2023-07-21T21:46:04.144 INFO:root:teuthology version: 0.0.1.dev153+g79491cb 2023-07-21T21:46:04.146 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721 --name rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi --description fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} --owner scheduled_rishabh@teuthology --verbose -- /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/orig.config.yaml 2023-07-21T21:46:04.208 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T21:46:04.305 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721 branch: wip-rishabh-2023Jul13-base-2 description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} email: null first_in_suite: false job_id: '7347721' kernel: flavor: default kdb: true sha1: c685da6f56cc77f2cfb9c4221be3960522616caf last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.6' overrides: admin_socket: branch: wip-rishabh-2023Jul13-base-2 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - slow metadata IO - SLOW_OPS - slow request sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea subvols: create: 2 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-2023Jul13-base-2 sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea owner: scheduled_rishabh@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea sleep_before_teardown: 0 suite: fs suite_branch: wip-rishabh-2023Jul13-base-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi151.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi195.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools:rhel8 --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph mgr module enable snap_schedule - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 500 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 79491cb69dd37a1eafb93b3471998174bdfa2fd9 timestamp: 2023-07-21_21:30:53 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-07-21T21:46:04.306 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa; will attempt to use it 2023-07-21T21:46:04.307 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks 2023-07-21T21:46:04.307 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-07-21T21:46:04.309 INFO:teuthology.task.internal:Checking packages... 2023-07-21T21:46:04.337 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea' 2023-07-21T21:46:04.338 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-07-21T21:46:04.338 INFO:teuthology.packaging:ref: None 2023-07-21T21:46:04.338 INFO:teuthology.packaging:tag: None 2023-07-21T21:46:04.339 INFO:teuthology.packaging:branch: wip-rishabh-2023Jul13-base-2 2023-07-21T21:46:04.339 INFO:teuthology.packaging:sha1: bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T21:46:04.339 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-rishabh-2023Jul13-base-2 2023-07-21T21:46:04.914 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-4735.gbffe049d 2023-07-21T21:46:04.914 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-07-21T21:46:04.920 INFO:teuthology.task.internal:no buildpackages task found 2023-07-21T21:46:04.921 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-07-21T21:46:04.936 INFO:teuthology.task.internal:Saving configuration 2023-07-21T21:46:04.957 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-07-21T21:46:04.963 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T21:46:04.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:39:47.065139', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-21T21:46:05.016 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:39:47.066295', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-21T21:46:05.042 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:39:47.067740', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-21T21:46:05.043 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-07-21T21:46:05.049 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2023-07-21T21:46:05.049 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2023-07-21T21:46:05.049 INFO:teuthology.task.internal:roles: ubuntu@smithi195.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2023-07-21T21:46:05.050 INFO:teuthology.run_tasks:Running task console_log... 2023-07-21T21:46:05.164 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4d086c5670>, signals=[15]) 2023-07-21T21:46:05.165 INFO:teuthology.run_tasks:Running task internal.connect... 2023-07-21T21:46:05.171 INFO:teuthology.task.internal:Opening connections... 2023-07-21T21:46:05.172 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T21:46:05.173 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:46:05.242 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2023-07-21T21:46:05.243 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:46:05.309 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi195.front.sepia.ceph.com 2023-07-21T21:46:05.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:46:05.377 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-07-21T21:46:05.386 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-07-21T21:46:05.407 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-07-21T21:46:05.408 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-07-21T21:46:05.466 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T21:46:05.467 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T21:46:05.467 INFO:teuthology.orchestra.run.smithi151.stdout:ID="rhel" 2023-07-21T21:46:05.467 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="fedora" 2023-07-21T21:46:05.467 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="8.6" 2023-07-21T21:46:05.467 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el8" 2023-07-21T21:46:05.467 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T21:46:05.468 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-07-21T21:46:05.468 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T21:46:05.468 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T21:46:05.468 INFO:teuthology.orchestra.run.smithi151.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T21:46:05.468 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T21:46:05.468 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T21:46:05.468 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T21:46:05.469 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T21:46:05.469 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T21:46:05.469 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T21:46:05.469 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-07-21T21:46:05.496 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-07-21T21:46:05.517 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-07-21T21:46:05.517 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-07-21T21:46:05.577 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T21:46:05.577 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T21:46:05.577 INFO:teuthology.orchestra.run.smithi187.stdout:ID="rhel" 2023-07-21T21:46:05.577 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="fedora" 2023-07-21T21:46:05.577 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="8.6" 2023-07-21T21:46:05.578 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el8" 2023-07-21T21:46:05.578 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T21:46:05.578 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-07-21T21:46:05.578 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T21:46:05.578 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T21:46:05.578 INFO:teuthology.orchestra.run.smithi187.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T21:46:05.578 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T21:46:05.579 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T21:46:05.579 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T21:46:05.579 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T21:46:05.579 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T21:46:05.579 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T21:46:05.579 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-07-21T21:46:05.604 DEBUG:teuthology.orchestra.run.smithi195:> uname -m 2023-07-21T21:46:05.624 INFO:teuthology.orchestra.run.smithi195.stdout:x86_64 2023-07-21T21:46:05.624 DEBUG:teuthology.orchestra.run.smithi195:> cat /etc/os-release 2023-07-21T21:46:05.682 INFO:teuthology.orchestra.run.smithi195.stdout:NAME="Red Hat Enterprise Linux" 2023-07-21T21:46:05.683 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION="8.6 (Ootpa)" 2023-07-21T21:46:05.683 INFO:teuthology.orchestra.run.smithi195.stdout:ID="rhel" 2023-07-21T21:46:05.683 INFO:teuthology.orchestra.run.smithi195.stdout:ID_LIKE="fedora" 2023-07-21T21:46:05.683 INFO:teuthology.orchestra.run.smithi195.stdout:VERSION_ID="8.6" 2023-07-21T21:46:05.683 INFO:teuthology.orchestra.run.smithi195.stdout:PLATFORM_ID="platform:el8" 2023-07-21T21:46:05.683 INFO:teuthology.orchestra.run.smithi195.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-07-21T21:46:05.684 INFO:teuthology.orchestra.run.smithi195.stdout:ANSI_COLOR="0;31" 2023-07-21T21:46:05.684 INFO:teuthology.orchestra.run.smithi195.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-07-21T21:46:05.684 INFO:teuthology.orchestra.run.smithi195.stdout:HOME_URL="https://www.redhat.com/" 2023-07-21T21:46:05.684 INFO:teuthology.orchestra.run.smithi195.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-07-21T21:46:05.684 INFO:teuthology.orchestra.run.smithi195.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-07-21T21:46:05.684 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T21:46:05.684 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-07-21T21:46:05.685 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-07-21T21:46:05.685 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-07-21T21:46:05.685 INFO:teuthology.orchestra.run.smithi195.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-07-21T21:46:05.685 INFO:teuthology.lock.ops:Updating smithi195.front.sepia.ceph.com on lock server 2023-07-21T21:46:05.712 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-07-21T21:46:05.722 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-07-21T21:46:05.727 INFO:teuthology.task.internal:Checking for old test directory... 2023-07-21T21:46:05.727 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-07-21T21:46:05.729 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2023-07-21T21:46:05.732 DEBUG:teuthology.orchestra.run.smithi195:> test '!' -e /home/ubuntu/cephtest 2023-07-21T21:46:05.750 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-07-21T21:46:05.756 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-07-21T21:46:05.756 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-07-21T21:46:05.788 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2023-07-21T21:46:05.790 DEBUG:teuthology.orchestra.run.smithi195:> test -z $(ls -A /var/lib/ceph) 2023-07-21T21:46:05.817 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-07-21T21:46:05.911 INFO:teuthology.run_tasks:Running task kernel... 2023-07-21T21:46:05.926 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'} 2023-07-21T21:46:05.927 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'c685da6f56cc77f2cfb9c4221be3960522616caf'}}, timeout 300 2023-07-21T21:46:05.928 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T21:46:05.929 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T21:46:05.929 DEBUG:teuthology.orchestra.run.smithi195:> test -f /run/.containerenv -o -f /.dockerenv 2023-07-21T21:46:05.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:46:05.948 DEBUG:teuthology.task.kernel:sha1 for mon.a is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:05.948 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-21T21:46:05.948 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-07-21T21:46:05.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:46:05.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:46:05.950 DEBUG:teuthology.task.kernel:sha1 for mon.b is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:05.950 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-21T21:46:05.950 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-07-21T21:46:05.951 DEBUG:teuthology.task.kernel:sha1 for mon.c is c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:05.951 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "c685da6f56cc77f2cfb9c4221be3960522616caf"... 2023-07-21T21:46:05.951 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2023-07-21T21:46:06.006 INFO:teuthology.orchestra.run.smithi151.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-21T21:46:06.006 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:06.006 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-21T21:46:06.007 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:06.010 INFO:teuthology.orchestra.run.smithi187.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-21T21:46:06.010 INFO:teuthology.orchestra.run.smithi195.stdout:4.18.0-372.9.1.el8.x86_64 2023-07-21T21:46:06.011 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:06.011 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-21T21:46:06.011 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:06.012 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-372.9.1.el8.x86_64 vs c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:06.012 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-07-21T21:46:06.013 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:06.639 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum upgrade -y linux-firmware 2023-07-21T21:46:06.676 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum upgrade -y linux-firmware 2023-07-21T21:46:06.683 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum upgrade -y linux-firmware 2023-07-21T21:46:07.810 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-21T21:46:07.811 INFO:teuthology.orchestra.run.smithi151.stdout:Unable to read consumer identity 2023-07-21T21:46:07.846 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-07-21T21:46:07.846 INFO:teuthology.orchestra.run.smithi195.stdout:Unable to read consumer identity 2023-07-21T21:46:07.890 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-07-21T21:46:07.890 INFO:teuthology.orchestra.run.smithi187.stdout:Unable to read consumer identity 2023-07-21T21:46:09.710 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 5.4 kB/s | 3.5 kB 00:00 2023-07-21T21:46:09.757 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 5.3 kB/s | 3.5 kB 00:00 2023-07-21T21:46:09.962 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 4.0 kB/s | 3.5 kB 00:00 2023-07-21T21:46:11.633 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 8.4 MB/s | 16 MB 00:01 2023-07-21T21:46:11.677 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 8.0 MB/s | 16 MB 00:01 2023-07-21T21:46:11.721 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 16 MB 00:01 2023-07-21T21:46:15.135 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 429 kB/s | 24 kB 00:00 2023-07-21T21:46:15.180 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 451 kB/s | 24 kB 00:00 2023-07-21T21:46:15.357 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 85 kB/s | 24 kB 00:00 2023-07-21T21:46:15.870 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-07-21T21:46:15.871 INFO:teuthology.orchestra.run.smithi151.stdout:Nothing to do. 2023-07-21T21:46:15.872 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-07-21T21:46:15.966 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-07-21T21:46:15.967 INFO:teuthology.orchestra.run.smithi195.stdout:Nothing to do. 2023-07-21T21:46:15.968 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-07-21T21:46:15.990 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.a... 2023-07-21T21:46:15.991 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:16.061 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-07-21T21:46:16.062 INFO:teuthology.orchestra.run.smithi187.stdout:Nothing to do. 2023-07-21T21:46:16.062 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-07-21T21:46:16.095 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.c... 2023-07-21T21:46:16.095 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:16.216 INFO:teuthology.task.kernel:Downloading kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.b... 2023-07-21T21:46:16.217 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&sha1=c685da6f56cc77f2cfb9c4221be3960522616caf 2023-07-21T21:46:16.469 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/centos/8/flavors/default/x86_64/ 2023-07-21T21:46:16.469 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_gc685da6f56cc-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-21T21:46:16.472 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi151.front.sepia.ceph.com to complete... 2023-07-21T21:46:16.566 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/centos/8/flavors/default/x86_64/ 2023-07-21T21:46:16.567 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_gc685da6f56cc-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-21T21:46:16.569 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi195.front.sepia.ceph.com to complete... 2023-07-21T21:46:16.708 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/centos/8/flavors/default/x86_64/ 2023-07-21T21:46:16.709 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.5.0_rc1_gc685da6f56cc-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/centos/8/flavors/default/x86_64/ --input-file=- 2023-07-21T21:46:16.711 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi187.front.sepia.ceph.com to complete... 2023-07-21T21:47:10.381 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21 21:47:10 URL:https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_gc685da6f56cc-1.x86_64.rpm [380683892/380683892] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-21T21:47:10.382 INFO:teuthology.orchestra.run.smithi195.stderr:FINISHED --2023-07-21 21:47:10-- 2023-07-21T21:47:10.383 INFO:teuthology.orchestra.run.smithi195.stderr:Total wall clock time: 54s 2023-07-21T21:47:10.383 INFO:teuthology.orchestra.run.smithi195.stderr:Downloaded: 1 files, 363M in 53s (6.83 MB/s) 2023-07-21T21:47:10.385 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.c... 2023-07-21T21:47:10.385 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-21T21:47:11.985 INFO:teuthology.orchestra.run.smithi195.stdout:Verifying... ######################################## 2023-07-21T21:47:12.042 INFO:teuthology.orchestra.run.smithi195.stdout:Preparing... ######################################## 2023-07-21T21:47:12.130 INFO:teuthology.orchestra.run.smithi195.stdout:Updating / installing... 2023-07-21T21:47:14.166 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21 21:47:14 URL:https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_gc685da6f56cc-1.x86_64.rpm [380683892/380683892] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-21T21:47:14.166 INFO:teuthology.orchestra.run.smithi187.stderr:FINISHED --2023-07-21 21:47:14-- 2023-07-21T21:47:14.166 INFO:teuthology.orchestra.run.smithi187.stderr:Total wall clock time: 57s 2023-07-21T21:47:14.166 INFO:teuthology.orchestra.run.smithi187.stderr:Downloaded: 1 files, 363M in 57s (6.39 MB/s) 2023-07-21T21:47:14.167 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.b... 2023-07-21T21:47:14.168 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-21T21:47:15.769 INFO:teuthology.orchestra.run.smithi187.stdout:Verifying... ######################################## 2023-07-21T21:47:15.928 INFO:teuthology.orchestra.run.smithi187.stdout:Preparing... ######################################## 2023-07-21T21:47:16.015 INFO:teuthology.orchestra.run.smithi187.stdout:Updating / installing... 2023-07-21T21:47:21.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21 21:47:21 URL:https://4.chacra.ceph.com/r/kernel/testing/c685da6f56cc77f2cfb9c4221be3960522616caf/centos/8/flavors/default/x86_64/kernel-6.5.0_rc1_gc685da6f56cc-1.x86_64.rpm [380683892/380683892] -> "/tmp/kernel.x86_64.rpm" [1] 2023-07-21T21:47:21.766 INFO:teuthology.orchestra.run.smithi151.stderr:FINISHED --2023-07-21 21:47:21-- 2023-07-21T21:47:21.767 INFO:teuthology.orchestra.run.smithi151.stderr:Total wall clock time: 1m 5s 2023-07-21T21:47:21.767 INFO:teuthology.orchestra.run.smithi151.stderr:Downloaded: 1 files, 363M in 1m 5s (5.62 MB/s) 2023-07-21T21:47:21.768 INFO:teuthology.task.kernel:Installing kernel c685da6f56cc77f2cfb9c4221be3960522616caf on mon.a... 2023-07-21T21:47:21.768 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-07-21T21:47:23.434 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying... ######################################## 2023-07-21T21:47:23.725 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing... ######################################## 2023-07-21T21:47:23.810 INFO:teuthology.orchestra.run.smithi151.stdout:Updating / installing... 2023-07-21T21:47:50.275 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-6.5.0_rc1_gc685da6f56cc-1 ######################################## 2023-07-21T21:47:54.114 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-6.5.0_rc1_gc685da6f56cc-1 ######################################## 2023-07-21T21:48:01.724 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-6.5.0_rc1_gc685da6f56cc-1 ######################################## 2023-07-21T21:48:14.252 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi195.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-21T21:48:14.253 DEBUG:teuthology.orchestra.run.smithi195:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-21T21:48:14.304 INFO:teuthology.orchestra.run.smithi195.stdout:/boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:14.305 INFO:teuthology.orchestra.run.smithi195.stdout:/boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:14.305 INFO:teuthology.orchestra.run.smithi195.stdout:/boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:14.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:14.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel 2023-07-21T21:48:14.305 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch 2023-07-21T21:48:14.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86 2023-07-21T21:48:14.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto 2023-07-21T21:48:14.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-21T21:48:14.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-21T21:48:14.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-21T21:48:14.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-21T21:48:14.306 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-21T21:48:14.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-21T21:48:14.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-21T21:48:14.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-21T21:48:14.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-21T21:48:14.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-21T21:48:14.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-21T21:48:14.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-21T21:48:14.307 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-21T21:48:14.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-21T21:48:14.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-21T21:48:14.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-21T21:48:14.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-21T21:48:14.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-21T21:48:14.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-21T21:48:14.308 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-21T21:48:14.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel 2023-07-21T21:48:14.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu 2023-07-21T21:48:14.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce 2023-07-21T21:48:14.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-21T21:48:14.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm 2023-07-21T21:48:14.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-21T21:48:14.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-21T21:48:14.309 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-21T21:48:14.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto 2023-07-21T21:48:14.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-21T21:48:14.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-21T21:48:14.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-21T21:48:14.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx 2023-07-21T21:48:14.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-21T21:48:14.310 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-21T21:48:14.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-21T21:48:14.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-21T21:48:14.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-21T21:48:14.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-21T21:48:14.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-21T21:48:14.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-21T21:48:14.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-21T21:48:14.311 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-21T21:48:14.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-21T21:48:14.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-21T21:48:14.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-21T21:48:14.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-21T21:48:14.312 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-21T21:48:14.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-21T21:48:14.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-21T21:48:14.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-21T21:48:14.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-21T21:48:14.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-21T21:48:14.313 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-21T21:48:14.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-21T21:48:14.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-21T21:48:14.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-21T21:48:14.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-21T21:48:14.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-21T21:48:14.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-21T21:48:14.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-21T21:48:14.314 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-21T21:48:14.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-21T21:48:14.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-21T21:48:14.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-21T21:48:14.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-21T21:48:14.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-21T21:48:14.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-21T21:48:14.315 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-21T21:48:14.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-21T21:48:14.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-21T21:48:14.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-21T21:48:14.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-21T21:48:14.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-21T21:48:14.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-21T21:48:14.316 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-21T21:48:14.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-21T21:48:14.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-21T21:48:14.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers 2023-07-21T21:48:14.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi 2023-07-21T21:48:14.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-21T21:48:14.317 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-21T21:48:14.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/custom_method.ko 2023-07-21T21:48:14.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-21T21:48:14.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-21T21:48:14.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-21T21:48:14.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-21T21:48:14.318 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-21T21:48:14.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata 2023-07-21T21:48:14.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-21T21:48:14.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-21T21:48:14.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ata_generic.ko 2023-07-21T21:48:14.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-21T21:48:14.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-21T21:48:14.319 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-21T21:48:14.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-21T21:48:14.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-21T21:48:14.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-21T21:48:14.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-21T21:48:14.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-21T21:48:14.320 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-21T21:48:14.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-21T21:48:14.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-21T21:48:14.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-21T21:48:14.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-21T21:48:14.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-21T21:48:14.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-21T21:48:14.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-21T21:48:14.321 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-21T21:48:14.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-21T21:48:14.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-21T21:48:14.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-21T21:48:14.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-21T21:48:14.322 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-21T21:48:14.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-21T21:48:14.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-21T21:48:14.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-21T21:48:14.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-21T21:48:14.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-21T21:48:14.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-21T21:48:14.323 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-21T21:48:14.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-21T21:48:14.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-21T21:48:14.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-21T21:48:14.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-21T21:48:14.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-21T21:48:14.324 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-21T21:48:14.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sis.ko 2023-07-21T21:48:14.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-21T21:48:14.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-21T21:48:14.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-21T21:48:14.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-21T21:48:14.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-21T21:48:14.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-21T21:48:14.325 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-21T21:48:14.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-21T21:48:14.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-21T21:48:14.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-21T21:48:14.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-21T21:48:14.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-21T21:48:14.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-21T21:48:14.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-21T21:48:14.326 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-21T21:48:14.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-21T21:48:14.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-21T21:48:14.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay 2023-07-21T21:48:14.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-21T21:48:14.327 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base 2023-07-21T21:48:14.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base/regmap 2023-07-21T21:48:14.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-21T21:48:14.328 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-21T21:48:14.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma 2023-07-21T21:48:14.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-21T21:48:14.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block 2023-07-21T21:48:14.329 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe 2023-07-21T21:48:14.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-21T21:48:14.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/brd.ko 2023-07-21T21:48:14.330 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd 2023-07-21T21:48:14.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-21T21:48:14.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-21T21:48:14.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/loop.ko 2023-07-21T21:48:14.331 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx 2023-07-21T21:48:14.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-21T21:48:14.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-21T21:48:14.332 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk 2023-07-21T21:48:14.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-21T21:48:14.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-21T21:48:14.333 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-21T21:48:14.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/virtio_blk.ko 2023-07-21T21:48:14.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback 2023-07-21T21:48:14.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-21T21:48:14.334 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkfront.ko 2023-07-21T21:48:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram 2023-07-21T21:48:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-21T21:48:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char 2023-07-21T21:48:14.335 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-21T21:48:14.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random 2023-07-21T21:48:14.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-21T21:48:14.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-21T21:48:14.336 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-21T21:48:14.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-21T21:48:14.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-21T21:48:14.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi 2023-07-21T21:48:14.337 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-21T21:48:14.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-21T21:48:14.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-21T21:48:14.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-21T21:48:14.338 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-21T21:48:14.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-21T21:48:14.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-21T21:48:14.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave 2023-07-21T21:48:14.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-21T21:48:14.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-21T21:48:14.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-21T21:48:14.339 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm 2023-07-21T21:48:14.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm.ko 2023-07-21T21:48:14.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-21T21:48:14.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-21T21:48:14.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-21T21:48:14.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-21T21:48:14.340 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-21T21:48:14.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/uv_mmtimer.ko 2023-07-21T21:48:14.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/virtio_console.ko 2023-07-21T21:48:14.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq 2023-07-21T21:48:14.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-21T21:48:14.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-21T21:48:14.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-21T21:48:14.341 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-21T21:48:14.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-21T21:48:14.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-21T21:48:14.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto 2023-07-21T21:48:14.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp 2023-07-21T21:48:14.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-21T21:48:14.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-21T21:48:14.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel 2023-07-21T21:48:14.342 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat 2023-07-21T21:48:14.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common 2023-07-21T21:48:14.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-21T21:48:14.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-21T21:48:14.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-21T21:48:14.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-21T21:48:14.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-21T21:48:14.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio 2023-07-21T21:48:14.343 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-21T21:48:14.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca 2023-07-21T21:48:14.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-21T21:48:14.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/devfreq 2023-07-21T21:48:14.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-21T21:48:14.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma 2023-07-21T21:48:14.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw 2023-07-21T21:48:14.344 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-21T21:48:14.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat 2023-07-21T21:48:14.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-21T21:48:14.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac 2023-07-21T21:48:14.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-21T21:48:14.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-21T21:48:14.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-21T21:48:14.345 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-21T21:48:14.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-21T21:48:14.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-21T21:48:14.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-21T21:48:14.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-21T21:48:14.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-21T21:48:14.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-21T21:48:14.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-21T21:48:14.346 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-21T21:48:14.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-21T21:48:14.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware 2023-07-21T21:48:14.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/edd.ko 2023-07-21T21:48:14.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-21T21:48:14.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio 2023-07-21T21:48:14.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-21T21:48:14.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-21T21:48:14.347 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid 2023-07-21T21:48:14.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-21T21:48:14.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-21T21:48:14.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-21T21:48:14.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-21T21:48:14.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-21T21:48:14.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-21T21:48:14.348 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-21T21:48:14.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-21T21:48:14.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-21T21:48:14.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-21T21:48:14.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-21T21:48:14.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-21T21:48:14.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-21T21:48:14.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-21T21:48:14.349 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-21T21:48:14.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-21T21:48:14.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-21T21:48:14.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-21T21:48:14.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-21T21:48:14.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-21T21:48:14.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-21T21:48:14.350 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-21T21:48:14.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-21T21:48:14.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-21T21:48:14.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-21T21:48:14.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-21T21:48:14.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-21T21:48:14.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-21T21:48:14.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-21T21:48:14.351 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-21T21:48:14.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-21T21:48:14.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-21T21:48:14.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-21T21:48:14.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-21T21:48:14.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-21T21:48:14.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-21T21:48:14.352 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-21T21:48:14.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-21T21:48:14.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-21T21:48:14.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-21T21:48:14.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-21T21:48:14.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-21T21:48:14.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-21T21:48:14.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-21T21:48:14.353 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-21T21:48:14.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-21T21:48:14.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-21T21:48:14.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-21T21:48:14.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-21T21:48:14.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-21T21:48:14.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-21T21:48:14.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-21T21:48:14.354 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-21T21:48:14.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-21T21:48:14.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-21T21:48:14.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-21T21:48:14.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-21T21:48:14.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-21T21:48:14.355 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-21T21:48:14.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-21T21:48:14.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-21T21:48:14.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-21T21:48:14.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-21T21:48:14.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-21T21:48:14.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv 2023-07-21T21:48:14.356 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-21T21:48:14.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-21T21:48:14.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-21T21:48:14.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon 2023-07-21T21:48:14.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-21T21:48:14.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-21T21:48:14.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-21T21:48:14.357 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-21T21:48:14.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-21T21:48:14.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-21T21:48:14.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-21T21:48:14.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-21T21:48:14.358 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-21T21:48:14.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-21T21:48:14.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-21T21:48:14.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-21T21:48:14.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-21T21:48:14.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-21T21:48:14.359 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-21T21:48:14.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-21T21:48:14.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-21T21:48:14.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-21T21:48:14.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-21T21:48:14.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-21T21:48:14.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-21T21:48:14.360 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-21T21:48:14.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-21T21:48:14.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-21T21:48:14.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-21T21:48:14.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-21T21:48:14.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-21T21:48:14.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-21T21:48:14.361 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-21T21:48:14.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-21T21:48:14.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-21T21:48:14.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-21T21:48:14.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-21T21:48:14.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-21T21:48:14.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-21T21:48:14.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-21T21:48:14.362 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-21T21:48:14.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-21T21:48:14.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-21T21:48:14.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-21T21:48:14.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-21T21:48:14.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-21T21:48:14.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-21T21:48:14.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-21T21:48:14.363 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-21T21:48:14.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-21T21:48:14.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-21T21:48:14.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-21T21:48:14.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-21T21:48:14.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-21T21:48:14.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-21T21:48:14.364 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-21T21:48:14.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-21T21:48:14.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-21T21:48:14.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-21T21:48:14.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-21T21:48:14.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-21T21:48:14.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-21T21:48:14.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-21T21:48:14.365 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-21T21:48:14.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-21T21:48:14.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-21T21:48:14.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-21T21:48:14.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-21T21:48:14.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-21T21:48:14.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-21T21:48:14.366 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-21T21:48:14.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-21T21:48:14.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-21T21:48:14.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-21T21:48:14.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-21T21:48:14.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-21T21:48:14.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-21T21:48:14.367 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-21T21:48:14.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-21T21:48:14.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-21T21:48:14.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-21T21:48:14.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-21T21:48:14.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-21T21:48:14.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-21T21:48:14.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-21T21:48:14.368 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-21T21:48:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-21T21:48:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-21T21:48:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-21T21:48:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-21T21:48:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-21T21:48:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-21T21:48:14.369 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus 2023-07-21T21:48:14.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-21T21:48:14.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-21T21:48:14.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-21T21:48:14.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-21T21:48:14.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-21T21:48:14.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-21T21:48:14.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-21T21:48:14.370 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-21T21:48:14.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-21T21:48:14.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-21T21:48:14.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-21T21:48:14.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-21T21:48:14.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-21T21:48:14.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-21T21:48:14.371 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-21T21:48:14.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-21T21:48:14.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-21T21:48:14.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-21T21:48:14.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-21T21:48:14.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-21T21:48:14.372 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-21T21:48:14.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-21T21:48:14.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-21T21:48:14.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-21T21:48:14.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-21T21:48:14.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-21T21:48:14.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-21T21:48:14.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-21T21:48:14.373 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-21T21:48:14.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-21T21:48:14.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-21T21:48:14.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-21T21:48:14.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-21T21:48:14.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-21T21:48:14.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-21T21:48:14.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-21T21:48:14.374 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-21T21:48:14.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-21T21:48:14.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-21T21:48:14.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-21T21:48:14.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-21T21:48:14.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c 2023-07-21T21:48:14.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos 2023-07-21T21:48:14.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-21T21:48:14.375 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-21T21:48:14.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses 2023-07-21T21:48:14.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-21T21:48:14.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-21T21:48:14.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-21T21:48:14.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-21T21:48:14.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-21T21:48:14.376 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-21T21:48:14.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-21T21:48:14.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-21T21:48:14.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-21T21:48:14.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-21T21:48:14.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-21T21:48:14.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-21T21:48:14.377 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-21T21:48:14.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-21T21:48:14.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-21T21:48:14.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-21T21:48:14.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-21T21:48:14.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-21T21:48:14.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-21T21:48:14.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-21T21:48:14.378 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-21T21:48:14.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-21T21:48:14.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-21T21:48:14.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-dev.ko 2023-07-21T21:48:14.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-21T21:48:14.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-21T21:48:14.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-21T21:48:14.379 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-21T21:48:14.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband 2023-07-21T21:48:14.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core 2023-07-21T21:48:14.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-21T21:48:14.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-21T21:48:14.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-21T21:48:14.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-21T21:48:14.380 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-21T21:48:14.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-21T21:48:14.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-21T21:48:14.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw 2023-07-21T21:48:14.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4 2023-07-21T21:48:14.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-21T21:48:14.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4 2023-07-21T21:48:14.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-21T21:48:14.381 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5 2023-07-21T21:48:14.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-21T21:48:14.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca 2023-07-21T21:48:14.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-21T21:48:14.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp 2023-07-21T21:48:14.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib 2023-07-21T21:48:14.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-21T21:48:14.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser 2023-07-21T21:48:14.382 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-21T21:48:14.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert 2023-07-21T21:48:14.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-21T21:48:14.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp 2023-07-21T21:48:14.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-21T21:48:14.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt 2023-07-21T21:48:14.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-21T21:48:14.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input 2023-07-21T21:48:14.383 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport 2023-07-21T21:48:14.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-21T21:48:14.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-21T21:48:14.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-21T21:48:14.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-21T21:48:14.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-21T21:48:14.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-21T21:48:14.384 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard 2023-07-21T21:48:14.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-21T21:48:14.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse 2023-07-21T21:48:14.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-21T21:48:14.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-21T21:48:14.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-21T21:48:14.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-21T21:48:14.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-21T21:48:14.385 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-21T21:48:14.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-21T21:48:14.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-21T21:48:14.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4 2023-07-21T21:48:14.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-21T21:48:14.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio 2023-07-21T21:48:14.386 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-21T21:48:14.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-21T21:48:14.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-21T21:48:14.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-21T21:48:14.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-21T21:48:14.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu 2023-07-21T21:48:14.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd 2023-07-21T21:48:14.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-21T21:48:14.387 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds 2023-07-21T21:48:14.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-21T21:48:14.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-21T21:48:14.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-21T21:48:14.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-21T21:48:14.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger 2023-07-21T21:48:14.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-21T21:48:14.388 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-21T21:48:14.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-21T21:48:14.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-21T21:48:14.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-21T21:48:14.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-21T21:48:14.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-21T21:48:14.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-21T21:48:14.389 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md 2023-07-21T21:48:14.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache 2023-07-21T21:48:14.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-21T21:48:14.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-21T21:48:14.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-21T21:48:14.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-21T21:48:14.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-21T21:48:14.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-21T21:48:14.390 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-21T21:48:14.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-21T21:48:14.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-21T21:48:14.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-21T21:48:14.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-21T21:48:14.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-21T21:48:14.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-21T21:48:14.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-21T21:48:14.391 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-21T21:48:14.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-21T21:48:14.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-21T21:48:14.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-21T21:48:14.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-21T21:48:14.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data 2023-07-21T21:48:14.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-21T21:48:14.392 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-21T21:48:14.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-21T21:48:14.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-21T21:48:14.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-21T21:48:14.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message 2023-07-21T21:48:14.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion 2023-07-21T21:48:14.393 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-21T21:48:14.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-21T21:48:14.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-21T21:48:14.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-21T21:48:14.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-21T21:48:14.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-21T21:48:14.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-21T21:48:14.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd 2023-07-21T21:48:14.394 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-21T21:48:14.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-21T21:48:14.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mfd-core.ko 2023-07-21T21:48:14.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-21T21:48:14.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-21T21:48:14.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-21T21:48:14.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-21T21:48:14.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc 2023-07-21T21:48:14.395 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl 2023-07-21T21:48:14.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-21T21:48:14.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-21T21:48:14.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-21T21:48:14.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-21T21:48:14.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710 2023-07-21T21:48:14.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-21T21:48:14.396 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom 2023-07-21T21:48:14.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-21T21:48:14.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-21T21:48:14.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-21T21:48:14.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-21T21:48:14.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-21T21:48:14.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-21T21:48:14.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-21T21:48:14.397 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-21T21:48:14.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d 2023-07-21T21:48:14.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-21T21:48:14.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-21T21:48:14.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei 2023-07-21T21:48:14.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-21T21:48:14.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-21T21:48:14.398 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-21T21:48:14.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-gru 2023-07-21T21:48:14.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-21T21:48:14.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp 2023-07-21T21:48:14.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-21T21:48:14.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-21T21:48:14.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-21T21:48:14.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-21T21:48:14.399 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-21T21:48:14.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-21T21:48:14.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-21T21:48:14.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci 2023-07-21T21:48:14.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-21T21:48:14.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net 2023-07-21T21:48:14.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding 2023-07-21T21:48:14.400 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-21T21:48:14.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa 2023-07-21T21:48:14.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53 2023-07-21T21:48:14.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-21T21:48:14.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-21T21:48:14.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-21T21:48:14.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx 2023-07-21T21:48:14.401 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-21T21:48:14.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-21T21:48:14.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-21T21:48:14.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet 2023-07-21T21:48:14.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com 2023-07-21T21:48:14.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-21T21:48:14.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-21T21:48:14.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-21T21:48:14.402 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-21T21:48:14.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390 2023-07-21T21:48:14.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-21T21:48:14.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-21T21:48:14.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-21T21:48:14.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-21T21:48:14.403 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec 2023-07-21T21:48:14.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-21T21:48:14.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere 2023-07-21T21:48:14.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-21T21:48:14.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon 2023-07-21T21:48:14.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-21T21:48:14.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera 2023-07-21T21:48:14.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-21T21:48:14.404 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd 2023-07-21T21:48:14.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-21T21:48:14.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-21T21:48:14.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-21T21:48:14.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros 2023-07-21T21:48:14.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx 2023-07-21T21:48:14.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-21T21:48:14.405 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-21T21:48:14.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-21T21:48:14.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-21T21:48:14.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-21T21:48:14.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx 2023-07-21T21:48:14.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-21T21:48:14.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-21T21:48:14.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom 2023-07-21T21:48:14.406 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-21T21:48:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-21T21:48:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-21T21:48:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-21T21:48:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-21T21:48:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet 2023-07-21T21:48:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-21T21:48:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-21T21:48:14.407 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade 2023-07-21T21:48:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna 2023-07-21T21:48:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-21T21:48:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio 2023-07-21T21:48:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-21T21:48:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-21T21:48:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-21T21:48:14.408 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-21T21:48:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-21T21:48:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-21T21:48:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-21T21:48:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-21T21:48:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-21T21:48:14.409 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-21T21:48:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco 2023-07-21T21:48:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic 2023-07-21T21:48:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-21T21:48:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec 2023-07-21T21:48:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip 2023-07-21T21:48:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-21T21:48:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-21T21:48:14.410 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-21T21:48:14.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-21T21:48:14.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-21T21:48:14.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-21T21:48:14.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink 2023-07-21T21:48:14.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-21T21:48:14.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-21T21:48:14.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-21T21:48:14.411 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex 2023-07-21T21:48:14.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet 2023-07-21T21:48:14.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-21T21:48:14.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-21T21:48:14.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-21T21:48:14.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel 2023-07-21T21:48:14.412 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-21T21:48:14.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000 2023-07-21T21:48:14.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-21T21:48:14.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e 2023-07-21T21:48:14.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-21T21:48:14.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k 2023-07-21T21:48:14.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-21T21:48:14.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e 2023-07-21T21:48:14.413 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-21T21:48:14.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf 2023-07-21T21:48:14.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-21T21:48:14.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb 2023-07-21T21:48:14.414 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-21T21:48:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf 2023-07-21T21:48:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-21T21:48:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-21T21:48:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-21T21:48:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-21T21:48:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-21T21:48:14.415 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-21T21:48:14.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell 2023-07-21T21:48:14.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-21T21:48:14.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-21T21:48:14.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-21T21:48:14.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox 2023-07-21T21:48:14.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-21T21:48:14.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-21T21:48:14.416 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-21T21:48:14.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-21T21:48:14.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-21T21:48:14.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-21T21:48:14.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel 2023-07-21T21:48:14.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-21T21:48:14.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom 2023-07-21T21:48:14.417 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-21T21:48:14.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-21T21:48:14.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi 2023-07-21T21:48:14.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-21T21:48:14.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-21T21:48:14.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion 2023-07-21T21:48:14.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-21T21:48:14.418 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia 2023-07-21T21:48:14.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-21T21:48:14.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines 2023-07-21T21:48:14.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-21T21:48:14.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-21T21:48:14.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic 2023-07-21T21:48:14.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-21T21:48:14.419 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-21T21:48:14.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-21T21:48:14.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-21T21:48:14.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-21T21:48:14.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc 2023-07-21T21:48:14.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-21T21:48:14.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek 2023-07-21T21:48:14.420 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-21T21:48:14.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-21T21:48:14.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-21T21:48:14.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-21T21:48:14.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rocker 2023-07-21T21:48:14.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-21T21:48:14.421 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc 2023-07-21T21:48:14.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-21T21:48:14.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan 2023-07-21T21:48:14.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-21T21:48:14.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis 2023-07-21T21:48:14.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-21T21:48:14.422 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-21T21:48:14.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc 2023-07-21T21:48:14.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-21T21:48:14.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-21T21:48:14.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-21T21:48:14.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-21T21:48:14.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro 2023-07-21T21:48:14.423 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-21T21:48:14.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-21T21:48:14.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-21T21:48:14.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun 2023-07-21T21:48:14.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-21T21:48:14.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-21T21:48:14.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-21T21:48:14.424 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-21T21:48:14.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti 2023-07-21T21:48:14.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-21T21:48:14.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti 2023-07-21T21:48:14.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-21T21:48:14.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via 2023-07-21T21:48:14.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-21T21:48:14.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-21T21:48:14.425 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet 2023-07-21T21:48:14.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-21T21:48:14.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-21T21:48:14.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom 2023-07-21T21:48:14.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-21T21:48:14.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-21T21:48:14.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv 2023-07-21T21:48:14.426 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-21T21:48:14.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154 2023-07-21T21:48:14.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-21T21:48:14.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-21T21:48:14.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan 2023-07-21T21:48:14.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-21T21:48:14.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-21T21:48:14.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-21T21:48:14.427 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio 2023-07-21T21:48:14.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-21T21:48:14.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-21T21:48:14.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-21T21:48:14.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-21T21:48:14.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-21T21:48:14.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/net_failover.ko 2023-07-21T21:48:14.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-21T21:48:14.428 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-21T21:48:14.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs 2023-07-21T21:48:14.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-21T21:48:14.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-21T21:48:14.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy 2023-07-21T21:48:14.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-21T21:48:14.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-21T21:48:14.429 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-21T21:48:14.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-21T21:48:14.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-21T21:48:14.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-21T21:48:14.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-21T21:48:14.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-21T21:48:14.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/dp83640.ko 2023-07-21T21:48:14.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-21T21:48:14.430 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-21T21:48:14.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-21T21:48:14.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-21T21:48:14.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-21T21:48:14.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-21T21:48:14.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-21T21:48:14.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-21T21:48:14.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-21T21:48:14.431 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-21T21:48:14.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-21T21:48:14.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-21T21:48:14.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp 2023-07-21T21:48:14.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-21T21:48:14.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-21T21:48:14.432 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-21T21:48:14.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-21T21:48:14.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-21T21:48:14.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-21T21:48:14.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-21T21:48:14.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-21T21:48:14.433 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-21T21:48:14.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip 2023-07-21T21:48:14.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slhc.ko 2023-07-21T21:48:14.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-21T21:48:14.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-21T21:48:14.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-21T21:48:14.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team 2023-07-21T21:48:14.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-21T21:48:14.434 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-21T21:48:14.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-21T21:48:14.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-21T21:48:14.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-21T21:48:14.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-21T21:48:14.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tun.ko 2023-07-21T21:48:14.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-21T21:48:14.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/virtio_net.ko 2023-07-21T21:48:14.435 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3 2023-07-21T21:48:14.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-21T21:48:14.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan 2023-07-21T21:48:14.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-21T21:48:14.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback 2023-07-21T21:48:14.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-21T21:48:14.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netfront.ko 2023-07-21T21:48:14.436 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb 2023-07-21T21:48:14.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-21T21:48:14.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme 2023-07-21T21:48:14.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host 2023-07-21T21:48:14.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-21T21:48:14.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-21T21:48:14.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport 2023-07-21T21:48:14.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-21T21:48:14.437 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-21T21:48:14.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-21T21:48:14.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-21T21:48:14.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci 2023-07-21T21:48:14.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug 2023-07-21T21:48:14.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-21T21:48:14.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pcie 2023-07-21T21:48:14.438 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-21T21:48:14.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-21T21:48:14.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia 2023-07-21T21:48:14.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-21T21:48:14.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-21T21:48:14.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-21T21:48:14.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl 2023-07-21T21:48:14.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel 2023-07-21T21:48:14.439 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-21T21:48:14.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform 2023-07-21T21:48:14.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86 2023-07-21T21:48:14.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-21T21:48:14.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-21T21:48:14.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-21T21:48:14.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-21T21:48:14.440 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-21T21:48:14.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-21T21:48:14.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-21T21:48:14.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-21T21:48:14.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-21T21:48:14.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-21T21:48:14.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-21T21:48:14.441 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-21T21:48:14.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel 2023-07-21T21:48:14.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-21T21:48:14.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-21T21:48:14.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-21T21:48:14.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-21T21:48:14.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-21T21:48:14.442 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-21T21:48:14.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-21T21:48:14.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-21T21:48:14.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-21T21:48:14.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-21T21:48:14.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-21T21:48:14.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-21T21:48:14.443 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap 2023-07-21T21:48:14.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-21T21:48:14.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-21T21:48:14.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps 2023-07-21T21:48:14.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients 2023-07-21T21:48:14.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-21T21:48:14.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-21T21:48:14.444 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-21T21:48:14.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-21T21:48:14.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp 2023-07-21T21:48:14.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-21T21:48:14.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-21T21:48:14.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc 2023-07-21T21:48:14.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-21T21:48:14.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-21T21:48:14.445 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-21T21:48:14.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-21T21:48:14.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-21T21:48:14.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-21T21:48:14.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-21T21:48:14.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-21T21:48:14.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-21T21:48:14.446 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-21T21:48:14.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-21T21:48:14.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-21T21:48:14.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-21T21:48:14.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-21T21:48:14.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-21T21:48:14.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-21T21:48:14.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-21T21:48:14.447 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-21T21:48:14.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-21T21:48:14.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-21T21:48:14.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-21T21:48:14.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-21T21:48:14.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-21T21:48:14.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-21T21:48:14.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-21T21:48:14.448 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-21T21:48:14.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-21T21:48:14.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-21T21:48:14.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-21T21:48:14.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-21T21:48:14.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-21T21:48:14.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-21T21:48:14.449 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi 2023-07-21T21:48:14.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-21T21:48:14.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-21T21:48:14.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-21T21:48:14.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-21T21:48:14.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-21T21:48:14.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid 2023-07-21T21:48:14.450 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-21T21:48:14.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-21T21:48:14.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx 2023-07-21T21:48:14.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-21T21:48:14.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-21T21:48:14.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-21T21:48:14.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr 2023-07-21T21:48:14.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-21T21:48:14.451 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-21T21:48:14.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi 2023-07-21T21:48:14.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-21T21:48:14.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa 2023-07-21T21:48:14.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-21T21:48:14.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc 2023-07-21T21:48:14.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-21T21:48:14.452 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i 2023-07-21T21:48:14.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-21T21:48:14.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-21T21:48:14.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor 2023-07-21T21:48:14.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-21T21:48:14.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi 2023-07-21T21:48:14.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-21T21:48:14.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-21T21:48:14.453 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-21T21:48:14.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-21T21:48:14.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-21T21:48:14.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-21T21:48:14.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler 2023-07-21T21:48:14.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-21T21:48:14.454 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-21T21:48:14.455 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-21T21:48:14.455 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-21T21:48:14.455 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-21T21:48:14.455 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r 2023-07-21T21:48:14.455 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-21T21:48:14.455 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-21T21:48:14.455 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe 2023-07-21T21:48:14.455 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-21T21:48:14.456 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-21T21:48:14.456 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic 2023-07-21T21:48:14.456 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-21T21:48:14.456 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-21T21:48:14.456 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-21T21:48:14.456 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-21T21:48:14.456 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-21T21:48:14.457 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-21T21:48:14.457 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-21T21:48:14.457 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci 2023-07-21T21:48:14.457 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-21T21:48:14.457 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-21T21:48:14.457 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-21T21:48:14.457 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc 2023-07-21T21:48:14.457 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-21T21:48:14.458 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-21T21:48:14.458 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-21T21:48:14.458 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas 2023-07-21T21:48:14.458 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-21T21:48:14.458 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc 2023-07-21T21:48:14.458 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-21T21:48:14.458 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid 2023-07-21T21:48:14.459 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-21T21:48:14.459 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-21T21:48:14.459 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-21T21:48:14.459 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-21T21:48:14.459 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas 2023-07-21T21:48:14.459 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-21T21:48:14.459 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas 2023-07-21T21:48:14.459 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-21T21:48:14.460 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-21T21:48:14.460 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001 2023-07-21T21:48:14.460 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-21T21:48:14.460 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-21T21:48:14.460 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-21T21:48:14.460 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx 2023-07-21T21:48:14.460 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-21T21:48:14.461 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-21T21:48:14.461 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx 2023-07-21T21:48:14.461 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-21T21:48:14.461 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-21T21:48:14.461 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-21T21:48:14.461 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-21T21:48:14.461 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-21T21:48:14.461 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-21T21:48:14.462 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-21T21:48:14.462 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-21T21:48:14.462 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-21T21:48:14.462 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-21T21:48:14.462 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-21T21:48:14.462 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2 2023-07-21T21:48:14.462 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-21T21:48:14.463 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-21T21:48:14.463 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-21T21:48:14.463 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-21T21:48:14.463 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb 2023-07-21T21:48:14.463 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-21T21:48:14.463 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target 2023-07-21T21:48:14.463 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi 2023-07-21T21:48:14.463 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-21T21:48:14.464 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback 2023-07-21T21:48:14.464 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-21T21:48:14.464 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-21T21:48:14.464 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-21T21:48:14.464 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-21T21:48:14.464 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-21T21:48:14.465 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-21T21:48:14.465 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc 2023-07-21T21:48:14.465 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-21T21:48:14.465 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal 2023-07-21T21:48:14.465 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel 2023-07-21T21:48:14.465 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal 2023-07-21T21:48:14.465 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-21T21:48:14.465 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-21T21:48:14.466 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-21T21:48:14.466 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-21T21:48:14.466 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-21T21:48:14.466 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-21T21:48:14.466 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-21T21:48:14.466 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-21T21:48:14.466 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-21T21:48:14.467 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-21T21:48:14.467 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-21T21:48:14.467 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-21T21:48:14.467 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-21T21:48:14.467 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-21T21:48:14.467 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-21T21:48:14.467 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty 2023-07-21T21:48:14.467 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless 2023-07-21T21:48:14.468 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-21T21:48:14.468 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-21T21:48:14.468 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-21T21:48:14.468 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-21T21:48:14.468 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial 2023-07-21T21:48:14.468 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250 2023-07-21T21:48:14.469 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-21T21:48:14.469 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-21T21:48:14.469 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm 2023-07-21T21:48:14.469 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-21T21:48:14.469 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-21T21:48:14.469 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs 2023-07-21T21:48:14.469 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core 2023-07-21T21:48:14.470 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-21T21:48:14.470 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host 2023-07-21T21:48:14.470 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-21T21:48:14.470 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio 2023-07-21T21:48:14.470 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-21T21:48:14.470 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-21T21:48:14.470 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-21T21:48:14.470 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-21T21:48:14.471 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-21T21:48:14.471 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb 2023-07-21T21:48:14.471 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class 2023-07-21T21:48:14.471 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-21T21:48:14.471 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-21T21:48:14.471 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-21T21:48:14.472 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-21T21:48:14.472 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host 2023-07-21T21:48:14.472 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-21T21:48:14.472 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image 2023-07-21T21:48:14.472 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-21T21:48:14.473 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-21T21:48:14.473 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc 2023-07-21T21:48:14.473 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-21T21:48:14.473 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-21T21:48:14.473 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-21T21:48:14.474 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-21T21:48:14.474 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-21T21:48:14.474 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-21T21:48:14.474 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-21T21:48:14.475 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-21T21:48:14.475 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-21T21:48:14.475 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-21T21:48:14.475 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga 2023-07-21T21:48:14.476 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-21T21:48:14.476 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-21T21:48:14.476 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-21T21:48:14.477 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-21T21:48:14.477 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-21T21:48:14.477 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-21T21:48:14.477 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-21T21:48:14.477 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy 2023-07-21T21:48:14.478 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-21T21:48:14.478 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial 2023-07-21T21:48:14.478 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-21T21:48:14.478 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-21T21:48:14.478 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-21T21:48:14.478 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-21T21:48:14.479 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-21T21:48:14.479 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-21T21:48:14.479 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-21T21:48:14.479 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-21T21:48:14.479 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-21T21:48:14.479 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-21T21:48:14.479 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-21T21:48:14.480 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-21T21:48:14.480 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-21T21:48:14.480 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-21T21:48:14.480 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-21T21:48:14.480 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-21T21:48:14.480 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-21T21:48:14.480 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-21T21:48:14.481 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-21T21:48:14.481 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-21T21:48:14.481 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-21T21:48:14.481 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-21T21:48:14.481 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-21T21:48:14.481 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-21T21:48:14.481 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-21T21:48:14.481 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-21T21:48:14.482 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-21T21:48:14.482 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-21T21:48:14.482 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-21T21:48:14.482 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-21T21:48:14.482 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-21T21:48:14.482 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-21T21:48:14.482 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-21T21:48:14.482 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-21T21:48:14.483 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-21T21:48:14.483 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-21T21:48:14.483 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-21T21:48:14.483 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-21T21:48:14.483 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-21T21:48:14.483 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-21T21:48:14.483 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-21T21:48:14.483 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-21T21:48:14.484 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-21T21:48:14.484 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-21T21:48:14.484 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-21T21:48:14.484 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage 2023-07-21T21:48:14.484 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-21T21:48:14.484 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-21T21:48:14.484 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-21T21:48:14.485 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-21T21:48:14.485 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-21T21:48:14.485 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-21T21:48:14.485 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-21T21:48:14.485 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-21T21:48:14.485 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-21T21:48:14.485 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-21T21:48:14.485 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-21T21:48:14.486 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-21T21:48:14.486 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-21T21:48:14.486 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-21T21:48:14.486 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-21T21:48:14.486 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip 2023-07-21T21:48:14.486 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-21T21:48:14.486 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-21T21:48:14.487 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-21T21:48:14.487 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio 2023-07-21T21:48:14.487 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci 2023-07-21T21:48:14.487 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-21T21:48:14.487 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-21T21:48:14.487 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-21T21:48:14.487 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-21T21:48:14.488 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost 2023-07-21T21:48:14.488 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-21T21:48:14.488 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-21T21:48:14.488 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-21T21:48:14.488 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-21T21:48:14.488 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video 2023-07-21T21:48:14.488 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight 2023-07-21T21:48:14.489 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-21T21:48:14.489 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-21T21:48:14.489 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-21T21:48:14.489 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio 2023-07-21T21:48:14.489 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio.ko 2023-07-21T21:48:14.489 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_balloon.ko 2023-07-21T21:48:14.489 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_mmio.ko 2023-07-21T21:48:14.489 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_pci.ko 2023-07-21T21:48:14.490 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-21T21:48:14.490 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-21T21:48:14.490 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_ring.ko 2023-07-21T21:48:14.490 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1 2023-07-21T21:48:14.490 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters 2023-07-21T21:48:14.490 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-21T21:48:14.490 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-21T21:48:14.490 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves 2023-07-21T21:48:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-21T21:48:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-21T21:48:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-21T21:48:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-21T21:48:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-21T21:48:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-21T21:48:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-21T21:48:14.491 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-21T21:48:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-21T21:48:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-21T21:48:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-21T21:48:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-21T21:48:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog 2023-07-21T21:48:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-21T21:48:14.492 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-21T21:48:14.493 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-21T21:48:14.493 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-21T21:48:14.493 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-21T21:48:14.493 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-21T21:48:14.493 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-21T21:48:14.493 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-21T21:48:14.493 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-21T21:48:14.493 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-21T21:48:14.494 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-21T21:48:14.494 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-21T21:48:14.494 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-21T21:48:14.494 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-21T21:48:14.494 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-21T21:48:14.494 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-21T21:48:14.494 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-21T21:48:14.494 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-21T21:48:14.495 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-21T21:48:14.495 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-21T21:48:14.495 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-21T21:48:14.495 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-21T21:48:14.495 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-21T21:48:14.495 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-21T21:48:14.495 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-21T21:48:14.495 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-21T21:48:14.496 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen 2023-07-21T21:48:14.496 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-21T21:48:14.496 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-21T21:48:14.496 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-21T21:48:14.496 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-21T21:48:14.497 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback 2023-07-21T21:48:14.497 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-21T21:48:14.497 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-21T21:48:14.497 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs 2023-07-21T21:48:14.497 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-21T21:48:14.497 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs 2023-07-21T21:48:14.497 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p 2023-07-21T21:48:14.497 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-21T21:48:14.498 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs 2023-07-21T21:48:14.498 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-21T21:48:14.498 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs 2023-07-21T21:48:14.498 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-21T21:48:14.498 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-21T21:48:14.498 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs 2023-07-21T21:48:14.498 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-21T21:48:14.498 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles 2023-07-21T21:48:14.499 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-21T21:48:14.499 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph 2023-07-21T21:48:14.499 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-21T21:48:14.499 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda 2023-07-21T21:48:14.500 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-21T21:48:14.500 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs 2023-07-21T21:48:14.500 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-21T21:48:14.500 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm 2023-07-21T21:48:14.500 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-21T21:48:14.500 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ecryptfs 2023-07-21T21:48:14.501 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-21T21:48:14.501 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs 2023-07-21T21:48:14.501 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-21T21:48:14.501 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat 2023-07-21T21:48:14.501 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/fat.ko 2023-07-21T21:48:14.501 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-21T21:48:14.501 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/vfat.ko 2023-07-21T21:48:14.501 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache 2023-07-21T21:48:14.502 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-21T21:48:14.502 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse 2023-07-21T21:48:14.502 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-21T21:48:14.502 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/fuse.ko 2023-07-21T21:48:14.502 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2 2023-07-21T21:48:14.502 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-21T21:48:14.502 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs 2023-07-21T21:48:14.503 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-21T21:48:14.503 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus 2023-07-21T21:48:14.503 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-21T21:48:14.503 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs 2023-07-21T21:48:14.503 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-21T21:48:14.504 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs 2023-07-21T21:48:14.504 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-21T21:48:14.504 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd 2023-07-21T21:48:14.504 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-21T21:48:14.505 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix 2023-07-21T21:48:14.505 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-21T21:48:14.505 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs 2023-07-21T21:48:14.505 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-21T21:48:14.506 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs 2023-07-21T21:48:14.506 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout 2023-07-21T21:48:14.506 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-21T21:48:14.506 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout 2023-07-21T21:48:14.507 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-21T21:48:14.507 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout 2023-07-21T21:48:14.507 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-21T21:48:14.507 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-21T21:48:14.507 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-21T21:48:14.508 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-21T21:48:14.508 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common 2023-07-21T21:48:14.508 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-21T21:48:14.508 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-21T21:48:14.508 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd 2023-07-21T21:48:14.508 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-21T21:48:14.508 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2 2023-07-21T21:48:14.509 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-21T21:48:14.509 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls 2023-07-21T21:48:14.509 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-21T21:48:14.509 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-21T21:48:14.509 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-21T21:48:14.509 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-21T21:48:14.509 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-21T21:48:14.509 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-21T21:48:14.510 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-21T21:48:14.510 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-21T21:48:14.510 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-21T21:48:14.510 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-21T21:48:14.510 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-21T21:48:14.510 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-21T21:48:14.510 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-21T21:48:14.511 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-21T21:48:14.511 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-21T21:48:14.511 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-21T21:48:14.511 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-21T21:48:14.511 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-21T21:48:14.511 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-21T21:48:14.511 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-21T21:48:14.511 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-21T21:48:14.512 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-21T21:48:14.512 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-21T21:48:14.512 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-21T21:48:14.512 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-21T21:48:14.512 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-21T21:48:14.512 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-21T21:48:14.513 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-21T21:48:14.513 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-21T21:48:14.513 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-21T21:48:14.513 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-21T21:48:14.513 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-21T21:48:14.513 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-21T21:48:14.513 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-21T21:48:14.514 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-21T21:48:14.514 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-21T21:48:14.514 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-21T21:48:14.514 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-21T21:48:14.514 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-21T21:48:14.514 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-21T21:48:14.514 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-21T21:48:14.514 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-21T21:48:14.515 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-21T21:48:14.515 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-21T21:48:14.515 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-21T21:48:14.515 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-21T21:48:14.515 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-21T21:48:14.515 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-21T21:48:14.515 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-21T21:48:14.515 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2 2023-07-21T21:48:14.516 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster 2023-07-21T21:48:14.516 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-21T21:48:14.516 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm 2023-07-21T21:48:14.516 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-21T21:48:14.516 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs 2023-07-21T21:48:14.516 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-21T21:48:14.516 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-21T21:48:14.516 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-21T21:48:14.517 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-21T21:48:14.517 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-21T21:48:14.517 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs 2023-07-21T21:48:14.517 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-21T21:48:14.517 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore 2023-07-21T21:48:14.517 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-21T21:48:14.517 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs 2023-07-21T21:48:14.517 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-21T21:48:14.518 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs 2023-07-21T21:48:14.518 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-21T21:48:14.518 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb 2023-07-21T21:48:14.518 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client 2023-07-21T21:48:14.518 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-21T21:48:14.518 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common 2023-07-21T21:48:14.518 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-21T21:48:14.519 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-21T21:48:14.519 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs 2023-07-21T21:48:14.519 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-21T21:48:14.519 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv 2023-07-21T21:48:14.519 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-21T21:48:14.519 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf 2023-07-21T21:48:14.519 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-21T21:48:14.520 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs 2023-07-21T21:48:14.520 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-21T21:48:14.520 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs 2023-07-21T21:48:14.520 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-21T21:48:14.520 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel 2023-07-21T21:48:14.520 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/rcu 2023-07-21T21:48:14.520 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/rcu/rcutorture.ko 2023-07-21T21:48:14.521 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-21T21:48:14.521 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/trace 2023-07-21T21:48:14.521 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-21T21:48:14.521 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib 2023-07-21T21:48:14.522 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/asn1_encoder.ko 2023-07-21T21:48:14.522 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-21T21:48:14.522 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-21T21:48:14.522 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto 2023-07-21T21:48:14.522 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-21T21:48:14.522 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-21T21:48:14.522 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-21T21:48:14.523 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-21T21:48:14.523 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4 2023-07-21T21:48:14.523 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-21T21:48:14.523 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-21T21:48:14.523 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math 2023-07-21T21:48:14.523 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-21T21:48:14.523 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6 2023-07-21T21:48:14.523 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-21T21:48:14.524 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon 2023-07-21T21:48:14.524 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-21T21:48:14.524 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-21T21:48:14.524 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-21T21:48:14.524 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-21T21:48:14.524 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/zstd 2023-07-21T21:48:14.524 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/zstd/zstd_compress.ko 2023-07-21T21:48:14.525 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm 2023-07-21T21:48:14.525 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-21T21:48:14.525 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net 2023-07-21T21:48:14.525 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan 2023-07-21T21:48:14.525 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-21T21:48:14.525 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-21T21:48:14.525 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-21T21:48:14.525 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-21T21:48:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-21T21:48:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-21T21:48:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-21T21:48:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-21T21:48:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802 2023-07-21T21:48:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-21T21:48:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-21T21:48:14.526 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-21T21:48:14.527 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-21T21:48:14.527 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-21T21:48:14.527 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q 2023-07-21T21:48:14.527 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-21T21:48:14.527 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p 2023-07-21T21:48:14.527 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-21T21:48:14.527 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-21T21:48:14.527 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-21T21:48:14.528 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-21T21:48:14.528 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv 2023-07-21T21:48:14.528 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-21T21:48:14.528 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge 2023-07-21T21:48:14.528 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-21T21:48:14.528 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-21T21:48:14.528 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter 2023-07-21T21:48:14.529 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-21T21:48:14.529 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-21T21:48:14.529 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-21T21:48:14.529 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-21T21:48:14.530 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-21T21:48:14.530 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-21T21:48:14.530 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-21T21:48:14.530 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-21T21:48:14.531 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-21T21:48:14.531 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-21T21:48:14.531 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-21T21:48:14.531 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-21T21:48:14.532 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-21T21:48:14.532 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-21T21:48:14.532 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-21T21:48:14.533 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-21T21:48:14.533 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-21T21:48:14.533 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-21T21:48:14.533 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-21T21:48:14.534 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-21T21:48:14.534 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-21T21:48:14.534 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-21T21:48:14.535 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-21T21:48:14.535 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-21T21:48:14.535 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph 2023-07-21T21:48:14.535 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-21T21:48:14.535 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core 2023-07-21T21:48:14.535 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/failover.ko 2023-07-21T21:48:14.535 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-21T21:48:14.535 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp 2023-07-21T21:48:14.536 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-21T21:48:14.536 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-21T21:48:14.536 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-21T21:48:14.536 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-21T21:48:14.536 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dns_resolver 2023-07-21T21:48:14.536 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dns_resolver/dns_resolver.ko 2023-07-21T21:48:14.536 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa 2023-07-21T21:48:14.537 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-21T21:48:14.537 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-21T21:48:14.537 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-21T21:48:14.537 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-21T21:48:14.537 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-21T21:48:14.537 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154 2023-07-21T21:48:14.537 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan 2023-07-21T21:48:14.537 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-21T21:48:14.538 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-21T21:48:14.538 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-21T21:48:14.538 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4 2023-07-21T21:48:14.538 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-21T21:48:14.538 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-21T21:48:14.538 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-21T21:48:14.538 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-21T21:48:14.538 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-21T21:48:14.539 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-21T21:48:14.539 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-21T21:48:14.539 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-21T21:48:14.539 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-21T21:48:14.539 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-21T21:48:14.539 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter 2023-07-21T21:48:14.539 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-21T21:48:14.539 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-21T21:48:14.540 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-21T21:48:14.540 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-21T21:48:14.540 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-21T21:48:14.540 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-21T21:48:14.540 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-21T21:48:14.540 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-21T21:48:14.540 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-21T21:48:14.541 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-21T21:48:14.541 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-21T21:48:14.541 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-21T21:48:14.541 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-21T21:48:14.541 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-21T21:48:14.541 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-21T21:48:14.541 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-21T21:48:14.542 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-21T21:48:14.542 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-21T21:48:14.542 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-21T21:48:14.542 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-21T21:48:14.542 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-21T21:48:14.542 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-21T21:48:14.543 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-21T21:48:14.543 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-21T21:48:14.543 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-21T21:48:14.543 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-21T21:48:14.544 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-21T21:48:14.544 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-21T21:48:14.544 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-21T21:48:14.544 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-21T21:48:14.544 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-21T21:48:14.544 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-21T21:48:14.545 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-21T21:48:14.545 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-21T21:48:14.545 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-21T21:48:14.545 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-21T21:48:14.545 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-21T21:48:14.546 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-21T21:48:14.546 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6 2023-07-21T21:48:14.546 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-21T21:48:14.546 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-21T21:48:14.547 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-21T21:48:14.547 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-21T21:48:14.547 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-21T21:48:14.547 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-21T21:48:14.548 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-21T21:48:14.548 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter 2023-07-21T21:48:14.548 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-21T21:48:14.549 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-21T21:48:14.549 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-21T21:48:14.549 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-21T21:48:14.549 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-21T21:48:14.550 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-21T21:48:14.550 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-21T21:48:14.550 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-21T21:48:14.551 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-21T21:48:14.551 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-21T21:48:14.551 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-21T21:48:14.551 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-21T21:48:14.551 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-21T21:48:14.551 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-21T21:48:14.552 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-21T21:48:14.552 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-21T21:48:14.552 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-21T21:48:14.552 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-21T21:48:14.552 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-21T21:48:14.553 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-21T21:48:14.553 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-21T21:48:14.553 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-21T21:48:14.553 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-21T21:48:14.553 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-21T21:48:14.553 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-21T21:48:14.553 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-21T21:48:14.553 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-21T21:48:14.554 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key 2023-07-21T21:48:14.554 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-21T21:48:14.554 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp 2023-07-21T21:48:14.554 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-21T21:48:14.554 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-21T21:48:14.554 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-21T21:48:14.554 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-21T21:48:14.554 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-21T21:48:14.555 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-21T21:48:14.555 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-21T21:48:14.555 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc 2023-07-21T21:48:14.555 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-21T21:48:14.555 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154 2023-07-21T21:48:14.555 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-21T21:48:14.555 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls 2023-07-21T21:48:14.555 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-21T21:48:14.556 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter 2023-07-21T21:48:14.556 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset 2023-07-21T21:48:14.556 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-21T21:48:14.556 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-21T21:48:14.556 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-21T21:48:14.556 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-21T21:48:14.556 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-21T21:48:14.557 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-21T21:48:14.557 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-21T21:48:14.557 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-21T21:48:14.557 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-21T21:48:14.557 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-21T21:48:14.557 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-21T21:48:14.558 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-21T21:48:14.558 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-21T21:48:14.558 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-21T21:48:14.558 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-21T21:48:14.558 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-21T21:48:14.558 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs 2023-07-21T21:48:14.558 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-21T21:48:14.559 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-21T21:48:14.559 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-21T21:48:14.559 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-21T21:48:14.559 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-21T21:48:14.559 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-21T21:48:14.559 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-21T21:48:14.560 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-21T21:48:14.560 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-21T21:48:14.560 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-21T21:48:14.560 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-21T21:48:14.560 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-21T21:48:14.560 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-21T21:48:14.560 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-21T21:48:14.561 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-21T21:48:14.561 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-21T21:48:14.561 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-21T21:48:14.561 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-21T21:48:14.561 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-21T21:48:14.561 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-21T21:48:14.562 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-21T21:48:14.562 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-21T21:48:14.562 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-21T21:48:14.562 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-21T21:48:14.562 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-21T21:48:14.562 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-21T21:48:14.562 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-21T21:48:14.562 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-21T21:48:14.563 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-21T21:48:14.563 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-21T21:48:14.563 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-21T21:48:14.563 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-21T21:48:14.563 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-21T21:48:14.563 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-21T21:48:14.563 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-21T21:48:14.563 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-21T21:48:14.564 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-21T21:48:14.564 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-21T21:48:14.564 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-21T21:48:14.564 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-21T21:48:14.564 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-21T21:48:14.564 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-21T21:48:14.564 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-21T21:48:14.565 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-21T21:48:14.565 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-21T21:48:14.565 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-21T21:48:14.565 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-21T21:48:14.565 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-21T21:48:14.565 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-21T21:48:14.565 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-21T21:48:14.566 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-21T21:48:14.566 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-21T21:48:14.566 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-21T21:48:14.566 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-21T21:48:14.566 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-21T21:48:14.566 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-21T21:48:14.566 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-21T21:48:14.566 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-21T21:48:14.567 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_quota.ko 2023-07-21T21:48:14.567 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-21T21:48:14.567 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-21T21:48:14.567 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-21T21:48:14.567 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-21T21:48:14.567 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tunnel.ko 2023-07-21T21:48:14.567 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-21T21:48:14.567 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-21T21:48:14.568 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-21T21:48:14.568 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-21T21:48:14.568 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-21T21:48:14.568 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-21T21:48:14.568 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-21T21:48:14.569 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-21T21:48:14.569 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-21T21:48:14.569 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-21T21:48:14.569 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-21T21:48:14.569 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-21T21:48:14.570 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-21T21:48:14.570 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-21T21:48:14.570 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-21T21:48:14.570 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-21T21:48:14.570 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-21T21:48:14.570 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-21T21:48:14.570 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-21T21:48:14.571 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-21T21:48:14.571 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-21T21:48:14.571 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-21T21:48:14.571 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-21T21:48:14.571 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-21T21:48:14.571 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-21T21:48:14.571 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-21T21:48:14.571 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-21T21:48:14.572 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-21T21:48:14.572 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-21T21:48:14.572 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-21T21:48:14.572 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-21T21:48:14.572 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-21T21:48:14.572 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-21T21:48:14.572 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-21T21:48:14.573 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-21T21:48:14.573 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-21T21:48:14.573 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-21T21:48:14.573 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-21T21:48:14.573 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-21T21:48:14.573 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-21T21:48:14.573 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-21T21:48:14.574 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-21T21:48:14.574 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-21T21:48:14.574 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-21T21:48:14.574 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-21T21:48:14.574 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-21T21:48:14.574 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-21T21:48:14.574 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-21T21:48:14.574 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-21T21:48:14.575 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-21T21:48:14.575 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-21T21:48:14.575 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-21T21:48:14.575 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-21T21:48:14.575 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-21T21:48:14.575 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-21T21:48:14.575 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-21T21:48:14.575 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-21T21:48:14.576 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-21T21:48:14.576 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-21T21:48:14.576 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-21T21:48:14.576 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-21T21:48:14.576 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-21T21:48:14.576 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-21T21:48:14.576 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-21T21:48:14.577 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-21T21:48:14.577 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-21T21:48:14.577 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-21T21:48:14.577 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-21T21:48:14.577 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-21T21:48:14.577 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-21T21:48:14.577 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-21T21:48:14.577 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink 2023-07-21T21:48:14.578 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-21T21:48:14.578 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh 2023-07-21T21:48:14.578 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-21T21:48:14.578 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch 2023-07-21T21:48:14.578 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-21T21:48:14.578 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-21T21:48:14.579 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-21T21:48:14.579 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-21T21:48:14.579 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet 2023-07-21T21:48:14.579 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-21T21:48:14.579 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds 2023-07-21T21:48:14.579 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-21T21:48:14.579 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-21T21:48:14.580 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-21T21:48:14.580 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched 2023-07-21T21:48:14.580 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-21T21:48:14.580 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-21T21:48:14.580 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-21T21:48:14.580 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-21T21:48:14.580 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-21T21:48:14.581 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-21T21:48:14.581 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-21T21:48:14.581 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-21T21:48:14.581 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-21T21:48:14.581 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-21T21:48:14.581 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-21T21:48:14.581 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-21T21:48:14.581 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-21T21:48:14.582 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-21T21:48:14.582 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-21T21:48:14.582 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-21T21:48:14.582 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-21T21:48:14.582 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-21T21:48:14.582 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-21T21:48:14.582 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-21T21:48:14.583 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-21T21:48:14.583 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-21T21:48:14.583 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-21T21:48:14.583 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-21T21:48:14.583 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-21T21:48:14.583 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-21T21:48:14.583 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-21T21:48:14.583 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-21T21:48:14.584 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-21T21:48:14.584 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-21T21:48:14.584 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-21T21:48:14.584 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-21T21:48:14.584 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-21T21:48:14.584 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-21T21:48:14.584 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-21T21:48:14.584 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-21T21:48:14.585 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-21T21:48:14.585 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-21T21:48:14.585 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-21T21:48:14.585 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-21T21:48:14.585 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-21T21:48:14.585 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-21T21:48:14.585 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-21T21:48:14.586 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-21T21:48:14.586 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp 2023-07-21T21:48:14.586 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-21T21:48:14.586 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-21T21:48:14.586 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc 2023-07-21T21:48:14.586 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss 2023-07-21T21:48:14.586 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-21T21:48:14.586 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-21T21:48:14.587 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-21T21:48:14.587 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma 2023-07-21T21:48:14.587 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-21T21:48:14.587 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc 2023-07-21T21:48:14.587 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-21T21:48:14.587 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-21T21:48:14.587 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix 2023-07-21T21:48:14.588 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-21T21:48:14.588 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock 2023-07-21T21:48:14.588 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-21T21:48:14.588 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-21T21:48:14.588 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-21T21:48:14.588 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-21T21:48:14.588 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-21T21:48:14.589 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm 2023-07-21T21:48:14.589 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-21T21:48:14.589 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security 2023-07-21T21:48:14.589 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys 2023-07-21T21:48:14.589 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/encrypted-keys 2023-07-21T21:48:14.590 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-21T21:48:14.590 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/trusted-keys 2023-07-21T21:48:14.590 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/trusted-keys/trusted.ko 2023-07-21T21:48:14.590 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt 2023-07-21T21:48:14.590 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib 2023-07-21T21:48:14.590 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-21T21:48:14.590 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-21T21:48:14.591 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-21T21:48:14.591 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-21T21:48:14.591 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-21T21:48:14.591 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-21T21:48:14.591 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-21T21:48:14.591 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-21T21:48:14.591 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-21T21:48:14.591 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-21T21:48:14.592 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-21T21:48:14.592 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-21T21:48:14.592 INFO:teuthology.orchestra.run.smithi195.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-21T21:48:14.593 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:14.593 DEBUG:teuthology.orchestra.run.smithi195:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-21T21:48:14.618 INFO:teuthology.orchestra.run.smithi195.stdout:postinstall scriptlet (using /bin/sh): 2023-07-21T21:48:14.618 INFO:teuthology.orchestra.run.smithi195.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc -a -r /boot/System.map-6.5.0-rc1-gc685da6f56cc ]; then 2023-07-21T21:48:14.619 INFO:teuthology.orchestra.run.smithi195.stdout:cp /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc /boot/.vmlinuz-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:14.619 INFO:teuthology.orchestra.run.smithi195.stdout:cp /boot/System.map-6.5.0-rc1-gc685da6f56cc /boot/.System.map-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:14.619 INFO:teuthology.orchestra.run.smithi195.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc /boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:14.619 INFO:teuthology.orchestra.run.smithi195.stdout:/sbin/installkernel 6.5.0-rc1-gc685da6f56cc /boot/.vmlinuz-6.5.0-rc1-gc685da6f56cc-rpm /boot/.System.map-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:14.619 INFO:teuthology.orchestra.run.smithi195.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-gc685da6f56cc-rpm /boot/.System.map-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:14.619 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2023-07-21T21:48:14.620 INFO:teuthology.orchestra.run.smithi195.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-21T21:48:14.620 INFO:teuthology.orchestra.run.smithi195.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-21T21:48:14.620 INFO:teuthology.orchestra.run.smithi195.stdout:new-kernel-pkg --remove 6.5.0-rc1-gc685da6f56cc --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-gc685da6f56cc.img 2023-07-21T21:48:14.620 INFO:teuthology.orchestra.run.smithi195.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-21T21:48:14.620 INFO:teuthology.orchestra.run.smithi195.stdout:kernel-install remove 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:14.620 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2023-07-21T21:48:14.620 INFO:teuthology.orchestra.run.smithi195.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-21T21:48:14.621 INFO:teuthology.orchestra.run.smithi195.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-21T21:48:14.621 INFO:teuthology.orchestra.run.smithi195.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:14.621 INFO:teuthology.orchestra.run.smithi195.stdout:fi 2023-07-21T21:48:14.622 DEBUG:teuthology.orchestra.run.smithi195:> sudo rpm -qi grub2-tools 2023-07-21T21:48:14.696 INFO:teuthology.orchestra.run.smithi195.stdout:Name : grub2-tools 2023-07-21T21:48:14.696 INFO:teuthology.orchestra.run.smithi195.stdout:Epoch : 1 2023-07-21T21:48:14.696 INFO:teuthology.orchestra.run.smithi195.stdout:Version : 2.02 2023-07-21T21:48:14.696 INFO:teuthology.orchestra.run.smithi195.stdout:Release : 123.el8 2023-07-21T21:48:14.696 INFO:teuthology.orchestra.run.smithi195.stdout:Architecture: x86_64 2023-07-21T21:48:14.697 INFO:teuthology.orchestra.run.smithi195.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-21T21:48:14.697 INFO:teuthology.orchestra.run.smithi195.stdout:Group : System Environment/Base 2023-07-21T21:48:14.697 INFO:teuthology.orchestra.run.smithi195.stdout:Size : 9265450 2023-07-21T21:48:14.697 INFO:teuthology.orchestra.run.smithi195.stdout:License : GPLv3+ 2023-07-21T21:48:14.697 INFO:teuthology.orchestra.run.smithi195.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-21T21:48:14.697 INFO:teuthology.orchestra.run.smithi195.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-21T21:48:14.697 INFO:teuthology.orchestra.run.smithi195.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-21T21:48:14.698 INFO:teuthology.orchestra.run.smithi195.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-21T21:48:14.698 INFO:teuthology.orchestra.run.smithi195.stdout:Relocations : (not relocatable) 2023-07-21T21:48:14.698 INFO:teuthology.orchestra.run.smithi195.stdout:Packager : Red Hat, Inc. 2023-07-21T21:48:14.698 INFO:teuthology.orchestra.run.smithi195.stdout:Vendor : Red Hat, Inc. 2023-07-21T21:48:14.698 INFO:teuthology.orchestra.run.smithi195.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-21T21:48:14.698 INFO:teuthology.orchestra.run.smithi195.stdout:Summary : Support tools for GRUB. 2023-07-21T21:48:14.698 INFO:teuthology.orchestra.run.smithi195.stdout:Description : 2023-07-21T21:48:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T21:48:14.699 INFO:teuthology.orchestra.run.smithi195.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-21T21:48:14.699 INFO:teuthology.orchestra.run.smithi195.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-21T21:48:14.699 INFO:teuthology.orchestra.run.smithi195.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-21T21:48:14.699 INFO:teuthology.orchestra.run.smithi195.stdout:hardware devices. 2023-07-21T21:48:14.699 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T21:48:14.699 INFO:teuthology.orchestra.run.smithi195.stdout:This subpackage provides tools for support of all platforms. 2023-07-21T21:48:14.700 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-21T21:48:14.700 INFO:teuthology.task.kernel:Updating grub on smithi195 to boot 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:14.701 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-21T21:48:17.983 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-21T21:48:17.983 DEBUG:teuthology.orchestra.run.smithi187:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-21T21:48:18.034 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:18.034 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:18.034 INFO:teuthology.orchestra.run.smithi187.stdout:/boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:18.034 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:18.034 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel 2023-07-21T21:48:18.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch 2023-07-21T21:48:18.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86 2023-07-21T21:48:18.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto 2023-07-21T21:48:18.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-21T21:48:18.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-21T21:48:18.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-21T21:48:18.035 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-21T21:48:18.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-21T21:48:18.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-21T21:48:18.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-21T21:48:18.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-21T21:48:18.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-21T21:48:18.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-21T21:48:18.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-21T21:48:18.036 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-21T21:48:18.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-21T21:48:18.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-21T21:48:18.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-21T21:48:18.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-21T21:48:18.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-21T21:48:18.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-21T21:48:18.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-21T21:48:18.037 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-21T21:48:18.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel 2023-07-21T21:48:18.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu 2023-07-21T21:48:18.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce 2023-07-21T21:48:18.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-21T21:48:18.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm 2023-07-21T21:48:18.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-21T21:48:18.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-21T21:48:18.038 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-21T21:48:18.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto 2023-07-21T21:48:18.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-21T21:48:18.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-21T21:48:18.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-21T21:48:18.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx 2023-07-21T21:48:18.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-21T21:48:18.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-21T21:48:18.039 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-21T21:48:18.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-21T21:48:18.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-21T21:48:18.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-21T21:48:18.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-21T21:48:18.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-21T21:48:18.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-21T21:48:18.040 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-21T21:48:18.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-21T21:48:18.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-21T21:48:18.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-21T21:48:18.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-21T21:48:18.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-21T21:48:18.041 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-21T21:48:18.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-21T21:48:18.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-21T21:48:18.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-21T21:48:18.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-21T21:48:18.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-21T21:48:18.042 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-21T21:48:18.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-21T21:48:18.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-21T21:48:18.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-21T21:48:18.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-21T21:48:18.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-21T21:48:18.043 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-21T21:48:18.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-21T21:48:18.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-21T21:48:18.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-21T21:48:18.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-21T21:48:18.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-21T21:48:18.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-21T21:48:18.044 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-21T21:48:18.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-21T21:48:18.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-21T21:48:18.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-21T21:48:18.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-21T21:48:18.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-21T21:48:18.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-21T21:48:18.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-21T21:48:18.045 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-21T21:48:18.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-21T21:48:18.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-21T21:48:18.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers 2023-07-21T21:48:18.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi 2023-07-21T21:48:18.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-21T21:48:18.046 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-21T21:48:18.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/custom_method.ko 2023-07-21T21:48:18.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-21T21:48:18.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-21T21:48:18.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-21T21:48:18.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-21T21:48:18.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-21T21:48:18.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata 2023-07-21T21:48:18.047 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-21T21:48:18.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-21T21:48:18.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ata_generic.ko 2023-07-21T21:48:18.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-21T21:48:18.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-21T21:48:18.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-21T21:48:18.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-21T21:48:18.048 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-21T21:48:18.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-21T21:48:18.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-21T21:48:18.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-21T21:48:18.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-21T21:48:18.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-21T21:48:18.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-21T21:48:18.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-21T21:48:18.049 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-21T21:48:18.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-21T21:48:18.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-21T21:48:18.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-21T21:48:18.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-21T21:48:18.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-21T21:48:18.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-21T21:48:18.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-21T21:48:18.050 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-21T21:48:18.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-21T21:48:18.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-21T21:48:18.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-21T21:48:18.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-21T21:48:18.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-21T21:48:18.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-21T21:48:18.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-21T21:48:18.051 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-21T21:48:18.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-21T21:48:18.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-21T21:48:18.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-21T21:48:18.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-21T21:48:18.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-21T21:48:18.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-21T21:48:18.052 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sis.ko 2023-07-21T21:48:18.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-21T21:48:18.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-21T21:48:18.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-21T21:48:18.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-21T21:48:18.053 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-21T21:48:18.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-21T21:48:18.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-21T21:48:18.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-21T21:48:18.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-21T21:48:18.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-21T21:48:18.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-21T21:48:18.054 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-21T21:48:18.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-21T21:48:18.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-21T21:48:18.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-21T21:48:18.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-21T21:48:18.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-21T21:48:18.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay 2023-07-21T21:48:18.055 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-21T21:48:18.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base 2023-07-21T21:48:18.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base/regmap 2023-07-21T21:48:18.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-21T21:48:18.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-21T21:48:18.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma 2023-07-21T21:48:18.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-21T21:48:18.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block 2023-07-21T21:48:18.056 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe 2023-07-21T21:48:18.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-21T21:48:18.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/brd.ko 2023-07-21T21:48:18.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd 2023-07-21T21:48:18.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-21T21:48:18.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-21T21:48:18.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/loop.ko 2023-07-21T21:48:18.057 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx 2023-07-21T21:48:18.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-21T21:48:18.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-21T21:48:18.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk 2023-07-21T21:48:18.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-21T21:48:18.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-21T21:48:18.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-21T21:48:18.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/virtio_blk.ko 2023-07-21T21:48:18.058 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback 2023-07-21T21:48:18.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-21T21:48:18.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkfront.ko 2023-07-21T21:48:18.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram 2023-07-21T21:48:18.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-21T21:48:18.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char 2023-07-21T21:48:18.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-21T21:48:18.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random 2023-07-21T21:48:18.059 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-21T21:48:18.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-21T21:48:18.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-21T21:48:18.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-21T21:48:18.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-21T21:48:18.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi 2023-07-21T21:48:18.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-21T21:48:18.060 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-21T21:48:18.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-21T21:48:18.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-21T21:48:18.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-21T21:48:18.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-21T21:48:18.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-21T21:48:18.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave 2023-07-21T21:48:18.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-21T21:48:18.061 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-21T21:48:18.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-21T21:48:18.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm 2023-07-21T21:48:18.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm.ko 2023-07-21T21:48:18.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-21T21:48:18.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-21T21:48:18.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-21T21:48:18.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-21T21:48:18.062 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-21T21:48:18.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/uv_mmtimer.ko 2023-07-21T21:48:18.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/virtio_console.ko 2023-07-21T21:48:18.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq 2023-07-21T21:48:18.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-21T21:48:18.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-21T21:48:18.063 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-21T21:48:18.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-21T21:48:18.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-21T21:48:18.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-21T21:48:18.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto 2023-07-21T21:48:18.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp 2023-07-21T21:48:18.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-21T21:48:18.064 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-21T21:48:18.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel 2023-07-21T21:48:18.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat 2023-07-21T21:48:18.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common 2023-07-21T21:48:18.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-21T21:48:18.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-21T21:48:18.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-21T21:48:18.065 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-21T21:48:18.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-21T21:48:18.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio 2023-07-21T21:48:18.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-21T21:48:18.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca 2023-07-21T21:48:18.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-21T21:48:18.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/devfreq 2023-07-21T21:48:18.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-21T21:48:18.066 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma 2023-07-21T21:48:18.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw 2023-07-21T21:48:18.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-21T21:48:18.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat 2023-07-21T21:48:18.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-21T21:48:18.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac 2023-07-21T21:48:18.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-21T21:48:18.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-21T21:48:18.067 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-21T21:48:18.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-21T21:48:18.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-21T21:48:18.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-21T21:48:18.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-21T21:48:18.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-21T21:48:18.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-21T21:48:18.068 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-21T21:48:18.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-21T21:48:18.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-21T21:48:18.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-21T21:48:18.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware 2023-07-21T21:48:18.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/edd.ko 2023-07-21T21:48:18.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-21T21:48:18.069 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio 2023-07-21T21:48:18.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-21T21:48:18.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-21T21:48:18.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid 2023-07-21T21:48:18.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-21T21:48:18.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-21T21:48:18.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-21T21:48:18.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-21T21:48:18.070 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-21T21:48:18.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-21T21:48:18.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-21T21:48:18.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-21T21:48:18.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-21T21:48:18.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-21T21:48:18.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-21T21:48:18.071 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-21T21:48:18.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-21T21:48:18.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-21T21:48:18.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-21T21:48:18.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-21T21:48:18.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-21T21:48:18.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-21T21:48:18.072 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-21T21:48:18.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-21T21:48:18.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-21T21:48:18.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-21T21:48:18.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-21T21:48:18.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-21T21:48:18.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-21T21:48:18.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-21T21:48:18.073 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-21T21:48:18.074 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-21T21:48:18.074 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-21T21:48:18.074 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-21T21:48:18.074 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-21T21:48:18.074 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-21T21:48:18.074 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-21T21:48:18.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-21T21:48:18.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-21T21:48:18.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-21T21:48:18.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-21T21:48:18.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-21T21:48:18.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-21T21:48:18.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-21T21:48:18.075 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-21T21:48:18.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-21T21:48:18.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-21T21:48:18.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-21T21:48:18.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-21T21:48:18.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-21T21:48:18.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-21T21:48:18.076 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-21T21:48:18.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-21T21:48:18.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-21T21:48:18.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-21T21:48:18.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-21T21:48:18.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-21T21:48:18.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-21T21:48:18.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-21T21:48:18.077 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-21T21:48:18.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-21T21:48:18.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-21T21:48:18.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-21T21:48:18.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-21T21:48:18.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-21T21:48:18.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-21T21:48:18.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-21T21:48:18.078 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-21T21:48:18.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv 2023-07-21T21:48:18.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-21T21:48:18.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-21T21:48:18.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-21T21:48:18.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon 2023-07-21T21:48:18.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-21T21:48:18.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-21T21:48:18.079 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-21T21:48:18.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-21T21:48:18.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-21T21:48:18.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-21T21:48:18.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-21T21:48:18.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-21T21:48:18.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-21T21:48:18.080 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-21T21:48:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-21T21:48:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-21T21:48:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-21T21:48:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-21T21:48:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-21T21:48:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-21T21:48:18.081 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-21T21:48:18.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-21T21:48:18.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-21T21:48:18.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-21T21:48:18.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-21T21:48:18.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-21T21:48:18.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-21T21:48:18.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-21T21:48:18.082 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-21T21:48:18.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-21T21:48:18.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-21T21:48:18.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-21T21:48:18.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-21T21:48:18.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-21T21:48:18.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-21T21:48:18.083 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-21T21:48:18.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-21T21:48:18.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-21T21:48:18.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-21T21:48:18.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-21T21:48:18.084 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-21T21:48:18.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-21T21:48:18.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-21T21:48:18.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-21T21:48:18.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-21T21:48:18.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-21T21:48:18.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-21T21:48:18.085 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-21T21:48:18.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-21T21:48:18.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-21T21:48:18.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-21T21:48:18.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-21T21:48:18.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-21T21:48:18.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-21T21:48:18.086 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-21T21:48:18.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-21T21:48:18.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-21T21:48:18.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-21T21:48:18.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-21T21:48:18.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-21T21:48:18.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-21T21:48:18.087 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-21T21:48:18.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-21T21:48:18.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-21T21:48:18.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-21T21:48:18.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-21T21:48:18.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-21T21:48:18.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-21T21:48:18.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-21T21:48:18.088 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-21T21:48:18.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-21T21:48:18.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-21T21:48:18.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-21T21:48:18.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-21T21:48:18.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-21T21:48:18.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-21T21:48:18.089 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-21T21:48:18.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-21T21:48:18.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-21T21:48:18.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-21T21:48:18.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-21T21:48:18.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-21T21:48:18.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-21T21:48:18.090 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-21T21:48:18.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-21T21:48:18.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-21T21:48:18.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-21T21:48:18.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-21T21:48:18.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-21T21:48:18.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-21T21:48:18.091 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-21T21:48:18.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-21T21:48:18.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus 2023-07-21T21:48:18.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-21T21:48:18.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-21T21:48:18.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-21T21:48:18.092 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-21T21:48:18.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-21T21:48:18.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-21T21:48:18.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-21T21:48:18.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-21T21:48:18.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-21T21:48:18.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-21T21:48:18.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-21T21:48:18.093 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-21T21:48:18.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-21T21:48:18.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-21T21:48:18.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-21T21:48:18.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-21T21:48:18.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-21T21:48:18.094 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-21T21:48:18.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-21T21:48:18.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-21T21:48:18.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-21T21:48:18.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-21T21:48:18.095 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-21T21:48:18.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-21T21:48:18.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-21T21:48:18.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-21T21:48:18.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-21T21:48:18.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-21T21:48:18.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-21T21:48:18.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-21T21:48:18.096 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-21T21:48:18.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-21T21:48:18.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-21T21:48:18.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-21T21:48:18.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-21T21:48:18.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-21T21:48:18.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-21T21:48:18.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-21T21:48:18.097 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-21T21:48:18.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-21T21:48:18.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-21T21:48:18.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c 2023-07-21T21:48:18.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos 2023-07-21T21:48:18.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-21T21:48:18.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-21T21:48:18.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses 2023-07-21T21:48:18.098 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-21T21:48:18.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-21T21:48:18.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-21T21:48:18.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-21T21:48:18.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-21T21:48:18.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-21T21:48:18.099 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-21T21:48:18.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-21T21:48:18.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-21T21:48:18.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-21T21:48:18.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-21T21:48:18.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-21T21:48:18.100 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-21T21:48:18.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-21T21:48:18.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-21T21:48:18.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-21T21:48:18.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-21T21:48:18.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-21T21:48:18.101 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-21T21:48:18.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-21T21:48:18.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-21T21:48:18.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-21T21:48:18.102 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-21T21:48:18.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-dev.ko 2023-07-21T21:48:18.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-21T21:48:18.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-21T21:48:18.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-21T21:48:18.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-21T21:48:18.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband 2023-07-21T21:48:18.103 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core 2023-07-21T21:48:18.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-21T21:48:18.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-21T21:48:18.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-21T21:48:18.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-21T21:48:18.104 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-21T21:48:18.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-21T21:48:18.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-21T21:48:18.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw 2023-07-21T21:48:18.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4 2023-07-21T21:48:18.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-21T21:48:18.105 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4 2023-07-21T21:48:18.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-21T21:48:18.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5 2023-07-21T21:48:18.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-21T21:48:18.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca 2023-07-21T21:48:18.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-21T21:48:18.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp 2023-07-21T21:48:18.106 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib 2023-07-21T21:48:18.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-21T21:48:18.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser 2023-07-21T21:48:18.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-21T21:48:18.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert 2023-07-21T21:48:18.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-21T21:48:18.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp 2023-07-21T21:48:18.107 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-21T21:48:18.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt 2023-07-21T21:48:18.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-21T21:48:18.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input 2023-07-21T21:48:18.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport 2023-07-21T21:48:18.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-21T21:48:18.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-21T21:48:18.108 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-21T21:48:18.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-21T21:48:18.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-21T21:48:18.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-21T21:48:18.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard 2023-07-21T21:48:18.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-21T21:48:18.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse 2023-07-21T21:48:18.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-21T21:48:18.109 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-21T21:48:18.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-21T21:48:18.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-21T21:48:18.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-21T21:48:18.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-21T21:48:18.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-21T21:48:18.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-21T21:48:18.110 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4 2023-07-21T21:48:18.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-21T21:48:18.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio 2023-07-21T21:48:18.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-21T21:48:18.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-21T21:48:18.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-21T21:48:18.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-21T21:48:18.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-21T21:48:18.111 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu 2023-07-21T21:48:18.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd 2023-07-21T21:48:18.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-21T21:48:18.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds 2023-07-21T21:48:18.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-21T21:48:18.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-21T21:48:18.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-21T21:48:18.112 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-21T21:48:18.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger 2023-07-21T21:48:18.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-21T21:48:18.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-21T21:48:18.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-21T21:48:18.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-21T21:48:18.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-21T21:48:18.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-21T21:48:18.113 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-21T21:48:18.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-21T21:48:18.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md 2023-07-21T21:48:18.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache 2023-07-21T21:48:18.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-21T21:48:18.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-21T21:48:18.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-21T21:48:18.114 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-21T21:48:18.115 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-21T21:48:18.115 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-21T21:48:18.115 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-21T21:48:18.115 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-21T21:48:18.115 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-21T21:48:18.115 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-21T21:48:18.116 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-21T21:48:18.116 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-21T21:48:18.116 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-21T21:48:18.116 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-21T21:48:18.116 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-21T21:48:18.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-21T21:48:18.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-21T21:48:18.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-21T21:48:18.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-21T21:48:18.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data 2023-07-21T21:48:18.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-21T21:48:18.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-21T21:48:18.117 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-21T21:48:18.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-21T21:48:18.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-21T21:48:18.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message 2023-07-21T21:48:18.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion 2023-07-21T21:48:18.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-21T21:48:18.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-21T21:48:18.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-21T21:48:18.118 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-21T21:48:18.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-21T21:48:18.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-21T21:48:18.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-21T21:48:18.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd 2023-07-21T21:48:18.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-21T21:48:18.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-21T21:48:18.119 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mfd-core.ko 2023-07-21T21:48:18.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-21T21:48:18.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-21T21:48:18.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-21T21:48:18.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-21T21:48:18.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc 2023-07-21T21:48:18.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl 2023-07-21T21:48:18.120 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-21T21:48:18.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-21T21:48:18.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-21T21:48:18.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-21T21:48:18.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710 2023-07-21T21:48:18.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-21T21:48:18.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom 2023-07-21T21:48:18.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-21T21:48:18.121 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-21T21:48:18.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-21T21:48:18.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-21T21:48:18.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-21T21:48:18.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-21T21:48:18.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-21T21:48:18.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-21T21:48:18.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d 2023-07-21T21:48:18.122 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-21T21:48:18.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-21T21:48:18.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei 2023-07-21T21:48:18.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-21T21:48:18.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-21T21:48:18.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-21T21:48:18.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-gru 2023-07-21T21:48:18.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-21T21:48:18.123 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp 2023-07-21T21:48:18.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-21T21:48:18.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-21T21:48:18.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-21T21:48:18.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-21T21:48:18.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-21T21:48:18.124 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-21T21:48:18.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-21T21:48:18.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci 2023-07-21T21:48:18.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-21T21:48:18.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net 2023-07-21T21:48:18.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding 2023-07-21T21:48:18.125 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-21T21:48:18.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa 2023-07-21T21:48:18.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53 2023-07-21T21:48:18.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-21T21:48:18.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-21T21:48:18.126 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-21T21:48:18.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx 2023-07-21T21:48:18.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-21T21:48:18.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-21T21:48:18.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-21T21:48:18.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet 2023-07-21T21:48:18.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com 2023-07-21T21:48:18.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-21T21:48:18.127 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-21T21:48:18.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-21T21:48:18.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-21T21:48:18.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390 2023-07-21T21:48:18.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-21T21:48:18.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-21T21:48:18.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-21T21:48:18.128 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-21T21:48:18.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec 2023-07-21T21:48:18.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-21T21:48:18.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere 2023-07-21T21:48:18.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-21T21:48:18.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon 2023-07-21T21:48:18.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-21T21:48:18.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera 2023-07-21T21:48:18.129 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-21T21:48:18.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd 2023-07-21T21:48:18.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-21T21:48:18.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-21T21:48:18.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-21T21:48:18.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros 2023-07-21T21:48:18.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx 2023-07-21T21:48:18.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-21T21:48:18.130 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-21T21:48:18.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-21T21:48:18.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-21T21:48:18.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-21T21:48:18.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx 2023-07-21T21:48:18.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-21T21:48:18.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-21T21:48:18.131 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom 2023-07-21T21:48:18.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-21T21:48:18.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-21T21:48:18.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-21T21:48:18.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-21T21:48:18.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-21T21:48:18.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet 2023-07-21T21:48:18.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-21T21:48:18.132 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-21T21:48:18.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade 2023-07-21T21:48:18.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna 2023-07-21T21:48:18.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-21T21:48:18.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio 2023-07-21T21:48:18.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-21T21:48:18.133 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-21T21:48:18.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-21T21:48:18.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-21T21:48:18.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-21T21:48:18.134 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-21T21:48:18.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-21T21:48:18.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-21T21:48:18.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-21T21:48:18.135 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-21T21:48:18.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco 2023-07-21T21:48:18.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic 2023-07-21T21:48:18.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-21T21:48:18.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec 2023-07-21T21:48:18.136 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip 2023-07-21T21:48:18.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-21T21:48:18.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-21T21:48:18.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-21T21:48:18.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-21T21:48:18.137 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-21T21:48:18.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-21T21:48:18.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink 2023-07-21T21:48:18.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-21T21:48:18.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-21T21:48:18.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-21T21:48:18.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex 2023-07-21T21:48:18.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet 2023-07-21T21:48:18.138 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-21T21:48:18.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-21T21:48:18.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-21T21:48:18.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel 2023-07-21T21:48:18.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-21T21:48:18.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000 2023-07-21T21:48:18.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-21T21:48:18.139 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e 2023-07-21T21:48:18.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-21T21:48:18.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k 2023-07-21T21:48:18.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-21T21:48:18.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e 2023-07-21T21:48:18.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-21T21:48:18.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf 2023-07-21T21:48:18.140 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-21T21:48:18.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb 2023-07-21T21:48:18.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-21T21:48:18.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf 2023-07-21T21:48:18.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-21T21:48:18.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-21T21:48:18.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-21T21:48:18.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-21T21:48:18.141 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-21T21:48:18.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-21T21:48:18.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell 2023-07-21T21:48:18.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-21T21:48:18.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-21T21:48:18.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-21T21:48:18.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox 2023-07-21T21:48:18.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-21T21:48:18.142 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-21T21:48:18.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-21T21:48:18.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-21T21:48:18.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-21T21:48:18.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-21T21:48:18.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel 2023-07-21T21:48:18.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-21T21:48:18.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom 2023-07-21T21:48:18.143 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-21T21:48:18.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-21T21:48:18.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi 2023-07-21T21:48:18.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-21T21:48:18.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-21T21:48:18.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion 2023-07-21T21:48:18.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-21T21:48:18.144 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia 2023-07-21T21:48:18.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-21T21:48:18.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines 2023-07-21T21:48:18.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-21T21:48:18.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-21T21:48:18.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic 2023-07-21T21:48:18.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-21T21:48:18.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-21T21:48:18.145 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-21T21:48:18.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-21T21:48:18.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-21T21:48:18.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc 2023-07-21T21:48:18.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-21T21:48:18.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek 2023-07-21T21:48:18.146 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-21T21:48:18.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-21T21:48:18.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-21T21:48:18.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-21T21:48:18.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rocker 2023-07-21T21:48:18.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-21T21:48:18.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc 2023-07-21T21:48:18.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-21T21:48:18.147 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan 2023-07-21T21:48:18.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-21T21:48:18.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis 2023-07-21T21:48:18.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-21T21:48:18.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-21T21:48:18.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc 2023-07-21T21:48:18.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-21T21:48:18.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-21T21:48:18.148 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-21T21:48:18.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-21T21:48:18.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro 2023-07-21T21:48:18.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-21T21:48:18.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-21T21:48:18.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-21T21:48:18.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun 2023-07-21T21:48:18.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-21T21:48:18.149 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-21T21:48:18.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-21T21:48:18.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-21T21:48:18.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti 2023-07-21T21:48:18.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-21T21:48:18.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti 2023-07-21T21:48:18.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-21T21:48:18.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via 2023-07-21T21:48:18.150 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-21T21:48:18.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-21T21:48:18.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet 2023-07-21T21:48:18.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-21T21:48:18.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-21T21:48:18.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom 2023-07-21T21:48:18.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-21T21:48:18.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-21T21:48:18.151 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv 2023-07-21T21:48:18.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-21T21:48:18.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154 2023-07-21T21:48:18.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-21T21:48:18.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-21T21:48:18.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan 2023-07-21T21:48:18.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-21T21:48:18.152 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-21T21:48:18.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-21T21:48:18.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio 2023-07-21T21:48:18.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-21T21:48:18.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-21T21:48:18.153 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-21T21:48:18.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-21T21:48:18.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-21T21:48:18.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/net_failover.ko 2023-07-21T21:48:18.154 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-21T21:48:18.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-21T21:48:18.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs 2023-07-21T21:48:18.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-21T21:48:18.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-21T21:48:18.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy 2023-07-21T21:48:18.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-21T21:48:18.155 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-21T21:48:18.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-21T21:48:18.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-21T21:48:18.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-21T21:48:18.156 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-21T21:48:18.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-21T21:48:18.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-21T21:48:18.157 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/dp83640.ko 2023-07-21T21:48:18.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-21T21:48:18.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-21T21:48:18.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-21T21:48:18.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-21T21:48:18.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-21T21:48:18.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-21T21:48:18.158 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-21T21:48:18.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-21T21:48:18.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-21T21:48:18.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-21T21:48:18.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-21T21:48:18.159 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-21T21:48:18.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp 2023-07-21T21:48:18.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-21T21:48:18.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-21T21:48:18.160 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-21T21:48:18.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-21T21:48:18.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-21T21:48:18.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-21T21:48:18.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-21T21:48:18.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-21T21:48:18.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-21T21:48:18.161 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip 2023-07-21T21:48:18.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slhc.ko 2023-07-21T21:48:18.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-21T21:48:18.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-21T21:48:18.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-21T21:48:18.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team 2023-07-21T21:48:18.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-21T21:48:18.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-21T21:48:18.162 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-21T21:48:18.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-21T21:48:18.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-21T21:48:18.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-21T21:48:18.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tun.ko 2023-07-21T21:48:18.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-21T21:48:18.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/virtio_net.ko 2023-07-21T21:48:18.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3 2023-07-21T21:48:18.163 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-21T21:48:18.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan 2023-07-21T21:48:18.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-21T21:48:18.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback 2023-07-21T21:48:18.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-21T21:48:18.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netfront.ko 2023-07-21T21:48:18.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb 2023-07-21T21:48:18.164 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-21T21:48:18.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme 2023-07-21T21:48:18.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host 2023-07-21T21:48:18.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-21T21:48:18.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-21T21:48:18.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport 2023-07-21T21:48:18.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-21T21:48:18.165 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-21T21:48:18.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-21T21:48:18.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-21T21:48:18.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci 2023-07-21T21:48:18.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug 2023-07-21T21:48:18.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-21T21:48:18.166 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pcie 2023-07-21T21:48:18.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-21T21:48:18.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-21T21:48:18.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia 2023-07-21T21:48:18.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-21T21:48:18.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-21T21:48:18.167 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-21T21:48:18.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl 2023-07-21T21:48:18.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel 2023-07-21T21:48:18.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-21T21:48:18.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform 2023-07-21T21:48:18.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86 2023-07-21T21:48:18.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-21T21:48:18.168 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-21T21:48:18.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-21T21:48:18.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-21T21:48:18.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-21T21:48:18.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-21T21:48:18.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-21T21:48:18.169 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-21T21:48:18.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-21T21:48:18.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-21T21:48:18.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-21T21:48:18.170 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-21T21:48:18.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel 2023-07-21T21:48:18.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-21T21:48:18.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-21T21:48:18.171 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-21T21:48:18.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-21T21:48:18.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-21T21:48:18.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-21T21:48:18.172 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-21T21:48:18.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-21T21:48:18.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-21T21:48:18.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-21T21:48:18.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-21T21:48:18.173 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-21T21:48:18.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap 2023-07-21T21:48:18.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-21T21:48:18.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-21T21:48:18.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps 2023-07-21T21:48:18.174 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients 2023-07-21T21:48:18.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-21T21:48:18.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-21T21:48:18.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-21T21:48:18.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-21T21:48:18.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp 2023-07-21T21:48:18.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-21T21:48:18.175 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-21T21:48:18.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc 2023-07-21T21:48:18.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-21T21:48:18.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-21T21:48:18.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-21T21:48:18.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-21T21:48:18.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-21T21:48:18.176 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-21T21:48:18.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-21T21:48:18.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-21T21:48:18.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-21T21:48:18.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-21T21:48:18.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-21T21:48:18.177 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-21T21:48:18.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-21T21:48:18.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-21T21:48:18.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-21T21:48:18.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-21T21:48:18.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-21T21:48:18.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-21T21:48:18.178 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-21T21:48:18.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-21T21:48:18.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-21T21:48:18.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-21T21:48:18.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-21T21:48:18.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-21T21:48:18.179 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-21T21:48:18.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-21T21:48:18.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-21T21:48:18.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-21T21:48:18.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-21T21:48:18.180 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-21T21:48:18.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-21T21:48:18.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-21T21:48:18.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi 2023-07-21T21:48:18.181 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-21T21:48:18.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-21T21:48:18.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-21T21:48:18.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-21T21:48:18.182 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-21T21:48:18.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid 2023-07-21T21:48:18.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-21T21:48:18.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-21T21:48:18.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx 2023-07-21T21:48:18.183 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-21T21:48:18.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-21T21:48:18.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-21T21:48:18.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr 2023-07-21T21:48:18.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-21T21:48:18.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-21T21:48:18.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi 2023-07-21T21:48:18.184 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-21T21:48:18.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa 2023-07-21T21:48:18.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-21T21:48:18.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc 2023-07-21T21:48:18.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-21T21:48:18.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i 2023-07-21T21:48:18.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-21T21:48:18.185 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-21T21:48:18.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor 2023-07-21T21:48:18.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-21T21:48:18.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi 2023-07-21T21:48:18.186 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-21T21:48:18.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-21T21:48:18.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-21T21:48:18.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-21T21:48:18.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-21T21:48:18.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-21T21:48:18.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler 2023-07-21T21:48:18.187 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-21T21:48:18.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-21T21:48:18.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-21T21:48:18.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-21T21:48:18.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-21T21:48:18.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r 2023-07-21T21:48:18.188 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-21T21:48:18.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-21T21:48:18.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe 2023-07-21T21:48:18.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-21T21:48:18.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-21T21:48:18.189 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic 2023-07-21T21:48:18.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-21T21:48:18.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-21T21:48:18.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-21T21:48:18.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-21T21:48:18.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-21T21:48:18.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-21T21:48:18.190 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-21T21:48:18.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci 2023-07-21T21:48:18.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-21T21:48:18.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-21T21:48:18.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-21T21:48:18.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc 2023-07-21T21:48:18.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-21T21:48:18.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-21T21:48:18.191 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-21T21:48:18.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas 2023-07-21T21:48:18.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-21T21:48:18.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc 2023-07-21T21:48:18.192 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-21T21:48:18.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid 2023-07-21T21:48:18.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-21T21:48:18.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-21T21:48:18.193 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-21T21:48:18.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-21T21:48:18.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas 2023-07-21T21:48:18.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-21T21:48:18.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas 2023-07-21T21:48:18.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-21T21:48:18.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-21T21:48:18.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001 2023-07-21T21:48:18.194 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-21T21:48:18.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-21T21:48:18.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-21T21:48:18.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx 2023-07-21T21:48:18.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-21T21:48:18.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-21T21:48:18.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx 2023-07-21T21:48:18.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-21T21:48:18.195 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-21T21:48:18.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-21T21:48:18.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-21T21:48:18.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-21T21:48:18.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-21T21:48:18.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-21T21:48:18.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-21T21:48:18.196 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-21T21:48:18.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-21T21:48:18.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-21T21:48:18.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2 2023-07-21T21:48:18.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-21T21:48:18.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-21T21:48:18.197 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-21T21:48:18.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-21T21:48:18.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb 2023-07-21T21:48:18.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-21T21:48:18.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target 2023-07-21T21:48:18.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi 2023-07-21T21:48:18.198 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-21T21:48:18.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback 2023-07-21T21:48:18.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-21T21:48:18.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-21T21:48:18.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-21T21:48:18.199 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-21T21:48:18.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-21T21:48:18.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-21T21:48:18.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc 2023-07-21T21:48:18.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-21T21:48:18.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal 2023-07-21T21:48:18.200 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel 2023-07-21T21:48:18.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal 2023-07-21T21:48:18.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-21T21:48:18.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-21T21:48:18.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-21T21:48:18.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-21T21:48:18.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-21T21:48:18.201 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-21T21:48:18.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-21T21:48:18.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-21T21:48:18.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-21T21:48:18.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-21T21:48:18.202 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-21T21:48:18.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-21T21:48:18.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-21T21:48:18.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-21T21:48:18.203 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-21T21:48:18.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty 2023-07-21T21:48:18.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless 2023-07-21T21:48:18.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-21T21:48:18.204 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-21T21:48:18.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-21T21:48:18.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-21T21:48:18.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial 2023-07-21T21:48:18.205 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250 2023-07-21T21:48:18.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-21T21:48:18.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-21T21:48:18.206 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm 2023-07-21T21:48:18.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-21T21:48:18.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-21T21:48:18.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs 2023-07-21T21:48:18.207 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core 2023-07-21T21:48:18.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-21T21:48:18.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host 2023-07-21T21:48:18.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-21T21:48:18.208 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio 2023-07-21T21:48:18.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-21T21:48:18.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-21T21:48:18.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-21T21:48:18.209 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-21T21:48:18.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-21T21:48:18.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb 2023-07-21T21:48:18.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class 2023-07-21T21:48:18.210 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-21T21:48:18.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-21T21:48:18.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-21T21:48:18.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-21T21:48:18.211 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host 2023-07-21T21:48:18.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-21T21:48:18.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image 2023-07-21T21:48:18.212 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-21T21:48:18.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-21T21:48:18.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc 2023-07-21T21:48:18.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-21T21:48:18.213 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-21T21:48:18.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-21T21:48:18.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-21T21:48:18.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-21T21:48:18.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-21T21:48:18.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-21T21:48:18.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-21T21:48:18.214 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-21T21:48:18.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-21T21:48:18.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga 2023-07-21T21:48:18.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-21T21:48:18.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-21T21:48:18.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-21T21:48:18.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-21T21:48:18.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-21T21:48:18.215 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-21T21:48:18.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-21T21:48:18.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy 2023-07-21T21:48:18.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-21T21:48:18.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial 2023-07-21T21:48:18.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-21T21:48:18.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-21T21:48:18.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-21T21:48:18.216 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-21T21:48:18.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-21T21:48:18.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-21T21:48:18.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-21T21:48:18.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-21T21:48:18.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-21T21:48:18.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-21T21:48:18.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-21T21:48:18.217 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-21T21:48:18.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-21T21:48:18.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-21T21:48:18.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-21T21:48:18.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-21T21:48:18.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-21T21:48:18.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-21T21:48:18.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-21T21:48:18.218 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-21T21:48:18.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-21T21:48:18.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-21T21:48:18.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-21T21:48:18.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-21T21:48:18.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-21T21:48:18.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-21T21:48:18.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-21T21:48:18.219 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-21T21:48:18.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-21T21:48:18.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-21T21:48:18.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-21T21:48:18.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-21T21:48:18.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-21T21:48:18.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-21T21:48:18.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-21T21:48:18.220 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-21T21:48:18.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-21T21:48:18.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-21T21:48:18.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-21T21:48:18.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-21T21:48:18.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-21T21:48:18.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-21T21:48:18.221 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-21T21:48:18.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-21T21:48:18.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-21T21:48:18.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage 2023-07-21T21:48:18.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-21T21:48:18.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-21T21:48:18.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-21T21:48:18.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-21T21:48:18.222 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-21T21:48:18.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-21T21:48:18.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-21T21:48:18.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-21T21:48:18.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-21T21:48:18.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-21T21:48:18.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-21T21:48:18.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-21T21:48:18.223 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-21T21:48:18.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-21T21:48:18.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-21T21:48:18.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip 2023-07-21T21:48:18.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-21T21:48:18.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-21T21:48:18.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-21T21:48:18.224 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio 2023-07-21T21:48:18.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci 2023-07-21T21:48:18.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-21T21:48:18.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-21T21:48:18.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-21T21:48:18.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-21T21:48:18.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost 2023-07-21T21:48:18.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-21T21:48:18.225 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-21T21:48:18.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-21T21:48:18.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-21T21:48:18.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video 2023-07-21T21:48:18.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight 2023-07-21T21:48:18.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-21T21:48:18.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-21T21:48:18.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-21T21:48:18.226 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio 2023-07-21T21:48:18.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio.ko 2023-07-21T21:48:18.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_balloon.ko 2023-07-21T21:48:18.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_mmio.ko 2023-07-21T21:48:18.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_pci.ko 2023-07-21T21:48:18.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-21T21:48:18.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-21T21:48:18.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_ring.ko 2023-07-21T21:48:18.227 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1 2023-07-21T21:48:18.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters 2023-07-21T21:48:18.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-21T21:48:18.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-21T21:48:18.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves 2023-07-21T21:48:18.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-21T21:48:18.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-21T21:48:18.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-21T21:48:18.228 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-21T21:48:18.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-21T21:48:18.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-21T21:48:18.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-21T21:48:18.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-21T21:48:18.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-21T21:48:18.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-21T21:48:18.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-21T21:48:18.229 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-21T21:48:18.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog 2023-07-21T21:48:18.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-21T21:48:18.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-21T21:48:18.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-21T21:48:18.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-21T21:48:18.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-21T21:48:18.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-21T21:48:18.230 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-21T21:48:18.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-21T21:48:18.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-21T21:48:18.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-21T21:48:18.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-21T21:48:18.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-21T21:48:18.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-21T21:48:18.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-21T21:48:18.231 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-21T21:48:18.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-21T21:48:18.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-21T21:48:18.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-21T21:48:18.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-21T21:48:18.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-21T21:48:18.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-21T21:48:18.232 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-21T21:48:18.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-21T21:48:18.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-21T21:48:18.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-21T21:48:18.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-21T21:48:18.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen 2023-07-21T21:48:18.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-21T21:48:18.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-21T21:48:18.233 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-21T21:48:18.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-21T21:48:18.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback 2023-07-21T21:48:18.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-21T21:48:18.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-21T21:48:18.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs 2023-07-21T21:48:18.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-21T21:48:18.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs 2023-07-21T21:48:18.234 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p 2023-07-21T21:48:18.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-21T21:48:18.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs 2023-07-21T21:48:18.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-21T21:48:18.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs 2023-07-21T21:48:18.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-21T21:48:18.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-21T21:48:18.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs 2023-07-21T21:48:18.235 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-21T21:48:18.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles 2023-07-21T21:48:18.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-21T21:48:18.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph 2023-07-21T21:48:18.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-21T21:48:18.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda 2023-07-21T21:48:18.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-21T21:48:18.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs 2023-07-21T21:48:18.236 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-21T21:48:18.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm 2023-07-21T21:48:18.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-21T21:48:18.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ecryptfs 2023-07-21T21:48:18.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-21T21:48:18.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs 2023-07-21T21:48:18.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-21T21:48:18.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat 2023-07-21T21:48:18.237 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/fat.ko 2023-07-21T21:48:18.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-21T21:48:18.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/vfat.ko 2023-07-21T21:48:18.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache 2023-07-21T21:48:18.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-21T21:48:18.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse 2023-07-21T21:48:18.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-21T21:48:18.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/fuse.ko 2023-07-21T21:48:18.238 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2 2023-07-21T21:48:18.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-21T21:48:18.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs 2023-07-21T21:48:18.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-21T21:48:18.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus 2023-07-21T21:48:18.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-21T21:48:18.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs 2023-07-21T21:48:18.239 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-21T21:48:18.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs 2023-07-21T21:48:18.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-21T21:48:18.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd 2023-07-21T21:48:18.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-21T21:48:18.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix 2023-07-21T21:48:18.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-21T21:48:18.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs 2023-07-21T21:48:18.240 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-21T21:48:18.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs 2023-07-21T21:48:18.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout 2023-07-21T21:48:18.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-21T21:48:18.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout 2023-07-21T21:48:18.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-21T21:48:18.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout 2023-07-21T21:48:18.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-21T21:48:18.241 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-21T21:48:18.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-21T21:48:18.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-21T21:48:18.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common 2023-07-21T21:48:18.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-21T21:48:18.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-21T21:48:18.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd 2023-07-21T21:48:18.242 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-21T21:48:18.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2 2023-07-21T21:48:18.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-21T21:48:18.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls 2023-07-21T21:48:18.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-21T21:48:18.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-21T21:48:18.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-21T21:48:18.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-21T21:48:18.243 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-21T21:48:18.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-21T21:48:18.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-21T21:48:18.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-21T21:48:18.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-21T21:48:18.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-21T21:48:18.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-21T21:48:18.244 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-21T21:48:18.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-21T21:48:18.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-21T21:48:18.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-21T21:48:18.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-21T21:48:18.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-21T21:48:18.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-21T21:48:18.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-21T21:48:18.245 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-21T21:48:18.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-21T21:48:18.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-21T21:48:18.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-21T21:48:18.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-21T21:48:18.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-21T21:48:18.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-21T21:48:18.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-21T21:48:18.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-21T21:48:18.246 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-21T21:48:18.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-21T21:48:18.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-21T21:48:18.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-21T21:48:18.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-21T21:48:18.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-21T21:48:18.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-21T21:48:18.247 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-21T21:48:18.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-21T21:48:18.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-21T21:48:18.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-21T21:48:18.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-21T21:48:18.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-21T21:48:18.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-21T21:48:18.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-21T21:48:18.248 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-21T21:48:18.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-21T21:48:18.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-21T21:48:18.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-21T21:48:18.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-21T21:48:18.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-21T21:48:18.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2 2023-07-21T21:48:18.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster 2023-07-21T21:48:18.249 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-21T21:48:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm 2023-07-21T21:48:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-21T21:48:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs 2023-07-21T21:48:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-21T21:48:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-21T21:48:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-21T21:48:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-21T21:48:18.250 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-21T21:48:18.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs 2023-07-21T21:48:18.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-21T21:48:18.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore 2023-07-21T21:48:18.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-21T21:48:18.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs 2023-07-21T21:48:18.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-21T21:48:18.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs 2023-07-21T21:48:18.251 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-21T21:48:18.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb 2023-07-21T21:48:18.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client 2023-07-21T21:48:18.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-21T21:48:18.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common 2023-07-21T21:48:18.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-21T21:48:18.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-21T21:48:18.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs 2023-07-21T21:48:18.252 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-21T21:48:18.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv 2023-07-21T21:48:18.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-21T21:48:18.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf 2023-07-21T21:48:18.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-21T21:48:18.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs 2023-07-21T21:48:18.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-21T21:48:18.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs 2023-07-21T21:48:18.253 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-21T21:48:18.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel 2023-07-21T21:48:18.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/rcu 2023-07-21T21:48:18.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/rcu/rcutorture.ko 2023-07-21T21:48:18.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-21T21:48:18.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/trace 2023-07-21T21:48:18.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-21T21:48:18.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib 2023-07-21T21:48:18.254 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/asn1_encoder.ko 2023-07-21T21:48:18.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-21T21:48:18.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-21T21:48:18.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto 2023-07-21T21:48:18.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-21T21:48:18.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-21T21:48:18.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-21T21:48:18.255 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-21T21:48:18.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4 2023-07-21T21:48:18.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-21T21:48:18.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-21T21:48:18.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math 2023-07-21T21:48:18.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-21T21:48:18.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6 2023-07-21T21:48:18.256 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-21T21:48:18.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon 2023-07-21T21:48:18.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-21T21:48:18.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-21T21:48:18.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-21T21:48:18.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-21T21:48:18.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/zstd 2023-07-21T21:48:18.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/zstd/zstd_compress.ko 2023-07-21T21:48:18.257 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm 2023-07-21T21:48:18.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-21T21:48:18.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net 2023-07-21T21:48:18.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan 2023-07-21T21:48:18.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-21T21:48:18.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-21T21:48:18.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-21T21:48:18.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-21T21:48:18.258 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-21T21:48:18.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-21T21:48:18.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-21T21:48:18.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-21T21:48:18.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802 2023-07-21T21:48:18.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-21T21:48:18.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-21T21:48:18.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-21T21:48:18.259 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-21T21:48:18.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-21T21:48:18.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q 2023-07-21T21:48:18.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-21T21:48:18.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p 2023-07-21T21:48:18.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-21T21:48:18.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-21T21:48:18.260 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-21T21:48:18.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-21T21:48:18.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv 2023-07-21T21:48:18.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-21T21:48:18.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge 2023-07-21T21:48:18.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-21T21:48:18.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-21T21:48:18.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter 2023-07-21T21:48:18.261 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-21T21:48:18.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-21T21:48:18.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-21T21:48:18.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-21T21:48:18.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-21T21:48:18.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-21T21:48:18.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-21T21:48:18.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-21T21:48:18.262 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-21T21:48:18.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-21T21:48:18.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-21T21:48:18.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-21T21:48:18.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-21T21:48:18.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-21T21:48:18.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-21T21:48:18.263 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-21T21:48:18.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-21T21:48:18.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-21T21:48:18.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-21T21:48:18.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-21T21:48:18.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-21T21:48:18.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-21T21:48:18.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-21T21:48:18.264 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-21T21:48:18.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph 2023-07-21T21:48:18.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-21T21:48:18.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core 2023-07-21T21:48:18.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/failover.ko 2023-07-21T21:48:18.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-21T21:48:18.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp 2023-07-21T21:48:18.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-21T21:48:18.265 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-21T21:48:18.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-21T21:48:18.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-21T21:48:18.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dns_resolver 2023-07-21T21:48:18.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dns_resolver/dns_resolver.ko 2023-07-21T21:48:18.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa 2023-07-21T21:48:18.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-21T21:48:18.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-21T21:48:18.266 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-21T21:48:18.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-21T21:48:18.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-21T21:48:18.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154 2023-07-21T21:48:18.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan 2023-07-21T21:48:18.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-21T21:48:18.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-21T21:48:18.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-21T21:48:18.267 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4 2023-07-21T21:48:18.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-21T21:48:18.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-21T21:48:18.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-21T21:48:18.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-21T21:48:18.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-21T21:48:18.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-21T21:48:18.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-21T21:48:18.268 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-21T21:48:18.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-21T21:48:18.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-21T21:48:18.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter 2023-07-21T21:48:18.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-21T21:48:18.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-21T21:48:18.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-21T21:48:18.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-21T21:48:18.269 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-21T21:48:18.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-21T21:48:18.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-21T21:48:18.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-21T21:48:18.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-21T21:48:18.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-21T21:48:18.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-21T21:48:18.270 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-21T21:48:18.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-21T21:48:18.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-21T21:48:18.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-21T21:48:18.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-21T21:48:18.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-21T21:48:18.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-21T21:48:18.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-21T21:48:18.271 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-21T21:48:18.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-21T21:48:18.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-21T21:48:18.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-21T21:48:18.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-21T21:48:18.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-21T21:48:18.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-21T21:48:18.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-21T21:48:18.272 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-21T21:48:18.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-21T21:48:18.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-21T21:48:18.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-21T21:48:18.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-21T21:48:18.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-21T21:48:18.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-21T21:48:18.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-21T21:48:18.273 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-21T21:48:18.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-21T21:48:18.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-21T21:48:18.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6 2023-07-21T21:48:18.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-21T21:48:18.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-21T21:48:18.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-21T21:48:18.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-21T21:48:18.274 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-21T21:48:18.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-21T21:48:18.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-21T21:48:18.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter 2023-07-21T21:48:18.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-21T21:48:18.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-21T21:48:18.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-21T21:48:18.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-21T21:48:18.275 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-21T21:48:18.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-21T21:48:18.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-21T21:48:18.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-21T21:48:18.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-21T21:48:18.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-21T21:48:18.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-21T21:48:18.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-21T21:48:18.276 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-21T21:48:18.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-21T21:48:18.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-21T21:48:18.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-21T21:48:18.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-21T21:48:18.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-21T21:48:18.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-21T21:48:18.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-21T21:48:18.277 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-21T21:48:18.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-21T21:48:18.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-21T21:48:18.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-21T21:48:18.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-21T21:48:18.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-21T21:48:18.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-21T21:48:18.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key 2023-07-21T21:48:18.278 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-21T21:48:18.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp 2023-07-21T21:48:18.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-21T21:48:18.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-21T21:48:18.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-21T21:48:18.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-21T21:48:18.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-21T21:48:18.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-21T21:48:18.279 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-21T21:48:18.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc 2023-07-21T21:48:18.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-21T21:48:18.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154 2023-07-21T21:48:18.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-21T21:48:18.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls 2023-07-21T21:48:18.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-21T21:48:18.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter 2023-07-21T21:48:18.280 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset 2023-07-21T21:48:18.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-21T21:48:18.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-21T21:48:18.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-21T21:48:18.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-21T21:48:18.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-21T21:48:18.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-21T21:48:18.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-21T21:48:18.281 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-21T21:48:18.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-21T21:48:18.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-21T21:48:18.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-21T21:48:18.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-21T21:48:18.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-21T21:48:18.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-21T21:48:18.282 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-21T21:48:18.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-21T21:48:18.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs 2023-07-21T21:48:18.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-21T21:48:18.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-21T21:48:18.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-21T21:48:18.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-21T21:48:18.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-21T21:48:18.283 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-21T21:48:18.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-21T21:48:18.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-21T21:48:18.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-21T21:48:18.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-21T21:48:18.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-21T21:48:18.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-21T21:48:18.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-21T21:48:18.284 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-21T21:48:18.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-21T21:48:18.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-21T21:48:18.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-21T21:48:18.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-21T21:48:18.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-21T21:48:18.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-21T21:48:18.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-21T21:48:18.285 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-21T21:48:18.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-21T21:48:18.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-21T21:48:18.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-21T21:48:18.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-21T21:48:18.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-21T21:48:18.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-21T21:48:18.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-21T21:48:18.286 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-21T21:48:18.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-21T21:48:18.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-21T21:48:18.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-21T21:48:18.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-21T21:48:18.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-21T21:48:18.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-21T21:48:18.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-21T21:48:18.287 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-21T21:48:18.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-21T21:48:18.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-21T21:48:18.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-21T21:48:18.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-21T21:48:18.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-21T21:48:18.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-21T21:48:18.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-21T21:48:18.288 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-21T21:48:18.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-21T21:48:18.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-21T21:48:18.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-21T21:48:18.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-21T21:48:18.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-21T21:48:18.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-21T21:48:18.289 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-21T21:48:18.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-21T21:48:18.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-21T21:48:18.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-21T21:48:18.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-21T21:48:18.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-21T21:48:18.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_quota.ko 2023-07-21T21:48:18.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-21T21:48:18.290 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-21T21:48:18.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-21T21:48:18.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-21T21:48:18.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tunnel.ko 2023-07-21T21:48:18.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-21T21:48:18.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-21T21:48:18.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-21T21:48:18.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-21T21:48:18.291 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-21T21:48:18.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-21T21:48:18.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-21T21:48:18.292 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-21T21:48:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-21T21:48:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-21T21:48:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-21T21:48:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-21T21:48:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-21T21:48:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-21T21:48:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-21T21:48:18.293 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-21T21:48:18.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-21T21:48:18.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-21T21:48:18.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-21T21:48:18.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-21T21:48:18.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-21T21:48:18.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-21T21:48:18.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-21T21:48:18.294 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-21T21:48:18.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-21T21:48:18.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-21T21:48:18.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-21T21:48:18.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-21T21:48:18.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-21T21:48:18.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-21T21:48:18.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-21T21:48:18.295 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-21T21:48:18.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-21T21:48:18.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-21T21:48:18.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-21T21:48:18.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-21T21:48:18.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-21T21:48:18.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-21T21:48:18.296 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-21T21:48:18.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-21T21:48:18.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-21T21:48:18.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-21T21:48:18.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-21T21:48:18.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-21T21:48:18.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-21T21:48:18.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-21T21:48:18.297 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-21T21:48:18.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-21T21:48:18.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-21T21:48:18.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-21T21:48:18.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-21T21:48:18.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-21T21:48:18.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-21T21:48:18.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-21T21:48:18.298 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-21T21:48:18.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-21T21:48:18.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-21T21:48:18.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-21T21:48:18.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-21T21:48:18.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-21T21:48:18.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-21T21:48:18.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-21T21:48:18.299 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-21T21:48:18.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-21T21:48:18.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-21T21:48:18.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-21T21:48:18.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-21T21:48:18.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-21T21:48:18.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-21T21:48:18.300 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-21T21:48:18.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-21T21:48:18.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink 2023-07-21T21:48:18.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-21T21:48:18.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh 2023-07-21T21:48:18.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-21T21:48:18.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch 2023-07-21T21:48:18.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-21T21:48:18.301 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-21T21:48:18.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-21T21:48:18.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-21T21:48:18.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet 2023-07-21T21:48:18.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-21T21:48:18.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds 2023-07-21T21:48:18.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-21T21:48:18.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-21T21:48:18.302 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-21T21:48:18.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched 2023-07-21T21:48:18.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-21T21:48:18.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-21T21:48:18.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-21T21:48:18.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-21T21:48:18.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-21T21:48:18.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-21T21:48:18.303 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-21T21:48:18.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-21T21:48:18.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-21T21:48:18.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-21T21:48:18.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-21T21:48:18.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-21T21:48:18.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-21T21:48:18.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-21T21:48:18.304 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-21T21:48:18.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-21T21:48:18.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-21T21:48:18.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-21T21:48:18.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-21T21:48:18.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-21T21:48:18.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-21T21:48:18.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-21T21:48:18.305 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-21T21:48:18.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-21T21:48:18.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-21T21:48:18.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-21T21:48:18.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-21T21:48:18.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-21T21:48:18.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-21T21:48:18.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-21T21:48:18.306 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-21T21:48:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-21T21:48:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-21T21:48:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-21T21:48:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-21T21:48:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-21T21:48:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-21T21:48:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-21T21:48:18.307 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-21T21:48:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-21T21:48:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-21T21:48:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-21T21:48:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-21T21:48:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-21T21:48:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp 2023-07-21T21:48:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-21T21:48:18.308 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-21T21:48:18.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc 2023-07-21T21:48:18.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss 2023-07-21T21:48:18.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-21T21:48:18.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-21T21:48:18.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-21T21:48:18.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma 2023-07-21T21:48:18.309 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-21T21:48:18.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc 2023-07-21T21:48:18.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-21T21:48:18.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-21T21:48:18.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix 2023-07-21T21:48:18.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-21T21:48:18.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock 2023-07-21T21:48:18.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-21T21:48:18.310 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-21T21:48:18.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-21T21:48:18.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-21T21:48:18.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-21T21:48:18.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm 2023-07-21T21:48:18.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-21T21:48:18.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security 2023-07-21T21:48:18.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys 2023-07-21T21:48:18.311 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/encrypted-keys 2023-07-21T21:48:18.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-21T21:48:18.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/trusted-keys 2023-07-21T21:48:18.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/trusted-keys/trusted.ko 2023-07-21T21:48:18.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt 2023-07-21T21:48:18.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib 2023-07-21T21:48:18.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-21T21:48:18.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-21T21:48:18.312 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-21T21:48:18.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-21T21:48:18.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-21T21:48:18.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-21T21:48:18.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-21T21:48:18.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-21T21:48:18.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-21T21:48:18.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-21T21:48:18.313 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-21T21:48:18.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-21T21:48:18.314 INFO:teuthology.orchestra.run.smithi187.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-21T21:48:18.314 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:18.315 DEBUG:teuthology.orchestra.run.smithi187:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-21T21:48:18.341 INFO:teuthology.orchestra.run.smithi187.stdout:postinstall scriptlet (using /bin/sh): 2023-07-21T21:48:18.341 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc -a -r /boot/System.map-6.5.0-rc1-gc685da6f56cc ]; then 2023-07-21T21:48:18.341 INFO:teuthology.orchestra.run.smithi187.stdout:cp /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc /boot/.vmlinuz-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:18.341 INFO:teuthology.orchestra.run.smithi187.stdout:cp /boot/System.map-6.5.0-rc1-gc685da6f56cc /boot/.System.map-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:18.341 INFO:teuthology.orchestra.run.smithi187.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc /boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:18.341 INFO:teuthology.orchestra.run.smithi187.stdout:/sbin/installkernel 6.5.0-rc1-gc685da6f56cc /boot/.vmlinuz-6.5.0-rc1-gc685da6f56cc-rpm /boot/.System.map-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:18.342 INFO:teuthology.orchestra.run.smithi187.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-gc685da6f56cc-rpm /boot/.System.map-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:18.342 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2023-07-21T21:48:18.342 INFO:teuthology.orchestra.run.smithi187.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-21T21:48:18.342 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-21T21:48:18.342 INFO:teuthology.orchestra.run.smithi187.stdout:new-kernel-pkg --remove 6.5.0-rc1-gc685da6f56cc --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-gc685da6f56cc.img 2023-07-21T21:48:18.342 INFO:teuthology.orchestra.run.smithi187.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-21T21:48:18.342 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-install remove 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:18.343 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2023-07-21T21:48:18.343 INFO:teuthology.orchestra.run.smithi187.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-21T21:48:18.343 INFO:teuthology.orchestra.run.smithi187.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-21T21:48:18.343 INFO:teuthology.orchestra.run.smithi187.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:18.343 INFO:teuthology.orchestra.run.smithi187.stdout:fi 2023-07-21T21:48:18.344 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -qi grub2-tools 2023-07-21T21:48:18.424 INFO:teuthology.orchestra.run.smithi187.stdout:Name : grub2-tools 2023-07-21T21:48:18.424 INFO:teuthology.orchestra.run.smithi187.stdout:Epoch : 1 2023-07-21T21:48:18.425 INFO:teuthology.orchestra.run.smithi187.stdout:Version : 2.02 2023-07-21T21:48:18.425 INFO:teuthology.orchestra.run.smithi187.stdout:Release : 123.el8 2023-07-21T21:48:18.425 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: x86_64 2023-07-21T21:48:18.425 INFO:teuthology.orchestra.run.smithi187.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-21T21:48:18.425 INFO:teuthology.orchestra.run.smithi187.stdout:Group : System Environment/Base 2023-07-21T21:48:18.425 INFO:teuthology.orchestra.run.smithi187.stdout:Size : 9265450 2023-07-21T21:48:18.425 INFO:teuthology.orchestra.run.smithi187.stdout:License : GPLv3+ 2023-07-21T21:48:18.426 INFO:teuthology.orchestra.run.smithi187.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-21T21:48:18.426 INFO:teuthology.orchestra.run.smithi187.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-21T21:48:18.426 INFO:teuthology.orchestra.run.smithi187.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-21T21:48:18.426 INFO:teuthology.orchestra.run.smithi187.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-21T21:48:18.426 INFO:teuthology.orchestra.run.smithi187.stdout:Relocations : (not relocatable) 2023-07-21T21:48:18.426 INFO:teuthology.orchestra.run.smithi187.stdout:Packager : Red Hat, Inc. 2023-07-21T21:48:18.426 INFO:teuthology.orchestra.run.smithi187.stdout:Vendor : Red Hat, Inc. 2023-07-21T21:48:18.426 INFO:teuthology.orchestra.run.smithi187.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-21T21:48:18.427 INFO:teuthology.orchestra.run.smithi187.stdout:Summary : Support tools for GRUB. 2023-07-21T21:48:18.427 INFO:teuthology.orchestra.run.smithi187.stdout:Description : 2023-07-21T21:48:18.427 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T21:48:18.427 INFO:teuthology.orchestra.run.smithi187.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-21T21:48:18.427 INFO:teuthology.orchestra.run.smithi187.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-21T21:48:18.427 INFO:teuthology.orchestra.run.smithi187.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-21T21:48:18.427 INFO:teuthology.orchestra.run.smithi187.stdout:hardware devices. 2023-07-21T21:48:18.427 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T21:48:18.428 INFO:teuthology.orchestra.run.smithi187.stdout:This subpackage provides tools for support of all platforms. 2023-07-21T21:48:18.428 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-21T21:48:18.428 INFO:teuthology.task.kernel:Updating grub on smithi187 to boot 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:18.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-21T21:48:18.466 INFO:teuthology.orchestra.run.smithi195.stderr:Generating grub configuration file ... 2023-07-21T21:48:20.195 INFO:teuthology.orchestra.run.smithi195.stderr:done 2023-07-21T21:48:20.196 DEBUG:teuthology.orchestra.run.smithi195:> mktemp 2023-07-21T21:48:20.213 INFO:teuthology.orchestra.run.smithi195.stdout:/tmp/tmp.jTSPsKbuCf 2023-07-21T21:48:20.214 DEBUG:teuthology.orchestra.run.smithi195:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.jTSPsKbuCf 2023-07-21T21:48:20.287 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 0666 /tmp/tmp.jTSPsKbuCf 2023-07-21T21:48:20.444 DEBUG:teuthology.orchestra.remote:smithi195:/tmp/tmp.jTSPsKbuCf is 6KB 2023-07-21T21:48:20.491 DEBUG:teuthology.orchestra.run.smithi195:> rm -fr /tmp/tmp.jTSPsKbuCf 2023-07-21T21:48:20.507 DEBUG:teuthology.orchestra.run.smithi195:> sudo /bin/ls /boot/loader/entries || true 2023-07-21T21:48:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-21T21:48:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-21T21:48:20.581 INFO:teuthology.orchestra.run.smithi195.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-gc685da6f56cc.conf 2023-07-21T21:48:20.582 DEBUG:teuthology.orchestra.run.smithi195:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:20.740 DEBUG:teuthology.orchestra.run.smithi195:> sudo shutdown -r now 2023-07-21T21:48:22.456 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2023-07-21T21:48:24.304 INFO:teuthology.orchestra.run.smithi187.stderr:done 2023-07-21T21:48:24.307 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-07-21T21:48:24.327 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.lP8A8LYh9J 2023-07-21T21:48:24.327 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.lP8A8LYh9J 2023-07-21T21:48:24.418 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.lP8A8LYh9J 2023-07-21T21:48:24.527 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.lP8A8LYh9J is 6KB 2023-07-21T21:48:24.548 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.lP8A8LYh9J 2023-07-21T21:48:24.564 DEBUG:teuthology.orchestra.run.smithi187:> sudo /bin/ls /boot/loader/entries || true 2023-07-21T21:48:24.629 INFO:teuthology.orchestra.run.smithi187.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-21T21:48:24.630 INFO:teuthology.orchestra.run.smithi187.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-21T21:48:24.630 INFO:teuthology.orchestra.run.smithi187.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-gc685da6f56cc.conf 2023-07-21T21:48:24.631 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:24.778 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2023-07-21T21:48:26.148 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-07-21T21:48:26.149 DEBUG:teuthology.orchestra.run.smithi151:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-07-21T21:48:26.195 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:26.196 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/config-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:26.196 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/vmlinuz-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:26.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:26.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel 2023-07-21T21:48:26.196 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch 2023-07-21T21:48:26.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86 2023-07-21T21:48:26.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto 2023-07-21T21:48:26.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-07-21T21:48:26.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-07-21T21:48:26.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-07-21T21:48:26.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-07-21T21:48:26.197 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-07-21T21:48:26.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-07-21T21:48:26.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-07-21T21:48:26.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crc32c-intel.ko 2023-07-21T21:48:26.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-07-21T21:48:26.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-07-21T21:48:26.198 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-07-21T21:48:26.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-07-21T21:48:26.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-avx2.ko 2023-07-21T21:48:26.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-07-21T21:48:26.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-07-21T21:48:26.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-07-21T21:48:26.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-07-21T21:48:26.199 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-07-21T21:48:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-07-21T21:48:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-07-21T21:48:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel 2023-07-21T21:48:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu 2023-07-21T21:48:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce 2023-07-21T21:48:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-07-21T21:48:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm 2023-07-21T21:48:26.200 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-amd.ko 2023-07-21T21:48:26.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm-intel.ko 2023-07-21T21:48:26.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/arch/x86/kvm/kvm.ko 2023-07-21T21:48:26.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto 2023-07-21T21:48:26.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ansi_cprng.ko 2023-07-21T21:48:26.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/anubis.ko 2023-07-21T21:48:26.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/arc4.ko 2023-07-21T21:48:26.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx 2023-07-21T21:48:26.201 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_memcpy.ko 2023-07-21T21:48:26.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_pq.ko 2023-07-21T21:48:26.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_raid6_recov.ko 2023-07-21T21:48:26.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_tx.ko 2023-07-21T21:48:26.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/async_xor.ko 2023-07-21T21:48:26.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/async_tx/raid6test.ko 2023-07-21T21:48:26.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authenc.ko 2023-07-21T21:48:26.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/authencesn.ko 2023-07-21T21:48:26.202 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blake2b_generic.ko 2023-07-21T21:48:26.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_common.ko 2023-07-21T21:48:26.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/blowfish_generic.ko 2023-07-21T21:48:26.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/camellia_generic.ko 2023-07-21T21:48:26.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast5_generic.ko 2023-07-21T21:48:26.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast6_generic.ko 2023-07-21T21:48:26.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cast_common.ko 2023-07-21T21:48:26.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/ccm.ko 2023-07-21T21:48:26.203 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cmac.ko 2023-07-21T21:48:26.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crc32_generic.ko 2023-07-21T21:48:26.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_engine.ko 2023-07-21T21:48:26.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/crypto_user.ko 2023-07-21T21:48:26.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/cts.ko 2023-07-21T21:48:26.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/des_generic.ko 2023-07-21T21:48:26.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/dh_generic.ko 2023-07-21T21:48:26.204 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/echainiv.ko 2023-07-21T21:48:26.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/essiv.ko 2023-07-21T21:48:26.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/fcrypt.ko 2023-07-21T21:48:26.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/khazad.ko 2023-07-21T21:48:26.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4.ko 2023-07-21T21:48:26.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/lz4hc.ko 2023-07-21T21:48:26.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/md4.ko 2023-07-21T21:48:26.205 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/michael_mic.ko 2023-07-21T21:48:26.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcbc.ko 2023-07-21T21:48:26.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/pcrypt.ko 2023-07-21T21:48:26.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/rmd160.ko 2023-07-21T21:48:26.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/seed.ko 2023-07-21T21:48:26.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/serpent_generic.ko 2023-07-21T21:48:26.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tcrypt.ko 2023-07-21T21:48:26.206 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/tea.ko 2023-07-21T21:48:26.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_common.ko 2023-07-21T21:48:26.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/twofish_generic.ko 2023-07-21T21:48:26.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/vmac.ko 2023-07-21T21:48:26.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/wp512.ko 2023-07-21T21:48:26.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xcbc.ko 2023-07-21T21:48:26.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xor.ko 2023-07-21T21:48:26.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/crypto/xxhash_generic.ko 2023-07-21T21:48:26.207 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers 2023-07-21T21:48:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi 2023-07-21T21:48:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_ipmi.ko 2023-07-21T21:48:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/acpi_pad.ko 2023-07-21T21:48:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/custom_method.ko 2023-07-21T21:48:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/ec_sys.ko 2023-07-21T21:48:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/platform_profile.ko 2023-07-21T21:48:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbs.ko 2023-07-21T21:48:26.208 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/sbshc.ko 2023-07-21T21:48:26.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/acpi/video.ko 2023-07-21T21:48:26.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata 2023-07-21T21:48:26.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/acard-ahci.ko 2023-07-21T21:48:26.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ahci_platform.ko 2023-07-21T21:48:26.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/ata_generic.ko 2023-07-21T21:48:26.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/libahci_platform.ko 2023-07-21T21:48:26.209 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_acpi.ko 2023-07-21T21:48:26.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ali.ko 2023-07-21T21:48:26.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_amd.ko 2023-07-21T21:48:26.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_artop.ko 2023-07-21T21:48:26.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atiixp.ko 2023-07-21T21:48:26.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_atp867x.ko 2023-07-21T21:48:26.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd640.ko 2023-07-21T21:48:26.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cmd64x.ko 2023-07-21T21:48:26.210 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_cypress.ko 2023-07-21T21:48:26.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_efar.ko 2023-07-21T21:48:26.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt366.ko 2023-07-21T21:48:26.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt37x.ko 2023-07-21T21:48:26.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x2n.ko 2023-07-21T21:48:26.211 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_hpt3x3.ko 2023-07-21T21:48:26.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it8213.ko 2023-07-21T21:48:26.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_it821x.ko 2023-07-21T21:48:26.212 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_jmicron.ko 2023-07-21T21:48:26.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_marvell.ko 2023-07-21T21:48:26.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_mpiix.ko 2023-07-21T21:48:26.213 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_netcell.ko 2023-07-21T21:48:26.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ninja32.ko 2023-07-21T21:48:26.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87410.ko 2023-07-21T21:48:26.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_ns87415.ko 2023-07-21T21:48:26.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_oldpiix.ko 2023-07-21T21:48:26.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_opti.ko 2023-07-21T21:48:26.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_optidma.ko 2023-07-21T21:48:26.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pcmcia.ko 2023-07-21T21:48:26.214 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc2027x.ko 2023-07-21T21:48:26.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-07-21T21:48:26.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_piccolo.ko 2023-07-21T21:48:26.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_rdc.ko 2023-07-21T21:48:26.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sch.ko 2023-07-21T21:48:26.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_serverworks.ko 2023-07-21T21:48:26.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sil680.ko 2023-07-21T21:48:26.215 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sis.ko 2023-07-21T21:48:26.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_sl82c105.ko 2023-07-21T21:48:26.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_triflex.ko 2023-07-21T21:48:26.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pata_via.ko 2023-07-21T21:48:26.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/pdc_adma.ko 2023-07-21T21:48:26.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_inic162x.ko 2023-07-21T21:48:26.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_mv.ko 2023-07-21T21:48:26.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_nv.ko 2023-07-21T21:48:26.216 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_promise.ko 2023-07-21T21:48:26.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_qstor.ko 2023-07-21T21:48:26.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil.ko 2023-07-21T21:48:26.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sil24.ko 2023-07-21T21:48:26.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sis.ko 2023-07-21T21:48:26.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_svw.ko 2023-07-21T21:48:26.217 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_sx4.ko 2023-07-21T21:48:26.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_uli.ko 2023-07-21T21:48:26.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_via.ko 2023-07-21T21:48:26.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ata/sata_vsc.ko 2023-07-21T21:48:26.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay 2023-07-21T21:48:26.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/auxdisplay/ks0108.ko 2023-07-21T21:48:26.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base 2023-07-21T21:48:26.218 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base/regmap 2023-07-21T21:48:26.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base/regmap/regmap-i2c.ko 2023-07-21T21:48:26.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/base/regmap/regmap-mmio.ko 2023-07-21T21:48:26.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma 2023-07-21T21:48:26.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/bcma/bcma.ko 2023-07-21T21:48:26.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block 2023-07-21T21:48:26.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe 2023-07-21T21:48:26.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/aoe/aoe.ko 2023-07-21T21:48:26.219 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/brd.ko 2023-07-21T21:48:26.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd 2023-07-21T21:48:26.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/drbd/drbd.ko 2023-07-21T21:48:26.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/floppy.ko 2023-07-21T21:48:26.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/loop.ko 2023-07-21T21:48:26.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx 2023-07-21T21:48:26.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-07-21T21:48:26.220 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/nbd.ko 2023-07-21T21:48:26.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk 2023-07-21T21:48:26.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/null_blk/null_blk.ko 2023-07-21T21:48:26.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/pktcdvd.ko 2023-07-21T21:48:26.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/rbd.ko 2023-07-21T21:48:26.221 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/virtio_blk.ko 2023-07-21T21:48:26.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback 2023-07-21T21:48:26.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-07-21T21:48:26.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/xen-blkfront.ko 2023-07-21T21:48:26.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram 2023-07-21T21:48:26.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/block/zram/zram.ko 2023-07-21T21:48:26.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char 2023-07-21T21:48:26.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hangcheck-timer.ko 2023-07-21T21:48:26.222 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random 2023-07-21T21:48:26.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/amd-rng.ko 2023-07-21T21:48:26.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/intel-rng.ko 2023-07-21T21:48:26.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-07-21T21:48:26.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/via-rng.ko 2023-07-21T21:48:26.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/hw_random/virtio-rng.ko 2023-07-21T21:48:26.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi 2023-07-21T21:48:26.223 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-07-21T21:48:26.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-07-21T21:48:26.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-07-21T21:48:26.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_si.ko 2023-07-21T21:48:26.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-07-21T21:48:26.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-07-21T21:48:26.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/lp.ko 2023-07-21T21:48:26.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave 2023-07-21T21:48:26.224 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/mwave/mwave.ko 2023-07-21T21:48:26.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/ppdev.ko 2023-07-21T21:48:26.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tlclk.ko 2023-07-21T21:48:26.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm 2023-07-21T21:48:26.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm.ko 2023-07-21T21:48:26.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_atmel.ko 2023-07-21T21:48:26.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_infineon.ko 2023-07-21T21:48:26.225 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_nsc.ko 2023-07-21T21:48:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_tis.ko 2023-07-21T21:48:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-07-21T21:48:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/uv_mmtimer.ko 2023-07-21T21:48:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/char/virtio_console.ko 2023-07-21T21:48:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq 2023-07-21T21:48:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-07-21T21:48:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-07-21T21:48:26.226 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/p4-clockmod.ko 2023-07-21T21:48:26.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-07-21T21:48:26.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/powernow-k8.ko 2023-07-21T21:48:26.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/cpufreq/speedstep-lib.ko 2023-07-21T21:48:26.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto 2023-07-21T21:48:26.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp 2023-07-21T21:48:26.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-07-21T21:48:26.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/ccp/ccp.ko 2023-07-21T21:48:26.227 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel 2023-07-21T21:48:26.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat 2023-07-21T21:48:26.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common 2023-07-21T21:48:26.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-07-21T21:48:26.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-07-21T21:48:26.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-07-21T21:48:26.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-aes.ko 2023-07-21T21:48:26.228 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/padlock-sha.ko 2023-07-21T21:48:26.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio 2023-07-21T21:48:26.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-07-21T21:48:26.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca 2023-07-21T21:48:26.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dca/dca.ko 2023-07-21T21:48:26.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/devfreq 2023-07-21T21:48:26.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-07-21T21:48:26.229 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma 2023-07-21T21:48:26.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw 2023-07-21T21:48:26.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/dw/dw_dmac.ko 2023-07-21T21:48:26.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat 2023-07-21T21:48:26.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/dma/ioat/ioatdma.ko 2023-07-21T21:48:26.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac 2023-07-21T21:48:26.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/amd64_edac.ko 2023-07-21T21:48:26.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/e752x_edac.ko 2023-07-21T21:48:26.230 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/edac_mce_amd.ko 2023-07-21T21:48:26.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3000_edac.ko 2023-07-21T21:48:26.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i3200_edac.ko 2023-07-21T21:48:26.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5100_edac.ko 2023-07-21T21:48:26.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i5400_edac.ko 2023-07-21T21:48:26.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7300_edac.ko 2023-07-21T21:48:26.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i7core_edac.ko 2023-07-21T21:48:26.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/i82975x_edac.ko 2023-07-21T21:48:26.231 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/ie31200_edac.ko 2023-07-21T21:48:26.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/sb_edac.ko 2023-07-21T21:48:26.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/edac/x38_edac.ko 2023-07-21T21:48:26.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware 2023-07-21T21:48:26.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/edd.ko 2023-07-21T21:48:26.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/firmware/iscsi_ibft.ko 2023-07-21T21:48:26.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio 2023-07-21T21:48:26.232 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-ich.ko 2023-07-21T21:48:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/gpio/gpio-viperboard.ko 2023-07-21T21:48:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid 2023-07-21T21:48:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-appleir.ko 2023-07-21T21:48:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-aureal.ko 2023-07-21T21:48:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-axff.ko 2023-07-21T21:48:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-dr.ko 2023-07-21T21:48:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elecom.ko 2023-07-21T21:48:26.233 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-elo.ko 2023-07-21T21:48:26.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-emsff.ko 2023-07-21T21:48:26.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gaff.ko 2023-07-21T21:48:26.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gt683r.ko 2023-07-21T21:48:26.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-gyration.ko 2023-07-21T21:48:26.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-kbd.ko 2023-07-21T21:48:26.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtek-mouse.ko 2023-07-21T21:48:26.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-holtekff.ko 2023-07-21T21:48:26.234 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-hyperv.ko 2023-07-21T21:48:26.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-icade.ko 2023-07-21T21:48:26.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-keytouch.ko 2023-07-21T21:48:26.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-kye.ko 2023-07-21T21:48:26.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lcpower.ko 2023-07-21T21:48:26.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-led.ko 2023-07-21T21:48:26.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-lenovo.ko 2023-07-21T21:48:26.235 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-dj.ko 2023-07-21T21:48:26.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-07-21T21:48:26.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-multitouch.ko 2023-07-21T21:48:26.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-ortek.ko 2023-07-21T21:48:26.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-penmount.ko 2023-07-21T21:48:26.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-petalynx.ko 2023-07-21T21:48:26.236 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-picolcd.ko 2023-07-21T21:48:26.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-pl.ko 2023-07-21T21:48:26.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-plantronics.ko 2023-07-21T21:48:26.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-primax.ko 2023-07-21T21:48:26.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-rmi.ko 2023-07-21T21:48:26.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-arvo.ko 2023-07-21T21:48:26.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-common.ko 2023-07-21T21:48:26.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-isku.ko 2023-07-21T21:48:26.237 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kone.ko 2023-07-21T21:48:26.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-07-21T21:48:26.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-konepure.ko 2023-07-21T21:48:26.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-07-21T21:48:26.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-lua.ko 2023-07-21T21:48:26.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-pyra.ko 2023-07-21T21:48:26.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-ryos.ko 2023-07-21T21:48:26.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat-savu.ko 2023-07-21T21:48:26.238 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-roccat.ko 2023-07-21T21:48:26.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-saitek.ko 2023-07-21T21:48:26.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-samsung.ko 2023-07-21T21:48:26.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sensor-hub.ko 2023-07-21T21:48:26.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sjoy.ko 2023-07-21T21:48:26.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sony.ko 2023-07-21T21:48:26.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-speedlink.ko 2023-07-21T21:48:26.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-steelseries.ko 2023-07-21T21:48:26.239 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-sunplus.ko 2023-07-21T21:48:26.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-thrustmaster.ko 2023-07-21T21:48:26.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tivo.ko 2023-07-21T21:48:26.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-tmff.ko 2023-07-21T21:48:26.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-topseed.ko 2023-07-21T21:48:26.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-twinhan.ko 2023-07-21T21:48:26.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-uclogic.ko 2023-07-21T21:48:26.240 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-waltop.ko 2023-07-21T21:48:26.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-wiimote.ko 2023-07-21T21:48:26.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-xinmo.ko 2023-07-21T21:48:26.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zpff.ko 2023-07-21T21:48:26.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/hid-zydacron.ko 2023-07-21T21:48:26.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/uhid.ko 2023-07-21T21:48:26.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hid/wacom.ko 2023-07-21T21:48:26.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv 2023-07-21T21:48:26.241 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_balloon.ko 2023-07-21T21:48:26.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_utils.ko 2023-07-21T21:48:26.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hv/hv_vmbus.ko 2023-07-21T21:48:26.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon 2023-07-21T21:48:26.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru.ko 2023-07-21T21:48:26.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/abituguru3.ko 2023-07-21T21:48:26.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/acpi_power_meter.ko 2023-07-21T21:48:26.242 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7414.ko 2023-07-21T21:48:26.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ad7418.ko 2023-07-21T21:48:26.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adc128d818.ko 2023-07-21T21:48:26.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1025.ko 2023-07-21T21:48:26.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1026.ko 2023-07-21T21:48:26.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1029.ko 2023-07-21T21:48:26.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm1031.ko 2023-07-21T21:48:26.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adm9240.ko 2023-07-21T21:48:26.243 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ads7828.ko 2023-07-21T21:48:26.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7410.ko 2023-07-21T21:48:26.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7411.ko 2023-07-21T21:48:26.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7462.ko 2023-07-21T21:48:26.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7470.ko 2023-07-21T21:48:26.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7475.ko 2023-07-21T21:48:26.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/adt7x10.ko 2023-07-21T21:48:26.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/amc6821.ko 2023-07-21T21:48:26.244 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/applesmc.ko 2023-07-21T21:48:26.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asb100.ko 2023-07-21T21:48:26.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asc7621.ko 2023-07-21T21:48:26.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/asus_atk0110.ko 2023-07-21T21:48:26.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/atxp1.ko 2023-07-21T21:48:26.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/coretemp.ko 2023-07-21T21:48:26.245 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-07-21T21:48:26.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/dme1737.ko 2023-07-21T21:48:26.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds1621.ko 2023-07-21T21:48:26.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ds620.ko 2023-07-21T21:48:26.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc1403.ko 2023-07-21T21:48:26.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/emc6w201.ko 2023-07-21T21:48:26.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71805f.ko 2023-07-21T21:48:26.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f71882fg.ko 2023-07-21T21:48:26.246 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/f75375s.ko 2023-07-21T21:48:26.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fam15h_power.ko 2023-07-21T21:48:26.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/fschmd.ko 2023-07-21T21:48:26.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g760a.ko 2023-07-21T21:48:26.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/g762.ko 2023-07-21T21:48:26.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl518sm.ko 2023-07-21T21:48:26.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/gl520sm.ko 2023-07-21T21:48:26.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/hwmon-vid.ko 2023-07-21T21:48:26.247 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5500_temp.ko 2023-07-21T21:48:26.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/i5k_amb.ko 2023-07-21T21:48:26.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmaem.ko 2023-07-21T21:48:26.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ibmpex.ko 2023-07-21T21:48:26.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina209.ko 2023-07-21T21:48:26.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ina2xx.ko 2023-07-21T21:48:26.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/it87.ko 2023-07-21T21:48:26.248 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k10temp.ko 2023-07-21T21:48:26.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/k8temp.ko 2023-07-21T21:48:26.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lineage-pem.ko 2023-07-21T21:48:26.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm63.ko 2023-07-21T21:48:26.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm73.ko 2023-07-21T21:48:26.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm75.ko 2023-07-21T21:48:26.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm77.ko 2023-07-21T21:48:26.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm78.ko 2023-07-21T21:48:26.249 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm80.ko 2023-07-21T21:48:26.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm83.ko 2023-07-21T21:48:26.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm85.ko 2023-07-21T21:48:26.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm87.ko 2023-07-21T21:48:26.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm90.ko 2023-07-21T21:48:26.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm92.ko 2023-07-21T21:48:26.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm93.ko 2023-07-21T21:48:26.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95234.ko 2023-07-21T21:48:26.250 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95241.ko 2023-07-21T21:48:26.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/lm95245.ko 2023-07-21T21:48:26.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc2945.ko 2023-07-21T21:48:26.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4151.ko 2023-07-21T21:48:26.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4215.ko 2023-07-21T21:48:26.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4222.ko 2023-07-21T21:48:26.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4245.ko 2023-07-21T21:48:26.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4260.ko 2023-07-21T21:48:26.251 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/ltc4261.ko 2023-07-21T21:48:26.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max16065.ko 2023-07-21T21:48:26.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1619.ko 2023-07-21T21:48:26.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max1668.ko 2023-07-21T21:48:26.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max197.ko 2023-07-21T21:48:26.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6639.ko 2023-07-21T21:48:26.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6650.ko 2023-07-21T21:48:26.252 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/max6697.ko 2023-07-21T21:48:26.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/mcp3021.ko 2023-07-21T21:48:26.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6683.ko 2023-07-21T21:48:26.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775-core.ko 2023-07-21T21:48:26.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct6775.ko 2023-07-21T21:48:26.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/nct7802.ko 2023-07-21T21:48:26.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87360.ko 2023-07-21T21:48:26.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pc87427.ko 2023-07-21T21:48:26.253 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pcf8591.ko 2023-07-21T21:48:26.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus 2023-07-21T21:48:26.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-07-21T21:48:26.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-07-21T21:48:26.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-07-21T21:48:26.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max16064.ko 2023-07-21T21:48:26.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max34440.ko 2023-07-21T21:48:26.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/max8688.ko 2023-07-21T21:48:26.254 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-07-21T21:48:26.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-07-21T21:48:26.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-07-21T21:48:26.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-07-21T21:48:26.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-07-21T21:48:26.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-07-21T21:48:26.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/powr1220.ko 2023-07-21T21:48:26.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5627.ko 2023-07-21T21:48:26.255 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch5636.ko 2023-07-21T21:48:26.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sch56xx-common.ko 2023-07-21T21:48:26.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht15.ko 2023-07-21T21:48:26.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sht21.ko 2023-07-21T21:48:26.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/shtc1.ko 2023-07-21T21:48:26.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/sis5595.ko 2023-07-21T21:48:26.256 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47b397.ko 2023-07-21T21:48:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m1.ko 2023-07-21T21:48:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/smsc47m192.ko 2023-07-21T21:48:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/thmc50.ko 2023-07-21T21:48:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp102.ko 2023-07-21T21:48:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp103.ko 2023-07-21T21:48:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp401.ko 2023-07-21T21:48:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/tmp421.ko 2023-07-21T21:48:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via-cputemp.ko 2023-07-21T21:48:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/via686a.ko 2023-07-21T21:48:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt1211.ko 2023-07-21T21:48:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/vt8231.ko 2023-07-21T21:48:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627ehf.ko 2023-07-21T21:48:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83627hf.ko 2023-07-21T21:48:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83781d.ko 2023-07-21T21:48:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83791d.ko 2023-07-21T21:48:26.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83792d.ko 2023-07-21T21:48:26.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83793.ko 2023-07-21T21:48:26.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83795.ko 2023-07-21T21:48:26.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l785ts.ko 2023-07-21T21:48:26.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/hwmon/w83l786ng.ko 2023-07-21T21:48:26.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c 2023-07-21T21:48:26.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos 2023-07-21T21:48:26.259 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-07-21T21:48:26.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-07-21T21:48:26.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses 2023-07-21T21:48:26.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-07-21T21:48:26.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-07-21T21:48:26.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-07-21T21:48:26.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-07-21T21:48:26.260 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-07-21T21:48:26.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-07-21T21:48:26.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-07-21T21:48:26.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-07-21T21:48:26.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-i801.ko 2023-07-21T21:48:26.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-isch.ko 2023-07-21T21:48:26.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-07-21T21:48:26.261 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-07-21T21:48:26.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-07-21T21:48:26.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-parport.ko 2023-07-21T21:48:26.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-07-21T21:48:26.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-07-21T21:48:26.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-07-21T21:48:26.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-07-21T21:48:26.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-07-21T21:48:26.262 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-07-21T21:48:26.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-via.ko 2023-07-21T21:48:26.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-07-21T21:48:26.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-07-21T21:48:26.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-dev.ko 2023-07-21T21:48:26.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-mux.ko 2023-07-21T21:48:26.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-07-21T21:48:26.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-smbus.ko 2023-07-21T21:48:26.263 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/i2c/i2c-stub.ko 2023-07-21T21:48:26.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband 2023-07-21T21:48:26.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core 2023-07-21T21:48:26.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_cm.ko 2023-07-21T21:48:26.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_core.ko 2023-07-21T21:48:26.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_umad.ko 2023-07-21T21:48:26.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-07-21T21:48:26.264 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/iw_cm.ko 2023-07-21T21:48:26.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_cm.ko 2023-07-21T21:48:26.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-07-21T21:48:26.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw 2023-07-21T21:48:26.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4 2023-07-21T21:48:26.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-07-21T21:48:26.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4 2023-07-21T21:48:26.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-07-21T21:48:26.265 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5 2023-07-21T21:48:26.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-07-21T21:48:26.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca 2023-07-21T21:48:26.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-07-21T21:48:26.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp 2023-07-21T21:48:26.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib 2023-07-21T21:48:26.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-07-21T21:48:26.266 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser 2023-07-21T21:48:26.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-07-21T21:48:26.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert 2023-07-21T21:48:26.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-07-21T21:48:26.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp 2023-07-21T21:48:26.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-07-21T21:48:26.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt 2023-07-21T21:48:26.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-07-21T21:48:26.267 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input 2023-07-21T21:48:26.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport 2023-07-21T21:48:26.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-07-21T21:48:26.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/fm801-gp.ko 2023-07-21T21:48:26.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/gameport.ko 2023-07-21T21:48:26.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/lightning.ko 2023-07-21T21:48:26.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/gameport/ns558.ko 2023-07-21T21:48:26.268 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/joydev.ko 2023-07-21T21:48:26.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard 2023-07-21T21:48:26.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/keyboard/gpio_keys.ko 2023-07-21T21:48:26.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse 2023-07-21T21:48:26.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/appletouch.ko 2023-07-21T21:48:26.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/bcm5974.ko 2023-07-21T21:48:26.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/cyapatp.ko 2023-07-21T21:48:26.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/elan_i2c.ko 2023-07-21T21:48:26.269 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/sermouse.ko 2023-07-21T21:48:26.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-07-21T21:48:26.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/synaptics_usb.ko 2023-07-21T21:48:26.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/mouse/vsxxxaa.ko 2023-07-21T21:48:26.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4 2023-07-21T21:48:26.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/rmi4/rmi_core.ko 2023-07-21T21:48:26.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio 2023-07-21T21:48:26.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/altera_ps2.ko 2023-07-21T21:48:26.270 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/arc_ps2.ko 2023-07-21T21:48:26.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-07-21T21:48:26.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/serio/serio_raw.ko 2023-07-21T21:48:26.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/input/sparse-keymap.ko 2023-07-21T21:48:26.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu 2023-07-21T21:48:26.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd 2023-07-21T21:48:26.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/iommu/amd/iommu_v2.ko 2023-07-21T21:48:26.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds 2023-07-21T21:48:26.271 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-blinkm.ko 2023-07-21T21:48:26.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lm3530.ko 2023-07-21T21:48:26.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-lp3944.ko 2023-07-21T21:48:26.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/leds-ss4200.ko 2023-07-21T21:48:26.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger 2023-07-21T21:48:26.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-07-21T21:48:26.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-07-21T21:48:26.272 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-07-21T21:48:26.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-07-21T21:48:26.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-07-21T21:48:26.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-07-21T21:48:26.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-07-21T21:48:26.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-07-21T21:48:26.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md 2023-07-21T21:48:26.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache 2023-07-21T21:48:26.273 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/bcache/bcache.ko 2023-07-21T21:48:26.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-bio-prison.ko 2023-07-21T21:48:26.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache-smq.ko 2023-07-21T21:48:26.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-cache.ko 2023-07-21T21:48:26.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-crypt.ko 2023-07-21T21:48:26.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-delay.ko 2023-07-21T21:48:26.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-flakey.ko 2023-07-21T21:48:26.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-log-userspace.ko 2023-07-21T21:48:26.274 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-multipath.ko 2023-07-21T21:48:26.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-queue-length.ko 2023-07-21T21:48:26.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-raid.ko 2023-07-21T21:48:26.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-round-robin.ko 2023-07-21T21:48:26.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-service-time.ko 2023-07-21T21:48:26.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-switch.ko 2023-07-21T21:48:26.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-thin-pool.ko 2023-07-21T21:48:26.275 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/dm-verity.ko 2023-07-21T21:48:26.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/faulty.ko 2023-07-21T21:48:26.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/linear.ko 2023-07-21T21:48:26.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/multipath.ko 2023-07-21T21:48:26.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data 2023-07-21T21:48:26.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-07-21T21:48:26.276 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid0.ko 2023-07-21T21:48:26.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid1.ko 2023-07-21T21:48:26.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid10.ko 2023-07-21T21:48:26.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/md/raid456.ko 2023-07-21T21:48:26.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message 2023-07-21T21:48:26.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion 2023-07-21T21:48:26.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptbase.ko 2023-07-21T21:48:26.277 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptctl.ko 2023-07-21T21:48:26.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptfc.ko 2023-07-21T21:48:26.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptlan.ko 2023-07-21T21:48:26.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptsas.ko 2023-07-21T21:48:26.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptscsih.ko 2023-07-21T21:48:26.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/message/fusion/mptspi.ko 2023-07-21T21:48:26.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd 2023-07-21T21:48:26.278 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_ich.ko 2023-07-21T21:48:26.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/lpc_sch.ko 2023-07-21T21:48:26.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/mfd-core.ko 2023-07-21T21:48:26.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/sm501.ko 2023-07-21T21:48:26.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/viperboard.ko 2023-07-21T21:48:26.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/vx855.ko 2023-07-21T21:48:26.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/mfd/wl1273-core.ko 2023-07-21T21:48:26.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc 2023-07-21T21:48:26.279 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl 2023-07-21T21:48:26.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-07-21T21:48:26.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds9802als.ko 2023-07-21T21:48:26.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/apds990x.ko 2023-07-21T21:48:26.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/bh1770glc.ko 2023-07-21T21:48:26.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710 2023-07-21T21:48:26.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/cb710/cb710.ko 2023-07-21T21:48:26.280 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom 2023-07-21T21:48:26.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/at24.ko 2023-07-21T21:48:26.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom.ko 2023-07-21T21:48:26.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-07-21T21:48:26.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/eeprom/max6875.ko 2023-07-21T21:48:26.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/enclosure.ko 2023-07-21T21:48:26.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/hpilo.ko 2023-07-21T21:48:26.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29003.ko 2023-07-21T21:48:26.281 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/isl29020.ko 2023-07-21T21:48:26.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d 2023-07-21T21:48:26.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-07-21T21:48:26.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-07-21T21:48:26.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei 2023-07-21T21:48:26.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-me.ko 2023-07-21T21:48:26.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei-txe.ko 2023-07-21T21:48:26.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/mei/mei.ko 2023-07-21T21:48:26.282 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-gru 2023-07-21T21:48:26.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-gru/gru.ko 2023-07-21T21:48:26.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp 2023-07-21T21:48:26.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp/xp.ko 2023-07-21T21:48:26.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp/xpc.ko 2023-07-21T21:48:26.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-07-21T21:48:26.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_7xx1.ko 2023-07-21T21:48:26.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tifm_core.ko 2023-07-21T21:48:26.283 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/tsl2550.ko 2023-07-21T21:48:26.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_balloon.ko 2023-07-21T21:48:26.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci 2023-07-21T21:48:26.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-07-21T21:48:26.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net 2023-07-21T21:48:26.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding 2023-07-21T21:48:26.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/bonding/bonding.ko 2023-07-21T21:48:26.284 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa 2023-07-21T21:48:26.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53 2023-07-21T21:48:26.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/b53/b53_common.ko 2023-07-21T21:48:26.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/bcm-sf2.ko 2023-07-21T21:48:26.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6060.ko 2023-07-21T21:48:26.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx 2023-07-21T21:48:26.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-07-21T21:48:26.285 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/dummy.ko 2023-07-21T21:48:26.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/eql.ko 2023-07-21T21:48:26.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet 2023-07-21T21:48:26.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com 2023-07-21T21:48:26.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-07-21T21:48:26.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-07-21T21:48:26.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-07-21T21:48:26.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-07-21T21:48:26.286 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390 2023-07-21T21:48:26.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/8390.ko 2023-07-21T21:48:26.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-07-21T21:48:26.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-07-21T21:48:26.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-07-21T21:48:26.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec 2023-07-21T21:48:26.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-07-21T21:48:26.287 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere 2023-07-21T21:48:26.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/agere/et131x.ko 2023-07-21T21:48:26.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon 2023-07-21T21:48:26.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-07-21T21:48:26.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera 2023-07-21T21:48:26.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-07-21T21:48:26.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd 2023-07-21T21:48:26.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-07-21T21:48:26.288 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-07-21T21:48:26.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-07-21T21:48:26.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros 2023-07-21T21:48:26.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx 2023-07-21T21:48:26.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-07-21T21:48:26.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c 2023-07-21T21:48:26.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-07-21T21:48:26.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e 2023-07-21T21:48:26.289 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-07-21T21:48:26.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx 2023-07-21T21:48:26.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-07-21T21:48:26.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-07-21T21:48:26.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom 2023-07-21T21:48:26.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-07-21T21:48:26.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-07-21T21:48:26.290 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-07-21T21:48:26.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-07-21T21:48:26.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-07-21T21:48:26.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet 2023-07-21T21:48:26.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-07-21T21:48:26.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-07-21T21:48:26.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade 2023-07-21T21:48:26.291 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna 2023-07-21T21:48:26.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-07-21T21:48:26.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio 2023-07-21T21:48:26.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb 2023-07-21T21:48:26.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-07-21T21:48:26.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-07-21T21:48:26.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-07-21T21:48:26.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-07-21T21:48:26.292 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-07-21T21:48:26.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-07-21T21:48:26.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-07-21T21:48:26.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-07-21T21:48:26.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-07-21T21:48:26.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco 2023-07-21T21:48:26.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic 2023-07-21T21:48:26.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-07-21T21:48:26.293 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec 2023-07-21T21:48:26.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip 2023-07-21T21:48:26.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-07-21T21:48:26.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-07-21T21:48:26.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-07-21T21:48:26.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-07-21T21:48:26.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-07-21T21:48:26.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-07-21T21:48:26.294 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink 2023-07-21T21:48:26.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-07-21T21:48:26.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-07-21T21:48:26.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/dnet.ko 2023-07-21T21:48:26.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex 2023-07-21T21:48:26.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet 2023-07-21T21:48:26.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-07-21T21:48:26.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ethoc.ko 2023-07-21T21:48:26.295 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/fealnx.ko 2023-07-21T21:48:26.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel 2023-07-21T21:48:26.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e100.ko 2023-07-21T21:48:26.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000 2023-07-21T21:48:26.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-07-21T21:48:26.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e 2023-07-21T21:48:26.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-07-21T21:48:26.296 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k 2023-07-21T21:48:26.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-07-21T21:48:26.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e 2023-07-21T21:48:26.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-07-21T21:48:26.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf 2023-07-21T21:48:26.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-07-21T21:48:26.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb 2023-07-21T21:48:26.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-07-21T21:48:26.297 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf 2023-07-21T21:48:26.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-07-21T21:48:26.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe 2023-07-21T21:48:26.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-07-21T21:48:26.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf 2023-07-21T21:48:26.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-07-21T21:48:26.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/jme.ko 2023-07-21T21:48:26.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell 2023-07-21T21:48:26.298 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-07-21T21:48:26.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/skge.ko 2023-07-21T21:48:26.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-07-21T21:48:26.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox 2023-07-21T21:48:26.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4 2023-07-21T21:48:26.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-07-21T21:48:26.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-07-21T21:48:26.299 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5 2023-07-21T21:48:26.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-07-21T21:48:26.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-07-21T21:48:26.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel 2023-07-21T21:48:26.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-07-21T21:48:26.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom 2023-07-21T21:48:26.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge 2023-07-21T21:48:26.300 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-07-21T21:48:26.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi 2023-07-21T21:48:26.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-07-21T21:48:26.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-07-21T21:48:26.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion 2023-07-21T21:48:26.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-07-21T21:48:26.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia 2023-07-21T21:48:26.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-07-21T21:48:26.301 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines 2023-07-21T21:48:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-07-21T21:48:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-07-21T21:48:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic 2023-07-21T21:48:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen 2023-07-21T21:48:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-07-21T21:48:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-07-21T21:48:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-07-21T21:48:26.302 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-07-21T21:48:26.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc 2023-07-21T21:48:26.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-07-21T21:48:26.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek 2023-07-21T21:48:26.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-07-21T21:48:26.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-07-21T21:48:26.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/atp.ko 2023-07-21T21:48:26.303 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-07-21T21:48:26.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rocker 2023-07-21T21:48:26.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-07-21T21:48:26.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc 2023-07-21T21:48:26.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-07-21T21:48:26.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan 2023-07-21T21:48:26.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-07-21T21:48:26.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis 2023-07-21T21:48:26.304 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis190.ko 2023-07-21T21:48:26.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sis/sis900.ko 2023-07-21T21:48:26.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc 2023-07-21T21:48:26.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-07-21T21:48:26.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-07-21T21:48:26.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-07-21T21:48:26.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-07-21T21:48:26.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro 2023-07-21T21:48:26.305 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac 2023-07-21T21:48:26.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-07-21T21:48:26.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-07-21T21:48:26.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun 2023-07-21T21:48:26.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/cassini.ko 2023-07-21T21:48:26.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/niu.ko 2023-07-21T21:48:26.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sungem.ko 2023-07-21T21:48:26.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-07-21T21:48:26.306 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti 2023-07-21T21:48:26.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-07-21T21:48:26.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti 2023-07-21T21:48:26.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/ti/tlan.ko 2023-07-21T21:48:26.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via 2023-07-21T21:48:26.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-07-21T21:48:26.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-07-21T21:48:26.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet 2023-07-21T21:48:26.307 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-07-21T21:48:26.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-07-21T21:48:26.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom 2023-07-21T21:48:26.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-07-21T21:48:26.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/geneve.ko 2023-07-21T21:48:26.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv 2023-07-21T21:48:26.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-07-21T21:48:26.308 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154 2023-07-21T21:48:26.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ieee802154/fakelb.ko 2023-07-21T21:48:26.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ifb.ko 2023-07-21T21:48:26.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan 2023-07-21T21:48:26.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ipvlan/ipvlan.ko 2023-07-21T21:48:26.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvlan.ko 2023-07-21T21:48:26.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/macvtap.ko 2023-07-21T21:48:26.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio 2023-07-21T21:48:26.309 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio.ko 2023-07-21T21:48:26.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-07-21T21:48:26.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-07-21T21:48:26.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mdio/mdio-regmap.ko 2023-07-21T21:48:26.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/mii.ko 2023-07-21T21:48:26.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/net_failover.ko 2023-07-21T21:48:26.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/netconsole.ko 2023-07-21T21:48:26.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/nlmon.ko 2023-07-21T21:48:26.310 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs 2023-07-21T21:48:26.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs-lynx.ko 2023-07-21T21:48:26.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-07-21T21:48:26.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy 2023-07-21T21:48:26.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/amd.ko 2023-07-21T21:48:26.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-07-21T21:48:26.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-07-21T21:48:26.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm7xxx.ko 2023-07-21T21:48:26.311 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/bcm87xx.ko 2023-07-21T21:48:26.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/broadcom.ko 2023-07-21T21:48:26.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/cicada.ko 2023-07-21T21:48:26.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/davicom.ko 2023-07-21T21:48:26.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/dp83640.ko 2023-07-21T21:48:26.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/et1011c.ko 2023-07-21T21:48:26.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/icplus.ko 2023-07-21T21:48:26.312 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/lxt.ko 2023-07-21T21:48:26.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/marvell.ko 2023-07-21T21:48:26.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/micrel.ko 2023-07-21T21:48:26.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/national.ko 2023-07-21T21:48:26.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/phylink.ko 2023-07-21T21:48:26.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/qsemi.ko 2023-07-21T21:48:26.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/realtek.ko 2023-07-21T21:48:26.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/smsc.ko 2023-07-21T21:48:26.313 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/ste10Xp.ko 2023-07-21T21:48:26.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/phy/vitesse.ko 2023-07-21T21:48:26.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp 2023-07-21T21:48:26.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/bsd_comp.ko 2023-07-21T21:48:26.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_async.ko 2023-07-21T21:48:26.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_deflate.ko 2023-07-21T21:48:26.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_generic.ko 2023-07-21T21:48:26.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_mppe.ko 2023-07-21T21:48:26.314 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/ppp_synctty.ko 2023-07-21T21:48:26.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppoe.ko 2023-07-21T21:48:26.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pppox.ko 2023-07-21T21:48:26.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/ppp/pptp.ko 2023-07-21T21:48:26.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip 2023-07-21T21:48:26.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slhc.ko 2023-07-21T21:48:26.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/slip/slip.ko 2023-07-21T21:48:26.315 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/sungem_phy.ko 2023-07-21T21:48:26.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tap.ko 2023-07-21T21:48:26.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team 2023-07-21T21:48:26.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team.ko 2023-07-21T21:48:26.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_activebackup.ko 2023-07-21T21:48:26.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_broadcast.ko 2023-07-21T21:48:26.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-07-21T21:48:26.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_random.ko 2023-07-21T21:48:26.316 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-07-21T21:48:26.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/tun.ko 2023-07-21T21:48:26.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/veth.ko 2023-07-21T21:48:26.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/virtio_net.ko 2023-07-21T21:48:26.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3 2023-07-21T21:48:26.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-07-21T21:48:26.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan 2023-07-21T21:48:26.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/vxlan/vxlan.ko 2023-07-21T21:48:26.317 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback 2023-07-21T21:48:26.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netback/xen-netback.ko 2023-07-21T21:48:26.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/net/xen-netfront.ko 2023-07-21T21:48:26.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb 2023-07-21T21:48:26.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ntb/ntb.ko 2023-07-21T21:48:26.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme 2023-07-21T21:48:26.318 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host 2023-07-21T21:48:26.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme-core.ko 2023-07-21T21:48:26.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/nvme/host/nvme.ko 2023-07-21T21:48:26.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport 2023-07-21T21:48:26.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport.ko 2023-07-21T21:48:26.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_cs.ko 2023-07-21T21:48:26.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_pc.ko 2023-07-21T21:48:26.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/parport/parport_serial.ko 2023-07-21T21:48:26.319 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci 2023-07-21T21:48:26.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug 2023-07-21T21:48:26.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-07-21T21:48:26.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pcie 2023-07-21T21:48:26.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/pcie/aer_inject.ko 2023-07-21T21:48:26.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pci/xen-pcifront.ko 2023-07-21T21:48:26.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia 2023-07-21T21:48:26.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/i82092.ko 2023-07-21T21:48:26.320 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/pd6729.ko 2023-07-21T21:48:26.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pcmcia/yenta_socket.ko 2023-07-21T21:48:26.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl 2023-07-21T21:48:26.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel 2023-07-21T21:48:26.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-07-21T21:48:26.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform 2023-07-21T21:48:26.321 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86 2023-07-21T21:48:26.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acer-wmi.ko 2023-07-21T21:48:26.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/acerhdf.ko 2023-07-21T21:48:26.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/apple-gmux.ko 2023-07-21T21:48:26.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-laptop.ko 2023-07-21T21:48:26.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-07-21T21:48:26.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/asus-wmi.ko 2023-07-21T21:48:26.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/classmate-laptop.ko 2023-07-21T21:48:26.322 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-07-21T21:48:26.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-07-21T21:48:26.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-07-21T21:48:26.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-07-21T21:48:26.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/hdaps.ko 2023-07-21T21:48:26.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel 2023-07-21T21:48:26.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-07-21T21:48:26.323 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/intel_ips.ko 2023-07-21T21:48:26.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/msi-wmi.ko 2023-07-21T21:48:26.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/mxm-wmi.ko 2023-07-21T21:48:26.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-07-21T21:48:26.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-laptop.ko 2023-07-21T21:48:26.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/samsung-q10.ko 2023-07-21T21:48:26.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/topstar-laptop.ko 2023-07-21T21:48:26.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-07-21T21:48:26.324 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/toshiba_haps.ko 2023-07-21T21:48:26.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi-bmof.ko 2023-07-21T21:48:26.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/platform/x86/wmi.ko 2023-07-21T21:48:26.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap 2023-07-21T21:48:26.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_common.ko 2023-07-21T21:48:26.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/powercap/intel_rapl_msr.ko 2023-07-21T21:48:26.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps 2023-07-21T21:48:26.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients 2023-07-21T21:48:26.325 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-gpio.ko 2023-07-21T21:48:26.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps-ldisc.ko 2023-07-21T21:48:26.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/clients/pps_parport.ko 2023-07-21T21:48:26.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/pps/pps_core.ko 2023-07-21T21:48:26.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp 2023-07-21T21:48:26.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp.ko 2023-07-21T21:48:26.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ptp/ptp_kvm.ko 2023-07-21T21:48:26.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc 2023-07-21T21:48:26.326 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq32k.ko 2023-07-21T21:48:26.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-bq4802.ko 2023-07-21T21:48:26.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1286.ko 2023-07-21T21:48:26.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1307.ko 2023-07-21T21:48:26.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1374.ko 2023-07-21T21:48:26.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1511.ko 2023-07-21T21:48:26.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1553.ko 2023-07-21T21:48:26.327 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1672.ko 2023-07-21T21:48:26.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds1742.ko 2023-07-21T21:48:26.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds2404.ko 2023-07-21T21:48:26.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-ds3232.ko 2023-07-21T21:48:26.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-em3027.ko 2023-07-21T21:48:26.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-fm3130.ko 2023-07-21T21:48:26.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl12022.ko 2023-07-21T21:48:26.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-isl1208.ko 2023-07-21T21:48:26.328 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m41t80.ko 2023-07-21T21:48:26.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t35.ko 2023-07-21T21:48:26.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-m48t59.ko 2023-07-21T21:48:26.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-max6900.ko 2023-07-21T21:48:26.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-msm6242.ko 2023-07-21T21:48:26.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf2127.ko 2023-07-21T21:48:26.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf85063.ko 2023-07-21T21:48:26.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8523.ko 2023-07-21T21:48:26.329 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8563.ko 2023-07-21T21:48:26.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-pcf8583.ko 2023-07-21T21:48:26.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rp5c01.ko 2023-07-21T21:48:26.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rs5c372.ko 2023-07-21T21:48:26.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-07-21T21:48:26.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8025.ko 2023-07-21T21:48:26.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-rx8581.ko 2023-07-21T21:48:26.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-07-21T21:48:26.330 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/rtc/rtc-x1205.ko 2023-07-21T21:48:26.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi 2023-07-21T21:48:26.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-9xxx.ko 2023-07-21T21:48:26.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-sas.ko 2023-07-21T21:48:26.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/3w-xxxx.ko 2023-07-21T21:48:26.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/BusLogic.ko 2023-07-21T21:48:26.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/a100u2w.ko 2023-07-21T21:48:26.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid 2023-07-21T21:48:26.331 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aacraid/aacraid.ko 2023-07-21T21:48:26.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/advansys.ko 2023-07-21T21:48:26.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx 2023-07-21T21:48:26.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-07-21T21:48:26.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-07-21T21:48:26.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/am53c974.ko 2023-07-21T21:48:26.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr 2023-07-21T21:48:26.332 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-07-21T21:48:26.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/atp870u.ko 2023-07-21T21:48:26.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi 2023-07-21T21:48:26.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-07-21T21:48:26.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa 2023-07-21T21:48:26.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bfa/bfa.ko 2023-07-21T21:48:26.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc 2023-07-21T21:48:26.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-07-21T21:48:26.333 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i 2023-07-21T21:48:26.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-07-21T21:48:26.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ch.ko 2023-07-21T21:48:26.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor 2023-07-21T21:48:26.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/csiostor/csiostor.ko 2023-07-21T21:48:26.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi 2023-07-21T21:48:26.334 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i 2023-07-21T21:48:26.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-07-21T21:48:26.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i 2023-07-21T21:48:26.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-07-21T21:48:26.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-07-21T21:48:26.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dc395x.ko 2023-07-21T21:48:26.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler 2023-07-21T21:48:26.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-07-21T21:48:26.335 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-07-21T21:48:26.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-07-21T21:48:26.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-07-21T21:48:26.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/dmx3191d.ko 2023-07-21T21:48:26.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r 2023-07-21T21:48:26.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esas2r/esas2r.ko 2023-07-21T21:48:26.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/esp_scsi.ko 2023-07-21T21:48:26.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe 2023-07-21T21:48:26.336 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/fcoe.ko 2023-07-21T21:48:26.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-07-21T21:48:26.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic 2023-07-21T21:48:26.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/fnic/fnic.ko 2023-07-21T21:48:26.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hpsa.ko 2023-07-21T21:48:26.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hptiop.ko 2023-07-21T21:48:26.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/hv_storvsc.ko 2023-07-21T21:48:26.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/initio.ko 2023-07-21T21:48:26.337 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ipr.ko 2023-07-21T21:48:26.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ips.ko 2023-07-21T21:48:26.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci 2023-07-21T21:48:26.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/isci/isci.ko 2023-07-21T21:48:26.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-07-21T21:48:26.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/iscsi_tcp.ko 2023-07-21T21:48:26.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc 2023-07-21T21:48:26.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libfc/libfc.ko 2023-07-21T21:48:26.338 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi.ko 2023-07-21T21:48:26.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libiscsi_tcp.ko 2023-07-21T21:48:26.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas 2023-07-21T21:48:26.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/libsas/libsas.ko 2023-07-21T21:48:26.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc 2023-07-21T21:48:26.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/lpfc/lpfc.ko 2023-07-21T21:48:26.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid 2023-07-21T21:48:26.339 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid.ko 2023-07-21T21:48:26.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-07-21T21:48:26.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-07-21T21:48:26.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-07-21T21:48:26.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas 2023-07-21T21:48:26.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-07-21T21:48:26.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas 2023-07-21T21:48:26.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvsas/mvsas.ko 2023-07-21T21:48:26.340 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/mvumi.ko 2023-07-21T21:48:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001 2023-07-21T21:48:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-07-21T21:48:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/pmcraid.ko 2023-07-21T21:48:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla1280.ko 2023-07-21T21:48:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx 2023-07-21T21:48:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-07-21T21:48:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-07-21T21:48:26.341 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx 2023-07-21T21:48:26.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-07-21T21:48:26.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/raid_class.ko 2023-07-21T21:48:26.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_debug.ko 2023-07-21T21:48:26.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_fc.ko 2023-07-21T21:48:26.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-07-21T21:48:26.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_sas.ko 2023-07-21T21:48:26.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_spi.ko 2023-07-21T21:48:26.342 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/scsi_transport_srp.ko 2023-07-21T21:48:26.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/ses.ko 2023-07-21T21:48:26.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/st.ko 2023-07-21T21:48:26.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/stex.ko 2023-07-21T21:48:26.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2 2023-07-21T21:48:26.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-07-21T21:48:26.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/virtio_scsi.ko 2023-07-21T21:48:26.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/vmw_pvscsi.ko 2023-07-21T21:48:26.343 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/scsi/wd719x.ko 2023-07-21T21:48:26.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb 2023-07-21T21:48:26.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ssb/ssb.ko 2023-07-21T21:48:26.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target 2023-07-21T21:48:26.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi 2023-07-21T21:48:26.344 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-07-21T21:48:26.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback 2023-07-21T21:48:26.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/loopback/tcm_loop.ko 2023-07-21T21:48:26.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_file.ko 2023-07-21T21:48:26.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_iblock.ko 2023-07-21T21:48:26.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_mod.ko 2023-07-21T21:48:26.345 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_pscsi.ko 2023-07-21T21:48:26.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/target_core_user.ko 2023-07-21T21:48:26.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc 2023-07-21T21:48:26.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-07-21T21:48:26.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal 2023-07-21T21:48:26.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel 2023-07-21T21:48:26.346 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal 2023-07-21T21:48:26.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-07-21T21:48:26.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-07-21T21:48:26.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-07-21T21:48:26.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-07-21T21:48:26.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-07-21T21:48:26.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-07-21T21:48:26.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-07-21T21:48:26.347 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-07-21T21:48:26.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-07-21T21:48:26.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-07-21T21:48:26.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-07-21T21:48:26.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-07-21T21:48:26.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-07-21T21:48:26.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-07-21T21:48:26.348 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-07-21T21:48:26.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty 2023-07-21T21:48:26.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless 2023-07-21T21:48:26.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-07-21T21:48:26.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_gsm.ko 2023-07-21T21:48:26.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/n_hdlc.ko 2023-07-21T21:48:26.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/nozomi.ko 2023-07-21T21:48:26.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial 2023-07-21T21:48:26.349 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250 2023-07-21T21:48:26.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-07-21T21:48:26.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/arc_uart.ko 2023-07-21T21:48:26.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm 2023-07-21T21:48:26.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/serial/jsm/jsm.ko 2023-07-21T21:48:26.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/tty/synclink_gt.ko 2023-07-21T21:48:26.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs 2023-07-21T21:48:26.350 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core 2023-07-21T21:48:26.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/core/ufshcd-core.ko 2023-07-21T21:48:26.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host 2023-07-21T21:48:26.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-07-21T21:48:26.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio 2023-07-21T21:48:26.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio.ko 2023-07-21T21:48:26.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_aec.ko 2023-07-21T21:48:26.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_cif.ko 2023-07-21T21:48:26.351 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_pci_generic.ko 2023-07-21T21:48:26.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/uio/uio_sercos3.ko 2023-07-21T21:48:26.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb 2023-07-21T21:48:26.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class 2023-07-21T21:48:26.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-acm.ko 2023-07-21T21:48:26.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/cdc-wdm.ko 2023-07-21T21:48:26.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usblp.ko 2023-07-21T21:48:26.352 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/class/usbtmc.ko 2023-07-21T21:48:26.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host 2023-07-21T21:48:26.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/host/sl811-hcd.ko 2023-07-21T21:48:26.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image 2023-07-21T21:48:26.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/mdc800.ko 2023-07-21T21:48:26.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/image/microtek.ko 2023-07-21T21:48:26.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc 2023-07-21T21:48:26.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/adutux.ko 2023-07-21T21:48:26.353 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/appledisplay.ko 2023-07-21T21:48:26.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi26.ko 2023-07-21T21:48:26.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/emi62.ko 2023-07-21T21:48:26.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ezusb.ko 2023-07-21T21:48:26.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/idmouse.ko 2023-07-21T21:48:26.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/iowarrior.ko 2023-07-21T21:48:26.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/isight_firmware.ko 2023-07-21T21:48:26.354 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/ldusb.ko 2023-07-21T21:48:26.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/legousbtower.ko 2023-07-21T21:48:26.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga 2023-07-21T21:48:26.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-07-21T21:48:26.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/trancevibrator.ko 2023-07-21T21:48:26.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usb3503.ko 2023-07-21T21:48:26.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usblcd.ko 2023-07-21T21:48:26.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/usbsevseg.ko 2023-07-21T21:48:26.355 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/uss720.ko 2023-07-21T21:48:26.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/misc/yurex.ko 2023-07-21T21:48:26.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy 2023-07-21T21:48:26.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/phy/phy-generic.ko 2023-07-21T21:48:26.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial 2023-07-21T21:48:26.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/aircable.ko 2023-07-21T21:48:26.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ark3116.ko 2023-07-21T21:48:26.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/belkin_sa.ko 2023-07-21T21:48:26.356 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ch341.ko 2023-07-21T21:48:26.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cp210x.ko 2023-07-21T21:48:26.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cyberjack.ko 2023-07-21T21:48:26.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/cypress_m8.ko 2023-07-21T21:48:26.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/digi_acceleport.ko 2023-07-21T21:48:26.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/empeg.ko 2023-07-21T21:48:26.357 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ftdi_sio.ko 2023-07-21T21:48:26.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/garmin_gps.ko 2023-07-21T21:48:26.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_edgeport.ko 2023-07-21T21:48:26.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/io_ti.ko 2023-07-21T21:48:26.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipaq.ko 2023-07-21T21:48:26.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ipw.ko 2023-07-21T21:48:26.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ir-usb.ko 2023-07-21T21:48:26.358 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-07-21T21:48:26.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan.ko 2023-07-21T21:48:26.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/keyspan_pda.ko 2023-07-21T21:48:26.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kl5kusb105.ko 2023-07-21T21:48:26.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/kobil_sct.ko 2023-07-21T21:48:26.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mct_u232.ko 2023-07-21T21:48:26.359 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7720.ko 2023-07-21T21:48:26.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/mos7840.ko 2023-07-21T21:48:26.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/navman.ko 2023-07-21T21:48:26.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/omninet.ko 2023-07-21T21:48:26.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/opticon.ko 2023-07-21T21:48:26.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/option.ko 2023-07-21T21:48:26.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/oti6858.ko 2023-07-21T21:48:26.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/pl2303.ko 2023-07-21T21:48:26.360 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcaux.ko 2023-07-21T21:48:26.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/qcserial.ko 2023-07-21T21:48:26.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/quatech2.ko 2023-07-21T21:48:26.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/safe_serial.ko 2023-07-21T21:48:26.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/sierra.ko 2023-07-21T21:48:26.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/spcp8x5.ko 2023-07-21T21:48:26.361 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ssu100.ko 2023-07-21T21:48:26.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/symbolserial.ko 2023-07-21T21:48:26.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-07-21T21:48:26.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-07-21T21:48:26.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_debug.ko 2023-07-21T21:48:26.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/usb_wwan.ko 2023-07-21T21:48:26.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/visor.ko 2023-07-21T21:48:26.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/whiteheat.ko 2023-07-21T21:48:26.362 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/serial/xsens_mt.ko 2023-07-21T21:48:26.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage 2023-07-21T21:48:26.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/uas.ko 2023-07-21T21:48:26.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-alauda.ko 2023-07-21T21:48:26.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-cypress.ko 2023-07-21T21:48:26.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-datafab.ko 2023-07-21T21:48:26.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-07-21T21:48:26.363 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-freecom.ko 2023-07-21T21:48:26.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-isd200.ko 2023-07-21T21:48:26.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-07-21T21:48:26.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-karma.ko 2023-07-21T21:48:26.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-onetouch.ko 2023-07-21T21:48:26.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-realtek.ko 2023-07-21T21:48:26.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr09.ko 2023-07-21T21:48:26.364 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-sddr55.ko 2023-07-21T21:48:26.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/ums-usbat.ko 2023-07-21T21:48:26.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/storage/usb-storage.ko 2023-07-21T21:48:26.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip 2023-07-21T21:48:26.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-core.ko 2023-07-21T21:48:26.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/usbip-host.ko 2023-07-21T21:48:26.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-07-21T21:48:26.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio 2023-07-21T21:48:26.365 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci 2023-07-21T21:48:26.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-07-21T21:48:26.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/pci/vfio-pci.ko 2023-07-21T21:48:26.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio.ko 2023-07-21T21:48:26.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-07-21T21:48:26.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost 2023-07-21T21:48:26.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost.ko 2023-07-21T21:48:26.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_iotlb.ko 2023-07-21T21:48:26.366 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_net.ko 2023-07-21T21:48:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/vhost/vhost_scsi.ko 2023-07-21T21:48:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video 2023-07-21T21:48:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight 2023-07-21T21:48:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/apple_bl.ko 2023-07-21T21:48:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/lcd.ko 2023-07-21T21:48:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/video/backlight/platform_lcd.ko 2023-07-21T21:48:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio 2023-07-21T21:48:26.367 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio.ko 2023-07-21T21:48:26.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_balloon.ko 2023-07-21T21:48:26.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_mmio.ko 2023-07-21T21:48:26.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_pci.ko 2023-07-21T21:48:26.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-07-21T21:48:26.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-07-21T21:48:26.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/virtio/virtio_ring.ko 2023-07-21T21:48:26.368 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1 2023-07-21T21:48:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters 2023-07-21T21:48:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2482.ko 2023-07-21T21:48:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/masters/ds2490.ko 2023-07-21T21:48:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves 2023-07-21T21:48:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-07-21T21:48:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-07-21T21:48:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-07-21T21:48:26.369 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-07-21T21:48:26.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-07-21T21:48:26.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-07-21T21:48:26.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-07-21T21:48:26.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-07-21T21:48:26.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-07-21T21:48:26.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_smem.ko 2023-07-21T21:48:26.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/slaves/w1_therm.ko 2023-07-21T21:48:26.370 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/w1/wire.ko 2023-07-21T21:48:26.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog 2023-07-21T21:48:26.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim1535_wdt.ko 2023-07-21T21:48:26.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/alim7101_wdt.ko 2023-07-21T21:48:26.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/f71808e_wdt.ko 2023-07-21T21:48:26.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/hpwdt.ko 2023-07-21T21:48:26.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/i6300esb.ko 2023-07-21T21:48:26.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-07-21T21:48:26.371 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/iTCO_wdt.ko 2023-07-21T21:48:26.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ib700wdt.ko 2023-07-21T21:48:26.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ibmasr.ko 2023-07-21T21:48:26.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-07-21T21:48:26.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it8712f_wdt.ko 2023-07-21T21:48:26.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/it87_wdt.ko 2023-07-21T21:48:26.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/machzwd.ko 2023-07-21T21:48:26.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/nv_tco.ko 2023-07-21T21:48:26.372 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_pci.ko 2023-07-21T21:48:26.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/pcwd_usb.ko 2023-07-21T21:48:26.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-07-21T21:48:26.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sch311x_wdt.ko 2023-07-21T21:48:26.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/softdog.ko 2023-07-21T21:48:26.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/sp5100_tco.ko 2023-07-21T21:48:26.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/via_wdt.ko 2023-07-21T21:48:26.373 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-07-21T21:48:26.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83877f_wdt.ko 2023-07-21T21:48:26.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/w83977f_wdt.ko 2023-07-21T21:48:26.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/wdt_pci.ko 2023-07-21T21:48:26.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/watchdog/xen_wdt.ko 2023-07-21T21:48:26.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen 2023-07-21T21:48:26.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-acpi-processor.ko 2023-07-21T21:48:26.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-evtchn.ko 2023-07-21T21:48:26.374 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntalloc.ko 2023-07-21T21:48:26.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-gntdev.ko 2023-07-21T21:48:26.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback 2023-07-21T21:48:26.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-07-21T21:48:26.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xen-privcmd.ko 2023-07-21T21:48:26.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs 2023-07-21T21:48:26.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/drivers/xen/xenfs/xenfs.ko 2023-07-21T21:48:26.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs 2023-07-21T21:48:26.375 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p 2023-07-21T21:48:26.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/9p/9p.ko 2023-07-21T21:48:26.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs 2023-07-21T21:48:26.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/affs/affs.ko 2023-07-21T21:48:26.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs 2023-07-21T21:48:26.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/befs/befs.ko 2023-07-21T21:48:26.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/binfmt_misc.ko 2023-07-21T21:48:26.376 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs 2023-07-21T21:48:26.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/btrfs/btrfs.ko 2023-07-21T21:48:26.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles 2023-07-21T21:48:26.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cachefiles/cachefiles.ko 2023-07-21T21:48:26.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph 2023-07-21T21:48:26.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ceph/ceph.ko 2023-07-21T21:48:26.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda 2023-07-21T21:48:26.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/coda/coda.ko 2023-07-21T21:48:26.377 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs 2023-07-21T21:48:26.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/cramfs/cramfs.ko 2023-07-21T21:48:26.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm 2023-07-21T21:48:26.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/dlm/dlm.ko 2023-07-21T21:48:26.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ecryptfs 2023-07-21T21:48:26.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ecryptfs/ecryptfs.ko 2023-07-21T21:48:26.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs 2023-07-21T21:48:26.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/f2fs/f2fs.ko 2023-07-21T21:48:26.378 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat 2023-07-21T21:48:26.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/fat.ko 2023-07-21T21:48:26.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/msdos.ko 2023-07-21T21:48:26.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fat/vfat.ko 2023-07-21T21:48:26.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache 2023-07-21T21:48:26.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fscache/fscache.ko 2023-07-21T21:48:26.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse 2023-07-21T21:48:26.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/cuse.ko 2023-07-21T21:48:26.379 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/fuse/fuse.ko 2023-07-21T21:48:26.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2 2023-07-21T21:48:26.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/gfs2/gfs2.ko 2023-07-21T21:48:26.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs 2023-07-21T21:48:26.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfs/hfs.ko 2023-07-21T21:48:26.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus 2023-07-21T21:48:26.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/hfsplus/hfsplus.ko 2023-07-21T21:48:26.380 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs 2023-07-21T21:48:26.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/isofs/isofs.ko 2023-07-21T21:48:26.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs 2023-07-21T21:48:26.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/jfs/jfs.ko 2023-07-21T21:48:26.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd 2023-07-21T21:48:26.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/lockd/lockd.ko 2023-07-21T21:48:26.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix 2023-07-21T21:48:26.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/minix/minix.ko 2023-07-21T21:48:26.381 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs 2023-07-21T21:48:26.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/netfs/netfs.ko 2023-07-21T21:48:26.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs 2023-07-21T21:48:26.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout 2023-07-21T21:48:26.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-07-21T21:48:26.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout 2023-07-21T21:48:26.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-07-21T21:48:26.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout 2023-07-21T21:48:26.382 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-07-21T21:48:26.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfs.ko 2023-07-21T21:48:26.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv3.ko 2023-07-21T21:48:26.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs/nfsv4.ko 2023-07-21T21:48:26.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common 2023-07-21T21:48:26.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/grace.ko 2023-07-21T21:48:26.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfs_common/nfs_acl.ko 2023-07-21T21:48:26.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd 2023-07-21T21:48:26.383 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nfsd/nfsd.ko 2023-07-21T21:48:26.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2 2023-07-21T21:48:26.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nilfs2/nilfs2.ko 2023-07-21T21:48:26.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls 2023-07-21T21:48:26.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-celtic.ko 2023-07-21T21:48:26.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-centeuro.ko 2023-07-21T21:48:26.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-croatian.ko 2023-07-21T21:48:26.384 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-cyrillic.ko 2023-07-21T21:48:26.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-gaelic.ko 2023-07-21T21:48:26.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-greek.ko 2023-07-21T21:48:26.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-iceland.ko 2023-07-21T21:48:26.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-inuit.ko 2023-07-21T21:48:26.385 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-roman.ko 2023-07-21T21:48:26.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-romanian.ko 2023-07-21T21:48:26.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/mac-turkish.ko 2023-07-21T21:48:26.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1250.ko 2023-07-21T21:48:26.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1251.ko 2023-07-21T21:48:26.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp1255.ko 2023-07-21T21:48:26.386 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp737.ko 2023-07-21T21:48:26.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp775.ko 2023-07-21T21:48:26.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp850.ko 2023-07-21T21:48:26.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp852.ko 2023-07-21T21:48:26.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp855.ko 2023-07-21T21:48:26.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp857.ko 2023-07-21T21:48:26.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp860.ko 2023-07-21T21:48:26.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp861.ko 2023-07-21T21:48:26.387 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp862.ko 2023-07-21T21:48:26.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp863.ko 2023-07-21T21:48:26.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp864.ko 2023-07-21T21:48:26.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp865.ko 2023-07-21T21:48:26.388 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp866.ko 2023-07-21T21:48:26.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp869.ko 2023-07-21T21:48:26.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp874.ko 2023-07-21T21:48:26.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp932.ko 2023-07-21T21:48:26.389 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp936.ko 2023-07-21T21:48:26.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp949.ko 2023-07-21T21:48:26.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_cp950.ko 2023-07-21T21:48:26.390 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_euc-jp.ko 2023-07-21T21:48:26.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-1.ko 2023-07-21T21:48:26.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-13.ko 2023-07-21T21:48:26.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-14.ko 2023-07-21T21:48:26.391 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-15.ko 2023-07-21T21:48:26.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-2.ko 2023-07-21T21:48:26.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-3.ko 2023-07-21T21:48:26.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-4.ko 2023-07-21T21:48:26.392 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-5.ko 2023-07-21T21:48:26.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-6.ko 2023-07-21T21:48:26.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-7.ko 2023-07-21T21:48:26.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_iso8859-9.ko 2023-07-21T21:48:26.393 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-r.ko 2023-07-21T21:48:26.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-ru.ko 2023-07-21T21:48:26.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_koi8-u.ko 2023-07-21T21:48:26.394 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/nls/nls_utf8.ko 2023-07-21T21:48:26.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2 2023-07-21T21:48:26.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster 2023-07-21T21:48:26.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-07-21T21:48:26.395 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm 2023-07-21T21:48:26.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-07-21T21:48:26.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs 2023-07-21T21:48:26.396 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-07-21T21:48:26.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2.ko 2023-07-21T21:48:26.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-07-21T21:48:26.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-07-21T21:48:26.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-07-21T21:48:26.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs 2023-07-21T21:48:26.397 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/overlayfs/overlay.ko 2023-07-21T21:48:26.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore 2023-07-21T21:48:26.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/pstore/ramoops.ko 2023-07-21T21:48:26.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs 2023-07-21T21:48:26.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/reiserfs/reiserfs.ko 2023-07-21T21:48:26.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs 2023-07-21T21:48:26.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/romfs/romfs.ko 2023-07-21T21:48:26.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb 2023-07-21T21:48:26.398 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client 2023-07-21T21:48:26.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/client/cifs.ko 2023-07-21T21:48:26.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common 2023-07-21T21:48:26.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_arc4.ko 2023-07-21T21:48:26.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/smb/common/cifs_md4.ko 2023-07-21T21:48:26.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs 2023-07-21T21:48:26.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/squashfs/squashfs.ko 2023-07-21T21:48:26.399 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv 2023-07-21T21:48:26.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/sysv/sysv.ko 2023-07-21T21:48:26.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf 2023-07-21T21:48:26.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/udf/udf.ko 2023-07-21T21:48:26.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs 2023-07-21T21:48:26.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/ufs/ufs.ko 2023-07-21T21:48:26.400 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs 2023-07-21T21:48:26.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/fs/xfs/xfs.ko 2023-07-21T21:48:26.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel 2023-07-21T21:48:26.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/rcu 2023-07-21T21:48:26.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/rcu/rcutorture.ko 2023-07-21T21:48:26.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/torture.ko 2023-07-21T21:48:26.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/trace 2023-07-21T21:48:26.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-07-21T21:48:26.401 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib 2023-07-21T21:48:26.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/asn1_encoder.ko 2023-07-21T21:48:26.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc-itu-t.ko 2023-07-21T21:48:26.402 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crc8.ko 2023-07-21T21:48:26.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto 2023-07-21T21:48:26.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libarc4.ko 2023-07-21T21:48:26.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/crypto/libdes.ko 2023-07-21T21:48:26.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/libcrc32c.ko 2023-07-21T21:48:26.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lru_cache.ko 2023-07-21T21:48:26.403 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4 2023-07-21T21:48:26.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4_compress.ko 2023-07-21T21:48:26.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/lz4/lz4hc_compress.ko 2023-07-21T21:48:26.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math 2023-07-21T21:48:26.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/math/cordic.ko 2023-07-21T21:48:26.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6 2023-07-21T21:48:26.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/raid6/raid6_pq.ko 2023-07-21T21:48:26.404 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon 2023-07-21T21:48:26.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/reed_solomon/reed_solomon.ko 2023-07-21T21:48:26.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_bm.ko 2023-07-21T21:48:26.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_fsm.ko 2023-07-21T21:48:26.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/ts_kmp.ko 2023-07-21T21:48:26.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/zstd 2023-07-21T21:48:26.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/lib/zstd/zstd_compress.ko 2023-07-21T21:48:26.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm 2023-07-21T21:48:26.405 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/mm/hwpoison-inject.ko 2023-07-21T21:48:26.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net 2023-07-21T21:48:26.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan 2023-07-21T21:48:26.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/6lowpan.ko 2023-07-21T21:48:26.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_dest.ko 2023-07-21T21:48:26.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_fragment.ko 2023-07-21T21:48:26.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_hop.ko 2023-07-21T21:48:26.406 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_ipv6.ko 2023-07-21T21:48:26.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_mobility.ko 2023-07-21T21:48:26.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_routing.ko 2023-07-21T21:48:26.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/6lowpan/nhc_udp.ko 2023-07-21T21:48:26.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802 2023-07-21T21:48:26.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/garp.ko 2023-07-21T21:48:26.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/mrp.ko 2023-07-21T21:48:26.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/p8022.ko 2023-07-21T21:48:26.407 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/psnap.ko 2023-07-21T21:48:26.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/802/stp.ko 2023-07-21T21:48:26.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q 2023-07-21T21:48:26.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/8021q/8021q.ko 2023-07-21T21:48:26.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p 2023-07-21T21:48:26.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet.ko 2023-07-21T21:48:26.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_fd.ko 2023-07-21T21:48:26.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_rdma.ko 2023-07-21T21:48:26.408 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/9p/9pnet_virtio.ko 2023-07-21T21:48:26.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv 2023-07-21T21:48:26.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/batman-adv/batman-adv.ko 2023-07-21T21:48:26.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge 2023-07-21T21:48:26.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/br_netfilter.ko 2023-07-21T21:48:26.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/bridge.ko 2023-07-21T21:48:26.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter 2023-07-21T21:48:26.409 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-07-21T21:48:26.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_among.ko 2023-07-21T21:48:26.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arp.ko 2023-07-21T21:48:26.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-07-21T21:48:26.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-07-21T21:48:26.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip.ko 2023-07-21T21:48:26.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-07-21T21:48:26.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_limit.ko 2023-07-21T21:48:26.410 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_log.ko 2023-07-21T21:48:26.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark.ko 2023-07-21T21:48:26.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-07-21T21:48:26.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-07-21T21:48:26.411 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-07-21T21:48:26.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-07-21T21:48:26.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_snat.ko 2023-07-21T21:48:26.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_stp.ko 2023-07-21T21:48:26.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-07-21T21:48:26.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-07-21T21:48:26.412 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-07-21T21:48:26.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-07-21T21:48:26.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/ebtables.ko 2023-07-21T21:48:26.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-07-21T21:48:26.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-07-21T21:48:26.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-07-21T21:48:26.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph 2023-07-21T21:48:26.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ceph/libceph.ko 2023-07-21T21:48:26.413 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core 2023-07-21T21:48:26.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/failover.ko 2023-07-21T21:48:26.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/core/pktgen.ko 2023-07-21T21:48:26.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp 2023-07-21T21:48:26.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp.ko 2023-07-21T21:48:26.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_diag.ko 2023-07-21T21:48:26.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv4.ko 2023-07-21T21:48:26.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dccp/dccp_ipv6.ko 2023-07-21T21:48:26.414 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dns_resolver 2023-07-21T21:48:26.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dns_resolver/dns_resolver.ko 2023-07-21T21:48:26.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa 2023-07-21T21:48:26.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/dsa_core.ko 2023-07-21T21:48:26.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_brcm.ko 2023-07-21T21:48:26.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_dsa.ko 2023-07-21T21:48:26.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_none.ko 2023-07-21T21:48:26.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/dsa/tag_trailer.ko 2023-07-21T21:48:26.415 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154 2023-07-21T21:48:26.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan 2023-07-21T21:48:26.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-07-21T21:48:26.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154.ko 2023-07-21T21:48:26.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ieee802154/ieee802154_socket.ko 2023-07-21T21:48:26.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4 2023-07-21T21:48:26.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ah4.ko 2023-07-21T21:48:26.416 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/esp4.ko 2023-07-21T21:48:26.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/fou.ko 2023-07-21T21:48:26.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/gre.ko 2023-07-21T21:48:26.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/inet_diag.ko 2023-07-21T21:48:26.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_gre.ko 2023-07-21T21:48:26.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_tunnel.ko 2023-07-21T21:48:26.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ip_vti.ko 2023-07-21T21:48:26.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipcomp.ko 2023-07-21T21:48:26.417 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/ipip.ko 2023-07-21T21:48:26.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter 2023-07-21T21:48:26.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arp_tables.ko 2023-07-21T21:48:26.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-07-21T21:48:26.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-07-21T21:48:26.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-07-21T21:48:26.418 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-07-21T21:48:26.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-07-21T21:48:26.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-07-21T21:48:26.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-07-21T21:48:26.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-07-21T21:48:26.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-07-21T21:48:26.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/iptable_security.ko 2023-07-21T21:48:26.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-07-21T21:48:26.419 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-07-21T21:48:26.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-07-21T21:48:26.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-07-21T21:48:26.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-07-21T21:48:26.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-07-21T21:48:26.420 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-07-21T21:48:26.421 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-07-21T21:48:26.421 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-07-21T21:48:26.421 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-07-21T21:48:26.421 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_bic.ko 2023-07-21T21:48:26.421 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_dctcp.ko 2023-07-21T21:48:26.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_diag.ko 2023-07-21T21:48:26.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_highspeed.ko 2023-07-21T21:48:26.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_htcp.ko 2023-07-21T21:48:26.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_hybla.ko 2023-07-21T21:48:26.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_illinois.ko 2023-07-21T21:48:26.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_lp.ko 2023-07-21T21:48:26.422 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_scalable.ko 2023-07-21T21:48:26.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_vegas.ko 2023-07-21T21:48:26.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_veno.ko 2023-07-21T21:48:26.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_westwood.ko 2023-07-21T21:48:26.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tcp_yeah.ko 2023-07-21T21:48:26.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/tunnel4.ko 2023-07-21T21:48:26.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_diag.ko 2023-07-21T21:48:26.423 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/udp_tunnel.ko 2023-07-21T21:48:26.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv4/xfrm4_tunnel.ko 2023-07-21T21:48:26.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6 2023-07-21T21:48:26.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ah6.ko 2023-07-21T21:48:26.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/esp6.ko 2023-07-21T21:48:26.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/fou6.ko 2023-07-21T21:48:26.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_tunnel.ko 2023-07-21T21:48:26.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-07-21T21:48:26.424 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ip6_vti.ko 2023-07-21T21:48:26.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/ipcomp6.ko 2023-07-21T21:48:26.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter 2023-07-21T21:48:26.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-07-21T21:48:26.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-07-21T21:48:26.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-07-21T21:48:26.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-07-21T21:48:26.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-07-21T21:48:26.425 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-07-21T21:48:26.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-07-21T21:48:26.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-07-21T21:48:26.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-07-21T21:48:26.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-07-21T21:48:26.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-07-21T21:48:26.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-07-21T21:48:26.426 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-07-21T21:48:26.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-07-21T21:48:26.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-07-21T21:48:26.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-07-21T21:48:26.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-07-21T21:48:26.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-07-21T21:48:26.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-07-21T21:48:26.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-07-21T21:48:26.427 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-07-21T21:48:26.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-07-21T21:48:26.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-07-21T21:48:26.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-07-21T21:48:26.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/sit.ko 2023-07-21T21:48:26.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/tunnel6.ko 2023-07-21T21:48:26.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/ipv6/xfrm6_tunnel.ko 2023-07-21T21:48:26.428 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key 2023-07-21T21:48:26.429 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/key/af_key.ko 2023-07-21T21:48:26.429 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp 2023-07-21T21:48:26.429 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_core.ko 2023-07-21T21:48:26.429 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_debugfs.ko 2023-07-21T21:48:26.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_eth.ko 2023-07-21T21:48:26.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip.ko 2023-07-21T21:48:26.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ip6.ko 2023-07-21T21:48:26.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_netlink.ko 2023-07-21T21:48:26.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/l2tp/l2tp_ppp.ko 2023-07-21T21:48:26.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc 2023-07-21T21:48:26.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/llc/llc.ko 2023-07-21T21:48:26.430 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154 2023-07-21T21:48:26.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mac802154/mac802154.ko 2023-07-21T21:48:26.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls 2023-07-21T21:48:26.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/mpls/mpls_gso.ko 2023-07-21T21:48:26.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter 2023-07-21T21:48:26.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset 2023-07-21T21:48:26.431 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set.ko 2023-07-21T21:48:26.432 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-07-21T21:48:26.432 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-07-21T21:48:26.432 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-07-21T21:48:26.433 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-07-21T21:48:26.433 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-07-21T21:48:26.433 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-07-21T21:48:26.433 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-07-21T21:48:26.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-07-21T21:48:26.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-07-21T21:48:26.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-07-21T21:48:26.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-07-21T21:48:26.434 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-07-21T21:48:26.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-07-21T21:48:26.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-07-21T21:48:26.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-07-21T21:48:26.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs 2023-07-21T21:48:26.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs.ko 2023-07-21T21:48:26.435 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-07-21T21:48:26.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-07-21T21:48:26.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-07-21T21:48:26.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-07-21T21:48:26.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-07-21T21:48:26.436 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-07-21T21:48:26.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-07-21T21:48:26.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-07-21T21:48:26.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-07-21T21:48:26.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-07-21T21:48:26.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-07-21T21:48:26.437 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-07-21T21:48:26.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-07-21T21:48:26.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conncount.ko 2023-07-21T21:48:26.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack.ko 2023-07-21T21:48:26.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-07-21T21:48:26.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-07-21T21:48:26.438 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-07-21T21:48:26.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_h323.ko 2023-07-21T21:48:26.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_irc.ko 2023-07-21T21:48:26.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-07-21T21:48:26.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-07-21T21:48:26.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-07-21T21:48:26.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sane.ko 2023-07-21T21:48:26.439 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_sip.ko 2023-07-21T21:48:26.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-07-21T21:48:26.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-07-21T21:48:26.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_dup_netdev.ko 2023-07-21T21:48:26.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table.ko 2023-07-21T21:48:26.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_flow_table_inet.ko 2023-07-21T21:48:26.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_log_syslog.ko 2023-07-21T21:48:26.440 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat.ko 2023-07-21T21:48:26.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_amanda.ko 2023-07-21T21:48:26.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_ftp.ko 2023-07-21T21:48:26.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_irc.ko 2023-07-21T21:48:26.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_sip.ko 2023-07-21T21:48:26.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_nat_tftp.ko 2023-07-21T21:48:26.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_synproxy_core.ko 2023-07-21T21:48:26.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nf_tables.ko 2023-07-21T21:48:26.441 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink.ko 2023-07-21T21:48:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_acct.ko 2023-07-21T21:48:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_log.ko 2023-07-21T21:48:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_osf.ko 2023-07-21T21:48:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nfnetlink_queue.ko 2023-07-21T21:48:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_chain_nat.ko 2023-07-21T21:48:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_compat.ko 2023-07-21T21:48:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_ct.ko 2023-07-21T21:48:26.442 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_dup_netdev.ko 2023-07-21T21:48:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fib.ko 2023-07-21T21:48:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_fwd_netdev.ko 2023-07-21T21:48:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_hash.ko 2023-07-21T21:48:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_limit.ko 2023-07-21T21:48:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_log.ko 2023-07-21T21:48:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_masq.ko 2023-07-21T21:48:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_nat.ko 2023-07-21T21:48:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_numgen.ko 2023-07-21T21:48:26.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_queue.ko 2023-07-21T21:48:26.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_quota.ko 2023-07-21T21:48:26.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_redir.ko 2023-07-21T21:48:26.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject.ko 2023-07-21T21:48:26.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_reject_inet.ko 2023-07-21T21:48:26.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_socket.ko 2023-07-21T21:48:26.444 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/nft_tunnel.ko 2023-07-21T21:48:26.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_AUDIT.ko 2023-07-21T21:48:26.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CHECKSUM.ko 2023-07-21T21:48:26.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CLASSIFY.ko 2023-07-21T21:48:26.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-07-21T21:48:26.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_CT.ko 2023-07-21T21:48:26.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_DSCP.ko 2023-07-21T21:48:26.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HL.ko 2023-07-21T21:48:26.445 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_HMARK.ko 2023-07-21T21:48:26.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_IDLETIMER.ko 2023-07-21T21:48:26.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LED.ko 2023-07-21T21:48:26.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_LOG.ko 2023-07-21T21:48:26.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_MASQUERADE.ko 2023-07-21T21:48:26.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NETMAP.ko 2023-07-21T21:48:26.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFLOG.ko 2023-07-21T21:48:26.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_NFQUEUE.ko 2023-07-21T21:48:26.446 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_RATEEST.ko 2023-07-21T21:48:26.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_REDIRECT.ko 2023-07-21T21:48:26.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_SECMARK.ko 2023-07-21T21:48:26.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPMSS.ko 2023-07-21T21:48:26.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-07-21T21:48:26.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TEE.ko 2023-07-21T21:48:26.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TPROXY.ko 2023-07-21T21:48:26.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_TRACE.ko 2023-07-21T21:48:26.447 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_addrtype.ko 2023-07-21T21:48:26.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_bpf.ko 2023-07-21T21:48:26.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cgroup.ko 2023-07-21T21:48:26.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cluster.ko 2023-07-21T21:48:26.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_comment.ko 2023-07-21T21:48:26.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connbytes.ko 2023-07-21T21:48:26.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlabel.ko 2023-07-21T21:48:26.448 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connlimit.ko 2023-07-21T21:48:26.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_connmark.ko 2023-07-21T21:48:26.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_conntrack.ko 2023-07-21T21:48:26.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_cpu.ko 2023-07-21T21:48:26.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dccp.ko 2023-07-21T21:48:26.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_devgroup.ko 2023-07-21T21:48:26.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_dscp.ko 2023-07-21T21:48:26.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ecn.ko 2023-07-21T21:48:26.449 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_esp.ko 2023-07-21T21:48:26.450 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hashlimit.ko 2023-07-21T21:48:26.450 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_helper.ko 2023-07-21T21:48:26.450 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_hl.ko 2023-07-21T21:48:26.452 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipcomp.ko 2023-07-21T21:48:26.453 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_iprange.ko 2023-07-21T21:48:26.453 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_ipvs.ko 2023-07-21T21:48:26.453 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_l2tp.ko 2023-07-21T21:48:26.454 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_length.ko 2023-07-21T21:48:26.454 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_limit.ko 2023-07-21T21:48:26.454 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mac.ko 2023-07-21T21:48:26.454 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_mark.ko 2023-07-21T21:48:26.455 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_multiport.ko 2023-07-21T21:48:26.455 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nat.ko 2023-07-21T21:48:26.455 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_nfacct.ko 2023-07-21T21:48:26.456 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_osf.ko 2023-07-21T21:48:26.456 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_owner.ko 2023-07-21T21:48:26.456 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_physdev.ko 2023-07-21T21:48:26.456 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_pkttype.ko 2023-07-21T21:48:26.457 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_policy.ko 2023-07-21T21:48:26.457 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_quota.ko 2023-07-21T21:48:26.457 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_rateest.ko 2023-07-21T21:48:26.457 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_realm.ko 2023-07-21T21:48:26.458 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_recent.ko 2023-07-21T21:48:26.458 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_sctp.ko 2023-07-21T21:48:26.458 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_set.ko 2023-07-21T21:48:26.459 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_socket.ko 2023-07-21T21:48:26.459 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_state.ko 2023-07-21T21:48:26.459 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_statistic.ko 2023-07-21T21:48:26.459 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_string.ko 2023-07-21T21:48:26.460 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_tcpmss.ko 2023-07-21T21:48:26.460 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_time.ko 2023-07-21T21:48:26.460 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netfilter/xt_u32.ko 2023-07-21T21:48:26.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink 2023-07-21T21:48:26.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/netlink/netlink_diag.ko 2023-07-21T21:48:26.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh 2023-07-21T21:48:26.461 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/nsh/nsh.ko 2023-07-21T21:48:26.462 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch 2023-07-21T21:48:26.462 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/openvswitch.ko 2023-07-21T21:48:26.462 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-geneve.ko 2023-07-21T21:48:26.462 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-gre.ko 2023-07-21T21:48:26.463 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/openvswitch/vport-vxlan.ko 2023-07-21T21:48:26.463 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet 2023-07-21T21:48:26.463 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/packet/af_packet_diag.ko 2023-07-21T21:48:26.464 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds 2023-07-21T21:48:26.464 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds.ko 2023-07-21T21:48:26.464 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_rdma.ko 2023-07-21T21:48:26.464 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/rds/rds_tcp.ko 2023-07-21T21:48:26.465 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched 2023-07-21T21:48:26.465 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_csum.ko 2023-07-21T21:48:26.465 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_gact.ko 2023-07-21T21:48:26.466 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_ipt.ko 2023-07-21T21:48:26.466 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_mirred.ko 2023-07-21T21:48:26.466 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_nat.ko 2023-07-21T21:48:26.466 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_pedit.ko 2023-07-21T21:48:26.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_police.ko 2023-07-21T21:48:26.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_simple.ko 2023-07-21T21:48:26.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_skbedit.ko 2023-07-21T21:48:26.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/act_vlan.ko 2023-07-21T21:48:26.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_basic.ko 2023-07-21T21:48:26.467 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_bpf.ko 2023-07-21T21:48:26.468 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_flow.ko 2023-07-21T21:48:26.468 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_fw.ko 2023-07-21T21:48:26.468 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_route.ko 2023-07-21T21:48:26.469 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/cls_u32.ko 2023-07-21T21:48:26.469 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_cmp.ko 2023-07-21T21:48:26.469 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_ipset.ko 2023-07-21T21:48:26.469 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_meta.ko 2023-07-21T21:48:26.470 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_nbyte.ko 2023-07-21T21:48:26.470 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_text.ko 2023-07-21T21:48:26.470 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/em_u32.ko 2023-07-21T21:48:26.470 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_choke.ko 2023-07-21T21:48:26.471 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_codel.ko 2023-07-21T21:48:26.471 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_drr.ko 2023-07-21T21:48:26.471 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_fq.ko 2023-07-21T21:48:26.471 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_gred.ko 2023-07-21T21:48:26.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hfsc.ko 2023-07-21T21:48:26.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_hhf.ko 2023-07-21T21:48:26.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_htb.ko 2023-07-21T21:48:26.472 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_ingress.ko 2023-07-21T21:48:26.473 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio.ko 2023-07-21T21:48:26.473 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_mqprio_lib.ko 2023-07-21T21:48:26.473 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_multiq.ko 2023-07-21T21:48:26.473 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_netem.ko 2023-07-21T21:48:26.474 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_pie.ko 2023-07-21T21:48:26.474 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_plug.ko 2023-07-21T21:48:26.474 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_prio.ko 2023-07-21T21:48:26.474 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_qfq.ko 2023-07-21T21:48:26.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_red.ko 2023-07-21T21:48:26.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfb.ko 2023-07-21T21:48:26.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_sfq.ko 2023-07-21T21:48:26.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_tbf.ko 2023-07-21T21:48:26.475 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sched/sch_teql.ko 2023-07-21T21:48:26.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp 2023-07-21T21:48:26.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp.ko 2023-07-21T21:48:26.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sctp/sctp_diag.ko 2023-07-21T21:48:26.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc 2023-07-21T21:48:26.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss 2023-07-21T21:48:26.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-07-21T21:48:26.476 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-07-21T21:48:26.477 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/sunrpc.ko 2023-07-21T21:48:26.477 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma 2023-07-21T21:48:26.477 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-07-21T21:48:26.477 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc 2023-07-21T21:48:26.478 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/diag.ko 2023-07-21T21:48:26.478 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/tipc/tipc.ko 2023-07-21T21:48:26.478 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix 2023-07-21T21:48:26.478 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/unix/unix_diag.ko 2023-07-21T21:48:26.479 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock 2023-07-21T21:48:26.479 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-07-21T21:48:26.479 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-07-21T21:48:26.479 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock.ko 2023-07-21T21:48:26.480 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_diag.ko 2023-07-21T21:48:26.480 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/vmw_vsock/vsock_loopback.ko 2023-07-21T21:48:26.480 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm 2023-07-21T21:48:26.480 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/net/xfrm/xfrm_ipcomp.ko 2023-07-21T21:48:26.481 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security 2023-07-21T21:48:26.481 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys 2023-07-21T21:48:26.481 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/encrypted-keys 2023-07-21T21:48:26.481 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-07-21T21:48:26.482 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/trusted-keys 2023-07-21T21:48:26.482 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/security/keys/trusted-keys/trusted.ko 2023-07-21T21:48:26.482 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt 2023-07-21T21:48:26.482 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib 2023-07-21T21:48:26.483 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/kernel/virt/lib/irqbypass.ko 2023-07-21T21:48:26.483 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias 2023-07-21T21:48:26.483 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.alias.bin 2023-07-21T21:48:26.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin 2023-07-21T21:48:26.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.bin 2023-07-21T21:48:26.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.builtin.modinfo 2023-07-21T21:48:26.484 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep 2023-07-21T21:48:26.485 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.dep.bin 2023-07-21T21:48:26.485 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.devname 2023-07-21T21:48:26.485 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.order 2023-07-21T21:48:26.486 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.softdep 2023-07-21T21:48:26.486 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols 2023-07-21T21:48:26.486 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.5.0-rc1-gc685da6f56cc/modules.symbols.bin 2023-07-21T21:48:26.487 DEBUG:teuthology.task.kernel:get_image_version: 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:26.488 DEBUG:teuthology.orchestra.run.smithi151:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-07-21T21:48:26.514 INFO:teuthology.orchestra.run.smithi151.stdout:postinstall scriptlet (using /bin/sh): 2023-07-21T21:48:26.515 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc -a -r /boot/System.map-6.5.0-rc1-gc685da6f56cc ]; then 2023-07-21T21:48:26.515 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc /boot/.vmlinuz-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:26.515 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/System.map-6.5.0-rc1-gc685da6f56cc /boot/.System.map-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:26.515 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/vmlinuz-6.5.0-rc1-gc685da6f56cc /boot/System.map-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:26.516 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/installkernel 6.5.0-rc1-gc685da6f56cc /boot/.vmlinuz-6.5.0-rc1-gc685da6f56cc-rpm /boot/.System.map-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:26.516 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/.vmlinuz-6.5.0-rc1-gc685da6f56cc-rpm /boot/.System.map-6.5.0-rc1-gc685da6f56cc-rpm 2023-07-21T21:48:26.516 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-07-21T21:48:26.517 INFO:teuthology.orchestra.run.smithi151.stdout:preuninstall scriptlet (using /bin/sh): 2023-07-21T21:48:26.517 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-07-21T21:48:26.517 INFO:teuthology.orchestra.run.smithi151.stdout:new-kernel-pkg --remove 6.5.0-rc1-gc685da6f56cc --rminitrd --initrdfile=/boot/initramfs-6.5.0-rc1-gc685da6f56cc.img 2023-07-21T21:48:26.517 INFO:teuthology.orchestra.run.smithi151.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-07-21T21:48:26.518 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-install remove 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:26.518 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-07-21T21:48:26.518 INFO:teuthology.orchestra.run.smithi151.stdout:postuninstall scriptlet (using /bin/sh): 2023-07-21T21:48:26.518 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/update-bootloader ]; then 2023-07-21T21:48:26.519 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/update-bootloader --remove 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:26.519 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-07-21T21:48:26.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2023-07-21T21:48:26.596 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2023-07-21T21:48:26.597 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2023-07-21T21:48:26.597 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.02 2023-07-21T21:48:26.597 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 123.el8 2023-07-21T21:48:26.597 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2023-07-21T21:48:26.597 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Thu 14 Jul 2022 06:22:19 PM UTC 2023-07-21T21:48:26.597 INFO:teuthology.orchestra.run.smithi151.stdout:Group : System Environment/Base 2023-07-21T21:48:26.598 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 9265450 2023-07-21T21:48:26.598 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2023-07-21T21:48:26.598 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Thu 31 Mar 2022 07:24:35 PM UTC, Key ID 199e2f91fd431d51 2023-07-21T21:48:26.598 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.02-123.el8.src.rpm 2023-07-21T21:48:26.598 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Mon 28 Mar 2022 02:12:09 PM UTC 2023-07-21T21:48:26.598 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-vm-09.build.eng.bos.redhat.com 2023-07-21T21:48:26.598 INFO:teuthology.orchestra.run.smithi151.stdout:Relocations : (not relocatable) 2023-07-21T21:48:26.598 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : Red Hat, Inc. 2023-07-21T21:48:26.599 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : Red Hat, Inc. 2023-07-21T21:48:26.599 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2023-07-21T21:48:26.599 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2023-07-21T21:48:26.599 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2023-07-21T21:48:26.599 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T21:48:26.599 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-07-21T21:48:26.599 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2023-07-21T21:48:26.600 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2023-07-21T21:48:26.600 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2023-07-21T21:48:26.600 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T21:48:26.600 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2023-07-21T21:48:26.601 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-07-21T21:48:26.601 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:26.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-07-21T21:48:30.167 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2023-07-21T21:48:32.289 INFO:teuthology.orchestra.run.smithi151.stderr:done 2023-07-21T21:48:32.291 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-07-21T21:48:32.308 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.no80oEgnf4 2023-07-21T21:48:32.309 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.no80oEgnf4 2023-07-21T21:48:32.382 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.no80oEgnf4 2023-07-21T21:48:32.541 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.no80oEgnf4 is 6KB 2023-07-21T21:48:32.588 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.no80oEgnf4 2023-07-21T21:48:32.604 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2023-07-21T21:48:32.670 INFO:teuthology.orchestra.run.smithi151.stdout:5a84457b7b52416e95d47d02e2e4a60f-0-rescue.conf 2023-07-21T21:48:32.670 INFO:teuthology.orchestra.run.smithi151.stdout:5a84457b7b52416e95d47d02e2e4a60f-4.18.0-372.9.1.el8.x86_64.conf 2023-07-21T21:48:32.671 INFO:teuthology.orchestra.run.smithi151.stdout:5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-gc685da6f56cc.conf 2023-07-21T21:48:32.671 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default 5a84457b7b52416e95d47d02e2e4a60f-6.5.0-rc1-gc685da6f56cc 2023-07-21T21:48:32.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2023-07-21T21:48:50.760 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2023-07-21T21:48:50.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-21T21:48:50.761 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:48:54.784 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-07-21T21:48:54.785 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-07-21T21:48:54.785 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:49:04.793 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-07-21T21:49:04.794 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-21T21:49:04.794 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:49:09.104 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-21T21:49:18.112 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-21T21:49:18.113 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:49:23.184 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-07-21T21:49:23.185 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-21T21:49:32.192 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-07-21T21:49:32.193 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:49:32.194 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-21T21:49:32.195 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:49:35.248 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-21T21:49:41.616 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-21T21:49:47.252 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-21T21:49:47.253 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:49:52.257 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.187 2023-07-21T21:49:53.619 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-21T21:49:53.620 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:49:55.312 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-21T21:49:56.692 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.195 2023-07-21T21:50:04.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-07-21T21:50:04.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:50:09.637 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-07-21T21:50:10.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-07-21T21:50:10.065 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-21T21:50:10.066 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-07-21T21:50:10.107 INFO:teuthology.orchestra.run.smithi187.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-21T21:50:10.107 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:50:10.107 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-21T21:50:10.108 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-21T21:50:10.313 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-21T21:50:10.314 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:50:11.108 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-07-21T21:50:11.109 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-21T21:50:11.291 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2023-07-21T21:50:11.318 DEBUG:teuthology.parallel:result is None 2023-07-21T21:50:11.693 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-21T21:50:11.694 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:50:16.697 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-07-21T21:50:17.071 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-07-21T21:50:17.489 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-21T21:50:17.490 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-21T21:50:17.490 DEBUG:teuthology.orchestra.run.smithi195:> uname -r 2023-07-21T21:50:17.531 INFO:teuthology.orchestra.run.smithi195.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-21T21:50:17.532 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:50:17.532 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-21T21:50:17.532 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-21T21:50:18.533 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2023-07-21T21:50:18.533 DEBUG:teuthology.orchestra.run.smithi195:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-21T21:50:18.665 INFO:teuthology.orchestra.run.smithi195.stdout:ttyS1 2023-07-21T21:50:18.696 DEBUG:teuthology.parallel:result is None 2023-07-21T21:50:34.698 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-21T21:50:34.699 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T21:50:40.066 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-07-21T21:50:40.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-21T21:50:40.480 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.5.0-rc1-gc685da6f56cc"... 2023-07-21T21:50:40.481 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-07-21T21:50:40.522 INFO:teuthology.orchestra.run.smithi151.stdout:6.5.0-rc1-gc685da6f56cc 2023-07-21T21:50:40.523 DEBUG:teuthology.task.kernel:current kernel version is 6.5.0-rc1-gc685da6f56cc vs 6.5.0-rc1-gc685da6f56cc 2023-07-21T21:50:40.523 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-07-21T21:50:40.523 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-07-21T21:50:41.524 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-07-21T21:50:41.524 DEBUG:teuthology.orchestra.run.smithi151:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-07-21T21:50:41.662 INFO:teuthology.orchestra.run.smithi151.stdout:ttyS1 2023-07-21T21:50:41.685 DEBUG:teuthology.parallel:result is None 2023-07-21T21:50:41.686 INFO:teuthology.run_tasks:Running task internal.base... 2023-07-21T21:50:41.700 INFO:teuthology.task.internal:Creating test directory... 2023-07-21T21:50:41.701 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T21:50:41.706 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T21:50:41.711 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-07-21T21:50:41.760 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-07-21T21:50:41.769 INFO:teuthology.run_tasks:Running task internal.archive... 2023-07-21T21:50:41.783 INFO:teuthology.task.internal:Creating archive directory... 2023-07-21T21:50:41.784 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T21:50:41.789 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T21:50:41.793 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-07-21T21:50:41.856 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-07-21T21:50:41.865 INFO:teuthology.task.internal:Enabling coredump saving... 2023-07-21T21:50:41.865 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T21:50:41.869 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T21:50:41.874 DEBUG:teuthology.orchestra.run.smithi195:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-07-21T21:50:41.938 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:50:41.958 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:50:41.964 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:50:41.966 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:50:41.986 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:50:41.993 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-07-21T21:50:41.996 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-07-21T21:50:42.005 INFO:teuthology.task.internal:Configuring sudo... 2023-07-21T21:50:42.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T21:50:42.010 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T21:50:42.014 DEBUG:teuthology.orchestra.run.smithi195:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-07-21T21:50:42.082 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-07-21T21:50:42.093 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-07-21T21:50:42.094 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T21:50:42.098 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T21:50:42.102 DEBUG:teuthology.orchestra.run.smithi195:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-07-21T21:50:42.147 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T21:50:42.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T21:50:42.332 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T21:50:42.407 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T21:50:42.475 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T21:50:42.475 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T21:50:42.542 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T21:50:42.616 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T21:50:42.695 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T21:50:42.770 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T21:50:42.848 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T21:50:42.849 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T21:50:42.951 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T21:50:43.026 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-07-21T21:50:43.122 DEBUG:teuthology.orchestra.run.smithi195:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T21:50:43.194 DEBUG:teuthology.orchestra.run.smithi195:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-07-21T21:50:43.275 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T21:50:43.275 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-07-21T21:50:43.343 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-07-21T21:50:43.348 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2023-07-21T21:50:43.353 DEBUG:teuthology.orchestra.run.smithi195:> sudo service rsyslog restart 2023-07-21T21:50:43.481 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T21:50:43.488 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T21:50:43.540 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T21:50:43.908 INFO:teuthology.run_tasks:Running task internal.timer... 2023-07-21T21:50:43.918 INFO:teuthology.task.internal:Starting timer... 2023-07-21T21:50:43.918 INFO:teuthology.run_tasks:Running task pcp... 2023-07-21T21:50:43.937 INFO:teuthology.run_tasks:Running task selinux... 2023-07-21T21:50:43.950 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-07-21T21:50:43.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-07-21T21:50:44.067 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-07-21T21:50:44.071 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2023-07-21T21:50:44.199 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2023-07-21T21:50:44.202 DEBUG:teuthology.orchestra.run.smithi195:> sudo service auditd rotate 2023-07-21T21:50:44.316 INFO:teuthology.orchestra.run.smithi195.stdout:Rotating logs: 2023-07-21T21:50:44.320 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-07-21T21:50:44.320 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-07-21T21:50:44.373 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-07-21T21:50:44.374 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2023-07-21T21:50:44.431 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2023-07-21T21:50:44.431 DEBUG:teuthology.orchestra.run.smithi195:> /usr/sbin/getenforce 2023-07-21T21:50:44.485 INFO:teuthology.orchestra.run.smithi195.stdout:Permissive 2023-07-21T21:50:44.485 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi151.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi195.front.sepia.ceph.com': 'permissive'} 2023-07-21T21:50:44.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-21T21:50:44.557 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:50:44.558 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-21T21:50:44.632 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:50:44.633 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-21T21:50:44.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T21:50:44.704 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-07-21T21:50:44.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-07-21T21:50:44.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2023-07-21T21:50:44.847 DEBUG:teuthology.orchestra.run.smithi195:> sudo /usr/sbin/setenforce permissive 2023-07-21T21:50:44.914 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-07-21T21:50:44.926 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-07-21T21:50:44.933 INFO:teuthology.repo_utils:Fetching main from origin 2023-07-21T21:50:45.101 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-07-21T21:50:45.123 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-07-21T21:50:45.124 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi151.front.sepia.ceph.com,smithi187.front.sepia.ceph.com,smithi195.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-07-21T22:03:32.685 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi151.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com'), Remote(name='ubuntu@smithi195.front.sepia.ceph.com')] 2023-07-21T22:03:32.686 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-21T22:03:32.688 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:03:37.782 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-07-21T22:03:37.902 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-07-21T22:03:37.903 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-07-21T22:03:37.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:03:37.994 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-07-21T22:03:38.108 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-07-21T22:03:38.109 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-21T22:03:38.109 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi195.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-07-21T22:03:38.199 DEBUG:teuthology.orchestra.run.smithi195:> true 2023-07-21T22:03:38.312 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi195.front.sepia.ceph.com' 2023-07-21T22:03:38.312 INFO:teuthology.run_tasks:Running task clock... 2023-07-21T22:03:38.322 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-07-21T22:03:38.322 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T22:03:38.323 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:03:38.328 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T22:03:38.328 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:03:38.333 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-07-21T22:03:38.333 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T22:03:38.406 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-21T22:03:38.408 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-21T22:03:38.426 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-07-21T22:03:38.442 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-21T22:03:38.443 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-21T22:03:38.460 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-07-21T22:03:38.539 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-07-21T22:03:38.540 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2023-07-21T22:03:38.558 INFO:teuthology.orchestra.run.smithi195.stderr:sudo: ntpd: command not found 2023-07-21T22:03:38.568 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-07-21T22:03:38.570 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2023-07-21T22:03:38.587 INFO:teuthology.orchestra.run.smithi195.stdout:506 Cannot talk to daemon 2023-07-21T22:03:38.603 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-21T22:03:38.604 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-21T22:03:38.621 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-07-21T22:03:38.638 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-21T22:03:38.639 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-21T22:03:38.656 INFO:teuthology.orchestra.run.smithi195.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-07-21T22:03:38.729 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2023-07-21T22:03:38.732 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-07-21T22:03:38.736 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T22:03:38.736 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-07-21T22:03:38.736 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.736 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.737 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.737 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.739 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T22:03:38.740 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-07-21T22:03:38.740 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.740 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.740 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.740 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.750 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2023-07-21T22:03:38.757 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T22:03:38.757 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2023-07-21T22:03:38.757 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.757 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.758 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.758 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T22:03:38.759 INFO:teuthology.run_tasks:Running task pexec... 2023-07-21T22:03:38.772 INFO:teuthology.task.pexec:Executing custom commands... 2023-07-21T22:03:38.773 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T22:03:38.773 DEBUG:teuthology.orchestra.run.smithi151:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-21T22:03:38.774 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi187.front.sepia.ceph.com 2023-07-21T22:03:38.774 DEBUG:teuthology.orchestra.run.smithi187:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-21T22:03:38.774 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi195.front.sepia.ceph.com 2023-07-21T22:03:38.775 DEBUG:teuthology.orchestra.run.smithi195:> TESTDIR=/home/ubuntu/cephtest bash -s 2023-07-21T22:03:39.251 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-07-21T22:03:39.259 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-21T22:03:39.262 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-07-21T22:03:40.311 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:01:57 ago on Fri 21 Jul 2023 10:01:42 PM UTC. 2023-07-21T22:03:40.412 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:01:58 ago on Fri 21 Jul 2023 10:01:41 PM UTC. 2023-07-21T22:03:40.418 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:00 ago on Fri 21 Jul 2023 10:01:39 PM UTC. 2023-07-21T22:03:42.152 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-07-21T22:03:42.153 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-07-21T22:03:42.153 INFO:teuthology.orchestra.run.smithi187.stdout: Package Architecture Version Repository Size 2023-07-21T22:03:42.153 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-07-21T22:03:42.153 INFO:teuthology.orchestra.run.smithi187.stdout:Resetting modules: 2023-07-21T22:03:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: container-tools 2023-07-21T22:03:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:03:42.154 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-07-21T22:03:42.154 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-07-21T22:03:42.154 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:03:42.258 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-07-21T22:03:42.259 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-07-21T22:03:42.259 INFO:teuthology.orchestra.run.smithi195.stdout: Package Architecture Version Repository Size 2023-07-21T22:03:42.259 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-07-21T22:03:42.259 INFO:teuthology.orchestra.run.smithi195.stdout:Resetting modules: 2023-07-21T22:03:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools 2023-07-21T22:03:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:03:42.260 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-07-21T22:03:42.260 INFO:teuthology.orchestra.run.smithi195.stdout:================================================================================ 2023-07-21T22:03:42.260 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:03:42.266 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-07-21T22:03:42.268 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-07-21T22:03:42.268 INFO:teuthology.orchestra.run.smithi151.stdout: Package Architecture Version Repository Size 2023-07-21T22:03:42.268 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-07-21T22:03:42.268 INFO:teuthology.orchestra.run.smithi151.stdout:Resetting modules: 2023-07-21T22:03:42.268 INFO:teuthology.orchestra.run.smithi151.stdout: container-tools 2023-07-21T22:03:42.269 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:03:42.269 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-07-21T22:03:42.269 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-07-21T22:03:42.269 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:03:43.401 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:02:00 ago on Fri 21 Jul 2023 10:01:42 PM UTC. 2023-07-21T22:03:43.513 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:03 ago on Fri 21 Jul 2023 10:01:39 PM UTC. 2023-07-21T22:03:43.533 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:01 ago on Fri 21 Jul 2023 10:01:41 PM UTC. 2023-07-21T22:03:48.332 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-07-21T22:03:48.633 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-07-21T22:03:48.716 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-07-21T22:03:48.923 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-07-21T22:03:49.253 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-21T22:03:49.305 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-07-21T22:03:49.926 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:08 ago on Fri 21 Jul 2023 10:01:41 PM UTC. 2023-07-21T22:03:50.342 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:10 ago on Fri 21 Jul 2023 10:01:39 PM UTC. 2023-07-21T22:03:50.344 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:02:07 ago on Fri 21 Jul 2023 10:01:42 PM UTC. 2023-07-21T22:03:51.686 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-07-21T22:03:51.784 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================================ 2023-07-21T22:03:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2023-07-21T22:03:51.785 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================================ 2023-07-21T22:03:51.785 INFO:teuthology.orchestra.run.smithi195.stdout:Installing group/module packages: 2023-07-21T22:03:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-07-21T22:03:51.785 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-07-21T22:03:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-07-21T22:03:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-07-21T22:03:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-07-21T22:03:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-07-21T22:03:51.786 INFO:teuthology.orchestra.run.smithi195.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-07-21T22:03:51.787 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2023-07-21T22:03:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-07-21T22:03:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-07-21T22:03:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-07-21T22:03:51.787 INFO:teuthology.orchestra.run.smithi195.stdout:Installing module profiles: 2023-07-21T22:03:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools/common 2023-07-21T22:03:51.787 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:03:51.788 INFO:teuthology.orchestra.run.smithi195.stdout:Enabling module streams: 2023-07-21T22:03:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: container-tools rhel8 2023-07-21T22:03:51.788 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:03:51.788 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-07-21T22:03:51.788 INFO:teuthology.orchestra.run.smithi195.stdout:============================================================================================================ 2023-07-21T22:03:51.789 INFO:teuthology.orchestra.run.smithi195.stdout:Install 10 Packages 2023-07-21T22:03:51.789 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:03:51.789 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 18 M 2023-07-21T22:03:51.790 INFO:teuthology.orchestra.run.smithi195.stdout:Installed size: 65 M 2023-07-21T22:03:51.790 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2023-07-21T22:03:51.868 INFO:teuthology.orchestra.run.smithi195.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 511 kB/s | 41 kB 00:00 2023-07-21T22:03:51.926 INFO:teuthology.orchestra.run.smithi195.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 179 kB/s | 25 kB 00:00 2023-07-21T22:03:51.952 INFO:teuthology.orchestra.run.smithi195.stdout:(3/10): python3-pyxdg-0.25-16.el8.noarch.rpm 573 kB/s | 94 kB 00:00 2023-07-21T22:03:51.977 INFO:teuthology.orchestra.run.smithi195.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 452 kB/s | 49 kB 00:00 2023-07-21T22:03:52.011 INFO:teuthology.orchestra.run.smithi195.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.1 MB/s | 524 kB 00:00 2023-07-21T22:03:52.036 INFO:teuthology.orchestra.run.smithi195.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-07-21T22:03:52.070 INFO:teuthology.orchestra.run.smithi195.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.6 MB/s | 213 kB 00:00 2023-07-21T22:03:52.113 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-07-21T22:03:52.118 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-07-21T22:03:52.178 INFO:teuthology.orchestra.run.smithi195.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 20 MB/s | 2.2 MB 00:00 2023-07-21T22:03:52.214 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================================ 2023-07-21T22:03:52.214 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2023-07-21T22:03:52.214 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================================ 2023-07-21T22:03:52.215 INFO:teuthology.orchestra.run.smithi187.stdout:Installing group/module packages: 2023-07-21T22:03:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-07-21T22:03:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-07-21T22:03:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-07-21T22:03:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-07-21T22:03:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-07-21T22:03:52.215 INFO:teuthology.orchestra.run.smithi187.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-07-21T22:03:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-07-21T22:03:52.216 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2023-07-21T22:03:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-07-21T22:03:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-07-21T22:03:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-07-21T22:03:52.216 INFO:teuthology.orchestra.run.smithi187.stdout:Installing module profiles: 2023-07-21T22:03:52.216 INFO:teuthology.orchestra.run.smithi187.stdout: container-tools/common 2023-07-21T22:03:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:03:52.217 INFO:teuthology.orchestra.run.smithi187.stdout:Enabling module streams: 2023-07-21T22:03:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: container-tools rhel8 2023-07-21T22:03:52.217 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:03:52.217 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-07-21T22:03:52.217 INFO:teuthology.orchestra.run.smithi187.stdout:============================================================================================================ 2023-07-21T22:03:52.217 INFO:teuthology.orchestra.run.smithi187.stdout:Install 10 Packages 2023-07-21T22:03:52.218 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:03:52.218 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 18 M 2023-07-21T22:03:52.218 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 65 M 2023-07-21T22:03:52.219 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-07-21T22:03:52.220 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================================ 2023-07-21T22:03:52.220 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-07-21T22:03:52.220 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================================ 2023-07-21T22:03:52.220 INFO:teuthology.orchestra.run.smithi151.stdout:Installing group/module packages: 2023-07-21T22:03:52.220 INFO:teuthology.orchestra.run.smithi151.stdout: buildah x86_64 1:1.26.2-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 8.0 M 2023-07-21T22:03:52.221 INFO:teuthology.orchestra.run.smithi151.stdout: cockpit-podman noarch 49.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 524 k 2023-07-21T22:03:52.221 INFO:teuthology.orchestra.run.smithi151.stdout: crun x86_64 1.5-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 213 k 2023-07-21T22:03:52.221 INFO:teuthology.orchestra.run.smithi151.stdout: python3-podman noarch 4.0.1-1.module+el8.6.0+16837+85b82211 rhel-8-for-x86_64-appstream-rpms 149 k 2023-07-21T22:03:52.221 INFO:teuthology.orchestra.run.smithi151.stdout: skopeo x86_64 2:1.9.1-1.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 7.0 M 2023-07-21T22:03:52.221 INFO:teuthology.orchestra.run.smithi151.stdout: toolbox x86_64 0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 2.2 M 2023-07-21T22:03:52.221 INFO:teuthology.orchestra.run.smithi151.stdout: udica noarch 0.2.6-4.module+el8.6.0+16771+28dfca77 rhel-8-for-x86_64-appstream-rpms 49 k 2023-07-21T22:03:52.221 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-07-21T22:03:52.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 rhel-8-for-x86_64-appstream-rpms 25 k 2023-07-21T22:03:52.222 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyxdg noarch 0.25-16.el8 rhel-8-for-x86_64-appstream-rpms 94 k 2023-07-21T22:03:52.222 INFO:teuthology.orchestra.run.smithi151.stdout: yajl x86_64 2.1.0-10.el8 rhel-8-for-x86_64-appstream-rpms 41 k 2023-07-21T22:03:52.222 INFO:teuthology.orchestra.run.smithi151.stdout:Installing module profiles: 2023-07-21T22:03:52.222 INFO:teuthology.orchestra.run.smithi151.stdout: container-tools/common 2023-07-21T22:03:52.222 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:03:52.223 INFO:teuthology.orchestra.run.smithi151.stdout:Enabling module streams: 2023-07-21T22:03:52.223 INFO:teuthology.orchestra.run.smithi151.stdout: container-tools rhel8 2023-07-21T22:03:52.223 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:03:52.223 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-07-21T22:03:52.223 INFO:teuthology.orchestra.run.smithi151.stdout:============================================================================================================ 2023-07-21T22:03:52.223 INFO:teuthology.orchestra.run.smithi151.stdout:Install 10 Packages 2023-07-21T22:03:52.224 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:03:52.224 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 18 M 2023-07-21T22:03:52.224 INFO:teuthology.orchestra.run.smithi151.stdout:Installed size: 65 M 2023-07-21T22:03:52.225 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-07-21T22:03:52.293 INFO:teuthology.orchestra.run.smithi187.stdout:(1/10): yajl-2.1.0-10.el8.x86_64.rpm 535 kB/s | 41 kB 00:00 2023-07-21T22:03:52.299 INFO:teuthology.orchestra.run.smithi151.stdout:(1/10): python3-pyxdg-0.25-16.el8.noarch.rpm 1.2 MB/s | 94 kB 00:00 2023-07-21T22:03:52.316 INFO:teuthology.orchestra.run.smithi151.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 268 kB/s | 25 kB 00:00 2023-07-21T22:03:52.327 INFO:teuthology.orchestra.run.smithi187.stdout:(2/10): python3-pytoml-0.1.14-5.git7dea353.el8. 226 kB/s | 25 kB 00:00 2023-07-21T22:03:52.333 INFO:teuthology.orchestra.run.smithi151.stdout:(3/10): yajl-2.1.0-10.el8.x86_64.rpm 372 kB/s | 41 kB 00:00 2023-07-21T22:03:52.337 INFO:teuthology.orchestra.run.smithi195.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 23 MB/s | 7.0 MB 00:00 2023-07-21T22:03:52.344 INFO:teuthology.orchestra.run.smithi187.stdout:(3/10): udica-0.2.6-4.module+el8.6.0+16771+28df 985 kB/s | 49 kB 00:00 2023-07-21T22:03:52.350 INFO:teuthology.orchestra.run.smithi151.stdout:(4/10): udica-0.2.6-4.module+el8.6.0+16771+28df 978 kB/s | 49 kB 00:00 2023-07-21T22:03:52.369 INFO:teuthology.orchestra.run.smithi187.stdout:(4/10): python3-pyxdg-0.25-16.el8.noarch.rpm 617 kB/s | 94 kB 00:00 2023-07-21T22:03:52.403 INFO:teuthology.orchestra.run.smithi187.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 6.8 MB/s | 524 kB 00:00 2023-07-21T22:03:52.424 INFO:teuthology.orchestra.run.smithi151.stdout:(5/10): cockpit-podman-49.1-1.module+el8.6.0+16 4.8 MB/s | 524 kB 00:00 2023-07-21T22:03:52.428 INFO:teuthology.orchestra.run.smithi187.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 2.5 MB/s | 149 kB 00:00 2023-07-21T22:03:52.429 INFO:teuthology.orchestra.run.smithi195.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 17 MB/s | 8.0 MB 00:00 2023-07-21T22:03:52.429 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2023-07-21T22:03:52.429 INFO:teuthology.orchestra.run.smithi195.stdout:Total 28 MB/s | 18 MB 00:00 2023-07-21T22:03:52.459 INFO:teuthology.orchestra.run.smithi151.stdout:(6/10): python3-podman-4.0.1-1.module+el8.6.0+1 1.3 MB/s | 149 kB 00:00 2023-07-21T22:03:52.462 INFO:teuthology.orchestra.run.smithi187.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.6 MB/s | 213 kB 00:00 2023-07-21T22:03:52.493 INFO:teuthology.orchestra.run.smithi151.stdout:(7/10): crun-1.5-1.module+el8.6.0+16771+28dfca7 3.0 MB/s | 213 kB 00:00 2023-07-21T22:03:52.587 INFO:teuthology.orchestra.run.smithi187.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 17 MB/s | 2.2 MB 00:00 2023-07-21T22:03:52.610 INFO:teuthology.orchestra.run.smithi151.stdout:(8/10): toolbox-0.0.99.3-0.6.module+el8.6.0+167 19 MB/s | 2.2 MB 00:00 2023-07-21T22:03:52.737 INFO:teuthology.orchestra.run.smithi187.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 23 MB/s | 7.0 MB 00:00 2023-07-21T22:03:52.763 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2023-07-21T22:03:52.777 INFO:teuthology.orchestra.run.smithi151.stdout:(9/10): skopeo-1.9.1-1.module+el8.6.0+16771+28d 22 MB/s | 7.0 MB 00:00 2023-07-21T22:03:52.786 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2023-07-21T22:03:52.786 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2023-07-21T22:03:52.829 INFO:teuthology.orchestra.run.smithi187.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 16 MB/s | 8.0 MB 00:00 2023-07-21T22:03:52.830 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-07-21T22:03:52.830 INFO:teuthology.orchestra.run.smithi187.stdout:Total 30 MB/s | 18 MB 00:00 2023-07-21T22:03:52.902 INFO:teuthology.orchestra.run.smithi151.stdout:(10/10): buildah-1.26.2-1.module+el8.6.0+16771+ 14 MB/s | 8.0 MB 00:00 2023-07-21T22:03:52.902 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-07-21T22:03:52.903 INFO:teuthology.orchestra.run.smithi151.stdout:Total 27 MB/s | 18 MB 00:00 2023-07-21T22:03:53.160 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-07-21T22:03:53.183 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-07-21T22:03:53.183 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-07-21T22:03:53.239 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-07-21T22:03:53.262 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-07-21T22:03:53.262 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-07-21T22:03:53.340 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2023-07-21T22:03:53.344 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2023-07-21T22:03:53.713 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-07-21T22:03:53.718 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-07-21T22:03:53.776 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-07-21T22:03:53.780 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-07-21T22:03:53.896 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2023-07-21T22:03:54.089 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-07-21T22:03:54.293 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-21T22:03:54.310 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-07-21T22:03:54.315 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-07-21T22:03:54.483 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-07-21T22:03:54.512 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 1/10 2023-07-21T22:03:54.520 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-07-21T22:03:54.688 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-21T22:03:54.693 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-21T22:03:54.769 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-07-21T22:03:54.911 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-07-21T22:03:54.931 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/10 2023-07-21T22:03:55.138 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-07-21T22:03:55.157 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-07-21T22:03:55.174 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 4/10 2023-07-21T22:03:55.531 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-07-21T22:03:55.562 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 5/10 2023-07-21T22:03:56.000 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-07-21T22:03:56.333 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-07-21T22:03:56.405 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 6/10 2023-07-21T22:03:56.937 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-07-21T22:03:57.239 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-07-21T22:03:57.258 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-07-21T22:03:57.363 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 7/10 2023-07-21T22:03:57.424 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-07-21T22:03:57.564 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-07-21T22:03:57.674 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-21T22:03:57.686 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 8/10 2023-07-21T22:03:57.732 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-07-21T22:03:57.877 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 9/10 2023-07-21T22:03:57.972 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-21T22:03:58.042 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-21T22:03:58.042 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-07-21T22:03:58.043 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-21T22:03:58.043 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-07-21T22:03:58.043 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-07-21T22:03:58.043 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-07-21T22:03:58.043 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-07-21T22:03:58.043 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-07-21T22:03:58.043 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-07-21T22:03:58.044 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-07-21T22:03:58.126 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-21T22:03:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-21T22:03:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-07-21T22:03:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-21T22:03:58.366 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-07-21T22:03:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-07-21T22:03:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-07-21T22:03:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-07-21T22:03:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-07-21T22:03:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-07-21T22:03:58.367 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-07-21T22:03:58.520 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 10/10 2023-07-21T22:03:58.520 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 1/10 2023-07-21T22:03:58.520 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : yajl-2.1.0-10.el8.x86_64 2/10 2023-07-21T22:03:58.520 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 3/10 2023-07-21T22:03:58.521 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 4/10 2023-07-21T22:03:58.521 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca7 5/10 2023-07-21T22:03:58.521 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x 6/10 2023-07-21T22:03:58.521 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-podman-4.0.1-1.module+el8.6.0+16837+85b822 7/10 2023-07-21T22:03:58.521 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 8/10 2023-07-21T22:03:58.521 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86 9/10 2023-07-21T22:03:59.556 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-07-21T22:03:59.557 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:17 ago on Fri 21 Jul 2023 10:01:41 PM UTC. 2023-07-21T22:03:59.925 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-07-21T22:03:59.926 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:20 ago on Fri 21 Jul 2023 10:01:39 PM UTC. 2023-07-21T22:03:59.984 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77 10/10 2023-07-21T22:03:59.984 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:02:17 ago on Fri 21 Jul 2023 10:01:42 PM UTC. 2023-07-21T22:04:02.656 INFO:teuthology.orchestra.run.smithi195.stdout:Installed products updated. 2023-07-21T22:04:02.860 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:04:02.861 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2023-07-21T22:04:02.861 INFO:teuthology.orchestra.run.smithi195.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:02.861 INFO:teuthology.orchestra.run.smithi195.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-07-21T22:04:02.861 INFO:teuthology.orchestra.run.smithi195.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:02.861 INFO:teuthology.orchestra.run.smithi195.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-07-21T22:04:02.862 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-21T22:04:02.862 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-21T22:04:02.862 INFO:teuthology.orchestra.run.smithi195.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:02.862 INFO:teuthology.orchestra.run.smithi195.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:02.862 INFO:teuthology.orchestra.run.smithi195.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-07-21T22:04:02.862 INFO:teuthology.orchestra.run.smithi195.stdout: yajl-2.1.0-10.el8.x86_64 2023-07-21T22:04:02.862 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:04:02.862 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-07-21T22:04:03.097 DEBUG:teuthology.parallel:result is None 2023-07-21T22:04:03.167 INFO:teuthology.orchestra.run.smithi151.stdout:Installed products updated. 2023-07-21T22:04:03.245 INFO:teuthology.orchestra.run.smithi187.stdout:Installed products updated. 2023-07-21T22:04:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:04:03.370 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-07-21T22:04:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-07-21T22:04:03.370 INFO:teuthology.orchestra.run.smithi151.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-07-21T22:04:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-21T22:04:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-21T22:04:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-07-21T22:04:03.371 INFO:teuthology.orchestra.run.smithi151.stdout: yajl-2.1.0-10.el8.x86_64 2023-07-21T22:04:03.372 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:04:03.372 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-07-21T22:04:03.461 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:04:03.462 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2023-07-21T22:04:03.462 INFO:teuthology.orchestra.run.smithi187.stdout: buildah-1:1.26.2-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:03.462 INFO:teuthology.orchestra.run.smithi187.stdout: cockpit-podman-49.1-1.module+el8.6.0+16771+28dfca77.noarch 2023-07-21T22:04:03.463 INFO:teuthology.orchestra.run.smithi187.stdout: crun-1.5-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:03.463 INFO:teuthology.orchestra.run.smithi187.stdout: python3-podman-4.0.1-1.module+el8.6.0+16837+85b82211.noarch 2023-07-21T22:04:03.463 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2023-07-21T22:04:03.464 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyxdg-0.25-16.el8.noarch 2023-07-21T22:04:03.464 INFO:teuthology.orchestra.run.smithi187.stdout: skopeo-2:1.9.1-1.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:03.464 INFO:teuthology.orchestra.run.smithi187.stdout: toolbox-0.0.99.3-0.6.module+el8.6.0+16771+28dfca77.x86_64 2023-07-21T22:04:03.465 INFO:teuthology.orchestra.run.smithi187.stdout: udica-0.2.6-4.module+el8.6.0+16771+28dfca77.noarch 2023-07-21T22:04:03.465 INFO:teuthology.orchestra.run.smithi187.stdout: yajl-2.1.0-10.el8.x86_64 2023-07-21T22:04:03.465 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:04:03.465 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-07-21T22:04:03.587 DEBUG:teuthology.parallel:result is None 2023-07-21T22:04:03.691 DEBUG:teuthology.parallel:result is None 2023-07-21T22:04:03.692 INFO:teuthology.run_tasks:Running task install... 2023-07-21T22:04:03.700 DEBUG:teuthology.task.install:project ceph 2023-07-21T22:04:03.700 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'}} 2023-07-21T22:04:03.700 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea'} 2023-07-21T22:04:03.701 INFO:teuthology.task.install:Using flavor: default 2023-07-21T22:04:03.706 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-07-21T22:04:03.707 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-07-21T22:04:03.707 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', 'tag': None, 'wait_for_package': False} 2023-07-21T22:04:03.708 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:04:03.710 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', 'tag': None, 'wait_for_package': False} 2023-07-21T22:04:03.710 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:04:03.712 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', 'tag': None, 'wait_for_package': False} 2023-07-21T22:04:03.712 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:04:04.247 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/ 2023-07-21T22:04:04.247 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4735.gbffe049d 2023-07-21T22:04:04.254 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/ 2023-07-21T22:04:04.254 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4735.gbffe049d 2023-07-21T22:04:04.259 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/ 2023-07-21T22:04:04.259 INFO:teuthology.task.install.rpm:Package version is 18.0.0-4735.gbffe049d 2023-07-21T22:04:04.697 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-21T22:04:04.697 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:04:04.697 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-21T22:04:04.700 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-21T22:04:04.700 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:04:04.700 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-21T22:04:04.703 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-07-21T22:04:04.703 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:04:04.704 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-07-21T22:04:04.776 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-21T22:04:04.776 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-21T22:04:04.778 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-21T22:04:04.779 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-21T22:04:04.780 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-07-21T22:04:04.780 DEBUG:teuthology.orchestra.run.smithi195:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-07-21T22:04:04.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-21T22:04:04.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-21T22:04:04.891 DEBUG:teuthology.orchestra.run.smithi195:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-07-21T22:04:04.985 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-21T22:04:04.986 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-21T22:04:04.987 DEBUG:teuthology.orchestra.run.smithi195:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-07-21T22:04:05.054 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2023-07-21T22:04:05.055 INFO:teuthology.orchestra.run.smithi195.stdout:check_obsoletes = 1 2023-07-21T22:04:05.055 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-07-21T22:04:05.057 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum clean all 2023-07-21T22:04:05.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-07-21T22:04:05.059 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2023-07-21T22:04:05.506 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-07-21T22:04:05.507 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-07-21T22:04:05.511 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-21T22:04:05.929 INFO:teuthology.orchestra.run.smithi151.stdout:44 files removed 2023-07-21T22:04:05.954 INFO:teuthology.orchestra.run.smithi187.stdout:44 files removed 2023-07-21T22:04:05.962 INFO:teuthology.orchestra.run.smithi195.stdout:44 files removed 2023-07-21T22:04:05.985 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-21T22:04:06.016 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-21T22:04:06.023 DEBUG:teuthology.orchestra.run.smithi195:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-07-21T22:04:06.435 INFO:teuthology.orchestra.run.smithi151.stdout:Updating Subscription Management repositories. 2023-07-21T22:04:06.469 INFO:teuthology.orchestra.run.smithi195.stdout:Updating Subscription Management repositories. 2023-07-21T22:04:06.470 INFO:teuthology.orchestra.run.smithi187.stdout:Updating Subscription Management repositories. 2023-07-21T22:04:08.147 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 65 kB/s | 81 kB 00:01 2023-07-21T22:04:08.207 INFO:teuthology.orchestra.run.smithi195.stdout:ceph packages for x86_64 64 kB/s | 81 kB 00:01 2023-07-21T22:04:08.232 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 64 kB/s | 81 kB 00:01 2023-07-21T22:04:09.282 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 8.6 kB/s | 9.4 kB 00:01 2023-07-21T22:04:09.349 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 8.7 kB/s | 9.4 kB 00:01 2023-07-21T22:04:09.391 INFO:teuthology.orchestra.run.smithi195.stdout:ceph noarch packages 8.2 kB/s | 9.4 kB 00:01 2023-07-21T22:04:10.349 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 1.4 kB/s | 1.5 kB 00:01 2023-07-21T22:04:10.416 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 1.4 kB/s | 1.5 kB 00:01 2023-07-21T22:04:10.425 INFO:teuthology.orchestra.run.smithi195.stdout:ceph source packages 1.5 kB/s | 1.5 kB 00:01 2023-07-21T22:04:10.949 INFO:teuthology.orchestra.run.smithi151.stdout:Copr repo for python3-asyncssh owned by ceph 6.0 kB/s | 3.5 kB 00:00 2023-07-21T22:04:10.992 INFO:teuthology.orchestra.run.smithi195.stdout:Copr repo for python3-asyncssh owned by ceph 6.4 kB/s | 3.5 kB 00:00 2023-07-21T22:04:11.000 INFO:teuthology.orchestra.run.smithi187.stdout:Copr repo for python3-asyncssh owned by ceph 6.2 kB/s | 3.5 kB 00:00 2023-07-21T22:04:13.759 INFO:teuthology.orchestra.run.smithi195.stdout:Extra Packages for Enterprise Linux 5.7 MB/s | 16 MB 00:02 2023-07-21T22:04:17.759 INFO:teuthology.orchestra.run.smithi195.stdout:lab-extras 410 kB/s | 24 kB 00:00 2023-07-21T22:04:18.845 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 47 MB/s | 47 MB 00:01 2023-07-21T22:04:22.616 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 16 MB 00:11 2023-07-21T22:04:24.208 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 1.2 MB/s | 16 MB 00:13 2023-07-21T22:04:26.683 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 402 kB/s | 24 kB 00:00 2023-07-21T22:04:27.354 INFO:teuthology.orchestra.run.smithi195.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 51 MB/s | 53 MB 00:01 2023-07-21T22:04:27.793 INFO:teuthology.orchestra.run.smithi151.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 46 MB/s | 47 MB 00:01 2023-07-21T22:04:28.191 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 411 kB/s | 24 kB 00:00 2023-07-21T22:04:29.319 INFO:teuthology.orchestra.run.smithi187.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 45 MB/s | 47 MB 00:01 2023-07-21T22:04:36.736 INFO:teuthology.orchestra.run.smithi151.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-07-21T22:04:37.911 INFO:teuthology.orchestra.run.smithi187.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 49 MB/s | 53 MB 00:01 2023-07-21T22:04:38.943 INFO:teuthology.orchestra.run.smithi195.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T22:04:38.944 INFO:teuthology.orchestra.run.smithi195.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T22:04:38.959 INFO:teuthology.orchestra.run.smithi195.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-21T22:04:38.960 INFO:teuthology.orchestra.run.smithi195.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-21T22:04:38.962 INFO:teuthology.orchestra.run.smithi195.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-21T22:04:38.962 INFO:teuthology.orchestra.run.smithi195.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-21T22:04:38.965 INFO:teuthology.orchestra.run.smithi195.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-21T22:04:38.968 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-21T22:04:38.969 INFO:teuthology.orchestra.run.smithi195.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-21T22:04:39.105 INFO:teuthology.orchestra.run.smithi195.stdout:Dependencies resolved. 2023-07-21T22:04:39.118 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================================================== 2023-07-21T22:04:39.118 INFO:teuthology.orchestra.run.smithi195.stdout: Package Arch Version Repository Size 2023-07-21T22:04:39.119 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================================================== 2023-07-21T22:04:39.119 INFO:teuthology.orchestra.run.smithi195.stdout:Installing: 2023-07-21T22:04:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-21T22:04:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-21T22:04:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: ceph x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 6.4 k 2023-07-21T22:04:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 5.4 M 2023-07-21T22:04:39.119 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 848 k 2023-07-21T22:04:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 165 k 2023-07-21T22:04:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 1.5 M 2023-07-21T22:04:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 129 k 2023-07-21T22:04:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 1.7 M 2023-07-21T22:04:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 7.4 M 2023-07-21T22:04:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 47 k 2023-07-21T22:04:39.120 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 13 M 2023-07-21T22:04:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 48 M 2023-07-21T22:04:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 258 k 2023-07-21T22:04:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 164 k 2023-07-21T22:04:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 258 k 2023-07-21T22:04:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 18 k 2023-07-21T22:04:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-21T22:04:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-21T22:04:39.121 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-21T22:04:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 31 k 2023-07-21T22:04:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 771 k 2023-07-21T22:04:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 139 k 2023-07-21T22:04:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-21T22:04:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-21T22:04:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-21T22:04:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-21T22:04:39.122 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-21T22:04:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-21T22:04:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 197 k 2023-07-21T22:04:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 370 k 2023-07-21T22:04:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 364 k 2023-07-21T22:04:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 107 k 2023-07-21T22:04:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 94 k 2023-07-21T22:04:39.123 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 3.4 M 2023-07-21T22:04:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 179 k 2023-07-21T22:04:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-21T22:04:39.124 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrading: 2023-07-21T22:04:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-21T22:04:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: librados2 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 3.7 M 2023-07-21T22:04:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 3.6 M 2023-07-21T22:04:39.124 INFO:teuthology.orchestra.run.smithi195.stdout:Installing dependencies: 2023-07-21T22:04:39.124 INFO:teuthology.orchestra.run.smithi195.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-21T22:04:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 22 M 2023-07-21T22:04:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 23 k 2023-07-21T22:04:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 2.3 M 2023-07-21T22:04:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 240 k 2023-07-21T22:04:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 4.6 M 2023-07-21T22:04:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 18 M 2023-07-21T22:04:39.125 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 15 k 2023-07-21T22:04:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 24 k 2023-07-21T22:04:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-21T22:04:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-21T22:04:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-21T22:04:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-21T22:04:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-21T22:04:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 137 k 2023-07-21T22:04:39.126 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-21T22:04:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-21T22:04:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-21T22:04:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-21T22:04:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-21T22:04:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-21T22:04:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 473 k 2023-07-21T22:04:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-21T22:04:39.127 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 6.7 M 2023-07-21T22:04:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-21T22:04:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-21T22:04:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-21T22:04:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-21T22:04:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-21T22:04:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-21T22:04:39.128 INFO:teuthology.orchestra.run.smithi195.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-21T22:04:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-21T22:04:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-21T22:04:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-21T22:04:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-21T22:04:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-21T22:04:39.129 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-21T22:04:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-21T22:04:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-21T22:04:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-21T22:04:39.131 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 45 k 2023-07-21T22:04:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 119 k 2023-07-21T22:04:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-21T22:04:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-21T22:04:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-21T22:04:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-21T22:04:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-21T22:04:39.132 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-21T22:04:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-21T22:04:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-21T22:04:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-21T22:04:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-21T22:04:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-21T22:04:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T22:04:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-21T22:04:39.133 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-21T22:04:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-21T22:04:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-21T22:04:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-21T22:04:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-21T22:04:39.134 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-21T22:04:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-21T22:04:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-21T22:04:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-21T22:04:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-21T22:04:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-21T22:04:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-21T22:04:39.135 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-21T22:04:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-21T22:04:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-21T22:04:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-21T22:04:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-21T22:04:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T22:04:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-21T22:04:39.136 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-21T22:04:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-21T22:04:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-21T22:04:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-21T22:04:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-21T22:04:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-21T22:04:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-21T22:04:39.137 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-21T22:04:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-21T22:04:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-21T22:04:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-21T22:04:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-21T22:04:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-21T22:04:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-21T22:04:39.138 INFO:teuthology.orchestra.run.smithi195.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-21T22:04:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-21T22:04:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-21T22:04:39.139 INFO:teuthology.orchestra.run.smithi195.stdout:Enabling module streams: 2023-07-21T22:04:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql 10 2023-07-21T22:04:39.139 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:04:39.139 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction Summary 2023-07-21T22:04:39.139 INFO:teuthology.orchestra.run.smithi195.stdout:=========================================================================================================================== 2023-07-21T22:04:39.140 INFO:teuthology.orchestra.run.smithi195.stdout:Install 128 Packages 2023-07-21T22:04:39.140 INFO:teuthology.orchestra.run.smithi195.stdout:Upgrade 3 Packages 2023-07-21T22:04:39.140 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:04:39.140 INFO:teuthology.orchestra.run.smithi195.stdout:Total download size: 205 M 2023-07-21T22:04:39.141 INFO:teuthology.orchestra.run.smithi195.stdout:Downloading Packages: 2023-07-21T22:04:40.230 INFO:teuthology.orchestra.run.smithi195.stdout:(1/131): ceph-18.0.0-4735.gbffe049d.el8.x86_64. 11 kB/s | 6.4 kB 00:00 2023-07-21T22:04:42.163 INFO:teuthology.orchestra.run.smithi195.stdout:(2/131): ceph-fuse-18.0.0-4735.gbffe049d.el8.x8 439 kB/s | 848 kB 00:01 2023-07-21T22:04:42.489 INFO:teuthology.orchestra.run.smithi195.stdout:(3/131): ceph-immutable-object-cache-18.0.0-473 510 kB/s | 165 kB 00:00 2023-07-21T22:04:44.505 INFO:teuthology.orchestra.run.smithi195.stdout:(4/131): ceph-mds-18.0.0-4735.gbffe049d.el8.x86 1.1 MB/s | 2.3 MB 00:02 2023-07-21T22:04:45.655 INFO:teuthology.orchestra.run.smithi195.stdout:(5/131): ceph-mgr-18.0.0-4735.gbffe049d.el8.x86 1.3 MB/s | 1.5 MB 00:01 2023-07-21T22:04:48.287 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T22:04:48.289 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T22:04:48.303 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-21T22:04:48.304 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-21T22:04:48.306 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-21T22:04:48.307 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-21T22:04:48.309 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-21T22:04:48.312 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-21T22:04:48.314 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-21T22:04:48.453 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-07-21T22:04:48.466 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================================================== 2023-07-21T22:04:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-07-21T22:04:48.466 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================================================== 2023-07-21T22:04:48.467 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-07-21T22:04:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-21T22:04:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-21T22:04:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 6.4 k 2023-07-21T22:04:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 5.4 M 2023-07-21T22:04:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 848 k 2023-07-21T22:04:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 165 k 2023-07-21T22:04:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 1.5 M 2023-07-21T22:04:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 129 k 2023-07-21T22:04:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 1.7 M 2023-07-21T22:04:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 7.4 M 2023-07-21T22:04:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 47 k 2023-07-21T22:04:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 13 M 2023-07-21T22:04:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 48 M 2023-07-21T22:04:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 258 k 2023-07-21T22:04:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 164 k 2023-07-21T22:04:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 258 k 2023-07-21T22:04:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 18 k 2023-07-21T22:04:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-21T22:04:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-21T22:04:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-21T22:04:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 31 k 2023-07-21T22:04:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 771 k 2023-07-21T22:04:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 139 k 2023-07-21T22:04:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-21T22:04:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-21T22:04:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-21T22:04:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-21T22:04:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-21T22:04:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-21T22:04:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 197 k 2023-07-21T22:04:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 370 k 2023-07-21T22:04:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 364 k 2023-07-21T22:04:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 107 k 2023-07-21T22:04:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 94 k 2023-07-21T22:04:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 3.4 M 2023-07-21T22:04:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 179 k 2023-07-21T22:04:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-21T22:04:48.472 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-07-21T22:04:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-21T22:04:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 3.7 M 2023-07-21T22:04:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 3.6 M 2023-07-21T22:04:48.473 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-07-21T22:04:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-21T22:04:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 22 M 2023-07-21T22:04:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 23 k 2023-07-21T22:04:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 2.3 M 2023-07-21T22:04:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 240 k 2023-07-21T22:04:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 4.6 M 2023-07-21T22:04:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 18 M 2023-07-21T22:04:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 15 k 2023-07-21T22:04:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 24 k 2023-07-21T22:04:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-21T22:04:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-21T22:04:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-21T22:04:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-21T22:04:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-21T22:04:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 137 k 2023-07-21T22:04:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-21T22:04:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-21T22:04:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-21T22:04:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-21T22:04:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-21T22:04:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-21T22:04:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 473 k 2023-07-21T22:04:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-21T22:04:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 6.7 M 2023-07-21T22:04:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-21T22:04:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-21T22:04:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-21T22:04:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-21T22:04:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-21T22:04:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-21T22:04:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-21T22:04:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-21T22:04:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-21T22:04:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-21T22:04:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-21T22:04:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-21T22:04:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-21T22:04:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-21T22:04:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-21T22:04:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-21T22:04:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 45 k 2023-07-21T22:04:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 119 k 2023-07-21T22:04:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-21T22:04:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-21T22:04:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-21T22:04:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-21T22:04:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-21T22:04:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-21T22:04:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-21T22:04:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-21T22:04:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-21T22:04:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-21T22:04:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-21T22:04:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T22:04:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-21T22:04:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-21T22:04:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-21T22:04:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-21T22:04:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-21T22:04:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-21T22:04:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-21T22:04:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-21T22:04:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-21T22:04:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-21T22:04:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-21T22:04:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-21T22:04:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-21T22:04:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-21T22:04:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-21T22:04:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-21T22:04:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-21T22:04:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-21T22:04:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T22:04:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-21T22:04:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-21T22:04:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-21T22:04:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-21T22:04:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-21T22:04:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-21T22:04:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-21T22:04:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-21T22:04:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-21T22:04:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-21T22:04:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-21T22:04:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-21T22:04:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-21T22:04:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-21T22:04:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-21T22:04:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-21T22:04:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-21T22:04:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-21T22:04:48.486 INFO:teuthology.orchestra.run.smithi151.stdout:Enabling module streams: 2023-07-21T22:04:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql 10 2023-07-21T22:04:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:04:48.487 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-07-21T22:04:48.487 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================================================== 2023-07-21T22:04:48.487 INFO:teuthology.orchestra.run.smithi151.stdout:Install 128 Packages 2023-07-21T22:04:48.487 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 3 Packages 2023-07-21T22:04:48.488 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:04:48.488 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 205 M 2023-07-21T22:04:48.488 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-07-21T22:04:48.697 INFO:teuthology.orchestra.run.smithi195.stdout:(6/131): ceph-mon-18.0.0-4735.gbffe049d.el8.x86 1.5 MB/s | 4.6 MB 00:03 2023-07-21T22:04:49.545 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T22:04:49.546 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-07-21T22:04:49.561 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-1:1.36.0-4.el8.x86_64 is already installed. 2023-07-21T22:04:49.563 INFO:teuthology.orchestra.run.smithi187.stdout:Package iproute-5.15.0-4.el8.x86_64 is already installed. 2023-07-21T22:04:49.564 INFO:teuthology.orchestra.run.smithi187.stdout:Package util-linux-2.32.1-35.el8.x86_64 is already installed. 2023-07-21T22:04:49.565 INFO:teuthology.orchestra.run.smithi187.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-07-21T22:04:49.568 INFO:teuthology.orchestra.run.smithi187.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-07-21T22:04:49.571 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsdump-3.1.8-4.el8.x86_64 is already installed. 2023-07-21T22:04:49.572 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsprogs-5.0.0-10.el8.x86_64 is already installed. 2023-07-21T22:04:49.670 INFO:teuthology.orchestra.run.smithi151.stdout:(1/131): ceph-18.0.0-4735.gbffe049d.el8.x86_64. 14 kB/s | 6.4 kB 00:00 2023-07-21T22:04:49.714 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-07-21T22:04:49.728 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================================================== 2023-07-21T22:04:49.728 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2023-07-21T22:04:49.729 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================================================== 2023-07-21T22:04:49.729 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2023-07-21T22:04:49.729 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-initscripts-updown noarch 1:1.36.0-9.el8_6 rhel-8-for-x86_64-baseos-rpms 138 k 2023-07-21T22:04:49.730 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-07-21T22:04:49.730 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 6.4 k 2023-07-21T22:04:49.730 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 5.4 M 2023-07-21T22:04:49.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 848 k 2023-07-21T22:04:49.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 165 k 2023-07-21T22:04:49.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 1.5 M 2023-07-21T22:04:49.731 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 129 k 2023-07-21T22:04:49.732 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 1.7 M 2023-07-21T22:04:49.732 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 7.4 M 2023-07-21T22:04:49.732 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 47 k 2023-07-21T22:04:49.733 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 13 M 2023-07-21T22:04:49.733 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 48 M 2023-07-21T22:04:49.733 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 258 k 2023-07-21T22:04:49.733 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 164 k 2023-07-21T22:04:49.734 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 258 k 2023-07-21T22:04:49.734 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 18 k 2023-07-21T22:04:49.734 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-07-21T22:04:49.734 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-07-21T22:04:49.734 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-07-21T22:04:49.735 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 31 k 2023-07-21T22:04:49.735 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 771 k 2023-07-21T22:04:49.735 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 139 k 2023-07-21T22:04:49.736 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-07-21T22:04:49.736 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-07-21T22:04:49.736 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-07-21T22:04:49.737 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 1.5 M 2023-07-21T22:04:49.737 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 808 k 2023-07-21T22:04:49.737 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server x86_64 10.21-2.module+el8.6.0+15342+53518fac rhel-8-for-x86_64-appstream-rpms 5.1 M 2023-07-21T22:04:49.737 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 197 k 2023-07-21T22:04:49.738 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 370 k 2023-07-21T22:04:49.738 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 364 k 2023-07-21T22:04:49.738 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 107 k 2023-07-21T22:04:49.738 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 94 k 2023-07-21T22:04:49.739 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 3.4 M 2023-07-21T22:04:49.739 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 179 k 2023-07-21T22:04:49.739 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-07-21T22:04:49.739 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2023-07-21T22:04:49.740 INFO:teuthology.orchestra.run.smithi187.stdout: iproute x86_64 5.15.0-4.el8_6.1 rhel-8-for-x86_64-baseos-rpms 798 k 2023-07-21T22:04:49.740 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 3.7 M 2023-07-21T22:04:49.740 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 3.6 M 2023-07-21T22:04:49.741 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2023-07-21T22:04:49.741 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-07-21T22:04:49.741 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 22 M 2023-07-21T22:04:49.741 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 23 k 2023-07-21T22:04:49.742 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 2.3 M 2023-07-21T22:04:49.742 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 240 k 2023-07-21T22:04:49.742 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 4.6 M 2023-07-21T22:04:49.742 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 18 M 2023-07-21T22:04:49.743 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:18.0.0-4735.gbffe049d.el8 ceph-noarch 15 k 2023-07-21T22:04:49.743 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 24 k 2023-07-21T22:04:49.743 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-07-21T22:04:49.743 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-07-21T22:04:49.744 INFO:teuthology.orchestra.run.smithi187.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-07-21T22:04:49.744 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-07-21T22:04:49.744 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-07-21T22:04:49.745 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 137 k 2023-07-21T22:04:49.745 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-07-21T22:04:49.745 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-07-21T22:04:49.745 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-07-21T22:04:49.746 INFO:teuthology.orchestra.run.smithi187.stdout: libpq x86_64 13.5-1.el8 rhel-8-for-x86_64-appstream-rpms 198 k 2023-07-21T22:04:49.746 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-07-21T22:04:49.746 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-07-21T22:04:49.746 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 473 k 2023-07-21T22:04:49.746 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-07-21T22:04:49.747 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 6.7 M 2023-07-21T22:04:49.747 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-07-21T22:04:49.747 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-07-21T22:04:49.747 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-07-21T22:04:49.747 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-07-21T22:04:49.748 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-07-21T22:04:49.748 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-07-21T22:04:49.748 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-07-21T22:04:49.749 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-07-21T22:04:49.749 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-07-21T22:04:49.749 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-07-21T22:04:49.749 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-07-21T22:04:49.750 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-07-21T22:04:49.750 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-07-21T22:04:49.750 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-07-21T22:04:49.750 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-07-21T22:04:49.751 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-07-21T22:04:49.751 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 45 k 2023-07-21T22:04:49.751 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:18.0.0-4735.gbffe049d.el8 ceph 119 k 2023-07-21T22:04:49.751 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-07-21T22:04:49.752 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-07-21T22:04:49.752 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-07-21T22:04:49.752 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-07-21T22:04:49.753 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-07-21T22:04:49.753 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-07-21T22:04:49.753 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-07-21T22:04:49.753 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-07-21T22:04:49.754 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-07-21T22:04:49.754 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-07-21T22:04:49.754 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-07-21T22:04:49.754 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T22:04:49.754 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-07-21T22:04:49.754 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-07-21T22:04:49.754 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-07-21T22:04:49.755 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-07-21T22:04:49.755 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-07-21T22:04:49.755 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-07-21T22:04:49.755 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-07-21T22:04:49.755 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-07-21T22:04:49.755 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-07-21T22:04:49.755 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-07-21T22:04:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-07-21T22:04:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-07-21T22:04:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-07-21T22:04:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-07-21T22:04:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-07-21T22:04:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-07-21T22:04:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-07-21T22:04:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-07-21T22:04:49.757 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-07-21T22:04:49.757 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-07-21T22:04:49.757 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.8-1.el8 epel 61 k 2023-07-21T22:04:49.757 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-07-21T22:04:49.757 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-07-21T22:04:49.757 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-07-21T22:04:49.757 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-07-21T22:04:49.758 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-07-21T22:04:49.758 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-07-21T22:04:49.758 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-07-21T22:04:49.758 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-07-21T22:04:49.758 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-07-21T22:04:49.758 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-07-21T22:04:49.758 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-07-21T22:04:49.758 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-07-21T22:04:49.759 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-07-21T22:04:49.759 INFO:teuthology.orchestra.run.smithi187.stdout: uuid x86_64 1.6.2-43.el8 rhel-8-for-x86_64-appstream-rpms 64 k 2023-07-21T22:04:49.759 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-07-21T22:04:49.759 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-07-21T22:04:49.759 INFO:teuthology.orchestra.run.smithi187.stdout:Enabling module streams: 2023-07-21T22:04:49.759 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql 10 2023-07-21T22:04:49.759 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:04:49.760 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-07-21T22:04:49.760 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================================================== 2023-07-21T22:04:49.760 INFO:teuthology.orchestra.run.smithi187.stdout:Install 128 Packages 2023-07-21T22:04:49.760 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 3 Packages 2023-07-21T22:04:49.760 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:04:49.761 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 205 M 2023-07-21T22:04:49.761 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-07-21T22:04:50.297 INFO:teuthology.orchestra.run.smithi195.stdout:(7/131): ceph-base-18.0.0-4735.gbffe049d.el8.x8 517 kB/s | 5.4 MB 00:10 2023-07-21T22:04:50.919 INFO:teuthology.orchestra.run.smithi187.stdout:(1/131): ceph-18.0.0-4735.gbffe049d.el8.x86_64. 13 kB/s | 6.4 kB 00:00 2023-07-21T22:04:50.920 INFO:teuthology.orchestra.run.smithi151.stdout:(2/131): ceph-fuse-18.0.0-4735.gbffe049d.el8.x8 678 kB/s | 848 kB 00:01 2023-07-21T22:04:51.178 INFO:teuthology.orchestra.run.smithi151.stdout:(3/131): ceph-immutable-object-cache-18.0.0-473 641 kB/s | 165 kB 00:00 2023-07-21T22:04:52.386 INFO:teuthology.orchestra.run.smithi187.stdout:(2/131): ceph-fuse-18.0.0-4735.gbffe049d.el8.x8 578 kB/s | 848 kB 00:01 2023-07-21T22:04:52.670 INFO:teuthology.orchestra.run.smithi187.stdout:(3/131): ceph-immutable-object-cache-18.0.0-473 585 kB/s | 165 kB 00:00 2023-07-21T22:04:53.321 INFO:teuthology.orchestra.run.smithi151.stdout:(4/131): ceph-mds-18.0.0-4735.gbffe049d.el8.x86 1.1 MB/s | 2.3 MB 00:02 2023-07-21T22:04:53.554 INFO:teuthology.orchestra.run.smithi151.stdout:(5/131): ceph-base-18.0.0-4735.gbffe049d.el8.x8 1.2 MB/s | 5.4 MB 00:04 2023-07-21T22:04:54.612 INFO:teuthology.orchestra.run.smithi151.stdout:(6/131): ceph-mgr-18.0.0-4735.gbffe049d.el8.x86 1.2 MB/s | 1.5 MB 00:01 2023-07-21T22:04:54.979 INFO:teuthology.orchestra.run.smithi151.stdout:(7/131): ceph-mon-18.0.0-4735.gbffe049d.el8.x86 3.2 MB/s | 4.6 MB 00:01 2023-07-21T22:04:55.478 INFO:teuthology.orchestra.run.smithi187.stdout:(4/131): ceph-mds-18.0.0-4735.gbffe049d.el8.x86 834 kB/s | 2.3 MB 00:02 2023-07-21T22:04:57.304 INFO:teuthology.orchestra.run.smithi151.stdout:(8/131): ceph-radosgw-18.0.0-4735.gbffe049d.el8 5.8 MB/s | 13 MB 00:02 2023-07-21T22:04:57.345 INFO:teuthology.orchestra.run.smithi187.stdout:(5/131): ceph-base-18.0.0-4735.gbffe049d.el8.x8 796 kB/s | 5.4 MB 00:06 2023-07-21T22:04:57.412 INFO:teuthology.orchestra.run.smithi187.stdout:(6/131): ceph-mgr-18.0.0-4735.gbffe049d.el8.x86 820 kB/s | 1.5 MB 00:01 2023-07-21T22:04:57.413 INFO:teuthology.orchestra.run.smithi151.stdout:(9/131): ceph-selinux-18.0.0-4735.gbffe049d.el8 226 kB/s | 24 kB 00:00 2023-07-21T22:04:59.740 INFO:teuthology.orchestra.run.smithi195.stdout:(8/131): ceph-radosgw-18.0.0-4735.gbffe049d.el8 1.4 MB/s | 13 MB 00:09 2023-07-21T22:04:59.965 INFO:teuthology.orchestra.run.smithi195.stdout:(9/131): ceph-common-18.0.0-4735.gbffe049d.el8. 1.1 MB/s | 22 MB 00:20 2023-07-21T22:04:59.982 INFO:teuthology.orchestra.run.smithi195.stdout:(10/131): ceph-selinux-18.0.0-4735.gbffe049d.el 101 kB/s | 24 kB 00:00 2023-07-21T22:05:00.366 INFO:teuthology.orchestra.run.smithi195.stdout:(11/131): cephfs-mirror-18.0.0-4735.gbffe049d.e 673 kB/s | 258 kB 00:00 2023-07-21T22:05:00.517 INFO:teuthology.orchestra.run.smithi195.stdout:(12/131): libcephfs-devel-18.0.0-4735.gbffe049d 207 kB/s | 31 kB 00:00 2023-07-21T22:05:01.275 INFO:teuthology.orchestra.run.smithi195.stdout:(13/131): libcephfs2-18.0.0-4735.gbffe049d.el8. 1.0 MB/s | 771 kB 00:00 2023-07-21T22:05:01.408 INFO:teuthology.orchestra.run.smithi195.stdout:(14/131): libcephsqlite-18.0.0-4735.gbffe049d.e 1.0 MB/s | 137 kB 00:00 2023-07-21T22:05:01.550 INFO:teuthology.orchestra.run.smithi195.stdout:(15/131): librados-devel-18.0.0-4735.gbffe049d. 982 kB/s | 139 kB 00:00 2023-07-21T22:05:01.613 INFO:teuthology.orchestra.run.smithi151.stdout:(10/131): ceph-test-18.0.0-4735.gbffe049d.el8.x 11 MB/s | 48 MB 00:04 2023-07-21T22:05:01.771 INFO:teuthology.orchestra.run.smithi151.stdout:(11/131): cephfs-mirror-18.0.0-4735.gbffe049d.e 1.6 MB/s | 258 kB 00:00 2023-07-21T22:05:01.930 INFO:teuthology.orchestra.run.smithi151.stdout:(12/131): libcephfs-devel-18.0.0-4735.gbffe049d 195 kB/s | 31 kB 00:00 2023-07-21T22:05:01.942 INFO:teuthology.orchestra.run.smithi195.stdout:(16/131): libradosstriper1-18.0.0-4735.gbffe049 1.2 MB/s | 473 kB 00:00 2023-07-21T22:05:01.987 INFO:teuthology.orchestra.run.smithi187.stdout:(7/131): ceph-mon-18.0.0-4735.gbffe049d.el8.x86 1.0 MB/s | 4.6 MB 00:04 2023-07-21T22:05:02.114 INFO:teuthology.orchestra.run.smithi151.stdout:(13/131): libcephfs2-18.0.0-4735.gbffe049d.el8. 4.1 MB/s | 771 kB 00:00 2023-07-21T22:05:02.573 INFO:teuthology.orchestra.run.smithi151.stdout:(14/131): libcephsqlite-18.0.0-4735.gbffe049d.e 299 kB/s | 137 kB 00:00 2023-07-21T22:05:02.698 INFO:teuthology.orchestra.run.smithi151.stdout:(15/131): librados-devel-18.0.0-4735.gbffe049d. 1.1 MB/s | 139 kB 00:00 2023-07-21T22:05:02.856 INFO:teuthology.orchestra.run.smithi151.stdout:(16/131): libradosstriper1-18.0.0-4735.gbffe049 2.9 MB/s | 473 kB 00:00 2023-07-21T22:05:02.901 INFO:teuthology.orchestra.run.smithi195.stdout:(17/131): ceph-osd-18.0.0-4735.gbffe049d.el8.x8 1.2 MB/s | 18 MB 00:14 2023-07-21T22:05:03.060 INFO:teuthology.orchestra.run.smithi195.stdout:(18/131): python3-ceph-argparse-18.0.0-4735.gbf 284 kB/s | 45 kB 00:00 2023-07-21T22:05:03.226 INFO:teuthology.orchestra.run.smithi195.stdout:(19/131): python3-ceph-common-18.0.0-4735.gbffe 713 kB/s | 119 kB 00:00 2023-07-21T22:05:03.560 INFO:teuthology.orchestra.run.smithi195.stdout:(20/131): python3-cephfs-18.0.0-4735.gbffe049d. 590 kB/s | 197 kB 00:00 2023-07-21T22:05:03.640 INFO:teuthology.orchestra.run.smithi151.stdout:(17/131): librgw2-18.0.0-4735.gbffe049d.el8.x86 8.6 MB/s | 6.7 MB 00:00 2023-07-21T22:05:03.790 INFO:teuthology.orchestra.run.smithi151.stdout:(18/131): python3-ceph-argparse-18.0.0-4735.gbf 299 kB/s | 45 kB 00:00 2023-07-21T22:05:03.949 INFO:teuthology.orchestra.run.smithi151.stdout:(19/131): python3-ceph-common-18.0.0-4735.gbffe 750 kB/s | 119 kB 00:00 2023-07-21T22:05:03.968 INFO:teuthology.orchestra.run.smithi195.stdout:(21/131): python3-rados-18.0.0-4735.gbffe049d.e 907 kB/s | 370 kB 00:00 2023-07-21T22:05:04.116 INFO:teuthology.orchestra.run.smithi151.stdout:(20/131): python3-cephfs-18.0.0-4735.gbffe049d. 1.2 MB/s | 197 kB 00:00 2023-07-21T22:05:04.275 INFO:teuthology.orchestra.run.smithi151.stdout:(21/131): python3-rados-18.0.0-4735.gbffe049d.e 2.3 MB/s | 370 kB 00:00 2023-07-21T22:05:04.394 INFO:teuthology.orchestra.run.smithi195.stdout:(22/131): python3-rbd-18.0.0-4735.gbffe049d.el8 856 kB/s | 364 kB 00:00 2023-07-21T22:05:04.441 INFO:teuthology.orchestra.run.smithi151.stdout:(22/131): python3-rbd-18.0.0-4735.gbffe049d.el8 2.1 MB/s | 364 kB 00:00 2023-07-21T22:05:04.552 INFO:teuthology.orchestra.run.smithi195.stdout:(23/131): python3-rgw-18.0.0-4735.gbffe049d.el8 674 kB/s | 107 kB 00:00 2023-07-21T22:05:04.608 INFO:teuthology.orchestra.run.smithi151.stdout:(23/131): python3-rgw-18.0.0-4735.gbffe049d.el8 640 kB/s | 107 kB 00:00 2023-07-21T22:05:04.686 INFO:teuthology.orchestra.run.smithi195.stdout:(24/131): rbd-fuse-18.0.0-4735.gbffe049d.el8.x8 709 kB/s | 94 kB 00:00 2023-07-21T22:05:04.734 INFO:teuthology.orchestra.run.smithi151.stdout:(24/131): rbd-fuse-18.0.0-4735.gbffe049d.el8.x8 756 kB/s | 94 kB 00:00 2023-07-21T22:05:05.242 INFO:teuthology.orchestra.run.smithi151.stdout:(25/131): rbd-mirror-18.0.0-4735.gbffe049d.el8. 6.8 MB/s | 3.4 MB 00:00 2023-07-21T22:05:05.518 INFO:teuthology.orchestra.run.smithi151.stdout:(26/131): ceph-osd-18.0.0-4735.gbffe049d.el8.x8 1.6 MB/s | 18 MB 00:10 2023-07-21T22:05:05.535 INFO:teuthology.orchestra.run.smithi151.stdout:(27/131): rbd-nbd-18.0.0-4735.gbffe049d.el8.x86 615 kB/s | 179 kB 00:00 2023-07-21T22:05:05.660 INFO:teuthology.orchestra.run.smithi151.stdout:(28/131): ceph-grafana-dashboards-18.0.0-4735.g 162 kB/s | 23 kB 00:00 2023-07-21T22:05:05.685 INFO:teuthology.orchestra.run.smithi151.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4735.gbffe049 857 kB/s | 129 kB 00:00 2023-07-21T22:05:05.828 INFO:teuthology.orchestra.run.smithi195.stdout:(25/131): librgw2-18.0.0-4735.gbffe049d.el8.x86 1.7 MB/s | 6.7 MB 00:03 2023-07-21T22:05:05.995 INFO:teuthology.orchestra.run.smithi195.stdout:(26/131): rbd-nbd-18.0.0-4735.gbffe049d.el8.x86 1.1 MB/s | 179 kB 00:00 2023-07-21T22:05:06.036 INFO:teuthology.orchestra.run.smithi151.stdout:(30/131): ceph-common-18.0.0-4735.gbffe049d.el8 1.3 MB/s | 22 MB 00:16 2023-07-21T22:05:06.153 INFO:teuthology.orchestra.run.smithi195.stdout:(27/131): ceph-grafana-dashboards-18.0.0-4735.g 146 kB/s | 23 kB 00:00 2023-07-21T22:05:06.253 INFO:teuthology.orchestra.run.smithi151.stdout:(31/131): ceph-mgr-dashboard-18.0.0-4735.gbffe0 2.9 MB/s | 1.7 MB 00:00 2023-07-21T22:05:06.311 INFO:teuthology.orchestra.run.smithi151.stdout:(32/131): ceph-mgr-modules-core-18.0.0-4735.gbf 875 kB/s | 240 kB 00:00 2023-07-21T22:05:06.329 INFO:teuthology.orchestra.run.smithi195.stdout:(28/131): ceph-mgr-cephadm-18.0.0-4735.gbffe049 737 kB/s | 129 kB 00:00 2023-07-21T22:05:06.403 INFO:teuthology.orchestra.run.smithi151.stdout:(33/131): ceph-mgr-rook-18.0.0-4735.gbffe049d.e 316 kB/s | 47 kB 00:00 2023-07-21T22:05:06.445 INFO:teuthology.orchestra.run.smithi151.stdout:(34/131): ceph-prometheus-alerts-18.0.0-4735.gb 109 kB/s | 15 kB 00:00 2023-07-21T22:05:06.579 INFO:teuthology.orchestra.run.smithi151.stdout:(35/131): ceph-volume-18.0.0-4735.gbffe049d.el8 1.4 MB/s | 258 kB 00:00 2023-07-21T22:05:06.754 INFO:teuthology.orchestra.run.smithi151.stdout:(36/131): ceph-mgr-diskprediction-local-18.0.0- 6.9 MB/s | 7.4 MB 00:01 2023-07-21T22:05:06.779 INFO:teuthology.orchestra.run.smithi151.stdout:(37/131): cephadm-18.0.0-4735.gbffe049d.el8.noa 491 kB/s | 164 kB 00:00 2023-07-21T22:05:06.805 INFO:teuthology.orchestra.run.smithi151.stdout:(38/131): cephfs-top-18.0.0-4735.gbffe049d.el8. 79 kB/s | 18 kB 00:00 2023-07-21T22:05:07.055 INFO:teuthology.orchestra.run.smithi187.stdout:(8/131): ceph-osd-18.0.0-4735.gbffe049d.el8.x86 1.8 MB/s | 18 MB 00:09 2023-07-21T22:05:07.129 INFO:teuthology.orchestra.run.smithi195.stdout:(29/131): ceph-mgr-dashboard-18.0.0-4735.gbffe0 2.1 MB/s | 1.7 MB 00:00 2023-07-21T22:05:07.379 INFO:teuthology.orchestra.run.smithi195.stdout:(30/131): rbd-mirror-18.0.0-4735.gbffe049d.el8. 1.3 MB/s | 3.4 MB 00:02 2023-07-21T22:05:07.598 INFO:teuthology.orchestra.run.smithi187.stdout:(9/131): ceph-radosgw-18.0.0-4735.gbffe049d.el8 2.4 MB/s | 13 MB 00:05 2023-07-21T22:05:07.630 INFO:teuthology.orchestra.run.smithi187.stdout:(10/131): ceph-selinux-18.0.0-4735.gbffe049d.el 42 kB/s | 24 kB 00:00 2023-07-21T22:05:07.663 INFO:teuthology.orchestra.run.smithi195.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4735.gbf 850 kB/s | 240 kB 00:00 2023-07-21T22:05:07.680 INFO:teuthology.orchestra.run.smithi151.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 331 kB/s | 306 kB 00:00 2023-07-21T22:05:07.830 INFO:teuthology.orchestra.run.smithi195.stdout:(32/131): ceph-mgr-rook-18.0.0-4735.gbffe049d.e 285 kB/s | 47 kB 00:00 2023-07-21T22:05:07.830 INFO:teuthology.orchestra.run.smithi151.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 73 kB/s | 75 kB 00:01 2023-07-21T22:05:07.856 INFO:teuthology.orchestra.run.smithi187.stdout:(11/131): ceph-common-18.0.0-4735.gbffe049d.el8 1.3 MB/s | 22 MB 00:17 2023-07-21T22:05:07.889 INFO:teuthology.orchestra.run.smithi187.stdout:(12/131): cephfs-mirror-18.0.0-4735.gbffe049d.e 998 kB/s | 258 kB 00:00 2023-07-21T22:05:07.981 INFO:teuthology.orchestra.run.smithi151.stdout:(41/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-07-21T22:05:08.014 INFO:teuthology.orchestra.run.smithi187.stdout:(13/131): libcephfs-devel-18.0.0-4735.gbffe049d 196 kB/s | 31 kB 00:00 2023-07-21T22:05:08.020 INFO:teuthology.orchestra.run.smithi195.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4735.gb 76 kB/s | 15 kB 00:00 2023-07-21T22:05:08.122 INFO:teuthology.orchestra.run.smithi151.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 149 kB/s | 44 kB 00:00 2023-07-21T22:05:08.148 INFO:teuthology.orchestra.run.smithi151.stdout:(43/131): liboath-2.6.2-3.el8.x86_64.rpm 44 kB/s | 59 kB 00:01 2023-07-21T22:05:08.173 INFO:teuthology.orchestra.run.smithi151.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 965 kB/s | 185 kB 00:00 2023-07-21T22:05:08.174 INFO:teuthology.orchestra.run.smithi187.stdout:(14/131): libcephsqlite-18.0.0-4735.gbffe049d.e 867 kB/s | 137 kB 00:00 2023-07-21T22:05:08.215 INFO:teuthology.orchestra.run.smithi187.stdout:(15/131): libcephfs2-18.0.0-4735.gbffe049d.el8. 2.3 MB/s | 771 kB 00:00 2023-07-21T22:05:08.314 INFO:teuthology.orchestra.run.smithi151.stdout:(45/131): python3-cachetools-3.1.1-4.el8.noarch 173 kB/s | 33 kB 00:00 2023-07-21T22:05:08.330 INFO:teuthology.orchestra.run.smithi195.stdout:(34/131): ceph-volume-18.0.0-4735.gbffe049d.el8 834 kB/s | 258 kB 00:00 2023-07-21T22:05:08.349 INFO:teuthology.orchestra.run.smithi151.stdout:(46/131): python3-certifi-2018.10.15-7.el8.noar 81 kB/s | 16 kB 00:00 2023-07-21T22:05:08.364 INFO:teuthology.orchestra.run.smithi187.stdout:(16/131): librados-devel-18.0.0-4735.gbffe049d. 732 kB/s | 139 kB 00:00 2023-07-21T22:05:08.375 INFO:teuthology.orchestra.run.smithi151.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 859 kB/s | 173 kB 00:00 2023-07-21T22:05:08.410 INFO:teuthology.orchestra.run.smithi187.stdout:(17/131): libradosstriper1-18.0.0-4735.gbffe049 2.4 MB/s | 473 kB 00:00 2023-07-21T22:05:08.489 INFO:teuthology.orchestra.run.smithi195.stdout:(35/131): cephadm-18.0.0-4735.gbffe049d.el8.noa 1.0 MB/s | 164 kB 00:00 2023-07-21T22:05:08.543 INFO:teuthology.orchestra.run.smithi151.stdout:(48/131): python3-jaraco-6.2-6.el8.noarch.rpm 66 kB/s | 11 kB 00:00 2023-07-21T22:05:08.574 INFO:teuthology.orchestra.run.smithi187.stdout:(18/131): python3-ceph-argparse-18.0.0-4735.gbf 268 kB/s | 45 kB 00:00 2023-07-21T22:05:08.643 INFO:teuthology.orchestra.run.smithi151.stdout:(49/131): python3-google-auth-1.1.1-10.el8.noar 277 kB/s | 81 kB 00:00 2023-07-21T22:05:08.656 INFO:teuthology.orchestra.run.smithi195.stdout:(36/131): cephfs-top-18.0.0-4735.gbffe049d.el8. 108 kB/s | 18 kB 00:00 2023-07-21T22:05:08.725 INFO:teuthology.orchestra.run.smithi151.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 97 kB/s | 18 kB 00:00 2023-07-21T22:05:08.759 INFO:teuthology.orchestra.run.smithi187.stdout:(19/131): python3-ceph-common-18.0.0-4735.gbffe 644 kB/s | 119 kB 00:00 2023-07-21T22:05:08.869 INFO:teuthology.orchestra.run.smithi151.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 339 kB/s | 49 kB 00:00 2023-07-21T22:05:08.908 INFO:teuthology.orchestra.run.smithi187.stdout:(20/131): python3-cephfs-18.0.0-4735.gbffe049d. 1.3 MB/s | 197 kB 00:00 2023-07-21T22:05:09.020 INFO:teuthology.orchestra.run.smithi151.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 392 kB/s | 59 kB 00:00 2023-07-21T22:05:09.075 INFO:teuthology.orchestra.run.smithi187.stdout:(21/131): python3-rados-18.0.0-4735.gbffe049d.e 2.2 MB/s | 370 kB 00:00 2023-07-21T22:05:09.177 INFO:teuthology.orchestra.run.smithi151.stdout:(53/131): python3-natsort-7.1.1-2.el8.noarch.rp 381 kB/s | 60 kB 00:00 2023-07-21T22:05:09.233 INFO:teuthology.orchestra.run.smithi187.stdout:(22/131): python3-rbd-18.0.0-4735.gbffe049d.el8 2.2 MB/s | 364 kB 00:00 2023-07-21T22:05:09.331 INFO:teuthology.orchestra.run.smithi195.stdout:(37/131): gperftools-libs-2.7-9.el8.x86_64.rpm 454 kB/s | 306 kB 00:00 2023-07-21T22:05:09.375 INFO:teuthology.orchestra.run.smithi187.stdout:(23/131): python3-rgw-18.0.0-4735.gbffe049d.el8 752 kB/s | 107 kB 00:00 2023-07-21T22:05:09.423 INFO:teuthology.orchestra.run.smithi195.stdout:(38/131): ceph-mgr-diskprediction-local-18.0.0- 3.2 MB/s | 7.4 MB 00:02 2023-07-21T22:05:09.445 INFO:teuthology.orchestra.run.smithi151.stdout:(54/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-07-21T22:05:09.490 INFO:teuthology.orchestra.run.smithi195.stdout:(39/131): liboath-2.6.2-3.el8.x86_64.rpm 371 kB/s | 59 kB 00:00 2023-07-21T22:05:09.551 INFO:teuthology.orchestra.run.smithi187.stdout:(24/131): rbd-fuse-18.0.0-4735.gbffe049d.el8.x8 539 kB/s | 94 kB 00:00 2023-07-21T22:05:09.603 INFO:teuthology.orchestra.run.smithi151.stdout:(55/131): python3-portend-2.6-1.el8.noarch.rpm 98 kB/s | 16 kB 00:00 2023-07-21T22:05:09.765 INFO:teuthology.orchestra.run.smithi195.stdout:(40/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.7 MB/s | 476 kB 00:00 2023-07-21T22:05:09.770 INFO:teuthology.orchestra.run.smithi151.stdout:(56/131): python3-repoze-lru-0.7-6.el8.noarch.r 202 kB/s | 34 kB 00:00 2023-07-21T22:05:09.916 INFO:teuthology.orchestra.run.smithi195.stdout:(41/131): libunwind-1.3.1-3.el8.x86_64.rpm 153 kB/s | 75 kB 00:00 2023-07-21T22:05:09.921 INFO:teuthology.orchestra.run.smithi151.stdout:(57/131): python3-cherrypy-18.4.0-1.el8.noarch. 239 kB/s | 384 kB 00:01 2023-07-21T22:05:09.941 INFO:teuthology.orchestra.run.smithi195.stdout:(42/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 249 kB/s | 44 kB 00:00 2023-07-21T22:05:09.946 INFO:teuthology.orchestra.run.smithi151.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.1 MB/s | 196 kB 00:00 2023-07-21T22:05:10.049 INFO:teuthology.orchestra.run.smithi195.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 305 kB/s | 33 kB 00:00 2023-07-21T22:05:10.071 INFO:teuthology.orchestra.run.smithi151.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 149 kB/s | 19 kB 00:00 2023-07-21T22:05:10.147 INFO:teuthology.orchestra.run.smithi151.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 273 kB/s | 61 kB 00:00 2023-07-21T22:05:10.191 INFO:teuthology.orchestra.run.smithi195.stdout:(44/131): python3-certifi-2018.10.15-7.el8.noar 115 kB/s | 16 kB 00:00 2023-07-21T22:05:10.205 INFO:teuthology.orchestra.run.smithi151.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 179 kB/s | 24 kB 00:00 2023-07-21T22:05:10.225 INFO:teuthology.orchestra.run.smithi195.stdout:(45/131): python3-beautifulsoup4-4.6.3-2.el8.1. 599 kB/s | 185 kB 00:00 2023-07-21T22:05:10.281 INFO:teuthology.orchestra.run.smithi151.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 219 kB/s | 29 kB 00:00 2023-07-21T22:05:10.331 INFO:teuthology.orchestra.run.smithi151.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 220 kB/s | 27 kB 00:00 2023-07-21T22:05:10.350 INFO:teuthology.orchestra.run.smithi195.stdout:(46/131): python3-cheroot-8.5.2-1.el8.noarch.rp 1.1 MB/s | 173 kB 00:00 2023-07-21T22:05:10.359 INFO:teuthology.orchestra.run.smithi187.stdout:(25/131): rbd-mirror-18.0.0-4735.gbffe049d.el8. 4.3 MB/s | 3.4 MB 00:00 2023-07-21T22:05:10.467 INFO:teuthology.orchestra.run.smithi195.stdout:(47/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.6 MB/s | 384 kB 00:00 2023-07-21T22:05:10.473 INFO:teuthology.orchestra.run.smithi151.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.7 MB/s | 251 kB 00:00 2023-07-21T22:05:10.476 INFO:teuthology.orchestra.run.smithi187.stdout:(26/131): librgw2-18.0.0-4735.gbffe049d.el8.x86 3.2 MB/s | 6.7 MB 00:02 2023-07-21T22:05:10.502 INFO:teuthology.orchestra.run.smithi187.stdout:(27/131): rbd-nbd-18.0.0-4735.gbffe049d.el8.x86 1.2 MB/s | 179 kB 00:00 2023-07-21T22:05:10.607 INFO:teuthology.orchestra.run.smithi151.stdout:(65/131): python3-websocket-client-0.56.0-5.el8 459 kB/s | 61 kB 00:00 2023-07-21T22:05:10.610 INFO:teuthology.orchestra.run.smithi187.stdout:(28/131): ceph-grafana-dashboards-18.0.0-4735.g 172 kB/s | 23 kB 00:00 2023-07-21T22:05:10.636 INFO:teuthology.orchestra.run.smithi187.stdout:(29/131): ceph-mgr-cephadm-18.0.0-4735.gbffe049 964 kB/s | 129 kB 00:00 2023-07-21T22:05:10.659 INFO:teuthology.orchestra.run.smithi195.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 263 kB/s | 81 kB 00:00 2023-07-21T22:05:10.685 INFO:teuthology.orchestra.run.smithi195.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 51 kB/s | 11 kB 00:00 2023-07-21T22:05:10.748 INFO:teuthology.orchestra.run.smithi151.stdout:(66/131): python3-webtest-2.0.33-1.el8.noarch.r 604 kB/s | 85 kB 00:00 2023-07-21T22:05:10.802 INFO:teuthology.orchestra.run.smithi195.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 124 kB/s | 18 kB 00:00 2023-07-21T22:05:10.882 INFO:teuthology.orchestra.run.smithi151.stdout:(67/131): python3-zc-lockfile-2.0-2.el8.noarch. 172 kB/s | 23 kB 00:00 2023-07-21T22:05:10.902 INFO:teuthology.orchestra.run.smithi195.stdout:(51/131): python3-kubernetes-11.0.0-6.el8.noarc 5.4 MB/s | 1.2 MB 00:00 2023-07-21T22:05:10.927 INFO:teuthology.orchestra.run.smithi195.stdout:(52/131): python3-logutils-0.3.5-11.el8.noarch. 390 kB/s | 49 kB 00:00 2023-07-21T22:05:11.019 INFO:teuthology.orchestra.run.smithi195.stdout:(53/131): python3-more-itertools-7.2.0-3.el8.no 501 kB/s | 59 kB 00:00 2023-07-21T22:05:11.044 INFO:teuthology.orchestra.run.smithi195.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 516 kB/s | 60 kB 00:00 2023-07-21T22:05:11.119 INFO:teuthology.orchestra.run.smithi187.stdout:(30/131): ceph-mgr-dashboard-18.0.0-4735.gbffe0 3.4 MB/s | 1.7 MB 00:00 2023-07-21T22:05:11.136 INFO:teuthology.orchestra.run.smithi195.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 2.4 MB/s | 283 kB 00:00 2023-07-21T22:05:11.141 INFO:teuthology.orchestra.run.smithi151.stdout:(68/131): python3-waitress-1.4.3-1.el8.noarch.r 297 kB/s | 255 kB 00:00 2023-07-21T22:05:11.162 INFO:teuthology.orchestra.run.smithi195.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 133 kB/s | 16 kB 00:00 2023-07-21T22:05:11.166 INFO:teuthology.orchestra.run.smithi151.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.8 MB/s | 70 kB 00:00 2023-07-21T22:05:11.278 INFO:teuthology.orchestra.run.smithi187.stdout:(31/131): ceph-mgr-modules-core-18.0.0-4735.gbf 1.5 MB/s | 240 kB 00:00 2023-07-21T22:05:11.287 INFO:teuthology.orchestra.run.smithi195.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 224 kB/s | 34 kB 00:00 2023-07-21T22:05:11.312 INFO:teuthology.orchestra.run.smithi195.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.3 MB/s | 196 kB 00:00 2023-07-21T22:05:11.438 INFO:teuthology.orchestra.run.smithi195.stdout:(59/131): python3-simplegeneric-0.8.1-17.el8.no 150 kB/s | 19 kB 00:00 2023-07-21T22:05:11.463 INFO:teuthology.orchestra.run.smithi195.stdout:(60/131): python3-rsa-4.8-1.el8.noarch.rpm 351 kB/s | 61 kB 00:00 2023-07-21T22:05:11.463 INFO:teuthology.orchestra.run.smithi187.stdout:(32/131): ceph-mgr-rook-18.0.0-4735.gbffe049d.e 256 kB/s | 47 kB 00:00 2023-07-21T22:05:11.550 INFO:teuthology.orchestra.run.smithi151.stdout:(70/131): python3-scipy-1.0.0-21.module+el8.5.0 36 MB/s | 14 MB 00:00 2023-07-21T22:05:11.571 INFO:teuthology.orchestra.run.smithi195.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 179 kB/s | 24 kB 00:00 2023-07-21T22:05:11.592 INFO:teuthology.orchestra.run.smithi151.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.6 MB/s | 110 kB 00:00 2023-07-21T22:05:11.597 INFO:teuthology.orchestra.run.smithi195.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 219 kB/s | 29 kB 00:00 2023-07-21T22:05:11.612 INFO:teuthology.orchestra.run.smithi187.stdout:(33/131): ceph-prometheus-alerts-18.0.0-4735.gb 98 kB/s | 15 kB 00:00 2023-07-21T22:05:11.660 INFO:teuthology.orchestra.run.smithi151.stdout:(72/131): thrift-0.13.0-2.el8.x86_64.rpm 2.2 MB/s | 1.7 MB 00:00 2023-07-21T22:05:11.692 INFO:teuthology.orchestra.run.smithi151.stdout:(73/131): python3-pytz-2017.2-9.el8.noarch.rpm 540 kB/s | 54 kB 00:00 2023-07-21T22:05:11.705 INFO:teuthology.orchestra.run.smithi195.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 206 kB/s | 27 kB 00:00 2023-07-21T22:05:11.742 INFO:teuthology.orchestra.run.smithi151.stdout:(74/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 3.1 MB/s | 259 kB 00:00 2023-07-21T22:05:11.768 INFO:teuthology.orchestra.run.smithi151.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 4.5 MB/s | 323 kB 00:00 2023-07-21T22:05:11.779 INFO:teuthology.orchestra.run.smithi187.stdout:(34/131): ceph-volume-18.0.0-4735.gbffe049d.el8 1.5 MB/s | 258 kB 00:00 2023-07-21T22:05:11.793 INFO:teuthology.orchestra.run.smithi151.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 771 kB/s | 39 kB 00:00 2023-07-21T22:05:11.843 INFO:teuthology.orchestra.run.smithi151.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 8.9 MB/s | 688 kB 00:00 2023-07-21T22:05:11.856 INFO:teuthology.orchestra.run.smithi195.stdout:(64/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.6 MB/s | 251 kB 00:00 2023-07-21T22:05:11.881 INFO:teuthology.orchestra.run.smithi195.stdout:(65/131): python3-waitress-1.4.3-1.el8.noarch.r 900 kB/s | 255 kB 00:00 2023-07-21T22:05:11.885 INFO:teuthology.orchestra.run.smithi151.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 5.7 MB/s | 538 kB 00:00 2023-07-21T22:05:11.911 INFO:teuthology.orchestra.run.smithi151.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-07-21T22:05:11.929 INFO:teuthology.orchestra.run.smithi187.stdout:(35/131): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-07-21T22:05:11.936 INFO:teuthology.orchestra.run.smithi151.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-07-21T22:05:11.954 INFO:teuthology.orchestra.run.smithi187.stdout:(36/131): cephadm-18.0.0-4735.gbffe049d.el8.noa 937 kB/s | 164 kB 00:00 2023-07-21T22:05:11.978 INFO:teuthology.orchestra.run.smithi151.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-07-21T22:05:11.990 INFO:teuthology.orchestra.run.smithi195.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 458 kB/s | 61 kB 00:00 2023-07-21T22:05:12.011 INFO:teuthology.orchestra.run.smithi151.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 804 kB/s | 27 kB 00:00 2023-07-21T22:05:12.015 INFO:teuthology.orchestra.run.smithi195.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 639 kB/s | 85 kB 00:00 2023-07-21T22:05:12.087 INFO:teuthology.orchestra.run.smithi151.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 4.1 MB/s | 320 kB 00:00 2023-07-21T22:05:12.096 INFO:teuthology.orchestra.run.smithi187.stdout:(37/131): cephfs-top-18.0.0-4735.gbffe049d.el8. 108 kB/s | 18 kB 00:00 2023-07-21T22:05:12.129 INFO:teuthology.orchestra.run.smithi151.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-07-21T22:05:12.190 INFO:teuthology.orchestra.run.smithi195.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 115 kB/s | 23 kB 00:00 2023-07-21T22:05:12.215 INFO:teuthology.orchestra.run.smithi195.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-21T22:05:12.229 INFO:teuthology.orchestra.run.smithi151.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2023-07-21T22:05:12.280 INFO:teuthology.orchestra.run.smithi151.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 8.9 MB/s | 457 kB 00:00 2023-07-21T22:05:12.307 INFO:teuthology.orchestra.run.smithi195.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 5.9 MB/s | 1.7 MB 00:00 2023-07-21T22:05:12.322 INFO:teuthology.orchestra.run.smithi151.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-21T22:05:12.374 INFO:teuthology.orchestra.run.smithi195.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 1.6 MB/s | 110 kB 00:00 2023-07-21T22:05:12.388 INFO:teuthology.orchestra.run.smithi151.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-07-21T22:05:12.408 INFO:teuthology.orchestra.run.smithi195.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-07-21T22:05:12.414 INFO:teuthology.orchestra.run.smithi151.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 696 kB/s | 64 kB 00:00 2023-07-21T22:05:12.443 INFO:teuthology.orchestra.run.smithi151.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.5 MB/s | 126 kB 00:00 2023-07-21T22:05:12.450 INFO:teuthology.orchestra.run.smithi195.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-21T22:05:12.465 INFO:teuthology.orchestra.run.smithi151.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 396 kB/s | 20 kB 00:00 2023-07-21T22:05:12.492 INFO:teuthology.orchestra.run.smithi195.stdout:(74/131): socat-1.7.4.1-1.el8.x86_64.rpm 7.6 MB/s | 323 kB 00:00 2023-07-21T22:05:12.524 INFO:teuthology.orchestra.run.smithi151.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 1.2 MB/s | 103 kB 00:00 2023-07-21T22:05:12.525 INFO:teuthology.orchestra.run.smithi195.stdout:(75/131): python3-markupsafe-0.23-19.el8.x86_64 1.1 MB/s | 39 kB 00:00 2023-07-21T22:05:12.565 INFO:teuthology.orchestra.run.smithi151.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 6.9 MB/s | 709 kB 00:00 2023-07-21T22:05:12.584 INFO:teuthology.orchestra.run.smithi195.stdout:(76/131): bison-3.0.4-10.el8.x86_64.rpm 12 MB/s | 688 kB 00:00 2023-07-21T22:05:12.607 INFO:teuthology.orchestra.run.smithi151.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.6 MB/s | 198 kB 00:00 2023-07-21T22:05:12.635 INFO:teuthology.orchestra.run.smithi195.stdout:(77/131): python3-jinja2-2.10.1-3.el8.noarch.rp 10 MB/s | 538 kB 00:00 2023-07-21T22:05:12.647 INFO:teuthology.orchestra.run.smithi187.stdout:(38/131): liboath-2.6.2-3.el8.x86_64.rpm 107 kB/s | 59 kB 00:00 2023-07-21T22:05:12.676 INFO:teuthology.orchestra.run.smithi195.stdout:(78/131): python3-mako-1.0.6-13.el8.noarch.rpm 3.7 MB/s | 157 kB 00:00 2023-07-21T22:05:12.718 INFO:teuthology.orchestra.run.smithi195.stdout:(79/131): oniguruma-6.8.2-2.el8.x86_64.rpm 4.4 MB/s | 187 kB 00:00 2023-07-21T22:05:12.749 INFO:teuthology.orchestra.run.smithi151.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2023-07-21T22:05:12.777 INFO:teuthology.orchestra.run.smithi195.stdout:(80/131): automake-1.16.1-7.el8.noarch.rpm 12 MB/s | 713 kB 00:00 2023-07-21T22:05:12.791 INFO:teuthology.orchestra.run.smithi151.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-21T22:05:12.805 INFO:teuthology.orchestra.run.smithi187.stdout:(39/131): gperftools-libs-2.7-9.el8.x86_64.rpm 360 kB/s | 306 kB 00:00 2023-07-21T22:05:12.883 INFO:teuthology.orchestra.run.smithi151.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 17 MB/s | 4.7 MB 00:00 2023-07-21T22:05:12.897 INFO:teuthology.orchestra.run.smithi187.stdout:(40/131): libunwind-1.3.1-3.el8.x86_64.rpm 300 kB/s | 75 kB 00:00 2023-07-21T22:05:12.943 INFO:teuthology.orchestra.run.smithi151.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 2.3 MB/s | 354 kB 00:00 2023-07-21T22:05:12.944 INFO:teuthology.orchestra.run.smithi195.stdout:(81/131): python3-scipy-1.0.0-21.module+el8.5.0 19 MB/s | 14 MB 00:00 2023-07-21T22:05:12.986 INFO:teuthology.orchestra.run.smithi195.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 641 kB/s | 27 kB 00:00 2023-07-21T22:05:13.009 INFO:teuthology.orchestra.run.smithi151.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2023-07-21T22:05:13.028 INFO:teuthology.orchestra.run.smithi195.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.6 MB/s | 320 kB 00:00 2023-07-21T22:05:13.055 INFO:teuthology.orchestra.run.smithi187.stdout:(41/131): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 276 kB/s | 44 kB 00:00 2023-07-21T22:05:13.070 INFO:teuthology.orchestra.run.smithi195.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-07-21T22:05:13.084 INFO:teuthology.orchestra.run.smithi151.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 20 MB/s | 1.5 MB 00:00 2023-07-21T22:05:13.106 INFO:teuthology.orchestra.run.smithi187.stdout:(42/131): python3-asyncssh-2.7.0-2.el8.noarch.r 1.5 MB/s | 476 kB 00:00 2023-07-21T22:05:13.118 INFO:teuthology.orchestra.run.smithi151.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-07-21T22:05:13.145 INFO:teuthology.orchestra.run.smithi195.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 13 MB/s | 4.8 MB 00:00 2023-07-21T22:05:13.193 INFO:teuthology.orchestra.run.smithi151.stdout:(102/131): postgresql-server-10.21-2.module+el8 16 MB/s | 5.1 MB 00:00 2023-07-21T22:05:13.195 INFO:teuthology.orchestra.run.smithi195.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-07-21T22:05:13.218 INFO:teuthology.orchestra.run.smithi151.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.9 MB/s | 200 kB 00:00 2023-07-21T22:05:13.238 INFO:teuthology.orchestra.run.smithi195.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-21T22:05:13.244 INFO:teuthology.orchestra.run.smithi151.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 846 kB/s | 43 kB 00:00 2023-07-21T22:05:13.256 INFO:teuthology.orchestra.run.smithi187.stdout:(43/131): python3-cachetools-3.1.1-4.el8.noarch 220 kB/s | 33 kB 00:00 2023-07-21T22:05:13.260 INFO:teuthology.orchestra.run.smithi151.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-07-21T22:05:13.279 INFO:teuthology.orchestra.run.smithi195.stdout:(88/131): uuid-1.6.2-43.el8.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2023-07-21T22:05:13.286 INFO:teuthology.orchestra.run.smithi151.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 1.1 MB/s | 48 kB 00:00 2023-07-21T22:05:13.311 INFO:teuthology.orchestra.run.smithi151.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-21T22:05:13.337 INFO:teuthology.orchestra.run.smithi151.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 847 kB/s | 43 kB 00:00 2023-07-21T22:05:13.346 INFO:teuthology.orchestra.run.smithi195.stdout:(89/131): python3-numpy-1.14.3-10.el8.x86_64.rp 14 MB/s | 3.7 MB 00:00 2023-07-21T22:05:13.395 INFO:teuthology.orchestra.run.smithi151.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 1.3 MB/s | 109 kB 00:00 2023-07-21T22:05:13.396 INFO:teuthology.orchestra.run.smithi195.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.1 MB/s | 126 kB 00:00 2023-07-21T22:05:13.399 INFO:teuthology.orchestra.run.smithi187.stdout:(44/131): python3-beautifulsoup4-4.6.3-2.el8.1. 540 kB/s | 185 kB 00:00 2023-07-21T22:05:13.420 INFO:teuthology.orchestra.run.smithi151.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2023-07-21T22:05:13.422 INFO:teuthology.orchestra.run.smithi195.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 266 kB/s | 20 kB 00:00 2023-07-21T22:05:13.431 INFO:teuthology.orchestra.run.smithi187.stdout:(45/131): python3-certifi-2018.10.15-7.el8.noar 93 kB/s | 16 kB 00:00 2023-07-21T22:05:13.447 INFO:teuthology.orchestra.run.smithi195.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-21T22:05:13.454 INFO:teuthology.orchestra.run.smithi151.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 9.4 MB/s | 560 kB 00:00 2023-07-21T22:05:13.471 INFO:teuthology.orchestra.run.smithi151.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 371 kB/s | 19 kB 00:00 2023-07-21T22:05:13.489 INFO:teuthology.orchestra.run.smithi195.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-07-21T22:05:13.505 INFO:teuthology.orchestra.run.smithi151.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-07-21T22:05:13.531 INFO:teuthology.orchestra.run.smithi195.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-07-21T22:05:13.539 INFO:teuthology.orchestra.run.smithi151.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 8.1 MB/s | 559 kB 00:00 2023-07-21T22:05:13.556 INFO:teuthology.orchestra.run.smithi151.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 356 kB/s | 18 kB 00:00 2023-07-21T22:05:13.589 INFO:teuthology.orchestra.run.smithi151.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-07-21T22:05:13.614 INFO:teuthology.orchestra.run.smithi151.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-07-21T22:05:13.632 INFO:teuthology.orchestra.run.smithi187.stdout:(46/131): python3-cherrypy-18.4.0-1.el8.noarch. 1.9 MB/s | 384 kB 00:00 2023-07-21T22:05:13.643 INFO:teuthology.orchestra.run.smithi151.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.8 MB/s | 72 kB 00:00 2023-07-21T22:05:13.658 INFO:teuthology.orchestra.run.smithi187.stdout:(47/131): python3-cheroot-8.5.2-1.el8.noarch.rp 669 kB/s | 173 kB 00:00 2023-07-21T22:05:13.665 INFO:teuthology.orchestra.run.smithi195.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 22 MB/s | 4.9 MB 00:00 2023-07-21T22:05:13.673 INFO:teuthology.orchestra.run.smithi151.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-07-21T22:05:13.707 INFO:teuthology.orchestra.run.smithi195.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-07-21T22:05:13.732 INFO:teuthology.orchestra.run.smithi151.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 16 MB/s | 2.3 MB 00:00 2023-07-21T22:05:13.757 INFO:teuthology.orchestra.run.smithi151.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 716 kB/s | 60 kB 00:00 2023-07-21T22:05:13.782 INFO:teuthology.orchestra.run.smithi195.stdout:(97/131): openblas-0.3.15-3.el8.x86_64.rpm 19 MB/s | 4.7 MB 00:00 2023-07-21T22:05:13.807 INFO:teuthology.orchestra.run.smithi187.stdout:(48/131): python3-google-auth-1.1.1-10.el8.noar 464 kB/s | 81 kB 00:00 2023-07-21T22:05:13.816 INFO:teuthology.orchestra.run.smithi195.stdout:(98/131): librdkafka-0.11.4-3.el8.x86_64.rpm 3.2 MB/s | 354 kB 00:00 2023-07-21T22:05:13.816 INFO:teuthology.orchestra.run.smithi151.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.1 MB/s | 98 kB 00:00 2023-07-21T22:05:13.833 INFO:teuthology.orchestra.run.smithi187.stdout:(49/131): python3-jaraco-6.2-6.el8.noarch.rpm 63 kB/s | 11 kB 00:00 2023-07-21T22:05:13.841 INFO:teuthology.orchestra.run.smithi151.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 689 kB/s | 58 kB 00:00 2023-07-21T22:05:13.867 INFO:teuthology.orchestra.run.smithi151.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 766 kB/s | 39 kB 00:00 2023-07-21T22:05:13.883 INFO:teuthology.orchestra.run.smithi195.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2023-07-21T22:05:13.909 INFO:teuthology.orchestra.run.smithi151.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-07-21T22:05:13.934 INFO:teuthology.orchestra.run.smithi151.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-07-21T22:05:13.950 INFO:teuthology.orchestra.run.smithi187.stdout:(50/131): python3-jaraco-functools-2.0-4.el8.no 124 kB/s | 18 kB 00:00 2023-07-21T22:05:13.951 INFO:teuthology.orchestra.run.smithi151.stdout:(127/131): NetworkManager-initscripts-updown-1. 3.2 MB/s | 138 kB 00:00 2023-07-21T22:05:13.983 INFO:teuthology.orchestra.run.smithi195.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 15 MB/s | 1.5 MB 00:00 2023-07-21T22:05:14.017 INFO:teuthology.orchestra.run.smithi195.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2023-07-21T22:05:14.083 INFO:teuthology.orchestra.run.smithi195.stdout:(102/131): postgresql-server-10.21-2.module+el8 17 MB/s | 5.1 MB 00:00 2023-07-21T22:05:14.108 INFO:teuthology.orchestra.run.smithi187.stdout:(51/131): python3-logutils-0.3.5-11.el8.noarch. 308 kB/s | 49 kB 00:00 2023-07-21T22:05:14.109 INFO:teuthology.orchestra.run.smithi195.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 2.1 MB/s | 200 kB 00:00 2023-07-21T22:05:14.126 INFO:teuthology.orchestra.run.smithi195.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-07-21T22:05:14.151 INFO:teuthology.orchestra.run.smithi151.stdout:(128/131): python3-kubernetes-11.0.0-6.el8.noar 217 kB/s | 1.2 MB 00:05 2023-07-21T22:05:14.152 INFO:teuthology.orchestra.run.smithi195.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.1 MB/s | 220 kB 00:00 2023-07-21T22:05:14.176 INFO:teuthology.orchestra.run.smithi195.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 953 kB/s | 48 kB 00:00 2023-07-21T22:05:14.202 INFO:teuthology.orchestra.run.smithi195.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-21T22:05:14.226 INFO:teuthology.orchestra.run.smithi151.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 10 MB/s | 798 kB 00:00 2023-07-21T22:05:14.227 INFO:teuthology.orchestra.run.smithi195.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 851 kB/s | 43 kB 00:00 2023-07-21T22:05:14.252 INFO:teuthology.orchestra.run.smithi195.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.1 MB/s | 109 kB 00:00 2023-07-21T22:05:14.267 INFO:teuthology.orchestra.run.smithi187.stdout:(52/131): python3-more-itertools-7.2.0-3.el8.no 371 kB/s | 59 kB 00:00 2023-07-21T22:05:14.286 INFO:teuthology.orchestra.run.smithi195.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-07-21T22:05:14.319 INFO:teuthology.orchestra.run.smithi195.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.2 MB/s | 560 kB 00:00 2023-07-21T22:05:14.342 INFO:teuthology.orchestra.run.smithi187.stdout:(53/131): python3-kubernetes-11.0.0-6.el8.noarc 2.3 MB/s | 1.2 MB 00:00 2023-07-21T22:05:14.344 INFO:teuthology.orchestra.run.smithi195.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 321 kB/s | 19 kB 00:00 2023-07-21T22:05:14.370 INFO:teuthology.orchestra.run.smithi195.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-07-21T22:05:14.412 INFO:teuthology.orchestra.run.smithi195.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 8.2 MB/s | 559 kB 00:00 2023-07-21T22:05:14.437 INFO:teuthology.orchestra.run.smithi195.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 268 kB/s | 18 kB 00:00 2023-07-21T22:05:14.442 INFO:teuthology.orchestra.run.smithi187.stdout:(54/131): python3-natsort-7.1.1-2.el8.noarch.rp 344 kB/s | 60 kB 00:00 2023-07-21T22:05:14.496 INFO:teuthology.orchestra.run.smithi195.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 7.1 MB/s | 605 kB 00:00 2023-07-21T22:05:14.510 INFO:teuthology.orchestra.run.smithi187.stdout:(55/131): python3-pecan-1.3.2-9.el8.noarch.rpm 1.7 MB/s | 283 kB 00:00 2023-07-21T22:05:14.521 INFO:teuthology.orchestra.run.smithi195.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.8 MB/s | 238 kB 00:00 2023-07-21T22:05:14.555 INFO:teuthology.orchestra.run.smithi195.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.1 MB/s | 72 kB 00:00 2023-07-21T22:05:14.597 INFO:teuthology.orchestra.run.smithi195.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 1.9 MB/s | 83 kB 00:00 2023-07-21T22:05:14.601 INFO:teuthology.orchestra.run.smithi187.stdout:(56/131): python3-portend-2.6-1.el8.noarch.rpm 98 kB/s | 16 kB 00:00 2023-07-21T22:05:14.647 INFO:teuthology.orchestra.run.smithi195.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 15 MB/s | 2.3 MB 00:00 2023-07-21T22:05:14.668 INFO:teuthology.orchestra.run.smithi187.stdout:(57/131): python3-repoze-lru-0.7-6.el8.noarch.r 212 kB/s | 34 kB 00:00 2023-07-21T22:05:14.672 INFO:teuthology.orchestra.run.smithi195.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 797 kB/s | 60 kB 00:00 2023-07-21T22:05:14.698 INFO:teuthology.orchestra.run.smithi195.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.9 MB/s | 98 kB 00:00 2023-07-21T22:05:14.723 INFO:teuthology.orchestra.run.smithi195.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.1 MB/s | 58 kB 00:00 2023-07-21T22:05:14.748 INFO:teuthology.orchestra.run.smithi195.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 767 kB/s | 39 kB 00:00 2023-07-21T22:05:14.790 INFO:teuthology.orchestra.run.smithi195.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.4 MB/s | 644 kB 00:00 2023-07-21T22:05:14.794 INFO:teuthology.orchestra.run.smithi187.stdout:(58/131): python3-routes-2.4.1-12.el8.noarch.rp 1.0 MB/s | 196 kB 00:00 2023-07-21T22:05:14.811 INFO:teuthology.orchestra.run.smithi187.stdout:(59/131): python3-rsa-4.8-1.el8.noarch.rpm 434 kB/s | 61 kB 00:00 2023-07-21T22:05:14.816 INFO:teuthology.orchestra.run.smithi195.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-07-21T22:05:14.841 INFO:teuthology.orchestra.run.smithi195.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-07-21T22:05:14.953 INFO:teuthology.orchestra.run.smithi187.stdout:(60/131): python3-simplegeneric-0.8.1-17.el8.no 118 kB/s | 19 kB 00:00 2023-07-21T22:05:14.970 INFO:teuthology.orchestra.run.smithi187.stdout:(61/131): python3-singledispatch-3.4.0.3-18.el8 151 kB/s | 24 kB 00:00 2023-07-21T22:05:15.112 INFO:teuthology.orchestra.run.smithi187.stdout:(62/131): python3-tempora-1.14.1-5.el8.noarch.r 184 kB/s | 29 kB 00:00 2023-07-21T22:05:15.129 INFO:teuthology.orchestra.run.smithi187.stdout:(63/131): python3-trustme-0.6.0-4.el8.noarch.rp 173 kB/s | 27 kB 00:00 2023-07-21T22:05:15.320 INFO:teuthology.orchestra.run.smithi187.stdout:(64/131): python3-waitress-1.4.3-1.el8.noarch.r 1.2 MB/s | 255 kB 00:00 2023-07-21T22:05:15.354 INFO:teuthology.orchestra.run.smithi187.stdout:(65/131): python3-webob-1.8.5-1.el8.1.noarch.rp 1.1 MB/s | 251 kB 00:00 2023-07-21T22:05:15.380 INFO:teuthology.orchestra.run.smithi151.stdout:(130/131): librbd1-18.0.0-4735.gbffe049d.el8.x8 2.5 MB/s | 3.6 MB 00:01 2023-07-21T22:05:15.487 INFO:teuthology.orchestra.run.smithi187.stdout:(66/131): python3-websocket-client-0.56.0-5.el8 367 kB/s | 61 kB 00:00 2023-07-21T22:05:15.513 INFO:teuthology.orchestra.run.smithi187.stdout:(67/131): python3-webtest-2.0.33-1.el8.noarch.r 539 kB/s | 85 kB 00:00 2023-07-21T22:05:15.630 INFO:teuthology.orchestra.run.smithi187.stdout:(68/131): python3-zc-lockfile-2.0-2.el8.noarch. 161 kB/s | 23 kB 00:00 2023-07-21T22:05:15.655 INFO:teuthology.orchestra.run.smithi187.stdout:(69/131): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-07-21T22:05:15.677 INFO:teuthology.orchestra.run.smithi151.stdout:(131/131): librados2-18.0.0-4735.gbffe049d.el8. 2.1 MB/s | 3.7 MB 00:01 2023-07-21T22:05:15.681 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-07-21T22:05:15.681 INFO:teuthology.orchestra.run.smithi151.stdout:Total 7.5 MB/s | 205 MB 00:27 2023-07-21T22:05:15.864 INFO:teuthology.orchestra.run.smithi187.stdout:(70/131): thrift-0.13.0-2.el8.x86_64.rpm 5.0 MB/s | 1.7 MB 00:00 2023-07-21T22:05:15.914 INFO:teuthology.orchestra.run.smithi187.stdout:(71/131): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-07-21T22:05:15.956 INFO:teuthology.orchestra.run.smithi187.stdout:(72/131): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-07-21T22:05:15.998 INFO:teuthology.orchestra.run.smithi187.stdout:(73/131): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-07-21T22:05:16.198 INFO:teuthology.orchestra.run.smithi187.stdout:(74/131): python3-scipy-1.0.0-21.module+el8.5.0 25 MB/s | 14 MB 00:00 2023-07-21T22:05:16.232 INFO:teuthology.orchestra.run.smithi187.stdout:(75/131): socat-1.7.4.1-1.el8.x86_64.rpm 1.4 MB/s | 323 kB 00:00 2023-07-21T22:05:16.257 INFO:teuthology.orchestra.run.smithi187.stdout:(76/131): python3-markupsafe-0.23-19.el8.x86_64 667 kB/s | 39 kB 00:00 2023-07-21T22:05:16.299 INFO:teuthology.orchestra.run.smithi187.stdout:(77/131): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-07-21T22:05:16.341 INFO:teuthology.orchestra.run.smithi187.stdout:(78/131): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2023-07-21T22:05:16.366 INFO:teuthology.orchestra.run.smithi187.stdout:(79/131): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-07-21T22:05:16.391 INFO:teuthology.orchestra.run.smithi187.stdout:(80/131): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-07-21T22:05:16.434 INFO:teuthology.orchestra.run.smithi187.stdout:(81/131): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-07-21T22:05:16.501 INFO:teuthology.orchestra.run.smithi187.stdout:(82/131): python3-jsonpatch-1.21-2.el8.noarch.r 399 kB/s | 27 kB 00:00 2023-07-21T22:05:16.543 INFO:teuthology.orchestra.run.smithi187.stdout:(83/131): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-07-21T22:05:16.585 INFO:teuthology.orchestra.run.smithi187.stdout:(84/131): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-07-21T22:05:16.599 INFO:teuthology.orchestra.run.smithi195.stdout:(128/131): librbd1-18.0.0-4735.gbffe049d.el8.x8 2.0 MB/s | 3.6 MB 00:01 2023-07-21T22:05:16.660 INFO:teuthology.orchestra.run.smithi187.stdout:(85/131): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-07-21T22:05:16.675 INFO:teuthology.orchestra.run.smithi195.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 10 MB/s | 798 kB 00:00 2023-07-21T22:05:16.710 INFO:teuthology.orchestra.run.smithi187.stdout:(86/131): python3-werkzeug-0.12.2-4.el8.noarch. 9.0 MB/s | 457 kB 00:00 2023-07-21T22:05:16.752 INFO:teuthology.orchestra.run.smithi187.stdout:(87/131): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-07-21T22:05:16.819 INFO:teuthology.orchestra.run.smithi187.stdout:(88/131): python3-numpy-1.14.3-10.el8.x86_64.rp 16 MB/s | 3.7 MB 00:00 2023-07-21T22:05:16.870 INFO:teuthology.orchestra.run.smithi187.stdout:(89/131): uuid-1.6.2-43.el8.x86_64.rpm 546 kB/s | 64 kB 00:00 2023-07-21T22:05:16.895 INFO:teuthology.orchestra.run.smithi187.stdout:(90/131): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.6 MB/s | 126 kB 00:00 2023-07-21T22:05:16.920 INFO:teuthology.orchestra.run.smithi187.stdout:(91/131): python3-jsonpointer-1.10-11.el8.noarc 399 kB/s | 20 kB 00:00 2023-07-21T22:05:16.945 INFO:teuthology.orchestra.run.smithi187.stdout:(92/131): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-07-21T22:05:16.987 INFO:teuthology.orchestra.run.smithi187.stdout:(93/131): libtool-2.4.6-25.el8.x86_64.rpm 10 MB/s | 709 kB 00:00 2023-07-21T22:05:17.029 INFO:teuthology.orchestra.run.smithi187.stdout:(94/131): libpq-13.5-1.el8.x86_64.rpm 4.7 MB/s | 198 kB 00:00 2023-07-21T22:05:17.146 INFO:teuthology.orchestra.run.smithi187.stdout:(95/131): openblas-threads-0.3.15-3.el8.x86_64. 24 MB/s | 4.9 MB 00:00 2023-07-21T22:05:17.188 INFO:teuthology.orchestra.run.smithi187.stdout:(96/131): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-07-21T22:05:17.263 INFO:teuthology.orchestra.run.smithi187.stdout:(97/131): librdkafka-0.11.4-3.el8.x86_64.rpm 4.6 MB/s | 354 kB 00:00 2023-07-21T22:05:17.330 INFO:teuthology.orchestra.run.smithi187.stdout:(98/131): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-07-21T22:05:17.334 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-07-21T22:05:17.366 INFO:teuthology.orchestra.run.smithi195.stdout:(130/131): librados2-18.0.0-4735.gbffe049d.el8. 1.4 MB/s | 3.7 MB 00:02 2023-07-21T22:05:17.397 INFO:teuthology.orchestra.run.smithi187.stdout:(99/131): postgresql-contrib-10.21-2.module+el8 12 MB/s | 808 kB 00:00 2023-07-21T22:05:17.469 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-07-21T22:05:17.469 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-07-21T22:05:17.692 INFO:teuthology.orchestra.run.smithi187.stdout:(100/131): postgresql-10.21-2.module+el8.6.0+15 5.1 MB/s | 1.5 MB 00:00 2023-07-21T22:05:17.731 INFO:teuthology.orchestra.run.smithi187.stdout:(101/131): librabbitmq-0.9.0-3.el8.x86_64.rpm 1.2 MB/s | 47 kB 00:00 2023-07-21T22:05:17.798 INFO:teuthology.orchestra.run.smithi187.stdout:(102/131): postgresql-server-10.21-2.module+el8 9.5 MB/s | 5.1 MB 00:00 2023-07-21T22:05:17.832 INFO:teuthology.orchestra.run.smithi187.stdout:(103/131): libselinux-devel-2.9-5.el8.x86_64.rp 1.9 MB/s | 200 kB 00:00 2023-07-21T22:05:17.857 INFO:teuthology.orchestra.run.smithi187.stdout:(104/131): python3-jwt-1.6.1-2.el8.noarch.rpm 729 kB/s | 43 kB 00:00 2023-07-21T22:05:17.882 INFO:teuthology.orchestra.run.smithi187.stdout:(105/131): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-07-21T22:05:17.900 INFO:teuthology.orchestra.run.smithi195.stdout:(131/131): ceph-test-18.0.0-4735.gbffe049d.el8. 2.7 MB/s | 48 MB 00:17 2023-07-21T22:05:17.904 INFO:teuthology.orchestra.run.smithi195.stdout:-------------------------------------------------------------------------------- 2023-07-21T22:05:17.904 INFO:teuthology.orchestra.run.smithi195.stdout:Total 5.3 MB/s | 205 MB 00:38 2023-07-21T22:05:17.907 INFO:teuthology.orchestra.run.smithi187.stdout:(106/131): keyutils-libs-devel-1.5.10-9.el8.x86 960 kB/s | 48 kB 00:00 2023-07-21T22:05:17.933 INFO:teuthology.orchestra.run.smithi187.stdout:(107/131): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-07-21T22:05:17.958 INFO:teuthology.orchestra.run.smithi187.stdout:(108/131): python3-requests-oauthlib-1.0.0-1.el 847 kB/s | 43 kB 00:00 2023-07-21T22:05:17.975 INFO:teuthology.orchestra.run.smithi187.stdout:(109/131): python3-pycparser-2.14-14.el8.noarch 2.5 MB/s | 109 kB 00:00 2023-07-21T22:05:18.000 INFO:teuthology.orchestra.run.smithi187.stdout:(110/131): pcre2-utf16-10.32-2.el8.x86_64.rpm 5.3 MB/s | 229 kB 00:00 2023-07-21T22:05:18.068 INFO:teuthology.orchestra.run.smithi187.stdout:(111/131): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.0 MB/s | 560 kB 00:00 2023-07-21T22:05:18.093 INFO:teuthology.orchestra.run.smithi187.stdout:(112/131): libaio-devel-0.3.112-1.el8.x86_64.rp 203 kB/s | 19 kB 00:00 2023-07-21T22:05:18.118 INFO:teuthology.orchestra.run.smithi187.stdout:(113/131): python3-oauthlib-2.1.0-1.el8.noarch. 3.0 MB/s | 155 kB 00:00 2023-07-21T22:05:18.152 INFO:teuthology.orchestra.run.smithi187.stdout:(114/131): python3-cryptography-3.2.1-5.el8.x86 9.3 MB/s | 559 kB 00:00 2023-07-21T22:05:18.177 INFO:teuthology.orchestra.run.smithi187.stdout:(115/131): libverto-devel-0.3.0-5.el8.x86_64.rp 305 kB/s | 18 kB 00:00 2023-07-21T22:05:18.211 INFO:teuthology.orchestra.run.smithi187.stdout:(116/131): pcre2-devel-10.32-2.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2023-07-21T22:05:18.244 INFO:teuthology.orchestra.run.smithi187.stdout:(117/131): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.5 MB/s | 238 kB 00:00 2023-07-21T22:05:18.286 INFO:teuthology.orchestra.run.smithi187.stdout:(118/131): xfsprogs-devel-5.0.0-10.el8.x86_64.r 1.7 MB/s | 72 kB 00:00 2023-07-21T22:05:18.320 INFO:teuthology.orchestra.run.smithi187.stdout:(119/131): fuse-2.9.7-15.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2023-07-21T22:05:18.370 INFO:teuthology.orchestra.run.smithi187.stdout:(120/131): openssl-devel-1.1.1k-7.el8_6.x86_64. 15 MB/s | 2.3 MB 00:00 2023-07-21T22:05:18.416 INFO:teuthology.orchestra.run.smithi187.stdout:(121/131): elfutils-libelf-devel-0.186-1.el8.x8 624 kB/s | 60 kB 00:00 2023-07-21T22:05:18.446 INFO:teuthology.orchestra.run.smithi187.stdout:(122/131): libuuid-devel-2.32.1-35.el8.x86_64.r 1.3 MB/s | 98 kB 00:00 2023-07-21T22:05:18.471 INFO:teuthology.orchestra.run.smithi187.stdout:(123/131): zlib-devel-1.2.11-18.el8_5.x86_64.rp 1.0 MB/s | 58 kB 00:00 2023-07-21T22:05:18.496 INFO:teuthology.orchestra.run.smithi187.stdout:(124/131): libcom_err-devel-1.45.6-4.el8.x86_64 767 kB/s | 39 kB 00:00 2023-07-21T22:05:18.538 INFO:teuthology.orchestra.run.smithi187.stdout:(125/131): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.5 MB/s | 644 kB 00:00 2023-07-21T22:05:18.564 INFO:teuthology.orchestra.run.smithi187.stdout:(126/131): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-07-21T22:05:18.589 INFO:teuthology.orchestra.run.smithi187.stdout:(127/131): NetworkManager-initscripts-updown-1. 2.7 MB/s | 138 kB 00:00 2023-07-21T22:05:19.069 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-07-21T22:05:19.074 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-07-21T22:05:19.541 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction check 2023-07-21T22:05:19.675 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction check succeeded. 2023-07-21T22:05:19.676 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction test 2023-07-21T22:05:19.714 INFO:teuthology.orchestra.run.smithi187.stdout:(128/131): librados2-18.0.0-4735.gbffe049d.el8. 3.2 MB/s | 3.7 MB 00:01 2023-07-21T22:05:19.781 INFO:teuthology.orchestra.run.smithi187.stdout:(129/131): iproute-5.15.0-4.el8_6.1.x86_64.rpm 12 MB/s | 798 kB 00:00 2023-07-21T22:05:20.273 INFO:teuthology.orchestra.run.smithi187.stdout:(130/131): ceph-test-18.0.0-4735.gbffe049d.el8. 3.8 MB/s | 48 MB 00:12 2023-07-21T22:05:20.365 INFO:teuthology.orchestra.run.smithi187.stdout:(131/131): librbd1-18.0.0-4735.gbffe049d.el8.x8 2.0 MB/s | 3.6 MB 00:01 2023-07-21T22:05:20.368 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-07-21T22:05:20.368 INFO:teuthology.orchestra.run.smithi187.stdout:Total 6.7 MB/s | 205 MB 00:30 2023-07-21T22:05:21.209 INFO:teuthology.orchestra.run.smithi195.stdout:Transaction test succeeded. 2023-07-21T22:05:21.213 INFO:teuthology.orchestra.run.smithi195.stdout:Running transaction 2023-07-21T22:05:22.018 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-07-21T22:05:22.153 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-07-21T22:05:22.153 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-07-21T22:05:23.728 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-07-21T22:05:23.733 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-07-21T22:05:24.281 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-07-21T22:05:24.495 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-21T22:05:24.660 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-21T22:05:24.864 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-21T22:05:25.062 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-21T22:05:25.221 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-21T22:05:25.496 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-21T22:05:25.969 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-21T22:05:26.204 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 6/134 2023-07-21T22:05:26.219 INFO:teuthology.orchestra.run.smithi195.stdout: Preparing : 1/1 2023-07-21T22:05:26.395 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-21T22:05:26.636 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-21T22:05:26.663 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 6/134 2023-07-21T22:05:26.795 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 7/134 2023-07-21T22:05:26.831 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-21T22:05:26.944 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 7/134 2023-07-21T22:05:27.004 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-21T22:05:27.145 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 8/134 2023-07-21T22:05:27.180 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-21T22:05:27.264 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 8/134 2023-07-21T22:05:27.413 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-21T22:05:27.484 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:18.0.0-4735.gbffe049d.el8.x86_64 9/134 2023-07-21T22:05:27.743 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-21T22:05:27.862 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-21T22:05:27.992 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-21T22:05:28.079 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 6/134 2023-07-21T22:05:28.406 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-21T22:05:28.568 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 6/134 2023-07-21T22:05:28.634 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-21T22:05:28.754 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 7/134 2023-07-21T22:05:28.815 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-07-21T22:05:28.820 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 14/134 2023-07-21T22:05:28.909 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 7/134 2023-07-21T22:05:28.937 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 14/134 2023-07-21T22:05:29.028 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/134 2023-07-21T22:05:29.088 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 8/134 2023-07-21T22:05:29.120 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86 15/134 2023-07-21T22:05:29.203 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 8/134 2023-07-21T22:05:29.205 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/134 2023-07-21T22:05:29.225 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86 15/134 2023-07-21T22:05:29.363 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-21T22:05:29.426 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rados-2:18.0.0-4735.gbffe049d.el8.x86_64 9/134 2023-07-21T22:05:29.448 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/134 2023-07-21T22:05:29.531 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-21T22:05:29.663 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-21T22:05:29.677 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-21T22:05:29.711 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-21T22:05:29.818 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/134 2023-07-21T22:05:29.943 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-21T22:05:30.104 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-21T22:05:30.357 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-21T22:05:30.415 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-21T22:05:30.569 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/134 2023-07-21T22:05:30.595 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-21T22:05:30.626 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-21T22:05:30.779 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 14/134 2023-07-21T22:05:30.829 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 6/134 2023-07-21T22:05:30.901 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 14/134 2023-07-21T22:05:31.095 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86 15/134 2023-07-21T22:05:31.201 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86 15/134 2023-07-21T22:05:31.280 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-21T22:05:31.284 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 6/134 2023-07-21T22:05:31.337 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-21T22:05:31.454 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 7/134 2023-07-21T22:05:31.478 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-21T22:05:31.514 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-21T22:05:31.641 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 7/134 2023-07-21T22:05:31.704 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-21T22:05:31.821 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 8/134 2023-07-21T22:05:31.943 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 8/134 2023-07-21T22:05:32.118 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:18.0.0-4735.gbffe049d.el8.x86_64 9/134 2023-07-21T22:05:32.360 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-21T22:05:32.400 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-21T22:05:32.412 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpq-13.5-1.el8.x86_64 10/134 2023-07-21T22:05:32.598 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-21T22:05:32.651 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/134 2023-07-21T22:05:32.694 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-21T22:05:32.988 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-21T22:05:33.110 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/134 2023-07-21T22:05:33.209 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-21T22:05:33.274 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-21T22:05:33.386 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-10.21-2.module+el8.6.0+15342+53518fac 13/134 2023-07-21T22:05:33.420 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-21T22:05:33.470 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-21T22:05:33.570 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 14/134 2023-07-21T22:05:33.679 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-21T22:05:33.699 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 14/134 2023-07-21T22:05:33.829 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86 15/134 2023-07-21T22:05:33.939 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-21T22:05:33.961 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86 15/134 2023-07-21T22:05:34.128 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-21T22:05:34.152 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:18.0.0-4735.gbffe049d.el8. 26/134 2023-07-21T22:05:34.290 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:18.0.0-4735.gbffe049d.el 27/134 2023-07-21T22:05:34.300 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-21T22:05:34.305 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 16/134 2023-07-21T22:05:34.495 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-21T22:05:34.578 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-21T22:05:34.813 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-21T22:05:35.060 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-21T22:05:35.190 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 17/134 2023-07-21T22:05:35.270 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-21T22:05:35.301 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:18.0.0-4735.gbffe049d.el8.x86_6 28/134 2023-07-21T22:05:35.379 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-21T22:05:35.554 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-21T22:05:35.725 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-21T22:05:35.806 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-21T22:05:36.011 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-common-2:18.0.0-4735.gbffe049d.el8. 26/134 2023-07-21T22:05:36.053 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-21T22:05:36.074 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 18/134 2023-07-21T22:05:36.149 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-ceph-argparse-2:18.0.0-4735.gbffe049d.el 27/134 2023-07-21T22:05:36.303 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.15-3.el8.x86_64 19/134 2023-07-21T22:05:36.382 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-21T22:05:36.577 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-21T22:05:37.150 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cephfs-2:18.0.0-4735.gbffe049d.el8.x86_6 28/134 2023-07-21T22:05:37.150 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 19/134 2023-07-21T22:05:37.477 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 20/134 2023-07-21T22:05:37.507 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-21T22:05:37.721 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 21/134 2023-07-21T22:05:37.819 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-21T22:05:37.943 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/134 2023-07-21T22:05:38.113 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-21T22:05:38.187 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/134 2023-07-21T22:05:38.320 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-21T22:05:38.454 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 24/134 2023-07-21T22:05:38.652 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-21T22:05:38.748 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/134 2023-07-21T22:05:38.952 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:18.0.0-4735.gbffe049d.el8. 26/134 2023-07-21T22:05:38.987 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-21T22:05:39.082 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:18.0.0-4735.gbffe049d.el 27/134 2023-07-21T22:05:39.223 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-21T22:05:39.408 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-21T22:05:39.627 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:18.0.0-4735.gbffe049d.el8.x86_64 36/134 2023-07-21T22:05:39.823 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:18.0.0-4735.gbffe049d.el8.x86_6 37/134 2023-07-21T22:05:39.969 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-21T22:05:40.135 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:18.0.0-4735.gbffe049d.el8.x86_6 28/134 2023-07-21T22:05:40.197 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-21T22:05:40.377 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-21T22:05:40.463 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-21T22:05:40.475 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/134 2023-07-21T22:05:40.641 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-21T22:05:40.720 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-21T22:05:40.752 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/134 2023-07-21T22:05:40.917 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-21T22:05:40.956 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-21T22:05:41.078 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/134 2023-07-21T22:05:41.143 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-21T22:05:41.150 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-21T22:05:41.319 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-21T22:05:41.597 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-21T22:05:41.653 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rbd-2:18.0.0-4735.gbffe049d.el8.x86_64 36/134 2023-07-21T22:05:41.841 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librados-devel-2:18.0.0-4735.gbffe049d.el8.x86_6 37/134 2023-07-21T22:05:41.909 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-21T22:05:42.005 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-21T22:05:42.108 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-21T22:05:42.212 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-21T22:05:42.380 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-21T22:05:42.389 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-21T22:05:42.551 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-21T22:05:42.653 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-21T22:05:42.818 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-21T22:05:42.995 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-21T22:05:43.051 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-21T22:05:43.211 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-21T22:05:43.402 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-21T22:05:43.402 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 32/134 2023-07-21T22:05:43.480 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-21T22:05:43.646 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-21T22:05:43.743 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-21T22:05:43.769 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 33/134 2023-07-21T22:05:43.877 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-21T22:05:43.992 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-21T22:05:44.022 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.8-1.el8.noarch 34/134 2023-07-21T22:05:44.032 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-21T22:05:44.216 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 35/134 2023-07-21T22:05:44.246 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-21T22:05:44.351 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-21T22:05:44.451 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:18.0.0-4735.gbffe049d.el8.x86_64 36/134 2023-07-21T22:05:44.520 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-21T22:05:44.646 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-21T22:05:44.648 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:18.0.0-4735.gbffe049d.el8.x86_6 37/134 2023-07-21T22:05:44.827 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 38/134 2023-07-21T22:05:44.870 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-21T22:05:44.958 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-21T22:05:45.005 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 39/134 2023-07-21T22:05:45.095 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-21T22:05:45.218 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-21T22:05:45.230 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.7-15.el8.x86_64 40/134 2023-07-21T22:05:45.284 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-21T22:05:45.399 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 41/134 2023-07-21T22:05:45.402 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-21T22:05:45.495 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-21T22:05:45.622 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-21T22:05:45.673 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/134 2023-07-21T22:05:45.683 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-21T22:05:45.801 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-21T22:05:45.857 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-21T22:05:45.896 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-21T22:05:45.898 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 43/134 2023-07-21T22:05:46.177 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-21T22:05:46.232 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-21T22:05:46.312 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 44/134 2023-07-21T22:05:46.433 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-21T22:05:46.506 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-21T22:05:46.568 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-21T22:05:46.609 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 45/134 2023-07-21T22:05:46.666 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-21T22:05:46.784 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-21T22:05:46.869 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 46/134 2023-07-21T22:05:46.916 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-21T22:05:47.027 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-21T22:05:47.095 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-21T22:05:47.148 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 47/134 2023-07-21T22:05:47.227 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-21T22:05:47.286 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-21T22:05:47.414 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-21T22:05:47.430 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 48/134 2023-07-21T22:05:47.493 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-21T22:05:47.576 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-21T22:05:47.661 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-21T22:05:47.799 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 49/134 2023-07-21T22:05:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-21T22:05:47.923 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-21T22:05:48.028 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 50/134 2023-07-21T22:05:48.035 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-21T22:05:48.141 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-21T22:05:48.196 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 51/134 2023-07-21T22:05:48.240 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-21T22:05:48.335 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-21T22:05:48.399 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-21T22:05:48.433 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-21T22:05:48.453 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 52/134 2023-07-21T22:05:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-21T22:05:48.656 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-21T22:05:48.674 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 53/134 2023-07-21T22:05:48.836 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-21T22:05:48.839 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 54/134 2023-07-21T22:05:48.854 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-21T22:05:49.003 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-21T22:05:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-21T22:05:49.182 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/134 2023-07-21T22:05:49.193 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-21T22:05:49.255 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-21T22:05:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-21T22:05:49.458 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-21T22:05:49.514 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/134 2023-07-21T22:05:49.659 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-21T22:05:49.679 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-21T22:05:49.790 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-21T22:05:49.820 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/134 2023-07-21T22:05:49.933 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-21T22:05:49.956 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-21T22:05:50.051 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 58/134 2023-07-21T22:05:50.133 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-21T22:05:50.158 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-21T22:05:50.268 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 59/134 2023-07-21T22:05:50.350 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-21T22:05:50.443 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-21T22:05:50.446 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 60/134 2023-07-21T22:05:50.582 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-21T22:05:50.659 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : uuid-1.6.2-43.el8.x86_64 61/134 2023-07-21T22:05:50.702 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-21T22:05:50.752 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: uuid-1.6.2-43.el8.x86_64 61/134 2023-07-21T22:05:50.763 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-21T22:05:50.891 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-21T22:05:50.947 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-21T22:05:50.975 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 62/134 2023-07-21T22:05:51.156 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-21T22:05:51.173 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.1-7.el8.noarch 63/134 2023-07-21T22:05:51.205 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-21T22:05:51.382 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-21T22:05:51.392 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-21T22:05:51.489 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/134 2023-07-21T22:05:51.608 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-21T22:05:51.742 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : jq-1.6-3.el8.x86_64 65/134 2023-07-21T22:05:51.912 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-21T22:05:51.928 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 66/134 2023-07-21T22:05:52.101 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-21T22:05:52.144 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 67/134 2023-07-21T22:05:52.302 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-21T22:05:52.326 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 68/134 2023-07-21T22:05:52.506 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-21T22:05:52.513 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-21T22:05:52.644 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 69/134 2023-07-21T22:05:52.829 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-21T22:05:52.869 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 70/134 2023-07-21T22:05:53.039 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 71/134 2023-07-21T22:05:53.089 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-21T22:05:53.189 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 72/134 2023-07-21T22:05:53.476 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 73/134 2023-07-21T22:05:53.525 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-21T22:05:53.719 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 74/134 2023-07-21T22:05:53.856 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-21T22:05:53.862 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-21T22:05:53.918 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 75/134 2023-07-21T22:05:54.104 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-21T22:05:54.138 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 76/134 2023-07-21T22:05:54.162 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-21T22:05:54.300 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 77/134 2023-07-21T22:05:54.448 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-21T22:05:54.570 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 78/134 2023-07-21T22:05:54.806 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-21T22:05:54.832 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 79/134 2023-07-21T22:05:54.951 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-21T22:05:55.033 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 80/134 2023-07-21T22:05:55.108 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-21T22:05:55.116 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 92/134 2023-07-21T22:05:55.202 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 92/134 2023-07-21T22:05:55.325 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-21T22:05:55.335 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-2.6-1.el8.noarch 81/134 2023-07-21T22:05:55.392 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:18.0.0-4735.gbffe049d.el8.x86_64 93/134 2023-07-21T22:05:55.543 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 82/134 2023-07-21T22:05:55.752 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 83/134 2023-07-21T22:05:55.958 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 84/134 2023-07-21T22:05:56.196 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-21T22:05:56.375 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 92/134 2023-07-21T22:05:56.475 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 92/134 2023-07-21T22:05:56.759 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : python3-rgw-2:18.0.0-4735.gbffe049d.el8.x86_64 93/134 2023-07-21T22:05:57.312 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 85/134 2023-07-21T22:05:57.646 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 86/134 2023-07-21T22:05:57.955 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 87/134 2023-07-21T22:05:58.324 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 88/134 2023-07-21T22:05:58.955 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 89/134 2023-07-21T22:05:59.193 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 90/134 2023-07-21T22:06:00.068 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 91/134 2023-07-21T22:06:00.257 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 92/134 2023-07-21T22:06:00.382 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 92/134 2023-07-21T22:06:00.549 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:18.0.0-4735.gbffe049d.el8.x86_64 93/134 2023-07-21T22:06:00.766 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 94/134 2023-07-21T22:06:01.025 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 94/134 2023-07-21T22:06:01.567 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 94/134 2023-07-21T22:06:01.745 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 94/134 2023-07-21T22:06:02.267 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 94/134 2023-07-21T22:06:02.793 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 95/134 2023-07-21T22:06:02.946 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 95/134 2023-07-21T22:06:02.974 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 94/134 2023-07-21T22:06:03.073 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 96/134 2023-07-21T22:06:03.293 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 95/134 2023-07-21T22:06:03.421 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 95/134 2023-07-21T22:06:03.541 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 96/134 2023-07-21T22:06:05.635 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 94/134 2023-07-21T22:06:05.882 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 94/134 2023-07-21T22:06:06.580 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 94/134 2023-07-21T22:06:06.888 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 95/134 2023-07-21T22:06:07.043 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 95/134 2023-07-21T22:06:07.190 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 96/134 2023-07-21T22:06:23.792 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 96/134 2023-07-21T22:06:23.793 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /sys 2023-07-21T22:06:23.793 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /proc 2023-07-21T22:06:23.793 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2023-07-21T22:06:23.793 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /run 2023-07-21T22:06:23.793 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /mnt 2023-07-21T22:06:23.794 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /var/tmp 2023-07-21T22:06:23.794 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /home 2023-07-21T22:06:23.794 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /tmp 2023-07-21T22:06:23.794 INFO:teuthology.orchestra.run.smithi195.stdout:skipping the directory /dev 2023-07-21T22:06:23.794 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:06:23.835 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 96/134 2023-07-21T22:06:23.835 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-07-21T22:06:23.835 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-07-21T22:06:23.835 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-07-21T22:06:23.835 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /run 2023-07-21T22:06:23.835 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-07-21T22:06:23.836 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-07-21T22:06:23.836 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-07-21T22:06:23.836 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-07-21T22:06:23.836 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /dev 2023-07-21T22:06:23.836 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:06:24.205 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 97/134 2023-07-21T22:06:24.246 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 97/134 2023-07-21T22:06:25.942 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 97/134 2023-07-21T22:06:26.002 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 97/134 2023-07-21T22:06:26.173 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 98/134 2023-07-21T22:06:26.198 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 98/134 2023-07-21T22:06:26.443 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 98/134 2023-07-21T22:06:26.468 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 98/134 2023-07-21T22:06:26.647 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 99/134 2023-07-21T22:06:26.671 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 99/134 2023-07-21T22:06:27.183 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 99/134 2023-07-21T22:06:27.207 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 99/134 2023-07-21T22:06:27.380 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 100/134 2023-07-21T22:06:27.422 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 100/134 2023-07-21T22:06:27.470 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 100/134 2023-07-21T22:06:27.513 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 100/134 2023-07-21T22:06:27.641 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 96/134 2023-07-21T22:06:27.642 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2023-07-21T22:06:27.642 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2023-07-21T22:06:27.642 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-07-21T22:06:27.642 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /run 2023-07-21T22:06:27.642 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2023-07-21T22:06:27.642 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2023-07-21T22:06:27.643 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2023-07-21T22:06:27.643 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2023-07-21T22:06:27.643 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /dev 2023-07-21T22:06:27.643 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:06:28.070 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 97/134 2023-07-21T22:06:29.811 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 97/134 2023-07-21T22:06:30.026 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 98/134 2023-07-21T22:06:30.128 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 101/134 2023-07-21T22:06:30.242 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 101/134 2023-07-21T22:06:30.296 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 98/134 2023-07-21T22:06:30.317 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 101/134 2023-07-21T22:06:30.417 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 101/134 2023-07-21T22:06:30.437 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4735.gbffe049d.e 102/134 2023-07-21T22:06:30.511 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 99/134 2023-07-21T22:06:30.536 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4735.gbffe049d.e 102/134 2023-07-21T22:06:30.676 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4735.gbffe049d. 103/134 2023-07-21T22:06:30.767 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4735.gbffe049d. 103/134 2023-07-21T22:06:30.862 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noa 104/134 2023-07-21T22:06:30.944 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noa 104/134 2023-07-21T22:06:31.051 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 99/134 2023-07-21T22:06:31.122 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noa 104/134 2023-07-21T22:06:31.212 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noa 104/134 2023-07-21T22:06:31.288 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.n 105/134 2023-07-21T22:06:31.303 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 100/134 2023-07-21T22:06:31.344 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 100/134 2023-07-21T22:06:31.413 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.n 105/134 2023-07-21T22:06:32.404 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.n 105/134 2023-07-21T22:06:32.529 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.n 105/134 2023-07-21T22:06:32.570 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4735.gbff 106/134 2023-07-21T22:06:32.694 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4735.gbff 106/134 2023-07-21T22:06:32.698 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4735.gbff 106/134 2023-07-21T22:06:32.824 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4735.gbff 106/134 2023-07-21T22:06:33.096 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4735.gbffe049d.el 107/134 2023-07-21T22:06:33.189 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4735.gbffe049d.el 107/134 2023-07-21T22:06:33.354 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 108/134 2023-07-21T22:06:33.401 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 108/134 2023-07-21T22:06:33.419 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 108/134 2023-07-21T22:06:33.467 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 108/134 2023-07-21T22:06:33.620 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 109/134 2023-07-21T22:06:33.648 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 109/134 2023-07-21T22:06:33.661 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 109/134 2023-07-21T22:06:33.689 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 109/134 2023-07-21T22:06:34.074 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 101/134 2023-07-21T22:06:34.270 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 101/134 2023-07-21T22:06:34.385 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-4735.gbffe049d.e 102/134 2023-07-21T22:06:34.591 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-4735.gbffe049d. 103/134 2023-07-21T22:06:34.801 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noa 104/134 2023-07-21T22:06:35.065 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noa 104/134 2023-07-21T22:06:35.079 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-2:18.0.0-4735.gbffe049d.el8.x86_64 110/134 2023-07-21T22:06:35.122 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:18.0.0-4735.gbffe049d.el8.x86_64 110/134 2023-07-21T22:06:35.250 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.n 105/134 2023-07-21T22:06:35.334 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 111/134 2023-07-21T22:06:35.381 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 111/134 2023-07-21T22:06:35.396 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 111/134 2023-07-21T22:06:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 111/134 2023-07-21T22:06:35.562 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4735.gbffe0 112/134 2023-07-21T22:06:35.619 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4735.gbffe0 112/134 2023-07-21T22:06:35.639 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4735.gbffe0 112/134 2023-07-21T22:06:35.691 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4735.gbffe0 112/134 2023-07-21T22:06:35.787 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 113/134 2023-07-21T22:06:35.878 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 113/134 2023-07-21T22:06:36.196 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 113/134 2023-07-21T22:06:36.293 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 113/134 2023-07-21T22:06:36.345 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 114/134 2023-07-21T22:06:36.366 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.n 105/134 2023-07-21T22:06:36.453 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 114/134 2023-07-21T22:06:36.535 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-4735.gbff 106/134 2023-07-21T22:06:36.664 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-4735.gbff 106/134 2023-07-21T22:06:37.074 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-4735.gbffe049d.el 107/134 2023-07-21T22:06:37.325 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 108/134 2023-07-21T22:06:37.391 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 108/134 2023-07-21T22:06:37.593 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 109/134 2023-07-21T22:06:37.621 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 109/134 2023-07-21T22:06:39.105 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:18.0.0-4735.gbffe049d.el8.x86_64 110/134 2023-07-21T22:06:39.364 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 111/134 2023-07-21T22:06:39.427 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 111/134 2023-07-21T22:06:39.584 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-4735.gbffe0 112/134 2023-07-21T22:06:39.655 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-4735.gbffe0 112/134 2023-07-21T22:06:39.843 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 113/134 2023-07-21T22:06:40.251 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 113/134 2023-07-21T22:06:40.401 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 114/134 2023-07-21T22:06:41.317 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 114/134 2023-07-21T22:06:41.445 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 114/134 2023-07-21T22:06:41.620 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-test-2:18.0.0-4735.gbffe049d.el8.x86_64 115/134 2023-07-21T22:06:41.794 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-21T22:06:41.804 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:18.0.0-4735.gbffe049d.el8.x86_64 115/134 2023-07-21T22:06:42.001 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-21T22:06:42.043 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-21T22:06:42.253 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-21T22:06:43.279 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-21T22:06:43.531 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-21T22:06:43.596 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-21T22:06:43.808 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : ceph-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 119/134 2023-07-21T22:06:43.891 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-21T22:06:44.024 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-21T22:06:44.157 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 119/134 2023-07-21T22:06:44.199 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libcephfs-devel-2:18.0.0-4735.gbffe049d.el8.x86_ 121/134 2023-07-21T22:06:44.373 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-21T22:06:44.386 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-21T22:06:44.590 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:18.0.0-4735.gbffe049d.el8.x86_ 121/134 2023-07-21T22:06:44.727 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-21T22:06:45.370 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 114/134 2023-07-21T22:06:45.705 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:18.0.0-4735.gbffe049d.el8.x86_64 115/134 2023-07-21T22:06:45.925 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-25.el8.x86_64 116/134 2023-07-21T22:06:46.180 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 116/134 2023-07-21T22:06:47.458 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 117/134 2023-07-21T22:06:47.674 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T22:06:47.806 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 118/134 2023-07-21T22:06:47.944 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T22:06:47.982 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T22:06:48.014 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 119/134 2023-07-21T22:06:48.058 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T22:06:48.255 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-21T22:06:48.311 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : cephfs-top-2:18.0.0-4735.gbffe049d.el8.noarch 124/134 2023-07-21T22:06:48.351 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T22:06:48.391 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T22:06:48.447 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:18.0.0-4735.gbffe049d.el8.x86_ 121/134 2023-07-21T22:06:48.528 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 125/134 2023-07-21T22:06:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:18.0.0-4735.gbffe049d.el8.noarch 124/134 2023-07-21T22:06:48.642 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-21T22:06:48.870 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : rbd-nbd-2:18.0.0-4735.gbffe049d.el8.x86_64 126/134 2023-07-21T22:06:48.886 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 125/134 2023-07-21T22:06:49.154 INFO:teuthology.orchestra.run.smithi195.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-21T22:06:49.230 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:18.0.0-4735.gbffe049d.el8.x86_64 126/134 2023-07-21T22:06:49.368 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T22:06:49.391 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T22:06:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-21T22:06:49.615 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-21T22:06:49.767 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T22:06:49.790 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T22:06:49.826 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-21T22:06:49.934 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-21T22:06:50.048 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-21T22:06:50.135 INFO:teuthology.orchestra.run.smithi195.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-21T22:06:50.164 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-21T22:06:50.164 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T22:06:50.242 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-21T22:06:50.353 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-21T22:06:50.399 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T22:06:50.399 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T22:06:50.592 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-21T22:06:50.621 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-21T22:06:50.621 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T22:06:50.660 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T22:06:50.857 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T22:06:50.857 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T22:06:50.909 INFO:teuthology.orchestra.run.smithi195.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T22:06:51.107 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T22:06:51.169 INFO:teuthology.orchestra.run.smithi195.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T22:06:51.169 INFO:teuthology.orchestra.run.smithi195.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-21T22:06:51.169 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:06:51.358 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T22:06:51.607 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T22:06:51.607 INFO:teuthology.orchestra.run.smithi151.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-21T22:06:51.607 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:06:51.812 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-2:18.0.0-4735.gbffe049d.el8.x86_64 1/134 2023-07-21T22:06:51.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 2/134 2023-07-21T22:06:51.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 3/134 2023-07-21T22:06:51.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 4/134 2023-07-21T22:06:51.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4735.gbffe0 5/134 2023-07-21T22:06:51.813 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 6/134 2023-07-21T22:06:51.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 7/134 2023-07-21T22:06:51.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 8/134 2023-07-21T22:06:51.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 9/134 2023-07-21T22:06:51.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 10/134 2023-07-21T22:06:51.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 11/134 2023-07-21T22:06:51.814 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-test-2:18.0.0-4735.gbffe049d.el8.x86_64 12/134 2023-07-21T22:06:51.815 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 13/134 2023-07-21T22:06:51.815 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs-devel-2:18.0.0-4735.gbffe049d.el8.x86_ 14/134 2023-07-21T22:06:51.815 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 15/134 2023-07-21T22:06:51.815 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 16/134 2023-07-21T22:06:51.815 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados-devel-2:18.0.0-4735.gbffe049d.el8.x86_6 17/134 2023-07-21T22:06:51.815 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86 18/134 2023-07-21T22:06:51.815 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 19/134 2023-07-21T22:06:51.816 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4735.gbffe049d.el 20/134 2023-07-21T22:06:51.816 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-ceph-common-2:18.0.0-4735.gbffe049d.el8. 21/134 2023-07-21T22:06:51.816 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cephfs-2:18.0.0-4735.gbffe049d.el8.x86_6 22/134 2023-07-21T22:06:51.816 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rados-2:18.0.0-4735.gbffe049d.el8.x86_64 23/134 2023-07-21T22:06:51.816 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rbd-2:18.0.0-4735.gbffe049d.el8.x86_64 24/134 2023-07-21T22:06:51.816 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rgw-2:18.0.0-4735.gbffe049d.el8.x86_64 25/134 2023-07-21T22:06:51.825 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 26/134 2023-07-21T22:06:51.825 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 27/134 2023-07-21T22:06:51.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : rbd-nbd-2:18.0.0-4735.gbffe049d.el8.x86_64 28/134 2023-07-21T22:06:51.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4735.gbffe049d. 29/134 2023-07-21T22:06:51.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noa 30/134 2023-07-21T22:06:51.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.n 31/134 2023-07-21T22:06:51.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4735.gbff 32/134 2023-07-21T22:06:51.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4735.gbffe049d.el 33/134 2023-07-21T22:06:51.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 34/134 2023-07-21T22:06:51.826 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4735.gbffe049d.e 35/134 2023-07-21T22:06:51.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 36/134 2023-07-21T22:06:51.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 37/134 2023-07-21T22:06:51.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : cephfs-top-2:18.0.0-4735.gbffe049d.el8.noarch 38/134 2023-07-21T22:06:51.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-21T22:06:51.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-21T22:06:51.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-21T22:06:51.827 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-21T22:06:51.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-21T22:06:51.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-21T22:06:51.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-21T22:06:51.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-21T22:06:51.828 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-21T22:06:51.829 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-21T22:06:51.829 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-21T22:06:51.829 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-21T22:06:51.829 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-21T22:06:51.830 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-21T22:06:51.830 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-21T22:06:51.830 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-21T22:06:51.831 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-21T22:06:51.831 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-21T22:06:51.831 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-21T22:06:51.831 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-21T22:06:51.832 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-21T22:06:51.832 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-21T22:06:51.832 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-21T22:06:51.833 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-21T22:06:51.833 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-21T22:06:51.833 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-21T22:06:51.833 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-21T22:06:51.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-21T22:06:51.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-21T22:06:51.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-21T22:06:51.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-21T22:06:51.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-21T22:06:51.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-21T22:06:51.834 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-21T22:06:51.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-21T22:06:51.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-21T22:06:51.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-21T22:06:51.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-21T22:06:51.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-21T22:06:51.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-21T22:06:51.835 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-21T22:06:51.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-21T22:06:51.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-21T22:06:51.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-21T22:06:51.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-21T22:06:51.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-21T22:06:51.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-21T22:06:51.836 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-21T22:06:51.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-21T22:06:51.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-21T22:06:51.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-21T22:06:51.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-21T22:06:51.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-21T22:06:51.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-21T22:06:51.837 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-21T22:06:51.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-21T22:06:51.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-21T22:06:51.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-21T22:06:51.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-21T22:06:51.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-21T22:06:51.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-21T22:06:51.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-21T22:06:51.838 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-21T22:06:51.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-21T22:06:51.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-21T22:06:51.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-21T22:06:51.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-21T22:06:51.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-21T22:06:51.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-21T22:06:51.839 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-21T22:06:51.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-21T22:06:51.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-21T22:06:51.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-21T22:06:51.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-21T22:06:51.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-21T22:06:51.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-21T22:06:51.840 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-21T22:06:51.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-21T22:06:51.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-21T22:06:51.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-21T22:06:51.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-21T22:06:51.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-21T22:06:51.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-21T22:06:51.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-21T22:06:51.841 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-21T22:06:51.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-21T22:06:51.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-21T22:06:51.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-21T22:06:51.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-21T22:06:51.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T22:06:51.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 129/134 2023-07-21T22:06:51.842 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-21T22:06:51.843 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 131/134 2023-07-21T22:06:51.843 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T22:06:51.843 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-21T22:06:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T22:06:52.237 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T22:06:52.243 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:18.0.0-4735.gbffe049d.el8.x86_64 1/134 2023-07-21T22:06:52.244 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 2/134 2023-07-21T22:06:52.244 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 3/134 2023-07-21T22:06:52.244 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 4/134 2023-07-21T22:06:52.244 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4735.gbffe0 5/134 2023-07-21T22:06:52.244 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 6/134 2023-07-21T22:06:52.244 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 7/134 2023-07-21T22:06:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 8/134 2023-07-21T22:06:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 9/134 2023-07-21T22:06:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 10/134 2023-07-21T22:06:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 11/134 2023-07-21T22:06:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:18.0.0-4735.gbffe049d.el8.x86_64 12/134 2023-07-21T22:06:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 13/134 2023-07-21T22:06:52.245 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:18.0.0-4735.gbffe049d.el8.x86_ 14/134 2023-07-21T22:06:52.246 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 15/134 2023-07-21T22:06:52.246 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 16/134 2023-07-21T22:06:52.246 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:18.0.0-4735.gbffe049d.el8.x86_6 17/134 2023-07-21T22:06:52.246 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86 18/134 2023-07-21T22:06:52.246 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 19/134 2023-07-21T22:06:52.246 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4735.gbffe049d.el 20/134 2023-07-21T22:06:52.246 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:18.0.0-4735.gbffe049d.el8. 21/134 2023-07-21T22:06:52.246 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:18.0.0-4735.gbffe049d.el8.x86_6 22/134 2023-07-21T22:06:52.247 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:18.0.0-4735.gbffe049d.el8.x86_64 23/134 2023-07-21T22:06:52.247 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:18.0.0-4735.gbffe049d.el8.x86_64 24/134 2023-07-21T22:06:52.247 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:18.0.0-4735.gbffe049d.el8.x86_64 25/134 2023-07-21T22:06:52.247 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 26/134 2023-07-21T22:06:52.247 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 27/134 2023-07-21T22:06:52.247 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:18.0.0-4735.gbffe049d.el8.x86_64 28/134 2023-07-21T22:06:52.247 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4735.gbffe049d. 29/134 2023-07-21T22:06:52.247 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noa 30/134 2023-07-21T22:06:52.248 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.n 31/134 2023-07-21T22:06:52.248 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4735.gbff 32/134 2023-07-21T22:06:52.248 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4735.gbffe049d.el 33/134 2023-07-21T22:06:52.248 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 34/134 2023-07-21T22:06:52.248 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4735.gbffe049d.e 35/134 2023-07-21T22:06:52.248 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 36/134 2023-07-21T22:06:52.248 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 37/134 2023-07-21T22:06:52.249 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:18.0.0-4735.gbffe049d.el8.noarch 38/134 2023-07-21T22:06:52.249 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-21T22:06:52.249 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-21T22:06:52.249 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-21T22:06:52.249 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-21T22:06:52.250 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-21T22:06:52.250 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-21T22:06:52.250 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-21T22:06:52.250 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-21T22:06:52.250 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-21T22:06:52.250 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-21T22:06:52.250 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-21T22:06:52.251 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-21T22:06:52.251 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-21T22:06:52.251 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-21T22:06:52.251 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-21T22:06:52.251 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-21T22:06:52.251 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-21T22:06:52.251 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-21T22:06:52.252 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-21T22:06:52.252 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-21T22:06:52.252 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-21T22:06:52.252 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-21T22:06:52.252 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-21T22:06:52.252 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-21T22:06:52.252 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-21T22:06:52.252 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-21T22:06:52.253 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-21T22:06:52.253 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-21T22:06:52.253 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-21T22:06:52.253 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-21T22:06:52.254 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-21T22:06:52.254 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-21T22:06:52.254 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-21T22:06:52.254 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-21T22:06:52.255 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-21T22:06:52.255 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-21T22:06:52.255 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-21T22:06:52.256 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-21T22:06:52.256 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-21T22:06:52.256 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-21T22:06:52.256 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-21T22:06:52.257 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-21T22:06:52.257 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-21T22:06:52.257 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-21T22:06:52.258 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-21T22:06:52.258 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-21T22:06:52.258 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-21T22:06:52.259 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-21T22:06:52.259 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-21T22:06:52.259 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-21T22:06:52.259 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-21T22:06:52.260 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-21T22:06:52.260 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-21T22:06:52.260 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-21T22:06:52.261 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-21T22:06:52.261 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-21T22:06:52.261 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-21T22:06:52.261 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-21T22:06:52.261 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-21T22:06:52.262 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-21T22:06:52.262 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-21T22:06:52.262 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-21T22:06:52.262 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-21T22:06:52.263 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-21T22:06:52.263 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-21T22:06:52.263 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-21T22:06:52.264 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-21T22:06:52.264 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-21T22:06:52.264 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-21T22:06:52.264 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-21T22:06:52.264 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-21T22:06:52.264 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-21T22:06:52.265 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-21T22:06:52.265 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-21T22:06:52.265 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-21T22:06:52.265 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-21T22:06:52.265 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-21T22:06:52.265 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-21T22:06:52.265 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-21T22:06:52.266 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-21T22:06:52.266 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-21T22:06:52.266 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-21T22:06:52.266 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-21T22:06:52.266 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-21T22:06:52.266 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-21T22:06:52.266 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-21T22:06:52.266 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-21T22:06:52.267 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-21T22:06:52.267 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-21T22:06:52.267 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T22:06:52.267 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 129/134 2023-07-21T22:06:52.267 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-21T22:06:52.267 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 131/134 2023-07-21T22:06:52.268 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T22:06:52.268 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-21T22:06:52.274 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-10.21-2.module+el8.6.0+15342+5 123/134 2023-07-21T22:06:52.550 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-top-2:18.0.0-4735.gbffe049d.el8.noarch 124/134 2023-07-21T22:06:52.751 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 125/134 2023-07-21T22:06:53.126 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:18.0.0-4735.gbffe049d.el8.x86_64 126/134 2023-07-21T22:06:53.459 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : iproute-5.15.0-4.el8_6.1.x86_64 127/134 2023-07-21T22:06:53.674 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T22:06:53.697 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T22:06:53.917 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 129/134 2023-07-21T22:06:54.140 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.1-9.el8.x86_64 130/134 2023-07-21T22:06:54.257 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 130/134 2023-07-21T22:06:54.498 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/134 2023-07-21T22:06:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/134 2023-07-21T22:06:54.528 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T22:06:54.543 INFO:teuthology.orchestra.run.smithi195.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T22:06:54.543 INFO:teuthology.orchestra.run.smithi195.stdout:Last metadata expiration check: 0:02:27 ago on Fri 21 Jul 2023 10:04:27 PM UTC. 2023-07-21T22:06:54.738 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T22:06:54.739 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T22:06:54.988 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T22:06:54.988 INFO:teuthology.orchestra.run.smithi151.stdout:Last metadata expiration check: 0:02:18 ago on Fri 21 Jul 2023 10:04:36 PM UTC. 2023-07-21T22:06:55.039 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 133/134 2023-07-21T22:06:55.357 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T22:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T22:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-07-21T22:06:55.611 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:06:56.235 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:18.0.0-4735.gbffe049d.el8.x86_64 1/134 2023-07-21T22:06:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 2/134 2023-07-21T22:06:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 3/134 2023-07-21T22:06:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 4/134 2023-07-21T22:06:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-4735.gbffe0 5/134 2023-07-21T22:06:56.236 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 6/134 2023-07-21T22:06:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 7/134 2023-07-21T22:06:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 8/134 2023-07-21T22:06:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 9/134 2023-07-21T22:06:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 10/134 2023-07-21T22:06:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 11/134 2023-07-21T22:06:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:18.0.0-4735.gbffe049d.el8.x86_64 12/134 2023-07-21T22:06:56.237 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 13/134 2023-07-21T22:06:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:18.0.0-4735.gbffe049d.el8.x86_ 14/134 2023-07-21T22:06:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 15/134 2023-07-21T22:06:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 16/134 2023-07-21T22:06:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:18.0.0-4735.gbffe049d.el8.x86_6 17/134 2023-07-21T22:06:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86 18/134 2023-07-21T22:06:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 19/134 2023-07-21T22:06:56.238 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:18.0.0-4735.gbffe049d.el 20/134 2023-07-21T22:06:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:18.0.0-4735.gbffe049d.el8. 21/134 2023-07-21T22:06:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:18.0.0-4735.gbffe049d.el8.x86_6 22/134 2023-07-21T22:06:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:18.0.0-4735.gbffe049d.el8.x86_64 23/134 2023-07-21T22:06:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:18.0.0-4735.gbffe049d.el8.x86_64 24/134 2023-07-21T22:06:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:18.0.0-4735.gbffe049d.el8.x86_64 25/134 2023-07-21T22:06:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 26/134 2023-07-21T22:06:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 27/134 2023-07-21T22:06:56.239 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:18.0.0-4735.gbffe049d.el8.x86_64 28/134 2023-07-21T22:06:56.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-4735.gbffe049d. 29/134 2023-07-21T22:06:56.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noa 30/134 2023-07-21T22:06:56.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.n 31/134 2023-07-21T22:06:56.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-4735.gbff 32/134 2023-07-21T22:06:56.249 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-4735.gbffe049d.el 33/134 2023-07-21T22:06:56.250 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 34/134 2023-07-21T22:06:56.250 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-4735.gbffe049d.e 35/134 2023-07-21T22:06:56.250 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 36/134 2023-07-21T22:06:56.250 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 37/134 2023-07-21T22:06:56.250 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-top-2:18.0.0-4735.gbffe049d.el8.noarch 38/134 2023-07-21T22:06:56.250 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/134 2023-07-21T22:06:56.250 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/134 2023-07-21T22:06:56.251 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/134 2023-07-21T22:06:56.251 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/134 2023-07-21T22:06:56.251 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/134 2023-07-21T22:06:56.251 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/134 2023-07-21T22:06:56.252 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/134 2023-07-21T22:06:56.252 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/134 2023-07-21T22:06:56.252 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/134 2023-07-21T22:06:56.252 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/134 2023-07-21T22:06:56.252 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/134 2023-07-21T22:06:56.253 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/134 2023-07-21T22:06:56.253 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/134 2023-07-21T22:06:56.253 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/134 2023-07-21T22:06:56.253 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/134 2023-07-21T22:06:56.253 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/134 2023-07-21T22:06:56.254 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/134 2023-07-21T22:06:56.254 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/134 2023-07-21T22:06:56.254 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/134 2023-07-21T22:06:56.254 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/134 2023-07-21T22:06:56.254 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/134 2023-07-21T22:06:56.254 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.8-1.el8.noarch 60/134 2023-07-21T22:06:56.254 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/134 2023-07-21T22:06:56.255 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/134 2023-07-21T22:06:56.255 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/134 2023-07-21T22:06:56.255 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/134 2023-07-21T22:06:56.255 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/134 2023-07-21T22:06:56.255 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/134 2023-07-21T22:06:56.255 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/134 2023-07-21T22:06:56.256 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/134 2023-07-21T22:06:56.256 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/134 2023-07-21T22:06:56.256 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/134 2023-07-21T22:06:56.256 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/134 2023-07-21T22:06:56.256 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 72/134 2023-07-21T22:06:56.256 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 73/134 2023-07-21T22:06:56.256 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 74/134 2023-07-21T22:06:56.257 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 75/134 2023-07-21T22:06:56.257 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 76/134 2023-07-21T22:06:56.257 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 77/134 2023-07-21T22:06:56.257 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.0.4-10.el8.x86_64 78/134 2023-07-21T22:06:56.258 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 79/134 2023-07-21T22:06:56.258 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 80/134 2023-07-21T22:06:56.258 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 81/134 2023-07-21T22:06:56.258 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.1-7.el8.noarch 82/134 2023-07-21T22:06:56.259 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 83/134 2023-07-21T22:06:56.259 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 84/134 2023-07-21T22:06:56.259 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.1-9.el8.x86_64 85/134 2023-07-21T22:06:56.259 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 86/134 2023-07-21T22:06:56.260 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 87/134 2023-07-21T22:06:56.260 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 88/134 2023-07-21T22:06:56.260 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 89/134 2023-07-21T22:06:56.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : uuid-1.6.2-43.el8.x86_64 90/134 2023-07-21T22:06:56.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 91/134 2023-07-21T22:06:56.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 92/134 2023-07-21T22:06:56.261 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 93/134 2023-07-21T22:06:56.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 94/134 2023-07-21T22:06:56.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 95/134 2023-07-21T22:06:56.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpq-13.5-1.el8.x86_64 96/134 2023-07-21T22:06:56.262 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 97/134 2023-07-21T22:06:56.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : jq-1.6-3.el8.x86_64 98/134 2023-07-21T22:06:56.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 99/134 2023-07-21T22:06:56.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-server-10.21-2.module+el8.6.0+15342+5 100/134 2023-07-21T22:06:56.263 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-contrib-10.21-2.module+el8.6.0+15342+ 101/134 2023-07-21T22:06:56.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-10.21-2.module+el8.6.0+15342+53518fac 102/134 2023-07-21T22:06:56.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 103/134 2023-07-21T22:06:56.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 104/134 2023-07-21T22:06:56.264 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 105/134 2023-07-21T22:06:56.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 106/134 2023-07-21T22:06:56.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 107/134 2023-07-21T22:06:56.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 108/134 2023-07-21T22:06:56.265 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 109/134 2023-07-21T22:06:56.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 110/134 2023-07-21T22:06:56.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 111/134 2023-07-21T22:06:56.266 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 112/134 2023-07-21T22:06:56.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 113/134 2023-07-21T22:06:56.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 114/134 2023-07-21T22:06:56.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 115/134 2023-07-21T22:06:56.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 116/134 2023-07-21T22:06:56.267 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 117/134 2023-07-21T22:06:56.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 118/134 2023-07-21T22:06:56.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 119/134 2023-07-21T22:06:56.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 120/134 2023-07-21T22:06:56.268 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 121/134 2023-07-21T22:06:56.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 122/134 2023-07-21T22:06:56.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 123/134 2023-07-21T22:06:56.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 124/134 2023-07-21T22:06:56.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 125/134 2023-07-21T22:06:56.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 126/134 2023-07-21T22:06:56.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 127/134 2023-07-21T22:06:56.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-initscripts-updown-1:1.36.0-9.el8 128/134 2023-07-21T22:06:56.269 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 129/134 2023-07-21T22:06:56.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 130/134 2023-07-21T22:06:56.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 131/134 2023-07-21T22:06:56.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 132/134 2023-07-21T22:06:56.270 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : iproute-5.15.0-4.el8_6.1.x86_64 133/134 2023-07-21T22:06:57.751 INFO:teuthology.orchestra.run.smithi195.stdout:Installed products updated. 2023-07-21T22:06:57.990 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:06:57.990 INFO:teuthology.orchestra.run.smithi195.stdout:Upgraded: 2023-07-21T22:06:57.991 INFO:teuthology.orchestra.run.smithi195.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-21T22:06:57.991 INFO:teuthology.orchestra.run.smithi195.stdout: librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.991 INFO:teuthology.orchestra.run.smithi195.stdout: librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.991 INFO:teuthology.orchestra.run.smithi195.stdout:Installed: 2023-07-21T22:06:57.991 INFO:teuthology.orchestra.run.smithi195.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-21T22:06:57.991 INFO:teuthology.orchestra.run.smithi195.stdout: automake-1.16.1-7.el8.noarch 2023-07-21T22:06:57.991 INFO:teuthology.orchestra.run.smithi195.stdout: bison-3.0.4-10.el8.x86_64 2023-07-21T22:06:57.992 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.992 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.992 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.992 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.992 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-grafana-dashboards-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.992 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-immutable-object-cache-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.993 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.993 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.993 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.993 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.993 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.994 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-modules-core-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.994 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.994 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.994 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.995 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-prometheus-alerts-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.995 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.995 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.996 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-test-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.996 INFO:teuthology.orchestra.run.smithi195.stdout: ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.996 INFO:teuthology.orchestra.run.smithi195.stdout: cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.996 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:57.997 INFO:teuthology.orchestra.run.smithi195.stdout: cephfs-top-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:57.997 INFO:teuthology.orchestra.run.smithi195.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-21T22:06:57.997 INFO:teuthology.orchestra.run.smithi195.stdout: flex-2.6.1-9.el8.x86_64 2023-07-21T22:06:57.998 INFO:teuthology.orchestra.run.smithi195.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-21T22:06:57.998 INFO:teuthology.orchestra.run.smithi195.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-21T22:06:57.998 INFO:teuthology.orchestra.run.smithi195.stdout: jq-1.6-3.el8.x86_64 2023-07-21T22:06:57.999 INFO:teuthology.orchestra.run.smithi195.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-21T22:06:57.999 INFO:teuthology.orchestra.run.smithi195.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-21T22:06:57.999 INFO:teuthology.orchestra.run.smithi195.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-21T22:06:57.999 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs-devel-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.000 INFO:teuthology.orchestra.run.smithi195.stdout: libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.000 INFO:teuthology.orchestra.run.smithi195.stdout: libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.000 INFO:teuthology.orchestra.run.smithi195.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-21T22:06:58.001 INFO:teuthology.orchestra.run.smithi195.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-21T22:06:58.001 INFO:teuthology.orchestra.run.smithi195.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-21T22:06:58.001 INFO:teuthology.orchestra.run.smithi195.stdout: libpq-13.5-1.el8.x86_64 2023-07-21T22:06:58.001 INFO:teuthology.orchestra.run.smithi195.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-21T22:06:58.001 INFO:teuthology.orchestra.run.smithi195.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-21T22:06:58.002 INFO:teuthology.orchestra.run.smithi195.stdout: librados-devel-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.002 INFO:teuthology.orchestra.run.smithi195.stdout: libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.002 INFO:teuthology.orchestra.run.smithi195.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-21T22:06:58.002 INFO:teuthology.orchestra.run.smithi195.stdout: librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.003 INFO:teuthology.orchestra.run.smithi195.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-21T22:06:58.003 INFO:teuthology.orchestra.run.smithi195.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-21T22:06:58.003 INFO:teuthology.orchestra.run.smithi195.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-21T22:06:58.004 INFO:teuthology.orchestra.run.smithi195.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-21T22:06:58.004 INFO:teuthology.orchestra.run.smithi195.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-21T22:06:58.004 INFO:teuthology.orchestra.run.smithi195.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-21T22:06:58.004 INFO:teuthology.orchestra.run.smithi195.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-21T22:06:58.004 INFO:teuthology.orchestra.run.smithi195.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-21T22:06:58.004 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-21T22:06:58.004 INFO:teuthology.orchestra.run.smithi195.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-21T22:06:58.005 INFO:teuthology.orchestra.run.smithi195.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-21T22:06:58.005 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-21T22:06:58.005 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-21T22:06:58.005 INFO:teuthology.orchestra.run.smithi195.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-21T22:06:58.005 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T22:06:58.005 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T22:06:58.005 INFO:teuthology.orchestra.run.smithi195.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T22:06:58.006 INFO:teuthology.orchestra.run.smithi195.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-21T22:06:58.006 INFO:teuthology.orchestra.run.smithi195.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-21T22:06:58.006 INFO:teuthology.orchestra.run.smithi195.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-21T22:06:58.006 INFO:teuthology.orchestra.run.smithi195.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-21T22:06:58.006 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-21T22:06:58.006 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-argparse-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.006 INFO:teuthology.orchestra.run.smithi195.stdout: python3-ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.006 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cephfs-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.007 INFO:teuthology.orchestra.run.smithi195.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-21T22:06:58.007 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-21T22:06:58.007 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-21T22:06:58.007 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-21T22:06:58.007 INFO:teuthology.orchestra.run.smithi195.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-21T22:06:58.007 INFO:teuthology.orchestra.run.smithi195.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-21T22:06:58.007 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-21T22:06:58.008 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-21T22:06:58.008 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-21T22:06:58.008 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-21T22:06:58.008 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-21T22:06:58.008 INFO:teuthology.orchestra.run.smithi195.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-21T22:06:58.008 INFO:teuthology.orchestra.run.smithi195.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-21T22:06:58.009 INFO:teuthology.orchestra.run.smithi195.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-21T22:06:58.009 INFO:teuthology.orchestra.run.smithi195.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-21T22:06:58.009 INFO:teuthology.orchestra.run.smithi195.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-21T22:06:58.009 INFO:teuthology.orchestra.run.smithi195.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-21T22:06:58.009 INFO:teuthology.orchestra.run.smithi195.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-21T22:06:58.009 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-21T22:06:58.009 INFO:teuthology.orchestra.run.smithi195.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-21T22:06:58.009 INFO:teuthology.orchestra.run.smithi195.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-21T22:06:58.010 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-21T22:06:58.010 INFO:teuthology.orchestra.run.smithi195.stdout: python3-portend-2.6-1.el8.noarch 2023-07-21T22:06:58.010 INFO:teuthology.orchestra.run.smithi195.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-21T22:06:58.010 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-21T22:06:58.010 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-21T22:06:58.011 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-21T22:06:58.011 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-21T22:06:58.011 INFO:teuthology.orchestra.run.smithi195.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-21T22:06:58.011 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rados-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.011 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rbd-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.011 INFO:teuthology.orchestra.run.smithi195.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-21T22:06:58.011 INFO:teuthology.orchestra.run.smithi195.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-21T22:06:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rgw-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-21T22:06:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-21T22:06:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-21T22:06:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-21T22:06:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-21T22:06:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-21T22:06:58.012 INFO:teuthology.orchestra.run.smithi195.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-21T22:06:58.013 INFO:teuthology.orchestra.run.smithi195.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-21T22:06:58.013 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-21T22:06:58.013 INFO:teuthology.orchestra.run.smithi195.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-21T22:06:58.013 INFO:teuthology.orchestra.run.smithi195.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-21T22:06:58.013 INFO:teuthology.orchestra.run.smithi195.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-21T22:06:58.013 INFO:teuthology.orchestra.run.smithi195.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-21T22:06:58.014 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.014 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.014 INFO:teuthology.orchestra.run.smithi195.stdout: rbd-nbd-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.014 INFO:teuthology.orchestra.run.smithi195.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-21T22:06:58.014 INFO:teuthology.orchestra.run.smithi195.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-21T22:06:58.014 INFO:teuthology.orchestra.run.smithi195.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-21T22:06:58.014 INFO:teuthology.orchestra.run.smithi195.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-21T22:06:58.015 INFO:teuthology.orchestra.run.smithi195.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-21T22:06:58.015 INFO:teuthology.orchestra.run.smithi195.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-21T22:06:58.015 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:06:58.015 INFO:teuthology.orchestra.run.smithi195.stdout:Complete! 2023-07-21T22:06:58.147 INFO:teuthology.orchestra.run.smithi151.stdout:Installed products updated. 2023-07-21T22:06:58.379 DEBUG:teuthology.parallel:result is None 2023-07-21T22:06:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:06:58.387 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-07-21T22:06:58.387 INFO:teuthology.orchestra.run.smithi151.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-21T22:06:58.388 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.388 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.388 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-07-21T22:06:58.389 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-21T22:06:58.389 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.1-7.el8.noarch 2023-07-21T22:06:58.389 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.0.4-10.el8.x86_64 2023-07-21T22:06:58.389 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.389 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.389 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.389 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.390 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.390 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.390 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.390 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.390 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.390 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.390 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.390 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.391 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.391 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.391 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.391 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.391 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.391 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.391 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.392 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.392 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.392 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.392 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:06:58.392 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-21T22:06:58.392 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.1-9.el8.x86_64 2023-07-21T22:06:58.392 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-21T22:06:58.393 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-21T22:06:58.393 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-3.el8.x86_64 2023-07-21T22:06:58.393 INFO:teuthology.orchestra.run.smithi151.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-21T22:06:58.393 INFO:teuthology.orchestra.run.smithi151.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-21T22:06:58.393 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-21T22:06:58.393 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.393 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.393 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.394 INFO:teuthology.orchestra.run.smithi151.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-21T22:06:58.394 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-21T22:06:58.394 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-21T22:06:58.394 INFO:teuthology.orchestra.run.smithi151.stdout: libpq-13.5-1.el8.x86_64 2023-07-21T22:06:58.394 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-21T22:06:58.394 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-21T22:06:58.394 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.395 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.395 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-21T22:06:58.395 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.395 INFO:teuthology.orchestra.run.smithi151.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-21T22:06:58.395 INFO:teuthology.orchestra.run.smithi151.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-21T22:06:58.395 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-21T22:06:58.395 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-21T22:06:58.396 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-21T22:06:58.396 INFO:teuthology.orchestra.run.smithi151.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-21T22:06:58.396 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-21T22:06:58.396 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-21T22:06:58.396 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-21T22:06:58.397 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-21T22:06:58.397 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-21T22:06:58.397 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-21T22:06:58.397 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-21T22:06:58.397 INFO:teuthology.orchestra.run.smithi151.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-21T22:06:58.397 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T22:06:58.397 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T22:06:58.397 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T22:06:58.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-21T22:06:58.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-21T22:06:58.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-21T22:06:58.398 INFO:teuthology.orchestra.run.smithi151.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-21T22:06:58.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-21T22:06:58.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.399 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-21T22:06:58.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-21T22:06:58.400 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-21T22:06:58.401 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-21T22:06:58.401 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-21T22:06:58.401 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-21T22:06:58.401 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-21T22:06:58.402 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-21T22:06:58.402 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-21T22:06:58.403 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-21T22:06:58.403 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-21T22:06:58.403 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-21T22:06:58.404 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-21T22:06:58.404 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-21T22:06:58.404 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-21T22:06:58.405 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-21T22:06:58.405 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-21T22:06:58.405 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-21T22:06:58.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-21T22:06:58.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-21T22:06:58.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-21T22:06:58.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-21T22:06:58.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-2.6-1.el8.noarch 2023-07-21T22:06:58.406 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-21T22:06:58.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-21T22:06:58.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-21T22:06:58.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-21T22:06:58.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-21T22:06:58.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-21T22:06:58.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.407 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-21T22:06:58.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-21T22:06:58.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-21T22:06:58.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-21T22:06:58.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-21T22:06:58.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-21T22:06:58.408 INFO:teuthology.orchestra.run.smithi151.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-21T22:06:58.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-21T22:06:58.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-21T22:06:58.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-21T22:06:58.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-21T22:06:58.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-21T22:06:58.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-21T22:06:58.409 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-21T22:06:58.410 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-21T22:06:58.410 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.410 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.410 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:06:58.410 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-21T22:06:58.410 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-21T22:06:58.410 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-21T22:06:58.410 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-21T22:06:58.411 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-21T22:06:58.411 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-21T22:06:58.411 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:06:58.411 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-07-21T22:06:58.727 DEBUG:teuthology.parallel:result is None 2023-07-21T22:06:59.074 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : iproute-5.15.0-4.el8.x86_64 134/134 2023-07-21T22:06:59.075 INFO:teuthology.orchestra.run.smithi187.stdout:Last metadata expiration check: 0:02:22 ago on Fri 21 Jul 2023 10:04:37 PM UTC. 2023-07-21T22:07:02.426 INFO:teuthology.orchestra.run.smithi187.stdout:Installed products updated. 2023-07-21T22:07:02.664 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:07:02.664 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2023-07-21T22:07:02.664 INFO:teuthology.orchestra.run.smithi187.stdout: iproute-5.15.0-4.el8_6.1.x86_64 2023-07-21T22:07:02.664 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.664 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.665 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2023-07-21T22:07:02.665 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-initscripts-updown-1:1.36.0-9.el8_6.noarch 2023-07-21T22:07:02.665 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.1-7.el8.noarch 2023-07-21T22:07:02.665 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.0.4-10.el8.x86_64 2023-07-21T22:07:02.665 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.665 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.665 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.666 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.666 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.666 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.666 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.667 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.667 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.668 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.668 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.669 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.669 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.669 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.669 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.670 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.670 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.670 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.671 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.671 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.671 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.671 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.672 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top-2:18.0.0-4735.gbffe049d.el8.noarch 2023-07-21T22:07:02.672 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-07-21T22:07:02.672 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.1-9.el8.x86_64 2023-07-21T22:07:02.673 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.7-15.el8.x86_64 2023-07-21T22:07:02.673 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-07-21T22:07:02.673 INFO:teuthology.orchestra.run.smithi187.stdout: jq-1.6-3.el8.x86_64 2023-07-21T22:07:02.673 INFO:teuthology.orchestra.run.smithi187.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-07-21T22:07:02.674 INFO:teuthology.orchestra.run.smithi187.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-07-21T22:07:02.674 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-07-21T22:07:02.674 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.675 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.675 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.675 INFO:teuthology.orchestra.run.smithi187.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-07-21T22:07:02.675 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-07-21T22:07:02.676 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.2-3.el8.x86_64 2023-07-21T22:07:02.676 INFO:teuthology.orchestra.run.smithi187.stdout: libpq-13.5-1.el8.x86_64 2023-07-21T22:07:02.676 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-07-21T22:07:02.677 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-07-21T22:07:02.677 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.677 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.678 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-07-21T22:07:02.678 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.678 INFO:teuthology.orchestra.run.smithi187.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-07-21T22:07:02.678 INFO:teuthology.orchestra.run.smithi187.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-07-21T22:07:02.679 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-25.el8.x86_64 2023-07-21T22:07:02.679 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.3.1-3.el8.x86_64 2023-07-21T22:07:02.679 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-07-21T22:07:02.680 INFO:teuthology.orchestra.run.smithi187.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-07-21T22:07:02.680 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-07-21T22:07:02.680 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-07-21T22:07:02.680 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.15-3.el8.x86_64 2023-07-21T22:07:02.680 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-07-21T22:07:02.680 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-07-21T22:07:02.681 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-07-21T22:07:02.681 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-07-21T22:07:02.681 INFO:teuthology.orchestra.run.smithi187.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-07-21T22:07:02.681 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T22:07:02.681 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T22:07:02.681 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server-10.21-2.module+el8.6.0+15342+53518fac.x86_64 2023-07-21T22:07:02.681 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-07-21T22:07:02.681 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.5.1-7.el8.noarch 2023-07-21T22:07:02.682 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-07-21T22:07:02.682 INFO:teuthology.orchestra.run.smithi187.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-07-21T22:07:02.682 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-07-21T22:07:02.682 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.682 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.682 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.682 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-07-21T22:07:02.683 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-07-21T22:07:02.683 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-07-21T22:07:02.683 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-07-21T22:07:02.683 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-07-21T22:07:02.683 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-07-21T22:07:02.683 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-6.2-6.el8.noarch 2023-07-21T22:07:02.683 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-07-21T22:07:02.683 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-07-21T22:07:02.684 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-07-21T22:07:02.684 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-07-21T22:07:02.684 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-07-21T22:07:02.684 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-07-21T22:07:02.684 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-07-21T22:07:02.684 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.0.6-13.el8.noarch 2023-07-21T22:07:02.684 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-07-21T22:07:02.685 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-07-21T22:07:02.685 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-07-21T22:07:02.685 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-07-21T22:07:02.685 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-07-21T22:07:02.685 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-07-21T22:07:02.685 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-07-21T22:07:02.685 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-2.6-1.el8.noarch 2023-07-21T22:07:02.685 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-07-21T22:07:02.686 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-07-21T22:07:02.686 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-07-21T22:07:02.686 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-07-21T22:07:02.686 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.14-14.el8.noarch 2023-07-21T22:07:02.686 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2017.2-9.el8.noarch 2023-07-21T22:07:02.686 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.686 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.687 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-07-21T22:07:02.687 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-07-21T22:07:02.687 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.687 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.4.1-12.el8.noarch 2023-07-21T22:07:02.687 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.8-1.el8.noarch 2023-07-21T22:07:02.687 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-07-21T22:07:02.687 INFO:teuthology.orchestra.run.smithi187.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-07-21T22:07:02.687 INFO:teuthology.orchestra.run.smithi187.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-07-21T22:07:02.688 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-07-21T22:07:02.688 INFO:teuthology.orchestra.run.smithi187.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-07-21T22:07:02.688 INFO:teuthology.orchestra.run.smithi187.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-07-21T22:07:02.688 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-07-21T22:07:02.688 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-07-21T22:07:02.688 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-07-21T22:07:02.688 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-07-21T22:07:02.688 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-07-21T22:07:02.689 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.689 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.689 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:18.0.0-4735.gbffe049d.el8.x86_64 2023-07-21T22:07:02.689 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-1.el8.x86_64 2023-07-21T22:07:02.689 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.13.0-2.el8.x86_64 2023-07-21T22:07:02.689 INFO:teuthology.orchestra.run.smithi187.stdout: uuid-1.6.2-43.el8.x86_64 2023-07-21T22:07:02.689 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-07-21T22:07:02.690 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-07-21T22:07:02.690 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-07-21T22:07:02.690 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-07-21T22:07:02.690 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-07-21T22:07:02.992 DEBUG:teuthology.parallel:result is None 2023-07-21T22:07:02.993 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:07:08.652 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-21T22:07:08.714 INFO:teuthology.orchestra.run.smithi151.stdout:18.0.0-4735.gbffe049d.el8 2023-07-21T22:07:08.715 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4735.gbffe049d.el8 2023-07-21T22:07:08.715 INFO:teuthology.task.install:The correct ceph version 18.0.0-4735.gbffe049d is installed. 2023-07-21T22:07:08.716 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:07:14.392 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-21T22:07:14.451 INFO:teuthology.orchestra.run.smithi187.stdout:18.0.0-4735.gbffe049d.el8 2023-07-21T22:07:14.452 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4735.gbffe049d.el8 2023-07-21T22:07:14.452 INFO:teuthology.task.install:The correct ceph version 18.0.0-4735.gbffe049d is installed. 2023-07-21T22:07:14.453 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:07:17.594 DEBUG:teuthology.orchestra.run.smithi195:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-07-21T22:07:17.654 INFO:teuthology.orchestra.run.smithi195.stdout:18.0.0-4735.gbffe049d.el8 2023-07-21T22:07:17.654 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-4735.gbffe049d.el8 2023-07-21T22:07:17.654 INFO:teuthology.task.install:The correct ceph version 18.0.0-4735.gbffe049d is installed. 2023-07-21T22:07:17.655 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-07-21T22:07:17.655 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:07:17.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T22:07:17.752 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:07:17.752 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T22:07:17.846 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:07:17.847 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-07-21T22:07:17.941 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-07-21T22:07:17.941 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:07:17.941 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T22:07:18.013 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T22:07:18.122 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:07:18.123 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T22:07:18.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T22:07:18.302 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:07:18.303 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/daemon-helper 2023-07-21T22:07:18.375 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-07-21T22:07:18.483 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-07-21T22:07:18.484 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:07:18.484 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T22:07:18.552 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T22:07:18.661 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:07:18.661 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T22:07:18.731 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T22:07:18.840 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:07:18.840 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/adjust-ulimits 2023-07-21T22:07:18.908 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-07-21T22:07:19.015 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-07-21T22:07:19.015 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:07:19.016 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T22:07:19.084 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T22:07:19.192 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:07:19.192 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T22:07:19.266 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T22:07:19.375 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:07:19.376 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/usr/bin/stdin-killer 2023-07-21T22:07:19.444 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-07-21T22:07:19.552 INFO:teuthology.run_tasks:Running task cephadm... 2023-07-21T22:07:19.645 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', 'subvols': {'create': 2}} 2023-07-21T22:07:19.645 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:07:19.657 INFO:tasks.cephadm:Cluster fsid is f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:07:19.658 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2023-07-21T22:07:19.659 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.151', 'mon.b': '172.21.15.187', 'mon.c': '172.21.15.195'} 2023-07-21T22:07:19.659 INFO:tasks.cephadm:First mon is mon.a on smithi151 2023-07-21T22:07:19.659 INFO:tasks.cephadm:First mgr is x 2023-07-21T22:07:19.660 INFO:tasks.cephadm:Normalizing hostnames... 2023-07-21T22:07:19.660 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname $(hostname -s) 2023-07-21T22:07:19.732 DEBUG:teuthology.orchestra.run.smithi187:> sudo hostname $(hostname -s) 2023-07-21T22:07:19.804 DEBUG:teuthology.orchestra.run.smithi195:> sudo hostname $(hostname -s) 2023-07-21T22:07:19.876 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2023-07-21T22:07:19.877 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:07:25.564 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic/71611/', 'root_build_cause': 'SCMTRIGGER', 'version': '18.0.0-4735-gbffe049d', 'node_name': '172.21.2.6+braggi06', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos8,DIST=centos8,MACHINE_SIZE=gigantic', 'package_manager_version': '18.0.0-4735.gbffe049d'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/', 'distro_codename': None, 'modified': '2023-07-21 20:32:06.130547', 'distro_version': '8', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-2023Jul13-base-2', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2023-07-21T22:07:31.165 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-rishabh-2023Jul13-base-2, sha1 bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F8%2Fx86_64&flavor=default&sha1=bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea 2023-07-21T22:07:31.166 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/x86_64/flavors/default/cephadm 2023-07-21T22:07:31.166 DEBUG:teuthology.orchestra.run.smithi151:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-21T22:07:32.999 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-rw-r--. 1 ubuntu ubuntu 663791 Jul 21 22:07 /home/ubuntu/cephtest/cephadm 2023-07-21T22:07:32.999 DEBUG:teuthology.orchestra.run.smithi187:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-21T22:07:34.774 INFO:teuthology.orchestra.run.smithi187.stdout:-rw-rw-r--. 1 ubuntu ubuntu 663791 Jul 21 22:07 /home/ubuntu/cephtest/cephadm 2023-07-21T22:07:34.774 DEBUG:teuthology.orchestra.run.smithi195:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-2023Jul13-base-2/bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/centos/8/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2023-07-21T22:07:36.493 INFO:teuthology.orchestra.run.smithi195.stdout:-rw-rw-r--. 1 ubuntu ubuntu 663791 Jul 21 22:07 /home/ubuntu/cephtest/cephadm 2023-07-21T22:07:36.493 DEBUG:teuthology.orchestra.run.smithi151:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-21T22:07:36.544 DEBUG:teuthology.orchestra.run.smithi187:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-21T22:07:36.595 DEBUG:teuthology.orchestra.run.smithi195:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2023-07-21T22:07:36.662 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea on all hosts... 2023-07-21T22:07:36.662 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea pull 2023-07-21T22:07:36.667 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea pull 2023-07-21T22:07:36.672 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea pull 2023-07-21T22:07:38.118 INFO:teuthology.orchestra.run.smithi195.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea... 2023-07-21T22:07:38.165 INFO:teuthology.orchestra.run.smithi187.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea... 2023-07-21T22:07:38.233 INFO:teuthology.orchestra.run.smithi151.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea... 2023-07-21T22:08:14.658 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-07-21T22:08:14.658 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:08:14.658 INFO:teuthology.orchestra.run.smithi187.stdout: "image_id": "fa7da5dee9716ef7a4d987f3d91e84057b58a2169f3bd7522f9d782cbf91e96c", 2023-07-21T22:08:14.658 INFO:teuthology.orchestra.run.smithi187.stdout: "repo_digests": [ 2023-07-21T22:08:14.659 INFO:teuthology.orchestra.run.smithi187.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e12d2e98545c41acbacae1458e8c994c4b4d7018583b915c7d66098e77144f43" 2023-07-21T22:08:14.659 INFO:teuthology.orchestra.run.smithi187.stdout: ] 2023-07-21T22:08:14.659 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-07-21T22:08:19.438 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:08:19.438 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:08:19.438 INFO:teuthology.orchestra.run.smithi151.stdout: "image_id": "fa7da5dee9716ef7a4d987f3d91e84057b58a2169f3bd7522f9d782cbf91e96c", 2023-07-21T22:08:19.439 INFO:teuthology.orchestra.run.smithi151.stdout: "repo_digests": [ 2023-07-21T22:08:19.439 INFO:teuthology.orchestra.run.smithi151.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e12d2e98545c41acbacae1458e8c994c4b4d7018583b915c7d66098e77144f43" 2023-07-21T22:08:19.439 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T22:08:19.439 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:08:26.472 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-07-21T22:08:26.472 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:08:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "image_id": "fa7da5dee9716ef7a4d987f3d91e84057b58a2169f3bd7522f9d782cbf91e96c", 2023-07-21T22:08:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "repo_digests": [ 2023-07-21T22:08:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:e12d2e98545c41acbacae1458e8c994c4b4d7018583b915c7d66098e77144f43" 2023-07-21T22:08:26.473 INFO:teuthology.orchestra.run.smithi195.stdout: ] 2023-07-21T22:08:26.473 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-07-21T22:08:26.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph 2023-07-21T22:08:26.581 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph 2023-07-21T22:08:26.662 DEBUG:teuthology.orchestra.run.smithi195:> sudo mkdir -p /etc/ceph 2023-07-21T22:08:26.735 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /etc/ceph 2023-07-21T22:08:26.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /etc/ceph 2023-07-21T22:08:26.878 DEBUG:teuthology.orchestra.run.smithi195:> sudo chmod 777 /etc/ceph 2023-07-21T22:08:26.946 INFO:tasks.cephadm:Writing seed config... 2023-07-21T22:08:26.947 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2023-07-21T22:08:26.948 INFO:tasks.cephadm: override: [client] debug client = 20 2023-07-21T22:08:26.948 INFO:tasks.cephadm: override: [client] debug ms = 1 2023-07-21T22:08:26.948 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2023-07-21T22:08:26.948 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2023-07-21T22:08:26.949 INFO:tasks.cephadm: override: [mds] debug mds = 20 2023-07-21T22:08:26.949 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2023-07-21T22:08:26.949 INFO:tasks.cephadm: override: [mds] debug ms = 1 2023-07-21T22:08:26.949 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2023-07-21T22:08:26.949 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2023-07-21T22:08:26.950 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2023-07-21T22:08:26.950 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2023-07-21T22:08:26.950 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2023-07-21T22:08:26.950 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2023-07-21T22:08:26.950 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2023-07-21T22:08:26.951 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2023-07-21T22:08:26.951 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2023-07-21T22:08:26.951 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2023-07-21T22:08:26.951 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2023-07-21T22:08:26.951 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2023-07-21T22:08:26.952 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2023-07-21T22:08:26.952 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2023-07-21T22:08:26.952 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2023-07-21T22:08:26.952 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2023-07-21T22:08:26.952 INFO:tasks.cephadm: override: [mon] debug mon = 20 2023-07-21T22:08:26.953 INFO:tasks.cephadm: override: [mon] debug ms = 1 2023-07-21T22:08:26.953 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2023-07-21T22:08:26.953 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2023-07-21T22:08:26.953 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2023-07-21T22:08:26.953 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2023-07-21T22:08:26.953 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2023-07-21T22:08:26.954 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2023-07-21T22:08:26.954 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2023-07-21T22:08:26.954 INFO:tasks.cephadm: override: [osd] debug ms = 1 2023-07-21T22:08:26.954 INFO:tasks.cephadm: override: [osd] debug osd = 20 2023-07-21T22:08:26.954 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2023-07-21T22:08:26.955 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2023-07-21T22:08:26.955 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2023-07-21T22:08:26.955 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2023-07-21T22:08:26.955 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2023-07-21T22:08:26.955 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2023-07-21T22:08:26.956 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2023-07-21T22:08:26.956 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2023-07-21T22:08:26.956 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2023-07-21T22:08:26.957 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:08:26.958 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2023-07-21T22:08:27.002 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f5fce3a4-2812-11ee-9b34-001a4aab830c [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2023-07-21T22:08:27.002 DEBUG:teuthology.orchestra.run.smithi151:mon.a> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.a.service 2023-07-21T22:08:27.046 DEBUG:teuthology.orchestra.run.smithi151:mgr.x> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.x.service 2023-07-21T22:08:27.090 INFO:tasks.cephadm:Bootstrapping... 2023-07-21T22:08:27.091 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea -v bootstrap --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.151 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2023-07-21T22:08:27.114 INFO:journalctl@ceph.mon.a.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:08:27.159 INFO:journalctl@ceph.mgr.x.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:08:27.314 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-07-21T22:08:27.314 INFO:teuthology.orchestra.run.smithi151.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea', '-v', 'bootstrap', '--fsid', 'f5fce3a4-2812-11ee-9b34-001a4aab830c', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.151', '--skip-admin-label'] 2023-07-21T22:08:27.486 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stdout 4.1.1 2023-07-21T22:08:27.487 INFO:teuthology.orchestra.run.smithi151.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2023-07-21T22:08:27.487 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying podman|docker is present... 2023-07-21T22:08:27.659 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stdout 4.1.1 2023-07-21T22:08:27.659 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying lvm2 is present... 2023-07-21T22:08:27.659 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying time synchronization is in place... 2023-07-21T22:08:27.673 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-07-21T22:08:27.673 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-21T22:08:27.686 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-07-21T22:08:27.687 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout inactive 2023-07-21T22:08:27.700 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout enabled 2023-07-21T22:08:27.713 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout active 2023-07-21T22:08:27.713 INFO:teuthology.orchestra.run.smithi151.stdout:Unit chronyd.service is enabled and running 2023-07-21T22:08:27.714 INFO:teuthology.orchestra.run.smithi151.stdout:Repeating the final host check... 2023-07-21T22:08:27.883 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stdout 4.1.1 2023-07-21T22:08:27.883 INFO:teuthology.orchestra.run.smithi151.stdout:podman (/bin/podman) version 4.1.1 is present 2023-07-21T22:08:27.883 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl is present 2023-07-21T22:08:27.883 INFO:teuthology.orchestra.run.smithi151.stdout:lvcreate is present 2023-07-21T22:08:27.896 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2023-07-21T22:08:27.896 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2023-07-21T22:08:27.909 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2023-07-21T22:08:27.909 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout inactive 2023-07-21T22:08:27.922 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout enabled 2023-07-21T22:08:27.934 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout active 2023-07-21T22:08:27.935 INFO:teuthology.orchestra.run.smithi151.stdout:Unit chronyd.service is enabled and running 2023-07-21T22:08:27.935 INFO:teuthology.orchestra.run.smithi151.stdout:Host looks OK 2023-07-21T22:08:27.935 INFO:teuthology.orchestra.run.smithi151.stdout:Cluster fsid: f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:08:27.936 INFO:teuthology.orchestra.run.smithi151.stdout:Acquiring lock 140084231383528 on /run/cephadm/f5fce3a4-2812-11ee-9b34-001a4aab830c.lock 2023-07-21T22:08:27.936 INFO:teuthology.orchestra.run.smithi151.stdout:Lock 140084231383528 acquired on /run/cephadm/f5fce3a4-2812-11ee-9b34-001a4aab830c.lock 2023-07-21T22:08:27.936 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying IP 172.21.15.151 port 3300 ... 2023-07-21T22:08:27.936 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying IP 172.21.15.151 port 6789 ... 2023-07-21T22:08:27.937 INFO:teuthology.orchestra.run.smithi151.stdout:Base mon IP(s) is [172.21.15.151:3300, 172.21.15.151:6789], mon addrv is [v2:172.21.15.151:3300,v1:172.21.15.151:6789] 2023-07-21T22:08:27.944 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp metric 100 2023-07-21T22:08:27.944 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.151 metric 100 2023-07-21T22:08:27.951 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2023-07-21T22:08:27.951 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2023-07-21T22:08:27.951 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2023-07-21T22:08:27.957 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2023-07-21T22:08:27.957 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2023-07-21T22:08:27.958 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-07-21T22:08:27.958 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2023-07-21T22:08:27.958 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout inet6 fe80::2ec:32d6:a911:8a1a/64 scope link noprefixroute 2023-07-21T22:08:27.958 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2023-07-21T22:08:27.959 INFO:teuthology.orchestra.run.smithi151.stdout:Mon IP `172.21.15.151` is in CIDR network `172.21.0.0/20` 2023-07-21T22:08:27.959 INFO:teuthology.orchestra.run.smithi151.stdout:Mon IP `172.21.15.151` is in CIDR network `172.21.0.0/20` 2023-07-21T22:08:27.959 INFO:teuthology.orchestra.run.smithi151.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2023-07-21T22:08:27.959 INFO:teuthology.orchestra.run.smithi151.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2023-07-21T22:08:27.960 INFO:teuthology.orchestra.run.smithi151.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea... 2023-07-21T22:08:28.434 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stdout fa7da5dee9716ef7a4d987f3d91e84057b58a2169f3bd7522f9d782cbf91e96c 2023-07-21T22:08:28.435 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea... 2023-07-21T22:08:28.435 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stderr Getting image source signatures 2023-07-21T22:08:28.435 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stderr Copying blob sha256:99ee8d5f86f7949582f207d2e584c4024ff3caa1cfdcb812f3da7de6a1ca5e74 2023-07-21T22:08:28.435 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stderr Copying blob sha256:6022c611d474f2b306ddd1edfc8360123ece5266119096f25fde843d7967e636 2023-07-21T22:08:28.435 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stderr Copying config sha256:fa7da5dee9716ef7a4d987f3d91e84057b58a2169f3bd7522f9d782cbf91e96c 2023-07-21T22:08:28.435 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stderr Writing manifest to image destination 2023-07-21T22:08:28.436 INFO:teuthology.orchestra.run.smithi151.stdout:/bin/podman: stderr Storing signatures 2023-07-21T22:08:29.413 INFO:teuthology.orchestra.run.smithi151.stdout:ceph: stdout ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:08:29.413 INFO:teuthology.orchestra.run.smithi151.stdout:Ceph version: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:08:29.414 INFO:teuthology.orchestra.run.smithi151.stdout:Extracting ceph user uid/gid from container image... 2023-07-21T22:08:30.288 INFO:teuthology.orchestra.run.smithi151.stdout:stat: stdout 167 167 2023-07-21T22:08:30.289 INFO:teuthology.orchestra.run.smithi151.stdout:Creating initial keys... 2023-07-21T22:08:31.162 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph-authtool: stdout AQDeAbtk+IKbKBAAOrJlyJdkuPbUOH+vkoj+iQ== 2023-07-21T22:08:32.037 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph-authtool: stdout AQDfAbtkxQgjIhAAGwncmhON8xoZNk20T70L0w== 2023-07-21T22:08:32.909 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph-authtool: stdout AQDgAbtkXrWwGRAAVxxNgSmZuttXypnRvPdbeA== 2023-07-21T22:08:32.910 INFO:teuthology.orchestra.run.smithi151.stdout:Creating initial monmap... 2023-07-21T22:08:33.887 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2023-07-21T22:08:33.887 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = pacific 2023-07-21T22:08:33.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:08:33.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-07-21T22:08:33.888 INFO:teuthology.orchestra.run.smithi151.stdout:monmaptool for a [v2:172.21.15.151:3300,v1:172.21.15.151:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2023-07-21T22:08:33.888 INFO:teuthology.orchestra.run.smithi151.stdout:setting min_mon_release = pacific 2023-07-21T22:08:33.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/monmaptool: set fsid to f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:08:33.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2023-07-21T22:08:33.888 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:08:33.889 INFO:teuthology.orchestra.run.smithi151.stdout:Creating mon... 2023-07-21T22:08:34.764 INFO:teuthology.orchestra.run.smithi151.stdout:create mon.a on 2023-07-21T22:08:35.016 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2023-07-21T22:08:35.220 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2023-07-21T22:08:35.470 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c.target → /etc/systemd/system/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c.target. 2023-07-21T22:08:35.470 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c.target → /etc/systemd/system/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c.target. 2023-07-21T22:08:35.873 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.a 2023-07-21T22:08:35.873 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.a.service: Unit ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.a.service not loaded. 2023-07-21T22:08:36.072 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c.target.wants/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@.service. 2023-07-21T22:08:36.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:36 smithi151 systemd[1]: Starting Ceph mon.a for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:08:36.822 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:36 smithi151 podman[94967]: 2023-07-21T22:08:36.822 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:36 smithi151 bash[94967]: 4ee55dc130b84ffe2f5541237a9af20a914ea1358f2568edc92142dbca8ceeae 2023-07-21T22:08:36.878 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-21T22:08:36.878 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout disabled 2023-07-21T22:08:36.894 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-21T22:08:36.894 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout inactive 2023-07-21T22:08:36.894 INFO:teuthology.orchestra.run.smithi151.stdout:firewalld.service is not enabled 2023-07-21T22:08:36.894 INFO:teuthology.orchestra.run.smithi151.stdout:Not possible to enable service . firewalld.service is not available 2023-07-21T22:08:36.895 INFO:teuthology.orchestra.run.smithi151.stdout:Waiting for mon to start... 2023-07-21T22:08:36.895 INFO:teuthology.orchestra.run.smithi151.stdout:Waiting for mon... 2023-07-21T22:08:37.157 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:36 smithi151 ceph-mon[95007]: mkfs f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:08:37.157 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:36 smithi151 ceph-mon[95007]: mon.a is new leader, mons a in quorum (ranks 0) 2023-07-21T22:08:37.157 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:36 smithi151 systemd[1]: Started Ceph mon.a for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:08:38.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:37 smithi151 ceph-mon[95007]: mon.a is new leader, mons a in quorum (ranks 0) 2023-07-21T22:08:38.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:37 smithi151 ceph-mon[95007]: monmap e1: 1 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0]} removed_ranks: {} 2023-07-21T22:08:38.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:37 smithi151 ceph-mon[95007]: fsmap 2023-07-21T22:08:38.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:37 smithi151 ceph-mon[95007]: osdmap e1: 0 total, 0 up, 0 in 2023-07-21T22:08:38.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:37 smithi151 ceph-mon[95007]: mgrmap e1: no daemons active 2023-07-21T22:08:38.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:37 smithi151 ceph-mon[95007]: from='client.? 172.21.15.151:0/336625235' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2023-07-21T22:08:46.899 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout cluster: 2023-07-21T22:08:46.900 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout id: f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:08:46.900 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2023-07-21T22:08:46.900 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:08:46.901 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout services: 2023-07-21T22:08:46.901 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.690527s) 2023-07-21T22:08:46.901 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2023-07-21T22:08:46.903 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2023-07-21T22:08:46.903 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:08:46.903 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout data: 2023-07-21T22:08:46.903 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2023-07-21T22:08:46.904 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2023-07-21T22:08:46.904 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2023-07-21T22:08:46.904 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout pgs: 2023-07-21T22:08:46.904 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:08:46.904 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.385+0000 7f060146e700 1 Processor -- start 2023-07-21T22:08:46.904 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.385+0000 7f060146e700 1 -- start start 2023-07-21T22:08:46.904 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.385+0000 7f060146e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:46.905 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.385+0000 7f060146e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc07a830 con 0x7f05fc07bdf0 2023-07-21T22:08:46.905 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.386+0000 7f05faffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:46.905 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.386+0000 7f05faffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51410/0 (socket says 172.21.15.151:51410) 2023-07-21T22:08:46.905 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.386+0000 7f05faffd700 1 -- 172.21.15.151:0/3122202229 learned_addr learned my addr 172.21.15.151:0/3122202229 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:46.905 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.387+0000 7f05faffd700 1 -- 172.21.15.151:0/3122202229 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05fc07a970 con 0x7f05fc07bdf0 2023-07-21T22:08:46.905 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.387+0000 7f05faffd700 1 --2- 172.21.15.151:0/3122202229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc07a2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0098a0 tx=0x7f05ec009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0cc8bc746aa40b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:46.905 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.387+0000 7f05f9ffb700 1 -- 172.21.15.151:0/3122202229 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec004160 con 0x7f05fc07bdf0 2023-07-21T22:08:46.906 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.387+0000 7f05f9ffb700 1 -- 172.21.15.151:0/3122202229 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec0042c0 con 0x7f05fc07bdf0 2023-07-21T22:08:46.906 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.387+0000 7f05f9ffb700 1 -- 172.21.15.151:0/3122202229 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec0045a0 con 0x7f05fc07bdf0 2023-07-21T22:08:46.906 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.388+0000 7f060146e700 1 -- 172.21.15.151:0/3122202229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 msgr2=0x7f05fc07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:46.906 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.388+0000 7f060146e700 1 --2- 172.21.15.151:0/3122202229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc07a2f0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f05ec0098a0 tx=0x7f05ec009bb0 comp rx=0 tx=0).stop 2023-07-21T22:08:46.906 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.388+0000 7f060146e700 1 -- 172.21.15.151:0/3122202229 shutdown_connections 2023-07-21T22:08:46.906 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.388+0000 7f060146e700 1 --2- 172.21.15.151:0/3122202229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc07a2f0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:46.906 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.388+0000 7f060146e700 1 -- 172.21.15.151:0/3122202229 >> 172.21.15.151:0/3122202229 conn(0x7f05fc100900 msgr2=0x7f05fc102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:46.906 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.388+0000 7f060146e700 1 -- 172.21.15.151:0/3122202229 shutdown_connections 2023-07-21T22:08:46.907 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.388+0000 7f060146e700 1 -- 172.21.15.151:0/3122202229 wait complete. 2023-07-21T22:08:46.907 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.389+0000 7f060146e700 1 Processor -- start 2023-07-21T22:08:46.909 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.390+0000 7f060146e700 1 -- start start 2023-07-21T22:08:46.909 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.390+0000 7f060146e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc19a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:46.909 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.390+0000 7f060146e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05fc19af20 con 0x7f05fc07bdf0 2023-07-21T22:08:46.909 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.391+0000 7f05faffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc19a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:46.909 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.391+0000 7f05faffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc19a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51422/0 (socket says 172.21.15.151:51422) 2023-07-21T22:08:46.910 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.391+0000 7f05faffd700 1 -- 172.21.15.151:0/336625235 learned_addr learned my addr 172.21.15.151:0/336625235 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:46.910 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.391+0000 7f05faffd700 1 -- 172.21.15.151:0/336625235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05ec009550 con 0x7f05fc07bdf0 2023-07-21T22:08:46.910 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.391+0000 7f05faffd700 1 --2- 172.21.15.151:0/336625235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc19a9e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f05fc07b360 tx=0x7f05ec004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:46.910 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.391+0000 7f05e3fff700 1 -- 172.21.15.151:0/336625235 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec003da0 con 0x7f05fc07bdf0 2023-07-21T22:08:46.910 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.391+0000 7f05e3fff700 1 -- 172.21.15.151:0/336625235 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05ec011630 con 0x7f05fc07bdf0 2023-07-21T22:08:46.910 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.392+0000 7f05e3fff700 1 -- 172.21.15.151:0/336625235 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f05ec011910 con 0x7f05fc07bdf0 2023-07-21T22:08:46.910 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.392+0000 7f060146e700 1 -- 172.21.15.151:0/336625235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05fc19b120 con 0x7f05fc07bdf0 2023-07-21T22:08:46.910 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.392+0000 7f060146e700 1 -- 172.21.15.151:0/336625235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05fc19b540 con 0x7f05fc07bdf0 2023-07-21T22:08:46.911 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.392+0000 7f05e3fff700 1 -- 172.21.15.151:0/336625235 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f05ec01c460 con 0x7f05fc07bdf0 2023-07-21T22:08:46.911 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.392+0000 7f05e3fff700 1 -- 172.21.15.151:0/336625235 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f05ec01a790 con 0x7f05fc07bdf0 2023-07-21T22:08:46.911 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.393+0000 7f060146e700 1 -- 172.21.15.151:0/336625235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05fc194760 con 0x7f05fc07bdf0 2023-07-21T22:08:46.911 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.396+0000 7f05e3fff700 1 -- 172.21.15.151:0/336625235 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f05ec01a950 con 0x7f05fc07bdf0 2023-07-21T22:08:46.911 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.467+0000 7f060146e700 1 -- 172.21.15.151:0/336625235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f05fc02c850 con 0x7f05fc07bdf0 2023-07-21T22:08:46.911 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.468+0000 7f05e3fff700 1 -- 172.21.15.151:0/336625235 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+317 (secure 0 0 0) 0x7f05ec01aaf0 con 0x7f05fc07bdf0 2023-07-21T22:08:46.911 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.469+0000 7f060146e700 1 -- 172.21.15.151:0/336625235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 msgr2=0x7f05fc19a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:46.912 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.469+0000 7f060146e700 1 --2- 172.21.15.151:0/336625235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc19a9e0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f05fc07b360 tx=0x7f05ec004750 comp rx=0 tx=0).stop 2023-07-21T22:08:46.912 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.469+0000 7f060146e700 1 -- 172.21.15.151:0/336625235 shutdown_connections 2023-07-21T22:08:46.912 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.469+0000 7f060146e700 1 --2- 172.21.15.151:0/336625235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05fc07bdf0 0x7f05fc19a9e0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:46.912 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.469+0000 7f060146e700 1 -- 172.21.15.151:0/336625235 >> 172.21.15.151:0/336625235 conn(0x7f05fc100900 msgr2=0x7f05fc102290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:46.912 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.469+0000 7f060146e700 1 -- 172.21.15.151:0/336625235 shutdown_connections 2023-07-21T22:08:46.912 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:37.469+0000 7f060146e700 1 -- 172.21.15.151:0/336625235 wait complete. 2023-07-21T22:08:46.912 INFO:teuthology.orchestra.run.smithi151.stdout:mon is available 2023-07-21T22:08:46.912 INFO:teuthology.orchestra.run.smithi151.stdout:Assimilating anything we can from ceph.conf... 2023-07-21T22:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout [global] 2023-07-21T22:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout fsid = f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.151:3300,v1:172.21.15.151:6789] 2023-07-21T22:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-07-21T22:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-07-21T22:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-07-21T22:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-07-21T22:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout [mgr] 2023-07-21T22:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-07-21T22:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout [osd] 2023-07-21T22:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-07-21T22:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-07-21T22:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-07-21T22:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-07-21T22:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-07-21T22:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.400+0000 7ff34f3d3700 1 Processor -- start 2023-07-21T22:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.400+0000 7ff34f3d3700 1 -- start start 2023-07-21T22:08:47.997 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.400+0000 7ff34f3d3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34807a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.400+0000 7ff34f3d3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34807a850 con 0x7ff34807be10 2023-07-21T22:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.401+0000 7ff34d16f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34807a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.401+0000 7ff34d16f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34807a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58688/0 (socket says 172.21.15.151:58688) 2023-07-21T22:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.401+0000 7ff34d16f700 1 -- 172.21.15.151:0/4265083700 learned_addr learned my addr 172.21.15.151:0/4265083700 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.401+0000 7ff34d16f700 1 -- 172.21.15.151:0/4265083700 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34807a990 con 0x7ff34807be10 2023-07-21T22:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.402+0000 7ff34d16f700 1 --2- 172.21.15.151:0/4265083700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34807a310 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff3440098a0 tx=0x7ff344009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bff269208803759 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.402+0000 7ff33ffff700 1 -- 172.21.15.151:0/4265083700 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff344004160 con 0x7ff34807be10 2023-07-21T22:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.402+0000 7ff33ffff700 1 -- 172.21.15.151:0/4265083700 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3440042c0 con 0x7ff34807be10 2023-07-21T22:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.402+0000 7ff33ffff700 1 -- 172.21.15.151:0/4265083700 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3440045a0 con 0x7ff34807be10 2023-07-21T22:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.402+0000 7ff34f3d3700 1 -- 172.21.15.151:0/4265083700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 msgr2=0x7ff34807a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.402+0000 7ff34f3d3700 1 --2- 172.21.15.151:0/4265083700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34807a310 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff3440098a0 tx=0x7ff344009bb0 comp rx=0 tx=0).stop 2023-07-21T22:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.402+0000 7ff34f3d3700 1 -- 172.21.15.151:0/4265083700 shutdown_connections 2023-07-21T22:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.402+0000 7ff34f3d3700 1 --2- 172.21.15.151:0/4265083700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34807a310 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.402+0000 7ff34f3d3700 1 -- 172.21.15.151:0/4265083700 >> 172.21.15.151:0/4265083700 conn(0x7ff348100900 msgr2=0x7ff348102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.403+0000 7ff34f3d3700 1 -- 172.21.15.151:0/4265083700 shutdown_connections 2023-07-21T22:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.403+0000 7ff34f3d3700 1 -- 172.21.15.151:0/4265083700 wait complete. 2023-07-21T22:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.403+0000 7ff34f3d3700 1 Processor -- start 2023-07-21T22:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.404+0000 7ff34f3d3700 1 -- start start 2023-07-21T22:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.404+0000 7ff34f3d3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.404+0000 7ff34f3d3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34819af10 con 0x7ff34807be10 2023-07-21T22:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.404+0000 7ff34d16f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.404+0000 7ff34d16f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34819a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58698/0 (socket says 172.21.15.151:58698) 2023-07-21T22:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.404+0000 7ff34d16f700 1 -- 172.21.15.151:0/1138293008 learned_addr learned my addr 172.21.15.151:0/1138293008 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.405+0000 7ff34d16f700 1 -- 172.21.15.151:0/1138293008 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff344009550 con 0x7ff34807be10 2023-07-21T22:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.405+0000 7ff34d16f700 1 --2- 172.21.15.151:0/1138293008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34819a9d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff344004000 tx=0x7ff344004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.405+0000 7ff33e7fc700 1 -- 172.21.15.151:0/1138293008 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff344011630 con 0x7ff34807be10 2023-07-21T22:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.405+0000 7ff33e7fc700 1 -- 172.21.15.151:0/1138293008 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344011790 con 0x7ff34807be10 2023-07-21T22:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.405+0000 7ff34f3d3700 1 -- 172.21.15.151:0/1138293008 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff34819b110 con 0x7ff34807be10 2023-07-21T22:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.405+0000 7ff33e7fc700 1 -- 172.21.15.151:0/1138293008 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff344011a30 con 0x7ff34807be10 2023-07-21T22:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.405+0000 7ff34f3d3700 1 -- 172.21.15.151:0/1138293008 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34819b530 con 0x7ff34807be10 2023-07-21T22:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.405+0000 7ff33e7fc700 1 -- 172.21.15.151:0/1138293008 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff344022070 con 0x7ff34807be10 2023-07-21T22:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.406+0000 7ff33e7fc700 1 -- 172.21.15.151:0/1138293008 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff34401c450 con 0x7ff34807be10 2023-07-21T22:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.406+0000 7ff34f3d3700 1 -- 172.21.15.151:0/1138293008 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff348194740 con 0x7ff34807be10 2023-07-21T22:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.409+0000 7ff33e7fc700 1 -- 172.21.15.151:0/1138293008 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7ff34401b450 con 0x7ff34807be10 2023-07-21T22:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.478+0000 7ff34f3d3700 1 -- 172.21.15.151:0/1138293008 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7ff34802ca90 con 0x7ff34807be10 2023-07-21T22:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.483+0000 7ff33e7fc700 1 -- 172.21.15.151:0/1138293008 <== mon.0 v2:172.21.15.151:3300/0 7 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff34401b5f0 con 0x7ff34807be10 2023-07-21T22:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.483+0000 7ff33e7fc700 1 -- 172.21.15.151:0/1138293008 <== mon.0 v2:172.21.15.151:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+431 (secure 0 0 0) 0x7ff344037540 con 0x7ff34807be10 2023-07-21T22:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.484+0000 7ff34f3d3700 1 -- 172.21.15.151:0/1138293008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 msgr2=0x7ff34819a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.484+0000 7ff34f3d3700 1 --2- 172.21.15.151:0/1138293008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34819a9d0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7ff344004000 tx=0x7ff344004750 comp rx=0 tx=0).stop 2023-07-21T22:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.484+0000 7ff34f3d3700 1 -- 172.21.15.151:0/1138293008 shutdown_connections 2023-07-21T22:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.484+0000 7ff34f3d3700 1 --2- 172.21.15.151:0/1138293008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff34807be10 0x7ff34819a9d0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.484+0000 7ff34f3d3700 1 -- 172.21.15.151:0/1138293008 >> 172.21.15.151:0/1138293008 conn(0x7ff348100900 msgr2=0x7ff3481022d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.484+0000 7ff34f3d3700 1 -- 172.21.15.151:0/1138293008 shutdown_connections 2023-07-21T22:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:47.485+0000 7ff34f3d3700 1 -- 172.21.15.151:0/1138293008 wait complete. 2023-07-21T22:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout:Generating new minimal ceph.conf... 2023-07-21T22:08:48.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:47 smithi151 ceph-mon[95007]: from='client.? 172.21.15.151:0/1138293008' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-21T22:08:48.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:47 smithi151 ceph-mon[95007]: from='client.? 172.21.15.151:0/1138293008' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2023-07-21T22:08:48.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:48 smithi151 ceph-mon[95007]: from='client.? 172.21.15.151:0/1573579501' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.481+0000 7f50e14b2700 1 Processor -- start 2023-07-21T22:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.481+0000 7f50e14b2700 1 -- start start 2023-07-21T22:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.482+0000 7f50e14b2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.482+0000 7f50e14b2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc07a870 con 0x7f50dc07be30 2023-07-21T22:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.482+0000 7f50daffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.482+0000 7f50daffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58706/0 (socket says 172.21.15.151:58706) 2023-07-21T22:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.482+0000 7f50daffd700 1 -- 172.21.15.151:0/1818720353 learned_addr learned my addr 172.21.15.151:0/1818720353 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.482+0000 7f50daffd700 1 -- 172.21.15.151:0/1818720353 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc07a9b0 con 0x7f50dc07be30 2023-07-21T22:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.483+0000 7f50daffd700 1 --2- 172.21.15.151:0/1818720353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc07a330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0098a0 tx=0x7f50cc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c75688daea853f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.483+0000 7f50d9ffb700 1 -- 172.21.15.151:0/1818720353 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50cc004160 con 0x7f50dc07be30 2023-07-21T22:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.483+0000 7f50d9ffb700 1 -- 172.21.15.151:0/1818720353 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f50cc0042c0 con 0x7f50dc07be30 2023-07-21T22:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.483+0000 7f50d9ffb700 1 -- 172.21.15.151:0/1818720353 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50cc011940 con 0x7f50dc07be30 2023-07-21T22:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.483+0000 7f50e14b2700 1 -- 172.21.15.151:0/1818720353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 msgr2=0x7f50dc07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.483+0000 7f50e14b2700 1 --2- 172.21.15.151:0/1818720353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc07a330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f50cc0098a0 tx=0x7f50cc009bb0 comp rx=0 tx=0).stop 2023-07-21T22:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.484+0000 7f50e14b2700 1 -- 172.21.15.151:0/1818720353 shutdown_connections 2023-07-21T22:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.484+0000 7f50e14b2700 1 --2- 172.21.15.151:0/1818720353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc07a330 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.484+0000 7f50e14b2700 1 -- 172.21.15.151:0/1818720353 >> 172.21.15.151:0/1818720353 conn(0x7f50dc100900 msgr2=0x7f50dc102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.484+0000 7f50e14b2700 1 -- 172.21.15.151:0/1818720353 shutdown_connections 2023-07-21T22:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.484+0000 7f50e14b2700 1 -- 172.21.15.151:0/1818720353 wait complete. 2023-07-21T22:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.485+0000 7f50e14b2700 1 Processor -- start 2023-07-21T22:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.485+0000 7f50e14b2700 1 -- start start 2023-07-21T22:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.485+0000 7f50e14b2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.485+0000 7f50e14b2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc19b6f0 con 0x7f50dc07be30 2023-07-21T22:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.485+0000 7f50daffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.485+0000 7f50daffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc19b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58710/0 (socket says 172.21.15.151:58710) 2023-07-21T22:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.485+0000 7f50daffd700 1 -- 172.21.15.151:0/1573579501 learned_addr learned my addr 172.21.15.151:0/1573579501 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.486+0000 7f50daffd700 1 -- 172.21.15.151:0/1573579501 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50cc009550 con 0x7f50dc07be30 2023-07-21T22:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.486+0000 7f50daffd700 1 --2- 172.21.15.151:0/1573579501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc19b1b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50cc000c00 tx=0x7f50cc011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.486+0000 7f50c3fff700 1 -- 172.21.15.151:0/1573579501 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50cc0036a0 con 0x7f50dc07be30 2023-07-21T22:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.486+0000 7f50c3fff700 1 -- 172.21.15.151:0/1573579501 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f50cc003c70 con 0x7f50dc07be30 2023-07-21T22:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.486+0000 7f50c3fff700 1 -- 172.21.15.151:0/1573579501 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f50cc0193f0 con 0x7f50dc07be30 2023-07-21T22:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.486+0000 7f50e14b2700 1 -- 172.21.15.151:0/1573579501 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50dc19b8f0 con 0x7f50dc07be30 2023-07-21T22:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.486+0000 7f50e14b2700 1 -- 172.21.15.151:0/1573579501 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50dc19bd10 con 0x7f50dc07be30 2023-07-21T22:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.487+0000 7f50c3fff700 1 -- 172.21.15.151:0/1573579501 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f50cc019920 con 0x7f50dc07be30 2023-07-21T22:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.487+0000 7f50c3fff700 1 -- 172.21.15.151:0/1573579501 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f50cc01a3d0 con 0x7f50dc07be30 2023-07-21T22:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.488+0000 7f50e14b2700 1 -- 172.21.15.151:0/1573579501 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50dc061b40 con 0x7f50dc07be30 2023-07-21T22:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.490+0000 7f50c3fff700 1 -- 172.21.15.151:0/1573579501 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f50cc029060 con 0x7f50dc07be30 2023-07-21T22:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.558+0000 7f50e14b2700 1 -- 172.21.15.151:0/1573579501 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f50dc19e750 con 0x7f50dc07be30 2023-07-21T22:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.558+0000 7f50c3fff700 1 -- 172.21.15.151:0/1573579501 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+177 (secure 0 0 0) 0x7f50cc033090 con 0x7f50dc07be30 2023-07-21T22:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.559+0000 7f50e14b2700 1 -- 172.21.15.151:0/1573579501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 msgr2=0x7f50dc19b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.559+0000 7f50e14b2700 1 --2- 172.21.15.151:0/1573579501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc19b1b0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f50cc000c00 tx=0x7f50cc011e70 comp rx=0 tx=0).stop 2023-07-21T22:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.559+0000 7f50e14b2700 1 -- 172.21.15.151:0/1573579501 shutdown_connections 2023-07-21T22:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.559+0000 7f50e14b2700 1 --2- 172.21.15.151:0/1573579501 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc07be30 0x7f50dc19b1b0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.559+0000 7f50e14b2700 1 -- 172.21.15.151:0/1573579501 >> 172.21.15.151:0/1573579501 conn(0x7f50dc100900 msgr2=0x7f50dc102020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.560+0000 7f50e14b2700 1 -- 172.21.15.151:0/1573579501 shutdown_connections 2023-07-21T22:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:48.560+0000 7f50e14b2700 1 -- 172.21.15.151:0/1573579501 wait complete. 2023-07-21T22:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout:Restarting the monitor... 2023-07-21T22:08:49.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:49 smithi151 systemd[1]: Stopping Ceph mon.a for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:08:49.834 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:49 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[94983]: 2023-07-21T22:08:49.486+0000 7fb752c16700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T22:08:49.834 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:49 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[94983]: 2023-07-21T22:08:49.486+0000 7fb752c16700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-07-21T22:08:50.126 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:49 smithi151 bash[95344]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a 2023-07-21T22:08:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:50 smithi151 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.a.service: Succeeded. 2023-07-21T22:08:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:50 smithi151 systemd[1]: Stopped Ceph mon.a for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:08:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:50 smithi151 systemd[1]: Starting Ceph mon.a for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:08:51.038 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:50 smithi151 podman[95470]: 2023-07-21T22:08:51.039 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:50 smithi151 bash[95470]: 52c531459f3f221f6d4c0db34baa2a6c52a74e3fe42cfab085fcd5b183496acc 2023-07-21T22:08:51.039 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:50 smithi151 ceph-mon[95510]: set uid:gid to 167:167 (ceph:ceph) 2023-07-21T22:08:51.049 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:50 smithi151 ceph-mon[95510]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev), process ceph-mon, pid 7 2023-07-21T22:08:51.049 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:50 smithi151 ceph-mon[95510]: pidfile_write: ignore empty --pid-file 2023-07-21T22:08:51.092 INFO:teuthology.orchestra.run.smithi151.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2023-07-21T22:08:51.352 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: load: jerasure load: lrc 2023-07-21T22:08:51.353 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: RocksDB version: 7.9.2 2023-07-21T22:08:51.353 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Git sha 0 2023-07-21T22:08:51.353 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Compile date 2023-07-21 19:07:44 2023-07-21T22:08:51.353 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: DB SUMMARY 2023-07-21T22:08:51.353 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: DB Session ID: DKM45EHRUBX17GJGC4QY 2023-07-21T22:08:51.353 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: CURRENT file: CURRENT 2023-07-21T22:08:51.353 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: IDENTITY file: IDENTITY 2023-07-21T22:08:51.353 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2023-07-21T22:08:51.354 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2023-07-21T22:08:51.354 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 99763 ; 2023-07-21T22:08:51.354 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.error_if_exists: 0 2023-07-21T22:08:51.354 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.create_if_missing: 0 2023-07-21T22:08:51.354 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.paranoid_checks: 1 2023-07-21T22:08:51.354 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.flush_verify_memtable_count: 1 2023-07-21T22:08:51.354 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-21T22:08:51.355 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-21T22:08:51.355 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.env: 0x55ff5f75d720 2023-07-21T22:08:51.355 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.fs: PosixFileSystem 2023-07-21T22:08:51.355 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.info_log: 0x55ff607f9260 2023-07-21T22:08:51.355 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_file_opening_threads: 16 2023-07-21T22:08:51.355 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.statistics: (nil) 2023-07-21T22:08:51.355 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.use_fsync: 0 2023-07-21T22:08:51.355 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_log_file_size: 0 2023-07-21T22:08:51.356 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-21T22:08:51.356 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.log_file_time_to_roll: 0 2023-07-21T22:08:51.356 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.keep_log_file_num: 1000 2023-07-21T22:08:51.356 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.recycle_log_file_num: 0 2023-07-21T22:08:51.356 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.allow_fallocate: 1 2023-07-21T22:08:51.356 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.allow_mmap_reads: 0 2023-07-21T22:08:51.356 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.allow_mmap_writes: 0 2023-07-21T22:08:51.357 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.use_direct_reads: 0 2023-07-21T22:08:51.357 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-21T22:08:51.357 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.create_missing_column_families: 0 2023-07-21T22:08:51.357 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.db_log_dir: 2023-07-21T22:08:51.357 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.wal_dir: 2023-07-21T22:08:51.357 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.table_cache_numshardbits: 6 2023-07-21T22:08:51.357 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.WAL_ttl_seconds: 0 2023-07-21T22:08:51.357 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.WAL_size_limit_MB: 0 2023-07-21T22:08:51.358 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-21T22:08:51.358 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-21T22:08:51.358 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.is_fd_close_on_exec: 1 2023-07-21T22:08:51.358 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.advise_random_on_open: 1 2023-07-21T22:08:51.358 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.db_write_buffer_size: 0 2023-07-21T22:08:51.358 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.write_buffer_manager: 0x55ff6071a3c0 2023-07-21T22:08:51.358 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-21T22:08:51.358 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-21T22:08:51.359 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.use_adaptive_mutex: 0 2023-07-21T22:08:51.359 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.rate_limiter: (nil) 2023-07-21T22:08:51.359 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-21T22:08:51.359 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.wal_recovery_mode: 2 2023-07-21T22:08:51.359 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.enable_thread_tracking: 0 2023-07-21T22:08:51.359 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.enable_pipelined_write: 0 2023-07-21T22:08:51.359 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.unordered_write: 0 2023-07-21T22:08:51.359 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-21T22:08:51.360 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-21T22:08:51.360 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-21T22:08:51.360 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-21T22:08:51.360 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.row_cache: None 2023-07-21T22:08:51.360 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.wal_filter: None 2023-07-21T22:08:51.360 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-21T22:08:51.360 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.allow_ingest_behind: 0 2023-07-21T22:08:51.360 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.two_write_queues: 0 2023-07-21T22:08:51.361 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.manual_wal_flush: 0 2023-07-21T22:08:51.361 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.wal_compression: 0 2023-07-21T22:08:51.361 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.atomic_flush: 0 2023-07-21T22:08:51.361 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-21T22:08:51.361 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.persist_stats_to_disk: 0 2023-07-21T22:08:51.361 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.write_dbid_to_manifest: 0 2023-07-21T22:08:51.361 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.log_readahead_size: 0 2023-07-21T22:08:51.362 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-21T22:08:51.362 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.best_efforts_recovery: 0 2023-07-21T22:08:51.362 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-21T22:08:51.362 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-21T22:08:51.362 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.allow_data_in_errors: 0 2023-07-21T22:08:51.362 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.db_host_id: __hostname__ 2023-07-21T22:08:51.362 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.enforce_single_del_contracts: true 2023-07-21T22:08:51.362 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_background_jobs: 2 2023-07-21T22:08:51.363 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_background_compactions: -1 2023-07-21T22:08:51.363 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_subcompactions: 1 2023-07-21T22:08:51.363 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-21T22:08:51.363 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-21T22:08:51.363 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.delayed_write_rate : 16777216 2023-07-21T22:08:51.363 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_total_wal_size: 0 2023-07-21T22:08:51.363 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-21T22:08:51.364 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.stats_dump_period_sec: 600 2023-07-21T22:08:51.364 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.stats_persist_period_sec: 600 2023-07-21T22:08:51.364 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-21T22:08:51.364 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_open_files: -1 2023-07-21T22:08:51.364 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bytes_per_sync: 0 2023-07-21T22:08:51.364 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.wal_bytes_per_sync: 0 2023-07-21T22:08:51.364 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.strict_bytes_per_sync: 0 2023-07-21T22:08:51.364 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_readahead_size: 0 2023-07-21T22:08:51.365 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_background_flushes: -1 2023-07-21T22:08:51.365 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Compression algorithms supported: 2023-07-21T22:08:51.365 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-21T22:08:51.365 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: kZSTD supported: 0 2023-07-21T22:08:51.365 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: kXpressCompression supported: 0 2023-07-21T22:08:51.365 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: kLZ4HCCompression supported: 1 2023-07-21T22:08:51.365 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: kZlibCompression supported: 1 2023-07-21T22:08:51.365 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: kSnappyCompression supported: 1 2023-07-21T22:08:51.366 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: kLZ4Compression supported: 1 2023-07-21T22:08:51.366 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: kBZip2Compression supported: 0 2023-07-21T22:08:51.366 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Fast CRC32 supported: Supported on x86 2023-07-21T22:08:51.366 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: DMutex implementation: pthread_mutex_t 2023-07-21T22:08:51.366 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2023-07-21T22:08:51.366 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-21T22:08:51.366 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-21T22:08:51.367 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.merge_operator: 2023-07-21T22:08:51.367 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_filter: None 2023-07-21T22:08:51.367 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_filter_factory: None 2023-07-21T22:08:51.367 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.sst_partitioner_factory: None 2023-07-21T22:08:51.367 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.memtable_factory: SkipListFactory 2023-07-21T22:08:51.367 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.table_factory: BlockBasedTable 2023-07-21T22:08:51.367 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55ff607f9360) 2023-07-21T22:08:51.367 INFO:journalctl@ceph.mon.a.smithi151.stdout: cache_index_and_filter_blocks: 1 2023-07-21T22:08:51.368 INFO:journalctl@ceph.mon.a.smithi151.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-21T22:08:51.368 INFO:journalctl@ceph.mon.a.smithi151.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-21T22:08:51.368 INFO:journalctl@ceph.mon.a.smithi151.stdout: pin_top_level_index_and_filter: 1 2023-07-21T22:08:51.368 INFO:journalctl@ceph.mon.a.smithi151.stdout: index_type: 0 2023-07-21T22:08:51.368 INFO:journalctl@ceph.mon.a.smithi151.stdout: data_block_index_type: 0 2023-07-21T22:08:51.368 INFO:journalctl@ceph.mon.a.smithi151.stdout: index_shortening: 1 2023-07-21T22:08:51.368 INFO:journalctl@ceph.mon.a.smithi151.stdout: data_block_hash_table_util_ratio: 0.750000 2023-07-21T22:08:51.368 INFO:journalctl@ceph.mon.a.smithi151.stdout: checksum: 4 2023-07-21T22:08:51.369 INFO:journalctl@ceph.mon.a.smithi151.stdout: no_block_cache: 0 2023-07-21T22:08:51.369 INFO:journalctl@ceph.mon.a.smithi151.stdout: block_cache: 0x55ff607b91f0 2023-07-21T22:08:51.369 INFO:journalctl@ceph.mon.a.smithi151.stdout: block_cache_name: BinnedLRUCache 2023-07-21T22:08:51.369 INFO:journalctl@ceph.mon.a.smithi151.stdout: block_cache_options: 2023-07-21T22:08:51.369 INFO:journalctl@ceph.mon.a.smithi151.stdout: capacity : 536870912 2023-07-21T22:08:51.369 INFO:journalctl@ceph.mon.a.smithi151.stdout: num_shard_bits : 4 2023-07-21T22:08:51.369 INFO:journalctl@ceph.mon.a.smithi151.stdout: strict_capacity_limit : 0 2023-07-21T22:08:51.369 INFO:journalctl@ceph.mon.a.smithi151.stdout: high_pri_pool_ratio: 0.000 2023-07-21T22:08:51.370 INFO:journalctl@ceph.mon.a.smithi151.stdout: block_cache_compressed: (nil) 2023-07-21T22:08:51.370 INFO:journalctl@ceph.mon.a.smithi151.stdout: persistent_cache: (nil) 2023-07-21T22:08:51.370 INFO:journalctl@ceph.mon.a.smithi151.stdout: block_size: 4096 2023-07-21T22:08:51.370 INFO:journalctl@ceph.mon.a.smithi151.stdout: block_size_deviation: 10 2023-07-21T22:08:51.370 INFO:journalctl@ceph.mon.a.smithi151.stdout: block_restart_interval: 16 2023-07-21T22:08:51.370 INFO:journalctl@ceph.mon.a.smithi151.stdout: index_block_restart_interval: 1 2023-07-21T22:08:51.370 INFO:journalctl@ceph.mon.a.smithi151.stdout: metadata_block_size: 4096 2023-07-21T22:08:51.370 INFO:journalctl@ceph.mon.a.smithi151.stdout: partition_filters: 0 2023-07-21T22:08:51.371 INFO:journalctl@ceph.mon.a.smithi151.stdout: use_delta_encoding: 1 2023-07-21T22:08:51.371 INFO:journalctl@ceph.mon.a.smithi151.stdout: filter_policy: bloomfilter 2023-07-21T22:08:51.371 INFO:journalctl@ceph.mon.a.smithi151.stdout: whole_key_filtering: 1 2023-07-21T22:08:51.371 INFO:journalctl@ceph.mon.a.smithi151.stdout: verify_compression: 0 2023-07-21T22:08:51.371 INFO:journalctl@ceph.mon.a.smithi151.stdout: read_amp_bytes_per_bit: 0 2023-07-21T22:08:51.371 INFO:journalctl@ceph.mon.a.smithi151.stdout: format_version: 5 2023-07-21T22:08:51.371 INFO:journalctl@ceph.mon.a.smithi151.stdout: enable_index_compression: 1 2023-07-21T22:08:51.371 INFO:journalctl@ceph.mon.a.smithi151.stdout: block_align: 0 2023-07-21T22:08:51.372 INFO:journalctl@ceph.mon.a.smithi151.stdout: max_auto_readahead_size: 262144 2023-07-21T22:08:51.372 INFO:journalctl@ceph.mon.a.smithi151.stdout: prepopulate_block_cache: 0 2023-07-21T22:08:51.372 INFO:journalctl@ceph.mon.a.smithi151.stdout: initial_auto_readahead_size: 8192 2023-07-21T22:08:51.372 INFO:journalctl@ceph.mon.a.smithi151.stdout: num_file_reads_for_auto_readahead: 2 2023-07-21T22:08:51.372 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.write_buffer_size: 33554432 2023-07-21T22:08:51.372 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_write_buffer_number: 2 2023-07-21T22:08:51.372 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression: NoCompression 2023-07-21T22:08:51.373 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression: Disabled 2023-07-21T22:08:51.373 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.prefix_extractor: nullptr 2023-07-21T22:08:51.373 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-21T22:08:51.373 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.num_levels: 7 2023-07-21T22:08:51.373 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-21T22:08:51.373 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-21T22:08:51.373 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-21T22:08:51.373 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-21T22:08:51.374 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-21T22:08:51.374 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-21T22:08:51.374 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-21T22:08:51.374 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-21T22:08:51.374 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-21T22:08:51.374 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-21T22:08:51.374 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-21T22:08:51.375 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-21T22:08:51.375 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression_opts.window_bits: -14 2023-07-21T22:08:51.376 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression_opts.level: 32767 2023-07-21T22:08:51.376 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression_opts.strategy: 0 2023-07-21T22:08:51.376 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-21T22:08:51.376 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-21T22:08:51.376 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-21T22:08:51.376 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-21T22:08:51.376 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression_opts.enabled: false 2023-07-21T22:08:51.377 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-21T22:08:51.377 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-21T22:08:51.377 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-21T22:08:51.377 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-21T22:08:51.377 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.target_file_size_base: 67108864 2023-07-21T22:08:51.377 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.target_file_size_multiplier: 1 2023-07-21T22:08:51.377 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-21T22:08:51.377 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-21T22:08:51.378 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-21T22:08:51.378 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-21T22:08:51.378 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-21T22:08:51.378 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-21T22:08:51.378 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-21T22:08:51.378 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-21T22:08:51.378 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-21T22:08:51.378 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-21T22:08:51.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-21T22:08:51.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-21T22:08:51.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-21T22:08:51.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.arena_block_size: 1048576 2023-07-21T22:08:51.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-21T22:08:51.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-21T22:08:51.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.disable_auto_compactions: 0 2023-07-21T22:08:51.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-21T22:08:51.380 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-21T22:08:51.380 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-21T22:08:51.380 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-21T22:08:51.380 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-21T22:08:51.380 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-21T22:08:51.380 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-21T22:08:51.380 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-21T22:08:51.381 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-21T22:08:51.381 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-21T22:08:51.381 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.table_properties_collectors: 2023-07-21T22:08:51.381 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.inplace_update_support: 0 2023-07-21T22:08:51.381 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.inplace_update_num_locks: 10000 2023-07-21T22:08:51.381 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-21T22:08:51.381 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-21T22:08:51.381 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.memtable_huge_page_size: 0 2023-07-21T22:08:51.382 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.bloom_locality: 0 2023-07-21T22:08:51.382 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.max_successive_merges: 0 2023-07-21T22:08:51.382 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.optimize_filters_for_hits: 0 2023-07-21T22:08:51.382 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.paranoid_file_checks: 0 2023-07-21T22:08:51.382 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.force_consistency_checks: 1 2023-07-21T22:08:51.382 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.report_bg_io_stats: 0 2023-07-21T22:08:51.382 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.ttl: 2592000 2023-07-21T22:08:51.382 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.periodic_compaction_seconds: 0 2023-07-21T22:08:51.383 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-21T22:08:51.383 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-21T22:08:51.383 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.enable_blob_files: false 2023-07-21T22:08:51.383 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.min_blob_size: 0 2023-07-21T22:08:51.383 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.blob_file_size: 268435456 2023-07-21T22:08:51.383 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.blob_compression_type: NoCompression 2023-07-21T22:08:51.383 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.enable_blob_garbage_collection: false 2023-07-21T22:08:51.383 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-21T22:08:51.384 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-21T22:08:51.384 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-21T22:08:51.384 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.blob_file_starting_level: 0 2023-07-21T22:08:51.384 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-21T22:08:51.384 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2023-07-21T22:08:51.384 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2023-07-21T22:08:51.384 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 25960338-4f6f-456f-afcf-3404d1ba101f 2023-07-21T22:08:51.385 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689977331007782, "job": 1, "event": "recovery_started", "wal_files": [9]} 2023-07-21T22:08:51.385 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2023-07-21T22:08:51.385 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689977331009612, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 94502, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 332, "table_properties": {"data_size": 92513, "index_size": 271, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13670, "raw_average_key_size": 49, "raw_value_size": 85062, "raw_average_value_size": 309, "num_data_blocks": 11, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689977331, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "25960338-4f6f-456f-afcf-3404d1ba101f", "db_session_id": "DKM45EHRUBX17GJGC4QY", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2023-07-21T22:08:51.385 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689977331009748, "job": 1, "event": "recovery_finished"} 2023-07-21T22:08:51.385 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2023-07-21T22:08:51.385 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-21T22:08:51.385 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55ff60852000 2023-07-21T22:08:51.386 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: DB pointer 0x55ff6083e000 2023-07-21T22:08:51.386 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-21T22:08:51.386 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-21T22:08:51.386 INFO:journalctl@ceph.mon.a.smithi151.stdout: ** DB Stats ** 2023-07-21T22:08:51.386 INFO:journalctl@ceph.mon.a.smithi151.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-21T22:08:51.386 INFO:journalctl@ceph.mon.a.smithi151.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-21T22:08:51.386 INFO:journalctl@ceph.mon.a.smithi151.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-21T22:08:51.386 INFO:journalctl@ceph.mon.a.smithi151.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-21T22:08:51.387 INFO:journalctl@ceph.mon.a.smithi151.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-21T22:08:51.387 INFO:journalctl@ceph.mon.a.smithi151.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-21T22:08:51.387 INFO:journalctl@ceph.mon.a.smithi151.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-21T22:08:51.387 INFO:journalctl@ceph.mon.a.smithi151.stdout: 2023-07-21T22:08:51.387 INFO:journalctl@ceph.mon.a.smithi151.stdout: ** Compaction Stats [default] ** 2023-07-21T22:08:51.387 INFO:journalctl@ceph.mon.a.smithi151.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-21T22:08:51.387 INFO:journalctl@ceph.mon.a.smithi151.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-21T22:08:51.387 INFO:journalctl@ceph.mon.a.smithi151.stdout: L0 2/0 94.12 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:08:51.388 INFO:journalctl@ceph.mon.a.smithi151.stdout: Sum 2/0 94.12 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:08:51.388 INFO:journalctl@ceph.mon.a.smithi151.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:08:51.388 INFO:journalctl@ceph.mon.a.smithi151.stdout: 2023-07-21T22:08:51.388 INFO:journalctl@ceph.mon.a.smithi151.stdout: ** Compaction Stats [default] ** 2023-07-21T22:08:51.388 INFO:journalctl@ceph.mon.a.smithi151.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-21T22:08:51.388 INFO:journalctl@ceph.mon.a.smithi151.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-21T22:08:51.388 INFO:journalctl@ceph.mon.a.smithi151.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 75.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:08:51.388 INFO:journalctl@ceph.mon.a.smithi151.stdout: 2023-07-21T22:08:51.389 INFO:journalctl@ceph.mon.a.smithi151.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-21T22:08:51.389 INFO:journalctl@ceph.mon.a.smithi151.stdout: 2023-07-21T22:08:51.389 INFO:journalctl@ceph.mon.a.smithi151.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-21T22:08:51.389 INFO:journalctl@ceph.mon.a.smithi151.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-07-21T22:08:51.389 INFO:journalctl@ceph.mon.a.smithi151.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-21T22:08:51.389 INFO:journalctl@ceph.mon.a.smithi151.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-07-21T22:08:51.389 INFO:journalctl@ceph.mon.a.smithi151.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-07-21T22:08:51.389 INFO:journalctl@ceph.mon.a.smithi151.stdout: AddFile(Keys): cumulative 0, interval 0 2023-07-21T22:08:51.390 INFO:journalctl@ceph.mon.a.smithi151.stdout: Cumulative compaction: 0.00 GB write, 14.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-21T22:08:51.390 INFO:journalctl@ceph.mon.a.smithi151.stdout: Interval compaction: 0.00 GB write, 14.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-21T22:08:51.390 INFO:journalctl@ceph.mon.a.smithi151.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-21T22:08:51.390 INFO:journalctl@ceph.mon.a.smithi151.stdout: Block cache BinnedLRUCache@0x55ff607b91f0#7 capacity: 512.00 MB usage: 1.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-07-21T22:08:51.390 INFO:journalctl@ceph.mon.a.smithi151.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.89 KB,0.000169873%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2023-07-21T22:08:51.390 INFO:journalctl@ceph.mon.a.smithi151.stdout: 2023-07-21T22:08:51.390 INFO:journalctl@ceph.mon.a.smithi151.stdout: ** File Read Latency Histogram By Level [default] ** 2023-07-21T22:08:51.391 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: starting mon.a rank 0 at public addrs [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] at bind addrs [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:08:51.391 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mon.a@-1(???) e1 preinit fsid f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:08:51.391 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mon.a@-1(???).mds e1 new map 2023-07-21T22:08:51.391 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mon.a@-1(???).mds e1 print_map 2023-07-21T22:08:51.391 INFO:journalctl@ceph.mon.a.smithi151.stdout: e1 2023-07-21T22:08:51.391 INFO:journalctl@ceph.mon.a.smithi151.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-07-21T22:08:51.391 INFO:journalctl@ceph.mon.a.smithi151.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-21T22:08:51.391 INFO:journalctl@ceph.mon.a.smithi151.stdout: legacy client fscid: -1 2023-07-21T22:08:51.392 INFO:journalctl@ceph.mon.a.smithi151.stdout: 2023-07-21T22:08:51.392 INFO:journalctl@ceph.mon.a.smithi151.stdout: No filesystems configured 2023-07-21T22:08:51.392 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-21T22:08:51.392 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-21T22:08:51.392 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-21T22:08:51.392 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2023-07-21T22:08:51.392 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2023-07-21T22:08:51.392 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta expand map: {default=false} 2023-07-21T22:08:51.393 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta from 'false' to 'false' 2023-07-21T22:08:51.393 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta expanded map: {default=false} 2023-07-21T22:08:51.393 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta expand map: {default=info} 2023-07-21T22:08:51.393 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta from 'info' to 'info' 2023-07-21T22:08:51.393 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta expanded map: {default=info} 2023-07-21T22:08:51.393 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta expand map: {default=daemon} 2023-07-21T22:08:51.393 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta from 'daemon' to 'daemon' 2023-07-21T22:08:51.393 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta expanded map: {default=daemon} 2023-07-21T22:08:51.394 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta expand map: {default=debug} 2023-07-21T22:08:51.394 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta from 'debug' to 'debug' 2023-07-21T22:08:51.394 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: expand_channel_meta expanded map: {default=debug} 2023-07-21T22:08:51.394 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 systemd[1]: Started Ceph mon.a for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:08:51.394 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mon.a is new leader, mons a in quorum (ranks 0) 2023-07-21T22:08:51.394 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: monmap e1: 1 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0]} removed_ranks: {} 2023-07-21T22:08:51.394 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: fsmap 2023-07-21T22:08:51.394 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: osdmap e1: 0 total, 0 up, 0 in 2023-07-21T22:08:51.395 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:51 smithi151 ceph-mon[95510]: mgrmap e1: no daemons active 2023-07-21T22:08:52.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.579+0000 7f442ca46700 1 Processor -- start 2023-07-21T22:08:52.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.579+0000 7f442ca46700 1 -- start start 2023-07-21T22:08:52.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.579+0000 7f442ca46700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442807a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:52.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.579+0000 7f442ca46700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442807a870 con 0x7f442807be30 2023-07-21T22:08:52.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.580+0000 7f4426d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442807a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:52.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.580+0000 7f4426d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442807a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58718/0 (socket says 172.21.15.151:58718) 2023-07-21T22:08:52.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.580+0000 7f4426d9d700 1 -- 172.21.15.151:0/574669799 learned_addr learned my addr 172.21.15.151:0/574669799 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:52.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.580+0000 7f4426d9d700 1 -- 172.21.15.151:0/574669799 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f442807a9b0 con 0x7f442807be30 2023-07-21T22:08:52.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.581+0000 7f4426d9d700 1 --2- 172.21.15.151:0/574669799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442807a330 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f44180098a0 tx=0x7f4418009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d140cd8e25ee7c2d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:52.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.581+0000 7f4425d9b700 1 -- 172.21.15.151:0/574669799 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4418004160 con 0x7f442807be30 2023-07-21T22:08:52.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.581+0000 7f4425d9b700 1 -- 172.21.15.151:0/574669799 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f44180042c0 con 0x7f442807be30 2023-07-21T22:08:52.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.581+0000 7f4425d9b700 1 -- 172.21.15.151:0/574669799 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4418011940 con 0x7f442807be30 2023-07-21T22:08:52.176 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.581+0000 7f442ca46700 1 -- 172.21.15.151:0/574669799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 msgr2=0x7f442807a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:52.176 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.581+0000 7f442ca46700 1 --2- 172.21.15.151:0/574669799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442807a330 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f44180098a0 tx=0x7f4418009bb0 comp rx=0 tx=0).stop 2023-07-21T22:08:52.176 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.582+0000 7f442ca46700 1 -- 172.21.15.151:0/574669799 shutdown_connections 2023-07-21T22:08:52.176 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.582+0000 7f442ca46700 1 --2- 172.21.15.151:0/574669799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442807a330 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:52.176 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.582+0000 7f442ca46700 1 -- 172.21.15.151:0/574669799 >> 172.21.15.151:0/574669799 conn(0x7f44281006c0 msgr2=0x7f4428102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:52.176 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.582+0000 7f442ca46700 1 -- 172.21.15.151:0/574669799 shutdown_connections 2023-07-21T22:08:52.176 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.582+0000 7f442ca46700 1 -- 172.21.15.151:0/574669799 wait complete. 2023-07-21T22:08:52.176 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.583+0000 7f442ca46700 1 Processor -- start 2023-07-21T22:08:52.177 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.583+0000 7f442ca46700 1 -- start start 2023-07-21T22:08:52.177 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.583+0000 7f442ca46700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442819af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:52.177 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.583+0000 7f442ca46700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f442819b4b0 con 0x7f442807be30 2023-07-21T22:08:52.177 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.583+0000 7f4426d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442819af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:52.179 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.584+0000 7f4426d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442819af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58720/0 (socket says 172.21.15.151:58720) 2023-07-21T22:08:52.179 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.584+0000 7f4426d9d700 1 -- 172.21.15.151:0/1731474837 learned_addr learned my addr 172.21.15.151:0/1731474837 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:52.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.584+0000 7f4426d9d700 1 -- 172.21.15.151:0/1731474837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4418009550 con 0x7f442807be30 2023-07-21T22:08:52.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.584+0000 7f4426d9d700 1 --2- 172.21.15.151:0/1731474837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442819af70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4418000c00 tx=0x7f4418011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:52.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.584+0000 7f440ffff700 1 -- 172.21.15.151:0/1731474837 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44180036a0 con 0x7f442807be30 2023-07-21T22:08:52.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.584+0000 7f442ca46700 1 -- 172.21.15.151:0/1731474837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f442819b6b0 con 0x7f442807be30 2023-07-21T22:08:52.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.584+0000 7f440ffff700 1 -- 172.21.15.151:0/1731474837 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4418003c70 con 0x7f442807be30 2023-07-21T22:08:52.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.584+0000 7f440ffff700 1 -- 172.21.15.151:0/1731474837 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f44180193f0 con 0x7f442807be30 2023-07-21T22:08:52.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.584+0000 7f442ca46700 1 -- 172.21.15.151:0/1731474837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f442819bad0 con 0x7f442807be30 2023-07-21T22:08:52.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.585+0000 7f440ffff700 1 -- 172.21.15.151:0/1731474837 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4418019970 con 0x7f442807be30 2023-07-21T22:08:52.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.585+0000 7f440ffff700 1 -- 172.21.15.151:0/1731474837 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f441801a3d0 con 0x7f442807be30 2023-07-21T22:08:52.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.586+0000 7f442ca46700 1 -- 172.21.15.151:0/1731474837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f442810b310 con 0x7f442807be30 2023-07-21T22:08:52.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.588+0000 7f440ffff700 1 -- 172.21.15.151:0/1731474837 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f4418029060 con 0x7f442807be30 2023-07-21T22:08:52.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.657+0000 7f442ca46700 1 -- 172.21.15.151:0/1731474837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f442810b4d0 con 0x7f442807be30 2023-07-21T22:08:52.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.660+0000 7f440ffff700 1 -- 172.21.15.151:0/1731474837 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f44180330c0 con 0x7f442807be30 2023-07-21T22:08:52.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.660+0000 7f442ca46700 1 -- 172.21.15.151:0/1731474837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 msgr2=0x7f442819af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:52.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.660+0000 7f442ca46700 1 --2- 172.21.15.151:0/1731474837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442819af70 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f4418000c00 tx=0x7f4418011e70 comp rx=0 tx=0).stop 2023-07-21T22:08:52.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.661+0000 7f442ca46700 1 -- 172.21.15.151:0/1731474837 shutdown_connections 2023-07-21T22:08:52.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.661+0000 7f442ca46700 1 --2- 172.21.15.151:0/1731474837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f442807be30 0x7f442819af70 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:52.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.661+0000 7f442ca46700 1 -- 172.21.15.151:0/1731474837 >> 172.21.15.151:0/1731474837 conn(0x7f44281006c0 msgr2=0x7f4428101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:52.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.661+0000 7f442ca46700 1 -- 172.21.15.151:0/1731474837 shutdown_connections 2023-07-21T22:08:52.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:51.661+0000 7f442ca46700 1 -- 172.21.15.151:0/1731474837 wait complete. 2023-07-21T22:08:52.182 INFO:teuthology.orchestra.run.smithi151.stdout:Wrote config to /etc/ceph/ceph.conf 2023-07-21T22:08:52.218 INFO:teuthology.orchestra.run.smithi151.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2023-07-21T22:08:52.218 INFO:teuthology.orchestra.run.smithi151.stdout:Creating mgr... 2023-07-21T22:08:52.219 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying port 9283 ... 2023-07-21T22:08:52.219 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying port 8765 ... 2023-07-21T22:08:52.617 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.x 2023-07-21T22:08:52.618 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.x.service: Unit ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.x.service not loaded. 2023-07-21T22:08:52.827 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c.target.wants/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@.service. 2023-07-21T22:08:52.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:52 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1731474837' entity='client.admin' 2023-07-21T22:08:52.946 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:52 smithi151 systemd[1]: Starting Ceph mgr.x for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:08:53.580 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:53 smithi151 podman[95740]: 2023-07-21T22:08:53.633 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-21T22:08:53.634 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout disabled 2023-07-21T22:08:53.650 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-21T22:08:53.650 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout inactive 2023-07-21T22:08:53.650 INFO:teuthology.orchestra.run.smithi151.stdout:firewalld.service is not enabled 2023-07-21T22:08:53.651 INFO:teuthology.orchestra.run.smithi151.stdout:Not possible to enable service . firewalld.service is not available 2023-07-21T22:08:53.667 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-21T22:08:53.668 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout disabled 2023-07-21T22:08:53.684 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-21T22:08:53.684 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout inactive 2023-07-21T22:08:53.685 INFO:teuthology.orchestra.run.smithi151.stdout:firewalld.service is not enabled 2023-07-21T22:08:53.685 INFO:teuthology.orchestra.run.smithi151.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2023-07-21T22:08:53.685 INFO:teuthology.orchestra.run.smithi151.stdout:Waiting for mgr to start... 2023-07-21T22:08:53.685 INFO:teuthology.orchestra.run.smithi151.stdout:Waiting for mgr... 2023-07-21T22:08:53.868 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:53 smithi151 bash[95740]: f5a370e846290a8bd34ed45effaf78c740f95752af701aaf2b24df583d50230d 2023-07-21T22:08:53.868 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:53 smithi151 systemd[1]: Started Ceph mgr.x for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:08:53.868 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:53 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:53.721+0000 7f6a5e5f5200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:08:53.869 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:53 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:53.827+0000 7f6a5e5f5200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:08:54.195 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:53 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:53.946+0000 7f6a5e5f5200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:08:54.195 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:54 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:54.074+0000 7f6a5e5f5200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:08:54.610 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:54 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:54.318+0000 7f6a5e5f5200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:08:54.611 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:54 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/627138510' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-21T22:08:54.868 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:08:54.872 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout { 2023-07-21T22:08:54.872 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:08:54.872 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "health": { 2023-07-21T22:08:54.872 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-21T22:08:54.873 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-21T22:08:54.873 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-21T22:08:54.873 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:54.873 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-21T22:08:54.873 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-21T22:08:54.873 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 0 2023-07-21T22:08:54.873 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:08:54.874 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-21T22:08:54.874 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "a" 2023-07-21T22:08:54.874 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:08:54.874 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2023-07-21T22:08:54.874 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-21T22:08:54.874 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:08:54.874 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-21T22:08:54.875 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-21T22:08:54.875 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:54.875 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-21T22:08:54.875 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:08:54.875 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-21T22:08:54.875 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-21T22:08:54.875 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-21T22:08:54.882 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-21T22:08:54.882 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-21T22:08:54.883 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-21T22:08:54.883 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:54.883 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-21T22:08:54.884 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-21T22:08:54.884 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-21T22:08:54.884 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-21T22:08:54.885 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-21T22:08:54.885 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-21T22:08:54.887 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-21T22:08:54.887 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-21T22:08:54.887 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-21T22:08:54.887 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:54.887 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-21T22:08:54.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:08:54.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-21T22:08:54.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-21T22:08:54.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:54.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-21T22:08:54.888 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-21T22:08:54.889 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-21T22:08:54.889 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-21T22:08:54.889 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-21T22:08:54.889 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-21T22:08:54.889 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "restful" 2023-07-21T22:08:54.889 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:08:54.889 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-21T22:08:54.890 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:54.890 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-21T22:08:54.890 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:08:54.890 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "modified": "2023-07-21T22:08:36.780281+0000", 2023-07-21T22:08:54.890 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-21T22:08:54.890 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:54.890 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-21T22:08:54.890 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout } 2023-07-21T22:08:54.891 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.241+0000 7f1d184fa700 1 Processor -- start 2023-07-21T22:08:54.891 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.241+0000 7f1d184fa700 1 -- start start 2023-07-21T22:08:54.891 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.242+0000 7f1d184fa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1007a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:54.891 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.242+0000 7f1d184fa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1007a850 con 0x7f1d1007be10 2023-07-21T22:08:54.891 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.242+0000 7f1d16296700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1007a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:54.891 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.242+0000 7f1d16296700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1007a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58752/0 (socket says 172.21.15.151:58752) 2023-07-21T22:08:54.891 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.242+0000 7f1d16296700 1 -- 172.21.15.151:0/1716084070 learned_addr learned my addr 172.21.15.151:0/1716084070 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:54.892 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.243+0000 7f1d16296700 1 -- 172.21.15.151:0/1716084070 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1007a990 con 0x7f1d1007be10 2023-07-21T22:08:54.892 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.243+0000 7f1d16296700 1 --2- 172.21.15.151:0/1716084070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1007a310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0098a0 tx=0x7f1d0c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57ddee5bf7215b52 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:54.892 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.243+0000 7f1d15294700 1 -- 172.21.15.151:0/1716084070 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c004160 con 0x7f1d1007be10 2023-07-21T22:08:54.892 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.243+0000 7f1d15294700 1 -- 172.21.15.151:0/1716084070 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1d0c0042c0 con 0x7f1d1007be10 2023-07-21T22:08:54.892 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.243+0000 7f1d15294700 1 -- 172.21.15.151:0/1716084070 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c011940 con 0x7f1d1007be10 2023-07-21T22:08:54.892 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.244+0000 7f1d184fa700 1 -- 172.21.15.151:0/1716084070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 msgr2=0x7f1d1007a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:54.892 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.244+0000 7f1d184fa700 1 --2- 172.21.15.151:0/1716084070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1007a310 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c0098a0 tx=0x7f1d0c009bb0 comp rx=0 tx=0).stop 2023-07-21T22:08:54.892 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.244+0000 7f1d184fa700 1 -- 172.21.15.151:0/1716084070 shutdown_connections 2023-07-21T22:08:54.893 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.244+0000 7f1d184fa700 1 --2- 172.21.15.151:0/1716084070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1007a310 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:54.893 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.244+0000 7f1d184fa700 1 -- 172.21.15.151:0/1716084070 >> 172.21.15.151:0/1716084070 conn(0x7f1d10100900 msgr2=0x7f1d10102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:54.893 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.244+0000 7f1d184fa700 1 -- 172.21.15.151:0/1716084070 shutdown_connections 2023-07-21T22:08:54.893 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.244+0000 7f1d184fa700 1 -- 172.21.15.151:0/1716084070 wait complete. 2023-07-21T22:08:54.893 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.245+0000 7f1d184fa700 1 Processor -- start 2023-07-21T22:08:54.893 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.245+0000 7f1d184fa700 1 -- start start 2023-07-21T22:08:54.893 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.246+0000 7f1d184fa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:54.894 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.246+0000 7f1d184fa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1019b6e0 con 0x7f1d1007be10 2023-07-21T22:08:54.894 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.246+0000 7f1d16296700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:54.894 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.246+0000 7f1d16296700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1019b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58754/0 (socket says 172.21.15.151:58754) 2023-07-21T22:08:54.894 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.246+0000 7f1d16296700 1 -- 172.21.15.151:0/627138510 learned_addr learned my addr 172.21.15.151:0/627138510 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:54.894 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.246+0000 7f1d16296700 1 -- 172.21.15.151:0/627138510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d0c009550 con 0x7f1d1007be10 2023-07-21T22:08:54.894 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.247+0000 7f1d16296700 1 --2- 172.21.15.151:0/627138510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1019b1a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c000c00 tx=0x7f1d0c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:54.894 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.247+0000 7f1d077fe700 1 -- 172.21.15.151:0/627138510 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c0036a0 con 0x7f1d1007be10 2023-07-21T22:08:54.894 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.247+0000 7f1d077fe700 1 -- 172.21.15.151:0/627138510 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1d0c003c70 con 0x7f1d1007be10 2023-07-21T22:08:54.895 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.247+0000 7f1d184fa700 1 -- 172.21.15.151:0/627138510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d1019b8e0 con 0x7f1d1007be10 2023-07-21T22:08:54.895 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.247+0000 7f1d077fe700 1 -- 172.21.15.151:0/627138510 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1d0c024d70 con 0x7f1d1007be10 2023-07-21T22:08:54.895 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.247+0000 7f1d184fa700 1 -- 172.21.15.151:0/627138510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d1019bd00 con 0x7f1d1007be10 2023-07-21T22:08:54.895 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.247+0000 7f1d077fe700 1 -- 172.21.15.151:0/627138510 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1d0c01a730 con 0x7f1d1007be10 2023-07-21T22:08:54.895 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.247+0000 7f1d077fe700 1 -- 172.21.15.151:0/627138510 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1d0c02dde0 con 0x7f1d1007be10 2023-07-21T22:08:54.895 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.248+0000 7f1d184fa700 1 -- 172.21.15.151:0/627138510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d1010b4f0 con 0x7f1d1007be10 2023-07-21T22:08:54.895 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.251+0000 7f1d077fe700 1 -- 172.21.15.151:0/627138510 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f1d0c02d3f0 con 0x7f1d1007be10 2023-07-21T22:08:54.896 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.339+0000 7f1d184fa700 1 -- 172.21.15.151:0/627138510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f1d1019ed10 con 0x7f1d1007be10 2023-07-21T22:08:54.896 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.339+0000 7f1d077fe700 1 -- 172.21.15.151:0/627138510 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f1d0c02d590 con 0x7f1d1007be10 2023-07-21T22:08:54.896 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.340+0000 7f1d184fa700 1 -- 172.21.15.151:0/627138510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 msgr2=0x7f1d1019b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:54.896 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.340+0000 7f1d184fa700 1 --2- 172.21.15.151:0/627138510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1019b1a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1d0c000c00 tx=0x7f1d0c004250 comp rx=0 tx=0).stop 2023-07-21T22:08:54.896 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.340+0000 7f1d184fa700 1 -- 172.21.15.151:0/627138510 shutdown_connections 2023-07-21T22:08:54.896 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.340+0000 7f1d184fa700 1 --2- 172.21.15.151:0/627138510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d1007be10 0x7f1d1019b1a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:54.896 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.340+0000 7f1d184fa700 1 -- 172.21.15.151:0/627138510 >> 172.21.15.151:0/627138510 conn(0x7f1d10100900 msgr2=0x7f1d10102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:54.897 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.341+0000 7f1d184fa700 1 -- 172.21.15.151:0/627138510 shutdown_connections 2023-07-21T22:08:54.897 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:54.341+0000 7f1d184fa700 1 -- 172.21.15.151:0/627138510 wait complete. 2023-07-21T22:08:54.897 INFO:teuthology.orchestra.run.smithi151.stdout:mgr not available, waiting (1/15)... 2023-07-21T22:08:54.897 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:54 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:54.736+0000 7f6a5e5f5200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:08:55.184 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:54 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:54.855+0000 7f6a5e5f5200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:08:55.184 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:55 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:55.022+0000 7f6a5e5f5200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:08:55.445 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:55 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:55.143+0000 7f6a5e5f5200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:08:56.195 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:55 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:55.684+0000 7f6a5e5f5200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:08:56.945 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:56 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:56.462+0000 7f6a5e5f5200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T22:08:56.945 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:56 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:56.669+0000 7f6a5e5f5200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:08:57.857 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:08:57 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2487350480' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-21T22:08:57.857 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:57 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:57.692+0000 7f6a5e5f5200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:08:58.057 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:08:58.057 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout { 2023-07-21T22:08:58.057 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:08:58.057 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "health": { 2023-07-21T22:08:58.058 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-21T22:08:58.058 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-21T22:08:58.058 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-21T22:08:58.058 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:58.058 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-21T22:08:58.058 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-21T22:08:58.058 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 0 2023-07-21T22:08:58.059 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:08:58.059 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-21T22:08:58.059 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "a" 2023-07-21T22:08:58.059 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:08:58.059 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum_age": 6, 2023-07-21T22:08:58.059 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-21T22:08:58.059 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:08:58.059 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-21T22:08:58.060 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-21T22:08:58.060 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:58.060 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-21T22:08:58.060 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:08:58.060 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-21T22:08:58.060 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-21T22:08:58.060 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-21T22:08:58.066 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-21T22:08:58.066 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-21T22:08:58.066 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-21T22:08:58.066 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:58.066 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-21T22:08:58.067 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-21T22:08:58.067 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-21T22:08:58.067 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-21T22:08:58.067 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-21T22:08:58.067 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-21T22:08:58.067 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-21T22:08:58.067 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-21T22:08:58.068 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-21T22:08:58.068 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:58.068 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-21T22:08:58.068 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:08:58.068 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-21T22:08:58.068 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-21T22:08:58.068 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:58.068 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-21T22:08:58.069 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-21T22:08:58.069 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-21T22:08:58.069 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-21T22:08:58.069 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-21T22:08:58.069 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-21T22:08:58.069 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "restful" 2023-07-21T22:08:58.069 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:08:58.070 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-21T22:08:58.070 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:58.070 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-21T22:08:58.070 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:08:58.070 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "modified": "2023-07-21T22:08:36.780281+0000", 2023-07-21T22:08:58.070 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-21T22:08:58.070 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:08:58.070 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-21T22:08:58.071 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout } 2023-07-21T22:08:58.071 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.417+0000 7f2cbdec8700 1 Processor -- start 2023-07-21T22:08:58.071 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.417+0000 7f2cbdec8700 1 -- start start 2023-07-21T22:08:58.071 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.417+0000 7f2cbdec8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8079d10 0x7f2cb8107da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:58.071 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.417+0000 7f2cbdec8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81082e0 con 0x7f2cb8079d10 2023-07-21T22:08:58.071 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.418+0000 7f2cb77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8079d10 0x7f2cb8107da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:58.071 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.418+0000 7f2cb77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8079d10 0x7f2cb8107da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49306/0 (socket says 172.21.15.151:49306) 2023-07-21T22:08:58.071 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.418+0000 7f2cb77fe700 1 -- 172.21.15.151:0/2248408085 learned_addr learned my addr 172.21.15.151:0/2248408085 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:58.072 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.418+0000 7f2cb77fe700 1 -- 172.21.15.151:0/2248408085 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cb8108420 con 0x7f2cb8079d10 2023-07-21T22:08:58.072 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.418+0000 7f2cb77fe700 1 --2- 172.21.15.151:0/2248408085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8079d10 0x7f2cb8107da0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80098a0 tx=0x7f2ca8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71b82e2a1f119b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:58.072 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.419+0000 7f2cb67fc700 1 -- 172.21.15.151:0/2248408085 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ca8004160 con 0x7f2cb8079d10 2023-07-21T22:08:58.072 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.419+0000 7f2cb67fc700 1 -- 172.21.15.151:0/2248408085 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2ca80042c0 con 0x7f2cb8079d10 2023-07-21T22:08:58.072 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.419+0000 7f2cb67fc700 1 -- 172.21.15.151:0/2248408085 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ca8011940 con 0x7f2cb8079d10 2023-07-21T22:08:58.072 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.419+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2248408085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8079d10 msgr2=0x7f2cb8107da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:58.072 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.419+0000 7f2cbdec8700 1 --2- 172.21.15.151:0/2248408085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8079d10 0x7f2cb8107da0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80098a0 tx=0x7f2ca8009bb0 comp rx=0 tx=0).stop 2023-07-21T22:08:58.073 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.420+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2248408085 shutdown_connections 2023-07-21T22:08:58.073 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.420+0000 7f2cbdec8700 1 --2- 172.21.15.151:0/2248408085 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8079d10 0x7f2cb8107da0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:58.073 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.420+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2248408085 >> 172.21.15.151:0/2248408085 conn(0x7f2cb80ff7f0 msgr2=0x7f2cb8101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:58.073 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.420+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2248408085 shutdown_connections 2023-07-21T22:08:58.073 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.420+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2248408085 wait complete. 2023-07-21T22:08:58.073 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.421+0000 7f2cbdec8700 1 Processor -- start 2023-07-21T22:08:58.073 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.421+0000 7f2cbdec8700 1 -- start start 2023-07-21T22:08:58.073 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.421+0000 7f2cbdec8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8198e90 0x7f2cb81992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:08:58.074 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.421+0000 7f2cbdec8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81997e0 con 0x7f2cb8198e90 2023-07-21T22:08:58.074 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.421+0000 7f2cb77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8198e90 0x7f2cb81992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:08:58.074 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.422+0000 7f2cb77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8198e90 0x7f2cb81992a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49310/0 (socket says 172.21.15.151:49310) 2023-07-21T22:08:58.074 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.422+0000 7f2cb77fe700 1 -- 172.21.15.151:0/2487350480 learned_addr learned my addr 172.21.15.151:0/2487350480 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:08:58.074 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.422+0000 7f2cb77fe700 1 -- 172.21.15.151:0/2487350480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009550 con 0x7f2cb8198e90 2023-07-21T22:08:58.074 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.422+0000 7f2cb77fe700 1 --2- 172.21.15.151:0/2487350480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8198e90 0x7f2cb81992a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8000c00 tx=0x7f2ca8011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:08:58.074 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.422+0000 7f2cb4ff9700 1 -- 172.21.15.151:0/2487350480 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ca80036a0 con 0x7f2cb8198e90 2023-07-21T22:08:58.074 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.422+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2487350480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb81999e0 con 0x7f2cb8198e90 2023-07-21T22:08:58.075 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.422+0000 7f2cb4ff9700 1 -- 172.21.15.151:0/2487350480 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2ca801b440 con 0x7f2cb8198e90 2023-07-21T22:08:58.075 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.423+0000 7f2cb4ff9700 1 -- 172.21.15.151:0/2487350480 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2ca80193f0 con 0x7f2cb8198e90 2023-07-21T22:08:58.075 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.423+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2487350480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb819c640 con 0x7f2cb8198e90 2023-07-21T22:08:58.075 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.423+0000 7f2cb4ff9700 1 -- 172.21.15.151:0/2487350480 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f2ca8019930 con 0x7f2cb8198e90 2023-07-21T22:08:58.075 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.423+0000 7f2cb4ff9700 1 -- 172.21.15.151:0/2487350480 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f2ca8024d00 con 0x7f2cb8198e90 2023-07-21T22:08:58.075 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.424+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2487350480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb8061b40 con 0x7f2cb8198e90 2023-07-21T22:08:58.075 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.428+0000 7f2cb4ff9700 1 -- 172.21.15.151:0/2487350480 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f2ca8029060 con 0x7f2cb8198e90 2023-07-21T22:08:58.076 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.500+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2487350480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f2cb8079f30 con 0x7f2cb8198e90 2023-07-21T22:08:58.076 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.501+0000 7f2cb4ff9700 1 -- 172.21.15.151:0/2487350480 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f2ca801f070 con 0x7f2cb8198e90 2023-07-21T22:08:58.076 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.502+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2487350480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8198e90 msgr2=0x7f2cb81992a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:08:58.076 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.502+0000 7f2cbdec8700 1 --2- 172.21.15.151:0/2487350480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8198e90 0x7f2cb81992a0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2ca8000c00 tx=0x7f2ca8011e70 comp rx=0 tx=0).stop 2023-07-21T22:08:58.076 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.502+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2487350480 shutdown_connections 2023-07-21T22:08:58.076 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.502+0000 7f2cbdec8700 1 --2- 172.21.15.151:0/2487350480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb8198e90 0x7f2cb81992a0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:08:58.076 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.502+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2487350480 >> 172.21.15.151:0/2487350480 conn(0x7f2cb80ff7f0 msgr2=0x7f2cb8100eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:08:58.076 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.502+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2487350480 shutdown_connections 2023-07-21T22:08:58.077 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:08:57.502+0000 7f2cbdec8700 1 -- 172.21.15.151:0/2487350480 wait complete. 2023-07-21T22:08:58.077 INFO:teuthology.orchestra.run.smithi151.stdout:mgr not available, waiting (2/15)... 2023-07-21T22:08:58.195 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:57 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:57.816+0000 7f6a5e5f5200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:08:58.195 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:58 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:58.042+0000 7f6a5e5f5200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:08:58.695 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:58 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:58.398+0000 7f6a5e5f5200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T22:08:59.196 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:58 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:58.676+0000 7f6a5e5f5200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:08:59.197 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:58 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:58.864+0000 7f6a5e5f5200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:08:59.695 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:08:59 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:08:59.203+0000 7f6a5e5f5200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:09:00.429 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:00.138+0000 7f6a5e5f5200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:09:00.430 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:00.316+0000 7f6a5e5f5200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:09:00.867 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:00 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3060274843' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-21T22:09:00.868 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:00.575+0000 7f6a5e5f5200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:09:00.868 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:00.731+0000 7f6a5e5f5200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:09:01.142 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:09:01.142 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout { 2023-07-21T22:09:01.142 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:09:01.143 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "health": { 2023-07-21T22:09:01.143 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-21T22:09:01.143 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-21T22:09:01.143 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-21T22:09:01.143 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:01.143 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-21T22:09:01.143 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-21T22:09:01.145 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 0 2023-07-21T22:09:01.145 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:09:01.145 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-21T22:09:01.145 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "a" 2023-07-21T22:09:01.145 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:09:01.146 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2023-07-21T22:09:01.146 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-21T22:09:01.146 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:09:01.146 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-21T22:09:01.146 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-21T22:09:01.146 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:01.146 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-21T22:09:01.146 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:09:01.147 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-21T22:09:01.147 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-21T22:09:01.147 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-21T22:09:01.147 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-21T22:09:01.152 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-21T22:09:01.153 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-21T22:09:01.153 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:01.153 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-21T22:09:01.153 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-21T22:09:01.153 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-21T22:09:01.153 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-21T22:09:01.154 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-21T22:09:01.154 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-21T22:09:01.154 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-21T22:09:01.154 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-21T22:09:01.154 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-21T22:09:01.154 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:01.154 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-21T22:09:01.154 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:09:01.155 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-21T22:09:01.155 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-21T22:09:01.155 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:01.155 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-21T22:09:01.155 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "available": false, 2023-07-21T22:09:01.155 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-21T22:09:01.155 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-21T22:09:01.155 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-21T22:09:01.156 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-21T22:09:01.156 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "restful" 2023-07-21T22:09:01.156 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:09:01.156 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-21T22:09:01.156 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:01.156 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-21T22:09:01.156 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:09:01.157 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "modified": "2023-07-21T22:08:36.780281+0000", 2023-07-21T22:09:01.157 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-21T22:09:01.157 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:01.157 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-21T22:09:01.157 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout } 2023-07-21T22:09:01.158 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.583+0000 7f14d1091700 1 Processor -- start 2023-07-21T22:09:01.158 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.583+0000 7f14d1091700 1 -- start start 2023-07-21T22:09:01.158 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.584+0000 7f14d1091700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc07a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:01.158 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.584+0000 7f14d1091700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc07a850 con 0x7f14cc07be10 2023-07-21T22:09:01.158 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.584+0000 7f14cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc07a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:01.158 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.584+0000 7f14cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc07a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49326/0 (socket says 172.21.15.151:49326) 2023-07-21T22:09:01.159 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.584+0000 7f14cbfff700 1 -- 172.21.15.151:0/3382205082 learned_addr learned my addr 172.21.15.151:0/3382205082 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:01.159 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.584+0000 7f14cbfff700 1 -- 172.21.15.151:0/3382205082 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14cc07a990 con 0x7f14cc07be10 2023-07-21T22:09:01.159 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.585+0000 7f14cbfff700 1 --2- 172.21.15.151:0/3382205082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc07a310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0098a0 tx=0x7f14bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9354fad91323ff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:01.159 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.585+0000 7f14caffd700 1 -- 172.21.15.151:0/3382205082 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14bc004160 con 0x7f14cc07be10 2023-07-21T22:09:01.159 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.585+0000 7f14caffd700 1 -- 172.21.15.151:0/3382205082 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f14bc0042c0 con 0x7f14cc07be10 2023-07-21T22:09:01.159 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.585+0000 7f14caffd700 1 -- 172.21.15.151:0/3382205082 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14bc011940 con 0x7f14cc07be10 2023-07-21T22:09:01.159 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.586+0000 7f14d1091700 1 -- 172.21.15.151:0/3382205082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 msgr2=0x7f14cc07a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:01.160 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.586+0000 7f14d1091700 1 --2- 172.21.15.151:0/3382205082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc07a310 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f14bc0098a0 tx=0x7f14bc009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:01.160 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.586+0000 7f14d1091700 1 -- 172.21.15.151:0/3382205082 shutdown_connections 2023-07-21T22:09:01.160 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.586+0000 7f14d1091700 1 --2- 172.21.15.151:0/3382205082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc07a310 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:01.160 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.586+0000 7f14d1091700 1 -- 172.21.15.151:0/3382205082 >> 172.21.15.151:0/3382205082 conn(0x7f14cc1006c0 msgr2=0x7f14cc102ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:01.160 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.586+0000 7f14d1091700 1 -- 172.21.15.151:0/3382205082 shutdown_connections 2023-07-21T22:09:01.160 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.586+0000 7f14d1091700 1 -- 172.21.15.151:0/3382205082 wait complete. 2023-07-21T22:09:01.161 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.587+0000 7f14d1091700 1 Processor -- start 2023-07-21T22:09:01.161 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.587+0000 7f14d1091700 1 -- start start 2023-07-21T22:09:01.161 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.587+0000 7f14d1091700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc19afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:01.161 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.587+0000 7f14d1091700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14cc19b4f0 con 0x7f14cc07be10 2023-07-21T22:09:01.161 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.588+0000 7f14cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc19afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:01.161 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.588+0000 7f14cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc19afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49342/0 (socket says 172.21.15.151:49342) 2023-07-21T22:09:01.162 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.588+0000 7f14cbfff700 1 -- 172.21.15.151:0/3060274843 learned_addr learned my addr 172.21.15.151:0/3060274843 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:01.162 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.588+0000 7f14cbfff700 1 -- 172.21.15.151:0/3060274843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc009550 con 0x7f14cc07be10 2023-07-21T22:09:01.162 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.588+0000 7f14cbfff700 1 --2- 172.21.15.151:0/3060274843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc19afb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14bc000c00 tx=0x7f14bc004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:01.162 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.588+0000 7f14c97fa700 1 -- 172.21.15.151:0/3060274843 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14bc0036a0 con 0x7f14cc07be10 2023-07-21T22:09:01.162 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.588+0000 7f14d1091700 1 -- 172.21.15.151:0/3060274843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14cc19b6f0 con 0x7f14cc07be10 2023-07-21T22:09:01.162 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.588+0000 7f14c97fa700 1 -- 172.21.15.151:0/3060274843 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f14bc003c70 con 0x7f14cc07be10 2023-07-21T22:09:01.162 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.588+0000 7f14c97fa700 1 -- 172.21.15.151:0/3060274843 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f14bc024d70 con 0x7f14cc07be10 2023-07-21T22:09:01.163 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.589+0000 7f14d1091700 1 -- 172.21.15.151:0/3060274843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14cc19bb10 con 0x7f14cc07be10 2023-07-21T22:09:01.163 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.589+0000 7f14c97fa700 1 -- 172.21.15.151:0/3060274843 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f14bc01a730 con 0x7f14cc07be10 2023-07-21T22:09:01.163 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.589+0000 7f14c97fa700 1 -- 172.21.15.151:0/3060274843 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f14bc02dd00 con 0x7f14cc07be10 2023-07-21T22:09:01.163 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.590+0000 7f14d1091700 1 -- 172.21.15.151:0/3060274843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14cc061b40 con 0x7f14cc07be10 2023-07-21T22:09:01.163 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.592+0000 7f14c97fa700 1 -- 172.21.15.151:0/3060274843 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72429 (secure 0 0 0) 0x7f14bc02d3f0 con 0x7f14cc07be10 2023-07-21T22:09:01.163 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.667+0000 7f14d1091700 1 -- 172.21.15.151:0/3060274843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f14cc19e550 con 0x7f14cc07be10 2023-07-21T22:09:01.163 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.667+0000 7f14c97fa700 1 -- 172.21.15.151:0/3060274843 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7f14bc0245d0 con 0x7f14cc07be10 2023-07-21T22:09:01.164 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.668+0000 7f14d1091700 1 -- 172.21.15.151:0/3060274843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 msgr2=0x7f14cc19afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:01.164 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.668+0000 7f14d1091700 1 --2- 172.21.15.151:0/3060274843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc19afb0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f14bc000c00 tx=0x7f14bc004250 comp rx=0 tx=0).stop 2023-07-21T22:09:01.164 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.669+0000 7f14d1091700 1 -- 172.21.15.151:0/3060274843 shutdown_connections 2023-07-21T22:09:01.164 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.669+0000 7f14d1091700 1 --2- 172.21.15.151:0/3060274843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14cc07be10 0x7f14cc19afb0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:01.164 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.669+0000 7f14d1091700 1 -- 172.21.15.151:0/3060274843 >> 172.21.15.151:0/3060274843 conn(0x7f14cc1006c0 msgr2=0x7f14cc101da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:01.165 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.669+0000 7f14d1091700 1 -- 172.21.15.151:0/3060274843 shutdown_connections 2023-07-21T22:09:01.165 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:00.669+0000 7f14d1091700 1 -- 172.21.15.151:0/3060274843 wait complete. 2023-07-21T22:09:01.165 INFO:teuthology.orchestra.run.smithi151.stdout:mgr not available, waiting (3/15)... 2023-07-21T22:09:01.165 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:01 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:01.033+0000 7f6a5e5f5200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:09:02.445 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:02.093+0000 7f6a5e5f5200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:09:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: Activating manager daemon x 2023-07-21T22:09:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: mgrmap e2: x(active, starting, since 0.00440386s) 2023-07-21T22:09:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-21T22:09:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-21T22:09:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-21T22:09:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:09:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-21T22:09:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: Manager daemon x is now available 2023-07-21T22:09:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-21T22:09:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-21T22:09:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' 2023-07-21T22:09:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' 2023-07-21T22:09:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:02 smithi151 ceph-mon[95510]: from='mgr.14100 172.21.15.151:0/471341424' entity='mgr.x' 2023-07-21T22:09:04.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:04 smithi151 ceph-mon[95510]: mgrmap e3: x(active, since 1.00985s) 2023-07-21T22:09:04.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:04 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/4088363436' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2023-07-21T22:09:04.535 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:09:04.536 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout { 2023-07-21T22:09:04.536 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:09:04.536 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "health": { 2023-07-21T22:09:04.536 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2023-07-21T22:09:04.537 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "checks": {}, 2023-07-21T22:09:04.537 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mutes": [] 2023-07-21T22:09:04.537 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:04.537 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2023-07-21T22:09:04.537 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum": [ 2023-07-21T22:09:04.538 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 0 2023-07-21T22:09:04.538 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:09:04.538 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2023-07-21T22:09:04.538 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "a" 2023-07-21T22:09:04.538 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:09:04.538 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "quorum_age": 12, 2023-07-21T22:09:04.538 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "monmap": { 2023-07-21T22:09:04.539 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:09:04.539 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "reef", 2023-07-21T22:09:04.539 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_mons": 1 2023-07-21T22:09:04.539 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:04.539 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osdmap": { 2023-07-21T22:09:04.539 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:09:04.539 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2023-07-21T22:09:04.539 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2023-07-21T22:09:04.545 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2023-07-21T22:09:04.545 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2023-07-21T22:09:04.546 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2023-07-21T22:09:04.546 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2023-07-21T22:09:04.546 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:04.546 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "pgmap": { 2023-07-21T22:09:04.546 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2023-07-21T22:09:04.546 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2023-07-21T22:09:04.546 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2023-07-21T22:09:04.546 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2023-07-21T22:09:04.547 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2023-07-21T22:09:04.547 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2023-07-21T22:09:04.547 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2023-07-21T22:09:04.547 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2023-07-21T22:09:04.547 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:04.547 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "fsmap": { 2023-07-21T22:09:04.547 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:09:04.548 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "by_rank": [], 2023-07-21T22:09:04.548 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "up:standby": 0 2023-07-21T22:09:04.548 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:04.548 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mgrmap": { 2023-07-21T22:09:04.548 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-21T22:09:04.548 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2023-07-21T22:09:04.548 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "modules": [ 2023-07-21T22:09:04.548 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "iostat", 2023-07-21T22:09:04.549 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "nfs", 2023-07-21T22:09:04.549 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "restful" 2023-07-21T22:09:04.549 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ], 2023-07-21T22:09:04.549 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-21T22:09:04.549 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:04.549 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "servicemap": { 2023-07-21T22:09:04.549 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 1, 2023-07-21T22:09:04.549 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "modified": "2023-07-21T22:08:36.780281+0000", 2023-07-21T22:09:04.550 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "services": {} 2023-07-21T22:09:04.550 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout }, 2023-07-21T22:09:04.550 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "progress_events": {} 2023-07-21T22:09:04.550 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout } 2023-07-21T22:09:04.550 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.653+0000 7ff9d2847700 1 Processor -- start 2023-07-21T22:09:04.550 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.653+0000 7ff9d2847700 1 -- start start 2023-07-21T22:09:04.550 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.654+0000 7ff9d2847700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc104510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:04.550 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.654+0000 7ff9d2847700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc104a50 con 0x7ff9cc104100 2023-07-21T22:09:04.551 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.654+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc104510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:04.551 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.654+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc104510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49388/0 (socket says 172.21.15.151:49388) 2023-07-21T22:09:04.551 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.654+0000 7ff9cbfff700 1 -- 172.21.15.151:0/1776734029 learned_addr learned my addr 172.21.15.151:0/1776734029 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:04.551 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.654+0000 7ff9cbfff700 1 -- 172.21.15.151:0/1776734029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9cc104b90 con 0x7ff9cc104100 2023-07-21T22:09:04.551 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.654+0000 7ff9cbfff700 1 --2- 172.21.15.151:0/1776734029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc104510 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0098a0 tx=0x7ff9bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6a0aa24e18fdcb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:04.551 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.655+0000 7ff9caffd700 1 -- 172.21.15.151:0/1776734029 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc004160 con 0x7ff9cc104100 2023-07-21T22:09:04.551 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.655+0000 7ff9caffd700 1 -- 172.21.15.151:0/1776734029 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff9bc0042c0 con 0x7ff9cc104100 2023-07-21T22:09:04.552 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.655+0000 7ff9caffd700 1 -- 172.21.15.151:0/1776734029 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc011940 con 0x7ff9cc104100 2023-07-21T22:09:04.552 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.655+0000 7ff9d2847700 1 -- 172.21.15.151:0/1776734029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 msgr2=0x7ff9cc104510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:04.552 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.655+0000 7ff9d2847700 1 --2- 172.21.15.151:0/1776734029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc104510 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc0098a0 tx=0x7ff9bc009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:04.552 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.655+0000 7ff9d2847700 1 -- 172.21.15.151:0/1776734029 shutdown_connections 2023-07-21T22:09:04.552 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.655+0000 7ff9d2847700 1 --2- 172.21.15.151:0/1776734029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc104510 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:04.552 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.655+0000 7ff9d2847700 1 -- 172.21.15.151:0/1776734029 >> 172.21.15.151:0/1776734029 conn(0x7ff9cc0ff7f0 msgr2=0x7ff9cc101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:04.552 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.655+0000 7ff9d2847700 1 -- 172.21.15.151:0/1776734029 shutdown_connections 2023-07-21T22:09:04.553 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.656+0000 7ff9d2847700 1 -- 172.21.15.151:0/1776734029 wait complete. 2023-07-21T22:09:04.553 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.656+0000 7ff9d2847700 1 Processor -- start 2023-07-21T22:09:04.553 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.657+0000 7ff9d2847700 1 -- start start 2023-07-21T22:09:04.553 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.657+0000 7ff9d2847700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc196ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:04.553 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.657+0000 7ff9d2847700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9cc1971e0 con 0x7ff9cc104100 2023-07-21T22:09:04.553 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.657+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc196ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:04.553 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.657+0000 7ff9cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc196ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49404/0 (socket says 172.21.15.151:49404) 2023-07-21T22:09:04.553 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.657+0000 7ff9cbfff700 1 -- 172.21.15.151:0/4088363436 learned_addr learned my addr 172.21.15.151:0/4088363436 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:04.554 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.657+0000 7ff9cbfff700 1 -- 172.21.15.151:0/4088363436 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9bc009550 con 0x7ff9cc104100 2023-07-21T22:09:04.554 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.658+0000 7ff9cbfff700 1 --2- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc196ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc006af0 tx=0x7ff9bc011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:04.554 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.658+0000 7ff9c97fa700 1 -- 172.21.15.151:0/4088363436 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc003bf0 con 0x7ff9cc104100 2023-07-21T22:09:04.554 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.658+0000 7ff9c97fa700 1 -- 172.21.15.151:0/4088363436 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff9bc01b8b0 con 0x7ff9cc104100 2023-07-21T22:09:04.554 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.658+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9cc1973e0 con 0x7ff9cc104100 2023-07-21T22:09:04.554 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.658+0000 7ff9c97fa700 1 -- 172.21.15.151:0/4088363436 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff9bc019880 con 0x7ff9cc104100 2023-07-21T22:09:04.554 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.658+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9cc197800 con 0x7ff9cc104100 2023-07-21T22:09:04.554 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.659+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9cc190a30 con 0x7ff9cc104100 2023-07-21T22:09:04.555 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.659+0000 7ff9c97fa700 1 -- 172.21.15.151:0/4088363436 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 3) v1 ==== 45366+0+0 (secure 0 0 0) 0x7ff9bc01b440 con 0x7ff9cc104100 2023-07-21T22:09:04.555 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.660+0000 7ff9c97fa700 1 --2- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7ff9b403a7a0 0x7ff9b403cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:04.555 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.660+0000 7ff9c97fa700 1 -- 172.21.15.151:0/4088363436 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7ff9bc04c7c0 con 0x7ff9cc104100 2023-07-21T22:09:04.555 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.660+0000 7ff9cb7fe700 1 --2- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7ff9b403a7a0 0x7ff9b403cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:04.555 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.661+0000 7ff9cb7fe700 1 --2- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7ff9b403a7a0 0x7ff9b403cc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0006fd0 tx=0x7ff9c0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:04.555 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.666+0000 7ff9c97fa700 1 -- 172.21.15.151:0/4088363436 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ff9bc018530 con 0x7ff9cc104100 2023-07-21T22:09:04.555 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.935+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7ff9cc061120 con 0x7ff9cc104100 2023-07-21T22:09:04.556 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.936+0000 7ff9c97fa700 1 -- 172.21.15.151:0/4088363436 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1238 (secure 0 0 0) 0x7ff9bc018350 con 0x7ff9cc104100 2023-07-21T22:09:04.556 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7ff9b403a7a0 msgr2=0x7ff9b403cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:04.556 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 --2- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7ff9b403a7a0 0x7ff9b403cc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0006fd0 tx=0x7ff9c0006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:04.556 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 msgr2=0x7ff9cc196ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:04.556 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 --2- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc196ca0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc006af0 tx=0x7ff9bc011a30 comp rx=0 tx=0).stop 2023-07-21T22:09:04.556 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 shutdown_connections 2023-07-21T22:09:04.556 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 --2- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7ff9b403a7a0 0x7ff9b403cc50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:04.556 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 --2- 172.21.15.151:0/4088363436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9cc104100 0x7ff9cc196ca0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:04.557 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 >> 172.21.15.151:0/4088363436 conn(0x7ff9cc0ff7f0 msgr2=0x7ff9cc18db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:04.557 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 shutdown_connections 2023-07-21T22:09:04.557 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:03.938+0000 7ff9d2847700 1 -- 172.21.15.151:0/4088363436 wait complete. 2023-07-21T22:09:04.557 INFO:teuthology.orchestra.run.smithi151.stdout:mgr is available 2023-07-21T22:09:05.422 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:05 smithi151 ceph-mon[95510]: mgrmap e4: x(active, since 2s) 2023-07-21T22:09:05.720 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:09:05.721 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout [global] 2023-07-21T22:09:05.721 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout fsid = f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:09:05.721 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2023-07-21T22:09:05.721 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2023-07-21T22:09:05.721 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2023-07-21T22:09:05.722 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2023-07-21T22:09:05.722 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:09:05.722 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout [mgr] 2023-07-21T22:09:05.722 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2023-07-21T22:09:05.722 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 2023-07-21T22:09:05.722 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout [osd] 2023-07-21T22:09:05.722 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2023-07-21T22:09:05.722 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2023-07-21T22:09:05.723 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2023-07-21T22:09:05.723 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2023-07-21T22:09:05.723 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2023-07-21T22:09:05.723 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.030+0000 7f01e9af0700 1 Processor -- start 2023-07-21T22:09:05.723 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.030+0000 7f01e9af0700 1 -- start start 2023-07-21T22:09:05.723 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.030+0000 7f01e9af0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:05.723 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.030+0000 7f01e9af0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e407a830 con 0x7f01e407bdf0 2023-07-21T22:09:05.723 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.031+0000 7f01e37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:05.724 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.031+0000 7f01e37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49418/0 (socket says 172.21.15.151:49418) 2023-07-21T22:09:05.724 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.031+0000 7f01e37fe700 1 -- 172.21.15.151:0/4082937797 learned_addr learned my addr 172.21.15.151:0/4082937797 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:05.724 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.031+0000 7f01e37fe700 1 -- 172.21.15.151:0/4082937797 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e407a970 con 0x7f01e407bdf0 2023-07-21T22:09:05.724 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.031+0000 7f01e37fe700 1 --2- 172.21.15.151:0/4082937797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e407a2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f01d40098a0 tx=0x7f01d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47ee659a48e87ce5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:05.724 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e27fc700 1 -- 172.21.15.151:0/4082937797 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d4004160 con 0x7f01e407bdf0 2023-07-21T22:09:05.724 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e27fc700 1 -- 172.21.15.151:0/4082937797 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f01d40042c0 con 0x7f01e407bdf0 2023-07-21T22:09:05.724 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e27fc700 1 -- 172.21.15.151:0/4082937797 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d4011940 con 0x7f01e407bdf0 2023-07-21T22:09:05.725 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e9af0700 1 -- 172.21.15.151:0/4082937797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 msgr2=0x7f01e407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:05.725 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e9af0700 1 --2- 172.21.15.151:0/4082937797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e407a2f0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f01d40098a0 tx=0x7f01d4009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:05.725 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e9af0700 1 -- 172.21.15.151:0/4082937797 shutdown_connections 2023-07-21T22:09:05.725 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e9af0700 1 --2- 172.21.15.151:0/4082937797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e407a2f0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:05.725 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e9af0700 1 -- 172.21.15.151:0/4082937797 >> 172.21.15.151:0/4082937797 conn(0x7f01e4100900 msgr2=0x7f01e4102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:05.725 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e9af0700 1 -- 172.21.15.151:0/4082937797 shutdown_connections 2023-07-21T22:09:05.725 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.032+0000 7f01e9af0700 1 -- 172.21.15.151:0/4082937797 wait complete. 2023-07-21T22:09:05.726 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.034+0000 7f01e9af0700 1 Processor -- start 2023-07-21T22:09:05.726 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.034+0000 7f01e9af0700 1 -- start start 2023-07-21T22:09:05.726 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.034+0000 7f01e9af0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e419b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:05.726 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.034+0000 7f01e9af0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e419b6b0 con 0x7f01e407bdf0 2023-07-21T22:09:05.726 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.035+0000 7f01e37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e419b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:05.726 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.035+0000 7f01e37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e419b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49430/0 (socket says 172.21.15.151:49430) 2023-07-21T22:09:05.726 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.035+0000 7f01e37fe700 1 -- 172.21.15.151:0/580645954 learned_addr learned my addr 172.21.15.151:0/580645954 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:05.726 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.035+0000 7f01e37fe700 1 -- 172.21.15.151:0/580645954 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d4009550 con 0x7f01e407bdf0 2023-07-21T22:09:05.727 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.035+0000 7f01e37fe700 1 --2- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e419b170 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f01d4006af0 tx=0x7f01d4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:05.727 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.035+0000 7f01e0ff9700 1 -- 172.21.15.151:0/580645954 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d4003bf0 con 0x7f01e407bdf0 2023-07-21T22:09:05.727 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.035+0000 7f01e0ff9700 1 -- 172.21.15.151:0/580645954 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f01d401b8b0 con 0x7f01e407bdf0 2023-07-21T22:09:05.727 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.035+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e419b8b0 con 0x7f01e407bdf0 2023-07-21T22:09:05.727 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.035+0000 7f01e0ff9700 1 -- 172.21.15.151:0/580645954 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f01d40197e0 con 0x7f01e407bdf0 2023-07-21T22:09:05.727 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.036+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e419bcd0 con 0x7f01e407bdf0 2023-07-21T22:09:05.727 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.036+0000 7f01e0ff9700 1 -- 172.21.15.151:0/580645954 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f01d401ba20 con 0x7f01e407bdf0 2023-07-21T22:09:05.727 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.037+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e4061b40 con 0x7f01e407bdf0 2023-07-21T22:09:05.728 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.037+0000 7f01e0ff9700 1 --2- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f01cc0386c0 0x7f01cc03ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:05.728 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.037+0000 7f01e0ff9700 1 -- 172.21.15.151:0/580645954 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f01d404c900 con 0x7f01e407bdf0 2023-07-21T22:09:05.728 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.037+0000 7f01e2ffd700 1 --2- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f01cc0386c0 0x7f01cc03ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:05.728 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.038+0000 7f01e2ffd700 1 --2- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f01cc0386c0 0x7f01cc03ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01d8006fd0 tx=0x7f01d8006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:05.728 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.042+0000 7f01e0ff9700 1 -- 172.21.15.151:0/580645954 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f01d4018530 con 0x7f01e407bdf0 2023-07-21T22:09:05.728 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.236+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f01e419eb50 con 0x7f01e407bdf0 2023-07-21T22:09:05.729 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.237+0000 7f01e0ff9700 1 -- 172.21.15.151:0/580645954 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+373 (secure 0 0 0) 0x7f01d4018350 con 0x7f01e407bdf0 2023-07-21T22:09:05.729 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.239+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f01cc0386c0 msgr2=0x7f01cc03ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:05.729 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.239+0000 7f01e9af0700 1 --2- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f01cc0386c0 0x7f01cc03ab70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f01d8006fd0 tx=0x7f01d8006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:05.729 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.239+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 msgr2=0x7f01e419b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:05.729 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.239+0000 7f01e9af0700 1 --2- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e419b170 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f01d4006af0 tx=0x7f01d4011a30 comp rx=0 tx=0).stop 2023-07-21T22:09:05.729 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.239+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 shutdown_connections 2023-07-21T22:09:05.729 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.239+0000 7f01e9af0700 1 --2- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f01cc0386c0 0x7f01cc03ab70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:05.729 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.239+0000 7f01e9af0700 1 --2- 172.21.15.151:0/580645954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f01e407bdf0 0x7f01e419b170 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:05.730 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.239+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 >> 172.21.15.151:0/580645954 conn(0x7f01e4100900 msgr2=0x7f01e4101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:05.730 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.240+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 shutdown_connections 2023-07-21T22:09:05.730 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:05.240+0000 7f01e9af0700 1 -- 172.21.15.151:0/580645954 wait complete. 2023-07-21T22:09:05.730 INFO:teuthology.orchestra.run.smithi151.stdout:Enabling cephadm module... 2023-07-21T22:09:06.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:06 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/580645954' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2023-07-21T22:09:07.420 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:07 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1686544680' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2023-07-21T22:09:07.420 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: ignoring --setuser ceph since I am not root 2023-07-21T22:09:07.420 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: ignoring --setgroup ceph since I am not root 2023-07-21T22:09:07.421 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:07.379+0000 7fb0458ae200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:09:07.601 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.222+0000 7f488cae4700 1 Processor -- start 2023-07-21T22:09:07.601 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.223+0000 7f488cae4700 1 -- start start 2023-07-21T22:09:07.601 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.223+0000 7f488cae4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488807a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:07.601 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.223+0000 7f488cae4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488807a830 con 0x7f488807bdf0 2023-07-21T22:09:07.601 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.223+0000 7f488659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488807a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:07.601 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.223+0000 7f488659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488807a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42542/0 (socket says 172.21.15.151:42542) 2023-07-21T22:09:07.602 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.223+0000 7f488659c700 1 -- 172.21.15.151:0/3590117326 learned_addr learned my addr 172.21.15.151:0/3590117326 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:07.602 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.224+0000 7f488659c700 1 -- 172.21.15.151:0/3590117326 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f488807a970 con 0x7f488807bdf0 2023-07-21T22:09:07.602 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.224+0000 7f488659c700 1 --2- 172.21.15.151:0/3590117326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488807a2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f48780098a0 tx=0x7f4878009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9ba5e134e1be4d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:07.602 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.224+0000 7f488559a700 1 -- 172.21.15.151:0/3590117326 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4878004160 con 0x7f488807bdf0 2023-07-21T22:09:07.602 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.224+0000 7f488559a700 1 -- 172.21.15.151:0/3590117326 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f48780042c0 con 0x7f488807bdf0 2023-07-21T22:09:07.602 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.224+0000 7f488559a700 1 -- 172.21.15.151:0/3590117326 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f4878011940 con 0x7f488807bdf0 2023-07-21T22:09:07.602 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.225+0000 7f488cae4700 1 -- 172.21.15.151:0/3590117326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 msgr2=0x7f488807a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:07.603 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.225+0000 7f488cae4700 1 --2- 172.21.15.151:0/3590117326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488807a2f0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f48780098a0 tx=0x7f4878009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:07.603 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.225+0000 7f488cae4700 1 -- 172.21.15.151:0/3590117326 shutdown_connections 2023-07-21T22:09:07.603 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.225+0000 7f488cae4700 1 --2- 172.21.15.151:0/3590117326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488807a2f0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:07.603 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.225+0000 7f488cae4700 1 -- 172.21.15.151:0/3590117326 >> 172.21.15.151:0/3590117326 conn(0x7f4888100890 msgr2=0x7f4888102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:07.603 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.225+0000 7f488cae4700 1 -- 172.21.15.151:0/3590117326 shutdown_connections 2023-07-21T22:09:07.604 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.225+0000 7f488cae4700 1 -- 172.21.15.151:0/3590117326 wait complete. 2023-07-21T22:09:07.604 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.226+0000 7f488cae4700 1 Processor -- start 2023-07-21T22:09:07.604 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.226+0000 7f488cae4700 1 -- start start 2023-07-21T22:09:07.604 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.226+0000 7f488cae4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488819b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:07.604 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.226+0000 7f488cae4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488819b5d0 con 0x7f488807bdf0 2023-07-21T22:09:07.604 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.227+0000 7f488659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488819b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:07.604 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.227+0000 7f488659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488819b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42544/0 (socket says 172.21.15.151:42544) 2023-07-21T22:09:07.605 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.227+0000 7f488659c700 1 -- 172.21.15.151:0/1686544680 learned_addr learned my addr 172.21.15.151:0/1686544680 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:07.605 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.227+0000 7f488659c700 1 -- 172.21.15.151:0/1686544680 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878009550 con 0x7f488807bdf0 2023-07-21T22:09:07.605 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.227+0000 7f488659c700 1 --2- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488819b090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4878000c00 tx=0x7f4878011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:07.605 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.227+0000 7f48777fe700 1 -- 172.21.15.151:0/1686544680 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48780036a0 con 0x7f488807bdf0 2023-07-21T22:09:07.605 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.227+0000 7f48777fe700 1 -- 172.21.15.151:0/1686544680 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f4878003c70 con 0x7f488807bdf0 2023-07-21T22:09:07.605 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.227+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f488819b7d0 con 0x7f488807bdf0 2023-07-21T22:09:07.605 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.227+0000 7f48777fe700 1 -- 172.21.15.151:0/1686544680 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f48780193f0 con 0x7f488807bdf0 2023-07-21T22:09:07.605 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.228+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f488819bbf0 con 0x7f488807bdf0 2023-07-21T22:09:07.606 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.229+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4888061b40 con 0x7f488807bdf0 2023-07-21T22:09:07.606 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.229+0000 7f48777fe700 1 -- 172.21.15.151:0/1686544680 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 4) v1 ==== 45472+0+0 (secure 0 0 0) 0x7f487801b440 con 0x7f488807bdf0 2023-07-21T22:09:07.606 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.229+0000 7f48777fe700 1 --2- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f48700386c0 0x7f487003ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:07.606 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.229+0000 7f48777fe700 1 -- 172.21.15.151:0/1686544680 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f487804c4f0 con 0x7f488807bdf0 2023-07-21T22:09:07.606 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.229+0000 7f4885d9b700 1 --2- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f48700386c0 0x7f487003ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:07.606 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.230+0000 7f4885d9b700 1 --2- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f48700386c0 0x7f487003ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f487c006fd0 tx=0x7f487c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:07.606 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.234+0000 7f48777fe700 1 -- 172.21.15.151:0/1686544680 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f4878022950 con 0x7f488807bdf0 2023-07-21T22:09:07.607 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:06.482+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f488819ed70 con 0x7f488807bdf0 2023-07-21T22:09:07.607 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.119+0000 7f48777fe700 1 -- 172.21.15.151:0/1686544680 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f4878003990 con 0x7f488807bdf0 2023-07-21T22:09:07.607 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.120+0000 7f48777fe700 1 -- 172.21.15.151:0/1686544680 <== mon.0 v2:172.21.15.151:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f487804bf10 con 0x7f488807bdf0 2023-07-21T22:09:07.607 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.123+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f48700386c0 msgr2=0x7f487003ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:07.607 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.123+0000 7f488cae4700 1 --2- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f48700386c0 0x7f487003ab70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f487c006fd0 tx=0x7f487c006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:07.607 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.123+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 msgr2=0x7f488819b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:07.608 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.123+0000 7f488cae4700 1 --2- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488819b090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f4878000c00 tx=0x7f4878011e70 comp rx=0 tx=0).stop 2023-07-21T22:09:07.608 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.123+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 shutdown_connections 2023-07-21T22:09:07.608 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.123+0000 7f488cae4700 1 --2- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f48700386c0 0x7f487003ab70 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:07.608 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.123+0000 7f488cae4700 1 --2- 172.21.15.151:0/1686544680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f488807bdf0 0x7f488819b090 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:07.608 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.123+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 >> 172.21.15.151:0/1686544680 conn(0x7f4888100890 msgr2=0x7f4888101610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:07.608 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.124+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 shutdown_connections 2023-07-21T22:09:07.609 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:07.124+0000 7f488cae4700 1 -- 172.21.15.151:0/1686544680 wait complete. 2023-07-21T22:09:07.686 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:07.484+0000 7fb0458ae200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:09:07.686 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:07.615+0000 7fb0458ae200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:09:07.945 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:07.745+0000 7fb0458ae200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:09:08.421 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:08 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1686544680' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2023-07-21T22:09:08.421 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:08 smithi151 ceph-mon[95510]: mgrmap e5: x(active, since 5s) 2023-07-21T22:09:08.421 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:07.978+0000 7fb0458ae200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:09:08.684 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:08.380+0000 7fb0458ae200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:09:08.684 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:08.509+0000 7fb0458ae200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:09:08.999 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout { 2023-07-21T22:09:08.999 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 5, 2023-07-21T22:09:08.999 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-21T22:09:09.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-07-21T22:09:09.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-07-21T22:09:09.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout } 2023-07-21T22:09:09.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.135+0000 7f1292865700 1 Processor -- start 2023-07-21T22:09:09.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.135+0000 7f1292865700 1 -- start start 2023-07-21T22:09:09.000 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.135+0000 7f1292865700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c07a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:09.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.135+0000 7f1292865700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c07a810 con 0x7f128c07bdd0 2023-07-21T22:09:09.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.136+0000 7f128bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c07a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:09.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.136+0000 7f128bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c07a2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42592/0 (socket says 172.21.15.151:42592) 2023-07-21T22:09:09.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.136+0000 7f128bfff700 1 -- 172.21.15.151:0/2595080067 learned_addr learned my addr 172.21.15.151:0/2595080067 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:09.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.136+0000 7f128bfff700 1 -- 172.21.15.151:0/2595080067 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128c07a950 con 0x7f128c07bdd0 2023-07-21T22:09:09.001 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.136+0000 7f128bfff700 1 --2- 172.21.15.151:0/2595080067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c07a2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f127c0098a0 tx=0x7f127c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af237463c4e71c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:09.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.137+0000 7f128affd700 1 -- 172.21.15.151:0/2595080067 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f127c004160 con 0x7f128c07bdd0 2023-07-21T22:09:09.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.137+0000 7f128affd700 1 -- 172.21.15.151:0/2595080067 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f127c0042c0 con 0x7f128c07bdd0 2023-07-21T22:09:09.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.137+0000 7f128affd700 1 -- 172.21.15.151:0/2595080067 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f127c011940 con 0x7f128c07bdd0 2023-07-21T22:09:09.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.137+0000 7f1292865700 1 -- 172.21.15.151:0/2595080067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 msgr2=0x7f128c07a2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:09.002 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.137+0000 7f1292865700 1 --2- 172.21.15.151:0/2595080067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c07a2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f127c0098a0 tx=0x7f127c009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:09.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.138+0000 7f1292865700 1 -- 172.21.15.151:0/2595080067 shutdown_connections 2023-07-21T22:09:09.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.138+0000 7f1292865700 1 --2- 172.21.15.151:0/2595080067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c07a2d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:09.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.138+0000 7f1292865700 1 -- 172.21.15.151:0/2595080067 >> 172.21.15.151:0/2595080067 conn(0x7f128c100900 msgr2=0x7f128c102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:09.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.138+0000 7f1292865700 1 -- 172.21.15.151:0/2595080067 shutdown_connections 2023-07-21T22:09:09.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.138+0000 7f1292865700 1 -- 172.21.15.151:0/2595080067 wait complete. 2023-07-21T22:09:09.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.139+0000 7f1292865700 1 Processor -- start 2023-07-21T22:09:09.003 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.140+0000 7f1292865700 1 -- start start 2023-07-21T22:09:09.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.140+0000 7f1292865700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:09.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.140+0000 7f1292865700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128c19b6b0 con 0x7f128c07bdd0 2023-07-21T22:09:09.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.140+0000 7f128bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:09.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.140+0000 7f128bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c19b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42606/0 (socket says 172.21.15.151:42606) 2023-07-21T22:09:09.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.140+0000 7f128bfff700 1 -- 172.21.15.151:0/3942317995 learned_addr learned my addr 172.21.15.151:0/3942317995 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:09.004 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.141+0000 7f128bfff700 1 -- 172.21.15.151:0/3942317995 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f127c009550 con 0x7f128c07bdd0 2023-07-21T22:09:09.005 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.141+0000 7f128bfff700 1 --2- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c19b170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f127c000c00 tx=0x7f127c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:09.005 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.141+0000 7f12897fa700 1 -- 172.21.15.151:0/3942317995 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f127c0036a0 con 0x7f128c07bdd0 2023-07-21T22:09:09.005 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.141+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128c19b8b0 con 0x7f128c07bdd0 2023-07-21T22:09:09.005 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.141+0000 7f12897fa700 1 -- 172.21.15.151:0/3942317995 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f127c003c70 con 0x7f128c07bdd0 2023-07-21T22:09:09.005 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.141+0000 7f12897fa700 1 -- 172.21.15.151:0/3942317995 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f127c0193f0 con 0x7f128c07bdd0 2023-07-21T22:09:09.005 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.141+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f128c19bcd0 con 0x7f128c07bdd0 2023-07-21T22:09:09.006 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.142+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128c10b4d0 con 0x7f128c07bdd0 2023-07-21T22:09:09.006 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.143+0000 7f12897fa700 1 -- 172.21.15.151:0/3942317995 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f127c01b440 con 0x7f128c07bdd0 2023-07-21T22:09:09.006 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.143+0000 7f12897fa700 1 --2- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f1274038710 0x7f127403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:09.006 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.143+0000 7f12897fa700 1 -- 172.21.15.151:0/3942317995 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f127c04c570 con 0x7f128c07bdd0 2023-07-21T22:09:09.006 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.143+0000 7f128b7fe700 1 -- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f1274038710 msgr2=0x7f127403abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/4032529407 2023-07-21T22:09:09.007 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.143+0000 7f128b7fe700 1 --2- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f1274038710 0x7f127403abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:09:09.007 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.148+0000 7f12897fa700 1 -- 172.21.15.151:0/3942317995 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f127c022950 con 0x7f128c07bdd0 2023-07-21T22:09:09.007 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.344+0000 7f128b7fe700 1 -- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f1274038710 msgr2=0x7f127403abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/4032529407 2023-07-21T22:09:09.007 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.344+0000 7f128b7fe700 1 --2- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f1274038710 0x7f127403abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:09:09.007 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.400+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f128c19eb30 con 0x7f128c07bdd0 2023-07-21T22:09:09.008 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.401+0000 7f12897fa700 1 -- 172.21.15.151:0/3942317995 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+88 (secure 0 0 0) 0x7f127c01f020 con 0x7f128c07bdd0 2023-07-21T22:09:09.008 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f1274038710 msgr2=0x7f127403abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:09:09.008 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 --2- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f1274038710 0x7f127403abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:09.008 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 msgr2=0x7f128c19b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:09.008 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 --2- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c19b170 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f127c000c00 tx=0x7f127c011e70 comp rx=0 tx=0).stop 2023-07-21T22:09:09.009 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 shutdown_connections 2023-07-21T22:09:09.009 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 --2- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f1274038710 0x7f127403abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:09.009 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 --2- 172.21.15.151:0/3942317995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f128c07bdd0 0x7f128c19b170 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:09.010 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 >> 172.21.15.151:0/3942317995 conn(0x7f128c100900 msgr2=0x7f128c102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:09.010 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 shutdown_connections 2023-07-21T22:09:09.010 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:08.404+0000 7f1292865700 1 -- 172.21.15.151:0/3942317995 wait complete. 2023-07-21T22:09:09.010 INFO:teuthology.orchestra.run.smithi151.stdout:Waiting for the mgr to restart... 2023-07-21T22:09:09.011 INFO:teuthology.orchestra.run.smithi151.stdout:Waiting for mgr epoch 5... 2023-07-21T22:09:09.160 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:08.675+0000 7fb0458ae200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:09:09.160 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:08.800+0000 7fb0458ae200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:09:09.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:09 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3942317995' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-07-21T22:09:09.445 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:09.367+0000 7fb0458ae200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:09:10.445 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:10.114+0000 7fb0458ae200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T22:09:10.445 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:10.322+0000 7fb0458ae200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:09:11.632 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:11.255+0000 7fb0458ae200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:09:11.632 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:11.372+0000 7fb0458ae200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:09:12.262 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:11.591+0000 7fb0458ae200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:09:12.263 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:11.946+0000 7fb0458ae200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T22:09:12.263 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:12 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:12.221+0000 7fb0458ae200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:09:12.695 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:12 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:12.411+0000 7fb0458ae200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:09:13.195 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:12 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:12.752+0000 7fb0458ae200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:09:14.122 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:13 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:13.671+0000 7fb0458ae200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:09:14.123 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:13 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:13.841+0000 7fb0458ae200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:09:14.445 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:14.081+0000 7fb0458ae200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:09:14.445 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:14.227+0000 7fb0458ae200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:09:14.945 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:14.496+0000 7fb0458ae200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:09:15.945 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:15.553+0000 7fb0458ae200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:09:15.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: Active manager daemon x restarted 2023-07-21T22:09:15.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: Activating manager daemon x 2023-07-21T22:09:15.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: osdmap e2: 0 total, 0 up, 0 in 2023-07-21T22:09:15.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: mgrmap e6: x(active, starting, since 0.00416504s) 2023-07-21T22:09:15.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:09:15.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-21T22:09:15.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-21T22:09:15.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-21T22:09:15.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-21T22:09:15.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: Manager daemon x is now available 2023-07-21T22:09:15.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:15.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:15.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:15.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:15.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:15 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:16.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:16 smithi151 ceph-mon[95510]: Found migration_current of "None". Setting to last migration. 2023-07-21T22:09:16.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:16 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-21T22:09:16.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:16 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-21T22:09:16.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:16 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:16.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:16 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:16.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:16 smithi151 ceph-mon[95510]: mgrmap e7: x(active, since 1.00675s) 2023-07-21T22:09:17.091 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout { 2023-07-21T22:09:17.096 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2023-07-21T22:09:17.097 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "initialized": true 2023-07-21T22:09:17.097 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout } 2023-07-21T22:09:17.097 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.479+0000 7f79b5658700 1 Processor -- start 2023-07-21T22:09:17.097 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.479+0000 7f79b5658700 1 -- start start 2023-07-21T22:09:17.097 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.479+0000 7f79b5658700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b007a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:17.097 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.479+0000 7f79b5658700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b007a850 con 0x7f79b007be10 2023-07-21T22:09:17.098 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.480+0000 7f79aeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b007a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:17.098 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.480+0000 7f79aeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b007a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42616/0 (socket says 172.21.15.151:42616) 2023-07-21T22:09:17.098 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.480+0000 7f79aeffd700 1 -- 172.21.15.151:0/660889556 learned_addr learned my addr 172.21.15.151:0/660889556 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:17.098 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.480+0000 7f79aeffd700 1 -- 172.21.15.151:0/660889556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b007a990 con 0x7f79b007be10 2023-07-21T22:09:17.098 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.480+0000 7f79aeffd700 1 --2- 172.21.15.151:0/660889556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b007a310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f79a00098a0 tx=0x7f79a0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3d1bbe56dc9d88b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:17.098 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.481+0000 7f79adffb700 1 -- 172.21.15.151:0/660889556 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79a0004160 con 0x7f79b007be10 2023-07-21T22:09:17.098 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.481+0000 7f79adffb700 1 -- 172.21.15.151:0/660889556 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f79a00042c0 con 0x7f79b007be10 2023-07-21T22:09:17.099 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.481+0000 7f79adffb700 1 -- 172.21.15.151:0/660889556 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79a0011940 con 0x7f79b007be10 2023-07-21T22:09:17.099 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.481+0000 7f79b5658700 1 -- 172.21.15.151:0/660889556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 msgr2=0x7f79b007a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:17.099 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.481+0000 7f79b5658700 1 --2- 172.21.15.151:0/660889556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b007a310 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f79a00098a0 tx=0x7f79a0009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:17.099 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.481+0000 7f79b5658700 1 -- 172.21.15.151:0/660889556 shutdown_connections 2023-07-21T22:09:17.099 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.481+0000 7f79b5658700 1 --2- 172.21.15.151:0/660889556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b007a310 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:17.099 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.482+0000 7f79b5658700 1 -- 172.21.15.151:0/660889556 >> 172.21.15.151:0/660889556 conn(0x7f79b0100900 msgr2=0x7f79b0102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:17.099 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.482+0000 7f79b5658700 1 -- 172.21.15.151:0/660889556 shutdown_connections 2023-07-21T22:09:17.100 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.482+0000 7f79b5658700 1 -- 172.21.15.151:0/660889556 wait complete. 2023-07-21T22:09:17.100 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.483+0000 7f79b5658700 1 Processor -- start 2023-07-21T22:09:17.100 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.483+0000 7f79b5658700 1 -- start start 2023-07-21T22:09:17.101 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.483+0000 7f79b5658700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b019b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:17.101 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.483+0000 7f79b5658700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b019b6e0 con 0x7f79b007be10 2023-07-21T22:09:17.101 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.483+0000 7f79aeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b019b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:17.101 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.484+0000 7f79aeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b019b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42624/0 (socket says 172.21.15.151:42624) 2023-07-21T22:09:17.101 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.484+0000 7f79aeffd700 1 -- 172.21.15.151:0/3403877368 learned_addr learned my addr 172.21.15.151:0/3403877368 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:17.101 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.484+0000 7f79aeffd700 1 -- 172.21.15.151:0/3403877368 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a0009550 con 0x7f79b007be10 2023-07-21T22:09:17.102 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.484+0000 7f79aeffd700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b019b1a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f79a0000c00 tx=0x7f79a0004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:17.102 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.484+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79a00036a0 con 0x7f79b007be10 2023-07-21T22:09:17.102 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.484+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f79a0003c70 con 0x7f79b007be10 2023-07-21T22:09:17.102 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.484+0000 7f79b5658700 1 -- 172.21.15.151:0/3403877368 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b019b8e0 con 0x7f79b007be10 2023-07-21T22:09:17.102 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.484+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f79a0024d70 con 0x7f79b007be10 2023-07-21T22:09:17.103 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.485+0000 7f79b5658700 1 -- 172.21.15.151:0/3403877368 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b019bd00 con 0x7f79b007be10 2023-07-21T22:09:17.103 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.486+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f79a001a480 con 0x7f79b007be10 2023-07-21T22:09:17.103 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.486+0000 7f7997fff700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 0x7f799803abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:17.103 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.486+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 --> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f799803b2d0 con 0x7f7998038710 2023-07-21T22:09:17.104 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.486+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f79a004c500 con 0x7f79b007be10 2023-07-21T22:09:17.104 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.486+0000 7f79ae7fc700 1 -- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 msgr2=0x7f799803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/4032529407 2023-07-21T22:09:17.104 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.486+0000 7f79ae7fc700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 0x7f799803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:09:17.104 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.687+0000 7f79ae7fc700 1 -- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 msgr2=0x7f799803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/4032529407 2023-07-21T22:09:17.104 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:09.687+0000 7f79ae7fc700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 0x7f799803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:09:17.104 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:10.088+0000 7f79ae7fc700 1 -- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 msgr2=0x7f799803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/4032529407 2023-07-21T22:09:17.105 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:10.088+0000 7f79ae7fc700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 0x7f799803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:09:17.105 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:10.889+0000 7f79ae7fc700 1 -- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 msgr2=0x7f799803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/4032529407 2023-07-21T22:09:17.105 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:10.889+0000 7f79ae7fc700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 0x7f799803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:09:17.105 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:12.490+0000 7f79ae7fc700 1 -- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 msgr2=0x7f799803abc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/4032529407 2023-07-21T22:09:17.105 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:12.490+0000 7f79ae7fc700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 0x7f799803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-21T22:09:17.105 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:15.558+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mgrmap(e 6) v1 ==== 45250+0+0 (secure 0 0 0) 0x7f79a001a910 con 0x7f79b007be10 2023-07-21T22:09:17.105 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:15.558+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 msgr2=0x7f799803abc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:09:17.105 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:15.558+0000 7f7997fff700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 0x7f799803abc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:17.106 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.560+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 7) v1 ==== 45377+0+0 (secure 0 0 0) 0x7f79a001ac90 con 0x7f79b007be10 2023-07-21T22:09:17.106 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.560+0000 7f7997fff700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f799803bfe0 0x7f799803e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:17.106 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.560+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f799803b2d0 con 0x7f799803bfe0 2023-07-21T22:09:17.106 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.561+0000 7f79ae7fc700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f799803bfe0 0x7f799803e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:17.106 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.562+0000 7f79ae7fc700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f799803bfe0 0x7f799803e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f79a4003a10 tx=0x7f79a4009290 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:17.106 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.563+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 <== mgr.14120 v2:172.21.15.151:6800/191414094 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7f799803b2d0 con 0x7f799803bfe0 2023-07-21T22:09:17.106 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.569+0000 7f79b5658700 1 -- 172.21.15.151:0/3403877368 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f79b019c4e0 con 0x7f799803bfe0 2023-07-21T22:09:17.107 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f7997fff700 1 -- 172.21.15.151:0/3403877368 <== mgr.14120 v2:172.21.15.151:6800/191414094 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7f79b019c4e0 con 0x7f799803bfe0 2023-07-21T22:09:17.107 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 -- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f799803bfe0 msgr2=0x7f799803e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:17.107 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f799803bfe0 0x7f799803e3c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f79a4003a10 tx=0x7f79a4009290 comp rx=0 tx=0).stop 2023-07-21T22:09:17.107 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 -- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 msgr2=0x7f79b019b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:17.107 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b019b1a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f79a0000c00 tx=0x7f79a0004250 comp rx=0 tx=0).stop 2023-07-21T22:09:17.107 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 -- 172.21.15.151:0/3403877368 shutdown_connections 2023-07-21T22:09:17.107 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f79b007be10 0x7f79b019b1a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:17.107 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f799803bfe0 0x7f799803e3c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:17.108 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 --2- 172.21.15.151:0/3403877368 >> [v2:172.21.15.151:6800/4032529407,v1:172.21.15.151:6801/4032529407] conn(0x7f7998038710 0x7f799803abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:17.108 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 -- 172.21.15.151:0/3403877368 >> 172.21.15.151:0/3403877368 conn(0x7f79b0100900 msgr2=0x7f79b0102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:17.108 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 -- 172.21.15.151:0/3403877368 shutdown_connections 2023-07-21T22:09:17.108 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:16.570+0000 7f79b5658700 1 -- 172.21.15.151:0/3403877368 wait complete. 2023-07-21T22:09:17.108 INFO:teuthology.orchestra.run.smithi151.stdout:mgr epoch 5 is available 2023-07-21T22:09:17.109 INFO:teuthology.orchestra.run.smithi151.stdout:Setting orchestrator backend to cephadm... 2023-07-21T22:09:17.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:17 smithi151 ceph-mon[95510]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-07-21T22:09:17.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:17 smithi151 ceph-mon[95510]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-07-21T22:09:17.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:17 smithi151 ceph-mon[95510]: [21/Jul/2023:22:09:16] ENGINE Bus STARTING 2023-07-21T22:09:17.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:17 smithi151 ceph-mon[95510]: [21/Jul/2023:22:09:16] ENGINE Serving on https://172.21.15.151:7150 2023-07-21T22:09:17.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:17 smithi151 ceph-mon[95510]: [21/Jul/2023:22:09:16] ENGINE Serving on http://172.21.15.151:8765 2023-07-21T22:09:17.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:17 smithi151 ceph-mon[95510]: [21/Jul/2023:22:09:16] ENGINE Bus STARTED 2023-07-21T22:09:17.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:17 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:18.479 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.723+0000 7f6ea0c4c700 1 Processor -- start 2023-07-21T22:09:18.479 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.724+0000 7f6ea0c4c700 1 -- start start 2023-07-21T22:09:18.479 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.724+0000 7f6ea0c4c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c07a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:18.479 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.724+0000 7f6ea0c4c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c07a850 con 0x7f6e9c07be10 2023-07-21T22:09:18.480 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.724+0000 7f6e9a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c07a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:18.480 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.725+0000 7f6e9a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c07a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41396/0 (socket says 172.21.15.151:41396) 2023-07-21T22:09:18.480 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.725+0000 7f6e9a59c700 1 -- 172.21.15.151:0/879210264 learned_addr learned my addr 172.21.15.151:0/879210264 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:18.480 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.725+0000 7f6e9a59c700 1 -- 172.21.15.151:0/879210264 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9c07a990 con 0x7f6e9c07be10 2023-07-21T22:09:18.480 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.725+0000 7f6e9a59c700 1 --2- 172.21.15.151:0/879210264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c07a310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0098a0 tx=0x7f6e8c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff28300b52379db0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:18.480 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.725+0000 7f6e9959a700 1 -- 172.21.15.151:0/879210264 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e8c004160 con 0x7f6e9c07be10 2023-07-21T22:09:18.480 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.725+0000 7f6e9959a700 1 -- 172.21.15.151:0/879210264 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6e8c0042c0 con 0x7f6e9c07be10 2023-07-21T22:09:18.481 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.725+0000 7f6e9959a700 1 -- 172.21.15.151:0/879210264 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e8c011940 con 0x7f6e9c07be10 2023-07-21T22:09:18.481 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.726+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/879210264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 msgr2=0x7f6e9c07a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:18.481 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.726+0000 7f6ea0c4c700 1 --2- 172.21.15.151:0/879210264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c07a310 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c0098a0 tx=0x7f6e8c009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:18.481 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.726+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/879210264 shutdown_connections 2023-07-21T22:09:18.481 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.726+0000 7f6ea0c4c700 1 --2- 172.21.15.151:0/879210264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c07a310 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:18.481 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.726+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/879210264 >> 172.21.15.151:0/879210264 conn(0x7f6e9c100890 msgr2=0x7f6e9c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:18.481 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.726+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/879210264 shutdown_connections 2023-07-21T22:09:18.482 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.726+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/879210264 wait complete. 2023-07-21T22:09:18.482 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.727+0000 7f6ea0c4c700 1 Processor -- start 2023-07-21T22:09:18.482 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.727+0000 7f6ea0c4c700 1 -- start start 2023-07-21T22:09:18.482 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.728+0000 7f6ea0c4c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c19b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:18.482 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.728+0000 7f6ea0c4c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e9c19b5e0 con 0x7f6e9c07be10 2023-07-21T22:09:18.482 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.728+0000 7f6e9a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c19b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:18.483 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.728+0000 7f6e9a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c19b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41398/0 (socket says 172.21.15.151:41398) 2023-07-21T22:09:18.483 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.728+0000 7f6e9a59c700 1 -- 172.21.15.151:0/2782472189 learned_addr learned my addr 172.21.15.151:0/2782472189 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:18.483 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.728+0000 7f6e9a59c700 1 -- 172.21.15.151:0/2782472189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e8c009550 con 0x7f6e9c07be10 2023-07-21T22:09:18.483 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.728+0000 7f6e9a59c700 1 --2- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c19b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c000c00 tx=0x7f6e8c004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:18.483 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.729+0000 7f6e8b7fe700 1 -- 172.21.15.151:0/2782472189 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e8c0036a0 con 0x7f6e9c07be10 2023-07-21T22:09:18.483 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.729+0000 7f6e8b7fe700 1 -- 172.21.15.151:0/2782472189 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f6e8c003c70 con 0x7f6e9c07be10 2023-07-21T22:09:18.483 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.729+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e9c19b7e0 con 0x7f6e9c07be10 2023-07-21T22:09:18.483 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.729+0000 7f6e8b7fe700 1 -- 172.21.15.151:0/2782472189 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f6e8c024d70 con 0x7f6e9c07be10 2023-07-21T22:09:18.484 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.729+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e9c19bc00 con 0x7f6e9c07be10 2023-07-21T22:09:18.484 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.730+0000 7f6e8b7fe700 1 -- 172.21.15.151:0/2782472189 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f6e8c0245d0 con 0x7f6e9c07be10 2023-07-21T22:09:18.484 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.730+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e9c061b40 con 0x7f6e9c07be10 2023-07-21T22:09:18.484 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.730+0000 7f6e8b7fe700 1 --2- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f6e84038760 0x7f6e8403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:18.484 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.730+0000 7f6e8b7fe700 1 -- 172.21.15.151:0/2782472189 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f6e8c04c4e0 con 0x7f6e9c07be10 2023-07-21T22:09:18.484 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.731+0000 7f6e99d9b700 1 --2- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f6e84038760 0x7f6e8403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:18.484 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.731+0000 7f6e99d9b700 1 --2- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f6e84038760 0x7f6e8403ac10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e90006fd0 tx=0x7f6e90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:18.485 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.736+0000 7f6e8b7fe700 1 -- 172.21.15.151:0/2782472189 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f6e8c0189a0 con 0x7f6e9c07be10 2023-07-21T22:09:18.485 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.947+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e9c101d80 con 0x7f6e84038760 2023-07-21T22:09:18.485 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.953+0000 7f6e8b7fe700 1 -- 172.21.15.151:0/2782472189 <== mgr.14120 v2:172.21.15.151:6800/191414094 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f6e9c101d80 con 0x7f6e84038760 2023-07-21T22:09:18.485 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f6e84038760 msgr2=0x7f6e8403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:18.485 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 --2- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f6e84038760 0x7f6e8403ac10 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f6e90006fd0 tx=0x7f6e90006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:18.485 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 msgr2=0x7f6e9c19b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:18.485 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 --2- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c19b0a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f6e8c000c00 tx=0x7f6e8c004250 comp rx=0 tx=0).stop 2023-07-21T22:09:18.486 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 shutdown_connections 2023-07-21T22:09:18.486 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 --2- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f6e84038760 0x7f6e8403ac10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:18.486 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 --2- 172.21.15.151:0/2782472189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e9c07be10 0x7f6e9c19b0a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:18.486 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 >> 172.21.15.151:0/2782472189 conn(0x7f6e9c100890 msgr2=0x7f6e9c101670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:18.486 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 shutdown_connections 2023-07-21T22:09:18.486 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:17.956+0000 7f6ea0c4c700 1 -- 172.21.15.151:0/2782472189 wait complete. 2023-07-21T22:09:18.774 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:18 smithi151 ceph-mon[95510]: mgrmap e8: x(active, since 2s) 2023-07-21T22:09:18.775 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:18 smithi151 ceph-mon[95510]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:18.775 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:18 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:18.775 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:18 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:19.760 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout value unchanged 2023-07-21T22:09:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.004+0000 7f234a184700 1 Processor -- start 2023-07-21T22:09:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.005+0000 7f234a184700 1 -- start start 2023-07-21T22:09:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.005+0000 7f234a184700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234407a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.005+0000 7f234a184700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234407a850 con 0x7f234407be10 2023-07-21T22:09:19.761 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.005+0000 7f23437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234407a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.005+0000 7f23437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234407a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41404/0 (socket says 172.21.15.151:41404) 2023-07-21T22:09:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.005+0000 7f23437fe700 1 -- 172.21.15.151:0/3949104060 learned_addr learned my addr 172.21.15.151:0/3949104060 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.006+0000 7f23437fe700 1 -- 172.21.15.151:0/3949104060 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234407a990 con 0x7f234407be10 2023-07-21T22:09:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.006+0000 7f23437fe700 1 --2- 172.21.15.151:0/3949104060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234407a310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23340098a0 tx=0x7f2334009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68a1fdf1a3c7afe1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.006+0000 7f23427fc700 1 -- 172.21.15.151:0/3949104060 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2334004160 con 0x7f234407be10 2023-07-21T22:09:19.762 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.006+0000 7f23427fc700 1 -- 172.21.15.151:0/3949104060 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f23340042c0 con 0x7f234407be10 2023-07-21T22:09:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.006+0000 7f23427fc700 1 -- 172.21.15.151:0/3949104060 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2334011940 con 0x7f234407be10 2023-07-21T22:09:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.007+0000 7f234a184700 1 -- 172.21.15.151:0/3949104060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 msgr2=0x7f234407a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.007+0000 7f234a184700 1 --2- 172.21.15.151:0/3949104060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234407a310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f23340098a0 tx=0x7f2334009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.007+0000 7f234a184700 1 -- 172.21.15.151:0/3949104060 shutdown_connections 2023-07-21T22:09:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.007+0000 7f234a184700 1 --2- 172.21.15.151:0/3949104060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234407a310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.007+0000 7f234a184700 1 -- 172.21.15.151:0/3949104060 >> 172.21.15.151:0/3949104060 conn(0x7f2344100900 msgr2=0x7f2344102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:19.763 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.007+0000 7f234a184700 1 -- 172.21.15.151:0/3949104060 shutdown_connections 2023-07-21T22:09:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.007+0000 7f234a184700 1 -- 172.21.15.151:0/3949104060 wait complete. 2023-07-21T22:09:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.008+0000 7f234a184700 1 Processor -- start 2023-07-21T22:09:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.009+0000 7f234a184700 1 -- start start 2023-07-21T22:09:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.009+0000 7f234a184700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234419b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.009+0000 7f234a184700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f234419b6e0 con 0x7f234407be10 2023-07-21T22:09:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.009+0000 7f23437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234419b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:19.764 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.009+0000 7f23437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234419b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41418/0 (socket says 172.21.15.151:41418) 2023-07-21T22:09:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.009+0000 7f23437fe700 1 -- 172.21.15.151:0/1505557098 learned_addr learned my addr 172.21.15.151:0/1505557098 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.009+0000 7f23437fe700 1 -- 172.21.15.151:0/1505557098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2334009550 con 0x7f234407be10 2023-07-21T22:09:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.010+0000 7f23437fe700 1 --2- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234419b1a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2334000c00 tx=0x7f2334004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.010+0000 7f2340ff9700 1 -- 172.21.15.151:0/1505557098 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f23340036a0 con 0x7f234407be10 2023-07-21T22:09:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.010+0000 7f2340ff9700 1 -- 172.21.15.151:0/1505557098 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f2334003c70 con 0x7f234407be10 2023-07-21T22:09:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.010+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234419b8e0 con 0x7f234407be10 2023-07-21T22:09:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.010+0000 7f2340ff9700 1 -- 172.21.15.151:0/1505557098 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2334024d70 con 0x7f234407be10 2023-07-21T22:09:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.010+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234419bd00 con 0x7f234407be10 2023-07-21T22:09:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.011+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f234410b4f0 con 0x7f234407be10 2023-07-21T22:09:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.011+0000 7f2340ff9700 1 -- 172.21.15.151:0/1505557098 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f2334003800 con 0x7f234407be10 2023-07-21T22:09:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.012+0000 7f2340ff9700 1 --2- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f232c038760 0x7f232c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.012+0000 7f2340ff9700 1 -- 172.21.15.151:0/1505557098 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f233404c580 con 0x7f234407be10 2023-07-21T22:09:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.012+0000 7f2342ffd700 1 --2- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f232c038760 0x7f232c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.012+0000 7f2342ffd700 1 --2- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f232c038760 0x7f232c03ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2338006fd0 tx=0x7f2338006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:19.766 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.016+0000 7f2340ff9700 1 -- 172.21.15.151:0/1505557098 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f23340189a0 con 0x7f234407be10 2023-07-21T22:09:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.212+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f234419eb60 con 0x7f232c038760 2023-07-21T22:09:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.213+0000 7f2340ff9700 1 -- 172.21.15.151:0/1505557098 <== mgr.14120 v2:172.21.15.151:6800/191414094 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f234419eb60 con 0x7f232c038760 2023-07-21T22:09:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f232c038760 msgr2=0x7f232c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 --2- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f232c038760 0x7f232c03ac10 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2338006fd0 tx=0x7f2338006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 msgr2=0x7f234419b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 --2- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234419b1a0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2334000c00 tx=0x7f2334004250 comp rx=0 tx=0).stop 2023-07-21T22:09:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 shutdown_connections 2023-07-21T22:09:19.767 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 --2- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f232c038760 0x7f232c03ac10 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 --2- 172.21.15.151:0/1505557098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f234407be10 0x7f234419b1a0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 >> 172.21.15.151:0/1505557098 conn(0x7f2344100900 msgr2=0x7f2344102000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 shutdown_connections 2023-07-21T22:09:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:19.216+0000 7f234a184700 1 -- 172.21.15.151:0/1505557098 wait complete. 2023-07-21T22:09:19.768 INFO:teuthology.orchestra.run.smithi151.stdout:Generating ssh key... 2023-07-21T22:09:19.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:19 smithi151 ceph-mon[95510]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:21.196 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: Generating public/private rsa key pair. 2023-07-21T22:09:21.196 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: Your identification has been saved in /tmp/tmpv4toqtmu/key. 2023-07-21T22:09:21.196 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: Your public key has been saved in /tmp/tmpv4toqtmu/key.pub. 2023-07-21T22:09:21.196 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: The key fingerprint is: 2023-07-21T22:09:21.197 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: SHA256:PttQxDJ9hJWFqOoCK0LM8eF+JYdr2bP8Q7Ckf9oSzws ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:09:21.197 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: The key's randomart image is: 2023-07-21T22:09:21.197 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: +---[RSA 3072]----+ 2023-07-21T22:09:21.197 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: | +o+. | 2023-07-21T22:09:21.197 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: | oo.o | 2023-07-21T22:09:21.197 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: | o.+ . | 2023-07-21T22:09:21.197 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: | . . o.+ . | 2023-07-21T22:09:21.198 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: |o + . +.S . | 2023-07-21T22:09:21.198 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: | +.o +.* o | 2023-07-21T22:09:21.198 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: |. .o .OEO | 2023-07-21T22:09:21.198 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: |o ...=o=oX | 2023-07-21T22:09:21.198 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: |.. o. +O++ | 2023-07-21T22:09:21.198 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: +----[SHA256]-----+ 2023-07-21T22:09:21.246 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.275+0000 7f1026785700 1 Processor -- start 2023-07-21T22:09:21.246 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.275+0000 7f1026785700 1 -- start start 2023-07-21T22:09:21.246 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.276+0000 7f1026785700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102007a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:21.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.276+0000 7f1026785700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102007a830 con 0x7f102007bdf0 2023-07-21T22:09:21.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.276+0000 7f101ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102007a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:21.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.276+0000 7f101ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102007a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41426/0 (socket says 172.21.15.151:41426) 2023-07-21T22:09:21.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.276+0000 7f101ffff700 1 -- 172.21.15.151:0/539581896 learned_addr learned my addr 172.21.15.151:0/539581896 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:21.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.276+0000 7f101ffff700 1 -- 172.21.15.151:0/539581896 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102007a970 con 0x7f102007bdf0 2023-07-21T22:09:21.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.277+0000 7f101ffff700 1 --2- 172.21.15.151:0/539581896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102007a2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10100098a0 tx=0x7f1010009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10a35ea368a7587b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:21.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.277+0000 7f101effd700 1 -- 172.21.15.151:0/539581896 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1010004160 con 0x7f102007bdf0 2023-07-21T22:09:21.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.277+0000 7f101effd700 1 -- 172.21.15.151:0/539581896 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f10100042c0 con 0x7f102007bdf0 2023-07-21T22:09:21.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.277+0000 7f101effd700 1 -- 172.21.15.151:0/539581896 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1010011940 con 0x7f102007bdf0 2023-07-21T22:09:21.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.277+0000 7f1026785700 1 -- 172.21.15.151:0/539581896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 msgr2=0x7f102007a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:21.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.277+0000 7f1026785700 1 --2- 172.21.15.151:0/539581896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102007a2f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f10100098a0 tx=0x7f1010009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:21.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.278+0000 7f1026785700 1 -- 172.21.15.151:0/539581896 shutdown_connections 2023-07-21T22:09:21.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.278+0000 7f1026785700 1 --2- 172.21.15.151:0/539581896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102007a2f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:21.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.278+0000 7f1026785700 1 -- 172.21.15.151:0/539581896 >> 172.21.15.151:0/539581896 conn(0x7f1020100900 msgr2=0x7f1020102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:21.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.278+0000 7f1026785700 1 -- 172.21.15.151:0/539581896 shutdown_connections 2023-07-21T22:09:21.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.278+0000 7f1026785700 1 -- 172.21.15.151:0/539581896 wait complete. 2023-07-21T22:09:21.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.279+0000 7f1026785700 1 Processor -- start 2023-07-21T22:09:21.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.279+0000 7f1026785700 1 -- start start 2023-07-21T22:09:21.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.279+0000 7f1026785700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102019b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:21.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.279+0000 7f1026785700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102019b6b0 con 0x7f102007bdf0 2023-07-21T22:09:21.250 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.279+0000 7f101ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102019b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:21.250 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.279+0000 7f101ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102019b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41442/0 (socket says 172.21.15.151:41442) 2023-07-21T22:09:21.250 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.279+0000 7f101ffff700 1 -- 172.21.15.151:0/141794839 learned_addr learned my addr 172.21.15.151:0/141794839 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:21.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.280+0000 7f101ffff700 1 -- 172.21.15.151:0/141794839 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1010009550 con 0x7f102007bdf0 2023-07-21T22:09:21.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.280+0000 7f101ffff700 1 --2- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102019b170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1010000c00 tx=0x7f1010011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:21.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.280+0000 7f101d7fa700 1 -- 172.21.15.151:0/141794839 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10100036a0 con 0x7f102007bdf0 2023-07-21T22:09:21.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.280+0000 7f101d7fa700 1 -- 172.21.15.151:0/141794839 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f1010003c70 con 0x7f102007bdf0 2023-07-21T22:09:21.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.280+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102019b8b0 con 0x7f102007bdf0 2023-07-21T22:09:21.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.280+0000 7f101d7fa700 1 -- 172.21.15.151:0/141794839 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f10100193f0 con 0x7f102007bdf0 2023-07-21T22:09:21.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.280+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102019bcd0 con 0x7f102007bdf0 2023-07-21T22:09:21.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.281+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1020061b40 con 0x7f102007bdf0 2023-07-21T22:09:21.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.282+0000 7f101d7fa700 1 -- 172.21.15.151:0/141794839 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f101001b440 con 0x7f102007bdf0 2023-07-21T22:09:21.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.282+0000 7f101d7fa700 1 --2- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f1008038760 0x7f100803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:21.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.282+0000 7f101d7fa700 1 -- 172.21.15.151:0/141794839 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f101004c5d0 con 0x7f102007bdf0 2023-07-21T22:09:21.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.282+0000 7f101f7fe700 1 --2- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f1008038760 0x7f100803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:21.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.283+0000 7f101f7fe700 1 --2- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f1008038760 0x7f100803ac10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1014006fd0 tx=0x7f1014006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:21.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.287+0000 7f101d7fa700 1 -- 172.21.15.151:0/141794839 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f1010022950 con 0x7f102007bdf0 2023-07-21T22:09:21.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.482+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1020102c10 con 0x7f1008038760 2023-07-21T22:09:21.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.750+0000 7f101d7fa700 1 -- 172.21.15.151:0/141794839 <== mgr.14120 v2:172.21.15.151:6800/191414094 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1020102c10 con 0x7f1008038760 2023-07-21T22:09:21.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.752+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f1008038760 msgr2=0x7f100803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:21.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.752+0000 7f1026785700 1 --2- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f1008038760 0x7f100803ac10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1014006fd0 tx=0x7f1014006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:21.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.752+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 msgr2=0x7f102019b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:21.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.752+0000 7f1026785700 1 --2- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102019b170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1010000c00 tx=0x7f1010011e70 comp rx=0 tx=0).stop 2023-07-21T22:09:21.254 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.752+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 shutdown_connections 2023-07-21T22:09:21.254 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.752+0000 7f1026785700 1 --2- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f1008038760 0x7f100803ac10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:21.254 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.752+0000 7f1026785700 1 --2- 172.21.15.151:0/141794839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f102007bdf0 0x7f102019b170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:21.254 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.752+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 >> 172.21.15.151:0/141794839 conn(0x7f1020100900 msgr2=0x7f1020101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:21.254 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.752+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 shutdown_connections 2023-07-21T22:09:21.255 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:20.753+0000 7f1026785700 1 -- 172.21.15.151:0/141794839 wait complete. 2023-07-21T22:09:22.162 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:21 smithi151 ceph-mon[95510]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:22.162 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:21 smithi151 ceph-mon[95510]: Generating ssh key... 2023-07-21T22:09:22.162 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:21 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:22.162 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:21 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:22.525 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7PYMk6glKDr1QQ7HMBtUvtzI2z1PxzD0O2NsBE0/l5UX19/sc96uIIkKISaspvNhndYBRqAAHPCYCaDiTu+3VhiU3ycUjrm9ALySEjnVAAJI0sK8uUQx6MMuSqINC8ujDu2LBeAAWBYRrserzwOLnuhLrjMj22ESHtUcVgLLLGqzCNaqRPFPUxhIL/G8HgbvEME6jWyAx6N/b5Be7d5vX2uyELMHTmH4Unol7jRqDa/M5AV6MdMHtnBxyelVjFxMaI4o6rQsy9WJbuBkSckNtnnYuvN3gz3jVL4JppNTg8F3L/1oEVnqsf44gerOg4x1NLJ1Tb0Z7VZTm/OV5UR9sVqLsp1/PjF1CBMBHS1phJjVMED0O3eTctto0jGniaTEnDpso0U9cJZcdAXqm+iZjVqsNzUATzNwiTJQfjcnLxhskzXXMD3q34zoBEpvR+zKyzC9qlSFBmEkpSUja0jS2RE4EXoeobmNvaYlb0wpgSoLb3NIdMd23d6S9wED5IpE= ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:09:22.525 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.731+0000 7ff411d1c700 1 Processor -- start 2023-07-21T22:09:22.525 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.731+0000 7ff411d1c700 1 -- start start 2023-07-21T22:09:22.525 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.732+0000 7ff411d1c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:22.526 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.732+0000 7ff411d1c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c07a830 con 0x7ff40c07bdf0 2023-07-21T22:09:22.526 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.732+0000 7ff40b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:22.526 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.732+0000 7ff40b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41444/0 (socket says 172.21.15.151:41444) 2023-07-21T22:09:22.526 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.732+0000 7ff40b7fe700 1 -- 172.21.15.151:0/3860753720 learned_addr learned my addr 172.21.15.151:0/3860753720 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:22.526 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.732+0000 7ff40b7fe700 1 -- 172.21.15.151:0/3860753720 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff40c07a970 con 0x7ff40c07bdf0 2023-07-21T22:09:22.526 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.732+0000 7ff40b7fe700 1 --2- 172.21.15.151:0/3860753720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c07a2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0098a0 tx=0x7ff3fc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bcb17f415f87f58 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:22.526 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff40a7fc700 1 -- 172.21.15.151:0/3860753720 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc004160 con 0x7ff40c07bdf0 2023-07-21T22:09:22.527 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff40a7fc700 1 -- 172.21.15.151:0/3860753720 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff3fc0042c0 con 0x7ff40c07bdf0 2023-07-21T22:09:22.527 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff40a7fc700 1 -- 172.21.15.151:0/3860753720 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc011940 con 0x7ff40c07bdf0 2023-07-21T22:09:22.527 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff411d1c700 1 -- 172.21.15.151:0/3860753720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 msgr2=0x7ff40c07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:22.527 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff411d1c700 1 --2- 172.21.15.151:0/3860753720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c07a2f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc0098a0 tx=0x7ff3fc009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:22.527 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff411d1c700 1 -- 172.21.15.151:0/3860753720 shutdown_connections 2023-07-21T22:09:22.527 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff411d1c700 1 --2- 172.21.15.151:0/3860753720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c07a2f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:22.527 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff411d1c700 1 -- 172.21.15.151:0/3860753720 >> 172.21.15.151:0/3860753720 conn(0x7ff40c100900 msgr2=0x7ff40c102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:22.528 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff411d1c700 1 -- 172.21.15.151:0/3860753720 shutdown_connections 2023-07-21T22:09:22.528 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.733+0000 7ff411d1c700 1 -- 172.21.15.151:0/3860753720 wait complete. 2023-07-21T22:09:22.528 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.734+0000 7ff411d1c700 1 Processor -- start 2023-07-21T22:09:22.528 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.735+0000 7ff411d1c700 1 -- start start 2023-07-21T22:09:22.528 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.735+0000 7ff411d1c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:22.528 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.735+0000 7ff411d1c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40c19b6b0 con 0x7ff40c07bdf0 2023-07-21T22:09:22.528 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.735+0000 7ff40b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:22.528 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.735+0000 7ff40b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c19b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41454/0 (socket says 172.21.15.151:41454) 2023-07-21T22:09:22.529 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.735+0000 7ff40b7fe700 1 -- 172.21.15.151:0/2158355193 learned_addr learned my addr 172.21.15.151:0/2158355193 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:22.529 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.735+0000 7ff40b7fe700 1 -- 172.21.15.151:0/2158355193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3fc009550 con 0x7ff40c07bdf0 2023-07-21T22:09:22.529 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.736+0000 7ff40b7fe700 1 --2- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c19b170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc000c00 tx=0x7ff3fc011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:22.529 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.736+0000 7ff408ff9700 1 -- 172.21.15.151:0/2158355193 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc0036a0 con 0x7ff40c07bdf0 2023-07-21T22:09:22.529 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.736+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff40c19b8b0 con 0x7ff40c07bdf0 2023-07-21T22:09:22.529 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.736+0000 7ff408ff9700 1 -- 172.21.15.151:0/2158355193 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff3fc003c70 con 0x7ff40c07bdf0 2023-07-21T22:09:22.529 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.736+0000 7ff408ff9700 1 -- 172.21.15.151:0/2158355193 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff3fc0193f0 con 0x7ff40c07bdf0 2023-07-21T22:09:22.530 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.736+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff40c19bcd0 con 0x7ff40c07bdf0 2023-07-21T22:09:22.530 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.737+0000 7ff408ff9700 1 -- 172.21.15.151:0/2158355193 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7ff3fc01b440 con 0x7ff40c07bdf0 2023-07-21T22:09:22.530 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.737+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff40c061b40 con 0x7ff40c07bdf0 2023-07-21T22:09:22.530 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.738+0000 7ff408ff9700 1 --2- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff3f4038710 0x7ff3f403abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:22.530 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.738+0000 7ff408ff9700 1 -- 172.21.15.151:0/2158355193 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff3fc04c580 con 0x7ff40c07bdf0 2023-07-21T22:09:22.530 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.738+0000 7ff40affd700 1 --2- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff3f4038710 0x7ff3f403abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:22.530 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.738+0000 7ff40affd700 1 --2- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff3f4038710 0x7ff3f403abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff400006fd0 tx=0x7ff400006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:22.530 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.743+0000 7ff408ff9700 1 -- 172.21.15.151:0/2158355193 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ff3fc022950 con 0x7ff40c07bdf0 2023-07-21T22:09:22.531 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.937+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7ff40c102c10 con 0x7ff3f4038710 2023-07-21T22:09:22.531 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.938+0000 7ff408ff9700 1 -- 172.21.15.151:0/2158355193 <== mgr.14120 v2:172.21.15.151:6800/191414094 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7ff40c102c10 con 0x7ff3f4038710 2023-07-21T22:09:22.531 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.940+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff3f4038710 msgr2=0x7ff3f403abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:22.531 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.940+0000 7ff411d1c700 1 --2- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff3f4038710 0x7ff3f403abc0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff400006fd0 tx=0x7ff400006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:22.531 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.940+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 msgr2=0x7ff40c19b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:22.531 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.940+0000 7ff411d1c700 1 --2- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c19b170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff3fc000c00 tx=0x7ff3fc011e70 comp rx=0 tx=0).stop 2023-07-21T22:09:22.531 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.941+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 shutdown_connections 2023-07-21T22:09:22.532 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.941+0000 7ff411d1c700 1 --2- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff3f4038710 0x7ff3f403abc0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:22.532 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.941+0000 7ff411d1c700 1 --2- 172.21.15.151:0/2158355193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff40c07bdf0 0x7ff40c19b170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:22.532 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.941+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 >> 172.21.15.151:0/2158355193 conn(0x7ff40c100900 msgr2=0x7ff40c101ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:22.532 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.941+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 shutdown_connections 2023-07-21T22:09:22.532 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:21.941+0000 7ff411d1c700 1 -- 172.21.15.151:0/2158355193 wait complete. 2023-07-21T22:09:22.532 INFO:teuthology.orchestra.run.smithi151.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2023-07-21T22:09:22.532 INFO:teuthology.orchestra.run.smithi151.stdout:Adding key to root@localhost authorized_keys... 2023-07-21T22:09:22.533 INFO:teuthology.orchestra.run.smithi151.stdout:Adding host smithi151... 2023-07-21T22:09:23.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:22 smithi151 ceph-mon[95510]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:24.576 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:24 smithi151 ceph-mon[95510]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi151", "addr": "172.21.15.151", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:24.577 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:24 smithi151 ceph-mon[95510]: Deploying cephadm binary to smithi151 2023-07-21T22:09:26.912 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout Added host 'smithi151' with addr '172.21.15.151' 2023-07-21T22:09:26.912 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.022+0000 7fa56181d700 1 Processor -- start 2023-07-21T22:09:26.913 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.022+0000 7fa56181d700 1 -- start start 2023-07-21T22:09:26.913 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.023+0000 7fa56181d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:26.913 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.023+0000 7fa56181d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c07a870 con 0x7fa55c07be30 2023-07-21T22:09:26.913 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.023+0000 7fa55affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:26.913 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.023+0000 7fa55affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41470/0 (socket says 172.21.15.151:41470) 2023-07-21T22:09:26.913 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.023+0000 7fa55affd700 1 -- 172.21.15.151:0/3548237284 learned_addr learned my addr 172.21.15.151:0/3548237284 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:26.913 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.024+0000 7fa55affd700 1 -- 172.21.15.151:0/3548237284 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c07a9b0 con 0x7fa55c07be30 2023-07-21T22:09:26.914 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.024+0000 7fa55affd700 1 --2- 172.21.15.151:0/3548237284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c07a330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0098a0 tx=0x7fa54c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a066ab54e782280 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:26.914 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.024+0000 7fa559ffb700 1 -- 172.21.15.151:0/3548237284 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c004160 con 0x7fa55c07be30 2023-07-21T22:09:26.914 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.024+0000 7fa559ffb700 1 -- 172.21.15.151:0/3548237284 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa54c0042c0 con 0x7fa55c07be30 2023-07-21T22:09:26.914 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.024+0000 7fa559ffb700 1 -- 172.21.15.151:0/3548237284 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c011940 con 0x7fa55c07be30 2023-07-21T22:09:26.914 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.024+0000 7fa56181d700 1 -- 172.21.15.151:0/3548237284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 msgr2=0x7fa55c07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:26.914 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.025+0000 7fa56181d700 1 --2- 172.21.15.151:0/3548237284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c07a330 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa54c0098a0 tx=0x7fa54c009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:26.914 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.025+0000 7fa56181d700 1 -- 172.21.15.151:0/3548237284 shutdown_connections 2023-07-21T22:09:26.914 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.025+0000 7fa56181d700 1 --2- 172.21.15.151:0/3548237284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c07a330 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:26.915 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.025+0000 7fa56181d700 1 -- 172.21.15.151:0/3548237284 >> 172.21.15.151:0/3548237284 conn(0x7fa55c100890 msgr2=0x7fa55c102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:26.915 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.025+0000 7fa56181d700 1 -- 172.21.15.151:0/3548237284 shutdown_connections 2023-07-21T22:09:26.915 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.025+0000 7fa56181d700 1 -- 172.21.15.151:0/3548237284 wait complete. 2023-07-21T22:09:26.915 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.026+0000 7fa56181d700 1 Processor -- start 2023-07-21T22:09:26.915 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.026+0000 7fa56181d700 1 -- start start 2023-07-21T22:09:26.915 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.026+0000 7fa56181d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:26.915 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.026+0000 7fa56181d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c19b610 con 0x7fa55c07be30 2023-07-21T22:09:26.916 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.026+0000 7fa55affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:26.916 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.026+0000 7fa55affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c19b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41482/0 (socket says 172.21.15.151:41482) 2023-07-21T22:09:26.916 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.026+0000 7fa55affd700 1 -- 172.21.15.151:0/4106015293 learned_addr learned my addr 172.21.15.151:0/4106015293 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:26.916 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.027+0000 7fa55affd700 1 -- 172.21.15.151:0/4106015293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c009550 con 0x7fa55c07be30 2023-07-21T22:09:26.916 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.027+0000 7fa55affd700 1 --2- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c19b0d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa54c000c00 tx=0x7fa54c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:26.916 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.027+0000 7fa56081b700 1 -- 172.21.15.151:0/4106015293 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c0036a0 con 0x7fa55c07be30 2023-07-21T22:09:26.916 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.027+0000 7fa56081b700 1 -- 172.21.15.151:0/4106015293 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7fa54c003c70 con 0x7fa55c07be30 2023-07-21T22:09:26.917 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.027+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa55c19b810 con 0x7fa55c07be30 2023-07-21T22:09:26.917 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.027+0000 7fa56081b700 1 -- 172.21.15.151:0/4106015293 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa54c0193f0 con 0x7fa55c07be30 2023-07-21T22:09:26.917 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.027+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c19bc30 con 0x7fa55c07be30 2023-07-21T22:09:26.917 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.028+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c061b40 con 0x7fa55c07be30 2023-07-21T22:09:26.917 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.028+0000 7fa56081b700 1 -- 172.21.15.151:0/4106015293 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7fa54c01b440 con 0x7fa55c07be30 2023-07-21T22:09:26.917 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.029+0000 7fa56081b700 1 --2- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fa544038760 0x7fa54403ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:26.917 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.029+0000 7fa56081b700 1 -- 172.21.15.151:0/4106015293 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fa54c04c5d0 con 0x7fa55c07be30 2023-07-21T22:09:26.918 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.029+0000 7fa55a7fc700 1 --2- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fa544038760 0x7fa54403ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:26.918 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.030+0000 7fa55a7fc700 1 --2- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fa544038760 0x7fa54403ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa550006fd0 tx=0x7fa550006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:26.918 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.034+0000 7fa56081b700 1 -- 172.21.15.151:0/4106015293 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fa54c022950 con 0x7fa55c07be30 2023-07-21T22:09:26.918 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:23.234+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi151", "addr": "172.21.15.151", "target": ["mon-mgr", ""]}) v1 -- 0x7fa55c101d70 con 0x7fa544038760 2023-07-21T22:09:26.918 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.380+0000 7fa56081b700 1 -- 172.21.15.151:0/4106015293 <== mgr.14120 v2:172.21.15.151:6800/191414094 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fa55c101d70 con 0x7fa544038760 2023-07-21T22:09:26.918 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.383+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fa544038760 msgr2=0x7fa54403ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:26.918 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.383+0000 7fa56181d700 1 --2- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fa544038760 0x7fa54403ac10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa550006fd0 tx=0x7fa550006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:26.919 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.383+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 msgr2=0x7fa55c19b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:26.919 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.383+0000 7fa56181d700 1 --2- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c19b0d0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa54c000c00 tx=0x7fa54c011e70 comp rx=0 tx=0).stop 2023-07-21T22:09:26.919 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.383+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 shutdown_connections 2023-07-21T22:09:26.919 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.383+0000 7fa56181d700 1 --2- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fa544038760 0x7fa54403ac10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:26.919 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.383+0000 7fa56181d700 1 --2- 172.21.15.151:0/4106015293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa55c07be30 0x7fa55c19b0d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:26.919 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.384+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 >> 172.21.15.151:0/4106015293 conn(0x7fa55c100890 msgr2=0x7fa55c101660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:26.919 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.384+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 shutdown_connections 2023-07-21T22:09:26.919 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:26.384+0000 7fa56181d700 1 -- 172.21.15.151:0/4106015293 wait complete. 2023-07-21T22:09:26.920 INFO:teuthology.orchestra.run.smithi151.stdout:Deploying unmanaged mon service... 2023-07-21T22:09:27.695 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:27 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:27.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:27 smithi151 ceph-mon[95510]: Added host smithi151 2023-07-21T22:09:27.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:27 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:28.242 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2023-07-21T22:09:28.246 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.469+0000 7f098771e700 1 Processor -- start 2023-07-21T22:09:28.246 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.469+0000 7f098771e700 1 -- start start 2023-07-21T22:09:28.246 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.469+0000 7f098771e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098007a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:28.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.469+0000 7f098771e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098007a830 con 0x7f098007bdf0 2023-07-21T22:09:28.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.470+0000 7f09854ba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098007a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:28.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.470+0000 7f09854ba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098007a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47408/0 (socket says 172.21.15.151:47408) 2023-07-21T22:09:28.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.470+0000 7f09854ba700 1 -- 172.21.15.151:0/3981963916 learned_addr learned my addr 172.21.15.151:0/3981963916 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:28.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.470+0000 7f09854ba700 1 -- 172.21.15.151:0/3981963916 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f098007a970 con 0x7f098007bdf0 2023-07-21T22:09:28.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.470+0000 7f09854ba700 1 --2- 172.21.15.151:0/3981963916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098007a2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f097c0098a0 tx=0x7f097c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79af8d950233f122 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:28.247 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.470+0000 7f0977fff700 1 -- 172.21.15.151:0/3981963916 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f097c004160 con 0x7f098007bdf0 2023-07-21T22:09:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.471+0000 7f0977fff700 1 -- 172.21.15.151:0/3981963916 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f097c0042c0 con 0x7f098007bdf0 2023-07-21T22:09:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.471+0000 7f0977fff700 1 -- 172.21.15.151:0/3981963916 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f097c011940 con 0x7f098007bdf0 2023-07-21T22:09:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.471+0000 7f098771e700 1 -- 172.21.15.151:0/3981963916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 msgr2=0x7f098007a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.471+0000 7f098771e700 1 --2- 172.21.15.151:0/3981963916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098007a2f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f097c0098a0 tx=0x7f097c009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.471+0000 7f098771e700 1 -- 172.21.15.151:0/3981963916 shutdown_connections 2023-07-21T22:09:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.471+0000 7f098771e700 1 --2- 172.21.15.151:0/3981963916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098007a2f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.471+0000 7f098771e700 1 -- 172.21.15.151:0/3981963916 >> 172.21.15.151:0/3981963916 conn(0x7f0980100890 msgr2=0x7f0980102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:28.248 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.471+0000 7f098771e700 1 -- 172.21.15.151:0/3981963916 shutdown_connections 2023-07-21T22:09:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.471+0000 7f098771e700 1 -- 172.21.15.151:0/3981963916 wait complete. 2023-07-21T22:09:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.472+0000 7f098771e700 1 Processor -- start 2023-07-21T22:09:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.472+0000 7f098771e700 1 -- start start 2023-07-21T22:09:28.249 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.473+0000 7f098771e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098019b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:28.250 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.473+0000 7f098771e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f098019b5d0 con 0x7f098007bdf0 2023-07-21T22:09:28.250 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.473+0000 7f09854ba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098019b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:28.250 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.473+0000 7f09854ba700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098019b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47412/0 (socket says 172.21.15.151:47412) 2023-07-21T22:09:28.250 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.473+0000 7f09854ba700 1 -- 172.21.15.151:0/3068623072 learned_addr learned my addr 172.21.15.151:0/3068623072 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:28.250 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.473+0000 7f09854ba700 1 -- 172.21.15.151:0/3068623072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097c009550 con 0x7f098007bdf0 2023-07-21T22:09:28.250 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.473+0000 7f09854ba700 1 --2- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098019b090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c00 tx=0x7f097c011e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:28.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.474+0000 7f09767fc700 1 -- 172.21.15.151:0/3068623072 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f097c0036a0 con 0x7f098007bdf0 2023-07-21T22:09:28.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.474+0000 7f09767fc700 1 -- 172.21.15.151:0/3068623072 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7f097c003c70 con 0x7f098007bdf0 2023-07-21T22:09:28.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.474+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f098019b7d0 con 0x7f098007bdf0 2023-07-21T22:09:28.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.474+0000 7f09767fc700 1 -- 172.21.15.151:0/3068623072 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f097c0193f0 con 0x7f098007bdf0 2023-07-21T22:09:28.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.474+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f098019bbf0 con 0x7f098007bdf0 2023-07-21T22:09:28.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.475+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0980061b40 con 0x7f098007bdf0 2023-07-21T22:09:28.251 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.475+0000 7f09767fc700 1 -- 172.21.15.151:0/3068623072 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f097c01b440 con 0x7f098007bdf0 2023-07-21T22:09:28.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.476+0000 7f09767fc700 1 --2- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f096c038760 0x7f096c03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:28.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.476+0000 7f09767fc700 1 -- 172.21.15.151:0/3068623072 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f097c04c5d0 con 0x7f098007bdf0 2023-07-21T22:09:28.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.476+0000 7f0984cb9700 1 --2- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f096c038760 0x7f096c03ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:28.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.477+0000 7f0984cb9700 1 --2- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f096c038760 0x7f096c03ac10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0970006fd0 tx=0x7f0970006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:28.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.481+0000 7f09767fc700 1 -- 172.21.15.151:0/3068623072 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f097c022950 con 0x7f098007bdf0 2023-07-21T22:09:28.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.706+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0980101d20 con 0x7f096c038760 2023-07-21T22:09:28.252 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.711+0000 7f09767fc700 1 -- 172.21.15.151:0/3068623072 <== mgr.14120 v2:172.21.15.151:6800/191414094 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f0980101d20 con 0x7f096c038760 2023-07-21T22:09:28.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f096c038760 msgr2=0x7f096c03ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:28.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 --2- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f096c038760 0x7f096c03ac10 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f0970006fd0 tx=0x7f0970006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:28.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 msgr2=0x7f098019b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:28.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 --2- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098019b090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f097c000c00 tx=0x7f097c011e70 comp rx=0 tx=0).stop 2023-07-21T22:09:28.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 shutdown_connections 2023-07-21T22:09:28.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 --2- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f096c038760 0x7f096c03ac10 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:28.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 --2- 172.21.15.151:0/3068623072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f098007bdf0 0x7f098019b090 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:28.253 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 >> 172.21.15.151:0/3068623072 conn(0x7f0980100890 msgr2=0x7f0980101610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:28.254 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 shutdown_connections 2023-07-21T22:09:28.254 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:27.714+0000 7f098771e700 1 -- 172.21.15.151:0/3068623072 wait complete. 2023-07-21T22:09:28.254 INFO:teuthology.orchestra.run.smithi151.stdout:Deploying unmanaged mgr service... 2023-07-21T22:09:28.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:28 smithi151 ceph-mon[95510]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:28.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:28 smithi151 ceph-mon[95510]: Saving service mon spec with placement count:5 2023-07-21T22:09:28.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:28 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:29.672 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2023-07-21T22:09:29.672 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.922+0000 7ff47c272700 1 Processor -- start 2023-07-21T22:09:29.672 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.922+0000 7ff47c272700 1 -- start start 2023-07-21T22:09:29.672 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.922+0000 7ff47c272700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff474105610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:29.673 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.922+0000 7ff47c272700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff474105b50 con 0x7ff474105200 2023-07-21T22:09:29.673 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.922+0000 7ff47a00e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff474105610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:29.673 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.922+0000 7ff47a00e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff474105610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47418/0 (socket says 172.21.15.151:47418) 2023-07-21T22:09:29.673 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.922+0000 7ff47a00e700 1 -- 172.21.15.151:0/1516776302 learned_addr learned my addr 172.21.15.151:0/1516776302 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:29.673 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.923+0000 7ff47a00e700 1 -- 172.21.15.151:0/1516776302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474105c90 con 0x7ff474105200 2023-07-21T22:09:29.673 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.923+0000 7ff47a00e700 1 --2- 172.21.15.151:0/1516776302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff474105610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff4700098a0 tx=0x7ff470009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a50bc9a0bdb07d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:29.673 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.923+0000 7ff47900c700 1 -- 172.21.15.151:0/1516776302 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff470004160 con 0x7ff474105200 2023-07-21T22:09:29.674 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.923+0000 7ff47900c700 1 -- 172.21.15.151:0/1516776302 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff4700042c0 con 0x7ff474105200 2023-07-21T22:09:29.674 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.923+0000 7ff47900c700 1 -- 172.21.15.151:0/1516776302 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff470011940 con 0x7ff474105200 2023-07-21T22:09:29.674 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.924+0000 7ff47c272700 1 -- 172.21.15.151:0/1516776302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 msgr2=0x7ff474105610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:29.674 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.924+0000 7ff47c272700 1 --2- 172.21.15.151:0/1516776302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff474105610 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff4700098a0 tx=0x7ff470009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:29.677 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.924+0000 7ff47c272700 1 -- 172.21.15.151:0/1516776302 shutdown_connections 2023-07-21T22:09:29.677 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.924+0000 7ff47c272700 1 --2- 172.21.15.151:0/1516776302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff474105610 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:29.678 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.924+0000 7ff47c272700 1 -- 172.21.15.151:0/1516776302 >> 172.21.15.151:0/1516776302 conn(0x7ff474100890 msgr2=0x7ff474102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:29.678 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.924+0000 7ff47c272700 1 -- 172.21.15.151:0/1516776302 shutdown_connections 2023-07-21T22:09:29.678 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.924+0000 7ff47c272700 1 -- 172.21.15.151:0/1516776302 wait complete. 2023-07-21T22:09:29.678 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.925+0000 7ff47c272700 1 Processor -- start 2023-07-21T22:09:29.678 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.925+0000 7ff47c272700 1 -- start start 2023-07-21T22:09:29.678 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.926+0000 7ff47c272700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff47407bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:29.678 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.926+0000 7ff47c272700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff47407c1a0 con 0x7ff474105200 2023-07-21T22:09:29.679 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.926+0000 7ff47a00e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff47407bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:29.679 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.926+0000 7ff47a00e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff47407bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47432/0 (socket says 172.21.15.151:47432) 2023-07-21T22:09:29.679 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.926+0000 7ff47a00e700 1 -- 172.21.15.151:0/1845312042 learned_addr learned my addr 172.21.15.151:0/1845312042 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:29.679 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.926+0000 7ff47a00e700 1 -- 172.21.15.151:0/1845312042 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff470009550 con 0x7ff474105200 2023-07-21T22:09:29.679 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.926+0000 7ff47a00e700 1 --2- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff47407bc60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff470011dc0 tx=0x7ff470011ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:29.679 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.927+0000 7ff46b7fe700 1 -- 172.21.15.151:0/1845312042 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff4700037d0 con 0x7ff474105200 2023-07-21T22:09:29.679 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.927+0000 7ff46b7fe700 1 -- 172.21.15.151:0/1845312042 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1036+0+0 (secure 0 0 0) 0x7ff47001b440 con 0x7ff474105200 2023-07-21T22:09:29.680 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.927+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff47407a2b0 con 0x7ff474105200 2023-07-21T22:09:29.680 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.927+0000 7ff46b7fe700 1 -- 172.21.15.151:0/1845312042 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff47001a560 con 0x7ff474105200 2023-07-21T22:09:29.680 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.927+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff47407a6d0 con 0x7ff474105200 2023-07-21T22:09:29.680 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.928+0000 7ff46b7fe700 1 -- 172.21.15.151:0/1845312042 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7ff470003930 con 0x7ff474105200 2023-07-21T22:09:29.680 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.928+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff474061b40 con 0x7ff474105200 2023-07-21T22:09:29.680 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.928+0000 7ff46b7fe700 1 --2- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff460038760 0x7ff46003ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:29.681 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.928+0000 7ff46b7fe700 1 -- 172.21.15.151:0/1845312042 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7ff47004c600 con 0x7ff474105200 2023-07-21T22:09:29.681 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.929+0000 7ff47980d700 1 --2- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff460038760 0x7ff46003ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:29.681 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.929+0000 7ff47980d700 1 --2- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff460038760 0x7ff46003ac10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff464006fd0 tx=0x7ff464006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:29.681 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:28.934+0000 7ff46b7fe700 1 -- 172.21.15.151:0/1845312042 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ff47001b920 con 0x7ff474105200 2023-07-21T22:09:29.681 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.146+0000 7ff46b7fe700 1 -- 172.21.15.151:0/1845312042 <== mon.0 v2:172.21.15.151:3300/0 7 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff47001b920 con 0x7ff474105200 2023-07-21T22:09:29.681 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.148+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff474101d30 con 0x7ff460038760 2023-07-21T22:09:29.681 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.163+0000 7ff46b7fe700 1 -- 172.21.15.151:0/1845312042 <== mgr.14120 v2:172.21.15.151:6800/191414094 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7ff474101d30 con 0x7ff460038760 2023-07-21T22:09:29.681 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff460038760 msgr2=0x7ff46003ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:29.682 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 --2- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff460038760 0x7ff46003ac10 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff464006fd0 tx=0x7ff464006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:29.682 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 msgr2=0x7ff47407bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:29.682 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 --2- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff47407bc60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff470011dc0 tx=0x7ff470011ea0 comp rx=0 tx=0).stop 2023-07-21T22:09:29.682 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 shutdown_connections 2023-07-21T22:09:29.682 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 --2- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7ff460038760 0x7ff46003ac10 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:29.682 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 --2- 172.21.15.151:0/1845312042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff474105200 0x7ff47407bc60 secure :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7ff470011dc0 tx=0x7ff470011ea0 comp rx=0 tx=0).stop 2023-07-21T22:09:29.683 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 >> 172.21.15.151:0/1845312042 conn(0x7ff474100890 msgr2=0x7ff474101620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:29.683 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 shutdown_connections 2023-07-21T22:09:29.683 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:29.166+0000 7ff47c272700 1 -- 172.21.15.151:0/1845312042 wait complete. 2023-07-21T22:09:30.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:30 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:30.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:30 smithi151 ceph-mon[95510]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:30.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:30 smithi151 ceph-mon[95510]: Saving service mgr spec with placement count:2 2023-07-21T22:09:30.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:30 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:30.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:30 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:30.960 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.179+0000 7f0d56fc4700 1 Processor -- start 2023-07-21T22:09:30.960 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.180+0000 7f0d56fc4700 1 -- start start 2023-07-21T22:09:30.961 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.180+0000 7f0d56fc4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50104510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:30.961 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.180+0000 7f0d56fc4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50104a50 con 0x7f0d50104100 2023-07-21T22:09:30.961 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.180+0000 7f0d54d60700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50104510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:30.961 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.180+0000 7f0d54d60700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50104510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47448/0 (socket says 172.21.15.151:47448) 2023-07-21T22:09:30.961 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.180+0000 7f0d54d60700 1 -- 172.21.15.151:0/2680663225 learned_addr learned my addr 172.21.15.151:0/2680663225 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:30.962 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.181+0000 7f0d54d60700 1 -- 172.21.15.151:0/2680663225 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d50104b90 con 0x7f0d50104100 2023-07-21T22:09:30.962 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.181+0000 7f0d54d60700 1 --2- 172.21.15.151:0/2680663225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50104510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0d440098a0 tx=0x7f0d44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920a1debe43ecb90 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:30.962 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.181+0000 7f0d4f7fe700 1 -- 172.21.15.151:0/2680663225 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d44004160 con 0x7f0d50104100 2023-07-21T22:09:30.962 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.181+0000 7f0d4f7fe700 1 -- 172.21.15.151:0/2680663225 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d440042c0 con 0x7f0d50104100 2023-07-21T22:09:30.962 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.181+0000 7f0d4f7fe700 1 -- 172.21.15.151:0/2680663225 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d440118e0 con 0x7f0d50104100 2023-07-21T22:09:30.962 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.182+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2680663225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 msgr2=0x7f0d50104510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:30.962 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.182+0000 7f0d56fc4700 1 --2- 172.21.15.151:0/2680663225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50104510 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f0d440098a0 tx=0x7f0d44009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:30.963 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.182+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2680663225 shutdown_connections 2023-07-21T22:09:30.963 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.182+0000 7f0d56fc4700 1 --2- 172.21.15.151:0/2680663225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50104510 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:30.963 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.182+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2680663225 >> 172.21.15.151:0/2680663225 conn(0x7f0d500ff7f0 msgr2=0x7f0d50101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:30.963 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.182+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2680663225 shutdown_connections 2023-07-21T22:09:30.963 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.182+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2680663225 wait complete. 2023-07-21T22:09:30.963 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.183+0000 7f0d56fc4700 1 Processor -- start 2023-07-21T22:09:30.963 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.183+0000 7f0d56fc4700 1 -- start start 2023-07-21T22:09:30.964 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.183+0000 7f0d56fc4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50198f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:30.964 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.183+0000 7f0d56fc4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d50199460 con 0x7f0d50104100 2023-07-21T22:09:30.964 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.184+0000 7f0d54d60700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50198f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:30.964 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.184+0000 7f0d54d60700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50198f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47452/0 (socket says 172.21.15.151:47452) 2023-07-21T22:09:30.964 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.184+0000 7f0d54d60700 1 -- 172.21.15.151:0/2671528378 learned_addr learned my addr 172.21.15.151:0/2671528378 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:30.964 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.184+0000 7f0d54d60700 1 -- 172.21.15.151:0/2671528378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44009550 con 0x7f0d50104100 2023-07-21T22:09:30.965 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.184+0000 7f0d54d60700 1 --2- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50198f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d44006af0 tx=0x7f0d44011e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:30.965 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.184+0000 7f0d4dffb700 1 -- 172.21.15.151:0/2671528378 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d440037d0 con 0x7f0d50104100 2023-07-21T22:09:30.965 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.184+0000 7f0d4dffb700 1 -- 172.21.15.151:0/2671528378 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0d4401b440 con 0x7f0d50104100 2023-07-21T22:09:30.965 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.184+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d50199660 con 0x7f0d50104100 2023-07-21T22:09:30.965 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.184+0000 7f0d4dffb700 1 -- 172.21.15.151:0/2671528378 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0d440193d0 con 0x7f0d50104100 2023-07-21T22:09:30.965 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.185+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d50199a80 con 0x7f0d50104100 2023-07-21T22:09:30.965 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.186+0000 7f0d4dffb700 1 -- 172.21.15.151:0/2671528378 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f0d4401b5b0 con 0x7f0d50104100 2023-07-21T22:09:30.966 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.186+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d50061b40 con 0x7f0d50104100 2023-07-21T22:09:30.966 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.186+0000 7f0d4dffb700 1 --2- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f0d40038710 0x7f0d4003abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:30.966 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.186+0000 7f0d4dffb700 1 -- 172.21.15.151:0/2671528378 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f0d4404c520 con 0x7f0d50104100 2023-07-21T22:09:30.966 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.186+0000 7f0d4ffff700 1 --2- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f0d40038710 0x7f0d4003abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:30.966 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.187+0000 7f0d4ffff700 1 --2- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f0d40038710 0x7f0d4003abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:30.967 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.191+0000 7f0d4dffb700 1 -- 172.21.15.151:0/2671528378 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f0d4402b530 con 0x7f0d50104100 2023-07-21T22:09:30.967 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.420+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f0d5019cb30 con 0x7f0d50104100 2023-07-21T22:09:30.967 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.426+0000 7f0d4dffb700 1 -- 172.21.15.151:0/2671528378 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f0d4402b350 con 0x7f0d50104100 2023-07-21T22:09:30.967 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f0d40038710 msgr2=0x7f0d4003abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:30.967 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 --2- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f0d40038710 0x7f0d4003abc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f0d3c006fd0 tx=0x7f0d3c006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:30.968 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 msgr2=0x7f0d50198f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:30.968 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 --2- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50198f20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0d44006af0 tx=0x7f0d44011e80 comp rx=0 tx=0).stop 2023-07-21T22:09:30.968 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 shutdown_connections 2023-07-21T22:09:30.968 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 --2- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f0d40038710 0x7f0d4003abc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:30.968 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 --2- 172.21.15.151:0/2671528378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d50104100 0x7f0d50198f20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:30.968 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 >> 172.21.15.151:0/2671528378 conn(0x7f0d500ff7f0 msgr2=0x7f0d50079870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:30.969 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 shutdown_connections 2023-07-21T22:09:30.969 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:30.429+0000 7f0d56fc4700 1 -- 172.21.15.151:0/2671528378 wait complete. 2023-07-21T22:09:31.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:31 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2671528378' entity='client.admin' 2023-07-21T22:09:32.403 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.687+0000 7f08a8e78700 1 Processor -- start 2023-07-21T22:09:32.404 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.688+0000 7f08a8e78700 1 -- start start 2023-07-21T22:09:32.404 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.688+0000 7f08a8e78700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a407a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:32.404 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.688+0000 7f08a8e78700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a407a870 con 0x7f08a407be30 2023-07-21T22:09:32.404 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.688+0000 7f08a259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a407a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:32.404 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.688+0000 7f08a259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a407a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47468/0 (socket says 172.21.15.151:47468) 2023-07-21T22:09:32.404 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.688+0000 7f08a259c700 1 -- 172.21.15.151:0/3644915649 learned_addr learned my addr 172.21.15.151:0/3644915649 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:32.405 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.689+0000 7f08a259c700 1 -- 172.21.15.151:0/3644915649 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08a407a9b0 con 0x7f08a407be30 2023-07-21T22:09:32.405 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.689+0000 7f08a259c700 1 --2- 172.21.15.151:0/3644915649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a407a330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08940098a0 tx=0x7f0894009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93e3b8d3476a0ae1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:32.405 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.689+0000 7f08a159a700 1 -- 172.21.15.151:0/3644915649 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0894004160 con 0x7f08a407be30 2023-07-21T22:09:32.405 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.689+0000 7f08a159a700 1 -- 172.21.15.151:0/3644915649 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f08940042c0 con 0x7f08a407be30 2023-07-21T22:09:32.405 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.689+0000 7f08a159a700 1 -- 172.21.15.151:0/3644915649 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08940118e0 con 0x7f08a407be30 2023-07-21T22:09:32.405 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.690+0000 7f08a8e78700 1 -- 172.21.15.151:0/3644915649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 msgr2=0x7f08a407a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:32.405 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.690+0000 7f08a8e78700 1 --2- 172.21.15.151:0/3644915649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a407a330 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f08940098a0 tx=0x7f0894009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:32.406 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.690+0000 7f08a8e78700 1 -- 172.21.15.151:0/3644915649 shutdown_connections 2023-07-21T22:09:32.406 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.690+0000 7f08a8e78700 1 --2- 172.21.15.151:0/3644915649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a407a330 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:32.406 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.690+0000 7f08a8e78700 1 -- 172.21.15.151:0/3644915649 >> 172.21.15.151:0/3644915649 conn(0x7f08a4100890 msgr2=0x7f08a4102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:32.406 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.690+0000 7f08a8e78700 1 -- 172.21.15.151:0/3644915649 shutdown_connections 2023-07-21T22:09:32.406 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.691+0000 7f08a8e78700 1 -- 172.21.15.151:0/3644915649 wait complete. 2023-07-21T22:09:32.406 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.692+0000 7f08a8e78700 1 Processor -- start 2023-07-21T22:09:32.406 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.692+0000 7f08a8e78700 1 -- start start 2023-07-21T22:09:32.406 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.692+0000 7f08a8e78700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a419b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:32.407 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.692+0000 7f08a8e78700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08a419b6f0 con 0x7f08a407be30 2023-07-21T22:09:32.407 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.692+0000 7f08a259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a419b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:32.407 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.692+0000 7f08a259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a419b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47482/0 (socket says 172.21.15.151:47482) 2023-07-21T22:09:32.407 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.692+0000 7f08a259c700 1 -- 172.21.15.151:0/2200537443 learned_addr learned my addr 172.21.15.151:0/2200537443 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:32.407 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.693+0000 7f08a259c700 1 -- 172.21.15.151:0/2200537443 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0894009550 con 0x7f08a407be30 2023-07-21T22:09:32.407 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.693+0000 7f08a259c700 1 --2- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a419b1b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0894003e30 tx=0x7f0894011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:32.407 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.693+0000 7f08937fe700 1 -- 172.21.15.151:0/2200537443 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f08940037d0 con 0x7f08a407be30 2023-07-21T22:09:32.408 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.693+0000 7f08937fe700 1 -- 172.21.15.151:0/2200537443 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f089401b440 con 0x7f08a407be30 2023-07-21T22:09:32.408 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.693+0000 7f08937fe700 1 -- 172.21.15.151:0/2200537443 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f0894023400 con 0x7f08a407be30 2023-07-21T22:09:32.408 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.693+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08a419b8f0 con 0x7f08a407be30 2023-07-21T22:09:32.408 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.693+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08a419bd10 con 0x7f08a407be30 2023-07-21T22:09:32.408 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.694+0000 7f08937fe700 1 -- 172.21.15.151:0/2200537443 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f0894003930 con 0x7f08a407be30 2023-07-21T22:09:32.408 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.695+0000 7f08937fe700 1 --2- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f088c038740 0x7f088c03abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:32.408 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.695+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08a4061b40 con 0x7f08a407be30 2023-07-21T22:09:32.409 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.695+0000 7f08937fe700 1 -- 172.21.15.151:0/2200537443 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f089404c830 con 0x7f08a407be30 2023-07-21T22:09:32.409 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.695+0000 7f08a1d9b700 1 --2- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f088c038740 0x7f088c03abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:32.409 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.696+0000 7f08a1d9b700 1 --2- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f088c038740 0x7f088c03abf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0898006fd0 tx=0x7f0898006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:32.409 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.700+0000 7f08937fe700 1 -- 172.21.15.151:0/2200537443 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f089400bdb0 con 0x7f08a407be30 2023-07-21T22:09:32.409 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.904+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f08a419eb70 con 0x7f08a407be30 2023-07-21T22:09:32.409 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.910+0000 7f08937fe700 1 -- 172.21.15.151:0/2200537443 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f089400fdf0 con 0x7f08a407be30 2023-07-21T22:09:32.409 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f088c038740 msgr2=0x7f088c03abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:32.409 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 --2- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f088c038740 0x7f088c03abf0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f0898006fd0 tx=0x7f0898006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:32.410 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 msgr2=0x7f08a419b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:32.410 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 --2- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a419b1b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0894003e30 tx=0x7f0894011b50 comp rx=0 tx=0).stop 2023-07-21T22:09:32.410 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 shutdown_connections 2023-07-21T22:09:32.410 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 --2- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f088c038740 0x7f088c03abf0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:32.410 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 --2- 172.21.15.151:0/2200537443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08a407be30 0x7f08a419b1b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:32.410 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 >> 172.21.15.151:0/2200537443 conn(0x7f08a4100890 msgr2=0x7f08a4101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:32.410 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 shutdown_connections 2023-07-21T22:09:32.410 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:31.913+0000 7f08a8e78700 1 -- 172.21.15.151:0/2200537443 wait complete. 2023-07-21T22:09:32.411 INFO:teuthology.orchestra.run.smithi151.stdout:Enabling the dashboard module... 2023-07-21T22:09:32.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:32 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:32.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:32 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2200537443' entity='client.admin' 2023-07-21T22:09:34.535 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:34 smithi151 ceph-mon[95510]: from='mgr.14120 172.21.15.151:0/1288984982' entity='mgr.x' 2023-07-21T22:09:34.535 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:34 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/362455228' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2023-07-21T22:09:34.535 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: ignoring --setuser ceph since I am not root 2023-07-21T22:09:34.535 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: ignoring --setgroup ceph since I am not root 2023-07-21T22:09:34.536 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:34.494+0000 7f523d14b200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:09:34.793 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.918+0000 7f85951c3700 1 Processor -- start 2023-07-21T22:09:34.793 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.918+0000 7f85951c3700 1 -- start start 2023-07-21T22:09:34.793 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.919+0000 7f85951c3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859007a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:34.793 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.919+0000 7f85951c3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859007a830 con 0x7f859007bdf0 2023-07-21T22:09:34.793 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.919+0000 7f858ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859007a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:34.793 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.919+0000 7f858ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859007a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47488/0 (socket says 172.21.15.151:47488) 2023-07-21T22:09:34.794 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.919+0000 7f858ed9d700 1 -- 172.21.15.151:0/1738086979 learned_addr learned my addr 172.21.15.151:0/1738086979 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:34.794 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.920+0000 7f858ed9d700 1 -- 172.21.15.151:0/1738086979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f859007a970 con 0x7f859007bdf0 2023-07-21T22:09:34.794 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.920+0000 7f858ed9d700 1 --2- 172.21.15.151:0/1738086979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859007a2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f85800098a0 tx=0x7f8580009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b144f79188a1c795 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:34.794 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.920+0000 7f858dd9b700 1 -- 172.21.15.151:0/1738086979 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8580004160 con 0x7f859007bdf0 2023-07-21T22:09:34.794 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.920+0000 7f858dd9b700 1 -- 172.21.15.151:0/1738086979 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85800042c0 con 0x7f859007bdf0 2023-07-21T22:09:34.794 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.920+0000 7f858dd9b700 1 -- 172.21.15.151:0/1738086979 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85800118e0 con 0x7f859007bdf0 2023-07-21T22:09:34.794 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.921+0000 7f85951c3700 1 -- 172.21.15.151:0/1738086979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 msgr2=0x7f859007a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:34.795 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.921+0000 7f85951c3700 1 --2- 172.21.15.151:0/1738086979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859007a2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f85800098a0 tx=0x7f8580009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:34.795 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.921+0000 7f85951c3700 1 -- 172.21.15.151:0/1738086979 shutdown_connections 2023-07-21T22:09:34.795 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.921+0000 7f85951c3700 1 --2- 172.21.15.151:0/1738086979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859007a2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:34.795 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.921+0000 7f85951c3700 1 -- 172.21.15.151:0/1738086979 >> 172.21.15.151:0/1738086979 conn(0x7f8590100890 msgr2=0x7f8590102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:34.795 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.921+0000 7f85951c3700 1 -- 172.21.15.151:0/1738086979 shutdown_connections 2023-07-21T22:09:34.795 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.921+0000 7f85951c3700 1 -- 172.21.15.151:0/1738086979 wait complete. 2023-07-21T22:09:34.795 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.922+0000 7f85951c3700 1 Processor -- start 2023-07-21T22:09:34.795 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.922+0000 7f85951c3700 1 -- start start 2023-07-21T22:09:34.796 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.923+0000 7f85951c3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859019b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:34.796 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.923+0000 7f85951c3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859019b680 con 0x7f859007bdf0 2023-07-21T22:09:34.796 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.923+0000 7f858ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859019b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:34.796 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.923+0000 7f858ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859019b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47490/0 (socket says 172.21.15.151:47490) 2023-07-21T22:09:34.796 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.923+0000 7f858ed9d700 1 -- 172.21.15.151:0/362455228 learned_addr learned my addr 172.21.15.151:0/362455228 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:34.796 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.923+0000 7f858ed9d700 1 -- 172.21.15.151:0/362455228 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580009550 con 0x7f859007bdf0 2023-07-21T22:09:34.796 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.924+0000 7f858ed9d700 1 --2- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859019b140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8580003e30 tx=0x7f85800119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:34.797 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.924+0000 7f8577fff700 1 -- 172.21.15.151:0/362455228 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f85800036a0 con 0x7f859007bdf0 2023-07-21T22:09:34.797 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.924+0000 7f8577fff700 1 -- 172.21.15.151:0/362455228 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f858001b440 con 0x7f859007bdf0 2023-07-21T22:09:34.797 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.924+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859019b880 con 0x7f859007bdf0 2023-07-21T22:09:34.797 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.924+0000 7f8577fff700 1 -- 172.21.15.151:0/362455228 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f8580023400 con 0x7f859007bdf0 2023-07-21T22:09:34.797 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.924+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859019bca0 con 0x7f859007bdf0 2023-07-21T22:09:34.797 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.925+0000 7f8577fff700 1 -- 172.21.15.151:0/362455228 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 8) v1 ==== 45483+0+0 (secure 0 0 0) 0x7f8580003800 con 0x7f859007bdf0 2023-07-21T22:09:34.797 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.925+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8590061b40 con 0x7f859007bdf0 2023-07-21T22:09:34.797 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.926+0000 7f8577fff700 1 --2- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f8578038760 0x7f857803ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:34.798 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.926+0000 7f8577fff700 1 -- 172.21.15.151:0/362455228 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f858004c6d0 con 0x7f859007bdf0 2023-07-21T22:09:34.798 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.926+0000 7f858e59c700 1 --2- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f8578038760 0x7f857803ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:34.798 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.927+0000 7f858e59c700 1 --2- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f8578038760 0x7f857803ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8584006fd0 tx=0x7f8584006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:34.798 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:32.931+0000 7f8577fff700 1 -- 172.21.15.151:0/362455228 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8580003ab0 con 0x7f859007bdf0 2023-07-21T22:09:34.798 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:33.194+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7f859019ed90 con 0x7f859007bdf0 2023-07-21T22:09:34.798 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.181+0000 7f8577fff700 1 -- 172.21.15.151:0/362455228 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f858001b960 con 0x7f859007bdf0 2023-07-21T22:09:34.798 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.183+0000 7f8577fff700 1 -- 172.21.15.151:0/362455228 <== mon.0 v2:172.21.15.151:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7f858004c020 con 0x7f859007bdf0 2023-07-21T22:09:34.799 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.186+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f8578038760 msgr2=0x7f857803ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:34.799 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.186+0000 7f85951c3700 1 --2- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f8578038760 0x7f857803ac10 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f8584006fd0 tx=0x7f8584006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:34.799 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.186+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 msgr2=0x7f859019b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:34.799 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.186+0000 7f85951c3700 1 --2- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859019b140 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8580003e30 tx=0x7f85800119a0 comp rx=0 tx=0).stop 2023-07-21T22:09:34.799 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.186+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 shutdown_connections 2023-07-21T22:09:34.799 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.186+0000 7f85951c3700 1 --2- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f8578038760 0x7f857803ac10 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:34.799 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.186+0000 7f85951c3700 1 --2- 172.21.15.151:0/362455228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f859007bdf0 0x7f859019b140 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:34.800 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.186+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 >> 172.21.15.151:0/362455228 conn(0x7f8590100890 msgr2=0x7f8590101f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:34.800 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.187+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 shutdown_connections 2023-07-21T22:09:34.800 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:34.187+0000 7f85951c3700 1 -- 172.21.15.151:0/362455228 wait complete. 2023-07-21T22:09:34.871 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:34.602+0000 7f523d14b200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:09:34.871 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:34.723+0000 7f523d14b200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:09:35.132 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:34.858+0000 7f523d14b200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:09:35.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:35 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/362455228' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2023-07-21T22:09:35.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:35 smithi151 ceph-mon[95510]: mgrmap e9: x(active, since 18s) 2023-07-21T22:09:35.446 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:35.094+0000 7f523d14b200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:09:35.827 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:35.504+0000 7f523d14b200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:09:35.827 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:35.622+0000 7f523d14b200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:09:36.170 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:35.798+0000 7f523d14b200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:09:36.170 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:35.923+0000 7f523d14b200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:09:36.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout { 2023-07-21T22:09:36.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "epoch": 9, 2023-07-21T22:09:36.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "available": true, 2023-07-21T22:09:36.174 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "active_name": "x", 2023-07-21T22:09:36.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "num_standby": 0 2023-07-21T22:09:36.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout } 2023-07-21T22:09:36.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.377+0000 7f950a457700 1 Processor -- start 2023-07-21T22:09:36.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.377+0000 7f950a457700 1 -- start start 2023-07-21T22:09:36.175 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.377+0000 7f950a457700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950407a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:36.179 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.377+0000 7f950a457700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950407a830 con 0x7f950407bdf0 2023-07-21T22:09:36.179 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.378+0000 7f9503fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950407a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:36.179 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.378+0000 7f9503fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950407a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47514/0 (socket says 172.21.15.151:47514) 2023-07-21T22:09:36.179 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.378+0000 7f9503fff700 1 -- 172.21.15.151:0/2932478821 learned_addr learned my addr 172.21.15.151:0/2932478821 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:36.179 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.378+0000 7f9503fff700 1 -- 172.21.15.151:0/2932478821 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950407a970 con 0x7f950407bdf0 2023-07-21T22:09:36.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.378+0000 7f9503fff700 1 --2- 172.21.15.151:0/2932478821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950407a2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94f40098a0 tx=0x7f94f4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e543a5646333b835 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:36.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f9502ffd700 1 -- 172.21.15.151:0/2932478821 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94f4004160 con 0x7f950407bdf0 2023-07-21T22:09:36.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f9502ffd700 1 -- 172.21.15.151:0/2932478821 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f94f40042c0 con 0x7f950407bdf0 2023-07-21T22:09:36.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f9502ffd700 1 -- 172.21.15.151:0/2932478821 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94f40118e0 con 0x7f950407bdf0 2023-07-21T22:09:36.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f950a457700 1 -- 172.21.15.151:0/2932478821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 msgr2=0x7f950407a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:36.180 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f950a457700 1 --2- 172.21.15.151:0/2932478821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950407a2f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f94f40098a0 tx=0x7f94f4009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f950a457700 1 -- 172.21.15.151:0/2932478821 shutdown_connections 2023-07-21T22:09:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f950a457700 1 --2- 172.21.15.151:0/2932478821 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950407a2f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f950a457700 1 -- 172.21.15.151:0/2932478821 >> 172.21.15.151:0/2932478821 conn(0x7f9504100900 msgr2=0x7f9504102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f950a457700 1 -- 172.21.15.151:0/2932478821 shutdown_connections 2023-07-21T22:09:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.379+0000 7f950a457700 1 -- 172.21.15.151:0/2932478821 wait complete. 2023-07-21T22:09:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.381+0000 7f950a457700 1 Processor -- start 2023-07-21T22:09:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.381+0000 7f950a457700 1 -- start start 2023-07-21T22:09:36.181 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.382+0000 7f950a457700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950419b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.382+0000 7f950a457700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f950419b740 con 0x7f950407bdf0 2023-07-21T22:09:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.382+0000 7f9503fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950419b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.382+0000 7f9503fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950419b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47516/0 (socket says 172.21.15.151:47516) 2023-07-21T22:09:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.382+0000 7f9503fff700 1 -- 172.21.15.151:0/2228521816 learned_addr learned my addr 172.21.15.151:0/2228521816 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.382+0000 7f9503fff700 1 -- 172.21.15.151:0/2228521816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f4009550 con 0x7f950407bdf0 2023-07-21T22:09:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.382+0000 7f9503fff700 1 --2- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950419b200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94f4006af0 tx=0x7f94f4011ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.383+0000 7f95017fa700 1 -- 172.21.15.151:0/2228521816 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94f40037d0 con 0x7f950407bdf0 2023-07-21T22:09:36.182 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.383+0000 7f95017fa700 1 -- 172.21.15.151:0/2228521816 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f94f401b440 con 0x7f950407bdf0 2023-07-21T22:09:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.383+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f950419b940 con 0x7f950407bdf0 2023-07-21T22:09:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.383+0000 7f95017fa700 1 -- 172.21.15.151:0/2228521816 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f94f4023400 con 0x7f950407bdf0 2023-07-21T22:09:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.383+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950419bd60 con 0x7f950407bdf0 2023-07-21T22:09:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.384+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95041951b0 con 0x7f950407bdf0 2023-07-21T22:09:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.385+0000 7f95017fa700 1 -- 172.21.15.151:0/2228521816 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f94f401b5d0 con 0x7f950407bdf0 2023-07-21T22:09:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.385+0000 7f95017fa700 1 --2- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f94ec038760 0x7f94ec03ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:36.183 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.385+0000 7f95017fa700 1 -- 172.21.15.151:0/2228521816 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7f94f404c8d0 con 0x7f950407bdf0 2023-07-21T22:09:36.184 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.385+0000 7f95037fe700 1 -- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f94ec038760 msgr2=0x7f94ec03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/191414094 2023-07-21T22:09:36.184 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.385+0000 7f95037fe700 1 --2- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f94ec038760 0x7f94ec03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:09:36.184 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.390+0000 7f95017fa700 1 -- 172.21.15.151:0/2228521816 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f94f401b8d0 con 0x7f950407bdf0 2023-07-21T22:09:36.185 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.586+0000 7f95037fe700 1 -- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f94ec038760 msgr2=0x7f94ec03ac10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/191414094 2023-07-21T22:09:36.185 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.586+0000 7f95037fe700 1 --2- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f94ec038760 0x7f94ec03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:09:36.185 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.643+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9504061b40 con 0x7f950407bdf0 2023-07-21T22:09:36.185 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.644+0000 7f95017fa700 1 -- 172.21.15.151:0/2228521816 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+88 (secure 0 0 0) 0x7f94f402ae60 con 0x7f950407bdf0 2023-07-21T22:09:36.185 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f94ec038760 msgr2=0x7f94ec03ac10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:09:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 --2- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f94ec038760 0x7f94ec03ac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 msgr2=0x7f950419b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 --2- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950419b200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f94f4006af0 tx=0x7f94f4011ed0 comp rx=0 tx=0).stop 2023-07-21T22:09:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 shutdown_connections 2023-07-21T22:09:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 --2- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7f94ec038760 0x7f94ec03ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 --2- 172.21.15.151:0/2228521816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f950407bdf0 0x7f950419b200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:36.186 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 >> 172.21.15.151:0/2228521816 conn(0x7f9504100900 msgr2=0x7f9504102020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:36.187 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 shutdown_connections 2023-07-21T22:09:36.187 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:35.646+0000 7f950a457700 1 -- 172.21.15.151:0/2228521816 wait complete. 2023-07-21T22:09:36.187 INFO:teuthology.orchestra.run.smithi151.stdout:Waiting for the mgr to restart... 2023-07-21T22:09:36.187 INFO:teuthology.orchestra.run.smithi151.stdout:Waiting for mgr epoch 9... 2023-07-21T22:09:36.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:36 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2228521816' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2023-07-21T22:09:36.945 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:36 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:36.483+0000 7f523d14b200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:09:37.695 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:37 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:37.240+0000 7f523d14b200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T22:09:37.696 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:37 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:37.449+0000 7f523d14b200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:09:38.695 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:38 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:38.394+0000 7f523d14b200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:09:38.696 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:38 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:38.515+0000 7f523d14b200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:09:39.136 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:38 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:38.737+0000 7f523d14b200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:09:39.412 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:39 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:39.095+0000 7f523d14b200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T22:09:39.695 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:39 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:39.371+0000 7f523d14b200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:09:39.696 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:39 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:39.562+0000 7f523d14b200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:09:40.445 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:39 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:39.904+0000 7f523d14b200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:09:41.195 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:40 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:40.832+0000 7f523d14b200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:09:41.196 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:41.003+0000 7f523d14b200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:09:41.695 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:41.253+0000 7f523d14b200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:09:41.696 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:41.402+0000 7f523d14b200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:09:42.195 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:41.676+0000 7f523d14b200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:09:43.196 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:09:42.749+0000 7f523d14b200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:09:43.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: Active manager daemon x restarted 2023-07-21T22:09:43.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: Activating manager daemon x 2023-07-21T22:09:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: osdmap e3: 0 total, 0 up, 0 in 2023-07-21T22:09:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: mgrmap e10: x(active, starting, since 0.00638188s) 2023-07-21T22:09:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:09:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-21T22:09:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-21T22:09:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-21T22:09:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-21T22:09:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: Manager daemon x is now available 2023-07-21T22:09:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:44.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-21T22:09:44.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-21T22:09:44.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:43 smithi151 ceph-mon[95510]: mgrmap e11: x(active, since 1.00755s) 2023-07-21T22:09:44.279 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout { 2023-07-21T22:09:44.279 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2023-07-21T22:09:44.279 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout "initialized": true 2023-07-21T22:09:44.280 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout } 2023-07-21T22:09:44.280 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.712+0000 7fc2f1eab700 1 Processor -- start 2023-07-21T22:09:44.280 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.712+0000 7fc2f1eab700 1 -- start start 2023-07-21T22:09:44.280 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.713+0000 7fc2f1eab700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec07a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:44.280 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.713+0000 7fc2f1eab700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec07a830 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.280 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.713+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec07a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:44.280 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.713+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec07a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51902/0 (socket says 172.21.15.151:51902) 2023-07-21T22:09:44.281 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.713+0000 7fc2eb7fe700 1 -- 172.21.15.151:0/1788044134 learned_addr learned my addr 172.21.15.151:0/1788044134 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:44.281 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.714+0000 7fc2eb7fe700 1 -- 172.21.15.151:0/1788044134 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2ec07a970 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.281 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.714+0000 7fc2eb7fe700 1 --2- 172.21.15.151:0/1788044134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec07a2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0098a0 tx=0x7fc2dc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1daaed7b0aef3849 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:44.282 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.714+0000 7fc2ea7fc700 1 -- 172.21.15.151:0/1788044134 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc004160 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.282 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.714+0000 7fc2ea7fc700 1 -- 172.21.15.151:0/1788044134 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2dc0042c0 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.282 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.714+0000 7fc2ea7fc700 1 -- 172.21.15.151:0/1788044134 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc0118e0 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.282 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.715+0000 7fc2f1eab700 1 -- 172.21.15.151:0/1788044134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 msgr2=0x7fc2ec07a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:44.283 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.715+0000 7fc2f1eab700 1 --2- 172.21.15.151:0/1788044134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec07a2f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0098a0 tx=0x7fc2dc009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:44.283 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.715+0000 7fc2f1eab700 1 -- 172.21.15.151:0/1788044134 shutdown_connections 2023-07-21T22:09:44.283 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.715+0000 7fc2f1eab700 1 --2- 172.21.15.151:0/1788044134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec07a2f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:44.283 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.715+0000 7fc2f1eab700 1 -- 172.21.15.151:0/1788044134 >> 172.21.15.151:0/1788044134 conn(0x7fc2ec100900 msgr2=0x7fc2ec102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:44.284 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.715+0000 7fc2f1eab700 1 -- 172.21.15.151:0/1788044134 shutdown_connections 2023-07-21T22:09:44.284 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.715+0000 7fc2f1eab700 1 -- 172.21.15.151:0/1788044134 wait complete. 2023-07-21T22:09:44.284 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.716+0000 7fc2f1eab700 1 Processor -- start 2023-07-21T22:09:44.284 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.717+0000 7fc2f1eab700 1 -- start start 2023-07-21T22:09:44.285 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.717+0000 7fc2f1eab700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec19b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:44.285 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.717+0000 7fc2f1eab700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2ec19b740 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.285 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.717+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec19b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:44.285 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.717+0000 7fc2eb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec19b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51916/0 (socket says 172.21.15.151:51916) 2023-07-21T22:09:44.286 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.717+0000 7fc2eb7fe700 1 -- 172.21.15.151:0/3104426187 learned_addr learned my addr 172.21.15.151:0/3104426187 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:44.286 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.718+0000 7fc2eb7fe700 1 -- 172.21.15.151:0/3104426187 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2dc009550 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.286 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.718+0000 7fc2eb7fe700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec19b200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc003e30 tx=0x7fc2dc0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:44.286 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.718+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc0036a0 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.287 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.718+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc2dc01b440 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.287 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.718+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc2dc023400 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.287 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.718+0000 7fc2f1eab700 1 -- 172.21.15.151:0/3104426187 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2ec19b940 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.287 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.719+0000 7fc2f1eab700 1 -- 172.21.15.151:0/3104426187 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2ec19bd60 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.288 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.720+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 9) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fc2dc01b5b0 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.288 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.720+0000 7fc2e8ff9700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 0x7fc2d403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:44.288 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.720+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 --> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2d403b370 con 0x7fc2d40387b0 2023-07-21T22:09:44.289 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.720+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 940+0+0 (secure 0 0 0) 0x7fc2dc04c640 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.289 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.720+0000 7fc2eaffd700 1 -- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 msgr2=0x7fc2d403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/191414094 2023-07-21T22:09:44.289 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.720+0000 7fc2eaffd700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 0x7fc2d403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:09:44.289 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.921+0000 7fc2eaffd700 1 -- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 msgr2=0x7fc2d403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/191414094 2023-07-21T22:09:44.290 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:36.921+0000 7fc2eaffd700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 0x7fc2d403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:09:44.290 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:37.322+0000 7fc2eaffd700 1 -- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 msgr2=0x7fc2d403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/191414094 2023-07-21T22:09:44.290 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:37.322+0000 7fc2eaffd700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 0x7fc2d403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:09:44.290 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:38.123+0000 7fc2eaffd700 1 -- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 msgr2=0x7fc2d403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/191414094 2023-07-21T22:09:44.291 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:38.123+0000 7fc2eaffd700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 0x7fc2d403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:09:44.291 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:39.725+0000 7fc2eaffd700 1 -- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 msgr2=0x7fc2d403ac60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/191414094 2023-07-21T22:09:44.291 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:39.725+0000 7fc2eaffd700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 0x7fc2d403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-21T22:09:44.292 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:42.756+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mgrmap(e 10) v1 ==== 45263+0+0 (secure 0 0 0) 0x7fc2dc003800 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.292 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:42.756+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 msgr2=0x7fc2d403ac60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:09:44.292 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:42.756+0000 7fc2e8ff9700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 0x7fc2d403ac60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:44.292 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.756+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 11) v1 ==== 45390+0+0 (secure 0 0 0) 0x7fc2dc04e700 con 0x7fc2ec07bdf0 2023-07-21T22:09:44.293 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.756+0000 7fc2e8ff9700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2d403bff0 0x7fc2d403e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:44.293 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.757+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc2d403b370 con 0x7fc2d403bff0 2023-07-21T22:09:44.293 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.757+0000 7fc2eaffd700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2d403bff0 0x7fc2d403e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:44.294 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.758+0000 7fc2eaffd700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2d403bff0 0x7fc2d403e3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0003a10 tx=0x7fc2e0009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:44.294 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.759+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6910 (secure 0 0 0) 0x7fc2d403b370 con 0x7fc2d403bff0 2023-07-21T22:09:44.294 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.766+0000 7fc2f1eab700 1 -- 172.21.15.151:0/3104426187 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fc2ec19c540 con 0x7fc2d403bff0 2023-07-21T22:09:44.294 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.766+0000 7fc2e8ff9700 1 -- 172.21.15.151:0/3104426187 <== mgr.14152 v2:172.21.15.151:6800/3677157440 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7fc2ec19c540 con 0x7fc2d403bff0 2023-07-21T22:09:44.295 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.766+0000 7fc2f1eab700 1 -- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2d403bff0 msgr2=0x7fc2d403e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:44.295 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.766+0000 7fc2f1eab700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2d403bff0 0x7fc2d403e3d0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0003a10 tx=0x7fc2e0009270 comp rx=0 tx=0).stop 2023-07-21T22:09:44.295 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.766+0000 7fc2f1eab700 1 -- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 msgr2=0x7fc2ec19b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:44.295 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.766+0000 7fc2f1eab700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec19b200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc003e30 tx=0x7fc2dc0119a0 comp rx=0 tx=0).stop 2023-07-21T22:09:44.296 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.767+0000 7fc2f1eab700 1 -- 172.21.15.151:0/3104426187 shutdown_connections 2023-07-21T22:09:44.296 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.767+0000 7fc2f1eab700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2d403bff0 0x7fc2d403e3d0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:44.296 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.767+0000 7fc2f1eab700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2ec07bdf0 0x7fc2ec19b200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:44.296 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.767+0000 7fc2f1eab700 1 --2- 172.21.15.151:0/3104426187 >> [v2:172.21.15.151:6800/191414094,v1:172.21.15.151:6801/191414094] conn(0x7fc2d40387b0 0x7fc2d403ac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:44.297 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.767+0000 7fc2f1eab700 1 -- 172.21.15.151:0/3104426187 >> 172.21.15.151:0/3104426187 conn(0x7fc2ec100900 msgr2=0x7fc2ec102020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:44.297 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.767+0000 7fc2f1eab700 1 -- 172.21.15.151:0/3104426187 shutdown_connections 2023-07-21T22:09:44.297 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:43.767+0000 7fc2f1eab700 1 -- 172.21.15.151:0/3104426187 wait complete. 2023-07-21T22:09:44.297 INFO:teuthology.orchestra.run.smithi151.stdout:mgr epoch 9 is available 2023-07-21T22:09:44.298 INFO:teuthology.orchestra.run.smithi151.stdout:Generating a dashboard self-signed certificate... 2023-07-21T22:09:45.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:44 smithi151 ceph-mon[95510]: [21/Jul/2023:22:09:43] ENGINE Bus STARTING 2023-07-21T22:09:45.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:44 smithi151 ceph-mon[95510]: [21/Jul/2023:22:09:43] ENGINE Serving on http://172.21.15.151:8765 2023-07-21T22:09:45.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:44 smithi151 ceph-mon[95510]: [21/Jul/2023:22:09:43] ENGINE Serving on https://172.21.15.151:7150 2023-07-21T22:09:45.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:44 smithi151 ceph-mon[95510]: [21/Jul/2023:22:09:43] ENGINE Bus STARTED 2023-07-21T22:09:45.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:44 smithi151 ceph-mon[95510]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2023-07-21T22:09:45.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:44 smithi151 ceph-mon[95510]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2023-07-21T22:09:45.562 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2023-07-21T22:09:45.562 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.828+0000 7f7b1fedb700 1 Processor -- start 2023-07-21T22:09:45.562 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.828+0000 7f7b1fedb700 1 -- start start 2023-07-21T22:09:45.562 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.828+0000 7f7b1fedb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1807a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:45.562 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.828+0000 7f7b1fedb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1807a870 con 0x7f7b1807be30 2023-07-21T22:09:45.562 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.829+0000 7f7b1dc77700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1807a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:45.563 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.829+0000 7f7b1dc77700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1807a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51984/0 (socket says 172.21.15.151:51984) 2023-07-21T22:09:45.563 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.829+0000 7f7b1dc77700 1 -- 172.21.15.151:0/3646623791 learned_addr learned my addr 172.21.15.151:0/3646623791 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:45.563 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.829+0000 7f7b1dc77700 1 -- 172.21.15.151:0/3646623791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b1807a9b0 con 0x7f7b1807be30 2023-07-21T22:09:45.563 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.830+0000 7f7b1dc77700 1 --2- 172.21.15.151:0/3646623791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1807a330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b140098a0 tx=0x7f7b14009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437f65c1b3e6ba44 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:45.563 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.830+0000 7f7b1cc75700 1 -- 172.21.15.151:0/3646623791 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b14004160 con 0x7f7b1807be30 2023-07-21T22:09:45.563 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.830+0000 7f7b1cc75700 1 -- 172.21.15.151:0/3646623791 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b140042c0 con 0x7f7b1807be30 2023-07-21T22:09:45.563 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.830+0000 7f7b1cc75700 1 -- 172.21.15.151:0/3646623791 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b140118e0 con 0x7f7b1807be30 2023-07-21T22:09:45.564 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.830+0000 7f7b1fedb700 1 -- 172.21.15.151:0/3646623791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 msgr2=0x7f7b1807a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:45.564 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.830+0000 7f7b1fedb700 1 --2- 172.21.15.151:0/3646623791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1807a330 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7b140098a0 tx=0x7f7b14009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:45.564 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.831+0000 7f7b1fedb700 1 -- 172.21.15.151:0/3646623791 shutdown_connections 2023-07-21T22:09:45.564 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.831+0000 7f7b1fedb700 1 --2- 172.21.15.151:0/3646623791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1807a330 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:45.564 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.831+0000 7f7b1fedb700 1 -- 172.21.15.151:0/3646623791 >> 172.21.15.151:0/3646623791 conn(0x7f7b18100900 msgr2=0x7f7b18102d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:45.564 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.831+0000 7f7b1fedb700 1 -- 172.21.15.151:0/3646623791 shutdown_connections 2023-07-21T22:09:45.564 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.831+0000 7f7b1fedb700 1 -- 172.21.15.151:0/3646623791 wait complete. 2023-07-21T22:09:45.565 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.832+0000 7f7b1fedb700 1 Processor -- start 2023-07-21T22:09:45.565 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.832+0000 7f7b1fedb700 1 -- start start 2023-07-21T22:09:45.565 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.832+0000 7f7b1fedb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1819b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:45.565 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.832+0000 7f7b1fedb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1819b780 con 0x7f7b1807be30 2023-07-21T22:09:45.565 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.833+0000 7f7b1dc77700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1819b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:45.565 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.833+0000 7f7b1dc77700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1819b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51988/0 (socket says 172.21.15.151:51988) 2023-07-21T22:09:45.565 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.833+0000 7f7b1dc77700 1 -- 172.21.15.151:0/404905203 learned_addr learned my addr 172.21.15.151:0/404905203 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:45.566 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.833+0000 7f7b1dc77700 1 -- 172.21.15.151:0/404905203 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b14009550 con 0x7f7b1807be30 2023-07-21T22:09:45.566 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.833+0000 7f7b1dc77700 1 --2- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1819b240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7b14003e30 tx=0x7f7b14011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:45.566 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.833+0000 7f7b0effd700 1 -- 172.21.15.151:0/404905203 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b140037d0 con 0x7f7b1807be30 2023-07-21T22:09:45.566 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.833+0000 7f7b0effd700 1 -- 172.21.15.151:0/404905203 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b1401b440 con 0x7f7b1807be30 2023-07-21T22:09:45.566 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.833+0000 7f7b0effd700 1 -- 172.21.15.151:0/404905203 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7b14023400 con 0x7f7b1807be30 2023-07-21T22:09:45.566 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.833+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1819b980 con 0x7f7b1807be30 2023-07-21T22:09:45.566 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.834+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1819bda0 con 0x7f7b1807be30 2023-07-21T22:09:45.566 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.835+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b181951a0 con 0x7f7b1807be30 2023-07-21T22:09:45.567 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.835+0000 7f7b0effd700 1 -- 172.21.15.151:0/404905203 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f7b14003930 con 0x7f7b1807be30 2023-07-21T22:09:45.567 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.836+0000 7f7b0effd700 1 --2- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7b04038790 0x7f7b0403ac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:45.567 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.836+0000 7f7b0effd700 1 -- 172.21.15.151:0/404905203 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7b1404c7c0 con 0x7f7b1807be30 2023-07-21T22:09:45.567 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.836+0000 7f7b1d476700 1 --2- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7b04038790 0x7f7b0403ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:45.567 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.837+0000 7f7b1d476700 1 --2- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7b04038790 0x7f7b0403ac40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7b08006fd0 tx=0x7f7b08006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:45.567 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:44.842+0000 7f7b0effd700 1 -- 172.21.15.151:0/404905203 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f7b1402b350 con 0x7f7b1807be30 2023-07-21T22:09:45.567 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.055+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b18060950 con 0x7f7b04038790 2023-07-21T22:09:45.568 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.135+0000 7f7b0effd700 1 -- 172.21.15.151:0/404905203 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f7b18060950 con 0x7f7b04038790 2023-07-21T22:09:45.568 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7b04038790 msgr2=0x7f7b0403ac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:45.568 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 --2- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7b04038790 0x7f7b0403ac40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7b08006fd0 tx=0x7f7b08006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:45.568 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 msgr2=0x7f7b1819b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:45.568 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 --2- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1819b240 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7b14003e30 tx=0x7f7b14011b50 comp rx=0 tx=0).stop 2023-07-21T22:09:45.568 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 shutdown_connections 2023-07-21T22:09:45.568 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 --2- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7b04038790 0x7f7b0403ac40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:45.569 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 --2- 172.21.15.151:0/404905203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1807be30 0x7f7b1819b240 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:45.569 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 >> 172.21.15.151:0/404905203 conn(0x7f7b18100900 msgr2=0x7f7b18102cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:45.569 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 shutdown_connections 2023-07-21T22:09:45.569 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:45.138+0000 7f7b1fedb700 1 -- 172.21.15.151:0/404905203 wait complete. 2023-07-21T22:09:45.569 INFO:teuthology.orchestra.run.smithi151.stdout:Creating initial admin user... 2023-07-21T22:09:46.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:45 smithi151 ceph-mon[95510]: mgrmap e12: x(active, since 2s) 2023-07-21T22:09:46.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:45 smithi151 ceph-mon[95510]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:46.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:46.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:46.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:47.037 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VphHRUDPC6i0JnfrwVZrP.mx3GI19uqjAkrXd6iE.OT0CsnPWc2fe", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1689977386, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2023-07-21T22:09:47.037 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.068+0000 7fd36bf16700 1 Processor -- start 2023-07-21T22:09:47.037 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.068+0000 7fd36bf16700 1 -- start start 2023-07-21T22:09:47.038 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.068+0000 7fd36bf16700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd364107c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:47.038 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.068+0000 7fd36bf16700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd364108180 con 0x7fd364107830 2023-07-21T22:09:47.038 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.069+0000 7fd369cb2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd364107c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:47.038 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.069+0000 7fd369cb2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd364107c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40978/0 (socket says 172.21.15.151:40978) 2023-07-21T22:09:47.038 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.069+0000 7fd369cb2700 1 -- 172.21.15.151:0/4163058757 learned_addr learned my addr 172.21.15.151:0/4163058757 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:47.038 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.069+0000 7fd369cb2700 1 -- 172.21.15.151:0/4163058757 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3641082c0 con 0x7fd364107830 2023-07-21T22:09:47.039 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.069+0000 7fd369cb2700 1 --2- 172.21.15.151:0/4163058757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd364107c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3600098a0 tx=0x7fd360009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec0107323efe6eab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:47.041 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.070+0000 7fd368cb0700 1 -- 172.21.15.151:0/4163058757 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd360004160 con 0x7fd364107830 2023-07-21T22:09:47.041 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.070+0000 7fd368cb0700 1 -- 172.21.15.151:0/4163058757 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd3600042c0 con 0x7fd364107830 2023-07-21T22:09:47.041 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.070+0000 7fd368cb0700 1 -- 172.21.15.151:0/4163058757 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3600118e0 con 0x7fd364107830 2023-07-21T22:09:47.041 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.070+0000 7fd36bf16700 1 -- 172.21.15.151:0/4163058757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 msgr2=0x7fd364107c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:47.041 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.070+0000 7fd36bf16700 1 --2- 172.21.15.151:0/4163058757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd364107c40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3600098a0 tx=0x7fd360009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:47.042 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.070+0000 7fd36bf16700 1 -- 172.21.15.151:0/4163058757 shutdown_connections 2023-07-21T22:09:47.042 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.070+0000 7fd36bf16700 1 --2- 172.21.15.151:0/4163058757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd364107c40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:47.042 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.070+0000 7fd36bf16700 1 -- 172.21.15.151:0/4163058757 >> 172.21.15.151:0/4163058757 conn(0x7fd36407a8a0 msgr2=0x7fd36407aca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:47.042 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.071+0000 7fd36bf16700 1 -- 172.21.15.151:0/4163058757 shutdown_connections 2023-07-21T22:09:47.042 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.071+0000 7fd36bf16700 1 -- 172.21.15.151:0/4163058757 wait complete. 2023-07-21T22:09:47.042 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.072+0000 7fd36bf16700 1 Processor -- start 2023-07-21T22:09:47.042 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.072+0000 7fd36bf16700 1 -- start start 2023-07-21T22:09:47.042 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.072+0000 7fd36bf16700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd36419b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:47.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.072+0000 7fd36bf16700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd36419b680 con 0x7fd364107830 2023-07-21T22:09:47.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.072+0000 7fd369cb2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd36419b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:47.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.072+0000 7fd369cb2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd36419b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40982/0 (socket says 172.21.15.151:40982) 2023-07-21T22:09:47.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.072+0000 7fd369cb2700 1 -- 172.21.15.151:0/2861684466 learned_addr learned my addr 172.21.15.151:0/2861684466 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:47.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.073+0000 7fd369cb2700 1 -- 172.21.15.151:0/2861684466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd360009550 con 0x7fd364107830 2023-07-21T22:09:47.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.073+0000 7fd369cb2700 1 --2- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd36419b140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd360000c00 tx=0x7fd3600119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:47.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.073+0000 7fd35affd700 1 -- 172.21.15.151:0/2861684466 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd3600036a0 con 0x7fd364107830 2023-07-21T22:09:47.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.073+0000 7fd35affd700 1 -- 172.21.15.151:0/2861684466 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd36001b440 con 0x7fd364107830 2023-07-21T22:09:47.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.073+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd36419b880 con 0x7fd364107830 2023-07-21T22:09:47.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.073+0000 7fd35affd700 1 -- 172.21.15.151:0/2861684466 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd36001a3d0 con 0x7fd364107830 2023-07-21T22:09:47.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.073+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd36419bca0 con 0x7fd364107830 2023-07-21T22:09:47.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.074+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd364061b40 con 0x7fd364107830 2023-07-21T22:09:47.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.075+0000 7fd35affd700 1 -- 172.21.15.151:0/2861684466 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fd36001b5b0 con 0x7fd364107830 2023-07-21T22:09:47.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.075+0000 7fd35affd700 1 --2- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd3500387b0 0x7fd35003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:47.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.075+0000 7fd35affd700 1 -- 172.21.15.151:0/2861684466 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd36004c730 con 0x7fd364107830 2023-07-21T22:09:47.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.075+0000 7fd3694b1700 1 --2- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd3500387b0 0x7fd35003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:47.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.076+0000 7fd3694b1700 1 --2- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd3500387b0 0x7fd35003ac60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd354006fd0 tx=0x7fd354006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:47.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.080+0000 7fd35affd700 1 -- 172.21.15.151:0/2861684466 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd360023c00 con 0x7fd364107830 2023-07-21T22:09:47.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.302+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd364109310 con 0x7fd3500387b0 2023-07-21T22:09:47.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.527+0000 7fd35affd700 1 -- 172.21.15.151:0/2861684466 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fd364109310 con 0x7fd3500387b0 2023-07-21T22:09:47.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.529+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd3500387b0 msgr2=0x7fd35003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:47.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.529+0000 7fd36bf16700 1 --2- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd3500387b0 0x7fd35003ac60 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fd354006fd0 tx=0x7fd354006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:47.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.529+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 msgr2=0x7fd36419b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:47.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.529+0000 7fd36bf16700 1 --2- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd36419b140 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd360000c00 tx=0x7fd3600119a0 comp rx=0 tx=0).stop 2023-07-21T22:09:47.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.529+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 shutdown_connections 2023-07-21T22:09:47.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.529+0000 7fd36bf16700 1 --2- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd3500387b0 0x7fd35003ac60 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:47.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.529+0000 7fd36bf16700 1 --2- 172.21.15.151:0/2861684466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd364107830 0x7fd36419b140 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:47.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.529+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 >> 172.21.15.151:0/2861684466 conn(0x7fd36407a8a0 msgr2=0x7fd3641060d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:47.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.530+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 shutdown_connections 2023-07-21T22:09:47.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:46.530+0000 7fd36bf16700 1 -- 172.21.15.151:0/2861684466 wait complete. 2023-07-21T22:09:47.047 INFO:teuthology.orchestra.run.smithi151.stdout:Fetching dashboard port number... 2023-07-21T22:09:47.320 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:47 smithi151 ceph-mon[95510]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:47.320 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:47 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:47.320 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:47 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:48.101 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:48 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1953200359' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2023-07-21T22:09:48.617 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stdout 8443 2023-07-21T22:09:48.622 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.560+0000 7f13a3fff700 1 Processor -- start 2023-07-21T22:09:48.622 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.560+0000 7f13a3fff700 1 -- start start 2023-07-21T22:09:48.623 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.560+0000 7f13a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4079d10 0x7f13a4107bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:48.623 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.560+0000 7f13a3fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4108130 con 0x7f13a4079d10 2023-07-21T22:09:48.623 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.560+0000 7f13a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4079d10 0x7f13a4107bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:48.623 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.561+0000 7f13a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4079d10 0x7f13a4107bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40990/0 (socket says 172.21.15.151:40990) 2023-07-21T22:09:48.623 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.561+0000 7f13a2ffd700 1 -- 172.21.15.151:0/1302548584 learned_addr learned my addr 172.21.15.151:0/1302548584 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:48.623 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.561+0000 7f13a2ffd700 1 -- 172.21.15.151:0/1302548584 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a4108270 con 0x7f13a4079d10 2023-07-21T22:09:48.623 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.561+0000 7f13a2ffd700 1 --2- 172.21.15.151:0/1302548584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4079d10 0x7f13a4107bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13940098a0 tx=0x7f1394009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddcfb91169c3ac9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:48.624 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.561+0000 7f13a1ffb700 1 -- 172.21.15.151:0/1302548584 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1394004160 con 0x7f13a4079d10 2023-07-21T22:09:48.624 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.561+0000 7f13a1ffb700 1 -- 172.21.15.151:0/1302548584 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f13940042c0 con 0x7f13a4079d10 2023-07-21T22:09:48.624 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.561+0000 7f13a1ffb700 1 -- 172.21.15.151:0/1302548584 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13940118e0 con 0x7f13a4079d10 2023-07-21T22:09:48.624 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.562+0000 7f13a3fff700 1 -- 172.21.15.151:0/1302548584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4079d10 msgr2=0x7f13a4107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:48.624 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.562+0000 7f13a3fff700 1 --2- 172.21.15.151:0/1302548584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4079d10 0x7f13a4107bf0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f13940098a0 tx=0x7f1394009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:48.624 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.562+0000 7f13a3fff700 1 -- 172.21.15.151:0/1302548584 shutdown_connections 2023-07-21T22:09:48.624 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.562+0000 7f13a3fff700 1 --2- 172.21.15.151:0/1302548584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4079d10 0x7f13a4107bf0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:48.625 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.562+0000 7f13a3fff700 1 -- 172.21.15.151:0/1302548584 >> 172.21.15.151:0/1302548584 conn(0x7f13a40ff5c0 msgr2=0x7f13a41019d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:48.625 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.562+0000 7f13a3fff700 1 -- 172.21.15.151:0/1302548584 shutdown_connections 2023-07-21T22:09:48.625 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.562+0000 7f13a3fff700 1 -- 172.21.15.151:0/1302548584 wait complete. 2023-07-21T22:09:48.625 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.563+0000 7f13a3fff700 1 Processor -- start 2023-07-21T22:09:48.625 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.563+0000 7f13a3fff700 1 -- start start 2023-07-21T22:09:48.625 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.564+0000 7f13a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4105500 0x7f13a4103b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:48.625 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.564+0000 7f13a3fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a4105910 con 0x7f13a4105500 2023-07-21T22:09:48.626 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.564+0000 7f13a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4105500 0x7f13a4103b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:48.626 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.564+0000 7f13a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4105500 0x7f13a4103b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41006/0 (socket says 172.21.15.151:41006) 2023-07-21T22:09:48.626 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.564+0000 7f13a2ffd700 1 -- 172.21.15.151:0/1953200359 learned_addr learned my addr 172.21.15.151:0/1953200359 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:48.626 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.564+0000 7f13a2ffd700 1 -- 172.21.15.151:0/1953200359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1394009550 con 0x7f13a4105500 2023-07-21T22:09:48.626 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.564+0000 7f13a2ffd700 1 --2- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4105500 0x7f13a4103b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1394003e30 tx=0x7f13940119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:48.626 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.565+0000 7f138bfff700 1 -- 172.21.15.151:0/1953200359 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f13940036a0 con 0x7f13a4105500 2023-07-21T22:09:48.626 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.565+0000 7f138bfff700 1 -- 172.21.15.151:0/1953200359 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f139401b440 con 0x7f13a4105500 2023-07-21T22:09:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.565+0000 7f138bfff700 1 -- 172.21.15.151:0/1953200359 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f1394023400 con 0x7f13a4105500 2023-07-21T22:09:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.565+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a41040d0 con 0x7f13a4105500 2023-07-21T22:09:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.565+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a41044f0 con 0x7f13a4105500 2023-07-21T22:09:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.566+0000 7f138bfff700 1 -- 172.21.15.151:0/1953200359 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 12) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f139401b5b0 con 0x7f13a4105500 2023-07-21T22:09:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.566+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a4192de0 con 0x7f13a4105500 2023-07-21T22:09:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.566+0000 7f138bfff700 1 --2- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f138c0387b0 0x7f138c03ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.566+0000 7f138bfff700 1 -- 172.21.15.151:0/1953200359 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f139404c7e0 con 0x7f13a4105500 2023-07-21T22:09:48.627 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.567+0000 7f13a27fc700 1 --2- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f138c0387b0 0x7f138c03ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:48.628 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.567+0000 7f13a27fc700 1 --2- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f138c0387b0 0x7f138c03ac60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1398006fd0 tx=0x7f1398006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:48.628 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.571+0000 7f138bfff700 1 -- 172.21.15.151:0/1953200359 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f139400be40 con 0x7f13a4105500 2023-07-21T22:09:48.628 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.777+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7f13a4061b40 con 0x7f13a4105500 2023-07-21T22:09:48.628 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.777+0000 7f138bfff700 1 -- 172.21.15.151:0/1953200359 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7f139400b3e0 con 0x7f13a4105500 2023-07-21T22:09:48.628 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f138c0387b0 msgr2=0x7f138c03ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:48.628 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 --2- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f138c0387b0 0x7f138c03ac60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1398006fd0 tx=0x7f1398006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:48.628 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4105500 msgr2=0x7f13a4103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:48.629 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 --2- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4105500 0x7f13a4103b90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1394003e30 tx=0x7f13940119a0 comp rx=0 tx=0).stop 2023-07-21T22:09:48.629 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 shutdown_connections 2023-07-21T22:09:48.629 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 --2- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f138c0387b0 0x7f138c03ac60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:48.629 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 --2- 172.21.15.151:0/1953200359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a4105500 0x7f13a4103b90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:48.629 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 >> 172.21.15.151:0/1953200359 conn(0x7f13a40ff5c0 msgr2=0x7f13a4100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:48.629 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 shutdown_connections 2023-07-21T22:09:48.629 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:47.780+0000 7f13a3fff700 1 -- 172.21.15.151:0/1953200359 wait complete. 2023-07-21T22:09:48.640 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2023-07-21T22:09:48.641 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout disabled 2023-07-21T22:09:48.657 INFO:teuthology.orchestra.run.smithi151.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2023-07-21T22:09:48.658 INFO:teuthology.orchestra.run.smithi151.stdout:systemctl: stdout inactive 2023-07-21T22:09:48.658 INFO:teuthology.orchestra.run.smithi151.stdout:firewalld.service is not enabled 2023-07-21T22:09:48.658 INFO:teuthology.orchestra.run.smithi151.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2023-07-21T22:09:48.661 INFO:teuthology.orchestra.run.smithi151.stdout:Ceph Dashboard is now available at: 2023-07-21T22:09:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: URL: https://smithi151.front.sepia.ceph.com:8443/ 2023-07-21T22:09:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: User: admin 2023-07-21T22:09:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: Password: 9vdcazaz51 2023-07-21T22:09:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:48.663 INFO:teuthology.orchestra.run.smithi151.stdout:Saving cluster configuration to /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config directory 2023-07-21T22:09:48.663 INFO:teuthology.orchestra.run.smithi151.stdout:Enabling autotune for osd_memory_target 2023-07-21T22:09:50.042 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.368+0000 7fc40faef700 1 Processor -- start 2023-07-21T22:09:50.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.369+0000 7fc40faef700 1 -- start start 2023-07-21T22:09:50.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.369+0000 7fc40faef700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40807a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:50.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.369+0000 7fc40faef700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40807a870 con 0x7fc40807be30 2023-07-21T22:09:50.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.369+0000 7fc40d88b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40807a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:50.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.370+0000 7fc40d88b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40807a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41016/0 (socket says 172.21.15.151:41016) 2023-07-21T22:09:50.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.370+0000 7fc40d88b700 1 -- 172.21.15.151:0/373448529 learned_addr learned my addr 172.21.15.151:0/373448529 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:50.043 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.370+0000 7fc40d88b700 1 -- 172.21.15.151:0/373448529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc40807a9b0 con 0x7fc40807be30 2023-07-21T22:09:50.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.370+0000 7fc40d88b700 1 --2- 172.21.15.151:0/373448529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40807a330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc4040098a0 tx=0x7fc404009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58e05ae37f5e1206 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:50.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.370+0000 7fc40c889700 1 -- 172.21.15.151:0/373448529 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc404004160 con 0x7fc40807be30 2023-07-21T22:09:50.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.370+0000 7fc40c889700 1 -- 172.21.15.151:0/373448529 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4040042c0 con 0x7fc40807be30 2023-07-21T22:09:50.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.370+0000 7fc40c889700 1 -- 172.21.15.151:0/373448529 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4040118e0 con 0x7fc40807be30 2023-07-21T22:09:50.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.371+0000 7fc40faef700 1 -- 172.21.15.151:0/373448529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 msgr2=0x7fc40807a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:50.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.371+0000 7fc40faef700 1 --2- 172.21.15.151:0/373448529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40807a330 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc4040098a0 tx=0x7fc404009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:50.044 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.371+0000 7fc40faef700 1 -- 172.21.15.151:0/373448529 shutdown_connections 2023-07-21T22:09:50.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.371+0000 7fc40faef700 1 --2- 172.21.15.151:0/373448529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40807a330 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:50.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.371+0000 7fc40faef700 1 -- 172.21.15.151:0/373448529 >> 172.21.15.151:0/373448529 conn(0x7fc408100890 msgr2=0x7fc408102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:50.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.371+0000 7fc40faef700 1 -- 172.21.15.151:0/373448529 shutdown_connections 2023-07-21T22:09:50.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.371+0000 7fc40faef700 1 -- 172.21.15.151:0/373448529 wait complete. 2023-07-21T22:09:50.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.372+0000 7fc40faef700 1 Processor -- start 2023-07-21T22:09:50.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.372+0000 7fc40faef700 1 -- start start 2023-07-21T22:09:50.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.373+0000 7fc40faef700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:50.045 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.373+0000 7fc40faef700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40819b6f0 con 0x7fc40807be30 2023-07-21T22:09:50.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.373+0000 7fc40d88b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:50.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.373+0000 7fc40d88b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40819b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41018/0 (socket says 172.21.15.151:41018) 2023-07-21T22:09:50.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.373+0000 7fc40d88b700 1 -- 172.21.15.151:0/1169679108 learned_addr learned my addr 172.21.15.151:0/1169679108 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:50.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.373+0000 7fc40d88b700 1 -- 172.21.15.151:0/1169679108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404009550 con 0x7fc40807be30 2023-07-21T22:09:50.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.373+0000 7fc40d88b700 1 --2- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40819b1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc404003e30 tx=0x7fc404011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:50.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.374+0000 7fc3feffd700 1 -- 172.21.15.151:0/1169679108 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc4040037d0 con 0x7fc40807be30 2023-07-21T22:09:50.046 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.374+0000 7fc3feffd700 1 -- 172.21.15.151:0/1169679108 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc40401b440 con 0x7fc40807be30 2023-07-21T22:09:50.047 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.374+0000 7fc3feffd700 1 -- 172.21.15.151:0/1169679108 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fc404023400 con 0x7fc40807be30 2023-07-21T22:09:50.047 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.374+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc40819b8f0 con 0x7fc40807be30 2023-07-21T22:09:50.047 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.374+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc40819bd10 con 0x7fc40807be30 2023-07-21T22:09:50.047 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.375+0000 7fc3feffd700 1 -- 172.21.15.151:0/1169679108 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fc404003930 con 0x7fc40807be30 2023-07-21T22:09:50.047 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.375+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc408061b40 con 0x7fc40807be30 2023-07-21T22:09:50.047 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.375+0000 7fc3feffd700 1 --2- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc3f4038830 0x7fc3f403ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:50.047 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.375+0000 7fc3feffd700 1 -- 172.21.15.151:0/1169679108 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fc40404c850 con 0x7fc40807be30 2023-07-21T22:09:50.047 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.376+0000 7fc40d08a700 1 --2- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc3f4038830 0x7fc3f403ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:50.048 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.376+0000 7fc40d08a700 1 --2- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc3f4038830 0x7fc3f403ace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8006fd0 tx=0x7fc3f8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:50.048 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.380+0000 7fc3feffd700 1 -- 172.21.15.151:0/1169679108 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fc40402b350 con 0x7fc40807be30 2023-07-21T22:09:50.048 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.575+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7fc40819eb70 con 0x7fc40807be30 2023-07-21T22:09:50.048 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.576+0000 7fc3feffd700 1 -- 172.21.15.151:0/1169679108 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7fc40400bbd0 con 0x7fc40807be30 2023-07-21T22:09:50.048 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.578+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc3f4038830 msgr2=0x7fc3f403ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:50.048 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.578+0000 7fc40faef700 1 --2- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc3f4038830 0x7fc3f403ace0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc3f8006fd0 tx=0x7fc3f8006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:50.048 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.578+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 msgr2=0x7fc40819b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:50.049 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.578+0000 7fc40faef700 1 --2- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40819b1b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc404003e30 tx=0x7fc404011b50 comp rx=0 tx=0).stop 2023-07-21T22:09:50.049 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.578+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 shutdown_connections 2023-07-21T22:09:50.049 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.578+0000 7fc40faef700 1 --2- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc3f4038830 0x7fc3f403ace0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:50.049 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.578+0000 7fc40faef700 1 --2- 172.21.15.151:0/1169679108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc40807be30 0x7fc40819b1b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:50.049 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.578+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 >> 172.21.15.151:0/1169679108 conn(0x7fc408100890 msgr2=0x7fc408101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:50.049 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.578+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 shutdown_connections 2023-07-21T22:09:50.049 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:49.579+0000 7fc40faef700 1 -- 172.21.15.151:0/1169679108 wait complete. 2023-07-21T22:09:50.358 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:50 smithi151 ceph-mon[95510]: mgrmap e13: x(active, since 6s) 2023-07-21T22:09:51.320 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.551+0000 7fa702d81700 1 Processor -- start 2023-07-21T22:09:51.321 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.552+0000 7fa702d81700 1 -- start start 2023-07-21T22:09:51.321 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.552+0000 7fa702d81700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc07a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:51.321 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.552+0000 7fa702d81700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc07a870 con 0x7fa6fc07be30 2023-07-21T22:09:51.321 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.552+0000 7fa700b1d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc07a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:51.321 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.552+0000 7fa700b1d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc07a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41026/0 (socket says 172.21.15.151:41026) 2023-07-21T22:09:51.321 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.552+0000 7fa700b1d700 1 -- 172.21.15.151:0/3109500006 learned_addr learned my addr 172.21.15.151:0/3109500006 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:51.322 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.553+0000 7fa700b1d700 1 -- 172.21.15.151:0/3109500006 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6fc07a9b0 con 0x7fa6fc07be30 2023-07-21T22:09:51.322 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.553+0000 7fa700b1d700 1 --2- 172.21.15.151:0/3109500006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc07a330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00098a0 tx=0x7fa6f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adbac33d49e7a7ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:51.322 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.553+0000 7fa6fb7fe700 1 -- 172.21.15.151:0/3109500006 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f0004160 con 0x7fa6fc07be30 2023-07-21T22:09:51.322 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.553+0000 7fa6fb7fe700 1 -- 172.21.15.151:0/3109500006 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6f00042c0 con 0x7fa6fc07be30 2023-07-21T22:09:51.322 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.553+0000 7fa6fb7fe700 1 -- 172.21.15.151:0/3109500006 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f00118e0 con 0x7fa6fc07be30 2023-07-21T22:09:51.322 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.553+0000 7fa702d81700 1 -- 172.21.15.151:0/3109500006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 msgr2=0x7fa6fc07a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:51.322 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.553+0000 7fa702d81700 1 --2- 172.21.15.151:0/3109500006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc07a330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa6f00098a0 tx=0x7fa6f0009bb0 comp rx=0 tx=0).stop 2023-07-21T22:09:51.323 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.554+0000 7fa702d81700 1 -- 172.21.15.151:0/3109500006 shutdown_connections 2023-07-21T22:09:51.323 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.554+0000 7fa702d81700 1 --2- 172.21.15.151:0/3109500006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc07a330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:51.323 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.554+0000 7fa702d81700 1 -- 172.21.15.151:0/3109500006 >> 172.21.15.151:0/3109500006 conn(0x7fa6fc100890 msgr2=0x7fa6fc102ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:51.323 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.554+0000 7fa702d81700 1 -- 172.21.15.151:0/3109500006 shutdown_connections 2023-07-21T22:09:51.323 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.554+0000 7fa702d81700 1 -- 172.21.15.151:0/3109500006 wait complete. 2023-07-21T22:09:51.323 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.555+0000 7fa702d81700 1 Processor -- start 2023-07-21T22:09:51.323 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.555+0000 7fa702d81700 1 -- start start 2023-07-21T22:09:51.324 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.555+0000 7fa702d81700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc19b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:51.324 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.555+0000 7fa702d81700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6fc19b6f0 con 0x7fa6fc07be30 2023-07-21T22:09:51.324 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.555+0000 7fa700b1d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc19b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:51.324 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.556+0000 7fa700b1d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc19b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41040/0 (socket says 172.21.15.151:41040) 2023-07-21T22:09:51.324 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.556+0000 7fa700b1d700 1 -- 172.21.15.151:0/430297653 learned_addr learned my addr 172.21.15.151:0/430297653 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:51.324 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.556+0000 7fa700b1d700 1 -- 172.21.15.151:0/430297653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6f0009550 con 0x7fa6fc07be30 2023-07-21T22:09:51.324 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.556+0000 7fa700b1d700 1 --2- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc19b1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0003e30 tx=0x7fa6f0011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:51.325 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.556+0000 7fa6f9ffb700 1 -- 172.21.15.151:0/430297653 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f00037d0 con 0x7fa6fc07be30 2023-07-21T22:09:51.325 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.556+0000 7fa6f9ffb700 1 -- 172.21.15.151:0/430297653 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa6f001b440 con 0x7fa6fc07be30 2023-07-21T22:09:51.325 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.556+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6fc19b8f0 con 0x7fa6fc07be30 2023-07-21T22:09:51.325 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.556+0000 7fa6f9ffb700 1 -- 172.21.15.151:0/430297653 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fa6f0023400 con 0x7fa6fc07be30 2023-07-21T22:09:51.325 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.556+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6fc19bd10 con 0x7fa6fc07be30 2023-07-21T22:09:51.325 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.557+0000 7fa6f9ffb700 1 -- 172.21.15.151:0/430297653 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fa6f0003930 con 0x7fa6fc07be30 2023-07-21T22:09:51.327 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.557+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6fc061b40 con 0x7fa6fc07be30 2023-07-21T22:09:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.558+0000 7fa6f9ffb700 1 --2- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa6ec038880 0x7fa6ec03ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.558+0000 7fa6f9ffb700 1 -- 172.21.15.151:0/430297653 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fa6f004c950 con 0x7fa6fc07be30 2023-07-21T22:09:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.558+0000 7fa6fbfff700 1 --2- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa6ec038880 0x7fa6ec03ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.559+0000 7fa6fbfff700 1 --2- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa6ec038880 0x7fa6ec03ad30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8006fd0 tx=0x7fa6e8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.562+0000 7fa6f9ffb700 1 -- 172.21.15.151:0/430297653 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fa6f002b350 con 0x7fa6fc07be30 2023-07-21T22:09:51.328 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.862+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fa6fc19eb70 con 0x7fa6fc07be30 2023-07-21T22:09:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.865+0000 7fa6f9ffb700 1 -- 172.21.15.151:0/430297653 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) v1 ==== 153+0+0 (secure 0 0 0) 0x7fa6f000bbd0 con 0x7fa6fc07be30 2023-07-21T22:09:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.867+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa6ec038880 msgr2=0x7fa6ec03ad30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.867+0000 7fa702d81700 1 --2- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa6ec038880 0x7fa6ec03ad30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa6e8006fd0 tx=0x7fa6e8006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.867+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 msgr2=0x7fa6fc19b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.867+0000 7fa702d81700 1 --2- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc19b1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6f0003e30 tx=0x7fa6f0011b50 comp rx=0 tx=0).stop 2023-07-21T22:09:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.867+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 shutdown_connections 2023-07-21T22:09:51.329 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.867+0000 7fa702d81700 1 --2- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa6ec038880 0x7fa6ec03ad30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.867+0000 7fa702d81700 1 --2- 172.21.15.151:0/430297653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa6fc07be30 0x7fa6fc19b1b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.867+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 >> 172.21.15.151:0/430297653 conn(0x7fa6fc100890 msgr2=0x7fa6fc101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.868+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 shutdown_connections 2023-07-21T22:09:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr 2023-07-21T22:09:50.868+0000 7fa702d81700 1 -- 172.21.15.151:0/430297653 wait complete. 2023-07-21T22:09:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2023-07-21T22:09:51.330 INFO:teuthology.orchestra.run.smithi151.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2023-07-21T22:09:51.330 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:51.331 INFO:teuthology.orchestra.run.smithi151.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2023-07-21T22:09:51.331 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:51.331 INFO:teuthology.orchestra.run.smithi151.stdout:Or, if you are only running a single cluster on this host: 2023-07-21T22:09:51.331 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:51.331 INFO:teuthology.orchestra.run.smithi151.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2023-07-21T22:09:51.331 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:51.331 INFO:teuthology.orchestra.run.smithi151.stdout:Please consider enabling telemetry to help improve Ceph: 2023-07-21T22:09:51.332 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:51.332 INFO:teuthology.orchestra.run.smithi151.stdout: ceph telemetry on 2023-07-21T22:09:51.332 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:51.332 INFO:teuthology.orchestra.run.smithi151.stdout:For more information see: 2023-07-21T22:09:51.332 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:51.332 INFO:teuthology.orchestra.run.smithi151.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2023-07-21T22:09:51.332 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:09:51.333 INFO:teuthology.orchestra.run.smithi151.stdout:Bootstrap complete. 2023-07-21T22:09:51.382 INFO:tasks.cephadm:Fetching config... 2023-07-21T22:09:51.383 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:09:51.383 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2023-07-21T22:09:51.427 INFO:tasks.cephadm:Fetching client.admin keyring... 2023-07-21T22:09:51.427 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:09:51.427 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2023-07-21T22:09:51.513 INFO:tasks.cephadm:Fetching mon keyring... 2023-07-21T22:09:51.513 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:09:51.513 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/keyring of=/dev/stdout 2023-07-21T22:09:51.624 INFO:tasks.cephadm:Fetching pub ssh key... 2023-07-21T22:09:51.624 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:09:51.624 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2023-07-21T22:09:51.709 INFO:tasks.cephadm:Installing pub ssh key for root users... 2023-07-21T22:09:51.710 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7PYMk6glKDr1QQ7HMBtUvtzI2z1PxzD0O2NsBE0/l5UX19/sc96uIIkKISaspvNhndYBRqAAHPCYCaDiTu+3VhiU3ycUjrm9ALySEjnVAAJI0sK8uUQx6MMuSqINC8ujDu2LBeAAWBYRrserzwOLnuhLrjMj22ESHtUcVgLLLGqzCNaqRPFPUxhIL/G8HgbvEME6jWyAx6N/b5Be7d5vX2uyELMHTmH4Unol7jRqDa/M5AV6MdMHtnBxyelVjFxMaI4o6rQsy9WJbuBkSckNtnnYuvN3gz3jVL4JppNTg8F3L/1oEVnqsf44gerOg4x1NLJ1Tb0Z7VZTm/OV5UR9sVqLsp1/PjF1CBMBHS1phJjVMED0O3eTctto0jGniaTEnDpso0U9cJZcdAXqm+iZjVqsNzUATzNwiTJQfjcnLxhskzXXMD3q34zoBEpvR+zKyzC9qlSFBmEkpSUja0jS2RE4EXoeobmNvaYlb0wpgSoLb3NIdMd23d6S9wED5IpE= ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-21T22:09:51.851 INFO:teuthology.orchestra.run.smithi151.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7PYMk6glKDr1QQ7HMBtUvtzI2z1PxzD0O2NsBE0/l5UX19/sc96uIIkKISaspvNhndYBRqAAHPCYCaDiTu+3VhiU3ycUjrm9ALySEjnVAAJI0sK8uUQx6MMuSqINC8ujDu2LBeAAWBYRrserzwOLnuhLrjMj22ESHtUcVgLLLGqzCNaqRPFPUxhIL/G8HgbvEME6jWyAx6N/b5Be7d5vX2uyELMHTmH4Unol7jRqDa/M5AV6MdMHtnBxyelVjFxMaI4o6rQsy9WJbuBkSckNtnnYuvN3gz3jVL4JppNTg8F3L/1oEVnqsf44gerOg4x1NLJ1Tb0Z7VZTm/OV5UR9sVqLsp1/PjF1CBMBHS1phJjVMED0O3eTctto0jGniaTEnDpso0U9cJZcdAXqm+iZjVqsNzUATzNwiTJQfjcnLxhskzXXMD3q34zoBEpvR+zKyzC9qlSFBmEkpSUja0jS2RE4EXoeobmNvaYlb0wpgSoLb3NIdMd23d6S9wED5IpE= ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:09:51.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7PYMk6glKDr1QQ7HMBtUvtzI2z1PxzD0O2NsBE0/l5UX19/sc96uIIkKISaspvNhndYBRqAAHPCYCaDiTu+3VhiU3ycUjrm9ALySEjnVAAJI0sK8uUQx6MMuSqINC8ujDu2LBeAAWBYRrserzwOLnuhLrjMj22ESHtUcVgLLLGqzCNaqRPFPUxhIL/G8HgbvEME6jWyAx6N/b5Be7d5vX2uyELMHTmH4Unol7jRqDa/M5AV6MdMHtnBxyelVjFxMaI4o6rQsy9WJbuBkSckNtnnYuvN3gz3jVL4JppNTg8F3L/1oEVnqsf44gerOg4x1NLJ1Tb0Z7VZTm/OV5UR9sVqLsp1/PjF1CBMBHS1phJjVMED0O3eTctto0jGniaTEnDpso0U9cJZcdAXqm+iZjVqsNzUATzNwiTJQfjcnLxhskzXXMD3q34zoBEpvR+zKyzC9qlSFBmEkpSUja0jS2RE4EXoeobmNvaYlb0wpgSoLb3NIdMd23d6S9wED5IpE= ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-21T22:09:51.988 INFO:teuthology.orchestra.run.smithi187.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7PYMk6glKDr1QQ7HMBtUvtzI2z1PxzD0O2NsBE0/l5UX19/sc96uIIkKISaspvNhndYBRqAAHPCYCaDiTu+3VhiU3ycUjrm9ALySEjnVAAJI0sK8uUQx6MMuSqINC8ujDu2LBeAAWBYRrserzwOLnuhLrjMj22ESHtUcVgLLLGqzCNaqRPFPUxhIL/G8HgbvEME6jWyAx6N/b5Be7d5vX2uyELMHTmH4Unol7jRqDa/M5AV6MdMHtnBxyelVjFxMaI4o6rQsy9WJbuBkSckNtnnYuvN3gz3jVL4JppNTg8F3L/1oEVnqsf44gerOg4x1NLJ1Tb0Z7VZTm/OV5UR9sVqLsp1/PjF1CBMBHS1phJjVMED0O3eTctto0jGniaTEnDpso0U9cJZcdAXqm+iZjVqsNzUATzNwiTJQfjcnLxhskzXXMD3q34zoBEpvR+zKyzC9qlSFBmEkpSUja0jS2RE4EXoeobmNvaYlb0wpgSoLb3NIdMd23d6S9wED5IpE= ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:09:52.017 DEBUG:teuthology.orchestra.run.smithi195:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7PYMk6glKDr1QQ7HMBtUvtzI2z1PxzD0O2NsBE0/l5UX19/sc96uIIkKISaspvNhndYBRqAAHPCYCaDiTu+3VhiU3ycUjrm9ALySEjnVAAJI0sK8uUQx6MMuSqINC8ujDu2LBeAAWBYRrserzwOLnuhLrjMj22ESHtUcVgLLLGqzCNaqRPFPUxhIL/G8HgbvEME6jWyAx6N/b5Be7d5vX2uyELMHTmH4Unol7jRqDa/M5AV6MdMHtnBxyelVjFxMaI4o6rQsy9WJbuBkSckNtnnYuvN3gz3jVL4JppNTg8F3L/1oEVnqsf44gerOg4x1NLJ1Tb0Z7VZTm/OV5UR9sVqLsp1/PjF1CBMBHS1phJjVMED0O3eTctto0jGniaTEnDpso0U9cJZcdAXqm+iZjVqsNzUATzNwiTJQfjcnLxhskzXXMD3q34zoBEpvR+zKyzC9qlSFBmEkpSUja0jS2RE4EXoeobmNvaYlb0wpgSoLb3NIdMd23d6S9wED5IpE= ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2023-07-21T22:09:52.120 INFO:teuthology.orchestra.run.smithi195.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC7PYMk6glKDr1QQ7HMBtUvtzI2z1PxzD0O2NsBE0/l5UX19/sc96uIIkKISaspvNhndYBRqAAHPCYCaDiTu+3VhiU3ycUjrm9ALySEjnVAAJI0sK8uUQx6MMuSqINC8ujDu2LBeAAWBYRrserzwOLnuhLrjMj22ESHtUcVgLLLGqzCNaqRPFPUxhIL/G8HgbvEME6jWyAx6N/b5Be7d5vX2uyELMHTmH4Unol7jRqDa/M5AV6MdMHtnBxyelVjFxMaI4o6rQsy9WJbuBkSckNtnnYuvN3gz3jVL4JppNTg8F3L/1oEVnqsf44gerOg4x1NLJ1Tb0Z7VZTm/OV5UR9sVqLsp1/PjF1CBMBHS1phJjVMED0O3eTctto0jGniaTEnDpso0U9cJZcdAXqm+iZjVqsNzUATzNwiTJQfjcnLxhskzXXMD3q34zoBEpvR+zKyzC9qlSFBmEkpSUja0jS2RE4EXoeobmNvaYlb0wpgSoLb3NIdMd23d6S9wED5IpE= ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:09:52.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2023-07-21T22:09:52.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:51 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/430297653' entity='client.admin' 2023-07-21T22:09:53.139 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:09:55.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.029+0000 7fded4199700 1 -- 172.21.15.151:0/114973078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 msgr2=0x7fdecc0ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:55.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.029+0000 7fded4199700 1 --2- 172.21.15.151:0/114973078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 0x7fdecc0ffa10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdec8009910 tx=0x7fdec8009c20 comp rx=0 tx=0).stop 2023-07-21T22:09:55.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.029+0000 7fded4199700 1 -- 172.21.15.151:0/114973078 shutdown_connections 2023-07-21T22:09:55.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.029+0000 7fded4199700 1 --2- 172.21.15.151:0/114973078 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 0x7fdecc0ffa10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:55.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.029+0000 7fded4199700 1 -- 172.21.15.151:0/114973078 >> 172.21.15.151:0/114973078 conn(0x7fdecc0fab90 msgr2=0x7fdecc0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:55.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.029+0000 7fded4199700 1 -- 172.21.15.151:0/114973078 shutdown_connections 2023-07-21T22:09:55.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.030+0000 7fded4199700 1 -- 172.21.15.151:0/114973078 wait complete. 2023-07-21T22:09:55.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.030+0000 7fded4199700 1 Processor -- start 2023-07-21T22:09:55.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.031+0000 7fded4199700 1 -- start start 2023-07-21T22:09:55.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.031+0000 7fded4199700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 0x7fdecc0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:55.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.031+0000 7fded4199700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdecc0747f0 con 0x7fdecc0ff600 2023-07-21T22:09:55.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.031+0000 7fded1f35700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 0x7fdecc0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:55.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.031+0000 7fded1f35700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 0x7fdecc0742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41062/0 (socket says 172.21.15.151:41062) 2023-07-21T22:09:55.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.031+0000 7fded1f35700 1 -- 172.21.15.151:0/4059472875 learned_addr learned my addr 172.21.15.151:0/4059472875 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:55.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.032+0000 7fded1f35700 1 -- 172.21.15.151:0/4059472875 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdec80095f0 con 0x7fdecc0ff600 2023-07-21T22:09:55.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.032+0000 7fded1f35700 1 --2- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 0x7fdecc0742b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdec8006010 tx=0x7fdec8005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.032+0000 7fdec2ffd700 1 -- 172.21.15.151:0/4059472875 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdec800ba90 con 0x7fdecc0ff600 2023-07-21T22:09:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.032+0000 7fdec2ffd700 1 -- 172.21.15.151:0/4059472875 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdec800bbf0 con 0x7fdecc0ff600 2023-07-21T22:09:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.032+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdecc072900 con 0x7fdecc0ff600 2023-07-21T22:09:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.032+0000 7fdec2ffd700 1 -- 172.21.15.151:0/4059472875 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fdec8017440 con 0x7fdecc0ff600 2023-07-21T22:09:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.032+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdecc072da0 con 0x7fdecc0ff600 2023-07-21T22:09:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.033+0000 7fdec2ffd700 1 -- 172.21.15.151:0/4059472875 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fdec800bd60 con 0x7fdecc0ff600 2023-07-21T22:09:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.033+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdecc061b40 con 0x7fdecc0ff600 2023-07-21T22:09:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.034+0000 7fdec2ffd700 1 --2- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdeb8038800 0x7fdeb803acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.034+0000 7fdec2ffd700 1 -- 172.21.15.151:0/4059472875 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fdec804c9e0 con 0x7fdecc0ff600 2023-07-21T22:09:55.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.034+0000 7fded1734700 1 --2- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdeb8038800 0x7fdeb803acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:55.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.035+0000 7fded1734700 1 --2- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdeb8038800 0x7fdeb803acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdebc006fd0 tx=0x7fdebc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:55.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.039+0000 7fdec2ffd700 1 -- 172.21.15.151:0/4059472875 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fdec802a9b0 con 0x7fdecc0ff600 2023-07-21T22:09:55.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.233+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fdecc18df40 con 0x7fdecc0ff600 2023-07-21T22:09:55.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.237+0000 7fdec2ffd700 1 -- 172.21.15.151:0/4059472875 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fdec8027030 con 0x7fdecc0ff600 2023-07-21T22:09:55.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdeb8038800 msgr2=0x7fdeb803acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:55.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 --2- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdeb8038800 0x7fdeb803acb0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdebc006fd0 tx=0x7fdebc006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:55.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 msgr2=0x7fdecc0742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:55.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 --2- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 0x7fdecc0742b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdec8006010 tx=0x7fdec8005810 comp rx=0 tx=0).stop 2023-07-21T22:09:55.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 shutdown_connections 2023-07-21T22:09:55.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 --2- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdeb8038800 0x7fdeb803acb0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:55.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 --2- 172.21.15.151:0/4059472875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdecc0ff600 0x7fdecc0742b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:55.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 >> 172.21.15.151:0/4059472875 conn(0x7fdecc0fab90 msgr2=0x7fdecc0fb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:55.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 shutdown_connections 2023-07-21T22:09:55.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:55.240+0000 7fded4199700 1 -- 172.21.15.151:0/4059472875 wait complete. 2023-07-21T22:09:55.760 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2023-07-21T22:09:55.761 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch client-keyring set client.admin '*' --mode 0755 2023-07-21T22:09:55.863 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:55.863 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:55.863 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi151", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:09:55.863 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:55.863 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:55.864 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:55.864 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:55 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/4059472875' entity='client.admin' 2023-07-21T22:09:55.864 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:55.864 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:56.523 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:09:58.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.997+0000 7ff156b64700 1 -- 172.21.15.151:0/1315228826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 msgr2=0x7ff1500ffa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:58.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.997+0000 7ff156b64700 1 --2- 172.21.15.151:0/1315228826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 0x7ff1500ffa10 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff144009910 tx=0x7ff144009c20 comp rx=0 tx=0).stop 2023-07-21T22:09:58.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.997+0000 7ff156b64700 1 -- 172.21.15.151:0/1315228826 shutdown_connections 2023-07-21T22:09:58.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.997+0000 7ff156b64700 1 --2- 172.21.15.151:0/1315228826 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 0x7ff1500ffa10 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:58.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.997+0000 7ff156b64700 1 -- 172.21.15.151:0/1315228826 >> 172.21.15.151:0/1315228826 conn(0x7ff1500fab90 msgr2=0x7ff1500fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:58.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.997+0000 7ff156b64700 1 -- 172.21.15.151:0/1315228826 shutdown_connections 2023-07-21T22:09:58.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.997+0000 7ff156b64700 1 -- 172.21.15.151:0/1315228826 wait complete. 2023-07-21T22:09:58.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.998+0000 7ff156b64700 1 Processor -- start 2023-07-21T22:09:58.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.998+0000 7ff156b64700 1 -- start start 2023-07-21T22:09:58.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.999+0000 7ff156b64700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 0x7ff1501968a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:58.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.999+0000 7ff156b64700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff150196de0 con 0x7ff1500ff600 2023-07-21T22:09:58.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.999+0000 7ff154900700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 0x7ff1501968a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:58.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.999+0000 7ff154900700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 0x7ff1501968a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59700/0 (socket says 172.21.15.151:59700) 2023-07-21T22:09:58.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.999+0000 7ff154900700 1 -- 172.21.15.151:0/636285157 learned_addr learned my addr 172.21.15.151:0/636285157 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:09:58.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.999+0000 7ff154900700 1 -- 172.21.15.151:0/636285157 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1440095f0 con 0x7ff1500ff600 2023-07-21T22:09:58.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:57.999+0000 7ff154900700 1 --2- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 0x7ff1501968a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff144005950 tx=0x7ff144005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:58.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.000+0000 7ff14dffb700 1 -- 172.21.15.151:0/636285157 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff14400ba90 con 0x7ff1500ff600 2023-07-21T22:09:58.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.000+0000 7ff14dffb700 1 -- 172.21.15.151:0/636285157 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff14400bbf0 con 0x7ff1500ff600 2023-07-21T22:09:58.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.000+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff150196fe0 con 0x7ff1500ff600 2023-07-21T22:09:58.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.000+0000 7ff14dffb700 1 -- 172.21.15.151:0/636285157 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7ff144017440 con 0x7ff1500ff600 2023-07-21T22:09:58.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.000+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff150197480 con 0x7ff1500ff600 2023-07-21T22:09:58.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.001+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff150190480 con 0x7ff1500ff600 2023-07-21T22:09:58.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.001+0000 7ff14dffb700 1 -- 172.21.15.151:0/636285157 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7ff14400f460 con 0x7ff1500ff600 2023-07-21T22:09:58.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.002+0000 7ff14dffb700 1 --2- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff140038800 0x7ff14003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:09:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.002+0000 7ff14dffb700 1 -- 172.21.15.151:0/636285157 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff14404c960 con 0x7ff1500ff600 2023-07-21T22:09:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.002+0000 7ff14ffff700 1 --2- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff140038800 0x7ff14003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:09:58.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.002+0000 7ff14ffff700 1 --2- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff140038800 0x7ff14003acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff13c006fd0 tx=0x7ff13c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:09:58.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.007+0000 7ff14dffb700 1 -- 172.21.15.151:0/636285157 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ff14402ad30 con 0x7ff1500ff600 2023-07-21T22:09:58.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.209+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7ff1500609e0 con 0x7ff140038800 2023-07-21T22:09:58.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.213+0000 7ff14dffb700 1 -- 172.21.15.151:0/636285157 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff1500609e0 con 0x7ff140038800 2023-07-21T22:09:58.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff140038800 msgr2=0x7ff14003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 --2- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff140038800 0x7ff14003acb0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ff13c006fd0 tx=0x7ff13c006e40 comp rx=0 tx=0).stop 2023-07-21T22:09:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 msgr2=0x7ff1501968a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:09:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 --2- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 0x7ff1501968a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff144005950 tx=0x7ff144005810 comp rx=0 tx=0).stop 2023-07-21T22:09:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 shutdown_connections 2023-07-21T22:09:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 --2- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff140038800 0x7ff14003acb0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:58.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 --2- 172.21.15.151:0/636285157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1500ff600 0x7ff1501968a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:09:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 >> 172.21.15.151:0/636285157 conn(0x7ff1500fab90 msgr2=0x7ff1500fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:09:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 shutdown_connections 2023-07-21T22:09:58.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:09:58.215+0000 7ff156b64700 1 -- 172.21.15.151:0/636285157 wait complete. 2023-07-21T22:09:58.898 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi187 2023-07-21T22:09:58.898 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:09:58.899 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.conf 2023-07-21T22:09:58.946 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:09:58.947 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:09:59.031 INFO:tasks.cephadm:Adding host smithi187 to orchestrator... 2023-07-21T22:09:59.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch host add smithi187 2023-07-21T22:09:59.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:59 smithi151 ceph-mon[95510]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:09:59.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:59 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:09:59.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:59 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:09:59.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:59 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:09:59.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:59 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:09:59.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:09:59 smithi151 ceph-mon[95510]: Updating smithi151:/etc/ceph/ceph.conf 2023-07-21T22:09:59.785 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:10:00.423 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:00 smithi151 ceph-mon[95510]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:00.423 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:00 smithi151 ceph-mon[95510]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:01.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.235+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1666595008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 msgr2=0x7f5fc8107be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:01.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.235+0000 7f5fd03a3700 1 --2- 172.21.15.151:0/1666595008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 0x7f5fc8107be0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4009910 tx=0x7f5fc4009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:01.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.235+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1666595008 shutdown_connections 2023-07-21T22:10:01.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.235+0000 7f5fd03a3700 1 --2- 172.21.15.151:0/1666595008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 0x7f5fc8107be0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:01.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.235+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1666595008 >> 172.21.15.151:0/1666595008 conn(0x7f5fc80fd2f0 msgr2=0x7f5fc80ff700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:01.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.235+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1666595008 shutdown_connections 2023-07-21T22:10:01.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.235+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1666595008 wait complete. 2023-07-21T22:10:01.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.237+0000 7f5fd03a3700 1 Processor -- start 2023-07-21T22:10:01.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.237+0000 7f5fd03a3700 1 -- start start 2023-07-21T22:10:01.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.237+0000 7f5fd03a3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 0x7f5fc819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:01.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.237+0000 7f5fd03a3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc819cff0 con 0x7f5fc8107810 2023-07-21T22:10:01.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.237+0000 7f5fce13f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 0x7f5fc819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:01.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.237+0000 7f5fce13f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 0x7f5fc819cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59716/0 (socket says 172.21.15.151:59716) 2023-07-21T22:10:01.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.237+0000 7f5fce13f700 1 -- 172.21.15.151:0/1800301556 learned_addr learned my addr 172.21.15.151:0/1800301556 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:10:01.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.238+0000 7f5fce13f700 1 -- 172.21.15.151:0/1800301556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc40095f0 con 0x7f5fc8107810 2023-07-21T22:10:01.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.238+0000 7f5fce13f700 1 --2- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 0x7f5fc819cab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4005950 tx=0x7f5fc4004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:01.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.238+0000 7f5fbf7fe700 1 -- 172.21.15.151:0/1800301556 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fc401d070 con 0x7f5fc8107810 2023-07-21T22:10:01.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.238+0000 7f5fbf7fe700 1 -- 172.21.15.151:0/1800301556 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fc400bdf0 con 0x7f5fc8107810 2023-07-21T22:10:01.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.238+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc819d1f0 con 0x7f5fc8107810 2023-07-21T22:10:01.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.238+0000 7f5fbf7fe700 1 -- 172.21.15.151:0/1800301556 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f5fc4022c50 con 0x7f5fc8107810 2023-07-21T22:10:01.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.238+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc819d610 con 0x7f5fc8107810 2023-07-21T22:10:01.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.239+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc8061b40 con 0x7f5fc8107810 2023-07-21T22:10:01.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.240+0000 7f5fbf7fe700 1 -- 172.21.15.151:0/1800301556 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f5fc4022470 con 0x7f5fc8107810 2023-07-21T22:10:01.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.240+0000 7f5fbf7fe700 1 --2- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5fb40387b0 0x7f5fb403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:01.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.240+0000 7f5fbf7fe700 1 -- 172.21.15.151:0/1800301556 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f5fc404cd00 con 0x7f5fc8107810 2023-07-21T22:10:01.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.240+0000 7f5fcd93e700 1 --2- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5fb40387b0 0x7f5fb403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:01.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.241+0000 7f5fcd93e700 1 --2- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5fb40387b0 0x7f5fb403ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8006fd0 tx=0x7f5fb8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:01.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.245+0000 7f5fbf7fe700 1 -- 172.21.15.151:0/1800301556 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f5fc402bba0 con 0x7f5fc8107810 2023-07-21T22:10:01.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:01 smithi151 ceph-mon[95510]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:10:01.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:01.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:01.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:01.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:01.445+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}) v1 -- 0x7f5fc80fea90 con 0x7f5fb40387b0 2023-07-21T22:10:02.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:02 smithi151 ceph-mon[95510]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi187", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:02.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:02 smithi151 ceph-mon[95510]: Deploying cephadm binary to smithi187 2023-07-21T22:10:04.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:03 smithi151 ceph-mon[95510]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:04.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.525+0000 7f5fbf7fe700 1 -- 172.21.15.151:0/1800301556 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f5fc80fea90 con 0x7f5fb40387b0 2023-07-21T22:10:04.567 INFO:teuthology.orchestra.run.smithi151.stdout:Added host 'smithi187' with addr '172.21.15.187' 2023-07-21T22:10:04.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5fb40387b0 msgr2=0x7f5fb403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:04.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 --2- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5fb40387b0 0x7f5fb403ac60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8006fd0 tx=0x7f5fb8006e40 comp rx=0 tx=0).stop 2023-07-21T22:10:04.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 msgr2=0x7f5fc819cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:04.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 --2- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 0x7f5fc819cab0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4005950 tx=0x7f5fc4004ff0 comp rx=0 tx=0).stop 2023-07-21T22:10:04.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 shutdown_connections 2023-07-21T22:10:04.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 --2- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5fb40387b0 0x7f5fb403ac60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:04.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 --2- 172.21.15.151:0/1800301556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fc8107810 0x7f5fc819cab0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:04.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 >> 172.21.15.151:0/1800301556 conn(0x7f5fc80fd2f0 msgr2=0x7f5fc80fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:04.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 shutdown_connections 2023-07-21T22:10:04.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:04.528+0000 7f5fd03a3700 1 -- 172.21.15.151:0/1800301556 wait complete. 2023-07-21T22:10:05.069 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch host ls --format=json 2023-07-21T22:10:05.792 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:10:05.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:05.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:05 smithi151 ceph-mon[95510]: Added host smithi187 2023-07-21T22:10:05.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:05.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:05 smithi151 ceph-mon[95510]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:05.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:07.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.240+0000 7f7840b1a700 1 -- 172.21.15.151:0/41301553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 msgr2=0x7f783c105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:07.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.240+0000 7f7840b1a700 1 --2- 172.21.15.151:0/41301553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 0x7f783c105a20 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f782c009910 tx=0x7f782c009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:07.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.240+0000 7f7840b1a700 1 -- 172.21.15.151:0/41301553 shutdown_connections 2023-07-21T22:10:07.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.240+0000 7f7840b1a700 1 --2- 172.21.15.151:0/41301553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 0x7f783c105a20 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:07.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.240+0000 7f7840b1a700 1 -- 172.21.15.151:0/41301553 >> 172.21.15.151:0/41301553 conn(0x7f783c0fb150 msgr2=0x7f783c0fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:07.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.240+0000 7f7840b1a700 1 -- 172.21.15.151:0/41301553 shutdown_connections 2023-07-21T22:10:07.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.241+0000 7f7840b1a700 1 -- 172.21.15.151:0/41301553 wait complete. 2023-07-21T22:10:07.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.242+0000 7f7840b1a700 1 Processor -- start 2023-07-21T22:10:07.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.242+0000 7f7840b1a700 1 -- start start 2023-07-21T22:10:07.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.243+0000 7f7840b1a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 0x7f783c072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:07.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.243+0000 7f7840b1a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f783c0747e0 con 0x7f783c105650 2023-07-21T22:10:07.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.243+0000 7f783a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 0x7f783c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:07.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.243+0000 7f783a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 0x7f783c072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40420/0 (socket says 172.21.15.151:40420) 2023-07-21T22:10:07.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.243+0000 7f783a59c700 1 -- 172.21.15.151:0/3089909116 learned_addr learned my addr 172.21.15.151:0/3089909116 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:10:07.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.243+0000 7f783a59c700 1 -- 172.21.15.151:0/3089909116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c0095f0 con 0x7f783c105650 2023-07-21T22:10:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.244+0000 7f783a59c700 1 --2- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 0x7f783c072810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f782c006010 tx=0x7f782c004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.244+0000 7f782b7fe700 1 -- 172.21.15.151:0/3089909116 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f782c01d070 con 0x7f783c105650 2023-07-21T22:10:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.244+0000 7f782b7fe700 1 -- 172.21.15.151:0/3089909116 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f782c00bdf0 con 0x7f783c105650 2023-07-21T22:10:07.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.244+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f783c072e10 con 0x7f783c105650 2023-07-21T22:10:07.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.244+0000 7f782b7fe700 1 -- 172.21.15.151:0/3089909116 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f782c022d80 con 0x7f783c105650 2023-07-21T22:10:07.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.244+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f783c073290 con 0x7f783c105650 2023-07-21T22:10:07.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.245+0000 7f782b7fe700 1 -- 172.21.15.151:0/3089909116 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f782c022570 con 0x7f783c105650 2023-07-21T22:10:07.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.245+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f783c1048f0 con 0x7f783c105650 2023-07-21T22:10:07.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.245+0000 7f782b7fe700 1 --2- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7824038800 0x7f782403acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:07.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.245+0000 7f782b7fe700 1 -- 172.21.15.151:0/3089909116 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f782c04c960 con 0x7f783c105650 2023-07-21T22:10:07.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.246+0000 7f7839d9b700 1 --2- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7824038800 0x7f782403acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:07.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.246+0000 7f7839d9b700 1 --2- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7824038800 0x7f782403acb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7830006fd0 tx=0x7f7830006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:07.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.250+0000 7f782b7fe700 1 -- 172.21.15.151:0/3089909116 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f782c02b590 con 0x7f783c105650 2023-07-21T22:10:07.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:06 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:07.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.452+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f783c073d40 con 0x7f7824038800 2023-07-21T22:10:07.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.453+0000 7f782b7fe700 1 -- 172.21.15.151:0/3089909116 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+161 (secure 0 0 0) 0x7f783c073d40 con 0x7f7824038800 2023-07-21T22:10:07.495 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:10:07.495 INFO:teuthology.orchestra.run.smithi151.stdout:[{"addr": "172.21.15.151", "hostname": "smithi151", "labels": [], "status": ""}, {"addr": "172.21.15.187", "hostname": "smithi187", "labels": [], "status": ""}] 2023-07-21T22:10:07.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7824038800 msgr2=0x7f782403acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:07.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 --2- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7824038800 0x7f782403acb0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7830006fd0 tx=0x7f7830006e40 comp rx=0 tx=0).stop 2023-07-21T22:10:07.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 msgr2=0x7f783c072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:07.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 --2- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 0x7f783c072810 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f782c006010 tx=0x7f782c004ff0 comp rx=0 tx=0).stop 2023-07-21T22:10:07.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 shutdown_connections 2023-07-21T22:10:07.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 --2- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7824038800 0x7f782403acb0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:07.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 --2- 172.21.15.151:0/3089909116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f783c105650 0x7f783c072810 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:07.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 >> 172.21.15.151:0/3089909116 conn(0x7f783c0fb150 msgr2=0x7f783c0fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:07.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 shutdown_connections 2023-07-21T22:10:07.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:07.456+0000 7f7840b1a700 1 -- 172.21.15.151:0/3089909116 wait complete. 2023-07-21T22:10:07.967 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi195 2023-07-21T22:10:07.968 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:10:07.968 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.conf 2023-07-21T22:10:08.015 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:10:08.016 DEBUG:teuthology.orchestra.run.smithi195:> dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:08.101 INFO:tasks.cephadm:Adding host smithi195 to orchestrator... 2023-07-21T22:10:08.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch host add smithi195 2023-07-21T22:10:08.164 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:08 smithi151 ceph-mon[95510]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:08.164 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:08.834 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:10:09.372 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:09 smithi151 ceph-mon[95510]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:10:10.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.307+0000 7f291e10f700 1 -- 172.21.15.151:0/906788951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 msgr2=0x7f2918105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:10.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.307+0000 7f291e10f700 1 --2- 172.21.15.151:0/906788951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 0x7f2918105a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2908009910 tx=0x7f2908009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:10.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.307+0000 7f291e10f700 1 -- 172.21.15.151:0/906788951 shutdown_connections 2023-07-21T22:10:10.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.308+0000 7f291e10f700 1 --2- 172.21.15.151:0/906788951 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 0x7f2918105a20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:10.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.308+0000 7f291e10f700 1 -- 172.21.15.151:0/906788951 >> 172.21.15.151:0/906788951 conn(0x7f29180fb150 msgr2=0x7f29180fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:10.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.308+0000 7f291e10f700 1 -- 172.21.15.151:0/906788951 shutdown_connections 2023-07-21T22:10:10.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.308+0000 7f291e10f700 1 -- 172.21.15.151:0/906788951 wait complete. 2023-07-21T22:10:10.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.309+0000 7f291e10f700 1 Processor -- start 2023-07-21T22:10:10.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.309+0000 7f291e10f700 1 -- start start 2023-07-21T22:10:10.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.309+0000 7f291e10f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 0x7f291819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.309+0000 7f291e10f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291819cee0 con 0x7f2918105650 2023-07-21T22:10:10.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.309+0000 7f29177fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 0x7f291819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.309+0000 7f29177fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 0x7f291819c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40440/0 (socket says 172.21.15.151:40440) 2023-07-21T22:10:10.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.309+0000 7f29177fe700 1 -- 172.21.15.151:0/3661941929 learned_addr learned my addr 172.21.15.151:0/3661941929 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:10:10.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.310+0000 7f29177fe700 1 -- 172.21.15.151:0/3661941929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29080095f0 con 0x7f2918105650 2023-07-21T22:10:10.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.310+0000 7f29177fe700 1 --2- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 0x7f291819c9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2908006010 tx=0x7f2908004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:10.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.310+0000 7f2914ff9700 1 -- 172.21.15.151:0/3661941929 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f290801d070 con 0x7f2918105650 2023-07-21T22:10:10.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.310+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f291819d140 con 0x7f2918105650 2023-07-21T22:10:10.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.310+0000 7f2914ff9700 1 -- 172.21.15.151:0/3661941929 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f290800bdf0 con 0x7f2918105650 2023-07-21T22:10:10.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.310+0000 7f2914ff9700 1 -- 172.21.15.151:0/3661941929 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f2908022d80 con 0x7f2918105650 2023-07-21T22:10:10.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.310+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2918196990 con 0x7f2918105650 2023-07-21T22:10:10.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.312+0000 7f2914ff9700 1 -- 172.21.15.151:0/3661941929 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f2908022570 con 0x7f2918105650 2023-07-21T22:10:10.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.312+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2918061b40 con 0x7f2918105650 2023-07-21T22:10:10.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.312+0000 7f2914ff9700 1 --2- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f29000387b0 0x7f290003ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:10.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.312+0000 7f2914ff9700 1 -- 172.21.15.151:0/3661941929 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f290804c8a0 con 0x7f2918105650 2023-07-21T22:10:10.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.312+0000 7f2916ffd700 1 --2- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f29000387b0 0x7f290003ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:10.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.313+0000 7f2916ffd700 1 --2- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f29000387b0 0x7f290003ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f290c006fd0 tx=0x7f290c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:10.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.317+0000 7f2914ff9700 1 -- 172.21.15.151:0/3661941929 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f290802bba0 con 0x7f2918105650 2023-07-21T22:10:10.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:10 smithi151 ceph-mon[95510]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:10.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:10.517+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}) v1 -- 0x7f29181974c0 con 0x7f29000387b0 2023-07-21T22:10:11.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:11.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:11.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:11.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:11.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:11.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:10:11.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:11.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:11.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: Updating smithi187:/etc/ceph/ceph.conf 2023-07-21T22:10:11.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:11.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:11 smithi151 ceph-mon[95510]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:12.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:12 smithi151 ceph-mon[95510]: Deploying cephadm binary to smithi195 2023-07-21T22:10:12.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:12 smithi151 ceph-mon[95510]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:12.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:12 smithi151 ceph-mon[95510]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:10:13.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.625+0000 7f2914ff9700 1 -- 172.21.15.151:0/3661941929 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7f29181974c0 con 0x7f29000387b0 2023-07-21T22:10:13.667 INFO:teuthology.orchestra.run.smithi151.stdout:Added host 'smithi195' with addr '172.21.15.195' 2023-07-21T22:10:13.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f29000387b0 msgr2=0x7f290003ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:13.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 --2- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f29000387b0 0x7f290003ac60 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f290c006fd0 tx=0x7f290c006e40 comp rx=0 tx=0).stop 2023-07-21T22:10:13.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 msgr2=0x7f291819c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:13.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 --2- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 0x7f291819c9a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2908006010 tx=0x7f2908004ff0 comp rx=0 tx=0).stop 2023-07-21T22:10:13.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 shutdown_connections 2023-07-21T22:10:13.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 --2- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f29000387b0 0x7f290003ac60 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:13.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 --2- 172.21.15.151:0/3661941929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2918105650 0x7f291819c9a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:13.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 >> 172.21.15.151:0/3661941929 conn(0x7f29180fb150 msgr2=0x7f29180fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:13.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 shutdown_connections 2023-07-21T22:10:13.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:13.628+0000 7f291e10f700 1 -- 172.21.15.151:0/3661941929 wait complete. 2023-07-21T22:10:14.110 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch host ls --format=json 2023-07-21T22:10:14.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:14 smithi151 ceph-mon[95510]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:14.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:14.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:14.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:14.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:14.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:14.836 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:10:15.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:15 smithi151 ceph-mon[95510]: Added host smithi195 2023-07-21T22:10:15.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:15.379 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:16.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.303+0000 7fd98c64f700 1 -- 172.21.15.151:0/1744396128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 msgr2=0x7fd984072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.303+0000 7fd98c64f700 1 --2- 172.21.15.151:0/1744396128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 0x7fd984072c00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd980009910 tx=0x7fd980009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.303+0000 7fd98c64f700 1 -- 172.21.15.151:0/1744396128 shutdown_connections 2023-07-21T22:10:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.303+0000 7fd98c64f700 1 --2- 172.21.15.151:0/1744396128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 0x7fd984072c00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.303+0000 7fd98c64f700 1 -- 172.21.15.151:0/1744396128 >> 172.21.15.151:0/1744396128 conn(0x7fd9840fb150 msgr2=0x7fd9840fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.303+0000 7fd98c64f700 1 -- 172.21.15.151:0/1744396128 shutdown_connections 2023-07-21T22:10:16.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.303+0000 7fd98c64f700 1 -- 172.21.15.151:0/1744396128 wait complete. 2023-07-21T22:10:16.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.304+0000 7fd98c64f700 1 Processor -- start 2023-07-21T22:10:16.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.304+0000 7fd98c64f700 1 -- start start 2023-07-21T22:10:16.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.304+0000 7fd98c64f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 0x7fd98419c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:16.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.304+0000 7fd98c64f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd98419cf10 con 0x7fd984072830 2023-07-21T22:10:16.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.305+0000 7fd98a3eb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 0x7fd98419c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:16.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.305+0000 7fd98a3eb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 0x7fd98419c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46352/0 (socket says 172.21.15.151:46352) 2023-07-21T22:10:16.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.305+0000 7fd98a3eb700 1 -- 172.21.15.151:0/3912710441 learned_addr learned my addr 172.21.15.151:0/3912710441 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:10:16.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.305+0000 7fd98a3eb700 1 -- 172.21.15.151:0/3912710441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9800095f0 con 0x7fd984072830 2023-07-21T22:10:16.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.305+0000 7fd98a3eb700 1 --2- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 0x7fd98419c9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd980006010 tx=0x7fd980004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:16.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.305+0000 7fd97b7fe700 1 -- 172.21.15.151:0/3912710441 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd98001d070 con 0x7fd984072830 2023-07-21T22:10:16.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.305+0000 7fd97b7fe700 1 -- 172.21.15.151:0/3912710441 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd98000bdf0 con 0x7fd984072830 2023-07-21T22:10:16.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.305+0000 7fd97b7fe700 1 -- 172.21.15.151:0/3912710441 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fd980022d80 con 0x7fd984072830 2023-07-21T22:10:16.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.305+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd98419d110 con 0x7fd984072830 2023-07-21T22:10:16.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.306+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd98419d530 con 0x7fd984072830 2023-07-21T22:10:16.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.307+0000 7fd97b7fe700 1 -- 172.21.15.151:0/3912710441 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fd980022570 con 0x7fd984072830 2023-07-21T22:10:16.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.307+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd984061b40 con 0x7fd984072830 2023-07-21T22:10:16.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.307+0000 7fd97b7fe700 1 --2- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd970038800 0x7fd97003acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:16.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.307+0000 7fd97b7fe700 1 -- 172.21.15.151:0/3912710441 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fd98004c8a0 con 0x7fd984072830 2023-07-21T22:10:16.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.307+0000 7fd989bea700 1 --2- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd970038800 0x7fd97003acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:16.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.308+0000 7fd989bea700 1 --2- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd970038800 0x7fd97003acb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd974006fd0 tx=0x7fd974006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:16.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.312+0000 7fd97b7fe700 1 -- 172.21.15.151:0/3912710441 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd98002b590 con 0x7fd984072830 2023-07-21T22:10:16.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:16 smithi151 ceph-mon[95510]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.516+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd984108c70 con 0x7fd970038800 2023-07-21T22:10:16.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.517+0000 7fd97b7fe700 1 -- 172.21.15.151:0/3912710441 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+241 (secure 0 0 0) 0x7fd984108c70 con 0x7fd970038800 2023-07-21T22:10:16.558 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:10:16.558 INFO:teuthology.orchestra.run.smithi151.stdout:[{"addr": "172.21.15.151", "hostname": "smithi151", "labels": [], "status": ""}, {"addr": "172.21.15.187", "hostname": "smithi187", "labels": [], "status": ""}, {"addr": "172.21.15.195", "hostname": "smithi195", "labels": [], "status": ""}] 2023-07-21T22:10:16.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.519+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd970038800 msgr2=0x7fd97003acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:16.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.519+0000 7fd98c64f700 1 --2- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd970038800 0x7fd97003acb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fd974006fd0 tx=0x7fd974006e40 comp rx=0 tx=0).stop 2023-07-21T22:10:16.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.519+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 msgr2=0x7fd98419c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:16.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.519+0000 7fd98c64f700 1 --2- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 0x7fd98419c9d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd980006010 tx=0x7fd980004ff0 comp rx=0 tx=0).stop 2023-07-21T22:10:16.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.519+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 shutdown_connections 2023-07-21T22:10:16.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.519+0000 7fd98c64f700 1 --2- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd970038800 0x7fd97003acb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:16.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.519+0000 7fd98c64f700 1 --2- 172.21.15.151:0/3912710441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd984072830 0x7fd98419c9d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:16.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.519+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 >> 172.21.15.151:0/3912710441 conn(0x7fd9840fb150 msgr2=0x7fd984106230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:16.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.519+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 shutdown_connections 2023-07-21T22:10:16.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:16.520+0000 7fd98c64f700 1 -- 172.21.15.151:0/3912710441 wait complete. 2023-07-21T22:10:17.115 INFO:tasks.cephadm:Setting crush tunables to default 2023-07-21T22:10:17.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd crush tunables default 2023-07-21T22:10:17.833 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:10:17.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:17 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:17.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:17 smithi151 ceph-mon[95510]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:10:17.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:17 smithi151 ceph-mon[95510]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:19.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.365+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/1569499176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 msgr2=0x7f7a34072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:19.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.365+0000 7f7a3bdb3700 1 --2- 172.21.15.151:0/1569499176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 0x7f7a34072c80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7a30009910 tx=0x7f7a30009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.365+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/1569499176 shutdown_connections 2023-07-21T22:10:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.365+0000 7f7a3bdb3700 1 --2- 172.21.15.151:0/1569499176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 0x7f7a34072c80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.365+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/1569499176 >> 172.21.15.151:0/1569499176 conn(0x7f7a340fb150 msgr2=0x7f7a340fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.366+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/1569499176 shutdown_connections 2023-07-21T22:10:19.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.366+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/1569499176 wait complete. 2023-07-21T22:10:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.367+0000 7f7a3bdb3700 1 Processor -- start 2023-07-21T22:10:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.367+0000 7f7a3bdb3700 1 -- start start 2023-07-21T22:10:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.368+0000 7f7a3bdb3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 0x7f7a3419b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:19.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.368+0000 7f7a3bdb3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a3419b5e0 con 0x7f7a340728b0 2023-07-21T22:10:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.368+0000 7f7a39b4f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 0x7f7a3419b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.368+0000 7f7a39b4f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 0x7f7a3419b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46370/0 (socket says 172.21.15.151:46370) 2023-07-21T22:10:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.368+0000 7f7a39b4f700 1 -- 172.21.15.151:0/4008023620 learned_addr learned my addr 172.21.15.151:0/4008023620 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:10:19.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.368+0000 7f7a39b4f700 1 -- 172.21.15.151:0/4008023620 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a300095f0 con 0x7f7a340728b0 2023-07-21T22:10:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.369+0000 7f7a39b4f700 1 --2- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 0x7f7a3419b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a30006010 tx=0x7f7a30004f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.369+0000 7f7a2affd700 1 -- 172.21.15.151:0/4008023620 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a3001d070 con 0x7f7a340728b0 2023-07-21T22:10:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.369+0000 7f7a2affd700 1 -- 172.21.15.151:0/4008023620 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a3000bdf0 con 0x7f7a340728b0 2023-07-21T22:10:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.369+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a3419b7e0 con 0x7f7a340728b0 2023-07-21T22:10:19.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.369+0000 7f7a2affd700 1 -- 172.21.15.151:0/4008023620 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f7a30022d80 con 0x7f7a340728b0 2023-07-21T22:10:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.369+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a3419bc00 con 0x7f7a340728b0 2023-07-21T22:10:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.370+0000 7f7a2affd700 1 -- 172.21.15.151:0/4008023620 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f7a3000b960 con 0x7f7a340728b0 2023-07-21T22:10:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.370+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a34061b40 con 0x7f7a340728b0 2023-07-21T22:10:19.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.371+0000 7f7a2affd700 1 --2- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a20038750 0x7f7a2003ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.371+0000 7f7a2affd700 1 -- 172.21.15.151:0/4008023620 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f7a3004c8e0 con 0x7f7a340728b0 2023-07-21T22:10:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.371+0000 7f7a3934e700 1 --2- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a20038750 0x7f7a2003ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:19.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.372+0000 7f7a3934e700 1 --2- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a20038750 0x7f7a2003ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7a24006fd0 tx=0x7f7a24006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:19.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.376+0000 7f7a2affd700 1 -- 172.21.15.151:0/4008023620 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f7a3002a540 con 0x7f7a340728b0 2023-07-21T22:10:19.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.574+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f7a34102530 con 0x7f7a340728b0 2023-07-21T22:10:19.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.822+0000 7f7a2affd700 1 -- 172.21.15.151:0/4008023620 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f7a30027070 con 0x7f7a340728b0 2023-07-21T22:10:19.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a20038750 msgr2=0x7f7a2003ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:19.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 --2- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a20038750 0x7f7a2003ac00 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7a24006fd0 tx=0x7f7a24006e40 comp rx=0 tx=0).stop 2023-07-21T22:10:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 msgr2=0x7f7a3419b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 --2- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 0x7f7a3419b0a0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7a30006010 tx=0x7f7a30004f40 comp rx=0 tx=0).stop 2023-07-21T22:10:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 shutdown_connections 2023-07-21T22:10:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 --2- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a20038750 0x7f7a2003ac00 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 --2- 172.21.15.151:0/4008023620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a340728b0 0x7f7a3419b0a0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 >> 172.21.15.151:0/4008023620 conn(0x7f7a340fb150 msgr2=0x7f7a340fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 shutdown_connections 2023-07-21T22:10:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:19.825+0000 7f7a3bdb3700 1 -- 172.21.15.151:0/4008023620 wait complete. 2023-07-21T22:10:19.868 INFO:teuthology.orchestra.run.smithi151.stderr:adjusted tunables profile to default 2023-07-21T22:10:20.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:19 smithi151 ceph-mon[95510]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:20.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:19 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/4008023620' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-21T22:10:20.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:20.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:20.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:20.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:20.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:10:20.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:20.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:20.412 INFO:tasks.cephadm:Adding mon.a on smithi151 2023-07-21T22:10:20.412 INFO:tasks.cephadm:Adding mon.b on smithi187 2023-07-21T22:10:20.413 INFO:tasks.cephadm:Adding mon.c on smithi195 2023-07-21T22:10:20.413 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch apply mon '3;smithi151:172.21.15.151=a;smithi187:172.21.15.187=b;smithi195:172.21.15.195=c' 2023-07-21T22:10:21.165 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:21.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:20 smithi151 ceph-mon[95510]: Updating smithi195:/etc/ceph/ceph.conf 2023-07-21T22:10:21.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:20 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/4008023620' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-21T22:10:21.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:20 smithi151 ceph-mon[95510]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:21.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:20 smithi151 ceph-mon[95510]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:22.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:22 smithi151 ceph-mon[95510]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:22.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:22 smithi151 ceph-mon[95510]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:22.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:22 smithi151 ceph-mon[95510]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:10:22.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:22.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:22.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:22.646 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.605+0000 7f928032a700 1 -- 172.21.15.195:0/531868488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 msgr2=0x7f9278105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:22.647 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.605+0000 7f928032a700 1 --2- 172.21.15.195:0/531868488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 0x7f9278105a20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9274009910 tx=0x7f9274009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:22.647 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.605+0000 7f928032a700 1 -- 172.21.15.195:0/531868488 shutdown_connections 2023-07-21T22:10:22.647 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.605+0000 7f928032a700 1 --2- 172.21.15.195:0/531868488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 0x7f9278105a20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:22.647 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.605+0000 7f928032a700 1 -- 172.21.15.195:0/531868488 >> 172.21.15.195:0/531868488 conn(0x7f92780fb150 msgr2=0x7f92780fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:22.647 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.605+0000 7f928032a700 1 -- 172.21.15.195:0/531868488 shutdown_connections 2023-07-21T22:10:22.648 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.605+0000 7f928032a700 1 -- 172.21.15.195:0/531868488 wait complete. 2023-07-21T22:10:22.649 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.606+0000 7f928032a700 1 Processor -- start 2023-07-21T22:10:22.649 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.606+0000 7f928032a700 1 -- start start 2023-07-21T22:10:22.649 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.606+0000 7f928032a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 0x7f927819a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:22.649 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.606+0000 7f928032a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f927819abf0 con 0x7f9278105650 2023-07-21T22:10:22.649 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.607+0000 7f927e0c6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 0x7f927819a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:22.649 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.607+0000 7f927e0c6700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 0x7f927819a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.195:41576/0 (socket says 172.21.15.195:41576) 2023-07-21T22:10:22.650 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.607+0000 7f927e0c6700 1 -- 172.21.15.195:0/3140906481 learned_addr learned my addr 172.21.15.195:0/3140906481 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:10:22.650 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.607+0000 7f927e0c6700 1 -- 172.21.15.195:0/3140906481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92740095f0 con 0x7f9278105650 2023-07-21T22:10:22.650 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.608+0000 7f927e0c6700 1 --2- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 0x7f927819a6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9274006010 tx=0x7f9274004ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:22.651 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.608+0000 7f926f7fe700 1 -- 172.21.15.195:0/3140906481 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f927401d070 con 0x7f9278105650 2023-07-21T22:10:22.651 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.608+0000 7f926f7fe700 1 -- 172.21.15.195:0/3140906481 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f927400bdf0 con 0x7f9278105650 2023-07-21T22:10:22.651 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.608+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f927819ae50 con 0x7f9278105650 2023-07-21T22:10:22.652 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.608+0000 7f926f7fe700 1 -- 172.21.15.195:0/3140906481 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7f9274022d80 con 0x7f9278105650 2023-07-21T22:10:22.652 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.608+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9278194750 con 0x7f9278105650 2023-07-21T22:10:22.652 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.609+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9278061b40 con 0x7f9278105650 2023-07-21T22:10:22.652 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.609+0000 7f926f7fe700 1 -- 172.21.15.195:0/3140906481 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f9274022570 con 0x7f9278105650 2023-07-21T22:10:22.652 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.610+0000 7f926f7fe700 1 --2- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9264038800 0x7f926403acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:22.652 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.610+0000 7f926f7fe700 1 -- 172.21.15.195:0/3140906481 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f927404c960 con 0x7f9278105650 2023-07-21T22:10:22.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.610+0000 7f927d8c5700 1 --2- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9264038800 0x7f926403acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:22.653 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.611+0000 7f927d8c5700 1 --2- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9264038800 0x7f926403acb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9268006fd0 tx=0x7f9268006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:22.656 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.615+0000 7f926f7fe700 1 -- 172.21.15.195:0/3140906481 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f927402b590 con 0x7f9278105650 2023-07-21T22:10:22.863 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.821+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi151:172.21.15.151=a;smithi187:172.21.15.187=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}) v1 -- 0x7f9278195230 con 0x7f9264038800 2023-07-21T22:10:22.870 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.829+0000 7f926f7fe700 1 -- 172.21.15.195:0/3140906481 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f9278195230 con 0x7f9264038800 2023-07-21T22:10:22.871 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mon update... 2023-07-21T22:10:22.872 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9264038800 msgr2=0x7f926403acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:22.873 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 --2- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9264038800 0x7f926403acb0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9268006fd0 tx=0x7f9268006e40 comp rx=0 tx=0).stop 2023-07-21T22:10:22.873 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 msgr2=0x7f927819a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:22.873 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 --2- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 0x7f927819a6b0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f9274006010 tx=0x7f9274004ff0 comp rx=0 tx=0).stop 2023-07-21T22:10:22.874 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 shutdown_connections 2023-07-21T22:10:22.874 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 --2- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9264038800 0x7f926403acb0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:22.874 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 --2- 172.21.15.195:0/3140906481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9278105650 0x7f927819a6b0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:22.874 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 >> 172.21.15.195:0/3140906481 conn(0x7f92780fb150 msgr2=0x7f92780fbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:22.874 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 shutdown_connections 2023-07-21T22:10:22.875 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:22.831+0000 7f928032a700 1 -- 172.21.15.195:0/3140906481 wait complete. 2023-07-21T22:10:23.341 DEBUG:teuthology.orchestra.run.smithi187:mon.b> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.b.service 2023-07-21T22:10:23.347 DEBUG:teuthology.orchestra.run.smithi195:mon.c> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.c.service 2023-07-21T22:10:23.352 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-21T22:10:23.352 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph mon dump -f json 2023-07-21T22:10:23.423 INFO:journalctl@ceph.mon.b.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:10:23.425 INFO:journalctl@ceph.mon.c.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:10:24.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:24.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi151:172.21.15.151=a;smithi187:172.21.15.187=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:24.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: Saving service mon spec with placement smithi151:172.21.15.151=a;smithi187:172.21.15.187=b;smithi195:172.21.15.195=c;count:3 2023-07-21T22:10:24.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:24.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:24.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:24.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:24.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:24.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:24.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:24.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:23 smithi151 ceph-mon[95510]: Deploying daemon mon.c on smithi195 2023-07-21T22:10:24.410 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:26.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:25 smithi151 ceph-mon[95510]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:26.545 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.503+0000 7fe021f26700 1 -- 172.21.15.195:0/3782321800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 msgr2=0x7fe01c072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:26.546 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.503+0000 7fe021f26700 1 --2- 172.21.15.195:0/3782321800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 0x7fe01c072c80 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fe00c009910 tx=0x7fe00c009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:26.546 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.503+0000 7fe021f26700 1 -- 172.21.15.195:0/3782321800 shutdown_connections 2023-07-21T22:10:26.546 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.503+0000 7fe021f26700 1 --2- 172.21.15.195:0/3782321800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 0x7fe01c072c80 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:26.546 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.503+0000 7fe021f26700 1 -- 172.21.15.195:0/3782321800 >> 172.21.15.195:0/3782321800 conn(0x7fe01c0fb150 msgr2=0x7fe01c0fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:26.546 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.503+0000 7fe021f26700 1 -- 172.21.15.195:0/3782321800 shutdown_connections 2023-07-21T22:10:26.546 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.503+0000 7fe021f26700 1 -- 172.21.15.195:0/3782321800 wait complete. 2023-07-21T22:10:26.546 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.504+0000 7fe021f26700 1 Processor -- start 2023-07-21T22:10:26.547 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.504+0000 7fe021f26700 1 -- start start 2023-07-21T22:10:26.548 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.505+0000 7fe021f26700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 0x7fe01c19b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:26.548 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.505+0000 7fe021f26700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe01c19b5e0 con 0x7fe01c0728b0 2023-07-21T22:10:26.548 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.505+0000 7fe01b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 0x7fe01c19b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:26.548 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.505+0000 7fe01b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 0x7fe01c19b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.195:41586/0 (socket says 172.21.15.195:41586) 2023-07-21T22:10:26.548 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.505+0000 7fe01b7fe700 1 -- 172.21.15.195:0/573451499 learned_addr learned my addr 172.21.15.195:0/573451499 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:10:26.548 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.506+0000 7fe01b7fe700 1 -- 172.21.15.195:0/573451499 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe00c0095f0 con 0x7fe01c0728b0 2023-07-21T22:10:26.549 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.506+0000 7fe01b7fe700 1 --2- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 0x7fe01c19b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe00c004e90 tx=0x7fe00c004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:26.549 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.506+0000 7fe018ff9700 1 -- 172.21.15.195:0/573451499 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe00c01d070 con 0x7fe01c0728b0 2023-07-21T22:10:26.549 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.506+0000 7fe018ff9700 1 -- 172.21.15.195:0/573451499 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe00c0044b0 con 0x7fe01c0728b0 2023-07-21T22:10:26.549 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.506+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe01c19b7e0 con 0x7fe01c0728b0 2023-07-21T22:10:26.549 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.506+0000 7fe018ff9700 1 -- 172.21.15.195:0/573451499 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 205+0+0 (secure 0 0 0) 0x7fe00c0038f0 con 0x7fe01c0728b0 2023-07-21T22:10:26.549 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.506+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe01c19bba0 con 0x7fe01c0728b0 2023-07-21T22:10:26.550 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.507+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01c061b40 con 0x7fe01c0728b0 2023-07-21T22:10:26.550 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.507+0000 7fe018ff9700 1 -- 172.21.15.195:0/573451499 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fe00c00b960 con 0x7fe01c0728b0 2023-07-21T22:10:26.550 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.508+0000 7fe018ff9700 1 --2- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe0040387b0 0x7fe00403ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:26.550 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.508+0000 7fe018ff9700 1 -- 172.21.15.195:0/573451499 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fe00c04c7e0 con 0x7fe01c0728b0 2023-07-21T22:10:26.551 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.508+0000 7fe01affd700 1 --2- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe0040387b0 0x7fe00403ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:26.551 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.509+0000 7fe01affd700 1 --2- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe0040387b0 0x7fe00403ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe010006fd0 tx=0x7fe010006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:26.554 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.513+0000 7fe018ff9700 1 -- 172.21.15.195:0/573451499 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fe00c02a930 con 0x7fe01c0728b0 2023-07-21T22:10:26.882 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.840+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fe01c19c400 con 0x7fe01c0728b0 2023-07-21T22:10:26.882 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.841+0000 7fe018ff9700 1 -- 172.21.15.195:0/573451499 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+740 (secure 0 0 0) 0x7fe00c02a360 con 0x7fe01c0728b0 2023-07-21T22:10:26.882 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:10:26.883 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":1,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","modified":"2023-07-21T22:08:33.303180Z","created":"2023-07-21T22:08:33.303180Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2023-07-21T22:10:26.884 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe0040387b0 msgr2=0x7fe00403ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:26.884 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 --2- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe0040387b0 0x7fe00403ac60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe010006fd0 tx=0x7fe010006e40 comp rx=0 tx=0).stop 2023-07-21T22:10:26.885 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 msgr2=0x7fe01c19b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:26.885 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 --2- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 0x7fe01c19b0a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe00c004e90 tx=0x7fe00c004f70 comp rx=0 tx=0).stop 2023-07-21T22:10:26.885 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 shutdown_connections 2023-07-21T22:10:26.885 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 --2- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe0040387b0 0x7fe00403ac60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:26.885 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 --2- 172.21.15.195:0/573451499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe01c0728b0 0x7fe01c19b0a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:26.885 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 >> 172.21.15.195:0/573451499 conn(0x7fe01c0fb150 msgr2=0x7fe01c0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:26.885 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 shutdown_connections 2023-07-21T22:10:26.886 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:26.843+0000 7fe021f26700 1 -- 172.21.15.195:0/573451499 wait complete. 2023-07-21T22:10:26.886 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 1 2023-07-21T22:10:27.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:27 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/573451499' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-21T22:10:27.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 systemd[1]: Starting Ceph mon.c for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:10:27.996 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 podman[97324]: 2023-07-21T22:10:27.996 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: set uid:gid to 167:167 (ceph:ceph) 2023-07-21T22:10:27.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev), process ceph-mon, pid 8 2023-07-21T22:10:27.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pidfile_write: ignore empty --pid-file 2023-07-21T22:10:27.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: load: jerasure load: lrc 2023-07-21T22:10:27.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: RocksDB version: 7.9.2 2023-07-21T22:10:27.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Git sha 0 2023-07-21T22:10:27.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Compile date 2023-07-21 19:07:44 2023-07-21T22:10:27.997 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: DB SUMMARY 2023-07-21T22:10:27.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: DB Session ID: 35WEFEWECRPVZAGW9EKA 2023-07-21T22:10:27.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: CURRENT file: CURRENT 2023-07-21T22:10:27.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: IDENTITY file: IDENTITY 2023-07-21T22:10:27.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-07-21T22:10:27.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2023-07-21T22:10:27.998 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2023-07-21T22:10:27.999 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.error_if_exists: 0 2023-07-21T22:10:27.999 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.create_if_missing: 0 2023-07-21T22:10:27.999 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.paranoid_checks: 1 2023-07-21T22:10:27.999 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.flush_verify_memtable_count: 1 2023-07-21T22:10:27.999 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-21T22:10:27.999 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-21T22:10:27.999 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.env: 0x55f8ed516720 2023-07-21T22:10:28.000 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.fs: PosixFileSystem 2023-07-21T22:10:28.000 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.info_log: 0x55f8eef13260 2023-07-21T22:10:28.000 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_file_opening_threads: 16 2023-07-21T22:10:28.000 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.statistics: (nil) 2023-07-21T22:10:28.000 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.use_fsync: 0 2023-07-21T22:10:28.000 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_log_file_size: 0 2023-07-21T22:10:28.000 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-21T22:10:28.001 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.log_file_time_to_roll: 0 2023-07-21T22:10:28.001 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.keep_log_file_num: 1000 2023-07-21T22:10:28.001 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.recycle_log_file_num: 0 2023-07-21T22:10:28.001 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.allow_fallocate: 1 2023-07-21T22:10:28.001 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.allow_mmap_reads: 0 2023-07-21T22:10:28.001 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.allow_mmap_writes: 0 2023-07-21T22:10:28.001 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.use_direct_reads: 0 2023-07-21T22:10:28.002 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-21T22:10:28.002 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.create_missing_column_families: 0 2023-07-21T22:10:28.002 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.db_log_dir: 2023-07-21T22:10:28.002 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.wal_dir: 2023-07-21T22:10:28.002 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.table_cache_numshardbits: 6 2023-07-21T22:10:28.002 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.WAL_ttl_seconds: 0 2023-07-21T22:10:28.002 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.WAL_size_limit_MB: 0 2023-07-21T22:10:28.003 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-21T22:10:28.003 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-21T22:10:28.003 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.is_fd_close_on_exec: 1 2023-07-21T22:10:28.003 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.advise_random_on_open: 1 2023-07-21T22:10:28.003 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.db_write_buffer_size: 0 2023-07-21T22:10:28.003 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.write_buffer_manager: 0x55f8eee343c0 2023-07-21T22:10:28.003 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-21T22:10:28.004 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-21T22:10:28.004 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.use_adaptive_mutex: 0 2023-07-21T22:10:28.004 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.rate_limiter: (nil) 2023-07-21T22:10:28.004 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-21T22:10:28.004 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.wal_recovery_mode: 2 2023-07-21T22:10:28.004 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.enable_thread_tracking: 0 2023-07-21T22:10:28.005 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.enable_pipelined_write: 0 2023-07-21T22:10:28.005 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.unordered_write: 0 2023-07-21T22:10:28.005 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-21T22:10:28.005 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-21T22:10:28.005 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-21T22:10:28.005 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-21T22:10:28.005 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.row_cache: None 2023-07-21T22:10:28.006 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.wal_filter: None 2023-07-21T22:10:28.006 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-21T22:10:28.006 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.allow_ingest_behind: 0 2023-07-21T22:10:28.006 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.two_write_queues: 0 2023-07-21T22:10:28.007 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.manual_wal_flush: 0 2023-07-21T22:10:28.007 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.wal_compression: 0 2023-07-21T22:10:28.007 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.atomic_flush: 0 2023-07-21T22:10:28.008 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-21T22:10:28.008 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.persist_stats_to_disk: 0 2023-07-21T22:10:28.008 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.write_dbid_to_manifest: 0 2023-07-21T22:10:28.009 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.log_readahead_size: 0 2023-07-21T22:10:28.009 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-21T22:10:28.009 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.best_efforts_recovery: 0 2023-07-21T22:10:28.009 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-21T22:10:28.010 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-21T22:10:28.010 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.allow_data_in_errors: 0 2023-07-21T22:10:28.010 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.db_host_id: __hostname__ 2023-07-21T22:10:28.012 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.enforce_single_del_contracts: true 2023-07-21T22:10:28.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_background_jobs: 2 2023-07-21T22:10:28.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_background_compactions: -1 2023-07-21T22:10:28.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_subcompactions: 1 2023-07-21T22:10:28.013 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-21T22:10:28.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-21T22:10:28.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.delayed_write_rate : 16777216 2023-07-21T22:10:28.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_total_wal_size: 0 2023-07-21T22:10:28.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-21T22:10:28.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.stats_dump_period_sec: 600 2023-07-21T22:10:28.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.stats_persist_period_sec: 600 2023-07-21T22:10:28.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-21T22:10:28.014 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_open_files: -1 2023-07-21T22:10:28.015 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bytes_per_sync: 0 2023-07-21T22:10:28.015 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.wal_bytes_per_sync: 0 2023-07-21T22:10:28.015 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.strict_bytes_per_sync: 0 2023-07-21T22:10:28.015 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_readahead_size: 0 2023-07-21T22:10:28.015 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_background_flushes: -1 2023-07-21T22:10:28.015 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Compression algorithms supported: 2023-07-21T22:10:28.016 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-21T22:10:28.016 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: kZSTD supported: 0 2023-07-21T22:10:28.016 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: kXpressCompression supported: 0 2023-07-21T22:10:28.016 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: kLZ4HCCompression supported: 1 2023-07-21T22:10:28.016 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: kZlibCompression supported: 1 2023-07-21T22:10:28.016 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: kSnappyCompression supported: 1 2023-07-21T22:10:28.016 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: kLZ4Compression supported: 1 2023-07-21T22:10:28.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: kBZip2Compression supported: 0 2023-07-21T22:10:28.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Fast CRC32 supported: Supported on x86 2023-07-21T22:10:28.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: DMutex implementation: pthread_mutex_t 2023-07-21T22:10:28.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2023-07-21T22:10:28.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-21T22:10:28.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-21T22:10:28.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.merge_operator: 2023-07-21T22:10:28.017 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_filter: None 2023-07-21T22:10:28.018 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_filter_factory: None 2023-07-21T22:10:28.018 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.sst_partitioner_factory: None 2023-07-21T22:10:28.018 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.memtable_factory: SkipListFactory 2023-07-21T22:10:28.018 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.table_factory: BlockBasedTable 2023-07-21T22:10:28.018 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f8eef13360) 2023-07-21T22:10:28.018 INFO:journalctl@ceph.mon.c.smithi195.stdout: cache_index_and_filter_blocks: 1 2023-07-21T22:10:28.018 INFO:journalctl@ceph.mon.c.smithi195.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-21T22:10:28.018 INFO:journalctl@ceph.mon.c.smithi195.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-21T22:10:28.019 INFO:journalctl@ceph.mon.c.smithi195.stdout: pin_top_level_index_and_filter: 1 2023-07-21T22:10:28.019 INFO:journalctl@ceph.mon.c.smithi195.stdout: index_type: 0 2023-07-21T22:10:28.019 INFO:journalctl@ceph.mon.c.smithi195.stdout: data_block_index_type: 0 2023-07-21T22:10:28.019 INFO:journalctl@ceph.mon.c.smithi195.stdout: index_shortening: 1 2023-07-21T22:10:28.019 INFO:journalctl@ceph.mon.c.smithi195.stdout: data_block_hash_table_util_ratio: 0.750000 2023-07-21T22:10:28.019 INFO:journalctl@ceph.mon.c.smithi195.stdout: checksum: 4 2023-07-21T22:10:28.019 INFO:journalctl@ceph.mon.c.smithi195.stdout: no_block_cache: 0 2023-07-21T22:10:28.019 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache: 0x55f8eeed31f0 2023-07-21T22:10:28.020 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache_name: BinnedLRUCache 2023-07-21T22:10:28.020 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache_options: 2023-07-21T22:10:28.020 INFO:journalctl@ceph.mon.c.smithi195.stdout: capacity : 536870912 2023-07-21T22:10:28.020 INFO:journalctl@ceph.mon.c.smithi195.stdout: num_shard_bits : 4 2023-07-21T22:10:28.020 INFO:journalctl@ceph.mon.c.smithi195.stdout: strict_capacity_limit : 0 2023-07-21T22:10:28.020 INFO:journalctl@ceph.mon.c.smithi195.stdout: high_pri_pool_ratio: 0.000 2023-07-21T22:10:28.020 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_cache_compressed: (nil) 2023-07-21T22:10:28.021 INFO:journalctl@ceph.mon.c.smithi195.stdout: persistent_cache: (nil) 2023-07-21T22:10:28.021 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_size: 4096 2023-07-21T22:10:28.021 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_size_deviation: 10 2023-07-21T22:10:28.021 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_restart_interval: 16 2023-07-21T22:10:28.021 INFO:journalctl@ceph.mon.c.smithi195.stdout: index_block_restart_interval: 1 2023-07-21T22:10:28.021 INFO:journalctl@ceph.mon.c.smithi195.stdout: metadata_block_size: 4096 2023-07-21T22:10:28.021 INFO:journalctl@ceph.mon.c.smithi195.stdout: partition_filters: 0 2023-07-21T22:10:28.021 INFO:journalctl@ceph.mon.c.smithi195.stdout: use_delta_encoding: 1 2023-07-21T22:10:28.022 INFO:journalctl@ceph.mon.c.smithi195.stdout: filter_policy: bloomfilter 2023-07-21T22:10:28.022 INFO:journalctl@ceph.mon.c.smithi195.stdout: whole_key_filtering: 1 2023-07-21T22:10:28.022 INFO:journalctl@ceph.mon.c.smithi195.stdout: verify_compression: 0 2023-07-21T22:10:28.022 INFO:journalctl@ceph.mon.c.smithi195.stdout: read_amp_bytes_per_bit: 0 2023-07-21T22:10:28.022 INFO:journalctl@ceph.mon.c.smithi195.stdout: format_version: 5 2023-07-21T22:10:28.022 INFO:journalctl@ceph.mon.c.smithi195.stdout: enable_index_compression: 1 2023-07-21T22:10:28.022 INFO:journalctl@ceph.mon.c.smithi195.stdout: block_align: 0 2023-07-21T22:10:28.023 INFO:journalctl@ceph.mon.c.smithi195.stdout: max_auto_readahead_size: 262144 2023-07-21T22:10:28.023 INFO:journalctl@ceph.mon.c.smithi195.stdout: prepopulate_block_cache: 0 2023-07-21T22:10:28.023 INFO:journalctl@ceph.mon.c.smithi195.stdout: initial_auto_readahead_size: 8192 2023-07-21T22:10:28.023 INFO:journalctl@ceph.mon.c.smithi195.stdout: num_file_reads_for_auto_readahead: 2 2023-07-21T22:10:28.023 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.write_buffer_size: 33554432 2023-07-21T22:10:28.023 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_write_buffer_number: 2 2023-07-21T22:10:28.023 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression: NoCompression 2023-07-21T22:10:28.023 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression: Disabled 2023-07-21T22:10:28.024 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.prefix_extractor: nullptr 2023-07-21T22:10:28.024 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-21T22:10:28.024 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.num_levels: 7 2023-07-21T22:10:28.024 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-21T22:10:28.024 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-21T22:10:28.024 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-21T22:10:28.024 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-21T22:10:28.025 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-21T22:10:28.025 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-21T22:10:28.025 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-21T22:10:28.025 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-21T22:10:28.025 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-21T22:10:28.025 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-21T22:10:28.025 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-21T22:10:28.026 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-21T22:10:28.026 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression_opts.window_bits: -14 2023-07-21T22:10:28.026 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression_opts.level: 32767 2023-07-21T22:10:28.026 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression_opts.strategy: 0 2023-07-21T22:10:28.026 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-21T22:10:28.026 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-21T22:10:28.026 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-21T22:10:28.026 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-21T22:10:28.027 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression_opts.enabled: false 2023-07-21T22:10:28.027 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-21T22:10:28.027 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-21T22:10:28.027 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-21T22:10:28.027 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-21T22:10:28.027 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.target_file_size_base: 67108864 2023-07-21T22:10:28.027 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.target_file_size_multiplier: 1 2023-07-21T22:10:28.027 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-21T22:10:28.028 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-21T22:10:28.028 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-21T22:10:28.028 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-21T22:10:28.028 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-21T22:10:28.028 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-21T22:10:28.028 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-21T22:10:28.028 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-21T22:10:28.029 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-21T22:10:28.029 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-21T22:10:28.029 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-21T22:10:28.029 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-21T22:10:28.029 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-21T22:10:28.029 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.arena_block_size: 1048576 2023-07-21T22:10:28.030 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-21T22:10:28.030 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-21T22:10:28.030 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.disable_auto_compactions: 0 2023-07-21T22:10:28.030 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-21T22:10:28.030 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-21T22:10:28.030 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-21T22:10:28.030 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-21T22:10:28.030 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-21T22:10:28.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-21T22:10:28.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-21T22:10:28.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-21T22:10:28.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-21T22:10:28.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-21T22:10:28.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.table_properties_collectors: 2023-07-21T22:10:28.031 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.inplace_update_support: 0 2023-07-21T22:10:28.032 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.inplace_update_num_locks: 10000 2023-07-21T22:10:28.032 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-21T22:10:28.032 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-21T22:10:28.032 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.memtable_huge_page_size: 0 2023-07-21T22:10:28.032 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.bloom_locality: 0 2023-07-21T22:10:28.032 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.max_successive_merges: 0 2023-07-21T22:10:28.033 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.optimize_filters_for_hits: 0 2023-07-21T22:10:28.033 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.paranoid_file_checks: 0 2023-07-21T22:10:28.033 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.force_consistency_checks: 1 2023-07-21T22:10:28.033 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.report_bg_io_stats: 0 2023-07-21T22:10:28.033 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.ttl: 2592000 2023-07-21T22:10:28.033 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.periodic_compaction_seconds: 0 2023-07-21T22:10:28.033 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-21T22:10:28.034 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-21T22:10:28.034 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.enable_blob_files: false 2023-07-21T22:10:28.034 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.min_blob_size: 0 2023-07-21T22:10:28.034 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.blob_file_size: 268435456 2023-07-21T22:10:28.034 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.blob_compression_type: NoCompression 2023-07-21T22:10:28.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.enable_blob_garbage_collection: false 2023-07-21T22:10:28.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-21T22:10:28.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-21T22:10:28.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-21T22:10:28.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.blob_file_starting_level: 0 2023-07-21T22:10:28.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-21T22:10:28.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-21T22:10:28.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-21T22:10:28.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 170c966a-2670-4f24-96f0-13ba0a2548e9 2023-07-21T22:10:28.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689977427918687, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-07-21T22:10:28.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-07-21T22:10:28.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689977427919788, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689977427, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "170c966a-2670-4f24-96f0-13ba0a2548e9", "db_session_id": "35WEFEWECRPVZAGW9EKA", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-07-21T22:10:28.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689977427919992, "job": 1, "event": "recovery_finished"} 2023-07-21T22:10:28.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-07-21T22:10:28.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-21T22:10:28.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f8eef6c000 2023-07-21T22:10:28.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: DB pointer 0x55f8eef58000 2023-07-21T22:10:28.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-21T22:10:28.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-21T22:10:28.037 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** DB Stats ** 2023-07-21T22:10:28.037 INFO:journalctl@ceph.mon.c.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-21T22:10:28.038 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-21T22:10:28.038 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-21T22:10:28.038 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-21T22:10:28.038 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-21T22:10:28.038 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-21T22:10:28.038 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-21T22:10:28.039 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-07-21T22:10:28.039 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** Compaction Stats [default] ** 2023-07-21T22:10:28.039 INFO:journalctl@ceph.mon.c.smithi195.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-21T22:10:28.039 INFO:journalctl@ceph.mon.c.smithi195.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-21T22:10:28.039 INFO:journalctl@ceph.mon.c.smithi195.stdout: L0 1/0 1.58 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:10:28.039 INFO:journalctl@ceph.mon.c.smithi195.stdout: Sum 1/0 1.58 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:10:28.040 INFO:journalctl@ceph.mon.c.smithi195.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:10:28.040 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-07-21T22:10:28.040 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** Compaction Stats [default] ** 2023-07-21T22:10:28.040 INFO:journalctl@ceph.mon.c.smithi195.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-21T22:10:28.040 INFO:journalctl@ceph.mon.c.smithi195.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-21T22:10:28.040 INFO:journalctl@ceph.mon.c.smithi195.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.5 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:10:28.040 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-07-21T22:10:28.041 INFO:journalctl@ceph.mon.c.smithi195.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-21T22:10:28.041 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-07-21T22:10:28.041 INFO:journalctl@ceph.mon.c.smithi195.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-21T22:10:28.041 INFO:journalctl@ceph.mon.c.smithi195.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-07-21T22:10:28.041 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-21T22:10:28.041 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-07-21T22:10:28.041 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-07-21T22:10:28.041 INFO:journalctl@ceph.mon.c.smithi195.stdout: AddFile(Keys): cumulative 0, interval 0 2023-07-21T22:10:28.042 INFO:journalctl@ceph.mon.c.smithi195.stdout: Cumulative compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-21T22:10:28.042 INFO:journalctl@ceph.mon.c.smithi195.stdout: Interval compaction: 0.00 GB write, 0.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-21T22:10:28.042 INFO:journalctl@ceph.mon.c.smithi195.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-21T22:10:28.042 INFO:journalctl@ceph.mon.c.smithi195.stdout: Block cache BinnedLRUCache@0x55f8eeed31f0#8 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2023-07-21T22:10:28.042 INFO:journalctl@ceph.mon.c.smithi195.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-07-21T22:10:28.042 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-07-21T22:10:28.042 INFO:journalctl@ceph.mon.c.smithi195.stdout: ** File Read Latency Histogram By Level [default] ** 2023-07-21T22:10:28.043 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c does not exist in monmap, will attempt to join an existing cluster 2023-07-21T22:10:28.043 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: using public_addr v2:172.21.15.195:0/0 -> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2023-07-21T22:10:28.043 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: starting mon.c rank -1 at public addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] at bind addrs [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:10:28.043 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 bash[97324]: cd55c9eb1ac0fd7227723c863277b00da00c5df97b09075b01be522cf3c2d2a4 2023-07-21T22:10:28.043 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(???) e0 preinit fsid f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:10:28.043 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).mds e1 new map 2023-07-21T22:10:28.043 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).mds e1 print_map 2023-07-21T22:10:28.043 INFO:journalctl@ceph.mon.c.smithi195.stdout: e1 2023-07-21T22:10:28.044 INFO:journalctl@ceph.mon.c.smithi195.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-07-21T22:10:28.044 INFO:journalctl@ceph.mon.c.smithi195.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-21T22:10:28.044 INFO:journalctl@ceph.mon.c.smithi195.stdout: legacy client fscid: -1 2023-07-21T22:10:28.044 INFO:journalctl@ceph.mon.c.smithi195.stdout: 2023-07-21T22:10:28.044 INFO:journalctl@ceph.mon.c.smithi195.stdout: No filesystems configured 2023-07-21T22:10:28.044 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-07-21T22:10:28.044 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-07-21T22:10:28.045 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-07-21T22:10:28.045 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-07-21T22:10:28.045 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-07-21T22:10:28.045 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-07-21T22:10:28.045 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-21T22:10:28.045 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-21T22:10:28.045 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-21T22:10:28.045 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-21T22:10:28.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:28.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:28.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:10:28.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:28.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:28.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Updating smithi187:/etc/ceph/ceph.conf 2023-07-21T22:10:28.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:28.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:28.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Deploying cephadm binary to smithi195 2023-07-21T22:10:28.048 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:28.048 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:10:28.048 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:28.048 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.048 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.048 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.048 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.049 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:28.049 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Added host smithi195 2023-07-21T22:10:28.049 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.049 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.049 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:28.049 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.049 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:10:28.049 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:28.050 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:28.050 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/4008023620' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-21T22:10:28.050 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.050 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.050 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.050 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.050 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:10:28.050 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:28.051 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:28.051 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Updating smithi195:/etc/ceph/ceph.conf 2023-07-21T22:10:28.051 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/4008023620' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-21T22:10:28.051 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:28.051 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:28.051 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:28.051 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:28.051 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:10:28.052 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.052 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.052 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.052 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:28.052 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi151:172.21.15.151=a;smithi187:172.21.15.187=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:28.052 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Saving service mon spec with placement smithi151:172.21.15.151=a;smithi187:172.21.15.187=b;smithi195:172.21.15.195=c;count:3 2023-07-21T22:10:28.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:28.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:28.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:28.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:28.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:28.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: Deploying daemon mon.c on smithi195 2023-07-21T22:10:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/573451499' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-21T22:10:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-07-21T22:10:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: mon.c@-1(synchronizing) e1 handle_conf_change mon_allow_pool_delete 2023-07-21T22:10:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta expand map: {default=false} 2023-07-21T22:10:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta from 'false' to 'false' 2023-07-21T22:10:28.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta expanded map: {default=false} 2023-07-21T22:10:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta expand map: {default=info} 2023-07-21T22:10:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta from 'info' to 'info' 2023-07-21T22:10:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta expanded map: {default=info} 2023-07-21T22:10:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta expand map: {default=daemon} 2023-07-21T22:10:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta from 'daemon' to 'daemon' 2023-07-21T22:10:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta expanded map: {default=daemon} 2023-07-21T22:10:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta expand map: {default=debug} 2023-07-21T22:10:28.055 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta from 'debug' to 'debug' 2023-07-21T22:10:28.056 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 ceph-mon[97365]: expand_channel_meta expanded map: {default=debug} 2023-07-21T22:10:28.305 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-21T22:10:28.306 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph mon dump -f json 2023-07-21T22:10:28.368 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:27 smithi195 systemd[1]: Started Ceph mon.c for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:10:29.022 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:10:33.403 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:10:33.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: mon.a calling monitor election 2023-07-21T22:10:33.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:33.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: mon.c calling monitor election 2023-07-21T22:10:33.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:33.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-21T22:10:33.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: monmap e2: 2 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-07-21T22:10:33.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: fsmap 2023-07-21T22:10:33.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:33.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: mgrmap e13: x(active, since 50s) 2023-07-21T22:10:33.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: overall HEALTH_OK 2023-07-21T22:10:33.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:33.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:33.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:10:33.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: mon.a calling monitor election 2023-07-21T22:10:33.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:33.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: mon.c calling monitor election 2023-07-21T22:10:33.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:33.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:33.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-21T22:10:33.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: monmap e2: 2 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-07-21T22:10:33.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: fsmap 2023-07-21T22:10:33.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:33.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: mgrmap e13: x(active, since 50s) 2023-07-21T22:10:33.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: overall HEALTH_OK 2023-07-21T22:10:33.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:33.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:33.510 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.468+0000 7f24f4fca700 1 -- 172.21.15.195:0/1712012636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24d80035c0 msgr2=0x7f24d8005a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:33.510 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.468+0000 7f24f4fca700 1 --2- 172.21.15.195:0/1712012636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24d80035c0 0x7f24d8005a40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f24f0072780 tx=0x7f24e000feb0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.510 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.468+0000 7f24f4fca700 1 -- 172.21.15.195:0/1712012636 shutdown_connections 2023-07-21T22:10:33.510 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.468+0000 7f24f4fca700 1 --2- 172.21.15.195:0/1712012636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24d80035c0 0x7f24d8005a40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.510 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.468+0000 7f24f4fca700 1 -- 172.21.15.195:0/1712012636 >> 172.21.15.195:0/1712012636 conn(0x7f24f00fb210 msgr2=0x7f24f00fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:33.511 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.468+0000 7f24f4fca700 1 -- 172.21.15.195:0/1712012636 shutdown_connections 2023-07-21T22:10:33.511 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.468+0000 7f24f4fca700 1 -- 172.21.15.195:0/1712012636 wait complete. 2023-07-21T22:10:33.511 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.470+0000 7f24f4fca700 1 Processor -- start 2023-07-21T22:10:33.511 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.470+0000 7f24f4fca700 1 -- start start 2023-07-21T22:10:33.512 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.470+0000 7f24f4fca700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 0x7f24f0196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:33.512 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.470+0000 7f24f4fca700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24f01972d0 0x7f24f019b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:33.513 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.470+0000 7f24f4fca700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f0197850 con 0x7f24f01972d0 2023-07-21T22:10:33.513 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.470+0000 7f24f4fca700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24f01979c0 con 0x7f24d80035c0 2023-07-21T22:10:33.513 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.471+0000 7f24ee59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 0x7f24f0196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:33.513 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.471+0000 7f24edd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24f01972d0 0x7f24f019b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:33.513 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.471+0000 7f24ee59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 0x7f24f0196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:41154/0 (socket says 172.21.15.195:41154) 2023-07-21T22:10:33.513 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.471+0000 7f24ee59c700 1 -- 172.21.15.195:0/3670697007 learned_addr learned my addr 172.21.15.195:0/3670697007 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:10:33.514 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.471+0000 7f24ee59c700 1 -- 172.21.15.195:0/3670697007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 msgr2=0x7f24f0196d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2023-07-21T22:10:33.514 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.471+0000 7f24ee59c700 1 -- 172.21.15.195:0/3670697007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 msgr2=0x7f24f0196d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-07-21T22:10:33.515 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.471+0000 7f24ee59c700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 0x7f24f0196d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T22:10:33.515 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.471+0000 7f24ee59c700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 0x7f24f0196d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:10:33.515 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.472+0000 7f24edd9b700 1 -- 172.21.15.195:0/3670697007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 msgr2=0x7f24f0196d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:10:33.515 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.472+0000 7f24edd9b700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 0x7f24f0196d90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.515 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.472+0000 7f24edd9b700 1 -- 172.21.15.195:0/3670697007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24e000f900 con 0x7f24f01972d0 2023-07-21T22:10:33.515 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.472+0000 7f24edd9b700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24f01972d0 0x7f24f019b740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24e400b4d0 tx=0x7f24e400b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:33.515 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.472+0000 7f24df7fe700 1 -- 172.21.15.195:0/3670697007 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f24e4011630 con 0x7f24f01972d0 2023-07-21T22:10:33.516 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.472+0000 7f24df7fe700 1 -- 172.21.15.195:0/3670697007 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f24e4011c20 con 0x7f24f01972d0 2023-07-21T22:10:33.516 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.472+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24f019bce0 con 0x7f24f01972d0 2023-07-21T22:10:33.516 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.472+0000 7f24df7fe700 1 -- 172.21.15.195:0/3670697007 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7f24e4010c60 con 0x7f24f01972d0 2023-07-21T22:10:33.516 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.472+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24f019c1e0 con 0x7f24f01972d0 2023-07-21T22:10:33.517 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.473+0000 7f24df7fe700 1 -- 172.21.15.195:0/3670697007 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f24e4011790 con 0x7f24f01972d0 2023-07-21T22:10:33.517 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.474+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24f0061b40 con 0x7f24f01972d0 2023-07-21T22:10:33.517 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.474+0000 7f24df7fe700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f24d00385f0 0x7f24d003aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:33.517 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.474+0000 7f24df7fe700 1 -- 172.21.15.195:0/3670697007 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f24e404ae20 con 0x7f24f01972d0 2023-07-21T22:10:33.517 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.474+0000 7f24ee59c700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f24d00385f0 0x7f24d003aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:33.517 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.475+0000 7f24ee59c700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f24d00385f0 0x7f24d003aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24e0005b40 tx=0x7f24e0005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:33.521 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.480+0000 7f24df7fe700 1 -- 172.21.15.195:0/3670697007 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f24e4010380 con 0x7f24f01972d0 2023-07-21T22:10:33.795 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.754+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f24f019c510 con 0x7f24f01972d0 2023-07-21T22:10:33.796 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.754+0000 7f24df7fe700 1 -- 172.21.15.195:0/3670697007 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1010 (secure 0 0 0) 0x7f24e4011d90 con 0x7f24f01972d0 2023-07-21T22:10:33.796 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:10:33.796 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","modified":"2023-07-21T22:10:27.958148Z","created":"2023-07-21T22:08:33.303180Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-07-21T22:10:33.799 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f24d00385f0 msgr2=0x7f24d003aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:33.799 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f24d00385f0 0x7f24d003aaa0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f24e0005b40 tx=0x7f24e0005a90 comp rx=0 tx=0).stop 2023-07-21T22:10:33.799 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24f01972d0 msgr2=0x7f24f019b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:33.800 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24f01972d0 0x7f24f019b740 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f24e400b4d0 tx=0x7f24e400b890 comp rx=0 tx=0).stop 2023-07-21T22:10:33.800 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 shutdown_connections 2023-07-21T22:10:33.800 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f24d00385f0 0x7f24d003aaa0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.800 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f24d80035c0 0x7f24f0196d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.801 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 --2- 172.21.15.195:0/3670697007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24f01972d0 0x7f24f019b740 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:33.801 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 >> 172.21.15.195:0/3670697007 conn(0x7f24f00fb210 msgr2=0x7f24f0103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:33.801 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 shutdown_connections 2023-07-21T22:10:33.802 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:33.757+0000 7f24f4fca700 1 -- 172.21.15.195:0/3670697007 wait complete. 2023-07-21T22:10:33.802 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2023-07-21T22:10:34.403 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:34 smithi195 ceph-mon[97365]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:34.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:34 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:34.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:34 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:34.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:34 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:34.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:34 smithi195 ceph-mon[97365]: Deploying daemon mon.b on smithi187 2023-07-21T22:10:34.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:34 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/3670697007' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-21T22:10:34.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:34 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:34.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:34 smithi151 ceph-mon[95510]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:34.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:34 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:34.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:34 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:34.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:34 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:34.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:34 smithi151 ceph-mon[95510]: Deploying daemon mon.b on smithi187 2023-07-21T22:10:34.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:34 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/3670697007' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-21T22:10:34.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:34 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:35.200 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-21T22:10:35.200 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph mon dump -f json 2023-07-21T22:10:35.446 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:10:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:10:34.958+0000 7f51f6ad5700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-07-21T22:10:35.925 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:10:36.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:36 smithi195 ceph-mon[97365]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:36.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:36 smithi151 ceph-mon[95510]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:37.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:36 smithi187 systemd[1]: Starting Ceph mon.b for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:10:37.282 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.240+0000 7fde8ec6b700 1 -- 172.21.15.195:0/283057904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde88105730 msgr2=0x7fde88105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:37.282 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.240+0000 7fde8ec6b700 1 --2- 172.21.15.195:0/283057904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde88105730 0x7fde88105b00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fde84009910 tx=0x7fde84009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:37.282 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.240+0000 7fde8ec6b700 1 -- 172.21.15.195:0/283057904 shutdown_connections 2023-07-21T22:10:37.283 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.240+0000 7fde8ec6b700 1 --2- 172.21.15.195:0/283057904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde88105730 0x7fde88105b00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:37.283 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.240+0000 7fde8ec6b700 1 -- 172.21.15.195:0/283057904 >> 172.21.15.195:0/283057904 conn(0x7fde880fb210 msgr2=0x7fde880fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:37.283 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.240+0000 7fde8ec6b700 1 -- 172.21.15.195:0/283057904 shutdown_connections 2023-07-21T22:10:37.283 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.240+0000 7fde8ec6b700 1 -- 172.21.15.195:0/283057904 wait complete. 2023-07-21T22:10:37.284 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.241+0000 7fde8ec6b700 1 Processor -- start 2023-07-21T22:10:37.285 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde8ec6b700 1 -- start start 2023-07-21T22:10:37.285 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde8ec6b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde88105730 0x7fde88196e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:37.285 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde8ec6b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 0x7fde8819b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:37.285 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde8ec6b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88197920 con 0x7fde88105730 2023-07-21T22:10:37.285 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde8ec6b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde88197a90 con 0x7fde881973a0 2023-07-21T22:10:37.285 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde7ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 0x7fde8819b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:37.285 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde7ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 0x7fde8819b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:41156/0 (socket says 172.21.15.195:41156) 2023-07-21T22:10:37.286 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde7ffff700 1 -- 172.21.15.195:0/2933607887 learned_addr learned my addr 172.21.15.195:0/2933607887 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:10:37.286 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde7ffff700 1 -- 172.21.15.195:0/2933607887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 msgr2=0x7fde8819b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2023-07-21T22:10:37.286 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde7ffff700 1 -- 172.21.15.195:0/2933607887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 msgr2=0x7fde8819b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-07-21T22:10:37.286 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde7ffff700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 0x7fde8819b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T22:10:37.286 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.242+0000 7fde8ca07700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde88105730 0x7fde88196e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:37.286 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.243+0000 7fde7ffff700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 0x7fde8819b810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:10:37.286 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.243+0000 7fde8ca07700 1 -- 172.21.15.195:0/2933607887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 msgr2=0x7fde8819b810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:10:37.287 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.243+0000 7fde8ca07700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 0x7fde8819b810 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:37.287 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.243+0000 7fde8ca07700 1 -- 172.21.15.195:0/2933607887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde840095f0 con 0x7fde88105730 2023-07-21T22:10:37.287 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.243+0000 7fde8ca07700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde88105730 0x7fde88196e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fde84009910 tx=0x7fde84004f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:37.288 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.244+0000 7fde7dffb700 1 -- 172.21.15.195:0/2933607887 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fde8401d070 con 0x7fde88105730 2023-07-21T22:10:37.288 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.244+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8819bdb0 con 0x7fde88105730 2023-07-21T22:10:37.288 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.244+0000 7fde7dffb700 1 -- 172.21.15.195:0/2933607887 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde84005dc0 con 0x7fde88105730 2023-07-21T22:10:37.288 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.244+0000 7fde7dffb700 1 -- 172.21.15.195:0/2933607887 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 309+0+0 (secure 0 0 0) 0x7fde84022c70 con 0x7fde88105730 2023-07-21T22:10:37.288 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.244+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8819c2b0 con 0x7fde88105730 2023-07-21T22:10:37.289 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.245+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde88061b40 con 0x7fde88105730 2023-07-21T22:10:37.289 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.245+0000 7fde7dffb700 1 -- 172.21.15.195:0/2933607887 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fde84022470 con 0x7fde88105730 2023-07-21T22:10:37.289 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.245+0000 7fde7dffb700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde700385e0 0x7fde7003aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:37.289 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.245+0000 7fde7dffb700 1 -- 172.21.15.195:0/2933607887 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fde8404cb00 con 0x7fde88105730 2023-07-21T22:10:37.289 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.246+0000 7fde7ffff700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde700385e0 0x7fde7003aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:37.289 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.246+0000 7fde7ffff700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde700385e0 0x7fde7003aa90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fde78009180 tx=0x7fde78008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:37.292 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.251+0000 7fde7dffb700 1 -- 172.21.15.195:0/2933607887 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fde84005c00 con 0x7fde88105730 2023-07-21T22:10:37.561 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.519+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fde8819c5e0 con 0x7fde88105730 2023-07-21T22:10:37.561 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.520+0000 7fde7dffb700 1 -- 172.21.15.195:0/2933607887 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1010 (secure 0 0 0) 0x7fde84013250 con 0x7fde88105730 2023-07-21T22:10:37.562 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:10:37.562 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":2,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","modified":"2023-07-21T22:10:27.958148Z","created":"2023-07-21T22:08:33.303180Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-07-21T22:10:37.564 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.522+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde700385e0 msgr2=0x7fde7003aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:37.564 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.522+0000 7fde8ec6b700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde700385e0 0x7fde7003aa90 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fde78009180 tx=0x7fde78008040 comp rx=0 tx=0).stop 2023-07-21T22:10:37.564 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.522+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde88105730 msgr2=0x7fde88196e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:37.565 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.522+0000 7fde8ec6b700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde88105730 0x7fde88196e60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fde84009910 tx=0x7fde84004f80 comp rx=0 tx=0).stop 2023-07-21T22:10:37.565 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.522+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 shutdown_connections 2023-07-21T22:10:37.565 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.522+0000 7fde8ec6b700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde700385e0 0x7fde7003aa90 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:37.565 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.522+0000 7fde8ec6b700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde88105730 0x7fde88196e60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:37.565 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.522+0000 7fde8ec6b700 1 --2- 172.21.15.195:0/2933607887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde881973a0 0x7fde8819b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:37.565 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.522+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 >> 172.21.15.195:0/2933607887 conn(0x7fde880fb210 msgr2=0x7fde88072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:37.565 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.523+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 shutdown_connections 2023-07-21T22:10:37.566 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:37.523+0000 7fde8ec6b700 1 -- 172.21.15.195:0/2933607887 wait complete. 2023-07-21T22:10:37.566 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 2 2023-07-21T22:10:37.634 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 podman[96878]: 2023-07-21T22:10:37.634 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 bash[96878]: 9feab3c2a379e7c949442ec51a81f683d3d2db9a0232d19cb33759b66ac4c1ac 2023-07-21T22:10:37.634 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: set uid:gid to 167:167 (ceph:ceph) 2023-07-21T22:10:37.635 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev), process ceph-mon, pid 7 2023-07-21T22:10:37.635 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pidfile_write: ignore empty --pid-file 2023-07-21T22:10:37.635 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: load: jerasure load: lrc 2023-07-21T22:10:37.635 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: RocksDB version: 7.9.2 2023-07-21T22:10:37.635 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Git sha 0 2023-07-21T22:10:37.635 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Compile date 2023-07-21 19:07:44 2023-07-21T22:10:37.635 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: DB SUMMARY 2023-07-21T22:10:37.635 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: DB Session ID: XZ3HQCY53N319V0GPMD5 2023-07-21T22:10:37.636 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: CURRENT file: CURRENT 2023-07-21T22:10:37.636 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: IDENTITY file: IDENTITY 2023-07-21T22:10:37.636 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2023-07-21T22:10:37.636 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2023-07-21T22:10:37.636 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2023-07-21T22:10:37.636 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.error_if_exists: 0 2023-07-21T22:10:37.636 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.create_if_missing: 0 2023-07-21T22:10:37.637 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.paranoid_checks: 1 2023-07-21T22:10:37.637 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.flush_verify_memtable_count: 1 2023-07-21T22:10:37.637 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2023-07-21T22:10:37.637 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2023-07-21T22:10:37.637 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.env: 0x56455f710720 2023-07-21T22:10:37.637 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.fs: PosixFileSystem 2023-07-21T22:10:37.637 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.info_log: 0x564561a79260 2023-07-21T22:10:37.637 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_file_opening_threads: 16 2023-07-21T22:10:37.638 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.statistics: (nil) 2023-07-21T22:10:37.638 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.use_fsync: 0 2023-07-21T22:10:37.638 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_log_file_size: 0 2023-07-21T22:10:37.638 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_manifest_file_size: 1073741824 2023-07-21T22:10:37.638 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.log_file_time_to_roll: 0 2023-07-21T22:10:37.638 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.keep_log_file_num: 1000 2023-07-21T22:10:37.638 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.recycle_log_file_num: 0 2023-07-21T22:10:37.639 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.allow_fallocate: 1 2023-07-21T22:10:37.639 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.allow_mmap_reads: 0 2023-07-21T22:10:37.639 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.allow_mmap_writes: 0 2023-07-21T22:10:37.639 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.use_direct_reads: 0 2023-07-21T22:10:37.639 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2023-07-21T22:10:37.639 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.create_missing_column_families: 0 2023-07-21T22:10:37.639 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.db_log_dir: 2023-07-21T22:10:37.639 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.wal_dir: 2023-07-21T22:10:37.641 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.table_cache_numshardbits: 6 2023-07-21T22:10:37.641 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.WAL_ttl_seconds: 0 2023-07-21T22:10:37.641 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.WAL_size_limit_MB: 0 2023-07-21T22:10:37.641 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2023-07-21T22:10:37.641 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.manifest_preallocation_size: 4194304 2023-07-21T22:10:37.641 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.is_fd_close_on_exec: 1 2023-07-21T22:10:37.642 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.advise_random_on_open: 1 2023-07-21T22:10:37.642 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.db_write_buffer_size: 0 2023-07-21T22:10:37.642 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.write_buffer_manager: 0x56456199a3c0 2023-07-21T22:10:37.642 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.access_hint_on_compaction_start: 1 2023-07-21T22:10:37.642 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.random_access_max_buffer_size: 1048576 2023-07-21T22:10:37.642 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.use_adaptive_mutex: 0 2023-07-21T22:10:37.642 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.rate_limiter: (nil) 2023-07-21T22:10:37.642 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2023-07-21T22:10:37.643 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.wal_recovery_mode: 2 2023-07-21T22:10:37.643 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.enable_thread_tracking: 0 2023-07-21T22:10:37.643 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.enable_pipelined_write: 0 2023-07-21T22:10:37.643 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.unordered_write: 0 2023-07-21T22:10:37.643 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.allow_concurrent_memtable_write: 1 2023-07-21T22:10:37.643 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2023-07-21T22:10:37.643 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.write_thread_max_yield_usec: 100 2023-07-21T22:10:37.644 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.write_thread_slow_yield_usec: 3 2023-07-21T22:10:37.644 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.row_cache: None 2023-07-21T22:10:37.644 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.wal_filter: None 2023-07-21T22:10:37.644 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.avoid_flush_during_recovery: 0 2023-07-21T22:10:37.645 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.allow_ingest_behind: 0 2023-07-21T22:10:37.645 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.two_write_queues: 0 2023-07-21T22:10:37.645 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.manual_wal_flush: 0 2023-07-21T22:10:37.645 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.wal_compression: 0 2023-07-21T22:10:37.645 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.atomic_flush: 0 2023-07-21T22:10:37.645 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2023-07-21T22:10:37.645 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.persist_stats_to_disk: 0 2023-07-21T22:10:37.646 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.write_dbid_to_manifest: 0 2023-07-21T22:10:37.646 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.log_readahead_size: 0 2023-07-21T22:10:37.646 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.file_checksum_gen_factory: Unknown 2023-07-21T22:10:37.646 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.best_efforts_recovery: 0 2023-07-21T22:10:37.646 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2023-07-21T22:10:37.646 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2023-07-21T22:10:37.646 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.allow_data_in_errors: 0 2023-07-21T22:10:37.646 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.db_host_id: __hostname__ 2023-07-21T22:10:37.647 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.enforce_single_del_contracts: true 2023-07-21T22:10:37.647 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_background_jobs: 2 2023-07-21T22:10:37.647 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_background_compactions: -1 2023-07-21T22:10:37.647 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_subcompactions: 1 2023-07-21T22:10:37.647 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.avoid_flush_during_shutdown: 0 2023-07-21T22:10:37.647 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2023-07-21T22:10:37.647 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.delayed_write_rate : 16777216 2023-07-21T22:10:37.647 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_total_wal_size: 0 2023-07-21T22:10:37.648 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2023-07-21T22:10:37.648 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.stats_dump_period_sec: 600 2023-07-21T22:10:37.648 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.stats_persist_period_sec: 600 2023-07-21T22:10:37.648 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.stats_history_buffer_size: 1048576 2023-07-21T22:10:37.648 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_open_files: -1 2023-07-21T22:10:37.648 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bytes_per_sync: 0 2023-07-21T22:10:37.648 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.wal_bytes_per_sync: 0 2023-07-21T22:10:37.649 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.strict_bytes_per_sync: 0 2023-07-21T22:10:37.649 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_readahead_size: 0 2023-07-21T22:10:37.649 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_background_flushes: -1 2023-07-21T22:10:37.649 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Compression algorithms supported: 2023-07-21T22:10:37.649 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: kZSTDNotFinalCompression supported: 0 2023-07-21T22:10:37.649 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: kZSTD supported: 0 2023-07-21T22:10:37.649 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: kXpressCompression supported: 0 2023-07-21T22:10:37.649 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: kLZ4HCCompression supported: 1 2023-07-21T22:10:37.650 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: kZlibCompression supported: 1 2023-07-21T22:10:37.650 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: kSnappyCompression supported: 1 2023-07-21T22:10:37.650 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: kLZ4Compression supported: 1 2023-07-21T22:10:37.650 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: kBZip2Compression supported: 0 2023-07-21T22:10:37.650 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Fast CRC32 supported: Supported on x86 2023-07-21T22:10:37.650 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: DMutex implementation: pthread_mutex_t 2023-07-21T22:10:37.650 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2023-07-21T22:10:37.650 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2023-07-21T22:10:37.651 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2023-07-21T22:10:37.651 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.merge_operator: 2023-07-21T22:10:37.651 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_filter: None 2023-07-21T22:10:37.651 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_filter_factory: None 2023-07-21T22:10:37.651 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.sst_partitioner_factory: None 2023-07-21T22:10:37.651 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.memtable_factory: SkipListFactory 2023-07-21T22:10:37.651 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.table_factory: BlockBasedTable 2023-07-21T22:10:37.651 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564561a79360) 2023-07-21T22:10:37.652 INFO:journalctl@ceph.mon.b.smithi187.stdout: cache_index_and_filter_blocks: 1 2023-07-21T22:10:37.652 INFO:journalctl@ceph.mon.b.smithi187.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2023-07-21T22:10:37.652 INFO:journalctl@ceph.mon.b.smithi187.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2023-07-21T22:10:37.652 INFO:journalctl@ceph.mon.b.smithi187.stdout: pin_top_level_index_and_filter: 1 2023-07-21T22:10:37.652 INFO:journalctl@ceph.mon.b.smithi187.stdout: index_type: 0 2023-07-21T22:10:37.652 INFO:journalctl@ceph.mon.b.smithi187.stdout: data_block_index_type: 0 2023-07-21T22:10:37.652 INFO:journalctl@ceph.mon.b.smithi187.stdout: index_shortening: 1 2023-07-21T22:10:37.653 INFO:journalctl@ceph.mon.b.smithi187.stdout: data_block_hash_table_util_ratio: 0.750000 2023-07-21T22:10:37.653 INFO:journalctl@ceph.mon.b.smithi187.stdout: checksum: 4 2023-07-21T22:10:37.653 INFO:journalctl@ceph.mon.b.smithi187.stdout: no_block_cache: 0 2023-07-21T22:10:37.653 INFO:journalctl@ceph.mon.b.smithi187.stdout: block_cache: 0x564561a391f0 2023-07-21T22:10:37.653 INFO:journalctl@ceph.mon.b.smithi187.stdout: block_cache_name: BinnedLRUCache 2023-07-21T22:10:37.653 INFO:journalctl@ceph.mon.b.smithi187.stdout: block_cache_options: 2023-07-21T22:10:37.653 INFO:journalctl@ceph.mon.b.smithi187.stdout: capacity : 536870912 2023-07-21T22:10:37.653 INFO:journalctl@ceph.mon.b.smithi187.stdout: num_shard_bits : 4 2023-07-21T22:10:37.654 INFO:journalctl@ceph.mon.b.smithi187.stdout: strict_capacity_limit : 0 2023-07-21T22:10:37.654 INFO:journalctl@ceph.mon.b.smithi187.stdout: high_pri_pool_ratio: 0.000 2023-07-21T22:10:37.654 INFO:journalctl@ceph.mon.b.smithi187.stdout: block_cache_compressed: (nil) 2023-07-21T22:10:37.654 INFO:journalctl@ceph.mon.b.smithi187.stdout: persistent_cache: (nil) 2023-07-21T22:10:37.654 INFO:journalctl@ceph.mon.b.smithi187.stdout: block_size: 4096 2023-07-21T22:10:37.654 INFO:journalctl@ceph.mon.b.smithi187.stdout: block_size_deviation: 10 2023-07-21T22:10:37.655 INFO:journalctl@ceph.mon.b.smithi187.stdout: block_restart_interval: 16 2023-07-21T22:10:37.655 INFO:journalctl@ceph.mon.b.smithi187.stdout: index_block_restart_interval: 1 2023-07-21T22:10:37.655 INFO:journalctl@ceph.mon.b.smithi187.stdout: metadata_block_size: 4096 2023-07-21T22:10:37.655 INFO:journalctl@ceph.mon.b.smithi187.stdout: partition_filters: 0 2023-07-21T22:10:37.655 INFO:journalctl@ceph.mon.b.smithi187.stdout: use_delta_encoding: 1 2023-07-21T22:10:37.656 INFO:journalctl@ceph.mon.b.smithi187.stdout: filter_policy: bloomfilter 2023-07-21T22:10:37.656 INFO:journalctl@ceph.mon.b.smithi187.stdout: whole_key_filtering: 1 2023-07-21T22:10:37.656 INFO:journalctl@ceph.mon.b.smithi187.stdout: verify_compression: 0 2023-07-21T22:10:37.656 INFO:journalctl@ceph.mon.b.smithi187.stdout: read_amp_bytes_per_bit: 0 2023-07-21T22:10:37.656 INFO:journalctl@ceph.mon.b.smithi187.stdout: format_version: 5 2023-07-21T22:10:37.656 INFO:journalctl@ceph.mon.b.smithi187.stdout: enable_index_compression: 1 2023-07-21T22:10:37.657 INFO:journalctl@ceph.mon.b.smithi187.stdout: block_align: 0 2023-07-21T22:10:37.657 INFO:journalctl@ceph.mon.b.smithi187.stdout: max_auto_readahead_size: 262144 2023-07-21T22:10:37.657 INFO:journalctl@ceph.mon.b.smithi187.stdout: prepopulate_block_cache: 0 2023-07-21T22:10:37.657 INFO:journalctl@ceph.mon.b.smithi187.stdout: initial_auto_readahead_size: 8192 2023-07-21T22:10:37.657 INFO:journalctl@ceph.mon.b.smithi187.stdout: num_file_reads_for_auto_readahead: 2 2023-07-21T22:10:37.657 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.write_buffer_size: 33554432 2023-07-21T22:10:37.657 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_write_buffer_number: 2 2023-07-21T22:10:37.657 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression: NoCompression 2023-07-21T22:10:37.658 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression: Disabled 2023-07-21T22:10:37.658 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.prefix_extractor: nullptr 2023-07-21T22:10:37.658 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2023-07-21T22:10:37.658 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.num_levels: 7 2023-07-21T22:10:37.658 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2023-07-21T22:10:37.658 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2023-07-21T22:10:37.658 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2023-07-21T22:10:37.659 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2023-07-21T22:10:37.659 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression_opts.level: 32767 2023-07-21T22:10:37.659 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2023-07-21T22:10:37.659 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2023-07-21T22:10:37.659 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2023-07-21T22:10:37.659 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2023-07-21T22:10:37.659 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression_opts.enabled: false 2023-07-21T22:10:37.659 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2023-07-21T22:10:37.660 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2023-07-21T22:10:37.660 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression_opts.window_bits: -14 2023-07-21T22:10:37.660 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression_opts.level: 32767 2023-07-21T22:10:37.660 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression_opts.strategy: 0 2023-07-21T22:10:37.660 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2023-07-21T22:10:37.661 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2023-07-21T22:10:37.661 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2023-07-21T22:10:37.661 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression_opts.parallel_threads: 1 2023-07-21T22:10:37.661 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression_opts.enabled: false 2023-07-21T22:10:37.661 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2023-07-21T22:10:37.661 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2023-07-21T22:10:37.662 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2023-07-21T22:10:37.662 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.level0_stop_writes_trigger: 36 2023-07-21T22:10:37.662 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.target_file_size_base: 67108864 2023-07-21T22:10:37.662 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.target_file_size_multiplier: 1 2023-07-21T22:10:37.662 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bytes_for_level_base: 268435456 2023-07-21T22:10:37.662 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2023-07-21T22:10:37.662 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2023-07-21T22:10:37.662 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2023-07-21T22:10:37.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2023-07-21T22:10:37.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2023-07-21T22:10:37.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2023-07-21T22:10:37.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2023-07-21T22:10:37.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2023-07-21T22:10:37.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2023-07-21T22:10:37.663 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2023-07-21T22:10:37.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_compaction_bytes: 1677721600 2023-07-21T22:10:37.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2023-07-21T22:10:37.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.arena_block_size: 1048576 2023-07-21T22:10:37.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2023-07-21T22:10:37.664 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2023-07-21T22:10:37.665 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.disable_auto_compactions: 0 2023-07-21T22:10:37.665 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2023-07-21T22:10:37.665 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2023-07-21T22:10:37.665 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2023-07-21T22:10:37.665 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2023-07-21T22:10:37.665 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2023-07-21T22:10:37.665 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2023-07-21T22:10:37.666 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2023-07-21T22:10:37.666 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2023-07-21T22:10:37.666 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2023-07-21T22:10:37.666 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2023-07-21T22:10:37.666 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.table_properties_collectors: 2023-07-21T22:10:37.666 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.inplace_update_support: 0 2023-07-21T22:10:37.666 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.inplace_update_num_locks: 10000 2023-07-21T22:10:37.666 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2023-07-21T22:10:37.667 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.memtable_whole_key_filtering: 0 2023-07-21T22:10:37.667 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.memtable_huge_page_size: 0 2023-07-21T22:10:37.667 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.bloom_locality: 0 2023-07-21T22:10:37.667 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.max_successive_merges: 0 2023-07-21T22:10:37.667 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.optimize_filters_for_hits: 0 2023-07-21T22:10:37.667 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.paranoid_file_checks: 0 2023-07-21T22:10:37.667 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.force_consistency_checks: 1 2023-07-21T22:10:37.667 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.report_bg_io_stats: 0 2023-07-21T22:10:37.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.ttl: 2592000 2023-07-21T22:10:37.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.periodic_compaction_seconds: 0 2023-07-21T22:10:37.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.preclude_last_level_data_seconds: 0 2023-07-21T22:10:37.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.preserve_internal_time_seconds: 0 2023-07-21T22:10:37.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.enable_blob_files: false 2023-07-21T22:10:37.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.min_blob_size: 0 2023-07-21T22:10:37.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.blob_file_size: 268435456 2023-07-21T22:10:37.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.blob_compression_type: NoCompression 2023-07-21T22:10:37.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.enable_blob_garbage_collection: false 2023-07-21T22:10:37.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2023-07-21T22:10:37.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2023-07-21T22:10:37.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.blob_compaction_readahead_size: 0 2023-07-21T22:10:37.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.blob_file_starting_level: 0 2023-07-21T22:10:37.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2023-07-21T22:10:37.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2023-07-21T22:10:37.670 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2023-07-21T22:10:37.670 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 2fa089f3-25d6-4eb1-b4de-63005b81a341 2023-07-21T22:10:37.670 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689977437582383, "job": 1, "event": "recovery_started", "wal_files": [4]} 2023-07-21T22:10:37.670 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2023-07-21T22:10:37.670 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689977437583408, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1747, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1689977437, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "2fa089f3-25d6-4eb1-b4de-63005b81a341", "db_session_id": "XZ3HQCY53N319V0GPMD5", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2023-07-21T22:10:37.670 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: EVENT_LOG_v1 {"time_micros": 1689977437583756, "job": 1, "event": "recovery_finished"} 2023-07-21T22:10:37.670 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2023-07-21T22:10:37.671 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2023-07-21T22:10:37.671 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564561ad2000 2023-07-21T22:10:37.671 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: DB pointer 0x564561abe000 2023-07-21T22:10:37.671 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2023-07-21T22:10:37.671 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: rocksdb: [db/db_impl/db_impl.cc:1111] 2023-07-21T22:10:37.671 INFO:journalctl@ceph.mon.b.smithi187.stdout: ** DB Stats ** 2023-07-21T22:10:37.671 INFO:journalctl@ceph.mon.b.smithi187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-21T22:10:37.671 INFO:journalctl@ceph.mon.b.smithi187.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2023-07-21T22:10:37.672 INFO:journalctl@ceph.mon.b.smithi187.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-21T22:10:37.672 INFO:journalctl@ceph.mon.b.smithi187.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-21T22:10:37.672 INFO:journalctl@ceph.mon.b.smithi187.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2023-07-21T22:10:37.672 INFO:journalctl@ceph.mon.b.smithi187.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2023-07-21T22:10:37.672 INFO:journalctl@ceph.mon.b.smithi187.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2023-07-21T22:10:37.672 INFO:journalctl@ceph.mon.b.smithi187.stdout: 2023-07-21T22:10:37.672 INFO:journalctl@ceph.mon.b.smithi187.stdout: ** Compaction Stats [default] ** 2023-07-21T22:10:37.673 INFO:journalctl@ceph.mon.b.smithi187.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-21T22:10:37.673 INFO:journalctl@ceph.mon.b.smithi187.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2023-07-21T22:10:37.673 INFO:journalctl@ceph.mon.b.smithi187.stdout: L0 1/0 1.71 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:10:37.673 INFO:journalctl@ceph.mon.b.smithi187.stdout: Sum 1/0 1.71 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:10:37.673 INFO:journalctl@ceph.mon.b.smithi187.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:10:37.673 INFO:journalctl@ceph.mon.b.smithi187.stdout: 2023-07-21T22:10:37.673 INFO:journalctl@ceph.mon.b.smithi187.stdout: ** Compaction Stats [default] ** 2023-07-21T22:10:37.674 INFO:journalctl@ceph.mon.b.smithi187.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2023-07-21T22:10:37.674 INFO:journalctl@ceph.mon.b.smithi187.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2023-07-21T22:10:37.674 INFO:journalctl@ceph.mon.b.smithi187.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2023-07-21T22:10:37.674 INFO:journalctl@ceph.mon.b.smithi187.stdout: 2023-07-21T22:10:37.674 INFO:journalctl@ceph.mon.b.smithi187.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2023-07-21T22:10:37.674 INFO:journalctl@ceph.mon.b.smithi187.stdout: 2023-07-21T22:10:37.674 INFO:journalctl@ceph.mon.b.smithi187.stdout: Uptime(secs): 0.0 total, 0.0 interval 2023-07-21T22:10:37.674 INFO:journalctl@ceph.mon.b.smithi187.stdout: Flush(GB): cumulative 0.000, interval 0.000 2023-07-21T22:10:37.675 INFO:journalctl@ceph.mon.b.smithi187.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2023-07-21T22:10:37.675 INFO:journalctl@ceph.mon.b.smithi187.stdout: AddFile(Total Files): cumulative 0, interval 0 2023-07-21T22:10:37.675 INFO:journalctl@ceph.mon.b.smithi187.stdout: AddFile(L0 Files): cumulative 0, interval 0 2023-07-21T22:10:37.675 INFO:journalctl@ceph.mon.b.smithi187.stdout: AddFile(Keys): cumulative 0, interval 0 2023-07-21T22:10:37.675 INFO:journalctl@ceph.mon.b.smithi187.stdout: Cumulative compaction: 0.00 GB write, 0.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-21T22:10:37.675 INFO:journalctl@ceph.mon.b.smithi187.stdout: Interval compaction: 0.00 GB write, 0.21 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2023-07-21T22:10:37.675 INFO:journalctl@ceph.mon.b.smithi187.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2023-07-21T22:10:37.676 INFO:journalctl@ceph.mon.b.smithi187.stdout: Block cache BinnedLRUCache@0x564561a391f0#7 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2023-07-21T22:10:37.676 INFO:journalctl@ceph.mon.b.smithi187.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2023-07-21T22:10:37.676 INFO:journalctl@ceph.mon.b.smithi187.stdout: 2023-07-21T22:10:37.676 INFO:journalctl@ceph.mon.b.smithi187.stdout: ** File Read Latency Histogram By Level [default] ** 2023-07-21T22:10:37.676 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b does not exist in monmap, will attempt to join an existing cluster 2023-07-21T22:10:37.676 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: using public_addr v2:172.21.15.187:0/0 -> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] 2023-07-21T22:10:37.676 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: starting mon.b rank -1 at public addrs [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] at bind addrs [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:10:37.676 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(???) e0 preinit fsid f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:10:38.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).mds e1 new map 2023-07-21T22:10:38.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).mds e1 print_map 2023-07-21T22:10:38.126 INFO:journalctl@ceph.mon.b.smithi187.stdout: e1 2023-07-21T22:10:38.126 INFO:journalctl@ceph.mon.b.smithi187.stdout: enable_multiple, ever_enabled_multiple: 1,1 2023-07-21T22:10:38.126 INFO:journalctl@ceph.mon.b.smithi187.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-21T22:10:38.127 INFO:journalctl@ceph.mon.b.smithi187.stdout: legacy client fscid: -1 2023-07-21T22:10:38.127 INFO:journalctl@ceph.mon.b.smithi187.stdout: 2023-07-21T22:10:38.127 INFO:journalctl@ceph.mon.b.smithi187.stdout: No filesystems configured 2023-07-21T22:10:38.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2023-07-21T22:10:38.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2023-07-21T22:10:38.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2023-07-21T22:10:38.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2023-07-21T22:10:38.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2023-07-21T22:10:38.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2023-07-21T22:10:38.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2023-07-21T22:10:38.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-21T22:10:38.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-21T22:10:38.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2023-07-21T22:10:38.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi195", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:38.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi187", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:10:38.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:38.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:38.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Updating smithi187:/etc/ceph/ceph.conf 2023-07-21T22:10:38.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:38.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Deploying cephadm binary to smithi195 2023-07-21T22:10:38.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:38.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:10:38.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:38.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Added host smithi195 2023-07-21T22:10:38.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:10:38.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/4008023620' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2023-07-21T22:10:38.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi195", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:10:38.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:38.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:38.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Updating smithi195:/etc/ceph/ceph.conf 2023-07-21T22:10:38.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/4008023620' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2023-07-21T22:10:38.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:38.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:38.136 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:38.136 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.136 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:10:38.136 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.137 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.137 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.137 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.137 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi151:172.21.15.151=a;smithi187:172.21.15.187=b;smithi195:172.21.15.195=c", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:38.137 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Saving service mon spec with placement smithi151:172.21.15.151=a;smithi187:172.21.15.187=b;smithi195:172.21.15.195=c;count:3 2023-07-21T22:10:38.137 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.138 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:38.138 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:38.138 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:38.138 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.138 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:38.138 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:38.138 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Deploying daemon mon.c on smithi195 2023-07-21T22:10:38.139 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.139 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/573451499' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-21T22:10:38.139 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:10:38.139 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:38.139 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.a calling monitor election 2023-07-21T22:10:38.139 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.139 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:38.140 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:38.140 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.c calling monitor election 2023-07-21T22:10:38.140 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.140 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:38.140 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:38.140 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:38.140 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-21T22:10:38.141 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: monmap e2: 2 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-07-21T22:10:38.141 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: fsmap 2023-07-21T22:10:38.141 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:38.141 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mgrmap e13: x(active, since 50s) 2023-07-21T22:10:38.141 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: overall HEALTH_OK 2023-07-21T22:10:38.141 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.142 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.142 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.142 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:38.142 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:38.142 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:38.142 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: Deploying daemon mon.b on smithi187 2023-07-21T22:10:38.144 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/3670697007' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-21T22:10:38.144 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:38.144 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:38.145 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2023-07-21T22:10:38.145 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta expand map: {default=false} 2023-07-21T22:10:38.145 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta from 'false' to 'false' 2023-07-21T22:10:38.145 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta expanded map: {default=false} 2023-07-21T22:10:38.146 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta expand map: {default=info} 2023-07-21T22:10:38.146 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta from 'info' to 'info' 2023-07-21T22:10:38.146 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta expanded map: {default=info} 2023-07-21T22:10:38.146 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta expand map: {default=daemon} 2023-07-21T22:10:38.147 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta from 'daemon' to 'daemon' 2023-07-21T22:10:38.147 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta expanded map: {default=daemon} 2023-07-21T22:10:38.147 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta expand map: {default=debug} 2023-07-21T22:10:38.147 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta from 'debug' to 'debug' 2023-07-21T22:10:38.148 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: expand_channel_meta expanded map: {default=debug} 2023-07-21T22:10:38.148 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 ceph-mon[96918]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2023-07-21T22:10:38.148 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:37 smithi187 systemd[1]: Started Ceph mon.b for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:10:39.001 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2023-07-21T22:10:39.001 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph mon dump -f json 2023-07-21T22:10:39.724 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:10:42.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.668+0000 7fdea64b4700 1 -- 172.21.15.195:0/645622784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 msgr2=0x7fdea0105b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.712 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.668+0000 7fdea64b4700 1 --2- 172.21.15.195:0/645622784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 0x7fdea0105b00 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fde9000fb50 tx=0x7fde9000fe60 comp rx=0 tx=0).stop 2023-07-21T22:10:42.713 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.668+0000 7fdea64b4700 1 -- 172.21.15.195:0/645622784 shutdown_connections 2023-07-21T22:10:42.713 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.668+0000 7fdea64b4700 1 --2- 172.21.15.195:0/645622784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 0x7fdea0105b00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.713 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.668+0000 7fdea64b4700 1 -- 172.21.15.195:0/645622784 >> 172.21.15.195:0/645622784 conn(0x7fdea00fb210 msgr2=0x7fdea00fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:42.713 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.668+0000 7fdea64b4700 1 -- 172.21.15.195:0/645622784 shutdown_connections 2023-07-21T22:10:42.713 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.669+0000 7fdea64b4700 1 -- 172.21.15.195:0/645622784 wait complete. 2023-07-21T22:10:42.713 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.670+0000 7fdea64b4700 1 Processor -- start 2023-07-21T22:10:42.713 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.670+0000 7fdea64b4700 1 -- start start 2023-07-21T22:10:42.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea64b4700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 0x7fdea0196f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:42.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea64b4700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdea01974b0 0x7fdea019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:42.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea64b4700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdea019be60 0x7fdea019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:42.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea64b4700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea0197b80 con 0x7fdea0105730 2023-07-21T22:10:42.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea64b4700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea01a3bd0 con 0x7fdea01974b0 2023-07-21T22:10:42.714 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea64b4700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdea01a3d10 con 0x7fdea019be60 2023-07-21T22:10:42.715 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fde9ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 0x7fdea0196f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:42.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fde9ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 0x7fdea0196f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.195:57406/0 (socket says 172.21.15.195:57406) 2023-07-21T22:10:42.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fde9ffff700 1 -- 172.21.15.195:0/2453070224 learned_addr learned my addr 172.21.15.195:0/2453070224 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:10:42.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea4a51700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdea019be60 0x7fdea019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:42.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fde9f7fe700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdea01974b0 0x7fdea019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:42.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea4a51700 1 -- 172.21.15.195:0/2453070224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdea019be60 msgr2=0x7fdea019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2023-07-21T22:10:42.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea4a51700 1 -- 172.21.15.195:0/2453070224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdea019be60 msgr2=0x7fdea019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2023-07-21T22:10:42.716 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.671+0000 7fdea4a51700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdea019be60 0x7fdea019c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-07-21T22:10:42.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fdea4a51700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdea019be60 0x7fdea019c300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:10:42.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fde9ffff700 1 -- 172.21.15.195:0/2453070224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdea019be60 msgr2=0x7fdea019c300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:10:42.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fde9ffff700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdea019be60 0x7fdea019c300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fde9ffff700 1 -- 172.21.15.195:0/2453070224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdea01974b0 msgr2=0x7fdea019b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:42.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fde9ffff700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdea01974b0 0x7fdea019b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:42.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fde9ffff700 1 -- 172.21.15.195:0/2453070224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde9000f830 con 0x7fdea0105730 2023-07-21T22:10:42.717 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fde9ffff700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 0x7fdea0196f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde90011c20 tx=0x7fde90011d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:42.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fde9d7fa700 1 -- 172.21.15.195:0/2453070224 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde90005480 con 0x7fdea0105730 2023-07-21T22:10:42.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fde9d7fa700 1 -- 172.21.15.195:0/2453070224 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde900055e0 con 0x7fdea0105730 2023-07-21T22:10:42.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.672+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdea01a3f60 con 0x7fdea0105730 2023-07-21T22:10:42.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.673+0000 7fde9d7fa700 1 -- 172.21.15.195:0/2453070224 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde9001c6a0 con 0x7fdea0105730 2023-07-21T22:10:42.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.673+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdea01a4320 con 0x7fdea0105730 2023-07-21T22:10:42.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.674+0000 7fde9d7fa700 1 -- 172.21.15.195:0/2453070224 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fde9001c860 con 0x7fdea0105730 2023-07-21T22:10:42.718 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.674+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdea0061b40 con 0x7fdea0105730 2023-07-21T22:10:42.719 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.674+0000 7fde9d7fa700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde88038c30 0x7fde8803b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:42.719 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.674+0000 7fde9d7fa700 1 -- 172.21.15.195:0/2453070224 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fde90018070 con 0x7fdea0105730 2023-07-21T22:10:42.719 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.675+0000 7fde9f7fe700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde88038c30 0x7fde8803b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:42.720 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.675+0000 7fde9f7fe700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde88038c30 0x7fde8803b0e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fde94009850 tx=0x7fde94008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:42.721 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.680+0000 7fde9d7fa700 1 -- 172.21.15.195:0/2453070224 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fde9001bdb0 con 0x7fdea0105730 2023-07-21T22:10:43.007 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.966+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fdea01982d0 con 0x7fdea0105730 2023-07-21T22:10:43.008 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.966+0000 7fde9d7fa700 1 -- 172.21.15.195:0/2453070224 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) v1 ==== 95+0+1278 (secure 0 0 0) 0x7fde9001b380 con 0x7fdea0105730 2023-07-21T22:10:43.008 INFO:teuthology.orchestra.run.smithi195.stdout: 2023-07-21T22:10:43.008 INFO:teuthology.orchestra.run.smithi195.stdout:{"epoch":3,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","modified":"2023-07-21T22:10:37.632962Z","created":"2023-07-21T22:08:33.303180Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:3300","nonce":0},{"type":"v1","addr":"172.21.15.195:6789","nonce":0}]},"addr":"172.21.15.195:6789/0","public_addr":"172.21.15.195:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:3300","nonce":0},{"type":"v1","addr":"172.21.15.187:6789","nonce":0}]},"addr":"172.21.15.187:6789/0","public_addr":"172.21.15.187:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2023-07-21T22:10:43.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde88038c30 msgr2=0x7fde8803b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde88038c30 0x7fde8803b0e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fde94009850 tx=0x7fde94008040 comp rx=0 tx=0).stop 2023-07-21T22:10:43.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 msgr2=0x7fdea0196f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:43.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 0x7fdea0196f70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fde90011c20 tx=0x7fde90011d00 comp rx=0 tx=0).stop 2023-07-21T22:10:43.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 shutdown_connections 2023-07-21T22:10:43.011 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fde88038c30 0x7fde8803b0e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdea019be60 0x7fdea019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdea0105730 0x7fdea0196f70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 --2- 172.21.15.195:0/2453070224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdea01974b0 0x7fdea019b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:43.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 >> 172.21.15.195:0/2453070224 conn(0x7fdea00fb210 msgr2=0x7fdea00fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:43.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 shutdown_connections 2023-07-21T22:10:43.012 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:42.969+0000 7fdea64b4700 1 -- 172.21.15.195:0/2453070224 wait complete. 2023-07-21T22:10:43.013 INFO:teuthology.orchestra.run.smithi195.stderr:dumped monmap epoch 3 2023-07-21T22:10:43.033 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:10:43.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: mon.a calling monitor election 2023-07-21T22:10:43.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: mon.c calling monitor election 2023-07-21T22:10:43.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:43.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:43.035 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:43.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-21T22:10:43.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: monmap e3: 3 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0],b=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-07-21T22:10:43.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: fsmap 2023-07-21T22:10:43.036 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:43.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: mgrmap e13: x(active, since 59s) 2023-07-21T22:10:43.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-07-21T22:10:43.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-07-21T22:10:43.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-07-21T22:10:43.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: mon.b (rank 2) addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] is down (out of quorum) 2023-07-21T22:10:43.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:43.037 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:43.038 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:43.038 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:43.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:10:43.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: mon.a calling monitor election 2023-07-21T22:10:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: mon.c calling monitor election 2023-07-21T22:10:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-21T22:10:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: monmap e3: 3 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0],b=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-07-21T22:10:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: fsmap 2023-07-21T22:10:43.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:43.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: mgrmap e13: x(active, since 59s) 2023-07-21T22:10:43.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-07-21T22:10:43.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-07-21T22:10:43.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-07-21T22:10:43.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: mon.b (rank 2) addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] is down (out of quorum) 2023-07-21T22:10:43.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:43.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:43.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:43.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:43.400 INFO:tasks.cephadm:Generating final ceph.conf file... 2023-07-21T22:10:43.400 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph config generate-minimal-conf 2023-07-21T22:10:44.125 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:10:44.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:43 smithi195 ceph-mon[97365]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:44.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:44.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:43 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/2453070224' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-21T22:10:44.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:44.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:44.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:43 smithi151 ceph-mon[95510]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:44.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:44.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:43 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/2453070224' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-21T22:10:44.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:44.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:45.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:10:45.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mon.a calling monitor election 2023-07-21T22:10:45.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mon.c calling monitor election 2023-07-21T22:10:45.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:45.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:10:45.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:45.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:45.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:45.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:45.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:45.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:45.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:45.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2023-07-21T22:10:45.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: monmap e3: 3 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0],b=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-07-21T22:10:45.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: fsmap 2023-07-21T22:10:45.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:45.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mgrmap e13: x(active, since 59s) 2023-07-21T22:10:45.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: Health check failed: 1/3 mons down, quorum a,c (MON_DOWN) 2023-07-21T22:10:45.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: Health detail: HEALTH_WARN 1/3 mons down, quorum a,c 2023-07-21T22:10:45.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: [WRN] MON_DOWN: 1/3 mons down, quorum a,c 2023-07-21T22:10:45.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mon.b (rank 2) addr [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] is down (out of quorum) 2023-07-21T22:10:45.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:45.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/2453070224' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2023-07-21T22:10:45.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:45.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:45.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mon.b calling monitor election 2023-07-21T22:10:45.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mon.b calling monitor election 2023-07-21T22:10:45.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mon.a calling monitor election 2023-07-21T22:10:45.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mon.c calling monitor election 2023-07-21T22:10:45.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-21T22:10:45.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: monmap e3: 3 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0],b=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-07-21T22:10:45.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: fsmap 2023-07-21T22:10:45.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:45.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: mgrmap e13: x(active, since 61s) 2023-07-21T22:10:45.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-07-21T22:10:45.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: Cluster is now healthy 2023-07-21T22:10:45.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: overall HEALTH_OK 2023-07-21T22:10:45.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:45.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:45.148 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: mon.b calling monitor election 2023-07-21T22:10:45.148 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: mon.b calling monitor election 2023-07-21T22:10:45.148 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: mon.a calling monitor election 2023-07-21T22:10:45.148 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: mon.c calling monitor election 2023-07-21T22:10:45.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-21T22:10:45.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: monmap e3: 3 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0],b=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-07-21T22:10:45.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: fsmap 2023-07-21T22:10:45.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:45.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: mgrmap e13: x(active, since 61s) 2023-07-21T22:10:45.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-07-21T22:10:45.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: Cluster is now healthy 2023-07-21T22:10:45.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: overall HEALTH_OK 2023-07-21T22:10:45.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:45.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:45.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: mon.b calling monitor election 2023-07-21T22:10:45.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: mon.b calling monitor election 2023-07-21T22:10:45.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: mon.a calling monitor election 2023-07-21T22:10:45.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: mon.c calling monitor election 2023-07-21T22:10:45.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2023-07-21T22:10:45.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: monmap e3: 3 mons at {a=[v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0],b=[v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0],c=[v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0]} removed_ranks: {} 2023-07-21T22:10:45.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: fsmap 2023-07-21T22:10:45.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: osdmap e4: 0 total, 0 up, 0 in 2023-07-21T22:10:45.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: mgrmap e13: x(active, since 61s) 2023-07-21T22:10:45.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: Health check cleared: MON_DOWN (was: 1/3 mons down, quorum a,c) 2023-07-21T22:10:45.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: Cluster is now healthy 2023-07-21T22:10:45.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: overall HEALTH_OK 2023-07-21T22:10:45.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:45.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:45.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:45.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.747+0000 7f61d0f9a700 1 -- 172.21.15.151:0/2653883947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 msgr2=0x7f61cc105a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:45.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.747+0000 7f61d0f9a700 1 --2- 172.21.15.151:0/2653883947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 0x7f61cc105a20 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f61bc009910 tx=0x7f61bc009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:45.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.748+0000 7f61d0f9a700 1 -- 172.21.15.151:0/2653883947 shutdown_connections 2023-07-21T22:10:45.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.748+0000 7f61d0f9a700 1 --2- 172.21.15.151:0/2653883947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 0x7f61cc105a20 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:45.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.748+0000 7f61d0f9a700 1 -- 172.21.15.151:0/2653883947 >> 172.21.15.151:0/2653883947 conn(0x7f61cc0fb150 msgr2=0x7f61cc0fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:45.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.748+0000 7f61d0f9a700 1 -- 172.21.15.151:0/2653883947 shutdown_connections 2023-07-21T22:10:45.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.748+0000 7f61d0f9a700 1 -- 172.21.15.151:0/2653883947 wait complete. 2023-07-21T22:10:45.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.749+0000 7f61d0f9a700 1 Processor -- start 2023-07-21T22:10:45.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.749+0000 7f61d0f9a700 1 -- start start 2023-07-21T22:10:45.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.749+0000 7f61d0f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 0x7f61cc19a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:45.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.749+0000 7f61d0f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61cc19adb0 0x7f61cc1948f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:45.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.749+0000 7f61d0f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61cc194e30 0x7f61cc1952d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:45.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.749+0000 7f61d0f9a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc19b3c0 con 0x7f61cc105650 2023-07-21T22:10:45.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.749+0000 7f61d0f9a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1a1690 con 0x7f61cc194e30 2023-07-21T22:10:45.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.749+0000 7f61d0f9a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61cc1a17d0 con 0x7f61cc19adb0 2023-07-21T22:10:45.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61ca59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 0x7f61cc19a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:45.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61ca59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 0x7f61cc19a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40410/0 (socket says 172.21.15.151:40410) 2023-07-21T22:10:45.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61ca59c700 1 -- 172.21.15.151:0/708564045 learned_addr learned my addr 172.21.15.151:0/708564045 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:10:45.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61c9d9b700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61cc19adb0 0x7f61cc1948f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:45.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61cad9d700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61cc194e30 0x7f61cc1952d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:45.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61ca59c700 1 -- 172.21.15.151:0/708564045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61cc19adb0 msgr2=0x7f61cc1948f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:45.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61ca59c700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61cc19adb0 0x7f61cc1948f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:45.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61ca59c700 1 -- 172.21.15.151:0/708564045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61cc194e30 msgr2=0x7f61cc1952d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:45.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61ca59c700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61cc194e30 0x7f61cc1952d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:45.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61ca59c700 1 -- 172.21.15.151:0/708564045 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61bc0095f0 con 0x7f61cc105650 2023-07-21T22:10:45.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.750+0000 7f61ca59c700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 0x7f61cc19a870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00bcf0 tx=0x7f61bc00bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:45.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.751+0000 7f61bb7fe700 1 -- 172.21.15.151:0/708564045 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc01d070 con 0x7f61cc105650 2023-07-21T22:10:45.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.751+0000 7f61bb7fe700 1 -- 172.21.15.151:0/708564045 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f61bc004db0 con 0x7f61cc105650 2023-07-21T22:10:45.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.751+0000 7f61bb7fe700 1 -- 172.21.15.151:0/708564045 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61bc022bd0 con 0x7f61cc105650 2023-07-21T22:10:45.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.751+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61cc1a1ab0 con 0x7f61cc105650 2023-07-21T22:10:45.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.751+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61cc1a1fe0 con 0x7f61cc105650 2023-07-21T22:10:45.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.752+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61cc061b40 con 0x7f61cc105650 2023-07-21T22:10:45.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.752+0000 7f61bb7fe700 1 -- 172.21.15.151:0/708564045 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7f61bc004920 con 0x7f61cc105650 2023-07-21T22:10:45.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.753+0000 7f61bb7fe700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61b4038c80 0x7f61b403b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:45.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.753+0000 7f61bb7fe700 1 -- 172.21.15.151:0/708564045 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7f61bc04ca90 con 0x7f61cc105650 2023-07-21T22:10:45.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.753+0000 7f61c9d9b700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61b4038c80 0x7f61b403b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:45.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.754+0000 7f61c9d9b700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61b4038c80 0x7f61b403b130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009ad0 tx=0x7f61c0009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:45.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.758+0000 7f61bb7fe700 1 -- 172.21.15.151:0/708564045 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f61bc004f20 con 0x7f61cc105650 2023-07-21T22:10:46.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.984+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f61cc195e00 con 0x7f61cc105650 2023-07-21T22:10:46.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.985+0000 7f61bb7fe700 1 -- 172.21.15.151:0/708564045 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) v1 ==== 76+0+277 (secure 0 0 0) 0x7f61bc027070 con 0x7f61cc105650 2023-07-21T22:10:46.026 INFO:teuthology.orchestra.run.smithi151.stdout:# minimal ceph.conf for f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:10:46.026 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-07-21T22:10:46.026 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:10:46.026 INFO:teuthology.orchestra.run.smithi151.stdout: mon_host = [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] 2023-07-21T22:10:46.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61b4038c80 msgr2=0x7f61b403b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:46.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61b4038c80 0x7f61b403b130 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009ad0 tx=0x7f61c0009210 comp rx=0 tx=0).stop 2023-07-21T22:10:46.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 msgr2=0x7f61cc19a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:46.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 0x7f61cc19a870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f61bc00bcf0 tx=0x7f61bc00bd20 comp rx=0 tx=0).stop 2023-07-21T22:10:46.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 shutdown_connections 2023-07-21T22:10:46.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61b4038c80 0x7f61b403b130 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:46.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61cc194e30 0x7f61cc1952d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:46.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61cc105650 0x7f61cc19a870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:46.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 --2- 172.21.15.151:0/708564045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61cc19adb0 0x7f61cc1948f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:46.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 >> 172.21.15.151:0/708564045 conn(0x7f61cc0fb150 msgr2=0x7f61cc0fc7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:46.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 shutdown_connections 2023-07-21T22:10:46.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:45.987+0000 7f61d0f9a700 1 -- 172.21.15.151:0/708564045 wait complete. 2023-07-21T22:10:46.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:45 smithi187 ceph-mon[96918]: Updating smithi151:/etc/ceph/ceph.conf 2023-07-21T22:10:46.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:45 smithi187 ceph-mon[96918]: Updating smithi187:/etc/ceph/ceph.conf 2023-07-21T22:10:46.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:45 smithi187 ceph-mon[96918]: Updating smithi195:/etc/ceph/ceph.conf 2023-07-21T22:10:46.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:45 smithi187 ceph-mon[96918]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:46.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:45 smithi187 ceph-mon[96918]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:46.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:45 smithi187 ceph-mon[96918]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:46.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:45 smithi187 ceph-mon[96918]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:46.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:46.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:45 smithi151 ceph-mon[95510]: Updating smithi151:/etc/ceph/ceph.conf 2023-07-21T22:10:46.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:45 smithi151 ceph-mon[95510]: Updating smithi187:/etc/ceph/ceph.conf 2023-07-21T22:10:46.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:45 smithi151 ceph-mon[95510]: Updating smithi195:/etc/ceph/ceph.conf 2023-07-21T22:10:46.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:45 smithi151 ceph-mon[95510]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:46.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:45 smithi151 ceph-mon[95510]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:46.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:45 smithi151 ceph-mon[95510]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:46.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:45 smithi151 ceph-mon[95510]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:46.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:46.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:45 smithi195 ceph-mon[97365]: Updating smithi151:/etc/ceph/ceph.conf 2023-07-21T22:10:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:45 smithi195 ceph-mon[97365]: Updating smithi187:/etc/ceph/ceph.conf 2023-07-21T22:10:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:45 smithi195 ceph-mon[97365]: Updating smithi195:/etc/ceph/ceph.conf 2023-07-21T22:10:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:45 smithi195 ceph-mon[97365]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:45 smithi195 ceph-mon[97365]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:45 smithi195 ceph-mon[97365]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:45 smithi195 ceph-mon[97365]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:10:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:10:46.615 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2023-07-21T22:10:46.615 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:10:46.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.conf 2023-07-21T22:10:46.687 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:10:46.687 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:46.803 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:10:46.804 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.conf 2023-07-21T22:10:46.879 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:10:46.879 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:46.989 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:10:46.990 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.conf 2023-07-21T22:10:47.066 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:10:47.067 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:10:47.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/708564045' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:47.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: Reconfiguring mon.a (unknown last config time)... 2023-07-21T22:10:47.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:47.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-21T22:10:47.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:47.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:46 smithi187 ceph-mon[96918]: Reconfiguring daemon mon.a on smithi151 2023-07-21T22:10:47.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/708564045' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:47.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: Reconfiguring mon.a (unknown last config time)... 2023-07-21T22:10:47.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:47.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-21T22:10:47.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:47.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:46 smithi195 ceph-mon[97365]: Reconfiguring daemon mon.a on smithi151 2023-07-21T22:10:47.176 INFO:tasks.cephadm:Adding mgr.x on smithi151 2023-07-21T22:10:47.176 INFO:tasks.cephadm:Adding mgr.y on smithi187 2023-07-21T22:10:47.177 INFO:tasks.cephadm:Adding mgr.z on smithi195 2023-07-21T22:10:47.178 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch apply mgr '3;smithi151=x;smithi187=y;smithi195=z' 2023-07-21T22:10:47.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:47.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/708564045' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:47.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: Reconfiguring mon.a (unknown last config time)... 2023-07-21T22:10:47.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:47.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-21T22:10:47.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:47.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:46 smithi151 ceph-mon[95510]: Reconfiguring daemon mon.a on smithi151 2023-07-21T22:10:47.925 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:10:48.353 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:48 smithi195 ceph-mon[97365]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:48.354 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:48.354 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:48.354 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:48.354 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-21T22:10:48.354 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:48.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:48 smithi187 ceph-mon[96918]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:48.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:48.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:48.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:48.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-21T22:10:48.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:48.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:48 smithi151 ceph-mon[95510]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:48.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-21T22:10:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:49.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:49 smithi195 ceph-mon[97365]: Reconfiguring mon.b (monmap changed)... 2023-07-21T22:10:49.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:49 smithi195 ceph-mon[97365]: Reconfiguring daemon mon.b on smithi187 2023-07-21T22:10:49.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:49 smithi187 ceph-mon[96918]: Reconfiguring mon.b (monmap changed)... 2023-07-21T22:10:49.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:49 smithi187 ceph-mon[96918]: Reconfiguring daemon mon.b on smithi187 2023-07-21T22:10:49.427 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.385+0000 7fb3809a0700 1 -- 172.21.15.195:0/2650273032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb37c0ff700 msgr2=0x7fb37c0ffb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.427 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.385+0000 7fb3809a0700 1 --2- 172.21.15.195:0/2650273032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb37c0ff700 0x7fb37c0ffb10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb36c009910 tx=0x7fb36c009c20 comp rx=0 tx=0).stop 2023-07-21T22:10:49.427 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.385+0000 7fb3809a0700 1 -- 172.21.15.195:0/2650273032 shutdown_connections 2023-07-21T22:10:49.427 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.385+0000 7fb3809a0700 1 --2- 172.21.15.195:0/2650273032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb37c0ff700 0x7fb37c0ffb10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.428 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.385+0000 7fb3809a0700 1 -- 172.21.15.195:0/2650273032 >> 172.21.15.195:0/2650273032 conn(0x7fb37c0facd0 msgr2=0x7fb37c0fd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:49.428 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.385+0000 7fb3809a0700 1 -- 172.21.15.195:0/2650273032 shutdown_connections 2023-07-21T22:10:49.428 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.385+0000 7fb3809a0700 1 -- 172.21.15.195:0/2650273032 wait complete. 2023-07-21T22:10:49.428 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.387+0000 7fb3809a0700 1 Processor -- start 2023-07-21T22:10:49.428 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.387+0000 7fb3809a0700 1 -- start start 2023-07-21T22:10:49.429 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.387+0000 7fb3809a0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0ff700 0x7fb37c196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.430 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.387+0000 7fb3809a0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb37c1970e0 0x7fb37c19c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.430 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.387+0000 7fb3809a0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb37c197550 0x7fb37c19e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.430 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.387+0000 7fb3809a0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c19ee60 con 0x7fb37c1970e0 2023-07-21T22:10:49.430 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb3809a0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c19efd0 con 0x7fb37c0ff700 2023-07-21T22:10:49.430 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb3809a0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb37c19f190 con 0x7fb37c197550 2023-07-21T22:10:49.430 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb37a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0ff700 0x7fb37c196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.430 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb37a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0ff700 0x7fb37c196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.195:59830/0 (socket says 172.21.15.195:59830) 2023-07-21T22:10:49.430 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb37a59c700 1 -- 172.21.15.195:0/394270158 learned_addr learned my addr 172.21.15.195:0/394270158 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:10:49.431 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb379d9b700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb37c1970e0 0x7fb37c19c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.431 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb37a59c700 1 -- 172.21.15.195:0/394270158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb37c197550 msgr2=0x7fb37c19e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.431 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb37a59c700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb37c197550 0x7fb37c19e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.432 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb37a59c700 1 -- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb37c1970e0 msgr2=0x7fb37c19c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.432 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb37a59c700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb37c1970e0 0x7fb37c19c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.432 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb37a59c700 1 -- 172.21.15.195:0/394270158 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb36c0095f0 con 0x7fb37c0ff700 2023-07-21T22:10:49.432 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.388+0000 7fb379d9b700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb37c1970e0 0x7fb37c19c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:10:49.432 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.389+0000 7fb37a59c700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0ff700 0x7fb37c196ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb36c006010 tx=0x7fb36c00bda0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:49.432 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.389+0000 7fb36b7fe700 1 -- 172.21.15.195:0/394270158 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c01d070 con 0x7fb37c0ff700 2023-07-21T22:10:49.432 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.389+0000 7fb36b7fe700 1 -- 172.21.15.195:0/394270158 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb36c004db0 con 0x7fb37c0ff700 2023-07-21T22:10:49.433 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.389+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb37c19f410 con 0x7fb37c0ff700 2023-07-21T22:10:49.433 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.389+0000 7fb36b7fe700 1 -- 172.21.15.195:0/394270158 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36c022d60 con 0x7fb37c0ff700 2023-07-21T22:10:49.433 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.389+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb37c19f980 con 0x7fb37c0ff700 2023-07-21T22:10:49.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.390+0000 7fb36b7fe700 1 -- 172.21.15.195:0/394270158 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7fb36c022500 con 0x7fb37c0ff700 2023-07-21T22:10:49.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.391+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb37c190580 con 0x7fb37c0ff700 2023-07-21T22:10:49.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.391+0000 7fb36b7fe700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb364038c80 0x7fb36403b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:49.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.391+0000 7fb36b7fe700 1 -- 172.21.15.195:0/394270158 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7fb36c04c910 con 0x7fb37c0ff700 2023-07-21T22:10:49.434 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.391+0000 7fb379d9b700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb364038c80 0x7fb36403b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:49.435 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.392+0000 7fb379d9b700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb364038c80 0x7fb36403b130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb370009910 tx=0x7fb370008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:49.438 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.397+0000 7fb36b7fe700 1 -- 172.21.15.195:0/394270158 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fb36c00edb0 con 0x7fb37c0ff700 2023-07-21T22:10:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:49 smithi151 ceph-mon[95510]: Reconfiguring mon.b (monmap changed)... 2023-07-21T22:10:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:49 smithi151 ceph-mon[95510]: Reconfiguring daemon mon.b on smithi187 2023-07-21T22:10:49.668 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.626+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi151=x;smithi187=y;smithi195=z", "target": ["mon-mgr", ""]}) v1 -- 0x7fb37c0609e0 con 0x7fb364038c80 2023-07-21T22:10:49.676 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.634+0000 7fb36b7fe700 1 -- 172.21.15.195:0/394270158 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb37c0609e0 con 0x7fb364038c80 2023-07-21T22:10:49.676 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mgr update... 2023-07-21T22:10:49.678 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.636+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb364038c80 msgr2=0x7fb36403b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.678 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.636+0000 7fb3809a0700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb364038c80 0x7fb36403b130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb370009910 tx=0x7fb370008040 comp rx=0 tx=0).stop 2023-07-21T22:10:49.679 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0ff700 msgr2=0x7fb37c196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:49.679 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0ff700 0x7fb37c196ba0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fb36c006010 tx=0x7fb36c00bda0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.679 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 shutdown_connections 2023-07-21T22:10:49.679 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb364038c80 0x7fb36403b130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.679 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb37c0ff700 0x7fb37c196ba0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.680 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb37c197550 0x7fb37c19e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.680 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 --2- 172.21.15.195:0/394270158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb37c1970e0 0x7fb37c19c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:49.680 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 >> 172.21.15.195:0/394270158 conn(0x7fb37c0facd0 msgr2=0x7fb37c0fd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:49.680 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 shutdown_connections 2023-07-21T22:10:49.680 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:10:49.637+0000 7fb3809a0700 1 -- 172.21.15.195:0/394270158 wait complete. 2023-07-21T22:10:50.095 DEBUG:teuthology.orchestra.run.smithi187:mgr.y> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.y.service 2023-07-21T22:10:50.100 DEBUG:teuthology.orchestra.run.smithi195:mgr.z> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.z.service 2023-07-21T22:10:50.105 INFO:tasks.cephadm:Deploying OSDs... 2023-07-21T22:10:50.106 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:10:50.106 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T22:10:50.157 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T22:10:50.157 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-07-21T22:10:50.177 INFO:journalctl@ceph.mgr.y.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:10:50.179 INFO:journalctl@ceph.mgr.z.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:10:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T22:10:50.204 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:50.204 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 449 Links: 1 2023-07-21T22:10:50.205 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:50.205 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:50.205 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-07-21 22:09:53.939780171 +0000 2023-07-21T22:10:50.205 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-07-21 22:02:45.730546067 +0000 2023-07-21T22:10:50.205 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-07-21 22:02:45.730546067 +0000 2023-07-21T22:10:50.205 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-07-21 22:02:45.700546423 +0000 2023-07-21T22:10:50.206 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T22:10:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-07-21T22:10:50.315 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-07-21T22:10:50.316 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000300779 s, 1.7 MB/s 2023-07-21T22:10:50.318 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T22:10:50.329 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:50 smithi195 ceph-mon[97365]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:50.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:50.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:50.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:50 smithi195 ceph-mon[97365]: Reconfiguring mon.c (monmap changed)... 2023-07-21T22:10:50.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:50.330 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-21T22:10:50.331 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:50.331 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:50 smithi195 ceph-mon[97365]: Reconfiguring daemon mon.c on smithi195 2023-07-21T22:10:50.331 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:50.364 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-07-21T22:10:50.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:50 smithi151 ceph-mon[95510]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:50 smithi151 ceph-mon[95510]: Reconfiguring mon.c (monmap changed)... 2023-07-21T22:10:50.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:50.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-21T22:10:50.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:50.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:50 smithi151 ceph-mon[95510]: Reconfiguring daemon mon.c on smithi195 2023-07-21T22:10:50.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:50.451 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T22:10:50.451 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:50.451 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 455 Links: 1 2023-07-21T22:10:50.451 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:50.452 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:50.452 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-07-21 22:09:53.939780171 +0000 2023-07-21T22:10:50.452 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-07-21 22:02:46.550536342 +0000 2023-07-21T22:10:50.452 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-07-21 22:02:46.550536342 +0000 2023-07-21T22:10:50.453 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-07-21 22:02:46.519536710 +0000 2023-07-21T22:10:50.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T22:10:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-07-21T22:10:50.557 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-07-21T22:10:50.558 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000318853 s, 1.6 MB/s 2023-07-21T22:10:50.560 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T22:10:50.607 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-07-21T22:10:50.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:50 smithi187 ceph-mon[96918]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:50.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:50 smithi187 ceph-mon[96918]: Reconfiguring mon.c (monmap changed)... 2023-07-21T22:10:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2023-07-21T22:10:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2023-07-21T22:10:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:50 smithi187 ceph-mon[96918]: Reconfiguring daemon mon.c on smithi195 2023-07-21T22:10:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:50.692 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T22:10:50.693 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:50.693 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 461 Links: 1 2023-07-21T22:10:50.693 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:50.693 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:50.694 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-07-21 22:09:53.939780171 +0000 2023-07-21T22:10:50.694 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-07-21 22:02:47.388526404 +0000 2023-07-21T22:10:50.694 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-07-21 22:02:47.388526404 +0000 2023-07-21T22:10:50.694 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-07-21 22:02:47.361526724 +0000 2023-07-21T22:10:50.695 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T22:10:50.799 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-07-21T22:10:50.799 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-07-21T22:10:50.799 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000282284 s, 1.8 MB/s 2023-07-21T22:10:50.801 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T22:10:50.852 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-07-21T22:10:50.898 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T22:10:50.898 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:50.899 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 467 Links: 1 2023-07-21T22:10:50.899 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:50.899 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:50.899 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-07-21 22:09:53.939780171 +0000 2023-07-21T22:10:50.899 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-07-21 22:02:48.215516596 +0000 2023-07-21T22:10:50.900 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-07-21 22:02:48.215516596 +0000 2023-07-21T22:10:50.900 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-07-21 22:02:48.188516916 +0000 2023-07-21T22:10:50.900 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T22:10:51.010 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-07-21T22:10:51.011 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-07-21T22:10:51.011 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000300512 s, 1.7 MB/s 2023-07-21T22:10:51.014 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T22:10:51.065 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-07-21T22:10:51.066 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T22:10:51.115 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T22:10:51.116 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2023-07-21T22:10:51.204 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T22:10:51.205 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:51.205 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-07-21T22:10:51.205 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:51.205 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:51.205 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-07-21 22:10:36.768910775 +0000 2023-07-21T22:10:51.205 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-07-21 22:02:49.817228662 +0000 2023-07-21T22:10:51.205 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-07-21 22:02:49.817228662 +0000 2023-07-21T22:10:51.206 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-07-21 22:02:49.787229110 +0000 2023-07-21T22:10:51.206 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T22:10:51.274 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-07-21T22:10:51.275 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-07-21T22:10:51.275 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000300663 s, 1.7 MB/s 2023-07-21T22:10:51.276 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T22:10:51.322 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2023-07-21T22:10:51.405 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T22:10:51.406 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:51.406 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-07-21T22:10:51.406 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:51.406 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:51.406 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-07-21 22:10:36.768910775 +0000 2023-07-21T22:10:51.407 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-07-21 22:02:50.680215786 +0000 2023-07-21T22:10:51.407 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-07-21 22:02:50.680215786 +0000 2023-07-21T22:10:51.407 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-07-21 22:02:50.650216233 +0000 2023-07-21T22:10:51.407 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T22:10:51.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:51 smithi151 ceph-mon[95510]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi151=x;smithi187=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:51.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:51 smithi151 ceph-mon[95510]: Saving service mgr spec with placement smithi151=x;smithi187=y;smithi195=z;count:3 2023-07-21T22:10:51.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:51.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:51.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:51.506 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:51 smithi187 ceph-mon[96918]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi151=x;smithi187=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:51.506 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:51 smithi187 ceph-mon[96918]: Saving service mgr spec with placement smithi151=x;smithi187=y;smithi195=z;count:3 2023-07-21T22:10:51.506 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:51.506 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:51.507 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:51.512 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-07-21T22:10:51.512 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-07-21T22:10:51.513 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000396586 s, 1.3 MB/s 2023-07-21T22:10:51.515 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T22:10:51.560 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2023-07-21T22:10:51.644 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T22:10:51.645 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:51.645 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-07-21T22:10:51.645 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:51.646 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:51.646 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-07-21 22:10:36.768910775 +0000 2023-07-21T22:10:51.646 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-07-21 22:02:51.485203775 +0000 2023-07-21T22:10:51.647 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-07-21 22:02:51.485203775 +0000 2023-07-21T22:10:51.647 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-07-21 22:02:51.459204163 +0000 2023-07-21T22:10:51.647 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T22:10:51.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:51 smithi195 ceph-mon[97365]: from='client.24104 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi151=x;smithi187=y;smithi195=z", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:10:51.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:51 smithi195 ceph-mon[97365]: Saving service mgr spec with placement smithi151=x;smithi187=y;smithi195=z;count:3 2023-07-21T22:10:51.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:51.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:51.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:51.750 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-07-21T22:10:51.750 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-07-21T22:10:51.750 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.00047842 s, 1.1 MB/s 2023-07-21T22:10:51.752 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T22:10:51.797 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2023-07-21T22:10:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T22:10:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:51.882 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 468 Links: 1 2023-07-21T22:10:51.882 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:51.882 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:51.882 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-07-21 22:10:36.768910775 +0000 2023-07-21T22:10:51.882 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-07-21 22:02:52.302191585 +0000 2023-07-21T22:10:51.882 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-07-21 22:02:52.302191585 +0000 2023-07-21T22:10:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-07-21 22:02:52.276191973 +0000 2023-07-21T22:10:51.883 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T22:10:51.986 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-07-21T22:10:51.987 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-07-21T22:10:51.987 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000318668 s, 1.6 MB/s 2023-07-21T22:10:51.989 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T22:10:52.035 DEBUG:teuthology.orchestra.run.smithi195:> set -ex 2023-07-21T22:10:52.035 DEBUG:teuthology.orchestra.run.smithi195:> dd if=/scratch_devs of=/dev/stdout 2023-07-21T22:10:52.082 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-07-21T22:10:52.083 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_1 2023-07-21T22:10:52.170 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-07-21T22:10:52.170 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:52.171 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 450 Links: 1 2023-07-21T22:10:52.171 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:52.171 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:52.171 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-07-21 22:10:27.079795649 +0000 2023-07-21T22:10:52.171 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-07-21 22:02:46.994297365 +0000 2023-07-21T22:10:52.171 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-07-21 22:02:46.994297365 +0000 2023-07-21T22:10:52.171 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-07-21 22:02:46.969297850 +0000 2023-07-21T22:10:52.172 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-07-21T22:10:52.247 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-07-21T22:10:52.248 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-07-21T22:10:52.248 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000203613 s, 2.5 MB/s 2023-07-21T22:10:52.251 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-07-21T22:10:52.300 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_2 2023-07-21T22:10:52.344 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-07-21T22:10:52.344 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:52.345 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 456 Links: 1 2023-07-21T22:10:52.345 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:52.345 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:52.345 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-07-21 22:10:27.079795649 +0000 2023-07-21T22:10:52.345 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-07-21 22:02:47.850280756 +0000 2023-07-21T22:10:52.345 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-07-21 22:02:47.850280756 +0000 2023-07-21T22:10:52.345 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-07-21 22:02:47.826281222 +0000 2023-07-21T22:10:52.346 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-07-21T22:10:52.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:52 smithi187 ceph-mon[96918]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:52.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:52.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:52.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:52.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-21T22:10:52.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-21T22:10:52.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-21T22:10:52.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:52.445 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:52 smithi195 ceph-mon[97365]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:52.445 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:52.445 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:52.446 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:52.446 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-21T22:10:52.446 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-21T22:10:52.446 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-21T22:10:52.446 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:52 smithi151 ceph-mon[95510]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:10:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-21T22:10:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-21T22:10:52.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-21T22:10:52.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:52.451 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-07-21T22:10:52.451 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-07-21T22:10:52.452 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000202534 s, 2.5 MB/s 2023-07-21T22:10:52.455 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-07-21T22:10:52.502 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_3 2023-07-21T22:10:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-07-21T22:10:52.588 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:52.588 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 462 Links: 1 2023-07-21T22:10:52.588 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:52.589 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:52.589 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-07-21 22:10:27.079795649 +0000 2023-07-21T22:10:52.589 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-07-21 22:02:48.677264710 +0000 2023-07-21T22:10:52.589 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-07-21 22:02:48.677264710 +0000 2023-07-21T22:10:52.589 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-07-21 22:02:48.655265137 +0000 2023-07-21T22:10:52.589 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-07-21T22:10:52.698 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-07-21T22:10:52.699 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-07-21T22:10:52.699 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000170627 s, 3.0 MB/s 2023-07-21T22:10:52.701 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-07-21T22:10:52.751 DEBUG:teuthology.orchestra.run.smithi195:> stat /dev/vg_nvme/lv_4 2023-07-21T22:10:52.795 INFO:teuthology.orchestra.run.smithi195.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-07-21T22:10:52.795 INFO:teuthology.orchestra.run.smithi195.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-07-21T22:10:52.795 INFO:teuthology.orchestra.run.smithi195.stdout:Device: 5h/5d Inode: 468 Links: 1 2023-07-21T22:10:52.796 INFO:teuthology.orchestra.run.smithi195.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-07-21T22:10:52.796 INFO:teuthology.orchestra.run.smithi195.stdout:Context: system_u:object_r:device_t:s0 2023-07-21T22:10:52.796 INFO:teuthology.orchestra.run.smithi195.stdout:Access: 2023-07-21 22:10:27.079795649 +0000 2023-07-21T22:10:52.797 INFO:teuthology.orchestra.run.smithi195.stdout:Modify: 2023-07-21 22:02:49.500248741 +0000 2023-07-21T22:10:52.797 INFO:teuthology.orchestra.run.smithi195.stdout:Change: 2023-07-21 22:02:49.500248741 +0000 2023-07-21T22:10:52.797 INFO:teuthology.orchestra.run.smithi195.stdout: Birth: 2023-07-21 22:02:49.478249168 +0000 2023-07-21T22:10:52.798 DEBUG:teuthology.orchestra.run.smithi195:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-07-21T22:10:52.900 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records in 2023-07-21T22:10:52.901 INFO:teuthology.orchestra.run.smithi195.stderr:1+0 records out 2023-07-21T22:10:52.901 INFO:teuthology.orchestra.run.smithi195.stderr:512 bytes copied, 0.000187652 s, 2.7 MB/s 2023-07-21T22:10:52.903 DEBUG:teuthology.orchestra.run.smithi195:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-07-21T22:10:52.947 INFO:tasks.cephadm:Deploying osd.0 on smithi151 with /dev/vg_nvme/lv_4... 2023-07-21T22:10:52.948 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-21T22:10:53.391 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:53 smithi195 ceph-mon[97365]: Deploying daemon mgr.z on smithi195 2023-07-21T22:10:53.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:53 smithi151 ceph-mon[95510]: Deploying daemon mgr.z on smithi195 2023-07-21T22:10:53.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:53 smithi187 ceph-mon[96918]: Deploying daemon mgr.z on smithi195 2023-07-21T22:10:53.654 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:53 smithi195 systemd[1]: Starting Ceph mgr.z for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:10:53.670 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:10:54.196 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:54 smithi151 ceph-mon[95510]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:54.344 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:54 smithi195 ceph-mon[97365]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:54.345 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:54 smithi195 podman[99704]: 2023-07-21T22:10:54.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:54 smithi187 ceph-mon[96918]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:54.639 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:54 smithi195 bash[99704]: 316b23d80b5aaac57d76d982b79a09346210527073b55ae07de55920dc2ba171 2023-07-21T22:10:54.639 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:54 smithi195 ceph-mgr[99744]: -- 172.21.15.195:0/373482357 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555b0dd8d1e0 con 0x555b0dd63000 2023-07-21T22:10:54.640 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:54 smithi195 systemd[1]: Started Ceph mgr.z for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:10:54.640 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:54.495+0000 7f025fefb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:10:54.904 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:54.597+0000 7f025fefb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:10:54.904 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:54.710+0000 7f025fefb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:10:54.904 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:54.827+0000 7f025fefb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:10:55.404 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:55.043+0000 7f025fefb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:10:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-21T22:10:55.651 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-21T22:10:55.651 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2023-07-21T22:10:55.651 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2023-07-21T22:10:55.651 INFO:teuthology.orchestra.run.smithi151.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.042947 s, 244 MB/s 2023-07-21T22:10:55.651 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 2023-07-21T22:10:55.652 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2023-07-21T22:10:55.667 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:55.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:55.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:55.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-21T22:10:55.668 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-21T22:10:55.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-21T22:10:55.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:55.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:55 smithi187 ceph-mon[96918]: Deploying daemon mgr.y on smithi187 2023-07-21T22:10:55.669 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:55 smithi187 ceph-mon[96918]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:55.746 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:55.430+0000 7f025fefb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:10:55.746 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:55.545+0000 7f025fefb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:10:55.747 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:55.747 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:55.747 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:55.747 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-21T22:10:55.747 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-21T22:10:55.748 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-21T22:10:55.748 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:55.748 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-mon[97365]: Deploying daemon mgr.y on smithi187 2023-07-21T22:10:55.749 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-mon[97365]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:55.815 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:55.815 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:55.816 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:55.816 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-21T22:10:55.816 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2023-07-21T22:10:55.816 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-21T22:10:55.816 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:55.817 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:55 smithi151 ceph-mon[95510]: Deploying daemon mgr.y on smithi187 2023-07-21T22:10:55.817 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:55 smithi151 ceph-mon[95510]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:56.153 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi151:vg_nvme/lv_4 2023-07-21T22:10:56.154 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:55.704+0000 7f025fefb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:10:56.154 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:55.826+0000 7f025fefb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:10:56.625 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:56 smithi187 systemd[1]: Starting Ceph mgr.y for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:10:56.653 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:56.360+0000 7f025fefb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:10:56.879 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:10:57.328 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:57 smithi187 podman[98360]: 2023-07-21T22:10:57.329 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:57 smithi187 bash[98360]: 789378da972fc79bbb0288e76afdd6d3f9a3105aca8948f6efeeb3bd560ebedf 2023-07-21T22:10:57.604 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:57 smithi187 ceph-mgr[98408]: -- 172.21.15.187:0/595190192 <== mon.2 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f48551d1e0 con 0x55f4854f2800 2023-07-21T22:10:57.605 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:57 smithi187 systemd[1]: Started Ceph mgr.y for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:10:57.605 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:57.459+0000 7fe268896200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:10:57.653 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:57 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:57.123+0000 7f025fefb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T22:10:57.654 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:57 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:57.331+0000 7f025fefb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:10:57.875 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:57.562+0000 7fe268896200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:10:57.875 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:57.681+0000 7fe268896200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:10:57.876 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:57.798+0000 7fe268896200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:10:58.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.253+0000 7ff2b052c700 1 -- 172.21.15.151:0/1804909777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2a8100d90 msgr2=0x7ff2a81011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:58.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.253+0000 7ff2b052c700 1 --2- 172.21.15.151:0/1804909777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2a8100d90 0x7ff2a81011e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff298009990 tx=0x7ff298009ca0 comp rx=0 tx=0).stop 2023-07-21T22:10:58.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.253+0000 7ff2b052c700 1 -- 172.21.15.151:0/1804909777 shutdown_connections 2023-07-21T22:10:58.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.253+0000 7ff2b052c700 1 --2- 172.21.15.151:0/1804909777 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2a80ffb90 0x7ff2a80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:58.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.253+0000 7ff2b052c700 1 --2- 172.21.15.151:0/1804909777 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2a8101720 0x7ff2a8107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:58.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.253+0000 7ff2b052c700 1 --2- 172.21.15.151:0/1804909777 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2a8100d90 0x7ff2a81011e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:58.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.253+0000 7ff2b052c700 1 -- 172.21.15.151:0/1804909777 >> 172.21.15.151:0/1804909777 conn(0x7ff2a80fb1a0 msgr2=0x7ff2a80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:10:58.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.253+0000 7ff2b052c700 1 -- 172.21.15.151:0/1804909777 shutdown_connections 2023-07-21T22:10:58.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.253+0000 7ff2b052c700 1 -- 172.21.15.151:0/1804909777 wait complete. 2023-07-21T22:10:58.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.254+0000 7ff2b052c700 1 Processor -- start 2023-07-21T22:10:58.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.254+0000 7ff2b052c700 1 -- start start 2023-07-21T22:10:58.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2b052c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2a80ffb90 0x7ff2a8195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:58.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2b052c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2a8100d90 0x7ff2a8195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:58.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2b052c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2a8101720 0x7ff2a819cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:58.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2b052c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a819d3a0 con 0x7ff2a8101720 2023-07-21T22:10:58.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2b052c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a819d4e0 con 0x7ff2a8100d90 2023-07-21T22:10:58.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2b052c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a819d670 con 0x7ff2a80ffb90 2023-07-21T22:10:58.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2ae2c8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2a80ffb90 0x7ff2a8195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:58.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2adac7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2a8100d90 0x7ff2a8195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:58.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2ae2c8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2a80ffb90 0x7ff2a8195810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42808/0 (socket says 172.21.15.151:42808) 2023-07-21T22:10:58.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2ae2c8700 1 -- 172.21.15.151:0/2205460019 learned_addr learned my addr 172.21.15.151:0/2205460019 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:10:58.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.255+0000 7ff2aeac9700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2a8101720 0x7ff2a819cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:58.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2adac7700 1 -- 172.21.15.151:0/2205460019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2a80ffb90 msgr2=0x7ff2a8195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:58.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2adac7700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2a80ffb90 0x7ff2a8195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:58.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2adac7700 1 -- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2a8101720 msgr2=0x7ff2a819cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:10:58.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2adac7700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2a8101720 0x7ff2a819cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:10:58.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2adac7700 1 -- 172.21.15.151:0/2205460019 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2980095f0 con 0x7ff2a8100d90 2023-07-21T22:10:58.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2aeac9700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2a8101720 0x7ff2a819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:58.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2ae2c8700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2a80ffb90 0x7ff2a8195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:10:58.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2adac7700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2a8100d90 0x7ff2a8195d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2980098e0 tx=0x7ff298005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:58.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff29f7fe700 1 -- 172.21.15.151:0/2205460019 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff29801d070 con 0x7ff2a8100d90 2023-07-21T22:10:58.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff29f7fe700 1 -- 172.21.15.151:0/2205460019 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff298003f80 con 0x7ff2a8100d90 2023-07-21T22:10:58.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a819d8f0 con 0x7ff2a8100d90 2023-07-21T22:10:58.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff29f7fe700 1 -- 172.21.15.151:0/2205460019 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2980229b0 con 0x7ff2a8100d90 2023-07-21T22:10:58.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.256+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a819dd00 con 0x7ff2a8100d90 2023-07-21T22:10:58.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.257+0000 7ff29f7fe700 1 -- 172.21.15.151:0/2205460019 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 13) v1 ==== 45540+0+0 (secure 0 0 0) 0x7ff298003af0 con 0x7ff2a8100d90 2023-07-21T22:10:58.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.257+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a8106b80 con 0x7ff2a8100d90 2023-07-21T22:10:58.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.258+0000 7ff29f7fe700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff2940389e0 0x7ff29403ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:10:58.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.258+0000 7ff29f7fe700 1 -- 172.21.15.151:0/2205460019 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1155+0+0 (secure 0 0 0) 0x7ff29804c870 con 0x7ff2a8100d90 2023-07-21T22:10:58.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.258+0000 7ff2ae2c8700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff2940389e0 0x7ff29403ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:10:58.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.259+0000 7ff2ae2c8700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff2940389e0 0x7ff29403ae90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40105c0 tx=0x7ff2a400b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:10:58.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.264+0000 7ff29f7fe700 1 -- 172.21.15.151:0/2205460019 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ff29800ebd0 con 0x7ff2a8100d90 2023-07-21T22:10:58.361 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-mon[97365]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:58.362 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.362 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.362 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.362 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.362 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:58.363 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.376 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:58.036+0000 7fe268896200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:10:58.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-mon[96918]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:58.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:58.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:58 smithi151 ceph-mon[95510]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:10:58.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:10:58.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:10:58.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:10:58.469+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7ff2a8060950 con 0x7ff2940389e0 2023-07-21T22:10:58.654 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:58.319+0000 7f025fefb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:10:58.654 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:58.442+0000 7f025fefb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:10:58.786 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:58.448+0000 7fe268896200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:10:58.787 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:58.569+0000 7fe268896200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:10:58.787 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:58.744+0000 7fe268896200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:10:59.091 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:58.676+0000 7f025fefb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:10:59.092 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:58.868+0000 7fe268896200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:10:59.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:59 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:10:59.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:59 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:10:59.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:10:59 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:59.404 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:59.070+0000 7f025fefb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T22:10:59.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:59 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:10:59.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:59 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:10:59.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:10:59 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:59.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:59 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:10:59.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:59 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:10:59.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:10:59 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:10:59.875 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:10:59 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:10:59.443+0000 7fe268896200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:10:59.903 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:59.366+0000 7f025fefb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:10:59.904 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:59.569+0000 7f025fefb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:11:00.181 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:00 smithi151 ceph-mon[95510]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:11:00.181 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:00 smithi151 ceph-mon[95510]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:00.181 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:00 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.181 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:00 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.181 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:00 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.182 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:00 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.182 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:00 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:00.182 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:00 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:00.182 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:00 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.375 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:00.246+0000 7fe268896200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T22:11:00.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-mon[96918]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:11:00.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-mon[96918]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:00.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.403 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:10:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:10:59.917+0000 7f025fefb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:11:00.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-mon[97365]: from='client.24116 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:11:00.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-mon[97365]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:00.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:00.875 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:00 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:00.454+0000 7fe268896200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:11:01.153 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:11:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:11:00.836+0000 7f025fefb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:11:01.154 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:11:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:11:01.007+0000 7f025fefb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:11:01.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:01 smithi195 ceph-mon[97365]: Reconfiguring mgr.x (unknown last config time)... 2023-07-21T22:11:01.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-21T22:11:01.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-21T22:11:01.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:01.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:01 smithi195 ceph-mon[97365]: Reconfiguring daemon mgr.x on smithi151 2023-07-21T22:11:01.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:01 smithi187 ceph-mon[96918]: Reconfiguring mgr.x (unknown last config time)... 2023-07-21T22:11:01.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-21T22:11:01.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-21T22:11:01.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:01.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:01 smithi187 ceph-mon[96918]: Reconfiguring daemon mgr.x on smithi151 2023-07-21T22:11:01.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:01 smithi151 ceph-mon[95510]: Reconfiguring mgr.x (unknown last config time)... 2023-07-21T22:11:01.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2023-07-21T22:11:01.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2023-07-21T22:11:01.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:01.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:01 smithi151 ceph-mon[95510]: Reconfiguring daemon mgr.x on smithi151 2023-07-21T22:11:01.653 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:11:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:11:01.248+0000 7f025fefb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:11:01.654 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:11:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:11:01.396+0000 7f025fefb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:11:01.774 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:01.398+0000 7fe268896200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:11:01.775 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:01.514+0000 7fe268896200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:11:01.775 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:01.733+0000 7fe268896200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:11:02.103 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:11:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:11:01.666+0000 7f025fefb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:11:02.375 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:02.085+0000 7fe268896200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T22:11:02.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:02 smithi187 ceph-mon[96918]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:02 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/864668141' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e903ed24-3bea-4007-9763-2fa25fdf3098"}]: dispatch 2023-07-21T22:11:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:02 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/864668141' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e903ed24-3bea-4007-9763-2fa25fdf3098"}]': finished 2023-07-21T22:11:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:02 smithi187 ceph-mon[96918]: osdmap e5: 1 total, 0 up, 1 in 2023-07-21T22:11:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:02.403 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:02 smithi195 ceph-mon[97365]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:02 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/864668141' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e903ed24-3bea-4007-9763-2fa25fdf3098"}]: dispatch 2023-07-21T22:11:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:02 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/864668141' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e903ed24-3bea-4007-9763-2fa25fdf3098"}]': finished 2023-07-21T22:11:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:02 smithi195 ceph-mon[97365]: osdmap e5: 1 total, 0 up, 1 in 2023-07-21T22:11:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:02 smithi151 ceph-mon[95510]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:02 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/864668141' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e903ed24-3bea-4007-9763-2fa25fdf3098"}]: dispatch 2023-07-21T22:11:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:02 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/864668141' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e903ed24-3bea-4007-9763-2fa25fdf3098"}]': finished 2023-07-21T22:11:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:02 smithi151 ceph-mon[95510]: osdmap e5: 1 total, 0 up, 1 in 2023-07-21T22:11:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:02.875 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:02.362+0000 7fe268896200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:11:02.876 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:02.550+0000 7fe268896200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:11:03.109 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:11:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:11:02.717+0000 7f025fefb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:11:03.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:03.073+0000 7ff29f7fe700 1 -- 172.21.15.151:0/2205460019 <== mon.2 v2:172.21.15.187:3300/0 7 ==== mgrmap(e 14) v1 ==== 90600+0+0 (secure 0 0 0) 0x7ff29800f980 con 0x7ff2a8100d90 2023-07-21T22:11:03.375 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:02.890+0000 7fe268896200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:11:03.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:03 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1523172884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:11:03.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:03 smithi187 ceph-mon[96918]: Standby manager daemon z started 2023-07-21T22:11:03.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:03 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-21T22:11:03.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:03 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:11:03.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:03 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-21T22:11:03.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:03 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:11:03.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:03 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1523172884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:11:03.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:03 smithi195 ceph-mon[97365]: Standby manager daemon z started 2023-07-21T22:11:03.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:03 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-21T22:11:03.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:03 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:11:03.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:03 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-21T22:11:03.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:03 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:11:03.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:03 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1523172884' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:11:03.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:03 smithi151 ceph-mon[95510]: Standby manager daemon z started 2023-07-21T22:11:03.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:03 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-21T22:11:03.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:03 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:11:03.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:03 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-21T22:11:03.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:03 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.195:0/522561792' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:11:04.110 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:03.808+0000 7fe268896200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:11:04.110 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:03.978+0000 7fe268896200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:11:04.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:04 smithi187 ceph-mon[96918]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:04.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:04 smithi187 ceph-mon[96918]: mgrmap e14: x(active, since 80s), standbys: z 2023-07-21T22:11:04.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-21T22:11:04.376 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:04 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:04.217+0000 7fe268896200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:11:04.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:04 smithi195 ceph-mon[97365]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:04.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:04 smithi195 ceph-mon[97365]: mgrmap e14: x(active, since 80s), standbys: z 2023-07-21T22:11:04.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-21T22:11:04.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:04 smithi151 ceph-mon[95510]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:04.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:04 smithi151 ceph-mon[95510]: mgrmap e14: x(active, since 80s), standbys: z 2023-07-21T22:11:04.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-21T22:11:04.674 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:04 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:04.364+0000 7fe268896200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:11:05.125 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:04 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:04.632+0000 7fe268896200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:11:06.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:06.081+0000 7ff29f7fe700 1 -- 172.21.15.151:0/2205460019 <== mon.2 v2:172.21.15.187:3300/0 8 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7ff29800e3e0 con 0x7ff2a8100d90 2023-07-21T22:11:06.125 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:11:05 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:11:05.692+0000 7fe268896200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:11:06.292 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:06 smithi151 ceph-mon[95510]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:06.293 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:06 smithi151 ceph-mon[95510]: Standby manager daemon y started 2023-07-21T22:11:06.293 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:06 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-21T22:11:06.293 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:06 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:11:06.293 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:06 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-21T22:11:06.293 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:06 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:11:06.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:06 smithi195 ceph-mon[97365]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:06.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:06 smithi195 ceph-mon[97365]: Standby manager daemon y started 2023-07-21T22:11:06.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:06 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-21T22:11:06.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:06 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:11:06.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:06 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-21T22:11:06.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:06 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:11:06.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:06 smithi187 ceph-mon[96918]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:06.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:06 smithi187 ceph-mon[96918]: Standby manager daemon y started 2023-07-21T22:11:06.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:06 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-21T22:11:06.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:06 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:11:06.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:06 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-21T22:11:06.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:06 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.187:0/2132528119' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:11:07.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:07 smithi195 ceph-mon[97365]: mgrmap e15: x(active, since 83s), standbys: z, y 2023-07-21T22:11:07.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:07 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-21T22:11:07.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:07 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:07.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:07 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:07.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:07 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:07.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:07 smithi151 ceph-mon[95510]: mgrmap e15: x(active, since 83s), standbys: z, y 2023-07-21T22:11:07.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:07 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-21T22:11:07.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:07 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:07.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:07 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:07.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:07 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:07.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:07 smithi187 ceph-mon[96918]: mgrmap e15: x(active, since 83s), standbys: z, y 2023-07-21T22:11:07.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:07 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-21T22:11:07.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:07 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:07.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:07 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:07.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:07 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:08.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:08 smithi195 ceph-mon[97365]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:08.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:08.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:08.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:08.436 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:08 smithi151 ceph-mon[95510]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:08.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:08.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:08.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:08.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:08 smithi187 ceph-mon[96918]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:08.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:08.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:08.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:10.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:10 smithi195 ceph-mon[97365]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:10.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:10 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-21T22:11:10.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:10 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:10.409 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:10 smithi151 ceph-mon[95510]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:10.409 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:10 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-21T22:11:10.410 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:10 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:10.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:10 smithi187 ceph-mon[96918]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:10.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:10 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2023-07-21T22:11:10.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:10 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:11.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:11 smithi195 ceph-mon[97365]: Deploying daemon osd.0 on smithi151 2023-07-21T22:11:11.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:11 smithi151 ceph-mon[95510]: Deploying daemon osd.0 on smithi151 2023-07-21T22:11:11.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:11 smithi187 ceph-mon[96918]: Deploying daemon osd.0 on smithi151 2023-07-21T22:11:12.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:12 smithi195 ceph-mon[97365]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:12.419 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:12 smithi151 ceph-mon[95510]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:12.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:12 smithi187 ceph-mon[96918]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:14.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:14 smithi151 ceph-mon[95510]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:14.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:14 smithi187 ceph-mon[96918]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:14.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:14 smithi195 ceph-mon[97365]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:16.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:16 smithi151 ceph-mon[95510]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:16.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:16 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:16.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:16 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:16.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:16 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:16.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:16 smithi187 ceph-mon[96918]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:16.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:16 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:16.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:16 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:16.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:16 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:16.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:16 smithi195 ceph-mon[97365]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:16.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:16 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:16.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:16 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:16.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:16 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:18.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:18 smithi151 ceph-mon[95510]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:18.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:18 smithi187 ceph-mon[96918]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:18.653 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:18 smithi195 ceph-mon[97365]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:19.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.527+0000 7ff29f7fe700 1 -- 172.21.15.151:0/2205460019 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff2a8060950 con 0x7ff2940389e0 2023-07-21T22:11:19.570 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 0 on host 'smithi151' 2023-07-21T22:11:19.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.529+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff2940389e0 msgr2=0x7ff29403ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:19.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.529+0000 7ff2b052c700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff2940389e0 0x7ff29403ae90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff2a40105c0 tx=0x7ff2a400b4a0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.529+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2a8100d90 msgr2=0x7ff2a8195d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:19.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.529+0000 7ff2b052c700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2a8100d90 0x7ff2a8195d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7ff2980098e0 tx=0x7ff298005740 comp rx=0 tx=0).stop 2023-07-21T22:11:19.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.530+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 shutdown_connections 2023-07-21T22:11:19.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.530+0000 7ff2b052c700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff2940389e0 0x7ff29403ae90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.530+0000 7ff2b052c700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2a8101720 0x7ff2a819cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.530+0000 7ff2b052c700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff2a80ffb90 0x7ff2a8195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.530+0000 7ff2b052c700 1 --2- 172.21.15.151:0/2205460019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2a8100d90 0x7ff2a8195d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:19.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.530+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 >> 172.21.15.151:0/2205460019 conn(0x7ff2a80fb1a0 msgr2=0x7ff2a80fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:19.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.530+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 shutdown_connections 2023-07-21T22:11:19.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:11:19.530+0000 7ff2b052c700 1 -- 172.21.15.151:0/2205460019 wait complete. 2023-07-21T22:11:19.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:19 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:19.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:19 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:19.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:19 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:19.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:19 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:19.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:19 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:19.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:19 smithi195 ceph-mon[97365]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:19.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:19.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:19 smithi151 ceph-mon[95510]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:19.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:19 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:19.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:19 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:19.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:19 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:19.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:19 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:19.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:19 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:19.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:19 smithi187 ceph-mon[96918]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:20.212 DEBUG:teuthology.orchestra.run.smithi151:osd.0> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.0.service 2023-07-21T22:11:20.217 INFO:tasks.cephadm:Deploying osd.1 on smithi187 with /dev/vg_nvme/lv_4... 2023-07-21T22:11:20.217 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-21T22:11:20.288 INFO:journalctl@ceph.osd.0.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:11:20.831 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:20 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:20.831 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:20 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:20.831 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:20 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:20.832 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:20 smithi151 ceph-mon[95510]: from='osd.0 [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-21T22:11:20.832 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:20 smithi151 ceph-mon[95510]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-21T22:11:20.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:20 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:20.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:20 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:20.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:20 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:20.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:20 smithi187 ceph-mon[96918]: from='osd.0 [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-21T22:11:20.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:20 smithi187 ceph-mon[96918]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-21T22:11:20.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:20 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:20.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:20 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:20.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:20 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:20.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:20 smithi195 ceph-mon[97365]: from='osd.0 [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-21T22:11:20.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:20 smithi195 ceph-mon[97365]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2023-07-21T22:11:20.941 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T22:11:21.583 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:21 smithi151 ceph-mon[95510]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-21T22:11:21.583 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:21 smithi151 ceph-mon[95510]: osdmap e6: 1 total, 0 up, 1 in 2023-07-21T22:11:21.584 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:21.584 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:21 smithi151 ceph-mon[95510]: from='osd.0 [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:11:21.584 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:21 smithi151 ceph-mon[95510]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:11:21.584 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:21 smithi151 ceph-mon[95510]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:21.584 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:11:21 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-0[108545]: 2023-07-21T22:11:21.537+0000 7f7ea7795700 -1 osd.0 0 waiting for initial osdmap 2023-07-21T22:11:21.585 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:11:21 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-0[108545]: 2023-07-21T22:11:21.541+0000 7f7ea1d87700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:11:21.804 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:21 smithi187 ceph-mon[96918]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-21T22:11:21.805 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:21 smithi187 ceph-mon[96918]: osdmap e6: 1 total, 0 up, 1 in 2023-07-21T22:11:21.805 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:21.805 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:21 smithi187 ceph-mon[96918]: from='osd.0 [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:11:21.805 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:21 smithi187 ceph-mon[96918]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:11:21.805 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:21 smithi187 ceph-mon[96918]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:21.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:21 smithi195 ceph-mon[97365]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2023-07-21T22:11:21.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:21 smithi195 ceph-mon[97365]: osdmap e6: 1 total, 0 up, 1 in 2023-07-21T22:11:21.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:21.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:21 smithi195 ceph-mon[97365]: from='osd.0 [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:11:21.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:21 smithi195 ceph-mon[97365]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:11:21.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:21 smithi195 ceph-mon[97365]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2023-07-21T22:11:22.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:22 smithi187 ceph-mon[96918]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:11:22.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:22 smithi187 ceph-mon[96918]: osdmap e7: 1 total, 0 up, 1 in 2023-07-21T22:11:22.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:22.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:22.883 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-21T22:11:22.884 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-21T22:11:22.884 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2023-07-21T22:11:22.884 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2023-07-21T22:11:22.884 INFO:teuthology.orchestra.run.smithi187.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0350202 s, 299 MB/s 2023-07-21T22:11:22.884 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2023-07-21T22:11:22.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:22 smithi195 ceph-mon[97365]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:11:22.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:22 smithi195 ceph-mon[97365]: osdmap e7: 1 total, 0 up, 1 in 2023-07-21T22:11:22.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:22.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:22.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:22 smithi151 ceph-mon[95510]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:11:22.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:22 smithi151 ceph-mon[95510]: osdmap e7: 1 total, 0 up, 1 in 2023-07-21T22:11:22.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:22.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:23.316 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi187:vg_nvme/lv_4 2023-07-21T22:11:23.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:11:23.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:11:23.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: osd.0 [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] boot 2023-07-21T22:11:23.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: osdmap e8: 1 total, 1 up, 1 in 2023-07-21T22:11:23.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:23.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:23.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi151 2023-07-21T22:11:23.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:11:23.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 17267M 2023-07-21T22:11:23.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:23.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:23.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:11:23.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:11:23.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: osd.0 [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] boot 2023-07-21T22:11:23.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: osdmap e8: 1 total, 1 up, 1 in 2023-07-21T22:11:23.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:23.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:23.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi151 2023-07-21T22:11:23.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:11:23.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 17267M 2023-07-21T22:11:23.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:23.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:23.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:11:23.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:11:23.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: osd.0 [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] boot 2023-07-21T22:11:23.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: osdmap e8: 1 total, 1 up, 1 in 2023-07-21T22:11:23.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:11:23.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: pgmap v48: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:23.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi151 2023-07-21T22:11:23.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:11:23.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 17267M 2023-07-21T22:11:23.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:23.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:23.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:23.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:24.038 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T22:11:24.861 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:24 smithi187 ceph-mon[96918]: osdmap e9: 1 total, 1 up, 1 in 2023-07-21T22:11:24.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:24 smithi195 ceph-mon[97365]: osdmap e9: 1 total, 1 up, 1 in 2023-07-21T22:11:24.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:24 smithi151 ceph-mon[95510]: osdmap e9: 1 total, 1 up, 1 in 2023-07-21T22:11:25.506 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.464+0000 7f0f19e64700 1 -- 172.21.15.187:0/904068063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f140ffb90 msgr2=0x7f0f140fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:25.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.464+0000 7f0f19e64700 1 --2- 172.21.15.187:0/904068063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f140ffb90 0x7f0f140fffa0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f0f040098f0 tx=0x7f0f04009c00 comp rx=0 tx=0).stop 2023-07-21T22:11:25.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.464+0000 7f0f19e64700 1 -- 172.21.15.187:0/904068063 shutdown_connections 2023-07-21T22:11:25.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.464+0000 7f0f19e64700 1 --2- 172.21.15.187:0/904068063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f140ffb90 0x7f0f140fffa0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.464+0000 7f0f19e64700 1 --2- 172.21.15.187:0/904068063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f14101720 0x7f0f14107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.464+0000 7f0f19e64700 1 --2- 172.21.15.187:0/904068063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f14100d90 0x7f0f141011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.507 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.464+0000 7f0f19e64700 1 -- 172.21.15.187:0/904068063 >> 172.21.15.187:0/904068063 conn(0x7f0f140fb1a0 msgr2=0x7f0f140fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:25.508 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.464+0000 7f0f19e64700 1 -- 172.21.15.187:0/904068063 shutdown_connections 2023-07-21T22:11:25.508 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.464+0000 7f0f19e64700 1 -- 172.21.15.187:0/904068063 wait complete. 2023-07-21T22:11:25.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.465+0000 7f0f19e64700 1 Processor -- start 2023-07-21T22:11:25.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.465+0000 7f0f19e64700 1 -- start start 2023-07-21T22:11:25.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f19e64700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f140ffb90 0x7f0f140742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.509 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f19e64700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f14100d90 0x7f0f14072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.510 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f19e64700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f14101720 0x7f0f14072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.510 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f19e64700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f140735c0 con 0x7f0f140ffb90 2023-07-21T22:11:25.510 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f19e64700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f14073730 con 0x7f0f14101720 2023-07-21T22:11:25.510 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f19e64700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f1419f8e0 con 0x7f0f14100d90 2023-07-21T22:11:25.510 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f13fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f14101720 0x7f0f14072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.510 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f12ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f14100d90 0x7f0f14072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.510 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f13fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f14101720 0x7f0f14072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:38886/0 (socket says 172.21.15.187:38886) 2023-07-21T22:11:25.511 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f140ffb90 0x7f0f140742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.511 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f13fff700 1 -- 172.21.15.187:0/1064556323 learned_addr learned my addr 172.21.15.187:0/1064556323 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-07-21T22:11:25.511 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f12ffd700 1 -- 172.21.15.187:0/1064556323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f14101720 msgr2=0x7f0f14072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:25.511 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f12ffd700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f14101720 0x7f0f14072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.511 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f12ffd700 1 -- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f140ffb90 msgr2=0x7f0f140742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:25.511 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f12ffd700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f140ffb90 0x7f0f140742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:25.511 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f12ffd700 1 -- 172.21.15.187:0/1064556323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f080095f0 con 0x7f0f14100d90 2023-07-21T22:11:25.512 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f13fff700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f14101720 0x7f0f14072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:25.512 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.466+0000 7f0f137fe700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f140ffb90 0x7f0f140742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:11:25.512 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.467+0000 7f0f12ffd700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f14100d90 0x7f0f14072900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800eb90 tx=0x7f0f0800eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:25.512 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.467+0000 7f0f10ff9700 1 -- 172.21.15.187:0/1064556323 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08009970 con 0x7f0f14100d90 2023-07-21T22:11:25.512 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.467+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f04009520 con 0x7f0f14100d90 2023-07-21T22:11:25.512 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.467+0000 7f0f10ff9700 1 -- 172.21.15.187:0/1064556323 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f080044b0 con 0x7f0f14100d90 2023-07-21T22:11:25.512 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.467+0000 7f0f10ff9700 1 -- 172.21.15.187:0/1064556323 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08003d60 con 0x7f0f14100d90 2023-07-21T22:11:25.512 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.467+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f1419ff80 con 0x7f0f14100d90 2023-07-21T22:11:25.513 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.468+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f14107290 con 0x7f0f14100d90 2023-07-21T22:11:25.513 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.470+0000 7f0f10ff9700 1 -- 172.21.15.187:0/1064556323 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7f0f08004020 con 0x7f0f14100d90 2023-07-21T22:11:25.513 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.471+0000 7f0f10ff9700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0efc0a10c0 0x7f0efc0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:25.514 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.472+0000 7f0f10ff9700 1 -- 172.21.15.187:0/1064556323 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1767+0+0 (secure 0 0 0) 0x7f0f08014070 con 0x7f0f14100d90 2023-07-21T22:11:25.514 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.472+0000 7f0f137fe700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0efc0a10c0 0x7f0efc0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:25.514 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.473+0000 7f0f137fe700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0efc0a10c0 0x7f0efc0a3570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009fd0 tx=0x7f0f04019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:25.516 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.475+0000 7f0f10ff9700 1 -- 172.21.15.187:0/1064556323 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f0f08096540 con 0x7f0f14100d90 2023-07-21T22:11:25.719 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:25.678+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f0f14060950 con 0x7f0efc0a10c0 2023-07-21T22:11:25.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:25 smithi187 ceph-mon[96918]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:25.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:25 smithi195 ceph-mon[97365]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:25.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:25 smithi151 ceph-mon[95510]: pgmap v50: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:26.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:26 smithi187 ceph-mon[96918]: from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:11:26.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:11:26.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:11:26.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:26.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:26 smithi195 ceph-mon[97365]: from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:11:26.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:11:26.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:11:26.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:26.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:26 smithi151 ceph-mon[95510]: from='client.24142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:11:26.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:11:26.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:11:26.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:27.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:27 smithi187 ceph-mon[96918]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:27.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:27 smithi195 ceph-mon[97365]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:27.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:27 smithi151 ceph-mon[95510]: pgmap v51: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:28.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:28 smithi151 ceph-mon[95510]: from='client.? 172.21.15.187:0/4204300269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96879cff-72f6-4852-91cb-51fedc6c24ee"}]: dispatch 2023-07-21T22:11:28.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:28 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96879cff-72f6-4852-91cb-51fedc6c24ee"}]: dispatch 2023-07-21T22:11:28.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:28 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96879cff-72f6-4852-91cb-51fedc6c24ee"}]': finished 2023-07-21T22:11:28.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:28 smithi151 ceph-mon[95510]: osdmap e10: 2 total, 1 up, 2 in 2023-07-21T22:11:28.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:29.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:28 smithi187 ceph-mon[96918]: from='client.? 172.21.15.187:0/4204300269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96879cff-72f6-4852-91cb-51fedc6c24ee"}]: dispatch 2023-07-21T22:11:29.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:28 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96879cff-72f6-4852-91cb-51fedc6c24ee"}]: dispatch 2023-07-21T22:11:29.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:28 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96879cff-72f6-4852-91cb-51fedc6c24ee"}]': finished 2023-07-21T22:11:29.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:28 smithi187 ceph-mon[96918]: osdmap e10: 2 total, 1 up, 2 in 2023-07-21T22:11:29.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:29.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:28 smithi195 ceph-mon[97365]: from='client.? 172.21.15.187:0/4204300269' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96879cff-72f6-4852-91cb-51fedc6c24ee"}]: dispatch 2023-07-21T22:11:29.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:28 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "96879cff-72f6-4852-91cb-51fedc6c24ee"}]: dispatch 2023-07-21T22:11:29.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:28 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "96879cff-72f6-4852-91cb-51fedc6c24ee"}]': finished 2023-07-21T22:11:29.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:28 smithi195 ceph-mon[97365]: osdmap e10: 2 total, 1 up, 2 in 2023-07-21T22:11:29.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:29.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:29 smithi151 ceph-mon[95510]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:29.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:29 smithi151 ceph-mon[95510]: from='client.? 172.21.15.187:0/822962827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:11:30.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:29 smithi187 ceph-mon[96918]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:30.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:29 smithi187 ceph-mon[96918]: from='client.? 172.21.15.187:0/822962827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:11:30.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:29 smithi195 ceph-mon[97365]: pgmap v53: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:30.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:29 smithi195 ceph-mon[97365]: from='client.? 172.21.15.187:0/822962827' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:11:32.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:32 smithi187 ceph-mon[96918]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:32.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:32 smithi195 ceph-mon[97365]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:32.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:32 smithi151 ceph-mon[95510]: pgmap v54: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:34.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:34 smithi187 ceph-mon[96918]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:34.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:34 smithi195 ceph-mon[97365]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:34.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:34 smithi151 ceph-mon[95510]: pgmap v55: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:36.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:36 smithi187 ceph-mon[96918]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:36.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:36 smithi195 ceph-mon[97365]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:36.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:36 smithi151 ceph-mon[95510]: pgmap v56: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:37.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-21T22:11:37.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:37.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:37 smithi187 ceph-mon[96918]: Deploying daemon osd.1 on smithi187 2023-07-21T22:11:37.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:37 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-21T22:11:37.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:37 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:37.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:37 smithi195 ceph-mon[97365]: Deploying daemon osd.1 on smithi187 2023-07-21T22:11:37.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:37 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2023-07-21T22:11:37.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:37 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:37.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:37 smithi151 ceph-mon[95510]: Deploying daemon osd.1 on smithi187 2023-07-21T22:11:38.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:38 smithi187 ceph-mon[96918]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:38.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:38 smithi195 ceph-mon[97365]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:38.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:38 smithi151 ceph-mon[95510]: pgmap v57: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:40.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:40 smithi187 ceph-mon[96918]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:40.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:40 smithi195 ceph-mon[97365]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:40.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:40 smithi151 ceph-mon[95510]: pgmap v58: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:42.237 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:42 smithi187 ceph-mon[96918]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:42.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:42 smithi195 ceph-mon[97365]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:42.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:42 smithi151 ceph-mon[95510]: pgmap v59: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:43.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:43.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:43.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:43.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:43.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:43.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:43.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:43.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:43.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:44.480 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:44 smithi187 ceph-mon[96918]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:44.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:44 smithi195 ceph-mon[97365]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:44.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:44 smithi151 ceph-mon[95510]: pgmap v60: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:45.643 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 1 on host 'smithi187' 2023-07-21T22:11:45.643 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.600+0000 7f0f10ff9700 1 -- 172.21.15.187:0/1064556323 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f0f14060950 con 0x7f0efc0a10c0 2023-07-21T22:11:45.645 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0efc0a10c0 msgr2=0x7f0efc0a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.645 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0efc0a10c0 0x7f0efc0a3570 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0f04009fd0 tx=0x7f0f04019040 comp rx=0 tx=0).stop 2023-07-21T22:11:45.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f14100d90 msgr2=0x7f0f14072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:45.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f14100d90 0x7f0f14072900 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f0f0800eb90 tx=0x7f0f0800eea0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 shutdown_connections 2023-07-21T22:11:45.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0efc0a10c0 0x7f0efc0a3570 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f14101720 0x7f0f14072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f140ffb90 0x7f0f140742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 --2- 172.21.15.187:0/1064556323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f14100d90 0x7f0f14072900 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:45.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 >> 172.21.15.187:0/1064556323 conn(0x7f0f140fb1a0 msgr2=0x7f0f141043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:45.647 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 shutdown_connections 2023-07-21T22:11:45.647 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:11:45.603+0000 7f0f19e64700 1 -- 172.21.15.187:0/1064556323 wait complete. 2023-07-21T22:11:45.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:45.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:45.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:45.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:45.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:45.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:45 smithi187 ceph-mon[96918]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:45.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:45.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:45.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:46.150 DEBUG:teuthology.orchestra.run.smithi187:osd.1> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.1.service 2023-07-21T22:11:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:46.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:46.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:45 smithi195 ceph-mon[97365]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:46.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:46.156 INFO:tasks.cephadm:Deploying osd.2 on smithi195 with /dev/vg_nvme/lv_4... 2023-07-21T22:11:46.156 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2023-07-21T22:11:46.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:46.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:46.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:45 smithi151 ceph-mon[95510]: pgmap v61: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:46.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:46.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:11:46.228 INFO:journalctl@ceph.osd.1.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:11:46.626 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:11:46 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-1[102031]: 2023-07-21T22:11:46.289+0000 7f54181bc640 -1 osd.1 0 log_to_monitors true 2023-07-21T22:11:46.877 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:11:47.344 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:47 smithi187 ceph-mon[96918]: from='osd.1 [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-21T22:11:47.345 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:47 smithi187 ceph-mon[96918]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-21T22:11:47.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:47 smithi195 ceph-mon[97365]: from='osd.1 [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-21T22:11:47.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:47 smithi195 ceph-mon[97365]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-21T22:11:47.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:47 smithi151 ceph-mon[95510]: from='osd.1 [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-21T22:11:47.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:47 smithi151 ceph-mon[95510]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2023-07-21T22:11:48.376 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:11:48 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-1[102031]: 2023-07-21T22:11:48.084+0000 7f540d834700 -1 osd.1 0 waiting for initial osdmap 2023-07-21T22:11:48.376 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:11:48 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-1[102031]: 2023-07-21T22:11:48.089+0000 7f5408e28700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:11:48.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:48 smithi187 ceph-mon[96918]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:48.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:48 smithi187 ceph-mon[96918]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-21T22:11:48.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:48 smithi187 ceph-mon[96918]: osdmap e11: 2 total, 1 up, 2 in 2023-07-21T22:11:48.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:48.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:48 smithi187 ceph-mon[96918]: from='osd.1 [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:11:48.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:48 smithi187 ceph-mon[96918]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:11:48.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:48 smithi195 ceph-mon[97365]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:48.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:48 smithi195 ceph-mon[97365]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-21T22:11:48.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:48 smithi195 ceph-mon[97365]: osdmap e11: 2 total, 1 up, 2 in 2023-07-21T22:11:48.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:48.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:48 smithi195 ceph-mon[97365]: from='osd.1 [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:11:48.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:48 smithi195 ceph-mon[97365]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:11:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:48 smithi151 ceph-mon[95510]: pgmap v62: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:48 smithi151 ceph-mon[95510]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2023-07-21T22:11:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:48 smithi151 ceph-mon[95510]: osdmap e11: 2 total, 1 up, 2 in 2023-07-21T22:11:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:48 smithi151 ceph-mon[95510]: from='osd.1 [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:11:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:48 smithi151 ceph-mon[95510]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:11:48.701 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_4 2023-07-21T22:11:48.701 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2023-07-21T22:11:48.701 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-07-21T22:11:48.702 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-07-21T22:11:48.702 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0352467 s, 297 MB/s 2023-07-21T22:11:48.702 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-07-21T22:11:49.155 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_4 2023-07-21T22:11:49.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:11:49.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: osdmap e12: 2 total, 1 up, 2 in 2023-07-21T22:11:49.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:49.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:49.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:11:49.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:49.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:49.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:11:49.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: osdmap e12: 2 total, 1 up, 2 in 2023-07-21T22:11:49.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:11:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:49.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:11:49.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: osdmap e12: 2 total, 1 up, 2 in 2023-07-21T22:11:49.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:49.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:49.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:11:49.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:49.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:11:49.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:11:49.873 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:11:50.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:50 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:11:50.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:50 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:11:50.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:50 smithi195 ceph-mon[97365]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:50.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:50 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi187 2023-07-21T22:11:50.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:50 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 17267M 2023-07-21T22:11:50.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:50 smithi195 ceph-mon[97365]: osd.1 [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] boot 2023-07-21T22:11:50.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:50 smithi195 ceph-mon[97365]: osdmap e13: 2 total, 2 up, 2 in 2023-07-21T22:11:50.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:50 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:11:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:50 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:11:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:50 smithi151 ceph-mon[95510]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:50 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi187 2023-07-21T22:11:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:50 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 17267M 2023-07-21T22:11:50.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:50 smithi151 ceph-mon[95510]: osd.1 [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] boot 2023-07-21T22:11:50.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:50 smithi151 ceph-mon[95510]: osdmap e13: 2 total, 2 up, 2 in 2023-07-21T22:11:50.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:50.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:50 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:11:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:50 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:11:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:50 smithi187 ceph-mon[96918]: pgmap v65: 0 pgs: ; 0 B data, 26 MiB used, 89 GiB / 89 GiB avail 2023-07-21T22:11:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:50 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi187 2023-07-21T22:11:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:50 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 17267M 2023-07-21T22:11:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:50 smithi187 ceph-mon[96918]: osd.1 [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] boot 2023-07-21T22:11:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:50 smithi187 ceph-mon[96918]: osdmap e13: 2 total, 2 up, 2 in 2023-07-21T22:11:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:11:51.259 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.218+0000 7fd9bd281700 1 -- 172.21.15.195:0/766629692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b8100d90 msgr2=0x7fd9b81011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.260 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.218+0000 7fd9bd281700 1 --2- 172.21.15.195:0/766629692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b8100d90 0x7fd9b81011e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac009990 tx=0x7fd9ac009ca0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.260 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.218+0000 7fd9bd281700 1 -- 172.21.15.195:0/766629692 shutdown_connections 2023-07-21T22:11:51.260 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.218+0000 7fd9bd281700 1 --2- 172.21.15.195:0/766629692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b80ffb90 0x7fd9b80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.260 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.218+0000 7fd9bd281700 1 --2- 172.21.15.195:0/766629692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9b8101720 0x7fd9b8107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.260 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.218+0000 7fd9bd281700 1 --2- 172.21.15.195:0/766629692 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b8100d90 0x7fd9b81011e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.260 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.218+0000 7fd9bd281700 1 -- 172.21.15.195:0/766629692 >> 172.21.15.195:0/766629692 conn(0x7fd9b80fb1a0 msgr2=0x7fd9b80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:11:51.260 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.218+0000 7fd9bd281700 1 -- 172.21.15.195:0/766629692 shutdown_connections 2023-07-21T22:11:51.261 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.218+0000 7fd9bd281700 1 -- 172.21.15.195:0/766629692 wait complete. 2023-07-21T22:11:51.262 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.219+0000 7fd9bd281700 1 Processor -- start 2023-07-21T22:11:51.262 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.219+0000 7fd9bd281700 1 -- start start 2023-07-21T22:11:51.262 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9bd281700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b80ffb90 0x7fd9b8197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.262 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9bd281700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9b8100d90 0x7fd9b8197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.262 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9bd281700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b8101720 0x7fd9b819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.263 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9bd281700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819f590 con 0x7fd9b8100d90 2023-07-21T22:11:51.263 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9bd281700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819f6d0 con 0x7fd9b8101720 2023-07-21T22:11:51.263 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9bd281700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9b819f860 con 0x7fd9b80ffb90 2023-07-21T22:11:51.263 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9b6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b80ffb90 0x7fd9b8197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.263 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9b6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b80ffb90 0x7fd9b8197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:58970/0 (socket says 172.21.15.195:58970) 2023-07-21T22:11:51.263 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9b6ffd700 1 -- 172.21.15.195:0/4116143001 learned_addr learned my addr 172.21.15.195:0/4116143001 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:11:51.263 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9b67fc700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9b8100d90 0x7fd9b8197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.264 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9b6ffd700 1 -- 172.21.15.195:0/4116143001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b8101720 msgr2=0x7fd9b819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.264 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.220+0000 7fd9b6ffd700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b8101720 0x7fd9b819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.264 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.221+0000 7fd9b6ffd700 1 -- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9b8100d90 msgr2=0x7fd9b8197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:11:51.264 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.221+0000 7fd9b6ffd700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9b8100d90 0x7fd9b8197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:11:51.265 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.221+0000 7fd9b6ffd700 1 -- 172.21.15.195:0/4116143001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9ac0095f0 con 0x7fd9b80ffb90 2023-07-21T22:11:51.265 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.221+0000 7fd9b6ffd700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b80ffb90 0x7fd9b8197a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800d9b0 tx=0x7fd9a800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:51.265 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.221+0000 7fd99ffff700 1 -- 172.21.15.195:0/4116143001 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a8004020 con 0x7fd9b80ffb90 2023-07-21T22:11:51.265 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.221+0000 7fd99ffff700 1 -- 172.21.15.195:0/4116143001 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9a80096b0 con 0x7fd9b80ffb90 2023-07-21T22:11:51.265 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.221+0000 7fd99ffff700 1 -- 172.21.15.195:0/4116143001 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9a80039e0 con 0x7fd9b80ffb90 2023-07-21T22:11:51.265 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.221+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9b819fb40 con 0x7fd9b80ffb90 2023-07-21T22:11:51.266 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.221+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9b819fff0 con 0x7fd9b80ffb90 2023-07-21T22:11:51.266 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.222+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9b8192110 con 0x7fd9b80ffb90 2023-07-21T22:11:51.266 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.224+0000 7fd99ffff700 1 -- 172.21.15.195:0/4116143001 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7fd9a8009820 con 0x7fd9b80ffb90 2023-07-21T22:11:51.267 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.226+0000 7fd99ffff700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9a00a10c0 0x7fd9a00a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:11:51.267 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.226+0000 7fd99ffff700 1 -- 172.21.15.195:0/4116143001 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2309+0+0 (secure 0 0 0) 0x7fd9a80cb0b0 con 0x7fd9b80ffb90 2023-07-21T22:11:51.267 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.226+0000 7fd9b67fc700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9a00a10c0 0x7fd9a00a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:11:51.268 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.227+0000 7fd9b67fc700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9a00a10c0 0x7fd9a00a3570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac006010 tx=0x7fd9ac00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:11:51.270 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.229+0000 7fd99ffff700 1 -- 172.21.15.195:0/4116143001 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd9a8095fb0 con 0x7fd9b80ffb90 2023-07-21T22:11:51.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:51 smithi195 ceph-mon[97365]: osdmap e14: 2 total, 2 up, 2 in 2023-07-21T22:11:51.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:51 smithi151 ceph-mon[95510]: osdmap e14: 2 total, 2 up, 2 in 2023-07-21T22:11:51.470 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:11:51.429+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9b8060950 con 0x7fd9a00a10c0 2023-07-21T22:11:51.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:51 smithi187 ceph-mon[96918]: osdmap e14: 2 total, 2 up, 2 in 2023-07-21T22:11:52.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:52 smithi195 ceph-mon[97365]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:52.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:11:52.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:11:52.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:52 smithi151 ceph-mon[95510]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:11:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:11:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:52.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:52 smithi187 ceph-mon[96918]: pgmap v68: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:52.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:11:52.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:11:52.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:11:53.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:53 smithi195 ceph-mon[97365]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:11:53.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:53 smithi151 ceph-mon[95510]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:11:53.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:53 smithi187 ceph-mon[96918]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:11:54.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:54 smithi151 ceph-mon[95510]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:54.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:54 smithi187 ceph-mon[96918]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:54.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:54 smithi195 ceph-mon[97365]: pgmap v69: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:55.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:55 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/1582357381' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a953e7b-0858-4387-9d3d-ad2693e940f2"}]: dispatch 2023-07-21T22:11:55.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:55 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a953e7b-0858-4387-9d3d-ad2693e940f2"}]: dispatch 2023-07-21T22:11:55.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:55 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a953e7b-0858-4387-9d3d-ad2693e940f2"}]': finished 2023-07-21T22:11:55.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:55 smithi151 ceph-mon[95510]: osdmap e15: 3 total, 2 up, 3 in 2023-07-21T22:11:55.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:11:55.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:55 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/470794291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:11:55.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:55 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/1582357381' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a953e7b-0858-4387-9d3d-ad2693e940f2"}]: dispatch 2023-07-21T22:11:55.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:55 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a953e7b-0858-4387-9d3d-ad2693e940f2"}]: dispatch 2023-07-21T22:11:55.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:55 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a953e7b-0858-4387-9d3d-ad2693e940f2"}]': finished 2023-07-21T22:11:55.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:55 smithi187 ceph-mon[96918]: osdmap e15: 3 total, 2 up, 3 in 2023-07-21T22:11:55.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:11:55.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:55 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/470794291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:11:55.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:55 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/1582357381' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a953e7b-0858-4387-9d3d-ad2693e940f2"}]: dispatch 2023-07-21T22:11:55.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:55 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2a953e7b-0858-4387-9d3d-ad2693e940f2"}]: dispatch 2023-07-21T22:11:55.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:55 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2a953e7b-0858-4387-9d3d-ad2693e940f2"}]': finished 2023-07-21T22:11:55.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:55 smithi195 ceph-mon[97365]: osdmap e15: 3 total, 2 up, 3 in 2023-07-21T22:11:55.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:11:55.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:55 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/470794291' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:11:56.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:56 smithi195 ceph-mon[97365]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:56.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:56 smithi151 ceph-mon[95510]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:56.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:56 smithi187 ceph-mon[96918]: pgmap v71: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:58.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:58 smithi195 ceph-mon[97365]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:58.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:58 smithi151 ceph-mon[95510]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:58.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:58 smithi187 ceph-mon[96918]: pgmap v72: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:59.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:11:59 smithi195 ceph-mon[97365]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:59.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:11:59 smithi151 ceph-mon[95510]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:11:59.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:11:59 smithi187 ceph-mon[96918]: pgmap v73: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:02 smithi187 ceph-mon[96918]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-21T22:12:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:02 smithi195 ceph-mon[97365]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-21T22:12:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:02 smithi151 ceph-mon[95510]: pgmap v74: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:02.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2023-07-21T22:12:02.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:03.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:03 smithi187 ceph-mon[96918]: Deploying daemon osd.2 on smithi195 2023-07-21T22:12:03.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:03 smithi195 ceph-mon[97365]: Deploying daemon osd.2 on smithi195 2023-07-21T22:12:03.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:03 smithi151 ceph-mon[95510]: Deploying daemon osd.2 on smithi195 2023-07-21T22:12:04.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:04 smithi187 ceph-mon[96918]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:04.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:04 smithi195 ceph-mon[97365]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:04.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:04 smithi151 ceph-mon[95510]: pgmap v75: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:06.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:06 smithi187 ceph-mon[96918]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:06.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:06 smithi195 ceph-mon[97365]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:06.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:06 smithi151 ceph-mon[95510]: pgmap v76: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:08.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:08 smithi187 ceph-mon[96918]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:08.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:08.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:08.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:08.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:08 smithi195 ceph-mon[97365]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:08.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:08.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:08.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:08.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:08 smithi151 ceph-mon[95510]: pgmap v77: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:08.479 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:08.479 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:08.479 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:10.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:10 smithi187 ceph-mon[96918]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:10.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:10 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:10.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:10 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:10.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:10 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:10.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:10 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:10.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:10 smithi195 ceph-mon[97365]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:10.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:10 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:10.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:10 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:10.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:10 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:10.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:10 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:10.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:10 smithi151 ceph-mon[95510]: pgmap v78: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:10.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:10 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:10.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:10 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:10.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:10 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:10.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:10 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:11.309 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:11 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:11.399 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.356+0000 7fd99ffff700 1 -- 172.21.15.195:0/4116143001 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd9b8060950 con 0x7fd9a00a10c0 2023-07-21T22:12:11.399 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 2 on host 'smithi195' 2023-07-21T22:12:11.401 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9a00a10c0 msgr2=0x7fd9a00a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:11.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9a00a10c0 0x7fd9a00a3570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd9ac006010 tx=0x7fd9ac00b260 comp rx=0 tx=0).stop 2023-07-21T22:12:11.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b80ffb90 msgr2=0x7fd9b8197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:11.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b80ffb90 0x7fd9b8197a00 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd9a800d9b0 tx=0x7fd9a800dcc0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 shutdown_connections 2023-07-21T22:12:11.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9a00a10c0 0x7fd9a00a3570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.402 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9b8101720 0x7fd9b819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.403 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9b80ffb90 0x7fd9b8197a00 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.403 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 --2- 172.21.15.195:0/4116143001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9b8100d90 0x7fd9b8197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:11.403 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 >> 172.21.15.195:0/4116143001 conn(0x7fd9b80fb1a0 msgr2=0x7fd9b8106760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:11.403 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 shutdown_connections 2023-07-21T22:12:11.403 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:12:11.359+0000 7fd9bd281700 1 -- 172.21.15.195:0/4116143001 wait complete. 2023-07-21T22:12:11.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:11 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:11.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:11 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:11.886 DEBUG:teuthology.orchestra.run.smithi195:osd.2> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.2.service 2023-07-21T22:12:11.891 INFO:tasks.cephadm:Deploying osd.3 on smithi151 with /dev/vg_nvme/lv_3... 2023-07-21T22:12:11.891 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-21T22:12:11.963 INFO:journalctl@ceph.osd.2.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:12:12.621 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:12:12.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:12 smithi187 ceph-mon[96918]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:12.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:12 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:12.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:12 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:12.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:12 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:12.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:12 smithi187 ceph-mon[96918]: from='osd.2 [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-21T22:12:12.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:12 smithi187 ceph-mon[96918]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-21T22:12:12.650 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:12 smithi195 ceph-mon[97365]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:12.651 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:12 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:12.651 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:12 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:12.651 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:12 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:12.651 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:12 smithi195 ceph-mon[97365]: from='osd.2 [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-21T22:12:12.651 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:12 smithi195 ceph-mon[97365]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-21T22:12:12.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:12 smithi151 ceph-mon[95510]: pgmap v79: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:12.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:12 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:12.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:12 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:12.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:12 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:12.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:12 smithi151 ceph-mon[95510]: from='osd.2 [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-21T22:12:12.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:12 smithi151 ceph-mon[95510]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2023-07-21T22:12:13.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:13 smithi151 ceph-mon[95510]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-21T22:12:13.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:13 smithi151 ceph-mon[95510]: osdmap e16: 3 total, 2 up, 3 in 2023-07-21T22:12:13.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:13.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:13 smithi151 ceph-mon[95510]: from='osd.2 [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:12:13.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:13 smithi151 ceph-mon[95510]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:12:13.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:13 smithi195 ceph-mon[97365]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-21T22:12:13.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:13 smithi195 ceph-mon[97365]: osdmap e16: 3 total, 2 up, 3 in 2023-07-21T22:12:13.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:13.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:13 smithi195 ceph-mon[97365]: from='osd.2 [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:12:13.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:13 smithi195 ceph-mon[97365]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:12:13.656 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:13 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-2[103401]: 2023-07-21T22:12:13.341+0000 7f306d1d2700 -1 osd.2 0 waiting for initial osdmap 2023-07-21T22:12:13.657 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:13 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-2[103401]: 2023-07-21T22:12:13.347+0000 7f3065fc1700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:12:13.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:13 smithi187 ceph-mon[96918]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2023-07-21T22:12:13.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:13 smithi187 ceph-mon[96918]: osdmap e16: 3 total, 2 up, 3 in 2023-07-21T22:12:13.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:13.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:13 smithi187 ceph-mon[96918]: from='osd.2 [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:12:13.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:13 smithi187 ceph-mon[96918]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:12:14.602 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-21T22:12:14.602 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-21T22:12:14.602 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2023-07-21T22:12:14.602 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2023-07-21T22:12:14.603 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0413792 s, 253 MB/s 2023-07-21T22:12:14.603 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2023-07-21T22:12:14.623 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:14 smithi195 ceph-mon[97365]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:14.623 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:14 smithi195 ceph-mon[97365]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:12:14.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:14 smithi195 ceph-mon[97365]: osdmap e17: 3 total, 2 up, 3 in 2023-07-21T22:12:14.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:14 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:14.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:14 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:14.640 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:14 smithi151 ceph-mon[95510]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:14.640 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:14 smithi151 ceph-mon[95510]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:12:14.640 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:14 smithi151 ceph-mon[95510]: osdmap e17: 3 total, 2 up, 3 in 2023-07-21T22:12:14.640 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:14.641 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:14.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:14 smithi187 ceph-mon[96918]: pgmap v81: 0 pgs: ; 0 B data, 53 MiB used, 179 GiB / 179 GiB avail 2023-07-21T22:12:14.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:14 smithi187 ceph-mon[96918]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:12:14.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:14 smithi187 ceph-mon[96918]: osdmap e17: 3 total, 2 up, 3 in 2023-07-21T22:12:14.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:14 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:14.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:14 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:15.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi151:vg_nvme/lv_3 2023-07-21T22:12:15.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:12:15.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:12:15.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: osd.2 [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] boot 2023-07-21T22:12:15.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: osdmap e18: 3 total, 3 up, 3 in 2023-07-21T22:12:15.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:15.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:12:15.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:15.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:15.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-07-21T22:12:15.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:12:15.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:12:15.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: osd.2 [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] boot 2023-07-21T22:12:15.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: osdmap e18: 3 total, 3 up, 3 in 2023-07-21T22:12:15.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:15.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:12:15.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:15.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:15.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-07-21T22:12:15.819 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:12:15.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:12:15.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:12:15.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: osd.2 [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] boot 2023-07-21T22:12:15.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: osdmap e18: 3 total, 3 up, 3 in 2023-07-21T22:12:15.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:12:15.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:12:15.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:15.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:15.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:15.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2023-07-21T22:12:16.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:16 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi195 2023-07-21T22:12:16.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:16 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 17267M 2023-07-21T22:12:16.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:16 smithi195 ceph-mon[97365]: pgmap v84: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:16.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:16 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-07-21T22:12:16.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:16 smithi195 ceph-mon[97365]: osdmap e19: 3 total, 3 up, 3 in 2023-07-21T22:12:16.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:16 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-07-21T22:12:16.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:16 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi195 2023-07-21T22:12:16.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:16 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 17267M 2023-07-21T22:12:16.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:16 smithi151 ceph-mon[95510]: pgmap v84: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:16.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:16 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-07-21T22:12:16.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:16 smithi151 ceph-mon[95510]: osdmap e19: 3 total, 3 up, 3 in 2023-07-21T22:12:16.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:16 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-07-21T22:12:16.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:16 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi195 2023-07-21T22:12:16.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:16 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 17267M 2023-07-21T22:12:16.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:16 smithi187 ceph-mon[96918]: pgmap v84: 0 pgs: ; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:16.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:16 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2023-07-21T22:12:16.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:16 smithi187 ceph-mon[96918]: osdmap e19: 3 total, 3 up, 3 in 2023-07-21T22:12:16.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:16 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2023-07-21T22:12:17.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.301+0000 7f2b97b26700 1 -- 172.21.15.151:0/3634864605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 msgr2=0x7f2b901021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.301+0000 7f2b97b26700 1 --2- 172.21.15.151:0/3634864605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 0x7f2b901021d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c009990 tx=0x7f2b8c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.301+0000 7f2b97b26700 1 -- 172.21.15.151:0/3634864605 shutdown_connections 2023-07-21T22:12:17.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.301+0000 7f2b97b26700 1 --2- 172.21.15.151:0/3634864605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b90103950 0x7f2b9010a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.301+0000 7f2b97b26700 1 --2- 172.21.15.151:0/3634864605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 0x7f2b901021d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.301+0000 7f2b97b26700 1 --2- 172.21.15.151:0/3634864605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b90102fc0 0x7f2b90103410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.301+0000 7f2b97b26700 1 -- 172.21.15.151:0/3634864605 >> 172.21.15.151:0/3634864605 conn(0x7f2b900fd410 msgr2=0x7f2b900ff840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:17.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.301+0000 7f2b97b26700 1 -- 172.21.15.151:0/3634864605 shutdown_connections 2023-07-21T22:12:17.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.301+0000 7f2b97b26700 1 -- 172.21.15.151:0/3634864605 wait complete. 2023-07-21T22:12:17.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.302+0000 7f2b97b26700 1 Processor -- start 2023-07-21T22:12:17.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.302+0000 7f2b97b26700 1 -- start start 2023-07-21T22:12:17.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b97b26700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 0x7f2b901979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b97b26700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b90102fc0 0x7f2b90197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b97b26700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b90103950 0x7f2b9019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b97b26700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9019f530 con 0x7f2b90101dc0 2023-07-21T22:12:17.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b97b26700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9019f670 con 0x7f2b90103950 2023-07-21T22:12:17.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b97b26700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b9019f800 con 0x7f2b90102fc0 2023-07-21T22:12:17.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b958c2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 0x7f2b901979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b958c2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 0x7f2b901979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32944/0 (socket says 172.21.15.151:32944) 2023-07-21T22:12:17.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b958c2700 1 -- 172.21.15.151:0/897374743 learned_addr learned my addr 172.21.15.151:0/897374743 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:12:17.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b960c3700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b90103950 0x7f2b9019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b950c1700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b90102fc0 0x7f2b90197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b958c2700 1 -- 172.21.15.151:0/897374743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b90102fc0 msgr2=0x7f2b90197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b958c2700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b90102fc0 0x7f2b90197ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b958c2700 1 -- 172.21.15.151:0/897374743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b90103950 msgr2=0x7f2b9019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:17.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b958c2700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b90103950 0x7f2b9019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:17.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.303+0000 7f2b958c2700 1 -- 172.21.15.151:0/897374743 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b8c0095f0 con 0x7f2b90101dc0 2023-07-21T22:12:17.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.304+0000 7f2b958c2700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 0x7f2b901979a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0059d0 tx=0x7f2b8c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:17.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.304+0000 7f2b86ffd700 1 -- 172.21.15.151:0/897374743 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c01d070 con 0x7f2b90101dc0 2023-07-21T22:12:17.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.304+0000 7f2b86ffd700 1 -- 172.21.15.151:0/897374743 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2b8c00f460 con 0x7f2b90101dc0 2023-07-21T22:12:17.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.304+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b9019fa80 con 0x7f2b90101dc0 2023-07-21T22:12:17.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.304+0000 7f2b86ffd700 1 -- 172.21.15.151:0/897374743 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c021670 con 0x7f2b90101dc0 2023-07-21T22:12:17.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.304+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b9019ff20 con 0x7f2b90101dc0 2023-07-21T22:12:17.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.305+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b90109410 con 0x7f2b90101dc0 2023-07-21T22:12:17.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.307+0000 7f2b86ffd700 1 -- 172.21.15.151:0/897374743 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 15) v1 ==== 135660+0+0 (secure 0 0 0) 0x7f2b8c00f5d0 con 0x7f2b90101dc0 2023-07-21T22:12:17.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.309+0000 7f2b86ffd700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2b7c0a10c0 0x7f2b7c0a3570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:17.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.309+0000 7f2b86ffd700 1 -- 172.21.15.151:0/897374743 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3237+0+0 (secure 0 0 0) 0x7f2b8c0ccce0 con 0x7f2b90101dc0 2023-07-21T22:12:17.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.309+0000 7f2b950c1700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2b7c0a10c0 0x7f2b7c0a3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:17.352 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.309+0000 7f2b950c1700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2b7c0a10c0 0x7f2b7c0a3570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009b30 tx=0x7f2b80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:17.353 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.311+0000 7f2b86ffd700 1 -- 172.21.15.151:0/897374743 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2b8c0978d0 con 0x7f2b90101dc0 2023-07-21T22:12:17.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:17.528+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b90060950 con 0x7f2b7c0a10c0 2023-07-21T22:12:17.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:17 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-07-21T22:12:17.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:17 smithi195 ceph-mon[97365]: osdmap e20: 3 total, 3 up, 3 in 2023-07-21T22:12:17.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:17 smithi195 ceph-mon[97365]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:17.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:17 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-07-21T22:12:17.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:17 smithi151 ceph-mon[95510]: osdmap e20: 3 total, 3 up, 3 in 2023-07-21T22:12:17.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:17 smithi151 ceph-mon[95510]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:17.698 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:12:17 smithi151 sudo[111474]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-21T22:12:17.698 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:12:17 smithi151 sudo[111474]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:17.698 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:12:17 smithi151 sudo[111474]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:17.698 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:12:17 smithi151 sudo[111474]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:17.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:17 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2023-07-21T22:12:17.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:17 smithi187 ceph-mon[96918]: osdmap e20: 3 total, 3 up, 3 in 2023-07-21T22:12:17.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:17 smithi187 ceph-mon[96918]: pgmap v87: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:18.406 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:12:17 smithi151 sudo[111555]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-21T22:12:18.406 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:12:17 smithi151 sudo[111555]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:18.406 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:12:17 smithi151 sudo[111555]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:18.406 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 22:12:17 smithi151 sudo[111555]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:18.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:18 smithi151 ceph-mon[95510]: osdmap e21: 3 total, 3 up, 3 in 2023-07-21T22:12:18.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:18 smithi151 ceph-mon[95510]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:12:18.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:12:18.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:12:18.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:18.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:18.876 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:12:18 smithi187 sudo[104421]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-21T22:12:18.876 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:12:18 smithi187 sudo[104421]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:18.876 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:12:18 smithi187 sudo[104421]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:18.876 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:12:18 smithi187 sudo[104421]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:18.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:18 smithi187 ceph-mon[96918]: osdmap e21: 3 total, 3 up, 3 in 2023-07-21T22:12:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:18 smithi187 ceph-mon[96918]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:12:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:12:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:12:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:18.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:18 smithi195 ceph-mon[97365]: osdmap e21: 3 total, 3 up, 3 in 2023-07-21T22:12:18.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:18 smithi195 ceph-mon[97365]: from='client.14316 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:12:18.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:12:18.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:12:18.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:18.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:19.376 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:12:18 smithi187 sudo[104424]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-21T22:12:19.376 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:12:18 smithi187 sudo[104424]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:19.376 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:12:18 smithi187 sudo[104424]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:19.376 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 22:12:18 smithi187 sudo[104424]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:19.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:19.380+0000 7f2b86ffd700 1 -- 172.21.15.151:0/897374743 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2b8c097ca0 con 0x7f2b90101dc0 2023-07-21T22:12:19.904 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:19 smithi195 sudo[105621]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-21T22:12:19.905 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:19 smithi195 sudo[105621]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:19.905 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:19 smithi195 sudo[105621]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:19.905 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:19 smithi195 sudo[105621]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:20.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:20 smithi187 ceph-mon[96918]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:20.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:20 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:20.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:20 smithi187 ceph-mon[96918]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-07-21T22:12:20.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:20 smithi195 ceph-mon[97365]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:20.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:20 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:20.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:20 smithi195 ceph-mon[97365]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-07-21T22:12:20.405 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:20 smithi195 sudo[105624]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-21T22:12:20.405 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:20 smithi195 sudo[105624]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:20.405 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:20 smithi195 sudo[105624]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:20.405 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 22:12:20 smithi195 sudo[105624]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:20.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:20 smithi151 ceph-mon[95510]: pgmap v89: 1 pgs: 1 unknown; 0 B data, 79 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:20.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:20 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:20.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:20 smithi151 ceph-mon[95510]: mgrmap e16: x(active, since 2m), standbys: z, y 2023-07-21T22:12:20.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:20 smithi151 sudo[111740]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-21T22:12:20.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:20 smithi151 sudo[111740]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:20.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:20 smithi151 sudo[111740]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:20.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:20 smithi151 sudo[111740]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:21.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:21.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:21 smithi195 ceph-mon[97365]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-21T22:12:21.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:21 smithi151 sudo[111743]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-21T22:12:21.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:21 smithi151 sudo[111743]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:21.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:21 smithi151 sudo[111743]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:21.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:21 smithi151 sudo[111743]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:21.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:21.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:21 smithi151 ceph-mon[95510]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-21T22:12:21.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:21.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:21 smithi187 ceph-mon[96918]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-21T22:12:21.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:21 smithi195 sudo[105627]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-21T22:12:21.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:21 smithi195 sudo[105627]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:21.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:21 smithi195 sudo[105627]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:21.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:21 smithi195 sudo[105627]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:22.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 sudo[105630]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-21T22:12:22.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 sudo[105630]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:22.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 sudo[105630]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:22.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 sudo[105630]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:22.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3429056588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69ea6be1-ee4c-4392-a1ea-f33959280632"}]: dispatch 2023-07-21T22:12:22.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:22.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-21T22:12:22.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:12:22.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69ea6be1-ee4c-4392-a1ea-f33959280632"}]: dispatch 2023-07-21T22:12:22.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:12:22.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:12:22.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69ea6be1-ee4c-4392-a1ea-f33959280632"}]': finished 2023-07-21T22:12:22.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: osdmap e22: 4 total, 3 up, 4 in 2023-07-21T22:12:22.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:22.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:12:22.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:12:22.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:12:22.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:22 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1120028310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:12:22.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3429056588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69ea6be1-ee4c-4392-a1ea-f33959280632"}]: dispatch 2023-07-21T22:12:22.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:22.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-21T22:12:22.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:12:22.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69ea6be1-ee4c-4392-a1ea-f33959280632"}]: dispatch 2023-07-21T22:12:22.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:12:22.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:12:22.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69ea6be1-ee4c-4392-a1ea-f33959280632"}]': finished 2023-07-21T22:12:22.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: osdmap e22: 4 total, 3 up, 4 in 2023-07-21T22:12:22.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:22.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:12:22.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:12:22.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:12:22.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:22 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1120028310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:12:22.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3429056588' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69ea6be1-ee4c-4392-a1ea-f33959280632"}]: dispatch 2023-07-21T22:12:22.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:22.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-21T22:12:22.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:12:22.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "69ea6be1-ee4c-4392-a1ea-f33959280632"}]: dispatch 2023-07-21T22:12:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:12:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:12:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "69ea6be1-ee4c-4392-a1ea-f33959280632"}]': finished 2023-07-21T22:12:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: osdmap e22: 4 total, 3 up, 4 in 2023-07-21T22:12:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:12:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:12:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:12:22.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1120028310' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:12:23.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 sudo[104427]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2023-07-21T22:12:23.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 sudo[104427]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:23.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 sudo[104427]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:23.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:22 smithi187 sudo[104427]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:23.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:23 smithi151 ceph-mon[95510]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-21T22:12:23.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:23 smithi151 ceph-mon[95510]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-21T22:12:23.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:12:23.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:12:23.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:12:23.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:23 smithi187 sudo[104430]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2023-07-21T22:12:23.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:23 smithi187 sudo[104430]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2023-07-21T22:12:23.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:23 smithi187 sudo[104430]: pam_unix(sudo:session): session opened for user root by (uid=0) 2023-07-21T22:12:23.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:23 smithi187 sudo[104430]: pam_unix(sudo:session): session closed for user root 2023-07-21T22:12:23.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:23 smithi187 ceph-mon[96918]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-21T22:12:23.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:23 smithi187 ceph-mon[96918]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-21T22:12:23.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:12:23.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:12:23.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:12:23.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:23 smithi195 ceph-mon[97365]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-21T22:12:23.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:23 smithi195 ceph-mon[97365]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-21T22:12:23.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:12:23.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:12:23.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:12:24.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:24 smithi151 ceph-mon[95510]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-21T22:12:24.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:24 smithi151 ceph-mon[95510]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:24.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:24 smithi151 ceph-mon[95510]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-21T22:12:24.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:24 smithi187 ceph-mon[96918]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-21T22:12:24.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:24 smithi187 ceph-mon[96918]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:24.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:24 smithi187 ceph-mon[96918]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-21T22:12:24.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:24 smithi195 ceph-mon[97365]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2023-07-21T22:12:24.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:24 smithi195 ceph-mon[97365]: pgmap v92: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:24.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:24 smithi195 ceph-mon[97365]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2023-07-21T22:12:26.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:26 smithi151 ceph-mon[95510]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:26.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:26 smithi187 ceph-mon[96918]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:26.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:26 smithi195 ceph-mon[97365]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:28.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:28 smithi151 ceph-mon[95510]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-07-21T22:12:28.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:28 smithi187 ceph-mon[96918]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-07-21T22:12:28.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:28 smithi195 ceph-mon[97365]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2023-07-21T22:12:29.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:29 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-21T22:12:29.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:29 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:29.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:29 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-21T22:12:29.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:29 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:29.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:29 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2023-07-21T22:12:29.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:29 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:30.319 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:30 smithi151 ceph-mon[95510]: Deploying daemon osd.3 on smithi151 2023-07-21T22:12:30.319 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:30 smithi151 ceph-mon[95510]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-07-21T22:12:30.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:30 smithi187 ceph-mon[96918]: Deploying daemon osd.3 on smithi151 2023-07-21T22:12:30.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:30 smithi187 ceph-mon[96918]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-07-21T22:12:30.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:30 smithi195 ceph-mon[97365]: Deploying daemon osd.3 on smithi151 2023-07-21T22:12:30.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:30 smithi195 ceph-mon[97365]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2023-07-21T22:12:32.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:32 smithi151 ceph-mon[95510]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-07-21T22:12:32.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:32 smithi187 ceph-mon[96918]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-07-21T22:12:32.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:32 smithi195 ceph-mon[97365]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2023-07-21T22:12:34.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:34 smithi151 ceph-mon[95510]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 875 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-21T22:12:34.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:34 smithi187 ceph-mon[96918]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 875 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-21T22:12:34.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:34 smithi195 ceph-mon[97365]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 875 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-21T22:12:36.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:36 smithi187 ceph-mon[96918]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-21T22:12:36.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:36.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:36.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:36.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:36 smithi195 ceph-mon[97365]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-21T22:12:36.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:36.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:36.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:36.413 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:36 smithi151 ceph-mon[95510]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-21T22:12:36.413 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:36.413 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:36.413 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:38 smithi195 ceph-mon[97365]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-21T22:12:38.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:38 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:38 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:38 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:38.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:38 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:38.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:38 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:38 smithi151 ceph-mon[95510]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-21T22:12:38.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:38 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:38 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:38 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:38.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:38 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:38.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:38 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:38 smithi187 ceph-mon[96918]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2023-07-21T22:12:38.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:38 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:38 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:38 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:38.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:38 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:38.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:38 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:38.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.699+0000 7f2b86ffd700 1 -- 172.21.15.151:0/897374743 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2b90060950 con 0x7f2b7c0a10c0 2023-07-21T22:12:38.742 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 3 on host 'smithi151' 2023-07-21T22:12:38.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2b7c0a10c0 msgr2=0x7f2b7c0a3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2b7c0a10c0 0x7f2b7c0a3570 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2b80009b30 tx=0x7f2b80009260 comp rx=0 tx=0).stop 2023-07-21T22:12:38.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 msgr2=0x7f2b901979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:38.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 0x7f2b901979a0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0059d0 tx=0x7f2b8c005ef0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 shutdown_connections 2023-07-21T22:12:38.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2b7c0a10c0 0x7f2b7c0a3570 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b90103950 0x7f2b9019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2b90101dc0 0x7f2b901979a0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 --2- 172.21.15.151:0/897374743 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2b90102fc0 0x7f2b90197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:38.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 >> 172.21.15.151:0/897374743 conn(0x7f2b900fd410 msgr2=0x7f2b90106550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:38.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 shutdown_connections 2023-07-21T22:12:38.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:12:38.701+0000 7f2b97b26700 1 -- 172.21.15.151:0/897374743 wait complete. 2023-07-21T22:12:39.253 DEBUG:teuthology.orchestra.run.smithi151:osd.3> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.3.service 2023-07-21T22:12:39.259 INFO:tasks.cephadm:Deploying osd.4 on smithi187 with /dev/vg_nvme/lv_3... 2023-07-21T22:12:39.259 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-21T22:12:39.349 INFO:journalctl@ceph.osd.3.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:12:39.957 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:39.957 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:39.958 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:39.958 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:39 smithi151 ceph-mon[95510]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:39.958 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:39 smithi151 ceph-mon[95510]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-21T22:12:40.003 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T22:12:40.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:40.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:40.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:40.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:39 smithi187 ceph-mon[96918]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:40.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:39 smithi187 ceph-mon[96918]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-21T22:12:40.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:40.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:12:40.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:40.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:39 smithi195 ceph-mon[97365]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:40.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:39 smithi195 ceph-mon[97365]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2023-07-21T22:12:40.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:40 smithi187 ceph-mon[96918]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-21T22:12:40.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:40 smithi187 ceph-mon[96918]: osdmap e23: 4 total, 3 up, 4 in 2023-07-21T22:12:40.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:40 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:40.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:40 smithi187 ceph-mon[96918]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:12:41.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:40 smithi195 ceph-mon[97365]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-21T22:12:41.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:40 smithi195 ceph-mon[97365]: osdmap e23: 4 total, 3 up, 4 in 2023-07-21T22:12:41.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:40 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:41.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:40 smithi195 ceph-mon[97365]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:12:41.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:40 smithi151 ceph-mon[95510]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2023-07-21T22:12:41.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:40 smithi151 ceph-mon[95510]: osdmap e23: 4 total, 3 up, 4 in 2023-07-21T22:12:41.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:40 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:41.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:40 smithi151 ceph-mon[95510]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:12:41.198 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 22:12:40 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-3[114027]: 2023-07-21T22:12:40.679+0000 7ff603af5700 -1 osd.3 0 waiting for initial osdmap 2023-07-21T22:12:41.198 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 22:12:40 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-3[114027]: 2023-07-21T22:12:40.686+0000 7ff5ff8ea700 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:12:41.886 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:41 smithi151 ceph-mon[95510]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:12:41.886 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:41 smithi151 ceph-mon[95510]: osdmap e24: 4 total, 3 up, 4 in 2023-07-21T22:12:41.887 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:41 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:41.887 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:41 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:41.887 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:41 smithi151 ceph-mon[95510]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:41.887 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:41 smithi151 ceph-mon[95510]: osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] boot 2023-07-21T22:12:41.887 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:41 smithi151 ceph-mon[95510]: osdmap e25: 4 total, 4 up, 4 in 2023-07-21T22:12:41.887 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:41 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:41.973 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-21T22:12:41.973 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-21T22:12:41.974 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2023-07-21T22:12:41.974 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2023-07-21T22:12:41.974 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0500517 s, 209 MB/s 2023-07-21T22:12:41.974 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2023-07-21T22:12:42.011 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:41 smithi187 ceph-mon[96918]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:12:42.011 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:41 smithi187 ceph-mon[96918]: osdmap e24: 4 total, 3 up, 4 in 2023-07-21T22:12:42.011 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:41 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:42.011 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:41 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:42.011 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:41 smithi187 ceph-mon[96918]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:42.012 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:41 smithi187 ceph-mon[96918]: osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] boot 2023-07-21T22:12:42.012 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:41 smithi187 ceph-mon[96918]: osdmap e25: 4 total, 4 up, 4 in 2023-07-21T22:12:42.012 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:41 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:42.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:41 smithi195 ceph-mon[97365]: from='osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:12:42.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:41 smithi195 ceph-mon[97365]: osdmap e24: 4 total, 3 up, 4 in 2023-07-21T22:12:42.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:41 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:42.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:41 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:42.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:41 smithi195 ceph-mon[97365]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 80 MiB used, 268 GiB / 268 GiB avail 2023-07-21T22:12:42.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:41 smithi195 ceph-mon[97365]: osd.3 [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] boot 2023-07-21T22:12:42.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:41 smithi195 ceph-mon[97365]: osdmap e25: 4 total, 4 up, 4 in 2023-07-21T22:12:42.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:41 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:12:42.471 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi187:vg_nvme/lv_3 2023-07-21T22:12:43.190 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T22:12:43.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:12:43.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:12:43.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi151 2023-07-21T22:12:43.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:12:43.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:12:43.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 8633M 2023-07-21T22:12:43.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:43.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:43.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:42 smithi187 ceph-mon[96918]: osdmap e26: 4 total, 4 up, 4 in 2023-07-21T22:12:43.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:12:43.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:12:43.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi151 2023-07-21T22:12:43.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:12:43.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:12:43.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 8633M 2023-07-21T22:12:43.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:43.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:43.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:42 smithi195 ceph-mon[97365]: osdmap e26: 4 total, 4 up, 4 in 2023-07-21T22:12:43.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:12:43.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:12:43.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi151 2023-07-21T22:12:43.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:12:43.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:12:43.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 8633M 2023-07-21T22:12:43.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:43.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:12:43.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:12:43.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:42 smithi151 ceph-mon[95510]: osdmap e26: 4 total, 4 up, 4 in 2023-07-21T22:12:44.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:44 smithi187 ceph-mon[96918]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:44.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:44 smithi187 ceph-mon[96918]: osdmap e27: 4 total, 4 up, 4 in 2023-07-21T22:12:44.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:44 smithi195 ceph-mon[97365]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:44.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:44 smithi195 ceph-mon[97365]: osdmap e27: 4 total, 4 up, 4 in 2023-07-21T22:12:44.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:44 smithi151 ceph-mon[95510]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:44.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:44 smithi151 ceph-mon[95510]: osdmap e27: 4 total, 4 up, 4 in 2023-07-21T22:12:44.668 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.624+0000 7f2969cc3700 1 -- 172.21.15.187:0/3285773461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 msgr2=0x7f29640fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.668 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.624+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3285773461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 0x7f29640fffa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2954009990 tx=0x7f2954009ca0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.668 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.624+0000 7f2969cc3700 1 -- 172.21.15.187:0/3285773461 shutdown_connections 2023-07-21T22:12:44.669 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.624+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3285773461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 0x7f29640fffa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.669 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.624+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3285773461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2964101720 0x7f2964107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.669 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.624+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3285773461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964100d90 0x7f29641011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.669 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.624+0000 7f2969cc3700 1 -- 172.21.15.187:0/3285773461 >> 172.21.15.187:0/3285773461 conn(0x7f29640fb1a0 msgr2=0x7f29640fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:12:44.669 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.624+0000 7f2969cc3700 1 -- 172.21.15.187:0/3285773461 shutdown_connections 2023-07-21T22:12:44.669 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.624+0000 7f2969cc3700 1 -- 172.21.15.187:0/3285773461 wait complete. 2023-07-21T22:12:44.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.625+0000 7f2969cc3700 1 Processor -- start 2023-07-21T22:12:44.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f2969cc3700 1 -- start start 2023-07-21T22:12:44.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f2969cc3700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 0x7f2964195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f2969cc3700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2964100d90 0x7f2964195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f2969cc3700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964101720 0x7f296419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.671 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f2969cc3700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419d400 con 0x7f2964101720 2023-07-21T22:12:44.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f2969cc3700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419d540 con 0x7f29640ffb90 2023-07-21T22:12:44.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f2969cc3700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296419d6d0 con 0x7f2964100d90 2023-07-21T22:12:44.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f29637fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 0x7f2964195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f29637fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 0x7f2964195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:51236/0 (socket says 172.21.15.187:51236) 2023-07-21T22:12:44.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f29637fe700 1 -- 172.21.15.187:0/3369636546 learned_addr learned my addr 172.21.15.187:0/3369636546 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-07-21T22:12:44.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f2962ffd700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2964100d90 0x7f2964195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.672 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.626+0000 7f2963fff700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964101720 0x7f296419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f29637fe700 1 -- 172.21.15.187:0/3369636546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2964100d90 msgr2=0x7f2964195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f29637fe700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2964100d90 0x7f2964195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f29637fe700 1 -- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964101720 msgr2=0x7f296419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:12:44.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f29637fe700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964101720 0x7f296419ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:12:44.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f29637fe700 1 -- 172.21.15.187:0/3369636546 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540095f0 con 0x7f29640ffb90 2023-07-21T22:12:44.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f2963fff700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964101720 0x7f296419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:12:44.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f29637fe700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 0x7f2964195870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f29540095c0 tx=0x7f2954005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.673 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f2960ff9700 1 -- 172.21.15.187:0/3369636546 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295401d070 con 0x7f29640ffb90 2023-07-21T22:12:44.674 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f2960ff9700 1 -- 172.21.15.187:0/3369636546 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2954004000 con 0x7f29640ffb90 2023-07-21T22:12:44.674 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f2960ff9700 1 -- 172.21.15.187:0/3369636546 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954022bc0 con 0x7f29640ffb90 2023-07-21T22:12:44.674 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f296419d950 con 0x7f29640ffb90 2023-07-21T22:12:44.674 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.627+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296419dd90 con 0x7f29640ffb90 2023-07-21T22:12:44.674 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.628+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2964107260 con 0x7f29640ffb90 2023-07-21T22:12:44.675 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.630+0000 7f2960ff9700 1 -- 172.21.15.187:0/3369636546 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2954003b70 con 0x7f29640ffb90 2023-07-21T22:12:44.675 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.632+0000 7f2960ff9700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f294c0a1150 0x7f294c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:12:44.676 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.632+0000 7f2960ff9700 1 -- 172.21.15.187:0/3369636546 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3669+0+0 (secure 0 0 0) 0x7f29540ccd30 con 0x7f29640ffb90 2023-07-21T22:12:44.676 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.633+0000 7f2962ffd700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f294c0a1150 0x7f294c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:12:44.676 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.633+0000 7f2962ffd700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f294c0a1150 0x7f294c0a3600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2958005950 tx=0x7f295800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:12:44.680 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.637+0000 7f2960ff9700 1 -- 172.21.15.187:0/3369636546 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2954097690 con 0x7f29640ffb90 2023-07-21T22:12:44.880 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:12:44.837+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f2964060950 con 0x7f294c0a1150 2023-07-21T22:12:45.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:45 smithi151 ceph-mon[95510]: osdmap e28: 4 total, 4 up, 4 in 2023-07-21T22:12:45.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:12:45.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:12:45.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:45.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:45 smithi187 ceph-mon[96918]: osdmap e28: 4 total, 4 up, 4 in 2023-07-21T22:12:45.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:12:45.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:12:45.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:45.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:45 smithi195 ceph-mon[97365]: osdmap e28: 4 total, 4 up, 4 in 2023-07-21T22:12:45.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:12:45.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:12:45.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:46.290 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:46 smithi187 ceph-mon[96918]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:46.291 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:46 smithi187 ceph-mon[96918]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:12:46.291 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:46 smithi187 ceph-mon[96918]: osdmap e29: 4 total, 4 up, 4 in 2023-07-21T22:12:46.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:46 smithi151 ceph-mon[95510]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:46.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:46 smithi151 ceph-mon[95510]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:12:46.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:46 smithi151 ceph-mon[95510]: osdmap e29: 4 total, 4 up, 4 in 2023-07-21T22:12:46.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:46 smithi195 ceph-mon[97365]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:46.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:46 smithi195 ceph-mon[97365]: from='client.24224 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:12:46.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:46 smithi195 ceph-mon[97365]: osdmap e29: 4 total, 4 up, 4 in 2023-07-21T22:12:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:48 smithi151 ceph-mon[95510]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2023-07-21T22:12:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:48 smithi151 ceph-mon[95510]: from='client.? 172.21.15.187:0/847757391' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fb10c73-994e-456d-8b9d-6f73960469df"}]: dispatch 2023-07-21T22:12:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:48 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fb10c73-994e-456d-8b9d-6f73960469df"}]: dispatch 2023-07-21T22:12:48.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:48 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fb10c73-994e-456d-8b9d-6f73960469df"}]': finished 2023-07-21T22:12:48.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:48 smithi151 ceph-mon[95510]: osdmap e30: 5 total, 4 up, 5 in 2023-07-21T22:12:48.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:12:48.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:48 smithi187 ceph-mon[96918]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2023-07-21T22:12:48.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:48 smithi187 ceph-mon[96918]: from='client.? 172.21.15.187:0/847757391' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fb10c73-994e-456d-8b9d-6f73960469df"}]: dispatch 2023-07-21T22:12:48.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:48 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fb10c73-994e-456d-8b9d-6f73960469df"}]: dispatch 2023-07-21T22:12:48.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:48 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fb10c73-994e-456d-8b9d-6f73960469df"}]': finished 2023-07-21T22:12:48.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:48 smithi187 ceph-mon[96918]: osdmap e30: 5 total, 4 up, 5 in 2023-07-21T22:12:48.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:12:48.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:48 smithi195 ceph-mon[97365]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 123 KiB/s, 0 objects/s recovering 2023-07-21T22:12:48.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:48 smithi195 ceph-mon[97365]: from='client.? 172.21.15.187:0/847757391' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fb10c73-994e-456d-8b9d-6f73960469df"}]: dispatch 2023-07-21T22:12:48.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:48 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9fb10c73-994e-456d-8b9d-6f73960469df"}]: dispatch 2023-07-21T22:12:48.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:48 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9fb10c73-994e-456d-8b9d-6f73960469df"}]': finished 2023-07-21T22:12:48.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:48 smithi195 ceph-mon[97365]: osdmap e30: 5 total, 4 up, 5 in 2023-07-21T22:12:48.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:12:49.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:49 smithi151 ceph-mon[95510]: from='client.? 172.21.15.187:0/1320487717' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:12:49.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:49 smithi187 ceph-mon[96918]: from='client.? 172.21.15.187:0/1320487717' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:12:49.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:49 smithi195 ceph-mon[97365]: from='client.? 172.21.15.187:0/1320487717' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:12:50.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:50 smithi151 ceph-mon[95510]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2023-07-21T22:12:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:50 smithi187 ceph-mon[96918]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2023-07-21T22:12:50.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:50 smithi195 ceph-mon[97365]: pgmap v113: 1 pgs: 1 peering; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 101 KiB/s, 0 objects/s recovering 2023-07-21T22:12:52.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:52 smithi151 ceph-mon[95510]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-07-21T22:12:52.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:52 smithi187 ceph-mon[96918]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-07-21T22:12:52.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:52 smithi195 ceph-mon[97365]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 86 KiB/s, 0 objects/s recovering 2023-07-21T22:12:54.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:54 smithi151 ceph-mon[95510]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-21T22:12:54.470 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:54 smithi187 ceph-mon[96918]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-21T22:12:54.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:54 smithi195 ceph-mon[97365]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-21T22:12:56.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:56 smithi151 ceph-mon[95510]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:56.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:56 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-21T22:12:56.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:56 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:56.455 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:56 smithi187 ceph-mon[96918]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:56.455 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:56 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-21T22:12:56.455 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:56 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:56.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:56 smithi195 ceph-mon[97365]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:56.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:56 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2023-07-21T22:12:56.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:56 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:12:57.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:57 smithi187 ceph-mon[96918]: Deploying daemon osd.4 on smithi187 2023-07-21T22:12:57.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:57 smithi195 ceph-mon[97365]: Deploying daemon osd.4 on smithi187 2023-07-21T22:12:57.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:57 smithi151 ceph-mon[95510]: Deploying daemon osd.4 on smithi187 2023-07-21T22:12:58.510 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:12:58 smithi187 ceph-mon[96918]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:58.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:12:58 smithi195 ceph-mon[97365]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:12:58.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:12:58 smithi151 ceph-mon[95510]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:00.466 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:00 smithi187 ceph-mon[96918]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:00.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:00 smithi195 ceph-mon[97365]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:00.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:00 smithi151 ceph-mon[95510]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:02.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:02 smithi187 ceph-mon[96918]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:02.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:02.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:02.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:02.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:02 smithi195 ceph-mon[97365]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:02.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:02.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:02.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:02.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:02 smithi151 ceph-mon[95510]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:04.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:04 smithi187 ceph-mon[96918]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:04.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:04 smithi195 ceph-mon[97365]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:04.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:04 smithi151 ceph-mon[95510]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:05.555 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.513+0000 7f2960ff9700 1 -- 172.21.15.187:0/3369636546 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f2964060950 con 0x7f294c0a1150 2023-07-21T22:13:05.556 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 4 on host 'smithi187' 2023-07-21T22:13:05.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.515+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f294c0a1150 msgr2=0x7f294c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:05.558 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f294c0a1150 0x7f294c0a3600 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2958005950 tx=0x7f295800b410 comp rx=0 tx=0).stop 2023-07-21T22:13:05.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 msgr2=0x7f2964195870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:05.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 0x7f2964195870 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f29540095c0 tx=0x7f2954005740 comp rx=0 tx=0).stop 2023-07-21T22:13:05.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 shutdown_connections 2023-07-21T22:13:05.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f294c0a1150 0x7f294c0a3600 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:05.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29640ffb90 0x7f2964195870 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:05.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964101720 0x7f296419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:05.559 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 --2- 172.21.15.187:0/3369636546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2964100d90 0x7f2964195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:05.560 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 >> 172.21.15.187:0/3369636546 conn(0x7f29640fb1a0 msgr2=0x7f29641043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:05.560 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 shutdown_connections 2023-07-21T22:13:05.560 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:13:05.516+0000 7f2969cc3700 1 -- 172.21.15.187:0/3369636546 wait complete. 2023-07-21T22:13:05.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:05 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:05 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.739 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:05 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:05 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:05 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.740 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:05 smithi187 ceph-mon[96918]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:05.741 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:05 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:05 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:05 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:05 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:05.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:05 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:05.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:05 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:05 smithi195 ceph-mon[97365]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:05.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:05 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:05.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:05.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:05.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:05 smithi151 ceph-mon[95510]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:05.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:06.010 DEBUG:teuthology.orchestra.run.smithi187:osd.4> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.4.service 2023-07-21T22:13:06.015 INFO:tasks.cephadm:Deploying osd.5 on smithi195 with /dev/vg_nvme/lv_3... 2023-07-21T22:13:06.015 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2023-07-21T22:13:06.091 INFO:journalctl@ceph.osd.4.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:13:06.762 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:13:06.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:06 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:06.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:06 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:06.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:06 smithi187 ceph-mon[96918]: from='osd.4 [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-21T22:13:06.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:06 smithi187 ceph-mon[96918]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-21T22:13:06.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:06 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:06.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:06 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:06.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:06 smithi195 ceph-mon[97365]: from='osd.4 [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-21T22:13:06.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:06 smithi195 ceph-mon[97365]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-21T22:13:06.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:06 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:06.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:06 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:06.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:06 smithi151 ceph-mon[95510]: from='osd.4 [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-21T22:13:06.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:06 smithi151 ceph-mon[95510]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2023-07-21T22:13:07.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:07 smithi195 ceph-mon[97365]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-21T22:13:07.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:07 smithi195 ceph-mon[97365]: osdmap e31: 5 total, 4 up, 5 in 2023-07-21T22:13:07.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:07 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:07.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:07 smithi195 ceph-mon[97365]: from='osd.4 [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:13:07.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:07 smithi195 ceph-mon[97365]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:13:07.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:07 smithi195 ceph-mon[97365]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:07.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:07 smithi187 ceph-mon[96918]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-21T22:13:07.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:07 smithi187 ceph-mon[96918]: osdmap e31: 5 total, 4 up, 5 in 2023-07-21T22:13:07.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:07 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:07.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:07 smithi187 ceph-mon[96918]: from='osd.4 [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:13:07.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:07 smithi187 ceph-mon[96918]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:13:07.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:07 smithi187 ceph-mon[96918]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:07.879 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 22:13:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T22:13:07.535+0000 7fb178b72700 -1 osd.4 0 waiting for initial osdmap 2023-07-21T22:13:07.880 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 22:13:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T22:13:07.543+0000 7fb17095f700 -1 osd.4 32 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:13:07.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:07 smithi151 ceph-mon[95510]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2023-07-21T22:13:07.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:07 smithi151 ceph-mon[95510]: osdmap e31: 5 total, 4 up, 5 in 2023-07-21T22:13:07.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:07 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:07.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:07 smithi151 ceph-mon[95510]: from='osd.4 [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:13:07.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:07 smithi151 ceph-mon[95510]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:13:07.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:07 smithi151 ceph-mon[95510]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:08.696 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_3 2023-07-21T22:13:08.696 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2023-07-21T22:13:08.696 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-07-21T22:13:08.696 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-07-21T22:13:08.697 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0385445 s, 272 MB/s 2023-07-21T22:13:08.697 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-07-21T22:13:08.774 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:08 smithi187 ceph-mon[96918]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:13:08.774 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:08 smithi187 ceph-mon[96918]: osdmap e32: 5 total, 4 up, 5 in 2023-07-21T22:13:08.775 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:08.775 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:08.852 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:08 smithi195 ceph-mon[97365]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:13:08.852 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:08 smithi195 ceph-mon[97365]: osdmap e32: 5 total, 4 up, 5 in 2023-07-21T22:13:08.852 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:08.852 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:08.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:08 smithi151 ceph-mon[95510]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:13:08.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:08 smithi151 ceph-mon[95510]: osdmap e32: 5 total, 4 up, 5 in 2023-07-21T22:13:08.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:08.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:09.137 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_3 2023-07-21T22:13:09.859 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:13:09.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:13:09.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:13:09.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: osd.4 [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] boot 2023-07-21T22:13:09.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: osdmap e33: 5 total, 5 up, 5 in 2023-07-21T22:13:09.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:09.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:09.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi187 2023-07-21T22:13:09.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:09.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:09.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 8633M 2023-07-21T22:13:09.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:09.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:09.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:13:09.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:13:09.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: osd.4 [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] boot 2023-07-21T22:13:09.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: osdmap e33: 5 total, 5 up, 5 in 2023-07-21T22:13:09.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:09.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:09.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi187 2023-07-21T22:13:09.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:09.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:09.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 8633M 2023-07-21T22:13:09.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:09.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:09.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:13:09.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:13:09.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: osd.4 [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] boot 2023-07-21T22:13:09.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: osdmap e33: 5 total, 5 up, 5 in 2023-07-21T22:13:09.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:13:09.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 106 MiB used, 358 GiB / 358 GiB avail 2023-07-21T22:13:09.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi187 2023-07-21T22:13:09.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:09.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:09.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 8633M 2023-07-21T22:13:09.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:09.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:09.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:09.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:10.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:10 smithi195 ceph-mon[97365]: osdmap e34: 5 total, 5 up, 5 in 2023-07-21T22:13:10.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:10 smithi187 ceph-mon[96918]: osdmap e34: 5 total, 5 up, 5 in 2023-07-21T22:13:10.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:10 smithi151 ceph-mon[95510]: osdmap e34: 5 total, 5 up, 5 in 2023-07-21T22:13:11.222 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.179+0000 7fd9fcb07700 1 -- 172.21.15.195:0/533241963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f8101720 msgr2=0x7fd9f8107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.222 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.179+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/533241963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f8101720 0x7fd9f8107fe0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd9f000b0a0 tx=0x7fd9f000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.223 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.179+0000 7fd9fcb07700 1 -- 172.21.15.195:0/533241963 shutdown_connections 2023-07-21T22:13:11.223 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.179+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/533241963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f8101720 0x7fd9f8107fe0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.223 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.179+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/533241963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9f80ffb90 0x7fd9f80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.223 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.179+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/533241963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9f8100d90 0x7fd9f81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.223 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.179+0000 7fd9fcb07700 1 -- 172.21.15.195:0/533241963 >> 172.21.15.195:0/533241963 conn(0x7fd9f80fb1a0 msgr2=0x7fd9f80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:11.223 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.179+0000 7fd9fcb07700 1 -- 172.21.15.195:0/533241963 shutdown_connections 2023-07-21T22:13:11.223 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.179+0000 7fd9fcb07700 1 -- 172.21.15.195:0/533241963 wait complete. 2023-07-21T22:13:11.225 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.180+0000 7fd9fcb07700 1 Processor -- start 2023-07-21T22:13:11.225 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.180+0000 7fd9fcb07700 1 -- start start 2023-07-21T22:13:11.227 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.180+0000 7fd9fcb07700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f80ffb90 0x7fd9f8197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.227 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.180+0000 7fd9fcb07700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9f8100d90 0x7fd9f8198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.227 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.180+0000 7fd9fcb07700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9f8101720 0x7fd9f819f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.227 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.180+0000 7fd9fcb07700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f819f670 con 0x7fd9f8101720 2023-07-21T22:13:11.227 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.180+0000 7fd9fcb07700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f819f7b0 con 0x7fd9f8100d90 2023-07-21T22:13:11.227 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.180+0000 7fd9fcb07700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9f819f940 con 0x7fd9f80ffb90 2023-07-21T22:13:11.228 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f80ffb90 0x7fd9f8197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.228 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f80ffb90 0x7fd9f8197ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:34254/0 (socket says 172.21.15.195:34254) 2023-07-21T22:13:11.228 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f659c700 1 -- 172.21.15.195:0/3183645320 learned_addr learned my addr 172.21.15.195:0/3183645320 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:13:11.229 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f6d9d700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9f8101720 0x7fd9f819f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.229 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f5d9b700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9f8100d90 0x7fd9f8198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.229 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f659c700 1 -- 172.21.15.195:0/3183645320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9f8100d90 msgr2=0x7fd9f8198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.229 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f659c700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9f8100d90 0x7fd9f8198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.229 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f659c700 1 -- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9f8101720 msgr2=0x7fd9f819f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:11.229 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f659c700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9f8101720 0x7fd9f819f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:11.230 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f659c700 1 -- 172.21.15.195:0/3183645320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f0009d00 con 0x7fd9f80ffb90 2023-07-21T22:13:11.230 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.181+0000 7fd9f659c700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f80ffb90 0x7fd9f8197ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800e9a0 tx=0x7fd9e800ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:11.230 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.182+0000 7fd9e77fe700 1 -- 172.21.15.195:0/3183645320 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8009790 con 0x7fd9f80ffb90 2023-07-21T22:13:11.230 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.182+0000 7fd9e77fe700 1 -- 172.21.15.195:0/3183645320 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9e800c810 con 0x7fd9f80ffb90 2023-07-21T22:13:11.230 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.182+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9f819fc20 con 0x7fd9f80ffb90 2023-07-21T22:13:11.230 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.182+0000 7fd9e77fe700 1 -- 172.21.15.195:0/3183645320 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9e8003bd0 con 0x7fd9f80ffb90 2023-07-21T22:13:11.230 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.182+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9f81a0170 con 0x7fd9f80ffb90 2023-07-21T22:13:11.231 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.183+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9f81920d0 con 0x7fd9f80ffb90 2023-07-21T22:13:11.231 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.185+0000 7fd9e77fe700 1 -- 172.21.15.195:0/3183645320 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd9e800c980 con 0x7fd9f80ffb90 2023-07-21T22:13:11.232 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.186+0000 7fd9e77fe700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9e00a11d0 0x7fd9e00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:11.232 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.186+0000 7fd9e77fe700 1 -- 172.21.15.195:0/3183645320 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 4101+0+0 (secure 0 0 0) 0x7fd9e8014070 con 0x7fd9f80ffb90 2023-07-21T22:13:11.232 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.187+0000 7fd9f5d9b700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9e00a11d0 0x7fd9e00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:11.232 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.187+0000 7fd9f5d9b700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9e00a11d0 0x7fd9e00a3680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec007be0 tx=0x7fd9ec0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:11.233 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.190+0000 7fd9e77fe700 1 -- 172.21.15.195:0/3183645320 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd9e8096170 con 0x7fd9f80ffb90 2023-07-21T22:13:11.437 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:11.394+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7fd9f8060950 con 0x7fd9e00a11d0 2023-07-21T22:13:12.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:12 smithi195 ceph-mon[97365]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:12.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:12 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:13:12.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:12 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:13:12.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:12 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:12.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:12 smithi151 ceph-mon[95510]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:12.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:12 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:13:12.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:12 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:13:12.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:12 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:12.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:12 smithi187 ceph-mon[96918]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:12.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:12 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:13:12.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:12 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:13:12.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:12 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:13.367 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:13 smithi195 ceph-mon[97365]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:13:13.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:13 smithi151 ceph-mon[95510]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:13:13.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:13 smithi187 ceph-mon[96918]: from='client.24250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:13:14.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:14 smithi195 ceph-mon[97365]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:14.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:14 smithi151 ceph-mon[95510]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:14.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:14 smithi187 ceph-mon[96918]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:15.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:15 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/999266366' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bc15555-8fb3-4caa-bea9-15460b5d34a5"}]: dispatch 2023-07-21T22:13:15.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:15 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bc15555-8fb3-4caa-bea9-15460b5d34a5"}]: dispatch 2023-07-21T22:13:15.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:15 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bc15555-8fb3-4caa-bea9-15460b5d34a5"}]': finished 2023-07-21T22:13:15.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:15 smithi195 ceph-mon[97365]: osdmap e35: 6 total, 5 up, 6 in 2023-07-21T22:13:15.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:15.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:15 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/3941684928' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:13:15.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:15 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/999266366' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bc15555-8fb3-4caa-bea9-15460b5d34a5"}]: dispatch 2023-07-21T22:13:15.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:15 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bc15555-8fb3-4caa-bea9-15460b5d34a5"}]: dispatch 2023-07-21T22:13:15.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:15 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bc15555-8fb3-4caa-bea9-15460b5d34a5"}]': finished 2023-07-21T22:13:15.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:15 smithi151 ceph-mon[95510]: osdmap e35: 6 total, 5 up, 6 in 2023-07-21T22:13:15.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:15.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:15 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/3941684928' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:13:15.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:15 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/999266366' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bc15555-8fb3-4caa-bea9-15460b5d34a5"}]: dispatch 2023-07-21T22:13:15.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:15 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8bc15555-8fb3-4caa-bea9-15460b5d34a5"}]: dispatch 2023-07-21T22:13:15.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:15 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8bc15555-8fb3-4caa-bea9-15460b5d34a5"}]': finished 2023-07-21T22:13:15.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:15 smithi187 ceph-mon[96918]: osdmap e35: 6 total, 5 up, 6 in 2023-07-21T22:13:15.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:15.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:15 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/3941684928' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:13:16.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:16 smithi187 ceph-mon[96918]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:16.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:16 smithi195 ceph-mon[97365]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:16.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:16 smithi151 ceph-mon[95510]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:18.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:18 smithi187 ceph-mon[96918]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:18.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:18 smithi195 ceph-mon[97365]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:18.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:18 smithi151 ceph-mon[95510]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:20.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:20 smithi187 ceph-mon[96918]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:20.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:20 smithi195 ceph-mon[97365]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:20.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:20 smithi151 ceph-mon[95510]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:22.610 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:22 smithi195 ceph-mon[97365]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:22.610 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-21T22:13:22.610 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:22.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:22 smithi187 ceph-mon[96918]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:22.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-21T22:13:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:22.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:22 smithi151 ceph-mon[95510]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:22.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2023-07-21T22:13:22.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:23.593 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:23 smithi195 ceph-mon[97365]: Deploying daemon osd.5 on smithi195 2023-07-21T22:13:23.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:23 smithi187 ceph-mon[96918]: Deploying daemon osd.5 on smithi195 2023-07-21T22:13:23.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:23 smithi151 ceph-mon[95510]: Deploying daemon osd.5 on smithi195 2023-07-21T22:13:24.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:24 smithi187 ceph-mon[96918]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:24.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:24 smithi195 ceph-mon[97365]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:24.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:24 smithi151 ceph-mon[95510]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:26.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:26 smithi187 ceph-mon[96918]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:26.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:26 smithi195 ceph-mon[97365]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:26.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:26 smithi151 ceph-mon[95510]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:28.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:28 smithi187 ceph-mon[96918]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:28.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:28.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:28.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:28.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:28 smithi195 ceph-mon[97365]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:28.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:28.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:28.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:28.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:28 smithi151 ceph-mon[95510]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:28.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:28.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:28.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:30.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:30 smithi195 ceph-mon[97365]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:30.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:30 smithi187 ceph-mon[96918]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:30.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:30 smithi151 ceph-mon[95510]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:31.362 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.320+0000 7fd9e77fe700 1 -- 172.21.15.195:0/3183645320 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fd9f8060950 con 0x7fd9e00a11d0 2023-07-21T22:13:31.363 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 5 on host 'smithi195' 2023-07-21T22:13:31.365 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9e00a11d0 msgr2=0x7fd9e00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.365 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9e00a11d0 0x7fd9e00a3680 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec007be0 tx=0x7fd9ec0073d0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.365 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f80ffb90 msgr2=0x7fd9f8197ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:31.366 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f80ffb90 0x7fd9f8197ae0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fd9e800e9a0 tx=0x7fd9e800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.366 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 shutdown_connections 2023-07-21T22:13:31.366 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9e00a11d0 0x7fd9e00a3680 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.366 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9f8101720 0x7fd9f819f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.366 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9f80ffb90 0x7fd9f8197ae0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.367 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 --2- 172.21.15.195:0/3183645320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9f8100d90 0x7fd9f8198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:31.367 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.322+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 >> 172.21.15.195:0/3183645320 conn(0x7fd9f80fb1a0 msgr2=0x7fd9f81066d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:31.367 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.323+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 shutdown_connections 2023-07-21T22:13:31.367 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:13:31.323+0000 7fd9fcb07700 1 -- 172.21.15.195:0/3183645320 wait complete. 2023-07-21T22:13:31.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:31.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:31.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:31 smithi195 ceph-mon[97365]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:31.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:31.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:31.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:31.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:31 smithi151 ceph-mon[95510]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:31.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:31.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.787 DEBUG:teuthology.orchestra.run.smithi195:osd.5> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.5.service 2023-07-21T22:13:31.792 INFO:tasks.cephadm:Deploying osd.6 on smithi151 with /dev/vg_nvme/lv_2... 2023-07-21T22:13:31.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-21T22:13:31.869 INFO:journalctl@ceph.osd.5.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:13:31.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:31.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:31.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:31 smithi187 ceph-mon[96918]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:31.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:31.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:31.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:32.524 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:13:32.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:32 smithi151 ceph-mon[95510]: from='osd.5 [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-21T22:13:32.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:32 smithi151 ceph-mon[95510]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-21T22:13:32.698 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:32 smithi195 ceph-mon[97365]: from='osd.5 [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-21T22:13:32.698 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:32 smithi195 ceph-mon[97365]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-21T22:13:32.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:32 smithi187 ceph-mon[96918]: from='osd.5 [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-21T22:13:32.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:32 smithi187 ceph-mon[96918]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2023-07-21T22:13:33.655 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 22:13:33 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T22:13:33.407+0000 7fa54a662700 -1 osd.5 0 waiting for initial osdmap 2023-07-21T22:13:33.655 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 22:13:33 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T22:13:33.416+0000 7fa544453700 -1 osd.5 37 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:13:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:33 smithi195 ceph-mon[97365]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-21T22:13:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:33 smithi195 ceph-mon[97365]: osdmap e36: 6 total, 5 up, 6 in 2023-07-21T22:13:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:33 smithi195 ceph-mon[97365]: from='osd.5 [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:13:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:33 smithi195 ceph-mon[97365]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:13:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:33 smithi195 ceph-mon[97365]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:33.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:33 smithi151 ceph-mon[95510]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-21T22:13:33.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:33 smithi151 ceph-mon[95510]: osdmap e36: 6 total, 5 up, 6 in 2023-07-21T22:13:33.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:33.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:33 smithi151 ceph-mon[95510]: from='osd.5 [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:13:33.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:33 smithi151 ceph-mon[95510]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:13:33.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:33 smithi151 ceph-mon[95510]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:33.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:33 smithi187 ceph-mon[96918]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2023-07-21T22:13:33.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:33 smithi187 ceph-mon[96918]: osdmap e36: 6 total, 5 up, 6 in 2023-07-21T22:13:33.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:33 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:33.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:33 smithi187 ceph-mon[96918]: from='osd.5 [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:13:33.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:33 smithi187 ceph-mon[96918]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:13:33.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:33 smithi187 ceph-mon[96918]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 447 GiB / 447 GiB avail 2023-07-21T22:13:34.455 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-21T22:13:34.456 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-21T22:13:34.456 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2023-07-21T22:13:34.456 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2023-07-21T22:13:34.456 INFO:teuthology.orchestra.run.smithi151.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0323698 s, 324 MB/s 2023-07-21T22:13:34.457 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2023-07-21T22:13:34.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:34 smithi151 ceph-mon[95510]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:13:34.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:34 smithi151 ceph-mon[95510]: osdmap e37: 6 total, 5 up, 6 in 2023-07-21T22:13:34.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:34 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:34.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:34 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:34.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:34 smithi151 ceph-mon[95510]: osd.5 [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] boot 2023-07-21T22:13:34.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:34 smithi151 ceph-mon[95510]: osdmap e38: 6 total, 6 up, 6 in 2023-07-21T22:13:34.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:34 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:34.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:34 smithi187 ceph-mon[96918]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:13:34.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:34 smithi187 ceph-mon[96918]: osdmap e37: 6 total, 5 up, 6 in 2023-07-21T22:13:34.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:34 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:34.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:34 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:34.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:34 smithi187 ceph-mon[96918]: osd.5 [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] boot 2023-07-21T22:13:34.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:34 smithi187 ceph-mon[96918]: osdmap e38: 6 total, 6 up, 6 in 2023-07-21T22:13:34.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:34 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:34.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:34 smithi195 ceph-mon[97365]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:13:34.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:34 smithi195 ceph-mon[97365]: osdmap e37: 6 total, 5 up, 6 in 2023-07-21T22:13:34.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:34 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:34.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:34 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:34.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:34 smithi195 ceph-mon[97365]: osd.5 [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] boot 2023-07-21T22:13:34.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:34 smithi195 ceph-mon[97365]: osdmap e38: 6 total, 6 up, 6 in 2023-07-21T22:13:34.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:34 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:13:34.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi151:vg_nvme/lv_2 2023-07-21T22:13:35.721 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:13:35.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:13:35.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:13:35.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi195 2023-07-21T22:13:35.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:35.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:35.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 8633M 2023-07-21T22:13:35.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:35.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:35.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:35.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:35 smithi187 ceph-mon[96918]: osdmap e39: 6 total, 6 up, 6 in 2023-07-21T22:13:35.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:13:35.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:13:35.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi195 2023-07-21T22:13:35.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:35.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:35.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 8633M 2023-07-21T22:13:35.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:35.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:35.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:35.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:35 smithi195 ceph-mon[97365]: osdmap e39: 6 total, 6 up, 6 in 2023-07-21T22:13:35.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:13:35.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:13:35.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi195 2023-07-21T22:13:35.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:35.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:13:35.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 8633M 2023-07-21T22:13:35.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:35.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:35.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:35.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:35.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:35 smithi151 ceph-mon[95510]: osdmap e39: 6 total, 6 up, 6 in 2023-07-21T22:13:37.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.161+0000 7f325ab19700 1 -- 172.21.15.151:0/4079492491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 msgr2=0x7f32540fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.161+0000 7f325ab19700 1 --2- 172.21.15.151:0/4079492491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 0x7f32540fffa0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3248009990 tx=0x7f3248009ca0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.161+0000 7f325ab19700 1 -- 172.21.15.151:0/4079492491 shutdown_connections 2023-07-21T22:13:37.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.161+0000 7f325ab19700 1 --2- 172.21.15.151:0/4079492491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3254101720 0x7f3254107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.161+0000 7f325ab19700 1 --2- 172.21.15.151:0/4079492491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 0x7f32540fffa0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.161+0000 7f325ab19700 1 --2- 172.21.15.151:0/4079492491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3254100d90 0x7f32541011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.161+0000 7f325ab19700 1 -- 172.21.15.151:0/4079492491 >> 172.21.15.151:0/4079492491 conn(0x7f32540fb1a0 msgr2=0x7f32540fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:37.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.161+0000 7f325ab19700 1 -- 172.21.15.151:0/4079492491 shutdown_connections 2023-07-21T22:13:37.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.161+0000 7f325ab19700 1 -- 172.21.15.151:0/4079492491 wait complete. 2023-07-21T22:13:37.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.162+0000 7f325ab19700 1 Processor -- start 2023-07-21T22:13:37.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.162+0000 7f325ab19700 1 -- start start 2023-07-21T22:13:37.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f325ab19700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 0x7f3254195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f325ab19700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3254100d90 0x7f3254195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f325ab19700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3254101720 0x7f325419cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f325ab19700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325419d3a0 con 0x7f32540ffb90 2023-07-21T22:13:37.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f325ab19700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325419d4e0 con 0x7f3254100d90 2023-07-21T22:13:37.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f325ab19700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f325419d670 con 0x7f3254101720 2023-07-21T22:13:37.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f32588b5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 0x7f3254195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f32588b5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 0x7f3254195810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43454/0 (socket says 172.21.15.151:43454) 2023-07-21T22:13:37.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f32588b5700 1 -- 172.21.15.151:0/735920450 learned_addr learned my addr 172.21.15.151:0/735920450 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:13:37.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f3253fff700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3254100d90 0x7f3254195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f32590b6700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3254101720 0x7f325419cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f32588b5700 1 -- 172.21.15.151:0/735920450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3254101720 msgr2=0x7f325419cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f32588b5700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3254101720 0x7f325419cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f32588b5700 1 -- 172.21.15.151:0/735920450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3254100d90 msgr2=0x7f3254195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:37.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.163+0000 7f32588b5700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3254100d90 0x7f3254195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:37.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.164+0000 7f32588b5700 1 -- 172.21.15.151:0/735920450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32480095f0 con 0x7f32540ffb90 2023-07-21T22:13:37.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.164+0000 7f3253fff700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3254100d90 0x7f3254195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:13:37.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.164+0000 7f32588b5700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 0x7f3254195810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32480098e0 tx=0x7f3248003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.164+0000 7f3251ffb700 1 -- 172.21.15.151:0/735920450 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f324801d070 con 0x7f32540ffb90 2023-07-21T22:13:37.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.164+0000 7f3251ffb700 1 -- 172.21.15.151:0/735920450 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f324800bd70 con 0x7f32540ffb90 2023-07-21T22:13:37.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.164+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f325419d8f0 con 0x7f32540ffb90 2023-07-21T22:13:37.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.164+0000 7f3251ffb700 1 -- 172.21.15.151:0/735920450 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3248022d20 con 0x7f32540ffb90 2023-07-21T22:13:37.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.164+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f325419dde0 con 0x7f32540ffb90 2023-07-21T22:13:37.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.165+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f325410b280 con 0x7f32540ffb90 2023-07-21T22:13:37.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.167+0000 7f3251ffb700 1 -- 172.21.15.151:0/735920450 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3248003fb0 con 0x7f32540ffb90 2023-07-21T22:13:37.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.168+0000 7f3251ffb700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f32440a11d0 0x7f32440a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:13:37.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.169+0000 7f3251ffb700 1 -- 172.21.15.151:0/735920450 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 4562+0+0 (secure 0 0 0) 0x7f32480cd0f0 con 0x7f32540ffb90 2023-07-21T22:13:37.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.169+0000 7f3253fff700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f32440a11d0 0x7f32440a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:13:37.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.169+0000 7f3253fff700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f32440a11d0 0x7f32440a3680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3240005950 tx=0x7f32400058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:13:37.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.173+0000 7f3251ffb700 1 -- 172.21.15.151:0/735920450 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f32480976d0 con 0x7f32540ffb90 2023-07-21T22:13:37.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:37.376+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f3254060950 con 0x7f32440a11d0 2023-07-21T22:13:37.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:37 smithi151 ceph-mon[95510]: osdmap e40: 6 total, 6 up, 6 in 2023-07-21T22:13:37.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:37 smithi151 ceph-mon[95510]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:37.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:37 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:13:37.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:37 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:13:37.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:37 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:37.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:37 smithi187 ceph-mon[96918]: osdmap e40: 6 total, 6 up, 6 in 2023-07-21T22:13:37.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:37 smithi187 ceph-mon[96918]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:37.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:13:37.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:13:37.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:37 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:37.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:37 smithi195 ceph-mon[97365]: osdmap e40: 6 total, 6 up, 6 in 2023-07-21T22:13:37.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:37 smithi195 ceph-mon[97365]: pgmap v147: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:37.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:37 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:13:37.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:37 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:13:37.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:37 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:38.774 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:38 smithi151 ceph-mon[95510]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:13:38.775 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:38 smithi151 ceph-mon[95510]: osdmap e41: 6 total, 6 up, 6 in 2023-07-21T22:13:38.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:38 smithi187 ceph-mon[96918]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:13:38.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:38 smithi187 ceph-mon[96918]: osdmap e41: 6 total, 6 up, 6 in 2023-07-21T22:13:38.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:38 smithi195 ceph-mon[97365]: from='client.14379 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:13:38.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:38 smithi195 ceph-mon[97365]: osdmap e41: 6 total, 6 up, 6 in 2023-07-21T22:13:39.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:39 smithi187 ceph-mon[96918]: osdmap e42: 6 total, 6 up, 6 in 2023-07-21T22:13:39.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:39 smithi187 ceph-mon[96918]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:39.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:39 smithi195 ceph-mon[97365]: osdmap e42: 6 total, 6 up, 6 in 2023-07-21T22:13:39.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:39 smithi195 ceph-mon[97365]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:39.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:39 smithi151 ceph-mon[95510]: osdmap e42: 6 total, 6 up, 6 in 2023-07-21T22:13:39.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:39 smithi151 ceph-mon[95510]: pgmap v150: 1 pgs: 1 remapped+peering; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:40.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:40 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3566050452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb0278c9-dae9-453f-83a9-6102b326604e"}]: dispatch 2023-07-21T22:13:40.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:40 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3566050452' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb0278c9-dae9-453f-83a9-6102b326604e"}]': finished 2023-07-21T22:13:40.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:40 smithi187 ceph-mon[96918]: osdmap e43: 7 total, 6 up, 7 in 2023-07-21T22:13:40.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:40 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:13:40.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:40 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3566050452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb0278c9-dae9-453f-83a9-6102b326604e"}]: dispatch 2023-07-21T22:13:40.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:40 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3566050452' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb0278c9-dae9-453f-83a9-6102b326604e"}]': finished 2023-07-21T22:13:40.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:40 smithi195 ceph-mon[97365]: osdmap e43: 7 total, 6 up, 7 in 2023-07-21T22:13:40.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:40 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:13:40.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:40 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3566050452' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "eb0278c9-dae9-453f-83a9-6102b326604e"}]: dispatch 2023-07-21T22:13:40.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:40 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3566050452' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "eb0278c9-dae9-453f-83a9-6102b326604e"}]': finished 2023-07-21T22:13:40.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:40 smithi151 ceph-mon[95510]: osdmap e43: 7 total, 6 up, 7 in 2023-07-21T22:13:40.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:40 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:13:42.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:42 smithi195 ceph-mon[97365]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 131 KiB/s, 0 objects/s recovering 2023-07-21T22:13:42.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:42 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3953285356' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:13:42.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:42 smithi151 ceph-mon[95510]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 131 KiB/s, 0 objects/s recovering 2023-07-21T22:13:42.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:42 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3953285356' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:13:42.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:42 smithi187 ceph-mon[96918]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 131 KiB/s, 0 objects/s recovering 2023-07-21T22:13:42.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:42 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3953285356' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:13:44.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:44 smithi195 ceph-mon[97365]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-07-21T22:13:44.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:44 smithi151 ceph-mon[95510]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-07-21T22:13:44.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:44 smithi187 ceph-mon[96918]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-07-21T22:13:46.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:46 smithi151 ceph-mon[95510]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-07-21T22:13:46.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:46 smithi187 ceph-mon[96918]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-07-21T22:13:46.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:46 smithi195 ceph-mon[97365]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 78 KiB/s, 0 objects/s recovering 2023-07-21T22:13:48.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:48 smithi151 ceph-mon[95510]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-07-21T22:13:48.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-21T22:13:48.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:48.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:48 smithi187 ceph-mon[96918]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-07-21T22:13:48.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-21T22:13:48.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:48.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:48 smithi195 ceph-mon[97365]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 69 KiB/s, 0 objects/s recovering 2023-07-21T22:13:48.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2023-07-21T22:13:48.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:49.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:49 smithi151 ceph-mon[95510]: Deploying daemon osd.6 on smithi151 2023-07-21T22:13:49.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:49 smithi187 ceph-mon[96918]: Deploying daemon osd.6 on smithi151 2023-07-21T22:13:49.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:49 smithi195 ceph-mon[97365]: Deploying daemon osd.6 on smithi151 2023-07-21T22:13:50.414 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:50 smithi151 ceph-mon[95510]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-07-21T22:13:50.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:50 smithi187 ceph-mon[96918]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-07-21T22:13:50.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:50 smithi195 ceph-mon[97365]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2023-07-21T22:13:52.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:52 smithi151 ceph-mon[95510]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:52.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:52 smithi187 ceph-mon[96918]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:52.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:52 smithi195 ceph-mon[97365]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:54.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:54 smithi151 ceph-mon[95510]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:54.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:54 smithi187 ceph-mon[96918]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:54.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:54 smithi195 ceph-mon[97365]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:55.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:55.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:55.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:55.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:55.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:55.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:55.664 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:55.665 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:55.665 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:56.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:56 smithi187 ceph-mon[96918]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:56.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:56 smithi195 ceph-mon[97365]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:56.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:56 smithi151 ceph-mon[95510]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:58.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.042+0000 7f3251ffb700 1 -- 172.21.15.151:0/735920450 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3254060950 con 0x7f32440a11d0 2023-07-21T22:13:58.086 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 6 on host 'smithi151' 2023-07-21T22:13:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f32440a11d0 msgr2=0x7f32440a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f32440a11d0 0x7f32440a3680 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3240005950 tx=0x7f32400058e0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 msgr2=0x7f3254195810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:13:58.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 0x7f3254195810 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f32480098e0 tx=0x7f3248003b00 comp rx=0 tx=0).stop 2023-07-21T22:13:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 shutdown_connections 2023-07-21T22:13:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f32440a11d0 0x7f32440a3680 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3254101720 0x7f325419cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32540ffb90 0x7f3254195810 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 --2- 172.21.15.151:0/735920450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3254100d90 0x7f3254195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:13:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 >> 172.21.15.151:0/735920450 conn(0x7f32540fb1a0 msgr2=0x7f32540fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:13:58.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 shutdown_connections 2023-07-21T22:13:58.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:13:58.045+0000 7f325ab19700 1 -- 172.21.15.151:0/735920450 wait complete. 2023-07-21T22:13:58.545 DEBUG:teuthology.orchestra.run.smithi151:osd.6> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.6.service 2023-07-21T22:13:58.550 INFO:tasks.cephadm:Deploying osd.7 on smithi187 with /dev/vg_nvme/lv_2... 2023-07-21T22:13:58.550 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-21T22:13:58.623 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:58 smithi187 ceph-mon[96918]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:58.624 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.624 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.624 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:58.624 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:58.624 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.624 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.624 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:58.625 INFO:journalctl@ceph.osd.6.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:13:58.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:58 smithi195 ceph-mon[97365]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:58.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:58.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:58 smithi151 ceph-mon[95510]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:13:58.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:13:58.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:13:58.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:13:58.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:13:59.277 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T22:13:59.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:13:59 smithi151 ceph-mon[95510]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-21T22:13:59.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:13:59 smithi187 ceph-mon[96918]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-21T22:13:59.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:13:59 smithi195 ceph-mon[97365]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2023-07-21T22:14:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:00 smithi151 ceph-mon[95510]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:14:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:00 smithi151 ceph-mon[95510]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-21T22:14:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:00 smithi151 ceph-mon[95510]: osdmap e44: 7 total, 6 up, 7 in 2023-07-21T22:14:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:00 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:00.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:00 smithi151 ceph-mon[95510]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:14:00.449 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 22:14:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T22:14:00.344+0000 7fc1428ee700 -1 osd.6 0 waiting for initial osdmap 2023-07-21T22:14:00.449 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 22:14:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T22:14:00.354+0000 7fc13bede700 -1 osd.6 45 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:14:00.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:00 smithi187 ceph-mon[96918]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:14:00.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:00 smithi187 ceph-mon[96918]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-21T22:14:00.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:00 smithi187 ceph-mon[96918]: osdmap e44: 7 total, 6 up, 7 in 2023-07-21T22:14:00.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:00 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:00.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:00 smithi187 ceph-mon[96918]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:14:00.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:00 smithi195 ceph-mon[97365]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:14:00.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:00 smithi195 ceph-mon[97365]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2023-07-21T22:14:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:00 smithi195 ceph-mon[97365]: osdmap e44: 7 total, 6 up, 7 in 2023-07-21T22:14:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:00 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:00 smithi195 ceph-mon[97365]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:14:01.358 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-21T22:14:01.358 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-21T22:14:01.359 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2023-07-21T22:14:01.359 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2023-07-21T22:14:01.359 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.031072 s, 337 MB/s 2023-07-21T22:14:01.359 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2023-07-21T22:14:01.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:01 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:14:01.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:01 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:14:01.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:01 smithi195 ceph-mon[97365]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:14:01.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:01 smithi195 ceph-mon[97365]: osdmap e45: 7 total, 6 up, 7 in 2023-07-21T22:14:01.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:01.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:01.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:01 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:14:01.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:01 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:14:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:01 smithi151 ceph-mon[95510]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:14:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:01 smithi151 ceph-mon[95510]: osdmap e45: 7 total, 6 up, 7 in 2023-07-21T22:14:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:01.797 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:01 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:14:01.798 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:01 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:14:01.798 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:01 smithi187 ceph-mon[96918]: from='osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:14:01.798 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:01 smithi187 ceph-mon[96918]: osdmap e45: 7 total, 6 up, 7 in 2023-07-21T22:14:01.798 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:01.798 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:01.853 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi187:vg_nvme/lv_2 2023-07-21T22:14:02.572 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T22:14:02.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:14:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] boot 2023-07-21T22:14:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: osdmap e46: 7 total, 7 up, 7 in 2023-07-21T22:14:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:14:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] boot 2023-07-21T22:14:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: osdmap e46: 7 total, 7 up, 7 in 2023-07-21T22:14:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.834 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 160 MiB used, 536 GiB / 536 GiB avail 2023-07-21T22:14:02.835 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: osd.6 [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] boot 2023-07-21T22:14:02.835 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: osdmap e46: 7 total, 7 up, 7 in 2023-07-21T22:14:02.835 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:14:02.835 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.835 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.835 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:02.836 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:02.836 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:02.836 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:02.836 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:02.836 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:02.836 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:03.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:03 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi151 2023-07-21T22:14:03.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:03 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 5755M 2023-07-21T22:14:03.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:03 smithi195 ceph-mon[97365]: osdmap e47: 7 total, 7 up, 7 in 2023-07-21T22:14:03.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:03 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi151 2023-07-21T22:14:03.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:03 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 5755M 2023-07-21T22:14:03.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:03 smithi151 ceph-mon[95510]: osdmap e47: 7 total, 7 up, 7 in 2023-07-21T22:14:03.855 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:03 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi151 2023-07-21T22:14:03.856 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:03 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 5755M 2023-07-21T22:14:03.856 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:03 smithi187 ceph-mon[96918]: osdmap e47: 7 total, 7 up, 7 in 2023-07-21T22:14:04.086 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.044+0000 7f12ae883700 1 -- 172.21.15.187:0/119338560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a80ffb90 msgr2=0x7f12a80fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:04.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.044+0000 7f12ae883700 1 --2- 172.21.15.187:0/119338560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a80ffb90 0x7f12a80fffa0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1298009990 tx=0x7f1298009ca0 comp rx=0 tx=0).stop 2023-07-21T22:14:04.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.044+0000 7f12ae883700 1 -- 172.21.15.187:0/119338560 shutdown_connections 2023-07-21T22:14:04.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.044+0000 7f12ae883700 1 --2- 172.21.15.187:0/119338560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a80ffb90 0x7f12a80fffa0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:04.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.044+0000 7f12ae883700 1 --2- 172.21.15.187:0/119338560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a8101720 0x7f12a8107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:04.087 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.044+0000 7f12ae883700 1 --2- 172.21.15.187:0/119338560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12a8100d90 0x7f12a81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:04.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.044+0000 7f12ae883700 1 -- 172.21.15.187:0/119338560 >> 172.21.15.187:0/119338560 conn(0x7f12a80fb1a0 msgr2=0x7f12a80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:04.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.044+0000 7f12ae883700 1 -- 172.21.15.187:0/119338560 shutdown_connections 2023-07-21T22:14:04.088 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.044+0000 7f12ae883700 1 -- 172.21.15.187:0/119338560 wait complete. 2023-07-21T22:14:04.090 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.045+0000 7f12ae883700 1 Processor -- start 2023-07-21T22:14:04.090 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.045+0000 7f12ae883700 1 -- start start 2023-07-21T22:14:04.090 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12ae883700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80ffb90 0x7f12a8195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:04.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12ae883700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a8100d90 0x7f12a8195c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:04.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12ae883700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12a8101720 0x7f12a819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:04.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12ae883700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a819d2b0 con 0x7f12a8101720 2023-07-21T22:14:04.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12ae883700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a819d3f0 con 0x7f12a8100d90 2023-07-21T22:14:04.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12ae883700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a819d580 con 0x7f12a80ffb90 2023-07-21T22:14:04.091 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a8100d90 0x7f12a8195c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:04.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12a77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a8100d90 0x7f12a8195c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:41500/0 (socket says 172.21.15.187:41500) 2023-07-21T22:14:04.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12a77fe700 1 -- 172.21.15.187:0/1852015516 learned_addr learned my addr 172.21.15.187:0/1852015516 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-07-21T22:14:04.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12a7fff700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80ffb90 0x7f12a8195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:04.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.046+0000 7f12ace20700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12a8101720 0x7f12a819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:04.092 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12a77fe700 1 -- 172.21.15.187:0/1852015516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80ffb90 msgr2=0x7f12a8195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:04.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12a77fe700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80ffb90 0x7f12a8195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:04.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12a77fe700 1 -- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12a8101720 msgr2=0x7f12a819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:04.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12a77fe700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12a8101720 0x7f12a819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:04.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12a77fe700 1 -- 172.21.15.187:0/1852015516 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12980095f0 con 0x7f12a8100d90 2023-07-21T22:14:04.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12ace20700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12a8101720 0x7f12a819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:04.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12a77fe700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a8100d90 0x7f12a8195c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f129c00c9b0 tx=0x7f129c00ccc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:04.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12a57fa700 1 -- 172.21.15.187:0/1852015516 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c007b00 con 0x7f12a8100d90 2023-07-21T22:14:04.093 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a80727a0 con 0x7f12a8100d90 2023-07-21T22:14:04.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12a57fa700 1 -- 172.21.15.187:0/1852015516 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f129c007c60 con 0x7f12a8100d90 2023-07-21T22:14:04.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12a57fa700 1 -- 172.21.15.187:0/1852015516 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129c018660 con 0x7f12a8100d90 2023-07-21T22:14:04.094 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.047+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a8072ca0 con 0x7f12a8100d90 2023-07-21T22:14:04.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.048+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a8107190 con 0x7f12a8100d90 2023-07-21T22:14:04.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.050+0000 7f12a57fa700 1 -- 172.21.15.187:0/1852015516 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f129c00f450 con 0x7f12a8100d90 2023-07-21T22:14:04.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.051+0000 7f12a57fa700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f12900a11d0 0x7f12900a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:04.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.052+0000 7f12a57fa700 1 -- 172.21.15.187:0/1852015516 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4965+0+0 (secure 0 0 0) 0x7f129c0cbc50 con 0x7f12a8100d90 2023-07-21T22:14:04.095 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.052+0000 7f12a7fff700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f12900a11d0 0x7f12900a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:04.096 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.053+0000 7f12a7fff700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f12900a11d0 0x7f12900a3680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f129800b5c0 tx=0x7f1298005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:04.098 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.055+0000 7f12a57fa700 1 -- 172.21.15.187:0/1852015516 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f129c096010 con 0x7f12a8100d90 2023-07-21T22:14:04.302 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:04.260+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f12a8074110 con 0x7f12900a11d0 2023-07-21T22:14:04.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:04 smithi195 ceph-mon[97365]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:04.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:14:04.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:14:04.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:04.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:04 smithi151 ceph-mon[95510]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:04.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:14:04.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:14:04.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:04.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:04 smithi187 ceph-mon[96918]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:04.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:14:04.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:14:04.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:05.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:05 smithi195 ceph-mon[97365]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:14:05.693 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:05 smithi187 ceph-mon[96918]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:14:05.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:05 smithi151 ceph-mon[95510]: from='client.24302 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:14:06.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:06 smithi187 ceph-mon[96918]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:06.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:06 smithi195 ceph-mon[97365]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:06.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:06 smithi151 ceph-mon[95510]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:07.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:07 smithi151 ceph-mon[95510]: from='client.? 172.21.15.187:0/2815246110' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16610547-d8ff-4d2a-b8f6-514f0374c058"}]: dispatch 2023-07-21T22:14:07.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:07 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16610547-d8ff-4d2a-b8f6-514f0374c058"}]: dispatch 2023-07-21T22:14:07.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:07 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16610547-d8ff-4d2a-b8f6-514f0374c058"}]': finished 2023-07-21T22:14:07.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:07 smithi151 ceph-mon[95510]: osdmap e48: 8 total, 7 up, 8 in 2023-07-21T22:14:07.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:07 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:07.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:07 smithi187 ceph-mon[96918]: from='client.? 172.21.15.187:0/2815246110' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16610547-d8ff-4d2a-b8f6-514f0374c058"}]: dispatch 2023-07-21T22:14:07.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:07 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16610547-d8ff-4d2a-b8f6-514f0374c058"}]: dispatch 2023-07-21T22:14:07.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:07 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16610547-d8ff-4d2a-b8f6-514f0374c058"}]': finished 2023-07-21T22:14:07.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:07 smithi187 ceph-mon[96918]: osdmap e48: 8 total, 7 up, 8 in 2023-07-21T22:14:07.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:07 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:07.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:07 smithi195 ceph-mon[97365]: from='client.? 172.21.15.187:0/2815246110' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16610547-d8ff-4d2a-b8f6-514f0374c058"}]: dispatch 2023-07-21T22:14:07.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:07 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16610547-d8ff-4d2a-b8f6-514f0374c058"}]: dispatch 2023-07-21T22:14:07.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:07 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16610547-d8ff-4d2a-b8f6-514f0374c058"}]': finished 2023-07-21T22:14:07.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:07 smithi195 ceph-mon[97365]: osdmap e48: 8 total, 7 up, 8 in 2023-07-21T22:14:07.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:07 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:08.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:08 smithi151 ceph-mon[95510]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:08.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:08 smithi151 ceph-mon[95510]: from='client.? 172.21.15.187:0/3802686781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:14:08.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:08 smithi187 ceph-mon[96918]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:08.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:08 smithi187 ceph-mon[96918]: from='client.? 172.21.15.187:0/3802686781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:14:08.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:08 smithi195 ceph-mon[97365]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:08.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:08 smithi195 ceph-mon[97365]: from='client.? 172.21.15.187:0/3802686781' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:14:09.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:09 smithi151 ceph-mon[95510]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:09.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:09 smithi187 ceph-mon[96918]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:09.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:09 smithi195 ceph-mon[97365]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:12.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:12 smithi151 ceph-mon[95510]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:12.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:12 smithi187 ceph-mon[96918]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:12.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:12 smithi195 ceph-mon[97365]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:14.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:14 smithi151 ceph-mon[95510]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:14.541 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:14 smithi187 ceph-mon[96918]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:14.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:14 smithi195 ceph-mon[97365]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:15.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-21T22:14:15.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:15 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:15.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-21T22:14:15.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:15 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:15.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2023-07-21T22:14:15.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:15 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:16.321 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:16 smithi187 ceph-mon[96918]: Deploying daemon osd.7 on smithi187 2023-07-21T22:14:16.321 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:16 smithi187 ceph-mon[96918]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:16.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:16 smithi151 ceph-mon[95510]: Deploying daemon osd.7 on smithi187 2023-07-21T22:14:16.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:16 smithi151 ceph-mon[95510]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:16.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:16 smithi195 ceph-mon[97365]: Deploying daemon osd.7 on smithi187 2023-07-21T22:14:16.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:16 smithi195 ceph-mon[97365]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:18.313 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:18 smithi187 ceph-mon[96918]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:18.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:18 smithi151 ceph-mon[95510]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:18.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:18 smithi195 ceph-mon[97365]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:20.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:20 smithi187 ceph-mon[96918]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:20.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:20 smithi151 ceph-mon[95510]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:20.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:20 smithi195 ceph-mon[97365]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:22.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:22 smithi187 ceph-mon[96918]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:22.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:22.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:22.490 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:22 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:22.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:22 smithi195 ceph-mon[97365]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:22.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:22.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:22.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:22 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:22.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:22 smithi151 ceph-mon[95510]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:22.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:22.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:22.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:22 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:24.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:24 smithi187 ceph-mon[96918]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:24.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:24 smithi195 ceph-mon[97365]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:24.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:24 smithi151 ceph-mon[95510]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:24.779 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.735+0000 7f12a57fa700 1 -- 172.21.15.187:0/1852015516 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f12a8074110 con 0x7f12900a11d0 2023-07-21T22:14:24.779 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 7 on host 'smithi187' 2023-07-21T22:14:24.782 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.738+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f12900a11d0 msgr2=0x7f12900a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.782 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.738+0000 7f12ae883700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f12900a11d0 0x7f12900a3680 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f129800b5c0 tx=0x7f1298005fb0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.782 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.738+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a8100d90 msgr2=0x7f12a8195c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:24.782 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.738+0000 7f12ae883700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a8100d90 0x7f12a8195c60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f129c00c9b0 tx=0x7f129c00ccc0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.782 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.739+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 shutdown_connections 2023-07-21T22:14:24.782 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.739+0000 7f12ae883700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f12900a11d0 0x7f12900a3680 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.783 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.739+0000 7f12ae883700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12a8101720 0x7f12a819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.783 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.739+0000 7f12ae883700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f12a80ffb90 0x7f12a8195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.783 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.739+0000 7f12ae883700 1 --2- 172.21.15.187:0/1852015516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a8100d90 0x7f12a8195c60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:24.783 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.739+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 >> 172.21.15.187:0/1852015516 conn(0x7f12a80fb1a0 msgr2=0x7f12a81042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:24.783 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.739+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 shutdown_connections 2023-07-21T22:14:24.783 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:14:24.739+0000 7f12ae883700 1 -- 172.21.15.187:0/1852015516 wait complete. 2023-07-21T22:14:25.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:25.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:25.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.358 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.358 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:25.358 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='osd.7 [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-21T22:14:25.358 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:25 smithi187 ceph-mon[96918]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-21T22:14:25.398 DEBUG:teuthology.orchestra.run.smithi187:osd.7> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.7.service 2023-07-21T22:14:25.402 INFO:tasks.cephadm:Deploying osd.8 on smithi195 with /dev/vg_nvme/lv_2... 2023-07-21T22:14:25.403 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2023-07-21T22:14:25.473 INFO:journalctl@ceph.osd.7.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:14:25.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:25.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:25.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:25.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='osd.7 [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-21T22:14:25.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:25 smithi195 ceph-mon[97365]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-21T22:14:25.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:25.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:25.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:25.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:25.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='osd.7 [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-21T22:14:25.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:25 smithi151 ceph-mon[95510]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2023-07-21T22:14:26.127 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:14:26.484 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:26 smithi195 ceph-mon[97365]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:26.484 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:26 smithi195 ceph-mon[97365]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-21T22:14:26.484 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:26 smithi195 ceph-mon[97365]: osdmap e49: 8 total, 7 up, 8 in 2023-07-21T22:14:26.484 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:26.484 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:26 smithi195 ceph-mon[97365]: from='osd.7 [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:14:26.485 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:26 smithi195 ceph-mon[97365]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:14:26.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:26 smithi187 ceph-mon[96918]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:26.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:26 smithi187 ceph-mon[96918]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-21T22:14:26.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:26 smithi187 ceph-mon[96918]: osdmap e49: 8 total, 7 up, 8 in 2023-07-21T22:14:26.488 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:26.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:26 smithi187 ceph-mon[96918]: from='osd.7 [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:14:26.489 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:26 smithi187 ceph-mon[96918]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:14:26.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:26 smithi151 ceph-mon[95510]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:26.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:26 smithi151 ceph-mon[95510]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2023-07-21T22:14:26.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:26 smithi151 ceph-mon[95510]: osdmap e49: 8 total, 7 up, 8 in 2023-07-21T22:14:26.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:26 smithi151 ceph-mon[95510]: from='osd.7 [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:14:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:26 smithi151 ceph-mon[95510]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:14:27.128 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 22:14:26 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T22:14:26.717+0000 7f01bfa60700 -1 osd.7 0 waiting for initial osdmap 2023-07-21T22:14:27.128 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 22:14:26 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T22:14:26.733+0000 7f01b784d700 -1 osd.7 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:14:27.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:27 smithi187 ceph-mon[96918]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:14:27.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:27 smithi187 ceph-mon[96918]: osdmap e50: 8 total, 7 up, 8 in 2023-07-21T22:14:27.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:27 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:27.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:27 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:27.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:27 smithi187 ceph-mon[96918]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:28.049 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_2 2023-07-21T22:14:28.050 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2023-07-21T22:14:28.050 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-07-21T22:14:28.050 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-07-21T22:14:28.050 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0315657 s, 332 MB/s 2023-07-21T22:14:28.050 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-07-21T22:14:28.086 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:27 smithi195 ceph-mon[97365]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:14:28.087 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:27 smithi195 ceph-mon[97365]: osdmap e50: 8 total, 7 up, 8 in 2023-07-21T22:14:28.087 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:28.087 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:28.087 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:27 smithi195 ceph-mon[97365]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:28.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:27 smithi151 ceph-mon[95510]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:14:28.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:27 smithi151 ceph-mon[95510]: osdmap e50: 8 total, 7 up, 8 in 2023-07-21T22:14:28.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:27 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:28.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:27 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:28.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:27 smithi151 ceph-mon[95510]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 187 MiB used, 626 GiB / 626 GiB avail 2023-07-21T22:14:28.500 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_2 2023-07-21T22:14:29.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:14:29.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:14:29.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: osd.7 [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] boot 2023-07-21T22:14:29.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: osdmap e51: 8 total, 8 up, 8 in 2023-07-21T22:14:29.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:29.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi187 2023-07-21T22:14:29.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:29.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:29.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:29.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 5755M 2023-07-21T22:14:29.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:29.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:29.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:28 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:14:29.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:14:29.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: osd.7 [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] boot 2023-07-21T22:14:29.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: osdmap e51: 8 total, 8 up, 8 in 2023-07-21T22:14:29.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:29.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi187 2023-07-21T22:14:29.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:29.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:29.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:29.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 5755M 2023-07-21T22:14:29.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:29.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:29.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:28 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:14:29.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:14:29.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: osd.7 [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] boot 2023-07-21T22:14:29.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: osdmap e51: 8 total, 8 up, 8 in 2023-07-21T22:14:29.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:14:29.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi187 2023-07-21T22:14:29.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:29.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:29.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:29.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 5755M 2023-07-21T22:14:29.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:29.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:29.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:28 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:29.220 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:14:30.020 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:29 smithi195 ceph-mon[97365]: osdmap e52: 8 total, 8 up, 8 in 2023-07-21T22:14:30.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:29 smithi195 ceph-mon[97365]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:30.021 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:29 smithi195 ceph-mon[97365]: osdmap e53: 8 total, 8 up, 8 in 2023-07-21T22:14:30.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:29 smithi187 ceph-mon[96918]: osdmap e52: 8 total, 8 up, 8 in 2023-07-21T22:14:30.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:29 smithi187 ceph-mon[96918]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:30.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:29 smithi187 ceph-mon[96918]: osdmap e53: 8 total, 8 up, 8 in 2023-07-21T22:14:30.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:29 smithi151 ceph-mon[95510]: osdmap e52: 8 total, 8 up, 8 in 2023-07-21T22:14:30.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:29 smithi151 ceph-mon[95510]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:30.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:29 smithi151 ceph-mon[95510]: osdmap e53: 8 total, 8 up, 8 in 2023-07-21T22:14:30.559 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.516+0000 7fcc6261c700 1 -- 172.21.15.195:0/2283245525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c101720 msgr2=0x7fcc5c107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.560 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.516+0000 7fcc6261c700 1 --2- 172.21.15.195:0/2283245525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c101720 0x7fcc5c107fe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcc5400b0a0 tx=0x7fcc5400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.560 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.516+0000 7fcc6261c700 1 -- 172.21.15.195:0/2283245525 shutdown_connections 2023-07-21T22:14:30.560 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.516+0000 7fcc6261c700 1 --2- 172.21.15.195:0/2283245525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc5c0ffb90 0x7fcc5c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.561 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.516+0000 7fcc6261c700 1 --2- 172.21.15.195:0/2283245525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c101720 0x7fcc5c107fe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.561 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.516+0000 7fcc6261c700 1 --2- 172.21.15.195:0/2283245525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc5c100d90 0x7fcc5c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.561 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.516+0000 7fcc6261c700 1 -- 172.21.15.195:0/2283245525 >> 172.21.15.195:0/2283245525 conn(0x7fcc5c0fb1a0 msgr2=0x7fcc5c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:30.561 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.516+0000 7fcc6261c700 1 -- 172.21.15.195:0/2283245525 shutdown_connections 2023-07-21T22:14:30.562 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.516+0000 7fcc6261c700 1 -- 172.21.15.195:0/2283245525 wait complete. 2023-07-21T22:14:30.562 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.517+0000 7fcc6261c700 1 Processor -- start 2023-07-21T22:14:30.562 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.517+0000 7fcc6261c700 1 -- start start 2023-07-21T22:14:30.565 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc6261c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc5c0ffb90 0x7fcc5c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.566 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc6261c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c100d90 0x7fcc5c197f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.566 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc6261c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc5c101720 0x7fcc5c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.566 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc6261c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c19f5e0 con 0x7fcc5c101720 2023-07-21T22:14:30.566 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc6261c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c19f720 con 0x7fcc5c0ffb90 2023-07-21T22:14:30.567 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc6261c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc5c19f8b0 con 0x7fcc5c100d90 2023-07-21T22:14:30.567 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc5b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c100d90 0x7fcc5c197f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.567 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc5b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c100d90 0x7fcc5c197f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:57332/0 (socket says 172.21.15.195:57332) 2023-07-21T22:14:30.567 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc5b7fe700 1 -- 172.21.15.195:0/1027157845 learned_addr learned my addr 172.21.15.195:0/1027157845 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:14:30.568 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc5bfff700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc5c0ffb90 0x7fcc5c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.568 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc60bb9700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc5c101720 0x7fcc5c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.568 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc5b7fe700 1 -- 172.21.15.195:0/1027157845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc5c0ffb90 msgr2=0x7fcc5c197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.568 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc5b7fe700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc5c0ffb90 0x7fcc5c197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.569 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc5b7fe700 1 -- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc5c101720 msgr2=0x7fcc5c19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:30.569 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc5b7fe700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc5c101720 0x7fcc5c19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:30.569 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.518+0000 7fcc5b7fe700 1 -- 172.21.15.195:0/1027157845 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc54009d00 con 0x7fcc5c100d90 2023-07-21T22:14:30.570 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.519+0000 7fcc5b7fe700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c100d90 0x7fcc5c197f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000c9e0 tx=0x7fcc5000ccf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:30.570 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.519+0000 7fcc597fa700 1 -- 172.21.15.195:0/1027157845 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50007ac0 con 0x7fcc5c100d90 2023-07-21T22:14:30.570 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.519+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc5c19fb90 con 0x7fcc5c100d90 2023-07-21T22:14:30.571 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.519+0000 7fcc597fa700 1 -- 172.21.15.195:0/1027157845 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcc5000ce80 con 0x7fcc5c100d90 2023-07-21T22:14:30.571 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.519+0000 7fcc597fa700 1 -- 172.21.15.195:0/1027157845 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc50018400 con 0x7fcc5c100d90 2023-07-21T22:14:30.571 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.519+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc5c1a00e0 con 0x7fcc5c100d90 2023-07-21T22:14:30.571 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.520+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc5c10b1c0 con 0x7fcc5c100d90 2023-07-21T22:14:30.572 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.522+0000 7fcc597fa700 1 -- 172.21.15.195:0/1027157845 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fcc5000f450 con 0x7fcc5c100d90 2023-07-21T22:14:30.573 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.524+0000 7fcc597fa700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcc440a1150 0x7fcc440a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:30.573 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.524+0000 7fcc597fa700 1 -- 172.21.15.195:0/1027157845 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5426+0+0 (secure 0 0 0) 0x7fcc500cbda0 con 0x7fcc5c100d90 2023-07-21T22:14:30.573 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.525+0000 7fcc5bfff700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcc440a1150 0x7fcc440a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:30.574 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.525+0000 7fcc5bfff700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcc440a1150 0x7fcc440a3600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c100bf0 tx=0x7fcc4c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:30.574 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.528+0000 7fcc597fa700 1 -- 172.21.15.195:0/1027157845 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fcc50095f90 con 0x7fcc5c100d90 2023-07-21T22:14:30.773 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:30.730+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc5c1076d0 con 0x7fcc440a1150 2023-07-21T22:14:32.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:31 smithi187 ceph-mon[96918]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:14:32.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:31 smithi187 ceph-mon[96918]: osdmap e54: 8 total, 8 up, 8 in 2023-07-21T22:14:32.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:14:32.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:14:32.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:31 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:32.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:31 smithi187 ceph-mon[96918]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:32.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:31 smithi195 ceph-mon[97365]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:14:32.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:31 smithi195 ceph-mon[97365]: osdmap e54: 8 total, 8 up, 8 in 2023-07-21T22:14:32.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:14:32.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:14:32.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:31 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:32.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:31 smithi195 ceph-mon[97365]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:32.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:31 smithi151 ceph-mon[95510]: from='client.24328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:14:32.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:31 smithi151 ceph-mon[95510]: osdmap e54: 8 total, 8 up, 8 in 2023-07-21T22:14:32.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:14:32.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:14:32.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:31 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:32.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:31 smithi151 ceph-mon[95510]: pgmap v188: 1 pgs: 1 remapped+peering; 577 KiB data, 214 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:33.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:32 smithi187 ceph-mon[96918]: osdmap e55: 8 total, 8 up, 8 in 2023-07-21T22:14:33.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:32 smithi195 ceph-mon[97365]: osdmap e55: 8 total, 8 up, 8 in 2023-07-21T22:14:33.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:32 smithi151 ceph-mon[95510]: osdmap e55: 8 total, 8 up, 8 in 2023-07-21T22:14:34.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:33 smithi187 ceph-mon[96918]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:34.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:33 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/1627470197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16e29935-729c-4d6d-b86b-82a69248c80c"}]: dispatch 2023-07-21T22:14:34.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:33 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16e29935-729c-4d6d-b86b-82a69248c80c"}]: dispatch 2023-07-21T22:14:34.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:33 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16e29935-729c-4d6d-b86b-82a69248c80c"}]': finished 2023-07-21T22:14:34.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:33 smithi187 ceph-mon[96918]: osdmap e56: 9 total, 8 up, 9 in 2023-07-21T22:14:34.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:33 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:34.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:33 smithi195 ceph-mon[97365]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:34.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:33 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/1627470197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16e29935-729c-4d6d-b86b-82a69248c80c"}]: dispatch 2023-07-21T22:14:34.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:33 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16e29935-729c-4d6d-b86b-82a69248c80c"}]: dispatch 2023-07-21T22:14:34.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:33 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16e29935-729c-4d6d-b86b-82a69248c80c"}]': finished 2023-07-21T22:14:34.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:33 smithi195 ceph-mon[97365]: osdmap e56: 9 total, 8 up, 9 in 2023-07-21T22:14:34.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:34.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:33 smithi151 ceph-mon[95510]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:34.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:33 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/1627470197' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16e29935-729c-4d6d-b86b-82a69248c80c"}]: dispatch 2023-07-21T22:14:34.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:33 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "16e29935-729c-4d6d-b86b-82a69248c80c"}]: dispatch 2023-07-21T22:14:34.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:33 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "16e29935-729c-4d6d-b86b-82a69248c80c"}]': finished 2023-07-21T22:14:34.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:33 smithi151 ceph-mon[95510]: osdmap e56: 9 total, 8 up, 9 in 2023-07-21T22:14:34.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:35.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:34 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/3128306867' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:14:35.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:34 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/3128306867' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:14:35.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:34 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/3128306867' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:14:36.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:35 smithi187 ceph-mon[96918]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:36.155 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:35 smithi195 ceph-mon[97365]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:36.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:35 smithi151 ceph-mon[95510]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:38.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:38 smithi195 ceph-mon[97365]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:38.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:38 smithi151 ceph-mon[95510]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:38.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:38 smithi187 ceph-mon[96918]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:40.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:40 smithi195 ceph-mon[97365]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:40.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:40 smithi151 ceph-mon[95510]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:40.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:40 smithi187 ceph-mon[96918]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:41.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:41 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-21T22:14:41.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:41 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:41.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:41 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-21T22:14:41.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:41 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:41.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:41 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2023-07-21T22:14:41.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:41 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:42.255 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:42 smithi195 ceph-mon[97365]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:42.256 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:42 smithi195 ceph-mon[97365]: Deploying daemon osd.8 on smithi195 2023-07-21T22:14:42.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:42 smithi151 ceph-mon[95510]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:42.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:42 smithi151 ceph-mon[95510]: Deploying daemon osd.8 on smithi195 2023-07-21T22:14:42.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:42 smithi187 ceph-mon[96918]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:42.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:42 smithi187 ceph-mon[96918]: Deploying daemon osd.8 on smithi195 2023-07-21T22:14:44.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:44 smithi195 ceph-mon[97365]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:44.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:44 smithi151 ceph-mon[95510]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:44.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:44 smithi187 ceph-mon[96918]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:46.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:46 smithi195 ceph-mon[97365]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:46.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:46 smithi151 ceph-mon[95510]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:46.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:46 smithi187 ceph-mon[96918]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:48.494 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:48 smithi195 ceph-mon[97365]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:48.494 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:48.495 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:48.495 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:48.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:48 smithi187 ceph-mon[96918]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:48.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:48 smithi151 ceph-mon[95510]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:48.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:48.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:48.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:50 smithi187 ceph-mon[96918]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:50.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:50.638 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:50 smithi195 ceph-mon[97365]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:50.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:50.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:50.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:50.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:50.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:50.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:50 smithi151 ceph-mon[95510]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:50.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:50.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:50.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:50.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:50.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:50.702 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.658+0000 7fcc597fa700 1 -- 172.21.15.195:0/1027157845 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fcc5c1076d0 con 0x7fcc440a1150 2023-07-21T22:14:50.702 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 8 on host 'smithi195' 2023-07-21T22:14:50.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.661+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcc440a1150 msgr2=0x7fcc440a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:50.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.661+0000 7fcc6261c700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcc440a1150 0x7fcc440a3600 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcc5c100bf0 tx=0x7fcc4c009260 comp rx=0 tx=0).stop 2023-07-21T22:14:50.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.661+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c100d90 msgr2=0x7fcc5c197f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:50.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.661+0000 7fcc6261c700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c100d90 0x7fcc5c197f90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcc5000c9e0 tx=0x7fcc5000ccf0 comp rx=0 tx=0).stop 2023-07-21T22:14:50.705 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.661+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 shutdown_connections 2023-07-21T22:14:50.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.661+0000 7fcc6261c700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcc440a1150 0x7fcc440a3600 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:50.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.661+0000 7fcc6261c700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc5c0ffb90 0x7fcc5c197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:50.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.661+0000 7fcc6261c700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc5c101720 0x7fcc5c19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:50.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.661+0000 7fcc6261c700 1 --2- 172.21.15.195:0/1027157845 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcc5c100d90 0x7fcc5c197f90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:50.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.662+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 >> 172.21.15.195:0/1027157845 conn(0x7fcc5c0fb1a0 msgr2=0x7fcc5c0fd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:50.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.662+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 shutdown_connections 2023-07-21T22:14:50.706 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:14:50.662+0000 7fcc6261c700 1 -- 172.21.15.195:0/1027157845 wait complete. 2023-07-21T22:14:51.139 DEBUG:teuthology.orchestra.run.smithi195:osd.8> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.8.service 2023-07-21T22:14:51.144 INFO:tasks.cephadm:Deploying osd.9 on smithi151 with /dev/vg_nvme/lv_1... 2023-07-21T22:14:51.144 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-21T22:14:51.230 INFO:journalctl@ceph.osd.8.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:14:51.873 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:14:51.918 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:51.919 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:51.919 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:51.919 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:51 smithi195 ceph-mon[97365]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:51.919 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:51 smithi195 ceph-mon[97365]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-21T22:14:51.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:51.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:51.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:51.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:51 smithi151 ceph-mon[95510]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:51.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:51 smithi151 ceph-mon[95510]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-21T22:14:52.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:52.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:52.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:14:52.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:51 smithi187 ceph-mon[96918]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:52.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:51 smithi187 ceph-mon[96918]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2023-07-21T22:14:53.433 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 22:14:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T22:14:53.141+0000 7fc613759700 -1 osd.8 0 waiting for initial osdmap 2023-07-21T22:14:53.434 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 22:14:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T22:14:53.156+0000 7fc60dd4b700 -1 osd.8 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:14:53.434 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:53 smithi195 ceph-mon[97365]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-07-21T22:14:53.434 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:53 smithi195 ceph-mon[97365]: osdmap e57: 9 total, 8 up, 9 in 2023-07-21T22:14:53.434 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:53 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:53.434 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:53 smithi195 ceph-mon[97365]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:14:53.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:53 smithi151 ceph-mon[95510]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-07-21T22:14:53.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:53 smithi151 ceph-mon[95510]: osdmap e57: 9 total, 8 up, 9 in 2023-07-21T22:14:53.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:53 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:53.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:53 smithi151 ceph-mon[95510]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:14:53.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:53 smithi187 ceph-mon[96918]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2023-07-21T22:14:53.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:53 smithi187 ceph-mon[96918]: osdmap e57: 9 total, 8 up, 9 in 2023-07-21T22:14:53.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:53 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:53.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:53 smithi187 ceph-mon[96918]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:14:53.825 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-21T22:14:53.825 INFO:teuthology.orchestra.run.smithi151.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-21T22:14:53.826 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10+0 records in 2023-07-21T22:14:53.826 INFO:teuthology.orchestra.run.smithi151.stderr:10+0 records out 2023-07-21T22:14:53.826 INFO:teuthology.orchestra.run.smithi151.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0428407 s, 245 MB/s 2023-07-21T22:14:53.826 INFO:teuthology.orchestra.run.smithi151.stderr:--> Zapping successful for: 2023-07-21T22:14:54.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:54.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:14:54.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: osdmap e58: 9 total, 8 up, 9 in 2023-07-21T22:14:54.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:54.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:54.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:54.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:54.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:54.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:54.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:54.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi151:vg_nvme/lv_1 2023-07-21T22:14:54.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:54.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:14:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: osdmap e58: 9 total, 8 up, 9 in 2023-07-21T22:14:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:54.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:54.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:54.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:54.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:54.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:54.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225]' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:14:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: osdmap e58: 9 total, 8 up, 9 in 2023-07-21T22:14:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:14:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:14:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:14:55.173 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:14:55.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:55 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:14:55.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:55 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:14:55.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:55 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi195 2023-07-21T22:14:55.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:55 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 5755M 2023-07-21T22:14:55.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:55.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:55 smithi151 ceph-mon[95510]: osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] boot 2023-07-21T22:14:55.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:55 smithi151 ceph-mon[95510]: osdmap e59: 9 total, 9 up, 9 in 2023-07-21T22:14:55.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:55.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:55 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:14:55.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:55 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:14:55.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:55 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi195 2023-07-21T22:14:55.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:55 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 5755M 2023-07-21T22:14:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:55 smithi187 ceph-mon[96918]: osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] boot 2023-07-21T22:14:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:55 smithi187 ceph-mon[96918]: osdmap e59: 9 total, 9 up, 9 in 2023-07-21T22:14:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:55.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:55 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:14:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:55 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:14:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:55 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi195 2023-07-21T22:14:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:55 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 5755M 2023-07-21T22:14:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:55 smithi195 ceph-mon[97365]: osd.8 [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] boot 2023-07-21T22:14:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:55 smithi195 ceph-mon[97365]: osdmap e59: 9 total, 9 up, 9 in 2023-07-21T22:14:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:14:56.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:56 smithi151 ceph-mon[95510]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:56.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:56 smithi151 ceph-mon[95510]: osdmap e60: 9 total, 9 up, 9 in 2023-07-21T22:14:56.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:56 smithi187 ceph-mon[96918]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:56.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:56 smithi187 ceph-mon[96918]: osdmap e60: 9 total, 9 up, 9 in 2023-07-21T22:14:56.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:56 smithi195 ceph-mon[97365]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2023-07-21T22:14:56.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:56 smithi195 ceph-mon[97365]: osdmap e60: 9 total, 9 up, 9 in 2023-07-21T22:14:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.658+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/2449834507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a08100d90 msgr2=0x7f3a081011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.658+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/2449834507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a08100d90 0x7f3a081011e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f39fc009990 tx=0x7f39fc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:14:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.658+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/2449834507 shutdown_connections 2023-07-21T22:14:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.658+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/2449834507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a08101720 0x7f3a08107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.658+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/2449834507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a080ffb90 0x7f3a080fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.658+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/2449834507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a08100d90 0x7f3a081011e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.658+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/2449834507 >> 172.21.15.151:0/2449834507 conn(0x7f3a080fb1a0 msgr2=0x7f3a080fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:14:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.658+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/2449834507 shutdown_connections 2023-07-21T22:14:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.659+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/2449834507 wait complete. 2023-07-21T22:14:56.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.659+0000 7f3a0e1bd700 1 Processor -- start 2023-07-21T22:14:56.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a0e1bd700 1 -- start start 2023-07-21T22:14:56.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a0e1bd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080ffb90 0x7f3a08197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:56.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a0e1bd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a08100d90 0x7f3a08197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:56.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a0e1bd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a08101720 0x7f3a0819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:56.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a0e1bd700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0819f590 con 0x7f3a080ffb90 2023-07-21T22:14:56.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a0e1bd700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0819f6d0 con 0x7f3a08100d90 2023-07-21T22:14:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a0e1bd700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a0819f860 con 0x7f3a08101720 2023-07-21T22:14:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080ffb90 0x7f3a08197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080ffb90 0x7f3a08197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48260/0 (socket says 172.21.15.151:48260) 2023-07-21T22:14:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.660+0000 7f3a077fe700 1 -- 172.21.15.151:0/3644297221 learned_addr learned my addr 172.21.15.151:0/3644297221 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:14:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a06ffd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a08100d90 0x7f3a08197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a07fff700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a08101720 0x7f3a0819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a077fe700 1 -- 172.21.15.151:0/3644297221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a08101720 msgr2=0x7f3a0819efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a077fe700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a08101720 0x7f3a0819efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:56.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a077fe700 1 -- 172.21.15.151:0/3644297221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a08100d90 msgr2=0x7f3a08197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:14:56.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a077fe700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a08100d90 0x7f3a08197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:14:56.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a077fe700 1 -- 172.21.15.151:0/3644297221 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc0095f0 con 0x7f3a080ffb90 2023-07-21T22:14:56.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a06ffd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a08100d90 0x7f3a08197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:14:56.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a077fe700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080ffb90 0x7f3a08197a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39f800d9b0 tx=0x7f39f800dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:56.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a04ff9700 1 -- 172.21.15.151:0/3644297221 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f800be80 con 0x7f3a080ffb90 2023-07-21T22:14:56.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a04ff9700 1 -- 172.21.15.151:0/3644297221 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39f80044b0 con 0x7f3a080ffb90 2023-07-21T22:14:56.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a04ff9700 1 -- 172.21.15.151:0/3644297221 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f8003aa0 con 0x7f3a080ffb90 2023-07-21T22:14:56.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a0819fb40 con 0x7f3a080ffb90 2023-07-21T22:14:56.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.661+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a081a0040 con 0x7f3a080ffb90 2023-07-21T22:14:56.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.663+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a08192110 con 0x7f3a080ffb90 2023-07-21T22:14:56.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.664+0000 7f3a04ff9700 1 -- 172.21.15.151:0/3644297221 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f39f8009940 con 0x7f3a080ffb90 2023-07-21T22:14:56.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.666+0000 7f3a04ff9700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39f00a11d0 0x7f39f00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:14:56.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.666+0000 7f3a04ff9700 1 -- 172.21.15.151:0/3644297221 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5858+0+0 (secure 0 0 0) 0x7f39f80cbcf0 con 0x7f3a080ffb90 2023-07-21T22:14:56.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.666+0000 7f3a06ffd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39f00a11d0 0x7f39f00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:14:56.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.667+0000 7f3a06ffd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39f00a11d0 0x7f39f00a3680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00b5c0 tx=0x7f39fc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:14:56.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.670+0000 7f3a04ff9700 1 -- 172.21.15.151:0/3644297221 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f39f8095d30 con 0x7f3a080ffb90 2023-07-21T22:14:56.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:14:56.876+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a08060950 con 0x7f39f00a11d0 2023-07-21T22:14:57.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:57 smithi187 ceph-mon[96918]: osdmap e61: 9 total, 9 up, 9 in 2023-07-21T22:14:57.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:57 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:14:57.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:57 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:14:57.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:57 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:57.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:57 smithi195 ceph-mon[97365]: osdmap e61: 9 total, 9 up, 9 in 2023-07-21T22:14:57.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:57 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:14:57.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:57 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:14:57.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:57 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:57.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:57 smithi151 ceph-mon[95510]: osdmap e61: 9 total, 9 up, 9 in 2023-07-21T22:14:57.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:57 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:14:57.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:57 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:14:57.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:57 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:14:58.271 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:58 smithi151 ceph-mon[95510]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:14:58.272 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:58 smithi151 ceph-mon[95510]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:14:58.272 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:58 smithi151 ceph-mon[95510]: osdmap e62: 9 total, 9 up, 9 in 2023-07-21T22:14:58.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:58 smithi187 ceph-mon[96918]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:14:58.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:58 smithi187 ceph-mon[96918]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:14:58.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:58 smithi187 ceph-mon[96918]: osdmap e62: 9 total, 9 up, 9 in 2023-07-21T22:14:58.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:58 smithi195 ceph-mon[97365]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:14:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:58 smithi195 ceph-mon[97365]: from='client.14445 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:14:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:58 smithi195 ceph-mon[97365]: osdmap e62: 9 total, 9 up, 9 in 2023-07-21T22:14:59.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:14:59 smithi151 ceph-mon[95510]: osdmap e63: 9 total, 9 up, 9 in 2023-07-21T22:14:59.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:14:59 smithi187 ceph-mon[96918]: osdmap e63: 9 total, 9 up, 9 in 2023-07-21T22:14:59.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:14:59 smithi195 ceph-mon[97365]: osdmap e63: 9 total, 9 up, 9 in 2023-07-21T22:15:00.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:00 smithi187 ceph-mon[96918]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-21T22:15:00.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:00 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2459876827' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57"}]: dispatch 2023-07-21T22:15:00.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:00 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2459876827' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57"}]': finished 2023-07-21T22:15:00.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:00 smithi187 ceph-mon[96918]: osdmap e64: 10 total, 9 up, 10 in 2023-07-21T22:15:00.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:00 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:00.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:00 smithi195 ceph-mon[97365]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-21T22:15:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:00 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2459876827' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57"}]: dispatch 2023-07-21T22:15:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:00 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2459876827' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57"}]': finished 2023-07-21T22:15:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:00 smithi195 ceph-mon[97365]: osdmap e64: 10 total, 9 up, 10 in 2023-07-21T22:15:00.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:00 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:00.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:00 smithi151 ceph-mon[95510]: pgmap v211: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2023-07-21T22:15:00.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:00 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2459876827' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57"}]: dispatch 2023-07-21T22:15:00.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:00 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2459876827' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57"}]': finished 2023-07-21T22:15:00.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:00 smithi151 ceph-mon[95510]: osdmap e64: 10 total, 9 up, 10 in 2023-07-21T22:15:00.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:00 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:01.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:01 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3701968907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:15:01.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:01 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3701968907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:15:01.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:01 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3701968907' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:15:02.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:02 smithi187 ceph-mon[96918]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-07-21T22:15:02.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:02 smithi195 ceph-mon[97365]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-07-21T22:15:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:02 smithi151 ceph-mon[95510]: pgmap v213: 1 pgs: 1 peering; 577 KiB data, 242 MiB used, 804 GiB / 805 GiB avail; 124 KiB/s, 0 objects/s recovering 2023-07-21T22:15:04.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:04 smithi187 ceph-mon[96918]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-07-21T22:15:04.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:04 smithi195 ceph-mon[97365]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-07-21T22:15:04.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:04 smithi151 ceph-mon[95510]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2023-07-21T22:15:06.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:06 smithi151 ceph-mon[95510]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-07-21T22:15:06.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:06 smithi187 ceph-mon[96918]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-07-21T22:15:06.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:06 smithi195 ceph-mon[97365]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2023-07-21T22:15:08.517 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:08 smithi151 ceph-mon[95510]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:08.517 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-21T22:15:08.517 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:08.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:08 smithi187 ceph-mon[96918]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:08.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-21T22:15:08.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:08.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:08 smithi195 ceph-mon[97365]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:08.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2023-07-21T22:15:08.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:09.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:09 smithi151 ceph-mon[95510]: Deploying daemon osd.9 on smithi151 2023-07-21T22:15:09.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:09 smithi187 ceph-mon[96918]: Deploying daemon osd.9 on smithi151 2023-07-21T22:15:09.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:09 smithi195 ceph-mon[97365]: Deploying daemon osd.9 on smithi151 2023-07-21T22:15:10.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:10 smithi187 ceph-mon[96918]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:10.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:10 smithi195 ceph-mon[97365]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:10.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:10 smithi151 ceph-mon[95510]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:12.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:12 smithi187 ceph-mon[96918]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:12.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:12 smithi195 ceph-mon[97365]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:12.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:12 smithi151 ceph-mon[95510]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:14.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:14 smithi187 ceph-mon[96918]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:14.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:14 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:14.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:14 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:14.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:14 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:14.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:14 smithi195 ceph-mon[97365]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:14.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:14 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:14.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:14 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:14.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:14 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:14.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:14 smithi151 ceph-mon[95510]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:14.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:14.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:14.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:14 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:16.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:16 smithi151 ceph-mon[95510]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:16.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:16 smithi187 ceph-mon[96918]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:16.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:16 smithi195 ceph-mon[97365]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:17.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.383+0000 7f3a04ff9700 1 -- 172.21.15.151:0/3644297221 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f3a08060950 con 0x7f39f00a11d0 2023-07-21T22:15:17.427 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 9 on host 'smithi151' 2023-07-21T22:15:17.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39f00a11d0 msgr2=0x7f39f00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:17.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39f00a11d0 0x7f39f00a3680 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f39fc00b5c0 tx=0x7f39fc005fb0 comp rx=0 tx=0).stop 2023-07-21T22:15:17.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080ffb90 msgr2=0x7f3a08197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:17.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080ffb90 0x7f3a08197a00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f39f800d9b0 tx=0x7f39f800dd70 comp rx=0 tx=0).stop 2023-07-21T22:15:17.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 shutdown_connections 2023-07-21T22:15:17.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39f00a11d0 0x7f39f00a3680 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:17.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a08101720 0x7f3a0819efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:17.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a080ffb90 0x7f3a08197a00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:17.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 --2- 172.21.15.151:0/3644297221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a08100d90 0x7f3a08197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:17.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 >> 172.21.15.151:0/3644297221 conn(0x7f3a080fb1a0 msgr2=0x7f3a08106760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:17.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 shutdown_connections 2023-07-21T22:15:17.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:15:17.386+0000 7f3a0e1bd700 1 -- 172.21.15.151:0/3644297221 wait complete. 2023-07-21T22:15:17.994 DEBUG:teuthology.orchestra.run.smithi151:osd.9> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.9.service 2023-07-21T22:15:17.998 INFO:tasks.cephadm:Deploying osd.10 on smithi187 with /dev/vg_nvme/lv_1... 2023-07-21T22:15:17.998 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-21T22:15:18.073 INFO:journalctl@ceph.osd.9.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:15:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:18 smithi195 ceph-mon[97365]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:18 smithi195 ceph-mon[97365]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-21T22:15:18.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:18 smithi151 ceph-mon[95510]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:18.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:18 smithi151 ceph-mon[95510]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-21T22:15:18.726 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T22:15:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:18 smithi187 ceph-mon[96918]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:18.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:18 smithi187 ceph-mon[96918]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2023-07-21T22:15:19.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:19 smithi187 ceph-mon[96918]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-07-21T22:15:19.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:19 smithi187 ceph-mon[96918]: osdmap e65: 10 total, 9 up, 10 in 2023-07-21T22:15:19.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:19 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:19.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:19 smithi187 ceph-mon[96918]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:15:19.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:19 smithi187 ceph-mon[96918]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:19.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:19 smithi195 ceph-mon[97365]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-07-21T22:15:19.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:19 smithi195 ceph-mon[97365]: osdmap e65: 10 total, 9 up, 10 in 2023-07-21T22:15:19.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:19 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:19.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:19 smithi195 ceph-mon[97365]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:15:19.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:19 smithi195 ceph-mon[97365]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:19.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:19 smithi151 ceph-mon[95510]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2023-07-21T22:15:19.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:19 smithi151 ceph-mon[95510]: osdmap e65: 10 total, 9 up, 10 in 2023-07-21T22:15:19.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:19 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:19.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:19 smithi151 ceph-mon[95510]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2023-07-21T22:15:19.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:19 smithi151 ceph-mon[95510]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:19.949 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 22:15:19 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T22:15:19.484+0000 7f5e82f3c700 -1 osd.9 0 waiting for initial osdmap 2023-07-21T22:15:19.950 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 22:15:19 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T22:15:19.501+0000 7f5e7e530700 -1 osd.9 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:15:20.671 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-21T22:15:20.671 INFO:teuthology.orchestra.run.smithi187.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-21T22:15:20.671 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10+0 records in 2023-07-21T22:15:20.672 INFO:teuthology.orchestra.run.smithi187.stderr:10+0 records out 2023-07-21T22:15:20.672 INFO:teuthology.orchestra.run.smithi187.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0296321 s, 354 MB/s 2023-07-21T22:15:20.672 INFO:teuthology.orchestra.run.smithi187.stderr:--> Zapping successful for: 2023-07-21T22:15:20.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:20 smithi151 ceph-mon[95510]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:15:20.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:20 smithi151 ceph-mon[95510]: osdmap e66: 10 total, 9 up, 10 in 2023-07-21T22:15:20.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:20 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:20.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:20 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:20.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:20 smithi187 ceph-mon[96918]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:15:20.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:20 smithi187 ceph-mon[96918]: osdmap e66: 10 total, 9 up, 10 in 2023-07-21T22:15:20.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:20 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:20.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:20 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:20.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:20 smithi195 ceph-mon[97365]: from='osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2023-07-21T22:15:20.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:20 smithi195 ceph-mon[97365]: osdmap e66: 10 total, 9 up, 10 in 2023-07-21T22:15:20.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:20 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:20.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:20 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:21.198 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi187:vg_nvme/lv_1 2023-07-21T22:15:21.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:15:21.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:15:21.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] boot 2023-07-21T22:15:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: osdmap e67: 10 total, 10 up, 10 in 2023-07-21T22:15:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi151 2023-07-21T22:15:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 4316M 2023-07-21T22:15:21.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:21.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:21.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:21.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:21.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:21.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:21 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:15:21.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:15:21.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] boot 2023-07-21T22:15:21.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: osdmap e67: 10 total, 10 up, 10 in 2023-07-21T22:15:21.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:21.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:21.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi151 2023-07-21T22:15:21.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 4316M 2023-07-21T22:15:21.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:21.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:21.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:21.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:21.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:21.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:21 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.925 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T22:15:21.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:15:21.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:15:21.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: osd.9 [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] boot 2023-07-21T22:15:21.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: osdmap e67: 10 total, 10 up, 10 in 2023-07-21T22:15:21.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:15:21.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 243 MiB used, 804 GiB / 805 GiB avail 2023-07-21T22:15:21.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi151 2023-07-21T22:15:21.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:21.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 4316M 2023-07-21T22:15:21.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:21.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:21.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:21.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:21.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:21.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:21.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:21 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:23.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:22 smithi187 ceph-mon[96918]: osdmap e68: 10 total, 10 up, 10 in 2023-07-21T22:15:23.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:22 smithi151 ceph-mon[95510]: osdmap e68: 10 total, 10 up, 10 in 2023-07-21T22:15:23.399 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.355+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1811076590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8101720 msgr2=0x7f2ec8107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:23.399 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.355+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1811076590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8101720 0x7f2ec8107fe0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000b0a0 tx=0x7f2ec000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:15:23.399 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.356+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1811076590 shutdown_connections 2023-07-21T22:15:23.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.356+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1811076590 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8101720 0x7f2ec8107fe0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:23.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.356+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1811076590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ec80ffb90 0x7f2ec80fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:23.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.356+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1811076590 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ec8100d90 0x7f2ec81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:23.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.356+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1811076590 >> 172.21.15.187:0/1811076590 conn(0x7f2ec80fb1a0 msgr2=0x7f2ec80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:23.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.356+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1811076590 shutdown_connections 2023-07-21T22:15:23.400 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.356+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1811076590 wait complete. 2023-07-21T22:15:23.402 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ecd2d2700 1 Processor -- start 2023-07-21T22:15:23.402 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ecd2d2700 1 -- start start 2023-07-21T22:15:23.402 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ecd2d2700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ec80ffb90 0x7f2ec80742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:23.402 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ecd2d2700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8100d90 0x7f2ec8072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:23.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ecd2d2700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ec8101720 0x7f2ec8072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:23.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ecd2d2700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec80735c0 con 0x7f2ec8101720 2023-07-21T22:15:23.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ecd2d2700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec8073730 con 0x7f2ec8100d90 2023-07-21T22:15:23.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ecd2d2700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ec819f930 con 0x7f2ec80ffb90 2023-07-21T22:15:23.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ec67fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8100d90 0x7f2ec8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:23.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ec67fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8100d90 0x7f2ec8072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:51352/0 (socket says 172.21.15.187:51352) 2023-07-21T22:15:23.403 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.357+0000 7f2ec67fc700 1 -- 172.21.15.187:0/1564136009 learned_addr learned my addr 172.21.15.187:0/1564136009 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-07-21T22:15:23.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ec6ffd700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ec80ffb90 0x7f2ec80742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:23.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ec77fe700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ec8101720 0x7f2ec8072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:23.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ec67fc700 1 -- 172.21.15.187:0/1564136009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ec80ffb90 msgr2=0x7f2ec80742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:23.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ec67fc700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ec80ffb90 0x7f2ec80742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:23.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ec67fc700 1 -- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ec8101720 msgr2=0x7f2ec8072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:23.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ec67fc700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ec8101720 0x7f2ec8072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:23.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ec67fc700 1 -- 172.21.15.187:0/1564136009 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0009d00 con 0x7f2ec8100d90 2023-07-21T22:15:23.404 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ec77fe700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ec8101720 0x7f2ec8072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:15:23.405 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ec67fc700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8100d90 0x7f2ec8072900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e9c0 tx=0x7f2ebc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:23.405 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2eaffff700 1 -- 172.21.15.187:0/1564136009 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc0097b0 con 0x7f2ec8100d90 2023-07-21T22:15:23.405 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2eaffff700 1 -- 172.21.15.187:0/1564136009 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ebc004cc0 con 0x7f2ec8100d90 2023-07-21T22:15:23.405 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ec819fc10 con 0x7f2ec8100d90 2023-07-21T22:15:23.405 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.358+0000 7f2eaffff700 1 -- 172.21.15.187:0/1564136009 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ebc005530 con 0x7f2ec8100d90 2023-07-21T22:15:23.405 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.359+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ec81a0110 con 0x7f2ec8100d90 2023-07-21T22:15:23.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:22 smithi195 ceph-mon[97365]: osdmap e68: 10 total, 10 up, 10 in 2023-07-21T22:15:23.406 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.360+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ec8107180 con 0x7f2ec8100d90 2023-07-21T22:15:23.407 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.362+0000 7f2eaffff700 1 -- 172.21.15.187:0/1564136009 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2ebc004750 con 0x7f2ec8100d90 2023-07-21T22:15:23.407 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.363+0000 7f2eaffff700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2eb00a11d0 0x7f2eb00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:23.407 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.363+0000 7f2eaffff700 1 -- 172.21.15.187:0/1564136009 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 6261+0+0 (secure 0 0 0) 0x7f2ebc014070 con 0x7f2ec8100d90 2023-07-21T22:15:23.407 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.363+0000 7f2ec6ffd700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2eb00a11d0 0x7f2eb00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:23.407 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.364+0000 7f2ec6ffd700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2eb00a11d0 0x7f2eb00a3680 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8100bf0 tx=0x7f2eb8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:23.408 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.365+0000 7f2eaffff700 1 -- 172.21.15.187:0/1564136009 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2ebc0964b0 con 0x7f2ec8100d90 2023-07-21T22:15:23.609 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:23.566+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ec8060950 con 0x7f2eb00a11d0 2023-07-21T22:15:24.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:23 smithi151 ceph-mon[95510]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:24.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:15:24.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:15:24.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:23 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:24.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:23 smithi187 ceph-mon[96918]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:24.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:15:24.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:15:24.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:23 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:24.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:23 smithi195 ceph-mon[97365]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:24.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:15:24.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:15:24.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:23 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:24.962 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:24 smithi187 ceph-mon[96918]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:15:25.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:24 smithi151 ceph-mon[95510]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:15:25.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:24 smithi195 ceph-mon[97365]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi187:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:15:26.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:25 smithi151 ceph-mon[95510]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:26.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:25 smithi187 ceph-mon[96918]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:26.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:25 smithi195 ceph-mon[97365]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:27.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:27 smithi151 ceph-mon[95510]: from='client.? 172.21.15.187:0/3663403712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408af95-5fda-41f2-8251-f56ed4efde80"}]: dispatch 2023-07-21T22:15:27.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:27 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408af95-5fda-41f2-8251-f56ed4efde80"}]: dispatch 2023-07-21T22:15:27.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:27 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2408af95-5fda-41f2-8251-f56ed4efde80"}]': finished 2023-07-21T22:15:27.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:27 smithi151 ceph-mon[95510]: osdmap e69: 11 total, 10 up, 11 in 2023-07-21T22:15:27.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:27 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:27.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:27 smithi187 ceph-mon[96918]: from='client.? 172.21.15.187:0/3663403712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408af95-5fda-41f2-8251-f56ed4efde80"}]: dispatch 2023-07-21T22:15:27.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:27 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408af95-5fda-41f2-8251-f56ed4efde80"}]: dispatch 2023-07-21T22:15:27.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:27 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2408af95-5fda-41f2-8251-f56ed4efde80"}]': finished 2023-07-21T22:15:27.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:27 smithi187 ceph-mon[96918]: osdmap e69: 11 total, 10 up, 11 in 2023-07-21T22:15:27.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:27 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:27.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:27 smithi195 ceph-mon[97365]: from='client.? 172.21.15.187:0/3663403712' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408af95-5fda-41f2-8251-f56ed4efde80"}]: dispatch 2023-07-21T22:15:27.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:27 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2408af95-5fda-41f2-8251-f56ed4efde80"}]: dispatch 2023-07-21T22:15:27.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:27 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2408af95-5fda-41f2-8251-f56ed4efde80"}]': finished 2023-07-21T22:15:27.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:27 smithi195 ceph-mon[97365]: osdmap e69: 11 total, 10 up, 11 in 2023-07-21T22:15:27.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:27 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:28.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:28 smithi151 ceph-mon[95510]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:28.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:28 smithi151 ceph-mon[95510]: from='client.? 172.21.15.187:0/3670424711' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:15:28.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:28 smithi187 ceph-mon[96918]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:28.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:28 smithi187 ceph-mon[96918]: from='client.? 172.21.15.187:0/3670424711' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:15:28.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:28 smithi195 ceph-mon[97365]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:28.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:28 smithi195 ceph-mon[97365]: from='client.? 172.21.15.187:0/3670424711' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:15:30.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:30 smithi151 ceph-mon[95510]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:30.454 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:30 smithi187 ceph-mon[96918]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:30.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:30 smithi195 ceph-mon[97365]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:32.361 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:32 smithi187 ceph-mon[96918]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:32.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:32 smithi151 ceph-mon[95510]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:32.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:32 smithi195 ceph-mon[97365]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:34.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:34 smithi187 ceph-mon[96918]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:34.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:34 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-21T22:15:34.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:34 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:34.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:34 smithi151 ceph-mon[95510]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:34.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:34 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-21T22:15:34.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:34 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:34.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:34 smithi195 ceph-mon[97365]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:34.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:34 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2023-07-21T22:15:34.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:34 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:35.302 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:35 smithi187 ceph-mon[96918]: Deploying daemon osd.10 on smithi187 2023-07-21T22:15:35.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:35 smithi195 ceph-mon[97365]: Deploying daemon osd.10 on smithi187 2023-07-21T22:15:35.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:35 smithi151 ceph-mon[95510]: Deploying daemon osd.10 on smithi187 2023-07-21T22:15:36.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:36 smithi187 ceph-mon[96918]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:36.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:36 smithi195 ceph-mon[97365]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:36.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:36 smithi151 ceph-mon[95510]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:38.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:38 smithi187 ceph-mon[96918]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:38.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:38 smithi195 ceph-mon[97365]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:38.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:38 smithi151 ceph-mon[95510]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:40.213 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:40 smithi187 ceph-mon[96918]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:40.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:40 smithi195 ceph-mon[97365]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:40.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:40 smithi151 ceph-mon[95510]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:41.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:41 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:41.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:41 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:41.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:41 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:41.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:41 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:41.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:41 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:41.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:41 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:41.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:41 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:41.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:41 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:41.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:41 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:42 smithi187 ceph-mon[96918]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:42.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:42 smithi195 ceph-mon[97365]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:42.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:42 smithi151 ceph-mon[95510]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:44.136 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.092+0000 7f2eaffff700 1 -- 172.21.15.187:0/1564136009 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f2ec8060950 con 0x7f2eb00a11d0 2023-07-21T22:15:44.137 INFO:teuthology.orchestra.run.smithi187.stdout:Created osd(s) 10 on host 'smithi187' 2023-07-21T22:15:44.138 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2eb00a11d0 msgr2=0x7f2eb00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:44.139 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2eb00a11d0 0x7f2eb00a3680 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8100bf0 tx=0x7f2eb8009260 comp rx=0 tx=0).stop 2023-07-21T22:15:44.139 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8100d90 msgr2=0x7f2ec8072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:44.139 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8100d90 0x7f2ec8072900 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc00e9c0 tx=0x7f2ebc00ecd0 comp rx=0 tx=0).stop 2023-07-21T22:15:44.139 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 shutdown_connections 2023-07-21T22:15:44.139 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2eb00a11d0 0x7f2eb00a3680 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:44.139 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ec8101720 0x7f2ec8072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:44.140 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ec80ffb90 0x7f2ec80742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:44.140 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 --2- 172.21.15.187:0/1564136009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ec8100d90 0x7f2ec8072900 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:44.140 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 >> 172.21.15.187:0/1564136009 conn(0x7f2ec80fb1a0 msgr2=0x7f2ec81042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:44.140 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 shutdown_connections 2023-07-21T22:15:44.140 INFO:teuthology.orchestra.run.smithi187.stderr:2023-07-21T22:15:44.095+0000 7f2ecd2d2700 1 -- 172.21.15.187:0/1564136009 wait complete. 2023-07-21T22:15:44.324 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:44 smithi187 ceph-mon[96918]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:44.325 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:44.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:44.646 DEBUG:teuthology.orchestra.run.smithi187:osd.10> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.10.service 2023-07-21T22:15:44.650 INFO:tasks.cephadm:Deploying osd.11 on smithi195 with /dev/vg_nvme/lv_1... 2023-07-21T22:15:44.650 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2023-07-21T22:15:44.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:44 smithi195 ceph-mon[97365]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:44.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:44 smithi151 ceph-mon[95510]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:44.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:44.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:44.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:44.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:15:44.730 INFO:journalctl@ceph.osd.10.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:15:45.378 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:15:45.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:45 smithi187 ceph-mon[96918]: from='osd.10 [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-21T22:15:45.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:45 smithi187 ceph-mon[96918]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-21T22:15:45.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:45 smithi195 ceph-mon[97365]: from='osd.10 [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-21T22:15:45.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:45 smithi195 ceph-mon[97365]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-21T22:15:45.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:45 smithi151 ceph-mon[95510]: from='osd.10 [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-21T22:15:45.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:45 smithi151 ceph-mon[95510]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2023-07-21T22:15:46.506 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:46 smithi195 ceph-mon[97365]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:46.507 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:46 smithi195 ceph-mon[97365]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-07-21T22:15:46.507 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:46 smithi195 ceph-mon[97365]: osdmap e70: 11 total, 10 up, 11 in 2023-07-21T22:15:46.507 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:46 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:46.507 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:46 smithi195 ceph-mon[97365]: from='osd.10 [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:15:46.507 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:46 smithi195 ceph-mon[97365]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:15:46.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:46 smithi187 ceph-mon[96918]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:46.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:46 smithi187 ceph-mon[96918]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-07-21T22:15:46.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:46 smithi187 ceph-mon[96918]: osdmap e70: 11 total, 10 up, 11 in 2023-07-21T22:15:46.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:46 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:46.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:46 smithi187 ceph-mon[96918]: from='osd.10 [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:15:46.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:46 smithi187 ceph-mon[96918]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:15:46.629 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 22:15:46 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T22:15:46.307+0000 7f29d3c25700 -1 osd.10 0 waiting for initial osdmap 2023-07-21T22:15:46.629 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 22:15:46 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T22:15:46.327+0000 7f29cba12700 -1 osd.10 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:15:46.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:46 smithi151 ceph-mon[95510]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:46.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:46 smithi151 ceph-mon[95510]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2023-07-21T22:15:46.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:46 smithi151 ceph-mon[95510]: osdmap e70: 11 total, 10 up, 11 in 2023-07-21T22:15:46.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:46 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:46.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:46 smithi151 ceph-mon[95510]: from='osd.10 [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:15:46.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:46 smithi151 ceph-mon[95510]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]: dispatch 2023-07-21T22:15:47.182 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping: /dev/vg_nvme/lv_1 2023-07-21T22:15:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2023-07-21T22:15:47.183 INFO:teuthology.orchestra.run.smithi195.stderr: stderr: 10+0 records in 2023-07-21T22:15:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:10+0 records out 2023-07-21T22:15:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0295584 s, 355 MB/s 2023-07-21T22:15:47.183 INFO:teuthology.orchestra.run.smithi195.stderr:--> Zapping successful for: 2023-07-21T22:15:47.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:47 smithi187 ceph-mon[96918]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:15:47.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:47 smithi187 ceph-mon[96918]: osdmap e71: 11 total, 10 up, 11 in 2023-07-21T22:15:47.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:47 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:47.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:47 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:47.611 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:47 smithi195 ceph-mon[97365]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:15:47.611 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:47 smithi195 ceph-mon[97365]: osdmap e71: 11 total, 10 up, 11 in 2023-07-21T22:15:47.612 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:47 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:47.612 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:47 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:47.652 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch daemon add osd smithi195:vg_nvme/lv_1 2023-07-21T22:15:47.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:47 smithi151 ceph-mon[95510]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi187", "root=default"]}]': finished 2023-07-21T22:15:47.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:47 smithi151 ceph-mon[95510]: osdmap e71: 11 total, 10 up, 11 in 2023-07-21T22:15:47.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:47 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:47.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:47 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:48.374 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:15:48.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:15:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:15:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:48.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: osd.10 [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] boot 2023-07-21T22:15:48.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: osdmap e72: 11 total, 11 up, 11 in 2023-07-21T22:15:48.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:48.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:48.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:48.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:15:48.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:15:48.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:48.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:48.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: osd.10 [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] boot 2023-07-21T22:15:48.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: osdmap e72: 11 total, 11 up, 11 in 2023-07-21T22:15:48.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:48.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:48.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:48.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:15:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:15:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 894 GiB / 894 GiB avail 2023-07-21T22:15:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: osd.10 [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] boot 2023-07-21T22:15:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: osdmap e72: 11 total, 11 up, 11 in 2023-07-21T22:15:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:15:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:15:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:15:48.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:15:49.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:49 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi187 2023-07-21T22:15:49.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:49 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 4316M 2023-07-21T22:15:49.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:49 smithi187 ceph-mon[96918]: osdmap e73: 11 total, 11 up, 11 in 2023-07-21T22:15:49.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:49 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi187 2023-07-21T22:15:49.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:49 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 4316M 2023-07-21T22:15:49.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:49 smithi195 ceph-mon[97365]: osdmap e73: 11 total, 11 up, 11 in 2023-07-21T22:15:49.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:49 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi187 2023-07-21T22:15:49.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:49 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 4316M 2023-07-21T22:15:49.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:49 smithi151 ceph-mon[95510]: osdmap e73: 11 total, 11 up, 11 in 2023-07-21T22:15:49.759 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.715+0000 7f399aa88700 1 -- 172.21.15.195:0/3719037243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 msgr2=0x7f39940733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:49.759 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.715+0000 7f399aa88700 1 --2- 172.21.15.195:0/3719037243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 0x7f39940733e0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f3980009990 tx=0x7f3980009ca0 comp rx=0 tx=0).stop 2023-07-21T22:15:49.759 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.715+0000 7f399aa88700 1 -- 172.21.15.195:0/3719037243 shutdown_connections 2023-07-21T22:15:49.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.715+0000 7f399aa88700 1 --2- 172.21.15.195:0/3719037243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3994074540 0x7f39940729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:49.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.715+0000 7f399aa88700 1 --2- 172.21.15.195:0/3719037243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3994107a60 0x7f3994109ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:49.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.715+0000 7f399aa88700 1 --2- 172.21.15.195:0/3719037243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 0x7f39940733e0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:49.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.715+0000 7f399aa88700 1 -- 172.21.15.195:0/3719037243 >> 172.21.15.195:0/3719037243 conn(0x7f39940fb1a0 msgr2=0x7f39940fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:15:49.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.715+0000 7f399aa88700 1 -- 172.21.15.195:0/3719037243 shutdown_connections 2023-07-21T22:15:49.760 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.715+0000 7f399aa88700 1 -- 172.21.15.195:0/3719037243 wait complete. 2023-07-21T22:15:49.762 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.716+0000 7f399aa88700 1 Processor -- start 2023-07-21T22:15:49.762 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.716+0000 7f399aa88700 1 -- start start 2023-07-21T22:15:49.762 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.716+0000 7f399aa88700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 0x7f3994197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:49.762 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.716+0000 7f399aa88700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3994074540 0x7f3994197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:49.762 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.716+0000 7f399aa88700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3994107a60 0x7f399419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:49.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.716+0000 7f399aa88700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399419f5b0 con 0x7f3994107a60 2023-07-21T22:15:49.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.716+0000 7f399aa88700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399419f6f0 con 0x7f3994074540 2023-07-21T22:15:49.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.716+0000 7f399aa88700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f399419f880 con 0x7f3994072f70 2023-07-21T22:15:49.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3998824700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 0x7f3994197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:49.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3998824700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 0x7f3994197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:51444/0 (socket says 172.21.15.195:51444) 2023-07-21T22:15:49.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3998824700 1 -- 172.21.15.195:0/1971955320 learned_addr learned my addr 172.21.15.195:0/1971955320 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:15:49.763 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3993fff700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3994074540 0x7f3994197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:49.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3999025700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3994107a60 0x7f399419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:49.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3998824700 1 -- 172.21.15.195:0/1971955320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3994074540 msgr2=0x7f3994197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:49.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3998824700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3994074540 0x7f3994197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:49.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3998824700 1 -- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3994107a60 msgr2=0x7f399419efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:15:49.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3998824700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3994107a60 0x7f399419efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:15:49.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3998824700 1 -- 172.21.15.195:0/1971955320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39800095f0 con 0x7f3994072f70 2023-07-21T22:15:49.764 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.717+0000 7f3998824700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 0x7f3994197a20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f398800d980 tx=0x7f398800dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:49.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.718+0000 7f3991ffb700 1 -- 172.21.15.195:0/1971955320 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3988009b40 con 0x7f3994072f70 2023-07-21T22:15:49.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.718+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f399419fb60 con 0x7f3994072f70 2023-07-21T22:15:49.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.718+0000 7f3991ffb700 1 -- 172.21.15.195:0/1971955320 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f398800b6e0 con 0x7f3994072f70 2023-07-21T22:15:49.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.718+0000 7f3991ffb700 1 -- 172.21.15.195:0/1971955320 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f398800f3c0 con 0x7f3994072f70 2023-07-21T22:15:49.765 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.718+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39941a0060 con 0x7f3994072f70 2023-07-21T22:15:49.766 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.719+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3994106110 con 0x7f3994072f70 2023-07-21T22:15:49.766 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.722+0000 7f3991ffb700 1 -- 172.21.15.195:0/1971955320 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3988010460 con 0x7f3994072f70 2023-07-21T22:15:49.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.724+0000 7f3991ffb700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39840a1150 0x7f39840a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:15:49.767 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.724+0000 7f3991ffb700 1 -- 172.21.15.195:0/1971955320 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6723+0+0 (secure 0 0 0) 0x7f39880cc2a0 con 0x7f3994072f70 2023-07-21T22:15:49.768 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.724+0000 7f3993fff700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39840a1150 0x7f39840a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:15:49.768 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.725+0000 7f3993fff700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39840a1150 0x7f39840a3600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f398000b5c0 tx=0x7f3980009f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:15:49.769 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.726+0000 7f3991ffb700 1 -- 172.21.15.195:0/1971955320 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f3988095f80 con 0x7f3994072f70 2023-07-21T22:15:49.974 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:15:49.930+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7f3994060950 con 0x7f39840a1150 2023-07-21T22:15:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:50 smithi187 ceph-mon[96918]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:15:50.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:50 smithi187 ceph-mon[96918]: osdmap e74: 11 total, 11 up, 11 in 2023-07-21T22:15:50.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:15:50.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:15:50.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:50 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:50.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:50 smithi195 ceph-mon[97365]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:15:50.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:50 smithi195 ceph-mon[97365]: osdmap e74: 11 total, 11 up, 11 in 2023-07-21T22:15:50.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:15:50.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:15:50.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:50 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:50.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:50 smithi151 ceph-mon[95510]: pgmap v246: 1 pgs: 1 remapped+peering; 577 KiB data, 297 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:15:50.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:50 smithi151 ceph-mon[95510]: osdmap e74: 11 total, 11 up, 11 in 2023-07-21T22:15:50.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2023-07-21T22:15:50.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2023-07-21T22:15:50.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:50 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:15:51.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:51 smithi195 ceph-mon[97365]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:15:51.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:51 smithi195 ceph-mon[97365]: osdmap e75: 11 total, 11 up, 11 in 2023-07-21T22:15:51.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:51 smithi151 ceph-mon[95510]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:15:51.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:51 smithi151 ceph-mon[95510]: osdmap e75: 11 total, 11 up, 11 in 2023-07-21T22:15:51.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:51 smithi187 ceph-mon[96918]: from='client.24400 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi195:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:15:51.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:51 smithi187 ceph-mon[96918]: osdmap e75: 11 total, 11 up, 11 in 2023-07-21T22:15:52.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:52 smithi195 ceph-mon[97365]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:15:52.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:52 smithi195 ceph-mon[97365]: osdmap e76: 11 total, 11 up, 11 in 2023-07-21T22:15:52.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:52 smithi151 ceph-mon[95510]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:15:52.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:52 smithi151 ceph-mon[95510]: osdmap e76: 11 total, 11 up, 11 in 2023-07-21T22:15:52.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:52 smithi187 ceph-mon[96918]: pgmap v249: 1 pgs: 1 remapped+peering; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:15:52.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:52 smithi187 ceph-mon[96918]: osdmap e76: 11 total, 11 up, 11 in 2023-07-21T22:15:53.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:53 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/3035610659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4071400e-d6ce-4ed6-8dc3-7c5e94774861"}]: dispatch 2023-07-21T22:15:53.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:53 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4071400e-d6ce-4ed6-8dc3-7c5e94774861"}]: dispatch 2023-07-21T22:15:53.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:53 smithi195 ceph-mon[97365]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4071400e-d6ce-4ed6-8dc3-7c5e94774861"}]': finished 2023-07-21T22:15:53.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:53 smithi195 ceph-mon[97365]: osdmap e77: 12 total, 11 up, 12 in 2023-07-21T22:15:53.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:53 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:15:53.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:53 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/3035610659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4071400e-d6ce-4ed6-8dc3-7c5e94774861"}]: dispatch 2023-07-21T22:15:53.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:53 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4071400e-d6ce-4ed6-8dc3-7c5e94774861"}]: dispatch 2023-07-21T22:15:53.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:53 smithi151 ceph-mon[95510]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4071400e-d6ce-4ed6-8dc3-7c5e94774861"}]': finished 2023-07-21T22:15:53.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:53 smithi151 ceph-mon[95510]: osdmap e77: 12 total, 11 up, 12 in 2023-07-21T22:15:53.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:53 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:15:53.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:53 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/3035610659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4071400e-d6ce-4ed6-8dc3-7c5e94774861"}]: dispatch 2023-07-21T22:15:53.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:53 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4071400e-d6ce-4ed6-8dc3-7c5e94774861"}]: dispatch 2023-07-21T22:15:53.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:53 smithi187 ceph-mon[96918]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4071400e-d6ce-4ed6-8dc3-7c5e94774861"}]': finished 2023-07-21T22:15:53.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:53 smithi187 ceph-mon[96918]: osdmap e77: 12 total, 11 up, 12 in 2023-07-21T22:15:53.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:53 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:15:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:54 smithi195 ceph-mon[97365]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 128 KiB/s, 0 objects/s recovering 2023-07-21T22:15:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:54 smithi195 ceph-mon[97365]: from='client.? 172.21.15.195:0/2297426263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:15:54.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:54 smithi151 ceph-mon[95510]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 128 KiB/s, 0 objects/s recovering 2023-07-21T22:15:54.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:54 smithi151 ceph-mon[95510]: from='client.? 172.21.15.195:0/2297426263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:15:54.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:54 smithi187 ceph-mon[96918]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 128 KiB/s, 0 objects/s recovering 2023-07-21T22:15:54.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:54 smithi187 ceph-mon[96918]: from='client.? 172.21.15.195:0/2297426263' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2023-07-21T22:15:56.655 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:56 smithi195 ceph-mon[97365]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-07-21T22:15:56.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:56 smithi151 ceph-mon[95510]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-07-21T22:15:56.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:56 smithi187 ceph-mon[96918]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 105 KiB/s, 0 objects/s recovering 2023-07-21T22:15:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:15:58 smithi195 ceph-mon[97365]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-07-21T22:15:58.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:15:58 smithi151 ceph-mon[95510]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-07-21T22:15:58.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:15:58 smithi187 ceph-mon[96918]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 89 KiB/s, 0 objects/s recovering 2023-07-21T22:16:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:00 smithi195 ceph-mon[97365]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-21T22:16:00.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:00 smithi151 ceph-mon[95510]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-21T22:16:00.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:00 smithi187 ceph-mon[96918]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2023-07-21T22:16:01.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-21T22:16:01.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:01.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-21T22:16:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:01.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2023-07-21T22:16:01.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:02 smithi195 ceph-mon[97365]: Deploying daemon osd.11 on smithi195 2023-07-21T22:16:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:02 smithi195 ceph-mon[97365]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2023-07-21T22:16:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:02 smithi151 ceph-mon[95510]: Deploying daemon osd.11 on smithi195 2023-07-21T22:16:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:02 smithi151 ceph-mon[95510]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2023-07-21T22:16:02.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:02 smithi187 ceph-mon[96918]: Deploying daemon osd.11 on smithi195 2023-07-21T22:16:02.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:02 smithi187 ceph-mon[96918]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail; 61 KiB/s, 0 objects/s recovering 2023-07-21T22:16:04.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:04 smithi151 ceph-mon[95510]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:04.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:04 smithi187 ceph-mon[96918]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:04.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:04 smithi195 ceph-mon[97365]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:06.503 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:06 smithi195 ceph-mon[97365]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:06.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:06 smithi151 ceph-mon[95510]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:06.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:06 smithi187 ceph-mon[96918]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:07.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:07 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:07.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:07 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:07.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:07 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:16:07.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:07 smithi187 ceph-mon[96918]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:07.884 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:07 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:07.885 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:07 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:07.885 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:07 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:16:07.885 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:07 smithi195 ceph-mon[97365]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:07.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:07 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:07.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:07 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:07.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:07 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:16:07.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:07 smithi151 ceph-mon[95510]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:09.899 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.857+0000 7f3991ffb700 1 -- 172.21.15.195:0/1971955320 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+38 (secure 0 0 0) 0x7f3994060950 con 0x7f39840a1150 2023-07-21T22:16:09.900 INFO:teuthology.orchestra.run.smithi195.stdout:Created osd(s) 11 on host 'smithi195' 2023-07-21T22:16:09.902 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39840a1150 msgr2=0x7f39840a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:09.902 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39840a1150 0x7f39840a3600 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f398000b5c0 tx=0x7f3980009f00 comp rx=0 tx=0).stop 2023-07-21T22:16:09.903 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 msgr2=0x7f3994197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:09.903 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 0x7f3994197a20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f398800d980 tx=0x7f398800dc90 comp rx=0 tx=0).stop 2023-07-21T22:16:09.903 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 shutdown_connections 2023-07-21T22:16:09.903 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f39840a1150 0x7f39840a3600 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:09.903 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3994107a60 0x7f399419efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:09.903 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3994072f70 0x7f3994197a20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:09.903 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 --2- 172.21.15.195:0/1971955320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3994074540 0x7f3994197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:09.904 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.859+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 >> 172.21.15.195:0/1971955320 conn(0x7f39940fb1a0 msgr2=0x7f39940fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:09.904 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.860+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 shutdown_connections 2023-07-21T22:16:09.904 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:09.860+0000 7f399aa88700 1 -- 172.21.15.195:0/1971955320 wait complete. 2023-07-21T22:16:10.108 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:09 smithi195 ceph-mon[97365]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:10.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:10.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:16:10.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.109 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:09 smithi151 ceph-mon[95510]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:10.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:16:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:09 smithi187 ceph-mon[96918]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:10.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:10.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:16:10.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:10.386 DEBUG:teuthology.orchestra.run.smithi195:osd.11> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.11.service 2023-07-21T22:16:10.391 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2023-07-21T22:16:10.391 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd stat -f json 2023-07-21T22:16:10.465 INFO:journalctl@ceph.osd.11.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:16:10.656 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 22:16:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T22:16:10.511+0000 7f5d12c59640 -1 osd.11 0 log_to_monitors true 2023-07-21T22:16:11.124 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:16:11.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:10 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:16:11.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:10 smithi151 ceph-mon[95510]: from='osd.11 [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-21T22:16:11.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:10 smithi151 ceph-mon[95510]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-21T22:16:11.300 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:10 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:16:11.300 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:10 smithi195 ceph-mon[97365]: from='osd.11 [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-21T22:16:11.300 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:10 smithi195 ceph-mon[97365]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-21T22:16:11.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:10 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:16:11.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:10 smithi187 ceph-mon[96918]: from='osd.11 [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-21T22:16:11.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:10 smithi187 ceph-mon[96918]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2023-07-21T22:16:12.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:11 smithi151 ceph-mon[95510]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:11 smithi151 ceph-mon[95510]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-07-21T22:16:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:11 smithi151 ceph-mon[95510]: osdmap e78: 12 total, 11 up, 12 in 2023-07-21T22:16:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:11 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:11 smithi151 ceph-mon[95510]: from='osd.11 [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:16:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:11 smithi151 ceph-mon[95510]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:16:12.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:11 smithi187 ceph-mon[96918]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:12.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:11 smithi187 ceph-mon[96918]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-07-21T22:16:12.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:11 smithi187 ceph-mon[96918]: osdmap e78: 12 total, 11 up, 12 in 2023-07-21T22:16:12.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:11 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:12.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:11 smithi187 ceph-mon[96918]: from='osd.11 [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:16:12.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:11 smithi187 ceph-mon[96918]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:16:12.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:11 smithi195 ceph-mon[97365]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:12.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:11 smithi195 ceph-mon[97365]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2023-07-21T22:16:12.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:11 smithi195 ceph-mon[97365]: osdmap e78: 12 total, 11 up, 12 in 2023-07-21T22:16:12.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:11 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:12.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:11 smithi195 ceph-mon[97365]: from='osd.11 [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:16:12.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:11 smithi195 ceph-mon[97365]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]: dispatch 2023-07-21T22:16:12.407 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 22:16:11 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T22:16:11.909+0000 7f5d082d1700 -1 osd.11 0 waiting for initial osdmap 2023-07-21T22:16:12.407 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 22:16:11 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T22:16:11.926+0000 7f5d010c0700 -1 osd.11 79 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-07-21T22:16:12.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.618+0000 7f819016f700 1 -- 172.21.15.151:0/2051597611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8188107a50 msgr2=0x7f8188109ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.618+0000 7f819016f700 1 --2- 172.21.15.151:0/2051597611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8188107a50 0x7f8188109ed0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f818000b0a0 tx=0x7f818000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.618+0000 7f819016f700 1 -- 172.21.15.151:0/2051597611 shutdown_connections 2023-07-21T22:16:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.618+0000 7f819016f700 1 --2- 172.21.15.151:0/2051597611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81880744c0 0x7f8188072920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.618+0000 7f819016f700 1 --2- 172.21.15.151:0/2051597611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8188107a50 0x7f8188109ed0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.618+0000 7f819016f700 1 --2- 172.21.15.151:0/2051597611 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8188072ef0 0x7f8188073360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.618+0000 7f819016f700 1 -- 172.21.15.151:0/2051597611 >> 172.21.15.151:0/2051597611 conn(0x7f81880fb1a0 msgr2=0x7f81880fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:12.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.619+0000 7f819016f700 1 -- 172.21.15.151:0/2051597611 shutdown_connections 2023-07-21T22:16:12.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.619+0000 7f819016f700 1 -- 172.21.15.151:0/2051597611 wait complete. 2023-07-21T22:16:12.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f819016f700 1 Processor -- start 2023-07-21T22:16:12.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f819016f700 1 -- start start 2023-07-21T22:16:12.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f819016f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8188072ef0 0x7f8188197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f819016f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81880744c0 0x7f8188197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f819016f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8188107a50 0x7f818819f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f819016f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818819f600 con 0x7f81880744c0 2023-07-21T22:16:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f819016f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818819f740 con 0x7f8188072ef0 2023-07-21T22:16:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f819016f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f818819f8d0 con 0x7f8188107a50 2023-07-21T22:16:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f818d70a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81880744c0 0x7f8188197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f818d70a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81880744c0 0x7f8188197fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48984/0 (socket says 172.21.15.151:48984) 2023-07-21T22:16:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.620+0000 7f818d70a700 1 -- 172.21.15.151:0/1256231097 learned_addr learned my addr 172.21.15.151:0/1256231097 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f818e70c700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8188107a50 0x7f818819f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f818df0b700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8188072ef0 0x7f8188197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f818d70a700 1 -- 172.21.15.151:0/1256231097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8188107a50 msgr2=0x7f818819f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f818d70a700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8188107a50 0x7f818819f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f818d70a700 1 -- 172.21.15.151:0/1256231097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8188072ef0 msgr2=0x7f8188197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f818d70a700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8188072ef0 0x7f8188197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f818d70a700 1 -- 172.21.15.151:0/1256231097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8180009d00 con 0x7f81880744c0 2023-07-21T22:16:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f818e70c700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8188107a50 0x7f818819f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:16:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f818d70a700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81880744c0 0x7f8188197fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f817800e9d0 tx=0x7f817800ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f817effd700 1 -- 172.21.15.151:0/1256231097 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178009790 con 0x7f81880744c0 2023-07-21T22:16:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f818819fbb0 con 0x7f81880744c0 2023-07-21T22:16:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f817effd700 1 -- 172.21.15.151:0/1256231097 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f817800ee70 con 0x7f81880744c0 2023-07-21T22:16:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.621+0000 7f817effd700 1 -- 172.21.15.151:0/1256231097 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8178018420 con 0x7f81880744c0 2023-07-21T22:16:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.622+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81881a00b0 con 0x7f81880744c0 2023-07-21T22:16:12.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.623+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8188106190 con 0x7f81880744c0 2023-07-21T22:16:12.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.625+0000 7f817effd700 1 -- 172.21.15.151:0/1256231097 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f817800cbd0 con 0x7f81880744c0 2023-07-21T22:16:12.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.626+0000 7f817effd700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81740a1150 0x7f81740a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:12.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.626+0000 7f817effd700 1 -- 172.21.15.151:0/1256231097 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 6847+0+0 (secure 0 0 0) 0x7f8178014070 con 0x7f81880744c0 2023-07-21T22:16:12.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.626+0000 7f818df0b700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81740a1150 0x7f81740a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:12.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.627+0000 7f818df0b700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81740a1150 0x7f81740a3600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8184005950 tx=0x7f818400a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:12.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.630+0000 7f817effd700 1 -- 172.21.15.151:0/1256231097 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8178051770 con 0x7f81880744c0 2023-07-21T22:16:12.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.828+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f818802c850 con 0x7f81880744c0 2023-07-21T22:16:12.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.829+0000 7f817effd700 1 -- 172.21.15.151:0/1256231097 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v79) v1 ==== 74+0+133 (secure 0 0 0) 0x7f81780961f0 con 0x7f81880744c0 2023-07-21T22:16:12.873 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:12.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81740a1150 msgr2=0x7f81740a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:12.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81740a1150 0x7f81740a3600 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f8184005950 tx=0x7f818400a300 comp rx=0 tx=0).stop 2023-07-21T22:16:12.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81880744c0 msgr2=0x7f8188197fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:12.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81880744c0 0x7f8188197fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f817800e9d0 tx=0x7f817800ece0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 shutdown_connections 2023-07-21T22:16:12.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81740a1150 0x7f81740a3600 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8188072ef0 0x7f8188197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8188107a50 0x7f818819f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 --2- 172.21.15.151:0/1256231097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81880744c0 0x7f8188197fb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:12.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.831+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 >> 172.21.15.151:0/1256231097 conn(0x7f81880fb1a0 msgr2=0x7f81880fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:12.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.832+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 shutdown_connections 2023-07-21T22:16:12.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:12.832+0000 7f819016f700 1 -- 172.21.15.151:0/1256231097 wait complete. 2023-07-21T22:16:13.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:12 smithi151 ceph-mon[95510]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:16:13.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:12 smithi151 ceph-mon[95510]: osdmap e79: 12 total, 11 up, 12 in 2023-07-21T22:16:13.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:12 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:13.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:12 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:13.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:12 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1256231097' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-21T22:16:13.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:12 smithi187 ceph-mon[96918]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:16:13.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:12 smithi187 ceph-mon[96918]: osdmap e79: 12 total, 11 up, 12 in 2023-07-21T22:16:13.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:12 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:13.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:12 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:13.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:12 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1256231097' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-21T22:16:13.395 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":79,"num_osds":12,"num_up_osds":11,"osd_up_since":1689977747,"num_in_osds":12,"osd_in_since":1689977752,"num_remapped_pgs":0} 2023-07-21T22:16:13.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:12 smithi195 ceph-mon[97365]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi195", "root=default"]}]': finished 2023-07-21T22:16:13.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:12 smithi195 ceph-mon[97365]: osdmap e79: 12 total, 11 up, 12 in 2023-07-21T22:16:13.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:12 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:13.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:12 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:13.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:12 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1256231097' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-21T22:16:14.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: purged_snaps scrub starts 2023-07-21T22:16:14.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: purged_snaps scrub ok 2023-07-21T22:16:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: osd.11 [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] boot 2023-07-21T22:16:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: osdmap e80: 12 total, 12 up, 12 in 2023-07-21T22:16:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: Detected new or changed devices on smithi195 2023-07-21T22:16:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 4316M 2023-07-21T22:16:14.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:14.380 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:16:14.380 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd stat -f json 2023-07-21T22:16:14.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: purged_snaps scrub starts 2023-07-21T22:16:14.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: purged_snaps scrub ok 2023-07-21T22:16:14.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:14.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: osd.11 [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] boot 2023-07-21T22:16:14.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: osdmap e80: 12 total, 12 up, 12 in 2023-07-21T22:16:14.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:14.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: Detected new or changed devices on smithi195 2023-07-21T22:16:14.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 4316M 2023-07-21T22:16:14.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:14.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:16:14.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: purged_snaps scrub starts 2023-07-21T22:16:14.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: purged_snaps scrub ok 2023-07-21T22:16:14.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 298 MiB used, 983 GiB / 983 GiB avail 2023-07-21T22:16:14.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: osd.11 [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] boot 2023-07-21T22:16:14.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: osdmap e80: 12 total, 12 up, 12 in 2023-07-21T22:16:14.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:16:14.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: Detected new or changed devices on smithi195 2023-07-21T22:16:14.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:16:14.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 4316M 2023-07-21T22:16:14.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:14.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:14.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:16:14.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:15.130 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:16:15.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:15 smithi151 ceph-mon[95510]: osdmap e81: 12 total, 12 up, 12 in 2023-07-21T22:16:15.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:15 smithi187 ceph-mon[96918]: osdmap e81: 12 total, 12 up, 12 in 2023-07-21T22:16:15.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:15 smithi195 ceph-mon[97365]: osdmap e81: 12 total, 12 up, 12 in 2023-07-21T22:16:16.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:16 smithi151 ceph-mon[95510]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:16.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:16 smithi187 ceph-mon[96918]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:16.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.592+0000 7fc0edab5700 1 -- 172.21.15.151:0/443245582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e80ffb90 msgr2=0x7fc0e80fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.592+0000 7fc0edab5700 1 --2- 172.21.15.151:0/443245582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e80ffb90 0x7fc0e80fffa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009990 tx=0x7fc0d8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.592+0000 7fc0edab5700 1 -- 172.21.15.151:0/443245582 shutdown_connections 2023-07-21T22:16:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.592+0000 7fc0edab5700 1 --2- 172.21.15.151:0/443245582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e8101720 0x7fc0e8107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.592+0000 7fc0edab5700 1 --2- 172.21.15.151:0/443245582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e80ffb90 0x7fc0e80fffa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.592+0000 7fc0edab5700 1 --2- 172.21.15.151:0/443245582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0e8100d90 0x7fc0e81011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.592+0000 7fc0edab5700 1 -- 172.21.15.151:0/443245582 >> 172.21.15.151:0/443245582 conn(0x7fc0e80fb1a0 msgr2=0x7fc0e80fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:16.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.592+0000 7fc0edab5700 1 -- 172.21.15.151:0/443245582 shutdown_connections 2023-07-21T22:16:16.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.592+0000 7fc0edab5700 1 -- 172.21.15.151:0/443245582 wait complete. 2023-07-21T22:16:16.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.593+0000 7fc0edab5700 1 Processor -- start 2023-07-21T22:16:16.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.593+0000 7fc0edab5700 1 -- start start 2023-07-21T22:16:16.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0edab5700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0e80ffb90 0x7fc0e81957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:16.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0edab5700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e8100d90 0x7fc0e8195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0edab5700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e8101720 0x7fc0e819cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0edab5700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e819d370 con 0x7fc0e8101720 2023-07-21T22:16:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0edab5700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e819d4b0 con 0x7fc0e8100d90 2023-07-21T22:16:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0edab5700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e819d640 con 0x7fc0e80ffb90 2023-07-21T22:16:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0e80ffb90 0x7fc0e81957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:16.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e8101720 0x7fc0e819cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e8100d90 0x7fc0e8195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0e80ffb90 0x7fc0e81957e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35632/0 (socket says 172.21.15.151:35632) 2023-07-21T22:16:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e8101720 0x7fc0e819cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46996/0 (socket says 172.21.15.151:46996) 2023-07-21T22:16:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e77fe700 1 -- 172.21.15.151:0/2716573454 learned_addr learned my addr 172.21.15.151:0/2716573454 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e7fff700 1 -- 172.21.15.151:0/2716573454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0e80ffb90 msgr2=0x7fc0e81957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e7fff700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0e80ffb90 0x7fc0e81957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e7fff700 1 -- 172.21.15.151:0/2716573454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e8100d90 msgr2=0x7fc0e8195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e7fff700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e8100d90 0x7fc0e8195d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e7fff700 1 -- 172.21.15.151:0/2716573454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d80095f0 con 0x7fc0e8101720 2023-07-21T22:16:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.594+0000 7fc0e77fe700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0e80ffb90 0x7fc0e81957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:16:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.595+0000 7fc0e7fff700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e8101720 0x7fc0e819cda0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009f60 tx=0x7fc0e0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.595+0000 7fc0e4ff9700 1 -- 172.21.15.151:0/2716573454 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e0018070 con 0x7fc0e8101720 2023-07-21T22:16:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.595+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e819d8c0 con 0x7fc0e8101720 2023-07-21T22:16:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.595+0000 7fc0e4ff9700 1 -- 172.21.15.151:0/2716573454 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc0e000f040 con 0x7fc0e8101720 2023-07-21T22:16:16.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.595+0000 7fc0e4ff9700 1 -- 172.21.15.151:0/2716573454 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e000cbf0 con 0x7fc0e8101720 2023-07-21T22:16:16.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.595+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e819dd70 con 0x7fc0e8101720 2023-07-21T22:16:16.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.596+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e8107260 con 0x7fc0e8101720 2023-07-21T22:16:16.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.598+0000 7fc0e4ff9700 1 -- 172.21.15.151:0/2716573454 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc0e0007500 con 0x7fc0e8101720 2023-07-21T22:16:16.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.600+0000 7fc0e4ff9700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc0d00a1150 0x7fc0d00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:16.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.600+0000 7fc0e4ff9700 1 -- 172.21.15.151:0/2716573454 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fc0e00cbfc0 con 0x7fc0e8101720 2023-07-21T22:16:16.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.600+0000 7fc0e77fe700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc0d00a1150 0x7fc0d00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:16.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.600+0000 7fc0e77fe700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc0d00a1150 0x7fc0d00a3600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8005910 tx=0x7fc0d8005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:16.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.604+0000 7fc0e4ff9700 1 -- 172.21.15.151:0/2716573454 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fc0e0095ba0 con 0x7fc0e8101720 2023-07-21T22:16:16.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:16 smithi195 ceph-mon[97365]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:16.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.799+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fc0e802c850 con 0x7fc0e8101720 2023-07-21T22:16:16.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.800+0000 7fc0e4ff9700 1 -- 172.21.15.151:0/2716573454 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v81) v1 ==== 74+0+133 (secure 0 0 0) 0x7fc0e00991c0 con 0x7fc0e8101720 2023-07-21T22:16:16.844 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc0d00a1150 msgr2=0x7fc0d00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc0d00a1150 0x7fc0d00a3600 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8005910 tx=0x7fc0d8005960 comp rx=0 tx=0).stop 2023-07-21T22:16:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e8101720 msgr2=0x7fc0e819cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:16.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e8101720 0x7fc0e819cda0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc0e0009f60 tx=0x7fc0e0009f90 comp rx=0 tx=0).stop 2023-07-21T22:16:16.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 shutdown_connections 2023-07-21T22:16:16.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc0d00a1150 0x7fc0d00a3600 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e8101720 0x7fc0e819cda0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0e80ffb90 0x7fc0e81957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 --2- 172.21.15.151:0/2716573454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e8100d90 0x7fc0e8195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:16.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.802+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 >> 172.21.15.151:0/2716573454 conn(0x7fc0e80fb1a0 msgr2=0x7fc0e81043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:16.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.803+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 shutdown_connections 2023-07-21T22:16:16.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:16.803+0000 7fc0edab5700 1 -- 172.21.15.151:0/2716573454 wait complete. 2023-07-21T22:16:17.307 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":81,"num_osds":12,"num_up_osds":12,"osd_up_since":1689977772,"num_in_osds":12,"osd_in_since":1689977752,"num_remapped_pgs":0} 2023-07-21T22:16:17.308 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd dump --format=json 2023-07-21T22:16:17.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:17 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2716573454' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-21T22:16:17.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:17 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2716573454' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-21T22:16:17.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:17 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2716573454' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2023-07-21T22:16:18.035 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:16:18.575 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:18 smithi151 ceph-mon[95510]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:18.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:18 smithi187 ceph-mon[96918]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:18 smithi195 ceph-mon[97365]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:19.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.510+0000 7fb1bbacf700 1 -- 172.21.15.151:0/2864186350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b40731c0 msgr2=0x7fb1b410bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:19.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.510+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/2864186350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b40731c0 0x7fb1b410bea0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb1a4009990 tx=0x7fb1a4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.510+0000 7fb1bbacf700 1 -- 172.21.15.151:0/2864186350 shutdown_connections 2023-07-21T22:16:19.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.510+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/2864186350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1b410c3e0 0x7fb1b410e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.510+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/2864186350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1b40728b0 0x7fb1b4072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.510+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/2864186350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b40731c0 0x7fb1b410bea0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.510+0000 7fb1bbacf700 1 -- 172.21.15.151:0/2864186350 >> 172.21.15.151:0/2864186350 conn(0x7fb1b40fb660 msgr2=0x7fb1b40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:19.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.510+0000 7fb1bbacf700 1 -- 172.21.15.151:0/2864186350 shutdown_connections 2023-07-21T22:16:19.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.510+0000 7fb1bbacf700 1 -- 172.21.15.151:0/2864186350 wait complete. 2023-07-21T22:16:19.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.511+0000 7fb1bbacf700 1 Processor -- start 2023-07-21T22:16:19.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.511+0000 7fb1bbacf700 1 -- start start 2023-07-21T22:16:19.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.511+0000 7fb1bbacf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1b40728b0 0x7fb1b4197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:19.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.511+0000 7fb1bbacf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1b40731c0 0x7fb1b4198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:19.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.511+0000 7fb1bbacf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b410c3e0 0x7fb1b419c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:19.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.511+0000 7fb1bbacf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b419cd70 con 0x7fb1b410c3e0 2023-07-21T22:16:19.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.511+0000 7fb1bbacf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b419cee0 con 0x7fb1b40731c0 2023-07-21T22:16:19.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.511+0000 7fb1bbacf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b419d0a0 con 0x7fb1b40728b0 2023-07-21T22:16:19.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1ba06c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b410c3e0 0x7fb1b419c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:19.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1b986b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1b40728b0 0x7fb1b4197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:19.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1ba06c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b410c3e0 0x7fb1b419c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47016/0 (socket says 172.21.15.151:47016) 2023-07-21T22:16:19.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1ba06c700 1 -- 172.21.15.151:0/1039997071 learned_addr learned my addr 172.21.15.151:0/1039997071 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:19.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1b906a700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1b40731c0 0x7fb1b4198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:19.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1ba06c700 1 -- 172.21.15.151:0/1039997071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1b40728b0 msgr2=0x7fb1b4197d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:19.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1ba06c700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1b40728b0 0x7fb1b4197d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1ba06c700 1 -- 172.21.15.151:0/1039997071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1b40731c0 msgr2=0x7fb1b4198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:19.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1ba06c700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1b40731c0 0x7fb1b4198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1ba06c700 1 -- 172.21.15.151:0/1039997071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40095f0 con 0x7fb1b410c3e0 2023-07-21T22:16:19.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.512+0000 7fb1ba06c700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b410c3e0 0x7fb1b419c6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac007ee0 tx=0x7fb1ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:19.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.513+0000 7fb1aaffd700 1 -- 172.21.15.151:0/1039997071 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac017070 con 0x7fb1b410c3e0 2023-07-21T22:16:19.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.513+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b419d380 con 0x7fb1b410c3e0 2023-07-21T22:16:19.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.513+0000 7fb1aaffd700 1 -- 172.21.15.151:0/1039997071 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb1ac00f040 con 0x7fb1b410c3e0 2023-07-21T22:16:19.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.513+0000 7fb1aaffd700 1 -- 172.21.15.151:0/1039997071 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1ac005570 con 0x7fb1b410c3e0 2023-07-21T22:16:19.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.513+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b41a4b50 con 0x7fb1b410c3e0 2023-07-21T22:16:19.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.514+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b404e210 con 0x7fb1b410c3e0 2023-07-21T22:16:19.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.516+0000 7fb1aaffd700 1 -- 172.21.15.151:0/1039997071 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb1ac00db20 con 0x7fb1b410c3e0 2023-07-21T22:16:19.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.518+0000 7fb1aaffd700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb1a00a11d0 0x7fb1a00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:19.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.518+0000 7fb1aaffd700 1 -- 172.21.15.151:0/1039997071 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fb1ac0cbb70 con 0x7fb1b410c3e0 2023-07-21T22:16:19.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.518+0000 7fb1b986b700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb1a00a11d0 0x7fb1a00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:19.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.519+0000 7fb1b986b700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb1a00a11d0 0x7fb1a00a3680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0005950 tx=0x7fb1b000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:19.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.522+0000 7fb1aaffd700 1 -- 172.21.15.151:0/1039997071 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fb1ac0956c0 con 0x7fb1b410c3e0 2023-07-21T22:16:19.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.718+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1b41a4ea0 con 0x7fb1b410c3e0 2023-07-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.720+0000 7fb1aaffd700 1 -- 172.21.15.151:0/1039997071 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18478 (secure 0 0 0) 0x7fb1ac098ce0 con 0x7fb1b410c3e0 2023-07-21T22:16:19.764 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:19.765 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":81,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:16:14.136307+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb1a00a11d0 msgr2=0x7fb1a00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb1a00a11d0 0x7fb1a00a3680 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb1b0005950 tx=0x7fb1b000b410 comp rx=0 tx=0).stop 2023-07-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b410c3e0 msgr2=0x7fb1b419c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b410c3e0 0x7fb1b419c6d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac007ee0 tx=0x7fb1ac00d3b0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 shutdown_connections 2023-07-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb1a00a11d0 0x7fb1a00a3680 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1b410c3e0 0x7fb1b419c6d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb1b40728b0 0x7fb1b4197d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 --2- 172.21.15.151:0/1039997071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb1b40731c0 0x7fb1b4198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 >> 172.21.15.151:0/1039997071 conn(0x7fb1b40fb660 msgr2=0x7fb1b410e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 shutdown_connections 2023-07-21T22:16:19.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:19.722+0000 7fb1bbacf700 1 -- 172.21.15.151:0/1039997071 wait complete. 2023-07-21T22:16:20.214 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:16:20.215 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd pool get .mgr pg_num 2023-07-21T22:16:20.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:20 smithi151 ceph-mon[95510]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:20.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:20 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1039997071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:16:20.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:20 smithi187 ceph-mon[96918]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:20.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:20 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1039997071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:16:20.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:20 smithi195 ceph-mon[97365]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:20.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:20 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1039997071' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:16:20.938 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:16:22.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.279+0000 7f2df21bf700 1 -- 172.21.15.151:0/2548968677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec10c3e0 msgr2=0x7f2dec10e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:22.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.279+0000 7f2df21bf700 1 --2- 172.21.15.151:0/2548968677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec10c3e0 0x7f2dec10e7c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2de400b0a0 tx=0x7f2de400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.279+0000 7f2df21bf700 1 -- 172.21.15.151:0/2548968677 shutdown_connections 2023-07-21T22:16:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.279+0000 7f2df21bf700 1 --2- 172.21.15.151:0/2548968677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dec0728b0 0x7f2dec072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.279+0000 7f2df21bf700 1 --2- 172.21.15.151:0/2548968677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec10c3e0 0x7f2dec10e7c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.279+0000 7f2df21bf700 1 --2- 172.21.15.151:0/2548968677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dec0731c0 0x7f2dec10bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.279+0000 7f2df21bf700 1 -- 172.21.15.151:0/2548968677 >> 172.21.15.151:0/2548968677 conn(0x7f2dec0fb660 msgr2=0x7f2dec0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.279+0000 7f2df21bf700 1 -- 172.21.15.151:0/2548968677 shutdown_connections 2023-07-21T22:16:22.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.279+0000 7f2df21bf700 1 -- 172.21.15.151:0/2548968677 wait complete. 2023-07-21T22:16:22.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.280+0000 7f2df21bf700 1 Processor -- start 2023-07-21T22:16:22.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2df21bf700 1 -- start start 2023-07-21T22:16:22.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2df21bf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec0728b0 0x7f2dec197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:22.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2df21bf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dec0731c0 0x7f2dec198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:22.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2df21bf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dec10c3e0 0x7f2dec19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:22.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2df21bf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec19ce40 con 0x7f2dec0728b0 2023-07-21T22:16:22.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2df21bf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec19cfb0 con 0x7f2dec0731c0 2023-07-21T22:16:22.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2df21bf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dec19d170 con 0x7f2dec10c3e0 2023-07-21T22:16:22.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2deb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec0728b0 0x7f2dec197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:22.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2deb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec0728b0 0x7f2dec197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47026/0 (socket says 172.21.15.151:47026) 2023-07-21T22:16:22.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2deb7fe700 1 -- 172.21.15.151:0/248147647 learned_addr learned my addr 172.21.15.151:0/248147647 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:22.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2de3fff700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dec0731c0 0x7f2dec198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:22.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.281+0000 7f2debfff700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dec10c3e0 0x7f2dec19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2deb7fe700 1 -- 172.21.15.151:0/248147647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dec10c3e0 msgr2=0x7f2dec19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2deb7fe700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dec10c3e0 0x7f2dec19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2deb7fe700 1 -- 172.21.15.151:0/248147647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dec0731c0 msgr2=0x7f2dec198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2deb7fe700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dec0731c0 0x7f2dec198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2deb7fe700 1 -- 172.21.15.151:0/248147647 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de4009d00 con 0x7f2dec0728b0 2023-07-21T22:16:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2deb7fe700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec0728b0 0x7f2dec197df0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e9a0 tx=0x7f2ddc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:22.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2de97fa700 1 -- 172.21.15.151:0/248147647 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc009790 con 0x7f2dec0728b0 2023-07-21T22:16:22.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2de97fa700 1 -- 172.21.15.151:0/248147647 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ddc00cbd0 con 0x7f2dec0728b0 2023-07-21T22:16:22.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec19d450 con 0x7f2dec0728b0 2023-07-21T22:16:22.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2de97fa700 1 -- 172.21.15.151:0/248147647 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ddc018680 con 0x7f2dec0728b0 2023-07-21T22:16:22.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.282+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dec1a4c70 con 0x7f2dec0728b0 2023-07-21T22:16:22.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.283+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dec04e210 con 0x7f2dec0728b0 2023-07-21T22:16:22.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.285+0000 7f2de97fa700 1 -- 172.21.15.151:0/248147647 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2ddc00cd40 con 0x7f2dec0728b0 2023-07-21T22:16:22.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.286+0000 7f2de97fa700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2dd80a11d0 0x7f2dd80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:22.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.287+0000 7f2de97fa700 1 -- 172.21.15.151:0/248147647 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2ddc014070 con 0x7f2dec0728b0 2023-07-21T22:16:22.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.287+0000 7f2de3fff700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2dd80a11d0 0x7f2dd80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:22.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.287+0000 7f2de3fff700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2dd80a11d0 0x7f2dd80a3680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4005950 tx=0x7f2dd40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:22.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.291+0000 7f2de97fa700 1 -- 172.21.15.151:0/248147647 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2ddc096180 con 0x7f2dec0728b0 2023-07-21T22:16:22.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:22 smithi151 ceph-mon[95510]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:22.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.484+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2dec199150 con 0x7f2dec0728b0 2023-07-21T22:16:22.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.484+0000 7f2de97fa700 1 -- 172.21.15.151:0/248147647 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2ddc0997a0 con 0x7f2dec0728b0 2023-07-21T22:16:22.527 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:16:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2dd80a11d0 msgr2=0x7f2dd80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:22.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2dd80a11d0 0x7f2dd80a3680 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f2dd4005950 tx=0x7f2dd40058e0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec0728b0 msgr2=0x7f2dec197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:22.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec0728b0 0x7f2dec197df0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2ddc00e9a0 tx=0x7f2ddc00ed60 comp rx=0 tx=0).stop 2023-07-21T22:16:22.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 shutdown_connections 2023-07-21T22:16:22.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2dd80a11d0 0x7f2dd80a3680 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2dec10c3e0 0x7f2dec19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2dec0728b0 0x7f2dec197df0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 --2- 172.21.15.151:0/248147647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2dec0731c0 0x7f2dec198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:22.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.486+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 >> 172.21.15.151:0/248147647 conn(0x7f2dec0fb660 msgr2=0x7f2dec10e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:22.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.487+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 shutdown_connections 2023-07-21T22:16:22.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:22.487+0000 7f2df21bf700 1 -- 172.21.15.151:0/248147647 wait complete. 2023-07-21T22:16:22.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:22 smithi187 ceph-mon[96918]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:22.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:22 smithi195 ceph-mon[97365]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:23.019 INFO:tasks.cephadm:Adding mds.a on smithi151 2023-07-21T22:16:23.020 INFO:tasks.cephadm:Adding mds.d on smithi151 2023-07-21T22:16:23.020 INFO:tasks.cephadm:Adding mds.g on smithi151 2023-07-21T22:16:23.020 INFO:tasks.cephadm:Adding mds.j on smithi151 2023-07-21T22:16:23.020 INFO:tasks.cephadm:Adding mds.b on smithi187 2023-07-21T22:16:23.021 INFO:tasks.cephadm:Adding mds.e on smithi187 2023-07-21T22:16:23.021 INFO:tasks.cephadm:Adding mds.h on smithi187 2023-07-21T22:16:23.021 INFO:tasks.cephadm:Adding mds.k on smithi187 2023-07-21T22:16:23.021 INFO:tasks.cephadm:Adding mds.c on smithi195 2023-07-21T22:16:23.021 INFO:tasks.cephadm:Adding mds.f on smithi195 2023-07-21T22:16:23.021 INFO:tasks.cephadm:Adding mds.i on smithi195 2023-07-21T22:16:23.022 INFO:tasks.cephadm:Adding mds.l on smithi195 2023-07-21T22:16:23.022 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph orch apply mds all '12;smithi151=a;smithi151=d;smithi151=g;smithi151=j;smithi187=b;smithi187=e;smithi187=h;smithi187=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l' 2023-07-21T22:16:23.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:23 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/248147647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:16:23.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:23 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/248147647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:16:23.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:23 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/248147647' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:16:23.756 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T22:16:24.289 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:24 smithi195 ceph-mon[97365]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:24.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:24 smithi187 ceph-mon[96918]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:24.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:24 smithi151 ceph-mon[95510]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:25.151 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.107+0000 7fda0eae9700 1 -- 172.21.15.195:0/2872670401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda080ffb90 msgr2=0x7fda080fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.107+0000 7fda0eae9700 1 --2- 172.21.15.195:0/2872670401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda080ffb90 0x7fda080fffa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc009990 tx=0x7fd9fc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.107+0000 7fda0eae9700 1 -- 172.21.15.195:0/2872670401 shutdown_connections 2023-07-21T22:16:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.107+0000 7fda0eae9700 1 --2- 172.21.15.195:0/2872670401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda08101720 0x7fda08107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.107+0000 7fda0eae9700 1 --2- 172.21.15.195:0/2872670401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda080ffb90 0x7fda080fffa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.152 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.107+0000 7fda0eae9700 1 --2- 172.21.15.195:0/2872670401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda08100d90 0x7fda081011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.107+0000 7fda0eae9700 1 -- 172.21.15.195:0/2872670401 >> 172.21.15.195:0/2872670401 conn(0x7fda080fb1a0 msgr2=0x7fda080fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.107+0000 7fda0eae9700 1 -- 172.21.15.195:0/2872670401 shutdown_connections 2023-07-21T22:16:25.153 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.107+0000 7fda0eae9700 1 -- 172.21.15.195:0/2872670401 wait complete. 2023-07-21T22:16:25.154 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.108+0000 7fda0eae9700 1 Processor -- start 2023-07-21T22:16:25.154 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.108+0000 7fda0eae9700 1 -- start start 2023-07-21T22:16:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0eae9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda080ffb90 0x7fda08197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0eae9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda08100d90 0x7fda08197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0eae9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda08101720 0x7fda0819efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0eae9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0819f590 con 0x7fda080ffb90 2023-07-21T22:16:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0eae9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0819f6d0 con 0x7fda08100d90 2023-07-21T22:16:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0eae9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0819f860 con 0x7fda08101720 2023-07-21T22:16:25.155 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0d086700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda08101720 0x7fda0819efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0c885700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda080ffb90 0x7fda08197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0d086700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda08101720 0x7fda0819efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.195:44062/0 (socket says 172.21.15.195:44062) 2023-07-21T22:16:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0d086700 1 -- 172.21.15.195:0/3475708825 learned_addr learned my addr 172.21.15.195:0/3475708825 (peer_addr_for_me v2:172.21.15.195:0/0) 2023-07-21T22:16:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda07fff700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda08100d90 0x7fda08197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0d086700 1 -- 172.21.15.195:0/3475708825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda08100d90 msgr2=0x7fda08197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0d086700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda08100d90 0x7fda08197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0d086700 1 -- 172.21.15.195:0/3475708825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda080ffb90 msgr2=0x7fda08197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:25.156 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0d086700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda080ffb90 0x7fda08197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.109+0000 7fda0d086700 1 -- 172.21.15.195:0/3475708825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9fc0095f0 con 0x7fda08101720 2023-07-21T22:16:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.110+0000 7fda0d086700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda08101720 0x7fda0819efc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda00007f10 tx=0x7fda0000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.110+0000 7fda05ffb700 1 -- 172.21.15.195:0/3475708825 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00017070 con 0x7fda08101720 2023-07-21T22:16:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.110+0000 7fda05ffb700 1 -- 172.21.15.195:0/3475708825 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda0000f040 con 0x7fda08101720 2023-07-21T22:16:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.110+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0819fb40 con 0x7fda08101720 2023-07-21T22:16:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.110+0000 7fda05ffb700 1 -- 172.21.15.195:0/3475708825 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda00005710 con 0x7fda08101720 2023-07-21T22:16:25.157 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.110+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda081a0040 con 0x7fda08101720 2023-07-21T22:16:25.158 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.111+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda0810b250 con 0x7fda08101720 2023-07-21T22:16:25.158 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.113+0000 7fda05ffb700 1 -- 172.21.15.195:0/3475708825 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fda00004ad0 con 0x7fda08101720 2023-07-21T22:16:25.158 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.114+0000 7fda05ffb700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11d0 0x7fd9f80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:25.159 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.114+0000 7fda05ffb700 1 -- 172.21.15.195:0/3475708825 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fda000cbcb0 con 0x7fda08101720 2023-07-21T22:16:25.159 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.115+0000 7fda0c885700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11d0 0x7fd9f80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:25.159 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.115+0000 7fda0c885700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11d0 0x7fd9f80a3680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc000c00 tx=0x7fd9fc00b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:25.162 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.118+0000 7fda05ffb700 1 -- 172.21.15.195:0/3475708825 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fda00095800 con 0x7fda08101720 2023-07-21T22:16:25.365 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.322+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi151=a;smithi151=d;smithi151=g;smithi151=j;smithi187=b;smithi187=e;smithi187=h;smithi187=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}) v1 -- 0x7fda08107870 con 0x7fd9f80a11d0 2023-07-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.331+0000 7fda05ffb700 1 -- 172.21.15.195:0/3475708825 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fda08107870 con 0x7fd9f80a11d0 2023-07-21T22:16:25.375 INFO:teuthology.orchestra.run.smithi195.stdout:Scheduled mds.all update... 2023-07-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11d0 msgr2=0x7fd9f80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:25.377 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11d0 0x7fd9f80a3680 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc000c00 tx=0x7fd9fc00b560 comp rx=0 tx=0).stop 2023-07-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda08101720 msgr2=0x7fda0819efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda08101720 0x7fda0819efc0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda00007f10 tx=0x7fda0000d3b0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 shutdown_connections 2023-07-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11d0 0x7fd9f80a3680 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda08101720 0x7fda0819efc0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda080ffb90 0x7fda08197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.378 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 --2- 172.21.15.195:0/3475708825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda08100d90 0x7fda08197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.333+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 >> 172.21.15.195:0/3475708825 conn(0x7fda080fb1a0 msgr2=0x7fda080fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.334+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 shutdown_connections 2023-07-21T22:16:25.379 INFO:teuthology.orchestra.run.smithi195.stderr:2023-07-21T22:16:25.334+0000 7fda0eae9700 1 -- 172.21.15.195:0/3475708825 wait complete. 2023-07-21T22:16:25.936 DEBUG:teuthology.orchestra.run.smithi151:mds.a> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.a.service 2023-07-21T22:16:25.942 DEBUG:teuthology.orchestra.run.smithi151:mds.d> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.d.service 2023-07-21T22:16:25.989 DEBUG:teuthology.orchestra.run.smithi151:mds.g> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.g.service 2023-07-21T22:16:26.024 INFO:journalctl@ceph.mds.a.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:16:26.027 DEBUG:teuthology.orchestra.run.smithi151:mds.j> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.j.service 2023-07-21T22:16:26.064 INFO:journalctl@ceph.mds.d.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:16:26.067 DEBUG:teuthology.orchestra.run.smithi187:mds.b> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.b.service 2023-07-21T22:16:26.072 DEBUG:teuthology.orchestra.run.smithi187:mds.e> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.e.service 2023-07-21T22:16:26.099 INFO:journalctl@ceph.mds.g.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:16:26.120 DEBUG:teuthology.orchestra.run.smithi187:mds.h> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.h.service 2023-07-21T22:16:26.134 INFO:journalctl@ceph.mds.j.smithi151.stdout:-- Logs begin at Fri 2023-07-21 21:50:06 UTC. -- 2023-07-21T22:16:26.153 INFO:journalctl@ceph.mds.b.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:16:26.157 DEBUG:teuthology.orchestra.run.smithi187:mds.k> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.k.service 2023-07-21T22:16:26.193 INFO:journalctl@ceph.mds.e.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:16:26.197 DEBUG:teuthology.orchestra.run.smithi195:mds.c> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.c.service 2023-07-21T22:16:26.202 DEBUG:teuthology.orchestra.run.smithi195:mds.f> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service 2023-07-21T22:16:26.229 INFO:journalctl@ceph.mds.h.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:16:26.248 DEBUG:teuthology.orchestra.run.smithi195:mds.i> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.i.service 2023-07-21T22:16:26.265 INFO:journalctl@ceph.mds.k.smithi187.stdout:-- Logs begin at Fri 2023-07-21 21:49:48 UTC. -- 2023-07-21T22:16:26.274 INFO:journalctl@ceph.mds.c.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:16:26.277 DEBUG:teuthology.orchestra.run.smithi195:mds.l> sudo journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.l.service 2023-07-21T22:16:26.322 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2023-07-21T22:16:26.323 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:16:26.326 INFO:journalctl@ceph.mds.f.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:16:26.350 INFO:journalctl@ceph.mds.i.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:16:26.393 INFO:journalctl@ceph.mds.l.smithi195.stdout:-- Logs begin at Fri 2023-07-21 21:49:41 UTC. -- 2023-07-21T22:16:26.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.501+0000 7f4ac47ff700 1 -- 172.21.15.151:0/4120447508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 msgr2=0x7f4abc101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:26.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.501+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/4120447508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 0x7f4abc101140 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4aac009990 tx=0x7f4aac009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.501+0000 7f4ac47ff700 1 -- 172.21.15.151:0/4120447508 shutdown_connections 2023-07-21T22:16:26.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.501+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/4120447508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4abc0ffb00 0x7f4abc0fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.501+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/4120447508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4abc101680 0x7f4abc107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.501+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/4120447508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 0x7f4abc101140 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.501+0000 7f4ac47ff700 1 -- 172.21.15.151:0/4120447508 >> 172.21.15.151:0/4120447508 conn(0x7f4abc0fb0e0 msgr2=0x7f4abc0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:26.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.501+0000 7f4ac47ff700 1 -- 172.21.15.151:0/4120447508 shutdown_connections 2023-07-21T22:16:26.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.501+0000 7f4ac47ff700 1 -- 172.21.15.151:0/4120447508 wait complete. 2023-07-21T22:16:26.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.502+0000 7f4ac47ff700 1 Processor -- start 2023-07-21T22:16:26.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.502+0000 7f4ac47ff700 1 -- start start 2023-07-21T22:16:26.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac47ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4abc0ffb00 0x7f4abc0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:26.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac47ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 0x7f4abc072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:26.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac47ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4abc101680 0x7f4abc072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:26.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac47ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc0735e0 con 0x7f4abc100cf0 2023-07-21T22:16:26.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac47ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc073750 con 0x7f4abc101680 2023-07-21T22:16:26.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac47ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc19f7a0 con 0x7f4abc0ffb00 2023-07-21T22:16:26.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac1d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 0x7f4abc072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:26.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac259b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4abc0ffb00 0x7f4abc0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:26.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac1d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 0x7f4abc072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42982/0 (socket says 172.21.15.151:42982) 2023-07-21T22:16:26.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac1d9a700 1 -- 172.21.15.151:0/1247311109 learned_addr learned my addr 172.21.15.151:0/1247311109 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:26.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac1d9a700 1 -- 172.21.15.151:0/1247311109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4abc0ffb00 msgr2=0x7f4abc0742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:26.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac1d9a700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4abc0ffb00 0x7f4abc0742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac1d9a700 1 -- 172.21.15.151:0/1247311109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4abc101680 msgr2=0x7f4abc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:26.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac1d9a700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4abc101680 0x7f4abc072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.503+0000 7f4ac1d9a700 1 -- 172.21.15.151:0/1247311109 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aac0095f0 con 0x7f4abc100cf0 2023-07-21T22:16:26.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.504+0000 7f4ac1d9a700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 0x7f4abc072900 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0098e0 tx=0x7f4aac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:26.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.504+0000 7f4ab37fe700 1 -- 172.21.15.151:0/1247311109 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac01d070 con 0x7f4abc100cf0 2023-07-21T22:16:26.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.504+0000 7f4ab37fe700 1 -- 172.21.15.151:0/1247311109 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4aac00bd50 con 0x7f4abc100cf0 2023-07-21T22:16:26.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.504+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4abc19fa20 con 0x7f4abc100cf0 2023-07-21T22:16:26.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.504+0000 7f4ab37fe700 1 -- 172.21.15.151:0/1247311109 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4aac022d90 con 0x7f4abc100cf0 2023-07-21T22:16:26.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.504+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4abc19fea0 con 0x7f4abc100cf0 2023-07-21T22:16:26.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.505+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4abc10b1d0 con 0x7f4abc100cf0 2023-07-21T22:16:26.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.507+0000 7f4ab37fe700 1 -- 172.21.15.151:0/1247311109 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4aac022470 con 0x7f4abc100cf0 2023-07-21T22:16:26.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.508+0000 7f4ab37fe700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4aa80a1220 0x7f4aa80a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:26.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.508+0000 7f4ab37fe700 1 -- 172.21.15.151:0/1247311109 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4aac0cd9f0 con 0x7f4abc100cf0 2023-07-21T22:16:26.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.509+0000 7f4ac259b700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4aa80a1220 0x7f4aa80a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:26.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.509+0000 7f4ac259b700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4aa80a1220 0x7f4aa80a36d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4abc100b50 tx=0x7f4ab8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:26.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.512+0000 7f4ab37fe700 1 -- 172.21.15.151:0/1247311109 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f4aac0975d0 con 0x7f4abc100cf0 2023-07-21T22:16:26.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:26.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi151=a;smithi151=d;smithi151=g;smithi151=j;smithi187=b;smithi187=e;smithi187=h;smithi187=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:16:26.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: Saving service mds.all spec with placement smithi151=a;smithi151=d;smithi151=g;smithi151=j;smithi187=b;smithi187=e;smithi187=h;smithi187=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-07-21T22:16:26.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:26.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:16:26.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:26.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:16:26.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:26.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:26.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:26.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:26 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:26.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:26.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi151=a;smithi151=d;smithi151=g;smithi151=j;smithi187=b;smithi187=e;smithi187=h;smithi187=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:16:26.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: Saving service mds.all spec with placement smithi151=a;smithi151=d;smithi151=g;smithi151=j;smithi187=b;smithi187=e;smithi187=h;smithi187=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-07-21T22:16:26.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:26.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:16:26.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:26.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:16:26.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:26.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:26.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:26.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:26 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:26.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi151=a;smithi151=d;smithi151=g;smithi151=j;smithi187=b;smithi187=e;smithi187=h;smithi187=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:16:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: Saving service mds.all spec with placement smithi151=a;smithi151=d;smithi151=g;smithi151=j;smithi187=b;smithi187=e;smithi187=h;smithi187=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-07-21T22:16:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:16:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:16:26.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:26.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:26.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:26.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:26 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:26.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.714+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4abc1069e0 con 0x7f4abc100cf0 2023-07-21T22:16:26.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.715+0000 7f4ab37fe700 1 -- 172.21.15.151:0/1247311109 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18478 (secure 0 0 0) 0x7f4aac09abf0 con 0x7f4abc100cf0 2023-07-21T22:16:26.758 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:26.758 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":81,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:16:14.136307+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:16:26.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4aa80a1220 msgr2=0x7f4aa80a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:26.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4aa80a1220 0x7f4aa80a36d0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4abc100b50 tx=0x7f4ab8009260 comp rx=0 tx=0).stop 2023-07-21T22:16:26.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 msgr2=0x7f4abc072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:26.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 0x7f4abc072900 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4aac0098e0 tx=0x7f4aac004730 comp rx=0 tx=0).stop 2023-07-21T22:16:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 shutdown_connections 2023-07-21T22:16:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4aa80a1220 0x7f4aa80a36d0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4abc101680 0x7f4abc072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4abc0ffb00 0x7f4abc0742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 --2- 172.21.15.151:0/1247311109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc100cf0 0x7f4abc072900 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 >> 172.21.15.151:0/1247311109 conn(0x7f4abc0fb0e0 msgr2=0x7f4abc0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 shutdown_connections 2023-07-21T22:16:26.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.717+0000 7f4ac47ff700 1 -- 172.21.15.151:0/1247311109 wait complete. 2023-07-21T22:16:26.781 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:16:26.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:16:26.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.942+0000 7f42971ff700 1 -- 172.21.15.151:0/1368905155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 msgr2=0x7f4290101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:26.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.942+0000 7f42971ff700 1 --2- 172.21.15.151:0/1368905155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 0x7f4290101130 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f427c009990 tx=0x7f427c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.942+0000 7f42971ff700 1 -- 172.21.15.151:0/1368905155 shutdown_connections 2023-07-21T22:16:26.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.942+0000 7f42971ff700 1 --2- 172.21.15.151:0/1368905155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42900ffaf0 0x7f42900fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.942+0000 7f42971ff700 1 --2- 172.21.15.151:0/1368905155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4290101670 0x7f4290107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.942+0000 7f42971ff700 1 --2- 172.21.15.151:0/1368905155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 0x7f4290101130 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.942+0000 7f42971ff700 1 -- 172.21.15.151:0/1368905155 >> 172.21.15.151:0/1368905155 conn(0x7f42900fb130 msgr2=0x7f42900fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:26.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.942+0000 7f42971ff700 1 -- 172.21.15.151:0/1368905155 shutdown_connections 2023-07-21T22:16:26.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.942+0000 7f42971ff700 1 -- 172.21.15.151:0/1368905155 wait complete. 2023-07-21T22:16:26.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.943+0000 7f42971ff700 1 Processor -- start 2023-07-21T22:16:26.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.943+0000 7f42971ff700 1 -- start start 2023-07-21T22:16:26.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.943+0000 7f42971ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42900ffaf0 0x7f42900742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:26.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.943+0000 7f42971ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 0x7f4290072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:26.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.943+0000 7f42971ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4290101670 0x7f4290072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:26.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.943+0000 7f42971ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42900735e0 con 0x7f4290100ce0 2023-07-21T22:16:26.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.943+0000 7f42971ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290073750 con 0x7f4290101670 2023-07-21T22:16:26.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.943+0000 7f42971ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429019f7e0 con 0x7f42900ffaf0 2023-07-21T22:16:26.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 0x7f4290072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:26.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 0x7f4290072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43000/0 (socket says 172.21.15.151:43000) 2023-07-21T22:16:26.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428ffff700 1 -- 172.21.15.151:0/353443530 learned_addr learned my addr 172.21.15.151:0/353443530 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:26.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f4294f9b700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42900ffaf0 0x7f42900742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:26.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f429579c700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4290101670 0x7f4290072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:26.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428ffff700 1 -- 172.21.15.151:0/353443530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42900ffaf0 msgr2=0x7f42900742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:26.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428ffff700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42900ffaf0 0x7f42900742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428ffff700 1 -- 172.21.15.151:0/353443530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4290101670 msgr2=0x7f4290072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:26.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428ffff700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4290101670 0x7f4290072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:26.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428ffff700 1 -- 172.21.15.151:0/353443530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f427c0095f0 con 0x7f4290100ce0 2023-07-21T22:16:26.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428ffff700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 0x7f4290072900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f427c005910 tx=0x7f427c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:26.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428dffb700 1 -- 172.21.15.151:0/353443530 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c01d070 con 0x7f4290100ce0 2023-07-21T22:16:26.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428dffb700 1 -- 172.21.15.151:0/353443530 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f427c00be10 con 0x7f4290100ce0 2023-07-21T22:16:26.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f428dffb700 1 -- 172.21.15.151:0/353443530 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f427c022e00 con 0x7f4290100ce0 2023-07-21T22:16:26.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.944+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f429019fa60 con 0x7f4290100ce0 2023-07-21T22:16:26.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.945+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f429019fe80 con 0x7f4290100ce0 2023-07-21T22:16:26.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.946+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429010b1c0 con 0x7f4290100ce0 2023-07-21T22:16:26.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.947+0000 7f428dffb700 1 -- 172.21.15.151:0/353443530 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f427c00b980 con 0x7f4290100ce0 2023-07-21T22:16:26.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.950+0000 7f428dffb700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42800a11d0 0x7f42800a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:26.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.950+0000 7f428dffb700 1 -- 172.21.15.151:0/353443530 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f427c0cd990 con 0x7f4290100ce0 2023-07-21T22:16:26.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.950+0000 7f4294f9b700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42800a11d0 0x7f42800a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:26.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.950+0000 7f4294f9b700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42800a11d0 0x7f42800a3680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4290100b40 tx=0x7f4284009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:26.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:26.953+0000 7f428dffb700 1 -- 172.21.15.151:0/353443530 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f427c097610 con 0x7f4290100ce0 2023-07-21T22:16:27.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.151+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4290106a70 con 0x7f4290100ce0 2023-07-21T22:16:27.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.151+0000 7f428dffb700 1 -- 172.21.15.151:0/353443530 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f427c09ac30 con 0x7f4290100ce0 2023-07-21T22:16:27.194 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:16:27.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42800a11d0 msgr2=0x7f42800a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:27.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42800a11d0 0x7f42800a3680 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4290100b40 tx=0x7f4284009260 comp rx=0 tx=0).stop 2023-07-21T22:16:27.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 msgr2=0x7f4290072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:27.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 0x7f4290072900 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f427c005910 tx=0x7f427c005740 comp rx=0 tx=0).stop 2023-07-21T22:16:27.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 shutdown_connections 2023-07-21T22:16:27.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42800a11d0 0x7f42800a3680 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4290101670 0x7f4290072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42900ffaf0 0x7f42900742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 --2- 172.21.15.151:0/353443530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4290100ce0 0x7f4290072900 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 >> 172.21.15.151:0/353443530 conn(0x7f42900fb130 msgr2=0x7f42900fd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:27.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 shutdown_connections 2023-07-21T22:16:27.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.154+0000 7f42971ff700 1 -- 172.21.15.151:0/353443530 wait complete. 2023-07-21T22:16:27.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:27.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:27 smithi195 ceph-mon[97365]: Deploying daemon mds.l on smithi195 2023-07-21T22:16:27.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:27 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1247311109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:16:27.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:27 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/353443530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:16:27.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.373+0000 7f2bc99ff700 1 -- 172.21.15.151:0/1877215910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc40ffb00 msgr2=0x7f2bc40fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:27.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.373+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/1877215910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc40ffb00 0x7f2bc40fff10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4009990 tx=0x7f2bb4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.374+0000 7f2bc99ff700 1 -- 172.21.15.151:0/1877215910 shutdown_connections 2023-07-21T22:16:27.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.374+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/1877215910 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc4101680 0x7f2bc4107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.374+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/1877215910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc40ffb00 0x7f2bc40fff10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.374+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/1877215910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc4100cf0 0x7f2bc4101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.374+0000 7f2bc99ff700 1 -- 172.21.15.151:0/1877215910 >> 172.21.15.151:0/1877215910 conn(0x7f2bc40fb0e0 msgr2=0x7f2bc40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.374+0000 7f2bc99ff700 1 -- 172.21.15.151:0/1877215910 shutdown_connections 2023-07-21T22:16:27.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.374+0000 7f2bc99ff700 1 -- 172.21.15.151:0/1877215910 wait complete. 2023-07-21T22:16:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.375+0000 7f2bc99ff700 1 Processor -- start 2023-07-21T22:16:27.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.375+0000 7f2bc99ff700 1 -- start start 2023-07-21T22:16:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc99ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc40ffb00 0x7f2bc40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc99ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc4100cf0 0x7f2bc4072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc99ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc4101680 0x7f2bc4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc99ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc40735e0 con 0x7f2bc4100cf0 2023-07-21T22:16:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc99ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc4073750 con 0x7f2bc40ffb00 2023-07-21T22:16:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc99ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc419f7b0 con 0x7f2bc4101680 2023-07-21T22:16:27.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc4100cf0 0x7f2bc4072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc4101680 0x7f2bc4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc40ffb00 0x7f2bc40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc4100cf0 0x7f2bc4072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43016/0 (socket says 172.21.15.151:43016) 2023-07-21T22:16:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.376+0000 7f2bc27fc700 1 -- 172.21.15.151:0/3862398756 learned_addr learned my addr 172.21.15.151:0/3862398756 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc37fe700 1 -- 172.21.15.151:0/3862398756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc40ffb00 msgr2=0x7f2bc40742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc37fe700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc40ffb00 0x7f2bc40742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc37fe700 1 -- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc4100cf0 msgr2=0x7f2bc4072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:27.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc37fe700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc4100cf0 0x7f2bc4072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc37fe700 1 -- 172.21.15.151:0/3862398756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bb40095f0 con 0x7f2bc4101680 2023-07-21T22:16:27.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc27fc700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc4100cf0 0x7f2bc4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:16:27.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc37fe700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc4101680 0x7f2bc4072e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00efc0 tx=0x7f2bbc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:27.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc89fd700 1 -- 172.21.15.151:0/3862398756 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc018070 con 0x7f2bc4101680 2023-07-21T22:16:27.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc89fd700 1 -- 172.21.15.151:0/3862398756 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2bbc00f040 con 0x7f2bc4101680 2023-07-21T22:16:27.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc89fd700 1 -- 172.21.15.151:0/3862398756 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc00cba0 con 0x7f2bc4101680 2023-07-21T22:16:27.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc419fa30 con 0x7f2bc4101680 2023-07-21T22:16:27.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.377+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc419ff40 con 0x7f2bc4101680 2023-07-21T22:16:27.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.378+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc4106a30 con 0x7f2bc4101680 2023-07-21T22:16:27.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.380+0000 7f2bc89fd700 1 -- 172.21.15.151:0/3862398756 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2bbc003a00 con 0x7f2bc4101680 2023-07-21T22:16:27.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.382+0000 7f2bc89fd700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2bac0a1220 0x7f2bac0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:27.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.382+0000 7f2bc89fd700 1 -- 172.21.15.151:0/3862398756 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2bbc0cbf30 con 0x7f2bc4101680 2023-07-21T22:16:27.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.382+0000 7f2bc2ffd700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2bac0a1220 0x7f2bac0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:27.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.382+0000 7f2bc2ffd700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2bac0a1220 0x7f2bac0a36d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005910 tx=0x7f2bb400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:27.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.386+0000 7f2bc89fd700 1 -- 172.21.15.151:0/3862398756 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2bbc095b10 con 0x7f2bc4101680 2023-07-21T22:16:27.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.622+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2bc402c850 con 0x7f2bc4101680 2023-07-21T22:16:27.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.623+0000 7f2bc89fd700 1 -- 172.21.15.151:0/3862398756 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) v1 ==== 93+0+501 (secure 0 0 0) 0x7f2bbc099130 con 0x7f2bc4101680 2023-07-21T22:16:27.666 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:27.667 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2023-07-21T22:16:27.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2bac0a1220 msgr2=0x7f2bac0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:27.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2bac0a1220 0x7f2bac0a36d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f2bb4005910 tx=0x7f2bb400b260 comp rx=0 tx=0).stop 2023-07-21T22:16:27.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc4101680 msgr2=0x7f2bc4072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:27.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc4101680 0x7f2bc4072e40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc00efc0 tx=0x7f2bbc00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 shutdown_connections 2023-07-21T22:16:27.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2bac0a1220 0x7f2bac0a36d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc40ffb00 0x7f2bc40742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2bc4101680 0x7f2bc4072e40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 --2- 172.21.15.151:0/3862398756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2bc4100cf0 0x7f2bc4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:27.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 >> 172.21.15.151:0/3862398756 conn(0x7f2bc40fb0e0 msgr2=0x7f2bc40fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:27.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 shutdown_connections 2023-07-21T22:16:27.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:27.626+0000 7f2bc99ff700 1 -- 172.21.15.151:0/3862398756 wait complete. 2023-07-21T22:16:27.671 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 1 2023-07-21T22:16:27.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:27 smithi151 ceph-mon[95510]: Deploying daemon mds.l on smithi195 2023-07-21T22:16:27.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:27 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1247311109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:16:27.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:27 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/353443530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:16:27.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:27 smithi187 ceph-mon[96918]: Deploying daemon mds.l on smithi195 2023-07-21T22:16:27.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:27 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1247311109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:16:27.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:27 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/353443530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:16:28.365 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 22:16:28 smithi195 systemd[1]: Starting Ceph mds.l for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:28.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:28 smithi195 ceph-mon[97365]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:28.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:28 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3862398756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:28.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:28 smithi151 ceph-mon[95510]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:28.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:28 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3862398756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:28.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:28 smithi187 ceph-mon[96918]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:28.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:28 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3862398756' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:29.103 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 22:16:28 smithi195 podman[122835]: 2023-07-21T22:16:29.406 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 22:16:29 smithi195 bash[122835]: a708213071fb33e33c98ad2bd4f338ce35d7d791ca5be450f1f2e817627f69c9 2023-07-21T22:16:29.406 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 22:16:29 smithi195 systemd[1]: Started Ceph mds.l for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:29.406 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 22:16:29 smithi195 ceph-mds[122875]: -- 172.21.15.195:0/1833277097 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x563901aaf1e0 con 0x563901a85000 2023-07-21T22:16:29.406 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 22:16:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-l[122851]: starting mds.l at 2023-07-21T22:16:29.688 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:29.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.854+0000 7f96ca3ff700 1 -- 172.21.15.151:0/2199638363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96c4100cf0 msgr2=0x7f96c4101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:29.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.854+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/2199638363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96c4100cf0 0x7f96c4101140 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f96b8009990 tx=0x7f96b8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:29.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.854+0000 7f96ca3ff700 1 -- 172.21.15.151:0/2199638363 shutdown_connections 2023-07-21T22:16:29.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.854+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/2199638363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96c40ffb00 0x7f96c40fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:29.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.854+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/2199638363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c4101680 0x7f96c4107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:29.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.854+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/2199638363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96c4100cf0 0x7f96c4101140 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:29.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.854+0000 7f96ca3ff700 1 -- 172.21.15.151:0/2199638363 >> 172.21.15.151:0/2199638363 conn(0x7f96c40fb0e0 msgr2=0x7f96c40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:29.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.854+0000 7f96ca3ff700 1 -- 172.21.15.151:0/2199638363 shutdown_connections 2023-07-21T22:16:29.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.854+0000 7f96ca3ff700 1 -- 172.21.15.151:0/2199638363 wait complete. 2023-07-21T22:16:29.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.855+0000 7f96ca3ff700 1 Processor -- start 2023-07-21T22:16:29.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.855+0000 7f96ca3ff700 1 -- start start 2023-07-21T22:16:29.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.855+0000 7f96ca3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c40ffb00 0x7f96c4195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:29.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.855+0000 7f96ca3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96c4100cf0 0x7f96c4195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:29.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.855+0000 7f96ca3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96c4101680 0x7f96c419ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:29.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.855+0000 7f96ca3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c419d290 con 0x7f96c4101680 2023-07-21T22:16:29.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.855+0000 7f96ca3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c419d3d0 con 0x7f96c4100cf0 2023-07-21T22:16:29.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.855+0000 7f96ca3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c419d560 con 0x7f96c40ffb00 2023-07-21T22:16:29.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96c4100cf0 0x7f96c4195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:29.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c899c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96c4101680 0x7f96c419ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:29.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96c4100cf0 0x7f96c4195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55784/0 (socket says 172.21.15.151:55784) 2023-07-21T22:16:29.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c37fe700 1 -- 172.21.15.151:0/3508266495 learned_addr learned my addr 172.21.15.151:0/3508266495 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:29.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c3fff700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c40ffb00 0x7f96c4195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:29.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c37fe700 1 -- 172.21.15.151:0/3508266495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c40ffb00 msgr2=0x7f96c4195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:29.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c37fe700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c40ffb00 0x7f96c4195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:29.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c37fe700 1 -- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96c4101680 msgr2=0x7f96c419ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:29.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c37fe700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96c4101680 0x7f96c419ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:29.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c37fe700 1 -- 172.21.15.151:0/3508266495 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc009c40 con 0x7f96c4100cf0 2023-07-21T22:16:29.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c899c700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96c4101680 0x7f96c419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:16:29.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.856+0000 7f96c37fe700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96c4100cf0 0x7f96c4195c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005740 tx=0x7f96b8005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:29.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.857+0000 7f96c17fa700 1 -- 172.21.15.151:0/3508266495 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b801d070 con 0x7f96c4100cf0 2023-07-21T22:16:29.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.857+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96b80095f0 con 0x7f96c4100cf0 2023-07-21T22:16:29.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.857+0000 7f96c17fa700 1 -- 172.21.15.151:0/3508266495 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96b800be50 con 0x7f96c4100cf0 2023-07-21T22:16:29.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.857+0000 7f96c17fa700 1 -- 172.21.15.151:0/3508266495 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b8022dd0 con 0x7f96c4100cf0 2023-07-21T22:16:29.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.857+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c419dad0 con 0x7f96c4100cf0 2023-07-21T22:16:29.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.858+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c4107090 con 0x7f96c4100cf0 2023-07-21T22:16:29.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.860+0000 7f96c17fa700 1 -- 172.21.15.151:0/3508266495 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f96b8022570 con 0x7f96c4100cf0 2023-07-21T22:16:29.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.861+0000 7f96c17fa700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f96ac0a11a0 0x7f96ac0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:29.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.861+0000 7f96c17fa700 1 -- 172.21.15.151:0/3508266495 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f96b80ce250 con 0x7f96c4100cf0 2023-07-21T22:16:29.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.861+0000 7f96c3fff700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f96ac0a11a0 0x7f96ac0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:29.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.862+0000 7f96c3fff700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f96ac0a11a0 0x7f96ac0a3650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f96c4100b50 tx=0x7f96b4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:29.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:29.863+0000 7f96c17fa700 1 -- 172.21.15.151:0/3508266495 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f96b8097e30 con 0x7f96c4100cf0 2023-07-21T22:16:30.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.105+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f96c402c850 con 0x7f96c4100cf0 2023-07-21T22:16:30.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.105+0000 7f96c17fa700 1 -- 172.21.15.151:0/3508266495 <== mon.2 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f96b809b450 con 0x7f96c4100cf0 2023-07-21T22:16:30.150 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:30.150 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-21T22:16:30.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f96ac0a11a0 msgr2=0x7f96ac0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:30.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f96ac0a11a0 0x7f96ac0a3650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f96c4100b50 tx=0x7f96b4009260 comp rx=0 tx=0).stop 2023-07-21T22:16:30.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96c4100cf0 msgr2=0x7f96c4195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:30.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96c4100cf0 0x7f96c4195c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f96b8005740 tx=0x7f96b8005e80 comp rx=0 tx=0).stop 2023-07-21T22:16:30.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 shutdown_connections 2023-07-21T22:16:30.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f96ac0a11a0 0x7f96ac0a3650 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:30.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96c4101680 0x7f96c419ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:30.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f96c40ffb00 0x7f96c4195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:30.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 --2- 172.21.15.151:0/3508266495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96c4100cf0 0x7f96c4195c50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:30.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 >> 172.21.15.151:0/3508266495 conn(0x7f96c40fb0e0 msgr2=0x7f96c41041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:30.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 shutdown_connections 2023-07-21T22:16:30.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:30.108+0000 7f96ca3ff700 1 -- 172.21.15.151:0/3508266495 wait complete. 2023-07-21T22:16:30.154 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 2 2023-07-21T22:16:30.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:30.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.195:6832/2796106198,v1:172.21.15.195:6833/2796106198] up:boot 2023-07-21T22:16:30.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: fsmap 1 up:standby 2023-07-21T22:16:30.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-21T22:16:30.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:30.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:30.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:30.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:30.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:30.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:30.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:30 smithi195 ceph-mon[97365]: Deploying daemon mds.k on smithi187 2023-07-21T22:16:30.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:30.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.195:6832/2796106198,v1:172.21.15.195:6833/2796106198] up:boot 2023-07-21T22:16:30.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: fsmap 1 up:standby 2023-07-21T22:16:30.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-21T22:16:30.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:30.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:30.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:30.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:30.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:30.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:30.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:30 smithi151 ceph-mon[95510]: Deploying daemon mds.k on smithi187 2023-07-21T22:16:30.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:30.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.195:6832/2796106198,v1:172.21.15.195:6833/2796106198] up:boot 2023-07-21T22:16:30.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: fsmap 1 up:standby 2023-07-21T22:16:30.497 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-21T22:16:30.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:30.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:30.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:30.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:30.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:30.498 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:30.499 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:30 smithi187 ceph-mon[96918]: Deploying daemon mds.k on smithi187 2023-07-21T22:16:31.295 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:31 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3508266495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:31.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:31 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3508266495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:31.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:31 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3508266495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:31.559 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 22:16:31 smithi187 systemd[1]: Starting Ceph mds.k for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:32.171 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:32.323 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:32 smithi187 ceph-mon[96918]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:32.323 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 22:16:32 smithi187 podman[121364]: 2023-07-21T22:16:32.323 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 22:16:32 smithi187 bash[121364]: b3f680a2ce22c120a9737a02a5f02cde53e60320e4e86da0d2abbbedc2318d73 2023-07-21T22:16:32.323 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 22:16:32 smithi187 ceph-mds[121404]: -- 172.21.15.187:0/3731336788 <== mon.2 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x560f5e0c71e0 con 0x560f5e09cc00 2023-07-21T22:16:32.324 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 22:16:32 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-k[121380]: starting mds.k at 2023-07-21T22:16:32.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.339+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1156488633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f18100cf0 msgr2=0x7f5f18101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:32.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.339+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1156488633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f18100cf0 0x7f5f18101140 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c009990 tx=0x7f5f0c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.339+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1156488633 shutdown_connections 2023-07-21T22:16:32.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.339+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1156488633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f180ffb00 0x7f5f180fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.339+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1156488633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f18101680 0x7f5f18107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.339+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1156488633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f18100cf0 0x7f5f18101140 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.339+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1156488633 >> 172.21.15.151:0/1156488633 conn(0x7f5f180fb0e0 msgr2=0x7f5f180fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:32.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.339+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1156488633 shutdown_connections 2023-07-21T22:16:32.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.339+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1156488633 wait complete. 2023-07-21T22:16:32.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.340+0000 7f5f1e5ff700 1 Processor -- start 2023-07-21T22:16:32.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.340+0000 7f5f1e5ff700 1 -- start start 2023-07-21T22:16:32.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.340+0000 7f5f1e5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f180ffb00 0x7f5f18195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:32.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.340+0000 7f5f1e5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f18100cf0 0x7f5f18195c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:32.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.340+0000 7f5f1e5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f18101680 0x7f5f1819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:32.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.340+0000 7f5f1e5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1819d2d0 con 0x7f5f18101680 2023-07-21T22:16:32.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.340+0000 7f5f1e5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1819d410 con 0x7f5f18100cf0 2023-07-21T22:16:32.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.340+0000 7f5f1e5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1819d5a0 con 0x7f5f180ffb00 2023-07-21T22:16:32.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f177fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f18100cf0 0x7f5f18195c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f17fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f180ffb00 0x7f5f18195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f1cb9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f18101680 0x7f5f1819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f177fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f18100cf0 0x7f5f18195c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55800/0 (socket says 172.21.15.151:55800) 2023-07-21T22:16:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f177fe700 1 -- 172.21.15.151:0/1233480308 learned_addr learned my addr 172.21.15.151:0/1233480308 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f1cb9c700 1 -- 172.21.15.151:0/1233480308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f180ffb00 msgr2=0x7f5f18195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f1cb9c700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f180ffb00 0x7f5f18195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f1cb9c700 1 -- 172.21.15.151:0/1233480308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f18100cf0 msgr2=0x7f5f18195c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:32.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f1cb9c700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f18100cf0 0x7f5f18195c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f1cb9c700 1 -- 172.21.15.151:0/1233480308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c0095f0 con 0x7f5f18101680 2023-07-21T22:16:32.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.341+0000 7f5f1cb9c700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f18101680 0x7f5f1819cd00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5f10007f10 tx=0x7f5f1000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:32.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.342+0000 7f5f157fa700 1 -- 172.21.15.151:0/1233480308 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10004db0 con 0x7f5f18101680 2023-07-21T22:16:32.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.342+0000 7f5f157fa700 1 -- 172.21.15.151:0/1233480308 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f1000f040 con 0x7f5f18101680 2023-07-21T22:16:32.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.342+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1819d880 con 0x7f5f18101680 2023-07-21T22:16:32.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.342+0000 7f5f157fa700 1 -- 172.21.15.151:0/1233480308 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f10005960 con 0x7f5f18101680 2023-07-21T22:16:32.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.342+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1819dde0 con 0x7f5f18101680 2023-07-21T22:16:32.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.343+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f18106a00 con 0x7f5f18101680 2023-07-21T22:16:32.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.345+0000 7f5f157fa700 1 -- 172.21.15.151:0/1233480308 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5f1000db20 con 0x7f5f18101680 2023-07-21T22:16:32.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.347+0000 7f5f157fa700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5f000a1220 0x7f5f000a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:32.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.347+0000 7f5f157fa700 1 -- 172.21.15.151:0/1233480308 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5f100cbd00 con 0x7f5f18101680 2023-07-21T22:16:32.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.347+0000 7f5f17fff700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5f000a1220 0x7f5f000a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:32.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.347+0000 7f5f17fff700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5f000a1220 0x7f5f000a36d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f18100b50 tx=0x7f5f08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:32.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.350+0000 7f5f157fa700 1 -- 172.21.15.151:0/1233480308 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f5f1004e770 con 0x7f5f18101680 2023-07-21T22:16:32.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:32 smithi151 ceph-mon[95510]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:32.627 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 22:16:32 smithi187 systemd[1]: Started Ceph mds.k for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:32.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:32 smithi195 ceph-mon[97365]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:32.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.616+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5f1802c850 con 0x7f5f18101680 2023-07-21T22:16:32.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.616+0000 7f5f157fa700 1 -- 172.21.15.151:0/1233480308 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1260 (secure 0 0 0) 0x7f5f10095850 con 0x7f5f18101680 2023-07-21T22:16:32.660 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:32.660 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-21T22:16:32.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5f000a1220 msgr2=0x7f5f000a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:32.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5f000a1220 0x7f5f000a36d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f5f18100b50 tx=0x7f5f08009260 comp rx=0 tx=0).stop 2023-07-21T22:16:32.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f18101680 msgr2=0x7f5f1819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:32.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f18101680 0x7f5f1819cd00 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5f10007f10 tx=0x7f5f1000d3b0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 shutdown_connections 2023-07-21T22:16:32.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5f000a1220 0x7f5f000a36d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f18101680 0x7f5f1819cd00 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f180ffb00 0x7f5f18195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 --2- 172.21.15.151:0/1233480308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f18100cf0 0x7f5f18195c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:32.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 >> 172.21.15.151:0/1233480308 conn(0x7f5f180fb0e0 msgr2=0x7f5f180fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:32.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 shutdown_connections 2023-07-21T22:16:32.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:32.619+0000 7f5f1e5ff700 1 -- 172.21.15.151:0/1233480308 wait complete. 2023-07-21T22:16:32.665 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 2 2023-07-21T22:16:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:33.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:33.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:33.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:33.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: Deploying daemon mds.j on smithi151 2023-07-21T22:16:33.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1233480308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:33.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.187:6832/3442978615,v1:172.21.15.187:6833/3442978615] up:boot 2023-07-21T22:16:33.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: fsmap 2 up:standby 2023-07-21T22:16:33.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:33 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-21T22:16:33.658 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:33.658 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:33.658 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:33.658 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:33.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:33.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:33.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: Deploying daemon mds.j on smithi151 2023-07-21T22:16:33.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1233480308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:33.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.187:6832/3442978615,v1:172.21.15.187:6833/3442978615] up:boot 2023-07-21T22:16:33.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: fsmap 2 up:standby 2023-07-21T22:16:33.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:33 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-21T22:16:33.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:33.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:33.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:33.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:33.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:33.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:33.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: Deploying daemon mds.j on smithi151 2023-07-21T22:16:33.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1233480308' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:33.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.187:6832/3442978615,v1:172.21.15.187:6833/3442978615] up:boot 2023-07-21T22:16:33.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: fsmap 2 up:standby 2023-07-21T22:16:33.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:33 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-21T22:16:34.634 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:34 smithi151 ceph-mon[95510]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:34.634 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 22:16:34 smithi151 systemd[1]: Starting Ceph mds.j for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:34.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:34.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:34 smithi187 ceph-mon[96918]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:34.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:34 smithi195 ceph-mon[97365]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:35.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.022+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1631978836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd01005d0 msgr2=0x7fbbd01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:35.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.022+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1631978836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd01005d0 0x7fbbd01029b0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009990 tx=0x7fbbcc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.022+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1631978836 shutdown_connections 2023-07-21T22:16:35.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.022+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1631978836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd0105810 0x7fbbd0107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.022+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1631978836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd01005d0 0x7fbbd01029b0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.022+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1631978836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd0102ef0 0x7fbbd01052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.022+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1631978836 >> 172.21.15.151:0/1631978836 conn(0x7fbbd00f9fd0 msgr2=0x7fbbd00fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:35.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.022+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1631978836 shutdown_connections 2023-07-21T22:16:35.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.022+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1631978836 wait complete. 2023-07-21T22:16:35.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.024+0000 7fbbd85ff700 1 Processor -- start 2023-07-21T22:16:35.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.024+0000 7fbbd85ff700 1 -- start start 2023-07-21T22:16:35.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd85ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd01005d0 0x7fbbd0195710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:35.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd85ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0102ef0 0x7fbbd0195c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:35.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd85ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd0105810 0x7fbbd019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:35.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd85ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd019d290 con 0x7fbbd0102ef0 2023-07-21T22:16:35.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd85ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd019d3d0 con 0x7fbbd0105810 2023-07-21T22:16:35.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd85ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd019d560 con 0x7fbbd01005d0 2023-07-21T22:16:35.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd5b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0102ef0 0x7fbbd0195c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:35.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd5b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0102ef0 0x7fbbd0195c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43074/0 (socket says 172.21.15.151:43074) 2023-07-21T22:16:35.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd5b9a700 1 -- 172.21.15.151:0/1381208233 learned_addr learned my addr 172.21.15.151:0/1381208233 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:35.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd639b700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd01005d0 0x7fbbd0195710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:35.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd6b9c700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd0105810 0x7fbbd019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:35.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd5b9a700 1 -- 172.21.15.151:0/1381208233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd01005d0 msgr2=0x7fbbd0195710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:35.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd5b9a700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd01005d0 0x7fbbd0195710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd5b9a700 1 -- 172.21.15.151:0/1381208233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd0105810 msgr2=0x7fbbd019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:35.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd5b9a700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd0105810 0x7fbbd019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.025+0000 7fbbd5b9a700 1 -- 172.21.15.151:0/1381208233 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0095f0 con 0x7fbbd0102ef0 2023-07-21T22:16:35.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.026+0000 7fbbd5b9a700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0102ef0 0x7fbbd0195c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000d950 tx=0x7fbbc000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:35.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.026+0000 7fbbc77fe700 1 -- 172.21.15.151:0/1381208233 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0009940 con 0x7fbbd0102ef0 2023-07-21T22:16:35.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.026+0000 7fbbc77fe700 1 -- 172.21.15.151:0/1381208233 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbbc0010460 con 0x7fbbd0102ef0 2023-07-21T22:16:35.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.026+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd019d840 con 0x7fbbd0102ef0 2023-07-21T22:16:35.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.026+0000 7fbbc77fe700 1 -- 172.21.15.151:0/1381208233 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc000f620 con 0x7fbbd0102ef0 2023-07-21T22:16:35.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.026+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd019dd50 con 0x7fbbd0102ef0 2023-07-21T22:16:35.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.027+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd00fbb40 con 0x7fbbd0102ef0 2023-07-21T22:16:35.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.029+0000 7fbbc77fe700 1 -- 172.21.15.151:0/1381208233 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fbbc00105d0 con 0x7fbbd0102ef0 2023-07-21T22:16:35.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.030+0000 7fbbc77fe700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbbbc0a11a0 0x7fbbbc0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:35.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.031+0000 7fbbc77fe700 1 -- 172.21.15.151:0/1381208233 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fbbc00cc360 con 0x7fbbd0102ef0 2023-07-21T22:16:35.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.031+0000 7fbbd639b700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbbbc0a11a0 0x7fbbbc0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:35.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.031+0000 7fbbd639b700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbbbc0a11a0 0x7fbbbc0a3650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00b5c0 tx=0x7fbbcc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:35.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.034+0000 7fbbc77fe700 1 -- 172.21.15.151:0/1381208233 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fbbc0095eb0 con 0x7fbbd0102ef0 2023-07-21T22:16:35.199 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 22:16:35 smithi151 podman[129155]: 2023-07-21T22:16:35.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.297+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbd002c850 con 0x7fbbd0102ef0 2023-07-21T22:16:35.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.298+0000 7fbbc77fe700 1 -- 172.21.15.151:0/1381208233 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2020 (secure 0 0 0) 0x7fbbc00994d0 con 0x7fbbd0102ef0 2023-07-21T22:16:35.342 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:35.342 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-21T22:16:35.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbbbc0a11a0 msgr2=0x7fbbbc0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:35.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbbbc0a11a0 0x7fbbbc0a3650 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc00b5c0 tx=0x7fbbcc005fb0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0102ef0 msgr2=0x7fbbd0195c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:35.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0102ef0 0x7fbbd0195c50 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000d950 tx=0x7fbbc000dc60 comp rx=0 tx=0).stop 2023-07-21T22:16:35.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 shutdown_connections 2023-07-21T22:16:35.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbbbc0a11a0 0x7fbbbc0a3650 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbd0105810 0x7fbbd019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbbd01005d0 0x7fbbd0195710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 --2- 172.21.15.151:0/1381208233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0102ef0 0x7fbbd0195c50 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:35.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.300+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 >> 172.21.15.151:0/1381208233 conn(0x7fbbd00f9fd0 msgr2=0x7fbbd0101230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:35.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.301+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 shutdown_connections 2023-07-21T22:16:35.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:35.301+0000 7fbbd85ff700 1 -- 172.21.15.151:0/1381208233 wait complete. 2023-07-21T22:16:35.346 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 3 2023-07-21T22:16:35.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:35 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1381208233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:35.699 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 22:16:35 smithi151 bash[129155]: 74efcb9551ecc8119ba875ff3737b26cf80088632500433c2669c0cc55f2dc4b 2023-07-21T22:16:35.699 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 22:16:35 smithi151 ceph-mds[129218]: -- 172.21.15.151:0/3853956636 <== mon.0 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55e02adad1e0 con 0x55e02ad83000 2023-07-21T22:16:35.700 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 22:16:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-j[129194]: starting mds.j at 2023-07-21T22:16:35.700 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 22:16:35 smithi151 systemd[1]: Started Ceph mds.j for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:35.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:35 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1381208233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:35.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:35 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1381208233' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:36.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:36.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.151:6834/2869868293,v1:172.21.15.151:6835/2869868293] up:boot 2023-07-21T22:16:36.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: fsmap 3 up:standby 2023-07-21T22:16:36.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-21T22:16:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:36.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:36 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:36.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:36.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.151:6834/2869868293,v1:172.21.15.151:6835/2869868293] up:boot 2023-07-21T22:16:36.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: fsmap 3 up:standby 2023-07-21T22:16:36.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-21T22:16:36.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:36.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:36.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:36.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:36.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:36.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:36 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:36.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:36.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.151:6834/2869868293,v1:172.21.15.151:6835/2869868293] up:boot 2023-07-21T22:16:36.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: fsmap 3 up:standby 2023-07-21T22:16:36.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-21T22:16:36.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:36.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:36.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:36.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:36.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:36.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:36 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:37.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:37.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.554+0000 7f97171ff700 1 -- 172.21.15.151:0/259809107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 msgr2=0x7f9710072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:37.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.554+0000 7f97171ff700 1 --2- 172.21.15.151:0/259809107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 0x7f9710072940 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f9704009990 tx=0x7f9704009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.554+0000 7f97171ff700 1 -- 172.21.15.151:0/259809107 shutdown_connections 2023-07-21T22:16:37.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.554+0000 7f97171ff700 1 --2- 172.21.15.151:0/259809107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97101079a0 0x7f9710109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.554+0000 7f97171ff700 1 --2- 172.21.15.151:0/259809107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 0x7f9710072940 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.554+0000 7f97171ff700 1 --2- 172.21.15.151:0/259809107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9710072f10 0x7f9710073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.554+0000 7f97171ff700 1 -- 172.21.15.151:0/259809107 >> 172.21.15.151:0/259809107 conn(0x7f97100fb110 msgr2=0x7f97100fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:37.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.554+0000 7f97171ff700 1 -- 172.21.15.151:0/259809107 shutdown_connections 2023-07-21T22:16:37.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.554+0000 7f97171ff700 1 -- 172.21.15.151:0/259809107 wait complete. 2023-07-21T22:16:37.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.555+0000 7f97171ff700 1 Processor -- start 2023-07-21T22:16:37.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.555+0000 7f97171ff700 1 -- start start 2023-07-21T22:16:37.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.555+0000 7f97171ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9710072f10 0x7f9710197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:37.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.555+0000 7f97171ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 0x7f9710197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:37.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.555+0000 7f97171ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97101079a0 0x7f971019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:37.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.555+0000 7f97171ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971019f490 con 0x7f97100744f0 2023-07-21T22:16:37.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.555+0000 7f97171ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971019f5d0 con 0x7f97101079a0 2023-07-21T22:16:37.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.555+0000 7f97171ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971019f760 con 0x7f9710072f10 2023-07-21T22:16:37.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f970ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 0x7f9710197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:37.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f970ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 0x7f9710197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33942/0 (socket says 172.21.15.151:33942) 2023-07-21T22:16:37.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f970ffff700 1 -- 172.21.15.151:0/3205609450 learned_addr learned my addr 172.21.15.151:0/3205609450 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:37.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f971579c700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97101079a0 0x7f971019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:37.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f9714f9b700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9710072f10 0x7f9710197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:37.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f970ffff700 1 -- 172.21.15.151:0/3205609450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9710072f10 msgr2=0x7f9710197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:37.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f970ffff700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9710072f10 0x7f9710197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f970ffff700 1 -- 172.21.15.151:0/3205609450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97101079a0 msgr2=0x7f971019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:37.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f970ffff700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97101079a0 0x7f971019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f970ffff700 1 -- 172.21.15.151:0/3205609450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97040095f0 con 0x7f97100744f0 2023-07-21T22:16:37.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.556+0000 7f970ffff700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 0x7f9710197e50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00e9a0 tx=0x7f96fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:37.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.557+0000 7f970dffb700 1 -- 172.21.15.151:0/3205609450 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc009790 con 0x7f97100744f0 2023-07-21T22:16:37.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.557+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f971019fa40 con 0x7f97100744f0 2023-07-21T22:16:37.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.557+0000 7f970dffb700 1 -- 172.21.15.151:0/3205609450 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f96fc010430 con 0x7f97100744f0 2023-07-21T22:16:37.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.557+0000 7f970dffb700 1 -- 172.21.15.151:0/3205609450 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96fc00cea0 con 0x7f97100744f0 2023-07-21T22:16:37.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.557+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f971019ffa0 con 0x7f97100744f0 2023-07-21T22:16:37.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.558+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97101060e0 con 0x7f97100744f0 2023-07-21T22:16:37.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.560+0000 7f970dffb700 1 -- 172.21.15.151:0/3205609450 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f96fc0105a0 con 0x7f97100744f0 2023-07-21T22:16:37.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.561+0000 7f970dffb700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f97000a11a0 0x7f97000a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:37.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.561+0000 7f970dffb700 1 -- 172.21.15.151:0/3205609450 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f96fc014070 con 0x7f97100744f0 2023-07-21T22:16:37.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.561+0000 7f9714f9b700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f97000a11a0 0x7f97000a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:37.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.562+0000 7f9714f9b700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f97000a11a0 0x7f97000a3650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9704006010 tx=0x7f970400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:37.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.565+0000 7f970dffb700 1 -- 172.21.15.151:0/3205609450 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f96fc051770 con 0x7f97100744f0 2023-07-21T22:16:37.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:37 smithi151 ceph-mon[95510]: Deploying daemon mds.d on smithi151 2023-07-21T22:16:37.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:37 smithi187 ceph-mon[96918]: Deploying daemon mds.d on smithi151 2023-07-21T22:16:37.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:37 smithi195 ceph-mon[97365]: Deploying daemon mds.d on smithi151 2023-07-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.864+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f971002c850 con 0x7f97100744f0 2023-07-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.865+0000 7f970dffb700 1 -- 172.21.15.151:0/3205609450 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) v1 ==== 93+0+2780 (secure 0 0 0) 0x7f96fc096250 con 0x7f97100744f0 2023-07-21T22:16:37.908 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:37.909 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f97000a11a0 msgr2=0x7f97000a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f97000a11a0 0x7f97000a3650 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9704006010 tx=0x7f970400b260 comp rx=0 tx=0).stop 2023-07-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 msgr2=0x7f9710197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 0x7f9710197e50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f96fc00e9a0 tx=0x7f96fc00ecb0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 shutdown_connections 2023-07-21T22:16:37.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f97000a11a0 0x7f97000a3650 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97101079a0 0x7f971019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9710072f10 0x7f9710197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 --2- 172.21.15.151:0/3205609450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97100744f0 0x7f9710197e50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 >> 172.21.15.151:0/3205609450 conn(0x7f97100fb110 msgr2=0x7f97100fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 shutdown_connections 2023-07-21T22:16:37.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:37.867+0000 7f97171ff700 1 -- 172.21.15.151:0/3205609450 wait complete. 2023-07-21T22:16:37.913 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 4 2023-07-21T22:16:38.198 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 22:16:37 smithi151 systemd[1]: Starting Ceph mds.d for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:38.519 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:38 smithi151 ceph-mon[95510]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:38.520 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:38 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3205609450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:38.520 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 22:16:38 smithi151 podman[129571]: 2023-07-21T22:16:38.520 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 22:16:38 smithi151 bash[129571]: 7a10e9266d47ecd4cbc9b00f7558790184f6f3356affdfcda445efdda457081a 2023-07-21T22:16:38.520 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 22:16:38 smithi151 ceph-mds[129611]: -- 172.21.15.151:0/3693336007 <== mon.0 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5569b809d1e0 con 0x5569b8072c00 2023-07-21T22:16:38.520 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 22:16:38 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-d[129587]: starting mds.d at 2023-07-21T22:16:38.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:38 smithi187 ceph-mon[96918]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:38.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:38 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3205609450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:38.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:38 smithi195 ceph-mon[97365]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:38.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:38 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3205609450' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:38.948 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 22:16:38 smithi151 systemd[1]: Started Ceph mds.d for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:39.858 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:39.858 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:39.858 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:39.859 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:39.859 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:39.859 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:39.859 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: Deploying daemon mds.e on smithi187 2023-07-21T22:16:39.859 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:39.859 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.151:6836/1023251552,v1:172.21.15.151:6837/1023251552] up:boot 2023-07-21T22:16:39.860 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: fsmap 4 up:standby 2023-07-21T22:16:39.860 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:39 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-21T22:16:39.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:39.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:39.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:39.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:39.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:39.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:39.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: Deploying daemon mds.e on smithi187 2023-07-21T22:16:39.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:39.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.151:6836/1023251552,v1:172.21.15.151:6837/1023251552] up:boot 2023-07-21T22:16:39.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: fsmap 4 up:standby 2023-07-21T22:16:39.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:39 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-21T22:16:39.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:39.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:39.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:39.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:39.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:39.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:39.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:39.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: Deploying daemon mds.e on smithi187 2023-07-21T22:16:39.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:39.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.151:6836/1023251552,v1:172.21.15.151:6837/1023251552] up:boot 2023-07-21T22:16:39.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: fsmap 4 up:standby 2023-07-21T22:16:39.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:39 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.097+0000 7f8ff77ff700 1 -- 172.21.15.151:0/2087078843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff0101680 msgr2=0x7f8ff0107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.097+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/2087078843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff0101680 0x7f8ff0107f40 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8fe800b0a0 tx=0x7f8fe800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.097+0000 7f8ff77ff700 1 -- 172.21.15.151:0/2087078843 shutdown_connections 2023-07-21T22:16:40.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.097+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/2087078843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ff00ffb00 0x7f8ff00fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.097+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/2087078843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff0101680 0x7f8ff0107f40 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.097+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/2087078843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff0100cf0 0x7f8ff0101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.097+0000 7f8ff77ff700 1 -- 172.21.15.151:0/2087078843 >> 172.21.15.151:0/2087078843 conn(0x7f8ff00fb0e0 msgr2=0x7f8ff00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.097+0000 7f8ff77ff700 1 -- 172.21.15.151:0/2087078843 shutdown_connections 2023-07-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.097+0000 7f8ff77ff700 1 -- 172.21.15.151:0/2087078843 wait complete. 2023-07-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.098+0000 7f8ff77ff700 1 Processor -- start 2023-07-21T22:16:40.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.098+0000 7f8ff77ff700 1 -- start start 2023-07-21T22:16:40.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff77ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff00ffb00 0x7f8ff0197a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff77ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff0100cf0 0x7f8ff0197f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff77ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ff0101680 0x7f8ff019efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff77ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff019f590 con 0x7f8ff00ffb00 2023-07-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff77ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff019f6d0 con 0x7f8ff0101680 2023-07-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff77ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ff019f860 con 0x7f8ff0100cf0 2023-07-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff559b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff00ffb00 0x7f8ff0197a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:40.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff559b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff00ffb00 0x7f8ff0197a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33980/0 (socket says 172.21.15.151:33980) 2023-07-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff559b700 1 -- 172.21.15.151:0/167117683 learned_addr learned my addr 172.21.15.151:0/167117683 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff5d9c700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ff0101680 0x7f8ff019efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff4d9a700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff0100cf0 0x7f8ff0197f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff559b700 1 -- 172.21.15.151:0/167117683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff0100cf0 msgr2=0x7f8ff0197f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff559b700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff0100cf0 0x7f8ff0197f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff559b700 1 -- 172.21.15.151:0/167117683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ff0101680 msgr2=0x7f8ff019efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:40.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff559b700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ff0101680 0x7f8ff019efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff559b700 1 -- 172.21.15.151:0/167117683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fe8009d00 con 0x7f8ff00ffb00 2023-07-21T22:16:40.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.099+0000 7f8ff5d9c700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ff0101680 0x7f8ff019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:16:40.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.100+0000 7f8ff559b700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff00ffb00 0x7f8ff0197a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00e970 tx=0x7f8fec00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:40.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.100+0000 7f8fe67fc700 1 -- 172.21.15.151:0/167117683 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec009790 con 0x7f8ff00ffb00 2023-07-21T22:16:40.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.100+0000 7f8fe67fc700 1 -- 172.21.15.151:0/167117683 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8fec00c7e0 con 0x7f8ff00ffb00 2023-07-21T22:16:40.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.100+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ff019fb40 con 0x7f8ff00ffb00 2023-07-21T22:16:40.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.100+0000 7f8fe67fc700 1 -- 172.21.15.151:0/167117683 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fec003bd0 con 0x7f8ff00ffb00 2023-07-21T22:16:40.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.100+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ff01a00a0 con 0x7f8ff00ffb00 2023-07-21T22:16:40.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.101+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ff010b1e0 con 0x7f8ff00ffb00 2023-07-21T22:16:40.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.103+0000 7f8fe67fc700 1 -- 172.21.15.151:0/167117683 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8fec00c950 con 0x7f8ff00ffb00 2023-07-21T22:16:40.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.104+0000 7f8fe67fc700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8fdc0a1220 0x7f8fdc0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:40.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.104+0000 7f8fe67fc700 1 -- 172.21.15.151:0/167117683 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8fec014070 con 0x7f8ff00ffb00 2023-07-21T22:16:40.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.105+0000 7f8ff4d9a700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8fdc0a1220 0x7f8fdc0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:40.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.105+0000 7f8ff4d9a700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8fdc0a1220 0x7f8fdc0a36d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009c60 tx=0x7f8fe0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:40.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.108+0000 7f8fe67fc700 1 -- 172.21.15.151:0/167117683 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8fec0961c0 con 0x7f8ff00ffb00 2023-07-21T22:16:40.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.351+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ff01a0860 con 0x7f8ff00ffb00 2023-07-21T22:16:40.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.352+0000 7f8fe67fc700 1 -- 172.21.15.151:0/167117683 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) v1 ==== 93+0+3540 (secure 0 0 0) 0x7f8fec0997e0 con 0x7f8ff00ffb00 2023-07-21T22:16:40.396 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:40.396 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-07-21T22:16:40.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8fdc0a1220 msgr2=0x7f8fdc0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:40.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8fdc0a1220 0x7f8fdc0a36d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8fe0009c60 tx=0x7f8fe0009260 comp rx=0 tx=0).stop 2023-07-21T22:16:40.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff00ffb00 msgr2=0x7f8ff0197a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:40.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff00ffb00 0x7f8ff0197a10 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8fec00e970 tx=0x7f8fec00ec80 comp rx=0 tx=0).stop 2023-07-21T22:16:40.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 shutdown_connections 2023-07-21T22:16:40.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8fdc0a1220 0x7f8fdc0a36d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ff0101680 0x7f8ff019efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ff00ffb00 0x7f8ff0197a10 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 --2- 172.21.15.151:0/167117683 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8ff0100cf0 0x7f8ff0197f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:40.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 >> 172.21.15.151:0/167117683 conn(0x7f8ff00fb0e0 msgr2=0x7f8ff0106520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:40.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 shutdown_connections 2023-07-21T22:16:40.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:40.354+0000 7f8ff77ff700 1 -- 172.21.15.151:0/167117683 wait complete. 2023-07-21T22:16:40.400 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 5 2023-07-21T22:16:40.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:40 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/167117683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:40.860 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:40 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/167117683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:40.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:40 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/167117683' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:41.128 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 22:16:40 smithi187 systemd[1]: Starting Ceph mds.e for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:41.627 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 22:16:41 smithi187 podman[121707]: 2023-07-21T22:16:41.628 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 22:16:41 smithi187 bash[121707]: 7d5322728faddcc5f97bc95ffe09fdf605185e511290f68fdb0503c81c1e2c7a 2023-07-21T22:16:41.628 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 22:16:41 smithi187 ceph-mds[121747]: -- 172.21.15.187:0/1371905091 <== mon.2 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5617170331e0 con 0x561717008c00 2023-07-21T22:16:41.628 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 22:16:41 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-e[121723]: starting mds.e at 2023-07-21T22:16:42.127 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 22:16:41 smithi187 systemd[1]: Started Ceph mds.e for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:42.419 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:42.486 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:42 smithi151 ceph-mon[95510]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:42.486 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:42.486 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:42.487 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:42.487 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:42.487 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:42.487 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:42 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:42.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:42 smithi187 ceph-mon[96918]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:42.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:42.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:42 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.585+0000 7fe22d9ff700 1 -- 172.21.15.151:0/1411375015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe228100cf0 msgr2=0x7fe228101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:42.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.585+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/1411375015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe228100cf0 0x7fe228101140 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009990 tx=0x7fe21c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.585+0000 7fe22d9ff700 1 -- 172.21.15.151:0/1411375015 shutdown_connections 2023-07-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.585+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/1411375015 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe228101680 0x7fe228107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.585+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/1411375015 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe2280ffb00 0x7fe2280fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.585+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/1411375015 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe228100cf0 0x7fe228101140 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.585+0000 7fe22d9ff700 1 -- 172.21.15.151:0/1411375015 >> 172.21.15.151:0/1411375015 conn(0x7fe2280fb0e0 msgr2=0x7fe2280fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.585+0000 7fe22d9ff700 1 -- 172.21.15.151:0/1411375015 shutdown_connections 2023-07-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.585+0000 7fe22d9ff700 1 -- 172.21.15.151:0/1411375015 wait complete. 2023-07-21T22:16:42.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe22d9ff700 1 Processor -- start 2023-07-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe22d9ff700 1 -- start start 2023-07-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe22d9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2280ffb00 0x7fe2281956b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe22d9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe228100cf0 0x7fe228195bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe22d9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe228101680 0x7fe22819cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe22d9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22819d230 con 0x7fe228100cf0 2023-07-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe22d9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22819d370 con 0x7fe2280ffb00 2023-07-21T22:16:42.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe22d9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22819d500 con 0x7fe228101680 2023-07-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe2267fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe228100cf0 0x7fe228195bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.586+0000 7fe2277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe228101680 0x7fe22819cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe2277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe228101680 0x7fe22819cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49830/0 (socket says 172.21.15.151:49830) 2023-07-21T22:16:42.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe2277fe700 1 -- 172.21.15.151:0/2987239173 learned_addr learned my addr 172.21.15.151:0/2987239173 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe226ffd700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2280ffb00 0x7fe2281956b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe2267fc700 1 -- 172.21.15.151:0/2987239173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe228101680 msgr2=0x7fe22819cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe2267fc700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe228101680 0x7fe22819cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe2267fc700 1 -- 172.21.15.151:0/2987239173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2280ffb00 msgr2=0x7fe2281956b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe2267fc700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2280ffb00 0x7fe2281956b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe2267fc700 1 -- 172.21.15.151:0/2987239173 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0095f0 con 0x7fe228100cf0 2023-07-21T22:16:42.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe2267fc700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe228100cf0 0x7fe228195bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0098e0 tx=0x7fe21c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe22c9fd700 1 -- 172.21.15.151:0/2987239173 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c01d070 con 0x7fe228100cf0 2023-07-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe22c9fd700 1 -- 172.21.15.151:0/2987239173 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe21c003f80 con 0x7fe228100cf0 2023-07-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22819d780 con 0x7fe228100cf0 2023-07-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.587+0000 7fe22c9fd700 1 -- 172.21.15.151:0/2987239173 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21c022ba0 con 0x7fe228100cf0 2023-07-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.588+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22819dc00 con 0x7fe228100cf0 2023-07-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.589+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe228106ff0 con 0x7fe228100cf0 2023-07-21T22:16:42.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.590+0000 7fe22c9fd700 1 -- 172.21.15.151:0/2987239173 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe21c003af0 con 0x7fe228100cf0 2023-07-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.592+0000 7fe22c9fd700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe2100a1220 0x7fe2100a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.592+0000 7fe22c9fd700 1 -- 172.21.15.151:0/2987239173 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fe21c0cdbb0 con 0x7fe228100cf0 2023-07-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.592+0000 7fe226ffd700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe2100a1220 0x7fe2100a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:42.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.593+0000 7fe226ffd700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe2100a1220 0x7fe2100a36d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe218005950 tx=0x7fe2180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:42.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.594+0000 7fe22c9fd700 1 -- 172.21.15.151:0/2987239173 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fe21c097790 con 0x7fe228100cf0 2023-07-21T22:16:42.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:42 smithi195 ceph-mon[97365]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:42.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:42.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:42.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:42.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:42.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:42.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:42 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:42.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.839+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe22802c850 con 0x7fe228100cf0 2023-07-21T22:16:42.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.840+0000 7fe22c9fd700 1 -- 172.21.15.151:0/2987239173 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4300 (secure 0 0 0) 0x7fe21c09adb0 con 0x7fe228100cf0 2023-07-21T22:16:42.884 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:42.884 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6}],"filesystems":[]} 2023-07-21T22:16:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe2100a1220 msgr2=0x7fe2100a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe2100a1220 0x7fe2100a36d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe218005950 tx=0x7fe2180058e0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe228100cf0 msgr2=0x7fe228195bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe228100cf0 0x7fe228195bf0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fe21c0098e0 tx=0x7fe21c009580 comp rx=0 tx=0).stop 2023-07-21T22:16:42.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 shutdown_connections 2023-07-21T22:16:42.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe2100a1220 0x7fe2100a36d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2280ffb00 0x7fe2281956b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe228101680 0x7fe22819cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 --2- 172.21.15.151:0/2987239173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe228100cf0 0x7fe228195bf0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:42.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 >> 172.21.15.151:0/2987239173 conn(0x7fe2280fb0e0 msgr2=0x7fe228104130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:42.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 shutdown_connections 2023-07-21T22:16:42.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:42.842+0000 7fe22d9ff700 1 -- 172.21.15.151:0/2987239173 wait complete. 2023-07-21T22:16:42.888 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 6 2023-07-21T22:16:43.305 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:43 smithi195 ceph-mon[97365]: Deploying daemon mds.f on smithi195 2023-07-21T22:16:43.306 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:43 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.187:6834/3281429688,v1:172.21.15.187:6835/3281429688] up:boot 2023-07-21T22:16:43.306 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:43 smithi195 ceph-mon[97365]: fsmap 5 up:standby 2023-07-21T22:16:43.306 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-21T22:16:43.306 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:43 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2987239173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:43.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:43 smithi187 ceph-mon[96918]: Deploying daemon mds.f on smithi195 2023-07-21T22:16:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:43 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.187:6834/3281429688,v1:172.21.15.187:6835/3281429688] up:boot 2023-07-21T22:16:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:43 smithi187 ceph-mon[96918]: fsmap 5 up:standby 2023-07-21T22:16:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-21T22:16:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:43 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2987239173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:43.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:43 smithi151 ceph-mon[95510]: Deploying daemon mds.f on smithi195 2023-07-21T22:16:43.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:43 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.187:6834/3281429688,v1:172.21.15.187:6835/3281429688] up:boot 2023-07-21T22:16:43.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:43 smithi151 ceph-mon[95510]: fsmap 5 up:standby 2023-07-21T22:16:43.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-21T22:16:43.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:43 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2987239173' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:43.935 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:16:43 smithi195 systemd[1]: Starting Ceph mds.f for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:44.533 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:44 smithi195 ceph-mon[97365]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:44.533 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:16:44 smithi195 podman[123180]: 2023-07-21T22:16:44.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:44 smithi187 ceph-mon[96918]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:44.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:44 smithi151 ceph-mon[95510]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:44.906 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:16:44 smithi195 bash[123180]: e9e035418351c009994b363bcaee793262e97f59125c97d50d40c054b0f8c440 2023-07-21T22:16:44.906 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:16:44 smithi195 ceph-mds[123220]: -- 172.21.15.195:0/1862170260 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c8709331e0 con 0x55c870908800 2023-07-21T22:16:44.906 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:16:44 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: starting mds.f at 2023-07-21T22:16:44.906 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:16:44 smithi195 systemd[1]: Started Ceph mds.f for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:44.907 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:45.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.071+0000 7f43a95ff700 1 -- 172.21.15.151:0/34330609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4100cf0 msgr2=0x7f43a4101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:45.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.071+0000 7f43a95ff700 1 --2- 172.21.15.151:0/34330609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4100cf0 0x7f43a4101140 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f4398009990 tx=0x7f4398009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.071+0000 7f43a95ff700 1 -- 172.21.15.151:0/34330609 shutdown_connections 2023-07-21T22:16:45.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.071+0000 7f43a95ff700 1 --2- 172.21.15.151:0/34330609 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a4101680 0x7f43a4107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.071+0000 7f43a95ff700 1 --2- 172.21.15.151:0/34330609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb00 0x7f43a40fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.071+0000 7f43a95ff700 1 --2- 172.21.15.151:0/34330609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4100cf0 0x7f43a4101140 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.071+0000 7f43a95ff700 1 -- 172.21.15.151:0/34330609 >> 172.21.15.151:0/34330609 conn(0x7f43a40fb0e0 msgr2=0x7f43a40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:45.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.071+0000 7f43a95ff700 1 -- 172.21.15.151:0/34330609 shutdown_connections 2023-07-21T22:16:45.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.071+0000 7f43a95ff700 1 -- 172.21.15.151:0/34330609 wait complete. 2023-07-21T22:16:45.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.073+0000 7f43a95ff700 1 Processor -- start 2023-07-21T22:16:45.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.073+0000 7f43a95ff700 1 -- start start 2023-07-21T22:16:45.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.073+0000 7f43a95ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb00 0x7f43a40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:45.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.073+0000 7f43a95ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4100cf0 0x7f43a4072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:45.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.073+0000 7f43a95ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a4101680 0x7f43a4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:45.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.073+0000 7f43a95ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a40735e0 con 0x7f43a4100cf0 2023-07-21T22:16:45.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.073+0000 7f43a95ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a4073750 con 0x7f43a4101680 2023-07-21T22:16:45.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.073+0000 7f43a95ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a419f7c0 con 0x7f43a40ffb00 2023-07-21T22:16:45.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb00 0x7f43a40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:45.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4100cf0 0x7f43a4072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:45.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb00 0x7f43a40742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49856/0 (socket says 172.21.15.151:49856) 2023-07-21T22:16:45.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a2ffd700 1 -- 172.21.15.151:0/255532060 learned_addr learned my addr 172.21.15.151:0/255532060 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:45.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a2ffd700 1 -- 172.21.15.151:0/255532060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a4101680 msgr2=0x7f43a4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:45.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a4101680 0x7f43a4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a2ffd700 1 -- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4100cf0 msgr2=0x7f43a4072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:45.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4100cf0 0x7f43a4072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a2ffd700 1 -- 172.21.15.151:0/255532060 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43980095f0 con 0x7f43a40ffb00 2023-07-21T22:16:45.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a27fc700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4100cf0 0x7f43a4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:16:45.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb00 0x7f43a40742c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f439400e970 tx=0x7f439400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:45.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.074+0000 7f438bfff700 1 -- 172.21.15.151:0/255532060 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394009790 con 0x7f43a40ffb00 2023-07-21T22:16:45.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.075+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a419faa0 con 0x7f43a40ffb00 2023-07-21T22:16:45.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.075+0000 7f438bfff700 1 -- 172.21.15.151:0/255532060 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f439400eec0 con 0x7f43a40ffb00 2023-07-21T22:16:45.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.075+0000 7f438bfff700 1 -- 172.21.15.151:0/255532060 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394003bd0 con 0x7f43a40ffb00 2023-07-21T22:16:45.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.075+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a41a0000 con 0x7f43a40ffb00 2023-07-21T22:16:45.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.076+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43a4107090 con 0x7f43a40ffb00 2023-07-21T22:16:45.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.078+0000 7f438bfff700 1 -- 172.21.15.151:0/255532060 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f439400c950 con 0x7f43a40ffb00 2023-07-21T22:16:45.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.079+0000 7f438bfff700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f438c0a11a0 0x7f438c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:45.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.079+0000 7f438bfff700 1 -- 172.21.15.151:0/255532060 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f4394014070 con 0x7f43a40ffb00 2023-07-21T22:16:45.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.079+0000 7f43a27fc700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f438c0a11a0 0x7f438c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:45.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.080+0000 7f43a27fc700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f438c0a11a0 0x7f438c0a3650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4398006010 tx=0x7f439800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:45.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.081+0000 7f438bfff700 1 -- 172.21.15.151:0/255532060 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f4394096890 con 0x7f43a40ffb00 2023-07-21T22:16:45.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.325+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43a402c850 con 0x7f43a40ffb00 2023-07-21T22:16:45.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.326+0000 7f438bfff700 1 -- 172.21.15.151:0/255532060 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5060 (secure 0 0 0) 0x7f4394099eb0 con 0x7f43a40ffb00 2023-07-21T22:16:45.370 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:45.371 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-07-21T22:16:45.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f438c0a11a0 msgr2=0x7f438c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:45.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f438c0a11a0 0x7f438c0a3650 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f4398006010 tx=0x7f439800b260 comp rx=0 tx=0).stop 2023-07-21T22:16:45.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb00 msgr2=0x7f43a40742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:45.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb00 0x7f43a40742c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f439400e970 tx=0x7f439400ec80 comp rx=0 tx=0).stop 2023-07-21T22:16:45.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 shutdown_connections 2023-07-21T22:16:45.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f438c0a11a0 0x7f438c0a3650 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a4101680 0x7f43a4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb00 0x7f43a40742c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 --2- 172.21.15.151:0/255532060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4100cf0 0x7f43a4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:45.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 >> 172.21.15.151:0/255532060 conn(0x7f43a40fb0e0 msgr2=0x7f43a41041d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:45.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 shutdown_connections 2023-07-21T22:16:45.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:45.329+0000 7f43a95ff700 1 -- 172.21.15.151:0/255532060 wait complete. 2023-07-21T22:16:45.375 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 7 2023-07-21T22:16:46.045 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:46.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:46.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:46.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:46.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:46.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:46.046 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: Deploying daemon mds.c on smithi195 2023-07-21T22:16:46.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:46.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.195:6834/3818436709,v1:172.21.15.195:6835/3818436709] up:boot 2023-07-21T22:16:46.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: fsmap 6 up:standby 2023-07-21T22:16:46.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:16:46.047 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:45 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/255532060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:46.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:46.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:46.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:46.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:46.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:46.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:46.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: Deploying daemon mds.c on smithi195 2023-07-21T22:16:46.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:46.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.195:6834/3818436709,v1:172.21.15.195:6835/3818436709] up:boot 2023-07-21T22:16:46.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: fsmap 6 up:standby 2023-07-21T22:16:46.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:16:46.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:45 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/255532060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:46.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:46.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:46.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:46.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:46.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:46.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:46.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: Deploying daemon mds.c on smithi195 2023-07-21T22:16:46.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:46.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.195:6834/3818436709,v1:172.21.15.195:6835/3818436709] up:boot 2023-07-21T22:16:46.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: fsmap 6 up:standby 2023-07-21T22:16:46.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:16:46.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:45 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/255532060' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:47.393 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:47.406 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 22:16:46 smithi195 systemd[1]: Starting Ceph mds.c for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:47.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.558+0000 7f02295ff700 1 -- 172.21.15.151:0/263672539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224105790 msgr2=0x7f0224107bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.558+0000 7f02295ff700 1 --2- 172.21.15.151:0/263672539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224105790 0x7f0224107bf0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f021c00b0a0 tx=0x7f021c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.558+0000 7f02295ff700 1 -- 172.21.15.151:0/263672539 shutdown_connections 2023-07-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.558+0000 7f02295ff700 1 --2- 172.21.15.151:0/263672539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224105790 0x7f0224107bf0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.558+0000 7f02295ff700 1 --2- 172.21.15.151:0/263672539 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0224100550 0x7f0224102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.558+0000 7f02295ff700 1 --2- 172.21.15.151:0/263672539 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0224102e70 0x7f0224105250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.558+0000 7f02295ff700 1 -- 172.21.15.151:0/263672539 >> 172.21.15.151:0/263672539 conn(0x7f02240f9fd0 msgr2=0x7f02240fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.558+0000 7f02295ff700 1 -- 172.21.15.151:0/263672539 shutdown_connections 2023-07-21T22:16:47.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.558+0000 7f02295ff700 1 -- 172.21.15.151:0/263672539 wait complete. 2023-07-21T22:16:47.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.560+0000 7f02295ff700 1 Processor -- start 2023-07-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.560+0000 7f02295ff700 1 -- start start 2023-07-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.560+0000 7f02295ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224100550 0x7f02240ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.560+0000 7f02295ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0224102e70 0x7f02240fe500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.560+0000 7f02295ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0224105790 0x7f02240fea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.560+0000 7f02295ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02240ff1e0 con 0x7f0224100550 2023-07-21T22:16:47.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.560+0000 7f02295ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02240ff350 con 0x7f0224102e70 2023-07-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.560+0000 7f02295ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f022419f800 con 0x7f0224105790 2023-07-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0222ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224100550 0x7f02240ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0222ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224100550 0x7f02240ffec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53942/0 (socket says 172.21.15.151:53942) 2023-07-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0222ffd700 1 -- 172.21.15.151:0/588124531 learned_addr learned my addr 172.21.15.151:0/588124531 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f02237fe700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0224105790 0x7f02240fea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f021bfff700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0224102e70 0x7f02240fe500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:47.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0222ffd700 1 -- 172.21.15.151:0/588124531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0224105790 msgr2=0x7f02240fea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0222ffd700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0224105790 0x7f02240fea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0222ffd700 1 -- 172.21.15.151:0/588124531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0224102e70 msgr2=0x7f02240fe500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0222ffd700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0224102e70 0x7f02240fe500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0222ffd700 1 -- 172.21.15.151:0/588124531 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f021c009d00 con 0x7f0224100550 2023-07-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0222ffd700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224100550 0x7f02240ffec0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f021400e9a0 tx=0x7f021400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0220ff9700 1 -- 172.21.15.151:0/588124531 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0214009790 con 0x7f0224100550 2023-07-21T22:16:47.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f022419fae0 con 0x7f0224100550 2023-07-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0220ff9700 1 -- 172.21.15.151:0/588124531 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0214010430 con 0x7f0224100550 2023-07-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.561+0000 7f0220ff9700 1 -- 172.21.15.151:0/588124531 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f021400cea0 con 0x7f0224100550 2023-07-21T22:16:47.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.562+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f022419ffc0 con 0x7f0224100550 2023-07-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.563+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02240fbb40 con 0x7f0224100550 2023-07-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.564+0000 7f0220ff9700 1 -- 172.21.15.151:0/588124531 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f02140105a0 con 0x7f0224100550 2023-07-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.567+0000 7f0220ff9700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02100a11a0 0x7f02100a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:47.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.567+0000 7f0220ff9700 1 -- 172.21.15.151:0/588124531 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f0214014070 con 0x7f0224100550 2023-07-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.567+0000 7f021bfff700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02100a11a0 0x7f02100a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:47.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.567+0000 7f021bfff700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02100a11a0 0x7f02100a3650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f020c009c60 tx=0x7f020c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:47.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.571+0000 7f0220ff9700 1 -- 172.21.15.151:0/588124531 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f0214051770 con 0x7f0224100550 2023-07-21T22:16:47.771 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 22:16:47 smithi195 podman[123523]: 2023-07-21T22:16:47.771 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 22:16:47 smithi195 bash[123523]: 9da9c6447cdeb639e197ec8c1cfcbb12fcbf42f56f38956ccfdb0c67bcf603b1 2023-07-21T22:16:47.771 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 22:16:47 smithi195 ceph-mds[123563]: -- 172.21.15.195:0/117344118 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x559f45bdd1e0 con 0x559f45bb2c00 2023-07-21T22:16:47.771 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 22:16:47 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-c[123539]: starting mds.c at 2023-07-21T22:16:47.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.817+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f022402c850 con 0x7f0224100550 2023-07-21T22:16:47.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.818+0000 7f0220ff9700 1 -- 172.21.15.151:0/588124531 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+5060 (secure 0 0 0) 0x7f02140962b0 con 0x7f0224100550 2023-07-21T22:16:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:47.862 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-07-21T22:16:47.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02100a11a0 msgr2=0x7f02100a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:47.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02100a11a0 0x7f02100a3650 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f020c009c60 tx=0x7f020c009260 comp rx=0 tx=0).stop 2023-07-21T22:16:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224100550 msgr2=0x7f02240ffec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224100550 0x7f02240ffec0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f021400e9a0 tx=0x7f021400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 shutdown_connections 2023-07-21T22:16:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02100a11a0 0x7f02100a3650 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0224105790 0x7f02240fea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0224100550 0x7f02240ffec0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 --2- 172.21.15.151:0/588124531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0224102e70 0x7f02240fe500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:47.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.820+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 >> 172.21.15.151:0/588124531 conn(0x7f02240f9fd0 msgr2=0x7f02241011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.821+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 shutdown_connections 2023-07-21T22:16:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:47.821+0000 7f02295ff700 1 -- 172.21.15.151:0/588124531 wait complete. 2023-07-21T22:16:47.866 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 7 2023-07-21T22:16:48.157 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 22:16:47 smithi195 systemd[1]: Started Ceph mds.c for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:48.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:48 smithi187 ceph-mon[96918]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:48 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/588124531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:48.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:48.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:48 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:48.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:48 smithi195 ceph-mon[97365]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:48.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:48.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:48.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:48 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/588124531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:48.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:48.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:48.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:48.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:48 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:48.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:48 smithi151 ceph-mon[95510]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:48 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/588124531' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:48 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:49.455 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:49 smithi187 ceph-mon[96918]: Deploying daemon mds.h on smithi187 2023-07-21T22:16:49.455 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:49 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.195:6836/87317468,v1:172.21.15.195:6837/87317468] up:boot 2023-07-21T22:16:49.455 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:49 smithi187 ceph-mon[96918]: fsmap 7 up:standby 2023-07-21T22:16:49.456 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:49 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-21T22:16:49.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:49 smithi195 ceph-mon[97365]: Deploying daemon mds.h on smithi187 2023-07-21T22:16:49.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:49 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.195:6836/87317468,v1:172.21.15.195:6837/87317468] up:boot 2023-07-21T22:16:49.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:49 smithi195 ceph-mon[97365]: fsmap 7 up:standby 2023-07-21T22:16:49.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:49 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-21T22:16:49.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:49 smithi151 ceph-mon[95510]: Deploying daemon mds.h on smithi187 2023-07-21T22:16:49.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:49 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.195:6836/87317468,v1:172.21.15.195:6837/87317468] up:boot 2023-07-21T22:16:49.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:49 smithi151 ceph-mon[95510]: fsmap 7 up:standby 2023-07-21T22:16:49.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:49 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-21T22:16:49.884 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:50.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.050+0000 7f7eafdff700 1 -- 172.21.15.151:0/2972341211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea8074550 msgr2=0x7f7ea80729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:50.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.050+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2972341211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea8074550 0x7f7ea80729a0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4009990 tx=0x7f7ea4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.050+0000 7f7eafdff700 1 -- 172.21.15.151:0/2972341211 shutdown_connections 2023-07-21T22:16:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.050+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2972341211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ea81079c0 0x7f7ea8109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.050+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2972341211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea8074550 0x7f7ea80729a0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.050+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2972341211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ea8072f70 0x7f7ea80733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.050+0000 7f7eafdff700 1 -- 172.21.15.151:0/2972341211 >> 172.21.15.151:0/2972341211 conn(0x7f7ea80fb0e0 msgr2=0x7f7ea80fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:50.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.050+0000 7f7eafdff700 1 -- 172.21.15.151:0/2972341211 shutdown_connections 2023-07-21T22:16:50.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.050+0000 7f7eafdff700 1 -- 172.21.15.151:0/2972341211 wait complete. 2023-07-21T22:16:50.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.051+0000 7f7eafdff700 1 Processor -- start 2023-07-21T22:16:50.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.051+0000 7f7eafdff700 1 -- start start 2023-07-21T22:16:50.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eafdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ea8072f70 0x7f7ea81979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:50.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eafdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ea8074550 0x7f7ea8197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:50.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eafdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea81079c0 0x7f7ea819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:50.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eafdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea819f4e0 con 0x7f7ea81079c0 2023-07-21T22:16:50.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eafdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea819f620 con 0x7f7ea8074550 2023-07-21T22:16:50.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eafdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea819f7b0 con 0x7f7ea8072f70 2023-07-21T22:16:50.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eae39c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea81079c0 0x7f7ea819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:50.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eae39c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea81079c0 0x7f7ea819ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53960/0 (socket says 172.21.15.151:53960) 2023-07-21T22:16:50.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eae39c700 1 -- 172.21.15.151:0/2578448429 learned_addr learned my addr 172.21.15.151:0/2578448429 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:50.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7ead39a700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ea8074550 0x7f7ea8197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:50.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eadb9b700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ea8072f70 0x7f7ea81979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:50.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eae39c700 1 -- 172.21.15.151:0/2578448429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ea8072f70 msgr2=0x7f7ea81979b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:50.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eae39c700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ea8072f70 0x7f7ea81979b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eae39c700 1 -- 172.21.15.151:0/2578448429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ea8074550 msgr2=0x7f7ea8197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:50.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eae39c700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ea8074550 0x7f7ea8197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eae39c700 1 -- 172.21.15.151:0/2578448429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98009520 con 0x7f7ea81079c0 2023-07-21T22:16:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.052+0000 7f7eadb9b700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ea8072f70 0x7f7ea81979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:16:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.053+0000 7f7eae39c700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea81079c0 0x7f7ea819ef10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0007d70 tx=0x7f7ea000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.053+0000 7f7e9effd700 1 -- 172.21.15.151:0/2578448429 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea000ad40 con 0x7f7ea81079c0 2023-07-21T22:16:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.053+0000 7f7e9effd700 1 -- 172.21.15.151:0/2578448429 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ea00128b0 con 0x7f7ea81079c0 2023-07-21T22:16:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.053+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea40095f0 con 0x7f7ea81079c0 2023-07-21T22:16:50.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.053+0000 7f7e9effd700 1 -- 172.21.15.151:0/2578448429 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea00115c0 con 0x7f7ea81079c0 2023-07-21T22:16:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.053+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea819fe10 con 0x7f7ea81079c0 2023-07-21T22:16:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.054+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea8106070 con 0x7f7ea81079c0 2023-07-21T22:16:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.056+0000 7f7e9effd700 1 -- 172.21.15.151:0/2578448429 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7ea0012a20 con 0x7f7ea81079c0 2023-07-21T22:16:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.057+0000 7f7e9effd700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7e940a11a0 0x7f7e940a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.058+0000 7f7e9effd700 1 -- 172.21.15.151:0/2578448429 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f7ea00cc730 con 0x7f7ea81079c0 2023-07-21T22:16:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.058+0000 7f7eadb9b700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7e940a11a0 0x7f7e940a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:50.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.058+0000 7f7eadb9b700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7e940a11a0 0x7f7e940a3650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005910 tx=0x7f7ea400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:50.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.061+0000 7f7e9effd700 1 -- 172.21.15.151:0/2578448429 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f7ea0096280 con 0x7f7ea81079c0 2023-07-21T22:16:50.187 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 22:16:50 smithi187 systemd[1]: Starting Ceph mds.h for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:50.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.307+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ea802c850 con 0x7f7ea81079c0 2023-07-21T22:16:50.351 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.308+0000 7f7e9effd700 1 -- 172.21.15.151:0/2578448429 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+5814 (secure 0 0 0) 0x7f7ea00998a0 con 0x7f7ea81079c0 2023-07-21T22:16:50.352 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:50.352 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7}],"filesystems":[]} 2023-07-21T22:16:50.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7e940a11a0 msgr2=0x7f7e940a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:50.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7e940a11a0 0x7f7e940a3650 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4005910 tx=0x7f7ea400b260 comp rx=0 tx=0).stop 2023-07-21T22:16:50.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea81079c0 msgr2=0x7f7ea819ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:50.354 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea81079c0 0x7f7ea819ef10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0007d70 tx=0x7f7ea000a340 comp rx=0 tx=0).stop 2023-07-21T22:16:50.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 shutdown_connections 2023-07-21T22:16:50.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7e940a11a0 0x7f7e940a3650 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ea81079c0 0x7f7ea819ef10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ea8072f70 0x7f7ea81979b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 --2- 172.21.15.151:0/2578448429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ea8074550 0x7f7ea8197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:50.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 >> 172.21.15.151:0/2578448429 conn(0x7f7ea80fb0e0 msgr2=0x7f7ea80fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:50.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 shutdown_connections 2023-07-21T22:16:50.355 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:50.310+0000 7f7eafdff700 1 -- 172.21.15.151:0/2578448429 wait complete. 2023-07-21T22:16:50.356 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 8 2023-07-21T22:16:50.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:50 smithi187 ceph-mon[96918]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:50.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:50 smithi195 ceph-mon[97365]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:50.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:50 smithi151 ceph-mon[95510]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:50.937 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 22:16:50 smithi187 podman[122049]: 2023-07-21T22:16:51.222 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 22:16:50 smithi187 bash[122049]: 144911328ce9e27628b4cbd36890fd3be7ed5f457729c941fd2f8fb92279b471 2023-07-21T22:16:51.223 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 22:16:50 smithi187 ceph-mds[122089]: -- 172.21.15.187:0/1617135544 <== mon.2 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x555f61aad1e0 con 0x555f61a82800 2023-07-21T22:16:51.223 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 22:16:50 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-h[122065]: starting mds.h at 2023-07-21T22:16:51.223 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 22:16:50 smithi187 systemd[1]: Started Ceph mds.h for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:51.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:51 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2578448429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:51.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:51.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:51.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:51.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:51.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:51.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:51 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:51.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:51 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2578448429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:51.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:51.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:51.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:51.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:51.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:51.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:51 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:51.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:51 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2578448429' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:51.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:51.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:51.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:51.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:51.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:51.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:51 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:52.373 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:52.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:52 smithi195 ceph-mon[97365]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:52.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:52 smithi195 ceph-mon[97365]: Deploying daemon mds.i on smithi195 2023-07-21T22:16:52.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:52 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] up:boot 2023-07-21T22:16:52.390 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:52 smithi195 ceph-mon[97365]: fsmap 8 up:standby 2023-07-21T22:16:52.391 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:52 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.537+0000 7f58b79ff700 1 -- 172.21.15.151:0/232684886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0072f10 msgr2=0x7f58b0073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.537+0000 7f58b79ff700 1 --2- 172.21.15.151:0/232684886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0072f10 0x7f58b0073380 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009990 tx=0x7f58a0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.537+0000 7f58b79ff700 1 -- 172.21.15.151:0/232684886 shutdown_connections 2023-07-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.537+0000 7f58b79ff700 1 --2- 172.21.15.151:0/232684886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b00744f0 0x7f58b0072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.537+0000 7f58b79ff700 1 --2- 172.21.15.151:0/232684886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0107990 0x7f58b0109e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.537+0000 7f58b79ff700 1 --2- 172.21.15.151:0/232684886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0072f10 0x7f58b0073380 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.537+0000 7f58b79ff700 1 -- 172.21.15.151:0/232684886 >> 172.21.15.151:0/232684886 conn(0x7f58b00fb0e0 msgr2=0x7f58b00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.537+0000 7f58b79ff700 1 -- 172.21.15.151:0/232684886 shutdown_connections 2023-07-21T22:16:52.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.537+0000 7f58b79ff700 1 -- 172.21.15.151:0/232684886 wait complete. 2023-07-21T22:16:52.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.538+0000 7f58b79ff700 1 Processor -- start 2023-07-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.538+0000 7f58b79ff700 1 -- start start 2023-07-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.538+0000 7f58b79ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0072f10 0x7f58b0197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.538+0000 7f58b79ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00744f0 0x7f58b0197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.538+0000 7f58b79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b0107990 0x7f58b019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.538+0000 7f58b79ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b019f4d0 con 0x7f58b00744f0 2023-07-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.538+0000 7f58b79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b019f610 con 0x7f58b0107990 2023-07-21T22:16:52.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.538+0000 7f58b79ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b019f7a0 con 0x7f58b0072f10 2023-07-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b4f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00744f0 0x7f58b0197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b4f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00744f0 0x7f58b0197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53986/0 (socket says 172.21.15.151:53986) 2023-07-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b4f9a700 1 -- 172.21.15.151:0/1026321025 learned_addr learned my addr 172.21.15.151:0/1026321025 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b5f9c700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b0107990 0x7f58b019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b579b700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0072f10 0x7f58b0197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b4f9a700 1 -- 172.21.15.151:0/1026321025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0072f10 msgr2=0x7f58b0197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b4f9a700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0072f10 0x7f58b0197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b4f9a700 1 -- 172.21.15.151:0/1026321025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b0107990 msgr2=0x7f58b019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b4f9a700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b0107990 0x7f58b019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b4f9a700 1 -- 172.21.15.151:0/1026321025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00095f0 con 0x7f58b00744f0 2023-07-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.539+0000 7f58b4f9a700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00744f0 0x7f58b0197e90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f58a0005910 tx=0x7f58a0005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.540+0000 7f58a67fc700 1 -- 172.21.15.151:0/1026321025 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a001d070 con 0x7f58b00744f0 2023-07-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.540+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b019fa20 con 0x7f58b00744f0 2023-07-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.540+0000 7f58a67fc700 1 -- 172.21.15.151:0/1026321025 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a0022470 con 0x7f58b00744f0 2023-07-21T22:16:52.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.540+0000 7f58a67fc700 1 -- 172.21.15.151:0/1026321025 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0022ea0 con 0x7f58b00744f0 2023-07-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.540+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b019fec0 con 0x7f58b00744f0 2023-07-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.541+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b01060d0 con 0x7f58b00744f0 2023-07-21T22:16:52.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.543+0000 7f58a67fc700 1 -- 172.21.15.151:0/1026321025 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f58a000ba60 con 0x7f58b00744f0 2023-07-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.544+0000 7f58a67fc700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f589c0a11a0 0x7f589c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.544+0000 7f58a67fc700 1 -- 172.21.15.151:0/1026321025 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f58a00cd8f0 con 0x7f58b00744f0 2023-07-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.544+0000 7f58b579b700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f589c0a11a0 0x7f589c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:52.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.545+0000 7f58b579b700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f589c0a11a0 0x7f589c0a3650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009c60 tx=0x7f58ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:52.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.548+0000 7f58a67fc700 1 -- 172.21.15.151:0/1026321025 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f58a005c770 con 0x7f58b00744f0 2023-07-21T22:16:52.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:52 smithi187 ceph-mon[96918]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:52.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:52 smithi187 ceph-mon[96918]: Deploying daemon mds.i on smithi195 2023-07-21T22:16:52.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:52 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] up:boot 2023-07-21T22:16:52.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:52 smithi187 ceph-mon[96918]: fsmap 8 up:standby 2023-07-21T22:16:52.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:52 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-21T22:16:52.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:52 smithi151 ceph-mon[95510]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:52.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:52 smithi151 ceph-mon[95510]: Deploying daemon mds.i on smithi195 2023-07-21T22:16:52.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:52 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] up:boot 2023-07-21T22:16:52.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:52 smithi151 ceph-mon[95510]: fsmap 8 up:standby 2023-07-21T22:16:52.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:52 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-21T22:16:52.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.789+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58b002c850 con 0x7f58b00744f0 2023-07-21T22:16:52.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.790+0000 7f58a67fc700 1 -- 172.21.15.151:0/1026321025 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) v1 ==== 93+0+6574 (secure 0 0 0) 0x7f58a00974d0 con 0x7f58b00744f0 2023-07-21T22:16:52.834 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:52.834 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[]} 2023-07-21T22:16:52.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f589c0a11a0 msgr2=0x7f589c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:52.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f589c0a11a0 0x7f589c0a3650 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f58ac009c60 tx=0x7f58ac009260 comp rx=0 tx=0).stop 2023-07-21T22:16:52.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00744f0 msgr2=0x7f58b0197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:52.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00744f0 0x7f58b0197e90 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f58a0005910 tx=0x7f58a0005720 comp rx=0 tx=0).stop 2023-07-21T22:16:52.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 shutdown_connections 2023-07-21T22:16:52.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f589c0a11a0 0x7f589c0a3650 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b0107990 0x7f58b019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0072f10 0x7f58b0197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 --2- 172.21.15.151:0/1026321025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00744f0 0x7f58b0197e90 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:52.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 >> 172.21.15.151:0/1026321025 conn(0x7f58b00fb0e0 msgr2=0x7f58b00fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:52.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 shutdown_connections 2023-07-21T22:16:52.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:52.792+0000 7f58b79ff700 1 -- 172.21.15.151:0/1026321025 wait complete. 2023-07-21T22:16:52.838 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 9 2023-07-21T22:16:53.383 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:53 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1026321025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:53.384 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 22:16:53 smithi195 systemd[1]: Starting Ceph mds.i for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:53.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:53 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1026321025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:53.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:53 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1026321025' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:54.125 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 22:16:53 smithi195 podman[123873]: 2023-07-21T22:16:54.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:54 smithi195 ceph-mon[97365]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:54.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:54.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:54 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:54.407 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 22:16:54 smithi195 bash[123873]: e748a96d6a717c00350e379a670b3db2a440373e3c5e484c24af5f86a7fbdff9 2023-07-21T22:16:54.407 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 22:16:54 smithi195 ceph-mds[123913]: -- 172.21.15.195:0/1543474590 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564dec4051e0 con 0x564dec3db000 2023-07-21T22:16:54.407 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 22:16:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-i[123889]: starting mds.i at 2023-07-21T22:16:54.407 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 22:16:54 smithi195 systemd[1]: Started Ceph mds.i for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:54.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:54 smithi187 ceph-mon[96918]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:54 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:54.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:54 smithi151 ceph-mon[95510]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:54.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:54.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:54 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:54.857 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:55.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.028+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/720407868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18072f70 msgr2=0x7f2d180733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:55.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.028+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/720407868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18072f70 0x7f2d180733e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f2d00009990 tx=0x7f2d00009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.028+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/720407868 shutdown_connections 2023-07-21T22:16:55.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.028+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/720407868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d18074550 0x7f2d180729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.028+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/720407868 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d181079c0 0x7f2d18109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.028+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/720407868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18072f70 0x7f2d180733e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.028+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/720407868 >> 172.21.15.151:0/720407868 conn(0x7f2d180fb0e0 msgr2=0x7f2d180fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:55.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.028+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/720407868 shutdown_connections 2023-07-21T22:16:55.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.028+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/720407868 wait complete. 2023-07-21T22:16:55.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.029+0000 7f2d1d7ff700 1 Processor -- start 2023-07-21T22:16:55.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.029+0000 7f2d1d7ff700 1 -- start start 2023-07-21T22:16:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d1d7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d18072f70 0x7f2d18197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d1d7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18074550 0x7f2d18197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d1d7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d181079c0 0x7f2d1819ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d1d7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1819f500 con 0x7f2d18074550 2023-07-21T22:16:55.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d1d7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1819f640 con 0x7f2d18072f70 2023-07-21T22:16:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d1d7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d1819f7d0 con 0x7f2d181079c0 2023-07-21T22:16:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d0ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18074550 0x7f2d18197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d0ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18074550 0x7f2d18197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54004/0 (socket says 172.21.15.151:54004) 2023-07-21T22:16:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d0ffff700 1 -- 172.21.15.151:0/1408585519 learned_addr learned my addr 172.21.15.151:0/1408585519 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.030+0000 7f2d16ffd700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d18072f70 0x7f2d18197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d177fe700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d181079c0 0x7f2d1819ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:55.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d0ffff700 1 -- 172.21.15.151:0/1408585519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d181079c0 msgr2=0x7f2d1819ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:55.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d0ffff700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d181079c0 0x7f2d1819ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d0ffff700 1 -- 172.21.15.151:0/1408585519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d18072f70 msgr2=0x7f2d18197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:55.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d0ffff700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d18072f70 0x7f2d18197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d0ffff700 1 -- 172.21.15.151:0/1408585519 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d000095f0 con 0x7f2d18074550 2023-07-21T22:16:55.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d0ffff700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18074550 0x7f2d18197ec0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d00004730 tx=0x7f2d00004760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:55.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d14ff9700 1 -- 172.21.15.151:0/1408585519 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d0001d070 con 0x7f2d18074550 2023-07-21T22:16:55.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d14ff9700 1 -- 172.21.15.151:0/1408585519 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2d00004cc0 con 0x7f2d18074550 2023-07-21T22:16:55.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d14ff9700 1 -- 172.21.15.151:0/1408585519 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d00005280 con 0x7f2d18074550 2023-07-21T22:16:55.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d1819fa50 con 0x7f2d18074550 2023-07-21T22:16:55.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.031+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d1819fe10 con 0x7f2d18074550 2023-07-21T22:16:55.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.032+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d18106070 con 0x7f2d18074550 2023-07-21T22:16:55.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.034+0000 7f2d14ff9700 1 -- 172.21.15.151:0/1408585519 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2d00003b70 con 0x7f2d18074550 2023-07-21T22:16:55.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.036+0000 7f2d14ff9700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2d040a1220 0x7f2d040a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:55.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.036+0000 7f2d14ff9700 1 -- 172.21.15.151:0/1408585519 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f2d000cd610 con 0x7f2d18074550 2023-07-21T22:16:55.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.036+0000 7f2d16ffd700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2d040a1220 0x7f2d040a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:55.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.037+0000 7f2d16ffd700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2d040a1220 0x7f2d040a36d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d08005950 tx=0x7f2d0800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:55.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.040+0000 7f2d14ff9700 1 -- 172.21.15.151:0/1408585519 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2d00097230 con 0x7f2d18074550 2023-07-21T22:16:55.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.318+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2d1810d400 con 0x7f2d18074550 2023-07-21T22:16:55.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.318+0000 7f2d14ff9700 1 -- 172.21.15.151:0/1408585519 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) v1 ==== 94+0+7336 (secure 0 0 0) 0x7f2d0009a850 con 0x7f2d18074550 2023-07-21T22:16:55.362 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:55.363 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24574,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-07-21T22:16:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2d040a1220 msgr2=0x7f2d040a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2d040a1220 0x7f2d040a36d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2d08005950 tx=0x7f2d0800b410 comp rx=0 tx=0).stop 2023-07-21T22:16:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18074550 msgr2=0x7f2d18197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18074550 0x7f2d18197ec0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2d00004730 tx=0x7f2d00004760 comp rx=0 tx=0).stop 2023-07-21T22:16:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 shutdown_connections 2023-07-21T22:16:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2d040a1220 0x7f2d040a36d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d18072f70 0x7f2d18197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2d181079c0 0x7f2d1819ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 --2- 172.21.15.151:0/1408585519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d18074550 0x7f2d18197ec0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:55.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 >> 172.21.15.151:0/1408585519 conn(0x7f2d180fb0e0 msgr2=0x7f2d180fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:55.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 shutdown_connections 2023-07-21T22:16:55.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:55.321+0000 7f2d1d7ff700 1 -- 172.21.15.151:0/1408585519 wait complete. 2023-07-21T22:16:55.366 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 10 2023-07-21T22:16:55.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:55 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] up:boot 2023-07-21T22:16:55.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:55 smithi151 ceph-mon[95510]: fsmap 9 up:standby 2023-07-21T22:16:55.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-21T22:16:55.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:55.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:55.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:55.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:55 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:55.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:55 smithi151 ceph-mon[95510]: Deploying daemon mds.g on smithi151 2023-07-21T22:16:55.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:55 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] up:boot 2023-07-21T22:16:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:55 smithi187 ceph-mon[96918]: fsmap 9 up:standby 2023-07-21T22:16:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-21T22:16:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:55.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:55 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:55.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:55 smithi187 ceph-mon[96918]: Deploying daemon mds.g on smithi151 2023-07-21T22:16:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:55 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] up:boot 2023-07-21T22:16:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:55 smithi195 ceph-mon[97365]: fsmap 9 up:standby 2023-07-21T22:16:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-21T22:16:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:55.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:55.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:55.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:55 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:55.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:55 smithi195 ceph-mon[97365]: Deploying daemon mds.g on smithi151 2023-07-21T22:16:56.462 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:56 smithi151 ceph-mon[95510]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:56.463 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:56 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1408585519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:56.463 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 22:16:56 smithi151 systemd[1]: Starting Ceph mds.g for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:56.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:56 smithi187 ceph-mon[96918]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:56.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:56 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1408585519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:56.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:56 smithi195 ceph-mon[97365]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:56.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:56 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1408585519' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:57.199 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 22:16:56 smithi151 podman[130230]: 2023-07-21T22:16:57.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:16:57.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.555+0000 7f5ed4dff700 1 -- 172.21.15.151:0/3223044437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0100cf0 msgr2=0x7f5ed0101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:57.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.555+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/3223044437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0100cf0 0x7f5ed0101140 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5eb8009990 tx=0x7f5eb8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.555+0000 7f5ed4dff700 1 -- 172.21.15.151:0/3223044437 shutdown_connections 2023-07-21T22:16:57.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.555+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/3223044437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed0101680 0x7f5ed0107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.555+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/3223044437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed00ffb00 0x7f5ed00fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.555+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/3223044437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0100cf0 0x7f5ed0101140 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.555+0000 7f5ed4dff700 1 -- 172.21.15.151:0/3223044437 >> 172.21.15.151:0/3223044437 conn(0x7f5ed00fb0e0 msgr2=0x7f5ed00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:57.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.555+0000 7f5ed4dff700 1 -- 172.21.15.151:0/3223044437 shutdown_connections 2023-07-21T22:16:57.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.556+0000 7f5ed4dff700 1 -- 172.21.15.151:0/3223044437 wait complete. 2023-07-21T22:16:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.556+0000 7f5ed4dff700 1 Processor -- start 2023-07-21T22:16:57.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5ed4dff700 1 -- start start 2023-07-21T22:16:57.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5ed4dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed00ffb00 0x7f5ed00742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:57.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5ed4dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed0100cf0 0x7f5ed0072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:57.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5ed4dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0101680 0x7f5ed0072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:57.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5ed4dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed01995e0 con 0x7f5ed0101680 2023-07-21T22:16:57.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5ed4dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0073380 con 0x7f5ed00ffb00 2023-07-21T22:16:57.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5ed4dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed0073540 con 0x7f5ed0100cf0 2023-07-21T22:16:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5eced9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0101680 0x7f5ed0072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5eced9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0101680 0x7f5ed0072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42538/0 (socket says 172.21.15.151:42538) 2023-07-21T22:16:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5eced9d700 1 -- 172.21.15.151:0/1644203086 learned_addr learned my addr 172.21.15.151:0/1644203086 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:16:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5ec7fff700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed0100cf0 0x7f5ed0072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.557+0000 7f5ece59c700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed00ffb00 0x7f5ed00742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5eced9d700 1 -- 172.21.15.151:0/1644203086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed0100cf0 msgr2=0x7f5ed0072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5eced9d700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed0100cf0 0x7f5ed0072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5eced9d700 1 -- 172.21.15.151:0/1644203086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed00ffb00 msgr2=0x7f5ed00742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:57.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5eced9d700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed00ffb00 0x7f5ed00742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5eced9d700 1 -- 172.21.15.151:0/1644203086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb80095f0 con 0x7f5ed0101680 2023-07-21T22:16:57.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5ece59c700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed00ffb00 0x7f5ed00742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:16:57.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5eced9d700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0101680 0x7f5ed0072e40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800ef30 tx=0x7f5ec800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:57.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5ec77fe700 1 -- 172.21.15.151:0/1644203086 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec8018070 con 0x7f5ed0101680 2023-07-21T22:16:57.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5ec77fe700 1 -- 172.21.15.151:0/1644203086 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ec800f040 con 0x7f5ed0101680 2023-07-21T22:16:57.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ed01a3f90 con 0x7f5ed0101680 2023-07-21T22:16:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5ec77fe700 1 -- 172.21.15.151:0/1644203086 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ec800cc70 con 0x7f5ed0101680 2023-07-21T22:16:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.558+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ed01a4350 con 0x7f5ed0101680 2023-07-21T22:16:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.559+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ed010b1d0 con 0x7f5ed0101680 2023-07-21T22:16:57.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.561+0000 7f5ec77fe700 1 -- 172.21.15.151:0/1644203086 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5ec8007500 con 0x7f5ed0101680 2023-07-21T22:16:57.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.563+0000 7f5ec77fe700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ebc0a1220 0x7f5ebc0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:16:57.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.563+0000 7f5ec77fe700 1 -- 172.21.15.151:0/1644203086 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5ec80cbfb0 con 0x7f5ed0101680 2023-07-21T22:16:57.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.563+0000 7f5ece59c700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ebc0a1220 0x7f5ebc0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:16:57.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.564+0000 7f5ece59c700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ebc0a1220 0x7f5ebc0a36d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0005950 tx=0x7f5ec00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:16:57.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.567+0000 7f5ec77fe700 1 -- 172.21.15.151:0/1644203086 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f5ec8095b90 con 0x7f5ed0101680 2023-07-21T22:16:57.698 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 22:16:57 smithi151 bash[130230]: 3aedef302e0fc0bd1f2947baabbedcc8c1acbfd2b65af00096a5fb31b06ce6c4 2023-07-21T22:16:57.699 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 22:16:57 smithi151 ceph-mds[130270]: -- 172.21.15.151:0/2402722975 <== mon.0 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55cdf04cf1e0 con 0x55cdf04a5000 2023-07-21T22:16:57.699 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 22:16:57 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-g[130246]: starting mds.g at 2023-07-21T22:16:57.699 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 22:16:57 smithi151 systemd[1]: Started Ceph mds.g for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:16:57.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.821+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5ed010b390 con 0x7f5ed0101680 2023-07-21T22:16:57.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.822+0000 7f5ec77fe700 1 -- 172.21.15.151:0/1644203086 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8094 (secure 0 0 0) 0x7f5ec80991b0 con 0x7f5ed0101680 2023-07-21T22:16:57.866 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:16:57.866 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24574,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-07-21T22:16:57.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.824+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ebc0a1220 msgr2=0x7f5ebc0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:57.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.824+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ebc0a1220 0x7f5ebc0a36d0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5ec0005950 tx=0x7f5ec00058e0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.824+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0101680 msgr2=0x7f5ed0072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:16:57.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.824+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0101680 0x7f5ed0072e40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5ec800ef30 tx=0x7f5ec800c3a0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.824+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 shutdown_connections 2023-07-21T22:16:57.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.824+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ebc0a1220 0x7f5ebc0a36d0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.825+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed00ffb00 0x7f5ed00742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.825+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ed0101680 0x7f5ed0072e40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.825+0000 7f5ed4dff700 1 --2- 172.21.15.151:0/1644203086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5ed0100cf0 0x7f5ed0072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:16:57.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.825+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 >> 172.21.15.151:0/1644203086 conn(0x7f5ed00fb0e0 msgr2=0x7f5ed00fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:16:57.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.825+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 shutdown_connections 2023-07-21T22:16:57.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:16:57.825+0000 7f5ed4dff700 1 -- 172.21.15.151:0/1644203086 wait complete. 2023-07-21T22:16:57.870 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 11 2023-07-21T22:16:58.536 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:58.537 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.151:6838/721992458,v1:172.21.15.151:6839/721992458] up:boot 2023-07-21T22:16:58.537 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: fsmap 10 up:standby 2023-07-21T22:16:58.537 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-21T22:16:58.537 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:58.537 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:58.537 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:58.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:58.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:58.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:58.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: Deploying daemon mds.a on smithi151 2023-07-21T22:16:58.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:16:58 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1644203086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:58.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:58.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.151:6838/721992458,v1:172.21.15.151:6839/721992458] up:boot 2023-07-21T22:16:58.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: fsmap 10 up:standby 2023-07-21T22:16:58.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-21T22:16:58.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:58.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:58.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:58.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:58.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:58.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:58.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: Deploying daemon mds.a on smithi151 2023-07-21T22:16:58.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:16:58 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1644203086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:16:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.151:6838/721992458,v1:172.21.15.151:6839/721992458] up:boot 2023-07-21T22:16:58.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: fsmap 10 up:standby 2023-07-21T22:16:58.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-21T22:16:58.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:58.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:58.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:16:58.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:16:58.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:16:58.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:16:58.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: Deploying daemon mds.a on smithi151 2023-07-21T22:16:58.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:16:58 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1644203086' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:16:59.745 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 22:16:59 smithi151 systemd[1]: Starting Ceph mds.a for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:16:59.889 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:17:00.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.072+0000 7f900e1ff700 1 -- 172.21.15.151:0/1344337187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9008100cb0 msgr2=0x7f9008103130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:00.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.072+0000 7f900e1ff700 1 --2- 172.21.15.151:0/1344337187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9008100cb0 0x7f9008103130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc009990 tx=0x7f8ffc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.072+0000 7f900e1ff700 1 -- 172.21.15.151:0/1344337187 shutdown_connections 2023-07-21T22:17:00.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.072+0000 7f900e1ff700 1 --2- 172.21.15.151:0/1344337187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9008103670 0x7f9008103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.072+0000 7f900e1ff700 1 --2- 172.21.15.151:0/1344337187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90080fe350 0x7f9008100770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.072+0000 7f900e1ff700 1 --2- 172.21.15.151:0/1344337187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9008100cb0 0x7f9008103130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.072+0000 7f900e1ff700 1 -- 172.21.15.151:0/1344337187 >> 172.21.15.151:0/1344337187 conn(0x7f90080fa000 msgr2=0x7f90080fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:00.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.072+0000 7f900e1ff700 1 -- 172.21.15.151:0/1344337187 shutdown_connections 2023-07-21T22:17:00.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.072+0000 7f900e1ff700 1 -- 172.21.15.151:0/1344337187 wait complete. 2023-07-21T22:17:00.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.074+0000 7f900e1ff700 1 Processor -- start 2023-07-21T22:17:00.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.074+0000 7f900e1ff700 1 -- start start 2023-07-21T22:17:00.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f900e1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90080fe350 0x7f900819bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:00.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f900e1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9008100cb0 0x7f900819c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:00.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f9006ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9008100cb0 0x7f900819c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:00.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f9006ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9008100cb0 0x7f900819c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60176/0 (socket says 172.21.15.151:60176) 2023-07-21T22:17:00.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f90077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90080fe350 0x7f900819bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:00.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f900e1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9008103670 0x7f90081a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:00.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f900e1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90081a3870 con 0x7f90080fe350 2023-07-21T22:17:00.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f900e1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90081a39e0 con 0x7f9008103670 2023-07-21T22:17:00.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f900e1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90081a3ba0 con 0x7f9008100cb0 2023-07-21T22:17:00.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f90077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90080fe350 0x7f900819bd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42562/0 (socket says 172.21.15.151:42562) 2023-07-21T22:17:00.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.075+0000 7f90077fe700 1 -- 172.21.15.151:0/3743976958 learned_addr learned my addr 172.21.15.151:0/3743976958 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:00.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f9007fff700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9008103670 0x7f90081a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:00.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f90077fe700 1 -- 172.21.15.151:0/3743976958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9008100cb0 msgr2=0x7f900819c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:00.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f90077fe700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9008100cb0 0x7f900819c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f90077fe700 1 -- 172.21.15.151:0/3743976958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9008103670 msgr2=0x7f90081a32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:00.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f90077fe700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9008103670 0x7f90081a32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f90077fe700 1 -- 172.21.15.151:0/3743976958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc0095f0 con 0x7f90080fe350 2023-07-21T22:17:00.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f9006ffd700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9008100cb0 0x7f900819c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:00.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f9007fff700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9008103670 0x7f90081a32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:00.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f90077fe700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90080fe350 0x7f900819bd30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800e9a0 tx=0x7f8ff800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:00.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f9004ff9700 1 -- 172.21.15.151:0/3743976958 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8009790 con 0x7f90080fe350 2023-07-21T22:17:00.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f9004ff9700 1 -- 172.21.15.151:0/3743976958 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ff800cbd0 con 0x7f90080fe350 2023-07-21T22:17:00.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90081a3e80 con 0x7f90080fe350 2023-07-21T22:17:00.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f9004ff9700 1 -- 172.21.15.151:0/3743976958 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff8018680 con 0x7f90080fe350 2023-07-21T22:17:00.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.076+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90081a42b0 con 0x7f90080fe350 2023-07-21T22:17:00.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.077+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90080fbb70 con 0x7f90080fe350 2023-07-21T22:17:00.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.079+0000 7f9004ff9700 1 -- 172.21.15.151:0/3743976958 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f8ff800cd40 con 0x7f90080fe350 2023-07-21T22:17:00.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.081+0000 7f9004ff9700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ff00a1220 0x7f8ff00a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:00.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.081+0000 7f9004ff9700 1 -- 172.21.15.151:0/3743976958 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f8ff8014070 con 0x7f90080fe350 2023-07-21T22:17:00.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.081+0000 7f9006ffd700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ff00a1220 0x7f8ff00a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:00.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.082+0000 7f9006ffd700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ff00a1220 0x7f8ff00a36d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc006010 tx=0x7f8ffc00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:00.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.083+0000 7f9004ff9700 1 -- 172.21.15.151:0/3743976958 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8ff80965b0 con 0x7f90080fe350 2023-07-21T22:17:00.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.341+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f900802c850 con 0x7f90080fe350 2023-07-21T22:17:00.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.342+0000 7f9004ff9700 1 -- 172.21.15.151:0/3743976958 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+8094 (secure 0 0 0) 0x7f8ff8026090 con 0x7f90080fe350 2023-07-21T22:17:00.387 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:00.387 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24574,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-07-21T22:17:00.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ff00a1220 msgr2=0x7f8ff00a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:00.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ff00a1220 0x7f8ff00a36d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc006010 tx=0x7f8ffc00b260 comp rx=0 tx=0).stop 2023-07-21T22:17:00.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90080fe350 msgr2=0x7f900819bd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:00.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90080fe350 0x7f900819bd30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8ff800e9a0 tx=0x7f8ff800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 shutdown_connections 2023-07-21T22:17:00.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ff00a1220 0x7f8ff00a36d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9008103670 0x7f90081a32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90080fe350 0x7f900819bd30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 --2- 172.21.15.151:0/3743976958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9008100cb0 0x7f900819c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:00.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 >> 172.21.15.151:0/3743976958 conn(0x7f90080fa000 msgr2=0x7f90080ff050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:00.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 shutdown_connections 2023-07-21T22:17:00.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:00.345+0000 7f900e1ff700 1 -- 172.21.15.151:0/3743976958 wait complete. 2023-07-21T22:17:00.391 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 11 2023-07-21T22:17:00.518 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:00 smithi151 ceph-mon[95510]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:00.519 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 22:17:00 smithi151 podman[130641]: 2023-07-21T22:17:00.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:00 smithi187 ceph-mon[96918]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:00 smithi195 ceph-mon[97365]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:00.949 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 22:17:00 smithi151 ceph-mds[130704]: -- 172.21.15.151:0/897376732 <== mon.0 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x558610a871e0 con 0x558610a5d000 2023-07-21T22:17:00.949 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 22:17:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-a[130677]: starting mds.a at 2023-07-21T22:17:00.949 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 22:17:00 smithi151 bash[130641]: 35fe9da3a7e97f09efb683be3ee949fedad8ec60cd2f99e93368010e437ef656 2023-07-21T22:17:00.949 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 22:17:00 smithi151 systemd[1]: Started Ceph mds.a for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:17:01.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:01 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3743976958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:01.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:01.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:01.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:01.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:17:01.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:17:01.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:01 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:17:01.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:01 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3743976958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:01.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:01.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:01.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:01.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:17:01.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:17:01.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:01 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:17:01.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:01 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3743976958' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2023-07-21T22:17:01.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2023-07-21T22:17:01.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:01 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:17:02.410 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.579+0000 7ff872bff700 1 -- 172.21.15.151:0/1789446852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c102e80 msgr2=0x7ff86c105260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.579+0000 7ff872bff700 1 --2- 172.21.15.151:0/1789446852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c102e80 0x7ff86c105260 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ff858009990 tx=0x7ff858009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.579+0000 7ff872bff700 1 -- 172.21.15.151:0/1789446852 shutdown_connections 2023-07-21T22:17:02.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.579+0000 7ff872bff700 1 --2- 172.21.15.151:0/1789446852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c100560 0x7ff86c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.579+0000 7ff872bff700 1 --2- 172.21.15.151:0/1789446852 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c1057a0 0x7ff86c107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.579+0000 7ff872bff700 1 --2- 172.21.15.151:0/1789446852 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c102e80 0x7ff86c105260 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.579+0000 7ff872bff700 1 -- 172.21.15.151:0/1789446852 >> 172.21.15.151:0/1789446852 conn(0x7ff86c0fa000 msgr2=0x7ff86c0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.579+0000 7ff872bff700 1 -- 172.21.15.151:0/1789446852 shutdown_connections 2023-07-21T22:17:02.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.579+0000 7ff872bff700 1 -- 172.21.15.151:0/1789446852 wait complete. 2023-07-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.580+0000 7ff872bff700 1 Processor -- start 2023-07-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.580+0000 7ff872bff700 1 -- start start 2023-07-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.580+0000 7ff872bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c100560 0x7ff86c0ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:02.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.580+0000 7ff872bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c102e80 0x7ff86c0fe510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.580+0000 7ff872bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c1057a0 0x7ff86c0fea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.580+0000 7ff872bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0ff1f0 con 0x7ff86c1057a0 2023-07-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.580+0000 7ff872bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c0ff360 con 0x7ff86c100560 2023-07-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.580+0000 7ff872bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c19f770 con 0x7ff86c102e80 2023-07-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.580+0000 7ff87099b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c100560 0x7ff86c0ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:02.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff87099b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c100560 0x7ff86c0ffed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41220/0 (socket says 172.21.15.151:41220) 2023-07-21T22:17:02.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff87099b700 1 -- 172.21.15.151:0/1289123090 learned_addr learned my addr 172.21.15.151:0/1289123090 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:02.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff87119c700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c1057a0 0x7ff86c0fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:02.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff86bfff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c102e80 0x7ff86c0fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:02.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff87099b700 1 -- 172.21.15.151:0/1289123090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c102e80 msgr2=0x7ff86c0fe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:02.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff87099b700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c102e80 0x7ff86c0fe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff87099b700 1 -- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c1057a0 msgr2=0x7ff86c0fea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:02.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff87099b700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c1057a0 0x7ff86c0fea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff87099b700 1 -- 172.21.15.151:0/1289123090 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8580095f0 con 0x7ff86c100560 2023-07-21T22:17:02.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff86bfff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c102e80 0x7ff86c0fe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:17:02.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff87099b700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c100560 0x7ff86c0ffed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff86000e9a0 tx=0x7ff86000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:02.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff869ffb700 1 -- 172.21.15.151:0/1289123090 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860009790 con 0x7ff86c100560 2023-07-21T22:17:02.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c19fa50 con 0x7ff86c100560 2023-07-21T22:17:02.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff869ffb700 1 -- 172.21.15.151:0/1289123090 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff86000cbd0 con 0x7ff86c100560 2023-07-21T22:17:02.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.581+0000 7ff869ffb700 1 -- 172.21.15.151:0/1289123090 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff860018680 con 0x7ff86c100560 2023-07-21T22:17:02.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.582+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c19ff60 con 0x7ff86c100560 2023-07-21T22:17:02.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.582+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c0fbb70 con 0x7ff86c100560 2023-07-21T22:17:02.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:02 smithi187 ceph-mon[96918]: Deploying daemon mds.b on smithi187 2023-07-21T22:17:02.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:02 smithi187 ceph-mon[96918]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:02.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:02 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.151:6840/337440051,v1:172.21.15.151:6841/337440051] up:boot 2023-07-21T22:17:02.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:02 smithi187 ceph-mon[96918]: fsmap 11 up:standby 2023-07-21T22:17:02.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:02 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-21T22:17:02.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.584+0000 7ff869ffb700 1 -- 172.21.15.151:0/1289123090 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff86000cd40 con 0x7ff86c100560 2023-07-21T22:17:02.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.586+0000 7ff869ffb700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff85c0a1220 0x7ff85c0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:02.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.586+0000 7ff869ffb700 1 -- 172.21.15.151:0/1289123090 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7ff860014070 con 0x7ff86c100560 2023-07-21T22:17:02.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.586+0000 7ff86bfff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff85c0a1220 0x7ff85c0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:02.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.586+0000 7ff86bfff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff85c0a1220 0x7ff85c0a36d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff8580098e0 tx=0x7ff858005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:02.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.588+0000 7ff869ffb700 1 -- 172.21.15.151:0/1289123090 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ff860096500 con 0x7ff86c100560 2023-07-21T22:17:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:02 smithi195 ceph-mon[97365]: Deploying daemon mds.b on smithi187 2023-07-21T22:17:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:02 smithi195 ceph-mon[97365]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:02 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.151:6840/337440051,v1:172.21.15.151:6841/337440051] up:boot 2023-07-21T22:17:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:02 smithi195 ceph-mon[97365]: fsmap 11 up:standby 2023-07-21T22:17:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:02 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-21T22:17:02.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:02 smithi151 ceph-mon[95510]: Deploying daemon mds.b on smithi187 2023-07-21T22:17:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:02 smithi151 ceph-mon[95510]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:02 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.151:6840/337440051,v1:172.21.15.151:6841/337440051] up:boot 2023-07-21T22:17:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:02 smithi151 ceph-mon[95510]: fsmap 11 up:standby 2023-07-21T22:17:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:02 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-21T22:17:02.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.831+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff86c02c850 con 0x7ff86c100560 2023-07-21T22:17:02.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.832+0000 7ff869ffb700 1 -- 172.21.15.151:0/1289123090 <== mon.2 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+8852 (secure 0 0 0) 0x7ff860099b20 con 0x7ff86c100560 2023-07-21T22:17:02.876 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:02.876 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24574,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[]} 2023-07-21T22:17:02.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff85c0a1220 msgr2=0x7ff85c0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:02.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff85c0a1220 0x7ff85c0a36d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff8580098e0 tx=0x7ff858005fb0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c100560 msgr2=0x7ff86c0ffed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:02.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c100560 0x7ff86c0ffed0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff86000e9a0 tx=0x7ff86000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 shutdown_connections 2023-07-21T22:17:02.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff85c0a1220 0x7ff85c0a36d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c100560 0x7ff86c0ffed0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c1057a0 0x7ff86c0fea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 --2- 172.21.15.151:0/1289123090 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c102e80 0x7ff86c0fe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:02.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 >> 172.21.15.151:0/1289123090 conn(0x7ff86c0fa000 msgr2=0x7ff86c101280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:02.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 shutdown_connections 2023-07-21T22:17:02.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:02.834+0000 7ff872bff700 1 -- 172.21.15.151:0/1289123090 wait complete. 2023-07-21T22:17:02.880 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 12 2023-07-21T22:17:02.945 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 22:17:02 smithi187 systemd[1]: Starting Ceph mds.b for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:17:03.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:03 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1289123090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:03.628 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 22:17:03 smithi187 podman[122396]: 2023-07-21T22:17:03.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:03 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1289123090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:03.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:03 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1289123090' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:04.128 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 22:17:03 smithi187 ceph-mds[122436]: -- 172.21.15.187:0/4150914944 <== mon.2 v2:172.21.15.187:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f0b0adf1e0 con 0x55f0b0ab4800 2023-07-21T22:17:04.128 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 22:17:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-b[122412]: starting mds.b at 2023-07-21T22:17:04.128 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 22:17:03 smithi187 bash[122396]: 407110a6c4767d740435426b80412781cb480e4a68cbe41360cd4f566fa69b4c 2023-07-21T22:17:04.128 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 22:17:03 smithi187 systemd[1]: Started Ceph mds.b for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:17:04.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:04 smithi187 ceph-mon[96918]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:04.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:04 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:17:04.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:04 smithi195 ceph-mon[97365]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:04.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:04 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:17:04.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:04 smithi151 ceph-mon[95510]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:04.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:04.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:04 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:17:04.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:17:05.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.064+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/1594865371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8101680 msgr2=0x7fa3e8107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.064+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/1594865371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8101680 0x7fa3e8107f40 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000b0a0 tx=0x7fa3e000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.064+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/1594865371 shutdown_connections 2023-07-21T22:17:05.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.064+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/1594865371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e80ffb00 0x7fa3e80fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.064+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/1594865371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8101680 0x7fa3e8107f40 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.064+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/1594865371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e8100cf0 0x7fa3e8101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.065+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/1594865371 >> 172.21.15.151:0/1594865371 conn(0x7fa3e80fb0e0 msgr2=0x7fa3e80fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:05.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.065+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/1594865371 shutdown_connections 2023-07-21T22:17:05.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.065+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/1594865371 wait complete. 2023-07-21T22:17:05.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3ee9ff700 1 Processor -- start 2023-07-21T22:17:05.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3ee9ff700 1 -- start start 2023-07-21T22:17:05.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3ee9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e80ffb00 0x7fa3e80742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:05.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3ee9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8100cf0 0x7fa3e8072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:05.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3ee9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e8101680 0x7fa3e8072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:05.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3ee9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e80735e0 con 0x7fa3e8100cf0 2023-07-21T22:17:05.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3ee9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e8073750 con 0x7fa3e80ffb00 2023-07-21T22:17:05.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3ee9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e819f890 con 0x7fa3e8101680 2023-07-21T22:17:05.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3e77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8100cf0 0x7fa3e8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:05.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3e77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8100cf0 0x7fa3e8072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42608/0 (socket says 172.21.15.151:42608) 2023-07-21T22:17:05.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3e77fe700 1 -- 172.21.15.151:0/2578049091 learned_addr learned my addr 172.21.15.151:0/2578049091 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:05.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.066+0000 7fa3e7fff700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e80ffb00 0x7fa3e80742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:05.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3ecf9c700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e8101680 0x7fa3e8072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:05.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3e77fe700 1 -- 172.21.15.151:0/2578049091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e8101680 msgr2=0x7fa3e8072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3e77fe700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e8101680 0x7fa3e8072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3e77fe700 1 -- 172.21.15.151:0/2578049091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e80ffb00 msgr2=0x7fa3e80742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3e77fe700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e80ffb00 0x7fa3e80742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3e77fe700 1 -- 172.21.15.151:0/2578049091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3e0009d00 con 0x7fa3e8100cf0 2023-07-21T22:17:05.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3e77fe700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8100cf0 0x7fa3e8072900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00d950 tx=0x7fa3dc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:05.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3e57fa700 1 -- 172.21.15.151:0/2578049091 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00f890 con 0x7fa3e8100cf0 2023-07-21T22:17:05.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e819fb70 con 0x7fa3e8100cf0 2023-07-21T22:17:05.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3e57fa700 1 -- 172.21.15.151:0/2578049091 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3dc00fe80 con 0x7fa3e8100cf0 2023-07-21T22:17:05.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3e57fa700 1 -- 172.21.15.151:0/2578049091 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc00e3b0 con 0x7fa3e8100cf0 2023-07-21T22:17:05.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.067+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e81a0050 con 0x7fa3e8100cf0 2023-07-21T22:17:05.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.068+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3e8106960 con 0x7fa3e8100cf0 2023-07-21T22:17:05.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.070+0000 7fa3e57fa700 1 -- 172.21.15.151:0/2578049091 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fa3dc010460 con 0x7fa3e8100cf0 2023-07-21T22:17:05.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.072+0000 7fa3e57fa700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a11a0 0x7fa3d00a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:05.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.072+0000 7fa3e57fa700 1 -- 172.21.15.151:0/2578049091 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fa3dc0cc2b0 con 0x7fa3e8100cf0 2023-07-21T22:17:05.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.072+0000 7fa3e7fff700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a11a0 0x7fa3d00a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:05.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.072+0000 7fa3e7fff700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a11a0 0x7fa3d00a3650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8100b50 tx=0x7fa3d8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:05.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.076+0000 7fa3e57fa700 1 -- 172.21.15.151:0/2578049091 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fa3dc095e00 con 0x7fa3e8100cf0 2023-07-21T22:17:05.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.340+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3e802c850 con 0x7fa3e8100cf0 2023-07-21T22:17:05.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.340+0000 7fa3e57fa700 1 -- 172.21.15.151:0/2578049091 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+9613 (secure 0 0 0) 0x7fa3dc099420 con 0x7fa3e8100cf0 2023-07-21T22:17:05.385 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:05.385 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":24475,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":24512,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":6},{"gid":24538,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":7},{"gid":24548,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24574,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":24599,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[]} 2023-07-21T22:17:05.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a11a0 msgr2=0x7fa3d00a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a11a0 0x7fa3d00a3650 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa3e8100b50 tx=0x7fa3d8009260 comp rx=0 tx=0).stop 2023-07-21T22:17:05.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8100cf0 msgr2=0x7fa3e8072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8100cf0 0x7fa3e8072900 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc00d950 tx=0x7fa3dc00dc60 comp rx=0 tx=0).stop 2023-07-21T22:17:05.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 shutdown_connections 2023-07-21T22:17:05.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a11a0 0x7fa3d00a3650 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e80ffb00 0x7fa3e80742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e8101680 0x7fa3e8072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 --2- 172.21.15.151:0/2578049091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e8100cf0 0x7fa3e8072900 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 >> 172.21.15.151:0/2578049091 conn(0x7fa3e80fb0e0 msgr2=0x7fa3e80fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:05.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 shutdown_connections 2023-07-21T22:17:05.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.343+0000 7fa3ee9ff700 1 -- 172.21.15.151:0/2578049091 wait complete. 2023-07-21T22:17:05.389 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 13 2023-07-21T22:17:05.407 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:17:05.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:05 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] up:boot 2023-07-21T22:17:05.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:05 smithi187 ceph-mon[96918]: fsmap 12 up:standby 2023-07-21T22:17:05.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:05 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-21T22:17:05.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:05 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] up:boot 2023-07-21T22:17:05.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:05 smithi195 ceph-mon[97365]: fsmap 12 up:standby 2023-07-21T22:17:05.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:05 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.621+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/4134224318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8100cf0 msgr2=0x7fd8a8101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.621+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/4134224318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8100cf0 0x7fd8a8101140 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd89c009990 tx=0x7fd89c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.622+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/4134224318 shutdown_connections 2023-07-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.622+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/4134224318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a80ffb00 0x7fd8a80fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.622+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/4134224318 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8a8101680 0x7fd8a8107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.622+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/4134224318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8100cf0 0x7fd8a8101140 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.622+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/4134224318 >> 172.21.15.151:0/4134224318 conn(0x7fd8a80fb0e0 msgr2=0x7fd8a80fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.622+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/4134224318 shutdown_connections 2023-07-21T22:17:05.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.622+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/4134224318 wait complete. 2023-07-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.623+0000 7fd8ae5ff700 1 Processor -- start 2023-07-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.623+0000 7fd8ae5ff700 1 -- start start 2023-07-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8ae5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8a80ffb00 0x7fd8a80742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8ae5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a8100cf0 0x7fd8a8072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8ae5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8101680 0x7fd8a8072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8ae5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80735e0 con 0x7fd8a8101680 2023-07-21T22:17:05.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8ae5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8073750 con 0x7fd8a8100cf0 2023-07-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8ae5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a819f7a0 con 0x7fd8a80ffb00 2023-07-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8acb9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8101680 0x7fd8a8072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8a7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8a80ffb00 0x7fd8a80742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8acb9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8101680 0x7fd8a8072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42618/0 (socket says 172.21.15.151:42618) 2023-07-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8acb9c700 1 -- 172.21.15.151:0/1173526714 learned_addr learned my addr 172.21.15.151:0/1173526714 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8a77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a8100cf0 0x7fd8a8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:05.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8acb9c700 1 -- 172.21.15.151:0/1173526714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8a80ffb00 msgr2=0x7fd8a80742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8acb9c700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8a80ffb00 0x7fd8a80742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8acb9c700 1 -- 172.21.15.151:0/1173526714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a8100cf0 msgr2=0x7fd8a8072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8acb9c700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a8100cf0 0x7fd8a8072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.624+0000 7fd8acb9c700 1 -- 172.21.15.151:0/1173526714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c0095f0 con 0x7fd8a8101680 2023-07-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.625+0000 7fd8acb9c700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8101680 0x7fd8a8072e40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0007ee0 tx=0x7fd8a000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.625+0000 7fd8a57fa700 1 -- 172.21.15.151:0/1173526714 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0017070 con 0x7fd8a8101680 2023-07-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.625+0000 7fd8a57fa700 1 -- 172.21.15.151:0/1173526714 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd8a000f040 con 0x7fd8a8101680 2023-07-21T22:17:05.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.625+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a819fa80 con 0x7fd8a8101680 2023-07-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.625+0000 7fd8a57fa700 1 -- 172.21.15.151:0/1173526714 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0005570 con 0x7fd8a8101680 2023-07-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.625+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a819ffe0 con 0x7fd8a8101680 2023-07-21T22:17:05.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.626+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a810b1d0 con 0x7fd8a8101680 2023-07-21T22:17:05.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.630+0000 7fd8a57fa700 1 -- 172.21.15.151:0/1173526714 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd8a000db20 con 0x7fd8a8101680 2023-07-21T22:17:05.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.632+0000 7fd8a57fa700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd8900a1220 0x7fd8900a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.632+0000 7fd8a57fa700 1 -- 172.21.15.151:0/1173526714 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fd8a00cbaf0 con 0x7fd8a8101680 2023-07-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.632+0000 7fd8a7fff700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd8900a1220 0x7fd8900a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:05.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.633+0000 7fd8a7fff700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd8900a1220 0x7fd8900a36d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8100b50 tx=0x7fd898009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:05.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.636+0000 7fd8a57fa700 1 -- 172.21.15.151:0/1173526714 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd8a00956e0 con 0x7fd8a8101680 2023-07-21T22:17:05.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:05 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] up:boot 2023-07-21T22:17:05.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:05 smithi151 ceph-mon[95510]: fsmap 12 up:standby 2023-07-21T22:17:05.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:05 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-21T22:17:05.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.851+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8a810b390 con 0x7fd8a8101680 2023-07-21T22:17:05.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.853+0000 7fd8a57fa700 1 -- 172.21.15.151:0/1173526714 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+18478 (secure 0 0 0) 0x7fd8a0098d00 con 0x7fd8a8101680 2023-07-21T22:17:05.897 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:05.897 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":81,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:16:14.136307+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":41,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":53,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:17:05.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd8900a1220 msgr2=0x7fd8900a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd8900a1220 0x7fd8900a36d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8100b50 tx=0x7fd898009260 comp rx=0 tx=0).stop 2023-07-21T22:17:05.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8101680 msgr2=0x7fd8a8072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8101680 0x7fd8a8072e40 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0007ee0 tx=0x7fd8a000d3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 shutdown_connections 2023-07-21T22:17:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd8900a1220 0x7fd8900a36d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a8101680 0x7fd8a8072e40 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd8a80ffb00 0x7fd8a80742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 --2- 172.21.15.151:0/1173526714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8a8100cf0 0x7fd8a8072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 >> 172.21.15.151:0/1173526714 conn(0x7fd8a80fb0e0 msgr2=0x7fd8a80fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 shutdown_connections 2023-07-21T22:17:05.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:05.855+0000 7fd8ae5ff700 1 -- 172.21.15.151:0/1173526714 wait complete. 2023-07-21T22:17:05.920 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:17:05.921 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:17:06.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.091+0000 7f707199d700 1 -- 172.21.15.151:0/2469029151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c105690 msgr2=0x7f706c107af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.091+0000 7f707199d700 1 --2- 172.21.15.151:0/2469029151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c105690 0x7f706c107af0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f70600098f0 tx=0x7f7060009c00 comp rx=0 tx=0).stop 2023-07-21T22:17:06.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.091+0000 7f707199d700 1 -- 172.21.15.151:0/2469029151 shutdown_connections 2023-07-21T22:17:06.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.091+0000 7f707199d700 1 --2- 172.21.15.151:0/2469029151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c105690 0x7f706c107af0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.091+0000 7f707199d700 1 --2- 172.21.15.151:0/2469029151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c100450 0x7f706c102830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.091+0000 7f707199d700 1 --2- 172.21.15.151:0/2469029151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c102d70 0x7f706c105150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.091+0000 7f707199d700 1 -- 172.21.15.151:0/2469029151 >> 172.21.15.151:0/2469029151 conn(0x7f706c0f9ed0 msgr2=0x7f706c0fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:06.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.091+0000 7f707199d700 1 -- 172.21.15.151:0/2469029151 shutdown_connections 2023-07-21T22:17:06.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.091+0000 7f707199d700 1 -- 172.21.15.151:0/2469029151 wait complete. 2023-07-21T22:17:06.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.092+0000 7f707199d700 1 Processor -- start 2023-07-21T22:17:06.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f707199d700 1 -- start start 2023-07-21T22:17:06.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f707199d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c100450 0x7f706c197660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:06.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f707199d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c102d70 0x7f706c197ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:06.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f707199d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c105690 0x7f706c19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:06.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f707199d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c19f1e0 con 0x7f706c102d70 2023-07-21T22:17:06.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f707199d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c19f320 con 0x7f706c100450 2023-07-21T22:17:06.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f707199d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c19f4b0 con 0x7f706c105690 2023-07-21T22:17:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f706bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c102d70 0x7f706c197ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f706bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c102d70 0x7f706c197ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39408/0 (socket says 172.21.15.151:39408) 2023-07-21T22:17:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.093+0000 7f706bfff700 1 -- 172.21.15.151:0/2325768782 learned_addr learned my addr 172.21.15.151:0/2325768782 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f707099b700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c100450 0x7f706c197660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f707119c700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c105690 0x7f706c19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:06.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f706bfff700 1 -- 172.21.15.151:0/2325768782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c105690 msgr2=0x7f706c19ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f706bfff700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c105690 0x7f706c19ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f706bfff700 1 -- 172.21.15.151:0/2325768782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c100450 msgr2=0x7f706c197660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f706bfff700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c100450 0x7f706c197660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f706bfff700 1 -- 172.21.15.151:0/2325768782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c0095f0 con 0x7f706c102d70 2023-07-21T22:17:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f706bfff700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c102d70 0x7f706c197ba0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f705c00ec10 tx=0x7f705c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f7069ffb700 1 -- 172.21.15.151:0/2325768782 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c00cd40 con 0x7f706c102d70 2023-07-21T22:17:06.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7060009520 con 0x7f706c102d70 2023-07-21T22:17:06.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f7069ffb700 1 -- 172.21.15.151:0/2325768782 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f705c0044b0 con 0x7f706c102d70 2023-07-21T22:17:06.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f7069ffb700 1 -- 172.21.15.151:0/2325768782 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f705c010430 con 0x7f706c102d70 2023-07-21T22:17:06.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.094+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c19fb60 con 0x7f706c102d70 2023-07-21T22:17:06.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.096+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c107200 con 0x7f706c102d70 2023-07-21T22:17:06.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.100+0000 7f7069ffb700 1 -- 172.21.15.151:0/2325768782 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f705c004000 con 0x7f706c102d70 2023-07-21T22:17:06.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.102+0000 7f7069ffb700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70540a11f0 0x7f70540a36a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:06.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.103+0000 7f7069ffb700 1 -- 172.21.15.151:0/2325768782 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f705c014070 con 0x7f706c102d70 2023-07-21T22:17:06.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.103+0000 7f707099b700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70540a11f0 0x7f70540a36a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:06.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.103+0000 7f7069ffb700 1 -- 172.21.15.151:0/2325768782 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f705c0f8810 con 0x7f706c102d70 2023-07-21T22:17:06.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.103+0000 7f707099b700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70540a11f0 0x7f70540a36a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f706400f540 tx=0x7f706400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:06.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.324+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f706c02cac0 con 0x7f706c102d70 2023-07-21T22:17:06.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.324+0000 7f7069ffb700 1 -- 172.21.15.151:0/2325768782 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v81) v1 ==== 93+0+10 (secure 0 0 0) 0x7f705c096690 con 0x7f706c102d70 2023-07-21T22:17:06.368 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:17:06.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70540a11f0 msgr2=0x7f70540a36a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70540a11f0 0x7f70540a36a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f706400f540 tx=0x7f706400b040 comp rx=0 tx=0).stop 2023-07-21T22:17:06.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c102d70 msgr2=0x7f706c197ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c102d70 0x7f706c197ba0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f705c00ec10 tx=0x7f705c00ef20 comp rx=0 tx=0).stop 2023-07-21T22:17:06.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 shutdown_connections 2023-07-21T22:17:06.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70540a11f0 0x7f70540a36a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f706c100450 0x7f706c197660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f706c105690 0x7f706c19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 --2- 172.21.15.151:0/2325768782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f706c102d70 0x7f706c197ba0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 >> 172.21.15.151:0/2325768782 conn(0x7f706c0f9ed0 msgr2=0x7f706c0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.327+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 shutdown_connections 2023-07-21T22:17:06.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.328+0000 7f707199d700 1 -- 172.21.15.151:0/2325768782 wait complete. 2023-07-21T22:17:06.391 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-07-21T22:17:06.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.556+0000 7fada27ff700 1 -- 172.21.15.151:0/1038289943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 msgr2=0x7fad9c0733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.556+0000 7fada27ff700 1 --2- 172.21.15.151:0/1038289943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 0x7fad9c0733e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fad90009990 tx=0x7fad90009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.556+0000 7fada27ff700 1 -- 172.21.15.151:0/1038289943 shutdown_connections 2023-07-21T22:17:06.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.556+0000 7fada27ff700 1 --2- 172.21.15.151:0/1038289943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9c074550 0x7fad9c0729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.556+0000 7fada27ff700 1 --2- 172.21.15.151:0/1038289943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c10c0d0 0x7fad9c10e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.556+0000 7fada27ff700 1 --2- 172.21.15.151:0/1038289943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 0x7fad9c0733e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.556+0000 7fada27ff700 1 -- 172.21.15.151:0/1038289943 >> 172.21.15.151:0/1038289943 conn(0x7fad9c0fb0e0 msgr2=0x7fad9c0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:06.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.556+0000 7fada27ff700 1 -- 172.21.15.151:0/1038289943 shutdown_connections 2023-07-21T22:17:06.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.556+0000 7fada27ff700 1 -- 172.21.15.151:0/1038289943 wait complete. 2023-07-21T22:17:06.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.558+0000 7fada27ff700 1 Processor -- start 2023-07-21T22:17:06.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.558+0000 7fada27ff700 1 -- start start 2023-07-21T22:17:06.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.558+0000 7fada27ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 0x7fad9c19bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:06.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fada27ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c074550 0x7fad9c19c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:06.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fada27ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9c10c0d0 0x7fad9c1a3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:06.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fada27ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1a3940 con 0x7fad9c072f70 2023-07-21T22:17:06.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fada27ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1a3a80 con 0x7fad9c10c0d0 2023-07-21T22:17:06.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fada27ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad9c1a3c10 con 0x7fad9c074550 2023-07-21T22:17:06.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 0x7fad9c19bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:06.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 0x7fad9c19bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39424/0 (socket says 172.21.15.151:39424) 2023-07-21T22:17:06.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9bfff700 1 -- 172.21.15.151:0/2375562152 learned_addr learned my addr 172.21.15.151:0/2375562152 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:06.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9b7fe700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c074550 0x7fad9c19c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:06.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fada0d9c700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9c10c0d0 0x7fad9c1a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:06.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9bfff700 1 -- 172.21.15.151:0/2375562152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c074550 msgr2=0x7fad9c19c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9bfff700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c074550 0x7fad9c19c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9bfff700 1 -- 172.21.15.151:0/2375562152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9c10c0d0 msgr2=0x7fad9c1a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9bfff700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9c10c0d0 0x7fad9c1a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9bfff700 1 -- 172.21.15.151:0/2375562152 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad900095f0 con 0x7fad9c072f70 2023-07-21T22:17:06.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9b7fe700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c074550 0x7fad9c19c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:06.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.559+0000 7fad9bfff700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 0x7fad9c19bdc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e970 tx=0x7fad8c00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:06.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.560+0000 7fad997fa700 1 -- 172.21.15.151:0/2375562152 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c009790 con 0x7fad9c072f70 2023-07-21T22:17:06.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.560+0000 7fad997fa700 1 -- 172.21.15.151:0/2375562152 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fad8c00c7e0 con 0x7fad9c072f70 2023-07-21T22:17:06.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.560+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad9c1a3ef0 con 0x7fad9c072f70 2023-07-21T22:17:06.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.560+0000 7fad997fa700 1 -- 172.21.15.151:0/2375562152 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c005440 con 0x7fad9c072f70 2023-07-21T22:17:06.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.560+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9c1a4310 con 0x7fad9c072f70 2023-07-21T22:17:06.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.561+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9c101c20 con 0x7fad9c072f70 2023-07-21T22:17:06.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.563+0000 7fad997fa700 1 -- 172.21.15.151:0/2375562152 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fad8c00c950 con 0x7fad9c072f70 2023-07-21T22:17:06.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.565+0000 7fad997fa700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fad840a11a0 0x7fad840a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:06.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.565+0000 7fad997fa700 1 -- 172.21.15.151:0/2375562152 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7fad8c014070 con 0x7fad9c072f70 2023-07-21T22:17:06.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.565+0000 7fad9b7fe700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fad840a11a0 0x7fad840a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:06.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.566+0000 7fad9b7fe700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fad840a11a0 0x7fad840a3650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fad900098e0 tx=0x7fad9000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:06.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.569+0000 7fad997fa700 1 -- 172.21.15.151:0/2375562152 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fad8c0961f0 con 0x7fad9c072f70 2023-07-21T22:17:06.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:06 smithi187 ceph-mon[96918]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:06.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:06 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2578049091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:06.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:06 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1173526714' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:06.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:06 smithi195 ceph-mon[97365]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:06.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:06 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2578049091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:06.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:06 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1173526714' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:06.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:06 smithi151 ceph-mon[95510]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:06.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:06 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2578049091' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:06.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:06 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1173526714' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:06.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.790+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fad9c0611c0 con 0x7fad9c072f70 2023-07-21T22:17:06.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.790+0000 7fad997fa700 1 -- 172.21.15.151:0/2375562152 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v81) v1 ==== 84+0+65 (secure 0 0 0) 0x7fad8c099810 con 0x7fad9c072f70 2023-07-21T22:17:06.835 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:06.835 INFO:teuthology.orchestra.run.smithi151.stdout:[ 2023-07-21T22:17:06.835 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T22:17:06.835 INFO:teuthology.orchestra.run.smithi151.stdout: "poolnum": 1, 2023-07-21T22:17:06.835 INFO:teuthology.orchestra.run.smithi151.stdout: "poolname": ".mgr" 2023-07-21T22:17:06.836 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:17:06.836 INFO:teuthology.orchestra.run.smithi151.stdout:] 2023-07-21T22:17:06.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.793+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fad840a11a0 msgr2=0x7fad840a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.793+0000 7fada27ff700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fad840a11a0 0x7fad840a3650 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fad900098e0 tx=0x7fad9000b260 comp rx=0 tx=0).stop 2023-07-21T22:17:06.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.793+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 msgr2=0x7fad9c19bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:06.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.793+0000 7fada27ff700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 0x7fad9c19bdc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00e970 tx=0x7fad8c00ec80 comp rx=0 tx=0).stop 2023-07-21T22:17:06.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.793+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 shutdown_connections 2023-07-21T22:17:06.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.793+0000 7fada27ff700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fad840a11a0 0x7fad840a3650 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.793+0000 7fada27ff700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9c10c0d0 0x7fad9c1a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.793+0000 7fada27ff700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad9c072f70 0x7fad9c19bdc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.794+0000 7fada27ff700 1 --2- 172.21.15.151:0/2375562152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad9c074550 0x7fad9c19c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:06.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.794+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 >> 172.21.15.151:0/2375562152 conn(0x7fad9c0fb0e0 msgr2=0x7fad9c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:06.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.794+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 shutdown_connections 2023-07-21T22:17:06.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:06.794+0000 7fada27ff700 1 -- 172.21.15.151:0/2375562152 wait complete. 2023-07-21T22:17:06.857 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-07-21T22:17:06.858 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-07-21T22:17:07.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.030+0000 7f5ae0fff700 1 -- 172.21.15.151:0/722629925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc100560 msgr2=0x7f5adc102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.030+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/722629925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc100560 0x7f5adc102940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5acc009990 tx=0x7f5acc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.030+0000 7f5ae0fff700 1 -- 172.21.15.151:0/722629925 shutdown_connections 2023-07-21T22:17:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.030+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/722629925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5adc1057a0 0x7f5adc107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.030+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/722629925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc100560 0x7f5adc102940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.030+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/722629925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5adc102e80 0x7f5adc105260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.030+0000 7f5ae0fff700 1 -- 172.21.15.151:0/722629925 >> 172.21.15.151:0/722629925 conn(0x7f5adc0fa000 msgr2=0x7f5adc0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:07.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.030+0000 7f5ae0fff700 1 -- 172.21.15.151:0/722629925 shutdown_connections 2023-07-21T22:17:07.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.030+0000 7f5ae0fff700 1 -- 172.21.15.151:0/722629925 wait complete. 2023-07-21T22:17:07.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.031+0000 7f5ae0fff700 1 Processor -- start 2023-07-21T22:17:07.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5ae0fff700 1 -- start start 2023-07-21T22:17:07.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5ae0fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5adc100560 0x7f5adc0ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:07.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5ae0fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5adc102e80 0x7f5adc0fe510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:07.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5ae0fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc1057a0 0x7f5adc0fea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:07.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5ae0fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0ff1f0 con 0x7f5adc1057a0 2023-07-21T22:17:07.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5ae0fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc0ff360 con 0x7f5adc102e80 2023-07-21T22:17:07.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5ae0fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5adc19f7f0 con 0x7f5adc100560 2023-07-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5adad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc1057a0 0x7f5adc0fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5ada59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5adc100560 0x7f5adc0ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5adad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc1057a0 0x7f5adc0fea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39434/0 (socket says 172.21.15.151:39434) 2023-07-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5ad9d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5adc102e80 0x7f5adc0fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.032+0000 7f5adad9d700 1 -- 172.21.15.151:0/3188000709 learned_addr learned my addr 172.21.15.151:0/3188000709 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5adad9d700 1 -- 172.21.15.151:0/3188000709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5adc100560 msgr2=0x7f5adc0ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:07.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5adad9d700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5adc100560 0x7f5adc0ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5adad9d700 1 -- 172.21.15.151:0/3188000709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5adc102e80 msgr2=0x7f5adc0fe510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5adad9d700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5adc102e80 0x7f5adc0fe510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5adad9d700 1 -- 172.21.15.151:0/3188000709 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5acc0095f0 con 0x7f5adc1057a0 2023-07-21T22:17:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5adad9d700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc1057a0 0x7f5adc0fea50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400ef30 tx=0x7f5ad400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5acb7fe700 1 -- 172.21.15.151:0/3188000709 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4018070 con 0x7f5adc1057a0 2023-07-21T22:17:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5acb7fe700 1 -- 172.21.15.151:0/3188000709 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ad400f040 con 0x7f5adc1057a0 2023-07-21T22:17:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5adc19fa70 con 0x7f5adc1057a0 2023-07-21T22:17:07.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5acb7fe700 1 -- 172.21.15.151:0/3188000709 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400cb80 con 0x7f5adc1057a0 2023-07-21T22:17:07.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.033+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5adc19ff80 con 0x7f5adc1057a0 2023-07-21T22:17:07.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.034+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5adc0fbb70 con 0x7f5adc1057a0 2023-07-21T22:17:07.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.036+0000 7f5acb7fe700 1 -- 172.21.15.151:0/3188000709 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f5ad400cd60 con 0x7f5adc1057a0 2023-07-21T22:17:07.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.037+0000 7f5acb7fe700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ac40a1150 0x7f5ac40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:07.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.037+0000 7f5acb7fe700 1 -- 172.21.15.151:0/3188000709 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 7127+0+0 (secure 0 0 0) 0x7f5ad40cbfa0 con 0x7f5adc1057a0 2023-07-21T22:17:07.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.038+0000 7f5ada59c700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ac40a1150 0x7f5ac40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:07.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.038+0000 7f5ada59c700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ac40a1150 0x7f5ac40a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006010 tx=0x7f5acc00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:07.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.041+0000 7f5acb7fe700 1 -- 172.21.15.151:0/3188000709 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f5ad4099610 con 0x7f5adc1057a0 2023-07-21T22:17:07.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.254+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5adc02c850 con 0x7f5adc1057a0 2023-07-21T22:17:07.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.836+0000 7f5acb7fe700 1 -- 172.21.15.151:0/3188000709 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v82) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5ad40991a0 con 0x7f5adc1057a0 2023-07-21T22:17:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.841+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ac40a1150 msgr2=0x7f5ac40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.841+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ac40a1150 0x7f5ac40a3600 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5acc006010 tx=0x7f5acc00b260 comp rx=0 tx=0).stop 2023-07-21T22:17:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.841+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc1057a0 msgr2=0x7f5adc0fea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:07.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.841+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc1057a0 0x7f5adc0fea50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f5ad400ef30 tx=0x7f5ad400c3a0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.842+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 shutdown_connections 2023-07-21T22:17:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.842+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5ac40a1150 0x7f5ac40a3600 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.842+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5adc1057a0 0x7f5adc0fea50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.842+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5adc100560 0x7f5adc0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.842+0000 7f5ae0fff700 1 --2- 172.21.15.151:0/3188000709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5adc102e80 0x7f5adc0fe510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:07.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.842+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 >> 172.21.15.151:0/3188000709 conn(0x7f5adc0fa000 msgr2=0x7f5adc1011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:07.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.842+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 shutdown_connections 2023-07-21T22:17:07.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:07.842+0000 7f5ae0fff700 1 -- 172.21.15.151:0/3188000709 wait complete. 2023-07-21T22:17:07.888 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_metadata' created 2023-07-21T22:17:07.909 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-07-21T22:17:08.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.082+0000 7fdf6fbff700 1 -- 172.21.15.151:0/2032331037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 msgr2=0x7fdf680729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:08.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.082+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/2032331037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 0x7fdf680729a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009990 tx=0x7fdf64009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.083+0000 7fdf6fbff700 1 -- 172.21.15.151:0/2032331037 shutdown_connections 2023-07-21T22:17:08.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.083+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/2032331037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf6810c0c0 0x7fdf6810e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.083+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/2032331037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 0x7fdf680729a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.083+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/2032331037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf68072f70 0x7fdf680733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.083+0000 7fdf6fbff700 1 -- 172.21.15.151:0/2032331037 >> 172.21.15.151:0/2032331037 conn(0x7fdf680fb130 msgr2=0x7fdf680fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.083+0000 7fdf6fbff700 1 -- 172.21.15.151:0/2032331037 shutdown_connections 2023-07-21T22:17:08.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.083+0000 7fdf6fbff700 1 -- 172.21.15.151:0/2032331037 wait complete. 2023-07-21T22:17:08.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:07 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2325768782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:17:08.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:07 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2375562152' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-07-21T22:17:08.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.084+0000 7fdf6fbff700 1 Processor -- start 2023-07-21T22:17:08.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.084+0000 7fdf6fbff700 1 -- start start 2023-07-21T22:17:08.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6fbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf68072f70 0x7fdf6819bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6fbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 0x7fdf6819c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6fbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6810c0c0 0x7fdf681a33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6fbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf681a3970 con 0x7fdf68074550 2023-07-21T22:17:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6fbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf681a3ab0 con 0x7fdf6810c0c0 2023-07-21T22:17:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6fbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf681a3c40 con 0x7fdf68072f70 2023-07-21T22:17:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6d19a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 0x7fdf6819c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6d19a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 0x7fdf6819c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39450/0 (socket says 172.21.15.151:39450) 2023-07-21T22:17:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6d19a700 1 -- 172.21.15.151:0/1917478801 learned_addr learned my addr 172.21.15.151:0/1917478801 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6e19c700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6810c0c0 0x7fdf681a33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.085+0000 7fdf6d99b700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf68072f70 0x7fdf6819bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf6d19a700 1 -- 172.21.15.151:0/1917478801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf68072f70 msgr2=0x7fdf6819bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf6d19a700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf68072f70 0x7fdf6819bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf6d19a700 1 -- 172.21.15.151:0/1917478801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6810c0c0 msgr2=0x7fdf681a33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf6d19a700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6810c0c0 0x7fdf681a33a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf6d19a700 1 -- 172.21.15.151:0/1917478801 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf58009520 con 0x7fdf68074550 2023-07-21T22:17:08.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf6e19c700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6810c0c0 0x7fdf681a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:08.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf6d19a700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 0x7fdf6819c330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800ea50 tx=0x7fdf5800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:08.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf5effd700 1 -- 172.21.15.151:0/1917478801 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800cbd0 con 0x7fdf68074550 2023-07-21T22:17:08.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf5effd700 1 -- 172.21.15.151:0/1917478801 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf5800cd30 con 0x7fdf68074550 2023-07-21T22:17:08.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf640095f0 con 0x7fdf68074550 2023-07-21T22:17:08.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf5effd700 1 -- 172.21.15.151:0/1917478801 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58018680 con 0x7fdf68074550 2023-07-21T22:17:08.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.086+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf681a41f0 con 0x7fdf68074550 2023-07-21T22:17:08.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.088+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf68101c10 con 0x7fdf68074550 2023-07-21T22:17:08.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.091+0000 7fdf5effd700 1 -- 172.21.15.151:0/1917478801 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fdf58010430 con 0x7fdf68074550 2023-07-21T22:17:08.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.093+0000 7fdf5effd700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf540a1150 0x7fdf540a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:08.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.093+0000 7fdf5effd700 1 -- 172.21.15.151:0/1917478801 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 7497+0+0 (secure 0 0 0) 0x7fdf58014070 con 0x7fdf68074550 2023-07-21T22:17:08.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.093+0000 7fdf6d99b700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf540a1150 0x7fdf540a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:08.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.094+0000 7fdf6d99b700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf540a1150 0x7fdf540a3600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdf64005910 tx=0x7fdf6400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.095+0000 7fdf5effd700 1 -- 172.21.15.151:0/1917478801 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fdf580968c0 con 0x7fdf68074550 2023-07-21T22:17:08.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:07 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2325768782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:17:08.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:07 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2375562152' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-07-21T22:17:08.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:07 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2325768782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:17:08.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:07 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2375562152' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2023-07-21T22:17:08.350 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.306+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fdf6802c850 con 0x7fdf68074550 2023-07-21T22:17:08.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.843+0000 7fdf5effd700 1 -- 172.21.15.151:0/1917478801 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v83) v1 ==== 170+0+0 (secure 0 0 0) 0x7fdf58099ee0 con 0x7fdf68074550 2023-07-21T22:17:08.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.853+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf540a1150 msgr2=0x7fdf540a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:08.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.853+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf540a1150 0x7fdf540a3600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fdf64005910 tx=0x7fdf6400b260 comp rx=0 tx=0).stop 2023-07-21T22:17:08.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.853+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 msgr2=0x7fdf6819c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:08.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.853+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 0x7fdf6819c330 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fdf5800ea50 tx=0x7fdf5800ed60 comp rx=0 tx=0).stop 2023-07-21T22:17:08.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.859+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 shutdown_connections 2023-07-21T22:17:08.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.859+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf540a1150 0x7fdf540a3600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.859+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf6810c0c0 0x7fdf681a33a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.859+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf68072f70 0x7fdf6819bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.859+0000 7fdf6fbff700 1 --2- 172.21.15.151:0/1917478801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf68074550 0x7fdf6819c330 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:08.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.859+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 >> 172.21.15.151:0/1917478801 conn(0x7fdf680fb130 msgr2=0x7fdf680fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:08.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.867+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 shutdown_connections 2023-07-21T22:17:08.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:08.867+0000 7fdf6fbff700 1 -- 172.21.15.151:0/1917478801 wait complete. 2023-07-21T22:17:08.912 INFO:teuthology.orchestra.run.smithi151.stderr:pool 'cephfs_data' created 2023-07-21T22:17:08.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-07-21T22:17:09.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:09.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3188000709' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-07-21T22:17:09.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3188000709' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-07-21T22:17:09.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: osdmap e82: 12 total, 12 up, 12 in 2023-07-21T22:17:09.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:08 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.092+0000 7fd1379ff700 1 -- 172.21.15.151:0/241322042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130100ce0 msgr2=0x7fd130101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.092+0000 7fd1379ff700 1 --2- 172.21.15.151:0/241322042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130100ce0 0x7fd130101130 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fd1200098f0 tx=0x7fd120009c00 comp rx=0 tx=0).stop 2023-07-21T22:17:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.092+0000 7fd1379ff700 1 -- 172.21.15.151:0/241322042 shutdown_connections 2023-07-21T22:17:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.092+0000 7fd1379ff700 1 --2- 172.21.15.151:0/241322042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd130101670 0x7fd130107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.092+0000 7fd1379ff700 1 --2- 172.21.15.151:0/241322042 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd1300ffaf0 0x7fd1300fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.092+0000 7fd1379ff700 1 --2- 172.21.15.151:0/241322042 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130100ce0 0x7fd130101130 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.092+0000 7fd1379ff700 1 -- 172.21.15.151:0/241322042 >> 172.21.15.151:0/241322042 conn(0x7fd1300fb130 msgr2=0x7fd1300fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:09.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.092+0000 7fd1379ff700 1 -- 172.21.15.151:0/241322042 shutdown_connections 2023-07-21T22:17:09.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.092+0000 7fd1379ff700 1 -- 172.21.15.151:0/241322042 wait complete. 2023-07-21T22:17:09.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.093+0000 7fd1379ff700 1 Processor -- start 2023-07-21T22:17:09.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.093+0000 7fd1379ff700 1 -- start start 2023-07-21T22:17:09.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd1379ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1300ffaf0 0x7fd130195810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd1379ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd130100ce0 0x7fd130195d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd1379ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130101670 0x7fd13019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd1379ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13019d390 con 0x7fd130101670 2023-07-21T22:17:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd1379ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13019d4d0 con 0x7fd1300ffaf0 2023-07-21T22:17:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd1379ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13019d660 con 0x7fd130100ce0 2023-07-21T22:17:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd135f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130101670 0x7fd13019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:09.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd135f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130101670 0x7fd13019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39476/0 (socket says 172.21.15.151:39476) 2023-07-21T22:17:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd135f9c700 1 -- 172.21.15.151:0/95996299 learned_addr learned my addr 172.21.15.151:0/95996299 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd13579b700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1300ffaf0 0x7fd130195810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd134f9a700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd130100ce0 0x7fd130195d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd135f9c700 1 -- 172.21.15.151:0/95996299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd130100ce0 msgr2=0x7fd130195d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd135f9c700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd130100ce0 0x7fd130195d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd135f9c700 1 -- 172.21.15.151:0/95996299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1300ffaf0 msgr2=0x7fd130195810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd135f9c700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1300ffaf0 0x7fd130195810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.094+0000 7fd135f9c700 1 -- 172.21.15.151:0/95996299 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd120009520 con 0x7fd130101670 2023-07-21T22:17:09.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.095+0000 7fd135f9c700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130101670 0x7fd13019cdc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd12800ef30 tx=0x7fd12800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:09.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.095+0000 7fd1267fc700 1 -- 172.21.15.151:0/95996299 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd128018070 con 0x7fd130101670 2023-07-21T22:17:09.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.095+0000 7fd1267fc700 1 -- 172.21.15.151:0/95996299 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd12800f040 con 0x7fd130101670 2023-07-21T22:17:09.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.095+0000 7fd1267fc700 1 -- 172.21.15.151:0/95996299 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd12800cbb0 con 0x7fd130101670 2023-07-21T22:17:09.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.095+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd13019d8e0 con 0x7fd130101670 2023-07-21T22:17:09.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.095+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd13019dda0 con 0x7fd130101670 2023-07-21T22:17:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.096+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130106b00 con 0x7fd130101670 2023-07-21T22:17:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.098+0000 7fd1267fc700 1 -- 172.21.15.151:0/95996299 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd12800cd30 con 0x7fd130101670 2023-07-21T22:17:09.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.099+0000 7fd1267fc700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd11c0a11d0 0x7fd11c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:09.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.100+0000 7fd1267fc700 1 -- 172.21.15.151:0/95996299 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(83..83 src has 1..83) v4 ==== 7879+0+0 (secure 0 0 0) 0x7fd1280cc7a0 con 0x7fd130101670 2023-07-21T22:17:09.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.100+0000 7fd13579b700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd11c0a11d0 0x7fd11c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:09.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.100+0000 7fd13579b700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd11c0a11d0 0x7fd11c0a3680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd130100b40 tx=0x7fd12c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:09.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.102+0000 7fd1267fc700 1 -- 172.21.15.151:0/95996299 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd128096090 con 0x7fd130101670 2023-07-21T22:17:09.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:09.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3188000709' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-07-21T22:17:09.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3188000709' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-07-21T22:17:09.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: osdmap e82: 12 total, 12 up, 12 in 2023-07-21T22:17:09.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:08 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:09.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3188000709' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2023-07-21T22:17:09.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3188000709' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2023-07-21T22:17:09.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: osdmap e82: 12 total, 12 up, 12 in 2023-07-21T22:17:09.201 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.201 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:08 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:09.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.356+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd13002c850 con 0x7fd130101670 2023-07-21T22:17:09.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.856+0000 7fd1267fc700 1 -- 172.21.15.151:0/95996299 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd1280996b0 con 0x7fd130101670 2023-07-21T22:17:09.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd11c0a11d0 msgr2=0x7fd11c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:09.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd11c0a11d0 0x7fd11c0a3680 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fd130100b40 tx=0x7fd12c009310 comp rx=0 tx=0).stop 2023-07-21T22:17:09.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130101670 msgr2=0x7fd13019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:09.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130101670 0x7fd13019cdc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd12800ef30 tx=0x7fd12800c3a0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 shutdown_connections 2023-07-21T22:17:09.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd11c0a11d0 0x7fd11c0a3680 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1300ffaf0 0x7fd130195810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd130101670 0x7fd13019cdc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 --2- 172.21.15.151:0/95996299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd130100ce0 0x7fd130195d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:09.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.860+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 >> 172.21.15.151:0/95996299 conn(0x7fd1300fb130 msgr2=0x7fd1300fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:09.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.861+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 shutdown_connections 2023-07-21T22:17:09.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:09.861+0000 7fd1379ff700 1 -- 172.21.15.151:0/95996299 wait complete. 2023-07-21T22:17:09.907 INFO:teuthology.orchestra.run.smithi151.stderr:new fs with metadata pool 2 and data pool 3 2023-07-21T22:17:09.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:17:10.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1917478801' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-07-21T22:17:10.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:17:10.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:17:10.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:10.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1917478801' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-07-21T22:17:10.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: osdmap e83: 12 total, 12 up, 12 in 2023-07-21T22:17:10.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: pgmap v296: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:10.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:17:10.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/95996299' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-21T22:17:10.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:09 smithi187 ceph-mon[96918]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-07-21T22:17:10.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.095+0000 7fcf599ff700 1 -- 172.21.15.151:0/1315249559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54101680 msgr2=0x7fcf54107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.095+0000 7fcf599ff700 1 --2- 172.21.15.151:0/1315249559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54101680 0x7fcf54107f40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcf4c00f530 tx=0x7fcf4c00f840 comp rx=0 tx=0).stop 2023-07-21T22:17:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.095+0000 7fcf599ff700 1 -- 172.21.15.151:0/1315249559 shutdown_connections 2023-07-21T22:17:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.095+0000 7fcf599ff700 1 --2- 172.21.15.151:0/1315249559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf540ffb00 0x7fcf540fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.095+0000 7fcf599ff700 1 --2- 172.21.15.151:0/1315249559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54101680 0x7fcf54107f40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.095+0000 7fcf599ff700 1 --2- 172.21.15.151:0/1315249559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf54100cf0 0x7fcf54101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.095+0000 7fcf599ff700 1 -- 172.21.15.151:0/1315249559 >> 172.21.15.151:0/1315249559 conn(0x7fcf540fb0e0 msgr2=0x7fcf540fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:10.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.095+0000 7fcf599ff700 1 -- 172.21.15.151:0/1315249559 shutdown_connections 2023-07-21T22:17:10.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.095+0000 7fcf599ff700 1 -- 172.21.15.151:0/1315249559 wait complete. 2023-07-21T22:17:10.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.096+0000 7fcf599ff700 1 Processor -- start 2023-07-21T22:17:10.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf599ff700 1 -- start start 2023-07-21T22:17:10.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf599ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540ffb00 0x7fcf541936a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf599ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54100cf0 0x7fcf54193be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf599ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf54101680 0x7fcf5419ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf599ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5419b220 con 0x7fcf54100cf0 2023-07-21T22:17:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf599ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5419b360 con 0x7fcf54101680 2023-07-21T22:17:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf599ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf5419b4f0 con 0x7fcf540ffb00 2023-07-21T22:17:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf527fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54100cf0 0x7fcf54193be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:10.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf52ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540ffb00 0x7fcf541936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf527fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54100cf0 0x7fcf54193be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39508/0 (socket says 172.21.15.151:39508) 2023-07-21T22:17:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf52ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540ffb00 0x7fcf541936a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54812/0 (socket says 172.21.15.151:54812) 2023-07-21T22:17:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.097+0000 7fcf527fc700 1 -- 172.21.15.151:0/513285418 learned_addr learned my addr 172.21.15.151:0/513285418 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf527fc700 1 -- 172.21.15.151:0/513285418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540ffb00 msgr2=0x7fcf541936a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf527fc700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540ffb00 0x7fcf541936a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf527fc700 1 -- 172.21.15.151:0/513285418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf54101680 msgr2=0x7fcf5419ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf527fc700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf54101680 0x7fcf5419ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf527fc700 1 -- 172.21.15.151:0/513285418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4c009d00 con 0x7fcf54100cf0 2023-07-21T22:17:10.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf527fc700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54100cf0 0x7fcf54193be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000c920 tx=0x7fcf4000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:10.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf589fd700 1 -- 172.21.15.151:0/513285418 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40007b00 con 0x7fcf54100cf0 2023-07-21T22:17:10.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf589fd700 1 -- 172.21.15.151:0/513285418 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf4000ce70 con 0x7fcf54100cf0 2023-07-21T22:17:10.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5419b7d0 con 0x7fcf54100cf0 2023-07-21T22:17:10.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf589fd700 1 -- 172.21.15.151:0/513285418 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf40005440 con 0x7fcf54100cf0 2023-07-21T22:17:10.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.098+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf5419bce0 con 0x7fcf54100cf0 2023-07-21T22:17:10.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.099+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf54109090 con 0x7fcf54100cf0 2023-07-21T22:17:10.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.101+0000 7fcf589fd700 1 -- 172.21.15.151:0/513285418 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fcf400055a0 con 0x7fcf54100cf0 2023-07-21T22:17:10.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.103+0000 7fcf589fd700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcf380a11a0 0x7fcf380a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:10.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.103+0000 7fcf589fd700 1 -- 172.21.15.151:0/513285418 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fcf400cc430 con 0x7fcf54100cf0 2023-07-21T22:17:10.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.103+0000 7fcf52ffd700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcf380a11a0 0x7fcf380a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:10.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.104+0000 7fcf52ffd700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcf380a11a0 0x7fcf380a3650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf54100b50 tx=0x7fcf44009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:10.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.107+0000 7fcf589fd700 1 -- 172.21.15.151:0/513285418 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fcf40095c30 con 0x7fcf54100cf0 2023-07-21T22:17:10.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1917478801' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-07-21T22:17:10.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:17:10.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:17:10.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:10.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1917478801' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-07-21T22:17:10.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: osdmap e83: 12 total, 12 up, 12 in 2023-07-21T22:17:10.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: pgmap v296: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:10.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:17:10.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/95996299' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-21T22:17:10.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:09 smithi195 ceph-mon[97365]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-07-21T22:17:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1917478801' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2023-07-21T22:17:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:17:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:17:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1917478801' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2023-07-21T22:17:10.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: osdmap e83: 12 total, 12 up, 12 in 2023-07-21T22:17:10.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: pgmap v296: 97 pgs: 3 creating+peering, 1 active+clean, 93 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:17:10.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:17:10.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/95996299' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2023-07-21T22:17:10.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:09 smithi151 ceph-mon[95510]: daemon mds.b assigned to filesystem cephfs as rank 0 2023-07-21T22:17:10.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.317+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf54109280 con 0x7fcf54100cf0 2023-07-21T22:17:10.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.318+0000 7fcf589fd700 1 -- 172.21.15.151:0/513285418 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22188 (secure 0 0 0) 0x7fcf40099250 con 0x7fcf54100cf0 2023-07-21T22:17:10.363 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:10.363 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":84,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:09.358474+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:17:10.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcf380a11a0 msgr2=0x7fcf380a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcf380a11a0 0x7fcf380a3650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcf54100b50 tx=0x7fcf44009260 comp rx=0 tx=0).stop 2023-07-21T22:17:10.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54100cf0 msgr2=0x7fcf54193be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54100cf0 0x7fcf54193be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000c920 tx=0x7fcf4000cc30 comp rx=0 tx=0).stop 2023-07-21T22:17:10.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 shutdown_connections 2023-07-21T22:17:10.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fcf380a11a0 0x7fcf380a3650 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf54101680 0x7fcf5419ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf540ffb00 0x7fcf541936a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 --2- 172.21.15.151:0/513285418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf54100cf0 0x7fcf54193be0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 >> 172.21.15.151:0/513285418 conn(0x7fcf540fb0e0 msgr2=0x7fcf540fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 shutdown_connections 2023-07-21T22:17:10.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.321+0000 7fcf599ff700 1 -- 172.21.15.151:0/513285418 wait complete. 2023-07-21T22:17:10.384 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:17:10.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.549+0000 7f9edfdff700 1 -- 172.21.15.151:0/1451834338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ed8074550 msgr2=0x7f9ed80729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.549+0000 7f9edfdff700 1 --2- 172.21.15.151:0/1451834338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ed8074550 0x7f9ed80729a0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4009990 tx=0x7f9ed4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.549+0000 7f9edfdff700 1 -- 172.21.15.151:0/1451834338 shutdown_connections 2023-07-21T22:17:10.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.549+0000 7f9edfdff700 1 --2- 172.21.15.151:0/1451834338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed81079c0 0x7f9ed8109e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.549+0000 7f9edfdff700 1 --2- 172.21.15.151:0/1451834338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ed8074550 0x7f9ed80729a0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.549+0000 7f9edfdff700 1 --2- 172.21.15.151:0/1451834338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ed8072f70 0x7f9ed80733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.549+0000 7f9edfdff700 1 -- 172.21.15.151:0/1451834338 >> 172.21.15.151:0/1451834338 conn(0x7f9ed80fb0e0 msgr2=0x7f9ed80fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:10.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.549+0000 7f9edfdff700 1 -- 172.21.15.151:0/1451834338 shutdown_connections 2023-07-21T22:17:10.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.549+0000 7f9edfdff700 1 -- 172.21.15.151:0/1451834338 wait complete. 2023-07-21T22:17:10.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.550+0000 7f9edfdff700 1 Processor -- start 2023-07-21T22:17:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.551+0000 7f9edfdff700 1 -- start start 2023-07-21T22:17:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.551+0000 7f9edfdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed8072f70 0x7f9ed81979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.551+0000 7f9edfdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ed8074550 0x7f9ed8197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.551+0000 7f9edfdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ed81079c0 0x7f9ed819ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.551+0000 7f9edfdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed819f550 con 0x7f9ed81079c0 2023-07-21T22:17:10.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.551+0000 7f9edfdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed819f690 con 0x7f9ed8072f70 2023-07-21T22:17:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.551+0000 7f9edfdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed819f820 con 0x7f9ed8074550 2023-07-21T22:17:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.551+0000 7f9eddb9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed8072f70 0x7f9ed81979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9eddb9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed8072f70 0x7f9ed81979d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43960/0 (socket says 172.21.15.151:43960) 2023-07-21T22:17:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9ede39c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ed81079c0 0x7f9ed819ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9eddb9b700 1 -- 172.21.15.151:0/916211517 learned_addr learned my addr 172.21.15.151:0/916211517 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9edd39a700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ed8074550 0x7f9ed8197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:10.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9eddb9b700 1 -- 172.21.15.151:0/916211517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ed8074550 msgr2=0x7f9ed8197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9eddb9b700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ed8074550 0x7f9ed8197f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9eddb9b700 1 -- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ed81079c0 msgr2=0x7f9ed819ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9eddb9b700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ed81079c0 0x7f9ed819ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9eddb9b700 1 -- 172.21.15.151:0/916211517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed40095f0 con 0x7f9ed8072f70 2023-07-21T22:17:10.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9ede39c700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ed81079c0 0x7f9ed819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:10.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9eddb9b700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed8072f70 0x7f9ed81979d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4005910 tx=0x7f9ed4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:10.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.552+0000 7f9eceffd700 1 -- 172.21.15.151:0/916211517 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed401d070 con 0x7f9ed8072f70 2023-07-21T22:17:10.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.553+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed819faa0 con 0x7f9ed8072f70 2023-07-21T22:17:10.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.553+0000 7f9eceffd700 1 -- 172.21.15.151:0/916211517 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ed400beb0 con 0x7f9ed8072f70 2023-07-21T22:17:10.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.553+0000 7f9eceffd700 1 -- 172.21.15.151:0/916211517 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4022de0 con 0x7f9ed8072f70 2023-07-21T22:17:10.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.553+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed819ff20 con 0x7f9ed8072f70 2023-07-21T22:17:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.554+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed8106070 con 0x7f9ed8072f70 2023-07-21T22:17:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.556+0000 7f9eceffd700 1 -- 172.21.15.151:0/916211517 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f9ed40225e0 con 0x7f9ed8072f70 2023-07-21T22:17:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.557+0000 7f9eceffd700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ec40a11a0 0x7f9ec40a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.557+0000 7f9eceffd700 1 -- 172.21.15.151:0/916211517 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f9ed40cdcf0 con 0x7f9ed8072f70 2023-07-21T22:17:10.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.557+0000 7f9edd39a700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ec40a11a0 0x7f9ec40a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:10.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.558+0000 7f9edd39a700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ec40a11a0 0x7f9ec40a3650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8074270 tx=0x7f9ec8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:10.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.562+0000 7f9eceffd700 1 -- 172.21.15.151:0/916211517 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f9ed4097580 con 0x7f9ed8072f70 2023-07-21T22:17:10.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.784+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ed80611c0 con 0x7f9ed8072f70 2023-07-21T22:17:10.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.786+0000 7f9eceffd700 1 -- 172.21.15.151:0/916211517 <== mon.2 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) v1 ==== 74+0+22188 (secure 0 0 0) 0x7f9ed409aba0 con 0x7f9ed8072f70 2023-07-21T22:17:10.830 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:10.830 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":84,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:09.358474+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:17:10.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ec40a11a0 msgr2=0x7f9ec40a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ec40a11a0 0x7f9ec40a3650 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8074270 tx=0x7f9ec8007400 comp rx=0 tx=0).stop 2023-07-21T22:17:10.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed8072f70 msgr2=0x7f9ed81979d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:10.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed8072f70 0x7f9ed81979d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4005910 tx=0x7f9ed4005740 comp rx=0 tx=0).stop 2023-07-21T22:17:10.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 shutdown_connections 2023-07-21T22:17:10.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ec40a11a0 0x7f9ec40a3650 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ed8072f70 0x7f9ed81979d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ed81079c0 0x7f9ed819ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 --2- 172.21.15.151:0/916211517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ed8074550 0x7f9ed8197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:10.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 >> 172.21.15.151:0/916211517 conn(0x7f9ed80fb0e0 msgr2=0x7f9ed80fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:10.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 shutdown_connections 2023-07-21T22:17:10.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:10.788+0000 7f9edfdff700 1 -- 172.21.15.151:0/916211517 wait complete. 2023-07-21T22:17:10.851 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-07-21T22:17:11.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.025+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/1722042056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8101670 msgr2=0x7fc1b8107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:11.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.025+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/1722042056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8101670 0x7fc1b8107f30 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fc1b000b0a0 tx=0x7fc1b000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:11.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.025+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/1722042056 shutdown_connections 2023-07-21T22:17:11.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.025+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/1722042056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8101670 0x7fc1b8107f30 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:11.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.025+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/1722042056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1b80ffaf0 0x7fc1b80fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:11.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.025+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/1722042056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b8100ce0 0x7fc1b8101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:11.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.025+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/1722042056 >> 172.21.15.151:0/1722042056 conn(0x7fc1b80fb130 msgr2=0x7fc1b80fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:11.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.025+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/1722042056 shutdown_connections 2023-07-21T22:17:11.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.025+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/1722042056 wait complete. 2023-07-21T22:17:11.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.026+0000 7fc1bd9ff700 1 Processor -- start 2023-07-21T22:17:11.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.026+0000 7fc1bd9ff700 1 -- start start 2023-07-21T22:17:11.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1bd9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b80ffaf0 0x7fc1b80742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:11.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1bd9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8100ce0 0x7fc1b8072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:11.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1bd9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1b8101670 0x7fc1b8072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:11.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1bd9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b80735e0 con 0x7fc1b8100ce0 2023-07-21T22:17:11.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1bd9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b8073750 con 0x7fc1b80ffaf0 2023-07-21T22:17:11.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1bd9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1b819f8a0 con 0x7fc1b8101670 2023-07-21T22:17:11.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1affff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8100ce0 0x7fc1b8072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:11.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1affff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8100ce0 0x7fc1b8072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39554/0 (socket says 172.21.15.151:39554) 2023-07-21T22:17:11.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1affff700 1 -- 172.21.15.151:0/3339379232 learned_addr learned my addr 172.21.15.151:0/3339379232 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:11.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1b6ffd700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b80ffaf0 0x7fc1b80742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:11.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1b77fe700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1b8101670 0x7fc1b8072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:11.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1affff700 1 -- 172.21.15.151:0/3339379232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1b8101670 msgr2=0x7fc1b8072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:11.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1affff700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1b8101670 0x7fc1b8072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:11.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1affff700 1 -- 172.21.15.151:0/3339379232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b80ffaf0 msgr2=0x7fc1b80742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:11.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1affff700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b80ffaf0 0x7fc1b80742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:11.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.027+0000 7fc1affff700 1 -- 172.21.15.151:0/3339379232 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1b0009d00 con 0x7fc1b8100ce0 2023-07-21T22:17:11.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.028+0000 7fc1affff700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8100ce0 0x7fc1b8072900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000d950 tx=0x7fc1a000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:11.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.028+0000 7fc1bc9fd700 1 -- 172.21.15.151:0/3339379232 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0009940 con 0x7fc1b8100ce0 2023-07-21T22:17:11.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.028+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1b819fb80 con 0x7fc1b8100ce0 2023-07-21T22:17:11.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.028+0000 7fc1bc9fd700 1 -- 172.21.15.151:0/3339379232 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc1a0010460 con 0x7fc1b8100ce0 2023-07-21T22:17:11.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.028+0000 7fc1bc9fd700 1 -- 172.21.15.151:0/3339379232 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1a000f620 con 0x7fc1b8100ce0 2023-07-21T22:17:11.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.028+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1b81a0090 con 0x7fc1b8100ce0 2023-07-21T22:17:11.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.029+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1b8107050 con 0x7fc1b8100ce0 2023-07-21T22:17:11.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.031+0000 7fc1bc9fd700 1 -- 172.21.15.151:0/3339379232 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc1a00105d0 con 0x7fc1b8100ce0 2023-07-21T22:17:11.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.033+0000 7fc1bc9fd700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc1a40a1150 0x7fc1a40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:11.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.033+0000 7fc1bc9fd700 1 -- 172.21.15.151:0/3339379232 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc1a00cc630 con 0x7fc1b8100ce0 2023-07-21T22:17:11.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.033+0000 7fc1b6ffd700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc1a40a1150 0x7fc1a40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:11.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.034+0000 7fc1b6ffd700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc1a40a1150 0x7fc1a40a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8100b40 tx=0x7fc1a8007400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:11.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.036+0000 7fc1bc9fd700 1 -- 172.21.15.151:0/3339379232 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fc1a0095e30 con 0x7fc1b8100ce0 2023-07-21T22:17:11.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:10 smithi187 ceph-mon[96918]: osdmap e84: 12 total, 12 up, 12 in 2023-07-21T22:17:11.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:10 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/95996299' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-07-21T22:17:11.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:10 smithi187 ceph-mon[96918]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-07-21T22:17:11.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:10 smithi187 ceph-mon[96918]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-07-21T22:17:11.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:10 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/513285418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:11.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:10 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/916211517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:11.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:10 smithi195 ceph-mon[97365]: osdmap e84: 12 total, 12 up, 12 in 2023-07-21T22:17:11.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:10 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/95996299' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-07-21T22:17:11.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:10 smithi195 ceph-mon[97365]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-07-21T22:17:11.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:10 smithi195 ceph-mon[97365]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-07-21T22:17:11.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:10 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/513285418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:11.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:10 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/916211517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:11.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:10 smithi151 ceph-mon[95510]: osdmap e84: 12 total, 12 up, 12 in 2023-07-21T22:17:11.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:10 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/95996299' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2023-07-21T22:17:11.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:10 smithi151 ceph-mon[95510]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2023-07-21T22:17:11.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:10 smithi151 ceph-mon[95510]: daemon mds.b is now active in filesystem cephfs as rank 0 2023-07-21T22:17:11.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:10 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/513285418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:11.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:10 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/916211517' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:11.348 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:11.304+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fc1b802c850 con 0x7fc1b8100ce0 2023-07-21T22:17:12.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:11 smithi187 ceph-mon[96918]: osdmap e85: 12 total, 12 up, 12 in 2023-07-21T22:17:12.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:11 smithi187 ceph-mon[96918]: pgmap v299: 97 pgs: 14 creating+peering, 29 active+clean, 54 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2023-07-21T22:17:12.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:11 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] up:active 2023-07-21T22:17:12.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:11 smithi187 ceph-mon[96918]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:12.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:11 smithi187 ceph-mon[96918]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:12.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:11 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3339379232' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-21T22:17:12.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:11 smithi195 ceph-mon[97365]: osdmap e85: 12 total, 12 up, 12 in 2023-07-21T22:17:12.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:11 smithi195 ceph-mon[97365]: pgmap v299: 97 pgs: 14 creating+peering, 29 active+clean, 54 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2023-07-21T22:17:12.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:11 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] up:active 2023-07-21T22:17:12.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:11 smithi195 ceph-mon[97365]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:12.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:11 smithi195 ceph-mon[97365]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:12.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:11 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3339379232' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-21T22:17:12.198 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:11 smithi151 ceph-mon[95510]: osdmap e85: 12 total, 12 up, 12 in 2023-07-21T22:17:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:11 smithi151 ceph-mon[95510]: pgmap v299: 97 pgs: 14 creating+peering, 29 active+clean, 54 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 4 op/s 2023-07-21T22:17:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:11 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] up:active 2023-07-21T22:17:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:11 smithi151 ceph-mon[95510]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:11 smithi151 ceph-mon[95510]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:12.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:11 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3339379232' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2023-07-21T22:17:12.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.169+0000 7fc1bc9fd700 1 -- 172.21.15.151:0/3339379232 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) v1 ==== 118+0+0 (secure 0 0 0) 0x7fc1a0099450 con 0x7fc1b8100ce0 2023-07-21T22:17:12.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc1a40a1150 msgr2=0x7fc1a40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:12.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc1a40a1150 0x7fc1a40a3600 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc1b8100b40 tx=0x7fc1a8007400 comp rx=0 tx=0).stop 2023-07-21T22:17:12.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8100ce0 msgr2=0x7fc1b8072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8100ce0 0x7fc1b8072900 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fc1a000d950 tx=0x7fc1a000dc60 comp rx=0 tx=0).stop 2023-07-21T22:17:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 shutdown_connections 2023-07-21T22:17:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc1a40a1150 0x7fc1a40a3600 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1b80ffaf0 0x7fc1b80742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc1b8101670 0x7fc1b8072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 --2- 172.21.15.151:0/3339379232 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1b8100ce0 0x7fc1b8072900 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 >> 172.21.15.151:0/3339379232 conn(0x7fc1b80fb130 msgr2=0x7fc1b8104190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:12.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 shutdown_connections 2023-07-21T22:17:12.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.172+0000 7fc1bd9ff700 1 -- 172.21.15.151:0/3339379232 wait complete. 2023-07-21T22:17:12.240 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2023-07-21T22:17:12.240 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2023-07-21T22:17:12.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.410+0000 7f7e151ff700 1 -- 172.21.15.151:0/3481163957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 msgr2=0x7f7e101029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:12.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.410+0000 7f7e151ff700 1 --2- 172.21.15.151:0/3481163957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 0x7f7e101029b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009990 tx=0x7f7e00009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.411+0000 7f7e151ff700 1 -- 172.21.15.151:0/3481163957 shutdown_connections 2023-07-21T22:17:12.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.411+0000 7f7e151ff700 1 --2- 172.21.15.151:0/3481163957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e10105810 0x7f7e10107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.411+0000 7f7e151ff700 1 --2- 172.21.15.151:0/3481163957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 0x7f7e101029b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.411+0000 7f7e151ff700 1 --2- 172.21.15.151:0/3481163957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e10102ef0 0x7f7e101052d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.411+0000 7f7e151ff700 1 -- 172.21.15.151:0/3481163957 >> 172.21.15.151:0/3481163957 conn(0x7f7e100fa070 msgr2=0x7f7e100fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:12.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.411+0000 7f7e151ff700 1 -- 172.21.15.151:0/3481163957 shutdown_connections 2023-07-21T22:17:12.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.411+0000 7f7e151ff700 1 -- 172.21.15.151:0/3481163957 wait complete. 2023-07-21T22:17:12.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e151ff700 1 Processor -- start 2023-07-21T22:17:12.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e151ff700 1 -- start start 2023-07-21T22:17:12.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e151ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 0x7f7e10197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:12.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e151ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e10102ef0 0x7f7e10197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:12.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e151ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e10105810 0x7f7e1019eec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:12.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e151ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1019f490 con 0x7f7e101005d0 2023-07-21T22:17:12.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e151ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1019f5d0 con 0x7f7e10105810 2023-07-21T22:17:12.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e151ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1019f760 con 0x7f7e10102ef0 2023-07-21T22:17:12.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e0ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 0x7f7e10197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:12.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e0ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 0x7f7e10197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39572/0 (socket says 172.21.15.151:39572) 2023-07-21T22:17:12.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e0ed9d700 1 -- 172.21.15.151:0/66707836 learned_addr learned my addr 172.21.15.151:0/66707836 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:12.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.412+0000 7f7e0f59e700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e10105810 0x7f7e1019eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:12.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7e0e59c700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e10102ef0 0x7f7e10197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:12.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7e0ed9d700 1 -- 172.21.15.151:0/66707836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e10102ef0 msgr2=0x7f7e10197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:12.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7e0ed9d700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e10102ef0 0x7f7e10197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7e0ed9d700 1 -- 172.21.15.151:0/66707836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e10105810 msgr2=0x7f7e1019eec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:12.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7e0ed9d700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e10105810 0x7f7e1019eec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:12.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7e0ed9d700 1 -- 172.21.15.151:0/66707836 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e000095f0 con 0x7f7e101005d0 2023-07-21T22:17:12.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7e0ed9d700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 0x7f7e10197910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7e000098e0 tx=0x7f7e00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:12.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7df7fff700 1 -- 172.21.15.151:0/66707836 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0001d070 con 0x7f7e101005d0 2023-07-21T22:17:12.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7df7fff700 1 -- 172.21.15.151:0/66707836 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7e0000be30 con 0x7f7e101005d0 2023-07-21T22:17:12.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e1019f9e0 con 0x7f7e101005d0 2023-07-21T22:17:12.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7df7fff700 1 -- 172.21.15.151:0/66707836 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e00022e00 con 0x7f7e101005d0 2023-07-21T22:17:12.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.413+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1019fe00 con 0x7f7e101005d0 2023-07-21T22:17:12.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.414+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e101073d0 con 0x7f7e101005d0 2023-07-21T22:17:12.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.418+0000 7f7df7fff700 1 -- 172.21.15.151:0/66707836 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7e0000b9a0 con 0x7f7e101005d0 2023-07-21T22:17:12.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.419+0000 7f7df7fff700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7df80a1150 0x7f7df80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:12.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.419+0000 7f7df7fff700 1 -- 172.21.15.151:0/66707836 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7e000ce130 con 0x7f7e101005d0 2023-07-21T22:17:12.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.419+0000 7f7e0e59c700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7df80a1150 0x7f7df80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:12.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.420+0000 7f7e0e59c700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7df80a1150 0x7f7df80a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e04005ea0 tx=0x7f7e04005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:12.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.421+0000 7f7df7fff700 1 -- 172.21.15.151:0/66707836 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f7e000979c0 con 0x7f7e101005d0 2023-07-21T22:17:12.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:12.676+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) v1 -- 0x7f7e1002c9e0 con 0x7f7e101005d0 2023-07-21T22:17:13.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.178+0000 7f7df7fff700 1 -- 172.21.15.151:0/66707836 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) v1 ==== 105+0+0 (secure 0 0 0) 0x7f7e0009afe0 con 0x7f7e101005d0 2023-07-21T22:17:13.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.181+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7df80a1150 msgr2=0x7f7df80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:13.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.181+0000 7f7e151ff700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7df80a1150 0x7f7df80a3600 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7e04005ea0 tx=0x7f7e04005e30 comp rx=0 tx=0).stop 2023-07-21T22:17:13.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.181+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 msgr2=0x7f7e10197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:13.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.181+0000 7f7e151ff700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 0x7f7e10197910 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7e000098e0 tx=0x7f7e00004730 comp rx=0 tx=0).stop 2023-07-21T22:17:13.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.181+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 shutdown_connections 2023-07-21T22:17:13.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.181+0000 7f7e151ff700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7df80a1150 0x7f7df80a3600 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.182+0000 7f7e151ff700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e10105810 0x7f7e1019eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.182+0000 7f7e151ff700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e101005d0 0x7f7e10197910 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.182+0000 7f7e151ff700 1 --2- 172.21.15.151:0/66707836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7e10102ef0 0x7f7e10197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.182+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 >> 172.21.15.151:0/66707836 conn(0x7f7e100fa070 msgr2=0x7f7e100fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:13.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.182+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 shutdown_connections 2023-07-21T22:17:13.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.182+0000 7f7e151ff700 1 -- 172.21.15.151:0/66707836 wait complete. 2023-07-21T22:17:13.247 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2023-07-21T22:17:13.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.408+0000 7fd5c19ff700 1 -- 172.21.15.151:0/2095492571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc101660 msgr2=0x7fd5bc107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:13.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.408+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/2095492571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc101660 0x7fd5bc107f20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400b0a0 tx=0x7fd5b400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.408+0000 7fd5c19ff700 1 -- 172.21.15.151:0/2095492571 shutdown_connections 2023-07-21T22:17:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.408+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/2095492571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5bc0ffae0 0x7fd5bc0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.408+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/2095492571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc101660 0x7fd5bc107f20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.408+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/2095492571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5bc100cd0 0x7fd5bc101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.408+0000 7fd5c19ff700 1 -- 172.21.15.151:0/2095492571 >> 172.21.15.151:0/2095492571 conn(0x7fd5bc0fb0e0 msgr2=0x7fd5bc0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.408+0000 7fd5c19ff700 1 -- 172.21.15.151:0/2095492571 shutdown_connections 2023-07-21T22:17:13.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.408+0000 7fd5c19ff700 1 -- 172.21.15.151:0/2095492571 wait complete. 2023-07-21T22:17:13.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.409+0000 7fd5c19ff700 1 Processor -- start 2023-07-21T22:17:13.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.409+0000 7fd5c19ff700 1 -- start start 2023-07-21T22:17:13.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.409+0000 7fd5c19ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5bc0ffae0 0x7fd5bc197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:13.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5c19ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc100cd0 0x7fd5bc197fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:13.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5c19ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5bc101660 0x7fd5bc19f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:13.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5c19ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc19f610 con 0x7fd5bc100cd0 2023-07-21T22:17:13.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5c19ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc19f750 con 0x7fd5bc0ffae0 2023-07-21T22:17:13.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5c19ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5bc19f8e0 con 0x7fd5bc101660 2023-07-21T22:17:13.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5baffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5bc0ffae0 0x7fd5bc197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5ba7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc100cd0 0x7fd5bc197fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5ba7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc100cd0 0x7fd5bc197fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39598/0 (socket says 172.21.15.151:39598) 2023-07-21T22:17:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5ba7fc700 1 -- 172.21.15.151:0/3675848446 learned_addr learned my addr 172.21.15.151:0/3675848446 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5bb7fe700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5bc101660 0x7fd5bc19f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5bb7fe700 1 -- 172.21.15.151:0/3675848446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5bc0ffae0 msgr2=0x7fd5bc197a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5bb7fe700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5bc0ffae0 0x7fd5bc197a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5bb7fe700 1 -- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc100cd0 msgr2=0x7fd5bc197fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:13.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5bb7fe700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc100cd0 0x7fd5bc197fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5bb7fe700 1 -- 172.21.15.151:0/3675848446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b4009d00 con 0x7fd5bc101660 2023-07-21T22:17:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5baffd700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5bc0ffae0 0x7fd5bc197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5ba7fc700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc100cd0 0x7fd5bc197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.410+0000 7fd5bb7fe700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5bc101660 0x7fd5bc19f040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009fd0 tx=0x7fd5b4007870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.411+0000 7fd5c09fd700 1 -- 172.21.15.151:0/3675848446 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b400e040 con 0x7fd5bc101660 2023-07-21T22:17:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.411+0000 7fd5c09fd700 1 -- 172.21.15.151:0/3675848446 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5b4004c50 con 0x7fd5bc101660 2023-07-21T22:17:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.411+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5bc19fb60 con 0x7fd5bc101660 2023-07-21T22:17:13.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.411+0000 7fd5c09fd700 1 -- 172.21.15.151:0/3675848446 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4005040 con 0x7fd5bc101660 2023-07-21T22:17:13.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.411+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5bc19ffe0 con 0x7fd5bc101660 2023-07-21T22:17:13.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.412+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5bc192080 con 0x7fd5bc101660 2023-07-21T22:17:13.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.414+0000 7fd5c09fd700 1 -- 172.21.15.151:0/3675848446 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd5b401d470 con 0x7fd5bc101660 2023-07-21T22:17:13.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.415+0000 7fd5c09fd700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd5a40a11d0 0x7fd5a40a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:13.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.415+0000 7fd5c09fd700 1 -- 172.21.15.151:0/3675848446 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd5b40ce1a0 con 0x7fd5bc101660 2023-07-21T22:17:13.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.415+0000 7fd5baffd700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd5a40a11d0 0x7fd5a40a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:13.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.416+0000 7fd5baffd700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd5a40a11d0 0x7fd5a40a3680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc100b30 tx=0x7fd5ac009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:13.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.417+0000 7fd5c09fd700 1 -- 172.21.15.151:0/3675848446 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd5b4097be0 con 0x7fd5bc101660 2023-07-21T22:17:13.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3339379232' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-07-21T22:17:13.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:13.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/66707836' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-07-21T22:17:13.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:17:13.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:17:13.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3339379232' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-07-21T22:17:13.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:13.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/66707836' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-07-21T22:17:13.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:17:13.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:17:13.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3339379232' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2023-07-21T22:17:13.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:13.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/66707836' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2023-07-21T22:17:13.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:17:13.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:17:13.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:17:13.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:13.662+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7fd5bc02c850 con 0x7fd5bc101660 2023-07-21T22:17:14.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.185+0000 7fd5c09fd700 1 -- 172.21.15.151:0/3675848446 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) v1 ==== 121+0+0 (secure 0 0 0) 0x7fd5b409b200 con 0x7fd5bc101660 2023-07-21T22:17:14.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd5a40a11d0 msgr2=0x7fd5a40a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:14.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd5a40a11d0 0x7fd5a40a3680 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc100b30 tx=0x7fd5ac009260 comp rx=0 tx=0).stop 2023-07-21T22:17:14.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5bc101660 msgr2=0x7fd5bc19f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:14.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5bc101660 0x7fd5bc19f040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4009fd0 tx=0x7fd5b4007870 comp rx=0 tx=0).stop 2023-07-21T22:17:14.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 shutdown_connections 2023-07-21T22:17:14.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd5a40a11d0 0x7fd5a40a3680 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5bc0ffae0 0x7fd5bc197a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5bc101660 0x7fd5bc19f040 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 --2- 172.21.15.151:0/3675848446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5bc100cd0 0x7fd5bc197fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 >> 172.21.15.151:0/3675848446 conn(0x7fd5bc0fb0e0 msgr2=0x7fd5bc1065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:14.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 shutdown_connections 2023-07-21T22:17:14.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.188+0000 7fd5c19ff700 1 -- 172.21.15.151:0/3675848446 wait complete. 2023-07-21T22:17:14.257 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2023-07-21T22:17:14.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.415+0000 7fb9f83ff700 1 -- 172.21.15.151:0/2956386812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0102ef0 msgr2=0x7fb9f0103340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:14.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.415+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/2956386812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0102ef0 0x7fb9f0103340 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fb9e0009990 tx=0x7fb9e0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.415+0000 7fb9f83ff700 1 -- 172.21.15.151:0/2956386812 shutdown_connections 2023-07-21T22:17:14.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.415+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/2956386812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9f0101d00 0x7fb9f0102110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.415+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/2956386812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f0103880 0x7fb9f010a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.415+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/2956386812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0102ef0 0x7fb9f0103340 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.415+0000 7fb9f83ff700 1 -- 172.21.15.151:0/2956386812 >> 172.21.15.151:0/2956386812 conn(0x7fb9f00fd360 msgr2=0x7fb9f00ff770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.416+0000 7fb9f83ff700 1 -- 172.21.15.151:0/2956386812 shutdown_connections 2023-07-21T22:17:14.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.416+0000 7fb9f83ff700 1 -- 172.21.15.151:0/2956386812 wait complete. 2023-07-21T22:17:14.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.417+0000 7fb9f83ff700 1 Processor -- start 2023-07-21T22:17:14.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.417+0000 7fb9f83ff700 1 -- start start 2023-07-21T22:17:14.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.417+0000 7fb9f83ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9f0101d00 0x7fb9f0197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:14.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.417+0000 7fb9f83ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f0102ef0 0x7fb9f0197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:14.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.417+0000 7fb9f83ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0103880 0x7fb9f019ef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:14.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.417+0000 7fb9f83ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f019f500 con 0x7fb9f0103880 2023-07-21T22:17:14.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.417+0000 7fb9f83ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f019f640 con 0x7fb9f0101d00 2023-07-21T22:17:14.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.417+0000 7fb9f83ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9f019f7d0 con 0x7fb9f0102ef0 2023-07-21T22:17:14.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0103880 0x7fb9f019ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:14.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0103880 0x7fb9f019ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39624/0 (socket says 172.21.15.151:39624) 2023-07-21T22:17:14.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f699c700 1 -- 172.21.15.151:0/77164710 learned_addr learned my addr 172.21.15.151:0/77164710 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:14.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f619b700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9f0101d00 0x7fb9f0197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:14.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f599a700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f0102ef0 0x7fb9f0197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:14.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f699c700 1 -- 172.21.15.151:0/77164710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f0102ef0 msgr2=0x7fb9f0197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:14.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f699c700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f0102ef0 0x7fb9f0197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f699c700 1 -- 172.21.15.151:0/77164710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9f0101d00 msgr2=0x7fb9f0197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:14.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f699c700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9f0101d00 0x7fb9f0197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:14.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f699c700 1 -- 172.21.15.151:0/77164710 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9e00095f0 con 0x7fb9f0103880 2023-07-21T22:17:14.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f599a700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f0102ef0 0x7fb9f0197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:17:14.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.418+0000 7fb9f699c700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0103880 0x7fb9f019ef30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800ef30 tx=0x7fb9e800c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.419+0000 7fb9e77fe700 1 -- 172.21.15.151:0/77164710 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8018070 con 0x7fb9f0103880 2023-07-21T22:17:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.419+0000 7fb9e77fe700 1 -- 172.21.15.151:0/77164710 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb9e800f040 con 0x7fb9f0103880 2023-07-21T22:17:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.419+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9f019fa50 con 0x7fb9f0103880 2023-07-21T22:17:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.419+0000 7fb9e77fe700 1 -- 172.21.15.151:0/77164710 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9e8003d00 con 0x7fb9f0103880 2023-07-21T22:17:14.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.419+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9f019ffb0 con 0x7fb9f0103880 2023-07-21T22:17:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.420+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9f0108c50 con 0x7fb9f0103880 2023-07-21T22:17:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.422+0000 7fb9e77fe700 1 -- 172.21.15.151:0/77164710 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb9e800caa0 con 0x7fb9f0103880 2023-07-21T22:17:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.423+0000 7fb9e77fe700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb9dc0a11d0 0x7fb9dc0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.423+0000 7fb9e77fe700 1 -- 172.21.15.151:0/77164710 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fb9e80cc4b0 con 0x7fb9f0103880 2023-07-21T22:17:14.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.423+0000 7fb9f619b700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb9dc0a11d0 0x7fb9dc0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:14.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.424+0000 7fb9f619b700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb9dc0a11d0 0x7fb9dc0a3680 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec005950 tx=0x7fb9ec0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:14.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.427+0000 7fb9e77fe700 1 -- 172.21.15.151:0/77164710 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fb9e8095d40 con 0x7fb9f0103880 2023-07-21T22:17:14.628 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-b[122412]: 2023-07-21T22:17:14.256+0000 7f7b24b22700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-07-21T22:17:14.628 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-b[122412]: 2023-07-21T22:17:14.256+0000 7f7b24b22700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2023-07-21T22:17:14.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-mon[96918]: pgmap v300: 97 pgs: 14 creating+peering, 72 active+clean, 11 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 408 B/s wr, 5 op/s 2023-07-21T22:17:14.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-mon[96918]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-07-21T22:17:14.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/66707836' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-07-21T22:17:14.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-mon[96918]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-07-21T22:17:14.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-mon[96918]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:14.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-mon[96918]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-07-21T22:17:14.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-mon[96918]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-07-21T22:17:14.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3675848446' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-21T22:17:14.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:14 smithi187 ceph-mon[96918]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-21T22:17:14.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:14 smithi195 ceph-mon[97365]: pgmap v300: 97 pgs: 14 creating+peering, 72 active+clean, 11 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 408 B/s wr, 5 op/s 2023-07-21T22:17:14.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:14 smithi195 ceph-mon[97365]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-07-21T22:17:14.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:14 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/66707836' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-07-21T22:17:14.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:14 smithi195 ceph-mon[97365]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-07-21T22:17:14.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:14 smithi195 ceph-mon[97365]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:14.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:14 smithi195 ceph-mon[97365]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-07-21T22:17:14.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:14 smithi195 ceph-mon[97365]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-07-21T22:17:14.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:14 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3675848446' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-21T22:17:14.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:14 smithi195 ceph-mon[97365]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-21T22:17:14.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:14 smithi151 ceph-mon[95510]: pgmap v300: 97 pgs: 14 creating+peering, 72 active+clean, 11 unknown; 577 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 408 B/s wr, 5 op/s 2023-07-21T22:17:14.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:14 smithi151 ceph-mon[95510]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2023-07-21T22:17:14.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:14 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/66707836' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2023-07-21T22:17:14.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:14 smithi151 ceph-mon[95510]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2023-07-21T22:17:14.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:14 smithi151 ceph-mon[95510]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2023-07-21T22:17:14.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:14 smithi151 ceph-mon[95510]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2023-07-21T22:17:14.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:14 smithi151 ceph-mon[95510]: daemon mds.i is now active in filesystem cephfs as rank 1 2023-07-21T22:17:14.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:14 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3675848446' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-21T22:17:14.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:14 smithi151 ceph-mon[95510]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2023-07-21T22:17:14.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:14.672+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fb9f002c850 con 0x7fb9f0103880 2023-07-21T22:17:15.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.193+0000 7fb9e77fe700 1 -- 172.21.15.151:0/77164710 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v22) v1 ==== 115+0+0 (secure 0 0 0) 0x7fb9e8099360 con 0x7fb9f0103880 2023-07-21T22:17:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb9dc0a11d0 msgr2=0x7fb9dc0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb9dc0a11d0 0x7fb9dc0a3680 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec005950 tx=0x7fb9ec0058e0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0103880 msgr2=0x7fb9f019ef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0103880 0x7fb9f019ef30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb9e800ef30 tx=0x7fb9e800c450 comp rx=0 tx=0).stop 2023-07-21T22:17:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 shutdown_connections 2023-07-21T22:17:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb9dc0a11d0 0x7fb9dc0a3680 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9f0101d00 0x7fb9f0197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9f0103880 0x7fb9f019ef30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 --2- 172.21.15.151:0/77164710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb9f0102ef0 0x7fb9f0197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 >> 172.21.15.151:0/77164710 conn(0x7fb9f00fd360 msgr2=0x7fb9f0100620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 shutdown_connections 2023-07-21T22:17:15.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.196+0000 7fb9f83ff700 1 -- 172.21.15.151:0/77164710 wait complete. 2023-07-21T22:17:15.260 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2023-07-21T22:17:15.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 '' 2023-07-21T22:17:15.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.418+0000 7fc29e1ff700 1 -- 172.21.15.151:0/1778272139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298100ce0 msgr2=0x7fc298101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.418+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/1778272139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298100ce0 0x7fc298101130 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fc28c009990 tx=0x7fc28c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.418+0000 7fc29e1ff700 1 -- 172.21.15.151:0/1778272139 shutdown_connections 2023-07-21T22:17:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.418+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/1778272139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2980ffaf0 0x7fc2980fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.418+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/1778272139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc298101670 0x7fc298107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.418+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/1778272139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298100ce0 0x7fc298101130 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.418+0000 7fc29e1ff700 1 -- 172.21.15.151:0/1778272139 >> 172.21.15.151:0/1778272139 conn(0x7fc2980fb130 msgr2=0x7fc2980fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.419+0000 7fc29e1ff700 1 -- 172.21.15.151:0/1778272139 shutdown_connections 2023-07-21T22:17:15.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.419+0000 7fc29e1ff700 1 -- 172.21.15.151:0/1778272139 wait complete. 2023-07-21T22:17:15.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.419+0000 7fc29e1ff700 1 Processor -- start 2023-07-21T22:17:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc29e1ff700 1 -- start start 2023-07-21T22:17:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc29e1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2980ffaf0 0x7fc298197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc29e1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc298100ce0 0x7fc298197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc29e1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298101670 0x7fc29819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc29e1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29819f4e0 con 0x7fc298101670 2023-07-21T22:17:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc29e1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29819f620 con 0x7fc298100ce0 2023-07-21T22:17:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc29e1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc29819f7b0 con 0x7fc2980ffaf0 2023-07-21T22:17:15.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc297fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298101670 0x7fc29819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc297fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298101670 0x7fc29819ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39630/0 (socket says 172.21.15.151:39630) 2023-07-21T22:17:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc297fff700 1 -- 172.21.15.151:0/3734684546 learned_addr learned my addr 172.21.15.151:0/3734684546 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc296ffd700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc298100ce0 0x7fc298197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc297fff700 1 -- 172.21.15.151:0/3734684546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2980ffaf0 msgr2=0x7fc298197960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.420+0000 7fc2977fe700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2980ffaf0 0x7fc298197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc297fff700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2980ffaf0 0x7fc298197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc297fff700 1 -- 172.21.15.151:0/3734684546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc298100ce0 msgr2=0x7fc298197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc297fff700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc298100ce0 0x7fc298197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc297fff700 1 -- 172.21.15.151:0/3734684546 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0095f0 con 0x7fc298101670 2023-07-21T22:17:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc296ffd700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc298100ce0 0x7fc298197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc297fff700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298101670 0x7fc29819ef10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc29000ef30 tx=0x7fc29000c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc294ff9700 1 -- 172.21.15.151:0/3734684546 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290018070 con 0x7fc298101670 2023-07-21T22:17:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc29819fa30 con 0x7fc298101670 2023-07-21T22:17:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc294ff9700 1 -- 172.21.15.151:0/3734684546 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc29000f040 con 0x7fc298101670 2023-07-21T22:17:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc294ff9700 1 -- 172.21.15.151:0/3734684546 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc290003ce0 con 0x7fc298101670 2023-07-21T22:17:15.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.421+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc29819ff90 con 0x7fc298101670 2023-07-21T22:17:15.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.422+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29810b1c0 con 0x7fc298101670 2023-07-21T22:17:15.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.424+0000 7fc294ff9700 1 -- 172.21.15.151:0/3734684546 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fc29000caa0 con 0x7fc298101670 2023-07-21T22:17:15.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.426+0000 7fc294ff9700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2800a1150 0x7fc2800a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:15.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.426+0000 7fc294ff9700 1 -- 172.21.15.151:0/3734684546 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fc2900cc420 con 0x7fc298101670 2023-07-21T22:17:15.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.426+0000 7fc2977fe700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2800a1150 0x7fc2800a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.427+0000 7fc2977fe700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2800a1150 0x7fc2800a3600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc288005fd0 tx=0x7fc288005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.430+0000 7fc294ff9700 1 -- 172.21.15.151:0/3734684546 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fc290095d50 con 0x7fc298101670 2023-07-21T22:17:15.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:15 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] up:active 2023-07-21T22:17:15.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:15 smithi187 ceph-mon[96918]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-07-21T22:17:15.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:15 smithi187 ceph-mon[96918]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-07-21T22:17:15.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:15 smithi187 ceph-mon[96918]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-07-21T22:17:15.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:15 smithi187 ceph-mon[96918]: Cluster is now healthy 2023-07-21T22:17:15.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:15 smithi187 ceph-mon[96918]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-07-21T22:17:15.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:15 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-07-21T22:17:15.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:15 smithi187 ceph-mon[96918]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-07-21T22:17:15.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:15 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/77164710' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-07-21T22:17:15.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:15 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] up:active 2023-07-21T22:17:15.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:15 smithi195 ceph-mon[97365]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-07-21T22:17:15.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:15 smithi195 ceph-mon[97365]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-07-21T22:17:15.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:15 smithi195 ceph-mon[97365]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-07-21T22:17:15.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:15 smithi195 ceph-mon[97365]: Cluster is now healthy 2023-07-21T22:17:15.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:15 smithi195 ceph-mon[97365]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-07-21T22:17:15.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:15 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-07-21T22:17:15.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:15 smithi195 ceph-mon[97365]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-07-21T22:17:15.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:15 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/77164710' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-07-21T22:17:15.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] up:active 2023-07-21T22:17:15.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-mon[95510]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2023-07-21T22:17:15.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-mon[95510]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2023-07-21T22:17:15.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-mon[95510]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2023-07-21T22:17:15.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-mon[95510]: Cluster is now healthy 2023-07-21T22:17:15.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-mon[95510]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2023-07-21T22:17:15.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2023-07-21T22:17:15.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-mon[95510]: daemon mds.h is now active in filesystem cephfs as rank 2 2023-07-21T22:17:15.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/77164710' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2023-07-21T22:17:15.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.662+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7fc298107680 con 0x7fc2800a1150 2023-07-21T22:17:15.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.715+0000 7fc294ff9700 1 -- 172.21.15.151:0/3734684546 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fc298107680 con 0x7fc2800a1150 2023-07-21T22:17:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.717+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2800a1150 msgr2=0x7fc2800a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.717+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2800a1150 0x7fc2800a3600 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fc288005fd0 tx=0x7fc288005f60 comp rx=0 tx=0).stop 2023-07-21T22:17:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298101670 msgr2=0x7fc29819ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298101670 0x7fc29819ef10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc29000ef30 tx=0x7fc29000c450 comp rx=0 tx=0).stop 2023-07-21T22:17:15.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 shutdown_connections 2023-07-21T22:17:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc2800a1150 0x7fc2800a3600 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc298101670 0x7fc29819ef10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc2980ffaf0 0x7fc298197960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 --2- 172.21.15.151:0/3734684546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc298100ce0 0x7fc298197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 >> 172.21.15.151:0/3734684546 conn(0x7fc2980fb130 msgr2=0x7fc2980fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 shutdown_connections 2023-07-21T22:17:15.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.718+0000 7fc29e1ff700 1 -- 172.21.15.151:0/3734684546 wait complete. 2023-07-21T22:17:15.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_0 2023-07-21T22:17:15.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.944+0000 7fabd55ff700 1 -- 172.21.15.151:0/1316210141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd0101660 msgr2=0x7fabd0107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.944+0000 7fabd55ff700 1 --2- 172.21.15.151:0/1316210141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd0101660 0x7fabd0107f20 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fabc800b0a0 tx=0x7fabc800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.944+0000 7fabd55ff700 1 -- 172.21.15.151:0/1316210141 shutdown_connections 2023-07-21T22:17:15.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.944+0000 7fabd55ff700 1 --2- 172.21.15.151:0/1316210141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd0101660 0x7fabd0107f20 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.944+0000 7fabd55ff700 1 --2- 172.21.15.151:0/1316210141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabd00ffae0 0x7fabd00ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.944+0000 7fabd55ff700 1 --2- 172.21.15.151:0/1316210141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0100cd0 0x7fabd0101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.944+0000 7fabd55ff700 1 -- 172.21.15.151:0/1316210141 >> 172.21.15.151:0/1316210141 conn(0x7fabd00fb0e0 msgr2=0x7fabd00fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:15.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.944+0000 7fabd55ff700 1 -- 172.21.15.151:0/1316210141 shutdown_connections 2023-07-21T22:17:15.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.944+0000 7fabd55ff700 1 -- 172.21.15.151:0/1316210141 wait complete. 2023-07-21T22:17:15.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.945+0000 7fabd55ff700 1 Processor -- start 2023-07-21T22:17:15.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.945+0000 7fabd55ff700 1 -- start start 2023-07-21T22:17:15.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabd55ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd00ffae0 0x7fabd01958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:15.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabd55ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabd0100cd0 0x7fabd0195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:15.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabd55ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101660 0x7fabd019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:15.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabd55ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd019d420 con 0x7fabd00ffae0 2023-07-21T22:17:15.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabd55ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd019d560 con 0x7fabd0101660 2023-07-21T22:17:15.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabd55ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabd019d6f0 con 0x7fabd0100cd0 2023-07-21T22:17:15.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd00ffae0 0x7fabd01958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:15.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd00ffae0 0x7fabd01958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53076/0 (socket says 172.21.15.151:53076) 2023-07-21T22:17:15.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabceffd700 1 -- 172.21.15.151:0/285708068 learned_addr learned my addr 172.21.15.151:0/285708068 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:15.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabce7fc700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabd0100cd0 0x7fabd0195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:15.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabceffd700 1 -- 172.21.15.151:0/285708068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabd0100cd0 msgr2=0x7fabd0195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabceffd700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabd0100cd0 0x7fabd0195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabceffd700 1 -- 172.21.15.151:0/285708068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101660 msgr2=0x7fabd019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:15.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabceffd700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101660 0x7fabd019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:15.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.946+0000 7fabceffd700 1 -- 172.21.15.151:0/285708068 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabc8009d00 con 0x7fabd00ffae0 2023-07-21T22:17:15.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.947+0000 7fabceffd700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd00ffae0 0x7fabd01958a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fabc000e970 tx=0x7fabc000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:15.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.947+0000 7fabb7fff700 1 -- 172.21.15.151:0/285708068 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0009790 con 0x7fabd00ffae0 2023-07-21T22:17:15.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.947+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabd019d9d0 con 0x7fabd00ffae0 2023-07-21T22:17:15.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.947+0000 7fabb7fff700 1 -- 172.21.15.151:0/285708068 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fabc00044b0 con 0x7fabd00ffae0 2023-07-21T22:17:15.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.947+0000 7fabb7fff700 1 -- 172.21.15.151:0/285708068 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabc0003dd0 con 0x7fabd00ffae0 2023-07-21T22:17:15.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.947+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabd019df30 con 0x7fabd00ffae0 2023-07-21T22:17:15.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.948+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabd010b1c0 con 0x7fabd00ffae0 2023-07-21T22:17:15.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.950+0000 7fabb7fff700 1 -- 172.21.15.151:0/285708068 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fabc0003f30 con 0x7fabd00ffae0 2023-07-21T22:17:15.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.951+0000 7fabb7fff700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fabb80a11d0 0x7fabb80a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:15.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.952+0000 7fabb7fff700 1 -- 172.21.15.151:0/285708068 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fabc0014070 con 0x7fabd00ffae0 2023-07-21T22:17:15.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.952+0000 7fabce7fc700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fabb80a11d0 0x7fabb80a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:15.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.952+0000 7fabce7fc700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fabb80a11d0 0x7fabb80a3680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabc4005950 tx=0x7fabc40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:15.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:15.955+0000 7fabb7fff700 1 -- 172.21.15.151:0/285708068 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fabc0096350 con 0x7fabd00ffae0 2023-07-21T22:17:16.199 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:17:15.670+0000 7f51a00b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:17:16.199 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:17:15.670+0000 7f51a00b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:17:16.199 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:17:15.670+0000 7f51a00b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:17:16.199 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:17:15.670+0000 7f51a00b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:17:16.199 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:17:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:17:15.670+0000 7f51a00b2700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:17:16.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.190+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) v1 -- 0x7fabd0060950 con 0x7fabb80a11d0 2023-07-21T22:17:16.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.195+0000 7fabb7fff700 1 -- 172.21.15.151:0/285708068 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7fabd0060950 con 0x7fabb80a11d0 2023-07-21T22:17:16.239 INFO:teuthology.orchestra.run.smithi151.stdout:/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935 2023-07-21T22:17:16.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fabb80a11d0 msgr2=0x7fabb80a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fabb80a11d0 0x7fabb80a3680 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fabc4005950 tx=0x7fabc40058e0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd00ffae0 msgr2=0x7fabd01958a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd00ffae0 0x7fabd01958a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fabc000e970 tx=0x7fabc000ed30 comp rx=0 tx=0).stop 2023-07-21T22:17:16.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 shutdown_connections 2023-07-21T22:17:16.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fabb80a11d0 0x7fabb80a3680 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabd0101660 0x7fabd019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fabd00ffae0 0x7fabd01958a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 --2- 172.21.15.151:0/285708068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fabd0100cd0 0x7fabd0195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.197+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 >> 172.21.15.151:0/285708068 conn(0x7fabd00fb0e0 msgr2=0x7fabd00fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:16.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.198+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 shutdown_connections 2023-07-21T22:17:16.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.198+0000 7fabd55ff700 1 -- 172.21.15.151:0/285708068 wait complete. 2023-07-21T22:17:16.261 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 '' 2023-07-21T22:17:16.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.420+0000 7f4b1adff700 1 -- 172.21.15.151:0/1530945045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14101670 msgr2=0x7f4b14107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.420+0000 7f4b1adff700 1 --2- 172.21.15.151:0/1530945045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14101670 0x7f4b14107f30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c00b0a0 tx=0x7f4b0c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.420+0000 7f4b1adff700 1 -- 172.21.15.151:0/1530945045 shutdown_connections 2023-07-21T22:17:16.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.420+0000 7f4b1adff700 1 --2- 172.21.15.151:0/1530945045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14101670 0x7f4b14107f30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.420+0000 7f4b1adff700 1 --2- 172.21.15.151:0/1530945045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b140ffaf0 0x7f4b140fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.420+0000 7f4b1adff700 1 --2- 172.21.15.151:0/1530945045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14100ce0 0x7f4b14101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.420+0000 7f4b1adff700 1 -- 172.21.15.151:0/1530945045 >> 172.21.15.151:0/1530945045 conn(0x7f4b140fb130 msgr2=0x7f4b140fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:16.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.420+0000 7f4b1adff700 1 -- 172.21.15.151:0/1530945045 shutdown_connections 2023-07-21T22:17:16.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.420+0000 7f4b1adff700 1 -- 172.21.15.151:0/1530945045 wait complete. 2023-07-21T22:17:16.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.421+0000 7f4b1adff700 1 Processor -- start 2023-07-21T22:17:16.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.421+0000 7f4b1adff700 1 -- start start 2023-07-21T22:17:16.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b1adff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b140ffaf0 0x7f4b14195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:16.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b1adff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14100ce0 0x7f4b14195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:16.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b1adff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14101670 0x7f4b1419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:16.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b1adff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1419d3f0 con 0x7f4b14100ce0 2023-07-21T22:17:16.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b1adff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1419d530 con 0x7f4b14101670 2023-07-21T22:17:16.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b1adff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1419d6c0 con 0x7f4b140ffaf0 2023-07-21T22:17:16.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b13fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14100ce0 0x7f4b14195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:16.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b13fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14100ce0 0x7f4b14195db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53088/0 (socket says 172.21.15.151:53088) 2023-07-21T22:17:16.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b13fff700 1 -- 172.21.15.151:0/3556307676 learned_addr learned my addr 172.21.15.151:0/3556307676 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:16.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b18b9b700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b140ffaf0 0x7f4b14195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:16.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b1939c700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14101670 0x7f4b1419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:16.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b13fff700 1 -- 172.21.15.151:0/3556307676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b140ffaf0 msgr2=0x7f4b14195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b13fff700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b140ffaf0 0x7f4b14195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b13fff700 1 -- 172.21.15.151:0/3556307676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14101670 msgr2=0x7f4b1419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b13fff700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14101670 0x7f4b1419ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b13fff700 1 -- 172.21.15.151:0/3556307676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009d00 con 0x7f4b14100ce0 2023-07-21T22:17:16.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.422+0000 7f4b1939c700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14101670 0x7f4b1419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:17:16.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.423+0000 7f4b13fff700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14100ce0 0x7f4b14195db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e9a0 tx=0x7f4b0000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:16.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.423+0000 7f4b11ffb700 1 -- 172.21.15.151:0/3556307676 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00009790 con 0x7f4b14100ce0 2023-07-21T22:17:16.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.423+0000 7f4b11ffb700 1 -- 172.21.15.151:0/3556307676 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b0000cbd0 con 0x7f4b14100ce0 2023-07-21T22:17:16.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.423+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b1419d9a0 con 0x7f4b14100ce0 2023-07-21T22:17:16.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.423+0000 7f4b11ffb700 1 -- 172.21.15.151:0/3556307676 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b00018680 con 0x7f4b14100ce0 2023-07-21T22:17:16.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.423+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b1419df00 con 0x7f4b14100ce0 2023-07-21T22:17:16.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.424+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b14107080 con 0x7f4b14100ce0 2023-07-21T22:17:16.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.426+0000 7f4b11ffb700 1 -- 172.21.15.151:0/3556307676 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f4b0000cd40 con 0x7f4b14100ce0 2023-07-21T22:17:16.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.427+0000 7f4b11ffb700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4b040a11d0 0x7f4b040a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:16.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.427+0000 7f4b11ffb700 1 -- 172.21.15.151:0/3556307676 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f4b00014070 con 0x7f4b14100ce0 2023-07-21T22:17:16.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.427+0000 7f4b18b9b700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4b040a11d0 0x7f4b040a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:16.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.428+0000 7f4b18b9b700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4b040a11d0 0x7f4b040a3680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4b14100b40 tx=0x7f4b08009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:16.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.431+0000 7f4b11ffb700 1 -- 172.21.15.151:0/3556307676 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f4b00051770 con 0x7f4b14100ce0 2023-07-21T22:17:16.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:16 smithi187 ceph-mon[96918]: pgmap v301: 97 pgs: 97 active+clean; 581 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s wr, 12 op/s 2023-07-21T22:17:16.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:16 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] up:active 2023-07-21T22:17:16.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:16 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/77164710' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-07-21T22:17:16.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:16 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-07-21T22:17:16.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:16 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:17:16.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:16 smithi195 ceph-mon[97365]: pgmap v301: 97 pgs: 97 active+clean; 581 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s wr, 12 op/s 2023-07-21T22:17:16.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:16 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] up:active 2023-07-21T22:17:16.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:16 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/77164710' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-07-21T22:17:16.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:16 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-07-21T22:17:16.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:16 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:17:16.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:16 smithi151 ceph-mon[95510]: pgmap v301: 97 pgs: 97 active+clean; 581 KiB data, 326 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s wr, 12 op/s 2023-07-21T22:17:16.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:16 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] up:active 2023-07-21T22:17:16.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:16 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/77164710' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2023-07-21T22:17:16.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:16 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2023-07-21T22:17:16.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:16 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:17:16.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.660+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}) v1 -- 0x7f4b14060950 con 0x7f4b040a11d0 2023-07-21T22:17:16.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.688+0000 7f4b11ffb700 1 -- 172.21.15.151:0/3556307676 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f4b14060950 con 0x7f4b040a11d0 2023-07-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4b040a11d0 msgr2=0x7f4b040a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4b040a11d0 0x7f4b040a3680 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4b14100b40 tx=0x7f4b08009260 comp rx=0 tx=0).stop 2023-07-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14100ce0 msgr2=0x7f4b14195db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14100ce0 0x7f4b14195db0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4b0000e9a0 tx=0x7f4b0000ed60 comp rx=0 tx=0).stop 2023-07-21T22:17:16.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 shutdown_connections 2023-07-21T22:17:16.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4b040a11d0 0x7f4b040a3680 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14101670 0x7f4b1419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b140ffaf0 0x7f4b14195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 --2- 172.21.15.151:0/3556307676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b14100ce0 0x7f4b14195db0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 >> 172.21.15.151:0/3556307676 conn(0x7f4b140fb130 msgr2=0x7f4b141041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:16.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 shutdown_connections 2023-07-21T22:17:16.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.691+0000 7f4b1adff700 1 -- 172.21.15.151:0/3556307676 wait complete. 2023-07-21T22:17:16.754 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs sv_1 2023-07-21T22:17:16.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.914+0000 7ff12e3ff700 1 -- 172.21.15.151:0/195271643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff128100ce0 msgr2=0x7ff128101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.914+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/195271643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff128100ce0 0x7ff128101130 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009990 tx=0x7ff11c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.914+0000 7ff12e3ff700 1 -- 172.21.15.151:0/195271643 shutdown_connections 2023-07-21T22:17:16.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.914+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/195271643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff128101670 0x7ff128107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.914+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/195271643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff1280ffaf0 0x7ff1280fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.914+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/195271643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff128100ce0 0x7ff128101130 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.914+0000 7ff12e3ff700 1 -- 172.21.15.151:0/195271643 >> 172.21.15.151:0/195271643 conn(0x7ff1280fb130 msgr2=0x7ff1280fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:16.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.914+0000 7ff12e3ff700 1 -- 172.21.15.151:0/195271643 shutdown_connections 2023-07-21T22:17:16.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.915+0000 7ff12e3ff700 1 -- 172.21.15.151:0/195271643 wait complete. 2023-07-21T22:17:16.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.915+0000 7ff12e3ff700 1 Processor -- start 2023-07-21T22:17:16.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff12e3ff700 1 -- start start 2023-07-21T22:17:16.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff12e3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1280ffaf0 0x7ff1281979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:16.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff12e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff128100ce0 0x7ff128197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:16.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff12e3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff128101670 0x7ff12819efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:16.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff12e3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12819f570 con 0x7ff1280ffaf0 2023-07-21T22:17:16.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff12e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12819f6b0 con 0x7ff128100ce0 2023-07-21T22:17:16.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff12e3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff12819f840 con 0x7ff128101670 2023-07-21T22:17:16.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff127fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1280ffaf0 0x7ff1281979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:16.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff127fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1280ffaf0 0x7ff1281979f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53118/0 (socket says 172.21.15.151:53118) 2023-07-21T22:17:16.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff127fff700 1 -- 172.21.15.151:0/3024554444 learned_addr learned my addr 172.21.15.151:0/3024554444 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff12c99c700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff128101670 0x7ff12819efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.916+0000 7ff1277fe700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff128100ce0 0x7ff128197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff127fff700 1 -- 172.21.15.151:0/3024554444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff128101670 msgr2=0x7ff12819efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff127fff700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff128101670 0x7ff12819efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff127fff700 1 -- 172.21.15.151:0/3024554444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff128100ce0 msgr2=0x7ff128197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff127fff700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff128100ce0 0x7ff128197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff127fff700 1 -- 172.21.15.151:0/3024554444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff11c0095f0 con 0x7ff1280ffaf0 2023-07-21T22:17:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff127fff700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1280ffaf0 0x7ff1281979f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff11800d980 tx=0x7ff11800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:16.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff1257fa700 1 -- 172.21.15.151:0/3024554444 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff118004020 con 0x7ff1280ffaf0 2023-07-21T22:17:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff1257fa700 1 -- 172.21.15.151:0/3024554444 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff11800f690 con 0x7ff1280ffaf0 2023-07-21T22:17:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12819fb20 con 0x7ff1280ffaf0 2023-07-21T22:17:16.970 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff1257fa700 1 -- 172.21.15.151:0/3024554444 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1180039e0 con 0x7ff1280ffaf0 2023-07-21T22:17:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.917+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1281a0080 con 0x7ff1280ffaf0 2023-07-21T22:17:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.918+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff128192100 con 0x7ff1280ffaf0 2023-07-21T22:17:16.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.920+0000 7ff1257fa700 1 -- 172.21.15.151:0/3024554444 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff11800f800 con 0x7ff1280ffaf0 2023-07-21T22:17:16.972 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.921+0000 7ff1257fa700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff1100a11d0 0x7ff1100a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:16.972 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.922+0000 7ff1257fa700 1 -- 172.21.15.151:0/3024554444 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7ff1180cc3e0 con 0x7ff1280ffaf0 2023-07-21T22:17:16.972 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.922+0000 7ff1277fe700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff1100a11d0 0x7ff1100a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:16.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.922+0000 7ff1277fe700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff1100a11d0 0x7ff1100a3680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c010 tx=0x7ff11c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:16.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:16.925+0000 7ff1257fa700 1 -- 172.21.15.151:0/3024554444 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ff118095be0 con 0x7ff1280ffaf0 2023-07-21T22:17:17.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.161+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff128060950 con 0x7ff1100a11d0 2023-07-21T22:17:17.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.166+0000 7ff1257fa700 1 -- 172.21.15.151:0/3024554444 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+60 (secure 0 0 0) 0x7ff128060950 con 0x7ff1100a11d0 2023-07-21T22:17:17.210 INFO:teuthology.orchestra.run.smithi151.stdout:/volumes/_nogroup/sv_1/3b03c308-e998-4338-9c25-83e9b87282b9 2023-07-21T22:17:17.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff1100a11d0 msgr2=0x7ff1100a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff1100a11d0 0x7ff1100a3680 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff11c00c010 tx=0x7ff11c005fb0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1280ffaf0 msgr2=0x7ff1281979f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1280ffaf0 0x7ff1281979f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff11800d980 tx=0x7ff11800dc90 comp rx=0 tx=0).stop 2023-07-21T22:17:17.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 shutdown_connections 2023-07-21T22:17:17.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff1100a11d0 0x7ff1100a3680 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff128101670 0x7ff12819efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1280ffaf0 0x7ff1281979f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 --2- 172.21.15.151:0/3024554444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff128100ce0 0x7ff128197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 >> 172.21.15.151:0/3024554444 conn(0x7ff1280fb130 msgr2=0x7ff128106630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:17.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 shutdown_connections 2023-07-21T22:17:17.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.168+0000 7ff12e3ff700 1 -- 172.21.15.151:0/3024554444 wait complete. 2023-07-21T22:17:17.231 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:17:17.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.392+0000 7fa35cbff700 1 -- 172.21.15.151:0/2885000768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358101680 msgr2=0x7fa358107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.392+0000 7fa35cbff700 1 --2- 172.21.15.151:0/2885000768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358101680 0x7fa358107f40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fa35000b0a0 tx=0x7fa35000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.392+0000 7fa35cbff700 1 -- 172.21.15.151:0/2885000768 shutdown_connections 2023-07-21T22:17:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.392+0000 7fa35cbff700 1 --2- 172.21.15.151:0/2885000768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358101680 0x7fa358107f40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.392+0000 7fa35cbff700 1 --2- 172.21.15.151:0/2885000768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3580ffb00 0x7fa3580fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.392+0000 7fa35cbff700 1 --2- 172.21.15.151:0/2885000768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa358100cf0 0x7fa358101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.392+0000 7fa35cbff700 1 -- 172.21.15.151:0/2885000768 >> 172.21.15.151:0/2885000768 conn(0x7fa3580fb0e0 msgr2=0x7fa3580fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.392+0000 7fa35cbff700 1 -- 172.21.15.151:0/2885000768 shutdown_connections 2023-07-21T22:17:17.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.392+0000 7fa35cbff700 1 -- 172.21.15.151:0/2885000768 wait complete. 2023-07-21T22:17:17.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.393+0000 7fa35cbff700 1 Processor -- start 2023-07-21T22:17:17.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.393+0000 7fa35cbff700 1 -- start start 2023-07-21T22:17:17.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.393+0000 7fa35cbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3580ffb00 0x7fa358197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:17.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.393+0000 7fa35cbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358100cf0 0x7fa358197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.393+0000 7fa35cbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa358101680 0x7fa35819eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa35cbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35819f5c0 con 0x7fa358100cf0 2023-07-21T22:17:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa35cbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35819f700 con 0x7fa358101680 2023-07-21T22:17:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa35cbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35819f890 con 0x7fa3580ffb00 2023-07-21T22:17:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa34ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358100cf0 0x7fa358197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa34ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358100cf0 0x7fa358197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53142/0 (socket says 172.21.15.151:53142) 2023-07-21T22:17:17.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa34ffff700 1 -- 172.21.15.151:0/72610857 learned_addr learned my addr 172.21.15.151:0/72610857 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa35659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3580ffb00 0x7fa358197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa356d9d700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa358101680 0x7fa35819eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa34ffff700 1 -- 172.21.15.151:0/72610857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3580ffb00 msgr2=0x7fa358197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa34ffff700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3580ffb00 0x7fa358197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa34ffff700 1 -- 172.21.15.151:0/72610857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa358101680 msgr2=0x7fa35819eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa34ffff700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa358101680 0x7fa35819eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa34ffff700 1 -- 172.21.15.151:0/72610857 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa350009d00 con 0x7fa358100cf0 2023-07-21T22:17:17.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa35659c700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3580ffb00 0x7fa358197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:17.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.394+0000 7fa34ffff700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358100cf0 0x7fa358197f80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa34000d980 tx=0x7fa34000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:17.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.395+0000 7fa34f7fe700 1 -- 172.21.15.151:0/72610857 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340004220 con 0x7fa358100cf0 2023-07-21T22:17:17.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.395+0000 7fa34f7fe700 1 -- 172.21.15.151:0/72610857 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa340007640 con 0x7fa358100cf0 2023-07-21T22:17:17.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.395+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa35819fb70 con 0x7fa358100cf0 2023-07-21T22:17:17.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.395+0000 7fa34f7fe700 1 -- 172.21.15.151:0/72610857 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa340005660 con 0x7fa358100cf0 2023-07-21T22:17:17.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.395+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3581a00d0 con 0x7fa358100cf0 2023-07-21T22:17:17.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.396+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35810b1e0 con 0x7fa358100cf0 2023-07-21T22:17:17.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.398+0000 7fa34f7fe700 1 -- 172.21.15.151:0/72610857 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa340004750 con 0x7fa358100cf0 2023-07-21T22:17:17.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.399+0000 7fa34f7fe700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3440a12a0 0x7fa3440a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.399+0000 7fa34f7fe700 1 -- 172.21.15.151:0/72610857 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa3400cc570 con 0x7fa358100cf0 2023-07-21T22:17:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.399+0000 7fa35659c700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3440a12a0 0x7fa3440a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:17.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.400+0000 7fa35659c700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3440a12a0 0x7fa3440a3750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa358100b50 tx=0x7fa348009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:17.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.403+0000 7fa34f7fe700 1 -- 172.21.15.151:0/72610857 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fa340095d10 con 0x7fa358100cf0 2023-07-21T22:17:17.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:17 smithi187 ceph-mon[96918]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:17.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:17 smithi187 ceph-mon[96918]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:17.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:17 smithi195 ceph-mon[97365]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:17.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:17 smithi195 ceph-mon[97365]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:17.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.648+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa3581a0680 con 0x7fa358100cf0 2023-07-21T22:17:17.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.649+0000 7fa34f7fe700 1 -- 172.21.15.151:0/72610857 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10816 (secure 0 0 0) 0x7fa340022350 con 0x7fa358100cf0 2023-07-21T22:17:17.693 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:17.693 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:17:15.194775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:17:17.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.651+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3440a12a0 msgr2=0x7fa3440a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.651+0000 7fa35cbff700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3440a12a0 0x7fa3440a3750 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa358100b50 tx=0x7fa348009260 comp rx=0 tx=0).stop 2023-07-21T22:17:17.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.651+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358100cf0 msgr2=0x7fa358197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.651+0000 7fa35cbff700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358100cf0 0x7fa358197f80 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fa34000d980 tx=0x7fa34000dc90 comp rx=0 tx=0).stop 2023-07-21T22:17:17.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.652+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 shutdown_connections 2023-07-21T22:17:17.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.652+0000 7fa35cbff700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3440a12a0 0x7fa3440a3750 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.652+0000 7fa35cbff700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa358101680 0x7fa35819eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.652+0000 7fa35cbff700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3580ffb00 0x7fa358197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.652+0000 7fa35cbff700 1 --2- 172.21.15.151:0/72610857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa358100cf0 0x7fa358197f80 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.652+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 >> 172.21.15.151:0/72610857 conn(0x7fa3580fb0e0 msgr2=0x7fa358106590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.652+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 shutdown_connections 2023-07-21T22:17:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.652+0000 7fa35cbff700 1 -- 172.21.15.151:0/72610857 wait complete. 2023-07-21T22:17:17.697 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 23 2023-07-21T22:17:17.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:17 smithi151 ceph-mon[95510]: from='client.14790 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:17.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:17 smithi151 ceph-mon[95510]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:17.715 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:17:17.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.873+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/1234645592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf40ffb00 msgr2=0x7f7cf40fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.873+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/1234645592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf40ffb00 0x7f7cf40fff10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7cf0009990 tx=0x7f7cf0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.874+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/1234645592 shutdown_connections 2023-07-21T22:17:17.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.874+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/1234645592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf4101680 0x7f7cf4107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.874+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/1234645592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf40ffb00 0x7f7cf40fff10 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.874+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/1234645592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cf4100cf0 0x7f7cf4101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.874+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/1234645592 >> 172.21.15.151:0/1234645592 conn(0x7f7cf40fb0e0 msgr2=0x7f7cf40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:17.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.874+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/1234645592 shutdown_connections 2023-07-21T22:17:17.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.874+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/1234645592 wait complete. 2023-07-21T22:17:17.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cfc7ff700 1 Processor -- start 2023-07-21T22:17:17.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cfc7ff700 1 -- start start 2023-07-21T22:17:17.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cfc7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cf40ffb00 0x7f7cf40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:17.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cfc7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf4100cf0 0x7f7cf4072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:17.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cfc7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf4101680 0x7f7cf4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:17.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cfc7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf40735e0 con 0x7f7cf4100cf0 2023-07-21T22:17:17.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cfc7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf4073750 con 0x7f7cf4101680 2023-07-21T22:17:17.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cfc7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf419f750 con 0x7f7cf40ffb00 2023-07-21T22:17:17.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cf9d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf4100cf0 0x7f7cf4072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:17.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cf9d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf4100cf0 0x7f7cf4072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53162/0 (socket says 172.21.15.151:53162) 2023-07-21T22:17:17.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cf9d9a700 1 -- 172.21.15.151:0/3782498302 learned_addr learned my addr 172.21.15.151:0/3782498302 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:17.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.875+0000 7f7cfad9c700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf4101680 0x7f7cf4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:17.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7cfa59b700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cf40ffb00 0x7f7cf40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:17.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7cf9d9a700 1 -- 172.21.15.151:0/3782498302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cf40ffb00 msgr2=0x7f7cf40742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7cf9d9a700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cf40ffb00 0x7f7cf40742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7cf9d9a700 1 -- 172.21.15.151:0/3782498302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf4101680 msgr2=0x7f7cf4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:17.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7cf9d9a700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf4101680 0x7f7cf4072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:17.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7cf9d9a700 1 -- 172.21.15.151:0/3782498302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf00095f0 con 0x7f7cf4100cf0 2023-07-21T22:17:17.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7cf9d9a700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf4100cf0 0x7f7cf4072900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400d950 tx=0x7f7ce400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:17.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7ceb7fe700 1 -- 172.21.15.151:0/3782498302 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400f890 con 0x7f7cf4100cf0 2023-07-21T22:17:17.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7ceb7fe700 1 -- 172.21.15.151:0/3782498302 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ce400fe80 con 0x7f7cf4100cf0 2023-07-21T22:17:17.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7ceb7fe700 1 -- 172.21.15.151:0/3782498302 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce400e3b0 con 0x7f7cf4100cf0 2023-07-21T22:17:17.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf419fa30 con 0x7f7cf4100cf0 2023-07-21T22:17:17.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.876+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf419ff40 con 0x7f7cf4100cf0 2023-07-21T22:17:17.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.877+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf4107070 con 0x7f7cf4100cf0 2023-07-21T22:17:17.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.879+0000 7f7ceb7fe700 1 -- 172.21.15.151:0/3782498302 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f7ce4010460 con 0x7f7cf4100cf0 2023-07-21T22:17:17.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.881+0000 7f7ceb7fe700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7ce00a12a0 0x7f7ce00a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:17.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.881+0000 7f7ceb7fe700 1 -- 172.21.15.151:0/3782498302 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f7ce40cc750 con 0x7f7cf4100cf0 2023-07-21T22:17:17.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.881+0000 7f7cfa59b700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7ce00a12a0 0x7f7ce00a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:17.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.881+0000 7f7cfa59b700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7ce00a12a0 0x7f7ce00a3750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000c010 tx=0x7f7cf0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:17.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:17.885+0000 7f7ceb7fe700 1 -- 172.21.15.151:0/3782498302 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f7ce4095df0 con 0x7f7cf4100cf0 2023-07-21T22:17:18.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.085+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7cf402caa0 con 0x7f7cf4100cf0 2023-07-21T22:17:18.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.087+0000 7f7ceb7fe700 1 -- 172.21.15.151:0/3782498302 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22175 (secure 0 0 0) 0x7f7ce4099410 con 0x7f7cf4100cf0 2023-07-21T22:17:18.131 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:18.131 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":85,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:10.821638+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:17:18.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7ce00a12a0 msgr2=0x7f7ce00a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7ce00a12a0 0x7f7ce00a3750 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7cf000c010 tx=0x7f7cf0005fb0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf4100cf0 msgr2=0x7f7cf4072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf4100cf0 0x7f7cf4072900 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ce400d950 tx=0x7f7ce400dc60 comp rx=0 tx=0).stop 2023-07-21T22:17:18.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 shutdown_connections 2023-07-21T22:17:18.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7ce00a12a0 0x7f7ce00a3750 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cf4101680 0x7f7cf4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7cf40ffb00 0x7f7cf40742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 --2- 172.21.15.151:0/3782498302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7cf4100cf0 0x7f7cf4072900 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.089+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 >> 172.21.15.151:0/3782498302 conn(0x7f7cf40fb0e0 msgr2=0x7f7cf41041b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:18.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.090+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 shutdown_connections 2023-07-21T22:17:18.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.090+0000 7f7cfc7ff700 1 -- 172.21.15.151:0/3782498302 wait complete. 2023-07-21T22:17:18.153 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-07-21T22:17:18.154 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:17:18.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.311+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/1195537052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18101680 msgr2=0x7f8a18107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.311+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/1195537052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18101680 0x7f8a18107f40 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f8a1000b0a0 tx=0x7f8a1000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.312+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/1195537052 shutdown_connections 2023-07-21T22:17:18.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.312+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/1195537052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a180ffb00 0x7f8a180fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.312+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/1195537052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18101680 0x7f8a18107f40 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.312+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/1195537052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a18100cf0 0x7f8a18101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.312+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/1195537052 >> 172.21.15.151:0/1195537052 conn(0x7f8a180fb0e0 msgr2=0x7f8a180fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:18.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.312+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/1195537052 shutdown_connections 2023-07-21T22:17:18.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.312+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/1195537052 wait complete. 2023-07-21T22:17:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a1e3ff700 1 Processor -- start 2023-07-21T22:17:18.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a1e3ff700 1 -- start start 2023-07-21T22:17:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a1e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a180ffb00 0x7f8a181958c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a1e3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18100cf0 0x7f8a18195e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a1e3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a18101680 0x7f8a1819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a1e3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1819d440 con 0x7f8a18100cf0 2023-07-21T22:17:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a1e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1819d580 con 0x7f8a180ffb00 2023-07-21T22:17:18.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a1e3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1819d710 con 0x7f8a18101680 2023-07-21T22:17:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a177fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18100cf0 0x7f8a18195e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a177fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18100cf0 0x7f8a18195e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53180/0 (socket says 172.21.15.151:53180) 2023-07-21T22:17:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a177fe700 1 -- 172.21.15.151:0/2374567660 learned_addr learned my addr 172.21.15.151:0/2374567660 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.313+0000 7f8a1c99c700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a18101680 0x7f8a1819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a177fe700 1 -- 172.21.15.151:0/2374567660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a18101680 msgr2=0x7f8a1819ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a177fe700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a18101680 0x7f8a1819ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a17fff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a180ffb00 0x7f8a181958c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:18.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a177fe700 1 -- 172.21.15.151:0/2374567660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a180ffb00 msgr2=0x7f8a181958c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a177fe700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a180ffb00 0x7f8a181958c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a177fe700 1 -- 172.21.15.151:0/2374567660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a10009d00 con 0x7f8a18100cf0 2023-07-21T22:17:18.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a1c99c700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a18101680 0x7f8a1819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:18.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a17fff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a180ffb00 0x7f8a181958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:17:18.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a177fe700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18100cf0 0x7f8a18195e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00e9a0 tx=0x7f8a0c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:18.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a157fa700 1 -- 172.21.15.151:0/2374567660 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c009790 con 0x7f8a18100cf0 2023-07-21T22:17:18.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a157fa700 1 -- 172.21.15.151:0/2374567660 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a0c00cbd0 con 0x7f8a18100cf0 2023-07-21T22:17:18.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1819d9f0 con 0x7f8a18100cf0 2023-07-21T22:17:18.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a157fa700 1 -- 172.21.15.151:0/2374567660 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c018680 con 0x7f8a18100cf0 2023-07-21T22:17:18.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.314+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1819df50 con 0x7f8a18100cf0 2023-07-21T22:17:18.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.315+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a18107040 con 0x7f8a18100cf0 2023-07-21T22:17:18.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.317+0000 7f8a157fa700 1 -- 172.21.15.151:0/2374567660 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8a0c00cd40 con 0x7f8a18100cf0 2023-07-21T22:17:18.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.319+0000 7f8a157fa700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8a000a12a0 0x7f8a000a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:18.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.319+0000 7f8a157fa700 1 -- 172.21.15.151:0/2374567660 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f8a0c014070 con 0x7f8a18100cf0 2023-07-21T22:17:18.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.319+0000 7f8a17fff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8a000a12a0 0x7f8a000a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:18.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.319+0000 7f8a17fff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8a000a12a0 0x7f8a000a3750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a08005d90 tx=0x7f8a08005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:18.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.323+0000 7f8a157fa700 1 -- 172.21.15.151:0/2374567660 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8a0c051770 con 0x7f8a18100cf0 2023-07-21T22:17:18.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:18 smithi151 ceph-mon[95510]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:18.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:18 smithi151 ceph-mon[95510]: pgmap v302: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 4.7 KiB/s wr, 14 op/s 2023-07-21T22:17:18.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:18 smithi151 ceph-mon[95510]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:18.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:18 smithi151 ceph-mon[95510]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-07-21T22:17:18.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:18 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/72610857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:18.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:18 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3782498302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:18.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.520+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a18060950 con 0x7f8a000a12a0 2023-07-21T22:17:18.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.533+0000 7f8a157fa700 1 -- 172.21.15.151:0/2374567660 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+334660 (secure 0 0 0) 0x7f8a18060950 con 0x7f8a000a12a0 2023-07-21T22:17:18.581 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8a000a12a0 msgr2=0x7f8a000a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8a000a12a0 0x7f8a000a3750 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f8a08005d90 tx=0x7f8a08005d00 comp rx=0 tx=0).stop 2023-07-21T22:17:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18100cf0 msgr2=0x7f8a18195e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18100cf0 0x7f8a18195e00 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00e9a0 tx=0x7f8a0c00ed60 comp rx=0 tx=0).stop 2023-07-21T22:17:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 shutdown_connections 2023-07-21T22:17:18.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8a000a12a0 0x7f8a000a3750 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a180ffb00 0x7f8a181958c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a18101680 0x7f8a1819ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 --2- 172.21.15.151:0/2374567660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a18100cf0 0x7f8a18195e00 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 >> 172.21.15.151:0/2374567660 conn(0x7f8a180fb0e0 msgr2=0x7f8a18104180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.537+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 shutdown_connections 2023-07-21T22:17:18.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.538+0000 7f8a1e3ff700 1 -- 172.21.15.151:0/2374567660 wait complete. 2023-07-21T22:17:18.586 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-07-21T22:17:18.601 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":302,"stamp":"2023-07-21T22:17:16.851305+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595446,"num_objects":57,"num_object_clones":0,"num_object_copies":171,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":295,"num_write_kb":2976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":236,"ondisk_log_size":236,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":282,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334424,"kb_used_data":11000,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607400,"statfs":{"total":1151940427776,"available":1151597977600,"internally_reserved":0,"allocated":11264000,"data_stored":7031731,"data_compressed":108096,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5078,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":114,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001947"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478881+0000","last_change":"2023-07-21T22:17:09.850731+0000","last_active":"2023-07-21T22:17:11.478881+0000","last_peered":"2023-07-21T22:17:11.478881+0000","last_clean":"2023-07-21T22:17:11.478881+0000","last_became_active":"2023-07-21T22:17:09.849185+0000","last_became_peered":"2023-07-21T22:17:09.849185+0000","last_unstale":"2023-07-21T22:17:11.478881+0000","last_undegraded":"2023-07-21T22:17:11.478881+0000","last_fullsized":"2023-07-21T22:17:11.478881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:21:18.058431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478539+0000","last_change":"2023-07-21T22:17:09.853210+0000","last_active":"2023-07-21T22:17:11.478539+0000","last_peered":"2023-07-21T22:17:11.478539+0000","last_clean":"2023-07-21T22:17:11.478539+0000","last_became_active":"2023-07-21T22:17:09.852822+0000","last_became_peered":"2023-07-21T22:17:09.852822+0000","last_unstale":"2023-07-21T22:17:11.478539+0000","last_undegraded":"2023-07-21T22:17:11.478539+0000","last_fullsized":"2023-07-21T22:17:11.478539+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:05.228164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479336+0000","last_change":"2023-07-21T22:17:09.850123+0000","last_active":"2023-07-21T22:17:11.479336+0000","last_peered":"2023-07-21T22:17:11.479336+0000","last_clean":"2023-07-21T22:17:11.479336+0000","last_became_active":"2023-07-21T22:17:09.849763+0000","last_became_peered":"2023-07-21T22:17:09.849763+0000","last_unstale":"2023-07-21T22:17:11.479336+0000","last_undegraded":"2023-07-21T22:17:11.479336+0000","last_fullsized":"2023-07-21T22:17:11.479336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:07.694600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.911099+0000","last_change":"2023-07-21T22:17:09.850462+0000","last_active":"2023-07-21T22:17:10.911099+0000","last_peered":"2023-07-21T22:17:10.911099+0000","last_clean":"2023-07-21T22:17:10.911099+0000","last_became_active":"2023-07-21T22:17:09.850119+0000","last_became_peered":"2023-07-21T22:17:09.850119+0000","last_unstale":"2023-07-21T22:17:10.911099+0000","last_undegraded":"2023-07-21T22:17:10.911099+0000","last_fullsized":"2023-07-21T22:17:10.911099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:58.470987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880661+0000","last_change":"2023-07-21T22:17:09.836811+0000","last_active":"2023-07-21T22:17:10.880661+0000","last_peered":"2023-07-21T22:17:10.880661+0000","last_clean":"2023-07-21T22:17:10.880661+0000","last_became_active":"2023-07-21T22:17:09.836470+0000","last_became_peered":"2023-07-21T22:17:09.836470+0000","last_unstale":"2023-07-21T22:17:10.880661+0000","last_undegraded":"2023-07-21T22:17:10.880661+0000","last_fullsized":"2023-07-21T22:17:10.880661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:50:47.112985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830817+0000","last_change":"2023-07-21T22:17:09.845801+0000","last_active":"2023-07-21T22:17:10.830817+0000","last_peered":"2023-07-21T22:17:10.830817+0000","last_clean":"2023-07-21T22:17:10.830817+0000","last_became_active":"2023-07-21T22:17:09.844938+0000","last_became_peered":"2023-07-21T22:17:09.844938+0000","last_unstale":"2023-07-21T22:17:10.830817+0000","last_undegraded":"2023-07-21T22:17:10.830817+0000","last_fullsized":"2023-07-21T22:17:10.830817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:24:19.472950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801512+0000","last_change":"2023-07-21T22:17:09.850392+0000","last_active":"2023-07-21T22:17:11.801512+0000","last_peered":"2023-07-21T22:17:11.801512+0000","last_clean":"2023-07-21T22:17:11.801512+0000","last_became_active":"2023-07-21T22:17:09.850013+0000","last_became_peered":"2023-07-21T22:17:09.850013+0000","last_unstale":"2023-07-21T22:17:11.801512+0000","last_undegraded":"2023-07-21T22:17:11.801512+0000","last_fullsized":"2023-07-21T22:17:11.801512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:37:01.907515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479233+0000","last_change":"2023-07-21T22:17:09.845425+0000","last_active":"2023-07-21T22:17:11.479233+0000","last_peered":"2023-07-21T22:17:11.479233+0000","last_clean":"2023-07-21T22:17:11.479233+0000","last_became_active":"2023-07-21T22:17:09.845090+0000","last_became_peered":"2023-07-21T22:17:09.845090+0000","last_unstale":"2023-07-21T22:17:11.479233+0000","last_undegraded":"2023-07-21T22:17:11.479233+0000","last_fullsized":"2023-07-21T22:17:11.479233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:57.327790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478316+0000","last_change":"2023-07-21T22:17:09.845600+0000","last_active":"2023-07-21T22:17:11.478316+0000","last_peered":"2023-07-21T22:17:11.478316+0000","last_clean":"2023-07-21T22:17:11.478316+0000","last_became_active":"2023-07-21T22:17:09.845260+0000","last_became_peered":"2023-07-21T22:17:09.845260+0000","last_unstale":"2023-07-21T22:17:11.478316+0000","last_undegraded":"2023-07-21T22:17:11.478316+0000","last_fullsized":"2023-07-21T22:17:11.478316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:02.052057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830968+0000","last_change":"2023-07-21T22:17:09.846172+0000","last_active":"2023-07-21T22:17:10.830968+0000","last_peered":"2023-07-21T22:17:10.830968+0000","last_clean":"2023-07-21T22:17:10.830968+0000","last_became_active":"2023-07-21T22:17:09.845827+0000","last_became_peered":"2023-07-21T22:17:09.845827+0000","last_unstale":"2023-07-21T22:17:10.830968+0000","last_undegraded":"2023-07-21T22:17:10.830968+0000","last_fullsized":"2023-07-21T22:17:10.830968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:40.926651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801831+0000","last_change":"2023-07-21T22:17:09.852728+0000","last_active":"2023-07-21T22:17:11.801831+0000","last_peered":"2023-07-21T22:17:11.801831+0000","last_clean":"2023-07-21T22:17:11.801831+0000","last_became_active":"2023-07-21T22:17:09.852152+0000","last_became_peered":"2023-07-21T22:17:09.852152+0000","last_unstale":"2023-07-21T22:17:11.801831+0000","last_undegraded":"2023-07-21T22:17:11.801831+0000","last_fullsized":"2023-07-21T22:17:11.801831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:20:15.335454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.911051+0000","last_change":"2023-07-21T22:17:09.850565+0000","last_active":"2023-07-21T22:17:10.911051+0000","last_peered":"2023-07-21T22:17:10.911051+0000","last_clean":"2023-07-21T22:17:10.911051+0000","last_became_active":"2023-07-21T22:17:09.850162+0000","last_became_peered":"2023-07-21T22:17:09.850162+0000","last_unstale":"2023-07-21T22:17:10.911051+0000","last_undegraded":"2023-07-21T22:17:10.911051+0000","last_fullsized":"2023-07-21T22:17:10.911051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:02.870883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830349+0000","last_change":"2023-07-21T22:17:09.836732+0000","last_active":"2023-07-21T22:17:10.830349+0000","last_peered":"2023-07-21T22:17:10.830349+0000","last_clean":"2023-07-21T22:17:10.830349+0000","last_became_active":"2023-07-21T22:17:09.836446+0000","last_became_peered":"2023-07-21T22:17:09.836446+0000","last_unstale":"2023-07-21T22:17:10.830349+0000","last_undegraded":"2023-07-21T22:17:10.830349+0000","last_fullsized":"2023-07-21T22:17:10.830349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:58.962790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478543+0000","last_change":"2023-07-21T22:17:09.852624+0000","last_active":"2023-07-21T22:17:11.478543+0000","last_peered":"2023-07-21T22:17:11.478543+0000","last_clean":"2023-07-21T22:17:11.478543+0000","last_became_active":"2023-07-21T22:17:09.852353+0000","last_became_peered":"2023-07-21T22:17:09.852353+0000","last_unstale":"2023-07-21T22:17:11.478543+0000","last_undegraded":"2023-07-21T22:17:11.478543+0000","last_fullsized":"2023-07-21T22:17:11.478543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:09.532957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478910+0000","last_change":"2023-07-21T22:17:09.860554+0000","last_active":"2023-07-21T22:17:11.478910+0000","last_peered":"2023-07-21T22:17:11.478910+0000","last_clean":"2023-07-21T22:17:11.478910+0000","last_became_active":"2023-07-21T22:17:09.860119+0000","last_became_peered":"2023-07-21T22:17:09.860119+0000","last_unstale":"2023-07-21T22:17:11.478910+0000","last_undegraded":"2023-07-21T22:17:11.478910+0000","last_fullsized":"2023-07-21T22:17:11.478910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:35.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477738+0000","last_change":"2023-07-21T22:17:09.850522+0000","last_active":"2023-07-21T22:17:11.477738+0000","last_peered":"2023-07-21T22:17:11.477738+0000","last_clean":"2023-07-21T22:17:11.477738+0000","last_became_active":"2023-07-21T22:17:09.850243+0000","last_became_peered":"2023-07-21T22:17:09.850243+0000","last_unstale":"2023-07-21T22:17:11.477738+0000","last_undegraded":"2023-07-21T22:17:11.477738+0000","last_fullsized":"2023-07-21T22:17:11.477738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:40.596690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478978+0000","last_change":"2023-07-21T22:17:09.848552+0000","last_active":"2023-07-21T22:17:11.478978+0000","last_peered":"2023-07-21T22:17:11.478978+0000","last_clean":"2023-07-21T22:17:11.478978+0000","last_became_active":"2023-07-21T22:17:09.848110+0000","last_became_peered":"2023-07-21T22:17:09.848110+0000","last_unstale":"2023-07-21T22:17:11.478978+0000","last_undegraded":"2023-07-21T22:17:11.478978+0000","last_fullsized":"2023-07-21T22:17:11.478978+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:00.673904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479417+0000","last_change":"2023-07-21T22:17:09.848899+0000","last_active":"2023-07-21T22:17:11.479417+0000","last_peered":"2023-07-21T22:17:11.479417+0000","last_clean":"2023-07-21T22:17:11.479417+0000","last_became_active":"2023-07-21T22:17:09.848606+0000","last_became_peered":"2023-07-21T22:17:09.848606+0000","last_unstale":"2023-07-21T22:17:11.479417+0000","last_undegraded":"2023-07-21T22:17:11.479417+0000","last_fullsized":"2023-07-21T22:17:11.479417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:45:42.525488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830577+0000","last_change":"2023-07-21T22:17:09.838033+0000","last_active":"2023-07-21T22:17:10.830577+0000","last_peered":"2023-07-21T22:17:10.830577+0000","last_clean":"2023-07-21T22:17:10.830577+0000","last_became_active":"2023-07-21T22:17:09.837532+0000","last_became_peered":"2023-07-21T22:17:09.837532+0000","last_unstale":"2023-07-21T22:17:10.830577+0000","last_undegraded":"2023-07-21T22:17:10.830577+0000","last_fullsized":"2023-07-21T22:17:10.830577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:57.879349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.201465+0000","last_change":"2023-07-21T22:17:08.867849+0000","last_active":"2023-07-21T22:17:14.201465+0000","last_peered":"2023-07-21T22:17:14.201465+0000","last_clean":"2023-07-21T22:17:14.201465+0000","last_became_active":"2023-07-21T22:17:08.866245+0000","last_became_peered":"2023-07-21T22:17:08.866245+0000","last_unstale":"2023-07-21T22:17:14.201465+0000","last_undegraded":"2023-07-21T22:17:14.201465+0000","last_fullsized":"2023-07-21T22:17:14.201465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:09.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478988+0000","last_change":"2023-07-21T22:17:09.841402+0000","last_active":"2023-07-21T22:17:11.478988+0000","last_peered":"2023-07-21T22:17:11.478988+0000","last_clean":"2023-07-21T22:17:11.478988+0000","last_became_active":"2023-07-21T22:17:09.841009+0000","last_became_peered":"2023-07-21T22:17:09.841009+0000","last_unstale":"2023-07-21T22:17:11.478988+0000","last_undegraded":"2023-07-21T22:17:11.478988+0000","last_fullsized":"2023-07-21T22:17:11.478988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:36.460866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.702373+0000","last_change":"2023-07-21T22:17:08.864236+0000","last_active":"2023-07-21T22:17:11.702373+0000","last_peered":"2023-07-21T22:17:11.702373+0000","last_clean":"2023-07-21T22:17:11.702373+0000","last_became_active":"2023-07-21T22:17:08.863579+0000","last_became_peered":"2023-07-21T22:17:08.863579+0000","last_unstale":"2023-07-21T22:17:11.702373+0000","last_undegraded":"2023-07-21T22:17:11.702373+0000","last_fullsized":"2023-07-21T22:17:11.702373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:52:52.715957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479141+0000","last_change":"2023-07-21T22:17:09.852677+0000","last_active":"2023-07-21T22:17:11.479141+0000","last_peered":"2023-07-21T22:17:11.479141+0000","last_clean":"2023-07-21T22:17:11.479141+0000","last_became_active":"2023-07-21T22:17:09.852326+0000","last_became_peered":"2023-07-21T22:17:09.852326+0000","last_unstale":"2023-07-21T22:17:11.479141+0000","last_undegraded":"2023-07-21T22:17:11.479141+0000","last_fullsized":"2023-07-21T22:17:11.479141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:41:25.896020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.197559+0000","last_change":"2023-07-21T22:17:08.867521+0000","last_active":"2023-07-21T22:17:14.197559+0000","last_peered":"2023-07-21T22:17:14.197559+0000","last_clean":"2023-07-21T22:17:14.197559+0000","last_became_active":"2023-07-21T22:17:08.867125+0000","last_became_peered":"2023-07-21T22:17:08.867125+0000","last_unstale":"2023-07-21T22:17:14.197559+0000","last_undegraded":"2023-07-21T22:17:14.197559+0000","last_fullsized":"2023-07-21T22:17:14.197559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:52.689349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477902+0000","last_change":"2023-07-21T22:17:09.846296+0000","last_active":"2023-07-21T22:17:11.477902+0000","last_peered":"2023-07-21T22:17:11.477902+0000","last_clean":"2023-07-21T22:17:11.477902+0000","last_became_active":"2023-07-21T22:17:09.845947+0000","last_became_peered":"2023-07-21T22:17:09.845947+0000","last_unstale":"2023-07-21T22:17:11.477902+0000","last_undegraded":"2023-07-21T22:17:11.477902+0000","last_fullsized":"2023-07-21T22:17:11.477902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:34:21.306139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.881094+0000","last_change":"2023-07-21T22:17:08.866709+0000","last_active":"2023-07-21T22:17:10.881094+0000","last_peered":"2023-07-21T22:17:10.881094+0000","last_clean":"2023-07-21T22:17:10.881094+0000","last_became_active":"2023-07-21T22:17:08.866277+0000","last_became_peered":"2023-07-21T22:17:08.866277+0000","last_unstale":"2023-07-21T22:17:10.881094+0000","last_undegraded":"2023-07-21T22:17:10.881094+0000","last_fullsized":"2023-07-21T22:17:10.881094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:13.405996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477930+0000","last_change":"2023-07-21T22:17:09.855068+0000","last_active":"2023-07-21T22:17:11.477930+0000","last_peered":"2023-07-21T22:17:11.477930+0000","last_clean":"2023-07-21T22:17:11.477930+0000","last_became_active":"2023-07-21T22:17:09.854697+0000","last_became_peered":"2023-07-21T22:17:09.854697+0000","last_unstale":"2023-07-21T22:17:11.477930+0000","last_undegraded":"2023-07-21T22:17:11.477930+0000","last_fullsized":"2023-07-21T22:17:11.477930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:51.198897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192160+0000","last_change":"2023-07-21T22:17:08.864292+0000","last_active":"2023-07-21T22:17:13.192160+0000","last_peered":"2023-07-21T22:17:13.192160+0000","last_clean":"2023-07-21T22:17:13.192160+0000","last_became_active":"2023-07-21T22:17:08.863243+0000","last_became_peered":"2023-07-21T22:17:08.863243+0000","last_unstale":"2023-07-21T22:17:13.192160+0000","last_undegraded":"2023-07-21T22:17:13.192160+0000","last_fullsized":"2023-07-21T22:17:13.192160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:31:13.356180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880612+0000","last_change":"2023-07-21T22:17:09.840756+0000","last_active":"2023-07-21T22:17:10.880612+0000","last_peered":"2023-07-21T22:17:10.880612+0000","last_clean":"2023-07-21T22:17:10.880612+0000","last_became_active":"2023-07-21T22:17:09.840421+0000","last_became_peered":"2023-07-21T22:17:09.840421+0000","last_unstale":"2023-07-21T22:17:10.880612+0000","last_undegraded":"2023-07-21T22:17:10.880612+0000","last_fullsized":"2023-07-21T22:17:10.880612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:30.331025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830610+0000","last_change":"2023-07-21T22:17:08.860265+0000","last_active":"2023-07-21T22:17:10.830610+0000","last_peered":"2023-07-21T22:17:10.830610+0000","last_clean":"2023-07-21T22:17:10.830610+0000","last_became_active":"2023-07-21T22:17:08.859900+0000","last_became_peered":"2023-07-21T22:17:08.859900+0000","last_unstale":"2023-07-21T22:17:10.830610+0000","last_undegraded":"2023-07-21T22:17:10.830610+0000","last_fullsized":"2023-07-21T22:17:10.830610+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:26.216426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478133+0000","last_change":"2023-07-21T22:17:09.839359+0000","last_active":"2023-07-21T22:17:11.478133+0000","last_peered":"2023-07-21T22:17:11.478133+0000","last_clean":"2023-07-21T22:17:11.478133+0000","last_became_active":"2023-07-21T22:17:09.839026+0000","last_became_peered":"2023-07-21T22:17:09.839026+0000","last_unstale":"2023-07-21T22:17:11.478133+0000","last_undegraded":"2023-07-21T22:17:11.478133+0000","last_fullsized":"2023-07-21T22:17:11.478133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:51:57.148996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.201962+0000","last_change":"2023-07-21T22:17:08.861680+0000","last_active":"2023-07-21T22:17:14.201962+0000","last_peered":"2023-07-21T22:17:14.201962+0000","last_clean":"2023-07-21T22:17:14.201962+0000","last_became_active":"2023-07-21T22:17:08.861348+0000","last_became_peered":"2023-07-21T22:17:08.861348+0000","last_unstale":"2023-07-21T22:17:14.201962+0000","last_undegraded":"2023-07-21T22:17:14.201962+0000","last_fullsized":"2023-07-21T22:17:14.201962+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:37.043743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479449+0000","last_change":"2023-07-21T22:17:09.840166+0000","last_active":"2023-07-21T22:17:11.479449+0000","last_peered":"2023-07-21T22:17:11.479449+0000","last_clean":"2023-07-21T22:17:11.479449+0000","last_became_active":"2023-07-21T22:17:09.839850+0000","last_became_peered":"2023-07-21T22:17:09.839850+0000","last_unstale":"2023-07-21T22:17:11.479449+0000","last_undegraded":"2023-07-21T22:17:11.479449+0000","last_fullsized":"2023-07-21T22:17:11.479449+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:40:55.141670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477777+0000","last_change":"2023-07-21T22:17:08.864838+0000","last_active":"2023-07-21T22:17:11.477777+0000","last_peered":"2023-07-21T22:17:11.477777+0000","last_clean":"2023-07-21T22:17:11.477777+0000","last_became_active":"2023-07-21T22:17:08.864484+0000","last_became_peered":"2023-07-21T22:17:08.864484+0000","last_unstale":"2023-07-21T22:17:11.477777+0000","last_undegraded":"2023-07-21T22:17:11.477777+0000","last_fullsized":"2023-07-21T22:17:11.477777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:14:17.469899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478426+0000","last_change":"2023-07-21T22:17:09.836214+0000","last_active":"2023-07-21T22:17:11.478426+0000","last_peered":"2023-07-21T22:17:11.478426+0000","last_clean":"2023-07-21T22:17:11.478426+0000","last_became_active":"2023-07-21T22:17:09.835877+0000","last_became_peered":"2023-07-21T22:17:09.835877+0000","last_unstale":"2023-07-21T22:17:11.478426+0000","last_undegraded":"2023-07-21T22:17:11.478426+0000","last_fullsized":"2023-07-21T22:17:11.478426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:38.431572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192737+0000","last_change":"2023-07-21T22:17:08.861801+0000","last_active":"2023-07-21T22:17:13.192737+0000","last_peered":"2023-07-21T22:17:13.192737+0000","last_clean":"2023-07-21T22:17:13.192737+0000","last_became_active":"2023-07-21T22:17:08.861391+0000","last_became_peered":"2023-07-21T22:17:08.861391+0000","last_unstale":"2023-07-21T22:17:13.192737+0000","last_undegraded":"2023-07-21T22:17:13.192737+0000","last_fullsized":"2023-07-21T22:17:13.192737+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:40:07.644870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478285+0000","last_change":"2023-07-21T22:17:09.842155+0000","last_active":"2023-07-21T22:17:11.478285+0000","last_peered":"2023-07-21T22:17:11.478285+0000","last_clean":"2023-07-21T22:17:11.478285+0000","last_became_active":"2023-07-21T22:17:09.841845+0000","last_became_peered":"2023-07-21T22:17:09.841845+0000","last_unstale":"2023-07-21T22:17:11.478285+0000","last_undegraded":"2023-07-21T22:17:11.478285+0000","last_fullsized":"2023-07-21T22:17:11.478285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:33.874760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801822+0000","last_change":"2023-07-21T22:17:08.858727+0000","last_active":"2023-07-21T22:17:11.801822+0000","last_peered":"2023-07-21T22:17:11.801822+0000","last_clean":"2023-07-21T22:17:11.801822+0000","last_became_active":"2023-07-21T22:17:08.858376+0000","last_became_peered":"2023-07-21T22:17:08.858376+0000","last_unstale":"2023-07-21T22:17:11.801822+0000","last_undegraded":"2023-07-21T22:17:11.801822+0000","last_fullsized":"2023-07-21T22:17:11.801822+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:51.205730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478993+0000","last_change":"2023-07-21T22:17:09.857300+0000","last_active":"2023-07-21T22:17:11.478993+0000","last_peered":"2023-07-21T22:17:11.478993+0000","last_clean":"2023-07-21T22:17:11.478993+0000","last_became_active":"2023-07-21T22:17:09.856932+0000","last_became_peered":"2023-07-21T22:17:09.856932+0000","last_unstale":"2023-07-21T22:17:11.478993+0000","last_undegraded":"2023-07-21T22:17:11.478993+0000","last_fullsized":"2023-07-21T22:17:11.478993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:03.422310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478290+0000","last_change":"2023-07-21T22:17:08.865488+0000","last_active":"2023-07-21T22:17:11.478290+0000","last_peered":"2023-07-21T22:17:11.478290+0000","last_clean":"2023-07-21T22:17:11.478290+0000","last_became_active":"2023-07-21T22:17:08.865050+0000","last_became_peered":"2023-07-21T22:17:08.865050+0000","last_unstale":"2023-07-21T22:17:11.478290+0000","last_undegraded":"2023-07-21T22:17:11.478290+0000","last_fullsized":"2023-07-21T22:17:11.478290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:54.377233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478099+0000","last_change":"2023-07-21T22:17:09.849880+0000","last_active":"2023-07-21T22:17:11.478099+0000","last_peered":"2023-07-21T22:17:11.478099+0000","last_clean":"2023-07-21T22:17:11.478099+0000","last_became_active":"2023-07-21T22:17:09.849552+0000","last_became_peered":"2023-07-21T22:17:09.849552+0000","last_unstale":"2023-07-21T22:17:11.478099+0000","last_undegraded":"2023-07-21T22:17:11.478099+0000","last_fullsized":"2023-07-21T22:17:11.478099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:06.952508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'8","reported_seq":22,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192913+0000","last_change":"2023-07-21T22:17:08.861663+0000","last_active":"2023-07-21T22:17:13.192913+0000","last_peered":"2023-07-21T22:17:13.192913+0000","last_clean":"2023-07-21T22:17:13.192913+0000","last_became_active":"2023-07-21T22:17:08.861339+0000","last_became_peered":"2023-07-21T22:17:08.861339+0000","last_unstale":"2023-07-21T22:17:13.192913+0000","last_undegraded":"2023-07-21T22:17:13.192913+0000","last_fullsized":"2023-07-21T22:17:13.192913+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:59:29.615115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880840+0000","last_change":"2023-07-21T22:17:09.841543+0000","last_active":"2023-07-21T22:17:10.880840+0000","last_peered":"2023-07-21T22:17:10.880840+0000","last_clean":"2023-07-21T22:17:10.880840+0000","last_became_active":"2023-07-21T22:17:09.841235+0000","last_became_peered":"2023-07-21T22:17:09.841235+0000","last_unstale":"2023-07-21T22:17:10.880840+0000","last_undegraded":"2023-07-21T22:17:10.880840+0000","last_fullsized":"2023-07-21T22:17:10.880840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:08.532253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.198328+0000","last_change":"2023-07-21T22:17:08.855145+0000","last_active":"2023-07-21T22:17:14.198328+0000","last_peered":"2023-07-21T22:17:14.198328+0000","last_clean":"2023-07-21T22:17:14.198328+0000","last_became_active":"2023-07-21T22:17:08.853279+0000","last_became_peered":"2023-07-21T22:17:08.853279+0000","last_unstale":"2023-07-21T22:17:14.198328+0000","last_undegraded":"2023-07-21T22:17:14.198328+0000","last_fullsized":"2023-07-21T22:17:14.198328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:15:37.989845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830147+0000","last_change":"2023-07-21T22:17:09.835656+0000","last_active":"2023-07-21T22:17:10.830147+0000","last_peered":"2023-07-21T22:17:10.830147+0000","last_clean":"2023-07-21T22:17:10.830147+0000","last_became_active":"2023-07-21T22:17:09.835309+0000","last_became_peered":"2023-07-21T22:17:09.835309+0000","last_unstale":"2023-07-21T22:17:10.830147+0000","last_undegraded":"2023-07-21T22:17:10.830147+0000","last_fullsized":"2023-07-21T22:17:10.830147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:52.048874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192054+0000","last_change":"2023-07-21T22:17:08.864811+0000","last_active":"2023-07-21T22:17:13.192054+0000","last_peered":"2023-07-21T22:17:13.192054+0000","last_clean":"2023-07-21T22:17:13.192054+0000","last_became_active":"2023-07-21T22:17:08.864428+0000","last_became_peered":"2023-07-21T22:17:08.864428+0000","last_unstale":"2023-07-21T22:17:13.192054+0000","last_undegraded":"2023-07-21T22:17:13.192054+0000","last_fullsized":"2023-07-21T22:17:13.192054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:18:29.979099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801854+0000","last_change":"2023-07-21T22:17:09.837713+0000","last_active":"2023-07-21T22:17:11.801854+0000","last_peered":"2023-07-21T22:17:11.801854+0000","last_clean":"2023-07-21T22:17:11.801854+0000","last_became_active":"2023-07-21T22:17:09.837420+0000","last_became_peered":"2023-07-21T22:17:09.837420+0000","last_unstale":"2023-07-21T22:17:11.801854+0000","last_undegraded":"2023-07-21T22:17:11.801854+0000","last_fullsized":"2023-07-21T22:17:11.801854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:19:44.256533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.200055+0000","last_change":"2023-07-21T22:17:08.854376+0000","last_active":"2023-07-21T22:17:14.200055+0000","last_peered":"2023-07-21T22:17:14.200055+0000","last_clean":"2023-07-21T22:17:14.200055+0000","last_became_active":"2023-07-21T22:17:08.854031+0000","last_became_peered":"2023-07-21T22:17:08.854031+0000","last_unstale":"2023-07-21T22:17:14.200055+0000","last_undegraded":"2023-07-21T22:17:14.200055+0000","last_fullsized":"2023-07-21T22:17:14.200055+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:15:45.599118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801552+0000","last_change":"2023-07-21T22:17:09.851279+0000","last_active":"2023-07-21T22:17:11.801552+0000","last_peered":"2023-07-21T22:17:11.801552+0000","last_clean":"2023-07-21T22:17:11.801552+0000","last_became_active":"2023-07-21T22:17:09.850948+0000","last_became_peered":"2023-07-21T22:17:09.850948+0000","last_unstale":"2023-07-21T22:17:11.801552+0000","last_undegraded":"2023-07-21T22:17:11.801552+0000","last_fullsized":"2023-07-21T22:17:11.801552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:20:44.072042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.201376+0000","last_change":"2023-07-21T22:17:08.865425+0000","last_active":"2023-07-21T22:17:14.201376+0000","last_peered":"2023-07-21T22:17:14.201376+0000","last_clean":"2023-07-21T22:17:14.201376+0000","last_became_active":"2023-07-21T22:17:08.865067+0000","last_became_peered":"2023-07-21T22:17:08.865067+0000","last_unstale":"2023-07-21T22:17:14.201376+0000","last_undegraded":"2023-07-21T22:17:14.201376+0000","last_fullsized":"2023-07-21T22:17:14.201376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:36.923874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477785+0000","last_change":"2023-07-21T22:17:09.844916+0000","last_active":"2023-07-21T22:17:11.477785+0000","last_peered":"2023-07-21T22:17:11.477785+0000","last_clean":"2023-07-21T22:17:11.477785+0000","last_became_active":"2023-07-21T22:17:09.844632+0000","last_became_peered":"2023-07-21T22:17:09.844632+0000","last_unstale":"2023-07-21T22:17:11.477785+0000","last_undegraded":"2023-07-21T22:17:11.477785+0000","last_fullsized":"2023-07-21T22:17:11.477785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:40.257355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880803+0000","last_change":"2023-07-21T22:17:08.862954+0000","last_active":"2023-07-21T22:17:10.880803+0000","last_peered":"2023-07-21T22:17:10.880803+0000","last_clean":"2023-07-21T22:17:10.880803+0000","last_became_active":"2023-07-21T22:17:08.862598+0000","last_became_peered":"2023-07-21T22:17:08.862598+0000","last_unstale":"2023-07-21T22:17:10.880803+0000","last_undegraded":"2023-07-21T22:17:10.880803+0000","last_fullsized":"2023-07-21T22:17:10.880803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:12.788001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478822+0000","last_change":"2023-07-21T22:17:09.847756+0000","last_active":"2023-07-21T22:17:11.478822+0000","last_peered":"2023-07-21T22:17:11.478822+0000","last_clean":"2023-07-21T22:17:11.478822+0000","last_became_active":"2023-07-21T22:17:09.847466+0000","last_became_peered":"2023-07-21T22:17:09.847466+0000","last_unstale":"2023-07-21T22:17:11.478822+0000","last_undegraded":"2023-07-21T22:17:11.478822+0000","last_fullsized":"2023-07-21T22:17:11.478822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:36.387868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478860+0000","last_change":"2023-07-21T22:17:08.862514+0000","last_active":"2023-07-21T22:17:11.478860+0000","last_peered":"2023-07-21T22:17:11.478860+0000","last_clean":"2023-07-21T22:17:11.478860+0000","last_became_active":"2023-07-21T22:17:08.862223+0000","last_became_peered":"2023-07-21T22:17:08.862223+0000","last_unstale":"2023-07-21T22:17:11.478860+0000","last_undegraded":"2023-07-21T22:17:11.478860+0000","last_fullsized":"2023-07-21T22:17:11.478860+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:55.490292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.831007+0000","last_change":"2023-07-21T22:17:09.852621+0000","last_active":"2023-07-21T22:17:10.831007+0000","last_peered":"2023-07-21T22:17:10.831007+0000","last_clean":"2023-07-21T22:17:10.831007+0000","last_became_active":"2023-07-21T22:17:09.852233+0000","last_became_peered":"2023-07-21T22:17:09.852233+0000","last_unstale":"2023-07-21T22:17:10.831007+0000","last_undegraded":"2023-07-21T22:17:10.831007+0000","last_fullsized":"2023-07-21T22:17:10.831007+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:25.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801936+0000","last_change":"2023-07-21T22:17:08.861344+0000","last_active":"2023-07-21T22:17:11.801936+0000","last_peered":"2023-07-21T22:17:11.801936+0000","last_clean":"2023-07-21T22:17:11.801936+0000","last_became_active":"2023-07-21T22:17:08.860978+0000","last_became_peered":"2023-07-21T22:17:08.860978+0000","last_unstale":"2023-07-21T22:17:11.801936+0000","last_undegraded":"2023-07-21T22:17:11.801936+0000","last_fullsized":"2023-07-21T22:17:11.801936+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:43.442172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830728+0000","last_change":"2023-07-21T22:17:09.852314+0000","last_active":"2023-07-21T22:17:10.830728+0000","last_peered":"2023-07-21T22:17:10.830728+0000","last_clean":"2023-07-21T22:17:10.830728+0000","last_became_active":"2023-07-21T22:17:09.852137+0000","last_became_peered":"2023-07-21T22:17:09.852137+0000","last_unstale":"2023-07-21T22:17:10.830728+0000","last_undegraded":"2023-07-21T22:17:10.830728+0000","last_fullsized":"2023-07-21T22:17:10.830728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:42:34.471855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478126+0000","last_change":"2023-07-21T22:17:09.839387+0000","last_active":"2023-07-21T22:17:11.478126+0000","last_peered":"2023-07-21T22:17:11.478126+0000","last_clean":"2023-07-21T22:17:11.478126+0000","last_became_active":"2023-07-21T22:17:09.839052+0000","last_became_peered":"2023-07-21T22:17:09.839052+0000","last_unstale":"2023-07-21T22:17:11.478126+0000","last_undegraded":"2023-07-21T22:17:11.478126+0000","last_fullsized":"2023-07-21T22:17:11.478126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:35:39.490581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:15.205969+0000","last_change":"2023-07-21T22:17:08.859465+0000","last_active":"2023-07-21T22:17:15.205969+0000","last_peered":"2023-07-21T22:17:15.205969+0000","last_clean":"2023-07-21T22:17:15.205969+0000","last_became_active":"2023-07-21T22:17:08.859076+0000","last_became_peered":"2023-07-21T22:17:08.859076+0000","last_unstale":"2023-07-21T22:17:15.205969+0000","last_undegraded":"2023-07-21T22:17:15.205969+0000","last_fullsized":"2023-07-21T22:17:15.205969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:23:52.974083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479721+0000","last_change":"2023-07-21T22:17:09.846937+0000","last_active":"2023-07-21T22:17:11.479721+0000","last_peered":"2023-07-21T22:17:11.479721+0000","last_clean":"2023-07-21T22:17:11.479721+0000","last_became_active":"2023-07-21T22:17:09.846638+0000","last_became_peered":"2023-07-21T22:17:09.846638+0000","last_unstale":"2023-07-21T22:17:11.479721+0000","last_undegraded":"2023-07-21T22:17:11.479721+0000","last_fullsized":"2023-07-21T22:17:11.479721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:12:55.930155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.193092+0000","last_change":"2023-07-21T22:17:08.860388+0000","last_active":"2023-07-21T22:17:13.193092+0000","last_peered":"2023-07-21T22:17:13.193092+0000","last_clean":"2023-07-21T22:17:13.193092+0000","last_became_active":"2023-07-21T22:17:08.860039+0000","last_became_peered":"2023-07-21T22:17:08.860039+0000","last_unstale":"2023-07-21T22:17:13.193092+0000","last_undegraded":"2023-07-21T22:17:13.193092+0000","last_fullsized":"2023-07-21T22:17:13.193092+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:05.482939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801371+0000","last_change":"2023-07-21T22:15:51.342448+0000","last_active":"2023-07-21T22:17:11.801371+0000","last_peered":"2023-07-21T22:17:11.801371+0000","last_clean":"2023-07-21T22:17:11.801371+0000","last_became_active":"2023-07-21T22:15:51.342004+0000","last_became_peered":"2023-07-21T22:15:51.342004+0000","last_unstale":"2023-07-21T22:17:11.801371+0000","last_undegraded":"2023-07-21T22:17:11.801371+0000","last_fullsized":"2023-07-21T22:17:11.801371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_clean_scrub_stamp":"2023-07-21T22:12:15.345227+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:09:47.096789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830018+0000","last_change":"2023-07-21T22:17:09.838402+0000","last_active":"2023-07-21T22:17:10.830018+0000","last_peered":"2023-07-21T22:17:10.830018+0000","last_clean":"2023-07-21T22:17:10.830018+0000","last_became_active":"2023-07-21T22:17:09.838096+0000","last_became_peered":"2023-07-21T22:17:09.838096+0000","last_unstale":"2023-07-21T22:17:10.830018+0000","last_undegraded":"2023-07-21T22:17:10.830018+0000","last_fullsized":"2023-07-21T22:17:10.830018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:29.036801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801687+0000","last_change":"2023-07-21T22:17:08.865676+0000","last_active":"2023-07-21T22:17:11.801687+0000","last_peered":"2023-07-21T22:17:11.801687+0000","last_clean":"2023-07-21T22:17:11.801687+0000","last_became_active":"2023-07-21T22:17:08.865370+0000","last_became_peered":"2023-07-21T22:17:08.865370+0000","last_unstale":"2023-07-21T22:17:11.801687+0000","last_undegraded":"2023-07-21T22:17:11.801687+0000","last_fullsized":"2023-07-21T22:17:11.801687+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:53.967818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880914+0000","last_change":"2023-07-21T22:17:08.864487+0000","last_active":"2023-07-21T22:17:10.880914+0000","last_peered":"2023-07-21T22:17:10.880914+0000","last_clean":"2023-07-21T22:17:10.880914+0000","last_became_active":"2023-07-21T22:17:08.863943+0000","last_became_peered":"2023-07-21T22:17:08.863943+0000","last_unstale":"2023-07-21T22:17:10.880914+0000","last_undegraded":"2023-07-21T22:17:10.880914+0000","last_fullsized":"2023-07-21T22:17:10.880914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:20:04.372255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830453+0000","last_change":"2023-07-21T22:17:09.833812+0000","last_active":"2023-07-21T22:17:10.830453+0000","last_peered":"2023-07-21T22:17:10.830453+0000","last_clean":"2023-07-21T22:17:10.830453+0000","last_became_active":"2023-07-21T22:17:09.833496+0000","last_became_peered":"2023-07-21T22:17:09.833496+0000","last_unstale":"2023-07-21T22:17:10.830453+0000","last_undegraded":"2023-07-21T22:17:10.830453+0000","last_fullsized":"2023-07-21T22:17:10.830453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:28.939675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.199937+0000","last_change":"2023-07-21T22:17:08.867858+0000","last_active":"2023-07-21T22:17:14.199937+0000","last_peered":"2023-07-21T22:17:14.199937+0000","last_clean":"2023-07-21T22:17:14.199937+0000","last_became_active":"2023-07-21T22:17:08.867468+0000","last_became_peered":"2023-07-21T22:17:08.867468+0000","last_unstale":"2023-07-21T22:17:14.199937+0000","last_undegraded":"2023-07-21T22:17:14.199937+0000","last_fullsized":"2023-07-21T22:17:14.199937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:37:14.340759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478685+0000","last_change":"2023-07-21T22:17:09.846988+0000","last_active":"2023-07-21T22:17:11.478685+0000","last_peered":"2023-07-21T22:17:11.478685+0000","last_clean":"2023-07-21T22:17:11.478685+0000","last_became_active":"2023-07-21T22:17:09.846686+0000","last_became_peered":"2023-07-21T22:17:09.846686+0000","last_unstale":"2023-07-21T22:17:11.478685+0000","last_undegraded":"2023-07-21T22:17:11.478685+0000","last_fullsized":"2023-07-21T22:17:11.478685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:25:19.635631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192527+0000","last_change":"2023-07-21T22:17:08.857694+0000","last_active":"2023-07-21T22:17:13.192527+0000","last_peered":"2023-07-21T22:17:13.192527+0000","last_clean":"2023-07-21T22:17:13.192527+0000","last_became_active":"2023-07-21T22:17:08.857356+0000","last_became_peered":"2023-07-21T22:17:08.857356+0000","last_unstale":"2023-07-21T22:17:13.192527+0000","last_undegraded":"2023-07-21T22:17:13.192527+0000","last_fullsized":"2023-07-21T22:17:13.192527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:11:16.479348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478682+0000","last_change":"2023-07-21T22:17:09.858500+0000","last_active":"2023-07-21T22:17:11.478682+0000","last_peered":"2023-07-21T22:17:11.478682+0000","last_clean":"2023-07-21T22:17:11.478682+0000","last_became_active":"2023-07-21T22:17:09.858009+0000","last_became_peered":"2023-07-21T22:17:09.858009+0000","last_unstale":"2023-07-21T22:17:11.478682+0000","last_undegraded":"2023-07-21T22:17:11.478682+0000","last_fullsized":"2023-07-21T22:17:11.478682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:30:08.512682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.191549+0000","last_change":"2023-07-21T22:17:08.853732+0000","last_active":"2023-07-21T22:17:13.191549+0000","last_peered":"2023-07-21T22:17:13.191549+0000","last_clean":"2023-07-21T22:17:13.191549+0000","last_became_active":"2023-07-21T22:17:08.853397+0000","last_became_peered":"2023-07-21T22:17:08.853397+0000","last_unstale":"2023-07-21T22:17:13.191549+0000","last_undegraded":"2023-07-21T22:17:13.191549+0000","last_fullsized":"2023-07-21T22:17:13.191549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:46:04.645341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880577+0000","last_change":"2023-07-21T22:17:09.840836+0000","last_active":"2023-07-21T22:17:10.880577+0000","last_peered":"2023-07-21T22:17:10.880577+0000","last_clean":"2023-07-21T22:17:10.880577+0000","last_became_active":"2023-07-21T22:17:09.840463+0000","last_became_peered":"2023-07-21T22:17:09.840463+0000","last_unstale":"2023-07-21T22:17:10.880577+0000","last_undegraded":"2023-07-21T22:17:10.880577+0000","last_fullsized":"2023-07-21T22:17:10.880577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:35:02.318409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192404+0000","last_change":"2023-07-21T22:17:08.865129+0000","last_active":"2023-07-21T22:17:13.192404+0000","last_peered":"2023-07-21T22:17:13.192404+0000","last_clean":"2023-07-21T22:17:13.192404+0000","last_became_active":"2023-07-21T22:17:08.864820+0000","last_became_peered":"2023-07-21T22:17:08.864820+0000","last_unstale":"2023-07-21T22:17:13.192404+0000","last_undegraded":"2023-07-21T22:17:13.192404+0000","last_fullsized":"2023-07-21T22:17:13.192404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:04.701632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478588+0000","last_change":"2023-07-21T22:17:09.846804+0000","last_active":"2023-07-21T22:17:11.478588+0000","last_peered":"2023-07-21T22:17:11.478588+0000","last_clean":"2023-07-21T22:17:11.478588+0000","last_became_active":"2023-07-21T22:17:09.846390+0000","last_became_peered":"2023-07-21T22:17:09.846390+0000","last_unstale":"2023-07-21T22:17:11.478588+0000","last_undegraded":"2023-07-21T22:17:11.478588+0000","last_fullsized":"2023-07-21T22:17:11.478588+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:19.365523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830352+0000","last_change":"2023-07-21T22:17:08.854259+0000","last_active":"2023-07-21T22:17:10.830352+0000","last_peered":"2023-07-21T22:17:10.830352+0000","last_clean":"2023-07-21T22:17:10.830352+0000","last_became_active":"2023-07-21T22:17:08.852680+0000","last_became_peered":"2023-07-21T22:17:08.852680+0000","last_unstale":"2023-07-21T22:17:10.830352+0000","last_undegraded":"2023-07-21T22:17:10.830352+0000","last_fullsized":"2023-07-21T22:17:10.830352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:57.503391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478636+0000","last_change":"2023-07-21T22:17:09.849197+0000","last_active":"2023-07-21T22:17:11.478636+0000","last_peered":"2023-07-21T22:17:11.478636+0000","last_clean":"2023-07-21T22:17:11.478636+0000","last_became_active":"2023-07-21T22:17:09.848835+0000","last_became_peered":"2023-07-21T22:17:09.848835+0000","last_unstale":"2023-07-21T22:17:11.478636+0000","last_undegraded":"2023-07-21T22:17:11.478636+0000","last_fullsized":"2023-07-21T22:17:11.478636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:08:03.842773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192075+0000","last_change":"2023-07-21T22:17:08.859614+0000","last_active":"2023-07-21T22:17:13.192075+0000","last_peered":"2023-07-21T22:17:13.192075+0000","last_clean":"2023-07-21T22:17:13.192075+0000","last_became_active":"2023-07-21T22:17:08.859261+0000","last_became_peered":"2023-07-21T22:17:08.859261+0000","last_unstale":"2023-07-21T22:17:13.192075+0000","last_undegraded":"2023-07-21T22:17:13.192075+0000","last_fullsized":"2023-07-21T22:17:13.192075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:41.679297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801777+0000","last_change":"2023-07-21T22:17:09.847279+0000","last_active":"2023-07-21T22:17:11.801777+0000","last_peered":"2023-07-21T22:17:11.801777+0000","last_clean":"2023-07-21T22:17:11.801777+0000","last_became_active":"2023-07-21T22:17:09.846982+0000","last_became_peered":"2023-07-21T22:17:09.846982+0000","last_unstale":"2023-07-21T22:17:11.801777+0000","last_undegraded":"2023-07-21T22:17:11.801777+0000","last_fullsized":"2023-07-21T22:17:11.801777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:04:28.959716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.201032+0000","last_change":"2023-07-21T22:17:08.857436+0000","last_active":"2023-07-21T22:17:14.201032+0000","last_peered":"2023-07-21T22:17:14.201032+0000","last_clean":"2023-07-21T22:17:14.201032+0000","last_became_active":"2023-07-21T22:17:08.857046+0000","last_became_peered":"2023-07-21T22:17:08.857046+0000","last_unstale":"2023-07-21T22:17:14.201032+0000","last_undegraded":"2023-07-21T22:17:14.201032+0000","last_fullsized":"2023-07-21T22:17:14.201032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:22:09.067121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801869+0000","last_change":"2023-07-21T22:17:09.852916+0000","last_active":"2023-07-21T22:17:11.801869+0000","last_peered":"2023-07-21T22:17:11.801869+0000","last_clean":"2023-07-21T22:17:11.801869+0000","last_became_active":"2023-07-21T22:17:09.852608+0000","last_became_peered":"2023-07-21T22:17:09.852608+0000","last_unstale":"2023-07-21T22:17:11.801869+0000","last_undegraded":"2023-07-21T22:17:11.801869+0000","last_fullsized":"2023-07-21T22:17:11.801869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:28:19.571061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477884+0000","last_change":"2023-07-21T22:17:08.859619+0000","last_active":"2023-07-21T22:17:11.477884+0000","last_peered":"2023-07-21T22:17:11.477884+0000","last_clean":"2023-07-21T22:17:11.477884+0000","last_became_active":"2023-07-21T22:17:08.859256+0000","last_became_peered":"2023-07-21T22:17:08.859256+0000","last_unstale":"2023-07-21T22:17:11.477884+0000","last_undegraded":"2023-07-21T22:17:11.477884+0000","last_fullsized":"2023-07-21T22:17:11.477884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:48.278511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801644+0000","last_change":"2023-07-21T22:17:09.850548+0000","last_active":"2023-07-21T22:17:11.801644+0000","last_peered":"2023-07-21T22:17:11.801644+0000","last_clean":"2023-07-21T22:17:11.801644+0000","last_became_active":"2023-07-21T22:17:09.850261+0000","last_became_peered":"2023-07-21T22:17:09.850261+0000","last_unstale":"2023-07-21T22:17:11.801644+0000","last_undegraded":"2023-07-21T22:17:11.801644+0000","last_fullsized":"2023-07-21T22:17:11.801644+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:46:59.385401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830285+0000","last_change":"2023-07-21T22:17:08.859729+0000","last_active":"2023-07-21T22:17:10.830285+0000","last_peered":"2023-07-21T22:17:10.830285+0000","last_clean":"2023-07-21T22:17:10.830285+0000","last_became_active":"2023-07-21T22:17:08.859421+0000","last_became_peered":"2023-07-21T22:17:08.859421+0000","last_unstale":"2023-07-21T22:17:10.830285+0000","last_undegraded":"2023-07-21T22:17:10.830285+0000","last_fullsized":"2023-07-21T22:17:10.830285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:26.110166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801893+0000","last_change":"2023-07-21T22:17:09.846413+0000","last_active":"2023-07-21T22:17:11.801893+0000","last_peered":"2023-07-21T22:17:11.801893+0000","last_clean":"2023-07-21T22:17:11.801893+0000","last_became_active":"2023-07-21T22:17:09.846038+0000","last_became_peered":"2023-07-21T22:17:09.846038+0000","last_unstale":"2023-07-21T22:17:11.801893+0000","last_undegraded":"2023-07-21T22:17:11.801893+0000","last_fullsized":"2023-07-21T22:17:11.801893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:13:22.358010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478636+0000","last_change":"2023-07-21T22:17:09.846786+0000","last_active":"2023-07-21T22:17:11.478636+0000","last_peered":"2023-07-21T22:17:11.478636+0000","last_clean":"2023-07-21T22:17:11.478636+0000","last_became_active":"2023-07-21T22:17:09.846437+0000","last_became_peered":"2023-07-21T22:17:09.846437+0000","last_unstale":"2023-07-21T22:17:11.478636+0000","last_undegraded":"2023-07-21T22:17:11.478636+0000","last_fullsized":"2023-07-21T22:17:11.478636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:59:56.822867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830355+0000","last_change":"2023-07-21T22:17:09.840000+0000","last_active":"2023-07-21T22:17:10.830355+0000","last_peered":"2023-07-21T22:17:10.830355+0000","last_clean":"2023-07-21T22:17:10.830355+0000","last_became_active":"2023-07-21T22:17:09.839674+0000","last_became_peered":"2023-07-21T22:17:09.839674+0000","last_unstale":"2023-07-21T22:17:10.830355+0000","last_undegraded":"2023-07-21T22:17:10.830355+0000","last_fullsized":"2023-07-21T22:17:10.830355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:28:39.662623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830295+0000","last_change":"2023-07-21T22:17:09.850137+0000","last_active":"2023-07-21T22:17:10.830295+0000","last_peered":"2023-07-21T22:17:10.830295+0000","last_clean":"2023-07-21T22:17:10.830295+0000","last_became_active":"2023-07-21T22:17:09.849721+0000","last_became_peered":"2023-07-21T22:17:09.849721+0000","last_unstale":"2023-07-21T22:17:10.830295+0000","last_undegraded":"2023-07-21T22:17:10.830295+0000","last_fullsized":"2023-07-21T22:17:10.830295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:26:45.318770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478870+0000","last_change":"2023-07-21T22:17:09.858573+0000","last_active":"2023-07-21T22:17:11.478870+0000","last_peered":"2023-07-21T22:17:11.478870+0000","last_clean":"2023-07-21T22:17:11.478870+0000","last_became_active":"2023-07-21T22:17:09.858017+0000","last_became_peered":"2023-07-21T22:17:09.858017+0000","last_unstale":"2023-07-21T22:17:11.478870+0000","last_undegraded":"2023-07-21T22:17:11.478870+0000","last_fullsized":"2023-07-21T22:17:11.478870+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:33:48.760338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830397+0000","last_change":"2023-07-21T22:17:09.844585+0000","last_active":"2023-07-21T22:17:10.830397+0000","last_peered":"2023-07-21T22:17:10.830397+0000","last_clean":"2023-07-21T22:17:10.830397+0000","last_became_active":"2023-07-21T22:17:09.844226+0000","last_became_peered":"2023-07-21T22:17:09.844226+0000","last_unstale":"2023-07-21T22:17:10.830397+0000","last_undegraded":"2023-07-21T22:17:10.830397+0000","last_fullsized":"2023-07-21T22:17:10.830397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:52.605557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478809+0000","last_change":"2023-07-21T22:17:09.845251+0000","last_active":"2023-07-21T22:17:11.478809+0000","last_peered":"2023-07-21T22:17:11.478809+0000","last_clean":"2023-07-21T22:17:11.478809+0000","last_became_active":"2023-07-21T22:17:09.844945+0000","last_became_peered":"2023-07-21T22:17:09.844945+0000","last_unstale":"2023-07-21T22:17:11.478809+0000","last_undegraded":"2023-07-21T22:17:11.478809+0000","last_fullsized":"2023-07-21T22:17:11.478809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:47.734064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830657+0000","last_change":"2023-07-21T22:17:09.850953+0000","last_active":"2023-07-21T22:17:10.830657+0000","last_peered":"2023-07-21T22:17:10.830657+0000","last_clean":"2023-07-21T22:17:10.830657+0000","last_became_active":"2023-07-21T22:17:09.850627+0000","last_became_peered":"2023-07-21T22:17:09.850627+0000","last_unstale":"2023-07-21T22:17:10.830657+0000","last_undegraded":"2023-07-21T22:17:10.830657+0000","last_fullsized":"2023-07-21T22:17:10.830657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:58.511942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478540+0000","last_change":"2023-07-21T22:17:09.841222+0000","last_active":"2023-07-21T22:17:11.478540+0000","last_peered":"2023-07-21T22:17:11.478540+0000","last_clean":"2023-07-21T22:17:11.478540+0000","last_became_active":"2023-07-21T22:17:09.840864+0000","last_became_peered":"2023-07-21T22:17:09.840864+0000","last_unstale":"2023-07-21T22:17:11.478540+0000","last_undegraded":"2023-07-21T22:17:11.478540+0000","last_fullsized":"2023-07-21T22:17:11.478540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:18:58.614605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477972+0000","last_change":"2023-07-21T22:17:09.837688+0000","last_active":"2023-07-21T22:17:11.477972+0000","last_peered":"2023-07-21T22:17:11.477972+0000","last_clean":"2023-07-21T22:17:11.477972+0000","last_became_active":"2023-07-21T22:17:09.837325+0000","last_became_peered":"2023-07-21T22:17:09.837325+0000","last_unstale":"2023-07-21T22:17:11.477972+0000","last_undegraded":"2023-07-21T22:17:11.477972+0000","last_fullsized":"2023-07-21T22:17:11.477972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:06.875774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479430+0000","last_change":"2023-07-21T22:17:09.843791+0000","last_active":"2023-07-21T22:17:11.479430+0000","last_peered":"2023-07-21T22:17:11.479430+0000","last_clean":"2023-07-21T22:17:11.479430+0000","last_became_active":"2023-07-21T22:17:09.843438+0000","last_became_peered":"2023-07-21T22:17:09.843438+0000","last_unstale":"2023-07-21T22:17:11.479430+0000","last_undegraded":"2023-07-21T22:17:11.479430+0000","last_fullsized":"2023-07-21T22:17:11.479430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:47.855493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477783+0000","last_change":"2023-07-21T22:17:09.849062+0000","last_active":"2023-07-21T22:17:11.477783+0000","last_peered":"2023-07-21T22:17:11.477783+0000","last_clean":"2023-07-21T22:17:11.477783+0000","last_became_active":"2023-07-21T22:17:09.848153+0000","last_became_peered":"2023-07-21T22:17:09.848153+0000","last_unstale":"2023-07-21T22:17:11.477783+0000","last_undegraded":"2023-07-21T22:17:11.477783+0000","last_fullsized":"2023-07-21T22:17:11.477783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:27.818555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830442+0000","last_change":"2023-07-21T22:17:09.849010+0000","last_active":"2023-07-21T22:17:10.830442+0000","last_peered":"2023-07-21T22:17:10.830442+0000","last_clean":"2023-07-21T22:17:10.830442+0000","last_became_active":"2023-07-21T22:17:09.848679+0000","last_became_peered":"2023-07-21T22:17:09.848679+0000","last_unstale":"2023-07-21T22:17:10.830442+0000","last_undegraded":"2023-07-21T22:17:10.830442+0000","last_fullsized":"2023-07-21T22:17:10.830442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:50:35.889211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478855+0000","last_change":"2023-07-21T22:17:09.846419+0000","last_active":"2023-07-21T22:17:11.478855+0000","last_peered":"2023-07-21T22:17:11.478855+0000","last_clean":"2023-07-21T22:17:11.478855+0000","last_became_active":"2023-07-21T22:17:09.846037+0000","last_became_peered":"2023-07-21T22:17:09.846037+0000","last_unstale":"2023-07-21T22:17:11.478855+0000","last_undegraded":"2023-07-21T22:17:11.478855+0000","last_fullsized":"2023-07-21T22:17:11.478855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:51:17.356984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248938,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5078,"num_objects":55,"num_object_clones":0,"num_object_copies":165,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":114,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":35,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":196608,"data_stored":11576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":99,"ondisk_log_size":99,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383694,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27844,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717308,"statfs":{"total":95995035648,"available":95966523392,"internally_reserved":0,"allocated":913408,"data_stored":438309,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":10,"up_from":72,"seq":309237645332,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27916,"kb_used_data":964,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717236,"statfs":{"total":95995035648,"available":95966449664,"internally_reserved":0,"allocated":987136,"data_stored":1030435,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":1,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.41299999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.60899999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.64400000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.379}]},{"osd":5,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.67500000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.68700000000000006}]},{"osd":7,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.63800000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.77300000000000002},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.59199999999999997}]},{"osd":9,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.82099999999999995},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.66100000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85999999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":933888,"data_stored":439127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.748}]},{"osd":8,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.92700000000000005}]},{"osd":10,"last update":"Fri Jul 21 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.88600000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070494,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":933888,"data_stored":439047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86199999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85099999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.999}]},{"osd":1,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93799999999999994,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.081,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.87}]},{"osd":2,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88100000000000001,"5min":1.056,"15min":1.056},"last":0.626},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94199999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.081,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.745,"15min":0.754},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94499999999999995,"5min":0.995,"15min":0.995},"last":0.90300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.82699999999999996,"15min":0.84399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.03,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.46000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95399999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98699999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.88300000000000001,"15min":0.90400000000000003},"min":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.165,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.92200000000000004,"15min":0.94099999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1020000000000001,"5min":1.282,"15min":1.282},"last":0.93100000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.89500000000000002,"15min":0.91100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0660000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.91500000000000004,"15min":0.92900000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.246,"5min":1.321,"15min":1.321},"last":1.1299999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.97999999999999998}]},{"osd":10,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.1040000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":7,"up_from":51,"seq":219043332130,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":1020358,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.34999999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.48999999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.753,"5min":0.68799999999999994,"15min":0.67700000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.50900000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.746,"15min":0.72599999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92100000000000004,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.40699999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.96799999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.80600000000000005,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0289999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.59599999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81299999999999994,"15min":0.81399999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0249999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.73999999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80100000000000005,"15min":0.79700000000000004},"min":{"1min":0.46400000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.82699999999999996,"15min":0.81699999999999995},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.81000000000000005}]},{"osd":9,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.48899999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.65900000000000003}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":438522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73299999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88800000000000001,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.143,"15min":1.143},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.83899999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.0049999999999999,"5min":1.075,"15min":1.075},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.621,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76600000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71299999999999997,"15min":0.72999999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85099999999999998,"5min":1.25,"15min":1.25},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92400000000000004,"5min":3.8759999999999999,"15min":3.8759999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.52800000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.52100000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.62,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.006,"5min":1.071,"15min":1.071},"last":0.77600000000000002}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98499999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.82799999999999996,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":4.0119999999999996,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.752}]},{"osd":9,"last update":"Fri Jul 21 22:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.80700000000000005}]},{"osd":10,"last update":"Fri Jul 21 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":439600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92000000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.624}]},{"osd":2,"last update":"Fri Jul 21 22:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.86599999999999999,"5min":0.874,"15min":0.874},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.73299999999999998,"15min":0.69099999999999995},"min":{"1min":0.505,"5min":0.438,"15min":0.438},"max":{"1min":7.2720000000000002,"5min":7.2720000000000002,"15min":7.2720000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.56599999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.48699999999999999,"15min":0.47099999999999997},"min":{"1min":0.38100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.50700000000000001,"15min":0.48899999999999999},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.54800000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.877,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67000000000000004,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.754}]},{"osd":6,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.74399999999999999,"15min":0.72099999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0189999999999999,"5min":1.036,"15min":1.036},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79500000000000004,"15min":0.74099999999999999},"min":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":0.83599999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.79400000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78000000000000003,"15min":0.77800000000000002},"min":{"1min":0.61099999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97699999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.68100000000000005,"5min":0.62,"15min":0.62},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.875}]},{"osd":9,"last update":"Fri Jul 21 22:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":7.4530000000000003,"5min":7.4530000000000003,"15min":7.4530000000000003},"last":0.86599999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.89500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":438399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.67600000000000005,"15min":0.63500000000000001},"min":{"1min":0.52900000000000003,"5min":0.432,"15min":0.432},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.64100000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85699999999999998,"5min":0.878,"15min":0.878},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.749,"5min":0.629,"15min":0.59699999999999998},"min":{"1min":0.46899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.62}]},{"osd":3,"last update":"Fri Jul 21 22:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.46100000000000002},"min":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.77400000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:16:14 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.624,"15min":0.59699999999999998},"min":{"1min":0.496,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.75600000000000001,"5min":0.67100000000000004,"15min":0.64300000000000002},"min":{"1min":0.53100000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.95099999999999996,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.52000000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.57999999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:17:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.95499999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.70099999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.751}]},{"osd":8,"last update":"Fri Jul 21 22:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.75700000000000001}]},{"osd":9,"last update":"Fri Jul 21 22:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.91700000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.74299999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.72099999999999997},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":7.5209999999999999,"5min":7.5209999999999999,"15min":7.5209999999999999},"last":0.79400000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":933888,"data_stored":440208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.51200000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.73099999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.63600000000000001,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.64000000000000001,"15min":0.60299999999999998},"min":{"1min":0.49199999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65700000000000003,"15min":0.63200000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.749},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.69399999999999995,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59599999999999997,"15min":0.56499999999999995},"min":{"1min":0.46300000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.97199999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.57299999999999995,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.435}]},{"osd":6,"last update":"Fri Jul 21 22:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60999999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":0.82899999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.286,"5min":1.409,"15min":1.409},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.48499999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.76500000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.71499999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":933888,"data_stored":438716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41999999999999998,"15min":0.40400000000000003},"min":{"1min":0.33100000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.42899999999999999},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.63500000000000001,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.66900000000000004,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0840000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68400000000000005,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.67300000000000004,"15min":0.63900000000000001},"min":{"1min":0.53100000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":1.093,"15min":1.093},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.745,"15min":0.69099999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97099999999999997,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.77200000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.82199999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72699999999999998,"15min":0.71199999999999997},"min":{"1min":0.623,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.71699999999999997,"15min":0.69099999999999995},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1739999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.05,"15min":1.0800000000000001},"min":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1180000000000001,"5min":6.9740000000000002,"15min":6.9740000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.089,"15min":1.1220000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.24,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.752}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.1140000000000001,"15min":1.157},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.083,"5min":7.0030000000000001,"15min":7.0030000000000001},"last":0.629},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1080000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73499999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71199999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.73999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":925696,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.873,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.46500000000000002,"15min":0.42799999999999999},"min":{"1min":0.35899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67100000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.49199999999999999,"15min":0.44900000000000001},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.64700000000000002},"min":{"1min":0.56299999999999994,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70499999999999996,"15min":0.65900000000000003},"min":{"1min":0.57199999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64300000000000002,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.95299999999999996,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67100000000000004,"15min":0.62},"min":{"1min":0.437,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0329999999999999,"5min":1.236,"15min":1.236},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.504,"5min":0.503,"15min":0.503},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.63200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56699999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0740000000000001,"5min":1.093,"15min":1.093},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.79700000000000004},"min":{"1min":0.64600000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0529999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.67000000000000004,"15min":0.64900000000000002},"min":{"1min":0.51200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64200000000000002}]},{"osd":8,"last update":"Fri Jul 21 22:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.84099999999999997,"15min":0.82599999999999996},"min":{"1min":0.71499999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.749}]},{"osd":9,"last update":"Fri Jul 21 22:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.65800000000000003}]},{"osd":10,"last update":"Fri Jul 21 22:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.79500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757294,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":991232,"data_stored":1030105,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.61899999999999999,"15min":0.58599999999999997},"min":{"1min":0.55700000000000005,"5min":0.374,"15min":0.374},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.999,"5min":0.71399999999999997,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":6.9340000000000002,"5min":6.9340000000000002,"15min":6.9340000000000002},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48799999999999999,"15min":0.47499999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.495},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.877,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.70399999999999996,"15min":0.65600000000000003},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.9160000000000004,"5min":6.9160000000000004,"15min":6.9160000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.72199999999999998,"15min":0.67100000000000004},"min":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":7.0129999999999999,"5min":7.0129999999999999,"15min":7.0129999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.68200000000000005,"15min":0.65000000000000002},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.56299999999999994,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.78100000000000003,"15min":0.73499999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.873,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80200000000000005,"15min":0.80000000000000004},"min":{"1min":0.64600000000000002,"5min":0.63,"15min":0.63},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.754},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77600000000000002,"15min":0.77200000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59399999999999997}]},{"osd":8,"last update":"Fri Jul 21 22:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.65500000000000003}]},{"osd":9,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68100000000000005}]},{"osd":10,"last update":"Fri Jul 21 22:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:17:18.611 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:17:18.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:18 smithi187 ceph-mon[96918]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:18.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:18 smithi187 ceph-mon[96918]: pgmap v302: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 4.7 KiB/s wr, 14 op/s 2023-07-21T22:17:18.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:18 smithi187 ceph-mon[96918]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:18.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:18 smithi187 ceph-mon[96918]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-07-21T22:17:18.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:18 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/72610857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:18.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:18 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3782498302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:18 smithi195 ceph-mon[97365]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:18 smithi195 ceph-mon[97365]: pgmap v302: 97 pgs: 97 active+clean; 581 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 383 B/s rd, 4.7 KiB/s wr, 14 op/s 2023-07-21T22:17:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:18 smithi195 ceph-mon[97365]: from='client.14814 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:17:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:18 smithi195 ceph-mon[97365]: mgrmap e17: x(active, since 7m), standbys: z, y 2023-07-21T22:17:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:18 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/72610857' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:17:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:18 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3782498302' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:18.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.795+0000 7fab85fff700 1 -- 172.21.15.151:0/3197877655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab80100cf0 msgr2=0x7fab80101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.795+0000 7fab85fff700 1 --2- 172.21.15.151:0/3197877655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab80100cf0 0x7fab80101140 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fab74009990 tx=0x7fab74009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.795+0000 7fab85fff700 1 -- 172.21.15.151:0/3197877655 shutdown_connections 2023-07-21T22:17:18.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.795+0000 7fab85fff700 1 --2- 172.21.15.151:0/3197877655 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab80101680 0x7fab80107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.795+0000 7fab85fff700 1 --2- 172.21.15.151:0/3197877655 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab800ffb00 0x7fab800fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.795+0000 7fab85fff700 1 --2- 172.21.15.151:0/3197877655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab80100cf0 0x7fab80101140 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.795+0000 7fab85fff700 1 -- 172.21.15.151:0/3197877655 >> 172.21.15.151:0/3197877655 conn(0x7fab800fb0e0 msgr2=0x7fab800fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:18.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.795+0000 7fab85fff700 1 -- 172.21.15.151:0/3197877655 shutdown_connections 2023-07-21T22:17:18.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.796+0000 7fab85fff700 1 -- 172.21.15.151:0/3197877655 wait complete. 2023-07-21T22:17:18.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.796+0000 7fab85fff700 1 Processor -- start 2023-07-21T22:17:18.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab85fff700 1 -- start start 2023-07-21T22:17:18.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab85fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab800ffb00 0x7fab800742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:18.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab85fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab80100cf0 0x7fab80072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:18.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab85fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab80101680 0x7fab80072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:18.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab85fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab800735e0 con 0x7fab800ffb00 2023-07-21T22:17:18.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab85fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80073750 con 0x7fab80100cf0 2023-07-21T22:17:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab85fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8019f890 con 0x7fab80101680 2023-07-21T22:17:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab7f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab800ffb00 0x7fab800742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab7f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab800ffb00 0x7fab800742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53198/0 (socket says 172.21.15.151:53198) 2023-07-21T22:17:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab7f7fe700 1 -- 172.21.15.151:0/3392500919 learned_addr learned my addr 172.21.15.151:0/3392500919 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab7f7fe700 1 -- 172.21.15.151:0/3392500919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab80101680 msgr2=0x7fab80072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab7f7fe700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab80101680 0x7fab80072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab7f7fe700 1 -- 172.21.15.151:0/3392500919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab80100cf0 msgr2=0x7fab80072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab7f7fe700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab80100cf0 0x7fab80072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.797+0000 7fab7f7fe700 1 -- 172.21.15.151:0/3392500919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab740095f0 con 0x7fab800ffb00 2023-07-21T22:17:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.798+0000 7fab7f7fe700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab800ffb00 0x7fab800742c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e970 tx=0x7fab7000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.798+0000 7fab7cff9700 1 -- 172.21.15.151:0/3392500919 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70009790 con 0x7fab800ffb00 2023-07-21T22:17:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.798+0000 7fab7cff9700 1 -- 172.21.15.151:0/3392500919 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab700044b0 con 0x7fab800ffb00 2023-07-21T22:17:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.798+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8019fb70 con 0x7fab800ffb00 2023-07-21T22:17:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.798+0000 7fab7cff9700 1 -- 172.21.15.151:0/3392500919 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab70003dd0 con 0x7fab800ffb00 2023-07-21T22:17:18.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.798+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab801a00d0 con 0x7fab800ffb00 2023-07-21T22:17:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.799+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab801070a0 con 0x7fab800ffb00 2023-07-21T22:17:18.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.801+0000 7fab7cff9700 1 -- 172.21.15.151:0/3392500919 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fab70003f30 con 0x7fab800ffb00 2023-07-21T22:17:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.802+0000 7fab7cff9700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab680a1320 0x7fab680a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.802+0000 7fab7cff9700 1 -- 172.21.15.151:0/3392500919 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fab70014070 con 0x7fab800ffb00 2023-07-21T22:17:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.803+0000 7fab7effd700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab680a1320 0x7fab680a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:18.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.803+0000 7fab7effd700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab680a1320 0x7fab680a37d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fab74005910 tx=0x7fab74005e80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:18.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:18.806+0000 7fab7cff9700 1 -- 172.21.15.151:0/3392500919 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fab700cee60 con 0x7fab800ffb00 2023-07-21T22:17:19.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.003+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fab80061310 con 0x7fab680a1320 2023-07-21T22:17:19.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.013+0000 7fab7cff9700 1 -- 172.21.15.151:0/3392500919 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339445 (secure 0 0 0) 0x7fab80061310 con 0x7fab680a1320 2023-07-21T22:17:19.061 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:19.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab680a1320 msgr2=0x7fab680a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:19.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab680a1320 0x7fab680a37d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fab74005910 tx=0x7fab74005e80 comp rx=0 tx=0).stop 2023-07-21T22:17:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab800ffb00 msgr2=0x7fab800742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab800ffb00 0x7fab800742c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fab7000e970 tx=0x7fab7000ed30 comp rx=0 tx=0).stop 2023-07-21T22:17:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 shutdown_connections 2023-07-21T22:17:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab680a1320 0x7fab680a37d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab80101680 0x7fab80072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:19.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab800ffb00 0x7fab800742c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:19.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 --2- 172.21.15.151:0/3392500919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab80100cf0 0x7fab80072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:19.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 >> 172.21.15.151:0/3392500919 conn(0x7fab800fb0e0 msgr2=0x7fab801041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:19.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 shutdown_connections 2023-07-21T22:17:19.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:19.018+0000 7fab85fff700 1 -- 172.21.15.151:0/3392500919 wait complete. 2023-07-21T22:17:19.065 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-07-21T22:17:19.081 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":303,"stamp":"2023-07-21T22:17:18.851752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":630365,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":155,"num_read_kb":166,"num_write":316,"num_write_kb":3013,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":256,"ondisk_log_size":256,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334536,"kb_used_data":11112,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124607288,"statfs":{"total":1151940427776,"available":1151597862912,"internally_reserved":0,"allocated":11378688,"data_stored":7080420,"data_compressed":108096,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39997,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":19,"num_read_kb":47,"num_write":135,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.029861"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478881+0000","last_change":"2023-07-21T22:17:09.850731+0000","last_active":"2023-07-21T22:17:11.478881+0000","last_peered":"2023-07-21T22:17:11.478881+0000","last_clean":"2023-07-21T22:17:11.478881+0000","last_became_active":"2023-07-21T22:17:09.849185+0000","last_became_peered":"2023-07-21T22:17:09.849185+0000","last_unstale":"2023-07-21T22:17:11.478881+0000","last_undegraded":"2023-07-21T22:17:11.478881+0000","last_fullsized":"2023-07-21T22:17:11.478881+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:21:18.058431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478539+0000","last_change":"2023-07-21T22:17:09.853210+0000","last_active":"2023-07-21T22:17:11.478539+0000","last_peered":"2023-07-21T22:17:11.478539+0000","last_clean":"2023-07-21T22:17:11.478539+0000","last_became_active":"2023-07-21T22:17:09.852822+0000","last_became_peered":"2023-07-21T22:17:09.852822+0000","last_unstale":"2023-07-21T22:17:11.478539+0000","last_undegraded":"2023-07-21T22:17:11.478539+0000","last_fullsized":"2023-07-21T22:17:11.478539+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:41:05.228164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479336+0000","last_change":"2023-07-21T22:17:09.850123+0000","last_active":"2023-07-21T22:17:11.479336+0000","last_peered":"2023-07-21T22:17:11.479336+0000","last_clean":"2023-07-21T22:17:11.479336+0000","last_became_active":"2023-07-21T22:17:09.849763+0000","last_became_peered":"2023-07-21T22:17:09.849763+0000","last_unstale":"2023-07-21T22:17:11.479336+0000","last_undegraded":"2023-07-21T22:17:11.479336+0000","last_fullsized":"2023-07-21T22:17:11.479336+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:06:07.694600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.911099+0000","last_change":"2023-07-21T22:17:09.850462+0000","last_active":"2023-07-21T22:17:10.911099+0000","last_peered":"2023-07-21T22:17:10.911099+0000","last_clean":"2023-07-21T22:17:10.911099+0000","last_became_active":"2023-07-21T22:17:09.850119+0000","last_became_peered":"2023-07-21T22:17:09.850119+0000","last_unstale":"2023-07-21T22:17:10.911099+0000","last_undegraded":"2023-07-21T22:17:10.911099+0000","last_fullsized":"2023-07-21T22:17:10.911099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:59:58.470987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880661+0000","last_change":"2023-07-21T22:17:09.836811+0000","last_active":"2023-07-21T22:17:10.880661+0000","last_peered":"2023-07-21T22:17:10.880661+0000","last_clean":"2023-07-21T22:17:10.880661+0000","last_became_active":"2023-07-21T22:17:09.836470+0000","last_became_peered":"2023-07-21T22:17:09.836470+0000","last_unstale":"2023-07-21T22:17:10.880661+0000","last_undegraded":"2023-07-21T22:17:10.880661+0000","last_fullsized":"2023-07-21T22:17:10.880661+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:50:47.112985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830817+0000","last_change":"2023-07-21T22:17:09.845801+0000","last_active":"2023-07-21T22:17:10.830817+0000","last_peered":"2023-07-21T22:17:10.830817+0000","last_clean":"2023-07-21T22:17:10.830817+0000","last_became_active":"2023-07-21T22:17:09.844938+0000","last_became_peered":"2023-07-21T22:17:09.844938+0000","last_unstale":"2023-07-21T22:17:10.830817+0000","last_undegraded":"2023-07-21T22:17:10.830817+0000","last_fullsized":"2023-07-21T22:17:10.830817+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:24:19.472950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801512+0000","last_change":"2023-07-21T22:17:09.850392+0000","last_active":"2023-07-21T22:17:11.801512+0000","last_peered":"2023-07-21T22:17:11.801512+0000","last_clean":"2023-07-21T22:17:11.801512+0000","last_became_active":"2023-07-21T22:17:09.850013+0000","last_became_peered":"2023-07-21T22:17:09.850013+0000","last_unstale":"2023-07-21T22:17:11.801512+0000","last_undegraded":"2023-07-21T22:17:11.801512+0000","last_fullsized":"2023-07-21T22:17:11.801512+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:37:01.907515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479233+0000","last_change":"2023-07-21T22:17:09.845425+0000","last_active":"2023-07-21T22:17:11.479233+0000","last_peered":"2023-07-21T22:17:11.479233+0000","last_clean":"2023-07-21T22:17:11.479233+0000","last_became_active":"2023-07-21T22:17:09.845090+0000","last_became_peered":"2023-07-21T22:17:09.845090+0000","last_unstale":"2023-07-21T22:17:11.479233+0000","last_undegraded":"2023-07-21T22:17:11.479233+0000","last_fullsized":"2023-07-21T22:17:11.479233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:54:57.327790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478316+0000","last_change":"2023-07-21T22:17:09.845600+0000","last_active":"2023-07-21T22:17:11.478316+0000","last_peered":"2023-07-21T22:17:11.478316+0000","last_clean":"2023-07-21T22:17:11.478316+0000","last_became_active":"2023-07-21T22:17:09.845260+0000","last_became_peered":"2023-07-21T22:17:09.845260+0000","last_unstale":"2023-07-21T22:17:11.478316+0000","last_undegraded":"2023-07-21T22:17:11.478316+0000","last_fullsized":"2023-07-21T22:17:11.478316+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:02.052057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830968+0000","last_change":"2023-07-21T22:17:09.846172+0000","last_active":"2023-07-21T22:17:10.830968+0000","last_peered":"2023-07-21T22:17:10.830968+0000","last_clean":"2023-07-21T22:17:10.830968+0000","last_became_active":"2023-07-21T22:17:09.845827+0000","last_became_peered":"2023-07-21T22:17:09.845827+0000","last_unstale":"2023-07-21T22:17:10.830968+0000","last_undegraded":"2023-07-21T22:17:10.830968+0000","last_fullsized":"2023-07-21T22:17:10.830968+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:40.926651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801831+0000","last_change":"2023-07-21T22:17:09.852728+0000","last_active":"2023-07-21T22:17:11.801831+0000","last_peered":"2023-07-21T22:17:11.801831+0000","last_clean":"2023-07-21T22:17:11.801831+0000","last_became_active":"2023-07-21T22:17:09.852152+0000","last_became_peered":"2023-07-21T22:17:09.852152+0000","last_unstale":"2023-07-21T22:17:11.801831+0000","last_undegraded":"2023-07-21T22:17:11.801831+0000","last_fullsized":"2023-07-21T22:17:11.801831+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:20:15.335454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.911051+0000","last_change":"2023-07-21T22:17:09.850565+0000","last_active":"2023-07-21T22:17:10.911051+0000","last_peered":"2023-07-21T22:17:10.911051+0000","last_clean":"2023-07-21T22:17:10.911051+0000","last_became_active":"2023-07-21T22:17:09.850162+0000","last_became_peered":"2023-07-21T22:17:09.850162+0000","last_unstale":"2023-07-21T22:17:10.911051+0000","last_undegraded":"2023-07-21T22:17:10.911051+0000","last_fullsized":"2023-07-21T22:17:10.911051+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:02.870883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830349+0000","last_change":"2023-07-21T22:17:09.836732+0000","last_active":"2023-07-21T22:17:10.830349+0000","last_peered":"2023-07-21T22:17:10.830349+0000","last_clean":"2023-07-21T22:17:10.830349+0000","last_became_active":"2023-07-21T22:17:09.836446+0000","last_became_peered":"2023-07-21T22:17:09.836446+0000","last_unstale":"2023-07-21T22:17:10.830349+0000","last_undegraded":"2023-07-21T22:17:10.830349+0000","last_fullsized":"2023-07-21T22:17:10.830349+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:36:58.962790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478543+0000","last_change":"2023-07-21T22:17:09.852624+0000","last_active":"2023-07-21T22:17:11.478543+0000","last_peered":"2023-07-21T22:17:11.478543+0000","last_clean":"2023-07-21T22:17:11.478543+0000","last_became_active":"2023-07-21T22:17:09.852353+0000","last_became_peered":"2023-07-21T22:17:09.852353+0000","last_unstale":"2023-07-21T22:17:11.478543+0000","last_undegraded":"2023-07-21T22:17:11.478543+0000","last_fullsized":"2023-07-21T22:17:11.478543+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:09.532957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478910+0000","last_change":"2023-07-21T22:17:09.860554+0000","last_active":"2023-07-21T22:17:11.478910+0000","last_peered":"2023-07-21T22:17:11.478910+0000","last_clean":"2023-07-21T22:17:11.478910+0000","last_became_active":"2023-07-21T22:17:09.860119+0000","last_became_peered":"2023-07-21T22:17:09.860119+0000","last_unstale":"2023-07-21T22:17:11.478910+0000","last_undegraded":"2023-07-21T22:17:11.478910+0000","last_fullsized":"2023-07-21T22:17:11.478910+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:27:35.587050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477738+0000","last_change":"2023-07-21T22:17:09.850522+0000","last_active":"2023-07-21T22:17:11.477738+0000","last_peered":"2023-07-21T22:17:11.477738+0000","last_clean":"2023-07-21T22:17:11.477738+0000","last_became_active":"2023-07-21T22:17:09.850243+0000","last_became_peered":"2023-07-21T22:17:09.850243+0000","last_unstale":"2023-07-21T22:17:11.477738+0000","last_undegraded":"2023-07-21T22:17:11.477738+0000","last_fullsized":"2023-07-21T22:17:11.477738+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:22:40.596690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478978+0000","last_change":"2023-07-21T22:17:09.848552+0000","last_active":"2023-07-21T22:17:11.478978+0000","last_peered":"2023-07-21T22:17:11.478978+0000","last_clean":"2023-07-21T22:17:11.478978+0000","last_became_active":"2023-07-21T22:17:09.848110+0000","last_became_peered":"2023-07-21T22:17:09.848110+0000","last_unstale":"2023-07-21T22:17:11.478978+0000","last_undegraded":"2023-07-21T22:17:11.478978+0000","last_fullsized":"2023-07-21T22:17:11.478978+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:48:00.673904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479417+0000","last_change":"2023-07-21T22:17:09.848899+0000","last_active":"2023-07-21T22:17:11.479417+0000","last_peered":"2023-07-21T22:17:11.479417+0000","last_clean":"2023-07-21T22:17:11.479417+0000","last_became_active":"2023-07-21T22:17:09.848606+0000","last_became_peered":"2023-07-21T22:17:09.848606+0000","last_unstale":"2023-07-21T22:17:11.479417+0000","last_undegraded":"2023-07-21T22:17:11.479417+0000","last_fullsized":"2023-07-21T22:17:11.479417+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:45:42.525488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830577+0000","last_change":"2023-07-21T22:17:09.838033+0000","last_active":"2023-07-21T22:17:10.830577+0000","last_peered":"2023-07-21T22:17:10.830577+0000","last_clean":"2023-07-21T22:17:10.830577+0000","last_became_active":"2023-07-21T22:17:09.837532+0000","last_became_peered":"2023-07-21T22:17:09.837532+0000","last_unstale":"2023-07-21T22:17:10.830577+0000","last_undegraded":"2023-07-21T22:17:10.830577+0000","last_fullsized":"2023-07-21T22:17:10.830577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:15:57.879349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":24,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.201465+0000","last_change":"2023-07-21T22:17:08.867849+0000","last_active":"2023-07-21T22:17:14.201465+0000","last_peered":"2023-07-21T22:17:14.201465+0000","last_clean":"2023-07-21T22:17:14.201465+0000","last_became_active":"2023-07-21T22:17:08.866245+0000","last_became_peered":"2023-07-21T22:17:08.866245+0000","last_unstale":"2023-07-21T22:17:14.201465+0000","last_undegraded":"2023-07-21T22:17:14.201465+0000","last_fullsized":"2023-07-21T22:17:14.201465+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:23:09.910672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478988+0000","last_change":"2023-07-21T22:17:09.841402+0000","last_active":"2023-07-21T22:17:11.478988+0000","last_peered":"2023-07-21T22:17:11.478988+0000","last_clean":"2023-07-21T22:17:11.478988+0000","last_became_active":"2023-07-21T22:17:09.841009+0000","last_became_peered":"2023-07-21T22:17:09.841009+0000","last_unstale":"2023-07-21T22:17:11.478988+0000","last_undegraded":"2023-07-21T22:17:11.478988+0000","last_fullsized":"2023-07-21T22:17:11.478988+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:22:36.460866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.702373+0000","last_change":"2023-07-21T22:17:08.864236+0000","last_active":"2023-07-21T22:17:11.702373+0000","last_peered":"2023-07-21T22:17:11.702373+0000","last_clean":"2023-07-21T22:17:11.702373+0000","last_became_active":"2023-07-21T22:17:08.863579+0000","last_became_peered":"2023-07-21T22:17:08.863579+0000","last_unstale":"2023-07-21T22:17:11.702373+0000","last_undegraded":"2023-07-21T22:17:11.702373+0000","last_fullsized":"2023-07-21T22:17:11.702373+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:52:52.715957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479141+0000","last_change":"2023-07-21T22:17:09.852677+0000","last_active":"2023-07-21T22:17:11.479141+0000","last_peered":"2023-07-21T22:17:11.479141+0000","last_clean":"2023-07-21T22:17:11.479141+0000","last_became_active":"2023-07-21T22:17:09.852326+0000","last_became_peered":"2023-07-21T22:17:09.852326+0000","last_unstale":"2023-07-21T22:17:11.479141+0000","last_undegraded":"2023-07-21T22:17:11.479141+0000","last_fullsized":"2023-07-21T22:17:11.479141+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:41:25.896020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.197559+0000","last_change":"2023-07-21T22:17:08.867521+0000","last_active":"2023-07-21T22:17:14.197559+0000","last_peered":"2023-07-21T22:17:14.197559+0000","last_clean":"2023-07-21T22:17:14.197559+0000","last_became_active":"2023-07-21T22:17:08.867125+0000","last_became_peered":"2023-07-21T22:17:08.867125+0000","last_unstale":"2023-07-21T22:17:14.197559+0000","last_undegraded":"2023-07-21T22:17:14.197559+0000","last_fullsized":"2023-07-21T22:17:14.197559+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:42:52.689349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477902+0000","last_change":"2023-07-21T22:17:09.846296+0000","last_active":"2023-07-21T22:17:11.477902+0000","last_peered":"2023-07-21T22:17:11.477902+0000","last_clean":"2023-07-21T22:17:11.477902+0000","last_became_active":"2023-07-21T22:17:09.845947+0000","last_became_peered":"2023-07-21T22:17:09.845947+0000","last_unstale":"2023-07-21T22:17:11.477902+0000","last_undegraded":"2023-07-21T22:17:11.477902+0000","last_fullsized":"2023-07-21T22:17:11.477902+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:34:21.306139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.881094+0000","last_change":"2023-07-21T22:17:08.866709+0000","last_active":"2023-07-21T22:17:10.881094+0000","last_peered":"2023-07-21T22:17:10.881094+0000","last_clean":"2023-07-21T22:17:10.881094+0000","last_became_active":"2023-07-21T22:17:08.866277+0000","last_became_peered":"2023-07-21T22:17:08.866277+0000","last_unstale":"2023-07-21T22:17:10.881094+0000","last_undegraded":"2023-07-21T22:17:10.881094+0000","last_fullsized":"2023-07-21T22:17:10.881094+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:13.405996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477930+0000","last_change":"2023-07-21T22:17:09.855068+0000","last_active":"2023-07-21T22:17:11.477930+0000","last_peered":"2023-07-21T22:17:11.477930+0000","last_clean":"2023-07-21T22:17:11.477930+0000","last_became_active":"2023-07-21T22:17:09.854697+0000","last_became_peered":"2023-07-21T22:17:09.854697+0000","last_unstale":"2023-07-21T22:17:11.477930+0000","last_undegraded":"2023-07-21T22:17:11.477930+0000","last_fullsized":"2023-07-21T22:17:11.477930+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:51.198897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":19,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192160+0000","last_change":"2023-07-21T22:17:08.864292+0000","last_active":"2023-07-21T22:17:13.192160+0000","last_peered":"2023-07-21T22:17:13.192160+0000","last_clean":"2023-07-21T22:17:13.192160+0000","last_became_active":"2023-07-21T22:17:08.863243+0000","last_became_peered":"2023-07-21T22:17:08.863243+0000","last_unstale":"2023-07-21T22:17:13.192160+0000","last_undegraded":"2023-07-21T22:17:13.192160+0000","last_fullsized":"2023-07-21T22:17:13.192160+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:31:13.356180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880612+0000","last_change":"2023-07-21T22:17:09.840756+0000","last_active":"2023-07-21T22:17:10.880612+0000","last_peered":"2023-07-21T22:17:10.880612+0000","last_clean":"2023-07-21T22:17:10.880612+0000","last_became_active":"2023-07-21T22:17:09.840421+0000","last_became_peered":"2023-07-21T22:17:09.840421+0000","last_unstale":"2023-07-21T22:17:10.880612+0000","last_undegraded":"2023-07-21T22:17:10.880612+0000","last_fullsized":"2023-07-21T22:17:10.880612+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:10:30.331025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.198556+0000","last_change":"2023-07-21T22:17:08.860265+0000","last_active":"2023-07-21T22:17:14.198556+0000","last_peered":"2023-07-21T22:17:14.198556+0000","last_clean":"2023-07-21T22:17:14.198556+0000","last_became_active":"2023-07-21T22:17:08.859900+0000","last_became_peered":"2023-07-21T22:17:08.859900+0000","last_unstale":"2023-07-21T22:17:14.198556+0000","last_undegraded":"2023-07-21T22:17:14.198556+0000","last_fullsized":"2023-07-21T22:17:14.198556+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:59:26.216426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478133+0000","last_change":"2023-07-21T22:17:09.839359+0000","last_active":"2023-07-21T22:17:11.478133+0000","last_peered":"2023-07-21T22:17:11.478133+0000","last_clean":"2023-07-21T22:17:11.478133+0000","last_became_active":"2023-07-21T22:17:09.839026+0000","last_became_peered":"2023-07-21T22:17:09.839026+0000","last_unstale":"2023-07-21T22:17:11.478133+0000","last_undegraded":"2023-07-21T22:17:11.478133+0000","last_fullsized":"2023-07-21T22:17:11.478133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:51:57.148996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.201962+0000","last_change":"2023-07-21T22:17:08.861680+0000","last_active":"2023-07-21T22:17:14.201962+0000","last_peered":"2023-07-21T22:17:14.201962+0000","last_clean":"2023-07-21T22:17:14.201962+0000","last_became_active":"2023-07-21T22:17:08.861348+0000","last_became_peered":"2023-07-21T22:17:08.861348+0000","last_unstale":"2023-07-21T22:17:14.201962+0000","last_undegraded":"2023-07-21T22:17:14.201962+0000","last_fullsized":"2023-07-21T22:17:14.201962+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:37.043743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479449+0000","last_change":"2023-07-21T22:17:09.840166+0000","last_active":"2023-07-21T22:17:11.479449+0000","last_peered":"2023-07-21T22:17:11.479449+0000","last_clean":"2023-07-21T22:17:11.479449+0000","last_became_active":"2023-07-21T22:17:09.839850+0000","last_became_peered":"2023-07-21T22:17:09.839850+0000","last_unstale":"2023-07-21T22:17:11.479449+0000","last_undegraded":"2023-07-21T22:17:11.479449+0000","last_fullsized":"2023-07-21T22:17:11.479449+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:40:55.141670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477777+0000","last_change":"2023-07-21T22:17:08.864838+0000","last_active":"2023-07-21T22:17:11.477777+0000","last_peered":"2023-07-21T22:17:11.477777+0000","last_clean":"2023-07-21T22:17:11.477777+0000","last_became_active":"2023-07-21T22:17:08.864484+0000","last_became_peered":"2023-07-21T22:17:08.864484+0000","last_unstale":"2023-07-21T22:17:11.477777+0000","last_undegraded":"2023-07-21T22:17:11.477777+0000","last_fullsized":"2023-07-21T22:17:11.477777+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:14:17.469899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478426+0000","last_change":"2023-07-21T22:17:09.836214+0000","last_active":"2023-07-21T22:17:11.478426+0000","last_peered":"2023-07-21T22:17:11.478426+0000","last_clean":"2023-07-21T22:17:11.478426+0000","last_became_active":"2023-07-21T22:17:09.835877+0000","last_became_peered":"2023-07-21T22:17:09.835877+0000","last_unstale":"2023-07-21T22:17:11.478426+0000","last_undegraded":"2023-07-21T22:17:11.478426+0000","last_fullsized":"2023-07-21T22:17:11.478426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:47:38.431572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":21,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:17.208835+0000","last_change":"2023-07-21T22:17:08.861801+0000","last_active":"2023-07-21T22:17:17.208835+0000","last_peered":"2023-07-21T22:17:17.208835+0000","last_clean":"2023-07-21T22:17:17.208835+0000","last_became_active":"2023-07-21T22:17:08.861391+0000","last_became_peered":"2023-07-21T22:17:08.861391+0000","last_unstale":"2023-07-21T22:17:17.208835+0000","last_undegraded":"2023-07-21T22:17:17.208835+0000","last_fullsized":"2023-07-21T22:17:17.208835+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:40:07.644870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478285+0000","last_change":"2023-07-21T22:17:09.842155+0000","last_active":"2023-07-21T22:17:11.478285+0000","last_peered":"2023-07-21T22:17:11.478285+0000","last_clean":"2023-07-21T22:17:11.478285+0000","last_became_active":"2023-07-21T22:17:09.841845+0000","last_became_peered":"2023-07-21T22:17:09.841845+0000","last_unstale":"2023-07-21T22:17:11.478285+0000","last_undegraded":"2023-07-21T22:17:11.478285+0000","last_fullsized":"2023-07-21T22:17:11.478285+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:47:33.874760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.191903+0000","last_change":"2023-07-21T22:17:08.858727+0000","last_active":"2023-07-21T22:17:13.191903+0000","last_peered":"2023-07-21T22:17:13.191903+0000","last_clean":"2023-07-21T22:17:13.191903+0000","last_became_active":"2023-07-21T22:17:08.858376+0000","last_became_peered":"2023-07-21T22:17:08.858376+0000","last_unstale":"2023-07-21T22:17:13.191903+0000","last_undegraded":"2023-07-21T22:17:13.191903+0000","last_fullsized":"2023-07-21T22:17:13.191903+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:54:51.205730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478993+0000","last_change":"2023-07-21T22:17:09.857300+0000","last_active":"2023-07-21T22:17:11.478993+0000","last_peered":"2023-07-21T22:17:11.478993+0000","last_clean":"2023-07-21T22:17:11.478993+0000","last_became_active":"2023-07-21T22:17:09.856932+0000","last_became_peered":"2023-07-21T22:17:09.856932+0000","last_unstale":"2023-07-21T22:17:11.478993+0000","last_undegraded":"2023-07-21T22:17:11.478993+0000","last_fullsized":"2023-07-21T22:17:11.478993+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:05:03.422310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478290+0000","last_change":"2023-07-21T22:17:08.865488+0000","last_active":"2023-07-21T22:17:11.478290+0000","last_peered":"2023-07-21T22:17:11.478290+0000","last_clean":"2023-07-21T22:17:11.478290+0000","last_became_active":"2023-07-21T22:17:08.865050+0000","last_became_peered":"2023-07-21T22:17:08.865050+0000","last_unstale":"2023-07-21T22:17:11.478290+0000","last_undegraded":"2023-07-21T22:17:11.478290+0000","last_fullsized":"2023-07-21T22:17:11.478290+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:59:54.377233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478099+0000","last_change":"2023-07-21T22:17:09.849880+0000","last_active":"2023-07-21T22:17:11.478099+0000","last_peered":"2023-07-21T22:17:11.478099+0000","last_clean":"2023-07-21T22:17:11.478099+0000","last_became_active":"2023-07-21T22:17:09.849552+0000","last_became_peered":"2023-07-21T22:17:09.849552+0000","last_unstale":"2023-07-21T22:17:11.478099+0000","last_undegraded":"2023-07-21T22:17:11.478099+0000","last_fullsized":"2023-07-21T22:17:11.478099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:07:06.952508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"85'18","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:18.217241+0000","last_change":"2023-07-21T22:17:08.861663+0000","last_active":"2023-07-21T22:17:18.217241+0000","last_peered":"2023-07-21T22:17:18.217241+0000","last_clean":"2023-07-21T22:17:18.217241+0000","last_became_active":"2023-07-21T22:17:08.861339+0000","last_became_peered":"2023-07-21T22:17:08.861339+0000","last_unstale":"2023-07-21T22:17:18.217241+0000","last_undegraded":"2023-07-21T22:17:18.217241+0000","last_fullsized":"2023-07-21T22:17:18.217241+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:59:29.615115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36237,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":40,"num_write":19,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880840+0000","last_change":"2023-07-21T22:17:09.841543+0000","last_active":"2023-07-21T22:17:10.880840+0000","last_peered":"2023-07-21T22:17:10.880840+0000","last_clean":"2023-07-21T22:17:10.880840+0000","last_became_active":"2023-07-21T22:17:09.841235+0000","last_became_peered":"2023-07-21T22:17:09.841235+0000","last_unstale":"2023-07-21T22:17:10.880840+0000","last_undegraded":"2023-07-21T22:17:10.880840+0000","last_fullsized":"2023-07-21T22:17:10.880840+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:01:08.532253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.198328+0000","last_change":"2023-07-21T22:17:08.855145+0000","last_active":"2023-07-21T22:17:14.198328+0000","last_peered":"2023-07-21T22:17:14.198328+0000","last_clean":"2023-07-21T22:17:14.198328+0000","last_became_active":"2023-07-21T22:17:08.853279+0000","last_became_peered":"2023-07-21T22:17:08.853279+0000","last_unstale":"2023-07-21T22:17:14.198328+0000","last_undegraded":"2023-07-21T22:17:14.198328+0000","last_fullsized":"2023-07-21T22:17:14.198328+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:15:37.989845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830147+0000","last_change":"2023-07-21T22:17:09.835656+0000","last_active":"2023-07-21T22:17:10.830147+0000","last_peered":"2023-07-21T22:17:10.830147+0000","last_clean":"2023-07-21T22:17:10.830147+0000","last_became_active":"2023-07-21T22:17:09.835309+0000","last_became_peered":"2023-07-21T22:17:09.835309+0000","last_unstale":"2023-07-21T22:17:10.830147+0000","last_undegraded":"2023-07-21T22:17:10.830147+0000","last_fullsized":"2023-07-21T22:17:10.830147+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:52.048874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192054+0000","last_change":"2023-07-21T22:17:08.864811+0000","last_active":"2023-07-21T22:17:13.192054+0000","last_peered":"2023-07-21T22:17:13.192054+0000","last_clean":"2023-07-21T22:17:13.192054+0000","last_became_active":"2023-07-21T22:17:08.864428+0000","last_became_peered":"2023-07-21T22:17:08.864428+0000","last_unstale":"2023-07-21T22:17:13.192054+0000","last_undegraded":"2023-07-21T22:17:13.192054+0000","last_fullsized":"2023-07-21T22:17:13.192054+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:18:29.979099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801854+0000","last_change":"2023-07-21T22:17:09.837713+0000","last_active":"2023-07-21T22:17:11.801854+0000","last_peered":"2023-07-21T22:17:11.801854+0000","last_clean":"2023-07-21T22:17:11.801854+0000","last_became_active":"2023-07-21T22:17:09.837420+0000","last_became_peered":"2023-07-21T22:17:09.837420+0000","last_unstale":"2023-07-21T22:17:11.801854+0000","last_undegraded":"2023-07-21T22:17:11.801854+0000","last_fullsized":"2023-07-21T22:17:11.801854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:19:44.256533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.200055+0000","last_change":"2023-07-21T22:17:08.854376+0000","last_active":"2023-07-21T22:17:14.200055+0000","last_peered":"2023-07-21T22:17:14.200055+0000","last_clean":"2023-07-21T22:17:14.200055+0000","last_became_active":"2023-07-21T22:17:08.854031+0000","last_became_peered":"2023-07-21T22:17:08.854031+0000","last_unstale":"2023-07-21T22:17:14.200055+0000","last_undegraded":"2023-07-21T22:17:14.200055+0000","last_fullsized":"2023-07-21T22:17:14.200055+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:15:45.599118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":540,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801552+0000","last_change":"2023-07-21T22:17:09.851279+0000","last_active":"2023-07-21T22:17:11.801552+0000","last_peered":"2023-07-21T22:17:11.801552+0000","last_clean":"2023-07-21T22:17:11.801552+0000","last_became_active":"2023-07-21T22:17:09.850948+0000","last_became_peered":"2023-07-21T22:17:09.850948+0000","last_unstale":"2023-07-21T22:17:11.801552+0000","last_undegraded":"2023-07-21T22:17:11.801552+0000","last_fullsized":"2023-07-21T22:17:11.801552+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:20:44.072042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.201376+0000","last_change":"2023-07-21T22:17:08.865425+0000","last_active":"2023-07-21T22:17:14.201376+0000","last_peered":"2023-07-21T22:17:14.201376+0000","last_clean":"2023-07-21T22:17:14.201376+0000","last_became_active":"2023-07-21T22:17:08.865067+0000","last_became_peered":"2023-07-21T22:17:08.865067+0000","last_unstale":"2023-07-21T22:17:14.201376+0000","last_undegraded":"2023-07-21T22:17:14.201376+0000","last_fullsized":"2023-07-21T22:17:14.201376+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:36.923874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477785+0000","last_change":"2023-07-21T22:17:09.844916+0000","last_active":"2023-07-21T22:17:11.477785+0000","last_peered":"2023-07-21T22:17:11.477785+0000","last_clean":"2023-07-21T22:17:11.477785+0000","last_became_active":"2023-07-21T22:17:09.844632+0000","last_became_peered":"2023-07-21T22:17:09.844632+0000","last_unstale":"2023-07-21T22:17:11.477785+0000","last_undegraded":"2023-07-21T22:17:11.477785+0000","last_fullsized":"2023-07-21T22:17:11.477785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:49:40.257355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880803+0000","last_change":"2023-07-21T22:17:08.862954+0000","last_active":"2023-07-21T22:17:10.880803+0000","last_peered":"2023-07-21T22:17:10.880803+0000","last_clean":"2023-07-21T22:17:10.880803+0000","last_became_active":"2023-07-21T22:17:08.862598+0000","last_became_peered":"2023-07-21T22:17:08.862598+0000","last_unstale":"2023-07-21T22:17:10.880803+0000","last_undegraded":"2023-07-21T22:17:10.880803+0000","last_fullsized":"2023-07-21T22:17:10.880803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:03:12.788001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478822+0000","last_change":"2023-07-21T22:17:09.847756+0000","last_active":"2023-07-21T22:17:11.478822+0000","last_peered":"2023-07-21T22:17:11.478822+0000","last_clean":"2023-07-21T22:17:11.478822+0000","last_became_active":"2023-07-21T22:17:09.847466+0000","last_became_peered":"2023-07-21T22:17:09.847466+0000","last_unstale":"2023-07-21T22:17:11.478822+0000","last_undegraded":"2023-07-21T22:17:11.478822+0000","last_fullsized":"2023-07-21T22:17:11.478822+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:46:36.387868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478860+0000","last_change":"2023-07-21T22:17:08.862514+0000","last_active":"2023-07-21T22:17:11.478860+0000","last_peered":"2023-07-21T22:17:11.478860+0000","last_clean":"2023-07-21T22:17:11.478860+0000","last_became_active":"2023-07-21T22:17:08.862223+0000","last_became_peered":"2023-07-21T22:17:08.862223+0000","last_unstale":"2023-07-21T22:17:11.478860+0000","last_undegraded":"2023-07-21T22:17:11.478860+0000","last_fullsized":"2023-07-21T22:17:11.478860+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:40:55.490292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.313089+0000","last_change":"2023-07-21T22:17:09.852621+0000","last_active":"2023-07-21T22:17:13.313089+0000","last_peered":"2023-07-21T22:17:13.313089+0000","last_clean":"2023-07-21T22:17:13.313089+0000","last_became_active":"2023-07-21T22:17:09.852233+0000","last_became_peered":"2023-07-21T22:17:09.852233+0000","last_unstale":"2023-07-21T22:17:13.313089+0000","last_undegraded":"2023-07-21T22:17:13.313089+0000","last_fullsized":"2023-07-21T22:17:13.313089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:52:25.120272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:12.781435+0000","last_change":"2023-07-21T22:17:08.861344+0000","last_active":"2023-07-21T22:17:12.781435+0000","last_peered":"2023-07-21T22:17:12.781435+0000","last_clean":"2023-07-21T22:17:12.781435+0000","last_became_active":"2023-07-21T22:17:08.860978+0000","last_became_peered":"2023-07-21T22:17:08.860978+0000","last_unstale":"2023-07-21T22:17:12.781435+0000","last_undegraded":"2023-07-21T22:17:12.781435+0000","last_fullsized":"2023-07-21T22:17:12.781435+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:00:43.442172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830728+0000","last_change":"2023-07-21T22:17:09.852314+0000","last_active":"2023-07-21T22:17:10.830728+0000","last_peered":"2023-07-21T22:17:10.830728+0000","last_clean":"2023-07-21T22:17:10.830728+0000","last_became_active":"2023-07-21T22:17:09.852137+0000","last_became_peered":"2023-07-21T22:17:09.852137+0000","last_unstale":"2023-07-21T22:17:10.830728+0000","last_undegraded":"2023-07-21T22:17:10.830728+0000","last_fullsized":"2023-07-21T22:17:10.830728+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:42:34.471855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478126+0000","last_change":"2023-07-21T22:17:09.839387+0000","last_active":"2023-07-21T22:17:11.478126+0000","last_peered":"2023-07-21T22:17:11.478126+0000","last_clean":"2023-07-21T22:17:11.478126+0000","last_became_active":"2023-07-21T22:17:09.839052+0000","last_became_peered":"2023-07-21T22:17:09.839052+0000","last_unstale":"2023-07-21T22:17:11.478126+0000","last_undegraded":"2023-07-21T22:17:11.478126+0000","last_fullsized":"2023-07-21T22:17:11.478126+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:35:39.490581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":20,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:15.205969+0000","last_change":"2023-07-21T22:17:08.859465+0000","last_active":"2023-07-21T22:17:15.205969+0000","last_peered":"2023-07-21T22:17:15.205969+0000","last_clean":"2023-07-21T22:17:15.205969+0000","last_became_active":"2023-07-21T22:17:08.859076+0000","last_became_peered":"2023-07-21T22:17:08.859076+0000","last_unstale":"2023-07-21T22:17:15.205969+0000","last_undegraded":"2023-07-21T22:17:15.205969+0000","last_fullsized":"2023-07-21T22:17:15.205969+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:23:52.974083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479721+0000","last_change":"2023-07-21T22:17:09.846937+0000","last_active":"2023-07-21T22:17:11.479721+0000","last_peered":"2023-07-21T22:17:11.479721+0000","last_clean":"2023-07-21T22:17:11.479721+0000","last_became_active":"2023-07-21T22:17:09.846638+0000","last_became_peered":"2023-07-21T22:17:09.846638+0000","last_unstale":"2023-07-21T22:17:11.479721+0000","last_undegraded":"2023-07-21T22:17:11.479721+0000","last_fullsized":"2023-07-21T22:17:11.479721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:12:55.930155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.193092+0000","last_change":"2023-07-21T22:17:08.860388+0000","last_active":"2023-07-21T22:17:13.193092+0000","last_peered":"2023-07-21T22:17:13.193092+0000","last_clean":"2023-07-21T22:17:13.193092+0000","last_became_active":"2023-07-21T22:17:08.860039+0000","last_became_peered":"2023-07-21T22:17:08.860039+0000","last_unstale":"2023-07-21T22:17:13.193092+0000","last_undegraded":"2023-07-21T22:17:13.193092+0000","last_fullsized":"2023-07-21T22:17:13.193092+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:57:05.482939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":345,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801371+0000","last_change":"2023-07-21T22:15:51.342448+0000","last_active":"2023-07-21T22:17:11.801371+0000","last_peered":"2023-07-21T22:17:11.801371+0000","last_clean":"2023-07-21T22:17:11.801371+0000","last_became_active":"2023-07-21T22:15:51.342004+0000","last_became_peered":"2023-07-21T22:15:51.342004+0000","last_unstale":"2023-07-21T22:17:11.801371+0000","last_undegraded":"2023-07-21T22:17:11.801371+0000","last_fullsized":"2023-07-21T22:17:11.801371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_clean_scrub_stamp":"2023-07-21T22:12:15.345227+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:09:47.096789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830018+0000","last_change":"2023-07-21T22:17:09.838402+0000","last_active":"2023-07-21T22:17:10.830018+0000","last_peered":"2023-07-21T22:17:10.830018+0000","last_clean":"2023-07-21T22:17:10.830018+0000","last_became_active":"2023-07-21T22:17:09.838096+0000","last_became_peered":"2023-07-21T22:17:09.838096+0000","last_unstale":"2023-07-21T22:17:10.830018+0000","last_undegraded":"2023-07-21T22:17:10.830018+0000","last_fullsized":"2023-07-21T22:17:10.830018+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:40:29.036801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.198578+0000","last_change":"2023-07-21T22:17:08.865676+0000","last_active":"2023-07-21T22:17:14.198578+0000","last_peered":"2023-07-21T22:17:14.198578+0000","last_clean":"2023-07-21T22:17:14.198578+0000","last_became_active":"2023-07-21T22:17:08.865370+0000","last_became_peered":"2023-07-21T22:17:08.865370+0000","last_unstale":"2023-07-21T22:17:14.198578+0000","last_undegraded":"2023-07-21T22:17:14.198578+0000","last_fullsized":"2023-07-21T22:17:14.198578+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:24:53.967818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880914+0000","last_change":"2023-07-21T22:17:08.864487+0000","last_active":"2023-07-21T22:17:10.880914+0000","last_peered":"2023-07-21T22:17:10.880914+0000","last_clean":"2023-07-21T22:17:10.880914+0000","last_became_active":"2023-07-21T22:17:08.863943+0000","last_became_peered":"2023-07-21T22:17:08.863943+0000","last_unstale":"2023-07-21T22:17:10.880914+0000","last_undegraded":"2023-07-21T22:17:10.880914+0000","last_fullsized":"2023-07-21T22:17:10.880914+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:20:04.372255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830453+0000","last_change":"2023-07-21T22:17:09.833812+0000","last_active":"2023-07-21T22:17:10.830453+0000","last_peered":"2023-07-21T22:17:10.830453+0000","last_clean":"2023-07-21T22:17:10.830453+0000","last_became_active":"2023-07-21T22:17:09.833496+0000","last_became_peered":"2023-07-21T22:17:09.833496+0000","last_unstale":"2023-07-21T22:17:10.830453+0000","last_undegraded":"2023-07-21T22:17:10.830453+0000","last_fullsized":"2023-07-21T22:17:10.830453+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:41:28.939675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.199937+0000","last_change":"2023-07-21T22:17:08.867858+0000","last_active":"2023-07-21T22:17:14.199937+0000","last_peered":"2023-07-21T22:17:14.199937+0000","last_clean":"2023-07-21T22:17:14.199937+0000","last_became_active":"2023-07-21T22:17:08.867468+0000","last_became_peered":"2023-07-21T22:17:08.867468+0000","last_unstale":"2023-07-21T22:17:14.199937+0000","last_undegraded":"2023-07-21T22:17:14.199937+0000","last_fullsized":"2023-07-21T22:17:14.199937+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:37:14.340759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478685+0000","last_change":"2023-07-21T22:17:09.846988+0000","last_active":"2023-07-21T22:17:11.478685+0000","last_peered":"2023-07-21T22:17:11.478685+0000","last_clean":"2023-07-21T22:17:11.478685+0000","last_became_active":"2023-07-21T22:17:09.846686+0000","last_became_peered":"2023-07-21T22:17:09.846686+0000","last_unstale":"2023-07-21T22:17:11.478685+0000","last_undegraded":"2023-07-21T22:17:11.478685+0000","last_fullsized":"2023-07-21T22:17:11.478685+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:25:19.635631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192527+0000","last_change":"2023-07-21T22:17:08.857694+0000","last_active":"2023-07-21T22:17:13.192527+0000","last_peered":"2023-07-21T22:17:13.192527+0000","last_clean":"2023-07-21T22:17:13.192527+0000","last_became_active":"2023-07-21T22:17:08.857356+0000","last_became_peered":"2023-07-21T22:17:08.857356+0000","last_unstale":"2023-07-21T22:17:13.192527+0000","last_undegraded":"2023-07-21T22:17:13.192527+0000","last_fullsized":"2023-07-21T22:17:13.192527+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:11:16.479348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478682+0000","last_change":"2023-07-21T22:17:09.858500+0000","last_active":"2023-07-21T22:17:11.478682+0000","last_peered":"2023-07-21T22:17:11.478682+0000","last_clean":"2023-07-21T22:17:11.478682+0000","last_became_active":"2023-07-21T22:17:09.858009+0000","last_became_peered":"2023-07-21T22:17:09.858009+0000","last_unstale":"2023-07-21T22:17:11.478682+0000","last_undegraded":"2023-07-21T22:17:11.478682+0000","last_fullsized":"2023-07-21T22:17:11.478682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:30:08.512682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.191549+0000","last_change":"2023-07-21T22:17:08.853732+0000","last_active":"2023-07-21T22:17:13.191549+0000","last_peered":"2023-07-21T22:17:13.191549+0000","last_clean":"2023-07-21T22:17:13.191549+0000","last_became_active":"2023-07-21T22:17:08.853397+0000","last_became_peered":"2023-07-21T22:17:08.853397+0000","last_unstale":"2023-07-21T22:17:13.191549+0000","last_undegraded":"2023-07-21T22:17:13.191549+0000","last_fullsized":"2023-07-21T22:17:13.191549+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:46:04.645341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.880577+0000","last_change":"2023-07-21T22:17:09.840836+0000","last_active":"2023-07-21T22:17:10.880577+0000","last_peered":"2023-07-21T22:17:10.880577+0000","last_clean":"2023-07-21T22:17:10.880577+0000","last_became_active":"2023-07-21T22:17:09.840463+0000","last_became_peered":"2023-07-21T22:17:09.840463+0000","last_unstale":"2023-07-21T22:17:10.880577+0000","last_undegraded":"2023-07-21T22:17:10.880577+0000","last_fullsized":"2023-07-21T22:17:10.880577+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:35:02.318409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192404+0000","last_change":"2023-07-21T22:17:08.865129+0000","last_active":"2023-07-21T22:17:13.192404+0000","last_peered":"2023-07-21T22:17:13.192404+0000","last_clean":"2023-07-21T22:17:13.192404+0000","last_became_active":"2023-07-21T22:17:08.864820+0000","last_became_peered":"2023-07-21T22:17:08.864820+0000","last_unstale":"2023-07-21T22:17:13.192404+0000","last_undegraded":"2023-07-21T22:17:13.192404+0000","last_fullsized":"2023-07-21T22:17:13.192404+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:30:04.701632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478588+0000","last_change":"2023-07-21T22:17:09.846804+0000","last_active":"2023-07-21T22:17:11.478588+0000","last_peered":"2023-07-21T22:17:11.478588+0000","last_clean":"2023-07-21T22:17:11.478588+0000","last_became_active":"2023-07-21T22:17:09.846390+0000","last_became_peered":"2023-07-21T22:17:09.846390+0000","last_unstale":"2023-07-21T22:17:11.478588+0000","last_undegraded":"2023-07-21T22:17:11.478588+0000","last_fullsized":"2023-07-21T22:17:11.478588+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:19.365523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830352+0000","last_change":"2023-07-21T22:17:08.854259+0000","last_active":"2023-07-21T22:17:10.830352+0000","last_peered":"2023-07-21T22:17:10.830352+0000","last_clean":"2023-07-21T22:17:10.830352+0000","last_became_active":"2023-07-21T22:17:08.852680+0000","last_became_peered":"2023-07-21T22:17:08.852680+0000","last_unstale":"2023-07-21T22:17:10.830352+0000","last_undegraded":"2023-07-21T22:17:10.830352+0000","last_fullsized":"2023-07-21T22:17:10.830352+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:43:57.503391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478636+0000","last_change":"2023-07-21T22:17:09.849197+0000","last_active":"2023-07-21T22:17:11.478636+0000","last_peered":"2023-07-21T22:17:11.478636+0000","last_clean":"2023-07-21T22:17:11.478636+0000","last_became_active":"2023-07-21T22:17:09.848835+0000","last_became_peered":"2023-07-21T22:17:09.848835+0000","last_unstale":"2023-07-21T22:17:11.478636+0000","last_undegraded":"2023-07-21T22:17:11.478636+0000","last_fullsized":"2023-07-21T22:17:11.478636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:08:03.842773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":18,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:13.192075+0000","last_change":"2023-07-21T22:17:08.859614+0000","last_active":"2023-07-21T22:17:13.192075+0000","last_peered":"2023-07-21T22:17:13.192075+0000","last_clean":"2023-07-21T22:17:13.192075+0000","last_became_active":"2023-07-21T22:17:08.859261+0000","last_became_peered":"2023-07-21T22:17:08.859261+0000","last_unstale":"2023-07-21T22:17:13.192075+0000","last_undegraded":"2023-07-21T22:17:13.192075+0000","last_fullsized":"2023-07-21T22:17:13.192075+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:41.679297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801777+0000","last_change":"2023-07-21T22:17:09.847279+0000","last_active":"2023-07-21T22:17:11.801777+0000","last_peered":"2023-07-21T22:17:11.801777+0000","last_clean":"2023-07-21T22:17:11.801777+0000","last_became_active":"2023-07-21T22:17:09.846982+0000","last_became_peered":"2023-07-21T22:17:09.846982+0000","last_unstale":"2023-07-21T22:17:11.801777+0000","last_undegraded":"2023-07-21T22:17:11.801777+0000","last_fullsized":"2023-07-21T22:17:11.801777+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:04:28.959716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:14.201032+0000","last_change":"2023-07-21T22:17:08.857436+0000","last_active":"2023-07-21T22:17:14.201032+0000","last_peered":"2023-07-21T22:17:14.201032+0000","last_clean":"2023-07-21T22:17:14.201032+0000","last_became_active":"2023-07-21T22:17:08.857046+0000","last_became_peered":"2023-07-21T22:17:08.857046+0000","last_unstale":"2023-07-21T22:17:14.201032+0000","last_undegraded":"2023-07-21T22:17:14.201032+0000","last_fullsized":"2023-07-21T22:17:14.201032+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:22:09.067121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801869+0000","last_change":"2023-07-21T22:17:09.852916+0000","last_active":"2023-07-21T22:17:11.801869+0000","last_peered":"2023-07-21T22:17:11.801869+0000","last_clean":"2023-07-21T22:17:11.801869+0000","last_became_active":"2023-07-21T22:17:09.852608+0000","last_became_peered":"2023-07-21T22:17:09.852608+0000","last_unstale":"2023-07-21T22:17:11.801869+0000","last_undegraded":"2023-07-21T22:17:11.801869+0000","last_fullsized":"2023-07-21T22:17:11.801869+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:28:19.571061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":15,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477884+0000","last_change":"2023-07-21T22:17:08.859619+0000","last_active":"2023-07-21T22:17:11.477884+0000","last_peered":"2023-07-21T22:17:11.477884+0000","last_clean":"2023-07-21T22:17:11.477884+0000","last_became_active":"2023-07-21T22:17:08.859256+0000","last_became_peered":"2023-07-21T22:17:08.859256+0000","last_unstale":"2023-07-21T22:17:11.477884+0000","last_undegraded":"2023-07-21T22:17:11.477884+0000","last_fullsized":"2023-07-21T22:17:11.477884+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:48.278511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":13,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:12.781504+0000","last_change":"2023-07-21T22:17:09.850548+0000","last_active":"2023-07-21T22:17:12.781504+0000","last_peered":"2023-07-21T22:17:12.781504+0000","last_clean":"2023-07-21T22:17:12.781504+0000","last_became_active":"2023-07-21T22:17:09.850261+0000","last_became_peered":"2023-07-21T22:17:09.850261+0000","last_unstale":"2023-07-21T22:17:12.781504+0000","last_undegraded":"2023-07-21T22:17:12.781504+0000","last_fullsized":"2023-07-21T22:17:12.781504+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:46:59.385401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":16,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830285+0000","last_change":"2023-07-21T22:17:08.859729+0000","last_active":"2023-07-21T22:17:10.830285+0000","last_peered":"2023-07-21T22:17:10.830285+0000","last_clean":"2023-07-21T22:17:10.830285+0000","last_became_active":"2023-07-21T22:17:08.859421+0000","last_became_peered":"2023-07-21T22:17:08.859421+0000","last_unstale":"2023-07-21T22:17:10.830285+0000","last_undegraded":"2023-07-21T22:17:10.830285+0000","last_fullsized":"2023-07-21T22:17:10.830285+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:22:26.110166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.801893+0000","last_change":"2023-07-21T22:17:09.846413+0000","last_active":"2023-07-21T22:17:11.801893+0000","last_peered":"2023-07-21T22:17:11.801893+0000","last_clean":"2023-07-21T22:17:11.801893+0000","last_became_active":"2023-07-21T22:17:09.846038+0000","last_became_peered":"2023-07-21T22:17:09.846038+0000","last_unstale":"2023-07-21T22:17:11.801893+0000","last_undegraded":"2023-07-21T22:17:11.801893+0000","last_fullsized":"2023-07-21T22:17:11.801893+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:13:22.358010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478636+0000","last_change":"2023-07-21T22:17:09.846786+0000","last_active":"2023-07-21T22:17:11.478636+0000","last_peered":"2023-07-21T22:17:11.478636+0000","last_clean":"2023-07-21T22:17:11.478636+0000","last_became_active":"2023-07-21T22:17:09.846437+0000","last_became_peered":"2023-07-21T22:17:09.846437+0000","last_unstale":"2023-07-21T22:17:11.478636+0000","last_undegraded":"2023-07-21T22:17:11.478636+0000","last_fullsized":"2023-07-21T22:17:11.478636+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:59:56.822867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830355+0000","last_change":"2023-07-21T22:17:09.840000+0000","last_active":"2023-07-21T22:17:10.830355+0000","last_peered":"2023-07-21T22:17:10.830355+0000","last_clean":"2023-07-21T22:17:10.830355+0000","last_became_active":"2023-07-21T22:17:09.839674+0000","last_became_peered":"2023-07-21T22:17:09.839674+0000","last_unstale":"2023-07-21T22:17:10.830355+0000","last_undegraded":"2023-07-21T22:17:10.830355+0000","last_fullsized":"2023-07-21T22:17:10.830355+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:28:39.662623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830295+0000","last_change":"2023-07-21T22:17:09.850137+0000","last_active":"2023-07-21T22:17:10.830295+0000","last_peered":"2023-07-21T22:17:10.830295+0000","last_clean":"2023-07-21T22:17:10.830295+0000","last_became_active":"2023-07-21T22:17:09.849721+0000","last_became_peered":"2023-07-21T22:17:09.849721+0000","last_unstale":"2023-07-21T22:17:10.830295+0000","last_undegraded":"2023-07-21T22:17:10.830295+0000","last_fullsized":"2023-07-21T22:17:10.830295+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:26:45.318770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478870+0000","last_change":"2023-07-21T22:17:09.858573+0000","last_active":"2023-07-21T22:17:11.478870+0000","last_peered":"2023-07-21T22:17:11.478870+0000","last_clean":"2023-07-21T22:17:11.478870+0000","last_became_active":"2023-07-21T22:17:09.858017+0000","last_became_peered":"2023-07-21T22:17:09.858017+0000","last_unstale":"2023-07-21T22:17:11.478870+0000","last_undegraded":"2023-07-21T22:17:11.478870+0000","last_fullsized":"2023-07-21T22:17:11.478870+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:33:48.760338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830397+0000","last_change":"2023-07-21T22:17:09.844585+0000","last_active":"2023-07-21T22:17:10.830397+0000","last_peered":"2023-07-21T22:17:10.830397+0000","last_clean":"2023-07-21T22:17:10.830397+0000","last_became_active":"2023-07-21T22:17:09.844226+0000","last_became_peered":"2023-07-21T22:17:09.844226+0000","last_unstale":"2023-07-21T22:17:10.830397+0000","last_undegraded":"2023-07-21T22:17:10.830397+0000","last_fullsized":"2023-07-21T22:17:10.830397+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:26:52.605557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478809+0000","last_change":"2023-07-21T22:17:09.845251+0000","last_active":"2023-07-21T22:17:11.478809+0000","last_peered":"2023-07-21T22:17:11.478809+0000","last_clean":"2023-07-21T22:17:11.478809+0000","last_became_active":"2023-07-21T22:17:09.844945+0000","last_became_peered":"2023-07-21T22:17:09.844945+0000","last_unstale":"2023-07-21T22:17:11.478809+0000","last_undegraded":"2023-07-21T22:17:11.478809+0000","last_fullsized":"2023-07-21T22:17:11.478809+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:47.734064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830657+0000","last_change":"2023-07-21T22:17:09.850953+0000","last_active":"2023-07-21T22:17:10.830657+0000","last_peered":"2023-07-21T22:17:10.830657+0000","last_clean":"2023-07-21T22:17:10.830657+0000","last_became_active":"2023-07-21T22:17:09.850627+0000","last_became_peered":"2023-07-21T22:17:09.850627+0000","last_unstale":"2023-07-21T22:17:10.830657+0000","last_undegraded":"2023-07-21T22:17:10.830657+0000","last_fullsized":"2023-07-21T22:17:10.830657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:04:58.511942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478540+0000","last_change":"2023-07-21T22:17:09.841222+0000","last_active":"2023-07-21T22:17:11.478540+0000","last_peered":"2023-07-21T22:17:11.478540+0000","last_clean":"2023-07-21T22:17:11.478540+0000","last_became_active":"2023-07-21T22:17:09.840864+0000","last_became_peered":"2023-07-21T22:17:09.840864+0000","last_unstale":"2023-07-21T22:17:11.478540+0000","last_undegraded":"2023-07-21T22:17:11.478540+0000","last_fullsized":"2023-07-21T22:17:11.478540+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:18:58.614605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477972+0000","last_change":"2023-07-21T22:17:09.837688+0000","last_active":"2023-07-21T22:17:11.477972+0000","last_peered":"2023-07-21T22:17:11.477972+0000","last_clean":"2023-07-21T22:17:11.477972+0000","last_became_active":"2023-07-21T22:17:09.837325+0000","last_became_peered":"2023-07-21T22:17:09.837325+0000","last_unstale":"2023-07-21T22:17:11.477972+0000","last_undegraded":"2023-07-21T22:17:11.477972+0000","last_fullsized":"2023-07-21T22:17:11.477972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:03:06.875774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.479430+0000","last_change":"2023-07-21T22:17:09.843791+0000","last_active":"2023-07-21T22:17:11.479430+0000","last_peered":"2023-07-21T22:17:11.479430+0000","last_clean":"2023-07-21T22:17:11.479430+0000","last_became_active":"2023-07-21T22:17:09.843438+0000","last_became_peered":"2023-07-21T22:17:09.843438+0000","last_unstale":"2023-07-21T22:17:11.479430+0000","last_undegraded":"2023-07-21T22:17:11.479430+0000","last_fullsized":"2023-07-21T22:17:11.479430+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:39:47.855493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.477783+0000","last_change":"2023-07-21T22:17:09.849062+0000","last_active":"2023-07-21T22:17:11.477783+0000","last_peered":"2023-07-21T22:17:11.477783+0000","last_clean":"2023-07-21T22:17:11.477783+0000","last_became_active":"2023-07-21T22:17:09.848153+0000","last_became_peered":"2023-07-21T22:17:09.848153+0000","last_unstale":"2023-07-21T22:17:11.477783+0000","last_undegraded":"2023-07-21T22:17:11.477783+0000","last_fullsized":"2023-07-21T22:17:11.477783+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:48:27.818555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:10.830442+0000","last_change":"2023-07-21T22:17:09.849010+0000","last_active":"2023-07-21T22:17:10.830442+0000","last_peered":"2023-07-21T22:17:10.830442+0000","last_clean":"2023-07-21T22:17:10.830442+0000","last_became_active":"2023-07-21T22:17:09.848679+0000","last_became_peered":"2023-07-21T22:17:09.848679+0000","last_unstale":"2023-07-21T22:17:10.830442+0000","last_undegraded":"2023-07-21T22:17:10.830442+0000","last_fullsized":"2023-07-21T22:17:10.830442+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:50:35.889211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":85,"state":"active+clean","last_fresh":"2023-07-21T22:17:11.478855+0000","last_change":"2023-07-21T22:17:09.846419+0000","last_active":"2023-07-21T22:17:11.478855+0000","last_peered":"2023-07-21T22:17:11.478855+0000","last_clean":"2023-07-21T22:17:11.478855+0000","last_became_active":"2023-07-21T22:17:09.846037+0000","last_became_peered":"2023-07-21T22:17:09.846037+0000","last_unstale":"2023-07-21T22:17:11.478855+0000","last_undegraded":"2023-07-21T22:17:11.478855+0000","last_fullsized":"2023-07-21T22:17:11.478855+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:51:17.356984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":615,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248938,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":39751,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":19,"num_read_kb":47,"num_write":133,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":50687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383695,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27848,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717304,"statfs":{"total":95995035648,"available":95966519296,"internally_reserved":0,"allocated":917504,"data_stored":438891,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.41999999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.625},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.55500000000000005}]},{"osd":2,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.38}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.58099999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.501}]},{"osd":6,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.72499999999999998}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]},{"osd":9,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.65500000000000003}]},{"osd":10,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.69399999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645333,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":1020,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":1044480,"data_stored":1066957,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.628,"15min":0.628},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.371},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.44800000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.504},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.63200000000000001,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.7869999999999999,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.52400000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.879,"15min":0.879},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.6659999999999999,"5min":1.6659999999999999,"15min":1.6659999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.58599999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"min":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.57799999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.875,"15min":0.875},"min":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.224,"5min":1.224,"15min":1.224},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.9730000000000001,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.61099999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.016,"5min":1.016,"15min":1.016},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.91600000000000004,"5min":0.91600000000000004,"15min":0.91600000000000004},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":0.70699999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.63800000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.78200000000000003},{"interface":"front","average":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.628}]},{"osd":9,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":1.329,"5min":1.329,"15min":1.329},"last":0.747},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.494,"5min":1.494,"15min":1.494},"last":0.55000000000000004}]},{"osd":11,"last update":"Fri Jul 21 22:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.65500000000000003}]}]},{"osd":9,"up_from":67,"seq":287762808856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":933888,"data_stored":439127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.54100000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.393,"5min":1.393,"15min":1.393},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.71099999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.2609999999999999,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.47199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.464,"5min":1.464,"15min":1.464},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"min":{"1min":0.64500000000000002,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":1.3,"5min":1.3,"15min":1.3},"last":0.78300000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.92500000000000004},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.6339999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.1000000000000001,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.66800000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.871,"5min":0.871,"15min":0.871},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.2010000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.431,"5min":1.431,"15min":1.431},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.696,"5min":1.696,"15min":1.696},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.748}]},{"osd":8,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0349999999999999,"15min":1.0349999999999999},"min":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.496,"5min":1.496,"15min":1.496},"last":0.91000000000000003},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":1.667,"5min":1.667,"15min":1.667},"last":0.92700000000000005}]},{"osd":10,"last update":"Fri Jul 21 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"min":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.97299999999999998,"5min":0.97299999999999998,"15min":0.97299999999999998},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.264,"5min":1.264,"15min":1.264},"last":0.88600000000000001}]}]},{"osd":8,"up_from":59,"seq":253403070494,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":933888,"data_stored":439047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86199999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85099999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.999}]},{"osd":1,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93799999999999994,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.081,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.87}]},{"osd":2,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88100000000000001,"5min":1.056,"15min":1.056},"last":0.626},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94199999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.59699999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.081,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.745,"15min":0.754},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94499999999999995,"5min":0.995,"15min":0.995},"last":0.90300000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.751},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.82699999999999996,"15min":0.84399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.03,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.95499999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.46000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95399999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98699999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.81499999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.88300000000000001,"15min":0.90400000000000003},"min":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.165,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.0620000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.92200000000000004,"15min":0.94099999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1020000000000001,"5min":1.282,"15min":1.282},"last":0.93100000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.89500000000000002,"15min":0.91100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0660000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.91500000000000004,"15min":0.92900000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.246,"5min":1.321,"15min":1.321},"last":1.1299999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.145,"5min":1.145,"15min":1.145},"last":1.0369999999999999},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"max":{"1min":1.1559999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.97999999999999998}]},{"osd":10,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.872,"15min":0.872},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.1839999999999999},{"interface":"front","average":{"1min":0.877,"5min":0.877,"15min":0.877},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.2709999999999999,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.1040000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.091}]}]},{"osd":7,"up_from":51,"seq":219043332131,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27908,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717244,"statfs":{"total":95995035648,"available":95966457856,"internally_reserved":0,"allocated":978944,"data_stored":1030555,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.50900000000000001,"15min":0.495},"min":{"1min":0.37,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.70099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.65800000000000003,"15min":0.64800000000000002},"min":{"1min":0.48999999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.96799999999999997,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.89100000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.68799999999999994,"15min":0.67700000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.73999999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.746,"15min":0.72599999999999998},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.077,"5min":1.077,"15min":1.077},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.71999999999999997,"15min":0.71099999999999997},"min":{"1min":0.45100000000000001,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.91300000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.64600000000000002,"15min":0.64200000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.66900000000000004,"15min":0.67400000000000004},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.92100000000000004,"5min":0.92600000000000005,"15min":0.92600000000000005},"last":0.48099999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":0.76900000000000002,"15min":0.76500000000000001},"min":{"1min":0.58799999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":0.96799999999999997,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.84599999999999997,"5min":0.80600000000000005,"15min":0.80000000000000004},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0289999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.76700000000000002,"15min":0.76200000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.0900000000000001,"5min":1.0900000000000001,"15min":1.0900000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.81299999999999994,"15min":0.81399999999999995},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.0249999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.67900000000000005}]},{"osd":8,"last update":"Fri Jul 21 22:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82199999999999995,"5min":0.80100000000000005,"15min":0.79700000000000004},"min":{"1min":0.46400000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.0109999999999999,"5min":1.0109999999999999,"15min":1.0109999999999999},"last":0.996},{"interface":"front","average":{"1min":0.88700000000000001,"5min":0.82699999999999996,"15min":0.81699999999999995},"min":{"1min":0.629,"5min":0.629,"15min":0.629},"max":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"last":0.83299999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"min":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"min":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.95099999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.873}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495657,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":438522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73299999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88800000000000001,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.143,"15min":1.143},"last":0.72099999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.83899999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.59599999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.0049999999999999,"5min":1.075,"15min":1.075},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.621,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76600000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.53800000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71299999999999997,"15min":0.72999999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85099999999999998,"5min":1.25,"15min":1.25},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92400000000000004,"5min":3.8759999999999999,"15min":3.8759999999999999},"last":0.78800000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.52800000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.52100000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.85999999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.74399999999999999,"15min":0.72799999999999998},"min":{"1min":0.62,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.76300000000000001},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.75600000000000001,"15min":0.751},"min":{"1min":0.47099999999999997,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.006,"5min":1.071,"15min":1.071},"last":0.77600000000000002}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98499999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.82799999999999996,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":4.0119999999999996,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.752}]},{"osd":9,"last update":"Fri Jul 21 22:16:23 2023","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.80700000000000005}]},{"osd":10,"last update":"Fri Jul 21 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.82699999999999996},{"interface":"front","average":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"min":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27852,"kb_used_data":900,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717300,"statfs":{"total":95995035648,"available":95966515200,"internally_reserved":0,"allocated":921600,"data_stored":439600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.60299999999999998,"15min":0.60099999999999998},"min":{"1min":0.374,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.88400000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92000000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.624}]},{"osd":2,"last update":"Fri Jul 21 22:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.64200000000000002,"15min":0.63900000000000001},"min":{"1min":0.47899999999999998,"5min":0.433,"15min":0.433},"max":{"1min":0.86599999999999999,"5min":0.874,"15min":0.874},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.63200000000000001,"15min":0.63500000000000001},"min":{"1min":0.40200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.92700000000000005,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.51500000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:16:45 2023","interfaces":[{"interface":"back","average":{"1min":1.1040000000000001,"5min":0.73299999999999998,"15min":0.69099999999999995},"min":{"1min":0.505,"5min":0.438,"15min":0.438},"max":{"1min":7.2720000000000002,"5min":7.2720000000000002,"15min":7.2720000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.76000000000000001,"5min":0.66800000000000004,"15min":0.66200000000000003},"min":{"1min":0.56599999999999995,"5min":0.439,"15min":0.439},"max":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"last":0.70799999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.48699999999999999,"15min":0.47099999999999997},"min":{"1min":0.38100000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.50700000000000001,"15min":0.48899999999999999},"min":{"1min":0.35299999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.46100000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:16:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.65500000000000003,"15min":0.65300000000000002},"min":{"1min":0.54800000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.877,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.67000000000000004,"15min":0.65500000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.754}]},{"osd":6,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.74399999999999999,"15min":0.72099999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0189999999999999,"5min":1.036,"15min":1.036},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79500000000000004,"15min":0.74099999999999999},"min":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":0.83599999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:16:30 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.60699999999999998,"15min":0.59099999999999997},"min":{"1min":0.46600000000000003,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":1.03,"5min":1.03,"15min":1.03},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.68100000000000005,"15min":0.67100000000000004},"min":{"1min":0.48499999999999999,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.79400000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.78000000000000003,"15min":0.77800000000000002},"min":{"1min":0.61099999999999999,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":0.97699999999999998,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.878,"5min":0.81399999999999995,"15min":0.80400000000000005},"min":{"1min":0.68100000000000005,"5min":0.62,"15min":0.62},"max":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"last":0.875}]},{"osd":9,"last update":"Fri Jul 21 22:16:26 2023","interfaces":[{"interface":"back","average":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"min":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.046,"5min":1.046,"15min":1.046},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.167,"5min":1.167,"15min":1.167},"min":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":7.4530000000000003,"5min":7.4530000000000003,"15min":7.4530000000000003},"last":0.86599999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.80900000000000005},{"interface":"front","average":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.073,"5min":1.073,"15min":1.073},"last":0.89500000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":439787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.66300000000000003,"15min":0.63100000000000001},"min":{"1min":0.42199999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.1499999999999999,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.80800000000000005,"5min":0.67600000000000005,"15min":0.63500000000000001},"min":{"1min":0.52900000000000003,"5min":0.432,"15min":0.432},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.747}]},{"osd":2,"last update":"Fri Jul 21 22:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.628,"15min":0.60799999999999998},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.85699999999999998,"5min":0.878,"15min":0.878},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.749,"5min":0.629,"15min":0.59699999999999998},"min":{"1min":0.46899999999999997,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.77200000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.46100000000000002},"min":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.49199999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64600000000000002,"15min":0.60399999999999998},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97499999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.499,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.012,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.68000000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:16:39 2023","interfaces":[{"interface":"back","average":{"1min":0.73599999999999999,"5min":0.70299999999999996,"15min":0.69799999999999995},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.97599999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70099999999999996,"15min":0.69399999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.335,"5min":1.335,"15min":1.335},"last":0.85099999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:17:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.95499999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.63},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.53800000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.751}]},{"osd":8,"last update":"Fri Jul 21 22:17:01 2023","interfaces":[{"interface":"back","average":{"1min":0.79600000000000004,"5min":0.83499999999999996,"15min":0.84099999999999997},"min":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":1.163,"5min":1.163,"15min":1.163},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.79800000000000004,"5min":0.84199999999999997,"15min":0.84899999999999998},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.2849999999999999,"5min":1.2849999999999999,"15min":1.2849999999999999},"last":0.89000000000000001}]},{"osd":9,"last update":"Fri Jul 21 22:16:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.198,"5min":1.198,"15min":1.198},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.79000000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:16:49 2023","interfaces":[{"interface":"back","average":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.3720000000000001,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":0.81499999999999995},{"interface":"front","average":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":7.5209999999999999,"5min":7.5209999999999999,"15min":7.5209999999999999},"last":0.80100000000000005}]},{"osd":11,"last update":"Fri Jul 21 22:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.86099999999999999}]}]},{"osd":2,"up_from":18,"seq":77309411389,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":933888,"data_stored":440208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.60399999999999998,"15min":0.58599999999999997},"min":{"1min":0.51200000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.73599999999999999,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.44600000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.345,"5min":1.345,"15min":1.345},"last":0.73099999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.74199999999999999,"5min":0.63600000000000001,"15min":0.60199999999999998},"min":{"1min":0.40500000000000003,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.64000000000000001,"15min":0.60299999999999998},"min":{"1min":0.49199999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.2949999999999999,"5min":1.2949999999999999,"15min":1.2949999999999999},"last":0.61799999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.754,"5min":0.65700000000000003,"15min":0.63200000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.369,"5min":1.369,"15min":1.369},"last":0.749},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.69399999999999995,"15min":0.66400000000000003},"min":{"1min":0.45400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.3089999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.53400000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.56599999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:16:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67100000000000004,"5min":0.59599999999999997,"15min":0.56499999999999995},"min":{"1min":0.46300000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.97199999999999998,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.57299999999999995,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.435}]},{"osd":6,"last update":"Fri Jul 21 22:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.80200000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60999999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":0.82899999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.286,"5min":1.409,"15min":1.409},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.48499999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:16:20 2023","interfaces":[{"interface":"back","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"last":0.76500000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4099999999999999,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.71499999999999997}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":25,"seq":107374182456,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27864,"kb_used_data":912,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717288,"statfs":{"total":95995035648,"available":95966502912,"internally_reserved":0,"allocated":933888,"data_stored":438716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.41999999999999998,"15min":0.40400000000000003},"min":{"1min":0.33100000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.45600000000000002,"15min":0.42899999999999999},"min":{"1min":0.35499999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46100000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.63500000000000001,"15min":0.59099999999999997},"min":{"1min":0.47099999999999997,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.115,"5min":1.115,"15min":1.115},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.66900000000000004,"15min":0.66200000000000003},"min":{"1min":0.45800000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.0840000000000001,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.52900000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.68400000000000005,"15min":0.65600000000000003},"min":{"1min":0.48599999999999999,"5min":0.432,"15min":0.432},"max":{"1min":1.103,"5min":1.103,"15min":1.103},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.67300000000000004,"15min":0.63900000000000001},"min":{"1min":0.53100000000000003,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.0740000000000001,"5min":1.093,"15min":1.093},"last":0.79500000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.745,"15min":0.69099999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97099999999999997,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.77200000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:16:40 2023","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.69099999999999995,"15min":0.67900000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.82199999999999995,"5min":0.98699999999999999,"15min":0.98699999999999999},"last":0.85399999999999998},{"interface":"front","average":{"1min":0.80400000000000005,"5min":0.72699999999999998,"15min":0.71199999999999997},"min":{"1min":0.623,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"last":0.69499999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.71699999999999997,"15min":0.69099999999999995},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1739999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.81200000000000006}]},{"osd":7,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":1.05,"15min":1.0800000000000001},"min":{"1min":0.58299999999999996,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.1180000000000001,"5min":6.9740000000000002,"15min":6.9740000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.89000000000000001,"5min":1.089,"15min":1.1220000000000001},"min":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.24,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.752}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.1140000000000001,"15min":1.157},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.083,"5min":7.0030000000000001,"15min":7.0030000000000001},"last":0.629},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1080000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73499999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.94099999999999995,"15min":0.94099999999999995},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.2789999999999999,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.71199999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:16:51 2023","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.98099999999999998,"15min":0.98099999999999998},"min":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.395,"5min":1.395,"15min":1.395},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.96599999999999997,"15min":0.96599999999999997},"min":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3799999999999999,"5min":1.3799999999999999,"15min":1.3799999999999999},"last":0.73999999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99199999999999999}]}]},{"osd":4,"up_from":33,"seq":141733920820,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27856,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717296,"statfs":{"total":95995035648,"available":95966511104,"internally_reserved":0,"allocated":925696,"data_stored":438905,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.873,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.46500000000000002,"15min":0.42799999999999999},"min":{"1min":0.35899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67100000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.49199999999999999,"15min":0.44900000000000001},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.47499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.64700000000000002},"min":{"1min":0.56299999999999994,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70499999999999996,"15min":0.65900000000000003},"min":{"1min":0.57199999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.63100000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64300000000000002,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.95299999999999996,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67100000000000004,"15min":0.62},"min":{"1min":0.437,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0329999999999999,"5min":1.236,"15min":1.236},"last":0.67000000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.74099999999999999,"15min":0.72499999999999998},"min":{"1min":0.504,"5min":0.503,"15min":0.503},"max":{"1min":1.194,"5min":1.194,"15min":1.194},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.73799999999999999,"15min":0.72199999999999998},"min":{"1min":0.63200000000000001,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.175,"5min":1.175,"15min":1.175},"last":0.71499999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56699999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0740000000000001,"5min":1.093,"15min":1.093},"last":0.67800000000000005},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.79700000000000004},"min":{"1min":0.64600000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0529999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.56499999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.67000000000000004,"15min":0.64900000000000002},"min":{"1min":0.51200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.127,"5min":1.127,"15min":1.127},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.68899999999999995,"15min":0.66700000000000004},"min":{"1min":0.52300000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.64200000000000002}]},{"osd":8,"last update":"Fri Jul 21 22:16:54 2023","interfaces":[{"interface":"back","average":{"1min":0.84299999999999997,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.59799999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.84099999999999997,"15min":0.82599999999999996},"min":{"1min":0.71499999999999997,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.2290000000000001,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.749}]},{"osd":9,"last update":"Fri Jul 21 22:16:22 2023","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.503,"5min":0.503,"15min":0.503},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"min":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.21,"5min":1.21,"15min":1.21},"last":0.65800000000000003}]},{"osd":10,"last update":"Fri Jul 21 22:16:50 2023","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.327,"5min":1.327,"15min":1.327},"last":0.69199999999999995},{"interface":"front","average":{"1min":1.002,"5min":1.002,"15min":1.002},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.3069999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.79500000000000004}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]}]},{"osd":5,"up_from":38,"seq":163208757294,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":968,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":991232,"data_stored":1030105,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.628,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.40899999999999997,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.55400000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.61899999999999999,"15min":0.58599999999999997},"min":{"1min":0.55700000000000005,"5min":0.374,"15min":0.374},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.999,"5min":0.71399999999999997,"15min":0.64500000000000002},"min":{"1min":0.47099999999999997,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":6.9340000000000002,"5min":6.9340000000000002,"15min":6.9340000000000002},"last":0.72499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.48799999999999999,"15min":0.47499999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.51500000000000001,"15min":0.495},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.877,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.44600000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":0.70399999999999996,"15min":0.65600000000000003},"min":{"1min":0.45100000000000001,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":6.9160000000000004,"5min":6.9160000000000004,"15min":6.9160000000000004},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.98499999999999999,"5min":0.72199999999999998,"15min":0.67100000000000004},"min":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":7.0129999999999999,"5min":7.0129999999999999,"15min":7.0129999999999999},"last":0.53200000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:16:38 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.68200000000000005,"15min":0.65000000000000002},"min":{"1min":0.53500000000000003,"5min":0.435,"15min":0.435},"max":{"1min":1.1579999999999999,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.76800000000000002,"5min":0.68300000000000005,"15min":0.66100000000000003},"min":{"1min":0.56299999999999994,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.075,"5min":1.075,"15min":1.075},"last":0.68899999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.78100000000000003,"15min":0.73499999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.873,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:16:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.80200000000000005,"15min":0.80000000000000004},"min":{"1min":0.64600000000000002,"5min":0.63,"15min":0.63},"max":{"1min":1.212,"5min":1.212,"15min":1.212},"last":0.754},{"interface":"front","average":{"1min":0.80300000000000005,"5min":0.77600000000000002,"15min":0.77200000000000002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.004,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59399999999999997}]},{"osd":8,"last update":"Fri Jul 21 22:16:58 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.77600000000000002,"15min":0.78800000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.046,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.749,"15min":0.753},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.012,"5min":1.012,"15min":1.012},"last":0.65500000000000003}]},{"osd":9,"last update":"Fri Jul 21 22:16:21 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":0.998,"5min":0.998,"15min":0.998},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"min":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.68100000000000005}]},{"osd":10,"last update":"Fri Jul 21 22:16:47 2023","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":0.88,"15min":0.88},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.87,"5min":0.87,"15min":0.87},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.087,"5min":1.087,"15min":1.087},"last":0.71099999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1564,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":38157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:17:19.095 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-07-21T22:17:19.096 INFO:tasks.cephadm:Setting up client nodes... 2023-07-21T22:17:19.096 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2023-07-21T22:17:19.844 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:20.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:20 smithi151 ceph-mon[95510]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:17:20.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:20 smithi151 ceph-mon[95510]: pgmap v303: 97 pgs: 97 active+clean; 616 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.3 KiB/s wr, 17 op/s 2023-07-21T22:17:20.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:20 smithi151 ceph-mon[95510]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:17:20.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:20 smithi187 ceph-mon[96918]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:17:20.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:20 smithi187 ceph-mon[96918]: pgmap v303: 97 pgs: 97 active+clean; 616 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.3 KiB/s wr, 17 op/s 2023-07-21T22:17:20.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:20 smithi187 ceph-mon[96918]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:17:20.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:20 smithi195 ceph-mon[97365]: from='client.14832 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:17:20.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:20 smithi195 ceph-mon[97365]: pgmap v303: 97 pgs: 97 active+clean; 616 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 8.3 KiB/s wr, 17 op/s 2023-07-21T22:17:20.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:20 smithi195 ceph-mon[97365]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:17:21.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.459+0000 7f71745bb700 1 -- 172.21.15.151:0/2109949117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c101740 msgr2=0x7f716c108000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:21.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.459+0000 7f71745bb700 1 --2- 172.21.15.151:0/2109949117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c101740 0x7f716c108000 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f716400b0a0 tx=0x7f716400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.459+0000 7f71745bb700 1 -- 172.21.15.151:0/2109949117 shutdown_connections 2023-07-21T22:17:21.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.460+0000 7f71745bb700 1 --2- 172.21.15.151:0/2109949117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f716c0ffbb0 0x7f716c0fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.460+0000 7f71745bb700 1 --2- 172.21.15.151:0/2109949117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c101740 0x7f716c108000 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.460+0000 7f71745bb700 1 --2- 172.21.15.151:0/2109949117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c100db0 0x7f716c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.460+0000 7f71745bb700 1 -- 172.21.15.151:0/2109949117 >> 172.21.15.151:0/2109949117 conn(0x7f716c0fb200 msgr2=0x7f716c0fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.460+0000 7f71745bb700 1 -- 172.21.15.151:0/2109949117 shutdown_connections 2023-07-21T22:17:21.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.460+0000 7f71745bb700 1 -- 172.21.15.151:0/2109949117 wait complete. 2023-07-21T22:17:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f71745bb700 1 Processor -- start 2023-07-21T22:17:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f71745bb700 1 -- start start 2023-07-21T22:17:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f71745bb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c0ffbb0 0x7f716c197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f71745bb700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c100db0 0x7f716c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f71745bb700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f716c101740 0x7f716c19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f71745bb700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c19f5b0 con 0x7f716c0ffbb0 2023-07-21T22:17:21.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f71745bb700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c19f6f0 con 0x7f716c101740 2023-07-21T22:17:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f71745bb700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716c19f880 con 0x7f716c100db0 2023-07-21T22:17:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f7172357700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c0ffbb0 0x7f716c197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f7172357700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c0ffbb0 0x7f716c197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53226/0 (socket says 172.21.15.151:53226) 2023-07-21T22:17:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f7172357700 1 -- 172.21.15.151:0/68356615 learned_addr learned my addr 172.21.15.151:0/68356615 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f7171b56700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c100db0 0x7f716c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:21.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.461+0000 7f7172b58700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f716c101740 0x7f716c19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:21.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f7172357700 1 -- 172.21.15.151:0/68356615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c100db0 msgr2=0x7f716c197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:21.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f7172357700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c100db0 0x7f716c197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f7172357700 1 -- 172.21.15.151:0/68356615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f716c101740 msgr2=0x7f716c19efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:21.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f7172357700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f716c101740 0x7f716c19efe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f7172357700 1 -- 172.21.15.151:0/68356615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7164009d00 con 0x7f716c0ffbb0 2023-07-21T22:17:21.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f7172357700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c0ffbb0 0x7f716c197a20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f716800c9c0 tx=0x7f716800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:21.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f71637fe700 1 -- 172.21.15.151:0/68356615 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168007ac0 con 0x7f716c0ffbb0 2023-07-21T22:17:21.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f71637fe700 1 -- 172.21.15.151:0/68356615 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f716800ce60 con 0x7f716c0ffbb0 2023-07-21T22:17:21.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f716c19fb60 con 0x7f716c0ffbb0 2023-07-21T22:17:21.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.462+0000 7f71637fe700 1 -- 172.21.15.151:0/68356615 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7168018400 con 0x7f716c0ffbb0 2023-07-21T22:17:21.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.463+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f716c1a00b0 con 0x7f716c0ffbb0 2023-07-21T22:17:21.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.464+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f716c10b230 con 0x7f716c0ffbb0 2023-07-21T22:17:21.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.465+0000 7f71637fe700 1 -- 172.21.15.151:0/68356615 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f716800f450 con 0x7f716c0ffbb0 2023-07-21T22:17:21.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.467+0000 7f71637fe700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f71580a1260 0x7f71580a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:21.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.467+0000 7f71637fe700 1 -- 172.21.15.151:0/68356615 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f71680cc810 con 0x7f716c0ffbb0 2023-07-21T22:17:21.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.467+0000 7f7171b56700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f71580a1260 0x7f71580a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:21.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.467+0000 7f7171b56700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f71580a1260 0x7f71580a3710 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f715c005950 tx=0x7f715c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:21.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.470+0000 7f71637fe700 1 -- 172.21.15.151:0/68356615 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f7168095eb0 con 0x7f716c0ffbb0 2023-07-21T22:17:21.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.745+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f716c10b450 con 0x7f716c0ffbb0 2023-07-21T22:17:21.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.750+0000 7f71637fe700 1 -- 172.21.15.151:0/68356615 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) v1 ==== 170+0+59 (secure 0 0 0) 0x7f71680994d0 con 0x7f716c0ffbb0 2023-07-21T22:17:21.795 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-07-21T22:17:21.795 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQDxA7tkH2qHLBAA1DewoufoVYkrkCE4JKiB5w== 2023-07-21T22:17:21.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f71580a1260 msgr2=0x7f71580a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:21.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f71580a1260 0x7f71580a3710 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f715c005950 tx=0x7f715c00b410 comp rx=0 tx=0).stop 2023-07-21T22:17:21.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c0ffbb0 msgr2=0x7f716c197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:21.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c0ffbb0 0x7f716c197a20 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f716800c9c0 tx=0x7f716800ccd0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 shutdown_connections 2023-07-21T22:17:21.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f71580a1260 0x7f71580a3710 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f716c101740 0x7f716c19efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f716c0ffbb0 0x7f716c197a20 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 --2- 172.21.15.151:0/68356615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f716c100db0 0x7f716c197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:21.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 >> 172.21.15.151:0/68356615 conn(0x7f716c0fb200 msgr2=0x7f716c106640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:21.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 shutdown_connections 2023-07-21T22:17:21.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:21.753+0000 7f71745bb700 1 -- 172.21.15.151:0/68356615 wait complete. 2023-07-21T22:17:22.322 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T22:17:22.322 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2023-07-21T22:17:22.323 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-07-21T22:17:22.424 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-07-21T22:17:22.425 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2023-07-21T22:17:22.426 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph mgr dump --format=json 2023-07-21T22:17:22.526 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:22 smithi151 ceph-mon[95510]: pgmap v304: 97 pgs: 97 active+clean; 616 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2023-07-21T22:17:22.526 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:22 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/68356615' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-21T22:17:22.526 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:22 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/68356615' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-21T22:17:22.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:22 smithi187 ceph-mon[96918]: pgmap v304: 97 pgs: 97 active+clean; 616 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2023-07-21T22:17:22.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:22 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/68356615' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-21T22:17:22.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:22 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/68356615' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-21T22:17:22.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:22 smithi195 ceph-mon[97365]: pgmap v304: 97 pgs: 97 active+clean; 616 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 6.5 KiB/s rd, 7.5 KiB/s wr, 16 op/s 2023-07-21T22:17:22.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:22 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/68356615' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2023-07-21T22:17:22.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:22 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/68356615' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2023-07-21T22:17:23.186 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:24.432 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:24 smithi151 ceph-mon[95510]: pgmap v305: 97 pgs: 97 active+clean; 616 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2023-07-21T22:17:24.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:24 smithi187 ceph-mon[96918]: pgmap v305: 97 pgs: 97 active+clean; 616 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2023-07-21T22:17:24.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:24 smithi195 ceph-mon[97365]: pgmap v305: 97 pgs: 97 active+clean; 616 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 6.3 KiB/s wr, 14 op/s 2023-07-21T22:17:24.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.651+0000 7f111192c700 1 -- 172.21.15.151:0/3822783889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c104ea0 msgr2=0x7f110c10ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:24.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.651+0000 7f111192c700 1 --2- 172.21.15.151:0/3822783889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c104ea0 0x7f110c10ca20 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f110400b0d0 tx=0x7f110400b3e0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.651+0000 7f111192c700 1 -- 172.21.15.151:0/3822783889 shutdown_connections 2023-07-21T22:17:24.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.651+0000 7f111192c700 1 --2- 172.21.15.151:0/3822783889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110c0ffe00 0x7f110c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.651+0000 7f111192c700 1 --2- 172.21.15.151:0/3822783889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c104ea0 0x7f110c10ca20 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.651+0000 7f111192c700 1 --2- 172.21.15.151:0/3822783889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c1007a0 0x7f110c104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.651+0000 7f111192c700 1 -- 172.21.15.151:0/3822783889 >> 172.21.15.151:0/3822783889 conn(0x7f110c0fb660 msgr2=0x7f110c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:24.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.651+0000 7f111192c700 1 -- 172.21.15.151:0/3822783889 shutdown_connections 2023-07-21T22:17:24.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.651+0000 7f111192c700 1 -- 172.21.15.151:0/3822783889 wait complete. 2023-07-21T22:17:24.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.652+0000 7f111192c700 1 Processor -- start 2023-07-21T22:17:24.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.652+0000 7f111192c700 1 -- start start 2023-07-21T22:17:24.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f111192c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c0ffe00 0x7f110c072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:24.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f111192c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c1007a0 0x7f110c072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:24.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f111192c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110c104ea0 0x7f110c073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:24.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f111192c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1a4110 con 0x7f110c0ffe00 2023-07-21T22:17:24.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f111192c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1a4280 con 0x7f110c104ea0 2023-07-21T22:17:24.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f111192c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110c1a4440 con 0x7f110c1007a0 2023-07-21T22:17:24.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f110affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c0ffe00 0x7f110c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:24.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f110affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c0ffe00 0x7f110c072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53250/0 (socket says 172.21.15.151:53250) 2023-07-21T22:17:24.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f110affd700 1 -- 172.21.15.151:0/4000786025 learned_addr learned my addr 172.21.15.151:0/4000786025 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:24.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f110b7fe700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110c104ea0 0x7f110c073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:24.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f110a7fc700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c1007a0 0x7f110c072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:24.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.653+0000 7f110affd700 1 -- 172.21.15.151:0/4000786025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c1007a0 msgr2=0x7f110c072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:24.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f110affd700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c1007a0 0x7f110c072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f110affd700 1 -- 172.21.15.151:0/4000786025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110c104ea0 msgr2=0x7f110c073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:24.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f110affd700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110c104ea0 0x7f110c073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f110affd700 1 -- 172.21.15.151:0/4000786025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104009d00 con 0x7f110c0ffe00 2023-07-21T22:17:24.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f110affd700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c0ffe00 0x7f110c072810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00e9a0 tx=0x7f10fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:24.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f111092a700 1 -- 172.21.15.151:0/4000786025 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc009790 con 0x7f110c0ffe00 2023-07-21T22:17:24.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f111092a700 1 -- 172.21.15.151:0/4000786025 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10fc00cbd0 con 0x7f110c0ffe00 2023-07-21T22:17:24.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110c1a4720 con 0x7f110c0ffe00 2023-07-21T22:17:24.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f111092a700 1 -- 172.21.15.151:0/4000786025 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10fc018680 con 0x7f110c0ffe00 2023-07-21T22:17:24.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.654+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110c1a4c70 con 0x7f110c0ffe00 2023-07-21T22:17:24.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.655+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110c04e210 con 0x7f110c0ffe00 2023-07-21T22:17:24.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.657+0000 7f111092a700 1 -- 172.21.15.151:0/4000786025 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f10fc00cd40 con 0x7f110c0ffe00 2023-07-21T22:17:24.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.658+0000 7f111092a700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10f40a1260 0x7f10f40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:24.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.659+0000 7f111092a700 1 -- 172.21.15.151:0/4000786025 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f10fc014070 con 0x7f110c0ffe00 2023-07-21T22:17:24.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.659+0000 7f110a7fc700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10f40a1260 0x7f10f40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:24.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.659+0000 7f110a7fc700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10f40a1260 0x7f10f40a3710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f110c073fb0 tx=0x7f1100009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:24.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.663+0000 7f111092a700 1 -- 172.21.15.151:0/4000786025 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f10fc051770 con 0x7f110c0ffe00 2023-07-21T22:17:24.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.915+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f110c073cf0 con 0x7f110c0ffe00 2023-07-21T22:17:24.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.919+0000 7f111092a700 1 -- 172.21.15.151:0/4000786025 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) v1 ==== 74+0+260133 (secure 0 0 0) 0x7f10fc065840 con 0x7f110c0ffe00 2023-07-21T22:17:24.966 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10f40a1260 msgr2=0x7f10f40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10f40a1260 0x7f10f40a3710 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f110c073fb0 tx=0x7f1100009260 comp rx=0 tx=0).stop 2023-07-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c0ffe00 msgr2=0x7f110c072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c0ffe00 0x7f110c072810 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f10fc00e9a0 tx=0x7f10fc00ecb0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 shutdown_connections 2023-07-21T22:17:24.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10f40a1260 0x7f10f40a3710 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f110c104ea0 0x7f110c073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f110c0ffe00 0x7f110c072810 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 --2- 172.21.15.151:0/4000786025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f110c1007a0 0x7f110c072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:24.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 >> 172.21.15.151:0/4000786025 conn(0x7f110c0fb660 msgr2=0x7f110c0fc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:24.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 shutdown_connections 2023-07-21T22:17:24.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:24.924+0000 7f111192c700 1 -- 172.21.15.151:0/4000786025 wait complete. 2023-07-21T22:17:25.464 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":17,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":3677157440},{"type":"v1","addr":"172.21.15.151:6801","nonce":3677157440}]},"active_addr":"172.21.15.151:6801/3677157440","active_change":"2023-07-21T22:09:42.752623+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24110,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.151:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":2857691582}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":4119562225}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1323163778}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":117839627}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":772768197}]}]} 2023-07-21T22:17:25.472 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2023-07-21T22:17:25.472 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2023-07-21T22:17:25.473 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd dump --format=json 2023-07-21T22:17:25.566 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:25 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/4000786025' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-21T22:17:25.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:25 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/4000786025' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-21T22:17:25.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:25 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/4000786025' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2023-07-21T22:17:26.229 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:26.552 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:26 smithi151 ceph-mon[95510]: pgmap v306: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 KiB/s wr, 15 op/s 2023-07-21T22:17:26.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:26 smithi187 ceph-mon[96918]: pgmap v306: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 KiB/s wr, 15 op/s 2023-07-21T22:17:26.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:26 smithi195 ceph-mon[97365]: pgmap v306: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 6.7 KiB/s wr, 15 op/s 2023-07-21T22:17:27.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.816+0000 7fa787236700 1 -- 172.21.15.151:0/2732616409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7800ffe00 msgr2=0x7fa7801001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:27.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.816+0000 7fa787236700 1 --2- 172.21.15.151:0/2732616409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7800ffe00 0x7fa7801001d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fa7740099c0 tx=0x7fa774009cd0 comp rx=0 tx=0).stop 2023-07-21T22:17:27.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.816+0000 7fa787236700 1 -- 172.21.15.151:0/2732616409 shutdown_connections 2023-07-21T22:17:27.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.816+0000 7fa787236700 1 --2- 172.21.15.151:0/2732616409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa780104ea0 0x7fa78010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:27.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.816+0000 7fa787236700 1 --2- 172.21.15.151:0/2732616409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7800ffe00 0x7fa7801001d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:27.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.816+0000 7fa787236700 1 --2- 172.21.15.151:0/2732616409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7801007a0 0x7fa780104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:27.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.816+0000 7fa787236700 1 -- 172.21.15.151:0/2732616409 >> 172.21.15.151:0/2732616409 conn(0x7fa7800fb660 msgr2=0x7fa7800fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:27.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.816+0000 7fa787236700 1 -- 172.21.15.151:0/2732616409 shutdown_connections 2023-07-21T22:17:27.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.816+0000 7fa787236700 1 -- 172.21.15.151:0/2732616409 wait complete. 2023-07-21T22:17:27.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.817+0000 7fa787236700 1 Processor -- start 2023-07-21T22:17:27.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.817+0000 7fa787236700 1 -- start start 2023-07-21T22:17:27.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa787236700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7800ffe00 0x7fa780197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:27.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa787236700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7801007a0 0x7fa780198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:27.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa787236700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa780104ea0 0x7fa78019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:27.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa787236700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78019cce0 con 0x7fa7801007a0 2023-07-21T22:17:27.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa787236700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78019ce50 con 0x7fa7800ffe00 2023-07-21T22:17:27.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa787236700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa78019d010 con 0x7fa780104ea0 2023-07-21T22:17:27.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa77ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7801007a0 0x7fa780198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:27.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa77ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7801007a0 0x7fa780198300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39128/0 (socket says 172.21.15.151:39128) 2023-07-21T22:17:27.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa77ffff700 1 -- 172.21.15.151:0/3964729737 learned_addr learned my addr 172.21.15.151:0/3964729737 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:27.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa7857d3700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa780104ea0 0x7fa78019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:27.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.818+0000 7fa784fd2700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7800ffe00 0x7fa780197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:27.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa77ffff700 1 -- 172.21.15.151:0/3964729737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa780104ea0 msgr2=0x7fa78019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:27.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa77ffff700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa780104ea0 0x7fa78019c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:27.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa77ffff700 1 -- 172.21.15.151:0/3964729737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7800ffe00 msgr2=0x7fa780197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:27.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa77ffff700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7800ffe00 0x7fa780197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:27.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa77ffff700 1 -- 172.21.15.151:0/3964729737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7740095f0 con 0x7fa7801007a0 2023-07-21T22:17:27.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa784fd2700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7800ffe00 0x7fa780197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:17:27.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa77ffff700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7801007a0 0x7fa780198300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c9e0 tx=0x7fa76c00ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:27.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa77dffb700 1 -- 172.21.15.151:0/3964729737 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c007aa0 con 0x7fa7801007a0 2023-07-21T22:17:27.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa78019d2f0 con 0x7fa7801007a0 2023-07-21T22:17:27.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa77dffb700 1 -- 172.21.15.151:0/3964729737 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa76c007c00 con 0x7fa7801007a0 2023-07-21T22:17:27.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa77dffb700 1 -- 172.21.15.151:0/3964729737 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c018660 con 0x7fa7801007a0 2023-07-21T22:17:27.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.819+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7801a4b50 con 0x7fa7801007a0 2023-07-21T22:17:27.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.820+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa78004e210 con 0x7fa7801007a0 2023-07-21T22:17:27.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.822+0000 7fa77dffb700 1 -- 172.21.15.151:0/3964729737 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa76c00f450 con 0x7fa7801007a0 2023-07-21T22:17:27.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.825+0000 7fa77dffb700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7700a11e0 0x7fa7700a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:27.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.825+0000 7fa77dffb700 1 -- 172.21.15.151:0/3964729737 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa76c0ccc20 con 0x7fa7801007a0 2023-07-21T22:17:27.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.825+0000 7fa784fd2700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7700a11e0 0x7fa7700a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:27.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.825+0000 7fa784fd2700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7700a11e0 0x7fa7700a3690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa774006010 tx=0x7fa774000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:27.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:27.827+0000 7fa77dffb700 1 -- 172.21.15.151:0/3964729737 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fa76c0cce60 con 0x7fa7801007a0 2023-07-21T22:17:28.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.023+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa780199120 con 0x7fa7801007a0 2023-07-21T22:17:28.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.025+0000 7fa77dffb700 1 -- 172.21.15.151:0/3964729737 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22175 (secure 0 0 0) 0x7fa76c00fe60 con 0x7fa7801007a0 2023-07-21T22:17:28.070 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:28.071 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":85,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:10.821638+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:17:28.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7700a11e0 msgr2=0x7fa7700a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:28.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7700a11e0 0x7fa7700a3690 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa774006010 tx=0x7fa774000bc0 comp rx=0 tx=0).stop 2023-07-21T22:17:28.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7801007a0 msgr2=0x7fa780198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:28.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7801007a0 0x7fa780198300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa76c00c9e0 tx=0x7fa76c00ccf0 comp rx=0 tx=0).stop 2023-07-21T22:17:28.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 shutdown_connections 2023-07-21T22:17:28.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7700a11e0 0x7fa7700a3690 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:28.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7800ffe00 0x7fa780197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:28.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa780104ea0 0x7fa78019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:28.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 --2- 172.21.15.151:0/3964729737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7801007a0 0x7fa780198300 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:28.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.027+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 >> 172.21.15.151:0/3964729737 conn(0x7fa7800fb660 msgr2=0x7fa7800fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:28.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.028+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 shutdown_connections 2023-07-21T22:17:28.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:28.028+0000 7fa787236700 1 -- 172.21.15.151:0/3964729737 wait complete. 2023-07-21T22:17:28.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:28 smithi151 ceph-mon[95510]: pgmap v307: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2023-07-21T22:17:28.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:28 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3964729737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:28.605 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2023-07-21T22:17:28.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd dump --format=json 2023-07-21T22:17:28.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:28 smithi187 ceph-mon[96918]: pgmap v307: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2023-07-21T22:17:28.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:28 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3964729737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:28.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:28 smithi195 ceph-mon[97365]: pgmap v307: 97 pgs: 97 active+clean; 621 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 4.7 KiB/s wr, 12 op/s 2023-07-21T22:17:28.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:28 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3964729737' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:29.333 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:30.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:30 smithi187 ceph-mon[96918]: pgmap v308: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.8 KiB/s wr, 10 op/s 2023-07-21T22:17:30.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:30 smithi195 ceph-mon[97365]: pgmap v308: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.8 KiB/s wr, 10 op/s 2023-07-21T22:17:30.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:30 smithi151 ceph-mon[95510]: pgmap v308: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 4.8 KiB/s wr, 10 op/s 2023-07-21T22:17:30.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.875+0000 7fd46c85e700 1 -- 172.21.15.151:0/355498417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4680ffe00 msgr2=0x7fd4681001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:30.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.875+0000 7fd46c85e700 1 --2- 172.21.15.151:0/355498417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4680ffe00 0x7fd4681001d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fd4580099c0 tx=0x7fd458009cd0 comp rx=0 tx=0).stop 2023-07-21T22:17:30.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.875+0000 7fd46c85e700 1 -- 172.21.15.151:0/355498417 shutdown_connections 2023-07-21T22:17:30.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.875+0000 7fd46c85e700 1 --2- 172.21.15.151:0/355498417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd468104ea0 0x7fd46810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:30.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.875+0000 7fd46c85e700 1 --2- 172.21.15.151:0/355498417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4680ffe00 0x7fd4681001d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:30.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.875+0000 7fd46c85e700 1 --2- 172.21.15.151:0/355498417 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4681007a0 0x7fd468104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:30.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.875+0000 7fd46c85e700 1 -- 172.21.15.151:0/355498417 >> 172.21.15.151:0/355498417 conn(0x7fd4680fb660 msgr2=0x7fd4680fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:30.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.875+0000 7fd46c85e700 1 -- 172.21.15.151:0/355498417 shutdown_connections 2023-07-21T22:17:30.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.875+0000 7fd46c85e700 1 -- 172.21.15.151:0/355498417 wait complete. 2023-07-21T22:17:30.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.876+0000 7fd46c85e700 1 Processor -- start 2023-07-21T22:17:30.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.877+0000 7fd46c85e700 1 -- start start 2023-07-21T22:17:30.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.877+0000 7fd46c85e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4680ffe00 0x7fd468072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:30.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.877+0000 7fd46c85e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4681007a0 0x7fd468072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:30.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.877+0000 7fd46c85e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd468104ea0 0x7fd4680732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:30.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.877+0000 7fd46c85e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681a40f0 con 0x7fd4681007a0 2023-07-21T22:17:30.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.877+0000 7fd46c85e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681a4260 con 0x7fd468104ea0 2023-07-21T22:17:30.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.877+0000 7fd46c85e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4681a4420 con 0x7fd4680ffe00 2023-07-21T22:17:30.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.877+0000 7fd465d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4681007a0 0x7fd468072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:30.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.877+0000 7fd465d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4681007a0 0x7fd468072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39156/0 (socket says 172.21.15.151:39156) 2023-07-21T22:17:30.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd465d9b700 1 -- 172.21.15.151:0/3019144332 learned_addr learned my addr 172.21.15.151:0/3019144332 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd46659c700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4680ffe00 0x7fd468072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd466d9d700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd468104ea0 0x7fd4680732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd465d9b700 1 -- 172.21.15.151:0/3019144332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4680ffe00 msgr2=0x7fd468072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd465d9b700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4680ffe00 0x7fd468072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd465d9b700 1 -- 172.21.15.151:0/3019144332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd468104ea0 msgr2=0x7fd4680732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:30.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd465d9b700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd468104ea0 0x7fd4680732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd465d9b700 1 -- 172.21.15.151:0/3019144332 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580095f0 con 0x7fd4681007a0 2023-07-21T22:17:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd466d9d700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd468104ea0 0x7fd4680732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:17:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd465d9b700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4681007a0 0x7fd468072d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00d980 tx=0x7fd45c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd4577fe700 1 -- 172.21.15.151:0/3019144332 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c009b40 con 0x7fd4681007a0 2023-07-21T22:17:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd4577fe700 1 -- 172.21.15.151:0/3019144332 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd45c00de60 con 0x7fd4681007a0 2023-07-21T22:17:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.878+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4681a4700 con 0x7fd4681007a0 2023-07-21T22:17:30.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.879+0000 7fd4577fe700 1 -- 172.21.15.151:0/3019144332 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd45c00f620 con 0x7fd4681007a0 2023-07-21T22:17:30.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.879+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4681a4c50 con 0x7fd4681007a0 2023-07-21T22:17:30.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.880+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd46804e210 con 0x7fd4681007a0 2023-07-21T22:17:30.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.881+0000 7fd4577fe700 1 -- 172.21.15.151:0/3019144332 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fd45c010460 con 0x7fd4681007a0 2023-07-21T22:17:30.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.883+0000 7fd4577fe700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd4500a1260 0x7fd4500a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:30.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.883+0000 7fd4577fe700 1 -- 172.21.15.151:0/3019144332 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fd45c0cc540 con 0x7fd4681007a0 2023-07-21T22:17:30.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.883+0000 7fd46659c700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd4500a1260 0x7fd4500a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:30.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.884+0000 7fd46659c700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd4500a1260 0x7fd4500a3710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd4580036c0 tx=0x7fd458009f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:30.930 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:30.887+0000 7fd4577fe700 1 -- 172.21.15.151:0/3019144332 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd45c095be0 con 0x7fd4681007a0 2023-07-21T22:17:31.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.085+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4681a4f10 con 0x7fd4681007a0 2023-07-21T22:17:31.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.086+0000 7fd4577fe700 1 -- 172.21.15.151:0/3019144332 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+22175 (secure 0 0 0) 0x7fd45c099200 con 0x7fd4681007a0 2023-07-21T22:17:31.131 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:17:31.131 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":85,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:10.821638+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:17:31.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd4500a1260 msgr2=0x7fd4500a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:31.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd4500a1260 0x7fd4500a3710 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd4580036c0 tx=0x7fd458009f90 comp rx=0 tx=0).stop 2023-07-21T22:17:31.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4681007a0 msgr2=0x7fd468072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:31.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4681007a0 0x7fd468072d50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00d980 tx=0x7fd45c00dd40 comp rx=0 tx=0).stop 2023-07-21T22:17:31.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 shutdown_connections 2023-07-21T22:17:31.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd4500a1260 0x7fd4500a3710 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:31.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd468104ea0 0x7fd4680732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:31.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd4680ffe00 0x7fd468072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:31.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 --2- 172.21.15.151:0/3019144332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd4681007a0 0x7fd468072d50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:31.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 >> 172.21.15.151:0/3019144332 conn(0x7fd4680fb660 msgr2=0x7fd468103750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:31.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 shutdown_connections 2023-07-21T22:17:31.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:31.089+0000 7fd46c85e700 1 -- 172.21.15.151:0/3019144332 wait complete. 2023-07-21T22:17:31.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:31 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3019144332' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:31.604 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2023-07-21T22:17:31.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2023-07-21T22:17:31.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2023-07-21T22:17:31.606 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2023-07-21T22:17:31.606 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2023-07-21T22:17:31.606 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2023-07-21T22:17:31.607 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2023-07-21T22:17:31.607 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2023-07-21T22:17:31.608 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.8 flush_pg_stats 2023-07-21T22:17:31.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.9 flush_pg_stats 2023-07-21T22:17:31.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.10 flush_pg_stats 2023-07-21T22:17:31.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph tell osd.11 flush_pg_stats 2023-07-21T22:17:31.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:31 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3019144332' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:31.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:31 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3019144332' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:17:32.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:32 smithi187 ceph-mon[96918]: pgmap v309: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-07-21T22:17:32.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:32 smithi195 ceph-mon[97365]: pgmap v309: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-07-21T22:17:32.698 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:32 smithi151 ceph-mon[95510]: pgmap v309: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2023-07-21T22:17:33.406 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:33.428 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:33.841 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:33.843 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:33.844 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:33.885 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:34.118 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:34.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:34 smithi151 ceph-mon[95510]: pgmap v310: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2023-07-21T22:17:34.504 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:34.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:34 smithi187 ceph-mon[96918]: pgmap v310: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2023-07-21T22:17:34.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:34 smithi195 ceph-mon[97365]: pgmap v310: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2023-07-21T22:17:34.831 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:34.833 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:35.255 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:36.542 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:36 smithi151 ceph-mon[95510]: pgmap v311: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2023-07-21T22:17:36.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:36 smithi187 ceph-mon[96918]: pgmap v311: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2023-07-21T22:17:36.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:36 smithi195 ceph-mon[97365]: pgmap v311: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.6 KiB/s wr, 7 op/s 2023-07-21T22:17:36.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.816+0000 7f052e256700 1 -- 172.21.15.151:0/1024133472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0528104ea0 msgr2=0x7f052810ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.816+0000 7f052e256700 1 --2- 172.21.15.151:0/1024133472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0528104ea0 0x7f052810ca20 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f052000b0d0 tx=0x7f052000b3e0 comp rx=0 tx=0).stop 2023-07-21T22:17:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.816+0000 7f052e256700 1 -- 172.21.15.151:0/1024133472 shutdown_connections 2023-07-21T22:17:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.816+0000 7f052e256700 1 --2- 172.21.15.151:0/1024133472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05280ffe00 0x7f05281001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.816+0000 7f052e256700 1 --2- 172.21.15.151:0/1024133472 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0528104ea0 0x7f052810ca20 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.816+0000 7f052e256700 1 --2- 172.21.15.151:0/1024133472 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05281007a0 0x7f0528104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:36.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.816+0000 7f052e256700 1 -- 172.21.15.151:0/1024133472 >> 172.21.15.151:0/1024133472 conn(0x7f05280fb660 msgr2=0x7f05280fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:36.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.816+0000 7f052e256700 1 -- 172.21.15.151:0/1024133472 shutdown_connections 2023-07-21T22:17:36.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.816+0000 7f052e256700 1 -- 172.21.15.151:0/1024133472 wait complete. 2023-07-21T22:17:36.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.817+0000 7f052e256700 1 Processor -- start 2023-07-21T22:17:36.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.818+0000 7f052e256700 1 -- start start 2023-07-21T22:17:36.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f052e256700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05280ffe00 0x7f0528197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f052e256700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05281007a0 0x7f05281983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f052e256700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0528104ea0 0x7f052819c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f052e256700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052819ce40 con 0x7f0528104ea0 2023-07-21T22:17:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f052e256700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052819cfb0 con 0x7f05281007a0 2023-07-21T22:17:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f052e256700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f052819d170 con 0x7f05280ffe00 2023-07-21T22:17:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f0527fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0528104ea0 0x7f052819c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f0527fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0528104ea0 0x7f052819c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42408/0 (socket says 172.21.15.151:42408) 2023-07-21T22:17:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f0527fff700 1 -- 172.21.15.151:0/3848378292 learned_addr learned my addr 172.21.15.151:0/3848378292 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f05277fe700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05280ffe00 0x7f0528197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f0526ffd700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05281007a0 0x7f05281983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f05277fe700 1 -- 172.21.15.151:0/3848378292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05281007a0 msgr2=0x7f05281983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.819+0000 7f05277fe700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05281007a0 0x7f05281983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f05277fe700 1 -- 172.21.15.151:0/3848378292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0528104ea0 msgr2=0x7f052819c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f05277fe700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0528104ea0 0x7f052819c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f05277fe700 1 -- 172.21.15.151:0/3848378292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0520009d00 con 0x7f05280ffe00 2023-07-21T22:17:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f0526ffd700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05281007a0 0x7f05281983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f05277fe700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05280ffe00 0x7f0528197e80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f051800d750 tx=0x7f051800da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f0524ff9700 1 -- 172.21.15.151:0/3848378292 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0518004220 con 0x7f05280ffe00 2023-07-21T22:17:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f0524ff9700 1 -- 172.21.15.151:0/3848378292 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0518004cc0 con 0x7f05280ffe00 2023-07-21T22:17:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f052819d450 con 0x7f05280ffe00 2023-07-21T22:17:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f0524ff9700 1 -- 172.21.15.151:0/3848378292 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05180056f0 con 0x7f05280ffe00 2023-07-21T22:17:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.820+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05281a4cb0 con 0x7f05280ffe00 2023-07-21T22:17:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.821+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f052810fc10 con 0x7f05280ffe00 2023-07-21T22:17:36.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.824+0000 7f0524ff9700 1 -- 172.21.15.151:0/3848378292 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f0518004e30 con 0x7f05280ffe00 2023-07-21T22:17:36.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.825+0000 7f0524ff9700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f05100a11e0 0x7f05100a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:36.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.825+0000 7f0524ff9700 1 -- 172.21.15.151:0/3848378292 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f05180ccdb0 con 0x7f05280ffe00 2023-07-21T22:17:36.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.825+0000 7f0526ffd700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f05100a11e0 0x7f05100a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:36.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.825+0000 7f0524ff9700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] conn(0x7f05100aa9b0 0x7f05100acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:36.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.825+0000 7f0524ff9700 1 -- 172.21.15.151:0/3848378292 --> [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f05100ad470 con 0x7f05100aa9b0 2023-07-21T22:17:36.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.825+0000 7f0524ff9700 1 -- 172.21.15.151:0/3848378292 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05180cd120 con 0x7f05280ffe00 2023-07-21T22:17:36.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.826+0000 7f0526ffd700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f05100a11e0 0x7f05100a3690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f05281994a0 tx=0x7f051c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:36.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.826+0000 7f0527fff700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] conn(0x7f05100aa9b0 0x7f05100acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:36.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.826+0000 7f0527fff700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] conn(0x7f05100aa9b0 0x7f05100acdc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:36.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.827+0000 7f0524ff9700 1 -- 172.21.15.151:0/3848378292 <== osd.2 v2:172.21.15.195:6800/3736985408 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f05100ad470 con 0x7f05100aa9b0 2023-07-21T22:17:36.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.845+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 --> [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f052804e210 con 0x7f05100aa9b0 2023-07-21T22:17:36.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.845+0000 7f0524ff9700 1 -- 172.21.15.151:0/3848378292 <== osd.2 v2:172.21.15.195:6800/3736985408 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f052804e210 con 0x7f05100aa9b0 2023-07-21T22:17:36.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.846+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 >> [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] conn(0x7f05100aa9b0 msgr2=0x7f05100acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:36.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.846+0000 7f052e256700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] conn(0x7f05100aa9b0 0x7f05100acdc0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:36.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.846+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f05100a11e0 msgr2=0x7f05100a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:36.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.846+0000 7f052e256700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f05100a11e0 0x7f05100a3690 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f05281994a0 tx=0x7f051c009260 comp rx=0 tx=0).stop 2023-07-21T22:17:36.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.846+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05280ffe00 msgr2=0x7f0528197e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:36.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.846+0000 7f052e256700 1 --2- 172.21.15.151:0/3848378292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f05280ffe00 0x7f0528197e80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f051800d750 tx=0x7f051800da60 comp rx=0 tx=0).stop 2023-07-21T22:17:36.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.846+0000 7f0527fff700 1 -- 172.21.15.151:0/3848378292 reap_dead start 2023-07-21T22:17:36.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.846+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 shutdown_connections 2023-07-21T22:17:36.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.846+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 >> 172.21.15.151:0/3848378292 conn(0x7f05280fb660 msgr2=0x7f05280fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:36.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.847+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 shutdown_connections 2023-07-21T22:17:36.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:36.847+0000 7f052e256700 1 -- 172.21.15.151:0/3848378292 wait complete. 2023-07-21T22:17:38.551 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:38 smithi151 ceph-mon[95510]: pgmap v312: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2023-07-21T22:17:38.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:38 smithi187 ceph-mon[96918]: pgmap v312: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2023-07-21T22:17:38.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:38 smithi195 ceph-mon[97365]: pgmap v312: 97 pgs: 97 active+clean; 631 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.1 KiB/s wr, 5 op/s 2023-07-21T22:17:38.942 INFO:teuthology.orchestra.run.smithi151.stdout:77309411394 2023-07-21T22:17:38.942 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.2 2023-07-21T22:17:40.506 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:40 smithi151 ceph-mon[95510]: pgmap v313: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-07-21T22:17:40.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:40 smithi187 ceph-mon[96918]: pgmap v313: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-07-21T22:17:40.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:40 smithi195 ceph-mon[97365]: pgmap v313: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2023-07-21T22:17:40.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.153+0000 7fa05ef4e700 1 -- 172.21.15.151:0/2227689930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0581070e0 msgr2=0x7fa05810ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:40.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.153+0000 7fa05ef4e700 1 --2- 172.21.15.151:0/2227689930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0581070e0 0x7fa05810ec60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa05000b0d0 tx=0x7fa05000b3e0 comp rx=0 tx=0).stop 2023-07-21T22:17:40.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.153+0000 7fa05ef4e700 1 -- 172.21.15.151:0/2227689930 shutdown_connections 2023-07-21T22:17:40.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.153+0000 7fa05ef4e700 1 --2- 172.21.15.151:0/2227689930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa058102040 0x7fa058102410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:40.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.153+0000 7fa05ef4e700 1 --2- 172.21.15.151:0/2227689930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0581070e0 0x7fa05810ec60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:40.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.153+0000 7fa05ef4e700 1 --2- 172.21.15.151:0/2227689930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0581029e0 0x7fa0581069b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:40.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.153+0000 7fa05ef4e700 1 -- 172.21.15.151:0/2227689930 >> 172.21.15.151:0/2227689930 conn(0x7fa0580fd900 msgr2=0x7fa0580ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:40.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.153+0000 7fa05ef4e700 1 -- 172.21.15.151:0/2227689930 shutdown_connections 2023-07-21T22:17:40.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.153+0000 7fa05ef4e700 1 -- 172.21.15.151:0/2227689930 wait complete. 2023-07-21T22:17:40.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.154+0000 7fa05ef4e700 1 Processor -- start 2023-07-21T22:17:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.154+0000 7fa05ef4e700 1 -- start start 2023-07-21T22:17:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.154+0000 7fa05ef4e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa058102040 0x7fa058197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.154+0000 7fa05ef4e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0581029e0 0x7fa0581982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.154+0000 7fa05ef4e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0581070e0 0x7fa05819c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.154+0000 7fa05ef4e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05819cd60 con 0x7fa058102040 2023-07-21T22:17:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.154+0000 7fa05ef4e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05819ced0 con 0x7fa0581029e0 2023-07-21T22:17:40.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.154+0000 7fa05ef4e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05819d090 con 0x7fa0581070e0 2023-07-21T22:17:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.154+0000 7fa05ccea700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa058102040 0x7fa058197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05ccea700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa058102040 0x7fa058197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42418/0 (socket says 172.21.15.151:42418) 2023-07-21T22:17:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05ccea700 1 -- 172.21.15.151:0/89045518 learned_addr learned my addr 172.21.15.151:0/89045518 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa057fff700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0581029e0 0x7fa0581982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05d4eb700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0581070e0 0x7fa05819c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05ccea700 1 -- 172.21.15.151:0/89045518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0581070e0 msgr2=0x7fa05819c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05ccea700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0581070e0 0x7fa05819c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:40.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05ccea700 1 -- 172.21.15.151:0/89045518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0581029e0 msgr2=0x7fa0581982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05ccea700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0581029e0 0x7fa0581982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05ccea700 1 -- 172.21.15.151:0/89045518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa050009d00 con 0x7fa058102040 2023-07-21T22:17:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa057fff700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0581029e0 0x7fa0581982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05ccea700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa058102040 0x7fa058197da0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00c9b0 tx=0x7fa04c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa055ffb700 1 -- 172.21.15.151:0/89045518 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c007b00 con 0x7fa058102040 2023-07-21T22:17:40.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05819d370 con 0x7fa058102040 2023-07-21T22:17:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa055ffb700 1 -- 172.21.15.151:0/89045518 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa04c007c60 con 0x7fa058102040 2023-07-21T22:17:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.155+0000 7fa055ffb700 1 -- 172.21.15.151:0/89045518 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c018660 con 0x7fa058102040 2023-07-21T22:17:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.156+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0581a4bd0 con 0x7fa058102040 2023-07-21T22:17:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.156+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa058111e90 con 0x7fa058102040 2023-07-21T22:17:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.158+0000 7fa055ffb700 1 -- 172.21.15.151:0/89045518 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa04c00f450 con 0x7fa058102040 2023-07-21T22:17:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.160+0000 7fa055ffb700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa0480a11e0 0x7fa0480a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.160+0000 7fa055ffb700 1 -- 172.21.15.151:0/89045518 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa04c0cced0 con 0x7fa058102040 2023-07-21T22:17:40.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.160+0000 7fa057fff700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa0480a11e0 0x7fa0480a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:40.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.160+0000 7fa055ffb700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] conn(0x7fa0480aa9b0 0x7fa0480acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:40.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.160+0000 7fa055ffb700 1 -- 172.21.15.151:0/89045518 --> [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa0480ad470 con 0x7fa0480aa9b0 2023-07-21T22:17:40.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.160+0000 7fa055ffb700 1 -- 172.21.15.151:0/89045518 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa04c0cd240 con 0x7fa058102040 2023-07-21T22:17:40.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.161+0000 7fa05d4eb700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] conn(0x7fa0480aa9b0 0x7fa0480acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:40.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.161+0000 7fa057fff700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa0480a11e0 0x7fa0480a3690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa044005fd0 tx=0x7fa04400a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:40.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.161+0000 7fa05d4eb700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] conn(0x7fa0480aa9b0 0x7fa0480acdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.162+0000 7fa055ffb700 1 -- 172.21.15.151:0/89045518 <== osd.7 v2:172.21.15.187:6816/963467354 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa0480ad470 con 0x7fa0480aa9b0 2023-07-21T22:17:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.179+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 --> [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa05804e210 con 0x7fa0480aa9b0 2023-07-21T22:17:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.179+0000 7fa055ffb700 1 -- 172.21.15.151:0/89045518 <== osd.7 v2:172.21.15.187:6816/963467354 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa05804e210 con 0x7fa0480aa9b0 2023-07-21T22:17:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 >> [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] conn(0x7fa0480aa9b0 msgr2=0x7fa0480acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:40.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] conn(0x7fa0480aa9b0 0x7fa0480acdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa0480a11e0 msgr2=0x7fa0480a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa0480a11e0 0x7fa0480a3690 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa044005fd0 tx=0x7fa04400a5e0 comp rx=0 tx=0).stop 2023-07-21T22:17:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa058102040 msgr2=0x7fa058197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 --2- 172.21.15.151:0/89045518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa058102040 0x7fa058197da0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa04c00c9b0 tx=0x7fa04c00cd70 comp rx=0 tx=0).stop 2023-07-21T22:17:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05d4eb700 1 -- 172.21.15.151:0/89045518 reap_dead start 2023-07-21T22:17:40.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 shutdown_connections 2023-07-21T22:17:40.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 >> 172.21.15.151:0/89045518 conn(0x7fa0580fd900 msgr2=0x7fa0580fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:40.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 shutdown_connections 2023-07-21T22:17:40.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.180+0000 7fa05ef4e700 1 -- 172.21.15.151:0/89045518 wait complete. 2023-07-21T22:17:41.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.967+0000 7f1038a0b700 1 -- 172.21.15.151:0/2655698164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1034104ea0 msgr2=0x7f103410ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:41.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.967+0000 7f1038a0b700 1 --2- 172.21.15.151:0/2655698164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1034104ea0 0x7f103410ca20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f102c00b0d0 tx=0x7f102c00b3e0 comp rx=0 tx=0).stop 2023-07-21T22:17:41.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.967+0000 7f1038a0b700 1 -- 172.21.15.151:0/2655698164 shutdown_connections 2023-07-21T22:17:41.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.967+0000 7f1038a0b700 1 --2- 172.21.15.151:0/2655698164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1034104ea0 0x7f103410ca20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.967+0000 7f1038a0b700 1 --2- 172.21.15.151:0/2655698164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10340ffe00 0x7f10341001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.967+0000 7f1038a0b700 1 --2- 172.21.15.151:0/2655698164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10341007a0 0x7f1034104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.967+0000 7f1038a0b700 1 -- 172.21.15.151:0/2655698164 >> 172.21.15.151:0/2655698164 conn(0x7f10340fb660 msgr2=0x7f10340fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.967+0000 7f1038a0b700 1 -- 172.21.15.151:0/2655698164 shutdown_connections 2023-07-21T22:17:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.967+0000 7f1038a0b700 1 -- 172.21.15.151:0/2655698164 wait complete. 2023-07-21T22:17:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.968+0000 7f1038a0b700 1 Processor -- start 2023-07-21T22:17:41.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.968+0000 7f1038a0b700 1 -- start start 2023-07-21T22:17:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1038a0b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10340ffe00 0x7f1034195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1038a0b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10341007a0 0x7f10341962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1038a0b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1034104ea0 0x7f103419a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1038a0b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103419ad20 con 0x7f1034104ea0 2023-07-21T22:17:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1038a0b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103419ae90 con 0x7f10340ffe00 2023-07-21T22:17:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1038a0b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f103419b050 con 0x7f10341007a0 2023-07-21T22:17:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1032d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1034104ea0 0x7f103419a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:41.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1032d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1034104ea0 0x7f103419a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42448/0 (socket says 172.21.15.151:42448) 2023-07-21T22:17:41.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1032d9d700 1 -- 172.21.15.151:0/1229951796 learned_addr learned my addr 172.21.15.151:0/1229951796 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:41.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f102bfff700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10341007a0 0x7f10341962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:41.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f103259c700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10340ffe00 0x7f1034195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:41.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1032d9d700 1 -- 172.21.15.151:0/1229951796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10341007a0 msgr2=0x7f10341962a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:41.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1032d9d700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10341007a0 0x7f10341962a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:41.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1032d9d700 1 -- 172.21.15.151:0/1229951796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10340ffe00 msgr2=0x7f1034195d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:41.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1032d9d700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10340ffe00 0x7f1034195d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:41.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.969+0000 7f1032d9d700 1 -- 172.21.15.151:0/1229951796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c009d00 con 0x7f1034104ea0 2023-07-21T22:17:41.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.970+0000 7f1032d9d700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1034104ea0 0x7f103419a710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f102c009300 tx=0x7f102c009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:41.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.970+0000 7f102b7fe700 1 -- 172.21.15.151:0/1229951796 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c00e040 con 0x7f1034104ea0 2023-07-21T22:17:41.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.970+0000 7f102b7fe700 1 -- 172.21.15.151:0/1229951796 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f102c003e10 con 0x7f1034104ea0 2023-07-21T22:17:41.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.970+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f103419b2d0 con 0x7f1034104ea0 2023-07-21T22:17:41.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.970+0000 7f102b7fe700 1 -- 172.21.15.151:0/1229951796 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102c01b8e0 con 0x7f1034104ea0 2023-07-21T22:17:41.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.970+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10341a2b90 con 0x7f1034104ea0 2023-07-21T22:17:41.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.971+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f103410fc00 con 0x7f1034104ea0 2023-07-21T22:17:41.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.973+0000 7f102b7fe700 1 -- 172.21.15.151:0/1229951796 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f102c005090 con 0x7f1034104ea0 2023-07-21T22:17:41.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.975+0000 7f102b7fe700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10200a1260 0x7f10200a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:41.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.975+0000 7f102b7fe700 1 -- 172.21.15.151:0/1229951796 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f102c0ce300 con 0x7f1034104ea0 2023-07-21T22:17:41.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.975+0000 7f103259c700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10200a1260 0x7f10200a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:41.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.975+0000 7f102b7fe700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] conn(0x7f10200aaa30 0x7f10200ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:41.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.975+0000 7f102b7fe700 1 -- 172.21.15.151:0/1229951796 --> [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10200ad4f0 con 0x7f10200aaa30 2023-07-21T22:17:41.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.975+0000 7f102b7fe700 1 -- 172.21.15.151:0/1229951796 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f102c0ce670 con 0x7f1034104ea0 2023-07-21T22:17:41.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.975+0000 7f102bfff700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] conn(0x7f10200aaa30 0x7f10200ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:41.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.975+0000 7f103259c700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10200a1260 0x7f10200a3710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1024007be0 tx=0x7f10240073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:41.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.976+0000 7f102bfff700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] conn(0x7f10200aaa30 0x7f10200ace40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:41.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.977+0000 7f102b7fe700 1 -- 172.21.15.151:0/1229951796 <== osd.9 v2:172.21.15.151:6826/2119659233 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f10200ad4f0 con 0x7f10200aaa30 2023-07-21T22:17:41.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.993+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 --> [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f103404e210 con 0x7f10200aaa30 2023-07-21T22:17:41.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.994+0000 7f102b7fe700 1 -- 172.21.15.151:0/1229951796 <== osd.9 v2:172.21.15.151:6826/2119659233 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f103404e210 con 0x7f10200aaa30 2023-07-21T22:17:41.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.994+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] conn(0x7f10200aaa30 msgr2=0x7f10200ace40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:41.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.994+0000 7f1038a0b700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] conn(0x7f10200aaa30 0x7f10200ace40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:41.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.994+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10200a1260 msgr2=0x7f10200a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:41.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.994+0000 7f1038a0b700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10200a1260 0x7f10200a3710 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f1024007be0 tx=0x7f10240073d0 comp rx=0 tx=0).stop 2023-07-21T22:17:41.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.994+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1034104ea0 msgr2=0x7f103419a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.994+0000 7f1038a0b700 1 --2- 172.21.15.151:0/1229951796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1034104ea0 0x7f103419a710 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f102c009300 tx=0x7f102c009330 comp rx=0 tx=0).stop 2023-07-21T22:17:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.994+0000 7f1032d9d700 1 -- 172.21.15.151:0/1229951796 reap_dead start 2023-07-21T22:17:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.995+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 shutdown_connections 2023-07-21T22:17:41.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.995+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 >> 172.21.15.151:0/1229951796 conn(0x7f10340fb660 msgr2=0x7f10340fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:41.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.995+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 shutdown_connections 2023-07-21T22:17:41.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:40.995+0000 7f1038a0b700 1 -- 172.21.15.151:0/1229951796 wait complete. 2023-07-21T22:17:42.078 INFO:teuthology.orchestra.run.smithi151.stdout:219043332136 2023-07-21T22:17:42.078 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.7 2023-07-21T22:17:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.461+0000 7fa847434700 1 -- 172.21.15.151:0/3974981525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8401007a0 msgr2=0x7fa840104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.461+0000 7fa847434700 1 --2- 172.21.15.151:0/3974981525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8401007a0 0x7fa840104770 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa8300099c0 tx=0x7fa830009cd0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.462+0000 7fa847434700 1 -- 172.21.15.151:0/3974981525 shutdown_connections 2023-07-21T22:17:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.462+0000 7fa847434700 1 --2- 172.21.15.151:0/3974981525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa840104ea0 0x7fa84010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.462+0000 7fa847434700 1 --2- 172.21.15.151:0/3974981525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8400ffe00 0x7fa8401001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.462+0000 7fa847434700 1 --2- 172.21.15.151:0/3974981525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8401007a0 0x7fa840104770 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.462+0000 7fa847434700 1 -- 172.21.15.151:0/3974981525 >> 172.21.15.151:0/3974981525 conn(0x7fa8400fb660 msgr2=0x7fa8400fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.462+0000 7fa847434700 1 -- 172.21.15.151:0/3974981525 shutdown_connections 2023-07-21T22:17:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.462+0000 7fa847434700 1 -- 172.21.15.151:0/3974981525 wait complete. 2023-07-21T22:17:42.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa847434700 1 Processor -- start 2023-07-21T22:17:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa847434700 1 -- start start 2023-07-21T22:17:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa847434700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8400ffe00 0x7fa84019b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa847434700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8401007a0 0x7fa84019be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa847434700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa840104ea0 0x7fa840195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa847434700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8401960b0 con 0x7fa8400ffe00 2023-07-21T22:17:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa847434700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa840196220 con 0x7fa840104ea0 2023-07-21T22:17:42.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa847434700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8401963e0 con 0x7fa8401007a0 2023-07-21T22:17:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa8451d0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8400ffe00 0x7fa84019b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa8451d0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8400ffe00 0x7fa84019b920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42466/0 (socket says 172.21.15.151:42466) 2023-07-21T22:17:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.463+0000 7fa8451d0700 1 -- 172.21.15.151:0/3447293191 learned_addr learned my addr 172.21.15.151:0/3447293191 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:42.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8449cf700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8401007a0 0x7fa84019be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8459d1700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa840104ea0 0x7fa840195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8451d0700 1 -- 172.21.15.151:0/3447293191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8401007a0 msgr2=0x7fa84019be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8451d0700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa8401007a0 0x7fa84019be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8451d0700 1 -- 172.21.15.151:0/3447293191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa840104ea0 msgr2=0x7fa840195a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8451d0700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa840104ea0 0x7fa840195a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8451d0700 1 -- 172.21.15.151:0/3447293191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8300095f0 con 0x7fa8400ffe00 2023-07-21T22:17:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8459d1700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa840104ea0 0x7fa840195a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:17:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8451d0700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8400ffe00 0x7fa84019b920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00d950 tx=0x7fa83c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:42.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8367fc700 1 -- 172.21.15.151:0/3447293191 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c009b40 con 0x7fa8400ffe00 2023-07-21T22:17:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8367fc700 1 -- 172.21.15.151:0/3447293191 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa83c009ca0 con 0x7fa8400ffe00 2023-07-21T22:17:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8401966c0 con 0x7fa8400ffe00 2023-07-21T22:17:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa8367fc700 1 -- 172.21.15.151:0/3447293191 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa83c00f620 con 0x7fa8400ffe00 2023-07-21T22:17:42.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.464+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8401a2910 con 0x7fa8400ffe00 2023-07-21T22:17:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.465+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa84004e210 con 0x7fa8400ffe00 2023-07-21T22:17:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.467+0000 7fa8367fc700 1 -- 172.21.15.151:0/3447293191 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa83c010460 con 0x7fa8400ffe00 2023-07-21T22:17:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.468+0000 7fa8367fc700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa82c0a1260 0x7fa82c0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.469+0000 7fa8367fc700 1 -- 172.21.15.151:0/3447293191 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fa83c0ccde0 con 0x7fa8400ffe00 2023-07-21T22:17:42.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.469+0000 7fa8449cf700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa82c0a1260 0x7fa82c0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.469+0000 7fa8367fc700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] conn(0x7fa82c0aaa30 0x7fa82c0ace40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.469+0000 7fa8367fc700 1 -- 172.21.15.151:0/3447293191 --> [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa82c0ad4f0 con 0x7fa82c0aaa30 2023-07-21T22:17:42.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.469+0000 7fa8367fc700 1 -- 172.21.15.151:0/3447293191 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa83c0cd150 con 0x7fa8400ffe00 2023-07-21T22:17:42.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.469+0000 7fa8449cf700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa82c0a1260 0x7fa82c0a3710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa830000c00 tx=0x7fa830009f70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:42.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.470+0000 7fa8459d1700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] conn(0x7fa82c0aaa30 0x7fa82c0ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.470+0000 7fa8459d1700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] conn(0x7fa82c0aaa30 0x7fa82c0ace40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:42.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.471+0000 7fa8367fc700 1 -- 172.21.15.151:0/3447293191 <== osd.10 v2:172.21.15.187:6824/1369649564 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa82c0ad4f0 con 0x7fa82c0aaa30 2023-07-21T22:17:42.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.488+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 --> [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa8400fca80 con 0x7fa82c0aaa30 2023-07-21T22:17:42.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa8367fc700 1 -- 172.21.15.151:0/3447293191 <== osd.10 v2:172.21.15.187:6824/1369649564 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa8400fca80 con 0x7fa82c0aaa30 2023-07-21T22:17:42.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 >> [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] conn(0x7fa82c0aaa30 msgr2=0x7fa82c0ace40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] conn(0x7fa82c0aaa30 0x7fa82c0ace40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa82c0a1260 msgr2=0x7fa82c0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa82c0a1260 0x7fa82c0a3710 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa830000c00 tx=0x7fa830009f70 comp rx=0 tx=0).stop 2023-07-21T22:17:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8400ffe00 msgr2=0x7fa84019b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 --2- 172.21.15.151:0/3447293191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8400ffe00 0x7fa84019b920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa83c00d950 tx=0x7fa83c00dd10 comp rx=0 tx=0).stop 2023-07-21T22:17:42.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa8459d1700 1 -- 172.21.15.151:0/3447293191 reap_dead start 2023-07-21T22:17:42.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 shutdown_connections 2023-07-21T22:17:42.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 >> 172.21.15.151:0/3447293191 conn(0x7fa8400fb660 msgr2=0x7fa8400fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:42.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 shutdown_connections 2023-07-21T22:17:42.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:41.489+0000 7fa847434700 1 -- 172.21.15.151:0/3447293191 wait complete. 2023-07-21T22:17:42.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:42 smithi151 ceph-mon[95510]: pgmap v314: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:17:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.530+0000 7faba3e52700 1 -- 172.21.15.151:0/1734186968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab9c1007a0 msgr2=0x7fab9c104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.574 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.530+0000 7faba3e52700 1 --2- 172.21.15.151:0/1734186968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab9c1007a0 0x7fab9c104770 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fab8c0099c0 tx=0x7fab8c009cd0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.530+0000 7faba3e52700 1 -- 172.21.15.151:0/1734186968 shutdown_connections 2023-07-21T22:17:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.530+0000 7faba3e52700 1 --2- 172.21.15.151:0/1734186968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab9c104ea0 0x7fab9c10ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.530+0000 7faba3e52700 1 --2- 172.21.15.151:0/1734186968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab9c0ffe00 0x7fab9c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.530+0000 7faba3e52700 1 --2- 172.21.15.151:0/1734186968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab9c1007a0 0x7fab9c104770 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.530+0000 7faba3e52700 1 -- 172.21.15.151:0/1734186968 >> 172.21.15.151:0/1734186968 conn(0x7fab9c0fb660 msgr2=0x7fab9c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.530+0000 7faba3e52700 1 -- 172.21.15.151:0/1734186968 shutdown_connections 2023-07-21T22:17:42.575 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.530+0000 7faba3e52700 1 -- 172.21.15.151:0/1734186968 wait complete. 2023-07-21T22:17:42.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.531+0000 7faba3e52700 1 Processor -- start 2023-07-21T22:17:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.531+0000 7faba3e52700 1 -- start start 2023-07-21T22:17:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba3e52700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab9c0ffe00 0x7fab9c072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba3e52700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab9c1007a0 0x7fab9c072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba3e52700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab9c104ea0 0x7fab9c073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba3e52700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c1a3fe0 con 0x7fab9c104ea0 2023-07-21T22:17:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba3e52700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c1a4150 con 0x7fab9c1007a0 2023-07-21T22:17:42.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba3e52700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c1a4310 con 0x7fab9c0ffe00 2023-07-21T22:17:42.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba23ef700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab9c104ea0 0x7fab9c073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba23ef700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab9c104ea0 0x7fab9c073290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42496/0 (socket says 172.21.15.151:42496) 2023-07-21T22:17:42.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba23ef700 1 -- 172.21.15.151:0/2937731746 learned_addr learned my addr 172.21.15.151:0/2937731746 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:42.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba13ed700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab9c1007a0 0x7fab9c072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba1bee700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab9c0ffe00 0x7fab9c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba23ef700 1 -- 172.21.15.151:0/2937731746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab9c0ffe00 msgr2=0x7fab9c072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba23ef700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab9c0ffe00 0x7fab9c072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba23ef700 1 -- 172.21.15.151:0/2937731746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab9c1007a0 msgr2=0x7fab9c072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba23ef700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab9c1007a0 0x7fab9c072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba23ef700 1 -- 172.21.15.151:0/2937731746 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab8c0095f0 con 0x7fab9c104ea0 2023-07-21T22:17:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.532+0000 7faba1bee700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab9c0ffe00 0x7fab9c072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:42.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.533+0000 7faba23ef700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab9c104ea0 0x7fab9c073290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fab94007d70 tx=0x7fab9400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:42.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.533+0000 7fab92ffd700 1 -- 172.21.15.151:0/2937731746 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9400ad40 con 0x7fab9c104ea0 2023-07-21T22:17:42.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.533+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9c1a45f0 con 0x7fab9c104ea0 2023-07-21T22:17:42.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.533+0000 7fab92ffd700 1 -- 172.21.15.151:0/2937731746 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab940128b0 con 0x7fab9c104ea0 2023-07-21T22:17:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.533+0000 7fab92ffd700 1 -- 172.21.15.151:0/2937731746 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab940115a0 con 0x7fab9c104ea0 2023-07-21T22:17:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.533+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9c1a4a70 con 0x7fab9c104ea0 2023-07-21T22:17:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.534+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fab9c04e210 con 0x7fab9c104ea0 2023-07-21T22:17:42.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.536+0000 7fab92ffd700 1 -- 172.21.15.151:0/2937731746 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fab94012a20 con 0x7fab9c104ea0 2023-07-21T22:17:42.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.537+0000 7fab92ffd700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab880a11e0 0x7fab880a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.538+0000 7fab92ffd700 1 -- 172.21.15.151:0/2937731746 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7fab940ccf80 con 0x7fab9c104ea0 2023-07-21T22:17:42.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.538+0000 7faba1bee700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab880a11e0 0x7fab880a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.538+0000 7fab92ffd700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] conn(0x7fab880aa9b0 0x7fab880acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.538+0000 7fab92ffd700 1 -- 172.21.15.151:0/2937731746 --> [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fab880ad470 con 0x7fab880aa9b0 2023-07-21T22:17:42.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.538+0000 7fab92ffd700 1 -- 172.21.15.151:0/2937731746 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab940cd420 con 0x7fab9c104ea0 2023-07-21T22:17:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.538+0000 7faba13ed700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] conn(0x7fab880aa9b0 0x7fab880acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.538+0000 7faba1bee700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab880a11e0 0x7fab880a3690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab98009cb0 tx=0x7fab98009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.539+0000 7faba13ed700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] conn(0x7fab880aa9b0 0x7fab880acdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:42.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.539+0000 7fab92ffd700 1 -- 172.21.15.151:0/2937731746 <== osd.3 v2:172.21.15.151:6810/446322037 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fab880ad470 con 0x7fab880aa9b0 2023-07-21T22:17:42.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.557+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 --> [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fab9c10fc40 con 0x7fab880aa9b0 2023-07-21T22:17:42.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.558+0000 7fab92ffd700 1 -- 172.21.15.151:0/2937731746 <== osd.3 v2:172.21.15.151:6810/446322037 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fab8c01e040 con 0x7fab880aa9b0 2023-07-21T22:17:42.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.558+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] conn(0x7fab880aa9b0 msgr2=0x7fab880acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.558+0000 7faba3e52700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] conn(0x7fab880aa9b0 0x7fab880acdc0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.559+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab880a11e0 msgr2=0x7fab880a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.559+0000 7faba3e52700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab880a11e0 0x7fab880a3690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fab98009cb0 tx=0x7fab98009260 comp rx=0 tx=0).stop 2023-07-21T22:17:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.559+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab9c104ea0 msgr2=0x7fab9c073290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.559+0000 7faba3e52700 1 --2- 172.21.15.151:0/2937731746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab9c104ea0 0x7fab9c073290 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fab94007d70 tx=0x7fab9400a340 comp rx=0 tx=0).stop 2023-07-21T22:17:42.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.559+0000 7faba23ef700 1 -- 172.21.15.151:0/2937731746 reap_dead start 2023-07-21T22:17:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.559+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 shutdown_connections 2023-07-21T22:17:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.559+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 >> 172.21.15.151:0/2937731746 conn(0x7fab9c0fb660 msgr2=0x7fab9c0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.559+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 shutdown_connections 2023-07-21T22:17:42.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:42.559+0000 7faba3e52700 1 -- 172.21.15.151:0/2937731746 wait complete. 2023-07-21T22:17:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:42 smithi187 ceph-mon[96918]: pgmap v314: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:17:42.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:42 smithi195 ceph-mon[97365]: pgmap v314: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:17:42.845 INFO:teuthology.orchestra.run.smithi151.stdout:287762808861 2023-07-21T22:17:42.846 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.9 2023-07-21T22:17:43.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.151+0000 7f2126b2d700 1 -- 172.21.15.151:0/1371379328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21201020a0 msgr2=0x7f2120102470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.151+0000 7f2126b2d700 1 --2- 172.21.15.151:0/1371379328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21201020a0 0x7f2120102470 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f21140099c0 tx=0x7f2114009cd0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.151+0000 7f2126b2d700 1 -- 172.21.15.151:0/1371379328 shutdown_connections 2023-07-21T22:17:43.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.151+0000 7f2126b2d700 1 --2- 172.21.15.151:0/1371379328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2120107140 0x7f212010ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.151+0000 7f2126b2d700 1 --2- 172.21.15.151:0/1371379328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f21201020a0 0x7f2120102470 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.151+0000 7f2126b2d700 1 --2- 172.21.15.151:0/1371379328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2120102a40 0x7f2120106a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.151+0000 7f2126b2d700 1 -- 172.21.15.151:0/1371379328 >> 172.21.15.151:0/1371379328 conn(0x7f21200fd940 msgr2=0x7f21200ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:43.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.151+0000 7f2126b2d700 1 -- 172.21.15.151:0/1371379328 shutdown_connections 2023-07-21T22:17:43.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.151+0000 7f2126b2d700 1 -- 172.21.15.151:0/1371379328 wait complete. 2023-07-21T22:17:43.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.152+0000 7f2126b2d700 1 Processor -- start 2023-07-21T22:17:43.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f2126b2d700 1 -- start start 2023-07-21T22:17:43.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f2126b2d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21201020a0 0x7f2120197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f2126b2d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2120102a40 0x7f21201982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f2126b2d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2120107140 0x7f212019c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f2126b2d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212019cd30 con 0x7f2120102a40 2023-07-21T22:17:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f2126b2d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212019cea0 con 0x7f21201020a0 2023-07-21T22:17:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f2126b2d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f212019d060 con 0x7f2120107140 2023-07-21T22:17:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f211ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2120102a40 0x7f21201982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f211ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2120102a40 0x7f21201982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42522/0 (socket says 172.21.15.151:42522) 2023-07-21T22:17:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f211ffff700 1 -- 172.21.15.151:0/1494242528 learned_addr learned my addr 172.21.15.151:0/1494242528 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.153+0000 7f21248c9700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21201020a0 0x7f2120197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f21250ca700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2120107140 0x7f212019c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f211ffff700 1 -- 172.21.15.151:0/1494242528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2120107140 msgr2=0x7f212019c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f211ffff700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2120107140 0x7f212019c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f211ffff700 1 -- 172.21.15.151:0/1494242528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21201020a0 msgr2=0x7f2120197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f211ffff700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21201020a0 0x7f2120197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f211ffff700 1 -- 172.21.15.151:0/1494242528 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21140095f0 con 0x7f2120102a40 2023-07-21T22:17:43.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f21248c9700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21201020a0 0x7f2120197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:43.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f21250ca700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2120107140 0x7f212019c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:17:43.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f211ffff700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2120102a40 0x7f21201982b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f210c00e970 tx=0x7f210c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:43.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f211dffb700 1 -- 172.21.15.151:0/1494242528 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c009790 con 0x7f2120102a40 2023-07-21T22:17:43.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f212019d340 con 0x7f2120102a40 2023-07-21T22:17:43.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f211dffb700 1 -- 172.21.15.151:0/1494242528 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f210c004cc0 con 0x7f2120102a40 2023-07-21T22:17:43.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f211dffb700 1 -- 172.21.15.151:0/1494242528 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210c0055b0 con 0x7f2120102a40 2023-07-21T22:17:43.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.154+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21201a4ba0 con 0x7f2120102a40 2023-07-21T22:17:43.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.155+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f212004e210 con 0x7f2120102a40 2023-07-21T22:17:43.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.157+0000 7f211dffb700 1 -- 172.21.15.151:0/1494242528 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f210c004e30 con 0x7f2120102a40 2023-07-21T22:17:43.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.159+0000 7f211dffb700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f21100a11e0 0x7f21100a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.159+0000 7f211dffb700 1 -- 172.21.15.151:0/1494242528 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 7979+0+0 (secure 0 0 0) 0x7f210c014070 con 0x7f2120102a40 2023-07-21T22:17:43.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.159+0000 7f21248c9700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f21100a11e0 0x7f21100a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.159+0000 7f211dffb700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] conn(0x7f21100aa9b0 0x7f21100acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.159+0000 7f211dffb700 1 -- 172.21.15.151:0/1494242528 --> [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21100ad470 con 0x7f21100aa9b0 2023-07-21T22:17:43.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.159+0000 7f211dffb700 1 -- 172.21.15.151:0/1494242528 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7f210c0cd2a0 con 0x7f2120102a40 2023-07-21T22:17:43.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.159+0000 7f21250ca700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] conn(0x7f21100aa9b0 0x7f21100acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.159+0000 7f21248c9700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f21100a11e0 0x7f21100a3690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2114000c00 tx=0x7f211401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:43.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.160+0000 7f21250ca700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] conn(0x7f21100aa9b0 0x7f21100acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:43.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.161+0000 7f211dffb700 1 -- 172.21.15.151:0/1494242528 <== osd.1 v2:172.21.15.187:6800/2089567930 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f21100ad470 con 0x7f21100aa9b0 2023-07-21T22:17:43.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.187+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 --> [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2120111ea0 con 0x7f21100aa9b0 2023-07-21T22:17:43.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.187+0000 7f211dffb700 1 -- 172.21.15.151:0/1494242528 <== osd.1 v2:172.21.15.187:6800/2089567930 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2118011040 con 0x7f21100aa9b0 2023-07-21T22:17:43.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.187+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 >> [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] conn(0x7f21100aa9b0 msgr2=0x7f21100acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f2126b2d700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] conn(0x7f21100aa9b0 0x7f21100acdc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f21100a11e0 msgr2=0x7f21100a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f2126b2d700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f21100a11e0 0x7f21100a3690 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f2114000c00 tx=0x7f211401a040 comp rx=0 tx=0).stop 2023-07-21T22:17:43.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2120102a40 msgr2=0x7f21201982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f2126b2d700 1 --2- 172.21.15.151:0/1494242528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2120102a40 0x7f21201982b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f210c00e970 tx=0x7f210c00ed30 comp rx=0 tx=0).stop 2023-07-21T22:17:43.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f21250ca700 1 -- 172.21.15.151:0/1494242528 reap_dead start 2023-07-21T22:17:43.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 shutdown_connections 2023-07-21T22:17:43.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 >> 172.21.15.151:0/1494242528 conn(0x7f21200fd940 msgr2=0x7f21200fe500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:43.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 shutdown_connections 2023-07-21T22:17:43.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.188+0000 7f2126b2d700 1 -- 172.21.15.151:0/1494242528 wait complete. 2023-07-21T22:17:43.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-07-21T22:17:43.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]: dispatch 2023-07-21T22:17:43.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-07-21T22:17:43.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-07-21T22:17:43.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2023-07-21T22:17:43.539 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2023-07-21T22:17:43.539 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:43 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2023-07-21T22:17:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-07-21T22:17:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]: dispatch 2023-07-21T22:17:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-07-21T22:17:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-07-21T22:17:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2023-07-21T22:17:43.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2023-07-21T22:17:43.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:43 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2023-07-21T22:17:43.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2023-07-21T22:17:43.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]: dispatch 2023-07-21T22:17:43.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]: dispatch 2023-07-21T22:17:43.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]: dispatch 2023-07-21T22:17:43.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]: dispatch 2023-07-21T22:17:43.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2023-07-21T22:17:43.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:43 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2023-07-21T22:17:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.531+0000 7fb05654d700 1 -- 172.21.15.151:0/823910399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0500ffe00 msgr2=0x7fb0501001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.531+0000 7fb05654d700 1 --2- 172.21.15.151:0/823910399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0500ffe00 0x7fb0501001d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb040009920 tx=0x7fb040009c30 comp rx=0 tx=0).stop 2023-07-21T22:17:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.531+0000 7fb05654d700 1 -- 172.21.15.151:0/823910399 shutdown_connections 2023-07-21T22:17:43.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.531+0000 7fb05654d700 1 --2- 172.21.15.151:0/823910399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb050104ea0 0x7fb05010ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.531+0000 7fb05654d700 1 --2- 172.21.15.151:0/823910399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb0500ffe00 0x7fb0501001d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.531+0000 7fb05654d700 1 --2- 172.21.15.151:0/823910399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0501007a0 0x7fb050104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.531+0000 7fb05654d700 1 -- 172.21.15.151:0/823910399 >> 172.21.15.151:0/823910399 conn(0x7fb0500fb660 msgr2=0x7fb0500fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:43.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.531+0000 7fb05654d700 1 -- 172.21.15.151:0/823910399 shutdown_connections 2023-07-21T22:17:43.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.531+0000 7fb05654d700 1 -- 172.21.15.151:0/823910399 wait complete. 2023-07-21T22:17:43.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.532+0000 7fb05654d700 1 Processor -- start 2023-07-21T22:17:43.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.532+0000 7fb05654d700 1 -- start start 2023-07-21T22:17:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb05654d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0500ffe00 0x7fb05006f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb05654d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0501007a0 0x7fb05006fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb05654d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb050104ea0 0x7fb05006a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb05654d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05006af20 con 0x7fb0501007a0 2023-07-21T22:17:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb05654d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05006b090 con 0x7fb0500ffe00 2023-07-21T22:17:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb05654d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05006b250 con 0x7fb050104ea0 2023-07-21T22:17:43.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb04f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0501007a0 0x7fb05006fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb04ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0500ffe00 0x7fb05006f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb04f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0501007a0 0x7fb05006fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42544/0 (socket says 172.21.15.151:42544) 2023-07-21T22:17:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb04f7fe700 1 -- 172.21.15.151:0/396371459 learned_addr learned my addr 172.21.15.151:0/396371459 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.533+0000 7fb054aea700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb050104ea0 0x7fb05006a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.534+0000 7fb04ffff700 1 -- 172.21.15.151:0/396371459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb050104ea0 msgr2=0x7fb05006a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.534+0000 7fb04ffff700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb050104ea0 0x7fb05006a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.534+0000 7fb04ffff700 1 -- 172.21.15.151:0/396371459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0501007a0 msgr2=0x7fb05006fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.534+0000 7fb04ffff700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0501007a0 0x7fb05006fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.534+0000 7fb04ffff700 1 -- 172.21.15.151:0/396371459 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb040009520 con 0x7fb0500ffe00 2023-07-21T22:17:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.534+0000 7fb04f7fe700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0501007a0 0x7fb05006fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:43.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.534+0000 7fb054aea700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb050104ea0 0x7fb05006a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:43.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.534+0000 7fb04ffff700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0500ffe00 0x7fb05006f710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb040000c00 tx=0x7fb04000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.534+0000 7fb04d7fa700 1 -- 172.21.15.151:0/396371459 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04001c070 con 0x7fb0500ffe00 2023-07-21T22:17:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.535+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb05006b4d0 con 0x7fb0500ffe00 2023-07-21T22:17:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.535+0000 7fb04d7fa700 1 -- 172.21.15.151:0/396371459 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb04000b9f0 con 0x7fb0500ffe00 2023-07-21T22:17:43.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.535+0000 7fb04d7fa700 1 -- 172.21.15.151:0/396371459 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0400046d0 con 0x7fb0500ffe00 2023-07-21T22:17:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.535+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb05006e650 con 0x7fb0500ffe00 2023-07-21T22:17:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.536+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb05006b7a0 con 0x7fb0500ffe00 2023-07-21T22:17:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.538+0000 7fb04d7fa700 1 -- 172.21.15.151:0/396371459 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fb040020070 con 0x7fb0500ffe00 2023-07-21T22:17:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.540+0000 7fb04d7fa700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb0340a1260 0x7fb0340a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.540+0000 7fb04d7fa700 1 -- 172.21.15.151:0/396371459 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fb0400cddd0 con 0x7fb0500ffe00 2023-07-21T22:17:43.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.540+0000 7fb04f7fe700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb0340a1260 0x7fb0340a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.540+0000 7fb04d7fa700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] conn(0x7fb0340aad10 0x7fb0340ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.540+0000 7fb04d7fa700 1 -- 172.21.15.151:0/396371459 --> [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb0340ad870 con 0x7fb0340aad10 2023-07-21T22:17:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.540+0000 7fb04d7fa700 1 -- 172.21.15.151:0/396371459 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb0400ce140 con 0x7fb0500ffe00 2023-07-21T22:17:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.541+0000 7fb04f7fe700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb0340a1260 0x7fb0340a3710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00d5c0 tx=0x7fb03c00f040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.541+0000 7fb054aea700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] conn(0x7fb0340aad10 0x7fb0340ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.541+0000 7fb054aea700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] conn(0x7fb0340aad10 0x7fb0340ad1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:43.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.542+0000 7fb04d7fa700 1 -- 172.21.15.151:0/396371459 <== osd.8 v2:172.21.15.195:6816/1226094225 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fb0340ad870 con 0x7fb0340aad10 2023-07-21T22:17:43.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.559+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 --> [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb05010dae0 con 0x7fb0340aad10 2023-07-21T22:17:43.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.560+0000 7fb04d7fa700 1 -- 172.21.15.151:0/396371459 <== osd.8 v2:172.21.15.195:6816/1226094225 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fb048003a00 con 0x7fb0340aad10 2023-07-21T22:17:43.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.560+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 >> [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] conn(0x7fb0340aad10 msgr2=0x7fb0340ad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.560+0000 7fb05654d700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] conn(0x7fb0340aad10 0x7fb0340ad1a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.561+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb0340a1260 msgr2=0x7fb0340a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.561+0000 7fb05654d700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb0340a1260 0x7fb0340a3710 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00d5c0 tx=0x7fb03c00f040 comp rx=0 tx=0).stop 2023-07-21T22:17:43.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.561+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0500ffe00 msgr2=0x7fb05006f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.561+0000 7fb05654d700 1 --2- 172.21.15.151:0/396371459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0500ffe00 0x7fb05006f710 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb040000c00 tx=0x7fb04000fa00 comp rx=0 tx=0).stop 2023-07-21T22:17:43.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.561+0000 7fb054aea700 1 -- 172.21.15.151:0/396371459 reap_dead start 2023-07-21T22:17:43.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.561+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 shutdown_connections 2023-07-21T22:17:43.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.561+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 >> 172.21.15.151:0/396371459 conn(0x7fb0500fb660 msgr2=0x7fb0500fc320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:43.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.561+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 shutdown_connections 2023-07-21T22:17:43.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.561+0000 7fb05654d700 1 -- 172.21.15.151:0/396371459 wait complete. 2023-07-21T22:17:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.736+0000 7f682b540700 1 -- 172.21.15.151:0/3343424689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f682410a140 msgr2=0x7f682410c5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.736+0000 7f682b540700 1 --2- 172.21.15.151:0/3343424689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f682410a140 0x7f682410c5a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f681c00b0a0 tx=0x7f681c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.736+0000 7f682b540700 1 -- 172.21.15.151:0/3343424689 shutdown_connections 2023-07-21T22:17:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.736+0000 7f682b540700 1 --2- 172.21.15.151:0/3343424689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f682410a140 0x7f682410c5a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.736+0000 7f682b540700 1 --2- 172.21.15.151:0/3343424689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6824100d60 0x7f6824101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.736+0000 7f682b540700 1 --2- 172.21.15.151:0/3343424689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6824101670 0x7f6824109b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.736+0000 7f682b540700 1 -- 172.21.15.151:0/3343424689 >> 172.21.15.151:0/3343424689 conn(0x7f68240fa5a0 msgr2=0x7f68240fc9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.736+0000 7f682b540700 1 -- 172.21.15.151:0/3343424689 shutdown_connections 2023-07-21T22:17:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.736+0000 7f682b540700 1 -- 172.21.15.151:0/3343424689 wait complete. 2023-07-21T22:17:43.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.737+0000 7f682b540700 1 Processor -- start 2023-07-21T22:17:43.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.737+0000 7f682b540700 1 -- start start 2023-07-21T22:17:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f682b540700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6824100d60 0x7f6824197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f682b540700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6824101670 0x7f6824198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f682b540700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f682410a140 0x7f682419c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f682b540700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682419ce10 con 0x7f6824101670 2023-07-21T22:17:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f682b540700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682419cf80 con 0x7f6824100d60 2023-07-21T22:17:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f682b540700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f682419d140 con 0x7f682410a140 2023-07-21T22:17:43.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f6828adb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6824101670 0x7f6824198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f6828adb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6824101670 0x7f6824198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42564/0 (socket says 172.21.15.151:42564) 2023-07-21T22:17:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f6828adb700 1 -- 172.21.15.151:0/691127214 learned_addr learned my addr 172.21.15.151:0/691127214 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f6829add700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f682410a140 0x7f682419c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.738+0000 7f68292dc700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6824100d60 0x7f6824197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f6828adb700 1 -- 172.21.15.151:0/691127214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f682410a140 msgr2=0x7f682419c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f6828adb700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f682410a140 0x7f682419c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f6828adb700 1 -- 172.21.15.151:0/691127214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6824100d60 msgr2=0x7f6824197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f6828adb700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6824100d60 0x7f6824197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f6828adb700 1 -- 172.21.15.151:0/691127214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f681c009d00 con 0x7f6824101670 2023-07-21T22:17:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f6828adb700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6824101670 0x7f6824198390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f681400d950 tx=0x7f681400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f681a7fc700 1 -- 172.21.15.151:0/691127214 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681400f890 con 0x7f6824101670 2023-07-21T22:17:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f681a7fc700 1 -- 172.21.15.151:0/691127214 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f681400fe80 con 0x7f6824101670 2023-07-21T22:17:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f682419d420 con 0x7f6824101670 2023-07-21T22:17:43.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f681a7fc700 1 -- 172.21.15.151:0/691127214 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681400e3b0 con 0x7f6824101670 2023-07-21T22:17:43.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.739+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68241a4c80 con 0x7f6824101670 2023-07-21T22:17:43.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.740+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f682410fb90 con 0x7f6824101670 2023-07-21T22:17:43.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.744+0000 7f681a7fc700 1 -- 172.21.15.151:0/691127214 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f6814010460 con 0x7f6824101670 2023-07-21T22:17:43.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.745+0000 7f681a7fc700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68100a11e0 0x7f68100a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.746+0000 7f681a7fc700 1 -- 172.21.15.151:0/691127214 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f68140cccf0 con 0x7f6824101670 2023-07-21T22:17:43.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.746+0000 7f68292dc700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68100a11e0 0x7f68100a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.746+0000 7f681a7fc700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] conn(0x7f68100aac90 0x7f68100ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:43.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.746+0000 7f681a7fc700 1 -- 172.21.15.151:0/691127214 --> [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68100ad7f0 con 0x7f68100aac90 2023-07-21T22:17:43.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.746+0000 7f681a7fc700 1 -- 172.21.15.151:0/691127214 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68140cd060 con 0x7f6824101670 2023-07-21T22:17:43.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.746+0000 7f6829add700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] conn(0x7f68100aac90 0x7f68100ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:43.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.747+0000 7f68292dc700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68100a11e0 0x7f68100a3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6820009c60 tx=0x7f6820009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:43.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.747+0000 7f6829add700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] conn(0x7f68100aac90 0x7f68100ad120 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:43.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.748+0000 7f681a7fc700 1 -- 172.21.15.151:0/691127214 <== osd.6 v2:172.21.15.151:6818/3406076685 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f68100ad7f0 con 0x7f68100aac90 2023-07-21T22:17:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.765+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 --> [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f682404e210 con 0x7f68100aac90 2023-07-21T22:17:43.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.766+0000 7f681a7fc700 1 -- 172.21.15.151:0/691127214 <== osd.6 v2:172.21.15.151:6818/3406076685 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f682404e210 con 0x7f68100aac90 2023-07-21T22:17:43.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.766+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] conn(0x7f68100aac90 msgr2=0x7f68100ad120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.766+0000 7f682b540700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] conn(0x7f68100aac90 0x7f68100ad120 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:43.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.767+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68100a11e0 msgr2=0x7f68100a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.767+0000 7f682b540700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68100a11e0 0x7f68100a3690 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6820009c60 tx=0x7f6820009260 comp rx=0 tx=0).stop 2023-07-21T22:17:43.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.767+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6824101670 msgr2=0x7f6824198390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:43.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.767+0000 7f682b540700 1 --2- 172.21.15.151:0/691127214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6824101670 0x7f6824198390 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f681400d950 tx=0x7f681400dc60 comp rx=0 tx=0).stop 2023-07-21T22:17:43.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.767+0000 7f6829add700 1 -- 172.21.15.151:0/691127214 reap_dead start 2023-07-21T22:17:43.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.767+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 shutdown_connections 2023-07-21T22:17:43.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.767+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 >> 172.21.15.151:0/691127214 conn(0x7f68240fa5a0 msgr2=0x7f682410c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:43.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.767+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 shutdown_connections 2023-07-21T22:17:43.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.767+0000 7f682b540700 1 -- 172.21.15.151:0/691127214 wait complete. 2023-07-21T22:17:44.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.917+0000 7fdb0efd0700 1 -- 172.21.15.151:0/302934863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080728b0 msgr2=0x7fdb08072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.917+0000 7fdb0efd0700 1 --2- 172.21.15.151:0/302934863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080728b0 0x7fdb08072c80 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdafc009990 tx=0x7fdafc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.917+0000 7fdb0efd0700 1 -- 172.21.15.151:0/302934863 shutdown_connections 2023-07-21T22:17:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.917+0000 7fdb0efd0700 1 --2- 172.21.15.151:0/302934863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0810c3e0 0x7fdb0810e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.917+0000 7fdb0efd0700 1 --2- 172.21.15.151:0/302934863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080728b0 0x7fdb08072c80 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.917+0000 7fdb0efd0700 1 --2- 172.21.15.151:0/302934863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb080731c0 0x7fdb0810bea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.917+0000 7fdb0efd0700 1 -- 172.21.15.151:0/302934863 >> 172.21.15.151:0/302934863 conn(0x7fdb080fb660 msgr2=0x7fdb080fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.918+0000 7fdb0efd0700 1 -- 172.21.15.151:0/302934863 shutdown_connections 2023-07-21T22:17:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.918+0000 7fdb0efd0700 1 -- 172.21.15.151:0/302934863 wait complete. 2023-07-21T22:17:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.919+0000 7fdb0efd0700 1 Processor -- start 2023-07-21T22:17:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.919+0000 7fdb0efd0700 1 -- start start 2023-07-21T22:17:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.919+0000 7fdb0efd0700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb080728b0 0x7fdb08197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.919+0000 7fdb0efd0700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080731c0 0x7fdb08198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.919+0000 7fdb0efd0700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0810c3e0 0x7fdb0819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.919+0000 7fdb0efd0700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0819cda0 con 0x7fdb080731c0 2023-07-21T22:17:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.919+0000 7fdb0efd0700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0819cf10 con 0x7fdb080728b0 2023-07-21T22:17:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.919+0000 7fdb0efd0700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0819d0d0 con 0x7fdb0810c3e0 2023-07-21T22:17:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080731c0 0x7fdb08198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080731c0 0x7fdb08198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42582/0 (socket says 172.21.15.151:42582) 2023-07-21T22:17:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb07fff700 1 -- 172.21.15.151:0/2111398714 learned_addr learned my addr 172.21.15.151:0/2111398714 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb0cd6c700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb080728b0 0x7fdb08197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb0d56d700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0810c3e0 0x7fdb0819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb0cd6c700 1 -- 172.21.15.151:0/2111398714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0810c3e0 msgr2=0x7fdb0819c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb0cd6c700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb0810c3e0 0x7fdb0819c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb0cd6c700 1 -- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080731c0 msgr2=0x7fdb08198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb0cd6c700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080731c0 0x7fdb08198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.920+0000 7fdb0cd6c700 1 -- 172.21.15.151:0/2111398714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc0095f0 con 0x7fdb080728b0 2023-07-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.921+0000 7fdb07fff700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb080731c0 0x7fdb08198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.921+0000 7fdb0cd6c700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb080728b0 0x7fdb08197d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdafc005910 tx=0x7fdafc005720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.921+0000 7fdb05ffb700 1 -- 172.21.15.151:0/2111398714 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc01d070 con 0x7fdb080728b0 2023-07-21T22:17:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.921+0000 7fdb05ffb700 1 -- 172.21.15.151:0/2111398714 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdafc022470 con 0x7fdb080728b0 2023-07-21T22:17:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.921+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0819d350 con 0x7fdb080728b0 2023-07-21T22:17:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.921+0000 7fdb05ffb700 1 -- 172.21.15.151:0/2111398714 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc017650 con 0x7fdb080728b0 2023-07-21T22:17:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.922+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb081a4b80 con 0x7fdb080728b0 2023-07-21T22:17:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.924+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fdb0804e210 con 0x7fdb080728b0 2023-07-21T22:17:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.926+0000 7fdb05ffb700 1 -- 172.21.15.151:0/2111398714 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fdafc0225e0 con 0x7fdb080728b0 2023-07-21T22:17:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.928+0000 7fdb05ffb700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdaf80a11e0 0x7fdaf80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.928+0000 7fdb05ffb700 1 -- 172.21.15.151:0/2111398714 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fdafc0cde00 con 0x7fdb080728b0 2023-07-21T22:17:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.928+0000 7fdb07fff700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdaf80a11e0 0x7fdaf80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.929+0000 7fdb05ffb700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] conn(0x7fdaf80aac90 0x7fdaf80ad120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.929+0000 7fdb05ffb700 1 -- 172.21.15.151:0/2111398714 --> [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdaf80ad7f0 con 0x7fdaf80aac90 2023-07-21T22:17:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.929+0000 7fdb05ffb700 1 -- 172.21.15.151:0/2111398714 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdafc0d03e0 con 0x7fdb080728b0 2023-07-21T22:17:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.929+0000 7fdb07fff700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdaf80a11e0 0x7fdaf80a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb08199370 tx=0x7fdaf4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.929+0000 7fdb0d56d700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] conn(0x7fdaf80aac90 0x7fdaf80ad120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.930+0000 7fdb0d56d700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] conn(0x7fdaf80aac90 0x7fdaf80ad120 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.930+0000 7fdb05ffb700 1 -- 172.21.15.151:0/2111398714 <== osd.0 v2:172.21.15.151:6802/1215940854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fdaf80ad7f0 con 0x7fdaf80aac90 2023-07-21T22:17:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.947+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 --> [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdb08111e20 con 0x7fdaf80aac90 2023-07-21T22:17:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.948+0000 7fdb05ffb700 1 -- 172.21.15.151:0/2111398714 <== osd.0 v2:172.21.15.151:6802/1215940854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdb0000f040 con 0x7fdaf80aac90 2023-07-21T22:17:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.948+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] conn(0x7fdaf80aac90 msgr2=0x7fdaf80ad120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.948+0000 7fdb0efd0700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] conn(0x7fdaf80aac90 0x7fdaf80ad120 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.949+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdaf80a11e0 msgr2=0x7fdaf80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.949+0000 7fdb0efd0700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdaf80a11e0 0x7fdaf80a3690 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdb08199370 tx=0x7fdaf4009260 comp rx=0 tx=0).stop 2023-07-21T22:17:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.949+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb080728b0 msgr2=0x7fdb08197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.949+0000 7fdb0efd0700 1 --2- 172.21.15.151:0/2111398714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb080728b0 0x7fdb08197d50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdafc005910 tx=0x7fdafc005720 comp rx=0 tx=0).stop 2023-07-21T22:17:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.949+0000 7fdb0d56d700 1 -- 172.21.15.151:0/2111398714 reap_dead start 2023-07-21T22:17:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.949+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 shutdown_connections 2023-07-21T22:17:44.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.949+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 >> 172.21.15.151:0/2111398714 conn(0x7fdb080fb660 msgr2=0x7fdb0810e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:44.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.949+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 shutdown_connections 2023-07-21T22:17:44.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:43.949+0000 7fdb0efd0700 1 -- 172.21.15.151:0/2111398714 wait complete. 2023-07-21T22:17:44.592 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:44 smithi151 ceph-mon[95510]: pgmap v315: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:17:44.592 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-07-21T22:17:44.592 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2023-07-21T22:17:44.593 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-07-21T22:17:44.593 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-07-21T22:17:44.593 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2023-07-21T22:17:44.593 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2023-07-21T22:17:44.593 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:44 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2023-07-21T22:17:44.593 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:44 smithi151 ceph-mon[95510]: osdmap e86: 12 total, 12 up, 12 in 2023-07-21T22:17:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:44 smithi187 ceph-mon[96918]: pgmap v315: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:17:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-07-21T22:17:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2023-07-21T22:17:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-07-21T22:17:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-07-21T22:17:44.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2023-07-21T22:17:44.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2023-07-21T22:17:44.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:44 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2023-07-21T22:17:44.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:44 smithi187 ceph-mon[96918]: osdmap e86: 12 total, 12 up, 12 in 2023-07-21T22:17:44.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:44 smithi195 ceph-mon[97365]: pgmap v315: 97 pgs: 97 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:17:44.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2023-07-21T22:17:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 1, 8, 11]}]': finished 2023-07-21T22:17:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 4]}]': finished 2023-07-21T22:17:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.e", "id": [5, 9]}]': finished 2023-07-21T22:17:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.21", "id": [4, 8]}]': finished 2023-07-21T22:17:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2023-07-21T22:17:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:44 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2023-07-21T22:17:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:44 smithi195 ceph-mon[97365]: osdmap e86: 12 total, 12 up, 12 in 2023-07-21T22:17:44.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.746+0000 7fa17bd9d700 1 -- 172.21.15.151:0/540070894 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa174100790 msgr2=0x7fa174104760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.746+0000 7fa17bd9d700 1 --2- 172.21.15.151:0/540070894 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa174100790 0x7fa174104760 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa1640099c0 tx=0x7fa164009cd0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.746+0000 7fa17bd9d700 1 -- 172.21.15.151:0/540070894 shutdown_connections 2023-07-21T22:17:44.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.746+0000 7fa17bd9d700 1 --2- 172.21.15.151:0/540070894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1740ffdf0 0x7fa1741001c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.746+0000 7fa17bd9d700 1 --2- 172.21.15.151:0/540070894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa174104e90 0x7fa17410ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.746+0000 7fa17bd9d700 1 --2- 172.21.15.151:0/540070894 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa174100790 0x7fa174104760 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.746+0000 7fa17bd9d700 1 -- 172.21.15.151:0/540070894 >> 172.21.15.151:0/540070894 conn(0x7fa1740fb670 msgr2=0x7fa1740fda80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:44.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.746+0000 7fa17bd9d700 1 -- 172.21.15.151:0/540070894 shutdown_connections 2023-07-21T22:17:44.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.746+0000 7fa17bd9d700 1 -- 172.21.15.151:0/540070894 wait complete. 2023-07-21T22:17:44.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.748+0000 7fa17bd9d700 1 Processor -- start 2023-07-21T22:17:44.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.748+0000 7fa17bd9d700 1 -- start start 2023-07-21T22:17:44.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.748+0000 7fa17bd9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1740ffdf0 0x7fa174072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.748+0000 7fa17bd9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa174100790 0x7fa174072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.748+0000 7fa17bd9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa174104e90 0x7fa1740732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa17bd9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1741a4020 con 0x7fa1740ffdf0 2023-07-21T22:17:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa17bd9d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1741a4190 con 0x7fa174104e90 2023-07-21T22:17:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa17bd9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1741a4350 con 0x7fa174100790 2023-07-21T22:17:44.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa179b39700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1740ffdf0 0x7fa174072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa179b39700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1740ffdf0 0x7fa174072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42610/0 (socket says 172.21.15.151:42610) 2023-07-21T22:17:44.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa179b39700 1 -- 172.21.15.151:0/2601873833 learned_addr learned my addr 172.21.15.151:0/2601873833 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:44.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa179338700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa174100790 0x7fa174072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa17a33a700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa174104e90 0x7fa1740732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa179b39700 1 -- 172.21.15.151:0/2601873833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa174100790 msgr2=0x7fa174072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa179b39700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa174100790 0x7fa174072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa179b39700 1 -- 172.21.15.151:0/2601873833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa174104e90 msgr2=0x7fa1740732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa179b39700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa174104e90 0x7fa1740732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa179b39700 1 -- 172.21.15.151:0/2601873833 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1640095f0 con 0x7fa1740ffdf0 2023-07-21T22:17:44.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.749+0000 7fa17a33a700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa174104e90 0x7fa1740732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:44.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.750+0000 7fa179b39700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1740ffdf0 0x7fa174072810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa17000b530 tx=0x7fa17000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:44.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.750+0000 7fa16affd700 1 -- 172.21.15.151:0/2601873833 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa170011830 con 0x7fa1740ffdf0 2023-07-21T22:17:44.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.750+0000 7fa16affd700 1 -- 172.21.15.151:0/2601873833 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa170011e20 con 0x7fa1740ffdf0 2023-07-21T22:17:44.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.750+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1741a4630 con 0x7fa1740ffdf0 2023-07-21T22:17:44.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.750+0000 7fa16affd700 1 -- 172.21.15.151:0/2601873833 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa17000f2e0 con 0x7fa1740ffdf0 2023-07-21T22:17:44.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.750+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1741a4b50 con 0x7fa1740ffdf0 2023-07-21T22:17:44.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.751+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa17404e210 con 0x7fa1740ffdf0 2023-07-21T22:17:44.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.753+0000 7fa16affd700 1 -- 172.21.15.151:0/2601873833 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa170011990 con 0x7fa1740ffdf0 2023-07-21T22:17:44.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.754+0000 7fa16affd700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1600a1260 0x7fa1600a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.754+0000 7fa16affd700 1 -- 172.21.15.151:0/2601873833 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa1700cca20 con 0x7fa1740ffdf0 2023-07-21T22:17:44.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.755+0000 7fa179338700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1600a1260 0x7fa1600a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.755+0000 7fa16affd700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] conn(0x7fa1600aad10 0x7fa1600ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:44.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.755+0000 7fa16affd700 1 -- 172.21.15.151:0/2601873833 --> [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa1600ad870 con 0x7fa1600aad10 2023-07-21T22:17:44.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.755+0000 7fa16affd700 1 -- 172.21.15.151:0/2601873833 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa1700ccd90 con 0x7fa1740ffdf0 2023-07-21T22:17:44.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.755+0000 7fa179338700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1600a1260 0x7fa1600a3710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa16400b580 tx=0x7fa164009f10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:44.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.755+0000 7fa17a33a700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] conn(0x7fa1600aad10 0x7fa1600ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:44.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.756+0000 7fa17a33a700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] conn(0x7fa1600aad10 0x7fa1600ad1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:44.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.757+0000 7fa16affd700 1 -- 172.21.15.151:0/2601873833 <== osd.4 v2:172.21.15.187:6808/357741250 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa1600ad870 con 0x7fa1600aad10 2023-07-21T22:17:44.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.774+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 --> [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa17410fc90 con 0x7fa1600aad10 2023-07-21T22:17:44.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa16affd700 1 -- 172.21.15.151:0/2601873833 <== osd.4 v2:172.21.15.187:6808/357741250 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fa16c007d60 con 0x7fa1600aad10 2023-07-21T22:17:44.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 >> [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] conn(0x7fa1600aad10 msgr2=0x7fa1600ad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.819 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] conn(0x7fa1600aad10 0x7fa1600ad1a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:44.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1600a1260 msgr2=0x7fa1600a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1600a1260 0x7fa1600a3710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa16400b580 tx=0x7fa164009f10 comp rx=0 tx=0).stop 2023-07-21T22:17:44.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1740ffdf0 msgr2=0x7fa174072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:44.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 --2- 172.21.15.151:0/2601873833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1740ffdf0 0x7fa174072810 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fa17000b530 tx=0x7fa17000b840 comp rx=0 tx=0).stop 2023-07-21T22:17:44.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17a33a700 1 -- 172.21.15.151:0/2601873833 reap_dead start 2023-07-21T22:17:44.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 shutdown_connections 2023-07-21T22:17:44.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 >> 172.21.15.151:0/2601873833 conn(0x7fa1740fb670 msgr2=0x7fa1740fc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:44.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 shutdown_connections 2023-07-21T22:17:44.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:44.775+0000 7fa17bd9d700 1 -- 172.21.15.151:0/2601873833 wait complete. 2023-07-21T22:17:44.883 INFO:teuthology.orchestra.run.smithi151.stdout:55834574922 2023-07-21T22:17:44.883 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.1 2023-07-21T22:17:44.901 INFO:teuthology.orchestra.run.smithi151.stdout:107374182462 2023-07-21T22:17:44.902 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.3 2023-07-21T22:17:45.368 INFO:teuthology.orchestra.run.smithi151.stdout:253403070500 2023-07-21T22:17:45.369 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.8 2023-07-21T22:17:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.418+0000 7ff8d2503700 1 -- 172.21.15.151:0/3161551463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8cc10b490 msgr2=0x7ff8cc078790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.418+0000 7ff8d2503700 1 --2- 172.21.15.151:0/3161551463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8cc10b490 0x7ff8cc078790 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400b0a0 tx=0x7ff8c400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.418+0000 7ff8d2503700 1 -- 172.21.15.151:0/3161551463 shutdown_connections 2023-07-21T22:17:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.418+0000 7ff8d2503700 1 --2- 172.21.15.151:0/3161551463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8cc10b490 0x7ff8cc078790 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.418+0000 7ff8d2503700 1 --2- 172.21.15.151:0/3161551463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8cc06cd10 0x7ff8cc06d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.418+0000 7ff8d2503700 1 --2- 172.21.15.151:0/3161551463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc06d6b0 0x7ff8cc10ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.418+0000 7ff8d2503700 1 -- 172.21.15.151:0/3161551463 >> 172.21.15.151:0/3161551463 conn(0x7ff8cc06be40 msgr2=0x7ff8cc071020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.418+0000 7ff8d2503700 1 -- 172.21.15.151:0/3161551463 shutdown_connections 2023-07-21T22:17:45.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.418+0000 7ff8d2503700 1 -- 172.21.15.151:0/3161551463 wait complete. 2023-07-21T22:17:45.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.420+0000 7ff8d2503700 1 Processor -- start 2023-07-21T22:17:45.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.420+0000 7ff8d2503700 1 -- start start 2023-07-21T22:17:45.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.420+0000 7ff8d2503700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8cc06cd10 0x7ff8cc1bbc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.420+0000 7ff8d2503700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8cc06d6b0 0x7ff8cc1b6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.420+0000 7ff8d2503700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc10b490 0x7ff8cc1b71d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.420+0000 7ff8d2503700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc1b7860 con 0x7ff8cc06cd10 2023-07-21T22:17:45.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.420+0000 7ff8d2503700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc1b79d0 con 0x7ff8cc10b490 2023-07-21T22:17:45.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.420+0000 7ff8d2503700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc076030 con 0x7ff8cc06d6b0 2023-07-21T22:17:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8cc06cd10 0x7ff8cc1bbc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8cc06cd10 0x7ff8cc1bbc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42628/0 (socket says 172.21.15.151:42628) 2023-07-21T22:17:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cbfff700 1 -- 172.21.15.151:0/2845594140 learned_addr learned my addr 172.21.15.151:0/2845594140 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8d0aa0700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc10b490 0x7ff8cc1b71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cb7fe700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8cc06d6b0 0x7ff8cc1b6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cbfff700 1 -- 172.21.15.151:0/2845594140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8cc06d6b0 msgr2=0x7ff8cc1b6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cbfff700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8cc06d6b0 0x7ff8cc1b6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cbfff700 1 -- 172.21.15.151:0/2845594140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc10b490 msgr2=0x7ff8cc1b71d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cbfff700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc10b490 0x7ff8cc1b71d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cbfff700 1 -- 172.21.15.151:0/2845594140 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c4009d00 con 0x7ff8cc06cd10 2023-07-21T22:17:45.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8d0aa0700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8cc10b490 0x7ff8cc1b71d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:45.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.421+0000 7ff8cbfff700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8cc06cd10 0x7ff8cc1bbc90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00d980 tx=0x7ff8bc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:45.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.422+0000 7ff8c97fa700 1 -- 172.21.15.151:0/2845594140 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00bb60 con 0x7ff8cc06cd10 2023-07-21T22:17:45.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.422+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc076310 con 0x7ff8cc06cd10 2023-07-21T22:17:45.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.422+0000 7ff8c97fa700 1 -- 172.21.15.151:0/2845594140 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8bc007640 con 0x7ff8cc06cd10 2023-07-21T22:17:45.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.422+0000 7ff8c97fa700 1 -- 172.21.15.151:0/2845594140 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc004d60 con 0x7ff8cc06cd10 2023-07-21T22:17:45.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.422+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc076860 con 0x7ff8cc06cd10 2023-07-21T22:17:45.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.423+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff8cc04e210 con 0x7ff8cc06cd10 2023-07-21T22:17:45.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.426+0000 7ff8c97fa700 1 -- 172.21.15.151:0/2845594140 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7ff8bc004020 con 0x7ff8cc06cd10 2023-07-21T22:17:45.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.428+0000 7ff8c97fa700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8b40a1240 0x7ff8b40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.428+0000 7ff8c97fa700 1 -- 172.21.15.151:0/2845594140 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7ff8bc0ccf40 con 0x7ff8cc06cd10 2023-07-21T22:17:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.428+0000 7ff8cb7fe700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8b40a1240 0x7ff8b40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.428+0000 7ff8c97fa700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] conn(0x7ff8b40aacf0 0x7ff8b40ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.428+0000 7ff8c97fa700 1 -- 172.21.15.151:0/2845594140 --> [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff8b40ad850 con 0x7ff8b40aacf0 2023-07-21T22:17:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.428+0000 7ff8c97fa700 1 -- 172.21.15.151:0/2845594140 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8bc0cd350 con 0x7ff8cc06cd10 2023-07-21T22:17:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.429+0000 7ff8d0aa0700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] conn(0x7ff8b40aacf0 0x7ff8b40ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.429+0000 7ff8cb7fe700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8b40a1240 0x7ff8b40a36f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc1b8480 tx=0x7ff8c0008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.429+0000 7ff8d0aa0700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] conn(0x7ff8b40aacf0 0x7ff8b40ad180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:45.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.430+0000 7ff8c97fa700 1 -- 172.21.15.151:0/2845594140 <== osd.5 v2:172.21.15.195:6808/2892220444 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff8b40ad850 con 0x7ff8b40aacf0 2023-07-21T22:17:45.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.450+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 --> [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff8cc07b9d0 con 0x7ff8b40aacf0 2023-07-21T22:17:45.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.451+0000 7ff8c97fa700 1 -- 172.21.15.151:0/2845594140 <== osd.5 v2:172.21.15.195:6808/2892220444 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7ff8c40096e0 con 0x7ff8b40aacf0 2023-07-21T22:17:45.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.452+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 >> [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] conn(0x7ff8b40aacf0 msgr2=0x7ff8b40ad180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.452+0000 7ff8d2503700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] conn(0x7ff8b40aacf0 0x7ff8b40ad180 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.452+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8b40a1240 msgr2=0x7ff8b40a36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.452+0000 7ff8d2503700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8b40a1240 0x7ff8b40a36f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc1b8480 tx=0x7ff8c0008040 comp rx=0 tx=0).stop 2023-07-21T22:17:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.452+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8cc06cd10 msgr2=0x7ff8cc1bbc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.452+0000 7ff8d2503700 1 --2- 172.21.15.151:0/2845594140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8cc06cd10 0x7ff8cc1bbc90 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00d980 tx=0x7ff8bc00dd40 comp rx=0 tx=0).stop 2023-07-21T22:17:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.452+0000 7ff8d0aa0700 1 -- 172.21.15.151:0/2845594140 reap_dead start 2023-07-21T22:17:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.452+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 shutdown_connections 2023-07-21T22:17:45.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.452+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 >> 172.21.15.151:0/2845594140 conn(0x7ff8cc06be40 msgr2=0x7ff8cc082c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.453+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 shutdown_connections 2023-07-21T22:17:45.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.453+0000 7ff8d2503700 1 -- 172.21.15.151:0/2845594140 wait complete. 2023-07-21T22:17:45.499 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:45 smithi151 ceph-mon[95510]: osdmap e87: 12 total, 12 up, 12 in 2023-07-21T22:17:45.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:45 smithi187 ceph-mon[96918]: osdmap e87: 12 total, 12 up, 12 in 2023-07-21T22:17:45.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:45 smithi195 ceph-mon[97365]: osdmap e87: 12 total, 12 up, 12 in 2023-07-21T22:17:45.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.653+0000 7f422beca700 1 -- 172.21.15.151:0/1155638000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42240ffe00 msgr2=0x7f42241001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.653+0000 7f422beca700 1 --2- 172.21.15.151:0/1155638000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42240ffe00 0x7f42241001d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42200099c0 tx=0x7f4220009cd0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.653+0000 7f422beca700 1 -- 172.21.15.151:0/1155638000 shutdown_connections 2023-07-21T22:17:45.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.653+0000 7f422beca700 1 --2- 172.21.15.151:0/1155638000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4224104ea0 0x7f422410ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.653+0000 7f422beca700 1 --2- 172.21.15.151:0/1155638000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42240ffe00 0x7f42241001d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.653+0000 7f422beca700 1 --2- 172.21.15.151:0/1155638000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42241007a0 0x7f4224104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.653+0000 7f422beca700 1 -- 172.21.15.151:0/1155638000 >> 172.21.15.151:0/1155638000 conn(0x7f42240fb660 msgr2=0x7f42240fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.653+0000 7f422beca700 1 -- 172.21.15.151:0/1155638000 shutdown_connections 2023-07-21T22:17:45.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.653+0000 7f422beca700 1 -- 172.21.15.151:0/1155638000 wait complete. 2023-07-21T22:17:45.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.654+0000 7f422beca700 1 Processor -- start 2023-07-21T22:17:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.654+0000 7f422beca700 1 -- start start 2023-07-21T22:17:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.654+0000 7f422beca700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42240ffe00 0x7f4224072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422beca700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42241007a0 0x7f4224072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422beca700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4224104ea0 0x7f42240732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422beca700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42241a4090 con 0x7f4224104ea0 2023-07-21T22:17:45.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422beca700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42241a4200 con 0x7f42241007a0 2023-07-21T22:17:45.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422beca700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42241a43c0 con 0x7f42240ffe00 2023-07-21T22:17:45.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f4229465700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42241007a0 0x7f4224072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422a467700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4224104ea0 0x7f42240732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422a467700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4224104ea0 0x7f42240732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42646/0 (socket says 172.21.15.151:42646) 2023-07-21T22:17:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f4229465700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42241007a0 0x7f4224072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:33368/0 (socket says 172.21.15.151:33368) 2023-07-21T22:17:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422a467700 1 -- 172.21.15.151:0/1711956529 learned_addr learned my addr 172.21.15.151:0/1711956529 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f4229c66700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42240ffe00 0x7f4224072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422a467700 1 -- 172.21.15.151:0/1711956529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42240ffe00 msgr2=0x7f4224072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422a467700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42240ffe00 0x7f4224072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422a467700 1 -- 172.21.15.151:0/1711956529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42241007a0 msgr2=0x7f4224072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422a467700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42241007a0 0x7f4224072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f422a467700 1 -- 172.21.15.151:0/1711956529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f421c009c40 con 0x7f4224104ea0 2023-07-21T22:17:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.655+0000 7f4229465700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42241007a0 0x7f4224072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.656+0000 7f422a467700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4224104ea0 0x7f42240732d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c370 tx=0x7f421c00c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.656+0000 7f421affd700 1 -- 172.21.15.151:0/1711956529 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c017070 con 0x7f4224104ea0 2023-07-21T22:17:45.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.656+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42200095f0 con 0x7f4224104ea0 2023-07-21T22:17:45.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.656+0000 7f421affd700 1 -- 172.21.15.151:0/1711956529 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f421c00f040 con 0x7f4224104ea0 2023-07-21T22:17:45.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.656+0000 7f421affd700 1 -- 172.21.15.151:0/1711956529 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f421c00e050 con 0x7f4224104ea0 2023-07-21T22:17:45.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.656+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42241a49b0 con 0x7f4224104ea0 2023-07-21T22:17:45.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.657+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f422410fb80 con 0x7f4224104ea0 2023-07-21T22:17:45.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.659+0000 7f421affd700 1 -- 172.21.15.151:0/1711956529 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f421c00cb60 con 0x7f4224104ea0 2023-07-21T22:17:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.661+0000 7f421affd700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42100a1260 0x7f42100a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.661+0000 7f421affd700 1 -- 172.21.15.151:0/1711956529 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f421c0cc360 con 0x7f4224104ea0 2023-07-21T22:17:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.661+0000 7f4229c66700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42100a1260 0x7f42100a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.661+0000 7f421affd700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] conn(0x7f42100aad10 0x7f42100ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:45.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.661+0000 7f421affd700 1 -- 172.21.15.151:0/1711956529 --> [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f42100ad870 con 0x7f42100aad10 2023-07-21T22:17:45.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.661+0000 7f421affd700 1 -- 172.21.15.151:0/1711956529 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f421c0ce940 con 0x7f4224104ea0 2023-07-21T22:17:45.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.661+0000 7f4229c66700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42100a1260 0x7f42100a3710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f422000b580 tx=0x7f4220005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:45.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.661+0000 7f4229465700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] conn(0x7f42100aad10 0x7f42100ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:45.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.662+0000 7f4229465700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] conn(0x7f42100aad10 0x7f42100ad1a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:45.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.663+0000 7f421affd700 1 -- 172.21.15.151:0/1711956529 <== osd.11 v2:172.21.15.195:6824/2228826039 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f42100ad870 con 0x7f42100aad10 2023-07-21T22:17:45.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.680+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 --> [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f422404e210 con 0x7f42100aad10 2023-07-21T22:17:45.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.680+0000 7f421affd700 1 -- 172.21.15.151:0/1711956529 <== osd.11 v2:172.21.15.195:6824/2228826039 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f422404e210 con 0x7f42100aad10 2023-07-21T22:17:45.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 >> [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] conn(0x7f42100aad10 msgr2=0x7f42100ad1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] conn(0x7f42100aad10 0x7f42100ad1a0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42100a1260 msgr2=0x7f42100a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f42100a1260 0x7f42100a3710 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f422000b580 tx=0x7f4220005c00 comp rx=0 tx=0).stop 2023-07-21T22:17:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4224104ea0 msgr2=0x7f42240732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 --2- 172.21.15.151:0/1711956529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4224104ea0 0x7f42240732d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f421c00c370 tx=0x7f421c00c680 comp rx=0 tx=0).stop 2023-07-21T22:17:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422a467700 1 -- 172.21.15.151:0/1711956529 reap_dead start 2023-07-21T22:17:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 shutdown_connections 2023-07-21T22:17:45.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 >> 172.21.15.151:0/1711956529 conn(0x7f42240fb660 msgr2=0x7f42240fc240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:45.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 shutdown_connections 2023-07-21T22:17:45.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:45.681+0000 7f422beca700 1 -- 172.21.15.151:0/1711956529 wait complete. 2023-07-21T22:17:46.166 INFO:teuthology.orchestra.run.smithi151.stdout:309237645338 2023-07-21T22:17:46.166 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.10 2023-07-21T22:17:46.198 INFO:teuthology.orchestra.run.smithi151.stdout:197568495663 2023-07-21T22:17:46.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.6 2023-07-21T22:17:46.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:46 smithi187 ceph-mon[96918]: pgmap v318: 97 pgs: 1 activating, 2 peering, 94 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 639 B/s wr, 7 op/s 2023-07-21T22:17:46.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:46 smithi195 ceph-mon[97365]: pgmap v318: 97 pgs: 1 activating, 2 peering, 94 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 639 B/s wr, 7 op/s 2023-07-21T22:17:46.675 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:46 smithi151 ceph-mon[95510]: pgmap v318: 97 pgs: 1 activating, 2 peering, 94 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 639 B/s wr, 7 op/s 2023-07-21T22:17:46.699 INFO:teuthology.orchestra.run.smithi151.stdout:34359738446 2023-07-21T22:17:46.700 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.0 2023-07-21T22:17:46.763 INFO:teuthology.orchestra.run.smithi151.stdout:343597383701 2023-07-21T22:17:46.763 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.11 2023-07-21T22:17:47.091 INFO:teuthology.orchestra.run.smithi151.stdout:141733920827 2023-07-21T22:17:47.091 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.4 2023-07-21T22:17:47.206 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:47.657 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:47.684 INFO:teuthology.orchestra.run.smithi151.stdout:163208757301 2023-07-21T22:17:47.684 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph osd last-stat-seq osd.5 2023-07-21T22:17:48.075 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:48.129 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:48.209 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:48.512 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:48 smithi151 ceph-mon[95510]: pgmap v319: 97 pgs: 1 activating, 1 peering, 95 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:48 smithi187 ceph-mon[96918]: pgmap v319: 97 pgs: 1 activating, 1 peering, 95 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:48.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:48 smithi195 ceph-mon[97365]: pgmap v319: 97 pgs: 1 activating, 1 peering, 95 active+clean; 634 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:49.459 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:50.111 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:50.584 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:50 smithi151 ceph-mon[95510]: pgmap v320: 97 pgs: 1 activating, 96 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:50.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:50 smithi187 ceph-mon[96918]: pgmap v320: 97 pgs: 1 activating, 96 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:50.655 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:50.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:50 smithi195 ceph-mon[97365]: pgmap v320: 97 pgs: 1 activating, 96 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:50.901 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:51.086 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:51.544 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.956+0000 7f589cb0a700 1 -- 172.21.15.151:0/4262657151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58981007a0 msgr2=0x7f5898104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.956+0000 7f589cb0a700 1 --2- 172.21.15.151:0/4262657151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58981007a0 0x7f5898104770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f588c0099c0 tx=0x7f588c009cd0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.956+0000 7f589cb0a700 1 -- 172.21.15.151:0/4262657151 shutdown_connections 2023-07-21T22:17:52.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.956+0000 7f589cb0a700 1 --2- 172.21.15.151:0/4262657151 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58980ffe00 0x7f58981001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.956+0000 7f589cb0a700 1 --2- 172.21.15.151:0/4262657151 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5898104ea0 0x7f589810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.956+0000 7f589cb0a700 1 --2- 172.21.15.151:0/4262657151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58981007a0 0x7f5898104770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.956+0000 7f589cb0a700 1 -- 172.21.15.151:0/4262657151 >> 172.21.15.151:0/4262657151 conn(0x7f58980fb660 msgr2=0x7f58980fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.956+0000 7f589cb0a700 1 -- 172.21.15.151:0/4262657151 shutdown_connections 2023-07-21T22:17:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.956+0000 7f589cb0a700 1 -- 172.21.15.151:0/4262657151 wait complete. 2023-07-21T22:17:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.957+0000 7f589cb0a700 1 Processor -- start 2023-07-21T22:17:52.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f589cb0a700 1 -- start start 2023-07-21T22:17:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f589cb0a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58980ffe00 0x7f5898072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f589cb0a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58981007a0 0x7f5898072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f589cb0a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5898104ea0 0x7f58980732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f589cb0a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981a40b0 con 0x7f5898104ea0 2023-07-21T22:17:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f589cb0a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981a4220 con 0x7f58980ffe00 2023-07-21T22:17:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f589cb0a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58981a43e0 con 0x7f58981007a0 2023-07-21T22:17:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f5896d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5898104ea0 0x7f58980732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:52.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f5896d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5898104ea0 0x7f58980732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39930/0 (socket says 172.21.15.151:39930) 2023-07-21T22:17:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f5896d9d700 1 -- 172.21.15.151:0/3696896189 learned_addr learned my addr 172.21.15.151:0/3696896189 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.958+0000 7f5895d9b700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58981007a0 0x7f5898072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:52.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f589659c700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58980ffe00 0x7f5898072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f5896d9d700 1 -- 172.21.15.151:0/3696896189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58981007a0 msgr2=0x7f5898072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f5896d9d700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58981007a0 0x7f5898072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f5896d9d700 1 -- 172.21.15.151:0/3696896189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58980ffe00 msgr2=0x7f5898072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f5896d9d700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58980ffe00 0x7f5898072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f5896d9d700 1 -- 172.21.15.151:0/3696896189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f588c0095f0 con 0x7f5898104ea0 2023-07-21T22:17:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f589659c700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58980ffe00 0x7f5898072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f5896d9d700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5898104ea0 0x7f58980732d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f589000b970 tx=0x7f589000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f58877fe700 1 -- 172.21.15.151:0/3696896189 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589000c930 con 0x7f5898104ea0 2023-07-21T22:17:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f58877fe700 1 -- 172.21.15.151:0/3696896189 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5890014440 con 0x7f5898104ea0 2023-07-21T22:17:52.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58981a46c0 con 0x7f5898104ea0 2023-07-21T22:17:52.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f58877fe700 1 -- 172.21.15.151:0/3696896189 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58900075d0 con 0x7f5898104ea0 2023-07-21T22:17:52.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.959+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58981a4b40 con 0x7f5898104ea0 2023-07-21T22:17:52.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.961+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f589804e210 con 0x7f5898104ea0 2023-07-21T22:17:52.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.963+0000 7f58877fe700 1 -- 172.21.15.151:0/3696896189 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f58900145b0 con 0x7f5898104ea0 2023-07-21T22:17:52.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.964+0000 7f58877fe700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58800a11e0 0x7f58800a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:52.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.964+0000 7f58877fe700 1 -- 172.21.15.151:0/3696896189 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f5890006e40 con 0x7f5898104ea0 2023-07-21T22:17:52.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.965+0000 7f589659c700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58800a11e0 0x7f58800a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:52.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.965+0000 7f589659c700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58800a11e0 0x7f58800a3690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5888005fd0 tx=0x7f5888005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:52.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:51.969+0000 7f58877fe700 1 -- 172.21.15.151:0/3696896189 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f58900959b0 con 0x7f5898104ea0 2023-07-21T22:17:52.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.185+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f58981a4df0 con 0x7f5898104ea0 2023-07-21T22:17:52.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.186+0000 7f58877fe700 1 -- 172.21.15.151:0/3696896189 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5890098fd0 con 0x7f5898104ea0 2023-07-21T22:17:52.229 INFO:teuthology.orchestra.run.smithi151.stdout:77309411397 2023-07-21T22:17:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58800a11e0 msgr2=0x7f58800a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58800a11e0 0x7f58800a3690 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5888005fd0 tx=0x7f5888005e30 comp rx=0 tx=0).stop 2023-07-21T22:17:52.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5898104ea0 msgr2=0x7f58980732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5898104ea0 0x7f58980732d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f589000b970 tx=0x7f589000bc80 comp rx=0 tx=0).stop 2023-07-21T22:17:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 shutdown_connections 2023-07-21T22:17:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58800a11e0 0x7f58800a3690 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58980ffe00 0x7f5898072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5898104ea0 0x7f58980732d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 --2- 172.21.15.151:0/3696896189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58981007a0 0x7f5898072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.188+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 >> 172.21.15.151:0/3696896189 conn(0x7f58980fb660 msgr2=0x7f58980fc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:52.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.189+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 shutdown_connections 2023-07-21T22:17:52.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.189+0000 7f589cb0a700 1 -- 172.21.15.151:0/3696896189 wait complete. 2023-07-21T22:17:52.261 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:17:52.585 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:52 smithi151 ceph-mon[95510]: pgmap v321: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:52.585 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:52 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3696896189' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-21T22:17:52.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:52 smithi187 ceph-mon[96918]: pgmap v321: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:52.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:52 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3696896189' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-21T22:17:52.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:52 smithi195 ceph-mon[97365]: pgmap v321: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:52.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:52 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3696896189' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2023-07-21T22:17:52.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.578+0000 7f81aab27700 1 -- 172.21.15.151:0/609651519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a4104ea0 msgr2=0x7f81a410ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.578+0000 7f81aab27700 1 --2- 172.21.15.151:0/609651519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a4104ea0 0x7f81a410ca20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f819c00b0d0 tx=0x7f819c00b3e0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.578+0000 7f81aab27700 1 -- 172.21.15.151:0/609651519 shutdown_connections 2023-07-21T22:17:52.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.578+0000 7f81aab27700 1 --2- 172.21.15.151:0/609651519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a40ffe00 0x7f81a41001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.578+0000 7f81aab27700 1 --2- 172.21.15.151:0/609651519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a4104ea0 0x7f81a410ca20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.578+0000 7f81aab27700 1 --2- 172.21.15.151:0/609651519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81a41007a0 0x7f81a4104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.578+0000 7f81aab27700 1 -- 172.21.15.151:0/609651519 >> 172.21.15.151:0/609651519 conn(0x7f81a40fb660 msgr2=0x7f81a40fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:52.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.578+0000 7f81aab27700 1 -- 172.21.15.151:0/609651519 shutdown_connections 2023-07-21T22:17:52.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.578+0000 7f81aab27700 1 -- 172.21.15.151:0/609651519 wait complete. 2023-07-21T22:17:52.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.580+0000 7f81aab27700 1 Processor -- start 2023-07-21T22:17:52.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.580+0000 7f81aab27700 1 -- start start 2023-07-21T22:17:52.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.580+0000 7f81aab27700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a40ffe00 0x7f81a4197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:52.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.580+0000 7f81aab27700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a41007a0 0x7f81a41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:52.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.580+0000 7f81aab27700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81a4104ea0 0x7f81a419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:52.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.580+0000 7f81aab27700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a419ce80 con 0x7f81a41007a0 2023-07-21T22:17:52.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.580+0000 7f81aab27700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a419cff0 con 0x7f81a40ffe00 2023-07-21T22:17:52.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.580+0000 7f81aab27700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a419d1b0 con 0x7f81a4104ea0 2023-07-21T22:17:52.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.580+0000 7f81a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a41007a0 0x7f81a41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:52.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a41007a0 0x7f81a41984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39942/0 (socket says 172.21.15.151:39942) 2023-07-21T22:17:52.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a3fff700 1 -- 172.21.15.151:0/3570534769 learned_addr learned my addr 172.21.15.151:0/3570534769 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:52.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a88c3700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a40ffe00 0x7f81a4197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:52.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a90c4700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81a4104ea0 0x7f81a419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:52.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a3fff700 1 -- 172.21.15.151:0/3570534769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81a4104ea0 msgr2=0x7f81a419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a3fff700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81a4104ea0 0x7f81a419c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a3fff700 1 -- 172.21.15.151:0/3570534769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a40ffe00 msgr2=0x7f81a4197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a3fff700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a40ffe00 0x7f81a4197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a3fff700 1 -- 172.21.15.151:0/3570534769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f819c009d00 con 0x7f81a41007a0 2023-07-21T22:17:52.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a3fff700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a41007a0 0x7f81a41984a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f819000d980 tx=0x7f819000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:52.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a1ffb700 1 -- 172.21.15.151:0/3570534769 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000f890 con 0x7f81a41007a0 2023-07-21T22:17:52.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81a1ffb700 1 -- 172.21.15.151:0/3570534769 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f819000fe80 con 0x7f81a41007a0 2023-07-21T22:17:52.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.581+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a419d490 con 0x7f81a41007a0 2023-07-21T22:17:52.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.582+0000 7f81a1ffb700 1 -- 172.21.15.151:0/3570534769 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819000e3b0 con 0x7f81a41007a0 2023-07-21T22:17:52.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.582+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a41a4cf0 con 0x7f81a41007a0 2023-07-21T22:17:52.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.583+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a404e210 con 0x7f81a41007a0 2023-07-21T22:17:52.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.585+0000 7f81a1ffb700 1 -- 172.21.15.151:0/3570534769 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f819000f9f0 con 0x7f81a41007a0 2023-07-21T22:17:52.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.586+0000 7f81a1ffb700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81940a11e0 0x7f81940a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:52.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.586+0000 7f81a1ffb700 1 -- 172.21.15.151:0/3570534769 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f81900cc460 con 0x7f81a41007a0 2023-07-21T22:17:52.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.587+0000 7f81a88c3700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81940a11e0 0x7f81940a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:52.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.587+0000 7f81a88c3700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81940a11e0 0x7f81940a3690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8198005950 tx=0x7f819800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:52.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.590+0000 7f81a1ffb700 1 -- 172.21.15.151:0/3570534769 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8190095a80 con 0x7f81a41007a0 2023-07-21T22:17:52.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.809+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f81a41992c0 con 0x7f81a41007a0 2023-07-21T22:17:52.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.809+0000 7f81a1ffb700 1 -- 172.21.15.151:0/3570534769 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f81900990a0 con 0x7f81a41007a0 2023-07-21T22:17:52.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81940a11e0 msgr2=0x7f81940a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81940a11e0 0x7f81940a3690 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8198005950 tx=0x7f819800b410 comp rx=0 tx=0).stop 2023-07-21T22:17:52.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a41007a0 msgr2=0x7f81a41984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:52.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a41007a0 0x7f81a41984a0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f819000d980 tx=0x7f819000dc90 comp rx=0 tx=0).stop 2023-07-21T22:17:52.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 shutdown_connections 2023-07-21T22:17:52.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f81940a11e0 0x7f81940a3690 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a40ffe00 0x7f81a4197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81a4104ea0 0x7f81a419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 --2- 172.21.15.151:0/3570534769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81a41007a0 0x7f81a41984a0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:52.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 >> 172.21.15.151:0/3570534769 conn(0x7f81a40fb660 msgr2=0x7f81a40fc3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:52.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 shutdown_connections 2023-07-21T22:17:52.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:52.812+0000 7f81aab27700 1 -- 172.21.15.151:0/3570534769 wait complete. 2023-07-21T22:17:52.946 INFO:teuthology.orchestra.run.smithi151.stdout:107374182463 2023-07-21T22:17:53.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.122+0000 7f1366db7700 1 -- 172.21.15.151:0/2705128858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13600727e0 msgr2=0x7f1360072bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:53.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.122+0000 7f1366db7700 1 --2- 172.21.15.151:0/2705128858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13600727e0 0x7f1360072bb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1354009990 tx=0x7f1354009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.122+0000 7f1366db7700 1 -- 172.21.15.151:0/2705128858 shutdown_connections 2023-07-21T22:17:53.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.122+0000 7f1366db7700 1 --2- 172.21.15.151:0/2705128858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f136010c4e0 0x7f136010e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.122+0000 7f1366db7700 1 --2- 172.21.15.151:0/2705128858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13600727e0 0x7f1360072bb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.122+0000 7f1366db7700 1 --2- 172.21.15.151:0/2705128858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13600730f0 0x7f136010bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.122+0000 7f1366db7700 1 -- 172.21.15.151:0/2705128858 >> 172.21.15.151:0/2705128858 conn(0x7f1360077b70 msgr2=0x7f1360077f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:53.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.122+0000 7f1366db7700 1 -- 172.21.15.151:0/2705128858 shutdown_connections 2023-07-21T22:17:53.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.122+0000 7f1366db7700 1 -- 172.21.15.151:0/2705128858 wait complete. 2023-07-21T22:17:53.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.124+0000 7f1366db7700 1 Processor -- start 2023-07-21T22:17:53.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.124+0000 7f1366db7700 1 -- start start 2023-07-21T22:17:53.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.124+0000 7f1366db7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13600727e0 0x7f1360197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:53.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.124+0000 7f1366db7700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13600730f0 0x7f1360198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:53.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.124+0000 7f1366db7700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136010c4e0 0x7f136019c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:53.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1366db7700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136019cce0 con 0x7f13600727e0 2023-07-21T22:17:53.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1366db7700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136019ce50 con 0x7f136010c4e0 2023-07-21T22:17:53.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1366db7700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f136019d010 con 0x7f13600730f0 2023-07-21T22:17:53.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1364b53700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13600727e0 0x7f1360197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:53.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1364b53700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13600727e0 0x7f1360197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39954/0 (socket says 172.21.15.151:39954) 2023-07-21T22:17:53.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1364b53700 1 -- 172.21.15.151:0/131761696 learned_addr learned my addr 172.21.15.151:0/131761696 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:53.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1365354700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136010c4e0 0x7f136019c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:53.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f135ffff700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13600730f0 0x7f1360198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:53.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1364b53700 1 -- 172.21.15.151:0/131761696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13600730f0 msgr2=0x7f1360198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:53.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1364b53700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13600730f0 0x7f1360198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1364b53700 1 -- 172.21.15.151:0/131761696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136010c4e0 msgr2=0x7f136019c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:53.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1364b53700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136010c4e0 0x7f136019c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.125+0000 7f1364b53700 1 -- 172.21.15.151:0/131761696 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13540095f0 con 0x7f13600727e0 2023-07-21T22:17:53.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.126+0000 7f1364b53700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13600727e0 0x7f1360197d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1354005910 tx=0x7f13540047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:53.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.126+0000 7f135dffb700 1 -- 172.21.15.151:0/131761696 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f135401d070 con 0x7f13600727e0 2023-07-21T22:17:53.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.126+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f136019d290 con 0x7f13600727e0 2023-07-21T22:17:53.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.126+0000 7f135dffb700 1 -- 172.21.15.151:0/131761696 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1354021410 con 0x7f13600727e0 2023-07-21T22:17:53.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.126+0000 7f135dffb700 1 -- 172.21.15.151:0/131761696 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1354017650 con 0x7f13600727e0 2023-07-21T22:17:53.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.126+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13601a4b50 con 0x7f13600727e0 2023-07-21T22:17:53.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.127+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1360106e00 con 0x7f13600727e0 2023-07-21T22:17:53.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.131+0000 7f135dffb700 1 -- 172.21.15.151:0/131761696 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f1354021580 con 0x7f13600727e0 2023-07-21T22:17:53.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.132+0000 7f135dffb700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f13500a1260 0x7f13500a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:53.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.132+0000 7f135dffb700 1 -- 172.21.15.151:0/131761696 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f13540ce070 con 0x7f13600727e0 2023-07-21T22:17:53.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.134+0000 7f135ffff700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f13500a1260 0x7f13500a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:53.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.134+0000 7f135ffff700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f13500a1260 0x7f13500a3710 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1360199340 tx=0x7f134c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:53.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.135+0000 7f135dffb700 1 -- 172.21.15.151:0/131761696 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f1354097720 con 0x7f13600727e0 2023-07-21T22:17:53.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.356+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f1360199180 con 0x7f13600727e0 2023-07-21T22:17:53.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.356+0000 7f135dffb700 1 -- 172.21.15.151:0/131761696 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1354021e60 con 0x7f13600727e0 2023-07-21T22:17:53.400 INFO:teuthology.orchestra.run.smithi151.stdout:253403070502 2023-07-21T22:17:53.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f13500a1260 msgr2=0x7f13500a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:53.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f13500a1260 0x7f13500a3710 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f1360199340 tx=0x7f134c009260 comp rx=0 tx=0).stop 2023-07-21T22:17:53.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13600727e0 msgr2=0x7f1360197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:53.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13600727e0 0x7f1360197d20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1354005910 tx=0x7f13540047b0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 shutdown_connections 2023-07-21T22:17:53.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f13500a1260 0x7f13500a3710 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f136010c4e0 0x7f136019c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13600727e0 0x7f1360197d20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 --2- 172.21.15.151:0/131761696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f13600730f0 0x7f1360198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:53.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 >> 172.21.15.151:0/131761696 conn(0x7f1360077b70 msgr2=0x7f1360103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:53.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 shutdown_connections 2023-07-21T22:17:53.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.359+0000 7f1366db7700 1 -- 172.21.15.151:0/131761696 wait complete. 2023-07-21T22:17:53.423 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:53 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3570534769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-21T22:17:53.519 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411394 got 77309411397 for osd.2 2023-07-21T22:17:53.519 DEBUG:teuthology.parallel:result is None 2023-07-21T22:17:53.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:53 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3570534769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-21T22:17:53.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:53 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3570534769' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2023-07-21T22:17:54.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.633+0000 7f512cb95700 1 -- 172.21.15.151:0/253245200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5128072850 msgr2=0x7f5128072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:54.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.633+0000 7f512cb95700 1 --2- 172.21.15.151:0/253245200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5128072850 0x7f5128072c20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5118009990 tx=0x7f5118009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.634+0000 7f512cb95700 1 -- 172.21.15.151:0/253245200 shutdown_connections 2023-07-21T22:17:54.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.634+0000 7f512cb95700 1 --2- 172.21.15.151:0/253245200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f512810c440 0x7f512810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.634+0000 7f512cb95700 1 --2- 172.21.15.151:0/253245200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5128072850 0x7f5128072c20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.634+0000 7f512cb95700 1 --2- 172.21.15.151:0/253245200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5128073160 0x7f512810bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.634+0000 7f512cb95700 1 -- 172.21.15.151:0/253245200 >> 172.21.15.151:0/253245200 conn(0x7f51280fb660 msgr2=0x7f51280fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:54.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.634+0000 7f512cb95700 1 -- 172.21.15.151:0/253245200 shutdown_connections 2023-07-21T22:17:54.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.634+0000 7f512cb95700 1 -- 172.21.15.151:0/253245200 wait complete. 2023-07-21T22:17:54.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.635+0000 7f512cb95700 1 Processor -- start 2023-07-21T22:17:54.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.635+0000 7f512cb95700 1 -- start start 2023-07-21T22:17:54.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.635+0000 7f512cb95700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5128072850 0x7f5128105120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:54.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.635+0000 7f512cb95700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5128073160 0x7f5128105680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:54.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512cb95700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512810c440 0x7f51281001d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:54.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512cb95700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51281009a0 con 0x7f512810c440 2023-07-21T22:17:54.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512cb95700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5128100b10 con 0x7f5128072850 2023-07-21T22:17:54.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512cb95700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5128100cd0 con 0x7f5128073160 2023-07-21T22:17:54.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f5126d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512810c440 0x7f51281001d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:54.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5128072850 0x7f5128105120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:54.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5128072850 0x7f5128105120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55822/0 (socket says 172.21.15.151:55822) 2023-07-21T22:17:54.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f5126d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512810c440 0x7f51281001d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39964/0 (socket says 172.21.15.151:39964) 2023-07-21T22:17:54.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512659c700 1 -- 172.21.15.151:0/2972745308 learned_addr learned my addr 172.21.15.151:0/2972745308 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:54.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f5125d9b700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5128073160 0x7f5128105680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:54.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512659c700 1 -- 172.21.15.151:0/2972745308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5128073160 msgr2=0x7f5128105680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:54.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512659c700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5128073160 0x7f5128105680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512659c700 1 -- 172.21.15.151:0/2972745308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512810c440 msgr2=0x7f51281001d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:54.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512659c700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512810c440 0x7f51281001d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.636+0000 7f512659c700 1 -- 172.21.15.151:0/2972745308 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51180095f0 con 0x7f5128072850 2023-07-21T22:17:54.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.637+0000 7f512659c700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5128072850 0x7f5128105120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5118005740 tx=0x7f5118005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:54.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.637+0000 7f51177fe700 1 -- 172.21.15.151:0/2972745308 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511801d070 con 0x7f5128072850 2023-07-21T22:17:54.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.637+0000 7f51177fe700 1 -- 172.21.15.151:0/2972745308 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5118022470 con 0x7f5128072850 2023-07-21T22:17:54.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.637+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5128100f50 con 0x7f5128072850 2023-07-21T22:17:54.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.637+0000 7f51177fe700 1 -- 172.21.15.151:0/2972745308 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5118017650 con 0x7f5128072850 2023-07-21T22:17:54.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.637+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f512810b130 con 0x7f5128072850 2023-07-21T22:17:54.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.639+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512804e210 con 0x7f5128072850 2023-07-21T22:17:54.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.641+0000 7f51177fe700 1 -- 172.21.15.151:0/2972745308 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f511800fb00 con 0x7f5128072850 2023-07-21T22:17:54.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.644+0000 7f51177fe700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f51100a1260 0x7f51100a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:54.157 INFO:teuthology.orchestra.run.smithi151.stdout:287762808864 2023-07-21T22:17:54.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.644+0000 7f51177fe700 1 -- 172.21.15.151:0/2972745308 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f51180ce670 con 0x7f5128072850 2023-07-21T22:17:54.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.644+0000 7f5125d9b700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f51100a1260 0x7f51100a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:54.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.645+0000 7f51177fe700 1 -- 172.21.15.151:0/2972745308 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f5118097cc0 con 0x7f5128072850 2023-07-21T22:17:54.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.645+0000 7f5125d9b700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f51100a1260 0x7f51100a3710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51281019c0 tx=0x7f511c0073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:54.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.872+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f512810b410 con 0x7f5128072850 2023-07-21T22:17:54.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.872+0000 7f51177fe700 1 -- 172.21.15.151:0/2972745308 <== mon.2 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f511809b2e0 con 0x7f5128072850 2023-07-21T22:17:54.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f51100a1260 msgr2=0x7f51100a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:54.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f51100a1260 0x7f51100a3710 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f51281019c0 tx=0x7f511c0073d0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5128072850 msgr2=0x7f5128105120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:54.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5128072850 0x7f5128105120 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5118005740 tx=0x7f5118005770 comp rx=0 tx=0).stop 2023-07-21T22:17:54.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 shutdown_connections 2023-07-21T22:17:54.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f51100a1260 0x7f51100a3710 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5128072850 0x7f5128105120 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f512810c440 0x7f51281001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 --2- 172.21.15.151:0/2972745308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5128073160 0x7f5128105680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:54.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 >> 172.21.15.151:0/2972745308 conn(0x7f51280fb660 msgr2=0x7f512810e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:54.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 shutdown_connections 2023-07-21T22:17:54.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:53.875+0000 7f512cb95700 1 -- 172.21.15.151:0/2972745308 wait complete. 2023-07-21T22:17:54.204 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182462 got 107374182463 for osd.3 2023-07-21T22:17:54.204 DEBUG:teuthology.parallel:result is None 2023-07-21T22:17:54.545 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:54 smithi151 ceph-mon[95510]: pgmap v322: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 214 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:54.545 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:54 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/131761696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-07-21T22:17:54.546 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:54 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2972745308' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-07-21T22:17:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:54 smithi187 ceph-mon[96918]: pgmap v322: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 214 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:54 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/131761696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-07-21T22:17:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:54 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2972745308' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-07-21T22:17:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:54 smithi195 ceph-mon[97365]: pgmap v322: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 214 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:54 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/131761696' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2023-07-21T22:17:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:54 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2972745308' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2023-07-21T22:17:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:55 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3008892990' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-21T22:17:55.653 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:55 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3008892990' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-21T22:17:55.655 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808861 got 287762808864 for osd.9 2023-07-21T22:17:55.655 DEBUG:teuthology.parallel:result is None 2023-07-21T22:17:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:55 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3008892990' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2023-07-21T22:17:56.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.121+0000 7feabf91c700 1 -- 172.21.15.151:0/2787998551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 msgr2=0x7feab810bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.121+0000 7feabf91c700 1 --2- 172.21.15.151:0/2787998551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 0x7feab810bf00 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7feaa8009990 tx=0x7feaa8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.121+0000 7feabf91c700 1 -- 172.21.15.151:0/2787998551 shutdown_connections 2023-07-21T22:17:56.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.121+0000 7feabf91c700 1 --2- 172.21.15.151:0/2787998551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feab8072850 0x7feab8072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.121+0000 7feabf91c700 1 --2- 172.21.15.151:0/2787998551 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab810c440 0x7feab810e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.121+0000 7feabf91c700 1 --2- 172.21.15.151:0/2787998551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 0x7feab810bf00 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.121+0000 7feabf91c700 1 -- 172.21.15.151:0/2787998551 >> 172.21.15.151:0/2787998551 conn(0x7feab80fb660 msgr2=0x7feab80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.121+0000 7feabf91c700 1 -- 172.21.15.151:0/2787998551 shutdown_connections 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.121+0000 7feabf91c700 1 -- 172.21.15.151:0/2787998551 wait complete. 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.122+0000 7feabf91c700 1 Processor -- start 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.122+0000 7feabf91c700 1 -- start start 2023-07-21T22:17:56.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabf91c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feab8072850 0x7feab8197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabf91c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 0x7feab81982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabf91c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab810c440 0x7feab819c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabf91c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab819cd40 con 0x7feab8073160 2023-07-21T22:17:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabf91c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab819ceb0 con 0x7feab8072850 2023-07-21T22:17:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabf91c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feab819d070 con 0x7feab810c440 2023-07-21T22:17:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabceb7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 0x7feab81982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabceb7700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 0x7feab81982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39988/0 (socket says 172.21.15.151:39988) 2023-07-21T22:17:56.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabceb7700 1 -- 172.21.15.151:0/3008892990 learned_addr learned my addr 172.21.15.151:0/3008892990 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:56.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabd6b8700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feab8072850 0x7feab8197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.123+0000 7feabdeb9700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab810c440 0x7feab819c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feabceb7700 1 -- 172.21.15.151:0/3008892990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab810c440 msgr2=0x7feab819c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feabceb7700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab810c440 0x7feab819c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feabceb7700 1 -- 172.21.15.151:0/3008892990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feab8072850 msgr2=0x7feab8197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feabceb7700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feab8072850 0x7feab8197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feabceb7700 1 -- 172.21.15.151:0/3008892990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feab4009520 con 0x7feab8073160 2023-07-21T22:17:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feabceb7700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 0x7feab81982c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7feaa8005770 tx=0x7feaa80057a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feaae7fc700 1 -- 172.21.15.151:0/3008892990 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa801d070 con 0x7feab8073160 2023-07-21T22:17:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feaae7fc700 1 -- 172.21.15.151:0/3008892990 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feaa800fbb0 con 0x7feab8073160 2023-07-21T22:17:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa80095f0 con 0x7feab8073160 2023-07-21T22:17:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feaae7fc700 1 -- 172.21.15.151:0/3008892990 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feaa80173f0 con 0x7feab8073160 2023-07-21T22:17:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.124+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feab81a49e0 con 0x7feab8073160 2023-07-21T22:17:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.126+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feab804e210 con 0x7feab8073160 2023-07-21T22:17:56.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.128+0000 7feaae7fc700 1 -- 172.21.15.151:0/3008892990 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7feaa8021410 con 0x7feab8073160 2023-07-21T22:17:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.129+0000 7feaae7fc700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7feaa40a1260 0x7feaa40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.129+0000 7feaae7fc700 1 -- 172.21.15.151:0/3008892990 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7feaa80cdd90 con 0x7feab8073160 2023-07-21T22:17:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.129+0000 7feabd6b8700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7feaa40a1260 0x7feaa40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.130+0000 7feabd6b8700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7feaa40a1260 0x7feaa40a3710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feab4009df0 tx=0x7feab4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.133+0000 7feaae7fc700 1 -- 172.21.15.151:0/3008892990 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7feaa80973e0 con 0x7feab8073160 2023-07-21T22:17:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.362+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7feab81990e0 con 0x7feab8073160 2023-07-21T22:17:56.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.362+0000 7feaae7fc700 1 -- 172.21.15.151:0/3008892990 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7feaa8026020 con 0x7feab8073160 2023-07-21T22:17:56.157 INFO:teuthology.orchestra.run.smithi151.stdout:219043332139 2023-07-21T22:17:56.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7feaa40a1260 msgr2=0x7feaa40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7feaa40a1260 0x7feaa40a3710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7feab4009df0 tx=0x7feab4009260 comp rx=0 tx=0).stop 2023-07-21T22:17:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 msgr2=0x7feab81982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 0x7feab81982c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7feaa8005770 tx=0x7feaa80057a0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 shutdown_connections 2023-07-21T22:17:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7feaa40a1260 0x7feaa40a3710 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feab8072850 0x7feab8197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feab810c440 0x7feab819c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 --2- 172.21.15.151:0/3008892990 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feab8073160 0x7feab81982c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 >> 172.21.15.151:0/3008892990 conn(0x7feab80fb660 msgr2=0x7feab810e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:56.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 shutdown_connections 2023-07-21T22:17:56.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:54.364+0000 7feabf91c700 1 -- 172.21.15.151:0/3008892990 wait complete. 2023-07-21T22:17:56.353 INFO:tasks.cephadm.ceph_manager.ceph:need seq 253403070500 got 253403070502 for osd.8 2023-07-21T22:17:56.354 DEBUG:teuthology.parallel:result is None 2023-07-21T22:17:56.420 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:56 smithi151 ceph-mon[95510]: pgmap v323: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 193 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:56.627 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:56 smithi187 ceph-mon[96918]: pgmap v323: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 193 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:56.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:56 smithi195 ceph-mon[97365]: pgmap v323: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 193 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:56.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.650+0000 7fa74f63e700 1 -- 172.21.15.151:0/866505924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7481007a0 msgr2=0x7fa748104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.650+0000 7fa74f63e700 1 --2- 172.21.15.151:0/866505924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7481007a0 0x7fa748104770 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa7380099c0 tx=0x7fa738009cd0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.650+0000 7fa74f63e700 1 -- 172.21.15.151:0/866505924 shutdown_connections 2023-07-21T22:17:56.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.650+0000 7fa74f63e700 1 --2- 172.21.15.151:0/866505924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7480ffe00 0x7fa7481001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.650+0000 7fa74f63e700 1 --2- 172.21.15.151:0/866505924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa748104ea0 0x7fa74810ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.650+0000 7fa74f63e700 1 --2- 172.21.15.151:0/866505924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa7481007a0 0x7fa748104770 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.650+0000 7fa74f63e700 1 -- 172.21.15.151:0/866505924 >> 172.21.15.151:0/866505924 conn(0x7fa7480fb660 msgr2=0x7fa7480fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:56.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.650+0000 7fa74f63e700 1 -- 172.21.15.151:0/866505924 shutdown_connections 2023-07-21T22:17:56.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.650+0000 7fa74f63e700 1 -- 172.21.15.151:0/866505924 wait complete. 2023-07-21T22:17:56.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.651+0000 7fa74f63e700 1 Processor -- start 2023-07-21T22:17:56.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.651+0000 7fa74f63e700 1 -- start start 2023-07-21T22:17:56.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.652+0000 7fa74f63e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7480ffe00 0x7fa74819ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.652+0000 7fa74f63e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7481007a0 0x7fa74819bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.652+0000 7fa74f63e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa748104ea0 0x7fa748195a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.652+0000 7fa74f63e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7481960e0 con 0x7fa748104ea0 2023-07-21T22:17:56.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.652+0000 7fa74f63e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa748196250 con 0x7fa7481007a0 2023-07-21T22:17:56.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.652+0000 7fa74f63e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa748196410 con 0x7fa7480ffe00 2023-07-21T22:17:56.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.652+0000 7fa74dbdb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa748104ea0 0x7fa748195a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.652+0000 7fa74dbdb700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa748104ea0 0x7fa748195a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36324/0 (socket says 172.21.15.151:36324) 2023-07-21T22:17:56.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.652+0000 7fa74dbdb700 1 -- 172.21.15.151:0/760838523 learned_addr learned my addr 172.21.15.151:0/760838523 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:56.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa74cbd9700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7481007a0 0x7fa74819bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa74d3da700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7480ffe00 0x7fa74819ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa74dbdb700 1 -- 172.21.15.151:0/760838523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7480ffe00 msgr2=0x7fa74819ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa74dbdb700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7480ffe00 0x7fa74819ba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa74dbdb700 1 -- 172.21.15.151:0/760838523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7481007a0 msgr2=0x7fa74819bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa74dbdb700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7481007a0 0x7fa74819bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa74dbdb700 1 -- 172.21.15.151:0/760838523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa740009c40 con 0x7fa748104ea0 2023-07-21T22:17:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa74dbdb700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa748104ea0 0x7fa748195a80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c370 tx=0x7fa74000c680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa73e7fc700 1 -- 172.21.15.151:0/760838523 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa740017070 con 0x7fa748104ea0 2023-07-21T22:17:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa73e7fc700 1 -- 172.21.15.151:0/760838523 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa74000f040 con 0x7fa748104ea0 2023-07-21T22:17:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.653+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7380095f0 con 0x7fa748104ea0 2023-07-21T22:17:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.654+0000 7fa73e7fc700 1 -- 172.21.15.151:0/760838523 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74000e050 con 0x7fa748104ea0 2023-07-21T22:17:56.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.654+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7481a2820 con 0x7fa748104ea0 2023-07-21T22:17:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.656+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa74804e210 con 0x7fa748104ea0 2023-07-21T22:17:56.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.658+0000 7fa73e7fc700 1 -- 172.21.15.151:0/760838523 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fa740003a00 con 0x7fa748104ea0 2023-07-21T22:17:56.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.660+0000 7fa73e7fc700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7340a1260 0x7fa7340a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.660+0000 7fa73e7fc700 1 -- 172.21.15.151:0/760838523 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa7400cc360 con 0x7fa748104ea0 2023-07-21T22:17:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.661+0000 7fa74d3da700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7340a1260 0x7fa7340a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.661+0000 7fa74d3da700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7340a1260 0x7fa7340a3710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa744005950 tx=0x7fa74400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:56.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.665+0000 7fa73e7fc700 1 -- 172.21.15.151:0/760838523 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fa740095920 con 0x7fa748104ea0 2023-07-21T22:17:56.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.715+0000 7ff65c1bf700 1 -- 172.21.15.151:0/2505420396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6540731c0 msgr2=0x7ff65410bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.715+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/2505420396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6540731c0 0x7ff65410bea0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff644009990 tx=0x7ff644009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.715+0000 7ff65c1bf700 1 -- 172.21.15.151:0/2505420396 shutdown_connections 2023-07-21T22:17:56.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.715+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/2505420396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6540728b0 0x7ff654072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.715+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/2505420396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff65410c3e0 0x7ff65410e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.715+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/2505420396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6540731c0 0x7ff65410bea0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.715+0000 7ff65c1bf700 1 -- 172.21.15.151:0/2505420396 >> 172.21.15.151:0/2505420396 conn(0x7ff6540fb660 msgr2=0x7ff6540fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:56.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.715+0000 7ff65c1bf700 1 -- 172.21.15.151:0/2505420396 shutdown_connections 2023-07-21T22:17:56.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.715+0000 7ff65c1bf700 1 -- 172.21.15.151:0/2505420396 wait complete. 2023-07-21T22:17:56.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.716+0000 7ff65c1bf700 1 Processor -- start 2023-07-21T22:17:56.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.716+0000 7ff65c1bf700 1 -- start start 2023-07-21T22:17:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.716+0000 7ff65c1bf700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6540728b0 0x7ff65419dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.716+0000 7ff65c1bf700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6540731c0 0x7ff65419e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.716+0000 7ff65c1bf700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65410c3e0 0x7ff654197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.716+0000 7ff65c1bf700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6541982a0 con 0x7ff6540731c0 2023-07-21T22:17:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.716+0000 7ff65c1bf700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff654198410 con 0x7ff65410c3e0 2023-07-21T22:17:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.716+0000 7ff65c1bf700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6541985d0 con 0x7ff6540728b0 2023-07-21T22:17:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff659f5b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6540728b0 0x7ff65419dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff65975a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6540731c0 0x7ff65419e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff659f5b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6540728b0 0x7ff65419dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:59300/0 (socket says 172.21.15.151:59300) 2023-07-21T22:17:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff659f5b700 1 -- 172.21.15.151:0/471389637 learned_addr learned my addr 172.21.15.151:0/471389637 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff65a75c700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65410c3e0 0x7ff654197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff65975a700 1 -- 172.21.15.151:0/471389637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6540728b0 msgr2=0x7ff65419dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff65975a700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6540728b0 0x7ff65419dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff65975a700 1 -- 172.21.15.151:0/471389637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65410c3e0 msgr2=0x7ff654197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff65975a700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65410c3e0 0x7ff654197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff65975a700 1 -- 172.21.15.151:0/471389637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6440095f0 con 0x7ff6540731c0 2023-07-21T22:17:56.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff659f5b700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6540728b0 0x7ff65419dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:56.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.717+0000 7ff65975a700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6540731c0 0x7ff65419e010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff644000c00 tx=0x7ff6440057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:56.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.718+0000 7ff64affd700 1 -- 172.21.15.151:0/471389637 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff64401d070 con 0x7ff6540731c0 2023-07-21T22:17:56.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.718+0000 7ff64affd700 1 -- 172.21.15.151:0/471389637 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff644021410 con 0x7ff6540731c0 2023-07-21T22:17:56.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.718+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff654198850 con 0x7ff6540731c0 2023-07-21T22:17:56.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.718+0000 7ff64affd700 1 -- 172.21.15.151:0/471389637 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff644017650 con 0x7ff6540731c0 2023-07-21T22:17:56.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.718+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6541a4ac0 con 0x7ff6540731c0 2023-07-21T22:17:56.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.719+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff65404e210 con 0x7ff6540731c0 2023-07-21T22:17:56.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.721+0000 7ff64affd700 1 -- 172.21.15.151:0/471389637 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7ff644021580 con 0x7ff6540731c0 2023-07-21T22:17:56.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.723+0000 7ff64affd700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff6400a11e0 0x7ff6400a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:56.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.723+0000 7ff64affd700 1 -- 172.21.15.151:0/471389637 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7ff6440ce550 con 0x7ff6540731c0 2023-07-21T22:17:56.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.725+0000 7ff659f5b700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff6400a11e0 0x7ff6400a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:56.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.725+0000 7ff64affd700 1 -- 172.21.15.151:0/471389637 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ff644097ba0 con 0x7ff6540731c0 2023-07-21T22:17:56.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.725+0000 7ff659f5b700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff6400a11e0 0x7ff6400a3690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff650011550 tx=0x7ff650009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:56.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.890+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa7481a29b0 con 0x7fa748104ea0 2023-07-21T22:17:56.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.891+0000 7fa73e7fc700 1 -- 172.21.15.151:0/760838523 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa740098f40 con 0x7fa748104ea0 2023-07-21T22:17:56.935 INFO:teuthology.orchestra.run.smithi151.stdout:34359738448 2023-07-21T22:17:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7340a1260 msgr2=0x7fa7340a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7340a1260 0x7fa7340a3710 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa744005950 tx=0x7fa74400b410 comp rx=0 tx=0).stop 2023-07-21T22:17:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa748104ea0 msgr2=0x7fa748195a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa748104ea0 0x7fa748195a80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa74000c370 tx=0x7fa74000c680 comp rx=0 tx=0).stop 2023-07-21T22:17:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 shutdown_connections 2023-07-21T22:17:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa7340a1260 0x7fa7340a3710 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa748104ea0 0x7fa748195a80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa7480ffe00 0x7fa74819ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 --2- 172.21.15.151:0/760838523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7481007a0 0x7fa74819bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 >> 172.21.15.151:0/760838523 conn(0x7fa7480fb660 msgr2=0x7fa7480fc190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 shutdown_connections 2023-07-21T22:17:56.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.893+0000 7fa74f63e700 1 -- 172.21.15.151:0/760838523 wait complete. 2023-07-21T22:17:56.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.937+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7ff654198ff0 con 0x7ff6540731c0 2023-07-21T22:17:56.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.938+0000 7ff64affd700 1 -- 172.21.15.151:0/471389637 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ff64409b1c0 con 0x7ff6540731c0 2023-07-21T22:17:56.982 INFO:teuthology.orchestra.run.smithi151.stdout:197568495665 2023-07-21T22:17:56.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.940+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff6400a11e0 msgr2=0x7ff6400a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.940+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff6400a11e0 0x7ff6400a3690 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7ff650011550 tx=0x7ff650009260 comp rx=0 tx=0).stop 2023-07-21T22:17:56.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.940+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6540731c0 msgr2=0x7ff65419e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:56.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.940+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6540731c0 0x7ff65419e010 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7ff644000c00 tx=0x7ff6440057c0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.940+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 shutdown_connections 2023-07-21T22:17:56.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.941+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff6400a11e0 0x7ff6400a3690 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.941+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff65410c3e0 0x7ff654197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.941+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6540728b0 0x7ff65419dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.941+0000 7ff65c1bf700 1 --2- 172.21.15.151:0/471389637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6540731c0 0x7ff65419e010 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.941+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 >> 172.21.15.151:0/471389637 conn(0x7ff6540fb660 msgr2=0x7ff65410e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.941+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 shutdown_connections 2023-07-21T22:17:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:56.941+0000 7ff65c1bf700 1 -- 172.21.15.151:0/471389637 wait complete. 2023-07-21T22:17:57.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:57 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/760838523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-21T22:17:57.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:57 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/471389637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-21T22:17:57.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:57 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/760838523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-21T22:17:57.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:57 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/471389637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-21T22:17:57.764 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332136 got 219043332139 for osd.7 2023-07-21T22:17:57.765 DEBUG:teuthology.parallel:result is None 2023-07-21T22:17:57.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:57 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/760838523' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2023-07-21T22:17:57.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:57 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/471389637' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2023-07-21T22:17:58.198 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738446 got 34359738448 for osd.0 2023-07-21T22:17:58.198 DEBUG:teuthology.parallel:result is None 2023-07-21T22:17:58.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:17:58 smithi195 ceph-mon[97365]: pgmap v324: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:58.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:17:58 smithi151 ceph-mon[95510]: pgmap v324: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:58.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:17:58 smithi187 ceph-mon[96918]: pgmap v324: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:17:59.115 INFO:tasks.cephadm.ceph_manager.ceph:need seq 197568495663 got 197568495665 for osd.6 2023-07-21T22:17:59.115 DEBUG:teuthology.parallel:result is None 2023-07-21T22:17:59.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.352+0000 7fa009881700 1 -- 172.21.15.151:0/933258571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0040728b0 msgr2=0x7fa004072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.352+0000 7fa009881700 1 --2- 172.21.15.151:0/933258571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0040728b0 0x7fa004072c80 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4009990 tx=0x7f9ff4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.353+0000 7fa009881700 1 -- 172.21.15.151:0/933258571 shutdown_connections 2023-07-21T22:17:59.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.353+0000 7fa009881700 1 --2- 172.21.15.151:0/933258571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa004110bb0 0x7fa004112f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.353+0000 7fa009881700 1 --2- 172.21.15.151:0/933258571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0040728b0 0x7fa004072c80 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.353+0000 7fa009881700 1 --2- 172.21.15.151:0/933258571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0040731c0 0x7fa004110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.353+0000 7fa009881700 1 -- 172.21.15.151:0/933258571 >> 172.21.15.151:0/933258571 conn(0x7fa0040fb660 msgr2=0x7fa0040fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:59.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.353+0000 7fa009881700 1 -- 172.21.15.151:0/933258571 shutdown_connections 2023-07-21T22:17:59.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.353+0000 7fa009881700 1 -- 172.21.15.151:0/933258571 wait complete. 2023-07-21T22:17:59.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.354+0000 7fa009881700 1 Processor -- start 2023-07-21T22:17:59.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.354+0000 7fa009881700 1 -- start start 2023-07-21T22:17:59.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.354+0000 7fa009881700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0040728b0 0x7fa00419c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.354+0000 7fa009881700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0040731c0 0x7fa00419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa009881700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa004110bb0 0x7fa0041a0af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa009881700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041a1100 con 0x7fa004110bb0 2023-07-21T22:17:59.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa009881700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041a1270 con 0x7fa0040728b0 2023-07-21T22:17:59.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa009881700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0041a1430 con 0x7fa0040731c0 2023-07-21T22:17:59.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa002ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0040728b0 0x7fa00419c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa002ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0040728b0 0x7fa00419c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35746/0 (socket says 172.21.15.151:35746) 2023-07-21T22:17:59.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa002ffd700 1 -- 172.21.15.151:0/3598491257 learned_addr learned my addr 172.21.15.151:0/3598491257 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:59.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa0027fc700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0040731c0 0x7fa00419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa0037fe700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa004110bb0 0x7fa0041a0af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa002ffd700 1 -- 172.21.15.151:0/3598491257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0040731c0 msgr2=0x7fa00419c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa002ffd700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0040731c0 0x7fa00419c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa002ffd700 1 -- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa004110bb0 msgr2=0x7fa0041a0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa002ffd700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa004110bb0 0x7fa0041a0af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa002ffd700 1 -- 172.21.15.151:0/3598491257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff40095f0 con 0x7fa0040728b0 2023-07-21T22:17:59.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.355+0000 7fa0027fc700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0040731c0 0x7fa00419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:17:59.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.356+0000 7fa002ffd700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0040728b0 0x7fa00419c140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006010 tx=0x7f9ff4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:59.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.356+0000 7fa00887f700 1 -- 172.21.15.151:0/3598491257 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff401d070 con 0x7fa0040728b0 2023-07-21T22:17:59.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.356+0000 7fa00887f700 1 -- 172.21.15.151:0/3598491257 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ff4003f80 con 0x7fa0040728b0 2023-07-21T22:17:59.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.356+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0041a16b0 con 0x7fa0040728b0 2023-07-21T22:17:59.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.356+0000 7fa00887f700 1 -- 172.21.15.151:0/3598491257 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff4022ab0 con 0x7fa0040728b0 2023-07-21T22:17:59.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.356+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0041a8f70 con 0x7fa0040728b0 2023-07-21T22:17:59.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.358+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa004103090 con 0x7fa0040728b0 2023-07-21T22:17:59.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.359+0000 7fa00887f700 1 -- 172.21.15.151:0/3598491257 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f9ff4003af0 con 0x7fa0040728b0 2023-07-21T22:17:59.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.361+0000 7fa00887f700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9fec0a11e0 0x7f9fec0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.361+0000 7fa00887f700 1 -- 172.21.15.151:0/3598491257 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f9ff40ce180 con 0x7fa0040728b0 2023-07-21T22:17:59.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.361+0000 7fa0027fc700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9fec0a11e0 0x7f9fec0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.362+0000 7fa0027fc700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9fec0a11e0 0x7f9fec0a3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa00419d760 tx=0x7f9ff800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:59.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.365+0000 7fa00887f700 1 -- 172.21.15.151:0/3598491257 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f9ff40977d0 con 0x7fa0040728b0 2023-07-21T22:17:59.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.499+0000 7fab42e11700 1 -- 172.21.15.151:0/3603193941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 msgr2=0x7fab3c10e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.499+0000 7fab42e11700 1 --2- 172.21.15.151:0/3603193941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 0x7fab3c10e910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fab3400b0a0 tx=0x7fab3400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.499+0000 7fab42e11700 1 -- 172.21.15.151:0/3603193941 shutdown_connections 2023-07-21T22:17:59.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.499+0000 7fab42e11700 1 --2- 172.21.15.151:0/3603193941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab3c0fe980 0x7fab3c0fed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.499+0000 7fab42e11700 1 --2- 172.21.15.151:0/3603193941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 0x7fab3c10e910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.499+0000 7fab42e11700 1 --2- 172.21.15.151:0/3603193941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c0ff290 0x7fab3c10bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.499+0000 7fab42e11700 1 -- 172.21.15.151:0/3603193941 >> 172.21.15.151:0/3603193941 conn(0x7fab3c075b70 msgr2=0x7fab3c075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:59.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.500+0000 7fab42e11700 1 -- 172.21.15.151:0/3603193941 shutdown_connections 2023-07-21T22:17:59.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.500+0000 7fab42e11700 1 -- 172.21.15.151:0/3603193941 wait complete. 2023-07-21T22:17:59.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.501+0000 7fab42e11700 1 Processor -- start 2023-07-21T22:17:59.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.501+0000 7fab42e11700 1 -- start start 2023-07-21T22:17:59.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab42e11700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab3c0fe980 0x7fab3c197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab42e11700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c0ff290 0x7fab3c198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab42e11700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 0x7fab3c19c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab42e11700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c19cea0 con 0x7fab3c10c530 2023-07-21T22:17:59.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab42e11700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c19d010 con 0x7fab3c0fe980 2023-07-21T22:17:59.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab42e11700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab3c19d1d0 con 0x7fab3c0ff290 2023-07-21T22:17:59.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab413ae700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 0x7fab3c19c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab413ae700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 0x7fab3c19c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36386/0 (socket says 172.21.15.151:36386) 2023-07-21T22:17:59.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab413ae700 1 -- 172.21.15.151:0/2500623000 learned_addr learned my addr 172.21.15.151:0/2500623000 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:59.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.502+0000 7fab3bfff700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c0ff290 0x7fab3c198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.503+0000 7fab40bad700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab3c0fe980 0x7fab3c197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.503+0000 7fab413ae700 1 -- 172.21.15.151:0/2500623000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c0ff290 msgr2=0x7fab3c198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.503+0000 7fab413ae700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c0ff290 0x7fab3c198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.503+0000 7fab413ae700 1 -- 172.21.15.151:0/2500623000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab3c0fe980 msgr2=0x7fab3c197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.503+0000 7fab413ae700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab3c0fe980 0x7fab3c197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.503+0000 7fab413ae700 1 -- 172.21.15.151:0/2500623000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab34009d00 con 0x7fab3c10c530 2023-07-21T22:17:59.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.503+0000 7fab413ae700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 0x7fab3c19c890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fab34009440 tx=0x7fab34009470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:59.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.503+0000 7fab39ffb700 1 -- 172.21.15.151:0/2500623000 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3400e040 con 0x7fab3c10c530 2023-07-21T22:17:59.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.504+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab3c19d450 con 0x7fab3c10c530 2023-07-21T22:17:59.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.504+0000 7fab39ffb700 1 -- 172.21.15.151:0/2500623000 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab34006080 con 0x7fab3c10c530 2023-07-21T22:17:59.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.504+0000 7fab39ffb700 1 -- 172.21.15.151:0/2500623000 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab3401b780 con 0x7fab3c10c530 2023-07-21T22:17:59.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.504+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab3c1a4d10 con 0x7fab3c10c530 2023-07-21T22:17:59.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.505+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab3c04e210 con 0x7fab3c10c530 2023-07-21T22:17:59.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.507+0000 7fab39ffb700 1 -- 172.21.15.151:0/2500623000 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fab3401d480 con 0x7fab3c10c530 2023-07-21T22:17:59.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.508+0000 7fab39ffb700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab2c0a11e0 0x7fab2c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.509+0000 7fab39ffb700 1 -- 172.21.15.151:0/2500623000 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fab340cedb0 con 0x7fab3c10c530 2023-07-21T22:17:59.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.509+0000 7fab40bad700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab2c0a11e0 0x7fab2c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.509+0000 7fab40bad700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab2c0a11e0 0x7fab2c0a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab30007be0 tx=0x7fab300073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:59.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.514+0000 7fab39ffb700 1 -- 172.21.15.151:0/2500623000 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fab3405f770 con 0x7fab3c10c530 2023-07-21T22:17:59.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.627+0000 7f23630fa700 1 -- 172.21.15.151:0/66438459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f235c1007a0 msgr2=0x7f235c104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.627+0000 7f23630fa700 1 --2- 172.21.15.151:0/66438459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f235c1007a0 0x7f235c104770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2348009920 tx=0x7f2348009c30 comp rx=0 tx=0).stop 2023-07-21T22:17:59.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.628+0000 7f23630fa700 1 -- 172.21.15.151:0/66438459 shutdown_connections 2023-07-21T22:17:59.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.628+0000 7f23630fa700 1 --2- 172.21.15.151:0/66438459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f235c0ffe00 0x7f235c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.628+0000 7f23630fa700 1 --2- 172.21.15.151:0/66438459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c104ea0 0x7f235c10ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.628+0000 7f23630fa700 1 --2- 172.21.15.151:0/66438459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f235c1007a0 0x7f235c104770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.628+0000 7f23630fa700 1 -- 172.21.15.151:0/66438459 >> 172.21.15.151:0/66438459 conn(0x7f235c0fb660 msgr2=0x7f235c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:59.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.628+0000 7f23630fa700 1 -- 172.21.15.151:0/66438459 shutdown_connections 2023-07-21T22:17:59.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.628+0000 7f23630fa700 1 -- 172.21.15.151:0/66438459 wait complete. 2023-07-21T22:17:59.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.629+0000 7f23630fa700 1 Processor -- start 2023-07-21T22:17:59.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.629+0000 7f23630fa700 1 -- start start 2023-07-21T22:17:59.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f23630fa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c0ffe00 0x7f235c197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f23630fa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f235c1007a0 0x7f235c1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f23630fa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f235c104ea0 0x7f235c19c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f23630fa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c19ce60 con 0x7f235c0ffe00 2023-07-21T22:17:59.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f23630fa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c19cfd0 con 0x7f235c104ea0 2023-07-21T22:17:59.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f23630fa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f235c19d190 con 0x7f235c1007a0 2023-07-21T22:17:59.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f2360e96700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c0ffe00 0x7f235c197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f2360e96700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c0ffe00 0x7f235c197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36404/0 (socket says 172.21.15.151:36404) 2023-07-21T22:17:59.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f2360e96700 1 -- 172.21.15.151:0/994781396 learned_addr learned my addr 172.21.15.151:0/994781396 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:59.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f235bfff700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f235c1007a0 0x7f235c1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.630+0000 7f2361697700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f235c104ea0 0x7f235c19c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.631+0000 7f2360e96700 1 -- 172.21.15.151:0/994781396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f235c1007a0 msgr2=0x7f235c1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.631+0000 7f2360e96700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f235c1007a0 0x7f235c1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.631+0000 7f2360e96700 1 -- 172.21.15.151:0/994781396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f235c104ea0 msgr2=0x7f235c19c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.631+0000 7f2360e96700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f235c104ea0 0x7f235c19c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.631+0000 7f2360e96700 1 -- 172.21.15.151:0/994781396 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2354009d00 con 0x7f235c0ffe00 2023-07-21T22:17:59.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.631+0000 7f2360e96700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c0ffe00 0x7f235c197ea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f235000e9a0 tx=0x7f235000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:59.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.632+0000 7f2359ffb700 1 -- 172.21.15.151:0/994781396 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350009790 con 0x7f235c0ffe00 2023-07-21T22:17:59.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.632+0000 7f2359ffb700 1 -- 172.21.15.151:0/994781396 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f235000cbd0 con 0x7f235c0ffe00 2023-07-21T22:17:59.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.632+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2348009520 con 0x7f235c0ffe00 2023-07-21T22:17:59.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.632+0000 7f2359ffb700 1 -- 172.21.15.151:0/994781396 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350018680 con 0x7f235c0ffe00 2023-07-21T22:17:59.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.632+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f235c1a4b00 con 0x7f235c0ffe00 2023-07-21T22:17:59.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.634+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f235c04e210 con 0x7f235c0ffe00 2023-07-21T22:17:59.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.636+0000 7f2359ffb700 1 -- 172.21.15.151:0/994781396 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f23500187e0 con 0x7f235c0ffe00 2023-07-21T22:17:59.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.639+0000 7f2359ffb700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f234c0a1330 0x7f234c0a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.639+0000 7f2359ffb700 1 -- 172.21.15.151:0/994781396 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f2350014070 con 0x7f235c0ffe00 2023-07-21T22:17:59.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.639+0000 7f235bfff700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f234c0a1330 0x7f234c0a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.640+0000 7f235bfff700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f234c0a1330 0x7f234c0a37e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f235c1994c0 tx=0x7f2348019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:59.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.644+0000 7f2359ffb700 1 -- 172.21.15.151:0/994781396 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2350096a90 con 0x7f235c0ffe00 2023-07-21T22:17:59.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.648+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7fa004102a70 con 0x7fa0040728b0 2023-07-21T22:17:59.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.649+0000 7fa00887f700 1 -- 172.21.15.151:0/3598491257 <== mon.2 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f9ff409adf0 con 0x7fa0040728b0 2023-07-21T22:17:59.693 INFO:teuthology.orchestra.run.smithi151.stdout:343597383704 2023-07-21T22:17:59.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9fec0a11e0 msgr2=0x7f9fec0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9fec0a11e0 0x7f9fec0a3690 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa00419d760 tx=0x7f9ff800b410 comp rx=0 tx=0).stop 2023-07-21T22:17:59.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0040728b0 msgr2=0x7fa00419c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0040728b0 0x7fa00419c140 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9ff4006010 tx=0x7f9ff4004730 comp rx=0 tx=0).stop 2023-07-21T22:17:59.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 shutdown_connections 2023-07-21T22:17:59.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9fec0a11e0 0x7f9fec0a3690 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0040728b0 0x7fa00419c140 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa004110bb0 0x7fa0041a0af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 --2- 172.21.15.151:0/3598491257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0040731c0 0x7fa00419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 >> 172.21.15.151:0/3598491257 conn(0x7fa0040fb660 msgr2=0x7fa0040fc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:59.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 shutdown_connections 2023-07-21T22:17:59.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.653+0000 7fa009881700 1 -- 172.21.15.151:0/3598491257 wait complete. 2023-07-21T22:17:59.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.739+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fab3c199240 con 0x7fab3c10c530 2023-07-21T22:17:59.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.739+0000 7fab39ffb700 1 -- 172.21.15.151:0/2500623000 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fab34021090 con 0x7fab3c10c530 2023-07-21T22:17:59.784 INFO:teuthology.orchestra.run.smithi151.stdout:55834574925 2023-07-21T22:17:59.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab2c0a11e0 msgr2=0x7fab2c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab2c0a11e0 0x7fab2c0a3690 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fab30007be0 tx=0x7fab300073d0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 msgr2=0x7fab3c19c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 0x7fab3c19c890 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fab34009440 tx=0x7fab34009470 comp rx=0 tx=0).stop 2023-07-21T22:17:59.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 shutdown_connections 2023-07-21T22:17:59.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fab2c0a11e0 0x7fab2c0a3690 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab3c0fe980 0x7fab3c197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab3c10c530 0x7fab3c19c890 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 --2- 172.21.15.151:0/2500623000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab3c0ff290 0x7fab3c198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 >> 172.21.15.151:0/2500623000 conn(0x7fab3c075b70 msgr2=0x7fab3c0fc3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:59.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 shutdown_connections 2023-07-21T22:17:59.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.742+0000 7fab42e11700 1 -- 172.21.15.151:0/2500623000 wait complete. 2023-07-21T22:17:59.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.870+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f235c199200 con 0x7f235c0ffe00 2023-07-21T22:17:59.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.871+0000 7f2359ffb700 1 -- 172.21.15.151:0/994781396 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f2350026020 con 0x7f235c0ffe00 2023-07-21T22:17:59.915 INFO:teuthology.orchestra.run.smithi151.stdout:163208757303 2023-07-21T22:17:59.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f234c0a1330 msgr2=0x7f234c0a37e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f234c0a1330 0x7f234c0a37e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f235c1994c0 tx=0x7f2348019040 comp rx=0 tx=0).stop 2023-07-21T22:17:59.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c0ffe00 msgr2=0x7f235c197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c0ffe00 0x7f235c197ea0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f235000e9a0 tx=0x7f235000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 shutdown_connections 2023-07-21T22:17:59.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f234c0a1330 0x7f234c0a37e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f235c104ea0 0x7f235c19c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f235c0ffe00 0x7f235c197ea0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 --2- 172.21.15.151:0/994781396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f235c1007a0 0x7f235c1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.873+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 >> 172.21.15.151:0/994781396 conn(0x7f235c0fb660 msgr2=0x7f235c0fc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:59.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.874+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 shutdown_connections 2023-07-21T22:17:59.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.874+0000 7f23630fa700 1 -- 172.21.15.151:0/994781396 wait complete. 2023-07-21T22:17:59.972 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.927+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/1398096997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb980731c0 msgr2=0x7ffb9810bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.972 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.927+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/1398096997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb980731c0 0x7ffb9810bea0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ffb8c009990 tx=0x7ffb8c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.972 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.928+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/1398096997 shutdown_connections 2023-07-21T22:17:59.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.928+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/1398096997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb9810c3e0 0x7ffb9810e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.928+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/1398096997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb980728b0 0x7ffb98072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.928+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/1398096997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb980731c0 0x7ffb9810bea0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.928+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/1398096997 >> 172.21.15.151:0/1398096997 conn(0x7ffb980fb660 msgr2=0x7ffb980fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:17:59.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.928+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/1398096997 shutdown_connections 2023-07-21T22:17:59.974 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.928+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/1398096997 wait complete. 2023-07-21T22:17:59.975 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.929+0000 7ffb9c9e1700 1 Processor -- start 2023-07-21T22:17:59.975 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.930+0000 7ffb9c9e1700 1 -- start start 2023-07-21T22:17:59.975 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.930+0000 7ffb9c9e1700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb980728b0 0x7ffb9819dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.975 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.930+0000 7ffb9c9e1700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb980731c0 0x7ffb9819e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.976 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.930+0000 7ffb9c9e1700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb9810c3e0 0x7ffb98197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.976 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.930+0000 7ffb9c9e1700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb981981c0 con 0x7ffb9810c3e0 2023-07-21T22:17:59.976 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.930+0000 7ffb9c9e1700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb98198330 con 0x7ffb980728b0 2023-07-21T22:17:59.976 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.930+0000 7ffb9c9e1700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb981984f0 con 0x7ffb980731c0 2023-07-21T22:17:59.976 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.930+0000 7ffb96d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb9810c3e0 0x7ffb98197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.976 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb96d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb9810c3e0 0x7ffb98197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36412/0 (socket says 172.21.15.151:36412) 2023-07-21T22:17:59.976 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb96d9d700 1 -- 172.21.15.151:0/3315743900 learned_addr learned my addr 172.21.15.151:0/3315743900 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:17:59.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb9659c700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb980728b0 0x7ffb9819dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb95d9b700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb980731c0 0x7ffb9819e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb96d9d700 1 -- 172.21.15.151:0/3315743900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb980731c0 msgr2=0x7ffb9819e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb96d9d700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb980731c0 0x7ffb9819e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb96d9d700 1 -- 172.21.15.151:0/3315743900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb980728b0 msgr2=0x7ffb9819dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:17:59.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb96d9d700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb980728b0 0x7ffb9819dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:17:59.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb96d9d700 1 -- 172.21.15.151:0/3315743900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8c0095f0 con 0x7ffb9810c3e0 2023-07-21T22:17:59.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb95d9b700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb980731c0 0x7ffb9819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:17:59.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb96d9d700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb9810c3e0 0x7ffb98197b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffb90007d70 tx=0x7ffb9000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:59.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.931+0000 7ffb877fe700 1 -- 172.21.15.151:0/3315743900 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb9000ad40 con 0x7ffb9810c3e0 2023-07-21T22:17:59.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.932+0000 7ffb877fe700 1 -- 172.21.15.151:0/3315743900 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffb900128b0 con 0x7ffb9810c3e0 2023-07-21T22:17:59.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.932+0000 7ffb877fe700 1 -- 172.21.15.151:0/3315743900 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb900115c0 con 0x7ffb9810c3e0 2023-07-21T22:17:59.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.932+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb981987d0 con 0x7ffb9810c3e0 2023-07-21T22:17:59.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.932+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb981a4ac0 con 0x7ffb9810c3e0 2023-07-21T22:17:59.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.933+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb9804e210 con 0x7ffb9810c3e0 2023-07-21T22:17:59.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.936+0000 7ffb877fe700 1 -- 172.21.15.151:0/3315743900 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7ffb90012a20 con 0x7ffb9810c3e0 2023-07-21T22:17:59.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.938+0000 7ffb877fe700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ffb800a1260 0x7ffb800a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:17:59.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.939+0000 7ffb877fe700 1 -- 172.21.15.151:0/3315743900 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7ffb900ccf60 con 0x7ffb9810c3e0 2023-07-21T22:17:59.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.939+0000 7ffb9659c700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ffb800a1260 0x7ffb800a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:17:59.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.940+0000 7ffb9659c700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ffb800a1260 0x7ffb800a3710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009c60 tx=0x7ffb88009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:17:59.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:17:59.940+0000 7ffb877fe700 1 -- 172.21.15.151:0/3315743900 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ffb900f9770 con 0x7ffb9810c3e0 2023-07-21T22:18:00.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.155+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7ffb98198ff0 con 0x7ffb9810c3e0 2023-07-21T22:18:00.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.156+0000 7ffb877fe700 1 -- 172.21.15.151:0/3315743900 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7ffb9009a0c0 con 0x7ffb9810c3e0 2023-07-21T22:18:00.201 INFO:teuthology.orchestra.run.smithi151.stdout:141733920829 2023-07-21T22:18:00.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.158+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ffb800a1260 msgr2=0x7ffb800a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:00.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.158+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ffb800a1260 0x7ffb800a3710 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffb88009c60 tx=0x7ffb88009260 comp rx=0 tx=0).stop 2023-07-21T22:18:00.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb9810c3e0 msgr2=0x7ffb98197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:00.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb9810c3e0 0x7ffb98197b50 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ffb90007d70 tx=0x7ffb9000a340 comp rx=0 tx=0).stop 2023-07-21T22:18:00.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 shutdown_connections 2023-07-21T22:18:00.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ffb800a1260 0x7ffb800a3710 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb980728b0 0x7ffb9819dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffb9810c3e0 0x7ffb98197b50 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 --2- 172.21.15.151:0/3315743900 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffb980731c0 0x7ffb9819e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 >> 172.21.15.151:0/3315743900 conn(0x7ffb980fb660 msgr2=0x7ffb9810e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:00.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 shutdown_connections 2023-07-21T22:18:00.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.159+0000 7ffb9c9e1700 1 -- 172.21.15.151:0/3315743900 wait complete. 2023-07-21T22:18:00.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.276+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/193248662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc1070b0 msgr2=0x7f3fbc10ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:00.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.276+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/193248662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc1070b0 0x7f3fbc10ec30 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f3fb400b0d0 tx=0x7f3fb400b3e0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.276+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/193248662 shutdown_connections 2023-07-21T22:18:00.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.276+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/193248662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fbc102010 0x7f3fbc1023e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.276+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/193248662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc1070b0 0x7f3fbc10ec30 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.276+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/193248662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fbc1029b0 0x7f3fbc106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.276+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/193248662 >> 172.21.15.151:0/193248662 conn(0x7f3fbc0fd8b0 msgr2=0x7f3fbc0ffcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:00.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.276+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/193248662 shutdown_connections 2023-07-21T22:18:00.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.276+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/193248662 wait complete. 2023-07-21T22:18:00.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.277+0000 7f3fc2f2c700 1 Processor -- start 2023-07-21T22:18:00.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.277+0000 7f3fc2f2c700 1 -- start start 2023-07-21T22:18:00.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc2f2c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc102010 0x7f3fbc197f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:00.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc2f2c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fbc1029b0 0x7f3fbc1984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:00.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc2f2c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fbc1070b0 0x7f3fbc19c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:00.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc2f2c700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc19cec0 con 0x7f3fbc102010 2023-07-21T22:18:00.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc2f2c700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc19d030 con 0x7f3fbc1070b0 2023-07-21T22:18:00.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc2f2c700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc19d1f0 con 0x7f3fbc1029b0 2023-07-21T22:18:00.324 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc0cc8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc102010 0x7f3fbc197f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:00.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc0cc8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc102010 0x7f3fbc197f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36430/0 (socket says 172.21.15.151:36430) 2023-07-21T22:18:00.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc0cc8700 1 -- 172.21.15.151:0/1268592942 learned_addr learned my addr 172.21.15.151:0/1268592942 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:00.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fbbfff700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fbc1029b0 0x7f3fbc1984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:00.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc14c9700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fbc1070b0 0x7f3fbc19c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:00.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc0cc8700 1 -- 172.21.15.151:0/1268592942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fbc1029b0 msgr2=0x7f3fbc1984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:00.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc0cc8700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fbc1029b0 0x7f3fbc1984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc0cc8700 1 -- 172.21.15.151:0/1268592942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fbc1070b0 msgr2=0x7f3fbc19c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:00.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc0cc8700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fbc1070b0 0x7f3fbc19c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc0cc8700 1 -- 172.21.15.151:0/1268592942 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009d00 con 0x7f3fbc102010 2023-07-21T22:18:00.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.278+0000 7f3fc14c9700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fbc1070b0 0x7f3fbc19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:00.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.279+0000 7f3fc0cc8700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc102010 0x7f3fbc197f70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000e9a0 tx=0x7f3fb000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:00.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.279+0000 7f3fb9ffb700 1 -- 172.21.15.151:0/1268592942 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0009790 con 0x7f3fbc102010 2023-07-21T22:18:00.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.279+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc19d4d0 con 0x7f3fbc102010 2023-07-21T22:18:00.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.279+0000 7f3fb9ffb700 1 -- 172.21.15.151:0/1268592942 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fb000cbd0 con 0x7f3fbc102010 2023-07-21T22:18:00.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.279+0000 7f3fb9ffb700 1 -- 172.21.15.151:0/1268592942 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0018680 con 0x7f3fbc102010 2023-07-21T22:18:00.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.279+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc1a4d30 con 0x7f3fbc102010 2023-07-21T22:18:00.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.280+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fbc04e210 con 0x7f3fbc102010 2023-07-21T22:18:00.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.282+0000 7f3fb9ffb700 1 -- 172.21.15.151:0/1268592942 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f3fb000cd40 con 0x7f3fbc102010 2023-07-21T22:18:00.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.284+0000 7f3fb9ffb700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3fac0a1260 0x7f3fac0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:00.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.284+0000 7f3fb9ffb700 1 -- 172.21.15.151:0/1268592942 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f3fb0014070 con 0x7f3fbc102010 2023-07-21T22:18:00.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.284+0000 7f3fbbfff700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3fac0a1260 0x7f3fac0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:00.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.285+0000 7f3fbbfff700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3fac0a1260 0x7f3fac0a3710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc199520 tx=0x7f3fa800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:00.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.289+0000 7f3fb9ffb700 1 -- 172.21.15.151:0/1268592942 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f3fb0051770 con 0x7f3fbc102010 2023-07-21T22:18:00.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.499+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f3fbc1a4f20 con 0x7f3fbc102010 2023-07-21T22:18:00.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.499+0000 7f3fb9ffb700 1 -- 172.21.15.151:0/1268592942 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+13 (secure 0 0 0) 0x7f3fb00962b0 con 0x7f3fbc102010 2023-07-21T22:18:00.544 INFO:teuthology.orchestra.run.smithi151.stdout:309237645342 2023-07-21T22:18:00.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3fac0a1260 msgr2=0x7f3fac0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:00.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3fac0a1260 0x7f3fac0a3710 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc199520 tx=0x7f3fa800b410 comp rx=0 tx=0).stop 2023-07-21T22:18:00.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc102010 msgr2=0x7f3fbc197f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:00.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc102010 0x7f3fbc197f70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f3fb000e9a0 tx=0x7f3fb000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 shutdown_connections 2023-07-21T22:18:00.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3fac0a1260 0x7f3fac0a3710 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fbc1070b0 0x7f3fbc19c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fbc102010 0x7f3fbc197f70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 --2- 172.21.15.151:0/1268592942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fbc1029b0 0x7f3fbc1984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:00.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 >> 172.21.15.151:0/1268592942 conn(0x7f3fbc0fd8b0 msgr2=0x7f3fbc0fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:00.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 shutdown_connections 2023-07-21T22:18:00.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:00.502+0000 7f3fc2f2c700 1 -- 172.21.15.151:0/1268592942 wait complete. 2023-07-21T22:18:00.567 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:00 smithi151 ceph-mon[95510]: pgmap v325: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:18:00.568 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:00 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3598491257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-07-21T22:18:00.568 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:00 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2500623000' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-21T22:18:00.568 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:00 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/994781396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-21T22:18:00.568 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:00 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3315743900' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-21T22:18:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:00 smithi195 ceph-mon[97365]: pgmap v325: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:18:00.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:00 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3598491257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-07-21T22:18:00.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:00 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2500623000' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-21T22:18:00.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:00 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/994781396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-21T22:18:00.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:00 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3315743900' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-21T22:18:00.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:00 smithi187 ceph-mon[96918]: pgmap v325: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 170 B/s wr, 6 op/s; 0 B/s, 0 objects/s recovering 2023-07-21T22:18:00.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:00 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3598491257' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2023-07-21T22:18:00.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:00 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2500623000' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2023-07-21T22:18:00.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:00 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/994781396' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2023-07-21T22:18:00.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:00 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3315743900' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2023-07-21T22:18:01.222 INFO:tasks.cephadm.ceph_manager.ceph:need seq 343597383701 got 343597383704 for osd.11 2023-07-21T22:18:01.222 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:01.391 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574922 got 55834574925 for osd.1 2023-07-21T22:18:01.392 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:01.428 INFO:tasks.cephadm.ceph_manager.ceph:need seq 141733920827 got 141733920829 for osd.4 2023-07-21T22:18:01.429 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:01.653 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:01 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1268592942' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-07-21T22:18:01.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:01 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1268592942' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-07-21T22:18:01.831 INFO:tasks.cephadm.ceph_manager.ceph:need seq 163208757301 got 163208757303 for osd.5 2023-07-21T22:18:01.831 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:01.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:01 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1268592942' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2023-07-21T22:18:02.045 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645338 got 309237645342 for osd.10 2023-07-21T22:18:02.046 DEBUG:teuthology.parallel:result is None 2023-07-21T22:18:02.046 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2023-07-21T22:18:02.046 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph pg dump --format=json 2023-07-21T22:18:02.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:02 smithi195 ceph-mon[97365]: pgmap v326: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-21T22:18:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:02 smithi151 ceph-mon[95510]: pgmap v326: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-21T22:18:02.771 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:02.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:02 smithi187 ceph-mon[96918]: pgmap v326: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-21T22:18:04.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.368+0000 7f5ac271b700 1 -- 172.21.15.151:0/1903016838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc0ffe00 msgr2=0x7f5abc1001d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:04.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.368+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1903016838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc0ffe00 0x7f5abc1001d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f5aac0099c0 tx=0x7f5aac009cd0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.368+0000 7f5ac271b700 1 -- 172.21.15.151:0/1903016838 shutdown_connections 2023-07-21T22:18:04.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.368+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1903016838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5abc104ea0 0x7f5abc10ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.368+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1903016838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc0ffe00 0x7f5abc1001d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.368+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1903016838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5abc1007a0 0x7f5abc104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.368+0000 7f5ac271b700 1 -- 172.21.15.151:0/1903016838 >> 172.21.15.151:0/1903016838 conn(0x7f5abc0fb660 msgr2=0x7f5abc0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:04.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.368+0000 7f5ac271b700 1 -- 172.21.15.151:0/1903016838 shutdown_connections 2023-07-21T22:18:04.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.368+0000 7f5ac271b700 1 -- 172.21.15.151:0/1903016838 wait complete. 2023-07-21T22:18:04.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.369+0000 7f5ac271b700 1 Processor -- start 2023-07-21T22:18:04.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5ac271b700 1 -- start start 2023-07-21T22:18:04.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5ac271b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5abc0ffe00 0x7f5abc072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:04.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5ac271b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc1007a0 0x7f5abc072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:04.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5ac271b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5abc104ea0 0x7f5abc0732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:04.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5ac271b700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1a4170 con 0x7f5abc1007a0 2023-07-21T22:18:04.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5ac271b700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1a42e0 con 0x7f5abc104ea0 2023-07-21T22:18:04.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5ac271b700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5abc1a44a0 con 0x7f5abc0ffe00 2023-07-21T22:18:04.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5abb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc1007a0 0x7f5abc072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:04.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5abbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5abc0ffe00 0x7f5abc072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:04.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5abb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc1007a0 0x7f5abc072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36452/0 (socket says 172.21.15.151:36452) 2023-07-21T22:18:04.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5abb7fe700 1 -- 172.21.15.151:0/1616512714 learned_addr learned my addr 172.21.15.151:0/1616512714 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:04.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.370+0000 7f5ac0cb8700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5abc104ea0 0x7f5abc0732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:04.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5abb7fe700 1 -- 172.21.15.151:0/1616512714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5abc0ffe00 msgr2=0x7f5abc072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:04.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5abb7fe700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5abc0ffe00 0x7f5abc072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5abb7fe700 1 -- 172.21.15.151:0/1616512714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5abc104ea0 msgr2=0x7f5abc0732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:04.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5abb7fe700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5abc104ea0 0x7f5abc0732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5abb7fe700 1 -- 172.21.15.151:0/1616512714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5aac0095f0 con 0x7f5abc1007a0 2023-07-21T22:18:04.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5abbfff700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5abc0ffe00 0x7f5abc072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:04.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5abb7fe700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc1007a0 0x7f5abc072d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000d980 tx=0x7f5ab000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:04.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5ab97fa700 1 -- 172.21.15.151:0/1616512714 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000f890 con 0x7f5abc1007a0 2023-07-21T22:18:04.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5ab97fa700 1 -- 172.21.15.151:0/1616512714 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ab000fe80 con 0x7f5abc1007a0 2023-07-21T22:18:04.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5abc1a4780 con 0x7f5abc1007a0 2023-07-21T22:18:04.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5ab97fa700 1 -- 172.21.15.151:0/1616512714 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ab000e3b0 con 0x7f5abc1007a0 2023-07-21T22:18:04.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.371+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5abc1a4cd0 con 0x7f5abc1007a0 2023-07-21T22:18:04.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.372+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5abc04e210 con 0x7f5abc1007a0 2023-07-21T22:18:04.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.374+0000 7f5ab97fa700 1 -- 172.21.15.151:0/1616512714 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f5ab000f9f0 con 0x7f5abc1007a0 2023-07-21T22:18:04.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.376+0000 7f5ab97fa700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5aa40a1260 0x7f5aa40a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:04.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.376+0000 7f5ab97fa700 1 -- 172.21.15.151:0/1616512714 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f5ab00cc490 con 0x7f5abc1007a0 2023-07-21T22:18:04.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.376+0000 7f5abbfff700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5aa40a1260 0x7f5aa40a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:04.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.376+0000 7f5abbfff700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5aa40a1260 0x7f5aa40a3710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00b580 tx=0x7f5aac01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:04.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.380+0000 7f5ab97fa700 1 -- 172.21.15.151:0/1616512714 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f5ab0095a50 con 0x7f5abc1007a0 2023-07-21T22:18:04.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:04 smithi151 ceph-mon[95510]: pgmap v327: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:04.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.572+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5abc0fc8f0 con 0x7f5aa40a1260 2023-07-21T22:18:04.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.583+0000 7f5ab97fa700 1 -- 172.21.15.151:0/1616512714 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339669 (secure 0 0 0) 0x7f5abc0fc8f0 con 0x7f5aa40a1260 2023-07-21T22:18:04.633 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:04.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5aa40a1260 msgr2=0x7f5aa40a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:04.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5aa40a1260 0x7f5aa40a3710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5aac00b580 tx=0x7f5aac01a040 comp rx=0 tx=0).stop 2023-07-21T22:18:04.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc1007a0 msgr2=0x7f5abc072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:04.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc1007a0 0x7f5abc072d50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f5ab000d980 tx=0x7f5ab000dc90 comp rx=0 tx=0).stop 2023-07-21T22:18:04.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 shutdown_connections 2023-07-21T22:18:04.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5aa40a1260 0x7f5aa40a3710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5abc104ea0 0x7f5abc0732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5abc0ffe00 0x7f5abc072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 --2- 172.21.15.151:0/1616512714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5abc1007a0 0x7f5abc072d50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:04.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 >> 172.21.15.151:0/1616512714 conn(0x7f5abc0fb660 msgr2=0x7f5abc0fc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:04.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 shutdown_connections 2023-07-21T22:18:04.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:04.588+0000 7f5ac271b700 1 -- 172.21.15.151:0/1616512714 wait complete. 2023-07-21T22:18:04.639 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-07-21T22:18:04.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:04 smithi195 ceph-mon[97365]: pgmap v327: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:04.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:04 smithi187 ceph-mon[96918]: pgmap v327: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:05.249 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":327,"stamp":"2023-07-21T22:18:02.866475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651344,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":430,"num_read_kb":329,"num_write":332,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334968,"kb_used_data":11544,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606856,"statfs":{"total":1151940427776,"available":1151597420544,"internally_reserved":0,"allocated":11821056,"data_stored":7419767,"data_compressed":108096,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006138"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.301208+0000","last_change":"2023-07-21T22:17:09.850731+0000","last_active":"2023-07-21T22:17:44.301208+0000","last_peered":"2023-07-21T22:17:44.301208+0000","last_clean":"2023-07-21T22:17:44.301208+0000","last_became_active":"2023-07-21T22:17:09.849185+0000","last_became_peered":"2023-07-21T22:17:09.849185+0000","last_unstale":"2023-07-21T22:17:44.301208+0000","last_undegraded":"2023-07-21T22:17:44.301208+0000","last_fullsized":"2023-07-21T22:17:44.301208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:35.659774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485459+0000","last_change":"2023-07-21T22:17:09.853210+0000","last_active":"2023-07-21T22:17:44.485459+0000","last_peered":"2023-07-21T22:17:44.485459+0000","last_clean":"2023-07-21T22:17:44.485459+0000","last_became_active":"2023-07-21T22:17:09.852822+0000","last_became_peered":"2023-07-21T22:17:09.852822+0000","last_unstale":"2023-07-21T22:17:44.485459+0000","last_undegraded":"2023-07-21T22:17:44.485459+0000","last_fullsized":"2023-07-21T22:17:44.485459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:20.599740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485471+0000","last_change":"2023-07-21T22:17:09.850123+0000","last_active":"2023-07-21T22:17:44.485471+0000","last_peered":"2023-07-21T22:17:44.485471+0000","last_clean":"2023-07-21T22:17:44.485471+0000","last_became_active":"2023-07-21T22:17:09.849763+0000","last_became_peered":"2023-07-21T22:17:09.849763+0000","last_unstale":"2023-07-21T22:17:44.485471+0000","last_undegraded":"2023-07-21T22:17:44.485471+0000","last_fullsized":"2023-07-21T22:17:44.485471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:56.684648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.306962+0000","last_change":"2023-07-21T22:17:44.306609+0000","last_active":"2023-07-21T22:17:44.306962+0000","last_peered":"2023-07-21T22:17:44.306962+0000","last_clean":"2023-07-21T22:17:44.306962+0000","last_became_active":"2023-07-21T22:17:44.306274+0000","last_became_peered":"2023-07-21T22:17:44.306274+0000","last_unstale":"2023-07-21T22:17:44.306962+0000","last_undegraded":"2023-07-21T22:17:44.306962+0000","last_fullsized":"2023-07-21T22:17:44.306962+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:18:47.720581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304532+0000","last_change":"2023-07-21T22:17:09.836811+0000","last_active":"2023-07-21T22:17:44.304532+0000","last_peered":"2023-07-21T22:17:44.304532+0000","last_clean":"2023-07-21T22:17:44.304532+0000","last_became_active":"2023-07-21T22:17:09.836470+0000","last_became_peered":"2023-07-21T22:17:09.836470+0000","last_unstale":"2023-07-21T22:17:44.304532+0000","last_undegraded":"2023-07-21T22:17:44.304532+0000","last_fullsized":"2023-07-21T22:17:44.304532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:19.711901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303155+0000","last_change":"2023-07-21T22:17:09.845801+0000","last_active":"2023-07-21T22:17:44.303155+0000","last_peered":"2023-07-21T22:17:44.303155+0000","last_clean":"2023-07-21T22:17:44.303155+0000","last_became_active":"2023-07-21T22:17:09.844938+0000","last_became_peered":"2023-07-21T22:17:09.844938+0000","last_unstale":"2023-07-21T22:17:44.303155+0000","last_undegraded":"2023-07-21T22:17:44.303155+0000","last_fullsized":"2023-07-21T22:17:44.303155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:35.691429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304408+0000","last_change":"2023-07-21T22:17:09.850392+0000","last_active":"2023-07-21T22:17:44.304408+0000","last_peered":"2023-07-21T22:17:44.304408+0000","last_clean":"2023-07-21T22:17:44.304408+0000","last_became_active":"2023-07-21T22:17:09.850013+0000","last_became_peered":"2023-07-21T22:17:09.850013+0000","last_unstale":"2023-07-21T22:17:44.304408+0000","last_undegraded":"2023-07-21T22:17:44.304408+0000","last_fullsized":"2023-07-21T22:17:44.304408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:04.984082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302962+0000","last_change":"2023-07-21T22:17:09.845425+0000","last_active":"2023-07-21T22:17:44.302962+0000","last_peered":"2023-07-21T22:17:44.302962+0000","last_clean":"2023-07-21T22:17:44.302962+0000","last_became_active":"2023-07-21T22:17:09.845090+0000","last_became_peered":"2023-07-21T22:17:09.845090+0000","last_unstale":"2023-07-21T22:17:44.302962+0000","last_undegraded":"2023-07-21T22:17:44.302962+0000","last_fullsized":"2023-07-21T22:17:44.302962+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:59.843469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305381+0000","last_change":"2023-07-21T22:17:09.845600+0000","last_active":"2023-07-21T22:17:44.305381+0000","last_peered":"2023-07-21T22:17:44.305381+0000","last_clean":"2023-07-21T22:17:44.305381+0000","last_became_active":"2023-07-21T22:17:09.845260+0000","last_became_peered":"2023-07-21T22:17:09.845260+0000","last_unstale":"2023-07-21T22:17:44.305381+0000","last_undegraded":"2023-07-21T22:17:44.305381+0000","last_fullsized":"2023-07-21T22:17:44.305381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:49.477671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302885+0000","last_change":"2023-07-21T22:17:09.846172+0000","last_active":"2023-07-21T22:17:44.302885+0000","last_peered":"2023-07-21T22:17:44.302885+0000","last_clean":"2023-07-21T22:17:44.302885+0000","last_became_active":"2023-07-21T22:17:09.845827+0000","last_became_peered":"2023-07-21T22:17:09.845827+0000","last_unstale":"2023-07-21T22:17:44.302885+0000","last_undegraded":"2023-07-21T22:17:44.302885+0000","last_fullsized":"2023-07-21T22:17:44.302885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:38.644866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304572+0000","last_change":"2023-07-21T22:17:09.852728+0000","last_active":"2023-07-21T22:17:44.304572+0000","last_peered":"2023-07-21T22:17:44.304572+0000","last_clean":"2023-07-21T22:17:44.304572+0000","last_became_active":"2023-07-21T22:17:09.852152+0000","last_became_peered":"2023-07-21T22:17:09.852152+0000","last_unstale":"2023-07-21T22:17:44.304572+0000","last_undegraded":"2023-07-21T22:17:44.304572+0000","last_fullsized":"2023-07-21T22:17:44.304572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:10.530218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487404+0000","last_change":"2023-07-21T22:17:09.850565+0000","last_active":"2023-07-21T22:17:44.487404+0000","last_peered":"2023-07-21T22:17:44.487404+0000","last_clean":"2023-07-21T22:17:44.487404+0000","last_became_active":"2023-07-21T22:17:09.850162+0000","last_became_peered":"2023-07-21T22:17:09.850162+0000","last_unstale":"2023-07-21T22:17:44.487404+0000","last_undegraded":"2023-07-21T22:17:44.487404+0000","last_fullsized":"2023-07-21T22:17:44.487404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:48.591116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299812+0000","last_change":"2023-07-21T22:17:09.836732+0000","last_active":"2023-07-21T22:17:44.299812+0000","last_peered":"2023-07-21T22:17:44.299812+0000","last_clean":"2023-07-21T22:17:44.299812+0000","last_became_active":"2023-07-21T22:17:09.836446+0000","last_became_peered":"2023-07-21T22:17:09.836446+0000","last_unstale":"2023-07-21T22:17:44.299812+0000","last_undegraded":"2023-07-21T22:17:44.299812+0000","last_fullsized":"2023-07-21T22:17:44.299812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:05.998599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485159+0000","last_change":"2023-07-21T22:17:09.852624+0000","last_active":"2023-07-21T22:17:44.485159+0000","last_peered":"2023-07-21T22:17:44.485159+0000","last_clean":"2023-07-21T22:17:44.485159+0000","last_became_active":"2023-07-21T22:17:09.852353+0000","last_became_peered":"2023-07-21T22:17:09.852353+0000","last_unstale":"2023-07-21T22:17:44.485159+0000","last_undegraded":"2023-07-21T22:17:44.485159+0000","last_fullsized":"2023-07-21T22:17:44.485159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:42.502841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485146+0000","last_change":"2023-07-21T22:17:09.860554+0000","last_active":"2023-07-21T22:17:44.485146+0000","last_peered":"2023-07-21T22:17:44.485146+0000","last_clean":"2023-07-21T22:17:44.485146+0000","last_became_active":"2023-07-21T22:17:09.860119+0000","last_became_peered":"2023-07-21T22:17:09.860119+0000","last_unstale":"2023-07-21T22:17:44.485146+0000","last_undegraded":"2023-07-21T22:17:44.485146+0000","last_fullsized":"2023-07-21T22:17:44.485146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:58.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305329+0000","last_change":"2023-07-21T22:17:09.850522+0000","last_active":"2023-07-21T22:17:44.305329+0000","last_peered":"2023-07-21T22:17:44.305329+0000","last_clean":"2023-07-21T22:17:44.305329+0000","last_became_active":"2023-07-21T22:17:09.850243+0000","last_became_peered":"2023-07-21T22:17:09.850243+0000","last_unstale":"2023-07-21T22:17:44.305329+0000","last_undegraded":"2023-07-21T22:17:44.305329+0000","last_fullsized":"2023-07-21T22:17:44.305329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:10.569656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.301523+0000","last_change":"2023-07-21T22:17:09.848552+0000","last_active":"2023-07-21T22:17:44.301523+0000","last_peered":"2023-07-21T22:17:44.301523+0000","last_clean":"2023-07-21T22:17:44.301523+0000","last_became_active":"2023-07-21T22:17:09.848110+0000","last_became_peered":"2023-07-21T22:17:09.848110+0000","last_unstale":"2023-07-21T22:17:44.301523+0000","last_undegraded":"2023-07-21T22:17:44.301523+0000","last_fullsized":"2023-07-21T22:17:44.301523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:12.712668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302425+0000","last_change":"2023-07-21T22:17:09.848899+0000","last_active":"2023-07-21T22:17:44.302425+0000","last_peered":"2023-07-21T22:17:44.302425+0000","last_clean":"2023-07-21T22:17:44.302425+0000","last_became_active":"2023-07-21T22:17:09.848606+0000","last_became_peered":"2023-07-21T22:17:09.848606+0000","last_unstale":"2023-07-21T22:17:44.302425+0000","last_undegraded":"2023-07-21T22:17:44.302425+0000","last_fullsized":"2023-07-21T22:17:44.302425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:51.141831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303803+0000","last_change":"2023-07-21T22:17:09.838033+0000","last_active":"2023-07-21T22:17:44.303803+0000","last_peered":"2023-07-21T22:17:44.303803+0000","last_clean":"2023-07-21T22:17:44.303803+0000","last_became_active":"2023-07-21T22:17:09.837532+0000","last_became_peered":"2023-07-21T22:17:09.837532+0000","last_unstale":"2023-07-21T22:17:44.303803+0000","last_undegraded":"2023-07-21T22:17:44.303803+0000","last_fullsized":"2023-07-21T22:17:44.303803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:24.281689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302370+0000","last_change":"2023-07-21T22:17:08.867849+0000","last_active":"2023-07-21T22:17:44.302370+0000","last_peered":"2023-07-21T22:17:44.302370+0000","last_clean":"2023-07-21T22:17:44.302370+0000","last_became_active":"2023-07-21T22:17:08.866245+0000","last_became_peered":"2023-07-21T22:17:08.866245+0000","last_unstale":"2023-07-21T22:17:44.302370+0000","last_undegraded":"2023-07-21T22:17:44.302370+0000","last_fullsized":"2023-07-21T22:17:44.302370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:37.153114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303911+0000","last_change":"2023-07-21T22:17:09.841402+0000","last_active":"2023-07-21T22:17:44.303911+0000","last_peered":"2023-07-21T22:17:44.303911+0000","last_clean":"2023-07-21T22:17:44.303911+0000","last_became_active":"2023-07-21T22:17:09.841009+0000","last_became_peered":"2023-07-21T22:17:09.841009+0000","last_unstale":"2023-07-21T22:17:44.303911+0000","last_undegraded":"2023-07-21T22:17:44.303911+0000","last_fullsized":"2023-07-21T22:17:44.303911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:08.232799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304136+0000","last_change":"2023-07-21T22:17:08.864236+0000","last_active":"2023-07-21T22:17:44.304136+0000","last_peered":"2023-07-21T22:17:44.304136+0000","last_clean":"2023-07-21T22:17:44.304136+0000","last_became_active":"2023-07-21T22:17:08.863579+0000","last_became_peered":"2023-07-21T22:17:08.863579+0000","last_unstale":"2023-07-21T22:17:44.304136+0000","last_undegraded":"2023-07-21T22:17:44.304136+0000","last_fullsized":"2023-07-21T22:17:44.304136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:10.453785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485547+0000","last_change":"2023-07-21T22:17:09.852677+0000","last_active":"2023-07-21T22:17:44.485547+0000","last_peered":"2023-07-21T22:17:44.485547+0000","last_clean":"2023-07-21T22:17:44.485547+0000","last_became_active":"2023-07-21T22:17:09.852326+0000","last_became_peered":"2023-07-21T22:17:09.852326+0000","last_unstale":"2023-07-21T22:17:44.485547+0000","last_undegraded":"2023-07-21T22:17:44.485547+0000","last_fullsized":"2023-07-21T22:17:44.485547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:09.817158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304951+0000","last_change":"2023-07-21T22:17:08.867521+0000","last_active":"2023-07-21T22:17:44.304951+0000","last_peered":"2023-07-21T22:17:44.304951+0000","last_clean":"2023-07-21T22:17:44.304951+0000","last_became_active":"2023-07-21T22:17:08.867125+0000","last_became_peered":"2023-07-21T22:17:08.867125+0000","last_unstale":"2023-07-21T22:17:44.304951+0000","last_undegraded":"2023-07-21T22:17:44.304951+0000","last_fullsized":"2023-07-21T22:17:44.304951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:36:09.254395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305145+0000","last_change":"2023-07-21T22:17:09.846296+0000","last_active":"2023-07-21T22:17:44.305145+0000","last_peered":"2023-07-21T22:17:44.305145+0000","last_clean":"2023-07-21T22:17:44.305145+0000","last_became_active":"2023-07-21T22:17:09.845947+0000","last_became_peered":"2023-07-21T22:17:09.845947+0000","last_unstale":"2023-07-21T22:17:44.305145+0000","last_undegraded":"2023-07-21T22:17:44.305145+0000","last_fullsized":"2023-07-21T22:17:44.305145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:34:46.553617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305483+0000","last_change":"2023-07-21T22:17:08.866709+0000","last_active":"2023-07-21T22:17:44.305483+0000","last_peered":"2023-07-21T22:17:44.305483+0000","last_clean":"2023-07-21T22:17:44.305483+0000","last_became_active":"2023-07-21T22:17:08.866277+0000","last_became_peered":"2023-07-21T22:17:08.866277+0000","last_unstale":"2023-07-21T22:17:44.305483+0000","last_undegraded":"2023-07-21T22:17:44.305483+0000","last_fullsized":"2023-07-21T22:17:44.305483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:13.480396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486380+0000","last_change":"2023-07-21T22:17:09.855068+0000","last_active":"2023-07-21T22:17:44.486380+0000","last_peered":"2023-07-21T22:17:44.486380+0000","last_clean":"2023-07-21T22:17:44.486380+0000","last_became_active":"2023-07-21T22:17:09.854697+0000","last_became_peered":"2023-07-21T22:17:09.854697+0000","last_unstale":"2023-07-21T22:17:44.486380+0000","last_undegraded":"2023-07-21T22:17:44.486380+0000","last_fullsized":"2023-07-21T22:17:44.486380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:46.560534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:58.279569+0000","last_change":"2023-07-21T22:17:08.864292+0000","last_active":"2023-07-21T22:17:58.279569+0000","last_peered":"2023-07-21T22:17:58.279569+0000","last_clean":"2023-07-21T22:17:58.279569+0000","last_became_active":"2023-07-21T22:17:08.863243+0000","last_became_peered":"2023-07-21T22:17:08.863243+0000","last_unstale":"2023-07-21T22:17:58.279569+0000","last_undegraded":"2023-07-21T22:17:58.279569+0000","last_fullsized":"2023-07-21T22:17:58.279569+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:46:18.247508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304784+0000","last_change":"2023-07-21T22:17:09.840756+0000","last_active":"2023-07-21T22:17:44.304784+0000","last_peered":"2023-07-21T22:17:44.304784+0000","last_clean":"2023-07-21T22:17:44.304784+0000","last_became_active":"2023-07-21T22:17:09.840421+0000","last_became_peered":"2023-07-21T22:17:09.840421+0000","last_unstale":"2023-07-21T22:17:44.304784+0000","last_undegraded":"2023-07-21T22:17:44.304784+0000","last_fullsized":"2023-07-21T22:17:44.304784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:30.874703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.491774+0000","last_change":"2023-07-21T22:17:44.491774+0000","last_active":"2023-07-21T22:17:44.491774+0000","last_peered":"2023-07-21T22:17:44.491774+0000","last_clean":"2023-07-21T22:17:44.491774+0000","last_became_active":"2023-07-21T22:17:44.488479+0000","last_became_peered":"2023-07-21T22:17:44.488479+0000","last_unstale":"2023-07-21T22:17:44.491774+0000","last_undegraded":"2023-07-21T22:17:44.491774+0000","last_fullsized":"2023-07-21T22:17:44.491774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:37:54.678291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486110+0000","last_change":"2023-07-21T22:17:09.839359+0000","last_active":"2023-07-21T22:17:44.486110+0000","last_peered":"2023-07-21T22:17:44.486110+0000","last_clean":"2023-07-21T22:17:44.486110+0000","last_became_active":"2023-07-21T22:17:09.839026+0000","last_became_peered":"2023-07-21T22:17:09.839026+0000","last_unstale":"2023-07-21T22:17:44.486110+0000","last_undegraded":"2023-07-21T22:17:44.486110+0000","last_fullsized":"2023-07-21T22:17:44.486110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:39.641691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299788+0000","last_change":"2023-07-21T22:17:08.861680+0000","last_active":"2023-07-21T22:17:44.299788+0000","last_peered":"2023-07-21T22:17:44.299788+0000","last_clean":"2023-07-21T22:17:44.299788+0000","last_became_active":"2023-07-21T22:17:08.861348+0000","last_became_peered":"2023-07-21T22:17:08.861348+0000","last_unstale":"2023-07-21T22:17:44.299788+0000","last_undegraded":"2023-07-21T22:17:44.299788+0000","last_fullsized":"2023-07-21T22:17:44.299788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:54.809555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303038+0000","last_change":"2023-07-21T22:17:09.840166+0000","last_active":"2023-07-21T22:17:44.303038+0000","last_peered":"2023-07-21T22:17:44.303038+0000","last_clean":"2023-07-21T22:17:44.303038+0000","last_became_active":"2023-07-21T22:17:09.839850+0000","last_became_peered":"2023-07-21T22:17:09.839850+0000","last_unstale":"2023-07-21T22:17:44.303038+0000","last_undegraded":"2023-07-21T22:17:44.303038+0000","last_fullsized":"2023-07-21T22:17:44.303038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:43.813137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485915+0000","last_change":"2023-07-21T22:17:08.864838+0000","last_active":"2023-07-21T22:17:44.485915+0000","last_peered":"2023-07-21T22:17:44.485915+0000","last_clean":"2023-07-21T22:17:44.485915+0000","last_became_active":"2023-07-21T22:17:08.864484+0000","last_became_peered":"2023-07-21T22:17:08.864484+0000","last_unstale":"2023-07-21T22:17:44.485915+0000","last_undegraded":"2023-07-21T22:17:44.485915+0000","last_fullsized":"2023-07-21T22:17:44.485915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:55:33.300808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302427+0000","last_change":"2023-07-21T22:17:09.836214+0000","last_active":"2023-07-21T22:17:44.302427+0000","last_peered":"2023-07-21T22:17:44.302427+0000","last_clean":"2023-07-21T22:17:44.302427+0000","last_became_active":"2023-07-21T22:17:09.835877+0000","last_became_peered":"2023-07-21T22:17:09.835877+0000","last_unstale":"2023-07-21T22:17:44.302427+0000","last_undegraded":"2023-07-21T22:17:44.302427+0000","last_fullsized":"2023-07-21T22:17:44.302427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:50.733216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":65,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:57.277194+0000","last_change":"2023-07-21T22:17:08.861801+0000","last_active":"2023-07-21T22:17:57.277194+0000","last_peered":"2023-07-21T22:17:57.277194+0000","last_clean":"2023-07-21T22:17:57.277194+0000","last_became_active":"2023-07-21T22:17:08.861391+0000","last_became_peered":"2023-07-21T22:17:08.861391+0000","last_unstale":"2023-07-21T22:17:57.277194+0000","last_undegraded":"2023-07-21T22:17:57.277194+0000","last_fullsized":"2023-07-21T22:17:57.277194+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:27:55.305051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305353+0000","last_change":"2023-07-21T22:17:09.842155+0000","last_active":"2023-07-21T22:17:44.305353+0000","last_peered":"2023-07-21T22:17:44.305353+0000","last_clean":"2023-07-21T22:17:44.305353+0000","last_became_active":"2023-07-21T22:17:09.841845+0000","last_became_peered":"2023-07-21T22:17:09.841845+0000","last_unstale":"2023-07-21T22:17:44.305353+0000","last_undegraded":"2023-07-21T22:17:44.305353+0000","last_fullsized":"2023-07-21T22:17:44.305353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:10.209278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304566+0000","last_change":"2023-07-21T22:17:08.858727+0000","last_active":"2023-07-21T22:17:44.304566+0000","last_peered":"2023-07-21T22:17:44.304566+0000","last_clean":"2023-07-21T22:17:44.304566+0000","last_became_active":"2023-07-21T22:17:08.858376+0000","last_became_peered":"2023-07-21T22:17:08.858376+0000","last_unstale":"2023-07-21T22:17:44.304566+0000","last_undegraded":"2023-07-21T22:17:44.304566+0000","last_fullsized":"2023-07-21T22:17:44.304566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:35.053954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485518+0000","last_change":"2023-07-21T22:17:09.857300+0000","last_active":"2023-07-21T22:17:44.485518+0000","last_peered":"2023-07-21T22:17:44.485518+0000","last_clean":"2023-07-21T22:17:44.485518+0000","last_became_active":"2023-07-21T22:17:09.856932+0000","last_became_peered":"2023-07-21T22:17:09.856932+0000","last_unstale":"2023-07-21T22:17:44.485518+0000","last_undegraded":"2023-07-21T22:17:44.485518+0000","last_fullsized":"2023-07-21T22:17:44.485518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:28.202771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486481+0000","last_change":"2023-07-21T22:17:08.865488+0000","last_active":"2023-07-21T22:17:44.486481+0000","last_peered":"2023-07-21T22:17:44.486481+0000","last_clean":"2023-07-21T22:17:44.486481+0000","last_became_active":"2023-07-21T22:17:08.865050+0000","last_became_peered":"2023-07-21T22:17:08.865050+0000","last_unstale":"2023-07-21T22:17:44.486481+0000","last_undegraded":"2023-07-21T22:17:44.486481+0000","last_fullsized":"2023-07-21T22:17:44.486481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:12:41.386381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305586+0000","last_change":"2023-07-21T22:17:09.849880+0000","last_active":"2023-07-21T22:17:44.305586+0000","last_peered":"2023-07-21T22:17:44.305586+0000","last_clean":"2023-07-21T22:17:44.305586+0000","last_became_active":"2023-07-21T22:17:09.849552+0000","last_became_peered":"2023-07-21T22:17:09.849552+0000","last_unstale":"2023-07-21T22:17:44.305586+0000","last_undegraded":"2023-07-21T22:17:44.305586+0000","last_fullsized":"2023-07-21T22:17:44.305586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:57.861104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'27","reported_seq":141,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:58.289552+0000","last_change":"2023-07-21T22:17:08.861663+0000","last_active":"2023-07-21T22:17:58.289552+0000","last_peered":"2023-07-21T22:17:58.289552+0000","last_clean":"2023-07-21T22:17:58.289552+0000","last_became_active":"2023-07-21T22:17:08.861339+0000","last_became_peered":"2023-07-21T22:17:08.861339+0000","last_unstale":"2023-07-21T22:17:58.289552+0000","last_undegraded":"2023-07-21T22:17:58.289552+0000","last_fullsized":"2023-07-21T22:17:58.289552+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:23:16.097183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56826,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":96,"num_read_kb":102,"num_write":28,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304514+0000","last_change":"2023-07-21T22:17:09.841543+0000","last_active":"2023-07-21T22:17:44.304514+0000","last_peered":"2023-07-21T22:17:44.304514+0000","last_clean":"2023-07-21T22:17:44.304514+0000","last_became_active":"2023-07-21T22:17:09.841235+0000","last_became_peered":"2023-07-21T22:17:09.841235+0000","last_unstale":"2023-07-21T22:17:44.304514+0000","last_undegraded":"2023-07-21T22:17:44.304514+0000","last_fullsized":"2023-07-21T22:17:44.304514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:37:58.825011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303802+0000","last_change":"2023-07-21T22:17:08.855145+0000","last_active":"2023-07-21T22:17:44.303802+0000","last_peered":"2023-07-21T22:17:44.303802+0000","last_clean":"2023-07-21T22:17:44.303802+0000","last_became_active":"2023-07-21T22:17:08.853279+0000","last_became_peered":"2023-07-21T22:17:08.853279+0000","last_unstale":"2023-07-21T22:17:44.303802+0000","last_undegraded":"2023-07-21T22:17:44.303802+0000","last_fullsized":"2023-07-21T22:17:44.303802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:10.333188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299716+0000","last_change":"2023-07-21T22:17:09.835656+0000","last_active":"2023-07-21T22:17:44.299716+0000","last_peered":"2023-07-21T22:17:44.299716+0000","last_clean":"2023-07-21T22:17:44.299716+0000","last_became_active":"2023-07-21T22:17:09.835309+0000","last_became_peered":"2023-07-21T22:17:09.835309+0000","last_unstale":"2023-07-21T22:17:44.299716+0000","last_undegraded":"2023-07-21T22:17:44.299716+0000","last_fullsized":"2023-07-21T22:17:44.299716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:59.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486159+0000","last_change":"2023-07-21T22:17:08.864811+0000","last_active":"2023-07-21T22:17:44.486159+0000","last_peered":"2023-07-21T22:17:44.486159+0000","last_clean":"2023-07-21T22:17:44.486159+0000","last_became_active":"2023-07-21T22:17:08.864428+0000","last_became_peered":"2023-07-21T22:17:08.864428+0000","last_unstale":"2023-07-21T22:17:44.486159+0000","last_undegraded":"2023-07-21T22:17:44.486159+0000","last_fullsized":"2023-07-21T22:17:44.486159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:09.637705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304356+0000","last_change":"2023-07-21T22:17:09.837713+0000","last_active":"2023-07-21T22:17:44.304356+0000","last_peered":"2023-07-21T22:17:44.304356+0000","last_clean":"2023-07-21T22:17:44.304356+0000","last_became_active":"2023-07-21T22:17:09.837420+0000","last_became_peered":"2023-07-21T22:17:09.837420+0000","last_unstale":"2023-07-21T22:17:44.304356+0000","last_undegraded":"2023-07-21T22:17:44.304356+0000","last_fullsized":"2023-07-21T22:17:44.304356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:00.392623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:58.295450+0000","last_change":"2023-07-21T22:17:08.854376+0000","last_active":"2023-07-21T22:17:58.295450+0000","last_peered":"2023-07-21T22:17:58.295450+0000","last_clean":"2023-07-21T22:17:58.295450+0000","last_became_active":"2023-07-21T22:17:08.854031+0000","last_became_peered":"2023-07-21T22:17:08.854031+0000","last_unstale":"2023-07-21T22:17:58.295450+0000","last_undegraded":"2023-07-21T22:17:58.295450+0000","last_fullsized":"2023-07-21T22:17:58.295450+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:12.749236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303992+0000","last_change":"2023-07-21T22:17:09.851279+0000","last_active":"2023-07-21T22:17:44.303992+0000","last_peered":"2023-07-21T22:17:44.303992+0000","last_clean":"2023-07-21T22:17:44.303992+0000","last_became_active":"2023-07-21T22:17:09.850948+0000","last_became_peered":"2023-07-21T22:17:09.850948+0000","last_unstale":"2023-07-21T22:17:44.303992+0000","last_undegraded":"2023-07-21T22:17:44.303992+0000","last_fullsized":"2023-07-21T22:17:44.303992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:10:00.991437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305069+0000","last_change":"2023-07-21T22:17:08.865425+0000","last_active":"2023-07-21T22:17:44.305069+0000","last_peered":"2023-07-21T22:17:44.305069+0000","last_clean":"2023-07-21T22:17:44.305069+0000","last_became_active":"2023-07-21T22:17:08.865067+0000","last_became_peered":"2023-07-21T22:17:08.865067+0000","last_unstale":"2023-07-21T22:17:44.305069+0000","last_undegraded":"2023-07-21T22:17:44.305069+0000","last_fullsized":"2023-07-21T22:17:44.305069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:55.543750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486350+0000","last_change":"2023-07-21T22:17:09.844916+0000","last_active":"2023-07-21T22:17:44.486350+0000","last_peered":"2023-07-21T22:17:44.486350+0000","last_clean":"2023-07-21T22:17:44.486350+0000","last_became_active":"2023-07-21T22:17:09.844632+0000","last_became_peered":"2023-07-21T22:17:09.844632+0000","last_unstale":"2023-07-21T22:17:44.486350+0000","last_undegraded":"2023-07-21T22:17:44.486350+0000","last_fullsized":"2023-07-21T22:17:44.486350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:32:46.857855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305478+0000","last_change":"2023-07-21T22:17:08.862954+0000","last_active":"2023-07-21T22:17:44.305478+0000","last_peered":"2023-07-21T22:17:44.305478+0000","last_clean":"2023-07-21T22:17:44.305478+0000","last_became_active":"2023-07-21T22:17:08.862598+0000","last_became_peered":"2023-07-21T22:17:08.862598+0000","last_unstale":"2023-07-21T22:17:44.305478+0000","last_undegraded":"2023-07-21T22:17:44.305478+0000","last_fullsized":"2023-07-21T22:17:44.305478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:02.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.488032+0000","last_change":"2023-07-21T22:17:44.488032+0000","last_active":"2023-07-21T22:17:44.488032+0000","last_peered":"2023-07-21T22:17:44.488032+0000","last_clean":"2023-07-21T22:17:44.488032+0000","last_became_active":"2023-07-21T22:17:44.487524+0000","last_became_peered":"2023-07-21T22:17:44.487524+0000","last_unstale":"2023-07-21T22:17:44.488032+0000","last_undegraded":"2023-07-21T22:17:44.488032+0000","last_fullsized":"2023-07-21T22:17:44.488032+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:01.489283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302366+0000","last_change":"2023-07-21T22:17:08.862514+0000","last_active":"2023-07-21T22:17:44.302366+0000","last_peered":"2023-07-21T22:17:44.302366+0000","last_clean":"2023-07-21T22:17:44.302366+0000","last_became_active":"2023-07-21T22:17:08.862223+0000","last_became_peered":"2023-07-21T22:17:08.862223+0000","last_unstale":"2023-07-21T22:17:44.302366+0000","last_undegraded":"2023-07-21T22:17:44.302366+0000","last_fullsized":"2023-07-21T22:17:44.302366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:37:34.099818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302802+0000","last_change":"2023-07-21T22:17:09.852621+0000","last_active":"2023-07-21T22:17:44.302802+0000","last_peered":"2023-07-21T22:17:44.302802+0000","last_clean":"2023-07-21T22:17:44.302802+0000","last_became_active":"2023-07-21T22:17:09.852233+0000","last_became_peered":"2023-07-21T22:17:09.852233+0000","last_unstale":"2023-07-21T22:17:44.302802+0000","last_undegraded":"2023-07-21T22:17:44.302802+0000","last_fullsized":"2023-07-21T22:17:44.302802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:17.187991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304312+0000","last_change":"2023-07-21T22:17:08.861344+0000","last_active":"2023-07-21T22:17:44.304312+0000","last_peered":"2023-07-21T22:17:44.304312+0000","last_clean":"2023-07-21T22:17:44.304312+0000","last_became_active":"2023-07-21T22:17:08.860978+0000","last_became_peered":"2023-07-21T22:17:08.860978+0000","last_unstale":"2023-07-21T22:17:44.304312+0000","last_undegraded":"2023-07-21T22:17:44.304312+0000","last_fullsized":"2023-07-21T22:17:44.304312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:21.901465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302315+0000","last_change":"2023-07-21T22:17:09.852314+0000","last_active":"2023-07-21T22:17:44.302315+0000","last_peered":"2023-07-21T22:17:44.302315+0000","last_clean":"2023-07-21T22:17:44.302315+0000","last_became_active":"2023-07-21T22:17:09.852137+0000","last_became_peered":"2023-07-21T22:17:09.852137+0000","last_unstale":"2023-07-21T22:17:44.302315+0000","last_undegraded":"2023-07-21T22:17:44.302315+0000","last_fullsized":"2023-07-21T22:17:44.302315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:02.728732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486194+0000","last_change":"2023-07-21T22:17:09.839387+0000","last_active":"2023-07-21T22:17:44.486194+0000","last_peered":"2023-07-21T22:17:44.486194+0000","last_clean":"2023-07-21T22:17:44.486194+0000","last_became_active":"2023-07-21T22:17:09.839052+0000","last_became_peered":"2023-07-21T22:17:09.839052+0000","last_unstale":"2023-07-21T22:17:44.486194+0000","last_undegraded":"2023-07-21T22:17:44.486194+0000","last_fullsized":"2023-07-21T22:17:44.486194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:00.416159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":69,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:00.298251+0000","last_change":"2023-07-21T22:17:08.859465+0000","last_active":"2023-07-21T22:18:00.298251+0000","last_peered":"2023-07-21T22:18:00.298251+0000","last_clean":"2023-07-21T22:18:00.298251+0000","last_became_active":"2023-07-21T22:17:08.859076+0000","last_became_peered":"2023-07-21T22:17:08.859076+0000","last_unstale":"2023-07-21T22:18:00.298251+0000","last_undegraded":"2023-07-21T22:18:00.298251+0000","last_fullsized":"2023-07-21T22:18:00.298251+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:23.451233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":47,"num_read_kb":47,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303499+0000","last_change":"2023-07-21T22:17:09.846937+0000","last_active":"2023-07-21T22:17:44.303499+0000","last_peered":"2023-07-21T22:17:44.303499+0000","last_clean":"2023-07-21T22:17:44.303499+0000","last_became_active":"2023-07-21T22:17:09.846638+0000","last_became_peered":"2023-07-21T22:17:09.846638+0000","last_unstale":"2023-07-21T22:17:44.303499+0000","last_undegraded":"2023-07-21T22:17:44.303499+0000","last_fullsized":"2023-07-21T22:17:44.303499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:17.574718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487106+0000","last_change":"2023-07-21T22:17:08.860388+0000","last_active":"2023-07-21T22:17:44.487106+0000","last_peered":"2023-07-21T22:17:44.487106+0000","last_clean":"2023-07-21T22:17:44.487106+0000","last_became_active":"2023-07-21T22:17:08.860039+0000","last_became_peered":"2023-07-21T22:17:08.860039+0000","last_unstale":"2023-07-21T22:17:44.487106+0000","last_undegraded":"2023-07-21T22:17:44.487106+0000","last_fullsized":"2023-07-21T22:17:44.487106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:34.981385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304109+0000","last_change":"2023-07-21T22:15:51.342448+0000","last_active":"2023-07-21T22:17:44.304109+0000","last_peered":"2023-07-21T22:17:44.304109+0000","last_clean":"2023-07-21T22:17:44.304109+0000","last_became_active":"2023-07-21T22:15:51.342004+0000","last_became_peered":"2023-07-21T22:15:51.342004+0000","last_unstale":"2023-07-21T22:17:44.304109+0000","last_undegraded":"2023-07-21T22:17:44.304109+0000","last_fullsized":"2023-07-21T22:17:44.304109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_clean_scrub_stamp":"2023-07-21T22:12:15.345227+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:29.784967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299632+0000","last_change":"2023-07-21T22:17:09.838402+0000","last_active":"2023-07-21T22:17:44.299632+0000","last_peered":"2023-07-21T22:17:44.299632+0000","last_clean":"2023-07-21T22:17:44.299632+0000","last_became_active":"2023-07-21T22:17:09.838096+0000","last_became_peered":"2023-07-21T22:17:09.838096+0000","last_unstale":"2023-07-21T22:17:44.299632+0000","last_undegraded":"2023-07-21T22:17:44.299632+0000","last_fullsized":"2023-07-21T22:17:44.299632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:37.376969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304274+0000","last_change":"2023-07-21T22:17:08.865676+0000","last_active":"2023-07-21T22:17:44.304274+0000","last_peered":"2023-07-21T22:17:44.304274+0000","last_clean":"2023-07-21T22:17:44.304274+0000","last_became_active":"2023-07-21T22:17:08.865370+0000","last_became_peered":"2023-07-21T22:17:08.865370+0000","last_unstale":"2023-07-21T22:17:44.304274+0000","last_undegraded":"2023-07-21T22:17:44.304274+0000","last_fullsized":"2023-07-21T22:17:44.304274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:36.039312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304666+0000","last_change":"2023-07-21T22:17:08.864487+0000","last_active":"2023-07-21T22:17:44.304666+0000","last_peered":"2023-07-21T22:17:44.304666+0000","last_clean":"2023-07-21T22:17:44.304666+0000","last_became_active":"2023-07-21T22:17:08.863943+0000","last_became_peered":"2023-07-21T22:17:08.863943+0000","last_unstale":"2023-07-21T22:17:44.304666+0000","last_undegraded":"2023-07-21T22:17:44.304666+0000","last_fullsized":"2023-07-21T22:17:44.304666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:00.454414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300048+0000","last_change":"2023-07-21T22:17:09.833812+0000","last_active":"2023-07-21T22:17:44.300048+0000","last_peered":"2023-07-21T22:17:44.300048+0000","last_clean":"2023-07-21T22:17:44.300048+0000","last_became_active":"2023-07-21T22:17:09.833496+0000","last_became_peered":"2023-07-21T22:17:09.833496+0000","last_unstale":"2023-07-21T22:17:44.300048+0000","last_undegraded":"2023-07-21T22:17:44.300048+0000","last_fullsized":"2023-07-21T22:17:44.300048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:32.258278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'5","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302555+0000","last_change":"2023-07-21T22:17:08.867858+0000","last_active":"2023-07-21T22:17:44.302555+0000","last_peered":"2023-07-21T22:17:44.302555+0000","last_clean":"2023-07-21T22:17:44.302555+0000","last_became_active":"2023-07-21T22:17:08.867468+0000","last_became_peered":"2023-07-21T22:17:08.867468+0000","last_unstale":"2023-07-21T22:17:44.302555+0000","last_undegraded":"2023-07-21T22:17:44.302555+0000","last_fullsized":"2023-07-21T22:17:44.302555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:52.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303919+0000","last_change":"2023-07-21T22:17:09.846988+0000","last_active":"2023-07-21T22:17:44.303919+0000","last_peered":"2023-07-21T22:17:44.303919+0000","last_clean":"2023-07-21T22:17:44.303919+0000","last_became_active":"2023-07-21T22:17:09.846686+0000","last_became_peered":"2023-07-21T22:17:09.846686+0000","last_unstale":"2023-07-21T22:17:44.303919+0000","last_undegraded":"2023-07-21T22:17:44.303919+0000","last_fullsized":"2023-07-21T22:17:44.303919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:48.205318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487213+0000","last_change":"2023-07-21T22:17:08.857694+0000","last_active":"2023-07-21T22:17:44.487213+0000","last_peered":"2023-07-21T22:17:44.487213+0000","last_clean":"2023-07-21T22:17:44.487213+0000","last_became_active":"2023-07-21T22:17:08.857356+0000","last_became_peered":"2023-07-21T22:17:08.857356+0000","last_unstale":"2023-07-21T22:17:44.487213+0000","last_undegraded":"2023-07-21T22:17:44.487213+0000","last_fullsized":"2023-07-21T22:17:44.487213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:39:39.361769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485692+0000","last_change":"2023-07-21T22:17:09.858500+0000","last_active":"2023-07-21T22:17:44.485692+0000","last_peered":"2023-07-21T22:17:44.485692+0000","last_clean":"2023-07-21T22:17:44.485692+0000","last_became_active":"2023-07-21T22:17:09.858009+0000","last_became_peered":"2023-07-21T22:17:09.858009+0000","last_unstale":"2023-07-21T22:17:44.485692+0000","last_undegraded":"2023-07-21T22:17:44.485692+0000","last_fullsized":"2023-07-21T22:17:44.485692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:19:05.454111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305503+0000","last_change":"2023-07-21T22:17:08.853732+0000","last_active":"2023-07-21T22:17:44.305503+0000","last_peered":"2023-07-21T22:17:44.305503+0000","last_clean":"2023-07-21T22:17:44.305503+0000","last_became_active":"2023-07-21T22:17:08.853397+0000","last_became_peered":"2023-07-21T22:17:08.853397+0000","last_unstale":"2023-07-21T22:17:44.305503+0000","last_undegraded":"2023-07-21T22:17:44.305503+0000","last_fullsized":"2023-07-21T22:17:44.305503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:18.249465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304237+0000","last_change":"2023-07-21T22:17:09.840836+0000","last_active":"2023-07-21T22:17:44.304237+0000","last_peered":"2023-07-21T22:17:44.304237+0000","last_clean":"2023-07-21T22:17:44.304237+0000","last_became_active":"2023-07-21T22:17:09.840463+0000","last_became_peered":"2023-07-21T22:17:09.840463+0000","last_unstale":"2023-07-21T22:17:44.304237+0000","last_undegraded":"2023-07-21T22:17:44.304237+0000","last_fullsized":"2023-07-21T22:17:44.304237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:24.284857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303419+0000","last_change":"2023-07-21T22:17:08.865129+0000","last_active":"2023-07-21T22:17:44.303419+0000","last_peered":"2023-07-21T22:17:44.303419+0000","last_clean":"2023-07-21T22:17:44.303419+0000","last_became_active":"2023-07-21T22:17:08.864820+0000","last_became_peered":"2023-07-21T22:17:08.864820+0000","last_unstale":"2023-07-21T22:17:44.303419+0000","last_undegraded":"2023-07-21T22:17:44.303419+0000","last_fullsized":"2023-07-21T22:17:44.303419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:07.661921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300707+0000","last_change":"2023-07-21T22:17:09.846804+0000","last_active":"2023-07-21T22:17:44.300707+0000","last_peered":"2023-07-21T22:17:44.300707+0000","last_clean":"2023-07-21T22:17:44.300707+0000","last_became_active":"2023-07-21T22:17:09.846390+0000","last_became_peered":"2023-07-21T22:17:09.846390+0000","last_unstale":"2023-07-21T22:17:44.300707+0000","last_undegraded":"2023-07-21T22:17:44.300707+0000","last_fullsized":"2023-07-21T22:17:44.300707+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:42.837431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.317619+0000","last_change":"2023-07-21T22:17:44.317155+0000","last_active":"2023-07-21T22:17:44.317619+0000","last_peered":"2023-07-21T22:17:44.317619+0000","last_clean":"2023-07-21T22:17:44.317619+0000","last_became_active":"2023-07-21T22:17:44.307394+0000","last_became_peered":"2023-07-21T22:17:44.307394+0000","last_unstale":"2023-07-21T22:17:44.317619+0000","last_undegraded":"2023-07-21T22:17:44.317619+0000","last_fullsized":"2023-07-21T22:17:44.317619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:59.993004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303309+0000","last_change":"2023-07-21T22:17:09.849197+0000","last_active":"2023-07-21T22:17:44.303309+0000","last_peered":"2023-07-21T22:17:44.303309+0000","last_clean":"2023-07-21T22:17:44.303309+0000","last_became_active":"2023-07-21T22:17:09.848835+0000","last_became_peered":"2023-07-21T22:17:09.848835+0000","last_unstale":"2023-07-21T22:17:44.303309+0000","last_undegraded":"2023-07-21T22:17:44.303309+0000","last_fullsized":"2023-07-21T22:17:44.303309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:22.001862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.314830+0000","last_change":"2023-07-21T22:17:44.314329+0000","last_active":"2023-07-21T22:17:44.314830+0000","last_peered":"2023-07-21T22:17:44.314830+0000","last_clean":"2023-07-21T22:17:44.314830+0000","last_became_active":"2023-07-21T22:17:44.307075+0000","last_became_peered":"2023-07-21T22:17:44.307075+0000","last_unstale":"2023-07-21T22:17:44.314830+0000","last_undegraded":"2023-07-21T22:17:44.314830+0000","last_fullsized":"2023-07-21T22:17:44.314830+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:28.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304997+0000","last_change":"2023-07-21T22:17:09.847279+0000","last_active":"2023-07-21T22:17:44.304997+0000","last_peered":"2023-07-21T22:17:44.304997+0000","last_clean":"2023-07-21T22:17:44.304997+0000","last_became_active":"2023-07-21T22:17:09.846982+0000","last_became_peered":"2023-07-21T22:17:09.846982+0000","last_unstale":"2023-07-21T22:17:44.304997+0000","last_undegraded":"2023-07-21T22:17:44.304997+0000","last_fullsized":"2023-07-21T22:17:44.304997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:14.985134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304706+0000","last_change":"2023-07-21T22:17:08.857436+0000","last_active":"2023-07-21T22:17:44.304706+0000","last_peered":"2023-07-21T22:17:44.304706+0000","last_clean":"2023-07-21T22:17:44.304706+0000","last_became_active":"2023-07-21T22:17:08.857046+0000","last_became_peered":"2023-07-21T22:17:08.857046+0000","last_unstale":"2023-07-21T22:17:44.304706+0000","last_undegraded":"2023-07-21T22:17:44.304706+0000","last_fullsized":"2023-07-21T22:17:44.304706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:23.427814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304736+0000","last_change":"2023-07-21T22:17:09.852916+0000","last_active":"2023-07-21T22:17:44.304736+0000","last_peered":"2023-07-21T22:17:44.304736+0000","last_clean":"2023-07-21T22:17:44.304736+0000","last_became_active":"2023-07-21T22:17:09.852608+0000","last_became_peered":"2023-07-21T22:17:09.852608+0000","last_unstale":"2023-07-21T22:17:44.304736+0000","last_undegraded":"2023-07-21T22:17:44.304736+0000","last_fullsized":"2023-07-21T22:17:44.304736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:21.187686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486196+0000","last_change":"2023-07-21T22:17:08.859619+0000","last_active":"2023-07-21T22:17:44.486196+0000","last_peered":"2023-07-21T22:17:44.486196+0000","last_clean":"2023-07-21T22:17:44.486196+0000","last_became_active":"2023-07-21T22:17:08.859256+0000","last_became_peered":"2023-07-21T22:17:08.859256+0000","last_unstale":"2023-07-21T22:17:44.486196+0000","last_undegraded":"2023-07-21T22:17:44.486196+0000","last_fullsized":"2023-07-21T22:17:44.486196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:49.010457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304804+0000","last_change":"2023-07-21T22:17:09.850548+0000","last_active":"2023-07-21T22:17:44.304804+0000","last_peered":"2023-07-21T22:17:44.304804+0000","last_clean":"2023-07-21T22:17:44.304804+0000","last_became_active":"2023-07-21T22:17:09.850261+0000","last_became_peered":"2023-07-21T22:17:09.850261+0000","last_unstale":"2023-07-21T22:17:44.304804+0000","last_undegraded":"2023-07-21T22:17:44.304804+0000","last_fullsized":"2023-07-21T22:17:44.304804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:05.546844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299865+0000","last_change":"2023-07-21T22:17:08.859729+0000","last_active":"2023-07-21T22:17:44.299865+0000","last_peered":"2023-07-21T22:17:44.299865+0000","last_clean":"2023-07-21T22:17:44.299865+0000","last_became_active":"2023-07-21T22:17:08.859421+0000","last_became_peered":"2023-07-21T22:17:08.859421+0000","last_unstale":"2023-07-21T22:17:44.299865+0000","last_undegraded":"2023-07-21T22:17:44.299865+0000","last_fullsized":"2023-07-21T22:17:44.299865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:21.189655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304610+0000","last_change":"2023-07-21T22:17:09.846413+0000","last_active":"2023-07-21T22:17:44.304610+0000","last_peered":"2023-07-21T22:17:44.304610+0000","last_clean":"2023-07-21T22:17:44.304610+0000","last_became_active":"2023-07-21T22:17:09.846038+0000","last_became_peered":"2023-07-21T22:17:09.846038+0000","last_unstale":"2023-07-21T22:17:44.304610+0000","last_undegraded":"2023-07-21T22:17:44.304610+0000","last_fullsized":"2023-07-21T22:17:44.304610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:08.536390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300763+0000","last_change":"2023-07-21T22:17:09.846786+0000","last_active":"2023-07-21T22:17:44.300763+0000","last_peered":"2023-07-21T22:17:44.300763+0000","last_clean":"2023-07-21T22:17:44.300763+0000","last_became_active":"2023-07-21T22:17:09.846437+0000","last_became_peered":"2023-07-21T22:17:09.846437+0000","last_unstale":"2023-07-21T22:17:44.300763+0000","last_undegraded":"2023-07-21T22:17:44.300763+0000","last_fullsized":"2023-07-21T22:17:44.300763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:38.254130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487796+0000","last_change":"2023-07-21T22:17:44.487796+0000","last_active":"2023-07-21T22:17:44.487796+0000","last_peered":"2023-07-21T22:17:44.487796+0000","last_clean":"2023-07-21T22:17:44.487796+0000","last_became_active":"2023-07-21T22:17:44.487278+0000","last_became_peered":"2023-07-21T22:17:44.487278+0000","last_unstale":"2023-07-21T22:17:44.487796+0000","last_undegraded":"2023-07-21T22:17:44.487796+0000","last_fullsized":"2023-07-21T22:17:44.487796+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:36.983831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303762+0000","last_change":"2023-07-21T22:17:09.850137+0000","last_active":"2023-07-21T22:17:44.303762+0000","last_peered":"2023-07-21T22:17:44.303762+0000","last_clean":"2023-07-21T22:17:44.303762+0000","last_became_active":"2023-07-21T22:17:09.849721+0000","last_became_peered":"2023-07-21T22:17:09.849721+0000","last_unstale":"2023-07-21T22:17:44.303762+0000","last_undegraded":"2023-07-21T22:17:44.303762+0000","last_fullsized":"2023-07-21T22:17:44.303762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:42.785707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485296+0000","last_change":"2023-07-21T22:17:09.858573+0000","last_active":"2023-07-21T22:17:44.485296+0000","last_peered":"2023-07-21T22:17:44.485296+0000","last_clean":"2023-07-21T22:17:44.485296+0000","last_became_active":"2023-07-21T22:17:09.858017+0000","last_became_peered":"2023-07-21T22:17:09.858017+0000","last_unstale":"2023-07-21T22:17:44.485296+0000","last_undegraded":"2023-07-21T22:17:44.485296+0000","last_fullsized":"2023-07-21T22:17:44.485296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:20.029025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486812+0000","last_change":"2023-07-21T22:17:44.486812+0000","last_active":"2023-07-21T22:17:44.486812+0000","last_peered":"2023-07-21T22:17:44.486812+0000","last_clean":"2023-07-21T22:17:44.486812+0000","last_became_active":"2023-07-21T22:17:44.486392+0000","last_became_peered":"2023-07-21T22:17:44.486392+0000","last_unstale":"2023-07-21T22:17:44.486812+0000","last_undegraded":"2023-07-21T22:17:44.486812+0000","last_fullsized":"2023-07-21T22:17:44.486812+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:12.827232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300834+0000","last_change":"2023-07-21T22:17:09.845251+0000","last_active":"2023-07-21T22:17:44.300834+0000","last_peered":"2023-07-21T22:17:44.300834+0000","last_clean":"2023-07-21T22:17:44.300834+0000","last_became_active":"2023-07-21T22:17:09.844945+0000","last_became_peered":"2023-07-21T22:17:09.844945+0000","last_unstale":"2023-07-21T22:17:44.300834+0000","last_undegraded":"2023-07-21T22:17:44.300834+0000","last_fullsized":"2023-07-21T22:17:44.300834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:50.719284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304475+0000","last_change":"2023-07-21T22:17:09.850953+0000","last_active":"2023-07-21T22:17:44.304475+0000","last_peered":"2023-07-21T22:17:44.304475+0000","last_clean":"2023-07-21T22:17:44.304475+0000","last_became_active":"2023-07-21T22:17:09.850627+0000","last_became_peered":"2023-07-21T22:17:09.850627+0000","last_unstale":"2023-07-21T22:17:44.304475+0000","last_undegraded":"2023-07-21T22:17:44.304475+0000","last_fullsized":"2023-07-21T22:17:44.304475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:01:24.705224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303842+0000","last_change":"2023-07-21T22:17:09.841222+0000","last_active":"2023-07-21T22:17:44.303842+0000","last_peered":"2023-07-21T22:17:44.303842+0000","last_clean":"2023-07-21T22:17:44.303842+0000","last_became_active":"2023-07-21T22:17:09.840864+0000","last_became_peered":"2023-07-21T22:17:09.840864+0000","last_unstale":"2023-07-21T22:17:44.303842+0000","last_undegraded":"2023-07-21T22:17:44.303842+0000","last_fullsized":"2023-07-21T22:17:44.303842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:23.181094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485967+0000","last_change":"2023-07-21T22:17:09.837688+0000","last_active":"2023-07-21T22:17:44.485967+0000","last_peered":"2023-07-21T22:17:44.485967+0000","last_clean":"2023-07-21T22:17:44.485967+0000","last_became_active":"2023-07-21T22:17:09.837325+0000","last_became_peered":"2023-07-21T22:17:09.837325+0000","last_unstale":"2023-07-21T22:17:44.485967+0000","last_undegraded":"2023-07-21T22:17:44.485967+0000","last_fullsized":"2023-07-21T22:17:44.485967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:06:00.041198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302967+0000","last_change":"2023-07-21T22:17:09.843791+0000","last_active":"2023-07-21T22:17:44.302967+0000","last_peered":"2023-07-21T22:17:44.302967+0000","last_clean":"2023-07-21T22:17:44.302967+0000","last_became_active":"2023-07-21T22:17:09.843438+0000","last_became_peered":"2023-07-21T22:17:09.843438+0000","last_unstale":"2023-07-21T22:17:44.302967+0000","last_undegraded":"2023-07-21T22:17:44.302967+0000","last_fullsized":"2023-07-21T22:17:44.302967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:10:55.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305731+0000","last_change":"2023-07-21T22:17:09.849062+0000","last_active":"2023-07-21T22:17:44.305731+0000","last_peered":"2023-07-21T22:17:44.305731+0000","last_clean":"2023-07-21T22:17:44.305731+0000","last_became_active":"2023-07-21T22:17:09.848153+0000","last_became_peered":"2023-07-21T22:17:09.848153+0000","last_unstale":"2023-07-21T22:17:44.305731+0000","last_undegraded":"2023-07-21T22:17:44.305731+0000","last_fullsized":"2023-07-21T22:17:44.305731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:30.677689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299885+0000","last_change":"2023-07-21T22:17:09.849010+0000","last_active":"2023-07-21T22:17:44.299885+0000","last_peered":"2023-07-21T22:17:44.299885+0000","last_clean":"2023-07-21T22:17:44.299885+0000","last_became_active":"2023-07-21T22:17:09.848679+0000","last_became_peered":"2023-07-21T22:17:09.848679+0000","last_unstale":"2023-07-21T22:17:44.299885+0000","last_undegraded":"2023-07-21T22:17:44.299885+0000","last_fullsized":"2023-07-21T22:17:44.299885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:40.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300645+0000","last_change":"2023-07-21T22:17:09.846419+0000","last_active":"2023-07-21T22:17:44.300645+0000","last_peered":"2023-07-21T22:17:44.300645+0000","last_clean":"2023-07-21T22:17:44.300645+0000","last_became_active":"2023-07-21T22:17:09.846037+0000","last_became_peered":"2023-07-21T22:17:09.846037+0000","last_unstale":"2023-07-21T22:17:44.300645+0000","last_undegraded":"2023-07-21T22:17:44.300645+0000","last_fullsized":"2023-07-21T22:17:44.300645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:33:14.382111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248938,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60730,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":294,"num_read_kb":210,"num_write":149,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":182190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383704,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":456133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42299999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.76800000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.86299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.91800000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.628}]},{"osd":7,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.80700000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]},{"osd":9,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.82199999999999995},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.84299999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.90000000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645342,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1089536,"data_stored":1104788,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.101,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.048,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.70199999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89100000000000001,"15min":0.88300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.3739999999999997,"5min":4.3739999999999997,"15min":4.3739999999999997},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.52600000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":4.5439999999999996,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":0.63}]},{"osd":4,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78100000000000003,"15min":0.79300000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.379,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98599999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.54100000000000004}]},{"osd":5,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86799999999999999,"15min":0.872},"min":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0589999999999999,"5min":1.224,"15min":1.224},"last":0.878},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.93700000000000006,"15min":0.95699999999999996},"min":{"1min":0.61099999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0389999999999999,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.78000000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.026,"15min":1.0189999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":4.6600000000000001,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.93300000000000005,"15min":0.92100000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.80100000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.63800000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.97599999999999998,"15min":0.99299999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.123,"5min":1.431,"15min":1.431},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.998,"15min":1.0169999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2070000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":1}]},{"osd":9,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.012,"15min":1.0049999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.3719999999999999,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":0.89600000000000002},{"interface":"front","average":{"1min":1,"5min":1.0389999999999999,"15min":1.0449999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.94999999999999996}]},{"osd":11,"last update":"Fri Jul 21 22:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.93300000000000005},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.052}]}]},{"osd":9,"up_from":67,"seq":287762808866,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.55500000000000005,"15min":0.57099999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.73999999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.44900000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.83099999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.84899999999999998,"15min":0.875},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.873,"5min":1.393,"15min":1.393},"last":0.626}]},{"osd":2,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.999},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.81899999999999995,"15min":0.83799999999999997},"min":{"1min":0.58399999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95099999999999996,"5min":1.335,"15min":1.335},"last":0.89700000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.74099999999999999,"15min":0.77300000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.877,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.097,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.88100000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.86099999999999999,"15min":0.88500000000000001},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.96499999999999997,"5min":1.464,"15min":1.464},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.88100000000000001,"15min":0.90800000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.3,"15min":1.3},"last":0.85299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.56799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.012,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.754,"5min":0.86499999999999999,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.095,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":1.016}]},{"osd":6,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.82999999999999996,"15min":0.85699999999999998},"min":{"1min":0.497,"5min":0.441,"15min":0.441},"max":{"1min":1.0620000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.94299999999999995},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.93000000000000005,"15min":0.95899999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.95099999999999996,"5min":1.431,"15min":1.431},"last":0.56299999999999994}]},{"osd":7,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.97099999999999997,"15min":1.0049999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.05,"5min":1.696,"15min":1.696},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.97499999999999998,"15min":1.0029999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.131,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.97699999999999998}]},{"osd":8,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.997,"15min":1.022},"min":{"1min":0.68300000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.0249999999999999,"5min":1.496,"15min":1.496},"last":0.92800000000000005},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.99299999999999999,"15min":1.0189999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.083,"5min":1.667,"15min":1.667},"last":0.98899999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:17:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.96199999999999997},"min":{"1min":0.71199999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.98899999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.95099999999999996,"15min":0.96499999999999997},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1870000000000001,"5min":1.264,"15min":1.264},"last":0.95799999999999996}]}]},{"osd":8,"up_from":59,"seq":253403070504,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.69299999999999995,"15min":0.70499999999999996},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86199999999999999,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.85099999999999998,"5min":0.95799999999999996,"15min":0.95799999999999996},"last":0.93999999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.72399999999999998,"15min":0.73199999999999998},"min":{"1min":0.44800000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93799999999999994,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.69099999999999995,"5min":0.76800000000000002,"15min":0.78100000000000003},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.081,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":1.0289999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.64500000000000002,"15min":0.65600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88100000000000001,"5min":1.056,"15min":1.056},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.64700000000000002,"15min":0.66500000000000004},"min":{"1min":0.36599999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.94199999999999995,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.84499999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.71199999999999997,"5min":0.79200000000000004,"15min":0.80600000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.081,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.69199999999999995,"5min":0.745,"15min":0.754},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.94499999999999995,"5min":0.995,"15min":0.995},"last":1.054}]},{"osd":4,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72299999999999998,"5min":0.79900000000000004,"15min":0.81100000000000005},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.88900000000000001,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.82699999999999996,"15min":0.84399999999999997},"min":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.03,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.107}]},{"osd":5,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.46000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.95399999999999996,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.751,"15min":0.77200000000000002},"min":{"1min":0.434,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98699999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.87}]},{"osd":6,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75900000000000001,"5min":0.88300000000000001,"15min":0.90400000000000003},"min":{"1min":0.57799999999999996,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.165,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.1950000000000001},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.92200000000000004,"15min":0.94099999999999995},"min":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.1020000000000001,"5min":1.282,"15min":1.282},"last":1.1799999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.89500000000000002,"15min":0.91100000000000003},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.0660000000000001,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.0820000000000001},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.91500000000000004,"15min":0.92900000000000005},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":1.246,"5min":1.321,"15min":1.321},"last":1.155}]},{"osd":9,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":1.2989999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.2070000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.74299999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.2190000000000001,"5min":1.254,"15min":1.254},"last":1.2509999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.755,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.125}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":7,"up_from":51,"seq":219043332141,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":1003520,"data_stored":1047797,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89900000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.65100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90000000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.68000000000000005},"min":{"1min":0.48199999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.77700000000000002,"15min":0.73599999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.1669999999999998,"5min":4.1669999999999998,"15min":4.1669999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.76200000000000001,"15min":0.72499999999999998},"min":{"1min":0.56000000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0129999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.624}]},{"osd":6,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.82799999999999996,"15min":0.78200000000000003},"min":{"1min":0.52500000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.1479999999999997,"5min":7.1479999999999997,"15min":7.1479999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.222,"5min":0.89500000000000002,"15min":0.84099999999999997},"min":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":9.1110000000000007,"5min":9.1110000000000007,"15min":9.1110000000000007},"last":0.74099999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84099999999999997,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.79100000000000004}]},{"osd":9,"last update":"Fri Jul 21 22:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0880000000000001,"5min":1.119,"15min":1.119},"last":0.95699999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.625,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.93600000000000005,"15min":0.94499999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495667,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":455764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47299999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.503,"15min":0.503},"min":{"1min":0.34399999999999997,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.73299999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.65600000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.70999999999999996,"15min":0.70399999999999996},"min":{"1min":0.41399999999999998,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.88800000000000001,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":0.878},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.70599999999999996,"15min":0.71799999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":0.874,"5min":1.143,"15min":1.143},"last":0.76700000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.68300000000000005,"15min":0.69099999999999995},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.83899999999999997,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.81799999999999995},{"interface":"front","average":{"1min":0.70999999999999996,"5min":0.70899999999999996,"15min":0.71099999999999997},"min":{"1min":0.51800000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.98899999999999999,"5min":0.98899999999999999,"15min":0.98899999999999999},"last":0.78300000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.57099999999999995,"15min":0.57199999999999995},"min":{"1min":0.40600000000000003,"5min":0.309,"15min":0.309},"max":{"1min":1.0049999999999999,"5min":1.075,"15min":1.075},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.621,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.372,"15min":0.372},"max":{"1min":0.76600000000000001,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.70899999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.71299999999999997,"15min":0.72999999999999998},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85099999999999998,"5min":1.25,"15min":1.25},"last":0.90100000000000002},{"interface":"front","average":{"1min":0.71399999999999997,"5min":0.77700000000000002,"15min":0.76300000000000001},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.92400000000000004,"5min":3.8759999999999999,"15min":3.8759999999999999},"last":0.92900000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.77600000000000002,"15min":0.78700000000000003},"min":{"1min":0.52800000000000002,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.5800000000000001,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.76200000000000001,"15min":0.77400000000000002},"min":{"1min":0.52100000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.107,"5min":1.107,"15min":1.107},"last":0.96599999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.75700000000000001,"15min":0.73199999999999998},"min":{"1min":0.60099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.284,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.998},{"interface":"front","average":{"1min":0.747,"5min":0.755,"15min":0.751},"min":{"1min":0.61199999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.002,"5min":1.071,"15min":1.071},"last":0.91500000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.81999999999999995,"15min":0.82399999999999995},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":0.98499999999999999,"5min":1.2190000000000001,"15min":1.2190000000000001},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.82799999999999996,"15min":0.81000000000000005},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":4.0119999999999996,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.98799999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":1.0069999999999999},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.86499999999999999,"15min":0.878},"min":{"1min":0.56000000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1200000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.95699999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:17:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3480000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":1.018},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.876,"15min":0.88600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0449999999999999,"5min":1.196,"15min":1.196},"last":0.94599999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":999424,"data_stored":512104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.48899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84299999999999997,"5min":0.98599999999999999,"15min":1.0620000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.59499999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.46200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.91900000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.70599999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72999999999999998,"15min":0.68999999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86299999999999999,"5min":7.2720000000000002,"15min":7.2720000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.53700000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.51400000000000001,"15min":0.47999999999999998},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.80100000000000005},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.497},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78300000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.81399999999999995}]},{"osd":5,"last update":"Fri Jul 21 22:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.67100000000000004,"15min":0.65800000000000003},"min":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":1.016},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.69899999999999995,"15min":0.66500000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.84399999999999997}]},{"osd":6,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.74399999999999999,"15min":0.72099999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0189999999999999,"5min":1.036,"15min":1.036},"last":0.89500000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79500000000000004,"15min":0.74099999999999999},"min":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":0.93500000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96899999999999997,"5min":1.03,"15min":1.03},"last":0.872},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91700000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":1.0860000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.79500000000000004,"15min":0.78300000000000003},"min":{"1min":0.67200000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.97399999999999998},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.84899999999999998,"15min":0.81499999999999995},"min":{"1min":0.79900000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.96199999999999997}]},{"osd":9,"last update":"Fri Jul 21 22:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83899999999999997,"15min":0.83199999999999996},"min":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":1.0329999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.0980000000000001,"15min":1.1439999999999999},"min":{"1min":0.65800000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97499999999999998,"5min":7.4530000000000003,"15min":7.4530000000000003},"last":0.99299999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:17:51 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":1.075},{"interface":"front","average":{"1min":1,"5min":0.92400000000000004,"15min":0.91100000000000003},"min":{"1min":0.78500000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.006}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0489999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":457029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91400000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.64100000000000001},"min":{"1min":0.50800000000000001,"5min":0.44,"15min":0.432},"max":{"1min":1.002,"5min":1.244,"15min":1.244},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:17:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.64700000000000002,"15min":0.60299999999999998},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.46100000000000002},"min":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.313},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64600000000000002,"15min":0.60399999999999998},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97499999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.499,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.012,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.60099999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97599999999999998,"5min":1.508,"15min":1.508},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":1.335,"15min":1.335},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:17:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.95499999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.751}]},{"osd":8,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.61399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88200000000000001,"5min":1.163,"15min":1.163},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.66000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.72499999999999998}]},{"osd":9,"last update":"Fri Jul 21 22:17:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.871,"15min":0.89400000000000002},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0369999999999999,"5min":1.198,"15min":1.198},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0800000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.88900000000000001,"15min":0.90300000000000002},"min":{"1min":0.57899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":1.2370000000000001,"15min":1.304},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4259999999999999,"5min":7.5209999999999999,"15min":7.5209999999999999},"last":0.77700000000000002}]},{"osd":11,"last update":"Fri Jul 21 22:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.753}]}]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":1024000,"data_stored":513406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98699999999999999,"5min":1.278,"15min":1.278},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0740000000000001,"5min":1.345,"15min":1.345},"last":0.80100000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68000000000000005,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.90800000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68100000000000005,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.67300000000000004},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.71699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.86399999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60199999999999998,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80500000000000005,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.55500000000000005},"min":{"1min":0.38800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93700000000000006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.89300000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.82599999999999996}]},{"osd":7,"last update":"Fri Jul 21 22:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60999999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:16:56 2023","interfaces":[{"interface":"back","average":{"1min":0.82099999999999995,"5min":0.82799999999999996,"15min":0.82899999999999996},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.286,"5min":1.409,"15min":1.409},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.181,"5min":1.181,"15min":1.181},"last":0.67200000000000004}]},{"osd":9,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.29,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.97899999999999998,"15min":0.98799999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.879}]},{"osd":10,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.88100000000000001,"15min":0.879},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.91800000000000004},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.92900000000000005,"15min":0.93600000000000005},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.84999999999999998}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]}]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":456081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.45700000000000002,"15min":0.41599999999999998},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.499,"15min":0.443},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.69299999999999995}]},{"osd":1,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.60499999999999998},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.76000000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.71599999999999997,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.70599999999999996,"15min":0.65000000000000002},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.89600000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.745,"15min":0.69099999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97099999999999997,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.96899999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70199999999999996,"15min":0.68300000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.88600000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.75700000000000001,"15min":0.72199999999999998},"min":{"1min":0.52400000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.93400000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.71699999999999997,"15min":0.69099999999999995},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1739999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":1.0109999999999999},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.71899999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.995,"15min":1.0620000000000001},"min":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.0499999999999998,"5min":6.9740000000000002,"15min":6.9740000000000002},"last":1.022},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.0229999999999999,"15min":1.1000000000000001},"min":{"1min":0.60599999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.8069999999999999,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.91900000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.1140000000000001,"15min":1.157},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.083,"5min":7.0030000000000001,"15min":7.0030000000000001},"last":0.629},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1080000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73499999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.93200000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2450000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.98899999999999999},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.88300000000000001,"15min":0.90000000000000002},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.048,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":1}]},{"osd":10,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97899999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":1.052},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":1.0629999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95499999999999996}]}]},{"osd":4,"up_from":33,"seq":141733920830,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":456537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.873,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.46500000000000002,"15min":0.42799999999999999},"min":{"1min":0.35899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67100000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.49199999999999999,"15min":0.44900000000000001},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.65500000000000003}]},{"osd":2,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.64700000000000002},"min":{"1min":0.56299999999999994,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70499999999999996,"15min":0.65900000000000003},"min":{"1min":0.57199999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.76200000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64300000000000002,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.95299999999999996,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67100000000000004,"15min":0.62},"min":{"1min":0.437,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0329999999999999,"5min":1.236,"15min":1.236},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.75800000000000001,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.165,"5min":1.194,"15min":1.194},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.76600000000000001,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1739999999999999,"5min":1.175,"15min":1.175},"last":0.90200000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:17:02 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.76000000000000001,"15min":0.73799999999999999},"min":{"1min":0.56699999999999995,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0740000000000001,"5min":1.093,"15min":1.093},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.83399999999999996,"5min":0.80000000000000004,"15min":0.79700000000000004},"min":{"1min":0.64600000000000002,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0529999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.55300000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98599999999999999,"5min":1.127,"15min":1.127},"last":0.505},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71399999999999997,"15min":0.67600000000000005},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0349999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.80600000000000005}]},{"osd":8,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.624,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0529999999999999,"5min":1.165,"15min":1.165},"last":0.877},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.224,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.95099999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89900000000000002,"15min":0.89700000000000002},"min":{"1min":0.61199999999999999,"5min":0.503,"15min":0.503},"max":{"1min":1.1890000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.86699999999999999,"15min":0.876},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.995,"5min":1.21,"15min":1.21},"last":0.69399999999999995}]},{"osd":10,"last update":"Fri Jul 21 22:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92700000000000005,"15min":0.93899999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.21,"5min":1.327,"15min":1.327},"last":0.621},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":0.998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2889999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":1.0129999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]}]},{"osd":5,"up_from":38,"seq":163208757304,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":1047470,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40799999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79000000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76300000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.59299999999999997},"min":{"1min":0.436,"5min":0.374,"15min":0.374},"max":{"1min":0.92000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.65100000000000002},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95399999999999996,"5min":6.9340000000000002,"15min":6.9340000000000002},"last":0.85499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.5,"15min":0.47899999999999998},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53600000000000003,"15min":0.502},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.879,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.70299999999999996,"15min":0.65500000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":6.9160000000000004,"15min":6.9160000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78800000000000003,"5min":7.0129999999999999,"15min":7.0129999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.435,"15min":0.435},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.46800000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.94099999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.78100000000000003,"15min":0.73499999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.873,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80300000000000005,"15min":0.80100000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.59399999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.79200000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76400000000000001,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.071,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.873}]},{"osd":9,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.83399999999999996,"15min":0.84599999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83799999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.878,"15min":0.879},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86599999999999999,"15min":0.86799999999999999},"min":{"1min":0.64500000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:05.259 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph pg dump --format=json 2023-07-21T22:18:05.984 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:06.618 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:06 smithi151 ceph-mon[95510]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:06.619 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:06 smithi151 ceph-mon[95510]: pgmap v328: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T22:18:06.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:06 smithi195 ceph-mon[97365]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:06.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:06 smithi195 ceph-mon[97365]: pgmap v328: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T22:18:06.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:06 smithi187 ceph-mon[96918]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:06.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:06 smithi187 ceph-mon[96918]: pgmap v328: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T22:18:07.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.534+0000 7f4d51b7a700 1 -- 172.21.15.151:0/1418348667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 msgr2=0x7f4d4c10ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:07.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.534+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/1418348667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 0x7f4d4c10ca20 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4d4400b0d0 tx=0x7f4d4400b3e0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.534+0000 7f4d51b7a700 1 -- 172.21.15.151:0/1418348667 shutdown_connections 2023-07-21T22:18:07.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.534+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/1418348667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 0x7f4d4c10ca20 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.534+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/1418348667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d4c0ffe00 0x7f4d4c1001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.534+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/1418348667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4c1007a0 0x7f4d4c104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.534+0000 7f4d51b7a700 1 -- 172.21.15.151:0/1418348667 >> 172.21.15.151:0/1418348667 conn(0x7f4d4c0fb660 msgr2=0x7f4d4c0fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:07.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.534+0000 7f4d51b7a700 1 -- 172.21.15.151:0/1418348667 shutdown_connections 2023-07-21T22:18:07.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.534+0000 7f4d51b7a700 1 -- 172.21.15.151:0/1418348667 wait complete. 2023-07-21T22:18:07.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.535+0000 7f4d51b7a700 1 Processor -- start 2023-07-21T22:18:07.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.535+0000 7f4d51b7a700 1 -- start start 2023-07-21T22:18:07.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d51b7a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d4c0ffe00 0x7f4d4c195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:07.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d51b7a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4c1007a0 0x7f4d4c1961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:07.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d51b7a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 0x7f4d4c1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:07.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d51b7a700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c199ba0 con 0x7f4d4c104ea0 2023-07-21T22:18:07.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d51b7a700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c199d10 con 0x7f4d4c1007a0 2023-07-21T22:18:07.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d51b7a700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d4c199ed0 con 0x7f4d4c0ffe00 2023-07-21T22:18:07.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 0x7f4d4c1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:07.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 0x7f4d4c1995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32888/0 (socket says 172.21.15.151:32888) 2023-07-21T22:18:07.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4bfff700 1 -- 172.21.15.151:0/4203436541 learned_addr learned my addr 172.21.15.151:0/4203436541 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:07.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4b7fe700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d4c0ffe00 0x7f4d4c195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:07.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4affd700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4c1007a0 0x7f4d4c1961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:07.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4bfff700 1 -- 172.21.15.151:0/4203436541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d4c0ffe00 msgr2=0x7f4d4c195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:07.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4bfff700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d4c0ffe00 0x7f4d4c195ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4bfff700 1 -- 172.21.15.151:0/4203436541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4c1007a0 msgr2=0x7f4d4c1961e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:07.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4bfff700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4c1007a0 0x7f4d4c1961e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.536+0000 7f4d4bfff700 1 -- 172.21.15.151:0/4203436541 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d44009d00 con 0x7f4d4c104ea0 2023-07-21T22:18:07.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.537+0000 7f4d4bfff700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 0x7f4d4c1995a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009300 tx=0x7f4d44009330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:07.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.537+0000 7f4d48ff9700 1 -- 172.21.15.151:0/4203436541 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4400e040 con 0x7f4d4c104ea0 2023-07-21T22:18:07.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.537+0000 7f4d48ff9700 1 -- 172.21.15.151:0/4203436541 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d44003e10 con 0x7f4d4c104ea0 2023-07-21T22:18:07.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.537+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d4c19a150 con 0x7f4d4c104ea0 2023-07-21T22:18:07.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.537+0000 7f4d48ff9700 1 -- 172.21.15.151:0/4203436541 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d4401b930 con 0x7f4d4c104ea0 2023-07-21T22:18:07.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.537+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d4c1a2b00 con 0x7f4d4c104ea0 2023-07-21T22:18:07.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.538+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d4c04e210 con 0x7f4d4c104ea0 2023-07-21T22:18:07.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.540+0000 7f4d48ff9700 1 -- 172.21.15.151:0/4203436541 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f4d44024410 con 0x7f4d4c104ea0 2023-07-21T22:18:07.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.542+0000 7f4d48ff9700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4d340a1260 0x7f4d340a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:07.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.543+0000 7f4d48ff9700 1 -- 172.21.15.151:0/4203436541 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4d440ce180 con 0x7f4d4c104ea0 2023-07-21T22:18:07.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.543+0000 7f4d4b7fe700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4d340a1260 0x7f4d340a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:07.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.543+0000 7f4d4b7fe700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4d340a1260 0x7f4d340a3710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c005950 tx=0x7f4d3c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:07.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.547+0000 7f4d48ff9700 1 -- 172.21.15.151:0/4203436541 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f4d440977d0 con 0x7f4d4c104ea0 2023-07-21T22:18:07.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.739+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4d4c0fc7e0 con 0x7f4d340a1260 2023-07-21T22:18:07.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.749+0000 7f4d48ff9700 1 -- 172.21.15.151:0/4203436541 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+339693 (secure 0 0 0) 0x7f4d4c0fc7e0 con 0x7f4d340a1260 2023-07-21T22:18:07.803 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:07.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4d340a1260 msgr2=0x7f4d340a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:07.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4d340a1260 0x7f4d340a3710 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c005950 tx=0x7f4d3c00b410 comp rx=0 tx=0).stop 2023-07-21T22:18:07.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 msgr2=0x7f4d4c1995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:07.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 0x7f4d4c1995a0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f4d44009300 tx=0x7f4d44009330 comp rx=0 tx=0).stop 2023-07-21T22:18:07.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 shutdown_connections 2023-07-21T22:18:07.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4d340a1260 0x7f4d340a3710 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d4c104ea0 0x7f4d4c1995a0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d4c0ffe00 0x7f4d4c195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 --2- 172.21.15.151:0/4203436541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d4c1007a0 0x7f4d4c1961e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:07.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 >> 172.21.15.151:0/4203436541 conn(0x7f4d4c0fb660 msgr2=0x7f4d4c0fc0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:07.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 shutdown_connections 2023-07-21T22:18:07.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:07.754+0000 7f4d51b7a700 1 -- 172.21.15.151:0/4203436541 wait complete. 2023-07-21T22:18:07.807 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-07-21T22:18:08.357 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":329,"stamp":"2023-07-21T22:18:06.867524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":651344,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":460,"num_read_kb":344,"num_write":332,"num_write_kb":3041,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334968,"kb_used_data":11544,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606856,"statfs":{"total":1151940427776,"available":1151597420544,"internally_reserved":0,"allocated":11821056,"data_stored":7419767,"data_compressed":108096,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":35,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002958"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.301208+0000","last_change":"2023-07-21T22:17:09.850731+0000","last_active":"2023-07-21T22:17:44.301208+0000","last_peered":"2023-07-21T22:17:44.301208+0000","last_clean":"2023-07-21T22:17:44.301208+0000","last_became_active":"2023-07-21T22:17:09.849185+0000","last_became_peered":"2023-07-21T22:17:09.849185+0000","last_unstale":"2023-07-21T22:17:44.301208+0000","last_undegraded":"2023-07-21T22:17:44.301208+0000","last_fullsized":"2023-07-21T22:17:44.301208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:35.659774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485459+0000","last_change":"2023-07-21T22:17:09.853210+0000","last_active":"2023-07-21T22:17:44.485459+0000","last_peered":"2023-07-21T22:17:44.485459+0000","last_clean":"2023-07-21T22:17:44.485459+0000","last_became_active":"2023-07-21T22:17:09.852822+0000","last_became_peered":"2023-07-21T22:17:09.852822+0000","last_unstale":"2023-07-21T22:17:44.485459+0000","last_undegraded":"2023-07-21T22:17:44.485459+0000","last_fullsized":"2023-07-21T22:17:44.485459+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:20.599740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485471+0000","last_change":"2023-07-21T22:17:09.850123+0000","last_active":"2023-07-21T22:17:44.485471+0000","last_peered":"2023-07-21T22:17:44.485471+0000","last_clean":"2023-07-21T22:17:44.485471+0000","last_became_active":"2023-07-21T22:17:09.849763+0000","last_became_peered":"2023-07-21T22:17:09.849763+0000","last_unstale":"2023-07-21T22:17:44.485471+0000","last_undegraded":"2023-07-21T22:17:44.485471+0000","last_fullsized":"2023-07-21T22:17:44.485471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:56.684648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.306962+0000","last_change":"2023-07-21T22:17:44.306609+0000","last_active":"2023-07-21T22:17:44.306962+0000","last_peered":"2023-07-21T22:17:44.306962+0000","last_clean":"2023-07-21T22:17:44.306962+0000","last_became_active":"2023-07-21T22:17:44.306274+0000","last_became_peered":"2023-07-21T22:17:44.306274+0000","last_unstale":"2023-07-21T22:17:44.306962+0000","last_undegraded":"2023-07-21T22:17:44.306962+0000","last_fullsized":"2023-07-21T22:17:44.306962+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:18:47.720581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304532+0000","last_change":"2023-07-21T22:17:09.836811+0000","last_active":"2023-07-21T22:17:44.304532+0000","last_peered":"2023-07-21T22:17:44.304532+0000","last_clean":"2023-07-21T22:17:44.304532+0000","last_became_active":"2023-07-21T22:17:09.836470+0000","last_became_peered":"2023-07-21T22:17:09.836470+0000","last_unstale":"2023-07-21T22:17:44.304532+0000","last_undegraded":"2023-07-21T22:17:44.304532+0000","last_fullsized":"2023-07-21T22:17:44.304532+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:19.711901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303155+0000","last_change":"2023-07-21T22:17:09.845801+0000","last_active":"2023-07-21T22:17:44.303155+0000","last_peered":"2023-07-21T22:17:44.303155+0000","last_clean":"2023-07-21T22:17:44.303155+0000","last_became_active":"2023-07-21T22:17:09.844938+0000","last_became_peered":"2023-07-21T22:17:09.844938+0000","last_unstale":"2023-07-21T22:17:44.303155+0000","last_undegraded":"2023-07-21T22:17:44.303155+0000","last_fullsized":"2023-07-21T22:17:44.303155+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:35.691429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304408+0000","last_change":"2023-07-21T22:17:09.850392+0000","last_active":"2023-07-21T22:17:44.304408+0000","last_peered":"2023-07-21T22:17:44.304408+0000","last_clean":"2023-07-21T22:17:44.304408+0000","last_became_active":"2023-07-21T22:17:09.850013+0000","last_became_peered":"2023-07-21T22:17:09.850013+0000","last_unstale":"2023-07-21T22:17:44.304408+0000","last_undegraded":"2023-07-21T22:17:44.304408+0000","last_fullsized":"2023-07-21T22:17:44.304408+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:04.984082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302962+0000","last_change":"2023-07-21T22:17:09.845425+0000","last_active":"2023-07-21T22:17:44.302962+0000","last_peered":"2023-07-21T22:17:44.302962+0000","last_clean":"2023-07-21T22:17:44.302962+0000","last_became_active":"2023-07-21T22:17:09.845090+0000","last_became_peered":"2023-07-21T22:17:09.845090+0000","last_unstale":"2023-07-21T22:17:44.302962+0000","last_undegraded":"2023-07-21T22:17:44.302962+0000","last_fullsized":"2023-07-21T22:17:44.302962+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:59.843469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305381+0000","last_change":"2023-07-21T22:17:09.845600+0000","last_active":"2023-07-21T22:17:44.305381+0000","last_peered":"2023-07-21T22:17:44.305381+0000","last_clean":"2023-07-21T22:17:44.305381+0000","last_became_active":"2023-07-21T22:17:09.845260+0000","last_became_peered":"2023-07-21T22:17:09.845260+0000","last_unstale":"2023-07-21T22:17:44.305381+0000","last_undegraded":"2023-07-21T22:17:44.305381+0000","last_fullsized":"2023-07-21T22:17:44.305381+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:49.477671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302885+0000","last_change":"2023-07-21T22:17:09.846172+0000","last_active":"2023-07-21T22:17:44.302885+0000","last_peered":"2023-07-21T22:17:44.302885+0000","last_clean":"2023-07-21T22:17:44.302885+0000","last_became_active":"2023-07-21T22:17:09.845827+0000","last_became_peered":"2023-07-21T22:17:09.845827+0000","last_unstale":"2023-07-21T22:17:44.302885+0000","last_undegraded":"2023-07-21T22:17:44.302885+0000","last_fullsized":"2023-07-21T22:17:44.302885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:38.644866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304572+0000","last_change":"2023-07-21T22:17:09.852728+0000","last_active":"2023-07-21T22:17:44.304572+0000","last_peered":"2023-07-21T22:17:44.304572+0000","last_clean":"2023-07-21T22:17:44.304572+0000","last_became_active":"2023-07-21T22:17:09.852152+0000","last_became_peered":"2023-07-21T22:17:09.852152+0000","last_unstale":"2023-07-21T22:17:44.304572+0000","last_undegraded":"2023-07-21T22:17:44.304572+0000","last_fullsized":"2023-07-21T22:17:44.304572+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:10.530218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487404+0000","last_change":"2023-07-21T22:17:09.850565+0000","last_active":"2023-07-21T22:17:44.487404+0000","last_peered":"2023-07-21T22:17:44.487404+0000","last_clean":"2023-07-21T22:17:44.487404+0000","last_became_active":"2023-07-21T22:17:09.850162+0000","last_became_peered":"2023-07-21T22:17:09.850162+0000","last_unstale":"2023-07-21T22:17:44.487404+0000","last_undegraded":"2023-07-21T22:17:44.487404+0000","last_fullsized":"2023-07-21T22:17:44.487404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:48.591116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299812+0000","last_change":"2023-07-21T22:17:09.836732+0000","last_active":"2023-07-21T22:17:44.299812+0000","last_peered":"2023-07-21T22:17:44.299812+0000","last_clean":"2023-07-21T22:17:44.299812+0000","last_became_active":"2023-07-21T22:17:09.836446+0000","last_became_peered":"2023-07-21T22:17:09.836446+0000","last_unstale":"2023-07-21T22:17:44.299812+0000","last_undegraded":"2023-07-21T22:17:44.299812+0000","last_fullsized":"2023-07-21T22:17:44.299812+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:05.998599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485159+0000","last_change":"2023-07-21T22:17:09.852624+0000","last_active":"2023-07-21T22:17:44.485159+0000","last_peered":"2023-07-21T22:17:44.485159+0000","last_clean":"2023-07-21T22:17:44.485159+0000","last_became_active":"2023-07-21T22:17:09.852353+0000","last_became_peered":"2023-07-21T22:17:09.852353+0000","last_unstale":"2023-07-21T22:17:44.485159+0000","last_undegraded":"2023-07-21T22:17:44.485159+0000","last_fullsized":"2023-07-21T22:17:44.485159+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:42.502841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485146+0000","last_change":"2023-07-21T22:17:09.860554+0000","last_active":"2023-07-21T22:17:44.485146+0000","last_peered":"2023-07-21T22:17:44.485146+0000","last_clean":"2023-07-21T22:17:44.485146+0000","last_became_active":"2023-07-21T22:17:09.860119+0000","last_became_peered":"2023-07-21T22:17:09.860119+0000","last_unstale":"2023-07-21T22:17:44.485146+0000","last_undegraded":"2023-07-21T22:17:44.485146+0000","last_fullsized":"2023-07-21T22:17:44.485146+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:58.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305329+0000","last_change":"2023-07-21T22:17:09.850522+0000","last_active":"2023-07-21T22:17:44.305329+0000","last_peered":"2023-07-21T22:17:44.305329+0000","last_clean":"2023-07-21T22:17:44.305329+0000","last_became_active":"2023-07-21T22:17:09.850243+0000","last_became_peered":"2023-07-21T22:17:09.850243+0000","last_unstale":"2023-07-21T22:17:44.305329+0000","last_undegraded":"2023-07-21T22:17:44.305329+0000","last_fullsized":"2023-07-21T22:17:44.305329+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:10.569656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.301523+0000","last_change":"2023-07-21T22:17:09.848552+0000","last_active":"2023-07-21T22:17:44.301523+0000","last_peered":"2023-07-21T22:17:44.301523+0000","last_clean":"2023-07-21T22:17:44.301523+0000","last_became_active":"2023-07-21T22:17:09.848110+0000","last_became_peered":"2023-07-21T22:17:09.848110+0000","last_unstale":"2023-07-21T22:17:44.301523+0000","last_undegraded":"2023-07-21T22:17:44.301523+0000","last_fullsized":"2023-07-21T22:17:44.301523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:12.712668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302425+0000","last_change":"2023-07-21T22:17:09.848899+0000","last_active":"2023-07-21T22:17:44.302425+0000","last_peered":"2023-07-21T22:17:44.302425+0000","last_clean":"2023-07-21T22:17:44.302425+0000","last_became_active":"2023-07-21T22:17:09.848606+0000","last_became_peered":"2023-07-21T22:17:09.848606+0000","last_unstale":"2023-07-21T22:17:44.302425+0000","last_undegraded":"2023-07-21T22:17:44.302425+0000","last_fullsized":"2023-07-21T22:17:44.302425+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:51.141831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303803+0000","last_change":"2023-07-21T22:17:09.838033+0000","last_active":"2023-07-21T22:17:44.303803+0000","last_peered":"2023-07-21T22:17:44.303803+0000","last_clean":"2023-07-21T22:17:44.303803+0000","last_became_active":"2023-07-21T22:17:09.837532+0000","last_became_peered":"2023-07-21T22:17:09.837532+0000","last_unstale":"2023-07-21T22:17:44.303803+0000","last_undegraded":"2023-07-21T22:17:44.303803+0000","last_fullsized":"2023-07-21T22:17:44.303803+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:24.281689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302370+0000","last_change":"2023-07-21T22:17:08.867849+0000","last_active":"2023-07-21T22:17:44.302370+0000","last_peered":"2023-07-21T22:17:44.302370+0000","last_clean":"2023-07-21T22:17:44.302370+0000","last_became_active":"2023-07-21T22:17:08.866245+0000","last_became_peered":"2023-07-21T22:17:08.866245+0000","last_unstale":"2023-07-21T22:17:44.302370+0000","last_undegraded":"2023-07-21T22:17:44.302370+0000","last_fullsized":"2023-07-21T22:17:44.302370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:37.153114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303911+0000","last_change":"2023-07-21T22:17:09.841402+0000","last_active":"2023-07-21T22:17:44.303911+0000","last_peered":"2023-07-21T22:17:44.303911+0000","last_clean":"2023-07-21T22:17:44.303911+0000","last_became_active":"2023-07-21T22:17:09.841009+0000","last_became_peered":"2023-07-21T22:17:09.841009+0000","last_unstale":"2023-07-21T22:17:44.303911+0000","last_undegraded":"2023-07-21T22:17:44.303911+0000","last_fullsized":"2023-07-21T22:17:44.303911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:08.232799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304136+0000","last_change":"2023-07-21T22:17:08.864236+0000","last_active":"2023-07-21T22:17:44.304136+0000","last_peered":"2023-07-21T22:17:44.304136+0000","last_clean":"2023-07-21T22:17:44.304136+0000","last_became_active":"2023-07-21T22:17:08.863579+0000","last_became_peered":"2023-07-21T22:17:08.863579+0000","last_unstale":"2023-07-21T22:17:44.304136+0000","last_undegraded":"2023-07-21T22:17:44.304136+0000","last_fullsized":"2023-07-21T22:17:44.304136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:10.453785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485547+0000","last_change":"2023-07-21T22:17:09.852677+0000","last_active":"2023-07-21T22:17:44.485547+0000","last_peered":"2023-07-21T22:17:44.485547+0000","last_clean":"2023-07-21T22:17:44.485547+0000","last_became_active":"2023-07-21T22:17:09.852326+0000","last_became_peered":"2023-07-21T22:17:09.852326+0000","last_unstale":"2023-07-21T22:17:44.485547+0000","last_undegraded":"2023-07-21T22:17:44.485547+0000","last_fullsized":"2023-07-21T22:17:44.485547+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:09.817158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304951+0000","last_change":"2023-07-21T22:17:08.867521+0000","last_active":"2023-07-21T22:17:44.304951+0000","last_peered":"2023-07-21T22:17:44.304951+0000","last_clean":"2023-07-21T22:17:44.304951+0000","last_became_active":"2023-07-21T22:17:08.867125+0000","last_became_peered":"2023-07-21T22:17:08.867125+0000","last_unstale":"2023-07-21T22:17:44.304951+0000","last_undegraded":"2023-07-21T22:17:44.304951+0000","last_fullsized":"2023-07-21T22:17:44.304951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:36:09.254395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305145+0000","last_change":"2023-07-21T22:17:09.846296+0000","last_active":"2023-07-21T22:17:44.305145+0000","last_peered":"2023-07-21T22:17:44.305145+0000","last_clean":"2023-07-21T22:17:44.305145+0000","last_became_active":"2023-07-21T22:17:09.845947+0000","last_became_peered":"2023-07-21T22:17:09.845947+0000","last_unstale":"2023-07-21T22:17:44.305145+0000","last_undegraded":"2023-07-21T22:17:44.305145+0000","last_fullsized":"2023-07-21T22:17:44.305145+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:34:46.553617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305483+0000","last_change":"2023-07-21T22:17:08.866709+0000","last_active":"2023-07-21T22:17:44.305483+0000","last_peered":"2023-07-21T22:17:44.305483+0000","last_clean":"2023-07-21T22:17:44.305483+0000","last_became_active":"2023-07-21T22:17:08.866277+0000","last_became_peered":"2023-07-21T22:17:08.866277+0000","last_unstale":"2023-07-21T22:17:44.305483+0000","last_undegraded":"2023-07-21T22:17:44.305483+0000","last_fullsized":"2023-07-21T22:17:44.305483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:13.480396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486380+0000","last_change":"2023-07-21T22:17:09.855068+0000","last_active":"2023-07-21T22:17:44.486380+0000","last_peered":"2023-07-21T22:17:44.486380+0000","last_clean":"2023-07-21T22:17:44.486380+0000","last_became_active":"2023-07-21T22:17:09.854697+0000","last_became_peered":"2023-07-21T22:17:09.854697+0000","last_unstale":"2023-07-21T22:17:44.486380+0000","last_undegraded":"2023-07-21T22:17:44.486380+0000","last_fullsized":"2023-07-21T22:17:44.486380+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:46.560534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"85'5","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:03.288372+0000","last_change":"2023-07-21T22:17:08.864292+0000","last_active":"2023-07-21T22:18:03.288372+0000","last_peered":"2023-07-21T22:18:03.288372+0000","last_clean":"2023-07-21T22:18:03.288372+0000","last_became_active":"2023-07-21T22:17:08.863243+0000","last_became_peered":"2023-07-21T22:17:08.863243+0000","last_unstale":"2023-07-21T22:18:03.288372+0000","last_undegraded":"2023-07-21T22:18:03.288372+0000","last_fullsized":"2023-07-21T22:18:03.288372+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:46:18.247508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304784+0000","last_change":"2023-07-21T22:17:09.840756+0000","last_active":"2023-07-21T22:17:44.304784+0000","last_peered":"2023-07-21T22:17:44.304784+0000","last_clean":"2023-07-21T22:17:44.304784+0000","last_became_active":"2023-07-21T22:17:09.840421+0000","last_became_peered":"2023-07-21T22:17:09.840421+0000","last_unstale":"2023-07-21T22:17:44.304784+0000","last_undegraded":"2023-07-21T22:17:44.304784+0000","last_fullsized":"2023-07-21T22:17:44.304784+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:30.874703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.491774+0000","last_change":"2023-07-21T22:17:44.491774+0000","last_active":"2023-07-21T22:17:44.491774+0000","last_peered":"2023-07-21T22:17:44.491774+0000","last_clean":"2023-07-21T22:17:44.491774+0000","last_became_active":"2023-07-21T22:17:44.488479+0000","last_became_peered":"2023-07-21T22:17:44.488479+0000","last_unstale":"2023-07-21T22:17:44.491774+0000","last_undegraded":"2023-07-21T22:17:44.491774+0000","last_fullsized":"2023-07-21T22:17:44.491774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:37:54.678291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486110+0000","last_change":"2023-07-21T22:17:09.839359+0000","last_active":"2023-07-21T22:17:44.486110+0000","last_peered":"2023-07-21T22:17:44.486110+0000","last_clean":"2023-07-21T22:17:44.486110+0000","last_became_active":"2023-07-21T22:17:09.839026+0000","last_became_peered":"2023-07-21T22:17:09.839026+0000","last_unstale":"2023-07-21T22:17:44.486110+0000","last_undegraded":"2023-07-21T22:17:44.486110+0000","last_fullsized":"2023-07-21T22:17:44.486110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:39.641691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299788+0000","last_change":"2023-07-21T22:17:08.861680+0000","last_active":"2023-07-21T22:17:44.299788+0000","last_peered":"2023-07-21T22:17:44.299788+0000","last_clean":"2023-07-21T22:17:44.299788+0000","last_became_active":"2023-07-21T22:17:08.861348+0000","last_became_peered":"2023-07-21T22:17:08.861348+0000","last_unstale":"2023-07-21T22:17:44.299788+0000","last_undegraded":"2023-07-21T22:17:44.299788+0000","last_fullsized":"2023-07-21T22:17:44.299788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:54.809555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303038+0000","last_change":"2023-07-21T22:17:09.840166+0000","last_active":"2023-07-21T22:17:44.303038+0000","last_peered":"2023-07-21T22:17:44.303038+0000","last_clean":"2023-07-21T22:17:44.303038+0000","last_became_active":"2023-07-21T22:17:09.839850+0000","last_became_peered":"2023-07-21T22:17:09.839850+0000","last_unstale":"2023-07-21T22:17:44.303038+0000","last_undegraded":"2023-07-21T22:17:44.303038+0000","last_fullsized":"2023-07-21T22:17:44.303038+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:43.813137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485915+0000","last_change":"2023-07-21T22:17:08.864838+0000","last_active":"2023-07-21T22:17:44.485915+0000","last_peered":"2023-07-21T22:17:44.485915+0000","last_clean":"2023-07-21T22:17:44.485915+0000","last_became_active":"2023-07-21T22:17:08.864484+0000","last_became_peered":"2023-07-21T22:17:08.864484+0000","last_unstale":"2023-07-21T22:17:44.485915+0000","last_undegraded":"2023-07-21T22:17:44.485915+0000","last_fullsized":"2023-07-21T22:17:44.485915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:55:33.300808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302427+0000","last_change":"2023-07-21T22:17:09.836214+0000","last_active":"2023-07-21T22:17:44.302427+0000","last_peered":"2023-07-21T22:17:44.302427+0000","last_clean":"2023-07-21T22:17:44.302427+0000","last_became_active":"2023-07-21T22:17:09.835877+0000","last_became_peered":"2023-07-21T22:17:09.835877+0000","last_unstale":"2023-07-21T22:17:44.302427+0000","last_undegraded":"2023-07-21T22:17:44.302427+0000","last_fullsized":"2023-07-21T22:17:44.302427+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:50.733216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"85'3","reported_seq":70,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:02.285519+0000","last_change":"2023-07-21T22:17:08.861801+0000","last_active":"2023-07-21T22:18:02.285519+0000","last_peered":"2023-07-21T22:18:02.285519+0000","last_clean":"2023-07-21T22:18:02.285519+0000","last_became_active":"2023-07-21T22:17:08.861391+0000","last_became_peered":"2023-07-21T22:17:08.861391+0000","last_unstale":"2023-07-21T22:18:02.285519+0000","last_undegraded":"2023-07-21T22:18:02.285519+0000","last_fullsized":"2023-07-21T22:18:02.285519+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:27:55.305051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":49,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305353+0000","last_change":"2023-07-21T22:17:09.842155+0000","last_active":"2023-07-21T22:17:44.305353+0000","last_peered":"2023-07-21T22:17:44.305353+0000","last_clean":"2023-07-21T22:17:44.305353+0000","last_became_active":"2023-07-21T22:17:09.841845+0000","last_became_peered":"2023-07-21T22:17:09.841845+0000","last_unstale":"2023-07-21T22:17:44.305353+0000","last_undegraded":"2023-07-21T22:17:44.305353+0000","last_fullsized":"2023-07-21T22:17:44.305353+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:10.209278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304566+0000","last_change":"2023-07-21T22:17:08.858727+0000","last_active":"2023-07-21T22:17:44.304566+0000","last_peered":"2023-07-21T22:17:44.304566+0000","last_clean":"2023-07-21T22:17:44.304566+0000","last_became_active":"2023-07-21T22:17:08.858376+0000","last_became_peered":"2023-07-21T22:17:08.858376+0000","last_unstale":"2023-07-21T22:17:44.304566+0000","last_undegraded":"2023-07-21T22:17:44.304566+0000","last_fullsized":"2023-07-21T22:17:44.304566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:35.053954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485518+0000","last_change":"2023-07-21T22:17:09.857300+0000","last_active":"2023-07-21T22:17:44.485518+0000","last_peered":"2023-07-21T22:17:44.485518+0000","last_clean":"2023-07-21T22:17:44.485518+0000","last_became_active":"2023-07-21T22:17:09.856932+0000","last_became_peered":"2023-07-21T22:17:09.856932+0000","last_unstale":"2023-07-21T22:17:44.485518+0000","last_undegraded":"2023-07-21T22:17:44.485518+0000","last_fullsized":"2023-07-21T22:17:44.485518+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:28.202771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486481+0000","last_change":"2023-07-21T22:17:08.865488+0000","last_active":"2023-07-21T22:17:44.486481+0000","last_peered":"2023-07-21T22:17:44.486481+0000","last_clean":"2023-07-21T22:17:44.486481+0000","last_became_active":"2023-07-21T22:17:08.865050+0000","last_became_peered":"2023-07-21T22:17:08.865050+0000","last_unstale":"2023-07-21T22:17:44.486481+0000","last_undegraded":"2023-07-21T22:17:44.486481+0000","last_fullsized":"2023-07-21T22:17:44.486481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:12:41.386381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305586+0000","last_change":"2023-07-21T22:17:09.849880+0000","last_active":"2023-07-21T22:17:44.305586+0000","last_peered":"2023-07-21T22:17:44.305586+0000","last_clean":"2023-07-21T22:17:44.305586+0000","last_became_active":"2023-07-21T22:17:09.849552+0000","last_became_peered":"2023-07-21T22:17:09.849552+0000","last_unstale":"2023-07-21T22:17:44.305586+0000","last_undegraded":"2023-07-21T22:17:44.305586+0000","last_fullsized":"2023-07-21T22:17:44.305586+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:57.861104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"86'27","reported_seq":151,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:03.298619+0000","last_change":"2023-07-21T22:17:08.861663+0000","last_active":"2023-07-21T22:18:03.298619+0000","last_peered":"2023-07-21T22:18:03.298619+0000","last_clean":"2023-07-21T22:18:03.298619+0000","last_became_active":"2023-07-21T22:17:08.861339+0000","last_became_peered":"2023-07-21T22:17:08.861339+0000","last_unstale":"2023-07-21T22:18:03.298619+0000","last_undegraded":"2023-07-21T22:18:03.298619+0000","last_fullsized":"2023-07-21T22:18:03.298619+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:23:16.097183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":56826,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":106,"num_read_kb":107,"num_write":28,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304514+0000","last_change":"2023-07-21T22:17:09.841543+0000","last_active":"2023-07-21T22:17:44.304514+0000","last_peered":"2023-07-21T22:17:44.304514+0000","last_clean":"2023-07-21T22:17:44.304514+0000","last_became_active":"2023-07-21T22:17:09.841235+0000","last_became_peered":"2023-07-21T22:17:09.841235+0000","last_unstale":"2023-07-21T22:17:44.304514+0000","last_undegraded":"2023-07-21T22:17:44.304514+0000","last_fullsized":"2023-07-21T22:17:44.304514+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:37:58.825011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303802+0000","last_change":"2023-07-21T22:17:08.855145+0000","last_active":"2023-07-21T22:17:44.303802+0000","last_peered":"2023-07-21T22:17:44.303802+0000","last_clean":"2023-07-21T22:17:44.303802+0000","last_became_active":"2023-07-21T22:17:08.853279+0000","last_became_peered":"2023-07-21T22:17:08.853279+0000","last_unstale":"2023-07-21T22:17:44.303802+0000","last_undegraded":"2023-07-21T22:17:44.303802+0000","last_fullsized":"2023-07-21T22:17:44.303802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:10.333188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299716+0000","last_change":"2023-07-21T22:17:09.835656+0000","last_active":"2023-07-21T22:17:44.299716+0000","last_peered":"2023-07-21T22:17:44.299716+0000","last_clean":"2023-07-21T22:17:44.299716+0000","last_became_active":"2023-07-21T22:17:09.835309+0000","last_became_peered":"2023-07-21T22:17:09.835309+0000","last_unstale":"2023-07-21T22:17:44.299716+0000","last_undegraded":"2023-07-21T22:17:44.299716+0000","last_fullsized":"2023-07-21T22:17:44.299716+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:59.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486159+0000","last_change":"2023-07-21T22:17:08.864811+0000","last_active":"2023-07-21T22:17:44.486159+0000","last_peered":"2023-07-21T22:17:44.486159+0000","last_clean":"2023-07-21T22:17:44.486159+0000","last_became_active":"2023-07-21T22:17:08.864428+0000","last_became_peered":"2023-07-21T22:17:08.864428+0000","last_unstale":"2023-07-21T22:17:44.486159+0000","last_undegraded":"2023-07-21T22:17:44.486159+0000","last_fullsized":"2023-07-21T22:17:44.486159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:09.637705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304356+0000","last_change":"2023-07-21T22:17:09.837713+0000","last_active":"2023-07-21T22:17:44.304356+0000","last_peered":"2023-07-21T22:17:44.304356+0000","last_clean":"2023-07-21T22:17:44.304356+0000","last_became_active":"2023-07-21T22:17:09.837420+0000","last_became_peered":"2023-07-21T22:17:09.837420+0000","last_unstale":"2023-07-21T22:17:44.304356+0000","last_undegraded":"2023-07-21T22:17:44.304356+0000","last_fullsized":"2023-07-21T22:17:44.304356+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:00.392623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'4","reported_seq":75,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:03.306010+0000","last_change":"2023-07-21T22:17:08.854376+0000","last_active":"2023-07-21T22:18:03.306010+0000","last_peered":"2023-07-21T22:18:03.306010+0000","last_clean":"2023-07-21T22:18:03.306010+0000","last_became_active":"2023-07-21T22:17:08.854031+0000","last_became_peered":"2023-07-21T22:17:08.854031+0000","last_unstale":"2023-07-21T22:18:03.306010+0000","last_undegraded":"2023-07-21T22:18:03.306010+0000","last_fullsized":"2023-07-21T22:18:03.306010+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:12.749236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":930,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303992+0000","last_change":"2023-07-21T22:17:09.851279+0000","last_active":"2023-07-21T22:17:44.303992+0000","last_peered":"2023-07-21T22:17:44.303992+0000","last_clean":"2023-07-21T22:17:44.303992+0000","last_became_active":"2023-07-21T22:17:09.850948+0000","last_became_peered":"2023-07-21T22:17:09.850948+0000","last_unstale":"2023-07-21T22:17:44.303992+0000","last_undegraded":"2023-07-21T22:17:44.303992+0000","last_fullsized":"2023-07-21T22:17:44.303992+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:10:00.991437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305069+0000","last_change":"2023-07-21T22:17:08.865425+0000","last_active":"2023-07-21T22:17:44.305069+0000","last_peered":"2023-07-21T22:17:44.305069+0000","last_clean":"2023-07-21T22:17:44.305069+0000","last_became_active":"2023-07-21T22:17:08.865067+0000","last_became_peered":"2023-07-21T22:17:08.865067+0000","last_unstale":"2023-07-21T22:17:44.305069+0000","last_undegraded":"2023-07-21T22:17:44.305069+0000","last_fullsized":"2023-07-21T22:17:44.305069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:55.543750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486350+0000","last_change":"2023-07-21T22:17:09.844916+0000","last_active":"2023-07-21T22:17:44.486350+0000","last_peered":"2023-07-21T22:17:44.486350+0000","last_clean":"2023-07-21T22:17:44.486350+0000","last_became_active":"2023-07-21T22:17:09.844632+0000","last_became_peered":"2023-07-21T22:17:09.844632+0000","last_unstale":"2023-07-21T22:17:44.486350+0000","last_undegraded":"2023-07-21T22:17:44.486350+0000","last_fullsized":"2023-07-21T22:17:44.486350+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:32:46.857855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305478+0000","last_change":"2023-07-21T22:17:08.862954+0000","last_active":"2023-07-21T22:17:44.305478+0000","last_peered":"2023-07-21T22:17:44.305478+0000","last_clean":"2023-07-21T22:17:44.305478+0000","last_became_active":"2023-07-21T22:17:08.862598+0000","last_became_peered":"2023-07-21T22:17:08.862598+0000","last_unstale":"2023-07-21T22:17:44.305478+0000","last_undegraded":"2023-07-21T22:17:44.305478+0000","last_fullsized":"2023-07-21T22:17:44.305478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:02.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.488032+0000","last_change":"2023-07-21T22:17:44.488032+0000","last_active":"2023-07-21T22:17:44.488032+0000","last_peered":"2023-07-21T22:17:44.488032+0000","last_clean":"2023-07-21T22:17:44.488032+0000","last_became_active":"2023-07-21T22:17:44.487524+0000","last_became_peered":"2023-07-21T22:17:44.487524+0000","last_unstale":"2023-07-21T22:17:44.488032+0000","last_undegraded":"2023-07-21T22:17:44.488032+0000","last_fullsized":"2023-07-21T22:17:44.488032+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:01.489283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302366+0000","last_change":"2023-07-21T22:17:08.862514+0000","last_active":"2023-07-21T22:17:44.302366+0000","last_peered":"2023-07-21T22:17:44.302366+0000","last_clean":"2023-07-21T22:17:44.302366+0000","last_became_active":"2023-07-21T22:17:08.862223+0000","last_became_peered":"2023-07-21T22:17:08.862223+0000","last_unstale":"2023-07-21T22:17:44.302366+0000","last_undegraded":"2023-07-21T22:17:44.302366+0000","last_fullsized":"2023-07-21T22:17:44.302366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:37:34.099818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302802+0000","last_change":"2023-07-21T22:17:09.852621+0000","last_active":"2023-07-21T22:17:44.302802+0000","last_peered":"2023-07-21T22:17:44.302802+0000","last_clean":"2023-07-21T22:17:44.302802+0000","last_became_active":"2023-07-21T22:17:09.852233+0000","last_became_peered":"2023-07-21T22:17:09.852233+0000","last_unstale":"2023-07-21T22:17:44.302802+0000","last_undegraded":"2023-07-21T22:17:44.302802+0000","last_fullsized":"2023-07-21T22:17:44.302802+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:17.187991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304312+0000","last_change":"2023-07-21T22:17:08.861344+0000","last_active":"2023-07-21T22:17:44.304312+0000","last_peered":"2023-07-21T22:17:44.304312+0000","last_clean":"2023-07-21T22:17:44.304312+0000","last_became_active":"2023-07-21T22:17:08.860978+0000","last_became_peered":"2023-07-21T22:17:08.860978+0000","last_unstale":"2023-07-21T22:17:44.304312+0000","last_undegraded":"2023-07-21T22:17:44.304312+0000","last_fullsized":"2023-07-21T22:17:44.304312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:21.901465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302315+0000","last_change":"2023-07-21T22:17:09.852314+0000","last_active":"2023-07-21T22:17:44.302315+0000","last_peered":"2023-07-21T22:17:44.302315+0000","last_clean":"2023-07-21T22:17:44.302315+0000","last_became_active":"2023-07-21T22:17:09.852137+0000","last_became_peered":"2023-07-21T22:17:09.852137+0000","last_unstale":"2023-07-21T22:17:44.302315+0000","last_undegraded":"2023-07-21T22:17:44.302315+0000","last_fullsized":"2023-07-21T22:17:44.302315+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:02.728732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486194+0000","last_change":"2023-07-21T22:17:09.839387+0000","last_active":"2023-07-21T22:17:44.486194+0000","last_peered":"2023-07-21T22:17:44.486194+0000","last_clean":"2023-07-21T22:17:44.486194+0000","last_became_active":"2023-07-21T22:17:09.839052+0000","last_became_peered":"2023-07-21T22:17:09.839052+0000","last_unstale":"2023-07-21T22:17:44.486194+0000","last_undegraded":"2023-07-21T22:17:44.486194+0000","last_fullsized":"2023-07-21T22:17:44.486194+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:00.416159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'4","reported_seq":74,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:05.309141+0000","last_change":"2023-07-21T22:17:08.859465+0000","last_active":"2023-07-21T22:18:05.309141+0000","last_peered":"2023-07-21T22:18:05.309141+0000","last_clean":"2023-07-21T22:18:05.309141+0000","last_became_active":"2023-07-21T22:17:08.859076+0000","last_became_peered":"2023-07-21T22:17:08.859076+0000","last_unstale":"2023-07-21T22:18:05.309141+0000","last_undegraded":"2023-07-21T22:18:05.309141+0000","last_fullsized":"2023-07-21T22:18:05.309141+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:23.451233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303499+0000","last_change":"2023-07-21T22:17:09.846937+0000","last_active":"2023-07-21T22:17:44.303499+0000","last_peered":"2023-07-21T22:17:44.303499+0000","last_clean":"2023-07-21T22:17:44.303499+0000","last_became_active":"2023-07-21T22:17:09.846638+0000","last_became_peered":"2023-07-21T22:17:09.846638+0000","last_unstale":"2023-07-21T22:17:44.303499+0000","last_undegraded":"2023-07-21T22:17:44.303499+0000","last_fullsized":"2023-07-21T22:17:44.303499+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:17.574718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487106+0000","last_change":"2023-07-21T22:17:08.860388+0000","last_active":"2023-07-21T22:17:44.487106+0000","last_peered":"2023-07-21T22:17:44.487106+0000","last_clean":"2023-07-21T22:17:44.487106+0000","last_became_active":"2023-07-21T22:17:08.860039+0000","last_became_peered":"2023-07-21T22:17:08.860039+0000","last_unstale":"2023-07-21T22:17:44.487106+0000","last_undegraded":"2023-07-21T22:17:44.487106+0000","last_fullsized":"2023-07-21T22:17:44.487106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:34.981385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":349,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304109+0000","last_change":"2023-07-21T22:15:51.342448+0000","last_active":"2023-07-21T22:17:44.304109+0000","last_peered":"2023-07-21T22:17:44.304109+0000","last_clean":"2023-07-21T22:17:44.304109+0000","last_became_active":"2023-07-21T22:15:51.342004+0000","last_became_peered":"2023-07-21T22:15:51.342004+0000","last_unstale":"2023-07-21T22:17:44.304109+0000","last_undegraded":"2023-07-21T22:17:44.304109+0000","last_fullsized":"2023-07-21T22:17:44.304109+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_clean_scrub_stamp":"2023-07-21T22:12:15.345227+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:29.784967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299632+0000","last_change":"2023-07-21T22:17:09.838402+0000","last_active":"2023-07-21T22:17:44.299632+0000","last_peered":"2023-07-21T22:17:44.299632+0000","last_clean":"2023-07-21T22:17:44.299632+0000","last_became_active":"2023-07-21T22:17:09.838096+0000","last_became_peered":"2023-07-21T22:17:09.838096+0000","last_unstale":"2023-07-21T22:17:44.299632+0000","last_undegraded":"2023-07-21T22:17:44.299632+0000","last_fullsized":"2023-07-21T22:17:44.299632+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:37.376969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304274+0000","last_change":"2023-07-21T22:17:08.865676+0000","last_active":"2023-07-21T22:17:44.304274+0000","last_peered":"2023-07-21T22:17:44.304274+0000","last_clean":"2023-07-21T22:17:44.304274+0000","last_became_active":"2023-07-21T22:17:08.865370+0000","last_became_peered":"2023-07-21T22:17:08.865370+0000","last_unstale":"2023-07-21T22:17:44.304274+0000","last_undegraded":"2023-07-21T22:17:44.304274+0000","last_fullsized":"2023-07-21T22:17:44.304274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:36.039312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304666+0000","last_change":"2023-07-21T22:17:08.864487+0000","last_active":"2023-07-21T22:17:44.304666+0000","last_peered":"2023-07-21T22:17:44.304666+0000","last_clean":"2023-07-21T22:17:44.304666+0000","last_became_active":"2023-07-21T22:17:08.863943+0000","last_became_peered":"2023-07-21T22:17:08.863943+0000","last_unstale":"2023-07-21T22:17:44.304666+0000","last_undegraded":"2023-07-21T22:17:44.304666+0000","last_fullsized":"2023-07-21T22:17:44.304666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:00.454414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300048+0000","last_change":"2023-07-21T22:17:09.833812+0000","last_active":"2023-07-21T22:17:44.300048+0000","last_peered":"2023-07-21T22:17:44.300048+0000","last_clean":"2023-07-21T22:17:44.300048+0000","last_became_active":"2023-07-21T22:17:09.833496+0000","last_became_peered":"2023-07-21T22:17:09.833496+0000","last_unstale":"2023-07-21T22:17:44.300048+0000","last_undegraded":"2023-07-21T22:17:44.300048+0000","last_fullsized":"2023-07-21T22:17:44.300048+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:32.258278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"85'5","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302555+0000","last_change":"2023-07-21T22:17:08.867858+0000","last_active":"2023-07-21T22:17:44.302555+0000","last_peered":"2023-07-21T22:17:44.302555+0000","last_clean":"2023-07-21T22:17:44.302555+0000","last_became_active":"2023-07-21T22:17:08.867468+0000","last_became_peered":"2023-07-21T22:17:08.867468+0000","last_unstale":"2023-07-21T22:17:44.302555+0000","last_undegraded":"2023-07-21T22:17:44.302555+0000","last_fullsized":"2023-07-21T22:17:44.302555+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:52.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303919+0000","last_change":"2023-07-21T22:17:09.846988+0000","last_active":"2023-07-21T22:17:44.303919+0000","last_peered":"2023-07-21T22:17:44.303919+0000","last_clean":"2023-07-21T22:17:44.303919+0000","last_became_active":"2023-07-21T22:17:09.846686+0000","last_became_peered":"2023-07-21T22:17:09.846686+0000","last_unstale":"2023-07-21T22:17:44.303919+0000","last_undegraded":"2023-07-21T22:17:44.303919+0000","last_fullsized":"2023-07-21T22:17:44.303919+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:48.205318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487213+0000","last_change":"2023-07-21T22:17:08.857694+0000","last_active":"2023-07-21T22:17:44.487213+0000","last_peered":"2023-07-21T22:17:44.487213+0000","last_clean":"2023-07-21T22:17:44.487213+0000","last_became_active":"2023-07-21T22:17:08.857356+0000","last_became_peered":"2023-07-21T22:17:08.857356+0000","last_unstale":"2023-07-21T22:17:44.487213+0000","last_undegraded":"2023-07-21T22:17:44.487213+0000","last_fullsized":"2023-07-21T22:17:44.487213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:39:39.361769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485692+0000","last_change":"2023-07-21T22:17:09.858500+0000","last_active":"2023-07-21T22:17:44.485692+0000","last_peered":"2023-07-21T22:17:44.485692+0000","last_clean":"2023-07-21T22:17:44.485692+0000","last_became_active":"2023-07-21T22:17:09.858009+0000","last_became_peered":"2023-07-21T22:17:09.858009+0000","last_unstale":"2023-07-21T22:17:44.485692+0000","last_undegraded":"2023-07-21T22:17:44.485692+0000","last_fullsized":"2023-07-21T22:17:44.485692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:19:05.454111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305503+0000","last_change":"2023-07-21T22:17:08.853732+0000","last_active":"2023-07-21T22:17:44.305503+0000","last_peered":"2023-07-21T22:17:44.305503+0000","last_clean":"2023-07-21T22:17:44.305503+0000","last_became_active":"2023-07-21T22:17:08.853397+0000","last_became_peered":"2023-07-21T22:17:08.853397+0000","last_unstale":"2023-07-21T22:17:44.305503+0000","last_undegraded":"2023-07-21T22:17:44.305503+0000","last_fullsized":"2023-07-21T22:17:44.305503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:18.249465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304237+0000","last_change":"2023-07-21T22:17:09.840836+0000","last_active":"2023-07-21T22:17:44.304237+0000","last_peered":"2023-07-21T22:17:44.304237+0000","last_clean":"2023-07-21T22:17:44.304237+0000","last_became_active":"2023-07-21T22:17:09.840463+0000","last_became_peered":"2023-07-21T22:17:09.840463+0000","last_unstale":"2023-07-21T22:17:44.304237+0000","last_undegraded":"2023-07-21T22:17:44.304237+0000","last_fullsized":"2023-07-21T22:17:44.304237+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:24.284857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303419+0000","last_change":"2023-07-21T22:17:08.865129+0000","last_active":"2023-07-21T22:17:44.303419+0000","last_peered":"2023-07-21T22:17:44.303419+0000","last_clean":"2023-07-21T22:17:44.303419+0000","last_became_active":"2023-07-21T22:17:08.864820+0000","last_became_peered":"2023-07-21T22:17:08.864820+0000","last_unstale":"2023-07-21T22:17:44.303419+0000","last_undegraded":"2023-07-21T22:17:44.303419+0000","last_fullsized":"2023-07-21T22:17:44.303419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:07.661921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300707+0000","last_change":"2023-07-21T22:17:09.846804+0000","last_active":"2023-07-21T22:17:44.300707+0000","last_peered":"2023-07-21T22:17:44.300707+0000","last_clean":"2023-07-21T22:17:44.300707+0000","last_became_active":"2023-07-21T22:17:09.846390+0000","last_became_peered":"2023-07-21T22:17:09.846390+0000","last_unstale":"2023-07-21T22:17:44.300707+0000","last_undegraded":"2023-07-21T22:17:44.300707+0000","last_fullsized":"2023-07-21T22:17:44.300707+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:42.837431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.317619+0000","last_change":"2023-07-21T22:17:44.317155+0000","last_active":"2023-07-21T22:17:44.317619+0000","last_peered":"2023-07-21T22:17:44.317619+0000","last_clean":"2023-07-21T22:17:44.317619+0000","last_became_active":"2023-07-21T22:17:44.307394+0000","last_became_peered":"2023-07-21T22:17:44.307394+0000","last_unstale":"2023-07-21T22:17:44.317619+0000","last_undegraded":"2023-07-21T22:17:44.317619+0000","last_fullsized":"2023-07-21T22:17:44.317619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:59.993004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303309+0000","last_change":"2023-07-21T22:17:09.849197+0000","last_active":"2023-07-21T22:17:44.303309+0000","last_peered":"2023-07-21T22:17:44.303309+0000","last_clean":"2023-07-21T22:17:44.303309+0000","last_became_active":"2023-07-21T22:17:09.848835+0000","last_became_peered":"2023-07-21T22:17:09.848835+0000","last_unstale":"2023-07-21T22:17:44.303309+0000","last_undegraded":"2023-07-21T22:17:44.303309+0000","last_fullsized":"2023-07-21T22:17:44.303309+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:22.001862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.314830+0000","last_change":"2023-07-21T22:17:44.314329+0000","last_active":"2023-07-21T22:17:44.314830+0000","last_peered":"2023-07-21T22:17:44.314830+0000","last_clean":"2023-07-21T22:17:44.314830+0000","last_became_active":"2023-07-21T22:17:44.307075+0000","last_became_peered":"2023-07-21T22:17:44.307075+0000","last_unstale":"2023-07-21T22:17:44.314830+0000","last_undegraded":"2023-07-21T22:17:44.314830+0000","last_fullsized":"2023-07-21T22:17:44.314830+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:28.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304997+0000","last_change":"2023-07-21T22:17:09.847279+0000","last_active":"2023-07-21T22:17:44.304997+0000","last_peered":"2023-07-21T22:17:44.304997+0000","last_clean":"2023-07-21T22:17:44.304997+0000","last_became_active":"2023-07-21T22:17:09.846982+0000","last_became_peered":"2023-07-21T22:17:09.846982+0000","last_unstale":"2023-07-21T22:17:44.304997+0000","last_undegraded":"2023-07-21T22:17:44.304997+0000","last_fullsized":"2023-07-21T22:17:44.304997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:14.985134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304706+0000","last_change":"2023-07-21T22:17:08.857436+0000","last_active":"2023-07-21T22:17:44.304706+0000","last_peered":"2023-07-21T22:17:44.304706+0000","last_clean":"2023-07-21T22:17:44.304706+0000","last_became_active":"2023-07-21T22:17:08.857046+0000","last_became_peered":"2023-07-21T22:17:08.857046+0000","last_unstale":"2023-07-21T22:17:44.304706+0000","last_undegraded":"2023-07-21T22:17:44.304706+0000","last_fullsized":"2023-07-21T22:17:44.304706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:23.427814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304736+0000","last_change":"2023-07-21T22:17:09.852916+0000","last_active":"2023-07-21T22:17:44.304736+0000","last_peered":"2023-07-21T22:17:44.304736+0000","last_clean":"2023-07-21T22:17:44.304736+0000","last_became_active":"2023-07-21T22:17:09.852608+0000","last_became_peered":"2023-07-21T22:17:09.852608+0000","last_unstale":"2023-07-21T22:17:44.304736+0000","last_undegraded":"2023-07-21T22:17:44.304736+0000","last_fullsized":"2023-07-21T22:17:44.304736+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:21.187686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486196+0000","last_change":"2023-07-21T22:17:08.859619+0000","last_active":"2023-07-21T22:17:44.486196+0000","last_peered":"2023-07-21T22:17:44.486196+0000","last_clean":"2023-07-21T22:17:44.486196+0000","last_became_active":"2023-07-21T22:17:08.859256+0000","last_became_peered":"2023-07-21T22:17:08.859256+0000","last_unstale":"2023-07-21T22:17:44.486196+0000","last_undegraded":"2023-07-21T22:17:44.486196+0000","last_fullsized":"2023-07-21T22:17:44.486196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:49.010457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"85'1","reported_seq":17,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304804+0000","last_change":"2023-07-21T22:17:09.850548+0000","last_active":"2023-07-21T22:17:44.304804+0000","last_peered":"2023-07-21T22:17:44.304804+0000","last_clean":"2023-07-21T22:17:44.304804+0000","last_became_active":"2023-07-21T22:17:09.850261+0000","last_became_peered":"2023-07-21T22:17:09.850261+0000","last_unstale":"2023-07-21T22:17:44.304804+0000","last_undegraded":"2023-07-21T22:17:44.304804+0000","last_fullsized":"2023-07-21T22:17:44.304804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:05.546844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299865+0000","last_change":"2023-07-21T22:17:08.859729+0000","last_active":"2023-07-21T22:17:44.299865+0000","last_peered":"2023-07-21T22:17:44.299865+0000","last_clean":"2023-07-21T22:17:44.299865+0000","last_became_active":"2023-07-21T22:17:08.859421+0000","last_became_peered":"2023-07-21T22:17:08.859421+0000","last_unstale":"2023-07-21T22:17:44.299865+0000","last_undegraded":"2023-07-21T22:17:44.299865+0000","last_fullsized":"2023-07-21T22:17:44.299865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:21.189655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304610+0000","last_change":"2023-07-21T22:17:09.846413+0000","last_active":"2023-07-21T22:17:44.304610+0000","last_peered":"2023-07-21T22:17:44.304610+0000","last_clean":"2023-07-21T22:17:44.304610+0000","last_became_active":"2023-07-21T22:17:09.846038+0000","last_became_peered":"2023-07-21T22:17:09.846038+0000","last_unstale":"2023-07-21T22:17:44.304610+0000","last_undegraded":"2023-07-21T22:17:44.304610+0000","last_fullsized":"2023-07-21T22:17:44.304610+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:08.536390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300763+0000","last_change":"2023-07-21T22:17:09.846786+0000","last_active":"2023-07-21T22:17:44.300763+0000","last_peered":"2023-07-21T22:17:44.300763+0000","last_clean":"2023-07-21T22:17:44.300763+0000","last_became_active":"2023-07-21T22:17:09.846437+0000","last_became_peered":"2023-07-21T22:17:09.846437+0000","last_unstale":"2023-07-21T22:17:44.300763+0000","last_undegraded":"2023-07-21T22:17:44.300763+0000","last_fullsized":"2023-07-21T22:17:44.300763+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:38.254130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487796+0000","last_change":"2023-07-21T22:17:44.487796+0000","last_active":"2023-07-21T22:17:44.487796+0000","last_peered":"2023-07-21T22:17:44.487796+0000","last_clean":"2023-07-21T22:17:44.487796+0000","last_became_active":"2023-07-21T22:17:44.487278+0000","last_became_peered":"2023-07-21T22:17:44.487278+0000","last_unstale":"2023-07-21T22:17:44.487796+0000","last_undegraded":"2023-07-21T22:17:44.487796+0000","last_fullsized":"2023-07-21T22:17:44.487796+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:36.983831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303762+0000","last_change":"2023-07-21T22:17:09.850137+0000","last_active":"2023-07-21T22:17:44.303762+0000","last_peered":"2023-07-21T22:17:44.303762+0000","last_clean":"2023-07-21T22:17:44.303762+0000","last_became_active":"2023-07-21T22:17:09.849721+0000","last_became_peered":"2023-07-21T22:17:09.849721+0000","last_unstale":"2023-07-21T22:17:44.303762+0000","last_undegraded":"2023-07-21T22:17:44.303762+0000","last_fullsized":"2023-07-21T22:17:44.303762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:42.785707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485296+0000","last_change":"2023-07-21T22:17:09.858573+0000","last_active":"2023-07-21T22:17:44.485296+0000","last_peered":"2023-07-21T22:17:44.485296+0000","last_clean":"2023-07-21T22:17:44.485296+0000","last_became_active":"2023-07-21T22:17:09.858017+0000","last_became_peered":"2023-07-21T22:17:09.858017+0000","last_unstale":"2023-07-21T22:17:44.485296+0000","last_undegraded":"2023-07-21T22:17:44.485296+0000","last_fullsized":"2023-07-21T22:17:44.485296+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:20.029025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486812+0000","last_change":"2023-07-21T22:17:44.486812+0000","last_active":"2023-07-21T22:17:44.486812+0000","last_peered":"2023-07-21T22:17:44.486812+0000","last_clean":"2023-07-21T22:17:44.486812+0000","last_became_active":"2023-07-21T22:17:44.486392+0000","last_became_peered":"2023-07-21T22:17:44.486392+0000","last_unstale":"2023-07-21T22:17:44.486812+0000","last_undegraded":"2023-07-21T22:17:44.486812+0000","last_fullsized":"2023-07-21T22:17:44.486812+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:12.827232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300834+0000","last_change":"2023-07-21T22:17:09.845251+0000","last_active":"2023-07-21T22:17:44.300834+0000","last_peered":"2023-07-21T22:17:44.300834+0000","last_clean":"2023-07-21T22:17:44.300834+0000","last_became_active":"2023-07-21T22:17:09.844945+0000","last_became_peered":"2023-07-21T22:17:09.844945+0000","last_unstale":"2023-07-21T22:17:44.300834+0000","last_undegraded":"2023-07-21T22:17:44.300834+0000","last_fullsized":"2023-07-21T22:17:44.300834+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:50.719284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304475+0000","last_change":"2023-07-21T22:17:09.850953+0000","last_active":"2023-07-21T22:17:44.304475+0000","last_peered":"2023-07-21T22:17:44.304475+0000","last_clean":"2023-07-21T22:17:44.304475+0000","last_became_active":"2023-07-21T22:17:09.850627+0000","last_became_peered":"2023-07-21T22:17:09.850627+0000","last_unstale":"2023-07-21T22:17:44.304475+0000","last_undegraded":"2023-07-21T22:17:44.304475+0000","last_fullsized":"2023-07-21T22:17:44.304475+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:01:24.705224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303842+0000","last_change":"2023-07-21T22:17:09.841222+0000","last_active":"2023-07-21T22:17:44.303842+0000","last_peered":"2023-07-21T22:17:44.303842+0000","last_clean":"2023-07-21T22:17:44.303842+0000","last_became_active":"2023-07-21T22:17:09.840864+0000","last_became_peered":"2023-07-21T22:17:09.840864+0000","last_unstale":"2023-07-21T22:17:44.303842+0000","last_undegraded":"2023-07-21T22:17:44.303842+0000","last_fullsized":"2023-07-21T22:17:44.303842+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:23.181094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485967+0000","last_change":"2023-07-21T22:17:09.837688+0000","last_active":"2023-07-21T22:17:44.485967+0000","last_peered":"2023-07-21T22:17:44.485967+0000","last_clean":"2023-07-21T22:17:44.485967+0000","last_became_active":"2023-07-21T22:17:09.837325+0000","last_became_peered":"2023-07-21T22:17:09.837325+0000","last_unstale":"2023-07-21T22:17:44.485967+0000","last_undegraded":"2023-07-21T22:17:44.485967+0000","last_fullsized":"2023-07-21T22:17:44.485967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:06:00.041198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302967+0000","last_change":"2023-07-21T22:17:09.843791+0000","last_active":"2023-07-21T22:17:44.302967+0000","last_peered":"2023-07-21T22:17:44.302967+0000","last_clean":"2023-07-21T22:17:44.302967+0000","last_became_active":"2023-07-21T22:17:09.843438+0000","last_became_peered":"2023-07-21T22:17:09.843438+0000","last_unstale":"2023-07-21T22:17:44.302967+0000","last_undegraded":"2023-07-21T22:17:44.302967+0000","last_fullsized":"2023-07-21T22:17:44.302967+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:10:55.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305731+0000","last_change":"2023-07-21T22:17:09.849062+0000","last_active":"2023-07-21T22:17:44.305731+0000","last_peered":"2023-07-21T22:17:44.305731+0000","last_clean":"2023-07-21T22:17:44.305731+0000","last_became_active":"2023-07-21T22:17:09.848153+0000","last_became_peered":"2023-07-21T22:17:09.848153+0000","last_unstale":"2023-07-21T22:17:44.305731+0000","last_undegraded":"2023-07-21T22:17:44.305731+0000","last_fullsized":"2023-07-21T22:17:44.305731+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:30.677689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299885+0000","last_change":"2023-07-21T22:17:09.849010+0000","last_active":"2023-07-21T22:17:44.299885+0000","last_peered":"2023-07-21T22:17:44.299885+0000","last_clean":"2023-07-21T22:17:44.299885+0000","last_became_active":"2023-07-21T22:17:09.848679+0000","last_became_peered":"2023-07-21T22:17:09.848679+0000","last_unstale":"2023-07-21T22:17:44.299885+0000","last_undegraded":"2023-07-21T22:17:44.299885+0000","last_fullsized":"2023-07-21T22:17:44.299885+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:40.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":16,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.300645+0000","last_change":"2023-07-21T22:17:09.846419+0000","last_active":"2023-07-21T22:17:44.300645+0000","last_peered":"2023-07-21T22:17:44.300645+0000","last_clean":"2023-07-21T22:17:44.300645+0000","last_became_active":"2023-07-21T22:17:09.846037+0000","last_became_peered":"2023-07-21T22:17:09.846037+0000","last_unstale":"2023-07-21T22:17:44.300645+0000","last_undegraded":"2023-07-21T22:17:44.300645+0000","last_fullsized":"2023-07-21T22:17:44.300645+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:33:14.382111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248938,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60730,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":324,"num_read_kb":225,"num_write":149,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":405504,"data_stored":182190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":131,"ondisk_log_size":131,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383705,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":456133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.621}]},{"osd":1,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.085,"5min":1.085,"15min":1.085},"last":0.872},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.70799999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.89500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.755}]},{"osd":5,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.1120000000000001,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.68600000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.628}]},{"osd":7,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.7350000000000001,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":1.6539999999999999,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.80100000000000005}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72299999999999998}]},{"osd":9,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.5960000000000001,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.874,"5min":0.874,"15min":0.874},"min":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.92000000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.82199999999999995}]}]},{"osd":10,"up_from":72,"seq":309237645343,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1089536,"data_stored":1104788,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78600000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.622,"15min":0.626},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60099999999999998,"15min":0.60499999999999998},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.81999999999999995,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46300000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.79500000000000004,"15min":0.80100000000000005},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":1.101,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.875},{"interface":"front","average":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.88300000000000001},"min":{"1min":0.46100000000000002,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.048,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.95499999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.89100000000000001,"15min":0.88300000000000001},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":4.3739999999999997,"5min":4.3739999999999997,"15min":4.3739999999999997},"last":0.622},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.82399999999999995,"15min":0.80800000000000005},"min":{"1min":0.52600000000000002,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":4.5439999999999996,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.78100000000000003,"15min":0.79300000000000004},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.94199999999999995,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.67900000000000005,"15min":0.68500000000000005},"min":{"1min":0.379,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.98599999999999999,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.65500000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.83999999999999997,"5min":0.86799999999999999,"15min":0.872},"min":{"1min":0.59099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.0589999999999999,"5min":1.224,"15min":1.224},"last":1.016},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.93700000000000006,"15min":0.95699999999999996},"min":{"1min":0.61099999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.0389999999999999,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":0.749}]},{"osd":6,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":1.069,"5min":1.026,"15min":1.0189999999999999},"min":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":4.6600000000000001,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":1.0049999999999999,"5min":0.93300000000000005,"15min":0.92100000000000004},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":4.4889999999999999,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.64100000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.63800000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.873,"5min":0.97599999999999998,"15min":0.99299999999999999},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.123,"5min":1.431,"15min":1.431},"last":1.03},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.998,"15min":1.0169999999999999},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2070000000000001,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.91600000000000004}]},{"osd":9,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":1.012,"15min":1.0049999999999999},"min":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":3.3719999999999999,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":1,"5min":1.0389999999999999,"15min":1.0449999999999999},"min":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":3.0670000000000002,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":1.085}]},{"osd":11,"last update":"Fri Jul 21 22:17:14 2023","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.98999999999999999},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.626,"5min":0.626,"15min":0.626},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.97299999999999998}]}]},{"osd":9,"up_from":67,"seq":287762808867,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.55500000000000005,"15min":0.57099999999999995},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.38100000000000001,"5min":0.377,"15min":0.377},"max":{"1min":0.73999999999999999,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.28299999999999997}]},{"osd":1,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.77500000000000002,"15min":0.80100000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.89400000000000002,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.84899999999999998,"15min":0.875},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.873,"5min":1.393,"15min":1.393},"last":0.57399999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71499999999999997,"5min":0.77900000000000003,"15min":0.78900000000000003},"min":{"1min":0.443,"5min":0.443,"15min":0.443},"max":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.70499999999999996,"5min":0.81899999999999995,"15min":0.83799999999999997},"min":{"1min":0.58399999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.95099999999999996,"5min":1.335,"15min":1.335},"last":0.68700000000000006}]},{"osd":3,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.74099999999999999,"15min":0.77300000000000002},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.877,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.71099999999999997,"15min":0.73199999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":1.097,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.34100000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.71999999999999997,"5min":0.86099999999999999,"15min":0.88500000000000001},"min":{"1min":0.52900000000000003,"5min":0.496,"15min":0.496},"max":{"1min":0.96499999999999997,"5min":1.464,"15min":1.464},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.88100000000000001,"15min":0.90800000000000003},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":0.96299999999999997,"5min":1.3,"15min":1.3},"last":0.60399999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.88500000000000001,"15min":0.91100000000000003},"min":{"1min":0.56799999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.012,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.754,"5min":0.86499999999999999,"15min":0.88300000000000001},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.095,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.82999999999999996,"15min":0.85699999999999998},"min":{"1min":0.497,"5min":0.441,"15min":0.441},"max":{"1min":1.0620000000000001,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.75800000000000001,"5min":0.93000000000000005,"15min":0.95899999999999996},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":0.95099999999999996,"5min":1.431,"15min":1.431},"last":0.48499999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.97099999999999997,"15min":1.0049999999999999},"min":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.05,"5min":1.696,"15min":1.696},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.80900000000000005,"5min":0.97499999999999998,"15min":1.0029999999999999},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.131,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.76900000000000002}]},{"osd":8,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.997,"15min":1.022},"min":{"1min":0.68300000000000005,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.0249999999999999,"5min":1.496,"15min":1.496},"last":0.621},{"interface":"front","average":{"1min":0.83899999999999997,"5min":0.99299999999999999,"15min":1.0189999999999999},"min":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":1.083,"5min":1.667,"15min":1.667},"last":0.73599999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:17:51 2023","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.94399999999999995,"15min":0.96199999999999997},"min":{"1min":0.71199999999999997,"5min":0.66500000000000004,"15min":0.66500000000000004},"max":{"1min":0.98899999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.86299999999999999,"5min":0.95099999999999996,"15min":0.96499999999999997},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":1.1870000000000001,"5min":1.264,"15min":1.264},"last":0.82399999999999995}]}]},{"osd":8,"up_from":59,"seq":253403070505,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68300000000000005,"15min":0.70099999999999996},"min":{"1min":0.48099999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.51400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.88,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.083,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.997}]},{"osd":2,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.373,"15min":0.373},"max":{"1min":0.97799999999999998,"5min":1.056,"15min":1.056},"last":0.94999999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.70899999999999996}]},{"osd":3,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.80300000000000005},"min":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0009999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.97999999999999998},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72899999999999998,"15min":0.749},"min":{"1min":0.442,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.74199999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.84299999999999997,"15min":0.84899999999999998},"min":{"1min":0.68400000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1719999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":1.099}]},{"osd":5,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":1.03},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.76900000000000002},"min":{"1min":0.53100000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98099999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.82499999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.88800000000000001,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1950000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":1.292},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.93799999999999994,"15min":0.94599999999999995},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":1.1399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.90000000000000002,"15min":0.91300000000000003},"min":{"1min":0.72999999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":1.2490000000000001},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90800000000000003,"15min":0.92600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.155,"5min":1.321,"15min":1.321},"last":1.0680000000000001}]},{"osd":9,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.87,"5min":0.83299999999999996,"15min":0.82699999999999996},"min":{"1min":0.57099999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.214,"5min":1.214,"15min":1.214},"last":1.1799999999999999},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.88200000000000001,"15min":0.88400000000000001},"min":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":1.1359999999999999,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":1.1990000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.74299999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.2190000000000001,"5min":1.254,"15min":1.254},"last":1.2669999999999999},{"interface":"front","average":{"1min":0.995,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.755,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.3109999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.153}]}]},{"osd":7,"up_from":51,"seq":219043332141,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":1003520,"data_stored":1047797,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51700000000000002,"15min":0.497},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.89900000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.34999999999999998,"5min":0.315,"15min":0.315},"max":{"1min":0.82899999999999996,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.59099999999999997}]},{"osd":2,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.66700000000000004,"15min":0.65100000000000002},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.90000000000000002,"5min":0.96799999999999997,"15min":0.96799999999999997},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.69599999999999995,"15min":0.68000000000000005},"min":{"1min":0.48199999999999998,"5min":0.437,"15min":0.437},"max":{"1min":1.0409999999999999,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.49199999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.77700000000000002,"15min":0.73599999999999999},"min":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":4.1669999999999998,"5min":4.1669999999999998,"15min":4.1669999999999998},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.91800000000000004,"5min":0.76200000000000001,"15min":0.72499999999999998},"min":{"1min":0.56000000000000005,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":4.2050000000000001},"last":0.71499999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.65000000000000002,"15min":0.64400000000000002},"min":{"1min":0.39400000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.0169999999999999,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.65200000000000002,"15min":0.66800000000000004},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.46899999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.75,"5min":0.76600000000000001,"15min":0.76400000000000001},"min":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":0.996,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.80000000000000004,"15min":0.79800000000000004},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.0129999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.624}]},{"osd":6,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":0.82799999999999996,"15min":0.78200000000000003},"min":{"1min":0.52500000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":7.1479999999999997,"5min":7.1479999999999997,"15min":7.1479999999999997},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.222,"5min":0.89500000000000002,"15min":0.84099999999999997},"min":{"1min":0.55600000000000005,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":9.1110000000000007,"5min":9.1110000000000007,"15min":9.1110000000000007},"last":0.74099999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.91500000000000004},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84099999999999997,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.79100000000000004}]},{"osd":9,"last update":"Fri Jul 21 22:17:21 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.85499999999999998,"15min":0.85899999999999999},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.84299999999999997,"5min":0.85299999999999998,"15min":0.85499999999999998},"min":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":1.0880000000000001,"5min":1.119,"15min":1.119},"last":0.95699999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.88800000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"min":{"1min":0.625,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.3200000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.93600000000000005,"15min":0.94499999999999995},"min":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"max":{"1min":1.2030000000000001,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.755}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":6,"up_from":46,"seq":197568495668,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":455764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.434}]},{"osd":1,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.51300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1970000000000001,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":1.143,"15min":1.143},"last":0.72199999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.54700000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.54000000000000004}]},{"osd":3,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.377},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.372,"15min":0.372},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.41299999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.72999999999999998},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.76500000000000001},"min":{"1min":0.47999999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":3.8759999999999999,"15min":3.8759999999999999},"last":0.77200000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.57399999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94999999999999996,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76700000000000002,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.78800000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:17:32 2023","interfaces":[{"interface":"back","average":{"1min":0.78200000000000003,"5min":0.75700000000000001,"15min":0.73199999999999998},"min":{"1min":0.60099999999999998,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.284,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.747,"5min":0.755,"15min":0.751},"min":{"1min":0.61199999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.002,"5min":1.071,"15min":1.071},"last":0.61399999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.623,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82699999999999996,"15min":0.80900000000000005},"min":{"1min":0.65600000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.004,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.63200000000000001}]},{"osd":9,"last update":"Fri Jul 21 22:17:27 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.78900000000000003,"15min":0.79900000000000004},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":0.97499999999999998,"5min":1.1519999999999999,"15min":1.1519999999999999},"last":0.754},{"interface":"front","average":{"1min":0.78900000000000003,"5min":0.86499999999999999,"15min":0.878},"min":{"1min":0.56000000000000005,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.1200000000000001,"5min":1.4099999999999999,"15min":1.4099999999999999},"last":0.70799999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:17:51 2023","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":0.90900000000000003,"15min":0.91600000000000004},"min":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.3480000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.876,"15min":0.88600000000000001},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":1.0449999999999999,"5min":1.196,"15min":1.196},"last":0.79700000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27928,"kb_used_data":976,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717224,"statfs":{"total":95995035648,"available":95966437376,"internally_reserved":0,"allocated":999424,"data_stored":512104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.48899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84299999999999997,"5min":0.98599999999999999,"15min":1.0620000000000001},"last":0.82399999999999995},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.61499999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.64800000000000002,"15min":0.64100000000000001},"min":{"1min":0.496,"5min":0.433,"15min":0.433},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.85799999999999998},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.63500000000000001,"15min":0.63600000000000001},"min":{"1min":0.46200000000000002,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.91900000000000004,"5min":0.93700000000000006,"15min":0.93700000000000006},"last":0.74399999999999999}]},{"osd":3,"last update":"Fri Jul 21 22:17:45 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72999999999999998,"15min":0.68999999999999995},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86299999999999999,"5min":7.2720000000000002,"15min":7.2720000000000002},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.67300000000000004,"15min":0.66300000000000003},"min":{"1min":0.48299999999999998,"5min":0.439,"15min":0.439},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.76600000000000001}]},{"osd":4,"last update":"Fri Jul 21 22:17:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.51400000000000001,"15min":0.47999999999999998},"min":{"1min":0.376,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.53100000000000003,"15min":0.497},"min":{"1min":0.40400000000000003,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.78300000000000003,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":0.71699999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.67100000000000004,"15min":0.65800000000000003},"min":{"1min":0.47899999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":1.0049999999999999,"5min":1.0049999999999999,"15min":1.0049999999999999},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.69899999999999995,"15min":0.66500000000000004},"min":{"1min":0.51700000000000002,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.91500000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.81599999999999995,"5min":0.74399999999999999,"15min":0.72099999999999997},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":1.0189999999999999,"5min":1.036,"15min":1.036},"last":0.873},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.79500000000000004,"15min":0.74099999999999999},"min":{"1min":0.56999999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":0.88200000000000001,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":0.67200000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:17:35 2023","interfaces":[{"interface":"back","average":{"1min":0.69999999999999996,"5min":0.63,"15min":0.59899999999999998},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.96899999999999997,"5min":1.03,"15min":1.03},"last":0.499},{"interface":"front","average":{"1min":0.73899999999999999,"5min":0.69599999999999995,"15min":0.67600000000000005},"min":{"1min":0.53500000000000003,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.91700000000000004,"5min":1.0129999999999999,"15min":1.0129999999999999},"last":0.80000000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.79500000000000004,"15min":0.78300000000000003},"min":{"1min":0.67200000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.84899999999999998,"15min":0.81499999999999995},"min":{"1min":0.79900000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.95499999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:17:29 2023","interfaces":[{"interface":"back","average":{"1min":0.88300000000000001,"5min":0.83899999999999997,"15min":0.83199999999999996},"min":{"1min":0.56599999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.095,"5min":1.095,"15min":1.095},"last":1.0009999999999999},{"interface":"front","average":{"1min":0.82499999999999996,"5min":1.0980000000000001,"15min":1.1439999999999999},"min":{"1min":0.65800000000000003,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":0.97499999999999998,"5min":7.4530000000000003,"15min":7.4530000000000003},"last":1.0660000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:17:51 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.82499999999999996,"15min":0.81599999999999995},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":1,"5min":0.92400000000000004,"15min":0.91100000000000003},"min":{"1min":0.78500000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.1659999999999999,"5min":1.1659999999999999,"15min":1.1659999999999999},"last":1.0449999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.111}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":457029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91400000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.64100000000000001},"min":{"1min":0.50800000000000001,"5min":0.44,"15min":0.432},"max":{"1min":1.002,"5min":1.244,"15min":1.244},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:17:23 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.64200000000000002,"15min":0.61199999999999999},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.64700000000000002,"15min":0.60299999999999998},"min":{"1min":0.437,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.84099999999999997,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.85499999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:15:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.47799999999999998,"15min":0.46100000000000002},"min":{"1min":0.32900000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"last":0.313},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.55600000000000005,"15min":0.53300000000000003},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.58699999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64600000000000002,"15min":0.60399999999999998},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97499999999999998,"5min":1.1579999999999999,"15min":1.1579999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.67700000000000005,"15min":0.64500000000000002},"min":{"1min":0.499,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.012,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.73399999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.71499999999999997,"15min":0.70199999999999996},"min":{"1min":0.60099999999999998,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.97599999999999998,"5min":1.508,"15min":1.508},"last":0.83299999999999996},{"interface":"front","average":{"1min":0.73099999999999998,"5min":0.70899999999999996,"15min":0.69699999999999995},"min":{"1min":0.46100000000000002,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.96999999999999997,"5min":1.335,"15min":1.335},"last":0.70399999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:17:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.58199999999999996},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.95499999999999996,"5min":1.0629999999999999,"15min":1.0629999999999999},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.65900000000000003,"15min":0.64900000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.46999999999999997}]},{"osd":7,"last update":"Fri Jul 21 22:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.751}]},{"osd":8,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.61399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88200000000000001,"5min":1.163,"15min":1.163},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.66000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.72499999999999998}]},{"osd":9,"last update":"Fri Jul 21 22:17:25 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.871,"15min":0.89400000000000002},"min":{"1min":0.47499999999999998,"5min":0.439,"15min":0.439},"max":{"1min":1.0369999999999999,"5min":1.198,"15min":1.198},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.40200000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0800000000000001,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.54600000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.88900000000000001,"15min":0.90300000000000002},"min":{"1min":0.57899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.484,"5min":1.484,"15min":1.484},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.83499999999999996,"5min":1.2370000000000001,"15min":1.304},"min":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.4259999999999999,"5min":7.5209999999999999,"15min":7.5209999999999999},"last":0.77700000000000002}]},{"osd":11,"last update":"Fri Jul 21 22:17:15 2023","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.357,"5min":1.357,"15min":1.357},"last":0.79300000000000004},{"interface":"front","average":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":0.753}]}]},{"osd":2,"up_from":18,"seq":77309411400,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":1000,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":1024000,"data_stored":513406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.98699999999999999,"5min":1.278,"15min":1.278},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.63,"5min":0.60599999999999998,"15min":0.58399999999999996},"min":{"1min":0.38100000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.0740000000000001,"5min":1.345,"15min":1.345},"last":0.439}]},{"osd":1,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.66300000000000003,"15min":0.61099999999999999},"min":{"1min":0.45000000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.78800000000000003,"5min":0.68000000000000005,"15min":0.61599999999999999},"min":{"1min":0.46500000000000002,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.4079999999999999,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.93500000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68100000000000005,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.67300000000000004},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jul 21 22:16:15 2023","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.67600000000000005,"15min":0.68000000000000005},"min":{"1min":0.46000000000000002,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":1.143,"5min":1.143,"15min":1.143},"last":0.753},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.69299999999999995,"15min":0.70399999999999996},"min":{"1min":0.51700000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.80200000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:17:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.60199999999999998,"15min":0.56699999999999995},"min":{"1min":0.374,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.80500000000000005,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.59799999999999998,"15min":0.55500000000000005},"min":{"1min":0.38800000000000001,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.93700000000000006,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:17:07 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.746,"15min":0.73699999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.292,"5min":1.292,"15min":1.292},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.77000000000000002,"15min":0.752},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.331,"5min":1.331,"15min":1.331},"last":0.78500000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60999999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96399999999999997,"5min":1.409,"15min":1.409},"last":0.73899999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.113,"5min":1.181,"15min":1.181},"last":0.76400000000000001}]},{"osd":9,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.871,"15min":0.88900000000000001},"min":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.29,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.92600000000000005,"5min":0.97899999999999998,"15min":0.98799999999999999},"min":{"1min":0.63,"5min":0.63,"15min":0.63},"max":{"1min":2.6299999999999999,"5min":2.6299999999999999,"15min":2.6299999999999999},"last":0.86899999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.88100000000000001,"15min":0.879},"min":{"1min":0.57499999999999996,"5min":0.496,"15min":0.496},"max":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.88900000000000001},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.92900000000000005,"15min":0.93600000000000005},"min":{"1min":0.71399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.68899999999999995}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97799999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182467,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":456081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.45700000000000002,"15min":0.41599999999999998},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.499,"15min":0.443},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.34899999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.60499999999999998},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.76400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.71599999999999997,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.70599999999999996,"15min":0.65000000000000002},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.66000000000000003}]},{"osd":4,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.745,"15min":0.69099999999999995},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.97099999999999997,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.70099999999999996,"15min":0.67900000000000005},"min":{"1min":0.47099999999999997,"5min":0.443,"15min":0.443},"max":{"1min":0.95499999999999996,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.70599999999999996}]},{"osd":5,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73099999999999998,"5min":0.70199999999999996,"15min":0.68300000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.702,"5min":1.702,"15min":1.702},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.75700000000000001,"15min":0.72199999999999998},"min":{"1min":0.52400000000000002,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.52000000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:17:12 2023","interfaces":[{"interface":"back","average":{"1min":0.76700000000000002,"5min":0.71699999999999997,"15min":0.69099999999999995},"min":{"1min":0.51000000000000001,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1739999999999999,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.72299999999999998,"15min":0.72199999999999998},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.999,"5min":1.1419999999999999,"15min":1.1419999999999999},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Jul 21 22:17:31 2023","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.995,"15min":1.0620000000000001},"min":{"1min":0.58699999999999997,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.0499999999999998,"5min":6.9740000000000002,"15min":6.9740000000000002},"last":0.752},{"interface":"front","average":{"1min":0.80900000000000005,"5min":1.0229999999999999,"15min":1.1000000000000001},"min":{"1min":0.60599999999999998,"5min":0.52900000000000003,"15min":0.52900000000000003},"max":{"1min":1.8069999999999999,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.82899999999999996}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.1140000000000001,"15min":1.157},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.083,"5min":7.0030000000000001,"15min":7.0030000000000001},"last":0.629},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1080000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73499999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:17:22 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.91400000000000003,"15min":0.93200000000000005},"min":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.2450000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.88300000000000001,"15min":0.90000000000000002},"min":{"1min":0.61399999999999999,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":1.048,"5min":1.2789999999999999,"15min":1.2789999999999999},"last":0.625}]},{"osd":10,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97899999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.77300000000000002}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80900000000000005}]}]},{"osd":4,"up_from":33,"seq":141733920831,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":456537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.873,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.46500000000000002,"15min":0.42799999999999999},"min":{"1min":0.35899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.67100000000000004,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.49199999999999999,"15min":0.44900000000000001},"min":{"1min":0.33300000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.90500000000000003,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.49299999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.68500000000000005,"15min":0.64700000000000002},"min":{"1min":0.56299999999999994,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.78400000000000003,"5min":0.70499999999999996,"15min":0.65900000000000003},"min":{"1min":0.57199999999999995,"5min":0.376,"15min":0.376},"max":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"last":0.88500000000000001}]},{"osd":3,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.64300000000000002,"15min":0.57799999999999996},"min":{"1min":0.44900000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.95299999999999996,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.67100000000000004,"15min":0.62},"min":{"1min":0.437,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0329999999999999,"5min":1.236,"15min":1.236},"last":0.66300000000000003}]},{"osd":5,"last update":"Fri Jul 21 22:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.75800000000000001,"15min":0.72999999999999998},"min":{"1min":0.58599999999999997,"5min":0.503,"15min":0.503},"max":{"1min":1.165,"5min":1.194,"15min":1.194},"last":0.84899999999999998},{"interface":"front","average":{"1min":0.85299999999999998,"5min":0.76600000000000001,"15min":0.73199999999999998},"min":{"1min":0.59599999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.1739999999999999,"5min":1.175,"15min":1.175},"last":0.80100000000000005}]},{"osd":6,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.093,"15min":1.093},"last":0.745},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0629999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.73399999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:17:39 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.65300000000000002},"min":{"1min":0.42499999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.98599999999999999,"5min":1.127,"15min":1.127},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.78300000000000003,"5min":0.71399999999999997,"15min":0.67600000000000005},"min":{"1min":0.45500000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0349999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.83099999999999996}]},{"osd":8,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.624,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0529999999999999,"5min":1.165,"15min":1.165},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.224,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.96099999999999997}]},{"osd":9,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.89900000000000002,"15min":0.89700000000000002},"min":{"1min":0.61199999999999999,"5min":0.503,"15min":0.503},"max":{"1min":1.1890000000000001,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.90000000000000002},{"interface":"front","average":{"1min":0.81399999999999995,"5min":0.86699999999999999,"15min":0.876},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.995,"5min":1.21,"15min":1.21},"last":0.61599999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:17:50 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.92700000000000005,"15min":0.93899999999999995},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.21,"5min":1.327,"15min":1.327},"last":0.78000000000000003},{"interface":"front","average":{"1min":0.95299999999999996,"5min":0.99199999999999999,"15min":0.998},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.2889999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.93400000000000005}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]}]},{"osd":5,"up_from":38,"seq":163208757305,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":1047470,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59599999999999997,"15min":0.58599999999999997},"min":{"1min":0.40799999999999997,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.79000000000000004,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.60199999999999998,"15min":0.59299999999999997},"min":{"1min":0.34899999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.76300000000000001,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.50900000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":0.63900000000000001,"15min":0.59299999999999997},"min":{"1min":0.436,"5min":0.374,"15min":0.374},"max":{"1min":0.92000000000000004,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.65100000000000002},"min":{"1min":0.39900000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.95399999999999996,"5min":6.9340000000000002,"15min":6.9340000000000002},"last":0.85499999999999998}]},{"osd":2,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.5,"15min":0.47899999999999998},"min":{"1min":0.36299999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.53600000000000003,"15min":0.502},"min":{"1min":0.36099999999999999,"5min":0.317,"15min":0.317},"max":{"1min":0.879,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.58599999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.70299999999999996,"15min":0.65500000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89700000000000002,"5min":6.9160000000000004,"15min":6.9160000000000004},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.71399999999999997,"15min":0.66800000000000004},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.78800000000000003,"5min":7.0129999999999999,"15min":7.0129999999999999},"last":0.54400000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:17:41 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.70199999999999996,"15min":0.65700000000000003},"min":{"1min":0.495,"5min":0.435,"15min":0.435},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.69899999999999995,"15min":0.66600000000000004},"min":{"1min":0.46800000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.94099999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:17:10 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.78100000000000003,"15min":0.73499999999999999},"min":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":0.873,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.72999999999999998,"15min":0.73299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":0.89500000000000002,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.68500000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:17:38 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.80300000000000005,"15min":0.80100000000000005},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.2390000000000001,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.91000000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.78000000000000003,"15min":0.77300000000000002},"min":{"1min":0.59399999999999997,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.139,"5min":1.139,"15min":1.139},"last":0.79200000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76400000000000001,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.071,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.873}]},{"osd":9,"last update":"Fri Jul 21 22:17:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.83699999999999997,"15min":0.84899999999999998},"min":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.80700000000000005},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.83399999999999996,"15min":0.84599999999999997},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.83799999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:17:49 2023","interfaces":[{"interface":"back","average":{"1min":0.872,"5min":0.878,"15min":0.879},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.97699999999999998},{"interface":"front","average":{"1min":0.85199999999999998,"5min":0.86599999999999999,"15min":0.86799999999999999},"min":{"1min":0.64500000000000002,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.95799999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":56826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":58746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:08.368 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2023-07-21T22:18:08.369 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-07-21T22:18:08.369 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2023-07-21T22:18:08.369 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph health --format=json 2023-07-21T22:18:08.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:08 smithi151 ceph-mon[95510]: pgmap v329: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:08.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:08 smithi187 ceph-mon[96918]: pgmap v329: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:08.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:08 smithi195 ceph-mon[97365]: pgmap v329: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:09.091 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:09.659 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:09 smithi151 ceph-mon[95510]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:09.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:09 smithi187 ceph-mon[96918]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:09.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:09 smithi195 ceph-mon[97365]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:10.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.591+0000 7fda14fb8700 1 -- 172.21.15.151:0/2452987333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10100df0 msgr2=0x7fda101011c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:10.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.591+0000 7fda14fb8700 1 --2- 172.21.15.151:0/2452987333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10100df0 0x7fda101011c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fda00009990 tx=0x7fda00009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.592+0000 7fda14fb8700 1 -- 172.21.15.151:0/2452987333 shutdown_connections 2023-07-21T22:18:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.592+0000 7fda14fb8700 1 --2- 172.21.15.151:0/2452987333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda1010a140 0x7fda1010c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.592+0000 7fda14fb8700 1 --2- 172.21.15.151:0/2452987333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10100df0 0x7fda101011c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.592+0000 7fda14fb8700 1 --2- 172.21.15.151:0/2452987333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda10101700 0x7fda10109c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.592+0000 7fda14fb8700 1 -- 172.21.15.151:0/2452987333 >> 172.21.15.151:0/2452987333 conn(0x7fda10075b70 msgr2=0x7fda10075f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.592+0000 7fda14fb8700 1 -- 172.21.15.151:0/2452987333 shutdown_connections 2023-07-21T22:18:10.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.592+0000 7fda14fb8700 1 -- 172.21.15.151:0/2452987333 wait complete. 2023-07-21T22:18:10.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.593+0000 7fda14fb8700 1 Processor -- start 2023-07-21T22:18:10.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.593+0000 7fda14fb8700 1 -- start start 2023-07-21T22:18:10.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.593+0000 7fda14fb8700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda10100df0 0x7fda10197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:10.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.593+0000 7fda14fb8700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10101700 0x7fda10198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:10.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.593+0000 7fda14fb8700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1010a140 0x7fda1019c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.593+0000 7fda14fb8700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1019cd90 con 0x7fda10101700 2023-07-21T22:18:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.593+0000 7fda14fb8700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1019cf00 con 0x7fda10100df0 2023-07-21T22:18:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.593+0000 7fda14fb8700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda1019d0c0 con 0x7fda1010a140 2023-07-21T22:18:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10101700 0x7fda10198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10101700 0x7fda10198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32910/0 (socket says 172.21.15.151:32910) 2023-07-21T22:18:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0dd9b700 1 -- 172.21.15.151:0/3394290359 learned_addr learned my addr 172.21.15.151:0/3394290359 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0e59c700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda10100df0 0x7fda10197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:10.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0ed9d700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1010a140 0x7fda1019c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0dd9b700 1 -- 172.21.15.151:0/3394290359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1010a140 msgr2=0x7fda1019c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0dd9b700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1010a140 0x7fda1019c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0dd9b700 1 -- 172.21.15.151:0/3394290359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda10100df0 msgr2=0x7fda10197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0dd9b700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda10100df0 0x7fda10197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0dd9b700 1 -- 172.21.15.151:0/3394290359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda000095f0 con 0x7fda10101700 2023-07-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0ed9d700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1010a140 0x7fda1019c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:10.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.594+0000 7fda0dd9b700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10101700 0x7fda10198310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fda0400d950 tx=0x7fda0400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.595+0000 7fd9ff7fe700 1 -- 172.21.15.151:0/3394290359 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda04009940 con 0x7fda10101700 2023-07-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.595+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda1019d3a0 con 0x7fda10101700 2023-07-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.595+0000 7fd9ff7fe700 1 -- 172.21.15.151:0/3394290359 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda04010460 con 0x7fda10101700 2023-07-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.595+0000 7fd9ff7fe700 1 -- 172.21.15.151:0/3394290359 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda0400f620 con 0x7fda10101700 2023-07-21T22:18:10.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.595+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda101a4c00 con 0x7fda10101700 2023-07-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.596+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda1004e210 con 0x7fda10101700 2023-07-21T22:18:10.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.598+0000 7fd9ff7fe700 1 -- 172.21.15.151:0/3394290359 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fda040105d0 con 0x7fda10101700 2023-07-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.600+0000 7fd9ff7fe700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11e0 0x7fd9f80a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.600+0000 7fd9ff7fe700 1 -- 172.21.15.151:0/3394290359 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fda040cc920 con 0x7fda10101700 2023-07-21T22:18:10.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.600+0000 7fda0e59c700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11e0 0x7fd9f80a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:10.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.601+0000 7fda0e59c700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11e0 0x7fd9f80a3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda00006010 tx=0x7fda0000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:10.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.604+0000 7fd9ff7fe700 1 -- 172.21.15.151:0/3394290359 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fda04095ee0 con 0x7fda10101700 2023-07-21T22:18:10.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:10 smithi151 ceph-mon[95510]: pgmap v330: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-21T22:18:10.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:10 smithi187 ceph-mon[96918]: pgmap v330: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-21T22:18:10.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.842+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fda10199130 con 0x7fda10101700 2023-07-21T22:18:10.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.842+0000 7fd9ff7fe700 1 -- 172.21.15.151:0/3394290359 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fda04016040 con 0x7fda10101700 2023-07-21T22:18:10.887 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:10.887 INFO:teuthology.orchestra.run.smithi151.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-07-21T22:18:10.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11e0 msgr2=0x7fd9f80a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:10.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11e0 0x7fd9f80a3690 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fda00006010 tx=0x7fda0000b260 comp rx=0 tx=0).stop 2023-07-21T22:18:10.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10101700 msgr2=0x7fda10198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:10.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10101700 0x7fda10198310 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fda0400d950 tx=0x7fda0400dc60 comp rx=0 tx=0).stop 2023-07-21T22:18:10.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 shutdown_connections 2023-07-21T22:18:10.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9f80a11e0 0x7fd9f80a3690 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda10100df0 0x7fda10197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda1010a140 0x7fda1019c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 --2- 172.21.15.151:0/3394290359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda10101700 0x7fda10198310 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:10.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 >> 172.21.15.151:0/3394290359 conn(0x7fda10075b70 msgr2=0x7fda100fe980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:10.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 shutdown_connections 2023-07-21T22:18:10.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:10.845+0000 7fda14fb8700 1 -- 172.21.15.151:0/3394290359 wait complete. 2023-07-21T22:18:10.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:10 smithi195 ceph-mon[97365]: pgmap v330: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-21T22:18:11.372 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2023-07-21T22:18:11.372 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:11.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.535+0000 7f86bbbff700 1 -- 172.21.15.151:0/407567514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b40ffb00 msgr2=0x7f86b40fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:11.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.535+0000 7f86bbbff700 1 --2- 172.21.15.151:0/407567514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b40ffb00 0x7f86b40fff10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f86b0009990 tx=0x7f86b0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.535+0000 7f86bbbff700 1 -- 172.21.15.151:0/407567514 shutdown_connections 2023-07-21T22:18:11.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.535+0000 7f86bbbff700 1 --2- 172.21.15.151:0/407567514 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86b4101680 0x7f86b4107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.535+0000 7f86bbbff700 1 --2- 172.21.15.151:0/407567514 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b40ffb00 0x7f86b40fff10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.535+0000 7f86bbbff700 1 --2- 172.21.15.151:0/407567514 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86b4100cf0 0x7f86b4101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.535+0000 7f86bbbff700 1 -- 172.21.15.151:0/407567514 >> 172.21.15.151:0/407567514 conn(0x7f86b40fb0e0 msgr2=0x7f86b40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:11.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.535+0000 7f86bbbff700 1 -- 172.21.15.151:0/407567514 shutdown_connections 2023-07-21T22:18:11.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.535+0000 7f86bbbff700 1 -- 172.21.15.151:0/407567514 wait complete. 2023-07-21T22:18:11.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.536+0000 7f86bbbff700 1 Processor -- start 2023-07-21T22:18:11.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86bbbff700 1 -- start start 2023-07-21T22:18:11.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86bbbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86b40ffb00 0x7f86b4197860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:11.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86bbbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86b4100cf0 0x7f86b4197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:11.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86bbbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b4101680 0x7f86b419ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:11.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86bbbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b419f3e0 con 0x7f86b4101680 2023-07-21T22:18:11.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86bbbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b419f520 con 0x7f86b4100cf0 2023-07-21T22:18:11.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86bbbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86b419f6b0 con 0x7f86b40ffb00 2023-07-21T22:18:11.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86ba19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b4101680 0x7f86b419ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:11.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86ba19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b4101680 0x7f86b419ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32932/0 (socket says 172.21.15.151:32932) 2023-07-21T22:18:11.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86ba19c700 1 -- 172.21.15.151:0/330120226 learned_addr learned my addr 172.21.15.151:0/330120226 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:11.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86b999b700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86b40ffb00 0x7f86b4197860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:11.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86b919a700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86b4100cf0 0x7f86b4197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:11.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86ba19c700 1 -- 172.21.15.151:0/330120226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86b40ffb00 msgr2=0x7f86b4197860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86ba19c700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86b40ffb00 0x7f86b4197860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86ba19c700 1 -- 172.21.15.151:0/330120226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86b4100cf0 msgr2=0x7f86b4197da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86ba19c700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86b4100cf0 0x7f86b4197da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.537+0000 7f86ba19c700 1 -- 172.21.15.151:0/330120226 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b00095f0 con 0x7f86b4101680 2023-07-21T22:18:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.538+0000 7f86ba19c700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b4101680 0x7f86b419ee10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f86ac007ee0 tx=0x7f86ac00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.538+0000 7f86aaffd700 1 -- 172.21.15.151:0/330120226 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac017070 con 0x7f86b4101680 2023-07-21T22:18:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.538+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86b419f990 con 0x7f86b4101680 2023-07-21T22:18:11.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.538+0000 7f86aaffd700 1 -- 172.21.15.151:0/330120226 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f86ac00f040 con 0x7f86b4101680 2023-07-21T22:18:11.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.538+0000 7f86aaffd700 1 -- 172.21.15.151:0/330120226 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86ac005570 con 0x7f86b4101680 2023-07-21T22:18:11.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.538+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86b419fea0 con 0x7f86b4101680 2023-07-21T22:18:11.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.539+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86b4192090 con 0x7f86b4101680 2023-07-21T22:18:11.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.541+0000 7f86aaffd700 1 -- 172.21.15.151:0/330120226 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f86ac00db20 con 0x7f86b4101680 2023-07-21T22:18:11.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.542+0000 7f86aaffd700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f86a00a1220 0x7f86a00a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:11.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.542+0000 7f86aaffd700 1 -- 172.21.15.151:0/330120226 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f86ac0cc850 con 0x7f86b4101680 2023-07-21T22:18:11.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.543+0000 7f86b999b700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f86a00a1220 0x7f86a00a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:11.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.543+0000 7f86b999b700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f86a00a1220 0x7f86a00a36d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c010 tx=0x7f86b0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:11.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.545+0000 7f86aaffd700 1 -- 172.21.15.151:0/330120226 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f86ac095e10 con 0x7f86b4101680 2023-07-21T22:18:11.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:11 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3394290359' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-21T22:18:11.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.746+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86b402caa0 con 0x7f86b4101680 2023-07-21T22:18:11.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.748+0000 7f86aaffd700 1 -- 172.21.15.151:0/330120226 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7f86ac099430 con 0x7f86b4101680 2023-07-21T22:18:11.793 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:11.793 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:11.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f86a00a1220 msgr2=0x7f86a00a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:11.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f86a00a1220 0x7f86a00a36d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f86b000c010 tx=0x7f86b0005fd0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b4101680 msgr2=0x7f86b419ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:11.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b4101680 0x7f86b419ee10 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f86ac007ee0 tx=0x7f86ac00d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 shutdown_connections 2023-07-21T22:18:11.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f86a00a1220 0x7f86a00a36d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f86b4101680 0x7f86b419ee10 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f86b40ffb00 0x7f86b4197860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 --2- 172.21.15.151:0/330120226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86b4100cf0 0x7f86b4197da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:11.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 >> 172.21.15.151:0/330120226 conn(0x7f86b40fb0e0 msgr2=0x7f86b41065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:11.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 shutdown_connections 2023-07-21T22:18:11.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.750+0000 7f86bbbff700 1 -- 172.21.15.151:0/330120226 wait complete. 2023-07-21T22:18:11.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:18:11.815 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:18:11.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:11 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3394290359' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-21T22:18:11.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:11 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3394290359' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2023-07-21T22:18:12.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.976+0000 7f04511ff700 1 -- 172.21.15.151:0/2592768667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 msgr2=0x7f044c105260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.976+0000 7f04511ff700 1 --2- 172.21.15.151:0/2592768667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 0x7f044c105260 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0440009990 tx=0x7f0440009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.976+0000 7f04511ff700 1 -- 172.21.15.151:0/2592768667 shutdown_connections 2023-07-21T22:18:12.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.976+0000 7f04511ff700 1 --2- 172.21.15.151:0/2592768667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f044c100560 0x7f044c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.976+0000 7f04511ff700 1 --2- 172.21.15.151:0/2592768667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f044c1057a0 0x7f044c107c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.976+0000 7f04511ff700 1 --2- 172.21.15.151:0/2592768667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 0x7f044c105260 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.976+0000 7f04511ff700 1 -- 172.21.15.151:0/2592768667 >> 172.21.15.151:0/2592768667 conn(0x7f044c0fa000 msgr2=0x7f044c0fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:12.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.976+0000 7f04511ff700 1 -- 172.21.15.151:0/2592768667 shutdown_connections 2023-07-21T22:18:12.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.976+0000 7f04511ff700 1 -- 172.21.15.151:0/2592768667 wait complete. 2023-07-21T22:18:12.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.977+0000 7f04511ff700 1 Processor -- start 2023-07-21T22:18:12.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.977+0000 7f04511ff700 1 -- start start 2023-07-21T22:18:12.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f04511ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f044c100560 0x7f044c0ffed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f04511ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 0x7f044c0fe510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f04511ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f044c1057a0 0x7f044c0fea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f04511ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c0ff1f0 con 0x7f044c102e80 2023-07-21T22:18:12.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f04511ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c0ff360 con 0x7f044c1057a0 2023-07-21T22:18:12.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f04511ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f044c19f7d0 con 0x7f044c100560 2023-07-21T22:18:12.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 0x7f044c0fe510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 0x7f044c0fe510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32950/0 (socket says 172.21.15.151:32950) 2023-07-21T22:18:12.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044a59c700 1 -- 172.21.15.151:0/1013805313 learned_addr learned my addr 172.21.15.151:0/1013805313 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:12.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044ad9d700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f044c100560 0x7f044c0ffed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044b59e700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f044c1057a0 0x7f044c0fea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044a59c700 1 -- 172.21.15.151:0/1013805313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f044c100560 msgr2=0x7f044c0ffed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044a59c700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f044c100560 0x7f044c0ffed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044a59c700 1 -- 172.21.15.151:0/1013805313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f044c1057a0 msgr2=0x7f044c0fea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044a59c700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f044c1057a0 0x7f044c0fea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044a59c700 1 -- 172.21.15.151:0/1013805313 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04400095f0 con 0x7f044c102e80 2023-07-21T22:18:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.978+0000 7f044b59e700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f044c1057a0 0x7f044c0fea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.979+0000 7f044a59c700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 0x7f044c0fe510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0440005910 tx=0x7f0440005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.979+0000 7f0433fff700 1 -- 172.21.15.151:0/1013805313 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044001d070 con 0x7f044c102e80 2023-07-21T22:18:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.979+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f044c19fa50 con 0x7f044c102e80 2023-07-21T22:18:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.979+0000 7f0433fff700 1 -- 172.21.15.151:0/1013805313 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0440022470 con 0x7f044c102e80 2023-07-21T22:18:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.979+0000 7f0433fff700 1 -- 172.21.15.151:0/1013805313 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f044000f6c0 con 0x7f044c102e80 2023-07-21T22:18:12.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.979+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f044c19fe70 con 0x7f044c102e80 2023-07-21T22:18:12.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.980+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f044c0fbb70 con 0x7f044c102e80 2023-07-21T22:18:12.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.982+0000 7f0433fff700 1 -- 172.21.15.151:0/1013805313 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f04400225e0 con 0x7f044c102e80 2023-07-21T22:18:12.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.983+0000 7f0433fff700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f04340a11e0 0x7f04340a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.983+0000 7f0433fff700 1 -- 172.21.15.151:0/1013805313 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f04400cdfe0 con 0x7f044c102e80 2023-07-21T22:18:12.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.983+0000 7f044ad9d700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f04340a11e0 0x7f04340a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.984+0000 7f044ad9d700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f04340a11e0 0x7f04340a3690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f043c009c60 tx=0x7f043c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:12.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:11.987+0000 7f0433fff700 1 -- 172.21.15.151:0/1013805313 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f0440097650 con 0x7f044c102e80 2023-07-21T22:18:12.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.183+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f044c02ca70 con 0x7f044c102e80 2023-07-21T22:18:12.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.184+0000 7f0433fff700 1 -- 172.21.15.151:0/1013805313 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f044009ac70 con 0x7f044c102e80 2023-07-21T22:18:12.229 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:18:12.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f04340a11e0 msgr2=0x7f04340a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f04340a11e0 0x7f04340a3690 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f043c009c60 tx=0x7f043c009260 comp rx=0 tx=0).stop 2023-07-21T22:18:12.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 msgr2=0x7f044c0fe510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 0x7f044c0fe510 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0440005910 tx=0x7f0440005720 comp rx=0 tx=0).stop 2023-07-21T22:18:12.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 shutdown_connections 2023-07-21T22:18:12.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f04340a11e0 0x7f04340a3690 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f044c1057a0 0x7f044c0fea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f044c100560 0x7f044c0ffed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 --2- 172.21.15.151:0/1013805313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f044c102e80 0x7f044c0fe510 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 >> 172.21.15.151:0/1013805313 conn(0x7f044c0fa000 msgr2=0x7f044c1011c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:12.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 shutdown_connections 2023-07-21T22:18:12.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.187+0000 7f04511ff700 1 -- 172.21.15.151:0/1013805313 wait complete. 2023-07-21T22:18:12.250 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:18:12.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.408+0000 7f4044fff700 1 -- 172.21.15.151:0/4289718456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40400ffaf0 msgr2=0x7f40400fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.408+0000 7f4044fff700 1 --2- 172.21.15.151:0/4289718456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40400ffaf0 0x7f40400fff00 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4030009990 tx=0x7f4030009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.408+0000 7f4044fff700 1 -- 172.21.15.151:0/4289718456 shutdown_connections 2023-07-21T22:18:12.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.408+0000 7f4044fff700 1 --2- 172.21.15.151:0/4289718456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4040101670 0x7f4040107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.408+0000 7f4044fff700 1 --2- 172.21.15.151:0/4289718456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40400ffaf0 0x7f40400fff00 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.408+0000 7f4044fff700 1 --2- 172.21.15.151:0/4289718456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4040100ce0 0x7f4040101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.408+0000 7f4044fff700 1 -- 172.21.15.151:0/4289718456 >> 172.21.15.151:0/4289718456 conn(0x7f40400fb130 msgr2=0x7f40400fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:12.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.408+0000 7f4044fff700 1 -- 172.21.15.151:0/4289718456 shutdown_connections 2023-07-21T22:18:12.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.408+0000 7f4044fff700 1 -- 172.21.15.151:0/4289718456 wait complete. 2023-07-21T22:18:12.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.409+0000 7f4044fff700 1 Processor -- start 2023-07-21T22:18:12.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.409+0000 7f4044fff700 1 -- start start 2023-07-21T22:18:12.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f4044fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40400ffaf0 0x7f40401979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f4044fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4040100ce0 0x7f4040197f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f4044fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4040101670 0x7f404019ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f4044fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404019f550 con 0x7f4040101670 2023-07-21T22:18:12.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f4044fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404019f690 con 0x7f4040100ce0 2023-07-21T22:18:12.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f4044fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f404019f820 con 0x7f40400ffaf0 2023-07-21T22:18:12.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4040101670 0x7f404019ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4040101670 0x7f404019ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32982/0 (socket says 172.21.15.151:32982) 2023-07-21T22:18:12.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403ed9d700 1 -- 172.21.15.151:0/3876303556 learned_addr learned my addr 172.21.15.151:0/3876303556 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:12.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403e59c700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40400ffaf0 0x7f40401979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403dd9b700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4040100ce0 0x7f4040197f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403ed9d700 1 -- 172.21.15.151:0/3876303556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40400ffaf0 msgr2=0x7f40401979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403ed9d700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40400ffaf0 0x7f40401979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403ed9d700 1 -- 172.21.15.151:0/3876303556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4040100ce0 msgr2=0x7f4040197f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403ed9d700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4040100ce0 0x7f4040197f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.410+0000 7f403ed9d700 1 -- 172.21.15.151:0/3876303556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40300095f0 con 0x7f4040101670 2023-07-21T22:18:12.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.411+0000 7f403ed9d700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4040101670 0x7f404019ef80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4038007ee0 tx=0x7f403800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:12.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.411+0000 7f402f7fe700 1 -- 172.21.15.151:0/3876303556 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f403800ddd0 con 0x7f4040101670 2023-07-21T22:18:12.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.411+0000 7f402f7fe700 1 -- 172.21.15.151:0/3876303556 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f403800f040 con 0x7f4040101670 2023-07-21T22:18:12.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.411+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f404019fb00 con 0x7f4040101670 2023-07-21T22:18:12.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.411+0000 7f402f7fe700 1 -- 172.21.15.151:0/3876303556 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40380047d0 con 0x7f4040101670 2023-07-21T22:18:12.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.411+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40401a0060 con 0x7f4040101670 2023-07-21T22:18:12.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.412+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f404010b1c0 con 0x7f4040101670 2023-07-21T22:18:12.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.414+0000 7f402f7fe700 1 -- 172.21.15.151:0/3876303556 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f4038003a00 con 0x7f4040101670 2023-07-21T22:18:12.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.416+0000 7f402f7fe700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f40280a1260 0x7f40280a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.416+0000 7f402f7fe700 1 -- 172.21.15.151:0/3876303556 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f40380cc340 con 0x7f4040101670 2023-07-21T22:18:12.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.417+0000 7f403e59c700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f40280a1260 0x7f40280a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.417+0000 7f403e59c700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f40280a1260 0x7f40280a3710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4030005910 tx=0x7f403000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:12.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.420+0000 7f402f7fe700 1 -- 172.21.15.151:0/3876303556 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f403804e770 con 0x7f4040101670 2023-07-21T22:18:12.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.619+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f40401a0610 con 0x7f4040101670 2023-07-21T22:18:12.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.620+0000 7f402f7fe700 1 -- 172.21.15.151:0/3876303556 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4038095900 con 0x7f4040101670 2023-07-21T22:18:12.664 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T22:18:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f40280a1260 msgr2=0x7f40280a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f40280a1260 0x7f40280a3710 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4030005910 tx=0x7f403000b260 comp rx=0 tx=0).stop 2023-07-21T22:18:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4040101670 msgr2=0x7f404019ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4040101670 0x7f404019ef80 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4038007ee0 tx=0x7f403800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 shutdown_connections 2023-07-21T22:18:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f40280a1260 0x7f40280a3710 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4040101670 0x7f404019ef80 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f40400ffaf0 0x7f40401979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 --2- 172.21.15.151:0/3876303556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4040100ce0 0x7f4040197f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 >> 172.21.15.151:0/3876303556 conn(0x7f40400fb130 msgr2=0x7f40400fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:12.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 shutdown_connections 2023-07-21T22:18:12.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.622+0000 7f4044fff700 1 -- 172.21.15.151:0/3876303556 wait complete. 2023-07-21T22:18:12.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:12 smithi151 ceph-mon[95510]: pgmap v331: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-21T22:18:12.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:12 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/330120226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:12.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:12 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1013805313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:12.685 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:18:12.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:12 smithi187 ceph-mon[96918]: pgmap v331: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-21T22:18:12.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:12 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/330120226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:12.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:12 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1013805313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:12.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.841+0000 7f5ea19ff700 1 -- 172.21.15.151:0/1691301014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 msgr2=0x7f5e9c072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.841+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/1691301014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 0x7f5e9c072940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c009990 tx=0x7f5e8c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.841+0000 7f5ea19ff700 1 -- 172.21.15.151:0/1691301014 shutdown_connections 2023-07-21T22:18:12.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.841+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/1691301014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9c107980 0x7f5e9c109e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.841+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/1691301014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 0x7f5e9c072940 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.841+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/1691301014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e9c072f10 0x7f5e9c073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.841+0000 7f5ea19ff700 1 -- 172.21.15.151:0/1691301014 >> 172.21.15.151:0/1691301014 conn(0x7f5e9c0fb130 msgr2=0x7f5e9c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:12.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.841+0000 7f5ea19ff700 1 -- 172.21.15.151:0/1691301014 shutdown_connections 2023-07-21T22:18:12.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.841+0000 7f5ea19ff700 1 -- 172.21.15.151:0/1691301014 wait complete. 2023-07-21T22:18:12.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.842+0000 7f5ea19ff700 1 Processor -- start 2023-07-21T22:18:12.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.842+0000 7f5ea19ff700 1 -- start start 2023-07-21T22:18:12.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.842+0000 7f5ea19ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e9c072f10 0x7f5e9c1979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.888 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.842+0000 7f5ea19ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 0x7f5e9c197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.842+0000 7f5ea19ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9c107980 0x7f5e9c19efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.842+0000 7f5ea19ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c19f570 con 0x7f5e9c0744f0 2023-07-21T22:18:12.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.842+0000 7f5ea19ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c19f6b0 con 0x7f5e9c107980 2023-07-21T22:18:12.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.842+0000 7f5ea19ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9c19f840 con 0x7f5e9c072f10 2023-07-21T22:18:12.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e93fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 0x7f5e9c197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e93fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 0x7f5e9c197f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33002/0 (socket says 172.21.15.151:33002) 2023-07-21T22:18:12.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e93fff700 1 -- 172.21.15.151:0/645528999 learned_addr learned my addr 172.21.15.151:0/645528999 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:12.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e9affd700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e9c072f10 0x7f5e9c1979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e9b7fe700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9c107980 0x7f5e9c19efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e93fff700 1 -- 172.21.15.151:0/645528999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e9c072f10 msgr2=0x7f5e9c1979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e93fff700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e9c072f10 0x7f5e9c1979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e93fff700 1 -- 172.21.15.151:0/645528999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9c107980 msgr2=0x7f5e9c19efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:12.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e93fff700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9c107980 0x7f5e9c19efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:12.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e93fff700 1 -- 172.21.15.151:0/645528999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e8c0095f0 con 0x7f5e9c0744f0 2023-07-21T22:18:12.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5e93fff700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 0x7f5e9c197f30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400d950 tx=0x7f5e8400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:12.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.843+0000 7f5ea09fd700 1 -- 172.21.15.151:0/645528999 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400f890 con 0x7f5e9c0744f0 2023-07-21T22:18:12.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.844+0000 7f5ea09fd700 1 -- 172.21.15.151:0/645528999 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5e8400fe80 con 0x7f5e9c0744f0 2023-07-21T22:18:12.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.844+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e9c19fb20 con 0x7f5e9c0744f0 2023-07-21T22:18:12.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.844+0000 7f5ea09fd700 1 -- 172.21.15.151:0/645528999 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8400e3b0 con 0x7f5e9c0744f0 2023-07-21T22:18:12.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.844+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e9c1a0080 con 0x7f5e9c0744f0 2023-07-21T22:18:12.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.845+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9c1060c0 con 0x7f5e9c0744f0 2023-07-21T22:18:12.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.847+0000 7f5ea09fd700 1 -- 172.21.15.151:0/645528999 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f5e84010460 con 0x7f5e9c0744f0 2023-07-21T22:18:12.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.848+0000 7f5ea09fd700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5e880a1260 0x7f5e880a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:12.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.849+0000 7f5ea09fd700 1 -- 172.21.15.151:0/645528999 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f5e840cc240 con 0x7f5e9c0744f0 2023-07-21T22:18:12.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.849+0000 7f5e9affd700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5e880a1260 0x7f5e880a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:12.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.849+0000 7f5e9affd700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5e880a1260 0x7f5e880a3710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00b5c0 tx=0x7f5e8c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:12.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:12.852+0000 7f5ea09fd700 1 -- 172.21.15.151:0/645528999 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f5e84095800 con 0x7f5e9c0744f0 2023-07-21T22:18:12.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:12 smithi195 ceph-mon[97365]: pgmap v331: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-21T22:18:12.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:12 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/330120226' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:12.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:12 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1013805313' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.054+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5e9c02ca70 con 0x7f5e9c0744f0 2023-07-21T22:18:13.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.055+0000 7f5ea09fd700 1 -- 172.21.15.151:0/645528999 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5e84098e20 con 0x7f5e9c0744f0 2023-07-21T22:18:13.099 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T22:18:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.057+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5e880a1260 msgr2=0x7f5e880a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.057+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5e880a1260 0x7f5e880a3710 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00b5c0 tx=0x7f5e8c005fb0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.057+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 msgr2=0x7f5e9c197f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.057+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 0x7f5e9c197f30 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5e8400d950 tx=0x7f5e8400dc60 comp rx=0 tx=0).stop 2023-07-21T22:18:13.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.058+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 shutdown_connections 2023-07-21T22:18:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.058+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f5e880a1260 0x7f5e880a3710 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.058+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9c107980 0x7f5e9c19efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.058+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5e9c072f10 0x7f5e9c1979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.058+0000 7f5ea19ff700 1 --2- 172.21.15.151:0/645528999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e9c0744f0 0x7f5e9c197f30 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.058+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 >> 172.21.15.151:0/645528999 conn(0x7f5e9c0fb130 msgr2=0x7f5e9c0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.058+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 shutdown_connections 2023-07-21T22:18:13.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.058+0000 7f5ea19ff700 1 -- 172.21.15.151:0/645528999 wait complete. 2023-07-21T22:18:13.121 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:18:13.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.286+0000 7f9ee95ff700 1 -- 172.21.15.151:0/2179772233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee4100cf0 msgr2=0x7f9ee4101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.286+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/2179772233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee4100cf0 0x7f9ee4101140 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8009990 tx=0x7f9ed8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.286+0000 7f9ee95ff700 1 -- 172.21.15.151:0/2179772233 shutdown_connections 2023-07-21T22:18:13.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.286+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/2179772233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee40ffb00 0x7f9ee40fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.286+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/2179772233 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ee4101680 0x7f9ee4107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.286+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/2179772233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee4100cf0 0x7f9ee4101140 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.286+0000 7f9ee95ff700 1 -- 172.21.15.151:0/2179772233 >> 172.21.15.151:0/2179772233 conn(0x7f9ee40fb0e0 msgr2=0x7f9ee40fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:13.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.287+0000 7f9ee95ff700 1 -- 172.21.15.151:0/2179772233 shutdown_connections 2023-07-21T22:18:13.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.287+0000 7f9ee95ff700 1 -- 172.21.15.151:0/2179772233 wait complete. 2023-07-21T22:18:13.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee95ff700 1 Processor -- start 2023-07-21T22:18:13.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee95ff700 1 -- start start 2023-07-21T22:18:13.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee95ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ee40ffb00 0x7f9ee40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:13.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee95ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee4100cf0 0x7f9ee4072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:13.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee95ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee4101680 0x7f9ee4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:13.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee95ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee40735e0 con 0x7f9ee4100cf0 2023-07-21T22:18:13.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee95ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee4073750 con 0x7f9ee4101680 2023-07-21T22:18:13.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee95ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ee419f7e0 con 0x7f9ee40ffb00 2023-07-21T22:18:13.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee4100cf0 0x7f9ee4072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:13.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ee40ffb00 0x7f9ee40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:13.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ee40ffb00 0x7f9ee40742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52060/0 (socket says 172.21.15.151:52060) 2023-07-21T22:18:13.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee2ffd700 1 -- 172.21.15.151:0/201159537 learned_addr learned my addr 172.21.15.151:0/201159537 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.288+0000 7f9ee37fe700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee4101680 0x7f9ee4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ee2ffd700 1 -- 172.21.15.151:0/201159537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee4101680 msgr2=0x7f9ee4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ee2ffd700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee4101680 0x7f9ee4072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ee2ffd700 1 -- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee4100cf0 msgr2=0x7f9ee4072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ee2ffd700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee4100cf0 0x7f9ee4072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ee2ffd700 1 -- 172.21.15.151:0/201159537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80095f0 con 0x7f9ee40ffb00 2023-07-21T22:18:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ee27fc700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee4100cf0 0x7f9ee4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:13.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ee2ffd700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ee40ffb00 0x7f9ee40742c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400e970 tx=0x7f9ed400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:13.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ecbfff700 1 -- 172.21.15.151:0/201159537 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4009790 con 0x7f9ee40ffb00 2023-07-21T22:18:13.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ee419fac0 con 0x7f9ee40ffb00 2023-07-21T22:18:13.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ecbfff700 1 -- 172.21.15.151:0/201159537 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ed400c7e0 con 0x7f9ee40ffb00 2023-07-21T22:18:13.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ecbfff700 1 -- 172.21.15.151:0/201159537 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4003bd0 con 0x7f9ee40ffb00 2023-07-21T22:18:13.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.289+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ee419ffd0 con 0x7f9ee40ffb00 2023-07-21T22:18:13.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.290+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ee410b1d0 con 0x7f9ee40ffb00 2023-07-21T22:18:13.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.292+0000 7f9ecbfff700 1 -- 172.21.15.151:0/201159537 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f9ed400c950 con 0x7f9ee40ffb00 2023-07-21T22:18:13.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.294+0000 7f9ecbfff700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ecc0a1220 0x7f9ecc0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:13.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.294+0000 7f9ecbfff700 1 -- 172.21.15.151:0/201159537 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f9ed4014070 con 0x7f9ee40ffb00 2023-07-21T22:18:13.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.294+0000 7f9ee27fc700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ecc0a1220 0x7f9ecc0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:13.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.295+0000 7f9ee27fc700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ecc0a1220 0x7f9ecc0a36d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8006010 tx=0x7f9ed800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:13.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.296+0000 7f9ecbfff700 1 -- 172.21.15.151:0/201159537 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f9ed40968a0 con 0x7f9ee40ffb00 2023-07-21T22:18:13.430 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:13 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3876303556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:13.430 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:13 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/645528999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:13.430 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:13 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:18:13.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.575+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ee419fc50 con 0x7f9ee40ffb00 2023-07-21T22:18:13.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.576+0000 7f9ecbfff700 1 -- 172.21.15.151:0/201159537 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f9ee419fc50 con 0x7f9ee40ffb00 2023-07-21T22:18:13.621 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:13.621 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:17:15.194775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:18:13.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.578+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ecc0a1220 msgr2=0x7f9ecc0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.578+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ecc0a1220 0x7f9ecc0a36d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9ed8006010 tx=0x7f9ed800b260 comp rx=0 tx=0).stop 2023-07-21T22:18:13.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.578+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ee40ffb00 msgr2=0x7f9ee40742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.578+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ee40ffb00 0x7f9ee40742c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9ed400e970 tx=0x7f9ed400ec80 comp rx=0 tx=0).stop 2023-07-21T22:18:13.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.579+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 shutdown_connections 2023-07-21T22:18:13.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.579+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9ecc0a1220 0x7f9ecc0a36d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.579+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ee4101680 0x7f9ee4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.579+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ee40ffb00 0x7f9ee40742c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.579+0000 7f9ee95ff700 1 --2- 172.21.15.151:0/201159537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ee4100cf0 0x7f9ee4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.579+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 >> 172.21.15.151:0/201159537 conn(0x7f9ee40fb0e0 msgr2=0x7f9ee40fd3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:13.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.579+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 shutdown_connections 2023-07-21T22:18:13.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.579+0000 7f9ee95ff700 1 -- 172.21.15.151:0/201159537 wait complete. 2023-07-21T22:18:13.625 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 23 2023-07-21T22:18:13.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:13.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.805+0000 7fd9ddfff700 1 -- 172.21.15.151:0/1648220830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9d80ffb20 msgr2=0x7fd9d80fff30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.805+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/1648220830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9d80ffb20 0x7fd9d80fff30 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8009990 tx=0x7fd9c8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.805+0000 7fd9ddfff700 1 -- 172.21.15.151:0/1648220830 shutdown_connections 2023-07-21T22:18:13.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.805+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/1648220830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9d81016a0 0x7fd9d8107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.805+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/1648220830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9d80ffb20 0x7fd9d80fff30 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.805+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/1648220830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9d8100d10 0x7fd9d8101160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.805+0000 7fd9ddfff700 1 -- 172.21.15.151:0/1648220830 >> 172.21.15.151:0/1648220830 conn(0x7fd9d80fb160 msgr2=0x7fd9d80fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:13.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.805+0000 7fd9ddfff700 1 -- 172.21.15.151:0/1648220830 shutdown_connections 2023-07-21T22:18:13.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.805+0000 7fd9ddfff700 1 -- 172.21.15.151:0/1648220830 wait complete. 2023-07-21T22:18:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.806+0000 7fd9ddfff700 1 Processor -- start 2023-07-21T22:18:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.806+0000 7fd9ddfff700 1 -- start start 2023-07-21T22:18:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9ddfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9d80ffb20 0x7fd9d8195760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9ddfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9d8100d10 0x7fd9d8195ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:13.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9ddfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9d81016a0 0x7fd9d819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9ddfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d819d2e0 con 0x7fd9d8100d10 2023-07-21T22:18:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9ddfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d819d420 con 0x7fd9d81016a0 2023-07-21T22:18:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9ddfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9d819d5b0 con 0x7fd9d80ffb20 2023-07-21T22:18:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9d77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9d80ffb20 0x7fd9d8195760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9d77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9d80ffb20 0x7fd9d8195760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52070/0 (socket says 172.21.15.151:52070) 2023-07-21T22:18:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9d77fe700 1 -- 172.21.15.151:0/3794782189 learned_addr learned my addr 172.21.15.151:0/3794782189 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:13.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9cffff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9d8100d10 0x7fd9d8195ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:13.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.807+0000 7fd9d7fff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9d81016a0 0x7fd9d819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:13.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9d77fe700 1 -- 172.21.15.151:0/3794782189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9d81016a0 msgr2=0x7fd9d819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9d77fe700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9d81016a0 0x7fd9d819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9d77fe700 1 -- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9d8100d10 msgr2=0x7fd9d8195ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:13.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9d77fe700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9d8100d10 0x7fd9d8195ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:13.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9d77fe700 1 -- 172.21.15.151:0/3794782189 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9c80095f0 con 0x7fd9d80ffb20 2023-07-21T22:18:13.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9d77fe700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9d80ffb20 0x7fd9d8195760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8005910 tx=0x7fd9c8005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9d57fa700 1 -- 172.21.15.151:0/3794782189 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c801d070 con 0x7fd9d80ffb20 2023-07-21T22:18:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9d57fa700 1 -- 172.21.15.151:0/3794782189 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd9c800bd50 con 0x7fd9d80ffb20 2023-07-21T22:18:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9d819d830 con 0x7fd9d80ffb20 2023-07-21T22:18:13.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9d57fa700 1 -- 172.21.15.151:0/3794782189 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9c8022d00 con 0x7fd9d80ffb20 2023-07-21T22:18:13.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.808+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9d819dcb0 con 0x7fd9d80ffb20 2023-07-21T22:18:13.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.809+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9d810b1f0 con 0x7fd9d80ffb20 2023-07-21T22:18:13.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.811+0000 7fd9d57fa700 1 -- 172.21.15.151:0/3794782189 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fd9c800b8c0 con 0x7fd9d80ffb20 2023-07-21T22:18:13.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.813+0000 7fd9d57fa700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9c40a12a0 0x7fd9c40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:13.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.813+0000 7fd9d57fa700 1 -- 172.21.15.151:0/3794782189 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fd9c80cde90 con 0x7fd9d80ffb20 2023-07-21T22:18:13.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.813+0000 7fd9cffff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9c40a12a0 0x7fd9c40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:13.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.814+0000 7fd9cffff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9c40a12a0 0x7fd9c40a3750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009c60 tx=0x7fd9c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:13.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:13.817+0000 7fd9d57fa700 1 -- 172.21.15.151:0/3794782189 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd9c80974e0 con 0x7fd9d80ffb20 2023-07-21T22:18:13.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:13 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3876303556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:13.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:13 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/645528999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:13.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:13 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:18:13.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:13 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3876303556' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:13.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:13 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/645528999' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:13.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:13 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:18:14.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.050+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd9d810b3e0 con 0x7fd9d80ffb20 2023-07-21T22:18:14.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.052+0000 7fd9d57fa700 1 -- 172.21.15.151:0/3794782189 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7fd9c8022e60 con 0x7fd9d80ffb20 2023-07-21T22:18:14.097 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:14.097 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:14.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.054+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9c40a12a0 msgr2=0x7fd9c40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.054+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9c40a12a0 0x7fd9c40a3750 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd9c0009c60 tx=0x7fd9c0009260 comp rx=0 tx=0).stop 2023-07-21T22:18:14.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.054+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9d80ffb20 msgr2=0x7fd9d8195760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.054+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9d80ffb20 0x7fd9d8195760 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd9c8005910 tx=0x7fd9c8005740 comp rx=0 tx=0).stop 2023-07-21T22:18:14.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.055+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 shutdown_connections 2023-07-21T22:18:14.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.055+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd9c40a12a0 0x7fd9c40a3750 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.055+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9d81016a0 0x7fd9d819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.055+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd9d80ffb20 0x7fd9d8195760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.055+0000 7fd9ddfff700 1 --2- 172.21.15.151:0/3794782189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9d8100d10 0x7fd9d8195ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.055+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 >> 172.21.15.151:0/3794782189 conn(0x7fd9d80fb160 msgr2=0x7fd9d80fd390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.055+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 shutdown_connections 2023-07-21T22:18:14.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.055+0000 7fd9ddfff700 1 -- 172.21.15.151:0/3794782189 wait complete. 2023-07-21T22:18:14.121 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:18:14.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:18:14.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.291+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/88946507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe280ffae0 msgr2=0x7fbe280ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.291+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/88946507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe280ffae0 0x7fbe280ffef0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fbe18009990 tx=0x7fbe18009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.291+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/88946507 shutdown_connections 2023-07-21T22:18:14.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.291+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/88946507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe28101660 0x7fbe28107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.291+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/88946507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe280ffae0 0x7fbe280ffef0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.291+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/88946507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe28100cd0 0x7fbe28101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.291+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/88946507 >> 172.21.15.151:0/88946507 conn(0x7fbe280fb0e0 msgr2=0x7fbe280fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:14.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.291+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/88946507 shutdown_connections 2023-07-21T22:18:14.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.291+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/88946507 wait complete. 2023-07-21T22:18:14.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.292+0000 7fbe2e1ff700 1 Processor -- start 2023-07-21T22:18:14.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.292+0000 7fbe2e1ff700 1 -- start start 2023-07-21T22:18:14.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe2e1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe280ffae0 0x7fbe280742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:14.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe2e1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe28100cd0 0x7fbe28072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:14.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe2e1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe28101660 0x7fbe28072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:14.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe2e1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe280735e0 con 0x7fbe28101660 2023-07-21T22:18:14.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe2e1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe28073750 con 0x7fbe280ffae0 2023-07-21T22:18:14.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe2e1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe2819f800 con 0x7fbe28100cd0 2023-07-21T22:18:14.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe28101660 0x7fbe28072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:14.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe28101660 0x7fbe28072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33062/0 (socket says 172.21.15.151:33062) 2023-07-21T22:18:14.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe27fff700 1 -- 172.21.15.151:0/2465345564 learned_addr learned my addr 172.21.15.151:0/2465345564 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:14.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe277fe700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe280ffae0 0x7fbe280742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:14.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe26ffd700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe28100cd0 0x7fbe28072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:14.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe27fff700 1 -- 172.21.15.151:0/2465345564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe28100cd0 msgr2=0x7fbe28072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe27fff700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe28100cd0 0x7fbe28072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe27fff700 1 -- 172.21.15.151:0/2465345564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe280ffae0 msgr2=0x7fbe280742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe27fff700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe280ffae0 0x7fbe280742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe27fff700 1 -- 172.21.15.151:0/2465345564 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe180095f0 con 0x7fbe28101660 2023-07-21T22:18:14.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.293+0000 7fbe26ffd700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe28100cd0 0x7fbe28072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:14.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.294+0000 7fbe27fff700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe28101660 0x7fbe28072e40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbe20007ee0 tx=0x7fbe2000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:14.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.294+0000 7fbe24ff9700 1 -- 172.21.15.151:0/2465345564 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20017070 con 0x7fbe28101660 2023-07-21T22:18:14.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.294+0000 7fbe24ff9700 1 -- 172.21.15.151:0/2465345564 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe2000f040 con 0x7fbe28101660 2023-07-21T22:18:14.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.294+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe2819fae0 con 0x7fbe28101660 2023-07-21T22:18:14.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.294+0000 7fbe24ff9700 1 -- 172.21.15.151:0/2465345564 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe20005710 con 0x7fbe28101660 2023-07-21T22:18:14.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.294+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe2819fff0 con 0x7fbe28101660 2023-07-21T22:18:14.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.295+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe2810b1b0 con 0x7fbe28101660 2023-07-21T22:18:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.297+0000 7fbe24ff9700 1 -- 172.21.15.151:0/2465345564 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fbe20005870 con 0x7fbe28101660 2023-07-21T22:18:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.298+0000 7fbe24ff9700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbe100a11e0 0x7fbe100a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.299+0000 7fbe24ff9700 1 -- 172.21.15.151:0/2465345564 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fbe200cc1d0 con 0x7fbe28101660 2023-07-21T22:18:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.299+0000 7fbe277fe700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbe100a11e0 0x7fbe100a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:14.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.299+0000 7fbe277fe700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbe100a11e0 0x7fbe100a3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c010 tx=0x7fbe18005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:14.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.302+0000 7fbe24ff9700 1 -- 172.21.15.151:0/2465345564 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fbe200957f0 con 0x7fbe28101660 2023-07-21T22:18:14.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.509+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbe28106a90 con 0x7fbe28101660 2023-07-21T22:18:14.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.510+0000 7fbe24ff9700 1 -- 172.21.15.151:0/2465345564 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbe20098e10 con 0x7fbe28101660 2023-07-21T22:18:14.554 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:18:14.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbe100a11e0 msgr2=0x7fbe100a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbe100a11e0 0x7fbe100a3690 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbe1800c010 tx=0x7fbe18005fb0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe28101660 msgr2=0x7fbe28072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe28101660 0x7fbe28072e40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbe20007ee0 tx=0x7fbe2000d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 shutdown_connections 2023-07-21T22:18:14.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fbe100a11e0 0x7fbe100a3690 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe280ffae0 0x7fbe280742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe28101660 0x7fbe28072e40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 --2- 172.21.15.151:0/2465345564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe28100cd0 0x7fbe28072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 >> 172.21.15.151:0/2465345564 conn(0x7fbe280fb0e0 msgr2=0x7fbe280fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:14.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 shutdown_connections 2023-07-21T22:18:14.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.512+0000 7fbe2e1ff700 1 -- 172.21.15.151:0/2465345564 wait complete. 2023-07-21T22:18:14.578 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:18:14.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:14 smithi151 ceph-mon[95510]: pgmap v332: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:14.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:14 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/201159537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:14.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:14 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3794782189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:14.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.746+0000 7fd2d49ff700 1 -- 172.21.15.151:0/2358027351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2d0102ef0 msgr2=0x7fd2d01052d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.746+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/2358027351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2d0102ef0 0x7fd2d01052d0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8009990 tx=0x7fd2b8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.746+0000 7fd2d49ff700 1 -- 172.21.15.151:0/2358027351 shutdown_connections 2023-07-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.746+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/2358027351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2d01005d0 0x7fd2d01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.746+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/2358027351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0105810 0x7fd2d0107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.746+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/2358027351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2d0102ef0 0x7fd2d01052d0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.746+0000 7fd2d49ff700 1 -- 172.21.15.151:0/2358027351 >> 172.21.15.151:0/2358027351 conn(0x7fd2d00fa070 msgr2=0x7fd2d00fc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.746+0000 7fd2d49ff700 1 -- 172.21.15.151:0/2358027351 shutdown_connections 2023-07-21T22:18:14.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.746+0000 7fd2d49ff700 1 -- 172.21.15.151:0/2358027351 wait complete. 2023-07-21T22:18:14.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.747+0000 7fd2d49ff700 1 Processor -- start 2023-07-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.747+0000 7fd2d49ff700 1 -- start start 2023-07-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.747+0000 7fd2d49ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2d01005d0 0x7fd2d0195770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2d49ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0102ef0 0x7fd2d0195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2d49ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2d0105810 0x7fd2d019cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2d49ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d019d2f0 con 0x7fd2d0102ef0 2023-07-21T22:18:14.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2d49ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d019d430 con 0x7fd2d01005d0 2023-07-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2d49ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2d019d5c0 con 0x7fd2d0105810 2023-07-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0102ef0 0x7fd2d0195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2ce59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2d01005d0 0x7fd2d0195770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2ce59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2d01005d0 0x7fd2d0195770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46030/0 (socket says 172.21.15.151:46030) 2023-07-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2ce59c700 1 -- 172.21.15.151:0/3690625016 learned_addr learned my addr 172.21.15.151:0/3690625016 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2ced9d700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2d0105810 0x7fd2d019cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:14.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2ce59c700 1 -- 172.21.15.151:0/3690625016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2d0105810 msgr2=0x7fd2d019cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2ce59c700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2d0105810 0x7fd2d019cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2ce59c700 1 -- 172.21.15.151:0/3690625016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0102ef0 msgr2=0x7fd2d0195cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2ce59c700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0102ef0 0x7fd2d0195cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.748+0000 7fd2ce59c700 1 -- 172.21.15.151:0/3690625016 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b80095f0 con 0x7fd2d01005d0 2023-07-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.749+0000 7fd2ce59c700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2d01005d0 0x7fd2d0195770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000e9a0 tx=0x7fd2c000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.749+0000 7fd2c77fe700 1 -- 172.21.15.151:0/3690625016 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c0009790 con 0x7fd2d01005d0 2023-07-21T22:18:14.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.749+0000 7fd2c77fe700 1 -- 172.21.15.151:0/3690625016 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd2c0010430 con 0x7fd2d01005d0 2023-07-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.749+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2d019d8a0 con 0x7fd2d01005d0 2023-07-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.749+0000 7fd2c77fe700 1 -- 172.21.15.151:0/3690625016 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2c000cea0 con 0x7fd2d01005d0 2023-07-21T22:18:14.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.749+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2d019de00 con 0x7fd2d01005d0 2023-07-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.750+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2d00fbbe0 con 0x7fd2d01005d0 2023-07-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.752+0000 7fd2c77fe700 1 -- 172.21.15.151:0/3690625016 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fd2c00105a0 con 0x7fd2d01005d0 2023-07-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.753+0000 7fd2c77fe700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd2bc0a1260 0x7fd2bc0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.753+0000 7fd2c77fe700 1 -- 172.21.15.151:0/3690625016 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fd2c0014070 con 0x7fd2d01005d0 2023-07-21T22:18:14.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.754+0000 7fd2c7fff700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd2bc0a1260 0x7fd2bc0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.754+0000 7fd2c7fff700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd2bc0a1260 0x7fd2bc0a3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006010 tx=0x7fd2b800b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:14.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.755+0000 7fd2c77fe700 1 -- 172.21.15.151:0/3690625016 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd2c00963f0 con 0x7fd2d01005d0 2023-07-21T22:18:14.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:14 smithi187 ceph-mon[96918]: pgmap v332: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:14.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:14 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/201159537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:14.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:14 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3794782189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:14.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:14 smithi195 ceph-mon[97365]: pgmap v332: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:14.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:14 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/201159537' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:14.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:14 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3794782189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:15.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.963+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd2d002cac0 con 0x7fd2d01005d0 2023-07-21T22:18:15.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.964+0000 7fd2c77fe700 1 -- 172.21.15.151:0/3690625016 <== mon.2 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd2c0099a10 con 0x7fd2d01005d0 2023-07-21T22:18:15.008 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T22:18:15.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.966+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd2bc0a1260 msgr2=0x7fd2bc0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd2bc0a1260 0x7fd2bc0a3710 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd2b8006010 tx=0x7fd2b800b260 comp rx=0 tx=0).stop 2023-07-21T22:18:15.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2d01005d0 msgr2=0x7fd2d0195770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2d01005d0 0x7fd2d0195770 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd2c000e9a0 tx=0x7fd2c000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 shutdown_connections 2023-07-21T22:18:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd2bc0a1260 0x7fd2bc0a3710 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2d01005d0 0x7fd2d0195770 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2d0105810 0x7fd2d019cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 --2- 172.21.15.151:0/3690625016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2d0102ef0 0x7fd2d0195cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 >> 172.21.15.151:0/3690625016 conn(0x7fd2d00fa070 msgr2=0x7fd2d0101230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 shutdown_connections 2023-07-21T22:18:15.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:14.967+0000 7fd2d49ff700 1 -- 172.21.15.151:0/3690625016 wait complete. 2023-07-21T22:18:15.031 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:18:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.201+0000 7f61311ff700 1 -- 172.21.15.151:0/3683236625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f612c0ffaf0 msgr2=0x7f612c0fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.201+0000 7f61311ff700 1 --2- 172.21.15.151:0/3683236625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f612c0ffaf0 0x7f612c0fff00 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f611c009990 tx=0x7f611c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.201+0000 7f61311ff700 1 -- 172.21.15.151:0/3683236625 shutdown_connections 2023-07-21T22:18:15.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.201+0000 7f61311ff700 1 --2- 172.21.15.151:0/3683236625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f612c101670 0x7f612c107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.201+0000 7f61311ff700 1 --2- 172.21.15.151:0/3683236625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f612c0ffaf0 0x7f612c0fff00 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.201+0000 7f61311ff700 1 --2- 172.21.15.151:0/3683236625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f612c100ce0 0x7f612c101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.201+0000 7f61311ff700 1 -- 172.21.15.151:0/3683236625 >> 172.21.15.151:0/3683236625 conn(0x7f612c0fb130 msgr2=0x7f612c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:15.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.201+0000 7f61311ff700 1 -- 172.21.15.151:0/3683236625 shutdown_connections 2023-07-21T22:18:15.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.201+0000 7f61311ff700 1 -- 172.21.15.151:0/3683236625 wait complete. 2023-07-21T22:18:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.202+0000 7f61311ff700 1 Processor -- start 2023-07-21T22:18:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.202+0000 7f61311ff700 1 -- start start 2023-07-21T22:18:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.202+0000 7f61311ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f612c0ffaf0 0x7f612c0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.202+0000 7f61311ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f612c100ce0 0x7f612c072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:15.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.202+0000 7f61311ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f612c101670 0x7f612c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.202+0000 7f61311ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c0735e0 con 0x7f612c100ce0 2023-07-21T22:18:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.202+0000 7f61311ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c073750 con 0x7f612c101670 2023-07-21T22:18:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.202+0000 7f61311ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f612c19f860 con 0x7f612c0ffaf0 2023-07-21T22:18:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f612c0ffaf0 0x7f612c0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f612c100ce0 0x7f612c072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f612c0ffaf0 0x7f612c0742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52138/0 (socket says 172.21.15.151:52138) 2023-07-21T22:18:15.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612ad9d700 1 -- 172.21.15.151:0/3096699836 learned_addr learned my addr 172.21.15.151:0/3096699836 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612b59e700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f612c101670 0x7f612c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612ad9d700 1 -- 172.21.15.151:0/3096699836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f612c101670 msgr2=0x7f612c072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612ad9d700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f612c101670 0x7f612c072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612ad9d700 1 -- 172.21.15.151:0/3096699836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f612c100ce0 msgr2=0x7f612c072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612ad9d700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f612c100ce0 0x7f612c072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612ad9d700 1 -- 172.21.15.151:0/3096699836 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f611c0095f0 con 0x7f612c0ffaf0 2023-07-21T22:18:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.203+0000 7f612ad9d700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f612c0ffaf0 0x7f612c0742c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f611c0098e0 tx=0x7f611c004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:15.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.204+0000 7f6113fff700 1 -- 172.21.15.151:0/3096699836 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c01d070 con 0x7f612c0ffaf0 2023-07-21T22:18:15.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.204+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f612c19fae0 con 0x7f612c0ffaf0 2023-07-21T22:18:15.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.204+0000 7f6113fff700 1 -- 172.21.15.151:0/3096699836 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f611c00bdd0 con 0x7f612c0ffaf0 2023-07-21T22:18:15.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.204+0000 7f6113fff700 1 -- 172.21.15.151:0/3096699836 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f611c022d20 con 0x7f612c0ffaf0 2023-07-21T22:18:15.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.204+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f612c19ff00 con 0x7f612c0ffaf0 2023-07-21T22:18:15.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.205+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f612c10b1c0 con 0x7f612c0ffaf0 2023-07-21T22:18:15.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.207+0000 7f6113fff700 1 -- 172.21.15.151:0/3096699836 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f611c00b940 con 0x7f612c0ffaf0 2023-07-21T22:18:15.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.208+0000 7f6113fff700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61140a11e0 0x7f61140a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:15.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.209+0000 7f6113fff700 1 -- 172.21.15.151:0/3096699836 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f611c0ce130 con 0x7f612c0ffaf0 2023-07-21T22:18:15.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.209+0000 7f612a59c700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61140a11e0 0x7f61140a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:15.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.209+0000 7f612a59c700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61140a11e0 0x7f61140a3690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6120009c60 tx=0x7f6120009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:15.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.212+0000 7f6113fff700 1 -- 172.21.15.151:0/3096699836 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f611c097780 con 0x7f612c0ffaf0 2023-07-21T22:18:15.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.423+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f612c10b380 con 0x7f612c0ffaf0 2023-07-21T22:18:15.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.423+0000 7f6113fff700 1 -- 172.21.15.151:0/3096699836 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f612c10b380 con 0x7f612c0ffaf0 2023-07-21T22:18:15.468 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T22:18:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61140a11e0 msgr2=0x7f61140a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61140a11e0 0x7f61140a3690 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6120009c60 tx=0x7f6120009260 comp rx=0 tx=0).stop 2023-07-21T22:18:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f612c0ffaf0 msgr2=0x7f612c0742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f612c0ffaf0 0x7f612c0742c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f611c0098e0 tx=0x7f611c004730 comp rx=0 tx=0).stop 2023-07-21T22:18:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 shutdown_connections 2023-07-21T22:18:15.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f61140a11e0 0x7f61140a3690 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f612c101670 0x7f612c072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f612c0ffaf0 0x7f612c0742c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 --2- 172.21.15.151:0/3096699836 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f612c100ce0 0x7f612c072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 >> 172.21.15.151:0/3096699836 conn(0x7f612c0fb130 msgr2=0x7f612c0fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:15.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 shutdown_connections 2023-07-21T22:18:15.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.426+0000 7f61311ff700 1 -- 172.21.15.151:0/3096699836 wait complete. 2023-07-21T22:18:15.491 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:18:15.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:15 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2465345564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:15.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:15 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3690625016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:15.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.657+0000 7f704c3ff700 1 -- 172.21.15.151:0/3559046783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7044100d10 msgr2=0x7f7044101160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.657+0000 7f704c3ff700 1 --2- 172.21.15.151:0/3559046783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7044100d10 0x7f7044101160 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7034009990 tx=0x7f7034009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.657+0000 7f704c3ff700 1 -- 172.21.15.151:0/3559046783 shutdown_connections 2023-07-21T22:18:15.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.657+0000 7f704c3ff700 1 --2- 172.21.15.151:0/3559046783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70441016a0 0x7f7044107f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.657+0000 7f704c3ff700 1 --2- 172.21.15.151:0/3559046783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70440ffb20 0x7f70440fff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.657+0000 7f704c3ff700 1 --2- 172.21.15.151:0/3559046783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7044100d10 0x7f7044101160 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.657+0000 7f704c3ff700 1 -- 172.21.15.151:0/3559046783 >> 172.21.15.151:0/3559046783 conn(0x7f70440fb160 msgr2=0x7f70440fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:15.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.657+0000 7f704c3ff700 1 -- 172.21.15.151:0/3559046783 shutdown_connections 2023-07-21T22:18:15.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.657+0000 7f704c3ff700 1 -- 172.21.15.151:0/3559046783 wait complete. 2023-07-21T22:18:15.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.658+0000 7f704c3ff700 1 Processor -- start 2023-07-21T22:18:15.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.658+0000 7f704c3ff700 1 -- start start 2023-07-21T22:18:15.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704c3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70440ffb20 0x7f70440742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:15.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704c3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7044100d10 0x7f7044072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:15.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704c3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70441016a0 0x7f7044072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:15.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704c3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044199570 con 0x7f70440ffb20 2023-07-21T22:18:15.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704c3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044073380 con 0x7f7044100d10 2023-07-21T22:18:15.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704c3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7044073540 con 0x7f70441016a0 2023-07-21T22:18:15.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704a19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70440ffb20 0x7f70440742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:15.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704a99c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70441016a0 0x7f7044072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:15.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704a19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70440ffb20 0x7f70440742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33118/0 (socket says 172.21.15.151:33118) 2023-07-21T22:18:15.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704a19b700 1 -- 172.21.15.151:0/1952267810 learned_addr learned my addr 172.21.15.151:0/1952267810 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:15.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.659+0000 7f704999a700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7044100d10 0x7f7044072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:15.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f704a99c700 1 -- 172.21.15.151:0/1952267810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7044100d10 msgr2=0x7f7044072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f704a99c700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7044100d10 0x7f7044072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f704a99c700 1 -- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70440ffb20 msgr2=0x7f70440742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f704a99c700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70440ffb20 0x7f70440742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f704a99c700 1 -- 172.21.15.151:0/1952267810 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70340095f0 con 0x7f70441016a0 2023-07-21T22:18:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f704a19b700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70440ffb20 0x7f70440742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f704a99c700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70441016a0 0x7f7044072e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f703c00efc0 tx=0x7f703c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f703b7fe700 1 -- 172.21.15.151:0/1952267810 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c018070 con 0x7f70441016a0 2023-07-21T22:18:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f703b7fe700 1 -- 172.21.15.151:0/1952267810 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f703c00f040 con 0x7f70441016a0 2023-07-21T22:18:15.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70441a3f20 con 0x7f70441016a0 2023-07-21T22:18:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f703b7fe700 1 -- 172.21.15.151:0/1952267810 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f703c00cba0 con 0x7f70441016a0 2023-07-21T22:18:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.660+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70441a4290 con 0x7f70441016a0 2023-07-21T22:18:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.661+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f704410b1a0 con 0x7f70441016a0 2023-07-21T22:18:15.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.663+0000 7f703b7fe700 1 -- 172.21.15.151:0/1952267810 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f703c003a00 con 0x7f70441016a0 2023-07-21T22:18:15.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.665+0000 7f703b7fe700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70300a1220 0x7f70300a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:15.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.665+0000 7f703b7fe700 1 -- 172.21.15.151:0/1952267810 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f703c0cc5b0 con 0x7f70441016a0 2023-07-21T22:18:15.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.665+0000 7f704a19b700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70300a1220 0x7f70300a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:15.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.665+0000 7f704a19b700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70300a1220 0x7f70300a36d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7040005950 tx=0x7f7040009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:15.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.671+0000 7f703b7fe700 1 -- 172.21.15.151:0/1952267810 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f703c095c00 con 0x7f70441016a0 2023-07-21T22:18:15.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:15 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2465345564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:15.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:15 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3690625016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:15.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:15 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2465345564' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:15.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:15 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3690625016' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:15.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.937+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f70441069d0 con 0x7f70441016a0 2023-07-21T22:18:15.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.938+0000 7f703b7fe700 1 -- 172.21.15.151:0/1952267810 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f703c0b7e60 con 0x7f70441016a0 2023-07-21T22:18:15.982 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:15.983 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:17:15.194775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:18:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70300a1220 msgr2=0x7f70300a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70300a1220 0x7f70300a36d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7040005950 tx=0x7f7040009260 comp rx=0 tx=0).stop 2023-07-21T22:18:15.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70441016a0 msgr2=0x7f7044072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:15.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70441016a0 0x7f7044072e40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f703c00efc0 tx=0x7f703c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 shutdown_connections 2023-07-21T22:18:15.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f70300a1220 0x7f70300a36d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f70441016a0 0x7f7044072e40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70440ffb20 0x7f70440742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 --2- 172.21.15.151:0/1952267810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7044100d10 0x7f7044072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:15.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 >> 172.21.15.151:0/1952267810 conn(0x7f70440fb160 msgr2=0x7f70440fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:15.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 shutdown_connections 2023-07-21T22:18:15.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:15.941+0000 7f704c3ff700 1 -- 172.21.15.151:0/1952267810 wait complete. 2023-07-21T22:18:15.987 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 23 2023-07-21T22:18:16.010 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:16.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.175+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1455706251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6ac0fe9d0 msgr2=0x7fd6ac0fede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.175+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1455706251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6ac0fe9d0 0x7fd6ac0fede0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fd69c009990 tx=0x7fd69c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.175+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1455706251 shutdown_connections 2023-07-21T22:18:16.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.175+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1455706251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ac100550 0x7fd6ac106e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.175+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1455706251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6ac0fe9d0 0x7fd6ac0fede0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.175+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1455706251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac0ffbc0 0x7fd6ac100010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.175+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1455706251 >> 172.21.15.151:0/1455706251 conn(0x7fd6ac0f9fd0 msgr2=0x7fd6ac0fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:16.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.175+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1455706251 shutdown_connections 2023-07-21T22:18:16.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.175+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1455706251 wait complete. 2023-07-21T22:18:16.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.176+0000 7fd6b0dff700 1 Processor -- start 2023-07-21T22:18:16.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.176+0000 7fd6b0dff700 1 -- start start 2023-07-21T22:18:16.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.176+0000 7fd6b0dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac0fe9d0 0x7fd6ac102960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:16.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.176+0000 7fd6b0dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6ac0ffbc0 0x7fd6ac100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:16.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.176+0000 7fd6b0dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ac100550 0x7fd6ac1014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:16.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.176+0000 7fd6b0dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac101c80 con 0x7fd6ac0ffbc0 2023-07-21T22:18:16.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.176+0000 7fd6b0dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac101df0 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.176+0000 7fd6b0dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac19f7d0 con 0x7fd6ac100550 2023-07-21T22:18:16.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6aa59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac0fe9d0 0x7fd6ac102960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:16.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6aa59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac0fe9d0 0x7fd6ac102960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57268/0 (socket says 172.21.15.151:57268) 2023-07-21T22:18:16.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6aa59c700 1 -- 172.21.15.151:0/1162568070 learned_addr learned my addr 172.21.15.151:0/1162568070 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:16.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6aad9d700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ac100550 0x7fd6ac1014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:16.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6a9d9b700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6ac0ffbc0 0x7fd6ac100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6aa59c700 1 -- 172.21.15.151:0/1162568070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ac100550 msgr2=0x7fd6ac1014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6aa59c700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ac100550 0x7fd6ac1014e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6aa59c700 1 -- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6ac0ffbc0 msgr2=0x7fd6ac100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6aa59c700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6ac0ffbc0 0x7fd6ac100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.177+0000 7fd6aa59c700 1 -- 172.21.15.151:0/1162568070 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd69c0095f0 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.178+0000 7fd6aa59c700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac0fe9d0 0x7fd6ac102960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0098e0 tx=0x7fd69c0039f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:16.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.178+0000 7fd69b7fe700 1 -- 172.21.15.151:0/1162568070 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c01d070 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.178+0000 7fd69b7fe700 1 -- 172.21.15.151:0/1162568070 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd69c00bdf0 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.178+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac19fa50 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.178+0000 7fd69b7fe700 1 -- 172.21.15.151:0/1162568070 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd69c004a00 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.178+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac19fe70 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.179+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac10a0a0 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.181+0000 7fd69b7fe700 1 -- 172.21.15.151:0/1162568070 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fd69c00b960 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.182+0000 7fd69b7fe700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6940a12a0 0x7fd6940a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.183+0000 7fd69b7fe700 1 -- 172.21.15.151:0/1162568070 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fd69c0cdb30 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.183+0000 7fd6a9d9b700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6940a12a0 0x7fd6940a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:16.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.183+0000 7fd6a9d9b700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6940a12a0 0x7fd6940a3750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009c60 tx=0x7fd6a0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:16.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.186+0000 7fd69b7fe700 1 -- 172.21.15.151:0/1162568070 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd69c097180 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.402+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd6ac1a04e0 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.404+0000 7fd69b7fe700 1 -- 172.21.15.151:0/1162568070 <== mon.2 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7fd69c09a7a0 con 0x7fd6ac0fe9d0 2023-07-21T22:18:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:16.449 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:16.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6940a12a0 msgr2=0x7fd6940a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6940a12a0 0x7fd6940a3750 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd6a0009c60 tx=0x7fd6a0009260 comp rx=0 tx=0).stop 2023-07-21T22:18:16.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac0fe9d0 msgr2=0x7fd6ac102960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac0fe9d0 0x7fd6ac102960 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd69c0098e0 tx=0x7fd69c0039f0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 shutdown_connections 2023-07-21T22:18:16.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6940a12a0 0x7fd6940a3750 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac0fe9d0 0x7fd6ac102960 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6ac100550 0x7fd6ac1014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 --2- 172.21.15.151:0/1162568070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd6ac0ffbc0 0x7fd6ac100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 >> 172.21.15.151:0/1162568070 conn(0x7fd6ac0f9fd0 msgr2=0x7fd6ac067730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:16.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.406+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 shutdown_connections 2023-07-21T22:18:16.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.407+0000 7fd6b0dff700 1 -- 172.21.15.151:0/1162568070 wait complete. 2023-07-21T22:18:16.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:18:16.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.654+0000 7f65567ff700 1 -- 172.21.15.151:0/4096046296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550072f70 msgr2=0x7f65500733e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.654+0000 7f65567ff700 1 --2- 172.21.15.151:0/4096046296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550072f70 0x7f65500733e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f654401a9a0 tx=0x7f654401acb0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.654+0000 7f65567ff700 1 -- 172.21.15.151:0/4096046296 shutdown_connections 2023-07-21T22:18:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.654+0000 7f65567ff700 1 --2- 172.21.15.151:0/4096046296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655010c0d0 0x7f655010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.654+0000 7f65567ff700 1 --2- 172.21.15.151:0/4096046296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6550074550 0x7f65500729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.654+0000 7f65567ff700 1 --2- 172.21.15.151:0/4096046296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550072f70 0x7f65500733e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.654+0000 7f65567ff700 1 -- 172.21.15.151:0/4096046296 >> 172.21.15.151:0/4096046296 conn(0x7f65500fb0e0 msgr2=0x7f65500fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.654+0000 7f65567ff700 1 -- 172.21.15.151:0/4096046296 shutdown_connections 2023-07-21T22:18:16.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.654+0000 7f65567ff700 1 -- 172.21.15.151:0/4096046296 wait complete. 2023-07-21T22:18:16.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:16 smithi151 ceph-mon[95510]: pgmap v333: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T22:18:16.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:16 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3096699836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:16.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:16 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1952267810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:16.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f65567ff700 1 Processor -- start 2023-07-21T22:18:16.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f65567ff700 1 -- start start 2023-07-21T22:18:16.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f65567ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6550072f70 0x7f6550195dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:16.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f65567ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550074550 0x7f6550198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:16.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f65567ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655010c0d0 0x7f655019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:16.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f65567ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655019b100 con 0x7f6550072f70 2023-07-21T22:18:16.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f65567ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655019b270 con 0x7f655010c0d0 2023-07-21T22:18:16.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f65567ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f655019b430 con 0x7f6550074550 2023-07-21T22:18:16.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f654f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550074550 0x7f6550198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:16.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f654f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550074550 0x7f6550198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45946/0 (socket says 172.21.15.151:45946) 2023-07-21T22:18:16.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f654f7fe700 1 -- 172.21.15.151:0/1939594127 learned_addr learned my addr 172.21.15.151:0/1939594127 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:16.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.656+0000 7f654ffff700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6550072f70 0x7f6550195dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:16.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.657+0000 7f6554d9c700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655010c0d0 0x7f655019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:16.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.657+0000 7f654f7fe700 1 -- 172.21.15.151:0/1939594127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655010c0d0 msgr2=0x7f655019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.657+0000 7f654f7fe700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655010c0d0 0x7f655019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.657+0000 7f654f7fe700 1 -- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6550072f70 msgr2=0x7f6550195dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.657+0000 7f654f7fe700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6550072f70 0x7f6550195dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.657+0000 7f654f7fe700 1 -- 172.21.15.151:0/1939594127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f654401a600 con 0x7f6550074550 2023-07-21T22:18:16.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.657+0000 7f654f7fe700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550074550 0x7f6550198320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65440289c0 tx=0x7f65440289f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:16.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.657+0000 7f654d7fa700 1 -- 172.21.15.151:0/1939594127 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f654402d070 con 0x7f6550074550 2023-07-21T22:18:16.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.658+0000 7f654d7fa700 1 -- 172.21.15.151:0/1939594127 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6544028da0 con 0x7f6550074550 2023-07-21T22:18:16.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.658+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f655019b6b0 con 0x7f6550074550 2023-07-21T22:18:16.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.658+0000 7f654d7fa700 1 -- 172.21.15.151:0/1939594127 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6544004a10 con 0x7f6550074550 2023-07-21T22:18:16.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.658+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f655019bb30 con 0x7f6550074550 2023-07-21T22:18:16.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.659+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6550101c20 con 0x7f6550074550 2023-07-21T22:18:16.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.661+0000 7f654d7fa700 1 -- 172.21.15.151:0/1939594127 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f6544005050 con 0x7f6550074550 2023-07-21T22:18:16.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.663+0000 7f654d7fa700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f65380a12a0 0x7f65380a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:16.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.663+0000 7f654d7fa700 1 -- 172.21.15.151:0/1939594127 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f65440de0f0 con 0x7f6550074550 2023-07-21T22:18:16.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.664+0000 7f654ffff700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f65380a12a0 0x7f65380a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:16.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.664+0000 7f654ffff700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f65380a12a0 0x7f65380a3750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6550074920 tx=0x7f6540009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:16.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.666+0000 7f654d7fa700 1 -- 172.21.15.151:0/1939594127 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f65440a7740 con 0x7f6550074550 2023-07-21T22:18:16.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:16 smithi187 ceph-mon[96918]: pgmap v333: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T22:18:16.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:16 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3096699836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:16.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:16 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1952267810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:16.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:16 smithi195 ceph-mon[97365]: pgmap v333: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T22:18:16.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:16 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3096699836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:16.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:16 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1952267810' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:16.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.933+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f655002c850 con 0x7f6550074550 2023-07-21T22:18:16.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.934+0000 7f654d7fa700 1 -- 172.21.15.151:0/1939594127 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f65440aad60 con 0x7f6550074550 2023-07-21T22:18:16.978 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:16.978 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:17:15.194775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:18:16.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.936+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f65380a12a0 msgr2=0x7f65380a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.936+0000 7f65567ff700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f65380a12a0 0x7f65380a3750 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6550074920 tx=0x7f6540009260 comp rx=0 tx=0).stop 2023-07-21T22:18:16.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.936+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550074550 msgr2=0x7f6550198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:16.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.936+0000 7f65567ff700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550074550 0x7f6550198320 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f65440289c0 tx=0x7f65440289f0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.937+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 shutdown_connections 2023-07-21T22:18:16.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.937+0000 7f65567ff700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f65380a12a0 0x7f65380a3750 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.937+0000 7f65567ff700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f655010c0d0 0x7f655019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.937+0000 7f65567ff700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6550072f70 0x7f6550195dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.937+0000 7f65567ff700 1 --2- 172.21.15.151:0/1939594127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6550074550 0x7f6550198320 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:16.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.937+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 >> 172.21.15.151:0/1939594127 conn(0x7f65500fb0e0 msgr2=0x7f65500fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:16.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.937+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 shutdown_connections 2023-07-21T22:18:16.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:16.937+0000 7f65567ff700 1 -- 172.21.15.151:0/1939594127 wait complete. 2023-07-21T22:18:16.983 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 23 2023-07-21T22:18:17.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-07-21T22:17:09.358855+0000', 'modified': '2023-07-21T22:17:15.194775+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24599, 'mds_1': 24574, 'mds_2': 24548}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24475': {'gid': 24475, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6833/2796106198', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 2796106198}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 2796106198}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24512': {'gid': 24512, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.187:6835/3281429688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6834', 'nonce': 3281429688}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 3281429688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24538': {'gid': 24538, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6835/3818436709', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 3818436709}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 3818436709}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24548': {'gid': 24548, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.187:6837/1053006516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6836', 'nonce': 1053006516}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 1053006516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24574': {'gid': 24574, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.195:6839/2311441690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 2311441690}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 2311441690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24599': {'gid': 24599, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6839/1236119832', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6838', 'nonce': 1236119832}, {'type': 'v1', 'addr': '172.21.15.187:6839', 'nonce': 1236119832}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:18:17.001 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-07-21T22:18:17.002 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-07-21T22:18:17.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.162+0000 7f00ec1ff700 1 -- 172.21.15.151:0/293229805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e4100ce0 msgr2=0x7f00e4101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.162+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/293229805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e4100ce0 0x7f00e4101130 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f00d4009990 tx=0x7f00d4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.162+0000 7f00ec1ff700 1 -- 172.21.15.151:0/293229805 shutdown_connections 2023-07-21T22:18:17.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.162+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/293229805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00e40ffaf0 0x7f00e40fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.162+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/293229805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e4101670 0x7f00e4107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.162+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/293229805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e4100ce0 0x7f00e4101130 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.162+0000 7f00ec1ff700 1 -- 172.21.15.151:0/293229805 >> 172.21.15.151:0/293229805 conn(0x7f00e40fb130 msgr2=0x7f00e40fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.163+0000 7f00ec1ff700 1 -- 172.21.15.151:0/293229805 shutdown_connections 2023-07-21T22:18:17.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.163+0000 7f00ec1ff700 1 -- 172.21.15.151:0/293229805 wait complete. 2023-07-21T22:18:17.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00ec1ff700 1 Processor -- start 2023-07-21T22:18:17.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00ec1ff700 1 -- start start 2023-07-21T22:18:17.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00ec1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e40ffaf0 0x7f00e4195800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00ec1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00e4100ce0 0x7f00e4195d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00ec1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e4101670 0x7f00e419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00ec1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e419d380 con 0x7f00e40ffaf0 2023-07-21T22:18:17.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00ec1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e419d4c0 con 0x7f00e4100ce0 2023-07-21T22:18:17.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00ec1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e419d650 con 0x7f00e4101670 2023-07-21T22:18:17.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00e9f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e40ffaf0 0x7f00e4195800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00e9f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e40ffaf0 0x7f00e4195800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60372/0 (socket says 172.21.15.151:60372) 2023-07-21T22:18:17.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00e9f9b700 1 -- 172.21.15.151:0/3759341577 learned_addr learned my addr 172.21.15.151:0/3759341577 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00ea79c700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e4101670 0x7f00e419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.164+0000 7f00e979a700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00e4100ce0 0x7f00e4195d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00e979a700 1 -- 172.21.15.151:0/3759341577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e4101670 msgr2=0x7f00e419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00e979a700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e4101670 0x7f00e419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00e979a700 1 -- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e40ffaf0 msgr2=0x7f00e4195800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00e979a700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e40ffaf0 0x7f00e4195800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00e979a700 1 -- 172.21.15.151:0/3759341577 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d40095f0 con 0x7f00e4100ce0 2023-07-21T22:18:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00e9f9b700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e40ffaf0 0x7f00e4195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00ea79c700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e4101670 0x7f00e419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00e979a700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00e4100ce0 0x7f00e4195d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00d40098e0 tx=0x7f00d4005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00daffd700 1 -- 172.21.15.151:0/3759341577 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d401d070 con 0x7f00e4100ce0 2023-07-21T22:18:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00ec1ff700 1 -- 172.21.15.151:0/3759341577 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e419d8d0 con 0x7f00e4100ce0 2023-07-21T22:18:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.165+0000 7f00daffd700 1 -- 172.21.15.151:0/3759341577 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00d400bd50 con 0x7f00e4100ce0 2023-07-21T22:18:17.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.166+0000 7f00daffd700 1 -- 172.21.15.151:0/3759341577 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d4022cd0 con 0x7f00e4100ce0 2023-07-21T22:18:17.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.166+0000 7f00ec1ff700 1 -- 172.21.15.151:0/3759341577 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e419dd50 con 0x7f00e4100ce0 2023-07-21T22:18:17.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.169+0000 7f00daffd700 1 -- 172.21.15.151:0/3759341577 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f00d4022470 con 0x7f00e4100ce0 2023-07-21T22:18:17.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00ffaf8b80 1 Processor -- start 2023-07-21T22:18:17.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00ffaf8b80 1 -- start start 2023-07-21T22:18:17.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00daffd700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f00d00a11e0 0x7f00d00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00daffd700 1 -- 172.21.15.151:0/3759341577 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f00d40ce020 con 0x7f00e4100ce0 2023-07-21T22:18:17.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e052020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e0525a0 0x557f9e050760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e050d40 0x557f9e0511e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00ea79c700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f00d00a11e0 0x7f00d00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9df51c60 con 0x557f9e050d40 2023-07-21T22:18:17.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9dfa49f0 con 0x557f9e051c10 2023-07-21T22:18:17.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.171+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9df9de80 con 0x557f9e0525a0 2023-07-21T22:18:17.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00ea79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e050d40 0x557f9e0511e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e979a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e0525a0 0x557f9e050760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e979a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e0525a0 0x557f9e050760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45978/0 (socket says 172.21.15.151:45978) 2023-07-21T22:18:17.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e979a700 1 -- 172.21.15.151:0/3897238308 learned_addr learned my addr 172.21.15.151:0/3897238308 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e9f9b700 1 --2- 172.21.15.151:0/3897238308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e052020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e979a700 1 -- 172.21.15.151:0/3897238308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 msgr2=0x557f9e052020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e979a700 1 --2- 172.21.15.151:0/3897238308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e052020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e979a700 1 -- 172.21.15.151:0/3897238308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e050d40 msgr2=0x557f9e0511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e979a700 1 --2- 172.21.15.151:0/3897238308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e050d40 0x557f9e0511e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e979a700 1 -- 172.21.15.151:0/3897238308 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f9ddcbd90 con 0x557f9e0525a0 2023-07-21T22:18:17.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00e979a700 1 --2- 172.21.15.151:0/3897238308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e0525a0 0x557f9e050760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00d4097e00 tx=0x7f00d4009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4d4681e56b028ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.172+0000 7f00ea79c700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f00d00a11e0 0x7f00d00a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009fd0 tx=0x7f00dc003cf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00cffff700 1 -- 172.21.15.151:0/3897238308 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d409acf0 con 0x557f9e0525a0 2023-07-21T22:18:17.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00cffff700 1 -- 172.21.15.151:0/3897238308 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00d409b390 con 0x557f9e0525a0 2023-07-21T22:18:17.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00cffff700 1 -- 172.21.15.151:0/3897238308 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00d40a10d0 con 0x557f9e0525a0 2023-07-21T22:18:17.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/3897238308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e0525a0 msgr2=0x557f9e050760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/3897238308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e0525a0 0x557f9e050760 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f00d4097e00 tx=0x7f00d4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/3897238308 shutdown_connections 2023-07-21T22:18:17.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/3897238308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e052020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/3897238308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e050d40 0x557f9e0511e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/3897238308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e0525a0 0x557f9e050760 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.173+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/3897238308 >> 172.21.15.151:0/3897238308 conn(0x557f9e041ea0 msgr2=0x557f9e047310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.174+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/3897238308 shutdown_connections 2023-07-21T22:18:17.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.174+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/3897238308 wait complete. 2023-07-21T22:18:17.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.174+0000 7f00ffaf8b80 1 -- start start 2023-07-21T22:18:17.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.174+0000 7f00ffaf8b80 1 Processor -- start 2023-07-21T22:18:17.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e05a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e061690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9df3da70 con 0x557f9e0525a0 2023-07-21T22:18:17.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9df3d770 con 0x557f9e051c10 2023-07-21T22:18:17.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9de218d0 con 0x557f9e050d40 2023-07-21T22:18:17.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00ffaf8b80 10 client.0 _ll_register_callbacks cb 0x557f9df3b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:17.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00e9f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00e979a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e05a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00e9f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45980/0 (socket says 172.21.15.151:45980) 2023-07-21T22:18:17.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00e9f9b700 1 -- 172.21.15.151:0/162151337 learned_addr learned my addr 172.21.15.151:0/162151337 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00ea79c700 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e061690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00e9f9b700 1 -- 172.21.15.151:0/162151337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 msgr2=0x557f9e05a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.175+0000 7f00e9f9b700 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e05a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00e9f9b700 1 -- 172.21.15.151:0/162151337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 msgr2=0x557f9e061690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00e9f9b700 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e061690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00e9f9b700 1 -- 172.21.15.151:0/162151337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e419dd50 con 0x557f9e050d40 2023-07-21T22:18:17.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00e979a700 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e05a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00e9f9b700 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05a110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f00e0011d10 tx=0x7f00e000f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9f550b629393222 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:18:17.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00cd7fa700 1 -- 172.21.15.151:0/162151337 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0016070 con 0x557f9e050d40 2023-07-21T22:18:17.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00cd7fa700 1 -- 172.21.15.151:0/162151337 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f00e000fd90 con 0x557f9e050d40 2023-07-21T22:18:17.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/162151337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f9def74a0 con 0x557f9e050d40 2023-07-21T22:18:17.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00cd7fa700 1 -- 172.21.15.151:0/162151337 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00e0004050 con 0x557f9e050d40 2023-07-21T22:18:17.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.176+0000 7f00ffaf8b80 10 client.24976 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:17.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.177+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/162151337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x557f9ddb4c10 con 0x557f9e050d40 2023-07-21T22:18:17.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.177+0000 7f00cd7fa700 1 -- 172.21.15.151:0/162151337 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557f9def74a0 con 0x557f9e050d40 2023-07-21T22:18:17.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.177+0000 7f00cd7fa700 1 -- 172.21.15.151:0/162151337 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f00e0026480 con 0x557f9e050d40 2023-07-21T22:18:17.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.177+0000 7f00ffaf8b80 10 client.24976 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:17.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.177+0000 7f00ffaf8b80 10 client.24976 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-21T22:18:17.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.177+0000 7f00ffaf8b80 20 client.24976 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:17.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.177+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x557f9e0653c0 0x557f9e064740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.177+0000 7f00ffaf8b80 4 client.24976 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:18:17.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.177+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/162151337 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f9df96e60 con 0x557f9e0653c0 2023-07-21T22:18:17.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.178+0000 7f00e979a700 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x557f9e0653c0 0x557f9e064740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.178+0000 7f00e979a700 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x557f9e0653c0 0x557f9e064740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7381990434c54787 server_cookie=85ef5860316b00ad in_seq=0 out_seq=0 2023-07-21T22:18:17.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.178+0000 7f00cd7fa700 10 client.24976 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:18:17.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00cd7fa700 1 -- 172.21.15.151:0/162151337 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557f9df96e60 con 0x557f9e0653c0 2023-07-21T22:18:17.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00cd7fa700 10 client.24976 handle_command_reply: tid=0 2023-07-21T22:18:17.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00ffaf8b80 1 client.24976 shutdown 2023-07-21T22:18:17.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/162151337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 msgr2=0x557f9e05a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05a110 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f00e0011d10 tx=0x7f00e000f6a0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/162151337 shutdown_connections 2023-07-21T22:18:17.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x557f9e0653c0 0x557f9e064740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e061690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05a110 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00cd7fa700 0 client.24976 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:18:17.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.179+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/162151337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e05a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.180+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/162151337 >> 172.21.15.151:0/162151337 conn(0x557f9e041ea0 msgr2=0x557f9e0469b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.180+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/162151337 shutdown_connections 2023-07-21T22:18:17.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.180+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/162151337 wait complete. 2023-07-21T22:18:17.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.180+0000 7f00ffaf8b80 20 client.24976 trim_cache size 0 max 16384 2023-07-21T22:18:17.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.199+0000 7f00ffaf8b80 1 Processor -- start 2023-07-21T22:18:17.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.199+0000 7f00ffaf8b80 1 -- start start 2023-07-21T22:18:17.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e050d40 0x557f9e0469b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e051c10 0x557f9e0615b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e058300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9df51c60 con 0x557f9e0525a0 2023-07-21T22:18:17.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9e03f050 con 0x557f9e050d40 2023-07-21T22:18:17.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9def74a0 con 0x557f9e051c10 2023-07-21T22:18:17.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ea79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e058300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ea79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e058300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60404/0 (socket says 172.21.15.151:60404) 2023-07-21T22:18:17.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ea79c700 1 -- 172.21.15.151:0/940152276 learned_addr learned my addr 172.21.15.151:0/940152276 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00e979a700 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e051c10 0x557f9e0615b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00e9f9b700 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e050d40 0x557f9e0469b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ea79c700 1 -- 172.21.15.151:0/940152276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e051c10 msgr2=0x557f9e0615b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ea79c700 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e051c10 0x557f9e0615b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ea79c700 1 -- 172.21.15.151:0/940152276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e050d40 msgr2=0x557f9e0469b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ea79c700 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e050d40 0x557f9e0469b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.200+0000 7f00ea79c700 1 -- 172.21.15.151:0/940152276 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f9e0591a0 con 0x557f9e0525a0 2023-07-21T22:18:17.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.201+0000 7f00e979a700 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e051c10 0x557f9e0615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.201+0000 7f00ea79c700 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e058300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0091b0 tx=0x7f00dc020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bffb7bb12f2cc6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.201+0000 7f00d8ff9700 1 -- 172.21.15.151:0/940152276 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc007710 con 0x557f9e0525a0 2023-07-21T22:18:17.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.201+0000 7f00d8ff9700 1 -- 172.21.15.151:0/940152276 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00dc00f040 con 0x557f9e0525a0 2023-07-21T22:18:17.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.201+0000 7f00d8ff9700 1 -- 172.21.15.151:0/940152276 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00dc01ba10 con 0x557f9e0525a0 2023-07-21T22:18:17.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/940152276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 msgr2=0x557f9e058300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e058300 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f00dc0091b0 tx=0x7f00dc020000 comp rx=0 tx=0).stop 2023-07-21T22:18:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/940152276 shutdown_connections 2023-07-21T22:18:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e050d40 0x557f9e0469b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e058300 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/940152276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e051c10 0x557f9e0615b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/940152276 >> 172.21.15.151:0/940152276 conn(0x557f9e041ea0 msgr2=0x557f9e06e130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/940152276 shutdown_connections 2023-07-21T22:18:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/940152276 wait complete. 2023-07-21T22:18:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.202+0000 7f00ffaf8b80 1 -- start start 2023-07-21T22:18:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00ffaf8b80 1 Processor -- start 2023-07-21T22:18:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00ffaf8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e0b97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9e0b9ce0 con 0x557f9e0525a0 2023-07-21T22:18:17.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9e0b9e20 con 0x557f9e051c10 2023-07-21T22:18:17.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00ffaf8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9e0b9fe0 con 0x557f9e050d40 2023-07-21T22:18:17.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00ffaf8b80 10 client.0 _ll_register_callbacks cb 0x557f9df3b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:17.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00e9f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00e9f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46006/0 (socket says 172.21.15.151:46006) 2023-07-21T22:18:17.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00ea79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e0b97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00e9f9b700 1 -- 172.21.15.151:0/1805817489 learned_addr learned my addr 172.21.15.151:0/1805817489 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.203+0000 7f00e979a700 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00e9f9b700 1 -- 172.21.15.151:0/1805817489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 msgr2=0x557f9e0b7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00e9f9b700 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e0b7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00e9f9b700 1 -- 172.21.15.151:0/1805817489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 msgr2=0x557f9e0b97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00e9f9b700 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e0b97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00e9f9b700 1 -- 172.21.15.151:0/1805817489 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f9ddcbd90 con 0x557f9e050d40 2023-07-21T22:18:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00e9f9b700 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05f5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00e00267e0 tx=0x7f00e000fa60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d507ff5d2c001489 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00cd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:18:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00cd7fa700 1 -- 172.21.15.151:0/1805817489 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00e0016040 con 0x557f9e050d40 2023-07-21T22:18:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/1805817489 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00d409b390 con 0x557f9e050d40 2023-07-21T22:18:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.204+0000 7f00cd7fa700 1 -- 172.21.15.151:0/1805817489 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f00e002b070 con 0x557f9e050d40 2023-07-21T22:18:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00cd7fa700 1 -- 172.21.15.151:0/1805817489 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f00e0026b80 con 0x557f9e050d40 2023-07-21T22:18:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00ffaf8b80 10 client.24982 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/1805817489 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f00dc004040 con 0x557f9e050d40 2023-07-21T22:18:17.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00cd7fa700 1 -- 172.21.15.151:0/1805817489 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00d409b390 con 0x557f9e050d40 2023-07-21T22:18:17.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00cd7fa700 1 -- 172.21.15.151:0/1805817489 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f00e003b480 con 0x557f9e050d40 2023-07-21T22:18:17.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00ffaf8b80 10 client.24982 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:17.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00ffaf8b80 10 client.24982 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-21T22:18:17.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00ffaf8b80 20 client.24982 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:17.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x557f9e0bed70 0x557f9e0bb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00ffaf8b80 4 client.24982 mds_command: new command op to 24548 tid=0[{"prefix": "status"}] 2023-07-21T22:18:17.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.205+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/1805817489 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557f9df59000 con 0x557f9e0bed70 2023-07-21T22:18:17.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.207+0000 7f00e979a700 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x557f9e0bed70 0x557f9e0bb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.207+0000 7f00cd7fa700 10 client.24982 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:18:17.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.207+0000 7f00e979a700 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x557f9e0bed70 0x557f9e0bb6c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a5287d6ef5e6c5b0 server_cookie=1a384de8e4251ce6 in_seq=0 out_seq=0 2023-07-21T22:18:17.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.207+0000 7f00cd7fa700 1 -- 172.21.15.151:0/1805817489 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x557f9df59000 con 0x557f9e0bed70 2023-07-21T22:18:17.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.207+0000 7f00cd7fa700 10 client.24982 handle_command_reply: tid=0 2023-07-21T22:18:17.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.207+0000 7f00ffaf8b80 1 client.24982 shutdown 2023-07-21T22:18:17.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/1805817489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 msgr2=0x557f9e05f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05f5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f00e00267e0 tx=0x7f00e000fa60 comp rx=0 tx=0).stop 2023-07-21T22:18:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/1805817489 shutdown_connections 2023-07-21T22:18:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x557f9e0bed70 0x557f9e0bb6c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f9e0525a0 0x557f9e0b97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f9e050d40 0x557f9e05f5a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00cd7fa700 0 client.24982 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:18:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 --2- 172.21.15.151:0/1805817489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f9e051c10 0x557f9e0b7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/1805817489 >> 172.21.15.151:0/1805817489 conn(0x557f9e041ea0 msgr2=0x557f9e0469b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/1805817489 shutdown_connections 2023-07-21T22:18:17.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 1 -- 172.21.15.151:0/1805817489 wait complete. 2023-07-21T22:18:17.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.208+0000 7f00ffaf8b80 20 client.24982 trim_cache size 0 max 16384 2023-07-21T22:18:17.259 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:18:17.259 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:18:17.260 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 2, 2023-07-21T22:18:17.260 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 24548, 2023-07-21T22:18:17.260 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-07-21T22:18:17.260 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-07-21T22:18:17.260 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-07-21T22:18:17.260 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 63.020246299999997, 2023-07-21T22:18:17.260 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 23, 2023-07-21T22:18:17.260 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 87, 2023-07-21T22:18:17.261 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 85, 2023-07-21T22:18:17.261 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 86.301975110000001 2023-07-21T22:18:17.261 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:18:17.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 -- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f00d00a11e0 msgr2=0x7f00d00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f00d00a11e0 0x7f00d00a3690 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00dc009fd0 tx=0x7f00dc003cf0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 -- 172.21.15.151:0/3759341577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00e4100ce0 msgr2=0x7f00e4195d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00e4100ce0 0x7f00e4195d40 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f00d40098e0 tx=0x7f00d4005740 comp rx=0 tx=0).stop 2023-07-21T22:18:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 -- 172.21.15.151:0/3759341577 shutdown_connections 2023-07-21T22:18:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f00d00a11e0 0x7f00d00a3690 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00e4101670 0x7f00e419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00e40ffaf0 0x7f00e4195800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 --2- 172.21.15.151:0/3759341577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00e4100ce0 0x7f00e4195d40 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 -- 172.21.15.151:0/3759341577 >> 172.21.15.151:0/3759341577 conn(0x7f00e40fb130 msgr2=0x7f00e4104270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 -- 172.21.15.151:0/3759341577 shutdown_connections 2023-07-21T22:18:17.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.209+0000 7f00ec1ff700 1 -- 172.21.15.151:0/3759341577 wait complete. 2023-07-21T22:18:17.271 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-07-21T22:18:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.431+0000 7f4f465ff700 1 -- 172.21.15.151:0/1403507954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 msgr2=0x7f4f40101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.431+0000 7f4f465ff700 1 --2- 172.21.15.151:0/1403507954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 0x7f4f40101140 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f4f34009990 tx=0x7f4f34009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.432+0000 7f4f465ff700 1 -- 172.21.15.151:0/1403507954 shutdown_connections 2023-07-21T22:18:17.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.432+0000 7f4f465ff700 1 --2- 172.21.15.151:0/1403507954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f40101680 0x7f4f40107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.432+0000 7f4f465ff700 1 --2- 172.21.15.151:0/1403507954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f400ffb00 0x7f4f400fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.432+0000 7f4f465ff700 1 --2- 172.21.15.151:0/1403507954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 0x7f4f40101140 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.432+0000 7f4f465ff700 1 -- 172.21.15.151:0/1403507954 >> 172.21.15.151:0/1403507954 conn(0x7f4f400fb120 msgr2=0x7f4f400fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.432+0000 7f4f465ff700 1 -- 172.21.15.151:0/1403507954 shutdown_connections 2023-07-21T22:18:17.477 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.432+0000 7f4f465ff700 1 -- 172.21.15.151:0/1403507954 wait complete. 2023-07-21T22:18:17.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f465ff700 1 Processor -- start 2023-07-21T22:18:17.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f465ff700 1 -- start start 2023-07-21T22:18:17.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f465ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f400ffb00 0x7f4f40197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f465ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 0x7f4f40197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f465ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f40101680 0x7f4f4019ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f465ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4019f4d0 con 0x7f4f40100cf0 2023-07-21T22:18:17.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f465ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4019f610 con 0x7f4f400ffb00 2023-07-21T22:18:17.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f465ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f4019f7a0 con 0x7f4f40101680 2023-07-21T22:18:17.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 0x7f4f40197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f400ffb00 0x7f4f40197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f400ffb00 0x7f4f40197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57374/0 (socket says 172.21.15.151:57374) 2023-07-21T22:18:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 0x7f4f40197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60440/0 (socket says 172.21.15.151:60440) 2023-07-21T22:18:17.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.433+0000 7f4f3ffff700 1 -- 172.21.15.151:0/2640134979 learned_addr learned my addr 172.21.15.151:0/2640134979 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f44b9c700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f40101680 0x7f4f4019ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3f7fe700 1 -- 172.21.15.151:0/2640134979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f40101680 msgr2=0x7f4f4019ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f40101680 0x7f4f4019ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3f7fe700 1 -- 172.21.15.151:0/2640134979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f400ffb00 msgr2=0x7f4f40197950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f400ffb00 0x7f4f40197950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3f7fe700 1 -- 172.21.15.151:0/2640134979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f340095f0 con 0x7f4f40100cf0 2023-07-21T22:18:17.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3ffff700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f400ffb00 0x7f4f40197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 0x7f4f40197e90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4f340098e0 tx=0x7f4f34009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3d7fa700 1 -- 172.21.15.151:0/2640134979 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3401d070 con 0x7f4f40100cf0 2023-07-21T22:18:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3d7fa700 1 -- 172.21.15.151:0/2640134979 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f34004c80 con 0x7f4f40100cf0 2023-07-21T22:18:17.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f465ff700 1 -- 172.21.15.151:0/2640134979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f4019fa20 con 0x7f4f40100cf0 2023-07-21T22:18:17.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.434+0000 7f4f3d7fa700 1 -- 172.21.15.151:0/2640134979 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34003a30 con 0x7f4f40100cf0 2023-07-21T22:18:17.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.435+0000 7f4f465ff700 1 -- 172.21.15.151:0/2640134979 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f4019fe40 con 0x7f4f40100cf0 2023-07-21T22:18:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.438+0000 7f4f3d7fa700 1 -- 172.21.15.151:0/2640134979 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f4f340047f0 con 0x7f4f40100cf0 2023-07-21T22:18:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.439+0000 7f4f59e7eb80 1 Processor -- start 2023-07-21T22:18:17.492 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.439+0000 7f4f59e7eb80 1 -- start start 2023-07-21T22:18:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.439+0000 7f4f3d7fa700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4f280a11e0 0x7f4f280a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.439+0000 7f4f3d7fa700 1 -- 172.21.15.151:0/2640134979 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4f340cd920 con 0x7f4f40100cf0 2023-07-21T22:18:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.439+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fd8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.493 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 0x55cda1fd7e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1edcc60 con 0x55cda1fd9150 2023-07-21T22:18:17.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1f2f9f0 con 0x55cda1fd87e0 2023-07-21T22:18:17.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1f28e80 con 0x55cda1fd79c0 2023-07-21T22:18:17.494 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f44b9c700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4f280a11e0 0x7f4f280a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fd8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fd8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57390/0 (socket says 172.21.15.151:57390) 2023-07-21T22:18:17.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3ffff700 1 -- 172.21.15.151:0/3230637891 learned_addr learned my addr 172.21.15.151:0/3230637891 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f44b9c700 1 --2- 172.21.15.151:0/3230637891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 0x55cda1fd7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3f7fe700 1 -- 172.21.15.151:0/3230637891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 msgr2=0x55cda1fd7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/3230637891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 0x55cda1fd7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3f7fe700 1 -- 172.21.15.151:0/3230637891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 msgr2=0x55cda1fd8bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/3230637891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fd8bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3f7fe700 1 -- 172.21.15.151:0/3230637891 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cda1d56d90 con 0x55cda1fd9150 2023-07-21T22:18:17.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f3ffff700 1 --2- 172.21.15.151:0/3230637891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fd8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.440+0000 7f4f44b9c700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4f280a11e0 0x7f4f280a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800f3c0 tx=0x7f4f3800f780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.441+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/3230637891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd73e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4f340cb2a0 tx=0x7f4f34004aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5502907ce2af18ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.441+0000 7f4f267fc700 1 -- 172.21.15.151:0/3230637891 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3409ed80 con 0x55cda1fd9150 2023-07-21T22:18:17.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.441+0000 7f4f267fc700 1 -- 172.21.15.151:0/3230637891 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f340a3110 con 0x55cda1fd9150 2023-07-21T22:18:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.441+0000 7f4f267fc700 1 -- 172.21.15.151:0/3230637891 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f340a2ec0 con 0x55cda1fd9150 2023-07-21T22:18:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.441+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/3230637891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 msgr2=0x55cda1fd73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.441+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/3230637891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd73e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f4f340cb2a0 tx=0x7f4f34004aa0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.442+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/3230637891 shutdown_connections 2023-07-21T22:18:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.442+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/3230637891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fd8bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.442+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/3230637891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 0x55cda1fd7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.442+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/3230637891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd73e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.442+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/3230637891 >> 172.21.15.151:0/3230637891 conn(0x55cda1fccea0 msgr2=0x55cda1fd2310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.442+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/3230637891 shutdown_connections 2023-07-21T22:18:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.442+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/3230637891 wait complete. 2023-07-21T22:18:17.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.442+0000 7f4f59e7eb80 1 -- start start 2023-07-21T22:18:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.442+0000 7f4f59e7eb80 1 Processor -- start 2023-07-21T22:18:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 0x55cda1fe12b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 0x55cda1fe82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1ec8a70 con 0x55cda1fd79c0 2023-07-21T22:18:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1ec8770 con 0x55cda1fd9150 2023-07-21T22:18:17.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1dac8d0 con 0x55cda1fd87e0 2023-07-21T22:18:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f59e7eb80 10 client.0 _ll_register_callbacks cb 0x55cda1ec6710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe0d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60470/0 (socket says 172.21.15.151:60470) 2023-07-21T22:18:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f3ffff700 1 -- 172.21.15.151:0/2556488679 learned_addr learned my addr 172.21.15.151:0/2556488679 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 0x55cda1fe12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.443+0000 7f4f44b9c700 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 0x55cda1fe82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f3ffff700 1 -- 172.21.15.151:0/2556488679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 msgr2=0x55cda1fe12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f3ffff700 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 0x55cda1fe12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f3ffff700 1 -- 172.21.15.151:0/2556488679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 msgr2=0x55cda1fe82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f3ffff700 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 0x55cda1fe82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f3ffff700 1 -- 172.21.15.151:0/2556488679 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f300103d0 con 0x55cda1fd79c0 2023-07-21T22:18:17.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f3ffff700 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe0d70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4f30010a60 tx=0x7f4f30010d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a0eab40e9e1165a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f1f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:18:17.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/2556488679 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f30016070 con 0x55cda1fd79c0 2023-07-21T22:18:17.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2556488679 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cda1e824a0 con 0x55cda1fd79c0 2023-07-21T22:18:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/2556488679 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4f300119e0 con 0x55cda1fd79c0 2023-07-21T22:18:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/2556488679 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f30011ba0 con 0x55cda1fd79c0 2023-07-21T22:18:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f59e7eb80 10 client.15126 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.444+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2556488679 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f4f4019fe40 con 0x55cda1fd79c0 2023-07-21T22:18:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.445+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/2556488679 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cda1e824a0 con 0x55cda1fd79c0 2023-07-21T22:18:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.445+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/2556488679 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4f30005250 con 0x55cda1fd79c0 2023-07-21T22:18:17.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.445+0000 7f4f59e7eb80 10 client.15126 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:17.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.445+0000 7f4f59e7eb80 10 client.15126 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-21T22:18:17.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.445+0000 7f4f59e7eb80 20 client.15126 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:17.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.445+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55cda1fec040 0x55cda1feb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.445+0000 7f4f59e7eb80 4 client.15126 mds_command: new command op to 24574 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:18:17.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.445+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2556488679 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cda1f21e60 con 0x55cda1fec040 2023-07-21T22:18:17.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.445+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55cda1fec040 0x55cda1feb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.446+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55cda1fec040 0x55cda1feb3f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72a4263ca305c0d3 server_cookie=8284b2d5a1e143a3 in_seq=0 out_seq=0 2023-07-21T22:18:17.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.446+0000 7f4f1f7fe700 10 client.15126 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:18:17.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.446+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/2556488679 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cda1f21e60 con 0x55cda1fec040 2023-07-21T22:18:17.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.446+0000 7f4f1f7fe700 10 client.15126 handle_command_reply: tid=0 2023-07-21T22:18:17.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 client.15126 shutdown 2023-07-21T22:18:17.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2556488679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 msgr2=0x55cda1fe0d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe0d70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f4f30010a60 tx=0x7f4f30010d70 comp rx=0 tx=0).stop 2023-07-21T22:18:17.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2556488679 shutdown_connections 2023-07-21T22:18:17.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55cda1fec040 0x55cda1feb3f0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 0x55cda1fe82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe0d70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2556488679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 0x55cda1fe12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f1f7fe700 0 client.15126 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:18:17.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2556488679 >> 172.21.15.151:0/2556488679 conn(0x55cda1fccea0 msgr2=0x55cda1fd19b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2556488679 shutdown_connections 2023-07-21T22:18:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2556488679 wait complete. 2023-07-21T22:18:17.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.447+0000 7f4f59e7eb80 20 client.15126 trim_cache size 0 max 16384 2023-07-21T22:18:17.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.466+0000 7f4f59e7eb80 1 Processor -- start 2023-07-21T22:18:17.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.466+0000 7f4f59e7eb80 1 -- start start 2023-07-21T22:18:17.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.466+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 0x55cda1fd7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.466+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fe82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.466+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd19b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.466+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1f28e80 con 0x55cda1fd9150 2023-07-21T22:18:17.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.466+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1f2f9f0 con 0x55cda1fd87e0 2023-07-21T22:18:17.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.466+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1e824a0 con 0x55cda1fd79c0 2023-07-21T22:18:17.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f44b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f44b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd19b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60482/0 (socket says 172.21.15.151:60482) 2023-07-21T22:18:17.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f44b9c700 1 -- 172.21.15.151:0/2136332440 learned_addr learned my addr 172.21.15.151:0/2136332440 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f3ffff700 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 0x55cda1fd7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fe82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f44b9c700 1 -- 172.21.15.151:0/2136332440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 msgr2=0x55cda1fd7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f44b9c700 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 0x55cda1fd7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f44b9c700 1 -- 172.21.15.151:0/2136332440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 msgr2=0x55cda1fe82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f44b9c700 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fe82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f44b9c700 1 -- 172.21.15.151:0/2136332440 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cda1d3fc10 con 0x55cda1fd9150 2023-07-21T22:18:17.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fe82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:17.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.467+0000 7f4f44b9c700 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd19b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4f38016880 tx=0x7f4f3801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0c7bf9350de69d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f26ffd700 1 -- 172.21.15.151:0/2136332440 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f380174a0 con 0x55cda1fd9150 2023-07-21T22:18:17.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f26ffd700 1 -- 172.21.15.151:0/2136332440 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f38017a90 con 0x55cda1fd9150 2023-07-21T22:18:17.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f26ffd700 1 -- 172.21.15.151:0/2136332440 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f38023b70 con 0x55cda1fd9150 2023-07-21T22:18:17.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2136332440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 msgr2=0x55cda1fd19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd19b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4f38016880 tx=0x7f4f3801a000 comp rx=0 tx=0).stop 2023-07-21T22:18:17.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2136332440 shutdown_connections 2023-07-21T22:18:17.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd9150 0x55cda1fd19b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd79c0 0x55cda1fd7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/2136332440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd87e0 0x55cda1fe82b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2136332440 >> 172.21.15.151:0/2136332440 conn(0x55cda1fccea0 msgr2=0x55cda1fdfac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2136332440 shutdown_connections 2023-07-21T22:18:17.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.468+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/2136332440 wait complete. 2023-07-21T22:18:17.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.469+0000 7f4f59e7eb80 1 -- start start 2023-07-21T22:18:17.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.469+0000 7f4f59e7eb80 1 Processor -- start 2023-07-21T22:18:17.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.469+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.469+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 0x55cda1fe3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.469+0000 7f4f59e7eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 0x55cda1fe6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.469+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1fe6fc0 con 0x55cda1fd79c0 2023-07-21T22:18:17.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.469+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1fe7130 con 0x55cda1fd9150 2023-07-21T22:18:17.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.469+0000 7f4f59e7eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cda1fe72f0 con 0x55cda1fd87e0 2023-07-21T22:18:17.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.469+0000 7f4f59e7eb80 10 client.0 _ll_register_callbacks cb 0x7f4f30010560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:17.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 0x55cda1fe3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60492/0 (socket says 172.21.15.151:60492) 2023-07-21T22:18:17.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3ffff700 1 -- 172.21.15.151:0/136208414 learned_addr learned my addr 172.21.15.151:0/136208414 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f44b9c700 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 0x55cda1fe6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3f7fe700 1 -- 172.21.15.151:0/136208414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 msgr2=0x55cda1fe6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 0x55cda1fe6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3f7fe700 1 -- 172.21.15.151:0/136208414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 msgr2=0x55cda1fe3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3f7fe700 1 -- 172.21.15.151:0/136208414 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f38016530 con 0x55cda1fd87e0 2023-07-21T22:18:17.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3ffff700 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f3f7fe700 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 0x55cda1fe3a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f340990a0 tx=0x7f4f3409aed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb6393349f1f79ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.470+0000 7f4f1f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:18:17.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/136208414 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3409ee00 con 0x55cda1fd87e0 2023-07-21T22:18:17.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/136208414 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4f3409a240 con 0x55cda1fd87e0 2023-07-21T22:18:17.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/136208414 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f340a3110 con 0x55cda1fd87e0 2023-07-21T22:18:17.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/136208414 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f340cb4f0 con 0x55cda1fd87e0 2023-07-21T22:18:17.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f59e7eb80 10 client.25000 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:17.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/136208414 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x55cda1d7d200 con 0x55cda1fd87e0 2023-07-21T22:18:17.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/136208414 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f340a3110 con 0x55cda1fd87e0 2023-07-21T22:18:17.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/136208414 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4f340a2c80 con 0x55cda1fd87e0 2023-07-21T22:18:17.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f59e7eb80 10 client.25000 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:17.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f59e7eb80 10 client.25000 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-21T22:18:17.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f59e7eb80 20 client.25000 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:17.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55cda2045250 0x55cda2041ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f59e7eb80 4 client.25000 mds_command: new command op to 24574 tid=0[{"prefix": "status"}] 2023-07-21T22:18:17.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.471+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/136208414 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55cda1ee4000 con 0x55cda2045250 2023-07-21T22:18:17.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.472+0000 7f4f3ffff700 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55cda2045250 0x55cda2041ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.472+0000 7f4f3ffff700 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55cda2045250 0x55cda2041ef0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=982fadc6e3b7782c server_cookie=66633608dd55a939 in_seq=0 out_seq=0 2023-07-21T22:18:17.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.472+0000 7f4f1f7fe700 10 client.25000 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:18:17.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.472+0000 7f4f1f7fe700 1 -- 172.21.15.151:0/136208414 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x55cda1ee4000 con 0x55cda2045250 2023-07-21T22:18:17.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.472+0000 7f4f1f7fe700 10 client.25000 handle_command_reply: tid=0 2023-07-21T22:18:17.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.472+0000 7f4f59e7eb80 1 client.25000 shutdown 2023-07-21T22:18:17.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/136208414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 msgr2=0x55cda1fe3a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 0x55cda1fe3a60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4f340990a0 tx=0x7f4f3409aed0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/136208414 shutdown_connections 2023-07-21T22:18:17.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55cda2045250 0x55cda2041ef0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cda1fd9150 0x55cda1fe6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cda1fd79c0 0x55cda1fe3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 --2- 172.21.15.151:0/136208414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cda1fd87e0 0x55cda1fe3a60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f1f7fe700 0 client.25000 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:18:17.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/136208414 >> 172.21.15.151:0/136208414 conn(0x55cda1fccea0 msgr2=0x55cda1fdef40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/136208414 shutdown_connections 2023-07-21T22:18:17.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 1 -- 172.21.15.151:0/136208414 wait complete. 2023-07-21T22:18:17.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.473+0000 7f4f59e7eb80 20 client.25000 trim_cache size 0 max 16384 2023-07-21T22:18:17.529 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:18:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:18:17.529 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 1, 2023-07-21T22:18:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 24574, 2023-07-21T22:18:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-07-21T22:18:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-07-21T22:18:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-07-21T22:18:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 64.291296349999996, 2023-07-21T22:18:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 23, 2023-07-21T22:18:17.530 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 87, 2023-07-21T22:18:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 85, 2023-07-21T22:18:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 83.384883114000004 2023-07-21T22:18:17.531 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:18:17.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 -- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4f280a11e0 msgr2=0x7f4f280a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4f280a11e0 0x7f4f280a3690 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f4f3800f3c0 tx=0x7f4f3800f780 comp rx=0 tx=0).stop 2023-07-21T22:18:17.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 -- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 msgr2=0x7f4f40197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 0x7f4f40197e90 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4f340098e0 tx=0x7f4f34009580 comp rx=0 tx=0).stop 2023-07-21T22:18:17.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 -- 172.21.15.151:0/2640134979 shutdown_connections 2023-07-21T22:18:17.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4f280a11e0 0x7f4f280a3690 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f400ffb00 0x7f4f40197950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f40101680 0x7f4f4019ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 --2- 172.21.15.151:0/2640134979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f40100cf0 0x7f4f40197e90 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 -- 172.21.15.151:0/2640134979 >> 172.21.15.151:0/2640134979 conn(0x7f4f400fb120 msgr2=0x7f4f400fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 -- 172.21.15.151:0/2640134979 shutdown_connections 2023-07-21T22:18:17.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.474+0000 7f4f465ff700 1 -- 172.21.15.151:0/2640134979 wait complete. 2023-07-21T22:18:17.537 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:17 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1162568070' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:17.537 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:17 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:17 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:17 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:17 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:17 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:17 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.538 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:17 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1939594127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:17.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-21T22:18:17.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.703+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3583828506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a64074550 msgr2=0x7f0a640729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.703+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3583828506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a64074550 0x7f0a640729a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0a600098f0 tx=0x7f0a60009c00 comp rx=0 tx=0).stop 2023-07-21T22:18:17.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.703+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3583828506 shutdown_connections 2023-07-21T22:18:17.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.703+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3583828506 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a64074550 0x7f0a640729a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.703+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3583828506 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a6410c0c0 0x7f0a6410e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.703+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3583828506 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a64072f70 0x7f0a640733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.703+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3583828506 >> 172.21.15.151:0/3583828506 conn(0x7f0a640fb130 msgr2=0x7f0a640fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.703+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3583828506 shutdown_connections 2023-07-21T22:18:17.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.703+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3583828506 wait complete. 2023-07-21T22:18:17.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.704+0000 7f0a6c7ff700 1 Processor -- start 2023-07-21T22:18:17.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.704+0000 7f0a6c7ff700 1 -- start start 2023-07-21T22:18:17.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.704+0000 7f0a6c7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a64072f70 0x7f0a6419be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.704+0000 7f0a6c7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a64074550 0x7f0a6419c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.704+0000 7f0a6c7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a6410c0c0 0x7f0a641a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6c7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a641a39d0 con 0x7f0a64072f70 2023-07-21T22:18:17.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6c7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a641a3b10 con 0x7f0a64074550 2023-07-21T22:18:17.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6c7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a641a3ca0 con 0x7f0a6410c0c0 2023-07-21T22:18:17.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6a59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a64072f70 0x7f0a6419be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6a59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a64072f70 0x7f0a6419be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60510/0 (socket says 172.21.15.151:60510) 2023-07-21T22:18:17.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6a59b700 1 -- 172.21.15.151:0/3031863266 learned_addr learned my addr 172.21.15.151:0/3031863266 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6ad9c700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a6410c0c0 0x7f0a641a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a64074550 0x7f0a6419c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6a59b700 1 -- 172.21.15.151:0/3031863266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a6410c0c0 msgr2=0x7f0a641a3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a6410c0c0 0x7f0a641a3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6a59b700 1 -- 172.21.15.151:0/3031863266 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a64074550 msgr2=0x7f0a6419c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a64074550 0x7f0a6419c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a6a59b700 1 -- 172.21.15.151:0/3031863266 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a540095f0 con 0x7f0a64072f70 2023-07-21T22:18:17.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.705+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a64074550 0x7f0a6419c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.706+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a64072f70 0x7f0a6419be50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009fd0 tx=0x7f0a6000b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.706+0000 7f0a5b7fe700 1 -- 172.21.15.151:0/3031863266 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a6001c070 con 0x7f0a64072f70 2023-07-21T22:18:17.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.706+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3031863266 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a60009520 con 0x7f0a64072f70 2023-07-21T22:18:17.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.706+0000 7f0a5b7fe700 1 -- 172.21.15.151:0/3031863266 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a6000f7d0 con 0x7f0a64072f70 2023-07-21T22:18:17.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.706+0000 7f0a5b7fe700 1 -- 172.21.15.151:0/3031863266 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a60003a00 con 0x7f0a64072f70 2023-07-21T22:18:17.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.706+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3031863266 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a641a41c0 con 0x7f0a64072f70 2023-07-21T22:18:17.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.709+0000 7f0a5b7fe700 1 -- 172.21.15.151:0/3031863266 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f0a60020030 con 0x7f0a64072f70 2023-07-21T22:18:17.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.711+0000 7f0a80215b80 1 Processor -- start 2023-07-21T22:18:17.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.711+0000 7f0a5b7fe700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0a500a11e0 0x7f0a500a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.711+0000 7f0a5b7fe700 1 -- 172.21.15.151:0/3031863266 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f0a600cdb20 con 0x7f0a64072f70 2023-07-21T22:18:17.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.711+0000 7f0a80215b80 1 -- start start 2023-07-21T22:18:17.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.711+0000 7f0a6ad9c700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0a500a11e0 0x7f0a500a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.711+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dc7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc8150 0x556d99dc63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dc6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a80215b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99ccbc60 con 0x556d99dc69c0 2023-07-21T22:18:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a80215b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99d1e9f0 con 0x556d99dc8150 2023-07-21T22:18:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a80215b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99d17e80 con 0x556d99dc77e0 2023-07-21T22:18:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6ad9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dc6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6a59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dc7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6a59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dc7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46110/0 (socket says 172.21.15.151:46110) 2023-07-21T22:18:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6ad9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dc6e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60514/0 (socket says 172.21.15.151:60514) 2023-07-21T22:18:17.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6a59b700 1 -- 172.21.15.151:0/1513804187 learned_addr learned my addr 172.21.15.151:0/1513804187 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/1513804187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc8150 0x556d99dc63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6a59b700 1 -- 172.21.15.151:0/1513804187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc8150 msgr2=0x556d99dc63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/1513804187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc8150 0x556d99dc63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6a59b700 1 -- 172.21.15.151:0/1513804187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 msgr2=0x556d99dc6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/1513804187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dc6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6a59b700 1 -- 172.21.15.151:0/1513804187 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d99b45d90 con 0x556d99dc77e0 2023-07-21T22:18:17.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/1513804187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc8150 0x556d99dc63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:17.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.712+0000 7f0a6ad9c700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0a500a11e0 0x7f0a500a3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009c70 tx=0x7f0a5c004320 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.713+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/1513804187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dc7bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a600978a0 tx=0x7f0a60005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=92f75d46103e2a87 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.713+0000 7f0a58ff9700 1 -- 172.21.15.151:0/1513804187 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600b2070 con 0x556d99dc77e0 2023-07-21T22:18:17.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.713+0000 7f0a58ff9700 1 -- 172.21.15.151:0/1513804187 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a600a31f0 con 0x556d99dc77e0 2023-07-21T22:18:17.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.713+0000 7f0a58ff9700 1 -- 172.21.15.151:0/1513804187 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600cb810 con 0x556d99dc77e0 2023-07-21T22:18:17.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.713+0000 7f0a80215b80 1 -- 172.21.15.151:0/1513804187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 msgr2=0x556d99dc7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.713+0000 7f0a80215b80 1 --2- 172.21.15.151:0/1513804187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dc7bf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a600978a0 tx=0x7f0a60005830 comp rx=0 tx=0).stop 2023-07-21T22:18:17.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.714+0000 7f0a80215b80 1 -- 172.21.15.151:0/1513804187 shutdown_connections 2023-07-21T22:18:17.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.714+0000 7f0a80215b80 1 --2- 172.21.15.151:0/1513804187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dc6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.714+0000 7f0a80215b80 1 --2- 172.21.15.151:0/1513804187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dc7bf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.714+0000 7f0a80215b80 1 --2- 172.21.15.151:0/1513804187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc8150 0x556d99dc63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.714+0000 7f0a80215b80 1 -- 172.21.15.151:0/1513804187 >> 172.21.15.151:0/1513804187 conn(0x556d99dbbea0 msgr2=0x556d99dc1310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.714+0000 7f0a80215b80 1 -- 172.21.15.151:0/1513804187 shutdown_connections 2023-07-21T22:18:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.714+0000 7f0a80215b80 1 -- 172.21.15.151:0/1513804187 wait complete. 2023-07-21T22:18:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.714+0000 7f0a80215b80 1 -- start start 2023-07-21T22:18:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.714+0000 7f0a80215b80 1 Processor -- start 2023-07-21T22:18:17.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc69c0 0x556d99dcfd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dd02a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a80215b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99cb7a70 con 0x556d99dc8150 2023-07-21T22:18:17.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a80215b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99cb7770 con 0x556d99dc69c0 2023-07-21T22:18:17.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a80215b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99b9b8d0 con 0x556d99dc77e0 2023-07-21T22:18:17.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a80215b80 10 client.0 _ll_register_callbacks cb 0x556d99cb5710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:17.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a6ad9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a6ad9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60520/0 (socket says 172.21.15.151:60520) 2023-07-21T22:18:17.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a6ad9c700 1 -- 172.21.15.151:0/3186450010 learned_addr learned my addr 172.21.15.151:0/3186450010 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dd02a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc69c0 0x556d99dcfd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a6ad9c700 1 -- 172.21.15.151:0/3186450010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 msgr2=0x556d99dd02a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.715+0000 7f0a6ad9c700 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dd02a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a6ad9c700 1 -- 172.21.15.151:0/3186450010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc69c0 msgr2=0x556d99dcfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a6ad9c700 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc69c0 0x556d99dcfd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a6ad9c700 1 -- 172.21.15.151:0/3186450010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a641a41c0 con 0x556d99dc8150 2023-07-21T22:18:17.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dd02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:17.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a6ad9c700 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd72e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c008c40 tx=0x7f0a5c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a2964eb9e9d013e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:18:17.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a4dffb700 1 -- 172.21.15.151:0/3186450010 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c01ad10 con 0x556d99dc8150 2023-07-21T22:18:17.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a80215b80 1 -- 172.21.15.151:0/3186450010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556d99c714a0 con 0x556d99dc8150 2023-07-21T22:18:17.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a4dffb700 1 -- 172.21.15.151:0/3186450010 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f0a5c023400 con 0x556d99dc8150 2023-07-21T22:18:17.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a4dffb700 1 -- 172.21.15.151:0/3186450010 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a5c01ae70 con 0x556d99dc8150 2023-07-21T22:18:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a80215b80 10 client.15144 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.716+0000 7f0a80215b80 1 -- 172.21.15.151:0/3186450010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x556d99b2ec10 con 0x556d99dc8150 2023-07-21T22:18:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.717+0000 7f0a4dffb700 1 -- 172.21.15.151:0/3186450010 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556d99c714a0 con 0x556d99dc8150 2023-07-21T22:18:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.717+0000 7f0a4dffb700 1 -- 172.21.15.151:0/3186450010 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0a5c0193d0 con 0x556d99dc8150 2023-07-21T22:18:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.717+0000 7f0a80215b80 10 client.15144 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.717+0000 7f0a80215b80 10 client.15144 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-21T22:18:17.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.717+0000 7f0a80215b80 20 client.15144 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.717+0000 7f0a80215b80 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556d99ddafb0 0x556d99dda3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.717+0000 7f0a80215b80 4 client.15144 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:18:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.717+0000 7f0a80215b80 1 -- 172.21.15.151:0/3186450010 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556d99d10e60 con 0x556d99ddafb0 2023-07-21T22:18:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.717+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556d99ddafb0 0x556d99dda3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.718+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556d99ddafb0 0x556d99dda3e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f25f60d4deeea6 server_cookie=b8fec4fdd875b65f in_seq=0 out_seq=0 2023-07-21T22:18:17.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.718+0000 7f0a4dffb700 10 client.15144 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:18:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a4dffb700 1 -- 172.21.15.151:0/3186450010 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556d99d10e60 con 0x556d99ddafb0 2023-07-21T22:18:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a4dffb700 10 client.15144 handle_command_reply: tid=0 2023-07-21T22:18:17.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 client.15144 shutdown 2023-07-21T22:18:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 -- 172.21.15.151:0/3186450010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 msgr2=0x556d99dd72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd72e0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c008c40 tx=0x7f0a5c004b40 comp rx=0 tx=0).stop 2023-07-21T22:18:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 -- 172.21.15.151:0/3186450010 shutdown_connections 2023-07-21T22:18:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556d99ddafb0 0x556d99dda3e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc69c0 0x556d99dcfd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd72e0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a4dffb700 0 client.15144 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:18:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 --2- 172.21.15.151:0/3186450010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc77e0 0x556d99dd02a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 -- 172.21.15.151:0/3186450010 >> 172.21.15.151:0/3186450010 conn(0x556d99dbbea0 msgr2=0x556d99dc09b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 -- 172.21.15.151:0/3186450010 shutdown_connections 2023-07-21T22:18:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.719+0000 7f0a80215b80 1 -- 172.21.15.151:0/3186450010 wait complete. 2023-07-21T22:18:17.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.720+0000 7f0a80215b80 20 client.15144 trim_cache size 0 max 16384 2023-07-21T22:18:17.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.738+0000 7f0a80215b80 1 Processor -- start 2023-07-21T22:18:17.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.738+0000 7f0a80215b80 1 -- start start 2023-07-21T22:18:17.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.738+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dcdf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.738+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 0x556d99dd7270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.738+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc8150 0x556d99dda3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.738+0000 7f0a80215b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99dc25c0 con 0x556d99dc69c0 2023-07-21T22:18:17.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.738+0000 7f0a80215b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99db9050 con 0x556d99dc77e0 2023-07-21T22:18:17.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.738+0000 7f0a80215b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99d10e90 con 0x556d99dc8150 2023-07-21T22:18:17.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6a59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dcdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6a59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dcdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60532/0 (socket says 172.21.15.151:60532) 2023-07-21T22:18:17.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6a59b700 1 -- 172.21.15.151:0/2475529610 learned_addr learned my addr 172.21.15.151:0/2475529610 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 0x556d99dd7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6ad9c700 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc8150 0x556d99dda3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6a59b700 1 -- 172.21.15.151:0/2475529610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc8150 msgr2=0x556d99dda3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc8150 0x556d99dda3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6a59b700 1 -- 172.21.15.151:0/2475529610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 msgr2=0x556d99dd7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 0x556d99dd7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6a59b700 1 -- 172.21.15.151:0/2475529610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556d99b6c200 con 0x556d99dc69c0 2023-07-21T22:18:17.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6ad9c700 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc8150 0x556d99dda3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:17.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dcdf60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0a600098c0 tx=0x7f0a60019040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=277d34907c1b249 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a597fa700 1 -- 172.21.15.151:0/2475529610 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600c9070 con 0x556d99dc69c0 2023-07-21T22:18:17.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a597fa700 1 -- 172.21.15.151:0/2475529610 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a600b7070 con 0x556d99dc69c0 2023-07-21T22:18:17.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.739+0000 7f0a597fa700 1 -- 172.21.15.151:0/2475529610 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a600b2040 con 0x556d99dc69c0 2023-07-21T22:18:17.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.740+0000 7f0a80215b80 1 -- 172.21.15.151:0/2475529610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 msgr2=0x556d99dcdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.740+0000 7f0a80215b80 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dcdf60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0a600098c0 tx=0x7f0a60019040 comp rx=0 tx=0).stop 2023-07-21T22:18:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.740+0000 7f0a80215b80 1 -- 172.21.15.151:0/2475529610 shutdown_connections 2023-07-21T22:18:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.740+0000 7f0a80215b80 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc8150 0x556d99dda3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.740+0000 7f0a80215b80 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc69c0 0x556d99dcdf60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.740+0000 7f0a80215b80 1 --2- 172.21.15.151:0/2475529610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 0x556d99dd7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.740+0000 7f0a80215b80 1 -- 172.21.15.151:0/2475529610 >> 172.21.15.151:0/2475529610 conn(0x556d99dbbea0 msgr2=0x556d99dd7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.740+0000 7f0a80215b80 1 -- 172.21.15.151:0/2475529610 shutdown_connections 2023-07-21T22:18:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.740+0000 7f0a80215b80 1 -- 172.21.15.151:0/2475529610 wait complete. 2023-07-21T22:18:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.741+0000 7f0a80215b80 1 -- start start 2023-07-21T22:18:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.741+0000 7f0a80215b80 1 Processor -- start 2023-07-21T22:18:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.741+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc69c0 0x556d99dd2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.741+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 0x556d99dd2b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.741+0000 7f0a80215b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.741+0000 7f0a80215b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99dd60f0 con 0x556d99dc8150 2023-07-21T22:18:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.741+0000 7f0a80215b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99dd6260 con 0x556d99dc77e0 2023-07-21T22:18:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.741+0000 7f0a80215b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556d99dd6420 con 0x556d99dc69c0 2023-07-21T22:18:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.741+0000 7f0a80215b80 10 client.0 _ll_register_callbacks cb 0x7f0a5c008820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a6ad9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a69d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 0x556d99dd2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a6ad9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60534/0 (socket says 172.21.15.151:60534) 2023-07-21T22:18:17.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a6ad9c700 1 -- 172.21.15.151:0/120654876 learned_addr learned my addr 172.21.15.151:0/120654876 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:17.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc69c0 0x556d99dd2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a69d9a700 1 -- 172.21.15.151:0/120654876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc69c0 msgr2=0x556d99dd2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc69c0 0x556d99dd2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a69d9a700 1 -- 172.21.15.151:0/120654876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 msgr2=0x556d99dd5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a69d9a700 1 -- 172.21.15.151:0/120654876 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556d99b45d90 con 0x556d99dc77e0 2023-07-21T22:18:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a6ad9c700 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a69d9a700 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 0x556d99dd2b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x556d99dc2dc0 tx=0x7f0a54010f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4365dbd39af0115e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.742+0000 7f0a4dffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:18:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.743+0000 7f0a4dffb700 1 -- 172.21.15.151:0/120654876 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a54021070 con 0x556d99dc77e0 2023-07-21T22:18:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.743+0000 7f0a4dffb700 1 -- 172.21.15.151:0/120654876 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f0a5400fad0 con 0x556d99dc77e0 2023-07-21T22:18:17.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.743+0000 7f0a80215b80 1 -- 172.21.15.151:0/120654876 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a600a31f0 con 0x556d99dc77e0 2023-07-21T22:18:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.743+0000 7f0a4dffb700 1 -- 172.21.15.151:0/120654876 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a5400fcd0 con 0x556d99dc77e0 2023-07-21T22:18:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.743+0000 7f0a80215b80 10 client.24959 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.743+0000 7f0a80215b80 1 -- 172.21.15.151:0/120654876 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x556d99b44260 con 0x556d99dc77e0 2023-07-21T22:18:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.744+0000 7f0a4dffb700 1 -- 172.21.15.151:0/120654876 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a600a31f0 con 0x556d99dc77e0 2023-07-21T22:18:17.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.744+0000 7f0a4dffb700 1 -- 172.21.15.151:0/120654876 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0a54003b00 con 0x556d99dc77e0 2023-07-21T22:18:17.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.744+0000 7f0a80215b80 10 client.24959 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:17.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.744+0000 7f0a80215b80 10 client.24959 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-21T22:18:17.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.744+0000 7f0a80215b80 20 client.24959 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:17.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.744+0000 7f0a80215b80 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556d99e346b0 0x556d99e31050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:17.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.744+0000 7f0a80215b80 4 client.24959 mds_command: new command op to 24599 tid=0[{"prefix": "status"}] 2023-07-21T22:18:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.744+0000 7f0a80215b80 1 -- 172.21.15.151:0/120654876 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556d99cd3000 con 0x556d99e346b0 2023-07-21T22:18:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.744+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556d99e346b0 0x556d99e31050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a6a59b700 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556d99e346b0 0x556d99e31050 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5cd0074748086d9 server_cookie=1c88e0814a7388db in_seq=0 out_seq=0 2023-07-21T22:18:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a4dffb700 10 client.24959 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:18:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a4dffb700 1 -- 172.21.15.151:0/120654876 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+332 (crc 0 0 0) 0x556d99cd3000 con 0x556d99e346b0 2023-07-21T22:18:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a4dffb700 10 client.24959 handle_command_reply: tid=0 2023-07-21T22:18:17.797 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 client.24959 shutdown 2023-07-21T22:18:17.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 -- 172.21.15.151:0/120654876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 msgr2=0x556d99dd2b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 0x556d99dd2b90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x556d99dc2dc0 tx=0x7f0a54010f40 comp rx=0 tx=0).stop 2023-07-21T22:18:17.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 -- 172.21.15.151:0/120654876 shutdown_connections 2023-07-21T22:18:17.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556d99e346b0 0x556d99e31050 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556d99dc8150 0x556d99dd5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556d99dc69c0 0x556d99dd2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 --2- 172.21.15.151:0/120654876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556d99dc77e0 0x556d99dd2b90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.798 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a4dffb700 0 client.24959 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:18:17.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 -- 172.21.15.151:0/120654876 >> 172.21.15.151:0/120654876 conn(0x556d99dbbea0 msgr2=0x556d99dd7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 -- 172.21.15.151:0/120654876 shutdown_connections 2023-07-21T22:18:17.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 1 -- 172.21.15.151:0/120654876 wait complete. 2023-07-21T22:18:17.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.745+0000 7f0a80215b80 20 client.24959 trim_cache size 0 max 16384 2023-07-21T22:18:17.799 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:18:17.800 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:18:17.800 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 0, 2023-07-21T22:18:17.800 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 24599, 2023-07-21T22:18:17.800 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-07-21T22:18:17.800 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-07-21T22:18:17.801 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-07-21T22:18:17.801 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 67.887774403999998, 2023-07-21T22:18:17.801 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 23, 2023-07-21T22:18:17.801 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 87, 2023-07-21T22:18:17.801 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 85, 2023-07-21T22:18:17.801 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 74.132211412000004 2023-07-21T22:18:17.802 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:18:17.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0a500a11e0 msgr2=0x7f0a500a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0a500a11e0 0x7f0a500a3690 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f0a5c009c70 tx=0x7f0a5c004320 comp rx=0 tx=0).stop 2023-07-21T22:18:17.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a64072f70 msgr2=0x7f0a6419be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:17.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a64072f70 0x7f0a6419be50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0a60009fd0 tx=0x7f0a6000b790 comp rx=0 tx=0).stop 2023-07-21T22:18:17.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3031863266 shutdown_connections 2023-07-21T22:18:17.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0a500a11e0 0x7f0a500a3690 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a6410c0c0 0x7f0a641a3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a64072f70 0x7f0a6419be50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 --2- 172.21.15.151:0/3031863266 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a64074550 0x7f0a6419c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3031863266 >> 172.21.15.151:0/3031863266 conn(0x7f0a640fb130 msgr2=0x7f0a640fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3031863266 shutdown_connections 2023-07-21T22:18:17.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:17.746+0000 7f0a6c7ff700 1 -- 172.21.15.151:0/3031863266 wait complete. 2023-07-21T22:18:17.810 INFO:tasks.cephadm:Setup complete, yielding 2023-07-21T22:18:17.810 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-07-21T22:18:17.822 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T22:18:17.823 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- bash -c 'ceph orch status' 2023-07-21T22:18:17.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:17 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1162568070' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:17.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:17 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:17 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:17 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:17 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:17 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:17 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:17 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1939594127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:17.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:17 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1162568070' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:17.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:17 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:17 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:17 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:17 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:17 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:17 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:17.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:17 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1939594127' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:18.543 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:18.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:18 smithi151 ceph-mon[95510]: pgmap v334: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:18.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:18:18.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:18:18.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:18 smithi151 ceph-mon[95510]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:18.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:18 smithi187 ceph-mon[96918]: pgmap v334: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:18.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:18:18.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:18:18.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:18 smithi187 ceph-mon[96918]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:18.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:18 smithi195 ceph-mon[97365]: pgmap v334: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:18.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:18:18.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:18:18.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:18 smithi195 ceph-mon[97365]: from='mgr.14152 172.21.15.151:0/130574729' entity='mgr.x' 2023-07-21T22:18:20.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.103+0000 7f9a3caaa700 1 -- 172.21.15.151:0/4009322988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381058f0 msgr2=0x7f9a38107cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.103+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/4009322988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381058f0 0x7f9a38107cd0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9a3000b0a0 tx=0x7f9a3000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.103+0000 7f9a3caaa700 1 -- 172.21.15.151:0/4009322988 shutdown_connections 2023-07-21T22:18:20.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.103+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/4009322988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381058f0 0x7f9a38107cd0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.103+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/4009322988 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a381006b0 0x7f9a38102a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.103+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/4009322988 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a38102fd0 0x7f9a381053b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.103+0000 7f9a3caaa700 1 -- 172.21.15.151:0/4009322988 >> 172.21.15.151:0/4009322988 conn(0x7f9a380fa0b0 msgr2=0x7f9a380fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:20.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.103+0000 7f9a3caaa700 1 -- 172.21.15.151:0/4009322988 shutdown_connections 2023-07-21T22:18:20.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.103+0000 7f9a3caaa700 1 -- 172.21.15.151:0/4009322988 wait complete. 2023-07-21T22:18:20.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.104+0000 7f9a3caaa700 1 Processor -- start 2023-07-21T22:18:20.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.104+0000 7f9a3caaa700 1 -- start start 2023-07-21T22:18:20.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3caaa700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381006b0 0x7f9a38197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3caaa700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a38102fd0 0x7f9a38197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3caaa700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a381058f0 0x7f9a3819f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3caaa700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3819f610 con 0x7f9a381006b0 2023-07-21T22:18:20.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3caaa700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3819f750 con 0x7f9a381058f0 2023-07-21T22:18:20.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3caaa700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a3819f8e0 con 0x7f9a38102fd0 2023-07-21T22:18:20.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381006b0 0x7f9a38197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381006b0 0x7f9a38197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60552/0 (socket says 172.21.15.151:60552) 2023-07-21T22:18:20.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3659c700 1 -- 172.21.15.151:0/468914071 learned_addr learned my addr 172.21.15.151:0/468914071 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:20.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a35d9b700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a38102fd0 0x7f9a38197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3659c700 1 -- 172.21.15.151:0/468914071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a38102fd0 msgr2=0x7f9a38197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a36d9d700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a381058f0 0x7f9a3819f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3659c700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a38102fd0 0x7f9a38197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3659c700 1 -- 172.21.15.151:0/468914071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a381058f0 msgr2=0x7f9a3819f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3659c700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a381058f0 0x7f9a3819f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a3659c700 1 -- 172.21.15.151:0/468914071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a30009d00 con 0x7f9a381006b0 2023-07-21T22:18:20.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.105+0000 7f9a36d9d700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a381058f0 0x7f9a3819f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:20.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.106+0000 7f9a3659c700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381006b0 0x7f9a38197a80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800e9d0 tx=0x7f9a2800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:20.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.106+0000 7f9a277fe700 1 -- 172.21.15.151:0/468914071 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28009790 con 0x7f9a381006b0 2023-07-21T22:18:20.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.106+0000 7f9a277fe700 1 -- 172.21.15.151:0/468914071 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9a2800cbd0 con 0x7f9a381006b0 2023-07-21T22:18:20.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.106+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a3819fbc0 con 0x7f9a381006b0 2023-07-21T22:18:20.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.106+0000 7f9a277fe700 1 -- 172.21.15.151:0/468914071 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a28018680 con 0x7f9a381006b0 2023-07-21T22:18:20.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.106+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a381a0110 con 0x7f9a381006b0 2023-07-21T22:18:20.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.107+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a38107460 con 0x7f9a381006b0 2023-07-21T22:18:20.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.109+0000 7f9a277fe700 1 -- 172.21.15.151:0/468914071 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f9a28010430 con 0x7f9a381006b0 2023-07-21T22:18:20.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.110+0000 7f9a277fe700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9a200a1260 0x7f9a200a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:20.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.110+0000 7f9a277fe700 1 -- 172.21.15.151:0/468914071 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f9a28014070 con 0x7f9a381006b0 2023-07-21T22:18:20.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.111+0000 7f9a35d9b700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9a200a1260 0x7f9a200a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:20.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.111+0000 7f9a35d9b700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9a200a1260 0x7f9a200a3710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009bf0 tx=0x7f9a2c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:20.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.114+0000 7f9a277fe700 1 -- 172.21.15.151:0/468914071 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f9a28051770 con 0x7f9a381006b0 2023-07-21T22:18:20.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.326+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a38060950 con 0x7f9a200a1260 2023-07-21T22:18:20.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.328+0000 7f9a277fe700 1 -- 172.21.15.151:0/468914071 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f9a38060950 con 0x7f9a200a1260 2023-07-21T22:18:20.372 INFO:teuthology.orchestra.run.smithi151.stdout:Backend: cephadm 2023-07-21T22:18:20.372 INFO:teuthology.orchestra.run.smithi151.stdout:Available: Yes 2023-07-21T22:18:20.372 INFO:teuthology.orchestra.run.smithi151.stdout:Paused: No 2023-07-21T22:18:20.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9a200a1260 msgr2=0x7f9a200a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9a200a1260 0x7f9a200a3710 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009bf0 tx=0x7f9a2c009260 comp rx=0 tx=0).stop 2023-07-21T22:18:20.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381006b0 msgr2=0x7f9a38197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:20.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381006b0 0x7f9a38197a80 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a2800e9d0 tx=0x7f9a2800ed90 comp rx=0 tx=0).stop 2023-07-21T22:18:20.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 shutdown_connections 2023-07-21T22:18:20.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f9a200a1260 0x7f9a200a3710 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a381058f0 0x7f9a3819f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a381006b0 0x7f9a38197a80 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 --2- 172.21.15.151:0/468914071 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9a38102fd0 0x7f9a38197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:20.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 >> 172.21.15.151:0/468914071 conn(0x7f9a380fa0b0 msgr2=0x7f9a380fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:20.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 shutdown_connections 2023-07-21T22:18:20.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:20.330+0000 7f9a3caaa700 1 -- 172.21.15.151:0/468914071 wait complete. 2023-07-21T22:18:20.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:20 smithi151 ceph-mon[95510]: pgmap v335: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T22:18:20.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:20 smithi187 ceph-mon[96918]: pgmap v335: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T22:18:20.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:20 smithi195 ceph-mon[97365]: pgmap v335: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T22:18:20.924 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- bash -c 'ceph orch ps' 2023-07-21T22:18:21.646 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:21 smithi187 ceph-mon[96918]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:21.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:21 smithi195 ceph-mon[97365]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:21.916 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:21 smithi151 ceph-mon[95510]: from='client.15156 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:22.476 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:22 smithi151 ceph-mon[95510]: pgmap v336: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-07-21T22:18:22.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:22 smithi187 ceph-mon[96918]: pgmap v336: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-07-21T22:18:22.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:22 smithi195 ceph-mon[97365]: pgmap v336: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-07-21T22:18:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.100+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/3757322912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc0ffb90 msgr2=0x7f0bbc0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.100+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/3757322912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc0ffb90 0x7f0bbc0fffa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009990 tx=0x7f0bb0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.100+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/3757322912 shutdown_connections 2023-07-21T22:18:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.100+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/3757322912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc101720 0x7f0bbc107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.100+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/3757322912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc0ffb90 0x7f0bbc0fffa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.100+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/3757322912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc100d90 0x7f0bbc1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.100+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/3757322912 >> 172.21.15.151:0/3757322912 conn(0x7f0bbc0fb1a0 msgr2=0x7f0bbc0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.100+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/3757322912 shutdown_connections 2023-07-21T22:18:23.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.100+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/3757322912 wait complete. 2023-07-21T22:18:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.101+0000 7f0bc2eb9700 1 Processor -- start 2023-07-21T22:18:23.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.101+0000 7f0bc2eb9700 1 -- start start 2023-07-21T22:18:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc2eb9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc0ffb90 0x7f0bbc197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc2eb9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc100d90 0x7f0bbc197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc2eb9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc101720 0x7f0bbc19efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc2eb9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc19f5b0 con 0x7f0bbc101720 2023-07-21T22:18:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc2eb9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc19f6f0 con 0x7f0bbc0ffb90 2023-07-21T22:18:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc2eb9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc19f880 con 0x7f0bbc100d90 2023-07-21T22:18:23.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc1456700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc101720 0x7f0bbc19efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc1456700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc101720 0x7f0bbc19efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60562/0 (socket says 172.21.15.151:60562) 2023-07-21T22:18:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc1456700 1 -- 172.21.15.151:0/431390667 learned_addr learned my addr 172.21.15.151:0/431390667 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bbbfff700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc100d90 0x7f0bbc197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc0c55700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc0ffb90 0x7f0bbc197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc1456700 1 -- 172.21.15.151:0/431390667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc100d90 msgr2=0x7f0bbc197f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc1456700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc100d90 0x7f0bbc197f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc1456700 1 -- 172.21.15.151:0/431390667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc0ffb90 msgr2=0x7f0bbc197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:23.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc1456700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc0ffb90 0x7f0bbc197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc1456700 1 -- 172.21.15.151:0/431390667 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb00095f0 con 0x7f0bbc101720 2023-07-21T22:18:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.102+0000 7f0bc0c55700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc0ffb90 0x7f0bbc197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.103+0000 7f0bc1456700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc101720 0x7f0bbc19efe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4007f10 tx=0x7f0bb400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.103+0000 7f0bb9ffb700 1 -- 172.21.15.151:0/431390667 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4017070 con 0x7f0bbc101720 2023-07-21T22:18:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.103+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc19fb60 con 0x7f0bbc101720 2023-07-21T22:18:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.103+0000 7f0bb9ffb700 1 -- 172.21.15.151:0/431390667 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bb400f040 con 0x7f0bbc101720 2023-07-21T22:18:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.103+0000 7f0bb9ffb700 1 -- 172.21.15.151:0/431390667 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4005710 con 0x7f0bbc101720 2023-07-21T22:18:23.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.103+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc1a0060 con 0x7f0bbc101720 2023-07-21T22:18:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.104+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc10b250 con 0x7f0bbc101720 2023-07-21T22:18:23.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.106+0000 7f0bb9ffb700 1 -- 172.21.15.151:0/431390667 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f0bb4004ad0 con 0x7f0bbc101720 2023-07-21T22:18:23.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.108+0000 7f0bb9ffb700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0bac0a1260 0x7f0bac0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:23.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.108+0000 7f0bb9ffb700 1 -- 172.21.15.151:0/431390667 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f0bb40cc270 con 0x7f0bbc101720 2023-07-21T22:18:23.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.108+0000 7f0bc0c55700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0bac0a1260 0x7f0bac0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:23.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.109+0000 7f0bc0c55700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0bac0a1260 0x7f0bac0a3710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000b5c0 tx=0x7f0bb0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:23.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.112+0000 7f0bb9ffb700 1 -- 172.21.15.151:0/431390667 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f0bb4095830 con 0x7f0bbc101720 2023-07-21T22:18:23.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.320+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0bbc107790 con 0x7f0bac0a1260 2023-07-21T22:18:23.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.333+0000 7f0bb9ffb700 1 -- 172.21.15.151:0/431390667 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+4185 (secure 0 0 0) 0x7f0bbc107790 con 0x7f0bac0a1260 2023-07-21T22:18:23.378 INFO:teuthology.orchestra.run.smithi151.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2023-07-21T22:18:23.378 INFO:teuthology.orchestra.run.smithi151.stdout:mds.a smithi151 running (83s) 6s ago 82s 13.7M - 18.0.0-4735-gbffe049d fa7da5dee971 35fe9da3a7e9 2023-07-21T22:18:23.378 INFO:teuthology.orchestra.run.smithi151.stdout:mds.b smithi187 running (80s) 6s ago 79s 28.7M - 18.0.0-4735-gbffe049d fa7da5dee971 407110a6c476 2023-07-21T22:18:23.379 INFO:teuthology.orchestra.run.smithi151.stdout:mds.c smithi195 running (95s) 6s ago 95s 13.7M - 18.0.0-4735-gbffe049d fa7da5dee971 9da9c6447cde 2023-07-21T22:18:23.379 INFO:teuthology.orchestra.run.smithi151.stdout:mds.d smithi151 running (105s) 6s ago 104s 13.9M - 18.0.0-4735-gbffe049d fa7da5dee971 7a10e9266d47 2023-07-21T22:18:23.379 INFO:teuthology.orchestra.run.smithi151.stdout:mds.e smithi187 running (102s) 6s ago 101s 16.8M - 18.0.0-4735-gbffe049d fa7da5dee971 7d5322728fad 2023-07-21T22:18:23.379 INFO:teuthology.orchestra.run.smithi151.stdout:mds.f smithi195 running (99s) 6s ago 98s 18.0M - 18.0.0-4735-gbffe049d fa7da5dee971 e9e035418351 2023-07-21T22:18:23.379 INFO:teuthology.orchestra.run.smithi151.stdout:mds.g smithi151 running (86s) 6s ago 86s 13.7M - 18.0.0-4735-gbffe049d fa7da5dee971 3aedef302e0f 2023-07-21T22:18:23.379 INFO:teuthology.orchestra.run.smithi151.stdout:mds.h smithi187 running (92s) 6s ago 92s 18.0M - 18.0.0-4735-gbffe049d fa7da5dee971 144911328ce9 2023-07-21T22:18:23.379 INFO:teuthology.orchestra.run.smithi151.stdout:mds.i smithi195 running (89s) 6s ago 89s 18.0M - 18.0.0-4735-gbffe049d fa7da5dee971 e748a96d6a71 2023-07-21T22:18:23.380 INFO:teuthology.orchestra.run.smithi151.stdout:mds.j smithi151 running (108s) 6s ago 107s 13.8M - 18.0.0-4735-gbffe049d fa7da5dee971 74efcb9551ec 2023-07-21T22:18:23.380 INFO:teuthology.orchestra.run.smithi151.stdout:mds.k smithi187 running (111s) 6s ago 111s 13.9M - 18.0.0-4735-gbffe049d fa7da5dee971 b3f680a2ce22 2023-07-21T22:18:23.380 INFO:teuthology.orchestra.run.smithi151.stdout:mds.l smithi195 running (114s) 6s ago 114s 16.9M - 18.0.0-4735-gbffe049d fa7da5dee971 a708213071fb 2023-07-21T22:18:23.380 INFO:teuthology.orchestra.run.smithi151.stdout:mgr.x smithi151 *:9283,8765 running (9m) 6s ago 9m 522M - 18.0.0-4735-gbffe049d fa7da5dee971 f5a370e84629 2023-07-21T22:18:23.380 INFO:teuthology.orchestra.run.smithi151.stdout:mgr.y smithi187 *:8443,8765 running (7m) 6s ago 7m 449M - 18.0.0-4735-gbffe049d fa7da5dee971 789378da972f 2023-07-21T22:18:23.380 INFO:teuthology.orchestra.run.smithi151.stdout:mgr.z smithi195 *:8443,8765 running (7m) 6s ago 7m 449M - 18.0.0-4735-gbffe049d fa7da5dee971 316b23d80b5a 2023-07-21T22:18:23.380 INFO:teuthology.orchestra.run.smithi151.stdout:mon.a smithi151 running (9m) 6s ago 9m 98.1M 2048M 18.0.0-4735-gbffe049d fa7da5dee971 52c531459f3f 2023-07-21T22:18:23.381 INFO:teuthology.orchestra.run.smithi151.stdout:mon.b smithi187 running (7m) 6s ago 7m 66.0M 2048M 18.0.0-4735-gbffe049d fa7da5dee971 9feab3c2a379 2023-07-21T22:18:23.381 INFO:teuthology.orchestra.run.smithi151.stdout:mon.c smithi195 running (7m) 6s ago 7m 64.8M 2048M 18.0.0-4735-gbffe049d fa7da5dee971 cd55c9eb1ac0 2023-07-21T22:18:23.381 INFO:teuthology.orchestra.run.smithi151.stdout:osd.0 smithi151 running (7m) 6s ago 7m 69.5M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 9e2a58cd0340 2023-07-21T22:18:23.381 INFO:teuthology.orchestra.run.smithi151.stdout:osd.1 smithi187 running (6m) 6s ago 6m 76.1M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 c3d2fdb17009 2023-07-21T22:18:23.381 INFO:teuthology.orchestra.run.smithi151.stdout:osd.2 smithi195 running (6m) 6s ago 6m 73.8M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 6a3a23ffc49a 2023-07-21T22:18:23.381 INFO:teuthology.orchestra.run.smithi151.stdout:osd.3 smithi151 running (5m) 6s ago 5m 64.2M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 7b0775c24cd7 2023-07-21T22:18:23.381 INFO:teuthology.orchestra.run.smithi151.stdout:osd.4 smithi187 running (5m) 6s ago 5m 61.3M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 2362e9a0e80e 2023-07-21T22:18:23.381 INFO:teuthology.orchestra.run.smithi151.stdout:osd.5 smithi195 running (4m) 6s ago 4m 65.4M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 81432b100476 2023-07-21T22:18:23.382 INFO:teuthology.orchestra.run.smithi151.stdout:osd.6 smithi151 running (4m) 6s ago 4m 60.3M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 277e8043e90a 2023-07-21T22:18:23.382 INFO:teuthology.orchestra.run.smithi151.stdout:osd.7 smithi187 running (4m) 6s ago 4m 63.0M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 1dcf2d4c6f55 2023-07-21T22:18:23.382 INFO:teuthology.orchestra.run.smithi151.stdout:osd.8 smithi195 running (3m) 6s ago 3m 60.7M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 5a2f1b2dc73a 2023-07-21T22:18:23.382 INFO:teuthology.orchestra.run.smithi151.stdout:osd.9 smithi151 running (3m) 6s ago 3m 55.6M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 1a3e8eeb3001 2023-07-21T22:18:23.382 INFO:teuthology.orchestra.run.smithi151.stdout:osd.10 smithi187 running (2m) 6s ago 2m 61.9M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 78526e0ee991 2023-07-21T22:18:23.382 INFO:teuthology.orchestra.run.smithi151.stdout:osd.11 smithi195 running (2m) 6s ago 2m 53.0M 4316M 18.0.0-4735-gbffe049d fa7da5dee971 dbb95478efbd 2023-07-21T22:18:23.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0bac0a1260 msgr2=0x7f0bac0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:23.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0bac0a1260 0x7f0bac0a3710 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0bb000b5c0 tx=0x7f0bb0005fb0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc101720 msgr2=0x7f0bbc19efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:23.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc101720 0x7f0bbc19efe0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4007f10 tx=0x7f0bb400d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 shutdown_connections 2023-07-21T22:18:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0bac0a1260 0x7f0bac0a3710 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc0ffb90 0x7f0bbc197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bbc101720 0x7f0bbc19efe0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 --2- 172.21.15.151:0/431390667 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bbc100d90 0x7f0bbc197f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 >> 172.21.15.151:0/431390667 conn(0x7f0bbc0fb1a0 msgr2=0x7f0bbc0fd480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 shutdown_connections 2023-07-21T22:18:23.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:23.336+0000 7f0bc2eb9700 1 -- 172.21.15.151:0/431390667 wait complete. 2023-07-21T22:18:23.820 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- bash -c 'ceph orch ls' 2023-07-21T22:18:24.543 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:24.845 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:24 smithi151 ceph-mon[95510]: pgmap v337: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T22:18:24.845 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:24 smithi151 ceph-mon[95510]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:24.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:24 smithi187 ceph-mon[96918]: pgmap v337: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T22:18:24.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:24 smithi187 ceph-mon[96918]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:24.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:24 smithi195 ceph-mon[97365]: pgmap v337: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T22:18:24.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:24 smithi195 ceph-mon[97365]: from='client.15162 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:26.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.992+0000 7fed0bf63700 1 -- 172.21.15.151:0/4132871553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed040ffb90 msgr2=0x7fed040fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:26.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.992+0000 7fed0bf63700 1 --2- 172.21.15.151:0/4132871553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed040ffb90 0x7fed040fffa0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fed00009990 tx=0x7fed00009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.992+0000 7fed0bf63700 1 -- 172.21.15.151:0/4132871553 shutdown_connections 2023-07-21T22:18:26.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.992+0000 7fed0bf63700 1 --2- 172.21.15.151:0/4132871553 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed04101720 0x7fed04107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.992+0000 7fed0bf63700 1 --2- 172.21.15.151:0/4132871553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed040ffb90 0x7fed040fffa0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.992+0000 7fed0bf63700 1 --2- 172.21.15.151:0/4132871553 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed04100d90 0x7fed041011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.992+0000 7fed0bf63700 1 -- 172.21.15.151:0/4132871553 >> 172.21.15.151:0/4132871553 conn(0x7fed040fb1a0 msgr2=0x7fed040fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:26.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.993+0000 7fed0bf63700 1 -- 172.21.15.151:0/4132871553 shutdown_connections 2023-07-21T22:18:26.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.993+0000 7fed0bf63700 1 -- 172.21.15.151:0/4132871553 wait complete. 2023-07-21T22:18:26.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed0bf63700 1 Processor -- start 2023-07-21T22:18:26.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed0bf63700 1 -- start start 2023-07-21T22:18:26.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed0bf63700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed040ffb90 0x7fed04197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:26.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed0bf63700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed04100d90 0x7fed04197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:26.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed0bf63700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed04101720 0x7fed0419efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:26.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed0bf63700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0419f5b0 con 0x7fed04100d90 2023-07-21T22:18:26.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed0bf63700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0419f6f0 con 0x7fed040ffb90 2023-07-21T22:18:26.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed0bf63700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed0419f880 con 0x7fed04101720 2023-07-21T22:18:26.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed094fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed04100d90 0x7fed04197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:26.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.994+0000 7fed09cff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed040ffb90 0x7fed04197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:26.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed094fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed04100d90 0x7fed04197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39232/0 (socket says 172.21.15.151:39232) 2023-07-21T22:18:26.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed094fe700 1 -- 172.21.15.151:0/275815023 learned_addr learned my addr 172.21.15.151:0/275815023 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:26.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed0a500700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed04101720 0x7fed0419efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:26.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed094fe700 1 -- 172.21.15.151:0/275815023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed04101720 msgr2=0x7fed0419efe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:26.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed094fe700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed04101720 0x7fed0419efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed094fe700 1 -- 172.21.15.151:0/275815023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed040ffb90 msgr2=0x7fed04197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:26.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed094fe700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed040ffb90 0x7fed04197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed094fe700 1 -- 172.21.15.151:0/275815023 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed000095f0 con 0x7fed04100d90 2023-07-21T22:18:26.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed094fe700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed04100d90 0x7fed04197f60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fecf400e9d0 tx=0x7fecf400ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:26.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fecfaffd700 1 -- 172.21.15.151:0/275815023 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4009790 con 0x7fed04100d90 2023-07-21T22:18:26.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fecfaffd700 1 -- 172.21.15.151:0/275815023 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fecf400cbd0 con 0x7fed04100d90 2023-07-21T22:18:26.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed0419fb60 con 0x7fed04100d90 2023-07-21T22:18:26.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.995+0000 7fecfaffd700 1 -- 172.21.15.151:0/275815023 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecf4018680 con 0x7fed04100d90 2023-07-21T22:18:26.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.996+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed041a0060 con 0x7fed04100d90 2023-07-21T22:18:26.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.997+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed0410b250 con 0x7fed04100d90 2023-07-21T22:18:26.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:25.999+0000 7fecfaffd700 1 -- 172.21.15.151:0/275815023 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fecf400cd40 con 0x7fed04100d90 2023-07-21T22:18:26.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.001+0000 7fecfaffd700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fecf00a11e0 0x7fecf00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:26.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.001+0000 7fecfaffd700 1 -- 172.21.15.151:0/275815023 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fecf4014070 con 0x7fed04100d90 2023-07-21T22:18:26.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.001+0000 7fed09cff700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fecf00a11e0 0x7fecf00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:26.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.002+0000 7fed09cff700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fecf00a11e0 0x7fecf00a3690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed000098e0 tx=0x7fed0000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:26.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.003+0000 7fecfaffd700 1 -- 172.21.15.151:0/275815023 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fecf4096680 con 0x7fed04100d90 2023-07-21T22:18:26.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.207+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fed041077c0 con 0x7fecf00a11e0 2023-07-21T22:18:26.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.212+0000 7fecfaffd700 1 -- 172.21.15.151:0/275815023 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+980 (secure 0 0 0) 0x7fed041077c0 con 0x7fecf00a11e0 2023-07-21T22:18:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2023-07-21T22:18:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:mds.all 12/12 9s ago 2m smithi151=a;smithi151=d;smithi151=g;smithi151=j;smithi187=b;smithi187=e;smithi187=h;smithi187=k;smithi195=c;smithi195=f;smithi195=i;smithi195=l;count:12 2023-07-21T22:18:26.257 INFO:teuthology.orchestra.run.smithi151.stdout:mgr 3/3 9s ago 7m smithi151=x;smithi187=y;smithi195=z;count:3 2023-07-21T22:18:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:mon 3/3 9s ago 8m smithi151:172.21.15.151=a;smithi187:172.21.15.187=b;smithi195:172.21.15.195=c;count:3 2023-07-21T22:18:26.258 INFO:teuthology.orchestra.run.smithi151.stdout:osd 12 9s ago - 2023-07-21T22:18:26.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fecf00a11e0 msgr2=0x7fecf00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:26.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fecf00a11e0 0x7fecf00a3690 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fed000098e0 tx=0x7fed0000b260 comp rx=0 tx=0).stop 2023-07-21T22:18:26.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed04100d90 msgr2=0x7fed04197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:26.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed04100d90 0x7fed04197f60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fecf400e9d0 tx=0x7fecf400ece0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 shutdown_connections 2023-07-21T22:18:26.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fecf00a11e0 0x7fecf00a3690 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed040ffb90 0x7fed04197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fed04101720 0x7fed0419efe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 --2- 172.21.15.151:0/275815023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed04100d90 0x7fed04197f60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:26.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 >> 172.21.15.151:0/275815023 conn(0x7fed040fb1a0 msgr2=0x7fed040fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:26.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 shutdown_connections 2023-07-21T22:18:26.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:26.215+0000 7fed0bf63700 1 -- 172.21.15.151:0/275815023 wait complete. 2023-07-21T22:18:26.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:26 smithi151 ceph-mon[95510]: pgmap v338: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T22:18:26.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- bash -c 'ceph orch host ls' 2023-07-21T22:18:26.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:26 smithi187 ceph-mon[96918]: pgmap v338: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T22:18:26.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:26 smithi195 ceph-mon[97365]: pgmap v338: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T22:18:27.444 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:27.748 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:27 smithi151 ceph-mon[95510]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:27.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:27 smithi187 ceph-mon[96918]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:27.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:27 smithi195 ceph-mon[97365]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:28.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:28 smithi151 ceph-mon[95510]: pgmap v339: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-07-21T22:18:28.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:28 smithi187 ceph-mon[96918]: pgmap v339: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-07-21T22:18:28.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:28 smithi195 ceph-mon[97365]: pgmap v339: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2023-07-21T22:18:28.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.937+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/3804246704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 msgr2=0x7fdf38109ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:28.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.937+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/3804246704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 0x7fdf38109ea0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdf3000b0a0 tx=0x7fdf3000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.937+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/3804246704 shutdown_connections 2023-07-21T22:18:28.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.937+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/3804246704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 0x7fdf38109ea0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.937+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/3804246704 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf38074540 0x7fdf380729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.937+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/3804246704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf38072f70 0x7fdf380733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.937+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/3804246704 >> 172.21.15.151:0/3804246704 conn(0x7fdf380fb1a0 msgr2=0x7fdf380fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:28.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.937+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/3804246704 shutdown_connections 2023-07-21T22:18:28.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.937+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/3804246704 wait complete. 2023-07-21T22:18:28.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.938+0000 7fdf3dbf9700 1 Processor -- start 2023-07-21T22:18:28.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.938+0000 7fdf3dbf9700 1 -- start start 2023-07-21T22:18:28.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf3dbf9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf38072f70 0x7fdf38197af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf3dbf9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf38074540 0x7fdf38198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf3dbf9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 0x7fdf3819f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf3dbf9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3819f680 con 0x7fdf38107a60 2023-07-21T22:18:28.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf3dbf9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3819f7c0 con 0x7fdf38072f70 2023-07-21T22:18:28.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf3dbf9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3819f950 con 0x7fdf38074540 2023-07-21T22:18:28.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf37fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 0x7fdf3819f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf36ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf38074540 0x7fdf38198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf37fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 0x7fdf3819f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39256/0 (socket says 172.21.15.151:39256) 2023-07-21T22:18:28.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf37fff700 1 -- 172.21.15.151:0/2520404191 learned_addr learned my addr 172.21.15.151:0/2520404191 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:28.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf377fe700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf38072f70 0x7fdf38197af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf37fff700 1 -- 172.21.15.151:0/2520404191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf38074540 msgr2=0x7fdf38198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:28.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf37fff700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf38074540 0x7fdf38198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf37fff700 1 -- 172.21.15.151:0/2520404191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf38072f70 msgr2=0x7fdf38197af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:28.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf37fff700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf38072f70 0x7fdf38197af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:28.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf37fff700 1 -- 172.21.15.151:0/2520404191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf30009d00 con 0x7fdf38107a60 2023-07-21T22:18:28.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.939+0000 7fdf377fe700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf38072f70 0x7fdf38197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:28.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.940+0000 7fdf37fff700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 0x7fdf3819f0b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdf30006070 tx=0x7fdf30004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:28.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.940+0000 7fdf34ff9700 1 -- 172.21.15.151:0/2520404191 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3000e040 con 0x7fdf38107a60 2023-07-21T22:18:28.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.940+0000 7fdf34ff9700 1 -- 172.21.15.151:0/2520404191 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf30003e90 con 0x7fdf38107a60 2023-07-21T22:18:28.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.940+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf3819fbd0 con 0x7fdf38107a60 2023-07-21T22:18:28.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.940+0000 7fdf34ff9700 1 -- 172.21.15.151:0/2520404191 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30004020 con 0x7fdf38107a60 2023-07-21T22:18:28.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.940+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf381a0090 con 0x7fdf38107a60 2023-07-21T22:18:28.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.941+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf38106110 con 0x7fdf38107a60 2023-07-21T22:18:28.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.943+0000 7fdf34ff9700 1 -- 172.21.15.151:0/2520404191 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fdf3001b660 con 0x7fdf38107a60 2023-07-21T22:18:28.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.945+0000 7fdf34ff9700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf200a1260 0x7fdf200a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:28.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.945+0000 7fdf34ff9700 1 -- 172.21.15.151:0/2520404191 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fdf300ce0e0 con 0x7fdf38107a60 2023-07-21T22:18:28.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.945+0000 7fdf377fe700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf200a1260 0x7fdf200a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:28.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.946+0000 7fdf377fe700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf200a1260 0x7fdf200a3710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdf28005fd0 tx=0x7fdf28005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:28.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:28.949+0000 7fdf34ff9700 1 -- 172.21.15.151:0/2520404191 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fdf30097730 con 0x7fdf38107a60 2023-07-21T22:18:29.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.151+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdf38060950 con 0x7fdf200a1260 2023-07-21T22:18:29.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.153+0000 7fdf34ff9700 1 -- 172.21.15.151:0/2520404191 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+191 (secure 0 0 0) 0x7fdf38060950 con 0x7fdf200a1260 2023-07-21T22:18:29.197 INFO:teuthology.orchestra.run.smithi151.stdout:HOST ADDR LABELS STATUS 2023-07-21T22:18:29.198 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151 172.21.15.151 2023-07-21T22:18:29.198 INFO:teuthology.orchestra.run.smithi151.stdout:smithi187 172.21.15.187 2023-07-21T22:18:29.198 INFO:teuthology.orchestra.run.smithi151.stdout:smithi195 172.21.15.195 2023-07-21T22:18:29.198 INFO:teuthology.orchestra.run.smithi151.stdout:3 hosts in cluster 2023-07-21T22:18:29.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.155+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf200a1260 msgr2=0x7fdf200a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:29.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.155+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf200a1260 0x7fdf200a3710 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fdf28005fd0 tx=0x7fdf28005ee0 comp rx=0 tx=0).stop 2023-07-21T22:18:29.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.155+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 msgr2=0x7fdf3819f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:29.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.155+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 0x7fdf3819f0b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fdf30006070 tx=0x7fdf30004c80 comp rx=0 tx=0).stop 2023-07-21T22:18:29.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.156+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 shutdown_connections 2023-07-21T22:18:29.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.156+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fdf200a1260 0x7fdf200a3710 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:29.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.156+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf38072f70 0x7fdf38197af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:29.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.156+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf38107a60 0x7fdf3819f0b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:29.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.156+0000 7fdf3dbf9700 1 --2- 172.21.15.151:0/2520404191 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf38074540 0x7fdf38198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:29.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.156+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 >> 172.21.15.151:0/2520404191 conn(0x7fdf380fb1a0 msgr2=0x7fdf380fd580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:29.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.156+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 shutdown_connections 2023-07-21T22:18:29.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:29.156+0000 7fdf3dbf9700 1 -- 172.21.15.151:0/2520404191 wait complete. 2023-07-21T22:18:29.473 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:29 smithi151 ceph-mon[95510]: pgmap v340: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2023-07-21T22:18:29.722 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- bash -c 'ceph orch device ls' 2023-07-21T22:18:29.785 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:29 smithi151 ceph-mon[95510]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:29.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:29 smithi187 ceph-mon[96918]: pgmap v340: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2023-07-21T22:18:29.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:29 smithi187 ceph-mon[96918]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:29.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:29 smithi195 ceph-mon[97365]: pgmap v340: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2023-07-21T22:18:29.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:29 smithi195 ceph-mon[97365]: from='client.15174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:30.453 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:31.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.909+0000 7fe782117700 1 -- 172.21.15.151:0/4265040691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c0ffb90 msgr2=0x7fe77c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:31.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.909+0000 7fe782117700 1 --2- 172.21.15.151:0/4265040691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c0ffb90 0x7fe77c0fffa0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe76c009990 tx=0x7fe76c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:31.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.909+0000 7fe782117700 1 -- 172.21.15.151:0/4265040691 shutdown_connections 2023-07-21T22:18:31.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.909+0000 7fe782117700 1 --2- 172.21.15.151:0/4265040691 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c101720 0x7fe77c107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:31.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.909+0000 7fe782117700 1 --2- 172.21.15.151:0/4265040691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c0ffb90 0x7fe77c0fffa0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:31.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.909+0000 7fe782117700 1 --2- 172.21.15.151:0/4265040691 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe77c100d90 0x7fe77c1011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:31.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.909+0000 7fe782117700 1 -- 172.21.15.151:0/4265040691 >> 172.21.15.151:0/4265040691 conn(0x7fe77c0fb1a0 msgr2=0x7fe77c0fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:31.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.910+0000 7fe782117700 1 -- 172.21.15.151:0/4265040691 shutdown_connections 2023-07-21T22:18:31.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.910+0000 7fe782117700 1 -- 172.21.15.151:0/4265040691 wait complete. 2023-07-21T22:18:31.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.911+0000 7fe782117700 1 Processor -- start 2023-07-21T22:18:31.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.911+0000 7fe782117700 1 -- start start 2023-07-21T22:18:31.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe782117700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0ffb90 0x7fe77c0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:31.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe782117700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe77c100d90 0x7fe77c072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:31.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe782117700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c101720 0x7fe77c072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:31.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe782117700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c0735c0 con 0x7fe77c101720 2023-07-21T22:18:31.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe782117700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c073730 con 0x7fe77c100d90 2023-07-21T22:18:31.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe782117700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c19f830 con 0x7fe77c0ffb90 2023-07-21T22:18:31.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c101720 0x7fe77c072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:31.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c101720 0x7fe77c072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39274/0 (socket says 172.21.15.151:39274) 2023-07-21T22:18:31.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77bfff700 1 -- 172.21.15.151:0/496425612 learned_addr learned my addr 172.21.15.151:0/496425612 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:31.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77b7fe700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0ffb90 0x7fe77c0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:31.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77affd700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe77c100d90 0x7fe77c072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:31.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77bfff700 1 -- 172.21.15.151:0/496425612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0ffb90 msgr2=0x7fe77c0742b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:31.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77bfff700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0ffb90 0x7fe77c0742b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:31.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77bfff700 1 -- 172.21.15.151:0/496425612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe77c100d90 msgr2=0x7fe77c072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:31.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77bfff700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe77c100d90 0x7fe77c072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:31.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.912+0000 7fe77bfff700 1 -- 172.21.15.151:0/496425612 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c0095f0 con 0x7fe77c101720 2023-07-21T22:18:31.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.913+0000 7fe77bfff700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c101720 0x7fe77c072e40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe774007d70 tx=0x7fe77400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:31.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.913+0000 7fe778ff9700 1 -- 172.21.15.151:0/496425612 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77400ad40 con 0x7fe77c101720 2023-07-21T22:18:31.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.913+0000 7fe778ff9700 1 -- 172.21.15.151:0/496425612 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7740128b0 con 0x7fe77c101720 2023-07-21T22:18:31.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.913+0000 7fe778ff9700 1 -- 172.21.15.151:0/496425612 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7740115a0 con 0x7fe77c101720 2023-07-21T22:18:31.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.913+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c19fb10 con 0x7fe77c101720 2023-07-21T22:18:31.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.913+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c19ffc0 con 0x7fe77c101720 2023-07-21T22:18:31.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.914+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c1071d0 con 0x7fe77c101720 2023-07-21T22:18:31.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.916+0000 7fe778ff9700 1 -- 172.21.15.151:0/496425612 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fe774012a20 con 0x7fe77c101720 2023-07-21T22:18:31.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.917+0000 7fe778ff9700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe7640a1260 0x7fe7640a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:31.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.918+0000 7fe778ff9700 1 -- 172.21.15.151:0/496425612 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fe7740ccbc0 con 0x7fe77c101720 2023-07-21T22:18:31.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.918+0000 7fe77b7fe700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe7640a1260 0x7fe7640a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:31.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.918+0000 7fe77b7fe700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe7640a1260 0x7fe7640a3710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe76c000c00 tx=0x7fe76c00b560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:31.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:31.921+0000 7fe778ff9700 1 -- 172.21.15.151:0/496425612 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fe774096290 con 0x7fe77c101720 2023-07-21T22:18:32.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.126+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe77c060950 con 0x7fe7640a1260 2023-07-21T22:18:32.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.127+0000 7fe778ff9700 1 -- 172.21.15.151:0/496425612 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+492 (secure 0 0 0) 0x7fe77c060950 con 0x7fe7640a1260 2023-07-21T22:18:32.172 INFO:teuthology.orchestra.run.smithi151.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2023-07-21T22:18:32.172 INFO:teuthology.orchestra.run.smithi151.stdout:smithi151 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JJ400BGN 372G No 3m ago LVM detected, locked 2023-07-21T22:18:32.172 INFO:teuthology.orchestra.run.smithi151.stdout:smithi187 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500MW400BGN 372G No 2m ago LVM detected, locked 2023-07-21T22:18:32.173 INFO:teuthology.orchestra.run.smithi151.stdout:smithi195 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB751300FS480DGN 447G No 2m ago LVM detected, locked 2023-07-21T22:18:32.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe7640a1260 msgr2=0x7fe7640a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:32.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe7640a1260 0x7fe7640a3710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe76c000c00 tx=0x7fe76c00b560 comp rx=0 tx=0).stop 2023-07-21T22:18:32.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c101720 msgr2=0x7fe77c072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:32.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c101720 0x7fe77c072e40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe774007d70 tx=0x7fe77400a340 comp rx=0 tx=0).stop 2023-07-21T22:18:32.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 shutdown_connections 2023-07-21T22:18:32.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe7640a1260 0x7fe7640a3710 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:32.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe77c101720 0x7fe77c072e40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:32.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe77c0ffb90 0x7fe77c0742b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:32.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 --2- 172.21.15.151:0/496425612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe77c100d90 0x7fe77c072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:32.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 >> 172.21.15.151:0/496425612 conn(0x7fe77c0fb1a0 msgr2=0x7fe77c104310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:32.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 shutdown_connections 2023-07-21T22:18:32.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:32.130+0000 7fe782117700 1 -- 172.21.15.151:0/496425612 wait complete. 2023-07-21T22:18:32.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:32 smithi151 ceph-mon[95510]: pgmap v341: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-07-21T22:18:32.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:32 smithi187 ceph-mon[96918]: pgmap v341: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-07-21T22:18:32.632 INFO:teuthology.run_tasks:Running task cephadm.shell... 2023-07-21T22:18:32.641 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T22:18:32.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- bash -c 'ceph fs dump' 2023-07-21T22:18:32.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:32 smithi195 ceph-mon[97365]: pgmap v341: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 5 op/s 2023-07-21T22:18:33.371 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:33.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:33 smithi187 ceph-mon[96918]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:33.643 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:33 smithi151 ceph-mon[95510]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:33.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:33 smithi195 ceph-mon[97365]: from='client.15180 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:18:34.333 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:34 smithi151 ceph-mon[95510]: pgmap v342: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T22:18:34.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:34 smithi187 ceph-mon[96918]: pgmap v342: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T22:18:34.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:34 smithi195 ceph-mon[97365]: pgmap v342: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T22:18:34.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.943+0000 7f7995d7f700 1 -- 172.21.15.151:0/598438055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7990100d90 msgr2=0x7f79901011e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:34.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.943+0000 7f7995d7f700 1 --2- 172.21.15.151:0/598438055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7990100d90 0x7f79901011e0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f7984009990 tx=0x7f7984009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.943+0000 7f7995d7f700 1 -- 172.21.15.151:0/598438055 shutdown_connections 2023-07-21T22:18:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.943+0000 7f7995d7f700 1 --2- 172.21.15.151:0/598438055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79900ffb90 0x7f79900fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.943+0000 7f7995d7f700 1 --2- 172.21.15.151:0/598438055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7990101720 0x7f7990107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.943+0000 7f7995d7f700 1 --2- 172.21.15.151:0/598438055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7990100d90 0x7f79901011e0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.943+0000 7f7995d7f700 1 -- 172.21.15.151:0/598438055 >> 172.21.15.151:0/598438055 conn(0x7f79900fb1a0 msgr2=0x7f79900fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:34.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.943+0000 7f7995d7f700 1 -- 172.21.15.151:0/598438055 shutdown_connections 2023-07-21T22:18:34.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.943+0000 7f7995d7f700 1 -- 172.21.15.151:0/598438055 wait complete. 2023-07-21T22:18:34.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.944+0000 7f7995d7f700 1 Processor -- start 2023-07-21T22:18:34.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.944+0000 7f7995d7f700 1 -- start start 2023-07-21T22:18:34.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.944+0000 7f7995d7f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79900ffb90 0x7f7990195850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:34.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.944+0000 7f7995d7f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7990100d90 0x7f7990195d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.944+0000 7f7995d7f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7990101720 0x7f799019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.944+0000 7f7995d7f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799019d3e0 con 0x7f7990101720 2023-07-21T22:18:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.944+0000 7f7995d7f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799019d520 con 0x7f79900ffb90 2023-07-21T22:18:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.944+0000 7f7995d7f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799019d6b0 con 0x7f7990100d90 2023-07-21T22:18:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79900ffb90 0x7f7990195850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:34.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7990101720 0x7f799019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79900ffb90 0x7f7990195850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:56018/0 (socket says 172.21.15.151:56018) 2023-07-21T22:18:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798f7fe700 1 -- 172.21.15.151:0/715441099 learned_addr learned my addr 172.21.15.151:0/715441099 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798effd700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7990100d90 0x7f7990195d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798ffff700 1 -- 172.21.15.151:0/715441099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7990100d90 msgr2=0x7f7990195d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798ffff700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7990100d90 0x7f7990195d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798ffff700 1 -- 172.21.15.151:0/715441099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79900ffb90 msgr2=0x7f7990195850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:34.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798ffff700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79900ffb90 0x7f7990195850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798ffff700 1 -- 172.21.15.151:0/715441099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79840095f0 con 0x7f7990101720 2023-07-21T22:18:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.945+0000 7f798ffff700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7990101720 0x7f799019ce10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f798800be50 tx=0x7f7988009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.946+0000 7f798cff9700 1 -- 172.21.15.151:0/715441099 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f798800cb90 con 0x7f7990101720 2023-07-21T22:18:34.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.946+0000 7f798cff9700 1 -- 172.21.15.151:0/715441099 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f798800ccf0 con 0x7f7990101720 2023-07-21T22:18:34.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.946+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799019d990 con 0x7f7990101720 2023-07-21T22:18:34.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.946+0000 7f798cff9700 1 -- 172.21.15.151:0/715441099 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79880125a0 con 0x7f7990101720 2023-07-21T22:18:34.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.946+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799019df60 con 0x7f7990101720 2023-07-21T22:18:34.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.947+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7990106b20 con 0x7f7990101720 2023-07-21T22:18:34.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.949+0000 7f798cff9700 1 -- 172.21.15.151:0/715441099 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f7988014440 con 0x7f7990101720 2023-07-21T22:18:34.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.950+0000 7f798cff9700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f79780a1260 0x7f79780a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:34.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.950+0000 7f798cff9700 1 -- 172.21.15.151:0/715441099 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f7988006e40 con 0x7f7990101720 2023-07-21T22:18:34.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.950+0000 7f798f7fe700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f79780a1260 0x7f79780a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:34.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.951+0000 7f798f7fe700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f79780a1260 0x7f79780a3710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f798000bd70 tx=0x7f798000b4a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:34.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:34.954+0000 7f798cff9700 1 -- 172.21.15.151:0/715441099 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f7988095950 con 0x7f7990101720 2023-07-21T22:18:35.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.191+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f799002c850 con 0x7f7990101720 2023-07-21T22:18:35.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.191+0000 7f798cff9700 1 -- 172.21.15.151:0/715441099 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+2905 (secure 0 0 0) 0x7f7988019b70 con 0x7f7990101720 2023-07-21T22:18:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:e23 2023-07-21T22:18:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:enable_multiple, ever_enabled_multiple: 1,1 2023-07-21T22:18:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-21T22:18:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:legacy client fscid: 1 2023-07-21T22:18:35.238 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:Filesystem 'cephfs' (1) 2023-07-21T22:18:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:fs_name cephfs 2023-07-21T22:18:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:epoch 23 2023-07-21T22:18:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2023-07-21T22:18:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:created 2023-07-21T22:17:09.358855+0000 2023-07-21T22:18:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:modified 2023-07-21T22:17:15.194775+0000 2023-07-21T22:18:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:tableserver 0 2023-07-21T22:18:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:root 0 2023-07-21T22:18:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:session_timeout 300 2023-07-21T22:18:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:session_autoclose 300 2023-07-21T22:18:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:max_file_size 1099511627776 2023-07-21T22:18:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:max_xattr_size 65536 2023-07-21T22:18:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:required_client_features {} 2023-07-21T22:18:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:last_failure 0 2023-07-21T22:18:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:last_failure_osd_epoch 0 2023-07-21T22:18:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2023-07-21T22:18:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:max_mds 3 2023-07-21T22:18:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:in 0,1,2 2023-07-21T22:18:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:up {0=24599,1=24574,2=24548} 2023-07-21T22:18:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:failed 2023-07-21T22:18:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:damaged 2023-07-21T22:18:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:stopped 2023-07-21T22:18:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:data_pools [3] 2023-07-21T22:18:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:metadata_pool 2 2023-07-21T22:18:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:inline_data disabled 2023-07-21T22:18:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:balancer 2023-07-21T22:18:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:bal_rank_mask -1 2023-07-21T22:18:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:standby_count_wanted 0 2023-07-21T22:18:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b{0:24599} state up:active seq 3 addr [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.f{0:24538} state up:standby-replay seq 1 addr [v2:172.21.15.195:6834/3818436709,v1:172.21.15.195:6835/3818436709] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.i{1:24574} state up:active seq 6 addr [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.e{1:24512} state up:standby-replay seq 1 addr [v2:172.21.15.187:6834/3281429688,v1:172.21.15.187:6835/3281429688] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.h{2:24548} state up:active seq 7 addr [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.l{2:24475} state up:standby-replay seq 1 addr [v2:172.21.15.195:6832/2796106198,v1:172.21.15.195:6833/2796106198] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.243 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:35.243 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:Standby daemons: 2023-07-21T22:18:35.243 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.j{-1:14589} state up:standby seq 1 addr [v2:172.21.15.151:6834/2869868293,v1:172.21.15.151:6835/2869868293] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d{-1:14601} state up:standby seq 1 addr [v2:172.21.15.151:6836/1023251552,v1:172.21.15.151:6837/1023251552] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c{-1:14640} state up:standby seq 1 addr [v2:172.21.15.195:6836/87317468,v1:172.21.15.195:6837/87317468] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.g{-1:14676} state up:standby seq 1 addr [v2:172.21.15.151:6838/721992458,v1:172.21.15.151:6839/721992458] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a{-1:14694} state up:standby seq 1 addr [v2:172.21.15.151:6840/337440051,v1:172.21.15.151:6841/337440051] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.k{-1:24470} state up:standby seq 1 addr [v2:172.21.15.187:6832/3442978615,v1:172.21.15.187:6833/3442978615] compat {c=[1],r=[1],i=[7ff]}] 2023-07-21T22:18:35.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.193+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f79780a1260 msgr2=0x7f79780a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:35.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.193+0000 7f7995d7f700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f79780a1260 0x7f79780a3710 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f798000bd70 tx=0x7f798000b4a0 comp rx=0 tx=0).stop 2023-07-21T22:18:35.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.193+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7990101720 msgr2=0x7f799019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:35.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.193+0000 7f7995d7f700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7990101720 0x7f799019ce10 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f798800be50 tx=0x7f7988009ed0 comp rx=0 tx=0).stop 2023-07-21T22:18:35.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.194+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 shutdown_connections 2023-07-21T22:18:35.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.194+0000 7f7995d7f700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f79780a1260 0x7f79780a3710 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:35.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.194+0000 7f7995d7f700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79900ffb90 0x7f7990195850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:35.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.194+0000 7f7995d7f700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7990101720 0x7f799019ce10 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:35.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.194+0000 7f7995d7f700 1 --2- 172.21.15.151:0/715441099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7990100d90 0x7f7990195d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:35.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.194+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 >> 172.21.15.151:0/715441099 conn(0x7f79900fb1a0 msgr2=0x7f79900fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:35.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.194+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 shutdown_connections 2023-07-21T22:18:35.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:35.194+0000 7f7995d7f700 1 -- 172.21.15.151:0/715441099 wait complete. 2023-07-21T22:18:35.247 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 23 2023-07-21T22:18:35.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:35 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/715441099' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-07-21T22:18:35.654 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:35 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/715441099' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-07-21T22:18:35.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:35 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/715441099' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2023-07-21T22:18:35.746 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- bash -c 'ceph osd dump' 2023-07-21T22:18:36.478 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:36.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:36 smithi187 ceph-mon[96918]: pgmap v343: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T22:18:36.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:36 smithi195 ceph-mon[97365]: pgmap v343: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T22:18:36.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:36 smithi151 ceph-mon[95510]: pgmap v343: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T22:18:38.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.984+0000 7f98ec4a9700 1 -- 172.21.15.151:0/2164667919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e4101720 msgr2=0x7f98e4107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.984+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/2164667919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e4101720 0x7f98e4107fe0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f98dc00b0a0 tx=0x7f98dc00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.984+0000 7f98ec4a9700 1 -- 172.21.15.151:0/2164667919 shutdown_connections 2023-07-21T22:18:38.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.985+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/2164667919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e40ffb90 0x7f98e40fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.985+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/2164667919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e4101720 0x7f98e4107fe0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.985+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/2164667919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e4100d90 0x7f98e41011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.985+0000 7f98ec4a9700 1 -- 172.21.15.151:0/2164667919 >> 172.21.15.151:0/2164667919 conn(0x7f98e40fb1a0 msgr2=0x7f98e40fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:38.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.985+0000 7f98ec4a9700 1 -- 172.21.15.151:0/2164667919 shutdown_connections 2023-07-21T22:18:38.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.985+0000 7f98ec4a9700 1 -- 172.21.15.151:0/2164667919 wait complete. 2023-07-21T22:18:38.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ec4a9700 1 Processor -- start 2023-07-21T22:18:38.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ec4a9700 1 -- start start 2023-07-21T22:18:38.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ec4a9700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e40ffb90 0x7f98e40742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ec4a9700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e4100d90 0x7f98e4072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ec4a9700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e4101720 0x7f98e4072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ec4a9700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e40735c0 con 0x7f98e40ffb90 2023-07-21T22:18:38.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ec4a9700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e4073730 con 0x7f98e4101720 2023-07-21T22:18:38.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ec4a9700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e419f910 con 0x7f98e4100d90 2023-07-21T22:18:38.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ea245700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e40ffb90 0x7f98e40742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ea245700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e40ffb90 0x7f98e40742b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37378/0 (socket says 172.21.15.151:37378) 2023-07-21T22:18:38.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.986+0000 7f98ea245700 1 -- 172.21.15.151:0/3849808805 learned_addr learned my addr 172.21.15.151:0/3849808805 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:38.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98e9a44700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e4100d90 0x7f98e4072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98eaa46700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e4101720 0x7f98e4072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98ea245700 1 -- 172.21.15.151:0/3849808805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e4100d90 msgr2=0x7f98e4072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98ea245700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e4100d90 0x7f98e4072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98ea245700 1 -- 172.21.15.151:0/3849808805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e4101720 msgr2=0x7f98e4072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98ea245700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e4101720 0x7f98e4072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98ea245700 1 -- 172.21.15.151:0/3849808805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc009d00 con 0x7f98e40ffb90 2023-07-21T22:18:38.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98eaa46700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e4101720 0x7f98e4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:38.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98ea245700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e40ffb90 0x7f98e40742b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f98e000d980 tx=0x7f98e000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98db7fe700 1 -- 172.21.15.151:0/3849808805 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0004020 con 0x7f98e40ffb90 2023-07-21T22:18:38.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98db7fe700 1 -- 172.21.15.151:0/3849808805 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98e0009730 con 0x7f98e40ffb90 2023-07-21T22:18:38.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e419fbf0 con 0x7f98e40ffb90 2023-07-21T22:18:38.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.987+0000 7f98db7fe700 1 -- 172.21.15.151:0/3849808805 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98e0003a00 con 0x7f98e40ffb90 2023-07-21T22:18:38.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.988+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e41a0140 con 0x7f98e40ffb90 2023-07-21T22:18:38.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.989+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e4107190 con 0x7f98e40ffb90 2023-07-21T22:18:38.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.990+0000 7f98db7fe700 1 -- 172.21.15.151:0/3849808805 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f98e00098a0 con 0x7f98e40ffb90 2023-07-21T22:18:38.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.992+0000 7f98db7fe700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f98d00a1260 0x7f98d00a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.992+0000 7f98db7fe700 1 -- 172.21.15.151:0/3849808805 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f98e00cc740 con 0x7f98e40ffb90 2023-07-21T22:18:38.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.992+0000 7f98e9a44700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f98d00a1260 0x7f98d00a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.993+0000 7f98e9a44700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f98d00a1260 0x7f98d00a3710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009c60 tx=0x7f98d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:37.996+0000 7f98db7fe700 1 -- 172.21.15.151:0/3849808805 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f98e0095d00 con 0x7f98e40ffb90 2023-07-21T22:18:38.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.195+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump"} v 0) v1 -- 0x7f98e402c850 con 0x7f98e40ffb90 2023-07-21T22:18:38.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.196+0000 7f98db7fe700 1 -- 172.21.15.151:0/3849808805 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v87) v1 ==== 56+0+5284 (secure 0 0 0) 0x7f98e00232f0 con 0x7f98e40ffb90 2023-07-21T22:18:38.240 INFO:teuthology.orchestra.run.smithi151.stdout:epoch 87 2023-07-21T22:18:38.241 INFO:teuthology.orchestra.run.smithi151.stdout:fsid f5fce3a4-2812-11ee-9b34-001a4aab830c 2023-07-21T22:18:38.241 INFO:teuthology.orchestra.run.smithi151.stdout:created 2023-07-21T22:08:36.779776+0000 2023-07-21T22:18:38.241 INFO:teuthology.orchestra.run.smithi151.stdout:modified 2023-07-21T22:17:44.291528+0000 2023-07-21T22:18:38.241 INFO:teuthology.orchestra.run.smithi151.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-07-21T22:18:38.241 INFO:teuthology.orchestra.run.smithi151.stdout:crush_version 26 2023-07-21T22:18:38.241 INFO:teuthology.orchestra.run.smithi151.stdout:full_ratio 0.95 2023-07-21T22:18:38.242 INFO:teuthology.orchestra.run.smithi151.stdout:backfillfull_ratio 0.9 2023-07-21T22:18:38.242 INFO:teuthology.orchestra.run.smithi151.stdout:nearfull_ratio 0.85 2023-07-21T22:18:38.242 INFO:teuthology.orchestra.run.smithi151.stdout:require_min_compat_client luminous 2023-07-21T22:18:38.242 INFO:teuthology.orchestra.run.smithi151.stdout:min_compat_client luminous 2023-07-21T22:18:38.242 INFO:teuthology.orchestra.run.smithi151.stdout:require_osd_release reef 2023-07-21T22:18:38.242 INFO:teuthology.orchestra.run.smithi151.stdout:stretch_mode_enabled false 2023-07-21T22:18:38.243 INFO:teuthology.orchestra.run.smithi151.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2023-07-21T22:18:38.243 INFO:teuthology.orchestra.run.smithi151.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 84 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2023-07-21T22:18:38.243 INFO:teuthology.orchestra.run.smithi151.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 85 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2023-07-21T22:18:38.243 INFO:teuthology.orchestra.run.smithi151.stdout:max_osd 12 2023-07-21T22:18:38.243 INFO:teuthology.orchestra.run.smithi151.stdout:osd.0 up in weight 1 up_from 8 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6802/1215940854,v1:172.21.15.151:6803/1215940854] [v2:172.21.15.151:6804/1215940854,v1:172.21.15.151:6805/1215940854] exists,up e903ed24-3bea-4007-9763-2fa25fdf3098 2023-07-21T22:18:38.243 INFO:teuthology.orchestra.run.smithi151.stdout:osd.1 up in weight 1 up_from 13 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6800/2089567930,v1:172.21.15.187:6801/2089567930] [v2:172.21.15.187:6802/2089567930,v1:172.21.15.187:6803/2089567930] exists,up 96879cff-72f6-4852-91cb-51fedc6c24ee 2023-07-21T22:18:38.243 INFO:teuthology.orchestra.run.smithi151.stdout:osd.2 up in weight 1 up_from 18 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6800/3736985408,v1:172.21.15.195:6801/3736985408] [v2:172.21.15.195:6802/3736985408,v1:172.21.15.195:6803/3736985408] exists,up 2a953e7b-0858-4387-9d3d-ad2693e940f2 2023-07-21T22:18:38.244 INFO:teuthology.orchestra.run.smithi151.stdout:osd.3 up in weight 1 up_from 25 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6810/446322037,v1:172.21.15.151:6811/446322037] [v2:172.21.15.151:6812/446322037,v1:172.21.15.151:6813/446322037] exists,up 69ea6be1-ee4c-4392-a1ea-f33959280632 2023-07-21T22:18:38.244 INFO:teuthology.orchestra.run.smithi151.stdout:osd.4 up in weight 1 up_from 33 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6808/357741250,v1:172.21.15.187:6809/357741250] [v2:172.21.15.187:6810/357741250,v1:172.21.15.187:6811/357741250] exists,up 9fb10c73-994e-456d-8b9d-6f73960469df 2023-07-21T22:18:38.244 INFO:teuthology.orchestra.run.smithi151.stdout:osd.5 up in weight 1 up_from 38 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6808/2892220444,v1:172.21.15.195:6809/2892220444] [v2:172.21.15.195:6810/2892220444,v1:172.21.15.195:6811/2892220444] exists,up 8bc15555-8fb3-4caa-bea9-15460b5d34a5 2023-07-21T22:18:38.244 INFO:teuthology.orchestra.run.smithi151.stdout:osd.6 up in weight 1 up_from 46 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6818/3406076685,v1:172.21.15.151:6819/3406076685] [v2:172.21.15.151:6820/3406076685,v1:172.21.15.151:6821/3406076685] exists,up eb0278c9-dae9-453f-83a9-6102b326604e 2023-07-21T22:18:38.244 INFO:teuthology.orchestra.run.smithi151.stdout:osd.7 up in weight 1 up_from 51 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6816/963467354,v1:172.21.15.187:6817/963467354] [v2:172.21.15.187:6818/963467354,v1:172.21.15.187:6819/963467354] exists,up 16610547-d8ff-4d2a-b8f6-514f0374c058 2023-07-21T22:18:38.244 INFO:teuthology.orchestra.run.smithi151.stdout:osd.8 up in weight 1 up_from 59 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6816/1226094225,v1:172.21.15.195:6817/1226094225] [v2:172.21.15.195:6818/1226094225,v1:172.21.15.195:6819/1226094225] exists,up 16e29935-729c-4d6d-b86b-82a69248c80c 2023-07-21T22:18:38.244 INFO:teuthology.orchestra.run.smithi151.stdout:osd.9 up in weight 1 up_from 67 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6826/2119659233,v1:172.21.15.151:6827/2119659233] [v2:172.21.15.151:6828/2119659233,v1:172.21.15.151:6829/2119659233] exists,up 0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57 2023-07-21T22:18:38.245 INFO:teuthology.orchestra.run.smithi151.stdout:osd.10 up in weight 1 up_from 72 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.187:6824/1369649564,v1:172.21.15.187:6825/1369649564] [v2:172.21.15.187:6826/1369649564,v1:172.21.15.187:6827/1369649564] exists,up 2408af95-5fda-41f2-8251-f56ed4efde80 2023-07-21T22:18:38.245 INFO:teuthology.orchestra.run.smithi151.stdout:osd.11 up in weight 1 up_from 80 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.195:6824/2228826039,v1:172.21.15.195:6825/2228826039] [v2:172.21.15.195:6826/2228826039,v1:172.21.15.195:6827/2228826039] exists,up 4071400e-d6ce-4ed6-8dc3-7c5e94774861 2023-07-21T22:18:38.245 INFO:teuthology.orchestra.run.smithi151.stdout:pg_upmap_items 2.a [2,11] 2023-07-21T22:18:38.245 INFO:teuthology.orchestra.run.smithi151.stdout:pg_upmap_items 2.b [2,1,8,11] 2023-07-21T22:18:38.245 INFO:teuthology.orchestra.run.smithi151.stdout:pg_upmap_items 2.1a [8,4] 2023-07-21T22:18:38.245 INFO:teuthology.orchestra.run.smithi151.stdout:pg_upmap_items 3.e [5,9] 2023-07-21T22:18:38.245 INFO:teuthology.orchestra.run.smithi151.stdout:pg_upmap_items 3.21 [4,8] 2023-07-21T22:18:38.246 INFO:teuthology.orchestra.run.smithi151.stdout:pg_upmap_items 3.24 [4,9] 2023-07-21T22:18:38.246 INFO:teuthology.orchestra.run.smithi151.stdout:pg_upmap_items 3.3c [4,9] 2023-07-21T22:18:38.246 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:0/2580982703 expires 2023-07-22T22:09:42.752515+0000 2023-07-21T22:18:38.246 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:6801/191414094 expires 2023-07-22T22:09:42.752515+0000 2023-07-21T22:18:38.246 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:6800/191414094 expires 2023-07-22T22:09:42.752515+0000 2023-07-21T22:18:38.246 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:0/1795404200 expires 2023-07-22T22:09:42.752515+0000 2023-07-21T22:18:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:0/3453762997 expires 2023-07-22T22:09:15.556837+0000 2023-07-21T22:18:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:6800/4032529407 expires 2023-07-22T22:09:15.556837+0000 2023-07-21T22:18:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:0/3481435706 expires 2023-07-22T22:09:15.556837+0000 2023-07-21T22:18:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:0/311680782 expires 2023-07-22T22:09:42.752515+0000 2023-07-21T22:18:38.247 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:0/372172769 expires 2023-07-22T22:09:15.556837+0000 2023-07-21T22:18:38.248 INFO:teuthology.orchestra.run.smithi151.stdout:blocklist 172.21.15.151:6801/4032529407 expires 2023-07-22T22:09:15.556837+0000 2023-07-21T22:18:38.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.198+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f98d00a1260 msgr2=0x7f98d00a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.198+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f98d00a1260 0x7f98d00a3710 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f98d4009c60 tx=0x7f98d4009260 comp rx=0 tx=0).stop 2023-07-21T22:18:38.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.198+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e40ffb90 msgr2=0x7f98e40742b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.198+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e40ffb90 0x7f98e40742b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f98e000d980 tx=0x7f98e000dc90 comp rx=0 tx=0).stop 2023-07-21T22:18:38.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.199+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 shutdown_connections 2023-07-21T22:18:38.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.199+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f98d00a1260 0x7f98d00a3710 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.199+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98e4101720 0x7f98e4072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.199+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98e40ffb90 0x7f98e40742b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.199+0000 7f98ec4a9700 1 --2- 172.21.15.151:0/3849808805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98e4100d90 0x7f98e4072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.199+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 >> 172.21.15.151:0/3849808805 conn(0x7f98e40fb1a0 msgr2=0x7f98e41042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:38.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.199+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 shutdown_connections 2023-07-21T22:18:38.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.199+0000 7f98ec4a9700 1 -- 172.21.15.151:0/3849808805 wait complete. 2023-07-21T22:18:38.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:38 smithi187 ceph-mon[96918]: pgmap v344: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:38.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:38 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3849808805' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-07-21T22:18:38.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:38 smithi195 ceph-mon[97365]: pgmap v344: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:38.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:38 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3849808805' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-07-21T22:18:38.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:38 smithi151 ceph-mon[95510]: pgmap v344: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:38.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:38 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3849808805' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2023-07-21T22:18:38.760 INFO:teuthology.run_tasks:Running task fs.ready... 2023-07-21T22:18:38.773 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:38.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.935+0000 7f56cf3ff700 1 -- 172.21.15.151:0/4120352163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8100c70 msgr2=0x7f56c81010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.935+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/4120352163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8100c70 0x7f56c81010c0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f56b8009990 tx=0x7f56b8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.935+0000 7f56cf3ff700 1 -- 172.21.15.151:0/4120352163 shutdown_connections 2023-07-21T22:18:38.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.935+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/4120352163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c8101600 0x7f56c8107ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.935+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/4120352163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c80ffa80 0x7f56c80ffe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.935+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/4120352163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8100c70 0x7f56c81010c0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.935+0000 7f56cf3ff700 1 -- 172.21.15.151:0/4120352163 >> 172.21.15.151:0/4120352163 conn(0x7f56c80fb080 msgr2=0x7f56c80fd4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:38.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.935+0000 7f56cf3ff700 1 -- 172.21.15.151:0/4120352163 shutdown_connections 2023-07-21T22:18:38.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.935+0000 7f56cf3ff700 1 -- 172.21.15.151:0/4120352163 wait complete. 2023-07-21T22:18:38.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.936+0000 7f56cf3ff700 1 Processor -- start 2023-07-21T22:18:38.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.936+0000 7f56cf3ff700 1 -- start start 2023-07-21T22:18:38.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.936+0000 7f56cf3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c80ffa80 0x7f56c81978b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.936+0000 7f56cf3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c8100c70 0x7f56c8197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.936+0000 7f56cf3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8101600 0x7f56c819ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.936+0000 7f56cf3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c819f430 con 0x7f56c8101600 2023-07-21T22:18:38.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.936+0000 7f56cf3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c819f570 con 0x7f56c80ffa80 2023-07-21T22:18:38.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.936+0000 7f56cf3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c819f700 con 0x7f56c8100c70 2023-07-21T22:18:38.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8101600 0x7f56c819ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8101600 0x7f56c819ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37400/0 (socket says 172.21.15.151:37400) 2023-07-21T22:18:38.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cc99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c8100c70 0x7f56c8197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd99c700 1 -- 172.21.15.151:0/1269016628 learned_addr learned my addr 172.21.15.151:0/1269016628 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd19b700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c80ffa80 0x7f56c81978b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd99c700 1 -- 172.21.15.151:0/1269016628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c8100c70 msgr2=0x7f56c8197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd99c700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c8100c70 0x7f56c8197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd99c700 1 -- 172.21.15.151:0/1269016628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c80ffa80 msgr2=0x7f56c81978b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd99c700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c80ffa80 0x7f56c81978b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:38.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd99c700 1 -- 172.21.15.151:0/1269016628 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b80095f0 con 0x7f56c8101600 2023-07-21T22:18:38.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56cd99c700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8101600 0x7f56c819ee60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f56c0007ee0 tx=0x7f56c000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.937+0000 7f56be7fc700 1 -- 172.21.15.151:0/1269016628 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0017070 con 0x7f56c8101600 2023-07-21T22:18:38.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.938+0000 7f56be7fc700 1 -- 172.21.15.151:0/1269016628 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f56c000f040 con 0x7f56c8101600 2023-07-21T22:18:38.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.938+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c819f9e0 con 0x7f56c8101600 2023-07-21T22:18:38.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.938+0000 7f56be7fc700 1 -- 172.21.15.151:0/1269016628 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56c0005710 con 0x7f56c8101600 2023-07-21T22:18:38.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.938+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c819ff40 con 0x7f56c8101600 2023-07-21T22:18:38.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.939+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c8192010 con 0x7f56c8101600 2023-07-21T22:18:38.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.941+0000 7f56be7fc700 1 -- 172.21.15.151:0/1269016628 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f56c0005870 con 0x7f56c8101600 2023-07-21T22:18:38.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.942+0000 7f56be7fc700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f56b40a12a0 0x7f56b40a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:38.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.942+0000 7f56be7fc700 1 -- 172.21.15.151:0/1269016628 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f56c00cc820 con 0x7f56c8101600 2023-07-21T22:18:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.942+0000 7f56cd19b700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f56b40a12a0 0x7f56b40a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.943+0000 7f56cd19b700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f56b40a12a0 0x7f56b40a3750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f56c4005950 tx=0x7f56c40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:38.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:38.944+0000 7f56be7fc700 1 -- 172.21.15.151:0/1269016628 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f56c0095de0 con 0x7f56c8101600 2023-07-21T22:18:39.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.149+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56c802ca20 con 0x7f56c8101600 2023-07-21T22:18:39.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.151+0000 7f56be7fc700 1 -- 172.21.15.151:0/1269016628 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7f56c0099400 con 0x7f56c8101600 2023-07-21T22:18:39.196 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:39.196 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:39.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f56b40a12a0 msgr2=0x7f56b40a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f56b40a12a0 0x7f56b40a3750 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f56c4005950 tx=0x7f56c40058e0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8101600 msgr2=0x7f56c819ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8101600 0x7f56c819ee60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f56c0007ee0 tx=0x7f56c000d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 shutdown_connections 2023-07-21T22:18:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f56b40a12a0 0x7f56b40a3750 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c80ffa80 0x7f56c81978b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56c8101600 0x7f56c819ee60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 --2- 172.21.15.151:0/1269016628 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f56c8100c70 0x7f56c8197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.153+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 >> 172.21.15.151:0/1269016628 conn(0x7f56c80fb080 msgr2=0x7f56c8106560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.154+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 shutdown_connections 2023-07-21T22:18:39.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.154+0000 7f56cf3ff700 1 -- 172.21.15.151:0/1269016628 wait complete. 2023-07-21T22:18:39.218 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:18:39.220 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:18:39.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.378+0000 7fd7199ff700 1 -- 172.21.15.151:0/2360496300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd714100ce0 msgr2=0x7fd714101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.378+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2360496300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd714100ce0 0x7fd714101130 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fd708009990 tx=0x7fd708009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.378+0000 7fd7199ff700 1 -- 172.21.15.151:0/2360496300 shutdown_connections 2023-07-21T22:18:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.378+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2360496300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd714101670 0x7fd714107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.378+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2360496300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7140ffaf0 0x7fd7140fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.378+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2360496300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd714100ce0 0x7fd714101130 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.378+0000 7fd7199ff700 1 -- 172.21.15.151:0/2360496300 >> 172.21.15.151:0/2360496300 conn(0x7fd7140fb130 msgr2=0x7fd7140fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.378+0000 7fd7199ff700 1 -- 172.21.15.151:0/2360496300 shutdown_connections 2023-07-21T22:18:39.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.378+0000 7fd7199ff700 1 -- 172.21.15.151:0/2360496300 wait complete. 2023-07-21T22:18:39.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.379+0000 7fd7199ff700 1 Processor -- start 2023-07-21T22:18:39.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.379+0000 7fd7199ff700 1 -- start start 2023-07-21T22:18:39.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7199ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7140ffaf0 0x7fd7141979a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7199ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd714100ce0 0x7fd714197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7199ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd714101670 0x7fd71419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7199ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71419f520 con 0x7fd7140ffaf0 2023-07-21T22:18:39.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7199ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71419f660 con 0x7fd714100ce0 2023-07-21T22:18:39.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7199ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71419f7f0 con 0x7fd714101670 2023-07-21T22:18:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7140ffaf0 0x7fd7141979a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd712ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7140ffaf0 0x7fd7141979a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37428/0 (socket says 172.21.15.151:37428) 2023-07-21T22:18:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd712ffd700 1 -- 172.21.15.151:0/2126063073 learned_addr learned my addr 172.21.15.151:0/2126063073 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7127fc700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd714100ce0 0x7fd714197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd712ffd700 1 -- 172.21.15.151:0/2126063073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd714101670 msgr2=0x7fd71419ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7137fe700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd714101670 0x7fd71419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd712ffd700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd714101670 0x7fd71419ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd712ffd700 1 -- 172.21.15.151:0/2126063073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd714100ce0 msgr2=0x7fd714197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd712ffd700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd714100ce0 0x7fd714197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd712ffd700 1 -- 172.21.15.151:0/2126063073 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7080095f0 con 0x7fd7140ffaf0 2023-07-21T22:18:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7127fc700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd714100ce0 0x7fd714197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd7137fe700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd714101670 0x7fd71419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.380+0000 7fd712ffd700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7140ffaf0 0x7fd7141979a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd70400e970 tx=0x7fd70400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.381+0000 7fd7189fd700 1 -- 172.21.15.151:0/2126063073 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704009790 con 0x7fd7140ffaf0 2023-07-21T22:18:39.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.381+0000 7fd7189fd700 1 -- 172.21.15.151:0/2126063073 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7040044b0 con 0x7fd7140ffaf0 2023-07-21T22:18:39.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.381+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71419fad0 con 0x7fd7140ffaf0 2023-07-21T22:18:39.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.381+0000 7fd7189fd700 1 -- 172.21.15.151:0/2126063073 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd704003dd0 con 0x7fd7140ffaf0 2023-07-21T22:18:39.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.381+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7141a0030 con 0x7fd7140ffaf0 2023-07-21T22:18:39.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.382+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7141920b0 con 0x7fd7140ffaf0 2023-07-21T22:18:39.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.384+0000 7fd7189fd700 1 -- 172.21.15.151:0/2126063073 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fd704004000 con 0x7fd7140ffaf0 2023-07-21T22:18:39.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.385+0000 7fd7189fd700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1260 0x7fd6fc0a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.385+0000 7fd7189fd700 1 -- 172.21.15.151:0/2126063073 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fd704014070 con 0x7fd7140ffaf0 2023-07-21T22:18:39.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.385+0000 7fd7127fc700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1260 0x7fd6fc0a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.386+0000 7fd7127fc700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1260 0x7fd6fc0a3710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098e0 tx=0x7fd708005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.389+0000 7fd7189fd700 1 -- 172.21.15.151:0/2126063073 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd704096370 con 0x7fd7140ffaf0 2023-07-21T22:18:39.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:39 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1269016628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:39.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.588+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd71402cac0 con 0x7fd7140ffaf0 2023-07-21T22:18:39.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.588+0000 7fd7189fd700 1 -- 172.21.15.151:0/2126063073 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd704099990 con 0x7fd7140ffaf0 2023-07-21T22:18:39.633 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:18:39.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.590+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1260 msgr2=0x7fd6fc0a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.590+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1260 0x7fd6fc0a3710 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd7080098e0 tx=0x7fd708005fb0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.590+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7140ffaf0 msgr2=0x7fd7141979a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.590+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7140ffaf0 0x7fd7141979a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd70400e970 tx=0x7fd70400ed30 comp rx=0 tx=0).stop 2023-07-21T22:18:39.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.591+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 shutdown_connections 2023-07-21T22:18:39.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.591+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1260 0x7fd6fc0a3710 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.591+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd714101670 0x7fd71419ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.591+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7140ffaf0 0x7fd7141979a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.591+0000 7fd7199ff700 1 --2- 172.21.15.151:0/2126063073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd714100ce0 0x7fd714197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.591+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 >> 172.21.15.151:0/2126063073 conn(0x7fd7140fb130 msgr2=0x7fd714106630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.591+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 shutdown_connections 2023-07-21T22:18:39.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.591+0000 7fd7199ff700 1 -- 172.21.15.151:0/2126063073 wait complete. 2023-07-21T22:18:39.651 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:39 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1269016628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:39.654 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:18:39.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:39 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1269016628' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:39.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.811+0000 7fc0583ff700 1 -- 172.21.15.151:0/2994999504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0500ffaf0 msgr2=0x7fc0500fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.811+0000 7fc0583ff700 1 --2- 172.21.15.151:0/2994999504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0500ffaf0 0x7fc0500fff00 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fc04c009990 tx=0x7fc04c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.811+0000 7fc0583ff700 1 -- 172.21.15.151:0/2994999504 shutdown_connections 2023-07-21T22:18:39.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.811+0000 7fc0583ff700 1 --2- 172.21.15.151:0/2994999504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0500ffaf0 0x7fc0500fff00 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.811+0000 7fc0583ff700 1 --2- 172.21.15.151:0/2994999504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc050101670 0x7fc050107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.811+0000 7fc0583ff700 1 --2- 172.21.15.151:0/2994999504 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc050100ce0 0x7fc050101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.811+0000 7fc0583ff700 1 -- 172.21.15.151:0/2994999504 >> 172.21.15.151:0/2994999504 conn(0x7fc0500fb130 msgr2=0x7fc0500fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:39.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.811+0000 7fc0583ff700 1 -- 172.21.15.151:0/2994999504 shutdown_connections 2023-07-21T22:18:39.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.811+0000 7fc0583ff700 1 -- 172.21.15.151:0/2994999504 wait complete. 2023-07-21T22:18:39.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.813+0000 7fc0583ff700 1 Processor -- start 2023-07-21T22:18:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.813+0000 7fc0583ff700 1 -- start start 2023-07-21T22:18:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.813+0000 7fc0583ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0500ffaf0 0x7fc0501957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.813+0000 7fc0583ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc050100ce0 0x7fc050195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc0583ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc050101670 0x7fc05019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc0583ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05019d360 con 0x7fc050101670 2023-07-21T22:18:39.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc0583ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05019d4a0 con 0x7fc050100ce0 2023-07-21T22:18:39.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc0583ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05019d630 con 0x7fc0500ffaf0 2023-07-21T22:18:39.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc050101670 0x7fc05019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc050101670 0x7fc05019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37450/0 (socket says 172.21.15.151:37450) 2023-07-21T22:18:39.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05699c700 1 -- 172.21.15.151:0/3269730823 learned_addr learned my addr 172.21.15.151:0/3269730823 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:39.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05599a700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc050100ce0 0x7fc050195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05619b700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0500ffaf0 0x7fc0501957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05699c700 1 -- 172.21.15.151:0/3269730823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0500ffaf0 msgr2=0x7fc0501957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05699c700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0500ffaf0 0x7fc0501957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05699c700 1 -- 172.21.15.151:0/3269730823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc050100ce0 msgr2=0x7fc050195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:39.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05699c700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc050100ce0 0x7fc050195d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:39.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05699c700 1 -- 172.21.15.151:0/3269730823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc040009520 con 0x7fc050101670 2023-07-21T22:18:39.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05599a700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc050100ce0 0x7fc050195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:39.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.814+0000 7fc05699c700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc050101670 0x7fc05019cd90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc04800ef30 tx=0x7fc04800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.815+0000 7fc0477fe700 1 -- 172.21.15.151:0/3269730823 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc048018070 con 0x7fc050101670 2023-07-21T22:18:39.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.815+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc04c0095f0 con 0x7fc050101670 2023-07-21T22:18:39.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.815+0000 7fc0477fe700 1 -- 172.21.15.151:0/3269730823 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc04800f040 con 0x7fc050101670 2023-07-21T22:18:39.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.815+0000 7fc0477fe700 1 -- 172.21.15.151:0/3269730823 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04800cc70 con 0x7fc050101670 2023-07-21T22:18:39.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.815+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05019dc30 con 0x7fc050101670 2023-07-21T22:18:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.816+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc05010b1c0 con 0x7fc050101670 2023-07-21T22:18:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.818+0000 7fc0477fe700 1 -- 172.21.15.151:0/3269730823 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7fc048007500 con 0x7fc050101670 2023-07-21T22:18:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.819+0000 7fc0477fe700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc03c0a11e0 0x7fc03c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:39.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.819+0000 7fc0477fe700 1 -- 172.21.15.151:0/3269730823 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fc0480cc630 con 0x7fc050101670 2023-07-21T22:18:39.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.819+0000 7fc05619b700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc03c0a11e0 0x7fc03c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:39.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.820+0000 7fc05619b700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc03c0a11e0 0x7fc03c0a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc04c005910 tx=0x7fc04c00b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:39.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:39.823+0000 7fc0477fe700 1 -- 172.21.15.151:0/3269730823 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fc048095c80 con 0x7fc050101670 2023-07-21T22:18:40.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.022+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc050106ad0 con 0x7fc050101670 2023-07-21T22:18:40.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.022+0000 7fc0477fe700 1 -- 172.21.15.151:0/3269730823 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc0480992a0 con 0x7fc050101670 2023-07-21T22:18:40.067 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T22:18:40.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc03c0a11e0 msgr2=0x7fc03c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc03c0a11e0 0x7fc03c0a3690 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc04c005910 tx=0x7fc04c00b260 comp rx=0 tx=0).stop 2023-07-21T22:18:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc050101670 msgr2=0x7fc05019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc050101670 0x7fc05019cd90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fc04800ef30 tx=0x7fc04800c3a0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 shutdown_connections 2023-07-21T22:18:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fc03c0a11e0 0x7fc03c0a3690 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc050101670 0x7fc05019cd90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0500ffaf0 0x7fc0501957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 --2- 172.21.15.151:0/3269730823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc050100ce0 0x7fc050195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 >> 172.21.15.151:0/3269730823 conn(0x7fc0500fb130 msgr2=0x7fc0500fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 shutdown_connections 2023-07-21T22:18:40.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.025+0000 7fc0583ff700 1 -- 172.21.15.151:0/3269730823 wait complete. 2023-07-21T22:18:40.089 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:18:40.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.246+0000 7f7a979ff700 1 -- 172.21.15.151:0/1668664616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 msgr2=0x7f7a900ffef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.246+0000 7f7a979ff700 1 --2- 172.21.15.151:0/1668664616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 0x7f7a900ffef0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c009990 tx=0x7f7a8c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.247+0000 7f7a979ff700 1 -- 172.21.15.151:0/1668664616 shutdown_connections 2023-07-21T22:18:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.247+0000 7f7a979ff700 1 --2- 172.21.15.151:0/1668664616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a90101660 0x7f7a90107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.247+0000 7f7a979ff700 1 --2- 172.21.15.151:0/1668664616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 0x7f7a900ffef0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.247+0000 7f7a979ff700 1 --2- 172.21.15.151:0/1668664616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a90100cd0 0x7f7a90101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.247+0000 7f7a979ff700 1 -- 172.21.15.151:0/1668664616 >> 172.21.15.151:0/1668664616 conn(0x7f7a900fb0e0 msgr2=0x7f7a900fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.247+0000 7f7a979ff700 1 -- 172.21.15.151:0/1668664616 shutdown_connections 2023-07-21T22:18:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.247+0000 7f7a979ff700 1 -- 172.21.15.151:0/1668664616 wait complete. 2023-07-21T22:18:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a979ff700 1 Processor -- start 2023-07-21T22:18:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a979ff700 1 -- start start 2023-07-21T22:18:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a979ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 0x7f7a900742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a979ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a90100cd0 0x7f7a90072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a979ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a90101660 0x7f7a90072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a979ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a900735e0 con 0x7f7a900ffae0 2023-07-21T22:18:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a979ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a90073750 con 0x7f7a90101660 2023-07-21T22:18:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a979ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a9019f7b0 con 0x7f7a90100cd0 2023-07-21T22:18:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a9579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 0x7f7a900742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a9579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 0x7f7a900742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37466/0 (socket says 172.21.15.151:37466) 2023-07-21T22:18:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.248+0000 7f7a9579b700 1 -- 172.21.15.151:0/3261800335 learned_addr learned my addr 172.21.15.151:0/3261800335 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a95f9c700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a90101660 0x7f7a90072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a94f9a700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a90100cd0 0x7f7a90072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a9579b700 1 -- 172.21.15.151:0/3261800335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a90100cd0 msgr2=0x7f7a90072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a9579b700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a90100cd0 0x7f7a90072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a9579b700 1 -- 172.21.15.151:0/3261800335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a90101660 msgr2=0x7f7a90072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a9579b700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a90101660 0x7f7a90072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a9579b700 1 -- 172.21.15.151:0/3261800335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c0095f0 con 0x7f7a900ffae0 2023-07-21T22:18:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a9579b700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 0x7f7a900742c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c003a20 tx=0x7f7a8c003a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a867fc700 1 -- 172.21.15.151:0/3261800335 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c01d070 con 0x7f7a900ffae0 2023-07-21T22:18:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a9019fa30 con 0x7f7a900ffae0 2023-07-21T22:18:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a867fc700 1 -- 172.21.15.151:0/3261800335 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7a8c00f460 con 0x7f7a900ffae0 2023-07-21T22:18:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.249+0000 7f7a867fc700 1 -- 172.21.15.151:0/3261800335 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8c021670 con 0x7f7a900ffae0 2023-07-21T22:18:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.250+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a9019fe60 con 0x7f7a900ffae0 2023-07-21T22:18:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.250+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a90106ac0 con 0x7f7a900ffae0 2023-07-21T22:18:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.252+0000 7f7a867fc700 1 -- 172.21.15.151:0/3261800335 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f7a8c00f5d0 con 0x7f7a900ffae0 2023-07-21T22:18:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.254+0000 7f7a867fc700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a7c0a11e0 0x7f7a7c0a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.255+0000 7f7a867fc700 1 -- 172.21.15.151:0/3261800335 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f7a8c0cdf40 con 0x7f7a900ffae0 2023-07-21T22:18:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.255+0000 7f7a94f9a700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a7c0a11e0 0x7f7a7c0a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.255+0000 7f7a94f9a700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a7c0a11e0 0x7f7a7c0a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009bf0 tx=0x7f7a80009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.258+0000 7f7a867fc700 1 -- 172.21.15.151:0/3261800335 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f7a8c09b020 con 0x7f7a900ffae0 2023-07-21T22:18:40.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:40 smithi151 ceph-mon[95510]: pgmap v345: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-21T22:18:40.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:40 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2126063073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:40.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:40 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3269730823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.458+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7a9002caa0 con 0x7f7a900ffae0 2023-07-21T22:18:40.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.459+0000 7f7a867fc700 1 -- 172.21.15.151:0/3261800335 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7a8c095e60 con 0x7f7a900ffae0 2023-07-21T22:18:40.503 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T22:18:40.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.461+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a7c0a11e0 msgr2=0x7f7a7c0a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.461+0000 7f7a979ff700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a7c0a11e0 0x7f7a7c0a3690 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f7a80009bf0 tx=0x7f7a80009260 comp rx=0 tx=0).stop 2023-07-21T22:18:40.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.461+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 msgr2=0x7f7a900742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.461+0000 7f7a979ff700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 0x7f7a900742c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f7a8c003a20 tx=0x7f7a8c003a50 comp rx=0 tx=0).stop 2023-07-21T22:18:40.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.462+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 shutdown_connections 2023-07-21T22:18:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.462+0000 7f7a979ff700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7a7c0a11e0 0x7f7a7c0a3690 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.462+0000 7f7a979ff700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a90101660 0x7f7a90072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.462+0000 7f7a979ff700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a900ffae0 0x7f7a900742c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.462+0000 7f7a979ff700 1 --2- 172.21.15.151:0/3261800335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7a90100cd0 0x7f7a90072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.462+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 >> 172.21.15.151:0/3261800335 conn(0x7f7a900fb0e0 msgr2=0x7f7a900fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.462+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 shutdown_connections 2023-07-21T22:18:40.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.462+0000 7f7a979ff700 1 -- 172.21.15.151:0/3261800335 wait complete. 2023-07-21T22:18:40.525 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:18:40.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:40 smithi187 ceph-mon[96918]: pgmap v345: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-21T22:18:40.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:40 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2126063073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:40.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:40 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3269730823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:40.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:40 smithi195 ceph-mon[97365]: pgmap v345: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-21T22:18:40.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:40 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2126063073' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:40.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:40 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3269730823' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:40.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.679+0000 7f2645bff700 1 -- 172.21.15.151:0/3878985903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 msgr2=0x7f26400fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.679+0000 7f2645bff700 1 --2- 172.21.15.151:0/3878985903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 0x7f26400fff10 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f2630009990 tx=0x7f2630009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.679+0000 7f2645bff700 1 -- 172.21.15.151:0/3878985903 shutdown_connections 2023-07-21T22:18:40.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.679+0000 7f2645bff700 1 --2- 172.21.15.151:0/3878985903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2640101680 0x7f2640107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.679+0000 7f2645bff700 1 --2- 172.21.15.151:0/3878985903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 0x7f26400fff10 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.679+0000 7f2645bff700 1 --2- 172.21.15.151:0/3878985903 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2640100cf0 0x7f2640101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.679+0000 7f2645bff700 1 -- 172.21.15.151:0/3878985903 >> 172.21.15.151:0/3878985903 conn(0x7f26400fb0e0 msgr2=0x7f26400fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.679+0000 7f2645bff700 1 -- 172.21.15.151:0/3878985903 shutdown_connections 2023-07-21T22:18:40.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.679+0000 7f2645bff700 1 -- 172.21.15.151:0/3878985903 wait complete. 2023-07-21T22:18:40.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.680+0000 7f2645bff700 1 Processor -- start 2023-07-21T22:18:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.680+0000 7f2645bff700 1 -- start start 2023-07-21T22:18:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f2645bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 0x7f26401979b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f2645bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2640100cf0 0x7f2640197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f2645bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2640101680 0x7f264019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f2645bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264019f530 con 0x7f26400ffb00 2023-07-21T22:18:40.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f2645bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264019f670 con 0x7f2640100cf0 2023-07-21T22:18:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f2645bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264019f800 con 0x7f2640101680 2023-07-21T22:18:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 0x7f26401979b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 0x7f26401979b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37486/0 (socket says 172.21.15.151:37486) 2023-07-21T22:18:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263f7fe700 1 -- 172.21.15.151:0/2381241029 learned_addr learned my addr 172.21.15.151:0/2381241029 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263ffff700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2640101680 0x7f264019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263effd700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2640100cf0 0x7f2640197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263f7fe700 1 -- 172.21.15.151:0/2381241029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2640101680 msgr2=0x7f264019ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263f7fe700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2640101680 0x7f264019ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263f7fe700 1 -- 172.21.15.151:0/2381241029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2640100cf0 msgr2=0x7f2640197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263f7fe700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2640100cf0 0x7f2640197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263f7fe700 1 -- 172.21.15.151:0/2381241029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26300095f0 con 0x7f26400ffb00 2023-07-21T22:18:40.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263ffff700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2640101680 0x7f264019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:40.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.681+0000 7f263effd700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2640100cf0 0x7f2640197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:40.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.682+0000 7f263f7fe700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 0x7f26401979b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f263000b5c0 tx=0x7f26300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.682+0000 7f263cff9700 1 -- 172.21.15.151:0/2381241029 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f263001d070 con 0x7f26400ffb00 2023-07-21T22:18:40.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.682+0000 7f263cff9700 1 -- 172.21.15.151:0/2381241029 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2630003f40 con 0x7f26400ffb00 2023-07-21T22:18:40.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.682+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264019fa80 con 0x7f26400ffb00 2023-07-21T22:18:40.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.682+0000 7f263cff9700 1 -- 172.21.15.151:0/2381241029 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2630022c50 con 0x7f26400ffb00 2023-07-21T22:18:40.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.682+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264019ff00 con 0x7f26400ffb00 2023-07-21T22:18:40.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.683+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2640192090 con 0x7f26400ffb00 2023-07-21T22:18:40.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.685+0000 7f263cff9700 1 -- 172.21.15.151:0/2381241029 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f2630003ab0 con 0x7f26400ffb00 2023-07-21T22:18:40.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.686+0000 7f263cff9700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f26280a12a0 0x7f26280a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:40.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.687+0000 7f263cff9700 1 -- 172.21.15.151:0/2381241029 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f26300ce070 con 0x7f26400ffb00 2023-07-21T22:18:40.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.687+0000 7f263effd700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f26280a12a0 0x7f26280a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:40.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.687+0000 7f263effd700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f26280a12a0 0x7f26280a3750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2634005950 tx=0x7f26340058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:40.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.690+0000 7f263cff9700 1 -- 172.21.15.151:0/2381241029 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2630097720 con 0x7f26400ffb00 2023-07-21T22:18:40.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.934+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f264002c850 con 0x7f26400ffb00 2023-07-21T22:18:40.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.935+0000 7f263cff9700 1 -- 172.21.15.151:0/2381241029 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f263009ad40 con 0x7f26400ffb00 2023-07-21T22:18:40.980 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:40.980 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:17:15.194775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:18:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.937+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f26280a12a0 msgr2=0x7f26280a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.937+0000 7f2645bff700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f26280a12a0 0x7f26280a3750 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2634005950 tx=0x7f26340058e0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.937+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 msgr2=0x7f26401979b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.937+0000 7f2645bff700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 0x7f26401979b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f263000b5c0 tx=0x7f26300057f0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.938+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 shutdown_connections 2023-07-21T22:18:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.938+0000 7f2645bff700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f26280a12a0 0x7f26280a3750 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.938+0000 7f2645bff700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2640101680 0x7f264019ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.938+0000 7f2645bff700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26400ffb00 0x7f26401979b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.938+0000 7f2645bff700 1 --2- 172.21.15.151:0/2381241029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2640100cf0 0x7f2640197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.938+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 >> 172.21.15.151:0/2381241029 conn(0x7f26400fb0e0 msgr2=0x7f2640106610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.938+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 shutdown_connections 2023-07-21T22:18:40.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:40.938+0000 7f2645bff700 1 -- 172.21.15.151:0/2381241029 wait complete. 2023-07-21T22:18:40.984 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 23 2023-07-21T22:18:41.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:41.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.155+0000 7efd271ff700 1 -- 172.21.15.151:0/3290885656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd200ffb00 msgr2=0x7efd200fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.155+0000 7efd271ff700 1 --2- 172.21.15.151:0/3290885656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd200ffb00 0x7efd200fff10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7efd14009990 tx=0x7efd14009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.156+0000 7efd271ff700 1 -- 172.21.15.151:0/3290885656 shutdown_connections 2023-07-21T22:18:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.156+0000 7efd271ff700 1 --2- 172.21.15.151:0/3290885656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd20101680 0x7efd20107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.156+0000 7efd271ff700 1 --2- 172.21.15.151:0/3290885656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd200ffb00 0x7efd200fff10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.156+0000 7efd271ff700 1 --2- 172.21.15.151:0/3290885656 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd20100cf0 0x7efd20101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.156+0000 7efd271ff700 1 -- 172.21.15.151:0/3290885656 >> 172.21.15.151:0/3290885656 conn(0x7efd200fb0e0 msgr2=0x7efd200fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.156+0000 7efd271ff700 1 -- 172.21.15.151:0/3290885656 shutdown_connections 2023-07-21T22:18:41.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.156+0000 7efd271ff700 1 -- 172.21.15.151:0/3290885656 wait complete. 2023-07-21T22:18:41.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.157+0000 7efd271ff700 1 Processor -- start 2023-07-21T22:18:41.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.157+0000 7efd271ff700 1 -- start start 2023-07-21T22:18:41.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd271ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd200ffb00 0x7efd200742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd271ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd20100cf0 0x7efd20072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd271ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20101680 0x7efd20072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd271ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd200735e0 con 0x7efd20101680 2023-07-21T22:18:41.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd271ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd20073750 con 0x7efd200ffb00 2023-07-21T22:18:41.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd271ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd2019f850 con 0x7efd20100cf0 2023-07-21T22:18:41.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd2579c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20101680 0x7efd20072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd2579c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20101680 0x7efd20072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37504/0 (socket says 172.21.15.151:37504) 2023-07-21T22:18:41.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd2579c700 1 -- 172.21.15.151:0/2122041418 learned_addr learned my addr 172.21.15.151:0/2122041418 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:41.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd24f9b700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd200ffb00 0x7efd200742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd1ffff700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd20100cf0 0x7efd20072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd2579c700 1 -- 172.21.15.151:0/2122041418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd20100cf0 msgr2=0x7efd20072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.158+0000 7efd2579c700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd20100cf0 0x7efd20072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.159+0000 7efd2579c700 1 -- 172.21.15.151:0/2122041418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd200ffb00 msgr2=0x7efd200742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.159+0000 7efd2579c700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd200ffb00 0x7efd200742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.159+0000 7efd2579c700 1 -- 172.21.15.151:0/2122041418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd140095f0 con 0x7efd20101680 2023-07-21T22:18:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.159+0000 7efd2579c700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20101680 0x7efd20072e40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efd18007ee0 tx=0x7efd1800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.159+0000 7efd1dffb700 1 -- 172.21.15.151:0/2122041418 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd18017070 con 0x7efd20101680 2023-07-21T22:18:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.159+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd2019fb30 con 0x7efd20101680 2023-07-21T22:18:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.159+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd201a0090 con 0x7efd20101680 2023-07-21T22:18:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.159+0000 7efd1dffb700 1 -- 172.21.15.151:0/2122041418 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd1800f040 con 0x7efd20101680 2023-07-21T22:18:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.159+0000 7efd1dffb700 1 -- 172.21.15.151:0/2122041418 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd180054b0 con 0x7efd20101680 2023-07-21T22:18:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.160+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd2010b1d0 con 0x7efd20101680 2023-07-21T22:18:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.162+0000 7efd1dffb700 1 -- 172.21.15.151:0/2122041418 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7efd1800db20 con 0x7efd20101680 2023-07-21T22:18:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.163+0000 7efd1dffb700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7efd100a12a0 0x7efd100a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.164+0000 7efd1dffb700 1 -- 172.21.15.151:0/2122041418 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7efd180cc060 con 0x7efd20101680 2023-07-21T22:18:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.164+0000 7efd24f9b700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7efd100a12a0 0x7efd100a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.164+0000 7efd24f9b700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7efd100a12a0 0x7efd100a3750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efd1400c010 tx=0x7efd14005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:41.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.167+0000 7efd1dffb700 1 -- 172.21.15.151:0/2122041418 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7efd180fe770 con 0x7efd20101680 2023-07-21T22:18:41.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.373+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efd2010b3c0 con 0x7efd20101680 2023-07-21T22:18:41.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.375+0000 7efd1dffb700 1 -- 172.21.15.151:0/2122041418 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7efd18095620 con 0x7efd20101680 2023-07-21T22:18:41.420 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:41.420 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:41.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7efd100a12a0 msgr2=0x7efd100a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7efd100a12a0 0x7efd100a3750 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7efd1400c010 tx=0x7efd14005fd0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20101680 msgr2=0x7efd20072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20101680 0x7efd20072e40 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7efd18007ee0 tx=0x7efd1800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 shutdown_connections 2023-07-21T22:18:41.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7efd100a12a0 0x7efd100a3750 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd200ffb00 0x7efd200742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd20101680 0x7efd20072e40 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 --2- 172.21.15.151:0/2122041418 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd20100cf0 0x7efd20072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.377+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 >> 172.21.15.151:0/2122041418 conn(0x7efd200fb0e0 msgr2=0x7efd200fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:41.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.378+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 shutdown_connections 2023-07-21T22:18:41.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.378+0000 7efd271ff700 1 -- 172.21.15.151:0/2122041418 wait complete. 2023-07-21T22:18:41.441 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:18:41.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:18:41.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:41 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3261800335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:41.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:41 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2381241029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:41.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.601+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/4159318325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 msgr2=0x7f4e74101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.601+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/4159318325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 0x7f4e74101120 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4e64009990 tx=0x7f4e64009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.601+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/4159318325 shutdown_connections 2023-07-21T22:18:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.601+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/4159318325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e740ffae0 0x7f4e740ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.601+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/4159318325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e74101660 0x7f4e74107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.601+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/4159318325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 0x7f4e74101120 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.601+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/4159318325 >> 172.21.15.151:0/4159318325 conn(0x7f4e740fb0e0 msgr2=0x7f4e740fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:41.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.601+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/4159318325 shutdown_connections 2023-07-21T22:18:41.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.602+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/4159318325 wait complete. 2023-07-21T22:18:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.602+0000 7f4e7b3ff700 1 Processor -- start 2023-07-21T22:18:41.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7b3ff700 1 -- start start 2023-07-21T22:18:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7b3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e740ffae0 0x7f4e741957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7b3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 0x7f4e74195cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7b3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e74101660 0x7f4e7419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7b3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7419d330 con 0x7f4e74100cd0 2023-07-21T22:18:41.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7b3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7419d470 con 0x7f4e74101660 2023-07-21T22:18:41.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7b3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7419d600 con 0x7f4e740ffae0 2023-07-21T22:18:41.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7899a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 0x7f4e74195cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7899a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 0x7f4e74195cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37514/0 (socket says 172.21.15.151:37514) 2023-07-21T22:18:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7899a700 1 -- 172.21.15.151:0/3735013287 learned_addr learned my addr 172.21.15.151:0/3735013287 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7919b700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e740ffae0 0x7f4e741957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7899a700 1 -- 172.21.15.151:0/3735013287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e740ffae0 msgr2=0x7f4e741957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7899a700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e740ffae0 0x7f4e741957b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7899a700 1 -- 172.21.15.151:0/3735013287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e74101660 msgr2=0x7f4e7419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7899a700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e74101660 0x7f4e7419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7899a700 1 -- 172.21.15.151:0/3735013287 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e640095f0 con 0x7f4e74100cd0 2023-07-21T22:18:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.603+0000 7f4e7919b700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e740ffae0 0x7f4e741957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.604+0000 7f4e7899a700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 0x7f4e74195cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e64005910 tx=0x7f4e640057d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.604+0000 7f4e6a7fc700 1 -- 172.21.15.151:0/3735013287 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6401d070 con 0x7f4e74100cd0 2023-07-21T22:18:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.604+0000 7f4e6a7fc700 1 -- 172.21.15.151:0/3735013287 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e64022470 con 0x7f4e74100cd0 2023-07-21T22:18:41.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.604+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7419d880 con 0x7f4e74100cd0 2023-07-21T22:18:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.604+0000 7f4e6a7fc700 1 -- 172.21.15.151:0/3735013287 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e6400f6c0 con 0x7f4e74100cd0 2023-07-21T22:18:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.604+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7419dd00 con 0x7f4e74100cd0 2023-07-21T22:18:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.605+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7410b1b0 con 0x7f4e74100cd0 2023-07-21T22:18:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.607+0000 7f4e6a7fc700 1 -- 172.21.15.151:0/3735013287 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f4e640225e0 con 0x7f4e74100cd0 2023-07-21T22:18:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.608+0000 7f4e6a7fc700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4e600a1260 0x7f4e600a3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.609+0000 7f4e6a7fc700 1 -- 172.21.15.151:0/3735013287 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f4e640ce700 con 0x7f4e74100cd0 2023-07-21T22:18:41.658 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.609+0000 7f4e7919b700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4e600a1260 0x7f4e600a3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:41.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:41 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3261800335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:41.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:41 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2381241029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:41.659 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.609+0000 7f4e7919b700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4e600a1260 0x7f4e600a3710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4e74100b30 tx=0x7f4e70009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:41.660 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.610+0000 7f4e6a7fc700 1 -- 172.21.15.151:0/3735013287 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f4e64097d50 con 0x7f4e74100cd0 2023-07-21T22:18:41.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:41 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3261800335' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:41.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:41 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2381241029' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.809+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4e7419e400 con 0x7f4e74100cd0 2023-07-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.810+0000 7f4e6a7fc700 1 -- 172.21.15.151:0/3735013287 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4e64027020 con 0x7f4e74100cd0 2023-07-21T22:18:41.854 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:18:41.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4e600a1260 msgr2=0x7f4e600a3710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4e600a1260 0x7f4e600a3710 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f4e74100b30 tx=0x7f4e70009260 comp rx=0 tx=0).stop 2023-07-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 msgr2=0x7f4e74195cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 0x7f4e74195cf0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4e64005910 tx=0x7f4e640057d0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 shutdown_connections 2023-07-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f4e600a1260 0x7f4e600a3710 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e74101660 0x7f4e7419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e740ffae0 0x7f4e741957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 --2- 172.21.15.151:0/3735013287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e74100cd0 0x7f4e74195cf0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 >> 172.21.15.151:0/3735013287 conn(0x7f4e740fb0e0 msgr2=0x7f4e740fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 shutdown_connections 2023-07-21T22:18:41.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:41.812+0000 7f4e7b3ff700 1 -- 172.21.15.151:0/3735013287 wait complete. 2023-07-21T22:18:41.876 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:18:42.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.034+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/816991388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04100ce0 msgr2=0x7f8d04101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.034+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/816991388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04100ce0 0x7f8d04101130 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8cec009990 tx=0x7f8cec009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.034+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/816991388 shutdown_connections 2023-07-21T22:18:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.034+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/816991388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d04101670 0x7f8d04107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.034+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/816991388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d040ffaf0 0x7f8d040fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.034+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/816991388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04100ce0 0x7f8d04101130 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.034+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/816991388 >> 172.21.15.151:0/816991388 conn(0x7f8d040fb130 msgr2=0x7f8d040fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:42.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.035+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/816991388 shutdown_connections 2023-07-21T22:18:42.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.035+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/816991388 wait complete. 2023-07-21T22:18:42.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.035+0000 7f8d0a3ff700 1 Processor -- start 2023-07-21T22:18:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0a3ff700 1 -- start start 2023-07-21T22:18:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0a3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d040ffaf0 0x7f8d04195840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0a3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d04100ce0 0x7f8d04195d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0a3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04101670 0x7f8d0419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0a3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0419d3c0 con 0x7f8d04101670 2023-07-21T22:18:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0a3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0419d500 con 0x7f8d04100ce0 2023-07-21T22:18:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0a3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0419d690 con 0x7f8d040ffaf0 2023-07-21T22:18:42.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0899c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04101670 0x7f8d0419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0899c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04101670 0x7f8d0419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37544/0 (socket says 172.21.15.151:37544) 2023-07-21T22:18:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d0899c700 1 -- 172.21.15.151:0/3063762247 learned_addr learned my addr 172.21.15.151:0/3063762247 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8cfbfff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d04100ce0 0x7f8d04195d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.036+0000 7f8d03fff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d040ffaf0 0x7f8d04195840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d0899c700 1 -- 172.21.15.151:0/3063762247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d040ffaf0 msgr2=0x7f8d04195840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d0899c700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d040ffaf0 0x7f8d04195840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d0899c700 1 -- 172.21.15.151:0/3063762247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d04100ce0 msgr2=0x7f8d04195d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d0899c700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d04100ce0 0x7f8d04195d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d0899c700 1 -- 172.21.15.151:0/3063762247 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cec0095f0 con 0x7f8d04101670 2023-07-21T22:18:42.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d0899c700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04101670 0x7f8d0419cdf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc007ee0 tx=0x7f8cfc00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:42.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d01ffb700 1 -- 172.21.15.151:0/3063762247 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc00ddd0 con 0x7f8d04101670 2023-07-21T22:18:42.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d0419d970 con 0x7f8d04101670 2023-07-21T22:18:42.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d01ffb700 1 -- 172.21.15.151:0/3063762247 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cfc00f040 con 0x7f8d04101670 2023-07-21T22:18:42.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d01ffb700 1 -- 172.21.15.151:0/3063762247 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0047d0 con 0x7f8d04101670 2023-07-21T22:18:42.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.037+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d0419de80 con 0x7f8d04101670 2023-07-21T22:18:42.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.038+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d04107180 con 0x7f8d04101670 2023-07-21T22:18:42.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.040+0000 7f8d01ffb700 1 -- 172.21.15.151:0/3063762247 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8cfc003a00 con 0x7f8d04101670 2023-07-21T22:18:42.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.042+0000 7f8d01ffb700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8cf00a11e0 0x7f8cf00a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.042+0000 7f8d01ffb700 1 -- 172.21.15.151:0/3063762247 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8cfc0cc320 con 0x7f8d04101670 2023-07-21T22:18:42.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.042+0000 7f8d03fff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8cf00a11e0 0x7f8cf00a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.042+0000 7f8d03fff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8cf00a11e0 0x7f8cf00a3690 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8d04100b40 tx=0x7f8cf4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:42.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.045+0000 7f8d01ffb700 1 -- 172.21.15.151:0/3063762247 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8cfc04e770 con 0x7f8d04101670 2023-07-21T22:18:42.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.247+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8d0402ca70 con 0x7f8d04101670 2023-07-21T22:18:42.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.248+0000 7f8d01ffb700 1 -- 172.21.15.151:0/3063762247 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8cfc0958e0 con 0x7f8d04101670 2023-07-21T22:18:42.292 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T22:18:42.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8cf00a11e0 msgr2=0x7f8cf00a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8cf00a11e0 0x7f8cf00a3690 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f8d04100b40 tx=0x7f8cf4009260 comp rx=0 tx=0).stop 2023-07-21T22:18:42.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04101670 msgr2=0x7f8d0419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04101670 0x7f8d0419cdf0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc007ee0 tx=0x7f8cfc00d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 shutdown_connections 2023-07-21T22:18:42.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8cf00a11e0 0x7f8cf00a3690 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d04101670 0x7f8d0419cdf0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d040ffaf0 0x7f8d04195840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 --2- 172.21.15.151:0/3063762247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d04100ce0 0x7f8d04195d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.250+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 >> 172.21.15.151:0/3063762247 conn(0x7f8d040fb130 msgr2=0x7f8d041042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:42.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.251+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 shutdown_connections 2023-07-21T22:18:42.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.251+0000 7f8d0a3ff700 1 -- 172.21.15.151:0/3063762247 wait complete. 2023-07-21T22:18:42.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:18:42.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.471+0000 7f59b5dff700 1 -- 172.21.15.151:0/3863666157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0100ce0 msgr2=0x7f59b0101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.471+0000 7f59b5dff700 1 --2- 172.21.15.151:0/3863666157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0100ce0 0x7f59b0101130 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f59a4009990 tx=0x7f59a4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.471+0000 7f59b5dff700 1 -- 172.21.15.151:0/3863666157 shutdown_connections 2023-07-21T22:18:42.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.471+0000 7f59b5dff700 1 --2- 172.21.15.151:0/3863666157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59b00ffaf0 0x7f59b00fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.471+0000 7f59b5dff700 1 --2- 172.21.15.151:0/3863666157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0101670 0x7f59b0107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.471+0000 7f59b5dff700 1 --2- 172.21.15.151:0/3863666157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0100ce0 0x7f59b0101130 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.471+0000 7f59b5dff700 1 -- 172.21.15.151:0/3863666157 >> 172.21.15.151:0/3863666157 conn(0x7f59b00fb130 msgr2=0x7f59b00fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:42.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.471+0000 7f59b5dff700 1 -- 172.21.15.151:0/3863666157 shutdown_connections 2023-07-21T22:18:42.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.471+0000 7f59b5dff700 1 -- 172.21.15.151:0/3863666157 wait complete. 2023-07-21T22:18:42.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.472+0000 7f59b5dff700 1 Processor -- start 2023-07-21T22:18:42.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59b5dff700 1 -- start start 2023-07-21T22:18:42.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59b5dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59b00ffaf0 0x7f59b00742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59b5dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0100ce0 0x7f59b0072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59b5dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0101670 0x7f59b0072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59b5dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b00735e0 con 0x7f59b0101670 2023-07-21T22:18:42.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59b5dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b0073750 con 0x7f59b00ffaf0 2023-07-21T22:18:42.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59b5dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b019f750 con 0x7f59b0100ce0 2023-07-21T22:18:42.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59affff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0101670 0x7f59b0072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59affff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0101670 0x7f59b0072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37560/0 (socket says 172.21.15.151:37560) 2023-07-21T22:18:42.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59affff700 1 -- 172.21.15.151:0/2892160040 learned_addr learned my addr 172.21.15.151:0/2892160040 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:42.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59af7fe700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59b00ffaf0 0x7f59b00742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.473+0000 7f59aeffd700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0100ce0 0x7f59b0072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59affff700 1 -- 172.21.15.151:0/2892160040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0100ce0 msgr2=0x7f59b0072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59affff700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0100ce0 0x7f59b0072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59affff700 1 -- 172.21.15.151:0/2892160040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59b00ffaf0 msgr2=0x7f59b00742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59affff700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59b00ffaf0 0x7f59b00742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59affff700 1 -- 172.21.15.151:0/2892160040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a40095f0 con 0x7f59b0101670 2023-07-21T22:18:42.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59aeffd700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0100ce0 0x7f59b0072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:42.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59af7fe700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59b00ffaf0 0x7f59b00742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:42.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59affff700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0101670 0x7f59b0072e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f59a8007ee0 tx=0x7f59a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:42.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59acff9700 1 -- 172.21.15.151:0/2892160040 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8017070 con 0x7f59b0101670 2023-07-21T22:18:42.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59acff9700 1 -- 172.21.15.151:0/2892160040 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f59a800f040 con 0x7f59b0101670 2023-07-21T22:18:42.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59b019fa30 con 0x7f59b0101670 2023-07-21T22:18:42.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59acff9700 1 -- 172.21.15.151:0/2892160040 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59a8005710 con 0x7f59b0101670 2023-07-21T22:18:42.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.474+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b019ff40 con 0x7f59b0101670 2023-07-21T22:18:42.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.475+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b010b1c0 con 0x7f59b0101670 2023-07-21T22:18:42.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.477+0000 7f59acff9700 1 -- 172.21.15.151:0/2892160040 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f59a8005870 con 0x7f59b0101670 2023-07-21T22:18:42.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.478+0000 7f59acff9700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f59980a11e0 0x7f59980a3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.478+0000 7f59acff9700 1 -- 172.21.15.151:0/2892160040 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f59a80cc350 con 0x7f59b0101670 2023-07-21T22:18:42.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.479+0000 7f59af7fe700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f59980a11e0 0x7f59980a3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.479+0000 7f59af7fe700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f59980a11e0 0x7f59980a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f59b0100b40 tx=0x7f59a000a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:42.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.482+0000 7f59acff9700 1 -- 172.21.15.151:0/2892160040 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f59a8095910 con 0x7f59b0101670 2023-07-21T22:18:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:42 smithi187 ceph-mon[96918]: pgmap v346: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-21T22:18:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:42 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2122041418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:42 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3735013287' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:42.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:42 smithi195 ceph-mon[97365]: pgmap v346: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-21T22:18:42.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:42 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2122041418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:42.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:42 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3735013287' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:42.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:42 smithi151 ceph-mon[95510]: pgmap v346: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2023-07-21T22:18:42.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:42 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2122041418' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:42.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:42 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3735013287' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:42.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.683+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f59b01069f0 con 0x7f59b0101670 2023-07-21T22:18:42.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.683+0000 7f59acff9700 1 -- 172.21.15.151:0/2892160040 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f59a8098f30 con 0x7f59b0101670 2023-07-21T22:18:42.728 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T22:18:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f59980a11e0 msgr2=0x7f59980a3690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f59980a11e0 0x7f59980a3690 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f59b0100b40 tx=0x7f59a000a680 comp rx=0 tx=0).stop 2023-07-21T22:18:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0101670 msgr2=0x7f59b0072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0101670 0x7f59b0072e40 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f59a8007ee0 tx=0x7f59a800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 shutdown_connections 2023-07-21T22:18:42.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f59980a11e0 0x7f59980a3690 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59b00ffaf0 0x7f59b00742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f59b0101670 0x7f59b0072e40 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 --2- 172.21.15.151:0/2892160040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f59b0100ce0 0x7f59b0072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.685+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 >> 172.21.15.151:0/2892160040 conn(0x7f59b00fb130 msgr2=0x7f59b00fd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.686+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 shutdown_connections 2023-07-21T22:18:42.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.686+0000 7f59b5dff700 1 -- 172.21.15.151:0/2892160040 wait complete. 2023-07-21T22:18:42.749 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.928+0000 7f8b00bff700 1 -- 172.21.15.151:0/2371371632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 msgr2=0x7f8afc101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.928+0000 7f8b00bff700 1 --2- 172.21.15.151:0/2371371632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 0x7f8afc101120 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8af0009990 tx=0x7f8af0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.928+0000 7f8b00bff700 1 -- 172.21.15.151:0/2371371632 shutdown_connections 2023-07-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.928+0000 7f8b00bff700 1 --2- 172.21.15.151:0/2371371632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8afc101660 0x7f8afc107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.974 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.928+0000 7f8b00bff700 1 --2- 172.21.15.151:0/2371371632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8afc0ffae0 0x7f8afc0ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.928+0000 7f8b00bff700 1 --2- 172.21.15.151:0/2371371632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 0x7f8afc101120 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.928+0000 7f8b00bff700 1 -- 172.21.15.151:0/2371371632 >> 172.21.15.151:0/2371371632 conn(0x7f8afc0fb100 msgr2=0x7f8afc0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.928+0000 7f8b00bff700 1 -- 172.21.15.151:0/2371371632 shutdown_connections 2023-07-21T22:18:42.975 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.928+0000 7f8b00bff700 1 -- 172.21.15.151:0/2371371632 wait complete. 2023-07-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.929+0000 7f8b00bff700 1 Processor -- start 2023-07-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.929+0000 7f8b00bff700 1 -- start start 2023-07-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8b00bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8afc0ffae0 0x7f8afc1957a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8b00bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 0x7f8afc195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8b00bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8afc101660 0x7f8afc19cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8b00bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc19d320 con 0x7f8afc100cd0 2023-07-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8b00bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc19d460 con 0x7f8afc101660 2023-07-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8b00bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8afc19d5f0 con 0x7f8afc0ffae0 2023-07-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8af9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 0x7f8afc195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8af9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 0x7f8afc195ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37592/0 (socket says 172.21.15.151:37592) 2023-07-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8af9d9b700 1 -- 172.21.15.151:0/1138834469 learned_addr learned my addr 172.21.15.151:0/1138834469 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:42.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8afad9d700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8afc101660 0x7f8afc19cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8afa59c700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8afc0ffae0 0x7f8afc1957a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8af9d9b700 1 -- 172.21.15.151:0/1138834469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8afc0ffae0 msgr2=0x7f8afc1957a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8af9d9b700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8afc0ffae0 0x7f8afc1957a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8af9d9b700 1 -- 172.21.15.151:0/1138834469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8afc101660 msgr2=0x7f8afc19cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8af9d9b700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8afc101660 0x7f8afc19cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:42.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8af9d9b700 1 -- 172.21.15.151:0/1138834469 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8af00095f0 con 0x7f8afc100cd0 2023-07-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.930+0000 7f8afa59c700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8afc0ffae0 0x7f8afc1957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.931+0000 7f8af9d9b700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 0x7f8afc195ce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8af0006010 tx=0x7f8af0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.931+0000 7f8aeb7fe700 1 -- 172.21.15.151:0/1138834469 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af001d070 con 0x7f8afc100cd0 2023-07-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.931+0000 7f8aeb7fe700 1 -- 172.21.15.151:0/1138834469 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8af00054c0 con 0x7f8afc100cd0 2023-07-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.931+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8afc19d870 con 0x7f8afc100cd0 2023-07-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.931+0000 7f8aeb7fe700 1 -- 172.21.15.151:0/1138834469 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8af0003ab0 con 0x7f8afc100cd0 2023-07-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.931+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8afc19dc90 con 0x7f8afc100cd0 2023-07-21T22:18:42.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.932+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8afc1070a0 con 0x7f8afc100cd0 2023-07-21T22:18:42.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.934+0000 7f8aeb7fe700 1 -- 172.21.15.151:0/1138834469 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) v1 ==== 135767+0+0 (secure 0 0 0) 0x7f8af00047a0 con 0x7f8afc100cd0 2023-07-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.936+0000 7f8aeb7fe700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ae40a1220 0x7f8ae40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.936+0000 7f8aeb7fe700 1 -- 172.21.15.151:0/1138834469 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8af00cda80 con 0x7f8afc100cd0 2023-07-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.936+0000 7f8afa59c700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ae40a1220 0x7f8ae40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.936+0000 7f8afa59c700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ae40a1220 0x7f8ae40a36d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8aec005d90 tx=0x7f8aec005d00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:42.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:42.939+0000 7f8aeb7fe700 1 -- 172.21.15.151:0/1138834469 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8af00970d0 con 0x7f8afc100cd0 2023-07-21T22:18:43.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.186+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8afc02c850 con 0x7f8afc100cd0 2023-07-21T22:18:43.231 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.186+0000 7f8aeb7fe700 1 -- 172.21.15.151:0/1138834469 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f8af009a6f0 con 0x7f8afc100cd0 2023-07-21T22:18:43.231 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:43.231 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:17:15.194775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:18:43.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ae40a1220 msgr2=0x7f8ae40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ae40a1220 0x7f8ae40a36d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8aec005d90 tx=0x7f8aec005d00 comp rx=0 tx=0).stop 2023-07-21T22:18:43.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 msgr2=0x7f8afc195ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 0x7f8afc195ce0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f8af0006010 tx=0x7f8af0004730 comp rx=0 tx=0).stop 2023-07-21T22:18:43.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 shutdown_connections 2023-07-21T22:18:43.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8ae40a1220 0x7f8ae40a36d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8afc101660 0x7f8afc19cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8afc0ffae0 0x7f8afc1957a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 --2- 172.21.15.151:0/1138834469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8afc100cd0 0x7f8afc195ce0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 >> 172.21.15.151:0/1138834469 conn(0x7f8afc0fb100 msgr2=0x7f8afc1041e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 shutdown_connections 2023-07-21T22:18:43.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.189+0000 7f8b00bff700 1 -- 172.21.15.151:0/1138834469 wait complete. 2023-07-21T22:18:43.238 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 23 2023-07-21T22:18:43.253 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.413+0000 7f45e47ff700 1 -- 172.21.15.151:0/3855664542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 msgr2=0x7f45dc0fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.413+0000 7f45e47ff700 1 --2- 172.21.15.151:0/3855664542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 0x7f45dc0fff10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009990 tx=0x7f45d8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.413+0000 7f45e47ff700 1 -- 172.21.15.151:0/3855664542 shutdown_connections 2023-07-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.413+0000 7f45e47ff700 1 --2- 172.21.15.151:0/3855664542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45dc101680 0x7f45dc107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.413+0000 7f45e47ff700 1 --2- 172.21.15.151:0/3855664542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 0x7f45dc0fff10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.413+0000 7f45e47ff700 1 --2- 172.21.15.151:0/3855664542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc100cf0 0x7f45dc101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.413+0000 7f45e47ff700 1 -- 172.21.15.151:0/3855664542 >> 172.21.15.151:0/3855664542 conn(0x7f45dc0fb0e0 msgr2=0x7f45dc0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.413+0000 7f45e47ff700 1 -- 172.21.15.151:0/3855664542 shutdown_connections 2023-07-21T22:18:43.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.413+0000 7f45e47ff700 1 -- 172.21.15.151:0/3855664542 wait complete. 2023-07-21T22:18:43.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e47ff700 1 Processor -- start 2023-07-21T22:18:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e47ff700 1 -- start start 2023-07-21T22:18:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e47ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 0x7f45dc0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e47ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc100cf0 0x7f45dc072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e47ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45dc101680 0x7f45dc072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e47ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc0735e0 con 0x7f45dc0ffb00 2023-07-21T22:18:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e47ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc073750 con 0x7f45dc101680 2023-07-21T22:18:43.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e47ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc19f7d0 con 0x7f45dc100cf0 2023-07-21T22:18:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e259b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 0x7f45dc0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e259b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 0x7f45dc0742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37620/0 (socket says 172.21.15.151:37620) 2023-07-21T22:18:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e259b700 1 -- 172.21.15.151:0/940357633 learned_addr learned my addr 172.21.15.151:0/940357633 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.414+0000 7f45e1d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc100cf0 0x7f45dc072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45e259b700 1 -- 172.21.15.151:0/940357633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc100cf0 msgr2=0x7f45dc072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45e2d9c700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45dc101680 0x7f45dc072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45e259b700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc100cf0 0x7f45dc072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45e259b700 1 -- 172.21.15.151:0/940357633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45dc101680 msgr2=0x7f45dc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45e259b700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45dc101680 0x7f45dc072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45e259b700 1 -- 172.21.15.151:0/940357633 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d80095f0 con 0x7f45dc0ffb00 2023-07-21T22:18:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45e2d9c700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45dc101680 0x7f45dc072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45e259b700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 0x7f45dc0742c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f45d8004730 tx=0x7f45d8009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45d37fe700 1 -- 172.21.15.151:0/940357633 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d801d070 con 0x7f45dc0ffb00 2023-07-21T22:18:43.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45d37fe700 1 -- 172.21.15.151:0/940357633 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f45d8004ca0 con 0x7f45dc0ffb00 2023-07-21T22:18:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45dc19fa50 con 0x7f45dc0ffb00 2023-07-21T22:18:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.415+0000 7f45d37fe700 1 -- 172.21.15.151:0/940357633 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d8003af0 con 0x7f45dc0ffb00 2023-07-21T22:18:43.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.416+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45dc19fed0 con 0x7f45dc0ffb00 2023-07-21T22:18:43.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.417+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45dc1070f0 con 0x7f45dc0ffb00 2023-07-21T22:18:43.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.419+0000 7f45d37fe700 1 -- 172.21.15.151:0/940357633 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f45d8004810 con 0x7f45dc0ffb00 2023-07-21T22:18:43.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.421+0000 7f45d37fe700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f45c80a1220 0x7f45c80a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.421+0000 7f45d37fe700 1 -- 172.21.15.151:0/940357633 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f45d80cd870 con 0x7f45dc0ffb00 2023-07-21T22:18:43.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.421+0000 7f45e1d9a700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f45c80a1220 0x7f45c80a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.421+0000 7f45e1d9a700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f45c80a1220 0x7f45c80a36d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f45cc005950 tx=0x7f45cc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.425+0000 7f45d37fe700 1 -- 172.21.15.151:0/940357633 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f45d8097020 con 0x7f45dc0ffb00 2023-07-21T22:18:43.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:43 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3063762247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:43.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:43 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2892160040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:43.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:43 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1138834469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:43.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:43 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3063762247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:43.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:43 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2892160040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:43.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:43 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1138834469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:43.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.627+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f45dc02c850 con 0x7f45dc0ffb00 2023-07-21T22:18:43.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.629+0000 7f45d37fe700 1 -- 172.21.15.151:0/940357633 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7f45d809a640 con 0x7f45dc0ffb00 2023-07-21T22:18:43.674 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:43.674 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:43.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f45c80a1220 msgr2=0x7f45c80a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f45c80a1220 0x7f45c80a36d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f45cc005950 tx=0x7f45cc00b410 comp rx=0 tx=0).stop 2023-07-21T22:18:43.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 msgr2=0x7f45dc0742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 0x7f45dc0742c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f45d8004730 tx=0x7f45d8009580 comp rx=0 tx=0).stop 2023-07-21T22:18:43.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 shutdown_connections 2023-07-21T22:18:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f45c80a1220 0x7f45c80a36d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45dc101680 0x7f45dc072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f45dc0ffb00 0x7f45dc0742c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 --2- 172.21.15.151:0/940357633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f45dc100cf0 0x7f45dc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.631+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 >> 172.21.15.151:0/940357633 conn(0x7f45dc0fb0e0 msgr2=0x7f45dc104230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.632+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 shutdown_connections 2023-07-21T22:18:43.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.632+0000 7f45e47ff700 1 -- 172.21.15.151:0/940357633 wait complete. 2023-07-21T22:18:43.692 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:43 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3063762247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:43.693 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:43 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2892160040' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:43.693 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:43 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1138834469' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:43.695 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2023-07-21T22:17:09.358855+0000', 'modified': '2023-07-21T22:17:15.194775+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24599, 'mds_1': 24574, 'mds_2': 24548}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24475': {'gid': 24475, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6833/2796106198', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6832', 'nonce': 2796106198}, {'type': 'v1', 'addr': '172.21.15.195:6833', 'nonce': 2796106198}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24512': {'gid': 24512, 'name': 'e', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.187:6835/3281429688', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6834', 'nonce': 3281429688}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 3281429688}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24538': {'gid': 24538, 'name': 'f', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.195:6835/3818436709', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6834', 'nonce': 3818436709}, {'type': 'v1', 'addr': '172.21.15.195:6835', 'nonce': 3818436709}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24548': {'gid': 24548, 'name': 'h', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 7, 'addr': '172.21.15.187:6837/1053006516', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6836', 'nonce': 1053006516}, {'type': 'v1', 'addr': '172.21.15.187:6837', 'nonce': 1053006516}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24574': {'gid': 24574, 'name': 'i', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.195:6839/2311441690', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.195:6838', 'nonce': 2311441690}, {'type': 'v1', 'addr': '172.21.15.195:6839', 'nonce': 2311441690}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}, 'gid_24599': {'gid': 24599, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6839/1236119832', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6838', 'nonce': 1236119832}, {'type': 'v1', 'addr': '172.21.15.187:6839', 'nonce': 1236119832}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-07-21T22:18:43.696 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2023-07-21T22:18:43.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2023-07-21T22:18:43.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.852+0000 7facc4bff700 1 -- 172.21.15.151:0/1605928529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 msgr2=0x7facc0107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.852+0000 7facc4bff700 1 --2- 172.21.15.151:0/1605928529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 0x7facc0107f30 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7facb800b0a0 tx=0x7facb800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.852+0000 7facc4bff700 1 -- 172.21.15.151:0/1605928529 shutdown_connections 2023-07-21T22:18:43.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.852+0000 7facc4bff700 1 --2- 172.21.15.151:0/1605928529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facc00ffaf0 0x7facc00fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.852+0000 7facc4bff700 1 --2- 172.21.15.151:0/1605928529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 0x7facc0107f30 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.898 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.852+0000 7facc4bff700 1 --2- 172.21.15.151:0/1605928529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc0100ce0 0x7facc0101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.852+0000 7facc4bff700 1 -- 172.21.15.151:0/1605928529 >> 172.21.15.151:0/1605928529 conn(0x7facc00fb130 msgr2=0x7facc00fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.852+0000 7facc4bff700 1 -- 172.21.15.151:0/1605928529 shutdown_connections 2023-07-21T22:18:43.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.852+0000 7facc4bff700 1 -- 172.21.15.151:0/1605928529 wait complete. 2023-07-21T22:18:43.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.853+0000 7facc4bff700 1 Processor -- start 2023-07-21T22:18:43.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.853+0000 7facc4bff700 1 -- start start 2023-07-21T22:18:43.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facc4bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc00ffaf0 0x7facc0197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facc4bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facc0100ce0 0x7facc0198020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facc4bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 0x7facc019f090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facc4bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc019f660 con 0x7facc0101670 2023-07-21T22:18:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facc4bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc019f7a0 con 0x7facc0100ce0 2023-07-21T22:18:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facc4bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc019f930 con 0x7facc00ffaf0 2023-07-21T22:18:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 0x7facc019f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 0x7facc019f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37624/0 (socket says 172.21.15.151:37624) 2023-07-21T22:18:43.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbed9d700 1 -- 172.21.15.151:0/141798604 learned_addr learned my addr 172.21.15.151:0/141798604 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:43.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbe59c700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc00ffaf0 0x7facc0197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facb7fff700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facc0100ce0 0x7facc0198020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbed9d700 1 -- 172.21.15.151:0/141798604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc00ffaf0 msgr2=0x7facc0197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbed9d700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc00ffaf0 0x7facc0197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbed9d700 1 -- 172.21.15.151:0/141798604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facc0100ce0 msgr2=0x7facc0198020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbed9d700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facc0100ce0 0x7facc0198020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbed9d700 1 -- 172.21.15.151:0/141798604 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb8009d00 con 0x7facc0101670 2023-07-21T22:18:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbe59c700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc00ffaf0 0x7facc0197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.854+0000 7facbed9d700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 0x7facc019f090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7facb8009fd0 tx=0x7facb800bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.855+0000 7facb77fe700 1 -- 172.21.15.151:0/141798604 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb800e040 con 0x7facc0101670 2023-07-21T22:18:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.855+0000 7facc4bff700 1 -- 172.21.15.151:0/141798604 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc019fbb0 con 0x7facc0101670 2023-07-21T22:18:43.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.855+0000 7facb77fe700 1 -- 172.21.15.151:0/141798604 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facb8003c00 con 0x7facc0101670 2023-07-21T22:18:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.855+0000 7facb77fe700 1 -- 172.21.15.151:0/141798604 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb801b6c0 con 0x7facc0101670 2023-07-21T22:18:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.855+0000 7facc4bff700 1 -- 172.21.15.151:0/141798604 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc019ff80 con 0x7facc0101670 2023-07-21T22:18:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.858+0000 7facb77fe700 1 -- 172.21.15.151:0/141798604 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7facb801d470 con 0x7facc0101670 2023-07-21T22:18:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.859+0000 7facd8504b80 1 Processor -- start 2023-07-21T22:18:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facd8504b80 1 -- start start 2023-07-21T22:18:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facb77fe700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7facac0a1150 0x7facac0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facb77fe700 1 -- 172.21.15.151:0/141798604 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7facb80cde90 con 0x7facc0101670 2023-07-21T22:18:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facb7fff700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7facac0a1150 0x7facac0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facd8504b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d07e0 0x56067f7d0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facd8504b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facd8504b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7cf9c0 0x56067f7cfe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facd8504b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f6d4c60 con 0x56067f7d1150 2023-07-21T22:18:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facd8504b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f7279f0 con 0x56067f7d07e0 2023-07-21T22:18:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facd8504b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f720e80 con 0x56067f7cf9c0 2023-07-21T22:18:43.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facb7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facb7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7cf3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37626/0 (socket says 172.21.15.151:37626) 2023-07-21T22:18:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facb7fff700 1 -- 172.21.15.151:0/1601675470 learned_addr learned my addr 172.21.15.151:0/1601675470 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.860+0000 7facbe59c700 1 --2- 172.21.15.151:0/1601675470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d07e0 0x56067f7d0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facbed9d700 1 --2- 172.21.15.151:0/1601675470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7cf9c0 0x56067f7cfe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb7fff700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7facac0a1150 0x7facac0a3600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faca80124b0 tx=0x7faca8012870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb7fff700 1 -- 172.21.15.151:0/1601675470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7cf9c0 msgr2=0x56067f7cfe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb7fff700 1 --2- 172.21.15.151:0/1601675470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7cf9c0 0x56067f7cfe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb7fff700 1 -- 172.21.15.151:0/1601675470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d07e0 msgr2=0x56067f7d0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb7fff700 1 --2- 172.21.15.151:0/1601675470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d07e0 0x56067f7d0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb7fff700 1 -- 172.21.15.151:0/1601675470 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56067f54ed90 con 0x56067f7d1150 2023-07-21T22:18:43.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb7fff700 1 --2- 172.21.15.151:0/1601675470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7cf3e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faca8012c70 tx=0x7faca801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f45f7ae2ff7f7b6b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb4ff9700 1 -- 172.21.15.151:0/1601675470 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8023030 con 0x56067f7d1150 2023-07-21T22:18:43.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb4ff9700 1 -- 172.21.15.151:0/1601675470 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faca80044c0 con 0x56067f7d1150 2023-07-21T22:18:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.861+0000 7facb4ff9700 1 -- 172.21.15.151:0/1601675470 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca8003e80 con 0x56067f7d1150 2023-07-21T22:18:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.862+0000 7facd8504b80 1 -- 172.21.15.151:0/1601675470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 msgr2=0x56067f7cf3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.862+0000 7facd8504b80 1 --2- 172.21.15.151:0/1601675470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7cf3e0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faca8012c70 tx=0x7faca801e000 comp rx=0 tx=0).stop 2023-07-21T22:18:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.862+0000 7facd8504b80 1 -- 172.21.15.151:0/1601675470 shutdown_connections 2023-07-21T22:18:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.862+0000 7facd8504b80 1 --2- 172.21.15.151:0/1601675470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d07e0 0x56067f7d0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.862+0000 7facd8504b80 1 --2- 172.21.15.151:0/1601675470 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7cf9c0 0x56067f7cfe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.862+0000 7facd8504b80 1 --2- 172.21.15.151:0/1601675470 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7cf3e0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.862+0000 7facd8504b80 1 -- 172.21.15.151:0/1601675470 >> 172.21.15.151:0/1601675470 conn(0x56067f7c4ea0 msgr2=0x56067f7ca310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.862+0000 7facd8504b80 1 -- 172.21.15.151:0/1601675470 shutdown_connections 2023-07-21T22:18:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.862+0000 7facd8504b80 1 -- 172.21.15.151:0/1601675470 wait complete. 2023-07-21T22:18:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.863+0000 7facd8504b80 1 -- start start 2023-07-21T22:18:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.863+0000 7facd8504b80 1 Processor -- start 2023-07-21T22:18:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.863+0000 7facd8504b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 0x56067f7d8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.863+0000 7facd8504b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7d9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.863+0000 7facd8504b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7e0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.863+0000 7facd8504b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f6c0a70 con 0x56067f7d1150 2023-07-21T22:18:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.863+0000 7facd8504b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f6c0770 con 0x56067f7cf9c0 2023-07-21T22:18:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.863+0000 7facd8504b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f5a48d0 con 0x56067f7d07e0 2023-07-21T22:18:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.863+0000 7facd8504b80 10 client.0 _ll_register_callbacks cb 0x56067f6be710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7e0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7e0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37638/0 (socket says 172.21.15.151:37638) 2023-07-21T22:18:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbed9d700 1 -- 172.21.15.151:0/4257937732 learned_addr learned my addr 172.21.15.151:0/4257937732 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:43.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbe59c700 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 0x56067f7d8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facb7fff700 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7d9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbed9d700 1 -- 172.21.15.151:0/4257937732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 msgr2=0x56067f7d9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbed9d700 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7d9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbed9d700 1 -- 172.21.15.151:0/4257937732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 msgr2=0x56067f7d8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbed9d700 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 0x56067f7d8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbed9d700 1 -- 172.21.15.151:0/4257937732 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca800e3c0 con 0x56067f7d1150 2023-07-21T22:18:43.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facbed9d700 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7e0570 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7facb809b000 tx=0x7facb809af30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0db837973bef6d1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7faca5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:18:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7faca5ffb700 1 -- 172.21.15.151:0/4257937732 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb809b300 con 0x56067f7d1150 2023-07-21T22:18:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7faca5ffb700 1 -- 172.21.15.151:0/4257937732 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7facb809f330 con 0x56067f7d1150 2023-07-21T22:18:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.864+0000 7facd8504b80 1 -- 172.21.15.151:0/4257937732 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56067f67a4a0 con 0x56067f7d1150 2023-07-21T22:18:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7faca5ffb700 1 -- 172.21.15.151:0/4257937732 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7facb80a36c0 con 0x56067f7d1150 2023-07-21T22:18:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7facd8504b80 10 client.15270 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:43.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7facd8504b80 1 -- 172.21.15.151:0/4257937732 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56067f537c10 con 0x56067f7d1150 2023-07-21T22:18:43.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7faca5ffb700 1 -- 172.21.15.151:0/4257937732 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facb80b7020 con 0x56067f7d1150 2023-07-21T22:18:43.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7faca5ffb700 1 -- 172.21.15.151:0/4257937732 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7facb80a3230 con 0x56067f7d1150 2023-07-21T22:18:43.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7facd8504b80 10 client.15270 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:43.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7facd8504b80 10 client.15270 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-21T22:18:43.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7facd8504b80 20 client.15270 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:43.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7facd8504b80 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x56067f7e4030 0x56067f7e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7facd8504b80 4 client.15270 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:18:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.865+0000 7facd8504b80 1 -- 172.21.15.151:0/4257937732 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56067f719e60 con 0x56067f7e4030 2023-07-21T22:18:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.866+0000 7facbe59c700 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x56067f7e4030 0x56067f7e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.866+0000 7faca5ffb700 10 client.15270 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:18:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.866+0000 7facbe59c700 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x56067f7e4030 0x56067f7e34a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69326144b057df73 server_cookie=e3cd473d64ce8a6f in_seq=0 out_seq=0 2023-07-21T22:18:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.867+0000 7faca5ffb700 1 -- 172.21.15.151:0/4257937732 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56067f719e60 con 0x56067f7e4030 2023-07-21T22:18:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.867+0000 7faca5ffb700 10 client.15270 handle_command_reply: tid=0 2023-07-21T22:18:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.867+0000 7facd8504b80 1 client.15270 shutdown 2023-07-21T22:18:43.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 -- 172.21.15.151:0/4257937732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 msgr2=0x56067f7e0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7e0570 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7facb809b000 tx=0x7facb809af30 comp rx=0 tx=0).stop 2023-07-21T22:18:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 -- 172.21.15.151:0/4257937732 shutdown_connections 2023-07-21T22:18:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x56067f7e4030 0x56067f7e34a0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 0x56067f7d8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7e0570 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7faca5ffb700 0 client.15270 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:18:43.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 --2- 172.21.15.151:0/4257937732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7d9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 -- 172.21.15.151:0/4257937732 >> 172.21.15.151:0/4257937732 conn(0x56067f7c4ea0 msgr2=0x56067f7c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 -- 172.21.15.151:0/4257937732 shutdown_connections 2023-07-21T22:18:43.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 1 -- 172.21.15.151:0/4257937732 wait complete. 2023-07-21T22:18:43.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.868+0000 7facd8504b80 20 client.15270 trim_cache size 0 max 16384 2023-07-21T22:18:43.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.886+0000 7facd8504b80 1 Processor -- start 2023-07-21T22:18:43.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.886+0000 7facd8504b80 1 -- start start 2023-07-21T22:18:43.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.886+0000 7facd8504b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7cf9c0 0x56067f7c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.886+0000 7facd8504b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7e0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.886+0000 7facd8504b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d1150 0x56067f7e34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.886+0000 7facd8504b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f719e60 con 0x56067f7cf9c0 2023-07-21T22:18:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.886+0000 7facd8504b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f6ef790 con 0x56067f7d1150 2023-07-21T22:18:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.886+0000 7facd8504b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f5b0de0 con 0x56067f7d07e0 2023-07-21T22:18:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbe59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7cf9c0 0x56067f7c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbe59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7cf9c0 0x56067f7c99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37642/0 (socket says 172.21.15.151:37642) 2023-07-21T22:18:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbe59c700 1 -- 172.21.15.151:0/3451936256 learned_addr learned my addr 172.21.15.151:0/3451936256 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:43.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbed9d700 1 --2- 172.21.15.151:0/3451936256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d1150 0x56067f7e34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbe59c700 1 -- 172.21.15.151:0/3451936256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 msgr2=0x56067f7e0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbe59c700 1 --2- 172.21.15.151:0/3451936256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbe59c700 1 -- 172.21.15.151:0/3451936256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d1150 msgr2=0x56067f7e34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbe59c700 1 --2- 172.21.15.151:0/3451936256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d1150 0x56067f7e34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbe59c700 1 -- 172.21.15.151:0/3451936256 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56067f575200 con 0x56067f7cf9c0 2023-07-21T22:18:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facbe59c700 1 --2- 172.21.15.151:0/3451936256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7cf9c0 0x56067f7c99b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7facc0100b40 tx=0x7facb0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e51ce4b006540b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facb57fa700 1 -- 172.21.15.151:0/3451936256 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0017030 con 0x56067f7cf9c0 2023-07-21T22:18:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facb57fa700 1 -- 172.21.15.151:0/3451936256 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facb0018040 con 0x56067f7cf9c0 2023-07-21T22:18:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.887+0000 7facb57fa700 1 -- 172.21.15.151:0/3451936256 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb00127b0 con 0x56067f7cf9c0 2023-07-21T22:18:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 -- 172.21.15.151:0/3451936256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7cf9c0 msgr2=0x56067f7c99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 --2- 172.21.15.151:0/3451936256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7cf9c0 0x56067f7c99b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7facc0100b40 tx=0x7facb0009260 comp rx=0 tx=0).stop 2023-07-21T22:18:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 -- 172.21.15.151:0/3451936256 shutdown_connections 2023-07-21T22:18:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 --2- 172.21.15.151:0/3451936256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7d1150 0x56067f7e34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 --2- 172.21.15.151:0/3451936256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7cf9c0 0x56067f7c99b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 --2- 172.21.15.151:0/3451936256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 -- 172.21.15.151:0/3451936256 >> 172.21.15.151:0/3451936256 conn(0x56067f7c4ea0 msgr2=0x56067f7d7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 -- 172.21.15.151:0/3451936256 shutdown_connections 2023-07-21T22:18:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 -- 172.21.15.151:0/3451936256 wait complete. 2023-07-21T22:18:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.888+0000 7facd8504b80 1 -- start start 2023-07-21T22:18:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facd8504b80 1 Processor -- start 2023-07-21T22:18:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facd8504b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 0x56067f7dbd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facd8504b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7dc2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facd8504b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7df1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facd8504b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f7df710 con 0x56067f7d1150 2023-07-21T22:18:43.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facd8504b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f7df880 con 0x56067f7cf9c0 2023-07-21T22:18:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facd8504b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56067f7dfa40 con 0x56067f7d07e0 2023-07-21T22:18:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facd8504b80 10 client.0 _ll_register_callbacks cb 0x7facb809b0d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facbed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7df1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facbed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7df1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37654/0 (socket says 172.21.15.151:37654) 2023-07-21T22:18:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.889+0000 7facbed9d700 1 -- 172.21.15.151:0/1804998634 learned_addr learned my addr 172.21.15.151:0/1804998634 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facbe59c700 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 0x56067f7dbd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facb7fff700 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7dc2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facbed9d700 1 -- 172.21.15.151:0/1804998634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 msgr2=0x56067f7dc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facbed9d700 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7dc2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facbed9d700 1 -- 172.21.15.151:0/1804998634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 msgr2=0x56067f7dbd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facbed9d700 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 0x56067f7dbd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facbed9d700 1 -- 172.21.15.151:0/1804998634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb0020ab0 con 0x56067f7d1150 2023-07-21T22:18:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facb7fff700 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7dc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facbe59c700 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 0x56067f7dbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:43.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facbed9d700 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7df1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7facb80a3190 tx=0x7facb809f250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58536324b3d7f8e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7faca5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:18:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7faca5ffb700 1 -- 172.21.15.151:0/1804998634 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb809aa40 con 0x56067f7d1150 2023-07-21T22:18:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7faca5ffb700 1 -- 172.21.15.151:0/1804998634 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7facb80b0e40 con 0x56067f7d1150 2023-07-21T22:18:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facd8504b80 1 -- 172.21.15.151:0/1804998634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faca80044c0 con 0x56067f7d1150 2023-07-21T22:18:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7faca5ffb700 1 -- 172.21.15.151:0/1804998634 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7facb809f330 con 0x56067f7d1150 2023-07-21T22:18:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facd8504b80 10 client.15276 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.890+0000 7facd8504b80 1 -- 172.21.15.151:0/1804998634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x56067f54d260 con 0x56067f7d1150 2023-07-21T22:18:43.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.891+0000 7faca5ffb700 1 -- 172.21.15.151:0/1804998634 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faca80044c0 con 0x56067f7d1150 2023-07-21T22:18:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.891+0000 7faca5ffb700 1 -- 172.21.15.151:0/1804998634 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7facb80b92e0 con 0x56067f7d1150 2023-07-21T22:18:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.891+0000 7facd8504b80 10 client.15276 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.891+0000 7facd8504b80 10 client.15276 resolve_mds: resolved name 'h' to daemon mds.h 2023-07-21T22:18:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.891+0000 7facd8504b80 20 client.15276 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.891+0000 7facd8504b80 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x56067f83d6a0 0x56067f83a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.891+0000 7facd8504b80 4 client.15276 mds_command: new command op to 24548 tid=0[{"prefix": "status"}] 2023-07-21T22:18:43.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.891+0000 7facd8504b80 1 -- 172.21.15.151:0/1804998634 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56067f6dc000 con 0x56067f83d6a0 2023-07-21T22:18:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.891+0000 7facbe59c700 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x56067f83d6a0 0x56067f83a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facbe59c700 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x56067f83d6a0 0x56067f83a0b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3fe6346bc55f3010 server_cookie=518c6de8eed75a99 in_seq=0 out_seq=0 2023-07-21T22:18:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7faca5ffb700 10 client.15276 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:18:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7faca5ffb700 1 -- 172.21.15.151:0/1804998634 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x56067f6dc000 con 0x56067f83d6a0 2023-07-21T22:18:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7faca5ffb700 10 client.15276 handle_command_reply: tid=0 2023-07-21T22:18:43.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facd8504b80 1 client.15276 shutdown 2023-07-21T22:18:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facd8504b80 1 -- 172.21.15.151:0/1804998634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 msgr2=0x56067f7df1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facd8504b80 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7df1d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7facb80a3190 tx=0x7facb809f250 comp rx=0 tx=0).stop 2023-07-21T22:18:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facd8504b80 1 -- 172.21.15.151:0/1804998634 shutdown_connections 2023-07-21T22:18:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facd8504b80 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x56067f83d6a0 0x56067f83a0b0 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facd8504b80 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56067f7cf9c0 0x56067f7dbd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facd8504b80 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56067f7d1150 0x56067f7df1d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7faca5ffb700 0 client.15276 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:18:43.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facd8504b80 1 --2- 172.21.15.151:0/1804998634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56067f7d07e0 0x56067f7dc2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.892+0000 7facd8504b80 1 -- 172.21.15.151:0/1804998634 >> 172.21.15.151:0/1804998634 conn(0x56067f7c4ea0 msgr2=0x56067f7d6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facd8504b80 1 -- 172.21.15.151:0/1804998634 shutdown_connections 2023-07-21T22:18:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facd8504b80 1 -- 172.21.15.151:0/1804998634 wait complete. 2023-07-21T22:18:43.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facd8504b80 20 client.15276 trim_cache size 0 max 16384 2023-07-21T22:18:43.946 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:18:43.946 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:18:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 2, 2023-07-21T22:18:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 24548, 2023-07-21T22:18:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-07-21T22:18:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-07-21T22:18:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-07-21T22:18:43.947 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 89.705044525999995, 2023-07-21T22:18:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 23, 2023-07-21T22:18:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 87, 2023-07-21T22:18:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 85, 2023-07-21T22:18:43.948 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 112.986756508 2023-07-21T22:18:43.948 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:18:43.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 -- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7facac0a1150 msgr2=0x7facac0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7facac0a1150 0x7facac0a3600 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7faca80124b0 tx=0x7faca8012870 comp rx=0 tx=0).stop 2023-07-21T22:18:43.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 -- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 msgr2=0x7facc019f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:43.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 0x7facc019f090 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7facb8009fd0 tx=0x7facb800bb00 comp rx=0 tx=0).stop 2023-07-21T22:18:43.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 -- 172.21.15.151:0/141798604 shutdown_connections 2023-07-21T22:18:43.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7facac0a1150 0x7facac0a3600 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facc0101670 0x7facc019f090 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facc00ffaf0 0x7facc0197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 --2- 172.21.15.151:0/141798604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facc0100ce0 0x7facc0198020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:43.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.893+0000 7facc4bff700 1 -- 172.21.15.151:0/141798604 >> 172.21.15.151:0/141798604 conn(0x7facc00fb130 msgr2=0x7facc01065f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:43.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.894+0000 7facc4bff700 1 -- 172.21.15.151:0/141798604 shutdown_connections 2023-07-21T22:18:43.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:43.894+0000 7facc4bff700 1 -- 172.21.15.151:0/141798604 wait complete. 2023-07-21T22:18:43.956 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.i status 2023-07-21T22:18:44.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.110+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1699057600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4100ce0 msgr2=0x7fa3e4101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.110+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1699057600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4100ce0 0x7fa3e4101130 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009990 tx=0x7fa3d4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.110+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1699057600 shutdown_connections 2023-07-21T22:18:44.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.111+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1699057600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e4101670 0x7fa3e4107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.111+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1699057600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e40ffaf0 0x7fa3e40fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.111+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1699057600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4100ce0 0x7fa3e4101130 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.111+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1699057600 >> 172.21.15.151:0/1699057600 conn(0x7fa3e40fb130 msgr2=0x7fa3e40fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.111+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1699057600 shutdown_connections 2023-07-21T22:18:44.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.111+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1699057600 wait complete. 2023-07-21T22:18:44.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3eb5ff700 1 Processor -- start 2023-07-21T22:18:44.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3eb5ff700 1 -- start start 2023-07-21T22:18:44.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3eb5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e40ffaf0 0x7fa3e4195780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3eb5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e4100ce0 0x7fa3e4195cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3eb5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4101670 0x7fa3e419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3eb5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e419d300 con 0x7fa3e4100ce0 2023-07-21T22:18:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3eb5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e419d440 con 0x7fa3e4101670 2023-07-21T22:18:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3eb5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3e419d5d0 con 0x7fa3e40ffaf0 2023-07-21T22:18:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3e8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e4100ce0 0x7fa3e4195cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3e8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e4100ce0 0x7fa3e4195cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37684/0 (socket says 172.21.15.151:37684) 2023-07-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.112+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/1594051251 learned_addr learned my addr 172.21.15.151:0/1594051251 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3e939b700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e40ffaf0 0x7fa3e4195780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/1594051251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e40ffaf0 msgr2=0x7fa3e4195780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e40ffaf0 0x7fa3e4195780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/1594051251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4101670 msgr2=0x7fa3e419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3e9b9c700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4101670 0x7fa3e419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4101670 0x7fa3e419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/1594051251 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d40095f0 con 0x7fa3e4100ce0 2023-07-21T22:18:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3e9b9c700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4101670 0x7fa3e419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e4100ce0 0x7fa3e4195cc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40098e0 tx=0x7fa3d4009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3da7fc700 1 -- 172.21.15.151:0/1594051251 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d401d070 con 0x7fa3e4100ce0 2023-07-21T22:18:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1594051251 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3e419d850 con 0x7fa3e4100ce0 2023-07-21T22:18:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3da7fc700 1 -- 172.21.15.151:0/1594051251 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3d400bed0 con 0x7fa3e4100ce0 2023-07-21T22:18:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3da7fc700 1 -- 172.21.15.151:0/1594051251 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d400f460 con 0x7fa3e4100ce0 2023-07-21T22:18:44.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.113+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1594051251 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3e419dc80 con 0x7fa3e4100ce0 2023-07-21T22:18:44.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.116+0000 7fa3da7fc700 1 -- 172.21.15.151:0/1594051251 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fa3d400ba40 con 0x7fa3e4100ce0 2023-07-21T22:18:44.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3fef3eb80 1 Processor -- start 2023-07-21T22:18:44.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3fef3eb80 1 -- start start 2023-07-21T22:18:44.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3da7fc700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a1150 0x7fa3d00a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3da7fc700 1 -- 172.21.15.151:0/1594051251 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa3d40cdeb0 con 0x7fa3e4100ce0 2023-07-21T22:18:44.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d907e0 0x563327d90bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 0x563327d8f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327d8fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3e9b9c700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a1150 0x7fa3d00a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327c94c60 con 0x563327d8f9c0 2023-07-21T22:18:44.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327ce79f0 con 0x563327d907e0 2023-07-21T22:18:44.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327ce0e80 con 0x563327d91150 2023-07-21T22:18:44.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3e9b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327d8fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3e9b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327d8fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37686/0 (socket says 172.21.15.151:37686) 2023-07-21T22:18:44.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.118+0000 7fa3e9b9c700 1 -- 172.21.15.151:0/4048116033 learned_addr learned my addr 172.21.15.151:0/4048116033 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3e939b700 1 --2- 172.21.15.151:0/4048116033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d907e0 0x563327d90bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/4048116033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 0x563327d8f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3e9b9c700 1 -- 172.21.15.151:0/4048116033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 msgr2=0x563327d8f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3e9b9c700 1 --2- 172.21.15.151:0/4048116033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 0x563327d8f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3e9b9c700 1 -- 172.21.15.151:0/4048116033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d907e0 msgr2=0x563327d90bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3e9b9c700 1 --2- 172.21.15.151:0/4048116033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d907e0 0x563327d90bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3e9b9c700 1 -- 172.21.15.151:0/4048116033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563327b0ed90 con 0x563327d8f9c0 2023-07-21T22:18:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3e9b9c700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a1150 0x7fa3d00a3600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007b30 tx=0x7fa3dc009340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3e9b9c700 1 --2- 172.21.15.151:0/4048116033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327d8fe40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0185e0 tx=0x7fa3dc01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fcf8fa708a8a3a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3cf7fe700 1 -- 172.21.15.151:0/4048116033 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc004db0 con 0x563327d8f9c0 2023-07-21T22:18:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3cf7fe700 1 -- 172.21.15.151:0/4048116033 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3dc009d60 con 0x563327d8f9c0 2023-07-21T22:18:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.119+0000 7fa3cf7fe700 1 -- 172.21.15.151:0/4048116033 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc005220 con 0x563327d8f9c0 2023-07-21T22:18:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.120+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/4048116033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 msgr2=0x563327d8fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.120+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/4048116033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327d8fe40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc0185e0 tx=0x7fa3dc01b000 comp rx=0 tx=0).stop 2023-07-21T22:18:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.120+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/4048116033 shutdown_connections 2023-07-21T22:18:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.120+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/4048116033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d907e0 0x563327d90bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.120+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/4048116033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327d8fe40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.120+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/4048116033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 0x563327d8f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.120+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/4048116033 >> 172.21.15.151:0/4048116033 conn(0x563327d84ea0 msgr2=0x563327d8a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.120+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/4048116033 shutdown_connections 2023-07-21T22:18:44.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.120+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/4048116033 wait complete. 2023-07-21T22:18:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.121+0000 7fa3fef3eb80 1 -- start start 2023-07-21T22:18:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.121+0000 7fa3fef3eb80 1 Processor -- start 2023-07-21T22:18:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 0x563327d9d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327d9d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d91150 0x563327da4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327c80a70 con 0x563327d907e0 2023-07-21T22:18:44.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327c80770 con 0x563327d91150 2023-07-21T22:18:44.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327b648d0 con 0x563327d8f9c0 2023-07-21T22:18:44.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3fef3eb80 10 client.0 _ll_register_callbacks cb 0x563327c7e710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:44.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327d9d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327d9d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37700/0 (socket says 172.21.15.151:37700) 2023-07-21T22:18:44.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/2645942101 learned_addr learned my addr 172.21.15.151:0/2645942101 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e939b700 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 0x563327d9d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e9b9c700 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d91150 0x563327da4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/2645942101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 msgr2=0x563327d9d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 0x563327d9d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/2645942101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d91150 msgr2=0x563327da4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d91150 0x563327da4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.122+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/2645942101 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3dc018770 con 0x563327d907e0 2023-07-21T22:18:44.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327d9d9d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4097820 tx=0x7fa3d4004320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b058d99a710bb83d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:18:44.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3ccff9700 1 -- 172.21.15.151:0/2645942101 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d409b320 con 0x563327d907e0 2023-07-21T22:18:44.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3ccff9700 1 -- 172.21.15.151:0/2645942101 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa3d40cbe40 con 0x563327d907e0 2023-07-21T22:18:44.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/2645942101 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563327cd9e60 con 0x563327d907e0 2023-07-21T22:18:44.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3ccff9700 1 -- 172.21.15.151:0/2645942101 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3d409f350 con 0x563327d907e0 2023-07-21T22:18:44.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3fef3eb80 10 client.15288 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:44.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/2645942101 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563327af7c10 con 0x563327d907e0 2023-07-21T22:18:44.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3ccff9700 1 -- 172.21.15.151:0/2645942101 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa3d40c9080 con 0x563327d907e0 2023-07-21T22:18:44.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.123+0000 7fa3ccff9700 1 -- 172.21.15.151:0/2645942101 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3d409a8a0 con 0x563327d907e0 2023-07-21T22:18:44.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.124+0000 7fa3fef3eb80 10 client.15288 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:44.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.124+0000 7fa3fef3eb80 10 client.15288 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-21T22:18:44.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.124+0000 7fa3fef3eb80 20 client.15288 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:44.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.124+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563327da8370 0x563327da7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.124+0000 7fa3fef3eb80 4 client.15288 mds_command: new command op to 24574 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:18:44.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.124+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/2645942101 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563327c9c000 con 0x563327da8370 2023-07-21T22:18:44.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.124+0000 7fa3e939b700 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563327da8370 0x563327da7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.125+0000 7fa3ccff9700 10 client.15288 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:18:44.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.125+0000 7fa3e939b700 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563327da8370 0x563327da7940 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1185889ce5822802 server_cookie=1a287f5a48e30cb in_seq=0 out_seq=0 2023-07-21T22:18:44.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.125+0000 7fa3ccff9700 1 -- 172.21.15.151:0/2645942101 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563327c9c000 con 0x563327da8370 2023-07-21T22:18:44.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.125+0000 7fa3ccff9700 10 client.15288 handle_command_reply: tid=0 2023-07-21T22:18:44.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.125+0000 7fa3fef3eb80 1 client.15288 shutdown 2023-07-21T22:18:44.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/2645942101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 msgr2=0x563327d9d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327d9d9d0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4097820 tx=0x7fa3d4004320 comp rx=0 tx=0).stop 2023-07-21T22:18:44.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/2645942101 shutdown_connections 2023-07-21T22:18:44.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563327da8370 0x563327da7940 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d91150 0x563327da4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 0x563327d9d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3ccff9700 0 client.15288 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:18:44.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/2645942101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327d9d9d0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/2645942101 >> 172.21.15.151:0/2645942101 conn(0x563327d84ea0 msgr2=0x563327d899b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/2645942101 shutdown_connections 2023-07-21T22:18:44.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/2645942101 wait complete. 2023-07-21T22:18:44.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.126+0000 7fa3fef3eb80 20 client.15288 trim_cache size 0 max 16384 2023-07-21T22:18:44.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.144+0000 7fa3fef3eb80 1 Processor -- start 2023-07-21T22:18:44.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.144+0000 7fa3fef3eb80 1 -- start start 2023-07-21T22:18:44.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.144+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 0x563327d9c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.144+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327da4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.144+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d91150 0x563327da52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.144+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327d9d060 con 0x563327d907e0 2023-07-21T22:18:44.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.144+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327c9f480 con 0x563327d91150 2023-07-21T22:18:44.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.144+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327d9e390 con 0x563327d8f9c0 2023-07-21T22:18:44.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327da4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327da4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37702/0 (socket says 172.21.15.151:37702) 2023-07-21T22:18:44.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/958359451 learned_addr learned my addr 172.21.15.151:0/958359451 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e939b700 1 --2- 172.21.15.151:0/958359451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 0x563327d9c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/958359451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 msgr2=0x563327d9c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/958359451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 0x563327d9c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/958359451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d91150 msgr2=0x563327da52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/958359451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d91150 0x563327da52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e8b9a700 1 -- 172.21.15.151:0/958359451 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563327b35200 con 0x563327d907e0 2023-07-21T22:18:44.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e939b700 1 --2- 172.21.15.151:0/958359451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 0x563327d9c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:44.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/958359451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327da4930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4097d40 tx=0x7fa3d409b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c50eddfd91e83e66 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3cffff700 1 -- 172.21.15.151:0/958359451 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40a33f0 con 0x563327d907e0 2023-07-21T22:18:44.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3cffff700 1 -- 172.21.15.151:0/958359451 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563327cd9e60 con 0x563327d907e0 2023-07-21T22:18:44.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.145+0000 7fa3cffff700 1 -- 172.21.15.151:0/958359451 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3d40a36e0 con 0x563327d907e0 2023-07-21T22:18:44.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/958359451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 msgr2=0x563327da4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/958359451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327da4930 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4097d40 tx=0x7fa3d409b8e0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/958359451 shutdown_connections 2023-07-21T22:18:44.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/958359451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d91150 0x563327da52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/958359451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d8f9c0 0x563327d9c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/958359451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d907e0 0x563327da4930 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/958359451 >> 172.21.15.151:0/958359451 conn(0x563327d84ea0 msgr2=0x563327db10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/958359451 shutdown_connections 2023-07-21T22:18:44.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/958359451 wait complete. 2023-07-21T22:18:44.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.146+0000 7fa3fef3eb80 1 -- start start 2023-07-21T22:18:44.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3fef3eb80 1 Processor -- start 2023-07-21T22:18:44.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327da1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d907e0 0x563327da1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3fef3eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 0x563327dfc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327da2520 con 0x563327d8f9c0 2023-07-21T22:18:44.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327dfc710 con 0x563327d907e0 2023-07-21T22:18:44.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3fef3eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563327dfc850 con 0x563327d91150 2023-07-21T22:18:44.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3fef3eb80 10 client.0 _ll_register_callbacks cb 0x7fa3d4086050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:44.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3e939b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327da1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3e939b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327da1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37706/0 (socket says 172.21.15.151:37706) 2023-07-21T22:18:44.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3e939b700 1 -- 172.21.15.151:0/714247782 learned_addr learned my addr 172.21.15.151:0/714247782 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3e9b9c700 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 0x563327dfc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3e939b700 1 -- 172.21.15.151:0/714247782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 msgr2=0x563327dfc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3e939b700 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 0x563327dfc1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3e939b700 1 -- 172.21.15.151:0/714247782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d907e0 msgr2=0x563327da1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3e939b700 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d907e0 0x563327da1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.147+0000 7fa3e939b700 1 -- 172.21.15.151:0/714247782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563327af7c10 con 0x563327d8f9c0 2023-07-21T22:18:44.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.148+0000 7fa3e939b700 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327da1900 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x563327b649e0 tx=0x7fa3e001fd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9830001f0df24d9c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.148+0000 7fa3ccff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:18:44.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.148+0000 7fa3ccff9700 1 -- 172.21.15.151:0/714247782 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3e001f240 con 0x563327d8f9c0 2023-07-21T22:18:44.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.148+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/714247782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563327c3a4a0 con 0x563327d8f9c0 2023-07-21T22:18:44.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.148+0000 7fa3ccff9700 1 -- 172.21.15.151:0/714247782 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa3e001f3a0 con 0x563327d8f9c0 2023-07-21T22:18:44.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.148+0000 7fa3ccff9700 1 -- 172.21.15.151:0/714247782 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa3e00142e0 con 0x563327d8f9c0 2023-07-21T22:18:44.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.148+0000 7fa3fef3eb80 10 client.15294 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:44.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.148+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/714247782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x563327b0d260 con 0x563327d8f9c0 2023-07-21T22:18:44.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.149+0000 7fa3ccff9700 1 -- 172.21.15.151:0/714247782 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563327c3a4a0 con 0x563327d8f9c0 2023-07-21T22:18:44.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.149+0000 7fa3ccff9700 1 -- 172.21.15.151:0/714247782 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa3e0028700 con 0x563327d8f9c0 2023-07-21T22:18:44.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.149+0000 7fa3fef3eb80 10 client.15294 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:44.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.149+0000 7fa3fef3eb80 10 client.15294 resolve_mds: resolved name 'i' to daemon mds.i 2023-07-21T22:18:44.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.149+0000 7fa3fef3eb80 20 client.15294 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:44.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.149+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563327e01640 0x563327dfdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.149+0000 7fa3fef3eb80 4 client.15294 mds_command: new command op to 24574 tid=0[{"prefix": "status"}] 2023-07-21T22:18:44.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.149+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/714247782 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563327b2ff20 con 0x563327e01640 2023-07-21T22:18:44.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.149+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563327e01640 0x563327dfdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.150+0000 7fa3e8b9a700 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563327e01640 0x563327dfdf90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3b776e4f4e2e671 server_cookie=8834c60d609c7fa9 in_seq=0 out_seq=0 2023-07-21T22:18:44.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.150+0000 7fa3ccff9700 10 client.15294 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:18:44.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.150+0000 7fa3ccff9700 1 -- 172.21.15.151:0/714247782 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x563327b2ff20 con 0x563327e01640 2023-07-21T22:18:44.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.150+0000 7fa3ccff9700 10 client.15294 handle_command_reply: tid=0 2023-07-21T22:18:44.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.150+0000 7fa3fef3eb80 1 client.15294 shutdown 2023-07-21T22:18:44.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.150+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/714247782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 msgr2=0x563327da1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.150+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327da1900 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x563327b649e0 tx=0x7fa3e001fd20 comp rx=0 tx=0).stop 2023-07-21T22:18:44.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/714247782 shutdown_connections 2023-07-21T22:18:44.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563327d91150 0x563327dfc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563327d8f9c0 0x563327da1900 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563327e01640 0x563327dfdf90 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3fef3eb80 1 --2- 172.21.15.151:0/714247782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563327d907e0 0x563327da1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3ccff9700 0 client.15294 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:18:44.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/714247782 >> 172.21.15.151:0/714247782 conn(0x563327d84ea0 msgr2=0x563327d899b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/714247782 shutdown_connections 2023-07-21T22:18:44.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3fef3eb80 1 -- 172.21.15.151:0/714247782 wait complete. 2023-07-21T22:18:44.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3fef3eb80 20 client.15294 trim_cache size 0 max 16384 2023-07-21T22:18:44.204 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:18:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:18:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 1, 2023-07-21T22:18:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 24574, 2023-07-21T22:18:44.204 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-07-21T22:18:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-07-21T22:18:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-07-21T22:18:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 90.968823090000001, 2023-07-21T22:18:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 23, 2023-07-21T22:18:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 87, 2023-07-21T22:18:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 85, 2023-07-21T22:18:44.205 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 110.062409176 2023-07-21T22:18:44.205 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:18:44.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a1150 msgr2=0x7fa3d00a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a1150 0x7fa3d00a3600 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc007b30 tx=0x7fa3dc009340 comp rx=0 tx=0).stop 2023-07-21T22:18:44.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e4100ce0 msgr2=0x7fa3e4195cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e4100ce0 0x7fa3e4195cc0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40098e0 tx=0x7fa3d4009570 comp rx=0 tx=0).stop 2023-07-21T22:18:44.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1594051251 shutdown_connections 2023-07-21T22:18:44.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa3d00a1150 0x7fa3d00a3600 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3e4101670 0x7fa3e419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa3e40ffaf0 0x7fa3e4195780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 --2- 172.21.15.151:0/1594051251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3e4100ce0 0x7fa3e4195cc0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.151+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1594051251 >> 172.21.15.151:0/1594051251 conn(0x7fa3e40fb130 msgr2=0x7fa3e40fd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.152+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1594051251 shutdown_connections 2023-07-21T22:18:44.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.152+0000 7fa3eb5ff700 1 -- 172.21.15.151:0/1594051251 wait complete. 2023-07-21T22:18:44.214 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-07-21T22:18:44.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.369+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2879710165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 msgr2=0x7f1a38107f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.369+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2879710165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 0x7f1a38107f20 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1a3000b0a0 tx=0x7f1a3000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.370+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2879710165 shutdown_connections 2023-07-21T22:18:44.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.370+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2879710165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 0x7f1a38107f20 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.370+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2879710165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a380ffae0 0x7f1a380ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.370+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2879710165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a38100cd0 0x7f1a38101120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.370+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2879710165 >> 172.21.15.151:0/2879710165 conn(0x7f1a380fb0e0 msgr2=0x7f1a380fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.370+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2879710165 shutdown_connections 2023-07-21T22:18:44.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.370+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2879710165 wait complete. 2023-07-21T22:18:44.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a3d3ff700 1 Processor -- start 2023-07-21T22:18:44.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a3d3ff700 1 -- start start 2023-07-21T22:18:44.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a3d3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a380ffae0 0x7f1a381958a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a3d3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a38100cd0 0x7f1a38195de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a3d3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 0x7f1a3819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a3d3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3819d420 con 0x7f1a38101660 2023-07-21T22:18:44.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a3d3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3819d560 con 0x7f1a38100cd0 2023-07-21T22:18:44.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a3d3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3819d6f0 con 0x7f1a380ffae0 2023-07-21T22:18:44.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 0x7f1a3819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a2ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a38100cd0 0x7f1a38195de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.371+0000 7f1a2ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a38100cd0 0x7f1a38195de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54774/0 (socket says 172.21.15.151:54774) 2023-07-21T22:18:44.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a2ffff700 1 -- 172.21.15.151:0/2117147084 learned_addr learned my addr 172.21.15.151:0/2117147084 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 0x7f1a3819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37720/0 (socket says 172.21.15.151:37720) 2023-07-21T22:18:44.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a380ffae0 0x7f1a381958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a377fe700 1 -- 172.21.15.151:0/2117147084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a380ffae0 msgr2=0x7f1a381958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a377fe700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a380ffae0 0x7f1a381958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a377fe700 1 -- 172.21.15.151:0/2117147084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a38100cd0 msgr2=0x7f1a38195de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a377fe700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a38100cd0 0x7f1a38195de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a377fe700 1 -- 172.21.15.151:0/2117147084 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a30009d00 con 0x7f1a38101660 2023-07-21T22:18:44.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a380ffae0 0x7f1a381958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:44.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a38100cd0 0x7f1a38195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:44.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a377fe700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 0x7f1a3819ce50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009fd0 tx=0x7f1a30007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a34ff9700 1 -- 172.21.15.151:0/2117147084 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3000e040 con 0x7f1a38101660 2023-07-21T22:18:44.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2117147084 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a38072740 con 0x7f1a38101660 2023-07-21T22:18:44.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a34ff9700 1 -- 172.21.15.151:0/2117147084 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a30020070 con 0x7f1a38101660 2023-07-21T22:18:44.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.372+0000 7f1a34ff9700 1 -- 172.21.15.151:0/2117147084 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a300276e0 con 0x7f1a38101660 2023-07-21T22:18:44.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.373+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2117147084 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a38072c00 con 0x7f1a38101660 2023-07-21T22:18:44.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.376+0000 7f1a34ff9700 1 -- 172.21.15.151:0/2117147084 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f1a3001c6c0 con 0x7f1a38101660 2023-07-21T22:18:44.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a50c92b80 1 Processor -- start 2023-07-21T22:18:44.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a50c92b80 1 -- start start 2023-07-21T22:18:44.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a34ff9700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f1a240a1150 0x7f1a240a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac27e0 0x562ff1ac2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ac13e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a34ff9700 1 -- 172.21.15.151:0/2117147084 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1a30022070 con 0x7f1a38101660 2023-07-21T22:18:44.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 0x562ff1ac1e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff19c6c60 con 0x562ff1ac3150 2023-07-21T22:18:44.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff1a199f0 con 0x562ff1ac27e0 2023-07-21T22:18:44.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.377+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff1a12e80 con 0x562ff1ac19c0 2023-07-21T22:18:44.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f1a240a1150 0x7f1a240a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a2ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ac13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a2ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ac13e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37736/0 (socket says 172.21.15.151:37736) 2023-07-21T22:18:44.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a36ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac27e0 0x562ff1ac2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a2ffff700 1 -- 172.21.15.151:0/1903302315 learned_addr learned my addr 172.21.15.151:0/1903302315 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a377fe700 1 --2- 172.21.15.151:0/1903302315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 0x562ff1ac1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a36ffd700 1 -- 172.21.15.151:0/1903302315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 msgr2=0x562ff1ac1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/1903302315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 0x562ff1ac1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a36ffd700 1 -- 172.21.15.151:0/1903302315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 msgr2=0x562ff1ac13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/1903302315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ac13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a36ffd700 1 -- 172.21.15.151:0/1903302315 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ff1840d90 con 0x562ff1ac27e0 2023-07-21T22:18:44.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/1903302315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ac13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:44.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.378+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f1a240a1150 0x7f1a240a3600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1a20011f10 tx=0x7f1a20011510 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.379+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/1903302315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac27e0 0x562ff1ac2bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009c90 tx=0x7f1a280113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b28e1c205594ea7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.379+0000 7f1a2d7fa700 1 -- 172.21.15.151:0/1903302315 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a28011c00 con 0x562ff1ac27e0 2023-07-21T22:18:44.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.379+0000 7f1a2d7fa700 1 -- 172.21.15.151:0/1903302315 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a28011d60 con 0x562ff1ac27e0 2023-07-21T22:18:44.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.379+0000 7f1a2d7fa700 1 -- 172.21.15.151:0/1903302315 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a28005590 con 0x562ff1ac27e0 2023-07-21T22:18:44.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1903302315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac27e0 msgr2=0x562ff1ac2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1903302315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac27e0 0x562ff1ac2bf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009c90 tx=0x7f1a280113e0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1903302315 shutdown_connections 2023-07-21T22:18:44.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1903302315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac27e0 0x562ff1ac2bf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1903302315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 0x562ff1ac1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1903302315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ac13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1903302315 >> 172.21.15.151:0/1903302315 conn(0x562ff1ab6ea0 msgr2=0x562ff1abc310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1903302315 shutdown_connections 2023-07-21T22:18:44.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1903302315 wait complete. 2023-07-21T22:18:44.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.380+0000 7f1a50c92b80 1 -- start start 2023-07-21T22:18:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a50c92b80 1 Processor -- start 2023-07-21T22:18:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac19c0 0x562ff1acb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 0x562ff1acb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ad25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff19b2a70 con 0x562ff1ac3150 2023-07-21T22:18:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff19b2770 con 0x562ff1ac19c0 2023-07-21T22:18:44.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff18968d0 con 0x562ff1ac27e0 2023-07-21T22:18:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a50c92b80 10 client.0 _ll_register_callbacks cb 0x562ff19b0710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ad25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ad25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37738/0 (socket says 172.21.15.151:37738) 2023-07-21T22:18:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a377fe700 1 -- 172.21.15.151:0/1440726099 learned_addr learned my addr 172.21.15.151:0/1440726099 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.381+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac19c0 0x562ff1acb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 0x562ff1acb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a377fe700 1 -- 172.21.15.151:0/1440726099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 msgr2=0x562ff1acb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a377fe700 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 0x562ff1acb5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a377fe700 1 -- 172.21.15.151:0/1440726099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac19c0 msgr2=0x562ff1acb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a377fe700 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac19c0 0x562ff1acb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a377fe700 1 -- 172.21.15.151:0/1440726099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a20019040 con 0x562ff1ac3150 2023-07-21T22:18:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 0x562ff1acb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a377fe700 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ad25e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1a300cf3d0 tx=0x7f1a3000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55baa8374c0dba9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a1e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:18:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/1440726099 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a3009ed70 con 0x562ff1ac3150 2023-07-21T22:18:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/1440726099 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1a300a2da0 con 0x562ff1ac3150 2023-07-21T22:18:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1440726099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562ff196c4a0 con 0x562ff1ac3150 2023-07-21T22:18:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/1440726099 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a300a7130 con 0x562ff1ac3150 2023-07-21T22:18:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a50c92b80 10 client.15306 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.382+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1440726099 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f1a280098f0 con 0x562ff1ac3150 2023-07-21T22:18:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.383+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/1440726099 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a300cd080 con 0x562ff1ac3150 2023-07-21T22:18:44.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.383+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/1440726099 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1a300cef80 con 0x562ff1ac3150 2023-07-21T22:18:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.383+0000 7f1a50c92b80 10 client.15306 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.383+0000 7f1a50c92b80 10 client.15306 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-21T22:18:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.383+0000 7f1a50c92b80 20 client.15306 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.383+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562ff1ad60a0 0x562ff1ad5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.383+0000 7f1a50c92b80 4 client.15306 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:18:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.383+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1440726099 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562ff1a0be60 con 0x562ff1ad60a0 2023-07-21T22:18:44.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.383+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562ff1ad60a0 0x562ff1ad5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.384+0000 7f1a1e7fc700 10 client.15306 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:18:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.384+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562ff1ad60a0 0x562ff1ad5560 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebc4404c93a57f96 server_cookie=429c8c035ce74cca in_seq=0 out_seq=0 2023-07-21T22:18:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/1440726099 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562ff1a0be60 con 0x562ff1ad60a0 2023-07-21T22:18:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a1e7fc700 10 client.15306 handle_command_reply: tid=0 2023-07-21T22:18:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 client.15306 shutdown 2023-07-21T22:18:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1440726099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 msgr2=0x562ff1ad25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ad25e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1a300cf3d0 tx=0x7f1a3000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1440726099 shutdown_connections 2023-07-21T22:18:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562ff1ad60a0 0x562ff1ad5560 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac19c0 0x562ff1acb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac3150 0x562ff1ad25e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a1e7fc700 0 client.15306 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:18:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1440726099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 0x562ff1acb5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1440726099 >> 172.21.15.151:0/1440726099 conn(0x562ff1ab6ea0 msgr2=0x562ff1abb9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1440726099 shutdown_connections 2023-07-21T22:18:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1440726099 wait complete. 2023-07-21T22:18:44.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.385+0000 7f1a50c92b80 20 client.15306 trim_cache size 0 max 16384 2023-07-21T22:18:44.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.403+0000 7f1a50c92b80 1 Processor -- start 2023-07-21T22:18:44.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.403+0000 7f1a50c92b80 1 -- start start 2023-07-21T22:18:44.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 0x562ff1ac8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac27e0 0x562ff1ac9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad25a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff1ab4050 con 0x562ff1ac27e0 2023-07-21T22:18:44.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff1a0be60 con 0x562ff1ac3150 2023-07-21T22:18:44.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff19e1790 con 0x562ff1ac19c0 2023-07-21T22:18:44.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a2ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac27e0 0x562ff1ac9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a36ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 0x562ff1ac8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a377fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54796/0 (socket says 172.21.15.151:54796) 2023-07-21T22:18:44.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a377fe700 1 -- 172.21.15.151:0/1494769753 learned_addr learned my addr 172.21.15.151:0/1494769753 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a2ffff700 1 -- 172.21.15.151:0/1494769753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 msgr2=0x562ff1ac8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/1494769753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 0x562ff1ac8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a2ffff700 1 -- 172.21.15.151:0/1494769753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 msgr2=0x562ff1ad25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/1494769753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a2ffff700 1 -- 172.21.15.151:0/1494769753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562ff1829c10 con 0x562ff1ac27e0 2023-07-21T22:18:44.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a377fe700 1 --2- 172.21.15.151:0/1494769753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:44.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.404+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/1494769753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 0x562ff1ac8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:44.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.405+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/1494769753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac27e0 0x562ff1ac9420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000fa30 tx=0x7f1a200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=614e715d44b107f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.405+0000 7f1a2dffb700 1 -- 172.21.15.151:0/1494769753 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20016040 con 0x562ff1ac27e0 2023-07-21T22:18:44.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.405+0000 7f1a2dffb700 1 -- 172.21.15.151:0/1494769753 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a2001ecf0 con 0x562ff1ac27e0 2023-07-21T22:18:44.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.405+0000 7f1a2dffb700 1 -- 172.21.15.151:0/1494769753 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2002aaf0 con 0x562ff1ac27e0 2023-07-21T22:18:44.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1494769753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac27e0 msgr2=0x562ff1ac9420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1494769753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac27e0 0x562ff1ac9420 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1a2000fa30 tx=0x7f1a200047c0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1494769753 shutdown_connections 2023-07-21T22:18:44.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1494769753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1494769753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac19c0 0x562ff1ac8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/1494769753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac27e0 0x562ff1ac9420 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1494769753 >> 172.21.15.151:0/1494769753 conn(0x562ff1ab6ea0 msgr2=0x562ff1ad5560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1494769753 shutdown_connections 2023-07-21T22:18:44.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 -- 172.21.15.151:0/1494769753 wait complete. 2023-07-21T22:18:44.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 -- start start 2023-07-21T22:18:44.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.406+0000 7f1a50c92b80 1 Processor -- start 2023-07-21T22:18:44.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac19c0 0x562ff1acda50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 0x562ff1acdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a50c92b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff1ad14f0 con 0x562ff1ac19c0 2023-07-21T22:18:44.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff1ad1660 con 0x562ff1ac3150 2023-07-21T22:18:44.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a50c92b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562ff1ad1820 con 0x562ff1ac27e0 2023-07-21T22:18:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a50c92b80 10 client.0 _ll_register_callbacks cb 0x7f1a3009b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:18:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a36ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac19c0 0x562ff1acda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a36ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac19c0 0x562ff1acda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37760/0 (socket says 172.21.15.151:37760) 2023-07-21T22:18:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a36ffd700 1 -- 172.21.15.151:0/2243967143 learned_addr learned my addr 172.21.15.151:0/2243967143 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 0x562ff1acdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a377fe700 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a36ffd700 1 -- 172.21.15.151:0/2243967143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 msgr2=0x562ff1acdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 0x562ff1acdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a36ffd700 1 -- 172.21.15.151:0/2243967143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 msgr2=0x562ff1ad0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:18:44.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a36ffd700 1 -- 172.21.15.151:0/2243967143 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a2801e040 con 0x562ff1ac19c0 2023-07-21T22:18:44.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.407+0000 7f1a377fe700 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:44.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.408+0000 7f1a36ffd700 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac19c0 0x562ff1acda50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1a28011730 tx=0x7f1a28011f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3629ac4c7b37ae78 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:44.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.408+0000 7f1a1e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:18:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.408+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/2243967143 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a28005240 con 0x562ff1ac19c0 2023-07-21T22:18:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.408+0000 7f1a50c92b80 1 -- 172.21.15.151:0/2243967143 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1a28011d60 con 0x562ff1ac19c0 2023-07-21T22:18:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.408+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/2243967143 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f1a280053a0 con 0x562ff1ac19c0 2023-07-21T22:18:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.408+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/2243967143 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1a28005560 con 0x562ff1ac19c0 2023-07-21T22:18:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.408+0000 7f1a50c92b80 10 client.15312 fetch_fsmap learned FSMap version 23 2023-07-21T22:18:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.408+0000 7f1a50c92b80 1 -- 172.21.15.151:0/2243967143 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x7f1a280098f0 con 0x562ff1ac19c0 2023-07-21T22:18:44.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.408+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/2243967143 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1a28011d60 con 0x562ff1ac19c0 2023-07-21T22:18:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.409+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/2243967143 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f1a28038050 con 0x562ff1ac19c0 2023-07-21T22:18:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.409+0000 7f1a50c92b80 10 client.15312 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:18:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.409+0000 7f1a50c92b80 10 client.15312 resolve_mds: resolved name 'b' to daemon mds.b 2023-07-21T22:18:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.409+0000 7f1a50c92b80 20 client.15312 populate_metadata read hostname 'smithi151' 2023-07-21T22:18:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.409+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562ff1b2f9f0 0x562ff1b2c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.409+0000 7f1a50c92b80 4 client.15312 mds_command: new command op to 24599 tid=0[{"prefix": "status"}] 2023-07-21T22:18:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.409+0000 7f1a50c92b80 1 -- 172.21.15.151:0/2243967143 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562ff19ce000 con 0x562ff1b2f9f0 2023-07-21T22:18:44.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.409+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562ff1b2f9f0 0x562ff1b2c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:44.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a2ffff700 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562ff1b2f9f0 0x562ff1b2c340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4753a8166d6985a server_cookie=4eae0b01cdf28be2 in_seq=0 out_seq=0 2023-07-21T22:18:44.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a1e7fc700 10 client.15312 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:18:44.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a1e7fc700 1 -- 172.21.15.151:0/2243967143 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x562ff19ce000 con 0x562ff1b2f9f0 2023-07-21T22:18:44.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a1e7fc700 10 client.15312 handle_command_reply: tid=0 2023-07-21T22:18:44.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 client.15312 shutdown 2023-07-21T22:18:44.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 -- 172.21.15.151:0/2243967143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac19c0 msgr2=0x562ff1acda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac19c0 0x562ff1acda50 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1a28011730 tx=0x7f1a28011f80 comp rx=0 tx=0).stop 2023-07-21T22:18:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 -- 172.21.15.151:0/2243967143 shutdown_connections 2023-07-21T22:18:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562ff1b2f9f0 0x562ff1b2c340 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562ff1ac3150 0x562ff1ad0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562ff1ac19c0 0x562ff1acda50 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a1e7fc700 0 client.15312 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:18:44.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 --2- 172.21.15.151:0/2243967143 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562ff1ac27e0 0x562ff1acdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 -- 172.21.15.151:0/2243967143 >> 172.21.15.151:0/2243967143 conn(0x562ff1ab6ea0 msgr2=0x562ff1ac8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 -- 172.21.15.151:0/2243967143 shutdown_connections 2023-07-21T22:18:44.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.410+0000 7f1a50c92b80 1 -- 172.21.15.151:0/2243967143 wait complete. 2023-07-21T22:18:44.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a50c92b80 20 client.15312 trim_cache size 0 max 16384 2023-07-21T22:18:44.465 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:18:44.465 INFO:teuthology.orchestra.run.smithi151.stdout: "cluster_fsid": "f5fce3a4-2812-11ee-9b34-001a4aab830c", 2023-07-21T22:18:44.465 INFO:teuthology.orchestra.run.smithi151.stdout: "whoami": 0, 2023-07-21T22:18:44.465 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 24599, 2023-07-21T22:18:44.465 INFO:teuthology.orchestra.run.smithi151.stdout: "want_state": "up:active", 2023-07-21T22:18:44.465 INFO:teuthology.orchestra.run.smithi151.stdout: "state": "up:active", 2023-07-21T22:18:44.466 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs", 2023-07-21T22:18:44.466 INFO:teuthology.orchestra.run.smithi151.stdout: "rank_uptime": 94.552945152999996, 2023-07-21T22:18:44.466 INFO:teuthology.orchestra.run.smithi151.stdout: "mdsmap_epoch": 23, 2023-07-21T22:18:44.466 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch": 87, 2023-07-21T22:18:44.466 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_epoch_barrier": 85, 2023-07-21T22:18:44.466 INFO:teuthology.orchestra.run.smithi151.stdout: "uptime": 100.797383119 2023-07-21T22:18:44.466 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:18:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f1a240a1150 msgr2=0x7f1a240a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f1a240a1150 0x7f1a240a3600 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1a20011f10 tx=0x7f1a20011510 comp rx=0 tx=0).stop 2023-07-21T22:18:44.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 msgr2=0x7f1a3819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:44.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 0x7f1a3819ce50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f1a30009fd0 tx=0x7f1a30007870 comp rx=0 tx=0).stop 2023-07-21T22:18:44.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2117147084 shutdown_connections 2023-07-21T22:18:44.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f1a240a1150 0x7f1a240a3600 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a38101660 0x7f1a3819ce50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a380ffae0 0x7f1a381958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 --2- 172.21.15.151:0/2117147084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a38100cd0 0x7f1a38195de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:44.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2117147084 >> 172.21.15.151:0/2117147084 conn(0x7f1a380fb0e0 msgr2=0x7f1a381041c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:44.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2117147084 shutdown_connections 2023-07-21T22:18:44.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:44.411+0000 7f1a3d3ff700 1 -- 172.21.15.151:0/2117147084 wait complete. 2023-07-21T22:18:44.471 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:44 smithi151 ceph-mon[95510]: pgmap v347: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:44.471 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:44 smithi151 ceph-mon[95510]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-07-21T22:18:44.471 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:44 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/940357633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:44.473 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-07-21T22:18:44.500 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-07-21T22:18:44.501 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-07-21T22:18:44.501 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-07-21T22:18:44.501 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-07-21T22:18:44.502 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2023-07-21T22:18:44.502 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2023-07-21T22:18:44.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:44.502 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-07-21T22:18:44.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:44.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-07-21T22:18:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:44 smithi187 ceph-mon[96918]: pgmap v347: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:44 smithi187 ceph-mon[96918]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-07-21T22:18:44.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:44 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/940357633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:44.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:44 smithi195 ceph-mon[97365]: pgmap v347: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T22:18:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:44 smithi195 ceph-mon[97365]: mgrmap e18: x(active, since 9m), standbys: z, y 2023-07-21T22:18:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:44 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/940357633' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:44.660 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-07-21T22:18:44.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T22:18:44.663 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-07-21T22:18:44.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph fs ls 2023-07-21T22:18:45.383 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T22:18:46.596 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:46 smithi151 ceph-mon[95510]: pgmap v348: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2023-07-21T22:18:46.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:46 smithi187 ceph-mon[96918]: pgmap v348: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2023-07-21T22:18:46.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:46 smithi195 ceph-mon[97365]: pgmap v348: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 7 op/s 2023-07-21T22:18:47.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.170+0000 7f41ce54f700 1 -- 172.21.15.151:0/2843315277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c8104ea0 msgr2=0x7f41c810ca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.170+0000 7f41ce54f700 1 --2- 172.21.15.151:0/2843315277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c8104ea0 0x7f41c810ca20 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f41c000b0d0 tx=0x7f41c000b3e0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.170+0000 7f41ce54f700 1 -- 172.21.15.151:0/2843315277 shutdown_connections 2023-07-21T22:18:47.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.170+0000 7f41ce54f700 1 --2- 172.21.15.151:0/2843315277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c8104ea0 0x7f41c810ca20 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.170+0000 7f41ce54f700 1 --2- 172.21.15.151:0/2843315277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41c80ffe00 0x7f41c81001d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.170+0000 7f41ce54f700 1 --2- 172.21.15.151:0/2843315277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41c81007a0 0x7f41c8104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.170+0000 7f41ce54f700 1 -- 172.21.15.151:0/2843315277 >> 172.21.15.151:0/2843315277 conn(0x7f41c80fb660 msgr2=0x7f41c80fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.170+0000 7f41ce54f700 1 -- 172.21.15.151:0/2843315277 shutdown_connections 2023-07-21T22:18:47.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.170+0000 7f41ce54f700 1 -- 172.21.15.151:0/2843315277 wait complete. 2023-07-21T22:18:47.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.171+0000 7f41ce54f700 1 Processor -- start 2023-07-21T22:18:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.171+0000 7f41ce54f700 1 -- start start 2023-07-21T22:18:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41ce54f700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c80ffe00 0x7f41c8197f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41ce54f700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41c81007a0 0x7f41c81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41ce54f700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41c8104ea0 0x7f41c819c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41ce54f700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c819cf40 con 0x7f41c80ffe00 2023-07-21T22:18:47.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41ce54f700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c819d0b0 con 0x7f41c81007a0 2023-07-21T22:18:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41ce54f700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c819d270 con 0x7f41c8104ea0 2023-07-21T22:18:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c80ffe00 0x7f41c8197f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c80ffe00 0x7f41c8197f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40228/0 (socket says 172.21.15.151:40228) 2023-07-21T22:18:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41c7fff700 1 -- 172.21.15.151:0/1482639670 learned_addr learned my addr 172.21.15.151:0/1482639670 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41ccaec700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41c8104ea0 0x7f41c819c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41c77fe700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41c81007a0 0x7f41c81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41c7fff700 1 -- 172.21.15.151:0/1482639670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41c8104ea0 msgr2=0x7f41c819c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41c7fff700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41c8104ea0 0x7f41c819c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41c7fff700 1 -- 172.21.15.151:0/1482639670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41c81007a0 msgr2=0x7f41c81984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41c7fff700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41c81007a0 0x7f41c81984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.172+0000 7f41c7fff700 1 -- 172.21.15.151:0/1482639670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c0009d00 con 0x7f41c80ffe00 2023-07-21T22:18:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.173+0000 7f41c77fe700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41c81007a0 0x7f41c81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.173+0000 7f41c7fff700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c80ffe00 0x7f41c8197f80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f41b800b530 tx=0x7f41b800b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.173+0000 7f41c57fa700 1 -- 172.21.15.151:0/1482639670 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b8011830 con 0x7f41c80ffe00 2023-07-21T22:18:47.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.173+0000 7f41c57fa700 1 -- 172.21.15.151:0/1482639670 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41b8011e20 con 0x7f41c80ffe00 2023-07-21T22:18:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.173+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c819d550 con 0x7f41c80ffe00 2023-07-21T22:18:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.173+0000 7f41c57fa700 1 -- 172.21.15.151:0/1482639670 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b800f2e0 con 0x7f41c80ffe00 2023-07-21T22:18:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.173+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c81a4db0 con 0x7f41c80ffe00 2023-07-21T22:18:47.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.174+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c804e210 con 0x7f41c80ffe00 2023-07-21T22:18:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.176+0000 7f41c57fa700 1 -- 172.21.15.151:0/1482639670 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f41b8011990 con 0x7f41c80ffe00 2023-07-21T22:18:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.178+0000 7f41c57fa700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f41b00a11d0 0x7f41b00a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.178+0000 7f41c57fa700 1 -- 172.21.15.151:0/1482639670 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f41b80cc3f0 con 0x7f41c80ffe00 2023-07-21T22:18:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.178+0000 7f41c77fe700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f41b00a11d0 0x7f41b00a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:47.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.178+0000 7f41c77fe700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f41b00a11d0 0x7f41b00a3680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f41bc005950 tx=0x7f41bc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:47.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.182+0000 7f41c57fa700 1 -- 172.21.15.151:0/1482639670 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f41b8095b10 con 0x7f41c80ffe00 2023-07-21T22:18:47.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.424+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f41c81a4fa0 con 0x7f41c80ffe00 2023-07-21T22:18:47.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.425+0000 7f41c57fa700 1 -- 172.21.15.151:0/1482639670 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) v1 ==== 53+0+73 (secure 0 0 0) 0x7f41b8099130 con 0x7f41c80ffe00 2023-07-21T22:18:47.470 INFO:teuthology.orchestra.run.smithi151.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-07-21T22:18:47.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f41b00a11d0 msgr2=0x7f41b00a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f41b00a11d0 0x7f41b00a3680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f41bc005950 tx=0x7f41bc0058e0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c80ffe00 msgr2=0x7f41c8197f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:47.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c80ffe00 0x7f41c8197f80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f41b800b530 tx=0x7f41b800b840 comp rx=0 tx=0).stop 2023-07-21T22:18:47.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 shutdown_connections 2023-07-21T22:18:47.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f41b00a11d0 0x7f41b00a3680 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41c8104ea0 0x7f41c819c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41c80ffe00 0x7f41c8197f80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 --2- 172.21.15.151:0/1482639670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f41c81007a0 0x7f41c81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:47.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 >> 172.21.15.151:0/1482639670 conn(0x7f41c80fb660 msgr2=0x7f41c80fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:47.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.427+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 shutdown_connections 2023-07-21T22:18:47.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:47.428+0000 7f41ce54f700 1 -- 172.21.15.151:0/1482639670 wait complete. 2023-07-21T22:18:47.968 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-07-21T22:18:47.968 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-07-21T22:18:47.968 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-07-21T22:18:47.969 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-07-21T22:18:47.969 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2023-07-21T22:18:47.969 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-07-21T22:18:47.969 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-07-21T22:18:47.969 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-07-21T22:18:47.970 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2023-07-21T22:18:47.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:47.970 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-07-21T22:18:48.015 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-07-21T22:18:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-07-21T22:18:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-07-21T22:18:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:18:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-07-21T22:18:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:18:48.016 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T22:18:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-07-21T22:18:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-07-21T22:18:48.016 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T22:18:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-07-21T22:18:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-07-21T22:18:48.017 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-07-21T22:18:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:18:48.017 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-07-21T22:18:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-07-21T22:18:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-07-21T22:18:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 41496sec preferred_lft 41496sec 2023-07-21T22:18:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::2ec:32d6:a911:8a1a/64 scope link noprefixroute 2023-07-21T22:18:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-07-21T22:18:48.018 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-07-21T22:18:48.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:48.019 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-07-21T22:18:48.019 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-07-21T22:18:48.019 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-07-21T22:18:48.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-07-21T22:18:48.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-07-21T22:18:48.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-07-21T22:18:48.020 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-07-21T22:18:48.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:48.478 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-07-21T22:18:48.546 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:48 smithi151 ceph-mon[95510]: pgmap v349: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2023-07-21T22:18:48.546 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:48 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1482639670' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-21T22:18:48.551 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-07-21T22:18:48.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:48.554 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-07-21T22:18:48.621 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-07-21T22:18:48.621 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-07-21T22:18:48.621 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-07-21T22:18:48.621 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-07-21T22:18:48.621 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-07-21T22:18:48.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:48.622 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-07-21T22:18:48.622 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-07-21T22:18:48.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-07-21T22:18:48.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-07-21T22:18:48.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-07-21T22:18:48.623 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-07-21T22:18:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:48 smithi187 ceph-mon[96918]: pgmap v349: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2023-07-21T22:18:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:48 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1482639670' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-21T22:18:48.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:48 smithi195 ceph-mon[97365]: pgmap v349: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 426 B/s wr, 5 op/s 2023-07-21T22:18:48.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:48 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1482639670' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2023-07-21T22:18:49.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:49.346 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-07-21T22:18:49.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:49.391 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-07-21T22:18:49.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:49.474 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-07-21T22:18:49.475 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-07-21T22:18:49.475 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--tmp-cephfs 2023-07-21T22:18:49.475 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--tmp-cephfs 0 2023-07-21T22:18:49.475 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-07-21T22:18:49.660 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2023-07-21T22:18:49.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:49.661 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-07-21T22:18:49.661 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-07-21T22:18:49.662 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2023-07-21T22:18:49.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-07-21T22:18:49.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2023-07-21T22:18:49.664 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2023-07-21T22:18:49.664 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2023-07-21T22:18:49.665 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-07-21T22:18:49.973 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:49.974 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-07-21T22:18:49.975 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-07-21T22:18:49.975 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-07-21T22:18:49.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-07-21T22:18:49.976 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-07-21T22:18:50.151 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2023-07-21T22:18:50.152 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:18:50.152 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /tmp/cephfs 2023-07-21T22:18:50.195 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/tmp/cephfs' 2023-07-21T22:18:50.196 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-07-21T22:18:50.196 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /tmp/cephfs 2023-07-21T22:18:50.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-07-21T22:18:50.380 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:50 smithi151 ceph-mon[95510]: pgmap v350: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:18:50.391 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:18:50.391 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:18:50.459 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:18:50.462 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:18:50.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:50.463 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-07-21T22:18:50.506 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-07-21T22:18:50.507 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2023-07-21T22:18:50.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-07-21T22:18:50.623 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:18:50.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:18:50.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:50 smithi187 ceph-mon[96918]: pgmap v350: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:18:50.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:50 smithi195 ceph-mon[97365]: pgmap v350: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:18:50.693 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:18:50.695 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:18:50.696 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:50.696 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-07-21T22:18:50.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi151.stderr:2023-07-21T22:18:50.705+0000 7f4f058f75c0 -1 init, newargv = 0x55dd078a8320 newargc=17 2023-07-21T22:18:50.750 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi151.stderr:ceph-fuse[143827]: starting ceph client 2023-07-21T22:18:50.773 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi151.stderr:ceph-fuse[143827]: starting fuse 2023-07-21T22:18:51.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo modprobe fuse 2023-07-21T22:18:51.921 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-07-21T22:18:51.921 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-07-21T22:18:51.991 INFO:teuthology.orchestra.run.smithi151.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-07-21T22:18:51.993 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-07-21T22:18:51.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:51.995 DEBUG:teuthology.orchestra.run.smithi151:> ls /sys/fs/fuse/connections 2023-07-21T22:18:52.040 INFO:teuthology.orchestra.run.smithi151.stdout:121 2023-07-21T22:18:52.040 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [121] 2023-07-21T22:18:52.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-07-21T22:18:52.042 DEBUG:teuthology.orchestra.run.smithi151:> import glob 2023-07-21T22:18:52.042 DEBUG:teuthology.orchestra.run.smithi151:> import re 2023-07-21T22:18:52.043 DEBUG:teuthology.orchestra.run.smithi151:> import os 2023-07-21T22:18:52.043 DEBUG:teuthology.orchestra.run.smithi151:> import subprocess 2023-07-21T22:18:52.044 DEBUG:teuthology.orchestra.run.smithi151:> 2023-07-21T22:18:52.044 DEBUG:teuthology.orchestra.run.smithi151:> def _find_admin_socket(client_name): 2023-07-21T22:18:52.044 DEBUG:teuthology.orchestra.run.smithi151:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-07-21T22:18:52.044 DEBUG:teuthology.orchestra.run.smithi151:> files = glob.glob(asok_path) 2023-07-21T22:18:52.045 DEBUG:teuthology.orchestra.run.smithi151:> mountpoint = "/tmp/cephfs" 2023-07-21T22:18:52.045 DEBUG:teuthology.orchestra.run.smithi151:> 2023-07-21T22:18:52.045 DEBUG:teuthology.orchestra.run.smithi151:> # Given a non-glob path, it better be there 2023-07-21T22:18:52.045 DEBUG:teuthology.orchestra.run.smithi151:> if "*" not in asok_path: 2023-07-21T22:18:52.046 DEBUG:teuthology.orchestra.run.smithi151:> assert(len(files) == 1) 2023-07-21T22:18:52.046 DEBUG:teuthology.orchestra.run.smithi151:> return files[0] 2023-07-21T22:18:52.046 DEBUG:teuthology.orchestra.run.smithi151:> 2023-07-21T22:18:52.046 DEBUG:teuthology.orchestra.run.smithi151:> for f in files: 2023-07-21T22:18:52.047 DEBUG:teuthology.orchestra.run.smithi151:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-07-21T22:18:52.047 DEBUG:teuthology.orchestra.run.smithi151:> if os.path.exists("/proc/{0}".format(pid)): 2023-07-21T22:18:52.047 DEBUG:teuthology.orchestra.run.smithi151:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-07-21T22:18:52.047 DEBUG:teuthology.orchestra.run.smithi151:> contents = proc_f.read() 2023-07-21T22:18:52.048 DEBUG:teuthology.orchestra.run.smithi151:> if mountpoint in contents: 2023-07-21T22:18:52.048 DEBUG:teuthology.orchestra.run.smithi151:> return f 2023-07-21T22:18:52.048 DEBUG:teuthology.orchestra.run.smithi151:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-07-21T22:18:52.049 DEBUG:teuthology.orchestra.run.smithi151:> 2023-07-21T22:18:52.049 DEBUG:teuthology.orchestra.run.smithi151:> print(_find_admin_socket("client.0")) 2023-07-21T22:18:52.049 DEBUG:teuthology.orchestra.run.smithi151:> ' 2023-07-21T22:18:52.224 INFO:teuthology.orchestra.run.smithi151.stdout:/var/run/ceph/ceph-client.0.143827.asok 2023-07-21T22:18:52.401 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.143827.asok 2023-07-21T22:18:52.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:52.402 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.143827.asok status 2023-07-21T22:18:52.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:52 smithi187 ceph-mon[96918]: pgmap v351: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:18:52.629 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:18:52.629 INFO:teuthology.orchestra.run.smithi151.stdout: "metadata": { 2023-07-21T22:18:52.629 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_sha1": "bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea", 2023-07-21T22:18:52.630 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev)", 2023-07-21T22:18:52.630 INFO:teuthology.orchestra.run.smithi151.stdout: "entity_id": "0", 2023-07-21T22:18:52.630 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": "smithi151", 2023-07-21T22:18:52.630 INFO:teuthology.orchestra.run.smithi151.stdout: "mount_point": "/tmp/cephfs", 2023-07-21T22:18:52.630 INFO:teuthology.orchestra.run.smithi151.stdout: "pid": "143827", 2023-07-21T22:18:52.630 INFO:teuthology.orchestra.run.smithi151.stdout: "root": "/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935" 2023-07-21T22:18:52.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T22:18:52.631 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_count": 0, 2023-07-21T22:18:52.631 INFO:teuthology.orchestra.run.smithi151.stdout: "dentry_pinned_count": 0, 2023-07-21T22:18:52.631 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 15324, 2023-07-21T22:18:52.631 INFO:teuthology.orchestra.run.smithi151.stdout: "inst": { 2023-07-21T22:18:52.631 INFO:teuthology.orchestra.run.smithi151.stdout: "name": { 2023-07-21T22:18:52.631 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "client", 2023-07-21T22:18:52.631 INFO:teuthology.orchestra.run.smithi151.stdout: "num": 15324 2023-07-21T22:18:52.631 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T22:18:52.632 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-07-21T22:18:52.632 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-07-21T22:18:52.632 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-07-21T22:18:52.632 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 4156266855 2023-07-21T22:18:52.632 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:18:52.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T22:18:52.632 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": { 2023-07-21T22:18:52.632 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-07-21T22:18:52.633 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-07-21T22:18:52.633 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 4156266855 2023-07-21T22:18:52.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T22:18:52.633 INFO:teuthology.orchestra.run.smithi151.stdout: "inst_str": "client.15324 172.21.15.151:0/4156266855", 2023-07-21T22:18:52.633 INFO:teuthology.orchestra.run.smithi151.stdout: "addr_str": "172.21.15.151:0/4156266855", 2023-07-21T22:18:52.633 INFO:teuthology.orchestra.run.smithi151.stdout: "inode_count": 5, 2023-07-21T22:18:52.633 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_epoch": 23, 2023-07-21T22:18:52.633 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch": 87, 2023-07-21T22:18:52.634 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_epoch_barrier": 0, 2023-07-21T22:18:52.634 INFO:teuthology.orchestra.run.smithi151.stdout: "blocklisted": false, 2023-07-21T22:18:52.634 INFO:teuthology.orchestra.run.smithi151.stdout: "fs_name": "cephfs" 2023-07-21T22:18:52.634 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:18:52.642 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:52 smithi151 ceph-mon[95510]: pgmap v351: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:18:52.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:52.644 DEBUG:teuthology.orchestra.run.smithi151:> stat --file-system '--printf=%T 2023-07-21T22:18:52.644 DEBUG:teuthology.orchestra.run.smithi151:> ' -- /tmp/cephfs 2023-07-21T22:18:52.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:52 smithi195 ceph-mon[97365]: pgmap v351: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:18:52.689 INFO:teuthology.orchestra.run.smithi151.stdout:fuseblk 2023-07-21T22:18:52.689 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2023-07-21T22:18:52.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T22:18:52.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /tmp/cephfs 2023-07-21T22:18:52.800 INFO:teuthology.run_tasks:Running task check-counter... 2023-07-21T22:18:52.811 INFO:teuthology.run_tasks:Running task fwd_scrub... 2023-07-21T22:18:52.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:53.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.986+0000 7f106d1ff700 1 -- 172.21.15.151:0/1323626478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1068101680 msgr2=0x7f1068107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.986+0000 7f106d1ff700 1 --2- 172.21.15.151:0/1323626478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1068101680 0x7f1068107f40 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f106000b0a0 tx=0x7f106000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.986+0000 7f106d1ff700 1 -- 172.21.15.151:0/1323626478 shutdown_connections 2023-07-21T22:18:53.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.986+0000 7f106d1ff700 1 --2- 172.21.15.151:0/1323626478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10680ffb00 0x7f10680fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.986+0000 7f106d1ff700 1 --2- 172.21.15.151:0/1323626478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1068101680 0x7f1068107f40 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.986+0000 7f106d1ff700 1 --2- 172.21.15.151:0/1323626478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1068100cf0 0x7f1068101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.986+0000 7f106d1ff700 1 -- 172.21.15.151:0/1323626478 >> 172.21.15.151:0/1323626478 conn(0x7f10680fb0e0 msgr2=0x7f10680fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:53.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.986+0000 7f106d1ff700 1 -- 172.21.15.151:0/1323626478 shutdown_connections 2023-07-21T22:18:53.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.986+0000 7f106d1ff700 1 -- 172.21.15.151:0/1323626478 wait complete. 2023-07-21T22:18:53.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.987+0000 7f106d1ff700 1 Processor -- start 2023-07-21T22:18:53.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.987+0000 7f106d1ff700 1 -- start start 2023-07-21T22:18:53.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.987+0000 7f106d1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10680ffb00 0x7f1068197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.987+0000 7f106d1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1068100cf0 0x7f1068197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.987+0000 7f106d1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1068101680 0x7f106819f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.987+0000 7f106d1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106819f5f0 con 0x7f10680ffb00 2023-07-21T22:18:53.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.987+0000 7f106d1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106819f730 con 0x7f1068101680 2023-07-21T22:18:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.987+0000 7f106d1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f106819f8c0 con 0x7f1068100cf0 2023-07-21T22:18:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1066d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10680ffb00 0x7f1068197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1066d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10680ffb00 0x7f1068197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40246/0 (socket says 172.21.15.151:40246) 2023-07-21T22:18:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1066d9d700 1 -- 172.21.15.151:0/3954451825 learned_addr learned my addr 172.21.15.151:0/3954451825 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f106759e700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1068101680 0x7f106819f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f105ffff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1068100cf0 0x7f1068197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1066d9d700 1 -- 172.21.15.151:0/3954451825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1068100cf0 msgr2=0x7f1068197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1066d9d700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1068100cf0 0x7f1068197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1066d9d700 1 -- 172.21.15.151:0/3954451825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1068101680 msgr2=0x7f106819f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1066d9d700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1068101680 0x7f106819f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1066d9d700 1 -- 172.21.15.151:0/3954451825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1060009d00 con 0x7f10680ffb00 2023-07-21T22:18:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f105ffff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1068100cf0 0x7f1068197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1066d9d700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10680ffb00 0x7f1068197a70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f105800d980 tx=0x7f105800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1064d99700 1 -- 172.21.15.151:0/3954451825 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058004020 con 0x7f10680ffb00 2023-07-21T22:18:53.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.988+0000 7f1064d99700 1 -- 172.21.15.151:0/3954451825 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1058009730 con 0x7f10680ffb00 2023-07-21T22:18:53.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.989+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f106819fba0 con 0x7f10680ffb00 2023-07-21T22:18:53.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.989+0000 7f1064d99700 1 -- 172.21.15.151:0/3954451825 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1058003a00 con 0x7f10680ffb00 2023-07-21T22:18:53.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.989+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10681a0100 con 0x7f10680ffb00 2023-07-21T22:18:53.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.990+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10681920a0 con 0x7f10680ffb00 2023-07-21T22:18:53.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.992+0000 7f1064d99700 1 -- 172.21.15.151:0/3954451825 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f10580098a0 con 0x7f10680ffb00 2023-07-21T22:18:53.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.993+0000 7f1064d99700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10540a1220 0x7f10540a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.993+0000 7f1064d99700 1 -- 172.21.15.151:0/3954451825 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f10580cc5b0 con 0x7f10680ffb00 2023-07-21T22:18:53.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.993+0000 7f105ffff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10540a1220 0x7f10540a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.994+0000 7f105ffff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10540a1220 0x7f10540a36d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1050009cb0 tx=0x7f1050009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:52.998+0000 7f1064d99700 1 -- 172.21.15.151:0/3954451825 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f1058095cd0 con 0x7f10680ffb00 2023-07-21T22:18:53.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.197+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f106802c850 con 0x7f10680ffb00 2023-07-21T22:18:53.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.199+0000 7f1064d99700 1 -- 172.21.15.151:0/3954451825 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7f10580232f0 con 0x7f10680ffb00 2023-07-21T22:18:53.243 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:53.244 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:53.245 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10540a1220 msgr2=0x7f10540a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10540a1220 0x7f10540a36d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1050009cb0 tx=0x7f1050009260 comp rx=0 tx=0).stop 2023-07-21T22:18:53.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10680ffb00 msgr2=0x7f1068197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10680ffb00 0x7f1068197a70 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f105800d980 tx=0x7f105800dc90 comp rx=0 tx=0).stop 2023-07-21T22:18:53.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 shutdown_connections 2023-07-21T22:18:53.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f10540a1220 0x7f10540a36d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1068101680 0x7f106819f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10680ffb00 0x7f1068197a70 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 --2- 172.21.15.151:0/3954451825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1068100cf0 0x7f1068197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 >> 172.21.15.151:0/3954451825 conn(0x7f10680fb0e0 msgr2=0x7f10681065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:53.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 shutdown_connections 2023-07-21T22:18:53.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.201+0000 7f106d1ff700 1 -- 172.21.15.151:0/3954451825 wait complete. 2023-07-21T22:18:53.264 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:18:53.265 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:18:53.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.423+0000 7ff873bff700 1 -- 172.21.15.151:0/1415170032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 msgr2=0x7ff86c073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.423+0000 7ff873bff700 1 --2- 172.21.15.151:0/1415170032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 0x7ff86c073380 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009990 tx=0x7ff85c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.423+0000 7ff873bff700 1 -- 172.21.15.151:0/1415170032 shutdown_connections 2023-07-21T22:18:53.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.423+0000 7ff873bff700 1 --2- 172.21.15.151:0/1415170032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c107990 0x7ff86c109e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.423+0000 7ff873bff700 1 --2- 172.21.15.151:0/1415170032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c0744f0 0x7ff86c072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.423+0000 7ff873bff700 1 --2- 172.21.15.151:0/1415170032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 0x7ff86c073380 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.423+0000 7ff873bff700 1 -- 172.21.15.151:0/1415170032 >> 172.21.15.151:0/1415170032 conn(0x7ff86c0fb120 msgr2=0x7ff86c0fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:53.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.423+0000 7ff873bff700 1 -- 172.21.15.151:0/1415170032 shutdown_connections 2023-07-21T22:18:53.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.423+0000 7ff873bff700 1 -- 172.21.15.151:0/1415170032 wait complete. 2023-07-21T22:18:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.424+0000 7ff873bff700 1 Processor -- start 2023-07-21T22:18:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.424+0000 7ff873bff700 1 -- start start 2023-07-21T22:18:53.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.424+0000 7ff873bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 0x7ff86c197880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.424+0000 7ff873bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c0744f0 0x7ff86c197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.424+0000 7ff873bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c107990 0x7ff86c19ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.424+0000 7ff873bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c19f400 con 0x7ff86c072f10 2023-07-21T22:18:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.424+0000 7ff873bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c19f540 con 0x7ff86c107990 2023-07-21T22:18:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.424+0000 7ff873bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff86c19f6d0 con 0x7ff86c0744f0 2023-07-21T22:18:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 0x7ff86c197880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 0x7ff86c197880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40256/0 (socket says 172.21.15.151:40256) 2023-07-21T22:18:53.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87199b700 1 -- 172.21.15.151:0/932141608 learned_addr learned my addr 172.21.15.151:0/932141608 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:53.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87219c700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c107990 0x7ff86c19ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87119a700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c0744f0 0x7ff86c197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87199b700 1 -- 172.21.15.151:0/932141608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c0744f0 msgr2=0x7ff86c197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87199b700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c0744f0 0x7ff86c197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87199b700 1 -- 172.21.15.151:0/932141608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c107990 msgr2=0x7ff86c19ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87199b700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c107990 0x7ff86c19ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87199b700 1 -- 172.21.15.151:0/932141608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c0095f0 con 0x7ff86c072f10 2023-07-21T22:18:53.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.425+0000 7ff87199b700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 0x7ff86c197880 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff86800c9b0 tx=0x7ff86800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.426+0000 7ff862ffd700 1 -- 172.21.15.151:0/932141608 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868007b00 con 0x7ff86c072f10 2023-07-21T22:18:53.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.426+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff86c19f9b0 con 0x7ff86c072f10 2023-07-21T22:18:53.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.426+0000 7ff862ffd700 1 -- 172.21.15.151:0/932141608 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff868007c60 con 0x7ff86c072f10 2023-07-21T22:18:53.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.426+0000 7ff862ffd700 1 -- 172.21.15.151:0/932141608 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff868018660 con 0x7ff86c072f10 2023-07-21T22:18:53.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.426+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff86c19fec0 con 0x7ff86c072f10 2023-07-21T22:18:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.427+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86c1060d0 con 0x7ff86c072f10 2023-07-21T22:18:53.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.429+0000 7ff862ffd700 1 -- 172.21.15.151:0/932141608 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7ff86800f450 con 0x7ff86c072f10 2023-07-21T22:18:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.430+0000 7ff862ffd700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8580a1150 0x7ff8580a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.431+0000 7ff862ffd700 1 -- 172.21.15.151:0/932141608 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7ff8680ccc00 con 0x7ff86c072f10 2023-07-21T22:18:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.431+0000 7ff87119a700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8580a1150 0x7ff8580a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.431+0000 7ff87119a700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8580a1150 0x7ff8580a3600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00b5c0 tx=0x7ff85c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.432+0000 7ff862ffd700 1 -- 172.21.15.151:0/932141608 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7ff8680963b0 con 0x7ff86c072f10 2023-07-21T22:18:53.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:53 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3954451825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:53.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:53 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3954451825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:53.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.631+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff86c02ca00 con 0x7ff86c072f10 2023-07-21T22:18:53.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.631+0000 7ff862ffd700 1 -- 172.21.15.151:0/932141608 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff8680999d0 con 0x7ff86c072f10 2023-07-21T22:18:53.676 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:18:53.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8580a1150 msgr2=0x7ff8580a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8580a1150 0x7ff8580a3600 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff85c00b5c0 tx=0x7ff85c005fb0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 msgr2=0x7ff86c197880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 0x7ff86c197880 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff86800c9b0 tx=0x7ff86800cd70 comp rx=0 tx=0).stop 2023-07-21T22:18:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 shutdown_connections 2023-07-21T22:18:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7ff8580a1150 0x7ff8580a3600 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff86c107990 0x7ff86c19ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff86c072f10 0x7ff86c197880 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 --2- 172.21.15.151:0/932141608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff86c0744f0 0x7ff86c197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 >> 172.21.15.151:0/932141608 conn(0x7ff86c0fb120 msgr2=0x7ff86c0fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:53.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 shutdown_connections 2023-07-21T22:18:53.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.634+0000 7ff873bff700 1 -- 172.21.15.151:0/932141608 wait complete. 2023-07-21T22:18:53.695 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:53 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3954451825' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:53.697 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:18:53.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.857+0000 7f68cafff700 1 -- 172.21.15.151:0/3500721169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 msgr2=0x7f68c4073380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.857+0000 7f68cafff700 1 --2- 172.21.15.151:0/3500721169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 0x7f68c4073380 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f68b0009990 tx=0x7f68b0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.857+0000 7f68cafff700 1 -- 172.21.15.151:0/3500721169 shutdown_connections 2023-07-21T22:18:53.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.857+0000 7f68cafff700 1 --2- 172.21.15.151:0/3500721169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c40744f0 0x7f68c4072940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.857+0000 7f68cafff700 1 --2- 172.21.15.151:0/3500721169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c41079a0 0x7f68c4109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.857+0000 7f68cafff700 1 --2- 172.21.15.151:0/3500721169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 0x7f68c4073380 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.857+0000 7f68cafff700 1 -- 172.21.15.151:0/3500721169 >> 172.21.15.151:0/3500721169 conn(0x7f68c40fb130 msgr2=0x7f68c40fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:53.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.857+0000 7f68cafff700 1 -- 172.21.15.151:0/3500721169 shutdown_connections 2023-07-21T22:18:53.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.857+0000 7f68cafff700 1 -- 172.21.15.151:0/3500721169 wait complete. 2023-07-21T22:18:53.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.858+0000 7f68cafff700 1 Processor -- start 2023-07-21T22:18:53.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68cafff700 1 -- start start 2023-07-21T22:18:53.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68cafff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 0x7f68c4197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68cafff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c40744f0 0x7f68c4197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68cafff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c41079a0 0x7f68c419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68cafff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c419f4d0 con 0x7f68c4072f10 2023-07-21T22:18:53.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68cafff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c419f610 con 0x7f68c41079a0 2023-07-21T22:18:53.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68cafff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c419f7a0 con 0x7f68c40744f0 2023-07-21T22:18:53.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68c8d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 0x7f68c4197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68c8d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 0x7f68c4197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40276/0 (socket says 172.21.15.151:40276) 2023-07-21T22:18:53.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68c8d9b700 1 -- 172.21.15.151:0/1085681454 learned_addr learned my addr 172.21.15.151:0/1085681454 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:53.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68c959c700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c41079a0 0x7f68c419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.859+0000 7f68c3fff700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c40744f0 0x7f68c4197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68c8d9b700 1 -- 172.21.15.151:0/1085681454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c40744f0 msgr2=0x7f68c4197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68c8d9b700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c40744f0 0x7f68c4197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68c8d9b700 1 -- 172.21.15.151:0/1085681454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c41079a0 msgr2=0x7f68c419ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:53.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68c8d9b700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c41079a0 0x7f68c419ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:53.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68c8d9b700 1 -- 172.21.15.151:0/1085681454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b00095f0 con 0x7f68c4072f10 2023-07-21T22:18:53.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68c8d9b700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 0x7f68c4197950 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f68b800e9a0 tx=0x7f68b800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68c1ffb700 1 -- 172.21.15.151:0/1085681454 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8009790 con 0x7f68c4072f10 2023-07-21T22:18:53.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c419fa80 con 0x7f68c4072f10 2023-07-21T22:18:53.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68c1ffb700 1 -- 172.21.15.151:0/1085681454 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f68b8010430 con 0x7f68c4072f10 2023-07-21T22:18:53.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68c1ffb700 1 -- 172.21.15.151:0/1085681454 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800cea0 con 0x7f68c4072f10 2023-07-21T22:18:53.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.860+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c419ff90 con 0x7f68c4072f10 2023-07-21T22:18:53.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.862+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c41060e0 con 0x7f68c4072f10 2023-07-21T22:18:53.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.864+0000 7f68c1ffb700 1 -- 172.21.15.151:0/1085681454 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f68b80105a0 con 0x7f68c4072f10 2023-07-21T22:18:53.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.865+0000 7f68c1ffb700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68b40a1150 0x7f68b40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.865+0000 7f68c1ffb700 1 -- 172.21.15.151:0/1085681454 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f68b8014070 con 0x7f68c4072f10 2023-07-21T22:18:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.865+0000 7f68c3fff700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68b40a1150 0x7f68b40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:53.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.866+0000 7f68c3fff700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68b40a1150 0x7f68b40a3600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f68b0006010 tx=0x7f68b000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:53.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:53.869+0000 7f68c1ffb700 1 -- 172.21.15.151:0/1085681454 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f68b8051770 con 0x7f68c4072f10 2023-07-21T22:18:54.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.069+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f68c40611c0 con 0x7f68c4072f10 2023-07-21T22:18:54.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.069+0000 7f68c1ffb700 1 -- 172.21.15.151:0/1085681454 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f68b80962b0 con 0x7f68c4072f10 2023-07-21T22:18:54.114 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T22:18:54.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68b40a1150 msgr2=0x7f68b40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68b40a1150 0x7f68b40a3600 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f68b0006010 tx=0x7f68b000b260 comp rx=0 tx=0).stop 2023-07-21T22:18:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 msgr2=0x7f68c4197950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 0x7f68c4197950 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f68b800e9a0 tx=0x7f68b800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 shutdown_connections 2023-07-21T22:18:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f68b40a1150 0x7f68b40a3600 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f68c41079a0 0x7f68c419ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c4072f10 0x7f68c4197950 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 --2- 172.21.15.151:0/1085681454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f68c40744f0 0x7f68c4197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 >> 172.21.15.151:0/1085681454 conn(0x7f68c40fb130 msgr2=0x7f68c40fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 shutdown_connections 2023-07-21T22:18:54.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.072+0000 7f68cafff700 1 -- 172.21.15.151:0/1085681454 wait complete. 2023-07-21T22:18:54.135 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:18:54.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.293+0000 7f2ea81ff700 1 -- 172.21.15.151:0/4230788145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea00ffaf0 msgr2=0x7f2ea00fff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.293+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/4230788145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea00ffaf0 0x7f2ea00fff00 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c009990 tx=0x7f2e9c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.293+0000 7f2ea81ff700 1 -- 172.21.15.151:0/4230788145 shutdown_connections 2023-07-21T22:18:54.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.293+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/4230788145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ea0101670 0x7f2ea0107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.293+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/4230788145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea00ffaf0 0x7f2ea00fff00 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.293+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/4230788145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ea0100ce0 0x7f2ea0101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.293+0000 7f2ea81ff700 1 -- 172.21.15.151:0/4230788145 >> 172.21.15.151:0/4230788145 conn(0x7f2ea00fb130 msgr2=0x7f2ea00fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.293+0000 7f2ea81ff700 1 -- 172.21.15.151:0/4230788145 shutdown_connections 2023-07-21T22:18:54.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.293+0000 7f2ea81ff700 1 -- 172.21.15.151:0/4230788145 wait complete. 2023-07-21T22:18:54.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.294+0000 7f2ea81ff700 1 Processor -- start 2023-07-21T22:18:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.294+0000 7f2ea81ff700 1 -- start start 2023-07-21T22:18:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea81ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ea00ffaf0 0x7f2ea00742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea81ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ea0100ce0 0x7f2ea0072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea81ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea0101670 0x7f2ea0072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea81ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea00735e0 con 0x7f2ea0101670 2023-07-21T22:18:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea81ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea0073750 con 0x7f2ea0100ce0 2023-07-21T22:18:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea81ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea019f7d0 con 0x7f2ea00ffaf0 2023-07-21T22:18:54.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea679c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea0101670 0x7f2ea0072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea679c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea0101670 0x7f2ea0072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40302/0 (socket says 172.21.15.151:40302) 2023-07-21T22:18:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea679c700 1 -- 172.21.15.151:0/755842958 learned_addr learned my addr 172.21.15.151:0/755842958 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea579a700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ea0100ce0 0x7f2ea0072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea5f9b700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ea00ffaf0 0x7f2ea00742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea679c700 1 -- 172.21.15.151:0/755842958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ea00ffaf0 msgr2=0x7f2ea00742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea679c700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ea00ffaf0 0x7f2ea00742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea679c700 1 -- 172.21.15.151:0/755842958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ea0100ce0 msgr2=0x7f2ea0072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea679c700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ea0100ce0 0x7f2ea0072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.295+0000 7f2ea679c700 1 -- 172.21.15.151:0/755842958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0095f0 con 0x7f2ea0101670 2023-07-21T22:18:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.296+0000 7f2ea679c700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea0101670 0x7f2ea0072e40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2e98007ee0 tx=0x7f2e9800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.296+0000 7f2e96ffd700 1 -- 172.21.15.151:0/755842958 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9800ddd0 con 0x7f2ea0101670 2023-07-21T22:18:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.296+0000 7f2e96ffd700 1 -- 172.21.15.151:0/755842958 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2e9800f040 con 0x7f2ea0101670 2023-07-21T22:18:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.296+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea019fab0 con 0x7f2ea0101670 2023-07-21T22:18:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.296+0000 7f2e96ffd700 1 -- 172.21.15.151:0/755842958 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980047d0 con 0x7f2ea0101670 2023-07-21T22:18:54.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.296+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea01a0010 con 0x7f2ea0101670 2023-07-21T22:18:54.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.297+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea010b170 con 0x7f2ea0101670 2023-07-21T22:18:54.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.299+0000 7f2e96ffd700 1 -- 172.21.15.151:0/755842958 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2e98003a00 con 0x7f2ea0101670 2023-07-21T22:18:54.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.301+0000 7f2e96ffd700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2e8c0a11d0 0x7f2e8c0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.301+0000 7f2e96ffd700 1 -- 172.21.15.151:0/755842958 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f2e980cc140 con 0x7f2ea0101670 2023-07-21T22:18:54.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.301+0000 7f2ea5f9b700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2e8c0a11d0 0x7f2e8c0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.302+0000 7f2ea5f9b700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2e8c0a11d0 0x7f2e8c0a3680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c010 tx=0x7f2e9c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.349 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.305+0000 7f2e96ffd700 1 -- 172.21.15.151:0/755842958 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2e9804e770 con 0x7f2ea0101670 2023-07-21T22:18:54.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:54 smithi151 ceph-mon[95510]: pgmap v352: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:18:54.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:54 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/932141608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:54.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:54 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1085681454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:54.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.505+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2ea0106a90 con 0x7f2ea0101670 2023-07-21T22:18:54.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.505+0000 7f2e96ffd700 1 -- 172.21.15.151:0/755842958 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2e98095860 con 0x7f2ea0101670 2023-07-21T22:18:54.551 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T22:18:54.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2e8c0a11d0 msgr2=0x7f2e8c0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2e8c0a11d0 0x7f2e8c0a3680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c00c010 tx=0x7f2e9c00b540 comp rx=0 tx=0).stop 2023-07-21T22:18:54.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea0101670 msgr2=0x7f2ea0072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea0101670 0x7f2ea0072e40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2e98007ee0 tx=0x7f2e9800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 shutdown_connections 2023-07-21T22:18:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2e8c0a11d0 0x7f2e8c0a3680 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ea0101670 0x7f2ea0072e40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ea00ffaf0 0x7f2ea00742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 --2- 172.21.15.151:0/755842958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ea0100ce0 0x7f2ea0072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 >> 172.21.15.151:0/755842958 conn(0x7f2ea00fb130 msgr2=0x7f2ea00fd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 shutdown_connections 2023-07-21T22:18:54.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.508+0000 7f2ea81ff700 1 -- 172.21.15.151:0/755842958 wait complete. 2023-07-21T22:18:54.570 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:54 smithi187 ceph-mon[96918]: pgmap v352: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:18:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:54 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/932141608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:54.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:54 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1085681454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:54.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:54 smithi195 ceph-mon[97365]: pgmap v352: 97 pgs: 97 active+clean; 636 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2023-07-21T22:18:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:54 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/932141608' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:54 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1085681454' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:54.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.723+0000 7f3f5afff700 1 -- 172.21.15.151:0/410476926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54101680 msgr2=0x7f3f54107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.723+0000 7f3f5afff700 1 --2- 172.21.15.151:0/410476926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54101680 0x7f3f54107f40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00b0a0 tx=0x7f3f4c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.723+0000 7f3f5afff700 1 -- 172.21.15.151:0/410476926 shutdown_connections 2023-07-21T22:18:54.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.723+0000 7f3f5afff700 1 --2- 172.21.15.151:0/410476926 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54101680 0x7f3f54107f40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.768 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.723+0000 7f3f5afff700 1 --2- 172.21.15.151:0/410476926 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f540ffb00 0x7f3f540fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.723+0000 7f3f5afff700 1 --2- 172.21.15.151:0/410476926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f54100cf0 0x7f3f54101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.723+0000 7f3f5afff700 1 -- 172.21.15.151:0/410476926 >> 172.21.15.151:0/410476926 conn(0x7f3f540fb0e0 msgr2=0x7f3f540fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.723+0000 7f3f5afff700 1 -- 172.21.15.151:0/410476926 shutdown_connections 2023-07-21T22:18:54.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.723+0000 7f3f5afff700 1 -- 172.21.15.151:0/410476926 wait complete. 2023-07-21T22:18:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.724+0000 7f3f5afff700 1 Processor -- start 2023-07-21T22:18:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.724+0000 7f3f5afff700 1 -- start start 2023-07-21T22:18:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f5afff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f540ffb00 0x7f3f54195830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f5afff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54100cf0 0x7f3f54195d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f5afff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f54101680 0x7f3f5419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f5afff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5419d3b0 con 0x7f3f54100cf0 2023-07-21T22:18:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f5afff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5419d4f0 con 0x7f3f54101680 2023-07-21T22:18:54.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f5afff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5419d680 con 0x7f3f540ffb00 2023-07-21T22:18:54.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f53fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54100cf0 0x7f3f54195d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f53fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54100cf0 0x7f3f54195d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40326/0 (socket says 172.21.15.151:40326) 2023-07-21T22:18:54.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f53fff700 1 -- 172.21.15.151:0/759548184 learned_addr learned my addr 172.21.15.151:0/759548184 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:54.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f5959c700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f54101680 0x7f3f5419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f58d9b700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f540ffb00 0x7f3f54195830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f53fff700 1 -- 172.21.15.151:0/759548184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f540ffb00 msgr2=0x7f3f54195830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f53fff700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f540ffb00 0x7f3f54195830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f53fff700 1 -- 172.21.15.151:0/759548184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f54101680 msgr2=0x7f3f5419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f53fff700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f54101680 0x7f3f5419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f53fff700 1 -- 172.21.15.151:0/759548184 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f4c009d00 con 0x7f3f54100cf0 2023-07-21T22:18:54.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.725+0000 7f3f58d9b700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f540ffb00 0x7f3f54195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:54.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.726+0000 7f3f53fff700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54100cf0 0x7f3f54195d70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e9a0 tx=0x7f3f4000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.726+0000 7f3f51ffb700 1 -- 172.21.15.151:0/759548184 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40009790 con 0x7f3f54100cf0 2023-07-21T22:18:54.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.726+0000 7f3f51ffb700 1 -- 172.21.15.151:0/759548184 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f4000cbd0 con 0x7f3f54100cf0 2023-07-21T22:18:54.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.726+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5419d960 con 0x7f3f54100cf0 2023-07-21T22:18:54.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.726+0000 7f3f51ffb700 1 -- 172.21.15.151:0/759548184 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f40018680 con 0x7f3f54100cf0 2023-07-21T22:18:54.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.726+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5419dec0 con 0x7f3f54100cf0 2023-07-21T22:18:54.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.727+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f54106960 con 0x7f3f54100cf0 2023-07-21T22:18:54.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.729+0000 7f3f51ffb700 1 -- 172.21.15.151:0/759548184 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f3f4000cd40 con 0x7f3f54100cf0 2023-07-21T22:18:54.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.730+0000 7f3f51ffb700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3f440a1220 0x7f3f440a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:54.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.731+0000 7f3f51ffb700 1 -- 172.21.15.151:0/759548184 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f3f40014070 con 0x7f3f54100cf0 2023-07-21T22:18:54.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.731+0000 7f3f58d9b700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3f440a1220 0x7f3f440a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:54.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.731+0000 7f3f58d9b700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3f440a1220 0x7f3f440a36d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f54100b50 tx=0x7f3f48009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:54.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.734+0000 7f3f51ffb700 1 -- 172.21.15.151:0/759548184 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f3f40051770 con 0x7f3f54100cf0 2023-07-21T22:18:54.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.934+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f5402c850 con 0x7f3f54100cf0 2023-07-21T22:18:54.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.936+0000 7f3f51ffb700 1 -- 172.21.15.151:0/759548184 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7f3f40078e60 con 0x7f3f54100cf0 2023-07-21T22:18:54.981 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:54.981 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:54.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3f440a1220 msgr2=0x7f3f440a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3f440a1220 0x7f3f440a36d0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f3f54100b50 tx=0x7f3f48009260 comp rx=0 tx=0).stop 2023-07-21T22:18:54.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54100cf0 msgr2=0x7f3f54195d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:54.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54100cf0 0x7f3f54195d70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000e9a0 tx=0x7f3f4000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 shutdown_connections 2023-07-21T22:18:54.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f3f440a1220 0x7f3f440a36d0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f54101680 0x7f3f5419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f540ffb00 0x7f3f54195830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 --2- 172.21.15.151:0/759548184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54100cf0 0x7f3f54195d70 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 >> 172.21.15.151:0/759548184 conn(0x7f3f540fb0e0 msgr2=0x7f3f540fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 shutdown_connections 2023-07-21T22:18:54.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:54.939+0000 7f3f5afff700 1 -- 172.21.15.151:0/759548184 wait complete. 2023-07-21T22:18:55.002 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:18:55.003 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:18:55.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.162+0000 7fb262dff700 1 -- 172.21.15.151:0/2092270817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c074550 msgr2=0x7fb25c0729a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.162+0000 7fb262dff700 1 --2- 172.21.15.151:0/2092270817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c074550 0x7fb25c0729a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb250009990 tx=0x7fb250009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.162+0000 7fb262dff700 1 -- 172.21.15.151:0/2092270817 shutdown_connections 2023-07-21T22:18:55.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.162+0000 7fb262dff700 1 --2- 172.21.15.151:0/2092270817 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb25c1079a0 0x7fb25c109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.162+0000 7fb262dff700 1 --2- 172.21.15.151:0/2092270817 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c074550 0x7fb25c0729a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.162+0000 7fb262dff700 1 --2- 172.21.15.151:0/2092270817 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb25c072f70 0x7fb25c0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.162+0000 7fb262dff700 1 -- 172.21.15.151:0/2092270817 >> 172.21.15.151:0/2092270817 conn(0x7fb25c0fb0e0 msgr2=0x7fb25c0fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.162+0000 7fb262dff700 1 -- 172.21.15.151:0/2092270817 shutdown_connections 2023-07-21T22:18:55.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.162+0000 7fb262dff700 1 -- 172.21.15.151:0/2092270817 wait complete. 2023-07-21T22:18:55.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.163+0000 7fb262dff700 1 Processor -- start 2023-07-21T22:18:55.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.163+0000 7fb262dff700 1 -- start start 2023-07-21T22:18:55.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb262dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb25c072f70 0x7fb25c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb262dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb25c074550 0x7fb25c197f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb262dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c1079a0 0x7fb25c19ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb262dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c19f560 con 0x7fb25c1079a0 2023-07-21T22:18:55.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb262dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c19f6a0 con 0x7fb25c072f70 2023-07-21T22:18:55.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb262dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb25c19f830 con 0x7fb25c074550 2023-07-21T22:18:55.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb26139c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c1079a0 0x7fb25c19ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb25bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb25c074550 0x7fb25c197f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb26139c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c1079a0 0x7fb25c19ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40340/0 (socket says 172.21.15.151:40340) 2023-07-21T22:18:55.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb26139c700 1 -- 172.21.15.151:0/1045592315 learned_addr learned my addr 172.21.15.151:0/1045592315 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:55.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb260b9b700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb25c072f70 0x7fb25c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb26139c700 1 -- 172.21.15.151:0/1045592315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb25c074550 msgr2=0x7fb25c197f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb26139c700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb25c074550 0x7fb25c197f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb26139c700 1 -- 172.21.15.151:0/1045592315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb25c072f70 msgr2=0x7fb25c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb26139c700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb25c072f70 0x7fb25c1979e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.164+0000 7fb26139c700 1 -- 172.21.15.151:0/1045592315 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2500095f0 con 0x7fb25c1079a0 2023-07-21T22:18:55.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.165+0000 7fb26139c700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c1079a0 0x7fb25c19ef90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb254007ee0 tx=0x7fb25400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.165+0000 7fb259ffb700 1 -- 172.21.15.151:0/1045592315 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb25400dd20 con 0x7fb25c1079a0 2023-07-21T22:18:55.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.165+0000 7fb259ffb700 1 -- 172.21.15.151:0/1045592315 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb25400f040 con 0x7fb25c1079a0 2023-07-21T22:18:55.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.165+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb25c19fb10 con 0x7fb25c1079a0 2023-07-21T22:18:55.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.165+0000 7fb259ffb700 1 -- 172.21.15.151:0/1045592315 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb254004750 con 0x7fb25c1079a0 2023-07-21T22:18:55.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.165+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb25c1a0020 con 0x7fb25c1079a0 2023-07-21T22:18:55.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.166+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb25c106050 con 0x7fb25c1079a0 2023-07-21T22:18:55.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.168+0000 7fb259ffb700 1 -- 172.21.15.151:0/1045592315 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fb254003a00 con 0x7fb25c1079a0 2023-07-21T22:18:55.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.169+0000 7fb259ffb700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb24c0a1250 0x7fb24c0a3700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.169+0000 7fb259ffb700 1 -- 172.21.15.151:0/1045592315 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fb2540cc1a0 con 0x7fb25c1079a0 2023-07-21T22:18:55.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.170+0000 7fb260b9b700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb24c0a1250 0x7fb24c0a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.170+0000 7fb260b9b700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb24c0a1250 0x7fb24c0a3700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb250006010 tx=0x7fb250005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.173+0000 7fb259ffb700 1 -- 172.21.15.151:0/1045592315 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fb25404e770 con 0x7fb25c1079a0 2023-07-21T22:18:55.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.374+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb25c0611c0 con 0x7fb25c1079a0 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.375+0000 7fb259ffb700 1 -- 172.21.15.151:0/1045592315 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb2540958c0 con 0x7fb25c1079a0 2023-07-21T22:18:55.420 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:18:55.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb24c0a1250 msgr2=0x7fb24c0a3700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb24c0a1250 0x7fb24c0a3700 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb250006010 tx=0x7fb250005960 comp rx=0 tx=0).stop 2023-07-21T22:18:55.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c1079a0 msgr2=0x7fb25c19ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c1079a0 0x7fb25c19ef90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb254007ee0 tx=0x7fb25400d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 shutdown_connections 2023-07-21T22:18:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fb24c0a1250 0x7fb24c0a3700 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb25c072f70 0x7fb25c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb25c1079a0 0x7fb25c19ef90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 --2- 172.21.15.151:0/1045592315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb25c074550 0x7fb25c197f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.377+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 >> 172.21.15.151:0/1045592315 conn(0x7fb25c0fb0e0 msgr2=0x7fb25c0fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.378+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 shutdown_connections 2023-07-21T22:18:55.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.378+0000 7fb262dff700 1 -- 172.21.15.151:0/1045592315 wait complete. 2023-07-21T22:18:55.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:18:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:55 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/755842958' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:55.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:55 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/759548184' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.597+0000 7fe8d25ff700 1 -- 172.21.15.151:0/1485633765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc100ce0 msgr2=0x7fe8cc101130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.597+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/1485633765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc100ce0 0x7fe8cc101130 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fe8c0009990 tx=0x7fe8c0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.597+0000 7fe8d25ff700 1 -- 172.21.15.151:0/1485633765 shutdown_connections 2023-07-21T22:18:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.597+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/1485633765 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8cc0ffaf0 0x7fe8cc0fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.597+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/1485633765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8cc101670 0x7fe8cc107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.597+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/1485633765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc100ce0 0x7fe8cc101130 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.597+0000 7fe8d25ff700 1 -- 172.21.15.151:0/1485633765 >> 172.21.15.151:0/1485633765 conn(0x7fe8cc0fb130 msgr2=0x7fe8cc0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.597+0000 7fe8d25ff700 1 -- 172.21.15.151:0/1485633765 shutdown_connections 2023-07-21T22:18:55.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.597+0000 7fe8d25ff700 1 -- 172.21.15.151:0/1485633765 wait complete. 2023-07-21T22:18:55.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.598+0000 7fe8d25ff700 1 Processor -- start 2023-07-21T22:18:55.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8d25ff700 1 -- start start 2023-07-21T22:18:55.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8d25ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc0ffaf0 0x7fe8cc0742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8d25ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8cc100ce0 0x7fe8cc072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8d25ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8cc101670 0x7fe8cc072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8d25ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc0735e0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8d25ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc073750 con 0x7fe8cc101670 2023-07-21T22:18:55.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8d25ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8cc19f7f0 con 0x7fe8cc100ce0 2023-07-21T22:18:55.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc0ffaf0 0x7fe8cc0742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc0ffaf0 0x7fe8cc0742c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40364/0 (socket says 172.21.15.151:40364) 2023-07-21T22:18:55.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8cbfff700 1 -- 172.21.15.151:0/858626908 learned_addr learned my addr 172.21.15.151:0/858626908 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:55.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.599+0000 7fe8d0b9c700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8cc101670 0x7fe8cc072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8cb7fe700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8cc100ce0 0x7fe8cc072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8cbfff700 1 -- 172.21.15.151:0/858626908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8cc100ce0 msgr2=0x7fe8cc072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8cbfff700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8cc100ce0 0x7fe8cc072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8cbfff700 1 -- 172.21.15.151:0/858626908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8cc101670 msgr2=0x7fe8cc072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8cbfff700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8cc101670 0x7fe8cc072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8cbfff700 1 -- 172.21.15.151:0/858626908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8c00095f0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8cb7fe700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8cc100ce0 0x7fe8cc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:55.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8cbfff700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc0ffaf0 0x7fe8cc0742c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00e970 tx=0x7fe8bc00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8c97fa700 1 -- 172.21.15.151:0/858626908 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc009790 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8c97fa700 1 -- 172.21.15.151:0/858626908 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe8bc00eec0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8cc19fad0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8c97fa700 1 -- 172.21.15.151:0/858626908 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8bc003c10 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.600+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8cc19ffe0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.601+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8cc1070e0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.603+0000 7fe8c97fa700 1 -- 172.21.15.151:0/858626908 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe8bc003db0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.605+0000 7fe8c97fa700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe8b40a1150 0x7fe8b40a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.605+0000 7fe8c97fa700 1 -- 172.21.15.151:0/858626908 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fe8bc014070 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.649 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.605+0000 7fe8cb7fe700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe8b40a1150 0x7fe8b40a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:55.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.605+0000 7fe8cb7fe700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe8b40a1150 0x7fe8b40a3600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00098e0 tx=0x7fe8c0004740 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:55.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.608+0000 7fe8c97fa700 1 -- 172.21.15.151:0/858626908 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fe8bc0962b0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:55 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/755842958' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:55.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:55 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/759548184' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:55.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:55 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/755842958' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:55.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:55 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/759548184' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:55.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.805+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe8cc0611c0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.806+0000 7fe8c97fa700 1 -- 172.21.15.151:0/858626908 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe8bc0998d0 con 0x7fe8cc0ffaf0 2023-07-21T22:18:55.851 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T22:18:55.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe8b40a1150 msgr2=0x7fe8b40a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe8b40a1150 0x7fe8b40a3600 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fe8c00098e0 tx=0x7fe8c0004740 comp rx=0 tx=0).stop 2023-07-21T22:18:55.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc0ffaf0 msgr2=0x7fe8cc0742c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:55.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc0ffaf0 0x7fe8cc0742c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fe8bc00e970 tx=0x7fe8bc00ec80 comp rx=0 tx=0).stop 2023-07-21T22:18:55.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 shutdown_connections 2023-07-21T22:18:55.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe8b40a1150 0x7fe8b40a3600 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8cc101670 0x7fe8cc072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe8cc0ffaf0 0x7fe8cc0742c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 --2- 172.21.15.151:0/858626908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe8cc100ce0 0x7fe8cc072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:55.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.808+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 >> 172.21.15.151:0/858626908 conn(0x7fe8cc0fb130 msgr2=0x7fe8cc104220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:55.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.809+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 shutdown_connections 2023-07-21T22:18:55.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:55.809+0000 7fe8d25ff700 1 -- 172.21.15.151:0/858626908 wait complete. 2023-07-21T22:18:55.871 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:18:56.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.028+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4029585810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34101670 msgr2=0x7f0b34107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.028+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4029585810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34101670 0x7f0b34107f30 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f0b2c00b0a0 tx=0x7f0b2c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.028+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4029585810 shutdown_connections 2023-07-21T22:18:56.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.028+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4029585810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b340ffaf0 0x7f0b340fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.028+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4029585810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34101670 0x7f0b34107f30 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.028+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4029585810 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b34100ce0 0x7f0b34101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.028+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4029585810 >> 172.21.15.151:0/4029585810 conn(0x7f0b340fb130 msgr2=0x7f0b340fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:56.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.028+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4029585810 shutdown_connections 2023-07-21T22:18:56.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.028+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4029585810 wait complete. 2023-07-21T22:18:56.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.029+0000 7f0b3a3ff700 1 Processor -- start 2023-07-21T22:18:56.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.029+0000 7f0b3a3ff700 1 -- start start 2023-07-21T22:18:56.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.029+0000 7f0b3a3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b340ffaf0 0x7f0b340742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.029+0000 7f0b3a3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34100ce0 0x7f0b34072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.029+0000 7f0b3a3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b34101670 0x7f0b34072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.029+0000 7f0b3a3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b340735e0 con 0x7f0b34100ce0 2023-07-21T22:18:56.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.029+0000 7f0b3a3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b34073750 con 0x7f0b34101670 2023-07-21T22:18:56.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.029+0000 7f0b3a3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b3419f910 con 0x7f0b340ffaf0 2023-07-21T22:18:56.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b337fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34100ce0 0x7f0b34072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b337fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34100ce0 0x7f0b34072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52108/0 (socket says 172.21.15.151:52108) 2023-07-21T22:18:56.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b337fe700 1 -- 172.21.15.151:0/4221792653 learned_addr learned my addr 172.21.15.151:0/4221792653 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:56.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b3899c700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b34101670 0x7f0b34072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b33fff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b340ffaf0 0x7f0b340742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b337fe700 1 -- 172.21.15.151:0/4221792653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b340ffaf0 msgr2=0x7f0b340742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b337fe700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b340ffaf0 0x7f0b340742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b337fe700 1 -- 172.21.15.151:0/4221792653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b34101670 msgr2=0x7f0b34072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b337fe700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b34101670 0x7f0b34072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b337fe700 1 -- 172.21.15.151:0/4221792653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b2c009d00 con 0x7f0b34100ce0 2023-07-21T22:18:56.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b33fff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b340ffaf0 0x7f0b340742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:56.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b3899c700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b34101670 0x7f0b34072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:56.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.030+0000 7f0b337fe700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34100ce0 0x7f0b34072900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800e9a0 tx=0x7f0b2800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:56.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.031+0000 7f0b317fa700 1 -- 172.21.15.151:0/4221792653 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28009790 con 0x7f0b34100ce0 2023-07-21T22:18:56.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.031+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b3419fbf0 con 0x7f0b34100ce0 2023-07-21T22:18:56.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.031+0000 7f0b317fa700 1 -- 172.21.15.151:0/4221792653 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b2800cbd0 con 0x7f0b34100ce0 2023-07-21T22:18:56.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.031+0000 7f0b317fa700 1 -- 172.21.15.151:0/4221792653 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b28018680 con 0x7f0b34100ce0 2023-07-21T22:18:56.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.031+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b341a0120 con 0x7f0b34100ce0 2023-07-21T22:18:56.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.032+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b3410b1d0 con 0x7f0b34100ce0 2023-07-21T22:18:56.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.034+0000 7f0b317fa700 1 -- 172.21.15.151:0/4221792653 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f0b2800cd40 con 0x7f0b34100ce0 2023-07-21T22:18:56.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.035+0000 7f0b317fa700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b1c0a1150 0x7f0b1c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.035+0000 7f0b317fa700 1 -- 172.21.15.151:0/4221792653 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f0b28014070 con 0x7f0b34100ce0 2023-07-21T22:18:56.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.035+0000 7f0b33fff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b1c0a1150 0x7f0b1c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.036+0000 7f0b33fff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b1c0a1150 0x7f0b1c0a3600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0b34100b40 tx=0x7f0b2400b670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:56.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.037+0000 7f0b317fa700 1 -- 172.21.15.151:0/4221792653 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f0b28096620 con 0x7f0b34100ce0 2023-07-21T22:18:56.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.241+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b34106a20 con 0x7f0b34100ce0 2023-07-21T22:18:56.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.241+0000 7f0b317fa700 1 -- 172.21.15.151:0/4221792653 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b28026020 con 0x7f0b34100ce0 2023-07-21T22:18:56.286 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T22:18:56.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b1c0a1150 msgr2=0x7f0b1c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b1c0a1150 0x7f0b1c0a3600 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f0b34100b40 tx=0x7f0b2400b670 comp rx=0 tx=0).stop 2023-07-21T22:18:56.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34100ce0 msgr2=0x7f0b34072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34100ce0 0x7f0b34072900 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f0b2800e9a0 tx=0x7f0b2800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 shutdown_connections 2023-07-21T22:18:56.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b1c0a1150 0x7f0b1c0a3600 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b34101670 0x7f0b34072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b340ffaf0 0x7f0b340742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 --2- 172.21.15.151:0/4221792653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b34100ce0 0x7f0b34072900 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 >> 172.21.15.151:0/4221792653 conn(0x7f0b340fb130 msgr2=0x7f0b340fd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:56.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 shutdown_connections 2023-07-21T22:18:56.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.244+0000 7f0b3a3ff700 1 -- 172.21.15.151:0/4221792653 wait complete. 2023-07-21T22:18:56.307 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2023-07-21T22:18:56.307 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:18:56.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.462+0000 7f182f3ff700 1 -- 172.21.15.151:0/3696286899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18280744f0 msgr2=0x7f1828072940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.462+0000 7f182f3ff700 1 --2- 172.21.15.151:0/3696286899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18280744f0 0x7f1828072940 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f1824009990 tx=0x7f1824009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.462+0000 7f182f3ff700 1 -- 172.21.15.151:0/3696286899 shutdown_connections 2023-07-21T22:18:56.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.462+0000 7f182f3ff700 1 --2- 172.21.15.151:0/3696286899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18281079a0 0x7f1828109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.462+0000 7f182f3ff700 1 --2- 172.21.15.151:0/3696286899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18280744f0 0x7f1828072940 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.462+0000 7f182f3ff700 1 --2- 172.21.15.151:0/3696286899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1828072f10 0x7f1828073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.462+0000 7f182f3ff700 1 -- 172.21.15.151:0/3696286899 >> 172.21.15.151:0/3696286899 conn(0x7f18280fb110 msgr2=0x7f18280fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:56.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.462+0000 7f182f3ff700 1 -- 172.21.15.151:0/3696286899 shutdown_connections 2023-07-21T22:18:56.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.462+0000 7f182f3ff700 1 -- 172.21.15.151:0/3696286899 wait complete. 2023-07-21T22:18:56.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.463+0000 7f182f3ff700 1 Processor -- start 2023-07-21T22:18:56.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.463+0000 7f182f3ff700 1 -- start start 2023-07-21T22:18:56.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182f3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1828072f10 0x7f18281978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182f3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18280744f0 0x7f1828197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18281079a0 0x7f182819ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182819f440 con 0x7f18281079a0 2023-07-21T22:18:56.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182f3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182819f580 con 0x7f18280744f0 2023-07-21T22:18:56.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182f3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f182819f710 con 0x7f1828072f10 2023-07-21T22:18:56.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1828072f10 0x7f18281978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18281079a0 0x7f182819ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1828072f10 0x7f18281978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50274/0 (socket says 172.21.15.151:50274) 2023-07-21T22:18:56.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d19b700 1 -- 172.21.15.151:0/1954415019 learned_addr learned my addr 172.21.15.151:0/1954415019 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:56.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182c99a700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18280744f0 0x7f1828197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d19b700 1 -- 172.21.15.151:0/1954415019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18280744f0 msgr2=0x7f1828197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d19b700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18280744f0 0x7f1828197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d19b700 1 -- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18281079a0 msgr2=0x7f182819ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d19b700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18281079a0 0x7f182819ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d19b700 1 -- 172.21.15.151:0/1954415019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18240095f0 con 0x7f1828072f10 2023-07-21T22:18:56.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182c99a700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18280744f0 0x7f1828197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:56.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.464+0000 7f182d99c700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18281079a0 0x7f182819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:56.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.465+0000 7f182d19b700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1828072f10 0x7f18281978c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18240059d0 tx=0x7f1824004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:56.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.465+0000 7f181e7fc700 1 -- 172.21.15.151:0/1954415019 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f182401d070 con 0x7f1828072f10 2023-07-21T22:18:56.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.465+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f182819f990 con 0x7f1828072f10 2023-07-21T22:18:56.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.465+0000 7f181e7fc700 1 -- 172.21.15.151:0/1954415019 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f182400f460 con 0x7f1828072f10 2023-07-21T22:18:56.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.465+0000 7f181e7fc700 1 -- 172.21.15.151:0/1954415019 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1824021670 con 0x7f1828072f10 2023-07-21T22:18:56.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.465+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f182819fe40 con 0x7f1828072f10 2023-07-21T22:18:56.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.466+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18281060e0 con 0x7f1828072f10 2023-07-21T22:18:56.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.468+0000 7f181e7fc700 1 -- 172.21.15.151:0/1954415019 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f182400f5d0 con 0x7f1828072f10 2023-07-21T22:18:56.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.469+0000 7f181e7fc700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f18140a11a0 0x7f18140a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.470+0000 7f181e7fc700 1 -- 172.21.15.151:0/1954415019 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f18240cdf90 con 0x7f1828072f10 2023-07-21T22:18:56.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.470+0000 7f182c99a700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f18140a11a0 0x7f18140a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.470+0000 7f182c99a700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f18140a11a0 0x7f18140a3650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1818005fd0 tx=0x7f1818005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:56.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.472+0000 7f181e7fc700 1 -- 172.21.15.151:0/1954415019 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f1824097740 con 0x7f1828072f10 2023-07-21T22:18:56.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:56 smithi187 ceph-mon[96918]: pgmap v353: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2023-07-21T22:18:56.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:56 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1045592315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:56.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:56 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/858626908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:56.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:56 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/4221792653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:56.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:56 smithi195 ceph-mon[97365]: pgmap v353: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2023-07-21T22:18:56.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:56 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1045592315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:56.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:56 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/858626908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:56.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:56 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/4221792653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:56.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:56 smithi151 ceph-mon[95510]: pgmap v353: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 767 B/s wr, 8 op/s 2023-07-21T22:18:56.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:56 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1045592315' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:56.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:56 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/858626908' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:18:56.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:56 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/4221792653' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:18:56.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.714+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f182802c850 con 0x7f1828072f10 2023-07-21T22:18:56.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.715+0000 7f181e7fc700 1 -- 172.21.15.151:0/1954415019 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f182409ad60 con 0x7f1828072f10 2023-07-21T22:18:56.759 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:56.760 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:17:15.194775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:18:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f18140a11a0 msgr2=0x7f18140a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f18140a11a0 0x7f18140a3650 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1818005fd0 tx=0x7f1818005ee0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1828072f10 msgr2=0x7f18281978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1828072f10 0x7f18281978c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f18240059d0 tx=0x7f1824004790 comp rx=0 tx=0).stop 2023-07-21T22:18:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 shutdown_connections 2023-07-21T22:18:56.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f18140a11a0 0x7f18140a3650 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18281079a0 0x7f182819ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1828072f10 0x7f18281978c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 --2- 172.21.15.151:0/1954415019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18280744f0 0x7f1828197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 >> 172.21.15.151:0/1954415019 conn(0x7f18280fb110 msgr2=0x7f18280fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.717+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 shutdown_connections 2023-07-21T22:18:56.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.718+0000 7f182f3ff700 1 -- 172.21.15.151:0/1954415019 wait complete. 2023-07-21T22:18:56.764 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 23 2023-07-21T22:18:56.780 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2023-07-21T22:18:56.781 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2023-07-21T22:18:56.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:56.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.935+0000 7fd6783ff700 1 -- 172.21.15.151:0/835550555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670100cf0 msgr2=0x7fd670101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.935+0000 7fd6783ff700 1 --2- 172.21.15.151:0/835550555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670100cf0 0x7fd670101140 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd660009990 tx=0x7fd660009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.935+0000 7fd6783ff700 1 -- 172.21.15.151:0/835550555 shutdown_connections 2023-07-21T22:18:56.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.935+0000 7fd6783ff700 1 --2- 172.21.15.151:0/835550555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd670101680 0x7fd670107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.935+0000 7fd6783ff700 1 --2- 172.21.15.151:0/835550555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd6700ffb00 0x7fd6700fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.935+0000 7fd6783ff700 1 --2- 172.21.15.151:0/835550555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670100cf0 0x7fd670101140 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.935+0000 7fd6783ff700 1 -- 172.21.15.151:0/835550555 >> 172.21.15.151:0/835550555 conn(0x7fd6700fb0e0 msgr2=0x7fd6700fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:56.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.935+0000 7fd6783ff700 1 -- 172.21.15.151:0/835550555 shutdown_connections 2023-07-21T22:18:56.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.935+0000 7fd6783ff700 1 -- 172.21.15.151:0/835550555 wait complete. 2023-07-21T22:18:56.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.936+0000 7fd6783ff700 1 Processor -- start 2023-07-21T22:18:56.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.936+0000 7fd6783ff700 1 -- start start 2023-07-21T22:18:56.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd6783ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6700ffb00 0x7fd6700742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd6783ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd670100cf0 0x7fd670072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd6783ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670101680 0x7fd670072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd6783ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6700735e0 con 0x7fd670101680 2023-07-21T22:18:56.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd6783ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd670073750 con 0x7fd6700ffb00 2023-07-21T22:18:56.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd6783ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67019f7a0 con 0x7fd670100cf0 2023-07-21T22:18:56.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd67699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670101680 0x7fd670072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd67699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670101680 0x7fd670072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52142/0 (socket says 172.21.15.151:52142) 2023-07-21T22:18:56.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd67699c700 1 -- 172.21.15.151:0/959524545 learned_addr learned my addr 172.21.15.151:0/959524545 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:56.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd67619b700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6700ffb00 0x7fd6700742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.937+0000 7fd67599a700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd670100cf0 0x7fd670072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd67699c700 1 -- 172.21.15.151:0/959524545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd670100cf0 msgr2=0x7fd670072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd67699c700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd670100cf0 0x7fd670072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd67699c700 1 -- 172.21.15.151:0/959524545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6700ffb00 msgr2=0x7fd6700742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:56.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd67699c700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6700ffb00 0x7fd6700742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:56.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd67699c700 1 -- 172.21.15.151:0/959524545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6600095f0 con 0x7fd670101680 2023-07-21T22:18:56.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd67699c700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670101680 0x7fd670072e40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd668007ee0 tx=0x7fd66800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:56.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd6677fe700 1 -- 172.21.15.151:0/959524545 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668017070 con 0x7fd670101680 2023-07-21T22:18:56.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd6677fe700 1 -- 172.21.15.151:0/959524545 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd66800f040 con 0x7fd670101680 2023-07-21T22:18:56.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67019fa80 con 0x7fd670101680 2023-07-21T22:18:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd6677fe700 1 -- 172.21.15.151:0/959524545 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd668005570 con 0x7fd670101680 2023-07-21T22:18:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.938+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67019ff90 con 0x7fd670101680 2023-07-21T22:18:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.939+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd67010b1d0 con 0x7fd670101680 2023-07-21T22:18:56.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.941+0000 7fd6677fe700 1 -- 172.21.15.151:0/959524545 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd66800db20 con 0x7fd670101680 2023-07-21T22:18:56.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.943+0000 7fd6677fe700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd65c0a11a0 0x7fd65c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:56.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.943+0000 7fd6677fe700 1 -- 172.21.15.151:0/959524545 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fd6680cc010 con 0x7fd670101680 2023-07-21T22:18:56.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.943+0000 7fd67619b700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd65c0a11a0 0x7fd65c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:56.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.943+0000 7fd67619b700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd65c0a11a0 0x7fd65c0a3650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd670100b50 tx=0x7fd66c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:56.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:56.947+0000 7fd6677fe700 1 -- 172.21.15.151:0/959524545 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd668095790 con 0x7fd670101680 2023-07-21T22:18:57.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.140+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd670060950 con 0x7fd65c0a11a0 2023-07-21T22:18:57.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.152+0000 7fd6677fe700 1 -- 172.21.15.151:0/959524545 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343281 (secure 0 0 0) 0x7fd670060950 con 0x7fd65c0a11a0 2023-07-21T22:18:57.200 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:57.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.156+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd65c0a11a0 msgr2=0x7fd65c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.156+0000 7fd6783ff700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd65c0a11a0 0x7fd65c0a3650 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd670100b50 tx=0x7fd66c00b410 comp rx=0 tx=0).stop 2023-07-21T22:18:57.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.156+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670101680 msgr2=0x7fd670072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.156+0000 7fd6783ff700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670101680 0x7fd670072e40 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd668007ee0 tx=0x7fd66800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.157+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 shutdown_connections 2023-07-21T22:18:57.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.157+0000 7fd6783ff700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd65c0a11a0 0x7fd65c0a3650 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.157+0000 7fd6783ff700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6700ffb00 0x7fd6700742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.157+0000 7fd6783ff700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd670101680 0x7fd670072e40 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.157+0000 7fd6783ff700 1 --2- 172.21.15.151:0/959524545 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd670100cf0 0x7fd670072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.157+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 >> 172.21.15.151:0/959524545 conn(0x7fd6700fb0e0 msgr2=0x7fd6700fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.157+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 shutdown_connections 2023-07-21T22:18:57.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.157+0000 7fd6783ff700 1 -- 172.21.15.151:0/959524545 wait complete. 2023-07-21T22:18:57.204 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-07-21T22:18:57.220 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2023-07-21T22:18:56.880729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653183,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":761,"num_read_kb":496,"num_write":345,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":781,"ondisk_log_size":781,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334976,"kb_used_data":11552,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606848,"statfs":{"total":1151940427776,"available":1151597412352,"internally_reserved":0,"allocated":11829248,"data_stored":7433924,"data_compressed":108096,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1449,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003003"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892270+0000","last_change":"2023-07-21T22:17:09.850731+0000","last_active":"2023-07-21T22:18:42.892270+0000","last_peered":"2023-07-21T22:18:42.892270+0000","last_clean":"2023-07-21T22:18:42.892270+0000","last_became_active":"2023-07-21T22:17:09.849185+0000","last_became_peered":"2023-07-21T22:17:09.849185+0000","last_unstale":"2023-07-21T22:18:42.892270+0000","last_undegraded":"2023-07-21T22:18:42.892270+0000","last_fullsized":"2023-07-21T22:18:42.892270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:35.659774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.887603+0000","last_change":"2023-07-21T22:17:09.853210+0000","last_active":"2023-07-21T22:18:42.887603+0000","last_peered":"2023-07-21T22:18:42.887603+0000","last_clean":"2023-07-21T22:18:42.887603+0000","last_became_active":"2023-07-21T22:17:09.852822+0000","last_became_peered":"2023-07-21T22:17:09.852822+0000","last_unstale":"2023-07-21T22:18:42.887603+0000","last_undegraded":"2023-07-21T22:18:42.887603+0000","last_fullsized":"2023-07-21T22:18:42.887603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:20.599740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891804+0000","last_change":"2023-07-21T22:17:09.850123+0000","last_active":"2023-07-21T22:18:42.891804+0000","last_peered":"2023-07-21T22:18:42.891804+0000","last_clean":"2023-07-21T22:18:42.891804+0000","last_became_active":"2023-07-21T22:17:09.849763+0000","last_became_peered":"2023-07-21T22:17:09.849763+0000","last_unstale":"2023-07-21T22:18:42.891804+0000","last_undegraded":"2023-07-21T22:18:42.891804+0000","last_fullsized":"2023-07-21T22:18:42.891804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:56.684648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.882006+0000","last_change":"2023-07-21T22:17:44.306609+0000","last_active":"2023-07-21T22:18:42.882006+0000","last_peered":"2023-07-21T22:18:42.882006+0000","last_clean":"2023-07-21T22:18:42.882006+0000","last_became_active":"2023-07-21T22:17:44.306274+0000","last_became_peered":"2023-07-21T22:17:44.306274+0000","last_unstale":"2023-07-21T22:18:42.882006+0000","last_undegraded":"2023-07-21T22:18:42.882006+0000","last_fullsized":"2023-07-21T22:18:42.882006+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:18:47.720581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893357+0000","last_change":"2023-07-21T22:17:09.836811+0000","last_active":"2023-07-21T22:18:42.893357+0000","last_peered":"2023-07-21T22:18:42.893357+0000","last_clean":"2023-07-21T22:18:42.893357+0000","last_became_active":"2023-07-21T22:17:09.836470+0000","last_became_peered":"2023-07-21T22:17:09.836470+0000","last_unstale":"2023-07-21T22:18:42.893357+0000","last_undegraded":"2023-07-21T22:18:42.893357+0000","last_fullsized":"2023-07-21T22:18:42.893357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:19.711901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891053+0000","last_change":"2023-07-21T22:17:09.845801+0000","last_active":"2023-07-21T22:18:42.891053+0000","last_peered":"2023-07-21T22:18:42.891053+0000","last_clean":"2023-07-21T22:18:42.891053+0000","last_became_active":"2023-07-21T22:17:09.844938+0000","last_became_peered":"2023-07-21T22:17:09.844938+0000","last_unstale":"2023-07-21T22:18:42.891053+0000","last_undegraded":"2023-07-21T22:18:42.891053+0000","last_fullsized":"2023-07-21T22:18:42.891053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:35.691429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.897535+0000","last_change":"2023-07-21T22:17:09.850392+0000","last_active":"2023-07-21T22:18:42.897535+0000","last_peered":"2023-07-21T22:18:42.897535+0000","last_clean":"2023-07-21T22:18:42.897535+0000","last_became_active":"2023-07-21T22:17:09.850013+0000","last_became_peered":"2023-07-21T22:17:09.850013+0000","last_unstale":"2023-07-21T22:18:42.897535+0000","last_undegraded":"2023-07-21T22:18:42.897535+0000","last_fullsized":"2023-07-21T22:18:42.897535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:04.984082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.894377+0000","last_change":"2023-07-21T22:17:09.845425+0000","last_active":"2023-07-21T22:18:42.894377+0000","last_peered":"2023-07-21T22:18:42.894377+0000","last_clean":"2023-07-21T22:18:42.894377+0000","last_became_active":"2023-07-21T22:17:09.845090+0000","last_became_peered":"2023-07-21T22:17:09.845090+0000","last_unstale":"2023-07-21T22:18:42.894377+0000","last_undegraded":"2023-07-21T22:18:42.894377+0000","last_fullsized":"2023-07-21T22:18:42.894377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:59.843469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891935+0000","last_change":"2023-07-21T22:17:09.845600+0000","last_active":"2023-07-21T22:18:42.891935+0000","last_peered":"2023-07-21T22:18:42.891935+0000","last_clean":"2023-07-21T22:18:42.891935+0000","last_became_active":"2023-07-21T22:17:09.845260+0000","last_became_peered":"2023-07-21T22:17:09.845260+0000","last_unstale":"2023-07-21T22:18:42.891935+0000","last_undegraded":"2023-07-21T22:18:42.891935+0000","last_fullsized":"2023-07-21T22:18:42.891935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:49.477671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891133+0000","last_change":"2023-07-21T22:17:09.846172+0000","last_active":"2023-07-21T22:18:42.891133+0000","last_peered":"2023-07-21T22:18:42.891133+0000","last_clean":"2023-07-21T22:18:42.891133+0000","last_became_active":"2023-07-21T22:17:09.845827+0000","last_became_peered":"2023-07-21T22:17:09.845827+0000","last_unstale":"2023-07-21T22:18:42.891133+0000","last_undegraded":"2023-07-21T22:18:42.891133+0000","last_fullsized":"2023-07-21T22:18:42.891133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:38.644866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896178+0000","last_change":"2023-07-21T22:17:09.852728+0000","last_active":"2023-07-21T22:18:42.896178+0000","last_peered":"2023-07-21T22:18:42.896178+0000","last_clean":"2023-07-21T22:18:42.896178+0000","last_became_active":"2023-07-21T22:17:09.852152+0000","last_became_peered":"2023-07-21T22:17:09.852152+0000","last_unstale":"2023-07-21T22:18:42.896178+0000","last_undegraded":"2023-07-21T22:18:42.896178+0000","last_fullsized":"2023-07-21T22:18:42.896178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:10.530218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889841+0000","last_change":"2023-07-21T22:17:09.850565+0000","last_active":"2023-07-21T22:18:42.889841+0000","last_peered":"2023-07-21T22:18:42.889841+0000","last_clean":"2023-07-21T22:18:42.889841+0000","last_became_active":"2023-07-21T22:17:09.850162+0000","last_became_peered":"2023-07-21T22:17:09.850162+0000","last_unstale":"2023-07-21T22:18:42.889841+0000","last_undegraded":"2023-07-21T22:18:42.889841+0000","last_fullsized":"2023-07-21T22:18:42.889841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:48.591116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893294+0000","last_change":"2023-07-21T22:17:09.836732+0000","last_active":"2023-07-21T22:18:42.893294+0000","last_peered":"2023-07-21T22:18:42.893294+0000","last_clean":"2023-07-21T22:18:42.893294+0000","last_became_active":"2023-07-21T22:17:09.836446+0000","last_became_peered":"2023-07-21T22:17:09.836446+0000","last_unstale":"2023-07-21T22:18:42.893294+0000","last_undegraded":"2023-07-21T22:18:42.893294+0000","last_fullsized":"2023-07-21T22:18:42.893294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:05.998599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889472+0000","last_change":"2023-07-21T22:17:09.852624+0000","last_active":"2023-07-21T22:18:42.889472+0000","last_peered":"2023-07-21T22:18:42.889472+0000","last_clean":"2023-07-21T22:18:42.889472+0000","last_became_active":"2023-07-21T22:17:09.852353+0000","last_became_peered":"2023-07-21T22:17:09.852353+0000","last_unstale":"2023-07-21T22:18:42.889472+0000","last_undegraded":"2023-07-21T22:18:42.889472+0000","last_fullsized":"2023-07-21T22:18:42.889472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:42.502841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890706+0000","last_change":"2023-07-21T22:17:09.860554+0000","last_active":"2023-07-21T22:18:42.890706+0000","last_peered":"2023-07-21T22:18:42.890706+0000","last_clean":"2023-07-21T22:18:42.890706+0000","last_became_active":"2023-07-21T22:17:09.860119+0000","last_became_peered":"2023-07-21T22:17:09.860119+0000","last_unstale":"2023-07-21T22:18:42.890706+0000","last_undegraded":"2023-07-21T22:18:42.890706+0000","last_fullsized":"2023-07-21T22:18:42.890706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:58.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.898261+0000","last_change":"2023-07-21T22:17:09.850522+0000","last_active":"2023-07-21T22:18:42.898261+0000","last_peered":"2023-07-21T22:18:42.898261+0000","last_clean":"2023-07-21T22:18:42.898261+0000","last_became_active":"2023-07-21T22:17:09.850243+0000","last_became_peered":"2023-07-21T22:17:09.850243+0000","last_unstale":"2023-07-21T22:18:42.898261+0000","last_undegraded":"2023-07-21T22:18:42.898261+0000","last_fullsized":"2023-07-21T22:18:42.898261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:10.569656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892471+0000","last_change":"2023-07-21T22:17:09.848552+0000","last_active":"2023-07-21T22:18:42.892471+0000","last_peered":"2023-07-21T22:18:42.892471+0000","last_clean":"2023-07-21T22:18:42.892471+0000","last_became_active":"2023-07-21T22:17:09.848110+0000","last_became_peered":"2023-07-21T22:17:09.848110+0000","last_unstale":"2023-07-21T22:18:42.892471+0000","last_undegraded":"2023-07-21T22:18:42.892471+0000","last_fullsized":"2023-07-21T22:18:42.892471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:12.712668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891829+0000","last_change":"2023-07-21T22:17:09.848899+0000","last_active":"2023-07-21T22:18:42.891829+0000","last_peered":"2023-07-21T22:18:42.891829+0000","last_clean":"2023-07-21T22:18:42.891829+0000","last_became_active":"2023-07-21T22:17:09.848606+0000","last_became_peered":"2023-07-21T22:17:09.848606+0000","last_unstale":"2023-07-21T22:18:42.891829+0000","last_undegraded":"2023-07-21T22:18:42.891829+0000","last_fullsized":"2023-07-21T22:18:42.891829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:51.141831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.887791+0000","last_change":"2023-07-21T22:17:09.838033+0000","last_active":"2023-07-21T22:18:42.887791+0000","last_peered":"2023-07-21T22:18:42.887791+0000","last_clean":"2023-07-21T22:18:42.887791+0000","last_became_active":"2023-07-21T22:17:09.837532+0000","last_became_peered":"2023-07-21T22:17:09.837532+0000","last_unstale":"2023-07-21T22:18:42.887791+0000","last_undegraded":"2023-07-21T22:18:42.887791+0000","last_fullsized":"2023-07-21T22:18:42.887791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:24.281689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302370+0000","last_change":"2023-07-21T22:17:08.867849+0000","last_active":"2023-07-21T22:17:44.302370+0000","last_peered":"2023-07-21T22:17:44.302370+0000","last_clean":"2023-07-21T22:17:44.302370+0000","last_became_active":"2023-07-21T22:17:08.866245+0000","last_became_peered":"2023-07-21T22:17:08.866245+0000","last_unstale":"2023-07-21T22:17:44.302370+0000","last_undegraded":"2023-07-21T22:17:44.302370+0000","last_fullsized":"2023-07-21T22:17:44.302370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:37.153114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.886760+0000","last_change":"2023-07-21T22:17:09.841402+0000","last_active":"2023-07-21T22:18:42.886760+0000","last_peered":"2023-07-21T22:18:42.886760+0000","last_clean":"2023-07-21T22:18:42.886760+0000","last_became_active":"2023-07-21T22:17:09.841009+0000","last_became_peered":"2023-07-21T22:17:09.841009+0000","last_unstale":"2023-07-21T22:18:42.886760+0000","last_undegraded":"2023-07-21T22:18:42.886760+0000","last_fullsized":"2023-07-21T22:18:42.886760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:08.232799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304136+0000","last_change":"2023-07-21T22:17:08.864236+0000","last_active":"2023-07-21T22:17:44.304136+0000","last_peered":"2023-07-21T22:17:44.304136+0000","last_clean":"2023-07-21T22:17:44.304136+0000","last_became_active":"2023-07-21T22:17:08.863579+0000","last_became_peered":"2023-07-21T22:17:08.863579+0000","last_unstale":"2023-07-21T22:17:44.304136+0000","last_undegraded":"2023-07-21T22:17:44.304136+0000","last_fullsized":"2023-07-21T22:17:44.304136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:10.453785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889151+0000","last_change":"2023-07-21T22:17:09.852677+0000","last_active":"2023-07-21T22:18:42.889151+0000","last_peered":"2023-07-21T22:18:42.889151+0000","last_clean":"2023-07-21T22:18:42.889151+0000","last_became_active":"2023-07-21T22:17:09.852326+0000","last_became_peered":"2023-07-21T22:17:09.852326+0000","last_unstale":"2023-07-21T22:18:42.889151+0000","last_undegraded":"2023-07-21T22:18:42.889151+0000","last_fullsized":"2023-07-21T22:18:42.889151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:09.817158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304951+0000","last_change":"2023-07-21T22:17:08.867521+0000","last_active":"2023-07-21T22:17:44.304951+0000","last_peered":"2023-07-21T22:17:44.304951+0000","last_clean":"2023-07-21T22:17:44.304951+0000","last_became_active":"2023-07-21T22:17:08.867125+0000","last_became_peered":"2023-07-21T22:17:08.867125+0000","last_unstale":"2023-07-21T22:17:44.304951+0000","last_undegraded":"2023-07-21T22:17:44.304951+0000","last_fullsized":"2023-07-21T22:17:44.304951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:36:09.254395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893649+0000","last_change":"2023-07-21T22:17:09.846296+0000","last_active":"2023-07-21T22:18:42.893649+0000","last_peered":"2023-07-21T22:18:42.893649+0000","last_clean":"2023-07-21T22:18:42.893649+0000","last_became_active":"2023-07-21T22:17:09.845947+0000","last_became_peered":"2023-07-21T22:17:09.845947+0000","last_unstale":"2023-07-21T22:18:42.893649+0000","last_undegraded":"2023-07-21T22:18:42.893649+0000","last_fullsized":"2023-07-21T22:18:42.893649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:34:46.553617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305483+0000","last_change":"2023-07-21T22:17:08.866709+0000","last_active":"2023-07-21T22:17:44.305483+0000","last_peered":"2023-07-21T22:17:44.305483+0000","last_clean":"2023-07-21T22:17:44.305483+0000","last_became_active":"2023-07-21T22:17:08.866277+0000","last_became_peered":"2023-07-21T22:17:08.866277+0000","last_unstale":"2023-07-21T22:17:44.305483+0000","last_undegraded":"2023-07-21T22:17:44.305483+0000","last_fullsized":"2023-07-21T22:17:44.305483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:13.480396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893496+0000","last_change":"2023-07-21T22:17:09.855068+0000","last_active":"2023-07-21T22:18:42.893496+0000","last_peered":"2023-07-21T22:18:42.893496+0000","last_clean":"2023-07-21T22:18:42.893496+0000","last_became_active":"2023-07-21T22:17:09.854697+0000","last_became_peered":"2023-07-21T22:17:09.854697+0000","last_unstale":"2023-07-21T22:18:42.893496+0000","last_undegraded":"2023-07-21T22:18:42.893496+0000","last_fullsized":"2023-07-21T22:18:42.893496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:46.560534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'6","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:53.377977+0000","last_change":"2023-07-21T22:17:08.864292+0000","last_active":"2023-07-21T22:18:53.377977+0000","last_peered":"2023-07-21T22:18:53.377977+0000","last_clean":"2023-07-21T22:18:53.377977+0000","last_became_active":"2023-07-21T22:17:08.863243+0000","last_became_peered":"2023-07-21T22:17:08.863243+0000","last_unstale":"2023-07-21T22:18:53.377977+0000","last_undegraded":"2023-07-21T22:18:53.377977+0000","last_fullsized":"2023-07-21T22:18:53.377977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:46:18.247508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.876771+0000","last_change":"2023-07-21T22:17:09.840756+0000","last_active":"2023-07-21T22:18:42.876771+0000","last_peered":"2023-07-21T22:18:42.876771+0000","last_clean":"2023-07-21T22:18:42.876771+0000","last_became_active":"2023-07-21T22:17:09.840421+0000","last_became_peered":"2023-07-21T22:17:09.840421+0000","last_unstale":"2023-07-21T22:18:42.876771+0000","last_undegraded":"2023-07-21T22:18:42.876771+0000","last_fullsized":"2023-07-21T22:18:42.876771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:30.874703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.491774+0000","last_change":"2023-07-21T22:17:44.491774+0000","last_active":"2023-07-21T22:17:44.491774+0000","last_peered":"2023-07-21T22:17:44.491774+0000","last_clean":"2023-07-21T22:17:44.491774+0000","last_became_active":"2023-07-21T22:17:44.488479+0000","last_became_peered":"2023-07-21T22:17:44.488479+0000","last_unstale":"2023-07-21T22:17:44.491774+0000","last_undegraded":"2023-07-21T22:17:44.491774+0000","last_fullsized":"2023-07-21T22:17:44.491774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:37:54.678291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889331+0000","last_change":"2023-07-21T22:17:09.839359+0000","last_active":"2023-07-21T22:18:42.889331+0000","last_peered":"2023-07-21T22:18:42.889331+0000","last_clean":"2023-07-21T22:18:42.889331+0000","last_became_active":"2023-07-21T22:17:09.839026+0000","last_became_peered":"2023-07-21T22:17:09.839026+0000","last_unstale":"2023-07-21T22:18:42.889331+0000","last_undegraded":"2023-07-21T22:18:42.889331+0000","last_fullsized":"2023-07-21T22:18:42.889331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:39.641691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299788+0000","last_change":"2023-07-21T22:17:08.861680+0000","last_active":"2023-07-21T22:17:44.299788+0000","last_peered":"2023-07-21T22:17:44.299788+0000","last_clean":"2023-07-21T22:17:44.299788+0000","last_became_active":"2023-07-21T22:17:08.861348+0000","last_became_peered":"2023-07-21T22:17:08.861348+0000","last_unstale":"2023-07-21T22:17:44.299788+0000","last_undegraded":"2023-07-21T22:17:44.299788+0000","last_fullsized":"2023-07-21T22:17:44.299788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:54.809555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889908+0000","last_change":"2023-07-21T22:17:09.840166+0000","last_active":"2023-07-21T22:18:42.889908+0000","last_peered":"2023-07-21T22:18:42.889908+0000","last_clean":"2023-07-21T22:18:42.889908+0000","last_became_active":"2023-07-21T22:17:09.839850+0000","last_became_peered":"2023-07-21T22:17:09.839850+0000","last_unstale":"2023-07-21T22:18:42.889908+0000","last_undegraded":"2023-07-21T22:18:42.889908+0000","last_fullsized":"2023-07-21T22:18:42.889908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:43.813137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485915+0000","last_change":"2023-07-21T22:17:08.864838+0000","last_active":"2023-07-21T22:17:44.485915+0000","last_peered":"2023-07-21T22:17:44.485915+0000","last_clean":"2023-07-21T22:17:44.485915+0000","last_became_active":"2023-07-21T22:17:08.864484+0000","last_became_peered":"2023-07-21T22:17:08.864484+0000","last_unstale":"2023-07-21T22:17:44.485915+0000","last_undegraded":"2023-07-21T22:17:44.485915+0000","last_fullsized":"2023-07-21T22:17:44.485915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:55:33.300808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891104+0000","last_change":"2023-07-21T22:17:09.836214+0000","last_active":"2023-07-21T22:18:42.891104+0000","last_peered":"2023-07-21T22:18:42.891104+0000","last_clean":"2023-07-21T22:18:42.891104+0000","last_became_active":"2023-07-21T22:17:09.835877+0000","last_became_peered":"2023-07-21T22:17:09.835877+0000","last_unstale":"2023-07-21T22:18:42.891104+0000","last_undegraded":"2023-07-21T22:18:42.891104+0000","last_fullsized":"2023-07-21T22:18:42.891104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:50.733216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:51.372317+0000","last_change":"2023-07-21T22:17:08.861801+0000","last_active":"2023-07-21T22:18:51.372317+0000","last_peered":"2023-07-21T22:18:51.372317+0000","last_clean":"2023-07-21T22:18:51.372317+0000","last_became_active":"2023-07-21T22:17:08.861391+0000","last_became_peered":"2023-07-21T22:17:08.861391+0000","last_unstale":"2023-07-21T22:18:51.372317+0000","last_undegraded":"2023-07-21T22:18:51.372317+0000","last_fullsized":"2023-07-21T22:18:51.372317+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:27:55.305051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892935+0000","last_change":"2023-07-21T22:17:09.842155+0000","last_active":"2023-07-21T22:18:42.892935+0000","last_peered":"2023-07-21T22:18:42.892935+0000","last_clean":"2023-07-21T22:18:42.892935+0000","last_became_active":"2023-07-21T22:17:09.841845+0000","last_became_peered":"2023-07-21T22:17:09.841845+0000","last_unstale":"2023-07-21T22:18:42.892935+0000","last_undegraded":"2023-07-21T22:18:42.892935+0000","last_fullsized":"2023-07-21T22:18:42.892935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:10.209278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304566+0000","last_change":"2023-07-21T22:17:08.858727+0000","last_active":"2023-07-21T22:17:44.304566+0000","last_peered":"2023-07-21T22:17:44.304566+0000","last_clean":"2023-07-21T22:17:44.304566+0000","last_became_active":"2023-07-21T22:17:08.858376+0000","last_became_peered":"2023-07-21T22:17:08.858376+0000","last_unstale":"2023-07-21T22:17:44.304566+0000","last_undegraded":"2023-07-21T22:17:44.304566+0000","last_fullsized":"2023-07-21T22:17:44.304566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:35.053954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.882407+0000","last_change":"2023-07-21T22:17:09.857300+0000","last_active":"2023-07-21T22:18:42.882407+0000","last_peered":"2023-07-21T22:18:42.882407+0000","last_clean":"2023-07-21T22:18:42.882407+0000","last_became_active":"2023-07-21T22:17:09.856932+0000","last_became_peered":"2023-07-21T22:17:09.856932+0000","last_unstale":"2023-07-21T22:18:42.882407+0000","last_undegraded":"2023-07-21T22:18:42.882407+0000","last_fullsized":"2023-07-21T22:18:42.882407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:28.202771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486481+0000","last_change":"2023-07-21T22:17:08.865488+0000","last_active":"2023-07-21T22:17:44.486481+0000","last_peered":"2023-07-21T22:17:44.486481+0000","last_clean":"2023-07-21T22:17:44.486481+0000","last_became_active":"2023-07-21T22:17:08.865050+0000","last_became_peered":"2023-07-21T22:17:08.865050+0000","last_unstale":"2023-07-21T22:17:44.486481+0000","last_undegraded":"2023-07-21T22:17:44.486481+0000","last_fullsized":"2023-07-21T22:17:44.486481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:12:41.386381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.894208+0000","last_change":"2023-07-21T22:17:09.849880+0000","last_active":"2023-07-21T22:18:42.894208+0000","last_peered":"2023-07-21T22:18:42.894208+0000","last_clean":"2023-07-21T22:18:42.894208+0000","last_became_active":"2023-07-21T22:17:09.849552+0000","last_became_peered":"2023-07-21T22:17:09.849552+0000","last_unstale":"2023-07-21T22:18:42.894208+0000","last_undegraded":"2023-07-21T22:18:42.894208+0000","last_fullsized":"2023-07-21T22:18:42.894208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:57.861104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'31","reported_seq":255,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:52.386870+0000","last_change":"2023-07-21T22:17:08.861663+0000","last_active":"2023-07-21T22:18:52.386870+0000","last_peered":"2023-07-21T22:18:52.386870+0000","last_clean":"2023-07-21T22:18:52.386870+0000","last_became_active":"2023-07-21T22:17:08.861339+0000","last_became_peered":"2023-07-21T22:17:08.861339+0000","last_unstale":"2023-07-21T22:18:52.386870+0000","last_undegraded":"2023-07-21T22:18:52.386870+0000","last_fullsized":"2023-07-21T22:18:52.386870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:23:16.097183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57558,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":158,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.898347+0000","last_change":"2023-07-21T22:17:09.841543+0000","last_active":"2023-07-21T22:18:42.898347+0000","last_peered":"2023-07-21T22:18:42.898347+0000","last_clean":"2023-07-21T22:18:42.898347+0000","last_became_active":"2023-07-21T22:17:09.841235+0000","last_became_peered":"2023-07-21T22:17:09.841235+0000","last_unstale":"2023-07-21T22:18:42.898347+0000","last_undegraded":"2023-07-21T22:18:42.898347+0000","last_fullsized":"2023-07-21T22:18:42.898347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:37:58.825011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303802+0000","last_change":"2023-07-21T22:17:08.855145+0000","last_active":"2023-07-21T22:17:44.303802+0000","last_peered":"2023-07-21T22:17:44.303802+0000","last_clean":"2023-07-21T22:17:44.303802+0000","last_became_active":"2023-07-21T22:17:08.853279+0000","last_became_peered":"2023-07-21T22:17:08.853279+0000","last_unstale":"2023-07-21T22:17:44.303802+0000","last_undegraded":"2023-07-21T22:17:44.303802+0000","last_fullsized":"2023-07-21T22:17:44.303802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:10.333188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896271+0000","last_change":"2023-07-21T22:17:09.835656+0000","last_active":"2023-07-21T22:18:42.896271+0000","last_peered":"2023-07-21T22:18:42.896271+0000","last_clean":"2023-07-21T22:18:42.896271+0000","last_became_active":"2023-07-21T22:17:09.835309+0000","last_became_peered":"2023-07-21T22:17:09.835309+0000","last_unstale":"2023-07-21T22:18:42.896271+0000","last_undegraded":"2023-07-21T22:18:42.896271+0000","last_fullsized":"2023-07-21T22:18:42.896271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:59.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486159+0000","last_change":"2023-07-21T22:17:08.864811+0000","last_active":"2023-07-21T22:17:44.486159+0000","last_peered":"2023-07-21T22:17:44.486159+0000","last_clean":"2023-07-21T22:17:44.486159+0000","last_became_active":"2023-07-21T22:17:08.864428+0000","last_became_peered":"2023-07-21T22:17:08.864428+0000","last_unstale":"2023-07-21T22:17:44.486159+0000","last_undegraded":"2023-07-21T22:17:44.486159+0000","last_fullsized":"2023-07-21T22:17:44.486159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:09.637705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.899354+0000","last_change":"2023-07-21T22:17:09.837713+0000","last_active":"2023-07-21T22:18:42.899354+0000","last_peered":"2023-07-21T22:18:42.899354+0000","last_clean":"2023-07-21T22:18:42.899354+0000","last_became_active":"2023-07-21T22:17:09.837420+0000","last_became_peered":"2023-07-21T22:17:09.837420+0000","last_unstale":"2023-07-21T22:18:42.899354+0000","last_undegraded":"2023-07-21T22:18:42.899354+0000","last_fullsized":"2023-07-21T22:18:42.899354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:00.392623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":129,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:53.406532+0000","last_change":"2023-07-21T22:17:08.854376+0000","last_active":"2023-07-21T22:18:53.406532+0000","last_peered":"2023-07-21T22:18:53.406532+0000","last_clean":"2023-07-21T22:18:53.406532+0000","last_became_active":"2023-07-21T22:17:08.854031+0000","last_became_peered":"2023-07-21T22:17:08.854031+0000","last_unstale":"2023-07-21T22:18:53.406532+0000","last_undegraded":"2023-07-21T22:18:53.406532+0000","last_fullsized":"2023-07-21T22:18:53.406532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:12.749236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.897798+0000","last_change":"2023-07-21T22:17:09.851279+0000","last_active":"2023-07-21T22:18:42.897798+0000","last_peered":"2023-07-21T22:18:42.897798+0000","last_clean":"2023-07-21T22:18:42.897798+0000","last_became_active":"2023-07-21T22:17:09.850948+0000","last_became_peered":"2023-07-21T22:17:09.850948+0000","last_unstale":"2023-07-21T22:18:42.897798+0000","last_undegraded":"2023-07-21T22:18:42.897798+0000","last_fullsized":"2023-07-21T22:18:42.897798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:10:00.991437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305069+0000","last_change":"2023-07-21T22:17:08.865425+0000","last_active":"2023-07-21T22:17:44.305069+0000","last_peered":"2023-07-21T22:17:44.305069+0000","last_clean":"2023-07-21T22:17:44.305069+0000","last_became_active":"2023-07-21T22:17:08.865067+0000","last_became_peered":"2023-07-21T22:17:08.865067+0000","last_unstale":"2023-07-21T22:17:44.305069+0000","last_undegraded":"2023-07-21T22:17:44.305069+0000","last_fullsized":"2023-07-21T22:17:44.305069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:55.543750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.872751+0000","last_change":"2023-07-21T22:17:09.844916+0000","last_active":"2023-07-21T22:18:42.872751+0000","last_peered":"2023-07-21T22:18:42.872751+0000","last_clean":"2023-07-21T22:18:42.872751+0000","last_became_active":"2023-07-21T22:17:09.844632+0000","last_became_peered":"2023-07-21T22:17:09.844632+0000","last_unstale":"2023-07-21T22:18:42.872751+0000","last_undegraded":"2023-07-21T22:18:42.872751+0000","last_fullsized":"2023-07-21T22:18:42.872751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:32:46.857855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305478+0000","last_change":"2023-07-21T22:17:08.862954+0000","last_active":"2023-07-21T22:17:44.305478+0000","last_peered":"2023-07-21T22:17:44.305478+0000","last_clean":"2023-07-21T22:17:44.305478+0000","last_became_active":"2023-07-21T22:17:08.862598+0000","last_became_peered":"2023-07-21T22:17:08.862598+0000","last_unstale":"2023-07-21T22:17:44.305478+0000","last_undegraded":"2023-07-21T22:17:44.305478+0000","last_fullsized":"2023-07-21T22:17:44.305478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:02.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891062+0000","last_change":"2023-07-21T22:17:44.488032+0000","last_active":"2023-07-21T22:18:42.891062+0000","last_peered":"2023-07-21T22:18:42.891062+0000","last_clean":"2023-07-21T22:18:42.891062+0000","last_became_active":"2023-07-21T22:17:44.487524+0000","last_became_peered":"2023-07-21T22:17:44.487524+0000","last_unstale":"2023-07-21T22:18:42.891062+0000","last_undegraded":"2023-07-21T22:18:42.891062+0000","last_fullsized":"2023-07-21T22:18:42.891062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:01.489283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302366+0000","last_change":"2023-07-21T22:17:08.862514+0000","last_active":"2023-07-21T22:17:44.302366+0000","last_peered":"2023-07-21T22:17:44.302366+0000","last_clean":"2023-07-21T22:17:44.302366+0000","last_became_active":"2023-07-21T22:17:08.862223+0000","last_became_peered":"2023-07-21T22:17:08.862223+0000","last_unstale":"2023-07-21T22:17:44.302366+0000","last_undegraded":"2023-07-21T22:17:44.302366+0000","last_fullsized":"2023-07-21T22:17:44.302366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:37:34.099818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893033+0000","last_change":"2023-07-21T22:17:09.852621+0000","last_active":"2023-07-21T22:18:42.893033+0000","last_peered":"2023-07-21T22:18:42.893033+0000","last_clean":"2023-07-21T22:18:42.893033+0000","last_became_active":"2023-07-21T22:17:09.852233+0000","last_became_peered":"2023-07-21T22:17:09.852233+0000","last_unstale":"2023-07-21T22:18:42.893033+0000","last_undegraded":"2023-07-21T22:18:42.893033+0000","last_fullsized":"2023-07-21T22:18:42.893033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:17.187991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304312+0000","last_change":"2023-07-21T22:17:08.861344+0000","last_active":"2023-07-21T22:17:44.304312+0000","last_peered":"2023-07-21T22:17:44.304312+0000","last_clean":"2023-07-21T22:17:44.304312+0000","last_became_active":"2023-07-21T22:17:08.860978+0000","last_became_peered":"2023-07-21T22:17:08.860978+0000","last_unstale":"2023-07-21T22:17:44.304312+0000","last_undegraded":"2023-07-21T22:17:44.304312+0000","last_fullsized":"2023-07-21T22:17:44.304312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:21.901465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890480+0000","last_change":"2023-07-21T22:17:09.852314+0000","last_active":"2023-07-21T22:18:42.890480+0000","last_peered":"2023-07-21T22:18:42.890480+0000","last_clean":"2023-07-21T22:18:42.890480+0000","last_became_active":"2023-07-21T22:17:09.852137+0000","last_became_peered":"2023-07-21T22:17:09.852137+0000","last_unstale":"2023-07-21T22:18:42.890480+0000","last_undegraded":"2023-07-21T22:18:42.890480+0000","last_fullsized":"2023-07-21T22:18:42.890480+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:02.728732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890529+0000","last_change":"2023-07-21T22:17:09.839387+0000","last_active":"2023-07-21T22:18:42.890529+0000","last_peered":"2023-07-21T22:18:42.890529+0000","last_clean":"2023-07-21T22:18:42.890529+0000","last_became_active":"2023-07-21T22:17:09.839052+0000","last_became_peered":"2023-07-21T22:17:09.839052+0000","last_unstale":"2023-07-21T22:18:42.890529+0000","last_undegraded":"2023-07-21T22:18:42.890529+0000","last_fullsized":"2023-07-21T22:18:42.890529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:00.416159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:54.407678+0000","last_change":"2023-07-21T22:17:08.859465+0000","last_active":"2023-07-21T22:18:54.407678+0000","last_peered":"2023-07-21T22:18:54.407678+0000","last_clean":"2023-07-21T22:18:54.407678+0000","last_became_active":"2023-07-21T22:17:08.859076+0000","last_became_peered":"2023-07-21T22:17:08.859076+0000","last_unstale":"2023-07-21T22:18:54.407678+0000","last_undegraded":"2023-07-21T22:18:54.407678+0000","last_fullsized":"2023-07-21T22:18:54.407678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:23.451233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890420+0000","last_change":"2023-07-21T22:17:09.846937+0000","last_active":"2023-07-21T22:18:42.890420+0000","last_peered":"2023-07-21T22:18:42.890420+0000","last_clean":"2023-07-21T22:18:42.890420+0000","last_became_active":"2023-07-21T22:17:09.846638+0000","last_became_peered":"2023-07-21T22:17:09.846638+0000","last_unstale":"2023-07-21T22:18:42.890420+0000","last_undegraded":"2023-07-21T22:18:42.890420+0000","last_fullsized":"2023-07-21T22:18:42.890420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:17.574718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487106+0000","last_change":"2023-07-21T22:17:08.860388+0000","last_active":"2023-07-21T22:17:44.487106+0000","last_peered":"2023-07-21T22:17:44.487106+0000","last_clean":"2023-07-21T22:17:44.487106+0000","last_became_active":"2023-07-21T22:17:08.860039+0000","last_became_peered":"2023-07-21T22:17:08.860039+0000","last_unstale":"2023-07-21T22:17:44.487106+0000","last_undegraded":"2023-07-21T22:17:44.487106+0000","last_fullsized":"2023-07-21T22:17:44.487106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:34.981385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304177+0000","last_change":"2023-07-21T22:15:51.342448+0000","last_active":"2023-07-21T22:17:44.304177+0000","last_peered":"2023-07-21T22:17:44.304177+0000","last_clean":"2023-07-21T22:17:44.304177+0000","last_became_active":"2023-07-21T22:15:51.342004+0000","last_became_peered":"2023-07-21T22:15:51.342004+0000","last_unstale":"2023-07-21T22:17:44.304177+0000","last_undegraded":"2023-07-21T22:17:44.304177+0000","last_fullsized":"2023-07-21T22:17:44.304177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_clean_scrub_stamp":"2023-07-21T22:12:15.345227+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:29.784967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.879253+0000","last_change":"2023-07-21T22:17:09.838402+0000","last_active":"2023-07-21T22:18:42.879253+0000","last_peered":"2023-07-21T22:18:42.879253+0000","last_clean":"2023-07-21T22:18:42.879253+0000","last_became_active":"2023-07-21T22:17:09.838096+0000","last_became_peered":"2023-07-21T22:17:09.838096+0000","last_unstale":"2023-07-21T22:18:42.879253+0000","last_undegraded":"2023-07-21T22:18:42.879253+0000","last_fullsized":"2023-07-21T22:18:42.879253+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:37.376969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304274+0000","last_change":"2023-07-21T22:17:08.865676+0000","last_active":"2023-07-21T22:17:44.304274+0000","last_peered":"2023-07-21T22:17:44.304274+0000","last_clean":"2023-07-21T22:17:44.304274+0000","last_became_active":"2023-07-21T22:17:08.865370+0000","last_became_peered":"2023-07-21T22:17:08.865370+0000","last_unstale":"2023-07-21T22:17:44.304274+0000","last_undegraded":"2023-07-21T22:17:44.304274+0000","last_fullsized":"2023-07-21T22:17:44.304274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:36.039312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304666+0000","last_change":"2023-07-21T22:17:08.864487+0000","last_active":"2023-07-21T22:17:44.304666+0000","last_peered":"2023-07-21T22:17:44.304666+0000","last_clean":"2023-07-21T22:17:44.304666+0000","last_became_active":"2023-07-21T22:17:08.863943+0000","last_became_peered":"2023-07-21T22:17:08.863943+0000","last_unstale":"2023-07-21T22:17:44.304666+0000","last_undegraded":"2023-07-21T22:17:44.304666+0000","last_fullsized":"2023-07-21T22:17:44.304666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:00.454414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.879926+0000","last_change":"2023-07-21T22:17:09.833812+0000","last_active":"2023-07-21T22:18:42.879926+0000","last_peered":"2023-07-21T22:18:42.879926+0000","last_clean":"2023-07-21T22:18:42.879926+0000","last_became_active":"2023-07-21T22:17:09.833496+0000","last_became_peered":"2023-07-21T22:17:09.833496+0000","last_unstale":"2023-07-21T22:18:42.879926+0000","last_undegraded":"2023-07-21T22:18:42.879926+0000","last_fullsized":"2023-07-21T22:18:42.879926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:32.258278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.620533+0000","last_change":"2023-07-21T22:17:08.867858+0000","last_active":"2023-07-21T22:18:43.620533+0000","last_peered":"2023-07-21T22:18:43.620533+0000","last_clean":"2023-07-21T22:18:43.620533+0000","last_became_active":"2023-07-21T22:17:08.867468+0000","last_became_peered":"2023-07-21T22:17:08.867468+0000","last_unstale":"2023-07-21T22:18:43.620533+0000","last_undegraded":"2023-07-21T22:18:43.620533+0000","last_fullsized":"2023-07-21T22:18:43.620533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:52.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896036+0000","last_change":"2023-07-21T22:17:09.846988+0000","last_active":"2023-07-21T22:18:42.896036+0000","last_peered":"2023-07-21T22:18:42.896036+0000","last_clean":"2023-07-21T22:18:42.896036+0000","last_became_active":"2023-07-21T22:17:09.846686+0000","last_became_peered":"2023-07-21T22:17:09.846686+0000","last_unstale":"2023-07-21T22:18:42.896036+0000","last_undegraded":"2023-07-21T22:18:42.896036+0000","last_fullsized":"2023-07-21T22:18:42.896036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:48.205318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487213+0000","last_change":"2023-07-21T22:17:08.857694+0000","last_active":"2023-07-21T22:17:44.487213+0000","last_peered":"2023-07-21T22:17:44.487213+0000","last_clean":"2023-07-21T22:17:44.487213+0000","last_became_active":"2023-07-21T22:17:08.857356+0000","last_became_peered":"2023-07-21T22:17:08.857356+0000","last_unstale":"2023-07-21T22:17:44.487213+0000","last_undegraded":"2023-07-21T22:17:44.487213+0000","last_fullsized":"2023-07-21T22:17:44.487213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:39:39.361769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893786+0000","last_change":"2023-07-21T22:17:09.858500+0000","last_active":"2023-07-21T22:18:42.893786+0000","last_peered":"2023-07-21T22:18:42.893786+0000","last_clean":"2023-07-21T22:18:42.893786+0000","last_became_active":"2023-07-21T22:17:09.858009+0000","last_became_peered":"2023-07-21T22:17:09.858009+0000","last_unstale":"2023-07-21T22:18:42.893786+0000","last_undegraded":"2023-07-21T22:18:42.893786+0000","last_fullsized":"2023-07-21T22:18:42.893786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:19:05.454111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305503+0000","last_change":"2023-07-21T22:17:08.853732+0000","last_active":"2023-07-21T22:17:44.305503+0000","last_peered":"2023-07-21T22:17:44.305503+0000","last_clean":"2023-07-21T22:17:44.305503+0000","last_became_active":"2023-07-21T22:17:08.853397+0000","last_became_peered":"2023-07-21T22:17:08.853397+0000","last_unstale":"2023-07-21T22:17:44.305503+0000","last_undegraded":"2023-07-21T22:17:44.305503+0000","last_fullsized":"2023-07-21T22:17:44.305503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:18.249465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.869110+0000","last_change":"2023-07-21T22:17:09.840836+0000","last_active":"2023-07-21T22:18:42.869110+0000","last_peered":"2023-07-21T22:18:42.869110+0000","last_clean":"2023-07-21T22:18:42.869110+0000","last_became_active":"2023-07-21T22:17:09.840463+0000","last_became_peered":"2023-07-21T22:17:09.840463+0000","last_unstale":"2023-07-21T22:18:42.869110+0000","last_undegraded":"2023-07-21T22:18:42.869110+0000","last_fullsized":"2023-07-21T22:18:42.869110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:24.284857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303419+0000","last_change":"2023-07-21T22:17:08.865129+0000","last_active":"2023-07-21T22:17:44.303419+0000","last_peered":"2023-07-21T22:17:44.303419+0000","last_clean":"2023-07-21T22:17:44.303419+0000","last_became_active":"2023-07-21T22:17:08.864820+0000","last_became_peered":"2023-07-21T22:17:08.864820+0000","last_unstale":"2023-07-21T22:17:44.303419+0000","last_undegraded":"2023-07-21T22:17:44.303419+0000","last_fullsized":"2023-07-21T22:17:44.303419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:07.661921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.878364+0000","last_change":"2023-07-21T22:17:09.846804+0000","last_active":"2023-07-21T22:18:42.878364+0000","last_peered":"2023-07-21T22:18:42.878364+0000","last_clean":"2023-07-21T22:18:42.878364+0000","last_became_active":"2023-07-21T22:17:09.846390+0000","last_became_peered":"2023-07-21T22:17:09.846390+0000","last_unstale":"2023-07-21T22:18:42.878364+0000","last_undegraded":"2023-07-21T22:18:42.878364+0000","last_fullsized":"2023-07-21T22:18:42.878364+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:42.837431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.317619+0000","last_change":"2023-07-21T22:17:44.317155+0000","last_active":"2023-07-21T22:17:44.317619+0000","last_peered":"2023-07-21T22:17:44.317619+0000","last_clean":"2023-07-21T22:17:44.317619+0000","last_became_active":"2023-07-21T22:17:44.307394+0000","last_became_peered":"2023-07-21T22:17:44.307394+0000","last_unstale":"2023-07-21T22:17:44.317619+0000","last_undegraded":"2023-07-21T22:17:44.317619+0000","last_fullsized":"2023-07-21T22:17:44.317619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:59.993004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892585+0000","last_change":"2023-07-21T22:17:09.849197+0000","last_active":"2023-07-21T22:18:42.892585+0000","last_peered":"2023-07-21T22:18:42.892585+0000","last_clean":"2023-07-21T22:18:42.892585+0000","last_became_active":"2023-07-21T22:17:09.848835+0000","last_became_peered":"2023-07-21T22:17:09.848835+0000","last_unstale":"2023-07-21T22:18:42.892585+0000","last_undegraded":"2023-07-21T22:18:42.892585+0000","last_fullsized":"2023-07-21T22:18:42.892585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:22.001862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.314830+0000","last_change":"2023-07-21T22:17:44.314329+0000","last_active":"2023-07-21T22:17:44.314830+0000","last_peered":"2023-07-21T22:17:44.314830+0000","last_clean":"2023-07-21T22:17:44.314830+0000","last_became_active":"2023-07-21T22:17:44.307075+0000","last_became_peered":"2023-07-21T22:17:44.307075+0000","last_unstale":"2023-07-21T22:17:44.314830+0000","last_undegraded":"2023-07-21T22:17:44.314830+0000","last_fullsized":"2023-07-21T22:17:44.314830+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:28.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896596+0000","last_change":"2023-07-21T22:17:09.847279+0000","last_active":"2023-07-21T22:18:42.896596+0000","last_peered":"2023-07-21T22:18:42.896596+0000","last_clean":"2023-07-21T22:18:42.896596+0000","last_became_active":"2023-07-21T22:17:09.846982+0000","last_became_peered":"2023-07-21T22:17:09.846982+0000","last_unstale":"2023-07-21T22:18:42.896596+0000","last_undegraded":"2023-07-21T22:18:42.896596+0000","last_fullsized":"2023-07-21T22:18:42.896596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:14.985134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304706+0000","last_change":"2023-07-21T22:17:08.857436+0000","last_active":"2023-07-21T22:17:44.304706+0000","last_peered":"2023-07-21T22:17:44.304706+0000","last_clean":"2023-07-21T22:17:44.304706+0000","last_became_active":"2023-07-21T22:17:08.857046+0000","last_became_peered":"2023-07-21T22:17:08.857046+0000","last_unstale":"2023-07-21T22:17:44.304706+0000","last_undegraded":"2023-07-21T22:17:44.304706+0000","last_fullsized":"2023-07-21T22:17:44.304706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:23.427814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896971+0000","last_change":"2023-07-21T22:17:09.852916+0000","last_active":"2023-07-21T22:18:42.896971+0000","last_peered":"2023-07-21T22:18:42.896971+0000","last_clean":"2023-07-21T22:18:42.896971+0000","last_became_active":"2023-07-21T22:17:09.852608+0000","last_became_peered":"2023-07-21T22:17:09.852608+0000","last_unstale":"2023-07-21T22:18:42.896971+0000","last_undegraded":"2023-07-21T22:18:42.896971+0000","last_fullsized":"2023-07-21T22:18:42.896971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:21.187686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486196+0000","last_change":"2023-07-21T22:17:08.859619+0000","last_active":"2023-07-21T22:17:44.486196+0000","last_peered":"2023-07-21T22:17:44.486196+0000","last_clean":"2023-07-21T22:17:44.486196+0000","last_became_active":"2023-07-21T22:17:08.859256+0000","last_became_peered":"2023-07-21T22:17:08.859256+0000","last_unstale":"2023-07-21T22:17:44.486196+0000","last_undegraded":"2023-07-21T22:17:44.486196+0000","last_fullsized":"2023-07-21T22:17:44.486196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:49.010457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.898245+0000","last_change":"2023-07-21T22:17:09.850548+0000","last_active":"2023-07-21T22:18:42.898245+0000","last_peered":"2023-07-21T22:18:42.898245+0000","last_clean":"2023-07-21T22:18:42.898245+0000","last_became_active":"2023-07-21T22:17:09.850261+0000","last_became_peered":"2023-07-21T22:17:09.850261+0000","last_unstale":"2023-07-21T22:18:42.898245+0000","last_undegraded":"2023-07-21T22:18:42.898245+0000","last_fullsized":"2023-07-21T22:18:42.898245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:05.546844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299865+0000","last_change":"2023-07-21T22:17:08.859729+0000","last_active":"2023-07-21T22:17:44.299865+0000","last_peered":"2023-07-21T22:17:44.299865+0000","last_clean":"2023-07-21T22:17:44.299865+0000","last_became_active":"2023-07-21T22:17:08.859421+0000","last_became_peered":"2023-07-21T22:17:08.859421+0000","last_unstale":"2023-07-21T22:17:44.299865+0000","last_undegraded":"2023-07-21T22:17:44.299865+0000","last_fullsized":"2023-07-21T22:17:44.299865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:21.189655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896517+0000","last_change":"2023-07-21T22:17:09.846413+0000","last_active":"2023-07-21T22:18:42.896517+0000","last_peered":"2023-07-21T22:18:42.896517+0000","last_clean":"2023-07-21T22:18:42.896517+0000","last_became_active":"2023-07-21T22:17:09.846038+0000","last_became_peered":"2023-07-21T22:17:09.846038+0000","last_unstale":"2023-07-21T22:18:42.896517+0000","last_undegraded":"2023-07-21T22:18:42.896517+0000","last_fullsized":"2023-07-21T22:18:42.896517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:08.536390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.877721+0000","last_change":"2023-07-21T22:17:09.846786+0000","last_active":"2023-07-21T22:18:42.877721+0000","last_peered":"2023-07-21T22:18:42.877721+0000","last_clean":"2023-07-21T22:18:42.877721+0000","last_became_active":"2023-07-21T22:17:09.846437+0000","last_became_peered":"2023-07-21T22:17:09.846437+0000","last_unstale":"2023-07-21T22:18:42.877721+0000","last_undegraded":"2023-07-21T22:18:42.877721+0000","last_fullsized":"2023-07-21T22:18:42.877721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:38.254130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.882594+0000","last_change":"2023-07-21T22:17:44.487796+0000","last_active":"2023-07-21T22:18:42.882594+0000","last_peered":"2023-07-21T22:18:42.882594+0000","last_clean":"2023-07-21T22:18:42.882594+0000","last_became_active":"2023-07-21T22:17:44.487278+0000","last_became_peered":"2023-07-21T22:17:44.487278+0000","last_unstale":"2023-07-21T22:18:42.882594+0000","last_undegraded":"2023-07-21T22:18:42.882594+0000","last_fullsized":"2023-07-21T22:18:42.882594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:36.983831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.887103+0000","last_change":"2023-07-21T22:17:09.850137+0000","last_active":"2023-07-21T22:18:42.887103+0000","last_peered":"2023-07-21T22:18:42.887103+0000","last_clean":"2023-07-21T22:18:42.887103+0000","last_became_active":"2023-07-21T22:17:09.849721+0000","last_became_peered":"2023-07-21T22:17:09.849721+0000","last_unstale":"2023-07-21T22:18:42.887103+0000","last_undegraded":"2023-07-21T22:18:42.887103+0000","last_fullsized":"2023-07-21T22:18:42.887103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:42.785707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.880240+0000","last_change":"2023-07-21T22:17:09.858573+0000","last_active":"2023-07-21T22:18:42.880240+0000","last_peered":"2023-07-21T22:18:42.880240+0000","last_clean":"2023-07-21T22:18:42.880240+0000","last_became_active":"2023-07-21T22:17:09.858017+0000","last_became_peered":"2023-07-21T22:17:09.858017+0000","last_unstale":"2023-07-21T22:18:42.880240+0000","last_undegraded":"2023-07-21T22:18:42.880240+0000","last_fullsized":"2023-07-21T22:18:42.880240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:20.029025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.880436+0000","last_change":"2023-07-21T22:17:44.486812+0000","last_active":"2023-07-21T22:18:42.880436+0000","last_peered":"2023-07-21T22:18:42.880436+0000","last_clean":"2023-07-21T22:18:42.880436+0000","last_became_active":"2023-07-21T22:17:44.486392+0000","last_became_peered":"2023-07-21T22:17:44.486392+0000","last_unstale":"2023-07-21T22:18:42.880436+0000","last_undegraded":"2023-07-21T22:18:42.880436+0000","last_fullsized":"2023-07-21T22:18:42.880436+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:12.827232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.883269+0000","last_change":"2023-07-21T22:17:09.845251+0000","last_active":"2023-07-21T22:18:42.883269+0000","last_peered":"2023-07-21T22:18:42.883269+0000","last_clean":"2023-07-21T22:18:42.883269+0000","last_became_active":"2023-07-21T22:17:09.844945+0000","last_became_peered":"2023-07-21T22:17:09.844945+0000","last_unstale":"2023-07-21T22:18:42.883269+0000","last_undegraded":"2023-07-21T22:18:42.883269+0000","last_fullsized":"2023-07-21T22:18:42.883269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:50.719284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.888580+0000","last_change":"2023-07-21T22:17:09.850953+0000","last_active":"2023-07-21T22:18:42.888580+0000","last_peered":"2023-07-21T22:18:42.888580+0000","last_clean":"2023-07-21T22:18:42.888580+0000","last_became_active":"2023-07-21T22:17:09.850627+0000","last_became_peered":"2023-07-21T22:17:09.850627+0000","last_unstale":"2023-07-21T22:18:42.888580+0000","last_undegraded":"2023-07-21T22:18:42.888580+0000","last_fullsized":"2023-07-21T22:18:42.888580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:01:24.705224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892604+0000","last_change":"2023-07-21T22:17:09.841222+0000","last_active":"2023-07-21T22:18:42.892604+0000","last_peered":"2023-07-21T22:18:42.892604+0000","last_clean":"2023-07-21T22:18:42.892604+0000","last_became_active":"2023-07-21T22:17:09.840864+0000","last_became_peered":"2023-07-21T22:17:09.840864+0000","last_unstale":"2023-07-21T22:18:42.892604+0000","last_undegraded":"2023-07-21T22:18:42.892604+0000","last_fullsized":"2023-07-21T22:18:42.892604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:23.181094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.885879+0000","last_change":"2023-07-21T22:17:09.837688+0000","last_active":"2023-07-21T22:18:42.885879+0000","last_peered":"2023-07-21T22:18:42.885879+0000","last_clean":"2023-07-21T22:18:42.885879+0000","last_became_active":"2023-07-21T22:17:09.837325+0000","last_became_peered":"2023-07-21T22:17:09.837325+0000","last_unstale":"2023-07-21T22:18:42.885879+0000","last_undegraded":"2023-07-21T22:18:42.885879+0000","last_fullsized":"2023-07-21T22:18:42.885879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:06:00.041198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893368+0000","last_change":"2023-07-21T22:17:09.843791+0000","last_active":"2023-07-21T22:18:42.893368+0000","last_peered":"2023-07-21T22:18:42.893368+0000","last_clean":"2023-07-21T22:18:42.893368+0000","last_became_active":"2023-07-21T22:17:09.843438+0000","last_became_peered":"2023-07-21T22:17:09.843438+0000","last_unstale":"2023-07-21T22:18:42.893368+0000","last_undegraded":"2023-07-21T22:18:42.893368+0000","last_fullsized":"2023-07-21T22:18:42.893368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:10:55.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.895426+0000","last_change":"2023-07-21T22:17:09.849062+0000","last_active":"2023-07-21T22:18:42.895426+0000","last_peered":"2023-07-21T22:18:42.895426+0000","last_clean":"2023-07-21T22:18:42.895426+0000","last_became_active":"2023-07-21T22:17:09.848153+0000","last_became_peered":"2023-07-21T22:17:09.848153+0000","last_unstale":"2023-07-21T22:18:42.895426+0000","last_undegraded":"2023-07-21T22:18:42.895426+0000","last_fullsized":"2023-07-21T22:18:42.895426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:30.677689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896467+0000","last_change":"2023-07-21T22:17:09.849010+0000","last_active":"2023-07-21T22:18:42.896467+0000","last_peered":"2023-07-21T22:18:42.896467+0000","last_clean":"2023-07-21T22:18:42.896467+0000","last_became_active":"2023-07-21T22:17:09.848679+0000","last_became_peered":"2023-07-21T22:17:09.848679+0000","last_unstale":"2023-07-21T22:18:42.896467+0000","last_undegraded":"2023-07-21T22:18:42.896467+0000","last_fullsized":"2023-07-21T22:18:42.896467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:40.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891473+0000","last_change":"2023-07-21T22:17:09.846419+0000","last_active":"2023-07-21T22:18:42.891473+0000","last_peered":"2023-07-21T22:18:42.891473+0000","last_clean":"2023-07-21T22:18:42.891473+0000","last_became_active":"2023-07-21T22:17:09.846037+0000","last_became_peered":"2023-07-21T22:17:09.846037+0000","last_unstale":"2023-07-21T22:18:42.891473+0000","last_undegraded":"2023-07-21T22:18:42.891473+0000","last_fullsized":"2023-07-21T22:18:42.891473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:33:14.382111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248938,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62569,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":625,"num_read_kb":377,"num_write":162,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":196347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383715,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":456133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70799999999999996,"15min":0.70099999999999996},"min":{"1min":0.53100000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.999,"5min":1.085,"15min":1.085},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90300000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77900000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.999,"5min":1.028,"15min":1.028},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.77900000000000003},"min":{"1min":0.60399999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.026,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88600000000000001,"5min":1.202,"15min":1.202},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.48699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.628}]},{"osd":7,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.024,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93500000000000005,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.63200000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.85299999999999998}]},{"osd":9,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.71199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.484,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.878},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.88600000000000001,"15min":0.878},"min":{"1min":0.70199999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0760000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.88800000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88,"15min":0.88600000000000001},"min":{"1min":0.63400000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.98199999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.80100000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.056,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.90000000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1089536,"data_stored":1106144,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":0.628},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.1360000000000001,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.88}]},{"osd":2,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.0629999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.85099999999999998,"15min":0.878},"min":{"1min":0.56000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.998,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.97599999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.85599999999999998,"15min":0.871},"min":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92800000000000005,"5min":4.3739999999999997,"15min":4.3739999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.47399999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.878,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.032,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.099,"5min":1.224,"15min":1.224},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.91700000000000004,"15min":0.94999999999999996},"min":{"1min":0.61399999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.079,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.02}]},{"osd":6,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.98599999999999999,"15min":1.006},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0629999999999999,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.90900000000000003,"15min":0.91300000000000003},"min":{"1min":0.64100000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.998,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.63800000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.94899999999999995,"15min":0.98399999999999999},"min":{"1min":0.68700000000000006,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.034,"5min":1.431,"15min":1.431},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.97199999999999998,"15min":1.008},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.83499999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.72299999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0680000000000001,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.871,"5min":1.0029999999999999,"15min":1.0329999999999999},"min":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.125,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.76400000000000001}]},{"osd":11,"last update":"Fri Jul 21 22:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":0.94299999999999995},"min":{"1min":0.72999999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1899999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.65500000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.212,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.99399999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.53200000000000003,"15min":0.56399999999999995},"min":{"1min":0.33000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.56399999999999995,"15min":0.60499999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60599999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.755,"15min":0.79500000000000004},"min":{"1min":0.441,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.80500000000000005,"15min":0.85999999999999999},"min":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":1.393,"15min":1.393},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76500000000000001,"15min":0.78500000000000003},"min":{"1min":0.50900000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78700000000000003,"15min":0.82699999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89700000000000002,"5min":1.335,"15min":1.335},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.68799999999999994,"15min":0.755},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79700000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81899999999999995,"15min":0.871},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93300000000000005,"5min":1.464,"15min":1.464},"last":0.751},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":0.89400000000000002},"min":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.056,"5min":1.3,"15min":1.3},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84299999999999997,"15min":0.89700000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1599999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.879},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.84499999999999997,"15min":0.877},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78900000000000003,"15min":0.84299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0249999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.86299999999999999,"15min":0.93700000000000006},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.878,"5min":1.431,"15min":1.431},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91800000000000004,"15min":0.98799999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.129,"5min":1.696,"15min":1.696},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.93999999999999995,"15min":0.99099999999999999},"min":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2050000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.82599999999999996}]},{"osd":8,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.94299999999999995,"15min":1.004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0009999999999999,"5min":1.496,"15min":1.496},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94399999999999995,"15min":1.002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.214,"5min":1.667,"15min":1.667},"last":0.84299999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.90700000000000003,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0429999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.95799999999999996,"5min":1.264,"15min":1.264},"last":0.80400000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68300000000000005,"15min":0.70099999999999996},"min":{"1min":0.48099999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.623},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.51400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.083,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.92300000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.373,"15min":0.373},"max":{"1min":0.97799999999999998,"5min":1.056,"15min":1.056},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.501}]},{"osd":3,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.80300000000000005},"min":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0009999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72899999999999998,"15min":0.749},"min":{"1min":0.442,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.84299999999999997,"15min":0.84899999999999998},"min":{"1min":0.68400000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1719999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.76900000000000002},"min":{"1min":0.53100000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98099999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.88800000000000001,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1950000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.93799999999999994,"15min":0.94599999999999995},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.90000000000000002,"15min":0.91300000000000003},"min":{"1min":0.72999999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90800000000000003,"15min":0.92600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.155,"5min":1.321,"15min":1.321},"last":0.94299999999999995}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.83199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":0.92600000000000005,"15min":0.89900000000000002},"min":{"1min":0.67400000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.82899999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.74299999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.2190000000000001,"5min":1.254,"15min":1.254},"last":1.085},{"interface":"front","average":{"1min":0.995,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.755,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.0229999999999999}]},{"osd":11,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.038},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.0600000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":1003520,"data_stored":1048904,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.499},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.441},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.38900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.63100000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68300000000000005,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.93500000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.75}]},{"osd":3,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":0.92200000000000004,"15min":0.78400000000000003},"min":{"1min":0.57199999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.4370000000000001,"5min":0.90800000000000003,"15min":0.77400000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":11.212,"5min":11.212,"15min":11.212},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.46500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91200000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.623,"15min":0.65900000000000003},"min":{"1min":0.41599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54100000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.0469999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.82099999999999995,"15min":0.78000000000000003},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":7.1479999999999997,"15min":7.1479999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.022,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.72199999999999998}]},{"osd":8,"last update":"Fri Jul 21 22:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84099999999999997,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.90500000000000003}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.88400000000000001,"15min":0.86799999999999999},"min":{"1min":0.64300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.034,"5min":0.88900000000000001,"15min":0.86699999999999999},"min":{"1min":0.67100000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.79900000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.87,"15min":0.88100000000000001},"min":{"1min":0.64500000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0600000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.99299999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.59399999999999997}]},{"osd":11,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.871},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.97399999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495678,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":455764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.51300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1970000000000001,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":1.143,"15min":1.143},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.54700000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.372,"15min":0.372},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.87}]},{"osd":4,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.72999999999999998},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.76500000000000001},"min":{"1min":0.47999999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":3.8759999999999999,"15min":3.8759999999999999},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.57399999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94999999999999996,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76700000000000002,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77300000000000002,"15min":0.73699999999999999},"min":{"1min":0.58699999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.61399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.002,"5min":1.071,"15min":1.071},"last":0.91500000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.623,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.754},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82699999999999996,"15min":0.80900000000000005},"min":{"1min":0.65600000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.004,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.69599999999999995}]},{"osd":9,"last update":"Fri Jul 21 22:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":0.91000000000000003,"15min":0.89300000000000002},"min":{"1min":0.58999999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":6.2880000000000003,"5min":6.2880000000000003,"15min":6.2880000000000003},"last":0.85999999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90200000000000002,"15min":0.91400000000000003},"min":{"1min":0.751,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.018,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.71499999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98299999999999998,"5min":1.196,"15min":1.196},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":1003520,"data_stored":517156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.48899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84299999999999997,"5min":0.98599999999999999,"15min":1.0620000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.628}]},{"osd":2,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.34300000000000003},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.68899999999999995},"min":{"1min":0.434,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93100000000000005,"5min":7.2720000000000002,"15min":7.2720000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.97099999999999997,"5min":0.997,"15min":0.997},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.56699999999999995,"15min":0.497},"min":{"1min":0.443,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.55800000000000005,"15min":0.50600000000000001},"min":{"1min":0.46100000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.73599999999999999,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.68600000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0229999999999999,"5min":1.036,"15min":1.036},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81599999999999995,"15min":0.748},"min":{"1min":0.66000000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.022,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":1.147}]},{"osd":7,"last update":"Fri Jul 21 22:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94999999999999996,"5min":1.03,"15min":1.03},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.73399999999999999,"15min":0.68899999999999995},"min":{"1min":0.60099999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.115}]},{"osd":8,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.79500000000000004,"15min":0.78300000000000003},"min":{"1min":0.67200000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.84899999999999998,"15min":0.81499999999999995},"min":{"1min":0.79900000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.1339999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.872,"15min":0.84299999999999997},"min":{"1min":0.76700000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.056,"15min":1.1299999999999999},"min":{"1min":0.76100000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1140000000000001,"5min":7.4530000000000003,"15min":7.4530000000000003},"last":1.0880000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.83999999999999997,"15min":0.82099999999999995},"min":{"1min":0.58599999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.075,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.02,"5min":0.94699999999999995,"15min":0.91900000000000004},"min":{"1min":0.78600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.103}]},{"osd":11,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.2090000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":457029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91400000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.64100000000000001},"min":{"1min":0.50800000000000001,"5min":0.44,"15min":0.432},"max":{"1min":1.002,"5min":1.244,"15min":1.244},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65900000000000003,"15min":0.61799999999999999},"min":{"1min":0.47799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.61399999999999999},"min":{"1min":0.51000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3360000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.70899999999999996,"15min":0.625},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4580000000000002,"5min":6.4580000000000002,"15min":6.4580000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68500000000000005,"15min":0.64700000000000002},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.879,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.63,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92500000000000004,"5min":1.508,"15min":1.508},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.78800000000000003,"15min":0.72299999999999998},"min":{"1min":0.53400000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.9470000000000001,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.41899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.751}]},{"osd":8,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.61399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88200000000000001,"5min":1.163,"15min":1.163},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.66000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Jul 21 22:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82899999999999996,"15min":0.88},"min":{"1min":0.51500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.82099999999999995,"15min":0.86099999999999999},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0509999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.84299999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.85099999999999998,"15min":0.89000000000000001},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91700000000000004,"5min":1.484,"15min":1.484},"last":0.621},{"interface":"front","average":{"1min":0.751,"5min":1.1200000000000001,"15min":1.2649999999999999},"min":{"1min":0.624,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.878,"5min":7.5209999999999999,"15min":7.5209999999999999},"last":0.71299999999999997}]},{"osd":11,"last update":"Fri Jul 21 22:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.83399999999999996,"15min":0.83199999999999996},"min":{"1min":0.70399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.038,"5min":1.357,"15min":1.357},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.70799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.80400000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":1028096,"data_stored":518941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.70599999999999996,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.443},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.64300000000000002,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.61699999999999999},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":1.476,"15min":1.476},"last":0.629},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.72699999999999998,"15min":0.63200000000000001},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.36499999999999999},"max":{"1min":1.01,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68100000000000005,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.67300000000000004},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.874}]},{"osd":5,"last update":"Fri Jul 21 22:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98799999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.63500000000000001,"15min":0.56699999999999995},"min":{"1min":0.48599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.84099999999999997,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.4900000000000002,"5min":8.4900000000000002,"15min":8.4900000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.2350000000000001,"5min":0.86899999999999999,"15min":0.78500000000000003},"min":{"1min":0.67500000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":8.4730000000000008,"5min":8.4730000000000008,"15min":8.4730000000000008},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60999999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96399999999999997,"5min":1.409,"15min":1.409},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.113,"5min":1.181,"15min":1.181},"last":0.82499999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.141,"5min":4.141,"15min":4.141},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.105,"5min":1.002,"15min":0.996},"min":{"1min":0.73099999999999998,"5min":0.63,"15min":0.63},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.95199999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:18:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.59799999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.0960000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.91400000000000003,"15min":0.93100000000000005},"min":{"1min":0.68899999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0409999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.91600000000000004}]},{"osd":11,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.97199999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":456081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.45700000000000002,"15min":0.41599999999999998},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.442},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.499,"15min":0.443},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.60499999999999998},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.71599999999999997,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.70599999999999996,"15min":0.65000000000000002},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.745}]},{"osd":4,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76900000000000002,"15min":0.69899999999999995},"min":{"1min":0.49199999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.7769999999999999,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.73199999999999998,"15min":0.68899999999999995},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.68400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88600000000000001,"5min":1.702,"15min":1.702},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.75,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93400000000000005,"5min":2.032,"15min":2.032},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73499999999999999,"15min":0.69699999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93500000000000005,"15min":1.042},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.143,"5min":6.9740000000000002,"15min":6.9740000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.95099999999999996,"15min":1.0760000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91900000000000004,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.68200000000000005}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.1140000000000001,"15min":1.157},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.083,"5min":7.0030000000000001,"15min":7.0030000000000001},"last":0.629},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1080000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73499999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.88100000000000001,"15min":0.92100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.85999999999999999,"15min":0.89200000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.66900000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97899999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.69999999999999996}]},{"osd":11,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.80600000000000005}]}]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":457161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.873,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.433},"min":{"1min":0.313,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.432},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.45600000000000002},"min":{"1min":0.377,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70899999999999996,"15min":0.65500000000000003},"min":{"1min":0.61499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":1.056,"15min":1.056},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.74199999999999999,"15min":0.67100000000000004},"min":{"1min":0.45000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.77900000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.58599999999999997},"min":{"1min":0.52200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.96999999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.67500000000000004,"15min":0.621},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86599999999999999,"5min":1.236,"15min":1.236},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0529999999999999,"5min":1.194,"15min":1.194},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.79200000000000004,"15min":0.73999999999999999},"min":{"1min":0.71899999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94099999999999995,"5min":1.175,"15min":1.175},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.093,"15min":1.093},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0629999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68899999999999995,"15min":0.65500000000000003},"min":{"1min":0.505,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88400000000000001,"5min":1.127,"15min":1.127},"last":0.625},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.749,"15min":0.68700000000000006},"min":{"1min":0.54600000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0209999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.85299999999999998}]},{"osd":8,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.624,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0529999999999999,"5min":1.165,"15min":1.165},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.224,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70099999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.63,"5min":0.503,"15min":0.503},"max":{"1min":1.224,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.52800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.82599999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.57799999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.024,"5min":1.327,"15min":1.327},"last":0.878},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.97599999999999998,"15min":0.99299999999999999},"min":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1040000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.92200000000000004}]},{"osd":11,"last update":"Fri Jul 21 22:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.99099999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":1047953,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68500000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.64100000000000001,"15min":0.60599999999999998},"min":{"1min":0.45200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.9550000000000001,"5min":4.9550000000000001,"15min":4.9550000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.67800000000000005,"15min":0.60599999999999998},"min":{"1min":0.53600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.91100000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.65900000000000003},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":6.9340000000000002,"15min":6.9340000000000002},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.52300000000000002,"15min":0.48699999999999999},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.50900000000000001},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71199999999999997,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.109,"5min":6.9160000000000004,"15min":6.9160000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.87,"5min":7.0129999999999999,"15min":7.0129999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72399999999999998,"15min":0.66400000000000003},"min":{"1min":0.53100000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.99199999999999999,"5min":1.177,"15min":1.177},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.73299999999999998,"15min":0.67700000000000005},"min":{"1min":0.64400000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0289999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":0.89500000000000002,"15min":0.77300000000000002},"min":{"1min":0.53200000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":6.3799999999999999,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.034,"5min":0.79000000000000004,"15min":0.753},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":6.6260000000000003,"5min":6.6260000000000003,"15min":6.6260000000000003},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Jul 21 22:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.64400000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.88},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.79800000000000004,"15min":0.77900000000000003},"min":{"1min":0.63700000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.05,"5min":1.139,"15min":1.139},"last":0.87}]},{"osd":8,"last update":"Fri Jul 21 22:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76400000000000001,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.071,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.89200000000000002}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83499999999999996,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1619999999999999,"5min":0.89600000000000002,"15min":0.86599999999999999},"min":{"1min":0.56599999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.91200000000000003}]},{"osd":10,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.80400000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1639999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.877,"15min":0.872},"min":{"1min":0.74399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.016,"5min":1.202,"15min":1.202},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:57.228 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.415+0000 7fa1dfdff700 1 -- 172.21.15.151:0/3474183665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8102e70 msgr2=0x7fa1d8105250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.415+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/3474183665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8102e70 0x7fa1d8105250 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa1c8009990 tx=0x7fa1c8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.415+0000 7fa1dfdff700 1 -- 172.21.15.151:0/3474183665 shutdown_connections 2023-07-21T22:18:57.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.415+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/3474183665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1d8100550 0x7fa1d8102930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.415+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/3474183665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d8105790 0x7fa1d8107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.415+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/3474183665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8102e70 0x7fa1d8105250 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.415+0000 7fa1dfdff700 1 -- 172.21.15.151:0/3474183665 >> 172.21.15.151:0/3474183665 conn(0x7fa1d80f9fd0 msgr2=0x7fa1d80fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.415+0000 7fa1dfdff700 1 -- 172.21.15.151:0/3474183665 shutdown_connections 2023-07-21T22:18:57.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.415+0000 7fa1dfdff700 1 -- 172.21.15.151:0/3474183665 wait complete. 2023-07-21T22:18:57.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.416+0000 7fa1dfdff700 1 Processor -- start 2023-07-21T22:18:57.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.416+0000 7fa1dfdff700 1 -- start start 2023-07-21T22:18:57.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1dfdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1d8100550 0x7fa1d8197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1dfdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d8102e70 0x7fa1d8197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1dfdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8105790 0x7fa1d819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1dfdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d819f4c0 con 0x7fa1d8105790 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1dfdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d819f600 con 0x7fa1d8100550 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1dfdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1d819f790 con 0x7fa1d8102e70 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1de39c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8105790 0x7fa1d819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1de39c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8105790 0x7fa1d819eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52172/0 (socket says 172.21.15.151:52172) 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1de39c700 1 -- 172.21.15.151:0/2722599369 learned_addr learned my addr 172.21.15.151:0/2722599369 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:57.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1ddb9b700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1d8100550 0x7fa1d8197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.417+0000 7fa1dd39a700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d8102e70 0x7fa1d8197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1de39c700 1 -- 172.21.15.151:0/2722599369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d8102e70 msgr2=0x7fa1d8197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1de39c700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d8102e70 0x7fa1d8197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1de39c700 1 -- 172.21.15.151:0/2722599369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1d8100550 msgr2=0x7fa1d8197940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1de39c700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1d8100550 0x7fa1d8197940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1de39c700 1 -- 172.21.15.151:0/2722599369 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c80095f0 con 0x7fa1d8105790 2023-07-21T22:18:57.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1ddb9b700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1d8100550 0x7fa1d8197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1de39c700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8105790 0x7fa1d819eef0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000ef30 tx=0x7fa1d000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1ceffd700 1 -- 172.21.15.151:0/2722599369 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d0018070 con 0x7fa1d8105790 2023-07-21T22:18:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1ceffd700 1 -- 172.21.15.151:0/2722599369 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa1d000f040 con 0x7fa1d8105790 2023-07-21T22:18:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1d819fa10 con 0x7fa1d8105790 2023-07-21T22:18:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1ceffd700 1 -- 172.21.15.151:0/2722599369 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1d000cbc0 con 0x7fa1d8105790 2023-07-21T22:18:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.418+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1d819ff70 con 0x7fa1d8105790 2023-07-21T22:18:57.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.419+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1d810b190 con 0x7fa1d8105790 2023-07-21T22:18:57.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.421+0000 7fa1ceffd700 1 -- 172.21.15.151:0/2722599369 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fa1d000cd80 con 0x7fa1d8105790 2023-07-21T22:18:57.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.423+0000 7fa1ceffd700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1c40a1220 0x7fa1c40a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.423+0000 7fa1ceffd700 1 -- 172.21.15.151:0/2722599369 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fa1d00cc360 con 0x7fa1d8105790 2023-07-21T22:18:57.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.423+0000 7fa1ddb9b700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1c40a1220 0x7fa1c40a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.423+0000 7fa1ddb9b700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1c40a1220 0x7fa1c40a36d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4011490 tx=0x7fa1d4009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.426+0000 7fa1ceffd700 1 -- 172.21.15.151:0/2722599369 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fa1d0095b10 con 0x7fa1d8105790 2023-07-21T22:18:57.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:57 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1954415019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:57.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:57 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1954415019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:57.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.620+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa1d8102100 con 0x7fa1c40a1220 2023-07-21T22:18:57.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.631+0000 7fa1ceffd700 1 -- 172.21.15.151:0/2722599369 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343281 (secure 0 0 0) 0x7fa1d8102100 con 0x7fa1c40a1220 2023-07-21T22:18:57.679 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:57.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.635+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1c40a1220 msgr2=0x7fa1c40a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.635+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1c40a1220 0x7fa1c40a36d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fa1d4011490 tx=0x7fa1d4009260 comp rx=0 tx=0).stop 2023-07-21T22:18:57.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.635+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8105790 msgr2=0x7fa1d819eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.635+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8105790 0x7fa1d819eef0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fa1d000ef30 tx=0x7fa1d000c3a0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.635+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 shutdown_connections 2023-07-21T22:18:57.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.635+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fa1c40a1220 0x7fa1c40a36d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.635+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1d8100550 0x7fa1d8197940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.636+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa1d8105790 0x7fa1d819eef0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.636+0000 7fa1dfdff700 1 --2- 172.21.15.151:0/2722599369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa1d8102e70 0x7fa1d8197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.636+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 >> 172.21.15.151:0/2722599369 conn(0x7fa1d80f9fd0 msgr2=0x7fa1d81019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.636+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 shutdown_connections 2023-07-21T22:18:57.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.636+0000 7fa1dfdff700 1 -- 172.21.15.151:0/2722599369 wait complete. 2023-07-21T22:18:57.683 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-07-21T22:18:57.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:57 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1954415019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:18:57.698 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2023-07-21T22:18:56.880729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653183,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":761,"num_read_kb":496,"num_write":345,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":781,"ondisk_log_size":781,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334976,"kb_used_data":11552,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606848,"statfs":{"total":1151940427776,"available":1151597412352,"internally_reserved":0,"allocated":11829248,"data_stored":7433924,"data_compressed":108096,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1449,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003003"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892270+0000","last_change":"2023-07-21T22:17:09.850731+0000","last_active":"2023-07-21T22:18:42.892270+0000","last_peered":"2023-07-21T22:18:42.892270+0000","last_clean":"2023-07-21T22:18:42.892270+0000","last_became_active":"2023-07-21T22:17:09.849185+0000","last_became_peered":"2023-07-21T22:17:09.849185+0000","last_unstale":"2023-07-21T22:18:42.892270+0000","last_undegraded":"2023-07-21T22:18:42.892270+0000","last_fullsized":"2023-07-21T22:18:42.892270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:35.659774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.887603+0000","last_change":"2023-07-21T22:17:09.853210+0000","last_active":"2023-07-21T22:18:42.887603+0000","last_peered":"2023-07-21T22:18:42.887603+0000","last_clean":"2023-07-21T22:18:42.887603+0000","last_became_active":"2023-07-21T22:17:09.852822+0000","last_became_peered":"2023-07-21T22:17:09.852822+0000","last_unstale":"2023-07-21T22:18:42.887603+0000","last_undegraded":"2023-07-21T22:18:42.887603+0000","last_fullsized":"2023-07-21T22:18:42.887603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:20.599740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891804+0000","last_change":"2023-07-21T22:17:09.850123+0000","last_active":"2023-07-21T22:18:42.891804+0000","last_peered":"2023-07-21T22:18:42.891804+0000","last_clean":"2023-07-21T22:18:42.891804+0000","last_became_active":"2023-07-21T22:17:09.849763+0000","last_became_peered":"2023-07-21T22:17:09.849763+0000","last_unstale":"2023-07-21T22:18:42.891804+0000","last_undegraded":"2023-07-21T22:18:42.891804+0000","last_fullsized":"2023-07-21T22:18:42.891804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:56.684648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.882006+0000","last_change":"2023-07-21T22:17:44.306609+0000","last_active":"2023-07-21T22:18:42.882006+0000","last_peered":"2023-07-21T22:18:42.882006+0000","last_clean":"2023-07-21T22:18:42.882006+0000","last_became_active":"2023-07-21T22:17:44.306274+0000","last_became_peered":"2023-07-21T22:17:44.306274+0000","last_unstale":"2023-07-21T22:18:42.882006+0000","last_undegraded":"2023-07-21T22:18:42.882006+0000","last_fullsized":"2023-07-21T22:18:42.882006+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:18:47.720581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893357+0000","last_change":"2023-07-21T22:17:09.836811+0000","last_active":"2023-07-21T22:18:42.893357+0000","last_peered":"2023-07-21T22:18:42.893357+0000","last_clean":"2023-07-21T22:18:42.893357+0000","last_became_active":"2023-07-21T22:17:09.836470+0000","last_became_peered":"2023-07-21T22:17:09.836470+0000","last_unstale":"2023-07-21T22:18:42.893357+0000","last_undegraded":"2023-07-21T22:18:42.893357+0000","last_fullsized":"2023-07-21T22:18:42.893357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:19.711901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891053+0000","last_change":"2023-07-21T22:17:09.845801+0000","last_active":"2023-07-21T22:18:42.891053+0000","last_peered":"2023-07-21T22:18:42.891053+0000","last_clean":"2023-07-21T22:18:42.891053+0000","last_became_active":"2023-07-21T22:17:09.844938+0000","last_became_peered":"2023-07-21T22:17:09.844938+0000","last_unstale":"2023-07-21T22:18:42.891053+0000","last_undegraded":"2023-07-21T22:18:42.891053+0000","last_fullsized":"2023-07-21T22:18:42.891053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:35.691429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.897535+0000","last_change":"2023-07-21T22:17:09.850392+0000","last_active":"2023-07-21T22:18:42.897535+0000","last_peered":"2023-07-21T22:18:42.897535+0000","last_clean":"2023-07-21T22:18:42.897535+0000","last_became_active":"2023-07-21T22:17:09.850013+0000","last_became_peered":"2023-07-21T22:17:09.850013+0000","last_unstale":"2023-07-21T22:18:42.897535+0000","last_undegraded":"2023-07-21T22:18:42.897535+0000","last_fullsized":"2023-07-21T22:18:42.897535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:04.984082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.894377+0000","last_change":"2023-07-21T22:17:09.845425+0000","last_active":"2023-07-21T22:18:42.894377+0000","last_peered":"2023-07-21T22:18:42.894377+0000","last_clean":"2023-07-21T22:18:42.894377+0000","last_became_active":"2023-07-21T22:17:09.845090+0000","last_became_peered":"2023-07-21T22:17:09.845090+0000","last_unstale":"2023-07-21T22:18:42.894377+0000","last_undegraded":"2023-07-21T22:18:42.894377+0000","last_fullsized":"2023-07-21T22:18:42.894377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:59.843469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891935+0000","last_change":"2023-07-21T22:17:09.845600+0000","last_active":"2023-07-21T22:18:42.891935+0000","last_peered":"2023-07-21T22:18:42.891935+0000","last_clean":"2023-07-21T22:18:42.891935+0000","last_became_active":"2023-07-21T22:17:09.845260+0000","last_became_peered":"2023-07-21T22:17:09.845260+0000","last_unstale":"2023-07-21T22:18:42.891935+0000","last_undegraded":"2023-07-21T22:18:42.891935+0000","last_fullsized":"2023-07-21T22:18:42.891935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:49.477671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891133+0000","last_change":"2023-07-21T22:17:09.846172+0000","last_active":"2023-07-21T22:18:42.891133+0000","last_peered":"2023-07-21T22:18:42.891133+0000","last_clean":"2023-07-21T22:18:42.891133+0000","last_became_active":"2023-07-21T22:17:09.845827+0000","last_became_peered":"2023-07-21T22:17:09.845827+0000","last_unstale":"2023-07-21T22:18:42.891133+0000","last_undegraded":"2023-07-21T22:18:42.891133+0000","last_fullsized":"2023-07-21T22:18:42.891133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:38.644866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896178+0000","last_change":"2023-07-21T22:17:09.852728+0000","last_active":"2023-07-21T22:18:42.896178+0000","last_peered":"2023-07-21T22:18:42.896178+0000","last_clean":"2023-07-21T22:18:42.896178+0000","last_became_active":"2023-07-21T22:17:09.852152+0000","last_became_peered":"2023-07-21T22:17:09.852152+0000","last_unstale":"2023-07-21T22:18:42.896178+0000","last_undegraded":"2023-07-21T22:18:42.896178+0000","last_fullsized":"2023-07-21T22:18:42.896178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:10.530218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889841+0000","last_change":"2023-07-21T22:17:09.850565+0000","last_active":"2023-07-21T22:18:42.889841+0000","last_peered":"2023-07-21T22:18:42.889841+0000","last_clean":"2023-07-21T22:18:42.889841+0000","last_became_active":"2023-07-21T22:17:09.850162+0000","last_became_peered":"2023-07-21T22:17:09.850162+0000","last_unstale":"2023-07-21T22:18:42.889841+0000","last_undegraded":"2023-07-21T22:18:42.889841+0000","last_fullsized":"2023-07-21T22:18:42.889841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:48.591116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893294+0000","last_change":"2023-07-21T22:17:09.836732+0000","last_active":"2023-07-21T22:18:42.893294+0000","last_peered":"2023-07-21T22:18:42.893294+0000","last_clean":"2023-07-21T22:18:42.893294+0000","last_became_active":"2023-07-21T22:17:09.836446+0000","last_became_peered":"2023-07-21T22:17:09.836446+0000","last_unstale":"2023-07-21T22:18:42.893294+0000","last_undegraded":"2023-07-21T22:18:42.893294+0000","last_fullsized":"2023-07-21T22:18:42.893294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:05.998599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889472+0000","last_change":"2023-07-21T22:17:09.852624+0000","last_active":"2023-07-21T22:18:42.889472+0000","last_peered":"2023-07-21T22:18:42.889472+0000","last_clean":"2023-07-21T22:18:42.889472+0000","last_became_active":"2023-07-21T22:17:09.852353+0000","last_became_peered":"2023-07-21T22:17:09.852353+0000","last_unstale":"2023-07-21T22:18:42.889472+0000","last_undegraded":"2023-07-21T22:18:42.889472+0000","last_fullsized":"2023-07-21T22:18:42.889472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:42.502841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890706+0000","last_change":"2023-07-21T22:17:09.860554+0000","last_active":"2023-07-21T22:18:42.890706+0000","last_peered":"2023-07-21T22:18:42.890706+0000","last_clean":"2023-07-21T22:18:42.890706+0000","last_became_active":"2023-07-21T22:17:09.860119+0000","last_became_peered":"2023-07-21T22:17:09.860119+0000","last_unstale":"2023-07-21T22:18:42.890706+0000","last_undegraded":"2023-07-21T22:18:42.890706+0000","last_fullsized":"2023-07-21T22:18:42.890706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:58.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.898261+0000","last_change":"2023-07-21T22:17:09.850522+0000","last_active":"2023-07-21T22:18:42.898261+0000","last_peered":"2023-07-21T22:18:42.898261+0000","last_clean":"2023-07-21T22:18:42.898261+0000","last_became_active":"2023-07-21T22:17:09.850243+0000","last_became_peered":"2023-07-21T22:17:09.850243+0000","last_unstale":"2023-07-21T22:18:42.898261+0000","last_undegraded":"2023-07-21T22:18:42.898261+0000","last_fullsized":"2023-07-21T22:18:42.898261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:10.569656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892471+0000","last_change":"2023-07-21T22:17:09.848552+0000","last_active":"2023-07-21T22:18:42.892471+0000","last_peered":"2023-07-21T22:18:42.892471+0000","last_clean":"2023-07-21T22:18:42.892471+0000","last_became_active":"2023-07-21T22:17:09.848110+0000","last_became_peered":"2023-07-21T22:17:09.848110+0000","last_unstale":"2023-07-21T22:18:42.892471+0000","last_undegraded":"2023-07-21T22:18:42.892471+0000","last_fullsized":"2023-07-21T22:18:42.892471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:12.712668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891829+0000","last_change":"2023-07-21T22:17:09.848899+0000","last_active":"2023-07-21T22:18:42.891829+0000","last_peered":"2023-07-21T22:18:42.891829+0000","last_clean":"2023-07-21T22:18:42.891829+0000","last_became_active":"2023-07-21T22:17:09.848606+0000","last_became_peered":"2023-07-21T22:17:09.848606+0000","last_unstale":"2023-07-21T22:18:42.891829+0000","last_undegraded":"2023-07-21T22:18:42.891829+0000","last_fullsized":"2023-07-21T22:18:42.891829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:51.141831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.887791+0000","last_change":"2023-07-21T22:17:09.838033+0000","last_active":"2023-07-21T22:18:42.887791+0000","last_peered":"2023-07-21T22:18:42.887791+0000","last_clean":"2023-07-21T22:18:42.887791+0000","last_became_active":"2023-07-21T22:17:09.837532+0000","last_became_peered":"2023-07-21T22:17:09.837532+0000","last_unstale":"2023-07-21T22:18:42.887791+0000","last_undegraded":"2023-07-21T22:18:42.887791+0000","last_fullsized":"2023-07-21T22:18:42.887791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:24.281689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302370+0000","last_change":"2023-07-21T22:17:08.867849+0000","last_active":"2023-07-21T22:17:44.302370+0000","last_peered":"2023-07-21T22:17:44.302370+0000","last_clean":"2023-07-21T22:17:44.302370+0000","last_became_active":"2023-07-21T22:17:08.866245+0000","last_became_peered":"2023-07-21T22:17:08.866245+0000","last_unstale":"2023-07-21T22:17:44.302370+0000","last_undegraded":"2023-07-21T22:17:44.302370+0000","last_fullsized":"2023-07-21T22:17:44.302370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:37.153114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.886760+0000","last_change":"2023-07-21T22:17:09.841402+0000","last_active":"2023-07-21T22:18:42.886760+0000","last_peered":"2023-07-21T22:18:42.886760+0000","last_clean":"2023-07-21T22:18:42.886760+0000","last_became_active":"2023-07-21T22:17:09.841009+0000","last_became_peered":"2023-07-21T22:17:09.841009+0000","last_unstale":"2023-07-21T22:18:42.886760+0000","last_undegraded":"2023-07-21T22:18:42.886760+0000","last_fullsized":"2023-07-21T22:18:42.886760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:08.232799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304136+0000","last_change":"2023-07-21T22:17:08.864236+0000","last_active":"2023-07-21T22:17:44.304136+0000","last_peered":"2023-07-21T22:17:44.304136+0000","last_clean":"2023-07-21T22:17:44.304136+0000","last_became_active":"2023-07-21T22:17:08.863579+0000","last_became_peered":"2023-07-21T22:17:08.863579+0000","last_unstale":"2023-07-21T22:17:44.304136+0000","last_undegraded":"2023-07-21T22:17:44.304136+0000","last_fullsized":"2023-07-21T22:17:44.304136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:10.453785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889151+0000","last_change":"2023-07-21T22:17:09.852677+0000","last_active":"2023-07-21T22:18:42.889151+0000","last_peered":"2023-07-21T22:18:42.889151+0000","last_clean":"2023-07-21T22:18:42.889151+0000","last_became_active":"2023-07-21T22:17:09.852326+0000","last_became_peered":"2023-07-21T22:17:09.852326+0000","last_unstale":"2023-07-21T22:18:42.889151+0000","last_undegraded":"2023-07-21T22:18:42.889151+0000","last_fullsized":"2023-07-21T22:18:42.889151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:09.817158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304951+0000","last_change":"2023-07-21T22:17:08.867521+0000","last_active":"2023-07-21T22:17:44.304951+0000","last_peered":"2023-07-21T22:17:44.304951+0000","last_clean":"2023-07-21T22:17:44.304951+0000","last_became_active":"2023-07-21T22:17:08.867125+0000","last_became_peered":"2023-07-21T22:17:08.867125+0000","last_unstale":"2023-07-21T22:17:44.304951+0000","last_undegraded":"2023-07-21T22:17:44.304951+0000","last_fullsized":"2023-07-21T22:17:44.304951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:36:09.254395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893649+0000","last_change":"2023-07-21T22:17:09.846296+0000","last_active":"2023-07-21T22:18:42.893649+0000","last_peered":"2023-07-21T22:18:42.893649+0000","last_clean":"2023-07-21T22:18:42.893649+0000","last_became_active":"2023-07-21T22:17:09.845947+0000","last_became_peered":"2023-07-21T22:17:09.845947+0000","last_unstale":"2023-07-21T22:18:42.893649+0000","last_undegraded":"2023-07-21T22:18:42.893649+0000","last_fullsized":"2023-07-21T22:18:42.893649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:34:46.553617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305483+0000","last_change":"2023-07-21T22:17:08.866709+0000","last_active":"2023-07-21T22:17:44.305483+0000","last_peered":"2023-07-21T22:17:44.305483+0000","last_clean":"2023-07-21T22:17:44.305483+0000","last_became_active":"2023-07-21T22:17:08.866277+0000","last_became_peered":"2023-07-21T22:17:08.866277+0000","last_unstale":"2023-07-21T22:17:44.305483+0000","last_undegraded":"2023-07-21T22:17:44.305483+0000","last_fullsized":"2023-07-21T22:17:44.305483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:13.480396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893496+0000","last_change":"2023-07-21T22:17:09.855068+0000","last_active":"2023-07-21T22:18:42.893496+0000","last_peered":"2023-07-21T22:18:42.893496+0000","last_clean":"2023-07-21T22:18:42.893496+0000","last_became_active":"2023-07-21T22:17:09.854697+0000","last_became_peered":"2023-07-21T22:17:09.854697+0000","last_unstale":"2023-07-21T22:18:42.893496+0000","last_undegraded":"2023-07-21T22:18:42.893496+0000","last_fullsized":"2023-07-21T22:18:42.893496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:46.560534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'6","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:53.377977+0000","last_change":"2023-07-21T22:17:08.864292+0000","last_active":"2023-07-21T22:18:53.377977+0000","last_peered":"2023-07-21T22:18:53.377977+0000","last_clean":"2023-07-21T22:18:53.377977+0000","last_became_active":"2023-07-21T22:17:08.863243+0000","last_became_peered":"2023-07-21T22:17:08.863243+0000","last_unstale":"2023-07-21T22:18:53.377977+0000","last_undegraded":"2023-07-21T22:18:53.377977+0000","last_fullsized":"2023-07-21T22:18:53.377977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:46:18.247508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.876771+0000","last_change":"2023-07-21T22:17:09.840756+0000","last_active":"2023-07-21T22:18:42.876771+0000","last_peered":"2023-07-21T22:18:42.876771+0000","last_clean":"2023-07-21T22:18:42.876771+0000","last_became_active":"2023-07-21T22:17:09.840421+0000","last_became_peered":"2023-07-21T22:17:09.840421+0000","last_unstale":"2023-07-21T22:18:42.876771+0000","last_undegraded":"2023-07-21T22:18:42.876771+0000","last_fullsized":"2023-07-21T22:18:42.876771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:30.874703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.491774+0000","last_change":"2023-07-21T22:17:44.491774+0000","last_active":"2023-07-21T22:17:44.491774+0000","last_peered":"2023-07-21T22:17:44.491774+0000","last_clean":"2023-07-21T22:17:44.491774+0000","last_became_active":"2023-07-21T22:17:44.488479+0000","last_became_peered":"2023-07-21T22:17:44.488479+0000","last_unstale":"2023-07-21T22:17:44.491774+0000","last_undegraded":"2023-07-21T22:17:44.491774+0000","last_fullsized":"2023-07-21T22:17:44.491774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:37:54.678291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889331+0000","last_change":"2023-07-21T22:17:09.839359+0000","last_active":"2023-07-21T22:18:42.889331+0000","last_peered":"2023-07-21T22:18:42.889331+0000","last_clean":"2023-07-21T22:18:42.889331+0000","last_became_active":"2023-07-21T22:17:09.839026+0000","last_became_peered":"2023-07-21T22:17:09.839026+0000","last_unstale":"2023-07-21T22:18:42.889331+0000","last_undegraded":"2023-07-21T22:18:42.889331+0000","last_fullsized":"2023-07-21T22:18:42.889331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:39.641691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299788+0000","last_change":"2023-07-21T22:17:08.861680+0000","last_active":"2023-07-21T22:17:44.299788+0000","last_peered":"2023-07-21T22:17:44.299788+0000","last_clean":"2023-07-21T22:17:44.299788+0000","last_became_active":"2023-07-21T22:17:08.861348+0000","last_became_peered":"2023-07-21T22:17:08.861348+0000","last_unstale":"2023-07-21T22:17:44.299788+0000","last_undegraded":"2023-07-21T22:17:44.299788+0000","last_fullsized":"2023-07-21T22:17:44.299788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:54.809555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889908+0000","last_change":"2023-07-21T22:17:09.840166+0000","last_active":"2023-07-21T22:18:42.889908+0000","last_peered":"2023-07-21T22:18:42.889908+0000","last_clean":"2023-07-21T22:18:42.889908+0000","last_became_active":"2023-07-21T22:17:09.839850+0000","last_became_peered":"2023-07-21T22:17:09.839850+0000","last_unstale":"2023-07-21T22:18:42.889908+0000","last_undegraded":"2023-07-21T22:18:42.889908+0000","last_fullsized":"2023-07-21T22:18:42.889908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:43.813137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485915+0000","last_change":"2023-07-21T22:17:08.864838+0000","last_active":"2023-07-21T22:17:44.485915+0000","last_peered":"2023-07-21T22:17:44.485915+0000","last_clean":"2023-07-21T22:17:44.485915+0000","last_became_active":"2023-07-21T22:17:08.864484+0000","last_became_peered":"2023-07-21T22:17:08.864484+0000","last_unstale":"2023-07-21T22:17:44.485915+0000","last_undegraded":"2023-07-21T22:17:44.485915+0000","last_fullsized":"2023-07-21T22:17:44.485915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:55:33.300808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891104+0000","last_change":"2023-07-21T22:17:09.836214+0000","last_active":"2023-07-21T22:18:42.891104+0000","last_peered":"2023-07-21T22:18:42.891104+0000","last_clean":"2023-07-21T22:18:42.891104+0000","last_became_active":"2023-07-21T22:17:09.835877+0000","last_became_peered":"2023-07-21T22:17:09.835877+0000","last_unstale":"2023-07-21T22:18:42.891104+0000","last_undegraded":"2023-07-21T22:18:42.891104+0000","last_fullsized":"2023-07-21T22:18:42.891104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:50.733216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:51.372317+0000","last_change":"2023-07-21T22:17:08.861801+0000","last_active":"2023-07-21T22:18:51.372317+0000","last_peered":"2023-07-21T22:18:51.372317+0000","last_clean":"2023-07-21T22:18:51.372317+0000","last_became_active":"2023-07-21T22:17:08.861391+0000","last_became_peered":"2023-07-21T22:17:08.861391+0000","last_unstale":"2023-07-21T22:18:51.372317+0000","last_undegraded":"2023-07-21T22:18:51.372317+0000","last_fullsized":"2023-07-21T22:18:51.372317+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:27:55.305051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892935+0000","last_change":"2023-07-21T22:17:09.842155+0000","last_active":"2023-07-21T22:18:42.892935+0000","last_peered":"2023-07-21T22:18:42.892935+0000","last_clean":"2023-07-21T22:18:42.892935+0000","last_became_active":"2023-07-21T22:17:09.841845+0000","last_became_peered":"2023-07-21T22:17:09.841845+0000","last_unstale":"2023-07-21T22:18:42.892935+0000","last_undegraded":"2023-07-21T22:18:42.892935+0000","last_fullsized":"2023-07-21T22:18:42.892935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:10.209278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304566+0000","last_change":"2023-07-21T22:17:08.858727+0000","last_active":"2023-07-21T22:17:44.304566+0000","last_peered":"2023-07-21T22:17:44.304566+0000","last_clean":"2023-07-21T22:17:44.304566+0000","last_became_active":"2023-07-21T22:17:08.858376+0000","last_became_peered":"2023-07-21T22:17:08.858376+0000","last_unstale":"2023-07-21T22:17:44.304566+0000","last_undegraded":"2023-07-21T22:17:44.304566+0000","last_fullsized":"2023-07-21T22:17:44.304566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:35.053954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.882407+0000","last_change":"2023-07-21T22:17:09.857300+0000","last_active":"2023-07-21T22:18:42.882407+0000","last_peered":"2023-07-21T22:18:42.882407+0000","last_clean":"2023-07-21T22:18:42.882407+0000","last_became_active":"2023-07-21T22:17:09.856932+0000","last_became_peered":"2023-07-21T22:17:09.856932+0000","last_unstale":"2023-07-21T22:18:42.882407+0000","last_undegraded":"2023-07-21T22:18:42.882407+0000","last_fullsized":"2023-07-21T22:18:42.882407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:28.202771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486481+0000","last_change":"2023-07-21T22:17:08.865488+0000","last_active":"2023-07-21T22:17:44.486481+0000","last_peered":"2023-07-21T22:17:44.486481+0000","last_clean":"2023-07-21T22:17:44.486481+0000","last_became_active":"2023-07-21T22:17:08.865050+0000","last_became_peered":"2023-07-21T22:17:08.865050+0000","last_unstale":"2023-07-21T22:17:44.486481+0000","last_undegraded":"2023-07-21T22:17:44.486481+0000","last_fullsized":"2023-07-21T22:17:44.486481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:12:41.386381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.894208+0000","last_change":"2023-07-21T22:17:09.849880+0000","last_active":"2023-07-21T22:18:42.894208+0000","last_peered":"2023-07-21T22:18:42.894208+0000","last_clean":"2023-07-21T22:18:42.894208+0000","last_became_active":"2023-07-21T22:17:09.849552+0000","last_became_peered":"2023-07-21T22:17:09.849552+0000","last_unstale":"2023-07-21T22:18:42.894208+0000","last_undegraded":"2023-07-21T22:18:42.894208+0000","last_fullsized":"2023-07-21T22:18:42.894208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:57.861104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'31","reported_seq":255,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:52.386870+0000","last_change":"2023-07-21T22:17:08.861663+0000","last_active":"2023-07-21T22:18:52.386870+0000","last_peered":"2023-07-21T22:18:52.386870+0000","last_clean":"2023-07-21T22:18:52.386870+0000","last_became_active":"2023-07-21T22:17:08.861339+0000","last_became_peered":"2023-07-21T22:17:08.861339+0000","last_unstale":"2023-07-21T22:18:52.386870+0000","last_undegraded":"2023-07-21T22:18:52.386870+0000","last_fullsized":"2023-07-21T22:18:52.386870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:23:16.097183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57558,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":158,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.898347+0000","last_change":"2023-07-21T22:17:09.841543+0000","last_active":"2023-07-21T22:18:42.898347+0000","last_peered":"2023-07-21T22:18:42.898347+0000","last_clean":"2023-07-21T22:18:42.898347+0000","last_became_active":"2023-07-21T22:17:09.841235+0000","last_became_peered":"2023-07-21T22:17:09.841235+0000","last_unstale":"2023-07-21T22:18:42.898347+0000","last_undegraded":"2023-07-21T22:18:42.898347+0000","last_fullsized":"2023-07-21T22:18:42.898347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:37:58.825011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303802+0000","last_change":"2023-07-21T22:17:08.855145+0000","last_active":"2023-07-21T22:17:44.303802+0000","last_peered":"2023-07-21T22:17:44.303802+0000","last_clean":"2023-07-21T22:17:44.303802+0000","last_became_active":"2023-07-21T22:17:08.853279+0000","last_became_peered":"2023-07-21T22:17:08.853279+0000","last_unstale":"2023-07-21T22:17:44.303802+0000","last_undegraded":"2023-07-21T22:17:44.303802+0000","last_fullsized":"2023-07-21T22:17:44.303802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:10.333188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896271+0000","last_change":"2023-07-21T22:17:09.835656+0000","last_active":"2023-07-21T22:18:42.896271+0000","last_peered":"2023-07-21T22:18:42.896271+0000","last_clean":"2023-07-21T22:18:42.896271+0000","last_became_active":"2023-07-21T22:17:09.835309+0000","last_became_peered":"2023-07-21T22:17:09.835309+0000","last_unstale":"2023-07-21T22:18:42.896271+0000","last_undegraded":"2023-07-21T22:18:42.896271+0000","last_fullsized":"2023-07-21T22:18:42.896271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:59.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486159+0000","last_change":"2023-07-21T22:17:08.864811+0000","last_active":"2023-07-21T22:17:44.486159+0000","last_peered":"2023-07-21T22:17:44.486159+0000","last_clean":"2023-07-21T22:17:44.486159+0000","last_became_active":"2023-07-21T22:17:08.864428+0000","last_became_peered":"2023-07-21T22:17:08.864428+0000","last_unstale":"2023-07-21T22:17:44.486159+0000","last_undegraded":"2023-07-21T22:17:44.486159+0000","last_fullsized":"2023-07-21T22:17:44.486159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:09.637705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.899354+0000","last_change":"2023-07-21T22:17:09.837713+0000","last_active":"2023-07-21T22:18:42.899354+0000","last_peered":"2023-07-21T22:18:42.899354+0000","last_clean":"2023-07-21T22:18:42.899354+0000","last_became_active":"2023-07-21T22:17:09.837420+0000","last_became_peered":"2023-07-21T22:17:09.837420+0000","last_unstale":"2023-07-21T22:18:42.899354+0000","last_undegraded":"2023-07-21T22:18:42.899354+0000","last_fullsized":"2023-07-21T22:18:42.899354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:00.392623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":129,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:53.406532+0000","last_change":"2023-07-21T22:17:08.854376+0000","last_active":"2023-07-21T22:18:53.406532+0000","last_peered":"2023-07-21T22:18:53.406532+0000","last_clean":"2023-07-21T22:18:53.406532+0000","last_became_active":"2023-07-21T22:17:08.854031+0000","last_became_peered":"2023-07-21T22:17:08.854031+0000","last_unstale":"2023-07-21T22:18:53.406532+0000","last_undegraded":"2023-07-21T22:18:53.406532+0000","last_fullsized":"2023-07-21T22:18:53.406532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:12.749236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.897798+0000","last_change":"2023-07-21T22:17:09.851279+0000","last_active":"2023-07-21T22:18:42.897798+0000","last_peered":"2023-07-21T22:18:42.897798+0000","last_clean":"2023-07-21T22:18:42.897798+0000","last_became_active":"2023-07-21T22:17:09.850948+0000","last_became_peered":"2023-07-21T22:17:09.850948+0000","last_unstale":"2023-07-21T22:18:42.897798+0000","last_undegraded":"2023-07-21T22:18:42.897798+0000","last_fullsized":"2023-07-21T22:18:42.897798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:10:00.991437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305069+0000","last_change":"2023-07-21T22:17:08.865425+0000","last_active":"2023-07-21T22:17:44.305069+0000","last_peered":"2023-07-21T22:17:44.305069+0000","last_clean":"2023-07-21T22:17:44.305069+0000","last_became_active":"2023-07-21T22:17:08.865067+0000","last_became_peered":"2023-07-21T22:17:08.865067+0000","last_unstale":"2023-07-21T22:17:44.305069+0000","last_undegraded":"2023-07-21T22:17:44.305069+0000","last_fullsized":"2023-07-21T22:17:44.305069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:55.543750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.872751+0000","last_change":"2023-07-21T22:17:09.844916+0000","last_active":"2023-07-21T22:18:42.872751+0000","last_peered":"2023-07-21T22:18:42.872751+0000","last_clean":"2023-07-21T22:18:42.872751+0000","last_became_active":"2023-07-21T22:17:09.844632+0000","last_became_peered":"2023-07-21T22:17:09.844632+0000","last_unstale":"2023-07-21T22:18:42.872751+0000","last_undegraded":"2023-07-21T22:18:42.872751+0000","last_fullsized":"2023-07-21T22:18:42.872751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:32:46.857855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305478+0000","last_change":"2023-07-21T22:17:08.862954+0000","last_active":"2023-07-21T22:17:44.305478+0000","last_peered":"2023-07-21T22:17:44.305478+0000","last_clean":"2023-07-21T22:17:44.305478+0000","last_became_active":"2023-07-21T22:17:08.862598+0000","last_became_peered":"2023-07-21T22:17:08.862598+0000","last_unstale":"2023-07-21T22:17:44.305478+0000","last_undegraded":"2023-07-21T22:17:44.305478+0000","last_fullsized":"2023-07-21T22:17:44.305478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:02.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891062+0000","last_change":"2023-07-21T22:17:44.488032+0000","last_active":"2023-07-21T22:18:42.891062+0000","last_peered":"2023-07-21T22:18:42.891062+0000","last_clean":"2023-07-21T22:18:42.891062+0000","last_became_active":"2023-07-21T22:17:44.487524+0000","last_became_peered":"2023-07-21T22:17:44.487524+0000","last_unstale":"2023-07-21T22:18:42.891062+0000","last_undegraded":"2023-07-21T22:18:42.891062+0000","last_fullsized":"2023-07-21T22:18:42.891062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:01.489283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302366+0000","last_change":"2023-07-21T22:17:08.862514+0000","last_active":"2023-07-21T22:17:44.302366+0000","last_peered":"2023-07-21T22:17:44.302366+0000","last_clean":"2023-07-21T22:17:44.302366+0000","last_became_active":"2023-07-21T22:17:08.862223+0000","last_became_peered":"2023-07-21T22:17:08.862223+0000","last_unstale":"2023-07-21T22:17:44.302366+0000","last_undegraded":"2023-07-21T22:17:44.302366+0000","last_fullsized":"2023-07-21T22:17:44.302366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:37:34.099818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893033+0000","last_change":"2023-07-21T22:17:09.852621+0000","last_active":"2023-07-21T22:18:42.893033+0000","last_peered":"2023-07-21T22:18:42.893033+0000","last_clean":"2023-07-21T22:18:42.893033+0000","last_became_active":"2023-07-21T22:17:09.852233+0000","last_became_peered":"2023-07-21T22:17:09.852233+0000","last_unstale":"2023-07-21T22:18:42.893033+0000","last_undegraded":"2023-07-21T22:18:42.893033+0000","last_fullsized":"2023-07-21T22:18:42.893033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:17.187991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304312+0000","last_change":"2023-07-21T22:17:08.861344+0000","last_active":"2023-07-21T22:17:44.304312+0000","last_peered":"2023-07-21T22:17:44.304312+0000","last_clean":"2023-07-21T22:17:44.304312+0000","last_became_active":"2023-07-21T22:17:08.860978+0000","last_became_peered":"2023-07-21T22:17:08.860978+0000","last_unstale":"2023-07-21T22:17:44.304312+0000","last_undegraded":"2023-07-21T22:17:44.304312+0000","last_fullsized":"2023-07-21T22:17:44.304312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:21.901465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890480+0000","last_change":"2023-07-21T22:17:09.852314+0000","last_active":"2023-07-21T22:18:42.890480+0000","last_peered":"2023-07-21T22:18:42.890480+0000","last_clean":"2023-07-21T22:18:42.890480+0000","last_became_active":"2023-07-21T22:17:09.852137+0000","last_became_peered":"2023-07-21T22:17:09.852137+0000","last_unstale":"2023-07-21T22:18:42.890480+0000","last_undegraded":"2023-07-21T22:18:42.890480+0000","last_fullsized":"2023-07-21T22:18:42.890480+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:02.728732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890529+0000","last_change":"2023-07-21T22:17:09.839387+0000","last_active":"2023-07-21T22:18:42.890529+0000","last_peered":"2023-07-21T22:18:42.890529+0000","last_clean":"2023-07-21T22:18:42.890529+0000","last_became_active":"2023-07-21T22:17:09.839052+0000","last_became_peered":"2023-07-21T22:17:09.839052+0000","last_unstale":"2023-07-21T22:18:42.890529+0000","last_undegraded":"2023-07-21T22:18:42.890529+0000","last_fullsized":"2023-07-21T22:18:42.890529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:00.416159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:54.407678+0000","last_change":"2023-07-21T22:17:08.859465+0000","last_active":"2023-07-21T22:18:54.407678+0000","last_peered":"2023-07-21T22:18:54.407678+0000","last_clean":"2023-07-21T22:18:54.407678+0000","last_became_active":"2023-07-21T22:17:08.859076+0000","last_became_peered":"2023-07-21T22:17:08.859076+0000","last_unstale":"2023-07-21T22:18:54.407678+0000","last_undegraded":"2023-07-21T22:18:54.407678+0000","last_fullsized":"2023-07-21T22:18:54.407678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:23.451233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890420+0000","last_change":"2023-07-21T22:17:09.846937+0000","last_active":"2023-07-21T22:18:42.890420+0000","last_peered":"2023-07-21T22:18:42.890420+0000","last_clean":"2023-07-21T22:18:42.890420+0000","last_became_active":"2023-07-21T22:17:09.846638+0000","last_became_peered":"2023-07-21T22:17:09.846638+0000","last_unstale":"2023-07-21T22:18:42.890420+0000","last_undegraded":"2023-07-21T22:18:42.890420+0000","last_fullsized":"2023-07-21T22:18:42.890420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:17.574718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487106+0000","last_change":"2023-07-21T22:17:08.860388+0000","last_active":"2023-07-21T22:17:44.487106+0000","last_peered":"2023-07-21T22:17:44.487106+0000","last_clean":"2023-07-21T22:17:44.487106+0000","last_became_active":"2023-07-21T22:17:08.860039+0000","last_became_peered":"2023-07-21T22:17:08.860039+0000","last_unstale":"2023-07-21T22:17:44.487106+0000","last_undegraded":"2023-07-21T22:17:44.487106+0000","last_fullsized":"2023-07-21T22:17:44.487106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:34.981385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304177+0000","last_change":"2023-07-21T22:15:51.342448+0000","last_active":"2023-07-21T22:17:44.304177+0000","last_peered":"2023-07-21T22:17:44.304177+0000","last_clean":"2023-07-21T22:17:44.304177+0000","last_became_active":"2023-07-21T22:15:51.342004+0000","last_became_peered":"2023-07-21T22:15:51.342004+0000","last_unstale":"2023-07-21T22:17:44.304177+0000","last_undegraded":"2023-07-21T22:17:44.304177+0000","last_fullsized":"2023-07-21T22:17:44.304177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_clean_scrub_stamp":"2023-07-21T22:12:15.345227+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:29.784967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.879253+0000","last_change":"2023-07-21T22:17:09.838402+0000","last_active":"2023-07-21T22:18:42.879253+0000","last_peered":"2023-07-21T22:18:42.879253+0000","last_clean":"2023-07-21T22:18:42.879253+0000","last_became_active":"2023-07-21T22:17:09.838096+0000","last_became_peered":"2023-07-21T22:17:09.838096+0000","last_unstale":"2023-07-21T22:18:42.879253+0000","last_undegraded":"2023-07-21T22:18:42.879253+0000","last_fullsized":"2023-07-21T22:18:42.879253+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:37.376969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304274+0000","last_change":"2023-07-21T22:17:08.865676+0000","last_active":"2023-07-21T22:17:44.304274+0000","last_peered":"2023-07-21T22:17:44.304274+0000","last_clean":"2023-07-21T22:17:44.304274+0000","last_became_active":"2023-07-21T22:17:08.865370+0000","last_became_peered":"2023-07-21T22:17:08.865370+0000","last_unstale":"2023-07-21T22:17:44.304274+0000","last_undegraded":"2023-07-21T22:17:44.304274+0000","last_fullsized":"2023-07-21T22:17:44.304274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:36.039312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304666+0000","last_change":"2023-07-21T22:17:08.864487+0000","last_active":"2023-07-21T22:17:44.304666+0000","last_peered":"2023-07-21T22:17:44.304666+0000","last_clean":"2023-07-21T22:17:44.304666+0000","last_became_active":"2023-07-21T22:17:08.863943+0000","last_became_peered":"2023-07-21T22:17:08.863943+0000","last_unstale":"2023-07-21T22:17:44.304666+0000","last_undegraded":"2023-07-21T22:17:44.304666+0000","last_fullsized":"2023-07-21T22:17:44.304666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:00.454414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.879926+0000","last_change":"2023-07-21T22:17:09.833812+0000","last_active":"2023-07-21T22:18:42.879926+0000","last_peered":"2023-07-21T22:18:42.879926+0000","last_clean":"2023-07-21T22:18:42.879926+0000","last_became_active":"2023-07-21T22:17:09.833496+0000","last_became_peered":"2023-07-21T22:17:09.833496+0000","last_unstale":"2023-07-21T22:18:42.879926+0000","last_undegraded":"2023-07-21T22:18:42.879926+0000","last_fullsized":"2023-07-21T22:18:42.879926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:32.258278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.620533+0000","last_change":"2023-07-21T22:17:08.867858+0000","last_active":"2023-07-21T22:18:43.620533+0000","last_peered":"2023-07-21T22:18:43.620533+0000","last_clean":"2023-07-21T22:18:43.620533+0000","last_became_active":"2023-07-21T22:17:08.867468+0000","last_became_peered":"2023-07-21T22:17:08.867468+0000","last_unstale":"2023-07-21T22:18:43.620533+0000","last_undegraded":"2023-07-21T22:18:43.620533+0000","last_fullsized":"2023-07-21T22:18:43.620533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:52.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896036+0000","last_change":"2023-07-21T22:17:09.846988+0000","last_active":"2023-07-21T22:18:42.896036+0000","last_peered":"2023-07-21T22:18:42.896036+0000","last_clean":"2023-07-21T22:18:42.896036+0000","last_became_active":"2023-07-21T22:17:09.846686+0000","last_became_peered":"2023-07-21T22:17:09.846686+0000","last_unstale":"2023-07-21T22:18:42.896036+0000","last_undegraded":"2023-07-21T22:18:42.896036+0000","last_fullsized":"2023-07-21T22:18:42.896036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:48.205318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487213+0000","last_change":"2023-07-21T22:17:08.857694+0000","last_active":"2023-07-21T22:17:44.487213+0000","last_peered":"2023-07-21T22:17:44.487213+0000","last_clean":"2023-07-21T22:17:44.487213+0000","last_became_active":"2023-07-21T22:17:08.857356+0000","last_became_peered":"2023-07-21T22:17:08.857356+0000","last_unstale":"2023-07-21T22:17:44.487213+0000","last_undegraded":"2023-07-21T22:17:44.487213+0000","last_fullsized":"2023-07-21T22:17:44.487213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:39:39.361769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893786+0000","last_change":"2023-07-21T22:17:09.858500+0000","last_active":"2023-07-21T22:18:42.893786+0000","last_peered":"2023-07-21T22:18:42.893786+0000","last_clean":"2023-07-21T22:18:42.893786+0000","last_became_active":"2023-07-21T22:17:09.858009+0000","last_became_peered":"2023-07-21T22:17:09.858009+0000","last_unstale":"2023-07-21T22:18:42.893786+0000","last_undegraded":"2023-07-21T22:18:42.893786+0000","last_fullsized":"2023-07-21T22:18:42.893786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:19:05.454111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305503+0000","last_change":"2023-07-21T22:17:08.853732+0000","last_active":"2023-07-21T22:17:44.305503+0000","last_peered":"2023-07-21T22:17:44.305503+0000","last_clean":"2023-07-21T22:17:44.305503+0000","last_became_active":"2023-07-21T22:17:08.853397+0000","last_became_peered":"2023-07-21T22:17:08.853397+0000","last_unstale":"2023-07-21T22:17:44.305503+0000","last_undegraded":"2023-07-21T22:17:44.305503+0000","last_fullsized":"2023-07-21T22:17:44.305503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:18.249465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.869110+0000","last_change":"2023-07-21T22:17:09.840836+0000","last_active":"2023-07-21T22:18:42.869110+0000","last_peered":"2023-07-21T22:18:42.869110+0000","last_clean":"2023-07-21T22:18:42.869110+0000","last_became_active":"2023-07-21T22:17:09.840463+0000","last_became_peered":"2023-07-21T22:17:09.840463+0000","last_unstale":"2023-07-21T22:18:42.869110+0000","last_undegraded":"2023-07-21T22:18:42.869110+0000","last_fullsized":"2023-07-21T22:18:42.869110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:24.284857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303419+0000","last_change":"2023-07-21T22:17:08.865129+0000","last_active":"2023-07-21T22:17:44.303419+0000","last_peered":"2023-07-21T22:17:44.303419+0000","last_clean":"2023-07-21T22:17:44.303419+0000","last_became_active":"2023-07-21T22:17:08.864820+0000","last_became_peered":"2023-07-21T22:17:08.864820+0000","last_unstale":"2023-07-21T22:17:44.303419+0000","last_undegraded":"2023-07-21T22:17:44.303419+0000","last_fullsized":"2023-07-21T22:17:44.303419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:07.661921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.878364+0000","last_change":"2023-07-21T22:17:09.846804+0000","last_active":"2023-07-21T22:18:42.878364+0000","last_peered":"2023-07-21T22:18:42.878364+0000","last_clean":"2023-07-21T22:18:42.878364+0000","last_became_active":"2023-07-21T22:17:09.846390+0000","last_became_peered":"2023-07-21T22:17:09.846390+0000","last_unstale":"2023-07-21T22:18:42.878364+0000","last_undegraded":"2023-07-21T22:18:42.878364+0000","last_fullsized":"2023-07-21T22:18:42.878364+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:42.837431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.317619+0000","last_change":"2023-07-21T22:17:44.317155+0000","last_active":"2023-07-21T22:17:44.317619+0000","last_peered":"2023-07-21T22:17:44.317619+0000","last_clean":"2023-07-21T22:17:44.317619+0000","last_became_active":"2023-07-21T22:17:44.307394+0000","last_became_peered":"2023-07-21T22:17:44.307394+0000","last_unstale":"2023-07-21T22:17:44.317619+0000","last_undegraded":"2023-07-21T22:17:44.317619+0000","last_fullsized":"2023-07-21T22:17:44.317619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:59.993004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892585+0000","last_change":"2023-07-21T22:17:09.849197+0000","last_active":"2023-07-21T22:18:42.892585+0000","last_peered":"2023-07-21T22:18:42.892585+0000","last_clean":"2023-07-21T22:18:42.892585+0000","last_became_active":"2023-07-21T22:17:09.848835+0000","last_became_peered":"2023-07-21T22:17:09.848835+0000","last_unstale":"2023-07-21T22:18:42.892585+0000","last_undegraded":"2023-07-21T22:18:42.892585+0000","last_fullsized":"2023-07-21T22:18:42.892585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:22.001862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.314830+0000","last_change":"2023-07-21T22:17:44.314329+0000","last_active":"2023-07-21T22:17:44.314830+0000","last_peered":"2023-07-21T22:17:44.314830+0000","last_clean":"2023-07-21T22:17:44.314830+0000","last_became_active":"2023-07-21T22:17:44.307075+0000","last_became_peered":"2023-07-21T22:17:44.307075+0000","last_unstale":"2023-07-21T22:17:44.314830+0000","last_undegraded":"2023-07-21T22:17:44.314830+0000","last_fullsized":"2023-07-21T22:17:44.314830+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:28.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896596+0000","last_change":"2023-07-21T22:17:09.847279+0000","last_active":"2023-07-21T22:18:42.896596+0000","last_peered":"2023-07-21T22:18:42.896596+0000","last_clean":"2023-07-21T22:18:42.896596+0000","last_became_active":"2023-07-21T22:17:09.846982+0000","last_became_peered":"2023-07-21T22:17:09.846982+0000","last_unstale":"2023-07-21T22:18:42.896596+0000","last_undegraded":"2023-07-21T22:18:42.896596+0000","last_fullsized":"2023-07-21T22:18:42.896596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:14.985134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304706+0000","last_change":"2023-07-21T22:17:08.857436+0000","last_active":"2023-07-21T22:17:44.304706+0000","last_peered":"2023-07-21T22:17:44.304706+0000","last_clean":"2023-07-21T22:17:44.304706+0000","last_became_active":"2023-07-21T22:17:08.857046+0000","last_became_peered":"2023-07-21T22:17:08.857046+0000","last_unstale":"2023-07-21T22:17:44.304706+0000","last_undegraded":"2023-07-21T22:17:44.304706+0000","last_fullsized":"2023-07-21T22:17:44.304706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:23.427814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896971+0000","last_change":"2023-07-21T22:17:09.852916+0000","last_active":"2023-07-21T22:18:42.896971+0000","last_peered":"2023-07-21T22:18:42.896971+0000","last_clean":"2023-07-21T22:18:42.896971+0000","last_became_active":"2023-07-21T22:17:09.852608+0000","last_became_peered":"2023-07-21T22:17:09.852608+0000","last_unstale":"2023-07-21T22:18:42.896971+0000","last_undegraded":"2023-07-21T22:18:42.896971+0000","last_fullsized":"2023-07-21T22:18:42.896971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:21.187686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486196+0000","last_change":"2023-07-21T22:17:08.859619+0000","last_active":"2023-07-21T22:17:44.486196+0000","last_peered":"2023-07-21T22:17:44.486196+0000","last_clean":"2023-07-21T22:17:44.486196+0000","last_became_active":"2023-07-21T22:17:08.859256+0000","last_became_peered":"2023-07-21T22:17:08.859256+0000","last_unstale":"2023-07-21T22:17:44.486196+0000","last_undegraded":"2023-07-21T22:17:44.486196+0000","last_fullsized":"2023-07-21T22:17:44.486196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:49.010457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.898245+0000","last_change":"2023-07-21T22:17:09.850548+0000","last_active":"2023-07-21T22:18:42.898245+0000","last_peered":"2023-07-21T22:18:42.898245+0000","last_clean":"2023-07-21T22:18:42.898245+0000","last_became_active":"2023-07-21T22:17:09.850261+0000","last_became_peered":"2023-07-21T22:17:09.850261+0000","last_unstale":"2023-07-21T22:18:42.898245+0000","last_undegraded":"2023-07-21T22:18:42.898245+0000","last_fullsized":"2023-07-21T22:18:42.898245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:05.546844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299865+0000","last_change":"2023-07-21T22:17:08.859729+0000","last_active":"2023-07-21T22:17:44.299865+0000","last_peered":"2023-07-21T22:17:44.299865+0000","last_clean":"2023-07-21T22:17:44.299865+0000","last_became_active":"2023-07-21T22:17:08.859421+0000","last_became_peered":"2023-07-21T22:17:08.859421+0000","last_unstale":"2023-07-21T22:17:44.299865+0000","last_undegraded":"2023-07-21T22:17:44.299865+0000","last_fullsized":"2023-07-21T22:17:44.299865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:21.189655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896517+0000","last_change":"2023-07-21T22:17:09.846413+0000","last_active":"2023-07-21T22:18:42.896517+0000","last_peered":"2023-07-21T22:18:42.896517+0000","last_clean":"2023-07-21T22:18:42.896517+0000","last_became_active":"2023-07-21T22:17:09.846038+0000","last_became_peered":"2023-07-21T22:17:09.846038+0000","last_unstale":"2023-07-21T22:18:42.896517+0000","last_undegraded":"2023-07-21T22:18:42.896517+0000","last_fullsized":"2023-07-21T22:18:42.896517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:08.536390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.877721+0000","last_change":"2023-07-21T22:17:09.846786+0000","last_active":"2023-07-21T22:18:42.877721+0000","last_peered":"2023-07-21T22:18:42.877721+0000","last_clean":"2023-07-21T22:18:42.877721+0000","last_became_active":"2023-07-21T22:17:09.846437+0000","last_became_peered":"2023-07-21T22:17:09.846437+0000","last_unstale":"2023-07-21T22:18:42.877721+0000","last_undegraded":"2023-07-21T22:18:42.877721+0000","last_fullsized":"2023-07-21T22:18:42.877721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:38.254130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.882594+0000","last_change":"2023-07-21T22:17:44.487796+0000","last_active":"2023-07-21T22:18:42.882594+0000","last_peered":"2023-07-21T22:18:42.882594+0000","last_clean":"2023-07-21T22:18:42.882594+0000","last_became_active":"2023-07-21T22:17:44.487278+0000","last_became_peered":"2023-07-21T22:17:44.487278+0000","last_unstale":"2023-07-21T22:18:42.882594+0000","last_undegraded":"2023-07-21T22:18:42.882594+0000","last_fullsized":"2023-07-21T22:18:42.882594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:36.983831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.887103+0000","last_change":"2023-07-21T22:17:09.850137+0000","last_active":"2023-07-21T22:18:42.887103+0000","last_peered":"2023-07-21T22:18:42.887103+0000","last_clean":"2023-07-21T22:18:42.887103+0000","last_became_active":"2023-07-21T22:17:09.849721+0000","last_became_peered":"2023-07-21T22:17:09.849721+0000","last_unstale":"2023-07-21T22:18:42.887103+0000","last_undegraded":"2023-07-21T22:18:42.887103+0000","last_fullsized":"2023-07-21T22:18:42.887103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:42.785707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.880240+0000","last_change":"2023-07-21T22:17:09.858573+0000","last_active":"2023-07-21T22:18:42.880240+0000","last_peered":"2023-07-21T22:18:42.880240+0000","last_clean":"2023-07-21T22:18:42.880240+0000","last_became_active":"2023-07-21T22:17:09.858017+0000","last_became_peered":"2023-07-21T22:17:09.858017+0000","last_unstale":"2023-07-21T22:18:42.880240+0000","last_undegraded":"2023-07-21T22:18:42.880240+0000","last_fullsized":"2023-07-21T22:18:42.880240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:20.029025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.880436+0000","last_change":"2023-07-21T22:17:44.486812+0000","last_active":"2023-07-21T22:18:42.880436+0000","last_peered":"2023-07-21T22:18:42.880436+0000","last_clean":"2023-07-21T22:18:42.880436+0000","last_became_active":"2023-07-21T22:17:44.486392+0000","last_became_peered":"2023-07-21T22:17:44.486392+0000","last_unstale":"2023-07-21T22:18:42.880436+0000","last_undegraded":"2023-07-21T22:18:42.880436+0000","last_fullsized":"2023-07-21T22:18:42.880436+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:12.827232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.883269+0000","last_change":"2023-07-21T22:17:09.845251+0000","last_active":"2023-07-21T22:18:42.883269+0000","last_peered":"2023-07-21T22:18:42.883269+0000","last_clean":"2023-07-21T22:18:42.883269+0000","last_became_active":"2023-07-21T22:17:09.844945+0000","last_became_peered":"2023-07-21T22:17:09.844945+0000","last_unstale":"2023-07-21T22:18:42.883269+0000","last_undegraded":"2023-07-21T22:18:42.883269+0000","last_fullsized":"2023-07-21T22:18:42.883269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:50.719284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.888580+0000","last_change":"2023-07-21T22:17:09.850953+0000","last_active":"2023-07-21T22:18:42.888580+0000","last_peered":"2023-07-21T22:18:42.888580+0000","last_clean":"2023-07-21T22:18:42.888580+0000","last_became_active":"2023-07-21T22:17:09.850627+0000","last_became_peered":"2023-07-21T22:17:09.850627+0000","last_unstale":"2023-07-21T22:18:42.888580+0000","last_undegraded":"2023-07-21T22:18:42.888580+0000","last_fullsized":"2023-07-21T22:18:42.888580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:01:24.705224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892604+0000","last_change":"2023-07-21T22:17:09.841222+0000","last_active":"2023-07-21T22:18:42.892604+0000","last_peered":"2023-07-21T22:18:42.892604+0000","last_clean":"2023-07-21T22:18:42.892604+0000","last_became_active":"2023-07-21T22:17:09.840864+0000","last_became_peered":"2023-07-21T22:17:09.840864+0000","last_unstale":"2023-07-21T22:18:42.892604+0000","last_undegraded":"2023-07-21T22:18:42.892604+0000","last_fullsized":"2023-07-21T22:18:42.892604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:23.181094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.885879+0000","last_change":"2023-07-21T22:17:09.837688+0000","last_active":"2023-07-21T22:18:42.885879+0000","last_peered":"2023-07-21T22:18:42.885879+0000","last_clean":"2023-07-21T22:18:42.885879+0000","last_became_active":"2023-07-21T22:17:09.837325+0000","last_became_peered":"2023-07-21T22:17:09.837325+0000","last_unstale":"2023-07-21T22:18:42.885879+0000","last_undegraded":"2023-07-21T22:18:42.885879+0000","last_fullsized":"2023-07-21T22:18:42.885879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:06:00.041198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893368+0000","last_change":"2023-07-21T22:17:09.843791+0000","last_active":"2023-07-21T22:18:42.893368+0000","last_peered":"2023-07-21T22:18:42.893368+0000","last_clean":"2023-07-21T22:18:42.893368+0000","last_became_active":"2023-07-21T22:17:09.843438+0000","last_became_peered":"2023-07-21T22:17:09.843438+0000","last_unstale":"2023-07-21T22:18:42.893368+0000","last_undegraded":"2023-07-21T22:18:42.893368+0000","last_fullsized":"2023-07-21T22:18:42.893368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:10:55.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.895426+0000","last_change":"2023-07-21T22:17:09.849062+0000","last_active":"2023-07-21T22:18:42.895426+0000","last_peered":"2023-07-21T22:18:42.895426+0000","last_clean":"2023-07-21T22:18:42.895426+0000","last_became_active":"2023-07-21T22:17:09.848153+0000","last_became_peered":"2023-07-21T22:17:09.848153+0000","last_unstale":"2023-07-21T22:18:42.895426+0000","last_undegraded":"2023-07-21T22:18:42.895426+0000","last_fullsized":"2023-07-21T22:18:42.895426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:30.677689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896467+0000","last_change":"2023-07-21T22:17:09.849010+0000","last_active":"2023-07-21T22:18:42.896467+0000","last_peered":"2023-07-21T22:18:42.896467+0000","last_clean":"2023-07-21T22:18:42.896467+0000","last_became_active":"2023-07-21T22:17:09.848679+0000","last_became_peered":"2023-07-21T22:17:09.848679+0000","last_unstale":"2023-07-21T22:18:42.896467+0000","last_undegraded":"2023-07-21T22:18:42.896467+0000","last_fullsized":"2023-07-21T22:18:42.896467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:40.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891473+0000","last_change":"2023-07-21T22:17:09.846419+0000","last_active":"2023-07-21T22:18:42.891473+0000","last_peered":"2023-07-21T22:18:42.891473+0000","last_clean":"2023-07-21T22:18:42.891473+0000","last_became_active":"2023-07-21T22:17:09.846037+0000","last_became_peered":"2023-07-21T22:17:09.846037+0000","last_unstale":"2023-07-21T22:18:42.891473+0000","last_undegraded":"2023-07-21T22:18:42.891473+0000","last_fullsized":"2023-07-21T22:18:42.891473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:33:14.382111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248938,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62569,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":625,"num_read_kb":377,"num_write":162,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":196347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383715,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":456133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70799999999999996,"15min":0.70099999999999996},"min":{"1min":0.53100000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.999,"5min":1.085,"15min":1.085},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90300000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77900000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.999,"5min":1.028,"15min":1.028},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.77900000000000003},"min":{"1min":0.60399999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.026,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88600000000000001,"5min":1.202,"15min":1.202},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.48699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.628}]},{"osd":7,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.024,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93500000000000005,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.63200000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.85299999999999998}]},{"osd":9,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.71199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.484,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.878},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.88600000000000001,"15min":0.878},"min":{"1min":0.70199999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0760000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.88800000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88,"15min":0.88600000000000001},"min":{"1min":0.63400000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.98199999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.80100000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.056,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.90000000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1089536,"data_stored":1106144,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":0.628},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.1360000000000001,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.88}]},{"osd":2,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.0629999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.85099999999999998,"15min":0.878},"min":{"1min":0.56000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.998,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.97599999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.85599999999999998,"15min":0.871},"min":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92800000000000005,"5min":4.3739999999999997,"15min":4.3739999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.47399999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.878,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.032,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.099,"5min":1.224,"15min":1.224},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.91700000000000004,"15min":0.94999999999999996},"min":{"1min":0.61399999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.079,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.02}]},{"osd":6,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.98599999999999999,"15min":1.006},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0629999999999999,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.90900000000000003,"15min":0.91300000000000003},"min":{"1min":0.64100000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.998,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.63800000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.94899999999999995,"15min":0.98399999999999999},"min":{"1min":0.68700000000000006,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.034,"5min":1.431,"15min":1.431},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.97199999999999998,"15min":1.008},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.83499999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.72299999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0680000000000001,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.871,"5min":1.0029999999999999,"15min":1.0329999999999999},"min":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.125,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.76400000000000001}]},{"osd":11,"last update":"Fri Jul 21 22:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":0.94299999999999995},"min":{"1min":0.72999999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1899999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.65500000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.212,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.99399999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.53200000000000003,"15min":0.56399999999999995},"min":{"1min":0.33000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.56399999999999995,"15min":0.60499999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60599999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.755,"15min":0.79500000000000004},"min":{"1min":0.441,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.80500000000000005,"15min":0.85999999999999999},"min":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":1.393,"15min":1.393},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76500000000000001,"15min":0.78500000000000003},"min":{"1min":0.50900000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78700000000000003,"15min":0.82699999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89700000000000002,"5min":1.335,"15min":1.335},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.68799999999999994,"15min":0.755},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79700000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81899999999999995,"15min":0.871},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93300000000000005,"5min":1.464,"15min":1.464},"last":0.751},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":0.89400000000000002},"min":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.056,"5min":1.3,"15min":1.3},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84299999999999997,"15min":0.89700000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1599999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.879},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.84499999999999997,"15min":0.877},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78900000000000003,"15min":0.84299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0249999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.86299999999999999,"15min":0.93700000000000006},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.878,"5min":1.431,"15min":1.431},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91800000000000004,"15min":0.98799999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.129,"5min":1.696,"15min":1.696},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.93999999999999995,"15min":0.99099999999999999},"min":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2050000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.82599999999999996}]},{"osd":8,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.94299999999999995,"15min":1.004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0009999999999999,"5min":1.496,"15min":1.496},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94399999999999995,"15min":1.002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.214,"5min":1.667,"15min":1.667},"last":0.84299999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.90700000000000003,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0429999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.95799999999999996,"5min":1.264,"15min":1.264},"last":0.80400000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68300000000000005,"15min":0.70099999999999996},"min":{"1min":0.48099999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.623},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.51400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.083,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.92300000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.373,"15min":0.373},"max":{"1min":0.97799999999999998,"5min":1.056,"15min":1.056},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.501}]},{"osd":3,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.80300000000000005},"min":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0009999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72899999999999998,"15min":0.749},"min":{"1min":0.442,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.84299999999999997,"15min":0.84899999999999998},"min":{"1min":0.68400000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1719999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.76900000000000002},"min":{"1min":0.53100000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98099999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.88800000000000001,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1950000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.93799999999999994,"15min":0.94599999999999995},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.90000000000000002,"15min":0.91300000000000003},"min":{"1min":0.72999999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90800000000000003,"15min":0.92600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.155,"5min":1.321,"15min":1.321},"last":0.94299999999999995}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.83199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":0.92600000000000005,"15min":0.89900000000000002},"min":{"1min":0.67400000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.82899999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.74299999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.2190000000000001,"5min":1.254,"15min":1.254},"last":1.085},{"interface":"front","average":{"1min":0.995,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.755,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.0229999999999999}]},{"osd":11,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.038},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.0600000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":1003520,"data_stored":1048904,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.499},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.441},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.38900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.63100000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68300000000000005,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.93500000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.75}]},{"osd":3,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":0.92200000000000004,"15min":0.78400000000000003},"min":{"1min":0.57199999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.4370000000000001,"5min":0.90800000000000003,"15min":0.77400000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":11.212,"5min":11.212,"15min":11.212},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.46500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91200000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.623,"15min":0.65900000000000003},"min":{"1min":0.41599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54100000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.0469999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.82099999999999995,"15min":0.78000000000000003},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":7.1479999999999997,"15min":7.1479999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.022,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.72199999999999998}]},{"osd":8,"last update":"Fri Jul 21 22:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84099999999999997,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.90500000000000003}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.88400000000000001,"15min":0.86799999999999999},"min":{"1min":0.64300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.034,"5min":0.88900000000000001,"15min":0.86699999999999999},"min":{"1min":0.67100000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.79900000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.87,"15min":0.88100000000000001},"min":{"1min":0.64500000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0600000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.99299999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.59399999999999997}]},{"osd":11,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.871},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.97399999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495678,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":455764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.51300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1970000000000001,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":1.143,"15min":1.143},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.54700000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.372,"15min":0.372},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.87}]},{"osd":4,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.72999999999999998},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.76500000000000001},"min":{"1min":0.47999999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":3.8759999999999999,"15min":3.8759999999999999},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.57399999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94999999999999996,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76700000000000002,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77300000000000002,"15min":0.73699999999999999},"min":{"1min":0.58699999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.61399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.002,"5min":1.071,"15min":1.071},"last":0.91500000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.623,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.754},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82699999999999996,"15min":0.80900000000000005},"min":{"1min":0.65600000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.004,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.69599999999999995}]},{"osd":9,"last update":"Fri Jul 21 22:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":0.91000000000000003,"15min":0.89300000000000002},"min":{"1min":0.58999999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":6.2880000000000003,"5min":6.2880000000000003,"15min":6.2880000000000003},"last":0.85999999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90200000000000002,"15min":0.91400000000000003},"min":{"1min":0.751,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.018,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.71499999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98299999999999998,"5min":1.196,"15min":1.196},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":1003520,"data_stored":517156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.48899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84299999999999997,"5min":0.98599999999999999,"15min":1.0620000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.628}]},{"osd":2,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.34300000000000003},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.68899999999999995},"min":{"1min":0.434,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93100000000000005,"5min":7.2720000000000002,"15min":7.2720000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.97099999999999997,"5min":0.997,"15min":0.997},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.56699999999999995,"15min":0.497},"min":{"1min":0.443,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.55800000000000005,"15min":0.50600000000000001},"min":{"1min":0.46100000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.73599999999999999,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.68600000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0229999999999999,"5min":1.036,"15min":1.036},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81599999999999995,"15min":0.748},"min":{"1min":0.66000000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.022,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":1.147}]},{"osd":7,"last update":"Fri Jul 21 22:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94999999999999996,"5min":1.03,"15min":1.03},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.73399999999999999,"15min":0.68899999999999995},"min":{"1min":0.60099999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.115}]},{"osd":8,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.79500000000000004,"15min":0.78300000000000003},"min":{"1min":0.67200000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.84899999999999998,"15min":0.81499999999999995},"min":{"1min":0.79900000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.1339999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.872,"15min":0.84299999999999997},"min":{"1min":0.76700000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.056,"15min":1.1299999999999999},"min":{"1min":0.76100000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1140000000000001,"5min":7.4530000000000003,"15min":7.4530000000000003},"last":1.0880000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.83999999999999997,"15min":0.82099999999999995},"min":{"1min":0.58599999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.075,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.02,"5min":0.94699999999999995,"15min":0.91900000000000004},"min":{"1min":0.78600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.103}]},{"osd":11,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.2090000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":457029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91400000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.64100000000000001},"min":{"1min":0.50800000000000001,"5min":0.44,"15min":0.432},"max":{"1min":1.002,"5min":1.244,"15min":1.244},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65900000000000003,"15min":0.61799999999999999},"min":{"1min":0.47799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.61399999999999999},"min":{"1min":0.51000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3360000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.70899999999999996,"15min":0.625},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4580000000000002,"5min":6.4580000000000002,"15min":6.4580000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68500000000000005,"15min":0.64700000000000002},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.879,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.63,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92500000000000004,"5min":1.508,"15min":1.508},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.78800000000000003,"15min":0.72299999999999998},"min":{"1min":0.53400000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.9470000000000001,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.41899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.751}]},{"osd":8,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.61399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88200000000000001,"5min":1.163,"15min":1.163},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.66000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Jul 21 22:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82899999999999996,"15min":0.88},"min":{"1min":0.51500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.82099999999999995,"15min":0.86099999999999999},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0509999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.84299999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.85099999999999998,"15min":0.89000000000000001},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91700000000000004,"5min":1.484,"15min":1.484},"last":0.621},{"interface":"front","average":{"1min":0.751,"5min":1.1200000000000001,"15min":1.2649999999999999},"min":{"1min":0.624,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.878,"5min":7.5209999999999999,"15min":7.5209999999999999},"last":0.71299999999999997}]},{"osd":11,"last update":"Fri Jul 21 22:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.83399999999999996,"15min":0.83199999999999996},"min":{"1min":0.70399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.038,"5min":1.357,"15min":1.357},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.70799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.80400000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":1028096,"data_stored":518941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.70599999999999996,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.443},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.64300000000000002,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.61699999999999999},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":1.476,"15min":1.476},"last":0.629},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.72699999999999998,"15min":0.63200000000000001},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.36499999999999999},"max":{"1min":1.01,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68100000000000005,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.67300000000000004},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.874}]},{"osd":5,"last update":"Fri Jul 21 22:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98799999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.63500000000000001,"15min":0.56699999999999995},"min":{"1min":0.48599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.84099999999999997,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.4900000000000002,"5min":8.4900000000000002,"15min":8.4900000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.2350000000000001,"5min":0.86899999999999999,"15min":0.78500000000000003},"min":{"1min":0.67500000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":8.4730000000000008,"5min":8.4730000000000008,"15min":8.4730000000000008},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60999999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96399999999999997,"5min":1.409,"15min":1.409},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.113,"5min":1.181,"15min":1.181},"last":0.82499999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.141,"5min":4.141,"15min":4.141},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.105,"5min":1.002,"15min":0.996},"min":{"1min":0.73099999999999998,"5min":0.63,"15min":0.63},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.95199999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:18:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.59799999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.0960000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.91400000000000003,"15min":0.93100000000000005},"min":{"1min":0.68899999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0409999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.91600000000000004}]},{"osd":11,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.97199999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":456081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.45700000000000002,"15min":0.41599999999999998},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.442},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.499,"15min":0.443},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.60499999999999998},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.71599999999999997,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.70599999999999996,"15min":0.65000000000000002},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.745}]},{"osd":4,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76900000000000002,"15min":0.69899999999999995},"min":{"1min":0.49199999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.7769999999999999,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.73199999999999998,"15min":0.68899999999999995},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.68400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88600000000000001,"5min":1.702,"15min":1.702},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.75,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93400000000000005,"5min":2.032,"15min":2.032},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73499999999999999,"15min":0.69699999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93500000000000005,"15min":1.042},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.143,"5min":6.9740000000000002,"15min":6.9740000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.95099999999999996,"15min":1.0760000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91900000000000004,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.68200000000000005}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.1140000000000001,"15min":1.157},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.083,"5min":7.0030000000000001,"15min":7.0030000000000001},"last":0.629},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1080000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73499999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.88100000000000001,"15min":0.92100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.85999999999999999,"15min":0.89200000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.66900000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97899999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.69999999999999996}]},{"osd":11,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.80600000000000005}]}]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":457161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.873,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.433},"min":{"1min":0.313,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.432},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.45600000000000002},"min":{"1min":0.377,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70899999999999996,"15min":0.65500000000000003},"min":{"1min":0.61499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":1.056,"15min":1.056},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.74199999999999999,"15min":0.67100000000000004},"min":{"1min":0.45000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.77900000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.58599999999999997},"min":{"1min":0.52200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.96999999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.67500000000000004,"15min":0.621},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86599999999999999,"5min":1.236,"15min":1.236},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0529999999999999,"5min":1.194,"15min":1.194},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.79200000000000004,"15min":0.73999999999999999},"min":{"1min":0.71899999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94099999999999995,"5min":1.175,"15min":1.175},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.093,"15min":1.093},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0629999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68899999999999995,"15min":0.65500000000000003},"min":{"1min":0.505,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88400000000000001,"5min":1.127,"15min":1.127},"last":0.625},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.749,"15min":0.68700000000000006},"min":{"1min":0.54600000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0209999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.85299999999999998}]},{"osd":8,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.624,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0529999999999999,"5min":1.165,"15min":1.165},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.224,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70099999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.63,"5min":0.503,"15min":0.503},"max":{"1min":1.224,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.52800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.82599999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.57799999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.024,"5min":1.327,"15min":1.327},"last":0.878},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.97599999999999998,"15min":0.99299999999999999},"min":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1040000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.92200000000000004}]},{"osd":11,"last update":"Fri Jul 21 22:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.99099999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":1047953,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68500000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.64100000000000001,"15min":0.60599999999999998},"min":{"1min":0.45200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.9550000000000001,"5min":4.9550000000000001,"15min":4.9550000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.67800000000000005,"15min":0.60599999999999998},"min":{"1min":0.53600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.91100000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.65900000000000003},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":6.9340000000000002,"15min":6.9340000000000002},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.52300000000000002,"15min":0.48699999999999999},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.50900000000000001},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71199999999999997,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.109,"5min":6.9160000000000004,"15min":6.9160000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.87,"5min":7.0129999999999999,"15min":7.0129999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72399999999999998,"15min":0.66400000000000003},"min":{"1min":0.53100000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.99199999999999999,"5min":1.177,"15min":1.177},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.73299999999999998,"15min":0.67700000000000005},"min":{"1min":0.64400000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0289999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":0.89500000000000002,"15min":0.77300000000000002},"min":{"1min":0.53200000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":6.3799999999999999,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.034,"5min":0.79000000000000004,"15min":0.753},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":6.6260000000000003,"5min":6.6260000000000003,"15min":6.6260000000000003},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Jul 21 22:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.64400000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.88},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.79800000000000004,"15min":0.77900000000000003},"min":{"1min":0.63700000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.05,"5min":1.139,"15min":1.139},"last":0.87}]},{"osd":8,"last update":"Fri Jul 21 22:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76400000000000001,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.071,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.89200000000000002}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83499999999999996,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1619999999999999,"5min":0.89600000000000002,"15min":0.86599999999999999},"min":{"1min":0.56599999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.91200000000000003}]},{"osd":10,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.80400000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1639999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.877,"15min":0.872},"min":{"1min":0.74399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.016,"5min":1.202,"15min":1.202},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:57.709 INFO:tasks.fwd_scrub.ceph_manager:clean! 2023-07-21T22:18:57.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-07-21T22:18:57.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.892+0000 7fe5883ff700 1 -- 172.21.15.151:0/2503405561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580101680 msgr2=0x7fe580107f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.892+0000 7fe5883ff700 1 --2- 172.21.15.151:0/2503405561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580101680 0x7fe580107f40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fe57800b0a0 tx=0x7fe57800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.892+0000 7fe5883ff700 1 -- 172.21.15.151:0/2503405561 shutdown_connections 2023-07-21T22:18:57.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.892+0000 7fe5883ff700 1 --2- 172.21.15.151:0/2503405561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5800ffb00 0x7fe5800fff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.892+0000 7fe5883ff700 1 --2- 172.21.15.151:0/2503405561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580101680 0x7fe580107f40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.892+0000 7fe5883ff700 1 --2- 172.21.15.151:0/2503405561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe580100cf0 0x7fe580101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.892+0000 7fe5883ff700 1 -- 172.21.15.151:0/2503405561 >> 172.21.15.151:0/2503405561 conn(0x7fe5800fb0e0 msgr2=0x7fe5800fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.892+0000 7fe5883ff700 1 -- 172.21.15.151:0/2503405561 shutdown_connections 2023-07-21T22:18:57.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.892+0000 7fe5883ff700 1 -- 172.21.15.151:0/2503405561 wait complete. 2023-07-21T22:18:57.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.894+0000 7fe5883ff700 1 Processor -- start 2023-07-21T22:18:57.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.894+0000 7fe5883ff700 1 -- start start 2023-07-21T22:18:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.894+0000 7fe5883ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5800ffb00 0x7fe580195820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.894+0000 7fe5883ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580100cf0 0x7fe580195d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.894+0000 7fe5883ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe580101680 0x7fe58019cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe5883ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58019d3a0 con 0x7fe580100cf0 2023-07-21T22:18:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe5883ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58019d4e0 con 0x7fe580101680 2023-07-21T22:18:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe5883ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58019d670 con 0x7fe5800ffb00 2023-07-21T22:18:57.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580100cf0 0x7fe580195d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580100cf0 0x7fe580195d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52184/0 (socket says 172.21.15.151:52184) 2023-07-21T22:18:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58599a700 1 -- 172.21.15.151:0/1988072496 learned_addr learned my addr 172.21.15.151:0/1988072496 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58619b700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5800ffb00 0x7fe580195820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58699c700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe580101680 0x7fe58019cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58599a700 1 -- 172.21.15.151:0/1988072496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5800ffb00 msgr2=0x7fe580195820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58599a700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5800ffb00 0x7fe580195820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.941 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58599a700 1 -- 172.21.15.151:0/1988072496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe580101680 msgr2=0x7fe58019cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:57.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58599a700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe580101680 0x7fe58019cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:57.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58599a700 1 -- 172.21.15.151:0/1988072496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe578009d00 con 0x7fe580100cf0 2023-07-21T22:18:57.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58699c700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe580101680 0x7fe58019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:18:57.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.895+0000 7fe58599a700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580100cf0 0x7fe580195d60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe57000e9a0 tx=0x7fe57000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.896+0000 7fe5777fe700 1 -- 172.21.15.151:0/1988072496 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570009790 con 0x7fe580100cf0 2023-07-21T22:18:57.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.896+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58019d950 con 0x7fe580100cf0 2023-07-21T22:18:57.943 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.896+0000 7fe5777fe700 1 -- 172.21.15.151:0/1988072496 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe57000cbd0 con 0x7fe580100cf0 2023-07-21T22:18:57.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.896+0000 7fe5777fe700 1 -- 172.21.15.151:0/1988072496 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe570018680 con 0x7fe580100cf0 2023-07-21T22:18:57.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.896+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58019de60 con 0x7fe580100cf0 2023-07-21T22:18:57.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.897+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe580107050 con 0x7fe580100cf0 2023-07-21T22:18:57.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.899+0000 7fe5777fe700 1 -- 172.21.15.151:0/1988072496 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fe57000cd40 con 0x7fe580100cf0 2023-07-21T22:18:57.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.900+0000 7fe5777fe700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe56c0a11a0 0x7fe56c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:57.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.900+0000 7fe5777fe700 1 -- 172.21.15.151:0/1988072496 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fe570014070 con 0x7fe580100cf0 2023-07-21T22:18:57.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.900+0000 7fe58619b700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe56c0a11a0 0x7fe56c0a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:57.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.901+0000 7fe58619b700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe56c0a11a0 0x7fe56c0a3650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe580100b50 tx=0x7fe57c009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:57.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:57.904+0000 7fe5777fe700 1 -- 172.21.15.151:0/1988072496 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fe570051770 con 0x7fe580100cf0 2023-07-21T22:18:58.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.100+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe580060950 con 0x7fe56c0a11a0 2023-07-21T22:18:58.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.110+0000 7fe5777fe700 1 -- 172.21.15.151:0/1988072496 <== mgr.14152 v2:172.21.15.151:6800/3677157440 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+343281 (secure 0 0 0) 0x7fe580060950 con 0x7fe56c0a11a0 2023-07-21T22:18:58.158 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:58.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.114+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe56c0a11a0 msgr2=0x7fe56c0a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.114+0000 7fe5883ff700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe56c0a11a0 0x7fe56c0a3650 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fe580100b50 tx=0x7fe57c009260 comp rx=0 tx=0).stop 2023-07-21T22:18:58.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.114+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580100cf0 msgr2=0x7fe580195d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.114+0000 7fe5883ff700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580100cf0 0x7fe580195d60 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe57000e9a0 tx=0x7fe57000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.115+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 shutdown_connections 2023-07-21T22:18:58.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.115+0000 7fe5883ff700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fe56c0a11a0 0x7fe56c0a3650 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.115+0000 7fe5883ff700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe580101680 0x7fe58019cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.115+0000 7fe5883ff700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5800ffb00 0x7fe580195820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.115+0000 7fe5883ff700 1 --2- 172.21.15.151:0/1988072496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe580100cf0 0x7fe580195d60 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.115+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 >> 172.21.15.151:0/1988072496 conn(0x7fe5800fb0e0 msgr2=0x7fe580104190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.115+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 shutdown_connections 2023-07-21T22:18:58.161 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.115+0000 7fe5883ff700 1 -- 172.21.15.151:0/1988072496 wait complete. 2023-07-21T22:18:58.162 INFO:teuthology.orchestra.run.smithi151.stderr:dumped all 2023-07-21T22:18:58.178 INFO:teuthology.orchestra.run.smithi151.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2023-07-21T22:18:56.880729+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653183,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":761,"num_read_kb":496,"num_write":345,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":781,"ondisk_log_size":781,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":334976,"kb_used_data":11552,"kb_used_omap":0,"kb_used_meta":323328,"kb_avail":1124606848,"statfs":{"total":1151940427776,"available":1151597412352,"internally_reserved":0,"allocated":11829248,"data_stored":7433924,"data_compressed":108096,"data_compressed_allocated":135168,"data_compressed_original":1769472,"omap_allocated":0,"internal_metadata":331087872},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1449,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":68,"num_read_kb":38,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003003"},"pg_stats":[{"pgid":"3.3f","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892270+0000","last_change":"2023-07-21T22:17:09.850731+0000","last_active":"2023-07-21T22:18:42.892270+0000","last_peered":"2023-07-21T22:18:42.892270+0000","last_clean":"2023-07-21T22:18:42.892270+0000","last_became_active":"2023-07-21T22:17:09.849185+0000","last_became_peered":"2023-07-21T22:17:09.849185+0000","last_unstale":"2023-07-21T22:18:42.892270+0000","last_undegraded":"2023-07-21T22:18:42.892270+0000","last_fullsized":"2023-07-21T22:18:42.892270+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:35.659774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.887603+0000","last_change":"2023-07-21T22:17:09.853210+0000","last_active":"2023-07-21T22:18:42.887603+0000","last_peered":"2023-07-21T22:18:42.887603+0000","last_clean":"2023-07-21T22:18:42.887603+0000","last_became_active":"2023-07-21T22:17:09.852822+0000","last_became_peered":"2023-07-21T22:17:09.852822+0000","last_unstale":"2023-07-21T22:18:42.887603+0000","last_undegraded":"2023-07-21T22:18:42.887603+0000","last_fullsized":"2023-07-21T22:18:42.887603+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:47:20.599740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891804+0000","last_change":"2023-07-21T22:17:09.850123+0000","last_active":"2023-07-21T22:18:42.891804+0000","last_peered":"2023-07-21T22:18:42.891804+0000","last_clean":"2023-07-21T22:18:42.891804+0000","last_became_active":"2023-07-21T22:17:09.849763+0000","last_became_peered":"2023-07-21T22:17:09.849763+0000","last_unstale":"2023-07-21T22:18:42.891804+0000","last_undegraded":"2023-07-21T22:18:42.891804+0000","last_fullsized":"2023-07-21T22:18:42.891804+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:58:56.684648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"87'8","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.882006+0000","last_change":"2023-07-21T22:17:44.306609+0000","last_active":"2023-07-21T22:18:42.882006+0000","last_peered":"2023-07-21T22:18:42.882006+0000","last_clean":"2023-07-21T22:18:42.882006+0000","last_became_active":"2023-07-21T22:17:44.306274+0000","last_became_peered":"2023-07-21T22:17:44.306274+0000","last_unstale":"2023-07-21T22:18:42.882006+0000","last_undegraded":"2023-07-21T22:18:42.882006+0000","last_fullsized":"2023-07-21T22:18:42.882006+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:18:47.720581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3b","version":"87'4","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893357+0000","last_change":"2023-07-21T22:17:09.836811+0000","last_active":"2023-07-21T22:18:42.893357+0000","last_peered":"2023-07-21T22:18:42.893357+0000","last_clean":"2023-07-21T22:18:42.893357+0000","last_became_active":"2023-07-21T22:17:09.836470+0000","last_became_peered":"2023-07-21T22:17:09.836470+0000","last_unstale":"2023-07-21T22:18:42.893357+0000","last_undegraded":"2023-07-21T22:18:42.893357+0000","last_fullsized":"2023-07-21T22:18:42.893357+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:44:19.711901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891053+0000","last_change":"2023-07-21T22:17:09.845801+0000","last_active":"2023-07-21T22:18:42.891053+0000","last_peered":"2023-07-21T22:18:42.891053+0000","last_clean":"2023-07-21T22:18:42.891053+0000","last_became_active":"2023-07-21T22:17:09.844938+0000","last_became_peered":"2023-07-21T22:17:09.844938+0000","last_unstale":"2023-07-21T22:18:42.891053+0000","last_undegraded":"2023-07-21T22:18:42.891053+0000","last_fullsized":"2023-07-21T22:18:42.891053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:48:35.691429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.897535+0000","last_change":"2023-07-21T22:17:09.850392+0000","last_active":"2023-07-21T22:18:42.897535+0000","last_peered":"2023-07-21T22:18:42.897535+0000","last_clean":"2023-07-21T22:18:42.897535+0000","last_became_active":"2023-07-21T22:17:09.850013+0000","last_became_peered":"2023-07-21T22:17:09.850013+0000","last_unstale":"2023-07-21T22:18:42.897535+0000","last_undegraded":"2023-07-21T22:18:42.897535+0000","last_fullsized":"2023-07-21T22:18:42.897535+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:04.984082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.894377+0000","last_change":"2023-07-21T22:17:09.845425+0000","last_active":"2023-07-21T22:18:42.894377+0000","last_peered":"2023-07-21T22:18:42.894377+0000","last_clean":"2023-07-21T22:18:42.894377+0000","last_became_active":"2023-07-21T22:17:09.845090+0000","last_became_peered":"2023-07-21T22:17:09.845090+0000","last_unstale":"2023-07-21T22:18:42.894377+0000","last_undegraded":"2023-07-21T22:18:42.894377+0000","last_fullsized":"2023-07-21T22:18:42.894377+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:28:59.843469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891935+0000","last_change":"2023-07-21T22:17:09.845600+0000","last_active":"2023-07-21T22:18:42.891935+0000","last_peered":"2023-07-21T22:18:42.891935+0000","last_clean":"2023-07-21T22:18:42.891935+0000","last_became_active":"2023-07-21T22:17:09.845260+0000","last_became_peered":"2023-07-21T22:17:09.845260+0000","last_unstale":"2023-07-21T22:18:42.891935+0000","last_undegraded":"2023-07-21T22:18:42.891935+0000","last_fullsized":"2023-07-21T22:18:42.891935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:06:49.477671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"87'16","reported_seq":32,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891133+0000","last_change":"2023-07-21T22:17:09.846172+0000","last_active":"2023-07-21T22:18:42.891133+0000","last_peered":"2023-07-21T22:18:42.891133+0000","last_clean":"2023-07-21T22:18:42.891133+0000","last_became_active":"2023-07-21T22:17:09.845827+0000","last_became_peered":"2023-07-21T22:17:09.845827+0000","last_unstale":"2023-07-21T22:18:42.891133+0000","last_undegraded":"2023-07-21T22:18:42.891133+0000","last_fullsized":"2023-07-21T22:18:42.891133+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:12:38.644866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896178+0000","last_change":"2023-07-21T22:17:09.852728+0000","last_active":"2023-07-21T22:18:42.896178+0000","last_peered":"2023-07-21T22:18:42.896178+0000","last_clean":"2023-07-21T22:18:42.896178+0000","last_became_active":"2023-07-21T22:17:09.852152+0000","last_became_peered":"2023-07-21T22:17:09.852152+0000","last_unstale":"2023-07-21T22:18:42.896178+0000","last_undegraded":"2023-07-21T22:18:42.896178+0000","last_fullsized":"2023-07-21T22:18:42.896178+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:13:10.530218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889841+0000","last_change":"2023-07-21T22:17:09.850565+0000","last_active":"2023-07-21T22:18:42.889841+0000","last_peered":"2023-07-21T22:18:42.889841+0000","last_clean":"2023-07-21T22:18:42.889841+0000","last_became_active":"2023-07-21T22:17:09.850162+0000","last_became_peered":"2023-07-21T22:17:09.850162+0000","last_unstale":"2023-07-21T22:18:42.889841+0000","last_undegraded":"2023-07-21T22:18:42.889841+0000","last_fullsized":"2023-07-21T22:18:42.889841+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:48.591116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893294+0000","last_change":"2023-07-21T22:17:09.836732+0000","last_active":"2023-07-21T22:18:42.893294+0000","last_peered":"2023-07-21T22:18:42.893294+0000","last_clean":"2023-07-21T22:18:42.893294+0000","last_became_active":"2023-07-21T22:17:09.836446+0000","last_became_peered":"2023-07-21T22:17:09.836446+0000","last_unstale":"2023-07-21T22:18:42.893294+0000","last_undegraded":"2023-07-21T22:18:42.893294+0000","last_fullsized":"2023-07-21T22:18:42.893294+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:04:05.998599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889472+0000","last_change":"2023-07-21T22:17:09.852624+0000","last_active":"2023-07-21T22:18:42.889472+0000","last_peered":"2023-07-21T22:18:42.889472+0000","last_clean":"2023-07-21T22:18:42.889472+0000","last_became_active":"2023-07-21T22:17:09.852353+0000","last_became_peered":"2023-07-21T22:17:09.852353+0000","last_unstale":"2023-07-21T22:18:42.889472+0000","last_undegraded":"2023-07-21T22:18:42.889472+0000","last_fullsized":"2023-07-21T22:18:42.889472+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:42.502841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890706+0000","last_change":"2023-07-21T22:17:09.860554+0000","last_active":"2023-07-21T22:18:42.890706+0000","last_peered":"2023-07-21T22:18:42.890706+0000","last_clean":"2023-07-21T22:18:42.890706+0000","last_became_active":"2023-07-21T22:17:09.860119+0000","last_became_peered":"2023-07-21T22:17:09.860119+0000","last_unstale":"2023-07-21T22:18:42.890706+0000","last_undegraded":"2023-07-21T22:18:42.890706+0000","last_fullsized":"2023-07-21T22:18:42.890706+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:13:58.134699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.898261+0000","last_change":"2023-07-21T22:17:09.850522+0000","last_active":"2023-07-21T22:18:42.898261+0000","last_peered":"2023-07-21T22:18:42.898261+0000","last_clean":"2023-07-21T22:18:42.898261+0000","last_became_active":"2023-07-21T22:17:09.850243+0000","last_became_peered":"2023-07-21T22:17:09.850243+0000","last_unstale":"2023-07-21T22:18:42.898261+0000","last_undegraded":"2023-07-21T22:18:42.898261+0000","last_fullsized":"2023-07-21T22:18:42.898261+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:32:10.569656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892471+0000","last_change":"2023-07-21T22:17:09.848552+0000","last_active":"2023-07-21T22:18:42.892471+0000","last_peered":"2023-07-21T22:18:42.892471+0000","last_clean":"2023-07-21T22:18:42.892471+0000","last_became_active":"2023-07-21T22:17:09.848110+0000","last_became_peered":"2023-07-21T22:17:09.848110+0000","last_unstale":"2023-07-21T22:18:42.892471+0000","last_undegraded":"2023-07-21T22:18:42.892471+0000","last_fullsized":"2023-07-21T22:18:42.892471+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:01:12.712668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891829+0000","last_change":"2023-07-21T22:17:09.848899+0000","last_active":"2023-07-21T22:18:42.891829+0000","last_peered":"2023-07-21T22:18:42.891829+0000","last_clean":"2023-07-21T22:18:42.891829+0000","last_became_active":"2023-07-21T22:17:09.848606+0000","last_became_peered":"2023-07-21T22:17:09.848606+0000","last_unstale":"2023-07-21T22:18:42.891829+0000","last_undegraded":"2023-07-21T22:18:42.891829+0000","last_fullsized":"2023-07-21T22:18:42.891829+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:25:51.141831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.887791+0000","last_change":"2023-07-21T22:17:09.838033+0000","last_active":"2023-07-21T22:18:42.887791+0000","last_peered":"2023-07-21T22:18:42.887791+0000","last_clean":"2023-07-21T22:18:42.887791+0000","last_became_active":"2023-07-21T22:17:09.837532+0000","last_became_peered":"2023-07-21T22:17:09.837532+0000","last_unstale":"2023-07-21T22:18:42.887791+0000","last_undegraded":"2023-07-21T22:18:42.887791+0000","last_fullsized":"2023-07-21T22:18:42.887791+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:39:24.281689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"85'9","reported_seq":28,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302370+0000","last_change":"2023-07-21T22:17:08.867849+0000","last_active":"2023-07-21T22:17:44.302370+0000","last_peered":"2023-07-21T22:17:44.302370+0000","last_clean":"2023-07-21T22:17:44.302370+0000","last_became_active":"2023-07-21T22:17:08.866245+0000","last_became_peered":"2023-07-21T22:17:08.866245+0000","last_unstale":"2023-07-21T22:17:44.302370+0000","last_undegraded":"2023-07-21T22:17:44.302370+0000","last_fullsized":"2023-07-21T22:17:44.302370+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:28:37.153114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.886760+0000","last_change":"2023-07-21T22:17:09.841402+0000","last_active":"2023-07-21T22:18:42.886760+0000","last_peered":"2023-07-21T22:18:42.886760+0000","last_clean":"2023-07-21T22:18:42.886760+0000","last_became_active":"2023-07-21T22:17:09.841009+0000","last_became_peered":"2023-07-21T22:17:09.841009+0000","last_unstale":"2023-07-21T22:18:42.886760+0000","last_undegraded":"2023-07-21T22:18:42.886760+0000","last_fullsized":"2023-07-21T22:18:42.886760+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:13:08.232799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304136+0000","last_change":"2023-07-21T22:17:08.864236+0000","last_active":"2023-07-21T22:17:44.304136+0000","last_peered":"2023-07-21T22:17:44.304136+0000","last_clean":"2023-07-21T22:17:44.304136+0000","last_became_active":"2023-07-21T22:17:08.863579+0000","last_became_peered":"2023-07-21T22:17:08.863579+0000","last_unstale":"2023-07-21T22:17:44.304136+0000","last_undegraded":"2023-07-21T22:17:44.304136+0000","last_fullsized":"2023-07-21T22:17:44.304136+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:56:10.453785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889151+0000","last_change":"2023-07-21T22:17:09.852677+0000","last_active":"2023-07-21T22:18:42.889151+0000","last_peered":"2023-07-21T22:18:42.889151+0000","last_clean":"2023-07-21T22:18:42.889151+0000","last_became_active":"2023-07-21T22:17:09.852326+0000","last_became_peered":"2023-07-21T22:17:09.852326+0000","last_unstale":"2023-07-21T22:18:42.889151+0000","last_undegraded":"2023-07-21T22:18:42.889151+0000","last_fullsized":"2023-07-21T22:18:42.889151+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:31:09.817158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304951+0000","last_change":"2023-07-21T22:17:08.867521+0000","last_active":"2023-07-21T22:17:44.304951+0000","last_peered":"2023-07-21T22:17:44.304951+0000","last_clean":"2023-07-21T22:17:44.304951+0000","last_became_active":"2023-07-21T22:17:08.867125+0000","last_became_peered":"2023-07-21T22:17:08.867125+0000","last_unstale":"2023-07-21T22:17:44.304951+0000","last_undegraded":"2023-07-21T22:17:44.304951+0000","last_fullsized":"2023-07-21T22:17:44.304951+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:36:09.254395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893649+0000","last_change":"2023-07-21T22:17:09.846296+0000","last_active":"2023-07-21T22:18:42.893649+0000","last_peered":"2023-07-21T22:18:42.893649+0000","last_clean":"2023-07-21T22:18:42.893649+0000","last_became_active":"2023-07-21T22:17:09.845947+0000","last_became_peered":"2023-07-21T22:17:09.845947+0000","last_unstale":"2023-07-21T22:18:42.893649+0000","last_undegraded":"2023-07-21T22:18:42.893649+0000","last_fullsized":"2023-07-21T22:18:42.893649+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:34:46.553617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305483+0000","last_change":"2023-07-21T22:17:08.866709+0000","last_active":"2023-07-21T22:17:44.305483+0000","last_peered":"2023-07-21T22:17:44.305483+0000","last_clean":"2023-07-21T22:17:44.305483+0000","last_became_active":"2023-07-21T22:17:08.866277+0000","last_became_peered":"2023-07-21T22:17:08.866277+0000","last_unstale":"2023-07-21T22:17:44.305483+0000","last_undegraded":"2023-07-21T22:17:44.305483+0000","last_fullsized":"2023-07-21T22:17:44.305483+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:25:13.480396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"87'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893496+0000","last_change":"2023-07-21T22:17:09.855068+0000","last_active":"2023-07-21T22:18:42.893496+0000","last_peered":"2023-07-21T22:18:42.893496+0000","last_clean":"2023-07-21T22:18:42.893496+0000","last_became_active":"2023-07-21T22:17:09.854697+0000","last_became_peered":"2023-07-21T22:17:09.854697+0000","last_unstale":"2023-07-21T22:18:42.893496+0000","last_undegraded":"2023-07-21T22:18:42.893496+0000","last_fullsized":"2023-07-21T22:18:42.893496+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:25:46.560534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"87'6","reported_seq":127,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:53.377977+0000","last_change":"2023-07-21T22:17:08.864292+0000","last_active":"2023-07-21T22:18:53.377977+0000","last_peered":"2023-07-21T22:18:53.377977+0000","last_clean":"2023-07-21T22:18:53.377977+0000","last_became_active":"2023-07-21T22:17:08.863243+0000","last_became_peered":"2023-07-21T22:17:08.863243+0000","last_unstale":"2023-07-21T22:18:53.377977+0000","last_undegraded":"2023-07-21T22:18:53.377977+0000","last_fullsized":"2023-07-21T22:18:53.377977+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:46:18.247508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1057,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":103,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.876771+0000","last_change":"2023-07-21T22:17:09.840756+0000","last_active":"2023-07-21T22:18:42.876771+0000","last_peered":"2023-07-21T22:18:42.876771+0000","last_clean":"2023-07-21T22:18:42.876771+0000","last_became_active":"2023-07-21T22:17:09.840421+0000","last_became_peered":"2023-07-21T22:17:09.840421+0000","last_unstale":"2023-07-21T22:18:42.876771+0000","last_undegraded":"2023-07-21T22:18:42.876771+0000","last_fullsized":"2023-07-21T22:18:42.876771+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:56:30.874703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"85'3","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.491774+0000","last_change":"2023-07-21T22:17:44.491774+0000","last_active":"2023-07-21T22:17:44.491774+0000","last_peered":"2023-07-21T22:17:44.491774+0000","last_clean":"2023-07-21T22:17:44.491774+0000","last_became_active":"2023-07-21T22:17:44.488479+0000","last_became_peered":"2023-07-21T22:17:44.488479+0000","last_unstale":"2023-07-21T22:17:44.491774+0000","last_undegraded":"2023-07-21T22:17:44.491774+0000","last_fullsized":"2023-07-21T22:17:44.491774+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:37:54.678291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,6],"acting":[10,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889331+0000","last_change":"2023-07-21T22:17:09.839359+0000","last_active":"2023-07-21T22:18:42.889331+0000","last_peered":"2023-07-21T22:18:42.889331+0000","last_clean":"2023-07-21T22:18:42.889331+0000","last_became_active":"2023-07-21T22:17:09.839026+0000","last_became_peered":"2023-07-21T22:17:09.839026+0000","last_unstale":"2023-07-21T22:18:42.889331+0000","last_undegraded":"2023-07-21T22:18:42.889331+0000","last_fullsized":"2023-07-21T22:18:42.889331+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:27:39.641691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299788+0000","last_change":"2023-07-21T22:17:08.861680+0000","last_active":"2023-07-21T22:17:44.299788+0000","last_peered":"2023-07-21T22:17:44.299788+0000","last_clean":"2023-07-21T22:17:44.299788+0000","last_became_active":"2023-07-21T22:17:08.861348+0000","last_became_peered":"2023-07-21T22:17:08.861348+0000","last_unstale":"2023-07-21T22:17:44.299788+0000","last_undegraded":"2023-07-21T22:17:44.299788+0000","last_fullsized":"2023-07-21T22:17:44.299788+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:44:54.809555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.889908+0000","last_change":"2023-07-21T22:17:09.840166+0000","last_active":"2023-07-21T22:18:42.889908+0000","last_peered":"2023-07-21T22:18:42.889908+0000","last_clean":"2023-07-21T22:18:42.889908+0000","last_became_active":"2023-07-21T22:17:09.839850+0000","last_became_peered":"2023-07-21T22:17:09.839850+0000","last_unstale":"2023-07-21T22:18:42.889908+0000","last_undegraded":"2023-07-21T22:18:42.889908+0000","last_fullsized":"2023-07-21T22:18:42.889908+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:07:43.813137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.485915+0000","last_change":"2023-07-21T22:17:08.864838+0000","last_active":"2023-07-21T22:17:44.485915+0000","last_peered":"2023-07-21T22:17:44.485915+0000","last_clean":"2023-07-21T22:17:44.485915+0000","last_became_active":"2023-07-21T22:17:08.864484+0000","last_became_peered":"2023-07-21T22:17:08.864484+0000","last_unstale":"2023-07-21T22:17:44.485915+0000","last_undegraded":"2023-07-21T22:17:44.485915+0000","last_fullsized":"2023-07-21T22:17:44.485915+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:55:33.300808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891104+0000","last_change":"2023-07-21T22:17:09.836214+0000","last_active":"2023-07-21T22:18:42.891104+0000","last_peered":"2023-07-21T22:18:42.891104+0000","last_clean":"2023-07-21T22:18:42.891104+0000","last_became_active":"2023-07-21T22:17:09.835877+0000","last_became_peered":"2023-07-21T22:17:09.835877+0000","last_unstale":"2023-07-21T22:18:42.891104+0000","last_undegraded":"2023-07-21T22:18:42.891104+0000","last_fullsized":"2023-07-21T22:18:42.891104+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:24:50.733216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"87'4","reported_seq":120,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:51.372317+0000","last_change":"2023-07-21T22:17:08.861801+0000","last_active":"2023-07-21T22:18:51.372317+0000","last_peered":"2023-07-21T22:18:51.372317+0000","last_clean":"2023-07-21T22:18:51.372317+0000","last_became_active":"2023-07-21T22:17:08.861391+0000","last_became_peered":"2023-07-21T22:17:08.861391+0000","last_unstale":"2023-07-21T22:18:51.372317+0000","last_undegraded":"2023-07-21T22:18:51.372317+0000","last_fullsized":"2023-07-21T22:18:51.372317+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:27:55.305051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":98,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892935+0000","last_change":"2023-07-21T22:17:09.842155+0000","last_active":"2023-07-21T22:18:42.892935+0000","last_peered":"2023-07-21T22:18:42.892935+0000","last_clean":"2023-07-21T22:18:42.892935+0000","last_became_active":"2023-07-21T22:17:09.841845+0000","last_became_peered":"2023-07-21T22:17:09.841845+0000","last_unstale":"2023-07-21T22:18:42.892935+0000","last_undegraded":"2023-07-21T22:18:42.892935+0000","last_fullsized":"2023-07-21T22:18:42.892935+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:55:10.209278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304566+0000","last_change":"2023-07-21T22:17:08.858727+0000","last_active":"2023-07-21T22:17:44.304566+0000","last_peered":"2023-07-21T22:17:44.304566+0000","last_clean":"2023-07-21T22:17:44.304566+0000","last_became_active":"2023-07-21T22:17:08.858376+0000","last_became_peered":"2023-07-21T22:17:08.858376+0000","last_unstale":"2023-07-21T22:17:44.304566+0000","last_undegraded":"2023-07-21T22:17:44.304566+0000","last_fullsized":"2023-07-21T22:17:44.304566+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:58:35.053954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.882407+0000","last_change":"2023-07-21T22:17:09.857300+0000","last_active":"2023-07-21T22:18:42.882407+0000","last_peered":"2023-07-21T22:18:42.882407+0000","last_clean":"2023-07-21T22:18:42.882407+0000","last_became_active":"2023-07-21T22:17:09.856932+0000","last_became_peered":"2023-07-21T22:17:09.856932+0000","last_unstale":"2023-07-21T22:18:42.882407+0000","last_undegraded":"2023-07-21T22:18:42.882407+0000","last_fullsized":"2023-07-21T22:18:42.882407+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:24:28.202771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"85'4","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486481+0000","last_change":"2023-07-21T22:17:08.865488+0000","last_active":"2023-07-21T22:17:44.486481+0000","last_peered":"2023-07-21T22:17:44.486481+0000","last_clean":"2023-07-21T22:17:44.486481+0000","last_became_active":"2023-07-21T22:17:08.865050+0000","last_became_peered":"2023-07-21T22:17:08.865050+0000","last_unstale":"2023-07-21T22:17:44.486481+0000","last_undegraded":"2023-07-21T22:17:44.486481+0000","last_fullsized":"2023-07-21T22:17:44.486481+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:12:41.386381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.894208+0000","last_change":"2023-07-21T22:17:09.849880+0000","last_active":"2023-07-21T22:18:42.894208+0000","last_peered":"2023-07-21T22:18:42.894208+0000","last_clean":"2023-07-21T22:18:42.894208+0000","last_became_active":"2023-07-21T22:17:09.849552+0000","last_became_peered":"2023-07-21T22:17:09.849552+0000","last_unstale":"2023-07-21T22:18:42.894208+0000","last_undegraded":"2023-07-21T22:18:42.894208+0000","last_fullsized":"2023-07-21T22:18:42.894208+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:18:57.861104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"87'31","reported_seq":255,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:52.386870+0000","last_change":"2023-07-21T22:17:08.861663+0000","last_active":"2023-07-21T22:18:52.386870+0000","last_peered":"2023-07-21T22:18:52.386870+0000","last_clean":"2023-07-21T22:18:52.386870+0000","last_became_active":"2023-07-21T22:17:08.861339+0000","last_became_peered":"2023-07-21T22:17:08.861339+0000","last_unstale":"2023-07-21T22:18:52.386870+0000","last_undegraded":"2023-07-21T22:18:52.386870+0000","last_fullsized":"2023-07-21T22:18:52.386870+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:23:16.097183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57558,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":206,"num_read_kb":158,"num_write":32,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.898347+0000","last_change":"2023-07-21T22:17:09.841543+0000","last_active":"2023-07-21T22:18:42.898347+0000","last_peered":"2023-07-21T22:18:42.898347+0000","last_clean":"2023-07-21T22:18:42.898347+0000","last_became_active":"2023-07-21T22:17:09.841235+0000","last_became_peered":"2023-07-21T22:17:09.841235+0000","last_unstale":"2023-07-21T22:18:42.898347+0000","last_undegraded":"2023-07-21T22:18:42.898347+0000","last_fullsized":"2023-07-21T22:18:42.898347+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:37:58.825011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"85'6","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303802+0000","last_change":"2023-07-21T22:17:08.855145+0000","last_active":"2023-07-21T22:17:44.303802+0000","last_peered":"2023-07-21T22:17:44.303802+0000","last_clean":"2023-07-21T22:17:44.303802+0000","last_became_active":"2023-07-21T22:17:08.853279+0000","last_became_peered":"2023-07-21T22:17:08.853279+0000","last_unstale":"2023-07-21T22:17:44.303802+0000","last_undegraded":"2023-07-21T22:17:44.303802+0000","last_fullsized":"2023-07-21T22:17:44.303802+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:38:10.333188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896271+0000","last_change":"2023-07-21T22:17:09.835656+0000","last_active":"2023-07-21T22:18:42.896271+0000","last_peered":"2023-07-21T22:18:42.896271+0000","last_clean":"2023-07-21T22:18:42.896271+0000","last_became_active":"2023-07-21T22:17:09.835309+0000","last_became_peered":"2023-07-21T22:17:09.835309+0000","last_unstale":"2023-07-21T22:18:42.896271+0000","last_undegraded":"2023-07-21T22:18:42.896271+0000","last_fullsized":"2023-07-21T22:18:42.896271+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:05:59.843982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486159+0000","last_change":"2023-07-21T22:17:08.864811+0000","last_active":"2023-07-21T22:17:44.486159+0000","last_peered":"2023-07-21T22:17:44.486159+0000","last_clean":"2023-07-21T22:17:44.486159+0000","last_became_active":"2023-07-21T22:17:08.864428+0000","last_became_peered":"2023-07-21T22:17:08.864428+0000","last_unstale":"2023-07-21T22:17:44.486159+0000","last_undegraded":"2023-07-21T22:17:44.486159+0000","last_fullsized":"2023-07-21T22:17:44.486159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:50:09.637705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"87'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.899354+0000","last_change":"2023-07-21T22:17:09.837713+0000","last_active":"2023-07-21T22:18:42.899354+0000","last_peered":"2023-07-21T22:18:42.899354+0000","last_clean":"2023-07-21T22:18:42.899354+0000","last_became_active":"2023-07-21T22:17:09.837420+0000","last_became_peered":"2023-07-21T22:17:09.837420+0000","last_unstale":"2023-07-21T22:18:42.899354+0000","last_undegraded":"2023-07-21T22:18:42.899354+0000","last_fullsized":"2023-07-21T22:18:42.899354+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:36:00.392623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'6","reported_seq":129,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:53.406532+0000","last_change":"2023-07-21T22:17:08.854376+0000","last_active":"2023-07-21T22:18:53.406532+0000","last_peered":"2023-07-21T22:18:53.406532+0000","last_clean":"2023-07-21T22:18:53.406532+0000","last_became_active":"2023-07-21T22:17:08.854031+0000","last_became_peered":"2023-07-21T22:17:08.854031+0000","last_unstale":"2023-07-21T22:18:53.406532+0000","last_undegraded":"2023-07-21T22:18:53.406532+0000","last_fullsized":"2023-07-21T22:18:53.406532+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:55:12.749236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1554,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.897798+0000","last_change":"2023-07-21T22:17:09.851279+0000","last_active":"2023-07-21T22:18:42.897798+0000","last_peered":"2023-07-21T22:18:42.897798+0000","last_clean":"2023-07-21T22:18:42.897798+0000","last_became_active":"2023-07-21T22:17:09.850948+0000","last_became_peered":"2023-07-21T22:17:09.850948+0000","last_unstale":"2023-07-21T22:18:42.897798+0000","last_undegraded":"2023-07-21T22:18:42.897798+0000","last_fullsized":"2023-07-21T22:18:42.897798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:10:00.991437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"85'15","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305069+0000","last_change":"2023-07-21T22:17:08.865425+0000","last_active":"2023-07-21T22:17:44.305069+0000","last_peered":"2023-07-21T22:17:44.305069+0000","last_clean":"2023-07-21T22:17:44.305069+0000","last_became_active":"2023-07-21T22:17:08.865067+0000","last_became_peered":"2023-07-21T22:17:08.865067+0000","last_unstale":"2023-07-21T22:17:44.305069+0000","last_undegraded":"2023-07-21T22:17:44.305069+0000","last_fullsized":"2023-07-21T22:17:44.305069+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:55:55.543750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.872751+0000","last_change":"2023-07-21T22:17:09.844916+0000","last_active":"2023-07-21T22:18:42.872751+0000","last_peered":"2023-07-21T22:18:42.872751+0000","last_clean":"2023-07-21T22:18:42.872751+0000","last_became_active":"2023-07-21T22:17:09.844632+0000","last_became_peered":"2023-07-21T22:17:09.844632+0000","last_unstale":"2023-07-21T22:18:42.872751+0000","last_undegraded":"2023-07-21T22:18:42.872751+0000","last_fullsized":"2023-07-21T22:18:42.872751+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:32:46.857855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"85'2","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305478+0000","last_change":"2023-07-21T22:17:08.862954+0000","last_active":"2023-07-21T22:17:44.305478+0000","last_peered":"2023-07-21T22:17:44.305478+0000","last_clean":"2023-07-21T22:17:44.305478+0000","last_became_active":"2023-07-21T22:17:08.862598+0000","last_became_peered":"2023-07-21T22:17:08.862598+0000","last_unstale":"2023-07-21T22:17:44.305478+0000","last_undegraded":"2023-07-21T22:17:44.305478+0000","last_fullsized":"2023-07-21T22:17:44.305478+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:16:02.185550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"87'5","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891062+0000","last_change":"2023-07-21T22:17:44.488032+0000","last_active":"2023-07-21T22:18:42.891062+0000","last_peered":"2023-07-21T22:18:42.891062+0000","last_clean":"2023-07-21T22:18:42.891062+0000","last_became_active":"2023-07-21T22:17:44.487524+0000","last_became_peered":"2023-07-21T22:17:44.487524+0000","last_unstale":"2023-07-21T22:18:42.891062+0000","last_undegraded":"2023-07-21T22:18:42.891062+0000","last_fullsized":"2023-07-21T22:18:42.891062+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:29:01.489283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,4],"acting":[11,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.302366+0000","last_change":"2023-07-21T22:17:08.862514+0000","last_active":"2023-07-21T22:17:44.302366+0000","last_peered":"2023-07-21T22:17:44.302366+0000","last_clean":"2023-07-21T22:17:44.302366+0000","last_became_active":"2023-07-21T22:17:08.862223+0000","last_became_peered":"2023-07-21T22:17:08.862223+0000","last_unstale":"2023-07-21T22:17:44.302366+0000","last_undegraded":"2023-07-21T22:17:44.302366+0000","last_fullsized":"2023-07-21T22:17:44.302366+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:37:34.099818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893033+0000","last_change":"2023-07-21T22:17:09.852621+0000","last_active":"2023-07-21T22:18:42.893033+0000","last_peered":"2023-07-21T22:18:42.893033+0000","last_clean":"2023-07-21T22:18:42.893033+0000","last_became_active":"2023-07-21T22:17:09.852233+0000","last_became_peered":"2023-07-21T22:17:09.852233+0000","last_unstale":"2023-07-21T22:18:42.893033+0000","last_undegraded":"2023-07-21T22:18:42.893033+0000","last_fullsized":"2023-07-21T22:18:42.893033+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:17.187991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'1","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304312+0000","last_change":"2023-07-21T22:17:08.861344+0000","last_active":"2023-07-21T22:17:44.304312+0000","last_peered":"2023-07-21T22:17:44.304312+0000","last_clean":"2023-07-21T22:17:44.304312+0000","last_became_active":"2023-07-21T22:17:08.860978+0000","last_became_peered":"2023-07-21T22:17:08.860978+0000","last_unstale":"2023-07-21T22:17:44.304312+0000","last_undegraded":"2023-07-21T22:17:44.304312+0000","last_fullsized":"2023-07-21T22:17:44.304312+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:03:21.901465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890480+0000","last_change":"2023-07-21T22:17:09.852314+0000","last_active":"2023-07-21T22:18:42.890480+0000","last_peered":"2023-07-21T22:18:42.890480+0000","last_clean":"2023-07-21T22:18:42.890480+0000","last_became_active":"2023-07-21T22:17:09.852137+0000","last_became_peered":"2023-07-21T22:17:09.852137+0000","last_unstale":"2023-07-21T22:18:42.890480+0000","last_undegraded":"2023-07-21T22:18:42.890480+0000","last_fullsized":"2023-07-21T22:18:42.890480+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:36:02.728732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890529+0000","last_change":"2023-07-21T22:17:09.839387+0000","last_active":"2023-07-21T22:18:42.890529+0000","last_peered":"2023-07-21T22:18:42.890529+0000","last_clean":"2023-07-21T22:18:42.890529+0000","last_became_active":"2023-07-21T22:17:09.839052+0000","last_became_peered":"2023-07-21T22:17:09.839052+0000","last_unstale":"2023-07-21T22:18:42.890529+0000","last_undegraded":"2023-07-21T22:18:42.890529+0000","last_fullsized":"2023-07-21T22:18:42.890529+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T00:48:00.416159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'5","reported_seq":124,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:54.407678+0000","last_change":"2023-07-21T22:17:08.859465+0000","last_active":"2023-07-21T22:18:54.407678+0000","last_peered":"2023-07-21T22:18:54.407678+0000","last_clean":"2023-07-21T22:18:54.407678+0000","last_became_active":"2023-07-21T22:17:08.859076+0000","last_became_peered":"2023-07-21T22:17:08.859076+0000","last_unstale":"2023-07-21T22:18:54.407678+0000","last_undegraded":"2023-07-21T22:18:54.407678+0000","last_fullsized":"2023-07-21T22:18:54.407678+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:47:23.451233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.890420+0000","last_change":"2023-07-21T22:17:09.846937+0000","last_active":"2023-07-21T22:18:42.890420+0000","last_peered":"2023-07-21T22:18:42.890420+0000","last_clean":"2023-07-21T22:18:42.890420+0000","last_became_active":"2023-07-21T22:17:09.846638+0000","last_became_peered":"2023-07-21T22:17:09.846638+0000","last_unstale":"2023-07-21T22:18:42.890420+0000","last_undegraded":"2023-07-21T22:18:42.890420+0000","last_fullsized":"2023-07-21T22:18:42.890420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:41:17.574718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"85'3","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487106+0000","last_change":"2023-07-21T22:17:08.860388+0000","last_active":"2023-07-21T22:17:44.487106+0000","last_peered":"2023-07-21T22:17:44.487106+0000","last_clean":"2023-07-21T22:17:44.487106+0000","last_became_active":"2023-07-21T22:17:08.860039+0000","last_became_peered":"2023-07-21T22:17:08.860039+0000","last_unstale":"2023-07-21T22:17:44.487106+0000","last_undegraded":"2023-07-21T22:17:44.487106+0000","last_fullsized":"2023-07-21T22:17:44.487106+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:11:34.981385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":350,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304177+0000","last_change":"2023-07-21T22:15:51.342448+0000","last_active":"2023-07-21T22:17:44.304177+0000","last_peered":"2023-07-21T22:17:44.304177+0000","last_clean":"2023-07-21T22:17:44.304177+0000","last_became_active":"2023-07-21T22:15:51.342004+0000","last_became_peered":"2023-07-21T22:15:51.342004+0000","last_unstale":"2023-07-21T22:17:44.304177+0000","last_undegraded":"2023-07-21T22:17:44.304177+0000","last_fullsized":"2023-07-21T22:17:44.304177+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:12:15.345227+0000","last_clean_scrub_stamp":"2023-07-21T22:12:15.345227+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:59:29.784967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.879253+0000","last_change":"2023-07-21T22:17:09.838402+0000","last_active":"2023-07-21T22:18:42.879253+0000","last_peered":"2023-07-21T22:18:42.879253+0000","last_clean":"2023-07-21T22:18:42.879253+0000","last_became_active":"2023-07-21T22:17:09.838096+0000","last_became_peered":"2023-07-21T22:17:09.838096+0000","last_unstale":"2023-07-21T22:18:42.879253+0000","last_undegraded":"2023-07-21T22:18:42.879253+0000","last_fullsized":"2023-07-21T22:18:42.879253+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:07:37.376969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304274+0000","last_change":"2023-07-21T22:17:08.865676+0000","last_active":"2023-07-21T22:17:44.304274+0000","last_peered":"2023-07-21T22:17:44.304274+0000","last_clean":"2023-07-21T22:17:44.304274+0000","last_became_active":"2023-07-21T22:17:08.865370+0000","last_became_peered":"2023-07-21T22:17:08.865370+0000","last_unstale":"2023-07-21T22:17:44.304274+0000","last_undegraded":"2023-07-21T22:17:44.304274+0000","last_fullsized":"2023-07-21T22:17:44.304274+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:53:36.039312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"85'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304666+0000","last_change":"2023-07-21T22:17:08.864487+0000","last_active":"2023-07-21T22:17:44.304666+0000","last_peered":"2023-07-21T22:17:44.304666+0000","last_clean":"2023-07-21T22:17:44.304666+0000","last_became_active":"2023-07-21T22:17:08.863943+0000","last_became_peered":"2023-07-21T22:17:08.863943+0000","last_unstale":"2023-07-21T22:17:44.304666+0000","last_undegraded":"2023-07-21T22:17:44.304666+0000","last_fullsized":"2023-07-21T22:17:44.304666+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:20:00.454414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.879926+0000","last_change":"2023-07-21T22:17:09.833812+0000","last_active":"2023-07-21T22:18:42.879926+0000","last_peered":"2023-07-21T22:18:42.879926+0000","last_clean":"2023-07-21T22:18:42.879926+0000","last_became_active":"2023-07-21T22:17:09.833496+0000","last_became_peered":"2023-07-21T22:17:09.833496+0000","last_unstale":"2023-07-21T22:18:42.879926+0000","last_undegraded":"2023-07-21T22:18:42.879926+0000","last_fullsized":"2023-07-21T22:18:42.879926+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:26:32.258278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"87'7","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:43.620533+0000","last_change":"2023-07-21T22:17:08.867858+0000","last_active":"2023-07-21T22:18:43.620533+0000","last_peered":"2023-07-21T22:18:43.620533+0000","last_clean":"2023-07-21T22:18:43.620533+0000","last_became_active":"2023-07-21T22:17:08.867468+0000","last_became_peered":"2023-07-21T22:17:08.867468+0000","last_unstale":"2023-07-21T22:18:43.620533+0000","last_undegraded":"2023-07-21T22:18:43.620533+0000","last_fullsized":"2023-07-21T22:18:43.620533+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:11:52.154872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896036+0000","last_change":"2023-07-21T22:17:09.846988+0000","last_active":"2023-07-21T22:18:42.896036+0000","last_peered":"2023-07-21T22:18:42.896036+0000","last_clean":"2023-07-21T22:18:42.896036+0000","last_became_active":"2023-07-21T22:17:09.846686+0000","last_became_peered":"2023-07-21T22:17:09.846686+0000","last_unstale":"2023-07-21T22:18:42.896036+0000","last_undegraded":"2023-07-21T22:18:42.896036+0000","last_fullsized":"2023-07-21T22:18:42.896036+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T03:27:48.205318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"85'4","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.487213+0000","last_change":"2023-07-21T22:17:08.857694+0000","last_active":"2023-07-21T22:17:44.487213+0000","last_peered":"2023-07-21T22:17:44.487213+0000","last_clean":"2023-07-21T22:17:44.487213+0000","last_became_active":"2023-07-21T22:17:08.857356+0000","last_became_peered":"2023-07-21T22:17:08.857356+0000","last_unstale":"2023-07-21T22:17:44.487213+0000","last_undegraded":"2023-07-21T22:17:44.487213+0000","last_fullsized":"2023-07-21T22:17:44.487213+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:39:39.361769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893786+0000","last_change":"2023-07-21T22:17:09.858500+0000","last_active":"2023-07-21T22:18:42.893786+0000","last_peered":"2023-07-21T22:18:42.893786+0000","last_clean":"2023-07-21T22:18:42.893786+0000","last_became_active":"2023-07-21T22:17:09.858009+0000","last_became_peered":"2023-07-21T22:17:09.858009+0000","last_unstale":"2023-07-21T22:18:42.893786+0000","last_undegraded":"2023-07-21T22:18:42.893786+0000","last_fullsized":"2023-07-21T22:18:42.893786+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:19:05.454111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"85'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.305503+0000","last_change":"2023-07-21T22:17:08.853732+0000","last_active":"2023-07-21T22:17:44.305503+0000","last_peered":"2023-07-21T22:17:44.305503+0000","last_clean":"2023-07-21T22:17:44.305503+0000","last_became_active":"2023-07-21T22:17:08.853397+0000","last_became_peered":"2023-07-21T22:17:08.853397+0000","last_unstale":"2023-07-21T22:17:44.305503+0000","last_undegraded":"2023-07-21T22:17:44.305503+0000","last_fullsized":"2023-07-21T22:17:44.305503+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:21:18.249465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"87'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.869110+0000","last_change":"2023-07-21T22:17:09.840836+0000","last_active":"2023-07-21T22:18:42.869110+0000","last_peered":"2023-07-21T22:18:42.869110+0000","last_clean":"2023-07-21T22:18:42.869110+0000","last_became_active":"2023-07-21T22:17:09.840463+0000","last_became_peered":"2023-07-21T22:17:09.840463+0000","last_unstale":"2023-07-21T22:18:42.869110+0000","last_undegraded":"2023-07-21T22:18:42.869110+0000","last_fullsized":"2023-07-21T22:18:42.869110+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T09:50:24.284857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"85'3","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.303419+0000","last_change":"2023-07-21T22:17:08.865129+0000","last_active":"2023-07-21T22:17:44.303419+0000","last_peered":"2023-07-21T22:17:44.303419+0000","last_clean":"2023-07-21T22:17:44.303419+0000","last_became_active":"2023-07-21T22:17:08.864820+0000","last_became_peered":"2023-07-21T22:17:08.864820+0000","last_unstale":"2023-07-21T22:17:44.303419+0000","last_undegraded":"2023-07-21T22:17:44.303419+0000","last_fullsized":"2023-07-21T22:17:44.303419+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:00:07.661921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.878364+0000","last_change":"2023-07-21T22:17:09.846804+0000","last_active":"2023-07-21T22:18:42.878364+0000","last_peered":"2023-07-21T22:18:42.878364+0000","last_clean":"2023-07-21T22:18:42.878364+0000","last_became_active":"2023-07-21T22:17:09.846390+0000","last_became_peered":"2023-07-21T22:17:09.846390+0000","last_unstale":"2023-07-21T22:18:42.878364+0000","last_undegraded":"2023-07-21T22:18:42.878364+0000","last_fullsized":"2023-07-21T22:18:42.878364+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:42.837431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"85'1","reported_seq":15,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.317619+0000","last_change":"2023-07-21T22:17:44.317155+0000","last_active":"2023-07-21T22:17:44.317619+0000","last_peered":"2023-07-21T22:17:44.317619+0000","last_clean":"2023-07-21T22:17:44.317619+0000","last_became_active":"2023-07-21T22:17:44.307394+0000","last_became_peered":"2023-07-21T22:17:44.307394+0000","last_unstale":"2023-07-21T22:17:44.317619+0000","last_undegraded":"2023-07-21T22:17:44.317619+0000","last_fullsized":"2023-07-21T22:17:44.317619+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:00:59.993004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892585+0000","last_change":"2023-07-21T22:17:09.849197+0000","last_active":"2023-07-21T22:18:42.892585+0000","last_peered":"2023-07-21T22:18:42.892585+0000","last_clean":"2023-07-21T22:18:42.892585+0000","last_became_active":"2023-07-21T22:17:09.848835+0000","last_became_peered":"2023-07-21T22:17:09.848835+0000","last_unstale":"2023-07-21T22:18:42.892585+0000","last_undegraded":"2023-07-21T22:18:42.892585+0000","last_fullsized":"2023-07-21T22:18:42.892585+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T08:04:22.001862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"85'4","reported_seq":19,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.314830+0000","last_change":"2023-07-21T22:17:44.314329+0000","last_active":"2023-07-21T22:17:44.314830+0000","last_peered":"2023-07-21T22:17:44.314830+0000","last_clean":"2023-07-21T22:17:44.314830+0000","last_became_active":"2023-07-21T22:17:44.307075+0000","last_became_peered":"2023-07-21T22:17:44.307075+0000","last_unstale":"2023-07-21T22:17:44.314830+0000","last_undegraded":"2023-07-21T22:17:44.314830+0000","last_fullsized":"2023-07-21T22:17:44.314830+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:14:28.681489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,7],"acting":[11,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.a","version":"87'5","reported_seq":21,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896596+0000","last_change":"2023-07-21T22:17:09.847279+0000","last_active":"2023-07-21T22:18:42.896596+0000","last_peered":"2023-07-21T22:18:42.896596+0000","last_clean":"2023-07-21T22:18:42.896596+0000","last_became_active":"2023-07-21T22:17:09.846982+0000","last_became_peered":"2023-07-21T22:17:09.846982+0000","last_unstale":"2023-07-21T22:18:42.896596+0000","last_undegraded":"2023-07-21T22:18:42.896596+0000","last_fullsized":"2023-07-21T22:18:42.896596+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:22:14.985134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'3","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.304706+0000","last_change":"2023-07-21T22:17:08.857436+0000","last_active":"2023-07-21T22:17:44.304706+0000","last_peered":"2023-07-21T22:17:44.304706+0000","last_clean":"2023-07-21T22:17:44.304706+0000","last_became_active":"2023-07-21T22:17:08.857046+0000","last_became_peered":"2023-07-21T22:17:08.857046+0000","last_unstale":"2023-07-21T22:17:44.304706+0000","last_undegraded":"2023-07-21T22:17:44.304706+0000","last_fullsized":"2023-07-21T22:17:44.304706+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:21:23.427814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896971+0000","last_change":"2023-07-21T22:17:09.852916+0000","last_active":"2023-07-21T22:18:42.896971+0000","last_peered":"2023-07-21T22:18:42.896971+0000","last_clean":"2023-07-21T22:18:42.896971+0000","last_became_active":"2023-07-21T22:17:09.852608+0000","last_became_peered":"2023-07-21T22:17:09.852608+0000","last_unstale":"2023-07-21T22:18:42.896971+0000","last_undegraded":"2023-07-21T22:18:42.896971+0000","last_fullsized":"2023-07-21T22:18:42.896971+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:12:21.187686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'1","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.486196+0000","last_change":"2023-07-21T22:17:08.859619+0000","last_active":"2023-07-21T22:17:44.486196+0000","last_peered":"2023-07-21T22:17:44.486196+0000","last_clean":"2023-07-21T22:17:44.486196+0000","last_became_active":"2023-07-21T22:17:08.859256+0000","last_became_peered":"2023-07-21T22:17:08.859256+0000","last_unstale":"2023-07-21T22:17:44.486196+0000","last_undegraded":"2023-07-21T22:17:44.486196+0000","last_fullsized":"2023-07-21T22:17:44.486196+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:48:49.010457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.898245+0000","last_change":"2023-07-21T22:17:09.850548+0000","last_active":"2023-07-21T22:18:42.898245+0000","last_peered":"2023-07-21T22:18:42.898245+0000","last_clean":"2023-07-21T22:18:42.898245+0000","last_became_active":"2023-07-21T22:17:09.850261+0000","last_became_peered":"2023-07-21T22:17:09.850261+0000","last_unstale":"2023-07-21T22:18:42.898245+0000","last_undegraded":"2023-07-21T22:18:42.898245+0000","last_fullsized":"2023-07-21T22:18:42.898245+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:35:05.546844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":123,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"84'2","reported_seq":20,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:17:44.299865+0000","last_change":"2023-07-21T22:17:08.859729+0000","last_active":"2023-07-21T22:17:44.299865+0000","last_peered":"2023-07-21T22:17:44.299865+0000","last_clean":"2023-07-21T22:17:44.299865+0000","last_became_active":"2023-07-21T22:17:08.859421+0000","last_became_peered":"2023-07-21T22:17:08.859421+0000","last_unstale":"2023-07-21T22:17:44.299865+0000","last_undegraded":"2023-07-21T22:17:44.299865+0000","last_fullsized":"2023-07-21T22:17:44.299865+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":82,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:07.832592+0000","last_clean_scrub_stamp":"2023-07-21T22:17:07.832592+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:14:21.189655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896517+0000","last_change":"2023-07-21T22:17:09.846413+0000","last_active":"2023-07-21T22:18:42.896517+0000","last_peered":"2023-07-21T22:18:42.896517+0000","last_clean":"2023-07-21T22:18:42.896517+0000","last_became_active":"2023-07-21T22:17:09.846038+0000","last_became_peered":"2023-07-21T22:17:09.846038+0000","last_unstale":"2023-07-21T22:18:42.896517+0000","last_undegraded":"2023-07-21T22:18:42.896517+0000","last_fullsized":"2023-07-21T22:18:42.896517+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:34:08.536390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"87'9","reported_seq":25,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.877721+0000","last_change":"2023-07-21T22:17:09.846786+0000","last_active":"2023-07-21T22:18:42.877721+0000","last_peered":"2023-07-21T22:18:42.877721+0000","last_clean":"2023-07-21T22:18:42.877721+0000","last_became_active":"2023-07-21T22:17:09.846437+0000","last_became_peered":"2023-07-21T22:17:09.846437+0000","last_unstale":"2023-07-21T22:18:42.877721+0000","last_undegraded":"2023-07-21T22:18:42.877721+0000","last_fullsized":"2023-07-21T22:18:42.877721+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:38.254130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"87'12","reported_seq":34,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.882594+0000","last_change":"2023-07-21T22:17:44.487796+0000","last_active":"2023-07-21T22:18:42.882594+0000","last_peered":"2023-07-21T22:18:42.882594+0000","last_clean":"2023-07-21T22:18:42.882594+0000","last_became_active":"2023-07-21T22:17:44.487278+0000","last_became_peered":"2023-07-21T22:17:44.487278+0000","last_unstale":"2023-07-21T22:18:42.882594+0000","last_undegraded":"2023-07-21T22:18:42.882594+0000","last_fullsized":"2023-07-21T22:18:42.882594+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:58:36.983831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,8],"acting":[2,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.887103+0000","last_change":"2023-07-21T22:17:09.850137+0000","last_active":"2023-07-21T22:18:42.887103+0000","last_peered":"2023-07-21T22:18:42.887103+0000","last_clean":"2023-07-21T22:18:42.887103+0000","last_became_active":"2023-07-21T22:17:09.849721+0000","last_became_peered":"2023-07-21T22:17:09.849721+0000","last_unstale":"2023-07-21T22:18:42.887103+0000","last_undegraded":"2023-07-21T22:18:42.887103+0000","last_fullsized":"2023-07-21T22:18:42.887103+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T02:32:42.785707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"87'7","reported_seq":23,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.880240+0000","last_change":"2023-07-21T22:17:09.858573+0000","last_active":"2023-07-21T22:18:42.880240+0000","last_peered":"2023-07-21T22:18:42.880240+0000","last_clean":"2023-07-21T22:18:42.880240+0000","last_became_active":"2023-07-21T22:17:09.858017+0000","last_became_peered":"2023-07-21T22:17:09.858017+0000","last_unstale":"2023-07-21T22:18:42.880240+0000","last_undegraded":"2023-07-21T22:18:42.880240+0000","last_fullsized":"2023-07-21T22:18:42.880240+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:04:20.029025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"87'4","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.880436+0000","last_change":"2023-07-21T22:17:44.486812+0000","last_active":"2023-07-21T22:18:42.880436+0000","last_peered":"2023-07-21T22:18:42.880436+0000","last_clean":"2023-07-21T22:18:42.880436+0000","last_became_active":"2023-07-21T22:17:44.486392+0000","last_became_peered":"2023-07-21T22:17:44.486392+0000","last_unstale":"2023-07-21T22:18:42.880436+0000","last_undegraded":"2023-07-21T22:18:42.880436+0000","last_fullsized":"2023-07-21T22:18:42.880436+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:39:12.827232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.883269+0000","last_change":"2023-07-21T22:17:09.845251+0000","last_active":"2023-07-21T22:18:42.883269+0000","last_peered":"2023-07-21T22:18:42.883269+0000","last_clean":"2023-07-21T22:18:42.883269+0000","last_became_active":"2023-07-21T22:17:09.844945+0000","last_became_peered":"2023-07-21T22:17:09.844945+0000","last_unstale":"2023-07-21T22:18:42.883269+0000","last_undegraded":"2023-07-21T22:18:42.883269+0000","last_fullsized":"2023-07-21T22:18:42.883269+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T06:23:50.719284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"87'15","reported_seq":31,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.888580+0000","last_change":"2023-07-21T22:17:09.850953+0000","last_active":"2023-07-21T22:18:42.888580+0000","last_peered":"2023-07-21T22:18:42.888580+0000","last_clean":"2023-07-21T22:18:42.888580+0000","last_became_active":"2023-07-21T22:17:09.850627+0000","last_became_peered":"2023-07-21T22:17:09.850627+0000","last_unstale":"2023-07-21T22:18:42.888580+0000","last_undegraded":"2023-07-21T22:18:42.888580+0000","last_fullsized":"2023-07-21T22:18:42.888580+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T04:01:24.705224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"87'2","reported_seq":18,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.892604+0000","last_change":"2023-07-21T22:17:09.841222+0000","last_active":"2023-07-21T22:18:42.892604+0000","last_peered":"2023-07-21T22:18:42.892604+0000","last_clean":"2023-07-21T22:18:42.892604+0000","last_became_active":"2023-07-21T22:17:09.840864+0000","last_became_peered":"2023-07-21T22:17:09.840864+0000","last_unstale":"2023-07-21T22:18:42.892604+0000","last_undegraded":"2023-07-21T22:18:42.892604+0000","last_fullsized":"2023-07-21T22:18:42.892604+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T07:02:23.181094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"87'6","reported_seq":22,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.885879+0000","last_change":"2023-07-21T22:17:09.837688+0000","last_active":"2023-07-21T22:18:42.885879+0000","last_peered":"2023-07-21T22:18:42.885879+0000","last_clean":"2023-07-21T22:18:42.885879+0000","last_became_active":"2023-07-21T22:17:09.837325+0000","last_became_peered":"2023-07-21T22:17:09.837325+0000","last_unstale":"2023-07-21T22:18:42.885879+0000","last_undegraded":"2023-07-21T22:18:42.885879+0000","last_fullsized":"2023-07-21T22:18:42.885879+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T10:06:00.041198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.893368+0000","last_change":"2023-07-21T22:17:09.843791+0000","last_active":"2023-07-21T22:18:42.893368+0000","last_peered":"2023-07-21T22:18:42.893368+0000","last_clean":"2023-07-21T22:18:42.893368+0000","last_became_active":"2023-07-21T22:17:09.843438+0000","last_became_peered":"2023-07-21T22:17:09.843438+0000","last_unstale":"2023-07-21T22:18:42.893368+0000","last_undegraded":"2023-07-21T22:18:42.893368+0000","last_fullsized":"2023-07-21T22:18:42.893368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T01:10:55.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"87'10","reported_seq":26,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.895426+0000","last_change":"2023-07-21T22:17:09.849062+0000","last_active":"2023-07-21T22:18:42.895426+0000","last_peered":"2023-07-21T22:18:42.895426+0000","last_clean":"2023-07-21T22:18:42.895426+0000","last_became_active":"2023-07-21T22:17:09.848153+0000","last_became_peered":"2023-07-21T22:17:09.848153+0000","last_unstale":"2023-07-21T22:18:42.895426+0000","last_undegraded":"2023-07-21T22:18:42.895426+0000","last_fullsized":"2023-07-21T22:18:42.895426+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-23T05:44:30.677689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"87'11","reported_seq":27,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.896467+0000","last_change":"2023-07-21T22:17:09.849010+0000","last_active":"2023-07-21T22:18:42.896467+0000","last_peered":"2023-07-21T22:18:42.896467+0000","last_clean":"2023-07-21T22:18:42.896467+0000","last_became_active":"2023-07-21T22:17:09.848679+0000","last_became_peered":"2023-07-21T22:17:09.848679+0000","last_unstale":"2023-07-21T22:18:42.896467+0000","last_undegraded":"2023-07-21T22:18:42.896467+0000","last_fullsized":"2023-07-21T22:18:42.896467+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T22:24:40.740692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"87'8","reported_seq":24,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-07-21T22:18:42.891473+0000","last_change":"2023-07-21T22:17:09.846419+0000","last_active":"2023-07-21T22:18:42.891473+0000","last_peered":"2023-07-21T22:18:42.891473+0000","last_clean":"2023-07-21T22:18:42.891473+0000","last_became_active":"2023-07-21T22:17:09.846037+0000","last_became_peered":"2023-07-21T22:17:09.846037+0000","last_unstale":"2023-07-21T22:18:42.891473+0000","last_undegraded":"2023-07-21T22:18:42.891473+0000","last_fullsized":"2023-07-21T22:18:42.891473+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-07-21T22:17:08.834634+0000","last_clean_scrub_stamp":"2023-07-21T22:17:08.834634+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-07-22T23:33:14.382111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":376832,"data_stored":4132576,"data_compressed":248938,"data_compressed_allocated":315392,"data_compressed_original":4096000,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62569,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":625,"num_read_kb":377,"num_write":162,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":196347,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":80,"seq":343597383715,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27872,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717280,"statfs":{"total":95995035648,"available":95966494720,"internally_reserved":0,"allocated":942080,"data_stored":456133,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.40799999999999997,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.71399999999999997,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.60499999999999998,"15min":0.61499999999999999},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74199999999999999,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.55800000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.70799999999999996,"15min":0.70099999999999996},"min":{"1min":0.53100000000000003,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":0.999,"5min":1.085,"15min":1.085},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.71799999999999997,"5min":0.68600000000000005,"15min":0.68100000000000005},"min":{"1min":0.498,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.90300000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.58099999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.53800000000000003,"15min":0.53400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.77900000000000003,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.40999999999999998,"5min":0.373,"15min":0.373},"max":{"1min":0.999,"5min":1.028,"15min":1.028},"last":0.48299999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.72499999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.82999999999999996,"5min":0.78600000000000003,"15min":0.77900000000000003},"min":{"1min":0.60399999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.026,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.73699999999999999,"15min":0.73999999999999999},"min":{"1min":0.50800000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.88600000000000001,"5min":1.202,"15min":1.202},"last":0.60299999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.70799999999999996,"5min":0.65200000000000002,"15min":0.64300000000000002},"min":{"1min":0.54100000000000004,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.97699999999999998,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.81200000000000006,"5min":0.74099999999999999,"15min":0.72899999999999998},"min":{"1min":0.48699999999999999,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95899999999999996,"5min":1.5640000000000001,"15min":1.5640000000000001},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Jul 21 22:17:13 2023","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.84699999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":2.2200000000000002,"5min":2.2200000000000002,"15min":2.2200000000000002},"last":0.628}]},{"osd":7,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.86899999999999999,"5min":0.85699999999999998,"15min":0.85499999999999998},"min":{"1min":0.64600000000000002,"5min":0.58299999999999996,"15min":0.58299999999999996},"max":{"1min":1.024,"5min":1.7350000000000001,"15min":1.7350000000000001},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.82999999999999996,"15min":0.83699999999999997},"min":{"1min":0.59999999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"max":{"1min":0.93500000000000005,"5min":1.6539999999999999,"15min":1.6539999999999999},"last":0.63200000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.85899999999999999,"5min":0.85899999999999999,"15min":0.85899999999999999},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.75,"5min":0.75,"15min":0.75},"min":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.85299999999999998}]},{"osd":9,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84899999999999998,"5min":0.84699999999999998,"15min":0.84699999999999998},"min":{"1min":0.71199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.484,"5min":1.5960000000000001,"15min":1.5960000000000001},"last":0.878},{"interface":"front","average":{"1min":0.93600000000000005,"5min":0.88600000000000001,"15min":0.878},"min":{"1min":0.70199999999999996,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.0760000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":0.88800000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.88,"15min":0.88600000000000001},"min":{"1min":0.63400000000000001,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":0.98199999999999998,"5min":1.4990000000000001,"15min":1.4990000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.89900000000000002,"5min":0.90700000000000003,"15min":0.90800000000000003},"min":{"1min":0.80100000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.056,"5min":2.2810000000000001,"15min":2.2810000000000001},"last":0.90000000000000002}]}]},{"osd":10,"up_from":72,"seq":309237645353,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1089536,"data_stored":1106144,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.748,"15min":0.748},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":3.121,"5min":3.121,"15min":3.121},"last":0.628},{"interface":"front","average":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":3.1360000000000001,"5min":3.1360000000000001,"15min":3.1360000000000001},"last":0.77400000000000002}]},{"osd":1,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.61399999999999999,"15min":0.623},"min":{"1min":0.38100000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.86699999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.82499999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.59099999999999997,"15min":0.60099999999999998},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.88}]},{"osd":2,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.78100000000000003,"5min":0.79000000000000004,"15min":0.80000000000000004},"min":{"1min":0.50600000000000001,"5min":0.441,"15min":0.441},"max":{"1min":1.0629999999999999,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.85099999999999998,"15min":0.878},"min":{"1min":0.56000000000000005,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.998,"5min":1.7869999999999999,"15min":1.7869999999999999},"last":0.97599999999999998}]},{"osd":3,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.85599999999999998,"15min":0.871},"min":{"1min":0.47999999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92800000000000005,"5min":4.3739999999999997,"15min":4.3739999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.80000000000000004,"15min":0.80000000000000004},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.92900000000000005,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":0.59499999999999997}]},{"osd":4,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.75900000000000001,"15min":0.78600000000000003},"min":{"1min":0.47399999999999998,"5min":0.38,"15min":0.38},"max":{"1min":0.878,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.67400000000000004,"15min":0.68300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.032,"5min":1.1120000000000001,"15min":1.1120000000000001},"last":0.49299999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.86299999999999999,"15min":0.871},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.099,"5min":1.224,"15min":1.224},"last":0.92600000000000005},{"interface":"front","average":{"1min":0.86699999999999999,"5min":0.91700000000000004,"15min":0.94999999999999996},"min":{"1min":0.61399999999999999,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.079,"5min":1.9730000000000001,"15min":1.9730000000000001},"last":1.02}]},{"osd":6,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.81699999999999995,"5min":0.98599999999999999,"15min":1.006},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.0629999999999999,"5min":4.6600000000000001,"15min":4.6600000000000001},"last":0.85899999999999999},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.90900000000000003,"15min":0.91300000000000003},"min":{"1min":0.64100000000000001,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.998,"5min":4.4889999999999999,"15min":4.4889999999999999},"last":0.74099999999999999}]},{"osd":7,"last update":"Fri Jul 21 22:16:48 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.91400000000000003,"15min":0.91400000000000003},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.385,"5min":1.385,"15min":1.385},"last":0.53200000000000003},{"interface":"front","average":{"1min":1.0209999999999999,"5min":1.0209999999999999,"15min":1.0209999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.839,"5min":1.839,"15min":1.839},"last":0.63800000000000001}]},{"osd":8,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.94899999999999995,"15min":0.98399999999999999},"min":{"1min":0.68700000000000006,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.034,"5min":1.431,"15min":1.431},"last":0.95499999999999996},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.97199999999999998,"15min":1.008},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":1.1419999999999999,"5min":1.4419999999999999,"15min":1.4419999999999999},"last":0.83499999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.877,"5min":0.98699999999999999,"15min":0.997},"min":{"1min":0.72299999999999998,"5min":0.53900000000000003,"15min":0.53900000000000003},"max":{"1min":1.0680000000000001,"5min":3.3719999999999999,"15min":3.3719999999999999},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.871,"5min":1.0029999999999999,"15min":1.0329999999999999},"min":{"1min":0.58499999999999996,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.125,"5min":3.0670000000000002,"15min":3.0670000000000002},"last":0.76400000000000001}]},{"osd":11,"last update":"Fri Jul 21 22:18:18 2023","interfaces":[{"interface":"back","average":{"1min":0.92000000000000004,"5min":0.93999999999999995,"15min":0.94299999999999995},"min":{"1min":0.72999999999999998,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.1899999999999999,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":1.004},{"interface":"front","average":{"1min":0.94299999999999995,"5min":0.95099999999999996,"15min":0.95199999999999996},"min":{"1min":0.65500000000000003,"5min":0.626,"15min":0.626},"max":{"1min":1.212,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.99399999999999999}]}]},{"osd":9,"up_from":67,"seq":287762808877,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.53200000000000003,"15min":0.56399999999999995},"min":{"1min":0.33000000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.56399999999999995,"15min":0.60499999999999998},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.60599999999999998,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.68300000000000005}]},{"osd":1,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71799999999999997,"5min":0.755,"15min":0.79500000000000004},"min":{"1min":0.441,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.117,"5min":1.117,"15min":1.117},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.80500000000000005,"15min":0.85999999999999999},"min":{"1min":0.53200000000000003,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":0.96899999999999997,"5min":1.393,"15min":1.393},"last":0.81599999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.76500000000000001,"15min":0.78500000000000003},"min":{"1min":0.50900000000000001,"5min":0.443,"15min":0.443},"max":{"1min":1.1459999999999999,"5min":1.1459999999999999,"15min":1.1459999999999999},"last":0.86499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.78700000000000003,"15min":0.82699999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.89700000000000002,"5min":1.335,"15min":1.335},"last":0.89300000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.68799999999999994,"15min":0.755},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.79700000000000004,"5min":1.2609999999999999,"15min":1.2609999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.68100000000000005,"15min":0.72199999999999998},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":1.232,"5min":1.232,"15min":1.232},"last":0.60199999999999998}]},{"osd":4,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.81899999999999995,"15min":0.871},"min":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":0.93300000000000005,"5min":1.464,"15min":1.464},"last":0.751},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":0.89400000000000002},"min":{"1min":0.53600000000000003,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.056,"5min":1.3,"15min":1.3},"last":0.64900000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.84299999999999997,"15min":0.89700000000000002},"min":{"1min":0.505,"5min":0.505,"15min":0.505},"max":{"1min":1.1599999999999999,"5min":1.6339999999999999,"15min":1.6339999999999999},"last":0.879},{"interface":"front","average":{"1min":0.79500000000000004,"5min":0.84499999999999997,"15min":0.877},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.177,"5min":1.177,"15min":1.177},"last":0.78700000000000003}]},{"osd":6,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.78900000000000003,"15min":0.84299999999999997},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.0249999999999999,"5min":1.2010000000000001,"15min":1.2010000000000001},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.86299999999999999,"15min":0.93700000000000006},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.878,"5min":1.431,"15min":1.431},"last":0.85599999999999998}]},{"osd":7,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76000000000000001,"5min":0.91800000000000004,"15min":0.98799999999999999},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.129,"5min":1.696,"15min":1.696},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.93999999999999995,"15min":0.99099999999999999},"min":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.2050000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":0.82599999999999996}]},{"osd":8,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.76600000000000001,"5min":0.94299999999999995,"15min":1.004},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":1.0009999999999999,"5min":1.496,"15min":1.496},"last":0.93500000000000005},{"interface":"front","average":{"1min":0.78600000000000003,"5min":0.94399999999999995,"15min":1.002},"min":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.214,"5min":1.667,"15min":1.667},"last":0.84299999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:18:56 2023","interfaces":[{"interface":"back","average":{"1min":0.79000000000000004,"5min":0.90700000000000003,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.0429999999999999,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.91600000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.91500000000000004,"15min":0.95299999999999996},"min":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":0.95799999999999996,"5min":1.264,"15min":1.264},"last":0.80400000000000005}]}]},{"osd":8,"up_from":59,"seq":253403070515,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27888,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717264,"statfs":{"total":95995035648,"available":95966478336,"internally_reserved":0,"allocated":958464,"data_stored":456289,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.68300000000000005,"15min":0.70099999999999996},"min":{"1min":0.48099999999999998,"5min":0.434,"15min":0.434},"max":{"1min":0.94199999999999995,"5min":0.96599999999999997,"15min":0.96599999999999997},"last":0.623},{"interface":"front","average":{"1min":0.72899999999999998,"5min":0.71399999999999997,"15min":0.72599999999999998},"min":{"1min":0.51400000000000001,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":1.02,"5min":1.02,"15min":1.02},"last":0.60199999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.72299999999999998,"15min":0.73099999999999998},"min":{"1min":0.45100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.97099999999999997,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.88,"5min":0.78700000000000003,"15min":0.78700000000000003},"min":{"1min":0.60399999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":1.083,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.92300000000000004}]},{"osd":2,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.65300000000000002,"15min":0.65900000000000003},"min":{"1min":0.496,"5min":0.373,"15min":0.373},"max":{"1min":0.97799999999999998,"5min":1.056,"15min":1.056},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.66300000000000003},"min":{"1min":0.39800000000000002,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.872,"5min":1.0680000000000001,"15min":1.0680000000000001},"last":0.501}]},{"osd":3,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78300000000000003,"15min":0.80300000000000005},"min":{"1min":0.59499999999999997,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0009999999999999,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.72899999999999998,"15min":0.749},"min":{"1min":0.442,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.64500000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.76800000000000002,"5min":0.78900000000000003,"15min":0.80800000000000005},"min":{"1min":0.55100000000000005,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.0029999999999999,"5min":1.1899999999999999,"15min":1.1899999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.84299999999999997,"15min":0.84899999999999998},"min":{"1min":0.68400000000000005,"5min":0.45300000000000001,"15min":0.45300000000000001},"max":{"1min":1.1719999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.85999999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.76500000000000001,"15min":0.78100000000000003},"min":{"1min":0.51000000000000001,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.0580000000000001,"5min":1.1759999999999999,"15min":1.1759999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.74199999999999999,"15min":0.76900000000000002},"min":{"1min":0.53100000000000003,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.98099999999999998,"5min":1.2230000000000001,"15min":1.2230000000000001},"last":0.73299999999999998}]},{"osd":6,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.93899999999999995,"5min":0.88800000000000001,"15min":0.90600000000000003},"min":{"1min":0.60399999999999998,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.1950000000000001,"5min":1.4139999999999999,"15min":1.4139999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0309999999999999,"5min":0.93799999999999994,"15min":0.94599999999999995},"min":{"1min":0.56899999999999995,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":3.339,"5min":3.339,"15min":3.339},"last":0.75800000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.90000000000000002,"15min":0.91300000000000003},"min":{"1min":0.72999999999999998,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.1879999999999999,"5min":1.3460000000000001,"15min":1.3460000000000001},"last":0.89900000000000002},{"interface":"front","average":{"1min":0.90000000000000002,"5min":0.90800000000000003,"15min":0.92600000000000005},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"max":{"1min":1.155,"5min":1.321,"15min":1.321},"last":0.94299999999999995}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":0.89600000000000002,"15min":0.84799999999999998},"min":{"1min":0.83199999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":2.8050000000000002,"5min":2.8050000000000002,"15min":2.8050000000000002},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.1060000000000001,"5min":0.92600000000000005,"15min":0.89900000000000002},"min":{"1min":0.67400000000000004,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":0.82899999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:17:53 2023","interfaces":[{"interface":"back","average":{"1min":0.99399999999999999,"5min":0.89600000000000002,"15min":0.88},"min":{"1min":0.74299999999999999,"5min":0.622,"15min":0.622},"max":{"1min":1.2190000000000001,"5min":1.254,"15min":1.254},"last":1.085},{"interface":"front","average":{"1min":0.995,"5min":0.90000000000000002,"15min":0.88400000000000001},"min":{"1min":0.755,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.226,"5min":1.2709999999999999,"15min":1.2709999999999999},"last":1.0229999999999999}]},{"osd":11,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.075,"15min":1.075},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":1.038},{"interface":"front","average":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"min":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":1.0600000000000001}]}]},{"osd":7,"up_from":51,"seq":219043332151,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":1003520,"data_stored":1048904,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:28 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.64800000000000002,"15min":0.63800000000000001},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.61599999999999999,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.48099999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.499},"min":{"1min":0.35699999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.441},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.54700000000000004,"15min":0.55100000000000005},"min":{"1min":0.38900000000000001,"5min":0.315,"15min":0.315},"max":{"1min":0.63100000000000001,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.61299999999999999}]},{"osd":2,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.68300000000000005,"15min":0.65600000000000003},"min":{"1min":0.49299999999999999,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.82599999999999996},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.68200000000000005},"min":{"1min":0.49199999999999999,"5min":0.437,"15min":0.437},"max":{"1min":0.93500000000000005,"5min":1.0409999999999999,"15min":1.0409999999999999},"last":0.75}]},{"osd":3,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":0.92200000000000004,"15min":0.78400000000000003},"min":{"1min":0.57199999999999995,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":11.173,"5min":11.173,"15min":11.173},"last":0.66000000000000003},{"interface":"front","average":{"1min":1.4370000000000001,"5min":0.90800000000000003,"15min":0.77400000000000002},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":11.212,"5min":11.212,"15min":11.212},"last":0.67600000000000005}]},{"osd":4,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.65600000000000003,"15min":0.64600000000000002},"min":{"1min":0.46500000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.91200000000000003,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.623,"15min":0.65900000000000003},"min":{"1min":0.41599999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.69899999999999995,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51400000000000001}]},{"osd":5,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.77700000000000002,"15min":0.76700000000000002},"min":{"1min":0.58299999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.028,"5min":1.1319999999999999,"15min":1.1319999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.79600000000000004,"15min":0.79600000000000004},"min":{"1min":0.54100000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.0469999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.81399999999999995}]},{"osd":6,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.72599999999999998,"5min":0.82099999999999995,"15min":0.78000000000000003},"min":{"1min":0.51600000000000001,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.052,"5min":7.1479999999999997,"15min":7.1479999999999997},"last":0.70699999999999996},{"interface":"front","average":{"1min":1.4530000000000001,"5min":1.022,"15min":0.88400000000000001},"min":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":11.122999999999999,"5min":11.122999999999999,"15min":11.122999999999999},"last":0.72199999999999998}]},{"osd":8,"last update":"Fri Jul 21 22:17:59 2023","interfaces":[{"interface":"back","average":{"1min":0.83299999999999996,"5min":0.80800000000000005,"15min":0.80000000000000004},"min":{"1min":0.55600000000000005,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.76500000000000001},{"interface":"front","average":{"1min":0.88100000000000001,"5min":0.84099999999999997,"15min":0.82199999999999995},"min":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"max":{"1min":1.2210000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.90500000000000003}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":0.88400000000000001,"15min":0.86799999999999999},"min":{"1min":0.64300000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.016,"5min":3.016,"15min":3.016},"last":0.69299999999999995},{"interface":"front","average":{"1min":1.034,"5min":0.88900000000000001,"15min":0.86699999999999999},"min":{"1min":0.67100000000000004,"5min":0.48899999999999999,"15min":0.48899999999999999},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":0.79900000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.87,"15min":0.88100000000000001},"min":{"1min":0.64500000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.0600000000000001,"5min":1.3200000000000001,"15min":1.3200000000000001},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.80500000000000005,"5min":0.90700000000000003,"15min":0.93500000000000005},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":0.99299999999999999,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.59399999999999997}]},{"osd":11,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.995,"5min":0.995,"15min":0.995},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"last":0.871},{"interface":"front","average":{"1min":1.034,"5min":1.034,"15min":1.034},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":0.97399999999999998}]}]},{"osd":6,"up_from":46,"seq":197568495678,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27876,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717276,"statfs":{"total":95995035648,"available":95966490624,"internally_reserved":0,"allocated":946176,"data_stored":455764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.48399999999999999,"15min":0.48099999999999998},"min":{"1min":0.32900000000000001,"5min":0.316,"15min":0.316},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51600000000000001,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.42499999999999999}]},{"osd":1,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.71499999999999997,"15min":0.70499999999999996},"min":{"1min":0.51300000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":1.1970000000000001,"5min":3.8250000000000002,"15min":3.8250000000000002},"last":0.80500000000000005},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.69899999999999995,"15min":0.71599999999999997},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":0.96999999999999997,"5min":1.143,"15min":1.143},"last":0.77300000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.69099999999999995,"15min":0.69299999999999995},"min":{"1min":0.54600000000000004,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.70799999999999996,"15min":0.70999999999999996},"min":{"1min":0.54700000000000004,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":1.1160000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"last":0.58999999999999997}]},{"osd":3,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.56000000000000005,"15min":0.56799999999999995},"min":{"1min":0.35899999999999999,"5min":0.309,"15min":0.309},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.629,"15min":0.64100000000000001},"min":{"1min":0.374,"5min":0.372,"15min":0.372},"max":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"last":0.87}]},{"osd":4,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.73999999999999999,"5min":0.71299999999999997,"15min":0.72999999999999998},"min":{"1min":0.502,"5min":0.439,"15min":0.439},"max":{"1min":1.454,"5min":1.454,"15min":1.454},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":0.78100000000000003,"15min":0.76500000000000001},"min":{"1min":0.47999999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.3149999999999999,"5min":3.8759999999999999,"15min":3.8759999999999999},"last":0.90100000000000002}]},{"osd":5,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.76300000000000001,"15min":0.78300000000000003},"min":{"1min":0.57399999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.94999999999999996,"5min":1.5800000000000001,"15min":1.5800000000000001},"last":0.81999999999999995},{"interface":"front","average":{"1min":0.80600000000000005,"5min":0.76700000000000002,"15min":0.77600000000000002},"min":{"1min":0.52600000000000002,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.425,"5min":1.425,"15min":1.425},"last":0.66000000000000003}]},{"osd":7,"last update":"Fri Jul 21 22:18:33 2023","interfaces":[{"interface":"back","average":{"1min":0.80200000000000005,"5min":0.77300000000000002,"15min":0.73699999999999999},"min":{"1min":0.58699999999999997,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.998,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.78200000000000003,"5min":0.76200000000000001,"15min":0.753},"min":{"1min":0.61399999999999999,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.002,"5min":1.071,"15min":1.071},"last":0.91500000000000004}]},{"osd":8,"last update":"Fri Jul 21 22:18:01 2023","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":0.82299999999999995,"15min":0.82499999999999996},"min":{"1min":0.623,"5min":0.55000000000000004,"15min":0.55000000000000004},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.754},{"interface":"front","average":{"1min":0.80000000000000004,"5min":0.82699999999999996,"15min":0.80900000000000005},"min":{"1min":0.65600000000000003,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.004,"5min":4.0119999999999996,"15min":4.0119999999999996},"last":0.69599999999999995}]},{"osd":9,"last update":"Fri Jul 21 22:18:30 2023","interfaces":[{"interface":"back","average":{"1min":0.84199999999999997,"5min":0.79600000000000004,"15min":0.80200000000000005},"min":{"1min":0.45500000000000002,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":2.23,"5min":2.23,"15min":2.23},"last":0.72799999999999998},{"interface":"front","average":{"1min":1.1060000000000001,"5min":0.91000000000000003,"15min":0.89300000000000002},"min":{"1min":0.58999999999999997,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":6.2880000000000003,"5min":6.2880000000000003,"15min":6.2880000000000003},"last":0.85999999999999999}]},{"osd":10,"last update":"Fri Jul 21 22:18:54 2023","interfaces":[{"interface":"back","average":{"1min":0.88700000000000001,"5min":0.90200000000000002,"15min":0.91400000000000003},"min":{"1min":0.751,"5min":0.64800000000000002,"15min":0.64800000000000002},"max":{"1min":1.018,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.88400000000000001},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.86499999999999999,"15min":0.88200000000000001},"min":{"1min":0.71499999999999997,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":0.98299999999999998,"5min":1.196,"15min":1.196},"last":0.89400000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":980,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":1003520,"data_stored":517156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67900000000000005,"5min":0.61899999999999999,"15min":0.60599999999999998},"min":{"1min":0.48899999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.84299999999999997,"5min":0.98599999999999999,"15min":1.0620000000000001},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.60199999999999998,"15min":0.58199999999999996},"min":{"1min":0.437,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79300000000000004,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.628}]},{"osd":2,"last update":"Fri Jul 21 22:18:24 2023","interfaces":[{"interface":"back","average":{"1min":0.755,"5min":0.67200000000000004,"15min":0.64900000000000002},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.74299999999999999,"5min":0.65600000000000003,"15min":0.64300000000000002},"min":{"1min":0.53900000000000003,"5min":0.40200000000000002,"15min":0.34300000000000003},"max":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.80200000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:18:48 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":0.72699999999999998,"15min":0.68899999999999995},"min":{"1min":0.434,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.93100000000000005,"5min":7.2720000000000002,"15min":7.2720000000000002},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.71999999999999997,"5min":0.68500000000000005,"15min":0.66700000000000004},"min":{"1min":0.53700000000000003,"5min":0.439,"15min":0.439},"max":{"1min":0.97099999999999997,"5min":0.997,"15min":0.997},"last":0.92100000000000004}]},{"osd":4,"last update":"Fri Jul 21 22:18:20 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.56699999999999995,"15min":0.497},"min":{"1min":0.443,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.0189999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.55800000000000005,"15min":0.50600000000000001},"min":{"1min":0.46100000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81399999999999995,"5min":0.88600000000000001,"15min":0.88600000000000001},"last":1.0389999999999999}]},{"osd":5,"last update":"Fri Jul 21 22:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.68999999999999995,"15min":0.66400000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.73599999999999999,"15min":0.67700000000000005},"min":{"1min":0.45000000000000001,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":1.0720000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:18:16 2023","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":0.77800000000000002,"15min":0.73199999999999998},"min":{"1min":0.68600000000000005,"5min":0.495,"15min":0.495},"max":{"1min":1.0229999999999999,"5min":1.036,"15min":1.036},"last":1.1599999999999999},{"interface":"front","average":{"1min":0.81499999999999995,"5min":0.81599999999999995,"15min":0.748},"min":{"1min":0.66000000000000003,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.022,"5min":7.3289999999999997,"15min":7.3289999999999997},"last":1.147}]},{"osd":7,"last update":"Fri Jul 21 22:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.72799999999999998,"5min":0.65900000000000003,"15min":0.60899999999999999},"min":{"1min":0.48799999999999999,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.94999999999999996,"5min":1.03,"15min":1.03},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.73399999999999999,"15min":0.68899999999999995},"min":{"1min":0.60099999999999998,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":1.133,"5min":1.133,"15min":1.133},"last":1.115}]},{"osd":8,"last update":"Fri Jul 21 22:17:56 2023","interfaces":[{"interface":"back","average":{"1min":0.85199999999999998,"5min":0.79500000000000004,"15min":0.78300000000000003},"min":{"1min":0.67200000000000004,"5min":0.55300000000000005,"15min":0.55300000000000005},"max":{"1min":1.1259999999999999,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.97399999999999998,"5min":0.84899999999999998,"15min":0.81499999999999995},"min":{"1min":0.79900000000000004,"5min":0.62,"15min":0.62},"max":{"1min":1.1950000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"last":1.1339999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:18:35 2023","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":0.872,"15min":0.84299999999999997},"min":{"1min":0.76700000000000002,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":0.95399999999999996,"5min":1.056,"15min":1.1299999999999999},"min":{"1min":0.76100000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.1140000000000001,"5min":7.4530000000000003,"15min":7.4530000000000003},"last":1.0880000000000001}]},{"osd":10,"last update":"Fri Jul 21 22:18:52 2023","interfaces":[{"interface":"back","average":{"1min":0.88500000000000001,"5min":0.83999999999999997,"15min":0.82099999999999995},"min":{"1min":0.58599999999999997,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":1.075,"5min":1.1240000000000001,"15min":1.1240000000000001},"last":0.90400000000000003},{"interface":"front","average":{"1min":1.02,"5min":0.94699999999999995,"15min":0.91900000000000004},"min":{"1min":0.78600000000000003,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.254,"5min":1.254,"15min":1.254},"last":1.103}]},{"osd":11,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":0.996,"15min":0.996},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":1.1699999999999999},{"interface":"front","average":{"1min":1.073,"5min":1.073,"15min":1.073},"min":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.2929999999999999,"5min":1.2929999999999999,"15min":1.2929999999999999},"last":1.2090000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27896,"kb_used_data":944,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717256,"statfs":{"total":95995035648,"available":95966470144,"internally_reserved":0,"allocated":966656,"data_stored":457029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.91400000000000003,"5min":1.1499999999999999,"15min":1.1499999999999999},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.69699999999999995,"5min":0.69299999999999995,"15min":0.64100000000000001},"min":{"1min":0.50800000000000001,"5min":0.44,"15min":0.432},"max":{"1min":1.002,"5min":1.244,"15min":1.244},"last":0.69099999999999995}]},{"osd":2,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.65900000000000003,"15min":0.61799999999999999},"min":{"1min":0.47799999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":0.95099999999999996},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.752,"5min":0.68200000000000005,"15min":0.61399999999999999},"min":{"1min":0.51000000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.3360000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.53300000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:18:09 2023","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.77800000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.70899999999999996,"15min":0.625},"min":{"1min":0.42999999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":6.4580000000000002,"5min":6.4580000000000002,"15min":6.4580000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.68500000000000005,"15min":0.64700000000000002},"min":{"1min":0.47499999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.879,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.59799999999999998}]},{"osd":5,"last update":"Fri Jul 21 22:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.72799999999999998,"15min":0.70599999999999996},"min":{"1min":0.63,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":0.92500000000000004,"5min":1.508,"15min":1.508},"last":0.72999999999999998},{"interface":"front","average":{"1min":1.0840000000000001,"5min":0.78800000000000003,"15min":0.72299999999999998},"min":{"1min":0.53400000000000003,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":6.9470000000000001,"5min":6.9470000000000001,"15min":6.9470000000000001},"last":0.74399999999999999}]},{"osd":6,"last update":"Fri Jul 21 22:18:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.60699999999999998,"15min":0.58299999999999996},"min":{"1min":0.36899999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.47,"5min":1.47,"15min":1.47},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.65100000000000002},"min":{"1min":0.41899999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":0.63700000000000001}]},{"osd":7,"last update":"Fri Jul 21 22:16:34 2023","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.76100000000000001,"15min":0.747},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.054,"5min":1.054,"15min":1.054},"last":0.63},{"interface":"front","average":{"1min":0.85799999999999998,"5min":0.76600000000000001,"15min":0.751},"min":{"1min":0.61299999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"last":0.751}]},{"osd":8,"last update":"Fri Jul 21 22:18:02 2023","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.81699999999999995,"15min":0.83499999999999996},"min":{"1min":0.61399999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":0.88200000000000001,"5min":1.163,"15min":1.163},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.83699999999999997,"15min":0.84699999999999998},"min":{"1min":0.66000000000000003,"5min":0.5,"15min":0.5},"max":{"1min":1.3839999999999999,"5min":1.3839999999999999,"15min":1.3839999999999999},"last":0.65200000000000002}]},{"osd":9,"last update":"Fri Jul 21 22:18:31 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.82899999999999996,"15min":0.88},"min":{"1min":0.51500000000000001,"5min":0.439,"15min":0.439},"max":{"1min":1.5269999999999999,"5min":1.5269999999999999,"15min":1.5269999999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.753,"5min":0.82099999999999995,"15min":0.86099999999999999},"min":{"1min":0.54300000000000004,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.0509999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"last":0.84299999999999997}]},{"osd":10,"last update":"Fri Jul 21 22:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.71899999999999997,"5min":0.85099999999999998,"15min":0.89000000000000001},"min":{"1min":0.53100000000000003,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":0.91700000000000004,"5min":1.484,"15min":1.484},"last":0.621},{"interface":"front","average":{"1min":0.751,"5min":1.1200000000000001,"15min":1.2649999999999999},"min":{"1min":0.624,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":0.878,"5min":7.5209999999999999,"15min":7.5209999999999999},"last":0.71299999999999997}]},{"osd":11,"last update":"Fri Jul 21 22:18:17 2023","interfaces":[{"interface":"back","average":{"1min":0.84999999999999998,"5min":0.83399999999999996,"15min":0.83199999999999996},"min":{"1min":0.70399999999999996,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.038,"5min":1.357,"15min":1.357},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86299999999999999,"15min":0.86399999999999999},"min":{"1min":0.70799999999999996,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":0.80400000000000005}]}]},{"osd":2,"up_from":18,"seq":77309411410,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":1004,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":1028096,"data_stored":518941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:26 2023","interfaces":[{"interface":"back","average":{"1min":1.0429999999999999,"5min":0.70599999999999996,"15min":0.62},"min":{"1min":0.38600000000000001,"5min":0.375,"15min":0.375},"max":{"1min":8.2530000000000001,"5min":8.2530000000000001,"15min":8.2530000000000001},"last":0.443},{"interface":"front","average":{"1min":0.75900000000000001,"5min":0.64300000000000002,"15min":0.59599999999999997},"min":{"1min":0.38700000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":0.59799999999999998}]},{"osd":1,"last update":"Fri Jul 21 22:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.68200000000000005,"15min":0.61699999999999999},"min":{"1min":0.436,"5min":0.40500000000000003,"15min":0.38400000000000001},"max":{"1min":0.91500000000000004,"5min":1.476,"15min":1.476},"last":0.629},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.72699999999999998,"15min":0.63200000000000001},"min":{"1min":0.50800000000000001,"5min":0.432,"15min":0.36499999999999999},"max":{"1min":1.01,"5min":1.4079999999999999,"15min":1.4079999999999999},"last":0.80800000000000005}]},{"osd":3,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68100000000000005,"15min":0.64000000000000001},"min":{"1min":0.47899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.78000000000000003,"5min":0.71999999999999997,"15min":0.67300000000000004},"min":{"1min":0.443,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"last":0.65100000000000002}]},{"osd":4,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":0.72499999999999998},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.874}]},{"osd":5,"last update":"Fri Jul 21 22:18:44 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.63100000000000001,"15min":0.57699999999999996},"min":{"1min":0.42399999999999999,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.98799999999999999,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.85299999999999998},{"interface":"front","average":{"1min":0.71699999999999997,"5min":0.63500000000000001,"15min":0.56699999999999995},"min":{"1min":0.48599999999999999,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":1.0269999999999999,"5min":1.0660000000000001,"15min":1.0660000000000001},"last":0.66700000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.84099999999999997,"15min":0.76900000000000002},"min":{"1min":0.56999999999999995,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":8.4900000000000002,"5min":8.4900000000000002,"15min":8.4900000000000002},"last":0.78900000000000003},{"interface":"front","average":{"1min":1.2350000000000001,"5min":0.86899999999999999,"15min":0.78500000000000003},"min":{"1min":0.67500000000000004,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":8.4730000000000008,"5min":8.4730000000000008,"15min":8.4730000000000008},"last":0.89400000000000002}]},{"osd":7,"last update":"Fri Jul 21 22:16:31 2023","interfaces":[{"interface":"back","average":{"1min":0.875,"5min":0.79300000000000004,"15min":0.77900000000000003},"min":{"1min":0.64700000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.82399999999999995,"5min":0.75600000000000001,"15min":0.74399999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"last":0.60999999999999999}]},{"osd":8,"last update":"Fri Jul 21 22:18:00 2023","interfaces":[{"interface":"back","average":{"1min":0.79500000000000004,"5min":0.82099999999999995,"15min":0.82699999999999996},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":0.96399999999999997,"5min":1.409,"15min":1.409},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.77400000000000002,"5min":0.78100000000000003,"15min":0.77700000000000002},"min":{"1min":0.48499999999999999,"5min":0.439,"15min":0.439},"max":{"1min":1.113,"5min":1.181,"15min":1.181},"last":0.82499999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:18:26 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.88200000000000001,"15min":0.89200000000000002},"min":{"1min":0.61899999999999999,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":4.141,"5min":4.141,"15min":4.141},"last":0.71699999999999997},{"interface":"front","average":{"1min":1.105,"5min":1.002,"15min":0.996},"min":{"1min":0.73099999999999998,"5min":0.63,"15min":0.63},"max":{"1min":4.4240000000000004,"5min":4.4240000000000004,"15min":4.4240000000000004},"last":0.95199999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:18:49 2023","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.88400000000000001,"15min":0.88},"min":{"1min":0.59799999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.0960000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"last":0.93600000000000005},{"interface":"front","average":{"1min":0.86399999999999999,"5min":0.91400000000000003,"15min":0.93100000000000005},"min":{"1min":0.68899999999999995,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":1.0409999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.91600000000000004}]},{"osd":11,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"min":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":1.2050000000000001,"5min":1.2050000000000001,"15min":1.2050000000000001},"last":0.98299999999999998},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"min":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"max":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"last":0.97199999999999998}]}]},{"osd":3,"up_from":25,"seq":107374182477,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27892,"kb_used_data":940,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717260,"statfs":{"total":95995035648,"available":95966474240,"internally_reserved":0,"allocated":962560,"data_stored":456081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.45700000000000002,"15min":0.41599999999999998},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":0.442},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.499,"15min":0.443},"min":{"1min":0.36799999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":1.9650000000000001,"5min":1.9650000000000001,"15min":1.9650000000000001},"last":0.40600000000000003}]},{"osd":1,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.78900000000000003,"5min":0.67900000000000005,"15min":0.60499999999999998},"min":{"1min":0.53100000000000003,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.948,"5min":1.948,"15min":1.948},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.68200000000000005,"15min":0.66600000000000004},"min":{"1min":0.47399999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":1.746,"5min":1.746,"15min":1.746},"last":0.64200000000000002}]},{"osd":2,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.80400000000000005,"5min":0.71599999999999997,"15min":0.66600000000000004},"min":{"1min":0.46200000000000002,"5min":0.432,"15min":0.432},"max":{"1min":2.0009999999999999,"5min":2.0009999999999999,"15min":2.0009999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.70599999999999996,"15min":0.65000000000000002},"min":{"1min":0.51000000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":2.109,"5min":2.109,"15min":2.109},"last":0.745}]},{"osd":4,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.76900000000000002,"15min":0.69899999999999995},"min":{"1min":0.49199999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":1.7769999999999999,"5min":6.9480000000000004,"15min":6.9480000000000004},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.81999999999999995,"5min":0.73199999999999998,"15min":0.68899999999999995},"min":{"1min":0.47299999999999998,"5min":0.443,"15min":0.443},"max":{"1min":1.9890000000000001,"5min":1.9890000000000001,"15min":1.9890000000000001},"last":0.55800000000000005}]},{"osd":5,"last update":"Fri Jul 21 22:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.70499999999999996,"15min":0.68400000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.88600000000000001,"5min":1.702,"15min":1.702},"last":0.72899999999999998},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.75,"15min":0.71999999999999997},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":0.93400000000000005,"5min":2.032,"15min":2.032},"last":0.76100000000000001}]},{"osd":6,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.77100000000000002,"5min":0.73499999999999999,"15min":0.69699999999999995},"min":{"1min":0.47999999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":2.097,"5min":2.097,"15min":2.097},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.749,"5min":0.72799999999999998,"15min":0.72399999999999998},"min":{"1min":0.45300000000000001,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Jul 21 22:18:32 2023","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.93500000000000005,"15min":1.042},"min":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.143,"5min":6.9740000000000002,"15min":6.9740000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.77900000000000003,"5min":0.95099999999999996,"15min":1.0760000000000001},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":0.91900000000000004,"5min":6.9870000000000001,"15min":6.9870000000000001},"last":0.68200000000000005}]},{"osd":8,"last update":"Fri Jul 21 22:16:57 2023","interfaces":[{"interface":"back","average":{"1min":0.85399999999999998,"5min":1.1140000000000001,"15min":1.157},"min":{"1min":0.62,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.083,"5min":7.0030000000000001,"15min":7.0030000000000001},"last":0.629},{"interface":"front","average":{"1min":0.88900000000000001,"5min":0.90300000000000002,"15min":0.90500000000000003},"min":{"1min":0.69699999999999995,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":1.1080000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.73499999999999999}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.77400000000000002,"5min":0.88100000000000001,"15min":0.92100000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.1259999999999999,"5min":2.1259999999999999,"15min":2.1259999999999999},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.85999999999999999,"15min":0.89200000000000002},"min":{"1min":0.46000000000000002,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":2.081,"5min":2.081,"15min":2.081},"last":0.66900000000000004}]},{"osd":10,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.96199999999999997,"5min":0.97699999999999998,"15min":0.97899999999999998},"min":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.0659999999999998,"5min":2.0659999999999998,"15min":2.0659999999999998},"last":0.79600000000000004},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.95799999999999996,"15min":0.96299999999999997},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.02,"5min":2.02,"15min":2.02},"last":0.69999999999999996}]},{"osd":11,"last update":"Fri Jul 21 22:18:10 2023","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":2.161,"5min":2.161,"15min":2.161},"last":0.77500000000000002},{"interface":"front","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":1.841,"5min":1.841,"15min":1.841},"last":0.80600000000000005}]}]},{"osd":4,"up_from":33,"seq":141733920841,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27880,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717272,"statfs":{"total":95995035648,"available":95966486528,"internally_reserved":0,"allocated":950272,"data_stored":457161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:16:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56200000000000006,"15min":0.54200000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.57099999999999995,"15min":0.54600000000000004},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.873,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.38500000000000001}]},{"osd":1,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48099999999999998,"15min":0.433},"min":{"1min":0.313,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.432},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.51200000000000001,"15min":0.45600000000000002},"min":{"1min":0.377,"5min":0.31,"15min":0.31},"max":{"1min":0.68400000000000005,"5min":0.90500000000000003,"15min":0.90500000000000003},"last":0.57499999999999996}]},{"osd":2,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.70899999999999996,"15min":0.65500000000000003},"min":{"1min":0.61499999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.92400000000000004,"5min":1.056,"15min":1.056},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.74199999999999999,"15min":0.67100000000000004},"min":{"1min":0.45000000000000001,"5min":0.376,"15min":0.376},"max":{"1min":1.155,"5min":1.155,"15min":1.155},"last":0.77900000000000003}]},{"osd":3,"last update":"Fri Jul 21 22:18:13 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.58599999999999997},"min":{"1min":0.52200000000000002,"5min":0.373,"15min":0.373},"max":{"1min":0.96999999999999997,"5min":1.2669999999999999,"15min":1.2669999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.67500000000000004,"15min":0.621},"min":{"1min":0.45200000000000001,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86599999999999999,"5min":1.236,"15min":1.236},"last":0.72099999999999997}]},{"osd":5,"last update":"Fri Jul 21 22:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.81100000000000005,"5min":0.77700000000000002,"15min":0.73699999999999999},"min":{"1min":0.52400000000000002,"5min":0.503,"15min":0.503},"max":{"1min":1.0529999999999999,"5min":1.194,"15min":1.194},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.84899999999999998,"5min":0.79200000000000004,"15min":0.73999999999999999},"min":{"1min":0.71899999999999997,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":0.94099999999999995,"5min":1.175,"15min":1.175},"last":0.79400000000000004}]},{"osd":6,"last update":"Fri Jul 21 22:18:03 2023","interfaces":[{"interface":"back","average":{"1min":0.75600000000000001,"5min":0.76600000000000001,"15min":0.73999999999999999},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":1.0009999999999999,"5min":1.093,"15min":1.093},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.72499999999999998,"5min":0.78600000000000003,"15min":0.79200000000000004},"min":{"1min":0.51600000000000001,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.0629999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005}]},{"osd":7,"last update":"Fri Jul 21 22:18:43 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.68899999999999995,"15min":0.65500000000000003},"min":{"1min":0.505,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88400000000000001,"5min":1.127,"15min":1.127},"last":0.625},{"interface":"front","average":{"1min":0.82899999999999996,"5min":0.749,"15min":0.68700000000000006},"min":{"1min":0.54600000000000004,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.0209999999999999,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.85299999999999998}]},{"osd":8,"last update":"Fri Jul 21 22:17:55 2023","interfaces":[{"interface":"back","average":{"1min":0.79100000000000004,"5min":0.79900000000000004,"15min":0.79100000000000004},"min":{"1min":0.624,"5min":0.48799999999999999,"15min":0.48799999999999999},"max":{"1min":1.0529999999999999,"5min":1.165,"15min":1.165},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.92000000000000004,"5min":0.86099999999999999,"15min":0.83299999999999996},"min":{"1min":0.68799999999999994,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.224,"5min":1.2290000000000001,"15min":1.2290000000000001},"last":0.70099999999999996}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.90200000000000002,"15min":0.89800000000000002},"min":{"1min":0.63,"5min":0.503,"15min":0.503},"max":{"1min":1.224,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.77800000000000002,"5min":0.84699999999999998,"15min":0.86899999999999999},"min":{"1min":0.52800000000000002,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.3169999999999999,"5min":1.3169999999999999,"15min":1.3169999999999999},"last":0.82599999999999996}]},{"osd":10,"last update":"Fri Jul 21 22:18:51 2023","interfaces":[{"interface":"back","average":{"1min":0.80100000000000005,"5min":0.89800000000000002,"15min":0.93000000000000005},"min":{"1min":0.57799999999999996,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.024,"5min":1.327,"15min":1.327},"last":0.878},{"interface":"front","average":{"1min":0.92300000000000004,"5min":0.97599999999999998,"15min":0.99299999999999999},"min":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":1.1040000000000001,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.92200000000000004}]},{"osd":11,"last update":"Fri Jul 21 22:18:08 2023","interfaces":[{"interface":"back","average":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":1.1990000000000001,"5min":1.1990000000000001,"15min":1.1990000000000001},"last":0.95399999999999996},{"interface":"front","average":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"last":0.99099999999999999}]}]},{"osd":5,"up_from":38,"seq":163208757315,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27948,"kb_used_data":996,"kb_used_omap":0,"kb_used_meta":26944,"kb_avail":93717204,"statfs":{"total":95995035648,"available":95966416896,"internally_reserved":0,"allocated":1019904,"data_stored":1047953,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":27590656},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.58499999999999996,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.68500000000000005,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.78700000000000003,"5min":0.64100000000000001,"15min":0.60599999999999998},"min":{"1min":0.45200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":4.9550000000000001,"5min":4.9550000000000001,"15min":4.9550000000000001},"last":0.54900000000000004}]},{"osd":1,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.76900000000000002,"5min":0.67800000000000005,"15min":0.60599999999999998},"min":{"1min":0.53600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.91100000000000003,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.72399999999999998,"5min":0.75600000000000001,"15min":0.65900000000000003},"min":{"1min":0.45400000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.88700000000000001,"5min":6.9340000000000002,"15min":6.9340000000000002},"last":0.63400000000000001}]},{"osd":2,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.52300000000000002,"15min":0.48699999999999999},"min":{"1min":0.437,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":0.93799999999999994},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.55500000000000005,"15min":0.50900000000000001},"min":{"1min":0.41299999999999998,"5min":0.317,"15min":0.317},"max":{"1min":0.748,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.71199999999999997,"15min":0.65800000000000003},"min":{"1min":0.48299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":1.109,"5min":6.9160000000000004,"15min":6.9160000000000004},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.72099999999999997,"15min":0.67100000000000004},"min":{"1min":0.45500000000000002,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.87,"5min":7.0129999999999999,"15min":7.0129999999999999},"last":0.73399999999999999}]},{"osd":4,"last update":"Fri Jul 21 22:18:46 2023","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":0.72399999999999998,"15min":0.66400000000000003},"min":{"1min":0.53100000000000003,"5min":0.435,"15min":0.435},"max":{"1min":0.99199999999999999,"5min":1.177,"15min":1.177},"last":0.79100000000000004},{"interface":"front","average":{"1min":0.81899999999999995,"5min":0.73299999999999998,"15min":0.67700000000000005},"min":{"1min":0.64400000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.0289999999999999,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.77400000000000002}]},{"osd":6,"last update":"Fri Jul 21 22:18:11 2023","interfaces":[{"interface":"back","average":{"1min":1.282,"5min":0.89500000000000002,"15min":0.77300000000000002},"min":{"1min":0.53200000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":6.3799999999999999,"5min":6.9649999999999999,"15min":6.9649999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":1.034,"5min":0.79000000000000004,"15min":0.753},"min":{"1min":0.5,"5min":0.5,"15min":0.5},"max":{"1min":6.6260000000000003,"5min":6.6260000000000003,"15min":6.6260000000000003},"last":0.81299999999999994}]},{"osd":7,"last update":"Fri Jul 21 22:18:41 2023","interfaces":[{"interface":"back","average":{"1min":0.82699999999999996,"5min":0.80800000000000005,"15min":0.80200000000000005},"min":{"1min":0.64400000000000002,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.0429999999999999,"5min":1.2390000000000001,"15min":1.2390000000000001},"last":0.88},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.79800000000000004,"15min":0.77900000000000003},"min":{"1min":0.63700000000000001,"5min":0.54100000000000004,"15min":0.54100000000000004},"max":{"1min":1.05,"5min":1.139,"15min":1.139},"last":0.87}]},{"osd":8,"last update":"Fri Jul 21 22:17:58 2023","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.76400000000000001,"15min":0.78400000000000003},"min":{"1min":0.54900000000000004,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":1.071,"5min":1.1279999999999999,"15min":1.1279999999999999},"last":0.82999999999999996},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.75700000000000001,"15min":0.75600000000000001},"min":{"1min":0.505,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.22,"5min":1.22,"15min":1.22},"last":0.89200000000000002}]},{"osd":9,"last update":"Fri Jul 21 22:18:25 2023","interfaces":[{"interface":"back","average":{"1min":0.84399999999999997,"5min":0.83499999999999996,"15min":0.84799999999999998},"min":{"1min":0.64900000000000002,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":1.157,"5min":1.157,"15min":1.157},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.1619999999999999,"5min":0.89600000000000002,"15min":0.86599999999999999},"min":{"1min":0.56599999999999995,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":6.343,"5min":6.343,"15min":6.343},"last":0.91200000000000003}]},{"osd":10,"last update":"Fri Jul 21 22:18:53 2023","interfaces":[{"interface":"back","average":{"1min":0.93100000000000005,"5min":0.88800000000000001,"15min":0.88200000000000001},"min":{"1min":0.80400000000000005,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.1639999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.92700000000000005,"5min":0.877,"15min":0.872},"min":{"1min":0.74399999999999999,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":1.016,"5min":1.202,"15min":1.202},"last":0.94099999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34389,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":36032,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":60102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-07-21T22:18:58.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:18:58.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.373+0000 7fd7175ff700 1 -- 172.21.15.151:0/3884151835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100ff6c0 msgr2=0x7fd7100ffb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.373+0000 7fd7175ff700 1 --2- 172.21.15.151:0/3884151835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100ff6c0 0x7fd7100ffb30 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fd70800b0a0 tx=0x7fd70800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.373+0000 7fd7175ff700 1 -- 172.21.15.151:0/3884151835 shutdown_connections 2023-07-21T22:18:58.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.373+0000 7fd7175ff700 1 --2- 172.21.15.151:0/3884151835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100ff6c0 0x7fd7100ffb30 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.373+0000 7fd7175ff700 1 --2- 172.21.15.151:0/3884151835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100fe3c0 0x7fd7100fe7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.373+0000 7fd7175ff700 1 --2- 172.21.15.151:0/3884151835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7100fed10 0x7fd7100ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.373+0000 7fd7175ff700 1 -- 172.21.15.151:0/3884151835 >> 172.21.15.151:0/3884151835 conn(0x7fd7100f9fd0 msgr2=0x7fd7100fc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.373+0000 7fd7175ff700 1 -- 172.21.15.151:0/3884151835 shutdown_connections 2023-07-21T22:18:58.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.373+0000 7fd7175ff700 1 -- 172.21.15.151:0/3884151835 wait complete. 2023-07-21T22:18:58.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.374+0000 7fd7175ff700 1 Processor -- start 2023-07-21T22:18:58.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd7175ff700 1 -- start start 2023-07-21T22:18:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd7175ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100fe3c0 0x7fd710197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd7175ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100fed10 0x7fd710197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd7175ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7100ff6c0 0x7fd71019ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd7175ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71019f510 con 0x7fd7100fed10 2023-07-21T22:18:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd7175ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71019f650 con 0x7fd7100ff6c0 2023-07-21T22:18:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd7175ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71019f7e0 con 0x7fd7100fe3c0 2023-07-21T22:18:58.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd714b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100fed10 0x7fd710197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd714b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100fed10 0x7fd710197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52212/0 (socket says 172.21.15.151:52212) 2023-07-21T22:18:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.375+0000 7fd714b9a700 1 -- 172.21.15.151:0/967156375 learned_addr learned my addr 172.21.15.151:0/967156375 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd71539b700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100fe3c0 0x7fd710197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd715b9c700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7100ff6c0 0x7fd71019ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd714b9a700 1 -- 172.21.15.151:0/967156375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100fe3c0 msgr2=0x7fd710197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd714b9a700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100fe3c0 0x7fd710197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd714b9a700 1 -- 172.21.15.151:0/967156375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7100ff6c0 msgr2=0x7fd71019ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd714b9a700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7100ff6c0 0x7fd71019ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd714b9a700 1 -- 172.21.15.151:0/967156375 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd708009d00 con 0x7fd7100fed10 2023-07-21T22:18:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd714b9a700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100fed10 0x7fd710197ed0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c9b0 tx=0x7fd70000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd7067fc700 1 -- 172.21.15.151:0/967156375 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700007b00 con 0x7fd7100fed10 2023-07-21T22:18:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd7067fc700 1 -- 172.21.15.151:0/967156375 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd70000ce50 con 0x7fd7100fed10 2023-07-21T22:18:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71019fac0 con 0x7fd7100fed10 2023-07-21T22:18:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.376+0000 7fd7067fc700 1 -- 172.21.15.151:0/967156375 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd700018420 con 0x7fd7100fed10 2023-07-21T22:18:58.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.377+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7101a0020 con 0x7fd7100fed10 2023-07-21T22:18:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.378+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7101091a0 con 0x7fd7100fed10 2023-07-21T22:18:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.379+0000 7fd7067fc700 1 -- 172.21.15.151:0/967156375 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7fd70000f450 con 0x7fd7100fed10 2023-07-21T22:18:58.426 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.381+0000 7fd7067fc700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1220 0x7fd6fc0a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.381+0000 7fd7067fc700 1 -- 172.21.15.151:0/967156375 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7fd7000cc800 con 0x7fd7100fed10 2023-07-21T22:18:58.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.381+0000 7fd71539b700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1220 0x7fd6fc0a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.381+0000 7fd71539b700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1220 0x7fd6fc0a36d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd70c005950 tx=0x7fd70c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.384+0000 7fd7067fc700 1 -- 172.21.15.151:0/967156375 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fd700095f20 con 0x7fd7100fed10 2023-07-21T22:18:58.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:58 smithi151 ceph-mon[95510]: pgmap v354: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2023-07-21T22:18:58.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:58 smithi151 ceph-mon[95510]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:58.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:58 smithi187 ceph-mon[96918]: pgmap v354: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2023-07-21T22:18:58.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:58 smithi187 ceph-mon[96918]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:58.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.589+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd71002c850 con 0x7fd7100fed10 2023-07-21T22:18:58.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.591+0000 7fd7067fc700 1 -- 172.21.15.151:0/967156375 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7fd70000f700 con 0x7fd7100fed10 2023-07-21T22:18:58.636 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:18:58.636 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:18:58.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.593+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1220 msgr2=0x7fd6fc0a36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.593+0000 7fd7175ff700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1220 0x7fd6fc0a36d0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd70c005950 tx=0x7fd70c00b410 comp rx=0 tx=0).stop 2023-07-21T22:18:58.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.593+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100fed10 msgr2=0x7fd710197ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.593+0000 7fd7175ff700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100fed10 0x7fd710197ed0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd70000c9b0 tx=0x7fd70000ccc0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.594+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 shutdown_connections 2023-07-21T22:18:58.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.594+0000 7fd7175ff700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7fd6fc0a1220 0x7fd6fc0a36d0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.594+0000 7fd7175ff700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7100ff6c0 0x7fd71019ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.594+0000 7fd7175ff700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7100fe3c0 0x7fd710197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.594+0000 7fd7175ff700 1 --2- 172.21.15.151:0/967156375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7100fed10 0x7fd710197ed0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.594+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 >> 172.21.15.151:0/967156375 conn(0x7fd7100f9fd0 msgr2=0x7fd7100fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.594+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 shutdown_connections 2023-07-21T22:18:58.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.594+0000 7fd7175ff700 1 -- 172.21.15.151:0/967156375 wait complete. 2023-07-21T22:18:58.657 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T22:18:58.658 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T22:18:58.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:58 smithi195 ceph-mon[97365]: pgmap v354: 97 pgs: 97 active+clean; 638 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 6 op/s 2023-07-21T22:18:58.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:58 smithi195 ceph-mon[97365]: from='client.15384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:58.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.817+0000 7f02f41ff700 1 -- 172.21.15.151:0/2342123047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec10c0c0 msgr2=0x7f02ec10e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.817+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2342123047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec10c0c0 0x7f02ec10e4a0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f02e400b0a0 tx=0x7f02e400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.817+0000 7f02f41ff700 1 -- 172.21.15.151:0/2342123047 shutdown_connections 2023-07-21T22:18:58.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.817+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2342123047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02ec074550 0x7f02ec0729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.817+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2342123047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec10c0c0 0x7f02ec10e4a0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.817+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2342123047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02ec072f70 0x7f02ec0733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.817+0000 7f02f41ff700 1 -- 172.21.15.151:0/2342123047 >> 172.21.15.151:0/2342123047 conn(0x7f02ec0fb130 msgr2=0x7f02ec0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:58.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.817+0000 7f02f41ff700 1 -- 172.21.15.151:0/2342123047 shutdown_connections 2023-07-21T22:18:58.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.817+0000 7f02f41ff700 1 -- 172.21.15.151:0/2342123047 wait complete. 2023-07-21T22:18:58.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.818+0000 7f02f41ff700 1 Processor -- start 2023-07-21T22:18:58.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.818+0000 7f02f41ff700 1 -- start start 2023-07-21T22:18:58.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f41ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02ec072f70 0x7f02ec19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f41ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec074550 0x7f02ec19c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f41ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02ec10c0c0 0x7f02ec1a3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f41ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec1a3a00 con 0x7f02ec074550 2023-07-21T22:18:58.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f41ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec1a3b40 con 0x7f02ec072f70 2023-07-21T22:18:58.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f41ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f02ec1a3cd0 con 0x7f02ec10c0c0 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f179a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec074550 0x7f02ec19c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f179a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec074550 0x7f02ec19c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52226/0 (socket says 172.21.15.151:52226) 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f179a700 1 -- 172.21.15.151:0/2083861108 learned_addr learned my addr 172.21.15.151:0/2083861108 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f1f9b700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02ec072f70 0x7f02ec19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f279c700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02ec10c0c0 0x7f02ec1a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f179a700 1 -- 172.21.15.151:0/2083861108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02ec10c0c0 msgr2=0x7f02ec1a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f179a700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02ec10c0c0 0x7f02ec1a3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f179a700 1 -- 172.21.15.151:0/2083861108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02ec072f70 msgr2=0x7f02ec19be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f179a700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02ec072f70 0x7f02ec19be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f179a700 1 -- 172.21.15.151:0/2083861108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f02e4009d00 con 0x7f02ec074550 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.819+0000 7f02f279c700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02ec10c0c0 0x7f02ec1a3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.820+0000 7f02f179a700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec074550 0x7f02ec19c3c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00e970 tx=0x7f02dc00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.820+0000 7f02e2ffd700 1 -- 172.21.15.151:0/2083861108 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc009790 con 0x7f02ec074550 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.820+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02ec1a3fb0 con 0x7f02ec074550 2023-07-21T22:18:58.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.820+0000 7f02e2ffd700 1 -- 172.21.15.151:0/2083861108 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f02dc0044b0 con 0x7f02ec074550 2023-07-21T22:18:58.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.820+0000 7f02e2ffd700 1 -- 172.21.15.151:0/2083861108 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02dc003dd0 con 0x7f02ec074550 2023-07-21T22:18:58.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.820+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f02ec1a4430 con 0x7f02ec074550 2023-07-21T22:18:58.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.821+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f02ec101c10 con 0x7f02ec074550 2023-07-21T22:18:58.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.823+0000 7f02e2ffd700 1 -- 172.21.15.151:0/2083861108 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f02dc003f30 con 0x7f02ec074550 2023-07-21T22:18:58.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.824+0000 7f02e2ffd700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02d80a1150 0x7f02d80a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:58.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.825+0000 7f02e2ffd700 1 -- 172.21.15.151:0/2083861108 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f02dc014070 con 0x7f02ec074550 2023-07-21T22:18:58.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.825+0000 7f02f1f9b700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02d80a1150 0x7f02d80a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:58.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.825+0000 7f02f1f9b700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02d80a1150 0x7f02d80a3600 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02ec074920 tx=0x7f02e8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:58.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:58.828+0000 7f02e2ffd700 1 -- 172.21.15.151:0/2083861108 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f02dc0963c0 con 0x7f02ec074550 2023-07-21T22:18:59.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.027+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f02ec061220 con 0x7f02ec074550 2023-07-21T22:18:59.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.028+0000 7f02e2ffd700 1 -- 172.21.15.151:0/2083861108 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v87) v1 ==== 93+0+10 (secure 0 0 0) 0x7f02dc0999e0 con 0x7f02ec074550 2023-07-21T22:18:59.073 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T22:18:59.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02d80a1150 msgr2=0x7f02d80a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02d80a1150 0x7f02d80a3600 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f02ec074920 tx=0x7f02e8009260 comp rx=0 tx=0).stop 2023-07-21T22:18:59.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec074550 msgr2=0x7f02ec19c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec074550 0x7f02ec19c3c0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00e970 tx=0x7f02dc00ed30 comp rx=0 tx=0).stop 2023-07-21T22:18:59.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 shutdown_connections 2023-07-21T22:18:59.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f02d80a1150 0x7f02d80a3600 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f02ec072f70 0x7f02ec19be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f02ec10c0c0 0x7f02ec1a3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 --2- 172.21.15.151:0/2083861108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f02ec074550 0x7f02ec19c3c0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 >> 172.21.15.151:0/2083861108 conn(0x7f02ec0fb130 msgr2=0x7f02ec0fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 shutdown_connections 2023-07-21T22:18:59.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.030+0000 7f02f41ff700 1 -- 172.21.15.151:0/2083861108 wait complete. 2023-07-21T22:18:59.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T22:18:59.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.251+0000 7f7b17bff700 1 -- 172.21.15.151:0/2246452041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 msgr2=0x7f7b10101120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.251+0000 7f7b17bff700 1 --2- 172.21.15.151:0/2246452041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 0x7f7b10101120 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f7b00009990 tx=0x7f7b00009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.251+0000 7f7b17bff700 1 -- 172.21.15.151:0/2246452041 shutdown_connections 2023-07-21T22:18:59.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.251+0000 7f7b17bff700 1 --2- 172.21.15.151:0/2246452041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b10101660 0x7f7b10107f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.251+0000 7f7b17bff700 1 --2- 172.21.15.151:0/2246452041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b100ffae0 0x7f7b100ffef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.251+0000 7f7b17bff700 1 --2- 172.21.15.151:0/2246452041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 0x7f7b10101120 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.251+0000 7f7b17bff700 1 -- 172.21.15.151:0/2246452041 >> 172.21.15.151:0/2246452041 conn(0x7f7b100fb0e0 msgr2=0x7f7b100fd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.251+0000 7f7b17bff700 1 -- 172.21.15.151:0/2246452041 shutdown_connections 2023-07-21T22:18:59.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.251+0000 7f7b17bff700 1 -- 172.21.15.151:0/2246452041 wait complete. 2023-07-21T22:18:59.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.252+0000 7f7b17bff700 1 Processor -- start 2023-07-21T22:18:59.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.252+0000 7f7b17bff700 1 -- start start 2023-07-21T22:18:59.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.252+0000 7f7b17bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100ffae0 0x7f7b100742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.252+0000 7f7b17bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 0x7f7b10072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.252+0000 7f7b17bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b10101660 0x7f7b10072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.252+0000 7f7b17bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b100735e0 con 0x7f7b10100cd0 2023-07-21T22:18:59.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.252+0000 7f7b17bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b10073750 con 0x7f7b100ffae0 2023-07-21T22:18:59.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b17bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1019f810 con 0x7f7b10101660 2023-07-21T22:18:59.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1519a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 0x7f7b10072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1599b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100ffae0 0x7f7b100742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1519a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 0x7f7b10072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52250/0 (socket says 172.21.15.151:52250) 2023-07-21T22:18:59.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1519a700 1 -- 172.21.15.151:0/3558424401 learned_addr learned my addr 172.21.15.151:0/3558424401 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:59.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1619c700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b10101660 0x7f7b10072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1519a700 1 -- 172.21.15.151:0/3558424401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b10101660 msgr2=0x7f7b10072e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1519a700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b10101660 0x7f7b10072e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1519a700 1 -- 172.21.15.151:0/3558424401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100ffae0 msgr2=0x7f7b100742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1519a700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100ffae0 0x7f7b100742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1519a700 1 -- 172.21.15.151:0/3558424401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b000095f0 con 0x7f7b10100cd0 2023-07-21T22:18:59.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1599b700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100ffae0 0x7f7b100742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:18:59.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.253+0000 7f7b1519a700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 0x7f7b10072900 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7b00000c00 tx=0x7f7b00005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.254+0000 7f7b06ffd700 1 -- 172.21.15.151:0/3558424401 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0001d070 con 0x7f7b10100cd0 2023-07-21T22:18:59.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.254+0000 7f7b06ffd700 1 -- 172.21.15.151:0/3558424401 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b00003ec0 con 0x7f7b10100cd0 2023-07-21T22:18:59.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.254+0000 7f7b06ffd700 1 -- 172.21.15.151:0/3558424401 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b00022ac0 con 0x7f7b10100cd0 2023-07-21T22:18:59.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.254+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1019fa90 con 0x7f7b10100cd0 2023-07-21T22:18:59.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.254+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1019fe60 con 0x7f7b10100cd0 2023-07-21T22:18:59.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.255+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b1010b220 con 0x7f7b10100cd0 2023-07-21T22:18:59.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.257+0000 7f7b06ffd700 1 -- 172.21.15.151:0/3558424401 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f7b00004030 con 0x7f7b10100cd0 2023-07-21T22:18:59.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.258+0000 7f7b06ffd700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7afc0a11d0 0x7f7afc0a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.258+0000 7f7b06ffd700 1 -- 172.21.15.151:0/3558424401 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f7b000cdf10 con 0x7f7b10100cd0 2023-07-21T22:18:59.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.259+0000 7f7b1599b700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7afc0a11d0 0x7f7afc0a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.259+0000 7f7b1599b700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7afc0a11d0 0x7f7afc0a3680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7b10100b30 tx=0x7f7b0c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.262+0000 7f7b06ffd700 1 -- 172.21.15.151:0/3558424401 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f7b000976c0 con 0x7f7b10100cd0 2023-07-21T22:18:59.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:59 smithi151 ceph-mon[95510]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:59.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:59 smithi151 ceph-mon[95510]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:59.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:59 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/967156375' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:59.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:18:59 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2083861108' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:59.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.464+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7b10106a80 con 0x7f7b10100cd0 2023-07-21T22:18:59.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.465+0000 7f7b06ffd700 1 -- 172.21.15.151:0/3558424401 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7b0009ace0 con 0x7f7b10100cd0 2023-07-21T22:18:59.510 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T22:18:59.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7afc0a11d0 msgr2=0x7f7afc0a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7afc0a11d0 0x7f7afc0a3680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7b10100b30 tx=0x7f7b0c00b410 comp rx=0 tx=0).stop 2023-07-21T22:18:59.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 msgr2=0x7f7b10072900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 0x7f7b10072900 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f7b00000c00 tx=0x7f7b00005740 comp rx=0 tx=0).stop 2023-07-21T22:18:59.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 shutdown_connections 2023-07-21T22:18:59.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f7afc0a11d0 0x7f7afc0a3680 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b100ffae0 0x7f7b100742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b10101660 0x7f7b10072e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 --2- 172.21.15.151:0/3558424401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b10100cd0 0x7f7b10072900 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.467+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 >> 172.21.15.151:0/3558424401 conn(0x7f7b100fb0e0 msgr2=0x7f7b100fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.468+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 shutdown_connections 2023-07-21T22:18:59.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.468+0000 7f7b17bff700 1 -- 172.21.15.151:0/3558424401 wait complete. 2023-07-21T22:18:59.530 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T22:18:59.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:59 smithi187 ceph-mon[96918]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:59.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:59 smithi187 ceph-mon[96918]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:59.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:59 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/967156375' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:59.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:18:59 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2083861108' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:59.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:59 smithi195 ceph-mon[97365]: from='client.15390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:59.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:59 smithi195 ceph-mon[97365]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2023-07-21T22:18:59.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:59 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/967156375' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:18:59.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:18:59 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2083861108' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T22:18:59.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.687+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/451106843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58100420 msgr2=0x7f0b58102800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.687+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/451106843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58100420 0x7f0b58102800 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0b54009990 tx=0x7f0b54009ca0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.687+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/451106843 shutdown_connections 2023-07-21T22:18:59.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.687+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/451106843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b58105660 0x7f0b58107ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.687+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/451106843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58100420 0x7f0b58102800 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.687+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/451106843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b58102d40 0x7f0b58105120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.687+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/451106843 >> 172.21.15.151:0/451106843 conn(0x7f0b580f9ee0 msgr2=0x7f0b580fc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.687+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/451106843 shutdown_connections 2023-07-21T22:18:59.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.687+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/451106843 wait complete. 2023-07-21T22:18:59.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.688+0000 7f0b5ed9d700 1 Processor -- start 2023-07-21T22:18:59.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.688+0000 7f0b5ed9d700 1 -- start start 2023-07-21T22:18:59.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5ed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b58100420 0x7f0b581976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b58102d40 0x7f0b58197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58105660 0x7f0b5819eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5ed9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5819f270 con 0x7f0b58105660 2023-07-21T22:18:59.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5ed9d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5819f3b0 con 0x7f0b58100420 2023-07-21T22:18:59.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5ed9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b5819f540 con 0x7f0b58102d40 2023-07-21T22:18:59.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58105660 0x7f0b5819eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58105660 0x7f0b5819eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52272/0 (socket says 172.21.15.151:52272) 2023-07-21T22:18:59.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5e59c700 1 -- 172.21.15.151:0/1281749381 learned_addr learned my addr 172.21.15.151:0/1281749381 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:18:59.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5d59a700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b58102d40 0x7f0b58197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5dd9b700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b58100420 0x7f0b581976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5e59c700 1 -- 172.21.15.151:0/1281749381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b58102d40 msgr2=0x7f0b58197c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5e59c700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b58102d40 0x7f0b58197c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5e59c700 1 -- 172.21.15.151:0/1281749381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b58100420 msgr2=0x7f0b581976f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5e59c700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b58100420 0x7f0b581976f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.689+0000 7f0b5e59c700 1 -- 172.21.15.151:0/1281749381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b540095f0 con 0x7f0b58105660 2023-07-21T22:18:59.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.690+0000 7f0b5e59c700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58105660 0x7f0b5819eca0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0b50007ee0 tx=0x7f0b5000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.690+0000 7f0b4effd700 1 -- 172.21.15.151:0/1281749381 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50017070 con 0x7f0b58105660 2023-07-21T22:18:59.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.690+0000 7f0b4effd700 1 -- 172.21.15.151:0/1281749381 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b5000f040 con 0x7f0b58105660 2023-07-21T22:18:59.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.690+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b5819f820 con 0x7f0b58105660 2023-07-21T22:18:59.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.690+0000 7f0b4effd700 1 -- 172.21.15.151:0/1281749381 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b50005710 con 0x7f0b58105660 2023-07-21T22:18:59.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.690+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b5819fd80 con 0x7f0b58105660 2023-07-21T22:18:59.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.691+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b58107220 con 0x7f0b58105660 2023-07-21T22:18:59.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.695+0000 7f0b4effd700 1 -- 172.21.15.151:0/1281749381 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f0b50005870 con 0x7f0b58105660 2023-07-21T22:18:59.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.696+0000 7f0b4effd700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b440a1270 0x7f0b440a3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:18:59.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.696+0000 7f0b4effd700 1 -- 172.21.15.151:0/1281749381 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f0b500cc710 con 0x7f0b58105660 2023-07-21T22:18:59.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.696+0000 7f0b5dd9b700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b440a1270 0x7f0b440a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:18:59.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.697+0000 7f0b5dd9b700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b440a1270 0x7f0b440a3720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0b54006010 tx=0x7f0b5400b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:18:59.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.698+0000 7f0b4effd700 1 -- 172.21.15.151:0/1281749381 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f0b50095e30 con 0x7f0b58105660 2023-07-21T22:18:59.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.897+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0b5802c9e0 con 0x7f0b58105660 2023-07-21T22:18:59.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.898+0000 7f0b4effd700 1 -- 172.21.15.151:0/1281749381 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0b50099450 con 0x7f0b58105660 2023-07-21T22:18:59.943 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T22:18:59.944 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b440a1270 msgr2=0x7f0b440a3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b440a1270 0x7f0b440a3720 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0b54006010 tx=0x7f0b5400b260 comp rx=0 tx=0).stop 2023-07-21T22:18:59.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58105660 msgr2=0x7f0b5819eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:18:59.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58105660 0x7f0b5819eca0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0b50007ee0 tx=0x7f0b5000d3b0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 shutdown_connections 2023-07-21T22:18:59.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f0b440a1270 0x7f0b440a3720 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b58100420 0x7f0b581976f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b58105660 0x7f0b5819eca0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 --2- 172.21.15.151:0/1281749381 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b58102d40 0x7f0b58197c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:18:59.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 >> 172.21.15.151:0/1281749381 conn(0x7f0b580f9ee0 msgr2=0x7f0b580feaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:18:59.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 shutdown_connections 2023-07-21T22:18:59.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:18:59.900+0000 7f0b5ed9d700 1 -- 172.21.15.151:0/1281749381 wait complete. 2023-07-21T22:18:59.964 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:00.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.117+0000 7f58b49ff700 1 -- 172.21.15.151:0/1190125796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00ffb00 msgr2=0x7f58b00fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.117+0000 7f58b49ff700 1 --2- 172.21.15.151:0/1190125796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00ffb00 0x7f58b00fff10 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009990 tx=0x7f58a0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.117+0000 7f58b49ff700 1 -- 172.21.15.151:0/1190125796 shutdown_connections 2023-07-21T22:19:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.117+0000 7f58b49ff700 1 --2- 172.21.15.151:0/1190125796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b0101680 0x7f58b0107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.117+0000 7f58b49ff700 1 --2- 172.21.15.151:0/1190125796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b00ffb00 0x7f58b00fff10 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.117+0000 7f58b49ff700 1 --2- 172.21.15.151:0/1190125796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0100cf0 0x7f58b0101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.117+0000 7f58b49ff700 1 -- 172.21.15.151:0/1190125796 >> 172.21.15.151:0/1190125796 conn(0x7f58b00fb0e0 msgr2=0x7f58b00fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.118+0000 7f58b49ff700 1 -- 172.21.15.151:0/1190125796 shutdown_connections 2023-07-21T22:19:00.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.118+0000 7f58b49ff700 1 -- 172.21.15.151:0/1190125796 wait complete. 2023-07-21T22:19:00.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.119+0000 7f58b49ff700 1 Processor -- start 2023-07-21T22:19:00.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.119+0000 7f58b49ff700 1 -- start start 2023-07-21T22:19:00.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58b49ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b00ffb00 0x7f58b00742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58b49ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0100cf0 0x7f58b0072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58b49ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0101680 0x7f58b0072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58b49ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b00735e0 con 0x7f58b0101680 2023-07-21T22:19:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58b49ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b0073750 con 0x7f58b00ffb00 2023-07-21T22:19:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58b49ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b019f7f0 con 0x7f58b0100cf0 2023-07-21T22:19:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58aed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0101680 0x7f58b0072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58aed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0101680 0x7f58b0072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52304/0 (socket says 172.21.15.151:52304) 2023-07-21T22:19:00.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58aed9d700 1 -- 172.21.15.151:0/2732424738 learned_addr learned my addr 172.21.15.151:0/2732424738 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:00.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58ae59c700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b00ffb00 0x7f58b00742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58add9b700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0100cf0 0x7f58b0072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58aed9d700 1 -- 172.21.15.151:0/2732424738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0100cf0 msgr2=0x7f58b0072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58aed9d700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0100cf0 0x7f58b0072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58aed9d700 1 -- 172.21.15.151:0/2732424738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b00ffb00 msgr2=0x7f58b00742c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58aed9d700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b00ffb00 0x7f58b00742c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58aed9d700 1 -- 172.21.15.151:0/2732424738 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00095f0 con 0x7f58b0101680 2023-07-21T22:19:00.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.120+0000 7f58add9b700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0100cf0 0x7f58b0072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:00.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.121+0000 7f58aed9d700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0101680 0x7f58b0072e40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f58a8007ee0 tx=0x7f58a800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.121+0000 7f589f7fe700 1 -- 172.21.15.151:0/2732424738 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a800ddd0 con 0x7f58b0101680 2023-07-21T22:19:00.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.121+0000 7f589f7fe700 1 -- 172.21.15.151:0/2732424738 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a800f040 con 0x7f58b0101680 2023-07-21T22:19:00.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.121+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b019fad0 con 0x7f58b0101680 2023-07-21T22:19:00.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.121+0000 7f589f7fe700 1 -- 172.21.15.151:0/2732424738 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a80047d0 con 0x7f58b0101680 2023-07-21T22:19:00.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.121+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b019ff90 con 0x7f58b0101680 2023-07-21T22:19:00.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.122+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58b010b1d0 con 0x7f58b0101680 2023-07-21T22:19:00.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.124+0000 7f589f7fe700 1 -- 172.21.15.151:0/2732424738 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f58a8003f20 con 0x7f58b0101680 2023-07-21T22:19:00.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.125+0000 7f589f7fe700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58980a11a0 0x7f58980a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.125+0000 7f589f7fe700 1 -- 172.21.15.151:0/2732424738 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f58a80cca50 con 0x7f58b0101680 2023-07-21T22:19:00.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.126+0000 7f58ae59c700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58980a11a0 0x7f58980a3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.126+0000 7f58ae59c700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58980a11a0 0x7f58980a3650 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f58a00098e0 tx=0x7f58a000b260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.127+0000 7f589f7fe700 1 -- 172.21.15.151:0/2732424738 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f58a8096170 con 0x7f58b0101680 2023-07-21T22:19:00.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.369+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58b0106a80 con 0x7f58b0101680 2023-07-21T22:19:00.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.370+0000 7f589f7fe700 1 -- 172.21.15.151:0/2732424738 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) v1 ==== 94+0+10816 (secure 0 0 0) 0x7f58a8023090 con 0x7f58b0101680 2023-07-21T22:19:00.415 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:00.415 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:17:15.194775+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:19:00.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58980a11a0 msgr2=0x7f58980a3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58980a11a0 0x7f58980a3650 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f58a00098e0 tx=0x7f58a000b260 comp rx=0 tx=0).stop 2023-07-21T22:19:00.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0101680 msgr2=0x7f58b0072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0101680 0x7f58b0072e40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f58a8007ee0 tx=0x7f58a800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 shutdown_connections 2023-07-21T22:19:00.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f58980a11a0 0x7f58980a3650 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b00ffb00 0x7f58b00742c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b0101680 0x7f58b0072e40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 --2- 172.21.15.151:0/2732424738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b0100cf0 0x7f58b0072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 >> 172.21.15.151:0/2732424738 conn(0x7f58b00fb0e0 msgr2=0x7f58b00fd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:00.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 shutdown_connections 2023-07-21T22:19:00.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.372+0000 7f58b49ff700 1 -- 172.21.15.151:0/2732424738 wait complete. 2023-07-21T22:19:00.420 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 23 2023-07-21T22:19:00.436 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T22:19:00.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:00 smithi187 ceph-mon[96918]: pgmap v355: 97 pgs: 97 active+clean; 642 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2023-07-21T22:19:00.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:00 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3558424401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:19:00.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:00 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1281749381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:19:00.636 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.592+0000 7f489fdff700 1 -- 172.21.15.151:0/121924581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 msgr2=0x7f48980fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.592+0000 7f489fdff700 1 --2- 172.21.15.151:0/121924581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 0x7f48980fff10 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f4894009990 tx=0x7f4894009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.592+0000 7f489fdff700 1 -- 172.21.15.151:0/121924581 shutdown_connections 2023-07-21T22:19:00.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.592+0000 7f489fdff700 1 --2- 172.21.15.151:0/121924581 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4898101680 0x7f4898107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.592+0000 7f489fdff700 1 --2- 172.21.15.151:0/121924581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 0x7f48980fff10 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.592+0000 7f489fdff700 1 --2- 172.21.15.151:0/121924581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4898100cf0 0x7f4898101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.637 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.592+0000 7f489fdff700 1 -- 172.21.15.151:0/121924581 >> 172.21.15.151:0/121924581 conn(0x7f48980fb0e0 msgr2=0x7f48980fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:00.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.592+0000 7f489fdff700 1 -- 172.21.15.151:0/121924581 shutdown_connections 2023-07-21T22:19:00.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.592+0000 7f489fdff700 1 -- 172.21.15.151:0/121924581 wait complete. 2023-07-21T22:19:00.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.593+0000 7f489fdff700 1 Processor -- start 2023-07-21T22:19:00.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.593+0000 7f489fdff700 1 -- start start 2023-07-21T22:19:00.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.593+0000 7f489fdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 0x7f4898197960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.593+0000 7f489fdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4898100cf0 0x7f4898197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.593+0000 7f489fdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4898101680 0x7f489819ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.593+0000 7f489fdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489819f4e0 con 0x7f48980ffb00 2023-07-21T22:19:00.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.593+0000 7f489fdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489819f620 con 0x7f4898100cf0 2023-07-21T22:19:00.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489fdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489819f7b0 con 0x7f4898101680 2023-07-21T22:19:00.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489db9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 0x7f4898197960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489db9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 0x7f4898197960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52320/0 (socket says 172.21.15.151:52320) 2023-07-21T22:19:00.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489db9b700 1 -- 172.21.15.151:0/3722158106 learned_addr learned my addr 172.21.15.151:0/3722158106 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:00.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489e39c700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4898101680 0x7f489819ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489d39a700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4898100cf0 0x7f4898197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489db9b700 1 -- 172.21.15.151:0/3722158106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4898101680 msgr2=0x7f489819ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489db9b700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4898101680 0x7f489819ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489db9b700 1 -- 172.21.15.151:0/3722158106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4898100cf0 msgr2=0x7f4898197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489db9b700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4898100cf0 0x7f4898197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489db9b700 1 -- 172.21.15.151:0/3722158106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940095f0 con 0x7f48980ffb00 2023-07-21T22:19:00.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.594+0000 7f489db9b700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 0x7f4898197960 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4894005910 tx=0x7f48940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.595+0000 7f488effd700 1 -- 172.21.15.151:0/3722158106 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489401d070 con 0x7f48980ffb00 2023-07-21T22:19:00.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.595+0000 7f488effd700 1 -- 172.21.15.151:0/3722158106 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4894022470 con 0x7f48980ffb00 2023-07-21T22:19:00.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.595+0000 7f488effd700 1 -- 172.21.15.151:0/3722158106 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400f6c0 con 0x7f48980ffb00 2023-07-21T22:19:00.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.595+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489819fa30 con 0x7f48980ffb00 2023-07-21T22:19:00.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.595+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489819fe00 con 0x7f48980ffb00 2023-07-21T22:19:00.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.596+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4898192090 con 0x7f48980ffb00 2023-07-21T22:19:00.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.598+0000 7f488effd700 1 -- 172.21.15.151:0/3722158106 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f48940225e0 con 0x7f48980ffb00 2023-07-21T22:19:00.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.599+0000 7f488effd700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f48840a12a0 0x7f48840a3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:00.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.599+0000 7f488effd700 1 -- 172.21.15.151:0/3722158106 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f48940ce6d0 con 0x7f48980ffb00 2023-07-21T22:19:00.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.599+0000 7f489d39a700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f48840a12a0 0x7f48840a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:00.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.600+0000 7f489d39a700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f48840a12a0 0x7f48840a3750 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4888009b30 tx=0x7f4888009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:00.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.601+0000 7f488effd700 1 -- 172.21.15.151:0/3722158106 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f4894097e80 con 0x7f48980ffb00 2023-07-21T22:19:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:00 smithi195 ceph-mon[97365]: pgmap v355: 97 pgs: 97 active+clean; 642 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2023-07-21T22:19:00.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:00 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3558424401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:19:00.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:00 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1281749381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:19:00.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:00 smithi151 ceph-mon[95510]: pgmap v355: 97 pgs: 97 active+clean; 642 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 938 B/s wr, 7 op/s 2023-07-21T22:19:00.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:00 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3558424401' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T22:19:00.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:00 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1281749381' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T22:19:00.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.800+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f489802c850 con 0x7f48980ffb00 2023-07-21T22:19:00.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.802+0000 7f488effd700 1 -- 172.21.15.151:0/3722158106 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+22579 (secure 0 0 0) 0x7f4894027090 con 0x7f48980ffb00 2023-07-21T22:19:00.847 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:00.848 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":87,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T22:17:44.291528+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T22:19:00.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.804+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f48840a12a0 msgr2=0x7f48840a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.804+0000 7f489fdff700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f48840a12a0 0x7f48840a3750 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f4888009b30 tx=0x7f4888009260 comp rx=0 tx=0).stop 2023-07-21T22:19:00.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.804+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 msgr2=0x7f4898197960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:00.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.804+0000 7f489fdff700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 0x7f4898197960 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f4894005910 tx=0x7f48940057f0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.805+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 shutdown_connections 2023-07-21T22:19:00.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.805+0000 7f489fdff700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f48840a12a0 0x7f48840a3750 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.805+0000 7f489fdff700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4898101680 0x7f489819ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.805+0000 7f489fdff700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48980ffb00 0x7f4898197960 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.805+0000 7f489fdff700 1 --2- 172.21.15.151:0/3722158106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4898100cf0 0x7f4898197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:00.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.805+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 >> 172.21.15.151:0/3722158106 conn(0x7f48980fb0e0 msgr2=0x7f48981065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:00.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.805+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 shutdown_connections 2023-07-21T22:19:00.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:00.805+0000 7f489fdff700 1 -- 172.21.15.151:0/3722158106 wait complete. 2023-07-21T22:19:00.868 DEBUG:tasks.fwd_scrub:Yielding 2023-07-21T22:19:00.869 INFO:teuthology.run_tasks:Running task exec... 2023-07-21T22:19:00.878 INFO:teuthology.task.exec:Executing custom commands... 2023-07-21T22:19:00.879 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T22:19:00.879 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2023-07-21T22:19:00.880 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2023-07-21T22:19:00.880 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-21T22:19:00.880 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-21T22:19:01.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.036+0000 7f207bdff700 1 -- 172.21.15.151:0/4019962308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f207410c0e0 msgr2=0x7f207410e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.036+0000 7f207bdff700 1 --2- 172.21.15.151:0/4019962308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f207410c0e0 0x7f207410e4c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f206c00b0a0 tx=0x7f206c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.036+0000 7f207bdff700 1 -- 172.21.15.151:0/4019962308 shutdown_connections 2023-07-21T22:19:01.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.036+0000 7f207bdff700 1 --2- 172.21.15.151:0/4019962308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2074074550 0x7f20740729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.036+0000 7f207bdff700 1 --2- 172.21.15.151:0/4019962308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f207410c0e0 0x7f207410e4c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.036+0000 7f207bdff700 1 --2- 172.21.15.151:0/4019962308 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2074072f70 0x7f20740733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.036+0000 7f207bdff700 1 -- 172.21.15.151:0/4019962308 >> 172.21.15.151:0/4019962308 conn(0x7f20740fb130 msgr2=0x7f20740fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.036+0000 7f207bdff700 1 -- 172.21.15.151:0/4019962308 shutdown_connections 2023-07-21T22:19:01.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.036+0000 7f207bdff700 1 -- 172.21.15.151:0/4019962308 wait complete. 2023-07-21T22:19:01.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.037+0000 7f207bdff700 1 Processor -- start 2023-07-21T22:19:01.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207bdff700 1 -- start start 2023-07-21T22:19:01.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207bdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2074072f70 0x7f207419bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207bdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2074074550 0x7f207419c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207bdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207410c0e0 0x7f207419d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207bdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207419d980 con 0x7f2074074550 2023-07-21T22:19:01.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207bdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207419daf0 con 0x7f2074072f70 2023-07-21T22:19:01.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207bdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207419dcb0 con 0x7f207410c0e0 2023-07-21T22:19:01.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207939a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2074074550 0x7f207419c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207939a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2074074550 0x7f207419c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52336/0 (socket says 172.21.15.151:52336) 2023-07-21T22:19:01.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207939a700 1 -- 172.21.15.151:0/1367025505 learned_addr learned my addr 172.21.15.151:0/1367025505 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f2079b9b700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2074072f70 0x7f207419bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.038+0000 7f207a39c700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207410c0e0 0x7f207419d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f207939a700 1 -- 172.21.15.151:0/1367025505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207410c0e0 msgr2=0x7f207419d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f207939a700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207410c0e0 0x7f207419d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f207939a700 1 -- 172.21.15.151:0/1367025505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2074072f70 msgr2=0x7f207419bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f207939a700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2074072f70 0x7f207419bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f207939a700 1 -- 172.21.15.151:0/1367025505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f206c009d00 con 0x7f2074074550 2023-07-21T22:19:01.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f2079b9b700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2074072f70 0x7f207419bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:01.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f207939a700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2074074550 0x7f207419c4a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f206400e970 tx=0x7f206400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f206affd700 1 -- 172.21.15.151:0/1367025505 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064009790 con 0x7f2074074550 2023-07-21T22:19:01.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f206affd700 1 -- 172.21.15.151:0/1367025505 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f20640044b0 con 0x7f2074074550 2023-07-21T22:19:01.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207419df90 con 0x7f2074074550 2023-07-21T22:19:01.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f206affd700 1 -- 172.21.15.151:0/1367025505 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2064003dd0 con 0x7f2074074550 2023-07-21T22:19:01.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.039+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20741a4750 con 0x7f2074074550 2023-07-21T22:19:01.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.041+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2074101c30 con 0x7f2074074550 2023-07-21T22:19:01.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.044+0000 7f206affd700 1 -- 172.21.15.151:0/1367025505 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2064004020 con 0x7f2074074550 2023-07-21T22:19:01.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.045+0000 7f206affd700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f20600a1150 0x7f20600a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.046+0000 7f206affd700 1 -- 172.21.15.151:0/1367025505 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f2064014070 con 0x7f2074074550 2023-07-21T22:19:01.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.046+0000 7f2079b9b700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f20600a1150 0x7f20600a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.046+0000 7f2079b9b700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f20600a1150 0x7f20600a3600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2074074920 tx=0x7f2070009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.050+0000 7f206affd700 1 -- 172.21.15.151:0/1367025505 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2064096390 con 0x7f2074074550 2023-07-21T22:19:01.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.051+0000 7f2cb75ff700 1 -- 172.21.15.151:0/2719325527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 msgr2=0x7f2cb0107c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.051+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/2719325527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 0x7f2cb0107c00 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800b0a0 tx=0x7f2ca800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.051+0000 7f2cb75ff700 1 -- 172.21.15.151:0/2719325527 shutdown_connections 2023-07-21T22:19:01.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.051+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/2719325527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cb01005c0 0x7f2cb01029a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.051+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/2719325527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 0x7f2cb0107c00 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.051+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/2719325527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb0102ee0 0x7f2cb01052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.051+0000 7f2cb75ff700 1 -- 172.21.15.151:0/2719325527 >> 172.21.15.151:0/2719325527 conn(0x7f2cb00fa000 msgr2=0x7f2cb00fc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.051+0000 7f2cb75ff700 1 -- 172.21.15.151:0/2719325527 shutdown_connections 2023-07-21T22:19:01.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.051+0000 7f2cb75ff700 1 -- 172.21.15.151:0/2719325527 wait complete. 2023-07-21T22:19:01.100 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.052+0000 7f2cb75ff700 1 Processor -- start 2023-07-21T22:19:01.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.052+0000 7f2cb75ff700 1 -- start start 2023-07-21T22:19:01.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb75ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb01005c0 0x7f2cb0195870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb75ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cb0102ee0 0x7f2cb0195db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb75ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 0x7f2cb019ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb75ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb019d3f0 con 0x7f2cb0105800 2023-07-21T22:19:01.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb75ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb019d530 con 0x7f2cb0102ee0 2023-07-21T22:19:01.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb75ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb019d6c0 con 0x7f2cb01005c0 2023-07-21T22:19:01.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb5b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 0x7f2cb019ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb539b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb01005c0 0x7f2cb0195870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb5b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 0x7f2cb019ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52352/0 (socket says 172.21.15.151:52352) 2023-07-21T22:19:01.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb539b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb01005c0 0x7f2cb0195870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50458/0 (socket says 172.21.15.151:50458) 2023-07-21T22:19:01.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb5b9c700 1 -- 172.21.15.151:0/1439576367 learned_addr learned my addr 172.21.15.151:0/1439576367 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cb0102ee0 0x7f2cb0195db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb5b9c700 1 -- 172.21.15.151:0/1439576367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb01005c0 msgr2=0x7f2cb0195870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb5b9c700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb01005c0 0x7f2cb0195870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb5b9c700 1 -- 172.21.15.151:0/1439576367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cb0102ee0 msgr2=0x7f2cb0195db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb5b9c700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cb0102ee0 0x7f2cb0195db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.053+0000 7f2cb5b9c700 1 -- 172.21.15.151:0/1439576367 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8009d00 con 0x7f2cb0105800 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.054+0000 7f2cb5b9c700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 0x7f2cb019ce20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800b070 tx=0x7f2ca8004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.054+0000 7f2ca67fc700 1 -- 172.21.15.151:0/1439576367 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca800e040 con 0x7f2cb0105800 2023-07-21T22:19:01.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.054+0000 7f2cb75ff700 1 -- 172.21.15.151:0/1439576367 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb019d940 con 0x7f2cb0105800 2023-07-21T22:19:01.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.054+0000 7f2ca67fc700 1 -- 172.21.15.151:0/1439576367 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ca8003e90 con 0x7f2cb0105800 2023-07-21T22:19:01.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.054+0000 7f2ca67fc700 1 -- 172.21.15.151:0/1439576367 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8004020 con 0x7f2cb0105800 2023-07-21T22:19:01.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.054+0000 7f2cb75ff700 1 -- 172.21.15.151:0/1439576367 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb019de10 con 0x7f2cb0105800 2023-07-21T22:19:01.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.057+0000 7f2ca67fc700 1 -- 172.21.15.151:0/1439576367 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f2ca8003a00 con 0x7f2cb0105800 2023-07-21T22:19:01.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ccae6bb80 1 Processor -- start 2023-07-21T22:19:01.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ccae6bb80 1 -- start start 2023-07-21T22:19:01.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ca67fc700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2c9c0a1150 0x7f2c9c0a3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3e8b0 0x565468e3ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3f220 0x565468e3d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e3df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468d42d30 con 0x565468e3f220 2023-07-21T22:19:01.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468d95ac0 con 0x565468e3e8b0 2023-07-21T22:19:01.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468d8ef50 con 0x565468e3da90 2023-07-21T22:19:01.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.059+0000 7f2ca67fc700 1 -- 172.21.15.151:0/1439576367 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f2ca80cdf20 con 0x7f2cb0105800 2023-07-21T22:19:01.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2c9c0a1150 0x7f2c9c0a3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb5b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e3df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb539b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3e8b0 0x565468e3ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb5b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e3df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50472/0 (socket says 172.21.15.151:50472) 2023-07-21T22:19:01.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb5b9c700 1 -- 172.21.15.151:0/485229050 learned_addr learned my addr 172.21.15.151:0/485229050 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/485229050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3f220 0x565468e3d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb5b9c700 1 -- 172.21.15.151:0/485229050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3e8b0 msgr2=0x565468e3ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb5b9c700 1 --2- 172.21.15.151:0/485229050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3e8b0 0x565468e3ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb5b9c700 1 -- 172.21.15.151:0/485229050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3f220 msgr2=0x565468e3d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb5b9c700 1 --2- 172.21.15.151:0/485229050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3f220 0x565468e3d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.060+0000 7f2cb5b9c700 1 -- 172.21.15.151:0/485229050 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565468bbce60 con 0x565468e3da90 2023-07-21T22:19:01.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.061+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2c9c0a1150 0x7f2c9c0a3600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000b6c0 tx=0x7f2ca000bbf0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.061+0000 7f2cb5b9c700 1 --2- 172.21.15.151:0/485229050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e3df10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ca809b090 tx=0x7f2ca80099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f819cbac6ab1f5fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.061+0000 7f2c9b7fe700 1 -- 172.21.15.151:0/485229050 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca809b160 con 0x565468e3da90 2023-07-21T22:19:01.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.061+0000 7f2c9b7fe700 1 -- 172.21.15.151:0/485229050 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ca809aed0 con 0x565468e3da90 2023-07-21T22:19:01.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.061+0000 7f2c9b7fe700 1 -- 172.21.15.151:0/485229050 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca8011620 con 0x565468e3da90 2023-07-21T22:19:01.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/485229050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 msgr2=0x565468e3df10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/485229050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e3df10 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2ca809b090 tx=0x7f2ca80099e0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/485229050 shutdown_connections 2023-07-21T22:19:01.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/485229050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3e8b0 0x565468e3ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/485229050 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e3df10 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/485229050 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3f220 0x565468e3d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/485229050 >> 172.21.15.151:0/485229050 conn(0x565468e32f70 msgr2=0x565468e383e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/485229050 shutdown_connections 2023-07-21T22:19:01.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/485229050 wait complete. 2023-07-21T22:19:01.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.062+0000 7f2ccae6bb80 1 -- start start 2023-07-21T22:19:01.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2ccae6bb80 1 Processor -- start 2023-07-21T22:19:01.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3da90 0x565468e4b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3e8b0 0x565468e4b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468d2eb40 con 0x565468e3da90 2023-07-21T22:19:01.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468d2e840 con 0x565468e3f220 2023-07-21T22:19:01.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468c129a0 con 0x565468e3e8b0 2023-07-21T22:19:01.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2ccae6bb80 10 client.0 _ll_register_callbacks cb 0x565468d2c7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:01.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2cb539b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3da90 0x565468e4b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2cb539b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3da90 0x565468e4b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52366/0 (socket says 172.21.15.151:52366) 2023-07-21T22:19:01.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.063+0000 7f2cb539b700 1 -- 172.21.15.151:0/2426673613 learned_addr learned my addr 172.21.15.151:0/2426673613 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3e8b0 0x565468e4b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2cb539b700 1 -- 172.21.15.151:0/2426673613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3e8b0 msgr2=0x565468e4b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2cb539b700 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3e8b0 0x565468e4b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2cb539b700 1 -- 172.21.15.151:0/2426673613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 msgr2=0x565468e528b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2cb539b700 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2cb539b700 1 -- 172.21.15.151:0/2426673613 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb019de10 con 0x565468e3da90 2023-07-21T22:19:01.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3e8b0 0x565468e4b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:01.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2cb539b700 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3da90 0x565468e4b330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00bb70 tx=0x7f2cac00bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c2d7313472ecf2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2c98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:19:01.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2c98ff9700 1 -- 172.21.15.151:0/2426673613 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cac016070 con 0x565468e3da90 2023-07-21T22:19:01.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2c98ff9700 1 -- 172.21.15.151:0/2426673613 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f2cac003d60 con 0x565468e3da90 2023-07-21T22:19:01.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/2426673613 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565468ce8570 con 0x565468e3da90 2023-07-21T22:19:01.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.064+0000 7f2c98ff9700 1 -- 172.21.15.151:0/2426673613 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2cac004830 con 0x565468e3da90 2023-07-21T22:19:01.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2ccae6bb80 10 client.15450 fetch_fsmap learned FSMap version 23 2023-07-21T22:19:01.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/2426673613 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x565468ba5ce0 con 0x565468e3da90 2023-07-21T22:19:01.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2c98ff9700 1 -- 172.21.15.151:0/2426673613 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565468ce8570 con 0x565468e3da90 2023-07-21T22:19:01.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2c98ff9700 1 -- 172.21.15.151:0/2426673613 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2cac0114d0 con 0x565468e3da90 2023-07-21T22:19:01.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2ccae6bb80 10 client.15450 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:19:01.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2ccae6bb80 10 client.15450 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:01.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2ccae6bb80 20 client.15450 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:01.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565468e57210 0x565468e59620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2ccae6bb80 4 client.15450 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:01.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.065+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/2426673613 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565468d87f30 con 0x565468e57210 2023-07-21T22:19:01.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.066+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565468e57210 0x565468e59620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.066+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565468e57210 0x565468e59620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=883083d2b17d2996 server_cookie=f22f1f3c1e9e85e6 in_seq=0 out_seq=0 2023-07-21T22:19:01.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.066+0000 7f2c98ff9700 10 client.15450 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:01.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2c98ff9700 1 -- 172.21.15.151:0/2426673613 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x565468d87f30 con 0x565468e57210 2023-07-21T22:19:01.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2c98ff9700 10 client.15450 handle_command_reply: tid=0 2023-07-21T22:19:01.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 client.15450 shutdown 2023-07-21T22:19:01.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/2426673613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3da90 msgr2=0x565468e4b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3da90 0x565468e4b330 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00bb70 tx=0x7f2cac00bf30 comp rx=0 tx=0).stop 2023-07-21T22:19:01.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/2426673613 shutdown_connections 2023-07-21T22:19:01.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565468e57210 0x565468e59620 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e528b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2c98ff9700 0 client.15450 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:01.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3da90 0x565468e4b330 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/2426673613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3e8b0 0x565468e4b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/2426673613 >> 172.21.15.151:0/2426673613 conn(0x565468e32f70 msgr2=0x565468e37a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.067+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/2426673613 shutdown_connections 2023-07-21T22:19:01.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.068+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/2426673613 wait complete. 2023-07-21T22:19:01.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.068+0000 7f2ccae6bb80 20 client.15450 trim_cache size 0 max 16384 2023-07-21T22:19:01.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.085+0000 7f2ccae6bb80 1 Processor -- start 2023-07-21T22:19:01.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.085+0000 7f2ccae6bb80 1 -- start start 2023-07-21T22:19:01.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.085+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e38190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.085+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e52870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.085+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e3c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.085+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468d87f30 con 0x565468e3e8b0 2023-07-21T22:19:01.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.085+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468ce8570 con 0x565468e3f220 2023-07-21T22:19:01.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.085+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468e39c50 con 0x565468e3da90 2023-07-21T22:19:01.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb4b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e52870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb4b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e52870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52378/0 (socket says 172.21.15.151:52378) 2023-07-21T22:19:01.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb4b9a700 1 -- 172.21.15.151:0/3374437875 learned_addr learned my addr 172.21.15.151:0/3374437875 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb539b700 1 --2- 172.21.15.151:0/3374437875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e38190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb5b9c700 1 --2- 172.21.15.151:0/3374437875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e3c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb4b9a700 1 -- 172.21.15.151:0/3374437875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 msgr2=0x565468e38190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/3374437875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e38190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb4b9a700 1 -- 172.21.15.151:0/3374437875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 msgr2=0x565468e3c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/3374437875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e3c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb4b9a700 1 -- 172.21.15.151:0/3374437875 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565468be32d0 con 0x565468e3e8b0 2023-07-21T22:19:01.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/3374437875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e52870 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x565468e59f50 tx=0x7f2ca00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a79e4fd479caa9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.086+0000 7f2c9bfff700 1 -- 172.21.15.151:0/3374437875 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca000b730 con 0x565468e3e8b0 2023-07-21T22:19:01.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.087+0000 7f2c9bfff700 1 -- 172.21.15.151:0/3374437875 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ca0027040 con 0x565468e3e8b0 2023-07-21T22:19:01.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.087+0000 7f2c9bfff700 1 -- 172.21.15.151:0/3374437875 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0029ad0 con 0x565468e3e8b0 2023-07-21T22:19:01.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.087+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/3374437875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 msgr2=0x565468e52870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.087+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/3374437875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e52870 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x565468e59f50 tx=0x7f2ca00047c0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.087+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/3374437875 shutdown_connections 2023-07-21T22:19:01.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.087+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/3374437875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e3c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.087+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/3374437875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e38190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.087+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/3374437875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e52870 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.087+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/3374437875 >> 172.21.15.151:0/3374437875 conn(0x565468e32f70 msgr2=0x565468e37a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.088+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/3374437875 shutdown_connections 2023-07-21T22:19:01.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.088+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/3374437875 wait complete. 2023-07-21T22:19:01.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.088+0000 7f2ccae6bb80 1 -- start start 2023-07-21T22:19:01.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.088+0000 7f2ccae6bb80 1 Processor -- start 2023-07-21T22:19:01.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e50130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e50670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2ccae6bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e51680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468e51bc0 con 0x565468e3e8b0 2023-07-21T22:19:01.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468e51d30 con 0x565468e3f220 2023-07-21T22:19:01.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2ccae6bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565468e51ef0 con 0x565468e3da90 2023-07-21T22:19:01.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2ccae6bb80 10 client.0 _ll_register_callbacks cb 0x7f2cac004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:01.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb4b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e50670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb4b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e50670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52380/0 (socket says 172.21.15.151:52380) 2023-07-21T22:19:01.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb4b9a700 1 -- 172.21.15.151:0/928611507 learned_addr learned my addr 172.21.15.151:0/928611507 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb539b700 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e50130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb5b9c700 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e51680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb4b9a700 1 -- 172.21.15.151:0/928611507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 msgr2=0x565468e50130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e50130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb4b9a700 1 -- 172.21.15.151:0/928611507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 msgr2=0x565468e51680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e51680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.089+0000 7f2cb4b9a700 1 -- 172.21.15.151:0/928611507 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca001a040 con 0x565468e3e8b0 2023-07-21T22:19:01.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.090+0000 7f2cb4b9a700 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e50670 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0010d70 tx=0x7f2ca000baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7699cbe9fbcf718a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.090+0000 7f2c98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:19:01.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.090+0000 7f2c98ff9700 1 -- 172.21.15.151:0/928611507 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0004540 con 0x565468e3e8b0 2023-07-21T22:19:01.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.090+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/928611507 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ca809aed0 con 0x565468e3e8b0 2023-07-21T22:19:01.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.090+0000 7f2c98ff9700 1 -- 172.21.15.151:0/928611507 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f2ca00294e0 con 0x565468e3e8b0 2023-07-21T22:19:01.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.090+0000 7f2c98ff9700 1 -- 172.21.15.151:0/928611507 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ca0029870 con 0x565468e3e8b0 2023-07-21T22:19:01.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.090+0000 7f2ccae6bb80 10 client.15456 fetch_fsmap learned FSMap version 23 2023-07-21T22:19:01.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.090+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/928611507 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x565468bbb330 con 0x565468e3e8b0 2023-07-21T22:19:01.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.091+0000 7f2c98ff9700 1 -- 172.21.15.151:0/928611507 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ca809aed0 con 0x565468e3e8b0 2023-07-21T22:19:01.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.091+0000 7f2c98ff9700 1 -- 172.21.15.151:0/928611507 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2ca0038020 con 0x565468e3e8b0 2023-07-21T22:19:01.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.091+0000 7f2ccae6bb80 10 client.15456 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:19:01.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.091+0000 7f2ccae6bb80 10 client.15456 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:01.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.091+0000 7f2ccae6bb80 20 client.15456 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:01.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.091+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565468eadac0 0x565468eafed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.091+0000 7f2ccae6bb80 4 client.15456 mds_command: new command op to 24599 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-21T22:19:01.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.091+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/928611507 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x565468d4a0d0 con 0x565468eadac0 2023-07-21T22:19:01.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.091+0000 7f2cb539b700 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565468eadac0 0x565468eafed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.092+0000 7f2cb539b700 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565468eadac0 0x565468eafed0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=298df05225021ba0 server_cookie=11c2de5fda1fbb9f in_seq=0 out_seq=0 2023-07-21T22:19:01.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.092+0000 7f2c98ff9700 10 client.15456 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:01.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2c98ff9700 1 -- 172.21.15.151:0/928611507 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x565468d4a0d0 con 0x565468eadac0 2023-07-21T22:19:01.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2c98ff9700 10 client.15456 handle_command_reply: tid=0 2023-07-21T22:19:01.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2ccae6bb80 1 client.15456 shutdown 2023-07-21T22:19:01.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/928611507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 msgr2=0x565468e50670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e50670 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f2ca0010d70 tx=0x7f2ca000baa0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/928611507 shutdown_connections 2023-07-21T22:19:01.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565468eadac0 0x565468eafed0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565468e3f220 0x565468e51680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565468e3da90 0x565468e50130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2ccae6bb80 1 --2- 172.21.15.151:0/928611507 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565468e3e8b0 0x565468e50670 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/928611507 >> 172.21.15.151:0/928611507 conn(0x565468e32f70 msgr2=0x565468e38310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.093+0000 7f2c98ff9700 0 client.15456 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:01.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/928611507 shutdown_connections 2023-07-21T22:19:01.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2ccae6bb80 1 -- 172.21.15.151:0/928611507 wait complete. 2023-07-21T22:19:01.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2ccae6bb80 20 client.15456 trim_cache size 0 max 16384 2023-07-21T22:19:01.156 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:19:01.156 INFO:teuthology.orchestra.run.smithi151.stdout: "return_code": 0, 2023-07-21T22:19:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_tag": "020ed9d1-7b9f-40c3-8e9f-fd23d51aff44", 2023-07-21T22:19:01.157 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": "asynchronous" 2023-07-21T22:19:01.157 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:19:01.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 -- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2c9c0a1150 msgr2=0x7f2c9c0a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2c9c0a1150 0x7f2c9c0a3600 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f2ca000b6c0 tx=0x7f2ca000bbf0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 -- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 msgr2=0x7f2cb019ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 0x7f2cb019ce20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f2ca800b070 tx=0x7f2ca8004c80 comp rx=0 tx=0).stop 2023-07-21T22:19:01.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 -- 172.21.15.151:0/1439576367 shutdown_connections 2023-07-21T22:19:01.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f2c9c0a1150 0x7f2c9c0a3600 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cb0105800 0x7f2cb019ce20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2cb01005c0 0x7f2cb0195870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 --2- 172.21.15.151:0/1439576367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2cb0102ee0 0x7f2cb0195db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.094+0000 7f2cb75ff700 1 -- 172.21.15.151:0/1439576367 >> 172.21.15.151:0/1439576367 conn(0x7f2cb00fa000 msgr2=0x7f2cb0101220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.095+0000 7f2cb75ff700 1 -- 172.21.15.151:0/1439576367 shutdown_connections 2023-07-21T22:19:01.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.095+0000 7f2cb75ff700 1 -- 172.21.15.151:0/1439576367 wait complete. 2023-07-21T22:19:01.160 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:19:01.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.326+0000 7f27803ff700 1 -- 172.21.15.151:0/1452084522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2778101670 msgr2=0x7f2778107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.326+0000 7f27803ff700 1 --2- 172.21.15.151:0/1452084522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2778101670 0x7f2778107f30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f277000b0a0 tx=0x7f277000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.326+0000 7f27803ff700 1 -- 172.21.15.151:0/1452084522 shutdown_connections 2023-07-21T22:19:01.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.326+0000 7f27803ff700 1 --2- 172.21.15.151:0/1452084522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2778101670 0x7f2778107f30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.326+0000 7f27803ff700 1 --2- 172.21.15.151:0/1452084522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f27780ffaf0 0x7f27780fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.326+0000 7f27803ff700 1 --2- 172.21.15.151:0/1452084522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778100ce0 0x7f2778101130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.326+0000 7f27803ff700 1 -- 172.21.15.151:0/1452084522 >> 172.21.15.151:0/1452084522 conn(0x7f27780fb130 msgr2=0x7f27780fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.326+0000 7f27803ff700 1 -- 172.21.15.151:0/1452084522 shutdown_connections 2023-07-21T22:19:01.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.326+0000 7f27803ff700 1 -- 172.21.15.151:0/1452084522 wait complete. 2023-07-21T22:19:01.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.327+0000 7f27803ff700 1 Processor -- start 2023-07-21T22:19:01.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.327+0000 7f27803ff700 1 -- start start 2023-07-21T22:19:01.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f27803ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27780ffaf0 0x7f2778197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f27803ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778100ce0 0x7f2778197fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f27803ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778101670 0x7f277819f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f27803ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277819f600 con 0x7f27780ffaf0 2023-07-21T22:19:01.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f27803ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277819f740 con 0x7f2778101670 2023-07-21T22:19:01.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f27803ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277819f8d0 con 0x7f2778100ce0 2023-07-21T22:19:01.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27780ffaf0 0x7f2778197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27780ffaf0 0x7f2778197a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52394/0 (socket says 172.21.15.151:52394) 2023-07-21T22:19:01.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e19b700 1 -- 172.21.15.151:0/3178286805 learned_addr learned my addr 172.21.15.151:0/3178286805 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277d99a700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778100ce0 0x7f2778197fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e99c700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778101670 0x7f277819f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e19b700 1 -- 172.21.15.151:0/3178286805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778100ce0 msgr2=0x7f2778197fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e19b700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778100ce0 0x7f2778197fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e19b700 1 -- 172.21.15.151:0/3178286805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778101670 msgr2=0x7f277819f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e19b700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778101670 0x7f277819f030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e19b700 1 -- 172.21.15.151:0/3178286805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770009d00 con 0x7f27780ffaf0 2023-07-21T22:19:01.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.328+0000 7f277e99c700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778101670 0x7f277819f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:01.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.329+0000 7f277e19b700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27780ffaf0 0x7f2778197a80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f277400d980 tx=0x7f277400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.329+0000 7f276f7fe700 1 -- 172.21.15.151:0/3178286805 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774004020 con 0x7f27780ffaf0 2023-07-21T22:19:01.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.329+0000 7f276f7fe700 1 -- 172.21.15.151:0/3178286805 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2774009730 con 0x7f27780ffaf0 2023-07-21T22:19:01.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.329+0000 7f276f7fe700 1 -- 172.21.15.151:0/3178286805 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774003a00 con 0x7f27780ffaf0 2023-07-21T22:19:01.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.329+0000 7f27803ff700 1 -- 172.21.15.151:0/3178286805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f277819fbb0 con 0x7f27780ffaf0 2023-07-21T22:19:01.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.329+0000 7f27803ff700 1 -- 172.21.15.151:0/3178286805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27781a0070 con 0x7f27780ffaf0 2023-07-21T22:19:01.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.334+0000 7f276f7fe700 1 -- 172.21.15.151:0/3178286805 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 18) v1 ==== 135716+0+0 (secure 0 0 0) 0x7f27740098a0 con 0x7f27780ffaf0 2023-07-21T22:19:01.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.335+0000 7f2793d04b80 1 Processor -- start 2023-07-21T22:19:01.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.335+0000 7f2793d04b80 1 -- start start 2023-07-21T22:19:01.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.335+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4a3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.335+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4a2430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.335+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.335+0000 7f2793d04b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce3a7cb0 con 0x5591ce4a41a0 2023-07-21T22:19:01.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.335+0000 7f2793d04b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce3faa40 con 0x5591ce4a2a10 2023-07-21T22:19:01.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.335+0000 7f2793d04b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce3f3ed0 con 0x5591ce4a3830 2023-07-21T22:19:01.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.335+0000 7f276f7fe700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f27640a11d0 0x7f27640a3680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f276f7fe700 1 -- 172.21.15.151:0/3178286805 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f27740cbff0 con 0x7f27780ffaf0 2023-07-21T22:19:01.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4a2430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4a2430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52408/0 (socket says 172.21.15.151:52408) 2023-07-21T22:19:01.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e19b700 1 -- 172.21.15.151:0/449192584 learned_addr learned my addr 172.21.15.151:0/449192584 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e99c700 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4a3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e99c700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f27640a11d0 0x7f27640a3680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277d99a700 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e19b700 1 -- 172.21.15.151:0/449192584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 msgr2=0x5591ce4a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e19b700 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4a3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e19b700 1 -- 172.21.15.151:0/449192584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 msgr2=0x5591ce4a2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e19b700 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e19b700 1 -- 172.21.15.151:0/449192584 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591ce221de0 con 0x5591ce4a41a0 2023-07-21T22:19:01.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277d99a700 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:01.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.336+0000 7f277e19b700 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4a2430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f277400d950 tx=0x7f27740992d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82042bdd37a915ca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.337+0000 7f276cbfe700 1 -- 172.21.15.151:0/449192584 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774009b80 con 0x5591ce4a41a0 2023-07-21T22:19:01.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.337+0000 7f277e99c700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f27640a11d0 0x7f27640a3680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f277000b070 tx=0x7f2770006000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.337+0000 7f276cbfe700 1 -- 172.21.15.151:0/449192584 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27740993d0 con 0x5591ce4a41a0 2023-07-21T22:19:01.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.337+0000 7f276cbfe700 1 -- 172.21.15.151:0/449192584 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27740c50c0 con 0x5591ce4a41a0 2023-07-21T22:19:01.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.337+0000 7f2793d04b80 1 -- 172.21.15.151:0/449192584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 msgr2=0x5591ce4a2430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.337+0000 7f2793d04b80 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4a2430 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f277400d950 tx=0x7f27740992d0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.337+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) v1 -- 0x7f207402ca60 con 0x7f2074074550 2023-07-21T22:19:01.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.338+0000 7f2793d04b80 1 -- 172.21.15.151:0/449192584 shutdown_connections 2023-07-21T22:19:01.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.338+0000 7f2793d04b80 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.338+0000 7f2793d04b80 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4a3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.338+0000 7f2793d04b80 1 --2- 172.21.15.151:0/449192584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4a2430 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.338+0000 7f2793d04b80 1 -- 172.21.15.151:0/449192584 >> 172.21.15.151:0/449192584 conn(0x5591ce497ef0 msgr2=0x5591ce49d360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.338+0000 7f2793d04b80 1 -- 172.21.15.151:0/449192584 shutdown_connections 2023-07-21T22:19:01.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.338+0000 7f2793d04b80 1 -- 172.21.15.151:0/449192584 wait complete. 2023-07-21T22:19:01.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.338+0000 7f2793d04b80 1 -- start start 2023-07-21T22:19:01.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.339+0000 7f2793d04b80 1 Processor -- start 2023-07-21T22:19:01.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.339+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4ac080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.339+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.390 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.339+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a41a0 0x5591ce4b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.339+0000 7f2793d04b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce393ac0 con 0x5591ce4a2a10 2023-07-21T22:19:01.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.339+0000 7f2793d04b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce3937c0 con 0x5591ce4a41a0 2023-07-21T22:19:01.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.339+0000 7f2793d04b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce277920 con 0x5591ce4a3830 2023-07-21T22:19:01.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.339+0000 7f2793d04b80 10 client.0 _ll_register_callbacks cb 0x5591ce391760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:01.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4ac080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4ac080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52410/0 (socket says 172.21.15.151:52410) 2023-07-21T22:19:01.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e19b700 1 -- 172.21.15.151:0/2969782879 learned_addr learned my addr 172.21.15.151:0/2969782879 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.391 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e99c700 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a41a0 0x5591ce4b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e19b700 1 -- 172.21.15.151:0/2969782879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 msgr2=0x5591ce4ac5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e19b700 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e19b700 1 -- 172.21.15.151:0/2969782879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a41a0 msgr2=0x5591ce4b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e19b700 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a41a0 0x5591ce4b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e19b700 1 -- 172.21.15.151:0/2969782879 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27781a0070 con 0x5591ce4a2a10 2023-07-21T22:19:01.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e99c700 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a41a0 0x5591ce4b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:01.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f277e19b700 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4ac080 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f27740a12f0 tx=0x7f27740cb000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525a5467074e75d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f2761ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:19:01.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f2761ffb700 1 -- 172.21.15.151:0/2969782879 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27740a1820 con 0x5591ce4a2a10 2023-07-21T22:19:01.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f2761ffb700 1 -- 172.21.15.151:0/2969782879 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f27740c52c0 con 0x5591ce4a2a10 2023-07-21T22:19:01.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.340+0000 7f2793d04b80 1 -- 172.21.15.151:0/2969782879 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5591ce34d4f0 con 0x5591ce4a2a10 2023-07-21T22:19:01.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2761ffb700 1 -- 172.21.15.151:0/2969782879 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2774099630 con 0x5591ce4a2a10 2023-07-21T22:19:01.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2793d04b80 10 client.15468 fetch_fsmap learned FSMap version 23 2023-07-21T22:19:01.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2793d04b80 1 -- 172.21.15.151:0/2969782879 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5591ce20ac60 con 0x5591ce4a2a10 2023-07-21T22:19:01.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2761ffb700 1 -- 172.21.15.151:0/2969782879 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5591ce34d4f0 con 0x5591ce4a2a10 2023-07-21T22:19:01.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2761ffb700 1 -- 172.21.15.151:0/2969782879 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f27740b1020 con 0x5591ce4a2a10 2023-07-21T22:19:01.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2793d04b80 10 client.15468 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:19:01.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2793d04b80 10 client.15468 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:01.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2793d04b80 20 client.15468 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:01.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2793d04b80 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5591ce4b7ae0 0x5591ce4b9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2793d04b80 4 client.15468 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:01.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.341+0000 7f2793d04b80 1 -- 172.21.15.151:0/2969782879 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5591ce3eceb0 con 0x5591ce4b7ae0 2023-07-21T22:19:01.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.342+0000 7f277d99a700 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5591ce4b7ae0 0x5591ce4b9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.342+0000 7f2761ffb700 10 client.15468 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:01.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.342+0000 7f277d99a700 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5591ce4b7ae0 0x5591ce4b9ef0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fc20fb2fc239228 server_cookie=6ffe7927978ff70a in_seq=0 out_seq=0 2023-07-21T22:19:01.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2761ffb700 1 -- 172.21.15.151:0/2969782879 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5591ce3eceb0 con 0x5591ce4b7ae0 2023-07-21T22:19:01.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2761ffb700 10 client.15468 handle_command_reply: tid=0 2023-07-21T22:19:01.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 client.15468 shutdown 2023-07-21T22:19:01.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 -- 172.21.15.151:0/2969782879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 msgr2=0x5591ce4ac080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4ac080 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f27740a12f0 tx=0x7f27740cb000 comp rx=0 tx=0).stop 2023-07-21T22:19:01.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 -- 172.21.15.151:0/2969782879 shutdown_connections 2023-07-21T22:19:01.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5591ce4b7ae0 0x5591ce4b9ef0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a41a0 0x5591ce4b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4ac080 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2761ffb700 0 client.15468 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:01.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 --2- 172.21.15.151:0/2969782879 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4ac5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 -- 172.21.15.151:0/2969782879 >> 172.21.15.151:0/2969782879 conn(0x5591ce497ef0 msgr2=0x5591ce49ca00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 -- 172.21.15.151:0/2969782879 shutdown_connections 2023-07-21T22:19:01.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.343+0000 7f2793d04b80 1 -- 172.21.15.151:0/2969782879 wait complete. 2023-07-21T22:19:01.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.344+0000 7f2793d04b80 20 client.15468 trim_cache size 0 max 16384 2023-07-21T22:19:01.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f2793d04b80 1 Processor -- start 2023-07-21T22:19:01.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f2793d04b80 1 -- start start 2023-07-21T22:19:01.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a3830 0x5591ce4b35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a41a0 0x5591ce4b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f2793d04b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce34d4f0 con 0x5591ce4a2a10 2023-07-21T22:19:01.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f2793d04b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce49a030 con 0x5591ce4a3830 2023-07-21T22:19:01.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f2793d04b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce4ab530 con 0x5591ce4a41a0 2023-07-21T22:19:01.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f277e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f277e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52422/0 (socket says 172.21.15.151:52422) 2023-07-21T22:19:01.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f277e19b700 1 -- 172.21.15.151:0/1293765371 learned_addr learned my addr 172.21.15.151:0/1293765371 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f277e99c700 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a41a0 0x5591ce4b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f277d99a700 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a3830 0x5591ce4b35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f277e19b700 1 -- 172.21.15.151:0/1293765371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a41a0 msgr2=0x5591ce4b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.361+0000 7f277e19b700 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a41a0 0x5591ce4b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f277e19b700 1 -- 172.21.15.151:0/1293765371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a3830 msgr2=0x5591ce4b35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f277e19b700 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a3830 0x5591ce4b35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f277e19b700 1 -- 172.21.15.151:0/1293765371 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5591ce248250 con 0x5591ce4a2a10 2023-07-21T22:19:01.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f277d99a700 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a3830 0x5591ce4b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:01.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f277e19b700 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2de0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2774095880 tx=0x7f27740992d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af1877942266e0a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f276d3ff700 1 -- 172.21.15.151:0/1293765371 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27740a1390 con 0x5591ce4a2a10 2023-07-21T22:19:01.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f276d3ff700 1 -- 172.21.15.151:0/1293765371 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27740a15d0 con 0x5591ce4a2a10 2023-07-21T22:19:01.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f276d3ff700 1 -- 172.21.15.151:0/1293765371 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774099630 con 0x5591ce4a2a10 2023-07-21T22:19:01.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f2793d04b80 1 -- 172.21.15.151:0/1293765371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 msgr2=0x5591ce4a2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.362+0000 7f2793d04b80 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2de0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2774095880 tx=0x7f27740992d0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.363+0000 7f2793d04b80 1 -- 172.21.15.151:0/1293765371 shutdown_connections 2023-07-21T22:19:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.363+0000 7f2793d04b80 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a41a0 0x5591ce4b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.363+0000 7f2793d04b80 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a2a10 0x5591ce4a2de0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.363+0000 7f2793d04b80 1 --2- 172.21.15.151:0/1293765371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a3830 0x5591ce4b35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.363+0000 7f2793d04b80 1 -- 172.21.15.151:0/1293765371 >> 172.21.15.151:0/1293765371 conn(0x5591ce497ef0 msgr2=0x5591ce4aad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.363+0000 7f2793d04b80 1 -- 172.21.15.151:0/1293765371 shutdown_connections 2023-07-21T22:19:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.363+0000 7f2793d04b80 1 -- 172.21.15.151:0/1293765371 wait complete. 2023-07-21T22:19:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.363+0000 7f2793d04b80 1 -- start start 2023-07-21T22:19:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.363+0000 7f2793d04b80 1 Processor -- start 2023-07-21T22:19:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 0x5591ce4af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4afd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f2793d04b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4b2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f2793d04b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce4b3180 con 0x5591ce4a41a0 2023-07-21T22:19:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f2793d04b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce4b32f0 con 0x5591ce4a2a10 2023-07-21T22:19:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f2793d04b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5591ce4b34b0 con 0x5591ce4a3830 2023-07-21T22:19:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f2793d04b80 10 client.0 _ll_register_callbacks cb 0x7f277000b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277e99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4b2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277e99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4b2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52434/0 (socket says 172.21.15.151:52434) 2023-07-21T22:19:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277d99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277e99c700 1 -- 172.21.15.151:0/3099202187 learned_addr learned my addr 172.21.15.151:0/3099202187 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:01.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277e19b700 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 0x5591ce4af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277e99c700 1 -- 172.21.15.151:0/3099202187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 msgr2=0x5591ce4afd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277e99c700 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4afd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277e99c700 1 -- 172.21.15.151:0/3099202187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 msgr2=0x5591ce4af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:01.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277e99c700 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 0x5591ce4af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277e99c700 1 -- 172.21.15.151:0/3099202187 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5591ce20ac60 con 0x5591ce4a41a0 2023-07-21T22:19:01.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.364+0000 7f277d99a700 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:01.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.365+0000 7f277e99c700 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4b2c40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2770015000 tx=0x7f277000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=625e4f62b1e4071e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:01.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.365+0000 7f2761ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:19:01.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.365+0000 7f2761ffb700 1 -- 172.21.15.151:0/3099202187 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277000e040 con 0x5591ce4a41a0 2023-07-21T22:19:01.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.365+0000 7f2793d04b80 1 -- 172.21.15.151:0/3099202187 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f27740993d0 con 0x5591ce4a41a0 2023-07-21T22:19:01.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.365+0000 7f2761ffb700 1 -- 172.21.15.151:0/3099202187 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f277001e870 con 0x5591ce4a41a0 2023-07-21T22:19:01.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.365+0000 7f2761ffb700 1 -- 172.21.15.151:0/3099202187 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f277001ea30 con 0x5591ce4a41a0 2023-07-21T22:19:01.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.365+0000 7f2793d04b80 10 client.15474 fetch_fsmap learned FSMap version 23 2023-07-21T22:19:01.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.365+0000 7f2793d04b80 1 -- 172.21.15.151:0/3099202187 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) v3 -- 0x5591ce2202b0 con 0x5591ce4a41a0 2023-07-21T22:19:01.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.365+0000 7f2761ffb700 1 -- 172.21.15.151:0/3099202187 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f27740993d0 con 0x5591ce4a41a0 2023-07-21T22:19:01.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f2761ffb700 1 -- 172.21.15.151:0/3099202187 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 23) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f277002ac50 con 0x5591ce4a41a0 2023-07-21T22:19:01.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f2793d04b80 10 client.15474 fetch_fsmap finished waiting for FSMap version 23 2023-07-21T22:19:01.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f2793d04b80 10 client.15474 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:01.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f2793d04b80 20 client.15474 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:01.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f2793d04b80 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5591ce50cd00 0x5591ce50f110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:01.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f2793d04b80 4 client.15474 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:19:01.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f2793d04b80 1 -- 172.21.15.151:0/3099202187 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5591ce3af050 con 0x5591ce50cd00 2023-07-21T22:19:01.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f277e19b700 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5591ce50cd00 0x5591ce50f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:01.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f277e19b700 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5591ce50cd00 0x5591ce50f110 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80bf85123876fccf server_cookie=59c27c8477f12e78 in_seq=0 out_seq=0 2023-07-21T22:19:01.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.366+0000 7f2761ffb700 10 client.15474 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:01.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2761ffb700 1 -- 172.21.15.151:0/3099202187 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x5591ce3af050 con 0x5591ce50cd00 2023-07-21T22:19:01.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2761ffb700 10 client.15474 handle_command_reply: tid=0 2023-07-21T22:19:01.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 client.15474 shutdown 2023-07-21T22:19:01.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 -- 172.21.15.151:0/3099202187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 msgr2=0x5591ce4b2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4b2c40 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2770015000 tx=0x7f277000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 -- 172.21.15.151:0/3099202187 shutdown_connections 2023-07-21T22:19:01.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5591ce50cd00 0x5591ce50f110 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5591ce4a2a10 0x5591ce4af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5591ce4a41a0 0x5591ce4b2c40 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 --2- 172.21.15.151:0/3099202187 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5591ce4a3830 0x5591ce4afd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2761ffb700 0 client.15474 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:01.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 -- 172.21.15.151:0/3099202187 >> 172.21.15.151:0/3099202187 conn(0x5591ce497ef0 msgr2=0x5591ce4a2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 -- 172.21.15.151:0/3099202187 shutdown_connections 2023-07-21T22:19:01.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 1 -- 172.21.15.151:0/3099202187 wait complete. 2023-07-21T22:19:01.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.367+0000 7f2793d04b80 20 client.15474 trim_cache size 0 max 16384 2023-07-21T22:19:01.421 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:19:01.421 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:19:01.422 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:19:01.422 INFO:teuthology.orchestra.run.smithi151.stdout: "020ed9d1-7b9f-40c3-8e9f-fd23d51aff44": { 2023-07-21T22:19:01.422 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:19:01.422 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "020ed9d1-7b9f-40c3-8e9f-fd23d51aff44", 2023-07-21T22:19:01.422 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:19:01.422 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:19:01.422 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:19:01.423 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:19:01.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 -- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f27640a11d0 msgr2=0x7f27640a3680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f27640a11d0 0x7f27640a3680 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f277000b070 tx=0x7f2770006000 comp rx=0 tx=0).stop 2023-07-21T22:19:01.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 -- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27780ffaf0 msgr2=0x7f2778197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:01.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27780ffaf0 0x7f2778197a80 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f277400d980 tx=0x7f277400dc90 comp rx=0 tx=0).stop 2023-07-21T22:19:01.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 -- 172.21.15.151:0/3178286805 shutdown_connections 2023-07-21T22:19:01.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f27640a11d0 0x7f27640a3680 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2778101670 0x7f277819f030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f27780ffaf0 0x7f2778197a80 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 --2- 172.21.15.151:0/3178286805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2778100ce0 0x7f2778197fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:01.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 -- 172.21.15.151:0/3178286805 >> 172.21.15.151:0/3178286805 conn(0x7f27780fb130 msgr2=0x7f27781065c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:01.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 -- 172.21.15.151:0/3178286805 shutdown_connections 2023-07-21T22:19:01.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:01.368+0000 7f27803ff700 1 -- 172.21.15.151:0/3178286805 wait complete. 2023-07-21T22:19:01.428 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:01 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2732424738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:19:01.428 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:01 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3722158106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:19:01.430 INFO:tasks.cephfs.filesystem:scrub status for tag:020ed9d1-7b9f-40c3-8e9f-fd23d51aff44 - {'path': '/', 'tag': '020ed9d1-7b9f-40c3-8e9f-fd23d51aff44', 'options': 'recursive,force'} 2023-07-21T22:19:01.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:01 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2732424738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:19:01.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:01 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3722158106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:19:01.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:01 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2732424738' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:19:01.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:01 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3722158106' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T22:19:02.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.323+0000 7f206affd700 1 -- 172.21.15.151:0/1367025505 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 19) v1 ==== 135733+0+0 (secure 0 0 0) 0x7f2064096760 con 0x7f2074074550 2023-07-21T22:19:02.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.324+0000 7f206affd700 1 -- 172.21.15.151:0/1367025505 <== mon.0 v2:172.21.15.151:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) v1 ==== 92+0+0 (secure 0 0 0) 0x7f2064085810 con 0x7f2074074550 2023-07-21T22:19:02.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f20600a1150 msgr2=0x7f20600a3600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f20600a1150 0x7f20600a3600 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f2074074920 tx=0x7f2070009260 comp rx=0 tx=0).stop 2023-07-21T22:19:02.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2074074550 msgr2=0x7f207419c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2074074550 0x7f207419c4a0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f206400e970 tx=0x7f206400ed30 comp rx=0 tx=0).stop 2023-07-21T22:19:02.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 shutdown_connections 2023-07-21T22:19:02.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f20600a1150 0x7f20600a3600 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2074072f70 0x7f207419bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f207410c0e0 0x7f207419d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 --2- 172.21.15.151:0/1367025505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2074074550 0x7f207419c4a0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.326+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 >> 172.21.15.151:0/1367025505 conn(0x7f20740fb130 msgr2=0x7f20740fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:02.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.327+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 shutdown_connections 2023-07-21T22:19:02.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.327+0000 7f207bdff700 1 -- 172.21.15.151:0/1367025505 wait complete. 2023-07-21T22:19:02.391 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2023-07-21T22:19:02.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.555+0000 7f14fedff700 1 -- 172.21.15.151:0/4249070316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8068640 msgr2=0x7f14f8102690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.555+0000 7f14fedff700 1 --2- 172.21.15.151:0/4249070316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8068640 0x7f14f8102690 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f14ec009990 tx=0x7f14ec009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.555+0000 7f14fedff700 1 -- 172.21.15.151:0/4249070316 shutdown_connections 2023-07-21T22:19:02.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.555+0000 7f14fedff700 1 --2- 172.21.15.151:0/4249070316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14f81056e0 0x7f14f8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.555+0000 7f14fedff700 1 --2- 172.21.15.151:0/4249070316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8068640 0x7f14f8102690 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.555+0000 7f14fedff700 1 --2- 172.21.15.151:0/4249070316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14f8102bd0 0x7f14f8105050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.555+0000 7f14fedff700 1 -- 172.21.15.151:0/4249070316 >> 172.21.15.151:0/4249070316 conn(0x7f14f80fa000 msgr2=0x7f14f80fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:02.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.556+0000 7f14fedff700 1 -- 172.21.15.151:0/4249070316 shutdown_connections 2023-07-21T22:19:02.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.556+0000 7f14fedff700 1 -- 172.21.15.151:0/4249070316 wait complete. 2023-07-21T22:19:02.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14fedff700 1 Processor -- start 2023-07-21T22:19:02.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14fedff700 1 -- start start 2023-07-21T22:19:02.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14fedff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14f8068640 0x7f14f80fe630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14fedff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8102bd0 0x7f14f80feb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14fedff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14f81056e0 0x7f14f80ff0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14fedff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f819f830 con 0x7f14f8102bd0 2023-07-21T22:19:02.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14fedff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f819f970 con 0x7f14f8068640 2023-07-21T22:19:02.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14fedff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f819fab0 con 0x7f14f81056e0 2023-07-21T22:19:02.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8102bd0 0x7f14f80feb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.557+0000 7f14fcb9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14f8068640 0x7f14f80fe630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14fcb9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14f8068640 0x7f14f80fe630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:47392/0 (socket says 172.21.15.151:47392) 2023-07-21T22:19:02.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8102bd0 0x7f14f80feb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52448/0 (socket says 172.21.15.151:52448) 2023-07-21T22:19:02.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14fcb9b700 1 -- 172.21.15.151:0/3938193670 learned_addr learned my addr 172.21.15.151:0/3938193670 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:02.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14fd39c700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14f81056e0 0x7f14f80ff0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:02.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14f7fff700 1 -- 172.21.15.151:0/3938193670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14f81056e0 msgr2=0x7f14f80ff0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14f7fff700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14f81056e0 0x7f14f80ff0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14f7fff700 1 -- 172.21.15.151:0/3938193670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14f8068640 msgr2=0x7f14f80fe630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14f7fff700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14f8068640 0x7f14f80fe630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14f7fff700 1 -- 172.21.15.151:0/3938193670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec0095f0 con 0x7f14f8102bd0 2023-07-21T22:19:02.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14fcb9b700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14f8068640 0x7f14f80fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:02.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14f7fff700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8102bd0 0x7f14f80feb70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f14e400e9f0 tx=0x7f14e400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:02.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14f5ffb700 1 -- 172.21.15.151:0/3938193670 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400c9c0 con 0x7f14f8102bd0 2023-07-21T22:19:02.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14f5ffb700 1 -- 172.21.15.151:0/3938193670 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f14e4010430 con 0x7f14f8102bd0 2023-07-21T22:19:02.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.558+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f819fd40 con 0x7f14f8102bd0 2023-07-21T22:19:02.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.559+0000 7f14f5ffb700 1 -- 172.21.15.151:0/3938193670 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e4018680 con 0x7f14f8102bd0 2023-07-21T22:19:02.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.559+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f81a01f0 con 0x7f14f8102bd0 2023-07-21T22:19:02.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.560+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14f804e2f0 con 0x7f14f8102bd0 2023-07-21T22:19:02.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.562+0000 7f14f5ffb700 1 -- 172.21.15.151:0/3938193670 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 19) v1 ==== 135733+0+0 (secure 0 0 0) 0x7f14e40105a0 con 0x7f14f8102bd0 2023-07-21T22:19:02.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.564+0000 7f14f5ffb700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f14e80a11a0 0x7f14e80a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:02.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.564+0000 7f14fcb9b700 1 -- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f14e80a11a0 msgr2=0x7f14e80a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:02.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.564+0000 7f14f5ffb700 1 -- 172.21.15.151:0/3938193670 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f14e4014070 con 0x7f14f8102bd0 2023-07-21T22:19:02.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.564+0000 7f14fcb9b700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f14e80a11a0 0x7f14e80a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:19:02.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.568+0000 7f14f5ffb700 1 -- 172.21.15.151:0/3938193670 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f14e4096180 con 0x7f14f8102bd0 2023-07-21T22:19:02.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-mon[96918]: pgmap v356: 97 pgs: 97 active+clean; 642 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2023-07-21T22:19:02.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-mon[96918]: scrub queued for path: / 2023-07-21T22:19:02.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:02.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:19:02.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:02.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1367025505' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-07-21T22:19:02.629 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: ignoring --setuser ceph since I am not root 2023-07-21T22:19:02.630 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: ignoring --setgroup ceph since I am not root 2023-07-21T22:19:02.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-mon[97365]: pgmap v356: 97 pgs: 97 active+clean; 642 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2023-07-21T22:19:02.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-mon[97365]: scrub queued for path: / 2023-07-21T22:19:02.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:02.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:19:02.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:02.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1367025505' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-07-21T22:19:02.645 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: ignoring --setuser ceph since I am not root 2023-07-21T22:19:02.646 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: ignoring --setgroup ceph since I am not root 2023-07-21T22:19:02.646 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-mgr[99744]: -- 172.21.15.195:0/2897868810 <== mon.0 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55c7d068f1e0 con 0x55c7d0665000 2023-07-21T22:19:02.646 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:02.599+0000 7f316f477200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:19:02.646 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-mon[95510]: pgmap v356: 97 pgs: 97 active+clean; 642 KiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 938 B/s wr, 6 op/s 2023-07-21T22:19:02.646 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-mon[95510]: scrub queued for path: / 2023-07-21T22:19:02.647 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:02.647 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:19:02.647 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:02.647 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1367025505' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2023-07-21T22:19:02.647 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: ignoring --setuser ceph since I am not root 2023-07-21T22:19:02.647 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: ignoring --setgroup ceph since I am not root 2023-07-21T22:19:02.648 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:02.599+0000 7fee978d3200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:19:02.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.765+0000 7f14fcb9b700 1 -- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f14e80a11a0 msgr2=0x7f14e80a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:02.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.765+0000 7f14fcb9b700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f14e80a11a0 0x7f14e80a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:19:02.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.774+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) v1 -- 0x7f14f81a03e0 con 0x7f14f8102bd0 2023-07-21T22:19:02.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.782+0000 7f14f5ffb700 1 -- 172.21.15.151:0/3938193670 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v23)=0 v23) v1 ==== 138+0+0 (secure 0 0 0) 0x7f14e40997a0 con 0x7f14f8102bd0 2023-07-21T22:19:02.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f14e80a11a0 msgr2=0x7f14e80a3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:19:02.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f14e80a11a0 0x7f14e80a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8102bd0 msgr2=0x7f14f80feb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:02.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8102bd0 0x7f14f80feb70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f14e400e9f0 tx=0x7f14e400ed00 comp rx=0 tx=0).stop 2023-07-21T22:19:02.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 shutdown_connections 2023-07-21T22:19:02.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f14e80a11a0 0x7f14e80a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14f8068640 0x7f14f80fe630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f14f81056e0 0x7f14f80ff0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 --2- 172.21.15.151:0/3938193670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14f8102bd0 0x7f14f80feb70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:02.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 >> 172.21.15.151:0/3938193670 conn(0x7f14f80fa000 msgr2=0x7f14f81016f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:02.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 shutdown_connections 2023-07-21T22:19:02.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:02.785+0000 7f14fedff700 1 -- 172.21.15.151:0/3938193670 wait complete. 2023-07-21T22:19:02.851 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2023-07-21T22:19:02.906 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:02.702+0000 7f316f477200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:19:02.907 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:02.818+0000 7f316f477200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:19:02.912 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:02.708+0000 7fee978d3200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:19:02.913 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:02.833+0000 7fee978d3200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:19:02.978 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:02.596+0000 7f7a4263c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-07-21T22:19:02.978 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:02.700+0000 7f7a4263c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-07-21T22:19:02.978 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:02.815+0000 7f7a4263c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-07-21T22:19:03.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.006+0000 7f898a9ff700 1 -- 172.21.15.151:0/3772130875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f898410c0e0 msgr2=0x7f898410e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.006+0000 7f898a9ff700 1 --2- 172.21.15.151:0/3772130875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f898410c0e0 0x7f898410e4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f897c009f90 tx=0x7f897c00b330 comp rx=0 tx=0).stop 2023-07-21T22:19:03.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.006+0000 7f898a9ff700 1 -- 172.21.15.151:0/3772130875 shutdown_connections 2023-07-21T22:19:03.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.006+0000 7f898a9ff700 1 --2- 172.21.15.151:0/3772130875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8984074550 0x7f89840729a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.006+0000 7f898a9ff700 1 --2- 172.21.15.151:0/3772130875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f898410c0e0 0x7f898410e4c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.006+0000 7f898a9ff700 1 --2- 172.21.15.151:0/3772130875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8984072f70 0x7f89840733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.006+0000 7f898a9ff700 1 -- 172.21.15.151:0/3772130875 >> 172.21.15.151:0/3772130875 conn(0x7f89840fb130 msgr2=0x7f89840fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:03.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.006+0000 7f898a9ff700 1 -- 172.21.15.151:0/3772130875 shutdown_connections 2023-07-21T22:19:03.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.006+0000 7f898a9ff700 1 -- 172.21.15.151:0/3772130875 wait complete. 2023-07-21T22:19:03.053 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.007+0000 7f898a9ff700 1 Processor -- start 2023-07-21T22:19:03.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.007+0000 7f898a9ff700 1 -- start start 2023-07-21T22:19:03.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f898a9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8984072f70 0x7f898419bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f898a9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8984074550 0x7f898419c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f898a9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f898410c0e0 0x7f898419d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f898a9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898419d9d0 con 0x7f8984074550 2023-07-21T22:19:03.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f898a9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898419db40 con 0x7f898410c0e0 2023-07-21T22:19:03.054 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f898a9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f898419dd00 con 0x7f8984072f70 2023-07-21T22:19:03.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f89837fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8984074550 0x7f898419c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f8983fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8984072f70 0x7f898419bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f8983fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8984072f70 0x7f898419bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50582/0 (socket says 172.21.15.151:50582) 2023-07-21T22:19:03.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f8983fff700 1 -- 172.21.15.151:0/2311814370 learned_addr learned my addr 172.21.15.151:0/2311814370 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:03.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f8988f9c700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f898410c0e0 0x7f898419d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f8983fff700 1 -- 172.21.15.151:0/2311814370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f898410c0e0 msgr2=0x7f898419d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f8983fff700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f898410c0e0 0x7f898419d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f8983fff700 1 -- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8984074550 msgr2=0x7f898419c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f8983fff700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8984074550 0x7f898419c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f8983fff700 1 -- 172.21.15.151:0/2311814370 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89780095f0 con 0x7f8984072f70 2023-07-21T22:19:03.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.008+0000 7f89837fe700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8984074550 0x7f898419c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:03.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.009+0000 7f8983fff700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8984072f70 0x7f898419bfb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f897400e970 tx=0x7f897400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.009+0000 7f89817fa700 1 -- 172.21.15.151:0/2311814370 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974009790 con 0x7f8984072f70 2023-07-21T22:19:03.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.009+0000 7f89817fa700 1 -- 172.21.15.151:0/2311814370 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f897400c7e0 con 0x7f8984072f70 2023-07-21T22:19:03.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.009+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f897c009c40 con 0x7f8984072f70 2023-07-21T22:19:03.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.009+0000 7f89817fa700 1 -- 172.21.15.151:0/2311814370 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8974005440 con 0x7f8984072f70 2023-07-21T22:19:03.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.009+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89841a45c0 con 0x7f8984072f70 2023-07-21T22:19:03.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.010+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8984101c30 con 0x7f8984072f70 2023-07-21T22:19:03.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.012+0000 7f89817fa700 1 -- 172.21.15.151:0/2311814370 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 19) v1 ==== 135733+0+0 (secure 0 0 0) 0x7f897400c950 con 0x7f8984072f70 2023-07-21T22:19:03.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.013+0000 7f89817fa700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f896c0a11a0 0x7f896c0a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.013+0000 7f89837fe700 1 -- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f896c0a11a0 msgr2=0x7f896c0a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:03.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.013+0000 7f89817fa700 1 -- 172.21.15.151:0/2311814370 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8974014070 con 0x7f8984072f70 2023-07-21T22:19:03.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.013+0000 7f89837fe700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f896c0a11a0 0x7f896c0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:19:03.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.017+0000 7f89817fa700 1 -- 172.21.15.151:0/2311814370 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8974096290 con 0x7f8984072f70 2023-07-21T22:19:03.199 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:02.959+0000 7fee978d3200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:19:03.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.214+0000 7f89837fe700 1 -- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f896c0a11a0 msgr2=0x7f896c0a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:03.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.214+0000 7f89837fe700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f896c0a11a0 0x7f896c0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:19:03.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.223+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) v1 -- 0x7f898402cb00 con 0x7f8984072f70 2023-07-21T22:19:03.274 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.230+0000 7f89817fa700 1 -- 172.21.15.151:0/2311814370 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v24)=0 v24) v1 ==== 133+0+0 (secure 0 0 0) 0x7f89740998b0 con 0x7f8984072f70 2023-07-21T22:19:03.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.232+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f896c0a11a0 msgr2=0x7f896c0a3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:19:03.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.232+0000 7f898a9ff700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f896c0a11a0 0x7f896c0a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.232+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8984072f70 msgr2=0x7f898419bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.277 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.232+0000 7f898a9ff700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8984072f70 0x7f898419bfb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f897400e970 tx=0x7f897400ec80 comp rx=0 tx=0).stop 2023-07-21T22:19:03.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.232+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 shutdown_connections 2023-07-21T22:19:03.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.233+0000 7f898a9ff700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f896c0a11a0 0x7f896c0a3650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.233+0000 7f898a9ff700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f898410c0e0 0x7f898419d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.233+0000 7f898a9ff700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8984072f70 0x7f898419bfb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.233+0000 7f898a9ff700 1 --2- 172.21.15.151:0/2311814370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8984074550 0x7f898419c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.233+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 >> 172.21.15.151:0/2311814370 conn(0x7f89840fb130 msgr2=0x7f89840fd510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:03.278 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.233+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 shutdown_connections 2023-07-21T22:19:03.279 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.233+0000 7f898a9ff700 1 -- 172.21.15.151:0/2311814370 wait complete. 2023-07-21T22:19:03.296 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1M' 2023-07-21T22:19:03.357 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:02.937+0000 7f316f477200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:19:03.357 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:03.156+0000 7f316f477200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:19:03.358 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:02.933+0000 7f7a4263c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-07-21T22:19:03.358 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:03.152+0000 7f7a4263c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:19:03.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.454+0000 7f8c367ff700 1 -- 172.21.15.151:0/3932713636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c30101690 msgr2=0x7f8c30107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.454+0000 7f8c367ff700 1 --2- 172.21.15.151:0/3932713636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c30101690 0x7f8c30107f50 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800b0a0 tx=0x7f8c2800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.455+0000 7f8c367ff700 1 -- 172.21.15.151:0/3932713636 shutdown_connections 2023-07-21T22:19:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.455+0000 7f8c367ff700 1 --2- 172.21.15.151:0/3932713636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c300ffb10 0x7f8c300fff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.455+0000 7f8c367ff700 1 --2- 172.21.15.151:0/3932713636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c30101690 0x7f8c30107f50 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.455+0000 7f8c367ff700 1 --2- 172.21.15.151:0/3932713636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c30100d00 0x7f8c30101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.455+0000 7f8c367ff700 1 -- 172.21.15.151:0/3932713636 >> 172.21.15.151:0/3932713636 conn(0x7f8c300fb130 msgr2=0x7f8c300fd560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.455+0000 7f8c367ff700 1 -- 172.21.15.151:0/3932713636 shutdown_connections 2023-07-21T22:19:03.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.455+0000 7f8c367ff700 1 -- 172.21.15.151:0/3932713636 wait complete. 2023-07-21T22:19:03.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.456+0000 7f8c367ff700 1 Processor -- start 2023-07-21T22:19:03.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.456+0000 7f8c367ff700 1 -- start start 2023-07-21T22:19:03.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.456+0000 7f8c367ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c300ffb10 0x7f8c30195730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.456+0000 7f8c367ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c30100d00 0x7f8c30195c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.456+0000 7f8c367ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30101690 0x7f8c30196af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.456+0000 7f8c367ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30197150 con 0x7f8c30100d00 2023-07-21T22:19:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.456+0000 7f8c367ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c301972c0 con 0x7f8c30101690 2023-07-21T22:19:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.456+0000 7f8c367ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c30197480 con 0x7f8c300ffb10 2023-07-21T22:19:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c2f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c30100d00 0x7f8c30195c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c2ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c300ffb10 0x7f8c30195730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c34d9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30101690 0x7f8c30196af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c2f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c30100d00 0x7f8c30195c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52492/0 (socket says 172.21.15.151:52492) 2023-07-21T22:19:03.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c2f7fe700 1 -- 172.21.15.151:0/1592022771 learned_addr learned my addr 172.21.15.151:0/1592022771 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c2ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c300ffb10 0x7f8c30195730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50604/0 (socket says 172.21.15.151:50604) 2023-07-21T22:19:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c34d9c700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c300ffb10 msgr2=0x7f8c30195730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c34d9c700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8c300ffb10 0x7f8c30195730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c34d9c700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c30100d00 msgr2=0x7f8c30195c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c34d9c700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c30100d00 0x7f8c30195c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c34d9c700 1 -- 172.21.15.151:0/1592022771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c28009d00 con 0x7f8c30101690 2023-07-21T22:19:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c2f7fe700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c30100d00 0x7f8c30195c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:03.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c34d9c700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30101690 0x7f8c30196af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009fd0 tx=0x7f8c2800bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.457+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c2800e040 con 0x7f8c30101690 2023-07-21T22:19:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.458+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c30197700 con 0x7f8c30101690 2023-07-21T22:19:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.458+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8c280094c0 con 0x7f8c30101690 2023-07-21T22:19:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.458+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c28005040 con 0x7f8c30101690 2023-07-21T22:19:03.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.458+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c3019df20 con 0x7f8c30101690 2023-07-21T22:19:03.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.459+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c30107040 con 0x7f8c30101690 2023-07-21T22:19:03.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.460+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 19) v1 ==== 135733+0+0 (secure 0 0 0) 0x7f8c2801d470 con 0x7f8c30101690 2023-07-21T22:19:03.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.462+0000 7f8c2d7fa700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 0x7f8c180a3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:03.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.462+0000 7f8c2ffff700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 msgr2=0x7f8c180a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.462+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 8190+0+0 (secure 0 0 0) 0x7f8c280ce210 con 0x7f8c30101690 2023-07-21T22:19:03.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.462+0000 7f8c2ffff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 0x7f8c180a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-07-21T22:19:03.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.466+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8c280979c0 con 0x7f8c30101690 2023-07-21T22:19:03.628 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:03.541+0000 7f7a4263c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:19:03.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:03 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1367025505' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-07-21T22:19:03.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:03 smithi187 ceph-mon[96918]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-07-21T22:19:03.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:03 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3938193670' entity='client.admin' 2023-07-21T22:19:03.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:03 smithi187 ceph-mon[96918]: from='client.? ' entity='client.admin' 2023-07-21T22:19:03.645 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:03 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:03.190+0000 7fee978d3200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-07-21T22:19:03.646 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:03 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1367025505' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-07-21T22:19:03.646 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:03 smithi151 ceph-mon[95510]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-07-21T22:19:03.646 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:03 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3938193670' entity='client.admin' 2023-07-21T22:19:03.646 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:03 smithi151 ceph-mon[95510]: from='client.? ' entity='client.admin' 2023-07-21T22:19:03.656 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:03.543+0000 7f316f477200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:19:03.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:03 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1367025505' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2023-07-21T22:19:03.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:03 smithi195 ceph-mon[97365]: mgrmap e19: x(active, since 9m), standbys: z, y 2023-07-21T22:19:03.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:03 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3938193670' entity='client.admin' 2023-07-21T22:19:03.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:03 smithi195 ceph-mon[97365]: from='client.? ' entity='client.admin' 2023-07-21T22:19:03.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.663+0000 7f8c2ffff700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 msgr2=0x7f8c180a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:03.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.663+0000 7f8c2ffff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 0x7f8c180a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-07-21T22:19:03.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:03.703+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 --> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c3002cbc0 con 0x7f8c180a11a0 2023-07-21T22:19:03.927 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:03 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:03.601+0000 7fee978d3200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-07-21T22:19:03.927 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:03 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:03.719+0000 7fee978d3200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:19:03.928 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:03 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:03.882+0000 7fee978d3200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:19:03.983 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:03.656+0000 7f7a4263c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:19:03.983 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:03.817+0000 7f7a4263c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:19:03.984 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:03.657+0000 7f316f477200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-07-21T22:19:03.984 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:03.819+0000 7f316f477200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-07-21T22:19:04.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:04.064+0000 7f8c2ffff700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 msgr2=0x7f8c180a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:04.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:04.064+0000 7f8c2ffff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 0x7f8c180a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-07-21T22:19:04.199 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:04 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:04.006+0000 7fee978d3200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:19:04.358 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:03.940+0000 7f316f477200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:19:04.359 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:03.938+0000 7f7a4263c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-07-21T22:19:04.628 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:04 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:04.472+0000 7f7a4263c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:19:04.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:04 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:19:04.656 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:04.474+0000 7f316f477200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:19:04.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:04 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:19:04.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:04 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:19:04.699 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:04 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:04.548+0000 7fee978d3200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-07-21T22:19:04.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:04.865+0000 7f8c2ffff700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 msgr2=0x7f8c180a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:04.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:04.865+0000 7f8c2ffff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 0x7f8c180a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-07-21T22:19:05.628 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:05 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:05.208+0000 7f7a4263c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T22:19:05.628 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:05 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:05.419+0000 7f7a4263c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:19:05.656 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:05.207+0000 7f316f477200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T22:19:05.657 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:05.417+0000 7f316f477200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:19:05.699 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:05 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:05.293+0000 7fee978d3200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-07-21T22:19:05.699 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:05 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:05.505+0000 7fee978d3200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-07-21T22:19:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:06.466+0000 7f8c2ffff700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 msgr2=0x7f8c180a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:06.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:06.466+0000 7f8c2ffff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 0x7f8c180a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2023-07-21T22:19:06.656 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:06.351+0000 7f316f477200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:19:06.657 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:06.470+0000 7f316f477200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:19:06.741 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:06 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:06.358+0000 7f7a4263c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:19:06.741 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:06 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:06.477+0000 7f7a4263c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:19:06.741 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:06 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:06.696+0000 7f7a4263c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:19:06.844 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:06 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:06.456+0000 7fee978d3200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:19:06.844 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:06 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:06.576+0000 7fee978d3200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-07-21T22:19:06.844 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:06 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:06.799+0000 7fee978d3200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:19:07.085 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:06.687+0000 7f316f477200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-07-21T22:19:07.362 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:07.040+0000 7f316f477200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T22:19:07.374 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:07.052+0000 7f7a4263c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T22:19:07.483 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:07.161+0000 7fee978d3200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-07-21T22:19:07.628 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:07.329+0000 7f7a4263c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:19:07.628 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:07.517+0000 7f7a4263c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:19:07.656 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:07.317+0000 7f316f477200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:19:07.657 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:07.506+0000 7f316f477200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:19:07.949 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:07.438+0000 7fee978d3200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-07-21T22:19:07.949 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:07.631+0000 7fee978d3200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-07-21T22:19:08.156 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:07.846+0000 7f316f477200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:19:08.378 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:07.858+0000 7f7a4263c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:19:08.449 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:07.977+0000 7fee978d3200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-07-21T22:19:09.128 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:08 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:08.779+0000 7f7a4263c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:19:09.128 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:08 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:08.953+0000 7f7a4263c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:19:09.156 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:08 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:08.763+0000 7f316f477200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:19:09.157 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:08 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:08.936+0000 7f316f477200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:19:09.378 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:08.909+0000 7fee978d3200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-07-21T22:19:09.378 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:09.085+0000 7fee978d3200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-07-21T22:19:09.378 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:09.333+0000 7fee978d3200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:19:09.628 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:09 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:09.196+0000 7f7a4263c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:19:09.628 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:09 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:09.342+0000 7f7a4263c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:19:09.641 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:09 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:09.179+0000 7f316f477200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-07-21T22:19:09.641 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:09 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:09.325+0000 7f316f477200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:19:09.699 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:09.481+0000 7fee978d3200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-07-21T22:19:09.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:09.669+0000 7f8c2ffff700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 msgr2=0x7f8c180a3650 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.151:6800/3677157440 2023-07-21T22:19:09.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:09.669+0000 7f8c2ffff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 0x7f8c180a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2023-07-21T22:19:09.906 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:09 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:09.596+0000 7f316f477200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:19:10.128 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:09 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:09.616+0000 7f7a4263c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:19:10.199 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:09.757+0000 7fee978d3200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-07-21T22:19:10.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:10.722+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mon.2 v2:172.21.15.187:3300/0 7 ==== mgrmap(e 20) v1 ==== 135733+0+0 (secure 0 0 0) 0x7f8c28097d90 con 0x7f8c30101690 2023-07-21T22:19:10.899 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:10.855+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mon.2 v2:172.21.15.187:3300/0 8 ==== mgrmap(e 21) v1 ==== 135400+0+0 (secure 0 0 0) 0x7f8c280cbd60 con 0x7f8c30101690 2023-07-21T22:19:10.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:10.855+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 msgr2=0x7f8c180a3650 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:19:10.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:10.855+0000 7f8c2d7fa700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/3677157440,v1:172.21.15.151:6801/3677157440] conn(0x7f8c180a11a0 0x7f8c180a3650 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.047 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y[98384]: 2023-07-21T22:19:10.674+0000 7f7a4263c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:19:11.048 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: Standby manager daemon z restarted 2023-07-21T22:19:11.048 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: Standby manager daemon z started 2023-07-21T22:19:11.048 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-21T22:19:11.048 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:19:11.048 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-21T22:19:11.048 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:19:11.049 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: Standby manager daemon y restarted 2023-07-21T22:19:11.049 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: Standby manager daemon y started 2023-07-21T22:19:11.049 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-21T22:19:11.049 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:19:11.049 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-21T22:19:11.049 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:10 smithi187 ceph-mon[96918]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:19:11.050 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: Standby manager daemon z restarted 2023-07-21T22:19:11.050 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: Standby manager daemon z started 2023-07-21T22:19:11.050 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-21T22:19:11.050 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:19:11.051 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-21T22:19:11.051 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:19:11.051 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: Standby manager daemon y restarted 2023-07-21T22:19:11.051 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: Standby manager daemon y started 2023-07-21T22:19:11.051 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-21T22:19:11.051 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:19:11.051 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-21T22:19:11.051 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-mon[95510]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:19:11.052 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z[99720]: 2023-07-21T22:19:10.655+0000 7f316f477200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:19:11.052 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:10.838+0000 7fee978d3200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-07-21T22:19:11.052 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: Standby manager daemon z restarted 2023-07-21T22:19:11.052 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: Standby manager daemon z started 2023-07-21T22:19:11.052 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2023-07-21T22:19:11.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:19:11.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2023-07-21T22:19:11.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.195:0/650546479' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:19:11.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: Standby manager daemon y restarted 2023-07-21T22:19:11.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: Standby manager daemon y started 2023-07-21T22:19:11.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2023-07-21T22:19:11.053 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2023-07-21T22:19:11.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2023-07-21T22:19:11.054 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:10 smithi195 ceph-mon[97365]: from='mgr.? 172.21.15.187:0/1297425160' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2023-07-21T22:19:11.449 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.055+0000 7fedf5df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.449 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.055+0000 7fedf5df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.450 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.055+0000 7fedf5df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.450 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.055+0000 7fedf5df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.450 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.055+0000 7fedf5df1700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.450 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.056+0000 7fedf35ec700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.450 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.056+0000 7fedf35ec700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.450 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.056+0000 7fedf35ec700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.450 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.056+0000 7fedf35ec700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.451 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:19:11.056+0000 7fedf35ec700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:19:11.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.861+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mon.2 v2:172.21.15.187:3300/0 9 ==== mgrmap(e 22) v1 ==== 135527+0+0 (secure 0 0 0) 0x7f8c2801d720 con 0x7f8c30101690 2023-07-21T22:19:11.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.862+0000 7f8c2d7fa700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8c18027e90 0x7f8c18028260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:11.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.862+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 --> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}) v1 -- 0x7f8c3002cbc0 con 0x7f8c18027e90 2023-07-21T22:19:11.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.865+0000 7f8c2ffff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8c18027e90 0x7f8c18028260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:11.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.869+0000 7f8c2ffff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8c18027e90 0x7f8c18028260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c30100b60 tx=0x7f8c20009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:11.974 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.929+0000 7f8c2d7fa700 1 -- 172.21.15.151:0/1592022771 <== mgr.15489 v2:172.21.15.151:6800/508405215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f8c3002cbc0 con 0x7f8c18027e90 2023-07-21T22:19:11.974 INFO:teuthology.orchestra.run.smithi151.stdout:Schedule set for path / 2023-07-21T22:19:11.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.933+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8c18027e90 msgr2=0x7f8c18028260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:11.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.933+0000 7f8c367ff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8c18027e90 0x7f8c18028260 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8c30100b60 tx=0x7f8c20009260 comp rx=0 tx=0).stop 2023-07-21T22:19:11.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.933+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30101690 msgr2=0x7f8c30196af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:11.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.933+0000 7f8c367ff700 1 --2- 172.21.15.151:0/1592022771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c30101690 0x7f8c30196af0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8c28009fd0 tx=0x7f8c2800bce0 comp rx=0 tx=0).stop 2023-07-21T22:19:11.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.933+0000 7f8c34d9c700 1 -- 172.21.15.151:0/1592022771 reap_dead start 2023-07-21T22:19:11.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.933+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 shutdown_connections 2023-07-21T22:19:11.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.933+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 >> 172.21.15.151:0/1592022771 conn(0x7f8c300fb130 msgr2=0x7f8c30104180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:11.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.933+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 shutdown_connections 2023-07-21T22:19:11.979 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:11.933+0000 7f8c367ff700 1 -- 172.21.15.151:0/1592022771 wait complete. 2023-07-21T22:19:11.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6M3h' 2023-07-21T22:19:12.063 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: mgrmap e20: x(active, since 9m), standbys: y, z 2023-07-21T22:19:12.063 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: Active manager daemon x restarted 2023-07-21T22:19:12.063 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: Activating manager daemon x 2023-07-21T22:19:12.064 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: osdmap e88: 12 total, 12 up, 12 in 2023-07-21T22:19:12.064 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: mgrmap e21: x(active, starting, since 0.0158171s), standbys: y, z 2023-07-21T22:19:12.064 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:19:12.064 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:19:12.064 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:19:12.064 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-21T22:19:12.064 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-21T22:19:12.065 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-21T22:19:12.065 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-21T22:19:12.065 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-21T22:19:12.065 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-21T22:19:12.065 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-21T22:19:12.065 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-21T22:19:12.065 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:19:12.066 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-21T22:19:12.066 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-21T22:19:12.066 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-21T22:19:12.066 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-21T22:19:12.066 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-21T22:19:12.066 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-21T22:19:12.066 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:19:12.067 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:19:12.067 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:19:12.067 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:19:12.067 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:19:12.067 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:19:12.067 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:19:12.067 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:19:12.068 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:19:12.068 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:19:12.068 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:19:12.068 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:19:12.068 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-21T22:19:12.068 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-21T22:19:12.069 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-21T22:19:12.069 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: Manager daemon x is now available 2023-07-21T22:19:12.069 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:19:12.069 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:19:12.069 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-21T22:19:12.069 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:11 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-21T22:19:12.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: mgrmap e20: x(active, since 9m), standbys: y, z 2023-07-21T22:19:12.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: Active manager daemon x restarted 2023-07-21T22:19:12.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: Activating manager daemon x 2023-07-21T22:19:12.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: osdmap e88: 12 total, 12 up, 12 in 2023-07-21T22:19:12.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: mgrmap e21: x(active, starting, since 0.0158171s), standbys: y, z 2023-07-21T22:19:12.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:19:12.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:19:12.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:19:12.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-21T22:19:12.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-21T22:19:12.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-21T22:19:12.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-21T22:19:12.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-21T22:19:12.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-21T22:19:12.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-21T22:19:12.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-21T22:19:12.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:19:12.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-21T22:19:12.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-21T22:19:12.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-21T22:19:12.131 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-21T22:19:12.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-21T22:19:12.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-21T22:19:12.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:19:12.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:19:12.132 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:19:12.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:19:12.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:19:12.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:19:12.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:19:12.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:19:12.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:19:12.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:19:12.133 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:19:12.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:19:12.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-21T22:19:12.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-21T22:19:12.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-21T22:19:12.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: Manager daemon x is now available 2023-07-21T22:19:12.134 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:19:12.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:19:12.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-21T22:19:12.135 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:11 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-21T22:19:12.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: mgrmap e20: x(active, since 9m), standbys: y, z 2023-07-21T22:19:12.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: Active manager daemon x restarted 2023-07-21T22:19:12.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: Activating manager daemon x 2023-07-21T22:19:12.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: osdmap e88: 12 total, 12 up, 12 in 2023-07-21T22:19:12.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: mgrmap e21: x(active, starting, since 0.0158171s), standbys: y, z 2023-07-21T22:19:12.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2023-07-21T22:19:12.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2023-07-21T22:19:12.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2023-07-21T22:19:12.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2023-07-21T22:19:12.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2023-07-21T22:19:12.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2023-07-21T22:19:12.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2023-07-21T22:19:12.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2023-07-21T22:19:12.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2023-07-21T22:19:12.159 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2023-07-21T22:19:12.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2023-07-21T22:19:12.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:19:12.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2023-07-21T22:19:12.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2023-07-21T22:19:12.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2023-07-21T22:19:12.160 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2023-07-21T22:19:12.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2023-07-21T22:19:12.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2023-07-21T22:19:12.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2023-07-21T22:19:12.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2023-07-21T22:19:12.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2023-07-21T22:19:12.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2023-07-21T22:19:12.161 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2023-07-21T22:19:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2023-07-21T22:19:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2023-07-21T22:19:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2023-07-21T22:19:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2023-07-21T22:19:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2023-07-21T22:19:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2023-07-21T22:19:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2023-07-21T22:19:12.162 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2023-07-21T22:19:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2023-07-21T22:19:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2023-07-21T22:19:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: Manager daemon x is now available 2023-07-21T22:19:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:19:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:19:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2023-07-21T22:19:12.163 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:11 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2023-07-21T22:19:12.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.164+0000 7fa929fff700 1 -- 172.21.15.151:0/2472282361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa924101d90 msgr2=0x7fa9241021a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:12.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.164+0000 7fa929fff700 1 --2- 172.21.15.151:0/2472282361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa924101d90 0x7fa9241021a0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fa914009990 tx=0x7fa914009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.164+0000 7fa929fff700 1 -- 172.21.15.151:0/2472282361 shutdown_connections 2023-07-21T22:19:12.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.164+0000 7fa929fff700 1 --2- 172.21.15.151:0/2472282361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa924103910 0x7fa92410a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.164+0000 7fa929fff700 1 --2- 172.21.15.151:0/2472282361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa924101d90 0x7fa9241021a0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.164+0000 7fa929fff700 1 --2- 172.21.15.151:0/2472282361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa924102f80 0x7fa9241033d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.164+0000 7fa929fff700 1 -- 172.21.15.151:0/2472282361 >> 172.21.15.151:0/2472282361 conn(0x7fa9240fd390 msgr2=0x7fa9240ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:12.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.164+0000 7fa929fff700 1 -- 172.21.15.151:0/2472282361 shutdown_connections 2023-07-21T22:19:12.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.164+0000 7fa929fff700 1 -- 172.21.15.151:0/2472282361 wait complete. 2023-07-21T22:19:12.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.165+0000 7fa929fff700 1 Processor -- start 2023-07-21T22:19:12.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.165+0000 7fa929fff700 1 -- start start 2023-07-21T22:19:12.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.165+0000 7fa929fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa924101d90 0x7fa924197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:12.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.165+0000 7fa929fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa924102f80 0x7fa924197fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:12.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.165+0000 7fa929fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa924103910 0x7fa924198e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:12.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.165+0000 7fa929fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924199480 con 0x7fa924103910 2023-07-21T22:19:12.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.165+0000 7fa929fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9241995f0 con 0x7fa924102f80 2023-07-21T22:19:12.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa929fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9241997b0 con 0x7fa924101d90 2023-07-21T22:19:12.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa9237fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa924101d90 0x7fa924197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:12.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa9237fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa924101d90 0x7fa924197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50208/0 (socket says 172.21.15.151:50208) 2023-07-21T22:19:12.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa9237fe700 1 -- 172.21.15.151:0/873747790 learned_addr learned my addr 172.21.15.151:0/873747790 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:12.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa923fff700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa924103910 0x7fa924198e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:12.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa922ffd700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa924102f80 0x7fa924197fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:12.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa9237fe700 1 -- 172.21.15.151:0/873747790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa924102f80 msgr2=0x7fa924197fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:12.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa9237fe700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa924102f80 0x7fa924197fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa9237fe700 1 -- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa924103910 msgr2=0x7fa924198e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:12.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa9237fe700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa924103910 0x7fa924198e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa9237fe700 1 -- 172.21.15.151:0/873747790 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140095f0 con 0x7fa924101d90 2023-07-21T22:19:12.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.166+0000 7fa9237fe700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa924101d90 0x7fa924197a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa914005910 tx=0x7fa914005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:12.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.167+0000 7fa920ff9700 1 -- 172.21.15.151:0/873747790 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa91401d070 con 0x7fa924101d90 2023-07-21T22:19:12.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.167+0000 7fa920ff9700 1 -- 172.21.15.151:0/873747790 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa91400bd50 con 0x7fa924101d90 2023-07-21T22:19:12.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.167+0000 7fa920ff9700 1 -- 172.21.15.151:0/873747790 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914022d00 con 0x7fa924101d90 2023-07-21T22:19:12.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.167+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa924199a30 con 0x7fa924101d90 2023-07-21T22:19:12.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.167+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9241a0250 con 0x7fa924101d90 2023-07-21T22:19:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.168+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92404e2f0 con 0x7fa924101d90 2023-07-21T22:19:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.170+0000 7fa920ff9700 1 -- 172.21.15.151:0/873747790 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 22) v1 ==== 135527+0+0 (secure 0 0 0) 0x7fa91400b8c0 con 0x7fa924101d90 2023-07-21T22:19:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.172+0000 7fa920ff9700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa90c0a1050 0x7fa90c0a3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.172+0000 7fa920ff9700 1 -- 172.21.15.151:0/873747790 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa9140cd9b0 con 0x7fa924101d90 2023-07-21T22:19:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.172+0000 7fa922ffd700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa90c0a1050 0x7fa90c0a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:12.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.173+0000 7fa922ffd700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa90c0a1050 0x7fa90c0a3500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa918009c60 tx=0x7fa918009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:12.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.176+0000 7fa920ff9700 1 -- 172.21.15.151:0/873747790 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fa914097390 con 0x7fa924101d90 2023-07-21T22:19:12.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.415+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 --> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}) v1 -- 0x7fa924060950 con 0x7fa90c0a1050 2023-07-21T22:19:12.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.470+0000 7fa920ff9700 1 -- 172.21.15.151:0/873747790 <== mgr.15489 v2:172.21.15.151:6800/508405215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7fa924060950 con 0x7fa90c0a1050 2023-07-21T22:19:12.514 INFO:teuthology.orchestra.run.smithi151.stdout:Retention added to path / 2023-07-21T22:19:12.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa90c0a1050 msgr2=0x7fa90c0a3500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:12.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa90c0a1050 0x7fa90c0a3500 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fa918009c60 tx=0x7fa918009260 comp rx=0 tx=0).stop 2023-07-21T22:19:12.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa924101d90 msgr2=0x7fa924197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:12.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa924101d90 0x7fa924197a60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa914005910 tx=0x7fa914005740 comp rx=0 tx=0).stop 2023-07-21T22:19:12.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 shutdown_connections 2023-07-21T22:19:12.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa90c0a1050 0x7fa90c0a3500 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa924103910 0x7fa924198e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa924101d90 0x7fa924197a60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 --2- 172.21.15.151:0/873747790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa924102f80 0x7fa924197fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 >> 172.21.15.151:0/873747790 conn(0x7fa9240fd390 msgr2=0x7fa9240ff650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:12.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 shutdown_connections 2023-07-21T22:19:12.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.473+0000 7fa929fff700 1 -- 172.21.15.151:0/873747790 wait complete. 2023-07-21T22:19:12.537 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-07-21T22:19:12.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.697+0000 7fc8f43ff700 1 -- 172.21.15.151:0/4135639538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8ec100620 msgr2=0x7fc8ec102a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:12.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.697+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/4135639538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8ec100620 0x7fc8ec102a00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8009990 tx=0x7fc8e8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.697+0000 7fc8f43ff700 1 -- 172.21.15.151:0/4135639538 shutdown_connections 2023-07-21T22:19:12.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.697+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/4135639538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8ec100620 0x7fc8ec102a00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.697+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/4135639538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec105860 0x7fc8ec107c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.697+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/4135639538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8ec102f40 0x7fc8ec105320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.697+0000 7fc8f43ff700 1 -- 172.21.15.151:0/4135639538 >> 172.21.15.151:0/4135639538 conn(0x7fc8ec0fa000 msgr2=0x7fc8ec0fc450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:12.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.698+0000 7fc8f43ff700 1 -- 172.21.15.151:0/4135639538 shutdown_connections 2023-07-21T22:19:12.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.698+0000 7fc8f43ff700 1 -- 172.21.15.151:0/4135639538 wait complete. 2023-07-21T22:19:12.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.699+0000 7fc8f43ff700 1 Processor -- start 2023-07-21T22:19:12.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.699+0000 7fc8f43ff700 1 -- start start 2023-07-21T22:19:12.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f43ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec100620 0x7fc8ec197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:12.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f43ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8ec102f40 0x7fc8ec198000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:12.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f43ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8ec105860 0x7fc8ec198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:12.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f43ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1994e0 con 0x7fc8ec102f40 2023-07-21T22:19:12.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f43ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec199650 con 0x7fc8ec105860 2023-07-21T22:19:12.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f43ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec199810 con 0x7fc8ec100620 2023-07-21T22:19:12.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f199a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8ec102f40 0x7fc8ec198000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:12.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f219b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec100620 0x7fc8ec197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:12.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f199a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8ec102f40 0x7fc8ec198000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47350/0 (socket says 172.21.15.151:47350) 2023-07-21T22:19:12.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f199a700 1 -- 172.21.15.151:0/700492847 learned_addr learned my addr 172.21.15.151:0/700492847 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:12.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.700+0000 7fc8f299c700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8ec105860 0x7fc8ec198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:12.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8f219b700 1 -- 172.21.15.151:0/700492847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8ec105860 msgr2=0x7fc8ec198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:12.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8f219b700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8ec105860 0x7fc8ec198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8f219b700 1 -- 172.21.15.151:0/700492847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8ec102f40 msgr2=0x7fc8ec198000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:12.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8f219b700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8ec102f40 0x7fc8ec198000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:12.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8f219b700 1 -- 172.21.15.151:0/700492847 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80095f0 con 0x7fc8ec100620 2023-07-21T22:19:12.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8f299c700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8ec105860 0x7fc8ec198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:12.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8f219b700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec100620 0x7fc8ec197ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8000c00 tx=0x7fc8e8005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:12.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8e37fe700 1 -- 172.21.15.151:0/700492847 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e801d070 con 0x7fc8ec100620 2023-07-21T22:19:12.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec199a90 con 0x7fc8ec100620 2023-07-21T22:19:12.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8e37fe700 1 -- 172.21.15.151:0/700492847 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc8e800be30 con 0x7fc8ec100620 2023-07-21T22:19:12.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.701+0000 7fc8e37fe700 1 -- 172.21.15.151:0/700492847 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e8022da0 con 0x7fc8ec100620 2023-07-21T22:19:12.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.702+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec1a02b0 con 0x7fc8ec100620 2023-07-21T22:19:12.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.703+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec1073d0 con 0x7fc8ec100620 2023-07-21T22:19:12.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.705+0000 7fc8e37fe700 1 -- 172.21.15.151:0/700492847 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 22) v1 ==== 135527+0+0 (secure 0 0 0) 0x7fc8e8022570 con 0x7fc8ec100620 2023-07-21T22:19:12.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.706+0000 7fc8e37fe700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc8d80a0f50 0x7fc8d80a3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:12.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.706+0000 7fc8e37fe700 1 -- 172.21.15.151:0/700492847 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc8e80ce2b0 con 0x7fc8ec100620 2023-07-21T22:19:12.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.707+0000 7fc8f199a700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc8d80a0f50 0x7fc8d80a3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:12.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.707+0000 7fc8f199a700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc8d80a0f50 0x7fc8d80a3400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009d20 tx=0x7fc8dc009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:12.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.712+0000 7fc8e37fe700 1 -- 172.21.15.151:0/700492847 <== mon.1 v2:172.21.15.195:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fc8e8097cb0 con 0x7fc8ec100620 2023-07-21T22:19:12.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.872+0000 7fc8e37fe700 1 -- 172.21.15.151:0/700492847 <== mon.1 v2:172.21.15.195:3300/0 7 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7fc8e8098080 con 0x7fc8ec100620 2023-07-21T22:19:13.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.964+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 --> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8ec02cb10 con 0x7fc8d80a0f50 2023-07-21T22:19:13.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.973+0000 7fc8e37fe700 1 -- 172.21.15.151:0/700492847 <== mgr.15489 v2:172.21.15.151:6800/508405215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+283 (secure 0 0 0) 0x7fc8ec02cb10 con 0x7fc8d80a0f50 2023-07-21T22:19:13.019 INFO:teuthology.orchestra.run.smithi151.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:19:11", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2023-07-21T22:19:13.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc8d80a0f50 msgr2=0x7fc8d80a3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc8d80a0f50 0x7fc8d80a3400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc009d20 tx=0x7fc8dc009260 comp rx=0 tx=0).stop 2023-07-21T22:19:13.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec100620 msgr2=0x7fc8ec197ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec100620 0x7fc8ec197ac0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8000c00 tx=0x7fc8e8005740 comp rx=0 tx=0).stop 2023-07-21T22:19:13.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 shutdown_connections 2023-07-21T22:19:13.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc8d80a0f50 0x7fc8d80a3400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8ec105860 0x7fc8ec198e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc8ec100620 0x7fc8ec197ac0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 --2- 172.21.15.151:0/700492847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8ec102f40 0x7fc8ec198000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 >> 172.21.15.151:0/700492847 conn(0x7fc8ec0fa000 msgr2=0x7fc8ec0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:13.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 shutdown_connections 2023-07-21T22:19:13.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:12.976+0000 7fc8f43ff700 1 -- 172.21.15.151:0/700492847 wait complete. 2023-07-21T22:19:13.040 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-07-21T22:19:13.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:12 smithi195 ceph-mon[97365]: [21/Jul/2023:22:19:11] ENGINE Bus STARTING 2023-07-21T22:19:13.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:12 smithi195 ceph-mon[97365]: [21/Jul/2023:22:19:11] ENGINE Serving on http://172.21.15.151:8765 2023-07-21T22:19:13.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:12 smithi195 ceph-mon[97365]: mgrmap e22: x(active, since 1.02162s), standbys: y, z 2023-07-21T22:19:13.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:12 smithi195 ceph-mon[97365]: from='client.25262 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:13.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:12 smithi195 ceph-mon[97365]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:13.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:12 smithi195 ceph-mon[97365]: [21/Jul/2023:22:19:11] ENGINE Serving on https://172.21.15.151:7150 2023-07-21T22:19:13.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:12 smithi195 ceph-mon[97365]: [21/Jul/2023:22:19:11] ENGINE Bus STARTED 2023-07-21T22:19:13.158 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:12 smithi195 ceph-mon[97365]: from='client.25345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:13.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:12 smithi151 ceph-mon[95510]: [21/Jul/2023:22:19:11] ENGINE Bus STARTING 2023-07-21T22:19:13.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:12 smithi151 ceph-mon[95510]: [21/Jul/2023:22:19:11] ENGINE Serving on http://172.21.15.151:8765 2023-07-21T22:19:13.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:12 smithi151 ceph-mon[95510]: mgrmap e22: x(active, since 1.02162s), standbys: y, z 2023-07-21T22:19:13.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:12 smithi151 ceph-mon[95510]: from='client.25262 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:13.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:12 smithi151 ceph-mon[95510]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:13.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:12 smithi151 ceph-mon[95510]: [21/Jul/2023:22:19:11] ENGINE Serving on https://172.21.15.151:7150 2023-07-21T22:19:13.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:12 smithi151 ceph-mon[95510]: [21/Jul/2023:22:19:11] ENGINE Bus STARTED 2023-07-21T22:19:13.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:12 smithi151 ceph-mon[95510]: from='client.25345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:13.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.205+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3753248325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd440ffb00 msgr2=0x7efd440fff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.205+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3753248325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd440ffb00 0x7efd440fff10 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7efd40009990 tx=0x7efd40009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.205+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3753248325 shutdown_connections 2023-07-21T22:19:13.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.205+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3753248325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd44101680 0x7efd44107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.205+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3753248325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd440ffb00 0x7efd440fff10 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.205+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3753248325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd44100cf0 0x7efd44101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.205+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3753248325 >> 172.21.15.151:0/3753248325 conn(0x7efd440fb0e0 msgr2=0x7efd440fd550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.205+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3753248325 shutdown_connections 2023-07-21T22:19:13.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.205+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3753248325 wait complete. 2023-07-21T22:19:13.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.206+0000 7efd4b7ff700 1 Processor -- start 2023-07-21T22:19:13.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.206+0000 7efd4b7ff700 1 -- start start 2023-07-21T22:19:13.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.206+0000 7efd4b7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd440ffb00 0x7efd44072900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd4b7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd44100cf0 0x7efd44072e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd4b7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd44101680 0x7efd44073380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd4b7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4419f840 con 0x7efd44100cf0 2023-07-21T22:19:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd4b7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4419f980 con 0x7efd440ffb00 2023-07-21T22:19:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd4b7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd4419fac0 con 0x7efd44101680 2023-07-21T22:19:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd48d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd44100cf0 0x7efd44072e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd4959b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd440ffb00 0x7efd44072900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd48d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd44100cf0 0x7efd44072e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47360/0 (socket says 172.21.15.151:47360) 2023-07-21T22:19:13.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd4959b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd440ffb00 0x7efd44072900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53762/0 (socket says 172.21.15.151:53762) 2023-07-21T22:19:13.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd48d9a700 1 -- 172.21.15.151:0/3484888838 learned_addr learned my addr 172.21.15.151:0/3484888838 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:13.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd49d9c700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd44101680 0x7efd44073380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd48d9a700 1 -- 172.21.15.151:0/3484888838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd44101680 msgr2=0x7efd44073380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd48d9a700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd44101680 0x7efd44073380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd48d9a700 1 -- 172.21.15.151:0/3484888838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd440ffb00 msgr2=0x7efd44072900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd48d9a700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd440ffb00 0x7efd44072900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd48d9a700 1 -- 172.21.15.151:0/3484888838 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd3c009c40 con 0x7efd44100cf0 2023-07-21T22:19:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.207+0000 7efd4959b700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd440ffb00 0x7efd44072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.208+0000 7efd48d9a700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd44100cf0 0x7efd44072e40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efd3400e9a0 tx=0x7efd3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:13.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.208+0000 7efd3a7fc700 1 -- 172.21.15.151:0/3484888838 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34009790 con 0x7efd44100cf0 2023-07-21T22:19:13.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.208+0000 7efd3a7fc700 1 -- 172.21.15.151:0/3484888838 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7efd3400ce50 con 0x7efd44100cf0 2023-07-21T22:19:13.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.208+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd400095f0 con 0x7efd44100cf0 2023-07-21T22:19:13.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.208+0000 7efd3a7fc700 1 -- 172.21.15.151:0/3484888838 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd34018420 con 0x7efd44100cf0 2023-07-21T22:19:13.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.208+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd441a00d0 con 0x7efd44100cf0 2023-07-21T22:19:13.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.209+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd441071c0 con 0x7efd44100cf0 2023-07-21T22:19:13.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.211+0000 7efd3a7fc700 1 -- 172.21.15.151:0/3484888838 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7efd34010430 con 0x7efd44100cf0 2023-07-21T22:19:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.212+0000 7efd3a7fc700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7efd300a1350 0x7efd300a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.213+0000 7efd3a7fc700 1 -- 172.21.15.151:0/3484888838 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7efd34014070 con 0x7efd44100cf0 2023-07-21T22:19:13.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.213+0000 7efd4959b700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7efd300a1350 0x7efd300a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:13.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.213+0000 7efd4959b700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7efd300a1350 0x7efd300a3800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd40005910 tx=0x7efd40005fb0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:13.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.216+0000 7efd3a7fc700 1 -- 172.21.15.151:0/3484888838 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7efd34051770 con 0x7efd44100cf0 2023-07-21T22:19:13.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:12 smithi187 ceph-mon[96918]: [21/Jul/2023:22:19:11] ENGINE Bus STARTING 2023-07-21T22:19:13.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:12 smithi187 ceph-mon[96918]: [21/Jul/2023:22:19:11] ENGINE Serving on http://172.21.15.151:8765 2023-07-21T22:19:13.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:12 smithi187 ceph-mon[96918]: mgrmap e22: x(active, since 1.02162s), standbys: y, z 2023-07-21T22:19:13.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:12 smithi187 ceph-mon[96918]: from='client.25262 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1M", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:13.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:12 smithi187 ceph-mon[96918]: pgmap v3: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:13.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:12 smithi187 ceph-mon[96918]: [21/Jul/2023:22:19:11] ENGINE Serving on https://172.21.15.151:7150 2023-07-21T22:19:13.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:12 smithi187 ceph-mon[96918]: [21/Jul/2023:22:19:11] ENGINE Bus STARTED 2023-07-21T22:19:13.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:12 smithi187 ceph-mon[96918]: from='client.25345 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6M3h", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:13.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.476+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 --> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7efd44060950 con 0x7efd300a1350 2023-07-21T22:19:13.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.484+0000 7efd3a7fc700 1 -- 172.21.15.151:0/3484888838 <== mgr.15489 v2:172.21.15.151:6800/508405215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7efd44060950 con 0x7efd300a1350 2023-07-21T22:19:13.528 INFO:teuthology.orchestra.run.smithi151.stdout:/ 1M 6M3h 2023-07-21T22:19:13.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7efd300a1350 msgr2=0x7efd300a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7efd300a1350 0x7efd300a3800 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7efd40005910 tx=0x7efd40005fb0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd44100cf0 msgr2=0x7efd44072e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd44100cf0 0x7efd44072e40 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7efd3400e9a0 tx=0x7efd3400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 shutdown_connections 2023-07-21T22:19:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7efd300a1350 0x7efd300a3800 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd440ffb00 0x7efd44072900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7efd44101680 0x7efd44073380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 --2- 172.21.15.151:0/3484888838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efd44100cf0 0x7efd44072e40 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:13.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.487+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 >> 172.21.15.151:0/3484888838 conn(0x7efd440fb0e0 msgr2=0x7efd44104300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:13.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.488+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 shutdown_connections 2023-07-21T22:19:13.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:13.488+0000 7efd4b7ff700 1 -- 172.21.15.151:0/3484888838 wait complete. 2023-07-21T22:19:13.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2023-07-21T22:19:13.623 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2023-07-21T22:19:13.633 INFO:teuthology.run_tasks:Running task background_exec... 2023-07-21T22:19:13.648 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T22:19:13.649 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2023-07-21T22:19:13.653 INFO:teuthology.run_tasks:Running task exec... 2023-07-21T22:19:13.664 INFO:teuthology.task.exec:Executing custom commands... 2023-07-21T22:19:13.665 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T22:19:13.665 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2023-07-21T22:19:13.773 INFO:teuthology.orchestra.run.smithi151.stdout:total 0 2023-07-21T22:19:13.821 INFO:teuthology.orchestra.run.smithi151.stdout:Filesystem Size Used Avail Use% Mounted on 2023-07-21T22:19:13.821 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-fuse 340G 0 340G 0% /tmp/cephfs 2023-07-21T22:19:13.827 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2023-07-21T22:19:13.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2023-07-21T22:19:14.073 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:13 smithi151 ceph-mon[95510]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:14.074 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:13 smithi151 ceph-mon[95510]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-07-21T22:19:14.074 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:13 smithi151 ceph-mon[95510]: from='client.25351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:14.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2023-07-21T22:19:14.156 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:13 smithi195 ceph-mon[97365]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:14.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:13 smithi195 ceph-mon[97365]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-07-21T22:19:14.157 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:13 smithi195 ceph-mon[97365]: from='client.25351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:13 smithi187 ceph-mon[96918]: pgmap v4: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:13 smithi187 ceph-mon[96918]: mgrmap e23: x(active, since 2s), standbys: y, z 2023-07-21T22:19:14.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:13 smithi187 ceph-mon[96918]: from='client.25351 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:15.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:14 smithi151 ceph-mon[95510]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:15.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:14 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.199 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:14 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:14 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.200 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:14 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:14 smithi187 ceph-mon[96918]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:15.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:14 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:14 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:14 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:14 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:14 smithi195 ceph-mon[97365]: from='client.15555 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T22:19:15.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:14 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:14 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:14 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:15.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:14 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:16.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:15 smithi187 ceph-mon[96918]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:16.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:16.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:16.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:15 smithi195 ceph-mon[97365]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:16.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:16.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:16.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:15 smithi151 ceph-mon[95510]: pgmap v5: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:16.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:16.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.148 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.149 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:19:17.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:19:17.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.150 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.151 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.151 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.151 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.151 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.152 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:19:17.152 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:19:17.152 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.152 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.153 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.154 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.154 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.154 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.154 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:19:17.155 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:19:17.155 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:19:17.155 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:19:17.155 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: Updating smithi151:/etc/ceph/ceph.conf 2023-07-21T22:19:17.155 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: Updating smithi187:/etc/ceph/ceph.conf 2023-07-21T22:19:17.155 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:17 smithi151 ceph-mon[95510]: Updating smithi195:/etc/ceph/ceph.conf 2023-07-21T22:19:17.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.378 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.380 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:19:17.380 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:19:17.380 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.381 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.381 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.381 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.381 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.382 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.382 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:19:17.382 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:19:17.383 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.383 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.383 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.384 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.384 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.384 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.384 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:19:17.385 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:19:17.385 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:19:17.385 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:19:17.385 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: Updating smithi151:/etc/ceph/ceph.conf 2023-07-21T22:19:17.385 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: Updating smithi187:/etc/ceph/ceph.conf 2023-07-21T22:19:17.385 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:17 smithi187 ceph-mon[96918]: Updating smithi195:/etc/ceph/ceph.conf 2023-07-21T22:19:17.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.407 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:19:17.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:19:17.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.409 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.409 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.409 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.409 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:19:17.409 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:19:17.409 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.409 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:17.409 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.410 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.410 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.410 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:19:17.410 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:19:17.410 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:19:17.410 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:19:17.410 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:19:17.411 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: Updating smithi151:/etc/ceph/ceph.conf 2023-07-21T22:19:17.411 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: Updating smithi187:/etc/ceph/ceph.conf 2023-07-21T22:19:17.411 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:17 smithi195 ceph-mon[97365]: Updating smithi195:/etc/ceph/ceph.conf 2023-07-21T22:19:17.488 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2023-07-21T22:19:17.594 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2023-07-21T22:19:17.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2023-07-21T22:19:17.711 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-07-21T22:19:17.825 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/: 2023-07-21T22:19:17.825 INFO:teuthology.orchestra.run.smithi151.stdout:total 2 2023-07-21T22:19:17.826 INFO:teuthology.orchestra.run.smithi151.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:17.826 INFO:teuthology.orchestra.run.smithi151.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 .. 2023-07-21T22:19:17.826 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 data 2023-07-21T22:19:17.826 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:17.827 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data: 2023-07-21T22:19:17.827 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:17.827 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:17.827 INFO:teuthology.orchestra.run.smithi151.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 .. 2023-07-21T22:19:17.831 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2023-07-21T22:19:17.962 INFO:teuthology.orchestra.run.smithi151.stdout:[Service] 2023-07-21T22:19:17.963 INFO:teuthology.orchestra.run.smithi151.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2023-07-21T22:19:17.963 INFO:teuthology.orchestra.run.smithi151.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2023-07-21T22:19:17.968 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2023-07-21T22:19:18.172 INFO:teuthology.orchestra.run.smithi151.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2023-07-21T22:19:18.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:18 smithi187 ceph-mon[96918]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:19:18.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:18 smithi187 ceph-mon[96918]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:18.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:18 smithi187 ceph-mon[96918]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:19:18.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:18 smithi187 ceph-mon[96918]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:19:18.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:18 smithi187 ceph-mon[96918]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:19:18.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:18 smithi187 ceph-mon[96918]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:19:18.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:18 smithi195 ceph-mon[97365]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:19:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:18 smithi195 ceph-mon[97365]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:18 smithi195 ceph-mon[97365]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:19:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:18 smithi195 ceph-mon[97365]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:19:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:18 smithi195 ceph-mon[97365]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:19:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:18 smithi195 ceph-mon[97365]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:19:18.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:18 smithi151 ceph-mon[95510]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:19:18.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:18 smithi151 ceph-mon[95510]: pgmap v6: 97 pgs: 97 active+clean; 1.0 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail 2023-07-21T22:19:18.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:18 smithi151 ceph-mon[95510]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:19:18.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:18 smithi151 ceph-mon[95510]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.conf 2023-07-21T22:19:18.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:18 smithi151 ceph-mon[95510]: Updating smithi187:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:19:18.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:18 smithi151 ceph-mon[95510]: Updating smithi195:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:19:19.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:19:19.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:19:19.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:19:19.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:19:19.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:19:19.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:19:19.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:19:19.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:19 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:19:19.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:19:19.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:19:19.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:19:19.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:19:19.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:19:19.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:19:19.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:19 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2023-07-21T22:19:19.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: Updating smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:19:19.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: Updating smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:19:19.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: Updating smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/config/ceph.client.admin.keyring 2023-07-21T22:19:19.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:19.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:19:19.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:19:19.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:19:19.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:19 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:19:20.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:20 smithi187 ceph-mon[96918]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 132 KiB/s wr, 50 op/s 2023-07-21T22:19:20.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:20 smithi195 ceph-mon[97365]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 132 KiB/s wr, 50 op/s 2023-07-21T22:19:20.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:20 smithi151 ceph-mon[95510]: pgmap v7: 97 pgs: 97 active+clean; 1.3 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 132 KiB/s wr, 50 op/s 2023-07-21T22:19:22.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:22 smithi187 ceph-mon[96918]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 39 op/s 2023-07-21T22:19:22.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:22 smithi195 ceph-mon[97365]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 39 op/s 2023-07-21T22:19:22.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:22 smithi151 ceph-mon[95510]: pgmap v8: 97 pgs: 97 active+clean; 1.3 MiB data, 327 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 103 KiB/s wr, 39 op/s 2023-07-21T22:19:24.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:24 smithi187 ceph-mon[96918]: pgmap v9: 97 pgs: 97 active+clean; 22 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 62 op/s 2023-07-21T22:19:24.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:24 smithi195 ceph-mon[97365]: pgmap v9: 97 pgs: 97 active+clean; 22 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 62 op/s 2023-07-21T22:19:24.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:24 smithi151 ceph-mon[95510]: pgmap v9: 97 pgs: 97 active+clean; 22 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 2.1 MiB/s wr, 62 op/s 2023-07-21T22:19:25.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:25 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:25.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:25 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:25.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:25 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:26.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:26 smithi187 ceph-mon[96918]: pgmap v10: 97 pgs: 97 active+clean; 22 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 1.9 MiB/s wr, 57 op/s 2023-07-21T22:19:26.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:26 smithi195 ceph-mon[97365]: pgmap v10: 97 pgs: 97 active+clean; 22 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 1.9 MiB/s wr, 57 op/s 2023-07-21T22:19:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:26 smithi151 ceph-mon[95510]: pgmap v10: 97 pgs: 97 active+clean; 22 MiB data, 333 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 1.9 MiB/s wr, 57 op/s 2023-07-21T22:19:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.876+0000 7f18cebff700 1 -- 172.21.15.151:0/2251435587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c80731c0 msgr2=0x7f18c810be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.876+0000 7f18cebff700 1 --2- 172.21.15.151:0/2251435587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c80731c0 0x7f18c810be00 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f18b4009990 tx=0x7f18b4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.876+0000 7f18cebff700 1 -- 172.21.15.151:0/2251435587 shutdown_connections 2023-07-21T22:19:26.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.876+0000 7f18cebff700 1 --2- 172.21.15.151:0/2251435587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18c810c340 0x7f18c810e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.876+0000 7f18cebff700 1 --2- 172.21.15.151:0/2251435587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18c80728b0 0x7f18c8072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.876+0000 7f18cebff700 1 --2- 172.21.15.151:0/2251435587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c80731c0 0x7f18c810be00 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.876+0000 7f18cebff700 1 -- 172.21.15.151:0/2251435587 >> 172.21.15.151:0/2251435587 conn(0x7f18c80fb600 msgr2=0x7f18c80fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.876+0000 7f18cebff700 1 -- 172.21.15.151:0/2251435587 shutdown_connections 2023-07-21T22:19:26.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.877+0000 7f18cebff700 1 -- 172.21.15.151:0/2251435587 wait complete. 2023-07-21T22:19:26.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.878+0000 7f18cebff700 1 Processor -- start 2023-07-21T22:19:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.878+0000 7f18cebff700 1 -- start start 2023-07-21T22:19:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.878+0000 7f18cebff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c80728b0 0x7f18c8197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.878+0000 7f18cebff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18c80731c0 0x7f18c81982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.878+0000 7f18cebff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18c810c340 0x7f18c819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.878+0000 7f18cebff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c819cf50 con 0x7f18c80728b0 2023-07-21T22:19:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.878+0000 7f18cebff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c819d0c0 con 0x7f18c810c340 2023-07-21T22:19:26.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.878+0000 7f18cebff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c819d280 con 0x7f18c80731c0 2023-07-21T22:19:26.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18cc99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c80728b0 0x7f18c8197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18c7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18c80731c0 0x7f18c81982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18c7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18c80731c0 0x7f18c81982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42240/0 (socket says 172.21.15.151:42240) 2023-07-21T22:19:26.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18c7fff700 1 -- 172.21.15.151:0/3875864869 learned_addr learned my addr 172.21.15.151:0/3875864869 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:26.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18cd19c700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18c810c340 0x7f18c819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18c7fff700 1 -- 172.21.15.151:0/3875864869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18c810c340 msgr2=0x7f18c819c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18c7fff700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18c810c340 0x7f18c819c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18c7fff700 1 -- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c80728b0 msgr2=0x7f18c8197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18c7fff700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c80728b0 0x7f18c8197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18c7fff700 1 -- 172.21.15.151:0/3875864869 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c0009c40 con 0x7f18c80731c0 2023-07-21T22:19:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18cd19c700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18c810c340 0x7f18c819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:26.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18cc99b700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c80728b0 0x7f18c8197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.879+0000 7f18c7fff700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18c80731c0 0x7f18c81982a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f18b4000c00 tx=0x7f18b4004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.880+0000 7f18c5ffb700 1 -- 172.21.15.151:0/3875864869 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b401d070 con 0x7f18c80731c0 2023-07-21T22:19:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.880+0000 7f18cebff700 1 -- 172.21.15.151:0/3875864869 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b40095f0 con 0x7f18c80731c0 2023-07-21T22:19:26.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.880+0000 7f18c5ffb700 1 -- 172.21.15.151:0/3875864869 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18b4022470 con 0x7f18c80731c0 2023-07-21T22:19:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.880+0000 7f18c5ffb700 1 -- 172.21.15.151:0/3875864869 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b4017650 con 0x7f18c80731c0 2023-07-21T22:19:26.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.880+0000 7f18cebff700 1 -- 172.21.15.151:0/3875864869 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c81a4bc0 con 0x7f18c80731c0 2023-07-21T22:19:26.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.884+0000 7f18c5ffb700 1 -- 172.21.15.151:0/3875864869 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f18b40225e0 con 0x7f18c80731c0 2023-07-21T22:19:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18e248cb80 1 Processor -- start 2023-07-21T22:19:26.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18e248cb80 1 -- start start 2023-07-21T22:19:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18c5ffb700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f18b80a1350 0x7f18b80a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c62cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 0x55ac33c5cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63660 0x55ac33c5d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18e248cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33b62c50 con 0x55ac33c63660 2023-07-21T22:19:26.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18e248cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33bb59e0 con 0x55ac33c63210 2023-07-21T22:19:26.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18e248cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33baee70 con 0x55ac33ab96b0 2023-07-21T22:19:26.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.886+0000 7f18c5ffb700 1 -- 172.21.15.151:0/3875864869 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f18b40ce2d0 con 0x7f18c80731c0 2023-07-21T22:19:26.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cc99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c62cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cc99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c62cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42244/0 (socket says 172.21.15.151:42244) 2023-07-21T22:19:26.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cc99b700 1 -- 172.21.15.151:0/1102643060 learned_addr learned my addr 172.21.15.151:0/1102643060 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:26.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18c7fff700 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 0x55ac33c5cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cd19c700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f18b80a1350 0x7f18b80a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cd19c700 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63660 0x55ac33c5d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cc99b700 1 -- 172.21.15.151:0/1102643060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 msgr2=0x55ac33c5cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cc99b700 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 0x55ac33c5cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cc99b700 1 -- 172.21.15.151:0/1102643060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63660 msgr2=0x55ac33c5d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cc99b700 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63660 0x55ac33c5d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cc99b700 1 -- 172.21.15.151:0/1102643060 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac339dcd80 con 0x55ac33ab96b0 2023-07-21T22:19:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cd19c700 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63660 0x55ac33c5d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.887+0000 7f18cc99b700 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c62cd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0115f0 tx=0x7f18bc011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5057a6481398503 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18b2ffd700 1 -- 172.21.15.151:0/1102643060 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc019630 con 0x55ac33ab96b0 2023-07-21T22:19:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18b2ffd700 1 -- 172.21.15.151:0/1102643060 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18bc019c20 con 0x55ac33ab96b0 2023-07-21T22:19:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18b2ffd700 1 -- 172.21.15.151:0/1102643060 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18bc00eb40 con 0x55ac33ab96b0 2023-07-21T22:19:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18cd19c700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f18b80a1350 0x7f18b80a3800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x55ac33c63a70 tx=0x7f18c0009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18e248cb80 1 -- 172.21.15.151:0/1102643060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 msgr2=0x55ac33c62cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c62cd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f18bc0115f0 tx=0x7f18bc011900 comp rx=0 tx=0).stop 2023-07-21T22:19:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18e248cb80 1 -- 172.21.15.151:0/1102643060 shutdown_connections 2023-07-21T22:19:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63660 0x55ac33c5d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c62cd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.888+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1102643060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 0x55ac33c5cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.889+0000 7f18e248cb80 1 -- 172.21.15.151:0/1102643060 >> 172.21.15.151:0/1102643060 conn(0x55ac33c52ae0 msgr2=0x55ac33c580e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.889+0000 7f18e248cb80 1 -- 172.21.15.151:0/1102643060 shutdown_connections 2023-07-21T22:19:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.889+0000 7f18e248cb80 1 -- 172.21.15.151:0/1102643060 wait complete. 2023-07-21T22:19:26.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.889+0000 7f18e248cb80 1 -- start start 2023-07-21T22:19:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.889+0000 7f18e248cb80 1 Processor -- start 2023-07-21T22:19:26.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 0x55ac33c695c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 0x55ac33c667d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63660 0x55ac33c66f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18e248cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33b4ea60 con 0x55ac33ab96b0 2023-07-21T22:19:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18e248cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33b4e760 con 0x55ac33c63210 2023-07-21T22:19:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18e248cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33a328c0 con 0x55ac33c63660 2023-07-21T22:19:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18e248cb80 10 client.0 _ll_register_callbacks cb 0x55ac33b4c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18cc99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 0x55ac33c695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18c7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 0x55ac33c667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18cc99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 0x55ac33c695c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44258/0 (socket says 172.21.15.151:44258) 2023-07-21T22:19:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18cc99b700 1 -- 172.21.15.151:0/2231112770 learned_addr learned my addr 172.21.15.151:0/2231112770 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.890+0000 7f18cd19c700 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63660 0x55ac33c66f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18c7fff700 1 -- 172.21.15.151:0/2231112770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63660 msgr2=0x55ac33c66f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18c7fff700 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63660 0x55ac33c66f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18c7fff700 1 -- 172.21.15.151:0/2231112770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 msgr2=0x55ac33c695c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18c7fff700 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 0x55ac33c695c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18c7fff700 1 -- 172.21.15.151:0/2231112770 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18bc009dd0 con 0x55ac33c63210 2023-07-21T22:19:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18c7fff700 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 0x55ac33c667d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18b40cb9b0 tx=0x7f18b409af40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2e8bf0bd10e28c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:19:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18a7fff700 1 -- 172.21.15.151:0/2231112770 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b409f150 con 0x55ac33c63210 2023-07-21T22:19:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18e248cb80 1 -- 172.21.15.151:0/2231112770 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac33b08490 con 0x55ac33c63210 2023-07-21T22:19:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.891+0000 7f18a7fff700 1 -- 172.21.15.151:0/2231112770 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f18b409b310 con 0x55ac33c63210 2023-07-21T22:19:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18a7fff700 1 -- 172.21.15.151:0/2231112770 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18b409f340 con 0x55ac33c63210 2023-07-21T22:19:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18e248cb80 10 client.25331 fetch_fsmap learned FSMap version 24 2023-07-21T22:19:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18e248cb80 1 -- 172.21.15.151:0/2231112770 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ac339c5c00 con 0x55ac33c63210 2023-07-21T22:19:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18a7fff700 1 -- 172.21.15.151:0/2231112770 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ac33b08490 con 0x55ac33c63210 2023-07-21T22:19:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18a7fff700 1 -- 172.21.15.151:0/2231112770 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 24) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f18b409b570 con 0x55ac33c63210 2023-07-21T22:19:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18e248cb80 10 client.25331 fetch_fsmap finished waiting for FSMap version 24 2023-07-21T22:19:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18e248cb80 10 client.25331 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18e248cb80 20 client.25331 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:26.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac33c75f70 0x55ac33c78350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18e248cb80 4 client.25331 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.892+0000 7f18e248cb80 1 -- 172.21.15.151:0/2231112770 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac33ba7e50 con 0x55ac33c75f70 2023-07-21T22:19:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.893+0000 7f18cc99b700 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac33c75f70 0x55ac33c78350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.893+0000 7f18cc99b700 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac33c75f70 0x55ac33c78350 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b73e97177f6b7c72 server_cookie=f95b40c546899b81 in_seq=0 out_seq=0 2023-07-21T22:19:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.893+0000 7f18a7fff700 10 client.25331 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:26.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18a7fff700 1 -- 172.21.15.151:0/2231112770 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ac33ba7e50 con 0x55ac33c75f70 2023-07-21T22:19:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18a7fff700 10 client.25331 handle_command_reply: tid=0 2023-07-21T22:19:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 client.25331 shutdown 2023-07-21T22:19:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 -- 172.21.15.151:0/2231112770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 msgr2=0x55ac33c667d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 0x55ac33c667d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f18b40cb9b0 tx=0x7f18b409af40 comp rx=0 tx=0).stop 2023-07-21T22:19:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 -- 172.21.15.151:0/2231112770 shutdown_connections 2023-07-21T22:19:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac33c75f70 0x55ac33c78350 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63660 0x55ac33c66f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 0x55ac33c695c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18a7fff700 0 client.25331 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2231112770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63210 0x55ac33c667d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 -- 172.21.15.151:0/2231112770 >> 172.21.15.151:0/2231112770 conn(0x55ac33c52ae0 msgr2=0x55ac33c573e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 -- 172.21.15.151:0/2231112770 shutdown_connections 2023-07-21T22:19:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 1 -- 172.21.15.151:0/2231112770 wait complete. 2023-07-21T22:19:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.894+0000 7f18e248cb80 20 client.25331 trim_cache size 0 max 16384 2023-07-21T22:19:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.912+0000 7f18e248cb80 1 Processor -- start 2023-07-21T22:19:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.912+0000 7f18e248cb80 1 -- start start 2023-07-21T22:19:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.912+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 0x55ac33c7bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.912+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63210 0x55ac33c80940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.912+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63660 0x55ac33c722b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.912+0000 7f18e248cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33c5df50 con 0x55ac33ab96b0 2023-07-21T22:19:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.912+0000 7f18e248cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33c612a0 con 0x55ac33c63660 2023-07-21T22:19:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.912+0000 7f18e248cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33c59760 con 0x55ac33c63210 2023-07-21T22:19:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18cc99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 0x55ac33c7bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18c7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63210 0x55ac33c80940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18c7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63210 0x55ac33c80940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42256/0 (socket says 172.21.15.151:42256) 2023-07-21T22:19:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18c7fff700 1 -- 172.21.15.151:0/2640569076 learned_addr learned my addr 172.21.15.151:0/2640569076 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18cd19c700 1 --2- 172.21.15.151:0/2640569076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63660 0x55ac33c722b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18c7fff700 1 -- 172.21.15.151:0/2640569076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63660 msgr2=0x55ac33c722b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18c7fff700 1 --2- 172.21.15.151:0/2640569076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63660 0x55ac33c722b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18c7fff700 1 -- 172.21.15.151:0/2640569076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 msgr2=0x55ac33c7bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18c7fff700 1 --2- 172.21.15.151:0/2640569076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 0x55ac33c7bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18c7fff700 1 -- 172.21.15.151:0/2640569076 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac33a031f0 con 0x55ac33c63210 2023-07-21T22:19:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.913+0000 7f18c7fff700 1 --2- 172.21.15.151:0/2640569076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63210 0x55ac33c80940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18b4097d80 tx=0x7f18b4005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfbf623e9c9c1936 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.914+0000 7f18b37fe700 1 -- 172.21.15.151:0/2640569076 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b409f150 con 0x55ac33c63210 2023-07-21T22:19:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.914+0000 7f18b37fe700 1 -- 172.21.15.151:0/2640569076 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18b40a36d0 con 0x55ac33c63210 2023-07-21T22:19:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.914+0000 7f18b37fe700 1 -- 172.21.15.151:0/2640569076 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b409aa70 con 0x55ac33c63210 2023-07-21T22:19:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.914+0000 7f18e248cb80 1 -- 172.21.15.151:0/2640569076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63210 msgr2=0x55ac33c80940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.914+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2640569076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63210 0x55ac33c80940 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18b4097d80 tx=0x7f18b4005c90 comp rx=0 tx=0).stop 2023-07-21T22:19:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.915+0000 7f18e248cb80 1 -- 172.21.15.151:0/2640569076 shutdown_connections 2023-07-21T22:19:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.915+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2640569076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63660 0x55ac33c722b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.915+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2640569076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33ab96b0 0x55ac33c7bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.915+0000 7f18e248cb80 1 --2- 172.21.15.151:0/2640569076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33c63210 0x55ac33c80940 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.915+0000 7f18e248cb80 1 -- 172.21.15.151:0/2640569076 >> 172.21.15.151:0/2640569076 conn(0x55ac33c52ae0 msgr2=0x55ac33c71ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.915+0000 7f18e248cb80 1 -- 172.21.15.151:0/2640569076 shutdown_connections 2023-07-21T22:19:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.915+0000 7f18e248cb80 1 -- 172.21.15.151:0/2640569076 wait complete. 2023-07-21T22:19:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.915+0000 7f18e248cb80 1 -- start start 2023-07-21T22:19:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18e248cb80 1 Processor -- start 2023-07-21T22:19:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c5fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63210 0x55ac33c60090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18e248cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63660 0x55ac33c57400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18e248cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33c57940 con 0x55ac33c63210 2023-07-21T22:19:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18e248cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33c57ab0 con 0x55ac33c63660 2023-07-21T22:19:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18e248cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac33c57c70 con 0x55ac33ab96b0 2023-07-21T22:19:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18e248cb80 10 client.0 _ll_register_callbacks cb 0x7f18b4097740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63210 0x55ac33c60090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18cc99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c5fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63210 0x55ac33c60090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44276/0 (socket says 172.21.15.151:44276) 2023-07-21T22:19:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.916+0000 7f18c7fff700 1 -- 172.21.15.151:0/1869914236 learned_addr learned my addr 172.21.15.151:0/1869914236 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18c7fff700 1 -- 172.21.15.151:0/1869914236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 msgr2=0x55ac33c5fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18c7fff700 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c5fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18c7fff700 1 -- 172.21.15.151:0/1869914236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63660 msgr2=0x55ac33c57400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18c7fff700 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63660 0x55ac33c57400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:26.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18c7fff700 1 -- 172.21.15.151:0/1869914236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ac339c5c00 con 0x55ac33c63210 2023-07-21T22:19:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18cc99b700 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c5fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18c7fff700 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63210 0x55ac33c60090 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f18b400f740 tx=0x7f18b40a3450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c88606288c8a33 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:19:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18a7fff700 1 -- 172.21.15.151:0/1869914236 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b409f150 con 0x55ac33c63210 2023-07-21T22:19:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18a7fff700 1 -- 172.21.15.151:0/1869914236 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f18b409b310 con 0x55ac33c63210 2023-07-21T22:19:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.917+0000 7f18e248cb80 1 -- 172.21.15.151:0/1869914236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f18bc019c20 con 0x55ac33c63210 2023-07-21T22:19:26.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18a7fff700 1 -- 172.21.15.151:0/1869914236 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f18b409ae50 con 0x55ac33c63210 2023-07-21T22:19:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18e248cb80 10 client.15570 fetch_fsmap learned FSMap version 24 2023-07-21T22:19:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18e248cb80 1 -- 172.21.15.151:0/1869914236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) v3 -- 0x55ac339db250 con 0x55ac33c63210 2023-07-21T22:19:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18a7fff700 1 -- 172.21.15.151:0/1869914236 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f18bc019c20 con 0x55ac33c63210 2023-07-21T22:19:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18a7fff700 1 -- 172.21.15.151:0/1869914236 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 24) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f18b409a270 con 0x55ac33c63210 2023-07-21T22:19:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18e248cb80 10 client.15570 fetch_fsmap finished waiting for FSMap version 24 2023-07-21T22:19:26.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18e248cb80 10 client.15570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18e248cb80 20 client.15570 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac33ccb540 0x55ac33ccd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18e248cb80 4 client.15570 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:19:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.918+0000 7f18e248cb80 1 -- 172.21.15.151:0/1869914236 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ac33b69ff0 con 0x55ac33ccb540 2023-07-21T22:19:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.919+0000 7f18cc99b700 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac33ccb540 0x55ac33ccd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:26.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.919+0000 7f18cc99b700 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac33ccb540 0x55ac33ccd920 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dbb44aaec4589570 server_cookie=9b6991d7f2281b65 in_seq=0 out_seq=0 2023-07-21T22:19:26.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.919+0000 7f18a7fff700 10 client.15570 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.984+0000 7f18a7fff700 1 -- 172.21.15.151:0/1869914236 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ac33b69ff0 con 0x55ac33ccb540 2023-07-21T22:19:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.984+0000 7f18a7fff700 10 client.15570 handle_command_reply: tid=0 2023-07-21T22:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.984+0000 7f18e248cb80 1 client.15570 shutdown 2023-07-21T22:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 -- 172.21.15.151:0/1869914236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63210 msgr2=0x55ac33c60090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63210 0x55ac33c60090 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f18b400f740 tx=0x7f18b40a3450 comp rx=0 tx=0).stop 2023-07-21T22:19:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 -- 172.21.15.151:0/1869914236 shutdown_connections 2023-07-21T22:19:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac33ccb540 0x55ac33ccd920 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac33c63660 0x55ac33c57400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac33ab96b0 0x55ac33c5fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 --2- 172.21.15.151:0/1869914236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac33c63210 0x55ac33c60090 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 -- 172.21.15.151:0/1869914236 >> 172.21.15.151:0/1869914236 conn(0x55ac33c52ae0 msgr2=0x55ac33c72430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18a7fff700 0 client.15570 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 -- 172.21.15.151:0/1869914236 shutdown_connections 2023-07-21T22:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 1 -- 172.21.15.151:0/1869914236 wait complete. 2023-07-21T22:19:27.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.985+0000 7f18e248cb80 20 client.15570 trim_cache size 0 max 16384 2023-07-21T22:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:19:27.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:19:27.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 -- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f18b80a1350 msgr2=0x7f18b80a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f18b80a1350 0x7f18b80a3800 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x55ac33c63a70 tx=0x7f18c0009920 comp rx=0 tx=0).stop 2023-07-21T22:19:27.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 -- 172.21.15.151:0/3875864869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18c80731c0 msgr2=0x7f18c81982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:27.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18c80731c0 0x7f18c81982a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f18b4000c00 tx=0x7f18b4004730 comp rx=0 tx=0).stop 2023-07-21T22:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 -- 172.21.15.151:0/3875864869 shutdown_connections 2023-07-21T22:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f18b80a1350 0x7f18b80a3800 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18c810c340 0x7f18c819c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18c80728b0 0x7f18c8197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 --2- 172.21.15.151:0/3875864869 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f18c80731c0 0x7f18c81982a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 -- 172.21.15.151:0/3875864869 >> 172.21.15.151:0/3875864869 conn(0x7f18c80fb600 msgr2=0x7f18c810e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:27.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 -- 172.21.15.151:0/3875864869 shutdown_connections 2023-07-21T22:19:27.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:26.986+0000 7f18cebff700 1 -- 172.21.15.151:0/3875864869 wait complete. 2023-07-21T22:19:28.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:28 smithi187 ceph-mon[96918]: pgmap v11: 97 pgs: 97 active+clean; 24 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 2.2 MiB/s wr, 66 op/s 2023-07-21T22:19:28.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:28 smithi195 ceph-mon[97365]: pgmap v11: 97 pgs: 97 active+clean; 24 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 2.2 MiB/s wr, 66 op/s 2023-07-21T22:19:28.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:28 smithi151 ceph-mon[95510]: pgmap v11: 97 pgs: 97 active+clean; 24 MiB data, 335 MiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 2.2 MiB/s wr, 66 op/s 2023-07-21T22:19:30.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:30 smithi187 ceph-mon[96918]: pgmap v12: 97 pgs: 97 active+clean; 38 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 3.9 MiB/s wr, 128 op/s 2023-07-21T22:19:30.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:30 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:30.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:30 smithi195 ceph-mon[97365]: pgmap v12: 97 pgs: 97 active+clean; 38 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 3.9 MiB/s wr, 128 op/s 2023-07-21T22:19:30.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:30 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:30.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:30 smithi151 ceph-mon[95510]: pgmap v12: 97 pgs: 97 active+clean; 38 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 266 KiB/s rd, 3.9 MiB/s wr, 128 op/s 2023-07-21T22:19:30.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:30 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:31.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.617+0000 7f39fa19d700 1 -- 172.21.15.151:0/2875443104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39f41059e0 msgr2=0x7f39f4105db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.662 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.617+0000 7f39fa19d700 1 --2- 172.21.15.151:0/2875443104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39f41059e0 0x7f39f4105db0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f39f00098f0 tx=0x7f39f0009c00 comp rx=0 tx=0).stop 2023-07-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.617+0000 7f39fa19d700 1 -- 172.21.15.151:0/2875443104 shutdown_connections 2023-07-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.617+0000 7f39fa19d700 1 --2- 172.21.15.151:0/2875443104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f4100380 0x7f39f410c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.617+0000 7f39fa19d700 1 --2- 172.21.15.151:0/2875443104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39f41059e0 0x7f39f4105db0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.617+0000 7f39fa19d700 1 --2- 172.21.15.151:0/2875443104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39f40ff9d0 0x7f39f40ffe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.617+0000 7f39fa19d700 1 -- 172.21.15.151:0/2875443104 >> 172.21.15.151:0/2875443104 conn(0x7f39f40fb4b0 msgr2=0x7f39f40fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.618+0000 7f39fa19d700 1 -- 172.21.15.151:0/2875443104 shutdown_connections 2023-07-21T22:19:31.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.618+0000 7f39fa19d700 1 -- 172.21.15.151:0/2875443104 wait complete. 2023-07-21T22:19:31.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.619+0000 7f39fa19d700 1 Processor -- start 2023-07-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.619+0000 7f39fa19d700 1 -- start start 2023-07-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39fa19d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39f40ff9d0 0x7f39f419d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39fa19d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f4100380 0x7f39f419de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39fa19d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39f41059e0 0x7f39f4197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39fa19d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4198000 con 0x7f39f4100380 2023-07-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39fa19d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4198170 con 0x7f39f40ff9d0 2023-07-21T22:19:31.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39fa19d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39f4198330 con 0x7f39f41059e0 2023-07-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f919b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39f40ff9d0 0x7f39f419d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f919b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39f40ff9d0 0x7f39f419d920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34596/0 (socket says 172.21.15.151:34596) 2023-07-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f919b700 1 -- 172.21.15.151:0/3687930800 learned_addr learned my addr 172.21.15.151:0/3687930800 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f999c700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39f41059e0 0x7f39f4197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f899a700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f4100380 0x7f39f419de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f919b700 1 -- 172.21.15.151:0/3687930800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39f41059e0 msgr2=0x7f39f4197990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f919b700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39f41059e0 0x7f39f4197990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f919b700 1 -- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f4100380 msgr2=0x7f39f419de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f919b700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f4100380 0x7f39f419de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.620+0000 7f39f919b700 1 -- 172.21.15.151:0/3687930800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f0009520 con 0x7f39f40ff9d0 2023-07-21T22:19:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.621+0000 7f39f919b700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39f40ff9d0 0x7f39f419d920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009fd0 tx=0x7f39f000bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.621+0000 7f39ea7fc700 1 -- 172.21.15.151:0/3687930800 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f001c070 con 0x7f39f40ff9d0 2023-07-21T22:19:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.621+0000 7f39fa19d700 1 -- 172.21.15.151:0/3687930800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39f41985b0 con 0x7f39f40ff9d0 2023-07-21T22:19:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.621+0000 7f39ea7fc700 1 -- 172.21.15.151:0/3687930800 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39f000baf0 con 0x7f39f40ff9d0 2023-07-21T22:19:31.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.621+0000 7f39ea7fc700 1 -- 172.21.15.151:0/3687930800 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f0004930 con 0x7f39f40ff9d0 2023-07-21T22:19:31.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.621+0000 7f39fa19d700 1 -- 172.21.15.151:0/3687930800 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39f41a4910 con 0x7f39f40ff9d0 2023-07-21T22:19:31.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.625+0000 7f39ea7fc700 1 -- 172.21.15.151:0/3687930800 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f39f0020070 con 0x7f39f40ff9d0 2023-07-21T22:19:31.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.625+0000 7f3a0edaeb80 1 Processor -- start 2023-07-21T22:19:31.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f3a0edaeb80 1 -- start start 2023-07-21T22:19:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39432860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432da0 0x558a3943d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a3943dc40 0x558a39440020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a39338cb0 con 0x558a39432490 2023-07-21T22:19:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a3938ba40 con 0x558a3943dc40 2023-07-21T22:19:31.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a39384ed0 con 0x558a39432da0 2023-07-21T22:19:31.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f39f999c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39432860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f39f919b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432da0 0x558a3943d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f39f999c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39432860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44302/0 (socket says 172.21.15.151:44302) 2023-07-21T22:19:31.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f39f999c700 1 -- 172.21.15.151:0/3884209422 learned_addr learned my addr 172.21.15.151:0/3884209422 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:31.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.626+0000 7f39f899a700 1 --2- 172.21.15.151:0/3884209422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a3943dc40 0x558a39440020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39f999c700 1 -- 172.21.15.151:0/3884209422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432da0 msgr2=0x558a3943d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39f999c700 1 --2- 172.21.15.151:0/3884209422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432da0 0x558a3943d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39f999c700 1 -- 172.21.15.151:0/3884209422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a3943dc40 msgr2=0x558a39440020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39f999c700 1 --2- 172.21.15.151:0/3884209422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a3943dc40 0x558a39440020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39f999c700 1 -- 172.21.15.151:0/3884209422 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a391b2de0 con 0x558a39432490 2023-07-21T22:19:31.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39ea7fc700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f39e00a1470 0x7f39e00a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39f999c700 1 --2- 172.21.15.151:0/3884209422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39432860 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f39ec011600 tx=0x7f39ec0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a54c2071bcb6056 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39ea7fc700 1 -- 172.21.15.151:0/3687930800 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f39f00cdab0 con 0x7f39f40ff9d0 2023-07-21T22:19:31.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39f919b700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f39e00a1470 0x7f39e00a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.627+0000 7f39df7fe700 1 -- 172.21.15.151:0/3884209422 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00e040 con 0x558a39432490 2023-07-21T22:19:31.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f39df7fe700 1 -- 172.21.15.151:0/3884209422 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39ec00f040 con 0x558a39432490 2023-07-21T22:19:31.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f39df7fe700 1 -- 172.21.15.151:0/3884209422 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0044e0 con 0x558a39432490 2023-07-21T22:19:31.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3884209422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 msgr2=0x558a39432860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3884209422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39432860 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f39ec011600 tx=0x7f39ec0099e0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f39f919b700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f39e00a1470 0x7f39e00a3920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f39f00cb1f0 tx=0x7f39f00d14b0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3884209422 shutdown_connections 2023-07-21T22:19:31.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3884209422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a3943dc40 0x558a39440020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3884209422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39432860 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3884209422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432da0 0x558a3943d700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.628+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3884209422 >> 172.21.15.151:0/3884209422 conn(0x558a39428ef0 msgr2=0x558a3942e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.629+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3884209422 shutdown_connections 2023-07-21T22:19:31.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.629+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3884209422 wait complete. 2023-07-21T22:19:31.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.629+0000 7f3a0edaeb80 1 -- start start 2023-07-21T22:19:31.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f3a0edaeb80 1 Processor -- start 2023-07-21T22:19:31.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432490 0x558a3943d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432da0 0x558a3943a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 0x558a3943aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a39324ac0 con 0x558a39432da0 2023-07-21T22:19:31.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a393247c0 con 0x558a39432490 2023-07-21T22:19:31.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a39208920 con 0x558a3943dc40 2023-07-21T22:19:31.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f3a0edaeb80 10 client.0 _ll_register_callbacks cb 0x558a39322760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:31.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f39f999c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432490 0x558a3943d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.630+0000 7f39f899a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432da0 0x558a3943a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39f999c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432490 0x558a3943d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34612/0 (socket says 172.21.15.151:34612) 2023-07-21T22:19:31.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39f999c700 1 -- 172.21.15.151:0/1537662541 learned_addr learned my addr 172.21.15.151:0/1537662541 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:31.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39f999c700 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 0x558a3943aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39f999c700 1 -- 172.21.15.151:0/1537662541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 msgr2=0x558a3943aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39f999c700 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 0x558a3943aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39f999c700 1 -- 172.21.15.151:0/1537662541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432da0 msgr2=0x558a3943a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39f999c700 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432da0 0x558a3943a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39f999c700 1 -- 172.21.15.151:0/1537662541 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39ec0112b0 con 0x558a39432490 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39f999c700 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432490 0x558a3943d5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39ec006080 tx=0x7f39ec0061f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=699913b7db5b61f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.631+0000 7f39dcff9700 1 -- 172.21.15.151:0/1537662541 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec0043d0 con 0x558a39432490 2023-07-21T22:19:31.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1537662541 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a392de4f0 con 0x558a39432490 2023-07-21T22:19:31.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f39dcff9700 1 -- 172.21.15.151:0/1537662541 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f39ec004530 con 0x558a39432490 2023-07-21T22:19:31.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f39dcff9700 1 -- 172.21.15.151:0/1537662541 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39ec0046f0 con 0x558a39432490 2023-07-21T22:19:31.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f3a0edaeb80 10 client.25346 fetch_fsmap learned FSMap version 25 2023-07-21T22:19:31.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1537662541 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558a3919bc60 con 0x558a39432490 2023-07-21T22:19:31.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f39dcff9700 1 -- 172.21.15.151:0/1537662541 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a392de4f0 con 0x558a39432490 2023-07-21T22:19:31.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f39dcff9700 1 -- 172.21.15.151:0/1537662541 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f39ec02a030 con 0x558a39432490 2023-07-21T22:19:31.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f3a0edaeb80 10 client.25346 fetch_fsmap finished waiting for FSMap version 25 2023-07-21T22:19:31.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f3a0edaeb80 10 client.25346 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:31.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f3a0edaeb80 20 client.25346 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:31.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a3944d510 0x558a3944f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f3a0edaeb80 4 client.25346 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:31.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.632+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1537662541 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a3937deb0 con 0x558a3944d510 2023-07-21T22:19:31.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.633+0000 7f39f899a700 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a3944d510 0x558a3944f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.633+0000 7f39f899a700 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a3944d510 0x558a3944f920 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=470f48b8dca2be51 server_cookie=6eafeca984f6df47 in_seq=0 out_seq=0 2023-07-21T22:19:31.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.633+0000 7f39dcff9700 10 client.25346 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:31.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f39dcff9700 1 -- 172.21.15.151:0/1537662541 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558a3937deb0 con 0x558a3944d510 2023-07-21T22:19:31.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f39dcff9700 10 client.25346 handle_command_reply: tid=0 2023-07-21T22:19:31.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 client.25346 shutdown 2023-07-21T22:19:31.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1537662541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432490 msgr2=0x558a3943d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432490 0x558a3943d5d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f39ec006080 tx=0x7f39ec0061f0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1537662541 shutdown_connections 2023-07-21T22:19:31.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a3944d510 0x558a3944f920 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432490 0x558a3943d5d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 0x558a3943aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1537662541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432da0 0x558a3943a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f39dcff9700 0 client.25346 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:31.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1537662541 >> 172.21.15.151:0/1537662541 conn(0x558a39428ef0 msgr2=0x558a3942e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1537662541 shutdown_connections 2023-07-21T22:19:31.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.634+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1537662541 wait complete. 2023-07-21T22:19:31.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.635+0000 7f3a0edaeb80 20 client.25346 trim_cache size 0 max 16384 2023-07-21T22:19:31.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.654+0000 7f3a0edaeb80 1 Processor -- start 2023-07-21T22:19:31.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.654+0000 7f3a0edaeb80 1 -- start start 2023-07-21T22:19:31.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.654+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39435ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.654+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a394360e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.654+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 0x558a39437b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.654+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a39435700 con 0x558a39432490 2023-07-21T22:19:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.654+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a3942f670 con 0x558a39432da0 2023-07-21T22:19:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.654+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a3943be30 con 0x558a3943dc40 2023-07-21T22:19:31.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f899a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a394360e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f999c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39435ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f899a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a394360e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34622/0 (socket says 172.21.15.151:34622) 2023-07-21T22:19:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f899a700 1 -- 172.21.15.151:0/1875855865 learned_addr learned my addr 172.21.15.151:0/1875855865 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f999c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39435ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44324/0 (socket says 172.21.15.151:44324) 2023-07-21T22:19:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f999c700 1 --2- 172.21.15.151:0/1875855865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 0x558a39437b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f899a700 1 -- 172.21.15.151:0/1875855865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 msgr2=0x558a39437b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f899a700 1 --2- 172.21.15.151:0/1875855865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 0x558a39437b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f899a700 1 -- 172.21.15.151:0/1875855865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 msgr2=0x558a39435ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f899a700 1 --2- 172.21.15.151:0/1875855865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39435ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f899a700 1 -- 172.21.15.151:0/1875855865 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a391d9250 con 0x558a39432da0 2023-07-21T22:19:31.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39f899a700 1 --2- 172.21.15.151:0/1875855865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a394360e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x558a394501f0 tx=0x7f39e4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1cdc8c4333b183a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39dffff700 1 -- 172.21.15.151:0/1875855865 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4016030 con 0x558a39432da0 2023-07-21T22:19:31.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39dffff700 1 -- 172.21.15.151:0/1875855865 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39e4017040 con 0x558a39432da0 2023-07-21T22:19:31.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.655+0000 7f39dffff700 1 -- 172.21.15.151:0/1875855865 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39e4010690 con 0x558a39432da0 2023-07-21T22:19:31.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.656+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1875855865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 msgr2=0x558a394360e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.656+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1875855865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a394360e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x558a394501f0 tx=0x7f39e4009260 comp rx=0 tx=0).stop 2023-07-21T22:19:31.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.656+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1875855865 shutdown_connections 2023-07-21T22:19:31.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.656+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1875855865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a3943dc40 0x558a39437b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.656+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1875855865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a39432490 0x558a39435ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.656+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/1875855865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a394360e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.656+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1875855865 >> 172.21.15.151:0/1875855865 conn(0x558a39428ef0 msgr2=0x558a3942cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.656+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1875855865 shutdown_connections 2023-07-21T22:19:31.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.656+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/1875855865 wait complete. 2023-07-21T22:19:31.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.657+0000 7f3a0edaeb80 1 -- start start 2023-07-21T22:19:31.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.657+0000 7f3a0edaeb80 1 Processor -- start 2023-07-21T22:19:31.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.657+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432490 0x558a39442f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.657+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a39443470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.657+0000 7f3a0edaeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a3943dc40 0x558a394439b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.657+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a394a1480 con 0x558a3943dc40 2023-07-21T22:19:31.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.657+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a394a15c0 con 0x558a39432da0 2023-07-21T22:19:31.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.657+0000 7f3a0edaeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a394a1780 con 0x558a39432490 2023-07-21T22:19:31.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f3a0edaeb80 10 client.0 _ll_register_callbacks cb 0x7f39e4009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f999c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a3943dc40 0x558a394439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f999c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a3943dc40 0x558a394439b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44334/0 (socket says 172.21.15.151:44334) 2023-07-21T22:19:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f999c700 1 -- 172.21.15.151:0/3765735223 learned_addr learned my addr 172.21.15.151:0/3765735223 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f999c700 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432490 0x558a39442f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f899a700 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a39443470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f999c700 1 -- 172.21.15.151:0/3765735223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432490 msgr2=0x558a39442f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f999c700 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432490 0x558a39442f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f999c700 1 -- 172.21.15.151:0/3765735223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 msgr2=0x558a39443470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:31.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f999c700 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a39443470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.658+0000 7f39f999c700 1 -- 172.21.15.151:0/3765735223 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39e4009c70 con 0x558a3943dc40 2023-07-21T22:19:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f39f999c700 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a3943dc40 0x558a394439b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39ec011cf0 tx=0x7f39ec017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4384dfad82dfbc82 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f39dcff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:19:31.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f39dcff9700 1 -- 172.21.15.151:0/3765735223 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ec00e040 con 0x558a3943dc40 2023-07-21T22:19:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3765735223 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39ec00f040 con 0x558a3943dc40 2023-07-21T22:19:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f39dcff9700 1 -- 172.21.15.151:0/3765735223 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f39ec02b5c0 con 0x558a3943dc40 2023-07-21T22:19:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f39dcff9700 1 -- 172.21.15.151:0/3765735223 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39ec02b780 con 0x558a3943dc40 2023-07-21T22:19:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f3a0edaeb80 10 client.15588 fetch_fsmap learned FSMap version 25 2023-07-21T22:19:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3765735223 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x558a391b12b0 con 0x558a3943dc40 2023-07-21T22:19:31.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f39dcff9700 1 -- 172.21.15.151:0/3765735223 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f39ec00f040 con 0x558a3943dc40 2023-07-21T22:19:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.659+0000 7f39dcff9700 1 -- 172.21.15.151:0/3765735223 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f39ec02a070 con 0x558a3943dc40 2023-07-21T22:19:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.660+0000 7f3a0edaeb80 10 client.15588 fetch_fsmap finished waiting for FSMap version 25 2023-07-21T22:19:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.660+0000 7f3a0edaeb80 10 client.15588 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.660+0000 7f3a0edaeb80 20 client.15588 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.660+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a394a2ad0 0x558a394a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.660+0000 7f3a0edaeb80 4 client.15588 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:19:31.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.660+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3765735223 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x558a39340050 con 0x558a394a2ad0 2023-07-21T22:19:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.660+0000 7f39f899a700 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a394a2ad0 0x558a394a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.660+0000 7f39dcff9700 10 client.15588 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.660+0000 7f39f899a700 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a394a2ad0 0x558a394a4eb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=615db5b69914965f server_cookie=ef6997153cd932c8 in_seq=0 out_seq=0 2023-07-21T22:19:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f39dcff9700 1 -- 172.21.15.151:0/3765735223 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x558a39340050 con 0x558a394a2ad0 2023-07-21T22:19:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f39dcff9700 10 client.15588 handle_command_reply: tid=0 2023-07-21T22:19:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 client.15588 shutdown 2023-07-21T22:19:31.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3765735223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a3943dc40 msgr2=0x558a394439b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a3943dc40 0x558a394439b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f39ec011cf0 tx=0x7f39ec017040 comp rx=0 tx=0).stop 2023-07-21T22:19:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3765735223 shutdown_connections 2023-07-21T22:19:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a394a2ad0 0x558a394a4eb0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a3943dc40 0x558a394439b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a39432490 0x558a39442f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 --2- 172.21.15.151:0/3765735223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a39432da0 0x558a39443470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f39dcff9700 0 client.15588 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:31.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3765735223 >> 172.21.15.151:0/3765735223 conn(0x558a39428ef0 msgr2=0x558a39434340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3765735223 shutdown_connections 2023-07-21T22:19:31.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 1 -- 172.21.15.151:0/3765735223 wait complete. 2023-07-21T22:19:31.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.661+0000 7f3a0edaeb80 20 client.15588 trim_cache size 0 max 16384 2023-07-21T22:19:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:19:31.721 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "no active scrubs running", 2023-07-21T22:19:31.721 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": {} 2023-07-21T22:19:31.721 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:19:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 -- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f39e00a1470 msgr2=0x7f39e00a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f39e00a1470 0x7f39e00a3920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f39f00cb1f0 tx=0x7f39f00d14b0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 -- 172.21.15.151:0/3687930800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39f40ff9d0 msgr2=0x7f39f419d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39f40ff9d0 0x7f39f419d920 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f39f0009fd0 tx=0x7f39f000bf30 comp rx=0 tx=0).stop 2023-07-21T22:19:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 -- 172.21.15.151:0/3687930800 shutdown_connections 2023-07-21T22:19:31.722 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f39e00a1470 0x7f39e00a3920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39f40ff9d0 0x7f39f419d920 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f39f41059e0 0x7f39f4197990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 --2- 172.21.15.151:0/3687930800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f39f4100380 0x7f39f419de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 -- 172.21.15.151:0/3687930800 >> 172.21.15.151:0/3687930800 conn(0x7f39f40fb4b0 msgr2=0x7f39f410ac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 -- 172.21.15.151:0/3687930800 shutdown_connections 2023-07-21T22:19:31.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.662+0000 7f39fa19d700 1 -- 172.21.15.151:0/3687930800 wait complete. 2023-07-21T22:19:31.727 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-21T22:19:31.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:19:31.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.918+0000 7f3a645ff700 1 -- 172.21.15.151:0/1812654816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c105b00 msgr2=0x7f3a5c105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.918+0000 7f3a645ff700 1 --2- 172.21.15.151:0/1812654816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c105b00 0x7f3a5c105ed0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f3a580098f0 tx=0x7f3a58009c00 comp rx=0 tx=0).stop 2023-07-21T22:19:31.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.918+0000 7f3a645ff700 1 -- 172.21.15.151:0/1812654816 shutdown_connections 2023-07-21T22:19:31.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.918+0000 7f3a645ff700 1 --2- 172.21.15.151:0/1812654816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a5c1004a0 0x7f3a5c10c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.918+0000 7f3a645ff700 1 --2- 172.21.15.151:0/1812654816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c105b00 0x7f3a5c105ed0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.918+0000 7f3a645ff700 1 --2- 172.21.15.151:0/1812654816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a5c0ffaf0 0x7f3a5c0fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.918+0000 7f3a645ff700 1 -- 172.21.15.151:0/1812654816 >> 172.21.15.151:0/1812654816 conn(0x7f3a5c0fb630 msgr2=0x7f3a5c0fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:31.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.918+0000 7f3a645ff700 1 -- 172.21.15.151:0/1812654816 shutdown_connections 2023-07-21T22:19:31.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.918+0000 7f3a645ff700 1 -- 172.21.15.151:0/1812654816 wait complete. 2023-07-21T22:19:31.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.919+0000 7f3a645ff700 1 Processor -- start 2023-07-21T22:19:31.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.919+0000 7f3a645ff700 1 -- start start 2023-07-21T22:19:31.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a645ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c0ffaf0 0x7f3a5c197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a645ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a5c1004a0 0x7f3a5c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a645ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a5c105b00 0x7f3a5c19c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a645ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c19cd40 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.967 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a645ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c19ceb0 con 0x7f3a5c1004a0 2023-07-21T22:19:31.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a645ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c19d070 con 0x7f3a5c105b00 2023-07-21T22:19:31.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a6239b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c0ffaf0 0x7f3a5c197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.968 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a61b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a5c1004a0 0x7f3a5c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a6239b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c0ffaf0 0x7f3a5c197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44364/0 (socket says 172.21.15.151:44364) 2023-07-21T22:19:31.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a6239b700 1 -- 172.21.15.151:0/2062443580 learned_addr learned my addr 172.21.15.151:0/2062443580 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:31.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a62b9c700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a5c105b00 0x7f3a5c19c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.969 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a6239b700 1 -- 172.21.15.151:0/2062443580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a5c105b00 msgr2=0x7f3a5c19c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a6239b700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a5c105b00 0x7f3a5c19c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a6239b700 1 -- 172.21.15.151:0/2062443580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a5c1004a0 msgr2=0x7f3a5c1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a6239b700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a5c1004a0 0x7f3a5c1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:31.970 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a6239b700 1 -- 172.21.15.151:0/2062443580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0095f0 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.920+0000 7f3a62b9c700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a5c105b00 0x7f3a5c19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.921+0000 7f3a6239b700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c0ffaf0 0x7f3a5c197d60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009810 tx=0x7f3a5800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.921+0000 7f3a537fe700 1 -- 172.21.15.151:0/2062443580 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a5801c070 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.921+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a58009520 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.921+0000 7f3a537fe700 1 -- 172.21.15.151:0/2062443580 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a5800bb70 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.971 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.921+0000 7f3a537fe700 1 -- 172.21.15.151:0/2062443580 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a58004930 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.972 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.921+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c19d580 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.972 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.922+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c067300 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.924+0000 7f3a537fe700 1 -- 172.21.15.151:0/2062443580 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f3a58020070 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.926+0000 7f3a537fe700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a480a1390 0x7f3a480a3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:31.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.926+0000 7f3a537fe700 1 -- 172.21.15.151:0/2062443580 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3a580cdf10 con 0x7f3a5c0ffaf0 2023-07-21T22:19:31.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.926+0000 7f3a61b9a700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a480a1390 0x7f3a480a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:31.973 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.927+0000 7f3a61b9a700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a480a1390 0x7f3a480a3840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c199370 tx=0x7f3a4c009310 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:31.974 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:31.928+0000 7f3a537fe700 1 -- 172.21.15.151:0/2062443580 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f3a58097290 con 0x7f3a5c0ffaf0 2023-07-21T22:19:32.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.214+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3a5c1990b0 con 0x7f3a5c0ffaf0 2023-07-21T22:19:32.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.215+0000 7f3a537fe700 1 -- 172.21.15.151:0/2062443580 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) v1 ==== 94+0+10819 (secure 0 0 0) 0x7f3a58027020 con 0x7f3a5c0ffaf0 2023-07-21T22:19:32.260 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:32.260 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:19:29.226782+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:19:32.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a480a1390 msgr2=0x7f3a480a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a480a1390 0x7f3a480a3840 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c199370 tx=0x7f3a4c009310 comp rx=0 tx=0).stop 2023-07-21T22:19:32.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c0ffaf0 msgr2=0x7f3a5c197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c0ffaf0 0x7f3a5c197d60 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f3a58009810 tx=0x7f3a5800fa00 comp rx=0 tx=0).stop 2023-07-21T22:19:32.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 shutdown_connections 2023-07-21T22:19:32.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a480a1390 0x7f3a480a3840 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a5c105b00 0x7f3a5c19c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a5c0ffaf0 0x7f3a5c197d60 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 --2- 172.21.15.151:0/2062443580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a5c1004a0 0x7f3a5c1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 >> 172.21.15.151:0/2062443580 conn(0x7f3a5c0fb630 msgr2=0x7f3a5c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 shutdown_connections 2023-07-21T22:19:32.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.217+0000 7f3a645ff700 1 -- 172.21.15.151:0/2062443580 wait complete. 2023-07-21T22:19:32.266 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 25 2023-07-21T22:19:32.283 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-21T22:19:32.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.471+0000 7f6740fff700 1 -- 172.21.15.151:0/708708557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c100480 msgr2=0x7f673c10c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.471+0000 7f6740fff700 1 --2- 172.21.15.151:0/708708557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c100480 0x7f673c10c910 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f673400b0a0 tx=0x7f673400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.471+0000 7f6740fff700 1 -- 172.21.15.151:0/708708557 shutdown_connections 2023-07-21T22:19:32.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.471+0000 7f6740fff700 1 --2- 172.21.15.151:0/708708557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f673c105ae0 0x7f673c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.471+0000 7f6740fff700 1 --2- 172.21.15.151:0/708708557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c100480 0x7f673c10c910 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.471+0000 7f6740fff700 1 --2- 172.21.15.151:0/708708557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f673c0ffad0 0x7f673c0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.471+0000 7f6740fff700 1 -- 172.21.15.151:0/708708557 >> 172.21.15.151:0/708708557 conn(0x7f673c0fb5f0 msgr2=0x7f673c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.471+0000 7f6740fff700 1 -- 172.21.15.151:0/708708557 shutdown_connections 2023-07-21T22:19:32.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.471+0000 7f6740fff700 1 -- 172.21.15.151:0/708708557 wait complete. 2023-07-21T22:19:32.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.472+0000 7f6740fff700 1 Processor -- start 2023-07-21T22:19:32.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.472+0000 7f6740fff700 1 -- start start 2023-07-21T22:19:32.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f6740fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c0ffad0 0x7f673c197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f6740fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f673c100480 0x7f673c198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f6740fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f673c105ae0 0x7f673c19c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f6740fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c19cd90 con 0x7f673c0ffad0 2023-07-21T22:19:32.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f6740fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c19cf00 con 0x7f673c100480 2023-07-21T22:19:32.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f6740fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f673c19d0c0 con 0x7f673c105ae0 2023-07-21T22:19:32.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f673a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c0ffad0 0x7f673c197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f673a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c0ffad0 0x7f673c197e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44380/0 (socket says 172.21.15.151:44380) 2023-07-21T22:19:32.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f673a59c700 1 -- 172.21.15.151:0/3766502011 learned_addr learned my addr 172.21.15.151:0/3766502011 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f673ad9d700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f673c105ae0 0x7f673c19c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f6739d9b700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f673c100480 0x7f673c198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f673a59c700 1 -- 172.21.15.151:0/3766502011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f673c105ae0 msgr2=0x7f673c19c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f673a59c700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f673c105ae0 0x7f673c19c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f673a59c700 1 -- 172.21.15.151:0/3766502011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f673c100480 msgr2=0x7f673c198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f673a59c700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f673c100480 0x7f673c198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.473+0000 7f673a59c700 1 -- 172.21.15.151:0/3766502011 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6734009d00 con 0x7f673c0ffad0 2023-07-21T22:19:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.474+0000 7f673a59c700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c0ffad0 0x7f673c197e00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f672c00e9a0 tx=0x7f672c00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.474+0000 7f672b7fe700 1 -- 172.21.15.151:0/3766502011 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c009790 con 0x7f673c0ffad0 2023-07-21T22:19:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.474+0000 7f6740fff700 1 -- 172.21.15.151:0/3766502011 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f673c19d3a0 con 0x7f673c0ffad0 2023-07-21T22:19:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.474+0000 7f672b7fe700 1 -- 172.21.15.151:0/3766502011 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f672c00cbd0 con 0x7f673c0ffad0 2023-07-21T22:19:32.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.474+0000 7f672b7fe700 1 -- 172.21.15.151:0/3766502011 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c018680 con 0x7f673c0ffad0 2023-07-21T22:19:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.474+0000 7f6740fff700 1 -- 172.21.15.151:0/3766502011 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c1a4be0 con 0x7f673c0ffad0 2023-07-21T22:19:32.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.478+0000 7f672b7fe700 1 -- 172.21.15.151:0/3766502011 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f672c00cd40 con 0x7f673c0ffad0 2023-07-21T22:19:32.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f6754896b80 1 Processor -- start 2023-07-21T22:19:32.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f6754896b80 1 -- start start 2023-07-21T22:19:32.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f672b7fe700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67240a13d0 0x7f67240a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f6754896b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27e1b0 0x5594ec27e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f6754896b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 0x5594ec279350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f6754896b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec279da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f6754896b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec17ecb0 con 0x5594ec27eac0 2023-07-21T22:19:32.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f6754896b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec1d1a40 con 0x5594ec279930 2023-07-21T22:19:32.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f6754896b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec1caed0 con 0x5594ec27e1b0 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.479+0000 7f672b7fe700 1 -- 172.21.15.151:0/3766502011 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f672c014070 con 0x7f673c0ffad0 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f6739d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 0x5594ec279350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27e1b0 0x5594ec27e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27e1b0 0x5594ec27e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42356/0 (socket says 172.21.15.151:42356) 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673a59c700 1 -- 172.21.15.151:0/2939962587 learned_addr learned my addr 172.21.15.151:0/2939962587 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673ad9d700 1 --2- 172.21.15.151:0/2939962587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec279da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673ad9d700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67240a13d0 0x7f67240a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673a59c700 1 -- 172.21.15.151:0/2939962587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 msgr2=0x5594ec279da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673a59c700 1 --2- 172.21.15.151:0/2939962587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec279da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673a59c700 1 -- 172.21.15.151:0/2939962587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 msgr2=0x5594ec279350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673a59c700 1 --2- 172.21.15.151:0/2939962587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 0x5594ec279350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673a59c700 1 -- 172.21.15.151:0/2939962587 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594ebff8de0 con 0x5594ec27e1b0 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.480+0000 7f673a59c700 1 --2- 172.21.15.151:0/2939962587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27e1b0 0x5594ec27e580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f672c00e970 tx=0x7f672c099a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ce25630ab8a69a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.481+0000 7f6728ff9700 1 -- 172.21.15.151:0/2939962587 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0a24e0 con 0x5594ec27e1b0 2023-07-21T22:19:32.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.481+0000 7f6728ff9700 1 -- 172.21.15.151:0/2939962587 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f672c09a2f0 con 0x5594ec27e1b0 2023-07-21T22:19:32.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.481+0000 7f6728ff9700 1 -- 172.21.15.151:0/2939962587 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0a22b0 con 0x5594ec27e1b0 2023-07-21T22:19:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.481+0000 7f673ad9d700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67240a13d0 0x7f67240a3880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6734009850 tx=0x7f673400b700 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.481+0000 7f6754896b80 1 -- 172.21.15.151:0/2939962587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27e1b0 msgr2=0x5594ec27e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.481+0000 7f6754896b80 1 --2- 172.21.15.151:0/2939962587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27e1b0 0x5594ec27e580 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f672c00e970 tx=0x7f672c099a70 comp rx=0 tx=0).stop 2023-07-21T22:19:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.482+0000 7f6754896b80 1 -- 172.21.15.151:0/2939962587 shutdown_connections 2023-07-21T22:19:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.482+0000 7f6754896b80 1 --2- 172.21.15.151:0/2939962587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec279da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.482+0000 7f6754896b80 1 --2- 172.21.15.151:0/2939962587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27e1b0 0x5594ec27e580 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.482+0000 7f6754896b80 1 --2- 172.21.15.151:0/2939962587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 0x5594ec279350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.482+0000 7f6754896b80 1 -- 172.21.15.151:0/2939962587 >> 172.21.15.151:0/2939962587 conn(0x5594ec26eef0 msgr2=0x5594ec274830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.482+0000 7f6754896b80 1 -- 172.21.15.151:0/2939962587 shutdown_connections 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.482+0000 7f6754896b80 1 -- 172.21.15.151:0/2939962587 wait complete. 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.482+0000 7f6754896b80 1 -- start start 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.483+0000 7f6754896b80 1 Processor -- start 2023-07-21T22:19:32.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.483+0000 7f6754896b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec285b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.483+0000 7f6754896b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27e1b0 0x5594ec282e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.483+0000 7f6754896b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 0x5594ec283490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.483+0000 7f6754896b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec16aac0 con 0x5594ec27e1b0 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.483+0000 7f6754896b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec16a7c0 con 0x5594ec279930 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.483+0000 7f6754896b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec04e920 con 0x5594ec27eac0 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.483+0000 7f6754896b80 10 client.0 _ll_register_callbacks cb 0x5594ec168760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec285b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec285b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34668/0 (socket says 172.21.15.151:34668) 2023-07-21T22:19:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673a59c700 1 -- 172.21.15.151:0/1651537596 learned_addr learned my addr 172.21.15.151:0/1651537596 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673ad9d700 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 0x5594ec283490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f6739d9b700 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27e1b0 0x5594ec282e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673a59c700 1 -- 172.21.15.151:0/1651537596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 msgr2=0x5594ec283490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673a59c700 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 0x5594ec283490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673a59c700 1 -- 172.21.15.151:0/1651537596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27e1b0 msgr2=0x5594ec282e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673a59c700 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27e1b0 0x5594ec282e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673a59c700 1 -- 172.21.15.151:0/1651537596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f673c1a4be0 con 0x5594ec279930 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673ad9d700 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 0x5594ec283490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f6739d9b700 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27e1b0 0x5594ec282e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f673a59c700 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec285b90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f672c096590 tx=0x7f672c09e230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8810abac5cacfad4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f6721ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f6721ffb700 1 -- 172.21.15.151:0/1651537596 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0b6070 con 0x5594ec279930 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f6721ffb700 1 -- 172.21.15.151:0/1651537596 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f672c098430 con 0x5594ec279930 2023-07-21T22:19:32.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.484+0000 7f6754896b80 1 -- 172.21.15.151:0/1651537596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594ec1244f0 con 0x5594ec279930 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6721ffb700 1 -- 172.21.15.151:0/1651537596 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f672c0a2260 con 0x5594ec279930 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6754896b80 10 client.25370 fetch_fsmap learned FSMap version 25 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6754896b80 1 -- 172.21.15.151:0/1651537596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5594ebfe1c60 con 0x5594ec279930 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6721ffb700 1 -- 172.21.15.151:0/1651537596 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5594ec1244f0 con 0x5594ec279930 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6721ffb700 1 -- 172.21.15.151:0/1651537596 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f672c098ff0 con 0x5594ec279930 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6754896b80 10 client.25370 fetch_fsmap finished waiting for FSMap version 25 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6754896b80 10 client.25370 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:19:32.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6754896b80 20 client.25370 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6754896b80 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5594ec293050 0x5594ec295430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6754896b80 4 client.25370 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:32.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.485+0000 7f6754896b80 1 -- 172.21.15.151:0/1651537596 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594ec1c3eb0 con 0x5594ec293050 2023-07-21T22:19:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.486+0000 7f6739d9b700 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5594ec293050 0x5594ec295430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.486+0000 7f6739d9b700 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5594ec293050 0x5594ec295430 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=db21c3e01f01f1a9 server_cookie=2590680840fad424 in_seq=0 out_seq=0 2023-07-21T22:19:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.486+0000 7f6721ffb700 10 client.25370 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:19:32.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.487+0000 7f6721ffb700 1 -- 172.21.15.151:0/1651537596 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5594ec1c3eb0 con 0x5594ec293050 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.487+0000 7f6721ffb700 10 client.25370 handle_command_reply: tid=0 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.487+0000 7f6754896b80 1 client.25370 shutdown 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.487+0000 7f6754896b80 1 -- 172.21.15.151:0/1651537596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 msgr2=0x5594ec285b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.487+0000 7f6754896b80 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec285b90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f672c096590 tx=0x7f672c09e230 comp rx=0 tx=0).stop 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.487+0000 7f6754896b80 1 -- 172.21.15.151:0/1651537596 shutdown_connections 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.487+0000 7f6754896b80 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5594ec293050 0x5594ec295430 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.488+0000 7f6721ffb700 0 client.25370 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:19:32.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.487+0000 7f6754896b80 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec279930 0x5594ec285b90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.488+0000 7f6754896b80 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 0x5594ec283490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.488+0000 7f6754896b80 1 --2- 172.21.15.151:0/1651537596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27e1b0 0x5594ec282e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.488+0000 7f6754896b80 1 -- 172.21.15.151:0/1651537596 >> 172.21.15.151:0/1651537596 conn(0x5594ec26eef0 msgr2=0x5594ec2743c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.488+0000 7f6754896b80 1 -- 172.21.15.151:0/1651537596 shutdown_connections 2023-07-21T22:19:32.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.488+0000 7f6754896b80 1 -- 172.21.15.151:0/1651537596 wait complete. 2023-07-21T22:19:32.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.488+0000 7f6754896b80 20 client.25370 trim_cache size 0 max 16384 2023-07-21T22:19:32.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.502+0000 7f6754896b80 1 Processor -- start 2023-07-21T22:19:32.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.502+0000 7f6754896b80 1 -- start start 2023-07-21T22:19:32.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.502+0000 7f6754896b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec279930 0x5594ec285730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.502+0000 7f6754896b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 0x5594ec277a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.502+0000 7f6754896b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 0x5594ec277f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.502+0000 7f6754896b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec27a220 con 0x5594ec27eac0 2023-07-21T22:19:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.502+0000 7f6754896b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec27dcc0 con 0x5594ec27e1b0 2023-07-21T22:19:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.502+0000 7f6754896b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec29a150 con 0x5594ec279930 2023-07-21T22:19:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 0x5594ec277f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec279930 0x5594ec285730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec279930 0x5594ec285730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42374/0 (socket says 172.21.15.151:42374) 2023-07-21T22:19:32.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673a59c700 1 -- 172.21.15.151:0/18706281 learned_addr learned my addr 172.21.15.151:0/18706281 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f6739d9b700 1 --2- 172.21.15.151:0/18706281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 0x5594ec277a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673a59c700 1 -- 172.21.15.151:0/18706281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 msgr2=0x5594ec277a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673a59c700 1 --2- 172.21.15.151:0/18706281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 0x5594ec277a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673a59c700 1 -- 172.21.15.151:0/18706281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 msgr2=0x5594ec277f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673a59c700 1 --2- 172.21.15.151:0/18706281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 0x5594ec277f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673a59c700 1 -- 172.21.15.151:0/18706281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594ec01f250 con 0x5594ec279930 2023-07-21T22:19:32.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.503+0000 7f673a59c700 1 --2- 172.21.15.151:0/18706281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec279930 0x5594ec285730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f672c095e10 tx=0x7f672c096480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15218302c1babf32 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.504+0000 7f67297fa700 1 -- 172.21.15.151:0/18706281 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0961b0 con 0x5594ec279930 2023-07-21T22:19:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.504+0000 7f67297fa700 1 -- 172.21.15.151:0/18706281 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f672c0ca700 con 0x5594ec279930 2023-07-21T22:19:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.504+0000 7f67297fa700 1 -- 172.21.15.151:0/18706281 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f672c0b2a70 con 0x5594ec279930 2023-07-21T22:19:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.504+0000 7f6754896b80 1 -- 172.21.15.151:0/18706281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec279930 msgr2=0x5594ec285730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.504+0000 7f6754896b80 1 --2- 172.21.15.151:0/18706281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec279930 0x5594ec285730 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f672c095e10 tx=0x7f672c096480 comp rx=0 tx=0).stop 2023-07-21T22:19:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.505+0000 7f6754896b80 1 -- 172.21.15.151:0/18706281 shutdown_connections 2023-07-21T22:19:32.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.505+0000 7f6754896b80 1 --2- 172.21.15.151:0/18706281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec27eac0 0x5594ec277f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.505+0000 7f6754896b80 1 --2- 172.21.15.151:0/18706281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec279930 0x5594ec285730 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.505+0000 7f6754896b80 1 --2- 172.21.15.151:0/18706281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 0x5594ec277a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.505+0000 7f6754896b80 1 -- 172.21.15.151:0/18706281 >> 172.21.15.151:0/18706281 conn(0x5594ec26eef0 msgr2=0x5594ec272f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.505+0000 7f6754896b80 1 -- 172.21.15.151:0/18706281 shutdown_connections 2023-07-21T22:19:32.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.505+0000 7f6754896b80 1 -- 172.21.15.151:0/18706281 wait complete. 2023-07-21T22:19:32.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.505+0000 7f6754896b80 1 -- start start 2023-07-21T22:19:32.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.505+0000 7f6754896b80 1 Processor -- start 2023-07-21T22:19:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f6754896b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec279930 0x5594ec288690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f6754896b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 0x5594ec288bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f6754896b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 0x5594ec2e5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f6754896b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec289360 con 0x5594ec279930 2023-07-21T22:19:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f6754896b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec2e6450 con 0x5594ec27e1b0 2023-07-21T22:19:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f6754896b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594ec2e6610 con 0x5594ec27eac0 2023-07-21T22:19:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f6754896b80 10 client.0 _ll_register_callbacks cb 0x7f6730009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:32.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f673a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec279930 0x5594ec288690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f673a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec279930 0x5594ec288690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44410/0 (socket says 172.21.15.151:44410) 2023-07-21T22:19:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f673a59c700 1 -- 172.21.15.151:0/4136102065 learned_addr learned my addr 172.21.15.151:0/4136102065 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f6739d9b700 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 0x5594ec288bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.506+0000 7f673ad9d700 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 0x5594ec2e5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6739d9b700 1 -- 172.21.15.151:0/4136102065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 msgr2=0x5594ec2e5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6739d9b700 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 0x5594ec2e5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6739d9b700 1 -- 172.21.15.151:0/4136102065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec279930 msgr2=0x5594ec288690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6739d9b700 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec279930 0x5594ec288690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6739d9b700 1 -- 172.21.15.151:0/4136102065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5594ebfe1c60 con 0x5594ec27e1b0 2023-07-21T22:19:32.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f673a59c700 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec279930 0x5594ec288690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:32.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6739d9b700 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 0x5594ec288bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5594ec2843c0 tx=0x7f673001dcc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=548e9944e9a7fa47 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6721ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:19:32.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6721ffb700 1 -- 172.21.15.151:0/4136102065 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6730018040 con 0x5594ec27e1b0 2023-07-21T22:19:32.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6721ffb700 1 -- 172.21.15.151:0/4136102065 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f673001d310 con 0x5594ec27e1b0 2023-07-21T22:19:32.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.507+0000 7f6754896b80 1 -- 172.21.15.151:0/4136102065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594ec186050 con 0x5594ec27e1b0 2023-07-21T22:19:32.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6721ffb700 1 -- 172.21.15.151:0/4136102065 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f673001d4d0 con 0x5594ec27e1b0 2023-07-21T22:19:32.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6754896b80 10 client.25376 fetch_fsmap learned FSMap version 25 2023-07-21T22:19:32.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6754896b80 1 -- 172.21.15.151:0/4136102065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5594ebff72b0 con 0x5594ec27e1b0 2023-07-21T22:19:32.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6721ffb700 1 -- 172.21.15.151:0/4136102065 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5594ec186050 con 0x5594ec27e1b0 2023-07-21T22:19:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6721ffb700 1 -- 172.21.15.151:0/4136102065 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f673002f5a0 con 0x5594ec27e1b0 2023-07-21T22:19:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6754896b80 10 client.25376 fetch_fsmap finished waiting for FSMap version 25 2023-07-21T22:19:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6754896b80 10 client.25376 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:19:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6754896b80 20 client.25376 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6754896b80 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5594ec2e7cf0 0x5594ec2ea100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6754896b80 4 client.25376 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:19:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.508+0000 7f6754896b80 1 -- 172.21.15.151:0/4136102065 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5594ec019f70 con 0x5594ec2e7cf0 2023-07-21T22:19:32.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.509+0000 7f673a59c700 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5594ec2e7cf0 0x5594ec2ea100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.509+0000 7f673a59c700 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5594ec2e7cf0 0x5594ec2ea100 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=39eb18040b4145d server_cookie=b81f70d0cfd45978 in_seq=0 out_seq=0 2023-07-21T22:19:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.509+0000 7f6721ffb700 10 client.25376 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:19:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.509+0000 7f6721ffb700 1 -- 172.21.15.151:0/4136102065 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5594ec019f70 con 0x5594ec2e7cf0 2023-07-21T22:19:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.509+0000 7f6721ffb700 10 client.25376 handle_command_reply: tid=0 2023-07-21T22:19:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.509+0000 7f6754896b80 1 client.25376 shutdown 2023-07-21T22:19:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 -- 172.21.15.151:0/4136102065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 msgr2=0x5594ec288bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 0x5594ec288bd0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x5594ec2843c0 tx=0x7f673001dcc0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 -- 172.21.15.151:0/4136102065 shutdown_connections 2023-07-21T22:19:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5594ec2e7cf0 0x5594ec2ea100 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594ec27eac0 0x5594ec2e5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6721ffb700 0 client.25376 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:19:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594ec279930 0x5594ec288690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 --2- 172.21.15.151:0/4136102065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594ec27e1b0 0x5594ec288bd0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 -- 172.21.15.151:0/4136102065 >> 172.21.15.151:0/4136102065 conn(0x5594ec26eef0 msgr2=0x5594ec277a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 -- 172.21.15.151:0/4136102065 shutdown_connections 2023-07-21T22:19:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 1 -- 172.21.15.151:0/4136102065 wait complete. 2023-07-21T22:19:32.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6754896b80 20 client.25376 trim_cache size 0 max 16384 2023-07-21T22:19:32.562 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:19:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6740fff700 1 -- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67240a13d0 msgr2=0x7f67240a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6740fff700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67240a13d0 0x7f67240a3880 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f6734009850 tx=0x7f673400b700 comp rx=0 tx=0).stop 2023-07-21T22:19:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6740fff700 1 -- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c0ffad0 msgr2=0x7f673c197e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.510+0000 7f6740fff700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c0ffad0 0x7f673c197e00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f672c00e9a0 tx=0x7f672c00ed60 comp rx=0 tx=0).stop 2023-07-21T22:19:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.511+0000 7f6740fff700 1 -- 172.21.15.151:0/3766502011 shutdown_connections 2023-07-21T22:19:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.511+0000 7f6740fff700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67240a13d0 0x7f67240a3880 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.511+0000 7f6740fff700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f673c105ae0 0x7f673c19c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.511+0000 7f6740fff700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f673c0ffad0 0x7f673c197e00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.511+0000 7f6740fff700 1 --2- 172.21.15.151:0/3766502011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f673c100480 0x7f673c198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.511+0000 7f6740fff700 1 -- 172.21.15.151:0/3766502011 >> 172.21.15.151:0/3766502011 conn(0x7f673c0fb5f0 msgr2=0x7f673c0fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.511+0000 7f6740fff700 1 -- 172.21.15.151:0/3766502011 shutdown_connections 2023-07-21T22:19:32.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.511+0000 7f6740fff700 1 -- 172.21.15.151:0/3766502011 wait complete. 2023-07-21T22:19:32.573 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:32 smithi151 ceph-mon[95510]: pgmap v13: 97 pgs: 97 active+clean; 38 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 3.8 MiB/s wr, 98 op/s 2023-07-21T22:19:32.573 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:32 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2062443580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:19:32.575 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-21T22:19:32.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:32 smithi187 ceph-mon[96918]: pgmap v13: 97 pgs: 97 active+clean; 38 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 3.8 MiB/s wr, 98 op/s 2023-07-21T22:19:32.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:32 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2062443580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:19:32.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:32 smithi195 ceph-mon[97365]: pgmap v13: 97 pgs: 97 active+clean; 38 MiB data, 348 MiB used, 1.0 TiB / 1.0 TiB avail; 248 KiB/s rd, 3.8 MiB/s wr, 98 op/s 2023-07-21T22:19:32.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:32 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2062443580' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:19:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.757+0000 7f2edefff700 1 -- 172.21.15.151:0/1951729356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80fe820 msgr2=0x7f2ed80febf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.757+0000 7f2edefff700 1 --2- 172.21.15.151:0/1951729356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80fe820 0x7f2ed80febf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc00b0a0 tx=0x7f2ecc00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.757+0000 7f2edefff700 1 -- 172.21.15.151:0/1951729356 shutdown_connections 2023-07-21T22:19:32.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.757+0000 7f2edefff700 1 --2- 172.21.15.151:0/1951729356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ed810c3d0 0x7f2ed810e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.757+0000 7f2edefff700 1 --2- 172.21.15.151:0/1951729356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80fe820 0x7f2ed80febf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.757+0000 7f2edefff700 1 --2- 172.21.15.151:0/1951729356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed80ff1c0 0x7f2ed810be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.757+0000 7f2edefff700 1 -- 172.21.15.151:0/1951729356 >> 172.21.15.151:0/1951729356 conn(0x7f2ed80fa510 msgr2=0x7f2ed80fc920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.757+0000 7f2edefff700 1 -- 172.21.15.151:0/1951729356 shutdown_connections 2023-07-21T22:19:32.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.757+0000 7f2edefff700 1 -- 172.21.15.151:0/1951729356 wait complete. 2023-07-21T22:19:32.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.758+0000 7f2edefff700 1 Processor -- start 2023-07-21T22:19:32.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.759+0000 7f2edefff700 1 -- start start 2023-07-21T22:19:32.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.759+0000 7f2edefff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed80fe820 0x7f2ed8197f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.759+0000 7f2edefff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80ff1c0 0x7f2ed8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.759+0000 7f2edefff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ed810c3d0 0x7f2ed819c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.759+0000 7f2edefff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed819cf10 con 0x7f2ed810c3d0 2023-07-21T22:19:32.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.759+0000 7f2edefff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed819d080 con 0x7f2ed80fe820 2023-07-21T22:19:32.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.759+0000 7f2edefff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed819d240 con 0x7f2ed80ff1c0 2023-07-21T22:19:32.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.759+0000 7f2edd59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ed810c3d0 0x7f2ed819c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.759+0000 7f2edd59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ed810c3d0 0x7f2ed819c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44436/0 (socket says 172.21.15.151:44436) 2023-07-21T22:19:32.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2edd59c700 1 -- 172.21.15.151:0/3363445087 learned_addr learned my addr 172.21.15.151:0/3363445087 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2ed7fff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80ff1c0 0x7f2ed8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed80fe820 0x7f2ed8197f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2ed7fff700 1 -- 172.21.15.151:0/3363445087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed80fe820 msgr2=0x7f2ed8197f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2ed7fff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed80fe820 0x7f2ed8197f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2ed7fff700 1 -- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ed810c3d0 msgr2=0x7f2ed819c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2ed7fff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ed810c3d0 0x7f2ed819c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2ed7fff700 1 -- 172.21.15.151:0/3363445087 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec4009520 con 0x7f2ed80ff1c0 2023-07-21T22:19:32.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2edd59c700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ed810c3d0 0x7f2ed819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:32.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2ed7fff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80ff1c0 0x7f2ed8198470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400e9f0 tx=0x7f2ec400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.760+0000 7f2ed5ffb700 1 -- 172.21.15.151:0/3363445087 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec400cb70 con 0x7f2ed80ff1c0 2023-07-21T22:19:32.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.761+0000 7f2ed5ffb700 1 -- 172.21.15.151:0/3363445087 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ec400ee90 con 0x7f2ed80ff1c0 2023-07-21T22:19:32.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.761+0000 7f2ed5ffb700 1 -- 172.21.15.151:0/3363445087 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec4003bc0 con 0x7f2ed80ff1c0 2023-07-21T22:19:32.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.761+0000 7f2edefff700 1 -- 172.21.15.151:0/3363445087 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc009d00 con 0x7f2ed80ff1c0 2023-07-21T22:19:32.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.761+0000 7f2edefff700 1 -- 172.21.15.151:0/3363445087 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed81a4b80 con 0x7f2ed80ff1c0 2023-07-21T22:19:32.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.764+0000 7f2ed5ffb700 1 -- 172.21.15.151:0/3363445087 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f2ec4003d60 con 0x7f2ed80ff1c0 2023-07-21T22:19:32.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.766+0000 7f2ef291fb80 1 Processor -- start 2023-07-21T22:19:32.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.766+0000 7f2ed5ffb700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ec80a13d0 0x7f2ec80a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.766+0000 7f2ef291fb80 1 -- start start 2023-07-21T22:19:32.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.766+0000 7f2ed5ffb700 1 -- 172.21.15.151:0/3363445087 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2ec4014070 con 0x7f2ed80ff1c0 2023-07-21T22:19:32.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7e1b0 0x5571fcf7e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7eac0 0x5571fcf79350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf79da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edd59c700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ec80a13d0 0x7f2ec80a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fce7ecb0 con 0x5571fcf7e1b0 2023-07-21T22:19:32.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fced1a40 con 0x5571fcf7eac0 2023-07-21T22:19:32.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fcecaed0 con 0x5571fcf79930 2023-07-21T22:19:32.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edcd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7e1b0 0x5571fcf7e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edcd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7e1b0 0x5571fcf7e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44446/0 (socket says 172.21.15.151:44446) 2023-07-21T22:19:32.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edcd9b700 1 -- 172.21.15.151:0/3043533766 learned_addr learned my addr 172.21.15.151:0/3043533766 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.813 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edd59c700 1 --2- 172.21.15.151:0/3043533766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf79da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.814 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edcd9b700 1 -- 172.21.15.151:0/3043533766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 msgr2=0x5571fcf79da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/3043533766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf79da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edcd9b700 1 -- 172.21.15.151:0/3043533766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7eac0 msgr2=0x5571fcf79350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/3043533766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7eac0 0x5571fcf79350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.767+0000 7f2edcd9b700 1 -- 172.21.15.151:0/3043533766 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571fccf8de0 con 0x5571fcf7e1b0 2023-07-21T22:19:32.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.768+0000 7f2edd59c700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ec80a13d0 0x7f2ec80a3880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00046e0 tx=0x7f2ed0013c30 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.768+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/3043533766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7e1b0 0x5571fcf7e580 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc015000 tx=0x7f2ecc0092e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccec54dc2bc07e48 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.815 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.768+0000 7f2ec2ffd700 1 -- 172.21.15.151:0/3043533766 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00e040 con 0x5571fcf7e1b0 2023-07-21T22:19:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.768+0000 7f2ec2ffd700 1 -- 172.21.15.151:0/3043533766 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ecc007d90 con 0x5571fcf7e1b0 2023-07-21T22:19:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.768+0000 7f2ec2ffd700 1 -- 172.21.15.151:0/3043533766 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc003c60 con 0x5571fcf7e1b0 2023-07-21T22:19:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3043533766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7e1b0 msgr2=0x5571fcf7e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3043533766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7e1b0 0x5571fcf7e580 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc015000 tx=0x7f2ecc0092e0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3043533766 shutdown_connections 2023-07-21T22:19:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3043533766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf79da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.816 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3043533766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7e1b0 0x5571fcf7e580 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3043533766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7eac0 0x5571fcf79350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3043533766 >> 172.21.15.151:0/3043533766 conn(0x5571fcf6eef0 msgr2=0x5571fcf74830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3043533766 shutdown_connections 2023-07-21T22:19:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3043533766 wait complete. 2023-07-21T22:19:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.769+0000 7f2ef291fb80 1 -- start start 2023-07-21T22:19:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.770+0000 7f2ef291fb80 1 Processor -- start 2023-07-21T22:19:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.770+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf79930 0x5571fcf85ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.770+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7e1b0 0x5571fcf82e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.770+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.770+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fce6aac0 con 0x5571fcf7eac0 2023-07-21T22:19:32.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.770+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fce6a7c0 con 0x5571fcf79930 2023-07-21T22:19:32.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.770+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fcd4e920 con 0x5571fcf7e1b0 2023-07-21T22:19:32.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.770+0000 7f2ef291fb80 10 client.0 _ll_register_callbacks cb 0x5571fce68760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.770+0000 7f2edd59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edd59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf834a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44462/0 (socket says 172.21.15.151:44462) 2023-07-21T22:19:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edd59c700 1 -- 172.21.15.151:0/1198799084 learned_addr learned my addr 172.21.15.151:0/1198799084 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf79930 0x5571fcf85ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2ed7fff700 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7e1b0 0x5571fcf82e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edd59c700 1 -- 172.21.15.151:0/1198799084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7e1b0 msgr2=0x5571fcf82e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edd59c700 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7e1b0 0x5571fcf82e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edd59c700 1 -- 172.21.15.151:0/1198799084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf79930 msgr2=0x5571fcf85ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edd59c700 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf79930 0x5571fcf85ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edd59c700 1 -- 172.21.15.151:0/1198799084 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed810f3f0 con 0x5571fcf7eac0 2023-07-21T22:19:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf79930 0x5571fcf85ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2edd59c700 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf834a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000fce0 tx=0x7f2ed00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8538c1940d7904fa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.771+0000 7f2eb7fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:19:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.772+0000 7f2eb7fff700 1 -- 172.21.15.151:0/1198799084 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0010d10 con 0x5571fcf7eac0 2023-07-21T22:19:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.772+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1198799084 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5571fce244f0 con 0x5571fcf7eac0 2023-07-21T22:19:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.772+0000 7f2eb7fff700 1 -- 172.21.15.151:0/1198799084 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2ed0020430 con 0x5571fcf7eac0 2023-07-21T22:19:32.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.772+0000 7f2eb7fff700 1 -- 172.21.15.151:0/1198799084 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ed0010e70 con 0x5571fcf7eac0 2023-07-21T22:19:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.772+0000 7f2ef291fb80 10 client.15624 fetch_fsmap learned FSMap version 25 2023-07-21T22:19:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.772+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1198799084 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5571fcce1c60 con 0x5571fcf7eac0 2023-07-21T22:19:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.772+0000 7f2eb7fff700 1 -- 172.21.15.151:0/1198799084 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5571fce244f0 con 0x5571fcf7eac0 2023-07-21T22:19:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.773+0000 7f2eb7fff700 1 -- 172.21.15.151:0/1198799084 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2ed000e3b0 con 0x5571fcf7eac0 2023-07-21T22:19:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.773+0000 7f2ef291fb80 10 client.15624 fetch_fsmap finished waiting for FSMap version 25 2023-07-21T22:19:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.773+0000 7f2ef291fb80 10 client.15624 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:19:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.773+0000 7f2ef291fb80 20 client.15624 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:32.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.773+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5571fcf933b0 0x5571fcf957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.773+0000 7f2ef291fb80 4 client.15624 mds_command: new command op to 24574 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:32.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.773+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1198799084 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5571fcec3eb0 con 0x5571fcf933b0 2023-07-21T22:19:32.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.773+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5571fcf933b0 0x5571fcf957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.774+0000 7f2eb7fff700 10 client.15624 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:19:32.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.774+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5571fcf933b0 0x5571fcf957c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=df0e95a970d074c9 server_cookie=b81e0dde99cba7dd in_seq=0 out_seq=0 2023-07-21T22:19:32.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.774+0000 7f2eb7fff700 1 -- 172.21.15.151:0/1198799084 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5571fcec3eb0 con 0x5571fcf933b0 2023-07-21T22:19:32.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.774+0000 7f2eb7fff700 10 client.15624 handle_command_reply: tid=0 2023-07-21T22:19:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.774+0000 7f2ef291fb80 1 client.15624 shutdown 2023-07-21T22:19:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1198799084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 msgr2=0x5571fcf834a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf834a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000fce0 tx=0x7f2ed00047c0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1198799084 shutdown_connections 2023-07-21T22:19:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5571fcf933b0 0x5571fcf957c0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf79930 0x5571fcf85ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2eb7fff700 0 client.15624 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:19:32.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf834a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1198799084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7e1b0 0x5571fcf82e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1198799084 >> 172.21.15.151:0/1198799084 conn(0x5571fcf6eef0 msgr2=0x5571fcf74420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1198799084 shutdown_connections 2023-07-21T22:19:32.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1198799084 wait complete. 2023-07-21T22:19:32.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.775+0000 7f2ef291fb80 20 client.15624 trim_cache size 0 max 16384 2023-07-21T22:19:32.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.793+0000 7f2ef291fb80 1 Processor -- start 2023-07-21T22:19:32.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.793+0000 7f2ef291fb80 1 -- start start 2023-07-21T22:19:32.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.793+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf8a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcf79090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf85740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fcf84400 con 0x5571fcf7eac0 2023-07-21T22:19:32.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fcf83830 con 0x5571fcf7e1b0 2023-07-21T22:19:32.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fcf75a50 con 0x5571fcf79930 2023-07-21T22:19:32.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2edd59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf85740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2edcd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf8a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2edcd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf8a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42434/0 (socket says 172.21.15.151:42434) 2023-07-21T22:19:32.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2edcd9b700 1 -- 172.21.15.151:0/1195885297 learned_addr learned my addr 172.21.15.151:0/1195885297 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2ed7fff700 1 --2- 172.21.15.151:0/1195885297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcf79090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2edcd9b700 1 -- 172.21.15.151:0/1195885297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 msgr2=0x5571fcf79090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/1195885297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcf79090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2edcd9b700 1 -- 172.21.15.151:0/1195885297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 msgr2=0x5571fcf85740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/1195885297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf85740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2edcd9b700 1 -- 172.21.15.151:0/1195885297 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5571fcf9a3b0 con 0x5571fcf79930 2023-07-21T22:19:32.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.794+0000 7f2ed7fff700 1 --2- 172.21.15.151:0/1195885297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcf79090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:32.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.795+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/1195885297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf8a520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009fd0 tx=0x7f2ecc005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7c9abfb53513981 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.795+0000 7f2ec37fe700 1 -- 172.21.15.151:0/1195885297 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc00e040 con 0x5571fcf79930 2023-07-21T22:19:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.795+0000 7f2ec37fe700 1 -- 172.21.15.151:0/1195885297 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ecc003e90 con 0x5571fcf79930 2023-07-21T22:19:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.795+0000 7f2ec37fe700 1 -- 172.21.15.151:0/1195885297 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc0054b0 con 0x5571fcf79930 2023-07-21T22:19:32.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.795+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1195885297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 msgr2=0x5571fcf8a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.795+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1195885297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf8a520 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc009fd0 tx=0x7f2ecc005040 comp rx=0 tx=0).stop 2023-07-21T22:19:32.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.796+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1195885297 shutdown_connections 2023-07-21T22:19:32.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.796+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1195885297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf7eac0 0x5571fcf85740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.796+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1195885297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf79930 0x5571fcf8a520 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.796+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/1195885297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcf79090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.796+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1195885297 >> 172.21.15.151:0/1195885297 conn(0x5571fcf6eef0 msgr2=0x5571fcf78980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.796+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1195885297 shutdown_connections 2023-07-21T22:19:32.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.796+0000 7f2ef291fb80 1 -- 172.21.15.151:0/1195885297 wait complete. 2023-07-21T22:19:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.796+0000 7f2ef291fb80 1 -- start start 2023-07-21T22:19:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.796+0000 7f2ef291fb80 1 Processor -- start 2023-07-21T22:19:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf79930 0x5571fcfdb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcfdb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2ef291fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7eac0 0x5571fcfe6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fcfdbed0 con 0x5571fcf79930 2023-07-21T22:19:32.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fcfdc040 con 0x5571fcf7e1b0 2023-07-21T22:19:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2ef291fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5571fcfe67b0 con 0x5571fcf7eac0 2023-07-21T22:19:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2ef291fb80 10 client.0 _ll_register_callbacks cb 0x7f2ed000f8b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2edcd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf79930 0x5571fcfdb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2edcd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf79930 0x5571fcfdb1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44480/0 (socket says 172.21.15.151:44480) 2023-07-21T22:19:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2edd59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7eac0 0x5571fcfe6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2edcd9b700 1 -- 172.21.15.151:0/3895338135 learned_addr learned my addr 172.21.15.151:0/3895338135 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.797+0000 7f2ed7fff700 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcfdb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2edd59c700 1 -- 172.21.15.151:0/3895338135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 msgr2=0x5571fcfdb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2edd59c700 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcfdb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2edd59c700 1 -- 172.21.15.151:0/3895338135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf79930 msgr2=0x5571fcfdb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:32.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2edd59c700 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf79930 0x5571fcfdb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2edd59c700 1 -- 172.21.15.151:0/3895338135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5571fccf8de0 con 0x5571fcf7eac0 2023-07-21T22:19:32.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2ed7fff700 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcfdb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:32.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2edd59c700 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7eac0 0x5571fcfe6240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000e790 tx=0x7f2ed000e5e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bb33826978b42e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:32.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2eb7fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:19:32.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2eb7fff700 1 -- 172.21.15.151:0/3895338135 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ed0009e90 con 0x5571fcf7eac0 2023-07-21T22:19:32.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2eb7fff700 1 -- 172.21.15.151:0/3895338135 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2ed000ea00 con 0x5571fcf7eac0 2023-07-21T22:19:32.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3895338135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2ecc007d90 con 0x5571fcf7eac0 2023-07-21T22:19:32.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.798+0000 7f2eb7fff700 1 -- 172.21.15.151:0/3895338135 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ed000f6a0 con 0x5571fcf7eac0 2023-07-21T22:19:32.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2ef291fb80 10 client.25432 fetch_fsmap learned FSMap version 25 2023-07-21T22:19:32.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3895338135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x5571fcd1f250 con 0x5571fcf7eac0 2023-07-21T22:19:32.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2eb7fff700 1 -- 172.21.15.151:0/3895338135 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ed0043080 con 0x5571fcf7eac0 2023-07-21T22:19:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2eb7fff700 1 -- 172.21.15.151:0/3895338135 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2ed00051b0 con 0x5571fcf7eac0 2023-07-21T22:19:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2ef291fb80 10 client.25432 fetch_fsmap finished waiting for FSMap version 25 2023-07-21T22:19:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2ef291fb80 10 client.25432 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:19:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2ef291fb80 20 client.25432 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5571fcfe7e90 0x5571fcfea2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2ef291fb80 4 client.25432 mds_command: new command op to 24574 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:19:32.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.799+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3895338135 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5571fce86050 con 0x5571fcfe7e90 2023-07-21T22:19:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.800+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5571fcfe7e90 0x5571fcfea2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.800+0000 7f2eb7fff700 10 client.25432 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:19:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.800+0000 7f2edcd9b700 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5571fcfe7e90 0x5571fcfea2a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec4e9d5c0943551f server_cookie=6fa1f15a23528cc4 in_seq=0 out_seq=0 2023-07-21T22:19:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.800+0000 7f2eb7fff700 1 -- 172.21.15.151:0/3895338135 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5571fce86050 con 0x5571fcfe7e90 2023-07-21T22:19:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.800+0000 7f2eb7fff700 10 client.25432 handle_command_reply: tid=0 2023-07-21T22:19:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.800+0000 7f2ef291fb80 1 client.25432 shutdown 2023-07-21T22:19:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3895338135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7eac0 msgr2=0x5571fcfe6240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7eac0 0x5571fcfe6240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2ed000e790 tx=0x7f2ed000e5e0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3895338135 shutdown_connections 2023-07-21T22:19:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5571fcf7eac0 0x5571fcfe6240 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571fcf79930 0x5571fcfdb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5571fcfe7e90 0x5571fcfea2a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 --2- 172.21.15.151:0/3895338135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5571fcf7e1b0 0x5571fcfdb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2eb7fff700 0 client.25432 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:19:32.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3895338135 >> 172.21.15.151:0/3895338135 conn(0x5571fcf6eef0 msgr2=0x5571fcf7ccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3895338135 shutdown_connections 2023-07-21T22:19:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 1 -- 172.21.15.151:0/3895338135 wait complete. 2023-07-21T22:19:32.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.801+0000 7f2ef291fb80 20 client.25432 trim_cache size 0 max 16384 2023-07-21T22:19:32.853 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:19:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 -- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ec80a13d0 msgr2=0x7f2ec80a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ec80a13d0 0x7f2ec80a3880 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2ed00046e0 tx=0x7f2ed0013c30 comp rx=0 tx=0).stop 2023-07-21T22:19:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 -- 172.21.15.151:0/3363445087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80ff1c0 msgr2=0x7f2ed8198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80ff1c0 0x7f2ed8198470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2ec400e9f0 tx=0x7f2ec400ed00 comp rx=0 tx=0).stop 2023-07-21T22:19:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 -- 172.21.15.151:0/3363445087 shutdown_connections 2023-07-21T22:19:32.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ec80a13d0 0x7f2ec80a3880 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed80fe820 0x7f2ed8197f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2ed810c3d0 0x7f2ed819c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 --2- 172.21.15.151:0/3363445087 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2ed80ff1c0 0x7f2ed8198470 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:32.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 -- 172.21.15.151:0/3363445087 >> 172.21.15.151:0/3363445087 conn(0x7f2ed80fa510 msgr2=0x7f2ed810e560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:32.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 -- 172.21.15.151:0/3363445087 shutdown_connections 2023-07-21T22:19:32.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:32.802+0000 7f2edefff700 1 -- 172.21.15.151:0/3363445087 wait complete. 2023-07-21T22:19:32.866 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-21T22:19:33.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.056+0000 7f41851ff700 1 -- 172.21.15.151:0/2195890547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41800ffad0 msgr2=0x7f41800fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.056+0000 7f41851ff700 1 --2- 172.21.15.151:0/2195890547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41800ffad0 0x7f41800fff40 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4174009990 tx=0x7f4174009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.056+0000 7f41851ff700 1 -- 172.21.15.151:0/2195890547 shutdown_connections 2023-07-21T22:19:33.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.056+0000 7f41851ff700 1 --2- 172.21.15.151:0/2195890547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4180100480 0x7f418010c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.056+0000 7f41851ff700 1 --2- 172.21.15.151:0/2195890547 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4180105ae0 0x7f4180105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.056+0000 7f41851ff700 1 --2- 172.21.15.151:0/2195890547 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f41800ffad0 0x7f41800fff40 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.056+0000 7f41851ff700 1 -- 172.21.15.151:0/2195890547 >> 172.21.15.151:0/2195890547 conn(0x7f41800fb5f0 msgr2=0x7f41800fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.057+0000 7f41851ff700 1 -- 172.21.15.151:0/2195890547 shutdown_connections 2023-07-21T22:19:33.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.057+0000 7f41851ff700 1 -- 172.21.15.151:0/2195890547 wait complete. 2023-07-21T22:19:33.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.058+0000 7f41851ff700 1 Processor -- start 2023-07-21T22:19:33.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.058+0000 7f41851ff700 1 -- start start 2023-07-21T22:19:33.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.058+0000 7f41851ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41800ffad0 0x7f4180072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.058+0000 7f41851ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4180100480 0x7f4180072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.058+0000 7f41851ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180105ae0 0x7f41801a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.058+0000 7f41851ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4180073580 con 0x7f41800ffad0 2023-07-21T22:19:33.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.058+0000 7f41851ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41801a41f0 con 0x7f4180100480 2023-07-21T22:19:33.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.058+0000 7f41851ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41801a4330 con 0x7f4180105ae0 2023-07-21T22:19:33.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41800ffad0 0x7f4180072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41800ffad0 0x7f4180072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44494/0 (socket says 172.21.15.151:44494) 2023-07-21T22:19:33.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417ed9d700 1 -- 172.21.15.151:0/3634590832 learned_addr learned my addr 172.21.15.151:0/3634590832 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:33.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4180100480 0x7f4180072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417f59e700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180105ae0 0x7f41801a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417ed9d700 1 -- 172.21.15.151:0/3634590832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180105ae0 msgr2=0x7f41801a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417ed9d700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180105ae0 0x7f41801a3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417ed9d700 1 -- 172.21.15.151:0/3634590832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4180100480 msgr2=0x7f4180072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417ed9d700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4180100480 0x7f4180072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417ed9d700 1 -- 172.21.15.151:0/3634590832 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41740095f0 con 0x7f41800ffad0 2023-07-21T22:19:33.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417e59c700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4180100480 0x7f4180072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:33.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.059+0000 7f417ed9d700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41800ffad0 0x7f4180072810 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f417000e9a0 tx=0x7f417000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.060+0000 7f4167fff700 1 -- 172.21.15.151:0/3634590832 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170009790 con 0x7f41800ffad0 2023-07-21T22:19:33.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.060+0000 7f41851ff700 1 -- 172.21.15.151:0/3634590832 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41801a4590 con 0x7f41800ffad0 2023-07-21T22:19:33.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.060+0000 7f4167fff700 1 -- 172.21.15.151:0/3634590832 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4170010430 con 0x7f41800ffad0 2023-07-21T22:19:33.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.060+0000 7f4167fff700 1 -- 172.21.15.151:0/3634590832 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417000cea0 con 0x7f41800ffad0 2023-07-21T22:19:33.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.060+0000 7f41851ff700 1 -- 172.21.15.151:0/3634590832 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41801a4ac0 con 0x7f41800ffad0 2023-07-21T22:19:33.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.063+0000 7f4167fff700 1 -- 172.21.15.151:0/3634590832 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f41700105a0 con 0x7f41800ffad0 2023-07-21T22:19:33.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.064+0000 7f4198ae2b80 1 Processor -- start 2023-07-21T22:19:33.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.065+0000 7f4198ae2b80 1 -- start start 2023-07-21T22:19:33.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.065+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca66894580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.065+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca6688f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.065+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca6688f930 0x55ca6688fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.065+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca66794cb0 con 0x55ca6688f930 2023-07-21T22:19:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.065+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca667e7a40 con 0x55ca66894ac0 2023-07-21T22:19:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.065+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca667e0ed0 con 0x55ca668941b0 2023-07-21T22:19:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.065+0000 7f4167fff700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f41680a1350 0x7f41680a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca66894580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca66894580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42480/0 (socket says 172.21.15.151:42480) 2023-07-21T22:19:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417f59e700 1 -- 172.21.15.151:0/2532242 learned_addr learned my addr 172.21.15.151:0/2532242 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417ed9d700 1 --2- 172.21.15.151:0/2532242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca6688f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417e59c700 1 --2- 172.21.15.151:0/2532242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca6688f930 0x55ca6688fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f4167fff700 1 -- 172.21.15.151:0/3634590832 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f4170014070 con 0x7f41800ffad0 2023-07-21T22:19:33.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417f59e700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f41680a1350 0x7f41680a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417ed9d700 1 -- 172.21.15.151:0/2532242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 msgr2=0x55ca66894580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417ed9d700 1 --2- 172.21.15.151:0/2532242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca66894580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417ed9d700 1 -- 172.21.15.151:0/2532242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca6688f930 msgr2=0x55ca6688fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417ed9d700 1 --2- 172.21.15.151:0/2532242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca6688f930 0x55ca6688fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417ed9d700 1 -- 172.21.15.151:0/2532242 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca6660ede0 con 0x55ca66894ac0 2023-07-21T22:19:33.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.066+0000 7f417ed9d700 1 --2- 172.21.15.151:0/2532242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca6688f350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41700ca6f0 tx=0x7f4170065410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40f1f83197f45c06 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.067+0000 7f41657fa700 1 -- 172.21.15.151:0/2532242 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4170025170 con 0x55ca66894ac0 2023-07-21T22:19:33.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.067+0000 7f41657fa700 1 -- 172.21.15.151:0/2532242 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4170010880 con 0x55ca66894ac0 2023-07-21T22:19:33.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.067+0000 7f41657fa700 1 -- 172.21.15.151:0/2532242 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417009a480 con 0x55ca66894ac0 2023-07-21T22:19:33.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.067+0000 7f4198ae2b80 1 -- 172.21.15.151:0/2532242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 msgr2=0x55ca6688f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.067+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/2532242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca6688f350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f41700ca6f0 tx=0x7f4170065410 comp rx=0 tx=0).stop 2023-07-21T22:19:33.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.067+0000 7f417f59e700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f41680a1350 0x7f41680a3800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41780060b0 tx=0x7f4178004b40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.067+0000 7f4198ae2b80 1 -- 172.21.15.151:0/2532242 shutdown_connections 2023-07-21T22:19:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.068+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/2532242 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca6688f930 0x55ca6688fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.068+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/2532242 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca66894580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.068+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/2532242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca6688f350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.068+0000 7f4198ae2b80 1 -- 172.21.15.151:0/2532242 >> 172.21.15.151:0/2532242 conn(0x55ca66884ef0 msgr2=0x55ca6688a830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.068+0000 7f4198ae2b80 1 -- 172.21.15.151:0/2532242 shutdown_connections 2023-07-21T22:19:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.068+0000 7f4198ae2b80 1 -- 172.21.15.151:0/2532242 wait complete. 2023-07-21T22:19:33.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.068+0000 7f4198ae2b80 1 -- start start 2023-07-21T22:19:33.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.068+0000 7f4198ae2b80 1 Processor -- start 2023-07-21T22:19:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca6689bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca668941b0 0x55ca66898dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca66899400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca66780ac0 con 0x55ca668941b0 2023-07-21T22:19:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca667807c0 con 0x55ca66894ac0 2023-07-21T22:19:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca66664920 con 0x55ca6688f930 2023-07-21T22:19:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f4198ae2b80 10 client.0 _ll_register_callbacks cb 0x55ca6677e760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f417e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca668941b0 0x55ca66898dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f417f59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca66899400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f417ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca6689bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f417e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca668941b0 0x55ca66898dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44510/0 (socket says 172.21.15.151:44510) 2023-07-21T22:19:33.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f417ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca6689bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42484/0 (socket says 172.21.15.151:42484) 2023-07-21T22:19:33.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f417e59c700 1 -- 172.21.15.151:0/3670944213 learned_addr learned my addr 172.21.15.151:0/3670944213 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:33.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.069+0000 7f417f59e700 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca66899400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34776/0 (socket says 172.21.15.151:34776) 2023-07-21T22:19:33.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f417ed9d700 1 -- 172.21.15.151:0/3670944213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 msgr2=0x55ca66899400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f417ed9d700 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca66899400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f417ed9d700 1 -- 172.21.15.151:0/3670944213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca668941b0 msgr2=0x55ca66898dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f417ed9d700 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca668941b0 0x55ca66898dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f417ed9d700 1 -- 172.21.15.151:0/3670944213 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41801a4ac0 con 0x55ca6688f930 2023-07-21T22:19:33.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f417f59e700 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca66899400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:33.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f417ed9d700 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca6689bb50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4170098310 tx=0x7f4170010bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd32bdffa7e9c88 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f4162ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:19:33.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f4162ff5700 1 -- 172.21.15.151:0/3670944213 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f417009dff0 con 0x55ca6688f930 2023-07-21T22:19:33.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f4162ff5700 1 -- 172.21.15.151:0/3670944213 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f41700a2410 con 0x55ca6688f930 2023-07-21T22:19:33.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.070+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3670944213 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca6673a4f0 con 0x55ca6688f930 2023-07-21T22:19:33.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4162ff5700 1 -- 172.21.15.151:0/3670944213 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4170099fc0 con 0x55ca6688f930 2023-07-21T22:19:33.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4198ae2b80 10 client.25444 fetch_fsmap learned FSMap version 25 2023-07-21T22:19:33.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3670944213 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ca665f7c60 con 0x55ca6688f930 2023-07-21T22:19:33.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4162ff5700 1 -- 172.21.15.151:0/3670944213 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41700b6020 con 0x55ca6688f930 2023-07-21T22:19:33.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4162ff5700 1 -- 172.21.15.151:0/3670944213 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f41700ca9a0 con 0x55ca6688f930 2023-07-21T22:19:33.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4198ae2b80 10 client.25444 fetch_fsmap finished waiting for FSMap version 25 2023-07-21T22:19:33.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4198ae2b80 10 client.25444 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:33.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4198ae2b80 20 client.25444 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:33.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca668a9040 0x55ca668ab450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.122 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4198ae2b80 4 client.25444 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:33.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3670944213 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca667d9eb0 con 0x55ca668a9040 2023-07-21T22:19:33.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.071+0000 7f417e59c700 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca668a9040 0x55ca668ab450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.072+0000 7f417e59c700 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca668a9040 0x55ca668ab450 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10803fd6e5bdcbba server_cookie=8adf210952698197 in_seq=0 out_seq=0 2023-07-21T22:19:33.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.072+0000 7f4162ff5700 10 client.25444 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:33.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.073+0000 7f4162ff5700 1 -- 172.21.15.151:0/3670944213 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ca667d9eb0 con 0x55ca668a9040 2023-07-21T22:19:33.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.073+0000 7f4162ff5700 10 client.25444 handle_command_reply: tid=0 2023-07-21T22:19:33.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.073+0000 7f4198ae2b80 1 client.25444 shutdown 2023-07-21T22:19:33.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.073+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3670944213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 msgr2=0x55ca6689bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.073+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca6689bb50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4170098310 tx=0x7f4170010bf0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3670944213 shutdown_connections 2023-07-21T22:19:33.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca668a9040 0x55ca668ab450 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca66894ac0 0x55ca66899400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca6689bb50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4162ff5700 0 client.25444 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:33.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3670944213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca668941b0 0x55ca66898dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3670944213 >> 172.21.15.151:0/3670944213 conn(0x55ca66884ef0 msgr2=0x55ca6688a420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3670944213 shutdown_connections 2023-07-21T22:19:33.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3670944213 wait complete. 2023-07-21T22:19:33.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.074+0000 7f4198ae2b80 20 client.25444 trim_cache size 0 max 16384 2023-07-21T22:19:33.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.091+0000 7f4198ae2b80 1 Processor -- start 2023-07-21T22:19:33.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.091+0000 7f4198ae2b80 1 -- start start 2023-07-21T22:19:33.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.091+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca668a0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.091+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca668941b0 0x55ca6689b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.091+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 0x55ca6688a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.091+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca66890740 con 0x55ca66894ac0 2023-07-21T22:19:33.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.091+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6689a3b0 con 0x55ca668941b0 2023-07-21T22:19:33.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.091+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6689c130 con 0x55ca6688f930 2023-07-21T22:19:33.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca668a0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca668a0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42490/0 (socket says 172.21.15.151:42490) 2023-07-21T22:19:33.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417ed9d700 1 -- 172.21.15.151:0/3868555201 learned_addr learned my addr 172.21.15.151:0/3868555201 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:33.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417e59c700 1 --2- 172.21.15.151:0/3868555201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca668941b0 0x55ca6689b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417f59e700 1 --2- 172.21.15.151:0/3868555201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 0x55ca6688a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417ed9d700 1 -- 172.21.15.151:0/3868555201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca668941b0 msgr2=0x55ca6689b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417ed9d700 1 --2- 172.21.15.151:0/3868555201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca668941b0 0x55ca6689b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417ed9d700 1 -- 172.21.15.151:0/3868555201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 msgr2=0x55ca6688a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417ed9d700 1 --2- 172.21.15.151:0/3868555201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 0x55ca6688a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417ed9d700 1 -- 172.21.15.151:0/3868555201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca66635250 con 0x55ca6688f930 2023-07-21T22:19:33.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f417ed9d700 1 --2- 172.21.15.151:0/3868555201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca668a0580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4170099f50 tx=0x7f4170099e40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=283148185623cb76 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f4165ffb700 1 -- 172.21.15.151:0/3868555201 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700a2410 con 0x55ca6688f930 2023-07-21T22:19:33.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f4165ffb700 1 -- 172.21.15.151:0/3868555201 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f41700b6030 con 0x55ca6688f930 2023-07-21T22:19:33.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.092+0000 7f4165ffb700 1 -- 172.21.15.151:0/3868555201 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700a1f80 con 0x55ca6688f930 2023-07-21T22:19:33.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.093+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3868555201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 msgr2=0x55ca668a0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.093+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3868555201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca668a0580 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f4170099f50 tx=0x7f4170099e40 comp rx=0 tx=0).stop 2023-07-21T22:19:33.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.093+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3868555201 shutdown_connections 2023-07-21T22:19:33.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.093+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3868555201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 0x55ca6688a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.093+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3868555201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca6688f930 0x55ca668a0580 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.093+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/3868555201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca668941b0 0x55ca6689b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.093+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3868555201 >> 172.21.15.151:0/3868555201 conn(0x55ca66884ef0 msgr2=0x55ca66888f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.093+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3868555201 shutdown_connections 2023-07-21T22:19:33.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.093+0000 7f4198ae2b80 1 -- 172.21.15.151:0/3868555201 wait complete. 2023-07-21T22:19:33.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.094+0000 7f4198ae2b80 1 -- start start 2023-07-21T22:19:33.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.094+0000 7f4198ae2b80 1 Processor -- start 2023-07-21T22:19:33.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.094+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6688f930 0x55ca6689ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.094+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca668a04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.094+0000 7f4198ae2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 0x55ca6689e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.094+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6689ea20 con 0x55ca66894ac0 2023-07-21T22:19:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.094+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6689eb90 con 0x55ca6688f930 2023-07-21T22:19:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.094+0000 7f4198ae2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca6689ed50 con 0x55ca668941b0 2023-07-21T22:19:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f4198ae2b80 10 client.0 _ll_register_callbacks cb 0x7f4170005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417ed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6688f930 0x55ca6689ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417ed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6688f930 0x55ca6689ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34796/0 (socket says 172.21.15.151:34796) 2023-07-21T22:19:33.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417ed9d700 1 -- 172.21.15.151:0/125531670 learned_addr learned my addr 172.21.15.151:0/125531670 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:33.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417f59e700 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 0x55ca6689e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417e59c700 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca668a04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417ed9d700 1 -- 172.21.15.151:0/125531670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 msgr2=0x55ca668a04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417ed9d700 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca668a04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417ed9d700 1 -- 172.21.15.151:0/125531670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 msgr2=0x55ca6689e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:33.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417ed9d700 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 0x55ca6689e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417ed9d700 1 -- 172.21.15.151:0/125531670 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca665f7c60 con 0x55ca6688f930 2023-07-21T22:19:33.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.095+0000 7f417e59c700 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca668a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:33.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.096+0000 7f417ed9d700 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6688f930 0x55ca6689ff90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4170000c00 tx=0x7f41700ca800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3488c4932c55150 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:33.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.096+0000 7f4162ff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:19:33.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.096+0000 7f4162ff5700 1 -- 172.21.15.151:0/125531670 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700b2210 con 0x55ca6688f930 2023-07-21T22:19:33.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.096+0000 7f4162ff5700 1 -- 172.21.15.151:0/125531670 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f41700b7080 con 0x55ca6688f930 2023-07-21T22:19:33.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.096+0000 7f4198ae2b80 1 -- 172.21.15.151:0/125531670 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4170010880 con 0x55ca6688f930 2023-07-21T22:19:33.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.096+0000 7f4162ff5700 1 -- 172.21.15.151:0/125531670 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f417009dff0 con 0x55ca6688f930 2023-07-21T22:19:33.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.096+0000 7f4198ae2b80 10 client.25409 fetch_fsmap learned FSMap version 25 2023-07-21T22:19:33.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.096+0000 7f4198ae2b80 1 -- 172.21.15.151:0/125531670 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) v3 -- 0x55ca6660d2b0 con 0x55ca6688f930 2023-07-21T22:19:33.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.096+0000 7f4162ff5700 1 -- 172.21.15.151:0/125531670 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4170010880 con 0x55ca6688f930 2023-07-21T22:19:33.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f4162ff5700 1 -- 172.21.15.151:0/125531670 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 25) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f41700b25e0 con 0x55ca6688f930 2023-07-21T22:19:33.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f4198ae2b80 10 client.25409 fetch_fsmap finished waiting for FSMap version 25 2023-07-21T22:19:33.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f4198ae2b80 10 client.25409 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:33.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f4198ae2b80 20 client.25409 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca668fdbc0 0x55ca668fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f4198ae2b80 4 client.25409 mds_command: new command op to 24599 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:19:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f4198ae2b80 1 -- 172.21.15.151:0/125531670 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55ca6679c050 con 0x55ca668fdbc0 2023-07-21T22:19:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f417e59c700 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca668fdbc0 0x55ca668fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f417e59c700 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca668fdbc0 0x55ca668fffa0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e70d4a5516e4bab5 server_cookie=1a3588ea7889efd2 in_seq=0 out_seq=0 2023-07-21T22:19:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.097+0000 7f4162ff5700 10 client.25409 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4162ff5700 1 -- 172.21.15.151:0/125531670 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55ca6679c050 con 0x55ca668fdbc0 2023-07-21T22:19:33.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4162ff5700 10 client.25409 handle_command_reply: tid=0 2023-07-21T22:19:33.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 client.25409 shutdown 2023-07-21T22:19:33.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 -- 172.21.15.151:0/125531670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6688f930 msgr2=0x55ca6689ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6688f930 0x55ca6689ff90 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f4170000c00 tx=0x7f41700ca800 comp rx=0 tx=0).stop 2023-07-21T22:19:33.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 -- 172.21.15.151:0/125531670 shutdown_connections 2023-07-21T22:19:33.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca668fdbc0 0x55ca668fffa0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca6688f930 0x55ca6689ff90 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca66894ac0 0x55ca6689e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4162ff5700 0 client.25409 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 --2- 172.21.15.151:0/125531670 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca668941b0 0x55ca668a04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 -- 172.21.15.151:0/125531670 >> 172.21.15.151:0/125531670 conn(0x55ca66884ef0 msgr2=0x55ca6688a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 -- 172.21.15.151:0/125531670 shutdown_connections 2023-07-21T22:19:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.098+0000 7f4198ae2b80 1 -- 172.21.15.151:0/125531670 wait complete. 2023-07-21T22:19:33.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f4198ae2b80 20 client.25409 trim_cache size 0 max 16384 2023-07-21T22:19:33.150 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:19:33.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 -- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f41680a1350 msgr2=0x7f41680a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f41680a1350 0x7f41680a3800 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f41780060b0 tx=0x7f4178004b40 comp rx=0 tx=0).stop 2023-07-21T22:19:33.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 -- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41800ffad0 msgr2=0x7f4180072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:33.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41800ffad0 0x7f4180072810 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f417000e9a0 tx=0x7f417000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 -- 172.21.15.151:0/3634590832 shutdown_connections 2023-07-21T22:19:33.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f41680a1350 0x7f41680a3800 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4180105ae0 0x7f41801a3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41800ffad0 0x7f4180072810 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 --2- 172.21.15.151:0/3634590832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4180100480 0x7f4180072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:33.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 -- 172.21.15.151:0/3634590832 >> 172.21.15.151:0/3634590832 conn(0x7f41800fb5f0 msgr2=0x7f41800fbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:33.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 -- 172.21.15.151:0/3634590832 shutdown_connections 2023-07-21T22:19:33.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:33.099+0000 7f41851ff700 1 -- 172.21.15.151:0/3634590832 wait complete. 2023-07-21T22:19:33.219 INFO:teuthology.orchestra.run.smithi151.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2023-07-21T22:19:33.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-07-21T22:19:33.926 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/: 2023-07-21T22:19:33.956 INFO:teuthology.orchestra.run.smithi151.stdout:total 2 2023-07-21T22:19:33.956 INFO:teuthology.orchestra.run.smithi151.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 24786244 Jul 21 22:19 . 2023-07-21T22:19:33.956 INFO:teuthology.orchestra.run.smithi151.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 24786244 Jul 21 22:19 .. 2023-07-21T22:19:33.956 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 24786244 Jul 21 22:19 data 2023-07-21T22:19:33.956 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:33.957 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data: 2023-07-21T22:19:33.957 INFO:teuthology.orchestra.run.smithi151.stdout:total 40 2023-07-21T22:19:33.957 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 24786244 Jul 21 22:19 . 2023-07-21T22:19:33.957 INFO:teuthology.orchestra.run.smithi151.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 24786244 Jul 21 22:19 .. 2023-07-21T22:19:33.957 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 base 2023-07-21T22:19:33.957 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Jul 21 22:19 global 2023-07-21T22:19:33.957 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 log 2023-07-21T22:19:33.958 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_commit_ts 2023-07-21T22:19:33.958 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_dynshmem 2023-07-21T22:19:33.958 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Jul 21 22:19 pg_hba.conf 2023-07-21T22:19:33.958 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jul 21 22:19 pg_ident.conf 2023-07-21T22:19:33.958 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 22:19 pg_logical 2023-07-21T22:19:33.958 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 pg_multixact 2023-07-21T22:19:33.958 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_notify 2023-07-21T22:19:33.958 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_replslot 2023-07-21T22:19:33.959 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_serial 2023-07-21T22:19:33.959 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_snapshots 2023-07-21T22:19:33.959 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_stat 2023-07-21T22:19:33.959 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_stat_tmp 2023-07-21T22:19:33.959 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 pg_subtrans 2023-07-21T22:19:33.959 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_tblspc 2023-07-21T22:19:33.959 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_twophase 2023-07-21T22:19:33.959 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 21 22:19 PG_VERSION 2023-07-21T22:19:33.960 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 22:19 pg_wal 2023-07-21T22:19:33.960 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 pg_xact 2023-07-21T22:19:33.960 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jul 21 22:19 postgresql.auto.conf 2023-07-21T22:19:33.960 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Jul 21 22:19 postgresql.conf 2023-07-21T22:19:33.960 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:33.960 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/base: 2023-07-21T22:19:33.960 INFO:teuthology.orchestra.run.smithi151.stdout:total 3 2023-07-21T22:19:33.960 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 . 2023-07-21T22:19:33.961 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 24786244 Jul 21 22:19 .. 2023-07-21T22:19:33.961 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 1 2023-07-21T22:19:33.961 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 12346 2023-07-21T22:19:33.961 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 12347 2023-07-21T22:19:33.961 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:33.961 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/base/1: 2023-07-21T22:19:33.961 INFO:teuthology.orchestra.run.smithi151.stdout:total 7210 2023-07-21T22:19:33.961 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 . 2023-07-21T22:19:33.962 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 .. 2023-07-21T22:19:33.962 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 112 2023-07-21T22:19:33.962 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 113 2023-07-21T22:19:33.962 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 21 22:19 12182 2023-07-21T22:19:33.962 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12182_fsm 2023-07-21T22:19:33.962 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12182_vm 2023-07-21T22:19:33.962 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12184 2023-07-21T22:19:33.962 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12186 2023-07-21T22:19:33.963 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187 2023-07-21T22:19:33.963 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12187_fsm 2023-07-21T22:19:33.963 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187_vm 2023-07-21T22:19:33.963 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12189 2023-07-21T22:19:33.963 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12191 2023-07-21T22:19:33.963 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192 2023-07-21T22:19:33.963 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12192_fsm 2023-07-21T22:19:33.963 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192_vm 2023-07-21T22:19:33.964 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12194 2023-07-21T22:19:33.964 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12196 2023-07-21T22:19:33.964 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197 2023-07-21T22:19:33.964 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12197_fsm 2023-07-21T22:19:33.964 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197_vm 2023-07-21T22:19:33.964 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12199 2023-07-21T22:19:33.964 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12201 2023-07-21T22:19:33.965 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202 2023-07-21T22:19:33.965 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12202_fsm 2023-07-21T22:19:33.965 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202_vm 2023-07-21T22:19:33.965 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12204 2023-07-21T22:19:33.965 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12206 2023-07-21T22:19:33.965 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207 2023-07-21T22:19:33.965 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12207_fsm 2023-07-21T22:19:33.965 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207_vm 2023-07-21T22:19:33.966 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12209 2023-07-21T22:19:33.966 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12211 2023-07-21T22:19:33.966 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12212 2023-07-21T22:19:33.966 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12214 2023-07-21T22:19:33.966 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12216 2023-07-21T22:19:33.966 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 21 22:19 1247 2023-07-21T22:19:33.966 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1247_fsm 2023-07-21T22:19:33.966 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1247_vm 2023-07-21T22:19:33.967 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 21 22:19 1249 2023-07-21T22:19:33.967 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1249_fsm 2023-07-21T22:19:33.967 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1249_vm 2023-07-21T22:19:33.967 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 21 22:19 1255 2023-07-21T22:19:33.967 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1255_fsm 2023-07-21T22:19:33.967 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1255_vm 2023-07-21T22:19:33.967 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 21 22:19 1259 2023-07-21T22:19:33.967 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1259_fsm 2023-07-21T22:19:33.968 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1259_vm 2023-07-21T22:19:33.968 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417 2023-07-21T22:19:33.968 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417_vm 2023-07-21T22:19:33.968 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418 2023-07-21T22:19:33.968 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418_vm 2023-07-21T22:19:33.968 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 174 2023-07-21T22:19:33.968 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 175 2023-07-21T22:19:33.968 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2187 2023-07-21T22:19:33.969 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224 2023-07-21T22:19:33.969 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224_vm 2023-07-21T22:19:33.969 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328 2023-07-21T22:19:33.969 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328_vm 2023-07-21T22:19:33.969 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336 2023-07-21T22:19:33.969 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336_vm 2023-07-21T22:19:33.969 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2337 2023-07-21T22:19:33.969 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2600 2023-07-21T22:19:33.970 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2600_fsm 2023-07-21T22:19:33.970 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2600_vm 2023-07-21T22:19:33.970 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601 2023-07-21T22:19:33.970 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2601_fsm 2023-07-21T22:19:33.970 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601_vm 2023-07-21T22:19:33.970 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2602 2023-07-21T22:19:33.970 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2602_fsm 2023-07-21T22:19:33.971 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2602_vm 2023-07-21T22:19:33.971 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2603 2023-07-21T22:19:33.971 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2603_fsm 2023-07-21T22:19:33.971 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2603_vm 2023-07-21T22:19:33.971 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604 2023-07-21T22:19:33.971 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604_vm 2023-07-21T22:19:33.971 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2605 2023-07-21T22:19:33.971 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2605_fsm 2023-07-21T22:19:33.972 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2605_vm 2023-07-21T22:19:33.972 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606 2023-07-21T22:19:33.972 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2606_fsm 2023-07-21T22:19:33.972 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606_vm 2023-07-21T22:19:33.972 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607 2023-07-21T22:19:33.972 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607_fsm 2023-07-21T22:19:33.972 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2607_vm 2023-07-21T22:19:33.972 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 21 22:19 2608 2023-07-21T22:19:33.973 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2608_fsm 2023-07-21T22:19:33.973 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2608_vm 2023-07-21T22:19:33.973 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 21 22:19 2609 2023-07-21T22:19:33.973 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2609_fsm 2023-07-21T22:19:33.973 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2609_vm 2023-07-21T22:19:33.973 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610 2023-07-21T22:19:33.973 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610_fsm 2023-07-21T22:19:33.973 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2610_vm 2023-07-21T22:19:33.974 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611 2023-07-21T22:19:33.974 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611_vm 2023-07-21T22:19:33.974 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612 2023-07-21T22:19:33.974 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2612_fsm 2023-07-21T22:19:33.974 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612_vm 2023-07-21T22:19:33.974 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613 2023-07-21T22:19:33.974 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613_vm 2023-07-21T22:19:33.974 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615 2023-07-21T22:19:33.975 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2615_fsm 2023-07-21T22:19:33.975 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615_vm 2023-07-21T22:19:33.975 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616 2023-07-21T22:19:33.975 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616_fsm 2023-07-21T22:19:33.975 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2616_vm 2023-07-21T22:19:33.975 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 21 22:19 2617 2023-07-21T22:19:33.975 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2617_fsm 2023-07-21T22:19:33.975 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2617_vm 2023-07-21T22:19:33.976 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 21 22:19 2618 2023-07-21T22:19:33.976 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2618_fsm 2023-07-21T22:19:33.976 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2618_vm 2023-07-21T22:19:33.976 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 21 22:19 2619 2023-07-21T22:19:33.976 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2619_fsm 2023-07-21T22:19:33.976 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2619_vm 2023-07-21T22:19:33.976 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620 2023-07-21T22:19:33.976 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620_vm 2023-07-21T22:19:33.977 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2650 2023-07-21T22:19:33.977 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2651 2023-07-21T22:19:33.977 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2652 2023-07-21T22:19:33.977 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2653 2023-07-21T22:19:33.977 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2654 2023-07-21T22:19:33.977 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2655 2023-07-21T22:19:33.977 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2656 2023-07-21T22:19:33.977 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2657 2023-07-21T22:19:33.978 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 21 22:19 2658 2023-07-21T22:19:33.978 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2659 2023-07-21T22:19:33.978 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2660 2023-07-21T22:19:33.978 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2661 2023-07-21T22:19:33.978 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2662 2023-07-21T22:19:33.978 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2663 2023-07-21T22:19:33.978 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2664 2023-07-21T22:19:33.978 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2665 2023-07-21T22:19:33.979 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2666 2023-07-21T22:19:33.979 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2667 2023-07-21T22:19:33.979 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2668 2023-07-21T22:19:33.979 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2669 2023-07-21T22:19:33.979 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2670 2023-07-21T22:19:33.979 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Jul 21 22:19 2673 2023-07-21T22:19:33.979 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 21 22:19 2674 2023-07-21T22:19:33.979 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 21 22:19 2675 2023-07-21T22:19:33.980 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2678 2023-07-21T22:19:33.980 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2679 2023-07-21T22:19:33.980 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2680 2023-07-21T22:19:33.980 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2681 2023-07-21T22:19:33.980 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2682 2023-07-21T22:19:33.980 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2683 2023-07-21T22:19:33.980 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2684 2023-07-21T22:19:33.980 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2685 2023-07-21T22:19:33.981 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2686 2023-07-21T22:19:33.981 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2687 2023-07-21T22:19:33.981 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2688 2023-07-21T22:19:33.981 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2689 2023-07-21T22:19:33.981 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2690 2023-07-21T22:19:33.981 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 21 22:19 2691 2023-07-21T22:19:33.981 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2692 2023-07-21T22:19:33.981 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2693 2023-07-21T22:19:33.982 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2696 2023-07-21T22:19:33.982 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2699 2023-07-21T22:19:33.982 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2701 2023-07-21T22:19:33.982 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2702 2023-07-21T22:19:33.982 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2703 2023-07-21T22:19:33.982 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2704 2023-07-21T22:19:33.982 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2753 2023-07-21T22:19:33.982 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2753_fsm 2023-07-21T22:19:33.983 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2753_vm 2023-07-21T22:19:33.983 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2754 2023-07-21T22:19:33.983 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2755 2023-07-21T22:19:33.983 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2756 2023-07-21T22:19:33.983 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2757 2023-07-21T22:19:33.983 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830 2023-07-21T22:19:33.983 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830_vm 2023-07-21T22:19:33.983 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2831 2023-07-21T22:19:33.984 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832 2023-07-21T22:19:33.984 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832_vm 2023-07-21T22:19:33.984 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2833 2023-07-21T22:19:33.984 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834 2023-07-21T22:19:33.984 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834_vm 2023-07-21T22:19:33.984 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2835 2023-07-21T22:19:33.984 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836 2023-07-21T22:19:33.984 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836_vm 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2837 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 21 22:19 2838 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2838_fsm 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2838_vm 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2839 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840_fsm 2023-07-21T22:19:33.985 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2840_vm 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2841 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995_vm 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2996 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3079_fsm 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079_vm 2023-07-21T22:19:33.986 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3080 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3081 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3085 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118_vm 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3119 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3164 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256 2023-07-21T22:19:33.987 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256_vm 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3257 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3258 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350_vm 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3351 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3379 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3380 2023-07-21T22:19:33.988 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381_vm 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3394 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3394_fsm 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3394_vm 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3395 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439_vm 2023-07-21T22:19:33.989 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3440 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 3455 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3456 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3456_fsm 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3456_vm 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466_vm 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3467 2023-07-21T22:19:33.990 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3468 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501_vm 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3502 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3503 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3534 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3541_fsm 2023-07-21T22:19:33.991 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541_vm 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3542 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3574 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3575 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576_vm 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596_vm 2023-07-21T22:19:33.992 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3597 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598_vm 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3599 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3600_fsm 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600_vm 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601 2023-07-21T22:19:33.993 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3601_fsm 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601_vm 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3602_fsm 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602_vm 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3603 2023-07-21T22:19:33.994 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3603_fsm 2023-07-21T22:19:34.164 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-21T22:19:34.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-21T22:19:34.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.348+0000 7f65c03ff700 1 -- 172.21.15.151:0/3694045974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8073140 msgr2=0x7f65b810be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.348+0000 7f65c03ff700 1 --2- 172.21.15.151:0/3694045974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8073140 0x7f65b810be60 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009990 tx=0x7f65a8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.348+0000 7f65c03ff700 1 -- 172.21.15.151:0/3694045974 shutdown_connections 2023-07-21T22:19:34.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.348+0000 7f65c03ff700 1 --2- 172.21.15.151:0/3694045974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65b8072830 0x7f65b8072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.348+0000 7f65c03ff700 1 --2- 172.21.15.151:0/3694045974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65b810c3a0 0x7f65b810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.348+0000 7f65c03ff700 1 --2- 172.21.15.151:0/3694045974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8073140 0x7f65b810be60 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.348+0000 7f65c03ff700 1 -- 172.21.15.151:0/3694045974 >> 172.21.15.151:0/3694045974 conn(0x7f65b80fb5e0 msgr2=0x7f65b80fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.348+0000 7f65c03ff700 1 -- 172.21.15.151:0/3694045974 shutdown_connections 2023-07-21T22:19:34.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.348+0000 7f65c03ff700 1 -- 172.21.15.151:0/3694045974 wait complete. 2023-07-21T22:19:34.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.349+0000 7f65c03ff700 1 Processor -- start 2023-07-21T22:19:34.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.349+0000 7f65c03ff700 1 -- start start 2023-07-21T22:19:34.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.349+0000 7f65c03ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8072830 0x7f65b8197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.349+0000 7f65c03ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65b8073140 0x7f65b8198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.349+0000 7f65c03ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65b810c3a0 0x7f65b819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65c03ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b819cdf0 con 0x7f65b8072830 2023-07-21T22:19:34.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65c03ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b819cf60 con 0x7f65b8073140 2023-07-21T22:19:34.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65c03ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65b819d120 con 0x7f65b810c3a0 2023-07-21T22:19:34.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8072830 0x7f65b8197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8072830 0x7f65b8197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44564/0 (socket says 172.21.15.151:44564) 2023-07-21T22:19:34.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be99c700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65b810c3a0 0x7f65b819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be19b700 1 -- 172.21.15.151:0/2532716425 learned_addr learned my addr 172.21.15.151:0/2532716425 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65bd99a700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65b8073140 0x7f65b8198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be99c700 1 -- 172.21.15.151:0/2532716425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65b8073140 msgr2=0x7f65b8198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be99c700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65b8073140 0x7f65b8198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be99c700 1 -- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8072830 msgr2=0x7f65b8197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be99c700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8072830 0x7f65b8197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be99c700 1 -- 172.21.15.151:0/2532716425 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65a80095f0 con 0x7f65b810c3a0 2023-07-21T22:19:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.350+0000 7f65be19b700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8072830 0x7f65b8197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.351+0000 7f65be99c700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65b810c3a0 0x7f65b819c7b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f65b000efc0 tx=0x7f65b000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.351+0000 7f65af7fe700 1 -- 172.21.15.151:0/2532716425 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b0018070 con 0x7f65b810c3a0 2023-07-21T22:19:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.351+0000 7f65af7fe700 1 -- 172.21.15.151:0/2532716425 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65b000f040 con 0x7f65b810c3a0 2023-07-21T22:19:34.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.351+0000 7f65c03ff700 1 -- 172.21.15.151:0/2532716425 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65b819d3a0 con 0x7f65b810c3a0 2023-07-21T22:19:34.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.351+0000 7f65af7fe700 1 -- 172.21.15.151:0/2532716425 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b000cba0 con 0x7f65b810c3a0 2023-07-21T22:19:34.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.351+0000 7f65c03ff700 1 -- 172.21.15.151:0/2532716425 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b81a4c40 con 0x7f65b810c3a0 2023-07-21T22:19:34.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.356+0000 7f65af7fe700 1 -- 172.21.15.151:0/2532716425 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f65b0003a00 con 0x7f65b810c3a0 2023-07-21T22:19:34.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.357+0000 7f65d3d35b80 1 Processor -- start 2023-07-21T22:19:34.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.357+0000 7f65d3d35b80 1 -- start start 2023-07-21T22:19:34.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.357+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51544600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.357+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea5153f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.357+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5153fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.357+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea51444d30 con 0x55ea51544230 2023-07-21T22:19:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.357+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea51497ac0 con 0x55ea5153f9b0 2023-07-21T22:19:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.357+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea51490f50 con 0x55ea51544b40 2023-07-21T22:19:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65bd99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51544600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65af7fe700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f65a40a13d0 0x7f65a40a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65be19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea5153f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65bd99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51544600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44570/0 (socket says 172.21.15.151:44570) 2023-07-21T22:19:34.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65bd99a700 1 -- 172.21.15.151:0/2507016074 learned_addr learned my addr 172.21.15.151:0/2507016074 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65bd99a700 1 --2- 172.21.15.151:0/2507016074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5153fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65af7fe700 1 -- 172.21.15.151:0/2532716425 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f65b00cc850 con 0x7f65b810c3a0 2023-07-21T22:19:34.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65be99c700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f65a40a13d0 0x7f65a40a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65be19b700 1 -- 172.21.15.151:0/2507016074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 msgr2=0x55ea5153fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65be19b700 1 --2- 172.21.15.151:0/2507016074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5153fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65be19b700 1 -- 172.21.15.151:0/2507016074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 msgr2=0x55ea51544600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65be19b700 1 --2- 172.21.15.151:0/2507016074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51544600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65be19b700 1 -- 172.21.15.151:0/2507016074 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea512bee60 con 0x55ea51544b40 2023-07-21T22:19:34.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.358+0000 7f65bd99a700 1 --2- 172.21.15.151:0/2507016074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51544600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:34.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.359+0000 7f65be19b700 1 --2- 172.21.15.151:0/2507016074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea5153f3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65b4010480 tx=0x7f65b4010790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90fd426882330bf9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.359+0000 7f65be99c700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f65a40a13d0 0x7f65a40a3880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65b00c9f90 tx=0x7f65b0009f10 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.359+0000 7f65acbfe700 1 -- 172.21.15.151:0/2507016074 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4004a30 con 0x55ea51544b40 2023-07-21T22:19:34.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.359+0000 7f65acbfe700 1 -- 172.21.15.151:0/2507016074 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65b4010ed0 con 0x55ea51544b40 2023-07-21T22:19:34.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.359+0000 7f65acbfe700 1 -- 172.21.15.151:0/2507016074 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b40116a0 con 0x55ea51544b40 2023-07-21T22:19:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.360+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2507016074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 msgr2=0x55ea5153f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.360+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/2507016074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea5153f3d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f65b4010480 tx=0x7f65b4010790 comp rx=0 tx=0).stop 2023-07-21T22:19:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.360+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2507016074 shutdown_connections 2023-07-21T22:19:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.360+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/2507016074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5153fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.360+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/2507016074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51544600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.360+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/2507016074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea5153f3d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.360+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2507016074 >> 172.21.15.151:0/2507016074 conn(0x55ea51534f70 msgr2=0x55ea5153a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.360+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2507016074 shutdown_connections 2023-07-21T22:19:34.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.360+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2507016074 wait complete. 2023-07-21T22:19:34.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.361+0000 7f65d3d35b80 1 -- start start 2023-07-21T22:19:34.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.361+0000 7f65d3d35b80 1 Processor -- start 2023-07-21T22:19:34.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.361+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.361+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51548e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.361+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea51549580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.361+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea51430b40 con 0x55ea51544230 2023-07-21T22:19:34.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.361+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea51430840 con 0x55ea5153f9b0 2023-07-21T22:19:34.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.361+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea513149a0 con 0x55ea51544b40 2023-07-21T22:19:34.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.361+0000 7f65d3d35b80 10 client.0 _ll_register_callbacks cb 0x55ea5142e7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:34.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65be19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51548e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65bd99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65be19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51548e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44586/0 (socket says 172.21.15.151:44586) 2023-07-21T22:19:34.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65be19b700 1 -- 172.21.15.151:0/18935294 learned_addr learned my addr 172.21.15.151:0/18935294 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65bd99a700 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea51549580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65be19b700 1 -- 172.21.15.151:0/18935294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 msgr2=0x55ea51549580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65be19b700 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea51549580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65be19b700 1 -- 172.21.15.151:0/18935294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 msgr2=0x55ea5154bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65be19b700 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65be19b700 1 -- 172.21.15.151:0/18935294 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65a8020040 con 0x55ea51544230 2023-07-21T22:19:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65be19b700 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51548e90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f65b4007720 tx=0x7f65b40127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a74c2cf25a79b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.362+0000 7f65a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:19:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.363+0000 7f65a1ffb700 1 -- 172.21.15.151:0/18935294 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b4027070 con 0x55ea51544230 2023-07-21T22:19:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.363+0000 7f65a1ffb700 1 -- 172.21.15.151:0/18935294 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f65b4012c70 con 0x55ea51544230 2023-07-21T22:19:34.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.363+0000 7f65d3d35b80 1 -- 172.21.15.151:0/18935294 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea513ea570 con 0x55ea51544230 2023-07-21T22:19:34.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.363+0000 7f65a1ffb700 1 -- 172.21.15.151:0/18935294 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65b401d040 con 0x55ea51544230 2023-07-21T22:19:34.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.363+0000 7f65d3d35b80 10 client.15660 fetch_fsmap learned FSMap version 26 2023-07-21T22:19:34.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.363+0000 7f65d3d35b80 1 -- 172.21.15.151:0/18935294 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f65b4007cd0 con 0x55ea51544230 2023-07-21T22:19:34.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.363+0000 7f65a1ffb700 1 -- 172.21.15.151:0/18935294 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ea513ea570 con 0x55ea51544230 2023-07-21T22:19:34.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.364+0000 7f65a1ffb700 1 -- 172.21.15.151:0/18935294 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f65b402a020 con 0x55ea51544230 2023-07-21T22:19:34.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.364+0000 7f65d3d35b80 10 client.15660 fetch_fsmap finished waiting for FSMap version 26 2023-07-21T22:19:34.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.364+0000 7f65d3d35b80 10 client.15660 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:34.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.364+0000 7f65d3d35b80 20 client.15660 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:34.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.364+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea515594f0 0x55ea5155b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.364+0000 7f65d3d35b80 4 client.15660 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:34.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.364+0000 7f65d3d35b80 1 -- 172.21.15.151:0/18935294 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea51489f30 con 0x55ea515594f0 2023-07-21T22:19:34.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.364+0000 7f65bd99a700 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea515594f0 0x55ea5155b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.365+0000 7f65bd99a700 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea515594f0 0x55ea5155b900 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8ecbf95ba7c404d server_cookie=c301231e734fd92f in_seq=0 out_seq=0 2023-07-21T22:19:34.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.365+0000 7f65a1ffb700 10 client.15660 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:34.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65a1ffb700 1 -- 172.21.15.151:0/18935294 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ea51489f30 con 0x55ea515594f0 2023-07-21T22:19:34.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65a1ffb700 10 client.15660 handle_command_reply: tid=0 2023-07-21T22:19:34.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 client.15660 shutdown 2023-07-21T22:19:34.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 -- 172.21.15.151:0/18935294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 msgr2=0x55ea51548e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51548e90 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f65b4007720 tx=0x7f65b40127c0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 -- 172.21.15.151:0/18935294 shutdown_connections 2023-07-21T22:19:34.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea515594f0 0x55ea5155b900 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea51549580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65a1ffb700 0 client.15660 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:34.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/18935294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544230 0x55ea51548e90 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 -- 172.21.15.151:0/18935294 >> 172.21.15.151:0/18935294 conn(0x55ea51534f70 msgr2=0x55ea5153a440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 -- 172.21.15.151:0/18935294 shutdown_connections 2023-07-21T22:19:34.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 1 -- 172.21.15.151:0/18935294 wait complete. 2023-07-21T22:19:34.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.366+0000 7f65d3d35b80 20 client.15660 trim_cache size 0 max 16384 2023-07-21T22:19:34.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.387+0000 7f65d3d35b80 1 Processor -- start 2023-07-21T22:19:34.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.387+0000 7f65d3d35b80 1 -- start start 2023-07-21T22:19:34.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5153f9b0 0x55ea5153f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea51544230 0x55ea515505f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea51545620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea513ea570 con 0x55ea5153f9b0 2023-07-21T22:19:34.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5154a470 con 0x55ea51544230 2023-07-21T22:19:34.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea51543e80 con 0x55ea51544b40 2023-07-21T22:19:34.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65bd99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5153f9b0 0x55ea5153f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65bd99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5153f9b0 0x55ea5153f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44594/0 (socket says 172.21.15.151:44594) 2023-07-21T22:19:34.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65bd99a700 1 -- 172.21.15.151:0/2985207898 learned_addr learned my addr 172.21.15.151:0/2985207898 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65be19b700 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea51544230 0x55ea515505f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65bd99a700 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea51545620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65bd99a700 1 -- 172.21.15.151:0/2985207898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 msgr2=0x55ea51545620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65bd99a700 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea51545620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65bd99a700 1 -- 172.21.15.151:0/2985207898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea51544230 msgr2=0x55ea515505f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65bd99a700 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea51544230 0x55ea515505f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65bd99a700 1 -- 172.21.15.151:0/2985207898 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea512a7ce0 con 0x55ea5153f9b0 2023-07-21T22:19:34.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.388+0000 7f65be19b700 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea51544230 0x55ea515505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:34.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.389+0000 7f65bd99a700 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5153f9b0 0x55ea5153f1f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f65a8000c00 tx=0x7f65a8009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23da1c5af99178a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.389+0000 7f65ad3ff700 1 -- 172.21.15.151:0/2985207898 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a801d040 con 0x55ea5153f9b0 2023-07-21T22:19:34.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.389+0000 7f65ad3ff700 1 -- 172.21.15.151:0/2985207898 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65a8004500 con 0x55ea5153f9b0 2023-07-21T22:19:34.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.389+0000 7f65ad3ff700 1 -- 172.21.15.151:0/2985207898 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a800f6c0 con 0x55ea5153f9b0 2023-07-21T22:19:34.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2985207898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5153f9b0 msgr2=0x55ea5153f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5153f9b0 0x55ea5153f1f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f65a8000c00 tx=0x7f65a8009310 comp rx=0 tx=0).stop 2023-07-21T22:19:34.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2985207898 shutdown_connections 2023-07-21T22:19:34.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544b40 0x55ea51545620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5153f9b0 0x55ea5153f1f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/2985207898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea51544230 0x55ea515505f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2985207898 >> 172.21.15.151:0/2985207898 conn(0x55ea51534f70 msgr2=0x55ea51544f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2985207898 shutdown_connections 2023-07-21T22:19:34.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 -- 172.21.15.151:0/2985207898 wait complete. 2023-07-21T22:19:34.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.390+0000 7f65d3d35b80 1 -- start start 2023-07-21T22:19:34.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.391+0000 7f65d3d35b80 1 Processor -- start 2023-07-21T22:19:34.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.391+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.391+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544230 0x55ea5154e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.391+0000 7f65d3d35b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544b40 0x55ea5154e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.391+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea515ae380 con 0x55ea51544b40 2023-07-21T22:19:34.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.391+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea515ae4c0 con 0x55ea5153f9b0 2023-07-21T22:19:34.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.391+0000 7f65d3d35b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea515ae600 con 0x55ea51544230 2023-07-21T22:19:34.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.391+0000 7f65d3d35b80 10 client.0 _ll_register_callbacks cb 0x7f65b00097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:34.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544b40 0x55ea5154e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34848/0 (socket says 172.21.15.151:34848) 2023-07-21T22:19:34.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 -- 172.21.15.151:0/544103762 learned_addr learned my addr 172.21.15.151:0/544103762 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65be19b700 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544230 0x55ea5154e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 -- 172.21.15.151:0/544103762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544230 msgr2=0x55ea5154e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544230 0x55ea5154e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 -- 172.21.15.151:0/544103762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544b40 msgr2=0x55ea5154e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544b40 0x55ea5154e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 -- 172.21.15.151:0/544103762 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65b4007cd0 con 0x55ea5153f9b0 2023-07-21T22:19:34.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65be19b700 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544230 0x55ea5154e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:34.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65bd99a700 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154dbe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65a8005930 tx=0x7f65a8009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb4c5b5236d06aa9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.392+0000 7f65a1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:19:34.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.393+0000 7f65a1ffb700 1 -- 172.21.15.151:0/544103762 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65a801d040 con 0x55ea5153f9b0 2023-07-21T22:19:34.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.393+0000 7f65d3d35b80 1 -- 172.21.15.151:0/544103762 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f65b4010ed0 con 0x55ea5153f9b0 2023-07-21T22:19:34.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.393+0000 7f65a1ffb700 1 -- 172.21.15.151:0/544103762 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f65a8004af0 con 0x55ea5153f9b0 2023-07-21T22:19:34.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.393+0000 7f65a1ffb700 1 -- 172.21.15.151:0/544103762 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f65a8004cb0 con 0x55ea5153f9b0 2023-07-21T22:19:34.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.393+0000 7f65d3d35b80 10 client.25427 fetch_fsmap learned FSMap version 26 2023-07-21T22:19:34.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.393+0000 7f65d3d35b80 1 -- 172.21.15.151:0/544103762 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x7f65b810f380 con 0x55ea5153f9b0 2023-07-21T22:19:34.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.393+0000 7f65a1ffb700 1 -- 172.21.15.151:0/544103762 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f65b4010ed0 con 0x55ea5153f9b0 2023-07-21T22:19:34.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.393+0000 7f65a1ffb700 1 -- 172.21.15.151:0/544103762 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f65a8039070 con 0x55ea5153f9b0 2023-07-21T22:19:34.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.394+0000 7f65d3d35b80 10 client.25427 fetch_fsmap finished waiting for FSMap version 26 2023-07-21T22:19:34.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.394+0000 7f65d3d35b80 10 client.25427 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:34.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.394+0000 7f65d3d35b80 20 client.25427 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:34.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.394+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea515af970 0x55ea515b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.394+0000 7f65d3d35b80 4 client.25427 mds_command: new command op to 24599 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-21T22:19:34.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.394+0000 7f65d3d35b80 1 -- 172.21.15.151:0/544103762 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55ea5144c0d0 con 0x55ea515af970 2023-07-21T22:19:34.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.394+0000 7f65be19b700 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea515af970 0x55ea515b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.394+0000 7f65be19b700 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea515af970 0x55ea515b1d80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99ba3d7ebd502cf1 server_cookie=c449356c33830f0c in_seq=0 out_seq=0 2023-07-21T22:19:34.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.394+0000 7f65a1ffb700 10 client.25427 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:34.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.395+0000 7f65a1ffb700 1 -- 172.21.15.151:0/544103762 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55ea5144c0d0 con 0x55ea515af970 2023-07-21T22:19:34.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.395+0000 7f65a1ffb700 10 client.25427 handle_command_reply: tid=0 2023-07-21T22:19:34.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.395+0000 7f65d3d35b80 1 client.25427 shutdown 2023-07-21T22:19:34.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 -- 172.21.15.151:0/544103762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 msgr2=0x55ea5154dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154dbe0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f65a8005930 tx=0x7f65a8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 -- 172.21.15.151:0/544103762 shutdown_connections 2023-07-21T22:19:34.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea515af970 0x55ea515b1d80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5153f9b0 0x55ea5154dbe0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea51544b40 0x55ea5154e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65a1ffb700 0 client.25427 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:34.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 --2- 172.21.15.151:0/544103762 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea51544230 0x55ea5154e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 -- 172.21.15.151:0/544103762 >> 172.21.15.151:0/544103762 conn(0x55ea51534f70 msgr2=0x55ea51543700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 -- 172.21.15.151:0/544103762 shutdown_connections 2023-07-21T22:19:34.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 1 -- 172.21.15.151:0/544103762 wait complete. 2023-07-21T22:19:34.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.396+0000 7f65d3d35b80 20 client.25427 trim_cache size 0 max 16384 2023-07-21T22:19:34.447 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:19:34.448 INFO:teuthology.orchestra.run.smithi151.stdout: "return_code": 0, 2023-07-21T22:19:34.448 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_tag": "c6c70218-5138-4107-bdf0-be89cd7b3dbb", 2023-07-21T22:19:34.448 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": "asynchronous" 2023-07-21T22:19:34.448 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:19:34.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 -- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f65a40a13d0 msgr2=0x7f65a40a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f65a40a13d0 0x7f65a40a3880 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f65b00c9f90 tx=0x7f65b0009f10 comp rx=0 tx=0).stop 2023-07-21T22:19:34.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 -- 172.21.15.151:0/2532716425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65b810c3a0 msgr2=0x7f65b819c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65b810c3a0 0x7f65b819c7b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f65b000efc0 tx=0x7f65b000c3a0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 -- 172.21.15.151:0/2532716425 shutdown_connections 2023-07-21T22:19:34.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f65a40a13d0 0x7f65a40a3880 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f65b810c3a0 0x7f65b819c7b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f65b8072830 0x7f65b8197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 --2- 172.21.15.151:0/2532716425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65b8073140 0x7f65b8198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 -- 172.21.15.151:0/2532716425 >> 172.21.15.151:0/2532716425 conn(0x7f65b80fb5e0 msgr2=0x7f65b810e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 -- 172.21.15.151:0/2532716425 shutdown_connections 2023-07-21T22:19:34.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.397+0000 7f65c03ff700 1 -- 172.21.15.151:0/2532716425 wait complete. 2023-07-21T22:19:34.462 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:19:34.539 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:34 smithi151 ceph-mon[95510]: pgmap v14: 97 pgs: 97 active+clean; 46 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 5.0 MiB/s wr, 180 op/s 2023-07-21T22:19:34.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:34 smithi187 ceph-mon[96918]: pgmap v14: 97 pgs: 97 active+clean; 46 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 5.0 MiB/s wr, 180 op/s 2023-07-21T22:19:34.629 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3603_vm 2023-07-21T22:19:34.630 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3604 2023-07-21T22:19:34.630 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3605 2023-07-21T22:19:34.630 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3606 2023-07-21T22:19:34.630 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3607 2023-07-21T22:19:34.630 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3608 2023-07-21T22:19:34.630 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 3609 2023-07-21T22:19:34.631 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3712 2023-07-21T22:19:34.631 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764 2023-07-21T22:19:34.631 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3764_fsm 2023-07-21T22:19:34.631 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764_vm 2023-07-21T22:19:34.631 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3766 2023-07-21T22:19:34.631 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3767 2023-07-21T22:19:34.631 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3997 2023-07-21T22:19:34.631 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 5002 2023-07-21T22:19:34.632 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 548 2023-07-21T22:19:34.632 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 549 2023-07-21T22:19:34.632 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102 2023-07-21T22:19:34.632 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102_vm 2023-07-21T22:19:34.632 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104 2023-07-21T22:19:34.632 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104_vm 2023-07-21T22:19:34.632 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106 2023-07-21T22:19:34.633 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106_vm 2023-07-21T22:19:34.633 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6110 2023-07-21T22:19:34.633 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6111 2023-07-21T22:19:34.633 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6112 2023-07-21T22:19:34.633 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6113 2023-07-21T22:19:34.633 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6117 2023-07-21T22:19:34.633 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826 2023-07-21T22:19:34.633 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826_vm 2023-07-21T22:19:34.634 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 827 2023-07-21T22:19:34.634 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 828 2023-07-21T22:19:34.634 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 21 22:19 pg_filenode.map 2023-07-21T22:19:34.634 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 21 22:19 PG_VERSION 2023-07-21T22:19:34.634 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:34.634 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-07-21T22:19:34.634 INFO:teuthology.orchestra.run.smithi151.stdout:total 7210 2023-07-21T22:19:34.634 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 . 2023-07-21T22:19:34.635 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 .. 2023-07-21T22:19:34.635 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 112 2023-07-21T22:19:34.635 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 113 2023-07-21T22:19:34.635 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 21 22:19 12182 2023-07-21T22:19:34.635 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12182_fsm 2023-07-21T22:19:34.635 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12182_vm 2023-07-21T22:19:34.635 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12184 2023-07-21T22:19:34.635 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12186 2023-07-21T22:19:34.636 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187 2023-07-21T22:19:34.636 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12187_fsm 2023-07-21T22:19:34.636 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187_vm 2023-07-21T22:19:34.636 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12189 2023-07-21T22:19:34.636 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12191 2023-07-21T22:19:34.636 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192 2023-07-21T22:19:34.636 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12192_fsm 2023-07-21T22:19:34.636 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192_vm 2023-07-21T22:19:34.637 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12194 2023-07-21T22:19:34.637 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12196 2023-07-21T22:19:34.637 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197 2023-07-21T22:19:34.637 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12197_fsm 2023-07-21T22:19:34.637 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197_vm 2023-07-21T22:19:34.637 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12199 2023-07-21T22:19:34.637 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12201 2023-07-21T22:19:34.637 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202 2023-07-21T22:19:34.638 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12202_fsm 2023-07-21T22:19:34.638 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202_vm 2023-07-21T22:19:34.638 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12204 2023-07-21T22:19:34.638 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12206 2023-07-21T22:19:34.638 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207 2023-07-21T22:19:34.638 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12207_fsm 2023-07-21T22:19:34.638 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207_vm 2023-07-21T22:19:34.638 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12209 2023-07-21T22:19:34.639 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12211 2023-07-21T22:19:34.639 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12212 2023-07-21T22:19:34.639 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12214 2023-07-21T22:19:34.639 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12216 2023-07-21T22:19:34.639 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 21 22:19 1247 2023-07-21T22:19:34.639 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1247_fsm 2023-07-21T22:19:34.639 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1247_vm 2023-07-21T22:19:34.639 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 21 22:19 1249 2023-07-21T22:19:34.640 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1249_fsm 2023-07-21T22:19:34.640 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1249_vm 2023-07-21T22:19:34.640 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 21 22:19 1255 2023-07-21T22:19:34.640 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1255_fsm 2023-07-21T22:19:34.640 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1255_vm 2023-07-21T22:19:34.640 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 21 22:19 1259 2023-07-21T22:19:34.640 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1259_fsm 2023-07-21T22:19:34.641 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1259_vm 2023-07-21T22:19:34.641 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417 2023-07-21T22:19:34.641 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417_vm 2023-07-21T22:19:34.641 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418 2023-07-21T22:19:34.641 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418_vm 2023-07-21T22:19:34.641 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 174 2023-07-21T22:19:34.641 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 175 2023-07-21T22:19:34.641 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2187 2023-07-21T22:19:34.642 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224 2023-07-21T22:19:34.642 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224_vm 2023-07-21T22:19:34.642 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328 2023-07-21T22:19:34.642 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328_vm 2023-07-21T22:19:34.642 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336 2023-07-21T22:19:34.642 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336_vm 2023-07-21T22:19:34.642 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2337 2023-07-21T22:19:34.642 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2600 2023-07-21T22:19:34.643 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2600_fsm 2023-07-21T22:19:34.643 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2600_vm 2023-07-21T22:19:34.643 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601 2023-07-21T22:19:34.643 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2601_fsm 2023-07-21T22:19:34.643 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601_vm 2023-07-21T22:19:34.643 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2602 2023-07-21T22:19:34.643 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2602_fsm 2023-07-21T22:19:34.643 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2602_vm 2023-07-21T22:19:34.644 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2603 2023-07-21T22:19:34.644 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2603_fsm 2023-07-21T22:19:34.644 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2603_vm 2023-07-21T22:19:34.644 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604 2023-07-21T22:19:34.644 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604_vm 2023-07-21T22:19:34.644 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2605 2023-07-21T22:19:34.644 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2605_fsm 2023-07-21T22:19:34.644 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2605_vm 2023-07-21T22:19:34.645 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606 2023-07-21T22:19:34.645 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2606_fsm 2023-07-21T22:19:34.645 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606_vm 2023-07-21T22:19:34.645 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607 2023-07-21T22:19:34.645 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607_fsm 2023-07-21T22:19:34.645 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2607_vm 2023-07-21T22:19:34.645 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 21 22:19 2608 2023-07-21T22:19:34.645 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2608_fsm 2023-07-21T22:19:34.646 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2608_vm 2023-07-21T22:19:34.646 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 21 22:19 2609 2023-07-21T22:19:34.646 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2609_fsm 2023-07-21T22:19:34.646 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2609_vm 2023-07-21T22:19:34.646 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610 2023-07-21T22:19:34.646 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610_fsm 2023-07-21T22:19:34.646 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2610_vm 2023-07-21T22:19:34.646 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611 2023-07-21T22:19:34.647 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611_vm 2023-07-21T22:19:34.647 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612 2023-07-21T22:19:34.647 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2612_fsm 2023-07-21T22:19:34.647 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612_vm 2023-07-21T22:19:34.647 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613 2023-07-21T22:19:34.647 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613_vm 2023-07-21T22:19:34.647 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615 2023-07-21T22:19:34.647 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2615_fsm 2023-07-21T22:19:34.648 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615_vm 2023-07-21T22:19:34.648 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616 2023-07-21T22:19:34.648 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616_fsm 2023-07-21T22:19:34.648 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2616_vm 2023-07-21T22:19:34.648 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 21 22:19 2617 2023-07-21T22:19:34.648 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2617_fsm 2023-07-21T22:19:34.648 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2617_vm 2023-07-21T22:19:34.648 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 21 22:19 2618 2023-07-21T22:19:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2618_fsm 2023-07-21T22:19:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2618_vm 2023-07-21T22:19:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 21 22:19 2619 2023-07-21T22:19:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2619_fsm 2023-07-21T22:19:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2619_vm 2023-07-21T22:19:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620 2023-07-21T22:19:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620_vm 2023-07-21T22:19:34.649 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2650 2023-07-21T22:19:34.650 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2651 2023-07-21T22:19:34.650 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2652 2023-07-21T22:19:34.650 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2653 2023-07-21T22:19:34.650 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2654 2023-07-21T22:19:34.650 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2655 2023-07-21T22:19:34.650 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2656 2023-07-21T22:19:34.650 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2657 2023-07-21T22:19:34.650 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 21 22:19 2658 2023-07-21T22:19:34.651 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2659 2023-07-21T22:19:34.651 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2660 2023-07-21T22:19:34.651 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2661 2023-07-21T22:19:34.651 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2662 2023-07-21T22:19:34.651 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2663 2023-07-21T22:19:34.651 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2664 2023-07-21T22:19:34.652 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2665 2023-07-21T22:19:34.652 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2666 2023-07-21T22:19:34.652 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2667 2023-07-21T22:19:34.652 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2668 2023-07-21T22:19:34.652 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2669 2023-07-21T22:19:34.652 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2670 2023-07-21T22:19:34.652 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Jul 21 22:19 2673 2023-07-21T22:19:34.653 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 21 22:19 2674 2023-07-21T22:19:34.653 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 21 22:19 2675 2023-07-21T22:19:34.653 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2678 2023-07-21T22:19:34.653 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2679 2023-07-21T22:19:34.653 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2680 2023-07-21T22:19:34.653 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2681 2023-07-21T22:19:34.653 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2682 2023-07-21T22:19:34.653 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2683 2023-07-21T22:19:34.654 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2684 2023-07-21T22:19:34.654 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2685 2023-07-21T22:19:34.654 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2686 2023-07-21T22:19:34.654 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2687 2023-07-21T22:19:34.654 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2688 2023-07-21T22:19:34.654 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2689 2023-07-21T22:19:34.654 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2690 2023-07-21T22:19:34.654 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 21 22:19 2691 2023-07-21T22:19:34.655 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2692 2023-07-21T22:19:34.655 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2693 2023-07-21T22:19:34.655 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2696 2023-07-21T22:19:34.655 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2699 2023-07-21T22:19:34.655 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2701 2023-07-21T22:19:34.655 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2702 2023-07-21T22:19:34.655 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2703 2023-07-21T22:19:34.655 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2704 2023-07-21T22:19:34.656 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2753 2023-07-21T22:19:34.656 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2753_fsm 2023-07-21T22:19:34.656 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2753_vm 2023-07-21T22:19:34.656 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2754 2023-07-21T22:19:34.656 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2755 2023-07-21T22:19:34.656 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2756 2023-07-21T22:19:34.656 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2757 2023-07-21T22:19:34.656 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830 2023-07-21T22:19:34.657 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830_vm 2023-07-21T22:19:34.657 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2831 2023-07-21T22:19:34.657 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832 2023-07-21T22:19:34.657 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832_vm 2023-07-21T22:19:34.657 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2833 2023-07-21T22:19:34.657 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834 2023-07-21T22:19:34.657 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834_vm 2023-07-21T22:19:34.657 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2835 2023-07-21T22:19:34.658 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836 2023-07-21T22:19:34.658 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836_vm 2023-07-21T22:19:34.658 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2837 2023-07-21T22:19:34.658 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 21 22:19 2838 2023-07-21T22:19:34.658 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2838_fsm 2023-07-21T22:19:34.658 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2838_vm 2023-07-21T22:19:34.658 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2839 2023-07-21T22:19:34.659 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840 2023-07-21T22:19:34.659 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840_fsm 2023-07-21T22:19:34.659 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2840_vm 2023-07-21T22:19:34.659 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2841 2023-07-21T22:19:34.659 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995 2023-07-21T22:19:34.659 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995_vm 2023-07-21T22:19:34.659 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2996 2023-07-21T22:19:34.659 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079 2023-07-21T22:19:34.659 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3079_fsm 2023-07-21T22:19:34.660 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079_vm 2023-07-21T22:19:34.660 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3080 2023-07-21T22:19:34.660 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3081 2023-07-21T22:19:34.660 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3085 2023-07-21T22:19:34.660 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118 2023-07-21T22:19:34.660 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118_vm 2023-07-21T22:19:34.660 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3119 2023-07-21T22:19:34.661 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3164 2023-07-21T22:19:34.661 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256 2023-07-21T22:19:34.661 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256_vm 2023-07-21T22:19:34.661 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3257 2023-07-21T22:19:34.661 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3258 2023-07-21T22:19:34.661 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350 2023-07-21T22:19:34.661 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350_vm 2023-07-21T22:19:34.661 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3351 2023-07-21T22:19:34.662 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3379 2023-07-21T22:19:34.662 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3380 2023-07-21T22:19:34.662 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381 2023-07-21T22:19:34.662 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381_vm 2023-07-21T22:19:34.662 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3394 2023-07-21T22:19:34.662 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3394_fsm 2023-07-21T22:19:34.662 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3394_vm 2023-07-21T22:19:34.662 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3395 2023-07-21T22:19:34.663 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439 2023-07-21T22:19:34.663 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439_vm 2023-07-21T22:19:34.663 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3440 2023-07-21T22:19:34.663 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 3455 2023-07-21T22:19:34.663 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3456 2023-07-21T22:19:34.663 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3456_fsm 2023-07-21T22:19:34.663 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3456_vm 2023-07-21T22:19:34.663 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466 2023-07-21T22:19:34.664 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466_vm 2023-07-21T22:19:34.664 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3467 2023-07-21T22:19:34.664 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3468 2023-07-21T22:19:34.664 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501 2023-07-21T22:19:34.664 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501_vm 2023-07-21T22:19:34.664 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3502 2023-07-21T22:19:34.664 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3503 2023-07-21T22:19:34.664 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3534 2023-07-21T22:19:34.665 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541 2023-07-21T22:19:34.665 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3541_fsm 2023-07-21T22:19:34.665 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541_vm 2023-07-21T22:19:34.665 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3542 2023-07-21T22:19:34.665 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3574 2023-07-21T22:19:34.665 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3575 2023-07-21T22:19:34.665 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576 2023-07-21T22:19:34.665 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576_vm 2023-07-21T22:19:34.666 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596 2023-07-21T22:19:34.666 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596_vm 2023-07-21T22:19:34.666 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3597 2023-07-21T22:19:34.666 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598 2023-07-21T22:19:34.666 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598_vm 2023-07-21T22:19:34.666 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3599 2023-07-21T22:19:34.666 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600 2023-07-21T22:19:34.666 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3600_fsm 2023-07-21T22:19:34.667 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600_vm 2023-07-21T22:19:34.667 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601 2023-07-21T22:19:34.667 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3601_fsm 2023-07-21T22:19:34.667 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601_vm 2023-07-21T22:19:34.667 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602 2023-07-21T22:19:34.667 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3602_fsm 2023-07-21T22:19:34.667 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602_vm 2023-07-21T22:19:34.667 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3603 2023-07-21T22:19:34.668 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3603_fsm 2023-07-21T22:19:34.668 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3603_vm 2023-07-21T22:19:34.668 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3604 2023-07-21T22:19:34.668 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:34 smithi195 ceph-mon[97365]: pgmap v14: 97 pgs: 97 active+clean; 46 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 608 KiB/s rd, 5.0 MiB/s wr, 180 op/s 2023-07-21T22:19:34.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.647+0000 7f3e59fff700 1 -- 172.21.15.151:0/1011298056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e540ffad0 msgr2=0x7f3e540fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.647+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1011298056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e540ffad0 0x7f3e540fff40 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f3e48009990 tx=0x7f3e48009ca0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.648+0000 7f3e59fff700 1 -- 172.21.15.151:0/1011298056 shutdown_connections 2023-07-21T22:19:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.648+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1011298056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e54105ae0 0x7f3e54105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.648+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1011298056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e54100480 0x7f3e5410c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.648+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1011298056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e540ffad0 0x7f3e540fff40 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.648+0000 7f3e59fff700 1 -- 172.21.15.151:0/1011298056 >> 172.21.15.151:0/1011298056 conn(0x7f3e540fb5f0 msgr2=0x7f3e540fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.648+0000 7f3e59fff700 1 -- 172.21.15.151:0/1011298056 shutdown_connections 2023-07-21T22:19:34.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.648+0000 7f3e59fff700 1 -- 172.21.15.151:0/1011298056 wait complete. 2023-07-21T22:19:34.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.649+0000 7f3e59fff700 1 Processor -- start 2023-07-21T22:19:34.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.649+0000 7f3e59fff700 1 -- start start 2023-07-21T22:19:34.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e59fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540ffad0 0x7f3e54072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e59fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e54100480 0x7f3e54072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e59fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e54105ae0 0x7f3e541a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e59fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e54073580 con 0x7f3e54100480 2023-07-21T22:19:34.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e59fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e541a41e0 con 0x7f3e540ffad0 2023-07-21T22:19:34.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e59fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e541a4320 con 0x7f3e54105ae0 2023-07-21T22:19:34.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e54100480 0x7f3e54072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e537fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540ffad0 0x7f3e54072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e53fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e54105ae0 0x7f3e541a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e54100480 0x7f3e54072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44616/0 (socket says 172.21.15.151:44616) 2023-07-21T22:19:34.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e537fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540ffad0 0x7f3e54072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34866/0 (socket says 172.21.15.151:34866) 2023-07-21T22:19:34.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e53fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e54105ae0 0x7f3e541a3ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42574/0 (socket says 172.21.15.151:42574) 2023-07-21T22:19:34.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e52ffd700 1 -- 172.21.15.151:0/1678993030 learned_addr learned my addr 172.21.15.151:0/1678993030 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e53fff700 1 -- 172.21.15.151:0/1678993030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540ffad0 msgr2=0x7f3e54072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e53fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540ffad0 0x7f3e54072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e53fff700 1 -- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e54100480 msgr2=0x7f3e54072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.650+0000 7f3e53fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e54100480 0x7f3e54072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.651+0000 7f3e53fff700 1 -- 172.21.15.151:0/1678993030 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e480095f0 con 0x7f3e54105ae0 2023-07-21T22:19:34.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.651+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e54100480 0x7f3e54072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:34.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.651+0000 7f3e53fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e54105ae0 0x7f3e541a3ca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00efc0 tx=0x7f3e4c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.651+0000 7f3e50ff9700 1 -- 172.21.15.151:0/1678993030 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c018070 con 0x7f3e54105ae0 2023-07-21T22:19:34.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.651+0000 7f3e59fff700 1 -- 172.21.15.151:0/1678993030 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e541a4520 con 0x7f3e54105ae0 2023-07-21T22:19:34.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.651+0000 7f3e50ff9700 1 -- 172.21.15.151:0/1678993030 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e4c00f040 con 0x7f3e54105ae0 2023-07-21T22:19:34.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.651+0000 7f3e50ff9700 1 -- 172.21.15.151:0/1678993030 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4c00cba0 con 0x7f3e54105ae0 2023-07-21T22:19:34.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.651+0000 7f3e59fff700 1 -- 172.21.15.151:0/1678993030 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e541a4a00 con 0x7f3e54105ae0 2023-07-21T22:19:34.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.656+0000 7f3e50ff9700 1 -- 172.21.15.151:0/1678993030 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f3e4c003a00 con 0x7f3e54105ae0 2023-07-21T22:19:34.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.657+0000 7f3e6d9e0b80 1 Processor -- start 2023-07-21T22:19:34.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.657+0000 7f3e6d9e0b80 1 -- start start 2023-07-21T22:19:34.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.657+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.657+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f82d0 0x55a5744ea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.657+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a5744eada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.657+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5743efcb0 con 0x55a5744f79c0 2023-07-21T22:19:34.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.657+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a574442a40 con 0x55a5744f82d0 2023-07-21T22:19:34.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.657+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a57443bed0 con 0x55a5744ea930 2023-07-21T22:19:34.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44626/0 (socket says 172.21.15.151:44626) 2023-07-21T22:19:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e52ffd700 1 -- 172.21.15.151:0/1007761205 learned_addr learned my addr 172.21.15.151:0/1007761205 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e537fe700 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f82d0 0x55a5744ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e50ff9700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3e3c0a1350 0x7f3e3c0a3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a5744eada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e50ff9700 1 -- 172.21.15.151:0/1678993030 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3e4c0cc910 con 0x7f3e54105ae0 2023-07-21T22:19:34.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e537fe700 1 -- 172.21.15.151:0/1007761205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 msgr2=0x55a5744eada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e537fe700 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a5744eada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e537fe700 1 -- 172.21.15.151:0/1007761205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 msgr2=0x55a5744f7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e537fe700 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744f7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e537fe700 1 -- 172.21.15.151:0/1007761205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a574269de0 con 0x55a5744f82d0 2023-07-21T22:19:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a5744eada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e53fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3e3c0a1350 0x7f3e3c0a3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.658+0000 7f3e537fe700 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f82d0 0x55a5744ea350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009cb0 tx=0x7f3e440058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21f87c557974575c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.659+0000 7f3e39ffb700 1 -- 172.21.15.151:0/1007761205 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44011ce0 con 0x55a5744f82d0 2023-07-21T22:19:34.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.659+0000 7f3e53fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3e3c0a1350 0x7f3e3c0a3800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0ca050 tx=0x7f3e4c009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.659+0000 7f3e39ffb700 1 -- 172.21.15.151:0/1007761205 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e44011e40 con 0x55a5744f82d0 2023-07-21T22:19:34.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.659+0000 7f3e39ffb700 1 -- 172.21.15.151:0/1007761205 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44005280 con 0x55a5744f82d0 2023-07-21T22:19:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.659+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/1007761205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f82d0 msgr2=0x55a5744ea350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.659+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f82d0 0x55a5744ea350 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3e44009cb0 tx=0x7f3e440058e0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.660+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/1007761205 shutdown_connections 2023-07-21T22:19:34.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.660+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a5744eada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.660+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744f7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.660+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/1007761205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f82d0 0x55a5744ea350 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.660+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/1007761205 >> 172.21.15.151:0/1007761205 conn(0x55a5744dfef0 msgr2=0x55a5744e5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.660+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/1007761205 shutdown_connections 2023-07-21T22:19:34.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.660+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/1007761205 wait complete. 2023-07-21T22:19:34.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.660+0000 7f3e6d9e0b80 1 -- start start 2023-07-21T22:19:34.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.661+0000 7f3e6d9e0b80 1 Processor -- start 2023-07-21T22:19:34.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.661+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a5744ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.661+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744fc700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.661+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f82d0 0x55a5744fce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.661+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5743dbac0 con 0x55a5744f79c0 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.661+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5743db7c0 con 0x55a5744ea930 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.661+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5742bf920 con 0x55a5744f82d0 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e6d9e0b80 10 client.0 _ll_register_callbacks cb 0x55a5743d9760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a5744ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e537fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744fc700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a5744ff4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34884/0 (socket says 172.21.15.151:34884) 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 -- 172.21.15.151:0/3196463454 learned_addr learned my addr 172.21.15.151:0/3196463454 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f82d0 0x55a5744fce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 -- 172.21.15.151:0/3196463454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f82d0 msgr2=0x55a5744fce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f82d0 0x55a5744fce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 -- 172.21.15.151:0/3196463454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 msgr2=0x55a5744fc700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744fc700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 -- 172.21.15.151:0/3196463454 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e440098e0 con 0x55a5744ea930 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e537fe700 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a5744ff4f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e48005150 tx=0x7f3e48005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be40b1991997b337 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.662+0000 7f3e32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.663+0000 7f3e32ffd700 1 -- 172.21.15.151:0/3196463454 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4801d040 con 0x55a5744ea930 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.663+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/3196463454 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a5743954f0 con 0x55a5744ea930 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.663+0000 7f3e32ffd700 1 -- 172.21.15.151:0/3196463454 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3e480056c0 con 0x55a5744ea930 2023-07-21T22:19:34.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.663+0000 7f3e32ffd700 1 -- 172.21.15.151:0/3196463454 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e48004710 con 0x55a5744ea930 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.663+0000 7f3e6d9e0b80 10 client.25439 fetch_fsmap learned FSMap version 26 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.663+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/3196463454 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a574252c60 con 0x55a5744ea930 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.663+0000 7f3e32ffd700 1 -- 172.21.15.151:0/3196463454 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a5743954f0 con 0x55a5744ea930 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.663+0000 7f3e32ffd700 1 -- 172.21.15.151:0/3196463454 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f3e4800f890 con 0x55a5744ea930 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.664+0000 7f3e6d9e0b80 10 client.25439 fetch_fsmap finished waiting for FSMap version 26 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.664+0000 7f3e6d9e0b80 10 client.25439 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.664+0000 7f3e6d9e0b80 20 client.25439 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:34.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.664+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a57450cc10 0x55a57450f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.664+0000 7f3e6d9e0b80 4 client.25439 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:34.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.664+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/3196463454 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a574434eb0 con 0x55a57450cc10 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.664+0000 7f3e537fe700 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a57450cc10 0x55a57450f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.665+0000 7f3e32ffd700 10 client.25439 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.665+0000 7f3e537fe700 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a57450cc10 0x55a57450f020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6594b19a7416fe0 server_cookie=a9950c304a54d103 in_seq=0 out_seq=0 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.665+0000 7f3e32ffd700 1 -- 172.21.15.151:0/3196463454 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a574434eb0 con 0x55a57450cc10 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.665+0000 7f3e32ffd700 10 client.25439 handle_command_reply: tid=0 2023-07-21T22:19:34.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.665+0000 7f3e6d9e0b80 1 client.25439 shutdown 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/3196463454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 msgr2=0x55a5744ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a5744ff4f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3e48005150 tx=0x7f3e48005960 comp rx=0 tx=0).stop 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/3196463454 shutdown_connections 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a57450cc10 0x55a57450f020 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a5744ff4f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f82d0 0x55a5744fce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/3196463454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f79c0 0x55a5744fc700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/3196463454 >> 172.21.15.151:0/3196463454 conn(0x55a5744dfef0 msgr2=0x55a5744e5420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e32ffd700 0 client.25439 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:34.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/3196463454 shutdown_connections 2023-07-21T22:19:34.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/3196463454 wait complete. 2023-07-21T22:19:34.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.666+0000 7f3e6d9e0b80 20 client.25439 trim_cache size 0 max 16384 2023-07-21T22:19:34.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.689+0000 7f3e6d9e0b80 1 Processor -- start 2023-07-21T22:19:34.733 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.689+0000 7f3e6d9e0b80 1 -- start start 2023-07-21T22:19:34.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.689+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a574503d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.689+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f79c0 0x55a5744ff020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.689+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 0x55a5744e52d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.689+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5745096e0 con 0x55a5744f82d0 2023-07-21T22:19:34.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.689+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5744f3bf0 con 0x55a5744f79c0 2023-07-21T22:19:34.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.689+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a5744fd420 con 0x55a5744ea930 2023-07-21T22:19:34.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a574503d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a574503d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42606/0 (socket says 172.21.15.151:42606) 2023-07-21T22:19:34.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 -- 172.21.15.151:0/47024494 learned_addr learned my addr 172.21.15.151:0/47024494 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/47024494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 0x55a5744e52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e537fe700 1 --2- 172.21.15.151:0/47024494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f79c0 0x55a5744ff020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 -- 172.21.15.151:0/47024494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f79c0 msgr2=0x55a5744ff020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/47024494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f79c0 0x55a5744ff020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 -- 172.21.15.151:0/47024494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 msgr2=0x55a5744e52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/47024494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 0x55a5744e52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 -- 172.21.15.151:0/47024494 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a574290250 con 0x55a5744ea930 2023-07-21T22:19:34.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.690+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/47024494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a574503d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55a5744e6d50 tx=0x7f3e48005960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e47d31ca1cc551a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e3a7fc700 1 -- 172.21.15.151:0/47024494 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e4801d040 con 0x55a5744ea930 2023-07-21T22:19:34.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e3a7fc700 1 -- 172.21.15.151:0/47024494 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e4800f8f0 con 0x55a5744ea930 2023-07-21T22:19:34.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e3a7fc700 1 -- 172.21.15.151:0/47024494 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e48004a90 con 0x55a5744ea930 2023-07-21T22:19:34.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/47024494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 msgr2=0x55a574503d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/47024494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a574503d90 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55a5744e6d50 tx=0x7f3e48005960 comp rx=0 tx=0).stop 2023-07-21T22:19:34.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/47024494 shutdown_connections 2023-07-21T22:19:34.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/47024494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 0x55a5744e52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/47024494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744ea930 0x55a574503d90 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/47024494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744f79c0 0x55a5744ff020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.691+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/47024494 >> 172.21.15.151:0/47024494 conn(0x55a5744dfef0 msgr2=0x55a5744e8a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.692+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/47024494 shutdown_connections 2023-07-21T22:19:34.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.692+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/47024494 wait complete. 2023-07-21T22:19:34.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.692+0000 7f3e6d9e0b80 1 -- start start 2023-07-21T22:19:34.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.692+0000 7f3e6d9e0b80 1 Processor -- start 2023-07-21T22:19:34.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a574501f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f79c0 0x55a5745024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e6d9e0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 0x55a57455fa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a57455ffd0 con 0x55a5744f82d0 2023-07-21T22:19:34.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a574560110 con 0x55a5744ea930 2023-07-21T22:19:34.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e6d9e0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a574560250 con 0x55a5744f79c0 2023-07-21T22:19:34.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e6d9e0b80 10 client.0 _ll_register_callbacks cb 0x7f3e4800bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:34.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 0x55a57455fa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e537fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f79c0 0x55a5745024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e52ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 0x55a57455fa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44638/0 (socket says 172.21.15.151:44638) 2023-07-21T22:19:34.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e537fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f79c0 0x55a5745024a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42618/0 (socket says 172.21.15.151:42618) 2023-07-21T22:19:34.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e52ffd700 1 -- 172.21.15.151:0/299532121 learned_addr learned my addr 172.21.15.151:0/299532121 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:34.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a574501f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e537fe700 1 -- 172.21.15.151:0/299532121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 msgr2=0x55a574501f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e537fe700 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a574501f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e537fe700 1 -- 172.21.15.151:0/299532121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 msgr2=0x55a57455fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:34.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e537fe700 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 0x55a57455fa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.693+0000 7f3e537fe700 1 -- 172.21.15.151:0/299532121 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a574252c60 con 0x55a5744f79c0 2023-07-21T22:19:34.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.694+0000 7f3e537fe700 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f79c0 0x55a5745024a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e44000c00 tx=0x7f3e44011800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff7d080455427701 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:34.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.694+0000 7f3e32ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:19:34.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.694+0000 7f3e32ffd700 1 -- 172.21.15.151:0/299532121 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e44027c10 con 0x55a5744f79c0 2023-07-21T22:19:34.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.694+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/299532121 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3e44011e40 con 0x55a5744f79c0 2023-07-21T22:19:34.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.694+0000 7f3e32ffd700 1 -- 172.21.15.151:0/299532121 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3e44027d70 con 0x55a5744f79c0 2023-07-21T22:19:34.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.694+0000 7f3e32ffd700 1 -- 172.21.15.151:0/299532121 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3e44004150 con 0x55a5744f79c0 2023-07-21T22:19:34.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.694+0000 7f3e6d9e0b80 10 client.25483 fetch_fsmap learned FSMap version 26 2023-07-21T22:19:34.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.694+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/299532121 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) v3 -- 0x55a5742682b0 con 0x55a5744f79c0 2023-07-21T22:19:34.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.695+0000 7f3e32ffd700 1 -- 172.21.15.151:0/299532121 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3e44011e40 con 0x55a5744f79c0 2023-07-21T22:19:34.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.695+0000 7f3e32ffd700 1 -- 172.21.15.151:0/299532121 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 26) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f3e44003840 con 0x55a5744f79c0 2023-07-21T22:19:34.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.695+0000 7f3e6d9e0b80 10 client.25483 fetch_fsmap finished waiting for FSMap version 26 2023-07-21T22:19:34.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.695+0000 7f3e6d9e0b80 10 client.25483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:34.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.695+0000 7f3e6d9e0b80 20 client.25483 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:34.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.695+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a574561940 0x55a574563d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:34.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.695+0000 7f3e6d9e0b80 4 client.25483 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:19:34.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.695+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/299532121 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a5743f7050 con 0x55a574561940 2023-07-21T22:19:34.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.695+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a574561940 0x55a574563d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:34.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e32ffd700 10 client.25483 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:34.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e52ffd700 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a574561940 0x55a574563d50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14826b6caaad738 server_cookie=29b66b10e7855400 in_seq=0 out_seq=0 2023-07-21T22:19:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e32ffd700 1 -- 172.21.15.151:0/299532121 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a5743f7050 con 0x55a574561940 2023-07-21T22:19:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e32ffd700 10 client.25483 handle_command_reply: tid=0 2023-07-21T22:19:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e6d9e0b80 1 client.25483 shutdown 2023-07-21T22:19:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/299532121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f79c0 msgr2=0x55a5745024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f79c0 0x55a5745024a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e44000c00 tx=0x7f3e44011800 comp rx=0 tx=0).stop 2023-07-21T22:19:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/299532121 shutdown_connections 2023-07-21T22:19:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a574561940 0x55a574563d50 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a5744ea930 0x55a574501f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.696+0000 7f3e32ffd700 0 client.25483 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a5744f82d0 0x55a57455fa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e6d9e0b80 1 --2- 172.21.15.151:0/299532121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a5744f79c0 0x55a5745024a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/299532121 >> 172.21.15.151:0/299532121 conn(0x55a5744dfef0 msgr2=0x55a5744e52b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/299532121 shutdown_connections 2023-07-21T22:19:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e6d9e0b80 1 -- 172.21.15.151:0/299532121 wait complete. 2023-07-21T22:19:34.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e6d9e0b80 20 client.25483 trim_cache size 0 max 16384 2023-07-21T22:19:34.749 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:19:34.749 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:19:34.749 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:19:34.749 INFO:teuthology.orchestra.run.smithi151.stdout: "c6c70218-5138-4107-bdf0-be89cd7b3dbb": { 2023-07-21T22:19:34.749 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:19:34.749 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "c6c70218-5138-4107-bdf0-be89cd7b3dbb", 2023-07-21T22:19:34.750 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:19:34.750 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:19:34.750 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:19:34.750 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:19:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 -- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3e3c0a1350 msgr2=0x7f3e3c0a3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3e3c0a1350 0x7f3e3c0a3800 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0ca050 tx=0x7f3e4c009040 comp rx=0 tx=0).stop 2023-07-21T22:19:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 -- 172.21.15.151:0/1678993030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e54105ae0 msgr2=0x7f3e541a3ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e54105ae0 0x7f3e541a3ca0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c00efc0 tx=0x7f3e4c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 -- 172.21.15.151:0/1678993030 shutdown_connections 2023-07-21T22:19:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3e3c0a1350 0x7f3e3c0a3800 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540ffad0 0x7f3e54072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3e54105ae0 0x7f3e541a3ca0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 --2- 172.21.15.151:0/1678993030 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3e54100480 0x7f3e54072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.697+0000 7f3e59fff700 1 -- 172.21.15.151:0/1678993030 >> 172.21.15.151:0/1678993030 conn(0x7f3e540fb5f0 msgr2=0x7f3e541035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.698+0000 7f3e59fff700 1 -- 172.21.15.151:0/1678993030 shutdown_connections 2023-07-21T22:19:34.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:19:34.698+0000 7f3e59fff700 1 -- 172.21.15.151:0/1678993030 wait complete. 2023-07-21T22:19:34.760 INFO:tasks.cephfs.filesystem:scrub status for tag:c6c70218-5138-4107-bdf0-be89cd7b3dbb - {'path': '/', 'tag': 'c6c70218-5138-4107-bdf0-be89cd7b3dbb', 'options': 'recursive,force'} 2023-07-21T22:19:35.226 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3605 2023-07-21T22:19:35.226 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3606 2023-07-21T22:19:35.226 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3607 2023-07-21T22:19:35.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3608 2023-07-21T22:19:35.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 3609 2023-07-21T22:19:35.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3712 2023-07-21T22:19:35.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764 2023-07-21T22:19:35.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3764_fsm 2023-07-21T22:19:35.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764_vm 2023-07-21T22:19:35.228 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3766 2023-07-21T22:19:35.228 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3767 2023-07-21T22:19:35.228 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3997 2023-07-21T22:19:35.229 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 5002 2023-07-21T22:19:35.229 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 548 2023-07-21T22:19:35.229 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 549 2023-07-21T22:19:35.229 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102 2023-07-21T22:19:35.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102_vm 2023-07-21T22:19:35.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104 2023-07-21T22:19:35.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104_vm 2023-07-21T22:19:35.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106 2023-07-21T22:19:35.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106_vm 2023-07-21T22:19:35.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6110 2023-07-21T22:19:35.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6111 2023-07-21T22:19:35.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6112 2023-07-21T22:19:35.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6113 2023-07-21T22:19:35.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6117 2023-07-21T22:19:35.233 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826 2023-07-21T22:19:35.233 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826_vm 2023-07-21T22:19:35.233 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 827 2023-07-21T22:19:35.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 828 2023-07-21T22:19:35.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 21 22:19 pg_filenode.map 2023-07-21T22:19:35.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 21 22:19 PG_VERSION 2023-07-21T22:19:35.234 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.235 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-07-21T22:19:35.235 INFO:teuthology.orchestra.run.smithi151.stdout:total 7210 2023-07-21T22:19:35.235 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 . 2023-07-21T22:19:35.236 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 22144521 Jul 21 22:19 .. 2023-07-21T22:19:35.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 112 2023-07-21T22:19:35.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 113 2023-07-21T22:19:35.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 21 22:19 12182 2023-07-21T22:19:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12182_fsm 2023-07-21T22:19:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12182_vm 2023-07-21T22:19:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12184 2023-07-21T22:19:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12186 2023-07-21T22:19:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187 2023-07-21T22:19:35.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12187_fsm 2023-07-21T22:19:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187_vm 2023-07-21T22:19:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12189 2023-07-21T22:19:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12191 2023-07-21T22:19:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192 2023-07-21T22:19:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12192_fsm 2023-07-21T22:19:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192_vm 2023-07-21T22:19:35.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12194 2023-07-21T22:19:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12196 2023-07-21T22:19:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197 2023-07-21T22:19:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12197_fsm 2023-07-21T22:19:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197_vm 2023-07-21T22:19:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12199 2023-07-21T22:19:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12201 2023-07-21T22:19:35.239 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202 2023-07-21T22:19:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12202_fsm 2023-07-21T22:19:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202_vm 2023-07-21T22:19:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12204 2023-07-21T22:19:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12206 2023-07-21T22:19:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207 2023-07-21T22:19:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12207_fsm 2023-07-21T22:19:35.240 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207_vm 2023-07-21T22:19:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12209 2023-07-21T22:19:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12211 2023-07-21T22:19:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12212 2023-07-21T22:19:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12214 2023-07-21T22:19:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12216 2023-07-21T22:19:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 21 22:19 1247 2023-07-21T22:19:35.241 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1247_fsm 2023-07-21T22:19:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1247_vm 2023-07-21T22:19:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 21 22:19 1249 2023-07-21T22:19:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1249_fsm 2023-07-21T22:19:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1249_vm 2023-07-21T22:19:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 21 22:19 1255 2023-07-21T22:19:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1255_fsm 2023-07-21T22:19:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1255_vm 2023-07-21T22:19:35.242 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 21 22:19 1259 2023-07-21T22:19:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1259_fsm 2023-07-21T22:19:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1259_vm 2023-07-21T22:19:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417 2023-07-21T22:19:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417_vm 2023-07-21T22:19:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418 2023-07-21T22:19:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418_vm 2023-07-21T22:19:35.243 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 174 2023-07-21T22:19:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 175 2023-07-21T22:19:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2187 2023-07-21T22:19:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224 2023-07-21T22:19:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224_vm 2023-07-21T22:19:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328 2023-07-21T22:19:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328_vm 2023-07-21T22:19:35.244 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336 2023-07-21T22:19:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336_vm 2023-07-21T22:19:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2337 2023-07-21T22:19:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2600 2023-07-21T22:19:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2600_fsm 2023-07-21T22:19:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2600_vm 2023-07-21T22:19:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601 2023-07-21T22:19:35.245 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2601_fsm 2023-07-21T22:19:35.246 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601_vm 2023-07-21T22:19:35.246 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2602 2023-07-21T22:19:35.246 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2602_fsm 2023-07-21T22:19:35.246 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2602_vm 2023-07-21T22:19:35.246 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2603 2023-07-21T22:19:35.246 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2603_fsm 2023-07-21T22:19:35.247 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2603_vm 2023-07-21T22:19:35.247 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604 2023-07-21T22:19:35.247 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604_vm 2023-07-21T22:19:35.247 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2605 2023-07-21T22:19:35.248 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2605_fsm 2023-07-21T22:19:35.248 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2605_vm 2023-07-21T22:19:35.248 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606 2023-07-21T22:19:35.248 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2606_fsm 2023-07-21T22:19:35.248 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606_vm 2023-07-21T22:19:35.248 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607 2023-07-21T22:19:35.249 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607_fsm 2023-07-21T22:19:35.249 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2607_vm 2023-07-21T22:19:35.249 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 21 22:19 2608 2023-07-21T22:19:35.249 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2608_fsm 2023-07-21T22:19:35.249 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2608_vm 2023-07-21T22:19:35.249 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 21 22:19 2609 2023-07-21T22:19:35.249 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2609_fsm 2023-07-21T22:19:35.250 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2609_vm 2023-07-21T22:19:35.250 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610 2023-07-21T22:19:35.250 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610_fsm 2023-07-21T22:19:35.250 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2610_vm 2023-07-21T22:19:35.250 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611 2023-07-21T22:19:35.250 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611_vm 2023-07-21T22:19:35.250 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612 2023-07-21T22:19:35.251 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2612_fsm 2023-07-21T22:19:35.251 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612_vm 2023-07-21T22:19:35.251 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613 2023-07-21T22:19:35.251 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613_vm 2023-07-21T22:19:35.251 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615 2023-07-21T22:19:35.251 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2615_fsm 2023-07-21T22:19:35.252 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615_vm 2023-07-21T22:19:35.252 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616 2023-07-21T22:19:35.252 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616_fsm 2023-07-21T22:19:35.252 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2616_vm 2023-07-21T22:19:35.252 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 21 22:19 2617 2023-07-21T22:19:35.252 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2617_fsm 2023-07-21T22:19:35.253 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2617_vm 2023-07-21T22:19:35.253 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 21 22:19 2618 2023-07-21T22:19:35.253 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2618_fsm 2023-07-21T22:19:35.253 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2618_vm 2023-07-21T22:19:35.253 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 21 22:19 2619 2023-07-21T22:19:35.253 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2619_fsm 2023-07-21T22:19:35.254 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2619_vm 2023-07-21T22:19:35.254 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620 2023-07-21T22:19:35.254 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620_vm 2023-07-21T22:19:35.254 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2650 2023-07-21T22:19:35.254 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2651 2023-07-21T22:19:35.254 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2652 2023-07-21T22:19:35.254 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2653 2023-07-21T22:19:35.255 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2654 2023-07-21T22:19:35.255 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2655 2023-07-21T22:19:35.255 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2656 2023-07-21T22:19:35.255 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2657 2023-07-21T22:19:35.255 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 21 22:19 2658 2023-07-21T22:19:35.255 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2659 2023-07-21T22:19:35.255 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2660 2023-07-21T22:19:35.256 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2661 2023-07-21T22:19:35.256 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2662 2023-07-21T22:19:35.256 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2663 2023-07-21T22:19:35.256 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2664 2023-07-21T22:19:35.256 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2665 2023-07-21T22:19:35.257 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2666 2023-07-21T22:19:35.257 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2667 2023-07-21T22:19:35.257 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2668 2023-07-21T22:19:35.257 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2669 2023-07-21T22:19:35.257 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2670 2023-07-21T22:19:35.258 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Jul 21 22:19 2673 2023-07-21T22:19:35.258 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 21 22:19 2674 2023-07-21T22:19:35.258 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 21 22:19 2675 2023-07-21T22:19:35.258 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2678 2023-07-21T22:19:35.258 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2679 2023-07-21T22:19:35.258 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2680 2023-07-21T22:19:35.258 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2681 2023-07-21T22:19:35.259 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2682 2023-07-21T22:19:35.259 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2683 2023-07-21T22:19:35.259 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2684 2023-07-21T22:19:35.259 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2685 2023-07-21T22:19:35.259 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2686 2023-07-21T22:19:35.259 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2687 2023-07-21T22:19:35.259 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2688 2023-07-21T22:19:35.260 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2689 2023-07-21T22:19:35.260 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2690 2023-07-21T22:19:35.260 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 21 22:19 2691 2023-07-21T22:19:35.260 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2692 2023-07-21T22:19:35.260 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2693 2023-07-21T22:19:35.260 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2696 2023-07-21T22:19:35.260 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2699 2023-07-21T22:19:35.261 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2701 2023-07-21T22:19:35.261 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2702 2023-07-21T22:19:35.261 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2703 2023-07-21T22:19:35.261 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2704 2023-07-21T22:19:35.261 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2753 2023-07-21T22:19:35.261 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2753_fsm 2023-07-21T22:19:35.261 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2753_vm 2023-07-21T22:19:35.262 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2754 2023-07-21T22:19:35.262 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2755 2023-07-21T22:19:35.262 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2756 2023-07-21T22:19:35.262 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2757 2023-07-21T22:19:35.262 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830 2023-07-21T22:19:35.262 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830_vm 2023-07-21T22:19:35.262 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2831 2023-07-21T22:19:35.263 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832 2023-07-21T22:19:35.263 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832_vm 2023-07-21T22:19:35.263 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2833 2023-07-21T22:19:35.263 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834 2023-07-21T22:19:35.263 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834_vm 2023-07-21T22:19:35.263 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2835 2023-07-21T22:19:35.263 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836 2023-07-21T22:19:35.263 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836_vm 2023-07-21T22:19:35.264 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2837 2023-07-21T22:19:35.264 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 21 22:19 2838 2023-07-21T22:19:35.264 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2838_fsm 2023-07-21T22:19:35.264 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2838_vm 2023-07-21T22:19:35.264 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2839 2023-07-21T22:19:35.264 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840 2023-07-21T22:19:35.264 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840_fsm 2023-07-21T22:19:35.265 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2840_vm 2023-07-21T22:19:35.265 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2841 2023-07-21T22:19:35.265 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995 2023-07-21T22:19:35.265 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995_vm 2023-07-21T22:19:35.265 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2996 2023-07-21T22:19:35.265 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079 2023-07-21T22:19:35.265 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3079_fsm 2023-07-21T22:19:35.266 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079_vm 2023-07-21T22:19:35.266 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3080 2023-07-21T22:19:35.266 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3081 2023-07-21T22:19:35.266 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3085 2023-07-21T22:19:35.266 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118 2023-07-21T22:19:35.266 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118_vm 2023-07-21T22:19:35.266 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3119 2023-07-21T22:19:35.267 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3164 2023-07-21T22:19:35.267 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256 2023-07-21T22:19:35.267 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256_vm 2023-07-21T22:19:35.267 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3257 2023-07-21T22:19:35.267 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3258 2023-07-21T22:19:35.267 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350 2023-07-21T22:19:35.268 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350_vm 2023-07-21T22:19:35.268 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3351 2023-07-21T22:19:35.268 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3379 2023-07-21T22:19:35.268 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3380 2023-07-21T22:19:35.268 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381 2023-07-21T22:19:35.268 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381_vm 2023-07-21T22:19:35.268 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3394 2023-07-21T22:19:35.269 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3394_fsm 2023-07-21T22:19:35.269 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3394_vm 2023-07-21T22:19:35.269 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3395 2023-07-21T22:19:35.269 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439 2023-07-21T22:19:35.269 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439_vm 2023-07-21T22:19:35.269 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3440 2023-07-21T22:19:35.269 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 3455 2023-07-21T22:19:35.270 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3456 2023-07-21T22:19:35.270 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3456_fsm 2023-07-21T22:19:35.270 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3456_vm 2023-07-21T22:19:35.270 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466 2023-07-21T22:19:35.270 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466_vm 2023-07-21T22:19:35.270 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3467 2023-07-21T22:19:35.270 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3468 2023-07-21T22:19:35.271 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501 2023-07-21T22:19:35.271 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501_vm 2023-07-21T22:19:35.271 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3502 2023-07-21T22:19:35.271 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3503 2023-07-21T22:19:35.271 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3534 2023-07-21T22:19:35.271 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541 2023-07-21T22:19:35.271 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3541_fsm 2023-07-21T22:19:35.271 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541_vm 2023-07-21T22:19:35.272 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3542 2023-07-21T22:19:35.272 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3574 2023-07-21T22:19:35.272 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3575 2023-07-21T22:19:35.272 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576 2023-07-21T22:19:35.272 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576_vm 2023-07-21T22:19:35.272 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596 2023-07-21T22:19:35.272 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596_vm 2023-07-21T22:19:35.273 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3597 2023-07-21T22:19:35.273 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598 2023-07-21T22:19:35.273 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598_vm 2023-07-21T22:19:35.273 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3599 2023-07-21T22:19:35.273 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600 2023-07-21T22:19:35.273 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3600_fsm 2023-07-21T22:19:35.273 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600_vm 2023-07-21T22:19:35.274 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601 2023-07-21T22:19:35.274 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3601_fsm 2023-07-21T22:19:35.274 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601_vm 2023-07-21T22:19:35.274 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602 2023-07-21T22:19:35.274 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3602_fsm 2023-07-21T22:19:35.274 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602_vm 2023-07-21T22:19:35.274 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3603 2023-07-21T22:19:35.275 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3603_fsm 2023-07-21T22:19:35.275 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3603_vm 2023-07-21T22:19:35.275 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3604 2023-07-21T22:19:35.318 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3605 2023-07-21T22:19:35.318 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3606 2023-07-21T22:19:35.318 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3607 2023-07-21T22:19:35.318 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3608 2023-07-21T22:19:35.318 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 3609 2023-07-21T22:19:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3712 2023-07-21T22:19:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764 2023-07-21T22:19:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3764_fsm 2023-07-21T22:19:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764_vm 2023-07-21T22:19:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3766 2023-07-21T22:19:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3767 2023-07-21T22:19:35.319 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3997 2023-07-21T22:19:35.320 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 5002 2023-07-21T22:19:35.320 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 548 2023-07-21T22:19:35.320 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 549 2023-07-21T22:19:35.320 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102 2023-07-21T22:19:35.320 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102_vm 2023-07-21T22:19:35.320 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104 2023-07-21T22:19:35.321 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104_vm 2023-07-21T22:19:35.321 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106 2023-07-21T22:19:35.321 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106_vm 2023-07-21T22:19:35.321 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6110 2023-07-21T22:19:35.321 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6111 2023-07-21T22:19:35.321 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6112 2023-07-21T22:19:35.321 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6113 2023-07-21T22:19:35.322 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6117 2023-07-21T22:19:35.322 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826 2023-07-21T22:19:35.322 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826_vm 2023-07-21T22:19:35.322 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 827 2023-07-21T22:19:35.322 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 828 2023-07-21T22:19:35.322 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 21 22:19 pg_filenode.map 2023-07-21T22:19:35.322 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 21 22:19 PG_VERSION 2023-07-21T22:19:35.322 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.323 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/global: 2023-07-21T22:19:35.323 INFO:teuthology.orchestra.run.smithi151.stdout:total 554 2023-07-21T22:19:35.323 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 565760 Jul 21 22:19 . 2023-07-21T22:19:35.323 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.323 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1136 2023-07-21T22:19:35.323 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1136_fsm 2023-07-21T22:19:35.323 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1136_vm 2023-07-21T22:19:35.324 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 1137 2023-07-21T22:19:35.324 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1213 2023-07-21T22:19:35.324 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1213_fsm 2023-07-21T22:19:35.324 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1213_vm 2023-07-21T22:19:35.324 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1214 2023-07-21T22:19:35.324 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1214_fsm 2023-07-21T22:19:35.324 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1214_vm 2023-07-21T22:19:35.325 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 1232 2023-07-21T22:19:35.325 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 1233 2023-07-21T22:19:35.325 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1260 2023-07-21T22:19:35.325 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1260_fsm 2023-07-21T22:19:35.325 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1260_vm 2023-07-21T22:19:35.325 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1261 2023-07-21T22:19:35.325 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1261_fsm 2023-07-21T22:19:35.326 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1261_vm 2023-07-21T22:19:35.326 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1262 2023-07-21T22:19:35.326 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1262_fsm 2023-07-21T22:19:35.326 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1262_vm 2023-07-21T22:19:35.326 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2396 2023-07-21T22:19:35.326 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2396_fsm 2023-07-21T22:19:35.327 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2396_vm 2023-07-21T22:19:35.327 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2397 2023-07-21T22:19:35.327 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2671 2023-07-21T22:19:35.327 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2672 2023-07-21T22:19:35.327 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2676 2023-07-21T22:19:35.327 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2677 2023-07-21T22:19:35.327 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2694 2023-07-21T22:19:35.328 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2695 2023-07-21T22:19:35.328 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2697 2023-07-21T22:19:35.328 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2698 2023-07-21T22:19:35.328 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2846 2023-07-21T22:19:35.328 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2846_vm 2023-07-21T22:19:35.328 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2847 2023-07-21T22:19:35.328 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2964 2023-07-21T22:19:35.329 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2964_vm 2023-07-21T22:19:35.329 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2965 2023-07-21T22:19:35.329 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2966 2023-07-21T22:19:35.329 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2966_vm 2023-07-21T22:19:35.329 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2967 2023-07-21T22:19:35.329 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3592 2023-07-21T22:19:35.329 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3592_vm 2023-07-21T22:19:35.330 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3593 2023-07-21T22:19:35.330 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 4060 2023-07-21T22:19:35.330 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 4060_vm 2023-07-21T22:19:35.330 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 4061 2023-07-21T22:19:35.330 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6000 2023-07-21T22:19:35.393 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6000_vm 2023-07-21T22:19:35.393 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6001 2023-07-21T22:19:35.393 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6002 2023-07-21T22:19:35.393 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6100 2023-07-21T22:19:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6100_vm 2023-07-21T22:19:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6114 2023-07-21T22:19:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6115 2023-07-21T22:19:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 pg_control 2023-07-21T22:19:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 21 22:19 pg_filenode.map 2023-07-21T22:19:35.394 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.394 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/log: 2023-07-21T22:19:35.395 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.395 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.395 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.395 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.395 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-07-21T22:19:35.395 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.395 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.395 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.396 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.396 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-07-21T22:19:35.396 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.396 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.396 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.396 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.396 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-07-21T22:19:35.397 INFO:teuthology.orchestra.run.smithi151.stdout:total 3 2023-07-21T22:19:35.397 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 22:19 . 2023-07-21T22:19:35.397 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.398 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 mappings 2023-07-21T22:19:35.398 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 22:19 replorigin_checkpoint 2023-07-21T22:19:35.398 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 snapshots 2023-07-21T22:19:35.399 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.399 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-07-21T22:19:35.399 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.399 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.400 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 22:19 .. 2023-07-21T22:19:35.400 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.400 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-07-21T22:19:35.401 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.401 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.401 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 22:19 .. 2023-07-21T22:19:35.401 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.401 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-07-21T22:19:35.402 INFO:teuthology.orchestra.run.smithi151.stdout:total 2 2023-07-21T22:19:35.402 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 . 2023-07-21T22:19:35.402 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.402 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 members 2023-07-21T22:19:35.403 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 offsets 2023-07-21T22:19:35.403 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.403 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-07-21T22:19:35.403 INFO:teuthology.orchestra.run.smithi151.stdout:total 9 2023-07-21T22:19:35.404 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 . 2023-07-21T22:19:35.404 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 .. 2023-07-21T22:19:35.404 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 0000 2023-07-21T22:19:35.404 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.405 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-07-21T22:19:35.405 INFO:teuthology.orchestra.run.smithi151.stdout:total 9 2023-07-21T22:19:35.405 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 . 2023-07-21T22:19:35.405 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 .. 2023-07-21T22:19:35.406 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 0000 2023-07-21T22:19:35.406 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.406 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-07-21T22:19:35.407 INFO:teuthology.orchestra.run.smithi151.stdout:total 9 2023-07-21T22:19:35.407 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 . 2023-07-21T22:19:35.407 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.407 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 0000 2023-07-21T22:19:35.408 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.408 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-07-21T22:19:35.408 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.450 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.450 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.450 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.451 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-07-21T22:19:35.451 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.451 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.451 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.451 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.451 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-07-21T22:19:35.451 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.452 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.452 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.452 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.452 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-07-21T22:19:35.452 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.452 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.452 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.453 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.453 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-07-21T22:19:35.453 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.453 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.453 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.454 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.454 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-07-21T22:19:35.454 INFO:teuthology.orchestra.run.smithi151.stdout:total 9 2023-07-21T22:19:35.454 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 . 2023-07-21T22:19:35.454 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.454 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 0000 2023-07-21T22:19:35.454 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.454 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-07-21T22:19:35.455 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.455 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.455 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.455 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.455 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-07-21T22:19:35.455 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.455 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.456 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.456 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.456 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-07-21T22:19:35.456 INFO:teuthology.orchestra.run.smithi151.stdout:total 16386 2023-07-21T22:19:35.456 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 22:19 . 2023-07-21T22:19:35.456 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.456 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 22:19 000000010000000000000001 2023-07-21T22:19:35.457 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 archive_status 2023-07-21T22:19:35.457 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.457 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-07-21T22:19:35.457 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T22:19:35.457 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T22:19:35.457 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 22:19 .. 2023-07-21T22:19:35.457 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:19:35.457 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-07-21T22:19:35.458 INFO:teuthology.orchestra.run.smithi151.stdout:total 9 2023-07-21T22:19:35.458 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 . 2023-07-21T22:19:35.458 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 39557450 Jul 21 22:19 .. 2023-07-21T22:19:35.458 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 0000 2023-07-21T22:19:35.459 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2023-07-21T22:19:35.545 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:35 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:35.546 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:35 smithi151 ceph-mon[95510]: scrub queued for path: / 2023-07-21T22:19:35.546 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:35 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:35.546 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:35 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:19:35.546 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:35 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:19:35.546 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:35 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:35.547 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:35 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:35.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:35 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:35.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:35 smithi187 ceph-mon[96918]: scrub queued for path: / 2023-07-21T22:19:35.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:35 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:35.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:35 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:19:35.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:35 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:19:35.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:35 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:35.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:35 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:35.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:35 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:35.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:35 smithi195 ceph-mon[97365]: scrub queued for path: / 2023-07-21T22:19:35.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:35 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:35.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:35 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:19:35.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:35 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:19:35.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:35 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:35.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:35 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:19:35.840 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 500 -i' 2023-07-21T22:19:36.037 INFO:teuthology.orchestra.run.smithi151.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2023-07-21T22:19:36.116 INFO:teuthology.orchestra.run.smithi151.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2023-07-21T22:19:36.126 INFO:teuthology.orchestra.run.smithi151.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2023-07-21T22:19:36.145 INFO:teuthology.orchestra.run.smithi151.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2023-07-21T22:19:36.493 INFO:teuthology.orchestra.run.smithi151.stderr:creating tables... 2023-07-21T22:19:36.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:36 smithi187 ceph-mon[96918]: pgmap v15: 97 pgs: 97 active+clean; 46 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 3.2 MiB/s wr, 153 op/s 2023-07-21T22:19:36.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:36 smithi195 ceph-mon[97365]: pgmap v15: 97 pgs: 97 active+clean; 46 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 3.2 MiB/s wr, 153 op/s 2023-07-21T22:19:36.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:36 smithi151 ceph-mon[95510]: pgmap v15: 97 pgs: 97 active+clean; 46 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 560 KiB/s rd, 3.2 MiB/s wr, 153 op/s 2023-07-21T22:19:37.307 INFO:teuthology.orchestra.run.smithi151.stderr:100000 of 50000000 tuples (0%) done (elapsed 0.80 s, remaining 399.21 s) 2023-07-21T22:19:38.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:38 smithi187 ceph-mon[96918]: pgmap v16: 97 pgs: 97 active+clean; 46 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 3.4 MiB/s wr, 157 op/s 2023-07-21T22:19:38.656 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:38 smithi195 ceph-mon[97365]: pgmap v16: 97 pgs: 97 active+clean; 46 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 3.4 MiB/s wr, 157 op/s 2023-07-21T22:19:38.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:38 smithi151 ceph-mon[95510]: pgmap v16: 97 pgs: 97 active+clean; 46 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 3.4 MiB/s wr, 157 op/s 2023-07-21T22:19:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:200000 of 50000000 tuples (0%) done (elapsed 2.55 s, remaining 635.62 s) 2023-07-21T22:19:40.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.158+0000 7f3bf219d700 1 -- 172.21.15.151:0/3711684351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 msgr2=0x7f3bec10c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.158+0000 7f3bf219d700 1 --2- 172.21.15.151:0/3711684351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 0x7f3bec10c740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f3be400b0a0 tx=0x7f3be400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.159+0000 7f3bf219d700 1 -- 172.21.15.151:0/3711684351 shutdown_connections 2023-07-21T22:19:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.159+0000 7f3bf219d700 1 --2- 172.21.15.151:0/3711684351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 0x7f3bec10c740 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.159+0000 7f3bf219d700 1 --2- 172.21.15.151:0/3711684351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec105910 0x7f3bec105ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.159+0000 7f3bf219d700 1 --2- 172.21.15.151:0/3711684351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec0ff900 0x7f3bec0ffd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.159+0000 7f3bf219d700 1 -- 172.21.15.151:0/3711684351 >> 172.21.15.151:0/3711684351 conn(0x7f3bec0fb440 msgr2=0x7f3bec0fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.159+0000 7f3bf219d700 1 -- 172.21.15.151:0/3711684351 shutdown_connections 2023-07-21T22:19:40.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.159+0000 7f3bf219d700 1 -- 172.21.15.151:0/3711684351 wait complete. 2023-07-21T22:19:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.160+0000 7f3bf219d700 1 Processor -- start 2023-07-21T22:19:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.160+0000 7f3bf219d700 1 -- start start 2023-07-21T22:19:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.161+0000 7f3bf219d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec0ff900 0x7f3bec195d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.161+0000 7f3bf219d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 0x7f3bec196260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.161+0000 7f3bf219d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec105910 0x7f3bec19a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.161+0000 7f3bf219d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec19ad00 con 0x7f3bec1002b0 2023-07-21T22:19:40.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.161+0000 7f3bf219d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec19ae70 con 0x7f3bec105910 2023-07-21T22:19:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.161+0000 7f3bf219d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec19b030 con 0x7f3bec0ff900 2023-07-21T22:19:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.161+0000 7f3bf099a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 0x7f3bec196260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.161+0000 7f3bf099a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 0x7f3bec196260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45032/0 (socket says 172.21.15.151:45032) 2023-07-21T22:19:40.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.161+0000 7f3bf099a700 1 -- 172.21.15.151:0/741189579 learned_addr learned my addr 172.21.15.151:0/741189579 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf119b700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec0ff900 0x7f3bec195d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf199c700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec105910 0x7f3bec19a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf099a700 1 -- 172.21.15.151:0/741189579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec0ff900 msgr2=0x7f3bec195d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf099a700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec0ff900 0x7f3bec195d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf099a700 1 -- 172.21.15.151:0/741189579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec105910 msgr2=0x7f3bec19a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf099a700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec105910 0x7f3bec19a6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf099a700 1 -- 172.21.15.151:0/741189579 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4009d00 con 0x7f3bec1002b0 2023-07-21T22:19:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf199c700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec105910 0x7f3bec19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf099a700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 0x7f3bec196260 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00d980 tx=0x7f3bdc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3be27fc700 1 -- 172.21.15.151:0/741189579 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc004220 con 0x7f3bec1002b0 2023-07-21T22:19:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3bf219d700 1 -- 172.21.15.151:0/741189579 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec19b310 con 0x7f3bec1002b0 2023-07-21T22:19:40.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.162+0000 7f3be27fc700 1 -- 172.21.15.151:0/741189579 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bdc007640 con 0x7f3bec1002b0 2023-07-21T22:19:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.163+0000 7f3be27fc700 1 -- 172.21.15.151:0/741189579 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0055e0 con 0x7f3bec1002b0 2023-07-21T22:19:40.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.163+0000 7f3bf219d700 1 -- 172.21.15.151:0/741189579 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec1a2b50 con 0x7f3bec1002b0 2023-07-21T22:19:40.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.166+0000 7f3be27fc700 1 -- 172.21.15.151:0/741189579 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f3bdc004750 con 0x7f3bec1002b0 2023-07-21T22:19:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.168+0000 7f3c06cccb80 1 Processor -- start 2023-07-21T22:19:40.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3be27fc700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3bd80a1470 0x7f3bd80a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3c06cccb80 1 -- start start 2023-07-21T22:19:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3be27fc700 1 -- 172.21.15.151:0/741189579 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3bdc0cccf0 con 0x7f3bec1002b0 2023-07-21T22:19:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3bf199c700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3bd80a1470 0x7f3bd80a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a31f0c6b0 0x562a320ad080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320ad5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 0x562a320c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a31fb5c50 con 0x562a320b0ff0 2023-07-21T22:19:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a320089e0 con 0x562a31f0c6b0 2023-07-21T22:19:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.169+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a32001e70 con 0x562a320adb00 2023-07-21T22:19:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf099a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320ad5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf099a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320ad5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45038/0 (socket says 172.21.15.151:45038) 2023-07-21T22:19:40.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf099a700 1 -- 172.21.15.151:0/538368781 learned_addr learned my addr 172.21.15.151:0/538368781 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:40.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf119b700 1 --2- 172.21.15.151:0/538368781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a31f0c6b0 0x562a320ad080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf199c700 1 --2- 172.21.15.151:0/538368781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 0x562a320c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf099a700 1 -- 172.21.15.151:0/538368781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 msgr2=0x562a320c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf099a700 1 --2- 172.21.15.151:0/538368781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 0x562a320c4d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf099a700 1 -- 172.21.15.151:0/538368781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a31f0c6b0 msgr2=0x562a320ad080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf099a700 1 --2- 172.21.15.151:0/538368781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a31f0c6b0 0x562a320ad080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf199c700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3bd80a1470 0x7f3bd80a3920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3be40062a0 tx=0x7f3be4006210 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf099a700 1 -- 172.21.15.151:0/538368781 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a31e2fd80 con 0x562a320b0ff0 2023-07-21T22:19:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.170+0000 7f3bf099a700 1 --2- 172.21.15.151:0/538368781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320ad5c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0966d0 tx=0x7f3bdc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0ab5a5540c836c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.171+0000 7f3bd77fe700 1 -- 172.21.15.151:0/538368781 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc099c60 con 0x562a320b0ff0 2023-07-21T22:19:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.171+0000 7f3bd77fe700 1 -- 172.21.15.151:0/538368781 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bdc09dc90 con 0x562a320b0ff0 2023-07-21T22:19:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.171+0000 7f3bd77fe700 1 -- 172.21.15.151:0/538368781 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc09a0c0 con 0x562a320b0ff0 2023-07-21T22:19:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.172+0000 7f3c06cccb80 1 -- 172.21.15.151:0/538368781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 msgr2=0x562a320ad5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.172+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/538368781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320ad5c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0966d0 tx=0x7f3bdc005740 comp rx=0 tx=0).stop 2023-07-21T22:19:40.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.172+0000 7f3c06cccb80 1 -- 172.21.15.151:0/538368781 shutdown_connections 2023-07-21T22:19:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.172+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/538368781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a31f0c6b0 0x562a320ad080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.172+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/538368781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 0x562a320c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.172+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/538368781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320ad5c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.172+0000 7f3c06cccb80 1 -- 172.21.15.151:0/538368781 >> 172.21.15.151:0/538368781 conn(0x562a320a5c40 msgr2=0x562a320ab300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.172+0000 7f3c06cccb80 1 -- 172.21.15.151:0/538368781 shutdown_connections 2023-07-21T22:19:40.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.172+0000 7f3c06cccb80 1 -- 172.21.15.151:0/538368781 wait complete. 2023-07-21T22:19:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.173+0000 7f3c06cccb80 1 -- start start 2023-07-21T22:19:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.173+0000 7f3c06cccb80 1 Processor -- start 2023-07-21T22:19:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 0x562a320c1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a31fa1a60 con 0x562a320b0ff0 2023-07-21T22:19:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a31fa1760 con 0x562a320adb00 2023-07-21T22:19:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a31e858c0 con 0x562a31f0c6b0 2023-07-21T22:19:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3c06cccb80 10 client.0 _ll_register_callbacks cb 0x562a31f9f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3bf119b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3bf119b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48168/0 (socket says 172.21.15.151:48168) 2023-07-21T22:19:40.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3bf119b700 1 -- 172.21.15.151:0/1489538369 learned_addr learned my addr 172.21.15.151:0/1489538369 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3bf099a700 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 0x562a320c1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.174+0000 7f3bf199c700 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bf099a700 1 -- 172.21.15.151:0/1489538369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 msgr2=0x562a320c4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bf099a700 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bf099a700 1 -- 172.21.15.151:0/1489538369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 msgr2=0x562a320c2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bf099a700 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320c2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bf099a700 1 -- 172.21.15.151:0/1489538369 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec1a2b50 con 0x562a320adb00 2023-07-21T22:19:40.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bf119b700 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:40.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bf099a700 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 0x562a320c1f10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x562a320adfb0 tx=0x7f3bdc0b2440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc3c6b9bf48b5114 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bd4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:19:40.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/1489538369 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc0a20b0 con 0x562a320adb00 2023-07-21T22:19:40.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3c06cccb80 1 -- 172.21.15.151:0/1489538369 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562a31f5b490 con 0x562a320adb00 2023-07-21T22:19:40.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/1489538369 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3bdc098000 con 0x562a320adb00 2023-07-21T22:19:40.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/1489538369 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bdc099360 con 0x562a320adb00 2023-07-21T22:19:40.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.175+0000 7f3c06cccb80 10 client.25457 fetch_fsmap learned FSMap version 27 2023-07-21T22:19:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.176+0000 7f3c06cccb80 1 -- 172.21.15.151:0/1489538369 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562a31e18c00 con 0x562a320adb00 2023-07-21T22:19:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.176+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/1489538369 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562a31f5b490 con 0x562a320adb00 2023-07-21T22:19:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.177+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/1489538369 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3bdc0a1c90 con 0x562a320adb00 2023-07-21T22:19:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.177+0000 7f3c06cccb80 10 client.25457 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:19:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.177+0000 7f3c06cccb80 10 client.25457 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.177+0000 7f3c06cccb80 20 client.25457 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.177+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562a320d2030 0x562a320d4410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.177+0000 7f3c06cccb80 4 client.25457 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:40.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.177+0000 7f3c06cccb80 1 -- 172.21.15.151:0/1489538369 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562a31ffae50 con 0x562a320d2030 2023-07-21T22:19:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.177+0000 7f3bf119b700 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562a320d2030 0x562a320d4410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.178+0000 7f3bf119b700 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562a320d2030 0x562a320d4410 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad71c835dc5a40b6 server_cookie=e69eafdadddf635a in_seq=0 out_seq=0 2023-07-21T22:19:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.178+0000 7f3bd4ff9700 10 client.25457 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/1489538369 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562a31ffae50 con 0x562a320d2030 2023-07-21T22:19:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3bd4ff9700 10 client.25457 handle_command_reply: tid=0 2023-07-21T22:19:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 client.25457 shutdown 2023-07-21T22:19:40.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 -- 172.21.15.151:0/1489538369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 msgr2=0x562a320c1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 0x562a320c1f10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x562a320adfb0 tx=0x7f3bdc0b2440 comp rx=0 tx=0).stop 2023-07-21T22:19:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 -- 172.21.15.151:0/1489538369 shutdown_connections 2023-07-21T22:19:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562a320d2030 0x562a320d4410 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320c2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3bd4ff9700 0 client.25457 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:40.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/1489538369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 0x562a320c1f10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 -- 172.21.15.151:0/1489538369 >> 172.21.15.151:0/1489538369 conn(0x562a320a5c40 msgr2=0x562a320a9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 -- 172.21.15.151:0/1489538369 shutdown_connections 2023-07-21T22:19:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.179+0000 7f3c06cccb80 1 -- 172.21.15.151:0/1489538369 wait complete. 2023-07-21T22:19:40.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.180+0000 7f3c06cccb80 20 client.25457 trim_cache size 0 max 16384 2023-07-21T22:19:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.202+0000 7f3c06cccb80 1 Processor -- start 2023-07-21T22:19:40.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.202+0000 7f3c06cccb80 1 -- start start 2023-07-21T22:19:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.203+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.203+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 0x562a320c16f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.203+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.203+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a320c5300 con 0x562a320b0ff0 2023-07-21T22:19:40.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.203+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a320a5640 con 0x562a320adb00 2023-07-21T22:19:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.203+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a320a2ba0 con 0x562a31f0c6b0 2023-07-21T22:19:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.203+0000 7f3bf119b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.203+0000 7f3bf119b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c9580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48172/0 (socket says 172.21.15.151:48172) 2023-07-21T22:19:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.203+0000 7f3bf119b700 1 -- 172.21.15.151:0/23877250 learned_addr learned my addr 172.21.15.151:0/23877250 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.204+0000 7f3bf099a700 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 0x562a320c16f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.204+0000 7f3bf199c700 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.204+0000 7f3bf119b700 1 -- 172.21.15.151:0/23877250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 msgr2=0x562a320c16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.204+0000 7f3bf119b700 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 0x562a320c16f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.204+0000 7f3bf119b700 1 -- 172.21.15.151:0/23877250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 msgr2=0x562a320bd260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.204+0000 7f3bf119b700 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320bd260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.204+0000 7f3bf119b700 1 -- 172.21.15.151:0/23877250 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562a31e561f0 con 0x562a31f0c6b0 2023-07-21T22:19:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.204+0000 7f3bf199c700 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320bd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.204+0000 7f3bf119b700 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c9580 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x562a320d4d20 tx=0x7f3be8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14bbfee631c7f90d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.205+0000 7f3bd7fff700 1 -- 172.21.15.151:0/23877250 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8017030 con 0x562a31f0c6b0 2023-07-21T22:19:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.205+0000 7f3bd7fff700 1 -- 172.21.15.151:0/23877250 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3be8018040 con 0x562a31f0c6b0 2023-07-21T22:19:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.205+0000 7f3bd7fff700 1 -- 172.21.15.151:0/23877250 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be8004a90 con 0x562a31f0c6b0 2023-07-21T22:19:40.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.206+0000 7f3c06cccb80 1 -- 172.21.15.151:0/23877250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 msgr2=0x562a320c9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.206+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c9580 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x562a320d4d20 tx=0x7f3be8009260 comp rx=0 tx=0).stop 2023-07-21T22:19:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.207+0000 7f3c06cccb80 1 -- 172.21.15.151:0/23877250 shutdown_connections 2023-07-21T22:19:40.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.207+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a320b0ff0 0x562a320bd260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.207+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a31f0c6b0 0x562a320c9580 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.207+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/23877250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320adb00 0x562a320c16f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.207+0000 7f3c06cccb80 1 -- 172.21.15.151:0/23877250 >> 172.21.15.151:0/23877250 conn(0x562a320a5c40 msgr2=0x562a320ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.207+0000 7f3c06cccb80 1 -- 172.21.15.151:0/23877250 shutdown_connections 2023-07-21T22:19:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.207+0000 7f3c06cccb80 1 -- 172.21.15.151:0/23877250 wait complete. 2023-07-21T22:19:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.208+0000 7f3c06cccb80 1 -- start start 2023-07-21T22:19:40.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.208+0000 7f3c06cccb80 1 Processor -- start 2023-07-21T22:19:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.208+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a31f0c6b0 0x562a320c7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.208+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 0x562a320c7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.208+0000 7f3c06cccb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320b0ff0 0x562a32124ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.208+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a320c8410 con 0x562a31f0c6b0 2023-07-21T22:19:40.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.208+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a32125430 con 0x562a320b0ff0 2023-07-21T22:19:40.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.208+0000 7f3c06cccb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562a321255f0 con 0x562a320adb00 2023-07-21T22:19:40.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3c06cccb80 10 client.0 _ll_register_callbacks cb 0x7f3be8009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:40.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf119b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a31f0c6b0 0x562a320c7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf199c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320b0ff0 0x562a32124ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf119b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a31f0c6b0 0x562a320c7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45068/0 (socket says 172.21.15.151:45068) 2023-07-21T22:19:40.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf119b700 1 -- 172.21.15.151:0/3122366589 learned_addr learned my addr 172.21.15.151:0/3122366589 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:40.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf099a700 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 0x562a320c7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf099a700 1 -- 172.21.15.151:0/3122366589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320b0ff0 msgr2=0x562a32124ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf099a700 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320b0ff0 0x562a32124ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf099a700 1 -- 172.21.15.151:0/3122366589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a31f0c6b0 msgr2=0x562a320c7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf099a700 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a31f0c6b0 0x562a320c7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.209+0000 7f3bf099a700 1 -- 172.21.15.151:0/3122366589 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3be8012040 con 0x562a320adb00 2023-07-21T22:19:40.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.210+0000 7f3bf099a700 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 0x562a320c7c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc096160 tx=0x7f3bdc004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1595737bb78456b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.210+0000 7f3bd4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:19:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.210+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/3122366589 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc099360 con 0x562a320adb00 2023-07-21T22:19:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.210+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/3122366589 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3bdc0a20b0 con 0x562a320adb00 2023-07-21T22:19:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.210+0000 7f3c06cccb80 1 -- 172.21.15.151:0/3122366589 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3bdc09dc90 con 0x562a320adb00 2023-07-21T22:19:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/3122366589 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3bdc0ca2d0 con 0x562a320adb00 2023-07-21T22:19:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3c06cccb80 10 client.25501 fetch_fsmap learned FSMap version 27 2023-07-21T22:19:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3c06cccb80 1 -- 172.21.15.151:0/3122366589 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x562a31e2e250 con 0x562a320adb00 2023-07-21T22:19:40.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/3122366589 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3bdc0bd080 con 0x562a320adb00 2023-07-21T22:19:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/3122366589 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3bdc09a570 con 0x562a320adb00 2023-07-21T22:19:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3c06cccb80 10 client.25501 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:19:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3c06cccb80 10 client.25501 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3c06cccb80 20 client.25501 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562a32126810 0x562a32128bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3c06cccb80 4 client.25501 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:19:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.211+0000 7f3c06cccb80 1 -- 172.21.15.151:0/3122366589 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562a31fbcff0 con 0x562a32126810 2023-07-21T22:19:40.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.212+0000 7f3bf119b700 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562a32126810 0x562a32128bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.212+0000 7f3bf119b700 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562a32126810 0x562a32128bf0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8be41676a76f7cca server_cookie=c20f870e8a9ccd3d in_seq=0 out_seq=0 2023-07-21T22:19:40.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.212+0000 7f3bd4ff9700 10 client.25501 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3bd4ff9700 1 -- 172.21.15.151:0/3122366589 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562a31fbcff0 con 0x562a32126810 2023-07-21T22:19:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3bd4ff9700 10 client.25501 handle_command_reply: tid=0 2023-07-21T22:19:40.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 client.25501 shutdown 2023-07-21T22:19:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 -- 172.21.15.151:0/3122366589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 msgr2=0x562a320c7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 0x562a320c7c90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc096160 tx=0x7f3bdc004570 comp rx=0 tx=0).stop 2023-07-21T22:19:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 -- 172.21.15.151:0/3122366589 shutdown_connections 2023-07-21T22:19:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562a32126810 0x562a32128bf0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562a320b0ff0 0x562a32124ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562a31f0c6b0 0x562a320c7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 --2- 172.21.15.151:0/3122366589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562a320adb00 0x562a320c7c90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 -- 172.21.15.151:0/3122366589 >> 172.21.15.151:0/3122366589 conn(0x562a320a5c40 msgr2=0x562a320bd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3bd4ff9700 0 client.25501 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:40.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.263+0000 7f3c06cccb80 1 -- 172.21.15.151:0/3122366589 shutdown_connections 2023-07-21T22:19:40.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.264+0000 7f3c06cccb80 1 -- 172.21.15.151:0/3122366589 wait complete. 2023-07-21T22:19:40.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.264+0000 7f3c06cccb80 20 client.25501 trim_cache size 0 max 16384 2023-07-21T22:19:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:19:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:19:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:19:40.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:19:40.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.264+0000 7f3bf219d700 1 -- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3bd80a1470 msgr2=0x7f3bd80a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.264+0000 7f3bf219d700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3bd80a1470 0x7f3bd80a3920 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3be40062a0 tx=0x7f3be4006210 comp rx=0 tx=0).stop 2023-07-21T22:19:40.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.264+0000 7f3bf219d700 1 -- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 msgr2=0x7f3bec196260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:40.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.264+0000 7f3bf219d700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 0x7f3bec196260 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00d980 tx=0x7f3bdc00dc90 comp rx=0 tx=0).stop 2023-07-21T22:19:40.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.265+0000 7f3bf219d700 1 -- 172.21.15.151:0/741189579 shutdown_connections 2023-07-21T22:19:40.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.265+0000 7f3bf219d700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3bd80a1470 0x7f3bd80a3920 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.265+0000 7f3bf219d700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec105910 0x7f3bec19a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.265+0000 7f3bf219d700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3bec0ff900 0x7f3bec195d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.265+0000 7f3bf219d700 1 --2- 172.21.15.151:0/741189579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3bec1002b0 0x7f3bec196260 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:40.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.265+0000 7f3bf219d700 1 -- 172.21.15.151:0/741189579 >> 172.21.15.151:0/741189579 conn(0x7f3bec0fb440 msgr2=0x7f3bec0fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:40.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.265+0000 7f3bf219d700 1 -- 172.21.15.151:0/741189579 shutdown_connections 2023-07-21T22:19:40.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:40.265+0000 7f3bf219d700 1 -- 172.21.15.151:0/741189579 wait complete. 2023-07-21T22:19:40.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:40 smithi187 ceph-mon[96918]: pgmap v17: 97 pgs: 97 active+clean; 47 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 3.2 MiB/s wr, 173 op/s 2023-07-21T22:19:40.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:40 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:40.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:40 smithi195 ceph-mon[97365]: pgmap v17: 97 pgs: 97 active+clean; 47 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 3.2 MiB/s wr, 173 op/s 2023-07-21T22:19:40.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:40 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:40.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:40 smithi151 ceph-mon[95510]: pgmap v17: 97 pgs: 97 active+clean; 47 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 662 KiB/s rd, 3.2 MiB/s wr, 173 op/s 2023-07-21T22:19:40.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:40 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:19:40.821 INFO:teuthology.orchestra.run.smithi151.stderr:300000 of 50000000 tuples (0%) done (elapsed 4.31 s, remaining 714.63 s) 2023-07-21T22:19:42.098 INFO:teuthology.orchestra.run.smithi151.stderr:400000 of 50000000 tuples (0%) done (elapsed 5.59 s, remaining 693.29 s) 2023-07-21T22:19:42.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:42 smithi187 ceph-mon[96918]: pgmap v18: 97 pgs: 97 active+clean; 47 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 1.5 MiB/s wr, 111 op/s 2023-07-21T22:19:42.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:42 smithi195 ceph-mon[97365]: pgmap v18: 97 pgs: 97 active+clean; 47 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 1.5 MiB/s wr, 111 op/s 2023-07-21T22:19:42.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:42 smithi151 ceph-mon[95510]: pgmap v18: 97 pgs: 97 active+clean; 47 MiB data, 386 MiB used, 1.0 TiB / 1.0 TiB avail; 461 KiB/s rd, 1.5 MiB/s wr, 111 op/s 2023-07-21T22:19:43.794 INFO:teuthology.orchestra.run.smithi151.stderr:500000 of 50000000 tuples (1%) done (elapsed 7.29 s, remaining 721.37 s) 2023-07-21T22:19:44.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:44 smithi187 ceph-mon[96918]: pgmap v19: 97 pgs: 97 active+clean; 125 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 14 MiB/s wr, 149 op/s 2023-07-21T22:19:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:44 smithi195 ceph-mon[97365]: pgmap v19: 97 pgs: 97 active+clean; 125 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 14 MiB/s wr, 149 op/s 2023-07-21T22:19:44.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:44 smithi151 ceph-mon[95510]: pgmap v19: 97 pgs: 97 active+clean; 125 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 548 KiB/s rd, 14 MiB/s wr, 149 op/s 2023-07-21T22:19:45.080 INFO:teuthology.orchestra.run.smithi151.stderr:600000 of 50000000 tuples (1%) done (elapsed 8.57 s, remaining 705.81 s) 2023-07-21T22:19:46.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:46 smithi187 ceph-mon[96918]: pgmap v20: 97 pgs: 97 active+clean; 125 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 12 MiB/s wr, 67 op/s 2023-07-21T22:19:46.656 INFO:teuthology.orchestra.run.smithi151.stderr:700000 of 50000000 tuples (1%) done (elapsed 10.15 s, remaining 714.78 s) 2023-07-21T22:19:46.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:46 smithi195 ceph-mon[97365]: pgmap v20: 97 pgs: 97 active+clean; 125 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 12 MiB/s wr, 67 op/s 2023-07-21T22:19:46.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:46 smithi151 ceph-mon[95510]: pgmap v20: 97 pgs: 97 active+clean; 125 MiB data, 416 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 12 MiB/s wr, 67 op/s 2023-07-21T22:19:48.354 INFO:teuthology.orchestra.run.smithi151.stderr:800000 of 50000000 tuples (1%) done (elapsed 11.85 s, remaining 728.56 s) 2023-07-21T22:19:48.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:48 smithi187 ceph-mon[96918]: pgmap v21: 97 pgs: 97 active+clean; 169 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 20 MiB/s wr, 73 op/s 2023-07-21T22:19:48.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:48 smithi195 ceph-mon[97365]: pgmap v21: 97 pgs: 97 active+clean; 169 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 20 MiB/s wr, 73 op/s 2023-07-21T22:19:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:48 smithi151 ceph-mon[95510]: pgmap v21: 97 pgs: 97 active+clean; 169 MiB data, 431 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 20 MiB/s wr, 73 op/s 2023-07-21T22:19:49.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:49 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:19:49.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:49 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:19:49.631 INFO:teuthology.orchestra.run.smithi151.stderr:900000 of 50000000 tuples (1%) done (elapsed 13.12 s, remaining 715.99 s) 2023-07-21T22:19:49.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:49 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:19:49.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:49 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:19:49.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:49 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:19:49.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:49 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:19:50.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:50 smithi187 ceph-mon[96918]: pgmap v22: 97 pgs: 97 active+clean; 201 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 25 MiB/s wr, 73 op/s 2023-07-21T22:19:50.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:50 smithi195 ceph-mon[97365]: pgmap v22: 97 pgs: 97 active+clean; 201 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 25 MiB/s wr, 73 op/s 2023-07-21T22:19:50.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:50 smithi151 ceph-mon[95510]: pgmap v22: 97 pgs: 97 active+clean; 201 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 196 KiB/s rd, 25 MiB/s wr, 73 op/s 2023-07-21T22:19:51.327 INFO:teuthology.orchestra.run.smithi151.stderr:1000000 of 50000000 tuples (2%) done (elapsed 14.82 s, remaining 726.16 s) 2023-07-21T22:19:52.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:52 smithi187 ceph-mon[96918]: pgmap v23: 97 pgs: 97 active+clean; 201 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 25 MiB/s wr, 47 op/s 2023-07-21T22:19:52.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:52 smithi195 ceph-mon[97365]: pgmap v23: 97 pgs: 97 active+clean; 201 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 25 MiB/s wr, 47 op/s 2023-07-21T22:19:52.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:52 smithi151 ceph-mon[95510]: pgmap v23: 97 pgs: 97 active+clean; 201 MiB data, 444 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 25 MiB/s wr, 47 op/s 2023-07-21T22:19:53.004 INFO:teuthology.orchestra.run.smithi151.stderr:1100000 of 50000000 tuples (2%) done (elapsed 16.50 s, remaining 733.37 s) 2023-07-21T22:19:53.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.427+0000 7f35cf1ff700 1 -- 172.21.15.151:0/602993980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 msgr2=0x7f35c8104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:53.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.427+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/602993980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 0x7f35c8104770 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f35b40099c0 tx=0x7f35b4009cd0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.427+0000 7f35cf1ff700 1 -- 172.21.15.151:0/602993980 shutdown_connections 2023-07-21T22:19:53.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.428+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/602993980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c8104e50 0x7f35c810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.428+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/602993980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35c8067c10 0x7f35c8067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.428+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/602993980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 0x7f35c8104770 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.428+0000 7f35cf1ff700 1 -- 172.21.15.151:0/602993980 >> 172.21.15.151:0/602993980 conn(0x7f35c8074760 msgr2=0x7f35c8074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:53.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.428+0000 7f35cf1ff700 1 -- 172.21.15.151:0/602993980 shutdown_connections 2023-07-21T22:19:53.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.428+0000 7f35cf1ff700 1 -- 172.21.15.151:0/602993980 wait complete. 2023-07-21T22:19:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.429+0000 7f35cf1ff700 1 Processor -- start 2023-07-21T22:19:53.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.429+0000 7f35cf1ff700 1 -- start start 2023-07-21T22:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.429+0000 7f35cf1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c8067c10 0x7f35c80fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.429+0000 7f35cf1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 0x7f35c80ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.429+0000 7f35cf1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35c8104e50 0x7f35c81a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.429+0000 7f35cf1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c81a4250 con 0x7f35c80685b0 2023-07-21T22:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.429+0000 7f35cf1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c81a4390 con 0x7f35c8067c10 2023-07-21T22:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.429+0000 7f35cf1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35c81a4500 con 0x7f35c8104e50 2023-07-21T22:19:53.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 0x7f35c80ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35ccf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c8067c10 0x7f35c80fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 0x7f35c80ff180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52966/0 (socket says 172.21.15.151:52966) 2023-07-21T22:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35c7fff700 1 -- 172.21.15.151:0/441276949 learned_addr learned my addr 172.21.15.151:0/441276949 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35cd79c700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35c8104e50 0x7f35c81a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35c7fff700 1 -- 172.21.15.151:0/441276949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35c8104e50 msgr2=0x7f35c81a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35c7fff700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35c8104e50 0x7f35c81a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35c7fff700 1 -- 172.21.15.151:0/441276949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c8067c10 msgr2=0x7f35c80fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35c7fff700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c8067c10 0x7f35c80fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35c7fff700 1 -- 172.21.15.151:0/441276949 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35b40095f0 con 0x7f35c80685b0 2023-07-21T22:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.430+0000 7f35c7fff700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 0x7f35c80ff180 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f35b4006010 tx=0x7f35b400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.431+0000 7f35c5ffb700 1 -- 172.21.15.151:0/441276949 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b401d070 con 0x7f35c80685b0 2023-07-21T22:19:53.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.431+0000 7f35cf1ff700 1 -- 172.21.15.151:0/441276949 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35c81a4780 con 0x7f35c80685b0 2023-07-21T22:19:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.431+0000 7f35c5ffb700 1 -- 172.21.15.151:0/441276949 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35b4005030 con 0x7f35c80685b0 2023-07-21T22:19:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.431+0000 7f35c5ffb700 1 -- 172.21.15.151:0/441276949 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b4004970 con 0x7f35c80685b0 2023-07-21T22:19:53.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.431+0000 7f35cf1ff700 1 -- 172.21.15.151:0/441276949 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c81a4c00 con 0x7f35c80685b0 2023-07-21T22:19:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.434+0000 7f35c5ffb700 1 -- 172.21.15.151:0/441276949 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 23) v1 ==== 135892+0+0 (secure 0 0 0) 0x7f35b40051a0 con 0x7f35c80685b0 2023-07-21T22:19:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.435+0000 7f35e2c1bb80 1 Processor -- start 2023-07-21T22:19:53.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35e2c1bb80 1 -- start start 2023-07-21T22:19:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35c5ffb700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a13d0 0x7f35b80a3880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713e116b0 0x55c713fbacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 0x55c713fb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb660 0x55c713fb54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35c5ffb700 1 -- 172.21.15.151:0/441276949 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f35b40cd9f0 con 0x7f35c80685b0 2023-07-21T22:19:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713ebac50 con 0x55c713fbb210 2023-07-21T22:19:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713f0d9e0 con 0x55c713e116b0 2023-07-21T22:19:53.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713f06e70 con 0x55c713fbb660 2023-07-21T22:19:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.436+0000 7f35cd79c700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a13d0 0x7f35b80a3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35ccf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713e116b0 0x55c713fbacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 0x55c713fb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35ccf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713e116b0 0x55c713fbacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:58408/0 (socket says 172.21.15.151:58408) 2023-07-21T22:19:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35ccf9b700 1 -- 172.21.15.151:0/821085333 learned_addr learned my addr 172.21.15.151:0/821085333 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 0x55c713fb4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52968/0 (socket says 172.21.15.151:52968) 2023-07-21T22:19:53.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35cd79c700 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb660 0x55c713fb54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35ccf9b700 1 -- 172.21.15.151:0/821085333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb660 msgr2=0x55c713fb54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb660 0x55c713fb54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35ccf9b700 1 -- 172.21.15.151:0/821085333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 msgr2=0x55c713fb4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 0x55c713fb4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35ccf9b700 1 -- 172.21.15.151:0/821085333 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c713d34d80 con 0x55c713e116b0 2023-07-21T22:19:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35cd79c700 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb660 0x55c713fb54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:53.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35c7fff700 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 0x55c713fb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:19:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713e116b0 0x55c713fbacd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35bc011650 tx=0x7f35bc009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=922b009641bd907b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.437+0000 7f35cd79c700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a13d0 0x7f35b80a3880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55c713fbba70 tx=0x7f35c00099b0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.438+0000 7f35b2ffd700 1 -- 172.21.15.151:0/821085333 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc00e040 con 0x55c713e116b0 2023-07-21T22:19:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.438+0000 7f35b2ffd700 1 -- 172.21.15.151:0/821085333 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35bc00f040 con 0x55c713e116b0 2023-07-21T22:19:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.438+0000 7f35b2ffd700 1 -- 172.21.15.151:0/821085333 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc0157c0 con 0x55c713e116b0 2023-07-21T22:19:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/821085333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713e116b0 msgr2=0x55c713fbacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:53.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713e116b0 0x55c713fbacd0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f35bc011650 tx=0x7f35bc009920 comp rx=0 tx=0).stop 2023-07-21T22:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/821085333 shutdown_connections 2023-07-21T22:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713e116b0 0x55c713fbacd0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb660 0x55c713fb54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/821085333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 0x55c713fb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/821085333 >> 172.21.15.151:0/821085333 conn(0x55c713faaae0 msgr2=0x55c713fb00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/821085333 shutdown_connections 2023-07-21T22:19:53.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/821085333 wait complete. 2023-07-21T22:19:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.439+0000 7f35e2c1bb80 1 -- start start 2023-07-21T22:19:53.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.440+0000 7f35e2c1bb80 1 Processor -- start 2023-07-21T22:19:53.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.440+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713e116b0 0x55c713fc14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.440+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 0x55c713fbe790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.440+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 0x55c713fbed30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.440+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713ea6a60 con 0x55c713fbb210 2023-07-21T22:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.440+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713ea6760 con 0x55c713fbb660 2023-07-21T22:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.440+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713d8a8c0 con 0x55c713e116b0 2023-07-21T22:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.440+0000 7f35e2c1bb80 10 client.0 _ll_register_callbacks cb 0x55c713ea4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:53.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35ccf9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713e116b0 0x55c713fc14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35ccf9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713e116b0 0x55c713fc14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37844/0 (socket says 172.21.15.151:37844) 2023-07-21T22:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35ccf9b700 1 -- 172.21.15.151:0/1794170689 learned_addr learned my addr 172.21.15.151:0/1794170689 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35cd79c700 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 0x55c713fbed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35ccf9b700 1 -- 172.21.15.151:0/1794170689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 msgr2=0x55c713fbed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 0x55c713fbed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35ccf9b700 1 -- 172.21.15.151:0/1794170689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 msgr2=0x55c713fbe790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 0x55c713fbe790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35ccf9b700 1 -- 172.21.15.151:0/1794170689 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c81a4c00 con 0x55c713e116b0 2023-07-21T22:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.441+0000 7f35cd79c700 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 0x55c713fbed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.442+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713e116b0 0x55c713fc14a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0060a0 tx=0x7f35bc005ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb8d84afa1d345b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.442+0000 7f35a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.442+0000 7f35a7fff700 1 -- 172.21.15.151:0/1794170689 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc00e050 con 0x55c713e116b0 2023-07-21T22:19:53.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.442+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/1794170689 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c713e60490 con 0x55c713e116b0 2023-07-21T22:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.442+0000 7f35a7fff700 1 -- 172.21.15.151:0/1794170689 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f35bc024070 con 0x55c713e116b0 2023-07-21T22:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.442+0000 7f35a7fff700 1 -- 172.21.15.151:0/1794170689 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35bc015660 con 0x55c713e116b0 2023-07-21T22:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.442+0000 7f35e2c1bb80 10 client.25513 fetch_fsmap learned FSMap version 27 2023-07-21T22:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.442+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/1794170689 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f35bc011330 con 0x55c713e116b0 2023-07-21T22:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.442+0000 7f35a7fff700 1 -- 172.21.15.151:0/1794170689 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c713e60490 con 0x55c713e116b0 2023-07-21T22:19:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.443+0000 7f35a7fff700 1 -- 172.21.15.151:0/1794170689 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f35bc0338b0 con 0x55c713e116b0 2023-07-21T22:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.443+0000 7f35e2c1bb80 10 client.25513 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.443+0000 7f35e2c1bb80 10 client.25513 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.443+0000 7f35e2c1bb80 20 client.25513 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.443+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c713fce970 0x55c713fd0d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.443+0000 7f35e2c1bb80 4 client.25513 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:19:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.443+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/1794170689 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c713effe50 con 0x55c713fce970 2023-07-21T22:19:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.443+0000 7f35c7fff700 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c713fce970 0x55c713fd0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.444+0000 7f35c7fff700 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c713fce970 0x55c713fd0d80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a409762e423868bf server_cookie=df7d37112d63554b in_seq=0 out_seq=0 2023-07-21T22:19:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.444+0000 7f35a7fff700 10 client.25513 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35a7fff700 1 -- 172.21.15.151:0/1794170689 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c713effe50 con 0x55c713fce970 2023-07-21T22:19:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35a7fff700 10 client.25513 handle_command_reply: tid=0 2023-07-21T22:19:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 client.25513 shutdown 2023-07-21T22:19:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/1794170689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713e116b0 msgr2=0x55c713fc14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713e116b0 0x55c713fc14a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f35bc0060a0 tx=0x7f35bc005ae0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/1794170689 shutdown_connections 2023-07-21T22:19:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c713fce970 0x55c713fd0d80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 0x55c713fbed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713e116b0 0x55c713fc14a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35a7fff700 0 client.25513 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/1794170689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb210 0x55c713fbe790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/1794170689 >> 172.21.15.151:0/1794170689 conn(0x55c713faaae0 msgr2=0x55c713faf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/1794170689 shutdown_connections 2023-07-21T22:19:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.445+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/1794170689 wait complete. 2023-07-21T22:19:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.446+0000 7f35e2c1bb80 20 client.25513 trim_cache size 0 max 16384 2023-07-21T22:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.461+0000 7f35e2c1bb80 1 Processor -- start 2023-07-21T22:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.461+0000 7f35e2c1bb80 1 -- start start 2023-07-21T22:19:53.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.461+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.461+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb660 0x55c713fafb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.461+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbe810 0x55c713fc1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.461+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713facc00 con 0x55c713fbb660 2023-07-21T22:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.461+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713fbfd00 con 0x55c713fbe810 2023-07-21T22:19:53.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.461+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713fba920 con 0x55c713fbb210 2023-07-21T22:19:53.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb660 0x55c713fafb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb660 0x55c713fafb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52990/0 (socket says 172.21.15.151:52990) 2023-07-21T22:19:53.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35c7fff700 1 -- 172.21.15.151:0/3077150091 learned_addr learned my addr 172.21.15.151:0/3077150091 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35cd79c700 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbe810 0x55c713fc1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35c7fff700 1 -- 172.21.15.151:0/3077150091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 msgr2=0x55c713fc5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35c7fff700 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35c7fff700 1 -- 172.21.15.151:0/3077150091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbe810 msgr2=0x55c713fc1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35c7fff700 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbe810 0x55c713fc1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35c7fff700 1 -- 172.21.15.151:0/3077150091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c713fd5970 con 0x55c713fbb660 2023-07-21T22:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.462+0000 7f35c7fff700 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb660 0x55c713fafb60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f35b409a6f0 tx=0x7f35b40cd040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5721c5ba77f2f762 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35b37fe700 1 -- 172.21.15.151:0/3077150091 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b40a2db0 con 0x55c713fbb660 2023-07-21T22:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35b37fe700 1 -- 172.21.15.151:0/3077150091 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35b4098d90 con 0x55c713fbb660 2023-07-21T22:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35b37fe700 1 -- 172.21.15.151:0/3077150091 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35b409ac50 con 0x55c713fbb660 2023-07-21T22:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3077150091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb660 msgr2=0x55c713fafb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb660 0x55c713fafb60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f35b409a6f0 tx=0x7f35b40cd040 comp rx=0 tx=0).stop 2023-07-21T22:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3077150091 shutdown_connections 2023-07-21T22:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbe810 0x55c713fc1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3077150091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbb660 0x55c713fafb60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3077150091 >> 172.21.15.151:0/3077150091 conn(0x55c713faaae0 msgr2=0x55c713fbe100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.463+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3077150091 shutdown_connections 2023-07-21T22:19:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.464+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3077150091 wait complete. 2023-07-21T22:19:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.464+0000 7f35e2c1bb80 1 -- start start 2023-07-21T22:19:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.464+0000 7f35e2c1bb80 1 Processor -- start 2023-07-21T22:19:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 0x55c713fb4360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35e2c1bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbe810 0x55c713fb4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c713fb51b0 con 0x55c713fbe810 2023-07-21T22:19:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7140227f0 con 0x55c713fbb660 2023-07-21T22:19:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35e2c1bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c714022930 con 0x55c713fbb210 2023-07-21T22:19:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35e2c1bb80 10 client.0 _ll_register_callbacks cb 0x7f35b40caf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:19:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35cd79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbe810 0x55c713fb4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35cd79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbe810 0x55c713fb4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52994/0 (socket says 172.21.15.151:52994) 2023-07-21T22:19:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35cd79c700 1 -- 172.21.15.151:0/3475597021 learned_addr learned my addr 172.21.15.151:0/3475597021 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:19:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.465+0000 7f35c7fff700 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 0x55c713fb4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35ccf9b700 1 -- 172.21.15.151:0/3475597021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 msgr2=0x55c713fb4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 0x55c713fb4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35ccf9b700 1 -- 172.21.15.151:0/3475597021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbe810 msgr2=0x55c713fb4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:19:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbe810 0x55c713fb4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35ccf9b700 1 -- 172.21.15.151:0/3475597021 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35c81a4780 con 0x55c713fbb210 2023-07-21T22:19:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35ccf9b700 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f35bc033c40 tx=0x7f35bc006000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66ef55fcba30c251 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:19:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35a7fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:19:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35a7fff700 1 -- 172.21.15.151:0/3475597021 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35bc00e070 con 0x55c713fbb210 2023-07-21T22:19:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35a7fff700 1 -- 172.21.15.151:0/3475597021 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f35bc024040 con 0x55c713fbb210 2023-07-21T22:19:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3475597021 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35bc00f040 con 0x55c713fbb210 2023-07-21T22:19:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35a7fff700 1 -- 172.21.15.151:0/3475597021 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35bc009ac0 con 0x55c713fbb210 2023-07-21T22:19:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35e2c1bb80 10 client.25519 fetch_fsmap learned FSMap version 27 2023-07-21T22:19:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.466+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3475597021 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c713d1dc00 con 0x55c713fbb210 2023-07-21T22:19:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.467+0000 7f35a7fff700 1 -- 172.21.15.151:0/3475597021 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35bc00f040 con 0x55c713fbb210 2023-07-21T22:19:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.467+0000 7f35a7fff700 1 -- 172.21.15.151:0/3475597021 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f35bc027740 con 0x55c713fbb210 2023-07-21T22:19:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.467+0000 7f35e2c1bb80 10 client.25519 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:19:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.467+0000 7f35e2c1bb80 10 client.25519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:19:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.467+0000 7f35e2c1bb80 20 client.25519 populate_metadata read hostname 'smithi151' 2023-07-21T22:19:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.467+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c714023cf0 0x55c714026100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:19:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.467+0000 7f35e2c1bb80 4 client.25519 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:19:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.467+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3475597021 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c713ec1ff0 con 0x55c714023cf0 2023-07-21T22:19:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.468+0000 7f35c7fff700 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c714023cf0 0x55c714026100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:19:53.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.468+0000 7f35a7fff700 10 client.25519 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:53.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.468+0000 7f35c7fff700 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c714023cf0 0x55c714026100 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=133aeb9a35987f8a server_cookie=4c1aec3246a7311d in_seq=0 out_seq=0 2023-07-21T22:19:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35a7fff700 1 -- 172.21.15.151:0/3475597021 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c713ec1ff0 con 0x55c714023cf0 2023-07-21T22:19:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35a7fff700 10 client.25519 handle_command_reply: tid=0 2023-07-21T22:19:53.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 client.25519 shutdown 2023-07-21T22:19:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3475597021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 msgr2=0x55c713fc5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5da0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f35bc033c40 tx=0x7f35bc006000 comp rx=0 tx=0).stop 2023-07-21T22:19:53.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3475597021 shutdown_connections 2023-07-21T22:19:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c714023cf0 0x55c714026100 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c713fbe810 0x55c713fb4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c713fbb210 0x55c713fc5da0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35a7fff700 0 client.25519 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:19:53.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 --2- 172.21.15.151:0/3475597021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c713fbb660 0x55c713fb4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3475597021 >> 172.21.15.151:0/3475597021 conn(0x55c713faaae0 msgr2=0x55c713fb98e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:53.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3475597021 shutdown_connections 2023-07-21T22:19:53.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 1 -- 172.21.15.151:0/3475597021 wait complete. 2023-07-21T22:19:53.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.491+0000 7f35e2c1bb80 20 client.25519 trim_cache size 0 max 16384 2023-07-21T22:19:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:19:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:19:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:19:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:19:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 -- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a13d0 msgr2=0x7f35b80a3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a13d0 0x7f35b80a3880 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x55c713fbba70 tx=0x7f35c00099b0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 -- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 msgr2=0x7f35c80ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:19:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 0x7f35c80ff180 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f35b4006010 tx=0x7f35b400f670 comp rx=0 tx=0).stop 2023-07-21T22:19:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 -- 172.21.15.151:0/441276949 shutdown_connections 2023-07-21T22:19:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a13d0 0x7f35b80a3880 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35c8067c10 0x7f35c80fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35c8104e50 0x7f35c81a3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 --2- 172.21.15.151:0/441276949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35c80685b0 0x7f35c80ff180 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:19:53.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 -- 172.21.15.151:0/441276949 >> 172.21.15.151:0/441276949 conn(0x7f35c8074760 msgr2=0x7f35c80fde50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:19:53.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 -- 172.21.15.151:0/441276949 shutdown_connections 2023-07-21T22:19:53.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:19:53.492+0000 7f35cf1ff700 1 -- 172.21.15.151:0/441276949 wait complete. 2023-07-21T22:19:54.284 INFO:teuthology.orchestra.run.smithi151.stderr:1200000 of 50000000 tuples (2%) done (elapsed 17.77 s, remaining 722.73 s) 2023-07-21T22:19:54.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:54 smithi187 ceph-mon[96918]: pgmap v24: 97 pgs: 97 active+clean; 273 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 37 MiB/s wr, 58 op/s 2023-07-21T22:19:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:54 smithi195 ceph-mon[97365]: pgmap v24: 97 pgs: 97 active+clean; 273 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 37 MiB/s wr, 58 op/s 2023-07-21T22:19:54.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:54 smithi151 ceph-mon[95510]: pgmap v24: 97 pgs: 97 active+clean; 273 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 37 MiB/s wr, 58 op/s 2023-07-21T22:19:55.801 INFO:teuthology.orchestra.run.smithi151.stderr:1300000 of 50000000 tuples (2%) done (elapsed 19.29 s, remaining 722.77 s) 2023-07-21T22:19:56.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:56 smithi187 ceph-mon[96918]: pgmap v25: 97 pgs: 97 active+clean; 273 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-07-21T22:19:56.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:56 smithi195 ceph-mon[97365]: pgmap v25: 97 pgs: 97 active+clean; 273 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-07-21T22:19:56.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:56 smithi151 ceph-mon[95510]: pgmap v25: 97 pgs: 97 active+clean; 273 MiB data, 473 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-07-21T22:19:57.497 INFO:teuthology.orchestra.run.smithi151.stderr:1400000 of 50000000 tuples (2%) done (elapsed 20.99 s, remaining 728.63 s) 2023-07-21T22:19:58.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:19:58 smithi187 ceph-mon[96918]: pgmap v26: 97 pgs: 97 active+clean; 297 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 26 op/s 2023-07-21T22:19:58.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:19:58 smithi195 ceph-mon[97365]: pgmap v26: 97 pgs: 97 active+clean; 297 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 26 op/s 2023-07-21T22:19:58.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:19:58 smithi151 ceph-mon[95510]: pgmap v26: 97 pgs: 97 active+clean; 297 MiB data, 485 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 29 MiB/s wr, 26 op/s 2023-07-21T22:19:58.746 INFO:teuthology.orchestra.run.smithi151.stderr:1500000 of 50000000 tuples (3%) done (elapsed 22.24 s, remaining 719.04 s) 2023-07-21T22:20:00.395 INFO:teuthology.orchestra.run.smithi151.stderr:1600000 of 50000000 tuples (3%) done (elapsed 23.89 s, remaining 722.60 s) 2023-07-21T22:20:00.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:00 smithi187 ceph-mon[96918]: pgmap v27: 97 pgs: 97 active+clean; 353 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 MiB/s wr, 30 op/s 2023-07-21T22:20:00.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:00 smithi187 ceph-mon[96918]: overall HEALTH_OK 2023-07-21T22:20:00.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:00 smithi195 ceph-mon[97365]: pgmap v27: 97 pgs: 97 active+clean; 353 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 MiB/s wr, 30 op/s 2023-07-21T22:20:00.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:00 smithi195 ceph-mon[97365]: overall HEALTH_OK 2023-07-21T22:20:00.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:00 smithi151 ceph-mon[95510]: pgmap v27: 97 pgs: 97 active+clean; 353 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 31 MiB/s wr, 30 op/s 2023-07-21T22:20:00.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:00 smithi151 ceph-mon[95510]: overall HEALTH_OK 2023-07-21T22:20:00.700 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:20:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:20:00.482+0000 7fedd49af700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:00.700 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:20:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:20:00.482+0000 7fedd49af700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:00.700 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:20:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:20:00.482+0000 7fedd49af700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:00.700 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:20:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:20:00.482+0000 7fedd49af700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:00.700 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 22:20:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T22:20:00.482+0000 7fedd49af700 -1 client.0 error registering admin socket command: (17) File exists 2023-07-21T22:20:01.732 INFO:teuthology.orchestra.run.smithi151.stderr:1700000 of 50000000 tuples (3%) done (elapsed 25.22 s, remaining 716.68 s) 2023-07-21T22:20:02.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:02 smithi187 ceph-mon[96918]: pgmap v28: 97 pgs: 97 active+clean; 353 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:20:02.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:02 smithi187 ceph-mon[96918]: mgrmap e24: x(active, since 50s), standbys: y, z 2023-07-21T22:20:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:02 smithi195 ceph-mon[97365]: pgmap v28: 97 pgs: 97 active+clean; 353 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:20:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:02 smithi195 ceph-mon[97365]: mgrmap e24: x(active, since 50s), standbys: y, z 2023-07-21T22:20:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:02 smithi151 ceph-mon[95510]: pgmap v28: 97 pgs: 97 active+clean; 353 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:20:02.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:02 smithi151 ceph-mon[95510]: mgrmap e24: x(active, since 50s), standbys: y, z 2023-07-21T22:20:03.327 INFO:teuthology.orchestra.run.smithi151.stderr:1800000 of 50000000 tuples (3%) done (elapsed 26.82 s, remaining 718.17 s) 2023-07-21T22:20:04.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:04 smithi187 ceph-mon[96918]: pgmap v29: 97 pgs: 97 active+clean; 450 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 MiB/s wr, 49 op/s 2023-07-21T22:20:04.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:04 smithi195 ceph-mon[97365]: pgmap v29: 97 pgs: 97 active+clean; 450 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 MiB/s wr, 49 op/s 2023-07-21T22:20:04.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:04 smithi151 ceph-mon[95510]: pgmap v29: 97 pgs: 97 active+clean; 450 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 38 MiB/s wr, 49 op/s 2023-07-21T22:20:04.761 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:20:04.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.947+0000 7f690f5ff700 1 -- 172.21.15.151:0/3095649851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69081015b0 msgr2=0x7f6908109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.947+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3095649851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69081015b0 0x7f6908109aa0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009990 tx=0x7f68f8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.947+0000 7f690f5ff700 1 -- 172.21.15.151:0/3095649851 shutdown_connections 2023-07-21T22:20:04.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.947+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3095649851 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6908100ca0 0x7f6908101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.947+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3095649851 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f690810a070 0x7f690810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.947+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3095649851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69081015b0 0x7f6908109aa0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.947+0000 7f690f5ff700 1 -- 172.21.15.151:0/3095649851 >> 172.21.15.151:0/3095649851 conn(0x7f69080fa4b0 msgr2=0x7f69080fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:04.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.947+0000 7f690f5ff700 1 -- 172.21.15.151:0/3095649851 shutdown_connections 2023-07-21T22:20:04.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.947+0000 7f690f5ff700 1 -- 172.21.15.151:0/3095649851 wait complete. 2023-07-21T22:20:04.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.948+0000 7f690f5ff700 1 Processor -- start 2023-07-21T22:20:04.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.948+0000 7f690f5ff700 1 -- start start 2023-07-21T22:20:04.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690f5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6908100ca0 0x7f69080fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690f5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69081015b0 0x7f69080fee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690f5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f690810a070 0x7f69081a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:04.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690f5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69080ff660 con 0x7f690810a070 2023-07-21T22:20:04.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690f5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69081a4290 con 0x7f69081015b0 2023-07-21T22:20:04.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690f5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69081a43d0 con 0x7f6908100ca0 2023-07-21T22:20:04.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f690810a070 0x7f69081a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f690810a070 0x7f69081a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37534/0 (socket says 172.21.15.151:37534) 2023-07-21T22:20:04.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690db9c700 1 -- 172.21.15.151:0/3973972986 learned_addr learned my addr 172.21.15.151:0/3973972986 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:04.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.949+0000 7f690d39b700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6908100ca0 0x7f69080fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690cb9a700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69081015b0 0x7f69080fee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:04.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690db9c700 1 -- 172.21.15.151:0/3973972986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6908100ca0 msgr2=0x7f69080fe8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690db9c700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6908100ca0 0x7f69080fe8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690db9c700 1 -- 172.21.15.151:0/3973972986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69081015b0 msgr2=0x7f69080fee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:04.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690db9c700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69081015b0 0x7f69080fee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:04.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690db9c700 1 -- 172.21.15.151:0/3973972986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68f80095f0 con 0x7f690810a070 2023-07-21T22:20:04.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690cb9a700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69081015b0 0x7f69080fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:04.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690db9c700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f690810a070 0x7f69081a3d50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f690000ef30 tx=0x7f690000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:04.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f68fe7fc700 1 -- 172.21.15.151:0/3973972986 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900018070 con 0x7f690810a070 2023-07-21T22:20:04.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f68fe7fc700 1 -- 172.21.15.151:0/3973972986 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f690000f040 con 0x7f690810a070 2023-07-21T22:20:04.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690f5ff700 1 -- 172.21.15.151:0/3973972986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69081a45d0 con 0x7f690810a070 2023-07-21T22:20:04.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f68fe7fc700 1 -- 172.21.15.151:0/3973972986 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f690000cc70 con 0x7f690810a070 2023-07-21T22:20:05.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.950+0000 7f690f5ff700 1 -- 172.21.15.151:0/3973972986 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69081a4ab0 con 0x7f690810a070 2023-07-21T22:20:05.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.954+0000 7f68fe7fc700 1 -- 172.21.15.151:0/3973972986 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f6900007500 con 0x7f690810a070 2023-07-21T22:20:05.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.955+0000 7f6922e8cb80 1 Processor -- start 2023-07-21T22:20:05.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.955+0000 7f6922e8cb80 1 -- start start 2023-07-21T22:20:05.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f68fe7fc700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f68f40a13e0 0x7f68f40a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70af580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f68fe7fc700 1 -- 172.21.15.151:0/3973972986 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f69000cca80 con 0x7f690810a070 2023-07-21T22:20:05.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 0x5626e70aa350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70aada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e6fafcb0 con 0x5626e70afac0 2023-07-21T22:20:05.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e7002a40 con 0x5626e70af1b0 2023-07-21T22:20:05.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e6ffbed0 con 0x5626e70aa930 2023-07-21T22:20:05.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f690cb9a700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f68f40a13e0 0x7f68f40a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.004 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f690cb9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 0x5626e70aa350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f690db9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70aada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f690cb9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 0x5626e70aa350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37546/0 (socket says 172.21.15.151:37546) 2023-07-21T22:20:05.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f690cb9a700 1 -- 172.21.15.151:0/3786738625 learned_addr learned my addr 172.21.15.151:0/3786738625 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.956+0000 7f690d39b700 1 --2- 172.21.15.151:0/3786738625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70af580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f690db9c700 1 -- 172.21.15.151:0/3786738625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 msgr2=0x5626e70af580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f690db9c700 1 --2- 172.21.15.151:0/3786738625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70af580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f690db9c700 1 -- 172.21.15.151:0/3786738625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 msgr2=0x5626e70aa350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f690db9c700 1 --2- 172.21.15.151:0/3786738625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 0x5626e70aa350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f690db9c700 1 -- 172.21.15.151:0/3786738625 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626e6e29de0 con 0x5626e70aa930 2023-07-21T22:20:05.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f690db9c700 1 --2- 172.21.15.151:0/3786738625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70aada0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69000ca060 tx=0x7f69000995b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7928cd5e66e47d57 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f690cb9a700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f68f40a13e0 0x7f68f40a3890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009990 tx=0x7f68f8004600 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f68f37fe700 1 -- 172.21.15.151:0/3786738625 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69000999a0 con 0x5626e70aa930 2023-07-21T22:20:05.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f68f37fe700 1 -- 172.21.15.151:0/3786738625 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f690009d9d0 con 0x5626e70aa930 2023-07-21T22:20:05.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.957+0000 7f68f37fe700 1 -- 172.21.15.151:0/3786738625 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6900098e90 con 0x5626e70aa930 2023-07-21T22:20:05.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.958+0000 7f6922e8cb80 1 -- 172.21.15.151:0/3786738625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 msgr2=0x5626e70aada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.958+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/3786738625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70aada0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f69000ca060 tx=0x7f69000995b0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.958+0000 7f6922e8cb80 1 -- 172.21.15.151:0/3786738625 shutdown_connections 2023-07-21T22:20:05.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.958+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/3786738625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70af580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.958+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/3786738625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70aada0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.958+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/3786738625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 0x5626e70aa350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.958+0000 7f6922e8cb80 1 -- 172.21.15.151:0/3786738625 >> 172.21.15.151:0/3786738625 conn(0x5626e709fef0 msgr2=0x5626e70a5830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.958+0000 7f6922e8cb80 1 -- 172.21.15.151:0/3786738625 shutdown_connections 2023-07-21T22:20:05.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.958+0000 7f6922e8cb80 1 -- 172.21.15.151:0/3786738625 wait complete. 2023-07-21T22:20:05.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.959+0000 7f6922e8cb80 1 -- start start 2023-07-21T22:20:05.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.959+0000 7f6922e8cb80 1 Processor -- start 2023-07-21T22:20:05.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70b6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b44d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e6f9bac0 con 0x5626e70aa930 2023-07-21T22:20:05.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e6f9b7c0 con 0x5626e70af1b0 2023-07-21T22:20:05.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e6e7f920 con 0x5626e70afac0 2023-07-21T22:20:05.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f6922e8cb80 10 client.0 _ll_register_callbacks cb 0x5626e6f99760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:05.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70b6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690db9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b44d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690db9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b44d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46476/0 (socket says 172.21.15.151:46476) 2023-07-21T22:20:05.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690db9c700 1 -- 172.21.15.151:0/1073405878 learned_addr learned my addr 172.21.15.151:0/1073405878 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70b6bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37552/0 (socket says 172.21.15.151:37552) 2023-07-21T22:20:05.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690cb9a700 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690db9c700 1 -- 172.21.15.151:0/1073405878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 msgr2=0x5626e70b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690db9c700 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690db9c700 1 -- 172.21.15.151:0/1073405878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 msgr2=0x5626e70b6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690db9c700 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70b6bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690db9c700 1 -- 172.21.15.151:0/1073405878 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69081a4ab0 con 0x5626e70afac0 2023-07-21T22:20:05.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.960+0000 7f690d39b700 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:05.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.961+0000 7f690db9c700 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b44d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6900095ea0 tx=0x7f69000c9fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d9277b49f98a9b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.961+0000 7f68f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:20:05.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.961+0000 7f68f0ff9700 1 -- 172.21.15.151:0/1073405878 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69000b2130 con 0x5626e70afac0 2023-07-21T22:20:05.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.961+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1073405878 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626e6f554f0 con 0x5626e70afac0 2023-07-21T22:20:05.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.961+0000 7f68f0ff9700 1 -- 172.21.15.151:0/1073405878 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f69000a1d60 con 0x5626e70afac0 2023-07-21T22:20:05.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.961+0000 7f68f0ff9700 1 -- 172.21.15.151:0/1073405878 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6900097d40 con 0x5626e70afac0 2023-07-21T22:20:05.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.961+0000 7f6922e8cb80 10 client.25534 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:05.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.961+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1073405878 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5626e6e12c60 con 0x5626e70afac0 2023-07-21T22:20:05.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.962+0000 7f68f0ff9700 1 -- 172.21.15.151:0/1073405878 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5626e6f554f0 con 0x5626e70afac0 2023-07-21T22:20:05.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.962+0000 7f68f0ff9700 1 -- 172.21.15.151:0/1073405878 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f69000958e0 con 0x5626e70afac0 2023-07-21T22:20:05.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.962+0000 7f6922e8cb80 10 client.25534 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:05.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.962+0000 7f6922e8cb80 10 client.25534 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:05.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.962+0000 7f6922e8cb80 20 client.25534 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:05.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.962+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5626e70c3ff0 0x5626e70c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.962+0000 7f6922e8cb80 4 client.25534 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:05.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.962+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1073405878 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626e6ff4eb0 con 0x5626e70c3ff0 2023-07-21T22:20:05.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.963+0000 7f690d39b700 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5626e70c3ff0 0x5626e70c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.963+0000 7f68f0ff9700 10 client.25534 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:05.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.963+0000 7f690d39b700 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5626e70c3ff0 0x5626e70c6400 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ac76dd2eadbb61 server_cookie=b2ca2bd5a2e1b0cc in_seq=0 out_seq=0 2023-07-21T22:20:05.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f68f0ff9700 1 -- 172.21.15.151:0/1073405878 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5626e6ff4eb0 con 0x5626e70c3ff0 2023-07-21T22:20:05.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f68f0ff9700 10 client.25534 handle_command_reply: tid=0 2023-07-21T22:20:05.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 client.25534 shutdown 2023-07-21T22:20:05.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1073405878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 msgr2=0x5626e70b44d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b44d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6900095ea0 tx=0x7f69000c9fd0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1073405878 shutdown_connections 2023-07-21T22:20:05.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5626e70c3ff0 0x5626e70c6400 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b44d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70b6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f68f0ff9700 0 client.25534 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:05.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1073405878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1073405878 >> 172.21.15.151:0/1073405878 conn(0x5626e709fef0 msgr2=0x5626e70a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.964+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1073405878 shutdown_connections 2023-07-21T22:20:05.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.965+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1073405878 wait complete. 2023-07-21T22:20:05.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.965+0000 7f6922e8cb80 20 client.25534 trim_cache size 0 max 16384 2023-07-21T22:20:05.026 INFO:teuthology.orchestra.run.smithi151.stderr:1900000 of 50000000 tuples (3%) done (elapsed 28.52 s, remaining 721.98 s) 2023-07-21T22:20:05.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.987+0000 7f6922e8cb80 1 Processor -- start 2023-07-21T22:20:05.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.987+0000 7f6922e8cb80 1 -- start start 2023-07-21T22:20:05.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.987+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70aa0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.987+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70b6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.987+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b3610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.987+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e70c6a60 con 0x5626e70aa930 2023-07-21T22:20:05.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.987+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e70b23b0 con 0x5626e70af1b0 2023-07-21T22:20:05.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e70a9330 con 0x5626e70afac0 2023-07-21T22:20:05.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70aa0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70aa0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37564/0 (socket says 172.21.15.151:37564) 2023-07-21T22:20:05.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690d39b700 1 -- 172.21.15.151:0/1629082375 learned_addr learned my addr 172.21.15.151:0/1629082375 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690cb9a700 1 --2- 172.21.15.151:0/1629082375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690db9c700 1 --2- 172.21.15.151:0/1629082375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690d39b700 1 -- 172.21.15.151:0/1629082375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 msgr2=0x5626e70b3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690d39b700 1 --2- 172.21.15.151:0/1629082375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690d39b700 1 -- 172.21.15.151:0/1629082375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 msgr2=0x5626e70b6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690d39b700 1 --2- 172.21.15.151:0/1629082375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70b6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.988+0000 7f690d39b700 1 -- 172.21.15.151:0/1629082375 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626e6e50250 con 0x5626e70aa930 2023-07-21T22:20:05.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.989+0000 7f690d39b700 1 --2- 172.21.15.151:0/1629082375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70aa0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5626e70c6cd0 tx=0x7f6904009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=189c91893bbbc925 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.989+0000 7f68f3fff700 1 -- 172.21.15.151:0/1629082375 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904017070 con 0x5626e70aa930 2023-07-21T22:20:05.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.989+0000 7f68f3fff700 1 -- 172.21.15.151:0/1629082375 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6904018040 con 0x5626e70aa930 2023-07-21T22:20:05.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.989+0000 7f68f3fff700 1 -- 172.21.15.151:0/1629082375 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904010720 con 0x5626e70aa930 2023-07-21T22:20:05.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.990+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1629082375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 msgr2=0x5626e70aa0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.990+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1629082375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70aa0a0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x5626e70c6cd0 tx=0x7f6904009260 comp rx=0 tx=0).stop 2023-07-21T22:20:05.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.990+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1629082375 shutdown_connections 2023-07-21T22:20:05.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.990+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1629082375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70afac0 0x5626e70b3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.990+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1629082375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70aa930 0x5626e70aa0a0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.990+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/1629082375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70b6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.990+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1629082375 >> 172.21.15.151:0/1629082375 conn(0x5626e709fef0 msgr2=0x5626e70a9990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.990+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1629082375 shutdown_connections 2023-07-21T22:20:05.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.990+0000 7f6922e8cb80 1 -- 172.21.15.151:0/1629082375 wait complete. 2023-07-21T22:20:05.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.991+0000 7f6922e8cb80 1 -- start start 2023-07-21T22:20:05.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.991+0000 7f6922e8cb80 1 Processor -- start 2023-07-21T22:20:05.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.991+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70b9e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.991+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70ba3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.991+0000 7f6922e8cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 0x5626e7117e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.991+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e70baba0 con 0x5626e70afac0 2023-07-21T22:20:05.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.991+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e70bad10 con 0x5626e70af1b0 2023-07-21T22:20:05.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.991+0000 7f6922e8cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626e71183f0 con 0x5626e70aa930 2023-07-21T22:20:05.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.991+0000 7f6922e8cb80 10 client.0 _ll_register_callbacks cb 0x7f69000097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:05.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690d39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70b9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690d39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70b9e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46486/0 (socket says 172.21.15.151:46486) 2023-07-21T22:20:05.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690d39b700 1 -- 172.21.15.151:0/714928026 learned_addr learned my addr 172.21.15.151:0/714928026 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690cb9a700 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70ba3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690db9c700 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 0x5626e7117e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690d39b700 1 -- 172.21.15.151:0/714928026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 msgr2=0x5626e70ba3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690d39b700 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70ba3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690d39b700 1 -- 172.21.15.151:0/714928026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 msgr2=0x5626e7117e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690d39b700 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 0x5626e7117e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.992+0000 7f690d39b700 1 -- 172.21.15.151:0/714928026 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6904012170 con 0x5626e70aa930 2023-07-21T22:20:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.993+0000 7f690d39b700 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70b9e90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6904012610 tx=0x7f6904013d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c99d7cb65e5acf8d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.993+0000 7f68f0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:20:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.993+0000 7f68f0ff9700 1 -- 172.21.15.151:0/714928026 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6904017070 con 0x5626e70aa930 2023-07-21T22:20:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.993+0000 7f6922e8cb80 1 -- 172.21.15.151:0/714928026 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f690009d9d0 con 0x5626e70aa930 2023-07-21T22:20:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.993+0000 7f68f0ff9700 1 -- 172.21.15.151:0/714928026 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f69040204c0 con 0x5626e70aa930 2023-07-21T22:20:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.993+0000 7f68f0ff9700 1 -- 172.21.15.151:0/714928026 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6904012b30 con 0x5626e70aa930 2023-07-21T22:20:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.993+0000 7f6922e8cb80 10 client.25540 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.993+0000 7f6922e8cb80 1 -- 172.21.15.151:0/714928026 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x5626e6e282b0 con 0x5626e70aa930 2023-07-21T22:20:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.994+0000 7f68f0ff9700 1 -- 172.21.15.151:0/714928026 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f690009d9d0 con 0x5626e70aa930 2023-07-21T22:20:05.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.994+0000 7f68f0ff9700 1 -- 172.21.15.151:0/714928026 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6904030060 con 0x5626e70aa930 2023-07-21T22:20:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.994+0000 7f6922e8cb80 10 client.25540 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.994+0000 7f6922e8cb80 10 client.25540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.994+0000 7f6922e8cb80 20 client.25540 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.994+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5626e7119bd0 0x5626e711bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.994+0000 7f6922e8cb80 4 client.25540 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:20:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.994+0000 7f6922e8cb80 1 -- 172.21.15.151:0/714928026 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5626e6fb7050 con 0x5626e7119bd0 2023-07-21T22:20:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.995+0000 7f690cb9a700 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5626e7119bd0 0x5626e711bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.995+0000 7f690cb9a700 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5626e7119bd0 0x5626e711bfe0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=614ecd3b73ce301c server_cookie=d9e517efb77c2b5f in_seq=0 out_seq=0 2023-07-21T22:20:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.995+0000 7f68f0ff9700 10 client.25540 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f68f0ff9700 1 -- 172.21.15.151:0/714928026 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5626e6fb7050 con 0x5626e7119bd0 2023-07-21T22:20:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f68f0ff9700 10 client.25540 handle_command_reply: tid=0 2023-07-21T22:20:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 client.25540 shutdown 2023-07-21T22:20:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 -- 172.21.15.151:0/714928026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 msgr2=0x5626e70b9e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70b9e90 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6904012610 tx=0x7f6904013d00 comp rx=0 tx=0).stop 2023-07-21T22:20:05.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 -- 172.21.15.151:0/714928026 shutdown_connections 2023-07-21T22:20:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5626e7119bd0 0x5626e711bfe0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5626e70afac0 0x5626e7117e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5626e70aa930 0x5626e70b9e90 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f68f0ff9700 0 client.25540 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 --2- 172.21.15.151:0/714928026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626e70af1b0 0x5626e70ba3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 -- 172.21.15.151:0/714928026 >> 172.21.15.151:0/714928026 conn(0x5626e709fef0 msgr2=0x5626e70aa220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 -- 172.21.15.151:0/714928026 shutdown_connections 2023-07-21T22:20:05.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 1 -- 172.21.15.151:0/714928026 wait complete. 2023-07-21T22:20:05.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.996+0000 7f6922e8cb80 20 client.25540 trim_cache size 0 max 16384 2023-07-21T22:20:05.047 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:20:05.047 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "no active scrubs running", 2023-07-21T22:20:05.047 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": {} 2023-07-21T22:20:05.047 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:20:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 -- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f68f40a13e0 msgr2=0x7f68f40a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f68f40a13e0 0x7f68f40a3890 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f68f8009990 tx=0x7f68f8004600 comp rx=0 tx=0).stop 2023-07-21T22:20:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 -- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f690810a070 msgr2=0x7f69081a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f690810a070 0x7f69081a3d50 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f690000ef30 tx=0x7f690000c3a0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 -- 172.21.15.151:0/3973972986 shutdown_connections 2023-07-21T22:20:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f68f40a13e0 0x7f68f40a3890 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f690810a070 0x7f69081a3d50 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6908100ca0 0x7f69080fe8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 --2- 172.21.15.151:0/3973972986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69081015b0 0x7f69080fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 -- 172.21.15.151:0/3973972986 >> 172.21.15.151:0/3973972986 conn(0x7f69080fa4b0 msgr2=0x7f690810c290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 -- 172.21.15.151:0/3973972986 shutdown_connections 2023-07-21T22:20:05.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:04.997+0000 7f690f5ff700 1 -- 172.21.15.151:0/3973972986 wait complete. 2023-07-21T22:20:05.062 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-21T22:20:05.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:20:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.238+0000 7f1e2f59e700 1 -- 172.21.15.151:0/2706194010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 msgr2=0x7f1e3010c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.238+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/2706194010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 0x7f1e3010c7a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f1e2800b0a0 tx=0x7f1e2800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.238+0000 7f1e2f59e700 1 -- 172.21.15.151:0/2706194010 shutdown_connections 2023-07-21T22:20:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.238+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/2706194010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 0x7f1e3010c7a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.238+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/2706194010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30104a30 0x7f1e30104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.238+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/2706194010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e30067670 0x7f1e30067ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.238+0000 7f1e2f59e700 1 -- 172.21.15.151:0/2706194010 >> 172.21.15.151:0/2706194010 conn(0x7f1e30074a30 msgr2=0x7f1e30074e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.238+0000 7f1e2f59e700 1 -- 172.21.15.151:0/2706194010 shutdown_connections 2023-07-21T22:20:05.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.238+0000 7f1e2f59e700 1 -- 172.21.15.151:0/2706194010 wait complete. 2023-07-21T22:20:05.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.239+0000 7f1e2f59e700 1 Processor -- start 2023-07-21T22:20:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2f59e700 1 -- start start 2023-07-21T22:20:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2f59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e30067670 0x7f1e300ff570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 0x7f1e300ffab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30104a30 0x7f1e301a3a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2f59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301002e0 con 0x7f1e30068000 2023-07-21T22:20:05.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2f59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301a3f90 con 0x7f1e30067670 2023-07-21T22:20:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2f59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e301a40d0 con 0x7f1e30104a30 2023-07-21T22:20:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 0x7f1e300ffab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 0x7f1e300ffab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37584/0 (socket says 172.21.15.151:37584) 2023-07-21T22:20:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2dd9b700 1 -- 172.21.15.151:0/723934625 learned_addr learned my addr 172.21.15.151:0/723934625 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2e59c700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e30067670 0x7f1e300ff570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.240+0000 7f1e2ed9d700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30104a30 0x7f1e301a3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e2dd9b700 1 -- 172.21.15.151:0/723934625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30104a30 msgr2=0x7f1e301a3a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e2dd9b700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30104a30 0x7f1e301a3a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e2dd9b700 1 -- 172.21.15.151:0/723934625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e30067670 msgr2=0x7f1e300ff570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e2dd9b700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e30067670 0x7f1e300ff570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e2dd9b700 1 -- 172.21.15.151:0/723934625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e28009d00 con 0x7f1e30068000 2023-07-21T22:20:05.288 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e2dd9b700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 0x7f1e300ffab0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400e9a0 tx=0x7f1e2400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e1f7fe700 1 -- 172.21.15.151:0/723934625 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24009790 con 0x7f1e30068000 2023-07-21T22:20:05.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e1f7fe700 1 -- 172.21.15.151:0/723934625 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1e24010430 con 0x7f1e30068000 2023-07-21T22:20:05.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e301a4330 con 0x7f1e30068000 2023-07-21T22:20:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.241+0000 7f1e1f7fe700 1 -- 172.21.15.151:0/723934625 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2400cea0 con 0x7f1e30068000 2023-07-21T22:20:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.242+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e301a4810 con 0x7f1e30068000 2023-07-21T22:20:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.243+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e30067220 con 0x7f1e30068000 2023-07-21T22:20:05.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.245+0000 7f1e1f7fe700 1 -- 172.21.15.151:0/723934625 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f1e240105a0 con 0x7f1e30068000 2023-07-21T22:20:05.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.247+0000 7f1e1f7fe700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1e180a14d0 0x7f1e180a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.247+0000 7f1e1f7fe700 1 -- 172.21.15.151:0/723934625 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1e24014070 con 0x7f1e30068000 2023-07-21T22:20:05.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.247+0000 7f1e2e59c700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1e180a14d0 0x7f1e180a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.248+0000 7f1e2e59c700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1e180a14d0 0x7f1e180a3980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e20007b60 tx=0x7f1e200073d0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.252+0000 7f1e1f7fe700 1 -- 172.21.15.151:0/723934625 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f1e24051770 con 0x7f1e30068000 2023-07-21T22:20:05.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.572+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e30100aa0 con 0x7f1e30068000 2023-07-21T22:20:05.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.573+0000 7f1e1f7fe700 1 -- 172.21.15.151:0/723934625 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) v1 ==== 94+0+10822 (secure 0 0 0) 0x7f1e240963e0 con 0x7f1e30068000 2023-07-21T22:20:05.618 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:20:05.618 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:19:39.254243+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:20:05.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1e180a14d0 msgr2=0x7f1e180a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1e180a14d0 0x7f1e180a3980 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f1e20007b60 tx=0x7f1e200073d0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 msgr2=0x7f1e300ffab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 0x7f1e300ffab0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400e9a0 tx=0x7f1e2400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 shutdown_connections 2023-07-21T22:20:05.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1e180a14d0 0x7f1e180a3980 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e30067670 0x7f1e300ff570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1e30104a30 0x7f1e301a3a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 --2- 172.21.15.151:0/723934625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1e30068000 0x7f1e300ffab0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 >> 172.21.15.151:0/723934625 conn(0x7f1e30074a30 msgr2=0x7f1e300fdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 shutdown_connections 2023-07-21T22:20:05.624 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.576+0000 7f1e2f59e700 1 -- 172.21.15.151:0/723934625 wait complete. 2023-07-21T22:20:05.625 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 27 2023-07-21T22:20:05.642 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-21T22:20:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.855+0000 7f552ddff700 1 -- 172.21.15.151:0/2311791352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528106fb0 msgr2=0x7f552810eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.855+0000 7f552ddff700 1 --2- 172.21.15.151:0/2311791352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528106fb0 0x7f552810eb80 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f552000b0a0 tx=0x7f552000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.855+0000 7f552ddff700 1 -- 172.21.15.151:0/2311791352 shutdown_connections 2023-07-21T22:20:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.855+0000 7f552ddff700 1 --2- 172.21.15.151:0/2311791352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528106fb0 0x7f552810eb80 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.900 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.855+0000 7f552ddff700 1 --2- 172.21.15.151:0/2311791352 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5528101f70 0x7f5528102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.855+0000 7f552ddff700 1 --2- 172.21.15.151:0/2311791352 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528102910 0x7f55281068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.855+0000 7f552ddff700 1 -- 172.21.15.151:0/2311791352 >> 172.21.15.151:0/2311791352 conn(0x7f55280fd7e0 msgr2=0x7f55280ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.856+0000 7f552ddff700 1 -- 172.21.15.151:0/2311791352 shutdown_connections 2023-07-21T22:20:05.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.856+0000 7f552ddff700 1 -- 172.21.15.151:0/2311791352 wait complete. 2023-07-21T22:20:05.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.857+0000 7f552ddff700 1 Processor -- start 2023-07-21T22:20:05.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.857+0000 7f552ddff700 1 -- start start 2023-07-21T22:20:05.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.858+0000 7f552ddff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528101f70 0x7f552810e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.858+0000 7f552ddff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5528102910 0x7f552810b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.858+0000 7f552ddff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528106fb0 0x7f552810bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.858+0000 7f552ddff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552810c310 con 0x7f5528102910 2023-07-21T22:20:05.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.858+0000 7f552ddff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552810c480 con 0x7f5528101f70 2023-07-21T22:20:05.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.858+0000 7f552ddff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f552810c640 con 0x7f5528106fb0 2023-07-21T22:20:05.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.858+0000 7f55277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528101f70 0x7f552810e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.859+0000 7f55277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528101f70 0x7f552810e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52306/0 (socket says 172.21.15.151:52306) 2023-07-21T22:20:05.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.859+0000 7f55277fe700 1 -- 172.21.15.151:0/1856372552 learned_addr learned my addr 172.21.15.151:0/1856372552 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.859+0000 7f5527fff700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528106fb0 0x7f552810bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.859+0000 7f55277fe700 1 -- 172.21.15.151:0/1856372552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528106fb0 msgr2=0x7f552810bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.859+0000 7f55277fe700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528106fb0 0x7f552810bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.859+0000 7f55277fe700 1 -- 172.21.15.151:0/1856372552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5528102910 msgr2=0x7f552810b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.859+0000 7f55277fe700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5528102910 0x7f552810b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.859+0000 7f55277fe700 1 -- 172.21.15.151:0/1856372552 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5520009d00 con 0x7f5528101f70 2023-07-21T22:20:05.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.859+0000 7f5527fff700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528106fb0 0x7f552810bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:05.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.860+0000 7f55277fe700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528101f70 0x7f552810e720 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f551800e9a0 tx=0x7f551800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.860+0000 7f5524ff9700 1 -- 172.21.15.151:0/1856372552 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518009790 con 0x7f5528101f70 2023-07-21T22:20:05.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.860+0000 7f5524ff9700 1 -- 172.21.15.151:0/1856372552 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5518010430 con 0x7f5528101f70 2023-07-21T22:20:05.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.860+0000 7f552ddff700 1 -- 172.21.15.151:0/1856372552 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55281a8ae0 con 0x7f5528101f70 2023-07-21T22:20:05.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.860+0000 7f5524ff9700 1 -- 172.21.15.151:0/1856372552 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518018680 con 0x7f5528101f70 2023-07-21T22:20:05.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.860+0000 7f552ddff700 1 -- 172.21.15.151:0/1856372552 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55281a9010 con 0x7f5528101f70 2023-07-21T22:20:05.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.866+0000 7f5524ff9700 1 -- 172.21.15.151:0/1856372552 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f55180105a0 con 0x7f5528101f70 2023-07-21T22:20:05.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.868+0000 7f5524ff9700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f55100a1460 0x7f55100a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.868+0000 7f5524ff9700 1 -- 172.21.15.151:0/1856372552 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5518014070 con 0x7f5528101f70 2023-07-21T22:20:05.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.868+0000 7f5526ffd700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f55100a1460 0x7f55100a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.869+0000 7f5526ffd700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f55100a1460 0x7f55100a3910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f552810cfc0 tx=0x7f551c005bf0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.869+0000 7f55416fbb80 1 Processor -- start 2023-07-21T22:20:05.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.869+0000 7f55416fbb80 1 -- start start 2023-07-21T22:20:05.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.870+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba0d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.870+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0dac0 0x55c48ba08350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.870+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba08930 0x55c48ba08da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.870+0000 7f55416fbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48b90dcb0 con 0x55c48ba0d1b0 2023-07-21T22:20:05.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.870+0000 7f55416fbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48b960a40 con 0x55c48ba0dac0 2023-07-21T22:20:05.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.870+0000 7f55416fbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48b959ed0 con 0x55c48ba08930 2023-07-21T22:20:05.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.870+0000 7f55277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba0d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.870+0000 7f55277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba0d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60850/0 (socket says 172.21.15.151:60850) 2023-07-21T22:20:05.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.870+0000 7f55277fe700 1 -- 172.21.15.151:0/218585579 learned_addr learned my addr 172.21.15.151:0/218585579 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f5526ffd700 1 --2- 172.21.15.151:0/218585579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0dac0 0x55c48ba08350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f5527fff700 1 --2- 172.21.15.151:0/218585579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba08930 0x55c48ba08da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f55277fe700 1 -- 172.21.15.151:0/218585579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba08930 msgr2=0x55c48ba08da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f55277fe700 1 --2- 172.21.15.151:0/218585579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba08930 0x55c48ba08da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f55277fe700 1 -- 172.21.15.151:0/218585579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0dac0 msgr2=0x55c48ba08350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f55277fe700 1 --2- 172.21.15.151:0/218585579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0dac0 0x55c48ba08350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f55277fe700 1 -- 172.21.15.151:0/218585579 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c48b787de0 con 0x55c48ba0d1b0 2023-07-21T22:20:05.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f55277fe700 1 --2- 172.21.15.151:0/218585579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba0d580 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5518096520 tx=0x7f5518099b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87b385e117692cc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f550dffb700 1 -- 172.21.15.151:0/218585579 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518010880 con 0x55c48ba0d1b0 2023-07-21T22:20:05.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f550dffb700 1 -- 172.21.15.151:0/218585579 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f551809a020 con 0x55c48ba0d1b0 2023-07-21T22:20:05.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.871+0000 7f550dffb700 1 -- 172.21.15.151:0/218585579 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180a21e0 con 0x55c48ba0d1b0 2023-07-21T22:20:05.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.872+0000 7f55416fbb80 1 -- 172.21.15.151:0/218585579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 msgr2=0x55c48ba0d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.872+0000 7f55416fbb80 1 --2- 172.21.15.151:0/218585579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba0d580 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5518096520 tx=0x7f5518099b60 comp rx=0 tx=0).stop 2023-07-21T22:20:05.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.872+0000 7f55416fbb80 1 -- 172.21.15.151:0/218585579 shutdown_connections 2023-07-21T22:20:05.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.872+0000 7f55416fbb80 1 --2- 172.21.15.151:0/218585579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba08930 0x55c48ba08da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.872+0000 7f55416fbb80 1 --2- 172.21.15.151:0/218585579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba0d580 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.872+0000 7f55416fbb80 1 --2- 172.21.15.151:0/218585579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0dac0 0x55c48ba08350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.872+0000 7f55416fbb80 1 -- 172.21.15.151:0/218585579 >> 172.21.15.151:0/218585579 conn(0x55c48b9fdef0 msgr2=0x55c48ba03830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.872+0000 7f55416fbb80 1 -- 172.21.15.151:0/218585579 shutdown_connections 2023-07-21T22:20:05.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.872+0000 7f55416fbb80 1 -- 172.21.15.151:0/218585579 wait complete. 2023-07-21T22:20:05.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.873+0000 7f55416fbb80 1 -- start start 2023-07-21T22:20:05.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.873+0000 7f55416fbb80 1 Processor -- start 2023-07-21T22:20:05.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba08930 0x55c48ba14c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba11e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba125c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55416fbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48b8f9ac0 con 0x55c48ba0d1b0 2023-07-21T22:20:05.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55416fbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48b8f97c0 con 0x55c48ba08930 2023-07-21T22:20:05.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55416fbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48b7dd920 con 0x55c48ba0dac0 2023-07-21T22:20:05.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55416fbb80 10 client.0 _ll_register_callbacks cb 0x55c48b8f7760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:05.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba08930 0x55c48ba14c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba08930 0x55c48ba14c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52328/0 (socket says 172.21.15.151:52328) 2023-07-21T22:20:05.928 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f55277fe700 1 -- 172.21.15.151:0/2725174751 learned_addr learned my addr 172.21.15.151:0/2725174751 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f5526ffd700 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba11e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.874+0000 7f5527fff700 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba125c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f55277fe700 1 -- 172.21.15.151:0/2725174751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 msgr2=0x55c48ba125c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.929 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f55277fe700 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba125c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.930 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f55277fe700 1 -- 172.21.15.151:0/2725174751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 msgr2=0x55c48ba11e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.930 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f55277fe700 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba11e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.930 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f55277fe700 1 -- 172.21.15.151:0/2725174751 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55281a9010 con 0x55c48ba08930 2023-07-21T22:20:05.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f5527fff700 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:05.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f55277fe700 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba08930 0x55c48ba14c00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f55180ca880 tx=0x7f5518005bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5859d0efffe29699 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f5506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:20:05.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f5506ffd700 1 -- 172.21.15.151:0/2725174751 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55180a2470 con 0x55c48ba08930 2023-07-21T22:20:05.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f55416fbb80 1 -- 172.21.15.151:0/2725174751 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c48b8b34f0 con 0x55c48ba08930 2023-07-21T22:20:05.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f5506ffd700 1 -- 172.21.15.151:0/2725174751 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f55180b8180 con 0x55c48ba08930 2023-07-21T22:20:05.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f5506ffd700 1 -- 172.21.15.151:0/2725174751 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55180b8340 con 0x55c48ba08930 2023-07-21T22:20:05.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.875+0000 7f55416fbb80 10 client.25520 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:05.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.876+0000 7f55416fbb80 1 -- 172.21.15.151:0/2725174751 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c48b770c60 con 0x55c48ba08930 2023-07-21T22:20:05.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.876+0000 7f5506ffd700 1 -- 172.21.15.151:0/2725174751 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c48b8b34f0 con 0x55c48ba08930 2023-07-21T22:20:05.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.876+0000 7f5506ffd700 1 -- 172.21.15.151:0/2725174751 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f55180add20 con 0x55c48ba08930 2023-07-21T22:20:05.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.876+0000 7f55416fbb80 10 client.25520 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:05.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.876+0000 7f55416fbb80 10 client.25520 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:20:05.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.876+0000 7f55416fbb80 20 client.25520 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:05.934 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.876+0000 7f55416fbb80 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55c48ba220a0 0x55c48ba244b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.876+0000 7f55416fbb80 4 client.25520 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:05.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.876+0000 7f55416fbb80 1 -- 172.21.15.151:0/2725174751 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c48b952eb0 con 0x55c48ba220a0 2023-07-21T22:20:05.935 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.877+0000 7f5526ffd700 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55c48ba220a0 0x55c48ba244b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.877+0000 7f5506ffd700 10 client.25520 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:20:05.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.877+0000 7f5526ffd700 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55c48ba220a0 0x55c48ba244b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3cd3461731f10afc server_cookie=95c59799e7b405b0 in_seq=0 out_seq=0 2023-07-21T22:20:05.936 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f5506ffd700 1 -- 172.21.15.151:0/2725174751 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c48b952eb0 con 0x55c48ba220a0 2023-07-21T22:20:05.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f5506ffd700 10 client.25520 handle_command_reply: tid=0 2023-07-21T22:20:05.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 client.25520 shutdown 2023-07-21T22:20:05.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 -- 172.21.15.151:0/2725174751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba08930 msgr2=0x55c48ba14c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.937 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba08930 0x55c48ba14c00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f55180ca880 tx=0x7f5518005bb0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 -- 172.21.15.151:0/2725174751 shutdown_connections 2023-07-21T22:20:05.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55c48ba220a0 0x55c48ba244b0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba08930 0x55c48ba14c00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.938 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba125c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 --2- 172.21.15.151:0/2725174751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba0d1b0 0x55c48ba11e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 -- 172.21.15.151:0/2725174751 >> 172.21.15.151:0/2725174751 conn(0x55c48b9fdef0 msgr2=0x55c48ba03420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f5506ffd700 0 client.25520 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:20:05.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 -- 172.21.15.151:0/2725174751 shutdown_connections 2023-07-21T22:20:05.939 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.878+0000 7f55416fbb80 1 -- 172.21.15.151:0/2725174751 wait complete. 2023-07-21T22:20:05.940 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.879+0000 7f55416fbb80 20 client.25520 trim_cache size 0 max 16384 2023-07-21T22:20:05.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.897+0000 7f55416fbb80 1 Processor -- start 2023-07-21T22:20:05.942 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55416fbb80 1 -- start start 2023-07-21T22:20:05.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba194c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 0x55c48ba1dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.945 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba147a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55416fbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48ba09670 con 0x55c48ba08930 2023-07-21T22:20:05.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55416fbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48ba10410 con 0x55c48ba0d1b0 2023-07-21T22:20:05.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55416fbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48ba19a00 con 0x55c48ba0dac0 2023-07-21T22:20:05.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba194c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba194c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60866/0 (socket says 172.21.15.151:60866) 2023-07-21T22:20:05.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f55277fe700 1 -- 172.21.15.151:0/978105584 learned_addr learned my addr 172.21.15.151:0/978105584 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.898+0000 7f5527fff700 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba147a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f5526ffd700 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 0x55c48ba1dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f55277fe700 1 -- 172.21.15.151:0/978105584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 msgr2=0x55c48ba147a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f55277fe700 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba147a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f55277fe700 1 -- 172.21.15.151:0/978105584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 msgr2=0x55c48ba1dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f55277fe700 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 0x55c48ba1dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f55277fe700 1 -- 172.21.15.151:0/978105584 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c48b7ae250 con 0x55c48ba08930 2023-07-21T22:20:05.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f5527fff700 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:05.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f55277fe700 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba194c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5518098370 tx=0x7f5518099b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331db1fc78aa6038 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f550e7fc700 1 -- 172.21.15.151:0/978105584 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551809e050 con 0x55c48ba08930 2023-07-21T22:20:05.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f550e7fc700 1 -- 172.21.15.151:0/978105584 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f55180a2470 con 0x55c48ba08930 2023-07-21T22:20:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.899+0000 7f550e7fc700 1 -- 172.21.15.151:0/978105584 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5518096190 con 0x55c48ba08930 2023-07-21T22:20:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.900+0000 7f55416fbb80 1 -- 172.21.15.151:0/978105584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 msgr2=0x55c48ba194c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.900+0000 7f55416fbb80 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba194c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f5518098370 tx=0x7f5518099b60 comp rx=0 tx=0).stop 2023-07-21T22:20:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.900+0000 7f55416fbb80 1 -- 172.21.15.151:0/978105584 shutdown_connections 2023-07-21T22:20:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.900+0000 7f55416fbb80 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba147a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.900+0000 7f55416fbb80 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba194c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.900+0000 7f55416fbb80 1 --2- 172.21.15.151:0/978105584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 0x55c48ba1dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.900+0000 7f55416fbb80 1 -- 172.21.15.151:0/978105584 >> 172.21.15.151:0/978105584 conn(0x55c48b9fdef0 msgr2=0x55c48ba1e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.900+0000 7f55416fbb80 1 -- 172.21.15.151:0/978105584 shutdown_connections 2023-07-21T22:20:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.900+0000 7f55416fbb80 1 -- 172.21.15.151:0/978105584 wait complete. 2023-07-21T22:20:05.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.901+0000 7f55416fbb80 1 -- start start 2023-07-21T22:20:05.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.901+0000 7f55416fbb80 1 Processor -- start 2023-07-21T22:20:05.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.901+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba18cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.901+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 0x55c48ba19230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.901+0000 7f55416fbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba174a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.901+0000 7f55416fbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48ba17aa0 con 0x55c48ba08930 2023-07-21T22:20:05.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.901+0000 7f55416fbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48ba17c10 con 0x55c48ba0d1b0 2023-07-21T22:20:05.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.901+0000 7f55416fbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c48ba17dd0 con 0x55c48ba0dac0 2023-07-21T22:20:05.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f55416fbb80 10 client.0 _ll_register_callbacks cb 0x7f5518099df0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:05.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f55277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba18cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f55277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba18cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60868/0 (socket says 172.21.15.151:60868) 2023-07-21T22:20:05.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f55277fe700 1 -- 172.21.15.151:0/615886960 learned_addr learned my addr 172.21.15.151:0/615886960 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:05.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f5526ffd700 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 0x55c48ba19230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f5527fff700 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba174a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f55277fe700 1 -- 172.21.15.151:0/615886960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 msgr2=0x55c48ba174a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f55277fe700 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba174a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f55277fe700 1 -- 172.21.15.151:0/615886960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 msgr2=0x55c48ba19230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:05.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f55277fe700 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 0x55c48ba19230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f55277fe700 1 -- 172.21.15.151:0/615886960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f552810f3c0 con 0x55c48ba08930 2023-07-21T22:20:05.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.902+0000 7f5526ffd700 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 0x55c48ba19230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:05.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.903+0000 7f55277fe700 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba18cf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5518095eb0 tx=0x7f55180962c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e728b6e6ab2bf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:05.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.903+0000 7f5506ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:20:05.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.903+0000 7f5506ffd700 1 -- 172.21.15.151:0/615886960 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f551809e050 con 0x55c48ba08930 2023-07-21T22:20:05.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.903+0000 7f5506ffd700 1 -- 172.21.15.151:0/615886960 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f55180b8180 con 0x55c48ba08930 2023-07-21T22:20:05.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.903+0000 7f55416fbb80 1 -- 172.21.15.151:0/615886960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f551809a020 con 0x55c48ba08930 2023-07-21T22:20:05.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.903+0000 7f5506ffd700 1 -- 172.21.15.151:0/615886960 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f55180b8340 con 0x55c48ba08930 2023-07-21T22:20:05.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.903+0000 7f55416fbb80 10 client.15762 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:05.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.903+0000 7f55416fbb80 1 -- 172.21.15.151:0/615886960 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c48b770c60 con 0x55c48ba08930 2023-07-21T22:20:05.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.903+0000 7f5506ffd700 1 -- 172.21.15.151:0/615886960 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f551809a020 con 0x55c48ba08930 2023-07-21T22:20:05.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.904+0000 7f5506ffd700 1 -- 172.21.15.151:0/615886960 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f55180add20 con 0x55c48ba08930 2023-07-21T22:20:05.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.904+0000 7f55416fbb80 10 client.15762 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:05.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.904+0000 7f55416fbb80 10 client.15762 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:20:05.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.904+0000 7f55416fbb80 20 client.15762 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:05.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.904+0000 7f55416fbb80 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55c48ba76ca0 0x55c48ba79080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:05.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.904+0000 7f55416fbb80 4 client.15762 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:20:05.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.904+0000 7f55416fbb80 1 -- 172.21.15.151:0/615886960 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c48b915050 con 0x55c48ba76ca0 2023-07-21T22:20:05.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.904+0000 7f5526ffd700 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55c48ba76ca0 0x55c48ba79080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:05.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f5526ffd700 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55c48ba76ca0 0x55c48ba79080 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ace9bebe982f5d1f server_cookie=d91cf2f012b27891 in_seq=0 out_seq=0 2023-07-21T22:20:05.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f5506ffd700 10 client.15762 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:20:05.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f5506ffd700 1 -- 172.21.15.151:0/615886960 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c48b915050 con 0x55c48ba76ca0 2023-07-21T22:20:05.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f5506ffd700 10 client.15762 handle_command_reply: tid=0 2023-07-21T22:20:05.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 client.15762 shutdown 2023-07-21T22:20:05.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 -- 172.21.15.151:0/615886960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 msgr2=0x55c48ba18cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba18cf0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f5518095eb0 tx=0x7f55180962c0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 -- 172.21.15.151:0/615886960 shutdown_connections 2023-07-21T22:20:05.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55c48ba76ca0 0x55c48ba79080 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c48ba0dac0 0x55c48ba174a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c48ba08930 0x55c48ba18cf0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 --2- 172.21.15.151:0/615886960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c48ba0d1b0 0x55c48ba19230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 -- 172.21.15.151:0/615886960 >> 172.21.15.151:0/615886960 conn(0x55c48b9fdef0 msgr2=0x55c48ba06a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f5506ffd700 0 client.15762 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:20:05.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.905+0000 7f55416fbb80 1 -- 172.21.15.151:0/615886960 shutdown_connections 2023-07-21T22:20:05.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f55416fbb80 1 -- 172.21.15.151:0/615886960 wait complete. 2023-07-21T22:20:05.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f55416fbb80 20 client.15762 trim_cache size 0 max 16384 2023-07-21T22:20:05.962 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:20:05.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 -- 172.21.15.151:0/1856372552 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f55100a1460 msgr2=0x7f55100a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f55100a1460 0x7f55100a3910 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f552810cfc0 tx=0x7f551c005bf0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 -- 172.21.15.151:0/1856372552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528101f70 msgr2=0x7f552810e720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:05.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528101f70 0x7f552810e720 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f551800e9a0 tx=0x7f551800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 -- 172.21.15.151:0/1856372552 shutdown_connections 2023-07-21T22:20:05.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f55100a1460 0x7f55100a3910 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5528101f70 0x7f552810e720 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5528106fb0 0x7f552810bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 --2- 172.21.15.151:0/1856372552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5528102910 0x7f552810b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:05.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.906+0000 7f552ddff700 1 -- 172.21.15.151:0/1856372552 >> 172.21.15.151:0/1856372552 conn(0x7f55280fd7e0 msgr2=0x7f55280fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:05.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.907+0000 7f552ddff700 1 -- 172.21.15.151:0/1856372552 shutdown_connections 2023-07-21T22:20:05.966 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:05.907+0000 7f552ddff700 1 -- 172.21.15.151:0/1856372552 wait complete. 2023-07-21T22:20:05.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-21T22:20:06.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.159+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/1372494576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 msgr2=0x7f1b28102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.159+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/1372494576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 0x7f1b28102350 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f1b180099c0 tx=0x7f1b18009cd0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.159+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/1372494576 shutdown_connections 2023-07-21T22:20:06.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.159+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/1372494576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b28106fc0 0x7f1b2810eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.159+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/1372494576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 0x7f1b28102350 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.159+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/1372494576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b28102920 0x7f1b281068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.159+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/1372494576 >> 172.21.15.151:0/1372494576 conn(0x7f1b280fd830 msgr2=0x7f1b280ffc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.159+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/1372494576 shutdown_connections 2023-07-21T22:20:06.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.159+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/1372494576 wait complete. 2023-07-21T22:20:06.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.160+0000 7f1b2e3ff700 1 Processor -- start 2023-07-21T22:20:06.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b2e3ff700 1 -- start start 2023-07-21T22:20:06.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b2e3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 0x7f1b28197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b2e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b28102920 0x7f1b28198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b2e3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b28106fc0 0x7f1b2819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b2e3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2819cda0 con 0x7f1b28101f80 2023-07-21T22:20:06.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b2e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2819cf10 con 0x7f1b28102920 2023-07-21T22:20:06.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b2e3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b2819d0d0 con 0x7f1b28106fc0 2023-07-21T22:20:06.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 0x7f1b28197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 0x7f1b28197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60888/0 (socket says 172.21.15.151:60888) 2023-07-21T22:20:06.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.161+0000 7f1b27fff700 1 -- 172.21.15.151:0/43332492 learned_addr learned my addr 172.21.15.151:0/43332492 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b2c99c700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b28106fc0 0x7f1b2819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b277fe700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b28102920 0x7f1b28198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b27fff700 1 -- 172.21.15.151:0/43332492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b28106fc0 msgr2=0x7f1b2819c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b27fff700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b28106fc0 0x7f1b2819c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b27fff700 1 -- 172.21.15.151:0/43332492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b28102920 msgr2=0x7f1b28198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b27fff700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b28102920 0x7f1b28198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b27fff700 1 -- 172.21.15.151:0/43332492 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b180095f0 con 0x7f1b28101f80 2023-07-21T22:20:06.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b2c99c700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b28106fc0 0x7f1b2819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:06.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b277fe700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b28102920 0x7f1b28198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:06.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b27fff700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 0x7f1b28197dc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009f50 tx=0x7f1b18005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b257fa700 1 -- 172.21.15.151:0/43332492 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1801d070 con 0x7f1b28101f80 2023-07-21T22:20:06.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b257fa700 1 -- 172.21.15.151:0/43332492 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b180040b0 con 0x7f1b28101f80 2023-07-21T22:20:06.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/43332492 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b2819d350 con 0x7f1b28101f80 2023-07-21T22:20:06.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.162+0000 7f1b257fa700 1 -- 172.21.15.151:0/43332492 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18022cf0 con 0x7f1b28101f80 2023-07-21T22:20:06.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.163+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/43332492 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b281a4bf0 con 0x7f1b28101f80 2023-07-21T22:20:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.166+0000 7f1b257fa700 1 -- 172.21.15.151:0/43332492 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f1b18022470 con 0x7f1b28101f80 2023-07-21T22:20:06.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.167+0000 7f1b41cbab80 1 Processor -- start 2023-07-21T22:20:06.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.167+0000 7f1b41cbab80 1 -- start start 2023-07-21T22:20:06.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c772809580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772809ac0 0x55c772804350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c772804da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c772709cb0 con 0x55c772809ac0 2023-07-21T22:20:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c77275ca40 con 0x55c7728091b0 2023-07-21T22:20:06.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c772755ed0 con 0x55c772804930 2023-07-21T22:20:06.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772809ac0 0x55c772804350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c772804da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c772804da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54332/0 (socket says 172.21.15.151:54332) 2023-07-21T22:20:06.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772809ac0 0x55c772804350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60896/0 (socket says 172.21.15.151:60896) 2023-07-21T22:20:06.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b277fe700 1 -- 172.21.15.151:0/4038177752 learned_addr learned my addr 172.21.15.151:0/4038177752 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.168+0000 7f1b2c99c700 1 --2- 172.21.15.151:0/4038177752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c772809580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b257fa700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1b100a1460 0x7f1b100a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b277fe700 1 -- 172.21.15.151:0/4038177752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 msgr2=0x55c772809580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b277fe700 1 --2- 172.21.15.151:0/4038177752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c772809580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b277fe700 1 -- 172.21.15.151:0/4038177752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772809ac0 msgr2=0x55c772804350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b277fe700 1 --2- 172.21.15.151:0/4038177752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772809ac0 0x55c772804350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b277fe700 1 -- 172.21.15.151:0/4038177752 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c772583de0 con 0x55c772804930 2023-07-21T22:20:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b257fa700 1 -- 172.21.15.151:0/43332492 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1b180ce340 con 0x7f1b28101f80 2023-07-21T22:20:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b2c99c700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1b100a1460 0x7f1b100a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b277fe700 1 --2- 172.21.15.151:0/4038177752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c772804da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009c40 tx=0x7f1b1c009f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2948dccfb80eb020 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.169+0000 7f1b0e7fc700 1 -- 172.21.15.151:0/4038177752 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c00eb00 con 0x55c772804930 2023-07-21T22:20:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.170+0000 7f1b2c99c700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1b100a1460 0x7f1b100a3910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b200094f0 tx=0x7f1b2000b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.170+0000 7f1b0e7fc700 1 -- 172.21.15.151:0/4038177752 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b1c004cc0 con 0x55c772804930 2023-07-21T22:20:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.170+0000 7f1b0e7fc700 1 -- 172.21.15.151:0/4038177752 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1c005520 con 0x55c772804930 2023-07-21T22:20:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.170+0000 7f1b41cbab80 1 -- 172.21.15.151:0/4038177752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 msgr2=0x55c772804da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.170+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/4038177752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c772804da0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1b1c009c40 tx=0x7f1b1c009f50 comp rx=0 tx=0).stop 2023-07-21T22:20:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.171+0000 7f1b41cbab80 1 -- 172.21.15.151:0/4038177752 shutdown_connections 2023-07-21T22:20:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.171+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/4038177752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c772809580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.171+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/4038177752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c772804da0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.171+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/4038177752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772809ac0 0x55c772804350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.171+0000 7f1b41cbab80 1 -- 172.21.15.151:0/4038177752 >> 172.21.15.151:0/4038177752 conn(0x55c7727f9ef0 msgr2=0x55c7727ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.171+0000 7f1b41cbab80 1 -- 172.21.15.151:0/4038177752 shutdown_connections 2023-07-21T22:20:06.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.171+0000 7f1b41cbab80 1 -- 172.21.15.151:0/4038177752 wait complete. 2023-07-21T22:20:06.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.171+0000 7f1b41cbab80 1 -- start start 2023-07-21T22:20:06.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.171+0000 7f1b41cbab80 1 Processor -- start 2023-07-21T22:20:06.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c77280de10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772809ac0 0x55c77280e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7726f5ac0 con 0x55c772804930 2023-07-21T22:20:06.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7726f57c0 con 0x55c7728091b0 2023-07-21T22:20:06.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7725d9920 con 0x55c772809ac0 2023-07-21T22:20:06.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b41cbab80 10 client.0 _ll_register_callbacks cb 0x55c7726f3760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:06.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60910/0 (socket says 172.21.15.151:60910) 2023-07-21T22:20:06.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.172+0000 7f1b27fff700 1 -- 172.21.15.151:0/148426423 learned_addr learned my addr 172.21.15.151:0/148426423 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b277fe700 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c77280de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b2c99c700 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772809ac0 0x55c77280e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b27fff700 1 -- 172.21.15.151:0/148426423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772809ac0 msgr2=0x55c77280e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b27fff700 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772809ac0 0x55c77280e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b27fff700 1 -- 172.21.15.151:0/148426423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 msgr2=0x55c77280de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b27fff700 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c77280de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b27fff700 1 -- 172.21.15.151:0/148426423 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b1c0098a0 con 0x55c772804930 2023-07-21T22:20:06.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b27fff700 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810b90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009990 tx=0x7f1b18005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a6fed4ecacc1dbc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b077fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:20:06.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b077fe700 1 -- 172.21.15.151:0/148426423 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b180a33d0 con 0x55c772804930 2023-07-21T22:20:06.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b077fe700 1 -- 172.21.15.151:0/148426423 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1b180a3660 con 0x55c772804930 2023-07-21T22:20:06.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b41cbab80 1 -- 172.21.15.151:0/148426423 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7726af4f0 con 0x55c772804930 2023-07-21T22:20:06.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b077fe700 1 -- 172.21.15.151:0/148426423 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b1809f110 con 0x55c772804930 2023-07-21T22:20:06.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b41cbab80 10 client.15774 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:06.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.173+0000 7f1b41cbab80 1 -- 172.21.15.151:0/148426423 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c77256cc60 con 0x55c772804930 2023-07-21T22:20:06.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.174+0000 7f1b077fe700 1 -- 172.21.15.151:0/148426423 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c7726af4f0 con 0x55c772804930 2023-07-21T22:20:06.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.174+0000 7f1b077fe700 1 -- 172.21.15.151:0/148426423 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1b180cbc40 con 0x55c772804930 2023-07-21T22:20:06.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.174+0000 7f1b41cbab80 10 client.15774 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:06.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.174+0000 7f1b41cbab80 10 client.15774 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:20:06.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.174+0000 7f1b41cbab80 20 client.15774 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:06.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.174+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55c7728268e0 0x55c772828cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.174+0000 7f1b41cbab80 4 client.15774 mds_command: new command op to 24574 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:06.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.174+0000 7f1b41cbab80 1 -- 172.21.15.151:0/148426423 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c77274eeb0 con 0x55c7728268e0 2023-07-21T22:20:06.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.175+0000 7f1b277fe700 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55c7728268e0 0x55c772828cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.175+0000 7f1b277fe700 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55c7728268e0 0x55c772828cf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1b5ca643d1dd3960 server_cookie=68d6be10b157160d in_seq=0 out_seq=0 2023-07-21T22:20:06.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.175+0000 7f1b077fe700 10 client.15774 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:20:06.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.176+0000 7f1b077fe700 1 -- 172.21.15.151:0/148426423 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c77274eeb0 con 0x55c7728268e0 2023-07-21T22:20:06.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.176+0000 7f1b077fe700 10 client.15774 handle_command_reply: tid=0 2023-07-21T22:20:06.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.176+0000 7f1b41cbab80 1 client.15774 shutdown 2023-07-21T22:20:06.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 -- 172.21.15.151:0/148426423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 msgr2=0x55c772810b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810b90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009990 tx=0x7f1b18005fb0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 -- 172.21.15.151:0/148426423 shutdown_connections 2023-07-21T22:20:06.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772809ac0 0x55c77280e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810b90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55c7728268e0 0x55c772828cf0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/148426423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c77280de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b077fe700 0 client.15774 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:20:06.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 -- 172.21.15.151:0/148426423 >> 172.21.15.151:0/148426423 conn(0x55c7727f9ef0 msgr2=0x55c7727ff420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 -- 172.21.15.151:0/148426423 shutdown_connections 2023-07-21T22:20:06.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 1 -- 172.21.15.151:0/148426423 wait complete. 2023-07-21T22:20:06.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.177+0000 7f1b41cbab80 20 client.15774 trim_cache size 0 max 16384 2023-07-21T22:20:06.228 INFO:teuthology.orchestra.run.smithi151.stderr:2000000 of 50000000 tuples (4%) done (elapsed 29.72 s, remaining 713.25 s) 2023-07-21T22:20:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.193+0000 7f1b41cbab80 1 Processor -- start 2023-07-21T22:20:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.193+0000 7f1b41cbab80 1 -- start start 2023-07-21T22:20:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.193+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7727f9ef0 0x55c772828cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.193+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.193+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c77280d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.193+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7728056d0 con 0x55c772804930 2023-07-21T22:20:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.193+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c77280eda0 con 0x55c7728091b0 2023-07-21T22:20:06.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.193+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7728054a0 con 0x55c7727f9ef0 2023-07-21T22:20:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7727f9ef0 0x55c772828cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7727f9ef0 0x55c772828cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54338/0 (socket says 172.21.15.151:54338) 2023-07-21T22:20:06.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b27fff700 1 -- 172.21.15.151:0/896716102 learned_addr learned my addr 172.21.15.151:0/896716102 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b2c99c700 1 --2- 172.21.15.151:0/896716102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c77280d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b27fff700 1 -- 172.21.15.151:0/896716102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 msgr2=0x55c77280d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b27fff700 1 --2- 172.21.15.151:0/896716102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c77280d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b27fff700 1 -- 172.21.15.151:0/896716102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 msgr2=0x55c772810730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b27fff700 1 --2- 172.21.15.151:0/896716102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b27fff700 1 -- 172.21.15.151:0/896716102 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7725aa250 con 0x55c7727f9ef0 2023-07-21T22:20:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b277fe700 1 --2- 172.21.15.151:0/896716102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:06.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b27fff700 1 --2- 172.21.15.151:0/896716102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7727f9ef0 0x55c772828cc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b18097d10 tx=0x7f1b180cbac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dc521d57b4d6eff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.194+0000 7f1b0effd700 1 -- 172.21.15.151:0/896716102 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b1809f110 con 0x55c7727f9ef0 2023-07-21T22:20:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b0effd700 1 -- 172.21.15.151:0/896716102 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b180cb8a0 con 0x55c7727f9ef0 2023-07-21T22:20:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b0effd700 1 -- 172.21.15.151:0/896716102 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b180a3430 con 0x55c7727f9ef0 2023-07-21T22:20:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b41cbab80 1 -- 172.21.15.151:0/896716102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7727f9ef0 msgr2=0x55c772828cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/896716102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7727f9ef0 0x55c772828cc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f1b18097d10 tx=0x7f1b180cbac0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b41cbab80 1 -- 172.21.15.151:0/896716102 shutdown_connections 2023-07-21T22:20:06.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/896716102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7728091b0 0x55c77280d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/896716102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7727f9ef0 0x55c772828cc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/896716102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c772804930 0x55c772810730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b41cbab80 1 -- 172.21.15.151:0/896716102 >> 172.21.15.151:0/896716102 conn(0x55c772805060 msgr2=0x55c7727fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.195+0000 7f1b41cbab80 1 -- 172.21.15.151:0/896716102 shutdown_connections 2023-07-21T22:20:06.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.196+0000 7f1b41cbab80 1 -- 172.21.15.151:0/896716102 wait complete. 2023-07-21T22:20:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.196+0000 7f1b41cbab80 1 -- start start 2023-07-21T22:20:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.196+0000 7f1b41cbab80 1 Processor -- start 2023-07-21T22:20:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7727f9ef0 0x55c77281d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c77281dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b41cbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7728091b0 0x55c77281bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c77281c4b0 con 0x55c7728091b0 2023-07-21T22:20:06.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c77281c620 con 0x55c7727f9ef0 2023-07-21T22:20:06.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b41cbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c77281c7e0 con 0x55c772804930 2023-07-21T22:20:06.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b41cbab80 10 client.0 _ll_register_callbacks cb 0x7f1b18022720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:06.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7727f9ef0 0x55c77281d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b27fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7727f9ef0 0x55c77281d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52412/0 (socket says 172.21.15.151:52412) 2023-07-21T22:20:06.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b27fff700 1 -- 172.21.15.151:0/2033253898 learned_addr learned my addr 172.21.15.151:0/2033253898 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b277fe700 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c77281dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.197+0000 7f1b2c99c700 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7728091b0 0x55c77281bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b27fff700 1 -- 172.21.15.151:0/2033253898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 msgr2=0x55c77281dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b27fff700 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c77281dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b27fff700 1 -- 172.21.15.151:0/2033253898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7728091b0 msgr2=0x55c77281bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b27fff700 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7728091b0 0x55c77281bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b27fff700 1 -- 172.21.15.151:0/2033253898 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c772583de0 con 0x55c7727f9ef0 2023-07-21T22:20:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b277fe700 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c77281dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:06.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b27fff700 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7727f9ef0 0x55c77281d860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b180860d0 tx=0x7f1b18009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e235e40777477ad7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b077fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:20:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b077fe700 1 -- 172.21.15.151:0/2033253898 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b18003e20 con 0x55c7727f9ef0 2023-07-21T22:20:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b41cbab80 1 -- 172.21.15.151:0/2033253898 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b1c004cc0 con 0x55c7727f9ef0 2023-07-21T22:20:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b077fe700 1 -- 172.21.15.151:0/2033253898 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1b180a3660 con 0x55c7727f9ef0 2023-07-21T22:20:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b077fe700 1 -- 172.21.15.151:0/2033253898 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1b1809ade0 con 0x55c7727f9ef0 2023-07-21T22:20:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b41cbab80 10 client.25541 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:06.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.198+0000 7f1b41cbab80 1 -- 172.21.15.151:0/2033253898 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55c77256cc60 con 0x55c7727f9ef0 2023-07-21T22:20:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.199+0000 7f1b077fe700 1 -- 172.21.15.151:0/2033253898 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b1c004cc0 con 0x55c7727f9ef0 2023-07-21T22:20:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.199+0000 7f1b077fe700 1 -- 172.21.15.151:0/2033253898 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1b1809a390 con 0x55c7727f9ef0 2023-07-21T22:20:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.199+0000 7f1b41cbab80 10 client.25541 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.199+0000 7f1b41cbab80 10 client.25541 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:20:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.199+0000 7f1b41cbab80 20 client.25541 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.199+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55c772809ac0 0x55c77287d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.199+0000 7f1b41cbab80 4 client.25541 mds_command: new command op to 24574 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:20:06.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.199+0000 7f1b41cbab80 1 -- 172.21.15.151:0/2033253898 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55c772711050 con 0x55c772809ac0 2023-07-21T22:20:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.199+0000 7f1b277fe700 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55c772809ac0 0x55c77287d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.200+0000 7f1b277fe700 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55c772809ac0 0x55c77287d410 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=789f160dc6474e05 server_cookie=a469e81db866e6dd in_seq=0 out_seq=0 2023-07-21T22:20:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.200+0000 7f1b077fe700 10 client.25541 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:20:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.200+0000 7f1b077fe700 1 -- 172.21.15.151:0/2033253898 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55c772711050 con 0x55c772809ac0 2023-07-21T22:20:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.200+0000 7f1b077fe700 10 client.25541 handle_command_reply: tid=0 2023-07-21T22:20:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.200+0000 7f1b41cbab80 1 client.25541 shutdown 2023-07-21T22:20:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.200+0000 7f1b41cbab80 1 -- 172.21.15.151:0/2033253898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7727f9ef0 msgr2=0x55c77281d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.200+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7727f9ef0 0x55c77281d860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1b180860d0 tx=0x7f1b18009310 comp rx=0 tx=0).stop 2023-07-21T22:20:06.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b41cbab80 1 -- 172.21.15.151:0/2033253898 shutdown_connections 2023-07-21T22:20:06.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55c772809ac0 0x55c77287d410 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7727f9ef0 0x55c77281d860 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7728091b0 0x55c77281bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b077fe700 0 client.25541 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:20:06.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b41cbab80 1 --2- 172.21.15.151:0/2033253898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c772804930 0x55c77281dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b41cbab80 1 -- 172.21.15.151:0/2033253898 >> 172.21.15.151:0/2033253898 conn(0x55c772805060 msgr2=0x55c772803940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b41cbab80 1 -- 172.21.15.151:0/2033253898 shutdown_connections 2023-07-21T22:20:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b41cbab80 1 -- 172.21.15.151:0/2033253898 wait complete. 2023-07-21T22:20:06.253 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b41cbab80 20 client.25541 trim_cache size 0 max 16384 2023-07-21T22:20:06.253 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:20:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1b100a1460 msgr2=0x7f1b100a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1b100a1460 0x7f1b100a3910 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1b200094f0 tx=0x7f1b2000b040 comp rx=0 tx=0).stop 2023-07-21T22:20:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 msgr2=0x7f1b28197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.201+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 0x7f1b28197dc0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f1b18009f50 tx=0x7f1b18005ef0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.202+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/43332492 shutdown_connections 2023-07-21T22:20:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.202+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1b100a1460 0x7f1b100a3910 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.202+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b28106fc0 0x7f1b2819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.202+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b28101f80 0x7f1b28197dc0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.202+0000 7f1b2e3ff700 1 --2- 172.21.15.151:0/43332492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b28102920 0x7f1b28198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.202+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/43332492 >> 172.21.15.151:0/43332492 conn(0x7f1b280fd830 msgr2=0x7f1b280fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.202+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/43332492 shutdown_connections 2023-07-21T22:20:06.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.202+0000 7f1b2e3ff700 1 -- 172.21.15.151:0/43332492 wait complete. 2023-07-21T22:20:06.266 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-21T22:20:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.473+0000 7fb4b279d700 1 -- 172.21.15.151:0/3697045043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac0ff9d0 msgr2=0x7fb4ac0ffe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.473+0000 7fb4b279d700 1 --2- 172.21.15.151:0/3697045043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac0ff9d0 0x7fb4ac0ffe40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb49c0098f0 tx=0x7fb49c009c00 comp rx=0 tx=0).stop 2023-07-21T22:20:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.473+0000 7fb4b279d700 1 -- 172.21.15.151:0/3697045043 shutdown_connections 2023-07-21T22:20:06.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.473+0000 7fb4b279d700 1 --2- 172.21.15.151:0/3697045043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac100380 0x7fb4ac10c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.473+0000 7fb4b279d700 1 --2- 172.21.15.151:0/3697045043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4ac1059e0 0x7fb4ac105db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.473+0000 7fb4b279d700 1 --2- 172.21.15.151:0/3697045043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac0ff9d0 0x7fb4ac0ffe40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.473+0000 7fb4b279d700 1 -- 172.21.15.151:0/3697045043 >> 172.21.15.151:0/3697045043 conn(0x7fb4ac0fb4b0 msgr2=0x7fb4ac0fd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.473+0000 7fb4b279d700 1 -- 172.21.15.151:0/3697045043 shutdown_connections 2023-07-21T22:20:06.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.473+0000 7fb4b279d700 1 -- 172.21.15.151:0/3697045043 wait complete. 2023-07-21T22:20:06.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.474+0000 7fb4b279d700 1 Processor -- start 2023-07-21T22:20:06.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.475+0000 7fb4b279d700 1 -- start start 2023-07-21T22:20:06.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.475+0000 7fb4b279d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac0ff9d0 0x7fb4ac19b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.475+0000 7fb4b279d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac100380 0x7fb4ac19bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.475+0000 7fb4b279d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4ac1059e0 0x7fb4ac195750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.475+0000 7fb4b279d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac195dc0 con 0x7fb4ac0ff9d0 2023-07-21T22:20:06.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.475+0000 7fb4b279d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac195f30 con 0x7fb4ac100380 2023-07-21T22:20:06.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.475+0000 7fb4b279d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4ac1960f0 con 0x7fb4ac1059e0 2023-07-21T22:20:06.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.475+0000 7fb4b179b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac0ff9d0 0x7fb4ac19b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b179b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac0ff9d0 0x7fb4ac19b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60950/0 (socket says 172.21.15.151:60950) 2023-07-21T22:20:06.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b179b700 1 -- 172.21.15.151:0/1280605104 learned_addr learned my addr 172.21.15.151:0/1280605104 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac100380 0x7fb4ac19bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b1f9c700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4ac1059e0 0x7fb4ac195750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b179b700 1 -- 172.21.15.151:0/1280605104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4ac1059e0 msgr2=0x7fb4ac195750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b179b700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4ac1059e0 0x7fb4ac195750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b179b700 1 -- 172.21.15.151:0/1280605104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac100380 msgr2=0x7fb4ac19bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.522 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b179b700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac100380 0x7fb4ac19bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b179b700 1 -- 172.21.15.151:0/1280605104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb49c009520 con 0x7fb4ac0ff9d0 2023-07-21T22:20:06.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b1f9c700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4ac1059e0 0x7fb4ac195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:06.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4b179b700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac0ff9d0 0x7fb4ac19b6e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800e970 tx=0x7fb4a800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.476+0000 7fb4a27fc700 1 -- 172.21.15.151:0/1280605104 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8009790 con 0x7fb4ac0ff9d0 2023-07-21T22:20:06.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.477+0000 7fb4a27fc700 1 -- 172.21.15.151:0/1280605104 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4a800eec0 con 0x7fb4ac0ff9d0 2023-07-21T22:20:06.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.477+0000 7fb4b279d700 1 -- 172.21.15.151:0/1280605104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4ac1963d0 con 0x7fb4ac0ff9d0 2023-07-21T22:20:06.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.477+0000 7fb4a27fc700 1 -- 172.21.15.151:0/1280605104 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8003c10 con 0x7fb4ac0ff9d0 2023-07-21T22:20:06.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.477+0000 7fb4b279d700 1 -- 172.21.15.151:0/1280605104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac1a26d0 con 0x7fb4ac0ff9d0 2023-07-21T22:20:06.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.481+0000 7fb4a27fc700 1 -- 172.21.15.151:0/1280605104 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fb4a8003db0 con 0x7fb4ac0ff9d0 2023-07-21T22:20:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.482+0000 7fb4c7392b80 1 Processor -- start 2023-07-21T22:20:06.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.482+0000 7fb4c7392b80 1 -- start start 2023-07-21T22:20:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.483+0000 7fb4a27fc700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4980a1500 0x7fb4980a39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.483+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 0x55b784441860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.483+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441da0 0x55b78444c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.483+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b78444cc40 0x55b78444f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.483+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b784347cb0 con 0x55b78444cc40 2023-07-21T22:20:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.483+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b78439aa40 con 0x55b784441da0 2023-07-21T22:20:06.528 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.483+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b784393ed0 con 0x55b784441490 2023-07-21T22:20:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.483+0000 7fb4a27fc700 1 -- 172.21.15.151:0/1280605104 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb4a8014070 con 0x7fb4ac0ff9d0 2023-07-21T22:20:06.529 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.483+0000 7fb4b0f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441da0 0x55b78444c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b0f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441da0 0x55b78444c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52434/0 (socket says 172.21.15.151:52434) 2023-07-21T22:20:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b0f9a700 1 -- 172.21.15.151:0/3594536771 learned_addr learned my addr 172.21.15.151:0/3594536771 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b1f9c700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4980a1500 0x7fb4980a39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b1f9c700 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b78444cc40 0x55b78444f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b179b700 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 0x55b784441860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b0f9a700 1 -- 172.21.15.151:0/3594536771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 msgr2=0x55b784441860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.530 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 0x55b784441860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b0f9a700 1 -- 172.21.15.151:0/3594536771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b78444cc40 msgr2=0x55b78444f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b78444cc40 0x55b78444f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b0f9a700 1 -- 172.21.15.151:0/3594536771 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7841c1de0 con 0x55b784441da0 2023-07-21T22:20:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.484+0000 7fb4b179b700 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 0x55b784441860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.485+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441da0 0x55b78444c700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb49c000c00 tx=0x7fb49c005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bde36d6544bb5fcf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.485+0000 7fb4b1f9c700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4980a1500 0x7fb4980a39b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac19c3e0 tx=0x7fb4a40099e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.485+0000 7fb4977fe700 1 -- 172.21.15.151:0/3594536771 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c00f460 con 0x55b784441da0 2023-07-21T22:20:06.531 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.485+0000 7fb4977fe700 1 -- 172.21.15.151:0/3594536771 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb49c01d040 con 0x55b784441da0 2023-07-21T22:20:06.532 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.485+0000 7fb4977fe700 1 -- 172.21.15.151:0/3594536771 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c0052a0 con 0x55b784441da0 2023-07-21T22:20:06.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.486+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3594536771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441da0 msgr2=0x55b78444c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.486+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441da0 0x55b78444c700 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb49c000c00 tx=0x7fb49c005dc0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.533 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.486+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3594536771 shutdown_connections 2023-07-21T22:20:06.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.486+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b78444cc40 0x55b78444f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.486+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 0x55b784441860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.486+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3594536771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441da0 0x55b78444c700 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.486+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3594536771 >> 172.21.15.151:0/3594536771 conn(0x55b784437ef0 msgr2=0x55b78443d860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.486+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3594536771 shutdown_connections 2023-07-21T22:20:06.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.486+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3594536771 wait complete. 2023-07-21T22:20:06.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.487+0000 7fb4c7392b80 1 -- start start 2023-07-21T22:20:06.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.487+0000 7fb4c7392b80 1 Processor -- start 2023-07-21T22:20:06.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b78444c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b7844498c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b78444cc40 0x55b784449fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b784333ac0 con 0x55b784441da0 2023-07-21T22:20:06.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7843337c0 con 0x55b784441490 2023-07-21T22:20:06.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b784217920 con 0x55b78444cc40 2023-07-21T22:20:06.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4c7392b80 10 client.0 _ll_register_callbacks cb 0x55b784331760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:06.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4b179b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b78444c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4b179b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b78444c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52444/0 (socket says 172.21.15.151:52444) 2023-07-21T22:20:06.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4b179b700 1 -- 172.21.15.151:0/3707702259 learned_addr learned my addr 172.21.15.151:0/3707702259 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.488+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b7844498c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb4b179b700 1 -- 172.21.15.151:0/3707702259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b78444cc40 msgr2=0x55b784449fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb4b179b700 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b78444cc40 0x55b784449fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb4b179b700 1 -- 172.21.15.151:0/3707702259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 msgr2=0x55b7844498c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb4b179b700 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b7844498c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb4b179b700 1 -- 172.21.15.151:0/3707702259 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4ac10d110 con 0x55b784441490 2023-07-21T22:20:06.538 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb4b179b700 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b78444c6b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8096a50 tx=0x7fb4a800cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89b4889e301ab077 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb494ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:20:06.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb494ff9700 1 -- 172.21.15.151:0/3707702259 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a80a2430 con 0x55b784441490 2023-07-21T22:20:06.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb494ff9700 1 -- 172.21.15.151:0/3707702259 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb4a80a1fa0 con 0x55b784441490 2023-07-21T22:20:06.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.489+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3707702259 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7842ed4f0 con 0x55b784441490 2023-07-21T22:20:06.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb494ff9700 1 -- 172.21.15.151:0/3707702259 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4a80a2160 con 0x55b784441490 2023-07-21T22:20:06.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb4c7392b80 10 client.25553 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:06.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3707702259 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b7841aac60 con 0x55b784441490 2023-07-21T22:20:06.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb494ff9700 1 -- 172.21.15.151:0/3707702259 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b7842ed4f0 con 0x55b784441490 2023-07-21T22:20:06.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb494ff9700 1 -- 172.21.15.151:0/3707702259 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb4a8098f40 con 0x55b784441490 2023-07-21T22:20:06.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb4c7392b80 10 client.25553 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:06.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb4c7392b80 10 client.25553 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:06.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb4c7392b80 20 client.25553 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:06.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b78445c560 0x55b78445e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb4c7392b80 4 client.25553 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:06.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.490+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3707702259 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b78438ceb0 con 0x55b78445c560 2023-07-21T22:20:06.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.491+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b78445c560 0x55b78445e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.492+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b78445c560 0x55b78445e970 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88e63c8fe38d8998 server_cookie=4871a43897e3b2bd in_seq=0 out_seq=0 2023-07-21T22:20:06.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.492+0000 7fb494ff9700 10 client.25553 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:06.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb494ff9700 1 -- 172.21.15.151:0/3707702259 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b78438ceb0 con 0x55b78445c560 2023-07-21T22:20:06.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb494ff9700 10 client.25553 handle_command_reply: tid=0 2023-07-21T22:20:06.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 client.25553 shutdown 2023-07-21T22:20:06.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3707702259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 msgr2=0x55b78444c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b78444c6b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8096a50 tx=0x7fb4a800cdc0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3707702259 shutdown_connections 2023-07-21T22:20:06.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b78445c560 0x55b78445e970 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b78444c6b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b78444cc40 0x55b784449fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/3707702259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b7844498c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3707702259 >> 172.21.15.151:0/3707702259 conn(0x55b784437ef0 msgr2=0x55b78443d3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb494ff9700 0 client.25553 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:06.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3707702259 shutdown_connections 2023-07-21T22:20:06.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.493+0000 7fb4c7392b80 1 -- 172.21.15.151:0/3707702259 wait complete. 2023-07-21T22:20:06.543 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.494+0000 7fb4c7392b80 20 client.25553 trim_cache size 0 max 16384 2023-07-21T22:20:06.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.509+0000 7fb4c7392b80 1 Processor -- start 2023-07-21T22:20:06.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.509+0000 7fb4c7392b80 1 -- start start 2023-07-21T22:20:06.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.509+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 0x55b78444c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.509+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784449160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.509+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b78444cc40 0x55b7844496a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.509+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b78444a620 con 0x55b784441da0 2023-07-21T22:20:06.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.509+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b784459c10 con 0x55b78444cc40 2023-07-21T22:20:06.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.509+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b784444350 con 0x55b784441490 2023-07-21T22:20:06.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b0f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784449160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b0f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784449160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60974/0 (socket says 172.21.15.151:60974) 2023-07-21T22:20:06.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b0f9a700 1 -- 172.21.15.151:0/4182618843 learned_addr learned my addr 172.21.15.151:0/4182618843 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b179b700 1 --2- 172.21.15.151:0/4182618843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 0x55b78444c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b1f9c700 1 --2- 172.21.15.151:0/4182618843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b78444cc40 0x55b7844496a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b0f9a700 1 -- 172.21.15.151:0/4182618843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 msgr2=0x55b78444c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/4182618843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 0x55b78444c1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b0f9a700 1 -- 172.21.15.151:0/4182618843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b78444cc40 msgr2=0x55b7844496a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/4182618843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b78444cc40 0x55b7844496a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.510+0000 7fb4b0f9a700 1 -- 172.21.15.151:0/4182618843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7841e8250 con 0x55b784441da0 2023-07-21T22:20:06.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.511+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/4182618843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784449160 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009810 tx=0x7fb49c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2525fe45ae19b9fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.511+0000 7fb497fff700 1 -- 172.21.15.151:0/4182618843 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c033070 con 0x55b784441da0 2023-07-21T22:20:06.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.511+0000 7fb497fff700 1 -- 172.21.15.151:0/4182618843 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb49c005920 con 0x55b784441da0 2023-07-21T22:20:06.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.511+0000 7fb497fff700 1 -- 172.21.15.151:0/4182618843 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49c02f570 con 0x55b784441da0 2023-07-21T22:20:06.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.512+0000 7fb4c7392b80 1 -- 172.21.15.151:0/4182618843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 msgr2=0x55b784449160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.512+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/4182618843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784449160 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fb49c009810 tx=0x7fb49c005040 comp rx=0 tx=0).stop 2023-07-21T22:20:06.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.512+0000 7fb4c7392b80 1 -- 172.21.15.151:0/4182618843 shutdown_connections 2023-07-21T22:20:06.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.512+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/4182618843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b78444cc40 0x55b7844496a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.512+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/4182618843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b784441490 0x55b78444c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.512+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/4182618843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784449160 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.512+0000 7fb4c7392b80 1 -- 172.21.15.151:0/4182618843 >> 172.21.15.151:0/4182618843 conn(0x55b784437ef0 msgr2=0x55b784444ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.512+0000 7fb4c7392b80 1 -- 172.21.15.151:0/4182618843 shutdown_connections 2023-07-21T22:20:06.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.512+0000 7fb4c7392b80 1 -- 172.21.15.151:0/4182618843 wait complete. 2023-07-21T22:20:06.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.513+0000 7fb4c7392b80 1 -- start start 2023-07-21T22:20:06.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.513+0000 7fb4c7392b80 1 Processor -- start 2023-07-21T22:20:06.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b784451410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784451950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4c7392b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b78444cc40 0x55b7844af420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7844af960 con 0x55b784441da0 2023-07-21T22:20:06.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7844afaa0 con 0x55b784441490 2023-07-21T22:20:06.561 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4c7392b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7844afbe0 con 0x55b78444cc40 2023-07-21T22:20:06.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4c7392b80 10 client.0 _ll_register_callbacks cb 0x7fb4a8099c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:06.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4b179b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b784451410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4b0f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784451950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4b0f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784451950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60978/0 (socket says 172.21.15.151:60978) 2023-07-21T22:20:06.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4b0f9a700 1 -- 172.21.15.151:0/322020049 learned_addr learned my addr 172.21.15.151:0/322020049 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.514+0000 7fb4b1f9c700 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b78444cc40 0x55b7844af420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.515+0000 7fb4b179b700 1 -- 172.21.15.151:0/322020049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b78444cc40 msgr2=0x55b7844af420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.515+0000 7fb4b179b700 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b78444cc40 0x55b7844af420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.515+0000 7fb4b179b700 1 -- 172.21.15.151:0/322020049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 msgr2=0x55b784451950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.515+0000 7fb4b179b700 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784451950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.515+0000 7fb4b179b700 1 -- 172.21.15.151:0/322020049 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b7841c1de0 con 0x55b784441490 2023-07-21T22:20:06.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.515+0000 7fb4b179b700 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b784451410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80964e0 tx=0x7fb4a800e8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7f2cd421b3848286 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.515+0000 7fb494ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:20:06.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb494ff9700 1 -- 172.21.15.151:0/322020049 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4a8099310 con 0x55b784441490 2023-07-21T22:20:06.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb494ff9700 1 -- 172.21.15.151:0/322020049 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb4a80caa10 con 0x55b784441490 2023-07-21T22:20:06.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb4c7392b80 1 -- 172.21.15.151:0/322020049 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb49c01d040 con 0x55b784441490 2023-07-21T22:20:06.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb494ff9700 1 -- 172.21.15.151:0/322020049 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb4a80a2430 con 0x55b784441490 2023-07-21T22:20:06.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb4c7392b80 10 client.25559 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:06.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb4c7392b80 1 -- 172.21.15.151:0/322020049 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b7841c02b0 con 0x55b784441490 2023-07-21T22:20:06.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb494ff9700 1 -- 172.21.15.151:0/322020049 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb49c01d040 con 0x55b784441490 2023-07-21T22:20:06.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb494ff9700 1 -- 172.21.15.151:0/322020049 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb4a80a1fa0 con 0x55b784441490 2023-07-21T22:20:06.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb4c7392b80 10 client.25559 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:06.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb4c7392b80 10 client.25559 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:06.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb4c7392b80 20 client.25559 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:06.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7844b0e10 0x55b7844b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb4c7392b80 4 client.25559 mds_command: new command op to 24599 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:20:06.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.516+0000 7fb4c7392b80 1 -- 172.21.15.151:0/322020049 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b78434f050 con 0x55b7844b0e10 2023-07-21T22:20:06.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.517+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7844b0e10 0x55b7844b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.517+0000 7fb4b0f9a700 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7844b0e10 0x55b7844b31f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2eeb442873e320a2 server_cookie=cf3a3308aef37f02 in_seq=0 out_seq=0 2023-07-21T22:20:06.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.517+0000 7fb494ff9700 10 client.25559 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:06.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb494ff9700 1 -- 172.21.15.151:0/322020049 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b78434f050 con 0x55b7844b0e10 2023-07-21T22:20:06.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb494ff9700 10 client.25559 handle_command_reply: tid=0 2023-07-21T22:20:06.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 client.25559 shutdown 2023-07-21T22:20:06.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 -- 172.21.15.151:0/322020049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 msgr2=0x55b784451410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b784451410 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fb4a80964e0 tx=0x7fb4a800e8f0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 -- 172.21.15.151:0/322020049 shutdown_connections 2023-07-21T22:20:06.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7844b0e10 0x55b7844b31f0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b784441490 0x55b784451410 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b78444cc40 0x55b7844af420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb494ff9700 0 client.25559 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:06.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 --2- 172.21.15.151:0/322020049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b784441da0 0x55b784451950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.568 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 -- 172.21.15.151:0/322020049 >> 172.21.15.151:0/322020049 conn(0x55b784437ef0 msgr2=0x55b784443340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 -- 172.21.15.151:0/322020049 shutdown_connections 2023-07-21T22:20:06.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 1 -- 172.21.15.151:0/322020049 wait complete. 2023-07-21T22:20:06.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.518+0000 7fb4c7392b80 20 client.25559 trim_cache size 0 max 16384 2023-07-21T22:20:06.569 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:20:06.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 -- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4980a1500 msgr2=0x7fb4980a39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4980a1500 0x7fb4980a39b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb4ac19c3e0 tx=0x7fb4a40099e0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 -- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac0ff9d0 msgr2=0x7fb4ac19b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac0ff9d0 0x7fb4ac19b6e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb4a800e970 tx=0x7fb4a800ec80 comp rx=0 tx=0).stop 2023-07-21T22:20:06.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 -- 172.21.15.151:0/1280605104 shutdown_connections 2023-07-21T22:20:06.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4980a1500 0x7fb4980a39b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4ac1059e0 0x7fb4ac195750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4ac0ff9d0 0x7fb4ac19b6e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 --2- 172.21.15.151:0/1280605104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4ac100380 0x7fb4ac19bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 -- 172.21.15.151:0/1280605104 >> 172.21.15.151:0/1280605104 conn(0x7fb4ac0fb4b0 msgr2=0x7fb4ac0fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 -- 172.21.15.151:0/1280605104 shutdown_connections 2023-07-21T22:20:06.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:06.519+0000 7fb4b279d700 1 -- 172.21.15.151:0/1280605104 wait complete. 2023-07-21T22:20:06.582 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:06 smithi151 ceph-mon[95510]: pgmap v30: 97 pgs: 97 active+clean; 450 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 38 op/s 2023-07-21T22:20:06.583 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:06 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/723934625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:20:06.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:06 smithi187 ceph-mon[96918]: pgmap v30: 97 pgs: 97 active+clean; 450 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 38 op/s 2023-07-21T22:20:06.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:06 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/723934625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:20:06.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:06 smithi195 ceph-mon[97365]: pgmap v30: 97 pgs: 97 active+clean; 450 MiB data, 539 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 26 MiB/s wr, 38 op/s 2023-07-21T22:20:06.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:06 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/723934625' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:20:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.660+0000 7fc5d83ff700 1 -- 172.21.15.151:0/3463649086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 msgr2=0x7fc5d010c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.660+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/3463649086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 0x7fc5d010c000 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fc5c0009990 tx=0x7fc5c0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.661+0000 7fc5d83ff700 1 -- 172.21.15.151:0/3463649086 shutdown_connections 2023-07-21T22:20:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.661+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/3463649086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5d00679a0 0x7fc5d0067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.661+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/3463649086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d010c540 0x7fc5d010e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.661+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/3463649086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 0x7fc5d010c000 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.661+0000 7fc5d83ff700 1 -- 172.21.15.151:0/3463649086 >> 172.21.15.151:0/3463649086 conn(0x7fc5d0074760 msgr2=0x7fc5d0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.661+0000 7fc5d83ff700 1 -- 172.21.15.151:0/3463649086 shutdown_connections 2023-07-21T22:20:06.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.661+0000 7fc5d83ff700 1 -- 172.21.15.151:0/3463649086 wait complete. 2023-07-21T22:20:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.662+0000 7fc5d83ff700 1 Processor -- start 2023-07-21T22:20:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.662+0000 7fc5d83ff700 1 -- start start 2023-07-21T22:20:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d83ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d00679a0 0x7fc5d0197cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d83ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 0x7fc5d0198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d83ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5d010c540 0x7fc5d019b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d83ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019bdd0 con 0x7fc5d00682b0 2023-07-21T22:20:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d83ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019bf40 con 0x7fc5d010c540 2023-07-21T22:20:06.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d83ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5d019c100 con 0x7fc5d00679a0 2023-07-21T22:20:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 0x7fc5d0198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 0x7fc5d0198210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60990/0 (socket says 172.21.15.151:60990) 2023-07-21T22:20:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d599a700 1 -- 172.21.15.151:0/2236623838 learned_addr learned my addr 172.21.15.151:0/2236623838 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d619b700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d00679a0 0x7fc5d0197cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d699c700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5d010c540 0x7fc5d019b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d599a700 1 -- 172.21.15.151:0/2236623838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d00679a0 msgr2=0x7fc5d0197cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d599a700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d00679a0 0x7fc5d0197cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d599a700 1 -- 172.21.15.151:0/2236623838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5d010c540 msgr2=0x7fc5d019b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d599a700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5d010c540 0x7fc5d019b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d599a700 1 -- 172.21.15.151:0/2236623838 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5c00095f0 con 0x7fc5d00682b0 2023-07-21T22:20:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.663+0000 7fc5d699c700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5d010c540 0x7fc5d019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.664+0000 7fc5d599a700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 0x7fc5d0198210 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00098e0 tx=0x7fc5c0009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.664+0000 7fc5c77fe700 1 -- 172.21.15.151:0/2236623838 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c001d070 con 0x7fc5d00682b0 2023-07-21T22:20:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.664+0000 7fc5c77fe700 1 -- 172.21.15.151:0/2236623838 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5c0021410 con 0x7fc5d00682b0 2023-07-21T22:20:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.664+0000 7fc5d83ff700 1 -- 172.21.15.151:0/2236623838 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5d019c380 con 0x7fc5d00682b0 2023-07-21T22:20:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.664+0000 7fc5c77fe700 1 -- 172.21.15.151:0/2236623838 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c0021ea0 con 0x7fc5d00682b0 2023-07-21T22:20:06.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.664+0000 7fc5d83ff700 1 -- 172.21.15.151:0/2236623838 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5d01a4d40 con 0x7fc5d00682b0 2023-07-21T22:20:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.668+0000 7fc5c77fe700 1 -- 172.21.15.151:0/2236623838 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fc5c0021580 con 0x7fc5d00682b0 2023-07-21T22:20:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.669+0000 7fc5ebe09b80 1 Processor -- start 2023-07-21T22:20:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.670+0000 7fc5ebe09b80 1 -- start start 2023-07-21T22:20:06.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.670+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df433acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.670+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df4334f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.670+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df43354a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.670+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df423ac50 con 0x559df433b660 2023-07-21T22:20:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.670+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df428d9e0 con 0x559df41916b0 2023-07-21T22:20:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.670+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df4286e70 con 0x559df433b210 2023-07-21T22:20:06.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df43354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df43354a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32772/0 (socket says 172.21.15.151:32772) 2023-07-21T22:20:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d599a700 1 -- 172.21.15.151:0/2969782965 learned_addr learned my addr 172.21.15.151:0/2969782965 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d699c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df433acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5c77fe700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc5bc0a1460 0x7fc5bc0a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5c77fe700 1 -- 172.21.15.151:0/2236623838 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc5c00ce0f0 con 0x7fc5d00682b0 2023-07-21T22:20:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d599a700 1 -- 172.21.15.151:0/2969782965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 msgr2=0x559df4334f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:20:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d599a700 1 --2- 172.21.15.151:0/2969782965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df4334f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d599a700 1 -- 172.21.15.151:0/2969782965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 msgr2=0x559df433acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d599a700 1 --2- 172.21.15.151:0/2969782965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df433acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d599a700 1 -- 172.21.15.151:0/2969782965 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559df40b4d80 con 0x559df433b660 2023-07-21T22:20:06.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d699c700 1 --2- 172.21.15.151:0/2969782965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df433acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.671+0000 7fc5d699c700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc5bc0a1460 0x7fc5bc0a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.672+0000 7fc5d599a700 1 --2- 172.21.15.151:0/2969782965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df43354a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00cb670 tx=0x7fc5c0009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b2bb5ea38b9f2cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.672+0000 7fc5c4bfe700 1 -- 172.21.15.151:0/2969782965 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c009af00 con 0x559df433b660 2023-07-21T22:20:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.672+0000 7fc5c4bfe700 1 -- 172.21.15.151:0/2969782965 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5c009ac70 con 0x559df433b660 2023-07-21T22:20:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.672+0000 7fc5c4bfe700 1 -- 172.21.15.151:0/2969782965 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c00d00d0 con 0x559df433b660 2023-07-21T22:20:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.672+0000 7fc5d699c700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc5bc0a1460 0x7fc5bc0a3910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009550 tx=0x7fc5c8004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/2969782965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 msgr2=0x559df43354a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/2969782965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df43354a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00cb670 tx=0x7fc5c0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/2969782965 shutdown_connections 2023-07-21T22:20:06.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/2969782965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df433acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/2969782965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df43354a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/2969782965 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df4334f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/2969782965 >> 172.21.15.151:0/2969782965 conn(0x559df432aae0 msgr2=0x559df43300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/2969782965 shutdown_connections 2023-07-21T22:20:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/2969782965 wait complete. 2023-07-21T22:20:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.673+0000 7fc5ebe09b80 1 -- start start 2023-07-21T22:20:06.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.674+0000 7fc5ebe09b80 1 Processor -- start 2023-07-21T22:20:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.674+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df41916b0 0x559df43411f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.674+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df433e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.674+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df433b660 0x559df433e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.674+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df4226a60 con 0x559df41916b0 2023-07-21T22:20:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.674+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df4226760 con 0x559df433b660 2023-07-21T22:20:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.674+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df410a8c0 con 0x559df433b210 2023-07-21T22:20:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5ebe09b80 10 client.0 _ll_register_callbacks cb 0x559df4224700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d619b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df41916b0 0x559df43411f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d699c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df433b660 0x559df433e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d619b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df41916b0 0x559df43411f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32788/0 (socket says 172.21.15.151:32788) 2023-07-21T22:20:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d599a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df433e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d619b700 1 -- 172.21.15.151:0/3927551811 learned_addr learned my addr 172.21.15.151:0/3927551811 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d699c700 1 -- 172.21.15.151:0/3927551811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 msgr2=0x559df433e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d699c700 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df433e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d699c700 1 -- 172.21.15.151:0/3927551811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df41916b0 msgr2=0x559df43411f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d699c700 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df41916b0 0x559df43411f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d699c700 1 -- 172.21.15.151:0/3927551811 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5c8009120 con 0x559df433b660 2023-07-21T22:20:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.675+0000 7fc5d599a700 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df433e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.676+0000 7fc5d699c700 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df433b660 0x559df433e9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8017c40 tx=0x7fc5c800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24a381e0c2ba1546 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.676+0000 7fc5b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:20:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.676+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/3927551811 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c8016c80 con 0x559df433b660 2023-07-21T22:20:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.676+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/3927551811 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559df41e0490 con 0x559df433b660 2023-07-21T22:20:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.676+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/3927551811 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc5c801f040 con 0x559df433b660 2023-07-21T22:20:06.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.676+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/3927551811 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c8016de0 con 0x559df433b660 2023-07-21T22:20:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.676+0000 7fc5ebe09b80 10 client.25568 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.676+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/3927551811 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fc5d01a4d40 con 0x559df433b660 2023-07-21T22:20:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.676+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/3927551811 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559df41e0490 con 0x559df433b660 2023-07-21T22:20:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.677+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/3927551811 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc5c802b360 con 0x559df433b660 2023-07-21T22:20:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.677+0000 7fc5ebe09b80 10 client.25568 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.677+0000 7fc5ebe09b80 10 client.25568 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:06.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.677+0000 7fc5ebe09b80 20 client.25568 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.677+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559df4356fd0 0x559df43593e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.677+0000 7fc5ebe09b80 4 client.25568 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.677+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/3927551811 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559df427fe50 con 0x559df4356fd0 2023-07-21T22:20:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.677+0000 7fc5d619b700 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559df4356fd0 0x559df43593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.678+0000 7fc5b9ffb700 10 client.25568 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.678+0000 7fc5d619b700 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559df4356fd0 0x559df43593e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324d35f28ced667e server_cookie=addddbc1c9988b9d in_seq=0 out_seq=0 2023-07-21T22:20:06.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/3927551811 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559df427fe50 con 0x559df4356fd0 2023-07-21T22:20:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5b9ffb700 10 client.25568 handle_command_reply: tid=0 2023-07-21T22:20:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 client.25568 shutdown 2023-07-21T22:20:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/3927551811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df433b660 msgr2=0x559df433e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df433b660 0x559df433e9b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8017c40 tx=0x7fc5c800b040 comp rx=0 tx=0).stop 2023-07-21T22:20:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/3927551811 shutdown_connections 2023-07-21T22:20:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559df4356fd0 0x559df43593e0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df433b660 0x559df433e9b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df41916b0 0x559df43411f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5b9ffb700 0 client.25568 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/3927551811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df433e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/3927551811 >> 172.21.15.151:0/3927551811 conn(0x559df432aae0 msgr2=0x559df432f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/3927551811 shutdown_connections 2023-07-21T22:20:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/3927551811 wait complete. 2023-07-21T22:20:06.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.679+0000 7fc5ebe09b80 20 client.25568 trim_cache size 0 max 16384 2023-07-21T22:20:06.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.697+0000 7fc5ebe09b80 1 Processor -- start 2023-07-21T22:20:06.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.697+0000 7fc5ebe09b80 1 -- start start 2023-07-21T22:20:06.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.697+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df4353270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.697+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b210 0x559df4334f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b660 0x559df4335480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df41e0490 con 0x559df433b210 2023-07-21T22:20:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df4336160 con 0x559df41916b0 2023-07-21T22:20:06.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df432cc30 con 0x559df433b660 2023-07-21T22:20:06.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b210 0x559df4334f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b210 0x559df4334f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32804/0 (socket says 172.21.15.151:32804) 2023-07-21T22:20:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d599a700 1 -- 172.21.15.151:0/117487361 learned_addr learned my addr 172.21.15.151:0/117487361 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d619b700 1 --2- 172.21.15.151:0/117487361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df4353270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d699c700 1 --2- 172.21.15.151:0/117487361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b660 0x559df4335480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d599a700 1 -- 172.21.15.151:0/117487361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b660 msgr2=0x559df4335480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d599a700 1 --2- 172.21.15.151:0/117487361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b660 0x559df4335480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d599a700 1 -- 172.21.15.151:0/117487361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 msgr2=0x559df4353270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d599a700 1 --2- 172.21.15.151:0/117487361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df4353270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.698+0000 7fc5d599a700 1 -- 172.21.15.151:0/117487361 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559df409dc00 con 0x559df433b210 2023-07-21T22:20:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.699+0000 7fc5d599a700 1 --2- 172.21.15.151:0/117487361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b210 0x559df4334f40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00ce3a0 tx=0x7fc5c000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29a4f6db74025bf7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.699+0000 7fc5c53ff700 1 -- 172.21.15.151:0/117487361 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c009af00 con 0x559df433b210 2023-07-21T22:20:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.699+0000 7fc5c53ff700 1 -- 172.21.15.151:0/117487361 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5c009aa90 con 0x559df433b210 2023-07-21T22:20:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.699+0000 7fc5c53ff700 1 -- 172.21.15.151:0/117487361 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c009b5f0 con 0x559df433b210 2023-07-21T22:20:06.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.699+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/117487361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b210 msgr2=0x559df4334f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.699+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/117487361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b210 0x559df4334f40 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00ce3a0 tx=0x7fc5c000b390 comp rx=0 tx=0).stop 2023-07-21T22:20:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.700+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/117487361 shutdown_connections 2023-07-21T22:20:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.700+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/117487361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df4353270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.700+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/117487361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b660 0x559df4335480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.700+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/117487361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b210 0x559df4334f40 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.700+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/117487361 >> 172.21.15.151:0/117487361 conn(0x559df432aae0 msgr2=0x559df4352b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.700+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/117487361 shutdown_connections 2023-07-21T22:20:06.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.700+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/117487361 wait complete. 2023-07-21T22:20:06.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.700+0000 7fc5ebe09b80 1 -- start start 2023-07-21T22:20:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.700+0000 7fc5ebe09b80 1 Processor -- start 2023-07-21T22:20:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df434de60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df434e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5ebe09b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df434c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df434ca90 con 0x559df433b660 2023-07-21T22:20:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df434cc00 con 0x559df41916b0 2023-07-21T22:20:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5ebe09b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559df434cdc0 con 0x559df433b210 2023-07-21T22:20:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5ebe09b80 10 client.0 _ll_register_callbacks cb 0x7fc5c8017820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5d699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df434c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5d699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df434c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32820/0 (socket says 172.21.15.151:32820) 2023-07-21T22:20:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5d699c700 1 -- 172.21.15.151:0/1039860065 learned_addr learned my addr 172.21.15.151:0/1039860065 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5d619b700 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df434de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.701+0000 7fc5d599a700 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df434e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5d699c700 1 -- 172.21.15.151:0/1039860065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 msgr2=0x559df434e3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5d699c700 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df434e3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5d699c700 1 -- 172.21.15.151:0/1039860065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 msgr2=0x559df434de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5d699c700 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df434de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5d699c700 1 -- 172.21.15.151:0/1039860065 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559df40b4d80 con 0x559df433b660 2023-07-21T22:20:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5d619b700 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df434de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5d699c700 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df434c3a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009f50 tx=0x7fc5c802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e262b5dc739bdff1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5b9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:20:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/1039860065 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5c803a070 con 0x559df433b660 2023-07-21T22:20:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/1039860065 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc5c009ac70 con 0x559df433b660 2023-07-21T22:20:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.702+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/1039860065 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc5c802b9b0 con 0x559df433b660 2023-07-21T22:20:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/1039860065 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc5c8006000 con 0x559df433b660 2023-07-21T22:20:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5ebe09b80 10 client.15816 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/1039860065 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559df40db1f0 con 0x559df433b660 2023-07-21T22:20:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/1039860065 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc5c009ac70 con 0x559df433b660 2023-07-21T22:20:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/1039860065 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc5c803d030 con 0x559df433b660 2023-07-21T22:20:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5ebe09b80 10 client.15816 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5ebe09b80 10 client.15816 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5ebe09b80 20 client.15816 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559df43ac020 0x559df43ae430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5ebe09b80 4 client.15816 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:20:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.703+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/1039860065 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559df4241ff0 con 0x559df43ac020 2023-07-21T22:20:06.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.704+0000 7fc5d619b700 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559df43ac020 0x559df43ae430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:06.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.705+0000 7fc5b9ffb700 10 client.15816 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:06.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.705+0000 7fc5d619b700 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559df43ac020 0x559df43ae430 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c6ac49d997b778a server_cookie=8ea235a03c56be19 in_seq=0 out_seq=0 2023-07-21T22:20:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.722+0000 7fc5b9ffb700 1 -- 172.21.15.151:0/1039860065 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559df4241ff0 con 0x559df43ac020 2023-07-21T22:20:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.722+0000 7fc5b9ffb700 10 client.15816 handle_command_reply: tid=0 2023-07-21T22:20:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 client.15816 shutdown 2023-07-21T22:20:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/1039860065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 msgr2=0x559df434c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df434c3a0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009f50 tx=0x7fc5c802bea0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/1039860065 shutdown_connections 2023-07-21T22:20:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559df43ac020 0x559df43ae430 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559df41916b0 0x559df434de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5b9ffb700 0 client.15816 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559df433b660 0x559df434c3a0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 --2- 172.21.15.151:0/1039860065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559df433b210 0x559df434e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/1039860065 >> 172.21.15.151:0/1039860065 conn(0x559df432aae0 msgr2=0x559df43533f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/1039860065 shutdown_connections 2023-07-21T22:20:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 1 -- 172.21.15.151:0/1039860065 wait complete. 2023-07-21T22:20:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.723+0000 7fc5ebe09b80 20 client.15816 trim_cache size 0 max 16384 2023-07-21T22:20:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:20:06.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:20:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:20:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:20:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 -- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc5bc0a1460 msgr2=0x7fc5bc0a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc5bc0a1460 0x7fc5bc0a3910 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc5c8009550 tx=0x7fc5c8004ad0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 -- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 msgr2=0x7fc5d0198210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 0x7fc5d0198210 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fc5c00098e0 tx=0x7fc5c0009580 comp rx=0 tx=0).stop 2023-07-21T22:20:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 -- 172.21.15.151:0/2236623838 shutdown_connections 2023-07-21T22:20:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc5bc0a1460 0x7fc5bc0a3910 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5d010c540 0x7fc5d019b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc5d00679a0 0x7fc5d0197cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 --2- 172.21.15.151:0/2236623838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5d00682b0 0x7fc5d0198210 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 -- 172.21.15.151:0/2236623838 >> 172.21.15.151:0/2236623838 conn(0x7fc5d0074760 msgr2=0x7fc5d00fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 -- 172.21.15.151:0/2236623838 shutdown_connections 2023-07-21T22:20:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:06.724+0000 7fc5d83ff700 1 -- 172.21.15.151:0/2236623838 wait complete. 2023-07-21T22:20:07.585 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-21T22:20:07.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-21T22:20:07.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.772+0000 7f0c999ff700 1 -- 172.21.15.151:0/4238920694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94100490 msgr2=0x7f0c9410c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.772+0000 7f0c999ff700 1 --2- 172.21.15.151:0/4238920694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94100490 0x7f0c9410c920 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00b0a0 tx=0x7f0c8c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.772+0000 7f0c999ff700 1 -- 172.21.15.151:0/4238920694 shutdown_connections 2023-07-21T22:20:07.817 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.772+0000 7f0c999ff700 1 --2- 172.21.15.151:0/4238920694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94100490 0x7f0c9410c920 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.772+0000 7f0c999ff700 1 --2- 172.21.15.151:0/4238920694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c94105af0 0x7f0c94105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.772+0000 7f0c999ff700 1 --2- 172.21.15.151:0/4238920694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c940ffae0 0x7f0c940fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.772+0000 7f0c999ff700 1 -- 172.21.15.151:0/4238920694 >> 172.21.15.151:0/4238920694 conn(0x7f0c940fb5e0 msgr2=0x7f0c940fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.772+0000 7f0c999ff700 1 -- 172.21.15.151:0/4238920694 shutdown_connections 2023-07-21T22:20:07.818 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.772+0000 7f0c999ff700 1 -- 172.21.15.151:0/4238920694 wait complete. 2023-07-21T22:20:07.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.773+0000 7f0c999ff700 1 Processor -- start 2023-07-21T22:20:07.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.773+0000 7f0c999ff700 1 -- start start 2023-07-21T22:20:07.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c999ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c940ffae0 0x7f0c9419b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c999ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c94100490 0x7f0c9419bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c999ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94105af0 0x7f0c94195a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c999ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c941960d0 con 0x7f0c94105af0 2023-07-21T22:20:07.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c999ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94196240 con 0x7f0c940ffae0 2023-07-21T22:20:07.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c999ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c94196400 con 0x7f0c94100490 2023-07-21T22:20:07.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c937fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94105af0 0x7f0c94195a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c937fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94105af0 0x7f0c94195a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32838/0 (socket says 172.21.15.151:32838) 2023-07-21T22:20:07.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c937fe700 1 -- 172.21.15.151:0/987470096 learned_addr learned my addr 172.21.15.151:0/987470096 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:07.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c927fc700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c94100490 0x7f0c9419bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.774+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c940ffae0 0x7f0c9419b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c937fe700 1 -- 172.21.15.151:0/987470096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c94100490 msgr2=0x7f0c9419bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c937fe700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c94100490 0x7f0c9419bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.822 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c937fe700 1 -- 172.21.15.151:0/987470096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c940ffae0 msgr2=0x7f0c9419b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c937fe700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c940ffae0 0x7f0c9419b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c937fe700 1 -- 172.21.15.151:0/987470096 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c8c009d00 con 0x7f0c94105af0 2023-07-21T22:20:07.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c940ffae0 0x7f0c9419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:07.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c937fe700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94105af0 0x7f0c94195a60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00b070 tx=0x7f0c8c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c989fd700 1 -- 172.21.15.151:0/987470096 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c00e040 con 0x7f0c94105af0 2023-07-21T22:20:07.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c999ff700 1 -- 172.21.15.151:0/987470096 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c94196680 con 0x7f0c94105af0 2023-07-21T22:20:07.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c989fd700 1 -- 172.21.15.151:0/987470096 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c8c009480 con 0x7f0c94105af0 2023-07-21T22:20:07.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c989fd700 1 -- 172.21.15.151:0/987470096 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c8c005040 con 0x7f0c94105af0 2023-07-21T22:20:07.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.775+0000 7f0c999ff700 1 -- 172.21.15.151:0/987470096 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c941a29e0 con 0x7f0c94105af0 2023-07-21T22:20:07.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.780+0000 7f0c989fd700 1 -- 172.21.15.151:0/987470096 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f0c8c01d480 con 0x7f0c94105af0 2023-07-21T22:20:07.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.781+0000 7f0cad336b80 1 Processor -- start 2023-07-21T22:20:07.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.781+0000 7f0cad336b80 1 -- start start 2023-07-21T22:20:07.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.781+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 0x559d54006600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.781+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540013d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.781+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 0x559d54001e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.781+0000 7f0cad336b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d53f06d30 con 0x559d54006b40 2023-07-21T22:20:07.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.781+0000 7f0cad336b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d53f59ac0 con 0x559d540019b0 2023-07-21T22:20:07.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.781+0000 7f0cad336b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d53f52f50 con 0x559d54006230 2023-07-21T22:20:07.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c92ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c92ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540013d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32854/0 (socket says 172.21.15.151:32854) 2023-07-21T22:20:07.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c92ffd700 1 -- 172.21.15.151:0/475502497 learned_addr learned my addr 172.21.15.151:0/475502497 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:07.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c927fc700 1 --2- 172.21.15.151:0/475502497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 0x559d54006600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c927fc700 1 --2- 172.21.15.151:0/475502497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 0x559d54001e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c989fd700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c7c0a13e0 0x7f0c7c0a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c92ffd700 1 -- 172.21.15.151:0/475502497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 msgr2=0x559d54006600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/475502497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 0x559d54006600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c92ffd700 1 -- 172.21.15.151:0/475502497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 msgr2=0x559d54001e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/475502497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 0x559d54001e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c92ffd700 1 -- 172.21.15.151:0/475502497 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d53d80e60 con 0x559d54006b40 2023-07-21T22:20:07.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.782+0000 7f0c989fd700 1 -- 172.21.15.151:0/987470096 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0c8c0ce2b0 con 0x7f0c94105af0 2023-07-21T22:20:07.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.783+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/475502497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540013d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009dc0 tx=0x7f0c840106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd92989b107b2338 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.783+0000 7f0c937fe700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c7c0a13e0 0x7f0c7c0a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.783+0000 7f0c79ffb700 1 -- 172.21.15.151:0/475502497 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84010e10 con 0x559d54006b40 2023-07-21T22:20:07.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.783+0000 7f0c79ffb700 1 -- 172.21.15.151:0/475502497 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c84015070 con 0x559d54006b40 2023-07-21T22:20:07.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.783+0000 7f0c79ffb700 1 -- 172.21.15.151:0/475502497 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c840116a0 con 0x559d54006b40 2023-07-21T22:20:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0cad336b80 1 -- 172.21.15.151:0/475502497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 msgr2=0x559d540013d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0c937fe700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c7c0a13e0 0x7f0c7c0a3890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0cb930 tx=0x7f0c8c009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0cad336b80 1 --2- 172.21.15.151:0/475502497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540013d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009dc0 tx=0x7f0c840106b0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0cad336b80 1 -- 172.21.15.151:0/475502497 shutdown_connections 2023-07-21T22:20:07.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0cad336b80 1 --2- 172.21.15.151:0/475502497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 0x559d54001e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0cad336b80 1 --2- 172.21.15.151:0/475502497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 0x559d54006600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0cad336b80 1 --2- 172.21.15.151:0/475502497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540013d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0cad336b80 1 -- 172.21.15.151:0/475502497 >> 172.21.15.151:0/475502497 conn(0x559d53ff6f70 msgr2=0x559d53ffc8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0cad336b80 1 -- 172.21.15.151:0/475502497 shutdown_connections 2023-07-21T22:20:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.784+0000 7f0cad336b80 1 -- 172.21.15.151:0/475502497 wait complete. 2023-07-21T22:20:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.785+0000 7f0cad336b80 1 -- start start 2023-07-21T22:20:07.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.785+0000 7f0cad336b80 1 Processor -- start 2023-07-21T22:20:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5400dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5400ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 0x559d5400b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0cad336b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d53ef2b40 con 0x559d54006230 2023-07-21T22:20:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0cad336b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d53ef2840 con 0x559d54006b40 2023-07-21T22:20:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0cad336b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d53dd69a0 con 0x559d540019b0 2023-07-21T22:20:07.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0cad336b80 10 client.0 _ll_register_callbacks cb 0x559d53ef07e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c92ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5400ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c92ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5400ae90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32860/0 (socket says 172.21.15.151:32860) 2023-07-21T22:20:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c92ffd700 1 -- 172.21.15.151:0/1395391760 learned_addr learned my addr 172.21.15.151:0/1395391760 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c927fc700 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5400dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c92ffd700 1 -- 172.21.15.151:0/1395391760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 msgr2=0x559d5400dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c927fc700 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 0x559d5400b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5400dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c92ffd700 1 -- 172.21.15.151:0/1395391760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 msgr2=0x559d5400b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 0x559d5400b510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c92ffd700 1 -- 172.21.15.151:0/1395391760 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c840099f0 con 0x559d54006230 2023-07-21T22:20:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.786+0000 7f0c927fc700 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 0x559d5400b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.787+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5400ae90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d90 tx=0x7f0c8401cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82c6d95a0eb633b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.787+0000 7f0c72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:20:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.787+0000 7f0c72ffd700 1 -- 172.21.15.151:0/1395391760 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84020040 con 0x559d54006230 2023-07-21T22:20:07.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.787+0000 7f0cad336b80 1 -- 172.21.15.151:0/1395391760 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d53eac570 con 0x559d54006230 2023-07-21T22:20:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.787+0000 7f0c72ffd700 1 -- 172.21.15.151:0/1395391760 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0c84017070 con 0x559d54006230 2023-07-21T22:20:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.787+0000 7f0c72ffd700 1 -- 172.21.15.151:0/1395391760 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c8401c890 con 0x559d54006230 2023-07-21T22:20:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.787+0000 7f0cad336b80 10 client.15828 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.787+0000 7f0cad336b80 1 -- 172.21.15.151:0/1395391760 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559d53d69ce0 con 0x559d54006230 2023-07-21T22:20:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.788+0000 7f0c72ffd700 1 -- 172.21.15.151:0/1395391760 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559d53eac570 con 0x559d54006230 2023-07-21T22:20:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.788+0000 7f0c72ffd700 1 -- 172.21.15.151:0/1395391760 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0c84004b20 con 0x559d54006230 2023-07-21T22:20:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.788+0000 7f0cad336b80 10 client.15828 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:07.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.788+0000 7f0cad336b80 10 client.15828 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:07.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.788+0000 7f0cad336b80 20 client.15828 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:07.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.788+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d5401b4e0 0x559d5401d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.788+0000 7f0cad336b80 4 client.15828 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:07.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.788+0000 7f0cad336b80 1 -- 172.21.15.151:0/1395391760 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d53f4bf30 con 0x559d5401b4e0 2023-07-21T22:20:07.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.788+0000 7f0c927fc700 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d5401b4e0 0x559d5401d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.789+0000 7f0c927fc700 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d5401b4e0 0x559d5401d8f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a4995eca0ffb541 server_cookie=f73026501789d2d0 in_seq=0 out_seq=0 2023-07-21T22:20:07.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.789+0000 7f0c72ffd700 10 client.15828 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:07.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0c72ffd700 1 -- 172.21.15.151:0/1395391760 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559d53f4bf30 con 0x559d5401b4e0 2023-07-21T22:20:07.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0c72ffd700 10 client.15828 handle_command_reply: tid=0 2023-07-21T22:20:07.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 client.15828 shutdown 2023-07-21T22:20:07.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 -- 172.21.15.151:0/1395391760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 msgr2=0x559d5400ae90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5400ae90 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0c84009d90 tx=0x7f0c8401cb70 comp rx=0 tx=0).stop 2023-07-21T22:20:07.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 -- 172.21.15.151:0/1395391760 shutdown_connections 2023-07-21T22:20:07.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d5401b4e0 0x559d5401d8f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 0x559d5400b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5400dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0c72ffd700 0 client.15828 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:07.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1395391760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5400ae90 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 -- 172.21.15.151:0/1395391760 >> 172.21.15.151:0/1395391760 conn(0x559d53ff6f70 msgr2=0x559d53ffc4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.790+0000 7f0cad336b80 1 -- 172.21.15.151:0/1395391760 shutdown_connections 2023-07-21T22:20:07.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.791+0000 7f0cad336b80 1 -- 172.21.15.151:0/1395391760 wait complete. 2023-07-21T22:20:07.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.791+0000 7f0cad336b80 20 client.15828 trim_cache size 0 max 16384 2023-07-21T22:20:07.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0cad336b80 1 Processor -- start 2023-07-21T22:20:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0cad336b80 1 -- start start 2023-07-21T22:20:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 0x559d54017a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 0x559d54012600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540011b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0cad336b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d53f4bf60 con 0x559d54006b40 2023-07-21T22:20:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0cad336b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d53eac5a0 con 0x559d540019b0 2023-07-21T22:20:07.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0cad336b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d53ffdeb0 con 0x559d54006230 2023-07-21T22:20:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0c927fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0c927fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32862/0 (socket says 172.21.15.151:32862) 2023-07-21T22:20:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.812+0000 7f0c927fc700 1 -- 172.21.15.151:0/1867156598 learned_addr learned my addr 172.21.15.151:0/1867156598 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c927fc700 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 0x559d54017a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 0x559d54012600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c927fc700 1 -- 172.21.15.151:0/1867156598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 msgr2=0x559d54012600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c927fc700 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 0x559d54012600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c927fc700 1 -- 172.21.15.151:0/1867156598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 msgr2=0x559d54017a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c927fc700 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 0x559d54017a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c927fc700 1 -- 172.21.15.151:0/1867156598 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d53da72d0 con 0x559d54006b40 2023-07-21T22:20:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 0x559d54012600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c927fc700 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540011b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0c88004790 tx=0x7f0c88009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4897949a8d105d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.813+0000 7f0c7a7fc700 1 -- 172.21.15.151:0/1867156598 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88021e10 con 0x559d54006b40 2023-07-21T22:20:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.814+0000 7f0c7a7fc700 1 -- 172.21.15.151:0/1867156598 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c88004cc0 con 0x559d54006b40 2023-07-21T22:20:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.814+0000 7f0c7a7fc700 1 -- 172.21.15.151:0/1867156598 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c88005550 con 0x559d54006b40 2023-07-21T22:20:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.814+0000 7f0cad336b80 1 -- 172.21.15.151:0/1867156598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 msgr2=0x559d540011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.814+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540011b0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f0c88004790 tx=0x7f0c88009750 comp rx=0 tx=0).stop 2023-07-21T22:20:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.814+0000 7f0cad336b80 1 -- 172.21.15.151:0/1867156598 shutdown_connections 2023-07-21T22:20:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.814+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d540019b0 0x559d54017a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.814+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006b40 0x559d540011b0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.814+0000 7f0cad336b80 1 --2- 172.21.15.151:0/1867156598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d54006230 0x559d54012600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.814+0000 7f0cad336b80 1 -- 172.21.15.151:0/1867156598 >> 172.21.15.151:0/1867156598 conn(0x559d53ff6f70 msgr2=0x559d54000aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.815+0000 7f0cad336b80 1 -- 172.21.15.151:0/1867156598 shutdown_connections 2023-07-21T22:20:07.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.815+0000 7f0cad336b80 1 -- 172.21.15.151:0/1867156598 wait complete. 2023-07-21T22:20:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.815+0000 7f0cad336b80 1 -- start start 2023-07-21T22:20:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.815+0000 7f0cad336b80 1 Processor -- start 2023-07-21T22:20:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5406d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5406de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0cad336b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 0x559d54067c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0cad336b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d54068240 con 0x559d54006230 2023-07-21T22:20:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0cad336b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d540683b0 con 0x559d54006b40 2023-07-21T22:20:07.864 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0cad336b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d54068570 con 0x559d540019b0 2023-07-21T22:20:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0cad336b80 10 client.0 _ll_register_callbacks cb 0x7f0c88009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0c927fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5406d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0c92ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5406de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0c927fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5406d8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54504/0 (socket says 172.21.15.151:54504) 2023-07-21T22:20:07.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0c927fc700 1 -- 172.21.15.151:0/2286569317 learned_addr learned my addr 172.21.15.151:0/2286569317 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.816+0000 7f0c927fc700 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 0x559d54067c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c92ffd700 1 -- 172.21.15.151:0/2286569317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 msgr2=0x559d5406d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5406d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c92ffd700 1 -- 172.21.15.151:0/2286569317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 msgr2=0x559d54067c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 0x559d54067c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c92ffd700 1 -- 172.21.15.151:0/2286569317 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d53d69ce0 con 0x559d54006230 2023-07-21T22:20:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c927fc700 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:07.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c92ffd700 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5406de00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0c84004f30 tx=0x7f0c8401c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1899dc77d881997 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c72ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:20:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c72ffd700 1 -- 172.21.15.151:0/2286569317 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c84020040 con 0x559d54006230 2023-07-21T22:20:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0cad336b80 1 -- 172.21.15.151:0/2286569317 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c84015070 con 0x559d54006230 2023-07-21T22:20:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.817+0000 7f0c72ffd700 1 -- 172.21.15.151:0/2286569317 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0c84017040 con 0x559d54006230 2023-07-21T22:20:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0c72ffd700 1 -- 172.21.15.151:0/2286569317 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c8401ae50 con 0x559d54006230 2023-07-21T22:20:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0cad336b80 10 client.15834 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:07.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0cad336b80 1 -- 172.21.15.151:0/2286569317 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f0c88029040 con 0x559d54006230 2023-07-21T22:20:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0c72ffd700 1 -- 172.21.15.151:0/2286569317 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c84015070 con 0x559d54006230 2023-07-21T22:20:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0c72ffd700 1 -- 172.21.15.151:0/2286569317 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0c84011820 con 0x559d54006230 2023-07-21T22:20:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0cad336b80 10 client.15834 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0cad336b80 10 client.15834 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0cad336b80 20 client.15834 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0cad336b80 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d540753a0 0x559d540777b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0cad336b80 4 client.15834 mds_command: new command op to 24599 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-21T22:20:07.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.818+0000 7f0cad336b80 1 -- 172.21.15.151:0/2286569317 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x559d53f0e0d0 con 0x559d540753a0 2023-07-21T22:20:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.819+0000 7f0c927fc700 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d540753a0 0x559d540777b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.819+0000 7f0c72ffd700 10 client.15834 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.819+0000 7f0c927fc700 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d540753a0 0x559d540777b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d044f4f37d4acf02 server_cookie=937741d9272d7688 in_seq=0 out_seq=0 2023-07-21T22:20:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0c72ffd700 1 -- 172.21.15.151:0/2286569317 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x559d53f0e0d0 con 0x559d540753a0 2023-07-21T22:20:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0c72ffd700 10 client.15834 handle_command_reply: tid=0 2023-07-21T22:20:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0cad336b80 1 client.15834 shutdown 2023-07-21T22:20:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0cad336b80 1 -- 172.21.15.151:0/2286569317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 msgr2=0x559d5406de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0cad336b80 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5406de00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f0c84004f30 tx=0x7f0c8401c940 comp rx=0 tx=0).stop 2023-07-21T22:20:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0cad336b80 1 -- 172.21.15.151:0/2286569317 shutdown_connections 2023-07-21T22:20:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0cad336b80 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d540753a0 0x559d540777b0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0cad336b80 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d54006b40 0x559d54067c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0cad336b80 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d540019b0 0x559d5406d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0cad336b80 1 --2- 172.21.15.151:0/2286569317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d54006230 0x559d5406de00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0c72ffd700 0 client.15834 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.820+0000 7f0cad336b80 1 -- 172.21.15.151:0/2286569317 >> 172.21.15.151:0/2286569317 conn(0x559d53ff6f70 msgr2=0x559d54000aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0cad336b80 1 -- 172.21.15.151:0/2286569317 shutdown_connections 2023-07-21T22:20:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0cad336b80 1 -- 172.21.15.151:0/2286569317 wait complete. 2023-07-21T22:20:07.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0cad336b80 20 client.15834 trim_cache size 0 max 16384 2023-07-21T22:20:07.873 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:20:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "return_code": 0, 2023-07-21T22:20:07.873 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_tag": "ec38d3a5-93f8-4072-bfe2-c7872d39c48a", 2023-07-21T22:20:07.874 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": "asynchronous" 2023-07-21T22:20:07.874 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:20:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 -- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c7c0a13e0 msgr2=0x7f0c7c0a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c7c0a13e0 0x7f0c7c0a3890 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c0cb930 tx=0x7f0c8c009040 comp rx=0 tx=0).stop 2023-07-21T22:20:07.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 -- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94105af0 msgr2=0x7f0c94195a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:07.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94105af0 0x7f0c94195a60 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0c8c00b070 tx=0x7f0c8c00bce0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 -- 172.21.15.151:0/987470096 shutdown_connections 2023-07-21T22:20:07.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c7c0a13e0 0x7f0c7c0a3890 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c940ffae0 0x7f0c9419b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c94105af0 0x7f0c94195a60 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 --2- 172.21.15.151:0/987470096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c94100490 0x7f0c9419bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.821+0000 7f0c999ff700 1 -- 172.21.15.151:0/987470096 >> 172.21.15.151:0/987470096 conn(0x7f0c940fb5e0 msgr2=0x7f0c940fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.822+0000 7f0c999ff700 1 -- 172.21.15.151:0/987470096 shutdown_connections 2023-07-21T22:20:07.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:07.822+0000 7f0c999ff700 1 -- 172.21.15.151:0/987470096 wait complete. 2023-07-21T22:20:07.888 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:20:08.046 INFO:teuthology.orchestra.run.smithi151.stderr:2100000 of 50000000 tuples (4%) done (elapsed 31.54 s, remaining 719.37 s) 2023-07-21T22:20:08.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.083+0000 7f811a5ff700 1 -- 172.21.15.151:0/2560243411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81140728b0 msgr2=0x7f8114072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.083+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2560243411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81140728b0 0x7f8114072c80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f8104009990 tx=0x7f8104009ca0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.083+0000 7f811a5ff700 1 -- 172.21.15.151:0/2560243411 shutdown_connections 2023-07-21T22:20:08.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.083+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2560243411 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811410c310 0x7f811410e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.083+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2560243411 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81140728b0 0x7f8114072c80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.083+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2560243411 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81140731c0 0x7f811410bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.083+0000 7f811a5ff700 1 -- 172.21.15.151:0/2560243411 >> 172.21.15.151:0/2560243411 conn(0x7f81140fb5f0 msgr2=0x7f81140fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.084+0000 7f811a5ff700 1 -- 172.21.15.151:0/2560243411 shutdown_connections 2023-07-21T22:20:08.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.084+0000 7f811a5ff700 1 -- 172.21.15.151:0/2560243411 wait complete. 2023-07-21T22:20:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.085+0000 7f811a5ff700 1 Processor -- start 2023-07-21T22:20:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.085+0000 7f811a5ff700 1 -- start start 2023-07-21T22:20:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.085+0000 7f811a5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81140728b0 0x7f8114197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.085+0000 7f811a5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81140731c0 0x7f81141982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.085+0000 7f811a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811410c310 0x7f811419c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.085+0000 7f811a5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811419cd50 con 0x7f81140731c0 2023-07-21T22:20:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f811a5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811419cec0 con 0x7f81140728b0 2023-07-21T22:20:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f811a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811419d080 con 0x7f811410c310 2023-07-21T22:20:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8113fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81140728b0 0x7f8114197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f81137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81140731c0 0x7f81141982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8113fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81140728b0 0x7f8114197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52614/0 (socket says 172.21.15.151:52614) 2023-07-21T22:20:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8113fff700 1 -- 172.21.15.151:0/2003030897 learned_addr learned my addr 172.21.15.151:0/2003030897 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8118b9c700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811410c310 0x7f811419c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8113fff700 1 -- 172.21.15.151:0/2003030897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811410c310 msgr2=0x7f811419c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8113fff700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811410c310 0x7f811419c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8113fff700 1 -- 172.21.15.151:0/2003030897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81140731c0 msgr2=0x7f81141982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8113fff700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81140731c0 0x7f81141982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8113fff700 1 -- 172.21.15.151:0/2003030897 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81040095f0 con 0x7f81140728b0 2023-07-21T22:20:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8118b9c700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811410c310 0x7f811419c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:08.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.086+0000 7f8113fff700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81140728b0 0x7f8114197d70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8104000c00 tx=0x7f8104004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.087+0000 7f81117fa700 1 -- 172.21.15.151:0/2003030897 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810401d070 con 0x7f81140728b0 2023-07-21T22:20:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.087+0000 7f811a5ff700 1 -- 172.21.15.151:0/2003030897 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811419d300 con 0x7f81140728b0 2023-07-21T22:20:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.087+0000 7f81117fa700 1 -- 172.21.15.151:0/2003030897 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8104022470 con 0x7f81140728b0 2023-07-21T22:20:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.087+0000 7f81117fa700 1 -- 172.21.15.151:0/2003030897 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8104017650 con 0x7f81140728b0 2023-07-21T22:20:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.087+0000 7f811a5ff700 1 -- 172.21.15.151:0/2003030897 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81141a4ba0 con 0x7f81140728b0 2023-07-21T22:20:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.091+0000 7f81117fa700 1 -- 172.21.15.151:0/2003030897 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f81040225e0 con 0x7f81140728b0 2023-07-21T22:20:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.092+0000 7f81117fa700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f80fc0a1460 0x7f80fc0a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.092+0000 7f81117fa700 1 -- 172.21.15.151:0/2003030897 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f81040ce2e0 con 0x7f81140728b0 2023-07-21T22:20:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.093+0000 7f812de67b80 1 Processor -- start 2023-07-21T22:20:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.093+0000 7f812de67b80 1 -- start start 2023-07-21T22:20:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.093+0000 7f81137fe700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f80fc0a1460 0x7f80fc0a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.093+0000 7f812de67b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23ac1b0 0x556ac23ac580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.093+0000 7f812de67b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23acac0 0x556ac23a7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.093+0000 7f812de67b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a7930 0x556ac23a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.093+0000 7f812de67b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac22accb0 con 0x556ac23acac0 2023-07-21T22:20:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.093+0000 7f812de67b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac22ffa40 con 0x556ac23ac1b0 2023-07-21T22:20:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.093+0000 7f812de67b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac22f8ed0 con 0x556ac23a7930 2023-07-21T22:20:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8113fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23ac1b0 0x556ac23ac580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8113fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23ac1b0 0x556ac23ac580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52624/0 (socket says 172.21.15.151:52624) 2023-07-21T22:20:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8113fff700 1 -- 172.21.15.151:0/3972697524 learned_addr learned my addr 172.21.15.151:0/3972697524 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8118b9c700 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a7930 0x556ac23a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f81137fe700 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23acac0 0x556ac23a7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8113fff700 1 -- 172.21.15.151:0/3972697524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a7930 msgr2=0x556ac23a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8113fff700 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a7930 0x556ac23a7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8113fff700 1 -- 172.21.15.151:0/3972697524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23acac0 msgr2=0x556ac23a7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8113fff700 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23acac0 0x556ac23a7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f81137fe700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f80fc0a1460 0x7f80fc0a3910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8114199380 tx=0x7f8108009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8113fff700 1 -- 172.21.15.151:0/3972697524 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ac2126de0 con 0x556ac23ac1b0 2023-07-21T22:20:08.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8118b9c700 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a7930 0x556ac23a7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f8113fff700 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23ac1b0 0x556ac23ac580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f810400f740 tx=0x7f8104096f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6acb2ec9d7ae9a2e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f80fa7fc700 1 -- 172.21.15.151:0/3972697524 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810409f030 con 0x556ac23ac1b0 2023-07-21T22:20:08.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f80fa7fc700 1 -- 172.21.15.151:0/3972697524 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81040a10d0 con 0x556ac23ac1b0 2023-07-21T22:20:08.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.094+0000 7f80fa7fc700 1 -- 172.21.15.151:0/3972697524 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810409a950 con 0x556ac23ac1b0 2023-07-21T22:20:08.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.095+0000 7f812de67b80 1 -- 172.21.15.151:0/3972697524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23ac1b0 msgr2=0x556ac23ac580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.095+0000 7f812de67b80 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23ac1b0 0x556ac23ac580 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f810400f740 tx=0x7f8104096f10 comp rx=0 tx=0).stop 2023-07-21T22:20:08.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.095+0000 7f812de67b80 1 -- 172.21.15.151:0/3972697524 shutdown_connections 2023-07-21T22:20:08.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.095+0000 7f812de67b80 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23ac1b0 0x556ac23ac580 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.095+0000 7f812de67b80 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a7930 0x556ac23a7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.095+0000 7f812de67b80 1 --2- 172.21.15.151:0/3972697524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23acac0 0x556ac23a7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.095+0000 7f812de67b80 1 -- 172.21.15.151:0/3972697524 >> 172.21.15.151:0/3972697524 conn(0x556ac239cef0 msgr2=0x556ac23a2830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.095+0000 7f812de67b80 1 -- 172.21.15.151:0/3972697524 shutdown_connections 2023-07-21T22:20:08.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.096+0000 7f812de67b80 1 -- 172.21.15.151:0/3972697524 wait complete. 2023-07-21T22:20:08.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.096+0000 7f812de67b80 1 -- start start 2023-07-21T22:20:08.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.096+0000 7f812de67b80 1 Processor -- start 2023-07-21T22:20:08.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f812de67b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f812de67b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23ac1b0 0x556ac23b0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f812de67b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23acac0 0x556ac23b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f812de67b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac2298ac0 con 0x556ac23a7930 2023-07-21T22:20:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f812de67b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac22987c0 con 0x556ac23acac0 2023-07-21T22:20:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f812de67b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac217c920 con 0x556ac23ac1b0 2023-07-21T22:20:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f812de67b80 10 client.0 _ll_register_callbacks cb 0x556ac2296760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:08.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f8113fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f8113fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b3ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32916/0 (socket says 172.21.15.151:32916) 2023-07-21T22:20:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.097+0000 7f8113fff700 1 -- 172.21.15.151:0/727169709 learned_addr learned my addr 172.21.15.151:0/727169709 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.098+0000 7f8113fff700 1 -- 172.21.15.151:0/727169709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23ac1b0 msgr2=0x556ac23b0d30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:20:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.098+0000 7f8113fff700 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23ac1b0 0x556ac23b0d30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.098+0000 7f8113fff700 1 -- 172.21.15.151:0/727169709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23acac0 msgr2=0x556ac23b12d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:20:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.098+0000 7f8113fff700 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23acac0 0x556ac23b12d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.098+0000 7f8113fff700 1 -- 172.21.15.151:0/727169709 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81141a4ba0 con 0x556ac23a7930 2023-07-21T22:20:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.098+0000 7f8113fff700 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b3ab0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f810409b860 tx=0x7f81040a3490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32abbaaf862c7c81 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.098+0000 7f80f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:20:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.099+0000 7f80f37fe700 1 -- 172.21.15.151:0/727169709 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810409f230 con 0x556ac23a7930 2023-07-21T22:20:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.099+0000 7f80f37fe700 1 -- 172.21.15.151:0/727169709 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f81040cd070 con 0x556ac23a7930 2023-07-21T22:20:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.099+0000 7f812de67b80 1 -- 172.21.15.151:0/727169709 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ac22524f0 con 0x556ac23a7930 2023-07-21T22:20:08.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.099+0000 7f80f37fe700 1 -- 172.21.15.151:0/727169709 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f81040092b0 con 0x556ac23a7930 2023-07-21T22:20:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.099+0000 7f812de67b80 10 client.15846 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.099+0000 7f812de67b80 1 -- 172.21.15.151:0/727169709 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x556ac210fc60 con 0x556ac23a7930 2023-07-21T22:20:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.100+0000 7f80f37fe700 1 -- 172.21.15.151:0/727169709 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556ac22524f0 con 0x556ac23a7930 2023-07-21T22:20:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.100+0000 7f80f37fe700 1 -- 172.21.15.151:0/727169709 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f81040cb2b0 con 0x556ac23a7930 2023-07-21T22:20:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.100+0000 7f812de67b80 10 client.15846 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.100+0000 7f812de67b80 10 client.15846 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:08.157 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.100+0000 7f812de67b80 20 client.15846 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.100+0000 7f812de67b80 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ac23c9450 0x556ac23cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.100+0000 7f812de67b80 4 client.15846 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.100+0000 7f812de67b80 1 -- 172.21.15.151:0/727169709 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ac22f1eb0 con 0x556ac23c9450 2023-07-21T22:20:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.100+0000 7f81137fe700 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ac23c9450 0x556ac23cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.101+0000 7f80f37fe700 10 client.15846 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.101+0000 7f81137fe700 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ac23c9450 0x556ac23cb830 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8febc91345d640 server_cookie=146386f052d26996 in_seq=0 out_seq=0 2023-07-21T22:20:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.101+0000 7f80f37fe700 1 -- 172.21.15.151:0/727169709 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556ac22f1eb0 con 0x556ac23c9450 2023-07-21T22:20:08.158 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.101+0000 7f80f37fe700 10 client.15846 handle_command_reply: tid=0 2023-07-21T22:20:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.101+0000 7f812de67b80 1 client.15846 shutdown 2023-07-21T22:20:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 -- 172.21.15.151:0/727169709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 msgr2=0x556ac23b3ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b3ab0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f810409b860 tx=0x7f81040a3490 comp rx=0 tx=0).stop 2023-07-21T22:20:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 -- 172.21.15.151:0/727169709 shutdown_connections 2023-07-21T22:20:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ac23c9450 0x556ac23cb830 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23acac0 0x556ac23b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b3ab0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.159 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 --2- 172.21.15.151:0/727169709 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23ac1b0 0x556ac23b0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 -- 172.21.15.151:0/727169709 >> 172.21.15.151:0/727169709 conn(0x556ac239cef0 msgr2=0x556ac23a2420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f80f37fe700 0 client.15846 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 -- 172.21.15.151:0/727169709 shutdown_connections 2023-07-21T22:20:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 1 -- 172.21.15.151:0/727169709 wait complete. 2023-07-21T22:20:08.160 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.102+0000 7f812de67b80 20 client.15846 trim_cache size 0 max 16384 2023-07-21T22:20:08.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.122+0000 7f812de67b80 1 Processor -- start 2023-07-21T22:20:08.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.122+0000 7f812de67b80 1 -- start start 2023-07-21T22:20:08.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.122+0000 7f812de67b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23a12c0 0x556ac23c0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f812de67b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac239cef0 0x556ac23b3650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f812de67b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23cb460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f812de67b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac23b1ea0 con 0x556ac23a7930 2023-07-21T22:20:08.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f812de67b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac22f1eb0 con 0x556ac23a12c0 2023-07-21T22:20:08.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f812de67b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac22524f0 con 0x556ac239cef0 2023-07-21T22:20:08.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f81137fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac239cef0 0x556ac23b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f81137fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac239cef0 0x556ac23b3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54568/0 (socket says 172.21.15.151:54568) 2023-07-21T22:20:08.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f81137fe700 1 -- 172.21.15.151:0/1558604170 learned_addr learned my addr 172.21.15.151:0/1558604170 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:08.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f8113fff700 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23a12c0 0x556ac23c0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f8118b9c700 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23cb460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f81137fe700 1 -- 172.21.15.151:0/1558604170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23a12c0 msgr2=0x556ac23c0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:08.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f81137fe700 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23a12c0 0x556ac23c0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f81137fe700 1 -- 172.21.15.151:0/1558604170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 msgr2=0x556ac23cb460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:08.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f81137fe700 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23cb460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f81137fe700 1 -- 172.21.15.151:0/1558604170 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ac214d250 con 0x556ac239cef0 2023-07-21T22:20:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f8118b9c700 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.123+0000 7f8113fff700 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23a12c0 0x556ac23c0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.124+0000 7f81137fe700 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac239cef0 0x556ac23b3650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x556ac23a85b0 tx=0x7f8108014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2f1f8e86c535f64 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.124+0000 7f80faffd700 1 -- 172.21.15.151:0/1558604170 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108029070 con 0x556ac239cef0 2023-07-21T22:20:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.124+0000 7f80faffd700 1 -- 172.21.15.151:0/1558604170 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8108004830 con 0x556ac239cef0 2023-07-21T22:20:08.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.124+0000 7f80faffd700 1 -- 172.21.15.151:0/1558604170 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8108024070 con 0x556ac239cef0 2023-07-21T22:20:08.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 -- 172.21.15.151:0/1558604170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac239cef0 msgr2=0x556ac23b3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac239cef0 0x556ac23b3650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x556ac23a85b0 tx=0x7f8108014000 comp rx=0 tx=0).stop 2023-07-21T22:20:08.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 -- 172.21.15.151:0/1558604170 shutdown_connections 2023-07-21T22:20:08.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac23a12c0 0x556ac23c0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23cb460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 --2- 172.21.15.151:0/1558604170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac239cef0 0x556ac23b3650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 -- 172.21.15.151:0/1558604170 >> 172.21.15.151:0/1558604170 conn(0x556ac23c56a0 msgr2=0x556ac23a5960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 -- 172.21.15.151:0/1558604170 shutdown_connections 2023-07-21T22:20:08.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 -- 172.21.15.151:0/1558604170 wait complete. 2023-07-21T22:20:08.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 -- start start 2023-07-21T22:20:08.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.125+0000 7f812de67b80 1 Processor -- start 2023-07-21T22:20:08.183 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f812de67b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac239cef0 0x556ac23afb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f812de67b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a12c0 0x556ac23b0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f812de67b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f812de67b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac241d210 con 0x556ac23a7930 2023-07-21T22:20:08.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f812de67b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac241d350 con 0x556ac239cef0 2023-07-21T22:20:08.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f812de67b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ac241d510 con 0x556ac23a12c0 2023-07-21T22:20:08.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f812de67b80 10 client.0 _ll_register_callbacks cb 0x7f8104097540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:08.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f8118b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f81137fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a12c0 0x556ac23b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f8113fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac239cef0 0x556ac23afb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f81137fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a12c0 0x556ac23b0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54574/0 (socket says 172.21.15.151:54574) 2023-07-21T22:20:08.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f81137fe700 1 -- 172.21.15.151:0/1055099780 learned_addr learned my addr 172.21.15.151:0/1055099780 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:08.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.126+0000 7f8113fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac239cef0 0x556ac23afb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52652/0 (socket says 172.21.15.151:52652) 2023-07-21T22:20:08.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f8118b9c700 1 -- 172.21.15.151:0/1055099780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a12c0 msgr2=0x556ac23b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f8118b9c700 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a12c0 0x556ac23b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f8118b9c700 1 -- 172.21.15.151:0/1055099780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac239cef0 msgr2=0x556ac23afb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f8118b9c700 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac239cef0 0x556ac23afb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f8118b9c700 1 -- 172.21.15.151:0/1055099780 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81141a4ba0 con 0x556ac23a7930 2023-07-21T22:20:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f81137fe700 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a12c0 0x556ac23b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f8113fff700 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac239cef0 0x556ac23afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f8118b9c700 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b05a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f810c0042c0 tx=0x7f810c0045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a930424499ff817 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:08.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f80f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:20:08.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f80f37fe700 1 -- 172.21.15.151:0/1055099780 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c004db0 con 0x556ac23a7930 2023-07-21T22:20:08.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f812de67b80 1 -- 172.21.15.151:0/1055099780 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f81040a10d0 con 0x556ac23a7930 2023-07-21T22:20:08.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.127+0000 7f80f37fe700 1 -- 172.21.15.151:0/1055099780 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f810c0077d0 con 0x556ac23a7930 2023-07-21T22:20:08.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f80f37fe700 1 -- 172.21.15.151:0/1055099780 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f810c007990 con 0x556ac23a7930 2023-07-21T22:20:08.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f812de67b80 10 client.15852 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:08.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f812de67b80 1 -- 172.21.15.151:0/1055099780 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f8108017070 con 0x556ac23a7930 2023-07-21T22:20:08.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f80f37fe700 1 -- 172.21.15.151:0/1055099780 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f81040a10d0 con 0x556ac23a7930 2023-07-21T22:20:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f80f37fe700 1 -- 172.21.15.151:0/1055099780 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f810c01c030 con 0x556ac23a7930 2023-07-21T22:20:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f812de67b80 10 client.15852 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f812de67b80 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f812de67b80 20 client.15852 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f812de67b80 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ac23ac1b0 0x556ac2420db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f812de67b80 4 client.15852 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:20:08.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.128+0000 7f812de67b80 1 -- 172.21.15.151:0/1055099780 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x556ac22b4050 con 0x556ac23ac1b0 2023-07-21T22:20:08.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.129+0000 7f8113fff700 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ac23ac1b0 0x556ac2420db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:08.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.129+0000 7f8113fff700 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ac23ac1b0 0x556ac2420db0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33e9542e6786d97d server_cookie=8cb6354c69f3e97e in_seq=0 out_seq=0 2023-07-21T22:20:08.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.129+0000 7f80f37fe700 10 client.15852 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:08.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.129+0000 7f80f37fe700 1 -- 172.21.15.151:0/1055099780 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x556ac22b4050 con 0x556ac23ac1b0 2023-07-21T22:20:08.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.129+0000 7f80f37fe700 10 client.15852 handle_command_reply: tid=0 2023-07-21T22:20:08.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.129+0000 7f812de67b80 1 client.15852 shutdown 2023-07-21T22:20:08.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.129+0000 7f812de67b80 1 -- 172.21.15.151:0/1055099780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 msgr2=0x556ac23b05a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.129+0000 7f812de67b80 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b05a0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f810c0042c0 tx=0x7f810c0045d0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f812de67b80 1 -- 172.21.15.151:0/1055099780 shutdown_connections 2023-07-21T22:20:08.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f812de67b80 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ac23ac1b0 0x556ac2420db0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f812de67b80 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ac239cef0 0x556ac23afb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f812de67b80 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ac23a7930 0x556ac23b05a0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f812de67b80 1 --2- 172.21.15.151:0/1055099780 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ac23a12c0 0x556ac23b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f812de67b80 1 -- 172.21.15.151:0/1055099780 >> 172.21.15.151:0/1055099780 conn(0x556ac23c56a0 msgr2=0x556ac23a22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f80f37fe700 0 client.15852 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:08.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f812de67b80 1 -- 172.21.15.151:0/1055099780 shutdown_connections 2023-07-21T22:20:08.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f812de67b80 1 -- 172.21.15.151:0/1055099780 wait complete. 2023-07-21T22:20:08.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.130+0000 7f812de67b80 20 client.15852 trim_cache size 0 max 16384 2023-07-21T22:20:08.196 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:20:08.197 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:20:08.197 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:20:08.197 INFO:teuthology.orchestra.run.smithi151.stdout: "ec38d3a5-93f8-4072-bfe2-c7872d39c48a": { 2023-07-21T22:20:08.197 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:20:08.198 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "ec38d3a5-93f8-4072-bfe2-c7872d39c48a", 2023-07-21T22:20:08.198 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:20:08.198 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:20:08.198 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:20:08.198 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:20:08.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 -- 172.21.15.151:0/2003030897 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f80fc0a1460 msgr2=0x7f80fc0a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f80fc0a1460 0x7f80fc0a3910 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f8114199380 tx=0x7f8108009260 comp rx=0 tx=0).stop 2023-07-21T22:20:08.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 -- 172.21.15.151:0/2003030897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81140728b0 msgr2=0x7f8114197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:08.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81140728b0 0x7f8114197d70 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8104000c00 tx=0x7f8104004730 comp rx=0 tx=0).stop 2023-07-21T22:20:08.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 -- 172.21.15.151:0/2003030897 shutdown_connections 2023-07-21T22:20:08.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f80fc0a1460 0x7f80fc0a3910 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81140728b0 0x7f8114197d70 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811410c310 0x7f811419c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 --2- 172.21.15.151:0/2003030897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81140731c0 0x7f81141982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:08.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 -- 172.21.15.151:0/2003030897 >> 172.21.15.151:0/2003030897 conn(0x7f81140fb5f0 msgr2=0x7f811410e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:08.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 -- 172.21.15.151:0/2003030897 shutdown_connections 2023-07-21T22:20:08.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:08.131+0000 7f811a5ff700 1 -- 172.21.15.151:0/2003030897 wait complete. 2023-07-21T22:20:08.201 INFO:tasks.cephfs.filesystem:scrub status for tag:ec38d3a5-93f8-4072-bfe2-c7872d39c48a - {'path': '/', 'tag': 'ec38d3a5-93f8-4072-bfe2-c7872d39c48a', 'options': 'recursive,force'} 2023-07-21T22:20:08.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:08 smithi187 ceph-mon[96918]: pgmap v31: 97 pgs: 97 active+clean; 505 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 34 MiB/s wr, 50 op/s 2023-07-21T22:20:08.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:08 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:20:08.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:08 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:08.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:08 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:20:08.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:08 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:20:08.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:08 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:08.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:08 smithi195 ceph-mon[97365]: pgmap v31: 97 pgs: 97 active+clean; 505 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 34 MiB/s wr, 50 op/s 2023-07-21T22:20:08.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:08 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:20:08.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:08 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:08.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:08 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:20:08.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:08 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:20:08.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:08 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:08.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:08 smithi151 ceph-mon[95510]: pgmap v31: 97 pgs: 97 active+clean; 505 MiB data, 562 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 34 MiB/s wr, 50 op/s 2023-07-21T22:20:08.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:08 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:20:08.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:08 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:08.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:08 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:20:08.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:08 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:20:08.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:08 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:09.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:09 smithi187 ceph-mon[96918]: scrub queued for path: / 2023-07-21T22:20:09.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:09 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:09.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:09 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:20:09.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:09 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:09.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:09 smithi195 ceph-mon[97365]: scrub queued for path: / 2023-07-21T22:20:09.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:09 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:09.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:09 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:20:09.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:09 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:09.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:09 smithi151 ceph-mon[95510]: scrub queued for path: / 2023-07-21T22:20:09.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:09 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:09.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:09 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:20:09.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:09 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:20:09.827 INFO:teuthology.orchestra.run.smithi151.stderr:2200000 of 50000000 tuples (4%) done (elapsed 33.32 s, remaining 723.95 s) 2023-07-21T22:20:10.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:10 smithi187 ceph-mon[96918]: pgmap v32: 97 pgs: 97 active+clean; 531 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 34 MiB/s wr, 48 op/s 2023-07-21T22:20:10.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:10 smithi195 ceph-mon[97365]: pgmap v32: 97 pgs: 97 active+clean; 531 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 34 MiB/s wr, 48 op/s 2023-07-21T22:20:10.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:10 smithi151 ceph-mon[95510]: pgmap v32: 97 pgs: 97 active+clean; 531 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 34 MiB/s wr, 48 op/s 2023-07-21T22:20:11.070 INFO:teuthology.orchestra.run.smithi151.stderr:2300000 of 50000000 tuples (4%) done (elapsed 34.56 s, remaining 716.80 s) 2023-07-21T22:20:12.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:12 smithi187 ceph-mon[96918]: pgmap v33: 97 pgs: 97 active+clean; 531 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-07-21T22:20:12.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:12 smithi195 ceph-mon[97365]: pgmap v33: 97 pgs: 97 active+clean; 531 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-07-21T22:20:12.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:12 smithi151 ceph-mon[95510]: pgmap v33: 97 pgs: 97 active+clean; 531 MiB data, 569 MiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 38 op/s 2023-07-21T22:20:12.719 INFO:teuthology.orchestra.run.smithi151.stderr:2400000 of 50000000 tuples (4%) done (elapsed 36.21 s, remaining 718.21 s) 2023-07-21T22:20:14.414 INFO:teuthology.orchestra.run.smithi151.stderr:2500000 of 50000000 tuples (5%) done (elapsed 37.91 s, remaining 720.24 s) 2023-07-21T22:20:14.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:14 smithi187 ceph-mon[96918]: pgmap v34: 97 pgs: 97 active+clean; 611 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 38 MiB/s wr, 66 op/s 2023-07-21T22:20:14.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:14 smithi195 ceph-mon[97365]: pgmap v34: 97 pgs: 97 active+clean; 611 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 38 MiB/s wr, 66 op/s 2023-07-21T22:20:14.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:14 smithi151 ceph-mon[95510]: pgmap v34: 97 pgs: 97 active+clean; 611 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 38 MiB/s wr, 66 op/s 2023-07-21T22:20:15.634 INFO:teuthology.orchestra.run.smithi151.stderr:2600000 of 50000000 tuples (5%) done (elapsed 39.13 s, remaining 713.30 s) 2023-07-21T22:20:16.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:16 smithi195 ceph-mon[97365]: pgmap v35: 97 pgs: 97 active+clean; 611 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 43 op/s 2023-07-21T22:20:16.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:16 smithi151 ceph-mon[95510]: pgmap v35: 97 pgs: 97 active+clean; 611 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 43 op/s 2023-07-21T22:20:16.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:16 smithi187 ceph-mon[96918]: pgmap v35: 97 pgs: 97 active+clean; 611 MiB data, 601 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 25 MiB/s wr, 43 op/s 2023-07-21T22:20:17.228 INFO:teuthology.orchestra.run.smithi151.stderr:2700000 of 50000000 tuples (5%) done (elapsed 40.72 s, remaining 713.37 s) 2023-07-21T22:20:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:18 smithi195 ceph-mon[97365]: pgmap v36: 97 pgs: 97 active+clean; 664 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 34 MiB/s wr, 47 op/s 2023-07-21T22:20:18.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:18 smithi151 ceph-mon[95510]: pgmap v36: 97 pgs: 97 active+clean; 664 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 34 MiB/s wr, 47 op/s 2023-07-21T22:20:18.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:18 smithi187 ceph-mon[96918]: pgmap v36: 97 pgs: 97 active+clean; 664 MiB data, 625 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 34 MiB/s wr, 47 op/s 2023-07-21T22:20:18.902 INFO:teuthology.orchestra.run.smithi151.stderr:2800000 of 50000000 tuples (5%) done (elapsed 42.39 s, remaining 714.65 s) 2023-07-21T22:20:19.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.889+0000 7fba313ff700 1 -- 172.21.15.151:0/632327121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c105b60 msgr2=0x7fba2c105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.889+0000 7fba313ff700 1 --2- 172.21.15.151:0/632327121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c105b60 0x7fba2c105f30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fba1c009990 tx=0x7fba1c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.889+0000 7fba313ff700 1 -- 172.21.15.151:0/632327121 shutdown_connections 2023-07-21T22:20:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.889+0000 7fba313ff700 1 --2- 172.21.15.151:0/632327121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba2c1004e0 0x7fba2c10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.889+0000 7fba313ff700 1 --2- 172.21.15.151:0/632327121 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c105b60 0x7fba2c105f30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.889+0000 7fba313ff700 1 --2- 172.21.15.151:0/632327121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba2c0ffb30 0x7fba2c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.889+0000 7fba313ff700 1 -- 172.21.15.151:0/632327121 >> 172.21.15.151:0/632327121 conn(0x7fba2c0fb650 msgr2=0x7fba2c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.889+0000 7fba313ff700 1 -- 172.21.15.151:0/632327121 shutdown_connections 2023-07-21T22:20:19.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.889+0000 7fba313ff700 1 -- 172.21.15.151:0/632327121 wait complete. 2023-07-21T22:20:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.890+0000 7fba313ff700 1 Processor -- start 2023-07-21T22:20:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.890+0000 7fba313ff700 1 -- start start 2023-07-21T22:20:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba313ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c0ffb30 0x7fba2c0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba313ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba2c1004e0 0x7fba2c072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba313ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba2c105b60 0x7fba2c1a3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba313ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c1a4270 con 0x7fba2c105b60 2023-07-21T22:20:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba313ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c1a43b0 con 0x7fba2c1004e0 2023-07-21T22:20:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba313ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba2c1a4520 con 0x7fba2c0ffb30 2023-07-21T22:20:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba2affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c0ffb30 0x7fba2c0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba2affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c0ffb30 0x7fba2c0729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50562/0 (socket says 172.21.15.151:50562) 2023-07-21T22:20:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba2affd700 1 -- 172.21.15.151:0/3091967447 learned_addr learned my addr 172.21.15.151:0/3091967447 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:19.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba2c1004e0 0x7fba2c072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.891+0000 7fba2b7fe700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba2c105b60 0x7fba2c1a3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.892+0000 7fba2affd700 1 -- 172.21.15.151:0/3091967447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba2c1004e0 msgr2=0x7fba2c072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:19.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.892+0000 7fba2affd700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba2c1004e0 0x7fba2c072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.892+0000 7fba2affd700 1 -- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba2c105b60 msgr2=0x7fba2c1a3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.892+0000 7fba2affd700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba2c105b60 0x7fba2c1a3d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.892+0000 7fba2affd700 1 -- 172.21.15.151:0/3091967447 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba1c0095f0 con 0x7fba2c0ffb30 2023-07-21T22:20:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.892+0000 7fba2b7fe700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba2c105b60 0x7fba2c1a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:20:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.892+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba2c1004e0 0x7fba2c072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.892+0000 7fba2affd700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c0ffb30 0x7fba2c0729f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fba1c005740 tx=0x7fba1c005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:19.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.893+0000 7fba13fff700 1 -- 172.21.15.151:0/3091967447 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c01d070 con 0x7fba2c0ffb30 2023-07-21T22:20:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.893+0000 7fba13fff700 1 -- 172.21.15.151:0/3091967447 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba1c022470 con 0x7fba2c0ffb30 2023-07-21T22:20:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.893+0000 7fba313ff700 1 -- 172.21.15.151:0/3091967447 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba2c1a47a0 con 0x7fba2c0ffb30 2023-07-21T22:20:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.893+0000 7fba13fff700 1 -- 172.21.15.151:0/3091967447 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c017650 con 0x7fba2c0ffb30 2023-07-21T22:20:19.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.893+0000 7fba313ff700 1 -- 172.21.15.151:0/3091967447 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba2c1a4c20 con 0x7fba2c0ffb30 2023-07-21T22:20:19.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.897+0000 7fba13fff700 1 -- 172.21.15.151:0/3091967447 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fba1c00fb00 con 0x7fba2c0ffb30 2023-07-21T22:20:19.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.898+0000 7fba44df2b80 1 Processor -- start 2023-07-21T22:20:19.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.898+0000 7fba44df2b80 1 -- start start 2023-07-21T22:20:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.898+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da944e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.898+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da8e750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.898+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da8ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.898+0000 7fba44df2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9d98bc50 con 0x559d9d8e26b0 2023-07-21T22:20:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.898+0000 7fba44df2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9d9de9e0 con 0x559d9da94e70 2023-07-21T22:20:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.898+0000 7fba44df2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9d9d7e70 con 0x559d9da94a20 2023-07-21T22:20:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da944e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41296/0 (socket says 172.21.15.151:41296) 2023-07-21T22:20:19.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2b7fe700 1 -- 172.21.15.151:0/291042674 learned_addr learned my addr 172.21.15.151:0/291042674 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:19.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/291042674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da8ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2affd700 1 --2- 172.21.15.151:0/291042674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da8e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba13fff700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fba140a1460 0x7fba140a3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2a7fc700 1 -- 172.21.15.151:0/291042674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 msgr2=0x559d9da8e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/291042674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da8e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2a7fc700 1 -- 172.21.15.151:0/291042674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 msgr2=0x559d9da944e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/291042674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da944e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.899+0000 7fba2a7fc700 1 -- 172.21.15.151:0/291042674 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d9d805d80 con 0x559d9da94e70 2023-07-21T22:20:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.900+0000 7fba13fff700 1 -- 172.21.15.151:0/3091967447 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fba1c0ce410 con 0x7fba2c0ffb30 2023-07-21T22:20:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.900+0000 7fba2b7fe700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fba140a1460 0x7fba140a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.900+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/291042674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da8ecb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba200114c0 tx=0x7fba200117d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1fbb931228a4e82 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.900+0000 7fba117fa700 1 -- 172.21.15.151:0/291042674 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200112f0 con 0x559d9da94e70 2023-07-21T22:20:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.900+0000 7fba117fa700 1 -- 172.21.15.151:0/291042674 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba200044c0 con 0x559d9da94e70 2023-07-21T22:20:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.900+0000 7fba117fa700 1 -- 172.21.15.151:0/291042674 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2001a480 con 0x559d9da94e70 2023-07-21T22:20:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba44df2b80 1 -- 172.21.15.151:0/291042674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 msgr2=0x559d9da8ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba2b7fe700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fba140a1460 0x7fba140a3910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba240075c0 tx=0x7fba2400d040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba44df2b80 1 --2- 172.21.15.151:0/291042674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da8ecb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fba200114c0 tx=0x7fba200117d0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba44df2b80 1 -- 172.21.15.151:0/291042674 shutdown_connections 2023-07-21T22:20:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba44df2b80 1 --2- 172.21.15.151:0/291042674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da8ecb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba44df2b80 1 --2- 172.21.15.151:0/291042674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da944e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba44df2b80 1 --2- 172.21.15.151:0/291042674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da8e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba44df2b80 1 -- 172.21.15.151:0/291042674 >> 172.21.15.151:0/291042674 conn(0x559d9da7bae0 msgr2=0x559d9da810e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba44df2b80 1 -- 172.21.15.151:0/291042674 shutdown_connections 2023-07-21T22:20:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.901+0000 7fba44df2b80 1 -- 172.21.15.151:0/291042674 wait complete. 2023-07-21T22:20:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.902+0000 7fba44df2b80 1 -- start start 2023-07-21T22:20:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.902+0000 7fba44df2b80 1 Processor -- start 2023-07-21T22:20:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.903+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9d8e26b0 0x559d9da9adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.903+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94a20 0x559d9da98070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.903+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da987b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.903+0000 7fba44df2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9d977a60 con 0x559d9da94a20 2023-07-21T22:20:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.903+0000 7fba44df2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9d977760 con 0x559d9da94e70 2023-07-21T22:20:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.903+0000 7fba44df2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9d85b8c0 con 0x559d9d8e26b0 2023-07-21T22:20:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.903+0000 7fba44df2b80 10 client.0 _ll_register_callbacks cb 0x559d9d975700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.903+0000 7fba2b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9d8e26b0 0x559d9da9adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9d8e26b0 0x559d9da9adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50578/0 (socket says 172.21.15.151:50578) 2023-07-21T22:20:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2affd700 1 -- 172.21.15.151:0/3612598816 learned_addr learned my addr 172.21.15.151:0/3612598816 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94a20 0x559d9da98070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2affd700 1 -- 172.21.15.151:0/3612598816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 msgr2=0x559d9da987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2affd700 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2affd700 1 -- 172.21.15.151:0/3612598816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94a20 msgr2=0x559d9da98070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2affd700 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94a20 0x559d9da98070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2affd700 1 -- 172.21.15.151:0/3612598816 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba20009c90 con 0x559d9d8e26b0 2023-07-21T22:20:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba2affd700 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9d8e26b0 0x559d9da9adf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba1c097870 tx=0x7fba1c0a3580 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ca4604d64cbddef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.904+0000 7fba0eff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:20:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.905+0000 7fba0eff5700 1 -- 172.21.15.151:0/3612598816 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c09aeb0 con 0x559d9d8e26b0 2023-07-21T22:20:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.905+0000 7fba0eff5700 1 -- 172.21.15.151:0/3612598816 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fba1c09f170 con 0x559d9d8e26b0 2023-07-21T22:20:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.905+0000 7fba44df2b80 1 -- 172.21.15.151:0/3612598816 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d9d931490 con 0x559d9d8e26b0 2023-07-21T22:20:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.905+0000 7fba0eff5700 1 -- 172.21.15.151:0/3612598816 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba1c09acd0 con 0x559d9d8e26b0 2023-07-21T22:20:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.905+0000 7fba44df2b80 10 client.25648 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.905+0000 7fba44df2b80 1 -- 172.21.15.151:0/3612598816 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559d9d7eec00 con 0x559d9d8e26b0 2023-07-21T22:20:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.905+0000 7fba0eff5700 1 -- 172.21.15.151:0/3612598816 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559d9d931490 con 0x559d9d8e26b0 2023-07-21T22:20:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.905+0000 7fba0eff5700 1 -- 172.21.15.151:0/3612598816 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fba1c0a10d0 con 0x559d9d8e26b0 2023-07-21T22:20:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.906+0000 7fba44df2b80 10 client.25648 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.906+0000 7fba44df2b80 10 client.25648 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.906+0000 7fba44df2b80 20 client.25648 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.906+0000 7fba44df2b80 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d9daa8000 0x559d9daaa410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.906+0000 7fba44df2b80 4 client.25648 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.906+0000 7fba44df2b80 1 -- 172.21.15.151:0/3612598816 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d9d9d0e50 con 0x559d9daa8000 2023-07-21T22:20:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.906+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d9daa8000 0x559d9daaa410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.907+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d9daa8000 0x559d9daaa410 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90aa94e19b80cd9e server_cookie=b8c7834b01de1f68 in_seq=0 out_seq=0 2023-07-21T22:20:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.908+0000 7fba0eff5700 10 client.25648 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.908+0000 7fba0eff5700 1 -- 172.21.15.151:0/3612598816 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559d9d9d0e50 con 0x559d9daa8000 2023-07-21T22:20:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.908+0000 7fba0eff5700 10 client.25648 handle_command_reply: tid=0 2023-07-21T22:20:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.908+0000 7fba44df2b80 1 client.25648 shutdown 2023-07-21T22:20:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.908+0000 7fba44df2b80 1 -- 172.21.15.151:0/3612598816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9d8e26b0 msgr2=0x559d9da9adf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.908+0000 7fba44df2b80 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9d8e26b0 0x559d9da9adf0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fba1c097870 tx=0x7fba1c0a3580 comp rx=0 tx=0).stop 2023-07-21T22:20:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba44df2b80 1 -- 172.21.15.151:0/3612598816 shutdown_connections 2023-07-21T22:20:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba44df2b80 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d9daa8000 0x559d9daaa410 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba44df2b80 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba44df2b80 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9d8e26b0 0x559d9da9adf0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba0eff5700 0 client.25648 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba44df2b80 1 --2- 172.21.15.151:0/3612598816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94a20 0x559d9da98070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba44df2b80 1 -- 172.21.15.151:0/3612598816 >> 172.21.15.151:0/3612598816 conn(0x559d9da7bae0 msgr2=0x559d9da84f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba44df2b80 1 -- 172.21.15.151:0/3612598816 shutdown_connections 2023-07-21T22:20:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba44df2b80 1 -- 172.21.15.151:0/3612598816 wait complete. 2023-07-21T22:20:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.909+0000 7fba44df2b80 20 client.25648 trim_cache size 0 max 16384 2023-07-21T22:20:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.926+0000 7fba44df2b80 1 Processor -- start 2023-07-21T22:20:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba44df2b80 1 -- start start 2023-07-21T22:20:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da9f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da9a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da80b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba44df2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9da9fa10 con 0x559d9d8e26b0 2023-07-21T22:20:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba44df2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9daaa3e0 con 0x559d9da94e70 2023-07-21T22:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba44df2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9da975e0 con 0x559d9da94a20 2023-07-21T22:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba2affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da9f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba2affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da9f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41318/0 (socket says 172.21.15.151:41318) 2023-07-21T22:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.927+0000 7fba2affd700 1 -- 172.21.15.151:0/187442831 learned_addr learned my addr 172.21.15.151:0/187442831 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da9a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba2b7fe700 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da80b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba2affd700 1 -- 172.21.15.151:0/187442831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 msgr2=0x559d9da9a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:19.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba2affd700 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da9a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba2affd700 1 -- 172.21.15.151:0/187442831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 msgr2=0x559d9da80b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba2affd700 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da80b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba2affd700 1 -- 172.21.15.151:0/187442831 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d9d82c1f0 con 0x559d9d8e26b0 2023-07-21T22:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da9a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba2affd700 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da9f440 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0996c0 tx=0x7fba1c009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8726a8f3da56c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba11ffb700 1 -- 172.21.15.151:0/187442831 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c09acd0 con 0x559d9d8e26b0 2023-07-21T22:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba11ffb700 1 -- 172.21.15.151:0/187442831 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba1c09aeb0 con 0x559d9d8e26b0 2023-07-21T22:20:19.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.928+0000 7fba11ffb700 1 -- 172.21.15.151:0/187442831 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c09f3a0 con 0x559d9d8e26b0 2023-07-21T22:20:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.929+0000 7fba44df2b80 1 -- 172.21.15.151:0/187442831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 msgr2=0x559d9da9f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.929+0000 7fba44df2b80 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da9f440 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0996c0 tx=0x7fba1c009310 comp rx=0 tx=0).stop 2023-07-21T22:20:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.929+0000 7fba44df2b80 1 -- 172.21.15.151:0/187442831 shutdown_connections 2023-07-21T22:20:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.929+0000 7fba44df2b80 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9da94e70 0x559d9da80b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.929+0000 7fba44df2b80 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9d8e26b0 0x559d9da9f440 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.929+0000 7fba44df2b80 1 --2- 172.21.15.151:0/187442831 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da9a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.929+0000 7fba44df2b80 1 -- 172.21.15.151:0/187442831 >> 172.21.15.151:0/187442831 conn(0x559d9da7bae0 msgr2=0x559d9da921e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.930+0000 7fba44df2b80 1 -- 172.21.15.151:0/187442831 shutdown_connections 2023-07-21T22:20:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.930+0000 7fba44df2b80 1 -- 172.21.15.151:0/187442831 wait complete. 2023-07-21T22:20:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.930+0000 7fba44df2b80 1 -- start start 2023-07-21T22:20:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.930+0000 7fba44df2b80 1 Processor -- start 2023-07-21T22:20:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9d8e26b0 0x559d9da910a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da915e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba44df2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94e70 0x559d9da8ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba44df2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9da91bc0 con 0x559d9da94e70 2023-07-21T22:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba44df2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9da91d30 con 0x559d9d8e26b0 2023-07-21T22:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba44df2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d9da904b0 con 0x559d9da94a20 2023-07-21T22:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba44df2b80 10 client.0 _ll_register_callbacks cb 0x559d9d975700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba2affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9d8e26b0 0x559d9da910a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba2b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94e70 0x559d9da8ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba2affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9d8e26b0 0x559d9da910a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:33560/0 (socket says 172.21.15.151:33560) 2023-07-21T22:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.931+0000 7fba2affd700 1 -- 172.21.15.151:0/2576322226 learned_addr learned my addr 172.21.15.151:0/2576322226 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.932+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da915e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.932+0000 7fba2affd700 1 -- 172.21.15.151:0/2576322226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 msgr2=0x559d9da915e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.932+0000 7fba2affd700 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da915e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.932+0000 7fba2affd700 1 -- 172.21.15.151:0/2576322226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94e70 msgr2=0x559d9da8ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.932+0000 7fba2affd700 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94e70 0x559d9da8ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.932+0000 7fba2affd700 1 -- 172.21.15.151:0/2576322226 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d9d7eec00 con 0x559d9d8e26b0 2023-07-21T22:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.932+0000 7fba2affd700 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9d8e26b0 0x559d9da910a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba1c005950 tx=0x7fba1c0228c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99ced046ca5ef2d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.932+0000 7fba0eff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.932+0000 7fba0eff5700 1 -- 172.21.15.151:0/2576322226 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c0cb970 con 0x559d9d8e26b0 2023-07-21T22:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba44df2b80 1 -- 172.21.15.151:0/2576322226 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fba200044c0 con 0x559d9d8e26b0 2023-07-21T22:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba0eff5700 1 -- 172.21.15.151:0/2576322226 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fba1c09b370 con 0x559d9d8e26b0 2023-07-21T22:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba0eff5700 1 -- 172.21.15.151:0/2576322226 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba1c0a3730 con 0x559d9d8e26b0 2023-07-21T22:20:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba44df2b80 10 client.25622 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba44df2b80 1 -- 172.21.15.151:0/2576322226 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559d9d804250 con 0x559d9d8e26b0 2023-07-21T22:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba0eff5700 1 -- 172.21.15.151:0/2576322226 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fba1c0b9020 con 0x559d9d8e26b0 2023-07-21T22:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba0eff5700 1 -- 172.21.15.151:0/2576322226 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fba1c0cbda0 con 0x559d9d8e26b0 2023-07-21T22:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba44df2b80 10 client.25622 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba44df2b80 10 client.25622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba44df2b80 20 client.25622 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba44df2b80 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d9dafc640 0x559d9dafea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba44df2b80 4 client.25622 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:20:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.933+0000 7fba44df2b80 1 -- 172.21.15.151:0/2576322226 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559d9d992ff0 con 0x559d9dafc640 2023-07-21T22:20:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.934+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d9dafc640 0x559d9dafea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.934+0000 7fba2a7fc700 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d9dafc640 0x559d9dafea20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=311a64bcb32e49a7 server_cookie=8668fccb93b78abd in_seq=0 out_seq=0 2023-07-21T22:20:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.934+0000 7fba0eff5700 10 client.25622 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba0eff5700 1 -- 172.21.15.151:0/2576322226 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559d9d992ff0 con 0x559d9dafc640 2023-07-21T22:20:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba0eff5700 10 client.25622 handle_command_reply: tid=0 2023-07-21T22:20:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 client.25622 shutdown 2023-07-21T22:20:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 -- 172.21.15.151:0/2576322226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9d8e26b0 msgr2=0x559d9da910a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9d8e26b0 0x559d9da910a0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fba1c005950 tx=0x7fba1c0228c0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 -- 172.21.15.151:0/2576322226 shutdown_connections 2023-07-21T22:20:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d9dafc640 0x559d9dafea20 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d9d8e26b0 0x559d9da910a0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d9da94e70 0x559d9da8ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 --2- 172.21.15.151:0/2576322226 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d9da94a20 0x559d9da915e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 -- 172.21.15.151:0/2576322226 >> 172.21.15.151:0/2576322226 conn(0x559d9da7bae0 msgr2=0x559d9da97910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba0eff5700 0 client.25622 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 -- 172.21.15.151:0/2576322226 shutdown_connections 2023-07-21T22:20:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 1 -- 172.21.15.151:0/2576322226 wait complete. 2023-07-21T22:20:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.952+0000 7fba44df2b80 20 client.25622 trim_cache size 0 max 16384 2023-07-21T22:20:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:20:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:20:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:20:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:20:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 -- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fba140a1460 msgr2=0x7fba140a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fba140a1460 0x7fba140a3910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba240075c0 tx=0x7fba2400d040 comp rx=0 tx=0).stop 2023-07-21T22:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 -- 172.21.15.151:0/3091967447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c0ffb30 msgr2=0x7fba2c0729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c0ffb30 0x7fba2c0729f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fba1c005740 tx=0x7fba1c005770 comp rx=0 tx=0).stop 2023-07-21T22:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 -- 172.21.15.151:0/3091967447 shutdown_connections 2023-07-21T22:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fba140a1460 0x7fba140a3910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fba2c105b60 0x7fba2c1a3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fba2c0ffb30 0x7fba2c0729f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 --2- 172.21.15.151:0/3091967447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba2c1004e0 0x7fba2c072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 -- 172.21.15.151:0/3091967447 >> 172.21.15.151:0/3091967447 conn(0x7fba2c0fb650 msgr2=0x7fba2c1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 -- 172.21.15.151:0/3091967447 shutdown_connections 2023-07-21T22:20:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:19.953+0000 7fba313ff700 1 -- 172.21.15.151:0/3091967447 wait complete. 2023-07-21T22:20:20.198 INFO:teuthology.orchestra.run.smithi151.stderr:2900000 of 50000000 tuples (5%) done (elapsed 43.69 s, remaining 709.60 s) 2023-07-21T22:20:20.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:20 smithi195 ceph-mon[97365]: pgmap v37: 97 pgs: 97 active+clean; 683 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 29 MiB/s wr, 41 op/s 2023-07-21T22:20:20.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:20:20.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:20 smithi151 ceph-mon[95510]: pgmap v37: 97 pgs: 97 active+clean; 683 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 29 MiB/s wr, 41 op/s 2023-07-21T22:20:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:20:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:20 smithi187 ceph-mon[96918]: pgmap v37: 97 pgs: 97 active+clean; 683 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 29 MiB/s wr, 41 op/s 2023-07-21T22:20:20.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:20:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:21.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:21 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:20:21.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:21 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:20:21.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:21 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:21.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:21 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:20:21.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:21 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:20:21.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:21 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:21 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:20:21.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:21 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:20:21.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:21 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:20:22.252 INFO:teuthology.orchestra.run.smithi151.stderr:3000000 of 50000000 tuples (6%) done (elapsed 45.74 s, remaining 716.66 s) 2023-07-21T22:20:22.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:22 smithi195 ceph-mon[97365]: pgmap v38: 97 pgs: 97 active+clean; 683 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-07-21T22:20:22.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:22 smithi151 ceph-mon[95510]: pgmap v38: 97 pgs: 97 active+clean; 683 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-07-21T22:20:22.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:22 smithi187 ceph-mon[96918]: pgmap v38: 97 pgs: 97 active+clean; 683 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 25 MiB/s wr, 37 op/s 2023-07-21T22:20:23.474 INFO:teuthology.orchestra.run.smithi151.stderr:3100000 of 50000000 tuples (6%) done (elapsed 46.97 s, remaining 710.57 s) 2023-07-21T22:20:24.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:24 smithi195 ceph-mon[97365]: pgmap v39: 97 pgs: 97 active+clean; 758 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 38 MiB/s wr, 53 op/s 2023-07-21T22:20:24.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:24 smithi151 ceph-mon[95510]: pgmap v39: 97 pgs: 97 active+clean; 758 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 38 MiB/s wr, 53 op/s 2023-07-21T22:20:24.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:24 smithi187 ceph-mon[96918]: pgmap v39: 97 pgs: 97 active+clean; 758 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 38 MiB/s wr, 53 op/s 2023-07-21T22:20:25.244 INFO:teuthology.orchestra.run.smithi151.stderr:3200000 of 50000000 tuples (6%) done (elapsed 48.74 s, remaining 712.77 s) 2023-07-21T22:20:26.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:26 smithi195 ceph-mon[97365]: pgmap v40: 97 pgs: 97 active+clean; 758 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-07-21T22:20:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:26 smithi151 ceph-mon[95510]: pgmap v40: 97 pgs: 97 active+clean; 758 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-07-21T22:20:26.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:26 smithi187 ceph-mon[96918]: pgmap v40: 97 pgs: 97 active+clean; 758 MiB data, 662 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-07-21T22:20:27.025 INFO:teuthology.orchestra.run.smithi151.stderr:3300000 of 50000000 tuples (6%) done (elapsed 50.52 s, remaining 714.91 s) 2023-07-21T22:20:28.159 INFO:teuthology.orchestra.run.smithi151.stderr:3400000 of 50000000 tuples (6%) done (elapsed 51.65 s, remaining 707.94 s) 2023-07-21T22:20:28.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:28 smithi195 ceph-mon[97365]: pgmap v41: 97 pgs: 97 active+clean; 815 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 MiB/s wr, 30 op/s 2023-07-21T22:20:28.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:28 smithi151 ceph-mon[95510]: pgmap v41: 97 pgs: 97 active+clean; 815 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 MiB/s wr, 30 op/s 2023-07-21T22:20:28.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:28 smithi187 ceph-mon[96918]: pgmap v41: 97 pgs: 97 active+clean; 815 MiB data, 685 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 35 MiB/s wr, 30 op/s 2023-07-21T22:20:29.827 INFO:teuthology.orchestra.run.smithi151.stderr:3500000 of 50000000 tuples (7%) done (elapsed 53.32 s, remaining 708.39 s) 2023-07-21T22:20:30.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:30 smithi195 ceph-mon[97365]: pgmap v42: 97 pgs: 97 active+clean; 827 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 28 MiB/s wr, 30 op/s 2023-07-21T22:20:30.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:30 smithi151 ceph-mon[95510]: pgmap v42: 97 pgs: 97 active+clean; 827 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 28 MiB/s wr, 30 op/s 2023-07-21T22:20:30.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:30 smithi187 ceph-mon[96918]: pgmap v42: 97 pgs: 97 active+clean; 827 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 28 MiB/s wr, 30 op/s 2023-07-21T22:20:31.501 INFO:teuthology.orchestra.run.smithi151.stderr:3600000 of 50000000 tuples (7%) done (elapsed 54.99 s, remaining 708.81 s) 2023-07-21T22:20:32.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:32 smithi151 ceph-mon[95510]: pgmap v43: 97 pgs: 97 active+clean; 827 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-07-21T22:20:32.724 INFO:teuthology.orchestra.run.smithi151.stderr:3700000 of 50000000 tuples (7%) done (elapsed 56.22 s, remaining 703.47 s) 2023-07-21T22:20:32.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:32 smithi187 ceph-mon[96918]: pgmap v43: 97 pgs: 97 active+clean; 827 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-07-21T22:20:32.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:32 smithi195 ceph-mon[97365]: pgmap v43: 97 pgs: 97 active+clean; 827 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 24 op/s 2023-07-21T22:20:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.155+0000 7fea349ff700 1 -- 172.21.15.151:0/377818153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea301004e0 msgr2=0x7fea3010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.155+0000 7fea349ff700 1 --2- 172.21.15.151:0/377818153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea301004e0 0x7fea3010c920 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fea2800b0a0 tx=0x7fea2800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.155+0000 7fea349ff700 1 -- 172.21.15.151:0/377818153 shutdown_connections 2023-07-21T22:20:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.155+0000 7fea349ff700 1 --2- 172.21.15.151:0/377818153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea30105b60 0x7fea30105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.155+0000 7fea349ff700 1 --2- 172.21.15.151:0/377818153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea301004e0 0x7fea3010c920 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.155+0000 7fea349ff700 1 --2- 172.21.15.151:0/377818153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea300ffb30 0x7fea300fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.155+0000 7fea349ff700 1 -- 172.21.15.151:0/377818153 >> 172.21.15.151:0/377818153 conn(0x7fea300fb5f0 msgr2=0x7fea300fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.155+0000 7fea349ff700 1 -- 172.21.15.151:0/377818153 shutdown_connections 2023-07-21T22:20:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.155+0000 7fea349ff700 1 -- 172.21.15.151:0/377818153 wait complete. 2023-07-21T22:20:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.157+0000 7fea349ff700 1 Processor -- start 2023-07-21T22:20:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.157+0000 7fea349ff700 1 -- start start 2023-07-21T22:20:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.157+0000 7fea349ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea300ffb30 0x7fea30197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.157+0000 7fea349ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea301004e0 0x7fea30198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.157+0000 7fea349ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea30105b60 0x7fea3019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.157+0000 7fea349ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3019cfd0 con 0x7fea30105b60 2023-07-21T22:20:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.157+0000 7fea349ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3019d140 con 0x7fea300ffb30 2023-07-21T22:20:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea349ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea3019d300 con 0x7fea301004e0 2023-07-21T22:20:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea300ffb30 0x7fea30197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea30105b60 0x7fea3019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea300ffb30 0x7fea30197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54794/0 (socket says 172.21.15.151:54794) 2023-07-21T22:20:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2e59c700 1 -- 172.21.15.151:0/3163441076 learned_addr learned my addr 172.21.15.151:0/3163441076 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea301004e0 0x7fea30198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2e59c700 1 -- 172.21.15.151:0/3163441076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea301004e0 msgr2=0x7fea30198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2e59c700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea301004e0 0x7fea30198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2e59c700 1 -- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea30105b60 msgr2=0x7fea3019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2e59c700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea30105b60 0x7fea3019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2e59c700 1 -- 172.21.15.151:0/3163441076 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28009d00 con 0x7fea300ffb30 2023-07-21T22:20:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2ed9d700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea30105b60 0x7fea3019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.158+0000 7fea2e59c700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea300ffb30 0x7fea30197de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fea2000e9a0 tx=0x7fea2000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.159+0000 7fea1f7fe700 1 -- 172.21.15.151:0/3163441076 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20009790 con 0x7fea300ffb30 2023-07-21T22:20:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.159+0000 7fea1f7fe700 1 -- 172.21.15.151:0/3163441076 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea20010430 con 0x7fea300ffb30 2023-07-21T22:20:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.159+0000 7fea349ff700 1 -- 172.21.15.151:0/3163441076 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea3019d5e0 con 0x7fea300ffb30 2023-07-21T22:20:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.159+0000 7fea1f7fe700 1 -- 172.21.15.151:0/3163441076 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000cea0 con 0x7fea300ffb30 2023-07-21T22:20:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.159+0000 7fea349ff700 1 -- 172.21.15.151:0/3163441076 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea301a4e20 con 0x7fea300ffb30 2023-07-21T22:20:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.163+0000 7fea1f7fe700 1 -- 172.21.15.151:0/3163441076 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7fea200105a0 con 0x7fea300ffb30 2023-07-21T22:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.164+0000 7fea4827cb80 1 Processor -- start 2023-07-21T22:20:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.164+0000 7fea4827cb80 1 -- start start 2023-07-21T22:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.164+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecc5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.164+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecbff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.164+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.164+0000 7fea1f7fe700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea180a13e0 0x7fea180a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.164+0000 7fea4827cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ebc5c50 con 0x56059eb1c6b0 2023-07-21T22:20:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.164+0000 7fea4827cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ec189e0 con 0x56059ecc6210 2023-07-21T22:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.164+0000 7fea4827cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ec11e70 con 0x56059ecc6660 2023-07-21T22:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea1f7fe700 1 -- 172.21.15.151:0/3163441076 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fea20014070 con 0x7fea300ffb30 2023-07-21T22:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecc5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecc5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40744/0 (socket says 172.21.15.151:40744) 2023-07-21T22:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2ed9d700 1 -- 172.21.15.151:0/1139271488 learned_addr learned my addr 172.21.15.151:0/1139271488 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:33.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2e59c700 1 --2- 172.21.15.151:0/1139271488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecbff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2ed9d700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea180a13e0 0x7fea180a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2dd9b700 1 -- 172.21.15.151:0/1139271488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 msgr2=0x56059ecbff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/1139271488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecbff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2dd9b700 1 -- 172.21.15.151:0/1139271488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 msgr2=0x56059ecc5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/1139271488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecc5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2dd9b700 1 -- 172.21.15.151:0/1139271488 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56059ea3fd80 con 0x56059ecc6660 2023-07-21T22:20:33.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.165+0000 7fea2ed9d700 1 --2- 172.21.15.151:0/1139271488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecc5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.166+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/1139271488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc04a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea24009c80 tx=0x7fea24009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5331f56d1d091471 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.166+0000 7fea1cff9700 1 -- 172.21.15.151:0/1139271488 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24011cb0 con 0x56059ecc6660 2023-07-21T22:20:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.166+0000 7fea1cff9700 1 -- 172.21.15.151:0/1139271488 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea24011e10 con 0x56059ecc6660 2023-07-21T22:20:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.166+0000 7fea2ed9d700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea180a13e0 0x7fea180a3890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea28009cd0 tx=0x7fea28006210 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.166+0000 7fea1cff9700 1 -- 172.21.15.151:0/1139271488 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24005280 con 0x56059ecc6660 2023-07-21T22:20:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.167+0000 7fea4827cb80 1 -- 172.21.15.151:0/1139271488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 msgr2=0x56059ecc04a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.167+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1139271488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc04a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fea24009c80 tx=0x7fea24009f90 comp rx=0 tx=0).stop 2023-07-21T22:20:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.167+0000 7fea4827cb80 1 -- 172.21.15.151:0/1139271488 shutdown_connections 2023-07-21T22:20:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.167+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1139271488 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc04a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.167+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1139271488 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecc5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.167+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1139271488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecbff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.167+0000 7fea4827cb80 1 -- 172.21.15.151:0/1139271488 >> 172.21.15.151:0/1139271488 conn(0x56059ecb5ae0 msgr2=0x56059ecbb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:33.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.167+0000 7fea4827cb80 1 -- 172.21.15.151:0/1139271488 shutdown_connections 2023-07-21T22:20:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.167+0000 7fea4827cb80 1 -- 172.21.15.151:0/1139271488 wait complete. 2023-07-21T22:20:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.168+0000 7fea4827cb80 1 -- start start 2023-07-21T22:20:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.168+0000 7fea4827cb80 1 Processor -- start 2023-07-21T22:20:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059eccc550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea4827cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ebb1a60 con 0x56059eb1c6b0 2023-07-21T22:20:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea4827cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ebb1760 con 0x56059ecc6210 2023-07-21T22:20:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea4827cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ea958c0 con 0x56059ecc6660 2023-07-21T22:20:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea4827cb80 10 client.0 _ll_register_callbacks cb 0x56059ebaf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2dd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059eccc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2dd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc97d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54812/0 (socket says 172.21.15.151:54812) 2023-07-21T22:20:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2dd9b700 1 -- 172.21.15.151:0/1054498152 learned_addr learned my addr 172.21.15.151:0/1054498152 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2ed9d700 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2dd9b700 1 -- 172.21.15.151:0/1054498152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 msgr2=0x56059ecc9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2dd9b700 1 -- 172.21.15.151:0/1054498152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 msgr2=0x56059eccc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059eccc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2dd9b700 1 -- 172.21.15.151:0/1054498152 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea240098e0 con 0x56059ecc6210 2023-07-21T22:20:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.169+0000 7fea2e59c700 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059eccc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.170+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc97d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea240048b0 tx=0x7fea240048e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40d9a6f09f589c23 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.170+0000 7fea15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:20:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.170+0000 7fea15ffb700 1 -- 172.21.15.151:0/1054498152 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea240042e0 con 0x56059ecc6210 2023-07-21T22:20:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.170+0000 7fea15ffb700 1 -- 172.21.15.151:0/1054498152 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fea24004440 con 0x56059ecc6210 2023-07-21T22:20:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.170+0000 7fea4827cb80 1 -- 172.21.15.151:0/1054498152 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56059eb6b490 con 0x56059ecc6210 2023-07-21T22:20:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.170+0000 7fea15ffb700 1 -- 172.21.15.151:0/1054498152 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea24003680 con 0x56059ecc6210 2023-07-21T22:20:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.170+0000 7fea4827cb80 10 client.25634 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.170+0000 7fea4827cb80 1 -- 172.21.15.151:0/1054498152 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56059ea28c00 con 0x56059ecc6210 2023-07-21T22:20:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.171+0000 7fea15ffb700 1 -- 172.21.15.151:0/1054498152 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56059eb6b490 con 0x56059ecc6210 2023-07-21T22:20:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.171+0000 7fea15ffb700 1 -- 172.21.15.151:0/1054498152 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fea24005130 con 0x56059ecc6210 2023-07-21T22:20:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.171+0000 7fea4827cb80 10 client.25634 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.171+0000 7fea4827cb80 10 client.25634 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.171+0000 7fea4827cb80 20 client.25634 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.171+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56059ecd9910 0x56059ecdbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.171+0000 7fea4827cb80 4 client.25634 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.171+0000 7fea4827cb80 1 -- 172.21.15.151:0/1054498152 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56059ec0ae50 con 0x56059ecd9910 2023-07-21T22:20:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.171+0000 7fea2e59c700 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56059ecd9910 0x56059ecdbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.172+0000 7fea2e59c700 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56059ecd9910 0x56059ecdbd20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e20dc433636489c0 server_cookie=f661fca5dc9fc8d9 in_seq=0 out_seq=0 2023-07-21T22:20:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.172+0000 7fea15ffb700 10 client.25634 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.172+0000 7fea15ffb700 1 -- 172.21.15.151:0/1054498152 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56059ec0ae50 con 0x56059ecd9910 2023-07-21T22:20:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.172+0000 7fea15ffb700 10 client.25634 handle_command_reply: tid=0 2023-07-21T22:20:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.172+0000 7fea4827cb80 1 client.25634 shutdown 2023-07-21T22:20:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 -- 172.21.15.151:0/1054498152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 msgr2=0x56059ecc97d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc97d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fea240048b0 tx=0x7fea240048e0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 -- 172.21.15.151:0/1054498152 shutdown_connections 2023-07-21T22:20:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56059ecd9910 0x56059ecdbd20 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059eccc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 --2- 172.21.15.151:0/1054498152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc97d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 -- 172.21.15.151:0/1054498152 >> 172.21.15.151:0/1054498152 conn(0x56059ecb5ae0 msgr2=0x56059ecba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea15ffb700 0 client.25634 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 -- 172.21.15.151:0/1054498152 shutdown_connections 2023-07-21T22:20:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 1 -- 172.21.15.151:0/1054498152 wait complete. 2023-07-21T22:20:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.173+0000 7fea4827cb80 20 client.25634 trim_cache size 0 max 16384 2023-07-21T22:20:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.189+0000 7fea4827cb80 1 Processor -- start 2023-07-21T22:20:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.189+0000 7fea4827cb80 1 -- start start 2023-07-21T22:20:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.189+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecd0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.189+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.189+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059eccc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.189+0000 7fea4827cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ecc4410 con 0x56059eb1c6b0 2023-07-21T22:20:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.189+0000 7fea4827cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ecbc9d0 con 0x56059ecc6210 2023-07-21T22:20:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.189+0000 7fea4827cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ecbc6b0 con 0x56059ecc6660 2023-07-21T22:20:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecd0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2dd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2dd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54816/0 (socket says 172.21.15.151:54816) 2023-07-21T22:20:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2dd9b700 1 -- 172.21.15.151:0/778237754 learned_addr learned my addr 172.21.15.151:0/778237754 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecd0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40768/0 (socket says 172.21.15.151:40768) 2023-07-21T22:20:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2ed9d700 1 --2- 172.21.15.151:0/778237754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059eccc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2dd9b700 1 -- 172.21.15.151:0/778237754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 msgr2=0x56059eccc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/778237754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059eccc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2dd9b700 1 -- 172.21.15.151:0/778237754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 msgr2=0x56059ecd0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/778237754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecd0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2dd9b700 1 -- 172.21.15.151:0/778237754 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56059ea661f0 con 0x56059ecc6210 2023-07-21T22:20:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.190+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/778237754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc8f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea24022400 tx=0x7fea24018410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=170404cdb5b88b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea1d7fa700 1 -- 172.21.15.151:0/778237754 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24005600 con 0x56059ecc6210 2023-07-21T22:20:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea1d7fa700 1 -- 172.21.15.151:0/778237754 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea24005c40 con 0x56059ecc6210 2023-07-21T22:20:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea1d7fa700 1 -- 172.21.15.151:0/778237754 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea240038e0 con 0x56059ecc6210 2023-07-21T22:20:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea4827cb80 1 -- 172.21.15.151:0/778237754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 msgr2=0x56059ecc8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea4827cb80 1 --2- 172.21.15.151:0/778237754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc8f90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fea24022400 tx=0x7fea24018410 comp rx=0 tx=0).stop 2023-07-21T22:20:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea4827cb80 1 -- 172.21.15.151:0/778237754 shutdown_connections 2023-07-21T22:20:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea4827cb80 1 --2- 172.21.15.151:0/778237754 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059eccc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea4827cb80 1 --2- 172.21.15.151:0/778237754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059eb1c6b0 0x56059ecd0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea4827cb80 1 --2- 172.21.15.151:0/778237754 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059ecc6210 0x56059ecc8f90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea4827cb80 1 -- 172.21.15.151:0/778237754 >> 172.21.15.151:0/778237754 conn(0x56059ecb5ae0 msgr2=0x56059ecd5da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.191+0000 7fea4827cb80 1 -- 172.21.15.151:0/778237754 shutdown_connections 2023-07-21T22:20:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.192+0000 7fea4827cb80 1 -- 172.21.15.151:0/778237754 wait complete. 2023-07-21T22:20:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.192+0000 7fea4827cb80 1 -- start start 2023-07-21T22:20:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.192+0000 7fea4827cb80 1 Processor -- start 2023-07-21T22:20:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059eb1c6b0 0x56059ecc2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059ecc6210 0x56059ecc2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea4827cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea4827cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ecc3470 con 0x56059ecc6210 2023-07-21T22:20:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea4827cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ecc1c70 con 0x56059eb1c6b0 2023-07-21T22:20:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea4827cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56059ecc1e30 con 0x56059ecc6660 2023-07-21T22:20:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea4827cb80 10 client.0 _ll_register_callbacks cb 0x7fea20010a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea2dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059ecc6210 0x56059ecc2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea2e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059eb1c6b0 0x56059ecc2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea2ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea2e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059eb1c6b0 0x56059ecc2820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54832/0 (socket says 172.21.15.151:54832) 2023-07-21T22:20:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea2dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059ecc6210 0x56059ecc2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40784/0 (socket says 172.21.15.151:40784) 2023-07-21T22:20:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.193+0000 7fea2e59c700 1 -- 172.21.15.151:0/70093486 learned_addr learned my addr 172.21.15.151:0/70093486 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea2e59c700 1 -- 172.21.15.151:0/70093486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 msgr2=0x56059ecc1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea2e59c700 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea2e59c700 1 -- 172.21.15.151:0/70093486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059ecc6210 msgr2=0x56059ecc2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea2e59c700 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059ecc6210 0x56059ecc2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea2e59c700 1 -- 172.21.15.151:0/70093486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56059ea28c00 con 0x56059eb1c6b0 2023-07-21T22:20:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea2e59c700 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059eb1c6b0 0x56059ecc2820 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fea20096a10 tx=0x7fea2001a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86d0f3b5e51eea71 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:20:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea15ffb700 1 -- 172.21.15.151:0/70093486 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea20064070 con 0x56059eb1c6b0 2023-07-21T22:20:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea15ffb700 1 -- 172.21.15.151:0/70093486 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fea20010880 con 0x56059eb1c6b0 2023-07-21T22:20:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea4827cb80 1 -- 172.21.15.151:0/70093486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea24011e10 con 0x56059eb1c6b0 2023-07-21T22:20:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea15ffb700 1 -- 172.21.15.151:0/70093486 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea20099ff0 con 0x56059eb1c6b0 2023-07-21T22:20:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea4827cb80 10 client.25640 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.194+0000 7fea4827cb80 1 -- 172.21.15.151:0/70093486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56059ea3e250 con 0x56059eb1c6b0 2023-07-21T22:20:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.195+0000 7fea15ffb700 1 -- 172.21.15.151:0/70093486 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea200c8080 con 0x56059eb1c6b0 2023-07-21T22:20:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.195+0000 7fea15ffb700 1 -- 172.21.15.151:0/70093486 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fea200a1fb0 con 0x56059eb1c6b0 2023-07-21T22:20:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.195+0000 7fea4827cb80 10 client.25640 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.195+0000 7fea4827cb80 10 client.25640 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.195+0000 7fea4827cb80 20 client.25640 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.195+0000 7fea4827cb80 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56059ed2e520 0x56059ed30930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.195+0000 7fea4827cb80 4 client.25640 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:20:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.195+0000 7fea4827cb80 1 -- 172.21.15.151:0/70093486 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56059ebccff0 con 0x56059ed2e520 2023-07-21T22:20:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.195+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56059ed2e520 0x56059ed30930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.196+0000 7fea2dd9b700 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56059ed2e520 0x56059ed30930 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c82c9d74b180e1a server_cookie=7cc51c50ee796aa4 in_seq=0 out_seq=0 2023-07-21T22:20:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.196+0000 7fea15ffb700 10 client.25640 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea15ffb700 1 -- 172.21.15.151:0/70093486 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56059ebccff0 con 0x56059ed2e520 2023-07-21T22:20:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea15ffb700 10 client.25640 handle_command_reply: tid=0 2023-07-21T22:20:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 client.25640 shutdown 2023-07-21T22:20:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 -- 172.21.15.151:0/70093486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059eb1c6b0 msgr2=0x56059ecc2820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059eb1c6b0 0x56059ecc2820 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fea20096a10 tx=0x7fea2001a040 comp rx=0 tx=0).stop 2023-07-21T22:20:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 -- 172.21.15.151:0/70093486 shutdown_connections 2023-07-21T22:20:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56059ed2e520 0x56059ed30930 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56059eb1c6b0 0x56059ecc2820 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56059ecc6660 0x56059ecc1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea15ffb700 0 client.25640 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 --2- 172.21.15.151:0/70093486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56059ecc6210 0x56059ecc2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 -- 172.21.15.151:0/70093486 >> 172.21.15.151:0/70093486 conn(0x56059ecb5ae0 msgr2=0x56059ecc6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 -- 172.21.15.151:0/70093486 shutdown_connections 2023-07-21T22:20:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 1 -- 172.21.15.151:0/70093486 wait complete. 2023-07-21T22:20:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.215+0000 7fea4827cb80 20 client.25640 trim_cache size 0 max 16384 2023-07-21T22:20:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:20:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:20:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:20:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:20:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 -- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea180a13e0 msgr2=0x7fea180a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea180a13e0 0x7fea180a3890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fea28009cd0 tx=0x7fea28006210 comp rx=0 tx=0).stop 2023-07-21T22:20:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 -- 172.21.15.151:0/3163441076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea300ffb30 msgr2=0x7fea30197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea300ffb30 0x7fea30197de0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fea2000e9a0 tx=0x7fea2000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 -- 172.21.15.151:0/3163441076 shutdown_connections 2023-07-21T22:20:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea180a13e0 0x7fea180a3890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea300ffb30 0x7fea30197de0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea30105b60 0x7fea3019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 --2- 172.21.15.151:0/3163441076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea301004e0 0x7fea30198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 -- 172.21.15.151:0/3163441076 >> 172.21.15.151:0/3163441076 conn(0x7fea300fb5f0 msgr2=0x7fea3010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 -- 172.21.15.151:0/3163441076 shutdown_connections 2023-07-21T22:20:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:33.216+0000 7fea349ff700 1 -- 172.21.15.151:0/3163441076 wait complete. 2023-07-21T22:20:34.432 INFO:teuthology.orchestra.run.smithi151.stderr:3800000 of 50000000 tuples (7%) done (elapsed 57.92 s, remaining 704.24 s) 2023-07-21T22:20:34.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:34 smithi151 ceph-mon[95510]: pgmap v44: 97 pgs: 97 active+clean; 902 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 MiB/s wr, 34 op/s 2023-07-21T22:20:34.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:34 smithi187 ceph-mon[96918]: pgmap v44: 97 pgs: 97 active+clean; 902 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 MiB/s wr, 34 op/s 2023-07-21T22:20:34.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:34 smithi195 ceph-mon[97365]: pgmap v44: 97 pgs: 97 active+clean; 902 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 37 MiB/s wr, 34 op/s 2023-07-21T22:20:36.143 INFO:teuthology.orchestra.run.smithi151.stderr:3900000 of 50000000 tuples (7%) done (elapsed 59.64 s, remaining 704.92 s) 2023-07-21T22:20:36.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:36 smithi151 ceph-mon[95510]: pgmap v45: 97 pgs: 97 active+clean; 902 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-21T22:20:36.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:36 smithi187 ceph-mon[96918]: pgmap v45: 97 pgs: 97 active+clean; 902 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-21T22:20:36.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:36 smithi195 ceph-mon[97365]: pgmap v45: 97 pgs: 97 active+clean; 902 MiB data, 718 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 18 op/s 2023-07-21T22:20:37.378 INFO:teuthology.orchestra.run.smithi151.stderr:4000000 of 50000000 tuples (8%) done (elapsed 60.87 s, remaining 700.01 s) 2023-07-21T22:20:38.202 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:20:38.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.385+0000 7f4743bff700 1 -- 172.21.15.151:0/3305291045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c0ffae0 msgr2=0x7f473c0fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.385+0000 7f4743bff700 1 --2- 172.21.15.151:0/3305291045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c0ffae0 0x7f473c0fff50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f472c0098f0 tx=0x7f472c009c00 comp rx=0 tx=0).stop 2023-07-21T22:20:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.385+0000 7f4743bff700 1 -- 172.21.15.151:0/3305291045 shutdown_connections 2023-07-21T22:20:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.385+0000 7f4743bff700 1 --2- 172.21.15.151:0/3305291045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f473c100490 0x7f473c10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.385+0000 7f4743bff700 1 --2- 172.21.15.151:0/3305291045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f473c105af0 0x7f473c105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.385+0000 7f4743bff700 1 --2- 172.21.15.151:0/3305291045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c0ffae0 0x7f473c0fff50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.385+0000 7f4743bff700 1 -- 172.21.15.151:0/3305291045 >> 172.21.15.151:0/3305291045 conn(0x7f473c0fb5e0 msgr2=0x7f473c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:38.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.385+0000 7f4743bff700 1 -- 172.21.15.151:0/3305291045 shutdown_connections 2023-07-21T22:20:38.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.386+0000 7f4743bff700 1 -- 172.21.15.151:0/3305291045 wait complete. 2023-07-21T22:20:38.431 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.387+0000 7f4743bff700 1 Processor -- start 2023-07-21T22:20:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.387+0000 7f4743bff700 1 -- start start 2023-07-21T22:20:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f4743bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f473c0ffae0 0x7f473c19b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f4743bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c100490 0x7f473c19be90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f4743bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f473c105af0 0x7f473c1959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f4743bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c196030 con 0x7f473c0ffae0 2023-07-21T22:20:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f4743bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c1961a0 con 0x7f473c100490 2023-07-21T22:20:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f4743bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473c196360 con 0x7f473c105af0 2023-07-21T22:20:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f473c0ffae0 0x7f473c19b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474119a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c100490 0x7f473c19be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474219c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f473c105af0 0x7f473c1959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f473c0ffae0 0x7f473c19b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52896/0 (socket says 172.21.15.151:52896) 2023-07-21T22:20:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474119a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c100490 0x7f473c19be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53652/0 (socket says 172.21.15.151:53652) 2023-07-21T22:20:38.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474199b700 1 -- 172.21.15.151:0/3112841654 learned_addr learned my addr 172.21.15.151:0/3112841654 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:38.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474119a700 1 -- 172.21.15.151:0/3112841654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f473c105af0 msgr2=0x7f473c1959c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:38.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474119a700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f473c105af0 0x7f473c1959c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474119a700 1 -- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f473c0ffae0 msgr2=0x7f473c19b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:38.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474119a700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f473c0ffae0 0x7f473c19b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474119a700 1 -- 172.21.15.151:0/3112841654 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c009520 con 0x7f473c100490 2023-07-21T22:20:38.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.388+0000 7f474199b700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f473c0ffae0 0x7f473c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:38.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.389+0000 7f474119a700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c100490 0x7f473c19be90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f472c009810 tx=0x7f472c00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:38.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.389+0000 7f4732ffd700 1 -- 172.21.15.151:0/3112841654 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c01c070 con 0x7f473c100490 2023-07-21T22:20:38.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.389+0000 7f4743bff700 1 -- 172.21.15.151:0/3112841654 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c1965e0 con 0x7f473c100490 2023-07-21T22:20:38.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.389+0000 7f4732ffd700 1 -- 172.21.15.151:0/3112841654 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f472c00ba70 con 0x7f473c100490 2023-07-21T22:20:38.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.389+0000 7f4732ffd700 1 -- 172.21.15.151:0/3112841654 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c0038e0 con 0x7f473c100490 2023-07-21T22:20:38.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.389+0000 7f4743bff700 1 -- 172.21.15.151:0/3112841654 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c1a2940 con 0x7f473c100490 2023-07-21T22:20:38.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.392+0000 7f4732ffd700 1 -- 172.21.15.151:0/3112841654 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 24) v1 ==== 135949+0+0 (secure 0 0 0) 0x7f472c020030 con 0x7f473c100490 2023-07-21T22:20:38.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.394+0000 7f4732ffd700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47280a13e0 0x7f47280a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.394+0000 7f47574f5b80 1 Processor -- start 2023-07-21T22:20:38.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.394+0000 7f4732ffd700 1 -- 172.21.15.151:0/3112841654 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f472c0cdd50 con 0x7f473c100490 2023-07-21T22:20:38.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.394+0000 7f47574f5b80 1 -- start start 2023-07-21T22:20:38.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474199b700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47280a13e0 0x7f47280a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 0x55a3f047a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047aac0 0x55a3f0475350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f0475930 0x55a3f0475da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f47574f5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f037acb0 con 0x55a3f0475930 2023-07-21T22:20:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f47574f5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f03cda40 con 0x55a3f047aac0 2023-07-21T22:20:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f47574f5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f03c6ed0 con 0x55a3f047a1b0 2023-07-21T22:20:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 0x55a3f047a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 0x55a3f047a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:44028/0 (socket says 172.21.15.151:44028) 2023-07-21T22:20:38.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474119a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047aac0 0x55a3f0475350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474199b700 1 -- 172.21.15.151:0/3049586781 learned_addr learned my addr 172.21.15.151:0/3049586781 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:38.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474219c700 1 --2- 172.21.15.151:0/3049586781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f0475930 0x55a3f0475da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474119a700 1 -- 172.21.15.151:0/3049586781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 msgr2=0x55a3f047a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474119a700 1 --2- 172.21.15.151:0/3049586781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 0x55a3f047a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474119a700 1 -- 172.21.15.151:0/3049586781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f0475930 msgr2=0x55a3f0475da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474119a700 1 --2- 172.21.15.151:0/3049586781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f0475930 0x55a3f0475da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.395+0000 7f474119a700 1 -- 172.21.15.151:0/3049586781 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3f01f4de0 con 0x55a3f047aac0 2023-07-21T22:20:38.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.396+0000 7f474219c700 1 --2- 172.21.15.151:0/3049586781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f0475930 0x55a3f0475da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:38.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.396+0000 7f474199b700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47280a13e0 0x7f47280a3890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4738011a40 tx=0x7f4738011e00 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:38.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.396+0000 7f474119a700 1 --2- 172.21.15.151:0/3049586781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047aac0 0x55a3f0475350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f472c0cb330 tx=0x7f472c009c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8b09b5aa28ef1e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:38.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.396+0000 7f4727fff700 1 -- 172.21.15.151:0/3049586781 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c09a5d0 con 0x55a3f047aac0 2023-07-21T22:20:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.396+0000 7f4727fff700 1 -- 172.21.15.151:0/3049586781 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f472c09ac70 con 0x55a3f047aac0 2023-07-21T22:20:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.396+0000 7f4727fff700 1 -- 172.21.15.151:0/3049586781 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00b5e0 con 0x55a3f047aac0 2023-07-21T22:20:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.397+0000 7f47574f5b80 1 -- 172.21.15.151:0/3049586781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047aac0 msgr2=0x55a3f0475350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:38.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.397+0000 7f47574f5b80 1 --2- 172.21.15.151:0/3049586781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047aac0 0x55a3f0475350 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f472c0cb330 tx=0x7f472c009c00 comp rx=0 tx=0).stop 2023-07-21T22:20:38.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.397+0000 7f47574f5b80 1 -- 172.21.15.151:0/3049586781 shutdown_connections 2023-07-21T22:20:38.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.397+0000 7f47574f5b80 1 --2- 172.21.15.151:0/3049586781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f0475930 0x55a3f0475da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.397+0000 7f47574f5b80 1 --2- 172.21.15.151:0/3049586781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 0x55a3f047a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.397+0000 7f47574f5b80 1 --2- 172.21.15.151:0/3049586781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047aac0 0x55a3f0475350 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.397+0000 7f47574f5b80 1 -- 172.21.15.151:0/3049586781 >> 172.21.15.151:0/3049586781 conn(0x55a3f046aef0 msgr2=0x55a3f0470830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.397+0000 7f47574f5b80 1 -- 172.21.15.151:0/3049586781 shutdown_connections 2023-07-21T22:20:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.397+0000 7f47574f5b80 1 -- 172.21.15.151:0/3049586781 wait complete. 2023-07-21T22:20:38.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.398+0000 7f47574f5b80 1 -- start start 2023-07-21T22:20:38.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.398+0000 7f47574f5b80 1 Processor -- start 2023-07-21T22:20:38.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0481b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f047ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f047f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f47574f5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f0366ac0 con 0x55a3f047aac0 2023-07-21T22:20:38.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f47574f5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f03667c0 con 0x55a3f047a1b0 2023-07-21T22:20:38.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f47574f5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f024a920 con 0x55a3f0475930 2023-07-21T22:20:38.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f47574f5b80 10 client.0 _ll_register_callbacks cb 0x55a3f0364760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:38.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f474119a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f047ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f474199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0481b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f474119a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f047ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53668/0 (socket says 172.21.15.151:53668) 2023-07-21T22:20:38.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f474119a700 1 -- 172.21.15.151:0/4217095665 learned_addr learned my addr 172.21.15.151:0/4217095665 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:38.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.399+0000 7f474219c700 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f047f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f474119a700 1 -- 172.21.15.151:0/4217095665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 msgr2=0x55a3f0481b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:38.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f474119a700 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0481b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f474119a700 1 -- 172.21.15.151:0/4217095665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 msgr2=0x55a3f047f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:38.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f474119a700 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f047f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f474119a700 1 -- 172.21.15.151:0/4217095665 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473c1a2940 con 0x55a3f047a1b0 2023-07-21T22:20:38.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f474199b700 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0481b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:38.457 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f474119a700 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f047ee60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f472c000c00 tx=0x7f472c099220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d6e8567f03924ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:38.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f47257fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:20:38.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f47257fa700 1 -- 172.21.15.151:0/4217095665 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c0052d0 con 0x55a3f047a1b0 2023-07-21T22:20:38.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f47257fa700 1 -- 172.21.15.151:0/4217095665 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f472c0a3030 con 0x55a3f047a1b0 2023-07-21T22:20:38.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f47574f5b80 1 -- 172.21.15.151:0/4217095665 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3f03204f0 con 0x55a3f047a1b0 2023-07-21T22:20:38.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f47257fa700 1 -- 172.21.15.151:0/4217095665 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f472c00b5e0 con 0x55a3f047a1b0 2023-07-21T22:20:38.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f47574f5b80 10 client.25652 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:38.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.400+0000 7f47574f5b80 1 -- 172.21.15.151:0/4217095665 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a3f01ddc60 con 0x55a3f047a1b0 2023-07-21T22:20:38.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.401+0000 7f47257fa700 1 -- 172.21.15.151:0/4217095665 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a3f03204f0 con 0x55a3f047a1b0 2023-07-21T22:20:38.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.401+0000 7f47257fa700 1 -- 172.21.15.151:0/4217095665 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f472c09a160 con 0x55a3f047a1b0 2023-07-21T22:20:38.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.401+0000 7f47574f5b80 10 client.25652 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:38.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.401+0000 7f47574f5b80 10 client.25652 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:38.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.401+0000 7f47574f5b80 20 client.25652 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:38.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.401+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3f048ed40 0x55a3f0491120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.401+0000 7f47574f5b80 4 client.25652 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:38.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.401+0000 7f47574f5b80 1 -- 172.21.15.151:0/4217095665 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3f03bfeb0 con 0x55a3f048ed40 2023-07-21T22:20:38.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.401+0000 7f474199b700 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3f048ed40 0x55a3f0491120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.402+0000 7f47257fa700 10 client.25652 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:38.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.402+0000 7f474199b700 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3f048ed40 0x55a3f0491120 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4278d8df0e1eebe server_cookie=60147c4ec189c4fd in_seq=0 out_seq=0 2023-07-21T22:20:38.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.402+0000 7f47257fa700 1 -- 172.21.15.151:0/4217095665 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a3f03bfeb0 con 0x55a3f048ed40 2023-07-21T22:20:38.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.402+0000 7f47257fa700 10 client.25652 handle_command_reply: tid=0 2023-07-21T22:20:38.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 client.25652 shutdown 2023-07-21T22:20:38.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 -- 172.21.15.151:0/4217095665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 msgr2=0x55a3f047ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:38.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f047ee60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f472c000c00 tx=0x7f472c099220 comp rx=0 tx=0).stop 2023-07-21T22:20:38.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 -- 172.21.15.151:0/4217095665 shutdown_connections 2023-07-21T22:20:38.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3f048ed40 0x55a3f0491120 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f047f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47257fa700 0 client.25652 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:38.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0481b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4217095665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f047ee60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 -- 172.21.15.151:0/4217095665 >> 172.21.15.151:0/4217095665 conn(0x55a3f046aef0 msgr2=0x55a3f04703c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:38.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 -- 172.21.15.151:0/4217095665 shutdown_connections 2023-07-21T22:20:38.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 1 -- 172.21.15.151:0/4217095665 wait complete. 2023-07-21T22:20:38.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.403+0000 7f47574f5b80 20 client.25652 trim_cache size 0 max 16384 2023-07-21T22:20:38.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.425+0000 7f47574f5b80 1 Processor -- start 2023-07-21T22:20:38.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f47574f5b80 1 -- start start 2023-07-21T22:20:38.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f0475930 0x55a3f0486390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 0x55a3f048b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0481710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f47574f5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f04868d0 con 0x55a3f047aac0 2023-07-21T22:20:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f47574f5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f0479d30 con 0x55a3f0475930 2023-07-21T22:20:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f47574f5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f0491120 con 0x55a3f047a1b0 2023-07-21T22:20:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f474199b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f0475930 0x55a3f0486390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f474199b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f0475930 0x55a3f0486390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53674/0 (socket says 172.21.15.151:53674) 2023-07-21T22:20:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f474199b700 1 -- 172.21.15.151:0/4191196153 learned_addr learned my addr 172.21.15.151:0/4191196153 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:38.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f474219c700 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0481710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.426+0000 7f474119a700 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 0x55a3f048b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f474199b700 1 -- 172.21.15.151:0/4191196153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 msgr2=0x55a3f048b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f474199b700 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 0x55a3f048b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f474199b700 1 -- 172.21.15.151:0/4191196153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 msgr2=0x55a3f0481710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:38.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f474199b700 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0481710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f474199b700 1 -- 172.21.15.151:0/4191196153 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3f021b250 con 0x55a3f0475930 2023-07-21T22:20:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f474219c700 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0481710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f474199b700 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f0475930 0x55a3f0486390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47380117a0 tx=0x7f4738020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fddaf0e96a94f686 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:38.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f4730bff700 1 -- 172.21.15.151:0/4191196153 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738016040 con 0x55a3f0475930 2023-07-21T22:20:38.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f4730bff700 1 -- 172.21.15.151:0/4191196153 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f473800fe00 con 0x55a3f0475930 2023-07-21T22:20:38.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.427+0000 7f4730bff700 1 -- 172.21.15.151:0/4191196153 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738004e30 con 0x55a3f0475930 2023-07-21T22:20:38.478 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.428+0000 7f47574f5b80 1 -- 172.21.15.151:0/4191196153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f0475930 msgr2=0x55a3f0486390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:38.478 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.428+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f0475930 0x55a3f0486390 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47380117a0 tx=0x7f4738020000 comp rx=0 tx=0).stop 2023-07-21T22:20:38.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.428+0000 7f47574f5b80 1 -- 172.21.15.151:0/4191196153 shutdown_connections 2023-07-21T22:20:38.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.428+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f0475930 0x55a3f0486390 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.428+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0481710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.428+0000 7f47574f5b80 1 --2- 172.21.15.151:0/4191196153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f047a1b0 0x55a3f048b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.428+0000 7f47574f5b80 1 -- 172.21.15.151:0/4191196153 >> 172.21.15.151:0/4191196153 conn(0x55a3f046aef0 msgr2=0x55a3f046ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:38.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.428+0000 7f47574f5b80 1 -- 172.21.15.151:0/4191196153 shutdown_connections 2023-07-21T22:20:38.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.428+0000 7f47574f5b80 1 -- 172.21.15.151:0/4191196153 wait complete. 2023-07-21T22:20:38.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.429+0000 7f47574f5b80 1 -- start start 2023-07-21T22:20:38.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.429+0000 7f47574f5b80 1 Processor -- start 2023-07-21T22:20:38.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.429+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0485bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.429+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f04860f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.429+0000 7f47574f5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0484370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f47574f5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f0484970 con 0x55a3f047aac0 2023-07-21T22:20:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f47574f5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f0484ae0 con 0x55a3f047a1b0 2023-07-21T22:20:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f47574f5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3f0484ca0 con 0x55a3f0475930 2023-07-21T22:20:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f47574f5b80 10 client.0 _ll_register_callbacks cb 0x7f472c096fb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0485bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0485bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:44052/0 (socket says 172.21.15.151:44052) 2023-07-21T22:20:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474199b700 1 -- 172.21.15.151:0/2924970478 learned_addr learned my addr 172.21.15.151:0/2924970478 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474119a700 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f04860f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474219c700 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0484370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474199b700 1 -- 172.21.15.151:0/2924970478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 msgr2=0x55a3f04860f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474199b700 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f04860f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474199b700 1 -- 172.21.15.151:0/2924970478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 msgr2=0x55a3f0484370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474199b700 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0484370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474199b700 1 -- 172.21.15.151:0/2924970478 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4738025040 con 0x55a3f0475930 2023-07-21T22:20:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474219c700 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0484370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:20:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f474199b700 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0485bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f473802e040 tx=0x7f4738004800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5673d95645b5343 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:38.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.430+0000 7f47257fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:20:38.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.431+0000 7f47257fa700 1 -- 172.21.15.151:0/2924970478 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4738016040 con 0x55a3f0475930 2023-07-21T22:20:38.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.431+0000 7f47574f5b80 1 -- 172.21.15.151:0/2924970478 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f472c09ac70 con 0x55a3f0475930 2023-07-21T22:20:38.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.431+0000 7f47257fa700 1 -- 172.21.15.151:0/2924970478 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f473802b2c0 con 0x55a3f0475930 2023-07-21T22:20:38.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.431+0000 7f47257fa700 1 -- 172.21.15.151:0/2924970478 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f473802b480 con 0x55a3f0475930 2023-07-21T22:20:38.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.431+0000 7f47574f5b80 10 client.25690 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:38.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.431+0000 7f47574f5b80 1 -- 172.21.15.151:0/2924970478 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55a3f01f32b0 con 0x55a3f0475930 2023-07-21T22:20:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.431+0000 7f47257fa700 1 -- 172.21.15.151:0/2924970478 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f472c09ac70 con 0x55a3f0475930 2023-07-21T22:20:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f47257fa700 1 -- 172.21.15.151:0/2924970478 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4738028040 con 0x55a3f0475930 2023-07-21T22:20:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f47574f5b80 10 client.25690 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f47574f5b80 10 client.25690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f47574f5b80 20 client.25690 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f47574f5b80 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3f04e3e30 0x55a3f04e6240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f47574f5b80 4 client.25690 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:20:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f47574f5b80 1 -- 172.21.15.151:0/2924970478 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a3f0382050 con 0x55a3f04e3e30 2023-07-21T22:20:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f474119a700 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3f04e3e30 0x55a3f04e6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f474119a700 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3f04e3e30 0x55a3f04e6240 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c85fc92aefa4858 server_cookie=bb6408e8db7c9bc2 in_seq=0 out_seq=0 2023-07-21T22:20:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.432+0000 7f47257fa700 10 client.25690 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47257fa700 1 -- 172.21.15.151:0/2924970478 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a3f0382050 con 0x55a3f04e3e30 2023-07-21T22:20:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47257fa700 10 client.25690 handle_command_reply: tid=0 2023-07-21T22:20:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 client.25690 shutdown 2023-07-21T22:20:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 -- 172.21.15.151:0/2924970478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 msgr2=0x55a3f0485bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0485bb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f473802e040 tx=0x7f4738004800 comp rx=0 tx=0).stop 2023-07-21T22:20:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 -- 172.21.15.151:0/2924970478 shutdown_connections 2023-07-21T22:20:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3f04e3e30 0x55a3f04e6240 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3f047aac0 0x55a3f0484370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47257fa700 0 client.25690 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3f0475930 0x55a3f0485bb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 --2- 172.21.15.151:0/2924970478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3f047a1b0 0x55a3f04860f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 -- 172.21.15.151:0/2924970478 >> 172.21.15.151:0/2924970478 conn(0x55a3f046aef0 msgr2=0x55a3f048b3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:38.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 -- 172.21.15.151:0/2924970478 shutdown_connections 2023-07-21T22:20:38.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 1 -- 172.21.15.151:0/2924970478 wait complete. 2023-07-21T22:20:38.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.433+0000 7f47574f5b80 20 client.25690 trim_cache size 0 max 16384 2023-07-21T22:20:38.487 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:20:38.487 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:20:38.488 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:20:38.488 INFO:teuthology.orchestra.run.smithi151.stdout: "ec38d3a5-93f8-4072-bfe2-c7872d39c48a": { 2023-07-21T22:20:38.488 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:20:38.488 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "ec38d3a5-93f8-4072-bfe2-c7872d39c48a", 2023-07-21T22:20:38.488 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:20:38.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:20:38.488 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:20:38.489 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:20:38.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 -- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47280a13e0 msgr2=0x7f47280a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:38.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47280a13e0 0x7f47280a3890 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4738011a40 tx=0x7f4738011e00 comp rx=0 tx=0).stop 2023-07-21T22:20:38.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 -- 172.21.15.151:0/3112841654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c100490 msgr2=0x7f473c19be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:38.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c100490 0x7f473c19be90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f472c009810 tx=0x7f472c00fa00 comp rx=0 tx=0).stop 2023-07-21T22:20:38.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 -- 172.21.15.151:0/3112841654 shutdown_connections 2023-07-21T22:20:38.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47280a13e0 0x7f47280a3890 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f473c105af0 0x7f473c1959c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f473c0ffae0 0x7f473c19b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 --2- 172.21.15.151:0/3112841654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f473c100490 0x7f473c19be90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:38.490 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 -- 172.21.15.151:0/3112841654 >> 172.21.15.151:0/3112841654 conn(0x7f473c0fb5e0 msgr2=0x7f473c0fbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:38.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 -- 172.21.15.151:0/3112841654 shutdown_connections 2023-07-21T22:20:38.491 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:20:38.434+0000 7f4743bff700 1 -- 172.21.15.151:0/3112841654 wait complete. 2023-07-21T22:20:38.497 INFO:tasks.cephfs.filesystem:scrub status for tag:ec38d3a5-93f8-4072-bfe2-c7872d39c48a - {'path': '/', 'tag': 'ec38d3a5-93f8-4072-bfe2-c7872d39c48a', 'options': 'recursive,force'} 2023-07-21T22:20:38.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:38 smithi151 ceph-mon[95510]: pgmap v46: 97 pgs: 97 active+clean; 979 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 38 op/s 2023-07-21T22:20:38.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:38 smithi187 ceph-mon[96918]: pgmap v46: 97 pgs: 97 active+clean; 979 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 38 op/s 2023-07-21T22:20:38.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:38 smithi195 ceph-mon[97365]: pgmap v46: 97 pgs: 97 active+clean; 979 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 37 MiB/s wr, 38 op/s 2023-07-21T22:20:38.948 INFO:teuthology.orchestra.run.smithi151.stderr:4100000 of 50000000 tuples (8%) done (elapsed 62.44 s, remaining 699.03 s) 2023-07-21T22:20:40.213 INFO:teuthology.orchestra.run.smithi151.stderr:4200000 of 50000000 tuples (8%) done (elapsed 63.71 s, remaining 694.70 s) 2023-07-21T22:20:40.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:40 smithi151 ceph-mon[95510]: pgmap v47: 97 pgs: 97 active+clean; 979 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 33 op/s 2023-07-21T22:20:40.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:40 smithi187 ceph-mon[96918]: pgmap v47: 97 pgs: 97 active+clean; 979 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 33 op/s 2023-07-21T22:20:40.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:40 smithi195 ceph-mon[97365]: pgmap v47: 97 pgs: 97 active+clean; 979 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 27 MiB/s wr, 33 op/s 2023-07-21T22:20:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:4300000 of 50000000 tuples (8%) done (elapsed 65.35 s, remaining 694.53 s) 2023-07-21T22:20:42.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:42 smithi151 ceph-mon[95510]: pgmap v48: 97 pgs: 97 active+clean; 979 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 30 op/s 2023-07-21T22:20:42.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:42 smithi187 ceph-mon[96918]: pgmap v48: 97 pgs: 97 active+clean; 979 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 30 op/s 2023-07-21T22:20:42.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:42 smithi195 ceph-mon[97365]: pgmap v48: 97 pgs: 97 active+clean; 979 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 30 op/s 2023-07-21T22:20:43.533 INFO:teuthology.orchestra.run.smithi151.stderr:4400000 of 50000000 tuples (8%) done (elapsed 67.03 s, remaining 694.63 s) 2023-07-21T22:20:44.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:44 smithi151 ceph-mon[95510]: pgmap v49: 97 pgs: 97 active+clean; 1.0 GiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 39 MiB/s wr, 42 op/s 2023-07-21T22:20:44.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:44 smithi151 ceph-mon[95510]: mgrmap e25: x(active, since 92s), standbys: y, z 2023-07-21T22:20:44.757 INFO:teuthology.orchestra.run.smithi151.stderr:4500000 of 50000000 tuples (9%) done (elapsed 68.25 s, remaining 690.07 s) 2023-07-21T22:20:44.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:44 smithi187 ceph-mon[96918]: pgmap v49: 97 pgs: 97 active+clean; 1.0 GiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 39 MiB/s wr, 42 op/s 2023-07-21T22:20:44.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:44 smithi187 ceph-mon[96918]: mgrmap e25: x(active, since 92s), standbys: y, z 2023-07-21T22:20:44.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:44 smithi195 ceph-mon[97365]: pgmap v49: 97 pgs: 97 active+clean; 1.0 GiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 39 MiB/s wr, 42 op/s 2023-07-21T22:20:44.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:44 smithi195 ceph-mon[97365]: mgrmap e25: x(active, since 92s), standbys: y, z 2023-07-21T22:20:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.380+0000 7f99d79ff700 1 -- 172.21.15.151:0/2430746527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99d0067c10 msgr2=0x7f99d0067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.380+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2430746527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99d0067c10 0x7f99d0067fe0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009990 tx=0x7f99cc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.380+0000 7f99d79ff700 1 -- 172.21.15.151:0/2430746527 shutdown_connections 2023-07-21T22:20:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.380+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2430746527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d0104e50 0x7f99d010ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.380+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2430746527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99d0067c10 0x7f99d0067fe0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.380+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2430746527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99d00685b0 0x7f99d0104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.380+0000 7f99d79ff700 1 -- 172.21.15.151:0/2430746527 >> 172.21.15.151:0/2430746527 conn(0x7f99d0074760 msgr2=0x7f99d0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:46.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.381+0000 7f99d79ff700 1 -- 172.21.15.151:0/2430746527 shutdown_connections 2023-07-21T22:20:46.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.381+0000 7f99d79ff700 1 -- 172.21.15.151:0/2430746527 wait complete. 2023-07-21T22:20:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.382+0000 7f99d79ff700 1 Processor -- start 2023-07-21T22:20:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.382+0000 7f99d79ff700 1 -- start start 2023-07-21T22:20:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.382+0000 7f99d79ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99d0067c10 0x7f99d0197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.382+0000 7f99d79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d00685b0 0x7f99d0198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.382+0000 7f99d79ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99d0104e50 0x7f99d019c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.382+0000 7f99d79ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d019cf10 con 0x7f99d0067c10 2023-07-21T22:20:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.382+0000 7f99d79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d019d080 con 0x7f99d00685b0 2023-07-21T22:20:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.382+0000 7f99d79ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d019d240 con 0x7f99d0104e50 2023-07-21T22:20:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99d0067c10 0x7f99d0197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d4f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d00685b0 0x7f99d0198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99d0067c10 0x7f99d0197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48086/0 (socket says 172.21.15.151:48086) 2023-07-21T22:20:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d579b700 1 -- 172.21.15.151:0/2474416160 learned_addr learned my addr 172.21.15.151:0/2474416160 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99d0104e50 0x7f99d019c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d579b700 1 -- 172.21.15.151:0/2474416160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99d0104e50 msgr2=0x7f99d019c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d579b700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99d0104e50 0x7f99d019c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d579b700 1 -- 172.21.15.151:0/2474416160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d00685b0 msgr2=0x7f99d0198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d579b700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d00685b0 0x7f99d0198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d579b700 1 -- 172.21.15.151:0/2474416160 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99cc0095f0 con 0x7f99d0067c10 2023-07-21T22:20:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d00685b0 0x7f99d0198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:20:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.383+0000 7f99d579b700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99d0067c10 0x7f99d0197d20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00b650 tx=0x7f99cc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.384+0000 7f99c67fc700 1 -- 172.21.15.151:0/2474416160 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc01d070 con 0x7f99d0067c10 2023-07-21T22:20:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.384+0000 7f99c67fc700 1 -- 172.21.15.151:0/2474416160 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99cc022470 con 0x7f99d0067c10 2023-07-21T22:20:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.384+0000 7f99d79ff700 1 -- 172.21.15.151:0/2474416160 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d019d4c0 con 0x7f99d0067c10 2023-07-21T22:20:46.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.384+0000 7f99c67fc700 1 -- 172.21.15.151:0/2474416160 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc017650 con 0x7f99d0067c10 2023-07-21T22:20:46.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.384+0000 7f99d79ff700 1 -- 172.21.15.151:0/2474416160 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d01a4d60 con 0x7f99d0067c10 2023-07-21T22:20:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.387+0000 7f99c67fc700 1 -- 172.21.15.151:0/2474416160 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f99cc0225e0 con 0x7f99d0067c10 2023-07-21T22:20:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.389+0000 7f99eb25fb80 1 Processor -- start 2023-07-21T22:20:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.389+0000 7f99eb25fb80 1 -- start start 2023-07-21T22:20:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8a9436b0 0x560a8aaeccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaed210 0x560a8aae6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99c67fc700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f99bc0a1340 0x7f99bc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed660 0x560a8aae74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8a9ecc50 con 0x560a8aaed210 2023-07-21T22:20:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8aa3f9e0 con 0x560a8a9436b0 2023-07-21T22:20:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8aa38e70 con 0x560a8aaed660 2023-07-21T22:20:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99c67fc700 1 -- 172.21.15.151:0/2474416160 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f99cc0ce080 con 0x7f99d0067c10 2023-07-21T22:20:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d5f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8a9436b0 0x560a8aaeccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d5f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8a9436b0 0x560a8aaeccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53450/0 (socket says 172.21.15.151:53450) 2023-07-21T22:20:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d5f9c700 1 -- 172.21.15.151:0/3634328438 learned_addr learned my addr 172.21.15.151:0/3634328438 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/3634328438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed660 0x560a8aae74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/3634328438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaed210 0x560a8aae6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d5f9c700 1 -- 172.21.15.151:0/3634328438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed660 msgr2=0x560a8aae74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/3634328438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed660 0x560a8aae74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d5f9c700 1 -- 172.21.15.151:0/3634328438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaed210 msgr2=0x560a8aae6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/3634328438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaed210 0x560a8aae6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.390+0000 7f99d5f9c700 1 -- 172.21.15.151:0/3634328438 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a8a866d80 con 0x560a8a9436b0 2023-07-21T22:20:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.391+0000 7f99d579b700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f99bc0a1340 0x7f99bc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.391+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/3634328438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8a9436b0 0x560a8aaeccd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f99c8008cd0 tx=0x7f99c8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab313e182f04f7ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.391+0000 7f99d579b700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f99bc0a1340 0x7f99bc0a37f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0a30c0 tx=0x7f99cc01a040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.392+0000 7f99bb7fe700 1 -- 172.21.15.151:0/3634328438 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c801f070 con 0x560a8a9436b0 2023-07-21T22:20:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.392+0000 7f99bb7fe700 1 -- 172.21.15.151:0/3634328438 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99c800f040 con 0x560a8a9436b0 2023-07-21T22:20:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.392+0000 7f99bb7fe700 1 -- 172.21.15.151:0/3634328438 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c800e050 con 0x560a8a9436b0 2023-07-21T22:20:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.393+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3634328438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8a9436b0 msgr2=0x560a8aaeccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.393+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3634328438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8a9436b0 0x560a8aaeccd0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f99c8008cd0 tx=0x7f99c8009920 comp rx=0 tx=0).stop 2023-07-21T22:20:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.393+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3634328438 shutdown_connections 2023-07-21T22:20:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.393+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3634328438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8a9436b0 0x560a8aaeccd0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.393+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3634328438 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed660 0x560a8aae74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.393+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3634328438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaed210 0x560a8aae6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.393+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3634328438 >> 172.21.15.151:0/3634328438 conn(0x560a8aadcae0 msgr2=0x560a8aae20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.393+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3634328438 shutdown_connections 2023-07-21T22:20:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.393+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3634328438 wait complete. 2023-07-21T22:20:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.394+0000 7f99eb25fb80 1 -- start start 2023-07-21T22:20:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.394+0000 7f99eb25fb80 1 Processor -- start 2023-07-21T22:20:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8a9436b0 0x560a8aaf35c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed210 0x560a8aaf0840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aaed660 0x560a8aaf0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8a9d8a60 con 0x560a8a9436b0 2023-07-21T22:20:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8a9d8760 con 0x560a8aaed660 2023-07-21T22:20:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8a8bc8c0 con 0x560a8aaed210 2023-07-21T22:20:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99eb25fb80 10 client.0 _ll_register_callbacks cb 0x560a8a9d6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:46.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d4f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed210 0x560a8aaf0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d4f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed210 0x560a8aaf0840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34410/0 (socket says 172.21.15.151:34410) 2023-07-21T22:20:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d4f9a700 1 -- 172.21.15.151:0/623410156 learned_addr learned my addr 172.21.15.151:0/623410156 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8a9436b0 0x560a8aaf35c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aaed660 0x560a8aaf0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d4f9a700 1 -- 172.21.15.151:0/623410156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aaed660 msgr2=0x560a8aaf0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:46.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aaed660 0x560a8aaf0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d4f9a700 1 -- 172.21.15.151:0/623410156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8a9436b0 msgr2=0x560a8aaf35c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:46.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8a9436b0 0x560a8aaf35c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.395+0000 7f99d4f9a700 1 -- 172.21.15.151:0/623410156 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99c80089b0 con 0x560a8aaed210 2023-07-21T22:20:46.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.396+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed210 0x560a8aaf0840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99c0012d20 tx=0x7f99c000f6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=806b463c83f59242 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:46.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.396+0000 7f99b8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:20:46.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.396+0000 7f99b8ff9700 1 -- 172.21.15.151:0/623410156 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0017070 con 0x560a8aaed210 2023-07-21T22:20:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.396+0000 7f99b8ff9700 1 -- 172.21.15.151:0/623410156 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f99c000fc30 con 0x560a8aaed210 2023-07-21T22:20:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.396+0000 7f99eb25fb80 1 -- 172.21.15.151:0/623410156 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560a8a992490 con 0x560a8aaed210 2023-07-21T22:20:46.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.396+0000 7f99b8ff9700 1 -- 172.21.15.151:0/623410156 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99c000fdf0 con 0x560a8aaed210 2023-07-21T22:20:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.396+0000 7f99eb25fb80 10 client.25702 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.396+0000 7f99eb25fb80 1 -- 172.21.15.151:0/623410156 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560a8a84fc00 con 0x560a8aaed210 2023-07-21T22:20:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.397+0000 7f99b8ff9700 1 -- 172.21.15.151:0/623410156 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560a8a992490 con 0x560a8aaed210 2023-07-21T22:20:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.397+0000 7f99b8ff9700 1 -- 172.21.15.151:0/623410156 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f99c0003b80 con 0x560a8aaed210 2023-07-21T22:20:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.397+0000 7f99eb25fb80 10 client.25702 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.397+0000 7f99eb25fb80 10 client.25702 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.397+0000 7f99eb25fb80 20 client.25702 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.397+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560a8ab00b10 0x560a8ab02f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.397+0000 7f99eb25fb80 4 client.25702 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.397+0000 7f99eb25fb80 1 -- 172.21.15.151:0/623410156 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560a8aa31e50 con 0x560a8ab00b10 2023-07-21T22:20:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.397+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560a8ab00b10 0x560a8ab02f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.398+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560a8ab00b10 0x560a8ab02f20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59d70be2833fb9b9 server_cookie=dccdb9a1997901cf in_seq=0 out_seq=0 2023-07-21T22:20:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.398+0000 7f99b8ff9700 10 client.25702 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.398+0000 7f99b8ff9700 1 -- 172.21.15.151:0/623410156 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560a8aa31e50 con 0x560a8ab00b10 2023-07-21T22:20:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.398+0000 7f99b8ff9700 10 client.25702 handle_command_reply: tid=0 2023-07-21T22:20:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.398+0000 7f99eb25fb80 1 client.25702 shutdown 2023-07-21T22:20:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 -- 172.21.15.151:0/623410156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed210 msgr2=0x560a8aaf0840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed210 0x560a8aaf0840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f99c0012d20 tx=0x7f99c000f6a0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 -- 172.21.15.151:0/623410156 shutdown_connections 2023-07-21T22:20:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560a8ab00b10 0x560a8ab02f20 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aaed660 0x560a8aaf0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99b8ff9700 0 client.25702 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8a9436b0 0x560a8aaf35c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/623410156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaed210 0x560a8aaf0840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 -- 172.21.15.151:0/623410156 >> 172.21.15.151:0/623410156 conn(0x560a8aadcae0 msgr2=0x560a8aae13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 -- 172.21.15.151:0/623410156 shutdown_connections 2023-07-21T22:20:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 1 -- 172.21.15.151:0/623410156 wait complete. 2023-07-21T22:20:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.399+0000 7f99eb25fb80 20 client.25702 trim_cache size 0 max 16384 2023-07-21T22:20:46.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.418+0000 7f99eb25fb80 1 Processor -- start 2023-07-21T22:20:46.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.418+0000 7f99eb25fb80 1 -- start start 2023-07-21T22:20:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.418+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaeb100 0x560a8aaf07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.418+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aafd080 0x560a8aaec1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.418+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aadcae0 0x560a8aaf30f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.418+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8aae7d30 con 0x560a8aadcae0 2023-07-21T22:20:46.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.418+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8aafe110 con 0x560a8aafd080 2023-07-21T22:20:46.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.418+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8aae8160 con 0x560a8aaeb100 2023-07-21T22:20:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d4f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aafd080 0x560a8aaec1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d5f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaeb100 0x560a8aaf07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d4f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aafd080 0x560a8aaec1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53470/0 (socket says 172.21.15.151:53470) 2023-07-21T22:20:46.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d4f9a700 1 -- 172.21.15.151:0/2160388564 learned_addr learned my addr 172.21.15.151:0/2160388564 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:46.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/2160388564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aadcae0 0x560a8aaf30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d4f9a700 1 -- 172.21.15.151:0/2160388564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaeb100 msgr2=0x560a8aaf07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:46.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/2160388564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaeb100 0x560a8aaf07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d4f9a700 1 -- 172.21.15.151:0/2160388564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aadcae0 msgr2=0x560a8aaf30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/2160388564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aadcae0 0x560a8aaf30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.419+0000 7f99d4f9a700 1 -- 172.21.15.151:0/2160388564 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560a8a88d1f0 con 0x560a8aafd080 2023-07-21T22:20:46.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.420+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/2160388564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aafd080 0x560a8aaec1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009340 tx=0x7f99c00123a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46656a50beb93b93 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:46.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.420+0000 7f99bbfff700 1 -- 172.21.15.151:0/2160388564 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0017070 con 0x560a8aafd080 2023-07-21T22:20:46.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.420+0000 7f99bbfff700 1 -- 172.21.15.151:0/2160388564 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99c0018040 con 0x560a8aafd080 2023-07-21T22:20:46.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.420+0000 7f99bbfff700 1 -- 172.21.15.151:0/2160388564 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c000fe90 con 0x560a8aafd080 2023-07-21T22:20:46.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 -- 172.21.15.151:0/2160388564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aafd080 msgr2=0x560a8aaec1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:46.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/2160388564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aafd080 0x560a8aaec1b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009340 tx=0x7f99c00123a0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 -- 172.21.15.151:0/2160388564 shutdown_connections 2023-07-21T22:20:46.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/2160388564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aadcae0 0x560a8aaf30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/2160388564 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aaeb100 0x560a8aaf07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/2160388564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aafd080 0x560a8aaec1b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 -- 172.21.15.151:0/2160388564 >> 172.21.15.151:0/2160388564 conn(0x560a8aaead30 msgr2=0x560a8aae5f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 -- 172.21.15.151:0/2160388564 shutdown_connections 2023-07-21T22:20:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 -- 172.21.15.151:0/2160388564 wait complete. 2023-07-21T22:20:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.421+0000 7f99eb25fb80 1 -- start start 2023-07-21T22:20:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99eb25fb80 1 Processor -- start 2023-07-21T22:20:46.474 INFO:teuthology.orchestra.run.smithi151.stderr:4600000 of 50000000 tuples (9%) done (elapsed 69.96 s, remaining 690.46 s) 2023-07-21T22:20:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aadcae0 0x560a8aaf4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaeb100 0x560a8aaf4a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99eb25fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aafd080 0x560a8ab54990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8aaf5280 con 0x560a8aaeb100 2023-07-21T22:20:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8aaf53f0 con 0x560a8aadcae0 2023-07-21T22:20:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99eb25fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560a8ab54f50 con 0x560a8aafd080 2023-07-21T22:20:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99eb25fb80 10 client.0 _ll_register_callbacks cb 0x7f99c00127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99d4f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaeb100 0x560a8aaf4a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99d5f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aadcae0 0x560a8aaf4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99d5f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aadcae0 0x560a8aaf4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53474/0 (socket says 172.21.15.151:53474) 2023-07-21T22:20:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.422+0000 7f99d5f9c700 1 -- 172.21.15.151:0/3546463943 learned_addr learned my addr 172.21.15.151:0/3546463943 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aafd080 0x560a8ab54990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99d4f9a700 1 -- 172.21.15.151:0/3546463943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aafd080 msgr2=0x560a8ab54990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:46.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aafd080 0x560a8ab54990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99d4f9a700 1 -- 172.21.15.151:0/3546463943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aadcae0 msgr2=0x560a8aaf4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:46.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aadcae0 0x560a8aaf4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99d4f9a700 1 -- 172.21.15.151:0/3546463943 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560a8a84fc00 con 0x560a8aaeb100 2023-07-21T22:20:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99d4f9a700 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaeb100 0x560a8aaf4a80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x560a8aae2dc0 tx=0x7f99c0009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1e45c29c767922 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99b8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:20:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99b8ff9700 1 -- 172.21.15.151:0/3546463943 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c0017030 con 0x560a8aaeb100 2023-07-21T22:20:46.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3546463943 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f99c800f040 con 0x560a8aaeb100 2023-07-21T22:20:46.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.423+0000 7f99b8ff9700 1 -- 172.21.15.151:0/3546463943 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f99c002b070 con 0x560a8aaeb100 2023-07-21T22:20:46.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99b8ff9700 1 -- 172.21.15.151:0/3546463943 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f99c0003680 con 0x560a8aaeb100 2023-07-21T22:20:46.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99eb25fb80 10 client.15921 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:46.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3546463943 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x560a8a865250 con 0x560a8aaeb100 2023-07-21T22:20:46.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99b8ff9700 1 -- 172.21.15.151:0/3546463943 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f99c800f040 con 0x560a8aaeb100 2023-07-21T22:20:46.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99b8ff9700 1 -- 172.21.15.151:0/3546463943 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f99c0005680 con 0x560a8aaeb100 2023-07-21T22:20:46.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99eb25fb80 10 client.15921 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:46.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99eb25fb80 10 client.15921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:46.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99eb25fb80 20 client.15921 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560a8a9436b0 0x560a8ab58340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99eb25fb80 4 client.15921 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:20:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.424+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3546463943 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560a8a9f3ff0 con 0x560a8a9436b0 2023-07-21T22:20:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.425+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560a8a9436b0 0x560a8ab58340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.425+0000 7f99d5f9c700 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560a8a9436b0 0x560a8ab58340 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83eb9bcfb2d88b57 server_cookie=8ac8b5bad305514f in_seq=0 out_seq=0 2023-07-21T22:20:46.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.425+0000 7f99b8ff9700 10 client.15921 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:46.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99b8ff9700 1 -- 172.21.15.151:0/3546463943 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560a8a9f3ff0 con 0x560a8a9436b0 2023-07-21T22:20:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99b8ff9700 10 client.15921 handle_command_reply: tid=0 2023-07-21T22:20:46.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 client.15921 shutdown 2023-07-21T22:20:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3546463943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaeb100 msgr2=0x560a8aaf4a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaeb100 0x560a8aaf4a80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x560a8aae2dc0 tx=0x7f99c0009370 comp rx=0 tx=0).stop 2023-07-21T22:20:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3546463943 shutdown_connections 2023-07-21T22:20:46.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560a8a9436b0 0x560a8ab58340 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560a8aadcae0 0x560a8aaf4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560a8aafd080 0x560a8ab54990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 --2- 172.21.15.151:0/3546463943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560a8aaeb100 0x560a8aaf4a80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99b8ff9700 0 client.15921 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3546463943 >> 172.21.15.151:0/3546463943 conn(0x560a8aaead30 msgr2=0x560a8aae67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.444+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3546463943 shutdown_connections 2023-07-21T22:20:46.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99eb25fb80 1 -- 172.21.15.151:0/3546463943 wait complete. 2023-07-21T22:20:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99eb25fb80 20 client.15921 trim_cache size 0 max 16384 2023-07-21T22:20:46.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:20:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:20:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:20:46.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:20:46.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 -- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f99bc0a1340 msgr2=0x7f99bc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:46.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f99bc0a1340 0x7f99bc0a37f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f99cc0a30c0 tx=0x7f99cc01a040 comp rx=0 tx=0).stop 2023-07-21T22:20:46.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 -- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99d0067c10 msgr2=0x7f99d0197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:46.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99d0067c10 0x7f99d0197d20 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00b650 tx=0x7f99cc005740 comp rx=0 tx=0).stop 2023-07-21T22:20:46.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 -- 172.21.15.151:0/2474416160 shutdown_connections 2023-07-21T22:20:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f99bc0a1340 0x7f99bc0a37f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99d0104e50 0x7f99d019c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f99d0067c10 0x7f99d0197d20 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 --2- 172.21.15.151:0/2474416160 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d00685b0 0x7f99d0198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:46.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.445+0000 7f99d79ff700 1 -- 172.21.15.151:0/2474416160 >> 172.21.15.151:0/2474416160 conn(0x7f99d0074760 msgr2=0x7f99d00fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.446+0000 7f99d79ff700 1 -- 172.21.15.151:0/2474416160 shutdown_connections 2023-07-21T22:20:46.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:46.446+0000 7f99d79ff700 1 -- 172.21.15.151:0/2474416160 wait complete. 2023-07-21T22:20:46.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:46 smithi151 ceph-mon[95510]: pgmap v50: 97 pgs: 97 active+clean; 1.0 GiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-07-21T22:20:46.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:46 smithi187 ceph-mon[96918]: pgmap v50: 97 pgs: 97 active+clean; 1.0 GiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-07-21T22:20:46.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:46 smithi195 ceph-mon[97365]: pgmap v50: 97 pgs: 97 active+clean; 1.0 GiB data, 784 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 25 MiB/s wr, 32 op/s 2023-07-21T22:20:48.115 INFO:teuthology.orchestra.run.smithi151.stderr:4700000 of 50000000 tuples (9%) done (elapsed 71.61 s, remaining 690.18 s) 2023-07-21T22:20:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:48 smithi151 ceph-mon[95510]: pgmap v51: 97 pgs: 97 active+clean; 1.1 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 38 MiB/s wr, 49 op/s 2023-07-21T22:20:48.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:48 smithi187 ceph-mon[96918]: pgmap v51: 97 pgs: 97 active+clean; 1.1 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 38 MiB/s wr, 49 op/s 2023-07-21T22:20:48.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:48 smithi195 ceph-mon[97365]: pgmap v51: 97 pgs: 97 active+clean; 1.1 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 38 MiB/s wr, 49 op/s 2023-07-21T22:20:49.273 INFO:teuthology.orchestra.run.smithi151.stderr:4800000 of 50000000 tuples (9%) done (elapsed 72.77 s, remaining 685.21 s) 2023-07-21T22:20:50.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:50 smithi151 ceph-mon[95510]: pgmap v52: 97 pgs: 97 active+clean; 1.1 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-07-21T22:20:50.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:50 smithi187 ceph-mon[96918]: pgmap v52: 97 pgs: 97 active+clean; 1.1 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-07-21T22:20:50.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:50 smithi195 ceph-mon[97365]: pgmap v52: 97 pgs: 97 active+clean; 1.1 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-07-21T22:20:50.932 INFO:teuthology.orchestra.run.smithi151.stderr:4900000 of 50000000 tuples (9%) done (elapsed 74.42 s, remaining 685.01 s) 2023-07-21T22:20:52.665 INFO:teuthology.orchestra.run.smithi151.stderr:5000000 of 50000000 tuples (10%) done (elapsed 76.16 s, remaining 685.42 s) 2023-07-21T22:20:52.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:52 smithi151 ceph-mon[95510]: pgmap v53: 97 pgs: 97 active+clean; 1.1 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-07-21T22:20:52.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:52 smithi187 ceph-mon[96918]: pgmap v53: 97 pgs: 97 active+clean; 1.1 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-07-21T22:20:52.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:52 smithi195 ceph-mon[97365]: pgmap v53: 97 pgs: 97 active+clean; 1.1 GiB data, 814 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-07-21T22:20:53.892 INFO:teuthology.orchestra.run.smithi151.stderr:5100000 of 50000000 tuples (10%) done (elapsed 77.38 s, remaining 681.29 s) 2023-07-21T22:20:54.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:54 smithi151 ceph-mon[95510]: pgmap v54: 97 pgs: 97 active+clean; 1.2 GiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-07-21T22:20:54.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:54 smithi187 ceph-mon[96918]: pgmap v54: 97 pgs: 97 active+clean; 1.2 GiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-07-21T22:20:54.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:54 smithi195 ceph-mon[97365]: pgmap v54: 97 pgs: 97 active+clean; 1.2 GiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-07-21T22:20:55.581 INFO:teuthology.orchestra.run.smithi151.stderr:5200000 of 50000000 tuples (10%) done (elapsed 79.07 s, remaining 681.25 s) 2023-07-21T22:20:56.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:56 smithi151 ceph-mon[95510]: pgmap v55: 97 pgs: 97 active+clean; 1.2 GiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:20:56.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:56 smithi187 ceph-mon[96918]: pgmap v55: 97 pgs: 97 active+clean; 1.2 GiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:20:56.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:56 smithi195 ceph-mon[97365]: pgmap v55: 97 pgs: 97 active+clean; 1.2 GiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:20:57.272 INFO:teuthology.orchestra.run.smithi151.stderr:5300000 of 50000000 tuples (10%) done (elapsed 80.76 s, remaining 681.16 s) 2023-07-21T22:20:58.521 INFO:teuthology.orchestra.run.smithi151.stderr:5400000 of 50000000 tuples (10%) done (elapsed 82.01 s, remaining 677.37 s) 2023-07-21T22:20:58.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:20:58 smithi187 ceph-mon[96918]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-07-21T22:20:58.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:20:58 smithi195 ceph-mon[97365]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-07-21T22:20:58.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:20:58 smithi151 ceph-mon[95510]: pgmap v56: 97 pgs: 97 active+clean; 1.2 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-07-21T22:20:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.608+0000 7fedbc5ff700 1 -- 172.21.15.151:0/1951271732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb40679a0 msgr2=0x7fedb4067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.608+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/1951271732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb40679a0 0x7fedb4067d70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fedb0009990 tx=0x7fedb0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.608+0000 7fedbc5ff700 1 -- 172.21.15.151:0/1951271732 shutdown_connections 2023-07-21T22:20:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.608+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/1951271732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb40679a0 0x7fedb4067d70 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.608+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/1951271732 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedb410c540 0x7fedb410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.608+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/1951271732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb40682b0 0x7fedb410c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.608+0000 7fedbc5ff700 1 -- 172.21.15.151:0/1951271732 >> 172.21.15.151:0/1951271732 conn(0x7fedb4074760 msgr2=0x7fedb4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.608+0000 7fedbc5ff700 1 -- 172.21.15.151:0/1951271732 shutdown_connections 2023-07-21T22:20:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.608+0000 7fedbc5ff700 1 -- 172.21.15.151:0/1951271732 wait complete. 2023-07-21T22:20:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.609+0000 7fedbc5ff700 1 Processor -- start 2023-07-21T22:20:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedbc5ff700 1 -- start start 2023-07-21T22:20:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedbc5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedb40679a0 0x7fedb4197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedbc5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb40682b0 0x7fedb4198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedbc5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb410c540 0x7fedb419c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedbc5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb419cf40 con 0x7fedb40682b0 2023-07-21T22:20:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedbc5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb419d0b0 con 0x7fedb410c540 2023-07-21T22:20:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedbc5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb419d270 con 0x7fedb40679a0 2023-07-21T22:20:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedba39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedb40679a0 0x7fedb4197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedb9b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb40682b0 0x7fedb4198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedba39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedb40679a0 0x7fedb4197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37964/0 (socket says 172.21.15.151:37964) 2023-07-21T22:20:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.610+0000 7fedba39b700 1 -- 172.21.15.151:0/3180647838 learned_addr learned my addr 172.21.15.151:0/3180647838 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.611+0000 7fedbab9c700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb410c540 0x7fedb419c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.611+0000 7fedba39b700 1 -- 172.21.15.151:0/3180647838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb410c540 msgr2=0x7fedb419c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.611+0000 7fedba39b700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb410c540 0x7fedb419c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.611+0000 7fedba39b700 1 -- 172.21.15.151:0/3180647838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb40682b0 msgr2=0x7fedb4198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.611+0000 7fedba39b700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb40682b0 0x7fedb4198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.611+0000 7fedba39b700 1 -- 172.21.15.151:0/3180647838 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac009c40 con 0x7fedb40679a0 2023-07-21T22:20:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.611+0000 7fedba39b700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedb40679a0 0x7fedb4197d50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fedb0000c00 tx=0x7fedb0004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.611+0000 7fedab7fe700 1 -- 172.21.15.151:0/3180647838 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb001d070 con 0x7fedb40679a0 2023-07-21T22:20:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.612+0000 7fedab7fe700 1 -- 172.21.15.151:0/3180647838 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb0022470 con 0x7fedb40679a0 2023-07-21T22:20:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.612+0000 7fedbc5ff700 1 -- 172.21.15.151:0/3180647838 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb00095f0 con 0x7fedb40679a0 2023-07-21T22:20:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.612+0000 7fedab7fe700 1 -- 172.21.15.151:0/3180647838 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb0017650 con 0x7fedb40679a0 2023-07-21T22:20:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.612+0000 7fedbc5ff700 1 -- 172.21.15.151:0/3180647838 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb41a4bb0 con 0x7fedb40679a0 2023-07-21T22:20:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.615+0000 7fedab7fe700 1 -- 172.21.15.151:0/3180647838 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fedb00225e0 con 0x7fedb40679a0 2023-07-21T22:20:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.616+0000 7fedd000eb80 1 Processor -- start 2023-07-21T22:20:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedd000eb80 1 -- start start 2023-07-21T22:20:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cad26b0 0x55d86cc7bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc75f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 0x55d86cc764a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedd000eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cb7bc50 con 0x55d86cad26b0 2023-07-21T22:20:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedd000eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cbce9e0 con 0x55d86cc7c210 2023-07-21T22:20:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedd000eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cbc7e70 con 0x55d86cc7c660 2023-07-21T22:20:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedab7fe700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feda00a12c0 0x7feda00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedba39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc75f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedba39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc75f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42254/0 (socket says 172.21.15.151:42254) 2023-07-21T22:20:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedba39b700 1 -- 172.21.15.151:0/310154456 learned_addr learned my addr 172.21.15.151:0/310154456 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedbab9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cad26b0 0x55d86cc7bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.617+0000 7fedb9b9a700 1 --2- 172.21.15.151:0/310154456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 0x55d86cc764a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7fedbab9c700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feda00a12c0 0x7feda00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7fedab7fe700 1 -- 172.21.15.151:0/3180647838 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fedb00ce090 con 0x7fedb40679a0 2023-07-21T22:20:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7fedba39b700 1 -- 172.21.15.151:0/310154456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 msgr2=0x55d86cc764a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7fedba39b700 1 --2- 172.21.15.151:0/310154456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 0x55d86cc764a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7fedba39b700 1 -- 172.21.15.151:0/310154456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cad26b0 msgr2=0x55d86cc7bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7fedba39b700 1 --2- 172.21.15.151:0/310154456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cad26b0 0x55d86cc7bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7fedba39b700 1 -- 172.21.15.151:0/310154456 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d86c9f5d80 con 0x55d86cc7c210 2023-07-21T22:20:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7fedba39b700 1 --2- 172.21.15.151:0/310154456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc75f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fedb0097740 tx=0x7fedb0005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b9b1ef59baf958d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:59.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7fedbab9c700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feda00a12c0 0x7feda00a3770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fedac009550 tx=0x7fedac00b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7feda8bfe700 1 -- 172.21.15.151:0/310154456 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00c92b0 con 0x55d86cc7c210 2023-07-21T22:20:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7feda8bfe700 1 -- 172.21.15.151:0/310154456 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb009ad80 con 0x55d86cc7c210 2023-07-21T22:20:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.618+0000 7feda8bfe700 1 -- 172.21.15.151:0/310154456 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb009f270 con 0x55d86cc7c210 2023-07-21T22:20:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.619+0000 7fedd000eb80 1 -- 172.21.15.151:0/310154456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 msgr2=0x55d86cc75f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.619+0000 7fedd000eb80 1 --2- 172.21.15.151:0/310154456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc75f40 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fedb0097740 tx=0x7fedb0005f00 comp rx=0 tx=0).stop 2023-07-21T22:20:59.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.619+0000 7fedd000eb80 1 -- 172.21.15.151:0/310154456 shutdown_connections 2023-07-21T22:20:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.619+0000 7fedd000eb80 1 --2- 172.21.15.151:0/310154456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 0x55d86cc764a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.619+0000 7fedd000eb80 1 --2- 172.21.15.151:0/310154456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cad26b0 0x55d86cc7bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.619+0000 7fedd000eb80 1 --2- 172.21.15.151:0/310154456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc75f40 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.619+0000 7fedd000eb80 1 -- 172.21.15.151:0/310154456 >> 172.21.15.151:0/310154456 conn(0x55d86cc6bae0 msgr2=0x55d86cc710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.619+0000 7fedd000eb80 1 -- 172.21.15.151:0/310154456 shutdown_connections 2023-07-21T22:20:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.620+0000 7fedd000eb80 1 -- 172.21.15.151:0/310154456 wait complete. 2023-07-21T22:20:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.620+0000 7fedd000eb80 1 -- start start 2023-07-21T22:20:59.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.620+0000 7fedd000eb80 1 Processor -- start 2023-07-21T22:20:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc82220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc7f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c660 0x55d86cc7f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedd000eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cb67a60 con 0x55d86cc7c660 2023-07-21T22:20:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedd000eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cb67760 con 0x55d86cc7c210 2023-07-21T22:20:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedd000eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86ca4b8c0 con 0x55d86cad26b0 2023-07-21T22:20:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedd000eb80 10 client.0 _ll_register_callbacks cb 0x55d86cb65700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:59.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedba39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc82220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedb9b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc7f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedba39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc82220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37984/0 (socket says 172.21.15.151:37984) 2023-07-21T22:20:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedba39b700 1 -- 172.21.15.151:0/2935326690 learned_addr learned my addr 172.21.15.151:0/2935326690 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.621+0000 7fedbab9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c660 0x55d86cc7f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fedba39b700 1 -- 172.21.15.151:0/2935326690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 msgr2=0x55d86cc7f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fedba39b700 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc7f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fedba39b700 1 -- 172.21.15.151:0/2935326690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c660 msgr2=0x55d86cc7f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fedba39b700 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c660 0x55d86cc7f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fedba39b700 1 -- 172.21.15.151:0/2935326690 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb41a4bb0 con 0x55d86cad26b0 2023-07-21T22:20:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fedba39b700 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc82220 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedb000f740 tx=0x7fedb0097630 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7465a6e1a9c96152 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fed9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:20:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fed9dffb700 1 -- 172.21.15.151:0/2935326690 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00228c0 con 0x55d86cad26b0 2023-07-21T22:20:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fed9dffb700 1 -- 172.21.15.151:0/2935326690 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fedb00a3600 con 0x55d86cad26b0 2023-07-21T22:20:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fedd000eb80 1 -- 172.21.15.151:0/2935326690 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d86cb21490 con 0x55d86cad26b0 2023-07-21T22:20:59.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fed9dffb700 1 -- 172.21.15.151:0/2935326690 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fedb009f270 con 0x55d86cad26b0 2023-07-21T22:20:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fedd000eb80 10 client.25720 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.622+0000 7fedd000eb80 1 -- 172.21.15.151:0/2935326690 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d86c9dec00 con 0x55d86cad26b0 2023-07-21T22:20:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.623+0000 7fed9dffb700 1 -- 172.21.15.151:0/2935326690 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d86cb21490 con 0x55d86cad26b0 2023-07-21T22:20:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.623+0000 7fed9dffb700 1 -- 172.21.15.151:0/2935326690 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fedb00ca070 con 0x55d86cad26b0 2023-07-21T22:20:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.623+0000 7fedd000eb80 10 client.25720 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.623+0000 7fedd000eb80 10 client.25720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.623+0000 7fedd000eb80 20 client.25720 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:59.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.623+0000 7fedd000eb80 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d86cc97af0 0x55d86cc99f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.623+0000 7fedd000eb80 4 client.25720 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:20:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.623+0000 7fedd000eb80 1 -- 172.21.15.151:0/2935326690 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d86cbc0e50 con 0x55d86cc97af0 2023-07-21T22:20:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.623+0000 7fedb9b9a700 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d86cc97af0 0x55d86cc99f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.624+0000 7fedb9b9a700 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d86cc97af0 0x55d86cc99f00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b9facc77193cf38 server_cookie=35662b8b37d1b2e6 in_seq=0 out_seq=0 2023-07-21T22:20:59.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.624+0000 7fed9dffb700 10 client.25720 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.624+0000 7fed9dffb700 1 -- 172.21.15.151:0/2935326690 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d86cbc0e50 con 0x55d86cc97af0 2023-07-21T22:20:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.624+0000 7fed9dffb700 10 client.25720 handle_command_reply: tid=0 2023-07-21T22:20:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.624+0000 7fedd000eb80 1 client.25720 shutdown 2023-07-21T22:20:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 -- 172.21.15.151:0/2935326690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 msgr2=0x55d86cc82220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc82220 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fedb000f740 tx=0x7fedb0097630 comp rx=0 tx=0).stop 2023-07-21T22:20:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 -- 172.21.15.151:0/2935326690 shutdown_connections 2023-07-21T22:20:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d86cc97af0 0x55d86cc99f00 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c660 0x55d86cc7f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc82220 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 --2- 172.21.15.151:0/2935326690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c210 0x55d86cc7f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fed9dffb700 0 client.25720 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 -- 172.21.15.151:0/2935326690 >> 172.21.15.151:0/2935326690 conn(0x55d86cc6bae0 msgr2=0x55d86cc703e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 -- 172.21.15.151:0/2935326690 shutdown_connections 2023-07-21T22:20:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 1 -- 172.21.15.151:0/2935326690 wait complete. 2023-07-21T22:20:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.625+0000 7fedd000eb80 20 client.25720 trim_cache size 0 max 16384 2023-07-21T22:20:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.644+0000 7fedd000eb80 1 Processor -- start 2023-07-21T22:20:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.644+0000 7fedd000eb80 1 -- start start 2023-07-21T22:20:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.644+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc943f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.644+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 0x55d86cc8f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.644+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c660 0x55d86cc7e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.644+0000 7fedd000eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cc7da00 con 0x55d86cc7c210 2023-07-21T22:20:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.644+0000 7fedd000eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cc7a0e0 con 0x55d86cc7c660 2023-07-21T22:20:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.644+0000 7fedd000eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cc8f8f0 con 0x55d86cad26b0 2023-07-21T22:20:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedba39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc943f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedba39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc943f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37996/0 (socket says 172.21.15.151:37996) 2023-07-21T22:20:59.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedba39b700 1 -- 172.21.15.151:0/1694530383 learned_addr learned my addr 172.21.15.151:0/1694530383 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedb9b9a700 1 --2- 172.21.15.151:0/1694530383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 0x55d86cc8f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedbab9c700 1 --2- 172.21.15.151:0/1694530383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c660 0x55d86cc7e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedba39b700 1 -- 172.21.15.151:0/1694530383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c660 msgr2=0x55d86cc7e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedba39b700 1 --2- 172.21.15.151:0/1694530383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c660 0x55d86cc7e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedba39b700 1 -- 172.21.15.151:0/1694530383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 msgr2=0x55d86cc8f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedba39b700 1 --2- 172.21.15.151:0/1694530383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 0x55d86cc8f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedba39b700 1 -- 172.21.15.151:0/1694530383 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d86ca1c1f0 con 0x55d86cad26b0 2023-07-21T22:20:59.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.645+0000 7fedba39b700 1 --2- 172.21.15.151:0/1694530383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc943f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fedb0099590 tx=0x7fedb000fd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=325d0257a7162ac0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.646+0000 7feda93ff700 1 -- 172.21.15.151:0/1694530383 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb00228c0 con 0x55d86cad26b0 2023-07-21T22:20:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.646+0000 7feda93ff700 1 -- 172.21.15.151:0/1694530383 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fedb009b6b0 con 0x55d86cad26b0 2023-07-21T22:20:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.646+0000 7feda93ff700 1 -- 172.21.15.151:0/1694530383 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedb009b240 con 0x55d86cad26b0 2023-07-21T22:20:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.646+0000 7fedd000eb80 1 -- 172.21.15.151:0/1694530383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 msgr2=0x55d86cc943f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.646+0000 7fedd000eb80 1 --2- 172.21.15.151:0/1694530383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc943f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fedb0099590 tx=0x7fedb000fd60 comp rx=0 tx=0).stop 2023-07-21T22:20:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.647+0000 7fedd000eb80 1 -- 172.21.15.151:0/1694530383 shutdown_connections 2023-07-21T22:20:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.647+0000 7fedd000eb80 1 --2- 172.21.15.151:0/1694530383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cc7c660 0x55d86cc7e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.647+0000 7fedd000eb80 1 --2- 172.21.15.151:0/1694530383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cad26b0 0x55d86cc943f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.647+0000 7fedd000eb80 1 --2- 172.21.15.151:0/1694530383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 0x55d86cc8f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.647+0000 7fedd000eb80 1 -- 172.21.15.151:0/1694530383 >> 172.21.15.151:0/1694530383 conn(0x55d86cc6bae0 msgr2=0x55d86cc7dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.647+0000 7fedd000eb80 1 -- 172.21.15.151:0/1694530383 shutdown_connections 2023-07-21T22:20:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.647+0000 7fedd000eb80 1 -- 172.21.15.151:0/1694530383 wait complete. 2023-07-21T22:20:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.647+0000 7fedd000eb80 1 -- start start 2023-07-21T22:20:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.647+0000 7fedd000eb80 1 Processor -- start 2023-07-21T22:20:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cad26b0 0x55d86cc8b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 0x55d86cc8bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedd000eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 0x55d86cce3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedd000eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cce4030 con 0x55d86cc7c210 2023-07-21T22:20:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedd000eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cce41a0 con 0x55d86cad26b0 2023-07-21T22:20:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedd000eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d86cce4360 con 0x55d86cc7c660 2023-07-21T22:20:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedd000eb80 10 client.0 _ll_register_callbacks cb 0x55d86cb65700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:20:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedba39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cad26b0 0x55d86cc8b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedb9b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 0x55d86cc8bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedba39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cad26b0 0x55d86cc8b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42286/0 (socket says 172.21.15.151:42286) 2023-07-21T22:20:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedba39b700 1 -- 172.21.15.151:0/987702535 learned_addr learned my addr 172.21.15.151:0/987702535 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:20:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedbab9c700 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 0x55d86cce3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.648+0000 7fedb9b9a700 1 -- 172.21.15.151:0/987702535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 msgr2=0x55d86cce3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fedb9b9a700 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 0x55d86cce3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fedb9b9a700 1 -- 172.21.15.151:0/987702535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cad26b0 msgr2=0x55d86cc8b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:20:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fedb9b9a700 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cad26b0 0x55d86cc8b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fedb9b9a700 1 -- 172.21.15.151:0/987702535 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d86c9dec00 con 0x55d86cc7c210 2023-07-21T22:20:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fedb9b9a700 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 0x55d86cc8bde0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55d86cc9a7a0 tx=0x7feda4004290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f3b75bcf4702152 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:20:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fed9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:20:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fed9dffb700 1 -- 172.21.15.151:0/987702535 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feda4016070 con 0x55d86cc7c210 2023-07-21T22:20:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fedd000eb80 1 -- 172.21.15.151:0/987702535 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d86cb82ff0 con 0x55d86cc7c210 2023-07-21T22:20:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fed9dffb700 1 -- 172.21.15.151:0/987702535 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7feda401dbd0 con 0x55d86cc7c210 2023-07-21T22:20:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.649+0000 7fed9dffb700 1 -- 172.21.15.151:0/987702535 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7feda401dd90 con 0x55d86cc7c210 2023-07-21T22:20:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fedd000eb80 10 client.15939 fetch_fsmap learned FSMap version 27 2023-07-21T22:20:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fedd000eb80 1 -- 172.21.15.151:0/987702535 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55d86c9f4250 con 0x55d86cc7c210 2023-07-21T22:20:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fed9dffb700 1 -- 172.21.15.151:0/987702535 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d86cb82ff0 con 0x55d86cc7c210 2023-07-21T22:20:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fed9dffb700 1 -- 172.21.15.151:0/987702535 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7feda4023030 con 0x55d86cc7c210 2023-07-21T22:20:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fedd000eb80 10 client.15939 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:20:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fedd000eb80 10 client.15939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:20:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fedd000eb80 20 client.15939 populate_metadata read hostname 'smithi151' 2023-07-21T22:20:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fedd000eb80 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d86ccecbc0 0x55d86cceefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:20:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fedd000eb80 4 client.15939 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:20:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fedd000eb80 1 -- 172.21.15.151:0/987702535 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d86ca16f10 con 0x55d86ccecbc0 2023-07-21T22:20:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.650+0000 7fedba39b700 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d86ccecbc0 0x55d86cceefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:20:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.651+0000 7fed9dffb700 10 client.15939 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:59.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.651+0000 7fedba39b700 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d86ccecbc0 0x55d86cceefd0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93c33d141eb346e4 server_cookie=a2a610eafeabd8f5 in_seq=0 out_seq=0 2023-07-21T22:20:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fed9dffb700 1 -- 172.21.15.151:0/987702535 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d86ca16f10 con 0x55d86ccecbc0 2023-07-21T22:20:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fed9dffb700 10 client.15939 handle_command_reply: tid=0 2023-07-21T22:20:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 client.15939 shutdown 2023-07-21T22:20:59.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 -- 172.21.15.151:0/987702535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 msgr2=0x55d86cc8bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 0x55d86cc8bde0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x55d86cc9a7a0 tx=0x7feda4004290 comp rx=0 tx=0).stop 2023-07-21T22:20:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 -- 172.21.15.151:0/987702535 shutdown_connections 2023-07-21T22:20:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d86ccecbc0 0x55d86cceefd0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d86cad26b0 0x55d86cc8b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d86cc7c660 0x55d86cce3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 --2- 172.21.15.151:0/987702535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d86cc7c210 0x55d86cc8bde0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 -- 172.21.15.151:0/987702535 >> 172.21.15.151:0/987702535 conn(0x55d86cc6bae0 msgr2=0x55d86cc7ad80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fed9dffb700 0 client.15939 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:20:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 -- 172.21.15.151:0/987702535 shutdown_connections 2023-07-21T22:20:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.668+0000 7fedd000eb80 1 -- 172.21.15.151:0/987702535 wait complete. 2023-07-21T22:20:59.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedd000eb80 20 client.15939 trim_cache size 0 max 16384 2023-07-21T22:20:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:20:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:20:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:20:59.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:20:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 -- 172.21.15.151:0/3180647838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feda00a12c0 msgr2=0x7feda00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feda00a12c0 0x7feda00a3770 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fedac009550 tx=0x7fedac00b040 comp rx=0 tx=0).stop 2023-07-21T22:20:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 -- 172.21.15.151:0/3180647838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedb40679a0 msgr2=0x7fedb4197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:20:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedb40679a0 0x7fedb4197d50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fedb0000c00 tx=0x7fedb0004730 comp rx=0 tx=0).stop 2023-07-21T22:20:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 -- 172.21.15.151:0/3180647838 shutdown_connections 2023-07-21T22:20:59.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feda00a12c0 0x7feda00a3770 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb410c540 0x7fedb419c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fedb40679a0 0x7fedb4197d50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 --2- 172.21.15.151:0/3180647838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedb40682b0 0x7fedb4198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:20:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 -- 172.21.15.151:0/3180647838 >> 172.21.15.151:0/3180647838 conn(0x7fedb4074760 msgr2=0x7fedb40fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:20:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.669+0000 7fedbc5ff700 1 -- 172.21.15.151:0/3180647838 shutdown_connections 2023-07-21T22:20:59.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:20:59.670+0000 7fedbc5ff700 1 -- 172.21.15.151:0/3180647838 wait complete. 2023-07-21T22:21:00.083 INFO:teuthology.orchestra.run.smithi151.stderr:5500000 of 50000000 tuples (11%) done (elapsed 83.58 s, remaining 676.20 s) 2023-07-21T22:21:00.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:00 smithi187 ceph-mon[96918]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-21T22:21:00.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:00 smithi195 ceph-mon[97365]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-21T22:21:00.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:00 smithi151 ceph-mon[95510]: pgmap v57: 97 pgs: 97 active+clean; 1.2 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-21T22:21:01.393 INFO:teuthology.orchestra.run.smithi151.stderr:5600000 of 50000000 tuples (11%) done (elapsed 84.89 s, remaining 673.02 s) 2023-07-21T22:21:02.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:02 smithi187 ceph-mon[96918]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-21T22:21:02.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:02 smithi195 ceph-mon[97365]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-21T22:21:02.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:02 smithi151 ceph-mon[95510]: pgmap v58: 97 pgs: 97 active+clean; 1.2 GiB data, 864 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 25 MiB/s wr, 19 op/s 2023-07-21T22:21:03.025 INFO:teuthology.orchestra.run.smithi151.stderr:5700000 of 50000000 tuples (11%) done (elapsed 86.52 s, remaining 672.41 s) 2023-07-21T22:21:04.660 INFO:teuthology.orchestra.run.smithi151.stderr:5800000 of 50000000 tuples (11%) done (elapsed 88.15 s, remaining 671.79 s) 2023-07-21T22:21:04.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:04 smithi187 ceph-mon[96918]: pgmap v59: 97 pgs: 97 active+clean; 1.3 GiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-07-21T22:21:04.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:04 smithi195 ceph-mon[97365]: pgmap v59: 97 pgs: 97 active+clean; 1.3 GiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-07-21T22:21:04.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:04 smithi151 ceph-mon[95510]: pgmap v59: 97 pgs: 97 active+clean; 1.3 GiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-07-21T22:21:05.964 INFO:teuthology.orchestra.run.smithi151.stderr:5900000 of 50000000 tuples (11%) done (elapsed 89.46 s, remaining 668.65 s) 2023-07-21T22:21:06.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:06 smithi187 ceph-mon[96918]: pgmap v60: 97 pgs: 97 active+clean; 1.3 GiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:21:06.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:06 smithi195 ceph-mon[97365]: pgmap v60: 97 pgs: 97 active+clean; 1.3 GiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:21:06.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:06 smithi151 ceph-mon[95510]: pgmap v60: 97 pgs: 97 active+clean; 1.3 GiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:21:07.625 INFO:teuthology.orchestra.run.smithi151.stderr:6000000 of 50000000 tuples (12%) done (elapsed 91.12 s, remaining 668.20 s) 2023-07-21T22:21:08.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:21:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.693+0000 7f5b303ff700 1 -- 172.21.15.151:0/40694761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b280fe880 msgr2=0x7f5b280fec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.693+0000 7f5b303ff700 1 --2- 172.21.15.151:0/40694761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b280fe880 0x7f5b280fec50 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5b24009990 tx=0x7f5b24009ca0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.693+0000 7f5b303ff700 1 -- 172.21.15.151:0/40694761 shutdown_connections 2023-07-21T22:21:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.693+0000 7f5b303ff700 1 --2- 172.21.15.151:0/40694761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b2810c430 0x7f5b2810e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.693+0000 7f5b303ff700 1 --2- 172.21.15.151:0/40694761 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b280fe880 0x7f5b280fec50 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.693+0000 7f5b303ff700 1 --2- 172.21.15.151:0/40694761 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b280ff190 0x7f5b2810bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.693+0000 7f5b303ff700 1 -- 172.21.15.151:0/40694761 >> 172.21.15.151:0/40694761 conn(0x7f5b280fa4b0 msgr2=0x7f5b280fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:08.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.693+0000 7f5b303ff700 1 -- 172.21.15.151:0/40694761 shutdown_connections 2023-07-21T22:21:08.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.693+0000 7f5b303ff700 1 -- 172.21.15.151:0/40694761 wait complete. 2023-07-21T22:21:08.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.694+0000 7f5b303ff700 1 Processor -- start 2023-07-21T22:21:08.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.694+0000 7f5b303ff700 1 -- start start 2023-07-21T22:21:08.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.694+0000 7f5b303ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b280fe880 0x7f5b28197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.694+0000 7f5b303ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b280ff190 0x7f5b281982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b303ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2810c430 0x7f5b2819c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b303ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2819cd50 con 0x7f5b2810c430 2023-07-21T22:21:08.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b303ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2819cec0 con 0x7f5b280ff190 2023-07-21T22:21:08.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b303ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2819d080 con 0x7f5b280fe880 2023-07-21T22:21:08.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2e19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b280fe880 0x7f5b28197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2d99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b280ff190 0x7f5b281982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2e99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2810c430 0x7f5b2819c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2e19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b280fe880 0x7f5b28197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57082/0 (socket says 172.21.15.151:57082) 2023-07-21T22:21:08.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2e19b700 1 -- 172.21.15.151:0/2665992622 learned_addr learned my addr 172.21.15.151:0/2665992622 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2e19b700 1 -- 172.21.15.151:0/2665992622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b280ff190 msgr2=0x7f5b281982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b280ff190 0x7f5b281982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2e19b700 1 -- 172.21.15.151:0/2665992622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2810c430 msgr2=0x7f5b2819c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2810c430 0x7f5b2819c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.695+0000 7f5b2e19b700 1 -- 172.21.15.151:0/2665992622 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b20009c40 con 0x7f5b280fe880 2023-07-21T22:21:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.696+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b280fe880 0x7f5b28197d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5b24005770 tx=0x7f5b240057a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.696+0000 7f5b1f7fe700 1 -- 172.21.15.151:0/2665992622 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2401d070 con 0x7f5b280fe880 2023-07-21T22:21:08.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.696+0000 7f5b1f7fe700 1 -- 172.21.15.151:0/2665992622 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b24005a00 con 0x7f5b280fe880 2023-07-21T22:21:08.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.696+0000 7f5b303ff700 1 -- 172.21.15.151:0/2665992622 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b240095f0 con 0x7f5b280fe880 2023-07-21T22:21:08.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.696+0000 7f5b1f7fe700 1 -- 172.21.15.151:0/2665992622 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24021d90 con 0x7f5b280fe880 2023-07-21T22:21:08.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.696+0000 7f5b303ff700 1 -- 172.21.15.151:0/2665992622 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b281a49c0 con 0x7f5b280fe880 2023-07-21T22:21:08.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.701+0000 7f5b1f7fe700 1 -- 172.21.15.151:0/2665992622 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5b24021410 con 0x7f5b280fe880 2023-07-21T22:21:08.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.702+0000 7f5b43cf8b80 1 Processor -- start 2023-07-21T22:21:08.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.702+0000 7f5b43cf8b80 1 -- start start 2023-07-21T22:21:08.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.702+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5596781591b0 0x559678159580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.702+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x559678154350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.702+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559678154930 0x559678154da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559678059cb0 con 0x5596781591b0 2023-07-21T22:21:08.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596780aca40 con 0x559678154930 2023-07-21T22:21:08.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596780a5ed0 con 0x559678159ac0 2023-07-21T22:21:08.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b1f7fe700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5b140a1340 0x7f5b140a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2e99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5596781591b0 0x559678159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2e99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5596781591b0 0x559678159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45882/0 (socket says 172.21.15.151:45882) 2023-07-21T22:21:08.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2e99c700 1 -- 172.21.15.151:0/3830030113 learned_addr learned my addr 172.21.15.151:0/3830030113 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:08.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/3830030113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x559678154350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2d99a700 1 --2- 172.21.15.151:0/3830030113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559678154930 0x559678154da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b1f7fe700 1 -- 172.21.15.151:0/2665992622 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5b240cdd90 con 0x7f5b280fe880 2023-07-21T22:21:08.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2e19b700 1 -- 172.21.15.151:0/3830030113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559678154930 msgr2=0x559678154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:08.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/3830030113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559678154930 0x559678154da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2e19b700 1 -- 172.21.15.151:0/3830030113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5596781591b0 msgr2=0x559678159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:08.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/3830030113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5596781591b0 0x559678159580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.703+0000 7f5b2e19b700 1 -- 172.21.15.151:0/3830030113 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559677ed3de0 con 0x559678159ac0 2023-07-21T22:21:08.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.704+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5b140a1340 0x7f5b140a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.704+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/3830030113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x559678154350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5b240cb640 tx=0x7f5b2406d0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=600e1d9ffd3ed960 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:08.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.704+0000 7f5b1cbfe700 1 -- 172.21.15.151:0/3830030113 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2409f080 con 0x559678159ac0 2023-07-21T22:21:08.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.704+0000 7f5b1cbfe700 1 -- 172.21.15.151:0/3830030113 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b240a3410 con 0x559678159ac0 2023-07-21T22:21:08.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.704+0000 7f5b1cbfe700 1 -- 172.21.15.151:0/3830030113 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2409a540 con 0x559678159ac0 2023-07-21T22:21:08.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5b140a1340 0x7f5b140a37f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5b20004a60 tx=0x7f5b20004b40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:08.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3830030113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 msgr2=0x559678154350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/3830030113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x559678154350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5b240cb640 tx=0x7f5b2406d0c0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3830030113 shutdown_connections 2023-07-21T22:21:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/3830030113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559678154930 0x559678154da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/3830030113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5596781591b0 0x559678159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/3830030113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x559678154350 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3830030113 >> 172.21.15.151:0/3830030113 conn(0x559678149ef0 msgr2=0x55967814f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3830030113 shutdown_connections 2023-07-21T22:21:08.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3830030113 wait complete. 2023-07-21T22:21:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.705+0000 7f5b43cf8b80 1 -- start start 2023-07-21T22:21:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b43cf8b80 1 Processor -- start 2023-07-21T22:21:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678154930 0x559678160b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967815dd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x55967815e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559678045ac0 con 0x559678154930 2023-07-21T22:21:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596780457c0 con 0x5596781591b0 2023-07-21T22:21:08.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559677f29920 con 0x559678159ac0 2023-07-21T22:21:08.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b43cf8b80 10 client.0 _ll_register_callbacks cb 0x559678043760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b2e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678154930 0x559678160b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b2e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678154930 0x559678160b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45888/0 (socket says 172.21.15.151:45888) 2023-07-21T22:21:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b2e19b700 1 -- 172.21.15.151:0/4260935069 learned_addr learned my addr 172.21.15.151:0/4260935069 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.706+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x55967815e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.707+0000 7f5b2d99a700 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967815dd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.707+0000 7f5b2e99c700 1 -- 172.21.15.151:0/4260935069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 msgr2=0x55967815dd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.707+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967815dd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.707+0000 7f5b2e99c700 1 -- 172.21.15.151:0/4260935069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678154930 msgr2=0x559678160b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.707+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678154930 0x559678160b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.707+0000 7f5b2e99c700 1 -- 172.21.15.151:0/4260935069 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b281a49c0 con 0x559678159ac0 2023-07-21T22:21:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.707+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x55967815e2d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5b200186f0 tx=0x7f5b20004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b02b76c92a6de67 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.707+0000 7f5b11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:21:08.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.707+0000 7f5b11ffb700 1 -- 172.21.15.151:0/4260935069 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b20021070 con 0x559678159ac0 2023-07-21T22:21:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/4260935069 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559677fff4f0 con 0x559678159ac0 2023-07-21T22:21:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b11ffb700 1 -- 172.21.15.151:0/4260935069 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5b20007b20 con 0x559678159ac0 2023-07-21T22:21:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b11ffb700 1 -- 172.21.15.151:0/4260935069 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b2000e040 con 0x559678159ac0 2023-07-21T22:21:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b43cf8b80 10 client.25738 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/4260935069 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559677ebcc60 con 0x559678159ac0 2023-07-21T22:21:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b11ffb700 1 -- 172.21.15.151:0/4260935069 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559677fff4f0 con 0x559678159ac0 2023-07-21T22:21:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b11ffb700 1 -- 172.21.15.151:0/4260935069 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5b200193d0 con 0x559678159ac0 2023-07-21T22:21:08.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b43cf8b80 10 client.25738 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b43cf8b80 10 client.25738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b43cf8b80 20 client.25738 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55967816e200 0x559678170610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b43cf8b80 4 client.25738 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:21:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.708+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/4260935069 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55967809eeb0 con 0x55967816e200 2023-07-21T22:21:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.709+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55967816e200 0x559678170610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.709+0000 7f5b11ffb700 10 client.25738 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.709+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55967816e200 0x559678170610 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1755e24db20c1b server_cookie=e7e3e05323ad10fd in_seq=0 out_seq=0 2023-07-21T22:21:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b11ffb700 1 -- 172.21.15.151:0/4260935069 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55967809eeb0 con 0x55967816e200 2023-07-21T22:21:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b11ffb700 10 client.25738 handle_command_reply: tid=0 2023-07-21T22:21:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b43cf8b80 1 client.25738 shutdown 2023-07-21T22:21:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/4260935069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 msgr2=0x55967815e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x55967815e2d0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5b200186f0 tx=0x7f5b20004ad0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/4260935069 shutdown_connections 2023-07-21T22:21:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55967816e200 0x559678170610 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678159ac0 0x55967815e2d0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678154930 0x559678160b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/4260935069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967815dd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b11ffb700 0 client.25738 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.710+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/4260935069 >> 172.21.15.151:0/4260935069 conn(0x559678149ef0 msgr2=0x55967814f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.711+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/4260935069 shutdown_connections 2023-07-21T22:21:08.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.711+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/4260935069 wait complete. 2023-07-21T22:21:08.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.711+0000 7f5b43cf8b80 20 client.25738 trim_cache size 0 max 16384 2023-07-21T22:21:08.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.735+0000 7f5b43cf8b80 1 Processor -- start 2023-07-21T22:21:08.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.735+0000 7f5b43cf8b80 1 -- start start 2023-07-21T22:21:08.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678165380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967814f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x5596781528e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559678150320 con 0x559678159ac0 2023-07-21T22:21:08.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596781556d0 con 0x5596781591b0 2023-07-21T22:21:08.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559678150a50 con 0x559678154930 2023-07-21T22:21:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b2e19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678165380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b2e19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678165380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57104/0 (socket says 172.21.15.151:57104) 2023-07-21T22:21:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b2e19b700 1 -- 172.21.15.151:0/3000131669 learned_addr learned my addr 172.21.15.151:0/3000131669 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:08.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b2d99a700 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967814f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x5596781528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.736+0000 7f5b2e19b700 1 -- 172.21.15.151:0/3000131669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 msgr2=0x55967814f2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:08.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.737+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967814f2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.737+0000 7f5b2e19b700 1 -- 172.21.15.151:0/3000131669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 msgr2=0x5596781528e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:08.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.737+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x5596781528e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.737+0000 7f5b2e19b700 1 -- 172.21.15.151:0/3000131669 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559677efa250 con 0x559678154930 2023-07-21T22:21:08.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.737+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x5596781528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:21:08.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.737+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678165380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5b24005cb0 tx=0x7f5b2402d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb79e0d46f4b7e9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:08.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.737+0000 7f5b1d3ff700 1 -- 172.21.15.151:0/3000131669 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b24099470 con 0x559678154930 2023-07-21T22:21:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.737+0000 7f5b1d3ff700 1 -- 172.21.15.151:0/3000131669 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b2409a540 con 0x559678154930 2023-07-21T22:21:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.737+0000 7f5b1d3ff700 1 -- 172.21.15.151:0/3000131669 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b240a2f80 con 0x559678154930 2023-07-21T22:21:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.738+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3000131669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 msgr2=0x559678165380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.738+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678165380 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f5b24005cb0 tx=0x7f5b2402d040 comp rx=0 tx=0).stop 2023-07-21T22:21:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.738+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3000131669 shutdown_connections 2023-07-21T22:21:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.738+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x5596781528e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.738+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678165380 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.738+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/3000131669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967814f2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.738+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3000131669 >> 172.21.15.151:0/3000131669 conn(0x559678149ef0 msgr2=0x559678169b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:08.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.738+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3000131669 shutdown_connections 2023-07-21T22:21:08.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.738+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/3000131669 wait complete. 2023-07-21T22:21:08.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.739+0000 7f5b43cf8b80 1 -- start start 2023-07-21T22:21:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.739+0000 7f5b43cf8b80 1 Processor -- start 2023-07-21T22:21:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678160880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967815f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b43cf8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x55967815fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559678165890 con 0x559678159ac0 2023-07-21T22:21:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596781600c0 con 0x5596781591b0 2023-07-21T22:21:08.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b43cf8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559678160280 con 0x559678154930 2023-07-21T22:21:08.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b43cf8b80 10 client.0 _ll_register_callbacks cb 0x559678043760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:08.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2d99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967815f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2e99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x55967815fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2e99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x55967815fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45898/0 (socket says 172.21.15.151:45898) 2023-07-21T22:21:08.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2e99c700 1 -- 172.21.15.151:0/2250966480 learned_addr learned my addr 172.21.15.151:0/2250966480 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:08.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678160880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2e99c700 1 -- 172.21.15.151:0/2250966480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 msgr2=0x559678160880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:08.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678160880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2e99c700 1 -- 172.21.15.151:0/2250966480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 msgr2=0x55967815f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:08.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967815f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2e99c700 1 -- 172.21.15.151:0/2250966480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559677ed3de0 con 0x559678159ac0 2023-07-21T22:21:08.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.740+0000 7f5b2d99a700 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967815f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:08.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.741+0000 7f5b2e99c700 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x55967815fb80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5b200186f0 tx=0x7f5b20019f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5703c40217d62f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:08.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.741+0000 7f5b11ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:21:08.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.741+0000 7f5b11ffb700 1 -- 172.21.15.151:0/2250966480 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b2001e070 con 0x559678159ac0 2023-07-21T22:21:08.792 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.741+0000 7f5b11ffb700 1 -- 172.21.15.151:0/2250966480 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5b20007b20 con 0x559678159ac0 2023-07-21T22:21:08.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.741+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/2250966480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5b240a3410 con 0x559678159ac0 2023-07-21T22:21:08.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.741+0000 7f5b11ffb700 1 -- 172.21.15.151:0/2250966480 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5b20021070 con 0x559678159ac0 2023-07-21T22:21:08.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.741+0000 7f5b43cf8b80 10 client.15957 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:08.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.741+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/2250966480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x559677ed22b0 con 0x559678159ac0 2023-07-21T22:21:08.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.742+0000 7f5b11ffb700 1 -- 172.21.15.151:0/2250966480 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5b240a3410 con 0x559678159ac0 2023-07-21T22:21:08.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.742+0000 7f5b11ffb700 1 -- 172.21.15.151:0/2250966480 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5b20038430 con 0x559678159ac0 2023-07-21T22:21:08.793 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.742+0000 7f5b43cf8b80 10 client.15957 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:08.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.742+0000 7f5b43cf8b80 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:08.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.742+0000 7f5b43cf8b80 20 client.15957 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:08.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.742+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5596781c33f0 0x5596781c5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:08.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.742+0000 7f5b43cf8b80 4 client.15957 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:21:08.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.742+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/2250966480 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x559678061050 con 0x5596781c33f0 2023-07-21T22:21:08.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.742+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5596781c33f0 0x5596781c5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:08.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.743+0000 7f5b2e19b700 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5596781c33f0 0x5596781c5800 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ab1ffca6d5a45b9 server_cookie=a95fca30fa2a4017 in_seq=0 out_seq=0 2023-07-21T22:21:08.794 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.743+0000 7f5b11ffb700 10 client.15957 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.743+0000 7f5b11ffb700 1 -- 172.21.15.151:0/2250966480 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x559678061050 con 0x5596781c33f0 2023-07-21T22:21:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.743+0000 7f5b11ffb700 10 client.15957 handle_command_reply: tid=0 2023-07-21T22:21:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.743+0000 7f5b43cf8b80 1 client.15957 shutdown 2023-07-21T22:21:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.743+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/2250966480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 msgr2=0x55967815fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.743+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x55967815fb80 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5b200186f0 tx=0x7f5b20019f10 comp rx=0 tx=0).stop 2023-07-21T22:21:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/2250966480 shutdown_connections 2023-07-21T22:21:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5596781c33f0 0x5596781c5800 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.795 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559678159ac0 0x55967815fb80 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559678154930 0x559678160880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b11ffb700 0 client.15957 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b43cf8b80 1 --2- 172.21.15.151:0/2250966480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596781591b0 0x55967815f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/2250966480 >> 172.21.15.151:0/2250966480 conn(0x559678149ef0 msgr2=0x55967814f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/2250966480 shutdown_connections 2023-07-21T22:21:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b43cf8b80 1 -- 172.21.15.151:0/2250966480 wait complete. 2023-07-21T22:21:08.796 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b43cf8b80 20 client.15957 trim_cache size 0 max 16384 2023-07-21T22:21:08.797 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:21:08.797 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:21:08.797 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:21:08.797 INFO:teuthology.orchestra.run.smithi151.stdout: "ec38d3a5-93f8-4072-bfe2-c7872d39c48a": { 2023-07-21T22:21:08.797 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:21:08.797 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "ec38d3a5-93f8-4072-bfe2-c7872d39c48a", 2023-07-21T22:21:08.798 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:21:08.798 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:21:08.798 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:21:08.798 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:21:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b303ff700 1 -- 172.21.15.151:0/2665992622 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5b140a1340 msgr2=0x7f5b140a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.744+0000 7f5b303ff700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5b140a1340 0x7f5b140a37f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f5b20004a60 tx=0x7f5b20004b40 comp rx=0 tx=0).stop 2023-07-21T22:21:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 -- 172.21.15.151:0/2665992622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b280fe880 msgr2=0x7f5b28197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b280fe880 0x7f5b28197d70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5b24005770 tx=0x7f5b240057a0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 -- 172.21.15.151:0/2665992622 shutdown_connections 2023-07-21T22:21:08.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5b140a1340 0x7f5b140a37f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5b2810c430 0x7f5b2819c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5b280fe880 0x7f5b28197d70 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 --2- 172.21.15.151:0/2665992622 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b280ff190 0x7f5b281982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 -- 172.21.15.151:0/2665992622 >> 172.21.15.151:0/2665992622 conn(0x7f5b280fa4b0 msgr2=0x7f5b2810d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 -- 172.21.15.151:0/2665992622 shutdown_connections 2023-07-21T22:21:08.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:08.745+0000 7f5b303ff700 1 -- 172.21.15.151:0/2665992622 wait complete. 2023-07-21T22:21:08.806 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:08 smithi151 ceph-mon[95510]: pgmap v61: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 48 op/s 2023-07-21T22:21:08.808 INFO:tasks.cephfs.filesystem:scrub status for tag:ec38d3a5-93f8-4072-bfe2-c7872d39c48a - {'path': '/', 'tag': 'ec38d3a5-93f8-4072-bfe2-c7872d39c48a', 'options': 'recursive,force'} 2023-07-21T22:21:08.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:08 smithi187 ceph-mon[96918]: pgmap v61: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 48 op/s 2023-07-21T22:21:08.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:08 smithi195 ceph-mon[97365]: pgmap v61: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 48 op/s 2023-07-21T22:21:09.335 INFO:teuthology.orchestra.run.smithi151.stderr:6100000 of 50000000 tuples (12%) done (elapsed 92.83 s, remaining 668.05 s) 2023-07-21T22:21:10.480 INFO:teuthology.orchestra.run.smithi151.stderr:6200000 of 50000000 tuples (12%) done (elapsed 93.97 s, remaining 663.87 s) 2023-07-21T22:21:10.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:10 smithi187 ceph-mon[96918]: pgmap v62: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:21:10.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:10 smithi195 ceph-mon[97365]: pgmap v62: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:21:10.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:10 smithi151 ceph-mon[95510]: pgmap v62: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:21:12.167 INFO:teuthology.orchestra.run.smithi151.stderr:6300000 of 50000000 tuples (12%) done (elapsed 95.66 s, remaining 663.54 s) 2023-07-21T22:21:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.831+0000 7fc72e3ff700 1 -- 172.21.15.151:0/2656165200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7280ffdc0 msgr2=0x7fc728100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.831+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/2656165200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7280ffdc0 0x7fc728100190 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc7180099c0 tx=0x7fc718009cd0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.831+0000 7fc72e3ff700 1 -- 172.21.15.151:0/2656165200 shutdown_connections 2023-07-21T22:21:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.831+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/2656165200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc728104e00 0x7fc72810c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.831+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/2656165200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7280ffdc0 0x7fc728100190 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.831+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/2656165200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc728100760 0x7fc728104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.831+0000 7fc72e3ff700 1 -- 172.21.15.151:0/2656165200 >> 172.21.15.151:0/2656165200 conn(0x7fc7280fb650 msgr2=0x7fc7280fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.831+0000 7fc72e3ff700 1 -- 172.21.15.151:0/2656165200 shutdown_connections 2023-07-21T22:21:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.832+0000 7fc72e3ff700 1 -- 172.21.15.151:0/2656165200 wait complete. 2023-07-21T22:21:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.833+0000 7fc72e3ff700 1 Processor -- start 2023-07-21T22:21:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.833+0000 7fc72e3ff700 1 -- start start 2023-07-21T22:21:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.833+0000 7fc72e3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7280ffdc0 0x7fc72819bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.833+0000 7fc72e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc728100760 0x7fc72819c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.833+0000 7fc72e3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc728104e00 0x7fc728195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.833+0000 7fc72e3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281960b0 con 0x7fc7280ffdc0 2023-07-21T22:21:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.833+0000 7fc72e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc728196220 con 0x7fc728100760 2023-07-21T22:21:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.833+0000 7fc72e3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7281963e0 con 0x7fc728104e00 2023-07-21T22:21:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:12 smithi187 ceph-mon[96918]: pgmap v63: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:21:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc727fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7280ffdc0 0x7fc72819bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc727fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7280ffdc0 0x7fc72819bbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45910/0 (socket says 172.21.15.151:45910) 2023-07-21T22:21:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc727fff700 1 -- 172.21.15.151:0/366705091 learned_addr learned my addr 172.21.15.151:0/366705091 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc72c99c700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc728104e00 0x7fc728195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc7277fe700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc728100760 0x7fc72819c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc72c99c700 1 -- 172.21.15.151:0/366705091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc728100760 msgr2=0x7fc72819c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc72c99c700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc728100760 0x7fc72819c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc72c99c700 1 -- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7280ffdc0 msgr2=0x7fc72819bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc72c99c700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7280ffdc0 0x7fc72819bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc72c99c700 1 -- 172.21.15.151:0/366705091 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7180095f0 con 0x7fc728104e00 2023-07-21T22:21:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.834+0000 7fc727fff700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7280ffdc0 0x7fc72819bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.835+0000 7fc72c99c700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc728104e00 0x7fc728195a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc72000efc0 tx=0x7fc72000c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.835+0000 7fc7257fa700 1 -- 172.21.15.151:0/366705091 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc720018070 con 0x7fc728104e00 2023-07-21T22:21:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.835+0000 7fc72e3ff700 1 -- 172.21.15.151:0/366705091 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc728196660 con 0x7fc728104e00 2023-07-21T22:21:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.835+0000 7fc7257fa700 1 -- 172.21.15.151:0/366705091 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc72000f040 con 0x7fc728104e00 2023-07-21T22:21:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.835+0000 7fc7257fa700 1 -- 172.21.15.151:0/366705091 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72000cba0 con 0x7fc728104e00 2023-07-21T22:21:12.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.836+0000 7fc72e3ff700 1 -- 172.21.15.151:0/366705091 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7281a2bd0 con 0x7fc728104e00 2023-07-21T22:21:12.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.840+0000 7fc7257fa700 1 -- 172.21.15.151:0/366705091 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fc720003a00 con 0x7fc728104e00 2023-07-21T22:21:12.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.841+0000 7fc741dd6b80 1 Processor -- start 2023-07-21T22:21:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.841+0000 7fc741dd6b80 1 -- start start 2023-07-21T22:21:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.841+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd58cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.841+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 0x561e0bd52f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.841+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.841+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bc58c50 con 0x561e0bd59210 2023-07-21T22:21:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.841+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bcab9e0 con 0x561e0bd59660 2023-07-21T22:21:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.841+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bca4e70 con 0x561e0bbaf6b0 2023-07-21T22:21:12.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd58cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd58cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57142/0 (socket says 172.21.15.151:57142) 2023-07-21T22:21:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 -- 172.21.15.151:0/4241891986 learned_addr learned my addr 172.21.15.151:0/4241891986 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7257fa700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7100a12c0 0x7fc7100a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 --2- 172.21.15.151:0/4241891986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc727fff700 1 --2- 172.21.15.151:0/4241891986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 0x561e0bd52f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7257fa700 1 -- 172.21.15.151:0/366705091 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc7200cc740 con 0x7fc728104e00 2023-07-21T22:21:12.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 -- 172.21.15.151:0/4241891986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 msgr2=0x561e0bd534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 --2- 172.21.15.151:0/4241891986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 -- 172.21.15.151:0/4241891986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 msgr2=0x561e0bd52f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 --2- 172.21.15.151:0/4241891986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 0x561e0bd52f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 -- 172.21.15.151:0/4241891986 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e0bad2d80 con 0x561e0bbaf6b0 2023-07-21T22:21:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.842+0000 7fc7277fe700 1 --2- 172.21.15.151:0/4241891986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd58cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc71c011820 tx=0x7fc71c0058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3312e7f07027d4b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.843+0000 7fc72c99c700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7100a12c0 0x7fc7100a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.843+0000 7fc70e7fc700 1 -- 172.21.15.151:0/4241891986 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c004830 con 0x561e0bbaf6b0 2023-07-21T22:21:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.843+0000 7fc70e7fc700 1 -- 172.21.15.151:0/4241891986 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc71c004e20 con 0x561e0bbaf6b0 2023-07-21T22:21:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.843+0000 7fc70e7fc700 1 -- 172.21.15.151:0/4241891986 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c01e3f0 con 0x561e0bbaf6b0 2023-07-21T22:21:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.843+0000 7fc72c99c700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7100a12c0 0x7fc7100a3770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc7200c9f00 tx=0x7fc720004c50 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.843+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4241891986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 msgr2=0x561e0bd58cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.843+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/4241891986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd58cd0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc71c011820 tx=0x7fc71c0058e0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.844+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4241891986 shutdown_connections 2023-07-21T22:21:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.844+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/4241891986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.844+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/4241891986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd58cd0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.844+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/4241891986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 0x561e0bd52f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.844+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4241891986 >> 172.21.15.151:0/4241891986 conn(0x561e0bd48ae0 msgr2=0x561e0bd4e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.844+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4241891986 shutdown_connections 2023-07-21T22:21:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.844+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4241891986 wait complete. 2023-07-21T22:21:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.844+0000 7fc741dd6b80 1 -- start start 2023-07-21T22:21:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.845+0000 7fc741dd6b80 1 Processor -- start 2023-07-21T22:21:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.845+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bbaf6b0 0x561e0bd5f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.845+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd5c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.845+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59660 0x561e0bd5ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.845+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bc44a60 con 0x561e0bd59660 2023-07-21T22:21:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.845+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bc44760 con 0x561e0bbaf6b0 2023-07-21T22:21:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.845+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bb288c0 con 0x561e0bd59210 2023-07-21T22:21:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.845+0000 7fc741dd6b80 10 client.0 _ll_register_callbacks cb 0x561e0bc42700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bbaf6b0 0x561e0bd5f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bbaf6b0 0x561e0bd5f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42496/0 (socket says 172.21.15.151:42496) 2023-07-21T22:21:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc7277fe700 1 -- 172.21.15.151:0/1665670118 learned_addr learned my addr 172.21.15.151:0/1665670118 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc727fff700 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd5c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc7277fe700 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59660 0x561e0bd5ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc727fff700 1 -- 172.21.15.151:0/1665670118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bbaf6b0 msgr2=0x561e0bd5f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc727fff700 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bbaf6b0 0x561e0bd5f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc727fff700 1 -- 172.21.15.151:0/1665670118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59660 msgr2=0x561e0bd5ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc727fff700 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59660 0x561e0bd5ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc727fff700 1 -- 172.21.15.151:0/1665670118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71c019040 con 0x561e0bd59210 2023-07-21T22:21:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc7277fe700 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bbaf6b0 0x561e0bd5f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc727fff700 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd5c7f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc71800b580 tx=0x7fc718005270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58d3abe5fe27c432 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.846+0000 7fc7077fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:21:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.847+0000 7fc7077fe700 1 -- 172.21.15.151:0/1665670118 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc718003760 con 0x561e0bd59210 2023-07-21T22:21:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.847+0000 7fc7077fe700 1 -- 172.21.15.151:0/1665670118 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc7180038c0 con 0x561e0bd59210 2023-07-21T22:21:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.847+0000 7fc741dd6b80 1 -- 172.21.15.151:0/1665670118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561e0bbfe490 con 0x561e0bd59210 2023-07-21T22:21:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.847+0000 7fc7077fe700 1 -- 172.21.15.151:0/1665670118 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc718003a80 con 0x561e0bd59210 2023-07-21T22:21:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.847+0000 7fc741dd6b80 10 client.25756 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.847+0000 7fc741dd6b80 1 -- 172.21.15.151:0/1665670118 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561e0babbc00 con 0x561e0bd59210 2023-07-21T22:21:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.847+0000 7fc7077fe700 1 -- 172.21.15.151:0/1665670118 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc718031020 con 0x561e0bd59210 2023-07-21T22:21:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.847+0000 7fc7077fe700 1 -- 172.21.15.151:0/1665670118 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc71802daf0 con 0x561e0bd59210 2023-07-21T22:21:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.848+0000 7fc741dd6b80 10 client.25756 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.848+0000 7fc741dd6b80 10 client.25756 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.848+0000 7fc741dd6b80 20 client.25756 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.848+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561e0bd70f60 0x561e0bd73370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.848+0000 7fc741dd6b80 4 client.25756 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:21:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.848+0000 7fc741dd6b80 1 -- 172.21.15.151:0/1665670118 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561e0bc9de50 con 0x561e0bd70f60 2023-07-21T22:21:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.848+0000 7fc7277fe700 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561e0bd70f60 0x561e0bd73370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.849+0000 7fc7277fe700 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561e0bd70f60 0x561e0bd73370 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44764748d0ac0147 server_cookie=59ebe63db503aac2 in_seq=0 out_seq=0 2023-07-21T22:21:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.849+0000 7fc7077fe700 10 client.25756 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.849+0000 7fc7077fe700 1 -- 172.21.15.151:0/1665670118 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561e0bc9de50 con 0x561e0bd70f60 2023-07-21T22:21:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.849+0000 7fc7077fe700 10 client.25756 handle_command_reply: tid=0 2023-07-21T22:21:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.849+0000 7fc741dd6b80 1 client.25756 shutdown 2023-07-21T22:21:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 -- 172.21.15.151:0/1665670118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 msgr2=0x561e0bd5c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd5c7f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fc71800b580 tx=0x7fc718005270 comp rx=0 tx=0).stop 2023-07-21T22:21:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 -- 172.21.15.151:0/1665670118 shutdown_connections 2023-07-21T22:21:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561e0bd70f60 0x561e0bd73370 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bbaf6b0 0x561e0bd5f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59660 0x561e0bd5ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc7077fe700 0 client.25756 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/1665670118 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd5c7f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 -- 172.21.15.151:0/1665670118 >> 172.21.15.151:0/1665670118 conn(0x561e0bd48ae0 msgr2=0x561e0bd4d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 -- 172.21.15.151:0/1665670118 shutdown_connections 2023-07-21T22:21:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 1 -- 172.21.15.151:0/1665670118 wait complete. 2023-07-21T22:21:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.850+0000 7fc741dd6b80 20 client.25756 trim_cache size 0 max 16384 2023-07-21T22:21:12.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:12 smithi195 ceph-mon[97365]: pgmap v63: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:21:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.871+0000 7fc741dd6b80 1 Processor -- start 2023-07-21T22:21:12.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc741dd6b80 1 -- start start 2023-07-21T22:21:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd6d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 0x561e0bd58180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd5e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bd6e590 con 0x561e0bd59210 2023-07-21T22:21:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bd4ed50 con 0x561e0bd59660 2023-07-21T22:21:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bd4a4f0 con 0x561e0bbaf6b0 2023-07-21T22:21:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd6d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc727fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 0x561e0bd58180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd6d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57154/0 (socket says 172.21.15.151:57154) 2023-07-21T22:21:12.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc7277fe700 1 -- 172.21.15.151:0/4016590006 learned_addr learned my addr 172.21.15.151:0/4016590006 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.872+0000 7fc7277fe700 1 --2- 172.21.15.151:0/4016590006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd5e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.873+0000 7fc7277fe700 1 -- 172.21.15.151:0/4016590006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 msgr2=0x561e0bd5e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:12.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.873+0000 7fc7277fe700 1 --2- 172.21.15.151:0/4016590006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd5e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.873+0000 7fc7277fe700 1 -- 172.21.15.151:0/4016590006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 msgr2=0x561e0bd58180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.873+0000 7fc7277fe700 1 --2- 172.21.15.151:0/4016590006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 0x561e0bd58180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.873+0000 7fc7277fe700 1 -- 172.21.15.151:0/4016590006 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561e0baf91f0 con 0x561e0bbaf6b0 2023-07-21T22:21:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.873+0000 7fc7277fe700 1 --2- 172.21.15.151:0/4016590006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd6d440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x561e0bd73c40 tx=0x7fc71c009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43445fb66ebf1834 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.873+0000 7fc70effd700 1 -- 172.21.15.151:0/4016590006 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c022070 con 0x561e0bbaf6b0 2023-07-21T22:21:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.873+0000 7fc70effd700 1 -- 172.21.15.151:0/4016590006 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc71c0314d0 con 0x561e0bbaf6b0 2023-07-21T22:21:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.873+0000 7fc70effd700 1 -- 172.21.15.151:0/4016590006 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71c005370 con 0x561e0bbaf6b0 2023-07-21T22:21:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.874+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4016590006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 msgr2=0x561e0bd6d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:12.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.874+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/4016590006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd6d440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x561e0bd73c40 tx=0x7fc71c009b90 comp rx=0 tx=0).stop 2023-07-21T22:21:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.874+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4016590006 shutdown_connections 2023-07-21T22:21:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.874+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/4016590006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd5e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.874+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/4016590006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bbaf6b0 0x561e0bd6d440 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.874+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/4016590006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bd59210 0x561e0bd58180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.874+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4016590006 >> 172.21.15.151:0/4016590006 conn(0x561e0bd48ae0 msgr2=0x561e0bd5e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.874+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4016590006 shutdown_connections 2023-07-21T22:21:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.874+0000 7fc741dd6b80 1 -- 172.21.15.151:0/4016590006 wait complete. 2023-07-21T22:21:12.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.875+0000 7fc741dd6b80 1 -- start start 2023-07-21T22:21:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.875+0000 7fc741dd6b80 1 Processor -- start 2023-07-21T22:21:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bbaf6b0 0x561e0bd68230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd54b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc741dd6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd55040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bd55750 con 0x561e0bbaf6b0 2023-07-21T22:21:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bd558c0 con 0x561e0bd59660 2023-07-21T22:21:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc741dd6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561e0bdc4de0 con 0x561e0bd59210 2023-07-21T22:21:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc741dd6b80 10 client.0 _ll_register_callbacks cb 0x7fc718009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bbaf6b0 0x561e0bd68230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc727fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd54b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc7277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bbaf6b0 0x561e0bd68230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45948/0 (socket says 172.21.15.151:45948) 2023-07-21T22:21:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc727fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd54b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57156/0 (socket says 172.21.15.151:57156) 2023-07-21T22:21:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc7277fe700 1 -- 172.21.15.151:0/686643281 learned_addr learned my addr 172.21.15.151:0/686643281 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc7277fe700 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd55040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc727fff700 1 -- 172.21.15.151:0/686643281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 msgr2=0x561e0bd55040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc727fff700 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd55040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc727fff700 1 -- 172.21.15.151:0/686643281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bbaf6b0 msgr2=0x561e0bd68230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc727fff700 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bbaf6b0 0x561e0bd68230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.876+0000 7fc727fff700 1 -- 172.21.15.151:0/686643281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc71c025040 con 0x561e0bd59210 2023-07-21T22:21:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.877+0000 7fc727fff700 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd54b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc71800e7e0 tx=0x7fc7180052e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35848fdb4defa225 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.877+0000 7fc7077fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:21:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.877+0000 7fc7077fe700 1 -- 172.21.15.151:0/686643281 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc71800ea60 con 0x561e0bd59210 2023-07-21T22:21:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.877+0000 7fc7077fe700 1 -- 172.21.15.151:0/686643281 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc718032080 con 0x561e0bd59210 2023-07-21T22:21:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.877+0000 7fc741dd6b80 1 -- 172.21.15.151:0/686643281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc71c004e20 con 0x561e0bd59210 2023-07-21T22:21:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.877+0000 7fc7077fe700 1 -- 172.21.15.151:0/686643281 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc718005bc0 con 0x561e0bd59210 2023-07-21T22:21:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.877+0000 7fc741dd6b80 10 client.25762 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.877+0000 7fc741dd6b80 1 -- 172.21.15.151:0/686643281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x561e0bad1250 con 0x561e0bd59210 2023-07-21T22:21:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.878+0000 7fc7077fe700 1 -- 172.21.15.151:0/686643281 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc71c004e20 con 0x561e0bd59210 2023-07-21T22:21:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.878+0000 7fc7077fe700 1 -- 172.21.15.151:0/686643281 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fc718034070 con 0x561e0bd59210 2023-07-21T22:21:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.878+0000 7fc741dd6b80 10 client.25762 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.878+0000 7fc741dd6b80 10 client.25762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.878+0000 7fc741dd6b80 20 client.25762 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.878+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561e0bdc6030 0x561e0bdc8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.878+0000 7fc741dd6b80 4 client.25762 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:21:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.878+0000 7fc741dd6b80 1 -- 172.21.15.151:0/686643281 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561e0bc5fff0 con 0x561e0bdc6030 2023-07-21T22:21:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.878+0000 7fc7277fe700 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561e0bdc6030 0x561e0bdc8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.879+0000 7fc7077fe700 10 client.25762 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:12.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.879+0000 7fc7277fe700 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561e0bdc6030 0x561e0bdc8440 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d1921bc45891f7 server_cookie=935b219c3a8d2f6f in_seq=0 out_seq=0 2023-07-21T22:21:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc7077fe700 1 -- 172.21.15.151:0/686643281 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561e0bc5fff0 con 0x561e0bdc6030 2023-07-21T22:21:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc7077fe700 10 client.25762 handle_command_reply: tid=0 2023-07-21T22:21:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc741dd6b80 1 client.25762 shutdown 2023-07-21T22:21:12.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc741dd6b80 1 -- 172.21.15.151:0/686643281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 msgr2=0x561e0bd54b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd54b00 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc71800e7e0 tx=0x7fc7180052e0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc741dd6b80 1 -- 172.21.15.151:0/686643281 shutdown_connections 2023-07-21T22:21:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561e0bdc6030 0x561e0bdc8440 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561e0bd59660 0x561e0bd55040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561e0bbaf6b0 0x561e0bd68230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc7077fe700 0 client.25762 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc741dd6b80 1 --2- 172.21.15.151:0/686643281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561e0bd59210 0x561e0bd54b00 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.897+0000 7fc741dd6b80 1 -- 172.21.15.151:0/686643281 >> 172.21.15.151:0/686643281 conn(0x561e0bd48ae0 msgr2=0x561e0bd57ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc741dd6b80 1 -- 172.21.15.151:0/686643281 shutdown_connections 2023-07-21T22:21:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc741dd6b80 1 -- 172.21.15.151:0/686643281 wait complete. 2023-07-21T22:21:12.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc741dd6b80 20 client.25762 trim_cache size 0 max 16384 2023-07-21T22:21:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:21:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:21:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:21:12.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:21:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc72e3ff700 1 -- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7100a12c0 msgr2=0x7fc7100a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7100a12c0 0x7fc7100a3770 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc7200c9f00 tx=0x7fc720004c50 comp rx=0 tx=0).stop 2023-07-21T22:21:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc72e3ff700 1 -- 172.21.15.151:0/366705091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc728104e00 msgr2=0x7fc728195a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc728104e00 0x7fc728195a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc72000efc0 tx=0x7fc72000c3a0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc72e3ff700 1 -- 172.21.15.151:0/366705091 shutdown_connections 2023-07-21T22:21:12.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7100a12c0 0x7fc7100a3770 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.898+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc728104e00 0x7fc728195a40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.899+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7280ffdc0 0x7fc72819bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.899+0000 7fc72e3ff700 1 --2- 172.21.15.151:0/366705091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc728100760 0x7fc72819c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.899+0000 7fc72e3ff700 1 -- 172.21.15.151:0/366705091 >> 172.21.15.151:0/366705091 conn(0x7fc7280fb650 msgr2=0x7fc728103700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.899+0000 7fc72e3ff700 1 -- 172.21.15.151:0/366705091 shutdown_connections 2023-07-21T22:21:12.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:12.899+0000 7fc72e3ff700 1 -- 172.21.15.151:0/366705091 wait complete. 2023-07-21T22:21:12.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:12 smithi151 ceph-mon[95510]: pgmap v63: 97 pgs: 97 active+clean; 1.4 GiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:21:13.828 INFO:teuthology.orchestra.run.smithi151.stderr:6400000 of 50000000 tuples (12%) done (elapsed 97.32 s, remaining 663.00 s) 2023-07-21T22:21:14.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:14 smithi187 ceph-mon[96918]: pgmap v64: 97 pgs: 97 active+clean; 1.5 GiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 38 MiB/s wr, 48 op/s 2023-07-21T22:21:14.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:14 smithi195 ceph-mon[97365]: pgmap v64: 97 pgs: 97 active+clean; 1.5 GiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 38 MiB/s wr, 48 op/s 2023-07-21T22:21:14.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:14 smithi151 ceph-mon[95510]: pgmap v64: 97 pgs: 97 active+clean; 1.5 GiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 38 MiB/s wr, 48 op/s 2023-07-21T22:21:15.064 INFO:teuthology.orchestra.run.smithi151.stderr:6500000 of 50000000 tuples (13%) done (elapsed 98.56 s, remaining 659.57 s) 2023-07-21T22:21:16.735 INFO:teuthology.orchestra.run.smithi151.stderr:6600000 of 50000000 tuples (13%) done (elapsed 100.23 s, remaining 659.07 s) 2023-07-21T22:21:16.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:16 smithi187 ceph-mon[96918]: pgmap v65: 97 pgs: 97 active+clean; 1.5 GiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-07-21T22:21:16.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:16 smithi195 ceph-mon[97365]: pgmap v65: 97 pgs: 97 active+clean; 1.5 GiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-07-21T22:21:16.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:16 smithi151 ceph-mon[95510]: pgmap v65: 97 pgs: 97 active+clean; 1.5 GiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 20 op/s 2023-07-21T22:21:18.433 INFO:teuthology.orchestra.run.smithi151.stderr:6700000 of 50000000 tuples (13%) done (elapsed 101.93 s, remaining 658.71 s) 2023-07-21T22:21:18.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:18 smithi187 ceph-mon[96918]: pgmap v66: 97 pgs: 97 active+clean; 1.6 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-07-21T22:21:18.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:18 smithi195 ceph-mon[97365]: pgmap v66: 97 pgs: 97 active+clean; 1.6 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-07-21T22:21:18.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:18 smithi151 ceph-mon[95510]: pgmap v66: 97 pgs: 97 active+clean; 1.6 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-07-21T22:21:19.670 INFO:teuthology.orchestra.run.smithi151.stderr:6800000 of 50000000 tuples (13%) done (elapsed 103.16 s, remaining 655.39 s) 2023-07-21T22:21:20.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:20 smithi187 ceph-mon[96918]: pgmap v67: 97 pgs: 97 active+clean; 1.6 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-07-21T22:21:20.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:20 smithi195 ceph-mon[97365]: pgmap v67: 97 pgs: 97 active+clean; 1.6 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-07-21T22:21:20.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:20 smithi151 ceph-mon[95510]: pgmap v67: 97 pgs: 97 active+clean; 1.6 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-07-21T22:21:21.239 INFO:teuthology.orchestra.run.smithi151.stderr:6900000 of 50000000 tuples (13%) done (elapsed 104.73 s, remaining 654.19 s) 2023-07-21T22:21:22.542 INFO:teuthology.orchestra.run.smithi151.stderr:7000000 of 50000000 tuples (14%) done (elapsed 106.03 s, remaining 651.35 s) 2023-07-21T22:21:22.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:22 smithi187 ceph-mon[96918]: pgmap v68: 97 pgs: 97 active+clean; 1.6 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-07-21T22:21:22.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:22 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:21:22.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:22 smithi195 ceph-mon[97365]: pgmap v68: 97 pgs: 97 active+clean; 1.6 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-07-21T22:21:22.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:22 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:21:22.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:22 smithi151 ceph-mon[95510]: pgmap v68: 97 pgs: 97 active+clean; 1.6 GiB data, 992 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 25 op/s 2023-07-21T22:21:22.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:22 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:21:23.628 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:23 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:21:23.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:23 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:21:23.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:23 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:21:23.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:23 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:21:23.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:23 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:21:23.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:23 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:21:23.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:23 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:21:23.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:23 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:21:23.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:23 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:21:24.165 INFO:teuthology.orchestra.run.smithi151.stderr:7100000 of 50000000 tuples (14%) done (elapsed 107.66 s, remaining 650.49 s) 2023-07-21T22:21:24.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:24 smithi195 ceph-mon[97365]: pgmap v69: 97 pgs: 97 active+clean; 1.6 GiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 34 op/s 2023-07-21T22:21:24.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:24 smithi151 ceph-mon[95510]: pgmap v69: 97 pgs: 97 active+clean; 1.6 GiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 34 op/s 2023-07-21T22:21:24.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:24 smithi187 ceph-mon[96918]: pgmap v69: 97 pgs: 97 active+clean; 1.6 GiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 38 MiB/s wr, 34 op/s 2023-07-21T22:21:25.849 INFO:teuthology.orchestra.run.smithi151.stderr:7200000 of 50000000 tuples (14%) done (elapsed 109.34 s, remaining 649.98 s) 2023-07-21T22:21:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.059+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/2193691360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080731c0 msgr2=0x7f1b081105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.059+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/2193691360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080731c0 0x7f1b081105d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f1af8009990 tx=0x7f1af8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.059+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/2193691360 shutdown_connections 2023-07-21T22:21:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.059+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/2193691360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b080728b0 0x7f1b08072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.059+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/2193691360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b08110b10 0x7f1b08112ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.059+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/2193691360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080731c0 0x7f1b081105d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.059+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/2193691360 >> 172.21.15.151:0/2193691360 conn(0x7f1b080fb600 msgr2=0x7f1b080fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.060+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/2193691360 shutdown_connections 2023-07-21T22:21:26.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.060+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/2193691360 wait complete. 2023-07-21T22:21:26.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.061+0000 7f1b0f9ff700 1 Processor -- start 2023-07-21T22:21:26.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.061+0000 7f1b0f9ff700 1 -- start start 2023-07-21T22:21:26.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0f9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080728b0 0x7f1b0819c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0f9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b080731c0 0x7f1b0819c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0f9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b08110b10 0x7f1b081a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0f9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b081a13a0 con 0x7f1b08110b10 2023-07-21T22:21:26.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0f9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b081a1510 con 0x7f1b080731c0 2023-07-21T22:21:26.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0f9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b081a16d0 con 0x7f1b080728b0 2023-07-21T22:21:26.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0d79b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080728b0 0x7f1b0819c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0df9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b08110b10 0x7f1b081a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0d79b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080728b0 0x7f1b0819c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:55618/0 (socket says 172.21.15.151:55618) 2023-07-21T22:21:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0d79b700 1 -- 172.21.15.151:0/768906480 learned_addr learned my addr 172.21.15.151:0/768906480 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.062+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b080731c0 0x7f1b0819c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0d79b700 1 -- 172.21.15.151:0/768906480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b080731c0 msgr2=0x7f1b0819c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0d79b700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b080731c0 0x7f1b0819c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0d79b700 1 -- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b08110b10 msgr2=0x7f1b081a0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0d79b700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b08110b10 0x7f1b081a0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0d79b700 1 -- 172.21.15.151:0/768906480 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b00009c40 con 0x7f1b080728b0 2023-07-21T22:21:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b080731c0 0x7f1b0819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:21:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b08110b10 0x7f1b081a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0d79b700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080728b0 0x7f1b0819c1b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e9a0 tx=0x7f1b0400ed60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1afe7fc700 1 -- 172.21.15.151:0/768906480 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04009790 con 0x7f1b080728b0 2023-07-21T22:21:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/768906480 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1af80095f0 con 0x7f1b080728b0 2023-07-21T22:21:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1afe7fc700 1 -- 172.21.15.151:0/768906480 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b0400cbd0 con 0x7f1b080728b0 2023-07-21T22:21:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1afe7fc700 1 -- 172.21.15.151:0/768906480 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400eee0 con 0x7f1b080728b0 2023-07-21T22:21:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.063+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/768906480 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b081a1ba0 con 0x7f1b080728b0 2023-07-21T22:21:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.068+0000 7f1afe7fc700 1 -- 172.21.15.151:0/768906480 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f1b0400cd40 con 0x7f1b080728b0 2023-07-21T22:21:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.069+0000 7f1b232fab80 1 Processor -- start 2023-07-21T22:21:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.069+0000 7f1b232fab80 1 -- start start 2023-07-21T22:21:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 0x55ed6eaa9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa660 0x55ed6eaa44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b232fab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6e9a9c50 con 0x55ed6eaaa210 2023-07-21T22:21:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b232fab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6e9fc9e0 con 0x55ed6e9006b0 2023-07-21T22:21:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b232fab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6e9f5e70 con 0x55ed6eaaa660 2023-07-21T22:21:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0df9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 0x55ed6eaa9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0d79b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0df9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 0x55ed6eaa9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57672/0 (socket says 172.21.15.151:57672) 2023-07-21T22:21:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0df9c700 1 -- 172.21.15.151:0/1381120517 learned_addr learned my addr 172.21.15.151:0/1381120517 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa660 0x55ed6eaa44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0df9c700 1 -- 172.21.15.151:0/1381120517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa660 msgr2=0x55ed6eaa44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa660 0x55ed6eaa44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0df9c700 1 -- 172.21.15.151:0/1381120517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 msgr2=0x55ed6eaa3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.070+0000 7f1b0df9c700 1 -- 172.21.15.151:0/1381120517 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed6e823d80 con 0x55ed6e9006b0 2023-07-21T22:21:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.071+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa660 0x55ed6eaa44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:21:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.071+0000 7f1afe7fc700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1af40a1340 0x7f1af40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.071+0000 7f1b0d79b700 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:21:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.071+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 0x55ed6eaa9cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b00007610 tx=0x7f1b00009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d3397d4579dcc2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.071+0000 7f1afe7fc700 1 -- 172.21.15.151:0/768906480 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1b04014070 con 0x7f1b080728b0 2023-07-21T22:21:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.071+0000 7f1b0d79b700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1af40a1340 0x7f1af40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.071+0000 7f1af37fe700 1 -- 172.21.15.151:0/1381120517 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000e900 con 0x55ed6e9006b0 2023-07-21T22:21:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.071+0000 7f1af37fe700 1 -- 172.21.15.151:0/1381120517 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b0000f040 con 0x55ed6e9006b0 2023-07-21T22:21:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.071+0000 7f1af37fe700 1 -- 172.21.15.151:0/1381120517 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00015d80 con 0x55ed6e9006b0 2023-07-21T22:21:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b232fab80 1 -- 172.21.15.151:0/1381120517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 msgr2=0x55ed6eaa9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b0d79b700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1af40a1340 0x7f1af40a37f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e970 tx=0x7f1b040d0510 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b232fab80 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 0x55ed6eaa9cd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1b00007610 tx=0x7f1b00009920 comp rx=0 tx=0).stop 2023-07-21T22:21:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b232fab80 1 -- 172.21.15.151:0/1381120517 shutdown_connections 2023-07-21T22:21:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b232fab80 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 0x55ed6eaa9cd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b232fab80 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa660 0x55ed6eaa44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b232fab80 1 --2- 172.21.15.151:0/1381120517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b232fab80 1 -- 172.21.15.151:0/1381120517 >> 172.21.15.151:0/1381120517 conn(0x55ed6ea99ae0 msgr2=0x55ed6ea9f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b232fab80 1 -- 172.21.15.151:0/1381120517 shutdown_connections 2023-07-21T22:21:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.072+0000 7f1b232fab80 1 -- 172.21.15.151:0/1381120517 wait complete. 2023-07-21T22:21:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.073+0000 7f1b232fab80 1 -- start start 2023-07-21T22:21:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.073+0000 7f1b232fab80 1 Processor -- start 2023-07-21T22:21:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6e9006b0 0x55ed6eab04b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaad6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 0x55ed6eaadc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b232fab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6e995a60 con 0x55ed6eaaa210 2023-07-21T22:21:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b232fab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6e995760 con 0x55ed6eaaa660 2023-07-21T22:21:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b232fab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6e8798c0 con 0x55ed6e9006b0 2023-07-21T22:21:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b232fab80 10 client.0 _ll_register_callbacks cb 0x55ed6e993700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0df9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6e9006b0 0x55ed6eab04b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0cf9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaad6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0df9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6e9006b0 0x55ed6eab04b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:55636/0 (socket says 172.21.15.151:55636) 2023-07-21T22:21:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0df9c700 1 -- 172.21.15.151:0/3611858429 learned_addr learned my addr 172.21.15.151:0/3611858429 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 0x55ed6eaadc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0cf9a700 1 -- 172.21.15.151:0/3611858429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6e9006b0 msgr2=0x55ed6eab04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6e9006b0 0x55ed6eab04b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0cf9a700 1 -- 172.21.15.151:0/3611858429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 msgr2=0x55ed6eaadc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 0x55ed6eaadc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.074+0000 7f1b0cf9a700 1 -- 172.21.15.151:0/3611858429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b00009220 con 0x55ed6eaaa210 2023-07-21T22:21:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.075+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaad6c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1af8005910 tx=0x7f1af80056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84e066c53d76d7c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.075+0000 7f1af0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:21:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.075+0000 7f1af0ff9700 1 -- 172.21.15.151:0/3611858429 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af8004500 con 0x55ed6eaaa210 2023-07-21T22:21:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.075+0000 7f1b232fab80 1 -- 172.21.15.151:0/3611858429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ed6e94f490 con 0x55ed6eaaa210 2023-07-21T22:21:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.075+0000 7f1af0ff9700 1 -- 172.21.15.151:0/3611858429 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1af8004660 con 0x55ed6eaaa210 2023-07-21T22:21:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.075+0000 7f1af0ff9700 1 -- 172.21.15.151:0/3611858429 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af8004820 con 0x55ed6eaaa210 2023-07-21T22:21:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.075+0000 7f1b232fab80 10 client.15987 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.075+0000 7f1b232fab80 1 -- 172.21.15.151:0/3611858429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ed6e80cc00 con 0x55ed6eaaa210 2023-07-21T22:21:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.076+0000 7f1af0ff9700 1 -- 172.21.15.151:0/3611858429 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1af8032020 con 0x55ed6eaaa210 2023-07-21T22:21:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.076+0000 7f1af0ff9700 1 -- 172.21.15.151:0/3611858429 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1af8024940 con 0x55ed6eaaa210 2023-07-21T22:21:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.076+0000 7f1b232fab80 10 client.15987 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.076+0000 7f1b232fab80 10 client.15987 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.076+0000 7f1b232fab80 20 client.15987 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.076+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ed6eabda90 0x55ed6eabfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.076+0000 7f1b232fab80 4 client.15987 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:21:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.076+0000 7f1b232fab80 1 -- 172.21.15.151:0/3611858429 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ed6e9eee50 con 0x55ed6eabda90 2023-07-21T22:21:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.077+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ed6eabda90 0x55ed6eabfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.077+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ed6eabda90 0x55ed6eabfea0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7fceb867ba5a87a server_cookie=5b8ecd1c8a3e4440 in_seq=0 out_seq=0 2023-07-21T22:21:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.077+0000 7f1af0ff9700 10 client.15987 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1af0ff9700 1 -- 172.21.15.151:0/3611858429 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ed6e9eee50 con 0x55ed6eabda90 2023-07-21T22:21:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1af0ff9700 10 client.15987 handle_command_reply: tid=0 2023-07-21T22:21:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 client.15987 shutdown 2023-07-21T22:21:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 -- 172.21.15.151:0/3611858429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 msgr2=0x55ed6eaad6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaad6c0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f1af8005910 tx=0x7f1af80056c0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 -- 172.21.15.151:0/3611858429 shutdown_connections 2023-07-21T22:21:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ed6eabda90 0x55ed6eabfea0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 0x55ed6eaadc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6e9006b0 0x55ed6eab04b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3611858429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa210 0x55ed6eaad6c0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1af0ff9700 0 client.15987 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 -- 172.21.15.151:0/3611858429 >> 172.21.15.151:0/3611858429 conn(0x55ed6ea99ae0 msgr2=0x55ed6ea9e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 -- 172.21.15.151:0/3611858429 shutdown_connections 2023-07-21T22:21:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.078+0000 7f1b232fab80 1 -- 172.21.15.151:0/3611858429 wait complete. 2023-07-21T22:21:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.079+0000 7f1b232fab80 20 client.15987 trim_cache size 0 max 16384 2023-07-21T22:21:26.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.096+0000 7f1b232fab80 1 Processor -- start 2023-07-21T22:21:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.096+0000 7f1b232fab80 1 -- start start 2023-07-21T22:21:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.096+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 0x55ed6eab4c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.096+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 0x55ed6eaab140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.096+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa660 0x55ed6eaaffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.096+0000 7f1b232fab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6eaae200 con 0x55ed6eaaa660 2023-07-21T22:21:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.096+0000 7f1b232fab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6ea9ff00 con 0x55ed6e9006b0 2023-07-21T22:21:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.096+0000 7f1b232fab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6eaadf70 con 0x55ed6eaaa210 2023-07-21T22:21:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.097+0000 7f1b0df9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa660 0x55ed6eaaffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.097+0000 7f1b0df9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa660 0x55ed6eaaffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48570/0 (socket says 172.21.15.151:48570) 2023-07-21T22:21:26.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.097+0000 7f1b0df9c700 1 -- 172.21.15.151:0/3078975327 learned_addr learned my addr 172.21.15.151:0/3078975327 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.097+0000 7f1b0df9c700 1 -- 172.21.15.151:0/3078975327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 msgr2=0x55ed6eaab140 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:21:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.097+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/3078975327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 0x55ed6eaab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.097+0000 7f1b0df9c700 1 -- 172.21.15.151:0/3078975327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 msgr2=0x55ed6eab4c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:21:26.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.097+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/3078975327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 0x55ed6eab4c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.097+0000 7f1b0df9c700 1 -- 172.21.15.151:0/3078975327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ed6e84a1f0 con 0x55ed6eaaa660 2023-07-21T22:21:26.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.098+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/3078975327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa660 0x55ed6eaaffe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1b00015950 tx=0x7f1b00009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d476fee64efc2e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:26.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.098+0000 7f1af3fff700 1 -- 172.21.15.151:0/3078975327 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b00030c90 con 0x55ed6eaaa660 2023-07-21T22:21:26.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.098+0000 7f1af3fff700 1 -- 172.21.15.151:0/3078975327 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b00015670 con 0x55ed6eaaa660 2023-07-21T22:21:26.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.098+0000 7f1af3fff700 1 -- 172.21.15.151:0/3078975327 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0000e960 con 0x55ed6eaaa660 2023-07-21T22:21:26.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.099+0000 7f1b232fab80 1 -- 172.21.15.151:0/3078975327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa660 msgr2=0x55ed6eaaffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:26.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.099+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3078975327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa660 0x55ed6eaaffe0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f1b00015950 tx=0x7f1b00009180 comp rx=0 tx=0).stop 2023-07-21T22:21:26.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.099+0000 7f1b232fab80 1 -- 172.21.15.151:0/3078975327 shutdown_connections 2023-07-21T22:21:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.099+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3078975327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6e9006b0 0x55ed6eab4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.099+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3078975327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6eaaa660 0x55ed6eaaffe0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.099+0000 7f1b232fab80 1 --2- 172.21.15.151:0/3078975327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 0x55ed6eaab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.099+0000 7f1b232fab80 1 -- 172.21.15.151:0/3078975327 >> 172.21.15.151:0/3078975327 conn(0x55ed6ea99ae0 msgr2=0x55ed6eaaaa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.099+0000 7f1b232fab80 1 -- 172.21.15.151:0/3078975327 shutdown_connections 2023-07-21T22:21:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.100+0000 7f1b232fab80 1 -- 172.21.15.151:0/3078975327 wait complete. 2023-07-21T22:21:26.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.100+0000 7f1b232fab80 1 -- start start 2023-07-21T22:21:26.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.100+0000 7f1b232fab80 1 Processor -- start 2023-07-21T22:21:26.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.101+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6e9006b0 0x55ed6eab4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.101+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.101+0000 7f1b232fab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 0x55ed6eaa5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.101+0000 7f1b232fab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6eaa6420 con 0x55ed6e9006b0 2023-07-21T22:21:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.101+0000 7f1b232fab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6eaa6590 con 0x55ed6eaaa660 2023-07-21T22:21:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.101+0000 7f1b232fab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ed6eaa6750 con 0x55ed6eaaa210 2023-07-21T22:21:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.101+0000 7f1b232fab80 10 client.0 _ll_register_callbacks cb 0x7f1b000097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.102+0000 7f1b0df9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6e9006b0 0x55ed6eab4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.102+0000 7f1b0df9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6e9006b0 0x55ed6eab4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48572/0 (socket says 172.21.15.151:48572) 2023-07-21T22:21:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.102+0000 7f1b0df9c700 1 -- 172.21.15.151:0/928442155 learned_addr learned my addr 172.21.15.151:0/928442155 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:26.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.102+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.102+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 0x55ed6eaa5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1b0cf9a700 1 -- 172.21.15.151:0/928442155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 msgr2=0x55ed6eaa5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 0x55ed6eaa5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1b0cf9a700 1 -- 172.21.15.151:0/928442155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6e9006b0 msgr2=0x55ed6eab4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6e9006b0 0x55ed6eab4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1b0cf9a700 1 -- 172.21.15.151:0/928442155 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ed6e823d80 con 0x55ed6eaaa210 2023-07-21T22:21:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6e9006b0 0x55ed6eab4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1b0cf9a700 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa5910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1af800e660 tx=0x7f1af80248d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60d21052fb149ae7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1af0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:21:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1af0ff9700 1 -- 172.21.15.151:0/928442155 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1af800b9f0 con 0x55ed6eaaa210 2023-07-21T22:21:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1b232fab80 1 -- 172.21.15.151:0/928442155 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1b0000f040 con 0x55ed6eaaa210 2023-07-21T22:21:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.103+0000 7f1af0ff9700 1 -- 172.21.15.151:0/928442155 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1af8000e40 con 0x55ed6eaaa210 2023-07-21T22:21:26.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1af0ff9700 1 -- 172.21.15.151:0/928442155 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1af80056a0 con 0x55ed6eaaa210 2023-07-21T22:21:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1b232fab80 10 client.25777 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1b232fab80 1 -- 172.21.15.151:0/928442155 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55ed6e822250 con 0x55ed6eaaa210 2023-07-21T22:21:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1af0ff9700 1 -- 172.21.15.151:0/928442155 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1b0000f040 con 0x55ed6eaaa210 2023-07-21T22:21:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1af0ff9700 1 -- 172.21.15.151:0/928442155 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1af800eb70 con 0x55ed6eaaa210 2023-07-21T22:21:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1b232fab80 10 client.25777 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1b232fab80 10 client.25777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:26.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1b232fab80 20 client.25777 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1b232fab80 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ed6eb12ac0 0x55ed6eb14ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1b232fab80 4 client.25777 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:21:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.104+0000 7f1b232fab80 1 -- 172.21.15.151:0/928442155 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ed6e9b0ff0 con 0x55ed6eb12ac0 2023-07-21T22:21:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.105+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ed6eb12ac0 0x55ed6eb14ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.105+0000 7f1af0ff9700 10 client.25777 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:26.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.105+0000 7f1b0df9c700 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ed6eb12ac0 0x55ed6eb14ed0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d401f6a449dfa89 server_cookie=60c2e3e032f32a3f in_seq=0 out_seq=0 2023-07-21T22:21:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.123+0000 7f1af0ff9700 1 -- 172.21.15.151:0/928442155 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ed6e9b0ff0 con 0x55ed6eb12ac0 2023-07-21T22:21:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.123+0000 7f1af0ff9700 10 client.25777 handle_command_reply: tid=0 2023-07-21T22:21:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.123+0000 7f1b232fab80 1 client.25777 shutdown 2023-07-21T22:21:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 -- 172.21.15.151:0/928442155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 msgr2=0x55ed6eaa5910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa5910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1af800e660 tx=0x7f1af80248d0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 -- 172.21.15.151:0/928442155 shutdown_connections 2023-07-21T22:21:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ed6eb12ac0 0x55ed6eb14ed0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ed6eaaa660 0x55ed6eaa5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ed6e9006b0 0x55ed6eab4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 --2- 172.21.15.151:0/928442155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ed6eaaa210 0x55ed6eaa5910 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1af0ff9700 0 client.25777 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 -- 172.21.15.151:0/928442155 >> 172.21.15.151:0/928442155 conn(0x55ed6ea99ae0 msgr2=0x55ed6eaa2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 -- 172.21.15.151:0/928442155 shutdown_connections 2023-07-21T22:21:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 1 -- 172.21.15.151:0/928442155 wait complete. 2023-07-21T22:21:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.124+0000 7f1b232fab80 20 client.25777 trim_cache size 0 max 16384 2023-07-21T22:21:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:21:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:21:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:21:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:21:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1af40a1340 msgr2=0x7f1af40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1af40a1340 0x7f1af40a37f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e970 tx=0x7f1b040d0510 comp rx=0 tx=0).stop 2023-07-21T22:21:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/768906480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080728b0 msgr2=0x7f1b0819c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080728b0 0x7f1b0819c1b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400e9a0 tx=0x7f1b0400ed60 comp rx=0 tx=0).stop 2023-07-21T22:21:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/768906480 shutdown_connections 2023-07-21T22:21:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1af40a1340 0x7f1af40a37f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1b08110b10 0x7f1b081a0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1b080728b0 0x7f1b0819c1b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 --2- 172.21.15.151:0/768906480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1b080731c0 0x7f1b0819c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/768906480 >> 172.21.15.151:0/768906480 conn(0x7f1b080fb600 msgr2=0x7f1b080fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/768906480 shutdown_connections 2023-07-21T22:21:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:26.125+0000 7f1b0f9ff700 1 -- 172.21.15.151:0/768906480 wait complete. 2023-07-21T22:21:26.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:26 smithi151 ceph-mon[95510]: pgmap v70: 97 pgs: 97 active+clean; 1.6 GiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-07-21T22:21:26.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:26 smithi187 ceph-mon[96918]: pgmap v70: 97 pgs: 97 active+clean; 1.6 GiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-07-21T22:21:26.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:26 smithi195 ceph-mon[97365]: pgmap v70: 97 pgs: 97 active+clean; 1.6 GiB data, 1021 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-07-21T22:21:27.126 INFO:teuthology.orchestra.run.smithi151.stderr:7300000 of 50000000 tuples (14%) done (elapsed 110.62 s, remaining 647.04 s) 2023-07-21T22:21:28.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:28 smithi151 ceph-mon[95510]: pgmap v71: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-07-21T22:21:28.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:28 smithi187 ceph-mon[96918]: pgmap v71: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-07-21T22:21:28.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:28 smithi195 ceph-mon[97365]: pgmap v71: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-07-21T22:21:29.017 INFO:teuthology.orchestra.run.smithi151.stderr:7400000 of 50000000 tuples (14%) done (elapsed 112.51 s, remaining 647.69 s) 2023-07-21T22:21:30.683 INFO:teuthology.orchestra.run.smithi151.stderr:7500000 of 50000000 tuples (15%) done (elapsed 114.18 s, remaining 646.99 s) 2023-07-21T22:21:30.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:30 smithi151 ceph-mon[95510]: pgmap v72: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-07-21T22:21:30.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:30 smithi187 ceph-mon[96918]: pgmap v72: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-07-21T22:21:30.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:30 smithi195 ceph-mon[97365]: pgmap v72: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-07-21T22:21:31.800 INFO:teuthology.orchestra.run.smithi151.stderr:7600000 of 50000000 tuples (15%) done (elapsed 115.29 s, remaining 643.21 s) 2023-07-21T22:21:32.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:32 smithi151 ceph-mon[95510]: pgmap v73: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-07-21T22:21:32.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:32 smithi187 ceph-mon[96918]: pgmap v73: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-07-21T22:21:32.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:32 smithi195 ceph-mon[97365]: pgmap v73: 97 pgs: 97 active+clean; 1.7 GiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 25 MiB/s wr, 24 op/s 2023-07-21T22:21:33.506 INFO:teuthology.orchestra.run.smithi151.stderr:7700000 of 50000000 tuples (15%) done (elapsed 117.00 s, remaining 642.73 s) 2023-07-21T22:21:34.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:34 smithi151 ceph-mon[95510]: pgmap v74: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 32 op/s 2023-07-21T22:21:34.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:34 smithi187 ceph-mon[96918]: pgmap v74: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 32 op/s 2023-07-21T22:21:34.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:34 smithi195 ceph-mon[97365]: pgmap v74: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 38 MiB/s wr, 32 op/s 2023-07-21T22:21:35.196 INFO:teuthology.orchestra.run.smithi151.stderr:7800000 of 50000000 tuples (15%) done (elapsed 118.69 s, remaining 642.14 s) 2023-07-21T22:21:36.459 INFO:teuthology.orchestra.run.smithi151.stderr:7900000 of 50000000 tuples (15%) done (elapsed 119.95 s, remaining 639.23 s) 2023-07-21T22:21:36.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:36 smithi151 ceph-mon[95510]: pgmap v75: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 22 op/s 2023-07-21T22:21:36.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:36 smithi187 ceph-mon[96918]: pgmap v75: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 22 op/s 2023-07-21T22:21:36.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:36 smithi195 ceph-mon[97365]: pgmap v75: 97 pgs: 97 active+clean; 1.8 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 25 MiB/s wr, 22 op/s 2023-07-21T22:21:38.113 INFO:teuthology.orchestra.run.smithi151.stderr:8000000 of 50000000 tuples (16%) done (elapsed 121.61 s, remaining 638.43 s) 2023-07-21T22:21:38.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:38 smithi151 ceph-mon[95510]: pgmap v76: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-07-21T22:21:38.809 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:21:38.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:38 smithi187 ceph-mon[96918]: pgmap v76: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-07-21T22:21:38.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:38 smithi195 ceph-mon[97365]: pgmap v76: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-07-21T22:21:39.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.011+0000 7fda58dff700 1 -- 172.21.15.151:0/3772144163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda54072850 msgr2=0x7fda54072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.056 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.011+0000 7fda58dff700 1 --2- 172.21.15.151:0/3772144163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda54072850 0x7fda54072c20 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fda44009990 tx=0x7fda44009ca0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.011+0000 7fda58dff700 1 -- 172.21.15.151:0/3772144163 shutdown_connections 2023-07-21T22:21:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.011+0000 7fda58dff700 1 --2- 172.21.15.151:0/3772144163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda5410c380 0x7fda5410e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.011+0000 7fda58dff700 1 --2- 172.21.15.151:0/3772144163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda54072850 0x7fda54072c20 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.011+0000 7fda58dff700 1 --2- 172.21.15.151:0/3772144163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda54073160 0x7fda5410be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.011+0000 7fda58dff700 1 -- 172.21.15.151:0/3772144163 >> 172.21.15.151:0/3772144163 conn(0x7fda540fb5e0 msgr2=0x7fda540fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.011+0000 7fda58dff700 1 -- 172.21.15.151:0/3772144163 shutdown_connections 2023-07-21T22:21:39.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.011+0000 7fda58dff700 1 -- 172.21.15.151:0/3772144163 wait complete. 2023-07-21T22:21:39.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.012+0000 7fda58dff700 1 Processor -- start 2023-07-21T22:21:39.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.012+0000 7fda58dff700 1 -- start start 2023-07-21T22:21:39.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.012+0000 7fda58dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda54072850 0x7fda54197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.012+0000 7fda58dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda54073160 0x7fda541982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.012+0000 7fda58dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda5410c380 0x7fda5419c740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.012+0000 7fda58dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5419cd80 con 0x7fda5410c380 2023-07-21T22:21:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.012+0000 7fda58dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5419cef0 con 0x7fda54072850 2023-07-21T22:21:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.012+0000 7fda58dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda5419d0b0 con 0x7fda54073160 2023-07-21T22:21:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda51d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda54073160 0x7fda541982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda5259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda54072850 0x7fda54197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda51d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda54073160 0x7fda541982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51566/0 (socket says 172.21.15.151:51566) 2023-07-21T22:21:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda5259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda54072850 0x7fda54197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45652/0 (socket says 172.21.15.151:45652) 2023-07-21T22:21:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda51d9b700 1 -- 172.21.15.151:0/677851289 learned_addr learned my addr 172.21.15.151:0/677851289 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda52d9d700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda5410c380 0x7fda5419c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda5259c700 1 -- 172.21.15.151:0/677851289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda54073160 msgr2=0x7fda541982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda5259c700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda54073160 0x7fda541982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda5259c700 1 -- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda5410c380 msgr2=0x7fda5419c740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda5259c700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda5410c380 0x7fda5419c740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda5259c700 1 -- 172.21.15.151:0/677851289 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda440095f0 con 0x7fda54072850 2023-07-21T22:21:39.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.013+0000 7fda5259c700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda54072850 0x7fda54197da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda44005910 tx=0x7fda44005740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.014+0000 7fda437fe700 1 -- 172.21.15.151:0/677851289 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4401d070 con 0x7fda54072850 2023-07-21T22:21:39.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.014+0000 7fda58dff700 1 -- 172.21.15.151:0/677851289 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda5419d330 con 0x7fda54072850 2023-07-21T22:21:39.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.014+0000 7fda437fe700 1 -- 172.21.15.151:0/677851289 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda44022470 con 0x7fda54072850 2023-07-21T22:21:39.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.014+0000 7fda437fe700 1 -- 172.21.15.151:0/677851289 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44017650 con 0x7fda54072850 2023-07-21T22:21:39.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.014+0000 7fda58dff700 1 -- 172.21.15.151:0/677851289 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda541a4bd0 con 0x7fda54072850 2023-07-21T22:21:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.017+0000 7fda437fe700 1 -- 172.21.15.151:0/677851289 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fda440225e0 con 0x7fda54072850 2023-07-21T22:21:39.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.019+0000 7fda6c73ab80 1 Processor -- start 2023-07-21T22:21:39.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.019+0000 7fda6c73ab80 1 -- start start 2023-07-21T22:21:39.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.019+0000 7fda437fe700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fda3c0a12c0 0x7fda3c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.019+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d50d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.019+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d508350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.019+0000 7fda437fe700 1 -- 172.21.15.151:0/677851289 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fda440ce040 con 0x7fda54072850 2023-07-21T22:21:39.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.019+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d508da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d40dcb0 con 0x56331d508930 2023-07-21T22:21:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d460a40 con 0x56331d50d1b0 2023-07-21T22:21:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d459ed0 con 0x56331d50dac0 2023-07-21T22:21:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda52d9d700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fda3c0a12c0 0x7fda3c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda51d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d508350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda52d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d508da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda5259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d50d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda51d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d508350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51578/0 (socket says 172.21.15.151:51578) 2023-07-21T22:21:39.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda51d9b700 1 -- 172.21.15.151:0/2290125985 learned_addr learned my addr 172.21.15.151:0/2290125985 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda5259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d50d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45658/0 (socket says 172.21.15.151:45658) 2023-07-21T22:21:39.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda51d9b700 1 -- 172.21.15.151:0/2290125985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 msgr2=0x56331d50d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda51d9b700 1 --2- 172.21.15.151:0/2290125985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d50d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda51d9b700 1 -- 172.21.15.151:0/2290125985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 msgr2=0x56331d508da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda51d9b700 1 --2- 172.21.15.151:0/2290125985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d508da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.020+0000 7fda51d9b700 1 -- 172.21.15.151:0/2290125985 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56331d287de0 con 0x56331d50dac0 2023-07-21T22:21:39.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.021+0000 7fda52d9d700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fda3c0a12c0 0x7fda3c0a3770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009ec0 tx=0x7fda4c0092f0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.021+0000 7fda51d9b700 1 --2- 172.21.15.151:0/2290125985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d508350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda48009df0 tx=0x7fda48011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5e98ed8d19c57b09 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.021+0000 7fda40ff9700 1 -- 172.21.15.151:0/2290125985 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48011d80 con 0x56331d50dac0 2023-07-21T22:21:39.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.021+0000 7fda40ff9700 1 -- 172.21.15.151:0/2290125985 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda480044c0 con 0x56331d50dac0 2023-07-21T22:21:39.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.021+0000 7fda40ff9700 1 -- 172.21.15.151:0/2290125985 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda48005280 con 0x56331d50dac0 2023-07-21T22:21:39.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.022+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2290125985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 msgr2=0x56331d508350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.022+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/2290125985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d508350 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fda48009df0 tx=0x7fda48011720 comp rx=0 tx=0).stop 2023-07-21T22:21:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.022+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2290125985 shutdown_connections 2023-07-21T22:21:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.022+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/2290125985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d50d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.022+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/2290125985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d508da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.022+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/2290125985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d508350 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.022+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2290125985 >> 172.21.15.151:0/2290125985 conn(0x56331d4fdef0 msgr2=0x56331d503830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.022+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2290125985 shutdown_connections 2023-07-21T22:21:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.022+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2290125985 wait complete. 2023-07-21T22:21:39.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.023+0000 7fda6c73ab80 1 -- start start 2023-07-21T22:21:39.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.023+0000 7fda6c73ab80 1 Processor -- start 2023-07-21T22:21:39.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d514bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d511e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d5124e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d3f9ac0 con 0x56331d508930 2023-07-21T22:21:39.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d3f97c0 con 0x56331d50d1b0 2023-07-21T22:21:39.073 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d2dd920 con 0x56331d50dac0 2023-07-21T22:21:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda6c73ab80 10 client.0 _ll_register_callbacks cb 0x56331d3f7760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda5259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d514bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda52d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d5124e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda51d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d511e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda5259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d514bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49042/0 (socket says 172.21.15.151:49042) 2023-07-21T22:21:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.024+0000 7fda5259c700 1 -- 172.21.15.151:0/3068889424 learned_addr learned my addr 172.21.15.151:0/3068889424 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda52d9d700 1 -- 172.21.15.151:0/3068889424 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 msgr2=0x56331d511e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda52d9d700 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d511e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda52d9d700 1 -- 172.21.15.151:0/3068889424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 msgr2=0x56331d514bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda52d9d700 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d514bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda52d9d700 1 -- 172.21.15.151:0/3068889424 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda48009a50 con 0x56331d50dac0 2023-07-21T22:21:39.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda5259c700 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d514bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:39.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda52d9d700 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d5124e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda54069a80 tx=0x7fda4c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=355124d7ef63ea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:21:39.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda39ffb700 1 -- 172.21.15.151:0/3068889424 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4c00e070 con 0x56331d50dac0 2023-07-21T22:21:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda6c73ab80 1 -- 172.21.15.151:0/3068889424 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56331d3b34f0 con 0x56331d50dac0 2023-07-21T22:21:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.025+0000 7fda39ffb700 1 -- 172.21.15.151:0/3068889424 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fda4c021040 con 0x56331d50dac0 2023-07-21T22:21:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda39ffb700 1 -- 172.21.15.151:0/3068889424 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda4c01ae50 con 0x56331d50dac0 2023-07-21T22:21:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda6c73ab80 10 client.25789 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda6c73ab80 1 -- 172.21.15.151:0/3068889424 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56331d270c60 con 0x56331d50dac0 2023-07-21T22:21:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda39ffb700 1 -- 172.21.15.151:0/3068889424 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56331d3b34f0 con 0x56331d50dac0 2023-07-21T22:21:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda39ffb700 1 -- 172.21.15.151:0/3068889424 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fda4c025070 con 0x56331d50dac0 2023-07-21T22:21:39.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda6c73ab80 10 client.25789 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda6c73ab80 10 client.25789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda6c73ab80 20 client.25789 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56331d522590 0x56331d5249a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda6c73ab80 4 client.25789 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:21:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.026+0000 7fda6c73ab80 1 -- 172.21.15.151:0/3068889424 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56331d452eb0 con 0x56331d522590 2023-07-21T22:21:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.027+0000 7fda5259c700 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56331d522590 0x56331d5249a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.027+0000 7fda5259c700 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56331d522590 0x56331d5249a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1830d197f961913 server_cookie=d655dd2de503e5a4 in_seq=0 out_seq=0 2023-07-21T22:21:39.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.027+0000 7fda39ffb700 10 client.25789 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:39.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda39ffb700 1 -- 172.21.15.151:0/3068889424 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56331d452eb0 con 0x56331d522590 2023-07-21T22:21:39.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda39ffb700 10 client.25789 handle_command_reply: tid=0 2023-07-21T22:21:39.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 client.25789 shutdown 2023-07-21T22:21:39.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 -- 172.21.15.151:0/3068889424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 msgr2=0x56331d5124e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d5124e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fda54069a80 tx=0x7fda4c00b040 comp rx=0 tx=0).stop 2023-07-21T22:21:39.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 -- 172.21.15.151:0/3068889424 shutdown_connections 2023-07-21T22:21:39.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56331d522590 0x56331d5249a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d50dac0 0x56331d5124e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d508930 0x56331d514bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/3068889424 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d511e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda39ffb700 0 client.25789 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:39.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 -- 172.21.15.151:0/3068889424 >> 172.21.15.151:0/3068889424 conn(0x56331d4fdef0 msgr2=0x56331d503420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 -- 172.21.15.151:0/3068889424 shutdown_connections 2023-07-21T22:21:39.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.028+0000 7fda6c73ab80 1 -- 172.21.15.151:0/3068889424 wait complete. 2023-07-21T22:21:39.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.029+0000 7fda6c73ab80 20 client.25789 trim_cache size 0 max 16384 2023-07-21T22:21:39.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.049+0000 7fda6c73ab80 1 Processor -- start 2023-07-21T22:21:39.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.049+0000 7fda6c73ab80 1 -- start start 2023-07-21T22:21:39.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.049+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d5195a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.049+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d514760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.049+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 0x56331d5032d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.049+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d4faf00 con 0x56331d50dac0 2023-07-21T22:21:39.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.049+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d504ca0 con 0x56331d50d1b0 2023-07-21T22:21:39.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.049+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d512df0 con 0x56331d508930 2023-07-21T22:21:39.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.049+0000 7fda5259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d5195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda5259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d5195a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51600/0 (socket says 172.21.15.151:51600) 2023-07-21T22:21:39.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda5259c700 1 -- 172.21.15.151:0/2613131767 learned_addr learned my addr 172.21.15.151:0/2613131767 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda52d9d700 1 --2- 172.21.15.151:0/2613131767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 0x56331d5032d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda51d9b700 1 --2- 172.21.15.151:0/2613131767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d514760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda5259c700 1 -- 172.21.15.151:0/2613131767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 msgr2=0x56331d514760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda5259c700 1 --2- 172.21.15.151:0/2613131767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d514760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda5259c700 1 -- 172.21.15.151:0/2613131767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 msgr2=0x56331d5032d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda5259c700 1 --2- 172.21.15.151:0/2613131767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 0x56331d5032d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda5259c700 1 -- 172.21.15.151:0/2613131767 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56331d2ae250 con 0x56331d508930 2023-07-21T22:21:39.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda5259c700 1 --2- 172.21.15.151:0/2613131767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d5195a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda4409aef0 tx=0x7fda44005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae7b1fe270eadf23 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.050+0000 7fda417fa700 1 -- 172.21.15.151:0/2613131767 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44011110 con 0x56331d508930 2023-07-21T22:21:39.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda417fa700 1 -- 172.21.15.151:0/2613131767 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda4409ad30 con 0x56331d508930 2023-07-21T22:21:39.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda417fa700 1 -- 172.21.15.151:0/2613131767 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44099330 con 0x56331d508930 2023-07-21T22:21:39.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2613131767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 msgr2=0x56331d5195a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/2613131767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d5195a0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fda4409aef0 tx=0x7fda44005830 comp rx=0 tx=0).stop 2023-07-21T22:21:39.101 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2613131767 shutdown_connections 2023-07-21T22:21:39.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/2613131767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 0x56331d5032d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/2613131767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d5195a0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/2613131767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d514760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2613131767 >> 172.21.15.151:0/2613131767 conn(0x56331d4fdef0 msgr2=0x56331d51dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.102 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.051+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2613131767 shutdown_connections 2023-07-21T22:21:39.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.052+0000 7fda6c73ab80 1 -- 172.21.15.151:0/2613131767 wait complete. 2023-07-21T22:21:39.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.052+0000 7fda6c73ab80 1 -- start start 2023-07-21T22:21:39.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.052+0000 7fda6c73ab80 1 Processor -- start 2023-07-21T22:21:39.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d511a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d510610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda6c73ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 0x56331d510b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d512060 con 0x56331d50dac0 2023-07-21T22:21:39.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d5121d0 con 0x56331d50d1b0 2023-07-21T22:21:39.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda6c73ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56331d511090 con 0x56331d508930 2023-07-21T22:21:39.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda6c73ab80 10 client.0 _ll_register_callbacks cb 0x7fda4c006080 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:39.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda5259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d511a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda5259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d511a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51614/0 (socket says 172.21.15.151:51614) 2023-07-21T22:21:39.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda52d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 0x56331d510b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.053+0000 7fda5259c700 1 -- 172.21.15.151:0/447706452 learned_addr learned my addr 172.21.15.151:0/447706452 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda51d9b700 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d510610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda5259c700 1 -- 172.21.15.151:0/447706452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 msgr2=0x56331d510610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda5259c700 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d510610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda5259c700 1 -- 172.21.15.151:0/447706452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 msgr2=0x56331d510b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda5259c700 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 0x56331d510b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda5259c700 1 -- 172.21.15.151:0/447706452 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda541a4bd0 con 0x56331d508930 2023-07-21T22:21:39.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda5259c700 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d511a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda440a3080 tx=0x7fda4400b390 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44f67c0c10bb4cce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda39ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:21:39.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda39ffb700 1 -- 172.21.15.151:0/447706452 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4409f220 con 0x56331d508930 2023-07-21T22:21:39.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda6c73ab80 1 -- 172.21.15.151:0/447706452 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fda480044c0 con 0x56331d508930 2023-07-21T22:21:39.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.054+0000 7fda39ffb700 1 -- 172.21.15.151:0/447706452 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fda440a10b0 con 0x56331d508930 2023-07-21T22:21:39.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda39ffb700 1 -- 172.21.15.151:0/447706452 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fda440a35b0 con 0x56331d508930 2023-07-21T22:21:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda6c73ab80 10 client.25795 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda6c73ab80 1 -- 172.21.15.151:0/447706452 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x56331d2862b0 con 0x56331d508930 2023-07-21T22:21:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda39ffb700 1 -- 172.21.15.151:0/447706452 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fda480044c0 con 0x56331d508930 2023-07-21T22:21:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda39ffb700 1 -- 172.21.15.151:0/447706452 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fda4409a770 con 0x56331d508930 2023-07-21T22:21:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda6c73ab80 10 client.25795 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda6c73ab80 10 client.25795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:39.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda6c73ab80 20 client.25795 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:39.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56331d57fa00 0x56331d581e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda6c73ab80 4 client.25795 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:21:39.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda6c73ab80 1 -- 172.21.15.151:0/447706452 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56331d415050 con 0x56331d57fa00 2023-07-21T22:21:39.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.055+0000 7fda51d9b700 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56331d57fa00 0x56331d581e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.056+0000 7fda51d9b700 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56331d57fa00 0x56331d581e10 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca1c7de580ac34a5 server_cookie=c0cfba4d08649786 in_seq=0 out_seq=0 2023-07-21T22:21:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.056+0000 7fda39ffb700 10 client.25795 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.056+0000 7fda39ffb700 1 -- 172.21.15.151:0/447706452 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x56331d415050 con 0x56331d57fa00 2023-07-21T22:21:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.056+0000 7fda39ffb700 10 client.25795 handle_command_reply: tid=0 2023-07-21T22:21:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.056+0000 7fda6c73ab80 1 client.25795 shutdown 2023-07-21T22:21:39.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.056+0000 7fda6c73ab80 1 -- 172.21.15.151:0/447706452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 msgr2=0x56331d511a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.056+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d511a00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fda440a3080 tx=0x7fda4400b390 comp rx=0 tx=0).stop 2023-07-21T22:21:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda6c73ab80 1 -- 172.21.15.151:0/447706452 shutdown_connections 2023-07-21T22:21:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56331d57fa00 0x56331d581e10 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56331d50dac0 0x56331d510b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56331d508930 0x56331d511a00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda39ffb700 0 client.25795 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:39.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda6c73ab80 1 --2- 172.21.15.151:0/447706452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56331d50d1b0 0x56331d510610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda6c73ab80 1 -- 172.21.15.151:0/447706452 >> 172.21.15.151:0/447706452 conn(0x56331d4fdef0 msgr2=0x56331d5032b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda6c73ab80 1 -- 172.21.15.151:0/447706452 shutdown_connections 2023-07-21T22:21:39.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda6c73ab80 1 -- 172.21.15.151:0/447706452 wait complete. 2023-07-21T22:21:39.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.057+0000 7fda6c73ab80 20 client.25795 trim_cache size 0 max 16384 2023-07-21T22:21:39.115 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:21:39.116 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:21:39.116 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:21:39.116 INFO:teuthology.orchestra.run.smithi151.stdout: "ec38d3a5-93f8-4072-bfe2-c7872d39c48a": { 2023-07-21T22:21:39.116 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:21:39.116 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "ec38d3a5-93f8-4072-bfe2-c7872d39c48a", 2023-07-21T22:21:39.116 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:21:39.116 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:21:39.117 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:21:39.117 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:21:39.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 -- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fda3c0a12c0 msgr2=0x7fda3c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fda3c0a12c0 0x7fda3c0a3770 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fda4c009ec0 tx=0x7fda4c0092f0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 -- 172.21.15.151:0/677851289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda54072850 msgr2=0x7fda54197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda54072850 0x7fda54197da0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fda44005910 tx=0x7fda44005740 comp rx=0 tx=0).stop 2023-07-21T22:21:39.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 -- 172.21.15.151:0/677851289 shutdown_connections 2023-07-21T22:21:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fda3c0a12c0 0x7fda3c0a3770 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda54072850 0x7fda54197da0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda5410c380 0x7fda5419c740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 --2- 172.21.15.151:0/677851289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fda54073160 0x7fda541982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 -- 172.21.15.151:0/677851289 >> 172.21.15.151:0/677851289 conn(0x7fda540fb5e0 msgr2=0x7fda5410e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 -- 172.21.15.151:0/677851289 shutdown_connections 2023-07-21T22:21:39.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:21:39.058+0000 7fda58dff700 1 -- 172.21.15.151:0/677851289 wait complete. 2023-07-21T22:21:39.124 INFO:tasks.cephfs.filesystem:scrub status for tag:ec38d3a5-93f8-4072-bfe2-c7872d39c48a - {'path': '/', 'tag': 'ec38d3a5-93f8-4072-bfe2-c7872d39c48a', 'options': 'recursive,force'} 2023-07-21T22:21:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.296+0000 7f1166b9d700 1 -- 172.21.15.151:0/3325187473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 msgr2=0x7f1160105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.296+0000 7f1166b9d700 1 --2- 172.21.15.151:0/3325187473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 0x7f1160105d70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f115c009990 tx=0x7f115c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.296+0000 7f1166b9d700 1 -- 172.21.15.151:0/3325187473 shutdown_connections 2023-07-21T22:21:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.296+0000 7f1166b9d700 1 --2- 172.21.15.151:0/3325187473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 0x7f1160105d70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.296+0000 7f1166b9d700 1 --2- 172.21.15.151:0/3325187473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1160068070 0x7f116010c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.296+0000 7f1166b9d700 1 --2- 172.21.15.151:0/3325187473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11601062b0 0x7f1160067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.296+0000 7f1166b9d700 1 -- 172.21.15.151:0/3325187473 >> 172.21.15.151:0/3325187473 conn(0x7f1160074770 msgr2=0x7f1160074b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.296+0000 7f1166b9d700 1 -- 172.21.15.151:0/3325187473 shutdown_connections 2023-07-21T22:21:39.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.296+0000 7f1166b9d700 1 -- 172.21.15.151:0/3325187473 wait complete. 2023-07-21T22:21:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.297+0000 7f1166b9d700 1 Processor -- start 2023-07-21T22:21:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.297+0000 7f1166b9d700 1 -- start start 2023-07-21T22:21:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f1166b9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1160068070 0x7f11600fea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f1166b9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 0x7f11600fefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f1166b9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11601062b0 0x7f11601a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f1166b9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11600ff7d0 con 0x7f1160068070 2023-07-21T22:21:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f1166b9d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11601a4150 con 0x7f11601059a0 2023-07-21T22:21:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f1166b9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11601a4290 con 0x7f11601062b0 2023-07-21T22:21:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f116539a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 0x7f11600fefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f1165b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1160068070 0x7f11600fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f116539a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 0x7f11600fefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45712/0 (socket says 172.21.15.151:45712) 2023-07-21T22:21:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f116539a700 1 -- 172.21.15.151:0/2027152749 learned_addr learned my addr 172.21.15.151:0/2027152749 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.298+0000 7f116639c700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11601062b0 0x7f11601a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1165b9b700 1 -- 172.21.15.151:0/2027152749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11601062b0 msgr2=0x7f11601a3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1165b9b700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11601062b0 0x7f11601a3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1165b9b700 1 -- 172.21.15.151:0/2027152749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 msgr2=0x7f11600fefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1165b9b700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 0x7f11600fefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1165b9b700 1 -- 172.21.15.151:0/2027152749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0095f0 con 0x7f1160068070 2023-07-21T22:21:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f116539a700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 0x7f11600fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:39.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1165b9b700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1160068070 0x7f11600fea60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f115c0098e0 tx=0x7f115c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1156ffd700 1 -- 172.21.15.151:0/2027152749 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c01d070 con 0x7f1160068070 2023-07-21T22:21:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1166b9d700 1 -- 172.21.15.151:0/2027152749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11601a4490 con 0x7f1160068070 2023-07-21T22:21:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1156ffd700 1 -- 172.21.15.151:0/2027152749 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f115c022470 con 0x7f1160068070 2023-07-21T22:21:39.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.299+0000 7f1156ffd700 1 -- 172.21.15.151:0/2027152749 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c017650 con 0x7f1160068070 2023-07-21T22:21:39.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.300+0000 7f1166b9d700 1 -- 172.21.15.151:0/2027152749 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11601a4960 con 0x7f1160068070 2023-07-21T22:21:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.304+0000 7f1156ffd700 1 -- 172.21.15.151:0/2027152749 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f115c0225e0 con 0x7f1160068070 2023-07-21T22:21:39.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.305+0000 7f117b765b80 1 Processor -- start 2023-07-21T22:21:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.305+0000 7f117b765b80 1 -- start start 2023-07-21T22:21:39.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f117b765b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd19750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f117b765b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 0x55b95fd138b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f117b765b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd14240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f117b765b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fc10c50 con 0x55b95fd13df0 2023-07-21T22:21:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f117b765b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fc639e0 con 0x55b95fb676b0 2023-07-21T22:21:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f117b765b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fc5ce70 con 0x55b95fd19c90 2023-07-21T22:21:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f116639c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd19750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f1156ffd700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f114c0a1340 0x7f114c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f116639c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd19750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45720/0 (socket says 172.21.15.151:45720) 2023-07-21T22:21:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f116639c700 1 -- 172.21.15.151:0/1212819949 learned_addr learned my addr 172.21.15.151:0/1212819949 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f116539a700 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd14240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f1165b9b700 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 0x55b95fd138b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.306+0000 7f1156ffd700 1 -- 172.21.15.151:0/2027152749 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f115c0cdf50 con 0x7f1160068070 2023-07-21T22:21:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f116639c700 1 -- 172.21.15.151:0/1212819949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 msgr2=0x55b95fd138b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f116639c700 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 0x55b95fd138b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f116639c700 1 -- 172.21.15.151:0/1212819949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 msgr2=0x55b95fd14240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f116639c700 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd14240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f116639c700 1 -- 172.21.15.151:0/1212819949 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b95fa8ad80 con 0x55b95fb676b0 2023-07-21T22:21:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f1165b9b700 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 0x55b95fd138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:21:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f116639c700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f114c0a1340 0x7f114c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f116539a700 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd14240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:21:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f116639c700 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd19750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f11580060b0 tx=0x7f1158013970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=167a60709eb9caba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f114bfff700 1 -- 172.21.15.151:0/1212819949 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115800e040 con 0x55b95fb676b0 2023-07-21T22:21:39.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f114bfff700 1 -- 172.21.15.151:0/1212819949 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f115800f040 con 0x55b95fb676b0 2023-07-21T22:21:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.307+0000 7f114bfff700 1 -- 172.21.15.151:0/1212819949 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1158023700 con 0x55b95fb676b0 2023-07-21T22:21:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f117b765b80 1 -- 172.21.15.151:0/1212819949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 msgr2=0x55b95fd19750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f117b765b80 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd19750 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f11580060b0 tx=0x7f1158013970 comp rx=0 tx=0).stop 2023-07-21T22:21:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f116639c700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f114c0a1340 0x7f114c0a37f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1158022000 tx=0x7f115801f000 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f117b765b80 1 -- 172.21.15.151:0/1212819949 shutdown_connections 2023-07-21T22:21:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f117b765b80 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd19750 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f117b765b80 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd14240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f117b765b80 1 --2- 172.21.15.151:0/1212819949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 0x55b95fd138b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f117b765b80 1 -- 172.21.15.151:0/1212819949 >> 172.21.15.151:0/1212819949 conn(0x55b95fd00c40 msgr2=0x55b95fd06300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f117b765b80 1 -- 172.21.15.151:0/1212819949 shutdown_connections 2023-07-21T22:21:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.308+0000 7f117b765b80 1 -- 172.21.15.151:0/1212819949 wait complete. 2023-07-21T22:21:39.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.309+0000 7f117b765b80 1 -- start start 2023-07-21T22:21:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.309+0000 7f117b765b80 1 Processor -- start 2023-07-21T22:21:39.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.310+0000 7f117b765b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fb676b0 0x55b95fd1fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.310+0000 7f117b765b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd13df0 0x55b95fd1d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.310+0000 7f117b765b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 0x55b95fd1d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.310+0000 7f117b765b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fbfca60 con 0x55b95fb676b0 2023-07-21T22:21:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.310+0000 7f117b765b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fbfc760 con 0x55b95fd19c90 2023-07-21T22:21:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.310+0000 7f117b765b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fae08c0 con 0x55b95fd13df0 2023-07-21T22:21:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.310+0000 7f117b765b80 10 client.0 _ll_register_callbacks cb 0x55b95fbfa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.310+0000 7f1165b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fb676b0 0x55b95fd1fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f1165b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fb676b0 0x55b95fd1fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49092/0 (socket says 172.21.15.151:49092) 2023-07-21T22:21:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f1165b9b700 1 -- 172.21.15.151:0/1086282235 learned_addr learned my addr 172.21.15.151:0/1086282235 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f116639c700 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 0x55b95fd1d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f116539a700 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd13df0 0x55b95fd1d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f1165b9b700 1 -- 172.21.15.151:0/1086282235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd13df0 msgr2=0x55b95fd1d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f1165b9b700 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd13df0 0x55b95fd1d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f1165b9b700 1 -- 172.21.15.151:0/1086282235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 msgr2=0x55b95fd1d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f1165b9b700 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 0x55b95fd1d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f1165b9b700 1 -- 172.21.15.151:0/1086282235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1158013370 con 0x55b95fb676b0 2023-07-21T22:21:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.311+0000 7f116639c700 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 0x55b95fd1d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.312+0000 7f1165b9b700 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fb676b0 0x55b95fd1fec0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f115c097b70 tx=0x7f115c015b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f02c6bf0282ea53 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.312+0000 7f11497fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:21:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.312+0000 7f11497fa700 1 -- 172.21.15.151:0/1086282235 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0cbb70 con 0x55b95fb676b0 2023-07-21T22:21:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.312+0000 7f11497fa700 1 -- 172.21.15.151:0/1086282235 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f115c0cbe40 con 0x55b95fb676b0 2023-07-21T22:21:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.312+0000 7f117b765b80 1 -- 172.21.15.151:0/1086282235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b95fbb6490 con 0x55b95fb676b0 2023-07-21T22:21:39.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.312+0000 7f11497fa700 1 -- 172.21.15.151:0/1086282235 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f115c0a34c0 con 0x55b95fb676b0 2023-07-21T22:21:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.312+0000 7f117b765b80 10 client.16023 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.312+0000 7f117b765b80 1 -- 172.21.15.151:0/1086282235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b95fa73c00 con 0x55b95fb676b0 2023-07-21T22:21:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.313+0000 7f11497fa700 1 -- 172.21.15.151:0/1086282235 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b95fbb6490 con 0x55b95fb676b0 2023-07-21T22:21:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.313+0000 7f11497fa700 1 -- 172.21.15.151:0/1086282235 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f115c0666e0 con 0x55b95fb676b0 2023-07-21T22:21:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.313+0000 7f117b765b80 10 client.16023 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.313+0000 7f117b765b80 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:39.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.313+0000 7f117b765b80 20 client.16023 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.313+0000 7f117b765b80 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b95fd2d120 0x55b95fd2f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.313+0000 7f117b765b80 4 client.16023 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:21:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.313+0000 7f117b765b80 1 -- 172.21.15.151:0/1086282235 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b95fc55e50 con 0x55b95fd2d120 2023-07-21T22:21:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.314+0000 7f116539a700 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b95fd2d120 0x55b95fd2f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.314+0000 7f116539a700 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b95fd2d120 0x55b95fd2f530 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3be0f889ee37369c server_cookie=439280988028817e in_seq=0 out_seq=0 2023-07-21T22:21:39.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.314+0000 7f11497fa700 10 client.16023 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f11497fa700 1 -- 172.21.15.151:0/1086282235 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b95fc55e50 con 0x55b95fd2d120 2023-07-21T22:21:39.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f11497fa700 10 client.16023 handle_command_reply: tid=0 2023-07-21T22:21:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f117b765b80 1 client.16023 shutdown 2023-07-21T22:21:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f117b765b80 1 -- 172.21.15.151:0/1086282235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fb676b0 msgr2=0x55b95fd1fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f117b765b80 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fb676b0 0x55b95fd1fec0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f115c097b70 tx=0x7f115c015b70 comp rx=0 tx=0).stop 2023-07-21T22:21:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f117b765b80 1 -- 172.21.15.151:0/1086282235 shutdown_connections 2023-07-21T22:21:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f117b765b80 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b95fd2d120 0x55b95fd2f530 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f117b765b80 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 0x55b95fd1d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f11497fa700 0 client.16023 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:39.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f117b765b80 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fb676b0 0x55b95fd1fec0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f117b765b80 1 --2- 172.21.15.151:0/1086282235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd13df0 0x55b95fd1d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.315+0000 7f117b765b80 1 -- 172.21.15.151:0/1086282235 >> 172.21.15.151:0/1086282235 conn(0x55b95fd00c40 msgr2=0x55b95fd05540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.316+0000 7f117b765b80 1 -- 172.21.15.151:0/1086282235 shutdown_connections 2023-07-21T22:21:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.316+0000 7f117b765b80 1 -- 172.21.15.151:0/1086282235 wait complete. 2023-07-21T22:21:39.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.316+0000 7f117b765b80 20 client.16023 trim_cache size 0 max 16384 2023-07-21T22:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.337+0000 7f117b765b80 1 Processor -- start 2023-07-21T22:21:39.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f117b765b80 1 -- start start 2023-07-21T22:21:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f117b765b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fb676b0 0x55b95fd245d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f117b765b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd05cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f117b765b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 0x55b95fd1f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f117b765b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fd29e70 con 0x55b95fd13df0 2023-07-21T22:21:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f117b765b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fd14810 con 0x55b95fd19c90 2023-07-21T22:21:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f117b765b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fd076d0 con 0x55b95fb676b0 2023-07-21T22:21:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f1165b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fb676b0 0x55b95fd245d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f116639c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 0x55b95fd1f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f1165b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fb676b0 0x55b95fd245d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51650/0 (socket says 172.21.15.151:51650) 2023-07-21T22:21:39.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f1165b9b700 1 -- 172.21.15.151:0/749571892 learned_addr learned my addr 172.21.15.151:0/749571892 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.338+0000 7f116539a700 1 --2- 172.21.15.151:0/749571892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd05cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f1165b9b700 1 -- 172.21.15.151:0/749571892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 msgr2=0x55b95fd1f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f1165b9b700 1 --2- 172.21.15.151:0/749571892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 0x55b95fd1f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f1165b9b700 1 -- 172.21.15.151:0/749571892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 msgr2=0x55b95fd05cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f1165b9b700 1 --2- 172.21.15.151:0/749571892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd05cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f1165b9b700 1 -- 172.21.15.151:0/749571892 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b95fab11f0 con 0x55b95fb676b0 2023-07-21T22:21:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f116539a700 1 --2- 172.21.15.151:0/749571892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd05cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:21:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f1165b9b700 1 --2- 172.21.15.151:0/749571892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fb676b0 0x55b95fd245d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f115c09b090 tx=0x7f115c00bfd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2439b85c0208910 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f1154bff700 1 -- 172.21.15.151:0/749571892 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0b7070 con 0x55b95fb676b0 2023-07-21T22:21:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f1154bff700 1 -- 172.21.15.151:0/749571892 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f115c09a8a0 con 0x55b95fb676b0 2023-07-21T22:21:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.339+0000 7f1154bff700 1 -- 172.21.15.151:0/749571892 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c09f130 con 0x55b95fb676b0 2023-07-21T22:21:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.340+0000 7f117b765b80 1 -- 172.21.15.151:0/749571892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fb676b0 msgr2=0x55b95fd245d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.340+0000 7f117b765b80 1 --2- 172.21.15.151:0/749571892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fb676b0 0x55b95fd245d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f115c09b090 tx=0x7f115c00bfd0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.340+0000 7f117b765b80 1 -- 172.21.15.151:0/749571892 shutdown_connections 2023-07-21T22:21:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.340+0000 7f117b765b80 1 --2- 172.21.15.151:0/749571892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fd19c90 0x55b95fd1f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.340+0000 7f117b765b80 1 --2- 172.21.15.151:0/749571892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fb676b0 0x55b95fd245d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.340+0000 7f117b765b80 1 --2- 172.21.15.151:0/749571892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd05cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.340+0000 7f117b765b80 1 -- 172.21.15.151:0/749571892 >> 172.21.15.151:0/749571892 conn(0x55b95fd00c40 msgr2=0x55b95fd1ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.340+0000 7f117b765b80 1 -- 172.21.15.151:0/749571892 shutdown_connections 2023-07-21T22:21:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.340+0000 7f117b765b80 1 -- 172.21.15.151:0/749571892 wait complete. 2023-07-21T22:21:39.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.341+0000 7f117b765b80 1 -- start start 2023-07-21T22:21:39.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.341+0000 7f117b765b80 1 Processor -- start 2023-07-21T22:21:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f117b765b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd21fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f117b765b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd22510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f117b765b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 0x55b95fd7ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f117b765b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fd22dd0 con 0x55b95fd13df0 2023-07-21T22:21:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f117b765b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fd804e0 con 0x55b95fb676b0 2023-07-21T22:21:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f117b765b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b95fd80620 con 0x55b95fd19c90 2023-07-21T22:21:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f117b765b80 10 client.0 _ll_register_callbacks cb 0x7f115c09aed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f1165b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd21fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f1165b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd21fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45750/0 (socket says 172.21.15.151:45750) 2023-07-21T22:21:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f1165b9b700 1 -- 172.21.15.151:0/970211652 learned_addr learned my addr 172.21.15.151:0/970211652 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:39.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f116539a700 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd22510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.342+0000 7f116639c700 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 0x55b95fd7ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f1165b9b700 1 -- 172.21.15.151:0/970211652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 msgr2=0x55b95fd7ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f1165b9b700 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 0x55b95fd7ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f1165b9b700 1 -- 172.21.15.151:0/970211652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 msgr2=0x55b95fd22510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f1165b9b700 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd22510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f1165b9b700 1 -- 172.21.15.151:0/970211652 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b95fa73c00 con 0x55b95fb676b0 2023-07-21T22:21:39.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f1165b9b700 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd21fd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f115c0996f0 tx=0x7f115c09b210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64e485bc1a7f8c14 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f11497fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f11497fa700 1 -- 172.21.15.151:0/970211652 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c0c9070 con 0x55b95fb676b0 2023-07-21T22:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f11497fa700 1 -- 172.21.15.151:0/970211652 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f115c0cbe40 con 0x55b95fb676b0 2023-07-21T22:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f117b765b80 1 -- 172.21.15.151:0/970211652 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b95fc17ff0 con 0x55b95fb676b0 2023-07-21T22:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f11497fa700 1 -- 172.21.15.151:0/970211652 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f115c0b7070 con 0x55b95fb676b0 2023-07-21T22:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f117b765b80 10 client.25781 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.343+0000 7f117b765b80 1 -- 172.21.15.151:0/970211652 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b95fa89250 con 0x55b95fb676b0 2023-07-21T22:21:39.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.344+0000 7f11497fa700 1 -- 172.21.15.151:0/970211652 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f115c07c030 con 0x55b95fb676b0 2023-07-21T22:21:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.344+0000 7f11497fa700 1 -- 172.21.15.151:0/970211652 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f115c0a3030 con 0x55b95fb676b0 2023-07-21T22:21:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.344+0000 7f117b765b80 10 client.25781 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.344+0000 7f117b765b80 10 client.25781 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.344+0000 7f117b765b80 20 client.25781 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.344+0000 7f117b765b80 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b95fd817f0 0x55b95fd83bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.344+0000 7f117b765b80 4 client.25781 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:21:39.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.344+0000 7f117b765b80 1 -- 172.21.15.151:0/970211652 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b95faabf10 con 0x55b95fd817f0 2023-07-21T22:21:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.344+0000 7f116539a700 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b95fd817f0 0x55b95fd83bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.345+0000 7f116539a700 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b95fd817f0 0x55b95fd83bd0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fc6f5d79f5211b1 server_cookie=717281d6638f9f4 in_seq=0 out_seq=0 2023-07-21T22:21:39.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.345+0000 7f11497fa700 10 client.25781 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:39.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.362+0000 7f11497fa700 1 -- 172.21.15.151:0/970211652 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b95faabf10 con 0x55b95fd817f0 2023-07-21T22:21:39.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.362+0000 7f11497fa700 10 client.25781 handle_command_reply: tid=0 2023-07-21T22:21:39.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.362+0000 7f117b765b80 1 client.25781 shutdown 2023-07-21T22:21:39.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 -- 172.21.15.151:0/970211652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 msgr2=0x55b95fd21fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd21fd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f115c0996f0 tx=0x7f115c09b210 comp rx=0 tx=0).stop 2023-07-21T22:21:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 -- 172.21.15.151:0/970211652 shutdown_connections 2023-07-21T22:21:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b95fd817f0 0x55b95fd83bd0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b95fb676b0 0x55b95fd21fd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b95fd19c90 0x55b95fd7ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 --2- 172.21.15.151:0/970211652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b95fd13df0 0x55b95fd22510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f11497fa700 0 client.25781 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 -- 172.21.15.151:0/970211652 >> 172.21.15.151:0/970211652 conn(0x55b95fd00c40 msgr2=0x55b95fd0a090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 -- 172.21.15.151:0/970211652 shutdown_connections 2023-07-21T22:21:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 1 -- 172.21.15.151:0/970211652 wait complete. 2023-07-21T22:21:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.363+0000 7f117b765b80 20 client.25781 trim_cache size 0 max 16384 2023-07-21T22:21:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:21:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:21:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:21:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:21:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 -- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f114c0a1340 msgr2=0x7f114c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f114c0a1340 0x7f114c0a37f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1158022000 tx=0x7f115801f000 comp rx=0 tx=0).stop 2023-07-21T22:21:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 -- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1160068070 msgr2=0x7f11600fea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1160068070 0x7f11600fea60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f115c0098e0 tx=0x7f115c004730 comp rx=0 tx=0).stop 2023-07-21T22:21:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 -- 172.21.15.151:0/2027152749 shutdown_connections 2023-07-21T22:21:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f114c0a1340 0x7f114c0a37f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11601062b0 0x7f11601a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1160068070 0x7f11600fea60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 --2- 172.21.15.151:0/2027152749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11601059a0 0x7f11600fefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 -- 172.21.15.151:0/2027152749 >> 172.21.15.151:0/2027152749 conn(0x7f1160074770 msgr2=0x7f11600fcfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 -- 172.21.15.151:0/2027152749 shutdown_connections 2023-07-21T22:21:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:39.364+0000 7f1166b9d700 1 -- 172.21.15.151:0/2027152749 wait complete. 2023-07-21T22:21:39.439 INFO:teuthology.orchestra.run.smithi151.stderr:8100000 of 50000000 tuples (16%) done (elapsed 122.93 s, remaining 635.90 s) 2023-07-21T22:21:40.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:40 smithi151 ceph-mon[95510]: pgmap v77: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-07-21T22:21:40.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:40 smithi187 ceph-mon[96918]: pgmap v77: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-07-21T22:21:40.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:40 smithi195 ceph-mon[97365]: pgmap v77: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-07-21T22:21:41.062 INFO:teuthology.orchestra.run.smithi151.stderr:8200000 of 50000000 tuples (16%) done (elapsed 124.55 s, remaining 634.92 s) 2023-07-21T22:21:42.641 INFO:teuthology.orchestra.run.smithi151.stderr:8300000 of 50000000 tuples (16%) done (elapsed 126.13 s, remaining 633.71 s) 2023-07-21T22:21:42.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:42 smithi151 ceph-mon[95510]: pgmap v78: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-07-21T22:21:42.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:42 smithi187 ceph-mon[96918]: pgmap v78: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-07-21T22:21:42.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:42 smithi195 ceph-mon[97365]: pgmap v78: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 25 MiB/s wr, 21 op/s 2023-07-21T22:21:43.880 INFO:teuthology.orchestra.run.smithi151.stderr:8400000 of 50000000 tuples (16%) done (elapsed 127.37 s, remaining 630.80 s) 2023-07-21T22:21:44.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:44 smithi151 ceph-mon[95510]: pgmap v79: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 37 op/s 2023-07-21T22:21:44.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:44 smithi187 ceph-mon[96918]: pgmap v79: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 37 op/s 2023-07-21T22:21:44.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:44 smithi195 ceph-mon[97365]: pgmap v79: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 38 MiB/s wr, 37 op/s 2023-07-21T22:21:45.581 INFO:teuthology.orchestra.run.smithi151.stderr:8500000 of 50000000 tuples (17%) done (elapsed 129.07 s, remaining 630.18 s) 2023-07-21T22:21:46.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:46 smithi151 ceph-mon[95510]: pgmap v80: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-07-21T22:21:46.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:46 smithi187 ceph-mon[96918]: pgmap v80: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-07-21T22:21:46.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:46 smithi195 ceph-mon[97365]: pgmap v80: 97 pgs: 97 active+clean; 1.9 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 25 MiB/s wr, 28 op/s 2023-07-21T22:21:47.282 INFO:teuthology.orchestra.run.smithi151.stderr:8600000 of 50000000 tuples (17%) done (elapsed 130.77 s, remaining 629.54 s) 2023-07-21T22:21:48.532 INFO:teuthology.orchestra.run.smithi151.stderr:8700000 of 50000000 tuples (17%) done (elapsed 132.02 s, remaining 626.74 s) 2023-07-21T22:21:48.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:48 smithi151 ceph-mon[95510]: pgmap v81: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-07-21T22:21:48.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:48 smithi187 ceph-mon[96918]: pgmap v81: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-07-21T22:21:48.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:48 smithi195 ceph-mon[97365]: pgmap v81: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 38 MiB/s wr, 38 op/s 2023-07-21T22:21:50.188 INFO:teuthology.orchestra.run.smithi151.stderr:8800000 of 50000000 tuples (17%) done (elapsed 133.68 s, remaining 625.87 s) 2023-07-21T22:21:50.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:50 smithi151 ceph-mon[95510]: pgmap v82: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:21:50.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:50 smithi187 ceph-mon[96918]: pgmap v82: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:21:50.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:50 smithi195 ceph-mon[97365]: pgmap v82: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:21:51.863 INFO:teuthology.orchestra.run.smithi151.stderr:8900000 of 50000000 tuples (17%) done (elapsed 135.36 s, remaining 625.07 s) 2023-07-21T22:21:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.534+0000 7f04eb59e700 1 -- 172.21.15.151:0/1391296503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ec073160 msgr2=0x7f04ec10bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.534+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1391296503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ec073160 0x7f04ec10bcb0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f04e00098f0 tx=0x7f04e0009c00 comp rx=0 tx=0).stop 2023-07-21T22:21:52.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.534+0000 7f04eb59e700 1 -- 172.21.15.151:0/1391296503 shutdown_connections 2023-07-21T22:21:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.534+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1391296503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec072850 0x7f04ec072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.534+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1391296503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04ec10c1f0 0x7f04ec10e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.534+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1391296503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ec073160 0x7f04ec10bcb0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.534+0000 7f04eb59e700 1 -- 172.21.15.151:0/1391296503 >> 172.21.15.151:0/1391296503 conn(0x7f04ec0fb470 msgr2=0x7f04ec0fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.534+0000 7f04eb59e700 1 -- 172.21.15.151:0/1391296503 shutdown_connections 2023-07-21T22:21:52.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.534+0000 7f04eb59e700 1 -- 172.21.15.151:0/1391296503 wait complete. 2023-07-21T22:21:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.535+0000 7f04eb59e700 1 Processor -- start 2023-07-21T22:21:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.535+0000 7f04eb59e700 1 -- start start 2023-07-21T22:21:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04eb59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec072850 0x7f04ec19da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04eb59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04ec073160 0x7f04ec19df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04eb59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ec10c1f0 0x7f04ec197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04eb59e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec1980e0 con 0x7f04ec10c1f0 2023-07-21T22:21:52.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04eb59e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec198250 con 0x7f04ec072850 2023-07-21T22:21:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04eb59e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04ec198410 con 0x7f04ec073160 2023-07-21T22:21:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04ea59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec072850 0x7f04ec19da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04ea59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec072850 0x7f04ec19da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44536/0 (socket says 172.21.15.151:44536) 2023-07-21T22:21:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04ea59c700 1 -- 172.21.15.151:0/1851312993 learned_addr learned my addr 172.21.15.151:0/1851312993 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04ead9d700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ec10c1f0 0x7f04ec197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04ec073160 0x7f04ec19df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04ea59c700 1 -- 172.21.15.151:0/1851312993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04ec073160 msgr2=0x7f04ec19df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04ea59c700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04ec073160 0x7f04ec19df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04ea59c700 1 -- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ec10c1f0 msgr2=0x7f04ec197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04ea59c700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ec10c1f0 0x7f04ec197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.536+0000 7f04ea59c700 1 -- 172.21.15.151:0/1851312993 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e0009520 con 0x7f04ec072850 2023-07-21T22:21:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.537+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04ec073160 0x7f04ec19df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.537+0000 7f04ea59c700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec072850 0x7f04ec19da00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00e9c0 tx=0x7f04dc00ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.537+0000 7f04db7fe700 1 -- 172.21.15.151:0/1851312993 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc004a30 con 0x7f04ec072850 2023-07-21T22:21:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.537+0000 7f04eb59e700 1 -- 172.21.15.151:0/1851312993 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04ec1986f0 con 0x7f04ec072850 2023-07-21T22:21:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.537+0000 7f04db7fe700 1 -- 172.21.15.151:0/1851312993 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04dc00cc50 con 0x7f04ec072850 2023-07-21T22:21:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.537+0000 7f04db7fe700 1 -- 172.21.15.151:0/1851312993 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc005410 con 0x7f04ec072850 2023-07-21T22:21:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.537+0000 7f04eb59e700 1 -- 172.21.15.151:0/1851312993 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ec1a49f0 con 0x7f04ec072850 2023-07-21T22:21:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.541+0000 7f04db7fe700 1 -- 172.21.15.151:0/1851312993 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f04dc005570 con 0x7f04ec072850 2023-07-21T22:21:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.542+0000 7f05045e2b80 1 Processor -- start 2023-07-21T22:21:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f05045e2b80 1 -- start start 2023-07-21T22:21:52.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f04db7fe700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04d40a12c0 0x7f04d40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f04db7fe700 1 -- 172.21.15.151:0/1851312993 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f04dc014070 con 0x7f04ec072850 2023-07-21T22:21:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 0x55b70c1d9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1da480 0x55b70c1d40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f05045e2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c0d9c50 con 0x55b70c0306b0 2023-07-21T22:21:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f05045e2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c12c9e0 con 0x55b70c1d45e0 2023-07-21T22:21:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f05045e2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c125e70 con 0x55b70c1da480 2023-07-21T22:21:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f04ead9d700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04d40a12c0 0x7f04d40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f04e9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1da480 0x55b70c1d40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f04e9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1da480 0x55b70c1d40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:40784/0 (socket says 172.21.15.151:40784) 2023-07-21T22:21:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f04e9d9b700 1 -- 172.21.15.151:0/1481730350 learned_addr learned my addr 172.21.15.151:0/1481730350 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.543+0000 7f04ead9d700 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.544+0000 7f04ea59c700 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 0x55b70c1d9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.544+0000 7f04e9d9b700 1 -- 172.21.15.151:0/1481730350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 msgr2=0x55b70c1d4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.544+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.544+0000 7f04e9d9b700 1 -- 172.21.15.151:0/1481730350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 msgr2=0x55b70c1d9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.544+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 0x55b70c1d9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.544+0000 7f04e9d9b700 1 -- 172.21.15.151:0/1481730350 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b70bf53d80 con 0x55b70c1da480 2023-07-21T22:21:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.544+0000 7f04ead9d700 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:21:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.544+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1da480 0x55b70c1d40a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04e0000c00 tx=0x7f04e0005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a3c529a53b60142 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.544+0000 7f04ead9d700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04d40a12c0 0x7f04d40a3770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009ec0 tx=0x7f04e4009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.545+0000 7f04d8ff9700 1 -- 172.21.15.151:0/1481730350 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e001c050 con 0x55b70c1da480 2023-07-21T22:21:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.545+0000 7f04d8ff9700 1 -- 172.21.15.151:0/1481730350 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04e001d040 con 0x55b70c1da480 2023-07-21T22:21:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.545+0000 7f04d8ff9700 1 -- 172.21.15.151:0/1481730350 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e00052a0 con 0x55b70c1da480 2023-07-21T22:21:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.545+0000 7f05045e2b80 1 -- 172.21.15.151:0/1481730350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1da480 msgr2=0x55b70c1d40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.545+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1da480 0x55b70c1d40a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04e0000c00 tx=0x7f04e0005dc0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.546+0000 7f05045e2b80 1 -- 172.21.15.151:0/1481730350 shutdown_connections 2023-07-21T22:21:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.546+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.546+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 0x55b70c1d9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.546+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1481730350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1da480 0x55b70c1d40a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.546+0000 7f05045e2b80 1 -- 172.21.15.151:0/1481730350 >> 172.21.15.151:0/1481730350 conn(0x55b70c1c9c40 msgr2=0x55b70c1cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.546+0000 7f05045e2b80 1 -- 172.21.15.151:0/1481730350 shutdown_connections 2023-07-21T22:21:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.546+0000 7f05045e2b80 1 -- 172.21.15.151:0/1481730350 wait complete. 2023-07-21T22:21:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.546+0000 7f05045e2b80 1 -- start start 2023-07-21T22:21:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.546+0000 7f05045e2b80 1 Processor -- start 2023-07-21T22:21:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e0680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1d45e0 0x55b70c1dd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 0x55b70c1ddec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f05045e2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c0c5a60 con 0x55b70c1d45e0 2023-07-21T22:21:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f05045e2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c0c5760 con 0x55b70c1da480 2023-07-21T22:21:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f05045e2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70bfa98c0 con 0x55b70c0306b0 2023-07-21T22:21:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f05045e2b80 10 client.0 _ll_register_callbacks cb 0x55b70c0c3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f04ea59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f04ea59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:40786/0 (socket says 172.21.15.151:40786) 2023-07-21T22:21:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f04ea59c700 1 -- 172.21.15.151:0/394770896 learned_addr learned my addr 172.21.15.151:0/394770896 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1d45e0 0x55b70c1dd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.547+0000 7f04ead9d700 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 0x55b70c1ddec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04ea59c700 1 -- 172.21.15.151:0/394770896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 msgr2=0x55b70c1ddec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04ea59c700 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 0x55b70c1ddec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04ea59c700 1 -- 172.21.15.151:0/394770896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1d45e0 msgr2=0x55b70c1dd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04ea59c700 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1d45e0 0x55b70c1dd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04ea59c700 1 -- 172.21.15.151:0/394770896 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04ec10f210 con 0x55b70c0306b0 2023-07-21T22:21:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04ea59c700 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e0680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0ca5d0 tx=0x7f04dc00cf00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=441b39329e24ac8e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:21:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04d1ffb700 1 -- 172.21.15.151:0/394770896 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc09a350 con 0x55b70c0306b0 2023-07-21T22:21:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04d1ffb700 1 -- 172.21.15.151:0/394770896 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f04dc09df20 con 0x55b70c0306b0 2023-07-21T22:21:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f05045e2b80 1 -- 172.21.15.151:0/394770896 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b70c07f490 con 0x55b70c0306b0 2023-07-21T22:21:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f04d1ffb700 1 -- 172.21.15.151:0/394770896 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04dc004da0 con 0x55b70c0306b0 2023-07-21T22:21:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f05045e2b80 10 client.25825 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.548+0000 7f05045e2b80 1 -- 172.21.15.151:0/394770896 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b70bf3cc00 con 0x55b70c0306b0 2023-07-21T22:21:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.549+0000 7f04d1ffb700 1 -- 172.21.15.151:0/394770896 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b70c07f490 con 0x55b70c0306b0 2023-07-21T22:21:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.549+0000 7f04d1ffb700 1 -- 172.21.15.151:0/394770896 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f04dc0993e0 con 0x55b70c0306b0 2023-07-21T22:21:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.549+0000 7f05045e2b80 10 client.25825 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.549+0000 7f05045e2b80 10 client.25825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.549+0000 7f05045e2b80 20 client.25825 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.549+0000 7f05045e2b80 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b70c1edbe0 0x55b70c1efff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.549+0000 7f05045e2b80 4 client.25825 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:21:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.549+0000 7f05045e2b80 1 -- 172.21.15.151:0/394770896 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b70c11ee50 con 0x55b70c1edbe0 2023-07-21T22:21:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.549+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b70c1edbe0 0x55b70c1efff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.550+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b70c1edbe0 0x55b70c1efff0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86b2cffbf020688e server_cookie=4462b430c6be3443 in_seq=0 out_seq=0 2023-07-21T22:21:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.550+0000 7f04d1ffb700 10 client.25825 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f04d1ffb700 1 -- 172.21.15.151:0/394770896 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b70c11ee50 con 0x55b70c1edbe0 2023-07-21T22:21:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f04d1ffb700 10 client.25825 handle_command_reply: tid=0 2023-07-21T22:21:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 client.25825 shutdown 2023-07-21T22:21:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 -- 172.21.15.151:0/394770896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 msgr2=0x55b70c1e0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e0680 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f04dc0ca5d0 tx=0x7f04dc00cf00 comp rx=0 tx=0).stop 2023-07-21T22:21:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 -- 172.21.15.151:0/394770896 shutdown_connections 2023-07-21T22:21:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b70c1edbe0 0x55b70c1efff0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 0x55b70c1ddec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f04d1ffb700 0 client.25825 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e0680 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 --2- 172.21.15.151:0/394770896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1d45e0 0x55b70c1dd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 -- 172.21.15.151:0/394770896 >> 172.21.15.151:0/394770896 conn(0x55b70c1c9c40 msgr2=0x55b70c1cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 -- 172.21.15.151:0/394770896 shutdown_connections 2023-07-21T22:21:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 1 -- 172.21.15.151:0/394770896 wait complete. 2023-07-21T22:21:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.551+0000 7f05045e2b80 20 client.25825 trim_cache size 0 max 16384 2023-07-21T22:21:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.568+0000 7f05045e2b80 1 Processor -- start 2023-07-21T22:21:52.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.568+0000 7f05045e2b80 1 -- start start 2023-07-21T22:21:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.568+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 0x55b70c1d40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.568+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1d45e0 0x55b70c1cf4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.568+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 0x55b70c1e4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.568+0000 7f05045e2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c1d8430 con 0x55b70c0306b0 2023-07-21T22:21:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.568+0000 7f05045e2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c1da280 con 0x55b70c1da480 2023-07-21T22:21:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.568+0000 7f05045e2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c1eb290 con 0x55b70c1d45e0 2023-07-21T22:21:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04ead9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 0x55b70c1e4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04e9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1d45e0 0x55b70c1cf4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04ea59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 0x55b70c1d40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04ead9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 0x55b70c1e4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44562/0 (socket says 172.21.15.151:44562) 2023-07-21T22:21:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04ead9d700 1 -- 172.21.15.151:0/3241086978 learned_addr learned my addr 172.21.15.151:0/3241086978 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:52.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04e9d9b700 1 -- 172.21.15.151:0/3241086978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 msgr2=0x55b70c1e4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:52.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/3241086978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 0x55b70c1e4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04e9d9b700 1 -- 172.21.15.151:0/3241086978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 msgr2=0x55b70c1d40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:52.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/3241086978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 0x55b70c1d40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04e9d9b700 1 -- 172.21.15.151:0/3241086978 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b70c1f4c20 con 0x55b70c1d45e0 2023-07-21T22:21:52.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/3241086978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1d45e0 0x55b70c1cf4b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04e00098c0 tx=0x7f04e0005c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eeb905262f21b5fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.569+0000 7f04d97fa700 1 -- 172.21.15.151:0/3241086978 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e001c040 con 0x55b70c1d45e0 2023-07-21T22:21:52.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f04d97fa700 1 -- 172.21.15.151:0/3241086978 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04e0005920 con 0x55b70c1d45e0 2023-07-21T22:21:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f04d97fa700 1 -- 172.21.15.151:0/3241086978 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04e0005560 con 0x55b70c1d45e0 2023-07-21T22:21:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f05045e2b80 1 -- 172.21.15.151:0/3241086978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1d45e0 msgr2=0x55b70c1cf4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f05045e2b80 1 --2- 172.21.15.151:0/3241086978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1d45e0 0x55b70c1cf4b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04e00098c0 tx=0x7f04e0005c10 comp rx=0 tx=0).stop 2023-07-21T22:21:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f05045e2b80 1 -- 172.21.15.151:0/3241086978 shutdown_connections 2023-07-21T22:21:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f05045e2b80 1 --2- 172.21.15.151:0/3241086978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1da480 0x55b70c1e4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f05045e2b80 1 --2- 172.21.15.151:0/3241086978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c0306b0 0x55b70c1d40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f05045e2b80 1 --2- 172.21.15.151:0/3241086978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c1d45e0 0x55b70c1cf4b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f05045e2b80 1 -- 172.21.15.151:0/3241086978 >> 172.21.15.151:0/3241086978 conn(0x55b70c1c9c40 msgr2=0x55b70c1cdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f05045e2b80 1 -- 172.21.15.151:0/3241086978 shutdown_connections 2023-07-21T22:21:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.570+0000 7f05045e2b80 1 -- 172.21.15.151:0/3241086978 wait complete. 2023-07-21T22:21:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.571+0000 7f05045e2b80 1 -- start start 2023-07-21T22:21:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.571+0000 7f05045e2b80 1 Processor -- start 2023-07-21T22:21:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f05045e2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1da480 0x55b70c1d5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f05045e2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c1d6460 con 0x55b70c1da480 2023-07-21T22:21:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f05045e2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c1d65d0 con 0x55b70c1d45e0 2023-07-21T22:21:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f05045e2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b70c1d6790 con 0x55b70c0306b0 2023-07-21T22:21:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f05045e2b80 10 client.0 _ll_register_callbacks cb 0x55b70c0c3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:21:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04ea59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04e9d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04ea59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e4dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:40804/0 (socket says 172.21.15.151:40804) 2023-07-21T22:21:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04ea59c700 1 -- 172.21.15.151:0/1615434744 learned_addr learned my addr 172.21.15.151:0/1615434744 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:21:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04ead9d700 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1da480 0x55b70c1d5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04ea59c700 1 -- 172.21.15.151:0/1615434744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 msgr2=0x55b70c1d5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04ea59c700 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04ea59c700 1 -- 172.21.15.151:0/1615434744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1da480 msgr2=0x55b70c1d5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:21:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04ea59c700 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1da480 0x55b70c1d5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04ea59c700 1 -- 172.21.15.151:0/1615434744 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b70bf53d80 con 0x55b70c0306b0 2023-07-21T22:21:52.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.572+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:21:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f04ea59c700 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e4dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f04dc096960 tx=0x7f04dc005c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b9cb8028d80847 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:21:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f04d1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:21:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f04d1ffb700 1 -- 172.21.15.151:0/1615434744 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04dc0ca3a0 con 0x55b70c0306b0 2023-07-21T22:21:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f04d1ffb700 1 -- 172.21.15.151:0/1615434744 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f04dc09df20 con 0x55b70c0306b0 2023-07-21T22:21:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f05045e2b80 1 -- 172.21.15.151:0/1615434744 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04e001d040 con 0x55b70c0306b0 2023-07-21T22:21:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f04d1ffb700 1 -- 172.21.15.151:0/1615434744 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04dc004da0 con 0x55b70c0306b0 2023-07-21T22:21:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f05045e2b80 10 client.25831 fetch_fsmap learned FSMap version 27 2023-07-21T22:21:52.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f05045e2b80 1 -- 172.21.15.151:0/1615434744 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x55b70bf7a1f0 con 0x55b70c0306b0 2023-07-21T22:21:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f04d1ffb700 1 -- 172.21.15.151:0/1615434744 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04e001d040 con 0x55b70c0306b0 2023-07-21T22:21:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.573+0000 7f04d1ffb700 1 -- 172.21.15.151:0/1615434744 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f04dc09a150 con 0x55b70c0306b0 2023-07-21T22:21:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.574+0000 7f05045e2b80 10 client.25831 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:21:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.574+0000 7f05045e2b80 10 client.25831 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:21:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.574+0000 7f05045e2b80 20 client.25831 populate_metadata read hostname 'smithi151' 2023-07-21T22:21:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.574+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b70c242bc0 0x55b70c244fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:21:52.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.574+0000 7f05045e2b80 4 client.25831 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:21:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.574+0000 7f05045e2b80 1 -- 172.21.15.151:0/1615434744 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b70c0e0ff0 con 0x55b70c242bc0 2023-07-21T22:21:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.574+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b70c242bc0 0x55b70c244fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:21:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.574+0000 7f04d1ffb700 10 client.25831 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:52.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.574+0000 7f04e9d9b700 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b70c242bc0 0x55b70c244fd0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=243d56d15d28b3e2 server_cookie=7c8255672f626e61 in_seq=0 out_seq=0 2023-07-21T22:21:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.594+0000 7f04d1ffb700 1 -- 172.21.15.151:0/1615434744 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b70c0e0ff0 con 0x55b70c242bc0 2023-07-21T22:21:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.594+0000 7f04d1ffb700 10 client.25831 handle_command_reply: tid=0 2023-07-21T22:21:52.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.594+0000 7f05045e2b80 1 client.25831 shutdown 2023-07-21T22:21:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 -- 172.21.15.151:0/1615434744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 msgr2=0x55b70c1e4dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:52.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e4dd0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f04dc096960 tx=0x7f04dc005c70 comp rx=0 tx=0).stop 2023-07-21T22:21:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 -- 172.21.15.151:0/1615434744 shutdown_connections 2023-07-21T22:21:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b70c242bc0 0x55b70c244fd0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b70c1da480 0x55b70c1d5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b70c0306b0 0x55b70c1e4dd0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f04d1ffb700 0 client.25831 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:21:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 --2- 172.21.15.151:0/1615434744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b70c1d45e0 0x55b70c1d5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 -- 172.21.15.151:0/1615434744 >> 172.21.15.151:0/1615434744 conn(0x55b70c1c9c40 msgr2=0x55b70c1dc940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 -- 172.21.15.151:0/1615434744 shutdown_connections 2023-07-21T22:21:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 1 -- 172.21.15.151:0/1615434744 wait complete. 2023-07-21T22:21:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.595+0000 7f05045e2b80 20 client.25831 trim_cache size 0 max 16384 2023-07-21T22:21:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:21:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:21:52.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:21:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:21:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 -- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04d40a12c0 msgr2=0x7f04d40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04d40a12c0 0x7f04d40a3770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f04e4009ec0 tx=0x7f04e4009920 comp rx=0 tx=0).stop 2023-07-21T22:21:52.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 -- 172.21.15.151:0/1851312993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec072850 msgr2=0x7f04ec19da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:21:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec072850 0x7f04ec19da00 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f04dc00e9c0 tx=0x7f04dc00ecd0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 -- 172.21.15.151:0/1851312993 shutdown_connections 2023-07-21T22:21:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04d40a12c0 0x7f04d40a3770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04ec072850 0x7f04ec19da00 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04ec10c1f0 0x7f04ec197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 --2- 172.21.15.151:0/1851312993 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04ec073160 0x7f04ec19df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:21:52.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 -- 172.21.15.151:0/1851312993 >> 172.21.15.151:0/1851312993 conn(0x7f04ec0fb470 msgr2=0x7f04ec10e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:21:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 -- 172.21.15.151:0/1851312993 shutdown_connections 2023-07-21T22:21:52.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:21:52.596+0000 7f04eb59e700 1 -- 172.21.15.151:0/1851312993 wait complete. 2023-07-21T22:21:52.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:52 smithi151 ceph-mon[95510]: pgmap v83: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:21:52.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:52 smithi187 ceph-mon[96918]: pgmap v83: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:21:52.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:52 smithi195 ceph-mon[97365]: pgmap v83: 97 pgs: 97 active+clean; 2.0 GiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 25 MiB/s wr, 26 op/s 2023-07-21T22:21:53.041 INFO:teuthology.orchestra.run.smithi151.stderr:9000000 of 50000000 tuples (18%) done (elapsed 136.53 s, remaining 621.99 s) 2023-07-21T22:21:54.663 INFO:teuthology.orchestra.run.smithi151.stderr:9100000 of 50000000 tuples (18%) done (elapsed 138.16 s, remaining 620.94 s) 2023-07-21T22:21:54.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:54 smithi151 ceph-mon[95510]: pgmap v84: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-07-21T22:21:54.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:54 smithi187 ceph-mon[96918]: pgmap v84: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-07-21T22:21:54.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:54 smithi195 ceph-mon[97365]: pgmap v84: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 38 MiB/s wr, 36 op/s 2023-07-21T22:21:55.924 INFO:teuthology.orchestra.run.smithi151.stderr:9200000 of 50000000 tuples (18%) done (elapsed 139.42 s, remaining 618.28 s) 2023-07-21T22:21:56.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:56 smithi187 ceph-mon[96918]: pgmap v85: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-21T22:21:56.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:56 smithi195 ceph-mon[97365]: pgmap v85: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-21T22:21:56.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:56 smithi151 ceph-mon[95510]: pgmap v85: 97 pgs: 97 active+clean; 2.1 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-21T22:21:57.610 INFO:teuthology.orchestra.run.smithi151.stderr:9300000 of 50000000 tuples (18%) done (elapsed 141.10 s, remaining 617.51 s) 2023-07-21T22:21:58.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:21:58 smithi187 ceph-mon[96918]: pgmap v86: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-07-21T22:21:58.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:21:58 smithi195 ceph-mon[97365]: pgmap v86: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-07-21T22:21:58.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:21:58 smithi151 ceph-mon[95510]: pgmap v86: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 38 MiB/s wr, 35 op/s 2023-07-21T22:21:59.258 INFO:teuthology.orchestra.run.smithi151.stderr:9400000 of 50000000 tuples (18%) done (elapsed 142.75 s, remaining 616.56 s) 2023-07-21T22:22:00.523 INFO:teuthology.orchestra.run.smithi151.stderr:9500000 of 50000000 tuples (19%) done (elapsed 144.02 s, remaining 613.96 s) 2023-07-21T22:22:00.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:00 smithi187 ceph-mon[96918]: pgmap v87: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-07-21T22:22:00.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:00 smithi195 ceph-mon[97365]: pgmap v87: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-07-21T22:22:00.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:00 smithi151 ceph-mon[95510]: pgmap v87: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-07-21T22:22:02.201 INFO:teuthology.orchestra.run.smithi151.stderr:9600000 of 50000000 tuples (19%) done (elapsed 145.69 s, remaining 613.13 s) 2023-07-21T22:22:02.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:02 smithi187 ceph-mon[96918]: pgmap v88: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-07-21T22:22:02.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:02 smithi195 ceph-mon[97365]: pgmap v88: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-07-21T22:22:02.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:02 smithi151 ceph-mon[95510]: pgmap v88: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-07-21T22:22:03.878 INFO:teuthology.orchestra.run.smithi151.stderr:9700000 of 50000000 tuples (19%) done (elapsed 147.37 s, remaining 612.27 s) 2023-07-21T22:22:04.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:04 smithi187 ceph-mon[96918]: pgmap v89: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 46 op/s 2023-07-21T22:22:04.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:04 smithi195 ceph-mon[97365]: pgmap v89: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 46 op/s 2023-07-21T22:22:04.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:04 smithi151 ceph-mon[95510]: pgmap v89: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 38 MiB/s wr, 46 op/s 2023-07-21T22:22:05.589 INFO:teuthology.orchestra.run.smithi151.stderr:9800000 of 50000000 tuples (19%) done (elapsed 149.08 s, remaining 611.54 s) 2023-07-21T22:22:05.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.768+0000 7fb2305ff700 1 -- 172.21.15.151:0/724654832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2280fea30 msgr2=0x7fb2280feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.768+0000 7fb2305ff700 1 --2- 172.21.15.151:0/724654832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2280fea30 0x7fb2280feea0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb2180098f0 tx=0x7fb218009c00 comp rx=0 tx=0).stop 2023-07-21T22:22:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.768+0000 7fb2305ff700 1 -- 172.21.15.151:0/724654832 shutdown_connections 2023-07-21T22:22:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.768+0000 7fb2305ff700 1 --2- 172.21.15.151:0/724654832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb228104a30 0x7fb228104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.768+0000 7fb2305ff700 1 --2- 172.21.15.151:0/724654832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2280ff3e0 0x7fb22810b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.768+0000 7fb2305ff700 1 --2- 172.21.15.151:0/724654832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb2280fea30 0x7fb2280feea0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.768+0000 7fb2305ff700 1 -- 172.21.15.151:0/724654832 >> 172.21.15.151:0/724654832 conn(0x7fb228074760 msgr2=0x7fb228074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.768+0000 7fb2305ff700 1 -- 172.21.15.151:0/724654832 shutdown_connections 2023-07-21T22:22:05.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.768+0000 7fb2305ff700 1 -- 172.21.15.151:0/724654832 wait complete. 2023-07-21T22:22:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.769+0000 7fb2305ff700 1 Processor -- start 2023-07-21T22:22:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.769+0000 7fb2305ff700 1 -- start start 2023-07-21T22:22:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb2305ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2280fea30 0x7fb22819c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb2305ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2280ff3e0 0x7fb22819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb2305ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb228104a30 0x7fb2281a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb2305ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281a1300 con 0x7fb2280fea30 2023-07-21T22:22:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb2305ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281a1470 con 0x7fb2280ff3e0 2023-07-21T22:22:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb2305ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2281a1630 con 0x7fb228104a30 2023-07-21T22:22:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb22e39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2280fea30 0x7fb22819c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb22e39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2280fea30 0x7fb22819c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39242/0 (socket says 172.21.15.151:39242) 2023-07-21T22:22:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb22e39b700 1 -- 172.21.15.151:0/2175615202 learned_addr learned my addr 172.21.15.151:0/2175615202 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.770+0000 7fb22db9a700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2280ff3e0 0x7fb22819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.771+0000 7fb22eb9c700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb228104a30 0x7fb2281a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.771+0000 7fb22e39b700 1 -- 172.21.15.151:0/2175615202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb228104a30 msgr2=0x7fb2281a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.771+0000 7fb22e39b700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb228104a30 0x7fb2281a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.771+0000 7fb22e39b700 1 -- 172.21.15.151:0/2175615202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2280ff3e0 msgr2=0x7fb22819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.771+0000 7fb22e39b700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2280ff3e0 0x7fb22819ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.771+0000 7fb22e39b700 1 -- 172.21.15.151:0/2175615202 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb220009d00 con 0x7fb2280fea30 2023-07-21T22:22:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.771+0000 7fb22eb9c700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb228104a30 0x7fb2281a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:22:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.771+0000 7fb22e39b700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2280fea30 0x7fb22819c8e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb22400e970 tx=0x7fb22400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.772+0000 7fb21f7fe700 1 -- 172.21.15.151:0/2175615202 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224009790 con 0x7fb2280fea30 2023-07-21T22:22:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.772+0000 7fb21f7fe700 1 -- 172.21.15.151:0/2175615202 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb22400eec0 con 0x7fb2280fea30 2023-07-21T22:22:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.772+0000 7fb2305ff700 1 -- 172.21.15.151:0/2175615202 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb218009520 con 0x7fb2280fea30 2023-07-21T22:22:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.772+0000 7fb21f7fe700 1 -- 172.21.15.151:0/2175615202 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb224003c10 con 0x7fb2280fea30 2023-07-21T22:22:05.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.772+0000 7fb2305ff700 1 -- 172.21.15.151:0/2175615202 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2281a8fc0 con 0x7fb2280fea30 2023-07-21T22:22:05.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.775+0000 7fb21f7fe700 1 -- 172.21.15.151:0/2175615202 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fb224003e50 con 0x7fb2280fea30 2023-07-21T22:22:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.777+0000 7fb21f7fe700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb2140a1410 0x7fb2140a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.777+0000 7fb243fccb80 1 Processor -- start 2023-07-21T22:22:05.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.777+0000 7fb21f7fe700 1 -- 172.21.15.151:0/2175615202 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb224014070 con 0x7fb2280fea30 2023-07-21T22:22:05.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.777+0000 7fb22db9a700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb2140a1410 0x7fb2140a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.777+0000 7fb243fccb80 1 -- start start 2023-07-21T22:22:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7b1f6b0 0x5560a7cc8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cc9210 0x5560a7cc2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cc34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb243fccb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7bc8c50 con 0x5560a7b1f6b0 2023-07-21T22:22:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb243fccb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7c1b9e0 con 0x5560a7cc9660 2023-07-21T22:22:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb243fccb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7c14e70 con 0x5560a7cc9210 2023-07-21T22:22:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb22eb9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cc34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb22db9a700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb2140a1410 0x7fb2140a38c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb218005e90 tx=0x7fb218019040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb22eb9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cc34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:58152/0 (socket says 172.21.15.151:58152) 2023-07-21T22:22:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb22eb9c700 1 -- 172.21.15.151:0/269794056 learned_addr learned my addr 172.21.15.151:0/269794056 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb22db9a700 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cc9210 0x5560a7cc2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.778+0000 7fb22e39b700 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7b1f6b0 0x5560a7cc8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb22eb9c700 1 -- 172.21.15.151:0/269794056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cc9210 msgr2=0x5560a7cc2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb22eb9c700 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cc9210 0x5560a7cc2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb22eb9c700 1 -- 172.21.15.151:0/269794056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7b1f6b0 msgr2=0x5560a7cc8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb22eb9c700 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7b1f6b0 0x5560a7cc8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb22eb9c700 1 -- 172.21.15.151:0/269794056 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560a7a42d80 con 0x5560a7cc9660 2023-07-21T22:22:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb22db9a700 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cc9210 0x5560a7cc2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb22eb9c700 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cc34a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb2200095c0 tx=0x7fb2200099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9aaf296ad8d62424 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb21cbfe700 1 -- 172.21.15.151:0/269794056 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220018070 con 0x5560a7cc9660 2023-07-21T22:22:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb21cbfe700 1 -- 172.21.15.151:0/269794056 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb22000f070 con 0x5560a7cc9660 2023-07-21T22:22:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.779+0000 7fb21cbfe700 1 -- 172.21.15.151:0/269794056 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb220014410 con 0x5560a7cc9660 2023-07-21T22:22:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.780+0000 7fb243fccb80 1 -- 172.21.15.151:0/269794056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 msgr2=0x5560a7cc34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.780+0000 7fb243fccb80 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cc34a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fb2200095c0 tx=0x7fb2200099e0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.780+0000 7fb243fccb80 1 -- 172.21.15.151:0/269794056 shutdown_connections 2023-07-21T22:22:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.780+0000 7fb243fccb80 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cc34a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.780+0000 7fb243fccb80 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7b1f6b0 0x5560a7cc8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.780+0000 7fb243fccb80 1 --2- 172.21.15.151:0/269794056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cc9210 0x5560a7cc2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.780+0000 7fb243fccb80 1 -- 172.21.15.151:0/269794056 >> 172.21.15.151:0/269794056 conn(0x5560a7cb8ae0 msgr2=0x5560a7cbe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.780+0000 7fb243fccb80 1 -- 172.21.15.151:0/269794056 shutdown_connections 2023-07-21T22:22:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.780+0000 7fb243fccb80 1 -- 172.21.15.151:0/269794056 wait complete. 2023-07-21T22:22:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.781+0000 7fb243fccb80 1 -- start start 2023-07-21T22:22:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.781+0000 7fb243fccb80 1 Processor -- start 2023-07-21T22:22:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7ccf600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7ccc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb243fccb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7bb4a60 con 0x5560a7cc9210 2023-07-21T22:22:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb243fccb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7bb4760 con 0x5560a7cc9660 2023-07-21T22:22:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb243fccb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7a988c0 con 0x5560a7b1f6b0 2023-07-21T22:22:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb243fccb80 10 client.0 _ll_register_callbacks cb 0x5560a7bb2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22e39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7ccf600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22eb9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22e39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7ccf600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:36368/0 (socket says 172.21.15.151:36368) 2023-07-21T22:22:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22e39b700 1 -- 172.21.15.151:0/2215581061 learned_addr learned my addr 172.21.15.151:0/2215581061 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22db9a700 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7ccc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22e39b700 1 -- 172.21.15.151:0/2215581061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 msgr2=0x5560a7cccfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22e39b700 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cccfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22e39b700 1 -- 172.21.15.151:0/2215581061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 msgr2=0x5560a7ccc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22e39b700 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7ccc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22e39b700 1 -- 172.21.15.151:0/2215581061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb22810c160 con 0x5560a7b1f6b0 2023-07-21T22:22:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.782+0000 7fb22eb9c700 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.783+0000 7fb22e39b700 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7ccf600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb224099c30 tx=0x7fb22400cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c135a28a4bc804f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.783+0000 7fb211ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:22:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.783+0000 7fb211ffb700 1 -- 172.21.15.151:0/2215581061 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240b6070 con 0x5560a7b1f6b0 2023-07-21T22:22:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.783+0000 7fb211ffb700 1 -- 172.21.15.151:0/2215581061 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb2240a2380 con 0x5560a7b1f6b0 2023-07-21T22:22:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.783+0000 7fb243fccb80 1 -- 172.21.15.151:0/2215581061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5560a7b6e490 con 0x5560a7b1f6b0 2023-07-21T22:22:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.783+0000 7fb211ffb700 1 -- 172.21.15.151:0/2215581061 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb22409a3a0 con 0x5560a7b1f6b0 2023-07-21T22:22:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.783+0000 7fb243fccb80 10 client.25840 fetch_fsmap learned FSMap version 27 2023-07-21T22:22:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.783+0000 7fb243fccb80 1 -- 172.21.15.151:0/2215581061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fb220009270 con 0x5560a7b1f6b0 2023-07-21T22:22:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.783+0000 7fb211ffb700 1 -- 172.21.15.151:0/2215581061 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5560a7b6e490 con 0x5560a7b1f6b0 2023-07-21T22:22:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.784+0000 7fb211ffb700 1 -- 172.21.15.151:0/2215581061 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb224099420 con 0x5560a7b1f6b0 2023-07-21T22:22:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.784+0000 7fb243fccb80 10 client.25840 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:22:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.784+0000 7fb243fccb80 10 client.25840 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.784+0000 7fb243fccb80 20 client.25840 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.784+0000 7fb243fccb80 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5560a7cdcaf0 0x5560a7cdef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.784+0000 7fb243fccb80 4 client.25840 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:22:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.784+0000 7fb243fccb80 1 -- 172.21.15.151:0/2215581061 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5560a7c0de50 con 0x5560a7cdcaf0 2023-07-21T22:22:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.784+0000 7fb22db9a700 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5560a7cdcaf0 0x5560a7cdef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.785+0000 7fb22db9a700 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5560a7cdcaf0 0x5560a7cdef00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7f48ba3b027c13b server_cookie=48b80960320026f0 in_seq=0 out_seq=0 2023-07-21T22:22:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.785+0000 7fb211ffb700 10 client.25840 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.785+0000 7fb211ffb700 1 -- 172.21.15.151:0/2215581061 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5560a7c0de50 con 0x5560a7cdcaf0 2023-07-21T22:22:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.785+0000 7fb211ffb700 10 client.25840 handle_command_reply: tid=0 2023-07-21T22:22:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.785+0000 7fb243fccb80 1 client.25840 shutdown 2023-07-21T22:22:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 -- 172.21.15.151:0/2215581061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 msgr2=0x5560a7ccf600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7ccf600 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb224099c30 tx=0x7fb22400cd50 comp rx=0 tx=0).stop 2023-07-21T22:22:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 -- 172.21.15.151:0/2215581061 shutdown_connections 2023-07-21T22:22:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5560a7cdcaf0 0x5560a7cdef00 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cc9660 0x5560a7cccfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7ccf600 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb211ffb700 0 client.25840 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 --2- 172.21.15.151:0/2215581061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7ccc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 -- 172.21.15.151:0/2215581061 >> 172.21.15.151:0/2215581061 conn(0x5560a7cb8ae0 msgr2=0x5560a7cbd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 -- 172.21.15.151:0/2215581061 shutdown_connections 2023-07-21T22:22:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 1 -- 172.21.15.151:0/2215581061 wait complete. 2023-07-21T22:22:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.786+0000 7fb243fccb80 20 client.25840 trim_cache size 0 max 16384 2023-07-21T22:22:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.810+0000 7fb243fccb80 1 Processor -- start 2023-07-21T22:22:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.810+0000 7fb243fccb80 1 -- start start 2023-07-21T22:22:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.810+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cb8ae0 0x5560a7cc8280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.810+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.810+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7ccc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.810+0000 7fb243fccb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7cc8950 con 0x5560a7cc9210 2023-07-21T22:22:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.810+0000 7fb243fccb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7ccae90 con 0x5560a7b1f6b0 2023-07-21T22:22:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.810+0000 7fb243fccb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7cc75e0 con 0x5560a7cb8ae0 2023-07-21T22:22:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.810+0000 7fb22e39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cb8ae0 0x5560a7cc8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22e39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cb8ae0 0x5560a7cc8280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33542/0 (socket says 172.21.15.151:33542) 2023-07-21T22:22:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22e39b700 1 -- 172.21.15.151:0/4107033778 learned_addr learned my addr 172.21.15.151:0/4107033778 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22db9a700 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22eb9c700 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7ccc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22db9a700 1 -- 172.21.15.151:0/4107033778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cb8ae0 msgr2=0x5560a7cc8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22db9a700 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cb8ae0 0x5560a7cc8280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22db9a700 1 -- 172.21.15.151:0/4107033778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 msgr2=0x5560a7ccc0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22db9a700 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7ccc0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22db9a700 1 -- 172.21.15.151:0/4107033778 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5560a7a2bc00 con 0x5560a7b1f6b0 2023-07-21T22:22:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22e39b700 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cb8ae0 0x5560a7cc8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22eb9c700 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7ccc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:22:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.811+0000 7fb22db9a700 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb218009810 tx=0x7fb21801e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f2ad3aeacb3d13fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:05.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.812+0000 7fb21d3ff700 1 -- 172.21.15.151:0/4107033778 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21802a040 con 0x5560a7b1f6b0 2023-07-21T22:22:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.812+0000 7fb21d3ff700 1 -- 172.21.15.151:0/4107033778 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb21802b040 con 0x5560a7b1f6b0 2023-07-21T22:22:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.812+0000 7fb21d3ff700 1 -- 172.21.15.151:0/4107033778 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb218034600 con 0x5560a7b1f6b0 2023-07-21T22:22:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.812+0000 7fb243fccb80 1 -- 172.21.15.151:0/4107033778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7b1f6b0 msgr2=0x5560a7cd3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.812+0000 7fb243fccb80 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3bb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb218009810 tx=0x7fb21801e000 comp rx=0 tx=0).stop 2023-07-21T22:22:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.813+0000 7fb243fccb80 1 -- 172.21.15.151:0/4107033778 shutdown_connections 2023-07-21T22:22:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.813+0000 7fb243fccb80 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7ccc0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.813+0000 7fb243fccb80 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7cb8ae0 0x5560a7cc8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.813+0000 7fb243fccb80 1 --2- 172.21.15.151:0/4107033778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3bb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.813+0000 7fb243fccb80 1 -- 172.21.15.151:0/4107033778 >> 172.21.15.151:0/4107033778 conn(0x5560a7cd86b0 msgr2=0x5560a7cc9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.813+0000 7fb243fccb80 1 -- 172.21.15.151:0/4107033778 shutdown_connections 2023-07-21T22:22:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.813+0000 7fb243fccb80 1 -- 172.21.15.151:0/4107033778 wait complete. 2023-07-21T22:22:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.813+0000 7fb243fccb80 1 -- start start 2023-07-21T22:22:05.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.813+0000 7fb243fccb80 1 Processor -- start 2023-07-21T22:22:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.814+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.814+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cb8ae0 0x5560a7cd1db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.814+0000 7fb243fccb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7cd22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.814+0000 7fb243fccb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7cd2880 con 0x5560a7cc9210 2023-07-21T22:22:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.814+0000 7fb243fccb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7cd29c0 con 0x5560a7cb8ae0 2023-07-21T22:22:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.814+0000 7fb243fccb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5560a7cd2b80 con 0x5560a7b1f6b0 2023-07-21T22:22:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.814+0000 7fb243fccb80 10 client.0 _ll_register_callbacks cb 0x7fb224099890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.814+0000 7fb22e39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22e39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33544/0 (socket says 172.21.15.151:33544) 2023-07-21T22:22:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22e39b700 1 -- 172.21.15.151:0/100356195 learned_addr learned my addr 172.21.15.151:0/100356195 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:05.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22eb9c700 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7cd22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22db9a700 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cb8ae0 0x5560a7cd1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22e39b700 1 -- 172.21.15.151:0/100356195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cb8ae0 msgr2=0x5560a7cd1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22e39b700 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cb8ae0 0x5560a7cd1db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22e39b700 1 -- 172.21.15.151:0/100356195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 msgr2=0x5560a7cd22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22e39b700 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7cd22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22e39b700 1 -- 172.21.15.151:0/100356195 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb220009270 con 0x5560a7b1f6b0 2023-07-21T22:22:05.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb22e39b700 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3ac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb22409a0f0 tx=0x7fb22400cdc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e059f1e1e0ca07f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb211ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:22:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb211ffb700 1 -- 172.21.15.151:0/100356195 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2240b6070 con 0x5560a7b1f6b0 2023-07-21T22:22:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.815+0000 7fb243fccb80 1 -- 172.21.15.151:0/100356195 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb22000f070 con 0x5560a7b1f6b0 2023-07-21T22:22:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb211ffb700 1 -- 172.21.15.151:0/100356195 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb2240a2380 con 0x5560a7b1f6b0 2023-07-21T22:22:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb211ffb700 1 -- 172.21.15.151:0/100356195 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2240a1ef0 con 0x5560a7b1f6b0 2023-07-21T22:22:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb243fccb80 10 client.25846 fetch_fsmap learned FSMap version 27 2023-07-21T22:22:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb243fccb80 1 -- 172.21.15.151:0/100356195 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fb21800f720 con 0x5560a7b1f6b0 2023-07-21T22:22:05.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb211ffb700 1 -- 172.21.15.151:0/100356195 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb2240a6020 con 0x5560a7b1f6b0 2023-07-21T22:22:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb211ffb700 1 -- 172.21.15.151:0/100356195 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb224098e90 con 0x5560a7b1f6b0 2023-07-21T22:22:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb243fccb80 10 client.25846 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:22:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb243fccb80 10 client.25846 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb243fccb80 20 client.25846 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb243fccb80 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5560a7cc9660 0x5560a7d33c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb243fccb80 4 client.25846 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:22:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.816+0000 7fb243fccb80 1 -- 172.21.15.151:0/100356195 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5560a7bcfff0 con 0x5560a7cc9660 2023-07-21T22:22:05.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.817+0000 7fb22db9a700 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5560a7cc9660 0x5560a7d33c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.817+0000 7fb22db9a700 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5560a7cc9660 0x5560a7d33c40 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1ba336b882592a8 server_cookie=f64e2c6433541156 in_seq=0 out_seq=0 2023-07-21T22:22:05.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.817+0000 7fb211ffb700 10 client.25846 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.842+0000 7fb211ffb700 1 -- 172.21.15.151:0/100356195 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5560a7bcfff0 con 0x5560a7cc9660 2023-07-21T22:22:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.842+0000 7fb211ffb700 10 client.25846 handle_command_reply: tid=0 2023-07-21T22:22:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.842+0000 7fb243fccb80 1 client.25846 shutdown 2023-07-21T22:22:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.843+0000 7fb243fccb80 1 -- 172.21.15.151:0/100356195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 msgr2=0x5560a7cd3ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.843+0000 7fb243fccb80 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3ac0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb22409a0f0 tx=0x7fb22400cdc0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.843+0000 7fb243fccb80 1 -- 172.21.15.151:0/100356195 shutdown_connections 2023-07-21T22:22:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.843+0000 7fb243fccb80 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5560a7cc9660 0x5560a7d33c40 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.843+0000 7fb243fccb80 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5560a7cc9210 0x5560a7cd22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.843+0000 7fb243fccb80 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5560a7b1f6b0 0x5560a7cd3ac0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.843+0000 7fb243fccb80 1 --2- 172.21.15.151:0/100356195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5560a7cb8ae0 0x5560a7cd1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.843+0000 7fb211ffb700 0 client.25846 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.843+0000 7fb243fccb80 1 -- 172.21.15.151:0/100356195 >> 172.21.15.151:0/100356195 conn(0x5560a7cd86b0 msgr2=0x5560a7cca330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.844+0000 7fb243fccb80 1 -- 172.21.15.151:0/100356195 shutdown_connections 2023-07-21T22:22:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.844+0000 7fb243fccb80 1 -- 172.21.15.151:0/100356195 wait complete. 2023-07-21T22:22:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.844+0000 7fb243fccb80 20 client.25846 trim_cache size 0 max 16384 2023-07-21T22:22:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:22:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:22:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:22:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:22:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 -- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb2140a1410 msgr2=0x7fb2140a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb2140a1410 0x7fb2140a38c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb218005e90 tx=0x7fb218019040 comp rx=0 tx=0).stop 2023-07-21T22:22:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 -- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2280fea30 msgr2=0x7fb22819c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2280fea30 0x7fb22819c8e0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb22400e970 tx=0x7fb22400ec80 comp rx=0 tx=0).stop 2023-07-21T22:22:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 -- 172.21.15.151:0/2175615202 shutdown_connections 2023-07-21T22:22:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb2140a1410 0x7fb2140a38c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb228104a30 0x7fb2281a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb2280fea30 0x7fb22819c8e0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 --2- 172.21.15.151:0/2175615202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2280ff3e0 0x7fb22819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 -- 172.21.15.151:0/2175615202 >> 172.21.15.151:0/2175615202 conn(0x7fb228074760 msgr2=0x7fb228067900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 -- 172.21.15.151:0/2175615202 shutdown_connections 2023-07-21T22:22:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:05.845+0000 7fb2305ff700 1 -- 172.21.15.151:0/2175615202 wait complete. 2023-07-21T22:22:06.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:06 smithi187 ceph-mon[96918]: pgmap v90: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 25 MiB/s wr, 36 op/s 2023-07-21T22:22:06.886 INFO:teuthology.orchestra.run.smithi151.stderr:9900000 of 50000000 tuples (19%) done (elapsed 150.38 s, remaining 609.11 s) 2023-07-21T22:22:06.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:06 smithi195 ceph-mon[97365]: pgmap v90: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 25 MiB/s wr, 36 op/s 2023-07-21T22:22:06.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:06 smithi151 ceph-mon[95510]: pgmap v90: 97 pgs: 97 active+clean; 2.2 GiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 25 MiB/s wr, 36 op/s 2023-07-21T22:22:08.170 INFO:teuthology.orchestra.run.smithi151.stderr:10000000 of 50000000 tuples (20%) done (elapsed 151.66 s, remaining 606.65 s) 2023-07-21T22:22:08.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:08 smithi187 ceph-mon[96918]: pgmap v91: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 36 MiB/s wr, 62 op/s 2023-07-21T22:22:08.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:08 smithi195 ceph-mon[97365]: pgmap v91: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 36 MiB/s wr, 62 op/s 2023-07-21T22:22:08.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:08 smithi151 ceph-mon[95510]: pgmap v91: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 130 KiB/s rd, 36 MiB/s wr, 62 op/s 2023-07-21T22:22:09.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:22:09.356 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.311+0000 7fefbe7ff700 1 -- 172.21.15.151:0/4111805110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb8072850 msgr2=0x7fefb8072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:09.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.311+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/4111805110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb8072850 0x7fefb8072c20 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fefa8009990 tx=0x7fefa8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.311+0000 7fefbe7ff700 1 -- 172.21.15.151:0/4111805110 shutdown_connections 2023-07-21T22:22:09.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.311+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/4111805110 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefb810c3a0 0x7fefb810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.311+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/4111805110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb8072850 0x7fefb8072c20 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.357 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.311+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/4111805110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb8073160 0x7fefb810be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.311+0000 7fefbe7ff700 1 -- 172.21.15.151:0/4111805110 >> 172.21.15.151:0/4111805110 conn(0x7fefb80fb600 msgr2=0x7fefb80fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:09.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.311+0000 7fefbe7ff700 1 -- 172.21.15.151:0/4111805110 shutdown_connections 2023-07-21T22:22:09.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.311+0000 7fefbe7ff700 1 -- 172.21.15.151:0/4111805110 wait complete. 2023-07-21T22:22:09.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.312+0000 7fefbe7ff700 1 Processor -- start 2023-07-21T22:22:09.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefbe7ff700 1 -- start start 2023-07-21T22:22:09.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefbe7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefb8072850 0x7fefb8197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefbe7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb8073160 0x7fefb8198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefbe7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb810c3a0 0x7fefb819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefbe7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb819cda0 con 0x7fefb8073160 2023-07-21T22:22:09.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefbe7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb819cf10 con 0x7fefb810c3a0 2023-07-21T22:22:09.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefbe7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb819d0d0 con 0x7fefb8072850 2023-07-21T22:22:09.360 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefb8072850 0x7fefb8197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefb77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb8073160 0x7fefb8198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefb8072850 0x7fefb8197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33570/0 (socket says 172.21.15.151:33570) 2023-07-21T22:22:09.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.313+0000 7fefb7fff700 1 -- 172.21.15.151:0/1980651565 learned_addr learned my addr 172.21.15.151:0/1980651565 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:09.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.314+0000 7fefbcd9c700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb810c3a0 0x7fefb819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.314+0000 7fefb7fff700 1 -- 172.21.15.151:0/1980651565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb810c3a0 msgr2=0x7fefb819c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:09.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.314+0000 7fefb7fff700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb810c3a0 0x7fefb819c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.314+0000 7fefb7fff700 1 -- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb8073160 msgr2=0x7fefb8198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:09.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.314+0000 7fefb7fff700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb8073160 0x7fefb8198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.314+0000 7fefb7fff700 1 -- 172.21.15.151:0/1980651565 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefa80095f0 con 0x7fefb8072850 2023-07-21T22:22:09.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.314+0000 7fefb77fe700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb8073160 0x7fefb8198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:09.362 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.314+0000 7fefb7fff700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefb8072850 0x7fefb8197dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefa8000c00 tx=0x7fefa8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:09.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.315+0000 7fefb57fa700 1 -- 172.21.15.151:0/1980651565 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa801d070 con 0x7fefb8072850 2023-07-21T22:22:09.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.315+0000 7fefb57fa700 1 -- 172.21.15.151:0/1980651565 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefa8022470 con 0x7fefb8072850 2023-07-21T22:22:09.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.315+0000 7fefbe7ff700 1 -- 172.21.15.151:0/1980651565 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb819d350 con 0x7fefb8072850 2023-07-21T22:22:09.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.315+0000 7fefb57fa700 1 -- 172.21.15.151:0/1980651565 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8017650 con 0x7fefb8072850 2023-07-21T22:22:09.363 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.315+0000 7fefbe7ff700 1 -- 172.21.15.151:0/1980651565 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb81a4bf0 con 0x7fefb8072850 2023-07-21T22:22:09.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.319+0000 7fefb57fa700 1 -- 172.21.15.151:0/1980651565 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fefa80225e0 con 0x7fefb8072850 2023-07-21T22:22:09.365 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.320+0000 7fefb57fa700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fefa00a12c0 0x7fefa00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.321+0000 7fefb57fa700 1 -- 172.21.15.151:0/1980651565 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fefa80ce060 con 0x7fefb8072850 2023-07-21T22:22:09.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.321+0000 7fefb77fe700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fefa00a12c0 0x7fefa00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.321+0000 7fefd216fb80 1 Processor -- start 2023-07-21T22:22:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.322+0000 7fefd216fb80 1 -- start start 2023-07-21T22:22:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.322+0000 7fefb77fe700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fefa00a12c0 0x7fefa00a3770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefb81993d0 tx=0x7fefac009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.322+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3993580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.322+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f398e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.322+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f398eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.322+0000 7fefd216fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3893cb0 con 0x55b7f3993ac0 2023-07-21T22:22:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.322+0000 7fefd216fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f38e6a40 con 0x55b7f398e930 2023-07-21T22:22:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.322+0000 7fefd216fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f38dfed0 con 0x55b7f39931b0 2023-07-21T22:22:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3993580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3993580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33574/0 (socket says 172.21.15.151:33574) 2023-07-21T22:22:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb7fff700 1 -- 172.21.15.151:0/633145783 learned_addr learned my addr 172.21.15.151:0/633145783 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefbcd9c700 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f398eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb77fe700 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f398e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb7fff700 1 -- 172.21.15.151:0/633145783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 msgr2=0x55b7f398eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb7fff700 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f398eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb7fff700 1 -- 172.21.15.151:0/633145783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 msgr2=0x55b7f398e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb7fff700 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f398e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb7fff700 1 -- 172.21.15.151:0/633145783 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7f370dde0 con 0x55b7f39931b0 2023-07-21T22:22:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefbcd9c700 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f398eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fefb7fff700 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3993580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fefa80a30a0 tx=0x7fefa8097670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f3c177cc76422d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:09.371 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.323+0000 7fef9e7fc700 1 -- 172.21.15.151:0/633145783 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa809f030 con 0x55b7f39931b0 2023-07-21T22:22:09.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.324+0000 7fef9e7fc700 1 -- 172.21.15.151:0/633145783 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefa80228c0 con 0x55b7f39931b0 2023-07-21T22:22:09.372 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.324+0000 7fef9e7fc700 1 -- 172.21.15.151:0/633145783 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa809b6d0 con 0x55b7f39931b0 2023-07-21T22:22:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.324+0000 7fefd216fb80 1 -- 172.21.15.151:0/633145783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 msgr2=0x55b7f3993580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:09.377 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.324+0000 7fefd216fb80 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3993580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fefa80a30a0 tx=0x7fefa8097670 comp rx=0 tx=0).stop 2023-07-21T22:22:09.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.325+0000 7fefd216fb80 1 -- 172.21.15.151:0/633145783 shutdown_connections 2023-07-21T22:22:09.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.325+0000 7fefd216fb80 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f398eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.378 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.325+0000 7fefd216fb80 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3993580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.325+0000 7fefd216fb80 1 --2- 172.21.15.151:0/633145783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f398e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.325+0000 7fefd216fb80 1 -- 172.21.15.151:0/633145783 >> 172.21.15.151:0/633145783 conn(0x55b7f3983ef0 msgr2=0x55b7f3989830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.325+0000 7fefd216fb80 1 -- 172.21.15.151:0/633145783 shutdown_connections 2023-07-21T22:22:09.379 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.325+0000 7fefd216fb80 1 -- 172.21.15.151:0/633145783 wait complete. 2023-07-21T22:22:09.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.325+0000 7fefd216fb80 1 -- start start 2023-07-21T22:22:09.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.326+0000 7fefd216fb80 1 Processor -- start 2023-07-21T22:22:09.380 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.326+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.326+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 0x55b7f3997da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.326+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f39983b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.326+0000 7fefd216fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f387fac0 con 0x55b7f3993ac0 2023-07-21T22:22:09.381 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.326+0000 7fefd216fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f387f7c0 con 0x55b7f39931b0 2023-07-21T22:22:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.326+0000 7fefd216fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3763920 con 0x55b7f398e930 2023-07-21T22:22:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.326+0000 7fefd216fb80 10 client.0 _ll_register_callbacks cb 0x55b7f387d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefbcd9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f39983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.382 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33586/0 (socket says 172.21.15.151:33586) 2023-07-21T22:22:09.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefb7fff700 1 -- 172.21.15.151:0/3349416711 learned_addr learned my addr 172.21.15.151:0/3349416711 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:09.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefb77fe700 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 0x55b7f3997da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.383 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefbcd9c700 1 -- 172.21.15.151:0/3349416711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 msgr2=0x55b7f399ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefbcd9c700 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefbcd9c700 1 -- 172.21.15.151:0/3349416711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 msgr2=0x55b7f3997da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefbcd9c700 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 0x55b7f3997da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefbcd9c700 1 -- 172.21.15.151:0/3349416711 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb0011230 con 0x55b7f3993ac0 2023-07-21T22:22:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fefbcd9c700 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f39983b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fefb8074920 tx=0x7fefb0007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6015ff89097052 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:09.384 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.327+0000 7fef977fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:22:09.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.328+0000 7fef977fe700 1 -- 172.21.15.151:0/3349416711 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb000e040 con 0x55b7f3993ac0 2023-07-21T22:22:09.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.328+0000 7fefd216fb80 1 -- 172.21.15.151:0/3349416711 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7f38394f0 con 0x55b7f3993ac0 2023-07-21T22:22:09.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.328+0000 7fef977fe700 1 -- 172.21.15.151:0/3349416711 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fefb0004db0 con 0x55b7f3993ac0 2023-07-21T22:22:09.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.328+0000 7fef977fe700 1 -- 172.21.15.151:0/3349416711 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefb0011b60 con 0x55b7f3993ac0 2023-07-21T22:22:09.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.328+0000 7fefd216fb80 10 client.16077 fetch_fsmap learned FSMap version 27 2023-07-21T22:22:09.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.328+0000 7fefd216fb80 1 -- 172.21.15.151:0/3349416711 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fefb81a4bf0 con 0x55b7f3993ac0 2023-07-21T22:22:09.385 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.328+0000 7fef977fe700 1 -- 172.21.15.151:0/3349416711 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b7f38394f0 con 0x55b7f3993ac0 2023-07-21T22:22:09.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.329+0000 7fef977fe700 1 -- 172.21.15.151:0/3349416711 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fefb0029bf0 con 0x55b7f3993ac0 2023-07-21T22:22:09.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.329+0000 7fefd216fb80 10 client.16077 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:22:09.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.329+0000 7fefd216fb80 10 client.16077 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:09.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.329+0000 7fefd216fb80 20 client.16077 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:09.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.329+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7f39a8200 0x55b7f39aa610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.329+0000 7fefd216fb80 4 client.16077 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:22:09.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.329+0000 7fefd216fb80 1 -- 172.21.15.151:0/3349416711 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7f38d8eb0 con 0x55b7f39a8200 2023-07-21T22:22:09.386 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.329+0000 7fefb7fff700 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7f39a8200 0x55b7f39aa610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.330+0000 7fefb7fff700 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7f39a8200 0x55b7f39aa610 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bea7bbd0f1ae083 server_cookie=e0f586712ac8688d in_seq=0 out_seq=0 2023-07-21T22:22:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.330+0000 7fef977fe700 10 client.16077 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.330+0000 7fef977fe700 1 -- 172.21.15.151:0/3349416711 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b7f38d8eb0 con 0x55b7f39a8200 2023-07-21T22:22:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.330+0000 7fef977fe700 10 client.16077 handle_command_reply: tid=0 2023-07-21T22:22:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.330+0000 7fefd216fb80 1 client.16077 shutdown 2023-07-21T22:22:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 -- 172.21.15.151:0/3349416711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 msgr2=0x55b7f39983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f39983b0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fefb8074920 tx=0x7fefb0007f40 comp rx=0 tx=0).stop 2023-07-21T22:22:09.387 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 -- 172.21.15.151:0/3349416711 shutdown_connections 2023-07-21T22:22:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7f39a8200 0x55b7f39aa610 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f39983b0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fef977fe700 0 client.16077 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3349416711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 0x55b7f3997da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 -- 172.21.15.151:0/3349416711 >> 172.21.15.151:0/3349416711 conn(0x55b7f3983ef0 msgr2=0x55b7f39893c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:09.388 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 -- 172.21.15.151:0/3349416711 shutdown_connections 2023-07-21T22:22:09.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 1 -- 172.21.15.151:0/3349416711 wait complete. 2023-07-21T22:22:09.389 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.331+0000 7fefd216fb80 20 client.16077 trim_cache size 0 max 16384 2023-07-21T22:22:09.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.352+0000 7fefd216fb80 1 Processor -- start 2023-07-21T22:22:09.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.352+0000 7fefd216fb80 1 -- start start 2023-07-21T22:22:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 0x55b7f3997560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f398d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefd216fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3839520 con 0x55b7f3993ac0 2023-07-21T22:22:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefd216fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3980e80 con 0x55b7f39931b0 2023-07-21T22:22:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefd216fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f3986010 con 0x55b7f398e930 2023-07-21T22:22:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefb77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 0x55b7f3997560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33592/0 (socket says 172.21.15.151:33592) 2023-07-21T22:22:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefbcd9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f398d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefb7fff700 1 -- 172.21.15.151:0/3225754478 learned_addr learned my addr 172.21.15.151:0/3225754478 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:09.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefb77fe700 1 -- 172.21.15.151:0/3225754478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 msgr2=0x55b7f399f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefb77fe700 1 --2- 172.21.15.151:0/3225754478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefb77fe700 1 -- 172.21.15.151:0/3225754478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 msgr2=0x55b7f398d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefb77fe700 1 --2- 172.21.15.151:0/3225754478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f398d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefb77fe700 1 -- 172.21.15.151:0/3225754478 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7f36f6c60 con 0x55b7f39931b0 2023-07-21T22:22:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.353+0000 7fefbcd9c700 1 --2- 172.21.15.151:0/3225754478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f398d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.354+0000 7fefb77fe700 1 --2- 172.21.15.151:0/3225754478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 0x55b7f3997560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55b7f399b170 tx=0x7fefac014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5aa54caf4a075ccf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:09.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.354+0000 7fef9effd700 1 -- 172.21.15.151:0/3225754478 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac024070 con 0x55b7f39931b0 2023-07-21T22:22:09.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.354+0000 7fef9effd700 1 -- 172.21.15.151:0/3225754478 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefac01e3f0 con 0x55b7f39931b0 2023-07-21T22:22:09.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.354+0000 7fef9effd700 1 -- 172.21.15.151:0/3225754478 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac00e610 con 0x55b7f39931b0 2023-07-21T22:22:09.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 -- 172.21.15.151:0/3225754478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 msgr2=0x55b7f3997560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:09.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3225754478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 0x55b7f3997560 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x55b7f399b170 tx=0x7fefac014000 comp rx=0 tx=0).stop 2023-07-21T22:22:09.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 -- 172.21.15.151:0/3225754478 shutdown_connections 2023-07-21T22:22:09.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3225754478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f398d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3225754478 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f398e930 0x55b7f399f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 --2- 172.21.15.151:0/3225754478 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f39931b0 0x55b7f3997560 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 -- 172.21.15.151:0/3225754478 >> 172.21.15.151:0/3225754478 conn(0x55b7f3983ef0 msgr2=0x55b7f3997d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:09.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 -- 172.21.15.151:0/3225754478 shutdown_connections 2023-07-21T22:22:09.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 -- 172.21.15.151:0/3225754478 wait complete. 2023-07-21T22:22:09.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.355+0000 7fefd216fb80 1 -- start start 2023-07-21T22:22:09.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefd216fb80 1 Processor -- start 2023-07-21T22:22:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f3999810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3999d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefd216fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f399a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefd216fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f39fc100 con 0x55b7f3993ac0 2023-07-21T22:22:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefd216fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f39fc270 con 0x55b7f398e930 2023-07-21T22:22:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefd216fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7f39fc430 con 0x55b7f39931b0 2023-07-21T22:22:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefd216fb80 10 client.0 _ll_register_callbacks cb 0x7fefb00075e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f3999810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefb77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3999d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f3999810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45484/0 (socket says 172.21.15.151:45484) 2023-07-21T22:22:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefb7fff700 1 -- 172.21.15.151:0/1393373161 learned_addr learned my addr 172.21.15.151:0/1393373161 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.356+0000 7fefbcd9c700 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f399a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fefb7fff700 1 -- 172.21.15.151:0/1393373161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 msgr2=0x55b7f3999d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fefb7fff700 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3999d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fefb7fff700 1 -- 172.21.15.151:0/1393373161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 msgr2=0x55b7f399a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fefb7fff700 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f399a290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fefb7fff700 1 -- 172.21.15.151:0/1393373161 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb81a4bf0 con 0x55b7f398e930 2023-07-21T22:22:09.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fefb7fff700 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f3999810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fefa8097710 tx=0x7fefa8009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39d3a03782297528 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fef977fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:22:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fef977fe700 1 -- 172.21.15.151:0/1393373161 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa80a35d0 con 0x55b7f398e930 2023-07-21T22:22:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fefd216fb80 1 -- 172.21.15.151:0/1393373161 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fefa80228c0 con 0x55b7f398e930 2023-07-21T22:22:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fef977fe700 1 -- 172.21.15.151:0/1393373161 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fefa809b210 con 0x55b7f398e930 2023-07-21T22:22:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.357+0000 7fef977fe700 1 -- 172.21.15.151:0/1393373161 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7fefa809f240 con 0x55b7f398e930 2023-07-21T22:22:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fefd216fb80 10 client.25835 fetch_fsmap learned FSMap version 27 2023-07-21T22:22:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fefd216fb80 1 -- 172.21.15.151:0/1393373161 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7fefac017070 con 0x55b7f398e930 2023-07-21T22:22:09.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fef977fe700 1 -- 172.21.15.151:0/1393373161 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fefa80228c0 con 0x55b7f398e930 2023-07-21T22:22:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fef977fe700 1 -- 172.21.15.151:0/1393373161 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fefa8064030 con 0x55b7f398e930 2023-07-21T22:22:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fefd216fb80 10 client.25835 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:22:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fefd216fb80 10 client.25835 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fefd216fb80 20 client.25835 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fefd216fb80 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7f39fd7e0 0x55b7f39ffbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fefd216fb80 4 client.25835 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:22:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fefd216fb80 1 -- 172.21.15.151:0/1393373161 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55b7f389b050 con 0x55b7f39fd7e0 2023-07-21T22:22:09.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.358+0000 7fefb77fe700 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7f39fd7e0 0x55b7f39ffbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefb77fe700 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7f39fd7e0 0x55b7f39ffbf0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=790517f016ba7fc1 server_cookie=5f270c177c7aed7e in_seq=0 out_seq=0 2023-07-21T22:22:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fef977fe700 10 client.25835 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fef977fe700 1 -- 172.21.15.151:0/1393373161 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55b7f389b050 con 0x55b7f39fd7e0 2023-07-21T22:22:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fef977fe700 10 client.25835 handle_command_reply: tid=0 2023-07-21T22:22:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefd216fb80 1 client.25835 shutdown 2023-07-21T22:22:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefd216fb80 1 -- 172.21.15.151:0/1393373161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 msgr2=0x55b7f3999810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:09.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefd216fb80 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f3999810 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fefa8097710 tx=0x7fefa8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefd216fb80 1 -- 172.21.15.151:0/1393373161 shutdown_connections 2023-07-21T22:22:09.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefd216fb80 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b7f39fd7e0 0x55b7f39ffbf0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefd216fb80 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7f398e930 0x55b7f3999810 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefd216fb80 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7f3993ac0 0x55b7f399a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefd216fb80 1 --2- 172.21.15.151:0/1393373161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7f39931b0 0x55b7f3999d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fef977fe700 0 client.25835 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:09.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.359+0000 7fefd216fb80 1 -- 172.21.15.151:0/1393373161 >> 172.21.15.151:0/1393373161 conn(0x55b7f3983ef0 msgr2=0x55b7f398d8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:09.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.360+0000 7fefd216fb80 1 -- 172.21.15.151:0/1393373161 shutdown_connections 2023-07-21T22:22:09.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.360+0000 7fefd216fb80 1 -- 172.21.15.151:0/1393373161 wait complete. 2023-07-21T22:22:09.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.360+0000 7fefd216fb80 20 client.25835 trim_cache size 0 max 16384 2023-07-21T22:22:09.412 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:22:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:22:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:22:09.412 INFO:teuthology.orchestra.run.smithi151.stdout: "ec38d3a5-93f8-4072-bfe2-c7872d39c48a": { 2023-07-21T22:22:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:22:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "ec38d3a5-93f8-4072-bfe2-c7872d39c48a", 2023-07-21T22:22:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:22:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:22:09.413 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:22:09.414 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:22:09.414 INFO:teuthology.orchestra.run.smithi151.stderr:10100000 of 50000000 tuples (20%) done (elapsed 152.90 s, remaining 604.02 s) 2023-07-21T22:22:09.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.360+0000 7fefbe7ff700 1 -- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fefa00a12c0 msgr2=0x7fefa00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:09.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.360+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fefa00a12c0 0x7fefa00a3770 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fefb81993d0 tx=0x7fefac009260 comp rx=0 tx=0).stop 2023-07-21T22:22:09.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.360+0000 7fefbe7ff700 1 -- 172.21.15.151:0/1980651565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefb8072850 msgr2=0x7fefb8197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:09.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.360+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefb8072850 0x7fefb8197dc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fefa8000c00 tx=0x7fefa8004730 comp rx=0 tx=0).stop 2023-07-21T22:22:09.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.361+0000 7fefbe7ff700 1 -- 172.21.15.151:0/1980651565 shutdown_connections 2023-07-21T22:22:09.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.361+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fefa00a12c0 0x7fefa00a3770 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.361+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb810c3a0 0x7fefb819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.361+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fefb8072850 0x7fefb8197dc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.361+0000 7fefbe7ff700 1 --2- 172.21.15.151:0/1980651565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefb8073160 0x7fefb8198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:09.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.361+0000 7fefbe7ff700 1 -- 172.21.15.151:0/1980651565 >> 172.21.15.151:0/1980651565 conn(0x7fefb80fb600 msgr2=0x7fefb810d660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:09.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.361+0000 7fefbe7ff700 1 -- 172.21.15.151:0/1980651565 shutdown_connections 2023-07-21T22:22:09.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:09.361+0000 7fefbe7ff700 1 -- 172.21.15.151:0/1980651565 wait complete. 2023-07-21T22:22:09.425 INFO:tasks.cephfs.filesystem:scrub status for tag:ec38d3a5-93f8-4072-bfe2-c7872d39c48a - {'path': '/', 'tag': 'ec38d3a5-93f8-4072-bfe2-c7872d39c48a', 'options': 'recursive,force'} 2023-07-21T22:22:10.594 INFO:teuthology.orchestra.run.smithi151.stderr:10200000 of 50000000 tuples (20%) done (elapsed 154.09 s, remaining 601.24 s) 2023-07-21T22:22:10.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:10 smithi187 ceph-mon[96918]: pgmap v92: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:22:10.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:10 smithi195 ceph-mon[97365]: pgmap v92: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:22:10.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:10 smithi151 ceph-mon[95510]: pgmap v92: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:22:11.892 INFO:teuthology.orchestra.run.smithi151.stderr:10300000 of 50000000 tuples (20%) done (elapsed 155.38 s, remaining 598.91 s) 2023-07-21T22:22:12.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:12 smithi187 ceph-mon[96918]: pgmap v93: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:22:12.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:12 smithi195 ceph-mon[97365]: pgmap v93: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:22:12.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:12 smithi151 ceph-mon[95510]: pgmap v93: 97 pgs: 97 active+clean; 2.3 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:22:13.111 INFO:teuthology.orchestra.run.smithi151.stderr:10400000 of 50000000 tuples (20%) done (elapsed 156.60 s, remaining 596.30 s) 2023-07-21T22:22:14.309 INFO:teuthology.orchestra.run.smithi151.stderr:10500000 of 50000000 tuples (21%) done (elapsed 157.80 s, remaining 593.63 s) 2023-07-21T22:22:14.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:14 smithi187 ceph-mon[96918]: pgmap v94: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 36 MiB/s wr, 55 op/s 2023-07-21T22:22:14.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:14 smithi195 ceph-mon[97365]: pgmap v94: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 36 MiB/s wr, 55 op/s 2023-07-21T22:22:14.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:14 smithi151 ceph-mon[95510]: pgmap v94: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 36 MiB/s wr, 55 op/s 2023-07-21T22:22:15.589 INFO:teuthology.orchestra.run.smithi151.stderr:10600000 of 50000000 tuples (21%) done (elapsed 159.08 s, remaining 591.30 s) 2023-07-21T22:22:16.806 INFO:teuthology.orchestra.run.smithi151.stderr:10700000 of 50000000 tuples (21%) done (elapsed 160.30 s, remaining 588.76 s) 2023-07-21T22:22:16.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:16 smithi187 ceph-mon[96918]: pgmap v95: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 23 MiB/s wr, 33 op/s 2023-07-21T22:22:16.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:16 smithi195 ceph-mon[97365]: pgmap v95: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 23 MiB/s wr, 33 op/s 2023-07-21T22:22:16.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:16 smithi151 ceph-mon[95510]: pgmap v95: 97 pgs: 97 active+clean; 2.4 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 23 MiB/s wr, 33 op/s 2023-07-21T22:22:18.004 INFO:teuthology.orchestra.run.smithi151.stderr:10800000 of 50000000 tuples (21%) done (elapsed 161.50 s, remaining 586.17 s) 2023-07-21T22:22:18.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:18 smithi187 ceph-mon[96918]: pgmap v96: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-07-21T22:22:18.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:18 smithi195 ceph-mon[97365]: pgmap v96: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-07-21T22:22:18.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:18 smithi151 ceph-mon[95510]: pgmap v96: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 36 MiB/s wr, 42 op/s 2023-07-21T22:22:19.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.012+0000 7f6005dff700 1 -- 172.21.15.151:0/2485385933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6000073160 msgr2=0x7f600010beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:19.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.012+0000 7f6005dff700 1 --2- 172.21.15.151:0/2485385933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6000073160 0x7f600010beb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4009990 tx=0x7f5ff4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.013+0000 7f6005dff700 1 -- 172.21.15.151:0/2485385933 shutdown_connections 2023-07-21T22:22:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.013+0000 7f6005dff700 1 --2- 172.21.15.151:0/2485385933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f600010c3f0 0x7f600010e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.013+0000 7f6005dff700 1 --2- 172.21.15.151:0/2485385933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6000072850 0x7f6000072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.013+0000 7f6005dff700 1 --2- 172.21.15.151:0/2485385933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6000073160 0x7f600010beb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.013+0000 7f6005dff700 1 -- 172.21.15.151:0/2485385933 >> 172.21.15.151:0/2485385933 conn(0x7f60000fb650 msgr2=0x7f60000fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:19.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.013+0000 7f6005dff700 1 -- 172.21.15.151:0/2485385933 shutdown_connections 2023-07-21T22:22:19.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.013+0000 7f6005dff700 1 -- 172.21.15.151:0/2485385933 wait complete. 2023-07-21T22:22:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.014+0000 7f6005dff700 1 Processor -- start 2023-07-21T22:22:19.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.014+0000 7f6005dff700 1 -- start start 2023-07-21T22:22:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.014+0000 7f6005dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6000072850 0x7f6000197da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.014+0000 7f6005dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6000073160 0x7f60001982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.014+0000 7f6005dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600010c3f0 0x7f600019c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.014+0000 7f6005dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600019cf90 con 0x7f600010c3f0 2023-07-21T22:22:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.014+0000 7f6005dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600019d100 con 0x7f6000072850 2023-07-21T22:22:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.014+0000 7f6005dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f600019d2c0 con 0x7f6000073160 2023-07-21T22:22:19.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5fff7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6000072850 0x7f6000197da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5fff7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6000072850 0x7f6000197da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43454/0 (socket says 172.21.15.151:43454) 2023-07-21T22:22:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6000073160 0x7f60001982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5fff7fe700 1 -- 172.21.15.151:0/2469254735 learned_addr learned my addr 172.21.15.151:0/2469254735 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5ffffff700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600010c3f0 0x7f600019c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5fff7fe700 1 -- 172.21.15.151:0/2469254735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6000073160 msgr2=0x7f60001982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6000073160 0x7f60001982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5fff7fe700 1 -- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600010c3f0 msgr2=0x7f600019c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:19.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600010c3f0 0x7f600019c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5fff7fe700 1 -- 172.21.15.151:0/2469254735 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ff40095f0 con 0x7f6000072850 2023-07-21T22:22:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6000073160 0x7f60001982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.015+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6000072850 0x7f6000197da0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000e9a0 tx=0x7f5ff000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.016+0000 7f5ffcff9700 1 -- 172.21.15.151:0/2469254735 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0009790 con 0x7f6000072850 2023-07-21T22:22:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.016+0000 7f5ffcff9700 1 -- 172.21.15.151:0/2469254735 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ff0010430 con 0x7f6000072850 2023-07-21T22:22:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.016+0000 7f6005dff700 1 -- 172.21.15.151:0/2469254735 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f600019d5a0 con 0x7f6000072850 2023-07-21T22:22:19.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.016+0000 7f5ffcff9700 1 -- 172.21.15.151:0/2469254735 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff000cea0 con 0x7f6000072850 2023-07-21T22:22:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.016+0000 7f6005dff700 1 -- 172.21.15.151:0/2469254735 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60001a4de0 con 0x7f6000072850 2023-07-21T22:22:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.020+0000 7f5ffcff9700 1 -- 172.21.15.151:0/2469254735 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5ff00105a0 con 0x7f6000072850 2023-07-21T22:22:19.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.021+0000 7f6019789b80 1 Processor -- start 2023-07-21T22:22:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.021+0000 7f6019789b80 1 -- start start 2023-07-21T22:22:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.021+0000 7f6019789b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62dbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.021+0000 7f6019789b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 0x556ff62d5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.021+0000 7f6019789b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 0x556ff62d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.021+0000 7f6019789b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff61dbc50 con 0x556ff61326b0 2023-07-21T22:22:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f6019789b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff622e9e0 con 0x556ff62dc210 2023-07-21T22:22:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f6019789b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff6227e70 con 0x556ff62dc660 2023-07-21T22:22:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62dbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62dbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56210/0 (socket says 172.21.15.151:56210) 2023-07-21T22:22:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffffff700 1 -- 172.21.15.151:0/272279337 learned_addr learned my addr 172.21.15.151:0/272279337 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 0x556ff62d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 0x556ff62d5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffcff9700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fe80a12c0 0x7f5fe80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffeffd700 1 -- 172.21.15.151:0/272279337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 msgr2=0x556ff62d5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 0x556ff62d5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffeffd700 1 -- 172.21.15.151:0/272279337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 msgr2=0x556ff62dbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62dbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffcff9700 1 -- 172.21.15.151:0/2469254735 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5ff0014070 con 0x7f6000072850 2023-07-21T22:22:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.022+0000 7f5ffeffd700 1 -- 172.21.15.151:0/272279337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ff6055d80 con 0x556ff62dc660 2023-07-21T22:22:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.023+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 0x556ff62d5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:22:19.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.023+0000 7f5ffffff700 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62dbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.023+0000 7f5ffffff700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fe80a12c0 0x7f5fe80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.023+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 0x556ff62d64a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4005910 tx=0x7f5ff4005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4cbd4cf98d1d41ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.023+0000 7f5fe5ffb700 1 -- 172.21.15.151:0/272279337 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff401d070 con 0x556ff62dc660 2023-07-21T22:22:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.023+0000 7f5fe5ffb700 1 -- 172.21.15.151:0/272279337 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ff401e040 con 0x556ff62dc660 2023-07-21T22:22:19.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.023+0000 7f5fe5ffb700 1 -- 172.21.15.151:0/272279337 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff4004c80 con 0x556ff62dc660 2023-07-21T22:22:19.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f6019789b80 1 -- 172.21.15.151:0/272279337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 msgr2=0x556ff62d64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:19.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f6019789b80 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 0x556ff62d64a0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4005910 tx=0x7f5ff4005f00 comp rx=0 tx=0).stop 2023-07-21T22:22:19.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f5ffffff700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fe80a12c0 0x7f5fe80a3770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8007620 tx=0x7f5ff8009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:19.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f6019789b80 1 -- 172.21.15.151:0/272279337 shutdown_connections 2023-07-21T22:22:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f6019789b80 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 0x556ff62d64a0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f6019789b80 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62dbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f6019789b80 1 --2- 172.21.15.151:0/272279337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 0x556ff62d5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f6019789b80 1 -- 172.21.15.151:0/272279337 >> 172.21.15.151:0/272279337 conn(0x556ff62cbae0 msgr2=0x556ff62d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f6019789b80 1 -- 172.21.15.151:0/272279337 shutdown_connections 2023-07-21T22:22:19.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.024+0000 7f6019789b80 1 -- 172.21.15.151:0/272279337 wait complete. 2023-07-21T22:22:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.025+0000 7f6019789b80 1 -- start start 2023-07-21T22:22:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.025+0000 7f6019789b80 1 Processor -- start 2023-07-21T22:22:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.025+0000 7f6019789b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62e5560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.025+0000 7f6019789b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62e5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.025+0000 7f6019789b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 0x556ff62df7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f6019789b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff61c7a60 con 0x556ff62dc210 2023-07-21T22:22:19.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f6019789b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff61c7760 con 0x556ff62dc660 2023-07-21T22:22:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f6019789b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff60ab8c0 con 0x556ff61326b0 2023-07-21T22:22:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f6019789b80 10 client.0 _ll_register_callbacks cb 0x556ff61c5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5fff7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62e5560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5fff7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62e5560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49408/0 (socket says 172.21.15.151:49408) 2023-07-21T22:22:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5fff7fe700 1 -- 172.21.15.151:0/3017922586 learned_addr learned my addr 172.21.15.151:0/3017922586 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5ffffff700 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 0x556ff62df7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62e5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5fff7fe700 1 -- 172.21.15.151:0/3017922586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 msgr2=0x556ff62df7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 0x556ff62df7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5fff7fe700 1 -- 172.21.15.151:0/3017922586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 msgr2=0x556ff62e5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62e5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5fff7fe700 1 -- 172.21.15.151:0/3017922586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ff80112c0 con 0x556ff61326b0 2023-07-21T22:22:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.026+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62e5560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c2d0 tx=0x7f5ff00cac20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e93e6ff25f5934fc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.027+0000 7f5fdeffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:22:19.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.027+0000 7f5fdeffd700 1 -- 172.21.15.151:0/3017922586 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff009a040 con 0x556ff61326b0 2023-07-21T22:22:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.027+0000 7f5fdeffd700 1 -- 172.21.15.151:0/3017922586 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5ff009e070 con 0x556ff61326b0 2023-07-21T22:22:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.027+0000 7f6019789b80 1 -- 172.21.15.151:0/3017922586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556ff6181490 con 0x556ff61326b0 2023-07-21T22:22:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.027+0000 7f5fdeffd700 1 -- 172.21.15.151:0/3017922586 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ff00a2490 con 0x556ff61326b0 2023-07-21T22:22:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.027+0000 7f6019789b80 10 client.25876 fetch_fsmap learned FSMap version 27 2023-07-21T22:22:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.027+0000 7f6019789b80 1 -- 172.21.15.151:0/3017922586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f600010f410 con 0x556ff61326b0 2023-07-21T22:22:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.027+0000 7f5fdeffd700 1 -- 172.21.15.151:0/3017922586 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ff00b8080 con 0x556ff61326b0 2023-07-21T22:22:19.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.027+0000 7f5fdeffd700 1 -- 172.21.15.151:0/3017922586 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5ff00d0070 con 0x556ff61326b0 2023-07-21T22:22:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.028+0000 7f6019789b80 10 client.25876 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:22:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.028+0000 7f6019789b80 10 client.25876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.028+0000 7f6019789b80 20 client.25876 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.028+0000 7f6019789b80 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ff62efa10 0x556ff62f1e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.028+0000 7f6019789b80 4 client.25876 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:22:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.028+0000 7f6019789b80 1 -- 172.21.15.151:0/3017922586 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556ff6220e50 con 0x556ff62efa10 2023-07-21T22:22:19.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.028+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ff62efa10 0x556ff62f1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.028+0000 7f5fdeffd700 10 client.25876 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:19.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.028+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ff62efa10 0x556ff62f1e20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9993964ceacb5e3 server_cookie=e25ab6fb59df0fdf in_seq=0 out_seq=0 2023-07-21T22:22:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.029+0000 7f5fdeffd700 1 -- 172.21.15.151:0/3017922586 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556ff6220e50 con 0x556ff62efa10 2023-07-21T22:22:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.029+0000 7f5fdeffd700 10 client.25876 handle_command_reply: tid=0 2023-07-21T22:22:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.029+0000 7f6019789b80 1 client.25876 shutdown 2023-07-21T22:22:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 -- 172.21.15.151:0/3017922586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 msgr2=0x556ff62e5560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62e5560 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000c2d0 tx=0x7f5ff00cac20 comp rx=0 tx=0).stop 2023-07-21T22:22:19.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 -- 172.21.15.151:0/3017922586 shutdown_connections 2023-07-21T22:22:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ff62efa10 0x556ff62f1e20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 0x556ff62df7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62e5560 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 --2- 172.21.15.151:0/3017922586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62e5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f5fdeffd700 0 client.25876 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 -- 172.21.15.151:0/3017922586 >> 172.21.15.151:0/3017922586 conn(0x556ff62cbae0 msgr2=0x556ff62d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:19.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 -- 172.21.15.151:0/3017922586 shutdown_connections 2023-07-21T22:22:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 1 -- 172.21.15.151:0/3017922586 wait complete. 2023-07-21T22:22:19.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.030+0000 7f6019789b80 20 client.25876 trim_cache size 0 max 16384 2023-07-21T22:22:19.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.052+0000 7f6019789b80 1 Processor -- start 2023-07-21T22:22:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.052+0000 7f6019789b80 1 -- start start 2023-07-21T22:22:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.052+0000 7f6019789b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62d5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.052+0000 7f6019789b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62dd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.052+0000 7f6019789b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 0x556ff62d0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.052+0000 7f6019789b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff62c8b70 con 0x556ff62dc210 2023-07-21T22:22:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.052+0000 7f6019789b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff62e0cb0 con 0x556ff62dc660 2023-07-21T22:22:19.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.052+0000 7f6019789b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff62d64b0 con 0x556ff61326b0 2023-07-21T22:22:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62dd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 0x556ff62d0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62dd1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56228/0 (socket says 172.21.15.151:56228) 2023-07-21T22:22:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffeffd700 1 -- 172.21.15.151:0/1856526928 learned_addr learned my addr 172.21.15.151:0/1856526928 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:19.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62d5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffeffd700 1 -- 172.21.15.151:0/1856526928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 msgr2=0x556ff62d5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62d5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffeffd700 1 -- 172.21.15.151:0/1856526928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 msgr2=0x556ff62d0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 0x556ff62d0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffeffd700 1 -- 172.21.15.151:0/1856526928 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556ff603ec00 con 0x556ff62dc210 2023-07-21T22:22:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62d5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffffff700 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 0x556ff62d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:19.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.053+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62dd1b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4005910 tx=0x7f5ff401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aba4a768df69402 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.054+0000 7f5fe67fc700 1 -- 172.21.15.151:0/1856526928 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff401d040 con 0x556ff62dc210 2023-07-21T22:22:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.054+0000 7f5fe67fc700 1 -- 172.21.15.151:0/1856526928 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ff40344f0 con 0x556ff62dc210 2023-07-21T22:22:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.054+0000 7f5fe67fc700 1 -- 172.21.15.151:0/1856526928 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff400f9b0 con 0x556ff62dc210 2023-07-21T22:22:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 -- 172.21.15.151:0/1856526928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 msgr2=0x556ff62dd1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62dd1b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f5ff4005910 tx=0x7f5ff401a040 comp rx=0 tx=0).stop 2023-07-21T22:22:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 -- 172.21.15.151:0/1856526928 shutdown_connections 2023-07-21T22:22:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc660 0x556ff62d0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff61326b0 0x556ff62d5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 --2- 172.21.15.151:0/1856526928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff62dc210 0x556ff62dd1b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 -- 172.21.15.151:0/1856526928 >> 172.21.15.151:0/1856526928 conn(0x556ff62cbae0 msgr2=0x556ff62dcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 -- 172.21.15.151:0/1856526928 shutdown_connections 2023-07-21T22:22:19.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 -- 172.21.15.151:0/1856526928 wait complete. 2023-07-21T22:22:19.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 -- start start 2023-07-21T22:22:19.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.055+0000 7f6019789b80 1 Processor -- start 2023-07-21T22:22:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f6019789b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62e3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f6019789b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 0x556ff62e3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f6019789b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 0x556ff6342890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f6019789b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff62e41d0 con 0x556ff61326b0 2023-07-21T22:22:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f6019789b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff6342dd0 con 0x556ff62dc210 2023-07-21T22:22:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f6019789b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556ff6342f60 con 0x556ff62dc660 2023-07-21T22:22:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f6019789b80 10 client.0 _ll_register_callbacks cb 0x7f5ff0099ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:19.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f5fff7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62e3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f5ffeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 0x556ff62e3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f5fff7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62e3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56236/0 (socket says 172.21.15.151:56236) 2023-07-21T22:22:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f5fff7fe700 1 -- 172.21.15.151:0/2852672808 learned_addr learned my addr 172.21.15.151:0/2852672808 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.056+0000 7f5ffffff700 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 0x556ff6342890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fff7fe700 1 -- 172.21.15.151:0/2852672808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 msgr2=0x556ff6342890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 0x556ff6342890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fff7fe700 1 -- 172.21.15.151:0/2852672808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 msgr2=0x556ff62e3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 0x556ff62e3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fff7fe700 1 -- 172.21.15.151:0/2852672808 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600010f410 con 0x556ff61326b0 2023-07-21T22:22:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fff7fe700 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62e3560 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00a2400 tx=0x7f5ff0099310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8d4e6cfffaa869e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fdeffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:22:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fdeffd700 1 -- 172.21.15.151:0/2852672808 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ff00961f0 con 0x556ff61326b0 2023-07-21T22:22:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fdeffd700 1 -- 172.21.15.151:0/2852672808 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5ff009e070 con 0x556ff61326b0 2023-07-21T22:22:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f6019789b80 1 -- 172.21.15.151:0/2852672808 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5ff401e040 con 0x556ff61326b0 2023-07-21T22:22:19.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f5fdeffd700 1 -- 172.21.15.151:0/2852672808 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5ff009a040 con 0x556ff61326b0 2023-07-21T22:22:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f6019789b80 10 client.16101 fetch_fsmap learned FSMap version 27 2023-07-21T22:22:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.057+0000 7f6019789b80 1 -- 172.21.15.151:0/2852672808 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) v3 -- 0x7f5ff8011450 con 0x556ff61326b0 2023-07-21T22:22:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.058+0000 7f5fdeffd700 1 -- 172.21.15.151:0/2852672808 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5ff00c8020 con 0x556ff61326b0 2023-07-21T22:22:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.058+0000 7f5fdeffd700 1 -- 172.21.15.151:0/2852672808 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 27) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5ff009ae20 con 0x556ff61326b0 2023-07-21T22:22:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.058+0000 7f6019789b80 10 client.16101 fetch_fsmap finished waiting for FSMap version 27 2023-07-21T22:22:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.058+0000 7f6019789b80 10 client.16101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.058+0000 7f6019789b80 20 client.16101 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:19.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.058+0000 7f6019789b80 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ff6344400 0x556ff6346810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.058+0000 7f6019789b80 4 client.16101 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:22:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.058+0000 7f6019789b80 1 -- 172.21.15.151:0/2852672808 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556ff61e2ff0 con 0x556ff6344400 2023-07-21T22:22:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.058+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ff6344400 0x556ff6346810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.059+0000 7f5ffeffd700 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ff6344400 0x556ff6346810 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ff9c3d1ad678391 server_cookie=3e3dce079e4c6975 in_seq=0 out_seq=0 2023-07-21T22:22:19.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.059+0000 7f5fdeffd700 10 client.16101 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.077+0000 7f5fdeffd700 1 -- 172.21.15.151:0/2852672808 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556ff61e2ff0 con 0x556ff6344400 2023-07-21T22:22:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f5fdeffd700 10 client.16101 handle_command_reply: tid=0 2023-07-21T22:22:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 client.16101 shutdown 2023-07-21T22:22:19.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 -- 172.21.15.151:0/2852672808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 msgr2=0x556ff62e3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62e3560 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00a2400 tx=0x7f5ff0099310 comp rx=0 tx=0).stop 2023-07-21T22:22:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 -- 172.21.15.151:0/2852672808 shutdown_connections 2023-07-21T22:22:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556ff6344400 0x556ff6346810 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556ff62dc660 0x556ff6342890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556ff61326b0 0x556ff62e3560 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 --2- 172.21.15.151:0/2852672808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556ff62dc210 0x556ff62e3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 -- 172.21.15.151:0/2852672808 >> 172.21.15.151:0/2852672808 conn(0x556ff62cbae0 msgr2=0x556ff62df760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f5fdeffd700 0 client.16101 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 -- 172.21.15.151:0/2852672808 shutdown_connections 2023-07-21T22:22:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 1 -- 172.21.15.151:0/2852672808 wait complete. 2023-07-21T22:22:19.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.078+0000 7f6019789b80 20 client.16101 trim_cache size 0 max 16384 2023-07-21T22:22:19.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:22:19.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:22:19.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:22:19.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:22:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 -- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fe80a12c0 msgr2=0x7f5fe80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fe80a12c0 0x7f5fe80a3770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5ff8007620 tx=0x7f5ff8009040 comp rx=0 tx=0).stop 2023-07-21T22:22:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 -- 172.21.15.151:0/2469254735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6000072850 msgr2=0x7f6000197da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6000072850 0x7f6000197da0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5ff000e9a0 tx=0x7f5ff000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 -- 172.21.15.151:0/2469254735 shutdown_connections 2023-07-21T22:22:19.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fe80a12c0 0x7f5fe80a3770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6000072850 0x7f6000197da0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f600010c3f0 0x7f600019c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 --2- 172.21.15.151:0/2469254735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6000073160 0x7f60001982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 -- 172.21.15.151:0/2469254735 >> 172.21.15.151:0/2469254735 conn(0x7f60000fb650 msgr2=0x7f600010e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 -- 172.21.15.151:0/2469254735 shutdown_connections 2023-07-21T22:22:19.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:19.079+0000 7f6005dff700 1 -- 172.21.15.151:0/2469254735 wait complete. 2023-07-21T22:22:19.232 INFO:teuthology.orchestra.run.smithi151.stderr:10900000 of 50000000 tuples (21%) done (elapsed 162.72 s, remaining 583.71 s) 2023-07-21T22:22:20.450 INFO:teuthology.orchestra.run.smithi151.stderr:11000000 of 50000000 tuples (22%) done (elapsed 163.94 s, remaining 581.25 s) 2023-07-21T22:22:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:20 smithi187 ceph-mon[96918]: pgmap v97: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 17 op/s 2023-07-21T22:22:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:20 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:22:20.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:20 smithi195 ceph-mon[97365]: pgmap v97: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 17 op/s 2023-07-21T22:22:20.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:20 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:22:20.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:20 smithi151 ceph-mon[95510]: pgmap v97: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 17 op/s 2023-07-21T22:22:20.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:20 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:22:21.729 INFO:teuthology.orchestra.run.smithi151.stderr:11100000 of 50000000 tuples (22%) done (elapsed 165.22 s, remaining 579.02 s) 2023-07-21T22:22:22.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:22 smithi187 ceph-mon[96918]: pgmap v98: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 17 op/s 2023-07-21T22:22:22.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:22 smithi195 ceph-mon[97365]: pgmap v98: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 17 op/s 2023-07-21T22:22:22.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:22 smithi151 ceph-mon[95510]: pgmap v98: 97 pgs: 97 active+clean; 2.5 GiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 25 MiB/s wr, 17 op/s 2023-07-21T22:22:22.964 INFO:teuthology.orchestra.run.smithi151.stderr:11200000 of 50000000 tuples (22%) done (elapsed 166.46 s, remaining 576.65 s) 2023-07-21T22:22:23.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:23 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:22:23.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:23 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:22:23.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:23 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:22:24.233 INFO:teuthology.orchestra.run.smithi151.stderr:11300000 of 50000000 tuples (22%) done (elapsed 167.73 s, remaining 574.42 s) 2023-07-21T22:22:24.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:24 smithi187 ceph-mon[96918]: pgmap v99: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:22:24.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:22:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:22:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:22:24.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:24 smithi195 ceph-mon[97365]: pgmap v99: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:22:24.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:22:24.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:22:24.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:22:24.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:24 smithi151 ceph-mon[95510]: pgmap v99: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:22:24.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:22:24.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:22:24.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:22:25.428 INFO:teuthology.orchestra.run.smithi151.stderr:11400000 of 50000000 tuples (22%) done (elapsed 168.92 s, remaining 571.96 s) 2023-07-21T22:22:26.716 INFO:teuthology.orchestra.run.smithi151.stderr:11500000 of 50000000 tuples (23%) done (elapsed 170.21 s, remaining 569.83 s) 2023-07-21T22:22:26.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:26 smithi187 ceph-mon[96918]: pgmap v100: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-07-21T22:22:26.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:26 smithi195 ceph-mon[97365]: pgmap v100: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-07-21T22:22:26.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:26 smithi151 ceph-mon[95510]: pgmap v100: 97 pgs: 97 active+clean; 2.6 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 24 MiB/s wr, 20 op/s 2023-07-21T22:22:27.916 INFO:teuthology.orchestra.run.smithi151.stderr:11600000 of 50000000 tuples (23%) done (elapsed 171.41 s, remaining 567.42 s) 2023-07-21T22:22:28.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:28 smithi187 ceph-mon[96918]: pgmap v101: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:22:28.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:28 smithi195 ceph-mon[97365]: pgmap v101: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:22:28.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:28 smithi151 ceph-mon[95510]: pgmap v101: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:22:29.110 INFO:teuthology.orchestra.run.smithi151.stderr:11700000 of 50000000 tuples (23%) done (elapsed 172.60 s, remaining 565.01 s) 2023-07-21T22:22:29.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:29 smithi187 ceph-mon[96918]: pgmap v102: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:22:29.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:29 smithi195 ceph-mon[97365]: pgmap v102: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:22:29.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:29 smithi151 ceph-mon[95510]: pgmap v102: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:22:30.406 INFO:teuthology.orchestra.run.smithi151.stderr:11800000 of 50000000 tuples (23%) done (elapsed 173.90 s, remaining 562.96 s) 2023-07-21T22:22:30.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:30 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:22:30.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:30 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:22:30.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:30 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:22:31.609 INFO:teuthology.orchestra.run.smithi151.stderr:11900000 of 50000000 tuples (23%) done (elapsed 175.10 s, remaining 560.62 s) 2023-07-21T22:22:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.244+0000 7f48095ff700 1 -- 172.21.15.151:0/3861776521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 msgr2=0x7f48040fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.244+0000 7f48095ff700 1 --2- 172.21.15.151:0/3861776521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 0x7f48040fffa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009990 tx=0x7f47f8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.244+0000 7f48095ff700 1 -- 172.21.15.151:0/3861776521 shutdown_connections 2023-07-21T22:22:32.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.244+0000 7f48095ff700 1 --2- 172.21.15.151:0/3861776521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4804105b60 0x7f4804105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.244+0000 7f48095ff700 1 --2- 172.21.15.151:0/3861776521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48041004e0 0x7f480410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.244+0000 7f48095ff700 1 --2- 172.21.15.151:0/3861776521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 0x7f48040fffa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.244+0000 7f48095ff700 1 -- 172.21.15.151:0/3861776521 >> 172.21.15.151:0/3861776521 conn(0x7f48040fb5f0 msgr2=0x7f48040fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.244+0000 7f48095ff700 1 -- 172.21.15.151:0/3861776521 shutdown_connections 2023-07-21T22:22:32.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.245+0000 7f48095ff700 1 -- 172.21.15.151:0/3861776521 wait complete. 2023-07-21T22:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.246+0000 7f48095ff700 1 Processor -- start 2023-07-21T22:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.246+0000 7f48095ff700 1 -- start start 2023-07-21T22:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.246+0000 7f48095ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 0x7f48040729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.246+0000 7f48095ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48041004e0 0x7f4804072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.246+0000 7f48095ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4804105b60 0x7f48041a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.246+0000 7f48095ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041a41c0 con 0x7f48041004e0 2023-07-21T22:22:32.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.246+0000 7f48095ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041a4300 con 0x7f4804105b60 2023-07-21T22:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.246+0000 7f48095ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48041a4470 con 0x7f48040ffb30 2023-07-21T22:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 0x7f48040729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f48027fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48041004e0 0x7f4804072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f48037fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4804105b60 0x7f48041a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 0x7f48040729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58002/0 (socket says 172.21.15.151:58002) 2023-07-21T22:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f4802ffd700 1 -- 172.21.15.151:0/2804043159 learned_addr learned my addr 172.21.15.151:0/2804043159 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:32.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f4802ffd700 1 -- 172.21.15.151:0/2804043159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4804105b60 msgr2=0x7f48041a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f4802ffd700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4804105b60 0x7f48041a3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f4802ffd700 1 -- 172.21.15.151:0/2804043159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48041004e0 msgr2=0x7f4804072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f4802ffd700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48041004e0 0x7f4804072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f4802ffd700 1 -- 172.21.15.151:0/2804043159 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f80095f0 con 0x7f48040ffb30 2023-07-21T22:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f4802ffd700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 0x7f48040729f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47f400e9a0 tx=0x7f47f400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.247+0000 7f47ebfff700 1 -- 172.21.15.151:0/2804043159 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f4009790 con 0x7f48040ffb30 2023-07-21T22:22:32.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.248+0000 7f47ebfff700 1 -- 172.21.15.151:0/2804043159 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f4010430 con 0x7f48040ffb30 2023-07-21T22:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.248+0000 7f48095ff700 1 -- 172.21.15.151:0/2804043159 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48041a4750 con 0x7f48040ffb30 2023-07-21T22:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.248+0000 7f47ebfff700 1 -- 172.21.15.151:0/2804043159 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f400cea0 con 0x7f48040ffb30 2023-07-21T22:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.248+0000 7f48095ff700 1 -- 172.21.15.151:0/2804043159 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48041a4c60 con 0x7f48040ffb30 2023-07-21T22:22:32.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.251+0000 7f47ebfff700 1 -- 172.21.15.151:0/2804043159 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f47f40105a0 con 0x7f48040ffb30 2023-07-21T22:22:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.253+0000 7f481cf83b80 1 Processor -- start 2023-07-21T22:22:32.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.253+0000 7f481cf83b80 1 -- start start 2023-07-21T22:22:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc888cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889210 0x55accc882f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889660 0x55accc8834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f481cf83b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc788c50 con 0x55accc889210 2023-07-21T22:22:32.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f481cf83b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc7db9e0 con 0x55accc6df6b0 2023-07-21T22:22:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f481cf83b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc7d4e70 con 0x55accc889660 2023-07-21T22:22:32.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f47ebfff700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47ec0a12c0 0x7f47ec0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f48027fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889660 0x55accc8834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f48037fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc888cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f48027fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889660 0x55accc8834a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58008/0 (socket says 172.21.15.151:58008) 2023-07-21T22:22:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f48027fc700 1 -- 172.21.15.151:0/1115448456 learned_addr learned my addr 172.21.15.151:0/1115448456 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f4802ffd700 1 --2- 172.21.15.151:0/1115448456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889210 0x55accc882f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f47ebfff700 1 -- 172.21.15.151:0/2804043159 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f47f4014070 con 0x7f48040ffb30 2023-07-21T22:22:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f48037fe700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47ec0a12c0 0x7f47ec0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.254+0000 7f48027fc700 1 -- 172.21.15.151:0/1115448456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 msgr2=0x55accc888cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.255+0000 7f48027fc700 1 --2- 172.21.15.151:0/1115448456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc888cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.255+0000 7f48027fc700 1 -- 172.21.15.151:0/1115448456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889210 msgr2=0x55accc882f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.255+0000 7f48027fc700 1 --2- 172.21.15.151:0/1115448456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889210 0x55accc882f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.255+0000 7f48027fc700 1 -- 172.21.15.151:0/1115448456 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55accc602d80 con 0x55accc889660 2023-07-21T22:22:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.255+0000 7f48027fc700 1 --2- 172.21.15.151:0/1115448456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889660 0x55accc8834a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009990 tx=0x7f47f8005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8610b1a2cbbbd588 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:32.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.255+0000 7f48037fe700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47ec0a12c0 0x7f47ec0a3770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009ec0 tx=0x7f47fc00b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.255+0000 7f47e97fa700 1 -- 172.21.15.151:0/1115448456 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f801d070 con 0x55accc889660 2023-07-21T22:22:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.255+0000 7f47e97fa700 1 -- 172.21.15.151:0/1115448456 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f801e040 con 0x55accc889660 2023-07-21T22:22:32.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.255+0000 7f47e97fa700 1 -- 172.21.15.151:0/1115448456 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f8004740 con 0x55accc889660 2023-07-21T22:22:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.256+0000 7f481cf83b80 1 -- 172.21.15.151:0/1115448456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889660 msgr2=0x55accc8834a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.256+0000 7f481cf83b80 1 --2- 172.21.15.151:0/1115448456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889660 0x55accc8834a0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f47f8009990 tx=0x7f47f8005f00 comp rx=0 tx=0).stop 2023-07-21T22:22:32.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.256+0000 7f481cf83b80 1 -- 172.21.15.151:0/1115448456 shutdown_connections 2023-07-21T22:22:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.256+0000 7f481cf83b80 1 --2- 172.21.15.151:0/1115448456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc888cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.256+0000 7f481cf83b80 1 --2- 172.21.15.151:0/1115448456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889660 0x55accc8834a0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.256+0000 7f481cf83b80 1 --2- 172.21.15.151:0/1115448456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889210 0x55accc882f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.256+0000 7f481cf83b80 1 -- 172.21.15.151:0/1115448456 >> 172.21.15.151:0/1115448456 conn(0x55accc878ae0 msgr2=0x55accc87e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.256+0000 7f481cf83b80 1 -- 172.21.15.151:0/1115448456 shutdown_connections 2023-07-21T22:22:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.256+0000 7f481cf83b80 1 -- 172.21.15.151:0/1115448456 wait complete. 2023-07-21T22:22:32.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.257+0000 7f481cf83b80 1 -- start start 2023-07-21T22:22:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.257+0000 7f481cf83b80 1 Processor -- start 2023-07-21T22:22:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc88f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc88c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 0x55accc88ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f481cf83b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc774a60 con 0x55accc889660 2023-07-21T22:22:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f481cf83b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc774760 con 0x55accc6df6b0 2023-07-21T22:22:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f481cf83b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc6588c0 con 0x55accc889210 2023-07-21T22:22:32.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f481cf83b80 10 client.0 _ll_register_callbacks cb 0x55accc772700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f48037fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 0x55accc88ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc88f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f48027fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc88c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f48027fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc88c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58014/0 (socket says 172.21.15.151:58014) 2023-07-21T22:22:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc88f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52154/0 (socket says 172.21.15.151:52154) 2023-07-21T22:22:32.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.258+0000 7f48027fc700 1 -- 172.21.15.151:0/2257257052 learned_addr learned my addr 172.21.15.151:0/2257257052 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f48027fc700 1 -- 172.21.15.151:0/2257257052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 msgr2=0x55accc88f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f48027fc700 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc88f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f48027fc700 1 -- 172.21.15.151:0/2257257052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 msgr2=0x55accc88ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f48027fc700 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 0x55accc88ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f48027fc700 1 -- 172.21.15.151:0/2257257052 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f480410d220 con 0x55accc889210 2023-07-21T22:22:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f4802ffd700 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc88f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f48027fc700 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc88c730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47f800bd70 tx=0x7f47f8009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a390fa7578153b6f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f47e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:22:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2257257052 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f801d070 con 0x55accc889210 2023-07-21T22:22:32.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f481cf83b80 1 -- 172.21.15.151:0/2257257052 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55accc72e490 con 0x55accc889210 2023-07-21T22:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.259+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2257257052 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f47f800ba20 con 0x55accc889210 2023-07-21T22:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2257257052 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47f8004700 con 0x55accc889210 2023-07-21T22:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f481cf83b80 10 client.25894 fetch_fsmap learned FSMap version 29 2023-07-21T22:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f481cf83b80 1 -- 172.21.15.151:0/2257257052 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55accc5ebc00 con 0x55accc889210 2023-07-21T22:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2257257052 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55accc72e490 con 0x55accc889210 2023-07-21T22:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2257257052 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47f800f990 con 0x55accc889210 2023-07-21T22:22:32.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f481cf83b80 10 client.25894 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f481cf83b80 10 client.25894 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f481cf83b80 20 client.25894 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55accc89c5b0 0x55accc89e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f481cf83b80 4 client.25894 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:22:32.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.260+0000 7f481cf83b80 1 -- 172.21.15.151:0/2257257052 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55accc7cde50 con 0x55accc89c5b0 2023-07-21T22:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.261+0000 7f4802ffd700 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55accc89c5b0 0x55accc89e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.261+0000 7f47e6ff5700 10 client.25894 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.261+0000 7f4802ffd700 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55accc89c5b0 0x55accc89e9c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6104b5d9749fd2e server_cookie=e0485c8a5c491615 in_seq=0 out_seq=0 2023-07-21T22:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2257257052 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55accc7cde50 con 0x55accc89c5b0 2023-07-21T22:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f47e6ff5700 10 client.25894 handle_command_reply: tid=0 2023-07-21T22:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 client.25894 shutdown 2023-07-21T22:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 -- 172.21.15.151:0/2257257052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 msgr2=0x55accc88c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc88c730 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f47f800bd70 tx=0x7f47f8009310 comp rx=0 tx=0).stop 2023-07-21T22:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 -- 172.21.15.151:0/2257257052 shutdown_connections 2023-07-21T22:22:32.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55accc89c5b0 0x55accc89e9c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc6df6b0 0x55accc88f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 0x55accc88ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f47e6ff5700 0 client.25894 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2257257052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc88c730 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 -- 172.21.15.151:0/2257257052 >> 172.21.15.151:0/2257257052 conn(0x55accc878ae0 msgr2=0x55accc87d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.262+0000 7f481cf83b80 1 -- 172.21.15.151:0/2257257052 shutdown_connections 2023-07-21T22:22:32.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.263+0000 7f481cf83b80 1 -- 172.21.15.151:0/2257257052 wait complete. 2023-07-21T22:22:32.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.263+0000 7f481cf83b80 20 client.25894 trim_cache size 0 max 16384 2023-07-21T22:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.284+0000 7f481cf83b80 1 Processor -- start 2023-07-21T22:22:32.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.284+0000 7f481cf83b80 1 -- start start 2023-07-21T22:22:32.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc6df6b0 0x55accc882f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889210 0x55accc893ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 0x55accc88bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f481cf83b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc87ef80 con 0x55accc889660 2023-07-21T22:22:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f481cf83b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc87f760 con 0x55accc889210 2023-07-21T22:22:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f481cf83b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc883480 con 0x55accc6df6b0 2023-07-21T22:22:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc6df6b0 0x55accc882f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f48037fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 0x55accc88bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f48027fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889210 0x55accc893ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc6df6b0 0x55accc882f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58022/0 (socket says 172.21.15.151:58022) 2023-07-21T22:22:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f4802ffd700 1 -- 172.21.15.151:0/3167530579 learned_addr learned my addr 172.21.15.151:0/3167530579 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f48027fc700 1 -- 172.21.15.151:0/3167530579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc6df6b0 msgr2=0x55accc882f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f48027fc700 1 --2- 172.21.15.151:0/3167530579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc6df6b0 0x55accc882f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f48027fc700 1 -- 172.21.15.151:0/3167530579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 msgr2=0x55accc88bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:32.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f48027fc700 1 --2- 172.21.15.151:0/3167530579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 0x55accc88bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f48027fc700 1 -- 172.21.15.151:0/3167530579 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55accc6291f0 con 0x55accc889210 2023-07-21T22:22:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.285+0000 7f4802ffd700 1 --2- 172.21.15.151:0/3167530579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc6df6b0 0x55accc882f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:32.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.286+0000 7f48027fc700 1 --2- 172.21.15.151:0/3167530579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889210 0x55accc893ba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47f80373d0 tx=0x7f47f8009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b389f14b7c5c696 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.286+0000 7f47e9ffb700 1 -- 172.21.15.151:0/3167530579 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f801d070 con 0x55accc889210 2023-07-21T22:22:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.286+0000 7f47e9ffb700 1 -- 172.21.15.151:0/3167530579 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f802c450 con 0x55accc889210 2023-07-21T22:22:32.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.286+0000 7f47e9ffb700 1 -- 172.21.15.151:0/3167530579 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f802ca20 con 0x55accc889210 2023-07-21T22:22:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 -- 172.21.15.151:0/3167530579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889210 msgr2=0x55accc893ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 --2- 172.21.15.151:0/3167530579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889210 0x55accc893ba0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f47f80373d0 tx=0x7f47f8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 -- 172.21.15.151:0/3167530579 shutdown_connections 2023-07-21T22:22:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 --2- 172.21.15.151:0/3167530579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc889660 0x55accc88bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 --2- 172.21.15.151:0/3167530579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc6df6b0 0x55accc882f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 --2- 172.21.15.151:0/3167530579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889210 0x55accc893ba0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 -- 172.21.15.151:0/3167530579 >> 172.21.15.151:0/3167530579 conn(0x55accc878ae0 msgr2=0x55accc886890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 -- 172.21.15.151:0/3167530579 shutdown_connections 2023-07-21T22:22:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 -- 172.21.15.151:0/3167530579 wait complete. 2023-07-21T22:22:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.287+0000 7f481cf83b80 1 -- start start 2023-07-21T22:22:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.288+0000 7f481cf83b80 1 Processor -- start 2023-07-21T22:22:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.288+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc6df6b0 0x55accc884730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.288+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc884c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.288+0000 7f481cf83b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889660 0x55accc8851b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.288+0000 7f481cf83b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc8858c0 con 0x55accc6df6b0 2023-07-21T22:22:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.288+0000 7f481cf83b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc885a30 con 0x55accc889660 2023-07-21T22:22:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.288+0000 7f481cf83b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55accc885bf0 con 0x55accc889210 2023-07-21T22:22:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.288+0000 7f481cf83b80 10 client.0 _ll_register_callbacks cb 0x7f47fc009360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc6df6b0 0x55accc884730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f48037fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889660 0x55accc8851b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f48027fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc884c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f4802ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc6df6b0 0x55accc884730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44004/0 (socket says 172.21.15.151:44004) 2023-07-21T22:22:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f48037fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889660 0x55accc8851b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52164/0 (socket says 172.21.15.151:52164) 2023-07-21T22:22:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f4802ffd700 1 -- 172.21.15.151:0/2950288883 learned_addr learned my addr 172.21.15.151:0/2950288883 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f4802ffd700 1 -- 172.21.15.151:0/2950288883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 msgr2=0x55accc884c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f4802ffd700 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc884c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f4802ffd700 1 -- 172.21.15.151:0/2950288883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889660 msgr2=0x55accc8851b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f4802ffd700 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889660 0x55accc8851b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f4802ffd700 1 -- 172.21.15.151:0/2950288883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48041a4c60 con 0x55accc6df6b0 2023-07-21T22:22:32.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f48037fe700 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889660 0x55accc8851b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f4802ffd700 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc6df6b0 0x55accc884730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f47f4099fd0 tx=0x7f47f4096430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=869429d2383ce24a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.289+0000 7f47e6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:22:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2950288883 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47f409e070 con 0x55accc6df6b0 2023-07-21T22:22:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2950288883 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f47f40a2490 con 0x55accc6df6b0 2023-07-21T22:22:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f481cf83b80 1 -- 172.21.15.151:0/2950288883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47f801e040 con 0x55accc6df6b0 2023-07-21T22:22:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2950288883 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47f40ca270 con 0x55accc6df6b0 2023-07-21T22:22:32.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f481cf83b80 10 client.16119 fetch_fsmap learned FSMap version 29 2023-07-21T22:22:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f481cf83b80 1 -- 172.21.15.151:0/2950288883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55accc5ebc00 con 0x55accc6df6b0 2023-07-21T22:22:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2950288883 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47f4063070 con 0x55accc6df6b0 2023-07-21T22:22:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2950288883 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47f40a2000 con 0x55accc6df6b0 2023-07-21T22:22:32.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f481cf83b80 10 client.16119 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:22:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f481cf83b80 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f481cf83b80 20 client.16119 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.290+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55accc8f10f0 0x55accc8f3500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.291+0000 7f481cf83b80 4 client.16119 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:22:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.291+0000 7f481cf83b80 1 -- 172.21.15.151:0/2950288883 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55accc78fff0 con 0x55accc8f10f0 2023-07-21T22:22:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.291+0000 7f48027fc700 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55accc8f10f0 0x55accc8f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:32.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.291+0000 7f48027fc700 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55accc8f10f0 0x55accc8f3500 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f975321b94886077 server_cookie=2bdea3c99c2c250b in_seq=0 out_seq=0 2023-07-21T22:22:32.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.291+0000 7f47e6ff5700 10 client.16119 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f47e6ff5700 1 -- 172.21.15.151:0/2950288883 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55accc78fff0 con 0x55accc8f10f0 2023-07-21T22:22:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f47e6ff5700 10 client.16119 handle_command_reply: tid=0 2023-07-21T22:22:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 client.16119 shutdown 2023-07-21T22:22:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 -- 172.21.15.151:0/2950288883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc6df6b0 msgr2=0x55accc884730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:32.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc6df6b0 0x55accc884730 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f47f4099fd0 tx=0x7f47f4096430 comp rx=0 tx=0).stop 2023-07-21T22:22:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 -- 172.21.15.151:0/2950288883 shutdown_connections 2023-07-21T22:22:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55accc8f10f0 0x55accc8f3500 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55accc889660 0x55accc8851b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55accc6df6b0 0x55accc884730 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f47e6ff5700 0 client.16119 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 --2- 172.21.15.151:0/2950288883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55accc889210 0x55accc884c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 -- 172.21.15.151:0/2950288883 >> 172.21.15.151:0/2950288883 conn(0x55accc878ae0 msgr2=0x55accc88c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 -- 172.21.15.151:0/2950288883 shutdown_connections 2023-07-21T22:22:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.309+0000 7f481cf83b80 1 -- 172.21.15.151:0/2950288883 wait complete. 2023-07-21T22:22:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f481cf83b80 20 client.16119 trim_cache size 0 max 16384 2023-07-21T22:22:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:22:32.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:22:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:22:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:22:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 -- 172.21.15.151:0/2804043159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47ec0a12c0 msgr2=0x7f47ec0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:32.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47ec0a12c0 0x7f47ec0a3770 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f47fc009ec0 tx=0x7f47fc00b040 comp rx=0 tx=0).stop 2023-07-21T22:22:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 -- 172.21.15.151:0/2804043159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 msgr2=0x7f48040729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 0x7f48040729f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f47f400e9a0 tx=0x7f47f400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 -- 172.21.15.151:0/2804043159 shutdown_connections 2023-07-21T22:22:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47ec0a12c0 0x7f47ec0a3770 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4804105b60 0x7f48041a3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48040ffb30 0x7f48040729f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 --2- 172.21.15.151:0/2804043159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48041004e0 0x7f4804072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.310+0000 7f48095ff700 1 -- 172.21.15.151:0/2804043159 >> 172.21.15.151:0/2804043159 conn(0x7f48040fb5f0 msgr2=0x7f4804103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.311+0000 7f48095ff700 1 -- 172.21.15.151:0/2804043159 shutdown_connections 2023-07-21T22:22:32.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:32.311+0000 7f48095ff700 1 -- 172.21.15.151:0/2804043159 wait complete. 2023-07-21T22:22:32.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:32 smithi187 ceph-mon[96918]: pgmap v103: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:22:32.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:32 smithi195 ceph-mon[97365]: pgmap v103: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:22:32.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:32 smithi151 ceph-mon[95510]: pgmap v103: 97 pgs: 97 active+clean; 2.7 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:22:32.848 INFO:teuthology.orchestra.run.smithi151.stderr:12000000 of 50000000 tuples (24%) done (elapsed 176.34 s, remaining 558.41 s) 2023-07-21T22:22:34.152 INFO:teuthology.orchestra.run.smithi151.stderr:12100000 of 50000000 tuples (24%) done (elapsed 177.64 s, remaining 556.42 s) 2023-07-21T22:22:34.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:34 smithi187 ceph-mon[96918]: pgmap v104: 97 pgs: 97 active+clean; 2.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:22:34.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:34 smithi195 ceph-mon[97365]: pgmap v104: 97 pgs: 97 active+clean; 2.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:22:34.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:34 smithi151 ceph-mon[95510]: pgmap v104: 97 pgs: 97 active+clean; 2.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:22:36.592 INFO:teuthology.orchestra.run.smithi151.stderr:12200000 of 50000000 tuples (24%) done (elapsed 180.08 s, remaining 557.96 s) 2023-07-21T22:22:36.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:36 smithi187 ceph-mon[96918]: pgmap v105: 97 pgs: 97 active+clean; 2.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-21T22:22:36.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:36 smithi195 ceph-mon[97365]: pgmap v105: 97 pgs: 97 active+clean; 2.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-21T22:22:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:36 smithi151 ceph-mon[95510]: pgmap v105: 97 pgs: 97 active+clean; 2.8 GiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 16 op/s 2023-07-21T22:22:37.935 INFO:teuthology.orchestra.run.smithi151.stderr:12300000 of 50000000 tuples (24%) done (elapsed 181.43 s, remaining 556.08 s) 2023-07-21T22:22:38.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:38 smithi187 ceph-mon[96918]: pgmap v106: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 33 MiB/s wr, 29 op/s 2023-07-21T22:22:38.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:38 smithi195 ceph-mon[97365]: pgmap v106: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 33 MiB/s wr, 29 op/s 2023-07-21T22:22:38.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:38 smithi151 ceph-mon[95510]: pgmap v106: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 33 MiB/s wr, 29 op/s 2023-07-21T22:22:39.144 INFO:teuthology.orchestra.run.smithi151.stderr:12400000 of 50000000 tuples (24%) done (elapsed 182.64 s, remaining 553.80 s) 2023-07-21T22:22:39.426 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:22:39.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.617+0000 7f7bbd19d700 1 -- 172.21.15.151:0/322811254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bb81013b0 msgr2=0x7f7bb8109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:39.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.617+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/322811254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bb81013b0 0x7f7bb8109a80 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f7bac009990 tx=0x7f7bac009ca0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.663 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.617+0000 7f7bbd19d700 1 -- 172.21.15.151:0/322811254 shutdown_connections 2023-07-21T22:22:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.617+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/322811254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb8100aa0 0x7f7bb8100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.618+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/322811254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bb8109fc0 0x7f7bb810c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.618+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/322811254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bb81013b0 0x7f7bb8109a80 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.618+0000 7f7bbd19d700 1 -- 172.21.15.151:0/322811254 >> 172.21.15.151:0/322811254 conn(0x7f7bb80745d0 msgr2=0x7f7bb80749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:39.664 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.618+0000 7f7bbd19d700 1 -- 172.21.15.151:0/322811254 shutdown_connections 2023-07-21T22:22:39.665 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.618+0000 7f7bbd19d700 1 -- 172.21.15.151:0/322811254 wait complete. 2023-07-21T22:22:39.666 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.619+0000 7f7bbd19d700 1 Processor -- start 2023-07-21T22:22:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.619+0000 7f7bbd19d700 1 -- start start 2023-07-21T22:22:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.619+0000 7f7bbd19d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb8100aa0 0x7f7bb819b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.619+0000 7f7bbd19d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bb81013b0 0x7f7bb819bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bbd19d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bb8109fc0 0x7f7bb8195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bbd19d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8195dd0 con 0x7f7bb8109fc0 2023-07-21T22:22:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bbd19d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8195f40 con 0x7f7bb8100aa0 2023-07-21T22:22:39.667 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bbd19d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bb8196100 con 0x7f7bb81013b0 2023-07-21T22:22:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb8100aa0 0x7f7bb819b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb8100aa0 0x7f7bb819b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50596/0 (socket says 172.21.15.151:50596) 2023-07-21T22:22:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bb7fff700 1 -- 172.21.15.151:0/4152382097 learned_addr learned my addr 172.21.15.151:0/4152382097 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bb81013b0 0x7f7bb819bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bbc99c700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bb8109fc0 0x7f7bb8195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.668 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bb7fff700 1 -- 172.21.15.151:0/4152382097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bb81013b0 msgr2=0x7f7bb819bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bb81013b0 0x7f7bb819bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bb7fff700 1 -- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bb8109fc0 msgr2=0x7f7bb8195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bb8109fc0 0x7f7bb8195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.620+0000 7f7bb7fff700 1 -- 172.21.15.151:0/4152382097 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba8009520 con 0x7f7bb8100aa0 2023-07-21T22:22:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.621+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb8100aa0 0x7f7bb819b620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800eb30 tx=0x7f7ba800ee40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.621+0000 7f7bb57fa700 1 -- 172.21.15.151:0/4152382097 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8009880 con 0x7f7bb8100aa0 2023-07-21T22:22:39.669 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.621+0000 7f7bbd19d700 1 -- 172.21.15.151:0/4152382097 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bac0095f0 con 0x7f7bb8100aa0 2023-07-21T22:22:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.621+0000 7f7bb57fa700 1 -- 172.21.15.151:0/4152382097 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ba800c950 con 0x7f7bb8100aa0 2023-07-21T22:22:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.621+0000 7f7bb57fa700 1 -- 172.21.15.151:0/4152382097 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8003c00 con 0x7f7bb8100aa0 2023-07-21T22:22:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.621+0000 7f7bbd19d700 1 -- 172.21.15.151:0/4152382097 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb80fe9e0 con 0x7f7bb8100aa0 2023-07-21T22:22:39.670 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.624+0000 7f7bb57fa700 1 -- 172.21.15.151:0/4152382097 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f7ba800cac0 con 0x7f7bb8100aa0 2023-07-21T22:22:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.626+0000 7f7bd1d4db80 1 Processor -- start 2023-07-21T22:22:39.671 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.626+0000 7f7bd1d4db80 1 -- start start 2023-07-21T22:22:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb57fa700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7ba00a1360 0x7f7ba00a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345562860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f345562da0 0x55f34556d700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f34556dc40 0x55f345570020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f345468cb0 con 0x55f34556dc40 2023-07-21T22:22:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3454bba40 con 0x55f345562490 2023-07-21T22:22:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3454b4ed0 con 0x55f345562da0 2023-07-21T22:22:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb57fa700 1 -- 172.21.15.151:0/4152382097 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7ba8014070 con 0x7f7bb8100aa0 2023-07-21T22:22:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345562860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f345562da0 0x55f34556d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345562860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50610/0 (socket says 172.21.15.151:50610) 2023-07-21T22:22:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb7fff700 1 -- 172.21.15.151:0/2085117615 learned_addr learned my addr 172.21.15.151:0/2085117615 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f345562da0 0x55f34556d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60782/0 (socket says 172.21.15.151:60782) 2023-07-21T22:22:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bbc99c700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7ba00a1360 0x7f7ba00a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bbc99c700 1 --2- 172.21.15.151:0/2085117615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f34556dc40 0x55f345570020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb77fe700 1 -- 172.21.15.151:0/2085117615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 msgr2=0x55f345562860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/2085117615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345562860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb77fe700 1 -- 172.21.15.151:0/2085117615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f34556dc40 msgr2=0x55f345570020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/2085117615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f34556dc40 0x55f345570020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.627+0000 7f7bb77fe700 1 -- 172.21.15.151:0/2085117615 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f3452e2de0 con 0x55f345562da0 2023-07-21T22:22:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.628+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/2085117615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f345562da0 0x55f34556d700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0098e0 tx=0x7f7bac005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ad8aa98a1f0059b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.628+0000 7f7bbc99c700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7ba00a1360 0x7f7ba00a3810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8073240 tx=0x7f7bb0009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.628+0000 7f7b9e7fc700 1 -- 172.21.15.151:0/2085117615 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac01d070 con 0x55f345562da0 2023-07-21T22:22:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.628+0000 7f7b9e7fc700 1 -- 172.21.15.151:0/2085117615 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bac01e040 con 0x55f345562da0 2023-07-21T22:22:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.628+0000 7f7b9e7fc700 1 -- 172.21.15.151:0/2085117615 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac004740 con 0x55f345562da0 2023-07-21T22:22:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.629+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2085117615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f345562da0 msgr2=0x55f34556d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.629+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2085117615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f345562da0 0x55f34556d700 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7bac0098e0 tx=0x7f7bac005f00 comp rx=0 tx=0).stop 2023-07-21T22:22:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.629+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2085117615 shutdown_connections 2023-07-21T22:22:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.629+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2085117615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345562860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.629+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2085117615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f34556dc40 0x55f345570020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.629+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2085117615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f345562da0 0x55f34556d700 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.629+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2085117615 >> 172.21.15.151:0/2085117615 conn(0x55f345558ef0 msgr2=0x55f34555e860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.629+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2085117615 shutdown_connections 2023-07-21T22:22:39.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.629+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2085117615 wait complete. 2023-07-21T22:22:39.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.630+0000 7f7bd1d4db80 1 -- start start 2023-07-21T22:22:39.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.630+0000 7f7bd1d4db80 1 Processor -- start 2023-07-21T22:22:39.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f34556d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f34556a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f34556adc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f345454ac0 con 0x55f345562da0 2023-07-21T22:22:39.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3454547c0 con 0x55f345562490 2023-07-21T22:22:39.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f345338920 con 0x55f34556dc40 2023-07-21T22:22:39.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bd1d4db80 10 client.0 _ll_register_callbacks cb 0x55f345452760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:39.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f34556d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f34556a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f34556d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50614/0 (socket says 172.21.15.151:50614) 2023-07-21T22:22:39.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb7fff700 1 -- 172.21.15.151:0/3834125053 learned_addr learned my addr 172.21.15.151:0/3834125053 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:39.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bbc99c700 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f34556adc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb7fff700 1 -- 172.21.15.151:0/3834125053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 msgr2=0x55f34556adc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:39.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f34556adc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb7fff700 1 -- 172.21.15.151:0/3834125053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 msgr2=0x55f34556a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:39.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f34556a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb7fff700 1 -- 172.21.15.151:0/3834125053 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bb810d0f0 con 0x55f345562490 2023-07-21T22:22:39.683 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bbc99c700 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f34556adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:22:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.631+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f34556a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.632+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f34556d5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c5b0 tx=0x7f7ba80ac6b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3653004c2d587b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.632+0000 7f7b977fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:22:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.632+0000 7f7b977fe700 1 -- 172.21.15.151:0/3834125053 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba800cdc0 con 0x55f345562490 2023-07-21T22:22:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.632+0000 7f7b977fe700 1 -- 172.21.15.151:0/3834125053 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7ba801e2e0 con 0x55f345562490 2023-07-21T22:22:39.684 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.632+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/3834125053 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f34540e4f0 con 0x55f345562490 2023-07-21T22:22:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.632+0000 7f7b977fe700 1 -- 172.21.15.151:0/3834125053 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ba80ac2a0 con 0x55f345562490 2023-07-21T22:22:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.632+0000 7f7bd1d4db80 10 client.25880 fetch_fsmap learned FSMap version 29 2023-07-21T22:22:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.632+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/3834125053 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f3452cbc60 con 0x55f345562490 2023-07-21T22:22:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.632+0000 7f7b977fe700 1 -- 172.21.15.151:0/3834125053 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ba80c8080 con 0x55f345562490 2023-07-21T22:22:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.633+0000 7f7b977fe700 1 -- 172.21.15.151:0/3834125053 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7ba809a410 con 0x55f345562490 2023-07-21T22:22:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.633+0000 7f7bd1d4db80 10 client.25880 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:22:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.633+0000 7f7bd1d4db80 10 client.25880 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:39.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.633+0000 7f7bd1d4db80 20 client.25880 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.633+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f34557d550 0x55f34557f960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.633+0000 7f7bd1d4db80 4 client.25880 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:22:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.633+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/3834125053 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f3454adeb0 con 0x55f34557d550 2023-07-21T22:22:39.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.633+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f34557d550 0x55f34557f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.634+0000 7f7b977fe700 10 client.25880 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:39.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.634+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f34557d550 0x55f34557f960 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a213f65d10f4b01 server_cookie=6cac5307184e4cbd in_seq=0 out_seq=0 2023-07-21T22:22:39.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7b977fe700 1 -- 172.21.15.151:0/3834125053 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f3454adeb0 con 0x55f34557d550 2023-07-21T22:22:39.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7b977fe700 10 client.25880 handle_command_reply: tid=0 2023-07-21T22:22:39.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 client.25880 shutdown 2023-07-21T22:22:39.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/3834125053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 msgr2=0x55f34556d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:39.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f34556d5f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800c5b0 tx=0x7f7ba80ac6b0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/3834125053 shutdown_connections 2023-07-21T22:22:39.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f34557d550 0x55f34557f960 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f34556d5f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7b977fe700 0 client.25880 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:39.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f34556adc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/3834125053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f34556a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/3834125053 >> 172.21.15.151:0/3834125053 conn(0x55f345558ef0 msgr2=0x55f34555e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:39.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/3834125053 shutdown_connections 2023-07-21T22:22:39.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/3834125053 wait complete. 2023-07-21T22:22:39.690 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.635+0000 7f7bd1d4db80 20 client.25880 trim_cache size 0 max 16384 2023-07-21T22:22:39.698 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.653+0000 7f7bd1d4db80 1 Processor -- start 2023-07-21T22:22:39.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.653+0000 7f7bd1d4db80 1 -- start start 2023-07-21T22:22:39.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562490 0x55f34555da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562da0 0x55f34556d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f345565ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f345563170 con 0x55f345562490 2023-07-21T22:22:39.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f345568d60 con 0x55f345562da0 2023-07-21T22:22:39.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f345565590 con 0x55f34556dc40 2023-07-21T22:22:39.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bb77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562da0 0x55f34556d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562490 0x55f34555da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bb77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562da0 0x55f34556d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50620/0 (socket says 172.21.15.151:50620) 2023-07-21T22:22:39.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bb77fe700 1 -- 172.21.15.151:0/2020459962 learned_addr learned my addr 172.21.15.151:0/2020459962 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:39.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.654+0000 7f7bbc99c700 1 --2- 172.21.15.151:0/2020459962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f345565ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7bb7fff700 1 -- 172.21.15.151:0/2020459962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 msgr2=0x55f345565ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:39.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/2020459962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f345565ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7bb7fff700 1 -- 172.21.15.151:0/2020459962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562da0 msgr2=0x55f34556d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:39.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/2020459962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562da0 0x55f34556d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7bb7fff700 1 -- 172.21.15.151:0/2020459962 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f345309250 con 0x55f345562490 2023-07-21T22:22:39.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/2020459962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562da0 0x55f34556d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:39.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/2020459962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562490 0x55f34555da30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7ba809a140 tx=0x7f7ba8098760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db3b1d761f2d991f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:39.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7b9effd700 1 -- 172.21.15.151:0/2020459962 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba80996a0 con 0x55f345562490 2023-07-21T22:22:39.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7b9effd700 1 -- 172.21.15.151:0/2020459962 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f34540e4f0 con 0x55f345562490 2023-07-21T22:22:39.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.655+0000 7f7b9effd700 1 -- 172.21.15.151:0/2020459962 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ba809e1e0 con 0x55f345562490 2023-07-21T22:22:39.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.656+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2020459962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562490 msgr2=0x55f34555da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:39.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.656+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2020459962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562490 0x55f34555da30 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f7ba809a140 tx=0x7f7ba8098760 comp rx=0 tx=0).stop 2023-07-21T22:22:39.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.656+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2020459962 shutdown_connections 2023-07-21T22:22:39.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.656+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2020459962 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f345565ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.656+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2020459962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562490 0x55f34555da30 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.656+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2020459962 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562da0 0x55f34556d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.656+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2020459962 >> 172.21.15.151:0/2020459962 conn(0x55f345558ef0 msgr2=0x55f345579850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:39.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.656+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2020459962 shutdown_connections 2023-07-21T22:22:39.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.656+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2020459962 wait complete. 2023-07-21T22:22:39.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.657+0000 7f7bd1d4db80 1 -- start start 2023-07-21T22:22:39.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.657+0000 7f7bd1d4db80 1 Processor -- start 2023-07-21T22:22:39.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.657+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345570840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.657+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f345570d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.657+0000 7f7bd1d4db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f3455ca440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.657+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3455ca9c0 con 0x55f345562da0 2023-07-21T22:22:39.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.657+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3455cab30 con 0x55f345562490 2023-07-21T22:22:39.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.657+0000 7f7bd1d4db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f3455cacf0 con 0x55f34556dc40 2023-07-21T22:22:39.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.657+0000 7f7bd1d4db80 10 client.0 _ll_register_callbacks cb 0x7f7ba8099b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:39.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345570840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f345570d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345570840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50628/0 (socket says 172.21.15.151:50628) 2023-07-21T22:22:39.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb7fff700 1 -- 172.21.15.151:0/2086354341 learned_addr learned my addr 172.21.15.151:0/2086354341 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:39.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bbc99c700 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f3455ca440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb77fe700 1 -- 172.21.15.151:0/2086354341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 msgr2=0x55f3455ca440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:39.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f3455ca440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb77fe700 1 -- 172.21.15.151:0/2086354341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 msgr2=0x55f345570840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:39.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345570840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb77fe700 1 -- 172.21.15.151:0/2086354341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f3452e2de0 con 0x55f345562da0 2023-07-21T22:22:39.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7bb77fe700 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f345570d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55f345584560 tx=0x7f7bac00bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b4fb9cef1485d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:39.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.658+0000 7f7b977fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:22:39.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.659+0000 7f7b977fe700 1 -- 172.21.15.151:0/2086354341 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bac01d040 con 0x55f345562da0 2023-07-21T22:22:39.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.659+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2086354341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7bac01e040 con 0x55f345562da0 2023-07-21T22:22:39.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.659+0000 7f7b977fe700 1 -- 172.21.15.151:0/2086354341 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7bac032040 con 0x55f345562da0 2023-07-21T22:22:39.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.659+0000 7f7b977fe700 1 -- 172.21.15.151:0/2086354341 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7bac00b390 con 0x55f345562da0 2023-07-21T22:22:39.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.659+0000 7f7bd1d4db80 10 client.16137 fetch_fsmap learned FSMap version 29 2023-07-21T22:22:39.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.659+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2086354341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55f3452cbc60 con 0x55f345562da0 2023-07-21T22:22:39.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.659+0000 7f7b977fe700 1 -- 172.21.15.151:0/2086354341 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7bac01e040 con 0x55f345562da0 2023-07-21T22:22:39.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.659+0000 7f7b977fe700 1 -- 172.21.15.151:0/2086354341 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7bac004780 con 0x55f345562da0 2023-07-21T22:22:39.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.660+0000 7f7bd1d4db80 10 client.16137 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:22:39.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.660+0000 7f7bd1d4db80 10 client.16137 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:39.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.660+0000 7f7bd1d4db80 20 client.16137 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:39.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.660+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f3455d2150 0x55f3455d4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:39.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.660+0000 7f7bd1d4db80 4 client.16137 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:22:39.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.660+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2086354341 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55f345470050 con 0x55f3455d2150 2023-07-21T22:22:39.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.660+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f3455d2150 0x55f3455d4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:39.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.660+0000 7f7b977fe700 10 client.16137 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:39.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.660+0000 7f7bb7fff700 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f3455d2150 0x55f3455d4560 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fe18b86a19dabc server_cookie=e3c4746cde60e8a1 in_seq=0 out_seq=0 2023-07-21T22:22:39.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7b977fe700 1 -- 172.21.15.151:0/2086354341 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55f345470050 con 0x55f3455d2150 2023-07-21T22:22:39.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7b977fe700 10 client.16137 handle_command_reply: tid=0 2023-07-21T22:22:39.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 client.16137 shutdown 2023-07-21T22:22:39.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2086354341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 msgr2=0x55f345570d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:39.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f345570d80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x55f345584560 tx=0x7f7bac00bb00 comp rx=0 tx=0).stop 2023-07-21T22:22:39.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2086354341 shutdown_connections 2023-07-21T22:22:39.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f3455d2150 0x55f3455d4560 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f345562490 0x55f345570840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f34556dc40 0x55f3455ca440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 --2- 172.21.15.151:0/2086354341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f345562da0 0x55f345570d80 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2086354341 >> 172.21.15.151:0/2086354341 conn(0x55f345558ef0 msgr2=0x55f345565ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:39.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7b977fe700 0 client.16137 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:39.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2086354341 shutdown_connections 2023-07-21T22:22:39.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 1 -- 172.21.15.151:0/2086354341 wait complete. 2023-07-21T22:22:39.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.661+0000 7f7bd1d4db80 20 client.16137 trim_cache size 0 max 16384 2023-07-21T22:22:39.719 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:22:39.720 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:22:39.720 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:22:39.720 INFO:teuthology.orchestra.run.smithi151.stdout: "ec38d3a5-93f8-4072-bfe2-c7872d39c48a": { 2023-07-21T22:22:39.721 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:22:39.721 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "ec38d3a5-93f8-4072-bfe2-c7872d39c48a", 2023-07-21T22:22:39.721 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:22:39.722 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:22:39.722 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:22:39.722 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:22:39.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 -- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7ba00a1360 msgr2=0x7f7ba00a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:39.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7ba00a1360 0x7f7ba00a3810 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7bb8073240 tx=0x7f7bb0009920 comp rx=0 tx=0).stop 2023-07-21T22:22:39.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 -- 172.21.15.151:0/4152382097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb8100aa0 msgr2=0x7f7bb819b620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:39.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb8100aa0 0x7f7bb819b620 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7ba800eb30 tx=0x7f7ba800ee40 comp rx=0 tx=0).stop 2023-07-21T22:22:39.723 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 -- 172.21.15.151:0/4152382097 shutdown_connections 2023-07-21T22:22:39.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7ba00a1360 0x7f7ba00a3810 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7bb8100aa0 0x7f7bb819b620 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7bb8109fc0 0x7f7bb8195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 --2- 172.21.15.151:0/4152382097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7bb81013b0 0x7f7bb819bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:39.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 -- 172.21.15.151:0/4152382097 >> 172.21.15.151:0/4152382097 conn(0x7f7bb80745d0 msgr2=0x7f7bb80fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:39.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 -- 172.21.15.151:0/4152382097 shutdown_connections 2023-07-21T22:22:39.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:22:39.662+0000 7f7bbd19d700 1 -- 172.21.15.151:0/4152382097 wait complete. 2023-07-21T22:22:39.727 INFO:tasks.cephfs.filesystem:scrub status for tag:ec38d3a5-93f8-4072-bfe2-c7872d39c48a - {'path': '/', 'tag': 'ec38d3a5-93f8-4072-bfe2-c7872d39c48a', 'options': 'recursive,force'} 2023-07-21T22:22:40.463 INFO:teuthology.orchestra.run.smithi151.stderr:12500000 of 50000000 tuples (25%) done (elapsed 183.96 s, remaining 551.87 s) 2023-07-21T22:22:40.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:40 smithi187 ceph-mon[96918]: pgmap v107: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-07-21T22:22:40.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:40 smithi195 ceph-mon[97365]: pgmap v107: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-07-21T22:22:40.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:40 smithi151 ceph-mon[95510]: pgmap v107: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-07-21T22:22:41.672 INFO:teuthology.orchestra.run.smithi151.stderr:12600000 of 50000000 tuples (25%) done (elapsed 185.16 s, remaining 549.61 s) 2023-07-21T22:22:42.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:42 smithi187 ceph-mon[96918]: pgmap v108: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-07-21T22:22:42.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:42 smithi195 ceph-mon[97365]: pgmap v108: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-07-21T22:22:42.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:42 smithi151 ceph-mon[95510]: pgmap v108: 97 pgs: 97 active+clean; 2.8 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 21 MiB/s wr, 21 op/s 2023-07-21T22:22:42.865 INFO:teuthology.orchestra.run.smithi151.stderr:12700000 of 50000000 tuples (25%) done (elapsed 186.36 s, remaining 547.33 s) 2023-07-21T22:22:44.066 INFO:teuthology.orchestra.run.smithi151.stderr:12800000 of 50000000 tuples (25%) done (elapsed 187.56 s, remaining 545.09 s) 2023-07-21T22:22:44.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:44 smithi187 ceph-mon[96918]: pgmap v109: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 33 MiB/s wr, 32 op/s 2023-07-21T22:22:44.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:44 smithi195 ceph-mon[97365]: pgmap v109: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 33 MiB/s wr, 32 op/s 2023-07-21T22:22:44.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:44 smithi151 ceph-mon[95510]: pgmap v109: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 33 MiB/s wr, 32 op/s 2023-07-21T22:22:45.381 INFO:teuthology.orchestra.run.smithi151.stderr:12900000 of 50000000 tuples (25%) done (elapsed 188.87 s, remaining 543.19 s) 2023-07-21T22:22:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.475+0000 7f62febff700 1 -- 172.21.15.151:0/4124335758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f81004b0 msgr2=0x7f62f810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:45.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.475+0000 7f62febff700 1 --2- 172.21.15.151:0/4124335758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f81004b0 0x7f62f810c940 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f62f0009f90 tx=0x7f62f000b330 comp rx=0 tx=0).stop 2023-07-21T22:22:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.475+0000 7f62febff700 1 -- 172.21.15.151:0/4124335758 shutdown_connections 2023-07-21T22:22:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.475+0000 7f62febff700 1 --2- 172.21.15.151:0/4124335758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f81004b0 0x7f62f810c940 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.475+0000 7f62febff700 1 --2- 172.21.15.151:0/4124335758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f8105b10 0x7f62f8105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.475+0000 7f62febff700 1 --2- 172.21.15.151:0/4124335758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62f80ffb00 0x7f62f80fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.475+0000 7f62febff700 1 -- 172.21.15.151:0/4124335758 >> 172.21.15.151:0/4124335758 conn(0x7f62f80fb600 msgr2=0x7f62f80fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:45.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.475+0000 7f62febff700 1 -- 172.21.15.151:0/4124335758 shutdown_connections 2023-07-21T22:22:45.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.475+0000 7f62febff700 1 -- 172.21.15.151:0/4124335758 wait complete. 2023-07-21T22:22:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.476+0000 7f62febff700 1 Processor -- start 2023-07-21T22:22:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62febff700 1 -- start start 2023-07-21T22:22:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62febff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f80ffb00 0x7f62f819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62febff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f81004b0 0x7f62f819c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62febff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62f8105b10 0x7f62f8195ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62febff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8196130 con 0x7f62f81004b0 2023-07-21T22:22:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62febff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f81962a0 con 0x7f62f8105b10 2023-07-21T22:22:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62febff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62f8196460 con 0x7f62f80ffb00 2023-07-21T22:22:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62fc99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f80ffb00 0x7f62f819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f81004b0 0x7f62f819c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62fc99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f80ffb00 0x7f62f819bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60840/0 (socket says 172.21.15.151:60840) 2023-07-21T22:22:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.477+0000 7f62fc99b700 1 -- 172.21.15.151:0/2618306588 learned_addr learned my addr 172.21.15.151:0/2618306588 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62fd19c700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62f8105b10 0x7f62f8195ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62fc99b700 1 -- 172.21.15.151:0/2618306588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62f8105b10 msgr2=0x7f62f8195ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62fc99b700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62f8105b10 0x7f62f8195ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62fc99b700 1 -- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f81004b0 msgr2=0x7f62f819c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62fc99b700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f81004b0 0x7f62f819c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62fc99b700 1 -- 172.21.15.151:0/2618306588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f0009c40 con 0x7f62f80ffb00 2023-07-21T22:22:45.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62f7fff700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f81004b0 0x7f62f819c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62fc99b700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f80ffb00 0x7f62f819bc60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00e9c0 tx=0x7f62ec00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62f5ffb700 1 -- 172.21.15.151:0/2618306588 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004a30 con 0x7f62f80ffb00 2023-07-21T22:22:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62f5ffb700 1 -- 172.21.15.151:0/2618306588 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f62ec00cc50 con 0x7f62f80ffb00 2023-07-21T22:22:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62febff700 1 -- 172.21.15.151:0/2618306588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62f8196740 con 0x7f62f80ffb00 2023-07-21T22:22:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.478+0000 7f62f5ffb700 1 -- 172.21.15.151:0/2618306588 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec005410 con 0x7f62f80ffb00 2023-07-21T22:22:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.479+0000 7f62febff700 1 -- 172.21.15.151:0/2618306588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f81a2c50 con 0x7f62f80ffb00 2023-07-21T22:22:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.482+0000 7f62f5ffb700 1 -- 172.21.15.151:0/2618306588 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f62ec005570 con 0x7f62f80ffb00 2023-07-21T22:22:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.483+0000 7f6312599b80 1 Processor -- start 2023-07-21T22:22:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.483+0000 7f62f5ffb700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62e80a12c0 0x7f62e80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f62f5ffb700 1 -- 172.21.15.151:0/2618306588 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f62ec014070 con 0x7f62f80ffb00 2023-07-21T22:22:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f6312599b80 1 -- start start 2023-07-21T22:22:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f62f7fff700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62e80a12c0 0x7f62e80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f6312599b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d406916b0 0x559d4083acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f6312599b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d40834f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f6312599b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d408354a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f6312599b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4073ac50 con 0x559d4083b210 2023-07-21T22:22:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f6312599b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4078d9e0 con 0x559d406916b0 2023-07-21T22:22:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f6312599b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d40786e70 con 0x559d4083b660 2023-07-21T22:22:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f62fc99b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d406916b0 0x559d4083acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f62fc99b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d406916b0 0x559d4083acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50664/0 (socket says 172.21.15.151:50664) 2023-07-21T22:22:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f62fc99b700 1 -- 172.21.15.151:0/1656286246 learned_addr learned my addr 172.21.15.151:0/1656286246 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.484+0000 7f62fd19c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d408354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62f7fff700 1 --2- 172.21.15.151:0/1656286246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d40834f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62fc99b700 1 -- 172.21.15.151:0/1656286246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 msgr2=0x559d408354a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62fc99b700 1 --2- 172.21.15.151:0/1656286246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d408354a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62fc99b700 1 -- 172.21.15.151:0/1656286246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 msgr2=0x559d40834f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62fc99b700 1 --2- 172.21.15.151:0/1656286246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d40834f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62fc99b700 1 -- 172.21.15.151:0/1656286246 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d405b4d80 con 0x559d406916b0 2023-07-21T22:22:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62f7fff700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62e80a12c0 0x7f62e80a3770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f62f8105230 tx=0x7f62e4009f90 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62fc99b700 1 --2- 172.21.15.151:0/1656286246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d406916b0 0x559d4083acd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0a1d70 tx=0x7f62ec099880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b9b07090f6a640a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62e2ffd700 1 -- 172.21.15.151:0/1656286246 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec099e50 con 0x559d406916b0 2023-07-21T22:22:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62e2ffd700 1 -- 172.21.15.151:0/1656286246 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f62ec09de80 con 0x559d406916b0 2023-07-21T22:22:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.485+0000 7f62e2ffd700 1 -- 172.21.15.151:0/1656286246 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec09a310 con 0x559d406916b0 2023-07-21T22:22:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.486+0000 7f6312599b80 1 -- 172.21.15.151:0/1656286246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d406916b0 msgr2=0x559d4083acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.486+0000 7f6312599b80 1 --2- 172.21.15.151:0/1656286246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d406916b0 0x559d4083acd0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f62ec0a1d70 tx=0x7f62ec099880 comp rx=0 tx=0).stop 2023-07-21T22:22:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.486+0000 7f6312599b80 1 -- 172.21.15.151:0/1656286246 shutdown_connections 2023-07-21T22:22:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.486+0000 7f6312599b80 1 --2- 172.21.15.151:0/1656286246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d406916b0 0x559d4083acd0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.486+0000 7f6312599b80 1 --2- 172.21.15.151:0/1656286246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d408354a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.486+0000 7f6312599b80 1 --2- 172.21.15.151:0/1656286246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d40834f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.486+0000 7f6312599b80 1 -- 172.21.15.151:0/1656286246 >> 172.21.15.151:0/1656286246 conn(0x559d4082aae0 msgr2=0x559d408300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.486+0000 7f6312599b80 1 -- 172.21.15.151:0/1656286246 shutdown_connections 2023-07-21T22:22:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.487+0000 7f6312599b80 1 -- 172.21.15.151:0/1656286246 wait complete. 2023-07-21T22:22:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.487+0000 7f6312599b80 1 -- start start 2023-07-21T22:22:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.487+0000 7f6312599b80 1 Processor -- start 2023-07-21T22:22:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f6312599b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40841550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f6312599b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f6312599b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d4083ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f6312599b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d40726a60 con 0x559d406916b0 2023-07-21T22:22:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f6312599b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d40726760 con 0x559d4083b210 2023-07-21T22:22:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f6312599b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4060a8c0 con 0x559d4083b660 2023-07-21T22:22:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f6312599b80 10 client.0 _ll_register_callbacks cb 0x559d40724700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f62fc99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40841550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f62fc99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40841550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44516/0 (socket says 172.21.15.151:44516) 2023-07-21T22:22:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f62fd19c700 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d4083ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f62f7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.488+0000 7f62fc99b700 1 -- 172.21.15.151:0/4294921872 learned_addr learned my addr 172.21.15.151:0/4294921872 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.489+0000 7f62f7fff700 1 -- 172.21.15.151:0/4294921872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 msgr2=0x559d4083ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.489+0000 7f62f7fff700 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d4083ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.489+0000 7f62f7fff700 1 -- 172.21.15.151:0/4294921872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 msgr2=0x559d40841550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.489+0000 7f62f7fff700 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40841550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.489+0000 7f62f7fff700 1 -- 172.21.15.151:0/4294921872 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62f81a2c50 con 0x559d4083b210 2023-07-21T22:22:45.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.489+0000 7f62f7fff700 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083e7d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62e4004650 tx=0x7f62e4016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=85f1498db0650056 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.489+0000 7f62d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:22:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f62d7fff700 1 -- 172.21.15.151:0/4294921872 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62e401d850 con 0x559d4083b210 2023-07-21T22:22:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f62d7fff700 1 -- 172.21.15.151:0/4294921872 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f62e401d9b0 con 0x559d4083b210 2023-07-21T22:22:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f6312599b80 1 -- 172.21.15.151:0/4294921872 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559d406e0490 con 0x559d4083b210 2023-07-21T22:22:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f62d7fff700 1 -- 172.21.15.151:0/4294921872 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62e401db70 con 0x559d4083b210 2023-07-21T22:22:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f6312599b80 10 client.25898 fetch_fsmap learned FSMap version 29 2023-07-21T22:22:45.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f6312599b80 1 -- 172.21.15.151:0/4294921872 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x559d4059dc00 con 0x559d4083b210 2023-07-21T22:22:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f62d7fff700 1 -- 172.21.15.151:0/4294921872 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559d406e0490 con 0x559d4083b210 2023-07-21T22:22:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f62d7fff700 1 -- 172.21.15.151:0/4294921872 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f62e4026b40 con 0x559d4083b210 2023-07-21T22:22:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f6312599b80 10 client.25898 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:22:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f6312599b80 10 client.25898 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f6312599b80 20 client.25898 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f6312599b80 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d4084ec70 0x559d40851080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f6312599b80 4 client.25898 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:22:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.490+0000 7f6312599b80 1 -- 172.21.15.151:0/4294921872 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559d4077fe50 con 0x559d4084ec70 2023-07-21T22:22:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.491+0000 7f62fc99b700 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d4084ec70 0x559d40851080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.491+0000 7f62fc99b700 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d4084ec70 0x559d40851080 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77926a167cd8ec1 server_cookie=395b7a67e4155832 in_seq=0 out_seq=0 2023-07-21T22:22:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.491+0000 7f62d7fff700 10 client.25898 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.492+0000 7f62d7fff700 1 -- 172.21.15.151:0/4294921872 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559d4077fe50 con 0x559d4084ec70 2023-07-21T22:22:45.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.492+0000 7f62d7fff700 10 client.25898 handle_command_reply: tid=0 2023-07-21T22:22:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.492+0000 7f6312599b80 1 client.25898 shutdown 2023-07-21T22:22:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.492+0000 7f6312599b80 1 -- 172.21.15.151:0/4294921872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 msgr2=0x559d4083e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.492+0000 7f6312599b80 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083e7d0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f62e4004650 tx=0x7f62e4016000 comp rx=0 tx=0).stop 2023-07-21T22:22:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f6312599b80 1 -- 172.21.15.151:0/4294921872 shutdown_connections 2023-07-21T22:22:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f6312599b80 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d4084ec70 0x559d40851080 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f6312599b80 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d4083ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f6312599b80 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40841550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f62d7fff700 0 client.25898 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f6312599b80 1 --2- 172.21.15.151:0/4294921872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083e7d0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f6312599b80 1 -- 172.21.15.151:0/4294921872 >> 172.21.15.151:0/4294921872 conn(0x559d4082aae0 msgr2=0x559d4082f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f6312599b80 1 -- 172.21.15.151:0/4294921872 shutdown_connections 2023-07-21T22:22:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f6312599b80 1 -- 172.21.15.151:0/4294921872 wait complete. 2023-07-21T22:22:45.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.493+0000 7f6312599b80 20 client.25898 trim_cache size 0 max 16384 2023-07-21T22:22:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.510+0000 7f6312599b80 1 Processor -- start 2023-07-21T22:22:45.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.510+0000 7f6312599b80 1 -- start start 2023-07-21T22:22:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.510+0000 7f6312599b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40845c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.510+0000 7f6312599b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.510+0000 7f6312599b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d408410f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.510+0000 7f6312599b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d40831820 con 0x559d406916b0 2023-07-21T22:22:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.510+0000 7f6312599b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d4083cd80 con 0x559d4083b210 2023-07-21T22:22:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.510+0000 7f6312599b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d408394a0 con 0x559d4083b660 2023-07-21T22:22:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62f7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62fc99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40845c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62f7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50668/0 (socket says 172.21.15.151:50668) 2023-07-21T22:22:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62f7fff700 1 -- 172.21.15.151:0/3352169208 learned_addr learned my addr 172.21.15.151:0/3352169208 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62fd19c700 1 --2- 172.21.15.151:0/3352169208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d408410f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62fc99b700 1 -- 172.21.15.151:0/3352169208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 msgr2=0x559d408410f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62fc99b700 1 --2- 172.21.15.151:0/3352169208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d408410f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62fc99b700 1 -- 172.21.15.151:0/3352169208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 msgr2=0x559d4083c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62fc99b700 1 --2- 172.21.15.151:0/3352169208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62fc99b700 1 -- 172.21.15.151:0/3352169208 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559d405db1f0 con 0x559d406916b0 2023-07-21T22:22:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.511+0000 7f62f7fff700 1 --2- 172.21.15.151:0/3352169208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f62fc99b700 1 --2- 172.21.15.151:0/3352169208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40845c30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f62ec099de0 tx=0x7f62ec009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f681bd81a589a6c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:45.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f62e37fe700 1 -- 172.21.15.151:0/3352169208 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec098270 con 0x559d406916b0 2023-07-21T22:22:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f62e37fe700 1 -- 172.21.15.151:0/3352169208 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f62ec096560 con 0x559d406916b0 2023-07-21T22:22:45.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f62e37fe700 1 -- 172.21.15.151:0/3352169208 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec0995a0 con 0x559d406916b0 2023-07-21T22:22:45.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f6312599b80 1 -- 172.21.15.151:0/3352169208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 msgr2=0x559d40845c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f6312599b80 1 --2- 172.21.15.151:0/3352169208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40845c30 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f62ec099de0 tx=0x7f62ec009550 comp rx=0 tx=0).stop 2023-07-21T22:22:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f6312599b80 1 -- 172.21.15.151:0/3352169208 shutdown_connections 2023-07-21T22:22:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f6312599b80 1 --2- 172.21.15.151:0/3352169208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d4083b660 0x559d408410f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f6312599b80 1 --2- 172.21.15.151:0/3352169208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d406916b0 0x559d40845c30 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f6312599b80 1 --2- 172.21.15.151:0/3352169208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b210 0x559d4083c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.512+0000 7f6312599b80 1 -- 172.21.15.151:0/3352169208 >> 172.21.15.151:0/3352169208 conn(0x559d4082aae0 msgr2=0x559d4083baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:45.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.513+0000 7f6312599b80 1 -- 172.21.15.151:0/3352169208 shutdown_connections 2023-07-21T22:22:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.513+0000 7f6312599b80 1 -- 172.21.15.151:0/3352169208 wait complete. 2023-07-21T22:22:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.513+0000 7f6312599b80 1 -- start start 2023-07-21T22:22:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.513+0000 7f6312599b80 1 Processor -- start 2023-07-21T22:22:45.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f6312599b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d406916b0 0x559d40837b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f6312599b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d408380d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f6312599b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b660 0x559d40836730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f6312599b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d40836e50 con 0x559d4083b210 2023-07-21T22:22:45.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f6312599b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d40836fc0 con 0x559d4083b660 2023-07-21T22:22:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f6312599b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559d40837180 con 0x559d406916b0 2023-07-21T22:22:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f6312599b80 10 client.0 _ll_register_callbacks cb 0x7f62e4004440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f62f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d408380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f62fc99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d406916b0 0x559d40837b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f62f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d408380d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44522/0 (socket says 172.21.15.151:44522) 2023-07-21T22:22:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f62f7fff700 1 -- 172.21.15.151:0/325238140 learned_addr learned my addr 172.21.15.151:0/325238140 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:45.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f62fc99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d406916b0 0x559d40837b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60868/0 (socket says 172.21.15.151:60868) 2023-07-21T22:22:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.514+0000 7f62fd19c700 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b660 0x559d40836730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62fc99b700 1 -- 172.21.15.151:0/325238140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b660 msgr2=0x559d40836730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:45.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62fc99b700 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b660 0x559d40836730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62fc99b700 1 -- 172.21.15.151:0/325238140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 msgr2=0x559d408380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62fc99b700 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d408380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62fc99b700 1 -- 172.21.15.151:0/325238140 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559d4059dc00 con 0x559d406916b0 2023-07-21T22:22:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62fd19c700 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b660 0x559d40836730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62f7fff700 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d408380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62fc99b700 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d406916b0 0x559d40837b90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62ec096350 tx=0x7f62ec00ced0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b00824400ce9fc41 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:22:45.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62d7fff700 1 -- 172.21.15.151:0/325238140 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62ec004da0 con 0x559d406916b0 2023-07-21T22:22:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62d7fff700 1 -- 172.21.15.151:0/325238140 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f62ec0966d0 con 0x559d406916b0 2023-07-21T22:22:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f6312599b80 1 -- 172.21.15.151:0/325238140 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f62ec09de80 con 0x559d406916b0 2023-07-21T22:22:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.515+0000 7f62d7fff700 1 -- 172.21.15.151:0/325238140 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62ec098270 con 0x559d406916b0 2023-07-21T22:22:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f6312599b80 10 client.25936 fetch_fsmap learned FSMap version 29 2023-07-21T22:22:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f6312599b80 1 -- 172.21.15.151:0/325238140 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f62ec0b6040 con 0x559d406916b0 2023-07-21T22:22:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f62d7fff700 1 -- 172.21.15.151:0/325238140 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f62ec07c020 con 0x559d406916b0 2023-07-21T22:22:45.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f62d7fff700 1 -- 172.21.15.151:0/325238140 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f62ec078d20 con 0x559d406916b0 2023-07-21T22:22:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f6312599b80 10 client.25936 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:22:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f6312599b80 10 client.25936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f6312599b80 20 client.25936 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f6312599b80 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d408a36a0 0x559d408a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f6312599b80 4 client.25936 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:22:45.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f6312599b80 1 -- 172.21.15.151:0/325238140 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559d40741ff0 con 0x559d408a36a0 2023-07-21T22:22:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.516+0000 7f62f7fff700 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d408a36a0 0x559d408a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.517+0000 7f62d7fff700 10 client.25936 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:45.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.517+0000 7f62f7fff700 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d408a36a0 0x559d408a5ab0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4776e72680d5b6 server_cookie=a12f390841d846d6 in_seq=0 out_seq=0 2023-07-21T22:22:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f62d7fff700 1 -- 172.21.15.151:0/325238140 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559d40741ff0 con 0x559d408a36a0 2023-07-21T22:22:45.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f62d7fff700 10 client.25936 handle_command_reply: tid=0 2023-07-21T22:22:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 client.25936 shutdown 2023-07-21T22:22:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 -- 172.21.15.151:0/325238140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d406916b0 msgr2=0x559d40837b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d406916b0 0x559d40837b90 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f62ec096350 tx=0x7f62ec00ced0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 -- 172.21.15.151:0/325238140 shutdown_connections 2023-07-21T22:22:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559d408a36a0 0x559d408a5ab0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559d4083b660 0x559d40836730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559d406916b0 0x559d40837b90 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f62d7fff700 0 client.25936 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 --2- 172.21.15.151:0/325238140 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d4083b210 0x559d408380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 -- 172.21.15.151:0/325238140 >> 172.21.15.151:0/325238140 conn(0x559d4082aae0 msgr2=0x559d4083c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:45.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 -- 172.21.15.151:0/325238140 shutdown_connections 2023-07-21T22:22:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.532+0000 7f6312599b80 1 -- 172.21.15.151:0/325238140 wait complete. 2023-07-21T22:22:45.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f6312599b80 20 client.25936 trim_cache size 0 max 16384 2023-07-21T22:22:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:22:45.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:22:45.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:22:45.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:22:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 -- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62e80a12c0 msgr2=0x7f62e80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:45.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62e80a12c0 0x7f62e80a3770 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f62f8105230 tx=0x7f62e4009f90 comp rx=0 tx=0).stop 2023-07-21T22:22:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 -- 172.21.15.151:0/2618306588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f80ffb00 msgr2=0x7f62f819bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f80ffb00 0x7f62f819bc60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f62ec00e9c0 tx=0x7f62ec00ecd0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 -- 172.21.15.151:0/2618306588 shutdown_connections 2023-07-21T22:22:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62e80a12c0 0x7f62e80a3770 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62f8105b10 0x7f62f8195ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f62f80ffb00 0x7f62f819bc60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 --2- 172.21.15.151:0/2618306588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f62f81004b0 0x7f62f819c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 -- 172.21.15.151:0/2618306588 >> 172.21.15.151:0/2618306588 conn(0x7f62f80fb600 msgr2=0x7f62f80fbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 -- 172.21.15.151:0/2618306588 shutdown_connections 2023-07-21T22:22:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:45.533+0000 7f62febff700 1 -- 172.21.15.151:0/2618306588 wait complete. 2023-07-21T22:22:46.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:46 smithi187 ceph-mon[96918]: pgmap v110: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 MiB/s wr, 23 op/s 2023-07-21T22:22:46.629 INFO:teuthology.orchestra.run.smithi151.stderr:13000000 of 50000000 tuples (26%) done (elapsed 190.12 s, remaining 541.11 s) 2023-07-21T22:22:46.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:46 smithi195 ceph-mon[97365]: pgmap v110: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 MiB/s wr, 23 op/s 2023-07-21T22:22:46.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:46 smithi151 ceph-mon[95510]: pgmap v110: 97 pgs: 97 active+clean; 2.9 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 MiB/s wr, 23 op/s 2023-07-21T22:22:47.822 INFO:teuthology.orchestra.run.smithi151.stderr:13100000 of 50000000 tuples (26%) done (elapsed 191.31 s, remaining 538.89 s) 2023-07-21T22:22:48.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:48 smithi187 ceph-mon[96918]: pgmap v111: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 MiB/s wr, 35 op/s 2023-07-21T22:22:48.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:48 smithi195 ceph-mon[97365]: pgmap v111: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 MiB/s wr, 35 op/s 2023-07-21T22:22:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:48 smithi151 ceph-mon[95510]: pgmap v111: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 33 MiB/s wr, 35 op/s 2023-07-21T22:22:49.116 INFO:teuthology.orchestra.run.smithi151.stderr:13200000 of 50000000 tuples (26%) done (elapsed 192.61 s, remaining 536.97 s) 2023-07-21T22:22:50.300 INFO:teuthology.orchestra.run.smithi151.stderr:13300000 of 50000000 tuples (26%) done (elapsed 193.79 s, remaining 534.75 s) 2023-07-21T22:22:50.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:50 smithi187 ceph-mon[96918]: pgmap v112: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-07-21T22:22:50.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:50 smithi195 ceph-mon[97365]: pgmap v112: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-07-21T22:22:50.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:50 smithi151 ceph-mon[95510]: pgmap v112: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-07-21T22:22:51.500 INFO:teuthology.orchestra.run.smithi151.stderr:13400000 of 50000000 tuples (26%) done (elapsed 194.99 s, remaining 532.59 s) 2023-07-21T22:22:52.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:52 smithi187 ceph-mon[96918]: pgmap v113: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-07-21T22:22:52.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:52 smithi195 ceph-mon[97365]: pgmap v113: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-07-21T22:22:52.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:52 smithi151 ceph-mon[95510]: pgmap v113: 97 pgs: 97 active+clean; 3.0 GiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 24 MiB/s wr, 22 op/s 2023-07-21T22:22:52.777 INFO:teuthology.orchestra.run.smithi151.stderr:13500000 of 50000000 tuples (27%) done (elapsed 196.27 s, remaining 530.65 s) 2023-07-21T22:22:53.977 INFO:teuthology.orchestra.run.smithi151.stderr:13600000 of 50000000 tuples (27%) done (elapsed 197.47 s, remaining 528.52 s) 2023-07-21T22:22:54.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:54 smithi187 ceph-mon[96918]: pgmap v114: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:22:54.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:54 smithi195 ceph-mon[97365]: pgmap v114: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:22:54.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:54 smithi151 ceph-mon[95510]: pgmap v114: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:22:55.313 INFO:teuthology.orchestra.run.smithi151.stderr:13700000 of 50000000 tuples (27%) done (elapsed 198.81 s, remaining 526.76 s) 2023-07-21T22:22:56.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:56 smithi187 ceph-mon[96918]: pgmap v115: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:22:56.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:56 smithi195 ceph-mon[97365]: pgmap v115: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:22:56.675 INFO:teuthology.orchestra.run.smithi151.stderr:13800000 of 50000000 tuples (27%) done (elapsed 200.17 s, remaining 525.08 s) 2023-07-21T22:22:56.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:56 smithi151 ceph-mon[95510]: pgmap v115: 97 pgs: 97 active+clean; 3.1 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:22:57.890 INFO:teuthology.orchestra.run.smithi151.stderr:13900000 of 50000000 tuples (27%) done (elapsed 201.38 s, remaining 523.01 s) 2023-07-21T22:22:58.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:22:58 smithi187 ceph-mon[96918]: pgmap v116: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 36 MiB/s wr, 47 op/s 2023-07-21T22:22:58.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:22:58 smithi195 ceph-mon[97365]: pgmap v116: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 36 MiB/s wr, 47 op/s 2023-07-21T22:22:58.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:22:58 smithi151 ceph-mon[95510]: pgmap v116: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 36 MiB/s wr, 47 op/s 2023-07-21T22:22:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.704+0000 7f4f0a79d700 1 -- 172.21.15.151:0/3377890423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f041059a0 msgr2=0x7f4f04105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.704+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/3377890423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f041059a0 0x7f4f04105d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f000098f0 tx=0x7f4f00009c00 comp rx=0 tx=0).stop 2023-07-21T22:22:58.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.704+0000 7f4f0a79d700 1 -- 172.21.15.151:0/3377890423 shutdown_connections 2023-07-21T22:22:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.704+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/3377890423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f041059a0 0x7f4f04105d70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.704+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/3377890423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f04068070 0x7f4f0410c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.704+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/3377890423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f041062b0 0x7f4f04067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.704+0000 7f4f0a79d700 1 -- 172.21.15.151:0/3377890423 >> 172.21.15.151:0/3377890423 conn(0x7f4f04074770 msgr2=0x7f4f04074b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.704+0000 7f4f0a79d700 1 -- 172.21.15.151:0/3377890423 shutdown_connections 2023-07-21T22:22:58.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.705+0000 7f4f0a79d700 1 -- 172.21.15.151:0/3377890423 wait complete. 2023-07-21T22:22:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.706+0000 7f4f0a79d700 1 Processor -- start 2023-07-21T22:22:58.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.706+0000 7f4f0a79d700 1 -- start start 2023-07-21T22:22:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.706+0000 7f4f0a79d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f04068070 0x7f4f0419d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.706+0000 7f4f0a79d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f041059a0 0x7f4f0419df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.706+0000 7f4f0a79d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f041062b0 0x7f4f04197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.706+0000 7f4f0a79d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f041980d0 con 0x7f4f041062b0 2023-07-21T22:22:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.706+0000 7f4f0a79d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04198240 con 0x7f4f04068070 2023-07-21T22:22:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.706+0000 7f4f0a79d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f04198400 con 0x7f4f041059a0 2023-07-21T22:22:58.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.706+0000 7f4f0979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f04068070 0x7f4f0419d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f0979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f04068070 0x7f4f0419d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40464/0 (socket says 172.21.15.151:40464) 2023-07-21T22:22:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f0979b700 1 -- 172.21.15.151:0/2932581131 learned_addr learned my addr 172.21.15.151:0/2932581131 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f041059a0 0x7f4f0419df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f09f9c700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f041062b0 0x7f4f04197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f0979b700 1 -- 172.21.15.151:0/2932581131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f041059a0 msgr2=0x7f4f0419df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f0979b700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f041059a0 0x7f4f0419df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f0979b700 1 -- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f041062b0 msgr2=0x7f4f04197a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f0979b700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f041062b0 0x7f4f04197a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f0979b700 1 -- 172.21.15.151:0/2932581131 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4efc009c40 con 0x7f4f04068070 2023-07-21T22:22:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.707+0000 7f4f0979b700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f04068070 0x7f4f0419d9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009810 tx=0x7f4f0000fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:58.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.708+0000 7f4efa7fc700 1 -- 172.21.15.151:0/2932581131 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0001c070 con 0x7f4f04068070 2023-07-21T22:22:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.708+0000 7f4efa7fc700 1 -- 172.21.15.151:0/2932581131 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f0000bb70 con 0x7f4f04068070 2023-07-21T22:22:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.708+0000 7f4efa7fc700 1 -- 172.21.15.151:0/2932581131 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f00004930 con 0x7f4f04068070 2023-07-21T22:22:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.708+0000 7f4f0a79d700 1 -- 172.21.15.151:0/2932581131 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f00009520 con 0x7f4f04068070 2023-07-21T22:22:58.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.708+0000 7f4f0a79d700 1 -- 172.21.15.151:0/2932581131 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f041a4800 con 0x7f4f04068070 2023-07-21T22:22:58.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.712+0000 7f4efa7fc700 1 -- 172.21.15.151:0/2932581131 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4f00020070 con 0x7f4f04068070 2023-07-21T22:22:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.714+0000 7f4efa7fc700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ef00a1340 0x7f4ef00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.714+0000 7f4f1f3eeb80 1 Processor -- start 2023-07-21T22:22:58.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.714+0000 7f4efa7fc700 1 -- 172.21.15.151:0/2932581131 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f4f000cd870 con 0x7f4f04068070 2023-07-21T22:22:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.714+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ef00a1340 0x7f4ef00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.714+0000 7f4f1f3eeb80 1 -- start start 2023-07-21T22:22:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.714+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcd2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.714+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 0x55d46dccd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.714+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dccda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dbd2c50 con 0x55d46dcd3480 2023-07-21T22:22:58.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dc259e0 con 0x55d46db296b0 2023-07-21T22:22:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dc1ee70 con 0x55d46dccd5e0 2023-07-21T22:22:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f0979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcd2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f09f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dccda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f0979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcd2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40480/0 (socket says 172.21.15.151:40480) 2023-07-21T22:22:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f0979b700 1 -- 172.21.15.151:0/2794365034 learned_addr learned my addr 172.21.15.151:0/2794365034 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:58.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/2794365034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 0x55d46dccd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f0979b700 1 -- 172.21.15.151:0/2794365034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 msgr2=0x55d46dccda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f0979b700 1 --2- 172.21.15.151:0/2794365034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dccda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f0979b700 1 -- 172.21.15.151:0/2794365034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 msgr2=0x55d46dccd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f0979b700 1 --2- 172.21.15.151:0/2794365034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 0x55d46dccd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f0979b700 1 -- 172.21.15.151:0/2794365034 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d46da4cd80 con 0x55d46db296b0 2023-07-21T22:22:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ef00a1340 0x7f4ef00a37f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4f040fc860 tx=0x7f4ef4009310 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:58.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.715+0000 7f4f09f9c700 1 --2- 172.21.15.151:0/2794365034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dccda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:22:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.716+0000 7f4f0979b700 1 --2- 172.21.15.151:0/2794365034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcd2f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f00097490 tx=0x7f4f0000bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bca5ce4c6081964f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.716+0000 7f4eef7fe700 1 -- 172.21.15.151:0/2794365034 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0009ea50 con 0x55d46db296b0 2023-07-21T22:22:58.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.716+0000 7f4eef7fe700 1 -- 172.21.15.151:0/2794365034 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f000a2de0 con 0x55d46db296b0 2023-07-21T22:22:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.716+0000 7f4eef7fe700 1 -- 172.21.15.151:0/2794365034 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0009aee0 con 0x55d46db296b0 2023-07-21T22:22:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/2794365034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 msgr2=0x55d46dcd2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/2794365034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcd2f40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4f00097490 tx=0x7f4f0000bce0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/2794365034 shutdown_connections 2023-07-21T22:22:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/2794365034 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcd2f40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/2794365034 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dccda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/2794365034 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 0x55d46dccd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/2794365034 >> 172.21.15.151:0/2794365034 conn(0x55d46dcc2c40 msgr2=0x55d46dcc8300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/2794365034 shutdown_connections 2023-07-21T22:22:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/2794365034 wait complete. 2023-07-21T22:22:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.717+0000 7f4f1f3eeb80 1 -- start start 2023-07-21T22:22:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f1f3eeb80 1 Processor -- start 2023-07-21T22:22:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcdc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcdca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 0x55d46dcd6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dbbea60 con 0x55d46dcd3480 2023-07-21T22:22:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dbbe760 con 0x55d46db296b0 2023-07-21T22:22:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46daa28c0 con 0x55d46dccd5e0 2023-07-21T22:22:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f1f3eeb80 10 client.0 _ll_register_callbacks cb 0x55d46dbbc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f0979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcdc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f0979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcdc4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40492/0 (socket says 172.21.15.151:40492) 2023-07-21T22:22:58.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f0979b700 1 -- 172.21.15.151:0/197859422 learned_addr learned my addr 172.21.15.151:0/197859422 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcdca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.718+0000 7f4f09f9c700 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 0x55d46dcd6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4f0979b700 1 -- 172.21.15.151:0/197859422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 msgr2=0x55d46dcdca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4f0979b700 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcdca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4f0979b700 1 -- 172.21.15.151:0/197859422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 msgr2=0x55d46dcd6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4f0979b700 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 0x55d46dcd6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4f0979b700 1 -- 172.21.15.151:0/197859422 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4efc00e330 con 0x55d46db296b0 2023-07-21T22:22:58.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4f0979b700 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcdc4d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4f000a28b0 tx=0x7f4f00005480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=606b1b39ade5f644 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4eecff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:22:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4eecff9700 1 -- 172.21.15.151:0/197859422 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f0009ea50 con 0x55d46db296b0 2023-07-21T22:22:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4eecff9700 1 -- 172.21.15.151:0/197859422 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f4f000b3120 con 0x55d46db296b0 2023-07-21T22:22:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.719+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/197859422 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d46db78490 con 0x55d46db296b0 2023-07-21T22:22:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4eecff9700 1 -- 172.21.15.151:0/197859422 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f0009a120 con 0x55d46db296b0 2023-07-21T22:22:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4f1f3eeb80 10 client.25916 fetch_fsmap learned FSMap version 29 2023-07-21T22:22:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/197859422 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x7f4f041a4800 con 0x55d46db296b0 2023-07-21T22:22:58.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4eecff9700 1 -- 172.21.15.151:0/197859422 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f0007d080 con 0x55d46db296b0 2023-07-21T22:22:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4eecff9700 1 -- 172.21.15.151:0/197859422 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4f00096810 con 0x55d46db296b0 2023-07-21T22:22:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4f1f3eeb80 10 client.25916 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:22:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4f1f3eeb80 10 client.25916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4f1f3eeb80 20 client.25916 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d46dce6510 0x55d46dce8920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4f1f3eeb80 4 client.25916 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:22:58.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.720+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/197859422 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d46dc17e50 con 0x55d46dce6510 2023-07-21T22:22:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.721+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d46dce6510 0x55d46dce8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.721+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d46dce6510 0x55d46dce8920 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3d24ce6d827d98a server_cookie=de4e007e2cd05496 in_seq=0 out_seq=0 2023-07-21T22:22:58.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.721+0000 7f4eecff9700 10 client.25916 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4eecff9700 1 -- 172.21.15.151:0/197859422 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d46dc17e50 con 0x55d46dce6510 2023-07-21T22:22:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4eecff9700 10 client.25916 handle_command_reply: tid=0 2023-07-21T22:22:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 client.25916 shutdown 2023-07-21T22:22:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/197859422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 msgr2=0x55d46dcdc4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcdc4d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4f000a28b0 tx=0x7f4f00005480 comp rx=0 tx=0).stop 2023-07-21T22:22:58.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/197859422 shutdown_connections 2023-07-21T22:22:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d46dce6510 0x55d46dce8920 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46db296b0 0x55d46dcdc4d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46dcd3480 0x55d46dcd6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4eecff9700 0 client.25916 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/197859422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcdca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/197859422 >> 172.21.15.151:0/197859422 conn(0x55d46dcc2c40 msgr2=0x55d46dcc7540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/197859422 shutdown_connections 2023-07-21T22:22:58.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/197859422 wait complete. 2023-07-21T22:22:58.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.722+0000 7f4f1f3eeb80 20 client.25916 trim_cache size 0 max 16384 2023-07-21T22:22:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.741+0000 7f4f1f3eeb80 1 Processor -- start 2023-07-21T22:22:58.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f1f3eeb80 1 -- start start 2023-07-21T22:22:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 0x55d46dcd59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcd6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 0x55d46dccf900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dcc9920 con 0x55d46db296b0 2023-07-21T22:22:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dcd6c50 con 0x55d46dcd3480 2023-07-21T22:22:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dcd1590 con 0x55d46dccd5e0 2023-07-21T22:22:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f0979b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 0x55d46dcd59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f08f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcd6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f08f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcd6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:59538/0 (socket says 172.21.15.151:59538) 2023-07-21T22:22:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f08f9a700 1 -- 172.21.15.151:0/3712858562 learned_addr learned my addr 172.21.15.151:0/3712858562 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.742+0000 7f4f09f9c700 1 --2- 172.21.15.151:0/3712858562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 0x55d46dccf900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.743+0000 7f4f08f9a700 1 -- 172.21.15.151:0/3712858562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 msgr2=0x55d46dccf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.743+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/3712858562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 0x55d46dccf900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.743+0000 7f4f08f9a700 1 -- 172.21.15.151:0/3712858562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 msgr2=0x55d46dcd59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.743+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/3712858562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 0x55d46dcd59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.743+0000 7f4f08f9a700 1 -- 172.21.15.151:0/3712858562 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d46da35c00 con 0x55d46dccd5e0 2023-07-21T22:22:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.743+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/3712858562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcd6710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55d46dcc7e00 tx=0x7f4ef4014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f644f096f70e9f65 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.743+0000 7f4eeffff700 1 -- 172.21.15.151:0/3712858562 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef402d070 con 0x55d46dccd5e0 2023-07-21T22:22:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.743+0000 7f4eeffff700 1 -- 172.21.15.151:0/3712858562 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ef4011bc0 con 0x55d46dccd5e0 2023-07-21T22:22:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.743+0000 7f4eeffff700 1 -- 172.21.15.151:0/3712858562 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef4023040 con 0x55d46dccd5e0 2023-07-21T22:22:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.744+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/3712858562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 msgr2=0x55d46dcd6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.744+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/3712858562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcd6710 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x55d46dcc7e00 tx=0x7f4ef4014000 comp rx=0 tx=0).stop 2023-07-21T22:22:58.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.744+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/3712858562 shutdown_connections 2023-07-21T22:22:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.744+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/3712858562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 0x55d46dccf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.744+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/3712858562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 0x55d46dcd59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.744+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/3712858562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcd6710 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.744+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/3712858562 >> 172.21.15.151:0/3712858562 conn(0x55d46dcc2c40 msgr2=0x55d46dcd6000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.744+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/3712858562 shutdown_connections 2023-07-21T22:22:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.744+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/3712858562 wait complete. 2023-07-21T22:22:58.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.745+0000 7f4f1f3eeb80 1 -- start start 2023-07-21T22:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.745+0000 7f4f1f3eeb80 1 Processor -- start 2023-07-21T22:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.745+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 0x55d46dcdc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.745+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcda8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f1f3eeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 0x55d46dcdae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dcdb360 con 0x55d46db296b0 2023-07-21T22:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dcdb4d0 con 0x55d46dcd3480 2023-07-21T22:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f1f3eeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d46dcdb690 con 0x55d46dccd5e0 2023-07-21T22:22:58.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f1f3eeb80 10 client.0 _ll_register_callbacks cb 0x7f4efc00e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:22:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f0979b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 0x55d46dcdc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f08f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcda8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f0979b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 0x55d46dcdc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52726/0 (socket says 172.21.15.151:52726) 2023-07-21T22:22:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f0979b700 1 -- 172.21.15.151:0/863910338 learned_addr learned my addr 172.21.15.151:0/863910338 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:22:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f09f9c700 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 0x55d46dcdae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f08f9a700 1 -- 172.21.15.151:0/863910338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 msgr2=0x55d46dcdae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 0x55d46dcdae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f08f9a700 1 -- 172.21.15.151:0/863910338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 msgr2=0x55d46dcdc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:22:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 0x55d46dcdc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.746+0000 7f4f08f9a700 1 -- 172.21.15.151:0/863910338 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef4017070 con 0x55d46dccd5e0 2023-07-21T22:22:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.747+0000 7f4f08f9a700 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcda8e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55d46dcc7d30 tx=0x7f4ef4028670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb09b7fa09f7efe7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:22:58.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.747+0000 7f4eecff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:22:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.747+0000 7f4eecff9700 1 -- 172.21.15.151:0/863910338 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef402d070 con 0x55d46dccd5e0 2023-07-21T22:22:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.747+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/863910338 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f000a2de0 con 0x55d46dccd5e0 2023-07-21T22:22:58.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.747+0000 7f4eecff9700 1 -- 172.21.15.151:0/863910338 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f4ef4004240 con 0x55d46dccd5e0 2023-07-21T22:22:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.747+0000 7f4eecff9700 1 -- 172.21.15.151:0/863910338 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ef4023050 con 0x55d46dccd5e0 2023-07-21T22:22:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.747+0000 7f4f1f3eeb80 10 client.25954 fetch_fsmap learned FSMap version 29 2023-07-21T22:22:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.747+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/863910338 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55d46da731f0 con 0x55d46dccd5e0 2023-07-21T22:22:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.747+0000 7f4eecff9700 1 -- 172.21.15.151:0/863910338 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f000a2de0 con 0x55d46dccd5e0 2023-07-21T22:22:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.748+0000 7f4eecff9700 1 -- 172.21.15.151:0/863910338 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4ef4004980 con 0x55d46dccd5e0 2023-07-21T22:22:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.748+0000 7f4f1f3eeb80 10 client.25954 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:22:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.748+0000 7f4f1f3eeb80 10 client.25954 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:22:58.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.748+0000 7f4f1f3eeb80 20 client.25954 populate_metadata read hostname 'smithi151' 2023-07-21T22:22:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.748+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d46dd3b7e0 0x55d46dd3dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:22:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.748+0000 7f4f1f3eeb80 4 client.25954 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:22:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.748+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/863910338 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d46dbd9ff0 con 0x55d46dd3b7e0 2023-07-21T22:22:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.748+0000 7f4f0979b700 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d46dd3b7e0 0x55d46dd3dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:22:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.749+0000 7f4eecff9700 10 client.25954 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:58.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.749+0000 7f4f0979b700 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d46dd3b7e0 0x55d46dd3dbf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8fe5d16332968ec3 server_cookie=e3958c184fee8284 in_seq=0 out_seq=0 2023-07-21T22:22:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4eecff9700 1 -- 172.21.15.151:0/863910338 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d46dbd9ff0 con 0x55d46dd3b7e0 2023-07-21T22:22:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4eecff9700 10 client.25954 handle_command_reply: tid=0 2023-07-21T22:22:58.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 client.25954 shutdown 2023-07-21T22:22:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/863910338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 msgr2=0x55d46dcda8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcda8e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x55d46dcc7d30 tx=0x7f4ef4028670 comp rx=0 tx=0).stop 2023-07-21T22:22:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/863910338 shutdown_connections 2023-07-21T22:22:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d46dd3b7e0 0x55d46dd3dbf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d46dcd3480 0x55d46dcdae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d46db296b0 0x55d46dcdc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 --2- 172.21.15.151:0/863910338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d46dccd5e0 0x55d46dcda8e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4eecff9700 0 client.25954 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:22:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/863910338 >> 172.21.15.151:0/863910338 conn(0x55d46dcc2c40 msgr2=0x55d46dcd41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/863910338 shutdown_connections 2023-07-21T22:22:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 1 -- 172.21.15.151:0/863910338 wait complete. 2023-07-21T22:22:58.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.761+0000 7f4f1f3eeb80 20 client.25954 trim_cache size 0 max 16384 2023-07-21T22:22:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:22:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:22:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:22:58.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:22:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 -- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ef00a1340 msgr2=0x7f4ef00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ef00a1340 0x7f4ef00a37f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f4f040fc860 tx=0x7f4ef4009310 comp rx=0 tx=0).stop 2023-07-21T22:22:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 -- 172.21.15.151:0/2932581131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f04068070 msgr2=0x7f4f0419d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:22:58.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f04068070 0x7f4f0419d9f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f00009810 tx=0x7f4f0000fa00 comp rx=0 tx=0).stop 2023-07-21T22:22:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 -- 172.21.15.151:0/2932581131 shutdown_connections 2023-07-21T22:22:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ef00a1340 0x7f4ef00a37f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f04068070 0x7f4f0419d9f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f041062b0 0x7f4f04197a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 --2- 172.21.15.151:0/2932581131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f041059a0 0x7f4f0419df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:22:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 -- 172.21.15.151:0/2932581131 >> 172.21.15.151:0/2932581131 conn(0x7f4f04074770 msgr2=0x7f4f040feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:22:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 -- 172.21.15.151:0/2932581131 shutdown_connections 2023-07-21T22:22:58.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:22:58.762+0000 7f4f0a79d700 1 -- 172.21.15.151:0/2932581131 wait complete. 2023-07-21T22:22:59.099 INFO:teuthology.orchestra.run.smithi151.stderr:14000000 of 50000000 tuples (28%) done (elapsed 202.59 s, remaining 520.95 s) 2023-07-21T22:23:00.306 INFO:teuthology.orchestra.run.smithi151.stderr:14100000 of 50000000 tuples (28%) done (elapsed 203.80 s, remaining 518.89 s) 2023-07-21T22:23:00.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:00 smithi187 ceph-mon[96918]: pgmap v117: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-07-21T22:23:00.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:00 smithi195 ceph-mon[97365]: pgmap v117: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-07-21T22:23:00.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:00 smithi151 ceph-mon[95510]: pgmap v117: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-07-21T22:23:01.642 INFO:teuthology.orchestra.run.smithi151.stderr:14200000 of 50000000 tuples (28%) done (elapsed 205.13 s, remaining 517.17 s) 2023-07-21T22:23:02.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:02 smithi187 ceph-mon[96918]: pgmap v118: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-07-21T22:23:02.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:02 smithi195 ceph-mon[97365]: pgmap v118: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-07-21T22:23:02.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:02 smithi151 ceph-mon[95510]: pgmap v118: 97 pgs: 97 active+clean; 3.2 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 24 MiB/s wr, 35 op/s 2023-07-21T22:23:02.852 INFO:teuthology.orchestra.run.smithi151.stderr:14300000 of 50000000 tuples (28%) done (elapsed 206.34 s, remaining 515.14 s) 2023-07-21T22:23:04.055 INFO:teuthology.orchestra.run.smithi151.stderr:14400000 of 50000000 tuples (28%) done (elapsed 207.55 s, remaining 513.10 s) 2023-07-21T22:23:04.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:04 smithi187 ceph-mon[96918]: pgmap v119: 97 pgs: 97 active+clean; 3.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 36 MiB/s wr, 60 op/s 2023-07-21T22:23:04.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:04 smithi195 ceph-mon[97365]: pgmap v119: 97 pgs: 97 active+clean; 3.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 36 MiB/s wr, 60 op/s 2023-07-21T22:23:04.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:04 smithi151 ceph-mon[95510]: pgmap v119: 97 pgs: 97 active+clean; 3.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 36 MiB/s wr, 60 op/s 2023-07-21T22:23:05.278 INFO:teuthology.orchestra.run.smithi151.stderr:14500000 of 50000000 tuples (29%) done (elapsed 208.77 s, remaining 511.13 s) 2023-07-21T22:23:06.584 INFO:teuthology.orchestra.run.smithi151.stderr:14600000 of 50000000 tuples (29%) done (elapsed 210.08 s, remaining 509.36 s) 2023-07-21T22:23:06.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:06 smithi187 ceph-mon[96918]: pgmap v120: 97 pgs: 97 active+clean; 3.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-07-21T22:23:06.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:06 smithi195 ceph-mon[97365]: pgmap v120: 97 pgs: 97 active+clean; 3.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-07-21T22:23:06.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:06 smithi151 ceph-mon[95510]: pgmap v120: 97 pgs: 97 active+clean; 3.3 GiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 24 MiB/s wr, 52 op/s 2023-07-21T22:23:07.784 INFO:teuthology.orchestra.run.smithi151.stderr:14700000 of 50000000 tuples (29%) done (elapsed 211.28 s, remaining 507.35 s) 2023-07-21T22:23:08.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:08 smithi187 ceph-mon[96918]: pgmap v121: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 36 MiB/s wr, 61 op/s 2023-07-21T22:23:08.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:08 smithi195 ceph-mon[97365]: pgmap v121: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 36 MiB/s wr, 61 op/s 2023-07-21T22:23:08.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:08 smithi151 ceph-mon[95510]: pgmap v121: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 36 MiB/s wr, 61 op/s 2023-07-21T22:23:08.998 INFO:teuthology.orchestra.run.smithi151.stderr:14800000 of 50000000 tuples (29%) done (elapsed 212.49 s, remaining 505.38 s) 2023-07-21T22:23:09.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:23:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.942+0000 7f43321ff700 1 -- 172.21.15.151:0/1637945198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c105af0 msgr2=0x7f432c105ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.942+0000 7f43321ff700 1 --2- 172.21.15.151:0/1637945198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c105af0 0x7f432c105ec0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f431c0098f0 tx=0x7f431c009c00 comp rx=0 tx=0).stop 2023-07-21T22:23:09.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.942+0000 7f43321ff700 1 -- 172.21.15.151:0/1637945198 shutdown_connections 2023-07-21T22:23:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.943+0000 7f43321ff700 1 --2- 172.21.15.151:0/1637945198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c105af0 0x7f432c105ec0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.943+0000 7f43321ff700 1 --2- 172.21.15.151:0/1637945198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c100490 0x7f432c10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.943+0000 7f43321ff700 1 --2- 172.21.15.151:0/1637945198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f432c0ffae0 0x7f432c0fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.943+0000 7f43321ff700 1 -- 172.21.15.151:0/1637945198 >> 172.21.15.151:0/1637945198 conn(0x7f432c0fb5e0 msgr2=0x7f432c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:09.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.943+0000 7f43321ff700 1 -- 172.21.15.151:0/1637945198 shutdown_connections 2023-07-21T22:23:09.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.943+0000 7f43321ff700 1 -- 172.21.15.151:0/1637945198 wait complete. 2023-07-21T22:23:09.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.944+0000 7f43321ff700 1 Processor -- start 2023-07-21T22:23:09.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.944+0000 7f43321ff700 1 -- start start 2023-07-21T22:23:09.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.944+0000 7f43321ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c0ffae0 0x7f432c072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:09.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f43321ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f432c100490 0x7f432c072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:09.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f43321ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c105af0 0x7f432c1a3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:09.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f43321ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c073580 con 0x7f432c0ffae0 2023-07-21T22:23:09.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f43321ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c1a42b0 con 0x7f432c105af0 2023-07-21T22:23:09.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f43321ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f432c1a43f0 con 0x7f432c100490 2023-07-21T22:23:09.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c0ffae0 0x7f432c072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:09.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f432c100490 0x7f432c072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:09.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c0ffae0 0x7f432c072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42070/0 (socket says 172.21.15.151:42070) 2023-07-21T22:23:09.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432b7fe700 1 -- 172.21.15.151:0/1585954610 learned_addr learned my addr 172.21.15.151:0/1585954610 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:09.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432bfff700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c105af0 0x7f432c1a3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:09.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432b7fe700 1 -- 172.21.15.151:0/1585954610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f432c100490 msgr2=0x7f432c072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:09.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432b7fe700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f432c100490 0x7f432c072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:09.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432b7fe700 1 -- 172.21.15.151:0/1585954610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c105af0 msgr2=0x7f432c1a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:09.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432b7fe700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c105af0 0x7f432c1a3d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:09.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432b7fe700 1 -- 172.21.15.151:0/1585954610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f431c009520 con 0x7f432c0ffae0 2023-07-21T22:23:09.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.945+0000 7f432affd700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f432c100490 0x7f432c072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:09.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.946+0000 7f432b7fe700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c0ffae0 0x7f432c072810 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f431c009810 tx=0x7f431c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:09.994 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.946+0000 7f4328ff9700 1 -- 172.21.15.151:0/1585954610 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c01c070 con 0x7f432c0ffae0 2023-07-21T22:23:09.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.946+0000 7f4328ff9700 1 -- 172.21.15.151:0/1585954610 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f431c00baf0 con 0x7f432c0ffae0 2023-07-21T22:23:09.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.946+0000 7f43321ff700 1 -- 172.21.15.151:0/1585954610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f432c1a45f0 con 0x7f432c0ffae0 2023-07-21T22:23:09.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.946+0000 7f4328ff9700 1 -- 172.21.15.151:0/1585954610 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c004930 con 0x7f432c0ffae0 2023-07-21T22:23:09.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.946+0000 7f43321ff700 1 -- 172.21.15.151:0/1585954610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f432c1a4a70 con 0x7f432c0ffae0 2023-07-21T22:23:09.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.949+0000 7f4328ff9700 1 -- 172.21.15.151:0/1585954610 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f431c020070 con 0x7f432c0ffae0 2023-07-21T22:23:09.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.951+0000 7f4345b85b80 1 Processor -- start 2023-07-21T22:23:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.951+0000 7f4345b85b80 1 -- start start 2023-07-21T22:23:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f4328ff9700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f43140a1340 0x7f43140a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e0411b0 0x55ce9e041580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:09.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e03cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f4345b85b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9df41cb0 con 0x55ce9e0411b0 2023-07-21T22:23:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f4345b85b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9df94a40 con 0x55ce9e03c930 2023-07-21T22:23:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f4345b85b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9df8ded0 con 0x55ce9e041ac0 2023-07-21T22:23:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f4328ff9700 1 -- 172.21.15.151:0/1585954610 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f431c0cd950 con 0x7f432c0ffae0 2023-07-21T22:23:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f432affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:09.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f432affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03c350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50950/0 (socket says 172.21.15.151:50950) 2023-07-21T22:23:09.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f432affd700 1 -- 172.21.15.151:0/2387346618 learned_addr learned my addr 172.21.15.151:0/2387346618 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:09.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f432bfff700 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e03cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:09.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f432bfff700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f43140a1340 0x7f43140a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:09.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.952+0000 7f432b7fe700 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e0411b0 0x55ce9e041580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f432affd700 1 -- 172.21.15.151:0/2387346618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 msgr2=0x55ce9e03cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:10.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f432affd700 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e03cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f432affd700 1 -- 172.21.15.151:0/2387346618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e0411b0 msgr2=0x55ce9e041580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:10.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f432affd700 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e0411b0 0x55ce9e041580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f432affd700 1 -- 172.21.15.151:0/2387346618 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce9ddbbde0 con 0x55ce9e041ac0 2023-07-21T22:23:10.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f432bfff700 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e03cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:23:10.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f432affd700 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03c350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f43200115f0 tx=0x7f4320011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3544a6ca07324e54 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:10.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f4311ffb700 1 -- 172.21.15.151:0/2387346618 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320004230 con 0x55ce9e041ac0 2023-07-21T22:23:10.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f4311ffb700 1 -- 172.21.15.151:0/2387346618 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4320004390 con 0x55ce9e041ac0 2023-07-21T22:23:10.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.953+0000 7f4311ffb700 1 -- 172.21.15.151:0/2387346618 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320019770 con 0x55ce9e041ac0 2023-07-21T22:23:10.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f4345b85b80 1 -- 172.21.15.151:0/2387346618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 msgr2=0x55ce9e03c350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f432bfff700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f43140a1340 0x7f43140a37f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4324009610 tx=0x7f432400b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03c350 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f43200115f0 tx=0x7f4320011900 comp rx=0 tx=0).stop 2023-07-21T22:23:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f4345b85b80 1 -- 172.21.15.151:0/2387346618 shutdown_connections 2023-07-21T22:23:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e03cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e0411b0 0x55ce9e041580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2387346618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03c350 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f4345b85b80 1 -- 172.21.15.151:0/2387346618 >> 172.21.15.151:0/2387346618 conn(0x55ce9e031ef0 msgr2=0x55ce9e037830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f4345b85b80 1 -- 172.21.15.151:0/2387346618 shutdown_connections 2023-07-21T22:23:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.954+0000 7f4345b85b80 1 -- 172.21.15.151:0/2387346618 wait complete. 2023-07-21T22:23:10.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.955+0000 7f4345b85b80 1 -- start start 2023-07-21T22:23:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.955+0000 7f4345b85b80 1 Processor -- start 2023-07-21T22:23:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e048b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e045e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 0x55ce9e046490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.005 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f4345b85b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9df2dac0 con 0x55ce9e041ac0 2023-07-21T22:23:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f4345b85b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9df2d7c0 con 0x55ce9e03c930 2023-07-21T22:23:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f4345b85b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9de11920 con 0x55ce9e0411b0 2023-07-21T22:23:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f4345b85b80 10 client.0 _ll_register_callbacks cb 0x55ce9df2b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f432affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e045e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f432affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e045e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50954/0 (socket says 172.21.15.151:50954) 2023-07-21T22:23:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f432affd700 1 -- 172.21.15.151:0/2568123421 learned_addr learned my addr 172.21.15.151:0/2568123421 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f432bfff700 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 0x55ce9e046490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.006 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.956+0000 7f432b7fe700 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e048b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f432affd700 1 -- 172.21.15.151:0/2568123421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 msgr2=0x55ce9e048b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f432affd700 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e048b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f432affd700 1 -- 172.21.15.151:0/2568123421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 msgr2=0x55ce9e046490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f432affd700 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 0x55ce9e046490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f432affd700 1 -- 172.21.15.151:0/2568123421 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4320009d50 con 0x55ce9e0411b0 2023-07-21T22:23:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f432affd700 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e045e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f432001b040 tx=0x7f4320005750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c170b54a9778d1a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f430affd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:23:10.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f430affd700 1 -- 172.21.15.151:0/2568123421 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4320005d60 con 0x55ce9e0411b0 2023-07-21T22:23:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f430affd700 1 -- 172.21.15.151:0/2568123421 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f4320004b60 con 0x55ce9e0411b0 2023-07-21T22:23:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.957+0000 7f4345b85b80 1 -- 172.21.15.151:0/2568123421 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce9dee74f0 con 0x55ce9e0411b0 2023-07-21T22:23:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f430affd700 1 -- 172.21.15.151:0/2568123421 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4320004d20 con 0x55ce9e0411b0 2023-07-21T22:23:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f4345b85b80 10 client.25966 fetch_fsmap learned FSMap version 29 2023-07-21T22:23:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f4345b85b80 1 -- 172.21.15.151:0/2568123421 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ce9dda4c60 con 0x55ce9e0411b0 2023-07-21T22:23:10.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f430affd700 1 -- 172.21.15.151:0/2568123421 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ce9dee74f0 con 0x55ce9e0411b0 2023-07-21T22:23:10.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f430affd700 1 -- 172.21.15.151:0/2568123421 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4320021040 con 0x55ce9e0411b0 2023-07-21T22:23:10.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f4345b85b80 10 client.25966 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:23:10.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f4345b85b80 10 client.25966 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:10.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f4345b85b80 20 client.25966 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:10.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce9e056430 0x55ce9e058840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f4345b85b80 4 client.25966 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:10.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.958+0000 7f4345b85b80 1 -- 172.21.15.151:0/2568123421 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce9df86eb0 con 0x55ce9e056430 2023-07-21T22:23:10.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.959+0000 7f432b7fe700 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce9e056430 0x55ce9e058840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.959+0000 7f432b7fe700 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce9e056430 0x55ce9e058840 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1967576d39da358 server_cookie=19ff95714d5aa3a1 in_seq=0 out_seq=0 2023-07-21T22:23:10.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.959+0000 7f430affd700 10 client.25966 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:10.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f430affd700 1 -- 172.21.15.151:0/2568123421 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ce9df86eb0 con 0x55ce9e056430 2023-07-21T22:23:10.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f430affd700 10 client.25966 handle_command_reply: tid=0 2023-07-21T22:23:10.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 client.25966 shutdown 2023-07-21T22:23:10.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 -- 172.21.15.151:0/2568123421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 msgr2=0x55ce9e045e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:10.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e045e10 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f432001b040 tx=0x7f4320005750 comp rx=0 tx=0).stop 2023-07-21T22:23:10.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 -- 172.21.15.151:0/2568123421 shutdown_connections 2023-07-21T22:23:10.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce9e056430 0x55ce9e058840 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e048b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 0x55ce9e046490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f430affd700 0 client.25966 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:10.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2568123421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e045e10 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 -- 172.21.15.151:0/2568123421 >> 172.21.15.151:0/2568123421 conn(0x55ce9e031ef0 msgr2=0x55ce9e037420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:10.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 -- 172.21.15.151:0/2568123421 shutdown_connections 2023-07-21T22:23:10.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.960+0000 7f4345b85b80 1 -- 172.21.15.151:0/2568123421 wait complete. 2023-07-21T22:23:10.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.961+0000 7f4345b85b80 20 client.25966 trim_cache size 0 max 16384 2023-07-21T22:23:10.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.981+0000 7f4345b85b80 1 Processor -- start 2023-07-21T22:23:10.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.981+0000 7f4345b85b80 1 -- start start 2023-07-21T22:23:10.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.981+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e03c930 0x55ce9e04d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e0411b0 0x55ce9e03a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f4345b85b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e049360 con 0x55ce9e03c930 2023-07-21T22:23:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f4345b85b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9df86eb0 con 0x55ce9e0411b0 2023-07-21T22:23:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f4345b85b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9dee74f0 con 0x55ce9e041ac0 2023-07-21T22:23:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e03c930 0x55ce9e04d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e0411b0 0x55ce9e03a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e0411b0 0x55ce9e03a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:58044/0 (socket says 172.21.15.151:58044) 2023-07-21T22:23:10.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432affd700 1 -- 172.21.15.151:0/3065928116 learned_addr learned my addr 172.21.15.151:0/3065928116 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:10.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432affd700 1 -- 172.21.15.151:0/3065928116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 msgr2=0x55ce9e03af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:10.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432affd700 1 --2- 172.21.15.151:0/3065928116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432affd700 1 -- 172.21.15.151:0/3065928116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e03c930 msgr2=0x55ce9e04d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:10.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432affd700 1 --2- 172.21.15.151:0/3065928116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e03c930 0x55ce9e04d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.982+0000 7f432affd700 1 -- 172.21.15.151:0/3065928116 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce9dde2250 con 0x55ce9e0411b0 2023-07-21T22:23:10.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.983+0000 7f432affd700 1 --2- 172.21.15.151:0/3065928116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e0411b0 0x55ce9e03a9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4320019470 tx=0x7f4320011900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2e20efe8307e975 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:10.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.983+0000 7f43127fc700 1 -- 172.21.15.151:0/3065928116 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43200196e0 con 0x55ce9e0411b0 2023-07-21T22:23:10.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.983+0000 7f43127fc700 1 -- 172.21.15.151:0/3065928116 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4320019db0 con 0x55ce9e0411b0 2023-07-21T22:23:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.983+0000 7f43127fc700 1 -- 172.21.15.151:0/3065928116 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f432000f580 con 0x55ce9e0411b0 2023-07-21T22:23:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 -- 172.21.15.151:0/3065928116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e0411b0 msgr2=0x55ce9e03a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 --2- 172.21.15.151:0/3065928116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e0411b0 0x55ce9e03a9c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f4320019470 tx=0x7f4320011900 comp rx=0 tx=0).stop 2023-07-21T22:23:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 -- 172.21.15.151:0/3065928116 shutdown_connections 2023-07-21T22:23:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 --2- 172.21.15.151:0/3065928116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e041ac0 0x55ce9e03af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 --2- 172.21.15.151:0/3065928116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e03c930 0x55ce9e04d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 --2- 172.21.15.151:0/3065928116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e0411b0 0x55ce9e03a9c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 -- 172.21.15.151:0/3065928116 >> 172.21.15.151:0/3065928116 conn(0x55ce9e031ef0 msgr2=0x55ce9e035f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:10.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 -- 172.21.15.151:0/3065928116 shutdown_connections 2023-07-21T22:23:10.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 -- 172.21.15.151:0/3065928116 wait complete. 2023-07-21T22:23:10.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 -- start start 2023-07-21T22:23:10.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.984+0000 7f4345b85b80 1 Processor -- start 2023-07-21T22:23:10.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e04d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e04b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f4345b85b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 0x55ce9e04bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f4345b85b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e04c5f0 con 0x55ce9e041ac0 2023-07-21T22:23:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f4345b85b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e04c760 con 0x55ce9e03c930 2023-07-21T22:23:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f4345b85b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce9e0aa2c0 con 0x55ce9e0411b0 2023-07-21T22:23:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f4345b85b80 10 client.0 _ll_register_callbacks cb 0x7f431c005040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f432b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e04d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f432affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e04b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f432b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e04d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:58054/0 (socket says 172.21.15.151:58054) 2023-07-21T22:23:10.034 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f432b7fe700 1 -- 172.21.15.151:0/2874442726 learned_addr learned my addr 172.21.15.151:0/2874442726 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:10.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.985+0000 7f432bfff700 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 0x55ce9e04bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f432b7fe700 1 -- 172.21.15.151:0/2874442726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 msgr2=0x55ce9e04b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:10.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f432b7fe700 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e04b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f432b7fe700 1 -- 172.21.15.151:0/2874442726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 msgr2=0x55ce9e04bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:10.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f432b7fe700 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 0x55ce9e04bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f432b7fe700 1 -- 172.21.15.151:0/2874442726 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce9dda4c60 con 0x55ce9e03c930 2023-07-21T22:23:10.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f432affd700 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e04b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:10.035 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f432b7fe700 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e04d580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f431c09aa50 tx=0x7f431c0a0040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=163c2edc3960b9b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:10.036 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f430affd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:23:10.037 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f430affd700 1 -- 172.21.15.151:0/2874442726 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f431c09eaf0 con 0x55ce9e03c930 2023-07-21T22:23:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f4345b85b80 1 -- 172.21.15.151:0/2874442726 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4320004390 con 0x55ce9e03c930 2023-07-21T22:23:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.986+0000 7f430affd700 1 -- 172.21.15.151:0/2874442726 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f431c0a2e80 con 0x55ce9e03c930 2023-07-21T22:23:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f430affd700 1 -- 172.21.15.151:0/2874442726 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) v2 ==== 24+0+0 (secure 0 0 0) 0x7f431c00b5e0 con 0x55ce9e03c930 2023-07-21T22:23:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f4345b85b80 10 client.25940 fetch_fsmap learned FSMap version 29 2023-07-21T22:23:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f4345b85b80 1 -- 172.21.15.151:0/2874442726 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) v3 -- 0x55ce9ddba2b0 con 0x55ce9e03c930 2023-07-21T22:23:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f430affd700 1 -- 172.21.15.151:0/2874442726 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4320004390 con 0x55ce9e03c930 2023-07-21T22:23:10.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f430affd700 1 -- 172.21.15.151:0/2874442726 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 29) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f431c0cb3c0 con 0x55ce9e03c930 2023-07-21T22:23:10.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f4345b85b80 10 client.25940 fetch_fsmap finished waiting for FSMap version 29 2023-07-21T22:23:10.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f4345b85b80 10 client.25940 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:10.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f4345b85b80 20 client.25940 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:10.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce9e0ab5e0 0x55ce9e0ad9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:10.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f4345b85b80 4 client.25940 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:23:10.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f4345b85b80 1 -- 172.21.15.151:0/2874442726 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ce9df49050 con 0x55ce9e0ab5e0 2023-07-21T22:23:10.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.987+0000 7f432affd700 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce9e0ab5e0 0x55ce9e0ad9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:10.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.988+0000 7f432affd700 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce9e0ab5e0 0x55ce9e0ad9f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=282598b65803f316 server_cookie=ea3144336827d3bf in_seq=0 out_seq=0 2023-07-21T22:23:10.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.988+0000 7f430affd700 10 client.25940 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:10.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.988+0000 7f430affd700 1 -- 172.21.15.151:0/2874442726 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ce9df49050 con 0x55ce9e0ab5e0 2023-07-21T22:23:10.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.988+0000 7f430affd700 10 client.25940 handle_command_reply: tid=0 2023-07-21T22:23:10.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.988+0000 7f4345b85b80 1 client.25940 shutdown 2023-07-21T22:23:10.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.988+0000 7f4345b85b80 1 -- 172.21.15.151:0/2874442726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 msgr2=0x55ce9e04d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:10.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.988+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e04d580 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f431c09aa50 tx=0x7f431c0a0040 comp rx=0 tx=0).stop 2023-07-21T22:23:10.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.988+0000 7f4345b85b80 1 -- 172.21.15.151:0/2874442726 shutdown_connections 2023-07-21T22:23:10.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.989+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce9e0ab5e0 0x55ce9e0ad9f0 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.989+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce9e03c930 0x55ce9e04d580 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.989+0000 7f430affd700 0 client.25940 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:10.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.989+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce9e041ac0 0x55ce9e04bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.989+0000 7f4345b85b80 1 --2- 172.21.15.151:0/2874442726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce9e0411b0 0x55ce9e04b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.989+0000 7f4345b85b80 1 -- 172.21.15.151:0/2874442726 >> 172.21.15.151:0/2874442726 conn(0x55ce9e031ef0 msgr2=0x55ce9e03a9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:10.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.989+0000 7f4345b85b80 1 -- 172.21.15.151:0/2874442726 shutdown_connections 2023-07-21T22:23:10.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.989+0000 7f4345b85b80 1 -- 172.21.15.151:0/2874442726 wait complete. 2023-07-21T22:23:10.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.989+0000 7f4345b85b80 20 client.25940 trim_cache size 0 max 16384 2023-07-21T22:23:10.042 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:23:10.042 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:23:10.043 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:23:10.043 INFO:teuthology.orchestra.run.smithi151.stdout: "ec38d3a5-93f8-4072-bfe2-c7872d39c48a": { 2023-07-21T22:23:10.043 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:23:10.043 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "ec38d3a5-93f8-4072-bfe2-c7872d39c48a", 2023-07-21T22:23:10.043 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:23:10.043 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:23:10.043 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:23:10.044 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:23:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 -- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f43140a1340 msgr2=0x7f43140a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f43140a1340 0x7f43140a37f0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4324009610 tx=0x7f432400b040 comp rx=0 tx=0).stop 2023-07-21T22:23:10.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 -- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c0ffae0 msgr2=0x7f432c072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c0ffae0 0x7f432c072810 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f431c009810 tx=0x7f431c00fa00 comp rx=0 tx=0).stop 2023-07-21T22:23:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 -- 172.21.15.151:0/1585954610 shutdown_connections 2023-07-21T22:23:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f43140a1340 0x7f43140a37f0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f432c105af0 0x7f432c1a3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f432c0ffae0 0x7f432c072810 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 --2- 172.21.15.151:0/1585954610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f432c100490 0x7f432c072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:10.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 -- 172.21.15.151:0/1585954610 >> 172.21.15.151:0/1585954610 conn(0x7f432c0fb5e0 msgr2=0x7f432c0fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 -- 172.21.15.151:0/1585954610 shutdown_connections 2023-07-21T22:23:10.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:09.990+0000 7f43321ff700 1 -- 172.21.15.151:0/1585954610 wait complete. 2023-07-21T22:23:10.055 INFO:tasks.cephfs.filesystem:scrub status for tag:ec38d3a5-93f8-4072-bfe2-c7872d39c48a - {'path': '/', 'tag': 'ec38d3a5-93f8-4072-bfe2-c7872d39c48a', 'options': 'recursive,force'} 2023-07-21T22:23:10.526 INFO:teuthology.orchestra.run.smithi151.stderr:14900000 of 50000000 tuples (29%) done (elapsed 214.02 s, remaining 504.16 s) 2023-07-21T22:23:10.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:10 smithi187 ceph-mon[96918]: pgmap v122: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 33 op/s 2023-07-21T22:23:10.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:10 smithi195 ceph-mon[97365]: pgmap v122: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 33 op/s 2023-07-21T22:23:10.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:10 smithi151 ceph-mon[95510]: pgmap v122: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 33 op/s 2023-07-21T22:23:11.729 INFO:teuthology.orchestra.run.smithi151.stderr:15000000 of 50000000 tuples (30%) done (elapsed 215.22 s, remaining 502.18 s) 2023-07-21T22:23:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.932+0000 7f1fb7dff700 1 -- 172.21.15.151:0/2680658721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb01004e0 msgr2=0x7f1fb010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.932+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/2680658721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb01004e0 0x7f1fb010c920 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800b0a0 tx=0x7f1fa800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.932+0000 7f1fb7dff700 1 -- 172.21.15.151:0/2680658721 shutdown_connections 2023-07-21T22:23:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.932+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/2680658721 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb01004e0 0x7f1fb010c920 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.932+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/2680658721 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb0105b60 0x7f1fb0105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.932+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/2680658721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fb00ffb30 0x7f1fb00fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.932+0000 7f1fb7dff700 1 -- 172.21.15.151:0/2680658721 >> 172.21.15.151:0/2680658721 conn(0x7f1fb00fb5f0 msgr2=0x7f1fb00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.932+0000 7f1fb7dff700 1 -- 172.21.15.151:0/2680658721 shutdown_connections 2023-07-21T22:23:11.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.932+0000 7f1fb7dff700 1 -- 172.21.15.151:0/2680658721 wait complete. 2023-07-21T22:23:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.934+0000 7f1fb7dff700 1 Processor -- start 2023-07-21T22:23:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.934+0000 7f1fb7dff700 1 -- start start 2023-07-21T22:23:11.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.934+0000 7f1fb7dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00ffb30 0x7f1fb0072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.934+0000 7f1fb7dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fb01004e0 0x7f1fb0072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.934+0000 7f1fb7dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb0105b60 0x7f1fb0073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.934+0000 7f1fb7dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb01a8690 con 0x7f1fb00ffb30 2023-07-21T22:23:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.934+0000 7f1fb7dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb01a8800 con 0x7f1fb01004e0 2023-07-21T22:23:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.934+0000 7f1fb7dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb01a89c0 con 0x7f1fb0105b60 2023-07-21T22:23:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00ffb30 0x7f1fb0072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00ffb30 0x7f1fb0072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42116/0 (socket says 172.21.15.151:42116) 2023-07-21T22:23:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb539a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fb01004e0 0x7f1fb0072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb5b9b700 1 -- 172.21.15.151:0/863606097 learned_addr learned my addr 172.21.15.151:0/863606097 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb639c700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb0105b60 0x7f1fb0073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb5b9b700 1 -- 172.21.15.151:0/863606097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb0105b60 msgr2=0x7f1fb0073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb0105b60 0x7f1fb0073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb5b9b700 1 -- 172.21.15.151:0/863606097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fb01004e0 msgr2=0x7f1fb0072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:11.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fb01004e0 0x7f1fb0072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb5b9b700 1 -- 172.21.15.151:0/863606097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa8009d00 con 0x7f1fb00ffb30 2023-07-21T22:23:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.935+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00ffb30 0x7f1fb0072810 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e9a0 tx=0x7f1fac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.936+0000 7f1fa6ffd700 1 -- 172.21.15.151:0/863606097 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac009790 con 0x7f1fb00ffb30 2023-07-21T22:23:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.936+0000 7f1fa6ffd700 1 -- 172.21.15.151:0/863606097 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fac010430 con 0x7f1fb00ffb30 2023-07-21T22:23:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.936+0000 7f1fb7dff700 1 -- 172.21.15.151:0/863606097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb01a8ca0 con 0x7f1fb00ffb30 2023-07-21T22:23:11.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.936+0000 7f1fa6ffd700 1 -- 172.21.15.151:0/863606097 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00cea0 con 0x7f1fb00ffb30 2023-07-21T22:23:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.936+0000 7f1fb7dff700 1 -- 172.21.15.151:0/863606097 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb01a91b0 con 0x7f1fb00ffb30 2023-07-21T22:23:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.939+0000 7f1fa6ffd700 1 -- 172.21.15.151:0/863606097 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f1fac0105a0 con 0x7f1fb00ffb30 2023-07-21T22:23:11.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.940+0000 7f1fcb7c1b80 1 Processor -- start 2023-07-21T22:23:11.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fcb7c1b80 1 -- start start 2023-07-21T22:23:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af0704ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d210 0x55af07046f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d660 0x55af070474a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af06f4cc50 con 0x55af0704d210 2023-07-21T22:23:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af06f9f9e0 con 0x55af0704d660 2023-07-21T22:23:11.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af06f98e70 con 0x55af06ea36b0 2023-07-21T22:23:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fa6ffd700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f9c0a12c0 0x7f1f9c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fb5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d210 0x55af07046f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.941+0000 7f1fb639c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af0704ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb639c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af0704ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51002/0 (socket says 172.21.15.151:51002) 2023-07-21T22:23:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb639c700 1 -- 172.21.15.151:0/2874949093 learned_addr learned my addr 172.21.15.151:0/2874949093 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:11.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb539a700 1 --2- 172.21.15.151:0/2874949093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d660 0x55af070474a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb639c700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f9c0a12c0 0x7f1f9c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fa6ffd700 1 -- 172.21.15.151:0/863606097 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1fac014070 con 0x7f1fb00ffb30 2023-07-21T22:23:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb539a700 1 -- 172.21.15.151:0/2874949093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 msgr2=0x55af0704ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb539a700 1 --2- 172.21.15.151:0/2874949093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af0704ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb539a700 1 -- 172.21.15.151:0/2874949093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d210 msgr2=0x55af07046f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:11.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb539a700 1 --2- 172.21.15.151:0/2874949093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d210 0x55af07046f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb539a700 1 -- 172.21.15.151:0/2874949093 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af06dc6d80 con 0x55af0704d660 2023-07-21T22:23:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.942+0000 7f1fb539a700 1 --2- 172.21.15.151:0/2874949093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d660 0x55af070474a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009c80 tx=0x7f1fa0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=879cd03471e1636 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.943+0000 7f1fb639c700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f9c0a12c0 0x7f1f9c0a3770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8006130 tx=0x7f1fa800b3b0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.943+0000 7f1f9bfff700 1 -- 172.21.15.151:0/2874949093 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0011cb0 con 0x55af0704d660 2023-07-21T22:23:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.943+0000 7f1f9bfff700 1 -- 172.21.15.151:0/2874949093 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fa0011e10 con 0x55af0704d660 2023-07-21T22:23:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.943+0000 7f1f9bfff700 1 -- 172.21.15.151:0/2874949093 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa0005220 con 0x55af0704d660 2023-07-21T22:23:11.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/2874949093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d660 msgr2=0x55af070474a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/2874949093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d660 0x55af070474a0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1fa0009c80 tx=0x7f1fa0009f90 comp rx=0 tx=0).stop 2023-07-21T22:23:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/2874949093 shutdown_connections 2023-07-21T22:23:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/2874949093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d660 0x55af070474a0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/2874949093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af0704ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/2874949093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d210 0x55af07046f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/2874949093 >> 172.21.15.151:0/2874949093 conn(0x55af0703cae0 msgr2=0x55af070420e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:11.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/2874949093 shutdown_connections 2023-07-21T22:23:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/2874949093 wait complete. 2023-07-21T22:23:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.944+0000 7f1fcb7c1b80 1 -- start start 2023-07-21T22:23:11.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.945+0000 7f1fcb7c1b80 1 Processor -- start 2023-07-21T22:23:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.945+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07053450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.945+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 0x55af07050740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.945+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07050ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.945+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af06f38a60 con 0x55af0704d660 2023-07-21T22:23:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.945+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af06f38760 con 0x55af0704d210 2023-07-21T22:23:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.945+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af06e1c8c0 con 0x55af06ea36b0 2023-07-21T22:23:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.945+0000 7f1fcb7c1b80 10 client.0 _ll_register_callbacks cb 0x55af06f36700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:11.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb639c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07050ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb639c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07050ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42128/0 (socket says 172.21.15.151:42128) 2023-07-21T22:23:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb639c700 1 -- 172.21.15.151:0/3079711210 learned_addr learned my addr 172.21.15.151:0/3079711210 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb539a700 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 0x55af07050740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07053450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb639c700 1 -- 172.21.15.151:0/3079711210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 msgr2=0x55af07053450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb639c700 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07053450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb639c700 1 -- 172.21.15.151:0/3079711210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 msgr2=0x55af07050740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:11.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb639c700 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 0x55af07050740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb639c700 1 -- 172.21.15.151:0/3079711210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fa00098e0 con 0x55af0704d660 2023-07-21T22:23:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb539a700 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 0x55af07050740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1fb639c700 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07050ca0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800beb0 tx=0x7f1fa80099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7592bec0940965fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.946+0000 7f1f997fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.947+0000 7f1f997fa700 1 -- 172.21.15.151:0/3079711210 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8026070 con 0x55af0704d660 2023-07-21T22:23:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.947+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3079711210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af06ef2490 con 0x55af0704d660 2023-07-21T22:23:11.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.947+0000 7f1f997fa700 1 -- 172.21.15.151:0/3079711210 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1fa8003c10 con 0x55af0704d660 2023-07-21T22:23:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.947+0000 7f1f997fa700 1 -- 172.21.15.151:0/3079711210 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fa800e040 con 0x55af0704d660 2023-07-21T22:23:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.947+0000 7f1fcb7c1b80 10 client.16203 fetch_fsmap learned FSMap version 30 2023-07-21T22:23:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.947+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3079711210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55af06dafc00 con 0x55af0704d660 2023-07-21T22:23:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.947+0000 7f1f997fa700 1 -- 172.21.15.151:0/3079711210 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55af06ef2490 con 0x55af0704d660 2023-07-21T22:23:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.947+0000 7f1f997fa700 1 -- 172.21.15.151:0/3079711210 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 30) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f1fa801a3f0 con 0x55af0704d660 2023-07-21T22:23:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.948+0000 7f1fcb7c1b80 10 client.16203 fetch_fsmap finished waiting for FSMap version 30 2023-07-21T22:23:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.948+0000 7f1fcb7c1b80 10 client.16203 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:11.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.948+0000 7f1fcb7c1b80 20 client.16203 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.948+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55af07060ad0 0x55af07062ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.948+0000 7f1fcb7c1b80 4 client.16203 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.948+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3079711210 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af06f91e50 con 0x55af07060ad0 2023-07-21T22:23:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.948+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55af07060ad0 0x55af07062ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.948+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55af07060ad0 0x55af07062ee0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5e865c5214181a8 server_cookie=734d22284cc857b9 in_seq=0 out_seq=0 2023-07-21T22:23:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.948+0000 7f1f997fa700 10 client.16203 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:12.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.949+0000 7f1f997fa700 1 -- 172.21.15.151:0/3079711210 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55af06f91e50 con 0x55af07060ad0 2023-07-21T22:23:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.949+0000 7f1f997fa700 10 client.16203 handle_command_reply: tid=0 2023-07-21T22:23:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.949+0000 7f1fcb7c1b80 1 client.16203 shutdown 2023-07-21T22:23:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.949+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3079711210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 msgr2=0x55af07050ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.949+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07050ca0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1fa800beb0 tx=0x7f1fa80099e0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.949+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3079711210 shutdown_connections 2023-07-21T22:23:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.949+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55af07060ad0 0x55af07062ee0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.950+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07050ca0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.950+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07053450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.950+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3079711210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 0x55af07050740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.950+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3079711210 >> 172.21.15.151:0/3079711210 conn(0x55af0703cae0 msgr2=0x55af070413e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.950+0000 7f1f997fa700 0 client.16203 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.950+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3079711210 shutdown_connections 2023-07-21T22:23:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.950+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3079711210 wait complete. 2023-07-21T22:23:12.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.950+0000 7f1fcb7c1b80 20 client.16203 trim_cache size 0 max 16384 2023-07-21T22:23:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.969+0000 7f1fcb7c1b80 1 Processor -- start 2023-07-21T22:23:12.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.969+0000 7f1fcb7c1b80 1 -- start start 2023-07-21T22:23:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.969+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af06ea36b0 0x55af0704e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.969+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af0704d210 0x55af07046f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:12.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.969+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af070526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.969+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af0705e0b0 con 0x55af0704d660 2023-07-21T22:23:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.969+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af07042f00 con 0x55af06ea36b0 2023-07-21T22:23:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af07043760 con 0x55af0704d210 2023-07-21T22:23:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb639c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af070526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb639c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af070526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42144/0 (socket says 172.21.15.151:42144) 2023-07-21T22:23:12.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb639c700 1 -- 172.21.15.151:0/3887951248 learned_addr learned my addr 172.21.15.151:0/3887951248 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:12.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af06ea36b0 0x55af0704e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:12.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb539a700 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af0704d210 0x55af07046f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:12.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb639c700 1 -- 172.21.15.151:0/3887951248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af0704d210 msgr2=0x55af07046f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:12.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb639c700 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af0704d210 0x55af07046f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb639c700 1 -- 172.21.15.151:0/3887951248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af06ea36b0 msgr2=0x55af0704e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:12.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb639c700 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af06ea36b0 0x55af0704e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb639c700 1 -- 172.21.15.151:0/3887951248 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af06ded1f0 con 0x55af0704d660 2023-07-21T22:23:12.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.970+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af06ea36b0 0x55af0704e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.971+0000 7f1fb639c700 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af070526f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1fa801a7a0 tx=0x7f1fa8008f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7677be1f852453d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.971+0000 7f1fa4bff700 1 -- 172.21.15.151:0/3887951248 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8026070 con 0x55af0704d660 2023-07-21T22:23:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.971+0000 7f1fa4bff700 1 -- 172.21.15.151:0/3887951248 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fa802f070 con 0x55af0704d660 2023-07-21T22:23:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.971+0000 7f1fa4bff700 1 -- 172.21.15.151:0/3887951248 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8020910 con 0x55af0704d660 2023-07-21T22:23:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3887951248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 msgr2=0x55af070526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af070526f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1fa801a7a0 tx=0x7f1fa8008f80 comp rx=0 tx=0).stop 2023-07-21T22:23:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3887951248 shutdown_connections 2023-07-21T22:23:12.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af06ea36b0 0x55af0704e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af070526f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/3887951248 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af0704d210 0x55af07046f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3887951248 >> 172.21.15.151:0/3887951248 conn(0x55af0703cae0 msgr2=0x55af07051fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3887951248 shutdown_connections 2023-07-21T22:23:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/3887951248 wait complete. 2023-07-21T22:23:12.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.972+0000 7f1fcb7c1b80 1 -- start start 2023-07-21T22:23:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.973+0000 7f1fcb7c1b80 1 Processor -- start 2023-07-21T22:23:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07055bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:12.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 0x55af07056130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fcb7c1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07056670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af070b3ac0 con 0x55af0704d660 2023-07-21T22:23:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af070b3c30 con 0x55af0704d210 2023-07-21T22:23:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fcb7c1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af070b3df0 con 0x55af06ea36b0 2023-07-21T22:23:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fcb7c1b80 10 client.0 _ll_register_callbacks cb 0x55af06f36700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb5b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07055bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb5b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07055bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51038/0 (socket says 172.21.15.151:51038) 2023-07-21T22:23:12.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb5b9b700 1 -- 172.21.15.151:0/288588053 learned_addr learned my addr 172.21.15.151:0/288588053 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb639c700 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07056670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb539a700 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 0x55af07056130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb5b9b700 1 -- 172.21.15.151:0/288588053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 msgr2=0x55af07056130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 0x55af07056130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb5b9b700 1 -- 172.21.15.151:0/288588053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 msgr2=0x55af07056670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07056670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.974+0000 7f1fb5b9b700 1 -- 172.21.15.151:0/288588053 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb01a91b0 con 0x55af06ea36b0 2023-07-21T22:23:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.975+0000 7f1fb5b9b700 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07055bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fac010c30 tx=0x7f1fac095c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edfdc2e9a61b9a40 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.975+0000 7f1f997fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:23:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.975+0000 7f1f997fa700 1 -- 172.21.15.151:0/288588053 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fac09a3c0 con 0x55af06ea36b0 2023-07-21T22:23:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.975+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/288588053 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1fa0011e10 con 0x55af06ea36b0 2023-07-21T22:23:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.975+0000 7f1f997fa700 1 -- 172.21.15.151:0/288588053 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1fac09df90 con 0x55af06ea36b0 2023-07-21T22:23:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.975+0000 7f1f997fa700 1 -- 172.21.15.151:0/288588053 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1fac0a23b0 con 0x55af06ea36b0 2023-07-21T22:23:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.975+0000 7f1fcb7c1b80 10 client.25990 fetch_fsmap learned FSMap version 30 2023-07-21T22:23:12.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.975+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/288588053 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) v3 -- 0x55af06dafc00 con 0x55af06ea36b0 2023-07-21T22:23:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.975+0000 7f1f997fa700 1 -- 172.21.15.151:0/288588053 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1fac0b8030 con 0x55af06ea36b0 2023-07-21T22:23:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.976+0000 7f1f997fa700 1 -- 172.21.15.151:0/288588053 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 30) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f1fac0a1f20 con 0x55af06ea36b0 2023-07-21T22:23:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.976+0000 7f1fcb7c1b80 10 client.25990 fetch_fsmap finished waiting for FSMap version 30 2023-07-21T22:23:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.976+0000 7f1fcb7c1b80 10 client.25990 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.976+0000 7f1fcb7c1b80 20 client.25990 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:12.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.976+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55af070b5460 0x55af070b7870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.976+0000 7f1fcb7c1b80 4 client.25990 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:23:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.976+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/288588053 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55af06f53ff0 con 0x55af070b5460 2023-07-21T22:23:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.976+0000 7f1fb539a700 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55af070b5460 0x55af070b7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.977+0000 7f1f997fa700 10 client.25990 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:12.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:11.977+0000 7f1fb539a700 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55af070b5460 0x55af070b7870 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d596ebd5f8521970 server_cookie=7333280a7a48b0f2 in_seq=0 out_seq=0 2023-07-21T22:23:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.117+0000 7f1f997fa700 1 -- 172.21.15.151:0/288588053 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55af06f53ff0 con 0x55af070b5460 2023-07-21T22:23:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.117+0000 7f1f997fa700 10 client.25990 handle_command_reply: tid=0 2023-07-21T22:23:12.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.117+0000 7f1fcb7c1b80 1 client.25990 shutdown 2023-07-21T22:23:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.117+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/288588053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 msgr2=0x55af07055bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.117+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07055bf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f1fac010c30 tx=0x7f1fac095c00 comp rx=0 tx=0).stop 2023-07-21T22:23:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.117+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/288588053 shutdown_connections 2023-07-21T22:23:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.117+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55af070b5460 0x55af070b7870 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.118+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55af0704d660 0x55af07056670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.118+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55af06ea36b0 0x55af07055bf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.118+0000 7f1f997fa700 0 client.25990 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.118+0000 7f1fcb7c1b80 1 --2- 172.21.15.151:0/288588053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af0704d210 0x55af07056130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.118+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/288588053 >> 172.21.15.151:0/288588053 conn(0x55af0703cae0 msgr2=0x55af0705cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.118+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/288588053 shutdown_connections 2023-07-21T22:23:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.118+0000 7f1fcb7c1b80 1 -- 172.21.15.151:0/288588053 wait complete. 2023-07-21T22:23:12.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.118+0000 7f1fcb7c1b80 20 client.25990 trim_cache size 0 max 16384 2023-07-21T22:23:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:23:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:23:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:23:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:23:12.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 -- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f9c0a12c0 msgr2=0x7f1f9c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f9c0a12c0 0x7f1f9c0a3770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8006130 tx=0x7f1fa800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 -- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00ffb30 msgr2=0x7f1fb0072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00ffb30 0x7f1fb0072810 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e9a0 tx=0x7f1fac00ecb0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 -- 172.21.15.151:0/863606097 shutdown_connections 2023-07-21T22:23:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f9c0a12c0 0x7f1f9c0a3770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1fb0105b60 0x7f1fb0073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00ffb30 0x7f1fb0072810 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 --2- 172.21.15.151:0/863606097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1fb01004e0 0x7f1fb0072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 -- 172.21.15.151:0/863606097 >> 172.21.15.151:0/863606097 conn(0x7f1fb00fb5f0 msgr2=0x7f1fb0103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 -- 172.21.15.151:0/863606097 shutdown_connections 2023-07-21T22:23:12.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:12.119+0000 7f1fb7dff700 1 -- 172.21.15.151:0/863606097 wait complete. 2023-07-21T22:23:12.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:12 smithi187 ceph-mon[96918]: pgmap v123: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 33 op/s 2023-07-21T22:23:12.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:12 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:23:12.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:12 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:12.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:12 smithi195 ceph-mon[97365]: pgmap v123: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 33 op/s 2023-07-21T22:23:12.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:12 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:23:12.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:12 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:12.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:12 smithi151 ceph-mon[95510]: pgmap v123: 97 pgs: 97 active+clean; 3.4 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 33 op/s 2023-07-21T22:23:12.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:12 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:23:12.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:12 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:12.947 INFO:teuthology.orchestra.run.smithi151.stderr:15100000 of 50000000 tuples (30%) done (elapsed 216.44 s, remaining 500.25 s) 2023-07-21T22:23:14.151 INFO:teuthology.orchestra.run.smithi151.stderr:15200000 of 50000000 tuples (30%) done (elapsed 217.64 s, remaining 498.29 s) 2023-07-21T22:23:14.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:14 smithi187 ceph-mon[96918]: pgmap v124: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 44 op/s 2023-07-21T22:23:14.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:14 smithi195 ceph-mon[97365]: pgmap v124: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 44 op/s 2023-07-21T22:23:14.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:14 smithi151 ceph-mon[95510]: pgmap v124: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 36 MiB/s wr, 44 op/s 2023-07-21T22:23:15.456 INFO:teuthology.orchestra.run.smithi151.stderr:15300000 of 50000000 tuples (30%) done (elapsed 218.95 s, remaining 496.57 s) 2023-07-21T22:23:16.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:16 smithi187 ceph-mon[96918]: pgmap v125: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:16.642 INFO:teuthology.orchestra.run.smithi151.stderr:15400000 of 50000000 tuples (30%) done (elapsed 220.13 s, remaining 494.59 s) 2023-07-21T22:23:16.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:16 smithi195 ceph-mon[97365]: pgmap v125: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:16.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:16 smithi151 ceph-mon[95510]: pgmap v125: 97 pgs: 97 active+clean; 3.5 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:17.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:17 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:23:17.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:17 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:23:17.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:17 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:23:17.846 INFO:teuthology.orchestra.run.smithi151.stderr:15500000 of 50000000 tuples (31%) done (elapsed 221.34 s, remaining 492.66 s) 2023-07-21T22:23:18.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:18 smithi187 ceph-mon[96918]: pgmap v126: 97 pgs: 97 active+clean; 3.6 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:23:18.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:18 smithi195 ceph-mon[97365]: pgmap v126: 97 pgs: 97 active+clean; 3.6 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:23:18.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:18 smithi151 ceph-mon[95510]: pgmap v126: 97 pgs: 97 active+clean; 3.6 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:23:19.156 INFO:teuthology.orchestra.run.smithi151.stderr:15600000 of 50000000 tuples (31%) done (elapsed 222.65 s, remaining 490.97 s) 2023-07-21T22:23:20.364 INFO:teuthology.orchestra.run.smithi151.stderr:15700000 of 50000000 tuples (31%) done (elapsed 223.86 s, remaining 489.06 s) 2023-07-21T22:23:20.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:20 smithi187 ceph-mon[96918]: pgmap v127: 97 pgs: 97 active+clean; 3.6 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-07-21T22:23:20.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:20 smithi195 ceph-mon[97365]: pgmap v127: 97 pgs: 97 active+clean; 3.6 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-07-21T22:23:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:20 smithi151 ceph-mon[95510]: pgmap v127: 97 pgs: 97 active+clean; 3.6 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-07-21T22:23:21.573 INFO:teuthology.orchestra.run.smithi151.stderr:15800000 of 50000000 tuples (31%) done (elapsed 225.06 s, remaining 487.17 s) 2023-07-21T22:23:22.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:22 smithi195 ceph-mon[97365]: pgmap v128: 97 pgs: 97 active+clean; 3.6 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-07-21T22:23:22.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:22 smithi151 ceph-mon[95510]: pgmap v128: 97 pgs: 97 active+clean; 3.6 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-07-21T22:23:22.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:22 smithi187 ceph-mon[96918]: pgmap v128: 97 pgs: 97 active+clean; 3.6 GiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 24 MiB/s wr, 21 op/s 2023-07-21T22:23:22.880 INFO:teuthology.orchestra.run.smithi151.stderr:15900000 of 50000000 tuples (31%) done (elapsed 226.37 s, remaining 485.49 s) 2023-07-21T22:23:24.101 INFO:teuthology.orchestra.run.smithi151.stderr:16000000 of 50000000 tuples (32%) done (elapsed 227.59 s, remaining 483.64 s) 2023-07-21T22:23:24.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:24 smithi195 ceph-mon[97365]: pgmap v129: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:23:24.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:24 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:23:24.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:24 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:23:24.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:24 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:23:24.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:23:24.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:24 smithi151 ceph-mon[95510]: pgmap v129: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:23:24.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:24 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:23:24.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:24 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:23:24.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:24 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:23:24.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:23:24.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:24 smithi187 ceph-mon[96918]: pgmap v129: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:23:24.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:24 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:23:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:24 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:23:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:24 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:23:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:23:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.290+0000 7fea975ff700 1 -- 172.21.15.151:0/3358176317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea90072850 msgr2=0x7fea90072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.290+0000 7fea975ff700 1 --2- 172.21.15.151:0/3358176317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea90072850 0x7fea90072c20 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fea8c009990 tx=0x7fea8c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.290+0000 7fea975ff700 1 -- 172.21.15.151:0/3358176317 shutdown_connections 2023-07-21T22:23:25.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.290+0000 7fea975ff700 1 --2- 172.21.15.151:0/3358176317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea9010c3f0 0x7fea9010e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.290+0000 7fea975ff700 1 --2- 172.21.15.151:0/3358176317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea90072850 0x7fea90072c20 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.290+0000 7fea975ff700 1 --2- 172.21.15.151:0/3358176317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90073160 0x7fea9010beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.290+0000 7fea975ff700 1 -- 172.21.15.151:0/3358176317 >> 172.21.15.151:0/3358176317 conn(0x7fea900fb650 msgr2=0x7fea900fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.290+0000 7fea975ff700 1 -- 172.21.15.151:0/3358176317 shutdown_connections 2023-07-21T22:23:25.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.290+0000 7fea975ff700 1 -- 172.21.15.151:0/3358176317 wait complete. 2023-07-21T22:23:25.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.291+0000 7fea975ff700 1 Processor -- start 2023-07-21T22:23:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea975ff700 1 -- start start 2023-07-21T22:23:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea975ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea90072850 0x7fea90197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea975ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90073160 0x7fea90198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea975ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9010c3f0 0x7fea9019c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea975ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9019cfb0 con 0x7fea9010c3f0 2023-07-21T22:23:25.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea975ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9019d120 con 0x7fea90073160 2023-07-21T22:23:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea975ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9019d2e0 con 0x7fea90072850 2023-07-21T22:23:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea95b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9010c3f0 0x7fea9019c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea95b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9010c3f0 0x7fea9019c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56316/0 (socket says 172.21.15.151:56316) 2023-07-21T22:23:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea95b9c700 1 -- 172.21.15.151:0/3662056168 learned_addr learned my addr 172.21.15.151:0/3662056168 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea94b9a700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90073160 0x7fea90198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea9539b700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea90072850 0x7fea90197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea94b9a700 1 -- 172.21.15.151:0/3662056168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea90072850 msgr2=0x7fea90197dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea94b9a700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea90072850 0x7fea90197dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea94b9a700 1 -- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9010c3f0 msgr2=0x7fea9019c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea94b9a700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9010c3f0 0x7fea9019c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea94b9a700 1 -- 172.21.15.151:0/3662056168 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8c0095f0 con 0x7fea90073160 2023-07-21T22:23:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.293+0000 7fea95b9c700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9010c3f0 0x7fea9019c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:25.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.294+0000 7fea94b9a700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90073160 0x7fea90198300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea8000e9f0 tx=0x7fea8000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.294+0000 7fea867fc700 1 -- 172.21.15.151:0/3662056168 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8000c9c0 con 0x7fea90073160 2023-07-21T22:23:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.294+0000 7fea867fc700 1 -- 172.21.15.151:0/3662056168 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea80010430 con 0x7fea90073160 2023-07-21T22:23:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.294+0000 7fea975ff700 1 -- 172.21.15.151:0/3662056168 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9019d5c0 con 0x7fea90073160 2023-07-21T22:23:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.294+0000 7fea867fc700 1 -- 172.21.15.151:0/3662056168 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80018680 con 0x7fea90073160 2023-07-21T22:23:25.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.294+0000 7fea975ff700 1 -- 172.21.15.151:0/3662056168 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea901a4e00 con 0x7fea90073160 2023-07-21T22:23:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.298+0000 7fea867fc700 1 -- 172.21.15.151:0/3662056168 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fea800105a0 con 0x7fea90073160 2023-07-21T22:23:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.299+0000 7fea867fc700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea7c0a12c0 0x7fea7c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.299+0000 7feaaafa1b80 1 Processor -- start 2023-07-21T22:23:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.299+0000 7feaaafa1b80 1 -- start start 2023-07-21T22:23:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.299+0000 7fea867fc700 1 -- 172.21.15.151:0/3662056168 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fea80014070 con 0x7fea90073160 2023-07-21T22:23:25.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b07cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b01f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7fea9539b700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea7c0a12c0 0x7fea7c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74b024a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c74a07c50 con 0x560c74b08210 2023-07-21T22:23:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c74a5a9e0 con 0x560c74b08660 2023-07-21T22:23:25.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c74a53e70 con 0x560c7495e6b0 2023-07-21T22:23:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7fea94b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b01f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7fea94b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b01f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56332/0 (socket says 172.21.15.151:56332) 2023-07-21T22:23:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7fea94b9a700 1 -- 172.21.15.151:0/1531126393 learned_addr learned my addr 172.21.15.151:0/1531126393 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.300+0000 7fea95b9c700 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74b024a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.301+0000 7fea9539b700 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b07cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.301+0000 7fea94b9a700 1 -- 172.21.15.151:0/1531126393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 msgr2=0x560c74b07cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.301+0000 7fea94b9a700 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b07cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.301+0000 7fea94b9a700 1 -- 172.21.15.151:0/1531126393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 msgr2=0x560c74b024a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.301+0000 7fea94b9a700 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74b024a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.301+0000 7fea94b9a700 1 -- 172.21.15.151:0/1531126393 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c74881d80 con 0x560c74b08210 2023-07-21T22:23:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.301+0000 7fea9539b700 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b07cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:23:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.301+0000 7fea9539b700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea7c0a12c0 0x7fea7c0a3770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fea8c006010 tx=0x7fea8c0051a0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:25.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.301+0000 7fea94b9a700 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b01f40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fea800969e0 tx=0x7fea800998d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfe878e4ef12f33c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7fea7b7fe700 1 -- 172.21.15.151:0/1531126393 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8009dfa0 con 0x560c74b08210 2023-07-21T22:23:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7fea7b7fe700 1 -- 172.21.15.151:0/1531126393 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea800a23c0 con 0x560c74b08210 2023-07-21T22:23:25.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7fea7b7fe700 1 -- 172.21.15.151:0/1531126393 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80099730 con 0x560c74b08210 2023-07-21T22:23:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1531126393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 msgr2=0x560c74b01f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:25.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b01f40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fea800969e0 tx=0x7fea800998d0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1531126393 shutdown_connections 2023-07-21T22:23:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74b024a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b07cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/1531126393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b01f40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1531126393 >> 172.21.15.151:0/1531126393 conn(0x560c74af7ae0 msgr2=0x560c74afd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1531126393 shutdown_connections 2023-07-21T22:23:25.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.303+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1531126393 wait complete. 2023-07-21T22:23:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.304+0000 7feaaafa1b80 1 -- start start 2023-07-21T22:23:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.304+0000 7feaaafa1b80 1 Processor -- start 2023-07-21T22:23:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b0e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b0b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74b0bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c749f3a60 con 0x560c74b08210 2023-07-21T22:23:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c749f3760 con 0x560c74b08660 2023-07-21T22:23:25.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c748d78c0 con 0x560c7495e6b0 2023-07-21T22:23:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7feaaafa1b80 10 client.0 _ll_register_callbacks cb 0x560c749f1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7fea94b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b0b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7fea94b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b0b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56334/0 (socket says 172.21.15.151:56334) 2023-07-21T22:23:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7fea95b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74b0bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7fea94b9a700 1 -- 172.21.15.151:0/2512564968 learned_addr learned my addr 172.21.15.151:0/2512564968 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.305+0000 7fea9539b700 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b0e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea95b9c700 1 -- 172.21.15.151:0/2512564968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 msgr2=0x560c74b0e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea95b9c700 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b0e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea95b9c700 1 -- 172.21.15.151:0/2512564968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 msgr2=0x560c74b0b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:25.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea95b9c700 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b0b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea95b9c700 1 -- 172.21.15.151:0/2512564968 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea901a4e00 con 0x560c74b08660 2023-07-21T22:23:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea94b9a700 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b0b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:25.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea95b9c700 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74b0bf20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea88009710 tx=0x7fea88009ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8230d81ca0b75ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:23:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea78ff9700 1 -- 172.21.15.151:0/2512564968 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88013d90 con 0x560c74b08660 2023-07-21T22:23:25.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7feaaafa1b80 1 -- 172.21.15.151:0/2512564968 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560c749ad490 con 0x560c74b08660 2023-07-21T22:23:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.306+0000 7fea78ff9700 1 -- 172.21.15.151:0/2512564968 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fea88016430 con 0x560c74b08660 2023-07-21T22:23:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.307+0000 7fea78ff9700 1 -- 172.21.15.151:0/2512564968 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea880165f0 con 0x560c74b08660 2023-07-21T22:23:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.307+0000 7feaaafa1b80 10 client.25970 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:25.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.307+0000 7feaaafa1b80 1 -- 172.21.15.151:0/2512564968 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560c7486ac00 con 0x560c74b08660 2023-07-21T22:23:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.307+0000 7fea78ff9700 1 -- 172.21.15.151:0/2512564968 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560c749ad490 con 0x560c74b08660 2023-07-21T22:23:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.307+0000 7fea78ff9700 1 -- 172.21.15.151:0/2512564968 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fea880206a0 con 0x560c74b08660 2023-07-21T22:23:25.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.308+0000 7feaaafa1b80 10 client.25970 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.308+0000 7feaaafa1b80 10 client.25970 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.308+0000 7feaaafa1b80 20 client.25970 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:25.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.308+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560c74b1bac0 0x560c74b1ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.308+0000 7feaaafa1b80 4 client.25970 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.308+0000 7feaaafa1b80 1 -- 172.21.15.151:0/2512564968 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560c74a4ce50 con 0x560c74b1bac0 2023-07-21T22:23:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.308+0000 7fea9539b700 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560c74b1bac0 0x560c74b1ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.309+0000 7fea9539b700 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560c74b1bac0 0x560c74b1ded0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de171f9b07df29c0 server_cookie=9d9c5bbd92272c23 in_seq=0 out_seq=0 2023-07-21T22:23:25.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.309+0000 7fea78ff9700 10 client.25970 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7fea78ff9700 1 -- 172.21.15.151:0/2512564968 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560c74a4ce50 con 0x560c74b1bac0 2023-07-21T22:23:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7fea78ff9700 10 client.25970 handle_command_reply: tid=0 2023-07-21T22:23:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 client.25970 shutdown 2023-07-21T22:23:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 -- 172.21.15.151:0/2512564968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 msgr2=0x560c74b0bf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:25.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74b0bf20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fea88009710 tx=0x7fea88009ed0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 -- 172.21.15.151:0/2512564968 shutdown_connections 2023-07-21T22:23:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560c74b1bac0 0x560c74b1ded0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74b0bf20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b0e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/2512564968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08210 0x560c74b0b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 -- 172.21.15.151:0/2512564968 >> 172.21.15.151:0/2512564968 conn(0x560c74af7ae0 msgr2=0x560c74afc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7fea78ff9700 0 client.25970 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:25.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 -- 172.21.15.151:0/2512564968 shutdown_connections 2023-07-21T22:23:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.310+0000 7feaaafa1b80 1 -- 172.21.15.151:0/2512564968 wait complete. 2023-07-21T22:23:25.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.311+0000 7feaaafa1b80 20 client.25970 trim_cache size 0 max 16384 2023-07-21T22:23:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.332+0000 7feaaafa1b80 1 Processor -- start 2023-07-21T22:23:25.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.332+0000 7feaaafa1b80 1 -- start start 2023-07-21T22:23:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.332+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c7495e6b0 0x560c74b12ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.332+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c74b08210 0x560c74b0e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.332+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74afcb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.332+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c74b0c280 con 0x560c7495e6b0 2023-07-21T22:23:25.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.332+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c74afdcb0 con 0x560c74b08660 2023-07-21T22:23:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.332+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c74b07890 con 0x560c74b08210 2023-07-21T22:23:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea9539b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c7495e6b0 0x560c74b12ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea94b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c74b08210 0x560c74b0e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea9539b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c7495e6b0 0x560c74b12ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56344/0 (socket says 172.21.15.151:56344) 2023-07-21T22:23:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea9539b700 1 -- 172.21.15.151:0/1916320135 learned_addr learned my addr 172.21.15.151:0/1916320135 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:25.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea95b9c700 1 --2- 172.21.15.151:0/1916320135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74afcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea94b9a700 1 -- 172.21.15.151:0/1916320135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 msgr2=0x560c74afcb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea94b9a700 1 --2- 172.21.15.151:0/1916320135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74afcb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea94b9a700 1 -- 172.21.15.151:0/1916320135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c7495e6b0 msgr2=0x560c74b12ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea94b9a700 1 --2- 172.21.15.151:0/1916320135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c7495e6b0 0x560c74b12ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea94b9a700 1 -- 172.21.15.151:0/1916320135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560c74b0b5f0 con 0x560c74b08210 2023-07-21T22:23:25.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.333+0000 7fea94b9a700 1 --2- 172.21.15.151:0/1916320135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c74b08210 0x560c74b0e100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea80096470 tx=0x7fea8000c6e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=359237684e9f37f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7fea7bfff700 1 -- 172.21.15.151:0/1916320135 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea800b8070 con 0x560c74b08210 2023-07-21T22:23:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7fea7bfff700 1 -- 172.21.15.151:0/1916320135 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea8009dfa0 con 0x560c74b08210 2023-07-21T22:23:25.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7fea7bfff700 1 -- 172.21.15.151:0/1916320135 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea800a1f30 con 0x560c74b08210 2023-07-21T22:23:25.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1916320135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c74b08210 msgr2=0x560c74b0e100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/1916320135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c74b08210 0x560c74b0e100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fea80096470 tx=0x7fea8000c6e0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1916320135 shutdown_connections 2023-07-21T22:23:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/1916320135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08660 0x560c74afcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/1916320135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c7495e6b0 0x560c74b12ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/1916320135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c74b08210 0x560c74b0e100 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.334+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1916320135 >> 172.21.15.151:0/1916320135 conn(0x560c74af7ae0 msgr2=0x560c74b05970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.336+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1916320135 shutdown_connections 2023-07-21T22:23:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.336+0000 7feaaafa1b80 1 -- 172.21.15.151:0/1916320135 wait complete. 2023-07-21T22:23:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.336+0000 7feaaafa1b80 1 -- start start 2023-07-21T22:23:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.336+0000 7feaaafa1b80 1 Processor -- start 2023-07-21T22:23:25.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b0f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08210 0x560c74b0f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08660 0x560c74b6e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c74b0fe20 con 0x560c74b08660 2023-07-21T22:23:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c74b0ff90 con 0x560c74b08210 2023-07-21T22:23:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560c74b6ef00 con 0x560c7495e6b0 2023-07-21T22:23:25.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 10 client.0 _ll_register_callbacks cb 0x560c749f1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea9539b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b0f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea9539b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b0f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56000/0 (socket says 172.21.15.151:56000) 2023-07-21T22:23:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea94b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08210 0x560c74b0f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea9539b700 1 -- 172.21.15.151:0/3999739513 learned_addr learned my addr 172.21.15.151:0/3999739513 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea95b9c700 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08660 0x560c74b6e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea94b9a700 1 -- 172.21.15.151:0/3999739513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 msgr2=0x560c74b0f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:25.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea94b9a700 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b0f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea94b9a700 1 -- 172.21.15.151:0/3999739513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08660 msgr2=0x560c74b6e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea94b9a700 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08660 0x560c74b6e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea94b9a700 1 -- 172.21.15.151:0/3999739513 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560c74881d80 con 0x560c74b08210 2023-07-21T22:23:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea94b9a700 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08210 0x560c74b0f640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x560c74b06660 tx=0x7fea800a2160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1c3492850e5a2bd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea78ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:23:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea78ff9700 1 -- 172.21.15.151:0/3999739513 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea800b8040 con 0x560c74b08210 2023-07-21T22:23:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea78ff9700 1 -- 172.21.15.151:0/3999739513 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fea80094b80 con 0x560c74b08210 2023-07-21T22:23:25.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 1 -- 172.21.15.151:0/3999739513 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fea800a23c0 con 0x560c74b08210 2023-07-21T22:23:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7fea78ff9700 1 -- 172.21.15.151:0/3999739513 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea800b83b0 con 0x560c74b08210 2023-07-21T22:23:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 10 client.25976 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.337+0000 7feaaafa1b80 1 -- 172.21.15.151:0/3999739513 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x560c748a81f0 con 0x560c74b08210 2023-07-21T22:23:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.338+0000 7fea78ff9700 1 -- 172.21.15.151:0/3999739513 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fea800a23c0 con 0x560c74b08210 2023-07-21T22:23:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.338+0000 7fea78ff9700 1 -- 172.21.15.151:0/3999739513 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fea80095d60 con 0x560c74b08210 2023-07-21T22:23:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.338+0000 7feaaafa1b80 10 client.25976 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.338+0000 7feaaafa1b80 10 client.25976 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:25.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.338+0000 7feaaafa1b80 20 client.25976 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.338+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560c74b701b0 0x560c74b72590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.338+0000 7feaaafa1b80 4 client.25976 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:23:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.338+0000 7feaaafa1b80 1 -- 172.21.15.151:0/3999739513 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560c74a0eff0 con 0x560c74b701b0 2023-07-21T22:23:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.338+0000 7fea9539b700 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560c74b701b0 0x560c74b72590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.340+0000 7fea9539b700 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560c74b701b0 0x560c74b72590 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b76575af6e8f9c8a server_cookie=c599b831c7b3edfc in_seq=0 out_seq=0 2023-07-21T22:23:25.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.340+0000 7fea78ff9700 10 client.25976 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.353+0000 7fea78ff9700 1 -- 172.21.15.151:0/3999739513 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560c74a0eff0 con 0x560c74b701b0 2023-07-21T22:23:25.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.353+0000 7fea78ff9700 10 client.25976 handle_command_reply: tid=0 2023-07-21T22:23:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.353+0000 7feaaafa1b80 1 client.25976 shutdown 2023-07-21T22:23:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 -- 172.21.15.151:0/3999739513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08210 msgr2=0x560c74b0f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08210 0x560c74b0f640 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x560c74b06660 tx=0x7fea800a2160 comp rx=0 tx=0).stop 2023-07-21T22:23:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 -- 172.21.15.151:0/3999739513 shutdown_connections 2023-07-21T22:23:25.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560c74b701b0 0x560c74b72590 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560c74b08660 0x560c74b6e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560c7495e6b0 0x560c74b0f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7fea78ff9700 0 client.25976 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:25.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 --2- 172.21.15.151:0/3999739513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560c74b08210 0x560c74b0f640 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 -- 172.21.15.151:0/3999739513 >> 172.21.15.151:0/3999739513 conn(0x560c74af7ae0 msgr2=0x560c74b06880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 -- 172.21.15.151:0/3999739513 shutdown_connections 2023-07-21T22:23:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 1 -- 172.21.15.151:0/3999739513 wait complete. 2023-07-21T22:23:25.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.354+0000 7feaaafa1b80 20 client.25976 trim_cache size 0 max 16384 2023-07-21T22:23:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:23:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:23:25.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:23:25.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:23:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 -- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea7c0a12c0 msgr2=0x7fea7c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea7c0a12c0 0x7fea7c0a3770 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fea8c006010 tx=0x7fea8c0051a0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 -- 172.21.15.151:0/3662056168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90073160 msgr2=0x7fea90198300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90073160 0x7fea90198300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fea8000e9f0 tx=0x7fea8000ed00 comp rx=0 tx=0).stop 2023-07-21T22:23:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 -- 172.21.15.151:0/3662056168 shutdown_connections 2023-07-21T22:23:25.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fea7c0a12c0 0x7fea7c0a3770 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fea9010c3f0 0x7fea9019c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fea90072850 0x7fea90197dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 --2- 172.21.15.151:0/3662056168 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90073160 0x7fea90198300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:25.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 -- 172.21.15.151:0/3662056168 >> 172.21.15.151:0/3662056168 conn(0x7fea900fb650 msgr2=0x7fea9010e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 -- 172.21.15.151:0/3662056168 shutdown_connections 2023-07-21T22:23:25.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:25.355+0000 7fea975ff700 1 -- 172.21.15.151:0/3662056168 wait complete. 2023-07-21T22:23:25.409 INFO:teuthology.orchestra.run.smithi151.stderr:16100000 of 50000000 tuples (32%) done (elapsed 228.90 s, remaining 481.97 s) 2023-07-21T22:23:25.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:25 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:23:25.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:25 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:23:25.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:25 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:23:25.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:25 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:23:25.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:25 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:23:25.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:25 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:23:25.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:25 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:23:25.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:25 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:23:25.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:25 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:23:26.612 INFO:teuthology.orchestra.run.smithi151.stderr:16200000 of 50000000 tuples (32%) done (elapsed 230.10 s, remaining 480.09 s) 2023-07-21T22:23:26.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:26 smithi195 ceph-mon[97365]: pgmap v130: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:26.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:26 smithi151 ceph-mon[95510]: pgmap v130: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:26.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:26 smithi187 ceph-mon[96918]: pgmap v130: 97 pgs: 97 active+clean; 3.7 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:27.900 INFO:teuthology.orchestra.run.smithi151.stderr:16300000 of 50000000 tuples (32%) done (elapsed 231.39 s, remaining 478.40 s) 2023-07-21T22:23:28.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:28 smithi195 ceph-mon[97365]: pgmap v131: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:23:28.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:28 smithi151 ceph-mon[95510]: pgmap v131: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:23:28.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:28 smithi187 ceph-mon[96918]: pgmap v131: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 36 MiB/s wr, 30 op/s 2023-07-21T22:23:29.113 INFO:teuthology.orchestra.run.smithi151.stderr:16400000 of 50000000 tuples (32%) done (elapsed 232.61 s, remaining 476.56 s) 2023-07-21T22:23:30.320 INFO:teuthology.orchestra.run.smithi151.stderr:16500000 of 50000000 tuples (33%) done (elapsed 233.81 s, remaining 474.71 s) 2023-07-21T22:23:30.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:30 smithi195 ceph-mon[97365]: pgmap v132: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:30.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:30 smithi151 ceph-mon[95510]: pgmap v132: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:30.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:30 smithi187 ceph-mon[96918]: pgmap v132: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:31.559 INFO:teuthology.orchestra.run.smithi151.stderr:16600000 of 50000000 tuples (33%) done (elapsed 235.05 s, remaining 472.93 s) 2023-07-21T22:23:32.657 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:32 smithi195 ceph-mon[97365]: pgmap v133: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:32.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:32 smithi151 ceph-mon[95510]: pgmap v133: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:32.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:32 smithi187 ceph-mon[96918]: pgmap v133: 97 pgs: 97 active+clean; 3.8 GiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:32.888 INFO:teuthology.orchestra.run.smithi151.stderr:16700000 of 50000000 tuples (33%) done (elapsed 236.38 s, remaining 471.35 s) 2023-07-21T22:23:34.119 INFO:teuthology.orchestra.run.smithi151.stderr:16800000 of 50000000 tuples (33%) done (elapsed 237.61 s, remaining 469.56 s) 2023-07-21T22:23:34.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:34 smithi151 ceph-mon[95510]: pgmap v134: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:23:34.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:34 smithi187 ceph-mon[96918]: pgmap v134: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:23:34.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:34 smithi195 ceph-mon[97365]: pgmap v134: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 36 MiB/s wr, 28 op/s 2023-07-21T22:23:35.352 INFO:teuthology.orchestra.run.smithi151.stderr:16900000 of 50000000 tuples (33%) done (elapsed 238.84 s, remaining 467.79 s) 2023-07-21T22:23:36.682 INFO:teuthology.orchestra.run.smithi151.stderr:17000000 of 50000000 tuples (34%) done (elapsed 240.17 s, remaining 466.22 s) 2023-07-21T22:23:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:36 smithi151 ceph-mon[95510]: pgmap v135: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:36.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:36 smithi187 ceph-mon[96918]: pgmap v135: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:36.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:36 smithi195 ceph-mon[97365]: pgmap v135: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:37.894 INFO:teuthology.orchestra.run.smithi151.stderr:17100000 of 50000000 tuples (34%) done (elapsed 241.39 s, remaining 464.42 s) 2023-07-21T22:23:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.536+0000 7f64e0bff700 1 -- 172.21.15.151:0/4205445202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 msgr2=0x7f64dc105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.536+0000 7f64e0bff700 1 --2- 172.21.15.151:0/4205445202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 0x7f64dc105ee0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009990 tx=0x7f64cc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.536+0000 7f64e0bff700 1 -- 172.21.15.151:0/4205445202 shutdown_connections 2023-07-21T22:23:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.536+0000 7f64e0bff700 1 --2- 172.21.15.151:0/4205445202 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc1004b0 0x7f64dc10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.536+0000 7f64e0bff700 1 --2- 172.21.15.151:0/4205445202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 0x7f64dc105ee0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.536+0000 7f64e0bff700 1 --2- 172.21.15.151:0/4205445202 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64dc0ffb00 0x7f64dc0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.536+0000 7f64e0bff700 1 -- 172.21.15.151:0/4205445202 >> 172.21.15.151:0/4205445202 conn(0x7f64dc0fb600 msgr2=0x7f64dc0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.536+0000 7f64e0bff700 1 -- 172.21.15.151:0/4205445202 shutdown_connections 2023-07-21T22:23:38.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.536+0000 7f64e0bff700 1 -- 172.21.15.151:0/4205445202 wait complete. 2023-07-21T22:23:38.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.537+0000 7f64e0bff700 1 Processor -- start 2023-07-21T22:23:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.537+0000 7f64e0bff700 1 -- start start 2023-07-21T22:23:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64e0bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc0ffb00 0x7f64dc197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64e0bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64dc1004b0 0x7f64dc1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64e0bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 0x7f64dc19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64e0bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc19cf60 con 0x7f64dc105b10 2023-07-21T22:23:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64e0bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc19d0d0 con 0x7f64dc1004b0 2023-07-21T22:23:38.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64e0bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64dc19d290 con 0x7f64dc0ffb00 2023-07-21T22:23:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64dad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 0x7f64dc19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64dad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 0x7f64dc19c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49078/0 (socket says 172.21.15.151:49078) 2023-07-21T22:23:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64dad9d700 1 -- 172.21.15.151:0/1687758983 learned_addr learned my addr 172.21.15.151:0/1687758983 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64da59c700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc0ffb00 0x7f64dc197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.538+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64dc1004b0 0x7f64dc1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64dad9d700 1 -- 172.21.15.151:0/1687758983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc0ffb00 msgr2=0x7f64dc197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64dad9d700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc0ffb00 0x7f64dc197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64dad9d700 1 -- 172.21.15.151:0/1687758983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64dc1004b0 msgr2=0x7f64dc1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64dad9d700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64dc1004b0 0x7f64dc1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64dad9d700 1 -- 172.21.15.151:0/1687758983 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64cc0095f0 con 0x7f64dc105b10 2023-07-21T22:23:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64da59c700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc0ffb00 0x7f64dc197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64dad9d700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 0x7f64dc19c920 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f64d4007ee0 tx=0x7f64d400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64cb7fe700 1 -- 172.21.15.151:0/1687758983 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4017070 con 0x7f64dc105b10 2023-07-21T22:23:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64cb7fe700 1 -- 172.21.15.151:0/1687758983 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64d400f040 con 0x7f64dc105b10 2023-07-21T22:23:38.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64cb7fe700 1 -- 172.21.15.151:0/1687758983 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4005710 con 0x7f64dc105b10 2023-07-21T22:23:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.539+0000 7f64e0bff700 1 -- 172.21.15.151:0/1687758983 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64dc19d570 con 0x7f64dc105b10 2023-07-21T22:23:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.540+0000 7f64e0bff700 1 -- 172.21.15.151:0/1687758983 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc1a4db0 con 0x7f64dc105b10 2023-07-21T22:23:38.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.543+0000 7f64cb7fe700 1 -- 172.21.15.151:0/1687758983 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f64d4005870 con 0x7f64dc105b10 2023-07-21T22:23:38.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.544+0000 7f64cb7fe700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a1340 0x7f64c40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.544+0000 7f64f4489b80 1 Processor -- start 2023-07-21T22:23:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.544+0000 7f64f4489b80 1 -- start start 2023-07-21T22:23:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.544+0000 7f64cb7fe700 1 -- 172.21.15.151:0/1687758983 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f64d40cc120 con 0x7f64dc105b10 2023-07-21T22:23:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64da59c700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a1340 0x7f64c40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c14a6b0 0x55db5c2f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 0x55db5c2edf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 0x55db5c2ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64f4489b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c1f3c50 con 0x55db5c14a6b0 2023-07-21T22:23:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64f4489b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c2469e0 con 0x55db5c2f4210 2023-07-21T22:23:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64f4489b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c23fe70 con 0x55db5c2f4660 2023-07-21T22:23:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64da59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c14a6b0 0x55db5c2f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64da59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c14a6b0 0x55db5c2f3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49082/0 (socket says 172.21.15.151:49082) 2023-07-21T22:23:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.545+0000 7f64da59c700 1 -- 172.21.15.151:0/3675309563 learned_addr learned my addr 172.21.15.151:0/3675309563 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:38.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64dad9d700 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 0x55db5c2ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 0x55db5c2edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64da59c700 1 -- 172.21.15.151:0/3675309563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 msgr2=0x55db5c2ee4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64da59c700 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 0x55db5c2ee4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64da59c700 1 -- 172.21.15.151:0/3675309563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 msgr2=0x55db5c2edf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64da59c700 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 0x55db5c2edf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64da59c700 1 -- 172.21.15.151:0/3675309563 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db5c06dd80 con 0x55db5c14a6b0 2023-07-21T22:23:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64dad9d700 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 0x55db5c2ee4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:38.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 0x55db5c2edf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:23:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64da59c700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a1340 0x7f64c40a37f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0098e0 tx=0x7f64cc00bb80 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64da59c700 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c14a6b0 0x55db5c2f3cd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009990 tx=0x7f64cc029030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f45ab78d107584 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.546+0000 7f64c8ff9700 1 -- 172.21.15.151:0/3675309563 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc01d030 con 0x55db5c14a6b0 2023-07-21T22:23:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.547+0000 7f64c8ff9700 1 -- 172.21.15.151:0/3675309563 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64cc00be60 con 0x55db5c14a6b0 2023-07-21T22:23:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.547+0000 7f64c8ff9700 1 -- 172.21.15.151:0/3675309563 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc005280 con 0x55db5c14a6b0 2023-07-21T22:23:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.547+0000 7f64f4489b80 1 -- 172.21.15.151:0/3675309563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c14a6b0 msgr2=0x55db5c2f3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.547+0000 7f64f4489b80 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c14a6b0 0x55db5c2f3cd0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f64cc009990 tx=0x7f64cc029030 comp rx=0 tx=0).stop 2023-07-21T22:23:38.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.547+0000 7f64f4489b80 1 -- 172.21.15.151:0/3675309563 shutdown_connections 2023-07-21T22:23:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.547+0000 7f64f4489b80 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 0x55db5c2ee4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.547+0000 7f64f4489b80 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c14a6b0 0x55db5c2f3cd0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.547+0000 7f64f4489b80 1 --2- 172.21.15.151:0/3675309563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 0x55db5c2edf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.547+0000 7f64f4489b80 1 -- 172.21.15.151:0/3675309563 >> 172.21.15.151:0/3675309563 conn(0x55db5c2e3ae0 msgr2=0x55db5c2e90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.548+0000 7f64f4489b80 1 -- 172.21.15.151:0/3675309563 shutdown_connections 2023-07-21T22:23:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.548+0000 7f64f4489b80 1 -- 172.21.15.151:0/3675309563 wait complete. 2023-07-21T22:23:38.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.548+0000 7f64f4489b80 1 -- start start 2023-07-21T22:23:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.548+0000 7f64f4489b80 1 Processor -- start 2023-07-21T22:23:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c14a6b0 0x55db5c2fd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 0x55db5c2f7650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64f4489b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c1dfa60 con 0x55db5c2f4210 2023-07-21T22:23:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64f4489b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c1df760 con 0x55db5c14a6b0 2023-07-21T22:23:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64f4489b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c0c38c0 con 0x55db5c2f4660 2023-07-21T22:23:38.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64f4489b80 10 client.0 _ll_register_callbacks cb 0x55db5c1dd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64d9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64d9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49096/0 (socket says 172.21.15.151:49096) 2023-07-21T22:23:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64d9d9b700 1 -- 172.21.15.151:0/2684968327 learned_addr learned my addr 172.21.15.151:0/2684968327 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64dad9d700 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 0x55db5c2f7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64da59c700 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c14a6b0 0x55db5c2fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64d9d9b700 1 -- 172.21.15.151:0/2684968327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 msgr2=0x55db5c2f7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 0x55db5c2f7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64d9d9b700 1 -- 172.21.15.151:0/2684968327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c14a6b0 msgr2=0x55db5c2fd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c14a6b0 0x55db5c2fd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.549+0000 7f64d9d9b700 1 -- 172.21.15.151:0/2684968327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64dc1a4db0 con 0x55db5c2f4210 2023-07-21T22:23:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.550+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fd900 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f64d00113e0 tx=0x7f64d00117a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53cfb2628253548a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.550+0000 7f64c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.550+0000 7f64c1ffb700 1 -- 172.21.15.151:0/2684968327 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d0012450 con 0x55db5c2f4210 2023-07-21T22:23:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.550+0000 7f64f4489b80 1 -- 172.21.15.151:0/2684968327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db5c199490 con 0x55db5c2f4210 2023-07-21T22:23:38.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.550+0000 7f64c1ffb700 1 -- 172.21.15.151:0/2684968327 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f64d00125b0 con 0x55db5c2f4210 2023-07-21T22:23:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.550+0000 7f64c1ffb700 1 -- 172.21.15.151:0/2684968327 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64d0012770 con 0x55db5c2f4210 2023-07-21T22:23:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.550+0000 7f64f4489b80 10 client.16239 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.550+0000 7f64f4489b80 1 -- 172.21.15.151:0/2684968327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f64cc020040 con 0x55db5c2f4210 2023-07-21T22:23:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.551+0000 7f64c1ffb700 1 -- 172.21.15.151:0/2684968327 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55db5c199490 con 0x55db5c2f4210 2023-07-21T22:23:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.551+0000 7f64c1ffb700 1 -- 172.21.15.151:0/2684968327 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f64d001b9a0 con 0x55db5c2f4210 2023-07-21T22:23:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.551+0000 7f64f4489b80 10 client.16239 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.551+0000 7f64f4489b80 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:38.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.551+0000 7f64f4489b80 20 client.16239 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.551+0000 7f64f4489b80 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db5c307a10 0x55db5c309e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.551+0000 7f64f4489b80 4 client.16239 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.551+0000 7f64f4489b80 1 -- 172.21.15.151:0/2684968327 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db5c238e50 con 0x55db5c307a10 2023-07-21T22:23:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.552+0000 7f64da59c700 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db5c307a10 0x55db5c309e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.552+0000 7f64da59c700 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db5c307a10 0x55db5c309e20 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33bc782565f6a3b5 server_cookie=7b561af3b6b06d4a in_seq=0 out_seq=0 2023-07-21T22:23:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.552+0000 7f64c1ffb700 10 client.16239 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.553+0000 7f64c1ffb700 1 -- 172.21.15.151:0/2684968327 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55db5c238e50 con 0x55db5c307a10 2023-07-21T22:23:38.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.553+0000 7f64c1ffb700 10 client.16239 handle_command_reply: tid=0 2023-07-21T22:23:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.553+0000 7f64f4489b80 1 client.16239 shutdown 2023-07-21T22:23:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.553+0000 7f64f4489b80 1 -- 172.21.15.151:0/2684968327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 msgr2=0x55db5c2fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.553+0000 7f64f4489b80 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fd900 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f64d00113e0 tx=0x7f64d00117a0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.553+0000 7f64f4489b80 1 -- 172.21.15.151:0/2684968327 shutdown_connections 2023-07-21T22:23:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.553+0000 7f64f4489b80 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db5c307a10 0x55db5c309e20 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.553+0000 7f64f4489b80 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c14a6b0 0x55db5c2fd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.554+0000 7f64f4489b80 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c2f4660 0x55db5c2f7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.554+0000 7f64f4489b80 1 --2- 172.21.15.151:0/2684968327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fd900 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.554+0000 7f64f4489b80 1 -- 172.21.15.151:0/2684968327 >> 172.21.15.151:0/2684968327 conn(0x55db5c2e3ae0 msgr2=0x55db5c2e83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.553+0000 7f64c1ffb700 0 client.16239 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.554+0000 7f64f4489b80 1 -- 172.21.15.151:0/2684968327 shutdown_connections 2023-07-21T22:23:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.554+0000 7f64f4489b80 1 -- 172.21.15.151:0/2684968327 wait complete. 2023-07-21T22:23:38.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.554+0000 7f64f4489b80 20 client.16239 trim_cache size 0 max 16384 2023-07-21T22:23:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.571+0000 7f64f4489b80 1 Processor -- start 2023-07-21T22:23:38.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.571+0000 7f64f4489b80 1 -- start start 2023-07-21T22:23:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.571+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 0x55db5c2f7600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.571+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 0x55db5c2e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.571+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4660 0x55db5c2e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.571+0000 7f64f4489b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c2e5c40 con 0x55db5c2f4660 2023-07-21T22:23:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.571+0000 7f64f4489b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c2f8760 con 0x55db5c2f4210 2023-07-21T22:23:38.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.571+0000 7f64f4489b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c2e95e0 con 0x55db5c14a6b0 2023-07-21T22:23:38.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.571+0000 7f64dad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4660 0x55db5c2e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64dad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4660 0x55db5c2e90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49110/0 (socket says 172.21.15.151:49110) 2023-07-21T22:23:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64dad9d700 1 -- 172.21.15.151:0/1635205204 learned_addr learned my addr 172.21.15.151:0/1635205204 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/1635205204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 0x55db5c2e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64da59c700 1 --2- 172.21.15.151:0/1635205204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 0x55db5c2f7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64dad9d700 1 -- 172.21.15.151:0/1635205204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 msgr2=0x55db5c2f7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:38.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64dad9d700 1 --2- 172.21.15.151:0/1635205204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 0x55db5c2f7600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64dad9d700 1 -- 172.21.15.151:0/1635205204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 msgr2=0x55db5c2e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64dad9d700 1 --2- 172.21.15.151:0/1635205204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 0x55db5c2e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64dad9d700 1 -- 172.21.15.151:0/1635205204 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db5c30ea10 con 0x55db5c2f4660 2023-07-21T22:23:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64dad9d700 1 --2- 172.21.15.151:0/1635205204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4660 0x55db5c2e90a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f64d40c9920 tx=0x7f64d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c120be8b94fbcd6a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.572+0000 7f64c97fa700 1 -- 172.21.15.151:0/1635205204 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4098ba0 con 0x55db5c2f4660 2023-07-21T22:23:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64c97fa700 1 -- 172.21.15.151:0/1635205204 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64d400dc60 con 0x55db5c2f4660 2023-07-21T22:23:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64c97fa700 1 -- 172.21.15.151:0/1635205204 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d40994a0 con 0x55db5c2f4660 2023-07-21T22:23:38.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64f4489b80 1 -- 172.21.15.151:0/1635205204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4660 msgr2=0x55db5c2e90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64f4489b80 1 --2- 172.21.15.151:0/1635205204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4660 0x55db5c2e90a0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f64d40c9920 tx=0x7f64d400b040 comp rx=0 tx=0).stop 2023-07-21T22:23:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64f4489b80 1 -- 172.21.15.151:0/1635205204 shutdown_connections 2023-07-21T22:23:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64f4489b80 1 --2- 172.21.15.151:0/1635205204 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4660 0x55db5c2e90a0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64f4489b80 1 --2- 172.21.15.151:0/1635205204 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 0x55db5c2f7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64f4489b80 1 --2- 172.21.15.151:0/1635205204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4210 0x55db5c2e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64f4489b80 1 -- 172.21.15.151:0/1635205204 >> 172.21.15.151:0/1635205204 conn(0x55db5c2e3ae0 msgr2=0x55db5c2f6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64f4489b80 1 -- 172.21.15.151:0/1635205204 shutdown_connections 2023-07-21T22:23:38.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.573+0000 7f64f4489b80 1 -- 172.21.15.151:0/1635205204 wait complete. 2023-07-21T22:23:38.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.574+0000 7f64f4489b80 1 -- start start 2023-07-21T22:23:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.574+0000 7f64f4489b80 1 Processor -- start 2023-07-21T22:23:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.574+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 0x55db5c2fd520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64f4489b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4660 0x55db5c2fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64f4489b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c2fc290 con 0x55db5c2f4210 2023-07-21T22:23:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64f4489b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c2fc400 con 0x55db5c2f4660 2023-07-21T22:23:38.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64f4489b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db5c2fc570 con 0x55db5c14a6b0 2023-07-21T22:23:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64f4489b80 10 client.0 _ll_register_callbacks cb 0x7f64d000ba30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64d9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64d9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49114/0 (socket says 172.21.15.151:49114) 2023-07-21T22:23:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64d9d9b700 1 -- 172.21.15.151:0/955502508 learned_addr learned my addr 172.21.15.151:0/955502508 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64da59c700 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 0x55db5c2fd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64dad9d700 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4660 0x55db5c2fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64da59c700 1 -- 172.21.15.151:0/955502508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4660 msgr2=0x55db5c2fbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:38.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64da59c700 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4660 0x55db5c2fbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64da59c700 1 -- 172.21.15.151:0/955502508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 msgr2=0x55db5c2fb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64da59c700 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64da59c700 1 -- 172.21.15.151:0/955502508 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d4021070 con 0x55db5c14a6b0 2023-07-21T22:23:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.575+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.576+0000 7f64da59c700 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 0x55db5c2fd520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64cc000c00 tx=0x7f64cc009f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=312ef3393e0c431 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.576+0000 7f64c1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:23:38.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.576+0000 7f64c1ffb700 1 -- 172.21.15.151:0/955502508 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64cc01d040 con 0x55db5c14a6b0 2023-07-21T22:23:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.576+0000 7f64c1ffb700 1 -- 172.21.15.151:0/955502508 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f64cc03e500 con 0x55db5c14a6b0 2023-07-21T22:23:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.576+0000 7f64f4489b80 1 -- 172.21.15.151:0/955502508 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f64cc00be60 con 0x55db5c14a6b0 2023-07-21T22:23:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64c1ffb700 1 -- 172.21.15.151:0/955502508 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64cc003ee0 con 0x55db5c14a6b0 2023-07-21T22:23:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64f4489b80 10 client.26023 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64f4489b80 1 -- 172.21.15.151:0/955502508 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55db5c056c00 con 0x55db5c14a6b0 2023-07-21T22:23:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64c1ffb700 1 -- 172.21.15.151:0/955502508 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64cc00be60 con 0x55db5c14a6b0 2023-07-21T22:23:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64c1ffb700 1 -- 172.21.15.151:0/955502508 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f64cc031750 con 0x55db5c14a6b0 2023-07-21T22:23:38.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64f4489b80 10 client.26023 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64f4489b80 10 client.26023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64f4489b80 20 client.26023 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64f4489b80 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db5c35c8f0 0x55db5c35ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64f4489b80 4 client.26023 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:23:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.577+0000 7f64f4489b80 1 -- 172.21.15.151:0/955502508 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55db5c1faff0 con 0x55db5c35c8f0 2023-07-21T22:23:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.578+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db5c35c8f0 0x55db5c35ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.578+0000 7f64d9d9b700 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db5c35c8f0 0x55db5c35ed00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22706ae6fb33c266 server_cookie=b98188cde875c105 in_seq=0 out_seq=0 2023-07-21T22:23:38.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.578+0000 7f64c1ffb700 10 client.26023 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64c1ffb700 1 -- 172.21.15.151:0/955502508 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55db5c1faff0 con 0x55db5c35c8f0 2023-07-21T22:23:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64c1ffb700 10 client.26023 handle_command_reply: tid=0 2023-07-21T22:23:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64f4489b80 1 client.26023 shutdown 2023-07-21T22:23:38.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64f4489b80 1 -- 172.21.15.151:0/955502508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 msgr2=0x55db5c2fd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64f4489b80 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 0x55db5c2fd520 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64cc000c00 tx=0x7f64cc009f70 comp rx=0 tx=0).stop 2023-07-21T22:23:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64f4489b80 1 -- 172.21.15.151:0/955502508 shutdown_connections 2023-07-21T22:23:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64f4489b80 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db5c35c8f0 0x55db5c35ed00 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64f4489b80 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db5c2f4660 0x55db5c2fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64c1ffb700 0 client.26023 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64f4489b80 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db5c14a6b0 0x55db5c2fd520 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64f4489b80 1 --2- 172.21.15.151:0/955502508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db5c2f4210 0x55db5c2fb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.592+0000 7f64f4489b80 1 -- 172.21.15.151:0/955502508 >> 172.21.15.151:0/955502508 conn(0x55db5c2e3ae0 msgr2=0x55db5c2f75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.593+0000 7f64f4489b80 1 -- 172.21.15.151:0/955502508 shutdown_connections 2023-07-21T22:23:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.593+0000 7f64f4489b80 1 -- 172.21.15.151:0/955502508 wait complete. 2023-07-21T22:23:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.593+0000 7f64f4489b80 20 client.26023 trim_cache size 0 max 16384 2023-07-21T22:23:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:23:38.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:23:38.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:23:38.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:23:38.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.593+0000 7f64e0bff700 1 -- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a1340 msgr2=0x7f64c40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.593+0000 7f64e0bff700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a1340 0x7f64c40a37f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f64cc0098e0 tx=0x7f64cc00bb80 comp rx=0 tx=0).stop 2023-07-21T22:23:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.593+0000 7f64e0bff700 1 -- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 msgr2=0x7f64dc19c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.593+0000 7f64e0bff700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 0x7f64dc19c920 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f64d4007ee0 tx=0x7f64d400d3b0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.594+0000 7f64e0bff700 1 -- 172.21.15.151:0/1687758983 shutdown_connections 2023-07-21T22:23:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.594+0000 7f64e0bff700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a1340 0x7f64c40a37f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.594+0000 7f64e0bff700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64dc105b10 0x7f64dc19c920 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.594+0000 7f64e0bff700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64dc0ffb00 0x7f64dc197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.594+0000 7f64e0bff700 1 --2- 172.21.15.151:0/1687758983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64dc1004b0 0x7f64dc1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.594+0000 7f64e0bff700 1 -- 172.21.15.151:0/1687758983 >> 172.21.15.151:0/1687758983 conn(0x7f64dc0fb600 msgr2=0x7f64dc10ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.594+0000 7f64e0bff700 1 -- 172.21.15.151:0/1687758983 shutdown_connections 2023-07-21T22:23:38.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:38.594+0000 7f64e0bff700 1 -- 172.21.15.151:0/1687758983 wait complete. 2023-07-21T22:23:38.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:38 smithi151 ceph-mon[95510]: pgmap v136: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 31 op/s 2023-07-21T22:23:38.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:38 smithi187 ceph-mon[96918]: pgmap v136: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 31 op/s 2023-07-21T22:23:38.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:38 smithi195 ceph-mon[97365]: pgmap v136: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 31 op/s 2023-07-21T22:23:39.115 INFO:teuthology.orchestra.run.smithi151.stderr:17200000 of 50000000 tuples (34%) done (elapsed 242.61 s, remaining 462.65 s) 2023-07-21T22:23:40.056 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:23:40.280 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.235+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1422272395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c0100d00 msgr2=0x7fd0c01010d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.235+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1422272395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c0100d00 0x7fd0c01010d0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009990 tx=0x7fd0b0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.235+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1422272395 shutdown_connections 2023-07-21T22:23:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.235+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1422272395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0c010a040 0x7fd0c010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.235+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1422272395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c0100d00 0x7fd0c01010d0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.281 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.235+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1422272395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c0101610 0x7fd0c0109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.235+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1422272395 >> 172.21.15.151:0/1422272395 conn(0x7fd0c00fa4b0 msgr2=0x7fd0c00fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:40.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.235+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1422272395 shutdown_connections 2023-07-21T22:23:40.282 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.235+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1422272395 wait complete. 2023-07-21T22:23:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.236+0000 7fd0c5dff700 1 Processor -- start 2023-07-21T22:23:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.236+0000 7fd0c5dff700 1 -- start start 2023-07-21T22:23:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0c5dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c0100d00 0x7fd0c019bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0c5dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0c0101610 0x7fd0c019c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0c5dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c010a040 0x7fd0c0195b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.283 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0c5dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c01961c0 con 0x7fd0c0100d00 2023-07-21T22:23:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0c5dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c0196330 con 0x7fd0c0101610 2023-07-21T22:23:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0c5dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c01964f0 con 0x7fd0c010a040 2023-07-21T22:23:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0bf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c0100d00 0x7fd0c019bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0c0101610 0x7fd0c019c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c010a040 0x7fd0c0195b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.284 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0c0101610 0x7fd0c019c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57088/0 (socket says 172.21.15.151:57088) 2023-07-21T22:23:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c010a040 0x7fd0c0195b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38322/0 (socket says 172.21.15.151:38322) 2023-07-21T22:23:40.285 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.237+0000 7fd0beffd700 1 -- 172.21.15.151:0/1539795915 learned_addr learned my addr 172.21.15.151:0/1539795915 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.238+0000 7fd0bffff700 1 -- 172.21.15.151:0/1539795915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0c0101610 msgr2=0x7fd0c019c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.238+0000 7fd0bffff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0c0101610 0x7fd0c019c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.238+0000 7fd0bffff700 1 -- 172.21.15.151:0/1539795915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c0100d00 msgr2=0x7fd0c019bae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.238+0000 7fd0bffff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c0100d00 0x7fd0c019bae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.238+0000 7fd0bffff700 1 -- 172.21.15.151:0/1539795915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0b00095f0 con 0x7fd0c010a040 2023-07-21T22:23:40.286 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.238+0000 7fd0beffd700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0c0101610 0x7fd0c019c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.239+0000 7fd0bffff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c010a040 0x7fd0c0195b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8007f10 tx=0x7fd0b800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.239+0000 7fd0bcff9700 1 -- 172.21.15.151:0/1539795915 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8004db0 con 0x7fd0c010a040 2023-07-21T22:23:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.239+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1539795915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c01967d0 con 0x7fd0c010a040 2023-07-21T22:23:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.239+0000 7fd0bcff9700 1 -- 172.21.15.151:0/1539795915 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0b800f040 con 0x7fd0c010a040 2023-07-21T22:23:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.240+0000 7fd0bcff9700 1 -- 172.21.15.151:0/1539795915 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8005960 con 0x7fd0c010a040 2023-07-21T22:23:40.287 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.240+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1539795915 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c01a2ad0 con 0x7fd0c010a040 2023-07-21T22:23:40.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.246+0000 7fd0bcff9700 1 -- 172.21.15.151:0/1539795915 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fd0b800db20 con 0x7fd0c010a040 2023-07-21T22:23:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.247+0000 7fd0d9629b80 1 Processor -- start 2023-07-21T22:23:40.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.247+0000 7fd0d9629b80 1 -- start start 2023-07-21T22:23:40.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.247+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba11b0 0x5582e1ba1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.247+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 0x5582e1b9c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1b9cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1aa1cb0 con 0x5582e1b9c930 2023-07-21T22:23:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1af4a40 con 0x5582e1ba11b0 2023-07-21T22:23:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1aeded0 con 0x5582e1ba1ac0 2023-07-21T22:23:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1b9cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0bcff9700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd0a80a12c0 0x7fd0a80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1b9cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49138/0 (socket says 172.21.15.151:49138) 2023-07-21T22:23:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0beffd700 1 -- 172.21.15.151:0/2554516320 learned_addr learned my addr 172.21.15.151:0/2554516320 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0beffd700 1 --2- 172.21.15.151:0/2554516320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba11b0 0x5582e1ba1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/2554516320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 0x5582e1b9c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.248+0000 7fd0bcff9700 1 -- 172.21.15.151:0/1539795915 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd0b80cc4b0 con 0x7fd0c010a040 2023-07-21T22:23:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0beffd700 1 -- 172.21.15.151:0/2554516320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 msgr2=0x5582e1b9c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0beffd700 1 --2- 172.21.15.151:0/2554516320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 0x5582e1b9c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0beffd700 1 -- 172.21.15.151:0/2554516320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba11b0 msgr2=0x5582e1ba1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0beffd700 1 --2- 172.21.15.151:0/2554516320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba11b0 0x5582e1ba1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0beffd700 1 -- 172.21.15.151:0/2554516320 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582e191bde0 con 0x5582e1b9c930 2023-07-21T22:23:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0bffff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd0a80a12c0 0x7fd0a80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0beffd700 1 --2- 172.21.15.151:0/2554516320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1b9cda0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4011d30 tx=0x7fd0b4009cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c827b669add614cb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0a5ffb700 1 -- 172.21.15.151:0/2554516320 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b400f9b0 con 0x5582e1b9c930 2023-07-21T22:23:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0bffff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd0a80a12c0 0x7fd0a80a3770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80c9cb0 tx=0x7fd0b8009580 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0a5ffb700 1 -- 172.21.15.151:0/2554516320 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0b401f440 con 0x5582e1b9c930 2023-07-21T22:23:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.249+0000 7fd0a5ffb700 1 -- 172.21.15.151:0/2554516320 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b400e610 con 0x5582e1b9c930 2023-07-21T22:23:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.250+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2554516320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 msgr2=0x5582e1b9cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.250+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2554516320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1b9cda0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4011d30 tx=0x7fd0b4009cf0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.250+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2554516320 shutdown_connections 2023-07-21T22:23:40.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.250+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2554516320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba11b0 0x5582e1ba1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.250+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2554516320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1b9cda0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.250+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2554516320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 0x5582e1b9c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.250+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2554516320 >> 172.21.15.151:0/2554516320 conn(0x5582e1b91ef0 msgr2=0x5582e1b97830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.250+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2554516320 shutdown_connections 2023-07-21T22:23:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.250+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2554516320 wait complete. 2023-07-21T22:23:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.251+0000 7fd0d9629b80 1 -- start start 2023-07-21T22:23:40.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.251+0000 7fd0d9629b80 1 Processor -- start 2023-07-21T22:23:40.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.252+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1b9c930 0x5582e1ba5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.252+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1ba63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.252+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba1ac0 0x5582e1ba6910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.252+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1a8dac0 con 0x5582e1ba11b0 2023-07-21T22:23:40.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.252+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1a8d7c0 con 0x5582e1ba1ac0 2023-07-21T22:23:40.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.252+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1971920 con 0x5582e1b9c930 2023-07-21T22:23:40.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.252+0000 7fd0d9629b80 10 client.0 _ll_register_callbacks cb 0x5582e1a8b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:40.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1b9c930 0x5582e1ba5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1b9c930 0x5582e1ba5e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38328/0 (socket says 172.21.15.151:38328) 2023-07-21T22:23:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 -- 172.21.15.151:0/3156838287 learned_addr learned my addr 172.21.15.151:0/3156838287 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1ba63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba1ac0 0x5582e1ba6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 -- 172.21.15.151:0/3156838287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba1ac0 msgr2=0x5582e1ba6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba1ac0 0x5582e1ba6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 -- 172.21.15.151:0/3156838287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 msgr2=0x5582e1ba63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:40.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1ba63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 -- 172.21.15.151:0/3156838287 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0b4019040 con 0x5582e1b9c930 2023-07-21T22:23:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd0beffd700 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1b9c930 0x5582e1ba5e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd0b401fc90 tx=0x7fd0b4011ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca776e25a3e939b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.253+0000 7fd09effd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:23:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.254+0000 7fd09effd700 1 -- 172.21.15.151:0/3156838287 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4023070 con 0x5582e1b9c930 2023-07-21T22:23:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.254+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3156838287 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5582e1a474f0 con 0x5582e1b9c930 2023-07-21T22:23:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.254+0000 7fd09effd700 1 -- 172.21.15.151:0/3156838287 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd0b4000e40 con 0x5582e1b9c930 2023-07-21T22:23:40.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.254+0000 7fd09effd700 1 -- 172.21.15.151:0/3156838287 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0b400f9b0 con 0x5582e1b9c930 2023-07-21T22:23:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.254+0000 7fd0d9629b80 10 client.26035 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.254+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3156838287 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5582e1904c60 con 0x5582e1b9c930 2023-07-21T22:23:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.254+0000 7fd09effd700 1 -- 172.21.15.151:0/3156838287 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5582e1a474f0 con 0x5582e1b9c930 2023-07-21T22:23:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.254+0000 7fd09effd700 1 -- 172.21.15.151:0/3156838287 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd0b4004750 con 0x5582e1b9c930 2023-07-21T22:23:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.254+0000 7fd0d9629b80 10 client.26035 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.255+0000 7fd0d9629b80 10 client.26035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:40.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.255+0000 7fd0d9629b80 20 client.26035 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.255+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5582e1bba700 0x5582e1bbcb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.255+0000 7fd0d9629b80 4 client.26035 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.255+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3156838287 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582e1ae6eb0 con 0x5582e1bba700 2023-07-21T22:23:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.255+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5582e1bba700 0x5582e1bbcb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.256+0000 7fd09effd700 10 client.26035 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:40.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.256+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5582e1bba700 0x5582e1bbcb10 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c21306df56077105 server_cookie=61036a4fca65153c in_seq=0 out_seq=0 2023-07-21T22:23:40.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd09effd700 1 -- 172.21.15.151:0/3156838287 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5582e1ae6eb0 con 0x5582e1bba700 2023-07-21T22:23:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd09effd700 10 client.26035 handle_command_reply: tid=0 2023-07-21T22:23:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 client.26035 shutdown 2023-07-21T22:23:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3156838287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1b9c930 msgr2=0x5582e1ba5e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1b9c930 0x5582e1ba5e90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fd0b401fc90 tx=0x7fd0b4011ad0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3156838287 shutdown_connections 2023-07-21T22:23:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5582e1bba700 0x5582e1bbcb10 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba1ac0 0x5582e1ba6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd09effd700 0 client.26035 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1b9c930 0x5582e1ba5e90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3156838287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1ba63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3156838287 >> 172.21.15.151:0/3156838287 conn(0x5582e1b91ef0 msgr2=0x5582e1b973c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3156838287 shutdown_connections 2023-07-21T22:23:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3156838287 wait complete. 2023-07-21T22:23:40.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.257+0000 7fd0d9629b80 20 client.26035 trim_cache size 0 max 16384 2023-07-21T22:23:40.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.279+0000 7fd0d9629b80 1 Processor -- start 2023-07-21T22:23:40.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.279+0000 7fd0d9629b80 1 -- start start 2023-07-21T22:23:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1b9c930 0x5582e1bb1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1b972d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 0x5582e1b97810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1a47520 con 0x5582e1ba11b0 2023-07-21T22:23:40.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1bb7370 con 0x5582e1b9c930 2023-07-21T22:23:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1b984e0 con 0x5582e1ba1ac0 2023-07-21T22:23:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0bf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1b972d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0bf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1b972d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49146/0 (socket says 172.21.15.151:49146) 2023-07-21T22:23:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0bf7fe700 1 -- 172.21.15.151:0/3649510606 learned_addr learned my addr 172.21.15.151:0/3649510606 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0beffd700 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1b9c930 0x5582e1bb1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.280+0000 7fd0beffd700 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 0x5582e1b97810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0bf7fe700 1 -- 172.21.15.151:0/3649510606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 msgr2=0x5582e1b97810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 0x5582e1b97810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0bf7fe700 1 -- 172.21.15.151:0/3649510606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1b9c930 msgr2=0x5582e1bb1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1b9c930 0x5582e1bb1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0bf7fe700 1 -- 172.21.15.151:0/3649510606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582e1b9cfd0 con 0x5582e1ba11b0 2023-07-21T22:23:40.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0beffd700 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 0x5582e1b97810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:23:40.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1b972d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0005910 tx=0x7fd0b000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d692183748a2d321 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:40.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0a67fc700 1 -- 172.21.15.151:0/3649510606 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b002a070 con 0x5582e1ba11b0 2023-07-21T22:23:40.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0a67fc700 1 -- 172.21.15.151:0/3649510606 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0b002e070 con 0x5582e1ba11b0 2023-07-21T22:23:40.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.281+0000 7fd0a67fc700 1 -- 172.21.15.151:0/3649510606 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b001d040 con 0x5582e1ba11b0 2023-07-21T22:23:40.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.282+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3649510606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 msgr2=0x5582e1b972d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.282+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1b972d0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0005910 tx=0x7fd0b000b260 comp rx=0 tx=0).stop 2023-07-21T22:23:40.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.282+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3649510606 shutdown_connections 2023-07-21T22:23:40.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.282+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1b9c930 0x5582e1bb1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.282+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba1ac0 0x5582e1b97810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.282+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/3649510606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1ba11b0 0x5582e1b972d0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.282+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3649510606 >> 172.21.15.151:0/3649510606 conn(0x5582e1b91ef0 msgr2=0x5582e1b9aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:40.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.282+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3649510606 shutdown_connections 2023-07-21T22:23:40.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.282+0000 7fd0d9629b80 1 -- 172.21.15.151:0/3649510606 wait complete. 2023-07-21T22:23:40.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.283+0000 7fd0d9629b80 1 -- start start 2023-07-21T22:23:40.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.283+0000 7fd0d9629b80 1 Processor -- start 2023-07-21T22:23:40.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1bb1860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba11b0 0x5582e1badbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0d9629b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba1ac0 0x5582e1bae100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1bae680 con 0x5582e1b9c930 2023-07-21T22:23:40.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1bae7c0 con 0x5582e1ba1ac0 2023-07-21T22:23:40.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0d9629b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582e1bae980 con 0x5582e1ba11b0 2023-07-21T22:23:40.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0d9629b80 10 client.0 _ll_register_callbacks cb 0x7fd0b4011c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:40.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1bb1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1bb1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49156/0 (socket says 172.21.15.151:49156) 2023-07-21T22:23:40.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0beffd700 1 -- 172.21.15.151:0/2220508824 learned_addr learned my addr 172.21.15.151:0/2220508824 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:40.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba11b0 0x5582e1badbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0beffd700 1 -- 172.21.15.151:0/2220508824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba11b0 msgr2=0x5582e1badbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:40.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0beffd700 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba11b0 0x5582e1badbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.284+0000 7fd0beffd700 1 -- 172.21.15.151:0/2220508824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba1ac0 msgr2=0x5582e1bae100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:40.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd0beffd700 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba1ac0 0x5582e1bae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd0beffd700 1 -- 172.21.15.151:0/2220508824 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c010d170 con 0x5582e1b9c930 2023-07-21T22:23:40.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba11b0 0x5582e1badbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:23:40.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd0beffd700 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1bb1860 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4011b40 tx=0x7fd0b4005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6aebdc1699ced7ec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:40.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd09effd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:40.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd09effd700 1 -- 172.21.15.151:0/2220508824 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b4023040 con 0x5582e1b9c930 2023-07-21T22:23:40.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2220508824 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd0b401f440 con 0x5582e1b9c930 2023-07-21T22:23:40.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd09effd700 1 -- 172.21.15.151:0/2220508824 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd0b400ed10 con 0x5582e1b9c930 2023-07-21T22:23:40.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd09effd700 1 -- 172.21.15.151:0/2220508824 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0b4004dd0 con 0x5582e1b9c930 2023-07-21T22:23:40.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd0d9629b80 10 client.16263 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:40.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.285+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2220508824 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5582e1942250 con 0x5582e1b9c930 2023-07-21T22:23:40.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.286+0000 7fd09effd700 1 -- 172.21.15.151:0/2220508824 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd0b401f440 con 0x5582e1b9c930 2023-07-21T22:23:40.337 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.286+0000 7fd09effd700 1 -- 172.21.15.151:0/2220508824 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd0b400e700 con 0x5582e1b9c930 2023-07-21T22:23:40.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.286+0000 7fd0d9629b80 10 client.16263 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:40.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.286+0000 7fd0d9629b80 10 client.16263 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:40.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.286+0000 7fd0d9629b80 20 client.16263 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:40.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.286+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5582e1c0f5c0 0x5582e1c119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.286+0000 7fd0d9629b80 4 client.16263 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:23:40.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.286+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2220508824 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x5582e1aa9050 con 0x5582e1c0f5c0 2023-07-21T22:23:40.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.286+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5582e1c0f5c0 0x5582e1c119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.287+0000 7fd0bf7fe700 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5582e1c0f5c0 0x5582e1c119a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6902a59cb5c3bf server_cookie=d13ffd1c3b0826de in_seq=0 out_seq=0 2023-07-21T22:23:40.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.287+0000 7fd09effd700 10 client.16263 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:40.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.287+0000 7fd09effd700 1 -- 172.21.15.151:0/2220508824 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x5582e1aa9050 con 0x5582e1c0f5c0 2023-07-21T22:23:40.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.287+0000 7fd09effd700 10 client.16263 handle_command_reply: tid=0 2023-07-21T22:23:40.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.287+0000 7fd0d9629b80 1 client.16263 shutdown 2023-07-21T22:23:40.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.287+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2220508824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 msgr2=0x5582e1bb1860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.287+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1bb1860 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd0b4011b40 tx=0x7fd0b4005d90 comp rx=0 tx=0).stop 2023-07-21T22:23:40.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2220508824 shutdown_connections 2023-07-21T22:23:40.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5582e1c0f5c0 0x5582e1c119a0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582e1ba1ac0 0x5582e1bae100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582e1b9c930 0x5582e1bb1860 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0d9629b80 1 --2- 172.21.15.151:0/2220508824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5582e1ba11b0 0x5582e1badbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd09effd700 0 client.16263 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:40.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2220508824 >> 172.21.15.151:0/2220508824 conn(0x5582e1b91ef0 msgr2=0x5582e1b9aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:40.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2220508824 shutdown_connections 2023-07-21T22:23:40.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0d9629b80 1 -- 172.21.15.151:0/2220508824 wait complete. 2023-07-21T22:23:40.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0d9629b80 20 client.16263 trim_cache size 0 max 16384 2023-07-21T22:23:40.341 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:23:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "no active scrubs running", 2023-07-21T22:23:40.342 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": {} 2023-07-21T22:23:40.342 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:23:40.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1539795915 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd0a80a12c0 msgr2=0x7fd0a80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd0a80a12c0 0x7fd0a80a3770 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd0b80c9cb0 tx=0x7fd0b8009580 comp rx=0 tx=0).stop 2023-07-21T22:23:40.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1539795915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c010a040 msgr2=0x7fd0c0195b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.288+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c010a040 0x7fd0c0195b50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8007f10 tx=0x7fd0b800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.289+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1539795915 shutdown_connections 2023-07-21T22:23:40.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.289+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd0a80a12c0 0x7fd0a80a3770 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.289+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd0c010a040 0x7fd0c0195b50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.289+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c0100d00 0x7fd0c019bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.289+0000 7fd0c5dff700 1 --2- 172.21.15.151:0/1539795915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0c0101610 0x7fd0c019c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.289+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1539795915 >> 172.21.15.151:0/1539795915 conn(0x7fd0c00fa4b0 msgr2=0x7fd0c010c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:40.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.289+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1539795915 shutdown_connections 2023-07-21T22:23:40.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.289+0000 7fd0c5dff700 1 -- 172.21.15.151:0/1539795915 wait complete. 2023-07-21T22:23:40.347 INFO:teuthology.orchestra.run.smithi151.stderr:17300000 of 50000000 tuples (34%) done (elapsed 243.84 s, remaining 460.89 s) 2023-07-21T22:23:40.352 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-21T22:23:40.352 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:23:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.538+0000 7fef85f9d700 1 -- 172.21.15.151:0/1719060588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef800ff9f0 msgr2=0x7fef800ffe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.538+0000 7fef85f9d700 1 --2- 172.21.15.151:0/1719060588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef800ff9f0 0x7fef800ffe60 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fef6c009990 tx=0x7fef6c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.538+0000 7fef85f9d700 1 -- 172.21.15.151:0/1719060588 shutdown_connections 2023-07-21T22:23:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.538+0000 7fef85f9d700 1 --2- 172.21.15.151:0/1719060588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef801003a0 0x7fef8010c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.538+0000 7fef85f9d700 1 --2- 172.21.15.151:0/1719060588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef80105a00 0x7fef80105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.538+0000 7fef85f9d700 1 --2- 172.21.15.151:0/1719060588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef800ff9f0 0x7fef800ffe60 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.538+0000 7fef85f9d700 1 -- 172.21.15.151:0/1719060588 >> 172.21.15.151:0/1719060588 conn(0x7fef800fb510 msgr2=0x7fef800fd920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.538+0000 7fef85f9d700 1 -- 172.21.15.151:0/1719060588 shutdown_connections 2023-07-21T22:23:40.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.538+0000 7fef85f9d700 1 -- 172.21.15.151:0/1719060588 wait complete. 2023-07-21T22:23:40.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.539+0000 7fef85f9d700 1 Processor -- start 2023-07-21T22:23:40.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef85f9d700 1 -- start start 2023-07-21T22:23:40.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef85f9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef800ff9f0 0x7fef8019d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef85f9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef801003a0 0x7fef8019dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef85f9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef80105a00 0x7fef80197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef85f9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80197f00 con 0x7fef80105a00 2023-07-21T22:23:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef85f9d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80198070 con 0x7fef800ff9f0 2023-07-21T22:23:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef85f9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef80198230 con 0x7fef801003a0 2023-07-21T22:23:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef8579c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef80105a00 0x7fef80197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef8579c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef80105a00 0x7fef80197890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49174/0 (socket says 172.21.15.151:49174) 2023-07-21T22:23:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef8579c700 1 -- 172.21.15.151:0/385013795 learned_addr learned my addr 172.21.15.151:0/385013795 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:40.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.540+0000 7fef7ffff700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef801003a0 0x7fef8019dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef84f9b700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef800ff9f0 0x7fef8019d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef8579c700 1 -- 172.21.15.151:0/385013795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef801003a0 msgr2=0x7fef8019dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef8579c700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef801003a0 0x7fef8019dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef8579c700 1 -- 172.21.15.151:0/385013795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef800ff9f0 msgr2=0x7fef8019d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef8579c700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef800ff9f0 0x7fef8019d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef8579c700 1 -- 172.21.15.151:0/385013795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0095f0 con 0x7fef80105a00 2023-07-21T22:23:40.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef8579c700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef80105a00 0x7fef80197890 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fef78007ee0 tx=0x7fef7800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:40.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef7dffb700 1 -- 172.21.15.151:0/385013795 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7800ddd0 con 0x7fef80105a00 2023-07-21T22:23:40.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef7dffb700 1 -- 172.21.15.151:0/385013795 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef7800f040 con 0x7fef80105a00 2023-07-21T22:23:40.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef80198510 con 0x7fef80105a00 2023-07-21T22:23:40.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.541+0000 7fef7dffb700 1 -- 172.21.15.151:0/385013795 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef780047d0 con 0x7fef80105a00 2023-07-21T22:23:40.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.542+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef801a4810 con 0x7fef80105a00 2023-07-21T22:23:40.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.543+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef80067220 con 0x7fef80105a00 2023-07-21T22:23:40.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.545+0000 7fef7dffb700 1 -- 172.21.15.151:0/385013795 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fef78003f20 con 0x7fef80105a00 2023-07-21T22:23:40.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.546+0000 7fef7dffb700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef700a14b0 0x7fef700a3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:40.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.546+0000 7fef7dffb700 1 -- 172.21.15.151:0/385013795 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fef780cc5d0 con 0x7fef80105a00 2023-07-21T22:23:40.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.546+0000 7fef84f9b700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef700a14b0 0x7fef700a3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:40.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.547+0000 7fef84f9b700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef700a14b0 0x7fef700a3960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fef80100b30 tx=0x7fef74009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:40.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.552+0000 7fef7dffb700 1 -- 172.21.15.151:0/385013795 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fef7804e770 con 0x7fef80105a00 2023-07-21T22:23:40.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:40 smithi151 ceph-mon[95510]: pgmap v137: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:40.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:40 smithi187 ceph-mon[96918]: pgmap v137: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.845+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fef80198da0 con 0x7fef80105a00 2023-07-21T22:23:40.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.845+0000 7fef7dffb700 1 -- 172.21.15.151:0/385013795 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+10822 (secure 0 0 0) 0x7fef780959f0 con 0x7fef80105a00 2023-07-21T22:23:40.891 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:23:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":31,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:23:16.318225+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:23:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef700a14b0 msgr2=0x7fef700a3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef700a14b0 0x7fef700a3960 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fef80100b30 tx=0x7fef74009260 comp rx=0 tx=0).stop 2023-07-21T22:23:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef80105a00 msgr2=0x7fef80197890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:40.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef80105a00 0x7fef80197890 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fef78007ee0 tx=0x7fef7800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 shutdown_connections 2023-07-21T22:23:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef700a14b0 0x7fef700a3960 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef800ff9f0 0x7fef8019d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef80105a00 0x7fef80197890 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 --2- 172.21.15.151:0/385013795 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef801003a0 0x7fef8019dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 >> 172.21.15.151:0/385013795 conn(0x7fef800fb510 msgr2=0x7fef800fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:40.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 shutdown_connections 2023-07-21T22:23:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:40.849+0000 7fef85f9d700 1 -- 172.21.15.151:0/385013795 wait complete. 2023-07-21T22:23:40.896 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 31 2023-07-21T22:23:40.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:40 smithi195 ceph-mon[97365]: pgmap v137: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:40.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-21T22:23:41.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.116+0000 7f4276fff700 1 -- 172.21.15.151:0/1757344179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f427010a040 msgr2=0x7f427010c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.116+0000 7f4276fff700 1 --2- 172.21.15.151:0/1757344179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f427010a040 0x7f427010c4b0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4268009990 tx=0x7f4268009ca0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.116+0000 7f4276fff700 1 -- 172.21.15.151:0/1757344179 shutdown_connections 2023-07-21T22:23:41.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.116+0000 7f4276fff700 1 --2- 172.21.15.151:0/1757344179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f427010a040 0x7f427010c4b0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.116+0000 7f4276fff700 1 --2- 172.21.15.151:0/1757344179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4270100d00 0x7f42701010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.116+0000 7f4276fff700 1 --2- 172.21.15.151:0/1757344179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4270101610 0x7f4270109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.116+0000 7f4276fff700 1 -- 172.21.15.151:0/1757344179 >> 172.21.15.151:0/1757344179 conn(0x7f42700fa4b0 msgr2=0x7f42700fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.116+0000 7f4276fff700 1 -- 172.21.15.151:0/1757344179 shutdown_connections 2023-07-21T22:23:41.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.117+0000 7f4276fff700 1 -- 172.21.15.151:0/1757344179 wait complete. 2023-07-21T22:23:41.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.118+0000 7f4276fff700 1 Processor -- start 2023-07-21T22:23:41.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.118+0000 7f4276fff700 1 -- start start 2023-07-21T22:23:41.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f4276fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4270100d00 0x7f427019ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f4276fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4270101610 0x7f427019bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f4276fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f427010a040 0x7f4270195aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f4276fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270196110 con 0x7f4270101610 2023-07-21T22:23:41.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f4276fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270196280 con 0x7f4270100d00 2023-07-21T22:23:41.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f4276fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4270196440 con 0x7f427010a040 2023-07-21T22:23:41.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f4274d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4270100d00 0x7f427019ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f426ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4270101610 0x7f427019bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f4274d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4270100d00 0x7f427019ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57164/0 (socket says 172.21.15.151:57164) 2023-07-21T22:23:41.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f4274d9b700 1 -- 172.21.15.151:0/2248907617 learned_addr learned my addr 172.21.15.151:0/2248907617 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f427559c700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f427010a040 0x7f4270195aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f426ffff700 1 -- 172.21.15.151:0/2248907617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f427010a040 msgr2=0x7f4270195aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.119+0000 7f426ffff700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f427010a040 0x7f4270195aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f426ffff700 1 -- 172.21.15.151:0/2248907617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4270100d00 msgr2=0x7f427019ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f426ffff700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4270100d00 0x7f427019ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f426ffff700 1 -- 172.21.15.151:0/2248907617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42680095f0 con 0x7f4270101610 2023-07-21T22:23:41.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f427559c700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f427010a040 0x7f4270195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:23:41.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f426ffff700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4270101610 0x7f427019bf70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f425c009c50 tx=0x7f425c009f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f426dffb700 1 -- 172.21.15.151:0/2248907617 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c015070 con 0x7f4270101610 2023-07-21T22:23:41.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f426dffb700 1 -- 172.21.15.151:0/2248907617 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f425c019410 con 0x7f4270101610 2023-07-21T22:23:41.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f4276fff700 1 -- 172.21.15.151:0/2248907617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4270196720 con 0x7f4270101610 2023-07-21T22:23:41.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f426dffb700 1 -- 172.21.15.151:0/2248907617 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c018610 con 0x7f4270101610 2023-07-21T22:23:41.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.120+0000 7f4276fff700 1 -- 172.21.15.151:0/2248907617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42700fea60 con 0x7f4270101610 2023-07-21T22:23:41.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.124+0000 7f426dffb700 1 -- 172.21.15.151:0/2248907617 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f425c00bb00 con 0x7f4270101610 2023-07-21T22:23:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.125+0000 7f428aa1db80 1 Processor -- start 2023-07-21T22:23:41.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.125+0000 7f428aa1db80 1 -- start start 2023-07-21T22:23:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 0x5627f4991580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f498c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f498cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f428aa1db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f4891cb0 con 0x5627f4991ac0 2023-07-21T22:23:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f428aa1db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f48e4a40 con 0x5627f49911b0 2023-07-21T22:23:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f428aa1db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f48dded0 con 0x5627f498c930 2023-07-21T22:23:41.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f4274d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f498c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f426ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f498cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f426ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f498cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38394/0 (socket says 172.21.15.151:38394) 2023-07-21T22:23:41.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f426ffff700 1 -- 172.21.15.151:0/2832582428 learned_addr learned my addr 172.21.15.151:0/2832582428 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f427559c700 1 --2- 172.21.15.151:0/2832582428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 0x5627f4991580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.126+0000 7f426dffb700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42600a12c0 0x7f42600a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f426ffff700 1 -- 172.21.15.151:0/2832582428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 msgr2=0x5627f4991580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f426ffff700 1 --2- 172.21.15.151:0/2832582428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 0x5627f4991580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f426ffff700 1 -- 172.21.15.151:0/2832582428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 msgr2=0x5627f498c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f426ffff700 1 --2- 172.21.15.151:0/2832582428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f498c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f426dffb700 1 -- 172.21.15.151:0/2248907617 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f425c0d03e0 con 0x7f4270101610 2023-07-21T22:23:41.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f426ffff700 1 -- 172.21.15.151:0/2832582428 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627f470bde0 con 0x5627f498c930 2023-07-21T22:23:41.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f427559c700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42600a12c0 0x7f42600a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f4274d9b700 1 --2- 172.21.15.151:0/2832582428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f498c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:41.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f426ffff700 1 --2- 172.21.15.151:0/2832582428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f498cda0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f425c0cdab0 tx=0x7f425c0108b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1ea3be30a5de06d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f425affd700 1 -- 172.21.15.151:0/2832582428 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c09d000 con 0x5627f498c930 2023-07-21T22:23:41.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f425affd700 1 -- 172.21.15.151:0/2832582428 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f425c09ce20 con 0x5627f498c930 2023-07-21T22:23:41.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.127+0000 7f425affd700 1 -- 172.21.15.151:0/2832582428 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c09d4c0 con 0x5627f498c930 2023-07-21T22:23:41.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f428aa1db80 1 -- 172.21.15.151:0/2832582428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 msgr2=0x5627f498cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f427559c700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42600a12c0 0x7f42600a3770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f426800b2e0 tx=0x7f426801a040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f428aa1db80 1 --2- 172.21.15.151:0/2832582428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f498cda0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f425c0cdab0 tx=0x7f425c0108b0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f428aa1db80 1 -- 172.21.15.151:0/2832582428 shutdown_connections 2023-07-21T22:23:41.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f428aa1db80 1 --2- 172.21.15.151:0/2832582428 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 0x5627f4991580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f428aa1db80 1 --2- 172.21.15.151:0/2832582428 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f498cda0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f428aa1db80 1 --2- 172.21.15.151:0/2832582428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f498c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f428aa1db80 1 -- 172.21.15.151:0/2832582428 >> 172.21.15.151:0/2832582428 conn(0x5627f4981ef0 msgr2=0x5627f4987830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f428aa1db80 1 -- 172.21.15.151:0/2832582428 shutdown_connections 2023-07-21T22:23:41.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.128+0000 7f428aa1db80 1 -- 172.21.15.151:0/2832582428 wait complete. 2023-07-21T22:23:41.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.129+0000 7f428aa1db80 1 -- start start 2023-07-21T22:23:41.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.129+0000 7f428aa1db80 1 Processor -- start 2023-07-21T22:23:41.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f4998cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f4995f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 0x5627f4996670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f428aa1db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f487dac0 con 0x5627f49911b0 2023-07-21T22:23:41.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f428aa1db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f487d7c0 con 0x5627f4991ac0 2023-07-21T22:23:41.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f428aa1db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f4761920 con 0x5627f498c930 2023-07-21T22:23:41.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f428aa1db80 10 client.0 _ll_register_callbacks cb 0x5627f487b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:41.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f426ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f4995f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f426ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f4995f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49198/0 (socket says 172.21.15.151:49198) 2023-07-21T22:23:41.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f426ffff700 1 -- 172.21.15.151:0/101737288 learned_addr learned my addr 172.21.15.151:0/101737288 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.130+0000 7f4274d9b700 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f4998cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f427559c700 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 0x5627f4996670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f426ffff700 1 -- 172.21.15.151:0/101737288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 msgr2=0x5627f4998cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f426ffff700 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f4998cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f426ffff700 1 -- 172.21.15.151:0/101737288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 msgr2=0x5627f4996670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f426ffff700 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 0x5627f4996670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f426ffff700 1 -- 172.21.15.151:0/101737288 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4264009b90 con 0x5627f49911b0 2023-07-21T22:23:41.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f426ffff700 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f4995f30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f425c009c20 tx=0x7f425c0a1570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b68d81db2e74772 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f424ffff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:41.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f424ffff700 1 -- 172.21.15.151:0/101737288 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c09d4c0 con 0x5627f49911b0 2023-07-21T22:23:41.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f428aa1db80 1 -- 172.21.15.151:0/101737288 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5627f48374f0 con 0x5627f49911b0 2023-07-21T22:23:41.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f424ffff700 1 -- 172.21.15.151:0/101737288 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f425c050e40 con 0x5627f49911b0 2023-07-21T22:23:41.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f424ffff700 1 -- 172.21.15.151:0/101737288 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f425c0a5910 con 0x5627f49911b0 2023-07-21T22:23:41.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f428aa1db80 10 client.16281 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:41.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.131+0000 7f428aa1db80 1 -- 172.21.15.151:0/101737288 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7f42700fea60 con 0x5627f49911b0 2023-07-21T22:23:41.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.132+0000 7f424ffff700 1 -- 172.21.15.151:0/101737288 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5627f48374f0 con 0x5627f49911b0 2023-07-21T22:23:41.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.132+0000 7f424ffff700 1 -- 172.21.15.151:0/101737288 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f425c09d720 con 0x5627f49911b0 2023-07-21T22:23:41.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.132+0000 7f428aa1db80 10 client.16281 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:41.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.132+0000 7f428aa1db80 10 client.16281 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:23:41.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.132+0000 7f428aa1db80 20 client.16281 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:41.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.132+0000 7f428aa1db80 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5627f49a6130 0x5627f49a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.132+0000 7f428aa1db80 4 client.16281 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:41.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.132+0000 7f428aa1db80 1 -- 172.21.15.151:0/101737288 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5627f48d6eb0 con 0x5627f49a6130 2023-07-21T22:23:41.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.133+0000 7f4274d9b700 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5627f49a6130 0x5627f49a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.133+0000 7f4274d9b700 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5627f49a6130 0x5627f49a8540 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=26775f60b4509e26 server_cookie=b2aabec784fe00a0 in_seq=0 out_seq=0 2023-07-21T22:23:41.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.133+0000 7f424ffff700 10 client.16281 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:23:41.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f424ffff700 1 -- 172.21.15.151:0/101737288 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5627f48d6eb0 con 0x5627f49a6130 2023-07-21T22:23:41.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f424ffff700 10 client.16281 handle_command_reply: tid=0 2023-07-21T22:23:41.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f428aa1db80 1 client.16281 shutdown 2023-07-21T22:23:41.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f428aa1db80 1 -- 172.21.15.151:0/101737288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 msgr2=0x5627f4995f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f428aa1db80 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f4995f30 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f425c009c20 tx=0x7f425c0a1570 comp rx=0 tx=0).stop 2023-07-21T22:23:41.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f428aa1db80 1 -- 172.21.15.151:0/101737288 shutdown_connections 2023-07-21T22:23:41.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f428aa1db80 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5627f49a6130 0x5627f49a8540 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f428aa1db80 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 0x5627f4996670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f428aa1db80 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f4998cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f424ffff700 0 client.16281 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:23:41.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f428aa1db80 1 --2- 172.21.15.151:0/101737288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f4995f30 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.134+0000 7f428aa1db80 1 -- 172.21.15.151:0/101737288 >> 172.21.15.151:0/101737288 conn(0x5627f4981ef0 msgr2=0x5627f49873c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.135+0000 7f428aa1db80 1 -- 172.21.15.151:0/101737288 shutdown_connections 2023-07-21T22:23:41.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.135+0000 7f428aa1db80 1 -- 172.21.15.151:0/101737288 wait complete. 2023-07-21T22:23:41.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.135+0000 7f428aa1db80 20 client.16281 trim_cache size 0 max 16384 2023-07-21T22:23:41.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.152+0000 7f428aa1db80 1 Processor -- start 2023-07-21T22:23:41.205 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.152+0000 7f428aa1db80 1 -- start start 2023-07-21T22:23:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.152+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f4985f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.152+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 0x5627f49a27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.152+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f49987e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.152+0000 7f428aa1db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f498d220 con 0x5627f4991ac0 2023-07-21T22:23:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.152+0000 7f428aa1db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f4984010 con 0x5627f49911b0 2023-07-21T22:23:41.206 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.152+0000 7f428aa1db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f49864d0 con 0x5627f498c930 2023-07-21T22:23:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f427559c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f49987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f427559c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f49987e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49212/0 (socket says 172.21.15.151:49212) 2023-07-21T22:23:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f427559c700 1 -- 172.21.15.151:0/3270367567 learned_addr learned my addr 172.21.15.151:0/3270367567 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f426ffff700 1 --2- 172.21.15.151:0/3270367567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 0x5627f49a27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f4274d9b700 1 --2- 172.21.15.151:0/3270367567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f4985f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f427559c700 1 -- 172.21.15.151:0/3270367567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 msgr2=0x5627f4985f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f427559c700 1 --2- 172.21.15.151:0/3270367567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f4985f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.207 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f427559c700 1 -- 172.21.15.151:0/3270367567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 msgr2=0x5627f49a27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f427559c700 1 --2- 172.21.15.151:0/3270367567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 0x5627f49a27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f427559c700 1 -- 172.21.15.151:0/3270367567 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5627f46f4c60 con 0x5627f4991ac0 2023-07-21T22:23:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.153+0000 7f427559c700 1 --2- 172.21.15.151:0/3270367567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f49987e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4268005850 tx=0x7f4268022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20227cff6fef42f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.154+0000 7f425b7fe700 1 -- 172.21.15.151:0/3270367567 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800bed0 con 0x5627f4991ac0 2023-07-21T22:23:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.154+0000 7f425b7fe700 1 -- 172.21.15.151:0/3270367567 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4268004990 con 0x5627f4991ac0 2023-07-21T22:23:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.154+0000 7f425b7fe700 1 -- 172.21.15.151:0/3270367567 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426800f770 con 0x5627f4991ac0 2023-07-21T22:23:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 -- 172.21.15.151:0/3270367567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 msgr2=0x5627f49987e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 --2- 172.21.15.151:0/3270367567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f49987e0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4268005850 tx=0x7f4268022000 comp rx=0 tx=0).stop 2023-07-21T22:23:41.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 -- 172.21.15.151:0/3270367567 shutdown_connections 2023-07-21T22:23:41.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 --2- 172.21.15.151:0/3270367567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f4991ac0 0x5627f49987e0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 --2- 172.21.15.151:0/3270367567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f4985f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 --2- 172.21.15.151:0/3270367567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f49911b0 0x5627f49a27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 -- 172.21.15.151:0/3270367567 >> 172.21.15.151:0/3270367567 conn(0x5627f4981ef0 msgr2=0x5627f49ace60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 -- 172.21.15.151:0/3270367567 shutdown_connections 2023-07-21T22:23:41.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 -- 172.21.15.151:0/3270367567 wait complete. 2023-07-21T22:23:41.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 -- start start 2023-07-21T22:23:41.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.155+0000 7f428aa1db80 1 Processor -- start 2023-07-21T22:23:41.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f499d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f499b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f428aa1db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 0x5627f499beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f428aa1db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f499c490 con 0x5627f49911b0 2023-07-21T22:23:41.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f428aa1db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f499c600 con 0x5627f4991ac0 2023-07-21T22:23:41.210 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f428aa1db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5627f499c7c0 con 0x5627f498c930 2023-07-21T22:23:41.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f428aa1db80 10 client.0 _ll_register_callbacks cb 0x5627f487b760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:41.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f426ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f499b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f426ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f499b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49216/0 (socket says 172.21.15.151:49216) 2023-07-21T22:23:41.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f426ffff700 1 -- 172.21.15.151:0/1247145563 learned_addr learned my addr 172.21.15.151:0/1247145563 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f427559c700 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 0x5627f499beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.156+0000 7f4274d9b700 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f499d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f426ffff700 1 -- 172.21.15.151:0/1247145563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 msgr2=0x5627f499d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.211 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f426ffff700 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f499d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f426ffff700 1 -- 172.21.15.151:0/1247145563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 msgr2=0x5627f499beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f426ffff700 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 0x5627f499beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f426ffff700 1 -- 172.21.15.151:0/1247145563 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f426802d040 con 0x5627f49911b0 2023-07-21T22:23:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f426ffff700 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f499b970 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f425c0cdba0 tx=0x7f425c099800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b74f244a7c96fe4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f424ffff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f424ffff700 1 -- 172.21.15.151:0/1247145563 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c0a5910 con 0x5627f49911b0 2023-07-21T22:23:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f424ffff700 1 -- 172.21.15.151:0/1247145563 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f425c09d4c0 con 0x5627f49911b0 2023-07-21T22:23:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.157+0000 7f428aa1db80 1 -- 172.21.15.151:0/1247145563 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f425c09ce20 con 0x5627f49911b0 2023-07-21T22:23:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f424ffff700 1 -- 172.21.15.151:0/1247145563 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f425c0a1100 con 0x5627f49911b0 2023-07-21T22:23:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f428aa1db80 10 client.16287 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f428aa1db80 1 -- 172.21.15.151:0/1247145563 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5627f4732250 con 0x5627f49911b0 2023-07-21T22:23:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f424ffff700 1 -- 172.21.15.151:0/1247145563 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f425c09ce20 con 0x5627f49911b0 2023-07-21T22:23:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f424ffff700 1 -- 172.21.15.151:0/1247145563 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f425c0d3ba0 con 0x5627f49911b0 2023-07-21T22:23:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f428aa1db80 10 client.16287 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f428aa1db80 10 client.16287 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:23:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f428aa1db80 20 client.16287 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f428aa1db80 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5627f49fb050 0x5627f49fd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f428aa1db80 4 client.16287 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:23:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.158+0000 7f428aa1db80 1 -- 172.21.15.151:0/1247145563 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5627f4899050 con 0x5627f49fb050 2023-07-21T22:23:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.159+0000 7f4274d9b700 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5627f49fb050 0x5627f49fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.159+0000 7f4274d9b700 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5627f49fb050 0x5627f49fd430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=206ea5ebfee45ec9 server_cookie=e56564f331fb44ae in_seq=0 out_seq=0 2023-07-21T22:23:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.159+0000 7f424ffff700 10 client.16287 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:23:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.159+0000 7f424ffff700 1 -- 172.21.15.151:0/1247145563 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5627f4899050 con 0x5627f49fb050 2023-07-21T22:23:41.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.159+0000 7f424ffff700 10 client.16287 handle_command_reply: tid=0 2023-07-21T22:23:41.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.159+0000 7f428aa1db80 1 client.16287 shutdown 2023-07-21T22:23:41.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.159+0000 7f428aa1db80 1 -- 172.21.15.151:0/1247145563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 msgr2=0x5627f499b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f499b970 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f425c0cdba0 tx=0x7f425c099800 comp rx=0 tx=0).stop 2023-07-21T22:23:41.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 1 -- 172.21.15.151:0/1247145563 shutdown_connections 2023-07-21T22:23:41.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x5627f49fb050 0x5627f49fd430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5627f4991ac0 0x5627f499beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5627f498c930 0x5627f499d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 1 --2- 172.21.15.151:0/1247145563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5627f49911b0 0x5627f499b970 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 1 -- 172.21.15.151:0/1247145563 >> 172.21.15.151:0/1247145563 conn(0x5627f4981ef0 msgr2=0x5627f49a27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f424ffff700 0 client.16287 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:23:41.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 1 -- 172.21.15.151:0/1247145563 shutdown_connections 2023-07-21T22:23:41.216 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 1 -- 172.21.15.151:0/1247145563 wait complete. 2023-07-21T22:23:41.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f428aa1db80 20 client.16287 trim_cache size 0 max 16384 2023-07-21T22:23:41.217 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:23:41.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f4276fff700 1 -- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42600a12c0 msgr2=0x7f42600a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.160+0000 7f4276fff700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42600a12c0 0x7f42600a3770 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f426800b2e0 tx=0x7f426801a040 comp rx=0 tx=0).stop 2023-07-21T22:23:41.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 -- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4270101610 msgr2=0x7f427019bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4270101610 0x7f427019bf70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f425c009c50 tx=0x7f425c009f60 comp rx=0 tx=0).stop 2023-07-21T22:23:41.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 -- 172.21.15.151:0/2248907617 shutdown_connections 2023-07-21T22:23:41.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42600a12c0 0x7f42600a3770 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4270100d00 0x7f427019ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f427010a040 0x7f4270195aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 --2- 172.21.15.151:0/2248907617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4270101610 0x7f427019bf70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 -- 172.21.15.151:0/2248907617 >> 172.21.15.151:0/2248907617 conn(0x7f42700fa4b0 msgr2=0x7f427010c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 -- 172.21.15.151:0/2248907617 shutdown_connections 2023-07-21T22:23:41.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.161+0000 7f4276fff700 1 -- 172.21.15.151:0/2248907617 wait complete. 2023-07-21T22:23:41.227 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-21T22:23:41.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.415+0000 7f6021fff700 1 -- 172.21.15.151:0/1588624557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c106fb0 msgr2=0x7f601c10eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.415+0000 7f6021fff700 1 --2- 172.21.15.151:0/1588624557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c106fb0 0x7f601c10eb80 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6014009fc0 tx=0x7f601400b330 comp rx=0 tx=0).stop 2023-07-21T22:23:41.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.415+0000 7f6021fff700 1 -- 172.21.15.151:0/1588624557 shutdown_connections 2023-07-21T22:23:41.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.415+0000 7f6021fff700 1 --2- 172.21.15.151:0/1588624557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c106fb0 0x7f601c10eb80 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.415+0000 7f6021fff700 1 --2- 172.21.15.151:0/1588624557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f601c101f70 0x7f601c102340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.415+0000 7f6021fff700 1 --2- 172.21.15.151:0/1588624557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f601c102910 0x7f601c1068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.415+0000 7f6021fff700 1 -- 172.21.15.151:0/1588624557 >> 172.21.15.151:0/1588624557 conn(0x7f601c0fd7e0 msgr2=0x7f601c0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.415+0000 7f6021fff700 1 -- 172.21.15.151:0/1588624557 shutdown_connections 2023-07-21T22:23:41.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.415+0000 7f6021fff700 1 -- 172.21.15.151:0/1588624557 wait complete. 2023-07-21T22:23:41.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.416+0000 7f6021fff700 1 Processor -- start 2023-07-21T22:23:41.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.417+0000 7f6021fff700 1 -- start start 2023-07-21T22:23:41.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.417+0000 7f6021fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f601c101f70 0x7f601c197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.417+0000 7f6021fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c102910 0x7f601c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.417+0000 7f6021fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f601c106fb0 0x7f601c19c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.417+0000 7f6021fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c19ce60 con 0x7f601c102910 2023-07-21T22:23:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.417+0000 7f6021fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c19cfd0 con 0x7f601c106fb0 2023-07-21T22:23:41.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.417+0000 7f6021fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601c19d190 con 0x7f601c101f70 2023-07-21T22:23:41.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c102910 0x7f601c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c102910 0x7f601c1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49230/0 (socket says 172.21.15.151:49230) 2023-07-21T22:23:41.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601affd700 1 -- 172.21.15.151:0/3565794429 learned_addr learned my addr 172.21.15.151:0/3565794429 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.465 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601bfff700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f601c106fb0 0x7f601c19c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601b7fe700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f601c101f70 0x7f601c197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601affd700 1 -- 172.21.15.151:0/3565794429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f601c101f70 msgr2=0x7f601c197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601affd700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f601c101f70 0x7f601c197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601affd700 1 -- 172.21.15.151:0/3565794429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f601c106fb0 msgr2=0x7f601c19c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601affd700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f601c106fb0 0x7f601c19c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.418+0000 7f601affd700 1 -- 172.21.15.151:0/3565794429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014009c40 con 0x7f601c102910 2023-07-21T22:23:41.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.419+0000 7f601affd700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c102910 0x7f601c1983c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f601000e940 tx=0x7f601000ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.419+0000 7f6018ff9700 1 -- 172.21.15.151:0/3565794429 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010009730 con 0x7f601c102910 2023-07-21T22:23:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.419+0000 7f6018ff9700 1 -- 172.21.15.151:0/3565794429 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f601000ce50 con 0x7f601c102910 2023-07-21T22:23:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.419+0000 7f6021fff700 1 -- 172.21.15.151:0/3565794429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f601c19d470 con 0x7f601c102910 2023-07-21T22:23:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.419+0000 7f6018ff9700 1 -- 172.21.15.151:0/3565794429 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6010018420 con 0x7f601c102910 2023-07-21T22:23:41.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.419+0000 7f6021fff700 1 -- 172.21.15.151:0/3565794429 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c1a4cb0 con 0x7f601c102910 2023-07-21T22:23:41.468 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.423+0000 7f6018ff9700 1 -- 172.21.15.151:0/3565794429 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6010010430 con 0x7f601c102910 2023-07-21T22:23:41.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.424+0000 7f6018ff9700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f60040a12c0 0x7f60040a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.424+0000 7f603590cb80 1 Processor -- start 2023-07-21T22:23:41.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.424+0000 7f6018ff9700 1 -- 172.21.15.151:0/3565794429 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6010014070 con 0x7f601c102910 2023-07-21T22:23:41.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.425+0000 7f601b7fe700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f60040a12c0 0x7f60040a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.425+0000 7f603590cb80 1 -- start start 2023-07-21T22:23:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.425+0000 7f603590cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3a7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.425+0000 7f603590cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 0x55f0db3a2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.425+0000 7f603590cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3a2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.473 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.425+0000 7f603590cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db2a7cb0 con 0x55f0db3a2930 2023-07-21T22:23:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.425+0000 7f603590cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db2faa40 con 0x55f0db3a7ac0 2023-07-21T22:23:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.425+0000 7f603590cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db2f3ed0 con 0x55f0db3a71b0 2023-07-21T22:23:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.425+0000 7f601b7fe700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f60040a12c0 0x7f60040a3770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f600c005fd0 tx=0x7f600c009310 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3a2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3a2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49244/0 (socket says 172.21.15.151:49244) 2023-07-21T22:23:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601bfff700 1 -- 172.21.15.151:0/1978842404 learned_addr learned my addr 172.21.15.151:0/1978842404 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.474 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601b7fe700 1 --2- 172.21.15.151:0/1978842404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3a7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601affd700 1 --2- 172.21.15.151:0/1978842404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 0x55f0db3a2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601bfff700 1 -- 172.21.15.151:0/1978842404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 msgr2=0x55f0db3a7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601bfff700 1 --2- 172.21.15.151:0/1978842404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3a7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601bfff700 1 -- 172.21.15.151:0/1978842404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 msgr2=0x55f0db3a2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.475 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601bfff700 1 --2- 172.21.15.151:0/1978842404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 0x55f0db3a2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601bfff700 1 -- 172.21.15.151:0/1978842404 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0db121de0 con 0x55f0db3a2930 2023-07-21T22:23:41.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.426+0000 7f601bfff700 1 --2- 172.21.15.151:0/1978842404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3a2da0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6014009350 tx=0x7f6014009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8647141930101f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.427+0000 7f6001ffb700 1 -- 172.21.15.151:0/1978842404 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400e040 con 0x55f0db3a2930 2023-07-21T22:23:41.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.427+0000 7f6001ffb700 1 -- 172.21.15.151:0/1978842404 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6014009ac0 con 0x55f0db3a2930 2023-07-21T22:23:41.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.427+0000 7f6001ffb700 1 -- 172.21.15.151:0/1978842404 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400bc50 con 0x55f0db3a2930 2023-07-21T22:23:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.427+0000 7f603590cb80 1 -- 172.21.15.151:0/1978842404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 msgr2=0x55f0db3a2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.427+0000 7f603590cb80 1 --2- 172.21.15.151:0/1978842404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3a2da0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f6014009350 tx=0x7f6014009380 comp rx=0 tx=0).stop 2023-07-21T22:23:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.428+0000 7f603590cb80 1 -- 172.21.15.151:0/1978842404 shutdown_connections 2023-07-21T22:23:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.428+0000 7f603590cb80 1 --2- 172.21.15.151:0/1978842404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3a2da0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.479 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.428+0000 7f603590cb80 1 --2- 172.21.15.151:0/1978842404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3a7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.428+0000 7f603590cb80 1 --2- 172.21.15.151:0/1978842404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 0x55f0db3a2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.428+0000 7f603590cb80 1 -- 172.21.15.151:0/1978842404 >> 172.21.15.151:0/1978842404 conn(0x55f0db397ef0 msgr2=0x55f0db39d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.428+0000 7f603590cb80 1 -- 172.21.15.151:0/1978842404 shutdown_connections 2023-07-21T22:23:41.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.428+0000 7f603590cb80 1 -- 172.21.15.151:0/1978842404 wait complete. 2023-07-21T22:23:41.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.428+0000 7f603590cb80 1 -- start start 2023-07-21T22:23:41.480 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f603590cb80 1 Processor -- start 2023-07-21T22:23:41.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f603590cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 0x55f0db3aec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f603590cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3abe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f603590cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a7ac0 0x55f0db3ac5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f603590cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db293ac0 con 0x55f0db3a7ac0 2023-07-21T22:23:41.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f603590cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db2937c0 con 0x55f0db3a2930 2023-07-21T22:23:41.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f603590cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db177920 con 0x55f0db3a71b0 2023-07-21T22:23:41.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f603590cb80 10 client.0 _ll_register_callbacks cb 0x55f0db291760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f601bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a7ac0 0x55f0db3ac5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a7ac0 0x55f0db3ac5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49248/0 (socket says 172.21.15.151:49248) 2023-07-21T22:23:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601bfff700 1 -- 172.21.15.151:0/1961799919 learned_addr learned my addr 172.21.15.151:0/1961799919 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.429+0000 7f601b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 0x55f0db3aec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601affd700 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3abe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601bfff700 1 -- 172.21.15.151:0/1961799919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 msgr2=0x55f0db3abe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601bfff700 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3abe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601bfff700 1 -- 172.21.15.151:0/1961799919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 msgr2=0x55f0db3aec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601bfff700 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 0x55f0db3aec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601bfff700 1 -- 172.21.15.151:0/1961799919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f601c10f3c0 con 0x55f0db3a7ac0 2023-07-21T22:23:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601affd700 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:23:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601b7fe700 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 0x55f0db3aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f601bfff700 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a7ac0 0x55f0db3ac5c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6014007880 tx=0x7f6014006060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=757b602817e00450 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.430+0000 7f5ffaffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:41.483 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.431+0000 7f5ffaffd700 1 -- 172.21.15.151:0/1961799919 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601400e040 con 0x55f0db3a7ac0 2023-07-21T22:23:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.431+0000 7f603590cb80 1 -- 172.21.15.151:0/1961799919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0db2eceb0 con 0x55f0db3a7ac0 2023-07-21T22:23:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.431+0000 7f5ffaffd700 1 -- 172.21.15.151:0/1961799919 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f601400b9f0 con 0x55f0db3a7ac0 2023-07-21T22:23:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.431+0000 7f5ffaffd700 1 -- 172.21.15.151:0/1961799919 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f601400bbb0 con 0x55f0db3a7ac0 2023-07-21T22:23:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.431+0000 7f603590cb80 10 client.16299 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.431+0000 7f603590cb80 1 -- 172.21.15.151:0/1961799919 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f0db10ac60 con 0x55f0db3a7ac0 2023-07-21T22:23:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.431+0000 7f5ffaffd700 1 -- 172.21.15.151:0/1961799919 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0db2eceb0 con 0x55f0db3a7ac0 2023-07-21T22:23:41.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.431+0000 7f5ffaffd700 1 -- 172.21.15.151:0/1961799919 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6014022030 con 0x55f0db3a7ac0 2023-07-21T22:23:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.432+0000 7f603590cb80 10 client.16299 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.432+0000 7f603590cb80 10 client.16299 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:23:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.432+0000 7f603590cb80 20 client.16299 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.432+0000 7f603590cb80 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55f0db3bbf90 0x55f0db3be3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.432+0000 7f603590cb80 4 client.16299 mds_command: new command op to 24574 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.432+0000 7f603590cb80 1 -- 172.21.15.151:0/1961799919 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0db2af050 con 0x55f0db3bbf90 2023-07-21T22:23:41.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.432+0000 7f601b7fe700 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55f0db3bbf90 0x55f0db3be3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.433+0000 7f601b7fe700 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55f0db3bbf90 0x55f0db3be3a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=79cfb5637fde1e74 server_cookie=10f9f754d1d250a3 in_seq=0 out_seq=0 2023-07-21T22:23:41.486 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.433+0000 7f5ffaffd700 10 client.16299 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:23:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f5ffaffd700 1 -- 172.21.15.151:0/1961799919 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f0db2af050 con 0x55f0db3bbf90 2023-07-21T22:23:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f5ffaffd700 10 client.16299 handle_command_reply: tid=0 2023-07-21T22:23:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 client.16299 shutdown 2023-07-21T22:23:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 -- 172.21.15.151:0/1961799919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a7ac0 msgr2=0x55f0db3ac5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a7ac0 0x55f0db3ac5c0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f6014007880 tx=0x7f6014006060 comp rx=0 tx=0).stop 2023-07-21T22:23:41.487 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 -- 172.21.15.151:0/1961799919 shutdown_connections 2023-07-21T22:23:41.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55f0db3bbf90 0x55f0db3be3a0 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 0x55f0db3aec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a7ac0 0x55f0db3ac5c0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 --2- 172.21.15.151:0/1961799919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3abe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.488 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f5ffaffd700 0 client.16299 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:23:41.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 -- 172.21.15.151:0/1961799919 >> 172.21.15.151:0/1961799919 conn(0x55f0db397ef0 msgr2=0x55f0db39d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.434+0000 7f603590cb80 1 -- 172.21.15.151:0/1961799919 shutdown_connections 2023-07-21T22:23:41.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.435+0000 7f603590cb80 1 -- 172.21.15.151:0/1961799919 wait complete. 2023-07-21T22:23:41.489 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.435+0000 7f603590cb80 20 client.16299 trim_cache size 0 max 16384 2023-07-21T22:23:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.452+0000 7f603590cb80 1 Processor -- start 2023-07-21T22:23:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.452+0000 7f603590cb80 1 -- start start 2023-07-21T22:23:41.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.452+0000 7f603590cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3b3520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.452+0000 7f603590cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3ae7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.452+0000 7f603590cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 0x55f0db3aece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.452+0000 7f603590cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db3ac920 con 0x55f0db3a2930 2023-07-21T22:23:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.452+0000 7f603590cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db3a9ea0 con 0x55f0db3a7ac0 2023-07-21T22:23:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.452+0000 7f603590cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db3b3a60 con 0x55f0db3a71b0 2023-07-21T22:23:41.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3b3520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49262/0 (socket says 172.21.15.151:49262) 2023-07-21T22:23:41.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601b7fe700 1 -- 172.21.15.151:0/2438495330 learned_addr learned my addr 172.21.15.151:0/2438495330 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601bfff700 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 0x55f0db3aece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601affd700 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3ae7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601b7fe700 1 -- 172.21.15.151:0/2438495330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 msgr2=0x55f0db3ae7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601b7fe700 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3ae7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601b7fe700 1 -- 172.21.15.151:0/2438495330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 msgr2=0x55f0db3aece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601b7fe700 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 0x55f0db3aece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601b7fe700 1 -- 172.21.15.151:0/2438495330 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0db148250 con 0x55f0db3a2930 2023-07-21T22:23:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601bfff700 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 0x55f0db3aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:23:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.453+0000 7f601b7fe700 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3b3520 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55f0db3bec40 tx=0x7f600c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdce8948adf72c0d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.454+0000 7f60027fc700 1 -- 172.21.15.151:0/2438495330 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c02e070 con 0x55f0db3a2930 2023-07-21T22:23:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.454+0000 7f60027fc700 1 -- 172.21.15.151:0/2438495330 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f600c004cc0 con 0x55f0db3a2930 2023-07-21T22:23:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.454+0000 7f60027fc700 1 -- 172.21.15.151:0/2438495330 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c024040 con 0x55f0db3a2930 2023-07-21T22:23:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.454+0000 7f603590cb80 1 -- 172.21.15.151:0/2438495330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 msgr2=0x55f0db3b3520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.454+0000 7f603590cb80 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3b3520 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x55f0db3bec40 tx=0x7f600c014000 comp rx=0 tx=0).stop 2023-07-21T22:23:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.454+0000 7f603590cb80 1 -- 172.21.15.151:0/2438495330 shutdown_connections 2023-07-21T22:23:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.454+0000 7f603590cb80 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a7ac0 0x55f0db3aece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.454+0000 7f603590cb80 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a2930 0x55f0db3b3520 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.455+0000 7f603590cb80 1 --2- 172.21.15.151:0/2438495330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a71b0 0x55f0db3ae7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.455+0000 7f603590cb80 1 -- 172.21.15.151:0/2438495330 >> 172.21.15.151:0/2438495330 conn(0x55f0db397ef0 msgr2=0x55f0db3a0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.455+0000 7f603590cb80 1 -- 172.21.15.151:0/2438495330 shutdown_connections 2023-07-21T22:23:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.455+0000 7f603590cb80 1 -- 172.21.15.151:0/2438495330 wait complete. 2023-07-21T22:23:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.455+0000 7f603590cb80 1 -- start start 2023-07-21T22:23:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.455+0000 7f603590cb80 1 Processor -- start 2023-07-21T22:23:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f603590cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 0x55f0db3b2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f603590cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a71b0 0x55f0db3b34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f603590cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a7ac0 0x55f0db3b1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.510 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f603590cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db3b1e10 con 0x55f0db3a71b0 2023-07-21T22:23:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f603590cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db3b1f80 con 0x55f0db3a2930 2023-07-21T22:23:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f603590cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0db3b2140 con 0x55f0db3a7ac0 2023-07-21T22:23:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f603590cb80 10 client.0 _ll_register_callbacks cb 0x7f6010096260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f601affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a71b0 0x55f0db3b34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f601affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a71b0 0x55f0db3b34c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49272/0 (socket says 172.21.15.151:49272) 2023-07-21T22:23:41.511 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f601affd700 1 -- 172.21.15.151:0/2590931773 learned_addr learned my addr 172.21.15.151:0/2590931773 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.456+0000 7f601b7fe700 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 0x55f0db3b2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f601bfff700 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a7ac0 0x55f0db3b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f601affd700 1 -- 172.21.15.151:0/2590931773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a7ac0 msgr2=0x55f0db3b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f601affd700 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a7ac0 0x55f0db3b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f601affd700 1 -- 172.21.15.151:0/2590931773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 msgr2=0x55f0db3b2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f601affd700 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 0x55f0db3b2f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f601affd700 1 -- 172.21.15.151:0/2590931773 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f600c017070 con 0x55f0db3a71b0 2023-07-21T22:23:41.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f601bfff700 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a7ac0 0x55f0db3b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:23:41.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f601affd700 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a71b0 0x55f0db3b34c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6010096910 tx=0x7f60100caa80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffa0f739431ea85 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f5ffaffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f5ffaffd700 1 -- 172.21.15.151:0/2590931773 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601009ded0 con 0x55f0db3a71b0 2023-07-21T22:23:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f603590cb80 1 -- 172.21.15.151:0/2590931773 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0db24d4f0 con 0x55f0db3a71b0 2023-07-21T22:23:41.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f5ffaffd700 1 -- 172.21.15.151:0/2590931773 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f60100a22f0 con 0x55f0db3a71b0 2023-07-21T22:23:41.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f5ffaffd700 1 -- 172.21.15.151:0/2590931773 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60100a1e60 con 0x55f0db3a71b0 2023-07-21T22:23:41.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f603590cb80 10 client.16305 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:41.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.457+0000 7f603590cb80 1 -- 172.21.15.151:0/2590931773 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55f0db1202b0 con 0x55f0db3a71b0 2023-07-21T22:23:41.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.458+0000 7f5ffaffd700 1 -- 172.21.15.151:0/2590931773 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0db24d4f0 con 0x55f0db3a71b0 2023-07-21T22:23:41.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.458+0000 7f5ffaffd700 1 -- 172.21.15.151:0/2590931773 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f60100c9fa0 con 0x55f0db3a71b0 2023-07-21T22:23:41.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.458+0000 7f603590cb80 10 client.16305 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.458+0000 7f603590cb80 10 client.16305 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:23:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.458+0000 7f603590cb80 20 client.16305 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.458+0000 7f603590cb80 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55f0db411060 0x55f0db413470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.458+0000 7f603590cb80 4 client.16305 mds_command: new command op to 24574 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:23:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.458+0000 7f603590cb80 1 -- 172.21.15.151:0/2590931773 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55f0db142f70 con 0x55f0db411060 2023-07-21T22:23:41.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.458+0000 7f601b7fe700 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55f0db411060 0x55f0db413470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f601b7fe700 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55f0db411060 0x55f0db413470 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c9287702da9c0d0c server_cookie=25269b567ea6d3e9 in_seq=0 out_seq=0 2023-07-21T22:23:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f5ffaffd700 10 client.16305 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:23:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f5ffaffd700 1 -- 172.21.15.151:0/2590931773 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55f0db142f70 con 0x55f0db411060 2023-07-21T22:23:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f5ffaffd700 10 client.16305 handle_command_reply: tid=0 2023-07-21T22:23:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f603590cb80 1 client.16305 shutdown 2023-07-21T22:23:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f603590cb80 1 -- 172.21.15.151:0/2590931773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a71b0 msgr2=0x55f0db3b34c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f603590cb80 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a71b0 0x55f0db3b34c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f6010096910 tx=0x7f60100caa80 comp rx=0 tx=0).stop 2023-07-21T22:23:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f603590cb80 1 -- 172.21.15.151:0/2590931773 shutdown_connections 2023-07-21T22:23:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f603590cb80 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55f0db411060 0x55f0db413470 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f603590cb80 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0db3a2930 0x55f0db3b2f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f603590cb80 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0db3a7ac0 0x55f0db3b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f5ffaffd700 0 client.16305 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:23:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f603590cb80 1 --2- 172.21.15.151:0/2590931773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0db3a71b0 0x55f0db3b34c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.459+0000 7f603590cb80 1 -- 172.21.15.151:0/2590931773 >> 172.21.15.151:0/2590931773 conn(0x55f0db397ef0 msgr2=0x55f0db3a2d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.460+0000 7f603590cb80 1 -- 172.21.15.151:0/2590931773 shutdown_connections 2023-07-21T22:23:41.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.460+0000 7f603590cb80 1 -- 172.21.15.151:0/2590931773 wait complete. 2023-07-21T22:23:41.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.460+0000 7f603590cb80 20 client.16305 trim_cache size 0 max 16384 2023-07-21T22:23:41.519 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:23:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.460+0000 7f6021fff700 1 -- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f60040a12c0 msgr2=0x7f60040a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.460+0000 7f6021fff700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f60040a12c0 0x7f60040a3770 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f600c005fd0 tx=0x7f600c009310 comp rx=0 tx=0).stop 2023-07-21T22:23:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.460+0000 7f6021fff700 1 -- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c102910 msgr2=0x7f601c1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.460+0000 7f6021fff700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c102910 0x7f601c1983c0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f601000e940 tx=0x7f601000ec50 comp rx=0 tx=0).stop 2023-07-21T22:23:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.461+0000 7f6021fff700 1 -- 172.21.15.151:0/3565794429 shutdown_connections 2023-07-21T22:23:41.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.461+0000 7f6021fff700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f60040a12c0 0x7f60040a3770 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.461+0000 7f6021fff700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f601c106fb0 0x7f601c19c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.461+0000 7f6021fff700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f601c101f70 0x7f601c197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.461+0000 7f6021fff700 1 --2- 172.21.15.151:0/3565794429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f601c102910 0x7f601c1983c0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.461+0000 7f6021fff700 1 -- 172.21.15.151:0/3565794429 >> 172.21.15.151:0/3565794429 conn(0x7f601c0fd7e0 msgr2=0x7f601c0fe2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.461+0000 7f6021fff700 1 -- 172.21.15.151:0/3565794429 shutdown_connections 2023-07-21T22:23:41.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.461+0000 7f6021fff700 1 -- 172.21.15.151:0/3565794429 wait complete. 2023-07-21T22:23:41.523 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:41 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/385013795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:23:41.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-21T22:23:41.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.706+0000 7fa0b279d700 1 -- 172.21.15.151:0/3813203079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac1013b0 msgr2=0x7fa0ac109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.706+0000 7fa0b279d700 1 --2- 172.21.15.151:0/3813203079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac1013b0 0x7fa0ac109a80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009990 tx=0x7fa09c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.706+0000 7fa0b279d700 1 -- 172.21.15.151:0/3813203079 shutdown_connections 2023-07-21T22:23:41.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.706+0000 7fa0b279d700 1 --2- 172.21.15.151:0/3813203079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ac109fc0 0x7fa0ac10c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.706+0000 7fa0b279d700 1 --2- 172.21.15.151:0/3813203079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac100aa0 0x7fa0ac100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.706+0000 7fa0b279d700 1 --2- 172.21.15.151:0/3813203079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac1013b0 0x7fa0ac109a80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.706+0000 7fa0b279d700 1 -- 172.21.15.151:0/3813203079 >> 172.21.15.151:0/3813203079 conn(0x7fa0ac0745d0 msgr2=0x7fa0ac0749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.706+0000 7fa0b279d700 1 -- 172.21.15.151:0/3813203079 shutdown_connections 2023-07-21T22:23:41.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.706+0000 7fa0b279d700 1 -- 172.21.15.151:0/3813203079 wait complete. 2023-07-21T22:23:41.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.708+0000 7fa0b279d700 1 Processor -- start 2023-07-21T22:23:41.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.708+0000 7fa0b279d700 1 -- start start 2023-07-21T22:23:41.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b279d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac100aa0 0x7fa0ac0fe8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b279d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ac1013b0 0x7fa0ac0fee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b279d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac109fc0 0x7fa0ac1a3ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b279d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac0ff640 con 0x7fa0ac100aa0 2023-07-21T22:23:41.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b279d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac1a3ff0 con 0x7fa0ac1013b0 2023-07-21T22:23:41.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b279d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0ac1a4130 con 0x7fa0ac109fc0 2023-07-21T22:23:41.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b179b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac100aa0 0x7fa0ac0fe8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b179b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac100aa0 0x7fa0ac0fe8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49288/0 (socket says 172.21.15.151:49288) 2023-07-21T22:23:41.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b179b700 1 -- 172.21.15.151:0/1699151767 learned_addr learned my addr 172.21.15.151:0/1699151767 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ac1013b0 0x7fa0ac0fee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b1f9c700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac109fc0 0x7fa0ac1a3ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b179b700 1 -- 172.21.15.151:0/1699151767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac109fc0 msgr2=0x7fa0ac1a3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b179b700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac109fc0 0x7fa0ac1a3ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b179b700 1 -- 172.21.15.151:0/1699151767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ac1013b0 msgr2=0x7fa0ac0fee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b179b700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ac1013b0 0x7fa0ac0fee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.709+0000 7fa0b179b700 1 -- 172.21.15.151:0/1699151767 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa09c0095f0 con 0x7fa0ac100aa0 2023-07-21T22:23:41.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.710+0000 7fa0b179b700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac100aa0 0x7fa0ac0fe8d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800e9a0 tx=0x7fa0a800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.710+0000 7fa0a27fc700 1 -- 172.21.15.151:0/1699151767 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8009790 con 0x7fa0ac100aa0 2023-07-21T22:23:41.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.710+0000 7fa0a27fc700 1 -- 172.21.15.151:0/1699151767 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0a8010430 con 0x7fa0ac100aa0 2023-07-21T22:23:41.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.710+0000 7fa0b279d700 1 -- 172.21.15.151:0/1699151767 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0ac1a4390 con 0x7fa0ac100aa0 2023-07-21T22:23:41.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.710+0000 7fa0a27fc700 1 -- 172.21.15.151:0/1699151767 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a800cea0 con 0x7fa0ac100aa0 2023-07-21T22:23:41.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.710+0000 7fa0b279d700 1 -- 172.21.15.151:0/1699151767 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0ac1a4870 con 0x7fa0ac100aa0 2023-07-21T22:23:41.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.714+0000 7fa0a27fc700 1 -- 172.21.15.151:0/1699151767 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fa0a80105a0 con 0x7fa0ac100aa0 2023-07-21T22:23:41.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.715+0000 7fa0a27fc700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0980a1360 0x7fa0980a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.715+0000 7fa0a27fc700 1 -- 172.21.15.151:0/1699151767 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa0a8014070 con 0x7fa0ac100aa0 2023-07-21T22:23:41.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.716+0000 7fa0c72b5b80 1 Processor -- start 2023-07-21T22:23:41.761 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.716+0000 7fa0c72b5b80 1 -- start start 2023-07-21T22:23:41.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.716+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0980a1360 0x7fa0980a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.716+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b030860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.716+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 0x55e05b03b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.716+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b03e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.716+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05af36cb0 con 0x55e05b03bc40 2023-07-21T22:23:41.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.716+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05af89a40 con 0x55e05b030490 2023-07-21T22:23:41.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.716+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05af82ed0 con 0x55e05b030da0 2023-07-21T22:23:41.763 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b1f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b03e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b179b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b030860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b179b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b030860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57294/0 (socket says 172.21.15.151:57294) 2023-07-21T22:23:41.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b1f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b03e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49298/0 (socket says 172.21.15.151:49298) 2023-07-21T22:23:41.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b179b700 1 -- 172.21.15.151:0/2472849974 learned_addr learned my addr 172.21.15.151:0/2472849974 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0980a1360 0x7fa0980a3810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac1000c0 tx=0x7fa09c00b260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.764 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/2472849974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 0x55e05b03b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b179b700 1 -- 172.21.15.151:0/2472849974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 msgr2=0x55e05b03b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b179b700 1 --2- 172.21.15.151:0/2472849974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 0x55e05b03b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b179b700 1 -- 172.21.15.151:0/2472849974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 msgr2=0x55e05b03e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b179b700 1 --2- 172.21.15.151:0/2472849974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b03e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b179b700 1 -- 172.21.15.151:0/2472849974 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e05adb0de0 con 0x55e05b030490 2023-07-21T22:23:41.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b1f9c700 1 --2- 172.21.15.151:0/2472849974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b03e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:41.766 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.717+0000 7fa0b179b700 1 --2- 172.21.15.151:0/2472849974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b030860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8096ab0 tx=0x7fa0a8099c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ac466fabd784099f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.718+0000 7fa0977fe700 1 -- 172.21.15.151:0/2472849974 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80a2490 con 0x55e05b030490 2023-07-21T22:23:41.772 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.718+0000 7fa0977fe700 1 -- 172.21.15.151:0/2472849974 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0a809a2a0 con 0x55e05b030490 2023-07-21T22:23:41.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.718+0000 7fa0977fe700 1 -- 172.21.15.151:0/2472849974 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80a2000 con 0x55e05b030490 2023-07-21T22:23:41.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.718+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2472849974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 msgr2=0x55e05b030860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.718+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/2472849974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b030860 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8096ab0 tx=0x7fa0a8099c90 comp rx=0 tx=0).stop 2023-07-21T22:23:41.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.719+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2472849974 shutdown_connections 2023-07-21T22:23:41.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.719+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/2472849974 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b030860 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.719+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/2472849974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b03e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.719+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/2472849974 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 0x55e05b03b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.719+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2472849974 >> 172.21.15.151:0/2472849974 conn(0x55e05b026ef0 msgr2=0x55e05b02c860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.719+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2472849974 shutdown_connections 2023-07-21T22:23:41.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.719+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2472849974 wait complete. 2023-07-21T22:23:41.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.719+0000 7fa0c72b5b80 1 -- start start 2023-07-21T22:23:41.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.720+0000 7fa0c72b5b80 1 Processor -- start 2023-07-21T22:23:41.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.720+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030490 0x55e05b03b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.720+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b0388f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.720+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b03bc40 0x55e05b039030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.720+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05af22ac0 con 0x55e05b030da0 2023-07-21T22:23:41.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.720+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05af227c0 con 0x55e05b03bc40 2023-07-21T22:23:41.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.720+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05ae06920 con 0x55e05b030490 2023-07-21T22:23:41.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.720+0000 7fa0c72b5b80 10 client.0 _ll_register_callbacks cb 0x55e05af20760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:41.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b0f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b0388f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b1f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b03bc40 0x55e05b039030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b179b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030490 0x55e05b03b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b179b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030490 0x55e05b03b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38510/0 (socket says 172.21.15.151:38510) 2023-07-21T22:23:41.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b1f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b03bc40 0x55e05b039030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57310/0 (socket says 172.21.15.151:57310) 2023-07-21T22:23:41.779 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b179b700 1 -- 172.21.15.151:0/1692638715 learned_addr learned my addr 172.21.15.151:0/1692638715 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b0f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b0388f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49304/0 (socket says 172.21.15.151:49304) 2023-07-21T22:23:41.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b0f9a700 1 -- 172.21.15.151:0/1692638715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030490 msgr2=0x55e05b03b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030490 0x55e05b03b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.780 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b0f9a700 1 -- 172.21.15.151:0/1692638715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b03bc40 msgr2=0x55e05b039030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b03bc40 0x55e05b039030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b0f9a700 1 -- 172.21.15.151:0/1692638715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a4003a40 con 0x55e05b030da0 2023-07-21T22:23:41.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b1f9c700 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b03bc40 0x55e05b039030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:41.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b0388f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005910 tx=0x7fa09c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f92435c38f8388 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.721+0000 7fa094ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:41.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.722+0000 7fa094ff9700 1 -- 172.21.15.151:0/1692638715 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c005720 con 0x55e05b030da0 2023-07-21T22:23:41.782 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.722+0000 7fa094ff9700 1 -- 172.21.15.151:0/1692638715 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa09c004dd0 con 0x55e05b030da0 2023-07-21T22:23:41.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.722+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/1692638715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e05aedc4f0 con 0x55e05b030da0 2023-07-21T22:23:41.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.722+0000 7fa094ff9700 1 -- 172.21.15.151:0/1692638715 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa09c039460 con 0x55e05b030da0 2023-07-21T22:23:41.783 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.722+0000 7fa0c72b5b80 10 client.16317 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.722+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/1692638715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x7fa0ac1a4870 con 0x55e05b030da0 2023-07-21T22:23:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.722+0000 7fa094ff9700 1 -- 172.21.15.151:0/1692638715 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e05aedc4f0 con 0x55e05b030da0 2023-07-21T22:23:41.784 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.723+0000 7fa094ff9700 1 -- 172.21.15.151:0/1692638715 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa09c0245d0 con 0x55e05b030da0 2023-07-21T22:23:41.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.723+0000 7fa0c72b5b80 10 client.16317 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:41.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.723+0000 7fa0c72b5b80 10 client.16317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:41.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.723+0000 7fa0c72b5b80 20 client.16317 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:41.785 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.723+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e05b04b620 0x55e05b04da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.723+0000 7fa0c72b5b80 4 client.16317 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:41.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.723+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/1692638715 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e05af7beb0 con 0x55e05b04b620 2023-07-21T22:23:41.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.723+0000 7fa0b179b700 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e05b04b620 0x55e05b04da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.786 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.724+0000 7fa0b179b700 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e05b04b620 0x55e05b04da30 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55fbc3ae2fea3abd server_cookie=3e5ed54a8e8fcbf5 in_seq=0 out_seq=0 2023-07-21T22:23:41.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.724+0000 7fa094ff9700 10 client.16317 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:41.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa094ff9700 1 -- 172.21.15.151:0/1692638715 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e05af7beb0 con 0x55e05b04b620 2023-07-21T22:23:41.787 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa094ff9700 10 client.16317 handle_command_reply: tid=0 2023-07-21T22:23:41.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 client.16317 shutdown 2023-07-21T22:23:41.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/1692638715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 msgr2=0x55e05b0388f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.788 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b0388f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fa09c005910 tx=0x7fa09c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/1692638715 shutdown_connections 2023-07-21T22:23:41.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e05b04b620 0x55e05b04da30 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b03bc40 0x55e05b039030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.789 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030490 0x55e05b03b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/1692638715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b0388f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/1692638715 >> 172.21.15.151:0/1692638715 conn(0x55e05b026ef0 msgr2=0x55e05b02c3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.790 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa094ff9700 0 client.16317 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:41.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/1692638715 shutdown_connections 2023-07-21T22:23:41.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/1692638715 wait complete. 2023-07-21T22:23:41.791 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.725+0000 7fa0c72b5b80 20 client.16317 trim_cache size 0 max 16384 2023-07-21T22:23:41.792 INFO:teuthology.orchestra.run.smithi151.stderr:17400000 of 50000000 tuples (34%) done (elapsed 245.27 s, remaining 459.52 s) 2023-07-21T22:23:41.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.741+0000 7fa0c72b5b80 1 Processor -- start 2023-07-21T22:23:41.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.741+0000 7fa0c72b5b80 1 -- start start 2023-07-21T22:23:41.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b03b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b03bc40 0x55e05b033ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.799 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05b0316f0 con 0x55e05b030da0 2023-07-21T22:23:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05b0311a0 con 0x55e05b030490 2023-07-21T22:23:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05b042bf0 con 0x55e05b03bc40 2023-07-21T22:23:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0b0f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b03b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0b0f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b03b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49312/0 (socket says 172.21.15.151:49312) 2023-07-21T22:23:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0b0f9a700 1 -- 172.21.15.151:0/2315698916 learned_addr learned my addr 172.21.15.151:0/2315698916 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0b179b700 1 --2- 172.21.15.151:0/2315698916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.800 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.742+0000 7fa0b1f9c700 1 --2- 172.21.15.151:0/2315698916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b03bc40 0x55e05b033ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.743+0000 7fa0b179b700 1 -- 172.21.15.151:0/2315698916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b03bc40 msgr2=0x55e05b033ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.743+0000 7fa0b179b700 1 --2- 172.21.15.151:0/2315698916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b03bc40 0x55e05b033ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.743+0000 7fa0b179b700 1 -- 172.21.15.151:0/2315698916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 msgr2=0x55e05b03b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.743+0000 7fa0b179b700 1 --2- 172.21.15.151:0/2315698916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b03b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.743+0000 7fa0b179b700 1 -- 172.21.15.151:0/2315698916 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e05ad99c60 con 0x55e05b030490 2023-07-21T22:23:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.743+0000 7fa0b179b700 1 --2- 172.21.15.151:0/2315698916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80a1f60 tx=0x7fa0a8099f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c84bdc70b7bea7f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.743+0000 7fa097fff700 1 -- 172.21.15.151:0/2315698916 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a809a410 con 0x55e05b030490 2023-07-21T22:23:41.801 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.743+0000 7fa097fff700 1 -- 172.21.15.151:0/2315698916 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0a80b8310 con 0x55e05b030490 2023-07-21T22:23:41.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.743+0000 7fa097fff700 1 -- 172.21.15.151:0/2315698916 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a80a2000 con 0x55e05b030490 2023-07-21T22:23:41.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.744+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2315698916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 msgr2=0x55e05b042680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.744+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/2315698916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042680 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa0a80a1f60 tx=0x7fa0a8099f40 comp rx=0 tx=0).stop 2023-07-21T22:23:41.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.744+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2315698916 shutdown_connections 2023-07-21T22:23:41.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.744+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/2315698916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042680 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.744+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/2315698916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b03bc40 0x55e05b033ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.744+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/2315698916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b030da0 0x55e05b03b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.802 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.744+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2315698916 >> 172.21.15.151:0/2315698916 conn(0x55e05b026ef0 msgr2=0x55e05b046e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.744+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2315698916 shutdown_connections 2023-07-21T22:23:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.745+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/2315698916 wait complete. 2023-07-21T22:23:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.745+0000 7fa0c72b5b80 1 -- start start 2023-07-21T22:23:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.745+0000 7fa0c72b5b80 1 Processor -- start 2023-07-21T22:23:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.746+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.746+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 0x55e05b040660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.746+0000 7fa0c72b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b040ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.803 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.746+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05b0410e0 con 0x55e05b03bc40 2023-07-21T22:23:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.746+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05b041250 con 0x55e05b030490 2023-07-21T22:23:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.746+0000 7fa0c72b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e05b041410 con 0x55e05b030da0 2023-07-21T22:23:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.746+0000 7fa0c72b5b80 10 client.0 _ll_register_callbacks cb 0x7fa09c00ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b179b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b1f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b040ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b179b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57324/0 (socket says 172.21.15.151:57324) 2023-07-21T22:23:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b179b700 1 -- 172.21.15.151:0/634012983 learned_addr learned my addr 172.21.15.151:0/634012983 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 0x55e05b040660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b179b700 1 -- 172.21.15.151:0/634012983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 msgr2=0x55e05b040660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b179b700 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 0x55e05b040660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b179b700 1 -- 172.21.15.151:0/634012983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 msgr2=0x55e05b040ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b179b700 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b040ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b179b700 1 -- 172.21.15.151:0/634012983 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e05adb0de0 con 0x55e05b030490 2023-07-21T22:23:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 0x55e05b040660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:23:41.805 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa0b179b700 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009230 tx=0x7fa0a8099a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc19bd894b719881 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.747+0000 7fa094ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:23:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.748+0000 7fa094ff9700 1 -- 172.21.15.151:0/634012983 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0a8099530 con 0x55e05b030490 2023-07-21T22:23:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.748+0000 7fa094ff9700 1 -- 172.21.15.151:0/634012983 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fa0a8099690 con 0x55e05b030490 2023-07-21T22:23:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.748+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/634012983 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa0a809a2a0 con 0x55e05b030490 2023-07-21T22:23:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.748+0000 7fa094ff9700 1 -- 172.21.15.151:0/634012983 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0a80a2000 con 0x55e05b030490 2023-07-21T22:23:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.748+0000 7fa0c72b5b80 10 client.26069 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.748+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/634012983 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55e05add7250 con 0x55e05b030490 2023-07-21T22:23:41.806 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.749+0000 7fa094ff9700 1 -- 172.21.15.151:0/634012983 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0a807c020 con 0x55e05b030490 2023-07-21T22:23:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.749+0000 7fa094ff9700 1 -- 172.21.15.151:0/634012983 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa0a8095e30 con 0x55e05b030490 2023-07-21T22:23:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.749+0000 7fa0c72b5b80 10 client.26069 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.749+0000 7fa0c72b5b80 10 client.26069 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.749+0000 7fa0c72b5b80 20 client.26069 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.749+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e05b0a03c0 0x55e05b0a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.749+0000 7fa0c72b5b80 4 client.26069 mds_command: new command op to 24599 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:23:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.749+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/634012983 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e05af3e050 con 0x55e05b0a03c0 2023-07-21T22:23:41.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.750+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e05b0a03c0 0x55e05b0a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.751+0000 7fa094ff9700 10 client.26069 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.751+0000 7fa0b0f9a700 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e05b0a03c0 0x55e05b0a27d0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f4a6600ddb4c382 server_cookie=3e267d31a9318981 in_seq=0 out_seq=0 2023-07-21T22:23:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.751+0000 7fa094ff9700 1 -- 172.21.15.151:0/634012983 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e05af3e050 con 0x55e05b0a03c0 2023-07-21T22:23:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.751+0000 7fa094ff9700 10 client.26069 handle_command_reply: tid=0 2023-07-21T22:23:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.751+0000 7fa0c72b5b80 1 client.26069 shutdown 2023-07-21T22:23:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/634012983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 msgr2=0x55e05b042250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042250 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0a8009230 tx=0x7fa0a8099a50 comp rx=0 tx=0).stop 2023-07-21T22:23:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/634012983 shutdown_connections 2023-07-21T22:23:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e05b0a03c0 0x55e05b0a27d0 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e05b030490 0x55e05b042250 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e05b03bc40 0x55e05b040ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 --2- 172.21.15.151:0/634012983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e05b030da0 0x55e05b040660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa094ff9700 0 client.26069 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/634012983 >> 172.21.15.151:0/634012983 conn(0x55e05b026ef0 msgr2=0x55e05b033ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.809 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/634012983 shutdown_connections 2023-07-21T22:23:41.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.752+0000 7fa0c72b5b80 1 -- 172.21.15.151:0/634012983 wait complete. 2023-07-21T22:23:41.810 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.753+0000 7fa0c72b5b80 20 client.26069 trim_cache size 0 max 16384 2023-07-21T22:23:41.810 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:23:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.753+0000 7fa0b279d700 1 -- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0980a1360 msgr2=0x7fa0980a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.753+0000 7fa0b279d700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0980a1360 0x7fa0980a3810 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa0ac1000c0 tx=0x7fa09c00b260 comp rx=0 tx=0).stop 2023-07-21T22:23:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 -- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac100aa0 msgr2=0x7fa0ac0fe8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac100aa0 0x7fa0ac0fe8d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fa0a800e9a0 tx=0x7fa0a800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.811 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 -- 172.21.15.151:0/1699151767 shutdown_connections 2023-07-21T22:23:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0980a1360 0x7fa0980a3810 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0ac109fc0 0x7fa0ac1a3ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0ac100aa0 0x7fa0ac0fe8d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 --2- 172.21.15.151:0/1699151767 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0ac1013b0 0x7fa0ac0fee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 -- 172.21.15.151:0/1699151767 >> 172.21.15.151:0/1699151767 conn(0x7fa0ac0745d0 msgr2=0x7fa0ac10a930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 -- 172.21.15.151:0/1699151767 shutdown_connections 2023-07-21T22:23:41.812 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:41.754+0000 7fa0b279d700 1 -- 172.21.15.151:0/1699151767 wait complete. 2023-07-21T22:23:41.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:41 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/385013795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:23:41.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:41 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/385013795' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:23:42.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:42 smithi151 ceph-mon[95510]: pgmap v138: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:42.821 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-21T22:23:42.821 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-21T22:23:42.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:42 smithi187 ceph-mon[96918]: pgmap v138: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:42.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:42 smithi195 ceph-mon[97365]: pgmap v138: 97 pgs: 97 active+clean; 3.9 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 19 op/s 2023-07-21T22:23:42.991 INFO:teuthology.orchestra.run.smithi151.stderr:17500000 of 50000000 tuples (35%) done (elapsed 246.48 s, remaining 457.75 s) 2023-07-21T22:23:43.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.013+0000 7f3a9cdff700 1 -- 172.21.15.151:0/951246278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98100490 msgr2=0x7f3a9810c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.013+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/951246278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98100490 0x7f3a9810c920 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000b0a0 tx=0x7f3a9000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.013+0000 7f3a9cdff700 1 -- 172.21.15.151:0/951246278 shutdown_connections 2023-07-21T22:23:43.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.013+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/951246278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a98105af0 0x7f3a98105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.013+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/951246278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98100490 0x7f3a9810c920 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.013+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/951246278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a980ffae0 0x7f3a980fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.013+0000 7f3a9cdff700 1 -- 172.21.15.151:0/951246278 >> 172.21.15.151:0/951246278 conn(0x7f3a980fb5e0 msgr2=0x7f3a980fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.013+0000 7f3a9cdff700 1 -- 172.21.15.151:0/951246278 shutdown_connections 2023-07-21T22:23:43.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.014+0000 7f3a9cdff700 1 -- 172.21.15.151:0/951246278 wait complete. 2023-07-21T22:23:43.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.015+0000 7f3a9cdff700 1 Processor -- start 2023-07-21T22:23:43.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.015+0000 7f3a9cdff700 1 -- start start 2023-07-21T22:23:43.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.015+0000 7f3a9cdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a980ffae0 0x7f3a9819b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.015+0000 7f3a9cdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a98100490 0x7f3a9819bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.015+0000 7f3a9cdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98105af0 0x7f3a98195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.015+0000 7f3a9cdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a98196090 con 0x7f3a98105af0 2023-07-21T22:23:43.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.015+0000 7f3a9cdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a98196200 con 0x7f3a980ffae0 2023-07-21T22:23:43.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.015+0000 7f3a9cdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a981963c0 con 0x7f3a98100490 2023-07-21T22:23:43.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a96d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98105af0 0x7f3a98195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a96d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98105af0 0x7f3a98195a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49336/0 (socket says 172.21.15.151:49336) 2023-07-21T22:23:43.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a96d9d700 1 -- 172.21.15.151:0/1649758601 learned_addr learned my addr 172.21.15.151:0/1649758601 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a95d9b700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a98100490 0x7f3a9819bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a9659c700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a980ffae0 0x7f3a9819b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a96d9d700 1 -- 172.21.15.151:0/1649758601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a98100490 msgr2=0x7f3a9819bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a98100490 0x7f3a9819bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a96d9d700 1 -- 172.21.15.151:0/1649758601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a980ffae0 msgr2=0x7f3a9819b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a980ffae0 0x7f3a9819b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a96d9d700 1 -- 172.21.15.151:0/1649758601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a90009d00 con 0x7f3a98105af0 2023-07-21T22:23:43.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.016+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98105af0 0x7f3a98195a20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000b070 tx=0x7f3a9000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.017+0000 7f3a877fe700 1 -- 172.21.15.151:0/1649758601 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000e040 con 0x7f3a98105af0 2023-07-21T22:23:43.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.017+0000 7f3a877fe700 1 -- 172.21.15.151:0/1649758601 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a90009480 con 0x7f3a98105af0 2023-07-21T22:23:43.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.017+0000 7f3a877fe700 1 -- 172.21.15.151:0/1649758601 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90005040 con 0x7f3a98105af0 2023-07-21T22:23:43.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.017+0000 7f3a9cdff700 1 -- 172.21.15.151:0/1649758601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a98196640 con 0x7f3a98105af0 2023-07-21T22:23:43.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.017+0000 7f3a9cdff700 1 -- 172.21.15.151:0/1649758601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a981a29a0 con 0x7f3a98105af0 2023-07-21T22:23:43.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.020+0000 7f3a877fe700 1 -- 172.21.15.151:0/1649758601 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f3a9001d480 con 0x7f3a98105af0 2023-07-21T22:23:43.067 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.022+0000 7f3a877fe700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a800a1340 0x7f3a800a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.022+0000 7f3a877fe700 1 -- 172.21.15.151:0/1649758601 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3a900cdc70 con 0x7f3a98105af0 2023-07-21T22:23:43.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.022+0000 7f3ab0804b80 1 Processor -- start 2023-07-21T22:23:43.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.022+0000 7f3a9659c700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a800a1340 0x7f3a800a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.023+0000 7f3ab0804b80 1 -- start start 2023-07-21T22:23:43.069 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.023+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7bf7bd0 0x5607b7bf7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.023+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7be93d0 0x5607b7be9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.023+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7bfe8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.023+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7aeed30 con 0x5607b7be9d80 2023-07-21T22:23:43.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.023+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7b41ac0 con 0x5607b7be93d0 2023-07-21T22:23:43.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.023+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7b3af50 con 0x5607b7bf7bd0 2023-07-21T22:23:43.070 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.023+0000 7f3a9659c700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a800a1340 0x7f3a800a37f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009be0 tx=0x7f3a88009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a96d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7bfe8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a96d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7bfe8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49338/0 (socket says 172.21.15.151:49338) 2023-07-21T22:23:43.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a96d9d700 1 -- 172.21.15.151:0/1511555914 learned_addr learned my addr 172.21.15.151:0/1511555914 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a95d9b700 1 --2- 172.21.15.151:0/1511555914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7be93d0 0x5607b7be9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a9659c700 1 --2- 172.21.15.151:0/1511555914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7bf7bd0 0x5607b7bf7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a96d9d700 1 -- 172.21.15.151:0/1511555914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7bf7bd0 msgr2=0x5607b7bf7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.071 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/1511555914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7bf7bd0 0x5607b7bf7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a96d9d700 1 -- 172.21.15.151:0/1511555914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7be93d0 msgr2=0x5607b7be9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/1511555914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7be93d0 0x5607b7be9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a96d9d700 1 -- 172.21.15.151:0/1511555914 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607b7968e60 con 0x5607b7be9d80 2023-07-21T22:23:43.072 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/1511555914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7bfe8e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3a900a2c70 tx=0x7f3a9000b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6219f7b1a5776b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.024+0000 7f3a84ff9700 1 -- 172.21.15.151:0/1511555914 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9009a740 con 0x5607b7be9d80 2023-07-21T22:23:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.025+0000 7f3a84ff9700 1 -- 172.21.15.151:0/1511555914 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a9009ade0 con 0x5607b7be9d80 2023-07-21T22:23:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.025+0000 7f3a84ff9700 1 -- 172.21.15.151:0/1511555914 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9009b040 con 0x5607b7be9d80 2023-07-21T22:23:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.025+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1511555914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 msgr2=0x5607b7bfe8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.025+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1511555914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7bfe8e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3a900a2c70 tx=0x7f3a9000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.026+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1511555914 shutdown_connections 2023-07-21T22:23:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.026+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1511555914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7bfe8e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.026+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1511555914 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7bf7bd0 0x5607b7bf7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.026+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1511555914 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7be93d0 0x5607b7be9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.026+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1511555914 >> 172.21.15.151:0/1511555914 conn(0x5607b7bdef70 msgr2=0x5607b7be44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.026+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1511555914 shutdown_connections 2023-07-21T22:23:43.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.026+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1511555914 wait complete. 2023-07-21T22:23:43.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.026+0000 7f3ab0804b80 1 -- start start 2023-07-21T22:23:43.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.027+0000 7f3ab0804b80 1 Processor -- start 2023-07-21T22:23:43.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.027+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 0x5607b7c015c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.027+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c01b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.027+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7bfb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.027+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7adab40 con 0x5607b7be9d80 2023-07-21T22:23:43.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.027+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7ada840 con 0x5607b7bf7bd0 2023-07-21T22:23:43.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.027+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b79be9a0 con 0x5607b7be93d0 2023-07-21T22:23:43.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.027+0000 7f3ab0804b80 10 client.0 _ll_register_callbacks cb 0x5607b7ad87e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:43.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a95d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c01b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a95d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c01b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49346/0 (socket says 172.21.15.151:49346) 2023-07-21T22:23:43.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a95d9b700 1 -- 172.21.15.151:0/1786642522 learned_addr learned my addr 172.21.15.151:0/1786642522 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7bfb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a9659c700 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 0x5607b7c015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a95d9b700 1 -- 172.21.15.151:0/1786642522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 msgr2=0x5607b7c015c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a95d9b700 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 0x5607b7c015c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a95d9b700 1 -- 172.21.15.151:0/1786642522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 msgr2=0x5607b7bfb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a95d9b700 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7bfb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a95d9b700 1 -- 172.21.15.151:0/1786642522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a981a29a0 con 0x5607b7be9d80 2023-07-21T22:23:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7bfb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:43.078 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a95d9b700 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c01b00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c012840 tx=0x7f3a8c012b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b35e6a1129ac3c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.028+0000 7f3a7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.029+0000 7f3a7dffb700 1 -- 172.21.15.151:0/1786642522 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c017070 con 0x5607b7be9d80 2023-07-21T22:23:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.029+0000 7f3a7dffb700 1 -- 172.21.15.151:0/1786642522 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3a8c00f480 con 0x5607b7be9d80 2023-07-21T22:23:43.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.029+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1786642522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5607b7a94570 con 0x5607b7be9d80 2023-07-21T22:23:43.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.029+0000 7f3a7dffb700 1 -- 172.21.15.151:0/1786642522 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a8c0122e0 con 0x5607b7be9d80 2023-07-21T22:23:43.080 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.029+0000 7f3ab0804b80 10 client.16335 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.029+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1786642522 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5607b7951ce0 con 0x5607b7be9d80 2023-07-21T22:23:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.029+0000 7f3a7dffb700 1 -- 172.21.15.151:0/1786642522 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5607b7a94570 con 0x5607b7be9d80 2023-07-21T22:23:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.030+0000 7f3a7dffb700 1 -- 172.21.15.151:0/1786642522 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3a8c010700 con 0x5607b7be9d80 2023-07-21T22:23:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.030+0000 7f3ab0804b80 10 client.16335 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.030+0000 7f3ab0804b80 10 client.16335 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.030+0000 7f3ab0804b80 20 client.16335 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:43.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.030+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5607b7c0bbe0 0x5607b7c0dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.030+0000 7f3ab0804b80 4 client.16335 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:43.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.030+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1786642522 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5607b7b33f30 con 0x5607b7c0bbe0 2023-07-21T22:23:43.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.030+0000 7f3a9659c700 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5607b7c0bbe0 0x5607b7c0dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.031+0000 7f3a9659c700 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5607b7c0bbe0 0x5607b7c0dff0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ead2672f8ba2e53c server_cookie=99297110fad8ca90 in_seq=0 out_seq=0 2023-07-21T22:23:43.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.031+0000 7f3a7dffb700 10 client.16335 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:43.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3a7dffb700 1 -- 172.21.15.151:0/1786642522 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5607b7b33f30 con 0x5607b7c0bbe0 2023-07-21T22:23:43.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3a7dffb700 10 client.16335 handle_command_reply: tid=0 2023-07-21T22:23:43.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 client.16335 shutdown 2023-07-21T22:23:43.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1786642522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 msgr2=0x5607b7c01b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c01b00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c012840 tx=0x7f3a8c012b50 comp rx=0 tx=0).stop 2023-07-21T22:23:43.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1786642522 shutdown_connections 2023-07-21T22:23:43.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5607b7c0bbe0 0x5607b7c0dff0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7bfb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 0x5607b7c015c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/1786642522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c01b00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1786642522 >> 172.21.15.151:0/1786642522 conn(0x5607b7bdef70 msgr2=0x5607b7be4250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3a7dffb700 0 client.16335 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:43.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1786642522 shutdown_connections 2023-07-21T22:23:43.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.032+0000 7f3ab0804b80 1 -- 172.21.15.151:0/1786642522 wait complete. 2023-07-21T22:23:43.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.033+0000 7f3ab0804b80 20 client.16335 trim_cache size 0 max 16384 2023-07-21T22:23:43.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.059+0000 7f3ab0804b80 1 Processor -- start 2023-07-21T22:23:43.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.060+0000 7f3ab0804b80 1 -- start start 2023-07-21T22:23:43.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.060+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be93d0 0x5607b7bfb980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.060+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7be9d80 0x5607b7bfa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.060+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7bf7bd0 0x5607b7c01190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.060+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7bf5790 con 0x5607b7be93d0 2023-07-21T22:23:43.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.060+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7bdc120 con 0x5607b7be9d80 2023-07-21T22:23:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.060+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7c09140 con 0x5607b7bf7bd0 2023-07-21T22:23:43.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.061+0000 7f3a9659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be93d0 0x5607b7bfb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.061+0000 7f3a9659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be93d0 0x5607b7bfb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49358/0 (socket says 172.21.15.151:49358) 2023-07-21T22:23:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.061+0000 7f3a9659c700 1 -- 172.21.15.151:0/2563922577 learned_addr learned my addr 172.21.15.151:0/2563922577 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.061+0000 7f3a9659c700 1 -- 172.21.15.151:0/2563922577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7bf7bd0 msgr2=0x5607b7c01190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.061+0000 7f3a9659c700 1 --2- 172.21.15.151:0/2563922577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7bf7bd0 0x5607b7c01190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.061+0000 7f3a9659c700 1 -- 172.21.15.151:0/2563922577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7be9d80 msgr2=0x5607b7bfa710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.061+0000 7f3a9659c700 1 --2- 172.21.15.151:0/2563922577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7be9d80 0x5607b7bfa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.061+0000 7f3a9659c700 1 -- 172.21.15.151:0/2563922577 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5607b798f2d0 con 0x5607b7be93d0 2023-07-21T22:23:43.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.061+0000 7f3a9659c700 1 --2- 172.21.15.151:0/2563922577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be93d0 0x5607b7bfb980 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009aa0 tx=0x7f3a88014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a235cfab6cd53c01 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.062+0000 7f3a857fa700 1 -- 172.21.15.151:0/2563922577 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8802f070 con 0x5607b7be93d0 2023-07-21T22:23:43.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.062+0000 7f3a857fa700 1 -- 172.21.15.151:0/2563922577 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a88026040 con 0x5607b7be93d0 2023-07-21T22:23:43.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.062+0000 7f3a857fa700 1 -- 172.21.15.151:0/2563922577 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a88024040 con 0x5607b7be93d0 2023-07-21T22:23:43.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.063+0000 7f3ab0804b80 1 -- 172.21.15.151:0/2563922577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be93d0 msgr2=0x5607b7bfb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.063+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/2563922577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be93d0 0x5607b7bfb980 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009aa0 tx=0x7f3a88014000 comp rx=0 tx=0).stop 2023-07-21T22:23:43.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.063+0000 7f3ab0804b80 1 -- 172.21.15.151:0/2563922577 shutdown_connections 2023-07-21T22:23:43.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.063+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/2563922577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7bf7bd0 0x5607b7c01190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.063+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/2563922577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be93d0 0x5607b7bfb980 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.063+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/2563922577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7be9d80 0x5607b7bfa710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.063+0000 7f3ab0804b80 1 -- 172.21.15.151:0/2563922577 >> 172.21.15.151:0/2563922577 conn(0x5607b7bdef70 msgr2=0x5607b7bfa000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.063+0000 7f3ab0804b80 1 -- 172.21.15.151:0/2563922577 shutdown_connections 2023-07-21T22:23:43.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.063+0000 7f3ab0804b80 1 -- 172.21.15.151:0/2563922577 wait complete. 2023-07-21T22:23:43.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.064+0000 7f3ab0804b80 1 -- start start 2023-07-21T22:23:43.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.064+0000 7f3ab0804b80 1 Processor -- start 2023-07-21T22:23:43.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.064+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 0x5607b7c59fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.064+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c5a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.064+0000 7f3ab0804b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7c54340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.064+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7c54920 con 0x5607b7be9d80 2023-07-21T22:23:43.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.064+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7c54a90 con 0x5607b7bf7bd0 2023-07-21T22:23:43.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.064+0000 7f3ab0804b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5607b7c54c50 con 0x5607b7be93d0 2023-07-21T22:23:43.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.064+0000 7f3ab0804b80 10 client.0 _ll_register_callbacks cb 0x7f3a8c009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:43.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a95d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c5a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a9659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 0x5607b7c59fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a95d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c5a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49366/0 (socket says 172.21.15.151:49366) 2023-07-21T22:23:43.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a95d9b700 1 -- 172.21.15.151:0/194081629 learned_addr learned my addr 172.21.15.151:0/194081629 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7c54340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a95d9b700 1 -- 172.21.15.151:0/194081629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 msgr2=0x5607b7c59fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.114 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a95d9b700 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 0x5607b7c59fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a95d9b700 1 -- 172.21.15.151:0/194081629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 msgr2=0x5607b7c54340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a95d9b700 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7c54340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a95d9b700 1 -- 172.21.15.151:0/194081629 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a88017070 con 0x5607b7be9d80 2023-07-21T22:23:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a9659c700 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 0x5607b7c59fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.065+0000 7f3a96d9d700 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7c54340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.066+0000 7f3a95d9b700 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c5a4e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c010b30 tx=0x7f3a8c0106e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c446a406e277fdb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.066+0000 7f3a7dffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.066+0000 7f3a7dffb700 1 -- 172.21.15.151:0/194081629 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8c017070 con 0x5607b7be9d80 2023-07-21T22:23:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.066+0000 7f3a7dffb700 1 -- 172.21.15.151:0/194081629 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3a8c000e40 con 0x5607b7be9d80 2023-07-21T22:23:43.116 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.066+0000 7f3ab0804b80 1 -- 172.21.15.151:0/194081629 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3a9009ade0 con 0x5607b7be9d80 2023-07-21T22:23:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.066+0000 7f3a7dffb700 1 -- 172.21.15.151:0/194081629 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3a8c0122e0 con 0x5607b7be9d80 2023-07-21T22:23:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.066+0000 7f3ab0804b80 10 client.16341 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.066+0000 7f3ab0804b80 1 -- 172.21.15.151:0/194081629 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5607b7967330 con 0x5607b7be9d80 2023-07-21T22:23:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.066+0000 7f3a7dffb700 1 -- 172.21.15.151:0/194081629 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3a9009ade0 con 0x5607b7be9d80 2023-07-21T22:23:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.067+0000 7f3a7dffb700 1 -- 172.21.15.151:0/194081629 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3a8c025a40 con 0x5607b7be9d80 2023-07-21T22:23:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.067+0000 7f3ab0804b80 10 client.16341 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.067+0000 7f3ab0804b80 10 client.16341 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:43.118 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.067+0000 7f3ab0804b80 20 client.16341 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.067+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5607b7c61e90 0x5607b7c642a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.067+0000 7f3ab0804b80 4 client.16341 mds_command: new command op to 24599 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-21T22:23:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.067+0000 7f3ab0804b80 1 -- 172.21.15.151:0/194081629 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5607b7af60d0 con 0x5607b7c61e90 2023-07-21T22:23:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.067+0000 7f3a9659c700 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5607b7c61e90 0x5607b7c642a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.068+0000 7f3a9659c700 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5607b7c61e90 0x5607b7c642a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f283bbe6033ecd61 server_cookie=cf67156833c3cd4b in_seq=0 out_seq=0 2023-07-21T22:23:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.068+0000 7f3a7dffb700 10 client.16341 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:43.119 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.068+0000 7f3a7dffb700 1 -- 172.21.15.151:0/194081629 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5607b7af60d0 con 0x5607b7c61e90 2023-07-21T22:23:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.068+0000 7f3a7dffb700 10 client.16341 handle_command_reply: tid=0 2023-07-21T22:23:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.068+0000 7f3ab0804b80 1 client.16341 shutdown 2023-07-21T22:23:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 -- 172.21.15.151:0/194081629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 msgr2=0x5607b7c5a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c5a4e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c010b30 tx=0x7f3a8c0106e0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 -- 172.21.15.151:0/194081629 shutdown_connections 2023-07-21T22:23:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5607b7c61e90 0x5607b7c642a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.120 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5607b7bf7bd0 0x5607b7c54340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5607b7be93d0 0x5607b7c59fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 --2- 172.21.15.151:0/194081629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5607b7be9d80 0x5607b7c5a4e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 -- 172.21.15.151:0/194081629 >> 172.21.15.151:0/194081629 conn(0x5607b7bdef70 msgr2=0x5607b7be8c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3a7dffb700 0 client.16341 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 -- 172.21.15.151:0/194081629 shutdown_connections 2023-07-21T22:23:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 1 -- 172.21.15.151:0/194081629 wait complete. 2023-07-21T22:23:43.121 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.069+0000 7f3ab0804b80 20 client.16341 trim_cache size 0 max 16384 2023-07-21T22:23:43.122 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:23:43.122 INFO:teuthology.orchestra.run.smithi151.stdout: "return_code": 0, 2023-07-21T22:23:43.122 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_tag": "177d95a7-7f0e-4ccf-a820-e5d6538baf6c", 2023-07-21T22:23:43.122 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": "asynchronous" 2023-07-21T22:23:43.122 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:23:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 -- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a800a1340 msgr2=0x7f3a800a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a800a1340 0x7f3a800a37f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009be0 tx=0x7f3a88009260 comp rx=0 tx=0).stop 2023-07-21T22:23:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 -- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98105af0 msgr2=0x7f3a98195a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.123 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98105af0 0x7f3a98195a20 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f3a9000b070 tx=0x7f3a9000bce0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 -- 172.21.15.151:0/1649758601 shutdown_connections 2023-07-21T22:23:43.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3a800a1340 0x7f3a800a37f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3a980ffae0 0x7f3a9819b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98105af0 0x7f3a98195a20 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 --2- 172.21.15.151:0/1649758601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3a98100490 0x7f3a9819bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 -- 172.21.15.151:0/1649758601 >> 172.21.15.151:0/1649758601 conn(0x7f3a980fb5e0 msgr2=0x7f3a981035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.124 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 -- 172.21.15.151:0/1649758601 shutdown_connections 2023-07-21T22:23:43.125 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.070+0000 7f3a9cdff700 1 -- 172.21.15.151:0/1649758601 wait complete. 2023-07-21T22:23:43.136 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:23:43.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.346+0000 7f111a9ff700 1 -- 172.21.15.151:0/4104082305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 msgr2=0x7f111410c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.346+0000 7f111a9ff700 1 --2- 172.21.15.151:0/4104082305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 0x7f111410c940 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f110c00b0a0 tx=0x7f110c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.346+0000 7f111a9ff700 1 -- 172.21.15.151:0/4104082305 shutdown_connections 2023-07-21T22:23:43.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.346+0000 7f111a9ff700 1 --2- 172.21.15.151:0/4104082305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1114105b10 0x7f1114105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.392 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.346+0000 7f111a9ff700 1 --2- 172.21.15.151:0/4104082305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 0x7f111410c940 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.346+0000 7f111a9ff700 1 --2- 172.21.15.151:0/4104082305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11140ffb00 0x7f11140fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.346+0000 7f111a9ff700 1 -- 172.21.15.151:0/4104082305 >> 172.21.15.151:0/4104082305 conn(0x7f11140fb600 msgr2=0x7f11140fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.346+0000 7f111a9ff700 1 -- 172.21.15.151:0/4104082305 shutdown_connections 2023-07-21T22:23:43.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.346+0000 7f111a9ff700 1 -- 172.21.15.151:0/4104082305 wait complete. 2023-07-21T22:23:43.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.347+0000 7f111a9ff700 1 Processor -- start 2023-07-21T22:23:43.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.348+0000 7f111a9ff700 1 -- start start 2023-07-21T22:23:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.348+0000 7f111a9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11140ffb00 0x7f1114072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.348+0000 7f111a9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 0x7f1114072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.348+0000 7f111a9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1114105b10 0x7f11141a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.348+0000 7f111a9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1114073580 con 0x7f11141004b0 2023-07-21T22:23:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.348+0000 7f111a9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11141a42f0 con 0x7f1114105b10 2023-07-21T22:23:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.348+0000 7f111a9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11141a4430 con 0x7f11140ffb00 2023-07-21T22:23:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.348+0000 7f11137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 0x7f1114072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f1113fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11140ffb00 0x7f1114072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f11137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 0x7f1114072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49396/0 (socket says 172.21.15.151:49396) 2023-07-21T22:23:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f11137fe700 1 -- 172.21.15.151:0/2303822788 learned_addr learned my addr 172.21.15.151:0/2303822788 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f1118f9c700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1114105b10 0x7f11141a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f11137fe700 1 -- 172.21.15.151:0/2303822788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11140ffb00 msgr2=0x7f1114072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f11137fe700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11140ffb00 0x7f1114072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f11137fe700 1 -- 172.21.15.151:0/2303822788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1114105b10 msgr2=0x7f11141a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f11137fe700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1114105b10 0x7f11141a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f11137fe700 1 -- 172.21.15.151:0/2303822788 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110c009d00 con 0x7f11141004b0 2023-07-21T22:23:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f1113fff700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11140ffb00 0x7f1114072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f1118f9c700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1114105b10 0x7f11141a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:43.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.349+0000 7f11137fe700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 0x7f1114072d50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f110800e9a0 tx=0x7f110800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.350+0000 7f11117fa700 1 -- 172.21.15.151:0/2303822788 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108009790 con 0x7f11141004b0 2023-07-21T22:23:43.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.350+0000 7f111a9ff700 1 -- 172.21.15.151:0/2303822788 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11141a4690 con 0x7f11141004b0 2023-07-21T22:23:43.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.350+0000 7f11117fa700 1 -- 172.21.15.151:0/2303822788 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1108010430 con 0x7f11141004b0 2023-07-21T22:23:43.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.350+0000 7f11117fa700 1 -- 172.21.15.151:0/2303822788 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110800cea0 con 0x7f11141004b0 2023-07-21T22:23:43.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.350+0000 7f111a9ff700 1 -- 172.21.15.151:0/2303822788 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11141a4b70 con 0x7f11141004b0 2023-07-21T22:23:43.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.354+0000 7f11117fa700 1 -- 172.21.15.151:0/2303822788 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f11080105a0 con 0x7f11141004b0 2023-07-21T22:23:43.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.355+0000 7f112e35eb80 1 Processor -- start 2023-07-21T22:23:43.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.355+0000 7f112e35eb80 1 -- start start 2023-07-21T22:23:43.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.355+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 0x55ac62e69580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.355+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e64350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.355+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62e64da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.355+0000 7f112e35eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62d69cb0 con 0x55ac62e69ac0 2023-07-21T22:23:43.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.355+0000 7f112e35eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62dbca40 con 0x55ac62e64930 2023-07-21T22:23:43.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.355+0000 7f112e35eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62db5ed0 con 0x55ac62e691b0 2023-07-21T22:23:43.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f11137fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62e64da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f11137fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62e64da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57382/0 (socket says 172.21.15.151:57382) 2023-07-21T22:23:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f11137fe700 1 -- 172.21.15.151:0/682283026 learned_addr learned my addr 172.21.15.151:0/682283026 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f1113fff700 1 --2- 172.21.15.151:0/682283026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e64350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f1118f9c700 1 --2- 172.21.15.151:0/682283026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 0x55ac62e69580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f11117fa700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10fc0a12c0 0x7f10fc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f11137fe700 1 -- 172.21.15.151:0/682283026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 msgr2=0x55ac62e69580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f11137fe700 1 --2- 172.21.15.151:0/682283026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 0x55ac62e69580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f11137fe700 1 -- 172.21.15.151:0/682283026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 msgr2=0x55ac62e64350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f11137fe700 1 --2- 172.21.15.151:0/682283026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e64350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.356+0000 7f11137fe700 1 -- 172.21.15.151:0/682283026 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac62be3de0 con 0x55ac62e64930 2023-07-21T22:23:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.357+0000 7f1118f9c700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10fc0a12c0 0x7f10fc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.357+0000 7f11137fe700 1 --2- 172.21.15.151:0/682283026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62e64da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11080ca600 tx=0x7f1108024000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8e2da9887730b03 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.357+0000 7f11117fa700 1 -- 172.21.15.151:0/2303822788 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f1108014070 con 0x7f11141004b0 2023-07-21T22:23:43.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.357+0000 7f10fa7fc700 1 -- 172.21.15.151:0/682283026 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108013f00 con 0x55ac62e64930 2023-07-21T22:23:43.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.357+0000 7f10fa7fc700 1 -- 172.21.15.151:0/682283026 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1108099b80 con 0x55ac62e64930 2023-07-21T22:23:43.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.357+0000 7f10fa7fc700 1 -- 172.21.15.151:0/682283026 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108025170 con 0x55ac62e64930 2023-07-21T22:23:43.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f112e35eb80 1 -- 172.21.15.151:0/682283026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 msgr2=0x55ac62e64da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f112e35eb80 1 --2- 172.21.15.151:0/682283026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62e64da0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f11080ca600 tx=0x7f1108024000 comp rx=0 tx=0).stop 2023-07-21T22:23:43.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f1118f9c700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10fc0a12c0 0x7f10fc0a3770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f110c0062a0 tx=0x7f110c0099e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f112e35eb80 1 -- 172.21.15.151:0/682283026 shutdown_connections 2023-07-21T22:23:43.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f112e35eb80 1 --2- 172.21.15.151:0/682283026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62e64da0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f112e35eb80 1 --2- 172.21.15.151:0/682283026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 0x55ac62e69580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f112e35eb80 1 --2- 172.21.15.151:0/682283026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e64350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f112e35eb80 1 -- 172.21.15.151:0/682283026 >> 172.21.15.151:0/682283026 conn(0x55ac62e59ef0 msgr2=0x55ac62e5f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f112e35eb80 1 -- 172.21.15.151:0/682283026 shutdown_connections 2023-07-21T22:23:43.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.359+0000 7f112e35eb80 1 -- 172.21.15.151:0/682283026 wait complete. 2023-07-21T22:23:43.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.360+0000 7f112e35eb80 1 -- start start 2023-07-21T22:23:43.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.361+0000 7f112e35eb80 1 Processor -- start 2023-07-21T22:23:43.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.362+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 0x55ac62e70ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.362+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e691b0 0x55ac62e6de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.362+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e6e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.362+0000 7f112e35eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62d55ac0 con 0x55ac62e69ac0 2023-07-21T22:23:43.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.362+0000 7f112e35eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62d557c0 con 0x55ac62e691b0 2023-07-21T22:23:43.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.362+0000 7f112e35eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62c39920 con 0x55ac62e64930 2023-07-21T22:23:43.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.362+0000 7f112e35eb80 10 client.0 _ll_register_callbacks cb 0x55ac62d53760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:43.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.363+0000 7f1118f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e6e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.363+0000 7f1113fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 0x55ac62e70ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.363+0000 7f1118f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e6e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49410/0 (socket says 172.21.15.151:49410) 2023-07-21T22:23:43.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.363+0000 7f1118f9c700 1 -- 172.21.15.151:0/4007339887 learned_addr learned my addr 172.21.15.151:0/4007339887 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.363+0000 7f11137fe700 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e691b0 0x55ac62e6de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f1118f9c700 1 -- 172.21.15.151:0/4007339887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 msgr2=0x55ac62e70ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f1118f9c700 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 0x55ac62e70ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f1118f9c700 1 -- 172.21.15.151:0/4007339887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e691b0 msgr2=0x55ac62e6de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f1118f9c700 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e691b0 0x55ac62e6de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f1118f9c700 1 -- 172.21.15.151:0/4007339887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11141a4b70 con 0x55ac62e69ac0 2023-07-21T22:23:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f1118f9c700 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e6e4a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f110c00b0a0 tx=0x7f110c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd093d206078a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f10f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:23:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f10f37fe700 1 -- 172.21.15.151:0/4007339887 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110c00e040 con 0x55ac62e69ac0 2023-07-21T22:23:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f112e35eb80 1 -- 172.21.15.151:0/4007339887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac62d0f4f0 con 0x55ac62e69ac0 2023-07-21T22:23:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.364+0000 7f10f37fe700 1 -- 172.21.15.151:0/4007339887 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f110c005450 con 0x55ac62e69ac0 2023-07-21T22:23:43.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f10f37fe700 1 -- 172.21.15.151:0/4007339887 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f110c009440 con 0x55ac62e69ac0 2023-07-21T22:23:43.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f112e35eb80 10 client.16353 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:43.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f112e35eb80 1 -- 172.21.15.151:0/4007339887 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ac62bccc60 con 0x55ac62e69ac0 2023-07-21T22:23:43.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f10f37fe700 1 -- 172.21.15.151:0/4007339887 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ac62d0f4f0 con 0x55ac62e69ac0 2023-07-21T22:23:43.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f10f37fe700 1 -- 172.21.15.151:0/4007339887 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f110c039ac0 con 0x55ac62e69ac0 2023-07-21T22:23:43.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f112e35eb80 10 client.16353 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:43.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f112e35eb80 10 client.16353 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:43.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f112e35eb80 20 client.16353 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:43.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f112e35eb80 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62e7e480 0x55ac62e80890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f112e35eb80 4 client.16353 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:43.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.365+0000 7f112e35eb80 1 -- 172.21.15.151:0/4007339887 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac62daeeb0 con 0x55ac62e7e480 2023-07-21T22:23:43.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.366+0000 7f1113fff700 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62e7e480 0x55ac62e80890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.366+0000 7f10f37fe700 10 client.16353 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:43.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.366+0000 7f1113fff700 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62e7e480 0x55ac62e80890 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa14013b666c8959 server_cookie=de6852e3ac961688 in_seq=0 out_seq=0 2023-07-21T22:23:43.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.367+0000 7f10f37fe700 1 -- 172.21.15.151:0/4007339887 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ac62daeeb0 con 0x55ac62e7e480 2023-07-21T22:23:43.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.367+0000 7f10f37fe700 10 client.16353 handle_command_reply: tid=0 2023-07-21T22:23:43.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.367+0000 7f112e35eb80 1 client.16353 shutdown 2023-07-21T22:23:43.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.367+0000 7f112e35eb80 1 -- 172.21.15.151:0/4007339887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 msgr2=0x55ac62e6e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.367+0000 7f112e35eb80 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e6e4a0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f110c00b0a0 tx=0x7f110c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f112e35eb80 1 -- 172.21.15.151:0/4007339887 shutdown_connections 2023-07-21T22:23:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f112e35eb80 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62e7e480 0x55ac62e80890 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f112e35eb80 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62e6e4a0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f112e35eb80 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 0x55ac62e70ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f112e35eb80 1 --2- 172.21.15.151:0/4007339887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e691b0 0x55ac62e6de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f10f37fe700 0 client.16353 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:43.417 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f112e35eb80 1 -- 172.21.15.151:0/4007339887 >> 172.21.15.151:0/4007339887 conn(0x55ac62e59ef0 msgr2=0x55ac62e5f420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f112e35eb80 1 -- 172.21.15.151:0/4007339887 shutdown_connections 2023-07-21T22:23:43.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f112e35eb80 1 -- 172.21.15.151:0/4007339887 wait complete. 2023-07-21T22:23:43.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.368+0000 7f112e35eb80 20 client.16353 trim_cache size 0 max 16384 2023-07-21T22:23:43.433 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 22:23:43 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-b[122412]: 2023-07-21T22:23:43.091+0000 7f7b27327700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...6,head] /volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_logical/ auth{1=1,2=1} v3557 ap=2 f(v16 m2023-07-21T22:22:54.184422+0000 3=1+2) n(v4 rc2023-07-21T22:22:54.184422+0000 b8 4=1+3) old_inodes=3 (idft sync r=1) (inest sync r=1) (ifile sync r=1) (iversion lock) caps={15324=pAsLsXsFs/-@81} | dirtyscattered=0 request=0 lock=3 importing=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55f0b1a47600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v453>,<0x10000000005/data v113>,<0x10000000003/postgres v23>,<0x10000000002/89be92e1-be58-42e3-be68-399c1317a935 v37>,<0x10000000001/sv_0 v57>,<0x10000000000/_nogroup v41>,<0x1/volumes v37>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v3557>,<0x10000000005/data v802>,<0x10000000003/postgres v364>,<0x10000000002/89be92e1-be58-42e3-be68-399c1317a935 v383>,<0x10000000001/sv_0 v404>,<0x10000000000/_nogroup v390>,<0x1/volumes v384>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2023-07-21T22:22:54.169291+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2023-07-21T22:22:54.184422+0000 b8 4=1+3)","memory_value.dirstat":"f(v16 m2023-07-21T22:22:54.184422+0000 3=1+2)","memory_value.rstat":"n(v4 rc2023-07-21T22:22:54.184422+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2023-07-21T22:23:43.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.388+0000 7f112e35eb80 1 Processor -- start 2023-07-21T22:23:43.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.388+0000 7f112e35eb80 1 -- start start 2023-07-21T22:23:43.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.388+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 0x55ac62e75520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.388+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e691b0 0x55ac62e5f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.388+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e69ac0 0x55ac62e62a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.388+0000 7f112e35eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62e60320 con 0x55ac62e691b0 2023-07-21T22:23:43.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.388+0000 7f112e35eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62daeeb0 con 0x55ac62e69ac0 2023-07-21T22:23:43.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.388+0000 7f112e35eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62e60ba0 con 0x55ac62e64930 2023-07-21T22:23:43.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f11137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e691b0 0x55ac62e5f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f11137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e691b0 0x55ac62e5f2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49426/0 (socket says 172.21.15.151:49426) 2023-07-21T22:23:43.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f11137fe700 1 -- 172.21.15.151:0/2946257134 learned_addr learned my addr 172.21.15.151:0/2946257134 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f1113fff700 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 0x55ac62e75520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f1118f9c700 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e69ac0 0x55ac62e62a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f11137fe700 1 -- 172.21.15.151:0/2946257134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 msgr2=0x55ac62e75520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f11137fe700 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 0x55ac62e75520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f11137fe700 1 -- 172.21.15.151:0/2946257134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e69ac0 msgr2=0x55ac62e62a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f11137fe700 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e69ac0 0x55ac62e62a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f11137fe700 1 -- 172.21.15.151:0/2946257134 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac62c0a250 con 0x55ac62e691b0 2023-07-21T22:23:43.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f1113fff700 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 0x55ac62e75520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:43.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.389+0000 7f1118f9c700 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e69ac0 0x55ac62e62a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:43.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.390+0000 7f11137fe700 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e691b0 0x55ac62e5f2d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f11080a1f60 tx=0x7f11080d0880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f866530e2a2bbbf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.391+0000 7f10faffd700 1 -- 172.21.15.151:0/2946257134 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108020360 con 0x55ac62e691b0 2023-07-21T22:23:43.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.391+0000 7f10faffd700 1 -- 172.21.15.151:0/2946257134 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f110809b2b0 con 0x55ac62e691b0 2023-07-21T22:23:43.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.391+0000 7f10faffd700 1 -- 172.21.15.151:0/2946257134 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f110809a040 con 0x55ac62e691b0 2023-07-21T22:23:43.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.392+0000 7f112e35eb80 1 -- 172.21.15.151:0/2946257134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e691b0 msgr2=0x55ac62e5f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.392+0000 7f112e35eb80 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e691b0 0x55ac62e5f2d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f11080a1f60 tx=0x7f11080d0880 comp rx=0 tx=0).stop 2023-07-21T22:23:43.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.392+0000 7f112e35eb80 1 -- 172.21.15.151:0/2946257134 shutdown_connections 2023-07-21T22:23:43.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.392+0000 7f112e35eb80 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e69ac0 0x55ac62e62a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.392+0000 7f112e35eb80 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e64930 0x55ac62e75520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.392+0000 7f112e35eb80 1 --2- 172.21.15.151:0/2946257134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e691b0 0x55ac62e5f2d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.392+0000 7f112e35eb80 1 -- 172.21.15.151:0/2946257134 >> 172.21.15.151:0/2946257134 conn(0x55ac62e59ef0 msgr2=0x55ac62e79cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.392+0000 7f112e35eb80 1 -- 172.21.15.151:0/2946257134 shutdown_connections 2023-07-21T22:23:43.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.392+0000 7f112e35eb80 1 -- 172.21.15.151:0/2946257134 wait complete. 2023-07-21T22:23:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.393+0000 7f112e35eb80 1 -- start start 2023-07-21T22:23:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.393+0000 7f112e35eb80 1 Processor -- start 2023-07-21T22:23:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62ec64e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 0x55ac62ec6a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f112e35eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62eca8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f112e35eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62ecae50 con 0x55ac62e69ac0 2023-07-21T22:23:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f112e35eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62ecafc0 con 0x55ac62e64930 2023-07-21T22:23:43.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f112e35eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62ecb180 con 0x55ac62e691b0 2023-07-21T22:23:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f112e35eb80 10 client.0 _ll_register_callbacks cb 0x55ac62d53760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f1118f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62eca8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f1118f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62eca8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49436/0 (socket says 172.21.15.151:49436) 2023-07-21T22:23:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f1118f9c700 1 -- 172.21.15.151:0/1061446498 learned_addr learned my addr 172.21.15.151:0/1061446498 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f11137fe700 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 0x55ac62ec6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.394+0000 7f1113fff700 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62ec64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f11137fe700 1 -- 172.21.15.151:0/1061446498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 msgr2=0x55ac62ec64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f11137fe700 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62ec64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f11137fe700 1 -- 172.21.15.151:0/1061446498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 msgr2=0x55ac62eca8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f11137fe700 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62eca8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f11137fe700 1 -- 172.21.15.151:0/1061446498 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110401da80 con 0x55ac62e691b0 2023-07-21T22:23:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f1118f9c700 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62eca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f11137fe700 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 0x55ac62ec6a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f11080a1f60 tx=0x7f1108005bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7f695cedbf304ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f10f37fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:23:43.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f10f37fe700 1 -- 172.21.15.151:0/1061446498 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1108010880 con 0x55ac62e691b0 2023-07-21T22:23:43.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f10f37fe700 1 -- 172.21.15.151:0/1061446498 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f110809e070 con 0x55ac62e691b0 2023-07-21T22:23:43.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f112e35eb80 1 -- 172.21.15.151:0/1061446498 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1108099b80 con 0x55ac62e691b0 2023-07-21T22:23:43.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f10f37fe700 1 -- 172.21.15.151:0/1061446498 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11080a2490 con 0x55ac62e691b0 2023-07-21T22:23:43.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f112e35eb80 10 client.26125 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:43.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.395+0000 7f112e35eb80 1 -- 172.21.15.151:0/1061446498 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x55ac62bccc60 con 0x55ac62e691b0 2023-07-21T22:23:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.396+0000 7f10f37fe700 1 -- 172.21.15.151:0/1061446498 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1108063020 con 0x55ac62e691b0 2023-07-21T22:23:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.396+0000 7f10f37fe700 1 -- 172.21.15.151:0/1061446498 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f11080b8270 con 0x55ac62e691b0 2023-07-21T22:23:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.396+0000 7f112e35eb80 10 client.26125 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.396+0000 7f112e35eb80 10 client.26125 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.396+0000 7f112e35eb80 20 client.26125 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.396+0000 7f112e35eb80 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62ed36e0 0x55ac62ed5af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.396+0000 7f112e35eb80 4 client.26125 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:23:43.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.396+0000 7f112e35eb80 1 -- 172.21.15.151:0/1061446498 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55ac62d71050 con 0x55ac62ed36e0 2023-07-21T22:23:43.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.397+0000 7f1113fff700 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62ed36e0 0x55ac62ed5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:43.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.397+0000 7f1113fff700 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62ed36e0 0x55ac62ed5af0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0cd2059f2dcdf18 server_cookie=fd557821f731f5d2 in_seq=0 out_seq=0 2023-07-21T22:23:43.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.397+0000 7f10f37fe700 10 client.26125 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:43.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.397+0000 7f10f37fe700 1 -- 172.21.15.151:0/1061446498 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55ac62d71050 con 0x55ac62ed36e0 2023-07-21T22:23:43.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.397+0000 7f10f37fe700 10 client.26125 handle_command_reply: tid=0 2023-07-21T22:23:43.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.397+0000 7f112e35eb80 1 client.26125 shutdown 2023-07-21T22:23:43.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 -- 172.21.15.151:0/1061446498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 msgr2=0x55ac62ec6a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 0x55ac62ec6a20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f11080a1f60 tx=0x7f1108005bb0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 -- 172.21.15.151:0/1061446498 shutdown_connections 2023-07-21T22:23:43.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62ed36e0 0x55ac62ed5af0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62e64930 0x55ac62ec64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62e69ac0 0x55ac62eca8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 --2- 172.21.15.151:0/1061446498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62e691b0 0x55ac62ec6a20 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f10f37fe700 0 client.26125 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:43.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 -- 172.21.15.151:0/1061446498 >> 172.21.15.151:0/1061446498 conn(0x55ac62e59ef0 msgr2=0x55ac62e5f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 -- 172.21.15.151:0/1061446498 shutdown_connections 2023-07-21T22:23:43.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 1 -- 172.21.15.151:0/1061446498 wait complete. 2023-07-21T22:23:43.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.398+0000 7f112e35eb80 20 client.26125 trim_cache size 0 max 16384 2023-07-21T22:23:43.450 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:23:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:23:43.450 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:23:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "177d95a7-7f0e-4ccf-a820-e5d6538baf6c": { 2023-07-21T22:23:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:23:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "177d95a7-7f0e-4ccf-a820-e5d6538baf6c", 2023-07-21T22:23:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:23:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:23:43.451 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:23:43.451 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:23:43.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 -- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10fc0a12c0 msgr2=0x7f10fc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10fc0a12c0 0x7f10fc0a3770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f110c0062a0 tx=0x7f110c0099e0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 -- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 msgr2=0x7f1114072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:43.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 0x7f1114072d50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f110800e9a0 tx=0x7f110800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 -- 172.21.15.151:0/2303822788 shutdown_connections 2023-07-21T22:23:43.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10fc0a12c0 0x7f10fc0a3770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1114105b10 0x7f11141a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11140ffb00 0x7f1114072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 --2- 172.21.15.151:0/2303822788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11141004b0 0x7f1114072d50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:43.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 -- 172.21.15.151:0/2303822788 >> 172.21.15.151:0/2303822788 conn(0x7f11140fb600 msgr2=0x7f11140fbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:43.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 -- 172.21.15.151:0/2303822788 shutdown_connections 2023-07-21T22:23:43.453 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:23:43.399+0000 7f111a9ff700 1 -- 172.21.15.151:0/2303822788 wait complete. 2023-07-21T22:23:43.464 INFO:tasks.cephfs.filesystem:scrub status for tag:177d95a7-7f0e-4ccf-a820-e5d6538baf6c - {'path': '/', 'tag': '177d95a7-7f0e-4ccf-a820-e5d6538baf6c', 'options': 'recursive,force'} 2023-07-21T22:23:43.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:43 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:23:43.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:43 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:43.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:43 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:23:43.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:43 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:23:43.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:43 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:43.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:43 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:23:43.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:43 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:23:43.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:43 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:43.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:43 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:23:44.310 INFO:teuthology.orchestra.run.smithi151.stderr:17600000 of 50000000 tuples (35%) done (elapsed 247.80 s, remaining 456.18 s) 2023-07-21T22:23:44.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:44 smithi151 ceph-mon[95510]: pgmap v139: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 31 op/s 2023-07-21T22:23:44.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:44 smithi151 ceph-mon[95510]: scrub queued for path: / 2023-07-21T22:23:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:44 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:44 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:23:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:44 smithi151 ceph-mon[95510]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-21T22:23:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:44 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:23:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:44 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:44 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:44 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:44 smithi187 ceph-mon[96918]: pgmap v139: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 31 op/s 2023-07-21T22:23:44.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:44 smithi187 ceph-mon[96918]: scrub queued for path: / 2023-07-21T22:23:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:44 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:44 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:23:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:44 smithi187 ceph-mon[96918]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-21T22:23:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:44 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:23:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:44 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:44 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:44 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:44 smithi195 ceph-mon[97365]: pgmap v139: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 35 MiB/s wr, 31 op/s 2023-07-21T22:23:44.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:44 smithi195 ceph-mon[97365]: scrub queued for path: / 2023-07-21T22:23:44.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:44 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:44 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:23:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:44 smithi195 ceph-mon[97365]: Scrub error on inode 0x1000000001b (/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2023-07-21T22:23:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:44 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:23:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:44 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:44 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:44 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:23:45.671 INFO:teuthology.orchestra.run.smithi151.stderr:17700000 of 50000000 tuples (35%) done (elapsed 249.16 s, remaining 454.69 s) 2023-07-21T22:23:46.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:46 smithi151 ceph-mon[95510]: pgmap v140: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-21T22:23:46.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:46 smithi187 ceph-mon[96918]: pgmap v140: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-21T22:23:46.903 INFO:teuthology.orchestra.run.smithi151.stderr:17800000 of 50000000 tuples (35%) done (elapsed 250.39 s, remaining 452.96 s) 2023-07-21T22:23:46.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:46 smithi195 ceph-mon[97365]: pgmap v140: 97 pgs: 97 active+clean; 4.0 GiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 23 MiB/s wr, 23 op/s 2023-07-21T22:23:48.121 INFO:teuthology.orchestra.run.smithi151.stderr:17900000 of 50000000 tuples (35%) done (elapsed 251.61 s, remaining 451.22 s) 2023-07-21T22:23:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:48 smithi151 ceph-mon[95510]: pgmap v141: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 35 MiB/s wr, 73 op/s 2023-07-21T22:23:48.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:48 smithi187 ceph-mon[96918]: pgmap v141: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 35 MiB/s wr, 73 op/s 2023-07-21T22:23:48.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:48 smithi195 ceph-mon[97365]: pgmap v141: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 35 MiB/s wr, 73 op/s 2023-07-21T22:23:49.462 INFO:teuthology.orchestra.run.smithi151.stderr:18000000 of 50000000 tuples (36%) done (elapsed 252.95 s, remaining 449.70 s) 2023-07-21T22:23:49.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:49 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:23:49.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:49 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:23:49.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:49 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:23:49.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:49 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:23:49.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:49 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:23:49.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:49 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:23:49.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:49 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:23:49.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:49 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:23:49.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:49 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:23:50.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:50 smithi151 ceph-mon[95510]: pgmap v142: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:23:50.709 INFO:teuthology.orchestra.run.smithi151.stderr:18100000 of 50000000 tuples (36%) done (elapsed 254.20 s, remaining 448.01 s) 2023-07-21T22:23:50.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:50 smithi187 ceph-mon[96918]: pgmap v142: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:23:50.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:50 smithi195 ceph-mon[97365]: pgmap v142: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:23:51.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.773+0000 7fb75a7ff700 1 -- 172.21.15.151:0/4285528355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb754105b10 msgr2=0x7fb754105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.773+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/4285528355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb754105b10 0x7fb754105ee0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb744009990 tx=0x7fb744009ca0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.773+0000 7fb75a7ff700 1 -- 172.21.15.151:0/4285528355 shutdown_connections 2023-07-21T22:23:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.773+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/4285528355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb754105b10 0x7fb754105ee0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.773+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/4285528355 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7541004b0 0x7fb75410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.773+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/4285528355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7540ffb00 0x7fb7540fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.773+0000 7fb75a7ff700 1 -- 172.21.15.151:0/4285528355 >> 172.21.15.151:0/4285528355 conn(0x7fb7540fb600 msgr2=0x7fb7540fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.773+0000 7fb75a7ff700 1 -- 172.21.15.151:0/4285528355 shutdown_connections 2023-07-21T22:23:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.773+0000 7fb75a7ff700 1 -- 172.21.15.151:0/4285528355 wait complete. 2023-07-21T22:23:51.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.775+0000 7fb75a7ff700 1 Processor -- start 2023-07-21T22:23:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.775+0000 7fb75a7ff700 1 -- start start 2023-07-21T22:23:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb75a7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ffb00 0x7fb75419bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb75a7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7541004b0 0x7fb75419c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb75a7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb754105b10 0x7fb754195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb75a7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7541960a0 con 0x7fb7541004b0 2023-07-21T22:23:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb75a7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb754196210 con 0x7fb754105b10 2023-07-21T22:23:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb75a7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7541963d0 con 0x7fb7540ffb00 2023-07-21T22:23:51.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb753fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ffb00 0x7fb75419bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb7537fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7541004b0 0x7fb75419c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb753fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ffb00 0x7fb75419bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54938/0 (socket says 172.21.15.151:54938) 2023-07-21T22:23:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb753fff700 1 -- 172.21.15.151:0/3029848516 learned_addr learned my addr 172.21.15.151:0/3029848516 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.776+0000 7fb758d9c700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb754105b10 0x7fb754195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.777+0000 7fb753fff700 1 -- 172.21.15.151:0/3029848516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb754105b10 msgr2=0x7fb754195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.777+0000 7fb753fff700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb754105b10 0x7fb754195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.777+0000 7fb753fff700 1 -- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7541004b0 msgr2=0x7fb75419c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.777+0000 7fb753fff700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7541004b0 0x7fb75419c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.777+0000 7fb753fff700 1 -- 172.21.15.151:0/3029848516 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7440095f0 con 0x7fb7540ffb00 2023-07-21T22:23:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.777+0000 7fb7537fe700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7541004b0 0x7fb75419c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.777+0000 7fb753fff700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ffb00 0x7fb75419bbd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb744005770 tx=0x7fb7440057a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:51.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.777+0000 7fb7517fa700 1 -- 172.21.15.151:0/3029848516 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74401d070 con 0x7fb7540ffb00 2023-07-21T22:23:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.778+0000 7fb7517fa700 1 -- 172.21.15.151:0/3029848516 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb744021410 con 0x7fb7540ffb00 2023-07-21T22:23:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.778+0000 7fb7517fa700 1 -- 172.21.15.151:0/3029848516 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb744017650 con 0x7fb7540ffb00 2023-07-21T22:23:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.778+0000 7fb75a7ff700 1 -- 172.21.15.151:0/3029848516 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb754196650 con 0x7fb7540ffb00 2023-07-21T22:23:51.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.778+0000 7fb75a7ff700 1 -- 172.21.15.151:0/3029848516 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb754072920 con 0x7fb7540ffb00 2023-07-21T22:23:51.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.783+0000 7fb7517fa700 1 -- 172.21.15.151:0/3029848516 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fb7440217f0 con 0x7fb7540ffb00 2023-07-21T22:23:51.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.784+0000 7fb76e155b80 1 Processor -- start 2023-07-21T22:23:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.784+0000 7fb76e155b80 1 -- start start 2023-07-21T22:23:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 0x5585c83bdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83b84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb76e155b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c82bdc50 con 0x5585c83be660 2023-07-21T22:23:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb76e155b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c83109e0 con 0x5585c83be210 2023-07-21T22:23:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb76e155b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c8309e70 con 0x5585c82146b0 2023-07-21T22:23:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb7517fa700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb73c0a12c0 0x7fb73c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb7517fa700 1 -- 172.21.15.151:0/3029848516 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb7440ce010 con 0x7fb7540ffb00 2023-07-21T22:23:51.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb753fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb758d9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 0x5585c83bdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb753fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54600/0 (socket says 172.21.15.151:54600) 2023-07-21T22:23:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb753fff700 1 -- 172.21.15.151:0/883371481 learned_addr learned my addr 172.21.15.151:0/883371481 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:51.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb7537fe700 1 --2- 172.21.15.151:0/883371481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83b84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb758d9c700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb73c0a12c0 0x7fb73c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb753fff700 1 -- 172.21.15.151:0/883371481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 msgr2=0x5585c83bdcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:51.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb753fff700 1 --2- 172.21.15.151:0/883371481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 0x5585c83bdcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb753fff700 1 -- 172.21.15.151:0/883371481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 msgr2=0x5585c83b84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb753fff700 1 --2- 172.21.15.151:0/883371481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83b84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb753fff700 1 -- 172.21.15.151:0/883371481 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585c8137d80 con 0x5585c83be210 2023-07-21T22:23:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.785+0000 7fb7537fe700 1 --2- 172.21.15.151:0/883371481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:23:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.786+0000 7fb753fff700 1 --2- 172.21.15.151:0/883371481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb744005740 tx=0x7fb7440975d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33549e7da390c0ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.786+0000 7fb73a7fc700 1 -- 172.21.15.151:0/883371481 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74409f020 con 0x5585c83be210 2023-07-21T22:23:51.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.786+0000 7fb73a7fc700 1 -- 172.21.15.151:0/883371481 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb74409ad00 con 0x5585c83be210 2023-07-21T22:23:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.786+0000 7fb73a7fc700 1 -- 172.21.15.151:0/883371481 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74409b420 con 0x5585c83be210 2023-07-21T22:23:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.786+0000 7fb758d9c700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb73c0a12c0 0x7fb73c0a3770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb75419c8d0 tx=0x7fb74c00b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.787+0000 7fb76e155b80 1 -- 172.21.15.151:0/883371481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 msgr2=0x5585c83b7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.787+0000 7fb76e155b80 1 --2- 172.21.15.151:0/883371481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb744005740 tx=0x7fb7440975d0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.787+0000 7fb76e155b80 1 -- 172.21.15.151:0/883371481 shutdown_connections 2023-07-21T22:23:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.787+0000 7fb76e155b80 1 --2- 172.21.15.151:0/883371481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83b84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.787+0000 7fb76e155b80 1 --2- 172.21.15.151:0/883371481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 0x5585c83bdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.787+0000 7fb76e155b80 1 --2- 172.21.15.151:0/883371481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.787+0000 7fb76e155b80 1 -- 172.21.15.151:0/883371481 >> 172.21.15.151:0/883371481 conn(0x5585c83adae0 msgr2=0x5585c83b30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.787+0000 7fb76e155b80 1 -- 172.21.15.151:0/883371481 shutdown_connections 2023-07-21T22:23:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.787+0000 7fb76e155b80 1 -- 172.21.15.151:0/883371481 wait complete. 2023-07-21T22:23:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.788+0000 7fb76e155b80 1 -- start start 2023-07-21T22:23:51.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.788+0000 7fb76e155b80 1 Processor -- start 2023-07-21T22:23:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c82146b0 0x5585c83c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be210 0x5585c83c7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83c14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb76e155b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c82a9a60 con 0x5585c83be660 2023-07-21T22:23:51.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb76e155b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c82a9760 con 0x5585c82146b0 2023-07-21T22:23:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb76e155b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c818d8c0 con 0x5585c83be210 2023-07-21T22:23:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb76e155b80 10 client.0 _ll_register_callbacks cb 0x5585c82a7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb758d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83c14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb753fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c82146b0 0x5585c83c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb758d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83c14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50902/0 (socket says 172.21.15.151:50902) 2023-07-21T22:23:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb758d9c700 1 -- 172.21.15.151:0/4167050646 learned_addr learned my addr 172.21.15.151:0/4167050646 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.789+0000 7fb7537fe700 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be210 0x5585c83c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb753fff700 1 -- 172.21.15.151:0/4167050646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be210 msgr2=0x5585c83c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb753fff700 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be210 0x5585c83c7760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb753fff700 1 -- 172.21.15.151:0/4167050646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 msgr2=0x5585c83c14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb753fff700 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83c14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb753fff700 1 -- 172.21.15.151:0/4167050646 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb754072920 con 0x5585c82146b0 2023-07-21T22:23:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb753fff700 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c82146b0 0x5585c83c7220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb74409ae70 tx=0x7fb7440cb750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8147ce2f1d45f6bd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb7337fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:23:51.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb7337fe700 1 -- 172.21.15.151:0/4167050646 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74409b620 con 0x5585c82146b0 2023-07-21T22:23:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb7337fe700 1 -- 172.21.15.151:0/4167050646 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb74409b1c0 con 0x5585c82146b0 2023-07-21T22:23:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb76e155b80 1 -- 172.21.15.151:0/4167050646 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585c8263490 con 0x5585c82146b0 2023-07-21T22:23:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb7337fe700 1 -- 172.21.15.151:0/4167050646 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb7440a3580 con 0x5585c82146b0 2023-07-21T22:23:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.790+0000 7fb76e155b80 10 client.26114 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.791+0000 7fb76e155b80 1 -- 172.21.15.151:0/4167050646 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5585c8120c00 con 0x5585c82146b0 2023-07-21T22:23:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.791+0000 7fb7337fe700 1 -- 172.21.15.151:0/4167050646 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5585c8263490 con 0x5585c82146b0 2023-07-21T22:23:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.791+0000 7fb7337fe700 1 -- 172.21.15.151:0/4167050646 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb7440cb1f0 con 0x5585c82146b0 2023-07-21T22:23:51.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.791+0000 7fb76e155b80 10 client.26114 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.791+0000 7fb76e155b80 10 client.26114 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.791+0000 7fb76e155b80 20 client.26114 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.791+0000 7fb76e155b80 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585c83d1320 0x5585c83d3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.791+0000 7fb76e155b80 4 client.26114 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:23:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.791+0000 7fb76e155b80 1 -- 172.21.15.151:0/4167050646 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585c8302e50 con 0x5585c83d1320 2023-07-21T22:23:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.792+0000 7fb7537fe700 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585c83d1320 0x5585c83d3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.792+0000 7fb7537fe700 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585c83d1320 0x5585c83d3730 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb8ef87b407e8850 server_cookie=9dd583dfe2362c31 in_seq=0 out_seq=0 2023-07-21T22:23:51.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.792+0000 7fb7337fe700 10 client.26114 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.793+0000 7fb7337fe700 1 -- 172.21.15.151:0/4167050646 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5585c8302e50 con 0x5585c83d1320 2023-07-21T22:23:51.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.793+0000 7fb7337fe700 10 client.26114 handle_command_reply: tid=0 2023-07-21T22:23:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.793+0000 7fb76e155b80 1 client.26114 shutdown 2023-07-21T22:23:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.793+0000 7fb76e155b80 1 -- 172.21.15.151:0/4167050646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c82146b0 msgr2=0x5585c83c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.793+0000 7fb76e155b80 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c82146b0 0x5585c83c7220 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb74409ae70 tx=0x7fb7440cb750 comp rx=0 tx=0).stop 2023-07-21T22:23:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb76e155b80 1 -- 172.21.15.151:0/4167050646 shutdown_connections 2023-07-21T22:23:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb76e155b80 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585c83d1320 0x5585c83d3730 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb76e155b80 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c82146b0 0x5585c83c7220 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb76e155b80 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c83c14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb76e155b80 1 --2- 172.21.15.151:0/4167050646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be210 0x5585c83c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb76e155b80 1 -- 172.21.15.151:0/4167050646 >> 172.21.15.151:0/4167050646 conn(0x5585c83adae0 msgr2=0x5585c83b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb7337fe700 0 client.26114 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb76e155b80 1 -- 172.21.15.151:0/4167050646 shutdown_connections 2023-07-21T22:23:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb76e155b80 1 -- 172.21.15.151:0/4167050646 wait complete. 2023-07-21T22:23:51.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.794+0000 7fb76e155b80 20 client.26114 trim_cache size 0 max 16384 2023-07-21T22:23:51.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.809+0000 7fb76e155b80 1 Processor -- start 2023-07-21T22:23:51.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.809+0000 7fb76e155b80 1 -- start start 2023-07-21T22:23:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c82146b0 0x5585c83c1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be660 0x5585c83b2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb76e155b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c8263490 con 0x5585c82146b0 2023-07-21T22:23:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb76e155b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c83b3cb0 con 0x5585c83be210 2023-07-21T22:23:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb76e155b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c83bf5a0 con 0x5585c83be660 2023-07-21T22:23:51.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb753fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c82146b0 0x5585c83c1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb753fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c82146b0 0x5585c83c1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50906/0 (socket says 172.21.15.151:50906) 2023-07-21T22:23:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb753fff700 1 -- 172.21.15.151:0/3521382523 learned_addr learned my addr 172.21.15.151:0/3521382523 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb7537fe700 1 --2- 172.21.15.151:0/3521382523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.810+0000 7fb758d9c700 1 --2- 172.21.15.151:0/3521382523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be660 0x5585c83b2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.811+0000 7fb753fff700 1 -- 172.21.15.151:0/3521382523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be660 msgr2=0x5585c83b2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.811+0000 7fb753fff700 1 --2- 172.21.15.151:0/3521382523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be660 0x5585c83b2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.811+0000 7fb753fff700 1 -- 172.21.15.151:0/3521382523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 msgr2=0x5585c83b7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:51.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.811+0000 7fb753fff700 1 --2- 172.21.15.151:0/3521382523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.811+0000 7fb753fff700 1 -- 172.21.15.151:0/3521382523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585c815e1f0 con 0x5585c82146b0 2023-07-21T22:23:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.811+0000 7fb753fff700 1 --2- 172.21.15.151:0/3521382523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c82146b0 0x5585c83c1490 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb7440b95d0 tx=0x7fb744021aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2db9e05558092a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.811+0000 7fb73affd700 1 -- 172.21.15.151:0/3521382523 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb74409f1f0 con 0x5585c82146b0 2023-07-21T22:23:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.811+0000 7fb73affd700 1 -- 172.21.15.151:0/3521382523 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb74409af90 con 0x5585c82146b0 2023-07-21T22:23:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.811+0000 7fb73affd700 1 -- 172.21.15.151:0/3521382523 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440a3350 con 0x5585c82146b0 2023-07-21T22:23:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 -- 172.21.15.151:0/3521382523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c82146b0 msgr2=0x5585c83c1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:51.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3521382523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c82146b0 0x5585c83c1490 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fb7440b95d0 tx=0x7fb744021aa0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 -- 172.21.15.151:0/3521382523 shutdown_connections 2023-07-21T22:23:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3521382523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c83be660 0x5585c83b2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3521382523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c82146b0 0x5585c83c1490 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3521382523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c83b7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 -- 172.21.15.151:0/3521382523 >> 172.21.15.151:0/3521382523 conn(0x5585c83adae0 msgr2=0x5585c83c0d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 -- 172.21.15.151:0/3521382523 shutdown_connections 2023-07-21T22:23:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 -- 172.21.15.151:0/3521382523 wait complete. 2023-07-21T22:23:51.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.812+0000 7fb76e155b80 1 -- start start 2023-07-21T22:23:51.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.813+0000 7fb76e155b80 1 Processor -- start 2023-07-21T22:23:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.813+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 0x5585c8419130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.813+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c8419670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.813+0000 7fb76e155b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c8419bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.813+0000 7fb76e155b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c84242a0 con 0x5585c83be660 2023-07-21T22:23:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.813+0000 7fb76e155b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c84243e0 con 0x5585c83be210 2023-07-21T22:23:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.813+0000 7fb76e155b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585c84245a0 con 0x5585c82146b0 2023-07-21T22:23:51.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.813+0000 7fb76e155b80 10 client.0 _ll_register_callbacks cb 0x5585c82a7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:23:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb758d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c8419bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb758d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c8419bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50910/0 (socket says 172.21.15.151:50910) 2023-07-21T22:23:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb758d9c700 1 -- 172.21.15.151:0/3332283578 learned_addr learned my addr 172.21.15.151:0/3332283578 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:23:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb753fff700 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 0x5585c8419130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb7537fe700 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c8419670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb753fff700 1 -- 172.21.15.151:0/3332283578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 msgr2=0x5585c8419670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:51.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb753fff700 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c8419670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb753fff700 1 -- 172.21.15.151:0/3332283578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 msgr2=0x5585c8419bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:23:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb753fff700 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c8419bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb753fff700 1 -- 172.21.15.151:0/3332283578 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585c8120c00 con 0x5585c82146b0 2023-07-21T22:23:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb7537fe700 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c8419670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:23:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb758d9c700 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c8419bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:23:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb753fff700 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 0x5585c8419130 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb7440b95d0 tx=0x7fb7440cb5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bd44aed8db68588 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:23:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.814+0000 7fb7337fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:23:51.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb7337fe700 1 -- 172.21.15.151:0/3332283578 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7440a3580 con 0x5585c82146b0 2023-07-21T22:23:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb7337fe700 1 -- 172.21.15.151:0/3332283578 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fb7440a3300 con 0x5585c82146b0 2023-07-21T22:23:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb76e155b80 1 -- 172.21.15.151:0/3332283578 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb74409ad00 con 0x5585c82146b0 2023-07-21T22:23:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb7337fe700 1 -- 172.21.15.151:0/3332283578 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb74409b420 con 0x5585c82146b0 2023-07-21T22:23:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb76e155b80 10 client.26143 fetch_fsmap learned FSMap version 31 2023-07-21T22:23:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb76e155b80 1 -- 172.21.15.151:0/3332283578 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) v3 -- 0x5585c8136250 con 0x5585c82146b0 2023-07-21T22:23:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb7337fe700 1 -- 172.21.15.151:0/3332283578 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb74409ad00 con 0x5585c82146b0 2023-07-21T22:23:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb7337fe700 1 -- 172.21.15.151:0/3332283578 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 31) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb74400fac0 con 0x5585c82146b0 2023-07-21T22:23:51.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb76e155b80 10 client.26143 fetch_fsmap finished waiting for FSMap version 31 2023-07-21T22:23:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb76e155b80 10 client.26143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:23:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb76e155b80 20 client.26143 populate_metadata read hostname 'smithi151' 2023-07-21T22:23:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585c8425800 0x5585c8427be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:23:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb76e155b80 4 client.26143 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:23:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.815+0000 7fb76e155b80 1 -- 172.21.15.151:0/3332283578 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5585c82c4ff0 con 0x5585c8425800 2023-07-21T22:23:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.816+0000 7fb7537fe700 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585c8425800 0x5585c8427be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:23:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.816+0000 7fb7337fe700 10 client.26143 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:51.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.816+0000 7fb7537fe700 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585c8425800 0x5585c8427be0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1be67512fe86eec3 server_cookie=d7cc527bef48367 in_seq=0 out_seq=0 2023-07-21T22:23:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.829+0000 7fb7337fe700 1 -- 172.21.15.151:0/3332283578 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5585c82c4ff0 con 0x5585c8425800 2023-07-21T22:23:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.829+0000 7fb7337fe700 10 client.26143 handle_command_reply: tid=0 2023-07-21T22:23:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.829+0000 7fb76e155b80 1 client.26143 shutdown 2023-07-21T22:23:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.829+0000 7fb76e155b80 1 -- 172.21.15.151:0/3332283578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 msgr2=0x5585c8419130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:51.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.829+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 0x5585c8419130 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb7440b95d0 tx=0x7fb7440cb5c0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb76e155b80 1 -- 172.21.15.151:0/3332283578 shutdown_connections 2023-07-21T22:23:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585c8425800 0x5585c8427be0 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585c83be660 0x5585c8419bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585c82146b0 0x5585c8419130 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb76e155b80 1 --2- 172.21.15.151:0/3332283578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585c83be210 0x5585c8419670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb7337fe700 0 client.26143 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:23:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb76e155b80 1 -- 172.21.15.151:0/3332283578 >> 172.21.15.151:0/3332283578 conn(0x5585c83adae0 msgr2=0x5585c83bce70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb76e155b80 1 -- 172.21.15.151:0/3332283578 shutdown_connections 2023-07-21T22:23:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb76e155b80 1 -- 172.21.15.151:0/3332283578 wait complete. 2023-07-21T22:23:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.830+0000 7fb76e155b80 20 client.26143 trim_cache size 0 max 16384 2023-07-21T22:23:51.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:23:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:23:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:23:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:23:51.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 -- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb73c0a12c0 msgr2=0x7fb73c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb73c0a12c0 0x7fb73c0a3770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fb75419c8d0 tx=0x7fb74c00b040 comp rx=0 tx=0).stop 2023-07-21T22:23:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 -- 172.21.15.151:0/3029848516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ffb00 msgr2=0x7fb75419bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:23:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ffb00 0x7fb75419bbd0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb744005770 tx=0x7fb7440057a0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 -- 172.21.15.151:0/3029848516 shutdown_connections 2023-07-21T22:23:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb73c0a12c0 0x7fb73c0a3770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb754105b10 0x7fb754195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7540ffb00 0x7fb75419bbd0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 --2- 172.21.15.151:0/3029848516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7541004b0 0x7fb75419c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:23:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 -- 172.21.15.151:0/3029848516 >> 172.21.15.151:0/3029848516 conn(0x7fb7540fb600 msgr2=0x7fb7540fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:23:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 -- 172.21.15.151:0/3029848516 shutdown_connections 2023-07-21T22:23:51.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:23:51.831+0000 7fb75a7ff700 1 -- 172.21.15.151:0/3029848516 wait complete. 2023-07-21T22:23:52.019 INFO:teuthology.orchestra.run.smithi151.stderr:18200000 of 50000000 tuples (36%) done (elapsed 255.51 s, remaining 446.44 s) 2023-07-21T22:23:52.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:52 smithi187 ceph-mon[96918]: pgmap v143: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:23:52.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:52 smithi195 ceph-mon[97365]: pgmap v143: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:23:52.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:52 smithi151 ceph-mon[95510]: pgmap v143: 97 pgs: 97 active+clean; 4.1 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:23:53.255 INFO:teuthology.orchestra.run.smithi151.stderr:18300000 of 50000000 tuples (36%) done (elapsed 256.75 s, remaining 444.75 s) 2023-07-21T22:23:54.602 INFO:teuthology.orchestra.run.smithi151.stderr:18400000 of 50000000 tuples (36%) done (elapsed 258.09 s, remaining 443.25 s) 2023-07-21T22:23:54.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:54 smithi187 ceph-mon[96918]: pgmap v144: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:23:54.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:54 smithi195 ceph-mon[97365]: pgmap v144: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:23:54.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:54 smithi151 ceph-mon[95510]: pgmap v144: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:23:55.834 INFO:teuthology.orchestra.run.smithi151.stderr:18500000 of 50000000 tuples (37%) done (elapsed 259.33 s, remaining 441.55 s) 2023-07-21T22:23:56.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:56 smithi187 ceph-mon[96918]: pgmap v145: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 23 MiB/s wr, 78 op/s 2023-07-21T22:23:56.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:56 smithi195 ceph-mon[97365]: pgmap v145: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 23 MiB/s wr, 78 op/s 2023-07-21T22:23:56.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:56 smithi151 ceph-mon[95510]: pgmap v145: 97 pgs: 97 active+clean; 4.2 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 23 MiB/s wr, 78 op/s 2023-07-21T22:23:57.123 INFO:teuthology.orchestra.run.smithi151.stderr:18600000 of 50000000 tuples (37%) done (elapsed 260.61 s, remaining 439.96 s) 2023-07-21T22:23:58.474 INFO:teuthology.orchestra.run.smithi151.stderr:18700000 of 50000000 tuples (37%) done (elapsed 261.97 s, remaining 438.48 s) 2023-07-21T22:23:58.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:23:58 smithi187 ceph-mon[96918]: pgmap v146: 97 pgs: 97 active+clean; 4.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 35 MiB/s wr, 101 op/s 2023-07-21T22:23:58.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:23:58 smithi195 ceph-mon[97365]: pgmap v146: 97 pgs: 97 active+clean; 4.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 35 MiB/s wr, 101 op/s 2023-07-21T22:23:58.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:23:58 smithi151 ceph-mon[95510]: pgmap v146: 97 pgs: 97 active+clean; 4.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 35 MiB/s wr, 101 op/s 2023-07-21T22:23:59.806 INFO:teuthology.orchestra.run.smithi151.stderr:18800000 of 50000000 tuples (37%) done (elapsed 263.30 s, remaining 436.96 s) 2023-07-21T22:24:00.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:00 smithi187 ceph-mon[96918]: pgmap v147: 97 pgs: 97 active+clean; 4.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:24:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:00 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:24:00.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:00 smithi195 ceph-mon[97365]: pgmap v147: 97 pgs: 97 active+clean; 4.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:24:00.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:00 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:24:00.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:00 smithi151 ceph-mon[95510]: pgmap v147: 97 pgs: 97 active+clean; 4.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:24:00.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:00 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:24:01.068 INFO:teuthology.orchestra.run.smithi151.stderr:18900000 of 50000000 tuples (37%) done (elapsed 264.56 s, remaining 435.33 s) 2023-07-21T22:24:02.300 INFO:teuthology.orchestra.run.smithi151.stderr:19000000 of 50000000 tuples (38%) done (elapsed 265.79 s, remaining 433.66 s) 2023-07-21T22:24:02.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:02 smithi187 ceph-mon[96918]: pgmap v148: 97 pgs: 97 active+clean; 4.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:24:02.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:02 smithi195 ceph-mon[97365]: pgmap v148: 97 pgs: 97 active+clean; 4.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:24:02.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:02 smithi151 ceph-mon[95510]: pgmap v148: 97 pgs: 97 active+clean; 4.3 GiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:24:03.608 INFO:teuthology.orchestra.run.smithi151.stderr:19100000 of 50000000 tuples (38%) done (elapsed 267.10 s, remaining 432.11 s) 2023-07-21T22:24:04.817 INFO:teuthology.orchestra.run.smithi151.stderr:19200000 of 50000000 tuples (38%) done (elapsed 268.31 s, remaining 430.41 s) 2023-07-21T22:24:04.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:04 smithi187 ceph-mon[96918]: pgmap v149: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 35 MiB/s wr, 94 op/s 2023-07-21T22:24:04.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:04 smithi195 ceph-mon[97365]: pgmap v149: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 35 MiB/s wr, 94 op/s 2023-07-21T22:24:04.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:04 smithi151 ceph-mon[95510]: pgmap v149: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 35 MiB/s wr, 94 op/s 2023-07-21T22:24:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.002+0000 7f53df3ff700 1 -- 172.21.15.151:0/823236584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8102970 msgr2=0x7f53d8106930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.002+0000 7f53df3ff700 1 --2- 172.21.15.151:0/823236584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8102970 0x7f53d8106930 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f53c80099c0 tx=0x7f53c8009cd0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.002+0000 7f53df3ff700 1 -- 172.21.15.151:0/823236584 shutdown_connections 2023-07-21T22:24:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.002+0000 7f53df3ff700 1 --2- 172.21.15.151:0/823236584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53d8101fd0 0x7f53d81023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.002+0000 7f53df3ff700 1 --2- 172.21.15.151:0/823236584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d8107010 0x7f53d810ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.002+0000 7f53df3ff700 1 --2- 172.21.15.151:0/823236584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8102970 0x7f53d8106930 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.002+0000 7f53df3ff700 1 -- 172.21.15.151:0/823236584 >> 172.21.15.151:0/823236584 conn(0x7f53d80fd840 msgr2=0x7f53d80ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.002+0000 7f53df3ff700 1 -- 172.21.15.151:0/823236584 shutdown_connections 2023-07-21T22:24:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.002+0000 7f53df3ff700 1 -- 172.21.15.151:0/823236584 wait complete. 2023-07-21T22:24:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53df3ff700 1 Processor -- start 2023-07-21T22:24:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53df3ff700 1 -- start start 2023-07-21T22:24:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53df3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d8101fd0 0x7f53d8197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53df3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53d8102970 0x7f53d81982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53df3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8107010 0x7f53d819c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53df3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d819cf50 con 0x7f53d8107010 2023-07-21T22:24:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53df3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d819d0c0 con 0x7f53d8102970 2023-07-21T22:24:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53df3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53d819d280 con 0x7f53d8101fd0 2023-07-21T22:24:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53dd99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8107010 0x7f53d819c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53dd99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8107010 0x7f53d819c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33336/0 (socket says 172.21.15.151:33336) 2023-07-21T22:24:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.004+0000 7f53dd99c700 1 -- 172.21.15.151:0/2113982894 learned_addr learned my addr 172.21.15.151:0/2113982894 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.005+0000 7f53dd19b700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d8101fd0 0x7f53d8197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.005+0000 7f53dc99a700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53d8102970 0x7f53d81982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.005+0000 7f53dd99c700 1 -- 172.21.15.151:0/2113982894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d8101fd0 msgr2=0x7f53d8197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.005+0000 7f53dd99c700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d8101fd0 0x7f53d8197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.005+0000 7f53dd99c700 1 -- 172.21.15.151:0/2113982894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53d8102970 msgr2=0x7f53d81982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.005+0000 7f53dd99c700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53d8102970 0x7f53d81982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.005+0000 7f53dd99c700 1 -- 172.21.15.151:0/2113982894 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c80095f0 con 0x7f53d8107010 2023-07-21T22:24:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.005+0000 7f53dd99c700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8107010 0x7f53d819c910 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f53d0007ee0 tx=0x7f53d000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.005+0000 7f53ce7fc700 1 -- 172.21.15.151:0/2113982894 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0017070 con 0x7f53d8107010 2023-07-21T22:24:05.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.006+0000 7f53ce7fc700 1 -- 172.21.15.151:0/2113982894 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53d000f040 con 0x7f53d8107010 2023-07-21T22:24:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.006+0000 7f53df3ff700 1 -- 172.21.15.151:0/2113982894 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d819d560 con 0x7f53d8107010 2023-07-21T22:24:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.006+0000 7f53ce7fc700 1 -- 172.21.15.151:0/2113982894 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0005570 con 0x7f53d8107010 2023-07-21T22:24:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.006+0000 7f53df3ff700 1 -- 172.21.15.151:0/2113982894 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d81a4da0 con 0x7f53d8107010 2023-07-21T22:24:05.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.009+0000 7f53ce7fc700 1 -- 172.21.15.151:0/2113982894 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f53d000db20 con 0x7f53d8107010 2023-07-21T22:24:05.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.010+0000 7f53ce7fc700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f53c40a12c0 0x7f53c40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.011+0000 7f53ce7fc700 1 -- 172.21.15.151:0/2113982894 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f53d00cc410 con 0x7f53d8107010 2023-07-21T22:24:05.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.011+0000 7f53dd19b700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f53c40a12c0 0x7f53c40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.011+0000 7f53f2d91b80 1 Processor -- start 2023-07-21T22:24:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.011+0000 7f53f2d91b80 1 -- start start 2023-07-21T22:24:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53dd19b700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f53c40a12c0 0x7f53c40a3770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53d400ac50 tx=0x7f53d400a380 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 0x5569b7295cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 0x5569b728ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72904a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b7195c50 con 0x5569b7296660 2023-07-21T22:24:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b71e89e0 con 0x5569b70ec6b0 2023-07-21T22:24:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b71e1e70 con 0x5569b7296210 2023-07-21T22:24:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53dd99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72904a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53dd99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72904a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33342/0 (socket says 172.21.15.151:33342) 2023-07-21T22:24:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53dd99c700 1 -- 172.21.15.151:0/4288137966 learned_addr learned my addr 172.21.15.151:0/4288137966 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53dc99a700 1 --2- 172.21.15.151:0/4288137966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 0x5569b728ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53dd19b700 1 --2- 172.21.15.151:0/4288137966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 0x5569b7295cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53dd99c700 1 -- 172.21.15.151:0/4288137966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 msgr2=0x5569b728ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53dd99c700 1 --2- 172.21.15.151:0/4288137966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 0x5569b728ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.012+0000 7f53dd99c700 1 -- 172.21.15.151:0/4288137966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 msgr2=0x5569b7295cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.013+0000 7f53dd99c700 1 --2- 172.21.15.151:0/4288137966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 0x5569b7295cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.013+0000 7f53dd99c700 1 -- 172.21.15.151:0/4288137966 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569b700fd80 con 0x5569b7296660 2023-07-21T22:24:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.013+0000 7f53dd99c700 1 --2- 172.21.15.151:0/4288137966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72904a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f53d00959f0 tx=0x7f53d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9a6ad13d4f37d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.013+0000 7f53c37fe700 1 -- 172.21.15.151:0/4288137966 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0004c40 con 0x5569b7296660 2023-07-21T22:24:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.013+0000 7f53c37fe700 1 -- 172.21.15.151:0/4288137966 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53d000ddd0 con 0x5569b7296660 2023-07-21T22:24:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.013+0000 7f53c37fe700 1 -- 172.21.15.151:0/4288137966 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d0095c00 con 0x5569b7296660 2023-07-21T22:24:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.014+0000 7f53f2d91b80 1 -- 172.21.15.151:0/4288137966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 msgr2=0x5569b72904a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.014+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/4288137966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72904a0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f53d00959f0 tx=0x7f53d0004ad0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.014+0000 7f53f2d91b80 1 -- 172.21.15.151:0/4288137966 shutdown_connections 2023-07-21T22:24:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.014+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/4288137966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 0x5569b7295cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.014+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/4288137966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72904a0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.014+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/4288137966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 0x5569b728ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.014+0000 7f53f2d91b80 1 -- 172.21.15.151:0/4288137966 >> 172.21.15.151:0/4288137966 conn(0x5569b7285ae0 msgr2=0x5569b728b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.014+0000 7f53f2d91b80 1 -- 172.21.15.151:0/4288137966 shutdown_connections 2023-07-21T22:24:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.014+0000 7f53f2d91b80 1 -- 172.21.15.151:0/4288137966 wait complete. 2023-07-21T22:24:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.015+0000 7f53f2d91b80 1 -- start start 2023-07-21T22:24:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.015+0000 7f53f2d91b80 1 Processor -- start 2023-07-21T22:24:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.015+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 0x5569b729f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.015+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 0x5569b729fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.015+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72997f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.015+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b7181a60 con 0x5569b7296660 2023-07-21T22:24:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.015+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b7181760 con 0x5569b70ec6b0 2023-07-21T22:24:05.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.015+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b70658c0 con 0x5569b7296210 2023-07-21T22:24:05.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53f2d91b80 10 client.0 _ll_register_callbacks cb 0x5569b717f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:05.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dd19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 0x5569b729f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dd19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 0x5569b729f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37188/0 (socket says 172.21.15.151:37188) 2023-07-21T22:24:05.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dd19b700 1 -- 172.21.15.151:0/2468250003 learned_addr learned my addr 172.21.15.151:0/2468250003 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:05.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dd99c700 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72997f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dc99a700 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 0x5569b729fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dd99c700 1 -- 172.21.15.151:0/2468250003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 msgr2=0x5569b729fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:05.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dd99c700 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 0x5569b729fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dd99c700 1 -- 172.21.15.151:0/2468250003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 msgr2=0x5569b729f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:05.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dd99c700 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 0x5569b729f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.016+0000 7f53dd99c700 1 -- 172.21.15.151:0/2468250003 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d81a4da0 con 0x5569b7296660 2023-07-21T22:24:05.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.017+0000 7f53dd99c700 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72997f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f53d0095f60 tx=0x7f53d00ca020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dde8aec436bf0a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.017+0000 7f53c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.017+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2468250003 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d00994f0 con 0x5569b7296660 2023-07-21T22:24:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.017+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2468250003 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f53d00a1940 con 0x5569b7296660 2023-07-21T22:24:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.017+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2468250003 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5569b713b490 con 0x5569b7296660 2023-07-21T22:24:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.017+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2468250003 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53d009d520 con 0x5569b7296660 2023-07-21T22:24:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.017+0000 7f53f2d91b80 10 client.16389 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:05.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.017+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2468250003 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5569b6ff8c00 con 0x5569b7296660 2023-07-21T22:24:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.018+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2468250003 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5569b713b490 con 0x5569b7296660 2023-07-21T22:24:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.018+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2468250003 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f53d00c3d20 con 0x5569b7296660 2023-07-21T22:24:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.018+0000 7f53f2d91b80 10 client.16389 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.018+0000 7f53f2d91b80 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.018+0000 7f53f2d91b80 20 client.16389 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.018+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b72a9730 0x5569b72abb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.018+0000 7f53f2d91b80 4 client.16389 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.018+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2468250003 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5569b71dae50 con 0x5569b72a9730 2023-07-21T22:24:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.019+0000 7f53dd19b700 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b72a9730 0x5569b72abb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.019+0000 7f53dd19b700 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b72a9730 0x5569b72abb10 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7985393e4ccf4c76 server_cookie=3d02ed5ca24ff5c4 in_seq=0 out_seq=0 2023-07-21T22:24:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.019+0000 7f53c0ff9700 10 client.16389 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2468250003 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5569b71dae50 con 0x5569b72a9730 2023-07-21T22:24:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53c0ff9700 10 client.16389 handle_command_reply: tid=0 2023-07-21T22:24:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53f2d91b80 1 client.16389 shutdown 2023-07-21T22:24:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2468250003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 msgr2=0x5569b72997f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72997f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f53d0095f60 tx=0x7f53d00ca020 comp rx=0 tx=0).stop 2023-07-21T22:24:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2468250003 shutdown_connections 2023-07-21T22:24:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b72a9730 0x5569b72abb10 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b70ec6b0 0x5569b729f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b72997f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2468250003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296210 0x5569b729fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2468250003 >> 172.21.15.151:0/2468250003 conn(0x5569b7285ae0 msgr2=0x5569b728a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.020+0000 7f53c0ff9700 0 client.16389 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.021+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2468250003 shutdown_connections 2023-07-21T22:24:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.021+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2468250003 wait complete. 2023-07-21T22:24:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.021+0000 7f53f2d91b80 20 client.16389 trim_cache size 0 max 16384 2023-07-21T22:24:05.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.039+0000 7f53f2d91b80 1 Processor -- start 2023-07-21T22:24:05.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.039+0000 7f53f2d91b80 1 -- start start 2023-07-21T22:24:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.039+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b70ec6b0 0x5569b729fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.039+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b728ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.039+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b728ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.039+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b7287c00 con 0x5569b7296660 2023-07-21T22:24:05.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.039+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b728c5d0 con 0x5569b7296210 2023-07-21T22:24:05.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.039+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b72874f0 con 0x5569b70ec6b0 2023-07-21T22:24:05.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dd99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b728ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dc99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b728ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dd19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b70ec6b0 0x5569b729fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dc99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b728ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37190/0 (socket says 172.21.15.151:37190) 2023-07-21T22:24:05.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dc99a700 1 -- 172.21.15.151:0/517704189 learned_addr learned my addr 172.21.15.151:0/517704189 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:05.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dc99a700 1 -- 172.21.15.151:0/517704189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b70ec6b0 msgr2=0x5569b729fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:05.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dc99a700 1 --2- 172.21.15.151:0/517704189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b70ec6b0 0x5569b729fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dc99a700 1 -- 172.21.15.151:0/517704189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 msgr2=0x5569b728ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dc99a700 1 --2- 172.21.15.151:0/517704189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b728ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dc99a700 1 -- 172.21.15.151:0/517704189 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569b70361f0 con 0x5569b7296210 2023-07-21T22:24:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dd19b700 1 --2- 172.21.15.151:0/517704189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b70ec6b0 0x5569b729fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.040+0000 7f53dd99c700 1 --2- 172.21.15.151:0/517704189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b728ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:05.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.041+0000 7f53dc99a700 1 --2- 172.21.15.151:0/517704189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b728ff40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53c800b580 tx=0x7f53c8009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b90568aac0228d68 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.041+0000 7f53c3fff700 1 -- 172.21.15.151:0/517704189 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c801d030 con 0x5569b7296210 2023-07-21T22:24:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.041+0000 7f53c3fff700 1 -- 172.21.15.151:0/517704189 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53c801e040 con 0x5569b7296210 2023-07-21T22:24:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.041+0000 7f53c3fff700 1 -- 172.21.15.151:0/517704189 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c8004880 con 0x5569b7296210 2023-07-21T22:24:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 -- 172.21.15.151:0/517704189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 msgr2=0x5569b728ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/517704189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b728ff40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f53c800b580 tx=0x7f53c8009f10 comp rx=0 tx=0).stop 2023-07-21T22:24:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 -- 172.21.15.151:0/517704189 shutdown_connections 2023-07-21T22:24:05.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/517704189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b7296660 0x5569b728ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/517704189 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b70ec6b0 0x5569b729fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/517704189 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b728ff40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 -- 172.21.15.151:0/517704189 >> 172.21.15.151:0/517704189 conn(0x5569b7285ae0 msgr2=0x5569b729f320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 -- 172.21.15.151:0/517704189 shutdown_connections 2023-07-21T22:24:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 -- 172.21.15.151:0/517704189 wait complete. 2023-07-21T22:24:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.042+0000 7f53f2d91b80 1 -- start start 2023-07-21T22:24:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.043+0000 7f53f2d91b80 1 Processor -- start 2023-07-21T22:24:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.043+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b70ec6b0 0x5569b72a2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.043+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b72a2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53f2d91b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296660 0x5569b72fc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b72fcaf0 con 0x5569b70ec6b0 2023-07-21T22:24:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b72fcc30 con 0x5569b7296210 2023-07-21T22:24:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53f2d91b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b72fcdf0 con 0x5569b7296660 2023-07-21T22:24:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53f2d91b80 10 client.0 _ll_register_callbacks cb 0x7f53c8009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dd19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b70ec6b0 0x5569b72a2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dd19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b70ec6b0 0x5569b72a2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33376/0 (socket says 172.21.15.151:33376) 2023-07-21T22:24:05.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dd19b700 1 -- 172.21.15.151:0/2141967716 learned_addr learned my addr 172.21.15.151:0/2141967716 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dd99c700 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296660 0x5569b72fc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dc99a700 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b72a2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dd19b700 1 -- 172.21.15.151:0/2141967716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296660 msgr2=0x5569b72fc5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dd19b700 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296660 0x5569b72fc5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dd19b700 1 -- 172.21.15.151:0/2141967716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 msgr2=0x5569b72a2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dd19b700 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b72a2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dd19b700 1 -- 172.21.15.151:0/2141967716 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53d400fe80 con 0x5569b70ec6b0 2023-07-21T22:24:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.044+0000 7f53dc99a700 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b72a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:24:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.045+0000 7f53dd19b700 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b70ec6b0 0x5569b72a2450 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f53d4010010 tx=0x7f53d4012070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84a04d405de06815 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.045+0000 7f53c0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.045+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2141967716 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53d4026040 con 0x5569b70ec6b0 2023-07-21T22:24:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.045+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2141967716 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f53d000ddd0 con 0x5569b70ec6b0 2023-07-21T22:24:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.045+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2141967716 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f53d40261a0 con 0x5569b70ec6b0 2023-07-21T22:24:05.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.045+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2141967716 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f53d4026360 con 0x5569b70ec6b0 2023-07-21T22:24:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.045+0000 7f53f2d91b80 10 client.16395 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.045+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2141967716 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5569b6ff8c00 con 0x5569b70ec6b0 2023-07-21T22:24:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.045+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2141967716 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f53d000ddd0 con 0x5569b70ec6b0 2023-07-21T22:24:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.046+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2141967716 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f53d40375c0 con 0x5569b70ec6b0 2023-07-21T22:24:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.046+0000 7f53f2d91b80 10 client.16395 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.046+0000 7f53f2d91b80 10 client.16395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.046+0000 7f53f2d91b80 20 client.16395 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:05.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.046+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b72fe5a0 0x5569b73009b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.046+0000 7f53f2d91b80 4 client.16395 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:24:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.046+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2141967716 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5569b719cff0 con 0x5569b72fe5a0 2023-07-21T22:24:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.046+0000 7f53dc99a700 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b72fe5a0 0x5569b73009b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.047+0000 7f53dc99a700 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b72fe5a0 0x5569b73009b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f8d1de68517d9512 server_cookie=cb421b41151184c5 in_seq=0 out_seq=0 2023-07-21T22:24:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.047+0000 7f53c0ff9700 10 client.16395 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.215+0000 7f53c0ff9700 1 -- 172.21.15.151:0/2141967716 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5569b719cff0 con 0x5569b72fe5a0 2023-07-21T22:24:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.215+0000 7f53c0ff9700 10 client.16395 handle_command_reply: tid=0 2023-07-21T22:24:05.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.215+0000 7f53f2d91b80 1 client.16395 shutdown 2023-07-21T22:24:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2141967716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b70ec6b0 msgr2=0x5569b72a2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b70ec6b0 0x5569b72a2450 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f53d4010010 tx=0x7f53d4012070 comp rx=0 tx=0).stop 2023-07-21T22:24:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2141967716 shutdown_connections 2023-07-21T22:24:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b72fe5a0 0x5569b73009b0 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b7296660 0x5569b72fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b70ec6b0 0x5569b72a2450 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53c0ff9700 0 client.16395 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 --2- 172.21.15.151:0/2141967716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b7296210 0x5569b72a2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2141967716 >> 172.21.15.151:0/2141967716 conn(0x5569b7285ae0 msgr2=0x5569b7296a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2141967716 shutdown_connections 2023-07-21T22:24:05.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 1 -- 172.21.15.151:0/2141967716 wait complete. 2023-07-21T22:24:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.216+0000 7f53f2d91b80 20 client.16395 trim_cache size 0 max 16384 2023-07-21T22:24:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:24:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:24:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:24:05.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:24:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 -- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f53c40a12c0 msgr2=0x7f53c40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f53c40a12c0 0x7f53c40a3770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f53d400ac50 tx=0x7f53d400a380 comp rx=0 tx=0).stop 2023-07-21T22:24:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 -- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8107010 msgr2=0x7f53d819c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:05.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8107010 0x7f53d819c910 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f53d0007ee0 tx=0x7f53d000d3b0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 -- 172.21.15.151:0/2113982894 shutdown_connections 2023-07-21T22:24:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f53c40a12c0 0x7f53c40a3770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53d8107010 0x7f53d819c910 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f53d8101fd0 0x7f53d8197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 --2- 172.21.15.151:0/2113982894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53d8102970 0x7f53d81982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 -- 172.21.15.151:0/2113982894 >> 172.21.15.151:0/2113982894 conn(0x7f53d80fd840 msgr2=0x7f53d80fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 -- 172.21.15.151:0/2113982894 shutdown_connections 2023-07-21T22:24:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:05.217+0000 7f53df3ff700 1 -- 172.21.15.151:0/2113982894 wait complete. 2023-07-21T22:24:05.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:05 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:24:05.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:05 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:24:05.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:05 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:24:06.160 INFO:teuthology.orchestra.run.smithi151.stderr:19300000 of 50000000 tuples (38%) done (elapsed 269.65 s, remaining 428.93 s) 2023-07-21T22:24:06.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:06 smithi187 ceph-mon[96918]: pgmap v150: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 23 MiB/s wr, 66 op/s 2023-07-21T22:24:06.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:06 smithi195 ceph-mon[97365]: pgmap v150: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 23 MiB/s wr, 66 op/s 2023-07-21T22:24:06.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:06 smithi151 ceph-mon[95510]: pgmap v150: 97 pgs: 97 active+clean; 4.4 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 23 MiB/s wr, 66 op/s 2023-07-21T22:24:07.359 INFO:teuthology.orchestra.run.smithi151.stderr:19400000 of 50000000 tuples (38%) done (elapsed 270.85 s, remaining 427.22 s) 2023-07-21T22:24:08.680 INFO:teuthology.orchestra.run.smithi151.stderr:19500000 of 50000000 tuples (39%) done (elapsed 272.17 s, remaining 425.70 s) 2023-07-21T22:24:08.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:08 smithi187 ceph-mon[96918]: pgmap v151: 97 pgs: 97 active+clean; 4.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 35 MiB/s wr, 221 op/s 2023-07-21T22:24:08.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:08 smithi195 ceph-mon[97365]: pgmap v151: 97 pgs: 97 active+clean; 4.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 35 MiB/s wr, 221 op/s 2023-07-21T22:24:08.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:08 smithi151 ceph-mon[95510]: pgmap v151: 97 pgs: 97 active+clean; 4.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 35 MiB/s wr, 221 op/s 2023-07-21T22:24:09.894 INFO:teuthology.orchestra.run.smithi151.stderr:19600000 of 50000000 tuples (39%) done (elapsed 273.39 s, remaining 424.03 s) 2023-07-21T22:24:10.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:10 smithi187 ceph-mon[96918]: pgmap v152: 97 pgs: 97 active+clean; 4.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 198 op/s 2023-07-21T22:24:10.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:10 smithi195 ceph-mon[97365]: pgmap v152: 97 pgs: 97 active+clean; 4.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 198 op/s 2023-07-21T22:24:10.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:10 smithi151 ceph-mon[95510]: pgmap v152: 97 pgs: 97 active+clean; 4.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 198 op/s 2023-07-21T22:24:11.151 INFO:teuthology.orchestra.run.smithi151.stderr:19700000 of 50000000 tuples (39%) done (elapsed 274.64 s, remaining 422.42 s) 2023-07-21T22:24:12.490 INFO:teuthology.orchestra.run.smithi151.stderr:19800000 of 50000000 tuples (39%) done (elapsed 275.98 s, remaining 420.94 s) 2023-07-21T22:24:12.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:12 smithi187 ceph-mon[96918]: pgmap v153: 97 pgs: 97 active+clean; 4.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 198 op/s 2023-07-21T22:24:12.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:12 smithi195 ceph-mon[97365]: pgmap v153: 97 pgs: 97 active+clean; 4.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 198 op/s 2023-07-21T22:24:12.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:12 smithi151 ceph-mon[95510]: pgmap v153: 97 pgs: 97 active+clean; 4.5 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 23 MiB/s wr, 198 op/s 2023-07-21T22:24:13.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:24:13.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.645+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/2852527954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 msgr2=0x7f6fc40fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.645+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/2852527954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 0x7f6fc40fff50 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009990 tx=0x7f6fb4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.645+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/2852527954 shutdown_connections 2023-07-21T22:24:13.691 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.645+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/2852527954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc4100490 0x7f6fc410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.645+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/2852527954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc4105af0 0x7f6fc4105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.645+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/2852527954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 0x7f6fc40fff50 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.645+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/2852527954 >> 172.21.15.151:0/2852527954 conn(0x7f6fc40fb5e0 msgr2=0x7f6fc40fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:13.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.645+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/2852527954 shutdown_connections 2023-07-21T22:24:13.692 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.645+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/2852527954 wait complete. 2023-07-21T22:24:13.693 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.647+0000 7f6fcb5ff700 1 Processor -- start 2023-07-21T22:24:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.647+0000 7f6fcb5ff700 1 -- start start 2023-07-21T22:24:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.647+0000 7f6fcb5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 0x7f6fc419b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.647+0000 7f6fcb5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc4100490 0x7f6fc419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.647+0000 7f6fcb5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc4105af0 0x7f6fc41958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.647+0000 7f6fcb5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4195f60 con 0x7f6fc40ffae0 2023-07-21T22:24:13.694 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.647+0000 7f6fcb5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc41960d0 con 0x7f6fc4100490 2023-07-21T22:24:13.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.647+0000 7f6fcb5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc4196290 con 0x7f6fc4105af0 2023-07-21T22:24:13.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc939b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 0x7f6fc419b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc939b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 0x7f6fc419b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45118/0 (socket says 172.21.15.151:45118) 2023-07-21T22:24:13.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc939b700 1 -- 172.21.15.151:0/3046053274 learned_addr learned my addr 172.21.15.151:0/3046053274 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:13.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc4100490 0x7f6fc419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc4105af0 0x7f6fc41958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.695 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc939b700 1 -- 172.21.15.151:0/3046053274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc4105af0 msgr2=0x7f6fc41958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc939b700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc4105af0 0x7f6fc41958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc939b700 1 -- 172.21.15.151:0/3046053274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc4100490 msgr2=0x7f6fc419bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc939b700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc4100490 0x7f6fc419bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc939b700 1 -- 172.21.15.151:0/3046053274 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb40095f0 con 0x7f6fc40ffae0 2023-07-21T22:24:13.696 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.648+0000 7f6fc939b700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 0x7f6fc419b880 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000e9a0 tx=0x7f6fc000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:13.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.649+0000 7f6fba7fc700 1 -- 172.21.15.151:0/3046053274 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0009790 con 0x7f6fc40ffae0 2023-07-21T22:24:13.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.649+0000 7f6fba7fc700 1 -- 172.21.15.151:0/3046053274 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fc000cbd0 con 0x7f6fc40ffae0 2023-07-21T22:24:13.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.649+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/3046053274 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc4196570 con 0x7f6fc40ffae0 2023-07-21T22:24:13.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.649+0000 7f6fba7fc700 1 -- 172.21.15.151:0/3046053274 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0018680 con 0x7f6fc40ffae0 2023-07-21T22:24:13.697 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.649+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/3046053274 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc41a2870 con 0x7f6fc40ffae0 2023-07-21T22:24:13.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.653+0000 7f6fdef79b80 1 Processor -- start 2023-07-21T22:24:13.699 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.653+0000 7f6fba7fc700 1 -- 172.21.15.151:0/3046053274 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6fc000cd40 con 0x7f6fc40ffae0 2023-07-21T22:24:13.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.654+0000 7f6fdef79b80 1 -- start start 2023-07-21T22:24:13.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.654+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca3446580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.654+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca3441350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.700 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.654+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca3441da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.654+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca3346cb0 con 0x564ca34461b0 2023-07-21T22:24:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.654+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca3399a40 con 0x564ca3441930 2023-07-21T22:24:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.654+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca3392ed0 con 0x564ca3446ac0 2023-07-21T22:24:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.654+0000 7f6fc9b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca3446580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc9b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca3446580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45130/0 (socket says 172.21.15.151:45130) 2023-07-21T22:24:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc9b9c700 1 -- 172.21.15.151:0/1631551023 learned_addr learned my addr 172.21.15.151:0/1631551023 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:13.701 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc939b700 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca3441350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.702 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca3441da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc9b9c700 1 -- 172.21.15.151:0/1631551023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 msgr2=0x564ca3441350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:13.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca3441350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc9b9c700 1 -- 172.21.15.151:0/1631551023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 msgr2=0x564ca3441da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:13.703 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca3441da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc9b9c700 1 -- 172.21.15.151:0/1631551023 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ca31c0de0 con 0x564ca34461b0 2023-07-21T22:24:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca3441da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca3446580 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0093b0 tx=0x7f6fbc009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4db30aaf167f12 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.655+0000 7f6fba7fc700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6fb00a1340 0x7f6fb00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.656+0000 7f6fba7fc700 1 -- 172.21.15.151:0/3046053274 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6fc0014070 con 0x7f6fc40ffae0 2023-07-21T22:24:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.656+0000 7f6fc939b700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6fb00a1340 0x7f6fb00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.656+0000 7f6faf7fe700 1 -- 172.21.15.151:0/1631551023 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc00e070 con 0x564ca34461b0 2023-07-21T22:24:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.656+0000 7f6faf7fe700 1 -- 172.21.15.151:0/1631551023 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fbc00f040 con 0x564ca34461b0 2023-07-21T22:24:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.656+0000 7f6faf7fe700 1 -- 172.21.15.151:0/1631551023 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc014600 con 0x564ca34461b0 2023-07-21T22:24:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.656+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1631551023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 msgr2=0x564ca3446580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.656+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca3446580 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc0093b0 tx=0x7f6fbc009920 comp rx=0 tx=0).stop 2023-07-21T22:24:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.656+0000 7f6fc939b700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6fb00a1340 0x7f6fb00a37f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x564ca343de70 tx=0x7f6fc00d0710 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.657+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1631551023 shutdown_connections 2023-07-21T22:24:13.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.657+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca3441da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.657+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca3446580 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.657+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1631551023 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca3441350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.657+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1631551023 >> 172.21.15.151:0/1631551023 conn(0x564ca3436ef0 msgr2=0x564ca343c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:13.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.657+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1631551023 shutdown_connections 2023-07-21T22:24:13.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.657+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1631551023 wait complete. 2023-07-21T22:24:13.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.657+0000 7f6fdef79b80 1 -- start start 2023-07-21T22:24:13.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fdef79b80 1 Processor -- start 2023-07-21T22:24:13.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca344aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344b400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca344b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca3332ac0 con 0x564ca34461b0 2023-07-21T22:24:13.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca33327c0 con 0x564ca3441930 2023-07-21T22:24:13.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca3216920 con 0x564ca3446ac0 2023-07-21T22:24:13.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fdef79b80 10 client.0 _ll_register_callbacks cb 0x564ca3330760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:13.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fc8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fc8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45136/0 (socket says 172.21.15.151:45136) 2023-07-21T22:24:13.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.658+0000 7f6fc8b9a700 1 -- 172.21.15.151:0/2313851867 learned_addr learned my addr 172.21.15.151:0/2313851867 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:13.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca344b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca344aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6fc8b9a700 1 -- 172.21.15.151:0/2313851867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 msgr2=0x564ca344b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:13.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca344b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6fc8b9a700 1 -- 172.21.15.151:0/2313851867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 msgr2=0x564ca344aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:13.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca344aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6fc8b9a700 1 -- 172.21.15.151:0/2313851867 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc410d220 con 0x564ca34461b0 2023-07-21T22:24:13.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca344aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:13.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344b400 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4000c00 tx=0x7f6fb4005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a555ad12a4af06 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:13.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.659+0000 7f6facff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:13.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.660+0000 7f6facff9700 1 -- 172.21.15.151:0/2313851867 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb401d070 con 0x564ca34461b0 2023-07-21T22:24:13.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.660+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2313851867 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564ca32ec4f0 con 0x564ca34461b0 2023-07-21T22:24:13.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.660+0000 7f6facff9700 1 -- 172.21.15.151:0/2313851867 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6fb4004500 con 0x564ca34461b0 2023-07-21T22:24:13.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.660+0000 7f6facff9700 1 -- 172.21.15.151:0/2313851867 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fb40046c0 con 0x564ca34461b0 2023-07-21T22:24:13.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.660+0000 7f6fdef79b80 10 client.16407 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:13.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.660+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2313851867 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f6fbc009090 con 0x564ca34461b0 2023-07-21T22:24:13.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.660+0000 7f6facff9700 1 -- 172.21.15.151:0/2313851867 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564ca32ec4f0 con 0x564ca34461b0 2023-07-21T22:24:13.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.660+0000 7f6facff9700 1 -- 172.21.15.151:0/2313851867 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6fb400f8a0 con 0x564ca34461b0 2023-07-21T22:24:13.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.661+0000 7f6fdef79b80 10 client.16407 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:13.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.661+0000 7f6fdef79b80 10 client.16407 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:13.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.661+0000 7f6fdef79b80 20 client.16407 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:13.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.661+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564ca345f940 0x564ca3461d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.661+0000 7f6fdef79b80 4 client.16407 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:13.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.661+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2313851867 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564ca338beb0 con 0x564ca345f940 2023-07-21T22:24:13.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.661+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564ca345f940 0x564ca3461d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.662+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564ca345f940 0x564ca3461d50 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8e27aaa563f7f9f server_cookie=8dfb65c3afc0d231 in_seq=0 out_seq=0 2023-07-21T22:24:13.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.662+0000 7f6facff9700 10 client.16407 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:13.714 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.662+0000 7f6facff9700 1 -- 172.21.15.151:0/2313851867 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564ca338beb0 con 0x564ca345f940 2023-07-21T22:24:13.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.662+0000 7f6facff9700 10 client.16407 handle_command_reply: tid=0 2023-07-21T22:24:13.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 client.16407 shutdown 2023-07-21T22:24:13.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2313851867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 msgr2=0x564ca344b400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344b400 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4000c00 tx=0x7f6fb4005be0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2313851867 shutdown_connections 2023-07-21T22:24:13.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564ca345f940 0x564ca3461d50 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3441930 0x564ca344aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca344b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2313851867 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344b400 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6facff9700 0 client.16407 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:13.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2313851867 >> 172.21.15.151:0/2313851867 conn(0x564ca3436ef0 msgr2=0x564ca343c420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:13.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2313851867 shutdown_connections 2023-07-21T22:24:13.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2313851867 wait complete. 2023-07-21T22:24:13.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.663+0000 7f6fdef79b80 20 client.16407 trim_cache size 0 max 16384 2023-07-21T22:24:13.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.682+0000 7f6fdef79b80 1 Processor -- start 2023-07-21T22:24:13.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.682+0000 7f6fdef79b80 1 -- start start 2023-07-21T22:24:13.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca3441930 0x564ca3456980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca34461b0 0x564ca3440a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca3440f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca338beb0 con 0x564ca3441930 2023-07-21T22:24:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca32ec4f0 con 0x564ca34461b0 2023-07-21T22:24:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca343dd00 con 0x564ca3446ac0 2023-07-21T22:24:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc9b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca3441930 0x564ca3456980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc9b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca3441930 0x564ca3456980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45142/0 (socket says 172.21.15.151:45142) 2023-07-21T22:24:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc9b9c700 1 -- 172.21.15.151:0/2500649422 learned_addr learned my addr 172.21.15.151:0/2500649422 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:13.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/2500649422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca34461b0 0x564ca3440a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/2500649422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca3440f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc9b9c700 1 -- 172.21.15.151:0/2500649422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 msgr2=0x564ca3440f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/2500649422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca3440f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc9b9c700 1 -- 172.21.15.151:0/2500649422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca34461b0 msgr2=0x564ca3440a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/2500649422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca34461b0 0x564ca3440a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.683+0000 7f6fc9b9c700 1 -- 172.21.15.151:0/2500649422 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564ca31a9c60 con 0x564ca3441930 2023-07-21T22:24:13.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.684+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/2500649422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca3441930 0x564ca3456980 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc018040 tx=0x7f6fbc009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfae2c998935b28 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:13.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.684+0000 7f6faffff700 1 -- 172.21.15.151:0/2500649422 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc00e040 con 0x564ca3441930 2023-07-21T22:24:13.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.684+0000 7f6faffff700 1 -- 172.21.15.151:0/2500649422 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fbc02a440 con 0x564ca3441930 2023-07-21T22:24:13.732 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.684+0000 7f6faffff700 1 -- 172.21.15.151:0/2500649422 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fbc003e10 con 0x564ca3441930 2023-07-21T22:24:13.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2500649422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca3441930 msgr2=0x564ca3456980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.734 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2500649422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca3441930 0x564ca3456980 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6fbc018040 tx=0x7f6fbc009f50 comp rx=0 tx=0).stop 2023-07-21T22:24:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2500649422 shutdown_connections 2023-07-21T22:24:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2500649422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3446ac0 0x564ca3440f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2500649422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca3441930 0x564ca3456980 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/2500649422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca34461b0 0x564ca3440a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2500649422 >> 172.21.15.151:0/2500649422 conn(0x564ca3436ef0 msgr2=0x564ca343fb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:13.735 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2500649422 shutdown_connections 2023-07-21T22:24:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 -- 172.21.15.151:0/2500649422 wait complete. 2023-07-21T22:24:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.685+0000 7f6fdef79b80 1 -- start start 2023-07-21T22:24:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fdef79b80 1 Processor -- start 2023-07-21T22:24:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3441930 0x564ca3456b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fdef79b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3446ac0 0x564ca344cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.736 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca344d400 con 0x564ca34461b0 2023-07-21T22:24:13.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca344d570 con 0x564ca3446ac0 2023-07-21T22:24:13.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fdef79b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564ca34b3800 con 0x564ca3441930 2023-07-21T22:24:13.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fdef79b80 10 client.0 _ll_register_callbacks cb 0x7f6fb4005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:13.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fc9b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3441930 0x564ca3456b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fc8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fc9b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3441930 0x564ca3456b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49886/0 (socket says 172.21.15.151:49886) 2023-07-21T22:24:13.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fc9b9c700 1 -- 172.21.15.151:0/1446333850 learned_addr learned my addr 172.21.15.151:0/1446333850 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:13.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fc8b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45154/0 (socket says 172.21.15.151:45154) 2023-07-21T22:24:13.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.686+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3446ac0 0x564ca344cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6fc8b9a700 1 -- 172.21.15.151:0/1446333850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3441930 msgr2=0x564ca3456b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:13.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3441930 0x564ca3456b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6fc8b9a700 1 -- 172.21.15.151:0/1446333850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3446ac0 msgr2=0x564ca344cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:13.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3446ac0 0x564ca344cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6fc8b9a700 1 -- 172.21.15.151:0/1446333850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564ca31c0de0 con 0x564ca34461b0 2023-07-21T22:24:13.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6fc8b9a700 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344c7d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009990 tx=0x7f6fb4005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8883d3036b182116 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:13.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6facff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:13.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6facff9700 1 -- 172.21.15.151:0/1446333850 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb401d040 con 0x564ca34461b0 2023-07-21T22:24:13.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6facff9700 1 -- 172.21.15.151:0/1446333850 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6fb4000e40 con 0x564ca34461b0 2023-07-21T22:24:13.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.687+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1446333850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6fbc00f040 con 0x564ca34461b0 2023-07-21T22:24:13.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6facff9700 1 -- 172.21.15.151:0/1446333850 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fb400fe20 con 0x564ca34461b0 2023-07-21T22:24:13.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6fdef79b80 10 client.16413 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:13.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1446333850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564ca31e7250 con 0x564ca34461b0 2023-07-21T22:24:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6facff9700 1 -- 172.21.15.151:0/1446333850 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6fbc00f040 con 0x564ca34461b0 2023-07-21T22:24:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6facff9700 1 -- 172.21.15.151:0/1446333850 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6fb4004500 con 0x564ca34461b0 2023-07-21T22:24:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6fdef79b80 10 client.16413 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6fdef79b80 10 client.16413 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6fdef79b80 20 client.16413 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564ca34b4a60 0x564ca34b6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6fdef79b80 4 client.16413 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:24:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.688+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1446333850 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564ca334e050 con 0x564ca34b4a60 2023-07-21T22:24:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.689+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564ca34b4a60 0x564ca34b6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.741 INFO:teuthology.orchestra.run.smithi151.stderr:19900000 of 50000000 tuples (39%) done (elapsed 277.23 s, remaining 419.32 s) 2023-07-21T22:24:13.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.689+0000 7f6fc9b9c700 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564ca34b4a60 0x564ca34b6e70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3da7b0b521e6b782 server_cookie=b226a3e5450c94c5 in_seq=0 out_seq=0 2023-07-21T22:24:13.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.689+0000 7f6facff9700 10 client.16413 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:13.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.689+0000 7f6facff9700 1 -- 172.21.15.151:0/1446333850 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x564ca334e050 con 0x564ca34b4a60 2023-07-21T22:24:13.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.689+0000 7f6facff9700 10 client.16413 handle_command_reply: tid=0 2023-07-21T22:24:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.689+0000 7f6fdef79b80 1 client.16413 shutdown 2023-07-21T22:24:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1446333850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 msgr2=0x564ca344c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344c7d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6fb4009990 tx=0x7f6fb4005a40 comp rx=0 tx=0).stop 2023-07-21T22:24:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1446333850 shutdown_connections 2023-07-21T22:24:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564ca34b4a60 0x564ca34b6e70 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564ca3446ac0 0x564ca344cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564ca3441930 0x564ca3456b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 --2- 172.21.15.151:0/1446333850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564ca34461b0 0x564ca344c7d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6facff9700 0 client.16413 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1446333850 >> 172.21.15.151:0/1446333850 conn(0x564ca3436ef0 msgr2=0x564ca3440a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1446333850 shutdown_connections 2023-07-21T22:24:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 1 -- 172.21.15.151:0/1446333850 wait complete. 2023-07-21T22:24:13.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.690+0000 7f6fdef79b80 20 client.16413 trim_cache size 0 max 16384 2023-07-21T22:24:13.745 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:24:13.745 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "no active scrubs running", 2023-07-21T22:24:13.745 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": {} 2023-07-21T22:24:13.745 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:24:13.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6fb00a1340 msgr2=0x7f6fb00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6fb00a1340 0x7f6fb00a37f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x564ca343de70 tx=0x7f6fc00d0710 comp rx=0 tx=0).stop 2023-07-21T22:24:13.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 msgr2=0x7f6fc419b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 0x7f6fc419b880 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000e9a0 tx=0x7f6fc000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/3046053274 shutdown_connections 2023-07-21T22:24:13.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6fb00a1340 0x7f6fb00a37f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6fc4105af0 0x7f6fc41958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fc40ffae0 0x7f6fc419b880 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 --2- 172.21.15.151:0/3046053274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc4100490 0x7f6fc419bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/3046053274 >> 172.21.15.151:0/3046053274 conn(0x7f6fc40fb5e0 msgr2=0x7f6fc41035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:13.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/3046053274 shutdown_connections 2023-07-21T22:24:13.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.691+0000 7f6fcb5ff700 1 -- 172.21.15.151:0/3046053274 wait complete. 2023-07-21T22:24:13.757 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-21T22:24:13.757 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:24:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.937+0000 7f3552fff700 1 -- 172.21.15.151:0/2614354787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c1004a0 msgr2=0x7f354c10c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.937+0000 7f3552fff700 1 --2- 172.21.15.151:0/2614354787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c1004a0 0x7f354c10c930 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f354400b0a0 tx=0x7f354400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.937+0000 7f3552fff700 1 -- 172.21.15.151:0/2614354787 shutdown_connections 2023-07-21T22:24:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.937+0000 7f3552fff700 1 --2- 172.21.15.151:0/2614354787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c1004a0 0x7f354c10c930 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.937+0000 7f3552fff700 1 --2- 172.21.15.151:0/2614354787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f354c105b00 0x7f354c105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.937+0000 7f3552fff700 1 --2- 172.21.15.151:0/2614354787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f354c0ffaf0 0x7f354c0fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.937+0000 7f3552fff700 1 -- 172.21.15.151:0/2614354787 >> 172.21.15.151:0/2614354787 conn(0x7f354c0fb630 msgr2=0x7f354c0fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:13.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.937+0000 7f3552fff700 1 -- 172.21.15.151:0/2614354787 shutdown_connections 2023-07-21T22:24:13.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.937+0000 7f3552fff700 1 -- 172.21.15.151:0/2614354787 wait complete. 2023-07-21T22:24:13.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.938+0000 7f3552fff700 1 Processor -- start 2023-07-21T22:24:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.939+0000 7f3552fff700 1 -- start start 2023-07-21T22:24:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.939+0000 7f3552fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c0ffaf0 0x7f354c197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.939+0000 7f3552fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f354c1004a0 0x7f354c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.939+0000 7f3552fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f354c105b00 0x7f354c19c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.939+0000 7f3552fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c19cda0 con 0x7f354c0ffaf0 2023-07-21T22:24:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.939+0000 7f3552fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c19cf10 con 0x7f354c1004a0 2023-07-21T22:24:13.986 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.939+0000 7f3552fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c19d0d0 con 0x7f354c105b00 2023-07-21T22:24:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.939+0000 7f3550d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c0ffaf0 0x7f354c197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.939+0000 7f3550d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c0ffaf0 0x7f354c197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45162/0 (socket says 172.21.15.151:45162) 2023-07-21T22:24:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f3550d9b700 1 -- 172.21.15.151:0/4024438495 learned_addr learned my addr 172.21.15.151:0/4024438495 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f354bfff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f354c1004a0 0x7f354c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f355159c700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f354c105b00 0x7f354c19c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f3550d9b700 1 -- 172.21.15.151:0/4024438495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f354c105b00 msgr2=0x7f354c19c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.987 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f3550d9b700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f354c105b00 0x7f354c19c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f3550d9b700 1 -- 172.21.15.151:0/4024438495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f354c1004a0 msgr2=0x7f354c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f3550d9b700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f354c1004a0 0x7f354c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f3550d9b700 1 -- 172.21.15.151:0/4024438495 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3538009520 con 0x7f354c0ffaf0 2023-07-21T22:24:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f355159c700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f354c105b00 0x7f354c19c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f354bfff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f354c1004a0 0x7f354c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:13.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f3550d9b700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c0ffaf0 0x7f354c197dc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f354000e9a0 tx=0x7f354000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f3549ffb700 1 -- 172.21.15.151:0/4024438495 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540009790 con 0x7f354c0ffaf0 2023-07-21T22:24:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.940+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3544009d00 con 0x7f354c0ffaf0 2023-07-21T22:24:13.989 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.941+0000 7f3549ffb700 1 -- 172.21.15.151:0/4024438495 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f354000cbd0 con 0x7f354c0ffaf0 2023-07-21T22:24:13.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.941+0000 7f3549ffb700 1 -- 172.21.15.151:0/4024438495 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540018680 con 0x7f354c0ffaf0 2023-07-21T22:24:13.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.941+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c19d5a0 con 0x7f354c0ffaf0 2023-07-21T22:24:13.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.942+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c067300 con 0x7f354c0ffaf0 2023-07-21T22:24:13.990 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.944+0000 7f3549ffb700 1 -- 172.21.15.151:0/4024438495 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f354000cd40 con 0x7f354c0ffaf0 2023-07-21T22:24:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.945+0000 7f3549ffb700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f353c0a1380 0x7f353c0a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.946+0000 7f3549ffb700 1 -- 172.21.15.151:0/4024438495 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3540014070 con 0x7f354c0ffaf0 2023-07-21T22:24:13.991 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.946+0000 7f354bfff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f353c0a1380 0x7f353c0a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:13.992 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.947+0000 7f354bfff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f353c0a1380 0x7f353c0a3830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f354c1993d0 tx=0x7f3538009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:13.993 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:13.948+0000 7f3549ffb700 1 -- 172.21.15.151:0/4024438495 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f3540096530 con 0x7f354c0ffaf0 2023-07-21T22:24:14.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.270+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f354c199110 con 0x7f354c0ffaf0 2023-07-21T22:24:14.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.271+0000 7f3549ffb700 1 -- 172.21.15.151:0/4024438495 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+10825 (secure 0 0 0) 0x7f3540026020 con 0x7f354c0ffaf0 2023-07-21T22:24:14.317 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:24:14.317 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:24:04.427029+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:24:14.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f353c0a1380 msgr2=0x7f353c0a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f353c0a1380 0x7f353c0a3830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f354c1993d0 tx=0x7f3538009260 comp rx=0 tx=0).stop 2023-07-21T22:24:14.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c0ffaf0 msgr2=0x7f354c197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c0ffaf0 0x7f354c197dc0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f354000e9a0 tx=0x7f354000ed60 comp rx=0 tx=0).stop 2023-07-21T22:24:14.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 shutdown_connections 2023-07-21T22:24:14.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f353c0a1380 0x7f353c0a3830 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f354c105b00 0x7f354c19c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f354c0ffaf0 0x7f354c197dc0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 --2- 172.21.15.151:0/4024438495 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f354c1004a0 0x7f354c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 >> 172.21.15.151:0/4024438495 conn(0x7f354c0fb630 msgr2=0x7f354c10ae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 shutdown_connections 2023-07-21T22:24:14.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.274+0000 7f3552fff700 1 -- 172.21.15.151:0/4024438495 wait complete. 2023-07-21T22:24:14.321 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 33 2023-07-21T22:24:14.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-21T22:24:14.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.530+0000 7f2c6e99d700 1 -- 172.21.15.151:0/3978199621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c68106ea0 msgr2=0x7f2c6810ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.530+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/3978199621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c68106ea0 0x7f2c6810ea70 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2c6000b0d0 tx=0x7f2c6000b3e0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.576 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.530+0000 7f2c6e99d700 1 -- 172.21.15.151:0/3978199621 shutdown_connections 2023-07-21T22:24:14.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.530+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/3978199621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c68101e60 0x7f2c68102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.530+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/3978199621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c68106ea0 0x7f2c6810ea70 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.530+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/3978199621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68102800 0x7f2c681067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.530+0000 7f2c6e99d700 1 -- 172.21.15.151:0/3978199621 >> 172.21.15.151:0/3978199621 conn(0x7f2c680fd690 msgr2=0x7f2c680ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.530+0000 7f2c6e99d700 1 -- 172.21.15.151:0/3978199621 shutdown_connections 2023-07-21T22:24:14.577 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.530+0000 7f2c6e99d700 1 -- 172.21.15.151:0/3978199621 wait complete. 2023-07-21T22:24:14.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.532+0000 7f2c6e99d700 1 Processor -- start 2023-07-21T22:24:14.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.532+0000 7f2c6e99d700 1 -- start start 2023-07-21T22:24:14.578 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.532+0000 7f2c6e99d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68101e60 0x7f2c6819d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.532+0000 7f2c6e99d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c68102800 0x7f2c6819df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.532+0000 7f2c6e99d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c68106ea0 0x7f2c68197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6e99d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c681980a0 con 0x7f2c68106ea0 2023-07-21T22:24:14.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6e99d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c68198210 con 0x7f2c68102800 2023-07-21T22:24:14.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6e99d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c681983d0 con 0x7f2c68101e60 2023-07-21T22:24:14.579 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6e19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c68106ea0 0x7f2c68197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6d99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68101e60 0x7f2c6819d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6d19a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c68102800 0x7f2c6819df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6d99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68101e60 0x7f2c6819d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49920/0 (socket says 172.21.15.151:49920) 2023-07-21T22:24:14.580 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6d99b700 1 -- 172.21.15.151:0/198914588 learned_addr learned my addr 172.21.15.151:0/198914588 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6d99b700 1 -- 172.21.15.151:0/198914588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c68102800 msgr2=0x7f2c6819df00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c68102800 0x7f2c6819df00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6d99b700 1 -- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c68106ea0 msgr2=0x7f2c68197a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c68106ea0 0x7f2c68197a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.581 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6d99b700 1 -- 172.21.15.151:0/198914588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c60009d00 con 0x7f2c68101e60 2023-07-21T22:24:14.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.533+0000 7f2c6e19c700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c68106ea0 0x7f2c68197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:14.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.534+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68101e60 0x7f2c6819d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400d980 tx=0x7f2c6400dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.534+0000 7f2c5effd700 1 -- 172.21.15.151:0/198914588 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64004220 con 0x7f2c68101e60 2023-07-21T22:24:14.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.534+0000 7f2c5effd700 1 -- 172.21.15.151:0/198914588 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c64007640 con 0x7f2c68101e60 2023-07-21T22:24:14.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.534+0000 7f2c5effd700 1 -- 172.21.15.151:0/198914588 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64005660 con 0x7f2c68101e60 2023-07-21T22:24:14.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.534+0000 7f2c6e99d700 1 -- 172.21.15.151:0/198914588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c681986b0 con 0x7f2c68101e60 2023-07-21T22:24:14.582 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.534+0000 7f2c6e99d700 1 -- 172.21.15.151:0/198914588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c681a49b0 con 0x7f2c68101e60 2023-07-21T22:24:14.583 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.538+0000 7f2c5effd700 1 -- 172.21.15.151:0/198914588 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2c64004750 con 0x7f2c68101e60 2023-07-21T22:24:14.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.539+0000 7f2c8359fb80 1 Processor -- start 2023-07-21T22:24:14.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.539+0000 7f2c8359fb80 1 -- start start 2023-07-21T22:24:14.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.539+0000 7f2c5effd700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c540a1360 0x7f2c540a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852d6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e1700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9851dccb0 con 0x55e9852e1c40 2023-07-21T22:24:14.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e98522fa40 con 0x55e9852d6da0 2023-07-21T22:24:14.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e985228ed0 con 0x55e9852d6490 2023-07-21T22:24:14.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c5effd700 1 -- 172.21.15.151:0/198914588 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2c640cca50 con 0x7f2c68101e60 2023-07-21T22:24:14.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c6e19c700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c540a1360 0x7f2c540a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c6d99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852d6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c6e19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c6d19a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c6d99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852d6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49932/0 (socket says 172.21.15.151:49932) 2023-07-21T22:24:14.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.540+0000 7f2c6d99b700 1 -- 172.21.15.151:0/885600415 learned_addr learned my addr 172.21.15.151:0/885600415 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c6d19a700 1 -- 172.21.15.151:0/885600415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 msgr2=0x55e9852d6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/885600415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852d6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c6d19a700 1 -- 172.21.15.151:0/885600415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 msgr2=0x55e9852e4020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/885600415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e4020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c6d19a700 1 -- 172.21.15.151:0/885600415 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e985056de0 con 0x55e9852d6da0 2023-07-21T22:24:14.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c6e19c700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c540a1360 0x7f2c540a3810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c60005bd0 tx=0x7f2c60005ac0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/885600415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e1700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2c680681c0 tx=0x7f2c58009f60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49c0fac8921e69b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c53fff700 1 -- 172.21.15.151:0/885600415 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58011c80 con 0x55e9852d6da0 2023-07-21T22:24:14.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c53fff700 1 -- 172.21.15.151:0/885600415 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c58011de0 con 0x55e9852d6da0 2023-07-21T22:24:14.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.541+0000 7f2c53fff700 1 -- 172.21.15.151:0/885600415 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58005020 con 0x55e9852d6da0 2023-07-21T22:24:14.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.542+0000 7f2c8359fb80 1 -- 172.21.15.151:0/885600415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 msgr2=0x55e9852e1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.542+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/885600415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e1700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f2c680681c0 tx=0x7f2c58009f60 comp rx=0 tx=0).stop 2023-07-21T22:24:14.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.542+0000 7f2c8359fb80 1 -- 172.21.15.151:0/885600415 shutdown_connections 2023-07-21T22:24:14.590 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.542+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/885600415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e4020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.542+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/885600415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852d6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.542+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/885600415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e1700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.542+0000 7f2c8359fb80 1 -- 172.21.15.151:0/885600415 >> 172.21.15.151:0/885600415 conn(0x55e9852ccef0 msgr2=0x55e9852d2860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.543+0000 7f2c8359fb80 1 -- 172.21.15.151:0/885600415 shutdown_connections 2023-07-21T22:24:14.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.543+0000 7f2c8359fb80 1 -- 172.21.15.151:0/885600415 wait complete. 2023-07-21T22:24:14.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.543+0000 7f2c8359fb80 1 -- start start 2023-07-21T22:24:14.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.543+0000 7f2c8359fb80 1 Processor -- start 2023-07-21T22:24:14.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6da0 0x55e9852de800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852e1c40 0x55e9852dedc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9851c8ac0 con 0x55e9852d6da0 2023-07-21T22:24:14.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9851c87c0 con 0x55e9852e1c40 2023-07-21T22:24:14.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9850ac920 con 0x55e9852d6490 2023-07-21T22:24:14.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c8359fb80 10 client.0 _ll_register_callbacks cb 0x55e9851c6760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c6d99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c6d19a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6da0 0x55e9852de800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c6d99b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49946/0 (socket says 172.21.15.151:49946) 2023-07-21T22:24:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c6d99b700 1 -- 172.21.15.151:0/1289502941 learned_addr learned my addr 172.21.15.151:0/1289502941 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.544+0000 7f2c6e19c700 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852e1c40 0x55e9852dedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c6d19a700 1 -- 172.21.15.151:0/1289502941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 msgr2=0x55e9852e15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c6d19a700 1 -- 172.21.15.151:0/1289502941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852e1c40 msgr2=0x55e9852dedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852e1c40 0x55e9852dedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c6d19a700 1 -- 172.21.15.151:0/1289502941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c580098e0 con 0x55e9852d6da0 2023-07-21T22:24:14.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:14.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c6e19c700 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852e1c40 0x55e9852dedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:14.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6da0 0x55e9852de800 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097c0 tx=0x7f2c58011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32083cc8ad80379 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c517fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:14.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c517fa700 1 -- 172.21.15.151:0/1289502941 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58011c70 con 0x55e9852d6da0 2023-07-21T22:24:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1289502941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e9851824f0 con 0x55e9852d6da0 2023-07-21T22:24:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.545+0000 7f2c517fa700 1 -- 172.21.15.151:0/1289502941 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2c58022610 con 0x55e9852d6da0 2023-07-21T22:24:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c517fa700 1 -- 172.21.15.151:0/1289502941 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c58022810 con 0x55e9852d6da0 2023-07-21T22:24:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c8359fb80 10 client.16431 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1289502941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55e98503fc60 con 0x55e9852d6da0 2023-07-21T22:24:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c517fa700 1 -- 172.21.15.151:0/1289502941 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e9851824f0 con 0x55e9852d6da0 2023-07-21T22:24:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c517fa700 1 -- 172.21.15.151:0/1289502941 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2c58019a30 con 0x55e9852d6da0 2023-07-21T22:24:14.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c8359fb80 10 client.16431 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c8359fb80 10 client.16431 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:24:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c8359fb80 20 client.16431 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55e9852f14c0 0x55e9852f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c8359fb80 4 client.16431 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.546+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1289502941 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e985221eb0 con 0x55e9852f14c0 2023-07-21T22:24:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.547+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55e9852f14c0 0x55e9852f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.548+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55e9852f14c0 0x55e9852f38d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4cd9b7911fdf9857 server_cookie=62343f5a1f870afe in_seq=0 out_seq=0 2023-07-21T22:24:14.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.548+0000 7f2c517fa700 10 client.16431 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:24:14.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.548+0000 7f2c517fa700 1 -- 172.21.15.151:0/1289502941 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e985221eb0 con 0x55e9852f14c0 2023-07-21T22:24:14.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.548+0000 7f2c517fa700 10 client.16431 handle_command_reply: tid=0 2023-07-21T22:24:14.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.548+0000 7f2c8359fb80 1 client.16431 shutdown 2023-07-21T22:24:14.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1289502941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6da0 msgr2=0x55e9852de800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6da0 0x55e9852de800 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2c580097c0 tx=0x7f2c58011a80 comp rx=0 tx=0).stop 2023-07-21T22:24:14.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1289502941 shutdown_connections 2023-07-21T22:24:14.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55e9852f14c0 0x55e9852f38d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852e1c40 0x55e9852dedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c517fa700 0 client.16431 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:24:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1289502941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6da0 0x55e9852de800 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1289502941 >> 172.21.15.151:0/1289502941 conn(0x55e9852ccef0 msgr2=0x55e9852d23f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1289502941 shutdown_connections 2023-07-21T22:24:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1289502941 wait complete. 2023-07-21T22:24:14.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.549+0000 7f2c8359fb80 20 client.16431 trim_cache size 0 max 16384 2023-07-21T22:24:14.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.566+0000 7f2c8359fb80 1 Processor -- start 2023-07-21T22:24:14.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.567+0000 7f2c8359fb80 1 -- start start 2023-07-21T22:24:14.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.567+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6490 0x55e9852e4020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.567+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852d0f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.567+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852e1c40 0x55e9852e1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.567+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9852d76e0 con 0x55e9852d6490 2023-07-21T22:24:14.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.567+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9852d7f50 con 0x55e9852d6da0 2023-07-21T22:24:14.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.567+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9852df3c0 con 0x55e9852e1c40 2023-07-21T22:24:14.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6490 0x55e9852e4020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6490 0x55e9852e4020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45208/0 (socket says 172.21.15.151:45208) 2023-07-21T22:24:14.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d99b700 1 -- 172.21.15.151:0/1871892981 learned_addr learned my addr 172.21.15.151:0/1871892981 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852d0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6e19c700 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852e1c40 0x55e9852e1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d99b700 1 -- 172.21.15.151:0/1871892981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852e1c40 msgr2=0x55e9852e1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852e1c40 0x55e9852e1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d99b700 1 -- 172.21.15.151:0/1871892981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 msgr2=0x55e9852d0f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852d0f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d99b700 1 -- 172.21.15.151:0/1871892981 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e98507d250 con 0x55e9852d6490 2023-07-21T22:24:14.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.568+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:14.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.569+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6490 0x55e9852e4020 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2c64096030 tx=0x7f2c64095e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22b0568ec3449792 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.569+0000 7f2c5cbff700 1 -- 172.21.15.151:0/1871892981 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c640057c0 con 0x55e9852d6490 2023-07-21T22:24:14.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.569+0000 7f2c5cbff700 1 -- 172.21.15.151:0/1871892981 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c64099b30 con 0x55e9852d6490 2023-07-21T22:24:14.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.569+0000 7f2c5cbff700 1 -- 172.21.15.151:0/1871892981 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c64097ff0 con 0x55e9852d6490 2023-07-21T22:24:14.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1871892981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6490 msgr2=0x55e9852e4020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6490 0x55e9852e4020 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2c64096030 tx=0x7f2c64095e70 comp rx=0 tx=0).stop 2023-07-21T22:24:14.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1871892981 shutdown_connections 2023-07-21T22:24:14.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852e1c40 0x55e9852e1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852d6490 0x55e9852e4020 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/1871892981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852d0f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1871892981 >> 172.21.15.151:0/1871892981 conn(0x55e9852ccef0 msgr2=0x55e9852ed910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1871892981 shutdown_connections 2023-07-21T22:24:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 -- 172.21.15.151:0/1871892981 wait complete. 2023-07-21T22:24:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.570+0000 7f2c8359fb80 1 -- start start 2023-07-21T22:24:14.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.571+0000 7f2c8359fb80 1 Processor -- start 2023-07-21T22:24:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.571+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e8620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.571+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.571+0000 7f2c8359fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.571+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9852e55a0 con 0x55e9852e1c40 2023-07-21T22:24:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.571+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9852e56e0 con 0x55e9852d6da0 2023-07-21T22:24:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.571+0000 7f2c8359fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9852e58a0 con 0x55e9852d6490 2023-07-21T22:24:14.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.571+0000 7f2c8359fb80 10 client.0 _ll_register_callbacks cb 0x7f2c58005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.571+0000 7f2c6e19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6e19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e5060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45218/0 (socket says 172.21.15.151:45218) 2023-07-21T22:24:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6e19c700 1 -- 172.21.15.151:0/3102365908 learned_addr learned my addr 172.21.15.151:0/3102365908 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6d19a700 1 -- 172.21.15.151:0/3102365908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 msgr2=0x55e9852e8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6d19a700 1 -- 172.21.15.151:0/3102365908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 msgr2=0x55e9852e5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6d19a700 1 -- 172.21.15.151:0/3102365908 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e98503fc60 con 0x55e9852d6da0 2023-07-21T22:24:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6e19c700 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c6d19a700 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e4b20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2c58019e90 tx=0x7f2c58009300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=56beb164a7e7d92 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.572+0000 7f2c517fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:24:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.573+0000 7f2c517fa700 1 -- 172.21.15.151:0/3102365908 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c58004020 con 0x55e9852d6da0 2023-07-21T22:24:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.573+0000 7f2c517fa700 1 -- 172.21.15.151:0/3102365908 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2c58004180 con 0x55e9852d6da0 2023-07-21T22:24:14.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.573+0000 7f2c8359fb80 1 -- 172.21.15.151:0/3102365908 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c58011de0 con 0x55e9852d6da0 2023-07-21T22:24:14.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.573+0000 7f2c517fa700 1 -- 172.21.15.151:0/3102365908 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c58004340 con 0x55e9852d6da0 2023-07-21T22:24:14.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.573+0000 7f2c8359fb80 10 client.26174 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:14.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.573+0000 7f2c8359fb80 1 -- 172.21.15.151:0/3102365908 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f2c640b9040 con 0x55e9852d6da0 2023-07-21T22:24:14.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.573+0000 7f2c517fa700 1 -- 172.21.15.151:0/3102365908 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c5803b080 con 0x55e9852d6da0 2023-07-21T22:24:14.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.574+0000 7f2c517fa700 1 -- 172.21.15.151:0/3102365908 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2c580036f0 con 0x55e9852d6da0 2023-07-21T22:24:14.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.574+0000 7f2c8359fb80 10 client.26174 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:14.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.574+0000 7f2c8359fb80 10 client.26174 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:24:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.574+0000 7f2c8359fb80 20 client.26174 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.574+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55e9853463f0 0x55e985348800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.574+0000 7f2c8359fb80 4 client.26174 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:24:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.574+0000 7f2c8359fb80 1 -- 172.21.15.151:0/3102365908 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55e9851e4050 con 0x55e9853463f0 2023-07-21T22:24:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.574+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55e9853463f0 0x55e985348800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c6d99b700 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55e9853463f0 0x55e985348800 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f93eaab49d7bc91f server_cookie=5e2f763b0339c543 in_seq=0 out_seq=0 2023-07-21T22:24:14.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c517fa700 10 client.26174 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:24:14.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c517fa700 1 -- 172.21.15.151:0/3102365908 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55e9851e4050 con 0x55e9853463f0 2023-07-21T22:24:14.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c517fa700 10 client.26174 handle_command_reply: tid=0 2023-07-21T22:24:14.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 client.26174 shutdown 2023-07-21T22:24:14.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 -- 172.21.15.151:0/3102365908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 msgr2=0x55e9852e4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e4b20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f2c58019e90 tx=0x7f2c58009300 comp rx=0 tx=0).stop 2023-07-21T22:24:14.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 -- 172.21.15.151:0/3102365908 shutdown_connections 2023-07-21T22:24:14.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55e9853463f0 0x55e985348800 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9852e1c40 0x55e9852e5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9852d6490 0x55e9852e8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 --2- 172.21.15.151:0/3102365908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9852d6da0 0x55e9852e4b20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c517fa700 0 client.26174 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:24:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 -- 172.21.15.151:0/3102365908 >> 172.21.15.151:0/3102365908 conn(0x55e9852ccef0 msgr2=0x55e9852d9b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 -- 172.21.15.151:0/3102365908 shutdown_connections 2023-07-21T22:24:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.575+0000 7f2c8359fb80 1 -- 172.21.15.151:0/3102365908 wait complete. 2023-07-21T22:24:14.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c8359fb80 20 client.26174 trim_cache size 0 max 16384 2023-07-21T22:24:14.630 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:24:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 -- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c540a1360 msgr2=0x7f2c540a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c540a1360 0x7f2c540a3810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2c60005bd0 tx=0x7f2c60005ac0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 -- 172.21.15.151:0/198914588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68101e60 msgr2=0x7f2c6819d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68101e60 0x7f2c6819d9c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400d980 tx=0x7f2c6400dc90 comp rx=0 tx=0).stop 2023-07-21T22:24:14.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 -- 172.21.15.151:0/198914588 shutdown_connections 2023-07-21T22:24:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c540a1360 0x7f2c540a3810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c68106ea0 0x7f2c68197a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c68101e60 0x7f2c6819d9c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 --2- 172.21.15.151:0/198914588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c68102800 0x7f2c6819df00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 -- 172.21.15.151:0/198914588 >> 172.21.15.151:0/198914588 conn(0x7f2c680fd690 msgr2=0x7f2c680fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 -- 172.21.15.151:0/198914588 shutdown_connections 2023-07-21T22:24:14.632 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.576+0000 7f2c6e99d700 1 -- 172.21.15.151:0/198914588 wait complete. 2023-07-21T22:24:14.637 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:14 smithi151 ceph-mon[95510]: pgmap v154: 97 pgs: 97 active+clean; 4.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 35 MiB/s wr, 224 op/s 2023-07-21T22:24:14.638 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:14 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/4024438495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:24:14.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-21T22:24:14.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.826+0000 7fdd1359e700 1 -- 172.21.15.151:0/1791494566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 msgr2=0x7fdd141067c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.826+0000 7fdd1359e700 1 --2- 172.21.15.151:0/1791494566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 0x7fdd141067c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fdd080099c0 tx=0x7fdd08009cd0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.826+0000 7fdd1359e700 1 -- 172.21.15.151:0/1791494566 shutdown_connections 2023-07-21T22:24:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.826+0000 7fdd1359e700 1 --2- 172.21.15.151:0/1791494566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd14106ea0 0x7fdd1410ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.826+0000 7fdd1359e700 1 --2- 172.21.15.151:0/1791494566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd14101e60 0x7fdd14102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.826+0000 7fdd1359e700 1 --2- 172.21.15.151:0/1791494566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 0x7fdd141067c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.826+0000 7fdd1359e700 1 -- 172.21.15.151:0/1791494566 >> 172.21.15.151:0/1791494566 conn(0x7fdd140fd690 msgr2=0x7fdd140ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.826+0000 7fdd1359e700 1 -- 172.21.15.151:0/1791494566 shutdown_connections 2023-07-21T22:24:14.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.826+0000 7fdd1359e700 1 -- 172.21.15.151:0/1791494566 wait complete. 2023-07-21T22:24:14.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.827+0000 7fdd1359e700 1 Processor -- start 2023-07-21T22:24:14.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.827+0000 7fdd1359e700 1 -- start start 2023-07-21T22:24:14.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd1359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd14101e60 0x7fdd1419d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd1359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 0x7fdd1419de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd1359e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd14106ea0 0x7fdd14197970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd1359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14197fd0 con 0x7fdd14102800 2023-07-21T22:24:14.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd1359e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14198140 con 0x7fdd14106ea0 2023-07-21T22:24:14.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd1359e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd14198300 con 0x7fdd14101e60 2023-07-21T22:24:14.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd11d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 0x7fdd1419de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd11d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 0x7fdd1419de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45234/0 (socket says 172.21.15.151:45234) 2023-07-21T22:24:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd11d9b700 1 -- 172.21.15.151:0/996097331 learned_addr learned my addr 172.21.15.151:0/996097331 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd12d9d700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd14106ea0 0x7fdd14197970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.828+0000 7fdd1259c700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd14101e60 0x7fdd1419d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd11d9b700 1 -- 172.21.15.151:0/996097331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd14101e60 msgr2=0x7fdd1419d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd14101e60 0x7fdd1419d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd11d9b700 1 -- 172.21.15.151:0/996097331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd14106ea0 msgr2=0x7fdd14197970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd14106ea0 0x7fdd14197970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd11d9b700 1 -- 172.21.15.151:0/996097331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd080095f0 con 0x7fdd14102800 2023-07-21T22:24:14.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 0x7fdd1419de40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdd080098e0 tx=0x7fdd0800b9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd037fe700 1 -- 172.21.15.151:0/996097331 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0801d070 con 0x7fdd14102800 2023-07-21T22:24:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd037fe700 1 -- 172.21.15.151:0/996097331 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd08004cc0 con 0x7fdd14102800 2023-07-21T22:24:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd1359e700 1 -- 172.21.15.151:0/996097331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd14198580 con 0x7fdd14102800 2023-07-21T22:24:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd037fe700 1 -- 172.21.15.151:0/996097331 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd08005720 con 0x7fdd14102800 2023-07-21T22:24:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.829+0000 7fdd1359e700 1 -- 172.21.15.151:0/996097331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd141a48f0 con 0x7fdd14102800 2023-07-21T22:24:14.878 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.833+0000 7fdd037fe700 1 -- 172.21.15.151:0/996097331 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdd08004830 con 0x7fdd14102800 2023-07-21T22:24:14.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:14 smithi187 ceph-mon[96918]: pgmap v154: 97 pgs: 97 active+clean; 4.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 35 MiB/s wr, 224 op/s 2023-07-21T22:24:14.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:14 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/4024438495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:24:14.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.834+0000 7fdd2c6cbb80 1 Processor -- start 2023-07-21T22:24:14.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd2c6cbb80 1 -- start start 2023-07-21T22:24:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd037fe700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdcfc0a13e0 0x7fdcfc0a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a52d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a538700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a53b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a433cb0 con 0x55689a52dda0 2023-07-21T22:24:14.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a486a40 con 0x55689a52d490 2023-07-21T22:24:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a47fed0 con 0x55689a538c40 2023-07-21T22:24:14.882 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd037fe700 1 -- 172.21.15.151:0/996097331 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdd080cd7a0 con 0x7fdd14102800 2023-07-21T22:24:14.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd12d9d700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdcfc0a13e0 0x7fdcfc0a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.835+0000 7fdd11d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a538700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd11d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a538700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45244/0 (socket says 172.21.15.151:45244) 2023-07-21T22:24:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd11d9b700 1 -- 172.21.15.151:0/3045911548 learned_addr learned my addr 172.21.15.151:0/3045911548 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd1259c700 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a52d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd12d9d700 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a53b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd11d9b700 1 -- 172.21.15.151:0/3045911548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 msgr2=0x55689a53b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a53b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd11d9b700 1 -- 172.21.15.151:0/3045911548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 msgr2=0x55689a52d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a52d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd11d9b700 1 -- 172.21.15.151:0/3045911548 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55689a2adde0 con 0x55689a52dda0 2023-07-21T22:24:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd1259c700 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a52d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a538700 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdd08096e50 tx=0x7fdd0809a510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823622a457624083 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.836+0000 7fdd12d9d700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdcfc0a13e0 0x7fdcfc0a3890 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009e10 tx=0x7fdd0c009490 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.837+0000 7fdd00ff9700 1 -- 172.21.15.151:0/3045911548 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0809a950 con 0x55689a52dda0 2023-07-21T22:24:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.837+0000 7fdd00ff9700 1 -- 172.21.15.151:0/3045911548 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd0809e980 con 0x55689a52dda0 2023-07-21T22:24:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.837+0000 7fdd00ff9700 1 -- 172.21.15.151:0/3045911548 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080cb1c0 con 0x55689a52dda0 2023-07-21T22:24:14.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.837+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/3045911548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 msgr2=0x55689a538700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.837+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a538700 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fdd08096e50 tx=0x7fdd0809a510 comp rx=0 tx=0).stop 2023-07-21T22:24:14.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.838+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/3045911548 shutdown_connections 2023-07-21T22:24:14.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.838+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a52d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.838+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a53b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.838+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/3045911548 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a538700 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.838+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/3045911548 >> 172.21.15.151:0/3045911548 conn(0x55689a523ef0 msgr2=0x55689a529860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.886 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.838+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/3045911548 shutdown_connections 2023-07-21T22:24:14.887 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.838+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/3045911548 wait complete. 2023-07-21T22:24:14.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.838+0000 7fdd2c6cbb80 1 -- start start 2023-07-21T22:24:14.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.838+0000 7fdd2c6cbb80 1 Processor -- start 2023-07-21T22:24:14.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52d490 0x55689a539010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a539550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a538c40 0x55689a539a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.889 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a41fac0 con 0x55689a52d490 2023-07-21T22:24:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a41f7c0 con 0x55689a538c40 2023-07-21T22:24:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a303920 con 0x55689a52dda0 2023-07-21T22:24:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd2c6cbb80 10 client.0 _ll_register_callbacks cb 0x55689a41d760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:14.890 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd1259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52d490 0x55689a539010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd1259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52d490 0x55689a539010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45254/0 (socket says 172.21.15.151:45254) 2023-07-21T22:24:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd1259c700 1 -- 172.21.15.151:0/2727374211 learned_addr learned my addr 172.21.15.151:0/2727374211 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.839+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a539550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.891 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdd12d9d700 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a538c40 0x55689a539a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdd1259c700 1 -- 172.21.15.151:0/2727374211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 msgr2=0x55689a539550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdd1259c700 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a539550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdd1259c700 1 -- 172.21.15.151:0/2727374211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a538c40 msgr2=0x55689a539a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdd1259c700 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a538c40 0x55689a539a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdd1259c700 1 -- 172.21.15.151:0/2727374211 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd141a48f0 con 0x55689a52d490 2023-07-21T22:24:14.892 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a539550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:14.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdd1259c700 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52d490 0x55689a539010 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdd04012740 tx=0x7fdd04012b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c97b8d90772b3c6e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdcf9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:14.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/2727374211 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd04017070 con 0x55689a52d490 2023-07-21T22:24:14.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/2727374211 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55689a3d94f0 con 0x55689a52d490 2023-07-21T22:24:14.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.840+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/2727374211 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdd04004050 con 0x55689a52d490 2023-07-21T22:24:14.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/2727374211 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd04004210 con 0x55689a52d490 2023-07-21T22:24:14.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdd2c6cbb80 10 client.16449 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:14.893 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/2727374211 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55689a296c60 con 0x55689a52d490 2023-07-21T22:24:14.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/2727374211 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55689a3d94f0 con 0x55689a52d490 2023-07-21T22:24:14.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/2727374211 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdd0400f640 con 0x55689a52d490 2023-07-21T22:24:14.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdd2c6cbb80 10 client.16449 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:14.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdd2c6cbb80 10 client.16449 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:24:14.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdd2c6cbb80 20 client.16449 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:14.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55689a548250 0x55689a54a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.894 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdd2c6cbb80 4 client.16449 mds_command: new command op to 24574 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.841+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/2727374211 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55689a478eb0 con 0x55689a548250 2023-07-21T22:24:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.842+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55689a548250 0x55689a54a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.842+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55689a548250 0x55689a54a660 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b74bdd2f4e200770 server_cookie=65b73b072a2d559a in_seq=0 out_seq=0 2023-07-21T22:24:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.842+0000 7fdcf9ffb700 10 client.16449 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:24:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/2727374211 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55689a478eb0 con 0x55689a548250 2023-07-21T22:24:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdcf9ffb700 10 client.16449 handle_command_reply: tid=0 2023-07-21T22:24:14.895 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdd2c6cbb80 1 client.16449 shutdown 2023-07-21T22:24:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/2727374211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52d490 msgr2=0x55689a539010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52d490 0x55689a539010 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdd04012740 tx=0x7fdd04012b00 comp rx=0 tx=0).stop 2023-07-21T22:24:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/2727374211 shutdown_connections 2023-07-21T22:24:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55689a548250 0x55689a54a660 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a538c40 0x55689a539a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52d490 0x55689a539010 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.896 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/2727374211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a539550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/2727374211 >> 172.21.15.151:0/2727374211 conn(0x55689a523ef0 msgr2=0x55689a529450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.843+0000 7fdcf9ffb700 0 client.16449 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:24:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.844+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/2727374211 shutdown_connections 2023-07-21T22:24:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.844+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/2727374211 wait complete. 2023-07-21T22:24:14.897 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.844+0000 7fdd2c6cbb80 20 client.16449 trim_cache size 0 max 16384 2023-07-21T22:24:14.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.861+0000 7fdd2c6cbb80 1 Processor -- start 2023-07-21T22:24:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.861+0000 7fdd2c6cbb80 1 -- start start 2023-07-21T22:24:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.861+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a53d040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a5445c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a534f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a538330 con 0x55689a52dda0 2023-07-21T22:24:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a52e650 con 0x55689a52d490 2023-07-21T22:24:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a536210 con 0x55689a538c40 2023-07-21T22:24:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd12d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a534f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd11d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a5445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd12d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a534f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50022/0 (socket says 172.21.15.151:50022) 2023-07-21T22:24:14.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd12d9d700 1 -- 172.21.15.151:0/4065243056 learned_addr learned my addr 172.21.15.151:0/4065243056 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:14 smithi195 ceph-mon[97365]: pgmap v154: 97 pgs: 97 active+clean; 4.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 35 MiB/s wr, 224 op/s 2023-07-21T22:24:14.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:14 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/4024438495' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:24:14.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd1259c700 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a53d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd12d9d700 1 -- 172.21.15.151:0/4065243056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 msgr2=0x55689a53d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.862+0000 7fdd12d9d700 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a53d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.863+0000 7fdd12d9d700 1 -- 172.21.15.151:0/4065243056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 msgr2=0x55689a5445c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.863+0000 7fdd12d9d700 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a5445c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.863+0000 7fdd12d9d700 1 -- 172.21.15.151:0/4065243056 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55689a2d4250 con 0x55689a538c40 2023-07-21T22:24:14.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.863+0000 7fdd1259c700 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a53d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.863+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a5445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.863+0000 7fdd12d9d700 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a534f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009b20 tx=0x7fdd0c00b070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99b9bf0b7c76850d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.863+0000 7fdd017fa700 1 -- 172.21.15.151:0/4065243056 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c029070 con 0x55689a538c40 2023-07-21T22:24:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.863+0000 7fdd017fa700 1 -- 172.21.15.151:0/4065243056 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd0c004bb0 con 0x55689a538c40 2023-07-21T22:24:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.863+0000 7fdd017fa700 1 -- 172.21.15.151:0/4065243056 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd0c005020 con 0x55689a538c40 2023-07-21T22:24:14.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.864+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4065243056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 msgr2=0x55689a534f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.864+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a534f20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009b20 tx=0x7fdd0c00b070 comp rx=0 tx=0).stop 2023-07-21T22:24:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.864+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4065243056 shutdown_connections 2023-07-21T22:24:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.864+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a53d040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.864+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a538c40 0x55689a534f20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.864+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4065243056 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a52dda0 0x55689a5445c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.864+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4065243056 >> 172.21.15.151:0/4065243056 conn(0x55689a523ef0 msgr2=0x55689a5437f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.865+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4065243056 shutdown_connections 2023-07-21T22:24:14.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.865+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4065243056 wait complete. 2023-07-21T22:24:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.865+0000 7fdd2c6cbb80 1 -- start start 2023-07-21T22:24:14.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.865+0000 7fdd2c6cbb80 1 Processor -- start 2023-07-21T22:24:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a595850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a595d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd2c6cbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a538c40 0x55689a5900a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a5906d0 con 0x55689a538c40 2023-07-21T22:24:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a590840 con 0x55689a52d490 2023-07-21T22:24:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd2c6cbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55689a590a00 con 0x55689a52dda0 2023-07-21T22:24:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd2c6cbb80 10 client.0 _ll_register_callbacks cb 0x7fdd04009dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd12d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a538c40 0x55689a5900a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd11d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a595d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd12d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a538c40 0x55689a5900a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45270/0 (socket says 172.21.15.151:45270) 2023-07-21T22:24:14.917 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd12d9d700 1 -- 172.21.15.151:0/4001160485 learned_addr learned my addr 172.21.15.151:0/4001160485 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd11d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a595d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50038/0 (socket says 172.21.15.151:50038) 2023-07-21T22:24:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.866+0000 7fdd1259c700 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a595850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdd11d9b700 1 -- 172.21.15.151:0/4001160485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 msgr2=0x55689a595850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a595850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdd11d9b700 1 -- 172.21.15.151:0/4001160485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a538c40 msgr2=0x55689a5900a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a538c40 0x55689a5900a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdd11d9b700 1 -- 172.21.15.151:0/4001160485 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55689a2adde0 con 0x55689a52dda0 2023-07-21T22:24:14.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdd11d9b700 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a595d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd08096d00 tx=0x7fdd08005950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=849a50cbcbf5d0e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:14.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdcf9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:24:14.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/4001160485 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd080cb1c0 con 0x55689a52dda0 2023-07-21T22:24:14.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4001160485 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd0809e980 con 0x55689a52dda0 2023-07-21T22:24:14.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.867+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/4001160485 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdd080cb320 con 0x55689a52dda0 2023-07-21T22:24:14.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/4001160485 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd0809ebe0 con 0x55689a52dda0 2023-07-21T22:24:14.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdd2c6cbb80 10 client.26221 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:14.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4001160485 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7fdd0c021040 con 0x55689a52dda0 2023-07-21T22:24:14.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/4001160485 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd0809e980 con 0x55689a52dda0 2023-07-21T22:24:14.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/4001160485 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdd0809abb0 con 0x55689a52dda0 2023-07-21T22:24:14.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdd2c6cbb80 10 client.26221 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:14.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdd2c6cbb80 10 client.26221 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:24:14.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdd2c6cbb80 20 client.26221 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:14.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55689a59d380 0x55689a59f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:14.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdd2c6cbb80 4 client.26221 mds_command: new command op to 24574 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:24:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.868+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4001160485 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55689a43b050 con 0x55689a59d380 2023-07-21T22:24:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.869+0000 7fdd1259c700 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55689a59d380 0x55689a59f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.869+0000 7fdd1259c700 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55689a59d380 0x55689a59f790 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dde929c3f5c8d2c5 server_cookie=24a14ea521dfd391 in_seq=0 out_seq=0 2023-07-21T22:24:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.869+0000 7fdcf9ffb700 10 client.26221 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:24:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdcf9ffb700 1 -- 172.21.15.151:0/4001160485 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55689a43b050 con 0x55689a59d380 2023-07-21T22:24:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdcf9ffb700 10 client.26221 handle_command_reply: tid=0 2023-07-21T22:24:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 client.26221 shutdown 2023-07-21T22:24:14.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4001160485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 msgr2=0x55689a595d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a595d90 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fdd08096d00 tx=0x7fdd08005950 comp rx=0 tx=0).stop 2023-07-21T22:24:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4001160485 shutdown_connections 2023-07-21T22:24:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x55689a59d380 0x55689a59f790 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55689a52d490 0x55689a595850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55689a538c40 0x55689a5900a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdcf9ffb700 0 client.26221 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:24:14.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 --2- 172.21.15.151:0/4001160485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55689a52dda0 0x55689a595d90 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4001160485 >> 172.21.15.151:0/4001160485 conn(0x55689a523ef0 msgr2=0x55689a537520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4001160485 shutdown_connections 2023-07-21T22:24:14.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 1 -- 172.21.15.151:0/4001160485 wait complete. 2023-07-21T22:24:14.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.870+0000 7fdd2c6cbb80 20 client.26221 trim_cache size 0 max 16384 2023-07-21T22:24:14.923 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:24:14.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 -- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdcfc0a13e0 msgr2=0x7fdcfc0a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdcfc0a13e0 0x7fdcfc0a3890 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd0c009e10 tx=0x7fdd0c009490 comp rx=0 tx=0).stop 2023-07-21T22:24:14.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 -- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 msgr2=0x7fdd1419de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:14.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 0x7fdd1419de40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fdd080098e0 tx=0x7fdd0800b9c0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 -- 172.21.15.151:0/996097331 shutdown_connections 2023-07-21T22:24:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdcfc0a13e0 0x7fdcfc0a3890 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd14106ea0 0x7fdd14197970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd14101e60 0x7fdd1419d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 --2- 172.21.15.151:0/996097331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd14102800 0x7fdd1419de40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.871+0000 7fdd1359e700 1 -- 172.21.15.151:0/996097331 >> 172.21.15.151:0/996097331 conn(0x7fdd140fd690 msgr2=0x7fdd140fe190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.872+0000 7fdd1359e700 1 -- 172.21.15.151:0/996097331 shutdown_connections 2023-07-21T22:24:14.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:14.872+0000 7fdd1359e700 1 -- 172.21.15.151:0/996097331 wait complete. 2023-07-21T22:24:14.936 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-21T22:24:15.060 INFO:teuthology.orchestra.run.smithi151.stderr:20000000 of 50000000 tuples (40%) done (elapsed 278.55 s, remaining 417.83 s) 2023-07-21T22:24:15.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.133+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/1791837479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e08100480 msgr2=0x7f2e0810c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:15.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.133+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/1791837479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e08100480 0x7f2e0810c910 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f2e00009f90 tx=0x7f2e0000b330 comp rx=0 tx=0).stop 2023-07-21T22:24:15.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.133+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/1791837479 shutdown_connections 2023-07-21T22:24:15.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.133+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/1791837479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e08105ae0 0x7f2e08105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.133+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/1791837479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e08100480 0x7f2e0810c910 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.133+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/1791837479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e080ffad0 0x7f2e080fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.133+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/1791837479 >> 172.21.15.151:0/1791837479 conn(0x7f2e080fb5f0 msgr2=0x7f2e080fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:15.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.133+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/1791837479 shutdown_connections 2023-07-21T22:24:15.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.134+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/1791837479 wait complete. 2023-07-21T22:24:15.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.135+0000 7f2e0e3ff700 1 Processor -- start 2023-07-21T22:24:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.135+0000 7f2e0e3ff700 1 -- start start 2023-07-21T22:24:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e0e3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e080ffad0 0x7f2e08197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e0e3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e08100480 0x7f2e08198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e0e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e08105ae0 0x7f2e0819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e0e3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0819cdf0 con 0x7f2e080ffad0 2023-07-21T22:24:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e0e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0819cf60 con 0x7f2e08105ae0 2023-07-21T22:24:15.182 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e0e3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e0819d120 con 0x7f2e08100480 2023-07-21T22:24:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e080ffad0 0x7f2e08197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e080ffad0 0x7f2e08197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45290/0 (socket says 172.21.15.151:45290) 2023-07-21T22:24:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e07fff700 1 -- 172.21.15.151:0/278572533 learned_addr learned my addr 172.21.15.151:0/278572533 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:15.183 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e077fe700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e08100480 0x7f2e08198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e0c99c700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e08105ae0 0x7f2e0819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.136+0000 7f2e07fff700 1 -- 172.21.15.151:0/278572533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e08100480 msgr2=0x7f2e08198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:15.184 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e07fff700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e08100480 0x7f2e08198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e07fff700 1 -- 172.21.15.151:0/278572533 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e08105ae0 msgr2=0x7f2e0819c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:15.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e07fff700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e08105ae0 0x7f2e0819c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e07fff700 1 -- 172.21.15.151:0/278572533 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e00009c40 con 0x7f2e080ffad0 2023-07-21T22:24:15.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e077fe700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e08100480 0x7f2e08198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:15.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e07fff700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e080ffad0 0x7f2e08197e10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2df800e9a0 tx=0x7f2df800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:15.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e057fa700 1 -- 172.21.15.151:0/278572533 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df8009790 con 0x7f2e080ffad0 2023-07-21T22:24:15.185 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/278572533 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e0819d400 con 0x7f2e080ffad0 2023-07-21T22:24:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e057fa700 1 -- 172.21.15.151:0/278572533 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2df800cbd0 con 0x7f2e080ffad0 2023-07-21T22:24:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e057fa700 1 -- 172.21.15.151:0/278572533 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800eee0 con 0x7f2e080ffad0 2023-07-21T22:24:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.137+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/278572533 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e081a4c40 con 0x7f2e080ffad0 2023-07-21T22:24:15.186 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.141+0000 7f2e057fa700 1 -- 172.21.15.151:0/278572533 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2df800cd40 con 0x7f2e080ffad0 2023-07-21T22:24:15.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e057fa700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2df00a1340 0x7f2df00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e21c4eb80 1 Processor -- start 2023-07-21T22:24:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e057fa700 1 -- 172.21.15.151:0/278572533 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2df8014070 con 0x7f2e080ffad0 2023-07-21T22:24:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e21c4eb80 1 -- start start 2023-07-21T22:24:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e077fe700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2df00a1340 0x7f2df00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.189 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907f4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f4930 0x563d907f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d906f9cb0 con 0x563d907f9ac0 2023-07-21T22:24:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.143+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9074ca40 con 0x563d907f4930 2023-07-21T22:24:15.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d90745ed0 con 0x563d907f91b0 2023-07-21T22:24:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.191 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e077fe700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2df00a1340 0x7f2df00a37f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e08199420 tx=0x7f2dfc009310 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907f4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45300/0 (socket says 172.21.15.151:45300) 2023-07-21T22:24:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e077fe700 1 -- 172.21.15.151:0/2377175092 learned_addr learned my addr 172.21.15.151:0/2377175092 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e0c99c700 1 --2- 172.21.15.151:0/2377175092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f4930 0x563d907f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e07fff700 1 -- 172.21.15.151:0/2377175092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f4930 msgr2=0x563d907f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2377175092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f4930 0x563d907f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.192 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e07fff700 1 -- 172.21.15.151:0/2377175092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 msgr2=0x563d907f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2377175092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907f4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.144+0000 7f2e07fff700 1 -- 172.21.15.151:0/2377175092 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d90573de0 con 0x563d907f91b0 2023-07-21T22:24:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.145+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2377175092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f9580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2df80ca600 tx=0x7f2df8099960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8fae703fcc131cd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.145+0000 7f2dee7fc700 1 -- 172.21.15.151:0/2377175092 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df809dfb0 con 0x563d907f91b0 2023-07-21T22:24:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.145+0000 7f2dee7fc700 1 -- 172.21.15.151:0/2377175092 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2df80a23d0 con 0x563d907f91b0 2023-07-21T22:24:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.145+0000 7f2dee7fc700 1 -- 172.21.15.151:0/2377175092 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80a2140 con 0x563d907f91b0 2023-07-21T22:24:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.145+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2377175092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 msgr2=0x563d907f9580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:15.193 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.145+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2377175092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f9580 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f2df80ca600 tx=0x7f2df8099960 comp rx=0 tx=0).stop 2023-07-21T22:24:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.146+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2377175092 shutdown_connections 2023-07-21T22:24:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.146+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2377175092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f4930 0x563d907f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.146+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2377175092 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f9580 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.146+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2377175092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.146+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2377175092 >> 172.21.15.151:0/2377175092 conn(0x563d907e9ef0 msgr2=0x563d907ef830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:15.194 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.146+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2377175092 shutdown_connections 2023-07-21T22:24:15.195 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.146+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2377175092 wait complete. 2023-07-21T22:24:15.196 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.146+0000 7f2e21c4eb80 1 -- start start 2023-07-21T22:24:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.146+0000 7f2e21c4eb80 1 Processor -- start 2023-07-21T22:24:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f4930 0x563d90800bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 0x563d907fdee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907fe620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d906e5ac0 con 0x563d907f9ac0 2023-07-21T22:24:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d906e57c0 con 0x563d907f91b0 2023-07-21T22:24:15.197 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d905c9920 con 0x563d907f4930 2023-07-21T22:24:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e21c4eb80 10 client.0 _ll_register_callbacks cb 0x563d906e3760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e0c99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907fe620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e0c99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907fe620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45302/0 (socket says 172.21.15.151:45302) 2023-07-21T22:24:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e0c99c700 1 -- 172.21.15.151:0/2180620393 learned_addr learned my addr 172.21.15.151:0/2180620393 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.147+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f4930 0x563d90800bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.148+0000 7f2e077fe700 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 0x563d907fdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.148+0000 7f2e07fff700 1 -- 172.21.15.151:0/2180620393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 msgr2=0x563d907fdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:15.198 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.148+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 0x563d907fdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.148+0000 7f2e07fff700 1 -- 172.21.15.151:0/2180620393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 msgr2=0x563d907fe620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.148+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907fe620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.148+0000 7f2e07fff700 1 -- 172.21.15.151:0/2180620393 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e081a4c40 con 0x563d907f4930 2023-07-21T22:24:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.148+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f4930 0x563d90800bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2df8096480 tx=0x7f2df8010b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fef9ced2890f99ac server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.148+0000 7f2de77fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:24:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.148+0000 7f2de77fe700 1 -- 172.21.15.151:0/2180620393 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80b6070 con 0x563d907f4930 2023-07-21T22:24:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2de77fe700 1 -- 172.21.15.151:0/2180620393 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2df80b82b0 con 0x563d907f4930 2023-07-21T22:24:15.199 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2180620393 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d9069f4f0 con 0x563d907f4930 2023-07-21T22:24:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2de77fe700 1 -- 172.21.15.151:0/2180620393 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2df8099740 con 0x563d907f4930 2023-07-21T22:24:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2e21c4eb80 10 client.26233 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2180620393 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x563d9055cc60 con 0x563d907f4930 2023-07-21T22:24:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2de77fe700 1 -- 172.21.15.151:0/2180620393 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2df807c080 con 0x563d907f4930 2023-07-21T22:24:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2de77fe700 1 -- 172.21.15.151:0/2180620393 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2df8094b90 con 0x563d907f4930 2023-07-21T22:24:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2e21c4eb80 10 client.26233 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:15.200 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2e21c4eb80 10 client.26233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2e21c4eb80 20 client.26233 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563d908168f0 0x563d90818d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2e21c4eb80 4 client.26233 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.149+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2180620393 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d9073eeb0 con 0x563d908168f0 2023-07-21T22:24:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.150+0000 7f2e077fe700 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563d908168f0 0x563d90818d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.150+0000 7f2e077fe700 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563d908168f0 0x563d90818d00 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ce33b60a1143983 server_cookie=fb68f1a66001e1a6 in_seq=0 out_seq=0 2023-07-21T22:24:15.201 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.150+0000 7f2de77fe700 10 client.26233 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.151+0000 7f2de77fe700 1 -- 172.21.15.151:0/2180620393 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563d9073eeb0 con 0x563d908168f0 2023-07-21T22:24:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.151+0000 7f2de77fe700 10 client.26233 handle_command_reply: tid=0 2023-07-21T22:24:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.151+0000 7f2e21c4eb80 1 client.26233 shutdown 2023-07-21T22:24:15.202 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.151+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2180620393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f4930 msgr2=0x563d90800bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.151+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f4930 0x563d90800bf0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2df8096480 tx=0x7f2df8010b20 comp rx=0 tx=0).stop 2023-07-21T22:24:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2180620393 shutdown_connections 2023-07-21T22:24:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563d908168f0 0x563d90818d00 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f9ac0 0x563d907fe620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f4930 0x563d90800bf0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2180620393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 0x563d907fdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.203 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2de77fe700 0 client.26233 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2180620393 >> 172.21.15.151:0/2180620393 conn(0x563d907e9ef0 msgr2=0x563d907ef420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2180620393 shutdown_connections 2023-07-21T22:24:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2180620393 wait complete. 2023-07-21T22:24:15.204 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.152+0000 7f2e21c4eb80 20 client.26233 trim_cache size 0 max 16384 2023-07-21T22:24:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.166+0000 7f2e21c4eb80 1 Processor -- start 2023-07-21T22:24:15.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.166+0000 7f2e21c4eb80 1 -- start start 2023-07-21T22:24:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d90800790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f9ac0 0x563d907f3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d907e6e50 con 0x563d907f4930 2023-07-21T22:24:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d907e7030 con 0x563d907f9ac0 2023-07-21T22:24:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d907f53e0 con 0x563d907f91b0 2023-07-21T22:24:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d90800790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d90800790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45312/0 (socket says 172.21.15.151:45312) 2023-07-21T22:24:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e07fff700 1 -- 172.21.15.151:0/2201057006 learned_addr learned my addr 172.21.15.151:0/2201057006 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e077fe700 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e0c99c700 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f9ac0 0x563d907f3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e07fff700 1 -- 172.21.15.151:0/2201057006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 msgr2=0x563d907f3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e07fff700 1 -- 172.21.15.151:0/2201057006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f9ac0 msgr2=0x563d907f3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f9ac0 0x563d907f3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e07fff700 1 -- 172.21.15.151:0/2201057006 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d9059a250 con 0x563d907f4930 2023-07-21T22:24:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e077fe700 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.167+0000 7f2e0c99c700 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f9ac0 0x563d907f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:24:15.215 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.168+0000 7f2e07fff700 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d90800790 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2df8099c80 tx=0x7f2df8099e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3e36d17e09396a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.168+0000 7f2deeffd700 1 -- 172.21.15.151:0/2201057006 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80b6020 con 0x563d907f4930 2023-07-21T22:24:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.168+0000 7f2deeffd700 1 -- 172.21.15.151:0/2201057006 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563d9069f4f0 con 0x563d907f4930 2023-07-21T22:24:15.217 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.168+0000 7f2deeffd700 1 -- 172.21.15.151:0/2201057006 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80a21a0 con 0x563d907f4930 2023-07-21T22:24:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2201057006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 msgr2=0x563d90800790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d90800790 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f2df8099c80 tx=0x7f2df8099e80 comp rx=0 tx=0).stop 2023-07-21T22:24:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2201057006 shutdown_connections 2023-07-21T22:24:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f9ac0 0x563d907f3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d90800790 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/2201057006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f91b0 0x563d907f3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2201057006 >> 172.21.15.151:0/2201057006 conn(0x563d907e9ef0 msgr2=0x563d907edf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:15.218 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2201057006 shutdown_connections 2023-07-21T22:24:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/2201057006 wait complete. 2023-07-21T22:24:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.169+0000 7f2e21c4eb80 1 -- start start 2023-07-21T22:24:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.170+0000 7f2e21c4eb80 1 Processor -- start 2023-07-21T22:24:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.170+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d9080dca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.170+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 0x563d9080bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.219 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.170+0000 7f2e21c4eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f9ac0 0x563d9080c510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.170+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9080ca50 con 0x563d907f4930 2023-07-21T22:24:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.170+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9080cbc0 con 0x563d907f91b0 2023-07-21T22:24:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.170+0000 7f2e21c4eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d9080cd80 con 0x563d907f9ac0 2023-07-21T22:24:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.170+0000 7f2e21c4eb80 10 client.0 _ll_register_callbacks cb 0x563d906e3760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d9080dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d9080dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45322/0 (socket says 172.21.15.151:45322) 2023-07-21T22:24:15.220 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e07fff700 1 -- 172.21.15.151:0/1405814213 learned_addr learned my addr 172.21.15.151:0/1405814213 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:15.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e0c99c700 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f9ac0 0x563d9080c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e077fe700 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 0x563d9080bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e07fff700 1 -- 172.21.15.151:0/1405814213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f9ac0 msgr2=0x563d9080c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:15.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e07fff700 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f9ac0 0x563d9080c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e07fff700 1 -- 172.21.15.151:0/1405814213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 msgr2=0x563d9080bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:15.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e07fff700 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 0x563d9080bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.221 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e07fff700 1 -- 172.21.15.151:0/1405814213 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d9055cc60 con 0x563d907f4930 2023-07-21T22:24:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e0c99c700 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f9ac0 0x563d9080c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2e07fff700 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d9080dca0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2df80982d0 tx=0x7f2df80ca6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=baa277da164e414b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2de77fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.171+0000 7f2de77fe700 1 -- 172.21.15.151:0/1405814213 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80a2140 con 0x563d907f4930 2023-07-21T22:24:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/1405814213 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2df80a23d0 con 0x563d907f4930 2023-07-21T22:24:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2de77fe700 1 -- 172.21.15.151:0/1405814213 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f2df809dfb0 con 0x563d907f4930 2023-07-21T22:24:15.222 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2de77fe700 1 -- 172.21.15.151:0/1405814213 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2df80ca170 con 0x563d907f4930 2023-07-21T22:24:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2e21c4eb80 10 client.16473 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:15.223 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/1405814213 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x563d905722b0 con 0x563d907f4930 2023-07-21T22:24:15.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2de77fe700 1 -- 172.21.15.151:0/1405814213 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2df80a23d0 con 0x563d907f4930 2023-07-21T22:24:15.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2de77fe700 1 -- 172.21.15.151:0/1405814213 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2df809b060 con 0x563d907f4930 2023-07-21T22:24:15.224 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2e21c4eb80 10 client.16473 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2e21c4eb80 10 client.16473 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2e21c4eb80 20 client.16473 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563d9086b6d0 0x563d9086dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2e21c4eb80 4 client.16473 mds_command: new command op to 24599 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:24:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.172+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/1405814213 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563d90701050 con 0x563d9086b6d0 2023-07-21T22:24:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.173+0000 7f2e077fe700 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563d9086b6d0 0x563d9086dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e077fe700 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563d9086b6d0 0x563d9086dab0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53ccb8d9fbc65992 server_cookie=9e3fe3926fee2db7 in_seq=0 out_seq=0 2023-07-21T22:24:15.225 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2de77fe700 10 client.16473 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2de77fe700 1 -- 172.21.15.151:0/1405814213 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563d90701050 con 0x563d9086b6d0 2023-07-21T22:24:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2de77fe700 10 client.16473 handle_command_reply: tid=0 2023-07-21T22:24:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 client.16473 shutdown 2023-07-21T22:24:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/1405814213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 msgr2=0x563d9080dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d9080dca0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f2df80982d0 tx=0x7f2df80ca6e0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/1405814213 shutdown_connections 2023-07-21T22:24:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563d9086b6d0 0x563d9086dab0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.226 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d907f9ac0 0x563d9080c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d907f4930 0x563d9080dca0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 --2- 172.21.15.151:0/1405814213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d907f91b0 0x563d9080bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/1405814213 >> 172.21.15.151:0/1405814213 conn(0x563d907e9ef0 msgr2=0x563d907f3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2de77fe700 0 client.16473 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/1405814213 shutdown_connections 2023-07-21T22:24:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 1 -- 172.21.15.151:0/1405814213 wait complete. 2023-07-21T22:24:15.227 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.174+0000 7f2e21c4eb80 20 client.16473 trim_cache size 0 max 16384 2023-07-21T22:24:15.228 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:24:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2df00a1340 msgr2=0x7f2df00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:15.228 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2df00a1340 0x7f2df00a37f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2e08199420 tx=0x7f2dfc009310 comp rx=0 tx=0).stop 2023-07-21T22:24:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e080ffad0 msgr2=0x7f2e08197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e080ffad0 0x7f2e08197e10 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f2df800e9a0 tx=0x7f2df800ed60 comp rx=0 tx=0).stop 2023-07-21T22:24:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/278572533 shutdown_connections 2023-07-21T22:24:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2df00a1340 0x7f2df00a37f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e08105ae0 0x7f2e0819c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e080ffad0 0x7f2e08197e10 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 --2- 172.21.15.151:0/278572533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2e08100480 0x7f2e08198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:15.229 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/278572533 >> 172.21.15.151:0/278572533 conn(0x7f2e080fb5f0 msgr2=0x7f2e080fbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/278572533 shutdown_connections 2023-07-21T22:24:15.230 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:15.175+0000 7f2e0e3ff700 1 -- 172.21.15.151:0/278572533 wait complete. 2023-07-21T22:24:16.241 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-21T22:24:16.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-21T22:24:16.430 INFO:teuthology.orchestra.run.smithi151.stderr:20100000 of 50000000 tuples (40%) done (elapsed 279.92 s, remaining 416.40 s) 2023-07-21T22:24:16.495 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.450+0000 7fdf4999d700 1 -- 172.21.15.151:0/932713787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 msgr2=0x7fdf44109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.450+0000 7fdf4999d700 1 --2- 172.21.15.151:0/932713787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 0x7fdf44109a80 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fdf30009990 tx=0x7fdf30009ca0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.450+0000 7fdf4999d700 1 -- 172.21.15.151:0/932713787 shutdown_connections 2023-07-21T22:24:16.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.450+0000 7fdf4999d700 1 --2- 172.21.15.151:0/932713787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf44100aa0 0x7fdf44100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.450+0000 7fdf4999d700 1 --2- 172.21.15.151:0/932713787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf44109fc0 0x7fdf4410c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.450+0000 7fdf4999d700 1 --2- 172.21.15.151:0/932713787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 0x7fdf44109a80 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.496 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.450+0000 7fdf4999d700 1 -- 172.21.15.151:0/932713787 >> 172.21.15.151:0/932713787 conn(0x7fdf440745d0 msgr2=0x7fdf440749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.450+0000 7fdf4999d700 1 -- 172.21.15.151:0/932713787 shutdown_connections 2023-07-21T22:24:16.497 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.450+0000 7fdf4999d700 1 -- 172.21.15.151:0/932713787 wait complete. 2023-07-21T22:24:16.498 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.451+0000 7fdf4999d700 1 Processor -- start 2023-07-21T22:24:16.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.451+0000 7fdf4999d700 1 -- start start 2023-07-21T22:24:16.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf4999d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf44100aa0 0x7fdf4419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf4999d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 0x7fdf4419bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf4999d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf44109fc0 0x7fdf44195720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf4999d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44195d90 con 0x7fdf441013b0 2023-07-21T22:24:16.499 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf4999d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf44195f00 con 0x7fdf44109fc0 2023-07-21T22:24:16.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf4999d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf441960c0 con 0x7fdf44100aa0 2023-07-21T22:24:16.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf43fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 0x7fdf4419bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf43fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 0x7fdf4419bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39526/0 (socket says 172.21.15.151:39526) 2023-07-21T22:24:16.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf43fff700 1 -- 172.21.15.151:0/1139665193 learned_addr learned my addr 172.21.15.151:0/1139665193 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf4919c700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf44109fc0 0x7fdf44195720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf4899b700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf44100aa0 0x7fdf4419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.500 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf43fff700 1 -- 172.21.15.151:0/1139665193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf44100aa0 msgr2=0x7fdf4419b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf43fff700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf44100aa0 0x7fdf4419b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf43fff700 1 -- 172.21.15.151:0/1139665193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf44109fc0 msgr2=0x7fdf44195720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf43fff700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf44109fc0 0x7fdf44195720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.452+0000 7fdf43fff700 1 -- 172.21.15.151:0/1139665193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf300095f0 con 0x7fdf441013b0 2023-07-21T22:24:16.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.453+0000 7fdf43fff700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 0x7fdf4419bbf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdf30000c00 tx=0x7fdf30004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.453+0000 7fdf41ffb700 1 -- 172.21.15.151:0/1139665193 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3001d070 con 0x7fdf441013b0 2023-07-21T22:24:16.501 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.453+0000 7fdf41ffb700 1 -- 172.21.15.151:0/1139665193 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf30022470 con 0x7fdf441013b0 2023-07-21T22:24:16.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.453+0000 7fdf4999d700 1 -- 172.21.15.151:0/1139665193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf44196340 con 0x7fdf441013b0 2023-07-21T22:24:16.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.453+0000 7fdf41ffb700 1 -- 172.21.15.151:0/1139665193 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf30017650 con 0x7fdf441013b0 2023-07-21T22:24:16.502 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.453+0000 7fdf4999d700 1 -- 172.21.15.151:0/1139665193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf441a26a0 con 0x7fdf441013b0 2023-07-21T22:24:16.503 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.458+0000 7fdf41ffb700 1 -- 172.21.15.151:0/1139665193 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdf300225e0 con 0x7fdf441013b0 2023-07-21T22:24:16.504 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.458+0000 7fdf5e5d1b80 1 Processor -- start 2023-07-21T22:24:16.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.459+0000 7fdf5e5d1b80 1 -- start start 2023-07-21T22:24:16.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.459+0000 7fdf41ffb700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf340a1360 0x7fdf340a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.459+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.459+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 0x55b85f6dab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.505 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.459+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6db0d0 0x55b85f6dd4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.459+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f5d1d30 con 0x55b85f6cbe20 2023-07-21T22:24:16.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.459+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f624ac0 con 0x55b85f6cb510 2023-07-21T22:24:16.506 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.459+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f61df50 con 0x55b85f6db0d0 2023-07-21T22:24:16.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf41ffb700 1 -- 172.21.15.151:0/1139665193 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdf300ce1d0 con 0x7fdf441013b0 2023-07-21T22:24:16.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4899b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4899b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52596/0 (socket says 172.21.15.151:52596) 2023-07-21T22:24:16.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4899b700 1 -- 172.21.15.151:0/2932027822 learned_addr learned my addr 172.21.15.151:0/2932027822 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.507 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4919c700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf340a1360 0x7fdf340a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf43fff700 1 --2- 172.21.15.151:0/2932027822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 0x55b85f6dab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4919c700 1 --2- 172.21.15.151:0/2932027822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6db0d0 0x55b85f6dd4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4899b700 1 -- 172.21.15.151:0/2932027822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6db0d0 msgr2=0x55b85f6dd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4899b700 1 --2- 172.21.15.151:0/2932027822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6db0d0 0x55b85f6dd4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4899b700 1 -- 172.21.15.151:0/2932027822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 msgr2=0x55b85f6dab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4899b700 1 --2- 172.21.15.151:0/2932027822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 0x55b85f6dab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.508 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.460+0000 7fdf4899b700 1 -- 172.21.15.151:0/2932027822 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b85f44be60 con 0x55b85f6cb510 2023-07-21T22:24:16.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.461+0000 7fdf4899b700 1 --2- 172.21.15.151:0/2932027822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6cb8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800dc70 tx=0x7fdf3800df80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc19561ff6912b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.461+0000 7fdf4919c700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf340a1360 0x7fdf340a3810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009e10 tx=0x7fdf3c009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.461+0000 7fdf2effd700 1 -- 172.21.15.151:0/2932027822 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3800fc20 con 0x55b85f6cb510 2023-07-21T22:24:16.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.461+0000 7fdf2effd700 1 -- 172.21.15.151:0/2932027822 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf3800fd80 con 0x55b85f6cb510 2023-07-21T22:24:16.509 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.461+0000 7fdf2effd700 1 -- 172.21.15.151:0/2932027822 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf380056f0 con 0x55b85f6cb510 2023-07-21T22:24:16.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.462+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/2932027822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 msgr2=0x55b85f6cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.462+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/2932027822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6cb8e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdf3800dc70 tx=0x7fdf3800df80 comp rx=0 tx=0).stop 2023-07-21T22:24:16.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.462+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/2932027822 shutdown_connections 2023-07-21T22:24:16.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.462+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/2932027822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6cb8e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.462+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/2932027822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6db0d0 0x55b85f6dd4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.512 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.462+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/2932027822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 0x55b85f6dab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.462+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/2932027822 >> 172.21.15.151:0/2932027822 conn(0x55b85f6c1f70 msgr2=0x55b85f6c78e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.462+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/2932027822 shutdown_connections 2023-07-21T22:24:16.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.462+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/2932027822 wait complete. 2023-07-21T22:24:16.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.463+0000 7fdf5e5d1b80 1 -- start start 2023-07-21T22:24:16.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.463+0000 7fdf5e5d1b80 1 Processor -- start 2023-07-21T22:24:16.513 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6dab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 0x55b85f6d7d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6d8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f5bdb40 con 0x55b85f6db0d0 2023-07-21T22:24:16.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f5bd840 con 0x55b85f6cb510 2023-07-21T22:24:16.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f4a19a0 con 0x55b85f6cbe20 2023-07-21T22:24:16.514 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf5e5d1b80 10 client.0 _ll_register_callbacks cb 0x55b85f5bb7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:16.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf4919c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6d8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf4919c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6d8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39548/0 (socket says 172.21.15.151:39548) 2023-07-21T22:24:16.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf4919c700 1 -- 172.21.15.151:0/3946804969 learned_addr learned my addr 172.21.15.151:0/3946804969 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf43fff700 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 0x55b85f6d7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf4899b700 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6dab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf4919c700 1 -- 172.21.15.151:0/3946804969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 msgr2=0x55b85f6d7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf4919c700 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 0x55b85f6d7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf4919c700 1 -- 172.21.15.151:0/3946804969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 msgr2=0x55b85f6dab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf4919c700 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6dab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.464+0000 7fdf4919c700 1 -- 172.21.15.151:0/3946804969 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf3800d8a0 con 0x55b85f6db0d0 2023-07-21T22:24:16.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.465+0000 7fdf4919c700 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6d8440 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c003d30 tx=0x7fdf3c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8456ee37bd0995d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.465+0000 7fdf23fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:16.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.465+0000 7fdf23fff700 1 -- 172.21.15.151:0/3946804969 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c020070 con 0x55b85f6db0d0 2023-07-21T22:24:16.517 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.465+0000 7fdf23fff700 1 -- 172.21.15.151:0/3946804969 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdf3c004040 con 0x55b85f6db0d0 2023-07-21T22:24:16.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.465+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3946804969 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b85f577570 con 0x55b85f6db0d0 2023-07-21T22:24:16.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.465+0000 7fdf23fff700 1 -- 172.21.15.151:0/3946804969 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf3c00e070 con 0x55b85f6db0d0 2023-07-21T22:24:16.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf5e5d1b80 10 client.16485 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:16.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3946804969 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55b85f434ce0 con 0x55b85f6db0d0 2023-07-21T22:24:16.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf23fff700 1 -- 172.21.15.151:0/3946804969 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf3c032020 con 0x55b85f6db0d0 2023-07-21T22:24:16.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf23fff700 1 -- 172.21.15.151:0/3946804969 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdf3c01a710 con 0x55b85f6db0d0 2023-07-21T22:24:16.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf5e5d1b80 10 client.16485 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:16.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf5e5d1b80 10 client.16485 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:16.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf5e5d1b80 20 client.16485 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:16.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b85f6eab40 0x55b85f6ecf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf5e5d1b80 4 client.16485 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:16.521 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.466+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3946804969 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b85f616f30 con 0x55b85f6eab40 2023-07-21T22:24:16.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.467+0000 7fdf4899b700 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b85f6eab40 0x55b85f6ecf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.467+0000 7fdf4899b700 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b85f6eab40 0x55b85f6ecf50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eeb418db28db2f3 server_cookie=f8ddb1d9621b86c8 in_seq=0 out_seq=0 2023-07-21T22:24:16.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.467+0000 7fdf23fff700 10 client.16485 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:16.523 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.468+0000 7fdf23fff700 1 -- 172.21.15.151:0/3946804969 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b85f616f30 con 0x55b85f6eab40 2023-07-21T22:24:16.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.468+0000 7fdf23fff700 10 client.16485 handle_command_reply: tid=0 2023-07-21T22:24:16.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.468+0000 7fdf5e5d1b80 1 client.16485 shutdown 2023-07-21T22:24:16.524 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.468+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3946804969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 msgr2=0x55b85f6d8440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.468+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6d8440 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c003d30 tx=0x7fdf3c004b40 comp rx=0 tx=0).stop 2023-07-21T22:24:16.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.468+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3946804969 shutdown_connections 2023-07-21T22:24:16.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.468+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b85f6eab40 0x55b85f6ecf50 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.525 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.469+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f6dab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.469+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6d8440 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.469+0000 7fdf23fff700 0 client.16485 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:16.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.469+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3946804969 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 0x55b85f6d7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.526 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.469+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3946804969 >> 172.21.15.151:0/3946804969 conn(0x55b85f6c1f70 msgr2=0x55b85f6c7470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.469+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3946804969 shutdown_connections 2023-07-21T22:24:16.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.469+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3946804969 wait complete. 2023-07-21T22:24:16.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.469+0000 7fdf5e5d1b80 20 client.16485 trim_cache size 0 max 16384 2023-07-21T22:24:16.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.491+0000 7fdf5e5d1b80 1 Processor -- start 2023-07-21T22:24:16.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.491+0000 7fdf5e5d1b80 1 -- start start 2023-07-21T22:24:16.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cb510 0x55b85f6d7d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.537 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 0x55b85f6da670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6db0d0 0x55b85f6d4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f6c40e0 con 0x55b85f6cbe20 2023-07-21T22:24:16.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f6d8a70 con 0x55b85f6db0d0 2023-07-21T22:24:16.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f6cc700 con 0x55b85f6cb510 2023-07-21T22:24:16.539 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf43fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 0x55b85f6da670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf4919c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6db0d0 0x55b85f6d4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf4919c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6db0d0 0x55b85f6d4fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52614/0 (socket says 172.21.15.151:52614) 2023-07-21T22:24:16.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf4919c700 1 -- 172.21.15.151:0/3572830002 learned_addr learned my addr 172.21.15.151:0/3572830002 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.492+0000 7fdf4899b700 1 --2- 172.21.15.151:0/3572830002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cb510 0x55b85f6d7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.540 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf4919c700 1 -- 172.21.15.151:0/3572830002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cb510 msgr2=0x55b85f6d7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf4919c700 1 --2- 172.21.15.151:0/3572830002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cb510 0x55b85f6d7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf4919c700 1 -- 172.21.15.151:0/3572830002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 msgr2=0x55b85f6da670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf4919c700 1 --2- 172.21.15.151:0/3572830002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 0x55b85f6da670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf4919c700 1 -- 172.21.15.151:0/3572830002 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b85f4722d0 con 0x55b85f6db0d0 2023-07-21T22:24:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf4899b700 1 --2- 172.21.15.151:0/3572830002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cb510 0x55b85f6d7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf4919c700 1 --2- 172.21.15.151:0/3572830002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6db0d0 0x55b85f6d4fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009f80 tx=0x7fdf3c01ac90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=912476769d2b422d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.541 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf2f7fe700 1 -- 172.21.15.151:0/3572830002 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c020050 con 0x55b85f6db0d0 2023-07-21T22:24:16.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf2f7fe700 1 -- 172.21.15.151:0/3572830002 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf3c032040 con 0x55b85f6db0d0 2023-07-21T22:24:16.542 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.493+0000 7fdf2f7fe700 1 -- 172.21.15.151:0/3572830002 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c004360 con 0x55b85f6db0d0 2023-07-21T22:24:16.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.494+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3572830002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6db0d0 msgr2=0x55b85f6d4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.494+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3572830002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6db0d0 0x55b85f6d4fc0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009f80 tx=0x7fdf3c01ac90 comp rx=0 tx=0).stop 2023-07-21T22:24:16.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.494+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3572830002 shutdown_connections 2023-07-21T22:24:16.544 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.494+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3572830002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6db0d0 0x55b85f6d4fc0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.494+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3572830002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cb510 0x55b85f6d7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.494+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/3572830002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6cbe20 0x55b85f6da670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.494+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3572830002 >> 172.21.15.151:0/3572830002 conn(0x55b85f6c1f70 msgr2=0x55b85f6d75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.494+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3572830002 shutdown_connections 2023-07-21T22:24:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.494+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/3572830002 wait complete. 2023-07-21T22:24:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.495+0000 7fdf5e5d1b80 1 -- start start 2023-07-21T22:24:16.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.495+0000 7fdf5e5d1b80 1 Processor -- start 2023-07-21T22:24:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.495+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f739460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.495+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 0x55b85f7399a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.495+0000 7fdf5e5d1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6e1150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f6e1730 con 0x55b85f6db0d0 2023-07-21T22:24:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f6e18a0 con 0x55b85f6cb510 2023-07-21T22:24:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf5e5d1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b85f6e1a60 con 0x55b85f6cbe20 2023-07-21T22:24:16.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf5e5d1b80 10 client.0 _ll_register_callbacks cb 0x7fdf3c008dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:16.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf4919c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6e1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf4919c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6e1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39560/0 (socket says 172.21.15.151:39560) 2023-07-21T22:24:16.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf4919c700 1 -- 172.21.15.151:0/220241314 learned_addr learned my addr 172.21.15.151:0/220241314 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf43fff700 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 0x55b85f7399a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf4899b700 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f739460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf4919c700 1 -- 172.21.15.151:0/220241314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 msgr2=0x55b85f7399a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf4919c700 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 0x55b85f7399a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf4919c700 1 -- 172.21.15.151:0/220241314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 msgr2=0x55b85f739460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.496+0000 7fdf4919c700 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f739460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf4919c700 1 -- 172.21.15.151:0/220241314 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b85f434ce0 con 0x55b85f6db0d0 2023-07-21T22:24:16.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf43fff700 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 0x55b85f7399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:16.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf4899b700 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f739460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:16.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf4919c700 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6e1150 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c018e30 tx=0x7fdf3c004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00432fe07527fc1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf23fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf23fff700 1 -- 172.21.15.151:0/220241314 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3c00e070 con 0x55b85f6db0d0 2023-07-21T22:24:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/220241314 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf3800fd80 con 0x55b85f6db0d0 2023-07-21T22:24:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf23fff700 1 -- 172.21.15.151:0/220241314 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdf3c033080 con 0x55b85f6db0d0 2023-07-21T22:24:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf23fff700 1 -- 172.21.15.151:0/220241314 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf3c020040 con 0x55b85f6db0d0 2023-07-21T22:24:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf5e5d1b80 10 client.16491 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.497+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/220241314 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55b85f44a330 con 0x55b85f6db0d0 2023-07-21T22:24:16.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.498+0000 7fdf23fff700 1 -- 172.21.15.151:0/220241314 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf3800fd80 con 0x55b85f6db0d0 2023-07-21T22:24:16.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.498+0000 7fdf23fff700 1 -- 172.21.15.151:0/220241314 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdf3c004770 con 0x55b85f6db0d0 2023-07-21T22:24:16.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.498+0000 7fdf5e5d1b80 10 client.16491 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:16.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.498+0000 7fdf5e5d1b80 10 client.16491 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:16.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.498+0000 7fdf5e5d1b80 20 client.16491 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:16.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.498+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b85f740f90 0x55b85f7433a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.498+0000 7fdf5e5d1b80 4 client.16491 mds_command: new command op to 24599 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-21T22:24:16.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.498+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/220241314 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x55b85f5d90d0 con 0x55b85f740f90 2023-07-21T22:24:16.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.499+0000 7fdf4899b700 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b85f740f90 0x55b85f7433a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.499+0000 7fdf23fff700 10 client.16491 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:16.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.499+0000 7fdf4899b700 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b85f740f90 0x55b85f7433a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a441b5c51b14f5e server_cookie=29e1fc72bf823edb in_seq=0 out_seq=0 2023-07-21T22:24:16.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.500+0000 7fdf23fff700 1 -- 172.21.15.151:0/220241314 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x55b85f5d90d0 con 0x55b85f740f90 2023-07-21T22:24:16.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.500+0000 7fdf23fff700 10 client.16491 handle_command_reply: tid=0 2023-07-21T22:24:16.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.500+0000 7fdf5e5d1b80 1 client.16491 shutdown 2023-07-21T22:24:16.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/220241314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 msgr2=0x55b85f6e1150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6e1150 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c018e30 tx=0x7fdf3c004d80 comp rx=0 tx=0).stop 2023-07-21T22:24:16.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/220241314 shutdown_connections 2023-07-21T22:24:16.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b85f740f90 0x55b85f7433a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b85f6cb510 0x55b85f739460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b85f6db0d0 0x55b85f6e1150 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 --2- 172.21.15.151:0/220241314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b85f6cbe20 0x55b85f7399a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf23fff700 0 client.16491 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:16.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/220241314 >> 172.21.15.151:0/220241314 conn(0x55b85f6c1f70 msgr2=0x55b85f6cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/220241314 shutdown_connections 2023-07-21T22:24:16.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 1 -- 172.21.15.151:0/220241314 wait complete. 2023-07-21T22:24:16.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.501+0000 7fdf5e5d1b80 20 client.16491 trim_cache size 0 max 16384 2023-07-21T22:24:16.554 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:24:16.555 INFO:teuthology.orchestra.run.smithi151.stdout: "return_code": 0, 2023-07-21T22:24:16.555 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_tag": "feb44276-d021-475d-aa73-69a9c7e0f34d", 2023-07-21T22:24:16.555 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": "asynchronous" 2023-07-21T22:24:16.555 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:24:16.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 -- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf340a1360 msgr2=0x7fdf340a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf340a1360 0x7fdf340a3810 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdf3c009e10 tx=0x7fdf3c009920 comp rx=0 tx=0).stop 2023-07-21T22:24:16.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 -- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 msgr2=0x7fdf4419bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 0x7fdf4419bbf0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fdf30000c00 tx=0x7fdf30004730 comp rx=0 tx=0).stop 2023-07-21T22:24:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 -- 172.21.15.151:0/1139665193 shutdown_connections 2023-07-21T22:24:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf340a1360 0x7fdf340a3810 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf44109fc0 0x7fdf44195720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf44100aa0 0x7fdf4419b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 --2- 172.21.15.151:0/1139665193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf441013b0 0x7fdf4419bbf0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 -- 172.21.15.151:0/1139665193 >> 172.21.15.151:0/1139665193 conn(0x7fdf440745d0 msgr2=0x7fdf440fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 -- 172.21.15.151:0/1139665193 shutdown_connections 2023-07-21T22:24:16.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.502+0000 7fdf4999d700 1 -- 172.21.15.151:0/1139665193 wait complete. 2023-07-21T22:24:16.566 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:16 smithi151 ceph-mon[95510]: pgmap v155: 97 pgs: 97 active+clean; 4.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 180 op/s 2023-07-21T22:24:16.569 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:24:16.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.774+0000 7ffaeefff700 1 -- 172.21.15.151:0/471929555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae80fe9d0 msgr2=0x7ffae80fee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.774+0000 7ffaeefff700 1 --2- 172.21.15.151:0/471929555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae80fe9d0 0x7ffae80fee40 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7ffad4009990 tx=0x7ffad4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.774+0000 7ffaeefff700 1 -- 172.21.15.151:0/471929555 shutdown_connections 2023-07-21T22:24:16.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.774+0000 7ffaeefff700 1 --2- 172.21.15.151:0/471929555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80ff380 0x7ffae810b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.820 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.774+0000 7ffaeefff700 1 --2- 172.21.15.151:0/471929555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81049e0 0x7ffae8104db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.774+0000 7ffaeefff700 1 --2- 172.21.15.151:0/471929555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae80fe9d0 0x7ffae80fee40 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.774+0000 7ffaeefff700 1 -- 172.21.15.151:0/471929555 >> 172.21.15.151:0/471929555 conn(0x7ffae80fa4b0 msgr2=0x7ffae80fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.774+0000 7ffaeefff700 1 -- 172.21.15.151:0/471929555 shutdown_connections 2023-07-21T22:24:16.821 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.774+0000 7ffaeefff700 1 -- 172.21.15.151:0/471929555 wait complete. 2023-07-21T22:24:16.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.775+0000 7ffaeefff700 1 Processor -- start 2023-07-21T22:24:16.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaeefff700 1 -- start start 2023-07-21T22:24:16.823 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaeefff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80fe9d0 0x7ffae81005e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaeefff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae80ff380 0x7ffae8100b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaeefff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81049e0 0x7ffae81a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaeefff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae8101350 con 0x7ffae80ff380 2023-07-21T22:24:16.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaeefff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae81a4210 con 0x7ffae80fe9d0 2023-07-21T22:24:16.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaeefff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffae81a4350 con 0x7ffae81049e0 2023-07-21T22:24:16.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffae7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae80ff380 0x7ffae8100b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.824 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80fe9d0 0x7ffae81005e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80fe9d0 0x7ffae81005e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52638/0 (socket says 172.21.15.151:52638) 2023-07-21T22:24:16.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.776+0000 7ffaecd9b700 1 -- 172.21.15.151:0/268551045 learned_addr learned my addr 172.21.15.151:0/268551045 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.777+0000 7ffaed59c700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81049e0 0x7ffae81a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.777+0000 7ffae7fff700 1 -- 172.21.15.151:0/268551045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81049e0 msgr2=0x7ffae81a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.777+0000 7ffae7fff700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81049e0 0x7ffae81a3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.777+0000 7ffae7fff700 1 -- 172.21.15.151:0/268551045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80fe9d0 msgr2=0x7ffae81005e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.825 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.777+0000 7ffae7fff700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80fe9d0 0x7ffae81005e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.777+0000 7ffae7fff700 1 -- 172.21.15.151:0/268551045 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffadc009520 con 0x7ffae80ff380 2023-07-21T22:24:16.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.777+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80fe9d0 0x7ffae81005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:16.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.777+0000 7ffae7fff700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae80ff380 0x7ffae8100b20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffad4005910 tx=0x7ffad4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.778+0000 7ffae5ffb700 1 -- 172.21.15.151:0/268551045 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad401d070 con 0x7ffae80ff380 2023-07-21T22:24:16.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.778+0000 7ffaeefff700 1 -- 172.21.15.151:0/268551045 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad40095f0 con 0x7ffae80ff380 2023-07-21T22:24:16.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.778+0000 7ffae5ffb700 1 -- 172.21.15.151:0/268551045 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffad4022470 con 0x7ffae80ff380 2023-07-21T22:24:16.826 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.778+0000 7ffae5ffb700 1 -- 172.21.15.151:0/268551045 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad4017650 con 0x7ffae80ff380 2023-07-21T22:24:16.827 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.778+0000 7ffaeefff700 1 -- 172.21.15.151:0/268551045 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffae81a4840 con 0x7ffae80ff380 2023-07-21T22:24:16.828 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.783+0000 7ffae5ffb700 1 -- 172.21.15.151:0/268551045 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ffad40225e0 con 0x7ffae80ff380 2023-07-21T22:24:16.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.784+0000 7ffb02993b80 1 Processor -- start 2023-07-21T22:24:16.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.784+0000 7ffb02993b80 1 -- start start 2023-07-21T22:24:16.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.784+0000 7ffae5ffb700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ffad80a1340 0x7ffad80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.784+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f498580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.784+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 0x55a82f493350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f493da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffb02993b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f398cb0 con 0x55a82f498ac0 2023-07-21T22:24:16.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffb02993b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f3eba40 con 0x55a82f4981b0 2023-07-21T22:24:16.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffb02993b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f3e4ed0 con 0x55a82f493930 2023-07-21T22:24:16.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffae5ffb700 1 -- 172.21.15.151:0/268551045 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ffad40cdbf0 con 0x7ffae80ff380 2023-07-21T22:24:16.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffaed59c700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ffad80a1340 0x7ffad80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffae7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 0x55a82f493350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f498580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffae7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 0x55a82f493350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39588/0 (socket says 172.21.15.151:39588) 2023-07-21T22:24:16.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f498580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52652/0 (socket says 172.21.15.151:52652) 2023-07-21T22:24:16.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffae7fff700 1 -- 172.21.15.151:0/4034815928 learned_addr learned my addr 172.21.15.151:0/4034815928 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffaed59c700 1 --2- 172.21.15.151:0/4034815928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f493da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffaecd9b700 1 -- 172.21.15.151:0/4034815928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 msgr2=0x55a82f493da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/4034815928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f493da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffaecd9b700 1 -- 172.21.15.151:0/4034815928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 msgr2=0x55a82f493350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/4034815928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 0x55a82f493350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.785+0000 7ffaecd9b700 1 -- 172.21.15.151:0/4034815928 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a82f212de0 con 0x55a82f4981b0 2023-07-21T22:24:16.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.786+0000 7ffaed59c700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ffad80a1340 0x7ffad80a37f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffae81026f0 tx=0x7ffae0004320 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.786+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/4034815928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f498580 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffadc011760 tx=0x7ffadc011a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d896bd4ebe75947e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.786+0000 7ffad2ffd700 1 -- 172.21.15.151:0/4034815928 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc004830 con 0x55a82f4981b0 2023-07-21T22:24:16.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.786+0000 7ffad2ffd700 1 -- 172.21.15.151:0/4034815928 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffadc004e20 con 0x55a82f4981b0 2023-07-21T22:24:16.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.786+0000 7ffad2ffd700 1 -- 172.21.15.151:0/4034815928 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc00f7a0 con 0x55a82f4981b0 2023-07-21T22:24:16.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.787+0000 7ffb02993b80 1 -- 172.21.15.151:0/4034815928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 msgr2=0x55a82f498580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.787+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4034815928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f498580 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffadc011760 tx=0x7ffadc011a70 comp rx=0 tx=0).stop 2023-07-21T22:24:16.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.787+0000 7ffb02993b80 1 -- 172.21.15.151:0/4034815928 shutdown_connections 2023-07-21T22:24:16.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.787+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4034815928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f498580 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.787+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4034815928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f493da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.787+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4034815928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 0x55a82f493350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.787+0000 7ffb02993b80 1 -- 172.21.15.151:0/4034815928 >> 172.21.15.151:0/4034815928 conn(0x55a82f488ef0 msgr2=0x55a82f48e830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.787+0000 7ffb02993b80 1 -- 172.21.15.151:0/4034815928 shutdown_connections 2023-07-21T22:24:16.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.787+0000 7ffb02993b80 1 -- 172.21.15.151:0/4034815928 wait complete. 2023-07-21T22:24:16.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.788+0000 7ffb02993b80 1 -- start start 2023-07-21T22:24:16.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.788+0000 7ffb02993b80 1 Processor -- start 2023-07-21T22:24:16.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.788+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f49fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f49ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 0x55a82f49d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffb02993b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f384ac0 con 0x55a82f493930 2023-07-21T22:24:16.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffb02993b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f3847c0 con 0x55a82f4981b0 2023-07-21T22:24:16.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffb02993b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f268920 con 0x55a82f498ac0 2023-07-21T22:24:16.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffb02993b80 10 client.0 _ll_register_callbacks cb 0x55a82f382760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:16.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f49fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f49fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39590/0 (socket says 172.21.15.151:39590) 2023-07-21T22:24:16.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffaecd9b700 1 -- 172.21.15.151:0/2591643665 learned_addr learned my addr 172.21.15.151:0/2591643665 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffae7fff700 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f49ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffaed59c700 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 0x55a82f49d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.840 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffae7fff700 1 -- 172.21.15.151:0/2591643665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 msgr2=0x55a82f49d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffae7fff700 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 0x55a82f49d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffae7fff700 1 -- 172.21.15.151:0/2591643665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 msgr2=0x55a82f49fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffae7fff700 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f49fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.789+0000 7ffae7fff700 1 -- 172.21.15.151:0/2591643665 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffadc011440 con 0x55a82f4981b0 2023-07-21T22:24:16.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.790+0000 7ffae7fff700 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f49ce00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffad40972a0 tx=0x7ffad409a700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc432fdb8cec9a5f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.790+0000 7ffac7fff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:24:16.841 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.790+0000 7ffac7fff700 1 -- 172.21.15.151:0/2591643665 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffad40cb810 con 0x55a82f4981b0 2023-07-21T22:24:16.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.790+0000 7ffac7fff700 1 -- 172.21.15.151:0/2591643665 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ffad409ada0 con 0x55a82f4981b0 2023-07-21T22:24:16.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.790+0000 7ffb02993b80 1 -- 172.21.15.151:0/2591643665 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a82f33e4f0 con 0x55a82f4981b0 2023-07-21T22:24:16.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.790+0000 7ffac7fff700 1 -- 172.21.15.151:0/2591643665 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffad4022b10 con 0x55a82f4981b0 2023-07-21T22:24:16.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.790+0000 7ffb02993b80 10 client.26237 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:16.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.790+0000 7ffb02993b80 1 -- 172.21.15.151:0/2591643665 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55a82f1fbc60 con 0x55a82f4981b0 2023-07-21T22:24:16.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.791+0000 7ffac7fff700 1 -- 172.21.15.151:0/2591643665 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a82f33e4f0 con 0x55a82f4981b0 2023-07-21T22:24:16.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.791+0000 7ffac7fff700 1 -- 172.21.15.151:0/2591643665 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ffad409a290 con 0x55a82f4981b0 2023-07-21T22:24:16.842 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.791+0000 7ffb02993b80 10 client.26237 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:16.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.791+0000 7ffb02993b80 10 client.26237 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:16.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.791+0000 7ffb02993b80 20 client.26237 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:16.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.791+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a82f4acfa0 0x55a82f4af3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.791+0000 7ffb02993b80 4 client.26237 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:16.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.791+0000 7ffb02993b80 1 -- 172.21.15.151:0/2591643665 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a82f3ddeb0 con 0x55a82f4acfa0 2023-07-21T22:24:16.843 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.792+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a82f4acfa0 0x55a82f4af3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.844 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.792+0000 7ffac7fff700 10 client.26237 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:16.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.792+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a82f4acfa0 0x55a82f4af3b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5964a321d692f01f server_cookie=fc62aedc74053642 in_seq=0 out_seq=0 2023-07-21T22:24:16.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffac7fff700 1 -- 172.21.15.151:0/2591643665 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a82f3ddeb0 con 0x55a82f4acfa0 2023-07-21T22:24:16.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffac7fff700 10 client.26237 handle_command_reply: tid=0 2023-07-21T22:24:16.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 client.26237 shutdown 2023-07-21T22:24:16.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 -- 172.21.15.151:0/2591643665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 msgr2=0x55a82f49ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f49ce00 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ffad40972a0 tx=0x7ffad409a700 comp rx=0 tx=0).stop 2023-07-21T22:24:16.845 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 -- 172.21.15.151:0/2591643665 shutdown_connections 2023-07-21T22:24:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a82f4acfa0 0x55a82f4af3b0 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 0x55a82f49d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f49fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2591643665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f49ce00 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffac7fff700 0 client.26237 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 -- 172.21.15.151:0/2591643665 >> 172.21.15.151:0/2591643665 conn(0x55a82f488ef0 msgr2=0x55a82f48e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 -- 172.21.15.151:0/2591643665 shutdown_connections 2023-07-21T22:24:16.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.793+0000 7ffb02993b80 1 -- 172.21.15.151:0/2591643665 wait complete. 2023-07-21T22:24:16.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.794+0000 7ffb02993b80 20 client.26237 trim_cache size 0 max 16384 2023-07-21T22:24:16.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.814+0000 7ffb02993b80 1 Processor -- start 2023-07-21T22:24:16.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.814+0000 7ffb02993b80 1 -- start start 2023-07-21T22:24:16.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.814+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f49f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.814+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f49c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 0x55a82f49cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffb02993b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f4889e0 con 0x55a82f498ac0 2023-07-21T22:24:16.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffb02993b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f4946d0 con 0x55a82f4981b0 2023-07-21T22:24:16.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffb02993b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f49e410 con 0x55a82f493930 2023-07-21T22:24:16.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f49f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f49f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:44596/0 (socket says 172.21.15.151:44596) 2023-07-21T22:24:16.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffaed59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 0x55a82f49cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffaecd9b700 1 -- 172.21.15.151:0/2042232336 learned_addr learned my addr 172.21.15.151:0/2042232336 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.862 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffae7fff700 1 --2- 172.21.15.151:0/2042232336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f49c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffaecd9b700 1 -- 172.21.15.151:0/2042232336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 msgr2=0x55a82f49c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/2042232336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f49c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffaecd9b700 1 -- 172.21.15.151:0/2042232336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 msgr2=0x55a82f49cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/2042232336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 0x55a82f49cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.815+0000 7ffaecd9b700 1 -- 172.21.15.151:0/2042232336 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a82f493fd0 con 0x55a82f493930 2023-07-21T22:24:16.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.816+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/2042232336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f49f720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009950 tx=0x7ffadc0054b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ff6e94f96c4ca29 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.816+0000 7ffad37fe700 1 -- 172.21.15.151:0/2042232336 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc005690 con 0x55a82f493930 2023-07-21T22:24:16.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.816+0000 7ffad37fe700 1 -- 172.21.15.151:0/2042232336 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffadc02e070 con 0x55a82f493930 2023-07-21T22:24:16.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.816+0000 7ffad37fe700 1 -- 172.21.15.151:0/2042232336 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc004a70 con 0x55a82f493930 2023-07-21T22:24:16.866 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 -- 172.21.15.151:0/2042232336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 msgr2=0x55a82f49f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2042232336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f49f720 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009950 tx=0x7ffadc0054b0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 -- 172.21.15.151:0/2042232336 shutdown_connections 2023-07-21T22:24:16.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2042232336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f498ac0 0x55a82f49cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2042232336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f493930 0x55a82f49f720 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 --2- 172.21.15.151:0/2042232336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f49c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.867 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 -- 172.21.15.151:0/2042232336 >> 172.21.15.151:0/2042232336 conn(0x55a82f488ef0 msgr2=0x55a82f4a9750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 -- 172.21.15.151:0/2042232336 shutdown_connections 2023-07-21T22:24:16.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 -- 172.21.15.151:0/2042232336 wait complete. 2023-07-21T22:24:16.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.817+0000 7ffb02993b80 1 -- start start 2023-07-21T22:24:16.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffb02993b80 1 Processor -- start 2023-07-21T22:24:16.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f4a2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f4a3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.868 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffb02993b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 0x55a82f4a36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffb02993b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f500e70 con 0x55a82f493930 2023-07-21T22:24:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffb02993b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f500fb0 con 0x55a82f4981b0 2023-07-21T22:24:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffb02993b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a82f501120 con 0x55a82f498ac0 2023-07-21T22:24:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffb02993b80 10 client.0 _ll_register_callbacks cb 0x7ffad409ab70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f4a2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffaecd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f4a2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39606/0 (socket says 172.21.15.151:39606) 2023-07-21T22:24:16.869 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.818+0000 7ffaecd9b700 1 -- 172.21.15.151:0/4190080120 learned_addr learned my addr 172.21.15.151:0/4190080120 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffae7fff700 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f4a3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffaed59c700 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 0x55a82f4a36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffaecd9b700 1 -- 172.21.15.151:0/4190080120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 msgr2=0x55a82f4a36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 0x55a82f4a36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffaecd9b700 1 -- 172.21.15.151:0/4190080120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 msgr2=0x55a82f4a3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f4a3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffaecd9b700 1 -- 172.21.15.151:0/4190080120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a82f212de0 con 0x55a82f493930 2023-07-21T22:24:16.870 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffae7fff700 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f4a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:16.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffaecd9b700 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f4a2c30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffadc005540 tx=0x7ffadc005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8aefd53ce3ab572 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:16.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffac7fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:16.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.819+0000 7ffac7fff700 1 -- 172.21.15.151:0/4190080120 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffadc0051b0 con 0x55a82f493930 2023-07-21T22:24:16.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffb02993b80 1 -- 172.21.15.151:0/4190080120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ffadc004e20 con 0x55a82f493930 2023-07-21T22:24:16.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffac7fff700 1 -- 172.21.15.151:0/4190080120 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ffadc004020 con 0x55a82f493930 2023-07-21T22:24:16.871 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffac7fff700 1 -- 172.21.15.151:0/4190080120 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffadc0041e0 con 0x55a82f493930 2023-07-21T22:24:16.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffb02993b80 10 client.16509 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:16.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffb02993b80 1 -- 172.21.15.151:0/4190080120 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55a82f239250 con 0x55a82f493930 2023-07-21T22:24:16.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffac7fff700 1 -- 172.21.15.151:0/4190080120 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ffadc004e20 con 0x55a82f493930 2023-07-21T22:24:16.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffac7fff700 1 -- 172.21.15.151:0/4190080120 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ffadc039020 con 0x55a82f493930 2023-07-21T22:24:16.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffb02993b80 10 client.16509 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:16.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffb02993b80 10 client.16509 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:16.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffb02993b80 20 client.16509 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:16.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a82f502580 0x55a82f504990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:16.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffb02993b80 4 client.16509 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:24:16.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.820+0000 7ffb02993b80 1 -- 172.21.15.151:0/4190080120 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55a82f3a0050 con 0x55a82f502580 2023-07-21T22:24:16.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.821+0000 7ffae7fff700 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a82f502580 0x55a82f504990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:16.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.821+0000 7ffae7fff700 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a82f502580 0x55a82f504990 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbb22acaed690d66 server_cookie=ff68429bae3ced37 in_seq=0 out_seq=0 2023-07-21T22:24:16.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.821+0000 7ffac7fff700 10 client.16509 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:16.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.821+0000 7ffac7fff700 1 -- 172.21.15.151:0/4190080120 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x55a82f3a0050 con 0x55a82f502580 2023-07-21T22:24:16.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffac7fff700 10 client.16509 handle_command_reply: tid=0 2023-07-21T22:24:16.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 client.16509 shutdown 2023-07-21T22:24:16.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 -- 172.21.15.151:0/4190080120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 msgr2=0x55a82f4a2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f4a2c30 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7ffadc005540 tx=0x7ffadc005e30 comp rx=0 tx=0).stop 2023-07-21T22:24:16.875 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 -- 172.21.15.151:0/4190080120 shutdown_connections 2023-07-21T22:24:16.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a82f502580 0x55a82f504990 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a82f498ac0 0x55a82f4a36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a82f493930 0x55a82f4a2c30 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 --2- 172.21.15.151:0/4190080120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a82f4981b0 0x55a82f4a3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 -- 172.21.15.151:0/4190080120 >> 172.21.15.151:0/4190080120 conn(0x55a82f488ef0 msgr2=0x55a82f496cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffac7fff700 0 client.16509 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:16.876 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 -- 172.21.15.151:0/4190080120 shutdown_connections 2023-07-21T22:24:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 1 -- 172.21.15.151:0/4190080120 wait complete. 2023-07-21T22:24:16.877 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.822+0000 7ffb02993b80 20 client.16509 trim_cache size 0 max 16384 2023-07-21T22:24:16.877 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:24:16.877 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:24:16.877 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:24:16.877 INFO:teuthology.orchestra.run.smithi151.stdout: "feb44276-d021-475d-aa73-69a9c7e0f34d": { 2023-07-21T22:24:16.878 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:24:16.878 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "feb44276-d021-475d-aa73-69a9c7e0f34d", 2023-07-21T22:24:16.878 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:24:16.878 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:24:16.878 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:24:16.878 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:24:16.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 -- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ffad80a1340 msgr2=0x7ffad80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ffad80a1340 0x7ffad80a37f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ffae81026f0 tx=0x7ffae0004320 comp rx=0 tx=0).stop 2023-07-21T22:24:16.879 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 -- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae80ff380 msgr2=0x7ffae8100b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:16.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae80ff380 0x7ffae8100b20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7ffad4005910 tx=0x7ffad4004730 comp rx=0 tx=0).stop 2023-07-21T22:24:16.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 -- 172.21.15.151:0/268551045 shutdown_connections 2023-07-21T22:24:16.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ffad80a1340 0x7ffad80a37f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffae80fe9d0 0x7ffae81005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ffae81049e0 0x7ffae81a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 --2- 172.21.15.151:0/268551045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae80ff380 0x7ffae8100b20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:16.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 -- 172.21.15.151:0/268551045 >> 172.21.15.151:0/268551045 conn(0x7ffae80fa4b0 msgr2=0x7ffae8102860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:16.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 -- 172.21.15.151:0/268551045 shutdown_connections 2023-07-21T22:24:16.881 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:16.823+0000 7ffaeefff700 1 -- 172.21.15.151:0/268551045 wait complete. 2023-07-21T22:24:16.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:16 smithi187 ceph-mon[96918]: pgmap v155: 97 pgs: 97 active+clean; 4.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 180 op/s 2023-07-21T22:24:16.889 INFO:tasks.cephfs.filesystem:scrub status for tag:feb44276-d021-475d-aa73-69a9c7e0f34d - {'path': '/', 'tag': 'feb44276-d021-475d-aa73-69a9c7e0f34d', 'options': 'recursive,force'} 2023-07-21T22:24:16.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:16 smithi195 ceph-mon[97365]: pgmap v155: 97 pgs: 97 active+clean; 4.6 GiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 23 MiB/s wr, 180 op/s 2023-07-21T22:24:17.719 INFO:teuthology.orchestra.run.smithi151.stderr:20200000 of 50000000 tuples (40%) done (elapsed 281.21 s, remaining 414.86 s) 2023-07-21T22:24:17.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:17 smithi187 ceph-mon[96918]: scrub queued for path: / 2023-07-21T22:24:17.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:17 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:17 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:24:17.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:17 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:24:17.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:17 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:24:17.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:17 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:17 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:17 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:17 smithi195 ceph-mon[97365]: scrub queued for path: / 2023-07-21T22:24:17.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:17 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:17 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:24:17.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:17 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:24:17.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:17 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:24:17.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:17 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:17 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:17 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:17 smithi151 ceph-mon[95510]: scrub queued for path: / 2023-07-21T22:24:17.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:17 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:17 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:24:17.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:17 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:24:17.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:17 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:24:17.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:17 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:17 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:17.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:17 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:18.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.392+0000 7f64e01ff700 1 -- 172.21.15.151:0/144334294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d8105b80 msgr2=0x7f64d8105f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.392+0000 7f64e01ff700 1 --2- 172.21.15.151:0/144334294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d8105b80 0x7f64d8105f50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f64d40098f0 tx=0x7f64d4009c00 comp rx=0 tx=0).stop 2023-07-21T22:24:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.392+0000 7f64e01ff700 1 -- 172.21.15.151:0/144334294 shutdown_connections 2023-07-21T22:24:18.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.392+0000 7f64e01ff700 1 --2- 172.21.15.151:0/144334294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64d8100500 0x7f64d810c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.392+0000 7f64e01ff700 1 --2- 172.21.15.151:0/144334294 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d8105b80 0x7f64d8105f50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.392+0000 7f64e01ff700 1 --2- 172.21.15.151:0/144334294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64d80ffb50 0x7f64d80fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.392+0000 7f64e01ff700 1 -- 172.21.15.151:0/144334294 >> 172.21.15.151:0/144334294 conn(0x7f64d80fb650 msgr2=0x7f64d80fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.392+0000 7f64e01ff700 1 -- 172.21.15.151:0/144334294 shutdown_connections 2023-07-21T22:24:18.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.392+0000 7f64e01ff700 1 -- 172.21.15.151:0/144334294 wait complete. 2023-07-21T22:24:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.393+0000 7f64e01ff700 1 Processor -- start 2023-07-21T22:24:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.393+0000 7f64e01ff700 1 -- start start 2023-07-21T22:24:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.393+0000 7f64e01ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64d80ffb50 0x7f64d8197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.393+0000 7f64e01ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64d8100500 0x7f64d8198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.393+0000 7f64e01ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d8105b80 0x7f64d819c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.393+0000 7f64e01ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d819cec0 con 0x7f64d8100500 2023-07-21T22:24:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.393+0000 7f64e01ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d819d030 con 0x7f64d80ffb50 2023-07-21T22:24:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.393+0000 7f64e01ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64d819d1f0 con 0x7f64d8105b80 2023-07-21T22:24:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64dd79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64d8100500 0x7f64d8198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64dd79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64d8100500 0x7f64d8198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39614/0 (socket says 172.21.15.151:39614) 2023-07-21T22:24:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64dd79a700 1 -- 172.21.15.151:0/1930144273 learned_addr learned my addr 172.21.15.151:0/1930144273 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64d80ffb50 0x7f64d8197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64de79c700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d8105b80 0x7f64d819c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64dd79a700 1 -- 172.21.15.151:0/1930144273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d8105b80 msgr2=0x7f64d819c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64dd79a700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d8105b80 0x7f64d819c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64dd79a700 1 -- 172.21.15.151:0/1930144273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64d80ffb50 msgr2=0x7f64d8197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64dd79a700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64d80ffb50 0x7f64d8197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64dd79a700 1 -- 172.21.15.151:0/1930144273 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64d4009520 con 0x7f64d8100500 2023-07-21T22:24:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.394+0000 7f64dd79a700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64d8100500 0x7f64d8198280 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f64c800e9a0 tx=0x7f64c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.395+0000 7f64ceffd700 1 -- 172.21.15.151:0/1930144273 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8009790 con 0x7f64d8100500 2023-07-21T22:24:18.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.395+0000 7f64e01ff700 1 -- 172.21.15.151:0/1930144273 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64d819d4d0 con 0x7f64d8100500 2023-07-21T22:24:18.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.395+0000 7f64ceffd700 1 -- 172.21.15.151:0/1930144273 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64c800cbd0 con 0x7f64d8100500 2023-07-21T22:24:18.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.395+0000 7f64ceffd700 1 -- 172.21.15.151:0/1930144273 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c8018680 con 0x7f64d8100500 2023-07-21T22:24:18.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.395+0000 7f64e01ff700 1 -- 172.21.15.151:0/1930144273 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d81a4d10 con 0x7f64d8100500 2023-07-21T22:24:18.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.398+0000 7f64ceffd700 1 -- 172.21.15.151:0/1930144273 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f64c800cd40 con 0x7f64d8100500 2023-07-21T22:24:18.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.399+0000 7f64f3bb8b80 1 Processor -- start 2023-07-21T22:24:18.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64f3bb8b80 1 -- start start 2023-07-21T22:24:18.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64ceffd700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a12c0 0x7f64c40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64ceffd700 1 -- 172.21.15.151:0/1930144273 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f64c8014070 con 0x7f64d8100500 2023-07-21T22:24:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x565025909cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502590a210 0x565025903f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x5650259044a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565025809c50 con 0x56502590a660 2023-07-21T22:24:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56502585c9e0 con 0x56502590a210 2023-07-21T22:24:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565025855e70 con 0x5650257606b0 2023-07-21T22:24:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64de79c700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a12c0 0x7f64c40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64ddf9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x565025909cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64ddf9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x565025909cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:44634/0 (socket says 172.21.15.151:44634) 2023-07-21T22:24:18.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.400+0000 7f64ddf9b700 1 -- 172.21.15.151:0/2278888043 learned_addr learned my addr 172.21.15.151:0/2278888043 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64de79c700 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x5650259044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64dd79a700 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502590a210 0x565025903f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64ddf9b700 1 -- 172.21.15.151:0/2278888043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502590a210 msgr2=0x565025903f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502590a210 0x565025903f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64ddf9b700 1 -- 172.21.15.151:0/2278888043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 msgr2=0x5650259044a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:18.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x5650259044a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64ddf9b700 1 -- 172.21.15.151:0/2278888043 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565025683d80 con 0x5650257606b0 2023-07-21T22:24:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64de79c700 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x5650259044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64dd79a700 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502590a210 0x565025903f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64de79c700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a12c0 0x7f64c40a3770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f64d00076d0 tx=0x7f64d0007a90 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x565025909cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64d40098f0 tx=0x7f64d4005b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48bd2e65d56eab0c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:18.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.401+0000 7f64c3fff700 1 -- 172.21.15.151:0/2278888043 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d400f460 con 0x5650257606b0 2023-07-21T22:24:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.402+0000 7f64c3fff700 1 -- 172.21.15.151:0/2278888043 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64d401d040 con 0x5650257606b0 2023-07-21T22:24:18.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.402+0000 7f64c3fff700 1 -- 172.21.15.151:0/2278888043 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4005040 con 0x5650257606b0 2023-07-21T22:24:18.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.402+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/2278888043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 msgr2=0x565025909cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.402+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x565025909cd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f64d40098f0 tx=0x7f64d4005b80 comp rx=0 tx=0).stop 2023-07-21T22:24:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.402+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/2278888043 shutdown_connections 2023-07-21T22:24:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.402+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x5650259044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.402+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x565025909cd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.402+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/2278888043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502590a210 0x565025903f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.402+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/2278888043 >> 172.21.15.151:0/2278888043 conn(0x5650258f9ae0 msgr2=0x5650258ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:18.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.403+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/2278888043 shutdown_connections 2023-07-21T22:24:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.403+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/2278888043 wait complete. 2023-07-21T22:24:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.403+0000 7f64f3bb8b80 1 -- start start 2023-07-21T22:24:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.403+0000 7f64f3bb8b80 1 Processor -- start 2023-07-21T22:24:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 0x565025910470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56502590a210 0x56502590d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x56502590dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650257f5a60 con 0x56502590a660 2023-07-21T22:24:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650257f5760 con 0x5650257606b0 2023-07-21T22:24:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650256d98c0 con 0x56502590a210 2023-07-21T22:24:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64f3bb8b80 10 client.0 _ll_register_callbacks cb 0x5650257f3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64de79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x56502590dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64de79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x56502590dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39626/0 (socket says 172.21.15.151:39626) 2023-07-21T22:24:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64de79c700 1 -- 172.21.15.151:0/4241710193 learned_addr learned my addr 172.21.15.151:0/4241710193 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 0x565025910470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.404+0000 7f64dd79a700 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56502590a210 0x56502590d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64dd79a700 1 -- 172.21.15.151:0/4241710193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 msgr2=0x565025910470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64dd79a700 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 0x565025910470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64dd79a700 1 -- 172.21.15.151:0/4241710193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 msgr2=0x56502590dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64dd79a700 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x56502590dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64dd79a700 1 -- 172.21.15.151:0/4241710193 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64d810d240 con 0x56502590a210 2023-07-21T22:24:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64dd79a700 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56502590a210 0x56502590d6f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f64c80ca710 tx=0x7f64c8099a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bcfb6cdc49651c47 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:18.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:24:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64c17fa700 1 -- 172.21.15.151:0/4241710193 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c809e0c0 con 0x56502590a210 2023-07-21T22:24:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64c17fa700 1 -- 172.21.15.151:0/4241710193 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f64c80a24e0 con 0x56502590a210 2023-07-21T22:24:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/4241710193 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5650257af490 con 0x56502590a210 2023-07-21T22:24:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64c17fa700 1 -- 172.21.15.151:0/4241710193 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64c80a2050 con 0x56502590a210 2023-07-21T22:24:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64f3bb8b80 10 client.26287 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.405+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/4241710193 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56502566cc00 con 0x56502590a210 2023-07-21T22:24:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.406+0000 7f64c17fa700 1 -- 172.21.15.151:0/4241710193 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64c80b8030 con 0x56502590a210 2023-07-21T22:24:18.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.406+0000 7f64c17fa700 1 -- 172.21.15.151:0/4241710193 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f64c8095e80 con 0x56502590a210 2023-07-21T22:24:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.406+0000 7f64f3bb8b80 10 client.26287 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.406+0000 7f64f3bb8b80 10 client.26287 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.406+0000 7f64f3bb8b80 20 client.26287 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.406+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56502591da70 0x56502591fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.406+0000 7f64f3bb8b80 4 client.26287 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.406+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/4241710193 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56502584ee50 con 0x56502591da70 2023-07-21T22:24:18.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.406+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56502591da70 0x56502591fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.407+0000 7f64c17fa700 10 client.26287 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.407+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56502591da70 0x56502591fe80 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5aaab2db8f1815e server_cookie=e98f5ff66190a277 in_seq=0 out_seq=0 2023-07-21T22:24:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64c17fa700 1 -- 172.21.15.151:0/4241710193 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56502584ee50 con 0x56502591da70 2023-07-21T22:24:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64c17fa700 10 client.26287 handle_command_reply: tid=0 2023-07-21T22:24:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 client.26287 shutdown 2023-07-21T22:24:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/4241710193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56502590a210 msgr2=0x56502590d6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:18.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56502590a210 0x56502590d6f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f64c80ca710 tx=0x7f64c8099a70 comp rx=0 tx=0).stop 2023-07-21T22:24:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/4241710193 shutdown_connections 2023-07-21T22:24:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56502591da70 0x56502591fe80 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 0x565025910470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502590a660 0x56502590dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/4241710193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56502590a210 0x56502590d6f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64c17fa700 0 client.26287 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:18.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/4241710193 >> 172.21.15.151:0/4241710193 conn(0x5650258f9ae0 msgr2=0x5650258fe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/4241710193 shutdown_connections 2023-07-21T22:24:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/4241710193 wait complete. 2023-07-21T22:24:18.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.408+0000 7f64f3bb8b80 20 client.26287 trim_cache size 0 max 16384 2023-07-21T22:24:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.429+0000 7f64f3bb8b80 1 Processor -- start 2023-07-21T22:24:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.429+0000 7f64f3bb8b80 1 -- start start 2023-07-21T22:24:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.429+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502591a020 0x56502590b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.429+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5650258f9ae0 0x565025914ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.429+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x56502590ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.429+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56502591b0c0 con 0x5650258f9ae0 2023-07-21T22:24:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.429+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650258fbc00 con 0x56502591a020 2023-07-21T22:24:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.429+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565025904f50 con 0x5650257606b0 2023-07-21T22:24:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.429+0000 7f64dd79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5650258f9ae0 0x565025914ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64dd79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5650258f9ae0 0x565025914ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39632/0 (socket says 172.21.15.151:39632) 2023-07-21T22:24:18.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64dd79a700 1 -- 172.21.15.151:0/3710987100 learned_addr learned my addr 172.21.15.151:0/3710987100 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64de79c700 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x56502590ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502591a020 0x56502590b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64dd79a700 1 -- 172.21.15.151:0/3710987100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 msgr2=0x56502590ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64dd79a700 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x56502590ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64dd79a700 1 -- 172.21.15.151:0/3710987100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502591a020 msgr2=0x56502590b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64dd79a700 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502591a020 0x56502590b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64dd79a700 1 -- 172.21.15.151:0/3710987100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5650256aa1f0 con 0x5650258f9ae0 2023-07-21T22:24:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502591a020 0x56502590b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64dd79a700 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5650258f9ae0 0x565025914ba0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f64c8096590 tx=0x7f64c809a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c85aff9e7c587b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.430+0000 7f64ccff9700 1 -- 172.21.15.151:0/3710987100 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80a24e0 con 0x5650258f9ae0 2023-07-21T22:24:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64ccff9700 1 -- 172.21.15.151:0/3710987100 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f64c80b8040 con 0x5650258f9ae0 2023-07-21T22:24:18.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64ccff9700 1 -- 172.21.15.151:0/3710987100 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64c80a22b0 con 0x5650258f9ae0 2023-07-21T22:24:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/3710987100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5650258f9ae0 msgr2=0x565025914ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5650258f9ae0 0x565025914ba0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f64c8096590 tx=0x7f64c809a210 comp rx=0 tx=0).stop 2023-07-21T22:24:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/3710987100 shutdown_connections 2023-07-21T22:24:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56502591a020 0x56502590b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650257606b0 0x56502590ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/3710987100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5650258f9ae0 0x565025914ba0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/3710987100 >> 172.21.15.151:0/3710987100 conn(0x565025907cf0 msgr2=0x56502590aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.431+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/3710987100 shutdown_connections 2023-07-21T22:24:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.432+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/3710987100 wait complete. 2023-07-21T22:24:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.432+0000 7f64f3bb8b80 1 -- start start 2023-07-21T22:24:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.432+0000 7f64f3bb8b80 1 Processor -- start 2023-07-21T22:24:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 0x565025905d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650258f9ae0 0x5650259062b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64f3bb8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502591a020 0x5650259067f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5650259151a0 con 0x56502591a020 2023-07-21T22:24:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565025971930 con 0x5650257606b0 2023-07-21T22:24:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64f3bb8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565025971af0 con 0x5650258f9ae0 2023-07-21T22:24:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64f3bb8b80 10 client.0 _ll_register_callbacks cb 0x7f64c8099f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64de79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502591a020 0x5650259067f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64de79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502591a020 0x5650259067f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39636/0 (socket says 172.21.15.151:39636) 2023-07-21T22:24:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64de79c700 1 -- 172.21.15.151:0/1591061302 learned_addr learned my addr 172.21.15.151:0/1591061302 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:18.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 0x565025905d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.433+0000 7f64dd79a700 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650258f9ae0 0x5650259062b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64ddf9b700 1 -- 172.21.15.151:0/1591061302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650258f9ae0 msgr2=0x5650259062b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:18.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650258f9ae0 0x5650259062b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64ddf9b700 1 -- 172.21.15.151:0/1591061302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502591a020 msgr2=0x5650259067f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502591a020 0x5650259067f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64ddf9b700 1 -- 172.21.15.151:0/1591061302 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56502566cc00 con 0x5650257606b0 2023-07-21T22:24:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64de79c700 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502591a020 0x5650259067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64ddf9b700 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 0x565025905d70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f64d400c010 tx=0x7f64d4005dc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc9acfd25d1c2cb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:18.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:24:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64c17fa700 1 -- 172.21.15.151:0/1591061302 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64d4036070 con 0x5650257606b0 2023-07-21T22:24:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64c17fa700 1 -- 172.21.15.151:0/1591061302 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f64d400b620 con 0x5650257606b0 2023-07-21T22:24:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.434+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/1591061302 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56502591a3f0 con 0x5650257606b0 2023-07-21T22:24:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.435+0000 7f64c17fa700 1 -- 172.21.15.151:0/1591061302 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64d4031070 con 0x5650257606b0 2023-07-21T22:24:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.435+0000 7f64f3bb8b80 10 client.26261 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.435+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/1591061302 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x565025682250 con 0x5650257606b0 2023-07-21T22:24:18.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.435+0000 7f64c17fa700 1 -- 172.21.15.151:0/1591061302 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56502591a3f0 con 0x5650257606b0 2023-07-21T22:24:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.435+0000 7f64c17fa700 1 -- 172.21.15.151:0/1591061302 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f64d4039030 con 0x5650257606b0 2023-07-21T22:24:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.435+0000 7f64f3bb8b80 10 client.26261 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.435+0000 7f64f3bb8b80 10 client.26261 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.435+0000 7f64f3bb8b80 20 client.26261 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:18.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.436+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56502590a210 0x565025974d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.436+0000 7f64f3bb8b80 4 client.26261 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:24:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.436+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/1591061302 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f64d401d040 con 0x56502590a210 2023-07-21T22:24:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.436+0000 7f64dd79a700 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56502590a210 0x565025974d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.436+0000 7f64dd79a700 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56502590a210 0x565025974d10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ace6d54e99e392bc server_cookie=e416c4aa953bd4e2 in_seq=0 out_seq=0 2023-07-21T22:24:18.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.436+0000 7f64c17fa700 10 client.26261 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.456+0000 7f64c17fa700 1 -- 172.21.15.151:0/1591061302 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f64d401d040 con 0x56502590a210 2023-07-21T22:24:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.456+0000 7f64c17fa700 10 client.26261 handle_command_reply: tid=0 2023-07-21T22:24:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.456+0000 7f64f3bb8b80 1 client.26261 shutdown 2023-07-21T22:24:18.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/1591061302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 msgr2=0x565025905d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 0x565025905d70 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f64d400c010 tx=0x7f64d4005dc0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/1591061302 shutdown_connections 2023-07-21T22:24:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56502590a210 0x565025974d10 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5650257606b0 0x565025905d70 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56502591a020 0x5650259067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64c17fa700 0 client.26261 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:18.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 --2- 172.21.15.151:0/1591061302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5650258f9ae0 0x5650259062b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/1591061302 >> 172.21.15.151:0/1591061302 conn(0x565025907cf0 msgr2=0x5650259046a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/1591061302 shutdown_connections 2023-07-21T22:24:18.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 1 -- 172.21.15.151:0/1591061302 wait complete. 2023-07-21T22:24:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.457+0000 7f64f3bb8b80 20 client.26261 trim_cache size 0 max 16384 2023-07-21T22:24:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:24:18.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:24:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:24:18.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:24:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 -- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a12c0 msgr2=0x7f64c40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a12c0 0x7f64c40a3770 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f64d00076d0 tx=0x7f64d0007a90 comp rx=0 tx=0).stop 2023-07-21T22:24:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 -- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64d8100500 msgr2=0x7f64d8198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64d8100500 0x7f64d8198280 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f64c800e9a0 tx=0x7f64c800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 -- 172.21.15.151:0/1930144273 shutdown_connections 2023-07-21T22:24:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f64c40a12c0 0x7f64c40a3770 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64d80ffb50 0x7f64d8197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f64d8105b80 0x7f64d819c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 --2- 172.21.15.151:0/1930144273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64d8100500 0x7f64d8198280 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 -- 172.21.15.151:0/1930144273 >> 172.21.15.151:0/1930144273 conn(0x7f64d80fb650 msgr2=0x7f64d810ad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 -- 172.21.15.151:0/1930144273 shutdown_connections 2023-07-21T22:24:18.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:18.458+0000 7f64e01ff700 1 -- 172.21.15.151:0/1930144273 wait complete. 2023-07-21T22:24:18.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:18 smithi187 ceph-mon[96918]: pgmap v156: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 35 MiB/s wr, 305 op/s 2023-07-21T22:24:18.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:18 smithi195 ceph-mon[97365]: pgmap v156: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 35 MiB/s wr, 305 op/s 2023-07-21T22:24:18.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:18 smithi151 ceph-mon[95510]: pgmap v156: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 35 MiB/s wr, 305 op/s 2023-07-21T22:24:18.975 INFO:teuthology.orchestra.run.smithi151.stderr:20300000 of 50000000 tuples (40%) done (elapsed 282.47 s, remaining 413.26 s) 2023-07-21T22:24:20.183 INFO:teuthology.orchestra.run.smithi151.stderr:20400000 of 50000000 tuples (40%) done (elapsed 283.68 s, remaining 411.61 s) 2023-07-21T22:24:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:20 smithi187 ceph-mon[96918]: pgmap v157: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 23 MiB/s wr, 150 op/s 2023-07-21T22:24:20.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:20 smithi195 ceph-mon[97365]: pgmap v157: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 23 MiB/s wr, 150 op/s 2023-07-21T22:24:20.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:20 smithi151 ceph-mon[95510]: pgmap v157: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 23 MiB/s wr, 150 op/s 2023-07-21T22:24:21.485 INFO:teuthology.orchestra.run.smithi151.stderr:20500000 of 50000000 tuples (41%) done (elapsed 284.98 s, remaining 410.09 s) 2023-07-21T22:24:22.729 INFO:teuthology.orchestra.run.smithi151.stderr:20600000 of 50000000 tuples (41%) done (elapsed 286.22 s, remaining 408.49 s) 2023-07-21T22:24:22.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:22 smithi187 ceph-mon[96918]: pgmap v158: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 23 MiB/s wr, 150 op/s 2023-07-21T22:24:22.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:22 smithi195 ceph-mon[97365]: pgmap v158: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 23 MiB/s wr, 150 op/s 2023-07-21T22:24:22.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:22 smithi151 ceph-mon[95510]: pgmap v158: 97 pgs: 97 active+clean; 4.7 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 23 MiB/s wr, 150 op/s 2023-07-21T22:24:23.944 INFO:teuthology.orchestra.run.smithi151.stderr:20700000 of 50000000 tuples (41%) done (elapsed 287.44 s, remaining 406.85 s) 2023-07-21T22:24:24.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:24 smithi187 ceph-mon[96918]: pgmap v159: 97 pgs: 97 active+clean; 4.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 35 MiB/s wr, 169 op/s 2023-07-21T22:24:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:24 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:24:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:24 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:24:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:24 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:24:24.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:24 smithi195 ceph-mon[97365]: pgmap v159: 97 pgs: 97 active+clean; 4.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 35 MiB/s wr, 169 op/s 2023-07-21T22:24:24.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:24 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:24:24.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:24 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:24:24.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:24 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:24:24.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:24 smithi151 ceph-mon[95510]: pgmap v159: 97 pgs: 97 active+clean; 4.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 35 MiB/s wr, 169 op/s 2023-07-21T22:24:24.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:24 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:24:24.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:24 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:24:24.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:24 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:24:25.244 INFO:teuthology.orchestra.run.smithi151.stderr:20800000 of 50000000 tuples (41%) done (elapsed 288.74 s, remaining 405.34 s) 2023-07-21T22:24:25.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:25 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:24:25.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:25 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:24:25.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:25 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:24:26.523 INFO:teuthology.orchestra.run.smithi151.stderr:20900000 of 50000000 tuples (41%) done (elapsed 290.01 s, remaining 403.80 s) 2023-07-21T22:24:26.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:26 smithi187 ceph-mon[96918]: pgmap v160: 97 pgs: 97 active+clean; 4.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 23 MiB/s wr, 143 op/s 2023-07-21T22:24:26.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:26 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:24:26.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:26 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:24:26.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:26 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:24:26.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:26 smithi195 ceph-mon[97365]: pgmap v160: 97 pgs: 97 active+clean; 4.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 23 MiB/s wr, 143 op/s 2023-07-21T22:24:26.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:26 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:24:26.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:26 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:24:26.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:26 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:24:26.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:26 smithi151 ceph-mon[95510]: pgmap v160: 97 pgs: 97 active+clean; 4.8 GiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 23 MiB/s wr, 143 op/s 2023-07-21T22:24:26.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:26 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:24:26.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:26 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:24:26.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:26 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:24:27.789 INFO:teuthology.orchestra.run.smithi151.stderr:21000000 of 50000000 tuples (42%) done (elapsed 291.28 s, remaining 402.24 s) 2023-07-21T22:24:27.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:27 smithi187 ceph-mon[96918]: pgmap v161: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 35 MiB/s wr, 164 op/s 2023-07-21T22:24:27.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:27 smithi195 ceph-mon[97365]: pgmap v161: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 35 MiB/s wr, 164 op/s 2023-07-21T22:24:27.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:27 smithi151 ceph-mon[95510]: pgmap v161: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 35 MiB/s wr, 164 op/s 2023-07-21T22:24:29.038 INFO:teuthology.orchestra.run.smithi151.stderr:21100000 of 50000000 tuples (42%) done (elapsed 292.53 s, remaining 400.67 s) 2023-07-21T22:24:30.356 INFO:teuthology.orchestra.run.smithi151.stderr:21200000 of 50000000 tuples (42%) done (elapsed 293.85 s, remaining 399.19 s) 2023-07-21T22:24:30.379 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:29 smithi187 ceph-mon[96918]: pgmap v162: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 40 op/s 2023-07-21T22:24:30.408 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:29 smithi195 ceph-mon[97365]: pgmap v162: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 40 op/s 2023-07-21T22:24:30.450 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:29 smithi151 ceph-mon[95510]: pgmap v162: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 40 op/s 2023-07-21T22:24:31.582 INFO:teuthology.orchestra.run.smithi151.stderr:21300000 of 50000000 tuples (42%) done (elapsed 295.07 s, remaining 397.59 s) 2023-07-21T22:24:31.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.622+0000 7fc6717ff700 1 -- 172.21.15.151:0/430873790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c1004e0 msgr2=0x7fc66c10c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.622+0000 7fc6717ff700 1 --2- 172.21.15.151:0/430873790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c1004e0 0x7fc66c10c920 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fc66400b0a0 tx=0x7fc66400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.623+0000 7fc6717ff700 1 -- 172.21.15.151:0/430873790 shutdown_connections 2023-07-21T22:24:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.623+0000 7fc6717ff700 1 --2- 172.21.15.151:0/430873790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c1004e0 0x7fc66c10c920 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.623+0000 7fc6717ff700 1 --2- 172.21.15.151:0/430873790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc66c105b60 0x7fc66c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.623+0000 7fc6717ff700 1 --2- 172.21.15.151:0/430873790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c0ffb30 0x7fc66c0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.623+0000 7fc6717ff700 1 -- 172.21.15.151:0/430873790 >> 172.21.15.151:0/430873790 conn(0x7fc66c0fb5f0 msgr2=0x7fc66c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.623+0000 7fc6717ff700 1 -- 172.21.15.151:0/430873790 shutdown_connections 2023-07-21T22:24:31.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.623+0000 7fc6717ff700 1 -- 172.21.15.151:0/430873790 wait complete. 2023-07-21T22:24:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.624+0000 7fc6717ff700 1 Processor -- start 2023-07-21T22:24:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.624+0000 7fc6717ff700 1 -- start start 2023-07-21T22:24:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.624+0000 7fc6717ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc66c0ffb30 0x7fc66c197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.624+0000 7fc6717ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c1004e0 0x7fc66c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.624+0000 7fc6717ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c105b60 0x7fc66c19c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.624+0000 7fc6717ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c19cfd0 con 0x7fc66c105b60 2023-07-21T22:24:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.624+0000 7fc6717ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c19d140 con 0x7fc66c1004e0 2023-07-21T22:24:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.624+0000 7fc6717ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c19d300 con 0x7fc66c0ffb30 2023-07-21T22:24:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c105b60 0x7fc66c19c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c105b60 0x7fc66c19c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33442/0 (socket says 172.21.15.151:33442) 2023-07-21T22:24:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66b7fe700 1 -- 172.21.15.151:0/1234819685 learned_addr learned my addr 172.21.15.151:0/1234819685 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66affd700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc66c0ffb30 0x7fc66c197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c1004e0 0x7fc66c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66b7fe700 1 -- 172.21.15.151:0/1234819685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc66c0ffb30 msgr2=0x7fc66c197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66b7fe700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc66c0ffb30 0x7fc66c197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66b7fe700 1 -- 172.21.15.151:0/1234819685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c1004e0 msgr2=0x7fc66c198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66b7fe700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c1004e0 0x7fc66c198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.625+0000 7fc66b7fe700 1 -- 172.21.15.151:0/1234819685 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc664009d00 con 0x7fc66c105b60 2023-07-21T22:24:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.626+0000 7fc66b7fe700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c105b60 0x7fc66c19c990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc664009fd0 tx=0x7fc664004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.626+0000 7fc653fff700 1 -- 172.21.15.151:0/1234819685 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66400e040 con 0x7fc66c105b60 2023-07-21T22:24:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.626+0000 7fc6717ff700 1 -- 172.21.15.151:0/1234819685 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66c19d580 con 0x7fc66c105b60 2023-07-21T22:24:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.626+0000 7fc653fff700 1 -- 172.21.15.151:0/1234819685 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc66400ceb0 con 0x7fc66c105b60 2023-07-21T22:24:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.626+0000 7fc653fff700 1 -- 172.21.15.151:0/1234819685 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc664005680 con 0x7fc66c105b60 2023-07-21T22:24:31.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.626+0000 7fc6717ff700 1 -- 172.21.15.151:0/1234819685 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66c1a4e20 con 0x7fc66c105b60 2023-07-21T22:24:31.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.630+0000 7fc653fff700 1 -- 172.21.15.151:0/1234819685 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fc66401bd60 con 0x7fc66c105b60 2023-07-21T22:24:31.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.631+0000 7fc6851eeb80 1 Processor -- start 2023-07-21T22:24:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.631+0000 7fc6851eeb80 1 -- start start 2023-07-21T22:24:31.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc653fff700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc6540a12c0 0x7fc6540a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 0x5555d83c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 0x5555d83c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d82c7c50 con 0x5555d821e6b0 2023-07-21T22:24:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d831a9e0 con 0x5555d83c8660 2023-07-21T22:24:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d8313e70 con 0x5555d83c8210 2023-07-21T22:24:31.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc653fff700 1 -- 172.21.15.151:0/1234819685 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc6640ce8a0 con 0x7fc66c105b60 2023-07-21T22:24:31.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc66affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc66affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33454/0 (socket says 172.21.15.151:33454) 2023-07-21T22:24:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc66affd700 1 -- 172.21.15.151:0/4172775515 learned_addr learned my addr 172.21.15.151:0/4172775515 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc6540a12c0 0x7fc6540a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/4172775515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 0x5555d83c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.632+0000 7fc66b7fe700 1 --2- 172.21.15.151:0/4172775515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 0x5555d83c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.633+0000 7fc66affd700 1 -- 172.21.15.151:0/4172775515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 msgr2=0x5555d83c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.633+0000 7fc66affd700 1 --2- 172.21.15.151:0/4172775515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 0x5555d83c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.633+0000 7fc66affd700 1 -- 172.21.15.151:0/4172775515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 msgr2=0x5555d83c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.633+0000 7fc66affd700 1 --2- 172.21.15.151:0/4172775515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 0x5555d83c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.633+0000 7fc66affd700 1 -- 172.21.15.151:0/4172775515 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555d8141d80 con 0x5555d821e6b0 2023-07-21T22:24:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.633+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc6540a12c0 0x7fc6540a3770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc66000efd0 tx=0x7fc66000c2d0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.633+0000 7fc66affd700 1 --2- 172.21.15.151:0/4172775515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c7cd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00bd70 tx=0x7fc65c0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e28f44c0d031b9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.634+0000 7fc6517fa700 1 -- 172.21.15.151:0/4172775515 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c010e10 con 0x5555d821e6b0 2023-07-21T22:24:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.634+0000 7fc6517fa700 1 -- 172.21.15.151:0/4172775515 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc65c015070 con 0x5555d821e6b0 2023-07-21T22:24:31.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.634+0000 7fc6517fa700 1 -- 172.21.15.151:0/4172775515 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0116a0 con 0x5555d821e6b0 2023-07-21T22:24:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.635+0000 7fc6851eeb80 1 -- 172.21.15.151:0/4172775515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 msgr2=0x5555d83c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.635+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/4172775515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c7cd0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fc65c00bd70 tx=0x7fc65c0106b0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.635+0000 7fc6851eeb80 1 -- 172.21.15.151:0/4172775515 shutdown_connections 2023-07-21T22:24:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.635+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/4172775515 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 0x5555d83c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.635+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/4172775515 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c7cd0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.635+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/4172775515 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 0x5555d83c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.635+0000 7fc6851eeb80 1 -- 172.21.15.151:0/4172775515 >> 172.21.15.151:0/4172775515 conn(0x5555d83b7ae0 msgr2=0x5555d83bd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.635+0000 7fc6851eeb80 1 -- 172.21.15.151:0/4172775515 shutdown_connections 2023-07-21T22:24:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.635+0000 7fc6851eeb80 1 -- 172.21.15.151:0/4172775515 wait complete. 2023-07-21T22:24:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.636+0000 7fc6851eeb80 1 -- start start 2023-07-21T22:24:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.636+0000 7fc6851eeb80 1 Processor -- start 2023-07-21T22:24:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.636+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83ce610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.636+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8210 0x5555d83cb900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.636+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 0x5555d83cc040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.636+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d82b3a60 con 0x5555d821e6b0 2023-07-21T22:24:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.636+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d82b3760 con 0x5555d83c8210 2023-07-21T22:24:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.636+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d81978c0 con 0x5555d83c8660 2023-07-21T22:24:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc6851eeb80 10 client.0 _ll_register_callbacks cb 0x5555d82b1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83ce610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 0x5555d83cc040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83ce610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33460/0 (socket says 172.21.15.151:33460) 2023-07-21T22:24:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66affd700 1 -- 172.21.15.151:0/1867000763 learned_addr learned my addr 172.21.15.151:0/1867000763 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8210 0x5555d83cb900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66b7fe700 1 -- 172.21.15.151:0/1867000763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8210 msgr2=0x5555d83cb900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66b7fe700 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8210 0x5555d83cb900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66b7fe700 1 -- 172.21.15.151:0/1867000763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 msgr2=0x5555d83ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66b7fe700 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83ce610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66b7fe700 1 -- 172.21.15.151:0/1867000763 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c00b9a0 con 0x5555d83c8660 2023-07-21T22:24:31.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.637+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8210 0x5555d83cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:24:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.638+0000 7fc66b7fe700 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 0x5555d83cc040 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc6640cc000 tx=0x7fc66409b550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63e64b1c3902b8cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.638+0000 7fc64eff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:24:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.638+0000 7fc64eff5700 1 -- 172.21.15.151:0/1867000763 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66409be70 con 0x5555d83c8660 2023-07-21T22:24:31.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.638+0000 7fc64eff5700 1 -- 172.21.15.151:0/1867000763 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc66401ae90 con 0x5555d83c8660 2023-07-21T22:24:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.638+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1867000763 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555d826d490 con 0x5555d83c8660 2023-07-21T22:24:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.639+0000 7fc64eff5700 1 -- 172.21.15.151:0/1867000763 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc66409fa40 con 0x5555d83c8660 2023-07-21T22:24:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.639+0000 7fc6851eeb80 10 client.26305 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.639+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1867000763 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5555d812ac00 con 0x5555d83c8660 2023-07-21T22:24:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.639+0000 7fc64eff5700 1 -- 172.21.15.151:0/1867000763 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5555d826d490 con 0x5555d83c8660 2023-07-21T22:24:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.639+0000 7fc64eff5700 1 -- 172.21.15.151:0/1867000763 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc6640a3940 con 0x5555d83c8660 2023-07-21T22:24:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.639+0000 7fc6851eeb80 10 client.26305 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:31.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.639+0000 7fc6851eeb80 10 client.26305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.639+0000 7fc6851eeb80 20 client.26305 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.640+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555d83db970 0x5555d83ddd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.640+0000 7fc6851eeb80 4 client.26305 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.640+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1867000763 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555d830ce50 con 0x5555d83db970 2023-07-21T22:24:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.641+0000 7fc66affd700 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555d83db970 0x5555d83ddd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.641+0000 7fc66affd700 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555d83db970 0x5555d83ddd80 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c154a131b0f6439b server_cookie=e99b593c859582bf in_seq=0 out_seq=0 2023-07-21T22:24:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.641+0000 7fc64eff5700 10 client.26305 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:31.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.642+0000 7fc64eff5700 1 -- 172.21.15.151:0/1867000763 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5555d830ce50 con 0x5555d83db970 2023-07-21T22:24:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.642+0000 7fc64eff5700 10 client.26305 handle_command_reply: tid=0 2023-07-21T22:24:31.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.642+0000 7fc6851eeb80 1 client.26305 shutdown 2023-07-21T22:24:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1867000763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 msgr2=0x5555d83cc040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 0x5555d83cc040 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc6640cc000 tx=0x7fc66409b550 comp rx=0 tx=0).stop 2023-07-21T22:24:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1867000763 shutdown_connections 2023-07-21T22:24:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555d83db970 0x5555d83ddd80 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 0x5555d83cc040 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83ce610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc64eff5700 0 client.26305 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1867000763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8210 0x5555d83cb900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1867000763 >> 172.21.15.151:0/1867000763 conn(0x5555d83b7ae0 msgr2=0x5555d83bc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1867000763 shutdown_connections 2023-07-21T22:24:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1867000763 wait complete. 2023-07-21T22:24:31.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.643+0000 7fc6851eeb80 20 client.26305 trim_cache size 0 max 16384 2023-07-21T22:24:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.658+0000 7fc6851eeb80 1 Processor -- start 2023-07-21T22:24:31.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.658+0000 7fc6851eeb80 1 -- start start 2023-07-21T22:24:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 0x5555d83ce1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 0x5555d83c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d826d490 con 0x5555d821e6b0 2023-07-21T22:24:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d83b4b60 con 0x5555d83c8660 2023-07-21T22:24:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d83cce70 con 0x5555d83c8210 2023-07-21T22:24:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc66affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc66affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33468/0 (socket says 172.21.15.151:33468) 2023-07-21T22:24:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc66affd700 1 -- 172.21.15.151:0/1092928839 learned_addr learned my addr 172.21.15.151:0/1092928839 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/1092928839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 0x5555d83ce1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.659+0000 7fc66b7fe700 1 --2- 172.21.15.151:0/1092928839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 0x5555d83c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.660+0000 7fc66affd700 1 -- 172.21.15.151:0/1092928839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 msgr2=0x5555d83ce1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.660+0000 7fc66affd700 1 --2- 172.21.15.151:0/1092928839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 0x5555d83ce1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.660+0000 7fc66affd700 1 -- 172.21.15.151:0/1092928839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 msgr2=0x5555d83c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.660+0000 7fc66affd700 1 --2- 172.21.15.151:0/1092928839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 0x5555d83c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.660+0000 7fc66affd700 1 -- 172.21.15.151:0/1092928839 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555d81681f0 con 0x5555d821e6b0 2023-07-21T22:24:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.660+0000 7fc66affd700 1 --2- 172.21.15.151:0/1092928839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c9140 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x5555d83de650 tx=0x7fc65c005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c302393b81f15638 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.660+0000 7fc651ffb700 1 -- 172.21.15.151:0/1092928839 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c020040 con 0x5555d821e6b0 2023-07-21T22:24:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.660+0000 7fc651ffb700 1 -- 172.21.15.151:0/1092928839 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc65c010e10 con 0x5555d821e6b0 2023-07-21T22:24:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.660+0000 7fc651ffb700 1 -- 172.21.15.151:0/1092928839 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c005040 con 0x5555d821e6b0 2023-07-21T22:24:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.661+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1092928839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 msgr2=0x5555d83c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.661+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1092928839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c9140 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x5555d83de650 tx=0x7fc65c005990 comp rx=0 tx=0).stop 2023-07-21T22:24:31.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.661+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1092928839 shutdown_connections 2023-07-21T22:24:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.661+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1092928839 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d83c8660 0x5555d83c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.661+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1092928839 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d821e6b0 0x5555d83c9140 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.661+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1092928839 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8210 0x5555d83ce1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.661+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1092928839 >> 172.21.15.151:0/1092928839 conn(0x5555d83b7ae0 msgr2=0x5555d83c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.661+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1092928839 shutdown_connections 2023-07-21T22:24:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.661+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1092928839 wait complete. 2023-07-21T22:24:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.662+0000 7fc6851eeb80 1 -- start start 2023-07-21T22:24:31.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.662+0000 7fc6851eeb80 1 Processor -- start 2023-07-21T22:24:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.662+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d821e6b0 0x5555d83d0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.662+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d83c8210 0x5555d83d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.662+0000 7fc6851eeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 0x5555d83d1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.662+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d842e970 con 0x5555d83c8210 2023-07-21T22:24:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.662+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d842eae0 con 0x5555d821e6b0 2023-07-21T22:24:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc6851eeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555d842eca0 con 0x5555d83c8660 2023-07-21T22:24:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc6851eeb80 10 client.0 _ll_register_callbacks cb 0x7fc664097e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:31.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66a7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d83c8210 0x5555d83d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d821e6b0 0x5555d83d0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66a7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d83c8210 0x5555d83d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33476/0 (socket says 172.21.15.151:33476) 2023-07-21T22:24:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66a7fc700 1 -- 172.21.15.151:0/1612356468 learned_addr learned my addr 172.21.15.151:0/1612356468 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66b7fe700 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 0x5555d83d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66a7fc700 1 -- 172.21.15.151:0/1612356468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 msgr2=0x5555d83d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 0x5555d83d1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66a7fc700 1 -- 172.21.15.151:0/1612356468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d821e6b0 msgr2=0x5555d83d0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d821e6b0 0x5555d83d0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66a7fc700 1 -- 172.21.15.151:0/1612356468 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555d8141d80 con 0x5555d83c8210 2023-07-21T22:24:31.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.663+0000 7fc66affd700 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d821e6b0 0x5555d83d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.664+0000 7fc66a7fc700 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d83c8210 0x5555d83d10d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc660005950 tx=0x7fc6600047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9063b921c492497b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.664+0000 7fc64eff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:31.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.664+0000 7fc64eff5700 1 -- 172.21.15.151:0/1612356468 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc660003cf0 con 0x5555d83c8210 2023-07-21T22:24:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.664+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1612356468 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc65c015070 con 0x5555d83c8210 2023-07-21T22:24:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.664+0000 7fc64eff5700 1 -- 172.21.15.151:0/1612356468 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc66000c620 con 0x5555d83c8210 2023-07-21T22:24:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.664+0000 7fc64eff5700 1 -- 172.21.15.151:0/1612356468 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc660003e50 con 0x5555d83c8210 2023-07-21T22:24:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.664+0000 7fc6851eeb80 10 client.16545 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.664+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1612356468 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5555d8140250 con 0x5555d83c8210 2023-07-21T22:24:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.665+0000 7fc64eff5700 1 -- 172.21.15.151:0/1612356468 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc65c015070 con 0x5555d83c8210 2023-07-21T22:24:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.665+0000 7fc64eff5700 1 -- 172.21.15.151:0/1612356468 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc660010800 con 0x5555d83c8210 2023-07-21T22:24:31.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.665+0000 7fc6851eeb80 10 client.16545 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.665+0000 7fc6851eeb80 10 client.16545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.665+0000 7fc6851eeb80 20 client.16545 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.665+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555d8430490 0x5555d84328a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.665+0000 7fc6851eeb80 4 client.16545 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:24:31.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.665+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1612356468 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5555d82ceff0 con 0x5555d8430490 2023-07-21T22:24:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.665+0000 7fc66affd700 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555d8430490 0x5555d84328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.666+0000 7fc64eff5700 10 client.16545 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:31.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.666+0000 7fc66affd700 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555d8430490 0x5555d84328a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8eb395512553fa55 server_cookie=47c8c54efd01c611 in_seq=0 out_seq=0 2023-07-21T22:24:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc64eff5700 1 -- 172.21.15.151:0/1612356468 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5555d82ceff0 con 0x5555d8430490 2023-07-21T22:24:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc64eff5700 10 client.16545 handle_command_reply: tid=0 2023-07-21T22:24:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc6851eeb80 1 client.16545 shutdown 2023-07-21T22:24:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1612356468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d83c8210 msgr2=0x5555d83d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d83c8210 0x5555d83d10d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7fc660005950 tx=0x7fc6600047c0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1612356468 shutdown_connections 2023-07-21T22:24:31.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555d8430490 0x5555d84328a0 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555d821e6b0 0x5555d83d0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555d83c8660 0x5555d83d1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc64eff5700 0 client.16545 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc6851eeb80 1 --2- 172.21.15.151:0/1612356468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555d83c8210 0x5555d83d10d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.679+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1612356468 >> 172.21.15.151:0/1612356468 conn(0x5555d83b7ae0 msgr2=0x5555d83c92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1612356468 shutdown_connections 2023-07-21T22:24:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6851eeb80 1 -- 172.21.15.151:0/1612356468 wait complete. 2023-07-21T22:24:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6851eeb80 20 client.16545 trim_cache size 0 max 16384 2023-07-21T22:24:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:24:31.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:24:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:24:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:24:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 -- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc6540a12c0 msgr2=0x7fc6540a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:31.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc6540a12c0 0x7fc6540a3770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc66000efd0 tx=0x7fc66000c2d0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 -- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c105b60 msgr2=0x7fc66c19c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c105b60 0x7fc66c19c990 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fc664009fd0 tx=0x7fc664004c80 comp rx=0 tx=0).stop 2023-07-21T22:24:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 -- 172.21.15.151:0/1234819685 shutdown_connections 2023-07-21T22:24:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc6540a12c0 0x7fc6540a3770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc66c105b60 0x7fc66c19c990 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc66c0ffb30 0x7fc66c197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 --2- 172.21.15.151:0/1234819685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c1004e0 0x7fc66c198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.680+0000 7fc6717ff700 1 -- 172.21.15.151:0/1234819685 >> 172.21.15.151:0/1234819685 conn(0x7fc66c0fb5f0 msgr2=0x7fc66c10ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.681+0000 7fc6717ff700 1 -- 172.21.15.151:0/1234819685 shutdown_connections 2023-07-21T22:24:31.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:31.681+0000 7fc6717ff700 1 -- 172.21.15.151:0/1234819685 wait complete. 2023-07-21T22:24:32.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:32 smithi187 ceph-mon[96918]: pgmap v163: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 40 op/s 2023-07-21T22:24:32.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:32 smithi195 ceph-mon[97365]: pgmap v163: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 40 op/s 2023-07-21T22:24:32.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:32 smithi151 ceph-mon[95510]: pgmap v163: 97 pgs: 97 active+clean; 4.8 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 23 MiB/s wr, 40 op/s 2023-07-21T22:24:32.794 INFO:teuthology.orchestra.run.smithi151.stderr:21400000 of 50000000 tuples (42%) done (elapsed 296.29 s, remaining 395.97 s) 2023-07-21T22:24:34.064 INFO:teuthology.orchestra.run.smithi151.stderr:21500000 of 50000000 tuples (43%) done (elapsed 297.56 s, remaining 394.43 s) 2023-07-21T22:24:34.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:34 smithi187 ceph-mon[96918]: pgmap v164: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 36 MiB/s wr, 59 op/s 2023-07-21T22:24:34.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:34 smithi195 ceph-mon[97365]: pgmap v164: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 36 MiB/s wr, 59 op/s 2023-07-21T22:24:34.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:34 smithi151 ceph-mon[95510]: pgmap v164: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 36 MiB/s wr, 59 op/s 2023-07-21T22:24:35.387 INFO:teuthology.orchestra.run.smithi151.stderr:21600000 of 50000000 tuples (43%) done (elapsed 298.88 s, remaining 392.97 s) 2023-07-21T22:24:36.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:36 smithi187 ceph-mon[96918]: pgmap v165: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 39 op/s 2023-07-21T22:24:36.646 INFO:teuthology.orchestra.run.smithi151.stderr:21700000 of 50000000 tuples (43%) done (elapsed 300.14 s, remaining 391.42 s) 2023-07-21T22:24:36.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:36 smithi195 ceph-mon[97365]: pgmap v165: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 39 op/s 2023-07-21T22:24:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:36 smithi151 ceph-mon[95510]: pgmap v165: 97 pgs: 97 active+clean; 4.9 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 24 MiB/s wr, 39 op/s 2023-07-21T22:24:37.859 INFO:teuthology.orchestra.run.smithi151.stderr:21800000 of 50000000 tuples (43%) done (elapsed 301.35 s, remaining 389.82 s) 2023-07-21T22:24:38.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:38 smithi187 ceph-mon[96918]: pgmap v166: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 MiB/s wr, 57 op/s 2023-07-21T22:24:38.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:38 smithi195 ceph-mon[97365]: pgmap v166: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 MiB/s wr, 57 op/s 2023-07-21T22:24:38.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:38 smithi151 ceph-mon[95510]: pgmap v166: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 36 MiB/s wr, 57 op/s 2023-07-21T22:24:39.210 INFO:teuthology.orchestra.run.smithi151.stderr:21900000 of 50000000 tuples (43%) done (elapsed 302.70 s, remaining 388.40 s) 2023-07-21T22:24:40.471 INFO:teuthology.orchestra.run.smithi151.stderr:22000000 of 50000000 tuples (44%) done (elapsed 303.96 s, remaining 386.86 s) 2023-07-21T22:24:40.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:40 smithi187 ceph-mon[96918]: pgmap v167: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-07-21T22:24:40.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:40 smithi195 ceph-mon[97365]: pgmap v167: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-07-21T22:24:40.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:40 smithi151 ceph-mon[95510]: pgmap v167: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-07-21T22:24:41.699 INFO:teuthology.orchestra.run.smithi151.stderr:22100000 of 50000000 tuples (44%) done (elapsed 305.19 s, remaining 385.29 s) 2023-07-21T22:24:42.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:42 smithi187 ceph-mon[96918]: pgmap v168: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-07-21T22:24:42.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:42 smithi195 ceph-mon[97365]: pgmap v168: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-07-21T22:24:42.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:42 smithi151 ceph-mon[95510]: pgmap v168: 97 pgs: 97 active+clean; 5.0 GiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 24 MiB/s wr, 36 op/s 2023-07-21T22:24:43.053 INFO:teuthology.orchestra.run.smithi151.stderr:22200000 of 50000000 tuples (44%) done (elapsed 306.54 s, remaining 383.87 s) 2023-07-21T22:24:44.280 INFO:teuthology.orchestra.run.smithi151.stderr:22300000 of 50000000 tuples (44%) done (elapsed 307.77 s, remaining 382.30 s) 2023-07-21T22:24:44.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:44 smithi187 ceph-mon[96918]: pgmap v169: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 36 MiB/s wr, 53 op/s 2023-07-21T22:24:44.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:44 smithi195 ceph-mon[97365]: pgmap v169: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 36 MiB/s wr, 53 op/s 2023-07-21T22:24:44.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:44 smithi151 ceph-mon[95510]: pgmap v169: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 36 MiB/s wr, 53 op/s 2023-07-21T22:24:44.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.852+0000 7f5a707ff700 1 -- 172.21.15.151:0/151796797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a681004e0 msgr2=0x7f5a6810c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.852+0000 7f5a707ff700 1 --2- 172.21.15.151:0/151796797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a681004e0 0x7f5a6810c920 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f5a6000b0a0 tx=0x7f5a6000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.852+0000 7f5a707ff700 1 -- 172.21.15.151:0/151796797 shutdown_connections 2023-07-21T22:24:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.852+0000 7f5a707ff700 1 --2- 172.21.15.151:0/151796797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a681004e0 0x7f5a6810c920 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.852+0000 7f5a707ff700 1 --2- 172.21.15.151:0/151796797 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a68105b60 0x7f5a68105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.852+0000 7f5a707ff700 1 --2- 172.21.15.151:0/151796797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a680ffb30 0x7f5a680fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.852+0000 7f5a707ff700 1 -- 172.21.15.151:0/151796797 >> 172.21.15.151:0/151796797 conn(0x7f5a680fb5f0 msgr2=0x7f5a680fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:44.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.852+0000 7f5a707ff700 1 -- 172.21.15.151:0/151796797 shutdown_connections 2023-07-21T22:24:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.853+0000 7f5a707ff700 1 -- 172.21.15.151:0/151796797 wait complete. 2023-07-21T22:24:44.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.854+0000 7f5a707ff700 1 Processor -- start 2023-07-21T22:24:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.854+0000 7f5a707ff700 1 -- start start 2023-07-21T22:24:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.854+0000 7f5a707ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a680ffb30 0x7f5a68197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.854+0000 7f5a707ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a681004e0 0x7f5a68198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.854+0000 7f5a707ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a68105b60 0x7f5a6819c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.854+0000 7f5a707ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6819cfd0 con 0x7f5a68105b60 2023-07-21T22:24:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.854+0000 7f5a707ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6819d140 con 0x7f5a681004e0 2023-07-21T22:24:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.854+0000 7f5a707ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6819d300 con 0x7f5a680ffb30 2023-07-21T22:24:44.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6e59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a680ffb30 0x7f5a68197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6ed9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a68105b60 0x7f5a6819c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6e59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a680ffb30 0x7f5a68197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48028/0 (socket says 172.21.15.151:48028) 2023-07-21T22:24:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6e59b700 1 -- 172.21.15.151:0/1120706586 learned_addr learned my addr 172.21.15.151:0/1120706586 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:44.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a681004e0 0x7f5a68198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6e59b700 1 -- 172.21.15.151:0/1120706586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a681004e0 msgr2=0x7f5a68198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6e59b700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a681004e0 0x7f5a68198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6e59b700 1 -- 172.21.15.151:0/1120706586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a68105b60 msgr2=0x7f5a6819c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6e59b700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a68105b60 0x7f5a6819c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.855+0000 7f5a6e59b700 1 -- 172.21.15.151:0/1120706586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a60009d00 con 0x7f5a680ffb30 2023-07-21T22:24:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.856+0000 7f5a6e59b700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a680ffb30 0x7f5a68197de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400d950 tx=0x7f5a6400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.856+0000 7f5a5f7fe700 1 -- 172.21.15.151:0/1120706586 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400f890 con 0x7f5a680ffb30 2023-07-21T22:24:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.856+0000 7f5a5f7fe700 1 -- 172.21.15.151:0/1120706586 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a6400fe80 con 0x7f5a680ffb30 2023-07-21T22:24:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.856+0000 7f5a5f7fe700 1 -- 172.21.15.151:0/1120706586 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6400e3b0 con 0x7f5a680ffb30 2023-07-21T22:24:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.856+0000 7f5a707ff700 1 -- 172.21.15.151:0/1120706586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6819d5e0 con 0x7f5a680ffb30 2023-07-21T22:24:44.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.856+0000 7f5a707ff700 1 -- 172.21.15.151:0/1120706586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a681a4e20 con 0x7f5a680ffb30 2023-07-21T22:24:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.860+0000 7f5a5f7fe700 1 -- 172.21.15.151:0/1120706586 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5a64010460 con 0x7f5a680ffb30 2023-07-21T22:24:44.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.861+0000 7f5a84032b80 1 Processor -- start 2023-07-21T22:24:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.861+0000 7f5a84032b80 1 -- start start 2023-07-21T22:24:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.861+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c998cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.861+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c992f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.861+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9934a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.861+0000 7f5a84032b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c898c50 con 0x55fe3c999210 2023-07-21T22:24:44.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.861+0000 7f5a84032b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c8eb9e0 con 0x55fe3c7ef6b0 2023-07-21T22:24:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.861+0000 7f5a84032b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c8e4e70 con 0x55fe3c999660 2023-07-21T22:24:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6ed9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c998cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6ed9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c998cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39156/0 (socket says 172.21.15.151:39156) 2023-07-21T22:24:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6ed9c700 1 -- 172.21.15.151:0/4156598916 learned_addr learned my addr 172.21.15.151:0/4156598916 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6e59b700 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c992f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9934a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6ed9c700 1 -- 172.21.15.151:0/4156598916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 msgr2=0x55fe3c9934a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9934a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6ed9c700 1 -- 172.21.15.151:0/4156598916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 msgr2=0x55fe3c992f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c992f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6ed9c700 1 -- 172.21.15.151:0/4156598916 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe3c712d80 con 0x55fe3c7ef6b0 2023-07-21T22:24:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9934a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.862+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c998cd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a60015000 tx=0x7f5a6000ce90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed43751f1a727d78 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.863+0000 7f5a5f7fe700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a540a1340 0x7f5a540a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.863+0000 7f5a5cff9700 1 -- 172.21.15.151:0/4156598916 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6000e040 con 0x55fe3c7ef6b0 2023-07-21T22:24:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.863+0000 7f5a5f7fe700 1 -- 172.21.15.151:0/1120706586 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5a640cca00 con 0x7f5a680ffb30 2023-07-21T22:24:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.863+0000 7f5a5cff9700 1 -- 172.21.15.151:0/4156598916 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a60009450 con 0x55fe3c7ef6b0 2023-07-21T22:24:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.863+0000 7f5a6e59b700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a540a1340 0x7f5a540a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.863+0000 7f5a5cff9700 1 -- 172.21.15.151:0/4156598916 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a6001c6a0 con 0x55fe3c7ef6b0 2023-07-21T22:24:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 -- 172.21.15.151:0/4156598916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 msgr2=0x55fe3c998cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a6e59b700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a540a1340 0x7f5a540a37f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a64095fe0 tx=0x7f5a64010000 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c998cd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5a60015000 tx=0x7f5a6000ce90 comp rx=0 tx=0).stop 2023-07-21T22:24:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 -- 172.21.15.151:0/4156598916 shutdown_connections 2023-07-21T22:24:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c998cd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9934a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 --2- 172.21.15.151:0/4156598916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c992f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 -- 172.21.15.151:0/4156598916 >> 172.21.15.151:0/4156598916 conn(0x55fe3c988ae0 msgr2=0x55fe3c98e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 -- 172.21.15.151:0/4156598916 shutdown_connections 2023-07-21T22:24:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 -- 172.21.15.151:0/4156598916 wait complete. 2023-07-21T22:24:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.864+0000 7f5a84032b80 1 -- start start 2023-07-21T22:24:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.865+0000 7f5a84032b80 1 Processor -- start 2023-07-21T22:24:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.865+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c99f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.865+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.865+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c99cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.865+0000 7f5a84032b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c884a60 con 0x55fe3c999210 2023-07-21T22:24:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.865+0000 7f5a84032b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c884760 con 0x55fe3c7ef6b0 2023-07-21T22:24:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.865+0000 7f5a84032b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c7688c0 con 0x55fe3c999660 2023-07-21T22:24:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.865+0000 7f5a84032b80 10 client.0 _ll_register_callbacks cb 0x55fe3c882700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6dd9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6dd9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59352/0 (socket says 172.21.15.151:59352) 2023-07-21T22:24:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/3968651390 learned_addr learned my addr 172.21.15.151:0/3968651390 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c99cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c99f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/3968651390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 msgr2=0x55fe3c99cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c99cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/3968651390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 msgr2=0x55fe3c99f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c99f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.866+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/3968651390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6810d220 con 0x55fe3c999210 2023-07-21T22:24:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.867+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99c700 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007690 tx=0x7f5a58012730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f6651c3cf88bdb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.867+0000 7f5a51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.867+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3968651390 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58004520 con 0x55fe3c999210 2023-07-21T22:24:44.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.867+0000 7f5a84032b80 1 -- 172.21.15.151:0/3968651390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fe3c83e490 con 0x55fe3c999210 2023-07-21T22:24:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.867+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3968651390 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5a58003680 con 0x55fe3c999210 2023-07-21T22:24:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.867+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3968651390 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a58003880 con 0x55fe3c999210 2023-07-21T22:24:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.867+0000 7f5a84032b80 10 client.16557 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.867+0000 7f5a84032b80 1 -- 172.21.15.151:0/3968651390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fe3c6fbc00 con 0x55fe3c999210 2023-07-21T22:24:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.867+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3968651390 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fe3c83e490 con 0x55fe3c999210 2023-07-21T22:24:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.868+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3968651390 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5a58025960 con 0x55fe3c999210 2023-07-21T22:24:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.868+0000 7f5a84032b80 10 client.16557 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:44.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.868+0000 7f5a84032b80 10 client.16557 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.868+0000 7f5a84032b80 20 client.16557 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.868+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fe3c9aca60 0x55fe3c9aee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.868+0000 7f5a84032b80 4 client.16557 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:44.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.868+0000 7f5a84032b80 1 -- 172.21.15.151:0/3968651390 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fe3c8dde50 con 0x55fe3c9aca60 2023-07-21T22:24:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.868+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fe3c9aca60 0x55fe3c9aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.869+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fe3c9aca60 0x55fe3c9aee70 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=163beef6189b4d91 server_cookie=a0e6439ad72a4c64 in_seq=0 out_seq=0 2023-07-21T22:24:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.869+0000 7f5a51ffb700 10 client.16557 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:44.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3968651390 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fe3c8dde50 con 0x55fe3c9aca60 2023-07-21T22:24:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a51ffb700 10 client.16557 handle_command_reply: tid=0 2023-07-21T22:24:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 client.16557 shutdown 2023-07-21T22:24:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 -- 172.21.15.151:0/3968651390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 msgr2=0x55fe3c99c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99c700 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007690 tx=0x7f5a58012730 comp rx=0 tx=0).stop 2023-07-21T22:24:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 -- 172.21.15.151:0/3968651390 shutdown_connections 2023-07-21T22:24:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fe3c9aca60 0x55fe3c9aee70 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c99f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c99cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3968651390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99c700 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 -- 172.21.15.151:0/3968651390 >> 172.21.15.151:0/3968651390 conn(0x55fe3c988ae0 msgr2=0x55fe3c98d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a51ffb700 0 client.16557 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 -- 172.21.15.151:0/3968651390 shutdown_connections 2023-07-21T22:24:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.870+0000 7f5a84032b80 1 -- 172.21.15.151:0/3968651390 wait complete. 2023-07-21T22:24:44.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.871+0000 7f5a84032b80 20 client.16557 trim_cache size 0 max 16384 2023-07-21T22:24:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.891+0000 7f5a84032b80 1 Processor -- start 2023-07-21T22:24:44.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a84032b80 1 -- start start 2023-07-21T22:24:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c99a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9a8a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a84032b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c993b30 con 0x55fe3c999210 2023-07-21T22:24:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a84032b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c993d00 con 0x55fe3c7ef6b0 2023-07-21T22:24:44.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a84032b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c9aa0b0 con 0x55fe3c999660 2023-07-21T22:24:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a6dd9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a6dd9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59354/0 (socket says 172.21.15.151:59354) 2023-07-21T22:24:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/2428871255 learned_addr learned my addr 172.21.15.151:0/2428871255 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9a8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.892+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c99a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/2428871255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 msgr2=0x55fe3c9a8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:44.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9a8a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/2428871255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 msgr2=0x55fe3c99a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c99a2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/2428871255 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fe3c7391f0 con 0x55fe3c999210 2023-07-21T22:24:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99f020 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5a58005c20 tx=0x7f5a58005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e1158f4b18a8d52 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a5d7fa700 1 -- 172.21.15.151:0/2428871255 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5801b440 con 0x55fe3c999210 2023-07-21T22:24:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a5d7fa700 1 -- 172.21.15.151:0/2428871255 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a58025480 con 0x55fe3c999210 2023-07-21T22:24:44.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.893+0000 7f5a5d7fa700 1 -- 172.21.15.151:0/2428871255 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5801b8e0 con 0x55fe3c999210 2023-07-21T22:24:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.894+0000 7f5a84032b80 1 -- 172.21.15.151:0/2428871255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 msgr2=0x55fe3c99f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.894+0000 7f5a84032b80 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99f020 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5a58005c20 tx=0x7f5a58005c50 comp rx=0 tx=0).stop 2023-07-21T22:24:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.894+0000 7f5a84032b80 1 -- 172.21.15.151:0/2428871255 shutdown_connections 2023-07-21T22:24:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.894+0000 7f5a84032b80 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c99a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.894+0000 7f5a84032b80 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c999660 0x55fe3c9a8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.894+0000 7f5a84032b80 1 --2- 172.21.15.151:0/2428871255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999210 0x55fe3c99f020 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.894+0000 7f5a84032b80 1 -- 172.21.15.151:0/2428871255 >> 172.21.15.151:0/2428871255 conn(0x55fe3c988ae0 msgr2=0x55fe3c9a8350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:44.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.894+0000 7f5a84032b80 1 -- 172.21.15.151:0/2428871255 shutdown_connections 2023-07-21T22:24:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.894+0000 7f5a84032b80 1 -- 172.21.15.151:0/2428871255 wait complete. 2023-07-21T22:24:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.895+0000 7f5a84032b80 1 -- start start 2023-07-21T22:24:44.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.895+0000 7f5a84032b80 1 Processor -- start 2023-07-21T22:24:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.895+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c9a1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.895+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c999210 0x55fe3c9a1fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.895+0000 7f5a84032b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999660 0x55fe3c9a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.895+0000 7f5a84032b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c9ff8e0 con 0x55fe3c999660 2023-07-21T22:24:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.895+0000 7f5a84032b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c9ffa20 con 0x55fe3c999210 2023-07-21T22:24:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.895+0000 7f5a84032b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fe3c9ffbe0 con 0x55fe3c7ef6b0 2023-07-21T22:24:44.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.895+0000 7f5a84032b80 10 client.0 _ll_register_callbacks cb 0x7f5a58007980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6ed9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c9a1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6dd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c999210 0x55fe3c9a1fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6ed9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999660 0x55fe3c9a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6dd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c999210 0x55fe3c9a1fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39196/0 (socket says 172.21.15.151:39196) 2023-07-21T22:24:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/3588225657 learned_addr learned my addr 172.21.15.151:0/3588225657 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/3588225657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c7ef6b0 msgr2=0x55fe3c9a1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c9a1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/3588225657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999660 msgr2=0x55fe3c9a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999660 0x55fe3c9a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.896+0000 7f5a6dd9a700 1 -- 172.21.15.151:0/3588225657 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6002e040 con 0x55fe3c999210 2023-07-21T22:24:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.897+0000 7f5a6dd9a700 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c999210 0x55fe3c9a1fb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007c60 tx=0x7f5a58025800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f53387583f2b36bc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.897+0000 7f5a51ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:24:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.897+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3588225657 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5803a070 con 0x55fe3c999210 2023-07-21T22:24:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.897+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3588225657 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5a5801b440 con 0x55fe3c999210 2023-07-21T22:24:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.897+0000 7f5a84032b80 1 -- 172.21.15.151:0/3588225657 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a60009450 con 0x55fe3c999210 2023-07-21T22:24:44.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.897+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3588225657 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a58007ea0 con 0x55fe3c999210 2023-07-21T22:24:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.897+0000 7f5a84032b80 10 client.26294 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.897+0000 7f5a84032b80 1 -- 172.21.15.151:0/3588225657 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55fe3c6fbc00 con 0x55fe3c999210 2023-07-21T22:24:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.898+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3588225657 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a58043020 con 0x55fe3c999210 2023-07-21T22:24:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.898+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3588225657 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f5a58035070 con 0x55fe3c999210 2023-07-21T22:24:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.898+0000 7f5a84032b80 10 client.26294 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.898+0000 7f5a84032b80 10 client.26294 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:44.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.898+0000 7f5a84032b80 20 client.26294 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.898+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fe3ca00fa0 0x55fe3ca033b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.898+0000 7f5a84032b80 4 client.26294 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:24:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.898+0000 7f5a84032b80 1 -- 172.21.15.151:0/3588225657 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fe3c89fff0 con 0x55fe3ca00fa0 2023-07-21T22:24:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.898+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fe3ca00fa0 0x55fe3ca033b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.899+0000 7f5a51ffb700 10 client.26294 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:44.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.899+0000 7f5a6ed9c700 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fe3ca00fa0 0x55fe3ca033b0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67020529cf3b6c66 server_cookie=d87ee48683a250f0 in_seq=0 out_seq=0 2023-07-21T22:24:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a51ffb700 1 -- 172.21.15.151:0/3588225657 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fe3c89fff0 con 0x55fe3ca00fa0 2023-07-21T22:24:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a51ffb700 10 client.26294 handle_command_reply: tid=0 2023-07-21T22:24:44.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 client.26294 shutdown 2023-07-21T22:24:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 -- 172.21.15.151:0/3588225657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c999210 msgr2=0x55fe3c9a1fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c999210 0x55fe3c9a1fb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5a58007c60 tx=0x7f5a58025800 comp rx=0 tx=0).stop 2023-07-21T22:24:44.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 -- 172.21.15.151:0/3588225657 shutdown_connections 2023-07-21T22:24:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fe3ca00fa0 0x55fe3ca033b0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fe3c999660 0x55fe3c9a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a51ffb700 0 client.26294 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fe3c7ef6b0 0x55fe3c9a1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 --2- 172.21.15.151:0/3588225657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fe3c999210 0x55fe3c9a1fb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 -- 172.21.15.151:0/3588225657 >> 172.21.15.151:0/3588225657 conn(0x55fe3c988ae0 msgr2=0x55fe3c99a130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 -- 172.21.15.151:0/3588225657 shutdown_connections 2023-07-21T22:24:44.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 1 -- 172.21.15.151:0/3588225657 wait complete. 2023-07-21T22:24:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.914+0000 7f5a84032b80 20 client.26294 trim_cache size 0 max 16384 2023-07-21T22:24:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:24:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:24:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:24:44.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:24:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 -- 172.21.15.151:0/1120706586 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a540a1340 msgr2=0x7f5a540a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a540a1340 0x7f5a540a37f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5a64095fe0 tx=0x7f5a64010000 comp rx=0 tx=0).stop 2023-07-21T22:24:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 -- 172.21.15.151:0/1120706586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a680ffb30 msgr2=0x7f5a68197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:44.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a680ffb30 0x7f5a68197de0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a6400d950 tx=0x7f5a6400dc60 comp rx=0 tx=0).stop 2023-07-21T22:24:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 -- 172.21.15.151:0/1120706586 shutdown_connections 2023-07-21T22:24:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a540a1340 0x7f5a540a37f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a68105b60 0x7f5a6819c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a680ffb30 0x7f5a68197de0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 --2- 172.21.15.151:0/1120706586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a681004e0 0x7f5a68198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 -- 172.21.15.151:0/1120706586 >> 172.21.15.151:0/1120706586 conn(0x7f5a680fb5f0 msgr2=0x7f5a6810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 -- 172.21.15.151:0/1120706586 shutdown_connections 2023-07-21T22:24:44.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:44.915+0000 7f5a707ff700 1 -- 172.21.15.151:0/1120706586 wait complete. 2023-07-21T22:24:45.599 INFO:teuthology.orchestra.run.smithi151.stderr:22400000 of 50000000 tuples (44%) done (elapsed 309.09 s, remaining 380.84 s) 2023-07-21T22:24:46.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:46 smithi187 ceph-mon[96918]: pgmap v170: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 23 MiB/s wr, 34 op/s 2023-07-21T22:24:46.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:46 smithi195 ceph-mon[97365]: pgmap v170: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 23 MiB/s wr, 34 op/s 2023-07-21T22:24:46.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:46 smithi151 ceph-mon[95510]: pgmap v170: 97 pgs: 97 active+clean; 5.1 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 23 MiB/s wr, 34 op/s 2023-07-21T22:24:46.846 INFO:teuthology.orchestra.run.smithi151.stderr:22500000 of 50000000 tuples (45%) done (elapsed 310.34 s, remaining 379.30 s) 2023-07-21T22:24:46.890 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:24:47.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.080+0000 7fd58eb9d700 1 -- 172.21.15.151:0/4089363325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd588105a00 msgr2=0x7fd588105dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.080+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/4089363325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd588105a00 0x7fd588105dd0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fd584009990 tx=0x7fd584009ca0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.081+0000 7fd58eb9d700 1 -- 172.21.15.151:0/4089363325 shutdown_connections 2023-07-21T22:24:47.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.081+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/4089363325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5881003a0 0x7fd58810c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.081+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/4089363325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd588105a00 0x7fd588105dd0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.081+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/4089363325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5880ff9f0 0x7fd5880ffe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.127 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.081+0000 7fd58eb9d700 1 -- 172.21.15.151:0/4089363325 >> 172.21.15.151:0/4089363325 conn(0x7fd5880fb4f0 msgr2=0x7fd5880fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:47.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.081+0000 7fd58eb9d700 1 -- 172.21.15.151:0/4089363325 shutdown_connections 2023-07-21T22:24:47.128 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.081+0000 7fd58eb9d700 1 -- 172.21.15.151:0/4089363325 wait complete. 2023-07-21T22:24:47.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.082+0000 7fd58eb9d700 1 Processor -- start 2023-07-21T22:24:47.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.082+0000 7fd58eb9d700 1 -- start start 2023-07-21T22:24:47.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.082+0000 7fd58eb9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5880ff9f0 0x7fd58819d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.082+0000 7fd58eb9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5881003a0 0x7fd58819dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.082+0000 7fd58eb9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd588105a00 0x7fd588197890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.082+0000 7fd58eb9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd588197f00 con 0x7fd5881003a0 2023-07-21T22:24:47.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.082+0000 7fd58eb9d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd588198070 con 0x7fd5880ff9f0 2023-07-21T22:24:47.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.082+0000 7fd58eb9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd588198230 con 0x7fd588105a00 2023-07-21T22:24:47.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58d39a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5881003a0 0x7fd58819dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58d39a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5881003a0 0x7fd58819dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54042/0 (socket says 172.21.15.151:54042) 2023-07-21T22:24:47.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58d39a700 1 -- 172.21.15.151:0/1485872954 learned_addr learned my addr 172.21.15.151:0/1485872954 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:47.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58e39c700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd588105a00 0x7fd588197890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58db9b700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5880ff9f0 0x7fd58819d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58d39a700 1 -- 172.21.15.151:0/1485872954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd588105a00 msgr2=0x7fd588197890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58d39a700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd588105a00 0x7fd588197890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58d39a700 1 -- 172.21.15.151:0/1485872954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5880ff9f0 msgr2=0x7fd58819d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58d39a700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5880ff9f0 0x7fd58819d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58d39a700 1 -- 172.21.15.151:0/1485872954 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5840095f0 con 0x7fd5881003a0 2023-07-21T22:24:47.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58db9b700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5880ff9f0 0x7fd58819d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:47.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.083+0000 7fd58d39a700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5881003a0 0x7fd58819dd60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd57800e9a0 tx=0x7fd57800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:47.132 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.084+0000 7fd57effd700 1 -- 172.21.15.151:0/1485872954 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578009790 con 0x7fd5881003a0 2023-07-21T22:24:47.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.084+0000 7fd57effd700 1 -- 172.21.15.151:0/1485872954 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd57800cbd0 con 0x7fd5881003a0 2023-07-21T22:24:47.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.084+0000 7fd58eb9d700 1 -- 172.21.15.151:0/1485872954 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd588198510 con 0x7fd5881003a0 2023-07-21T22:24:47.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.084+0000 7fd57effd700 1 -- 172.21.15.151:0/1485872954 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578018680 con 0x7fd5881003a0 2023-07-21T22:24:47.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.084+0000 7fd58eb9d700 1 -- 172.21.15.151:0/1485872954 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5881a4810 con 0x7fd5881003a0 2023-07-21T22:24:47.133 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.088+0000 7fd57effd700 1 -- 172.21.15.151:0/1485872954 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fd57800cd40 con 0x7fd5881003a0 2023-07-21T22:24:47.134 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.089+0000 7fd5a368fb80 1 Processor -- start 2023-07-21T22:24:47.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.089+0000 7fd5a368fb80 1 -- start start 2023-07-21T22:24:47.135 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd57effd700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5740a13e0 0x7fd5740a3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a558860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a563700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a563c40 0x56448a566020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a45ecb0 con 0x56448a558da0 2023-07-21T22:24:47.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a4b1a40 con 0x56448a558490 2023-07-21T22:24:47.136 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a4aaed0 con 0x56448a563c40 2023-07-21T22:24:47.137 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd57effd700 1 -- 172.21.15.151:0/1485872954 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd578014070 con 0x7fd5881003a0 2023-07-21T22:24:47.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd58d39a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a563700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd58e39c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a563c40 0x56448a566020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.138 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd58e39c700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5740a13e0 0x7fd5740a3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd58d39a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a563700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54048/0 (socket says 172.21.15.151:54048) 2023-07-21T22:24:47.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd58d39a700 1 -- 172.21.15.151:0/2469815404 learned_addr learned my addr 172.21.15.151:0/2469815404 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:47.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.090+0000 7fd58db9b700 1 --2- 172.21.15.151:0/2469815404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a558860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.091+0000 7fd58db9b700 1 -- 172.21.15.151:0/2469815404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a563c40 msgr2=0x56448a566020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:47.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.091+0000 7fd58db9b700 1 --2- 172.21.15.151:0/2469815404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a563c40 0x56448a566020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.139 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.091+0000 7fd58db9b700 1 -- 172.21.15.151:0/2469815404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 msgr2=0x56448a563700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:47.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.091+0000 7fd58db9b700 1 --2- 172.21.15.151:0/2469815404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a563700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.091+0000 7fd58db9b700 1 -- 172.21.15.151:0/2469815404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56448a2d8de0 con 0x56448a558490 2023-07-21T22:24:47.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.091+0000 7fd58d39a700 1 --2- 172.21.15.151:0/2469815404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a563700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:47.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.091+0000 7fd58e39c700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5740a13e0 0x7fd5740a3890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd580007740 tx=0x7fd580007c00 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:47.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.091+0000 7fd58db9b700 1 --2- 172.21.15.151:0/2469815404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a558860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5840098e0 tx=0x7fd584005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f29a4e7f16d16bd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:47.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.092+0000 7fd573fff700 1 -- 172.21.15.151:0/2469815404 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd584005710 con 0x56448a558490 2023-07-21T22:24:47.140 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.092+0000 7fd573fff700 1 -- 172.21.15.151:0/2469815404 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd58401e040 con 0x56448a558490 2023-07-21T22:24:47.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.092+0000 7fd573fff700 1 -- 172.21.15.151:0/2469815404 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5840049d0 con 0x56448a558490 2023-07-21T22:24:47.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.092+0000 7fd5a368fb80 1 -- 172.21.15.151:0/2469815404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 msgr2=0x56448a558860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.093+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/2469815404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a558860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd5840098e0 tx=0x7fd584005040 comp rx=0 tx=0).stop 2023-07-21T22:24:47.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.093+0000 7fd5a368fb80 1 -- 172.21.15.151:0/2469815404 shutdown_connections 2023-07-21T22:24:47.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.093+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/2469815404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a558860 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.093+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/2469815404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a563c40 0x56448a566020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.141 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.093+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/2469815404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a563700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.093+0000 7fd5a368fb80 1 -- 172.21.15.151:0/2469815404 >> 172.21.15.151:0/2469815404 conn(0x56448a54eef0 msgr2=0x56448a554860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:47.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.093+0000 7fd5a368fb80 1 -- 172.21.15.151:0/2469815404 shutdown_connections 2023-07-21T22:24:47.142 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.093+0000 7fd5a368fb80 1 -- 172.21.15.151:0/2469815404 wait complete. 2023-07-21T22:24:47.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.093+0000 7fd5a368fb80 1 -- start start 2023-07-21T22:24:47.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.094+0000 7fd5a368fb80 1 Processor -- start 2023-07-21T22:24:47.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.094+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558490 0x56448a563610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.094+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a560890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.145 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.094+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a560f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.094+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a44aac0 con 0x56448a558490 2023-07-21T22:24:47.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.094+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a44a7c0 con 0x56448a563c40 2023-07-21T22:24:47.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.094+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a32e920 con 0x56448a558da0 2023-07-21T22:24:47.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd5a368fb80 10 client.0 _ll_register_callbacks cb 0x56448a448760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:47.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58db9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558490 0x56448a563610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58d39a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a560890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.146 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58db9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558490 0x56448a563610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54056/0 (socket says 172.21.15.151:54056) 2023-07-21T22:24:47.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58db9b700 1 -- 172.21.15.151:0/3525236499 learned_addr learned my addr 172.21.15.151:0/3525236499 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:47.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58e39c700 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a560f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58d39a700 1 -- 172.21.15.151:0/3525236499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 msgr2=0x56448a560f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:47.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58d39a700 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a560f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58d39a700 1 -- 172.21.15.151:0/3525236499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558490 msgr2=0x56448a563610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:47.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58d39a700 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558490 0x56448a563610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58d39a700 1 -- 172.21.15.151:0/3525236499 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5881a4810 con 0x56448a558da0 2023-07-21T22:24:47.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58e39c700 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a560f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:47.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd58d39a700 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a560890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd578096a80 tx=0x7fd578099a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67c8ac06300a7e6f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:47.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.095+0000 7fd5717fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:24:47.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5717fa700 1 -- 172.21.15.151:0/3525236499 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780a2460 con 0x56448a558da0 2023-07-21T22:24:47.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5717fa700 1 -- 172.21.15.151:0/3525236499 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd578099500 con 0x56448a558da0 2023-07-21T22:24:47.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3525236499 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56448a4044f0 con 0x56448a558da0 2023-07-21T22:24:47.148 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5717fa700 1 -- 172.21.15.151:0/3525236499 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5780996c0 con 0x56448a558da0 2023-07-21T22:24:47.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5a368fb80 10 client.26338 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:47.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3525236499 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7fd58810d130 con 0x56448a558da0 2023-07-21T22:24:47.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5717fa700 1 -- 172.21.15.151:0/3525236499 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56448a4044f0 con 0x56448a558da0 2023-07-21T22:24:47.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5717fa700 1 -- 172.21.15.151:0/3525236499 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd578095e00 con 0x56448a558da0 2023-07-21T22:24:47.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5a368fb80 10 client.26338 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:47.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5a368fb80 10 client.26338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:47.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5a368fb80 20 client.26338 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:47.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56448a573500 0x56448a575910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5a368fb80 4 client.26338 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:47.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.096+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3525236499 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56448a4a3eb0 con 0x56448a573500 2023-07-21T22:24:47.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.097+0000 7fd58db9b700 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56448a573500 0x56448a575910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.097+0000 7fd58db9b700 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56448a573500 0x56448a575910 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32c0e2a9dfbf3a80 server_cookie=d86bc966b73b5b42 in_seq=0 out_seq=0 2023-07-21T22:24:47.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.097+0000 7fd5717fa700 10 client.26338 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:47.150 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.098+0000 7fd5717fa700 1 -- 172.21.15.151:0/3525236499 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56448a4a3eb0 con 0x56448a573500 2023-07-21T22:24:47.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.098+0000 7fd5717fa700 10 client.26338 handle_command_reply: tid=0 2023-07-21T22:24:47.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.098+0000 7fd5a368fb80 1 client.26338 shutdown 2023-07-21T22:24:47.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.098+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3525236499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 msgr2=0x56448a560890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.098+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a560890 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd578096a80 tx=0x7fd578099a60 comp rx=0 tx=0).stop 2023-07-21T22:24:47.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.098+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3525236499 shutdown_connections 2023-07-21T22:24:47.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.099+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56448a573500 0x56448a575910 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.151 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.099+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a560f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.099+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558490 0x56448a563610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.099+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3525236499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a560890 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.099+0000 7fd5717fa700 0 client.26338 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:47.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.099+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3525236499 >> 172.21.15.151:0/3525236499 conn(0x56448a54eef0 msgr2=0x56448a5543f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:47.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.099+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3525236499 shutdown_connections 2023-07-21T22:24:47.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.099+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3525236499 wait complete. 2023-07-21T22:24:47.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.099+0000 7fd5a368fb80 20 client.26338 trim_cache size 0 max 16384 2023-07-21T22:24:47.162 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd5a368fb80 1 Processor -- start 2023-07-21T22:24:47.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd5a368fb80 1 -- start start 2023-07-21T22:24:47.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558490 0x56448a56a670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a5631b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a55bba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a5617f0 con 0x56448a558da0 2023-07-21T22:24:47.163 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a56abb0 con 0x56448a563c40 2023-07-21T22:24:47.164 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a55b350 con 0x56448a558490 2023-07-21T22:24:47.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd58d39a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a5631b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd58d39a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a5631b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54058/0 (socket says 172.21.15.151:54058) 2023-07-21T22:24:47.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.117+0000 7fd58d39a700 1 -- 172.21.15.151:0/1279349108 learned_addr learned my addr 172.21.15.151:0/1279349108 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:47.165 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd58db9b700 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558490 0x56448a56a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd58e39c700 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a55bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd58d39a700 1 -- 172.21.15.151:0/1279349108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558490 msgr2=0x56448a56a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:47.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd58d39a700 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558490 0x56448a56a670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd58d39a700 1 -- 172.21.15.151:0/1279349108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 msgr2=0x56448a55bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:47.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd58d39a700 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a55bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd58d39a700 1 -- 172.21.15.151:0/1279349108 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56448a2c1c60 con 0x56448a558da0 2023-07-21T22:24:47.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd58e39c700 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a55bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:47.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd58d39a700 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a5631b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd578099fa0 tx=0x7fd57800e930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4432180fd8cc2f87 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:47.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.118+0000 7fd57cbff700 1 -- 172.21.15.151:0/1279349108 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578096190 con 0x56448a558da0 2023-07-21T22:24:47.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd57cbff700 1 -- 172.21.15.151:0/1279349108 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5780a2460 con 0x56448a558da0 2023-07-21T22:24:47.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd57cbff700 1 -- 172.21.15.151:0/1279349108 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780a1fd0 con 0x56448a558da0 2023-07-21T22:24:47.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd5a368fb80 1 -- 172.21.15.151:0/1279349108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 msgr2=0x56448a5631b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a5631b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fd578099fa0 tx=0x7fd57800e930 comp rx=0 tx=0).stop 2023-07-21T22:24:47.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd5a368fb80 1 -- 172.21.15.151:0/1279349108 shutdown_connections 2023-07-21T22:24:47.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a563c40 0x56448a55bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558490 0x56448a56a670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/1279349108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a558da0 0x56448a5631b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd5a368fb80 1 -- 172.21.15.151:0/1279349108 >> 172.21.15.151:0/1279349108 conn(0x56448a54eef0 msgr2=0x56448a56f8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:47.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd5a368fb80 1 -- 172.21.15.151:0/1279349108 shutdown_connections 2023-07-21T22:24:47.168 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.119+0000 7fd5a368fb80 1 -- 172.21.15.151:0/1279349108 wait complete. 2023-07-21T22:24:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.120+0000 7fd5a368fb80 1 -- start start 2023-07-21T22:24:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.120+0000 7fd5a368fb80 1 Processor -- start 2023-07-21T22:24:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a56a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a5667f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.171 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd5a368fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a563c40 0x56448a566d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a567410 con 0x56448a563c40 2023-07-21T22:24:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a567580 con 0x56448a558490 2023-07-21T22:24:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd5a368fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56448a5cfbf0 con 0x56448a558da0 2023-07-21T22:24:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd5a368fb80 10 client.0 _ll_register_callbacks cb 0x7fd578099eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58d39a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a5667f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58e39c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a563c40 0x56448a566d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58d39a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a5667f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58650/0 (socket says 172.21.15.151:58650) 2023-07-21T22:24:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58d39a700 1 -- 172.21.15.151:0/3615186492 learned_addr learned my addr 172.21.15.151:0/3615186492 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58db9b700 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a56a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58d39a700 1 -- 172.21.15.151:0/3615186492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 msgr2=0x56448a56a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58d39a700 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a56a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58d39a700 1 -- 172.21.15.151:0/3615186492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a563c40 msgr2=0x56448a566d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58d39a700 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a563c40 0x56448a566d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58d39a700 1 -- 172.21.15.151:0/3615186492 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd58810d130 con 0x56448a558da0 2023-07-21T22:24:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.121+0000 7fd58db9b700 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a56a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd58d39a700 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a5667f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c5b0 tx=0x7fd578010a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78f950d58c70628c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5717fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:24:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5717fa700 1 -- 172.21.15.151:0/3615186492 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5780a21d0 con 0x56448a558da0 2023-07-21T22:24:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5717fa700 1 -- 172.21.15.151:0/3615186492 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fd578099710 con 0x56448a558da0 2023-07-21T22:24:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3615186492 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd58401e040 con 0x56448a558da0 2023-07-21T22:24:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5717fa700 1 -- 172.21.15.151:0/3615186492 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5780b8290 con 0x56448a558da0 2023-07-21T22:24:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5a368fb80 10 client.26344 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3615186492 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56448a2ff250 con 0x56448a558da0 2023-07-21T22:24:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5717fa700 1 -- 172.21.15.151:0/3615186492 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd58401e040 con 0x56448a558da0 2023-07-21T22:24:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5717fa700 1 -- 172.21.15.151:0/3615186492 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fd5780b29f0 con 0x56448a558da0 2023-07-21T22:24:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5a368fb80 10 client.26344 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5a368fb80 10 client.26344 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.122+0000 7fd5a368fb80 20 client.26344 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.123+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56448a5d0da0 0x56448a5d3180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.123+0000 7fd5a368fb80 4 client.26344 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:24:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.123+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3615186492 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x56448a466050 con 0x56448a5d0da0 2023-07-21T22:24:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.123+0000 7fd58db9b700 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56448a5d0da0 0x56448a5d3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.123+0000 7fd5717fa700 10 client.26344 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.123+0000 7fd58db9b700 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56448a5d0da0 0x56448a5d3180 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f244e9ee4ba47516 server_cookie=be6db1f22dc7581f in_seq=0 out_seq=0 2023-07-21T22:24:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5717fa700 1 -- 172.21.15.151:0/3615186492 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x56448a466050 con 0x56448a5d0da0 2023-07-21T22:24:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5717fa700 10 client.26344 handle_command_reply: tid=0 2023-07-21T22:24:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 client.26344 shutdown 2023-07-21T22:24:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3615186492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 msgr2=0x56448a5667f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a5667f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd57800c5b0 tx=0x7fd578010a70 comp rx=0 tx=0).stop 2023-07-21T22:24:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3615186492 shutdown_connections 2023-07-21T22:24:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56448a5d0da0 0x56448a5d3180 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56448a558490 0x56448a56a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56448a563c40 0x56448a566d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5717fa700 0 client.26344 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 --2- 172.21.15.151:0/3615186492 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56448a558da0 0x56448a5667f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3615186492 >> 172.21.15.151:0/3615186492 conn(0x56448a54eef0 msgr2=0x56448a55bba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3615186492 shutdown_connections 2023-07-21T22:24:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 1 -- 172.21.15.151:0/3615186492 wait complete. 2023-07-21T22:24:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.124+0000 7fd5a368fb80 20 client.26344 trim_cache size 0 max 16384 2023-07-21T22:24:47.179 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:24:47.179 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "no active scrubs running", 2023-07-21T22:24:47.179 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": {} 2023-07-21T22:24:47.179 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:24:47.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 -- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5740a13e0 msgr2=0x7fd5740a3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5740a13e0 0x7fd5740a3890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd580007740 tx=0x7fd580007c00 comp rx=0 tx=0).stop 2023-07-21T22:24:47.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 -- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5881003a0 msgr2=0x7fd58819dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5881003a0 0x7fd58819dd60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fd57800e9a0 tx=0x7fd57800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.180 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 -- 172.21.15.151:0/1485872954 shutdown_connections 2023-07-21T22:24:47.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5740a13e0 0x7fd5740a3890 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5880ff9f0 0x7fd58819d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd588105a00 0x7fd588197890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 --2- 172.21.15.151:0/1485872954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5881003a0 0x7fd58819dd60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 -- 172.21.15.151:0/1485872954 >> 172.21.15.151:0/1485872954 conn(0x7fd5880fb4f0 msgr2=0x7fd588072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:47.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 -- 172.21.15.151:0/1485872954 shutdown_connections 2023-07-21T22:24:47.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.125+0000 7fd58eb9d700 1 -- 172.21.15.151:0/1485872954 wait complete. 2023-07-21T22:24:47.191 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-21T22:24:47.192 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:24:47.427 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.381+0000 7f243e5ff700 1 -- 172.21.15.151:0/416486040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f243810a040 msgr2=0x7f243810c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.381+0000 7f243e5ff700 1 --2- 172.21.15.151:0/416486040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f243810a040 0x7f243810c4b0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2430009f90 tx=0x7f243000b330 comp rx=0 tx=0).stop 2023-07-21T22:24:47.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.381+0000 7f243e5ff700 1 -- 172.21.15.151:0/416486040 shutdown_connections 2023-07-21T22:24:47.428 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.381+0000 7f243e5ff700 1 --2- 172.21.15.151:0/416486040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f243810a040 0x7f243810c4b0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.381+0000 7f243e5ff700 1 --2- 172.21.15.151:0/416486040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2438100d00 0x7f24381010d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.381+0000 7f243e5ff700 1 --2- 172.21.15.151:0/416486040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2438101610 0x7f2438109b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.381+0000 7f243e5ff700 1 -- 172.21.15.151:0/416486040 >> 172.21.15.151:0/416486040 conn(0x7f24380fa490 msgr2=0x7f24380fc8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:47.429 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.381+0000 7f243e5ff700 1 -- 172.21.15.151:0/416486040 shutdown_connections 2023-07-21T22:24:47.430 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.381+0000 7f243e5ff700 1 -- 172.21.15.151:0/416486040 wait complete. 2023-07-21T22:24:47.432 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.382+0000 7f243e5ff700 1 Processor -- start 2023-07-21T22:24:47.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.382+0000 7f243e5ff700 1 -- start start 2023-07-21T22:24:47.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243e5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2438100d00 0x7f2438197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243e5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2438101610 0x7f2438198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243e5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f243810a040 0x7f243819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243e5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243819cdf0 con 0x7f243810a040 2023-07-21T22:24:47.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243e5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243819cf60 con 0x7f2438101610 2023-07-21T22:24:47.433 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243e5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243819d120 con 0x7f2438100d00 2023-07-21T22:24:47.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f2437fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2438100d00 0x7f2438197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243cb9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f243810a040 0x7f243819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f2437fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2438100d00 0x7f2438197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58670/0 (socket says 172.21.15.151:58670) 2023-07-21T22:24:47.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f2437fff700 1 -- 172.21.15.151:0/1906708377 learned_addr learned my addr 172.21.15.151:0/1906708377 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:47.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f24377fe700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2438101610 0x7f2438198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243cb9c700 1 -- 172.21.15.151:0/1906708377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2438100d00 msgr2=0x7f2438197e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.434 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243cb9c700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2438100d00 0x7f2438197e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243cb9c700 1 -- 172.21.15.151:0/1906708377 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2438101610 msgr2=0x7f2438198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243cb9c700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2438101610 0x7f2438198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.383+0000 7f243cb9c700 1 -- 172.21.15.151:0/1906708377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2430009c40 con 0x7f243810a040 2023-07-21T22:24:47.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.384+0000 7f243cb9c700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f243810a040 0x7f243819c7b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f243000b6c0 tx=0x7f2430008ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:47.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.384+0000 7f24357fa700 1 -- 172.21.15.151:0/1906708377 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f243000e040 con 0x7f243810a040 2023-07-21T22:24:47.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.384+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243819d3a0 con 0x7f243810a040 2023-07-21T22:24:47.435 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.384+0000 7f24357fa700 1 -- 172.21.15.151:0/1906708377 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2430004e90 con 0x7f243810a040 2023-07-21T22:24:47.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.384+0000 7f24357fa700 1 -- 172.21.15.151:0/1906708377 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2430005040 con 0x7f243810a040 2023-07-21T22:24:47.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.384+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24381a4c40 con 0x7f243810a040 2023-07-21T22:24:47.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.385+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2438067300 con 0x7f243810a040 2023-07-21T22:24:47.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.389+0000 7f24357fa700 1 -- 172.21.15.151:0/1906708377 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f243001d470 con 0x7f243810a040 2023-07-21T22:24:47.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.390+0000 7f24357fa700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f24200a1300 0x7f24200a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.390+0000 7f24357fa700 1 -- 172.21.15.151:0/1906708377 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f24300ce7e0 con 0x7f243810a040 2023-07-21T22:24:47.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.391+0000 7f2437fff700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f24200a1300 0x7f24200a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:47.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.391+0000 7f2437fff700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f24200a1300 0x7f24200a37b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2428005950 tx=0x7f242800b500 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:47.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.393+0000 7f24357fa700 1 -- 172.21.15.151:0/1906708377 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f2430097df0 con 0x7f243810a040 2023-07-21T22:24:47.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.704+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2438199160 con 0x7f243810a040 2023-07-21T22:24:47.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.705+0000 7f24357fa700 1 -- 172.21.15.151:0/1906708377 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+10825 (secure 0 0 0) 0x7f243001d720 con 0x7f243810a040 2023-07-21T22:24:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:24:47.751 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:24:04.427029+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":7,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:24:47.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f24200a1300 msgr2=0x7f24200a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f24200a1300 0x7f24200a37b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2428005950 tx=0x7f242800b500 comp rx=0 tx=0).stop 2023-07-21T22:24:47.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f243810a040 msgr2=0x7f243819c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f243810a040 0x7f243819c7b0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f243000b6c0 tx=0x7f2430008ca0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 shutdown_connections 2023-07-21T22:24:47.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f24200a1300 0x7f24200a37b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f243810a040 0x7f243819c7b0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2438100d00 0x7f2438197e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 --2- 172.21.15.151:0/1906708377 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2438101610 0x7f2438198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 >> 172.21.15.151:0/1906708377 conn(0x7f24380fa490 msgr2=0x7f24380fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:47.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 shutdown_connections 2023-07-21T22:24:47.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.708+0000 7f243e5ff700 1 -- 172.21.15.151:0/1906708377 wait complete. 2023-07-21T22:24:47.756 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 33 2023-07-21T22:24:47.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-21T22:24:47.995 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.949+0000 7f740dfff700 1 -- 172.21.15.151:0/1832557077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7408105ae0 msgr2=0x7f7408105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:47.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.949+0000 7f740dfff700 1 --2- 172.21.15.151:0/1832557077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7408105ae0 0x7f7408105eb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f73f80098f0 tx=0x7f73f8009c00 comp rx=0 tx=0).stop 2023-07-21T22:24:47.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.949+0000 7f740dfff700 1 -- 172.21.15.151:0/1832557077 shutdown_connections 2023-07-21T22:24:47.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.949+0000 7f740dfff700 1 --2- 172.21.15.151:0/1832557077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7408105ae0 0x7f7408105eb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.949+0000 7f740dfff700 1 --2- 172.21.15.151:0/1832557077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7408100480 0x7f740810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.996 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.949+0000 7f740dfff700 1 --2- 172.21.15.151:0/1832557077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74080ffad0 0x7f74080fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:47.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.949+0000 7f740dfff700 1 -- 172.21.15.151:0/1832557077 >> 172.21.15.151:0/1832557077 conn(0x7f74080fb5f0 msgr2=0x7f74080fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:47.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.949+0000 7f740dfff700 1 -- 172.21.15.151:0/1832557077 shutdown_connections 2023-07-21T22:24:47.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.949+0000 7f740dfff700 1 -- 172.21.15.151:0/1832557077 wait complete. 2023-07-21T22:24:47.997 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.950+0000 7f740dfff700 1 Processor -- start 2023-07-21T22:24:47.998 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.950+0000 7f740dfff700 1 -- start start 2023-07-21T22:24:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f740dfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74080ffad0 0x7f7408197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f740dfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7408100480 0x7f74081982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f740dfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7408105ae0 0x7f740819c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f740dfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740819cd40 con 0x7f74080ffad0 2023-07-21T22:24:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f740dfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740819ceb0 con 0x7f7408100480 2023-07-21T22:24:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f740dfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740819d070 con 0x7f7408105ae0 2023-07-21T22:24:47.999 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f74077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74080ffad0 0x7f7408197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f74077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74080ffad0 0x7f7408197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54094/0 (socket says 172.21.15.151:54094) 2023-07-21T22:24:48.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f74077fe700 1 -- 172.21.15.151:0/62059719 learned_addr learned my addr 172.21.15.151:0/62059719 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.951+0000 7f7407fff700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7408105ae0 0x7f740819c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f7406ffd700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7408100480 0x7f74081982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.000 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f74077fe700 1 -- 172.21.15.151:0/62059719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7408105ae0 msgr2=0x7f740819c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f74077fe700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7408105ae0 0x7f740819c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f74077fe700 1 -- 172.21.15.151:0/62059719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7408100480 msgr2=0x7f74081982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f74077fe700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7408100480 0x7f74081982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f74077fe700 1 -- 172.21.15.151:0/62059719 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f8009520 con 0x7f74080ffad0 2023-07-21T22:24:48.001 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f74077fe700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74080ffad0 0x7f7408197d60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009810 tx=0x7f73f800fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f7404ff9700 1 -- 172.21.15.151:0/62059719 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f801c070 con 0x7f74080ffad0 2023-07-21T22:24:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f740dfff700 1 -- 172.21.15.151:0/62059719 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740819d2f0 con 0x7f74080ffad0 2023-07-21T22:24:48.002 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f7404ff9700 1 -- 172.21.15.151:0/62059719 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73f8005040 con 0x7f74080ffad0 2023-07-21T22:24:48.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f7404ff9700 1 -- 172.21.15.151:0/62059719 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8004a50 con 0x7f74080ffad0 2023-07-21T22:24:48.003 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.952+0000 7f740dfff700 1 -- 172.21.15.151:0/62059719 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74081a4b90 con 0x7f74080ffad0 2023-07-21T22:24:48.007 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.956+0000 7f7404ff9700 1 -- 172.21.15.151:0/62059719 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f73f8020070 con 0x7f74080ffad0 2023-07-21T22:24:48.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.958+0000 7f74218afb80 1 Processor -- start 2023-07-21T22:24:48.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.958+0000 7f7404ff9700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f73f00a12c0 0x7f73f00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.008 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.958+0000 7f74218afb80 1 -- start start 2023-07-21T22:24:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.958+0000 7f7404ff9700 1 -- 172.21.15.151:0/62059719 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f73f80cdb40 con 0x7f74080ffad0 2023-07-21T22:24:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.958+0000 7f7407fff700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f73f00a12c0 0x7f73f00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f74218afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee83f580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f74218afb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee83a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.009 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f74218afb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee83ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f74218afb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee73fcb0 con 0x55b7ee83fac0 2023-07-21T22:24:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f74218afb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee792a40 con 0x55b7ee83a930 2023-07-21T22:24:48.010 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f74218afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee78bed0 con 0x55b7ee83f1b0 2023-07-21T22:24:48.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee83a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee83a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54110/0 (socket says 172.21.15.151:54110) 2023-07-21T22:24:48.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7406ffd700 1 -- 172.21.15.151:0/1384594091 learned_addr learned my addr 172.21.15.151:0/1384594091 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7407fff700 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee83ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f74077fe700 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee83f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7407fff700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f73f00a12c0 0x7f73f00a3770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7400009c60 tx=0x7f74000077e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7407fff700 1 -- 172.21.15.151:0/1384594091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 msgr2=0x55b7ee83f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7407fff700 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee83f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.012 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7407fff700 1 -- 172.21.15.151:0/1384594091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 msgr2=0x55b7ee83a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7407fff700 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee83a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7407fff700 1 -- 172.21.15.151:0/1384594091 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7ee5b9de0 con 0x55b7ee83a930 2023-07-21T22:24:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.959+0000 7f7406ffd700 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee83a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.960+0000 7f7407fff700 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee83ada0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7400009f60 tx=0x7f740001a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da42da74cd207531 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.960+0000 7f73edffb700 1 -- 172.21.15.151:0/1384594091 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7400019d80 con 0x55b7ee83a930 2023-07-21T22:24:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.960+0000 7f73edffb700 1 -- 172.21.15.151:0/1384594091 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74000218c0 con 0x55b7ee83a930 2023-07-21T22:24:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.960+0000 7f73edffb700 1 -- 172.21.15.151:0/1384594091 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74000187a0 con 0x55b7ee83a930 2023-07-21T22:24:48.013 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.961+0000 7f74218afb80 1 -- 172.21.15.151:0/1384594091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 msgr2=0x55b7ee83ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.961+0000 7f74218afb80 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee83ada0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7400009f60 tx=0x7f740001a000 comp rx=0 tx=0).stop 2023-07-21T22:24:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.961+0000 7f74218afb80 1 -- 172.21.15.151:0/1384594091 shutdown_connections 2023-07-21T22:24:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.961+0000 7f74218afb80 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee83ada0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.961+0000 7f74218afb80 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee83f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.961+0000 7f74218afb80 1 --2- 172.21.15.151:0/1384594091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee83a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.961+0000 7f74218afb80 1 -- 172.21.15.151:0/1384594091 >> 172.21.15.151:0/1384594091 conn(0x55b7ee82fef0 msgr2=0x55b7ee835830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.014 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.961+0000 7f74218afb80 1 -- 172.21.15.151:0/1384594091 shutdown_connections 2023-07-21T22:24:48.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.961+0000 7f74218afb80 1 -- 172.21.15.151:0/1384594091 wait complete. 2023-07-21T22:24:48.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.962+0000 7f74218afb80 1 -- start start 2023-07-21T22:24:48.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.962+0000 7f74218afb80 1 Processor -- start 2023-07-21T22:24:48.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.962+0000 7f74218afb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee846bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.962+0000 7f74218afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee843e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.962+0000 7f74218afb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee844590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74218afb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee72bac0 con 0x55b7ee83fac0 2023-07-21T22:24:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74218afb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee72b7c0 con 0x55b7ee83a930 2023-07-21T22:24:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74218afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee60f920 con 0x55b7ee83f1b0 2023-07-21T22:24:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74218afb80 10 client.0 _ll_register_callbacks cb 0x55b7ee729760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74077fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee846bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f7407fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee844590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74077fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee846bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44152/0 (socket says 172.21.15.151:44152) 2023-07-21T22:24:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74077fe700 1 -- 172.21.15.151:0/4139780706 learned_addr learned my addr 172.21.15.151:0/4139780706 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f7406ffd700 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee843e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74077fe700 1 -- 172.21.15.151:0/4139780706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 msgr2=0x55b7ee843e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74077fe700 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee843e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74077fe700 1 -- 172.21.15.151:0/4139780706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 msgr2=0x55b7ee844590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74077fe700 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee844590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f74077fe700 1 -- 172.21.15.151:0/4139780706 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73fc009800 con 0x55b7ee83a930 2023-07-21T22:24:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.963+0000 7f7406ffd700 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee843e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:24:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f74077fe700 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee846bd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009fd0 tx=0x7f73f809ad80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba4b26204e683fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f73e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:24:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4139780706 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f80b3220 con 0x55b7ee83a930 2023-07-21T22:24:48.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4139780706 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f73f80b3380 con 0x55b7ee83a930 2023-07-21T22:24:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f74218afb80 1 -- 172.21.15.151:0/4139780706 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7ee6e54f0 con 0x55b7ee83a930 2023-07-21T22:24:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4139780706 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73f809af10 con 0x55b7ee83a930 2023-07-21T22:24:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f74218afb80 10 client.26327 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f74218afb80 1 -- 172.21.15.151:0/4139780706 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x7f7400009d40 con 0x55b7ee83a930 2023-07-21T22:24:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4139780706 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73f80c9020 con 0x55b7ee83a930 2023-07-21T22:24:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.964+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4139780706 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f73f80a2be0 con 0x55b7ee83a930 2023-07-21T22:24:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.965+0000 7f74218afb80 10 client.26327 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:48.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.965+0000 7f74218afb80 10 client.26327 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:24:48.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.965+0000 7f74218afb80 20 client.26327 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:48.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.965+0000 7f74218afb80 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55b7ee8541b0 0x55b7ee8565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.965+0000 7f74218afb80 4 client.26327 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:48.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.965+0000 7f74218afb80 1 -- 172.21.15.151:0/4139780706 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7ee784eb0 con 0x55b7ee8541b0 2023-07-21T22:24:48.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.965+0000 7f7406ffd700 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55b7ee8541b0 0x55b7ee8565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.966+0000 7f7406ffd700 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55b7ee8541b0 0x55b7ee8565c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e657754d56520daa server_cookie=a671f5686d8821a1 in_seq=0 out_seq=0 2023-07-21T22:24:48.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.966+0000 7f73e6ffd700 10 client.26327 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:24:48.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.966+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4139780706 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b7ee784eb0 con 0x55b7ee8541b0 2023-07-21T22:24:48.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.966+0000 7f73e6ffd700 10 client.26327 handle_command_reply: tid=0 2023-07-21T22:24:48.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.966+0000 7f74218afb80 1 client.26327 shutdown 2023-07-21T22:24:48.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.966+0000 7f74218afb80 1 -- 172.21.15.151:0/4139780706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 msgr2=0x55b7ee846bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee846bd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009fd0 tx=0x7f73f809ad80 comp rx=0 tx=0).stop 2023-07-21T22:24:48.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 1 -- 172.21.15.151:0/4139780706 shutdown_connections 2023-07-21T22:24:48.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55b7ee8541b0 0x55b7ee8565c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee846bd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee844590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 1 --2- 172.21.15.151:0/4139780706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee843e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 1 -- 172.21.15.151:0/4139780706 >> 172.21.15.151:0/4139780706 conn(0x55b7ee82fef0 msgr2=0x55b7ee8353c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f73e6ffd700 0 client.26327 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:24:48.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 1 -- 172.21.15.151:0/4139780706 shutdown_connections 2023-07-21T22:24:48.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 1 -- 172.21.15.151:0/4139780706 wait complete. 2023-07-21T22:24:48.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.967+0000 7f74218afb80 20 client.26327 trim_cache size 0 max 16384 2023-07-21T22:24:48.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.982+0000 7f74218afb80 1 Processor -- start 2023-07-21T22:24:48.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.982+0000 7f74218afb80 1 -- start start 2023-07-21T22:24:48.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f74218afb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83a930 0x55b7ee846770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f74218afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee843740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f74218afb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83fac0 0x55b7ee843c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f74218afb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee844e00 con 0x55b7ee83a930 2023-07-21T22:24:48.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f74218afb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee832010 con 0x55b7ee83fac0 2023-07-21T22:24:48.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f74218afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee836ca0 con 0x55b7ee83f1b0 2023-07-21T22:24:48.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f74077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83a930 0x55b7ee846770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f74077fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83a930 0x55b7ee846770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54128/0 (socket says 172.21.15.151:54128) 2023-07-21T22:24:48.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f74077fe700 1 -- 172.21.15.151:0/2472807747 learned_addr learned my addr 172.21.15.151:0/2472807747 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f7406ffd700 1 --2- 172.21.15.151:0/2472807747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee843740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.983+0000 7f7407fff700 1 --2- 172.21.15.151:0/2472807747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83fac0 0x55b7ee843c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.984+0000 7f74077fe700 1 -- 172.21.15.151:0/2472807747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 msgr2=0x55b7ee843740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.984+0000 7f74077fe700 1 --2- 172.21.15.151:0/2472807747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee843740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.984+0000 7f74077fe700 1 -- 172.21.15.151:0/2472807747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83fac0 msgr2=0x55b7ee843c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.984+0000 7f74077fe700 1 --2- 172.21.15.151:0/2472807747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83fac0 0x55b7ee843c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.984+0000 7f74077fe700 1 -- 172.21.15.151:0/2472807747 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7ee5a2c60 con 0x55b7ee83a930 2023-07-21T22:24:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.984+0000 7f74077fe700 1 --2- 172.21.15.151:0/2472807747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83a930 0x55b7ee846770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f73f809abf0 tx=0x7f73f80a31f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8104f21cd38b3f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.984+0000 7f73ee7fc700 1 -- 172.21.15.151:0/2472807747 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f809a400 con 0x55b7ee83a930 2023-07-21T22:24:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.984+0000 7f73ee7fc700 1 -- 172.21.15.151:0/2472807747 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f73f80c9030 con 0x55b7ee83a930 2023-07-21T22:24:48.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.984+0000 7f73ee7fc700 1 -- 172.21.15.151:0/2472807747 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73f8097560 con 0x55b7ee83a930 2023-07-21T22:24:48.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.985+0000 7f74218afb80 1 -- 172.21.15.151:0/2472807747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83a930 msgr2=0x55b7ee846770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.985+0000 7f74218afb80 1 --2- 172.21.15.151:0/2472807747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83a930 0x55b7ee846770 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f73f809abf0 tx=0x7f73f80a31f0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.038 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.985+0000 7f74218afb80 1 -- 172.21.15.151:0/2472807747 shutdown_connections 2023-07-21T22:24:48.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.985+0000 7f74218afb80 1 --2- 172.21.15.151:0/2472807747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83fac0 0x55b7ee843c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.985+0000 7f74218afb80 1 --2- 172.21.15.151:0/2472807747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83a930 0x55b7ee846770 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.985+0000 7f74218afb80 1 --2- 172.21.15.151:0/2472807747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee843740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.985+0000 7f74218afb80 1 -- 172.21.15.151:0/2472807747 >> 172.21.15.151:0/2472807747 conn(0x55b7ee82fef0 msgr2=0x55b7ee838a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.985+0000 7f74218afb80 1 -- 172.21.15.151:0/2472807747 shutdown_connections 2023-07-21T22:24:48.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.985+0000 7f74218afb80 1 -- 172.21.15.151:0/2472807747 wait complete. 2023-07-21T22:24:48.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.986+0000 7f74218afb80 1 -- start start 2023-07-21T22:24:48.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.986+0000 7f74218afb80 1 Processor -- start 2023-07-21T22:24:48.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.986+0000 7f74218afb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee8a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.986+0000 7f74218afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee8a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.986+0000 7f74218afb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee849560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.986+0000 7f74218afb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee849aa0 con 0x55b7ee83fac0 2023-07-21T22:24:48.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.986+0000 7f74218afb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee849be0 con 0x55b7ee83a930 2023-07-21T22:24:48.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.986+0000 7f74218afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7ee849da0 con 0x55b7ee83f1b0 2023-07-21T22:24:48.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.986+0000 7f74218afb80 10 client.0 _ll_register_callbacks cb 0x55b7ee729760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:48.042 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7407fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee849560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee8a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7407fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee849560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54140/0 (socket says 172.21.15.151:54140) 2023-07-21T22:24:48.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7407fff700 1 -- 172.21.15.151:0/4106702413 learned_addr learned my addr 172.21.15.151:0/4106702413 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.043 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7406ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee8a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58714/0 (socket says 172.21.15.151:58714) 2023-07-21T22:24:48.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f74077fe700 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee8a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7406ffd700 1 -- 172.21.15.151:0/4106702413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 msgr2=0x55b7ee8a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7406ffd700 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee8a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7406ffd700 1 -- 172.21.15.151:0/4106702413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 msgr2=0x55b7ee849560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7406ffd700 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee849560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7406ffd700 1 -- 172.21.15.151:0/4106702413 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7400009d40 con 0x55b7ee83f1b0 2023-07-21T22:24:48.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f7406ffd700 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee8a17e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55b7ee856ed0 tx=0x7f73fc01d690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8835bbfd5ebd2564 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.987+0000 7f73e6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:24:48.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.988+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4106702413 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73fc017040 con 0x55b7ee83f1b0 2023-07-21T22:24:48.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.988+0000 7f74218afb80 1 -- 172.21.15.151:0/4106702413 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74000218c0 con 0x55b7ee83f1b0 2023-07-21T22:24:48.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.988+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4106702413 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f73fc004220 con 0x55b7ee83f1b0 2023-07-21T22:24:48.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.988+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4106702413 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f73fc0043e0 con 0x55b7ee83f1b0 2023-07-21T22:24:48.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.988+0000 7f74218afb80 10 client.26365 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:48.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.988+0000 7f74218afb80 1 -- 172.21.15.151:0/4106702413 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x55b7ee5e0250 con 0x55b7ee83f1b0 2023-07-21T22:24:48.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.989+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4106702413 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74000218c0 con 0x55b7ee83f1b0 2023-07-21T22:24:48.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.989+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4106702413 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f73fc012660 con 0x55b7ee83f1b0 2023-07-21T22:24:48.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.989+0000 7f74218afb80 10 client.26365 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:48.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.989+0000 7f74218afb80 10 client.26365 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:24:48.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.989+0000 7f74218afb80 20 client.26365 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:48.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.989+0000 7f74218afb80 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55b7ee8a9140 0x55b7ee8ab550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.989+0000 7f74218afb80 4 client.26365 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:24:48.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.989+0000 7f74218afb80 1 -- 172.21.15.151:0/4106702413 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55b7ee747050 con 0x55b7ee8a9140 2023-07-21T22:24:48.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.989+0000 7f74077fe700 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55b7ee8a9140 0x55b7ee8ab550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f73e6ffd700 10 client.26365 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:24:48.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74077fe700 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55b7ee8a9140 0x55b7ee8ab550 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7e5e2fd639b6615f server_cookie=5d1beba833ad908 in_seq=0 out_seq=0 2023-07-21T22:24:48.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f73e6ffd700 1 -- 172.21.15.151:0/4106702413 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55b7ee747050 con 0x55b7ee8a9140 2023-07-21T22:24:48.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f73e6ffd700 10 client.26365 handle_command_reply: tid=0 2023-07-21T22:24:48.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 client.26365 shutdown 2023-07-21T22:24:48.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 -- 172.21.15.151:0/4106702413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 msgr2=0x55b7ee8a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee8a17e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x55b7ee856ed0 tx=0x7f73fc01d690 comp rx=0 tx=0).stop 2023-07-21T22:24:48.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 -- 172.21.15.151:0/4106702413 shutdown_connections 2023-07-21T22:24:48.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55b7ee8a9140 0x55b7ee8ab550 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b7ee83a930 0x55b7ee8a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b7ee83fac0 0x55b7ee849560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 --2- 172.21.15.151:0/4106702413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b7ee83f1b0 0x55b7ee8a17e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.048 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f73e6ffd700 0 client.26365 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:24:48.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 -- 172.21.15.151:0/4106702413 >> 172.21.15.151:0/4106702413 conn(0x55b7ee82fef0 msgr2=0x55b7ee8399a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 -- 172.21.15.151:0/4106702413 shutdown_connections 2023-07-21T22:24:48.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.990+0000 7f74218afb80 1 -- 172.21.15.151:0/4106702413 wait complete. 2023-07-21T22:24:48.049 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f74218afb80 20 client.26365 trim_cache size 0 max 16384 2023-07-21T22:24:48.049 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:24:48.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 -- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f73f00a12c0 msgr2=0x7f73f00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f73f00a12c0 0x7f73f00a3770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7400009c60 tx=0x7f74000077e0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 -- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74080ffad0 msgr2=0x7f7408197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.050 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74080ffad0 0x7f7408197d60 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f73f8009810 tx=0x7f73f800fa00 comp rx=0 tx=0).stop 2023-07-21T22:24:48.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 -- 172.21.15.151:0/62059719 shutdown_connections 2023-07-21T22:24:48.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f73f00a12c0 0x7f73f00a3770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7408105ae0 0x7f740819c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74080ffad0 0x7f7408197d60 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 --2- 172.21.15.151:0/62059719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7408100480 0x7f74081982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.991+0000 7f740dfff700 1 -- 172.21.15.151:0/62059719 >> 172.21.15.151:0/62059719 conn(0x7f74080fb5f0 msgr2=0x7f740810ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.051 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.992+0000 7f740dfff700 1 -- 172.21.15.151:0/62059719 shutdown_connections 2023-07-21T22:24:48.052 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:47.992+0000 7f740dfff700 1 -- 172.21.15.151:0/62059719 wait complete. 2023-07-21T22:24:48.056 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-21T22:24:48.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.248+0000 7f1802d9d700 1 -- 172.21.15.151:0/3421364190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc1013b0 msgr2=0x7f17fc109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.248+0000 7f1802d9d700 1 --2- 172.21.15.151:0/3421364190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc1013b0 0x7f17fc109a80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f17ec009990 tx=0x7f17ec009ca0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.248+0000 7f1802d9d700 1 -- 172.21.15.151:0/3421364190 shutdown_connections 2023-07-21T22:24:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.248+0000 7f1802d9d700 1 --2- 172.21.15.151:0/3421364190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc109fc0 0x7f17fc10c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.248+0000 7f1802d9d700 1 --2- 172.21.15.151:0/3421364190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17fc100aa0 0x7f17fc100e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.248+0000 7f1802d9d700 1 --2- 172.21.15.151:0/3421364190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc1013b0 0x7f17fc109a80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.248+0000 7f1802d9d700 1 -- 172.21.15.151:0/3421364190 >> 172.21.15.151:0/3421364190 conn(0x7f17fc0745d0 msgr2=0x7f17fc0749d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.249+0000 7f1802d9d700 1 -- 172.21.15.151:0/3421364190 shutdown_connections 2023-07-21T22:24:48.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.249+0000 7f1802d9d700 1 -- 172.21.15.151:0/3421364190 wait complete. 2023-07-21T22:24:48.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1802d9d700 1 Processor -- start 2023-07-21T22:24:48.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1802d9d700 1 -- start start 2023-07-21T22:24:48.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1802d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc100aa0 0x7f17fc19b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1802d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17fc1013b0 0x7f17fc19bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1802d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc109fc0 0x7f17fc195740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1802d9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc195db0 con 0x7f17fc100aa0 2023-07-21T22:24:48.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1802d9d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc195f20 con 0x7f17fc109fc0 2023-07-21T22:24:48.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1802d9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc1960e0 con 0x7f17fc1013b0 2023-07-21T22:24:48.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1801d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc100aa0 0x7f17fc19b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1801d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc100aa0 0x7f17fc19b6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54152/0 (socket says 172.21.15.151:54152) 2023-07-21T22:24:48.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.250+0000 7f1801d9b700 1 -- 172.21.15.151:0/2333576652 learned_addr learned my addr 172.21.15.151:0/2333576652 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f180159a700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17fc1013b0 0x7f17fc19bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f180259c700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc109fc0 0x7f17fc195740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f1801d9b700 1 -- 172.21.15.151:0/2333576652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17fc1013b0 msgr2=0x7f17fc19bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f1801d9b700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17fc1013b0 0x7f17fc19bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f1801d9b700 1 -- 172.21.15.151:0/2333576652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc109fc0 msgr2=0x7f17fc195740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f1801d9b700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc109fc0 0x7f17fc195740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f1801d9b700 1 -- 172.21.15.151:0/2333576652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17ec0095f0 con 0x7f17fc100aa0 2023-07-21T22:24:48.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f180159a700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17fc1013b0 0x7f17fc19bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:48.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f1801d9b700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc100aa0 0x7f17fc19b6d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f17f800e9a0 tx=0x7f17f800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.251+0000 7f17f2ffd700 1 -- 172.21.15.151:0/2333576652 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8009790 con 0x7f17fc100aa0 2023-07-21T22:24:48.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.252+0000 7f1802d9d700 1 -- 172.21.15.151:0/2333576652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc1963c0 con 0x7f17fc100aa0 2023-07-21T22:24:48.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.252+0000 7f17f2ffd700 1 -- 172.21.15.151:0/2333576652 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f800cbd0 con 0x7f17fc100aa0 2023-07-21T22:24:48.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.252+0000 7f17f2ffd700 1 -- 172.21.15.151:0/2333576652 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f8018680 con 0x7f17fc100aa0 2023-07-21T22:24:48.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.252+0000 7f1802d9d700 1 -- 172.21.15.151:0/2333576652 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc1a26c0 con 0x7f17fc100aa0 2023-07-21T22:24:48.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.255+0000 7f17f2ffd700 1 -- 172.21.15.151:0/2333576652 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f17f800cd40 con 0x7f17fc100aa0 2023-07-21T22:24:48.301 INFO:teuthology.orchestra.run.smithi151.stderr:22600000 of 50000000 tuples (45%) done (elapsed 311.79 s, remaining 378.01 s) 2023-07-21T22:24:48.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.256+0000 7f18179c5b80 1 Processor -- start 2023-07-21T22:24:48.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.256+0000 7f18179c5b80 1 -- start start 2023-07-21T22:24:48.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aac9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad8b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aad9050 0x563d8aadb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f18179c5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8a9cfcb0 con 0x563d8aac9da0 2023-07-21T22:24:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f18179c5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8aa22a40 con 0x563d8aac9490 2023-07-21T22:24:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f18179c5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8aa1bed0 con 0x563d8aad9050 2023-07-21T22:24:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f180259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aac9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f180259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aac9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44208/0 (socket says 172.21.15.151:44208) 2023-07-21T22:24:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f180259c700 1 -- 172.21.15.151:0/1798881578 learned_addr learned my addr 172.21.15.151:0/1798881578 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.257+0000 7f1801d9b700 1 --2- 172.21.15.151:0/1798881578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f180159a700 1 --2- 172.21.15.151:0/1798881578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aad9050 0x563d8aadb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f180259c700 1 -- 172.21.15.151:0/1798881578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aad9050 msgr2=0x563d8aadb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f180259c700 1 --2- 172.21.15.151:0/1798881578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aad9050 0x563d8aadb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f180259c700 1 -- 172.21.15.151:0/1798881578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 msgr2=0x563d8aad8b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f180259c700 1 --2- 172.21.15.151:0/1798881578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad8b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.305 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f17f2ffd700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17e80a1360 0x7f17e80a3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f180259c700 1 -- 172.21.15.151:0/1798881578 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d8a849de0 con 0x563d8aac9490 2023-07-21T22:24:48.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f17f2ffd700 1 -- 172.21.15.151:0/2333576652 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f17f8014070 con 0x7f17fc100aa0 2023-07-21T22:24:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f180259c700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17e80a1360 0x7f17e80a3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.258+0000 7f180259c700 1 --2- 172.21.15.151:0/1798881578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aac9860 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f17f40093a0 tx=0x7f17f4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39e0f33dd77fc897 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.259+0000 7f17e7fff700 1 -- 172.21.15.151:0/1798881578 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400e070 con 0x563d8aac9490 2023-07-21T22:24:48.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.259+0000 7f17e7fff700 1 -- 172.21.15.151:0/1798881578 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f400f040 con 0x563d8aac9490 2023-07-21T22:24:48.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.259+0000 7f17e7fff700 1 -- 172.21.15.151:0/1798881578 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4020610 con 0x563d8aac9490 2023-07-21T22:24:48.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.259+0000 7f18179c5b80 1 -- 172.21.15.151:0/1798881578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 msgr2=0x563d8aac9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.259+0000 7f180259c700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17e80a1360 0x7f17e80a3810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f17f401f000 tx=0x7f17f4022000 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.260+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1798881578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aac9860 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f17f40093a0 tx=0x7f17f4009920 comp rx=0 tx=0).stop 2023-07-21T22:24:48.308 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.260+0000 7f18179c5b80 1 -- 172.21.15.151:0/1798881578 shutdown_connections 2023-07-21T22:24:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.260+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1798881578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aac9860 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.260+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1798881578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aad9050 0x563d8aadb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.260+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1798881578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad8b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.260+0000 7f18179c5b80 1 -- 172.21.15.151:0/1798881578 >> 172.21.15.151:0/1798881578 conn(0x563d8aabfef0 msgr2=0x563d8aac5860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.260+0000 7f18179c5b80 1 -- 172.21.15.151:0/1798881578 shutdown_connections 2023-07-21T22:24:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.260+0000 7f18179c5b80 1 -- 172.21.15.151:0/1798881578 wait complete. 2023-07-21T22:24:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.260+0000 7f18179c5b80 1 -- start start 2023-07-21T22:24:48.309 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.261+0000 7f18179c5b80 1 Processor -- start 2023-07-21T22:24:48.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.261+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 0x563d8aad8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.261+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.261+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8aad6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.310 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.261+0000 7f18179c5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8a9bbac0 con 0x563d8aac9da0 2023-07-21T22:24:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.261+0000 7f18179c5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8a9bb7c0 con 0x563d8aad9050 2023-07-21T22:24:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.261+0000 7f18179c5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8a89f920 con 0x563d8aac9490 2023-07-21T22:24:48.311 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f18179c5b80 10 client.0 _ll_register_callbacks cb 0x563d8a9b9760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180159a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180159a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54166/0 (socket says 172.21.15.151:54166) 2023-07-21T22:24:48.313 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8aad6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180159a700 1 -- 172.21.15.151:0/1769932734 learned_addr learned my addr 172.21.15.151:0/1769932734 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f1801d9b700 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 0x563d8aad8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180259c700 1 -- 172.21.15.151:0/1769932734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 msgr2=0x563d8aad8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180259c700 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 0x563d8aad8a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180259c700 1 -- 172.21.15.151:0/1769932734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 msgr2=0x563d8aad5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180259c700 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180259c700 1 -- 172.21.15.151:0/1769932734 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17f4009050 con 0x563d8aad9050 2023-07-21T22:24:48.314 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.262+0000 7f180159a700 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.263+0000 7f180259c700 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8aad6230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f17f400b010 tx=0x7f17f4015590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab07fde1873c844f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.263+0000 7f17e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:24:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.263+0000 7f17e57fa700 1 -- 172.21.15.151:0/1769932734 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400e040 con 0x563d8aad9050 2023-07-21T22:24:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.263+0000 7f18179c5b80 1 -- 172.21.15.151:0/1769932734 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563d8a9754f0 con 0x563d8aad9050 2023-07-21T22:24:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.263+0000 7f17e57fa700 1 -- 172.21.15.151:0/1769932734 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f17f4027070 con 0x563d8aad9050 2023-07-21T22:24:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.263+0000 7f17e57fa700 1 -- 172.21.15.151:0/1769932734 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17f4021d80 con 0x563d8aad9050 2023-07-21T22:24:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.263+0000 7f18179c5b80 10 client.26345 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:48.315 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.263+0000 7f18179c5b80 1 -- 172.21.15.151:0/1769932734 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x563d8a832c60 con 0x563d8aad9050 2023-07-21T22:24:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.264+0000 7f17e57fa700 1 -- 172.21.15.151:0/1769932734 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563d8a9754f0 con 0x563d8aad9050 2023-07-21T22:24:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.264+0000 7f17e57fa700 1 -- 172.21.15.151:0/1769932734 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f17f40041e0 con 0x563d8aad9050 2023-07-21T22:24:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.264+0000 7f18179c5b80 10 client.26345 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.264+0000 7f18179c5b80 10 client.26345 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:24:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.264+0000 7f18179c5b80 20 client.26345 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.264+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563d8aae89a0 0x563d8aaeadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.316 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.264+0000 7f18179c5b80 4 client.26345 mds_command: new command op to 24574 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.264+0000 7f18179c5b80 1 -- 172.21.15.151:0/1769932734 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563d8aa14eb0 con 0x563d8aae89a0 2023-07-21T22:24:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.264+0000 7f1801d9b700 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563d8aae89a0 0x563d8aaeadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.265+0000 7f1801d9b700 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563d8aae89a0 0x563d8aaeadb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1fd240f84a0653a0 server_cookie=c1eabdc1acf835d5 in_seq=0 out_seq=0 2023-07-21T22:24:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.265+0000 7f17e57fa700 10 client.26345 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:24:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f17e57fa700 1 -- 172.21.15.151:0/1769932734 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563d8aa14eb0 con 0x563d8aae89a0 2023-07-21T22:24:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f17e57fa700 10 client.26345 handle_command_reply: tid=0 2023-07-21T22:24:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 client.26345 shutdown 2023-07-21T22:24:48.317 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 -- 172.21.15.151:0/1769932734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 msgr2=0x563d8aad6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8aad6230 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f17f400b010 tx=0x7f17f4015590 comp rx=0 tx=0).stop 2023-07-21T22:24:48.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 -- 172.21.15.151:0/1769932734 shutdown_connections 2023-07-21T22:24:48.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563d8aae89a0 0x563d8aaeadb0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8aad6230 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 0x563d8aad8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 --2- 172.21.15.151:0/1769932734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aad5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f17e57fa700 0 client.26345 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:24:48.318 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 -- 172.21.15.151:0/1769932734 >> 172.21.15.151:0/1769932734 conn(0x563d8aabfef0 msgr2=0x563d8aac53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 -- 172.21.15.151:0/1769932734 shutdown_connections 2023-07-21T22:24:48.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 1 -- 172.21.15.151:0/1769932734 wait complete. 2023-07-21T22:24:48.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.266+0000 7f18179c5b80 20 client.26345 trim_cache size 0 max 16384 2023-07-21T22:24:48.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.283+0000 7f18179c5b80 1 Processor -- start 2023-07-21T22:24:48.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.283+0000 7f18179c5b80 1 -- start start 2023-07-21T22:24:48.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.284+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aad8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.284+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9da0 0x563d8aae42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.284+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aad9050 0x563d8aad0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.284+0000 7f18179c5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8aac2010 con 0x563d8aad9050 2023-07-21T22:24:48.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.284+0000 7f18179c5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8aadb8b0 con 0x563d8aac9490 2023-07-21T22:24:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.284+0000 7f18179c5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8aaca170 con 0x563d8aac9da0 2023-07-21T22:24:48.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f180259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aad9050 0x563d8aad0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f180259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aad9050 0x563d8aad0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54180/0 (socket says 172.21.15.151:54180) 2023-07-21T22:24:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f180259c700 1 -- 172.21.15.151:0/389881723 learned_addr learned my addr 172.21.15.151:0/389881723 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f180159a700 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9da0 0x563d8aae42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f1801d9b700 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aad8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f180259c700 1 -- 172.21.15.151:0/389881723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9da0 msgr2=0x563d8aae42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f180259c700 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9da0 0x563d8aae42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.332 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f180259c700 1 -- 172.21.15.151:0/389881723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 msgr2=0x563d8aad8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f180259c700 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aad8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f180259c700 1 -- 172.21.15.151:0/389881723 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563d8aad5790 con 0x563d8aad9050 2023-07-21T22:24:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.285+0000 7f1801d9b700 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aad8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:24:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.286+0000 7f180259c700 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aad9050 0x563d8aad0f10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f17f4002230 tx=0x7f17f4006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c18a0ffd986135 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.286+0000 7f17f0ff9700 1 -- 172.21.15.151:0/389881723 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f40216b0 con 0x563d8aad9050 2023-07-21T22:24:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.286+0000 7f17f0ff9700 1 -- 172.21.15.151:0/389881723 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f4029350 con 0x563d8aad9050 2023-07-21T22:24:48.333 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.286+0000 7f17f0ff9700 1 -- 172.21.15.151:0/389881723 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f4009550 con 0x563d8aad9050 2023-07-21T22:24:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.287+0000 7f18179c5b80 1 -- 172.21.15.151:0/389881723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aad9050 msgr2=0x563d8aad0f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.287+0000 7f18179c5b80 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aad9050 0x563d8aad0f10 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f17f4002230 tx=0x7f17f4006000 comp rx=0 tx=0).stop 2023-07-21T22:24:48.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.287+0000 7f18179c5b80 1 -- 172.21.15.151:0/389881723 shutdown_connections 2023-07-21T22:24:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.287+0000 7f18179c5b80 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aac9490 0x563d8aad8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.287+0000 7f18179c5b80 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aad9050 0x563d8aad0f10 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.287+0000 7f18179c5b80 1 --2- 172.21.15.151:0/389881723 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9da0 0x563d8aae42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.287+0000 7f18179c5b80 1 -- 172.21.15.151:0/389881723 >> 172.21.15.151:0/389881723 conn(0x563d8aabfef0 msgr2=0x563d8aac3f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.287+0000 7f18179c5b80 1 -- 172.21.15.151:0/389881723 shutdown_connections 2023-07-21T22:24:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.287+0000 7f18179c5b80 1 -- 172.21.15.151:0/389881723 wait complete. 2023-07-21T22:24:48.335 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.288+0000 7f18179c5b80 1 -- start start 2023-07-21T22:24:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.288+0000 7f18179c5b80 1 Processor -- start 2023-07-21T22:24:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 0x563d8aadbce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aadc220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f18179c5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8ab35850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f18179c5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8ab35d90 con 0x563d8aac9da0 2023-07-21T22:24:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f18179c5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8ab35f00 con 0x563d8aad9050 2023-07-21T22:24:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f18179c5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563d8ab360c0 con 0x563d8aac9490 2023-07-21T22:24:48.336 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f18179c5b80 10 client.0 _ll_register_callbacks cb 0x7f17f80d07d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f180159a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aadc220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f180259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8ab35850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f180259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8ab35850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44242/0 (socket says 172.21.15.151:44242) 2023-07-21T22:24:48.338 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f180259c700 1 -- 172.21.15.151:0/2367601814 learned_addr learned my addr 172.21.15.151:0/2367601814 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.289+0000 7f1801d9b700 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 0x563d8aadbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.290+0000 7f180259c700 1 -- 172.21.15.151:0/2367601814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 msgr2=0x563d8aadbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.290+0000 7f180259c700 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 0x563d8aadbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.290+0000 7f180259c700 1 -- 172.21.15.151:0/2367601814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 msgr2=0x563d8aadc220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.290+0000 7f180259c700 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aadc220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.290+0000 7f180259c700 1 -- 172.21.15.151:0/2367601814 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563d8a832c60 con 0x563d8aad9050 2023-07-21T22:24:48.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.290+0000 7f1801d9b700 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 0x563d8aadbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:48.339 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.290+0000 7f180259c700 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8ab35850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17f40045c0 tx=0x7f17f4015590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2a39cb13c7c922e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.290+0000 7f17e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:24:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.291+0000 7f17e57fa700 1 -- 172.21.15.151:0/2367601814 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f400e070 con 0x563d8aad9050 2023-07-21T22:24:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.291+0000 7f18179c5b80 1 -- 172.21.15.151:0/2367601814 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17f400f040 con 0x563d8aad9050 2023-07-21T22:24:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.291+0000 7f17e57fa700 1 -- 172.21.15.151:0/2367601814 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f17f40297a0 con 0x563d8aad9050 2023-07-21T22:24:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.291+0000 7f17e57fa700 1 -- 172.21.15.151:0/2367601814 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17f4029960 con 0x563d8aad9050 2023-07-21T22:24:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.291+0000 7f18179c5b80 10 client.26348 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:48.340 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.291+0000 7f18179c5b80 1 -- 172.21.15.151:0/2367601814 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x563d8a870250 con 0x563d8aad9050 2023-07-21T22:24:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.292+0000 7f17e57fa700 1 -- 172.21.15.151:0/2367601814 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17f400f040 con 0x563d8aad9050 2023-07-21T22:24:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.292+0000 7f17e57fa700 1 -- 172.21.15.151:0/2367601814 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f17f4003fa0 con 0x563d8aad9050 2023-07-21T22:24:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.292+0000 7f18179c5b80 10 client.26348 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.292+0000 7f18179c5b80 10 client.26348 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:24:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.292+0000 7f18179c5b80 20 client.26348 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.292+0000 7f18179c5b80 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563d8ab3d2d0 0x563d8ab3f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.292+0000 7f18179c5b80 4 client.26348 mds_command: new command op to 24574 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:24:48.341 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.292+0000 7f18179c5b80 1 -- 172.21.15.151:0/2367601814 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x563d8a9d7050 con 0x563d8ab3d2d0 2023-07-21T22:24:48.342 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.292+0000 7f1801d9b700 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563d8ab3d2d0 0x563d8ab3f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.293+0000 7f1801d9b700 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563d8ab3d2d0 0x563d8ab3f6b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5783adbeadfa5694 server_cookie=82e80d0b95c2f9a5 in_seq=0 out_seq=0 2023-07-21T22:24:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.293+0000 7f17e57fa700 10 client.26348 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:24:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.293+0000 7f17e57fa700 1 -- 172.21.15.151:0/2367601814 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x563d8a9d7050 con 0x563d8ab3d2d0 2023-07-21T22:24:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.293+0000 7f17e57fa700 10 client.26348 handle_command_reply: tid=0 2023-07-21T22:24:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.293+0000 7f18179c5b80 1 client.26348 shutdown 2023-07-21T22:24:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.293+0000 7f18179c5b80 1 -- 172.21.15.151:0/2367601814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 msgr2=0x563d8ab35850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.343 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.293+0000 7f18179c5b80 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8ab35850 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17f40045c0 tx=0x7f17f4015590 comp rx=0 tx=0).stop 2023-07-21T22:24:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f18179c5b80 1 -- 172.21.15.151:0/2367601814 shutdown_connections 2023-07-21T22:24:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f18179c5b80 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x563d8ab3d2d0 0x563d8ab3f6b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f18179c5b80 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563d8aad9050 0x563d8ab35850 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f18179c5b80 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563d8aac9490 0x563d8aadbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f18179c5b80 1 --2- 172.21.15.151:0/2367601814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563d8aac9da0 0x563d8aadc220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f18179c5b80 1 -- 172.21.15.151:0/2367601814 >> 172.21.15.151:0/2367601814 conn(0x563d8aabfef0 msgr2=0x563d8aae4cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f17e57fa700 0 client.26348 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:24:48.344 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f18179c5b80 1 -- 172.21.15.151:0/2367601814 shutdown_connections 2023-07-21T22:24:48.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f18179c5b80 1 -- 172.21.15.151:0/2367601814 wait complete. 2023-07-21T22:24:48.345 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.294+0000 7f18179c5b80 20 client.26348 trim_cache size 0 max 16384 2023-07-21T22:24:48.345 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:24:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.295+0000 7f1802d9d700 1 -- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17e80a1360 msgr2=0x7f17e80a3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.295+0000 7f1802d9d700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17e80a1360 0x7f17e80a3810 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f17f401f000 tx=0x7f17f4022000 comp rx=0 tx=0).stop 2023-07-21T22:24:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.295+0000 7f1802d9d700 1 -- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc100aa0 msgr2=0x7f17fc19b6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.295+0000 7f1802d9d700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc100aa0 0x7f17fc19b6d0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f17f800e9a0 tx=0x7f17f800ed60 comp rx=0 tx=0).stop 2023-07-21T22:24:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.295+0000 7f1802d9d700 1 -- 172.21.15.151:0/2333576652 shutdown_connections 2023-07-21T22:24:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.295+0000 7f1802d9d700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17e80a1360 0x7f17e80a3810 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.346 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.295+0000 7f1802d9d700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc109fc0 0x7f17fc195740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.295+0000 7f1802d9d700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17fc100aa0 0x7f17fc19b6d0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.295+0000 7f1802d9d700 1 --2- 172.21.15.151:0/2333576652 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17fc1013b0 0x7f17fc19bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.296+0000 7f1802d9d700 1 -- 172.21.15.151:0/2333576652 >> 172.21.15.151:0/2333576652 conn(0x7f17fc0745d0 msgr2=0x7f17fc0fd350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.296+0000 7f1802d9d700 1 -- 172.21.15.151:0/2333576652 shutdown_connections 2023-07-21T22:24:48.347 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.296+0000 7f1802d9d700 1 -- 172.21.15.151:0/2333576652 wait complete. 2023-07-21T22:24:48.361 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-21T22:24:48.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.552+0000 7f4770dff700 1 -- 172.21.15.151:0/3570541093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 msgr2=0x7f476c10e810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.552+0000 7f4770dff700 1 --2- 172.21.15.151:0/3570541093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 0x7f476c10e810 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f476400b0a0 tx=0x7f476400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.552+0000 7f4770dff700 1 -- 172.21.15.151:0/3570541093 shutdown_connections 2023-07-21T22:24:48.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.552+0000 7f4770dff700 1 --2- 172.21.15.151:0/3570541093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476c0fe880 0x7f476c0fec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.552+0000 7f4770dff700 1 --2- 172.21.15.151:0/3570541093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 0x7f476c10e810 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.552+0000 7f4770dff700 1 --2- 172.21.15.151:0/3570541093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f476c0ff190 0x7f476c10bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.552+0000 7f4770dff700 1 -- 172.21.15.151:0/3570541093 >> 172.21.15.151:0/3570541093 conn(0x7f476c0fa4b0 msgr2=0x7f476c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.552+0000 7f4770dff700 1 -- 172.21.15.151:0/3570541093 shutdown_connections 2023-07-21T22:24:48.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.552+0000 7f4770dff700 1 -- 172.21.15.151:0/3570541093 wait complete. 2023-07-21T22:24:48.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.554+0000 7f4770dff700 1 Processor -- start 2023-07-21T22:24:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.554+0000 7f4770dff700 1 -- start start 2023-07-21T22:24:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.554+0000 7f4770dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f476c0fe880 0x7f476c197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.554+0000 7f4770dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476c0ff190 0x7f476c198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.554+0000 7f4770dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 0x7f476c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.554+0000 7f4770dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c19cea0 con 0x7f476c10c430 2023-07-21T22:24:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.554+0000 7f4770dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c19d010 con 0x7f476c0ff190 2023-07-21T22:24:48.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.554+0000 7f4770dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476c19d1d0 con 0x7f476c0fe880 2023-07-21T22:24:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 0x7f476c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 0x7f476c19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54220/0 (socket says 172.21.15.151:54220) 2023-07-21T22:24:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476ad9d700 1 -- 172.21.15.151:0/1450007933 learned_addr learned my addr 172.21.15.151:0/1450007933 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476a59c700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f476c0fe880 0x7f476c197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f4769d9b700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476c0ff190 0x7f476c198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476ad9d700 1 -- 172.21.15.151:0/1450007933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f476c0fe880 msgr2=0x7f476c197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476ad9d700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f476c0fe880 0x7f476c197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476ad9d700 1 -- 172.21.15.151:0/1450007933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476c0ff190 msgr2=0x7f476c198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476ad9d700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476c0ff190 0x7f476c198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476ad9d700 1 -- 172.21.15.151:0/1450007933 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4764009d00 con 0x7f476c10c430 2023-07-21T22:24:48.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f4769d9b700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476c0ff190 0x7f476c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.555+0000 7f476a59c700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f476c0fe880 0x7f476c197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.556+0000 7f476ad9d700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 0x7f476c19c860 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4764008f90 tx=0x7f4764008fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.556+0000 7f475b7fe700 1 -- 172.21.15.151:0/1450007933 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476400e040 con 0x7f476c10c430 2023-07-21T22:24:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.556+0000 7f475b7fe700 1 -- 172.21.15.151:0/1450007933 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4764004c50 con 0x7f476c10c430 2023-07-21T22:24:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.556+0000 7f475b7fe700 1 -- 172.21.15.151:0/1450007933 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640052a0 con 0x7f476c10c430 2023-07-21T22:24:48.606 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.556+0000 7f4770dff700 1 -- 172.21.15.151:0/1450007933 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f476c19d450 con 0x7f476c10c430 2023-07-21T22:24:48.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.556+0000 7f4770dff700 1 -- 172.21.15.151:0/1450007933 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476c1a4cf0 con 0x7f476c10c430 2023-07-21T22:24:48.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.561+0000 7f475b7fe700 1 -- 172.21.15.151:0/1450007933 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f476401d470 con 0x7f476c10c430 2023-07-21T22:24:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.563+0000 7f4784687b80 1 Processor -- start 2023-07-21T22:24:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.563+0000 7f4784687b80 1 -- start start 2023-07-21T22:24:48.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.563+0000 7f475b7fe700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47540a1340 0x7f47540a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.563+0000 7f475b7fe700 1 -- 172.21.15.151:0/1450007933 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f47640ce080 con 0x7f476c10c430 2023-07-21T22:24:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.563+0000 7f4784687b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 0x56248a51e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.563+0000 7f4784687b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a519350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f4784687b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a519930 0x56248a519da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f4784687b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a41ecb0 con 0x56248a51eac0 2023-07-21T22:24:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f4784687b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a471a40 con 0x56248a51e1b0 2023-07-21T22:24:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f4784687b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a46aed0 con 0x56248a519930 2023-07-21T22:24:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f4769d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a519350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f4769d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a519350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54228/0 (socket says 172.21.15.151:54228) 2023-07-21T22:24:48.612 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f4769d9b700 1 -- 172.21.15.151:0/3223782648 learned_addr learned my addr 172.21.15.151:0/3223782648 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f4769d9b700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47540a1340 0x7f47540a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f476ad9d700 1 --2- 172.21.15.151:0/3223782648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a519930 0x56248a519da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.564+0000 7f476a59c700 1 --2- 172.21.15.151:0/3223782648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 0x56248a51e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.565+0000 7f476ad9d700 1 -- 172.21.15.151:0/3223782648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 msgr2=0x56248a51e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.565+0000 7f476ad9d700 1 --2- 172.21.15.151:0/3223782648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 0x56248a51e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.565+0000 7f476ad9d700 1 -- 172.21.15.151:0/3223782648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 msgr2=0x56248a519350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.565+0000 7f476ad9d700 1 --2- 172.21.15.151:0/3223782648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a519350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.613 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.565+0000 7f476ad9d700 1 -- 172.21.15.151:0/3223782648 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56248a298de0 con 0x56248a519930 2023-07-21T22:24:48.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.565+0000 7f476ad9d700 1 --2- 172.21.15.151:0/3223782648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a519930 0x56248a519da0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47640cb820 tx=0x7f476409ad70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39f8a21afcd36b91 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.565+0000 7f4769d9b700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47540a1340 0x7f47540a37f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x56248a51a5b0 tx=0x7f47600058e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.565+0000 7f4758ff9700 1 -- 172.21.15.151:0/3223782648 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640aeea0 con 0x56248a519930 2023-07-21T22:24:48.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.566+0000 7f4758ff9700 1 -- 172.21.15.151:0/3223782648 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47640a10d0 con 0x56248a519930 2023-07-21T22:24:48.614 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.566+0000 7f4758ff9700 1 -- 172.21.15.151:0/3223782648 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476409b490 con 0x56248a519930 2023-07-21T22:24:48.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.566+0000 7f4784687b80 1 -- 172.21.15.151:0/3223782648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a519930 msgr2=0x56248a519da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.566+0000 7f4784687b80 1 --2- 172.21.15.151:0/3223782648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a519930 0x56248a519da0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47640cb820 tx=0x7f476409ad70 comp rx=0 tx=0).stop 2023-07-21T22:24:48.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.567+0000 7f4784687b80 1 -- 172.21.15.151:0/3223782648 shutdown_connections 2023-07-21T22:24:48.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.567+0000 7f4784687b80 1 --2- 172.21.15.151:0/3223782648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 0x56248a51e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.615 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.567+0000 7f4784687b80 1 --2- 172.21.15.151:0/3223782648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a519930 0x56248a519da0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.567+0000 7f4784687b80 1 --2- 172.21.15.151:0/3223782648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a519350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.567+0000 7f4784687b80 1 -- 172.21.15.151:0/3223782648 >> 172.21.15.151:0/3223782648 conn(0x56248a50eef0 msgr2=0x56248a514830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.567+0000 7f4784687b80 1 -- 172.21.15.151:0/3223782648 shutdown_connections 2023-07-21T22:24:48.616 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.567+0000 7f4784687b80 1 -- 172.21.15.151:0/3223782648 wait complete. 2023-07-21T22:24:48.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.569+0000 7f4784687b80 1 -- start start 2023-07-21T22:24:48.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.570+0000 7f4784687b80 1 Processor -- start 2023-07-21T22:24:48.617 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.571+0000 7f4784687b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a525c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.571+0000 7f4784687b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 0x56248a522ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.571+0000 7f4784687b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51eac0 0x56248a523610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.571+0000 7f4784687b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a40aac0 con 0x56248a519930 2023-07-21T22:24:48.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.571+0000 7f4784687b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a40a7c0 con 0x56248a51e1b0 2023-07-21T22:24:48.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.571+0000 7f4784687b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a2ee920 con 0x56248a51eac0 2023-07-21T22:24:48.618 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.571+0000 7f4784687b80 10 client.0 _ll_register_callbacks cb 0x56248a408760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:48.619 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.572+0000 7f476a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a525c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.572+0000 7f476a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a525c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54240/0 (socket says 172.21.15.151:54240) 2023-07-21T22:24:48.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.572+0000 7f476a59c700 1 -- 172.21.15.151:0/1922353181 learned_addr learned my addr 172.21.15.151:0/1922353181 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.572+0000 7f4769d9b700 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 0x56248a522ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.572+0000 7f476ad9d700 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51eac0 0x56248a523610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f476a59c700 1 -- 172.21.15.151:0/1922353181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51eac0 msgr2=0x56248a523610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f476a59c700 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51eac0 0x56248a523610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f476a59c700 1 -- 172.21.15.151:0/1922353181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 msgr2=0x56248a522ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f476a59c700 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 0x56248a522ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f476a59c700 1 -- 172.21.15.151:0/1922353181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f476401de70 con 0x56248a519930 2023-07-21T22:24:48.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f476a59c700 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a525c50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f475c012d20 tx=0x7f475c00f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a454b598da1749 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.621 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f4751ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:48.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f4751ffb700 1 -- 172.21.15.151:0/1922353181 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c017070 con 0x56248a519930 2023-07-21T22:24:48.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f4751ffb700 1 -- 172.21.15.151:0/1922353181 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f475c00fc30 con 0x56248a519930 2023-07-21T22:24:48.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.573+0000 7f4784687b80 1 -- 172.21.15.151:0/1922353181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56248a3c44f0 con 0x56248a519930 2023-07-21T22:24:48.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.574+0000 7f4751ffb700 1 -- 172.21.15.151:0/1922353181 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f475c0122e0 con 0x56248a519930 2023-07-21T22:24:48.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.574+0000 7f4784687b80 10 client.16635 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:48.623 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.574+0000 7f4784687b80 1 -- 172.21.15.151:0/1922353181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56248a281c60 con 0x56248a519930 2023-07-21T22:24:48.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.574+0000 7f4751ffb700 1 -- 172.21.15.151:0/1922353181 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56248a3c44f0 con 0x56248a519930 2023-07-21T22:24:48.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.575+0000 7f4751ffb700 1 -- 172.21.15.151:0/1922353181 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f475c01c420 con 0x56248a519930 2023-07-21T22:24:48.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.575+0000 7f4784687b80 10 client.16635 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:48.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.575+0000 7f4784687b80 10 client.16635 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:48.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.575+0000 7f4784687b80 20 client.16635 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:48.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.575+0000 7f4784687b80 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56248a53bc40 0x56248a53e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.575+0000 7f4784687b80 4 client.16635 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:48.627 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.575+0000 7f4784687b80 1 -- 172.21.15.151:0/1922353181 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56248a463eb0 con 0x56248a53bc40 2023-07-21T22:24:48.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.576+0000 7f4769d9b700 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56248a53bc40 0x56248a53e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.577+0000 7f4769d9b700 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56248a53bc40 0x56248a53e050 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f628d82e0e94f7d server_cookie=95a67f6275529f05 in_seq=0 out_seq=0 2023-07-21T22:24:48.628 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.577+0000 7f4751ffb700 10 client.16635 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:48.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.577+0000 7f4751ffb700 1 -- 172.21.15.151:0/1922353181 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56248a463eb0 con 0x56248a53bc40 2023-07-21T22:24:48.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.577+0000 7f4751ffb700 10 client.16635 handle_command_reply: tid=0 2023-07-21T22:24:48.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 client.16635 shutdown 2023-07-21T22:24:48.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 -- 172.21.15.151:0/1922353181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 msgr2=0x56248a525c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a525c50 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f475c012d20 tx=0x7f475c00f6a0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.629 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 -- 172.21.15.151:0/1922353181 shutdown_connections 2023-07-21T22:24:48.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56248a53bc40 0x56248a53e050 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51eac0 0x56248a523610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a525c50 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4751ffb700 0 client.16635 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:48.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 --2- 172.21.15.151:0/1922353181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51e1b0 0x56248a522ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 -- 172.21.15.151:0/1922353181 >> 172.21.15.151:0/1922353181 conn(0x56248a50eef0 msgr2=0x56248a514420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 -- 172.21.15.151:0/1922353181 shutdown_connections 2023-07-21T22:24:48.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.578+0000 7f4784687b80 1 -- 172.21.15.151:0/1922353181 wait complete. 2023-07-21T22:24:48.631 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.579+0000 7f4784687b80 20 client.16635 trim_cache size 0 max 16384 2023-07-21T22:24:48.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:48 smithi187 ceph-mon[96918]: pgmap v171: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 35 MiB/s wr, 76 op/s 2023-07-21T22:24:48.631 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:48 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1906708377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:24:48.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f4784687b80 1 Processor -- start 2023-07-21T22:24:48.638 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f4784687b80 1 -- start start 2023-07-21T22:24:48.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f4784687b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a519930 0x56248a537e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.639 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f4784687b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 0x56248a5257f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f4784687b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a5226b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f4784687b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a511010 con 0x56248a51eac0 2023-07-21T22:24:48.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f4784687b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a539210 con 0x56248a519930 2023-07-21T22:24:48.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f4784687b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a521450 con 0x56248a51e1b0 2023-07-21T22:24:48.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f476ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a5226b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.640 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f476ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a5226b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54244/0 (socket says 172.21.15.151:54244) 2023-07-21T22:24:48.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.593+0000 7f476ad9d700 1 -- 172.21.15.151:0/410043505 learned_addr learned my addr 172.21.15.151:0/410043505 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f476a59c700 1 --2- 172.21.15.151:0/410043505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a519930 0x56248a537e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f4769d9b700 1 --2- 172.21.15.151:0/410043505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 0x56248a5257f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f476ad9d700 1 -- 172.21.15.151:0/410043505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 msgr2=0x56248a5257f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f476ad9d700 1 --2- 172.21.15.151:0/410043505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 0x56248a5257f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f476ad9d700 1 -- 172.21.15.151:0/410043505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a519930 msgr2=0x56248a537e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.641 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f476ad9d700 1 --2- 172.21.15.151:0/410043505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a519930 0x56248a537e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.642 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f476ad9d700 1 -- 172.21.15.151:0/410043505 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56248a2bf250 con 0x56248a51eac0 2023-07-21T22:24:48.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f476ad9d700 1 --2- 172.21.15.151:0/410043505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a5226b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4764026000 tx=0x7f47640a1240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41cac1a845b63ca5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f47597fa700 1 -- 172.21.15.151:0/410043505 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47640aeea0 con 0x56248a51eac0 2023-07-21T22:24:48.643 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f47597fa700 1 -- 172.21.15.151:0/410043505 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47640a35f0 con 0x56248a51eac0 2023-07-21T22:24:48.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.594+0000 7f47597fa700 1 -- 172.21.15.151:0/410043505 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f476409a720 con 0x56248a51eac0 2023-07-21T22:24:48.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.595+0000 7f4784687b80 1 -- 172.21.15.151:0/410043505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 msgr2=0x56248a5226b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.595+0000 7f4784687b80 1 --2- 172.21.15.151:0/410043505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a5226b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f4764026000 tx=0x7f47640a1240 comp rx=0 tx=0).stop 2023-07-21T22:24:48.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.595+0000 7f4784687b80 1 -- 172.21.15.151:0/410043505 shutdown_connections 2023-07-21T22:24:48.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.595+0000 7f4784687b80 1 --2- 172.21.15.151:0/410043505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a519930 0x56248a537e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.595+0000 7f4784687b80 1 --2- 172.21.15.151:0/410043505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a51eac0 0x56248a5226b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.644 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.595+0000 7f4784687b80 1 --2- 172.21.15.151:0/410043505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 0x56248a5257f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.595+0000 7f4784687b80 1 -- 172.21.15.151:0/410043505 >> 172.21.15.151:0/410043505 conn(0x56248a50eef0 msgr2=0x56248a5429d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.595+0000 7f4784687b80 1 -- 172.21.15.151:0/410043505 shutdown_connections 2023-07-21T22:24:48.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.595+0000 7f4784687b80 1 -- 172.21.15.151:0/410043505 wait complete. 2023-07-21T22:24:48.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.596+0000 7f4784687b80 1 -- start start 2023-07-21T22:24:48.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.596+0000 7f4784687b80 1 Processor -- start 2023-07-21T22:24:48.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f4784687b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a530bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f4784687b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 0x56248a531100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.645 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f4784687b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51eac0 0x56248a58eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f4784687b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a5319f0 con 0x56248a519930 2023-07-21T22:24:48.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f4784687b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a58f060 con 0x56248a51eac0 2023-07-21T22:24:48.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f4784687b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56248a58f1a0 con 0x56248a51e1b0 2023-07-21T22:24:48.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f4784687b80 10 client.0 _ll_register_callbacks cb 0x7f475c0127f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:48.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f476a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a530bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f476ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51eac0 0x56248a58eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.646 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f476a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a530bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54258/0 (socket says 172.21.15.151:54258) 2023-07-21T22:24:48.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f476a59c700 1 -- 172.21.15.151:0/4099670453 learned_addr learned my addr 172.21.15.151:0/4099670453 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:48.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f4769d9b700 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 0x56248a531100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f476a59c700 1 -- 172.21.15.151:0/4099670453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 msgr2=0x56248a531100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f476a59c700 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 0x56248a531100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f476a59c700 1 -- 172.21.15.151:0/4099670453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51eac0 msgr2=0x56248a58eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:48.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f476a59c700 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51eac0 0x56248a58eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.597+0000 7f476a59c700 1 -- 172.21.15.151:0/4099670453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56248a298de0 con 0x56248a519930 2023-07-21T22:24:48.647 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f476ad9d700 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51eac0 0x56248a58eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:48.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f4769d9b700 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 0x56248a531100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:48.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f476a59c700 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a530bc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f475c01c750 tx=0x7f475c01c650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a008f9aedb4199 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:48.648 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f4751ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:48.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f4751ffb700 1 -- 172.21.15.151:0/4099670453 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c017040 con 0x56248a519930 2023-07-21T22:24:48.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f4784687b80 1 -- 172.21.15.151:0/4099670453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47640a10d0 con 0x56248a519930 2023-07-21T22:24:48.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f4751ffb700 1 -- 172.21.15.151:0/4099670453 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f475c005310 con 0x56248a519930 2023-07-21T22:24:48.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f4751ffb700 1 -- 172.21.15.151:0/4099670453 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f475c0057e0 con 0x56248a519930 2023-07-21T22:24:48.650 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f4784687b80 10 client.16641 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:48.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.598+0000 7f4784687b80 1 -- 172.21.15.151:0/4099670453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x56248a2972b0 con 0x56248a519930 2023-07-21T22:24:48.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.599+0000 7f4751ffb700 1 -- 172.21.15.151:0/4099670453 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47640a10d0 con 0x56248a519930 2023-07-21T22:24:48.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.599+0000 7f4751ffb700 1 -- 172.21.15.151:0/4099670453 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f475c003a00 con 0x56248a519930 2023-07-21T22:24:48.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.599+0000 7f4784687b80 10 client.16641 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:48.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.599+0000 7f4784687b80 10 client.16641 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:48.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.599+0000 7f4784687b80 20 client.16641 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:48.651 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.599+0000 7f4784687b80 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56248a590820 0x56248a592c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:48.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.599+0000 7f4784687b80 4 client.16641 mds_command: new command op to 24599 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:24:48.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.599+0000 7f4784687b80 1 -- 172.21.15.151:0/4099670453 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x56248a426050 con 0x56248a590820 2023-07-21T22:24:48.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.599+0000 7f4769d9b700 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56248a590820 0x56248a592c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:48.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4769d9b700 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56248a590820 0x56248a592c30 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=980f56b74dd15f10 server_cookie=7ab8231f33350bbb in_seq=0 out_seq=0 2023-07-21T22:24:48.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4751ffb700 10 client.16641 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:48.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4751ffb700 1 -- 172.21.15.151:0/4099670453 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x56248a426050 con 0x56248a590820 2023-07-21T22:24:48.652 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4751ffb700 10 client.16641 handle_command_reply: tid=0 2023-07-21T22:24:48.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4784687b80 1 client.16641 shutdown 2023-07-21T22:24:48.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4784687b80 1 -- 172.21.15.151:0/4099670453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 msgr2=0x56248a530bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4784687b80 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a530bc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f475c01c750 tx=0x7f475c01c650 comp rx=0 tx=0).stop 2023-07-21T22:24:48.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4784687b80 1 -- 172.21.15.151:0/4099670453 shutdown_connections 2023-07-21T22:24:48.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4784687b80 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56248a590820 0x56248a592c30 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4784687b80 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56248a51eac0 0x56248a58eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4784687b80 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56248a519930 0x56248a530bc0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.653 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4751ffb700 0 client.16641 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:48.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4784687b80 1 --2- 172.21.15.151:0/4099670453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56248a51e1b0 0x56248a531100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.600+0000 7f4784687b80 1 -- 172.21.15.151:0/4099670453 >> 172.21.15.151:0/4099670453 conn(0x56248a50eef0 msgr2=0x56248a537e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.601+0000 7f4784687b80 1 -- 172.21.15.151:0/4099670453 shutdown_connections 2023-07-21T22:24:48.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.601+0000 7f4784687b80 1 -- 172.21.15.151:0/4099670453 wait complete. 2023-07-21T22:24:48.654 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.601+0000 7f4784687b80 20 client.16641 trim_cache size 0 max 16384 2023-07-21T22:24:48.654 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:24:48.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.601+0000 7f4770dff700 1 -- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47540a1340 msgr2=0x7f47540a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.601+0000 7f4770dff700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47540a1340 0x7f47540a37f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x56248a51a5b0 tx=0x7f47600058e0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.655 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.601+0000 7f4770dff700 1 -- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 msgr2=0x7f476c19c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.601+0000 7f4770dff700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 0x7f476c19c860 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f4764008f90 tx=0x7f4764008fc0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.602+0000 7f4770dff700 1 -- 172.21.15.151:0/1450007933 shutdown_connections 2023-07-21T22:24:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.602+0000 7f4770dff700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47540a1340 0x7f47540a37f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.602+0000 7f4770dff700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f476c10c430 0x7f476c19c860 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.602+0000 7f4770dff700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f476c0fe880 0x7f476c197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.602+0000 7f4770dff700 1 --2- 172.21.15.151:0/1450007933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476c0ff190 0x7f476c198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:48.656 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.602+0000 7f4770dff700 1 -- 172.21.15.151:0/1450007933 >> 172.21.15.151:0/1450007933 conn(0x7f476c0fa4b0 msgr2=0x7f476c10e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:48.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.602+0000 7f4770dff700 1 -- 172.21.15.151:0/1450007933 shutdown_connections 2023-07-21T22:24:48.657 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:48.602+0000 7f4770dff700 1 -- 172.21.15.151:0/1450007933 wait complete. 2023-07-21T22:24:48.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:48 smithi195 ceph-mon[97365]: pgmap v171: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 35 MiB/s wr, 76 op/s 2023-07-21T22:24:48.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:48 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1906708377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:24:48.664 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:48 smithi151 ceph-mon[95510]: pgmap v171: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 35 MiB/s wr, 76 op/s 2023-07-21T22:24:48.664 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:48 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1906708377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:24:49.553 INFO:teuthology.orchestra.run.smithi151.stderr:22700000 of 50000000 tuples (45%) done (elapsed 313.04 s, remaining 376.48 s) 2023-07-21T22:24:49.667 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2023-07-21T22:24:49.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2023-07-21T22:24:49.901 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.855+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2686923019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb5410a070 msgr2=0x7fdb5410c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.855+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2686923019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb5410a070 0x7fdb5410c4b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c00b0a0 tx=0x7fdb4c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.856+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2686923019 shutdown_connections 2023-07-21T22:24:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.856+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2686923019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb5410a070 0x7fdb5410c4b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.856+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2686923019 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb54100ca0 0x7fdb54101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.856+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2686923019 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb541015b0 0x7fdb54109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.902 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.856+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2686923019 >> 172.21.15.151:0/2686923019 conn(0x7fdb540fa4b0 msgr2=0x7fdb540fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.856+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2686923019 shutdown_connections 2023-07-21T22:24:49.903 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.856+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2686923019 wait complete. 2023-07-21T22:24:49.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.857+0000 7fdb5a5ff700 1 Processor -- start 2023-07-21T22:24:49.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.857+0000 7fdb5a5ff700 1 -- start start 2023-07-21T22:24:49.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.857+0000 7fdb5a5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb54100ca0 0x7fdb54195ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.904 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.857+0000 7fdb5a5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb541015b0 0x7fdb54196220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.857+0000 7fdb5a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5410a070 0x7fdb541995d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.857+0000 7fdb5a5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54199bd0 con 0x7fdb541015b0 2023-07-21T22:24:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.857+0000 7fdb5a5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54199d40 con 0x7fdb54100ca0 2023-07-21T22:24:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.857+0000 7fdb5a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb54199f00 con 0x7fdb5410a070 2023-07-21T22:24:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb537fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb541015b0 0x7fdb54196220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb537fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb541015b0 0x7fdb54196220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54280/0 (socket says 172.21.15.151:54280) 2023-07-21T22:24:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb537fe700 1 -- 172.21.15.151:0/2615485669 learned_addr learned my addr 172.21.15.151:0/2615485669 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:49.905 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb53fff700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb54100ca0 0x7fdb54195ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb58b9c700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5410a070 0x7fdb541995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb537fe700 1 -- 172.21.15.151:0/2615485669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5410a070 msgr2=0x7fdb541995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:49.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb537fe700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5410a070 0x7fdb541995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb537fe700 1 -- 172.21.15.151:0/2615485669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb54100ca0 msgr2=0x7fdb54195ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:49.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb537fe700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb54100ca0 0x7fdb54195ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb537fe700 1 -- 172.21.15.151:0/2615485669 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb4c009d00 con 0x7fdb541015b0 2023-07-21T22:24:49.906 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.858+0000 7fdb537fe700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb541015b0 0x7fdb54196220 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800d980 tx=0x7fdb4800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:49.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.859+0000 7fdb517fa700 1 -- 172.21.15.151:0/2615485669 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48004220 con 0x7fdb541015b0 2023-07-21T22:24:49.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.859+0000 7fdb517fa700 1 -- 172.21.15.151:0/2615485669 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb48007640 con 0x7fdb541015b0 2023-07-21T22:24:49.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.859+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2615485669 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb5419a1e0 con 0x7fdb541015b0 2023-07-21T22:24:49.907 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.859+0000 7fdb517fa700 1 -- 172.21.15.151:0/2615485669 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48005660 con 0x7fdb541015b0 2023-07-21T22:24:49.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.859+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2615485669 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb541a2b40 con 0x7fdb541015b0 2023-07-21T22:24:49.908 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.863+0000 7fdb517fa700 1 -- 172.21.15.151:0/2615485669 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdb48004750 con 0x7fdb541015b0 2023-07-21T22:24:49.909 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.864+0000 7fdb6de45b80 1 Processor -- start 2023-07-21T22:24:49.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.864+0000 7fdb6de45b80 1 -- start start 2023-07-21T22:24:49.910 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b55c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55c33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c39b0 0x5635b55c3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b54c8d30 con 0x5635b55c8b40 2023-07-21T22:24:49.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b551bac0 con 0x5635b55c8230 2023-07-21T22:24:49.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b5514f50 con 0x5635b55c39b0 2023-07-21T22:24:49.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb53fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55c33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.911 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb53fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55c33d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54282/0 (socket says 172.21.15.151:54282) 2023-07-21T22:24:49.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb53fff700 1 -- 172.21.15.151:0/1653698044 learned_addr learned my addr 172.21.15.151:0/1653698044 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:49.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb537fe700 1 --2- 172.21.15.151:0/1653698044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c39b0 0x5635b55c3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.912 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb58b9c700 1 --2- 172.21.15.151:0/1653698044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b55c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.865+0000 7fdb517fa700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb3c0a12c0 0x7fdb3c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb517fa700 1 -- 172.21.15.151:0/2615485669 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdb480cc760 con 0x7fdb541015b0 2023-07-21T22:24:49.913 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb53fff700 1 -- 172.21.15.151:0/1653698044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c39b0 msgr2=0x5635b55c3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:49.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb53fff700 1 --2- 172.21.15.151:0/1653698044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c39b0 0x5635b55c3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb53fff700 1 -- 172.21.15.151:0/1653698044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 msgr2=0x5635b55c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:49.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb53fff700 1 --2- 172.21.15.151:0/1653698044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b55c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb53fff700 1 -- 172.21.15.151:0/1653698044 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635b5342e60 con 0x5635b55c8b40 2023-07-21T22:24:49.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb58b9c700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb3c0a12c0 0x7fdb3c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb53fff700 1 --2- 172.21.15.151:0/1653698044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55c33d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400bd70 tx=0x7fdb440106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f1d91597fef2eb7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:49.914 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb3a7fc700 1 -- 172.21.15.151:0/1653698044 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44010e10 con 0x5635b55c8b40 2023-07-21T22:24:49.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb58b9c700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb3c0a12c0 0x7fdb3c0a3770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009cd0 tx=0x7fdb4c00b3b0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:49.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb3a7fc700 1 -- 172.21.15.151:0/1653698044 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb44015070 con 0x5635b55c8b40 2023-07-21T22:24:49.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.866+0000 7fdb3a7fc700 1 -- 172.21.15.151:0/1653698044 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440116a0 con 0x5635b55c8b40 2023-07-21T22:24:49.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.867+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1653698044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 msgr2=0x5635b55c33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:49.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.867+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/1653698044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55c33d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdb4400bd70 tx=0x7fdb440106b0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.867+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1653698044 shutdown_connections 2023-07-21T22:24:49.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.867+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/1653698044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b55c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.915 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.867+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/1653698044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c39b0 0x5635b55c3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.867+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/1653698044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55c33d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.867+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1653698044 >> 172.21.15.151:0/1653698044 conn(0x5635b55b8f70 msgr2=0x5635b55be8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.867+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1653698044 shutdown_connections 2023-07-21T22:24:49.916 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.867+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1653698044 wait complete. 2023-07-21T22:24:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.868+0000 7fdb6de45b80 1 -- start start 2023-07-21T22:24:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.868+0000 7fdb6de45b80 1 Processor -- start 2023-07-21T22:24:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b55cfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b55ccf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.918 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 0x5635b55cd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b54b4b40 con 0x5635b55c39b0 2023-07-21T22:24:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b54b4840 con 0x5635b55c8230 2023-07-21T22:24:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b53989a0 con 0x5635b55c8b40 2023-07-21T22:24:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb6de45b80 10 client.0 _ll_register_callbacks cb 0x5635b54b27e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb53fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b55cfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb53fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b55cfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54298/0 (socket says 172.21.15.151:54298) 2023-07-21T22:24:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.869+0000 7fdb53fff700 1 -- 172.21.15.151:0/3423756614 learned_addr learned my addr 172.21.15.151:0/3423756614 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:49.919 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb58b9c700 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 0x5635b55cd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb53fff700 1 -- 172.21.15.151:0/3423756614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 msgr2=0x5635b55cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:49.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb537fe700 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b55ccf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb53fff700 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 0x5635b55cd640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb53fff700 1 -- 172.21.15.151:0/3423756614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 msgr2=0x5635b55ccf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:49.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb53fff700 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b55ccf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb53fff700 1 -- 172.21.15.151:0/3423756614 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb4400b9a0 con 0x5635b55c39b0 2023-07-21T22:24:49.920 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb537fe700 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b55ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:24:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb53fff700 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b55cfc80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdb44000c00 tx=0x7fdb4401dff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b066e47024a61a82 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb337fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.870+0000 7fdb337fe700 1 -- 172.21.15.151:0/3423756614 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44020040 con 0x5635b55c39b0 2023-07-21T22:24:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.871+0000 7fdb337fe700 1 -- 172.21.15.151:0/3423756614 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdb44017070 con 0x5635b55c39b0 2023-07-21T22:24:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.871+0000 7fdb6de45b80 1 -- 172.21.15.151:0/3423756614 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635b546e570 con 0x5635b55c39b0 2023-07-21T22:24:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.871+0000 7fdb337fe700 1 -- 172.21.15.151:0/3423756614 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb4401c480 con 0x5635b55c39b0 2023-07-21T22:24:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.871+0000 7fdb6de45b80 10 client.16653 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:49.921 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.871+0000 7fdb6de45b80 1 -- 172.21.15.151:0/3423756614 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5635b532bce0 con 0x5635b55c39b0 2023-07-21T22:24:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.871+0000 7fdb337fe700 1 -- 172.21.15.151:0/3423756614 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5635b546e570 con 0x5635b55c39b0 2023-07-21T22:24:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.871+0000 7fdb337fe700 1 -- 172.21.15.151:0/3423756614 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdb44003710 con 0x5635b55c39b0 2023-07-21T22:24:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.871+0000 7fdb6de45b80 10 client.16653 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.871+0000 7fdb6de45b80 10 client.16653 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.872+0000 7fdb6de45b80 20 client.16653 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.872+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5635b55dd4a0 0x5635b55df8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.872+0000 7fdb6de45b80 4 client.16653 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:49.922 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.872+0000 7fdb6de45b80 1 -- 172.21.15.151:0/3423756614 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5635b550df30 con 0x5635b55dd4a0 2023-07-21T22:24:49.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.872+0000 7fdb537fe700 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5635b55dd4a0 0x5635b55df8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.872+0000 7fdb337fe700 10 client.16653 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:49.923 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.872+0000 7fdb537fe700 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5635b55dd4a0 0x5635b55df8b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=849c52de5399e1bd server_cookie=77b8d3222f797286 in_seq=0 out_seq=0 2023-07-21T22:24:49.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.873+0000 7fdb337fe700 1 -- 172.21.15.151:0/3423756614 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5635b550df30 con 0x5635b55dd4a0 2023-07-21T22:24:49.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.873+0000 7fdb337fe700 10 client.16653 handle_command_reply: tid=0 2023-07-21T22:24:49.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.873+0000 7fdb6de45b80 1 client.16653 shutdown 2023-07-21T22:24:49.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 -- 172.21.15.151:0/3423756614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 msgr2=0x5635b55cfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:49.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b55cfc80 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fdb44000c00 tx=0x7fdb4401dff0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.924 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 -- 172.21.15.151:0/3423756614 shutdown_connections 2023-07-21T22:24:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5635b55dd4a0 0x5635b55df8b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 0x5635b55cd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b55cfc80 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/3423756614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b55ccf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb337fe700 0 client.16653 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 -- 172.21.15.151:0/3423756614 >> 172.21.15.151:0/3423756614 conn(0x5635b55b8f70 msgr2=0x5635b55be4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 -- 172.21.15.151:0/3423756614 shutdown_connections 2023-07-21T22:24:49.925 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 1 -- 172.21.15.151:0/3423756614 wait complete. 2023-07-21T22:24:49.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.874+0000 7fdb6de45b80 20 client.16653 trim_cache size 0 max 16384 2023-07-21T22:24:49.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.901+0000 7fdb6de45b80 1 Processor -- start 2023-07-21T22:24:49.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.902+0000 7fdb6de45b80 1 -- start start 2023-07-21T22:24:49.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.902+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c39b0 0x5635b55c3250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.902+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8230 0x5635b55d4600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.902+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55cf820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.902+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b546e570 con 0x5635b55c8b40 2023-07-21T22:24:49.948 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.902+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b55bfd20 con 0x5635b55c39b0 2023-07-21T22:24:49.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.902+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b55ce4e0 con 0x5635b55c8230 2023-07-21T22:24:49.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb58b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55cf820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb53fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c39b0 0x5635b55c3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb53fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c39b0 0x5635b55c3250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44350/0 (socket says 172.21.15.151:44350) 2023-07-21T22:24:49.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb53fff700 1 -- 172.21.15.151:0/1603930066 learned_addr learned my addr 172.21.15.151:0/1603930066 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:49.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb537fe700 1 --2- 172.21.15.151:0/1603930066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8230 0x5635b55d4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb53fff700 1 -- 172.21.15.151:0/1603930066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8230 msgr2=0x5635b55d4600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:49.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb53fff700 1 --2- 172.21.15.151:0/1603930066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8230 0x5635b55d4600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb53fff700 1 -- 172.21.15.151:0/1603930066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 msgr2=0x5635b55cf820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:49.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb53fff700 1 --2- 172.21.15.151:0/1603930066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55cf820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb53fff700 1 -- 172.21.15.151:0/1603930066 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5635b53692d0 con 0x5635b55c39b0 2023-07-21T22:24:49.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.903+0000 7fdb53fff700 1 --2- 172.21.15.151:0/1603930066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c39b0 0x5635b55c3250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb4401b570 tx=0x7fdb44010b30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=204536ee3f1e4f32 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:49.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.904+0000 7fdb3affd700 1 -- 172.21.15.151:0/1603930066 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb44020040 con 0x5635b55c39b0 2023-07-21T22:24:49.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.904+0000 7fdb3affd700 1 -- 172.21.15.151:0/1603930066 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb4400bec0 con 0x5635b55c39b0 2023-07-21T22:24:49.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.904+0000 7fdb3affd700 1 -- 172.21.15.151:0/1603930066 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb440038e0 con 0x5635b55c39b0 2023-07-21T22:24:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.904+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1603930066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c39b0 msgr2=0x5635b55c3250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:49.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.904+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/1603930066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c39b0 0x5635b55c3250 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fdb4401b570 tx=0x7fdb44010b30 comp rx=0 tx=0).stop 2023-07-21T22:24:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.905+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1603930066 shutdown_connections 2023-07-21T22:24:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.905+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/1603930066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c39b0 0x5635b55c3250 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.905+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/1603930066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c8b40 0x5635b55cf820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.905+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/1603930066 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8230 0x5635b55d4600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.905+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1603930066 >> 172.21.15.151:0/1603930066 conn(0x5635b55b8f70 msgr2=0x5635b55c6d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.905+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1603930066 shutdown_connections 2023-07-21T22:24:49.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.905+0000 7fdb6de45b80 1 -- 172.21.15.151:0/1603930066 wait complete. 2023-07-21T22:24:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.905+0000 7fdb6de45b80 1 -- start start 2023-07-21T22:24:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb6de45b80 1 Processor -- start 2023-07-21T22:24:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b562a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b562ab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb6de45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 0x5635b55d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b55d3b40 con 0x5635b55c39b0 2023-07-21T22:24:49.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b55d3cb0 con 0x5635b55c8230 2023-07-21T22:24:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb6de45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5635b55d3e70 con 0x5635b55c8b40 2023-07-21T22:24:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb6de45b80 10 client.0 _ll_register_callbacks cb 0x7fdb4c009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb53fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b562a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb537fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b562ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb53fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b562a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54314/0 (socket says 172.21.15.151:54314) 2023-07-21T22:24:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.906+0000 7fdb53fff700 1 -- 172.21.15.151:0/2214946728 learned_addr learned my addr 172.21.15.151:0/2214946728 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.907+0000 7fdb58b9c700 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 0x5635b55d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.907+0000 7fdb537fe700 1 -- 172.21.15.151:0/2214946728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 msgr2=0x5635b55d3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:49.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.907+0000 7fdb537fe700 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 0x5635b55d3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.907+0000 7fdb537fe700 1 -- 172.21.15.151:0/2214946728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 msgr2=0x5635b562a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:49.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.907+0000 7fdb537fe700 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b562a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.907+0000 7fdb537fe700 1 -- 172.21.15.151:0/2214946728 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5635b532bce0 con 0x5635b55c8230 2023-07-21T22:24:49.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.907+0000 7fdb537fe700 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b562ab80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb480c9ec0 tx=0x7fdb48084040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=596a207ba74e3a29 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:49.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.907+0000 7fdb337fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:24:49.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.907+0000 7fdb337fe700 1 -- 172.21.15.151:0/2214946728 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb48099840 con 0x5635b55c8230 2023-07-21T22:24:49.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb6de45b80 1 -- 172.21.15.151:0/2214946728 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5635b54d00d0 con 0x5635b55c8230 2023-07-21T22:24:49.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb337fe700 1 -- 172.21.15.151:0/2214946728 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdb4809d870 con 0x5635b55c8230 2023-07-21T22:24:49.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb337fe700 1 -- 172.21.15.151:0/2214946728 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb480a1c90 con 0x5635b55c8230 2023-07-21T22:24:49.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb6de45b80 10 client.26381 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb6de45b80 1 -- 172.21.15.151:0/2214946728 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x5635b5341330 con 0x5635b55c8230 2023-07-21T22:24:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb337fe700 1 -- 172.21.15.151:0/2214946728 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5635b54d00d0 con 0x5635b55c8230 2023-07-21T22:24:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb337fe700 1 -- 172.21.15.151:0/2214946728 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdb480b91b0 con 0x5635b55c8230 2023-07-21T22:24:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb6de45b80 10 client.26381 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb6de45b80 10 client.26381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb6de45b80 20 client.26381 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5635b5633620 0x5635b5635a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb6de45b80 4 client.26381 mds_command: new command op to 24599 tid=0[{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2023-07-21T22:24:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.908+0000 7fdb6de45b80 1 -- 172.21.15.151:0/2214946728 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) v1 -- 0x5635b5363ff0 con 0x5635b5633620 2023-07-21T22:24:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.909+0000 7fdb53fff700 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5635b5633620 0x5635b5635a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.909+0000 7fdb53fff700 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5635b5633620 0x5635b5635a30 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db854f1c2c07e567 server_cookie=e8a85c5367ed2b6c in_seq=0 out_seq=0 2023-07-21T22:24:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.909+0000 7fdb337fe700 10 client.26381 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.910+0000 7fdb337fe700 1 -- 172.21.15.151:0/2214946728 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+110 (crc 0 0 0) 0x5635b5363ff0 con 0x5635b5633620 2023-07-21T22:24:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.910+0000 7fdb337fe700 10 client.26381 handle_command_reply: tid=0 2023-07-21T22:24:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.910+0000 7fdb6de45b80 1 client.26381 shutdown 2023-07-21T22:24:49.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 -- 172.21.15.151:0/2214946728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 msgr2=0x5635b562ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:49.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b562ab80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdb480c9ec0 tx=0x7fdb48084040 comp rx=0 tx=0).stop 2023-07-21T22:24:49.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 -- 172.21.15.151:0/2214946728 shutdown_connections 2023-07-21T22:24:49.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5635b5633620 0x5635b5635a30 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5635b55c8b40 0x5635b55d3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5635b55c39b0 0x5635b562a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 --2- 172.21.15.151:0/2214946728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5635b55c8230 0x5635b562ab80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.961 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 -- 172.21.15.151:0/2214946728 >> 172.21.15.151:0/2214946728 conn(0x5635b55b8f70 msgr2=0x5635b55c30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:49.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb337fe700 0 client.26381 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:49.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 -- 172.21.15.151:0/2214946728 shutdown_connections 2023-07-21T22:24:49.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 1 -- 172.21.15.151:0/2214946728 wait complete. 2023-07-21T22:24:49.962 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.911+0000 7fdb6de45b80 20 client.26381 trim_cache size 0 max 16384 2023-07-21T22:24:49.962 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:24:49.962 INFO:teuthology.orchestra.run.smithi151.stdout: "return_code": 0, 2023-07-21T22:24:49.963 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_tag": "681033c0-60b1-441f-a8ed-502fd1bb9188", 2023-07-21T22:24:49.963 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": "asynchronous" 2023-07-21T22:24:49.963 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:24:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb3c0a12c0 msgr2=0x7fdb3c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb3c0a12c0 0x7fdb3c0a3770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdb4c009cd0 tx=0x7fdb4c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb541015b0 msgr2=0x7fdb54196220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb541015b0 0x7fdb54196220 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdb4800d980 tx=0x7fdb4800dc90 comp rx=0 tx=0).stop 2023-07-21T22:24:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2615485669 shutdown_connections 2023-07-21T22:24:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb3c0a12c0 0x7fdb3c0a3770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb54100ca0 0x7fdb54195ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb5410a070 0x7fdb541995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 --2- 172.21.15.151:0/2615485669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb541015b0 0x7fdb54196220 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:49.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2615485669 >> 172.21.15.151:0/2615485669 conn(0x7fdb540fa4b0 msgr2=0x7fdb5410c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:49.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2615485669 shutdown_connections 2023-07-21T22:24:49.965 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:49.912+0000 7fdb5a5ff700 1 -- 172.21.15.151:0/2615485669 wait complete. 2023-07-21T22:24:49.979 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:24:50.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.200+0000 7f72cf7ff700 1 -- 172.21.15.151:0/327158328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8105ae0 msgr2=0x7f72c8105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:50.246 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.200+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/327158328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8105ae0 0x7f72c8105eb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f72c4009990 tx=0x7f72c4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.200+0000 7f72cf7ff700 1 -- 172.21.15.151:0/327158328 shutdown_connections 2023-07-21T22:24:50.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.200+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/327158328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8105ae0 0x7f72c8105eb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.200+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/327158328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c8100480 0x7f72c810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.200+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/327158328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72c80ffad0 0x7f72c80fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.200+0000 7f72cf7ff700 1 -- 172.21.15.151:0/327158328 >> 172.21.15.151:0/327158328 conn(0x7f72c80fb5f0 msgr2=0x7f72c80fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:50.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.201+0000 7f72cf7ff700 1 -- 172.21.15.151:0/327158328 shutdown_connections 2023-07-21T22:24:50.247 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.201+0000 7f72cf7ff700 1 -- 172.21.15.151:0/327158328 wait complete. 2023-07-21T22:24:50.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.202+0000 7f72cf7ff700 1 Processor -- start 2023-07-21T22:24:50.248 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.202+0000 7f72cf7ff700 1 -- start start 2023-07-21T22:24:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cf7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c80ffad0 0x7f72c819da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cf7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8100480 0x7f72c819df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cf7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72c8105ae0 0x7f72c8197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.249 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cf7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8198160 con 0x7f72c8105ae0 2023-07-21T22:24:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cf7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c81982d0 con 0x7f72c8100480 2023-07-21T22:24:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cf7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c8198490 con 0x7f72c80ffad0 2023-07-21T22:24:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c80ffad0 0x7f72c819da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72ccd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8100480 0x7f72c819df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c80ffad0 0x7f72c819da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58886/0 (socket says 172.21.15.151:58886) 2023-07-21T22:24:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cdd9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72c8105ae0 0x7f72c8197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72cd59b700 1 -- 172.21.15.151:0/3024389068 learned_addr learned my addr 172.21.15.151:0/3024389068 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:50.250 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.203+0000 7f72ccd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8100480 0x7f72c819df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44390/0 (socket says 172.21.15.151:44390) 2023-07-21T22:24:50.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72ccd9a700 1 -- 172.21.15.151:0/3024389068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c80ffad0 msgr2=0x7f72c819da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:50.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72ccd9a700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c80ffad0 0x7f72c819da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72ccd9a700 1 -- 172.21.15.151:0/3024389068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72c8105ae0 msgr2=0x7f72c8197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:50.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72ccd9a700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72c8105ae0 0x7f72c8197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.251 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72ccd9a700 1 -- 172.21.15.151:0/3024389068 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c40095f0 con 0x7f72c8100480 2023-07-21T22:24:50.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72ccd9a700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8100480 0x7f72c819df70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72b800e9f0 tx=0x7f72b800ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:50.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72be7fc700 1 -- 172.21.15.151:0/3024389068 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b800c9c0 con 0x7f72c8100480 2023-07-21T22:24:50.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72cf7ff700 1 -- 172.21.15.151:0/3024389068 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72c8198770 con 0x7f72c8100480 2023-07-21T22:24:50.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72be7fc700 1 -- 172.21.15.151:0/3024389068 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72b8010430 con 0x7f72c8100480 2023-07-21T22:24:50.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72be7fc700 1 -- 172.21.15.151:0/3024389068 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8018680 con 0x7f72c8100480 2023-07-21T22:24:50.252 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.204+0000 7f72cf7ff700 1 -- 172.21.15.151:0/3024389068 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c81a4ad0 con 0x7f72c8100480 2023-07-21T22:24:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.209+0000 7f72be7fc700 1 -- 172.21.15.151:0/3024389068 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f72b80105a0 con 0x7f72c8100480 2023-07-21T22:24:50.254 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.209+0000 7f72e321db80 1 Processor -- start 2023-07-21T22:24:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.209+0000 7f72e321db80 1 -- start start 2023-07-21T22:24:50.255 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72e321db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 0x564f36325580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72e321db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36325ac0 0x564f36320350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72e321db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f36320da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72e321db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f36225cb0 con 0x564f36320930 2023-07-21T22:24:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72e321db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f36278a40 con 0x564f363251b0 2023-07-21T22:24:50.256 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72e321db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f36271ed0 con 0x564f36325ac0 2023-07-21T22:24:50.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36325ac0 0x564f36320350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72cdd9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 0x564f36325580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72ccd9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f36320da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36325ac0 0x564f36320350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58888/0 (socket says 172.21.15.151:58888) 2023-07-21T22:24:50.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72cd59b700 1 -- 172.21.15.151:0/1698546712 learned_addr learned my addr 172.21.15.151:0/1698546712 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:50.257 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.210+0000 7f72cdd9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 0x564f36325580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44404/0 (socket says 172.21.15.151:44404) 2023-07-21T22:24:50.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72cd59b700 1 -- 172.21.15.151:0/1698546712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 msgr2=0x564f36325580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:50.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72cd59b700 1 --2- 172.21.15.151:0/1698546712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 0x564f36325580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72cd59b700 1 -- 172.21.15.151:0/1698546712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 msgr2=0x564f36320da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:50.258 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72cd59b700 1 --2- 172.21.15.151:0/1698546712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f36320da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72cd59b700 1 -- 172.21.15.151:0/1698546712 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f3609fde0 con 0x564f36325ac0 2023-07-21T22:24:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72cd59b700 1 --2- 172.21.15.151:0/1698546712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36325ac0 0x564f36320350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f72c4005c90 tx=0x7f72c4005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf69234ec17b145 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72be7fc700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f72b40a12c0 0x7f72b40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72be7fc700 1 -- 172.21.15.151:0/3024389068 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f72b8014070 con 0x7f72c8100480 2023-07-21T22:24:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72b37fe700 1 -- 172.21.15.151:0/1698546712 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c401d070 con 0x564f36325ac0 2023-07-21T22:24:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.211+0000 7f72cdd9c700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f72b40a12c0 0x7f72b40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.259 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.212+0000 7f72b37fe700 1 -- 172.21.15.151:0/1698546712 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72c401e040 con 0x564f36325ac0 2023-07-21T22:24:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.212+0000 7f72b37fe700 1 -- 172.21.15.151:0/1698546712 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c4004860 con 0x564f36325ac0 2023-07-21T22:24:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.212+0000 7f72e321db80 1 -- 172.21.15.151:0/1698546712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36325ac0 msgr2=0x564f36320350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.212+0000 7f72e321db80 1 --2- 172.21.15.151:0/1698546712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36325ac0 0x564f36320350 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f72c4005c90 tx=0x7f72c4005040 comp rx=0 tx=0).stop 2023-07-21T22:24:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.212+0000 7f72cdd9c700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f72b40a12c0 0x7f72b40a3770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f72c00127f0 tx=0x7f72c000b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.213+0000 7f72e321db80 1 -- 172.21.15.151:0/1698546712 shutdown_connections 2023-07-21T22:24:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.213+0000 7f72e321db80 1 --2- 172.21.15.151:0/1698546712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 0x564f36325580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.213+0000 7f72e321db80 1 --2- 172.21.15.151:0/1698546712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f36320da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.260 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.213+0000 7f72e321db80 1 --2- 172.21.15.151:0/1698546712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36325ac0 0x564f36320350 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.261 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.213+0000 7f72e321db80 1 -- 172.21.15.151:0/1698546712 >> 172.21.15.151:0/1698546712 conn(0x564f36315ef0 msgr2=0x564f3631b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.213+0000 7f72e321db80 1 -- 172.21.15.151:0/1698546712 shutdown_connections 2023-07-21T22:24:50.262 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.213+0000 7f72e321db80 1 -- 172.21.15.151:0/1698546712 wait complete. 2023-07-21T22:24:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.213+0000 7f72e321db80 1 -- start start 2023-07-21T22:24:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.214+0000 7f72e321db80 1 Processor -- start 2023-07-21T22:24:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.214+0000 7f72e321db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f3632cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.214+0000 7f72e321db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f36329e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.214+0000 7f72e321db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36325ac0 0x564f3632a580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.214+0000 7f72e321db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f36211ac0 con 0x564f363251b0 2023-07-21T22:24:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.214+0000 7f72e321db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f362117c0 con 0x564f36325ac0 2023-07-21T22:24:50.263 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.214+0000 7f72e321db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f360f5920 con 0x564f36320930 2023-07-21T22:24:50.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.214+0000 7f72e321db80 10 client.0 _ll_register_callbacks cb 0x564f3620f760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:50.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f3632cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72cdd9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36325ac0 0x564f3632a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72cd59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f3632cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58898/0 (socket says 172.21.15.151:58898) 2023-07-21T22:24:50.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72cd59b700 1 -- 172.21.15.151:0/2780641408 learned_addr learned my addr 172.21.15.151:0/2780641408 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:50.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72cd59b700 1 -- 172.21.15.151:0/2780641408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36325ac0 msgr2=0x564f3632a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:50.264 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72ccd9a700 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f36329e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72cd59b700 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36325ac0 0x564f3632a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72cd59b700 1 -- 172.21.15.151:0/2780641408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 msgr2=0x564f36329e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72cd59b700 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f36329e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72cd59b700 1 -- 172.21.15.151:0/2780641408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c810d210 con 0x564f36320930 2023-07-21T22:24:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.215+0000 7f72ccd9a700 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f36329e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:24:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.216+0000 7f72cd59b700 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f3632cc30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f72c4005c00 tx=0x7f72c400bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=633b6a7b96aba83b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.216+0000 7f72b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:24:50.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.216+0000 7f72b0ff9700 1 -- 172.21.15.151:0/2780641408 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c401d030 con 0x564f36320930 2023-07-21T22:24:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.216+0000 7f72e321db80 1 -- 172.21.15.151:0/2780641408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564f361cb4f0 con 0x564f36320930 2023-07-21T22:24:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.216+0000 7f72b0ff9700 1 -- 172.21.15.151:0/2780641408 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f72c4004710 con 0x564f36320930 2023-07-21T22:24:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72b0ff9700 1 -- 172.21.15.151:0/2780641408 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72c40048d0 con 0x564f36320930 2023-07-21T22:24:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72e321db80 10 client.26428 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72e321db80 1 -- 172.21.15.151:0/2780641408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564f36088c60 con 0x564f36320930 2023-07-21T22:24:50.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72b0ff9700 1 -- 172.21.15.151:0/2780641408 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x564f361cb4f0 con 0x564f36320930 2023-07-21T22:24:50.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72b0ff9700 1 -- 172.21.15.151:0/2780641408 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f72c400f9a0 con 0x564f36320930 2023-07-21T22:24:50.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72e321db80 10 client.26428 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:50.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72e321db80 10 client.26428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:50.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72e321db80 20 client.26428 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:50.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72e321db80 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564f36339fa0 0x564f3633c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72e321db80 4 client.26428 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:50.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.217+0000 7f72e321db80 1 -- 172.21.15.151:0/2780641408 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564f3626aeb0 con 0x564f36339fa0 2023-07-21T22:24:50.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.218+0000 7f72ccd9a700 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564f36339fa0 0x564f3633c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.218+0000 7f72ccd9a700 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564f36339fa0 0x564f3633c3b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc6e6cd5799f84b0 server_cookie=282d3394be7692ef in_seq=0 out_seq=0 2023-07-21T22:24:50.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.218+0000 7f72b0ff9700 10 client.26428 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:50.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.219+0000 7f72b0ff9700 1 -- 172.21.15.151:0/2780641408 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564f3626aeb0 con 0x564f36339fa0 2023-07-21T22:24:50.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.219+0000 7f72b0ff9700 10 client.26428 handle_command_reply: tid=0 2023-07-21T22:24:50.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.219+0000 7f72e321db80 1 client.26428 shutdown 2023-07-21T22:24:50.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.219+0000 7f72e321db80 1 -- 172.21.15.151:0/2780641408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 msgr2=0x564f3632cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:50.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.219+0000 7f72e321db80 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f3632cc30 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f72c4005c00 tx=0x7f72c400bdb0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72e321db80 1 -- 172.21.15.151:0/2780641408 shutdown_connections 2023-07-21T22:24:50.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72e321db80 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564f36339fa0 0x564f3633c3b0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72e321db80 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36325ac0 0x564f3632a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72e321db80 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f3632cc30 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72e321db80 1 --2- 172.21.15.151:0/2780641408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f36329e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72b0ff9700 0 client.26428 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:50.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72e321db80 1 -- 172.21.15.151:0/2780641408 >> 172.21.15.151:0/2780641408 conn(0x564f36315ef0 msgr2=0x564f3631b420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:50.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72e321db80 1 -- 172.21.15.151:0/2780641408 shutdown_connections 2023-07-21T22:24:50.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72e321db80 1 -- 172.21.15.151:0/2780641408 wait complete. 2023-07-21T22:24:50.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.220+0000 7f72e321db80 20 client.26428 trim_cache size 0 max 16384 2023-07-21T22:24:50.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.243+0000 7f72e321db80 1 Processor -- start 2023-07-21T22:24:50.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.243+0000 7f72e321db80 1 -- start start 2023-07-21T22:24:50.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72e321db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36315ef0 0x564f3632c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72e321db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f363296e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72e321db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 0x564f36329c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72e321db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f363216f0 con 0x564f36320930 2023-07-21T22:24:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72e321db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f36318010 con 0x564f363251b0 2023-07-21T22:24:50.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72e321db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3632ab80 con 0x564f36315ef0 2023-07-21T22:24:50.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72ccd9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f363296e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72ccd9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f363296e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54356/0 (socket says 172.21.15.151:54356) 2023-07-21T22:24:50.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72ccd9a700 1 -- 172.21.15.151:0/1003001382 learned_addr learned my addr 172.21.15.151:0/1003001382 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:50.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72cdd9c700 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 0x564f36329c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.244+0000 7f72cd59b700 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36315ef0 0x564f3632c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72cd59b700 1 -- 172.21.15.151:0/1003001382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 msgr2=0x564f36329c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72cd59b700 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 0x564f36329c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72cd59b700 1 -- 172.21.15.151:0/1003001382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 msgr2=0x564f363296e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72cd59b700 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f363296e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72cd59b700 1 -- 172.21.15.151:0/1003001382 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564f360c6250 con 0x564f36315ef0 2023-07-21T22:24:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72ccd9a700 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f363296e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:50.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72cd59b700 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36315ef0 0x564f3632c760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72c400fdb0 tx=0x7f72c402a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbc8ce1989867446 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:50.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72b3fff700 1 -- 172.21.15.151:0/1003001382 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c401d040 con 0x564f36315ef0 2023-07-21T22:24:50.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72b3fff700 1 -- 172.21.15.151:0/1003001382 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72c400bed0 con 0x564f36315ef0 2023-07-21T22:24:50.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.245+0000 7f72b3fff700 1 -- 172.21.15.151:0/1003001382 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c402cac0 con 0x564f36315ef0 2023-07-21T22:24:50.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.246+0000 7f72e321db80 1 -- 172.21.15.151:0/1003001382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36315ef0 msgr2=0x564f3632c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:50.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.246+0000 7f72e321db80 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36315ef0 0x564f3632c760 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f72c400fdb0 tx=0x7f72c402a430 comp rx=0 tx=0).stop 2023-07-21T22:24:50.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.246+0000 7f72e321db80 1 -- 172.21.15.151:0/1003001382 shutdown_connections 2023-07-21T22:24:50.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.246+0000 7f72e321db80 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f363251b0 0x564f36329c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.246+0000 7f72e321db80 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36315ef0 0x564f3632c760 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.246+0000 7f72e321db80 1 --2- 172.21.15.151:0/1003001382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f36320930 0x564f363296e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.246+0000 7f72e321db80 1 -- 172.21.15.151:0/1003001382 >> 172.21.15.151:0/1003001382 conn(0x564f36321060 msgr2=0x564f3631ea60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:50.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.246+0000 7f72e321db80 1 -- 172.21.15.151:0/1003001382 shutdown_connections 2023-07-21T22:24:50.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.246+0000 7f72e321db80 1 -- 172.21.15.151:0/1003001382 wait complete. 2023-07-21T22:24:50.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.247+0000 7f72e321db80 1 -- start start 2023-07-21T22:24:50.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.247+0000 7f72e321db80 1 Processor -- start 2023-07-21T22:24:50.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.247+0000 7f72e321db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36315ef0 0x564f36330f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72e321db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f36331470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72e321db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f3632f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.296 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72e321db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3632fad0 con 0x564f363251b0 2023-07-21T22:24:50.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72e321db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3632fc40 con 0x564f36315ef0 2023-07-21T22:24:50.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72e321db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564f3632fe00 con 0x564f36320930 2023-07-21T22:24:50.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72e321db80 10 client.0 _ll_register_callbacks cb 0x7f72c0009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:50.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72cdd9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f3632f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72cdd9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f3632f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54364/0 (socket says 172.21.15.151:54364) 2023-07-21T22:24:50.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72cdd9c700 1 -- 172.21.15.151:0/3977398236 learned_addr learned my addr 172.21.15.151:0/3977398236 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:50.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72cd59b700 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36315ef0 0x564f36330f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72ccd9a700 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f36331470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72cdd9c700 1 -- 172.21.15.151:0/3977398236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 msgr2=0x564f36331470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:50.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72cdd9c700 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f36331470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72cdd9c700 1 -- 172.21.15.151:0/3977398236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36315ef0 msgr2=0x564f36330f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:50.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72cdd9c700 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36315ef0 0x564f36330f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.248+0000 7f72cdd9c700 1 -- 172.21.15.151:0/3977398236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c81a4ad0 con 0x564f363251b0 2023-07-21T22:24:50.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.249+0000 7f72cdd9c700 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f3632f500 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f72c0004050 tx=0x7f72c0004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808d5d17ff828058 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:50.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.249+0000 7f72b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:50.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.249+0000 7f72b0ff9700 1 -- 172.21.15.151:0/3977398236 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72c000e040 con 0x564f363251b0 2023-07-21T22:24:50.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.249+0000 7f72e321db80 1 -- 172.21.15.151:0/3977398236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f72c401e040 con 0x564f363251b0 2023-07-21T22:24:50.299 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.249+0000 7f72b0ff9700 1 -- 172.21.15.151:0/3977398236 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f72c00048a0 con 0x564f363251b0 2023-07-21T22:24:50.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.249+0000 7f72b0ff9700 1 -- 172.21.15.151:0/3977398236 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) v2 ==== 24+0+0 (secure 0 0 0) 0x7f72c0008920 con 0x564f363251b0 2023-07-21T22:24:50.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72e321db80 10 client.16674 fetch_fsmap learned FSMap version 33 2023-07-21T22:24:50.300 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72e321db80 1 -- 172.21.15.151:0/3977398236 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) v3 -- 0x564f36088c60 con 0x564f363251b0 2023-07-21T22:24:50.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72b0ff9700 1 -- 172.21.15.151:0/3977398236 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f72c401e040 con 0x564f363251b0 2023-07-21T22:24:50.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72b0ff9700 1 -- 172.21.15.151:0/3977398236 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f72c002eae0 con 0x564f363251b0 2023-07-21T22:24:50.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72e321db80 10 client.16674 fetch_fsmap finished waiting for FSMap version 33 2023-07-21T22:24:50.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72e321db80 10 client.16674 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:50.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72e321db80 20 client.16674 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:50.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72e321db80 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564f36325ac0 0x564f36391130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:50.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72e321db80 4 client.16674 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:24:50.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.250+0000 7f72e321db80 1 -- 172.21.15.151:0/3977398236 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x564f3622d050 con 0x564f36325ac0 2023-07-21T22:24:50.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.251+0000 7f72cd59b700 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564f36325ac0 0x564f36391130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:50.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.251+0000 7f72cd59b700 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564f36325ac0 0x564f36391130 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a442d70f2f618d04 server_cookie=3b333948d31faa20 in_seq=0 out_seq=0 2023-07-21T22:24:50.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.251+0000 7f72b0ff9700 10 client.16674 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:50.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.251+0000 7f72b0ff9700 1 -- 172.21.15.151:0/3977398236 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+259 (crc 0 0 0) 0x564f3622d050 con 0x564f36325ac0 2023-07-21T22:24:50.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.251+0000 7f72b0ff9700 10 client.16674 handle_command_reply: tid=0 2023-07-21T22:24:50.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.251+0000 7f72e321db80 1 client.16674 shutdown 2023-07-21T22:24:50.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 -- 172.21.15.151:0/3977398236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 msgr2=0x564f3632f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:50.302 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f3632f500 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f72c0004050 tx=0x7f72c0004b40 comp rx=0 tx=0).stop 2023-07-21T22:24:50.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 -- 172.21.15.151:0/3977398236 shutdown_connections 2023-07-21T22:24:50.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564f36325ac0 0x564f36391130 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564f36315ef0 0x564f36330f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f363251b0 0x564f3632f500 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72b0ff9700 0 client.16674 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:50.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 --2- 172.21.15.151:0/3977398236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564f36320930 0x564f36331470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 -- 172.21.15.151:0/3977398236 >> 172.21.15.151:0/3977398236 conn(0x564f36321060 msgr2=0x564f3631f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:50.303 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 -- 172.21.15.151:0/3977398236 shutdown_connections 2023-07-21T22:24:50.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 1 -- 172.21.15.151:0/3977398236 wait complete. 2023-07-21T22:24:50.304 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.252+0000 7f72e321db80 20 client.16674 trim_cache size 0 max 16384 2023-07-21T22:24:50.304 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:24:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "IDLE (waiting for more scrubs)", 2023-07-21T22:24:50.304 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": { 2023-07-21T22:24:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "681033c0-60b1-441f-a8ed-502fd1bb9188": { 2023-07-21T22:24:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/", 2023-07-21T22:24:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "tag": "681033c0-60b1-441f-a8ed-502fd1bb9188", 2023-07-21T22:24:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: "options": "recursive,force" 2023-07-21T22:24:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:24:50.305 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:24:50.305 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:24:50.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 -- 172.21.15.151:0/3024389068 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f72b40a12c0 msgr2=0x7f72b40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:50.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f72b40a12c0 0x7f72b40a3770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f72c00127f0 tx=0x7f72c000b040 comp rx=0 tx=0).stop 2023-07-21T22:24:50.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 -- 172.21.15.151:0/3024389068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8100480 msgr2=0x7f72c819df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:50.306 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8100480 0x7f72c819df70 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f72b800e9f0 tx=0x7f72b800ed00 comp rx=0 tx=0).stop 2023-07-21T22:24:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 -- 172.21.15.151:0/3024389068 shutdown_connections 2023-07-21T22:24:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f72b40a12c0 0x7f72b40a3770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72c8105ae0 0x7f72c8197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f72c80ffad0 0x7f72c819da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 --2- 172.21.15.151:0/3024389068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c8100480 0x7f72c819df70 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 -- 172.21.15.151:0/3024389068 >> 172.21.15.151:0/3024389068 conn(0x7f72c80fb5f0 msgr2=0x7f72c810ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 -- 172.21.15.151:0/3024389068 shutdown_connections 2023-07-21T22:24:50.307 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:24:50.253+0000 7f72cf7ff700 1 -- 172.21.15.151:0/3024389068 wait complete. 2023-07-21T22:24:50.318 INFO:tasks.cephfs.filesystem:scrub status for tag:681033c0-60b1-441f-a8ed-502fd1bb9188 - {'path': '/', 'tag': '681033c0-60b1-441f-a8ed-502fd1bb9188', 'options': 'recursive,force'} 2023-07-21T22:24:50.361 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 22:24:49 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-h[122065]: 2023-07-21T22:24:49.924+0000 7f7f0b0ca700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a8 [...7,head] /volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/000000010000000000000083 auth v3144 ap=1 snaprealm=0x555f6312f200 s=16777216 n(v0 rc2023-07-21T22:24:20.452599+0000 b16777216 1=1+0) old_inodes=2 (iversion lock) caps={15324=pAsLsXsFsc/-@1},l=15324(-1) | ptrwaiter=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x555f62f48b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a8:[<0x10000000007/000000010000000000000083 v3114>,<0x10000000006/pg_wal v3781>,<0x10000000005/data v983>,<0x10000000003/postgres v391>,<0x10000000002/89be92e1-be58-42e3-be68-399c1317a935 v409>,<0x10000000001/sv_0 v425>,<0x10000000000/_nogroup v415>,<0x1/volumes v409>]//[]","memoryvalue":"(3)0x100000003a8:[<0x10000000007/000000010000000000000083 v3144>,<0x10000000006/pg_wal v3996>,<0x10000000005/data v1127>,<0x10000000003/postgres v429>,<0x10000000002/89be92e1-be58-42e3-be68-399c1317a935 v448>,<0x10000000001/sv_0 v455>,<0x10000000000/_nogroup v395>,<0x1/volumes v443>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-07-21T22:24:50.361 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 22:24:49 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-h[122065]: 2023-07-21T22:24:49.924+0000 7f7f0b0ca700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [...6,head] /volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/00000001000000000000006A auth v3016 ap=1 snaprealm=0x555f62f93200 s=16777216 n(v0 rc2023-07-21T22:23:30.486229+0000 b16777216 1=1+0) old_inodes=1 (iversion lock) caps={15324=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x555f62da8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c5:[<0x10000000007/00000001000000000000006A v3016>,<0x10000000006/pg_wal v3781>,<0x10000000005/data v983>,<0x10000000003/postgres v391>,<0x10000000002/89be92e1-be58-42e3-be68-399c1317a935 v409>,<0x10000000001/sv_0 v425>,<0x10000000000/_nogroup v415>,<0x1/volumes v409>]//[]","memoryvalue":"(3)0x100000003c5:[<0x10000000007/00000001000000000000006A v3016>,<0x10000000006/pg_wal v3996>,<0x10000000005/data v1127>,<0x10000000003/postgres v429>,<0x10000000002/89be92e1-be58-42e3-be68-399c1317a935 v448>,<0x10000000001/sv_0 v455>,<0x10000000000/_nogroup v395>,<0x1/volumes v443>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2023-07-21T22:24:50.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:50 smithi187 ceph-mon[96918]: pgmap v172: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:24:50.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:50 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:24:50.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:50 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:50.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:50 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:24:50.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:50 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:24:50.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:50 smithi187 ceph-mon[96918]: Scrub error on inode 0x100000003a8 (/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/000000010000000000000083) see mds.h log and `damage ls` output for details 2023-07-21T22:24:50.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:50 smithi187 ceph-mon[96918]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/00000001000000000000006A) see mds.h log and `damage ls` output for details 2023-07-21T22:24:50.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:50 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:50.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:50 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:50.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:50 smithi195 ceph-mon[97365]: pgmap v172: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:24:50.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:50 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:24:50.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:50 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:50.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:50 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:24:50.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:50 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:24:50.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:50 smithi195 ceph-mon[97365]: Scrub error on inode 0x100000003a8 (/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/000000010000000000000083) see mds.h log and `damage ls` output for details 2023-07-21T22:24:50.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:50 smithi195 ceph-mon[97365]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/00000001000000000000006A) see mds.h log and `damage ls` output for details 2023-07-21T22:24:50.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:50 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:50.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:50 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:50.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:50 smithi151 ceph-mon[95510]: pgmap v172: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:24:50.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:50 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:24:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:50 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:50 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:24:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:50 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:24:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:50 smithi151 ceph-mon[95510]: Scrub error on inode 0x100000003a8 (/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/000000010000000000000083) see mds.h log and `damage ls` output for details 2023-07-21T22:24:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:50 smithi151 ceph-mon[95510]: Scrub error on inode 0x100000003c5 (/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/00000001000000000000006A) see mds.h log and `damage ls` output for details 2023-07-21T22:24:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:50 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:50 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:50.934 INFO:teuthology.orchestra.run.smithi151.stderr:22800000 of 50000000 tuples (45%) done (elapsed 314.43 s, remaining 375.10 s) 2023-07-21T22:24:51.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:51 smithi187 ceph-mon[96918]: scrub queued for path: / 2023-07-21T22:24:51.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:51 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:51.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:51 smithi187 ceph-mon[96918]: scrub summary: active paths [/] 2023-07-21T22:24:51.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:51 smithi187 ceph-mon[96918]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:51.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:51 smithi195 ceph-mon[97365]: scrub queued for path: / 2023-07-21T22:24:51.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:51 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:51.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:51 smithi195 ceph-mon[97365]: scrub summary: active paths [/] 2023-07-21T22:24:51.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:51 smithi195 ceph-mon[97365]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:51.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:51 smithi151 ceph-mon[95510]: scrub queued for path: / 2023-07-21T22:24:51.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:51 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:51.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:51 smithi151 ceph-mon[95510]: scrub summary: active paths [/] 2023-07-21T22:24:51.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:51 smithi151 ceph-mon[95510]: scrub summary: idle+waiting paths [/] 2023-07-21T22:24:52.222 INFO:teuthology.orchestra.run.smithi151.stderr:22900000 of 50000000 tuples (45%) done (elapsed 315.71 s, remaining 373.62 s) 2023-07-21T22:24:52.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:52 smithi187 ceph-mon[96918]: pgmap v173: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:24:52.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:52 smithi195 ceph-mon[97365]: pgmap v173: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:24:52.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:52 smithi151 ceph-mon[95510]: pgmap v173: 97 pgs: 97 active+clean; 5.2 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:24:53.413 INFO:teuthology.orchestra.run.smithi151.stderr:23000000 of 50000000 tuples (46%) done (elapsed 316.90 s, remaining 372.02 s) 2023-07-21T22:24:54.628 INFO:teuthology.orchestra.run.smithi151.stderr:23100000 of 50000000 tuples (46%) done (elapsed 318.12 s, remaining 370.45 s) 2023-07-21T22:24:54.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:54 smithi187 ceph-mon[96918]: pgmap v174: 97 pgs: 97 active+clean; 5.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 35 MiB/s wr, 171 op/s 2023-07-21T22:24:54.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:54 smithi195 ceph-mon[97365]: pgmap v174: 97 pgs: 97 active+clean; 5.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 35 MiB/s wr, 171 op/s 2023-07-21T22:24:54.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:54 smithi151 ceph-mon[95510]: pgmap v174: 97 pgs: 97 active+clean; 5.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 216 KiB/s rd, 35 MiB/s wr, 171 op/s 2023-07-21T22:24:54.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:54 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T22:24:54.326+0000 7f5662017700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-07-21T22:24:55.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:55 smithi187 ceph-mon[96918]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-07-21T22:24:55.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:55 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] up:active 2023-07-21T22:24:55.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:55 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:24:55.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:55 smithi195 ceph-mon[97365]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-07-21T22:24:55.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:55 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] up:active 2023-07-21T22:24:55.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:55 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:24:55.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:55 smithi151 ceph-mon[95510]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2023-07-21T22:24:55.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:55 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] up:active 2023-07-21T22:24:55.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:55 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:24:55.848 INFO:teuthology.orchestra.run.smithi151.stderr:23200000 of 50000000 tuples (46%) done (elapsed 319.34 s, remaining 368.89 s) 2023-07-21T22:24:56.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:56 smithi195 ceph-mon[97365]: pgmap v175: 97 pgs: 97 active+clean; 5.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 23 MiB/s wr, 155 op/s 2023-07-21T22:24:56.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:56 smithi151 ceph-mon[95510]: pgmap v175: 97 pgs: 97 active+clean; 5.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 23 MiB/s wr, 155 op/s 2023-07-21T22:24:56.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:56 smithi187 ceph-mon[96918]: pgmap v175: 97 pgs: 97 active+clean; 5.3 GiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 169 KiB/s rd, 23 MiB/s wr, 155 op/s 2023-07-21T22:24:57.161 INFO:teuthology.orchestra.run.smithi151.stderr:23300000 of 50000000 tuples (46%) done (elapsed 320.65 s, remaining 367.44 s) 2023-07-21T22:24:58.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.074+0000 7f05463ff700 1 -- 172.21.15.151:0/2125212759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0540106ff0 msgr2=0x7f054010ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.074+0000 7f05463ff700 1 --2- 172.21.15.151:0/2125212759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0540106ff0 0x7f054010ebc0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f053800b0d0 tx=0x7f053800b3e0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.074+0000 7f05463ff700 1 -- 172.21.15.151:0/2125212759 shutdown_connections 2023-07-21T22:24:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.074+0000 7f05463ff700 1 --2- 172.21.15.151:0/2125212759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0540101fb0 0x7f0540102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.074+0000 7f05463ff700 1 --2- 172.21.15.151:0/2125212759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0540106ff0 0x7f054010ebc0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.074+0000 7f05463ff700 1 --2- 172.21.15.151:0/2125212759 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0540102950 0x7f0540106910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.074+0000 7f05463ff700 1 -- 172.21.15.151:0/2125212759 >> 172.21.15.151:0/2125212759 conn(0x7f05400fd800 msgr2=0x7f05400ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:58.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.074+0000 7f05463ff700 1 -- 172.21.15.151:0/2125212759 shutdown_connections 2023-07-21T22:24:58.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.074+0000 7f05463ff700 1 -- 172.21.15.151:0/2125212759 wait complete. 2023-07-21T22:24:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.075+0000 7f05463ff700 1 Processor -- start 2023-07-21T22:24:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.075+0000 7f05463ff700 1 -- start start 2023-07-21T22:24:58.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f05463ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0540101fb0 0x7f0540197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f05463ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0540102950 0x7f0540198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f05463ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0540106ff0 0x7f054019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f05463ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054019d040 con 0x7f0540106ff0 2023-07-21T22:24:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f05463ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054019d1b0 con 0x7f0540102950 2023-07-21T22:24:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f05463ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f054019d370 con 0x7f0540101fb0 2023-07-21T22:24:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f054499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0540106ff0 0x7f054019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f053ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0540101fb0 0x7f0540197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f053ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0540101fb0 0x7f0540197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35290/0 (socket says 172.21.15.151:35290) 2023-07-21T22:24:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f053ffff700 1 -- 172.21.15.151:0/4216709929 learned_addr learned my addr 172.21.15.151:0/4216709929 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.076+0000 7f053f7fe700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0540102950 0x7f0540198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f054499c700 1 -- 172.21.15.151:0/4216709929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0540101fb0 msgr2=0x7f0540197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f054499c700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0540101fb0 0x7f0540197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f054499c700 1 -- 172.21.15.151:0/4216709929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0540102950 msgr2=0x7f0540198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f054499c700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0540102950 0x7f0540198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f054499c700 1 -- 172.21.15.151:0/4216709929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0538009d00 con 0x7f0540106ff0 2023-07-21T22:24:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f053f7fe700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0540102950 0x7f0540198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f054499c700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0540106ff0 0x7f054019ca00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0538009fd0 tx=0x7f0538007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f053d7fa700 1 -- 172.21.15.151:0/4216709929 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053800e040 con 0x7f0540106ff0 2023-07-21T22:24:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f053d7fa700 1 -- 172.21.15.151:0/4216709929 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f053800ce80 con 0x7f0540106ff0 2023-07-21T22:24:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f05463ff700 1 -- 172.21.15.151:0/4216709929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f054019d5f0 con 0x7f0540106ff0 2023-07-21T22:24:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f053d7fa700 1 -- 172.21.15.151:0/4216709929 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053801b450 con 0x7f0540106ff0 2023-07-21T22:24:58.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.077+0000 7f05463ff700 1 -- 172.21.15.151:0/4216709929 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05401a4e90 con 0x7f0540106ff0 2023-07-21T22:24:58.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.082+0000 7f053d7fa700 1 -- 172.21.15.151:0/4216709929 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f053801d480 con 0x7f0540106ff0 2023-07-21T22:24:58.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.083+0000 7f0559cb9b80 1 Processor -- start 2023-07-21T22:24:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.083+0000 7f0559cb9b80 1 -- start start 2023-07-21T22:24:58.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f053d7fa700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05280a12c0 0x7f05280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2a6e6b0 0x55eda2c17cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18210 0x55eda2c11f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c124a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2b17c50 con 0x55eda2c18660 2023-07-21T22:24:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2b6a9e0 con 0x55eda2a6e6b0 2023-07-21T22:24:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2b63e70 con 0x55eda2c18210 2023-07-21T22:24:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f053d7fa700 1 -- 172.21.15.151:0/4216709929 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f05380ce550 con 0x7f0540106ff0 2023-07-21T22:24:58.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f053f7fe700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05280a12c0 0x7f05280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f054499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c124a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f053ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2a6e6b0 0x55eda2c17cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f053ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2a6e6b0 0x55eda2c17cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55868/0 (socket says 172.21.15.151:55868) 2023-07-21T22:24:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f053ffff700 1 -- 172.21.15.151:0/1430261525 learned_addr learned my addr 172.21.15.151:0/1430261525 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.084+0000 7f053f7fe700 1 --2- 172.21.15.151:0/1430261525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18210 0x55eda2c11f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.085+0000 7f053ffff700 1 -- 172.21.15.151:0/1430261525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18210 msgr2=0x55eda2c11f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:58.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.085+0000 7f053ffff700 1 --2- 172.21.15.151:0/1430261525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18210 0x55eda2c11f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.085+0000 7f053ffff700 1 -- 172.21.15.151:0/1430261525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 msgr2=0x55eda2c124a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:58.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.085+0000 7f053ffff700 1 --2- 172.21.15.151:0/1430261525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c124a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.085+0000 7f053ffff700 1 -- 172.21.15.151:0/1430261525 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eda2991d80 con 0x55eda2a6e6b0 2023-07-21T22:24:58.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.085+0000 7f054499c700 1 --2- 172.21.15.151:0/1430261525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:24:58.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.085+0000 7f053f7fe700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05280a12c0 0x7f05280a3770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0540199670 tx=0x7f0534012840 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:58.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.085+0000 7f053ffff700 1 --2- 172.21.15.151:0/1430261525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2a6e6b0 0x55eda2c17cd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0530009e50 tx=0x7f0530011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b857ac1126677bd7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.085+0000 7f05267fc700 1 -- 172.21.15.151:0/1430261525 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530019630 con 0x55eda2a6e6b0 2023-07-21T22:24:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.086+0000 7f05267fc700 1 -- 172.21.15.151:0/1430261525 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0530019c20 con 0x55eda2a6e6b0 2023-07-21T22:24:58.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.086+0000 7f05267fc700 1 -- 172.21.15.151:0/1430261525 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053000eb60 con 0x55eda2a6e6b0 2023-07-21T22:24:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.086+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1430261525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2a6e6b0 msgr2=0x55eda2c17cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.086+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/1430261525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2a6e6b0 0x55eda2c17cd0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0530009e50 tx=0x7f0530011720 comp rx=0 tx=0).stop 2023-07-21T22:24:58.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.087+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1430261525 shutdown_connections 2023-07-21T22:24:58.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.087+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/1430261525 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2a6e6b0 0x55eda2c17cd0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.087+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/1430261525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c124a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.087+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/1430261525 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18210 0x55eda2c11f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.087+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1430261525 >> 172.21.15.151:0/1430261525 conn(0x55eda2c07ae0 msgr2=0x55eda2c0d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.087+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1430261525 shutdown_connections 2023-07-21T22:24:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.087+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1430261525 wait complete. 2023-07-21T22:24:58.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.087+0000 7f0559cb9b80 1 -- start start 2023-07-21T22:24:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.088+0000 7f0559cb9b80 1 Processor -- start 2023-07-21T22:24:58.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.088+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.088+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18210 0x55eda2c1b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.088+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18660 0x55eda2c1bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.088+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2b03a60 con 0x55eda2c18210 2023-07-21T22:24:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.088+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2b03760 con 0x55eda2c18660 2023-07-21T22:24:58.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.088+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda29e78c0 con 0x55eda2a6e6b0 2023-07-21T22:24:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.088+0000 7f0559cb9b80 10 client.0 _ll_register_callbacks cb 0x55eda2b01700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f053ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f053ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35306/0 (socket says 172.21.15.151:35306) 2023-07-21T22:24:58.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f053ffff700 1 -- 172.21.15.151:0/3431497165 learned_addr learned my addr 172.21.15.151:0/3431497165 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f053f7fe700 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18210 0x55eda2c1b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f054499c700 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18660 0x55eda2c1bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f053ffff700 1 -- 172.21.15.151:0/3431497165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18660 msgr2=0x55eda2c1bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:58.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f053ffff700 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18660 0x55eda2c1bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f053ffff700 1 -- 172.21.15.151:0/3431497165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18210 msgr2=0x55eda2c1b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:58.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f053ffff700 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18210 0x55eda2c1b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.089+0000 7f053ffff700 1 -- 172.21.15.151:0/3431497165 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05401a4e90 con 0x55eda2a6e6b0 2023-07-21T22:24:58.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.090+0000 7f053ffff700 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1e5e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05300046e0 tx=0x7f0530019ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=77e6cc9ec36e4632 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:58.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.090+0000 7f051f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:24:58.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.091+0000 7f051f7fe700 1 -- 172.21.15.151:0/3431497165 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530005450 con 0x55eda2a6e6b0 2023-07-21T22:24:58.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.091+0000 7f0559cb9b80 1 -- 172.21.15.151:0/3431497165 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55eda2abd490 con 0x55eda2a6e6b0 2023-07-21T22:24:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.091+0000 7f051f7fe700 1 -- 172.21.15.151:0/3431497165 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0530005ce0 con 0x55eda2a6e6b0 2023-07-21T22:24:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.091+0000 7f051f7fe700 1 -- 172.21.15.151:0/3431497165 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05300055b0 con 0x55eda2a6e6b0 2023-07-21T22:24:58.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.091+0000 7f0559cb9b80 10 client.26446 fetch_fsmap learned FSMap version 34 2023-07-21T22:24:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.091+0000 7f0559cb9b80 1 -- 172.21.15.151:0/3431497165 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f0530009a80 con 0x55eda2a6e6b0 2023-07-21T22:24:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.092+0000 7f051f7fe700 1 -- 172.21.15.151:0/3431497165 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55eda2abd490 con 0x55eda2a6e6b0 2023-07-21T22:24:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.092+0000 7f051f7fe700 1 -- 172.21.15.151:0/3431497165 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0530028020 con 0x55eda2a6e6b0 2023-07-21T22:24:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.092+0000 7f0559cb9b80 10 client.26446 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:24:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.092+0000 7f0559cb9b80 10 client.26446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.092+0000 7f0559cb9b80 20 client.26446 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.092+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55eda2c2ba30 0x55eda2c2de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.092+0000 7f0559cb9b80 4 client.26446 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:24:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.092+0000 7f0559cb9b80 1 -- 172.21.15.151:0/3431497165 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55eda2b5ce50 con 0x55eda2c2ba30 2023-07-21T22:24:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.093+0000 7f053f7fe700 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55eda2c2ba30 0x55eda2c2de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.094+0000 7f051f7fe700 10 client.26446 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.094+0000 7f053f7fe700 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55eda2c2ba30 0x55eda2c2de40 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c407f947bee0febc server_cookie=b98aa5d994f508e1 in_seq=0 out_seq=0 2023-07-21T22:24:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f051f7fe700 1 -- 172.21.15.151:0/3431497165 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55eda2b5ce50 con 0x55eda2c2ba30 2023-07-21T22:24:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f051f7fe700 10 client.26446 handle_command_reply: tid=0 2023-07-21T22:24:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f0559cb9b80 1 client.26446 shutdown 2023-07-21T22:24:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f0559cb9b80 1 -- 172.21.15.151:0/3431497165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 msgr2=0x55eda2c1e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1e5e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f05300046e0 tx=0x7f0530019ab0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f0559cb9b80 1 -- 172.21.15.151:0/3431497165 shutdown_connections 2023-07-21T22:24:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55eda2c2ba30 0x55eda2c2de40 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18660 0x55eda2c1bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1e5e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/3431497165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18210 0x55eda2c1b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f0559cb9b80 1 -- 172.21.15.151:0/3431497165 >> 172.21.15.151:0/3431497165 conn(0x55eda2c07ae0 msgr2=0x55eda2c0c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.095+0000 7f051f7fe700 0 client.26446 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:58.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.096+0000 7f0559cb9b80 1 -- 172.21.15.151:0/3431497165 shutdown_connections 2023-07-21T22:24:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.096+0000 7f0559cb9b80 1 -- 172.21.15.151:0/3431497165 wait complete. 2023-07-21T22:24:58.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.096+0000 7f0559cb9b80 20 client.26446 trim_cache size 0 max 16384 2023-07-21T22:24:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.118+0000 7f0559cb9b80 1 Processor -- start 2023-07-21T22:24:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.118+0000 7f0559cb9b80 1 -- start start 2023-07-21T22:24:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.118+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.118+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 0x55eda2c11f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.118+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c22ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.118+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2c1ce10 con 0x55eda2c18660 2023-07-21T22:24:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.118+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2c12480 con 0x55eda2c18210 2023-07-21T22:24:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.118+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2c178c0 con 0x55eda2a6e6b0 2023-07-21T22:24:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.118+0000 7f054499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c22ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f054499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c22ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38046/0 (socket says 172.21.15.151:38046) 2023-07-21T22:24:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f054499c700 1 -- 172.21.15.151:0/1941119566 learned_addr learned my addr 172.21.15.151:0/1941119566 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f053ffff700 1 --2- 172.21.15.151:0/1941119566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f053f7fe700 1 --2- 172.21.15.151:0/1941119566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 0x55eda2c11f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f054499c700 1 -- 172.21.15.151:0/1941119566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 msgr2=0x55eda2c1b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f054499c700 1 --2- 172.21.15.151:0/1941119566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1b7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f054499c700 1 -- 172.21.15.151:0/1941119566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 msgr2=0x55eda2c11f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f054499c700 1 --2- 172.21.15.151:0/1941119566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 0x55eda2c11f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f054499c700 1 -- 172.21.15.151:0/1941119566 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55eda297ac00 con 0x55eda2c18660 2023-07-21T22:24:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f054499c700 1 --2- 172.21.15.151:0/1941119566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c22ba0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f053809b400 tx=0x7f05380bb040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=919798d5a909cf19 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.119+0000 7f0526ffd700 1 -- 172.21.15.151:0/1941119566 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053809b700 con 0x55eda2c18660 2023-07-21T22:24:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.120+0000 7f0526ffd700 1 -- 172.21.15.151:0/1941119566 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f053809f730 con 0x55eda2c18660 2023-07-21T22:24:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.120+0000 7f0526ffd700 1 -- 172.21.15.151:0/1941119566 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0538099aa0 con 0x55eda2c18660 2023-07-21T22:24:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.120+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1941119566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 msgr2=0x55eda2c22ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.120+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/1941119566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c22ba0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f053809b400 tx=0x7f05380bb040 comp rx=0 tx=0).stop 2023-07-21T22:24:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.120+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1941119566 shutdown_connections 2023-07-21T22:24:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.120+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/1941119566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2c18660 0x55eda2c22ba0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.120+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/1941119566 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2a6e6b0 0x55eda2c1b7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.120+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/1941119566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 0x55eda2c11f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.120+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1941119566 >> 172.21.15.151:0/1941119566 conn(0x55eda2c07ae0 msgr2=0x55eda2c1b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.121+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1941119566 shutdown_connections 2023-07-21T22:24:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.121+0000 7f0559cb9b80 1 -- 172.21.15.151:0/1941119566 wait complete. 2023-07-21T22:24:58.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.121+0000 7f0559cb9b80 1 -- start start 2023-07-21T22:24:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.121+0000 7f0559cb9b80 1 Processor -- start 2023-07-21T22:24:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2a6e6b0 0x55eda2c22470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 0x55eda2c229b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f0559cb9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18660 0x55eda2c778a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2c77f70 con 0x55eda2a6e6b0 2023-07-21T22:24:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2c780e0 con 0x55eda2c18210 2023-07-21T22:24:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f0559cb9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55eda2c782a0 con 0x55eda2c18660 2023-07-21T22:24:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f0559cb9b80 10 client.0 _ll_register_callbacks cb 0x7f0538097380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:24:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f053ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2a6e6b0 0x55eda2c22470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f053ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2a6e6b0 0x55eda2c22470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38056/0 (socket says 172.21.15.151:38056) 2023-07-21T22:24:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f053ffff700 1 -- 172.21.15.151:0/441925415 learned_addr learned my addr 172.21.15.151:0/441925415 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:24:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f053f7fe700 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 0x55eda2c229b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.122+0000 7f054499c700 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18660 0x55eda2c778a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f053ffff700 1 -- 172.21.15.151:0/441925415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18660 msgr2=0x55eda2c778a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:58.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f053ffff700 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18660 0x55eda2c778a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f053ffff700 1 -- 172.21.15.151:0/441925415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 msgr2=0x55eda2c229b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:24:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f053ffff700 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 0x55eda2c229b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f053ffff700 1 -- 172.21.15.151:0/441925415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054019d5f0 con 0x55eda2a6e6b0 2023-07-21T22:24:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f054499c700 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18660 0x55eda2c778a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:24:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f053ffff700 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2a6e6b0 0x55eda2c22470 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f053000f010 tx=0x7f0530009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0b892a8c86a4670 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:24:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f051f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:24:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f051f7fe700 1 -- 172.21.15.151:0/441925415 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530038070 con 0x55eda2a6e6b0 2023-07-21T22:24:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f051f7fe700 1 -- 172.21.15.151:0/441925415 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0530000e40 con 0x55eda2a6e6b0 2023-07-21T22:24:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.123+0000 7f0559cb9b80 1 -- 172.21.15.151:0/441925415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0530019c20 con 0x55eda2a6e6b0 2023-07-21T22:24:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f051f7fe700 1 -- 172.21.15.151:0/441925415 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05300056b0 con 0x55eda2a6e6b0 2023-07-21T22:24:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f0559cb9b80 10 client.16692 fetch_fsmap learned FSMap version 34 2023-07-21T22:24:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f0559cb9b80 1 -- 172.21.15.151:0/441925415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55eda29b81f0 con 0x55eda2a6e6b0 2023-07-21T22:24:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f051f7fe700 1 -- 172.21.15.151:0/441925415 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0530019c20 con 0x55eda2a6e6b0 2023-07-21T22:24:58.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f051f7fe700 1 -- 172.21.15.151:0/441925415 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f053003b030 con 0x55eda2a6e6b0 2023-07-21T22:24:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f0559cb9b80 10 client.16692 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:24:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f0559cb9b80 10 client.16692 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:24:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f0559cb9b80 20 client.16692 populate_metadata read hostname 'smithi151' 2023-07-21T22:24:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55eda2c805b0 0x55eda2c829c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:24:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f0559cb9b80 4 client.16692 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:24:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f0559cb9b80 1 -- 172.21.15.151:0/441925415 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55eda2b1eff0 con 0x55eda2c805b0 2023-07-21T22:24:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.124+0000 7f053f7fe700 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55eda2c805b0 0x55eda2c829c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:24:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.125+0000 7f053f7fe700 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55eda2c805b0 0x55eda2c829c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=20a29589a1853b05 server_cookie=db8025e806741eb4 in_seq=0 out_seq=0 2023-07-21T22:24:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.125+0000 7f051f7fe700 10 client.16692 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f051f7fe700 1 -- 172.21.15.151:0/441925415 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55eda2b1eff0 con 0x55eda2c805b0 2023-07-21T22:24:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f051f7fe700 10 client.16692 handle_command_reply: tid=0 2023-07-21T22:24:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 client.16692 shutdown 2023-07-21T22:24:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 -- 172.21.15.151:0/441925415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2a6e6b0 msgr2=0x55eda2c22470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2a6e6b0 0x55eda2c22470 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f053000f010 tx=0x7f0530009260 comp rx=0 tx=0).stop 2023-07-21T22:24:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 -- 172.21.15.151:0/441925415 shutdown_connections 2023-07-21T22:24:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55eda2c805b0 0x55eda2c829c0 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55eda2c18660 0x55eda2c778a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55eda2a6e6b0 0x55eda2c22470 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 --2- 172.21.15.151:0/441925415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55eda2c18210 0x55eda2c229b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f051f7fe700 0 client.16692 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:24:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 -- 172.21.15.151:0/441925415 >> 172.21.15.151:0/441925415 conn(0x55eda2c07ae0 msgr2=0x55eda2c168b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 -- 172.21.15.151:0/441925415 shutdown_connections 2023-07-21T22:24:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 1 -- 172.21.15.151:0/441925415 wait complete. 2023-07-21T22:24:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.138+0000 7f0559cb9b80 20 client.16692 trim_cache size 0 max 16384 2023-07-21T22:24:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:24:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:24:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:24:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:24:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 -- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05280a12c0 msgr2=0x7f05280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05280a12c0 0x7f05280a3770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0540199670 tx=0x7f0534012840 comp rx=0 tx=0).stop 2023-07-21T22:24:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 -- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0540106ff0 msgr2=0x7f054019ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:24:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0540106ff0 0x7f054019ca00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f0538009fd0 tx=0x7f0538007910 comp rx=0 tx=0).stop 2023-07-21T22:24:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 -- 172.21.15.151:0/4216709929 shutdown_connections 2023-07-21T22:24:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05280a12c0 0x7f05280a3770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0540106ff0 0x7f054019ca00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0540101fb0 0x7f0540197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 --2- 172.21.15.151:0/4216709929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0540102950 0x7f0540198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:24:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 -- 172.21.15.151:0/4216709929 >> 172.21.15.151:0/4216709929 conn(0x7f05400fd800 msgr2=0x7f05400fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:24:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 -- 172.21.15.151:0/4216709929 shutdown_connections 2023-07-21T22:24:58.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:24:58.139+0000 7f05463ff700 1 -- 172.21.15.151:0/4216709929 wait complete. 2023-07-21T22:24:58.402 INFO:teuthology.orchestra.run.smithi151.stderr:23400000 of 50000000 tuples (46%) done (elapsed 321.89 s, remaining 365.91 s) 2023-07-21T22:24:58.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:58 smithi195 ceph-mon[97365]: pgmap v176: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 35 MiB/s wr, 173 op/s 2023-07-21T22:24:58.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:58 smithi151 ceph-mon[95510]: pgmap v176: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 35 MiB/s wr, 173 op/s 2023-07-21T22:24:58.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:58 smithi187 ceph-mon[96918]: pgmap v176: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 35 MiB/s wr, 173 op/s 2023-07-21T22:24:59.621 INFO:teuthology.orchestra.run.smithi151.stderr:23500000 of 50000000 tuples (47%) done (elapsed 323.11 s, remaining 364.36 s) 2023-07-21T22:24:59.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:59 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:24:59.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:59 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:24:59.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:24:59 smithi195 ceph-mon[97365]: scrub summary: idle 2023-07-21T22:24:59.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:59 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:24:59.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:59 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:24:59.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:24:59 smithi151 ceph-mon[95510]: scrub summary: idle 2023-07-21T22:24:59.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:59 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:24:59.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:59 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:24:59.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:24:59 smithi187 ceph-mon[96918]: scrub summary: idle 2023-07-21T22:25:00.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:00 smithi195 ceph-mon[97365]: pgmap v177: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 23 MiB/s wr, 131 op/s 2023-07-21T22:25:00.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:00 smithi151 ceph-mon[95510]: pgmap v177: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 23 MiB/s wr, 131 op/s 2023-07-21T22:25:00.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:00 smithi187 ceph-mon[96918]: pgmap v177: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 23 MiB/s wr, 131 op/s 2023-07-21T22:25:00.978 INFO:teuthology.orchestra.run.smithi151.stderr:23600000 of 50000000 tuples (47%) done (elapsed 324.47 s, remaining 362.97 s) 2023-07-21T22:25:02.201 INFO:teuthology.orchestra.run.smithi151.stderr:23700000 of 50000000 tuples (47%) done (elapsed 325.69 s, remaining 361.42 s) 2023-07-21T22:25:02.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:02 smithi195 ceph-mon[97365]: pgmap v178: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 23 MiB/s wr, 131 op/s 2023-07-21T22:25:02.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:02 smithi151 ceph-mon[95510]: pgmap v178: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 23 MiB/s wr, 131 op/s 2023-07-21T22:25:02.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:02 smithi187 ceph-mon[96918]: pgmap v178: 97 pgs: 97 active+clean; 5.4 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 23 MiB/s wr, 131 op/s 2023-07-21T22:25:03.405 INFO:teuthology.orchestra.run.smithi151.stderr:23800000 of 50000000 tuples (47%) done (elapsed 326.90 s, remaining 359.86 s) 2023-07-21T22:25:04.642 INFO:teuthology.orchestra.run.smithi151.stderr:23900000 of 50000000 tuples (47%) done (elapsed 328.13 s, remaining 358.34 s) 2023-07-21T22:25:04.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:04 smithi195 ceph-mon[97365]: pgmap v179: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 35 MiB/s wr, 162 op/s 2023-07-21T22:25:04.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:04 smithi151 ceph-mon[95510]: pgmap v179: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 35 MiB/s wr, 162 op/s 2023-07-21T22:25:04.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:04 smithi187 ceph-mon[96918]: pgmap v179: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 35 MiB/s wr, 162 op/s 2023-07-21T22:25:05.988 INFO:teuthology.orchestra.run.smithi151.stderr:24000000 of 50000000 tuples (48%) done (elapsed 329.48 s, remaining 356.94 s) 2023-07-21T22:25:06.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:06 smithi151 ceph-mon[95510]: pgmap v180: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:25:06.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:06 smithi187 ceph-mon[96918]: pgmap v180: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:25:06.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:06 smithi195 ceph-mon[97365]: pgmap v180: 97 pgs: 97 active+clean; 5.5 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:25:07.222 INFO:teuthology.orchestra.run.smithi151.stderr:24100000 of 50000000 tuples (48%) done (elapsed 330.71 s, remaining 355.41 s) 2023-07-21T22:25:08.459 INFO:teuthology.orchestra.run.smithi151.stderr:24200000 of 50000000 tuples (48%) done (elapsed 331.95 s, remaining 353.90 s) 2023-07-21T22:25:08.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:08 smithi151 ceph-mon[95510]: pgmap v181: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-07-21T22:25:08.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:08 smithi187 ceph-mon[96918]: pgmap v181: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-07-21T22:25:08.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:08 smithi195 ceph-mon[97365]: pgmap v181: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 MiB/s wr, 75 op/s 2023-07-21T22:25:09.778 INFO:teuthology.orchestra.run.smithi151.stderr:24300000 of 50000000 tuples (48%) done (elapsed 333.27 s, remaining 352.47 s) 2023-07-21T22:25:10.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:10 smithi151 ceph-mon[95510]: pgmap v182: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-07-21T22:25:10.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:10 smithi187 ceph-mon[96918]: pgmap v182: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-07-21T22:25:10.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:10 smithi195 ceph-mon[97365]: pgmap v182: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-07-21T22:25:11.001 INFO:teuthology.orchestra.run.smithi151.stderr:24400000 of 50000000 tuples (48%) done (elapsed 334.49 s, remaining 350.94 s) 2023-07-21T22:25:11.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.301+0000 7fe746dff700 1 -- 172.21.15.151:0/720729838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7400fea30 msgr2=0x7fe7400feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:11.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.301+0000 7fe746dff700 1 --2- 172.21.15.151:0/720729838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7400fea30 0x7fe7400feea0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009990 tx=0x7fe72c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.301+0000 7fe746dff700 1 -- 172.21.15.151:0/720729838 shutdown_connections 2023-07-21T22:25:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.301+0000 7fe746dff700 1 --2- 172.21.15.151:0/720729838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7400ff3e0 0x7fe74010b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.301+0000 7fe746dff700 1 --2- 172.21.15.151:0/720729838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe740104a30 0x7fe740104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.301+0000 7fe746dff700 1 --2- 172.21.15.151:0/720729838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7400fea30 0x7fe7400feea0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.301+0000 7fe746dff700 1 -- 172.21.15.151:0/720729838 >> 172.21.15.151:0/720729838 conn(0x7fe740074760 msgr2=0x7fe740074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.302+0000 7fe746dff700 1 -- 172.21.15.151:0/720729838 shutdown_connections 2023-07-21T22:25:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.302+0000 7fe746dff700 1 -- 172.21.15.151:0/720729838 wait complete. 2023-07-21T22:25:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.303+0000 7fe746dff700 1 Processor -- start 2023-07-21T22:25:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.303+0000 7fe746dff700 1 -- start start 2023-07-21T22:25:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe746dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7400fea30 0x7fe74010deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe746dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7400ff3e0 0x7fe74010e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe746dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe740104a30 0x7fe7401a3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe746dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7401a41c0 con 0x7fe740104a30 2023-07-21T22:25:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe746dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7401a4300 con 0x7fe7400fea30 2023-07-21T22:25:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe746dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7401a4470 con 0x7fe7400ff3e0 2023-07-21T22:25:11.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe74539c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe740104a30 0x7fe7401a3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe74539c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe740104a30 0x7fe7401a3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52282/0 (socket says 172.21.15.151:52282) 2023-07-21T22:25:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe74539c700 1 -- 172.21.15.151:0/824865412 learned_addr learned my addr 172.21.15.151:0/824865412 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe73ffff700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7400ff3e0 0x7fe74010e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.304+0000 7fe744b9b700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7400fea30 0x7fe74010deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe74539c700 1 -- 172.21.15.151:0/824865412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7400ff3e0 msgr2=0x7fe74010e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe74539c700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7400ff3e0 0x7fe74010e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe74539c700 1 -- 172.21.15.151:0/824865412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7400fea30 msgr2=0x7fe74010deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe74539c700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7400fea30 0x7fe74010deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe74539c700 1 -- 172.21.15.151:0/824865412 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe72c0095f0 con 0x7fe740104a30 2023-07-21T22:25:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe74539c700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe740104a30 0x7fe7401a3c80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe738007ee0 tx=0x7fe73800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe73dffb700 1 -- 172.21.15.151:0/824865412 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe73800dd20 con 0x7fe740104a30 2023-07-21T22:25:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe746dff700 1 -- 172.21.15.151:0/824865412 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7401a4750 con 0x7fe740104a30 2023-07-21T22:25:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe73dffb700 1 -- 172.21.15.151:0/824865412 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe73800f040 con 0x7fe740104a30 2023-07-21T22:25:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe73dffb700 1 -- 172.21.15.151:0/824865412 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe738004750 con 0x7fe740104a30 2023-07-21T22:25:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.305+0000 7fe746dff700 1 -- 172.21.15.151:0/824865412 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7401a4cb0 con 0x7fe740104a30 2023-07-21T22:25:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.309+0000 7fe73dffb700 1 -- 172.21.15.151:0/824865412 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fe738003a00 con 0x7fe740104a30 2023-07-21T22:25:11.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.310+0000 7fe73dffb700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7300a12c0 0x7fe7300a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.310+0000 7fe73dffb700 1 -- 172.21.15.151:0/824865412 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe7380cc5f0 con 0x7fe740104a30 2023-07-21T22:25:11.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.311+0000 7fe744b9b700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7300a12c0 0x7fe7300a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.311+0000 7fe75a6f0b80 1 Processor -- start 2023-07-21T22:25:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.311+0000 7fe75a6f0b80 1 -- start start 2023-07-21T22:25:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.311+0000 7fe744b9b700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7300a12c0 0x7fe7300a3770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe7400ffba0 tx=0x7fe734007400 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 0x555b32992cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3298cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 0x555b3298d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b32892c50 con 0x555b32993210 2023-07-21T22:25:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b328e59e0 con 0x555b327e96b0 2023-07-21T22:25:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b328dee70 con 0x555b32993660 2023-07-21T22:25:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe73ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3298cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe73ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3298cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52296/0 (socket says 172.21.15.151:52296) 2023-07-21T22:25:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe73ffff700 1 -- 172.21.15.151:0/2038064239 learned_addr learned my addr 172.21.15.151:0/2038064239 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe744b9b700 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 0x555b32992cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe74539c700 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 0x555b3298d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe73ffff700 1 -- 172.21.15.151:0/2038064239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 msgr2=0x555b3298d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe73ffff700 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 0x555b3298d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe73ffff700 1 -- 172.21.15.151:0/2038064239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 msgr2=0x555b32992cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe73ffff700 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 0x555b32992cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe73ffff700 1 -- 172.21.15.151:0/2038064239 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b3270cd80 con 0x555b32993210 2023-07-21T22:25:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.312+0000 7fe744b9b700 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 0x555b32992cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:25:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.313+0000 7fe73ffff700 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3298cf40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009990 tx=0x7fe72c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1deea122436f9bd4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.313+0000 7fe72affd700 1 -- 172.21.15.151:0/2038064239 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c01d070 con 0x555b32993210 2023-07-21T22:25:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.313+0000 7fe72affd700 1 -- 172.21.15.151:0/2038064239 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe72c01e040 con 0x555b32993210 2023-07-21T22:25:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.313+0000 7fe72affd700 1 -- 172.21.15.151:0/2038064239 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c004500 con 0x555b32993210 2023-07-21T22:25:11.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.314+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2038064239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 msgr2=0x555b3298cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:11.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.314+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3298cf40 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe72c009990 tx=0x7fe72c009ee0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.314+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2038064239 shutdown_connections 2023-07-21T22:25:11.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.314+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 0x555b32992cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.314+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 0x555b3298d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.314+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2038064239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3298cf40 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.314+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2038064239 >> 172.21.15.151:0/2038064239 conn(0x555b32982ae0 msgr2=0x555b329880e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.314+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2038064239 shutdown_connections 2023-07-21T22:25:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.314+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2038064239 wait complete. 2023-07-21T22:25:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.315+0000 7fe75a6f0b80 1 -- start start 2023-07-21T22:25:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.315+0000 7fe75a6f0b80 1 Processor -- start 2023-07-21T22:25:11.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.315+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b327e96b0 0x555b3299c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993210 0x555b3299ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 0x555b32996750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b3287ea60 con 0x555b327e96b0 2023-07-21T22:25:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b3287e760 con 0x555b32993660 2023-07-21T22:25:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b327628c0 con 0x555b32993210 2023-07-21T22:25:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe75a6f0b80 10 client.0 _ll_register_callbacks cb 0x555b3287c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:11.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe744b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b327e96b0 0x555b3299c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe744b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b327e96b0 0x555b3299c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52310/0 (socket says 172.21.15.151:52310) 2023-07-21T22:25:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe744b9b700 1 -- 172.21.15.151:0/3119347911 learned_addr learned my addr 172.21.15.151:0/3119347911 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe74539c700 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 0x555b32996750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe73ffff700 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993210 0x555b3299ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe744b9b700 1 -- 172.21.15.151:0/3119347911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993210 msgr2=0x555b3299ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe744b9b700 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993210 0x555b3299ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe744b9b700 1 -- 172.21.15.151:0/3119347911 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 msgr2=0x555b32996750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe744b9b700 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 0x555b32996750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.316+0000 7fe744b9b700 1 -- 172.21.15.151:0/3119347911 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe74010c160 con 0x555b327e96b0 2023-07-21T22:25:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.317+0000 7fe744b9b700 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b327e96b0 0x555b3299c500 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe734011000 tx=0x7fe7340047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed54f1ad123d2896 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.317+0000 7fe71ffff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.317+0000 7fe71ffff700 1 -- 172.21.15.151:0/3119347911 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe734028670 con 0x555b327e96b0 2023-07-21T22:25:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.317+0000 7fe71ffff700 1 -- 172.21.15.151:0/3119347911 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe734017070 con 0x555b327e96b0 2023-07-21T22:25:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.317+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/3119347911 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555b32838490 con 0x555b327e96b0 2023-07-21T22:25:11.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.317+0000 7fe71ffff700 1 -- 172.21.15.151:0/3119347911 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7340287d0 con 0x555b327e96b0 2023-07-21T22:25:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.317+0000 7fe75a6f0b80 10 client.16704 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.317+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/3119347911 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x555b326f5c00 con 0x555b327e96b0 2023-07-21T22:25:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.318+0000 7fe71ffff700 1 -- 172.21.15.151:0/3119347911 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555b32838490 con 0x555b327e96b0 2023-07-21T22:25:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.318+0000 7fe71ffff700 1 -- 172.21.15.151:0/3119347911 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe734031990 con 0x555b327e96b0 2023-07-21T22:25:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.318+0000 7fe75a6f0b80 10 client.16704 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.318+0000 7fe75a6f0b80 10 client.16704 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:11.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.318+0000 7fe75a6f0b80 20 client.16704 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.318+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555b329a6a20 0x555b329a8e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.318+0000 7fe75a6f0b80 4 client.16704 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:25:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.318+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/3119347911 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555b328d7e50 con 0x555b329a6a20 2023-07-21T22:25:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.318+0000 7fe73ffff700 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555b329a6a20 0x555b329a8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.319+0000 7fe73ffff700 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555b329a6a20 0x555b329a8e30 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a2d07161ba6f9b2 server_cookie=4b6177f42a8fdc73 in_seq=0 out_seq=0 2023-07-21T22:25:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.319+0000 7fe71ffff700 10 client.16704 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:11.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.319+0000 7fe71ffff700 1 -- 172.21.15.151:0/3119347911 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555b328d7e50 con 0x555b329a6a20 2023-07-21T22:25:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.319+0000 7fe71ffff700 10 client.16704 handle_command_reply: tid=0 2023-07-21T22:25:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 client.16704 shutdown 2023-07-21T22:25:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/3119347911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b327e96b0 msgr2=0x555b3299c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b327e96b0 0x555b3299c500 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe734011000 tx=0x7fe7340047c0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/3119347911 shutdown_connections 2023-07-21T22:25:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555b329a6a20 0x555b329a8e30 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 0x555b32996750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b327e96b0 0x555b3299c500 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/3119347911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993210 0x555b3299ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/3119347911 >> 172.21.15.151:0/3119347911 conn(0x555b32982ae0 msgr2=0x555b329873e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe71ffff700 0 client.16704 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/3119347911 shutdown_connections 2023-07-21T22:25:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/3119347911 wait complete. 2023-07-21T22:25:11.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.320+0000 7fe75a6f0b80 20 client.16704 trim_cache size 0 max 16384 2023-07-21T22:25:11.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.336+0000 7fe75a6f0b80 1 Processor -- start 2023-07-21T22:25:11.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.336+0000 7fe75a6f0b80 1 -- start start 2023-07-21T22:25:11.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b327e96b0 0x555b32996880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b32994140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 0x555b32987b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b32984c00 con 0x555b32993210 2023-07-21T22:25:11.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b3297fb00 con 0x555b32993660 2023-07-21T22:25:11.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b32991390 con 0x555b327e96b0 2023-07-21T22:25:11.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe73ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b32994140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe73ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b32994140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52326/0 (socket says 172.21.15.151:52326) 2023-07-21T22:25:11.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe73ffff700 1 -- 172.21.15.151:0/38440589 learned_addr learned my addr 172.21.15.151:0/38440589 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:11.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe74539c700 1 --2- 172.21.15.151:0/38440589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 0x555b32987b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe744b9b700 1 --2- 172.21.15.151:0/38440589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b327e96b0 0x555b32996880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe73ffff700 1 -- 172.21.15.151:0/38440589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b327e96b0 msgr2=0x555b32996880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe73ffff700 1 --2- 172.21.15.151:0/38440589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b327e96b0 0x555b32996880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe73ffff700 1 -- 172.21.15.151:0/38440589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 msgr2=0x555b32987b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe73ffff700 1 --2- 172.21.15.151:0/38440589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 0x555b32987b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.337+0000 7fe73ffff700 1 -- 172.21.15.151:0/38440589 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555b329ada60 con 0x555b32993210 2023-07-21T22:25:11.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.338+0000 7fe73ffff700 1 --2- 172.21.15.151:0/38440589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b32994140 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe72c005f50 tx=0x7fe72c01a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cd917274d9b3d58 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:11.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.338+0000 7fe72b7fe700 1 -- 172.21.15.151:0/38440589 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c01d040 con 0x555b32993210 2023-07-21T22:25:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.338+0000 7fe72b7fe700 1 -- 172.21.15.151:0/38440589 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe72c0058e0 con 0x555b32993210 2023-07-21T22:25:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.338+0000 7fe72b7fe700 1 -- 172.21.15.151:0/38440589 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c005320 con 0x555b32993210 2023-07-21T22:25:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/38440589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 msgr2=0x555b32994140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:11.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/38440589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b32994140 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe72c005f50 tx=0x7fe72c01a040 comp rx=0 tx=0).stop 2023-07-21T22:25:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/38440589 shutdown_connections 2023-07-21T22:25:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/38440589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b32993660 0x555b32987b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/38440589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b327e96b0 0x555b32996880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/38440589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b32994140 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/38440589 >> 172.21.15.151:0/38440589 conn(0x555b32982ae0 msgr2=0x555b32993a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/38440589 shutdown_connections 2023-07-21T22:25:11.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/38440589 wait complete. 2023-07-21T22:25:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.339+0000 7fe75a6f0b80 1 -- start start 2023-07-21T22:25:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.340+0000 7fe75a6f0b80 1 Processor -- start 2023-07-21T22:25:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.340+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 0x555b3299a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.340+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3299a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.340+0000 7fe75a6f0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 0x555b3299aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.340+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b329f9950 con 0x555b32993210 2023-07-21T22:25:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.340+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b329f9ac0 con 0x555b327e96b0 2023-07-21T22:25:11.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.340+0000 7fe75a6f0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555b329f9c80 con 0x555b32993660 2023-07-21T22:25:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.340+0000 7fe75a6f0b80 10 client.0 _ll_register_callbacks cb 0x7fe734010b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe73ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3299a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe73ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3299a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52338/0 (socket says 172.21.15.151:52338) 2023-07-21T22:25:11.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe73ffff700 1 -- 172.21.15.151:0/2272547391 learned_addr learned my addr 172.21.15.151:0/2272547391 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe74539c700 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 0x555b3299aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe744b9b700 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 0x555b3299a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe73ffff700 1 -- 172.21.15.151:0/2272547391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 msgr2=0x555b3299aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe73ffff700 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 0x555b3299aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe73ffff700 1 -- 172.21.15.151:0/2272547391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 msgr2=0x555b3299a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe73ffff700 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 0x555b3299a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe73ffff700 1 -- 172.21.15.151:0/2272547391 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555b3270cd80 con 0x555b32993210 2023-07-21T22:25:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe73ffff700 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3299a5b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe72c036040 tx=0x7fe72c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d200a01b062fea4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.341+0000 7fe71ffff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe71ffff700 1 -- 172.21.15.151:0/2272547391 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe72c01d040 con 0x555b32993210 2023-07-21T22:25:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2272547391 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe72c01e040 con 0x555b32993210 2023-07-21T22:25:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe71ffff700 1 -- 172.21.15.151:0/2272547391 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fe72c005240 con 0x555b32993210 2023-07-21T22:25:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe71ffff700 1 -- 172.21.15.151:0/2272547391 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe72c005400 con 0x555b32993210 2023-07-21T22:25:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe75a6f0b80 10 client.16710 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:11.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2272547391 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x555b327331f0 con 0x555b32993210 2023-07-21T22:25:11.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe71ffff700 1 -- 172.21.15.151:0/2272547391 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe72c049020 con 0x555b32993210 2023-07-21T22:25:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe71ffff700 1 -- 172.21.15.151:0/2272547391 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe72c004500 con 0x555b32993210 2023-07-21T22:25:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe75a6f0b80 10 client.16710 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe75a6f0b80 10 client.16710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.342+0000 7fe75a6f0b80 20 client.16710 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.343+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555b329fafe0 0x555b329fd3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.343+0000 7fe75a6f0b80 4 client.16710 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:25:11.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.343+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2272547391 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555b32899ff0 con 0x555b329fafe0 2023-07-21T22:25:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.343+0000 7fe744b9b700 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555b329fafe0 0x555b329fd3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.344+0000 7fe744b9b700 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555b329fafe0 0x555b329fd3f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e985254aa295a8b4 server_cookie=aa7ed403af29cf96 in_seq=0 out_seq=0 2023-07-21T22:25:11.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.344+0000 7fe71ffff700 10 client.16710 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe71ffff700 1 -- 172.21.15.151:0/2272547391 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555b32899ff0 con 0x555b329fafe0 2023-07-21T22:25:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe71ffff700 10 client.16710 handle_command_reply: tid=0 2023-07-21T22:25:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe75a6f0b80 1 client.16710 shutdown 2023-07-21T22:25:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2272547391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 msgr2=0x555b3299a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:11.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3299a5b0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fe72c036040 tx=0x7fe72c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2272547391 shutdown_connections 2023-07-21T22:25:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555b329fafe0 0x555b329fd3f0 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555b327e96b0 0x555b3299a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555b32993660 0x555b3299aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe75a6f0b80 1 --2- 172.21.15.151:0/2272547391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555b32993210 0x555b3299a5b0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.357+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2272547391 >> 172.21.15.151:0/2272547391 conn(0x555b32982ae0 msgr2=0x555b3298bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.358+0000 7fe71ffff700 0 client.16710 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.358+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2272547391 shutdown_connections 2023-07-21T22:25:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.358+0000 7fe75a6f0b80 1 -- 172.21.15.151:0/2272547391 wait complete. 2023-07-21T22:25:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.358+0000 7fe75a6f0b80 20 client.16710 trim_cache size 0 max 16384 2023-07-21T22:25:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:25:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:25:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:25:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:25:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.358+0000 7fe746dff700 1 -- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7300a12c0 msgr2=0x7fe7300a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.358+0000 7fe746dff700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7300a12c0 0x7fe7300a3770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fe7400ffba0 tx=0x7fe734007400 comp rx=0 tx=0).stop 2023-07-21T22:25:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.358+0000 7fe746dff700 1 -- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe740104a30 msgr2=0x7fe7401a3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.358+0000 7fe746dff700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe740104a30 0x7fe7401a3c80 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe738007ee0 tx=0x7fe73800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.359+0000 7fe746dff700 1 -- 172.21.15.151:0/824865412 shutdown_connections 2023-07-21T22:25:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.359+0000 7fe746dff700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7300a12c0 0x7fe7300a3770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.359+0000 7fe746dff700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7400fea30 0x7fe74010deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.359+0000 7fe746dff700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe740104a30 0x7fe7401a3c80 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.359+0000 7fe746dff700 1 --2- 172.21.15.151:0/824865412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7400ff3e0 0x7fe74010e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.359+0000 7fe746dff700 1 -- 172.21.15.151:0/824865412 >> 172.21.15.151:0/824865412 conn(0x7fe740074760 msgr2=0x7fe7400fd070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.359+0000 7fe746dff700 1 -- 172.21.15.151:0/824865412 shutdown_connections 2023-07-21T22:25:11.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:11.359+0000 7fe746dff700 1 -- 172.21.15.151:0/824865412 wait complete. 2023-07-21T22:25:12.216 INFO:teuthology.orchestra.run.smithi151.stderr:24500000 of 50000000 tuples (49%) done (elapsed 335.71 s, remaining 349.41 s) 2023-07-21T22:25:12.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:12 smithi151 ceph-mon[95510]: pgmap v183: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-07-21T22:25:12.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:12 smithi187 ceph-mon[96918]: pgmap v183: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-07-21T22:25:12.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:12 smithi195 ceph-mon[97365]: pgmap v183: 97 pgs: 97 active+clean; 5.6 GiB data, 2.5 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-07-21T22:25:13.411 INFO:teuthology.orchestra.run.smithi151.stderr:24600000 of 50000000 tuples (49%) done (elapsed 336.90 s, remaining 347.86 s) 2023-07-21T22:25:14.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:14 smithi151 ceph-mon[95510]: pgmap v184: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 36 MiB/s wr, 85 op/s 2023-07-21T22:25:14.739 INFO:teuthology.orchestra.run.smithi151.stderr:24700000 of 50000000 tuples (49%) done (elapsed 338.23 s, remaining 346.45 s) 2023-07-21T22:25:14.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:14 smithi187 ceph-mon[96918]: pgmap v184: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 36 MiB/s wr, 85 op/s 2023-07-21T22:25:14.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:14 smithi195 ceph-mon[97365]: pgmap v184: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 36 MiB/s wr, 85 op/s 2023-07-21T22:25:15.975 INFO:teuthology.orchestra.run.smithi151.stderr:24800000 of 50000000 tuples (49%) done (elapsed 339.47 s, remaining 344.94 s) 2023-07-21T22:25:16.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:16 smithi151 ceph-mon[95510]: pgmap v185: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-07-21T22:25:16.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:16 smithi187 ceph-mon[96918]: pgmap v185: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-07-21T22:25:16.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:16 smithi195 ceph-mon[97365]: pgmap v185: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 54 op/s 2023-07-21T22:25:17.177 INFO:teuthology.orchestra.run.smithi151.stderr:24900000 of 50000000 tuples (49%) done (elapsed 340.67 s, remaining 343.41 s) 2023-07-21T22:25:18.450 INFO:teuthology.orchestra.run.smithi151.stderr:25000000 of 50000000 tuples (50%) done (elapsed 341.94 s, remaining 341.94 s) 2023-07-21T22:25:18.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:18 smithi151 ceph-mon[95510]: pgmap v186: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 MiB/s wr, 73 op/s 2023-07-21T22:25:18.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:18 smithi187 ceph-mon[96918]: pgmap v186: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 MiB/s wr, 73 op/s 2023-07-21T22:25:18.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:18 smithi195 ceph-mon[97365]: pgmap v186: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 MiB/s wr, 73 op/s 2023-07-21T22:25:19.666 INFO:teuthology.orchestra.run.smithi151.stderr:25100000 of 50000000 tuples (50%) done (elapsed 343.16 s, remaining 340.42 s) 2023-07-21T22:25:20.320 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 scrub status 2023-07-21T22:25:20.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.501+0000 7f400f5ff700 1 -- 172.21.15.151:0/3629255314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40081015f0 msgr2=0x7f4008109ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.501+0000 7f400f5ff700 1 --2- 172.21.15.151:0/3629255314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40081015f0 0x7f4008109ae0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009990 tx=0x7f3ff8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.502+0000 7f400f5ff700 1 -- 172.21.15.151:0/3629255314 shutdown_connections 2023-07-21T22:25:20.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.502+0000 7f400f5ff700 1 --2- 172.21.15.151:0/3629255314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4008100ce0 0x7f40081010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.502+0000 7f400f5ff700 1 --2- 172.21.15.151:0/3629255314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f400810a020 0x7f400810c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.548 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.502+0000 7f400f5ff700 1 --2- 172.21.15.151:0/3629255314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f40081015f0 0x7f4008109ae0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.502+0000 7f400f5ff700 1 -- 172.21.15.151:0/3629255314 >> 172.21.15.151:0/3629255314 conn(0x7f40080fa4b0 msgr2=0x7f40080fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:20.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.502+0000 7f400f5ff700 1 -- 172.21.15.151:0/3629255314 shutdown_connections 2023-07-21T22:25:20.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.502+0000 7f400f5ff700 1 -- 172.21.15.151:0/3629255314 wait complete. 2023-07-21T22:25:20.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.503+0000 7f400f5ff700 1 Processor -- start 2023-07-21T22:25:20.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.503+0000 7f400f5ff700 1 -- start start 2023-07-21T22:25:20.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400f5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4008100ce0 0x7f4008197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400f5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40081015f0 0x7f4008198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400f5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f400810a020 0x7f400819c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400f5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400819cdb0 con 0x7f4008100ce0 2023-07-21T22:25:20.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400f5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400819cf20 con 0x7f40081015f0 2023-07-21T22:25:20.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400f5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400819d0e0 con 0x7f400810a020 2023-07-21T22:25:20.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4008100ce0 0x7f4008197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4008100ce0 0x7f4008197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56248/0 (socket says 172.21.15.151:56248) 2023-07-21T22:25:20.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400d39b700 1 -- 172.21.15.151:0/2806660768 learned_addr learned my addr 172.21.15.151:0/2806660768 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:20.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400db9c700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f400810a020 0x7f400819c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400cb9a700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40081015f0 0x7f4008198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400d39b700 1 -- 172.21.15.151:0/2806660768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f400810a020 msgr2=0x7f400819c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400d39b700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f400810a020 0x7f400819c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400d39b700 1 -- 172.21.15.151:0/2806660768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40081015f0 msgr2=0x7f4008198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400d39b700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40081015f0 0x7f4008198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.504+0000 7f400d39b700 1 -- 172.21.15.151:0/2806660768 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80095f0 con 0x7f4008100ce0 2023-07-21T22:25:20.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.505+0000 7f400d39b700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4008100ce0 0x7f4008197dd0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f400400e9a0 tx=0x7f400400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:20.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.505+0000 7f3ffe7fc700 1 -- 172.21.15.151:0/2806660768 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004009790 con 0x7f4008100ce0 2023-07-21T22:25:20.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.505+0000 7f3ffe7fc700 1 -- 172.21.15.151:0/2806660768 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4004010430 con 0x7f4008100ce0 2023-07-21T22:25:20.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.505+0000 7f400f5ff700 1 -- 172.21.15.151:0/2806660768 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400819d3c0 con 0x7f4008100ce0 2023-07-21T22:25:20.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.505+0000 7f3ffe7fc700 1 -- 172.21.15.151:0/2806660768 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400400cea0 con 0x7f4008100ce0 2023-07-21T22:25:20.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.505+0000 7f400f5ff700 1 -- 172.21.15.151:0/2806660768 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40081a4c00 con 0x7f4008100ce0 2023-07-21T22:25:20.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.509+0000 7f3ffe7fc700 1 -- 172.21.15.151:0/2806660768 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f40040105a0 con 0x7f4008100ce0 2023-07-21T22:25:20.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.510+0000 7f4022e52b80 1 Processor -- start 2023-07-21T22:25:20.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.510+0000 7f4022e52b80 1 -- start start 2023-07-21T22:25:20.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.510+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.510+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 0x55aa278b1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.510+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 0x55aa278b1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.510+0000 7f4022e52b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa277b6cb0 con 0x55aa278b61b0 2023-07-21T22:25:20.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.510+0000 7f4022e52b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa27809a40 con 0x55aa278b6ac0 2023-07-21T22:25:20.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.510+0000 7f4022e52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa27802ed0 con 0x55aa278b1930 2023-07-21T22:25:20.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278b6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56252/0 (socket says 172.21.15.151:56252) 2023-07-21T22:25:20.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400db9c700 1 -- 172.21.15.151:0/2721085669 learned_addr learned my addr 172.21.15.151:0/2721085669 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:20.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400cb9a700 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 0x55aa278b1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400d39b700 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 0x55aa278b1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f3ffe7fc700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3ff40a12c0 0x7f3ff40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400cb9a700 1 -- 172.21.15.151:0/2721085669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 msgr2=0x55aa278b1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:20.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400cb9a700 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 0x55aa278b1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400cb9a700 1 -- 172.21.15.151:0/2721085669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 msgr2=0x55aa278b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:20.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400cb9a700 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400cb9a700 1 -- 172.21.15.151:0/2721085669 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa27630de0 con 0x55aa278b1930 2023-07-21T22:25:20.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f3ffe7fc700 1 -- 172.21.15.151:0/2806660768 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f4004014070 con 0x7f4008100ce0 2023-07-21T22:25:20.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400d39b700 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 0x55aa278b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:25:20.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.511+0000 7f400db9c700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3ff40a12c0 0x7f3ff40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.560 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.512+0000 7f400cb9a700 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 0x55aa278b1da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8005910 tx=0x7f3ff8005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bac4caefb0be4625 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:20.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.512+0000 7f3ff37fe700 1 -- 172.21.15.151:0/2721085669 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff801d070 con 0x55aa278b1930 2023-07-21T22:25:20.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.512+0000 7f400db9c700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3ff40a12c0 0x7f3ff40a3770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f40000075c0 tx=0x7f4000009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:20.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.512+0000 7f3ff37fe700 1 -- 172.21.15.151:0/2721085669 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ff801e040 con 0x55aa278b1930 2023-07-21T22:25:20.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.512+0000 7f3ff37fe700 1 -- 172.21.15.151:0/2721085669 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8004760 con 0x55aa278b1930 2023-07-21T22:25:20.562 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.513+0000 7f4022e52b80 1 -- 172.21.15.151:0/2721085669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 msgr2=0x55aa278b1da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.513+0000 7f4022e52b80 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 0x55aa278b1da0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8005910 tx=0x7f3ff8005f00 comp rx=0 tx=0).stop 2023-07-21T22:25:20.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.513+0000 7f4022e52b80 1 -- 172.21.15.151:0/2721085669 shutdown_connections 2023-07-21T22:25:20.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.513+0000 7f4022e52b80 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 0x55aa278b1da0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.513+0000 7f4022e52b80 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.513+0000 7f4022e52b80 1 --2- 172.21.15.151:0/2721085669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 0x55aa278b1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.513+0000 7f4022e52b80 1 -- 172.21.15.151:0/2721085669 >> 172.21.15.151:0/2721085669 conn(0x55aa278a6ef0 msgr2=0x55aa278ac830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:20.563 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.513+0000 7f4022e52b80 1 -- 172.21.15.151:0/2721085669 shutdown_connections 2023-07-21T22:25:20.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.513+0000 7f4022e52b80 1 -- 172.21.15.151:0/2721085669 wait complete. 2023-07-21T22:25:20.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.514+0000 7f4022e52b80 1 -- start start 2023-07-21T22:25:20.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.514+0000 7f4022e52b80 1 Processor -- start 2023-07-21T22:25:20.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.514+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 0x55aa278bdbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.514+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278badf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b6ac0 0x55aa278bb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.564 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f4022e52b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa277a2ac0 con 0x55aa278b61b0 2023-07-21T22:25:20.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f4022e52b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa277a27c0 con 0x55aa278b1930 2023-07-21T22:25:20.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f4022e52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa27686920 con 0x55aa278b6ac0 2023-07-21T22:25:20.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f4022e52b80 10 client.0 _ll_register_callbacks cb 0x55aa277a0760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:20.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400cb9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278badf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400cb9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278badf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56258/0 (socket says 172.21.15.151:56258) 2023-07-21T22:25:20.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400cb9a700 1 -- 172.21.15.151:0/142932281 learned_addr learned my addr 172.21.15.151:0/142932281 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:20.565 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400db9c700 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b6ac0 0x55aa278bb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400d39b700 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 0x55aa278bdbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400db9c700 1 -- 172.21.15.151:0/142932281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 msgr2=0x55aa278bdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:20.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400db9c700 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 0x55aa278bdbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400db9c700 1 -- 172.21.15.151:0/142932281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 msgr2=0x55aa278badf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:20.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400db9c700 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278badf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400db9c700 1 -- 172.21.15.151:0/142932281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f400810d170 con 0x55aa278b6ac0 2023-07-21T22:25:20.566 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.515+0000 7f400cb9a700 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278badf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:20.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.516+0000 7f400db9c700 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b6ac0 0x55aa278bb530 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4000017dc0 tx=0x7f4000004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9061d9e8cecd97ff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:20.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.516+0000 7f3ff0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:25:20.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.516+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/142932281 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000e040 con 0x55aa278b6ac0 2023-07-21T22:25:20.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.516+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/142932281 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f400001c070 con 0x55aa278b6ac0 2023-07-21T22:25:20.567 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.516+0000 7f4022e52b80 1 -- 172.21.15.151:0/142932281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aa2775c4f0 con 0x55aa278b6ac0 2023-07-21T22:25:20.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/142932281 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4000003a00 con 0x55aa278b6ac0 2023-07-21T22:25:20.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f4022e52b80 10 client.26482 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:20.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f4022e52b80 1 -- 172.21.15.151:0/142932281 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55aa27619c60 con 0x55aa278b6ac0 2023-07-21T22:25:20.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/142932281 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aa2775c4f0 con 0x55aa278b6ac0 2023-07-21T22:25:20.569 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/142932281 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f400002c070 con 0x55aa278b6ac0 2023-07-21T22:25:20.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f4022e52b80 10 client.26482 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:20.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f4022e52b80 10 client.26482 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:20.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f4022e52b80 20 client.26482 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:20.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f4022e52b80 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aa278cb410 0x55aa278cd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f4022e52b80 4 client.26482 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:25:20.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.517+0000 7f4022e52b80 1 -- 172.21.15.151:0/142932281 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aa277fbeb0 con 0x55aa278cb410 2023-07-21T22:25:20.570 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.518+0000 7f400d39b700 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aa278cb410 0x55aa278cd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.518+0000 7f400d39b700 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aa278cb410 0x55aa278cd820 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c06d57e7939c00e server_cookie=1e270aefb1e259f5 in_seq=0 out_seq=0 2023-07-21T22:25:20.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.518+0000 7f3ff0ff9700 10 client.26482 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:20.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.519+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/142932281 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55aa277fbeb0 con 0x55aa278cb410 2023-07-21T22:25:20.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.519+0000 7f3ff0ff9700 10 client.26482 handle_command_reply: tid=0 2023-07-21T22:25:20.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.519+0000 7f4022e52b80 1 client.26482 shutdown 2023-07-21T22:25:20.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.519+0000 7f4022e52b80 1 -- 172.21.15.151:0/142932281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b6ac0 msgr2=0x55aa278bb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.519+0000 7f4022e52b80 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b6ac0 0x55aa278bb530 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4000017dc0 tx=0x7f4000004ad0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.571 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f4022e52b80 1 -- 172.21.15.151:0/142932281 shutdown_connections 2023-07-21T22:25:20.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f4022e52b80 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aa278cb410 0x55aa278cd820 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f4022e52b80 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 0x55aa278bdbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f4022e52b80 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b6ac0 0x55aa278bb530 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f4022e52b80 1 --2- 172.21.15.151:0/142932281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa278badf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f3ff0ff9700 0 client.26482 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:20.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f4022e52b80 1 -- 172.21.15.151:0/142932281 >> 172.21.15.151:0/142932281 conn(0x55aa278a6ef0 msgr2=0x55aa278ac3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:20.572 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f4022e52b80 1 -- 172.21.15.151:0/142932281 shutdown_connections 2023-07-21T22:25:20.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f4022e52b80 1 -- 172.21.15.151:0/142932281 wait complete. 2023-07-21T22:25:20.573 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.520+0000 7f4022e52b80 20 client.26482 trim_cache size 0 max 16384 2023-07-21T22:25:20.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.539+0000 7f4022e52b80 1 Processor -- start 2023-07-21T22:25:20.585 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f4022e52b80 1 -- start start 2023-07-21T22:25:20.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 0x55aa278bb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b61b0 0x55aa278aaf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b6ac0 0x55aa278c7790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f4022e52b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa278a9010 con 0x55aa278b6ac0 2023-07-21T22:25:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f4022e52b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa278b5e00 con 0x55aa278b1930 2023-07-21T22:25:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f4022e52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa278ab4a0 con 0x55aa278b61b0 2023-07-21T22:25:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f400db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b6ac0 0x55aa278c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f400d39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 0x55aa278bb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.587 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f400db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b6ac0 0x55aa278c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56260/0 (socket says 172.21.15.151:56260) 2023-07-21T22:25:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.540+0000 7f400db9c700 1 -- 172.21.15.151:0/4182951923 learned_addr learned my addr 172.21.15.151:0/4182951923 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f400cb9a700 1 --2- 172.21.15.151:0/4182951923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b61b0 0x55aa278aaf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f400d39b700 1 -- 172.21.15.151:0/4182951923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b61b0 msgr2=0x55aa278aaf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f400d39b700 1 --2- 172.21.15.151:0/4182951923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b61b0 0x55aa278aaf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f400d39b700 1 -- 172.21.15.151:0/4182951923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b6ac0 msgr2=0x55aa278c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f400d39b700 1 --2- 172.21.15.151:0/4182951923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b6ac0 0x55aa278c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.588 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f400d39b700 1 -- 172.21.15.151:0/4182951923 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aa27657250 con 0x55aa278b1930 2023-07-21T22:25:20.589 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f400db9c700 1 --2- 172.21.15.151:0/4182951923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b6ac0 0x55aa278c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:20.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f400d39b700 1 --2- 172.21.15.151:0/4182951923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 0x55aa278bb490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f40040ca6c0 tx=0x7f40040cd000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ec114c73174868e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:20.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f3ff3fff700 1 -- 172.21.15.151:0/4182951923 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004096380 con 0x55aa278b1930 2023-07-21T22:25:20.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f3ff3fff700 1 -- 172.21.15.151:0/4182951923 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4004010880 con 0x55aa278b1930 2023-07-21T22:25:20.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.541+0000 7f3ff3fff700 1 -- 172.21.15.151:0/4182951923 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400409a500 con 0x55aa278b1930 2023-07-21T22:25:20.591 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.542+0000 7f4022e52b80 1 -- 172.21.15.151:0/4182951923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 msgr2=0x55aa278bb490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.542+0000 7f4022e52b80 1 --2- 172.21.15.151:0/4182951923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 0x55aa278bb490 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f40040ca6c0 tx=0x7f40040cd000 comp rx=0 tx=0).stop 2023-07-21T22:25:20.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.542+0000 7f4022e52b80 1 -- 172.21.15.151:0/4182951923 shutdown_connections 2023-07-21T22:25:20.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.542+0000 7f4022e52b80 1 --2- 172.21.15.151:0/4182951923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b1930 0x55aa278bb490 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.542+0000 7f4022e52b80 1 --2- 172.21.15.151:0/4182951923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b6ac0 0x55aa278c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.542+0000 7f4022e52b80 1 --2- 172.21.15.151:0/4182951923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b61b0 0x55aa278aaf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.542+0000 7f4022e52b80 1 -- 172.21.15.151:0/4182951923 >> 172.21.15.151:0/4182951923 conn(0x55aa278a6ef0 msgr2=0x55aa278d2180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:20.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.542+0000 7f4022e52b80 1 -- 172.21.15.151:0/4182951923 shutdown_connections 2023-07-21T22:25:20.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.542+0000 7f4022e52b80 1 -- 172.21.15.151:0/4182951923 wait complete. 2023-07-21T22:25:20.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.543+0000 7f4022e52b80 1 -- start start 2023-07-21T22:25:20.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.543+0000 7f4022e52b80 1 Processor -- start 2023-07-21T22:25:20.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 0x55aa279185d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa27918b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f4022e52b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 0x55aa278c1b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.593 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f4022e52b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa278c2230 con 0x55aa278b61b0 2023-07-21T22:25:20.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f4022e52b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa278c23a0 con 0x55aa278b6ac0 2023-07-21T22:25:20.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f4022e52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aa278c2560 con 0x55aa278b1930 2023-07-21T22:25:20.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f4022e52b80 10 client.0 _ll_register_callbacks cb 0x7f40000177e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:20.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f400cb9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa27918b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f400cb9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa27918b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56262/0 (socket says 172.21.15.151:56262) 2023-07-21T22:25:20.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f400cb9a700 1 -- 172.21.15.151:0/891342441 learned_addr learned my addr 172.21.15.151:0/891342441 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:20.594 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f400d39b700 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 0x55aa279185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.544+0000 7f400db9c700 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 0x55aa278c1b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f400cb9a700 1 -- 172.21.15.151:0/891342441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 msgr2=0x55aa279185d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f400cb9a700 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 0x55aa279185d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f400cb9a700 1 -- 172.21.15.151:0/891342441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 msgr2=0x55aa278c1b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f400cb9a700 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 0x55aa278c1b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f400cb9a700 1 -- 172.21.15.151:0/891342441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55aa27619c60 con 0x55aa278b61b0 2023-07-21T22:25:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f400cb9a700 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa27918b10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009590 tx=0x7f3ff8009290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bee49dc62cab91 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:20.595 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f3ff0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:20.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/891342441 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff801d040 con 0x55aa278b61b0 2023-07-21T22:25:20.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f4022e52b80 1 -- 172.21.15.151:0/891342441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ff801e040 con 0x55aa278b61b0 2023-07-21T22:25:20.596 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.545+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/891342441 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f3ff8004910 con 0x55aa278b61b0 2023-07-21T22:25:20.597 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/891342441 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ff8004ad0 con 0x55aa278b61b0 2023-07-21T22:25:20.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f4022e52b80 10 client.16728 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:20.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f4022e52b80 1 -- 172.21.15.151:0/891342441 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f40081a4c00 con 0x55aa278b61b0 2023-07-21T22:25:20.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/891342441 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ff801e040 con 0x55aa278b61b0 2023-07-21T22:25:20.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/891342441 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3ff8037cb0 con 0x55aa278b61b0 2023-07-21T22:25:20.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f4022e52b80 10 client.16728 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:20.598 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f4022e52b80 10 client.16728 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:20.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f4022e52b80 20 client.16728 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:20.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f4022e52b80 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aa27920030 0x55aa27922440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f4022e52b80 4 client.16728 mds_command: new command op to 24599 tid=0[{"prefix": "scrub status"}] 2023-07-21T22:25:20.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.546+0000 7f4022e52b80 1 -- 172.21.15.151:0/891342441 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "scrub status"}) v1 -- 0x55aa277be050 con 0x55aa27920030 2023-07-21T22:25:20.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.547+0000 7f400d39b700 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aa27920030 0x55aa27922440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.547+0000 7f3ff0ff9700 10 client.16728 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:20.599 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.547+0000 7f400d39b700 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aa27920030 0x55aa27922440 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8611d986637ac7cc server_cookie=e325e8930efc2ea0 in_seq=0 out_seq=0 2023-07-21T22:25:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.547+0000 7f3ff0ff9700 1 -- 172.21.15.151:0/891342441 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+63 (crc 0 0 0) 0x55aa277be050 con 0x55aa27920030 2023-07-21T22:25:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.547+0000 7f3ff0ff9700 10 client.16728 handle_command_reply: tid=0 2023-07-21T22:25:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.547+0000 7f4022e52b80 1 client.16728 shutdown 2023-07-21T22:25:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 -- 172.21.15.151:0/891342441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 msgr2=0x55aa27918b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa27918b10 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8009590 tx=0x7f3ff8009290 comp rx=0 tx=0).stop 2023-07-21T22:25:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 -- 172.21.15.151:0/891342441 shutdown_connections 2023-07-21T22:25:20.600 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aa27920030 0x55aa27922440 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aa278b6ac0 0x55aa278c1b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aa278b1930 0x55aa279185d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 --2- 172.21.15.151:0/891342441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aa278b61b0 0x55aa27918b10 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f3ff0ff9700 0 client.16728 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 -- 172.21.15.151:0/891342441 >> 172.21.15.151:0/891342441 conn(0x55aa278a6ef0 msgr2=0x55aa278c7790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 -- 172.21.15.151:0/891342441 shutdown_connections 2023-07-21T22:25:20.601 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 1 -- 172.21.15.151:0/891342441 wait complete. 2023-07-21T22:25:20.602 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.548+0000 7f4022e52b80 20 client.16728 trim_cache size 0 max 16384 2023-07-21T22:25:20.602 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T22:25:20.602 INFO:teuthology.orchestra.run.smithi151.stdout: "status": "no active scrubs running", 2023-07-21T22:25:20.602 INFO:teuthology.orchestra.run.smithi151.stdout: "scrubs": {} 2023-07-21T22:25:20.602 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T22:25:20.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 -- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3ff40a12c0 msgr2=0x7f3ff40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3ff40a12c0 0x7f3ff40a3770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f40000075c0 tx=0x7f4000009040 comp rx=0 tx=0).stop 2023-07-21T22:25:20.603 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 -- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4008100ce0 msgr2=0x7f4008197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4008100ce0 0x7f4008197dd0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f400400e9a0 tx=0x7f400400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 -- 172.21.15.151:0/2806660768 shutdown_connections 2023-07-21T22:25:20.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3ff40a12c0 0x7f3ff40a3770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f400810a020 0x7f400819c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4008100ce0 0x7f4008197dd0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 --2- 172.21.15.151:0/2806660768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40081015f0 0x7f4008198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 -- 172.21.15.151:0/2806660768 >> 172.21.15.151:0/2806660768 conn(0x7f40080fa4b0 msgr2=0x7f400810c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:20.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 -- 172.21.15.151:0/2806660768 shutdown_connections 2023-07-21T22:25:20.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.549+0000 7f400f5ff700 1 -- 172.21.15.151:0/2806660768 wait complete. 2023-07-21T22:25:20.614 INFO:tasks.cephfs.filesystem:all active scrubs completed 2023-07-21T22:25:20.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-07-21T22:25:20.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:20 smithi151 ceph-mon[95510]: pgmap v187: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:25:20.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.803+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/3272176392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4410c330 msgr2=0x7f8d4410e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.803+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/3272176392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4410c330 0x7f8d4410e710 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c00b0a0 tx=0x7f8d3c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.803+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/3272176392 shutdown_connections 2023-07-21T22:25:20.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.803+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/3272176392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d440728b0 0x7f8d44072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.803+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/3272176392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d4410c330 0x7f8d4410e710 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.803+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/3272176392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d440731c0 0x7f8d4410bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.803+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/3272176392 >> 172.21.15.151:0/3272176392 conn(0x7f8d440fb630 msgr2=0x7f8d440fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:20.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.803+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/3272176392 shutdown_connections 2023-07-21T22:25:20.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.803+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/3272176392 wait complete. 2023-07-21T22:25:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.805+0000 7f8d4a7ff700 1 Processor -- start 2023-07-21T22:25:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.805+0000 7f8d4a7ff700 1 -- start start 2023-07-21T22:25:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.805+0000 7f8d4a7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d440728b0 0x7f8d44197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.805+0000 7f8d4a7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d440731c0 0x7f8d441982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.805+0000 7f8d4a7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4410c330 0x7f8d4419c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.805+0000 7f8d4a7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4419cd90 con 0x7f8d440728b0 2023-07-21T22:25:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.805+0000 7f8d4a7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4419cf00 con 0x7f8d4410c330 2023-07-21T22:25:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.805+0000 7f8d4a7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4419d0c0 con 0x7f8d440731c0 2023-07-21T22:25:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.805+0000 7f8d43fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d440728b0 0x7f8d44197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d43fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d440728b0 0x7f8d44197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56282/0 (socket says 172.21.15.151:56282) 2023-07-21T22:25:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d43fff700 1 -- 172.21.15.151:0/1384016282 learned_addr learned my addr 172.21.15.151:0/1384016282 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:20.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d437fe700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d440731c0 0x7f8d441982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d48d9c700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4410c330 0x7f8d4419c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d43fff700 1 -- 172.21.15.151:0/1384016282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d440731c0 msgr2=0x7f8d441982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d43fff700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d440731c0 0x7f8d441982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d43fff700 1 -- 172.21.15.151:0/1384016282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4410c330 msgr2=0x7f8d4419c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:20.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d43fff700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4410c330 0x7f8d4419c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:20.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d43fff700 1 -- 172.21.15.151:0/1384016282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d3c009d00 con 0x7f8d440728b0 2023-07-21T22:25:20.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.806+0000 7f8d43fff700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d440728b0 0x7f8d44197db0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e9a0 tx=0x7f8d3400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:20.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.807+0000 7f8d417fa700 1 -- 172.21.15.151:0/1384016282 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34009790 con 0x7f8d440728b0 2023-07-21T22:25:20.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.807+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d4419d3a0 con 0x7f8d440728b0 2023-07-21T22:25:20.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.807+0000 7f8d417fa700 1 -- 172.21.15.151:0/1384016282 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8d34010430 con 0x7f8d440728b0 2023-07-21T22:25:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.807+0000 7f8d417fa700 1 -- 172.21.15.151:0/1384016282 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3400cea0 con 0x7f8d440728b0 2023-07-21T22:25:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.807+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d441a4be0 con 0x7f8d440728b0 2023-07-21T22:25:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.808+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d44106c50 con 0x7f8d440728b0 2023-07-21T22:25:20.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.810+0000 7f8d417fa700 1 -- 172.21.15.151:0/1384016282 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f8d340105a0 con 0x7f8d440728b0 2023-07-21T22:25:20.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.813+0000 7f8d417fa700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8d2c0a1300 0x7f8d2c0a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:20.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.813+0000 7f8d417fa700 1 -- 172.21.15.151:0/1384016282 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f8d34014070 con 0x7f8d440728b0 2023-07-21T22:25:20.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.813+0000 7f8d437fe700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8d2c0a1300 0x7f8d2c0a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:20.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.814+0000 7f8d437fe700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8d2c0a1300 0x7f8d2c0a37b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8d441993c0 tx=0x7f8d3800a380 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:20.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:20.817+0000 7f8d417fa700 1 -- 172.21.15.151:0/1384016282 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8d34051770 con 0x7f8d440728b0 2023-07-21T22:25:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:20 smithi187 ceph-mon[96918]: pgmap v187: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:25:20.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:20 smithi195 ceph-mon[97365]: pgmap v187: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:25:20.937 INFO:teuthology.orchestra.run.smithi151.stderr:25200000 of 50000000 tuples (50%) done (elapsed 344.43 s, remaining 338.96 s) 2023-07-21T22:25:21.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.103+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8d44106630 con 0x7f8d440728b0 2023-07-21T22:25:21.149 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.104+0000 7f8d417fa700 1 -- 172.21.15.151:0/1384016282 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+10827 (secure 0 0 0) 0x7f8d34096380 con 0x7f8d440728b0 2023-07-21T22:25:21.150 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T22:25:21.150 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":34,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14589,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2869868293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2869868293},{"type":"v1","addr":"172.21.15.151:6835","nonce":2869868293}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":4},{"gid":14601,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1023251552","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1023251552},{"type":"v1","addr":"172.21.15.151:6837","nonce":1023251552}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":5},{"gid":14640,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.195:6837/87317468","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6836","nonce":87317468},{"type":"v1","addr":"172.21.15.195:6837","nonce":87317468}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":8},{"gid":14676,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/721992458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":721992458},{"type":"v1","addr":"172.21.15.151:6839","nonce":721992458}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":14694,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6841/337440051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6840","nonce":337440051},{"type":"v1","addr":"172.21.15.151:6841","nonce":337440051}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":24470,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3442978615","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3442978615},{"type":"v1","addr":"172.21.15.187:6833","nonce":3442978615}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2023-07-21T22:17:09.358855+0000","modified":"2023-07-21T22:24:54.326513+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24599,"mds_1":24574,"mds_2":24548},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24475":{"gid":24475,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6833/2796106198","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6832","nonce":2796106198},{"type":"v1","addr":"172.21.15.195:6833","nonce":2796106198}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24512":{"gid":24512,"name":"e","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.187:6835/3281429688","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3281429688},{"type":"v1","addr":"172.21.15.187:6835","nonce":3281429688}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24538":{"gid":24538,"name":"f","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.195:6835/3818436709","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6834","nonce":3818436709},{"type":"v1","addr":"172.21.15.195:6835","nonce":3818436709}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24548":{"gid":24548,"name":"h","rank":2,"incarnation":21,"state":"up:active","state_seq":122,"addr":"172.21.15.187:6837/1053006516","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6836","nonce":1053006516},{"type":"v1","addr":"172.21.15.187:6837","nonce":1053006516}]},"join_fscid":-1,"export_targets":[0,1],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24574":{"gid":24574,"name":"i","rank":1,"incarnation":19,"state":"up:active","state_seq":6,"addr":"172.21.15.195:6839/2311441690","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6838","nonce":2311441690},{"type":"v1","addr":"172.21.15.195:6839","nonce":2311441690}]},"join_fscid":-1,"export_targets":[0,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24599":{"gid":24599,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6839/1236119832","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6838","nonce":1236119832},{"type":"v1","addr":"172.21.15.187:6839","nonce":1236119832}]},"join_fscid":-1,"export_targets":[1,2],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-07-21T22:25:21.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.106+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8d2c0a1300 msgr2=0x7f8d2c0a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.152 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.106+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8d2c0a1300 0x7f8d2c0a37b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8d441993c0 tx=0x7f8d3800a380 comp rx=0 tx=0).stop 2023-07-21T22:25:21.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.106+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d440728b0 msgr2=0x7f8d44197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.106+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d440728b0 0x7f8d44197db0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f8d3400e9a0 tx=0x7f8d3400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.107+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 shutdown_connections 2023-07-21T22:25:21.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.107+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8d2c0a1300 0x7f8d2c0a37b0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.107+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4410c330 0x7f8d4419c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.107+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d440728b0 0x7f8d44197db0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.153 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.107+0000 7f8d4a7ff700 1 --2- 172.21.15.151:0/1384016282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8d440731c0 0x7f8d441982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.107+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 >> 172.21.15.151:0/1384016282 conn(0x7f8d440fb630 msgr2=0x7f8d44103d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.107+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 shutdown_connections 2023-07-21T22:25:21.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.107+0000 7f8d4a7ff700 1 -- 172.21.15.151:0/1384016282 wait complete. 2023-07-21T22:25:21.154 INFO:teuthology.orchestra.run.smithi151.stderr:dumped fsmap epoch 34 2023-07-21T22:25:21.172 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2023-07-21T22:25:21.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.354+0000 7f0dd0dff700 1 -- 172.21.15.151:0/3124689562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc105ae0 msgr2=0x7f0dcc105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.354+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/3124689562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc105ae0 0x7f0dcc105eb0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc009990 tx=0x7f0dbc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.354+0000 7f0dd0dff700 1 -- 172.21.15.151:0/3124689562 shutdown_connections 2023-07-21T22:25:21.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.354+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/3124689562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dcc100480 0x7f0dcc10c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.354+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/3124689562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc105ae0 0x7f0dcc105eb0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.354+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/3124689562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dcc0ffad0 0x7f0dcc0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.354+0000 7f0dd0dff700 1 -- 172.21.15.151:0/3124689562 >> 172.21.15.151:0/3124689562 conn(0x7f0dcc0fb5f0 msgr2=0x7f0dcc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.354+0000 7f0dd0dff700 1 -- 172.21.15.151:0/3124689562 shutdown_connections 2023-07-21T22:25:21.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.354+0000 7f0dd0dff700 1 -- 172.21.15.151:0/3124689562 wait complete. 2023-07-21T22:25:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.355+0000 7f0dd0dff700 1 Processor -- start 2023-07-21T22:25:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.355+0000 7f0dd0dff700 1 -- start start 2023-07-21T22:25:21.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dd0dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dcc0ffad0 0x7f0dcc19b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dd0dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc100480 0x7f0dcc19be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dd0dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dcc105ae0 0x7f0dcc195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dd0dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc195fc0 con 0x7f0dcc100480 2023-07-21T22:25:21.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dd0dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc196130 con 0x7f0dcc0ffad0 2023-07-21T22:25:21.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dd0dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dcc1962f0 con 0x7f0dcc105ae0 2023-07-21T22:25:21.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dc9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc100480 0x7f0dcc19be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dc9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc100480 0x7f0dcc19be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56296/0 (socket says 172.21.15.151:56296) 2023-07-21T22:25:21.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/1976516935 learned_addr learned my addr 172.21.15.151:0/1976516935 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dcad9d700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dcc105ae0 0x7f0dcc195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.356+0000 7f0dca59c700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dcc0ffad0 0x7f0dcc19b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/1976516935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dcc105ae0 msgr2=0x7f0dcc195950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dcc105ae0 0x7f0dcc195950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/1976516935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dcc0ffad0 msgr2=0x7f0dcc19b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dcc0ffad0 0x7f0dcc19b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/1976516935 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dbc0095f0 con 0x7f0dcc100480 2023-07-21T22:25:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc100480 0x7f0dcc19be20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000d950 tx=0x7f0dc000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dbb7fe700 1 -- 172.21.15.151:0/1976516935 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000f890 con 0x7f0dcc100480 2023-07-21T22:25:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dbb7fe700 1 -- 172.21.15.151:0/1976516935 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dc000fe80 con 0x7f0dcc100480 2023-07-21T22:25:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dd0dff700 1 -- 172.21.15.151:0/1976516935 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dcc1965d0 con 0x7f0dcc100480 2023-07-21T22:25:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dbb7fe700 1 -- 172.21.15.151:0/1976516935 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc000e3b0 con 0x7f0dcc100480 2023-07-21T22:25:21.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.357+0000 7f0dd0dff700 1 -- 172.21.15.151:0/1976516935 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc1a28d0 con 0x7f0dcc100480 2023-07-21T22:25:21.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.361+0000 7f0dbb7fe700 1 -- 172.21.15.151:0/1976516935 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0dc0010460 con 0x7f0dcc100480 2023-07-21T22:25:21.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.363+0000 7f0dbb7fe700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0db40a1340 0x7f0db40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.363+0000 7f0de469bb80 1 Processor -- start 2023-07-21T22:25:21.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.363+0000 7f0dbb7fe700 1 -- 172.21.15.151:0/1976516935 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0dc00cca70 con 0x7f0dcc100480 2023-07-21T22:25:21.409 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.363+0000 7f0dca59c700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0db40a1340 0x7f0db40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.363+0000 7f0de469bb80 1 -- start start 2023-07-21T22:25:21.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e34a0 0x55a1a14e3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e8450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 0x55a1a14e8de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0de469bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a13e3cb0 con 0x55a1a14e3db0 2023-07-21T22:25:21.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0de469bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a1436a40 con 0x55a1a14e8990 2023-07-21T22:25:21.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0de469bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a142fed0 con 0x55a1a14e34a0 2023-07-21T22:25:21.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dc9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dca59c700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0db40a1340 0x7f0db40a37f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00b5c0 tx=0x7f0dbc005fb0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dc9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56300/0 (socket says 172.21.15.151:56300) 2023-07-21T22:25:21.411 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/1937366695 learned_addr learned my addr 172.21.15.151:0/1937366695 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dcad9d700 1 --2- 172.21.15.151:0/1937366695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 0x55a1a14e8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.412 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/1937366695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e34a0 msgr2=0x55a1a14e3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/1937366695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e34a0 0x55a1a14e3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/1937366695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 msgr2=0x55a1a14e8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/1937366695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 0x55a1a14e8de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/1937366695 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1a125dde0 con 0x55a1a14e3db0 2023-07-21T22:25:21.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.364+0000 7f0dcad9d700 1 --2- 172.21.15.151:0/1937366695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 0x55a1a14e8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:25:21.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.365+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/1937366695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e8450 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00965c0 tx=0x7f0dc0010760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8604a95da006228a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.413 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.365+0000 7f0db8ff9700 1 -- 172.21.15.151:0/1937366695 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc009db80 con 0x55a1a14e3db0 2023-07-21T22:25:21.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.365+0000 7f0db8ff9700 1 -- 172.21.15.151:0/1937366695 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dc00a1fa0 con 0x55a1a14e3db0 2023-07-21T22:25:21.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.365+0000 7f0db8ff9700 1 -- 172.21.15.151:0/1937366695 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00a1d70 con 0x55a1a14e3db0 2023-07-21T22:25:21.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 -- 172.21.15.151:0/1937366695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 msgr2=0x55a1a14e8450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 --2- 172.21.15.151:0/1937366695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e8450 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0dc00965c0 tx=0x7f0dc0010760 comp rx=0 tx=0).stop 2023-07-21T22:25:21.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 -- 172.21.15.151:0/1937366695 shutdown_connections 2023-07-21T22:25:21.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 --2- 172.21.15.151:0/1937366695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 0x55a1a14e8de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.414 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 --2- 172.21.15.151:0/1937366695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e34a0 0x55a1a14e3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 --2- 172.21.15.151:0/1937366695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e8450 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 -- 172.21.15.151:0/1937366695 >> 172.21.15.151:0/1937366695 conn(0x55a1a14d3ef0 msgr2=0x55a1a14d96b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 -- 172.21.15.151:0/1937366695 shutdown_connections 2023-07-21T22:25:21.415 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 -- 172.21.15.151:0/1937366695 wait complete. 2023-07-21T22:25:21.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.366+0000 7f0de469bb80 1 -- start start 2023-07-21T22:25:21.416 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.367+0000 7f0de469bb80 1 Processor -- start 2023-07-21T22:25:21.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e34a0 0x55a1a14eefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e3db0 0x55a1a14ec2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 0x55a1a14eca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0de469bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a13cfac0 con 0x55a1a14e34a0 2023-07-21T22:25:21.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0de469bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a13cf7c0 con 0x55a1a14e8990 2023-07-21T22:25:21.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0de469bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a12b3920 con 0x55a1a14e3db0 2023-07-21T22:25:21.418 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0de469bb80 10 client.0 _ll_register_callbacks cb 0x55a1a13cd760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:21.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0dc9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e3db0 0x55a1a14ec2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0dc9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e3db0 0x55a1a14ec2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:55682/0 (socket says 172.21.15.151:55682) 2023-07-21T22:25:21.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0dca59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e34a0 0x55a1a14eefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/2591856345 learned_addr learned my addr 172.21.15.151:0/2591856345 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0dcad9d700 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 0x55a1a14eca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/2591856345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 msgr2=0x55a1a14eca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.419 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 0x55a1a14eca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/2591856345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e34a0 msgr2=0x55a1a14eefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.368+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e34a0 0x55a1a14eefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.369+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/2591856345 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dcc1a28d0 con 0x55a1a14e3db0 2023-07-21T22:25:21.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.369+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e3db0 0x55a1a14ec2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0099ae0 tx=0x7f0dc0000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d7f2019942f029d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.369+0000 7f0db1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:25:21.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.369+0000 7f0db1ffb700 1 -- 172.21.15.151:0/2591856345 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00b22e0 con 0x55a1a14e3db0 2023-07-21T22:25:21.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.369+0000 7f0db1ffb700 1 -- 172.21.15.151:0/2591856345 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0dc0099db0 con 0x55a1a14e3db0 2023-07-21T22:25:21.420 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.369+0000 7f0de469bb80 1 -- 172.21.15.151:0/2591856345 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a1a13894f0 con 0x55a1a14e3db0 2023-07-21T22:25:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.369+0000 7f0db1ffb700 1 -- 172.21.15.151:0/2591856345 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dc0099f70 con 0x55a1a14e3db0 2023-07-21T22:25:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.369+0000 7f0de469bb80 10 client.26500 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.369+0000 7f0de469bb80 1 -- 172.21.15.151:0/2591856345 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a1a1246c60 con 0x55a1a14e3db0 2023-07-21T22:25:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.370+0000 7f0db1ffb700 1 -- 172.21.15.151:0/2591856345 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a1a13894f0 con 0x55a1a14e3db0 2023-07-21T22:25:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.370+0000 7f0db1ffb700 1 -- 172.21.15.151:0/2591856345 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0dc0095b40 con 0x55a1a14e3db0 2023-07-21T22:25:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.370+0000 7f0de469bb80 10 client.26500 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:21.421 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.370+0000 7f0de469bb80 10 client.26500 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:25:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.370+0000 7f0de469bb80 20 client.26500 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.370+0000 7f0de469bb80 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55a1a14fc160 0x55a1a14fe540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.370+0000 7f0de469bb80 4 client.26500 mds_command: new command op to 24548 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:25:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.370+0000 7f0de469bb80 1 -- 172.21.15.151:0/2591856345 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a1a1428eb0 con 0x55a1a14fc160 2023-07-21T22:25:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.370+0000 7f0dca59c700 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55a1a14fc160 0x55a1a14fe540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.371+0000 7f0db1ffb700 10 client.26500 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:25:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.371+0000 7f0dca59c700 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55a1a14fc160 0x55a1a14fe540 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a31f2edc1c00d41b server_cookie=9702f944ac6cc364 in_seq=0 out_seq=0 2023-07-21T22:25:21.422 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.372+0000 7f0db1ffb700 1 -- 172.21.15.151:0/2591856345 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a1a1428eb0 con 0x55a1a14fc160 2023-07-21T22:25:21.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.372+0000 7f0db1ffb700 10 client.26500 handle_command_reply: tid=0 2023-07-21T22:25:21.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.372+0000 7f0de469bb80 1 client.26500 shutdown 2023-07-21T22:25:21.423 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.372+0000 7f0de469bb80 1 -- 172.21.15.151:0/2591856345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e3db0 msgr2=0x55a1a14ec2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.372+0000 7f0de469bb80 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e3db0 0x55a1a14ec2f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0099ae0 tx=0x7f0dc0000bc0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0de469bb80 1 -- 172.21.15.151:0/2591856345 shutdown_connections 2023-07-21T22:25:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0de469bb80 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55a1a14fc160 0x55a1a14fe540 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0de469bb80 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e8990 0x55a1a14eca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0db1ffb700 0 client.26500 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:25:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0de469bb80 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e34a0 0x55a1a14eefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.424 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0de469bb80 1 --2- 172.21.15.151:0/2591856345 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e3db0 0x55a1a14ec2f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0de469bb80 1 -- 172.21.15.151:0/2591856345 >> 172.21.15.151:0/2591856345 conn(0x55a1a14d3ef0 msgr2=0x55a1a14d92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0de469bb80 1 -- 172.21.15.151:0/2591856345 shutdown_connections 2023-07-21T22:25:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0de469bb80 1 -- 172.21.15.151:0/2591856345 wait complete. 2023-07-21T22:25:21.425 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.373+0000 7f0de469bb80 20 client.26500 trim_cache size 0 max 16384 2023-07-21T22:25:21.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.390+0000 7f0de469bb80 1 Processor -- start 2023-07-21T22:25:21.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.390+0000 7f0de469bb80 1 -- start start 2023-07-21T22:25:21.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.390+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 0x55a1a14e6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.390+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.390+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14d7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.390+0000 7f0de469bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a14ea2b0 con 0x55a1a14e3db0 2023-07-21T22:25:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.390+0000 7f0de469bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a14ec2b0 con 0x55a1a14e34a0 2023-07-21T22:25:21.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.390+0000 7f0de469bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a14d84a0 con 0x55a1a14e8990 2023-07-21T22:25:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dcad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14d7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dcad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14d7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:55688/0 (socket says 172.21.15.151:55688) 2023-07-21T22:25:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dcad9d700 1 -- 172.21.15.151:0/195234133 learned_addr learned my addr 172.21.15.151:0/195234133 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.438 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dca59c700 1 --2- 172.21.15.151:0/195234133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 0x55a1a14e6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/195234133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dcad9d700 1 -- 172.21.15.151:0/195234133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 msgr2=0x55a1a14e6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dcad9d700 1 --2- 172.21.15.151:0/195234133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 0x55a1a14e6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dcad9d700 1 -- 172.21.15.151:0/195234133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 msgr2=0x55a1a14e9d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dcad9d700 1 --2- 172.21.15.151:0/195234133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e9d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.391+0000 7f0dcad9d700 1 -- 172.21.15.151:0/195234133 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a1a1284250 con 0x55a1a14e8990 2023-07-21T22:25:21.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.392+0000 7f0dcad9d700 1 --2- 172.21.15.151:0/195234133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14d7f60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009e00 tx=0x7f0dc4009100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=151acfffd230774d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.393+0000 7f0db97fa700 1 -- 172.21.15.151:0/195234133 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4007e60 con 0x55a1a14e8990 2023-07-21T22:25:21.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.393+0000 7f0db97fa700 1 -- 172.21.15.151:0/195234133 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dc400f070 con 0x55a1a14e8990 2023-07-21T22:25:21.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.393+0000 7f0db97fa700 1 -- 172.21.15.151:0/195234133 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4004570 con 0x55a1a14e8990 2023-07-21T22:25:21.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.394+0000 7f0de469bb80 1 -- 172.21.15.151:0/195234133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 msgr2=0x55a1a14d7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.394+0000 7f0de469bb80 1 --2- 172.21.15.151:0/195234133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14d7f60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0dc4009e00 tx=0x7f0dc4009100 comp rx=0 tx=0).stop 2023-07-21T22:25:21.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.394+0000 7f0de469bb80 1 -- 172.21.15.151:0/195234133 shutdown_connections 2023-07-21T22:25:21.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.394+0000 7f0de469bb80 1 --2- 172.21.15.151:0/195234133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 0x55a1a14e6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.394+0000 7f0de469bb80 1 --2- 172.21.15.151:0/195234133 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14d7f60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.394+0000 7f0de469bb80 1 --2- 172.21.15.151:0/195234133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14e9d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.441 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.394+0000 7f0de469bb80 1 -- 172.21.15.151:0/195234133 >> 172.21.15.151:0/195234133 conn(0x55a1a14d3ef0 msgr2=0x55a1a14f8980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.394+0000 7f0de469bb80 1 -- 172.21.15.151:0/195234133 shutdown_connections 2023-07-21T22:25:21.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.395+0000 7f0de469bb80 1 -- 172.21.15.151:0/195234133 wait complete. 2023-07-21T22:25:21.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.395+0000 7f0de469bb80 1 -- start start 2023-07-21T22:25:21.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.395+0000 7f0de469bb80 1 Processor -- start 2023-07-21T22:25:21.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 0x55a1a14f3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14f1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0de469bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14f2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0de469bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a14f2ae0 con 0x55a1a14e3db0 2023-07-21T22:25:21.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0de469bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a154ffd0 con 0x55a1a14e34a0 2023-07-21T22:25:21.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0de469bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a1a1550110 con 0x55a1a14e8990 2023-07-21T22:25:21.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0de469bb80 10 client.0 _ll_register_callbacks cb 0x7f0dc00994b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:21.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0dc9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14f1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0dc9d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14f1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56326/0 (socket says 172.21.15.151:56326) 2023-07-21T22:25:21.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/409968296 learned_addr learned my addr 172.21.15.151:0/409968296 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0dcad9d700 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14f2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.396+0000 7f0dca59c700 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 0x55a1a14f3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/409968296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 msgr2=0x55a1a14f2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14f2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/409968296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 msgr2=0x55a1a14f3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 0x55a1a14f3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0dc9d9b700 1 -- 172.21.15.151:0/409968296 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc4009ab0 con 0x55a1a14e3db0 2023-07-21T22:25:21.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0dc9d9b700 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14f1d70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0099d10 tx=0x7f0dc0099580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f27f54a741268a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0db1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:21.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0db1ffb700 1 -- 172.21.15.151:0/409968296 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0098c70 con 0x55a1a14e3db0 2023-07-21T22:25:21.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0db1ffb700 1 -- 172.21.15.151:0/409968296 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0dc00b22e0 con 0x55a1a14e3db0 2023-07-21T22:25:21.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0de469bb80 1 -- 172.21.15.151:0/409968296 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0dc00a1fa0 con 0x55a1a14e3db0 2023-07-21T22:25:21.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0db1ffb700 1 -- 172.21.15.151:0/409968296 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0dc000f9f0 con 0x55a1a14e3db0 2023-07-21T22:25:21.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0de469bb80 10 client.16752 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:21.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.397+0000 7f0de469bb80 1 -- 172.21.15.151:0/409968296 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55a1a125c2b0 con 0x55a1a14e3db0 2023-07-21T22:25:21.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.398+0000 7f0db1ffb700 1 -- 172.21.15.151:0/409968296 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0dc00a1fa0 con 0x55a1a14e3db0 2023-07-21T22:25:21.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.398+0000 7f0db1ffb700 1 -- 172.21.15.151:0/409968296 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0dc007f050 con 0x55a1a14e3db0 2023-07-21T22:25:21.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.398+0000 7f0de469bb80 10 client.16752 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:21.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.398+0000 7f0de469bb80 10 client.16752 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.h 2023-07-21T22:25:21.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.398+0000 7f0de469bb80 20 client.16752 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:21.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.398+0000 7f0de469bb80 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55a1a1551230 0x55a1a1553610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.398+0000 7f0de469bb80 4 client.16752 mds_command: new command op to 24548 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:25:21.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.398+0000 7f0de469bb80 1 -- 172.21.15.151:0/409968296 --> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55a1a13eb050 con 0x55a1a1551230 2023-07-21T22:25:21.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.398+0000 7f0dca59c700 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55a1a1551230 0x55a1a1553610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.399+0000 7f0db1ffb700 10 client.16752 ms_handle_connect on v2:172.21.15.187:6836/1053006516 2023-07-21T22:25:21.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.399+0000 7f0dca59c700 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55a1a1551230 0x55a1a1553610 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5833418a395c329b server_cookie=55f0719561a1b477 in_seq=0 out_seq=0 2023-07-21T22:25:21.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.399+0000 7f0db1ffb700 1 -- 172.21.15.151:0/409968296 <== mds.2 v2:172.21.15.187:6836/1053006516 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+461 (crc 0 0 0) 0x55a1a13eb050 con 0x55a1a1551230 2023-07-21T22:25:21.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.399+0000 7f0db1ffb700 10 client.16752 handle_command_reply: tid=0 2023-07-21T22:25:21.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.399+0000 7f0de469bb80 1 client.16752 shutdown 2023-07-21T22:25:21.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 -- 172.21.15.151:0/409968296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 msgr2=0x55a1a14f1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14f1d70 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f0dc0099d10 tx=0x7f0dc0099580 comp rx=0 tx=0).stop 2023-07-21T22:25:21.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 -- 172.21.15.151:0/409968296 shutdown_connections 2023-07-21T22:25:21.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.187:6836/1053006516,v1:172.21.15.187:6837/1053006516] conn(0x55a1a1551230 0x55a1a1553610 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a1a14e34a0 0x55a1a14f3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0db1ffb700 0 client.16752 ms_handle_reset on v2:172.21.15.187:6836/1053006516 2023-07-21T22:25:21.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a1a14e8990 0x55a1a14f2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 --2- 172.21.15.151:0/409968296 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a1a14e3db0 0x55a1a14f1d70 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 -- 172.21.15.151:0/409968296 >> 172.21.15.151:0/409968296 conn(0x55a1a14d3ef0 msgr2=0x55a1a14e7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.451 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 -- 172.21.15.151:0/409968296 shutdown_connections 2023-07-21T22:25:21.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 1 -- 172.21.15.151:0/409968296 wait complete. 2023-07-21T22:25:21.452 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.400+0000 7f0de469bb80 20 client.16752 trim_cache size 0 max 16384 2023-07-21T22:25:21.452 INFO:teuthology.orchestra.run.smithi151.stdout:[ 2023-07-21T22:25:21.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T22:25:21.452 INFO:teuthology.orchestra.run.smithi151.stdout: "damage_type": "backtrace", 2023-07-21T22:25:21.452 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 1258011751, 2023-07-21T22:25:21.453 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 1099511628712, 2023-07-21T22:25:21.453 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/000000010000000000000083" 2023-07-21T22:25:21.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T22:25:21.453 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T22:25:21.453 INFO:teuthology.orchestra.run.smithi151.stdout: "damage_type": "backtrace", 2023-07-21T22:25:21.453 INFO:teuthology.orchestra.run.smithi151.stdout: "id": 2826495192, 2023-07-21T22:25:21.453 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 1099511628741, 2023-07-21T22:25:21.454 INFO:teuthology.orchestra.run.smithi151.stdout: "path": "/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/00000001000000000000006A" 2023-07-21T22:25:21.454 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T22:25:21.454 INFO:teuthology.orchestra.run.smithi151.stdout:] 2023-07-21T22:25:21.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 -- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0db40a1340 msgr2=0x7f0db40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0db40a1340 0x7f0db40a37f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc00b5c0 tx=0x7f0dbc005fb0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 -- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc100480 msgr2=0x7f0dcc19be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc100480 0x7f0dcc19be20 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0dc000d950 tx=0x7f0dc000dc60 comp rx=0 tx=0).stop 2023-07-21T22:25:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 -- 172.21.15.151:0/1976516935 shutdown_connections 2023-07-21T22:25:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0db40a1340 0x7f0db40a37f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0dcc0ffad0 0x7f0dcc19b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.455 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0dcc105ae0 0x7f0dcc195950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 --2- 172.21.15.151:0/1976516935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0dcc100480 0x7f0dcc19be20 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 -- 172.21.15.151:0/1976516935 >> 172.21.15.151:0/1976516935 conn(0x7f0dcc0fb5f0 msgr2=0x7f0dcc1035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 -- 172.21.15.151:0/1976516935 shutdown_connections 2023-07-21T22:25:21.456 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.401+0000 7f0dd0dff700 1 -- 172.21.15.151:0/1976516935 wait complete. 2023-07-21T22:25:21.467 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2023-07-21T22:25:21.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:21 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1384016282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:25:21.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.660+0000 7f6931bff700 1 -- 172.21.15.151:0/363628487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 msgr2=0x7f692c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.660+0000 7f6931bff700 1 --2- 172.21.15.151:0/363628487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 0x7f692c100f30 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f691c009990 tx=0x7f691c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.660+0000 7f6931bff700 1 -- 172.21.15.151:0/363628487 shutdown_connections 2023-07-21T22:25:21.706 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.660+0000 7f6931bff700 1 --2- 172.21.15.151:0/363628487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c10a080 0x7f692c10c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.660+0000 7f6931bff700 1 --2- 172.21.15.151:0/363628487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 0x7f692c100f30 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.660+0000 7f6931bff700 1 --2- 172.21.15.151:0/363628487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f692c101470 0x7f692c109b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.660+0000 7f6931bff700 1 -- 172.21.15.151:0/363628487 >> 172.21.15.151:0/363628487 conn(0x7f692c0fa4b0 msgr2=0x7f692c0fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.660+0000 7f6931bff700 1 -- 172.21.15.151:0/363628487 shutdown_connections 2023-07-21T22:25:21.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.661+0000 7f6931bff700 1 -- 172.21.15.151:0/363628487 wait complete. 2023-07-21T22:25:21.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f6931bff700 1 Processor -- start 2023-07-21T22:25:21.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f6931bff700 1 -- start start 2023-07-21T22:25:21.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f6931bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 0x7f692c195cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f6931bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c101470 0x7f692c1961f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f6931bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f692c10a080 0x7f692c1995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f6931bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c199ba0 con 0x7f692c100b60 2023-07-21T22:25:21.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f6931bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c199d10 con 0x7f692c10a080 2023-07-21T22:25:21.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f6931bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692c199ed0 con 0x7f692c101470 2023-07-21T22:25:21.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f692b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 0x7f692c195cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f692b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 0x7f692c195cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56342/0 (socket says 172.21.15.151:56342) 2023-07-21T22:25:21.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.662+0000 7f692b7fe700 1 -- 172.21.15.151:0/1171013215 learned_addr learned my addr 172.21.15.151:0/1171013215 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.663+0000 7f692affd700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c101470 0x7f692c1961f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.663+0000 7f692bfff700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f692c10a080 0x7f692c1995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.663+0000 7f692b7fe700 1 -- 172.21.15.151:0/1171013215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c101470 msgr2=0x7f692c1961f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.663+0000 7f692b7fe700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c101470 0x7f692c1961f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.663+0000 7f692b7fe700 1 -- 172.21.15.151:0/1171013215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f692c10a080 msgr2=0x7f692c1995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.663+0000 7f692b7fe700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f692c10a080 0x7f692c1995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.663+0000 7f692b7fe700 1 -- 172.21.15.151:0/1171013215 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f691c0095f0 con 0x7f692c100b60 2023-07-21T22:25:21.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.663+0000 7f692b7fe700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 0x7f692c195cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f691c005910 tx=0x7f691c009580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.664+0000 7f6928ff9700 1 -- 172.21.15.151:0/1171013215 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c01d070 con 0x7f692c100b60 2023-07-21T22:25:21.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.664+0000 7f6931bff700 1 -- 172.21.15.151:0/1171013215 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692c19a150 con 0x7f692c100b60 2023-07-21T22:25:21.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.664+0000 7f6928ff9700 1 -- 172.21.15.151:0/1171013215 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f691c004c80 con 0x7f692c100b60 2023-07-21T22:25:21.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.664+0000 7f6928ff9700 1 -- 172.21.15.151:0/1171013215 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c003a30 con 0x7f692c100b60 2023-07-21T22:25:21.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.664+0000 7f6931bff700 1 -- 172.21.15.151:0/1171013215 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c19a420 con 0x7f692c100b60 2023-07-21T22:25:21.713 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.667+0000 7f6928ff9700 1 -- 172.21.15.151:0/1171013215 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f691c004fd0 con 0x7f692c100b60 2023-07-21T22:25:21.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.669+0000 7f6928ff9700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f69140a12c0 0x7f69140a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.669+0000 7f69454c0b80 1 Processor -- start 2023-07-21T22:25:21.715 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.669+0000 7f6928ff9700 1 -- 172.21.15.151:0/1171013215 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f691c0cdb70 con 0x7f692c100b60 2023-07-21T22:25:21.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.669+0000 7f692affd700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f69140a12c0 0x7f69140a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f69454c0b80 1 -- start start 2023-07-21T22:25:21.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233992580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559233992ac0 0x55923398d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.716 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 0x55923398dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f69454c0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559233892cb0 con 0x5592339921b0 2023-07-21T22:25:21.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f69454c0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592338e5a40 con 0x55923398d930 2023-07-21T22:25:21.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f69454c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592338deed0 con 0x559233992ac0 2023-07-21T22:25:21.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f692affd700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f69140a12c0 0x7f69140a3770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f692c197280 tx=0x7f692000b410 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f692b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233992580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f692b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233992580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56354/0 (socket says 172.21.15.151:56354) 2023-07-21T22:25:21.717 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f692b7fe700 1 -- 172.21.15.151:0/845859230 learned_addr learned my addr 172.21.15.151:0/845859230 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f692affd700 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559233992ac0 0x55923398d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.718 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.670+0000 7f692bfff700 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 0x55923398dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f692b7fe700 1 -- 172.21.15.151:0/845859230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559233992ac0 msgr2=0x55923398d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f692b7fe700 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559233992ac0 0x55923398d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f692b7fe700 1 -- 172.21.15.151:0/845859230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 msgr2=0x55923398dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f692b7fe700 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 0x55923398dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.719 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f692b7fe700 1 -- 172.21.15.151:0/845859230 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55923370cde0 con 0x5592339921b0 2023-07-21T22:25:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f692affd700 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559233992ac0 0x55923398d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f692b7fe700 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233992580 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f691c097750 tx=0x7f691c004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365d841711a0aeb6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f6911ffb700 1 -- 172.21.15.151:0/845859230 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0a30a0 con 0x5592339921b0 2023-07-21T22:25:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f6911ffb700 1 -- 172.21.15.151:0/845859230 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f691c09d030 con 0x5592339921b0 2023-07-21T22:25:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.671+0000 7f6911ffb700 1 -- 172.21.15.151:0/845859230 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691c0a2c10 con 0x5592339921b0 2023-07-21T22:25:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.672+0000 7f69454c0b80 1 -- 172.21.15.151:0/845859230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 msgr2=0x559233992580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.672+0000 7f69454c0b80 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233992580 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f691c097750 tx=0x7f691c004df0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.720 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.672+0000 7f69454c0b80 1 -- 172.21.15.151:0/845859230 shutdown_connections 2023-07-21T22:25:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.672+0000 7f69454c0b80 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 0x55923398dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.672+0000 7f69454c0b80 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233992580 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.672+0000 7f69454c0b80 1 --2- 172.21.15.151:0/845859230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559233992ac0 0x55923398d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.672+0000 7f69454c0b80 1 -- 172.21.15.151:0/845859230 >> 172.21.15.151:0/845859230 conn(0x559233982ef0 msgr2=0x559233988830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.672+0000 7f69454c0b80 1 -- 172.21.15.151:0/845859230 shutdown_connections 2023-07-21T22:25:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.672+0000 7f69454c0b80 1 -- 172.21.15.151:0/845859230 wait complete. 2023-07-21T22:25:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.673+0000 7f69454c0b80 1 -- start start 2023-07-21T22:25:21.721 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.673+0000 7f69454c0b80 1 Processor -- start 2023-07-21T22:25:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 0x559233999b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233996d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 0x559233997360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f69454c0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923387eac0 con 0x5592339921b0 2023-07-21T22:25:21.724 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f69454c0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923387e7c0 con 0x559233992ac0 2023-07-21T22:25:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f69454c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559233762920 con 0x55923398d930 2023-07-21T22:25:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f69454c0b80 10 client.0 _ll_register_callbacks cb 0x55923387c760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233996d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233996d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56358/0 (socket says 172.21.15.151:56358) 2023-07-21T22:25:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692affd700 1 -- 172.21.15.151:0/3031773420 learned_addr learned my addr 172.21.15.151:0/3031773420 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692bfff700 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 0x559233997360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.725 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692b7fe700 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 0x559233999b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692affd700 1 -- 172.21.15.151:0/3031773420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 msgr2=0x559233999b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692affd700 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 0x559233999b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692affd700 1 -- 172.21.15.151:0/3031773420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 msgr2=0x559233997360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692affd700 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 0x559233997360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.674+0000 7f692affd700 1 -- 172.21.15.151:0/3031773420 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6920010c20 con 0x5592339921b0 2023-07-21T22:25:21.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.675+0000 7f692affd700 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233996d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6920011770 tx=0x7f69200047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b69bac4c72492c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.675+0000 7f690affd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:21.726 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.675+0000 7f690affd700 1 -- 172.21.15.151:0/3031773420 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692001e830 con 0x5592339921b0 2023-07-21T22:25:21.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.675+0000 7f69454c0b80 1 -- 172.21.15.151:0/3031773420 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5592338384f0 con 0x5592339921b0 2023-07-21T22:25:21.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.675+0000 7f690affd700 1 -- 172.21.15.151:0/3031773420 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6920017070 con 0x5592339921b0 2023-07-21T22:25:21.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.675+0000 7f690affd700 1 -- 172.21.15.151:0/3031773420 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f692001e990 con 0x5592339921b0 2023-07-21T22:25:21.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.675+0000 7f69454c0b80 10 client.16764 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:21.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.675+0000 7f69454c0b80 1 -- 172.21.15.151:0/3031773420 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f692c19a420 con 0x5592339921b0 2023-07-21T22:25:21.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.676+0000 7f690affd700 1 -- 172.21.15.151:0/3031773420 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5592338384f0 con 0x5592339921b0 2023-07-21T22:25:21.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.676+0000 7f690affd700 1 -- 172.21.15.151:0/3031773420 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6920028ad0 con 0x5592339921b0 2023-07-21T22:25:21.727 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.676+0000 7f69454c0b80 10 client.16764 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:21.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.676+0000 7f69454c0b80 10 client.16764 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:25:21.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.676+0000 7f69454c0b80 20 client.16764 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:21.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.676+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5592339ab5c0 0x5592339ad9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.676+0000 7f69454c0b80 4 client.16764 mds_command: new command op to 24574 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:25:21.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.676+0000 7f69454c0b80 1 -- 172.21.15.151:0/3031773420 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5592338d7eb0 con 0x5592339ab5c0 2023-07-21T22:25:21.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.677+0000 7f692b7fe700 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5592339ab5c0 0x5592339ad9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.728 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.677+0000 7f692b7fe700 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5592339ab5c0 0x5592339ad9d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98ce041897a820dd server_cookie=cc7ce6650603aa70 in_seq=0 out_seq=0 2023-07-21T22:25:21.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.677+0000 7f690affd700 10 client.16764 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:25:21.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f690affd700 1 -- 172.21.15.151:0/3031773420 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5592338d7eb0 con 0x5592339ab5c0 2023-07-21T22:25:21.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f690affd700 10 client.16764 handle_command_reply: tid=0 2023-07-21T22:25:21.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 client.16764 shutdown 2023-07-21T22:25:21.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 -- 172.21.15.151:0/3031773420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 msgr2=0x559233996d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233996d80 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6920011770 tx=0x7f69200047c0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 -- 172.21.15.151:0/3031773420 shutdown_connections 2023-07-21T22:25:21.729 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x5592339ab5c0 0x5592339ad9d0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 0x559233997360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 0x559233999b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f690affd700 0 client.16764 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:25:21.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3031773420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x559233996d80 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 -- 172.21.15.151:0/3031773420 >> 172.21.15.151:0/3031773420 conn(0x559233982ef0 msgr2=0x5592339883c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 -- 172.21.15.151:0/3031773420 shutdown_connections 2023-07-21T22:25:21.730 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.678+0000 7f69454c0b80 1 -- 172.21.15.151:0/3031773420 wait complete. 2023-07-21T22:25:21.731 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.679+0000 7f69454c0b80 20 client.16764 trim_cache size 0 max 16384 2023-07-21T22:25:21.737 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.692+0000 7f69454c0b80 1 Processor -- start 2023-07-21T22:25:21.738 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.692+0000 7f69454c0b80 1 -- start start 2023-07-21T22:25:21.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.692+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 0x55923398dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.692+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x55923399e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.692+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 0x559233986f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.692+0000 7f69454c0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5592338384f0 con 0x5592339921b0 2023-07-21T22:25:21.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.692+0000 7f69454c0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923398c270 con 0x559233992ac0 2023-07-21T22:25:21.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.692+0000 7f69454c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559233989dd0 con 0x55923398d930 2023-07-21T22:25:21.739 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x55923399e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x55923399e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56372/0 (socket says 172.21.15.151:56372) 2023-07-21T22:25:21.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692affd700 1 -- 172.21.15.151:0/3381474636 learned_addr learned my addr 172.21.15.151:0/3381474636 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692b7fe700 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 0x55923398dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692bfff700 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 0x559233986f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692affd700 1 -- 172.21.15.151:0/3381474636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 msgr2=0x55923398dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692affd700 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 0x55923398dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692affd700 1 -- 172.21.15.151:0/3381474636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 msgr2=0x559233986f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.740 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692affd700 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 0x559233986f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692affd700 1 -- 172.21.15.151:0/3381474636 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5592336f5c60 con 0x5592339921b0 2023-07-21T22:25:21.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692bfff700 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 0x559233986f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:25:21.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.693+0000 7f692affd700 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x55923399e380 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6920000c00 tx=0x7f692000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a8b9d399df56c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.694+0000 7f69127fc700 1 -- 172.21.15.151:0/3381474636 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6920010ac0 con 0x5592339921b0 2023-07-21T22:25:21.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.694+0000 7f69127fc700 1 -- 172.21.15.151:0/3381474636 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6920015070 con 0x5592339921b0 2023-07-21T22:25:21.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.694+0000 7f69127fc700 1 -- 172.21.15.151:0/3381474636 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f692001ea00 con 0x5592339921b0 2023-07-21T22:25:21.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.694+0000 7f69454c0b80 1 -- 172.21.15.151:0/3381474636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 msgr2=0x55923399e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.694+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x55923399e380 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f6920000c00 tx=0x7f692000bf90 comp rx=0 tx=0).stop 2023-07-21T22:25:21.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.695+0000 7f69454c0b80 1 -- 172.21.15.151:0/3381474636 shutdown_connections 2023-07-21T22:25:21.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.695+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559233992ac0 0x559233986f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.695+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55923398d930 0x55923398dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.695+0000 7f69454c0b80 1 --2- 172.21.15.151:0/3381474636 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5592339921b0 0x55923399e380 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.743 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.695+0000 7f69454c0b80 1 -- 172.21.15.151:0/3381474636 >> 172.21.15.151:0/3381474636 conn(0x559233982ef0 msgr2=0x5592339a78f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.695+0000 7f69454c0b80 1 -- 172.21.15.151:0/3381474636 shutdown_connections 2023-07-21T22:25:21.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.695+0000 7f69454c0b80 1 -- 172.21.15.151:0/3381474636 wait complete. 2023-07-21T22:25:21.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.695+0000 7f69454c0b80 1 -- start start 2023-07-21T22:25:21.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.695+0000 7f69454c0b80 1 Processor -- start 2023-07-21T22:25:21.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 0x55923399da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592339921b0 0x55923399df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f69454c0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559233992ac0 0x55923399c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f69454c0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923399c930 con 0x559233992ac0 2023-07-21T22:25:21.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f69454c0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923399caa0 con 0x55923398d930 2023-07-21T22:25:21.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f69454c0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55923399cc60 con 0x5592339921b0 2023-07-21T22:25:21.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f69454c0b80 10 client.0 _ll_register_callbacks cb 0x7f6920010f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:21.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f692bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559233992ac0 0x55923399c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f692b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 0x55923399da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.696+0000 7f692bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559233992ac0 0x55923399c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56382/0 (socket says 172.21.15.151:56382) 2023-07-21T22:25:21.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.697+0000 7f692bfff700 1 -- 172.21.15.151:0/2878918493 learned_addr learned my addr 172.21.15.151:0/2878918493 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:21.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.697+0000 7f692affd700 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592339921b0 0x55923399df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.697+0000 7f692bfff700 1 -- 172.21.15.151:0/2878918493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592339921b0 msgr2=0x55923399df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.697+0000 7f692bfff700 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592339921b0 0x55923399df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.697+0000 7f692bfff700 1 -- 172.21.15.151:0/2878918493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 msgr2=0x55923399da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:21.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.697+0000 7f692bfff700 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 0x55923399da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.697+0000 7f692bfff700 1 -- 172.21.15.151:0/2878918493 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f692c19a420 con 0x559233992ac0 2023-07-21T22:25:21.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.697+0000 7f692bfff700 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559233992ac0 0x55923399c310 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6924016e80 tx=0x7f6924016eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871b3585fa4360dd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:21.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.697+0000 7f690affd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:21.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.698+0000 7f690affd700 1 -- 172.21.15.151:0/2878918493 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69240148a0 con 0x559233992ac0 2023-07-21T22:25:21.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.698+0000 7f69454c0b80 1 -- 172.21.15.151:0/2878918493 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f691c09d030 con 0x559233992ac0 2023-07-21T22:25:21.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.698+0000 7f690affd700 1 -- 172.21.15.151:0/2878918493 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f6924014a00 con 0x559233992ac0 2023-07-21T22:25:21.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.698+0000 7f690affd700 1 -- 172.21.15.151:0/2878918493 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6924014bc0 con 0x559233992ac0 2023-07-21T22:25:21.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.698+0000 7f69454c0b80 10 client.16770 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:21.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.698+0000 7f69454c0b80 1 -- 172.21.15.151:0/2878918493 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x559233733250 con 0x559233992ac0 2023-07-21T22:25:21.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.698+0000 7f690affd700 1 -- 172.21.15.151:0/2878918493 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f691c09d030 con 0x559233992ac0 2023-07-21T22:25:21.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.699+0000 7f690affd700 1 -- 172.21.15.151:0/2878918493 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6924017430 con 0x559233992ac0 2023-07-21T22:25:21.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.699+0000 7f69454c0b80 10 client.16770 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:21.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.699+0000 7f69454c0b80 10 client.16770 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2023-07-21T22:25:21.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.699+0000 7f69454c0b80 20 client.16770 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:21.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.699+0000 7f69454c0b80 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x559233a00590 0x559233a029a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:21.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.699+0000 7f69454c0b80 4 client.16770 mds_command: new command op to 24574 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:25:21.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.699+0000 7f69454c0b80 1 -- 172.21.15.151:0/2878918493 --> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x55923389a050 con 0x559233a00590 2023-07-21T22:25:21.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.699+0000 7f692b7fe700 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x559233a00590 0x559233a029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:21.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.700+0000 7f692b7fe700 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x559233a00590 0x559233a029a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=470cf19ca9623c37 server_cookie=90f7a35a202ea642 in_seq=0 out_seq=0 2023-07-21T22:25:21.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.700+0000 7f690affd700 10 client.16770 ms_handle_connect on v2:172.21.15.195:6838/2311441690 2023-07-21T22:25:21.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.700+0000 7f690affd700 1 -- 172.21.15.151:0/2878918493 <== mds.1 v2:172.21.15.195:6838/2311441690 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x55923389a050 con 0x559233a00590 2023-07-21T22:25:21.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.700+0000 7f690affd700 10 client.16770 handle_command_reply: tid=0 2023-07-21T22:25:21.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.700+0000 7f69454c0b80 1 client.16770 shutdown 2023-07-21T22:25:21.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.700+0000 7f69454c0b80 1 -- 172.21.15.151:0/2878918493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559233992ac0 msgr2=0x55923399c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559233992ac0 0x55923399c310 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f6924016e80 tx=0x7f6924016eb0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 1 -- 172.21.15.151:0/2878918493 shutdown_connections 2023-07-21T22:25:21.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.195:6838/2311441690,v1:172.21.15.195:6839/2311441690] conn(0x559233a00590 0x559233a029a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55923398d930 0x55923399da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559233992ac0 0x55923399c310 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 1 --2- 172.21.15.151:0/2878918493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5592339921b0 0x55923399df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 1 -- 172.21.15.151:0/2878918493 >> 172.21.15.151:0/2878918493 conn(0x559233982ef0 msgr2=0x559233986f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f690affd700 0 client.16770 ms_handle_reset on v2:172.21.15.195:6838/2311441690 2023-07-21T22:25:21.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 1 -- 172.21.15.151:0/2878918493 shutdown_connections 2023-07-21T22:25:21.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 1 -- 172.21.15.151:0/2878918493 wait complete. 2023-07-21T22:25:21.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.701+0000 7f69454c0b80 20 client.16770 trim_cache size 0 max 16384 2023-07-21T22:25:21.753 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:25:21.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 -- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f69140a12c0 msgr2=0x7f69140a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f69140a12c0 0x7f69140a3770 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f692c197280 tx=0x7f692000b410 comp rx=0 tx=0).stop 2023-07-21T22:25:21.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 -- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 msgr2=0x7f692c195cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:21.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 0x7f692c195cb0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f691c005910 tx=0x7f691c009580 comp rx=0 tx=0).stop 2023-07-21T22:25:21.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 -- 172.21.15.151:0/1171013215 shutdown_connections 2023-07-21T22:25:21.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f69140a12c0 0x7f69140a3770 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f692c10a080 0x7f692c1995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.754 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f692c100b60 0x7f692c195cb0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 --2- 172.21.15.151:0/1171013215 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f692c101470 0x7f692c1961f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:21.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 -- 172.21.15.151:0/1171013215 >> 172.21.15.151:0/1171013215 conn(0x7f692c0fa4b0 msgr2=0x7f692c10c260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:21.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 -- 172.21.15.151:0/1171013215 shutdown_connections 2023-07-21T22:25:21.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.702+0000 7f6931bff700 1 -- 172.21.15.151:0/1171013215 wait complete. 2023-07-21T22:25:21.771 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2023-07-21T22:25:21.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:21 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1384016282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:25:21.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:21 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1384016282' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2023-07-21T22:25:22.015 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.970+0000 7f1a075ff700 1 -- 172.21.15.151:0/1142912122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a001015b0 msgr2=0x7f1a00109aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.970+0000 7f1a075ff700 1 --2- 172.21.15.151:0/1142912122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a001015b0 0x7f1a00109aa0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009990 tx=0x7f19f0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.970+0000 7f1a075ff700 1 -- 172.21.15.151:0/1142912122 shutdown_connections 2023-07-21T22:25:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.970+0000 7f1a075ff700 1 --2- 172.21.15.151:0/1142912122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a00100ca0 0x7f1a00101070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.970+0000 7f1a075ff700 1 --2- 172.21.15.151:0/1142912122 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a0010a070 0x7f1a0010c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.016 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.970+0000 7f1a075ff700 1 --2- 172.21.15.151:0/1142912122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a001015b0 0x7f1a00109aa0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.970+0000 7f1a075ff700 1 -- 172.21.15.151:0/1142912122 >> 172.21.15.151:0/1142912122 conn(0x7f1a000fa4b0 msgr2=0x7f1a000fc8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.970+0000 7f1a075ff700 1 -- 172.21.15.151:0/1142912122 shutdown_connections 2023-07-21T22:25:22.017 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.970+0000 7f1a075ff700 1 -- 172.21.15.151:0/1142912122 wait complete. 2023-07-21T22:25:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.971+0000 7f1a075ff700 1 Processor -- start 2023-07-21T22:25:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.971+0000 7f1a075ff700 1 -- start start 2023-07-21T22:25:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a075ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a00100ca0 0x7f1a000fe8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a075ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a001015b0 0x7f1a000fee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a075ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a0010a070 0x7f1a001a3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a075ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a000ff660 con 0x7f1a00100ca0 2023-07-21T22:25:22.018 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a075ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a001a4340 con 0x7f1a001015b0 2023-07-21T22:25:22.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a075ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a001a4480 con 0x7f1a0010a070 2023-07-21T22:25:22.019 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a0539b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a00100ca0 0x7f1a000fe8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a0539b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a00100ca0 0x7f1a000fe8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56402/0 (socket says 172.21.15.151:56402) 2023-07-21T22:25:22.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a0539b700 1 -- 172.21.15.151:0/3496889155 learned_addr learned my addr 172.21.15.151:0/3496889155 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:22.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a001015b0 0x7f1a000fee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.972+0000 7f1a05b9c700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a0010a070 0x7f1a001a3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f1a0539b700 1 -- 172.21.15.151:0/3496889155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a0010a070 msgr2=0x7f1a001a3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:22.020 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f1a0539b700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a0010a070 0x7f1a001a3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f1a0539b700 1 -- 172.21.15.151:0/3496889155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a001015b0 msgr2=0x7f1a000fee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f1a0539b700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a001015b0 0x7f1a000fee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f1a0539b700 1 -- 172.21.15.151:0/3496889155 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19f8009c40 con 0x7f1a00100ca0 2023-07-21T22:25:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f1a0539b700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a00100ca0 0x7f1a000fe8f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00e9a0 tx=0x7f19fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f19f67fc700 1 -- 172.21.15.151:0/3496889155 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc009790 con 0x7f1a00100ca0 2023-07-21T22:25:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f19f67fc700 1 -- 172.21.15.151:0/3496889155 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f19fc00ce50 con 0x7f1a00100ca0 2023-07-21T22:25:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f19f67fc700 1 -- 172.21.15.151:0/3496889155 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc018420 con 0x7f1a00100ca0 2023-07-21T22:25:22.021 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.973+0000 7f1a075ff700 1 -- 172.21.15.151:0/3496889155 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19f00095f0 con 0x7f1a00100ca0 2023-07-21T22:25:22.022 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.974+0000 7f1a075ff700 1 -- 172.21.15.151:0/3496889155 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a001a49e0 con 0x7f1a00100ca0 2023-07-21T22:25:22.023 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.978+0000 7f19f67fc700 1 -- 172.21.15.151:0/3496889155 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f19fc010430 con 0x7f1a00100ca0 2023-07-21T22:25:22.024 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.979+0000 7f1a1ae7cb80 1 Processor -- start 2023-07-21T22:25:22.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.979+0000 7f1a1ae7cb80 1 -- start start 2023-07-21T22:25:22.025 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c87580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c87ac0 0x5628a4c82350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c82930 0x5628a4c82da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4b87cb0 con 0x5628a4c82930 2023-07-21T22:25:22.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4bdaa40 con 0x5628a4c871b0 2023-07-21T22:25:22.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4bd3ed0 con 0x5628a4c87ac0 2023-07-21T22:25:22.026 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f19f67fc700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f19ec0a1340 0x7f19ec0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.027 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a04b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c82930 0x5628a4c82da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a04b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c82930 0x5628a4c82da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56416/0 (socket says 172.21.15.151:56416) 2023-07-21T22:25:22.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2722753194 learned_addr learned my addr 172.21.15.151:0/2722753194 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:22.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a05b9c700 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c87580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f19f67fc700 1 -- 172.21.15.151:0/3496889155 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f19fc014070 con 0x7f1a00100ca0 2023-07-21T22:25:22.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a0539b700 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c87ac0 0x5628a4c82350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.980+0000 7f1a05b9c700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f19ec0a1340 0x7f19ec0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.028 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2722753194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c87ac0 msgr2=0x5628a4c82350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c87ac0 0x5628a4c82350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2722753194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 msgr2=0x5628a4c87580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c87580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2722753194 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628a4a01de0 con 0x5628a4c82930 2023-07-21T22:25:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f1a05b9c700 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c87580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c82930 0x5628a4c82da0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009990 tx=0x7f19f0005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadea2205153f9b5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f1a05b9c700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f19ec0a1340 0x7f19ec0a37f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009550 tx=0x7f19f800b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:22.029 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f19eb7fe700 1 -- 172.21.15.151:0/2722753194 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f001d070 con 0x5628a4c82930 2023-07-21T22:25:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f19eb7fe700 1 -- 172.21.15.151:0/2722753194 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f19f001e040 con 0x5628a4c82930 2023-07-21T22:25:22.030 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.981+0000 7f19eb7fe700 1 -- 172.21.15.151:0/2722753194 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f00047a0 con 0x5628a4c82930 2023-07-21T22:25:22.031 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.982+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2722753194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c82930 msgr2=0x5628a4c82da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.982+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c82930 0x5628a4c82da0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009990 tx=0x7f19f0005f00 comp rx=0 tx=0).stop 2023-07-21T22:25:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.982+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2722753194 shutdown_connections 2023-07-21T22:25:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.982+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c87580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.982+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c82930 0x5628a4c82da0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.982+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2722753194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c87ac0 0x5628a4c82350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.982+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2722753194 >> 172.21.15.151:0/2722753194 conn(0x5628a4c77ef0 msgr2=0x5628a4c7d830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:22.032 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.983+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2722753194 shutdown_connections 2023-07-21T22:25:22.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.983+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2722753194 wait complete. 2023-07-21T22:25:22.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.983+0000 7f1a1ae7cb80 1 -- start start 2023-07-21T22:25:22.033 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.983+0000 7f1a1ae7cb80 1 Processor -- start 2023-07-21T22:25:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4c8eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c8bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.039 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c8c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4b73ac0 con 0x5628a4c87ac0 2023-07-21T22:25:22.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4b737c0 con 0x5628a4c871b0 2023-07-21T22:25:22.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4a57920 con 0x5628a4c82930 2023-07-21T22:25:22.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a1ae7cb80 10 client.0 _ll_register_callbacks cb 0x5628a4b71760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:22.040 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a05b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c8c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.074 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a04b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c8bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a04b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c8bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43558/0 (socket says 172.21.15.151:43558) 2023-07-21T22:25:22.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2664262967 learned_addr learned my addr 172.21.15.151:0/2664262967 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:22.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a05b9c700 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c8c3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56422/0 (socket says 172.21.15.151:56422) 2023-07-21T22:25:22.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.984+0000 7f1a0539b700 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4c8eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2664262967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 msgr2=0x5628a4c8eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:22.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4c8eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.075 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2664262967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 msgr2=0x5628a4c8c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c8c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2664262967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19f8008750 con 0x5628a4c871b0 2023-07-21T22:25:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f1a0539b700 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4c8eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f1a05b9c700 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c8c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c8bdc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19f0000c00 tx=0x7f19f000b920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6432e1090008a6a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f19e8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:25:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.985+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2664262967 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f001d030 con 0x5628a4c871b0 2023-07-21T22:25:22.076 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.986+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2664262967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5628a4b2d4f0 con 0x5628a4c871b0 2023-07-21T22:25:22.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.986+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2664262967 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f19f0004910 con 0x5628a4c871b0 2023-07-21T22:25:22.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.986+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2664262967 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19f000bb80 con 0x5628a4c871b0 2023-07-21T22:25:22.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.986+0000 7f1a1ae7cb80 10 client.26501 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:22.077 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.986+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2664262967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f1a0010d170 con 0x5628a4c871b0 2023-07-21T22:25:22.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.986+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2664262967 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5628a4b2d4f0 con 0x5628a4c871b0 2023-07-21T22:25:22.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.987+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2664262967 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f19f000f8b0 con 0x5628a4c871b0 2023-07-21T22:25:22.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.987+0000 7f1a1ae7cb80 10 client.26501 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:22.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.987+0000 7f1a1ae7cb80 10 client.26501 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:22.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.987+0000 7f1a1ae7cb80 20 client.26501 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:22.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.987+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5628a4c9c170 0x5628a4c9e580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.987+0000 7f1a1ae7cb80 4 client.26501 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:25:22.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.987+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2664262967 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5628a4bcceb0 con 0x5628a4c9c170 2023-07-21T22:25:22.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.987+0000 7f1a0539b700 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5628a4c9c170 0x5628a4c9e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.988+0000 7f1a0539b700 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5628a4c9c170 0x5628a4c9e580 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d60f9d59de119a6 server_cookie=240e80a5d806889f in_seq=0 out_seq=0 2023-07-21T22:25:22.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.988+0000 7f19e8ff9700 10 client.26501 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:22.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.988+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2664262967 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5628a4bcceb0 con 0x5628a4c9c170 2023-07-21T22:25:22.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.988+0000 7f19e8ff9700 10 client.26501 handle_command_reply: tid=0 2023-07-21T22:25:22.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 client.26501 shutdown 2023-07-21T22:25:22.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2664262967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 msgr2=0x5628a4c8bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c8bdc0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f19f0000c00 tx=0x7f19f000b920 comp rx=0 tx=0).stop 2023-07-21T22:25:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2664262967 shutdown_connections 2023-07-21T22:25:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5628a4c9c170 0x5628a4c9e580 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c8c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4c8eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f19e8ff9700 0 client.26501 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2664262967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c871b0 0x5628a4c8bdc0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2664262967 >> 172.21.15.151:0/2664262967 conn(0x5628a4c77ef0 msgr2=0x5628a4c7d420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:22.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2664262967 shutdown_connections 2023-07-21T22:25:22.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2664262967 wait complete. 2023-07-21T22:25:22.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:21.989+0000 7f1a1ae7cb80 20 client.26501 trim_cache size 0 max 16384 2023-07-21T22:25:22.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.004+0000 7f1a1ae7cb80 1 Processor -- start 2023-07-21T22:25:22.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.004+0000 7f1a1ae7cb80 1 -- start start 2023-07-21T22:25:22.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.004+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c82930 0x5628a4c93520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c871b0 0x5628a4c97cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c7d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4b2d4f0 con 0x5628a4c87ac0 2023-07-21T22:25:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4c8f120 con 0x5628a4c82930 2023-07-21T22:25:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4c7eca0 con 0x5628a4c871b0 2023-07-21T22:25:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a0539b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c82930 0x5628a4c93520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a0539b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c82930 0x5628a4c93520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43570/0 (socket says 172.21.15.151:43570) 2023-07-21T22:25:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a0539b700 1 -- 172.21.15.151:0/554588407 learned_addr learned my addr 172.21.15.151:0/554588407 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:22.086 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a05b9c700 1 --2- 172.21.15.151:0/554588407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c7d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/554588407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c871b0 0x5628a4c97cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a0539b700 1 -- 172.21.15.151:0/554588407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c871b0 msgr2=0x5628a4c97cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:22.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a0539b700 1 --2- 172.21.15.151:0/554588407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c871b0 0x5628a4c97cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a0539b700 1 -- 172.21.15.151:0/554588407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 msgr2=0x5628a4c7d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:22.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a0539b700 1 --2- 172.21.15.151:0/554588407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c7d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.005+0000 7f1a0539b700 1 -- 172.21.15.151:0/554588407 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5628a49eac60 con 0x5628a4c82930 2023-07-21T22:25:22.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.006+0000 7f1a0539b700 1 --2- 172.21.15.151:0/554588407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c82930 0x5628a4c93520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19fc096960 tx=0x7f19fc0cc040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff9a1fafc0dac99 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:22.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.006+0000 7f19ebfff700 1 -- 172.21.15.151:0/554588407 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc09df20 con 0x5628a4c82930 2023-07-21T22:25:22.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.006+0000 7f19ebfff700 1 -- 172.21.15.151:0/554588407 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f19fc0a2340 con 0x5628a4c82930 2023-07-21T22:25:22.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.006+0000 7f19ebfff700 1 -- 172.21.15.151:0/554588407 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19fc0a1eb0 con 0x5628a4c82930 2023-07-21T22:25:22.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/554588407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c82930 msgr2=0x5628a4c93520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:22.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/554588407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c82930 0x5628a4c93520 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f19fc096960 tx=0x7f19fc0cc040 comp rx=0 tx=0).stop 2023-07-21T22:25:22.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/554588407 shutdown_connections 2023-07-21T22:25:22.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/554588407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c82930 0x5628a4c93520 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/554588407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c87ac0 0x5628a4c7d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/554588407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c871b0 0x5628a4c97cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/554588407 >> 172.21.15.151:0/554588407 conn(0x5628a4c77ef0 msgr2=0x5628a4c8e770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:22.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/554588407 shutdown_connections 2023-07-21T22:25:22.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/554588407 wait complete. 2023-07-21T22:25:22.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 -- start start 2023-07-21T22:25:22.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.007+0000 7f1a1ae7cb80 1 Processor -- start 2023-07-21T22:25:22.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4ce4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c871b0 0x5628a4ce46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a1ae7cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c87ac0 0x5628a4cef000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4ce4d80 con 0x5628a4c871b0 2023-07-21T22:25:22.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4cef540 con 0x5628a4c87ac0 2023-07-21T22:25:22.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a1ae7cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5628a4cef680 con 0x5628a4c82930 2023-07-21T22:25:22.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a1ae7cb80 10 client.0 _ll_register_callbacks cb 0x7f19f8009120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:22.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a04b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c871b0 0x5628a4ce46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a04b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c871b0 0x5628a4ce46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56432/0 (socket says 172.21.15.151:56432) 2023-07-21T22:25:22.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.008+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2435237949 learned_addr learned my addr 172.21.15.151:0/2435237949 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:22.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a05b9c700 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c87ac0 0x5628a4cef000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a0539b700 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4ce4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2435237949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 msgr2=0x5628a4ce4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:22.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4ce4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2435237949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c87ac0 msgr2=0x5628a4cef000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:22.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c87ac0 0x5628a4cef000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a04b9a700 1 -- 172.21.15.151:0/2435237949 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a001a49e0 con 0x5628a4c871b0 2023-07-21T22:25:22.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a0539b700 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4ce4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:25:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a04b9a700 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c871b0 0x5628a4ce46b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009350 tx=0x7f19f000bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb182c2d939b6e77 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f19e8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2435237949 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19f001d070 con 0x5628a4c871b0 2023-07-21T22:25:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2435237949 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f19f001e040 con 0x5628a4c871b0 2023-07-21T22:25:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.009+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2435237949 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f19f0000e40 con 0x5628a4c871b0 2023-07-21T22:25:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2435237949 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19f000bee0 con 0x5628a4c871b0 2023-07-21T22:25:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f1a1ae7cb80 10 client.16788 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:22.092 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2435237949 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5628a4a28250 con 0x5628a4c871b0 2023-07-21T22:25:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2435237949 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f19f001e040 con 0x5628a4c871b0 2023-07-21T22:25:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2435237949 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f19f0004d30 con 0x5628a4c871b0 2023-07-21T22:25:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f1a1ae7cb80 10 client.16788 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f1a1ae7cb80 10 client.16788 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f1a1ae7cb80 20 client.16788 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5628a4cf0950 0x5628a4cf2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f1a1ae7cb80 4 client.16788 mds_command: new command op to 24599 tid=0[{"prefix": "damage ls"}] 2023-07-21T22:25:22.093 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.010+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2435237949 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "damage ls"}) v1 -- 0x5628a4b8f050 con 0x5628a4cf0950 2023-07-21T22:25:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.011+0000 7f1a0539b700 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5628a4cf0950 0x5628a4cf2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.011+0000 7f19e8ff9700 10 client.16788 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.011+0000 7f1a0539b700 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5628a4cf0950 0x5628a4cf2d60 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7d03d6cd1a3a44f server_cookie=d0ff09056b59d2f5 in_seq=0 out_seq=0 2023-07-21T22:25:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.011+0000 7f19e8ff9700 1 -- 172.21.15.151:0/2435237949 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+3 (crc 0 0 0) 0x5628a4b8f050 con 0x5628a4cf0950 2023-07-21T22:25:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.011+0000 7f19e8ff9700 10 client.16788 handle_command_reply: tid=0 2023-07-21T22:25:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.011+0000 7f1a1ae7cb80 1 client.16788 shutdown 2023-07-21T22:25:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2435237949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c871b0 msgr2=0x5628a4ce46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:22.094 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c871b0 0x5628a4ce46b0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f19f0009350 tx=0x7f19f000bc40 comp rx=0 tx=0).stop 2023-07-21T22:25:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2435237949 shutdown_connections 2023-07-21T22:25:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5628a4cf0950 0x5628a4cf2d60 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5628a4c87ac0 0x5628a4cef000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5628a4c82930 0x5628a4ce4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 --2- 172.21.15.151:0/2435237949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5628a4c871b0 0x5628a4ce46b0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f19e8ff9700 0 client.16788 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2435237949 >> 172.21.15.151:0/2435237949 conn(0x5628a4c77ef0 msgr2=0x5628a4c7d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:22.095 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2435237949 shutdown_connections 2023-07-21T22:25:22.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 1 -- 172.21.15.151:0/2435237949 wait complete. 2023-07-21T22:25:22.096 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.012+0000 7f1a1ae7cb80 20 client.16788 trim_cache size 0 max 16384 2023-07-21T22:25:22.096 INFO:teuthology.orchestra.run.smithi151.stdout:[] 2023-07-21T22:25:22.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 -- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f19ec0a1340 msgr2=0x7f19ec0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:22.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f19ec0a1340 0x7f19ec0a37f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19f8009550 tx=0x7f19f800b040 comp rx=0 tx=0).stop 2023-07-21T22:25:22.097 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 -- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a00100ca0 msgr2=0x7f1a000fe8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:22.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a00100ca0 0x7f1a000fe8f0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f19fc00e9a0 tx=0x7f19fc00ecb0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 -- 172.21.15.151:0/3496889155 shutdown_connections 2023-07-21T22:25:22.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f19ec0a1340 0x7f19ec0a37f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1a0010a070 0x7f1a001a3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a00100ca0 0x7f1a000fe8f0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 --2- 172.21.15.151:0/3496889155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1a001015b0 0x7f1a000fee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:22.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 -- 172.21.15.151:0/3496889155 >> 172.21.15.151:0/3496889155 conn(0x7f1a000fa4b0 msgr2=0x7f1a000fb110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:22.098 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 -- 172.21.15.151:0/3496889155 shutdown_connections 2023-07-21T22:25:22.099 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T22:25:22.013+0000 7f1a075ff700 1 -- 172.21.15.151:0/3496889155 wait complete. 2023-07-21T22:25:22.099 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 1258011751, 'ino': 1099511628712, 'path': '/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/000000010000000000000083'}, {'damage_type': 'backtrace', 'id': 2826495192, 'ino': 1099511628741, 'path': '/volumes/_nogroup/sv_0/89be92e1-be58-42e3-be68-399c1317a935/postgres/data/pg_wal/00000001000000000000006A'}] 2023-07-21T22:25:22.099 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2023-07-21T22:25:22.349 INFO:teuthology.orchestra.run.smithi151.stderr:25300000 of 50000000 tuples (50%) done (elapsed 345.84 s, remaining 337.64 s) 2023-07-21T22:25:22.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:22 smithi151 ceph-mon[95510]: pgmap v188: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:25:22.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:22 smithi187 ceph-mon[96918]: pgmap v188: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:25:22.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:22 smithi195 ceph-mon[97365]: pgmap v188: 97 pgs: 97 active+clean; 5.7 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 24 MiB/s wr, 47 op/s 2023-07-21T22:25:23.618 INFO:teuthology.orchestra.run.smithi151.stderr:25400000 of 50000000 tuples (50%) done (elapsed 347.11 s, remaining 336.18 s) 2023-07-21T22:25:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.507+0000 7f9bb37ff700 1 -- 172.21.15.151:0/1234971181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac105b10 msgr2=0x7f9bac105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.507+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/1234971181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac105b10 0x7f9bac105ee0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009990 tx=0x7f9ba8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.507+0000 7f9bb37ff700 1 -- 172.21.15.151:0/1234971181 shutdown_connections 2023-07-21T22:25:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.507+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/1234971181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bac1004b0 0x7f9bac10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.507+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/1234971181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac105b10 0x7f9bac105ee0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.507+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/1234971181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bac0ffb00 0x7f9bac0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.507+0000 7f9bb37ff700 1 -- 172.21.15.151:0/1234971181 >> 172.21.15.151:0/1234971181 conn(0x7f9bac0fb600 msgr2=0x7f9bac0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.507+0000 7f9bb37ff700 1 -- 172.21.15.151:0/1234971181 shutdown_connections 2023-07-21T22:25:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.507+0000 7f9bb37ff700 1 -- 172.21.15.151:0/1234971181 wait complete. 2023-07-21T22:25:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.508+0000 7f9bb37ff700 1 Processor -- start 2023-07-21T22:25:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.508+0000 7f9bb37ff700 1 -- start start 2023-07-21T22:25:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb37ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bac0ffb00 0x7f9bac197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb37ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac1004b0 0x7f9bac1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb37ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bac105b10 0x7f9bac19c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb37ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac19cf70 con 0x7f9bac1004b0 2023-07-21T22:25:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb37ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac19d0e0 con 0x7f9bac105b10 2023-07-21T22:25:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb37ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bac19d2a0 con 0x7f9bac0ffb00 2023-07-21T22:25:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb0d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac1004b0 0x7f9bac1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb0d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac1004b0 0x7f9bac1982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56444/0 (socket says 172.21.15.151:56444) 2023-07-21T22:25:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb0d9a700 1 -- 172.21.15.151:0/3885715229 learned_addr learned my addr 172.21.15.151:0/3885715229 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb159b700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bac0ffb00 0x7f9bac197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb0d9a700 1 -- 172.21.15.151:0/3885715229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bac0ffb00 msgr2=0x7f9bac197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:24.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bac0ffb00 0x7f9bac197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb0d9a700 1 -- 172.21.15.151:0/3885715229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bac105b10 msgr2=0x7f9bac19c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bac105b10 0x7f9bac19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb0d9a700 1 -- 172.21.15.151:0/3885715229 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba80095f0 con 0x7f9bac1004b0 2023-07-21T22:25:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.509+0000 7f9bb159b700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bac0ffb00 0x7f9bac197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:25:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.510+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac1004b0 0x7f9bac1982c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00d950 tx=0x7f9b9c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.510+0000 7f9ba27fc700 1 -- 172.21.15.151:0/3885715229 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c009b40 con 0x7f9bac1004b0 2023-07-21T22:25:24.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.510+0000 7f9bb37ff700 1 -- 172.21.15.151:0/3885715229 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bac19d580 con 0x7f9bac1004b0 2023-07-21T22:25:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.510+0000 7f9ba27fc700 1 -- 172.21.15.151:0/3885715229 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b9c009ca0 con 0x7f9bac1004b0 2023-07-21T22:25:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.510+0000 7f9ba27fc700 1 -- 172.21.15.151:0/3885715229 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00f620 con 0x7f9bac1004b0 2023-07-21T22:25:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.510+0000 7f9bb37ff700 1 -- 172.21.15.151:0/3885715229 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac1a4dc0 con 0x7f9bac1004b0 2023-07-21T22:25:24.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.513+0000 7f9ba27fc700 1 -- 172.21.15.151:0/3885715229 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f9b9c010460 con 0x7f9bac1004b0 2023-07-21T22:25:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.514+0000 7f9bc7165b80 1 Processor -- start 2023-07-21T22:25:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bc7165b80 1 -- start start 2023-07-21T22:25:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 0x56218c177cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178210 0x56218c171f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 0x56218c1724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c077c50 con 0x56218c178210 2023-07-21T22:25:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c0ca9e0 con 0x56218bfce6b0 2023-07-21T22:25:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c0c3e70 con 0x56218c178660 2023-07-21T22:25:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9ba27fc700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a12c0 0x7f9b980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bb159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178210 0x56218c171f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9ba27fc700 1 -- 172.21.15.151:0/3885715229 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9b9c0cd090 con 0x7f9bac1004b0 2023-07-21T22:25:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bb159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178210 0x56218c171f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56456/0 (socket says 172.21.15.151:56456) 2023-07-21T22:25:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bb159b700 1 -- 172.21.15.151:0/302403516 learned_addr learned my addr 172.21.15.151:0/302403516 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/302403516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 0x56218c1724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bb1d9c700 1 --2- 172.21.15.151:0/302403516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 0x56218c177cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.515+0000 7f9bb1d9c700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a12c0 0x7f9b980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9bb159b700 1 -- 172.21.15.151:0/302403516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 msgr2=0x56218c1724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9bb159b700 1 --2- 172.21.15.151:0/302403516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 0x56218c1724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9bb159b700 1 -- 172.21.15.151:0/302403516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 msgr2=0x56218c177cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9bb159b700 1 --2- 172.21.15.151:0/302403516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 0x56218c177cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9bb159b700 1 -- 172.21.15.151:0/302403516 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56218bef1d80 con 0x56218c178210 2023-07-21T22:25:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9bb159b700 1 --2- 172.21.15.151:0/302403516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178210 0x56218c171f40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8005f00 tx=0x7f9ba8005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44c8c837207f520d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:24.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9bb1d9c700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a12c0 0x7f9b980a3770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40060b0 tx=0x7f9ba4006040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9b977fe700 1 -- 172.21.15.151:0/302403516 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80052c0 con 0x56218c178210 2023-07-21T22:25:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9b977fe700 1 -- 172.21.15.151:0/302403516 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ba801e040 con 0x56218c178210 2023-07-21T22:25:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.516+0000 7f9b977fe700 1 -- 172.21.15.151:0/302403516 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8004760 con 0x56218c178210 2023-07-21T22:25:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.517+0000 7f9bc7165b80 1 -- 172.21.15.151:0/302403516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178210 msgr2=0x56218c171f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.517+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/302403516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178210 0x56218c171f40 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8005f00 tx=0x7f9ba8005c00 comp rx=0 tx=0).stop 2023-07-21T22:25:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.517+0000 7f9bc7165b80 1 -- 172.21.15.151:0/302403516 shutdown_connections 2023-07-21T22:25:24.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.517+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/302403516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 0x56218c177cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.517+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/302403516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 0x56218c1724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.517+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/302403516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178210 0x56218c171f40 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.517+0000 7f9bc7165b80 1 -- 172.21.15.151:0/302403516 >> 172.21.15.151:0/302403516 conn(0x56218c167ae0 msgr2=0x56218c16d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.517+0000 7f9bc7165b80 1 -- 172.21.15.151:0/302403516 shutdown_connections 2023-07-21T22:25:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.517+0000 7f9bc7165b80 1 -- 172.21.15.151:0/302403516 wait complete. 2023-07-21T22:25:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.518+0000 7f9bc7165b80 1 -- start start 2023-07-21T22:25:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.518+0000 7f9bc7165b80 1 Processor -- start 2023-07-21T22:25:24.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.518+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c181560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.518+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 0x56218c181aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.518+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178660 0x56218c17b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.518+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c063a60 con 0x56218bfce6b0 2023-07-21T22:25:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.518+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c063760 con 0x56218c178660 2023-07-21T22:25:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.518+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218bf478c0 con 0x56218c178210 2023-07-21T22:25:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.518+0000 7f9bc7165b80 10 client.0 _ll_register_callbacks cb 0x56218c061700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c181560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c181560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56470/0 (socket says 172.21.15.151:56470) 2023-07-21T22:25:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb159b700 1 -- 172.21.15.151:0/825676462 learned_addr learned my addr 172.21.15.151:0/825676462 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 0x56218c181aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb1d9c700 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178660 0x56218c17b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb159b700 1 -- 172.21.15.151:0/825676462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 msgr2=0x56218c181aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb159b700 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 0x56218c181aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb159b700 1 -- 172.21.15.151:0/825676462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178660 msgr2=0x56218c17b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb159b700 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178660 0x56218c17b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb159b700 1 -- 172.21.15.151:0/825676462 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bac10d240 con 0x56218bfce6b0 2023-07-21T22:25:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9bb159b700 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c181560 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009990 tx=0x7f9ba800ba00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdefa4a188885371 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.519+0000 7f9b94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9b94ff9700 1 -- 172.21.15.151:0/825676462 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8005530 con 0x56218bfce6b0 2023-07-21T22:25:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9b94ff9700 1 -- 172.21.15.151:0/825676462 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9ba8004500 con 0x56218bfce6b0 2023-07-21T22:25:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9bc7165b80 1 -- 172.21.15.151:0/825676462 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56218c01d490 con 0x56218bfce6b0 2023-07-21T22:25:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9b94ff9700 1 -- 172.21.15.151:0/825676462 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba80046c0 con 0x56218bfce6b0 2023-07-21T22:25:24.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9bc7165b80 10 client.16800 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9bc7165b80 1 -- 172.21.15.151:0/825676462 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56218bedac00 con 0x56218bfce6b0 2023-07-21T22:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9b94ff9700 1 -- 172.21.15.151:0/825676462 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56218c01d490 con 0x56218bfce6b0 2023-07-21T22:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9b94ff9700 1 -- 172.21.15.151:0/825676462 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f9ba8003c30 con 0x56218bfce6b0 2023-07-21T22:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9bc7165b80 10 client.16800 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9bc7165b80 10 client.16800 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9bc7165b80 20 client.16800 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56218c18b530 0x56218c18d910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9bc7165b80 4 client.16800 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:25:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.520+0000 7f9bc7165b80 1 -- 172.21.15.151:0/825676462 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56218c0bce50 con 0x56218c18b530 2023-07-21T22:25:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.521+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56218c18b530 0x56218c18d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.521+0000 7f9b94ff9700 10 client.16800 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:24.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.521+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56218c18b530 0x56218c18d910 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cfcc02df767d927 server_cookie=86ae65832c5db68f in_seq=0 out_seq=0 2023-07-21T22:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9b94ff9700 1 -- 172.21.15.151:0/825676462 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56218c0bce50 con 0x56218c18b530 2023-07-21T22:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9b94ff9700 10 client.16800 handle_command_reply: tid=0 2023-07-21T22:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 client.16800 shutdown 2023-07-21T22:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 -- 172.21.15.151:0/825676462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 msgr2=0x56218c181560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:24.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c181560 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009990 tx=0x7f9ba800ba00 comp rx=0 tx=0).stop 2023-07-21T22:25:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 -- 172.21.15.151:0/825676462 shutdown_connections 2023-07-21T22:25:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56218c18b530 0x56218c18d910 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178660 0x56218c17b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c181560 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9b94ff9700 0 client.16800 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/825676462 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 0x56218c181aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 -- 172.21.15.151:0/825676462 >> 172.21.15.151:0/825676462 conn(0x56218c167ae0 msgr2=0x56218c16c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.522+0000 7f9bc7165b80 1 -- 172.21.15.151:0/825676462 shutdown_connections 2023-07-21T22:25:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.523+0000 7f9bc7165b80 1 -- 172.21.15.151:0/825676462 wait complete. 2023-07-21T22:25:24.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.523+0000 7f9bc7165b80 20 client.16800 trim_cache size 0 max 16384 2023-07-21T22:25:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.543+0000 7f9bc7165b80 1 Processor -- start 2023-07-21T22:25:24.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.543+0000 7f9bc7165b80 1 -- start start 2023-07-21T22:25:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.543+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c17b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.543+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178210 0x56218c171f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 0x56218c174740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c17cd90 con 0x56218bfce6b0 2023-07-21T22:25:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c16df30 con 0x56218c178210 2023-07-21T22:25:24.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c164b00 con 0x56218c178660 2023-07-21T22:25:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c17b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c17b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56484/0 (socket says 172.21.15.151:56484) 2023-07-21T22:25:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb159b700 1 -- 172.21.15.151:0/1260904625 learned_addr learned my addr 172.21.15.151:0/1260904625 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/1260904625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178210 0x56218c171f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb1d9c700 1 --2- 172.21.15.151:0/1260904625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 0x56218c174740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb159b700 1 -- 172.21.15.151:0/1260904625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 msgr2=0x56218c174740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:24.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb159b700 1 --2- 172.21.15.151:0/1260904625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 0x56218c174740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb159b700 1 -- 172.21.15.151:0/1260904625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178210 msgr2=0x56218c171f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb159b700 1 --2- 172.21.15.151:0/1260904625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178210 0x56218c171f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.544+0000 7f9bb159b700 1 -- 172.21.15.151:0/1260904625 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56218bf181f0 con 0x56218bfce6b0 2023-07-21T22:25:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.545+0000 7f9bb159b700 1 --2- 172.21.15.151:0/1260904625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c17b760 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8005a60 tx=0x7f9ba800b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1af64b24d3a60501 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.545+0000 7f9b97fff700 1 -- 172.21.15.151:0/1260904625 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8004160 con 0x56218bfce6b0 2023-07-21T22:25:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.545+0000 7f9b97fff700 1 -- 172.21.15.151:0/1260904625 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ba8003cb0 con 0x56218bfce6b0 2023-07-21T22:25:24.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.545+0000 7f9b97fff700 1 -- 172.21.15.151:0/1260904625 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba802b9b0 con 0x56218bfce6b0 2023-07-21T22:25:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.545+0000 7f9bc7165b80 1 -- 172.21.15.151:0/1260904625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 msgr2=0x56218c17b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.545+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/1260904625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c17b760 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8005a60 tx=0x7f9ba800b540 comp rx=0 tx=0).stop 2023-07-21T22:25:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.545+0000 7f9bc7165b80 1 -- 172.21.15.151:0/1260904625 shutdown_connections 2023-07-21T22:25:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.546+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/1260904625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178660 0x56218c174740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.546+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/1260904625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218bfce6b0 0x56218c17b760 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.546+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/1260904625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218c178210 0x56218c171f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.546+0000 7f9bc7165b80 1 -- 172.21.15.151:0/1260904625 >> 172.21.15.151:0/1260904625 conn(0x56218c167ae0 msgr2=0x56218c17b050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.546+0000 7f9bc7165b80 1 -- 172.21.15.151:0/1260904625 shutdown_connections 2023-07-21T22:25:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.546+0000 7f9bc7165b80 1 -- 172.21.15.151:0/1260904625 wait complete. 2023-07-21T22:25:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.546+0000 7f9bc7165b80 1 -- start start 2023-07-21T22:25:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.546+0000 7f9bc7165b80 1 Processor -- start 2023-07-21T22:25:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 0x56218c17f210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 0x56218c17f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bc7165b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178660 0x56218c1de370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c180060 con 0x56218c178660 2023-07-21T22:25:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c1de8b0 con 0x56218bfce6b0 2023-07-21T22:25:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bc7165b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56218c1de9f0 con 0x56218c178210 2023-07-21T22:25:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bc7165b80 10 client.0 _ll_register_callbacks cb 0x7f9ba40121e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb1d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178660 0x56218c1de370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb1d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178660 0x56218c1de370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56494/0 (socket says 172.21.15.151:56494) 2023-07-21T22:25:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb1d9c700 1 -- 172.21.15.151:0/3976834859 learned_addr learned my addr 172.21.15.151:0/3976834859 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:24.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb159b700 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 0x56218c17f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 0x56218c17f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb1d9c700 1 -- 172.21.15.151:0/3976834859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 msgr2=0x56218c17f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb1d9c700 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 0x56218c17f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb1d9c700 1 -- 172.21.15.151:0/3976834859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 msgr2=0x56218c17f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb1d9c700 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 0x56218c17f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb1d9c700 1 -- 172.21.15.151:0/3976834859 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56218bedac00 con 0x56218c178660 2023-07-21T22:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.547+0000 7f9bb0d9a700 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 0x56218c17f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:25:24.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.548+0000 7f9bb1d9c700 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178660 0x56218c1de370 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40093a0 tx=0x7f9ba4004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=619a36c6209cd398 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.548+0000 7f9b94ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.548+0000 7f9b94ff9700 1 -- 172.21.15.151:0/3976834859 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba40093d0 con 0x56218c178660 2023-07-21T22:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.548+0000 7f9bc7165b80 1 -- 172.21.15.151:0/3976834859 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ba801e040 con 0x56218c178660 2023-07-21T22:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.548+0000 7f9b94ff9700 1 -- 172.21.15.151:0/3976834859 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f9ba4025450 con 0x56218c178660 2023-07-21T22:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.548+0000 7f9b94ff9700 1 -- 172.21.15.151:0/3976834859 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba4025610 con 0x56218c178660 2023-07-21T22:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.548+0000 7f9bc7165b80 10 client.16806 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.548+0000 7f9bc7165b80 1 -- 172.21.15.151:0/3976834859 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x56218bef0250 con 0x56218c178660 2023-07-21T22:25:24.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.549+0000 7f9b94ff9700 1 -- 172.21.15.151:0/3976834859 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ba801e040 con 0x56218c178660 2023-07-21T22:25:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.549+0000 7f9b94ff9700 1 -- 172.21.15.151:0/3976834859 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f9ba4023070 con 0x56218c178660 2023-07-21T22:25:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.549+0000 7f9bc7165b80 10 client.16806 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:24.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.549+0000 7f9bc7165b80 10 client.16806 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.549+0000 7f9bc7165b80 20 client.16806 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.549+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56218c1e0150 0x56218c1e2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.549+0000 7f9bc7165b80 4 client.16806 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.549+0000 7f9bc7165b80 1 -- 172.21.15.151:0/3976834859 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56218c07eff0 con 0x56218c1e0150 2023-07-21T22:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.549+0000 7f9bb159b700 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56218c1e0150 0x56218c1e2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.550+0000 7f9bb159b700 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56218c1e0150 0x56218c1e2560 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef30f6563238fe58 server_cookie=bef3fc560caa0591 in_seq=0 out_seq=0 2023-07-21T22:25:24.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.550+0000 7f9b94ff9700 10 client.16806 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9b94ff9700 1 -- 172.21.15.151:0/3976834859 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56218c07eff0 con 0x56218c1e0150 2023-07-21T22:25:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9b94ff9700 10 client.16806 handle_command_reply: tid=0 2023-07-21T22:25:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 client.16806 shutdown 2023-07-21T22:25:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 -- 172.21.15.151:0/3976834859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178660 msgr2=0x56218c1de370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178660 0x56218c1de370 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40093a0 tx=0x7f9ba4004ad0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 -- 172.21.15.151:0/3976834859 shutdown_connections 2023-07-21T22:25:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56218c1e0150 0x56218c1e2560 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56218bfce6b0 0x56218c17f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56218c178660 0x56218c1de370 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9b94ff9700 0 client.16806 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 --2- 172.21.15.151:0/3976834859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56218c178210 0x56218c17f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 -- 172.21.15.151:0/3976834859 >> 172.21.15.151:0/3976834859 conn(0x56218c167ae0 msgr2=0x56218c178a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 -- 172.21.15.151:0/3976834859 shutdown_connections 2023-07-21T22:25:24.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 1 -- 172.21.15.151:0/3976834859 wait complete. 2023-07-21T22:25:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.568+0000 7f9bc7165b80 20 client.16806 trim_cache size 0 max 16384 2023-07-21T22:25:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:25:24.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:25:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:25:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:25:24.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 -- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a12c0 msgr2=0x7f9b980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a12c0 0x7f9b980a3770 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f9ba40060b0 tx=0x7f9ba4006040 comp rx=0 tx=0).stop 2023-07-21T22:25:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 -- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac1004b0 msgr2=0x7f9bac1982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac1004b0 0x7f9bac1982c0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00d950 tx=0x7f9b9c00dd10 comp rx=0 tx=0).stop 2023-07-21T22:25:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 -- 172.21.15.151:0/3885715229 shutdown_connections 2023-07-21T22:25:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a12c0 0x7f9b980a3770 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bac105b10 0x7f9bac19c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bac0ffb00 0x7f9bac197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 --2- 172.21.15.151:0/3885715229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bac1004b0 0x7f9bac1982c0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 -- 172.21.15.151:0/3885715229 >> 172.21.15.151:0/3885715229 conn(0x7f9bac0fb600 msgr2=0x7f9bac10ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 -- 172.21.15.151:0/3885715229 shutdown_connections 2023-07-21T22:25:24.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:24.569+0000 7f9bb37ff700 1 -- 172.21.15.151:0/3885715229 wait complete. 2023-07-21T22:25:24.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:24 smithi151 ceph-mon[95510]: pgmap v189: 97 pgs: 97 active+clean; 5.8 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 56 op/s 2023-07-21T22:25:24.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:24 smithi187 ceph-mon[96918]: pgmap v189: 97 pgs: 97 active+clean; 5.8 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 56 op/s 2023-07-21T22:25:24.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:24 smithi195 ceph-mon[97365]: pgmap v189: 97 pgs: 97 active+clean; 5.8 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 56 op/s 2023-07-21T22:25:26.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:26 smithi151 ceph-mon[95510]: pgmap v190: 97 pgs: 97 active+clean; 5.8 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 26 op/s 2023-07-21T22:25:26.748 INFO:teuthology.orchestra.run.smithi151.stderr:25500000 of 50000000 tuples (51%) done (elapsed 350.24 s, remaining 336.51 s) 2023-07-21T22:25:26.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:26 smithi187 ceph-mon[96918]: pgmap v190: 97 pgs: 97 active+clean; 5.8 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 26 op/s 2023-07-21T22:25:26.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:26 smithi195 ceph-mon[97365]: pgmap v190: 97 pgs: 97 active+clean; 5.8 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 23 MiB/s wr, 26 op/s 2023-07-21T22:25:27.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:27 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:25:27.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:27 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:25:27.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:27 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:25:28.088 INFO:teuthology.orchestra.run.smithi151.stderr:25600000 of 50000000 tuples (51%) done (elapsed 351.57 s, remaining 335.09 s) 2023-07-21T22:25:28.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:28 smithi187 ceph-mon[96918]: pgmap v191: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 31 MiB/s wr, 47 op/s 2023-07-21T22:25:28.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:25:28.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:25:28.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:25:28.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:28 smithi195 ceph-mon[97365]: pgmap v191: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 31 MiB/s wr, 47 op/s 2023-07-21T22:25:28.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:25:28.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:25:28.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:25:28.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:28 smithi151 ceph-mon[95510]: pgmap v191: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 31 MiB/s wr, 47 op/s 2023-07-21T22:25:28.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:25:28.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:25:28.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:25:30.567 INFO:teuthology.orchestra.run.smithi151.stderr:25700000 of 50000000 tuples (51%) done (elapsed 354.06 s, remaining 334.77 s) 2023-07-21T22:25:30.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:30 smithi187 ceph-mon[96918]: pgmap v192: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 19 MiB/s wr, 29 op/s 2023-07-21T22:25:30.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:30 smithi195 ceph-mon[97365]: pgmap v192: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 19 MiB/s wr, 29 op/s 2023-07-21T22:25:30.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:30 smithi151 ceph-mon[95510]: pgmap v192: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 19 MiB/s wr, 29 op/s 2023-07-21T22:25:31.844 INFO:teuthology.orchestra.run.smithi151.stderr:25800000 of 50000000 tuples (51%) done (elapsed 355.34 s, remaining 333.30 s) 2023-07-21T22:25:32.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:32 smithi187 ceph-mon[96918]: pgmap v193: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 19 MiB/s wr, 29 op/s 2023-07-21T22:25:32.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:32 smithi195 ceph-mon[97365]: pgmap v193: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 19 MiB/s wr, 29 op/s 2023-07-21T22:25:32.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:32 smithi151 ceph-mon[95510]: pgmap v193: 97 pgs: 97 active+clean; 5.9 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 19 MiB/s wr, 29 op/s 2023-07-21T22:25:33.088 INFO:teuthology.orchestra.run.smithi151.stderr:25900000 of 50000000 tuples (51%) done (elapsed 356.58 s, remaining 331.80 s) 2023-07-21T22:25:34.389 INFO:teuthology.orchestra.run.smithi151.stderr:26000000 of 50000000 tuples (52%) done (elapsed 357.88 s, remaining 330.35 s) 2023-07-21T22:25:34.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:34 smithi187 ceph-mon[96918]: pgmap v194: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 28 MiB/s wr, 65 op/s 2023-07-21T22:25:34.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:34 smithi195 ceph-mon[97365]: pgmap v194: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 28 MiB/s wr, 65 op/s 2023-07-21T22:25:34.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:34 smithi151 ceph-mon[95510]: pgmap v194: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 28 MiB/s wr, 65 op/s 2023-07-21T22:25:35.742 INFO:teuthology.orchestra.run.smithi151.stderr:26100000 of 50000000 tuples (52%) done (elapsed 359.23 s, remaining 328.95 s) 2023-07-21T22:25:36.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:36 smithi187 ceph-mon[96918]: pgmap v195: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 16 MiB/s wr, 56 op/s 2023-07-21T22:25:36.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:36 smithi195 ceph-mon[97365]: pgmap v195: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 16 MiB/s wr, 56 op/s 2023-07-21T22:25:36.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:36 smithi151 ceph-mon[95510]: pgmap v195: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 16 MiB/s wr, 56 op/s 2023-07-21T22:25:36.999 INFO:teuthology.orchestra.run.smithi151.stderr:26200000 of 50000000 tuples (52%) done (elapsed 360.49 s, remaining 327.47 s) 2023-07-21T22:25:37.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.734+0000 7f7ad919d700 1 -- 172.21.15.151:0/3645811004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad40733d0 msgr2=0x7f7ad410bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.734+0000 7f7ad919d700 1 --2- 172.21.15.151:0/3645811004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad40733d0 0x7f7ad410bce0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009990 tx=0x7f7ac8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.735+0000 7f7ad919d700 1 -- 172.21.15.151:0/3645811004 shutdown_connections 2023-07-21T22:25:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.735+0000 7f7ad919d700 1 --2- 172.21.15.151:0/3645811004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ad4072ac0 0x7f7ad4072e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.735+0000 7f7ad919d700 1 --2- 172.21.15.151:0/3645811004 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ad410c2b0 0x7f7ad410e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.735+0000 7f7ad919d700 1 --2- 172.21.15.151:0/3645811004 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad40733d0 0x7f7ad410bce0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.735+0000 7f7ad919d700 1 -- 172.21.15.151:0/3645811004 >> 172.21.15.151:0/3645811004 conn(0x7f7ad40fb440 msgr2=0x7f7ad40fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.735+0000 7f7ad919d700 1 -- 172.21.15.151:0/3645811004 shutdown_connections 2023-07-21T22:25:37.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.735+0000 7f7ad919d700 1 -- 172.21.15.151:0/3645811004 wait complete. 2023-07-21T22:25:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.736+0000 7f7ad919d700 1 Processor -- start 2023-07-21T22:25:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.736+0000 7f7ad919d700 1 -- start start 2023-07-21T22:25:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.736+0000 7f7ad919d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad4072ac0 0x7f7ad4197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.736+0000 7f7ad919d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ad40733d0 0x7f7ad4198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.736+0000 7f7ad919d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ad410c2b0 0x7f7ad419b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.736+0000 7f7ad919d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad419bbd0 con 0x7f7ad4072ac0 2023-07-21T22:25:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.736+0000 7f7ad919d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad419bd40 con 0x7f7ad40733d0 2023-07-21T22:25:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad919d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ad419bf00 con 0x7f7ad410c2b0 2023-07-21T22:25:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad4072ac0 0x7f7ad4197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad4072ac0 0x7f7ad4197ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41736/0 (socket says 172.21.15.151:41736) 2023-07-21T22:25:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad3fff700 1 -- 172.21.15.151:0/2684209445 learned_addr learned my addr 172.21.15.151:0/2684209445 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad899c700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ad410c2b0 0x7f7ad419b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad37fe700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ad40733d0 0x7f7ad4198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad3fff700 1 -- 172.21.15.151:0/2684209445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ad410c2b0 msgr2=0x7f7ad419b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:37.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ad410c2b0 0x7f7ad419b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad3fff700 1 -- 172.21.15.151:0/2684209445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ad40733d0 msgr2=0x7f7ad4198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:37.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ad40733d0 0x7f7ad4198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.737+0000 7f7ad3fff700 1 -- 172.21.15.151:0/2684209445 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc009c40 con 0x7f7ad4072ac0 2023-07-21T22:25:37.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.738+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad4072ac0 0x7f7ad4197ce0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400e9a0 tx=0x7f7ac400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:37.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.738+0000 7f7ad17fa700 1 -- 172.21.15.151:0/2684209445 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4009790 con 0x7f7ad4072ac0 2023-07-21T22:25:37.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.738+0000 7f7ad17fa700 1 -- 172.21.15.151:0/2684209445 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ac4010430 con 0x7f7ad4072ac0 2023-07-21T22:25:37.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.738+0000 7f7ad919d700 1 -- 172.21.15.151:0/2684209445 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ac80095f0 con 0x7f7ad4072ac0 2023-07-21T22:25:37.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.738+0000 7f7ad17fa700 1 -- 172.21.15.151:0/2684209445 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400cea0 con 0x7f7ad4072ac0 2023-07-21T22:25:37.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.738+0000 7f7ad919d700 1 -- 172.21.15.151:0/2684209445 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad41a4960 con 0x7f7ad4072ac0 2023-07-21T22:25:37.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.742+0000 7f7ad17fa700 1 -- 172.21.15.151:0/2684209445 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f7ac40105a0 con 0x7f7ad4072ac0 2023-07-21T22:25:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.743+0000 7f7aedcbab80 1 Processor -- start 2023-07-21T22:25:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.743+0000 7f7aedcbab80 1 -- start start 2023-07-21T22:25:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.743+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c7904f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.743+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c78ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.743+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c78ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.743+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c7804c50 con 0x5597c78ff5e0 2023-07-21T22:25:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.743+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c78579e0 con 0x5597c775b6b0 2023-07-21T22:25:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.743+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c7850e70 con 0x5597c7905480 2023-07-21T22:25:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c78ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad17fa700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7abc0a1340 0x7f7abc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c78ffa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41740/0 (socket says 172.21.15.151:41740) 2023-07-21T22:25:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad37fe700 1 -- 172.21.15.151:0/1588946295 learned_addr learned my addr 172.21.15.151:0/1588946295 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c78ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad899c700 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c7904f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad17fa700 1 -- 172.21.15.151:0/2684209445 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7ac4014070 con 0x7f7ad4072ac0 2023-07-21T22:25:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad899c700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7abc0a1340 0x7f7abc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad37fe700 1 -- 172.21.15.151:0/1588946295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 msgr2=0x5597c78ff0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad37fe700 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c78ff0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad37fe700 1 -- 172.21.15.151:0/1588946295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 msgr2=0x5597c7904f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad37fe700 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c7904f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad37fe700 1 -- 172.21.15.151:0/1588946295 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597c767ed80 con 0x5597c78ff5e0 2023-07-21T22:25:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.744+0000 7f7ad899c700 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c7904f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:25:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.745+0000 7f7ad37fe700 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c78ffa30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009990 tx=0x7f7ac8005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c9d1a488a19447 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:37.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.745+0000 7f7ad899c700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7abc0a1340 0x7f7abc0a37f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009f70 tx=0x7f7acc00b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.745+0000 7f7aba7fc700 1 -- 172.21.15.151:0/1588946295 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac801d070 con 0x5597c78ff5e0 2023-07-21T22:25:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.745+0000 7f7aba7fc700 1 -- 172.21.15.151:0/1588946295 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ac801e040 con 0x5597c78ff5e0 2023-07-21T22:25:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.745+0000 7f7aba7fc700 1 -- 172.21.15.151:0/1588946295 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac8004760 con 0x5597c78ff5e0 2023-07-21T22:25:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.746+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1588946295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 msgr2=0x5597c78ffa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.746+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c78ffa30 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009990 tx=0x7f7ac8005f00 comp rx=0 tx=0).stop 2023-07-21T22:25:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.746+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1588946295 shutdown_connections 2023-07-21T22:25:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.746+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c7904f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.746+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c78ffa30 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.746+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1588946295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c78ff0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.746+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1588946295 >> 172.21.15.151:0/1588946295 conn(0x5597c78f4c40 msgr2=0x5597c78fa300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.746+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1588946295 shutdown_connections 2023-07-21T22:25:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.746+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1588946295 wait complete. 2023-07-21T22:25:37.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.747+0000 7f7aedcbab80 1 -- start start 2023-07-21T22:25:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.747+0000 7f7aedcbab80 1 Processor -- start 2023-07-21T22:25:37.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.747+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c775b6b0 0x5597c790b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.747+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 0x5597c7908940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.747+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c7908f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.747+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c77f0a60 con 0x5597c775b6b0 2023-07-21T22:25:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.747+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c77f0760 con 0x5597c78ff5e0 2023-07-21T22:25:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.747+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c76d48c0 con 0x5597c7905480 2023-07-21T22:25:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.747+0000 7f7aedcbab80 10 client.0 _ll_register_callbacks cb 0x5597c77ee700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:37.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c775b6b0 0x5597c790b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c775b6b0 0x5597c790b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41744/0 (socket says 172.21.15.151:41744) 2023-07-21T22:25:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad3fff700 1 -- 172.21.15.151:0/1971212182 learned_addr learned my addr 172.21.15.151:0/1971212182 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad37fe700 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 0x5597c7908940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad899c700 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c7908f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad3fff700 1 -- 172.21.15.151:0/1971212182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 msgr2=0x5597c7908f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c7908f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad3fff700 1 -- 172.21.15.151:0/1971212182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 msgr2=0x5597c7908940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:37.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 0x5597c7908940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad3fff700 1 -- 172.21.15.151:0/1971212182 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ad410f300 con 0x5597c775b6b0 2023-07-21T22:25:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad37fe700 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 0x5597c7908940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c775b6b0 0x5597c790b6c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4096480 tx=0x7f7ac408f910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a25790c7bc7220e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.748+0000 7f7ab37fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7ab37fe700 1 -- 172.21.15.151:0/1971212182 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac409a3e0 con 0x5597c775b6b0 2023-07-21T22:25:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7ab37fe700 1 -- 172.21.15.151:0/1971212182 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7ac4010880 con 0x5597c775b6b0 2023-07-21T22:25:37.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1971212182 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597c77aa490 con 0x5597c775b6b0 2023-07-21T22:25:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7ab37fe700 1 -- 172.21.15.151:0/1971212182 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7ac4099f80 con 0x5597c775b6b0 2023-07-21T22:25:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7aedcbab80 10 client.16818 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1971212182 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5597c7667c00 con 0x5597c775b6b0 2023-07-21T22:25:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7ab37fe700 1 -- 172.21.15.151:0/1971212182 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5597c77aa490 con 0x5597c775b6b0 2023-07-21T22:25:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7ab37fe700 1 -- 172.21.15.151:0/1971212182 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f7ac4099500 con 0x5597c775b6b0 2023-07-21T22:25:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7aedcbab80 10 client.16818 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7aedcbab80 10 client.16818 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:37.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.749+0000 7f7aedcbab80 20 client.16818 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.750+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597c7918c10 0x5597c791b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.750+0000 7f7aedcbab80 4 client.16818 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:25:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.750+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1971212182 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597c7849e50 con 0x5597c7918c10 2023-07-21T22:25:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.750+0000 7f7ad37fe700 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597c7918c10 0x5597c791b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.750+0000 7f7ab37fe700 10 client.16818 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.750+0000 7f7ad37fe700 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597c7918c10 0x5597c791b020 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91cbd284f1a74a8a server_cookie=1e5920ae617d1eb9 in_seq=0 out_seq=0 2023-07-21T22:25:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.751+0000 7f7ab37fe700 1 -- 172.21.15.151:0/1971212182 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5597c7849e50 con 0x5597c7918c10 2023-07-21T22:25:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.751+0000 7f7ab37fe700 10 client.16818 handle_command_reply: tid=0 2023-07-21T22:25:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.751+0000 7f7aedcbab80 1 client.16818 shutdown 2023-07-21T22:25:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.751+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1971212182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c775b6b0 msgr2=0x5597c790b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.751+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c775b6b0 0x5597c790b6c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4096480 tx=0x7f7ac408f910 comp rx=0 tx=0).stop 2023-07-21T22:25:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1971212182 shutdown_connections 2023-07-21T22:25:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597c7918c10 0x5597c791b020 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c7908f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c775b6b0 0x5597c790b6c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/1971212182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 0x5597c7908940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7ab37fe700 0 client.16818 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1971212182 >> 172.21.15.151:0/1971212182 conn(0x5597c78f4c40 msgr2=0x5597c78f9540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1971212182 shutdown_connections 2023-07-21T22:25:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7aedcbab80 1 -- 172.21.15.151:0/1971212182 wait complete. 2023-07-21T22:25:37.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.752+0000 7f7aedcbab80 20 client.16818 trim_cache size 0 max 16384 2023-07-21T22:25:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.769+0000 7f7aedcbab80 1 Processor -- start 2023-07-21T22:25:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.769+0000 7f7aedcbab80 1 -- start start 2023-07-21T22:25:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c775b6b0 0x5597c78ff0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 0x5597c7904470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c7905480 0x5597c7908860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c79162d0 con 0x5597c7905480 2023-07-21T22:25:37.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c78f1d60 con 0x5597c78ff5e0 2023-07-21T22:25:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c7900350 con 0x5597c775b6b0 2023-07-21T22:25:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c775b6b0 0x5597c78ff0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7ad899c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c7905480 0x5597c7908860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c775b6b0 0x5597c78ff0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:53380/0 (socket says 172.21.15.151:53380) 2023-07-21T22:25:37.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7ad3fff700 1 -- 172.21.15.151:0/679485234 learned_addr learned my addr 172.21.15.151:0/679485234 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:37.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.770+0000 7f7ad37fe700 1 --2- 172.21.15.151:0/679485234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 0x5597c7904470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7ad3fff700 1 -- 172.21.15.151:0/679485234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 msgr2=0x5597c7904470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:37.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/679485234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 0x5597c7904470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7ad3fff700 1 -- 172.21.15.151:0/679485234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c7905480 msgr2=0x5597c7908860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/679485234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c7905480 0x5597c7908860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7ad3fff700 1 -- 172.21.15.151:0/679485234 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597c76a51f0 con 0x5597c775b6b0 2023-07-21T22:25:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7ad899c700 1 --2- 172.21.15.151:0/679485234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c7905480 0x5597c7908860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/679485234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c775b6b0 0x5597c78ff0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40969f0 tx=0x7f7ac400c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3686123c5e54c38 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7abaffd700 1 -- 172.21.15.151:0/679485234 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4099f80 con 0x5597c775b6b0 2023-07-21T22:25:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7abaffd700 1 -- 172.21.15.151:0/679485234 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ac409dfb0 con 0x5597c775b6b0 2023-07-21T22:25:37.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.771+0000 7f7abaffd700 1 -- 172.21.15.151:0/679485234 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac409a420 con 0x5597c775b6b0 2023-07-21T22:25:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.772+0000 7f7aedcbab80 1 -- 172.21.15.151:0/679485234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c775b6b0 msgr2=0x5597c78ff0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.772+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/679485234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c775b6b0 0x5597c78ff0a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40969f0 tx=0x7f7ac400c400 comp rx=0 tx=0).stop 2023-07-21T22:25:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.772+0000 7f7aedcbab80 1 -- 172.21.15.151:0/679485234 shutdown_connections 2023-07-21T22:25:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.772+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/679485234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c7905480 0x5597c7908860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.772+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/679485234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c775b6b0 0x5597c78ff0a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.772+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/679485234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c78ff5e0 0x5597c7904470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.772+0000 7f7aedcbab80 1 -- 172.21.15.151:0/679485234 >> 172.21.15.151:0/679485234 conn(0x5597c78f4c40 msgr2=0x5597c7907110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:37.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.772+0000 7f7aedcbab80 1 -- 172.21.15.151:0/679485234 shutdown_connections 2023-07-21T22:25:37.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.772+0000 7f7aedcbab80 1 -- 172.21.15.151:0/679485234 wait complete. 2023-07-21T22:25:37.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.773+0000 7f7aedcbab80 1 -- start start 2023-07-21T22:25:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.773+0000 7f7aedcbab80 1 Processor -- start 2023-07-21T22:25:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c790df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c790e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7aedcbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c796bad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c790ec20 con 0x5597c78ff5e0 2023-07-21T22:25:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c796c010 con 0x5597c775b6b0 2023-07-21T22:25:37.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7aedcbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597c796c180 con 0x5597c7905480 2023-07-21T22:25:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7aedcbab80 10 client.0 _ll_register_callbacks cb 0x7f7ac40998e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7ad37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c790e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7ad3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c790df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7ad899c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c796bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7ad37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c790e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41756/0 (socket says 172.21.15.151:41756) 2023-07-21T22:25:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7ad37fe700 1 -- 172.21.15.151:0/2974932586 learned_addr learned my addr 172.21.15.151:0/2974932586 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.774+0000 7f7ad899c700 1 -- 172.21.15.151:0/2974932586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 msgr2=0x5597c790df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:37.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ad899c700 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c790df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ad899c700 1 -- 172.21.15.151:0/2974932586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 msgr2=0x5597c790e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ad899c700 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c790e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ad899c700 1 -- 172.21.15.151:0/2974932586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7acc008d50 con 0x5597c7905480 2023-07-21T22:25:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c790df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ad899c700 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c796bad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009790 tx=0x7f7acc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43fd519bc7fd75c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ab37fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:25:37.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ab37fe700 1 -- 172.21.15.151:0/2974932586 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00e070 con 0x5597c7905480 2023-07-21T22:25:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7aedcbab80 1 -- 172.21.15.151:0/2974932586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7ac801e040 con 0x5597c7905480 2023-07-21T22:25:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ab37fe700 1 -- 172.21.15.151:0/2974932586 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f7acc004bb0 con 0x5597c7905480 2023-07-21T22:25:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7ab37fe700 1 -- 172.21.15.151:0/2974932586 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7acc004d70 con 0x5597c7905480 2023-07-21T22:25:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7aedcbab80 10 client.26572 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.775+0000 7f7aedcbab80 1 -- 172.21.15.151:0/2974932586 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x5597c7667c00 con 0x5597c7905480 2023-07-21T22:25:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.776+0000 7f7ab37fe700 1 -- 172.21.15.151:0/2974932586 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7ac801e040 con 0x5597c7905480 2023-07-21T22:25:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.776+0000 7f7ab37fe700 1 -- 172.21.15.151:0/2974932586 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f7acc037bc0 con 0x5597c7905480 2023-07-21T22:25:37.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.776+0000 7f7aedcbab80 10 client.26572 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.776+0000 7f7aedcbab80 10 client.26572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.776+0000 7f7aedcbab80 20 client.26572 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.776+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597c796d950 0x5597c796fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.776+0000 7f7aedcbab80 4 client.26572 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:25:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.776+0000 7f7aedcbab80 1 -- 172.21.15.151:0/2974932586 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5597c780bff0 con 0x5597c796d950 2023-07-21T22:25:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.777+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597c796d950 0x5597c796fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.777+0000 7f7ab37fe700 10 client.26572 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:37.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.777+0000 7f7ad3fff700 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597c796d950 0x5597c796fd60 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed5809ad286a1899 server_cookie=2f89ad4131750bd9 in_seq=0 out_seq=0 2023-07-21T22:25:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.795+0000 7f7ab37fe700 1 -- 172.21.15.151:0/2974932586 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5597c780bff0 con 0x5597c796d950 2023-07-21T22:25:37.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.795+0000 7f7ab37fe700 10 client.26572 handle_command_reply: tid=0 2023-07-21T22:25:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.795+0000 7f7aedcbab80 1 client.26572 shutdown 2023-07-21T22:25:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 -- 172.21.15.151:0/2974932586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 msgr2=0x5597c796bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c796bad0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009790 tx=0x7f7acc004ad0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 -- 172.21.15.151:0/2974932586 shutdown_connections 2023-07-21T22:25:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597c796d950 0x5597c796fd60 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597c775b6b0 0x5597c790df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7ab37fe700 0 client.26572 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:37.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597c7905480 0x5597c796bad0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 --2- 172.21.15.151:0/2974932586 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597c78ff5e0 0x5597c790e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 -- 172.21.15.151:0/2974932586 >> 172.21.15.151:0/2974932586 conn(0x5597c78f4c40 msgr2=0x5597c79079a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 -- 172.21.15.151:0/2974932586 shutdown_connections 2023-07-21T22:25:37.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 1 -- 172.21.15.151:0/2974932586 wait complete. 2023-07-21T22:25:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.796+0000 7f7aedcbab80 20 client.26572 trim_cache size 0 max 16384 2023-07-21T22:25:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:25:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:25:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:25:37.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:25:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 -- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7abc0a1340 msgr2=0x7f7abc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7abc0a1340 0x7f7abc0a37f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009f70 tx=0x7f7acc00b040 comp rx=0 tx=0).stop 2023-07-21T22:25:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 -- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad4072ac0 msgr2=0x7f7ad4197ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad4072ac0 0x7f7ad4197ce0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400e9a0 tx=0x7f7ac400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 -- 172.21.15.151:0/2684209445 shutdown_connections 2023-07-21T22:25:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7abc0a1340 0x7f7abc0a37f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7ad410c2b0 0x7f7ad419b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7ad4072ac0 0x7f7ad4197ce0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 --2- 172.21.15.151:0/2684209445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ad40733d0 0x7f7ad4198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:37.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 -- 172.21.15.151:0/2684209445 >> 172.21.15.151:0/2684209445 conn(0x7f7ad40fb440 msgr2=0x7f7ad410e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:37.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 -- 172.21.15.151:0/2684209445 shutdown_connections 2023-07-21T22:25:37.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:37.797+0000 7f7ad919d700 1 -- 172.21.15.151:0/2684209445 wait complete. 2023-07-21T22:25:38.262 INFO:teuthology.orchestra.run.smithi151.stderr:26300000 of 50000000 tuples (52%) done (elapsed 361.75 s, remaining 325.99 s) 2023-07-21T22:25:38.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:38 smithi187 ceph-mon[96918]: pgmap v196: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:25:38.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:38 smithi195 ceph-mon[97365]: pgmap v196: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:25:38.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:38 smithi151 ceph-mon[95510]: pgmap v196: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:25:39.619 INFO:teuthology.orchestra.run.smithi151.stderr:26400000 of 50000000 tuples (52%) done (elapsed 363.11 s, remaining 324.60 s) 2023-07-21T22:25:40.830 INFO:teuthology.orchestra.run.smithi151.stderr:26500000 of 50000000 tuples (53%) done (elapsed 364.32 s, remaining 323.08 s) 2023-07-21T22:25:40.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:40 smithi187 ceph-mon[96918]: pgmap v197: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:25:40.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:40 smithi195 ceph-mon[97365]: pgmap v197: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:25:40.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:40 smithi151 ceph-mon[95510]: pgmap v197: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:25:42.128 INFO:teuthology.orchestra.run.smithi151.stderr:26600000 of 50000000 tuples (53%) done (elapsed 365.62 s, remaining 321.64 s) 2023-07-21T22:25:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:42 smithi187 ceph-mon[96918]: pgmap v198: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:25:42.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:42 smithi195 ceph-mon[97365]: pgmap v198: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:25:42.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:42 smithi151 ceph-mon[95510]: pgmap v198: 97 pgs: 97 active+clean; 6.0 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:25:43.452 INFO:teuthology.orchestra.run.smithi151.stderr:26700000 of 50000000 tuples (53%) done (elapsed 366.94 s, remaining 320.22 s) 2023-07-21T22:25:44.721 INFO:teuthology.orchestra.run.smithi151.stderr:26800000 of 50000000 tuples (53%) done (elapsed 368.21 s, remaining 318.75 s) 2023-07-21T22:25:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:44 smithi187 ceph-mon[96918]: pgmap v199: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 32 MiB/s wr, 99 op/s 2023-07-21T22:25:44.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:44 smithi195 ceph-mon[97365]: pgmap v199: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 32 MiB/s wr, 99 op/s 2023-07-21T22:25:44.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:44 smithi151 ceph-mon[95510]: pgmap v199: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 32 MiB/s wr, 99 op/s 2023-07-21T22:25:45.997 INFO:teuthology.orchestra.run.smithi151.stderr:26900000 of 50000000 tuples (53%) done (elapsed 369.49 s, remaining 317.29 s) 2023-07-21T22:25:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:46 smithi187 ceph-mon[96918]: pgmap v200: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:25:46.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:46 smithi195 ceph-mon[97365]: pgmap v200: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:25:46.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:46 smithi151 ceph-mon[95510]: pgmap v200: 97 pgs: 97 active+clean; 6.1 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:25:47.325 INFO:teuthology.orchestra.run.smithi151.stderr:27000000 of 50000000 tuples (54%) done (elapsed 370.82 s, remaining 315.88 s) 2023-07-21T22:25:48.564 INFO:teuthology.orchestra.run.smithi151.stderr:27100000 of 50000000 tuples (54%) done (elapsed 372.06 s, remaining 314.39 s) 2023-07-21T22:25:48.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:48 smithi187 ceph-mon[96918]: pgmap v201: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 35 MiB/s wr, 97 op/s 2023-07-21T22:25:48.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:48 smithi195 ceph-mon[97365]: pgmap v201: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 35 MiB/s wr, 97 op/s 2023-07-21T22:25:48.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:48 smithi151 ceph-mon[95510]: pgmap v201: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 137 KiB/s rd, 35 MiB/s wr, 97 op/s 2023-07-21T22:25:49.822 INFO:teuthology.orchestra.run.smithi151.stderr:27200000 of 50000000 tuples (54%) done (elapsed 373.31 s, remaining 312.92 s) 2023-07-21T22:25:50.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:50 smithi187 ceph-mon[96918]: pgmap v202: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:25:50.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:50 smithi195 ceph-mon[97365]: pgmap v202: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:25:50.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:50 smithi151 ceph-mon[95510]: pgmap v202: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:25:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.975+0000 7f303a9ff700 1 -- 172.21.15.151:0/3793970950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3034105b10 msgr2=0x7f3034105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.975+0000 7f303a9ff700 1 --2- 172.21.15.151:0/3793970950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3034105b10 0x7f3034105ee0 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f3024009990 tx=0x7f3024009ca0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.975+0000 7f303a9ff700 1 -- 172.21.15.151:0/3793970950 shutdown_connections 2023-07-21T22:25:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.975+0000 7f303a9ff700 1 --2- 172.21.15.151:0/3793970950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30341004b0 0x7f303410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.975+0000 7f303a9ff700 1 --2- 172.21.15.151:0/3793970950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3034105b10 0x7f3034105ee0 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.975+0000 7f303a9ff700 1 --2- 172.21.15.151:0/3793970950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30340ffb00 0x7f30340fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.975+0000 7f303a9ff700 1 -- 172.21.15.151:0/3793970950 >> 172.21.15.151:0/3793970950 conn(0x7f30340fb600 msgr2=0x7f30340fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.975+0000 7f303a9ff700 1 -- 172.21.15.151:0/3793970950 shutdown_connections 2023-07-21T22:25:51.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.975+0000 7f303a9ff700 1 -- 172.21.15.151:0/3793970950 wait complete. 2023-07-21T22:25:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.976+0000 7f303a9ff700 1 Processor -- start 2023-07-21T22:25:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.976+0000 7f303a9ff700 1 -- start start 2023-07-21T22:25:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f303a9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30340ffb00 0x7f3034197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f303a9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30341004b0 0x7f30341982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f303a9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3034105b10 0x7f303419c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f303a9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303419cf60 con 0x7f30341004b0 2023-07-21T22:25:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f303a9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303419d0d0 con 0x7f3034105b10 2023-07-21T22:25:51.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f303a9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303419d290 con 0x7f30340ffb00 2023-07-21T22:25:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f30337fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30341004b0 0x7f30341982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f30337fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30341004b0 0x7f30341982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56308/0 (socket says 172.21.15.151:56308) 2023-07-21T22:25:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f30337fe700 1 -- 172.21.15.151:0/1635712010 learned_addr learned my addr 172.21.15.151:0/1635712010 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f3033fff700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30340ffb00 0x7f3034197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.977+0000 7f3038f9c700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3034105b10 0x7f303419c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f30337fe700 1 -- 172.21.15.151:0/1635712010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30340ffb00 msgr2=0x7f3034197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f30337fe700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30340ffb00 0x7f3034197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f30337fe700 1 -- 172.21.15.151:0/1635712010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3034105b10 msgr2=0x7f303419c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:51.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f30337fe700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3034105b10 0x7f303419c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f30337fe700 1 -- 172.21.15.151:0/1635712010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240095f0 con 0x7f30341004b0 2023-07-21T22:25:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f30337fe700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30341004b0 0x7f30341982b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f302800d950 tx=0x7f302800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f30317fa700 1 -- 172.21.15.151:0/1635712010 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302800f890 con 0x7f30341004b0 2023-07-21T22:25:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f303a9ff700 1 -- 172.21.15.151:0/1635712010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303419d570 con 0x7f30341004b0 2023-07-21T22:25:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f30317fa700 1 -- 172.21.15.151:0/1635712010 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f302800fe80 con 0x7f30341004b0 2023-07-21T22:25:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f30317fa700 1 -- 172.21.15.151:0/1635712010 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302800e3b0 con 0x7f30341004b0 2023-07-21T22:25:51.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.978+0000 7f303a9ff700 1 -- 172.21.15.151:0/1635712010 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30341a4db0 con 0x7f30341004b0 2023-07-21T22:25:51.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.982+0000 7f30317fa700 1 -- 172.21.15.151:0/1635712010 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f3028010460 con 0x7f30341004b0 2023-07-21T22:25:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.983+0000 7f30317fa700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f301c0a12c0 0x7f301c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.983+0000 7f30317fa700 1 -- 172.21.15.151:0/1635712010 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f30280ccab0 con 0x7f30341004b0 2023-07-21T22:25:51.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.984+0000 7f3033fff700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f301c0a12c0 0x7f301c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.984+0000 7f304e281b80 1 Processor -- start 2023-07-21T22:25:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.984+0000 7f304e281b80 1 -- start start 2023-07-21T22:25:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.984+0000 7f3033fff700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f301c0a12c0 0x7f301c0a3770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f302400b5c0 tx=0x7f3024005fb0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.984+0000 7f304e281b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242105cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.984+0000 7f304e281b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632420fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.984+0000 7f304e281b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x5632421004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f304e281b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563242005c50 con 0x563241f5c6b0 2023-07-21T22:25:51.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f304e281b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632420589e0 con 0x563242106660 2023-07-21T22:25:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f304e281b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563242051e70 con 0x563242106210 2023-07-21T22:25:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f3033fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242105cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f3033fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242105cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56322/0 (socket says 172.21.15.151:56322) 2023-07-21T22:25:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f3033fff700 1 -- 172.21.15.151:0/2709595843 learned_addr learned my addr 172.21.15.151:0/2709595843 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f30337fe700 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632420fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f3038f9c700 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x5632421004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f3033fff700 1 -- 172.21.15.151:0/2709595843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 msgr2=0x5632420fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f3033fff700 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632420fff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f3033fff700 1 -- 172.21.15.151:0/2709595843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 msgr2=0x5632421004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f3033fff700 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x5632421004a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f3033fff700 1 -- 172.21.15.151:0/2709595843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563241e7fd80 con 0x563241f5c6b0 2023-07-21T22:25:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.985+0000 7f30337fe700 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632420fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:51.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.986+0000 7f3033fff700 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242105cd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3024005310 tx=0x7f3024020000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb55f699a445903 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.986+0000 7f301a7fc700 1 -- 172.21.15.151:0/2709595843 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302400bc60 con 0x563241f5c6b0 2023-07-21T22:25:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.986+0000 7f301a7fc700 1 -- 172.21.15.151:0/2709595843 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f302401e040 con 0x563241f5c6b0 2023-07-21T22:25:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.986+0000 7f301a7fc700 1 -- 172.21.15.151:0/2709595843 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024003a80 con 0x563241f5c6b0 2023-07-21T22:25:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.987+0000 7f304e281b80 1 -- 172.21.15.151:0/2709595843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 msgr2=0x563242105cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.987+0000 7f304e281b80 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242105cd0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3024005310 tx=0x7f3024020000 comp rx=0 tx=0).stop 2023-07-21T22:25:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.987+0000 7f304e281b80 1 -- 172.21.15.151:0/2709595843 shutdown_connections 2023-07-21T22:25:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.987+0000 7f304e281b80 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x5632421004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.987+0000 7f304e281b80 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242105cd0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.987+0000 7f304e281b80 1 --2- 172.21.15.151:0/2709595843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632420fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.987+0000 7f304e281b80 1 -- 172.21.15.151:0/2709595843 >> 172.21.15.151:0/2709595843 conn(0x5632420f5ae0 msgr2=0x5632420fb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.987+0000 7f304e281b80 1 -- 172.21.15.151:0/2709595843 shutdown_connections 2023-07-21T22:25:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.987+0000 7f304e281b80 1 -- 172.21.15.151:0/2709595843 wait complete. 2023-07-21T22:25:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.988+0000 7f304e281b80 1 -- start start 2023-07-21T22:25:51.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.988+0000 7f304e281b80 1 Processor -- start 2023-07-21T22:25:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f304e281b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x56324210c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f304e281b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x563242109930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f304e281b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x56324210a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f304e281b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563241ff1a60 con 0x563241f5c6b0 2023-07-21T22:25:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f304e281b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563241ff1760 con 0x563242106660 2023-07-21T22:25:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f304e281b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563241ed58c0 con 0x563242106210 2023-07-21T22:25:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f304e281b80 10 client.0 _ll_register_callbacks cb 0x563241fef700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f3033fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x56324210c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f3033fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x56324210c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56324/0 (socket says 172.21.15.151:56324) 2023-07-21T22:25:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f30337fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x563242109930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f3033fff700 1 -- 172.21.15.151:0/3129156461 learned_addr learned my addr 172.21.15.151:0/3129156461 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f3038f9c700 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x56324210a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f30337fe700 1 -- 172.21.15.151:0/3129156461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 msgr2=0x56324210a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f30337fe700 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x56324210a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f30337fe700 1 -- 172.21.15.151:0/3129156461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 msgr2=0x56324210c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.989+0000 7f30337fe700 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x56324210c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.990+0000 7f30337fe700 1 -- 172.21.15.151:0/3129156461 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30341a4db0 con 0x563242106210 2023-07-21T22:25:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.990+0000 7f30337fe700 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x563242109930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f30280ca210 tx=0x7f30280997e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39558f13daf355e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.990+0000 7f30137fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:25:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.990+0000 7f30137fe700 1 -- 172.21.15.151:0/3129156461 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30280a1fe0 con 0x563242106210 2023-07-21T22:25:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.990+0000 7f30137fe700 1 -- 172.21.15.151:0/3129156461 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f30280b2200 con 0x563242106210 2023-07-21T22:25:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.990+0000 7f304e281b80 1 -- 172.21.15.151:0/3129156461 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563241fab490 con 0x563242106210 2023-07-21T22:25:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.990+0000 7f30137fe700 1 -- 172.21.15.151:0/3129156461 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3028099080 con 0x563242106210 2023-07-21T22:25:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.990+0000 7f304e281b80 10 client.26584 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:51.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.990+0000 7f304e281b80 1 -- 172.21.15.151:0/3129156461 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f303410d240 con 0x563242106210 2023-07-21T22:25:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.991+0000 7f30137fe700 1 -- 172.21.15.151:0/3129156461 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563241fab490 con 0x563242106210 2023-07-21T22:25:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.991+0000 7f30137fe700 1 -- 172.21.15.151:0/3129156461 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3028095980 con 0x563242106210 2023-07-21T22:25:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.991+0000 7f304e281b80 10 client.26584 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.991+0000 7f304e281b80 10 client.26584 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.991+0000 7f304e281b80 20 client.26584 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.991+0000 7f304e281b80 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563242119b30 0x56324211bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.991+0000 7f304e281b80 4 client.26584 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:25:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.991+0000 7f304e281b80 1 -- 172.21.15.151:0/3129156461 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56324204ae50 con 0x563242119b30 2023-07-21T22:25:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.991+0000 7f3033fff700 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563242119b30 0x56324211bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.992+0000 7f3033fff700 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563242119b30 0x56324211bf40 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e0d97cc049da239 server_cookie=ca35ade46b839175 in_seq=0 out_seq=0 2023-07-21T22:25:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.992+0000 7f30137fe700 10 client.26584 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f30137fe700 1 -- 172.21.15.151:0/3129156461 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56324204ae50 con 0x563242119b30 2023-07-21T22:25:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f30137fe700 10 client.26584 handle_command_reply: tid=0 2023-07-21T22:25:51.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 client.26584 shutdown 2023-07-21T22:25:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 -- 172.21.15.151:0/3129156461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 msgr2=0x563242109930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x563242109930 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f30280ca210 tx=0x7f30280997e0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 -- 172.21.15.151:0/3129156461 shutdown_connections 2023-07-21T22:25:51.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563242119b30 0x56324211bf40 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x56324210a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x56324210c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 --2- 172.21.15.151:0/3129156461 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x563242109930 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f30137fe700 0 client.26584 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:51.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 -- 172.21.15.151:0/3129156461 >> 172.21.15.151:0/3129156461 conn(0x5632420f5ae0 msgr2=0x5632420fa3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:51.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 -- 172.21.15.151:0/3129156461 shutdown_connections 2023-07-21T22:25:51.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.993+0000 7f304e281b80 1 -- 172.21.15.151:0/3129156461 wait complete. 2023-07-21T22:25:51.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:50.994+0000 7f304e281b80 20 client.26584 trim_cache size 0 max 16384 2023-07-21T22:25:51.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.015+0000 7f304e281b80 1 Processor -- start 2023-07-21T22:25:51.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.015+0000 7f304e281b80 1 -- start start 2023-07-21T22:25:51.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.015+0000 7f304e281b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563241f5c6b0 0x56324210f200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.015+0000 7f304e281b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632420fab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.015+0000 7f304e281b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563242106660 0x5632420fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.015+0000 7f304e281b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632420fb5e0 con 0x563242106660 2023-07-21T22:25:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f304e281b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563242104600 con 0x563241f5c6b0 2023-07-21T22:25:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f304e281b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56324210f740 con 0x563242106210 2023-07-21T22:25:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3038f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563242106660 0x5632420fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3038f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563242106660 0x5632420fb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56340/0 (socket says 172.21.15.151:56340) 2023-07-21T22:25:51.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3038f9c700 1 -- 172.21.15.151:0/1338607453 learned_addr learned my addr 172.21.15.151:0/1338607453 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3033fff700 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563241f5c6b0 0x56324210f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f30337fe700 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632420fab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3038f9c700 1 -- 172.21.15.151:0/1338607453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 msgr2=0x5632420fab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3038f9c700 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632420fab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3038f9c700 1 -- 172.21.15.151:0/1338607453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563241f5c6b0 msgr2=0x56324210f200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3038f9c700 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563241f5c6b0 0x56324210f200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3038f9c700 1 -- 172.21.15.151:0/1338607453 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563241e68c00 con 0x563242106660 2023-07-21T22:25:51.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.016+0000 7f3033fff700 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563241f5c6b0 0x56324210f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:25:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.017+0000 7f3038f9c700 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563242106660 0x5632420fb0a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f302c0099c0 tx=0x7f302c009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e148fa93f755a25b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.017+0000 7f301affd700 1 -- 172.21.15.151:0/1338607453 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c003bd0 con 0x563242106660 2023-07-21T22:25:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.017+0000 7f301affd700 1 -- 172.21.15.151:0/1338607453 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f302c00f040 con 0x563242106660 2023-07-21T22:25:51.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.017+0000 7f301affd700 1 -- 172.21.15.151:0/1338607453 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302c0059b0 con 0x563242106660 2023-07-21T22:25:51.065 INFO:teuthology.orchestra.run.smithi151.stderr:27300000 of 50000000 tuples (54%) done (elapsed 374.55 s, remaining 311.44 s) 2023-07-21T22:25:51.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 -- 172.21.15.151:0/1338607453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563242106660 msgr2=0x5632420fb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563242106660 0x5632420fb0a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f302c0099c0 tx=0x7f302c009cd0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 -- 172.21.15.151:0/1338607453 shutdown_connections 2023-07-21T22:25:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563241f5c6b0 0x56324210f200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563242106660 0x5632420fb0a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 --2- 172.21.15.151:0/1338607453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632420fab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 -- 172.21.15.151:0/1338607453 >> 172.21.15.151:0/1338607453 conn(0x5632420f5ae0 msgr2=0x563242107330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:51.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 -- 172.21.15.151:0/1338607453 shutdown_connections 2023-07-21T22:25:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 -- 172.21.15.151:0/1338607453 wait complete. 2023-07-21T22:25:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.018+0000 7f304e281b80 1 -- start start 2023-07-21T22:25:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.019+0000 7f304e281b80 1 Processor -- start 2023-07-21T22:25:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.019+0000 7f304e281b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242161b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.019+0000 7f304e281b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632421620d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.019+0000 7f304e281b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x563242165fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.019+0000 7f304e281b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563242166530 con 0x563241f5c6b0 2023-07-21T22:25:51.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.019+0000 7f304e281b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5632421666a0 con 0x563242106660 2023-07-21T22:25:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.019+0000 7f304e281b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563242166860 con 0x563242106210 2023-07-21T22:25:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.019+0000 7f304e281b80 10 client.0 _ll_register_callbacks cb 0x7f30280994f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:25:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3033fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242161b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3033fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242161b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56350/0 (socket says 172.21.15.151:56350) 2023-07-21T22:25:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3033fff700 1 -- 172.21.15.151:0/2278764641 learned_addr learned my addr 172.21.15.151:0/2278764641 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:25:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f30337fe700 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632421620d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3038f9c700 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x563242165fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3033fff700 1 -- 172.21.15.151:0/2278764641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 msgr2=0x5632421620d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3033fff700 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632421620d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3033fff700 1 -- 172.21.15.151:0/2278764641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 msgr2=0x563242165fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:25:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3033fff700 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x563242165fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3033fff700 1 -- 172.21.15.151:0/2278764641 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563241e7fd80 con 0x563241f5c6b0 2023-07-21T22:25:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f3033fff700 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242161b90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f30240098e0 tx=0x7f3024005620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be3580d65c7c141 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:25:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.020+0000 7f30137fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:25:51.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f30137fe700 1 -- 172.21.15.151:0/2278764641 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302400bab0 con 0x563241f5c6b0 2023-07-21T22:25:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f304e281b80 1 -- 172.21.15.151:0/2278764641 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f302401e040 con 0x563241f5c6b0 2023-07-21T22:25:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f30137fe700 1 -- 172.21.15.151:0/2278764641 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f302400bc10 con 0x563241f5c6b0 2023-07-21T22:25:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f30137fe700 1 -- 172.21.15.151:0/2278764641 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f302400bdd0 con 0x563241f5c6b0 2023-07-21T22:25:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f304e281b80 10 client.16842 fetch_fsmap learned FSMap version 34 2023-07-21T22:25:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f304e281b80 1 -- 172.21.15.151:0/2278764641 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x7f302c003d30 con 0x563241f5c6b0 2023-07-21T22:25:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f30137fe700 1 -- 172.21.15.151:0/2278764641 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f302401e040 con 0x563241f5c6b0 2023-07-21T22:25:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f30137fe700 1 -- 172.21.15.151:0/2278764641 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f30240049c0 con 0x563241f5c6b0 2023-07-21T22:25:51.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f304e281b80 10 client.16842 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:25:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f304e281b80 10 client.16842 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:25:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f304e281b80 20 client.16842 populate_metadata read hostname 'smithi151' 2023-07-21T22:25:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f304e281b80 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56324216ee90 0x5632421712a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:25:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f304e281b80 4 client.16842 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:25:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.021+0000 7f304e281b80 1 -- 172.21.15.151:0/2278764641 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56324200cff0 con 0x56324216ee90 2023-07-21T22:25:51.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.022+0000 7f30337fe700 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56324216ee90 0x5632421712a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:25:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.022+0000 7f30137fe700 10 client.16842 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:51.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.022+0000 7f30337fe700 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56324216ee90 0x5632421712a0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=99bb73b1dc65f0b0 server_cookie=b30e3926095dbbd7 in_seq=0 out_seq=0 2023-07-21T22:25:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.038+0000 7f30137fe700 1 -- 172.21.15.151:0/2278764641 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56324200cff0 con 0x56324216ee90 2023-07-21T22:25:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.038+0000 7f30137fe700 10 client.16842 handle_command_reply: tid=0 2023-07-21T22:25:51.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.038+0000 7f304e281b80 1 client.16842 shutdown 2023-07-21T22:25:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.038+0000 7f304e281b80 1 -- 172.21.15.151:0/2278764641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 msgr2=0x563242161b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.038+0000 7f304e281b80 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242161b90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f30240098e0 tx=0x7f3024005620 comp rx=0 tx=0).stop 2023-07-21T22:25:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.038+0000 7f304e281b80 1 -- 172.21.15.151:0/2278764641 shutdown_connections 2023-07-21T22:25:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f304e281b80 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56324216ee90 0x5632421712a0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f304e281b80 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563242106660 0x563242165fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f304e281b80 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563241f5c6b0 0x563242161b90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f30137fe700 0 client.16842 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:25:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f304e281b80 1 --2- 172.21.15.151:0/2278764641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563242106210 0x5632421620d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f304e281b80 1 -- 172.21.15.151:0/2278764641 >> 172.21.15.151:0/2278764641 conn(0x5632420f5ae0 msgr2=0x563242104a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f304e281b80 1 -- 172.21.15.151:0/2278764641 shutdown_connections 2023-07-21T22:25:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f304e281b80 1 -- 172.21.15.151:0/2278764641 wait complete. 2023-07-21T22:25:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f304e281b80 20 client.16842 trim_cache size 0 max 16384 2023-07-21T22:25:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:25:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:25:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:25:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:25:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f303a9ff700 1 -- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f301c0a12c0 msgr2=0x7f301c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.039+0000 7f303a9ff700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f301c0a12c0 0x7f301c0a3770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f302400b5c0 tx=0x7f3024005fb0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 -- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30341004b0 msgr2=0x7f30341982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:25:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30341004b0 0x7f30341982b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f302800d950 tx=0x7f302800dc60 comp rx=0 tx=0).stop 2023-07-21T22:25:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 -- 172.21.15.151:0/1635712010 shutdown_connections 2023-07-21T22:25:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f301c0a12c0 0x7f301c0a3770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3034105b10 0x7f303419c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f30340ffb00 0x7f3034197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 --2- 172.21.15.151:0/1635712010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30341004b0 0x7f30341982b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:25:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 -- 172.21.15.151:0/1635712010 >> 172.21.15.151:0/1635712010 conn(0x7f30340fb600 msgr2=0x7f303410ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:25:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 -- 172.21.15.151:0/1635712010 shutdown_connections 2023-07-21T22:25:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:25:51.040+0000 7f303a9ff700 1 -- 172.21.15.151:0/1635712010 wait complete. 2023-07-21T22:25:52.342 INFO:teuthology.orchestra.run.smithi151.stderr:27400000 of 50000000 tuples (54%) done (elapsed 375.83 s, remaining 309.99 s) 2023-07-21T22:25:52.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:52 smithi187 ceph-mon[96918]: pgmap v203: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:25:52.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:52 smithi195 ceph-mon[97365]: pgmap v203: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:25:52.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:52 smithi151 ceph-mon[95510]: pgmap v203: 97 pgs: 97 active+clean; 6.2 GiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:25:53.554 INFO:teuthology.orchestra.run.smithi151.stderr:27500000 of 50000000 tuples (55%) done (elapsed 377.05 s, remaining 308.49 s) 2023-07-21T22:25:54.750 INFO:teuthology.orchestra.run.smithi151.stderr:27600000 of 50000000 tuples (55%) done (elapsed 378.24 s, remaining 306.98 s) 2023-07-21T22:25:54.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:54 smithi187 ceph-mon[96918]: pgmap v204: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 35 MiB/s wr, 96 op/s 2023-07-21T22:25:54.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:54 smithi195 ceph-mon[97365]: pgmap v204: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 35 MiB/s wr, 96 op/s 2023-07-21T22:25:54.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:54 smithi151 ceph-mon[95510]: pgmap v204: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 35 MiB/s wr, 96 op/s 2023-07-21T22:25:55.961 INFO:teuthology.orchestra.run.smithi151.stderr:27700000 of 50000000 tuples (55%) done (elapsed 379.45 s, remaining 305.48 s) 2023-07-21T22:25:56.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:56 smithi187 ceph-mon[96918]: pgmap v205: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 66 op/s 2023-07-21T22:25:56.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:56 smithi195 ceph-mon[97365]: pgmap v205: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 66 op/s 2023-07-21T22:25:56.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:56 smithi151 ceph-mon[95510]: pgmap v205: 97 pgs: 97 active+clean; 6.3 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 66 op/s 2023-07-21T22:25:57.434 INFO:teuthology.orchestra.run.smithi151.stderr:27800000 of 50000000 tuples (55%) done (elapsed 380.93 s, remaining 304.19 s) 2023-07-21T22:25:58.656 INFO:teuthology.orchestra.run.smithi151.stderr:27900000 of 50000000 tuples (55%) done (elapsed 382.15 s, remaining 302.71 s) 2023-07-21T22:25:58.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:25:58 smithi187 ceph-mon[96918]: pgmap v206: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 35 MiB/s wr, 75 op/s 2023-07-21T22:25:58.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:25:58 smithi195 ceph-mon[97365]: pgmap v206: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 35 MiB/s wr, 75 op/s 2023-07-21T22:25:58.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:25:58 smithi151 ceph-mon[95510]: pgmap v206: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 35 MiB/s wr, 75 op/s 2023-07-21T22:25:59.880 INFO:teuthology.orchestra.run.smithi151.stderr:28000000 of 50000000 tuples (56%) done (elapsed 383.37 s, remaining 301.22 s) 2023-07-21T22:26:00.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:00 smithi187 ceph-mon[96918]: pgmap v207: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-07-21T22:26:00.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:00 smithi195 ceph-mon[97365]: pgmap v207: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-07-21T22:26:00.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:00 smithi151 ceph-mon[95510]: pgmap v207: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-07-21T22:26:01.165 INFO:teuthology.orchestra.run.smithi151.stderr:28100000 of 50000000 tuples (56%) done (elapsed 384.66 s, remaining 299.79 s) 2023-07-21T22:26:02.455 INFO:teuthology.orchestra.run.smithi151.stderr:28200000 of 50000000 tuples (56%) done (elapsed 385.95 s, remaining 298.36 s) 2023-07-21T22:26:02.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:02 smithi187 ceph-mon[96918]: pgmap v208: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-07-21T22:26:02.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:02 smithi195 ceph-mon[97365]: pgmap v208: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-07-21T22:26:02.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:02 smithi151 ceph-mon[95510]: pgmap v208: 97 pgs: 97 active+clean; 6.4 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 41 op/s 2023-07-21T22:26:03.671 INFO:teuthology.orchestra.run.smithi151.stderr:28300000 of 50000000 tuples (56%) done (elapsed 387.16 s, remaining 296.87 s) 2023-07-21T22:26:04.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.223+0000 7f35d59ff700 1 -- 172.21.15.151:0/2721071578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0101700 msgr2=0x7f35d0109bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:04.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.223+0000 7f35d59ff700 1 --2- 172.21.15.151:0/2721071578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0101700 0x7f35d0109bf0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009990 tx=0x7f35c4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.223+0000 7f35d59ff700 1 -- 172.21.15.151:0/2721071578 shutdown_connections 2023-07-21T22:26:04.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.223+0000 7f35d59ff700 1 --2- 172.21.15.151:0/2721071578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d0100df0 0x7f35d01011c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.223+0000 7f35d59ff700 1 --2- 172.21.15.151:0/2721071578 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d010a130 0x7f35d010c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.223+0000 7f35d59ff700 1 --2- 172.21.15.151:0/2721071578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0101700 0x7f35d0109bf0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.223+0000 7f35d59ff700 1 -- 172.21.15.151:0/2721071578 >> 172.21.15.151:0/2721071578 conn(0x7f35d0075ba0 msgr2=0x7f35d0075fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:04.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.223+0000 7f35d59ff700 1 -- 172.21.15.151:0/2721071578 shutdown_connections 2023-07-21T22:26:04.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.223+0000 7f35d59ff700 1 -- 172.21.15.151:0/2721071578 wait complete. 2023-07-21T22:26:04.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.224+0000 7f35d59ff700 1 Processor -- start 2023-07-21T22:26:04.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.224+0000 7f35d59ff700 1 -- start start 2023-07-21T22:26:04.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35d59ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0100df0 0x7f35d0197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35d59ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d0101700 0x7f35d0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35d59ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d010a130 0x7f35d019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35d59ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d019cfd0 con 0x7f35d0100df0 2023-07-21T22:26:04.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35d59ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d019d140 con 0x7f35d010a130 2023-07-21T22:26:04.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35d59ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d019d300 con 0x7f35d0101700 2023-07-21T22:26:04.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35ceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0100df0 0x7f35d0197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35ceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0100df0 0x7f35d0197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38392/0 (socket says 172.21.15.151:38392) 2023-07-21T22:26:04.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35ceffd700 1 -- 172.21.15.151:0/743668148 learned_addr learned my addr 172.21.15.151:0/743668148 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:04.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35ce7fc700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d0101700 0x7f35d0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d010a130 0x7f35d019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35ceffd700 1 -- 172.21.15.151:0/743668148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d0101700 msgr2=0x7f35d0198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:04.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35ceffd700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d0101700 0x7f35d0198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35ceffd700 1 -- 172.21.15.151:0/743668148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d010a130 msgr2=0x7f35d019c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:04.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35ceffd700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d010a130 0x7f35d019c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.225+0000 7f35ceffd700 1 -- 172.21.15.151:0/743668148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c40095f0 con 0x7f35d0100df0 2023-07-21T22:26:04.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.226+0000 7f35ceffd700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0100df0 0x7f35d0197de0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f35c000d980 tx=0x7f35c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:04.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.226+0000 7f35d49fd700 1 -- 172.21.15.151:0/743668148 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0004220 con 0x7f35d0100df0 2023-07-21T22:26:04.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.226+0000 7f35d59ff700 1 -- 172.21.15.151:0/743668148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d019d5e0 con 0x7f35d0100df0 2023-07-21T22:26:04.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.226+0000 7f35d49fd700 1 -- 172.21.15.151:0/743668148 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35c0007640 con 0x7f35d0100df0 2023-07-21T22:26:04.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.226+0000 7f35d49fd700 1 -- 172.21.15.151:0/743668148 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00055e0 con 0x7f35d0100df0 2023-07-21T22:26:04.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.226+0000 7f35d59ff700 1 -- 172.21.15.151:0/743668148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d01a4e20 con 0x7f35d0100df0 2023-07-21T22:26:04.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.230+0000 7f35d49fd700 1 -- 172.21.15.151:0/743668148 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f35c0004750 con 0x7f35d0100df0 2023-07-21T22:26:04.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.232+0000 7f35e929bb80 1 Processor -- start 2023-07-21T22:26:04.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.232+0000 7f35e929bb80 1 -- start start 2023-07-21T22:26:04.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.232+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5decd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.232+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.232+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5d94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.232+0000 7f35e929bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b4dec50 con 0x55e19b5df660 2023-07-21T22:26:04.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.232+0000 7f35e929bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b5319e0 con 0x55e19b4356b0 2023-07-21T22:26:04.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.232+0000 7f35e929bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b52ae70 con 0x55e19b5df210 2023-07-21T22:26:04.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35d49fd700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a12c0 0x7f35b80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35d49fd700 1 -- 172.21.15.151:0/743668148 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f35c00ccb10 con 0x7f35d0100df0 2023-07-21T22:26:04.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35ce7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5d94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35ce7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5d94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38396/0 (socket says 172.21.15.151:38396) 2023-07-21T22:26:04.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35ce7fc700 1 -- 172.21.15.151:0/2877123105 learned_addr learned my addr 172.21.15.151:0/2877123105 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:04.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a12c0 0x7f35b80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35ceffd700 1 --2- 172.21.15.151:0/2877123105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/2877123105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5decd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35ce7fc700 1 -- 172.21.15.151:0/2877123105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 msgr2=0x55e19b5d8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:04.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35ce7fc700 1 --2- 172.21.15.151:0/2877123105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5d8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35ce7fc700 1 -- 172.21.15.151:0/2877123105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 msgr2=0x55e19b5decd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:04.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35ce7fc700 1 --2- 172.21.15.151:0/2877123105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5decd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.233+0000 7f35ce7fc700 1 -- 172.21.15.151:0/2877123105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e19b358d80 con 0x55e19b5df660 2023-07-21T22:26:04.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.234+0000 7f35ce7fc700 1 --2- 172.21.15.151:0/2877123105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5d94a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009990 tx=0x7f35c4005990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db7790849f87470e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:04.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.234+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a12c0 0x7f35b80a3770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35c8015ab0 tx=0x7f35c8009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.234+0000 7f35b5ffb700 1 -- 172.21.15.151:0/2877123105 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c401d070 con 0x55e19b5df660 2023-07-21T22:26:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.234+0000 7f35b5ffb700 1 -- 172.21.15.151:0/2877123105 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35c401e040 con 0x55e19b5df660 2023-07-21T22:26:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.234+0000 7f35b5ffb700 1 -- 172.21.15.151:0/2877123105 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c4004920 con 0x55e19b5df660 2023-07-21T22:26:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.235+0000 7f35e929bb80 1 -- 172.21.15.151:0/2877123105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 msgr2=0x55e19b5d94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.235+0000 7f35e929bb80 1 --2- 172.21.15.151:0/2877123105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5d94a0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f35c4009990 tx=0x7f35c4005990 comp rx=0 tx=0).stop 2023-07-21T22:26:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.235+0000 7f35e929bb80 1 -- 172.21.15.151:0/2877123105 shutdown_connections 2023-07-21T22:26:04.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.235+0000 7f35e929bb80 1 --2- 172.21.15.151:0/2877123105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5decd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.235+0000 7f35e929bb80 1 --2- 172.21.15.151:0/2877123105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5d94a0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.235+0000 7f35e929bb80 1 --2- 172.21.15.151:0/2877123105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5d8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.235+0000 7f35e929bb80 1 -- 172.21.15.151:0/2877123105 >> 172.21.15.151:0/2877123105 conn(0x55e19b5ceae0 msgr2=0x55e19b5d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.235+0000 7f35e929bb80 1 -- 172.21.15.151:0/2877123105 shutdown_connections 2023-07-21T22:26:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.235+0000 7f35e929bb80 1 -- 172.21.15.151:0/2877123105 wait complete. 2023-07-21T22:26:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.236+0000 7f35e929bb80 1 -- start start 2023-07-21T22:26:04.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.236+0000 7f35e929bb80 1 Processor -- start 2023-07-21T22:26:04.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.236+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5e5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.236+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5e27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.236+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5e2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.236+0000 7f35e929bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b4caa60 con 0x55e19b5df660 2023-07-21T22:26:04.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.236+0000 7f35e929bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b4ca760 con 0x55e19b4356b0 2023-07-21T22:26:04.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.236+0000 7f35e929bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b3ae8c0 con 0x55e19b5df210 2023-07-21T22:26:04.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35e929bb80 10 client.0 _ll_register_callbacks cb 0x55e19b4c8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35cf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5e2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35cf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5e2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38406/0 (socket says 172.21.15.151:38406) 2023-07-21T22:26:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35cf7fe700 1 -- 172.21.15.151:0/889529791 learned_addr learned my addr 172.21.15.151:0/889529791 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35ce7fc700 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5e27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35ceffd700 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5e5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35cf7fe700 1 -- 172.21.15.151:0/889529791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 msgr2=0x55e19b5e27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:04.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5e27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35cf7fe700 1 -- 172.21.15.151:0/889529791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 msgr2=0x55e19b5e5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5e5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.237+0000 7f35cf7fe700 1 -- 172.21.15.151:0/889529791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d010d260 con 0x55e19b5df660 2023-07-21T22:26:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.238+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5e2dd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009e30 tx=0x7f35c8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adeef23d8d0a3de1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.238+0000 7f35aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:26:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.238+0000 7f35aeffd700 1 -- 172.21.15.151:0/889529791 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c800e040 con 0x55e19b5df660 2023-07-21T22:26:04.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.238+0000 7f35e929bb80 1 -- 172.21.15.151:0/889529791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e19b484490 con 0x55e19b5df660 2023-07-21T22:26:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.238+0000 7f35aeffd700 1 -- 172.21.15.151:0/889529791 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f35c801e050 con 0x55e19b5df660 2023-07-21T22:26:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.238+0000 7f35aeffd700 1 -- 172.21.15.151:0/889529791 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c80198f0 con 0x55e19b5df660 2023-07-21T22:26:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.238+0000 7f35e929bb80 10 client.16854 fetch_fsmap learned FSMap version 34 2023-07-21T22:26:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.238+0000 7f35e929bb80 1 -- 172.21.15.151:0/889529791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e19b341c00 con 0x55e19b5df660 2023-07-21T22:26:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.239+0000 7f35aeffd700 1 -- 172.21.15.151:0/889529791 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e19b484490 con 0x55e19b5df660 2023-07-21T22:26:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.239+0000 7f35aeffd700 1 -- 172.21.15.151:0/889529791 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f35c8023ab0 con 0x55e19b5df660 2023-07-21T22:26:04.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.239+0000 7f35e929bb80 10 client.16854 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:26:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.239+0000 7f35e929bb80 10 client.16854 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.239+0000 7f35e929bb80 20 client.16854 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.239+0000 7f35e929bb80 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e19b5f2bb0 0x55e19b5f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.239+0000 7f35e929bb80 4 client.16854 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:26:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.239+0000 7f35e929bb80 1 -- 172.21.15.151:0/889529791 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e19b523e50 con 0x55e19b5f2bb0 2023-07-21T22:26:04.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.239+0000 7f35ceffd700 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e19b5f2bb0 0x55e19b5f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.240+0000 7f35ceffd700 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e19b5f2bb0 0x55e19b5f4fc0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eb089bc15845ba8 server_cookie=39c847993088fd71 in_seq=0 out_seq=0 2023-07-21T22:26:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.240+0000 7f35aeffd700 10 client.16854 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35aeffd700 1 -- 172.21.15.151:0/889529791 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e19b523e50 con 0x55e19b5f2bb0 2023-07-21T22:26:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35aeffd700 10 client.16854 handle_command_reply: tid=0 2023-07-21T22:26:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 client.16854 shutdown 2023-07-21T22:26:04.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 -- 172.21.15.151:0/889529791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 msgr2=0x55e19b5e2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5e2dd0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f35c8009e30 tx=0x7f35c8004ad0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 -- 172.21.15.151:0/889529791 shutdown_connections 2023-07-21T22:26:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e19b5f2bb0 0x55e19b5f4fc0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5e5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5e2dd0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 --2- 172.21.15.151:0/889529791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5e27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 -- 172.21.15.151:0/889529791 >> 172.21.15.151:0/889529791 conn(0x55e19b5ceae0 msgr2=0x55e19b5d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35aeffd700 0 client.16854 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 -- 172.21.15.151:0/889529791 shutdown_connections 2023-07-21T22:26:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.241+0000 7f35e929bb80 1 -- 172.21.15.151:0/889529791 wait complete. 2023-07-21T22:26:04.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.242+0000 7f35e929bb80 20 client.16854 trim_cache size 0 max 16384 2023-07-21T22:26:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.259+0000 7f35e929bb80 1 Processor -- start 2023-07-21T22:26:04.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.259+0000 7f35e929bb80 1 -- start start 2023-07-21T22:26:04.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.259+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b4356b0 0x55e19b5d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.259+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b5df210 0x55e19b5e9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.259+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df660 0x55e19b5e01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.259+0000 7f35e929bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b5d4f00 con 0x55e19b4356b0 2023-07-21T22:26:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.259+0000 7f35e929bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b5e0d00 con 0x55e19b5df210 2023-07-21T22:26:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.259+0000 7f35e929bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b5dd3d0 con 0x55e19b5df660 2023-07-21T22:26:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b4356b0 0x55e19b5d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b4356b0 0x55e19b5d8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38420/0 (socket says 172.21.15.151:38420) 2023-07-21T22:26:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ceffd700 1 -- 172.21.15.151:0/1615253585 learned_addr learned my addr 172.21.15.151:0/1615253585 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df660 0x55e19b5e01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ce7fc700 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b5df210 0x55e19b5e9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ceffd700 1 -- 172.21.15.151:0/1615253585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df660 msgr2=0x55e19b5e01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ceffd700 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df660 0x55e19b5e01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ceffd700 1 -- 172.21.15.151:0/1615253585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b5df210 msgr2=0x55e19b5e9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ceffd700 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b5df210 0x55e19b5e9ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ceffd700 1 -- 172.21.15.151:0/1615253585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e19b37f1f0 con 0x55e19b4356b0 2023-07-21T22:26:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.260+0000 7f35ce7fc700 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b5df210 0x55e19b5e9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:26:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.261+0000 7f35ceffd700 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b4356b0 0x55e19b5d8f40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f35c0099b80 tx=0x7f35c00cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e63d50e7f1a5a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.261+0000 7f35b67fc700 1 -- 172.21.15.151:0/1615253585 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c00b6070 con 0x55e19b4356b0 2023-07-21T22:26:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.261+0000 7f35b67fc700 1 -- 172.21.15.151:0/1615253585 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35c000f3c0 con 0x55e19b4356b0 2023-07-21T22:26:04.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.261+0000 7f35b67fc700 1 -- 172.21.15.151:0/1615253585 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0097f90 con 0x55e19b4356b0 2023-07-21T22:26:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.261+0000 7f35e929bb80 1 -- 172.21.15.151:0/1615253585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b4356b0 msgr2=0x55e19b5d8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.261+0000 7f35e929bb80 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b4356b0 0x55e19b5d8f40 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f35c0099b80 tx=0x7f35c00cc040 comp rx=0 tx=0).stop 2023-07-21T22:26:04.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.262+0000 7f35e929bb80 1 -- 172.21.15.151:0/1615253585 shutdown_connections 2023-07-21T22:26:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.262+0000 7f35e929bb80 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df660 0x55e19b5e01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.262+0000 7f35e929bb80 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b4356b0 0x55e19b5d8f40 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.262+0000 7f35e929bb80 1 --2- 172.21.15.151:0/1615253585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b5df210 0x55e19b5e9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.262+0000 7f35e929bb80 1 -- 172.21.15.151:0/1615253585 >> 172.21.15.151:0/1615253585 conn(0x55e19b5ceae0 msgr2=0x55e19b5dfaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.262+0000 7f35e929bb80 1 -- 172.21.15.151:0/1615253585 shutdown_connections 2023-07-21T22:26:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.262+0000 7f35e929bb80 1 -- 172.21.15.151:0/1615253585 wait complete. 2023-07-21T22:26:04.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.262+0000 7f35e929bb80 1 -- start start 2023-07-21T22:26:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.262+0000 7f35e929bb80 1 Processor -- start 2023-07-21T22:26:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5dbaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5dc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35e929bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5da730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35e929bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b5dace0 con 0x55e19b5df660 2023-07-21T22:26:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35e929bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b5dae50 con 0x55e19b4356b0 2023-07-21T22:26:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35e929bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e19b5db010 con 0x55e19b5df210 2023-07-21T22:26:04.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35e929bb80 10 client.0 _ll_register_callbacks cb 0x7f35c80093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35cf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5da730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35cf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5da730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38422/0 (socket says 172.21.15.151:38422) 2023-07-21T22:26:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35cf7fe700 1 -- 172.21.15.151:0/448918360 learned_addr learned my addr 172.21.15.151:0/448918360 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35ceffd700 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5dbaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.263+0000 7f35ce7fc700 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5dc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35cf7fe700 1 -- 172.21.15.151:0/448918360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 msgr2=0x55e19b5dc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5dc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35cf7fe700 1 -- 172.21.15.151:0/448918360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 msgr2=0x55e19b5dbaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5dbaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35cf7fe700 1 -- 172.21.15.151:0/448918360 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d01a4e20 con 0x55e19b5df660 2023-07-21T22:26:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35ce7fc700 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5dc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:26:04.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35cf7fe700 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5da730 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f35c8023e90 tx=0x7f35c8004df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f56ec3d6a0620da server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35aeffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:26:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35aeffd700 1 -- 172.21.15.151:0/448918360 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c800e040 con 0x55e19b5df660 2023-07-21T22:26:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35e929bb80 1 -- 172.21.15.151:0/448918360 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f35c401e040 con 0x55e19b5df660 2023-07-21T22:26:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.264+0000 7f35aeffd700 1 -- 172.21.15.151:0/448918360 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(88..88 src has 1..88) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f35c801e040 con 0x55e19b5df660 2023-07-21T22:26:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35aeffd700 1 -- 172.21.15.151:0/448918360 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) v2 ==== 24+0+0 (secure 0 0 0) 0x7f35c8007530 con 0x55e19b5df660 2023-07-21T22:26:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35e929bb80 10 client.16860 fetch_fsmap learned FSMap version 34 2023-07-21T22:26:04.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35e929bb80 1 -- 172.21.15.151:0/448918360 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) v3 -- 0x55e19b357250 con 0x55e19b5df660 2023-07-21T22:26:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35aeffd700 1 -- 172.21.15.151:0/448918360 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f35c401e040 con 0x55e19b5df660 2023-07-21T22:26:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35aeffd700 1 -- 172.21.15.151:0/448918360 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 34) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f35c8023420 con 0x55e19b5df660 2023-07-21T22:26:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35e929bb80 10 client.16860 fetch_fsmap finished waiting for FSMap version 34 2023-07-21T22:26:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35e929bb80 10 client.16860 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35e929bb80 20 client.16860 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35e929bb80 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e19b6478a0 0x55e19b649cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:04.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35e929bb80 4 client.16860 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:26:04.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.265+0000 7f35e929bb80 1 -- 172.21.15.151:0/448918360 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e19b4e5ff0 con 0x55e19b6478a0 2023-07-21T22:26:04.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.266+0000 7f35ceffd700 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e19b6478a0 0x55e19b649cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:04.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.266+0000 7f35ceffd700 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e19b6478a0 0x55e19b649cb0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dcdab33dc118671 server_cookie=55fb20055bfb70e2 in_seq=0 out_seq=0 2023-07-21T22:26:04.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.266+0000 7f35aeffd700 10 client.16860 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:04.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35aeffd700 1 -- 172.21.15.151:0/448918360 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e19b4e5ff0 con 0x55e19b6478a0 2023-07-21T22:26:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35aeffd700 10 client.16860 handle_command_reply: tid=0 2023-07-21T22:26:04.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 client.16860 shutdown 2023-07-21T22:26:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 -- 172.21.15.151:0/448918360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 msgr2=0x55e19b5da730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5da730 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f35c8023e90 tx=0x7f35c8004df0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 -- 172.21.15.151:0/448918360 shutdown_connections 2023-07-21T22:26:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e19b6478a0 0x55e19b649cb0 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e19b4356b0 0x55e19b5dbaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e19b5df660 0x55e19b5da730 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 --2- 172.21.15.151:0/448918360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e19b5df210 0x55e19b5dc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35aeffd700 0 client.16860 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 -- 172.21.15.151:0/448918360 >> 172.21.15.151:0/448918360 conn(0x55e19b5ceae0 msgr2=0x55e19b5dd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 -- 172.21.15.151:0/448918360 shutdown_connections 2023-07-21T22:26:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.279+0000 7f35e929bb80 1 -- 172.21.15.151:0/448918360 wait complete. 2023-07-21T22:26:04.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35e929bb80 20 client.16860 trim_cache size 0 max 16384 2023-07-21T22:26:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:26:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:26:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:26:04.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:26:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 -- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a12c0 msgr2=0x7f35b80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a12c0 0x7f35b80a3770 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f35c8015ab0 tx=0x7f35c8009920 comp rx=0 tx=0).stop 2023-07-21T22:26:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 -- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0100df0 msgr2=0x7f35d0197de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0100df0 0x7f35d0197de0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f35c000d980 tx=0x7f35c000dc90 comp rx=0 tx=0).stop 2023-07-21T22:26:04.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 -- 172.21.15.151:0/743668148 shutdown_connections 2023-07-21T22:26:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35b80a12c0 0x7f35b80a3770 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d010a130 0x7f35d019c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35d0100df0 0x7f35d0197de0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 --2- 172.21.15.151:0/743668148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35d0101700 0x7f35d0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.280+0000 7f35d59ff700 1 -- 172.21.15.151:0/743668148 >> 172.21.15.151:0/743668148 conn(0x7f35d0075ba0 msgr2=0x7f35d00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.281+0000 7f35d59ff700 1 -- 172.21.15.151:0/743668148 shutdown_connections 2023-07-21T22:26:04.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:04.281+0000 7f35d59ff700 1 -- 172.21.15.151:0/743668148 wait complete. 2023-07-21T22:26:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:04 smithi187 ceph-mon[96918]: pgmap v209: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 74 op/s 2023-07-21T22:26:04.893 INFO:teuthology.orchestra.run.smithi151.stderr:28400000 of 50000000 tuples (56%) done (elapsed 388.38 s, remaining 295.39 s) 2023-07-21T22:26:04.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:04 smithi195 ceph-mon[97365]: pgmap v209: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 74 op/s 2023-07-21T22:26:04.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:04 smithi151 ceph-mon[95510]: pgmap v209: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 35 MiB/s wr, 74 op/s 2023-07-21T22:26:05.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:05 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:05.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:05 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:05.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:05 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:06.216 INFO:teuthology.orchestra.run.smithi151.stderr:28500000 of 50000000 tuples (57%) done (elapsed 389.71 s, remaining 293.99 s) 2023-07-21T22:26:06.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:06 smithi187 ceph-mon[96918]: pgmap v210: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-21T22:26:06.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:06 smithi195 ceph-mon[97365]: pgmap v210: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-21T22:26:06.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:06 smithi151 ceph-mon[95510]: pgmap v210: 97 pgs: 97 active+clean; 6.5 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 23 MiB/s wr, 41 op/s 2023-07-21T22:26:07.441 INFO:teuthology.orchestra.run.smithi151.stderr:28600000 of 50000000 tuples (57%) done (elapsed 390.93 s, remaining 292.52 s) 2023-07-21T22:26:07.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:07 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:07.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:07 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:07.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:07 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:08.671 INFO:teuthology.orchestra.run.smithi151.stderr:28700000 of 50000000 tuples (57%) done (elapsed 392.16 s, remaining 291.05 s) 2023-07-21T22:26:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:08 smithi187 ceph-mon[96918]: pgmap v211: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 MiB/s wr, 64 op/s 2023-07-21T22:26:08.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:08 smithi195 ceph-mon[97365]: pgmap v211: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 MiB/s wr, 64 op/s 2023-07-21T22:26:08.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:08 smithi151 ceph-mon[95510]: pgmap v211: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 MiB/s wr, 64 op/s 2023-07-21T22:26:10.050 INFO:teuthology.orchestra.run.smithi151.stderr:28800000 of 50000000 tuples (57%) done (elapsed 393.54 s, remaining 289.69 s) 2023-07-21T22:26:10.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:10 smithi187 ceph-mon[96918]: pgmap v212: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-07-21T22:26:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:10 smithi187 ceph-mon[96918]: osdmap e89: 12 total, 12 up, 12 in 2023-07-21T22:26:10.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:10 smithi195 ceph-mon[97365]: pgmap v212: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-07-21T22:26:10.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:10 smithi195 ceph-mon[97365]: osdmap e89: 12 total, 12 up, 12 in 2023-07-21T22:26:10.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:10 smithi151 ceph-mon[95510]: pgmap v212: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 24 MiB/s wr, 56 op/s 2023-07-21T22:26:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:10 smithi151 ceph-mon[95510]: osdmap e89: 12 total, 12 up, 12 in 2023-07-21T22:26:11.299 INFO:teuthology.orchestra.run.smithi151.stderr:28900000 of 50000000 tuples (57%) done (elapsed 394.79 s, remaining 288.24 s) 2023-07-21T22:26:12.481 INFO:teuthology.orchestra.run.smithi151.stderr:29000000 of 50000000 tuples (58%) done (elapsed 395.97 s, remaining 286.74 s) 2023-07-21T22:26:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:12 smithi187 ceph-mon[96918]: pgmap v214: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 MiB/s wr, 67 op/s 2023-07-21T22:26:12.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:12 smithi195 ceph-mon[97365]: pgmap v214: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 MiB/s wr, 67 op/s 2023-07-21T22:26:12.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:12 smithi151 ceph-mon[95510]: pgmap v214: 97 pgs: 97 active+clean; 6.6 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 29 MiB/s wr, 67 op/s 2023-07-21T22:26:13.776 INFO:teuthology.orchestra.run.smithi151.stderr:29100000 of 50000000 tuples (58%) done (elapsed 397.27 s, remaining 285.32 s) 2023-07-21T22:26:13.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:13 smithi187 ceph-mon[96918]: pgmap v215: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 29 MiB/s wr, 60 op/s 2023-07-21T22:26:13.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:13 smithi195 ceph-mon[97365]: pgmap v215: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 29 MiB/s wr, 60 op/s 2023-07-21T22:26:13.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:13 smithi151 ceph-mon[95510]: pgmap v215: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 29 MiB/s wr, 60 op/s 2023-07-21T22:26:15.009 INFO:teuthology.orchestra.run.smithi151.stderr:29200000 of 50000000 tuples (58%) done (elapsed 398.50 s, remaining 283.86 s) 2023-07-21T22:26:15.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:15 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:15.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:15 smithi187 ceph-mon[96918]: pgmap v216: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 29 MiB/s wr, 60 op/s 2023-07-21T22:26:15.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:15 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:15.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:15 smithi195 ceph-mon[97365]: pgmap v216: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 29 MiB/s wr, 60 op/s 2023-07-21T22:26:15.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:15 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:15.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:15 smithi151 ceph-mon[95510]: pgmap v216: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 29 MiB/s wr, 60 op/s 2023-07-21T22:26:16.283 INFO:teuthology.orchestra.run.smithi151.stderr:29300000 of 50000000 tuples (58%) done (elapsed 399.77 s, remaining 282.43 s) 2023-07-21T22:26:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.455+0000 7fead09ff700 1 -- 172.21.15.151:0/372890037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feacc10c350 msgr2=0x7feacc10e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.455+0000 7fead09ff700 1 --2- 172.21.15.151:0/372890037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feacc10c350 0x7feacc10e730 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7feac400b0a0 tx=0x7feac400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.455+0000 7fead09ff700 1 -- 172.21.15.151:0/372890037 shutdown_connections 2023-07-21T22:26:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.455+0000 7fead09ff700 1 --2- 172.21.15.151:0/372890037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feacc0728b0 0x7feacc072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.455+0000 7fead09ff700 1 --2- 172.21.15.151:0/372890037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feacc10c350 0x7feacc10e730 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.455+0000 7fead09ff700 1 --2- 172.21.15.151:0/372890037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feacc0731c0 0x7feacc10be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.455+0000 7fead09ff700 1 -- 172.21.15.151:0/372890037 >> 172.21.15.151:0/372890037 conn(0x7feacc0fb5f0 msgr2=0x7feacc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.455+0000 7fead09ff700 1 -- 172.21.15.151:0/372890037 shutdown_connections 2023-07-21T22:26:17.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.455+0000 7fead09ff700 1 -- 172.21.15.151:0/372890037 wait complete. 2023-07-21T22:26:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.456+0000 7fead09ff700 1 Processor -- start 2023-07-21T22:26:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.457+0000 7fead09ff700 1 -- start start 2023-07-21T22:26:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.457+0000 7fead09ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feacc0728b0 0x7feacc197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.457+0000 7fead09ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feacc0731c0 0x7feacc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.457+0000 7fead09ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feacc10c350 0x7feacc19ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.457+0000 7fead09ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc19d070 con 0x7feacc10c350 2023-07-21T22:26:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.457+0000 7fead09ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc19d1e0 con 0x7feacc0728b0 2023-07-21T22:26:17.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.457+0000 7fead09ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feacc19d3a0 con 0x7feacc0731c0 2023-07-21T22:26:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feac9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feacc0731c0 0x7feacc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feac9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feacc0731c0 0x7feacc1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48004/0 (socket says 172.21.15.151:48004) 2023-07-21T22:26:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feac9d9b700 1 -- 172.21.15.151:0/2184143193 learned_addr learned my addr 172.21.15.151:0/2184143193 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:17.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feaca59c700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feacc0728b0 0x7feacc197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feacad9d700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feacc10c350 0x7feacc19ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feac9d9b700 1 -- 172.21.15.151:0/2184143193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feacc0728b0 msgr2=0x7feacc197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feac9d9b700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feacc0728b0 0x7feacc197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feac9d9b700 1 -- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feacc10c350 msgr2=0x7feacc19ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feac9d9b700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feacc10c350 0x7feacc19ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feac9d9b700 1 -- 172.21.15.151:0/2184143193 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4009d00 con 0x7feacc0731c0 2023-07-21T22:26:17.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.458+0000 7feac9d9b700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feacc0731c0 0x7feacc1983c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feac000d950 tx=0x7feac000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.459+0000 7feabb7fe700 1 -- 172.21.15.151:0/2184143193 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000f890 con 0x7feacc0731c0 2023-07-21T22:26:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.459+0000 7feabb7fe700 1 -- 172.21.15.151:0/2184143193 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feac000fe80 con 0x7feacc0731c0 2023-07-21T22:26:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.459+0000 7fead09ff700 1 -- 172.21.15.151:0/2184143193 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feacc19d680 con 0x7feacc0731c0 2023-07-21T22:26:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.459+0000 7feabb7fe700 1 -- 172.21.15.151:0/2184143193 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac000e3b0 con 0x7feacc0731c0 2023-07-21T22:26:17.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.459+0000 7fead09ff700 1 -- 172.21.15.151:0/2184143193 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc1a4ec0 con 0x7feacc0731c0 2023-07-21T22:26:17.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.462+0000 7feabb7fe700 1 -- 172.21.15.151:0/2184143193 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7feac0010460 con 0x7feacc0731c0 2023-07-21T22:26:17.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.463+0000 7feae437ab80 1 Processor -- start 2023-07-21T22:26:17.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feae437ab80 1 -- start start 2023-07-21T22:26:17.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feae437ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec2724e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feae437ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272a20 0x558eec26c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feae437ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272e70 0x558eec26ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feae437ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec169c50 con 0x558eec0c06b0 2023-07-21T22:26:17.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feae437ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec1bc9e0 con 0x558eec272e70 2023-07-21T22:26:17.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feae437ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec1b5e70 con 0x558eec272a20 2023-07-21T22:26:17.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feabb7fe700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feab40a1340 0x7feab40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feabb7fe700 1 -- 172.21.15.151:0/2184143193 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feac00cca30 con 0x7feacc0731c0 2023-07-21T22:26:17.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feacad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec2724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feacad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec2724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51638/0 (socket says 172.21.15.151:51638) 2023-07-21T22:26:17.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feacad9d700 1 -- 172.21.15.151:0/1068840983 learned_addr learned my addr 172.21.15.151:0/1068840983 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:17.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feacad9d700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feab40a1340 0x7feab40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.464+0000 7feaca59c700 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272a20 0x558eec26c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feac9d9b700 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272e70 0x558eec26ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feaca59c700 1 -- 172.21.15.151:0/1068840983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272e70 msgr2=0x558eec26ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feaca59c700 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272e70 0x558eec26ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feaca59c700 1 -- 172.21.15.151:0/1068840983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 msgr2=0x558eec2724e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feaca59c700 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec2724e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feaca59c700 1 -- 172.21.15.151:0/1068840983 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eebfe3d80 con 0x558eec272a20 2023-07-21T22:26:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feacad9d700 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec2724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:26:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feaca59c700 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272a20 0x558eec26c750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feabc007bf0 tx=0x7feabc007f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9be9134dd642ea04 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feacad9d700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feab40a1340 0x7feab40a37f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feac4009610 tx=0x7feac400b7d0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.465+0000 7feab8ff9700 1 -- 172.21.15.151:0/1068840983 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc004310 con 0x558eec272a20 2023-07-21T22:26:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feab8ff9700 1 -- 172.21.15.151:0/1068840983 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feabc010e10 con 0x558eec272a20 2023-07-21T22:26:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feab8ff9700 1 -- 172.21.15.151:0/1068840983 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc005020 con 0x558eec272a20 2023-07-21T22:26:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feae437ab80 1 -- 172.21.15.151:0/1068840983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272a20 msgr2=0x558eec26c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:17.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feae437ab80 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272a20 0x558eec26c750 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feabc007bf0 tx=0x7feabc007f00 comp rx=0 tx=0).stop 2023-07-21T22:26:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feae437ab80 1 -- 172.21.15.151:0/1068840983 shutdown_connections 2023-07-21T22:26:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feae437ab80 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272e70 0x558eec26ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feae437ab80 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec2724e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feae437ab80 1 --2- 172.21.15.151:0/1068840983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272a20 0x558eec26c750 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feae437ab80 1 -- 172.21.15.151:0/1068840983 >> 172.21.15.151:0/1068840983 conn(0x558eec259ae0 msgr2=0x558eec25f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.466+0000 7feae437ab80 1 -- 172.21.15.151:0/1068840983 shutdown_connections 2023-07-21T22:26:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.467+0000 7feae437ab80 1 -- 172.21.15.151:0/1068840983 wait complete. 2023-07-21T22:26:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.467+0000 7feae437ab80 1 -- start start 2023-07-21T22:26:17.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.467+0000 7feae437ab80 1 Processor -- start 2023-07-21T22:26:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feae437ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec276070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feae437ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 0x558eec2765b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feae437ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272e70 0x558eec276af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feae437ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec155a60 con 0x558eec0c06b0 2023-07-21T22:26:17.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feae437ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec155760 con 0x558eec272a20 2023-07-21T22:26:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feae437ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec0398c0 con 0x558eec272e70 2023-07-21T22:26:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feae437ab80 10 client.0 _ll_register_callbacks cb 0x558eec153700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feaca59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec276070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feaca59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec276070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51652/0 (socket says 172.21.15.151:51652) 2023-07-21T22:26:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feaca59c700 1 -- 172.21.15.151:0/3343512695 learned_addr learned my addr 172.21.15.151:0/3343512695 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feac9d9b700 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 0x558eec2765b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.468+0000 7feacad9d700 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272e70 0x558eec276af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feaca59c700 1 -- 172.21.15.151:0/3343512695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272e70 msgr2=0x558eec276af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:17.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feaca59c700 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272e70 0x558eec276af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feaca59c700 1 -- 172.21.15.151:0/3343512695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 msgr2=0x558eec2765b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:17.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feaca59c700 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 0x558eec2765b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feaca59c700 1 -- 172.21.15.151:0/3343512695 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc10f3d0 con 0x558eec0c06b0 2023-07-21T22:26:17.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feacad9d700 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272e70 0x558eec276af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:26:17.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feaca59c700 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec276070 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7feabc007670 tx=0x7feabc0049f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5ae1c7b9cea35bf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:17.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feab1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:26:17.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feab1ffb700 1 -- 172.21.15.151:0/3343512695 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feabc01f070 con 0x558eec0c06b0 2023-07-21T22:26:17.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feae437ab80 1 -- 172.21.15.151:0/3343512695 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558eec10f490 con 0x558eec0c06b0 2023-07-21T22:26:17.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.469+0000 7feab1ffb700 1 -- 172.21.15.151:0/3343512695 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feabc004110 con 0x558eec0c06b0 2023-07-21T22:26:17.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feab1ffb700 1 -- 172.21.15.151:0/3343512695 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feabc0042d0 con 0x558eec0c06b0 2023-07-21T22:26:17.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feae437ab80 10 client.16872 fetch_fsmap learned FSMap version 37 2023-07-21T22:26:17.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feae437ab80 1 -- 172.21.15.151:0/3343512695 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x7feabc0078a0 con 0x558eec0c06b0 2023-07-21T22:26:17.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feab1ffb700 1 -- 172.21.15.151:0/3343512695 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feabc030020 con 0x558eec0c06b0 2023-07-21T22:26:17.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feab1ffb700 1 -- 172.21.15.151:0/3343512695 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feabc0114d0 con 0x558eec0c06b0 2023-07-21T22:26:17.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feae437ab80 10 client.16872 fetch_fsmap finished waiting for FSMap version 37 2023-07-21T22:26:17.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feae437ab80 10 client.16872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:17.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feae437ab80 20 client.16872 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:17.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feae437ab80 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558eec286210 0x558eec288620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feae437ab80 4 client.16872 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:26:17.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.470+0000 7feae437ab80 1 -- 172.21.15.151:0/3343512695 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558eec1aee50 con 0x558eec286210 2023-07-21T22:26:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.471+0000 7feac9d9b700 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558eec286210 0x558eec288620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.471+0000 7feac9d9b700 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558eec286210 0x558eec288620 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2d157877050ba58 server_cookie=91b7697ffa036003 in_seq=0 out_seq=0 2023-07-21T22:26:17.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.471+0000 7feab1ffb700 10 client.16872 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.472+0000 7feab1ffb700 1 -- 172.21.15.151:0/3343512695 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558eec1aee50 con 0x558eec286210 2023-07-21T22:26:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.472+0000 7feab1ffb700 10 client.16872 handle_command_reply: tid=0 2023-07-21T22:26:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.472+0000 7feae437ab80 1 client.16872 shutdown 2023-07-21T22:26:17.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.472+0000 7feae437ab80 1 -- 172.21.15.151:0/3343512695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 msgr2=0x558eec276070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.472+0000 7feae437ab80 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec276070 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7feabc007670 tx=0x7feabc0049f0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.472+0000 7feae437ab80 1 -- 172.21.15.151:0/3343512695 shutdown_connections 2023-07-21T22:26:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.473+0000 7feae437ab80 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558eec286210 0x558eec288620 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.473+0000 7feae437ab80 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec272e70 0x558eec276af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.473+0000 7feae437ab80 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec0c06b0 0x558eec276070 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.473+0000 7feab1ffb700 0 client.16872 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.473+0000 7feae437ab80 1 --2- 172.21.15.151:0/3343512695 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 0x558eec2765b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.473+0000 7feae437ab80 1 -- 172.21.15.151:0/3343512695 >> 172.21.15.151:0/3343512695 conn(0x558eec259ae0 msgr2=0x558eec262f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.473+0000 7feae437ab80 1 -- 172.21.15.151:0/3343512695 shutdown_connections 2023-07-21T22:26:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.473+0000 7feae437ab80 1 -- 172.21.15.151:0/3343512695 wait complete. 2023-07-21T22:26:17.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.473+0000 7feae437ab80 20 client.16872 trim_cache size 0 max 16384 2023-07-21T22:26:17.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.498+0000 7feae437ab80 1 Processor -- start 2023-07-21T22:26:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.498+0000 7feae437ab80 1 -- start start 2023-07-21T22:26:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.498+0000 7feae437ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec259ae0 0x558eec275300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.498+0000 7feae437ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec0c06b0 0x558eec273b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.498+0000 7feae437ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 0x558eec27d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.498+0000 7feae437ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec274050 con 0x558eec259ae0 2023-07-21T22:26:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.498+0000 7feae437ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec25b4f0 con 0x558eec272a20 2023-07-21T22:26:17.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.498+0000 7feae437ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec270cc0 con 0x558eec0c06b0 2023-07-21T22:26:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feacad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 0x558eec27d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feac9d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec0c06b0 0x558eec273b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feacad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 0x558eec27d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:59958/0 (socket says 172.21.15.151:59958) 2023-07-21T22:26:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feacad9d700 1 -- 172.21.15.151:0/1948255421 learned_addr learned my addr 172.21.15.151:0/1948255421 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:17.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feaca59c700 1 --2- 172.21.15.151:0/1948255421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec259ae0 0x558eec275300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feac9d9b700 1 -- 172.21.15.151:0/1948255421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 msgr2=0x558eec27d390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feac9d9b700 1 --2- 172.21.15.151:0/1948255421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 0x558eec27d390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feac9d9b700 1 -- 172.21.15.151:0/1948255421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec259ae0 msgr2=0x558eec275300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feac9d9b700 1 --2- 172.21.15.151:0/1948255421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec259ae0 0x558eec275300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.499+0000 7feac9d9b700 1 -- 172.21.15.151:0/1948255421 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558eec28d230 con 0x558eec0c06b0 2023-07-21T22:26:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.500+0000 7feac9d9b700 1 --2- 172.21.15.151:0/1948255421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec0c06b0 0x558eec273b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feac00ca140 tx=0x7feac007a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c009d74d8c083a60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:17.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.500+0000 7feab97fa700 1 -- 172.21.15.151:0/1948255421 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0099ac0 con 0x558eec0c06b0 2023-07-21T22:26:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.500+0000 7feab97fa700 1 -- 172.21.15.151:0/1948255421 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feac009daf0 con 0x558eec0c06b0 2023-07-21T22:26:17.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.500+0000 7feab97fa700 1 -- 172.21.15.151:0/1948255421 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac0099d20 con 0x558eec0c06b0 2023-07-21T22:26:17.547 INFO:teuthology.orchestra.run.smithi151.stderr:29400000 of 50000000 tuples (58%) done (elapsed 401.04 s, remaining 281.00 s) 2023-07-21T22:26:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.501+0000 7feae437ab80 1 -- 172.21.15.151:0/1948255421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec0c06b0 msgr2=0x558eec273b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.501+0000 7feae437ab80 1 --2- 172.21.15.151:0/1948255421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec0c06b0 0x558eec273b10 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7feac00ca140 tx=0x7feac007a040 comp rx=0 tx=0).stop 2023-07-21T22:26:17.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.501+0000 7feae437ab80 1 -- 172.21.15.151:0/1948255421 shutdown_connections 2023-07-21T22:26:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.501+0000 7feae437ab80 1 --2- 172.21.15.151:0/1948255421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec272a20 0x558eec27d390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.501+0000 7feae437ab80 1 --2- 172.21.15.151:0/1948255421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec259ae0 0x558eec275300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.501+0000 7feae437ab80 1 --2- 172.21.15.151:0/1948255421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec0c06b0 0x558eec273b10 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.501+0000 7feae437ab80 1 -- 172.21.15.151:0/1948255421 >> 172.21.15.151:0/1948255421 conn(0x558eec282990 msgr2=0x558eec262f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.501+0000 7feae437ab80 1 -- 172.21.15.151:0/1948255421 shutdown_connections 2023-07-21T22:26:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.501+0000 7feae437ab80 1 -- 172.21.15.151:0/1948255421 wait complete. 2023-07-21T22:26:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.502+0000 7feae437ab80 1 -- start start 2023-07-21T22:26:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.502+0000 7feae437ab80 1 Processor -- start 2023-07-21T22:26:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feae437ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec0c06b0 0x558eec27d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feae437ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec259ae0 0x558eec26e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feae437ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec272a20 0x558eec26e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feae437ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec26ec40 con 0x558eec272a20 2023-07-21T22:26:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feae437ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec26edb0 con 0x558eec0c06b0 2023-07-21T22:26:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feae437ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558eec26ef70 con 0x558eec259ae0 2023-07-21T22:26:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feae437ab80 10 client.0 _ll_register_callbacks cb 0x7feac4009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feacad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec272a20 0x558eec26e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feacad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec272a20 0x558eec26e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51664/0 (socket says 172.21.15.151:51664) 2023-07-21T22:26:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feacad9d700 1 -- 172.21.15.151:0/1222547789 learned_addr learned my addr 172.21.15.151:0/1222547789 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feac9d9b700 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec259ae0 0x558eec26e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.503+0000 7feaca59c700 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec0c06b0 0x558eec27d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feac9d9b700 1 -- 172.21.15.151:0/1222547789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec0c06b0 msgr2=0x558eec27d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feac9d9b700 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec0c06b0 0x558eec27d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feac9d9b700 1 -- 172.21.15.151:0/1222547789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec272a20 msgr2=0x558eec26e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feac9d9b700 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec272a20 0x558eec26e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feac9d9b700 1 -- 172.21.15.151:0/1222547789 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feacc1a4ec0 con 0x558eec259ae0 2023-07-21T22:26:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feacad9d700 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec272a20 0x558eec26e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:26:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feac9d9b700 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec259ae0 0x558eec26e0e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feac0010a00 tx=0x7feac0010000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6507e93e40a5d5cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feab1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:26:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feab1ffb700 1 -- 172.21.15.151:0/1222547789 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac00b6070 con 0x558eec259ae0 2023-07-21T22:26:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feab1ffb700 1 -- 172.21.15.151:0/1222547789 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feac00b2270 con 0x558eec259ae0 2023-07-21T22:26:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feae437ab80 1 -- 172.21.15.151:0/1222547789 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558eec282d60 con 0x558eec259ae0 2023-07-21T22:26:17.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feab1ffb700 1 -- 172.21.15.151:0/1222547789 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7feac0077880 con 0x558eec259ae0 2023-07-21T22:26:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feae437ab80 10 client.26626 fetch_fsmap learned FSMap version 37 2023-07-21T22:26:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.504+0000 7feae437ab80 1 -- 172.21.15.151:0/1222547789 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558eebfccc00 con 0x558eec259ae0 2023-07-21T22:26:17.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.505+0000 7feab1ffb700 1 -- 172.21.15.151:0/1222547789 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558eec282d60 con 0x558eec259ae0 2023-07-21T22:26:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.505+0000 7feab1ffb700 1 -- 172.21.15.151:0/1222547789 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feac0099db0 con 0x558eec259ae0 2023-07-21T22:26:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.505+0000 7feae437ab80 10 client.26626 fetch_fsmap finished waiting for FSMap version 37 2023-07-21T22:26:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.505+0000 7feae437ab80 10 client.26626 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.505+0000 7feae437ab80 20 client.26626 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.505+0000 7feae437ab80 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558eec272e70 0x558eec2dd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:17.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.505+0000 7feae437ab80 4 client.26626 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:26:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.505+0000 7feae437ab80 1 -- 172.21.15.151:0/1222547789 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7feabc010e10 con 0x558eec272e70 2023-07-21T22:26:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.505+0000 7feaca59c700 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558eec272e70 0x558eec2dd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.506+0000 7feab1ffb700 10 client.26626 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:17.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.506+0000 7feaca59c700 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558eec272e70 0x558eec2dd350 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e13d849d16a8658f server_cookie=c95e1e6d5eca3332 in_seq=0 out_seq=0 2023-07-21T22:26:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feab1ffb700 1 -- 172.21.15.151:0/1222547789 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7feabc010e10 con 0x558eec272e70 2023-07-21T22:26:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feab1ffb700 10 client.26626 handle_command_reply: tid=0 2023-07-21T22:26:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 client.26626 shutdown 2023-07-21T22:26:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 -- 172.21.15.151:0/1222547789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec259ae0 msgr2=0x558eec26e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec259ae0 0x558eec26e0e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7feac0010a00 tx=0x7feac0010000 comp rx=0 tx=0).stop 2023-07-21T22:26:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 -- 172.21.15.151:0/1222547789 shutdown_connections 2023-07-21T22:26:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558eec272e70 0x558eec2dd350 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558eec0c06b0 0x558eec27d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558eec272a20 0x558eec26e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 --2- 172.21.15.151:0/1222547789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558eec259ae0 0x558eec26e0e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feab1ffb700 0 client.26626 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 -- 172.21.15.151:0/1222547789 >> 172.21.15.151:0/1222547789 conn(0x558eec282990 msgr2=0x558eec273940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 -- 172.21.15.151:0/1222547789 shutdown_connections 2023-07-21T22:26:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 1 -- 172.21.15.151:0/1222547789 wait complete. 2023-07-21T22:26:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.523+0000 7feae437ab80 20 client.26626 trim_cache size 0 max 16384 2023-07-21T22:26:17.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:26:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:26:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:26:17.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:26:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 -- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feab40a1340 msgr2=0x7feab40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feab40a1340 0x7feab40a37f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7feac4009610 tx=0x7feac400b7d0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 -- 172.21.15.151:0/2184143193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feacc0731c0 msgr2=0x7feacc1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feacc0731c0 0x7feacc1983c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7feac000d950 tx=0x7feac000dc60 comp rx=0 tx=0).stop 2023-07-21T22:26:17.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 -- 172.21.15.151:0/2184143193 shutdown_connections 2023-07-21T22:26:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feab40a1340 0x7feab40a37f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feacc0728b0 0x7feacc197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feacc10c350 0x7feacc19ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 --2- 172.21.15.151:0/2184143193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feacc0731c0 0x7feacc1983c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 -- 172.21.15.151:0/2184143193 >> 172.21.15.151:0/2184143193 conn(0x7feacc0fb5f0 msgr2=0x7feacc103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 -- 172.21.15.151:0/2184143193 shutdown_connections 2023-07-21T22:26:17.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:17.524+0000 7fead09ff700 1 -- 172.21.15.151:0/2184143193 wait complete. 2023-07-21T22:26:17.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:17 smithi187 ceph-mon[96918]: osdmap e90: 12 total, 12 up, 12 in 2023-07-21T22:26:17.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:17 smithi195 ceph-mon[97365]: osdmap e90: 12 total, 12 up, 12 in 2023-07-21T22:26:17.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:17 smithi151 ceph-mon[95510]: osdmap e90: 12 total, 12 up, 12 in 2023-07-21T22:26:18.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:18 smithi187 ceph-mon[96918]: pgmap v218: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 36 MiB/s wr, 64 op/s 2023-07-21T22:26:18.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:18 smithi195 ceph-mon[97365]: pgmap v218: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 36 MiB/s wr, 64 op/s 2023-07-21T22:26:18.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:18 smithi151 ceph-mon[95510]: pgmap v218: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 36 MiB/s wr, 64 op/s 2023-07-21T22:26:18.861 INFO:teuthology.orchestra.run.smithi151.stderr:29500000 of 50000000 tuples (59%) done (elapsed 402.35 s, remaining 279.60 s) 2023-07-21T22:26:20.122 INFO:teuthology.orchestra.run.smithi151.stderr:29600000 of 50000000 tuples (59%) done (elapsed 403.61 s, remaining 278.17 s) 2023-07-21T22:26:20.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:20 smithi187 ceph-mon[96918]: pgmap v219: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 30 MiB/s wr, 54 op/s 2023-07-21T22:26:20.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:20 smithi195 ceph-mon[97365]: pgmap v219: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 30 MiB/s wr, 54 op/s 2023-07-21T22:26:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:20 smithi151 ceph-mon[95510]: pgmap v219: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 30 MiB/s wr, 54 op/s 2023-07-21T22:26:21.381 INFO:teuthology.orchestra.run.smithi151.stderr:29700000 of 50000000 tuples (59%) done (elapsed 404.87 s, remaining 276.73 s) 2023-07-21T22:26:22.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:22 smithi187 ceph-mon[96918]: pgmap v220: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 51 op/s 2023-07-21T22:26:22.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:22 smithi195 ceph-mon[97365]: pgmap v220: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 51 op/s 2023-07-21T22:26:22.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:22 smithi151 ceph-mon[95510]: pgmap v220: 97 pgs: 97 active+clean; 6.7 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 28 MiB/s wr, 51 op/s 2023-07-21T22:26:22.726 INFO:teuthology.orchestra.run.smithi151.stderr:29800000 of 50000000 tuples (59%) done (elapsed 406.22 s, remaining 275.36 s) 2023-07-21T22:26:23.968 INFO:teuthology.orchestra.run.smithi151.stderr:29900000 of 50000000 tuples (59%) done (elapsed 407.46 s, remaining 273.91 s) 2023-07-21T22:26:24.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:24 smithi187 ceph-mon[96918]: pgmap v221: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 28 MiB/s wr, 61 op/s 2023-07-21T22:26:24.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:24 smithi195 ceph-mon[97365]: pgmap v221: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 28 MiB/s wr, 61 op/s 2023-07-21T22:26:24.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:24 smithi151 ceph-mon[95510]: pgmap v221: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 28 MiB/s wr, 61 op/s 2023-07-21T22:26:26.391 INFO:teuthology.orchestra.run.smithi151.stderr:30000000 of 50000000 tuples (60%) done (elapsed 409.88 s, remaining 273.25 s) 2023-07-21T22:26:26.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:26 smithi187 ceph-mon[96918]: pgmap v222: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 28 MiB/s wr, 61 op/s 2023-07-21T22:26:26.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:26 smithi195 ceph-mon[97365]: pgmap v222: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 28 MiB/s wr, 61 op/s 2023-07-21T22:26:26.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:26 smithi151 ceph-mon[95510]: pgmap v222: 97 pgs: 97 active+clean; 6.8 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 28 MiB/s wr, 61 op/s 2023-07-21T22:26:27.648 INFO:teuthology.orchestra.run.smithi151.stderr:30100000 of 50000000 tuples (60%) done (elapsed 411.14 s, remaining 271.82 s) 2023-07-21T22:26:28.629 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:28 smithi187 ceph-mon[96918]: pgmap v223: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:26:28.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:26:28.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:28 smithi195 ceph-mon[97365]: pgmap v223: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:26:28.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:26:28.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:28 smithi151 ceph-mon[95510]: pgmap v223: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:26:28.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:26:29.067 INFO:teuthology.orchestra.run.smithi151.stderr:30200000 of 50000000 tuples (60%) done (elapsed 412.56 s, remaining 270.49 s) 2023-07-21T22:26:29.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:26:29.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:26:29.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:26:29.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:26:29.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:26:29.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:26:29.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:26:29.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:26:29.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:26:30.312 INFO:teuthology.orchestra.run.smithi151.stderr:30300000 of 50000000 tuples (60%) done (elapsed 413.80 s, remaining 269.04 s) 2023-07-21T22:26:30.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:30 smithi195 ceph-mon[97365]: pgmap v224: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 21 MiB/s wr, 60 op/s 2023-07-21T22:26:30.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:30 smithi151 ceph-mon[95510]: pgmap v224: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 21 MiB/s wr, 60 op/s 2023-07-21T22:26:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.694+0000 7f3f591ff700 1 -- 172.21.15.151:0/3263595912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 msgr2=0x7f3f54105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:30.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.694+0000 7f3f591ff700 1 --2- 172.21.15.151:0/3263595912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 0x7f3f54105f30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3f44009990 tx=0x7f3f44009ca0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.695+0000 7f3f591ff700 1 -- 172.21.15.151:0/3263595912 shutdown_connections 2023-07-21T22:26:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.695+0000 7f3f591ff700 1 --2- 172.21.15.151:0/3263595912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f541004e0 0x7f3f5410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.695+0000 7f3f591ff700 1 --2- 172.21.15.151:0/3263595912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 0x7f3f54105f30 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.695+0000 7f3f591ff700 1 --2- 172.21.15.151:0/3263595912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f540ffb30 0x7f3f540fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.695+0000 7f3f591ff700 1 -- 172.21.15.151:0/3263595912 >> 172.21.15.151:0/3263595912 conn(0x7f3f540fb5f0 msgr2=0x7f3f540fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.695+0000 7f3f591ff700 1 -- 172.21.15.151:0/3263595912 shutdown_connections 2023-07-21T22:26:30.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.695+0000 7f3f591ff700 1 -- 172.21.15.151:0/3263595912 wait complete. 2023-07-21T22:26:30.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.696+0000 7f3f591ff700 1 Processor -- start 2023-07-21T22:26:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.696+0000 7f3f591ff700 1 -- start start 2023-07-21T22:26:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f591ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f540ffb30 0x7f3f54197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f591ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f541004e0 0x7f3f54198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f591ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 0x7f3f5419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f591ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5419cf20 con 0x7f3f54105b60 2023-07-21T22:26:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f591ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5419d090 con 0x7f3f540ffb30 2023-07-21T22:26:30.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f591ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5419d250 con 0x7f3f541004e0 2023-07-21T22:26:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f5359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 0x7f3f5419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f5359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 0x7f3f5419c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49346/0 (socket says 172.21.15.151:49346) 2023-07-21T22:26:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f5359e700 1 -- 172.21.15.151:0/2865467629 learned_addr learned my addr 172.21.15.151:0/2865467629 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:30.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f5259c700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f541004e0 0x7f3f54198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f540ffb30 0x7f3f54197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f5359e700 1 -- 172.21.15.151:0/2865467629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f541004e0 msgr2=0x7f3f54198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f5359e700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f541004e0 0x7f3f54198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f5359e700 1 -- 172.21.15.151:0/2865467629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f540ffb30 msgr2=0x7f3f54197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:30.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.697+0000 7f3f5359e700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f540ffb30 0x7f3f54197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.698+0000 7f3f5359e700 1 -- 172.21.15.151:0/2865467629 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f440095f0 con 0x7f3f54105b60 2023-07-21T22:26:30.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.698+0000 7f3f5359e700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 0x7f3f5419c8e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00ef30 tx=0x7f3f4c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:30.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.698+0000 7f3f3bfff700 1 -- 172.21.15.151:0/2865467629 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c018070 con 0x7f3f54105b60 2023-07-21T22:26:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.698+0000 7f3f591ff700 1 -- 172.21.15.151:0/2865467629 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5419d4d0 con 0x7f3f54105b60 2023-07-21T22:26:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.698+0000 7f3f3bfff700 1 -- 172.21.15.151:0/2865467629 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f4c00f040 con 0x7f3f54105b60 2023-07-21T22:26:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.698+0000 7f3f3bfff700 1 -- 172.21.15.151:0/2865467629 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00cb80 con 0x7f3f54105b60 2023-07-21T22:26:30.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.698+0000 7f3f591ff700 1 -- 172.21.15.151:0/2865467629 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f541a4d70 con 0x7f3f54105b60 2023-07-21T22:26:30.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.702+0000 7f3f3bfff700 1 -- 172.21.15.151:0/2865467629 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f3f4c00cd60 con 0x7f3f54105b60 2023-07-21T22:26:30.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.703+0000 7f3f3bfff700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f3c0a12c0 0x7f3f3c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.703+0000 7f3f3bfff700 1 -- 172.21.15.151:0/2865467629 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f4c0cc790 con 0x7f3f54105b60 2023-07-21T22:26:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f3c0a12c0 0x7f3f3c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f6cac4b80 1 Processor -- start 2023-07-21T22:26:30.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f6cac4b80 1 -- start start 2023-07-21T22:26:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 0x558d0b1cfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0210 0x558d0b1c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0660 0x558d0b1ca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b0cfc50 con 0x558d0b1d0210 2023-07-21T22:26:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b1229e0 con 0x558d0b1d0660 2023-07-21T22:26:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b11be70 con 0x558d0b0266b0 2023-07-21T22:26:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.704+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f3c0a12c0 0x7f3f3c0a3770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f44006010 tx=0x7f3f4400b260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:30.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0210 0x558d0b1c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5359e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0660 0x558d0b1ca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0210 0x558d0b1c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49362/0 (socket says 172.21.15.151:49362) 2023-07-21T22:26:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5259c700 1 -- 172.21.15.151:0/3086652008 learned_addr learned my addr 172.21.15.151:0/3086652008 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:30.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5359e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0660 0x558d0b1ca4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39616/0 (socket says 172.21.15.151:39616) 2023-07-21T22:26:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/3086652008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 0x558d0b1cfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5359e700 1 -- 172.21.15.151:0/3086652008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 msgr2=0x558d0b1cfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5359e700 1 --2- 172.21.15.151:0/3086652008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 0x558d0b1cfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5359e700 1 -- 172.21.15.151:0/3086652008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0210 msgr2=0x558d0b1c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5359e700 1 --2- 172.21.15.151:0/3086652008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0210 0x558d0b1c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.705+0000 7f3f5359e700 1 -- 172.21.15.151:0/3086652008 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d0af49d80 con 0x558d0b1d0660 2023-07-21T22:26:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.706+0000 7f3f5359e700 1 --2- 172.21.15.151:0/3086652008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0660 0x558d0b1ca4a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0c9ea0 tx=0x7f3f4c099520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=541546cfb16444f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:30.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.706+0000 7f3f397fa700 1 -- 172.21.15.151:0/3086652008 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c0a1c70 con 0x558d0b1d0660 2023-07-21T22:26:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.706+0000 7f3f397fa700 1 -- 172.21.15.151:0/3086652008 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f4c0979f0 con 0x558d0b1d0660 2023-07-21T22:26:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.706+0000 7f3f397fa700 1 -- 172.21.15.151:0/3086652008 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c099d50 con 0x558d0b1d0660 2023-07-21T22:26:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3086652008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0660 msgr2=0x558d0b1ca4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:30.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3086652008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0660 0x558d0b1ca4a0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c0c9ea0 tx=0x7f3f4c099520 comp rx=0 tx=0).stop 2023-07-21T22:26:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3086652008 shutdown_connections 2023-07-21T22:26:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3086652008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0660 0x558d0b1ca4a0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3086652008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 0x558d0b1cfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3086652008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0210 0x558d0b1c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3086652008 >> 172.21.15.151:0/3086652008 conn(0x558d0b1bfae0 msgr2=0x558d0b1c50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3086652008 shutdown_connections 2023-07-21T22:26:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3086652008 wait complete. 2023-07-21T22:26:30.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.707+0000 7f3f6cac4b80 1 -- start start 2023-07-21T22:26:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.708+0000 7f3f6cac4b80 1 Processor -- start 2023-07-21T22:26:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.708+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b0266b0 0x558d0b1d6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.708+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1d0210 0x558d0b1d37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0660 0x558d0b1d3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b0bba60 con 0x558d0b1d0660 2023-07-21T22:26:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b0bb760 con 0x558d0b0266b0 2023-07-21T22:26:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0af9f8c0 con 0x558d0b1d0210 2023-07-21T22:26:30.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f6cac4b80 10 client.0 _ll_register_callbacks cb 0x558d0b0b9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f52d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b0266b0 0x558d0b1d6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f52d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b0266b0 0x558d0b1d6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39622/0 (socket says 172.21.15.151:39622) 2023-07-21T22:26:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f52d9d700 1 -- 172.21.15.151:0/3740852772 learned_addr learned my addr 172.21.15.151:0/3740852772 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:30.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f5259c700 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1d0210 0x558d0b1d37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f5359e700 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0660 0x558d0b1d3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f52d9d700 1 -- 172.21.15.151:0/3740852772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1d0210 msgr2=0x558d0b1d37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:30.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1d0210 0x558d0b1d37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f52d9d700 1 -- 172.21.15.151:0/3740852772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0660 msgr2=0x558d0b1d3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:30.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0660 0x558d0b1d3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f52d9d700 1 -- 172.21.15.151:0/3740852772 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f541a4d70 con 0x558d0b0266b0 2023-07-21T22:26:30.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.709+0000 7f3f5359e700 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0660 0x558d0b1d3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:26:30.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.710+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b0266b0 0x558d0b1d6570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400bee0 tx=0x7f3f4401a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fea0d04ae5166e00 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:30.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.710+0000 7f3f36ff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:26:30.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.710+0000 7f3f36ff5700 1 -- 172.21.15.151:0/3740852772 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44030420 con 0x558d0b0266b0 2023-07-21T22:26:30.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.710+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3740852772 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d0b075490 con 0x558d0b0266b0 2023-07-21T22:26:30.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.710+0000 7f3f36ff5700 1 -- 172.21.15.151:0/3740852772 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f44030580 con 0x558d0b0266b0 2023-07-21T22:26:30.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.710+0000 7f3f36ff5700 1 -- 172.21.15.151:0/3740852772 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f44030740 con 0x558d0b0266b0 2023-07-21T22:26:30.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.710+0000 7f3f6cac4b80 10 client.26606 fetch_fsmap learned FSMap version 37 2023-07-21T22:26:30.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.710+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3740852772 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558d0af32c00 con 0x558d0b0266b0 2023-07-21T22:26:30.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.711+0000 7f3f36ff5700 1 -- 172.21.15.151:0/3740852772 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f4403d020 con 0x558d0b0266b0 2023-07-21T22:26:30.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.711+0000 7f3f36ff5700 1 -- 172.21.15.151:0/3740852772 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3f440248d0 con 0x558d0b0266b0 2023-07-21T22:26:30.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.711+0000 7f3f6cac4b80 10 client.26606 fetch_fsmap finished waiting for FSMap version 37 2023-07-21T22:26:30.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.711+0000 7f3f6cac4b80 10 client.26606 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:30.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.711+0000 7f3f6cac4b80 20 client.26606 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:30.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.711+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d0b1e3b50 0x558d0b1e5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.711+0000 7f3f6cac4b80 4 client.26606 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:26:30.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.711+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3740852772 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d0b114e50 con 0x558d0b1e3b50 2023-07-21T22:26:30.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.712+0000 7f3f5259c700 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d0b1e3b50 0x558d0b1e5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.712+0000 7f3f5259c700 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d0b1e3b50 0x558d0b1e5f60 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c0d1ebcb29e02a server_cookie=b93dc85b29658827 in_seq=0 out_seq=0 2023-07-21T22:26:30.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.712+0000 7f3f36ff5700 10 client.26606 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:30.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f36ff5700 1 -- 172.21.15.151:0/3740852772 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558d0b114e50 con 0x558d0b1e3b50 2023-07-21T22:26:30.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f36ff5700 10 client.26606 handle_command_reply: tid=0 2023-07-21T22:26:30.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f6cac4b80 1 client.26606 shutdown 2023-07-21T22:26:30.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3740852772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b0266b0 msgr2=0x558d0b1d6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b0266b0 0x558d0b1d6570 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400bee0 tx=0x7f3f4401a050 comp rx=0 tx=0).stop 2023-07-21T22:26:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3740852772 shutdown_connections 2023-07-21T22:26:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d0b1e3b50 0x558d0b1e5f60 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b0266b0 0x558d0b1d6570 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1d0660 0x558d0b1d3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f36ff5700 0 client.26606 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:30.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/3740852772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1d0210 0x558d0b1d37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.713+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3740852772 >> 172.21.15.151:0/3740852772 conn(0x558d0b1bfae0 msgr2=0x558d0b1c43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:30.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.714+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3740852772 shutdown_connections 2023-07-21T22:26:30.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.714+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/3740852772 wait complete. 2023-07-21T22:26:30.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.714+0000 7f3f6cac4b80 20 client.26606 trim_cache size 0 max 16384 2023-07-21T22:26:30.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.734+0000 7f3f6cac4b80 1 Processor -- start 2023-07-21T22:26:30.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.734+0000 7f3f6cac4b80 1 -- start start 2023-07-21T22:26:30.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1bfae0 0x558d0b1d12c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 0x558d0b1d2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 0x558d0b1d6110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b1d3c50 con 0x558d0b1bfae0 2023-07-21T22:26:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b1d1800 con 0x558d0b1d0210 2023-07-21T22:26:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b1d47b0 con 0x558d0b0266b0 2023-07-21T22:26:30.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f52d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1bfae0 0x558d0b1d12c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f52d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1bfae0 0x558d0b1d12c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49384/0 (socket says 172.21.15.151:49384) 2023-07-21T22:26:30.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f52d9d700 1 -- 172.21.15.151:0/1058212646 learned_addr learned my addr 172.21.15.151:0/1058212646 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:30.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f5359e700 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 0x558d0b1d6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f5259c700 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 0x558d0b1d2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f52d9d700 1 -- 172.21.15.151:0/1058212646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 msgr2=0x558d0b1d2fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:30.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 0x558d0b1d2fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f52d9d700 1 -- 172.21.15.151:0/1058212646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 msgr2=0x558d0b1d6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:30.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 0x558d0b1d6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f52d9d700 1 -- 172.21.15.151:0/1058212646 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d0af701f0 con 0x558d0b1bfae0 2023-07-21T22:26:30.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.735+0000 7f3f5259c700 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 0x558d0b1d2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:26:30.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.736+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1bfae0 0x558d0b1d12c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3f440098e0 tx=0x7f3f44009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ab1c36fce69564 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:30.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.736+0000 7f3f39ffb700 1 -- 172.21.15.151:0/1058212646 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400fa20 con 0x558d0b1bfae0 2023-07-21T22:26:30.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.736+0000 7f3f39ffb700 1 -- 172.21.15.151:0/1058212646 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f4403d030 con 0x558d0b1bfae0 2023-07-21T22:26:30.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.736+0000 7f3f39ffb700 1 -- 172.21.15.151:0/1058212646 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f44018a00 con 0x558d0b1bfae0 2023-07-21T22:26:30.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/1058212646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1bfae0 msgr2=0x558d0b1d12c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:30.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1bfae0 0x558d0b1d12c0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3f440098e0 tx=0x7f3f44009310 comp rx=0 tx=0).stop 2023-07-21T22:26:30.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/1058212646 shutdown_connections 2023-07-21T22:26:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 0x558d0b1d6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b1bfae0 0x558d0b1d12c0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/1058212646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b0266b0 0x558d0b1d2fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/1058212646 >> 172.21.15.151:0/1058212646 conn(0x558d0b1e0140 msgr2=0x558d0b1ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:30.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/1058212646 shutdown_connections 2023-07-21T22:26:30.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/1058212646 wait complete. 2023-07-21T22:26:30.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.737+0000 7f3f6cac4b80 1 -- start start 2023-07-21T22:26:30.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f6cac4b80 1 Processor -- start 2023-07-21T22:26:30.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b0266b0 0x558d0b1dabb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1bfae0 0x558d0b1cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f6cac4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 0x558d0b1cbd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b1cc290 con 0x558d0b0266b0 2023-07-21T22:26:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b1cc400 con 0x558d0b1d0210 2023-07-21T22:26:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f6cac4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d0b1cc570 con 0x558d0b1bfae0 2023-07-21T22:26:30.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f6cac4b80 10 client.0 _ll_register_callbacks cb 0x7f3f4400bac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f52d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b0266b0 0x558d0b1dabb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f52d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b0266b0 0x558d0b1dabb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49390/0 (socket says 172.21.15.151:49390) 2023-07-21T22:26:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.738+0000 7f3f52d9d700 1 -- 172.21.15.151:0/2286796654 learned_addr learned my addr 172.21.15.151:0/2286796654 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f5359e700 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 0x558d0b1cbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f5259c700 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1bfae0 0x558d0b1cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f52d9d700 1 -- 172.21.15.151:0/2286796654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1bfae0 msgr2=0x558d0b1cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:30.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1bfae0 0x558d0b1cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f52d9d700 1 -- 172.21.15.151:0/2286796654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 msgr2=0x558d0b1cbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 0x558d0b1cbd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f52d9d700 1 -- 172.21.15.151:0/2286796654 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d0af32c00 con 0x558d0b0266b0 2023-07-21T22:26:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f5259c700 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1bfae0 0x558d0b1cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:26:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f52d9d700 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b0266b0 0x558d0b1dabb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3f44018600 tx=0x7f3f44024640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87817ee26f86ecb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f36ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:26:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f36ff5700 1 -- 172.21.15.151:0/2286796654 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400fa20 con 0x558d0b0266b0 2023-07-21T22:26:30.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.739+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/2286796654 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f4c0979f0 con 0x558d0b0266b0 2023-07-21T22:26:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f36ff5700 1 -- 172.21.15.151:0/2286796654 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f4403e080 con 0x558d0b0266b0 2023-07-21T22:26:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f36ff5700 1 -- 172.21.15.151:0/2286796654 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f440249f0 con 0x558d0b0266b0 2023-07-21T22:26:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f6cac4b80 10 client.16896 fetch_fsmap learned FSMap version 37 2023-07-21T22:26:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/2286796654 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) v3 -- 0x558d0af48250 con 0x558d0b0266b0 2023-07-21T22:26:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f36ff5700 1 -- 172.21.15.151:0/2286796654 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f4c0979f0 con 0x558d0b0266b0 2023-07-21T22:26:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f36ff5700 1 -- 172.21.15.151:0/2286796654 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 37) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3f4404b750 con 0x558d0b0266b0 2023-07-21T22:26:30.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f6cac4b80 10 client.16896 fetch_fsmap finished waiting for FSMap version 37 2023-07-21T22:26:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f6cac4b80 10 client.16896 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f6cac4b80 20 client.16896 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d0b1d0660 0x558d0b23a900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f6cac4b80 4 client.16896 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:26:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.740+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/2286796654 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558d0b0d6ff0 con 0x558d0b1d0660 2023-07-21T22:26:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.741+0000 7f3f5259c700 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d0b1d0660 0x558d0b23a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.741+0000 7f3f5259c700 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d0b1d0660 0x558d0b23a900 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c374ea2753b47a9 server_cookie=e03ba9aed9171015 in_seq=0 out_seq=0 2023-07-21T22:26:30.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.741+0000 7f3f36ff5700 10 client.16896 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:30.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f36ff5700 1 -- 172.21.15.151:0/2286796654 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558d0b0d6ff0 con 0x558d0b1d0660 2023-07-21T22:26:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f36ff5700 10 client.16896 handle_command_reply: tid=0 2023-07-21T22:26:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 client.16896 shutdown 2023-07-21T22:26:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/2286796654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b0266b0 msgr2=0x558d0b1dabb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b0266b0 0x558d0b1dabb0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f3f44018600 tx=0x7f3f44024640 comp rx=0 tx=0).stop 2023-07-21T22:26:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/2286796654 shutdown_connections 2023-07-21T22:26:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d0b1d0660 0x558d0b23a900 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d0b1d0210 0x558d0b1cbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f36ff5700 0 client.16896 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d0b0266b0 0x558d0b1dabb0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 --2- 172.21.15.151:0/2286796654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d0b1bfae0 0x558d0b1cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/2286796654 >> 172.21.15.151:0/2286796654 conn(0x558d0b1e0140 msgr2=0x558d0b1cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/2286796654 shutdown_connections 2023-07-21T22:26:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.756+0000 7f3f6cac4b80 1 -- 172.21.15.151:0/2286796654 wait complete. 2023-07-21T22:26:30.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f6cac4b80 20 client.16896 trim_cache size 0 max 16384 2023-07-21T22:26:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:26:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:26:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:26:30.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:26:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 -- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f3c0a12c0 msgr2=0x7f3f3c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f3c0a12c0 0x7f3f3c0a3770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3f44006010 tx=0x7f3f4400b260 comp rx=0 tx=0).stop 2023-07-21T22:26:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 -- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 msgr2=0x7f3f5419c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 0x7f3f5419c8e0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00ef30 tx=0x7f3f4c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 -- 172.21.15.151:0/2865467629 shutdown_connections 2023-07-21T22:26:30.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f3c0a12c0 0x7f3f3c0a3770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f540ffb30 0x7f3f54197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f54105b60 0x7f3f5419c8e0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 --2- 172.21.15.151:0/2865467629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f541004e0 0x7f3f54198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.757+0000 7f3f591ff700 1 -- 172.21.15.151:0/2865467629 >> 172.21.15.151:0/2865467629 conn(0x7f3f540fb5f0 msgr2=0x7f3f5410ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.758+0000 7f3f591ff700 1 -- 172.21.15.151:0/2865467629 shutdown_connections 2023-07-21T22:26:30.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:30.758+0000 7f3f591ff700 1 -- 172.21.15.151:0/2865467629 wait complete. 2023-07-21T22:26:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:30 smithi187 ceph-mon[96918]: pgmap v224: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 21 MiB/s wr, 60 op/s 2023-07-21T22:26:31.613 INFO:teuthology.orchestra.run.smithi151.stderr:30400000 of 50000000 tuples (60%) done (elapsed 415.10 s, remaining 267.63 s) 2023-07-21T22:26:32.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:32 smithi195 ceph-mon[97365]: pgmap v225: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 21 MiB/s wr, 60 op/s 2023-07-21T22:26:32.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:32 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:32.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:32 smithi151 ceph-mon[95510]: pgmap v225: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 21 MiB/s wr, 60 op/s 2023-07-21T22:26:32.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:32 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:32.865 INFO:teuthology.orchestra.run.smithi151.stderr:30500000 of 50000000 tuples (61%) done (elapsed 416.36 s, remaining 266.20 s) 2023-07-21T22:26:32.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:32 smithi187 ceph-mon[96918]: pgmap v225: 97 pgs: 97 active+clean; 6.9 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 21 MiB/s wr, 60 op/s 2023-07-21T22:26:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:32 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:34.282 INFO:teuthology.orchestra.run.smithi151.stderr:30600000 of 50000000 tuples (61%) done (elapsed 417.77 s, remaining 264.86 s) 2023-07-21T22:26:34.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:34 smithi195 ceph-mon[97365]: pgmap v226: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 32 MiB/s wr, 83 op/s 2023-07-21T22:26:34.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:34 smithi151 ceph-mon[95510]: pgmap v226: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 32 MiB/s wr, 83 op/s 2023-07-21T22:26:34.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:34 smithi187 ceph-mon[96918]: pgmap v226: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 32 MiB/s wr, 83 op/s 2023-07-21T22:26:35.540 INFO:teuthology.orchestra.run.smithi151.stderr:30700000 of 50000000 tuples (61%) done (elapsed 419.03 s, remaining 263.43 s) 2023-07-21T22:26:36.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:36 smithi195 ceph-mon[97365]: pgmap v227: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 20 MiB/s wr, 48 op/s 2023-07-21T22:26:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:36 smithi151 ceph-mon[95510]: pgmap v227: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 20 MiB/s wr, 48 op/s 2023-07-21T22:26:36.811 INFO:teuthology.orchestra.run.smithi151.stderr:30800000 of 50000000 tuples (61%) done (elapsed 420.30 s, remaining 262.01 s) 2023-07-21T22:26:36.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:36 smithi187 ceph-mon[96918]: pgmap v227: 97 pgs: 97 active+clean; 7.0 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 20 MiB/s wr, 48 op/s 2023-07-21T22:26:37.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:37 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:37.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:37 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:37.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:37 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:38.130 INFO:teuthology.orchestra.run.smithi151.stderr:30900000 of 50000000 tuples (61%) done (elapsed 421.62 s, remaining 260.61 s) 2023-07-21T22:26:38.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:38 smithi195 ceph-mon[97365]: pgmap v228: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 32 MiB/s wr, 87 op/s 2023-07-21T22:26:38.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:38 smithi151 ceph-mon[95510]: pgmap v228: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 32 MiB/s wr, 87 op/s 2023-07-21T22:26:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:38 smithi187 ceph-mon[96918]: pgmap v228: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 32 MiB/s wr, 87 op/s 2023-07-21T22:26:39.325 INFO:teuthology.orchestra.run.smithi151.stderr:31000000 of 50000000 tuples (62%) done (elapsed 422.82 s, remaining 259.15 s) 2023-07-21T22:26:40.529 INFO:teuthology.orchestra.run.smithi151.stderr:31100000 of 50000000 tuples (62%) done (elapsed 424.02 s, remaining 257.68 s) 2023-07-21T22:26:40.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:40 smithi151 ceph-mon[95510]: pgmap v229: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:26:40.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:40 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:40 smithi187 ceph-mon[96918]: pgmap v229: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:26:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:40 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:40.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:40 smithi195 ceph-mon[97365]: pgmap v229: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:26:40.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:40 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:41.857 INFO:teuthology.orchestra.run.smithi151.stderr:31200000 of 50000000 tuples (62%) done (elapsed 425.35 s, remaining 256.30 s) 2023-07-21T22:26:42.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:42 smithi151 ceph-mon[95510]: pgmap v230: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:26:42.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:42 smithi187 ceph-mon[96918]: pgmap v230: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:26:42.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:42 smithi195 ceph-mon[97365]: pgmap v230: 97 pgs: 97 active+clean; 7.1 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 23 MiB/s wr, 62 op/s 2023-07-21T22:26:43.110 INFO:teuthology.orchestra.run.smithi151.stderr:31300000 of 50000000 tuples (62%) done (elapsed 426.60 s, remaining 254.87 s) 2023-07-21T22:26:43.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.919+0000 7f0b73dff700 1 -- 172.21.15.151:0/1167106498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c073160 msgr2=0x7f0b6c10be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:43.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.919+0000 7f0b73dff700 1 --2- 172.21.15.151:0/1167106498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c073160 0x7f0b6c10be70 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009990 tx=0x7f0b5c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.919+0000 7f0b73dff700 1 -- 172.21.15.151:0/1167106498 shutdown_connections 2023-07-21T22:26:43.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.919+0000 7f0b73dff700 1 --2- 172.21.15.151:0/1167106498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c10c3b0 0x7f0b6c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.919+0000 7f0b73dff700 1 --2- 172.21.15.151:0/1167106498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b6c072850 0x7f0b6c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.919+0000 7f0b73dff700 1 --2- 172.21.15.151:0/1167106498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c073160 0x7f0b6c10be70 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.919+0000 7f0b73dff700 1 -- 172.21.15.151:0/1167106498 >> 172.21.15.151:0/1167106498 conn(0x7f0b6c0fb5f0 msgr2=0x7f0b6c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.919+0000 7f0b73dff700 1 -- 172.21.15.151:0/1167106498 shutdown_connections 2023-07-21T22:26:43.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.919+0000 7f0b73dff700 1 -- 172.21.15.151:0/1167106498 wait complete. 2023-07-21T22:26:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.920+0000 7f0b73dff700 1 Processor -- start 2023-07-21T22:26:43.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.920+0000 7f0b73dff700 1 -- start start 2023-07-21T22:26:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b73dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c072850 0x7f0b6c197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b73dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b6c073160 0x7f0b6c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b73dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c10c3b0 0x7f0b6c19c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b73dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c19cfb0 con 0x7f0b6c072850 2023-07-21T22:26:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b73dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c19d120 con 0x7f0b6c10c3b0 2023-07-21T22:26:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b73dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c19d2e0 con 0x7f0b6c073160 2023-07-21T22:26:43.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b71b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c072850 0x7f0b6c197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b71b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c072850 0x7f0b6c197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32962/0 (socket says 172.21.15.151:32962) 2023-07-21T22:26:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b7239c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c10c3b0 0x7f0b6c19c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b71b9b700 1 -- 172.21.15.151:0/4082696452 learned_addr learned my addr 172.21.15.151:0/4082696452 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b7139a700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b6c073160 0x7f0b6c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b71b9b700 1 -- 172.21.15.151:0/4082696452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b6c073160 msgr2=0x7f0b6c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b6c073160 0x7f0b6c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b71b9b700 1 -- 172.21.15.151:0/4082696452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c10c3b0 msgr2=0x7f0b6c19c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c10c3b0 0x7f0b6c19c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.921+0000 7f0b71b9b700 1 -- 172.21.15.151:0/4082696452 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c0095f0 con 0x7f0b6c072850 2023-07-21T22:26:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.922+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c072850 0x7f0b6c197dc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800e9a0 tx=0x7f0b6800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:43.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.922+0000 7f0b62ffd700 1 -- 172.21.15.151:0/4082696452 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68009790 con 0x7f0b6c072850 2023-07-21T22:26:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.922+0000 7f0b62ffd700 1 -- 172.21.15.151:0/4082696452 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b68010430 con 0x7f0b6c072850 2023-07-21T22:26:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.922+0000 7f0b62ffd700 1 -- 172.21.15.151:0/4082696452 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6800cea0 con 0x7f0b6c072850 2023-07-21T22:26:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.922+0000 7f0b73dff700 1 -- 172.21.15.151:0/4082696452 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6c19d5c0 con 0x7f0b6c072850 2023-07-21T22:26:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.922+0000 7f0b73dff700 1 -- 172.21.15.151:0/4082696452 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c1a4e00 con 0x7f0b6c072850 2023-07-21T22:26:43.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.926+0000 7f0b62ffd700 1 -- 172.21.15.151:0/4082696452 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0b680105a0 con 0x7f0b6c072850 2023-07-21T22:26:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.927+0000 7f0b876f4b80 1 Processor -- start 2023-07-21T22:26:43.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.927+0000 7f0b876f4b80 1 -- start start 2023-07-21T22:26:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.927+0000 7f0b62ffd700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0b580a1340 0x7f0b580a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66569cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66563f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b62ffd700 1 -- 172.21.15.151:0/4082696452 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0b68014070 con 0x7f0b6c072850 2023-07-21T22:26:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665644a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66469c50 con 0x559f663c06b0 2023-07-21T22:26:43.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f664bc9e0 con 0x559f6656a210 2023-07-21T22:26:43.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f664b5e70 con 0x559f6656a660 2023-07-21T22:26:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b7239c700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0b580a1340 0x7f0b580a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b71b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66569cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b7239c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665644a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b7239c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665644a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34354/0 (socket says 172.21.15.151:34354) 2023-07-21T22:26:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b7239c700 1 -- 172.21.15.151:0/2083661441 learned_addr learned my addr 172.21.15.151:0/2083661441 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b7139a700 1 --2- 172.21.15.151:0/2083661441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66563f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.928+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/2083661441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66569cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32972/0 (socket says 172.21.15.151:32972) 2023-07-21T22:26:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b7239c700 1 -- 172.21.15.151:0/2083661441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 msgr2=0x559f66563f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b7239c700 1 --2- 172.21.15.151:0/2083661441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66563f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b7239c700 1 -- 172.21.15.151:0/2083661441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 msgr2=0x559f66569cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:43.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b7239c700 1 --2- 172.21.15.151:0/2083661441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66569cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b7239c700 1 -- 172.21.15.151:0/2083661441 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f662e3d80 con 0x559f6656a660 2023-07-21T22:26:43.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b7239c700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0b580a1340 0x7f0b580a37f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b64007b50 tx=0x7f0b64009c50 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:43.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b7239c700 1 --2- 172.21.15.151:0/2083661441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665644a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0b640075b0 tx=0x7f0b6401c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c874b4fe2a5da987 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:43.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b57fff700 1 -- 172.21.15.151:0/2083661441 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64027070 con 0x559f6656a660 2023-07-21T22:26:43.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b57fff700 1 -- 172.21.15.151:0/2083661441 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b64009620 con 0x559f6656a660 2023-07-21T22:26:43.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.929+0000 7f0b57fff700 1 -- 172.21.15.151:0/2083661441 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64023af0 con 0x559f6656a660 2023-07-21T22:26:43.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.930+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2083661441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 msgr2=0x559f665644a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:43.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.930+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2083661441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665644a0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0b640075b0 tx=0x7f0b6401c000 comp rx=0 tx=0).stop 2023-07-21T22:26:43.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.930+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2083661441 shutdown_connections 2023-07-21T22:26:43.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.930+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2083661441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665644a0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.930+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2083661441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66569cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.930+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2083661441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66563f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.930+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2083661441 >> 172.21.15.151:0/2083661441 conn(0x559f66559ae0 msgr2=0x559f6655f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:43.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.930+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2083661441 shutdown_connections 2023-07-21T22:26:43.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.930+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2083661441 wait complete. 2023-07-21T22:26:43.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.931+0000 7f0b876f4b80 1 -- start start 2023-07-21T22:26:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.931+0000 7f0b876f4b80 1 Processor -- start 2023-07-21T22:26:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f663c06b0 0x559f66570520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6656a660 0x559f6656ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66455a60 con 0x559f6656a660 2023-07-21T22:26:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66455760 con 0x559f6656a210 2023-07-21T22:26:43.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f663398c0 con 0x559f663c06b0 2023-07-21T22:26:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b876f4b80 10 client.0 _ll_register_callbacks cb 0x559f66453700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b7239c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6656a660 0x559f6656ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b7239c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6656a660 0x559f6656ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32986/0 (socket says 172.21.15.151:32986) 2023-07-21T22:26:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b7239c700 1 -- 172.21.15.151:0/2492184137 learned_addr learned my addr 172.21.15.151:0/2492184137 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.932+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f663c06b0 0x559f66570520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.933+0000 7f0b7139a700 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.933+0000 7f0b71b9b700 1 -- 172.21.15.151:0/2492184137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 msgr2=0x559f6656d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.933+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.933+0000 7f0b71b9b700 1 -- 172.21.15.151:0/2492184137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6656a660 msgr2=0x559f6656ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.933+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6656a660 0x559f6656ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.933+0000 7f0b71b9b700 1 -- 172.21.15.151:0/2492184137 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b64011040 con 0x559f663c06b0 2023-07-21T22:26:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.933+0000 7f0b7239c700 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6656a660 0x559f6656ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:26:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.933+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f663c06b0 0x559f66570520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0b680ca5e0 tx=0x7f0b68099bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e673158f81506880 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:43.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.933+0000 7f0b557fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:26:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b557fa700 1 -- 172.21.15.151:0/2492184137 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680b1070 con 0x559f663c06b0 2023-07-21T22:26:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b557fa700 1 -- 172.21.15.151:0/2492184137 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0b680a23b0 con 0x559f663c06b0 2023-07-21T22:26:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2492184137 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559f6640f490 con 0x559f663c06b0 2023-07-21T22:26:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b557fa700 1 -- 172.21.15.151:0/2492184137 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b68099660 con 0x559f663c06b0 2023-07-21T22:26:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b876f4b80 10 client.26653 fetch_fsmap learned FSMap version 40 2023-07-21T22:26:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2492184137 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x559f662ccc00 con 0x559f663c06b0 2023-07-21T22:26:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b557fa700 1 -- 172.21.15.151:0/2492184137 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b680c8080 con 0x559f663c06b0 2023-07-21T22:26:43.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b557fa700 1 -- 172.21.15.151:0/2492184137 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 40) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f0b6800ca10 con 0x559f663c06b0 2023-07-21T22:26:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b876f4b80 10 client.26653 fetch_fsmap finished waiting for FSMap version 40 2023-07-21T22:26:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b876f4b80 10 client.26653 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b876f4b80 20 client.26653 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559f6657d990 0x559f6657fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b876f4b80 4 client.26653 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:26:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.934+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2492184137 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559f664aee50 con 0x559f6657d990 2023-07-21T22:26:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.935+0000 7f0b7139a700 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559f6657d990 0x559f6657fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:43.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.935+0000 7f0b557fa700 10 client.26653 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.935+0000 7f0b7139a700 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559f6657d990 0x559f6657fda0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa42ad2d55fcdfa server_cookie=61b24cf1faebc069 in_seq=0 out_seq=0 2023-07-21T22:26:43.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b557fa700 1 -- 172.21.15.151:0/2492184137 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559f664aee50 con 0x559f6657d990 2023-07-21T22:26:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b557fa700 10 client.26653 handle_command_reply: tid=0 2023-07-21T22:26:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b876f4b80 1 client.26653 shutdown 2023-07-21T22:26:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2492184137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f663c06b0 msgr2=0x559f66570520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f663c06b0 0x559f66570520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0b680ca5e0 tx=0x7f0b68099bb0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2492184137 shutdown_connections 2023-07-21T22:26:43.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559f6657d990 0x559f6657fda0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f6656a660 0x559f6656ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f663c06b0 0x559f66570520 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/2492184137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2492184137 >> 172.21.15.151:0/2492184137 conn(0x559f66559ae0 msgr2=0x559f6655e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.936+0000 7f0b557fa700 0 client.26653 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.937+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2492184137 shutdown_connections 2023-07-21T22:26:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.937+0000 7f0b876f4b80 1 -- 172.21.15.151:0/2492184137 wait complete. 2023-07-21T22:26:43.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.937+0000 7f0b876f4b80 20 client.26653 trim_cache size 0 max 16384 2023-07-21T22:26:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.955+0000 7f0b876f4b80 1 Processor -- start 2023-07-21T22:26:44.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.955+0000 7f0b876f4b80 1 -- start start 2023-07-21T22:26:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.955+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66574b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665700c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66564ae0 con 0x559f663c06b0 2023-07-21T22:26:44.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f665683e0 con 0x559f6656a210 2023-07-21T22:26:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66575060 con 0x559f6656a660 2023-07-21T22:26:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7139a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b71b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66574b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7239c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665700c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7139a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57524/0 (socket says 172.21.15.151:57524) 2023-07-21T22:26:44.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7139a700 1 -- 172.21.15.151:0/635709256 learned_addr learned my addr 172.21.15.151:0/635709256 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:44.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7239c700 1 -- 172.21.15.151:0/635709256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 msgr2=0x559f6656cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7239c700 1 --2- 172.21.15.151:0/635709256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7239c700 1 -- 172.21.15.151:0/635709256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 msgr2=0x559f66574b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7239c700 1 --2- 172.21.15.151:0/635709256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66574b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7239c700 1 -- 172.21.15.151:0/635709256 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559f6630a1f0 con 0x559f6656a660 2023-07-21T22:26:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.956+0000 7f0b7139a700 1 --2- 172.21.15.151:0/635709256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:26:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.957+0000 7f0b7239c700 1 --2- 172.21.15.151:0/635709256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665700c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009790 tx=0x7f0b64009940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b369b618f4c8eb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.957+0000 7f0b60bff700 1 -- 172.21.15.151:0/635709256 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b64027040 con 0x559f6656a660 2023-07-21T22:26:44.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.957+0000 7f0b60bff700 1 -- 172.21.15.151:0/635709256 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b64004c90 con 0x559f6656a660 2023-07-21T22:26:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.957+0000 7f0b60bff700 1 -- 172.21.15.151:0/635709256 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b640052b0 con 0x559f6656a660 2023-07-21T22:26:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.958+0000 7f0b876f4b80 1 -- 172.21.15.151:0/635709256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 msgr2=0x559f665700c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.958+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/635709256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665700c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0b64009790 tx=0x7f0b64009940 comp rx=0 tx=0).stop 2023-07-21T22:26:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.958+0000 7f0b876f4b80 1 -- 172.21.15.151:0/635709256 shutdown_connections 2023-07-21T22:26:44.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.958+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/635709256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665700c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.958+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/635709256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66574b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.958+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/635709256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f6656cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.958+0000 7f0b876f4b80 1 -- 172.21.15.151:0/635709256 >> 172.21.15.151:0/635709256 conn(0x559f66559ae0 msgr2=0x559f665678d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.958+0000 7f0b876f4b80 1 -- 172.21.15.151:0/635709256 shutdown_connections 2023-07-21T22:26:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.958+0000 7f0b876f4b80 1 -- 172.21.15.151:0/635709256 wait complete. 2023-07-21T22:26:44.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.959+0000 7f0b876f4b80 1 -- start start 2023-07-21T22:26:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.959+0000 7f0b876f4b80 1 Processor -- start 2023-07-21T22:26:44.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66566a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66566f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b876f4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665657b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66565ef0 con 0x559f663c06b0 2023-07-21T22:26:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66566060 con 0x559f6656a210 2023-07-21T22:26:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b876f4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559f66566220 con 0x559f6656a660 2023-07-21T22:26:44.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b876f4b80 10 client.0 _ll_register_callbacks cb 0x7f0b680998c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b7139a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66566f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b7139a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66566f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57532/0 (socket says 172.21.15.151:57532) 2023-07-21T22:26:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b7139a700 1 -- 172.21.15.151:0/814703052 learned_addr learned my addr 172.21.15.151:0/814703052 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66566a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b7239c700 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665657b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b7139a700 1 -- 172.21.15.151:0/814703052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 msgr2=0x559f665657b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b7139a700 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665657b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b7139a700 1 -- 172.21.15.151:0/814703052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 msgr2=0x559f66566a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b7139a700 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66566a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.960+0000 7f0b7139a700 1 -- 172.21.15.151:0/814703052 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c10f3d0 con 0x559f6656a210 2023-07-21T22:26:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.961+0000 7f0b7239c700 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:26:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.961+0000 7f0b7139a700 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66566f80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c015000 tx=0x7f0b5c0055a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36c8e4aea318216f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.961+0000 7f0b557fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:26:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.961+0000 7f0b557fa700 1 -- 172.21.15.151:0/814703052 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b5c02c070 con 0x559f6656a210 2023-07-21T22:26:44.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.961+0000 7f0b557fa700 1 -- 172.21.15.151:0/814703052 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0b5c00b920 con 0x559f6656a210 2023-07-21T22:26:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.961+0000 7f0b876f4b80 1 -- 172.21.15.151:0/814703052 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0b64009620 con 0x559f6656a210 2023-07-21T22:26:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b557fa700 1 -- 172.21.15.151:0/814703052 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0b5c01d040 con 0x559f6656a210 2023-07-21T22:26:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b876f4b80 10 client.26630 fetch_fsmap learned FSMap version 40 2023-07-21T22:26:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b876f4b80 1 -- 172.21.15.151:0/814703052 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) v3 -- 0x559f662e3d80 con 0x559f6656a210 2023-07-21T22:26:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b557fa700 1 -- 172.21.15.151:0/814703052 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0b5c03c080 con 0x559f6656a210 2023-07-21T22:26:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b557fa700 1 -- 172.21.15.151:0/814703052 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 40) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f0b5c004be0 con 0x559f6656a210 2023-07-21T22:26:44.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b876f4b80 10 client.26630 fetch_fsmap finished waiting for FSMap version 40 2023-07-21T22:26:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b876f4b80 10 client.26630 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b876f4b80 20 client.26630 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559f665d2a30 0x559f665d4e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b876f4b80 4 client.26630 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:26:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.962+0000 7f0b876f4b80 1 -- 172.21.15.151:0/814703052 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559f66470ff0 con 0x559f665d2a30 2023-07-21T22:26:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.963+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559f665d2a30 0x559f665d4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:44.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.963+0000 7f0b71b9b700 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559f665d2a30 0x559f665d4e40 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6714265b9b759aed server_cookie=1870ebced94f718f in_seq=0 out_seq=0 2023-07-21T22:26:44.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.963+0000 7f0b557fa700 10 client.26630 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:44.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.982+0000 7f0b557fa700 1 -- 172.21.15.151:0/814703052 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559f66470ff0 con 0x559f665d2a30 2023-07-21T22:26:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.982+0000 7f0b557fa700 10 client.26630 handle_command_reply: tid=0 2023-07-21T22:26:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.982+0000 7f0b876f4b80 1 client.26630 shutdown 2023-07-21T22:26:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 -- 172.21.15.151:0/814703052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 msgr2=0x559f66566f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:44.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66566f80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c015000 tx=0x7f0b5c0055a0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 -- 172.21.15.151:0/814703052 shutdown_connections 2023-07-21T22:26:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559f665d2a30 0x559f665d4e40 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559f6656a660 0x559f665657b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559f663c06b0 0x559f66566a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b557fa700 0 client.26630 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 --2- 172.21.15.151:0/814703052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559f6656a210 0x559f66566f80 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 -- 172.21.15.151:0/814703052 >> 172.21.15.151:0/814703052 conn(0x559f66559ae0 msgr2=0x559f6656aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 -- 172.21.15.151:0/814703052 shutdown_connections 2023-07-21T22:26:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 1 -- 172.21.15.151:0/814703052 wait complete. 2023-07-21T22:26:44.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.983+0000 7f0b876f4b80 20 client.26630 trim_cache size 0 max 16384 2023-07-21T22:26:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:26:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:26:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:26:44.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:26:44.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 -- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0b580a1340 msgr2=0x7f0b580a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0b580a1340 0x7f0b580a37f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0b64007b50 tx=0x7f0b64009c50 comp rx=0 tx=0).stop 2023-07-21T22:26:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 -- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c072850 msgr2=0x7f0b6c197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:44.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c072850 0x7f0b6c197dc0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f0b6800e9a0 tx=0x7f0b6800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 -- 172.21.15.151:0/4082696452 shutdown_connections 2023-07-21T22:26:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0b580a1340 0x7f0b580a37f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c10c3b0 0x7f0b6c19c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0b6c072850 0x7f0b6c197dc0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 --2- 172.21.15.151:0/4082696452 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0b6c073160 0x7f0b6c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 -- 172.21.15.151:0/4082696452 >> 172.21.15.151:0/4082696452 conn(0x7f0b6c0fb5f0 msgr2=0x7f0b6c10e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 -- 172.21.15.151:0/4082696452 shutdown_connections 2023-07-21T22:26:44.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:43.984+0000 7f0b73dff700 1 -- 172.21.15.151:0/4082696452 wait complete. 2023-07-21T22:26:44.379 INFO:teuthology.orchestra.run.smithi151.stderr:31400000 of 50000000 tuples (62%) done (elapsed 427.87 s, remaining 253.45 s) 2023-07-21T22:26:44.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:44 smithi151 ceph-mon[95510]: pgmap v231: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 35 MiB/s wr, 87 op/s 2023-07-21T22:26:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:44 smithi187 ceph-mon[96918]: pgmap v231: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 35 MiB/s wr, 87 op/s 2023-07-21T22:26:44.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:44 smithi195 ceph-mon[97365]: pgmap v231: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 35 MiB/s wr, 87 op/s 2023-07-21T22:26:45.594 INFO:teuthology.orchestra.run.smithi151.stderr:31500000 of 50000000 tuples (63%) done (elapsed 429.09 s, remaining 252.00 s) 2023-07-21T22:26:46.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:46 smithi151 ceph-mon[95510]: pgmap v232: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:26:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:46 smithi187 ceph-mon[96918]: pgmap v232: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:26:46.882 INFO:teuthology.orchestra.run.smithi151.stderr:31600000 of 50000000 tuples (63%) done (elapsed 430.37 s, remaining 250.60 s) 2023-07-21T22:26:46.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:46 smithi195 ceph-mon[97365]: pgmap v232: 97 pgs: 97 active+clean; 7.2 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:26:48.107 INFO:teuthology.orchestra.run.smithi151.stderr:31700000 of 50000000 tuples (63%) done (elapsed 431.60 s, remaining 249.16 s) 2023-07-21T22:26:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:48 smithi151 ceph-mon[95510]: pgmap v233: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 35 MiB/s wr, 99 op/s 2023-07-21T22:26:48.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:48 smithi187 ceph-mon[96918]: pgmap v233: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 35 MiB/s wr, 99 op/s 2023-07-21T22:26:48.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:48 smithi195 ceph-mon[97365]: pgmap v233: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 35 MiB/s wr, 99 op/s 2023-07-21T22:26:49.360 INFO:teuthology.orchestra.run.smithi151.stderr:31800000 of 50000000 tuples (63%) done (elapsed 432.85 s, remaining 247.73 s) 2023-07-21T22:26:50.679 INFO:teuthology.orchestra.run.smithi151.stderr:31900000 of 50000000 tuples (63%) done (elapsed 434.17 s, remaining 246.35 s) 2023-07-21T22:26:50.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:50 smithi151 ceph-mon[95510]: pgmap v234: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 60 op/s 2023-07-21T22:26:50.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:50 smithi187 ceph-mon[96918]: pgmap v234: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 60 op/s 2023-07-21T22:26:50.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:50 smithi195 ceph-mon[97365]: pgmap v234: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 60 op/s 2023-07-21T22:26:51.941 INFO:teuthology.orchestra.run.smithi151.stderr:32000000 of 50000000 tuples (64%) done (elapsed 435.43 s, remaining 244.93 s) 2023-07-21T22:26:52.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:52 smithi151 ceph-mon[95510]: pgmap v235: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 60 op/s 2023-07-21T22:26:52.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:52 smithi187 ceph-mon[96918]: pgmap v235: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 60 op/s 2023-07-21T22:26:52.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:52 smithi195 ceph-mon[97365]: pgmap v235: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 24 MiB/s wr, 60 op/s 2023-07-21T22:26:53.157 INFO:teuthology.orchestra.run.smithi151.stderr:32100000 of 50000000 tuples (64%) done (elapsed 436.65 s, remaining 243.49 s) 2023-07-21T22:26:54.383 INFO:teuthology.orchestra.run.smithi151.stderr:32200000 of 50000000 tuples (64%) done (elapsed 437.87 s, remaining 242.05 s) 2023-07-21T22:26:54.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:54 smithi151 ceph-mon[95510]: pgmap v236: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 MiB/s wr, 89 op/s 2023-07-21T22:26:54.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:54 smithi187 ceph-mon[96918]: pgmap v236: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 MiB/s wr, 89 op/s 2023-07-21T22:26:54.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:54 smithi195 ceph-mon[97365]: pgmap v236: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 36 MiB/s wr, 89 op/s 2023-07-21T22:26:55.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:55 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:55.731 INFO:teuthology.orchestra.run.smithi151.stderr:32300000 of 50000000 tuples (64%) done (elapsed 439.22 s, remaining 240.69 s) 2023-07-21T22:26:55.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:55 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:55.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:55 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:26:56.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:56 smithi151 ceph-mon[95510]: pgmap v237: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:26:56.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:56 smithi187 ceph-mon[96918]: pgmap v237: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:26:56.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:56 smithi195 ceph-mon[97365]: pgmap v237: 97 pgs: 97 active+clean; 7.3 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:26:56.970 INFO:teuthology.orchestra.run.smithi151.stderr:32400000 of 50000000 tuples (64%) done (elapsed 440.46 s, remaining 239.26 s) 2023-07-21T22:26:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.154+0000 7f4ee89ff700 1 -- 172.21.15.151:0/1830556267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee4105b10 msgr2=0x7f4ee4105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.154+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/1830556267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee4105b10 0x7f4ee4105ee0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4ed4009990 tx=0x7f4ed4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.154+0000 7f4ee89ff700 1 -- 172.21.15.151:0/1830556267 shutdown_connections 2023-07-21T22:26:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.154+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/1830556267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee41004b0 0x7f4ee410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.154+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/1830556267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee4105b10 0x7f4ee4105ee0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.154+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/1830556267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ee40ffb00 0x7f4ee40fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.154+0000 7f4ee89ff700 1 -- 172.21.15.151:0/1830556267 >> 172.21.15.151:0/1830556267 conn(0x7f4ee40fb600 msgr2=0x7f4ee40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.154+0000 7f4ee89ff700 1 -- 172.21.15.151:0/1830556267 shutdown_connections 2023-07-21T22:26:57.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.154+0000 7f4ee89ff700 1 -- 172.21.15.151:0/1830556267 wait complete. 2023-07-21T22:26:57.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.155+0000 7f4ee89ff700 1 Processor -- start 2023-07-21T22:26:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.155+0000 7f4ee89ff700 1 -- start start 2023-07-21T22:26:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee89ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee40ffb00 0x7f4ee4199b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee89ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee41004b0 0x7f4ee419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee89ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ee4105b10 0x7f4ee41938f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee89ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee41940c0 con 0x7f4ee40ffb00 2023-07-21T22:26:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee89ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee4194230 con 0x7f4ee41004b0 2023-07-21T22:26:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee89ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee41943f0 con 0x7f4ee4105b10 2023-07-21T22:26:57.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee40ffb00 0x7f4ee4199b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee40ffb00 0x7f4ee4199b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59850/0 (socket says 172.21.15.151:59850) 2023-07-21T22:26:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee259c700 1 -- 172.21.15.151:0/835457763 learned_addr learned my addr 172.21.15.151:0/835457763 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee2d9d700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ee4105b10 0x7f4ee41938f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.156+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee41004b0 0x7f4ee419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee2d9d700 1 -- 172.21.15.151:0/835457763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee41004b0 msgr2=0x7f4ee419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee2d9d700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee41004b0 0x7f4ee419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee2d9d700 1 -- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee40ffb00 msgr2=0x7f4ee4199b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee2d9d700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee40ffb00 0x7f4ee4199b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee2d9d700 1 -- 172.21.15.151:0/835457763 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ed40095f0 con 0x7f4ee4105b10 2023-07-21T22:26:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee259c700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee40ffb00 0x7f4ee4199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:26:57.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee41004b0 0x7f4ee419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:26:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee2d9d700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ee4105b10 0x7f4ee41938f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00efc0 tx=0x7f4edc00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ed37fe700 1 -- 172.21.15.151:0/835457763 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc018070 con 0x7f4ee4105b10 2023-07-21T22:26:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ed37fe700 1 -- 172.21.15.151:0/835457763 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4edc00f040 con 0x7f4ee4105b10 2023-07-21T22:26:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee89ff700 1 -- 172.21.15.151:0/835457763 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee4194670 con 0x7f4ee4105b10 2023-07-21T22:26:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ed37fe700 1 -- 172.21.15.151:0/835457763 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4edc00cc50 con 0x7f4ee4105b10 2023-07-21T22:26:57.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.157+0000 7f4ee89ff700 1 -- 172.21.15.151:0/835457763 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee41a0aa0 con 0x7f4ee4105b10 2023-07-21T22:26:57.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.161+0000 7f4ed37fe700 1 -- 172.21.15.151:0/835457763 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4edc003a00 con 0x7f4ee4105b10 2023-07-21T22:26:57.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.162+0000 7f4efc300b80 1 Processor -- start 2023-07-21T22:26:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.163+0000 7f4efc300b80 1 -- start start 2023-07-21T22:26:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.163+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 0x55d7be779cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.163+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a210 0x55d7be773f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.163+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a660 0x55d7be7744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.163+0000 7f4efc300b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be679c50 con 0x55d7be77a210 2023-07-21T22:26:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.163+0000 7f4efc300b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be6cc9e0 con 0x55d7be5d06b0 2023-07-21T22:26:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.163+0000 7f4efc300b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be6c5e70 con 0x55d7be77a660 2023-07-21T22:26:57.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.163+0000 7f4ed37fe700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ecc0a12c0 0x7f4ecc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.163+0000 7f4ed37fe700 1 -- 172.21.15.151:0/835457763 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4edc0cc820 con 0x7f4ee4105b10 2023-07-21T22:26:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a660 0x55d7be7744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee2d9d700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ecc0a12c0 0x7f4ecc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a660 0x55d7be7744a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37490/0 (socket says 172.21.15.151:37490) 2023-07-21T22:26:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/584815277 learned_addr learned my addr 172.21.15.151:0/584815277 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee259c700 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a210 0x55d7be773f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 0x55d7be779cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/584815277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 msgr2=0x55d7be779cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 0x55d7be779cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/584815277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a210 msgr2=0x55d7be773f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:57.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a210 0x55d7be773f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/584815277 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7be4f3d80 con 0x55d7be77a660 2023-07-21T22:26:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee259c700 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a210 0x55d7be773f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:26:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee2d9d700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ecc0a12c0 0x7f4ecc0a3770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0c9f90 tx=0x7f4edc009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.164+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a660 0x55d7be7744a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009c50 tx=0x7f4ed800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4bb7256c9b4aaca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.165+0000 7f4ed0ff9700 1 -- 172.21.15.151:0/584815277 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8014070 con 0x55d7be77a660 2023-07-21T22:26:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.165+0000 7f4ed0ff9700 1 -- 172.21.15.151:0/584815277 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ed800f4b0 con 0x55d7be77a660 2023-07-21T22:26:57.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.165+0000 7f4ed0ff9700 1 -- 172.21.15.151:0/584815277 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed800ed70 con 0x55d7be77a660 2023-07-21T22:26:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.166+0000 7f4efc300b80 1 -- 172.21.15.151:0/584815277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a660 msgr2=0x55d7be7744a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.166+0000 7f4efc300b80 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a660 0x55d7be7744a0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009c50 tx=0x7f4ed800fa00 comp rx=0 tx=0).stop 2023-07-21T22:26:57.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.166+0000 7f4efc300b80 1 -- 172.21.15.151:0/584815277 shutdown_connections 2023-07-21T22:26:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.166+0000 7f4efc300b80 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 0x55d7be779cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.166+0000 7f4efc300b80 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a660 0x55d7be7744a0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.166+0000 7f4efc300b80 1 --2- 172.21.15.151:0/584815277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a210 0x55d7be773f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.166+0000 7f4efc300b80 1 -- 172.21.15.151:0/584815277 >> 172.21.15.151:0/584815277 conn(0x55d7be769ae0 msgr2=0x55d7be76f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.166+0000 7f4efc300b80 1 -- 172.21.15.151:0/584815277 shutdown_connections 2023-07-21T22:26:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.166+0000 7f4efc300b80 1 -- 172.21.15.151:0/584815277 wait complete. 2023-07-21T22:26:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.167+0000 7f4efc300b80 1 -- start start 2023-07-21T22:26:57.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.167+0000 7f4efc300b80 1 Processor -- start 2023-07-21T22:26:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.167+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be7805d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.167+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be77a210 0x55d7be77d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.167+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a660 0x55d7be77df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.167+0000 7f4efc300b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be665a60 con 0x55d7be77a660 2023-07-21T22:26:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4efc300b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be665760 con 0x55d7be77a210 2023-07-21T22:26:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4efc300b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be5498c0 con 0x55d7be5d06b0 2023-07-21T22:26:57.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4efc300b80 10 client.0 _ll_register_callbacks cb 0x55d7be663700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be7805d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be7805d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37504/0 (socket says 172.21.15.151:37504) 2023-07-21T22:26:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/2103016612 learned_addr learned my addr 172.21.15.151:0/2103016612 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a660 0x55d7be77df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee259c700 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be77a210 0x55d7be77d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/2103016612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be77a210 msgr2=0x55d7be77d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be77a210 0x55d7be77d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/2103016612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a660 msgr2=0x55d7be77df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a660 0x55d7be77df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.168+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/2103016612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee410d240 con 0x55d7be5d06b0 2023-07-21T22:26:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.169+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be7805d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009340 tx=0x7f4ed800fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=768befc460269e25 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.169+0000 7f4ec9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:26:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.169+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/2103016612 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8014040 con 0x55d7be5d06b0 2023-07-21T22:26:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.169+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/2103016612 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4ed8000e40 con 0x55d7be5d06b0 2023-07-21T22:26:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.169+0000 7f4efc300b80 1 -- 172.21.15.151:0/2103016612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d7be61f490 con 0x55d7be5d06b0 2023-07-21T22:26:57.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.169+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/2103016612 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ed800ee50 con 0x55d7be5d06b0 2023-07-21T22:26:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.169+0000 7f4efc300b80 10 client.26671 fetch_fsmap learned FSMap version 41 2023-07-21T22:26:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.169+0000 7f4efc300b80 1 -- 172.21.15.151:0/2103016612 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f4ed8009900 con 0x55d7be5d06b0 2023-07-21T22:26:57.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.169+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/2103016612 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d7be61f490 con 0x55d7be5d06b0 2023-07-21T22:26:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.170+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/2103016612 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4ed8004750 con 0x55d7be5d06b0 2023-07-21T22:26:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.170+0000 7f4efc300b80 10 client.26671 fetch_fsmap finished waiting for FSMap version 41 2023-07-21T22:26:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.170+0000 7f4efc300b80 10 client.26671 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:57.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.170+0000 7f4efc300b80 20 client.26671 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.170+0000 7f4efc300b80 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d7be78d970 0x55d7be78fd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.170+0000 7f4efc300b80 4 client.26671 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:26:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.170+0000 7f4efc300b80 1 -- 172.21.15.151:0/2103016612 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d7be6bee50 con 0x55d7be78d970 2023-07-21T22:26:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.170+0000 7f4ee259c700 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d7be78d970 0x55d7be78fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.171+0000 7f4ec9ffb700 10 client.26671 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.171+0000 7f4ee259c700 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d7be78d970 0x55d7be78fd80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b43b06904d716f8 server_cookie=c9f3902b03310d12 in_seq=0 out_seq=0 2023-07-21T22:26:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/2103016612 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d7be6bee50 con 0x55d7be78d970 2023-07-21T22:26:57.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4ec9ffb700 10 client.26671 handle_command_reply: tid=0 2023-07-21T22:26:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 client.26671 shutdown 2023-07-21T22:26:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 -- 172.21.15.151:0/2103016612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 msgr2=0x55d7be7805d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be7805d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009340 tx=0x7f4ed800fa00 comp rx=0 tx=0).stop 2023-07-21T22:26:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 -- 172.21.15.151:0/2103016612 shutdown_connections 2023-07-21T22:26:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d7be78d970 0x55d7be78fd80 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be77a660 0x55d7be77df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be7805d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4ec9ffb700 0 client.26671 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 --2- 172.21.15.151:0/2103016612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be77a210 0x55d7be77d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 -- 172.21.15.151:0/2103016612 >> 172.21.15.151:0/2103016612 conn(0x55d7be769ae0 msgr2=0x55d7be76e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 -- 172.21.15.151:0/2103016612 shutdown_connections 2023-07-21T22:26:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.172+0000 7f4efc300b80 1 -- 172.21.15.151:0/2103016612 wait complete. 2023-07-21T22:26:57.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.173+0000 7f4efc300b80 20 client.26671 trim_cache size 0 max 16384 2023-07-21T22:26:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.191+0000 7f4efc300b80 1 Processor -- start 2023-07-21T22:26:57.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4efc300b80 1 -- start start 2023-07-21T22:26:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be7791c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be773f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be77a210 0x55d7be774480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4efc300b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be61f490 con 0x55d7be769ae0 2023-07-21T22:26:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4efc300b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be774cd0 con 0x55d7be77a210 2023-07-21T22:26:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4efc300b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be766b20 con 0x55d7be5d06b0 2023-07-21T22:26:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be7791c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4ee1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be7791c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59878/0 (socket says 172.21.15.151:59878) 2023-07-21T22:26:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/768127735 learned_addr learned my addr 172.21.15.151:0/768127735 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:57.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.192+0000 7f4ee259c700 1 --2- 172.21.15.151:0/768127735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be773f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.193+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/768127735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 msgr2=0x55d7be773f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.193+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/768127735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be773f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.193+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/768127735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be77a210 msgr2=0x55d7be774480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.193+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/768127735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be77a210 0x55d7be774480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.193+0000 7f4ee1d9b700 1 -- 172.21.15.151:0/768127735 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d7be77d3c0 con 0x55d7be769ae0 2023-07-21T22:26:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.193+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/768127735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be7791c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009470 tx=0x7f4ed8009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c30b273116e49d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.193+0000 7f4ed17fa700 1 -- 172.21.15.151:0/768127735 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed8014040 con 0x55d7be769ae0 2023-07-21T22:26:57.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.193+0000 7f4ed17fa700 1 -- 172.21.15.151:0/768127735 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ed800ee50 con 0x55d7be769ae0 2023-07-21T22:26:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.193+0000 7f4ed17fa700 1 -- 172.21.15.151:0/768127735 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed80053d0 con 0x55d7be769ae0 2023-07-21T22:26:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.194+0000 7f4efc300b80 1 -- 172.21.15.151:0/768127735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 msgr2=0x55d7be7791c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.194+0000 7f4efc300b80 1 --2- 172.21.15.151:0/768127735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be7791c0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8009470 tx=0x7f4ed8009750 comp rx=0 tx=0).stop 2023-07-21T22:26:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.194+0000 7f4efc300b80 1 -- 172.21.15.151:0/768127735 shutdown_connections 2023-07-21T22:26:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.194+0000 7f4efc300b80 1 --2- 172.21.15.151:0/768127735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be77a210 0x55d7be774480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.194+0000 7f4efc300b80 1 --2- 172.21.15.151:0/768127735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be7791c0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.194+0000 7f4efc300b80 1 --2- 172.21.15.151:0/768127735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be5d06b0 0x55d7be773f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.194+0000 7f4efc300b80 1 -- 172.21.15.151:0/768127735 >> 172.21.15.151:0/768127735 conn(0x55d7be78a140 msgr2=0x55d7be77bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.194+0000 7f4efc300b80 1 -- 172.21.15.151:0/768127735 shutdown_connections 2023-07-21T22:26:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.194+0000 7f4efc300b80 1 -- 172.21.15.151:0/768127735 wait complete. 2023-07-21T22:26:57.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.195+0000 7f4efc300b80 1 -- start start 2023-07-21T22:26:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.195+0000 7f4efc300b80 1 Processor -- start 2023-07-21T22:26:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.195+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 0x55d7be7812f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.195+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be781830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.195+0000 7f4efc300b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a210 0x55d7be7da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.195+0000 7f4efc300b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be7dad60 con 0x55d7be769ae0 2023-07-21T22:26:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.195+0000 7f4efc300b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be7daed0 con 0x55d7be5d06b0 2023-07-21T22:26:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.195+0000 7f4efc300b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d7be7db090 con 0x55d7be77a210 2023-07-21T22:26:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4efc300b80 10 client.0 _ll_register_callbacks cb 0x7f4ed800ff50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:26:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be781830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be781830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59882/0 (socket says 172.21.15.151:59882) 2023-07-21T22:26:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee259c700 1 -- 172.21.15.151:0/4109402148 learned_addr learned my addr 172.21.15.151:0/4109402148 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:26:57.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a210 0x55d7be7da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 0x55d7be7812f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee259c700 1 -- 172.21.15.151:0/4109402148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a210 msgr2=0x55d7be7da7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee259c700 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a210 0x55d7be7da7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee259c700 1 -- 172.21.15.151:0/4109402148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 msgr2=0x55d7be7812f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:26:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee259c700 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 0x55d7be7812f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee259c700 1 -- 172.21.15.151:0/4109402148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ed8009900 con 0x55d7be769ae0 2023-07-21T22:26:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.196+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 0x55d7be7812f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:26:57.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.197+0000 7f4ee259c700 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be781830 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x55d7be77ee90 tx=0x7f4ed40050b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c45135344de1f0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:26:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.197+0000 7f4ec9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:26:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.197+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/4109402148 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ed401d040 con 0x55d7be769ae0 2023-07-21T22:26:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.197+0000 7f4efc300b80 1 -- 172.21.15.151:0/4109402148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4ed800f4b0 con 0x55d7be769ae0 2023-07-21T22:26:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.197+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/4109402148 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4ed4029e10 con 0x55d7be769ae0 2023-07-21T22:26:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.197+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/4109402148 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4ed40054d0 con 0x55d7be769ae0 2023-07-21T22:26:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.197+0000 7f4efc300b80 10 client.16932 fetch_fsmap learned FSMap version 41 2023-07-21T22:26:57.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.197+0000 7f4efc300b80 1 -- 172.21.15.151:0/4109402148 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55d7be4dcc00 con 0x55d7be769ae0 2023-07-21T22:26:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.197+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/4109402148 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4ed800f4b0 con 0x55d7be769ae0 2023-07-21T22:26:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.198+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/4109402148 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4ed402f020 con 0x55d7be769ae0 2023-07-21T22:26:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.198+0000 7f4efc300b80 10 client.16932 fetch_fsmap finished waiting for FSMap version 41 2023-07-21T22:26:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.198+0000 7f4efc300b80 10 client.16932 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:26:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.198+0000 7f4efc300b80 20 client.16932 populate_metadata read hostname 'smithi151' 2023-07-21T22:26:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.198+0000 7f4efc300b80 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d7be77a660 0x55d7be7e4780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:26:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.198+0000 7f4efc300b80 4 client.16932 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:26:57.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.198+0000 7f4efc300b80 1 -- 172.21.15.151:0/4109402148 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d7be680ff0 con 0x55d7be77a660 2023-07-21T22:26:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.198+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d7be77a660 0x55d7be7e4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:26:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.199+0000 7f4ec9ffb700 10 client.16932 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:57.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.199+0000 7f4ee1d9b700 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d7be77a660 0x55d7be7e4780 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65b61be016e95f53 server_cookie=ff3defbb799816a6 in_seq=0 out_seq=0 2023-07-21T22:26:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4ec9ffb700 1 -- 172.21.15.151:0/4109402148 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d7be680ff0 con 0x55d7be77a660 2023-07-21T22:26:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4ec9ffb700 10 client.16932 handle_command_reply: tid=0 2023-07-21T22:26:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 client.16932 shutdown 2023-07-21T22:26:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 -- 172.21.15.151:0/4109402148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 msgr2=0x55d7be781830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:57.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be781830 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x55d7be77ee90 tx=0x7f4ed40050b0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 -- 172.21.15.151:0/4109402148 shutdown_connections 2023-07-21T22:26:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d7be77a660 0x55d7be7e4780 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d7be5d06b0 0x55d7be7812f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d7be77a210 0x55d7be7da7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 --2- 172.21.15.151:0/4109402148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d7be769ae0 0x55d7be781830 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 -- 172.21.15.151:0/4109402148 >> 172.21.15.151:0/4109402148 conn(0x55d7be78a140 msgr2=0x55d7be77c660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:57.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4ec9ffb700 0 client.16932 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:26:57.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 -- 172.21.15.151:0/4109402148 shutdown_connections 2023-07-21T22:26:57.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.212+0000 7f4efc300b80 1 -- 172.21.15.151:0/4109402148 wait complete. 2023-07-21T22:26:57.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4efc300b80 20 client.16932 trim_cache size 0 max 16384 2023-07-21T22:26:57.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:26:57.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:26:57.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:26:57.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:26:57.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 -- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ecc0a12c0 msgr2=0x7f4ecc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:57.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ecc0a12c0 0x7f4ecc0a3770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0c9f90 tx=0x7f4edc009040 comp rx=0 tx=0).stop 2023-07-21T22:26:57.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 -- 172.21.15.151:0/835457763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ee4105b10 msgr2=0x7f4ee41938f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:26:57.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ee4105b10 0x7f4ee41938f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f4edc00efc0 tx=0x7f4edc00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 -- 172.21.15.151:0/835457763 shutdown_connections 2023-07-21T22:26:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4ecc0a12c0 0x7f4ecc0a3770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4ee4105b10 0x7f4ee41938f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ee40ffb00 0x7f4ee4199b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 --2- 172.21.15.151:0/835457763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ee41004b0 0x7f4ee419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:26:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.213+0000 7f4ee89ff700 1 -- 172.21.15.151:0/835457763 >> 172.21.15.151:0/835457763 conn(0x7f4ee40fb600 msgr2=0x7f4ee40fc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:26:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.214+0000 7f4ee89ff700 1 -- 172.21.15.151:0/835457763 shutdown_connections 2023-07-21T22:26:57.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:26:57.214+0000 7f4ee89ff700 1 -- 172.21.15.151:0/835457763 wait complete. 2023-07-21T22:26:58.203 INFO:teuthology.orchestra.run.smithi151.stderr:32500000 of 50000000 tuples (65%) done (elapsed 441.69 s, remaining 237.84 s) 2023-07-21T22:26:58.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:26:58 smithi151 ceph-mon[95510]: pgmap v238: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 MiB/s wr, 91 op/s 2023-07-21T22:26:58.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:26:58 smithi187 ceph-mon[96918]: pgmap v238: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 MiB/s wr, 91 op/s 2023-07-21T22:26:58.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:26:58 smithi195 ceph-mon[97365]: pgmap v238: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 36 MiB/s wr, 91 op/s 2023-07-21T22:26:59.414 INFO:teuthology.orchestra.run.smithi151.stderr:32600000 of 50000000 tuples (65%) done (elapsed 442.91 s, remaining 236.40 s) 2023-07-21T22:27:00.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:00 smithi151 ceph-mon[95510]: pgmap v239: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:00.713 INFO:teuthology.orchestra.run.smithi151.stderr:32700000 of 50000000 tuples (65%) done (elapsed 444.20 s, remaining 235.01 s) 2023-07-21T22:27:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:00 smithi187 ceph-mon[96918]: pgmap v239: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:00.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:00 smithi195 ceph-mon[97365]: pgmap v239: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:01.978 INFO:teuthology.orchestra.run.smithi151.stderr:32800000 of 50000000 tuples (65%) done (elapsed 445.47 s, remaining 233.60 s) 2023-07-21T22:27:02.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:02 smithi187 ceph-mon[96918]: pgmap v240: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:02.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:02 smithi195 ceph-mon[97365]: pgmap v240: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:02.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:02 smithi151 ceph-mon[95510]: pgmap v240: 97 pgs: 97 active+clean; 7.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:03.204 INFO:teuthology.orchestra.run.smithi151.stderr:32900000 of 50000000 tuples (65%) done (elapsed 446.70 s, remaining 232.17 s) 2023-07-21T22:27:04.583 INFO:teuthology.orchestra.run.smithi151.stderr:33000000 of 50000000 tuples (66%) done (elapsed 448.07 s, remaining 230.83 s) 2023-07-21T22:27:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:04 smithi187 ceph-mon[96918]: pgmap v241: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 84 op/s 2023-07-21T22:27:04.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:04 smithi195 ceph-mon[97365]: pgmap v241: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 84 op/s 2023-07-21T22:27:04.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:04 smithi151 ceph-mon[95510]: pgmap v241: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 36 MiB/s wr, 84 op/s 2023-07-21T22:27:05.825 INFO:teuthology.orchestra.run.smithi151.stderr:33100000 of 50000000 tuples (66%) done (elapsed 449.32 s, remaining 229.41 s) 2023-07-21T22:27:05.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:05 smithi187 ceph-mon[96918]: osdmap e91: 12 total, 12 up, 12 in 2023-07-21T22:27:05.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:05 smithi195 ceph-mon[97365]: osdmap e91: 12 total, 12 up, 12 in 2023-07-21T22:27:05.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:05 smithi151 ceph-mon[95510]: osdmap e91: 12 total, 12 up, 12 in 2023-07-21T22:27:06.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:06 smithi187 ceph-mon[96918]: pgmap v243: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 28 MiB/s wr, 67 op/s 2023-07-21T22:27:06.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:06 smithi195 ceph-mon[97365]: pgmap v243: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 28 MiB/s wr, 67 op/s 2023-07-21T22:27:06.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:06 smithi151 ceph-mon[95510]: pgmap v243: 97 pgs: 97 active+clean; 7.5 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 28 MiB/s wr, 67 op/s 2023-07-21T22:27:07.086 INFO:teuthology.orchestra.run.smithi151.stderr:33200000 of 50000000 tuples (66%) done (elapsed 450.58 s, remaining 228.00 s) 2023-07-21T22:27:08.440 INFO:teuthology.orchestra.run.smithi151.stderr:33300000 of 50000000 tuples (66%) done (elapsed 451.93 s, remaining 226.64 s) 2023-07-21T22:27:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:08 smithi187 ceph-mon[96918]: pgmap v244: 97 pgs: 97 active+clean; 7.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 28 MiB/s wr, 64 op/s 2023-07-21T22:27:08.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:08 smithi195 ceph-mon[97365]: pgmap v244: 97 pgs: 97 active+clean; 7.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 28 MiB/s wr, 64 op/s 2023-07-21T22:27:08.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:08 smithi151 ceph-mon[95510]: pgmap v244: 97 pgs: 97 active+clean; 7.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 28 MiB/s wr, 64 op/s 2023-07-21T22:27:09.699 INFO:teuthology.orchestra.run.smithi151.stderr:33400000 of 50000000 tuples (66%) done (elapsed 453.19 s, remaining 225.24 s) 2023-07-21T22:27:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.382+0000 7f11d0fff700 1 -- 172.21.15.151:0/2624356070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11cc072850 msgr2=0x7f11cc072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.382+0000 7f11d0fff700 1 --2- 172.21.15.151:0/2624356070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11cc072850 0x7f11cc072c20 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00b0a0 tx=0x7f11bc00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.382+0000 7f11d0fff700 1 -- 172.21.15.151:0/2624356070 shutdown_connections 2023-07-21T22:27:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.382+0000 7f11d0fff700 1 --2- 172.21.15.151:0/2624356070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc10c3f0 0x7f11cc10e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.382+0000 7f11d0fff700 1 --2- 172.21.15.151:0/2624356070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11cc072850 0x7f11cc072c20 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.382+0000 7f11d0fff700 1 --2- 172.21.15.151:0/2624356070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11cc073160 0x7f11cc10beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.382+0000 7f11d0fff700 1 -- 172.21.15.151:0/2624356070 >> 172.21.15.151:0/2624356070 conn(0x7f11cc0fb650 msgr2=0x7f11cc0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:10.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.383+0000 7f11d0fff700 1 -- 172.21.15.151:0/2624356070 shutdown_connections 2023-07-21T22:27:10.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.383+0000 7f11d0fff700 1 -- 172.21.15.151:0/2624356070 wait complete. 2023-07-21T22:27:10.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.384+0000 7f11d0fff700 1 Processor -- start 2023-07-21T22:27:10.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.384+0000 7f11d0fff700 1 -- start start 2023-07-21T22:27:10.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.384+0000 7f11d0fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc072850 0x7f11cc197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.384+0000 7f11d0fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11cc073160 0x7f11cc198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.384+0000 7f11d0fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11cc10c3f0 0x7f11cc19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.384+0000 7f11d0fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc19d0f0 con 0x7f11cc10c3f0 2023-07-21T22:27:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.384+0000 7f11d0fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc19d260 con 0x7f11cc073160 2023-07-21T22:27:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.384+0000 7f11d0fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11cc19d420 con 0x7f11cc072850 2023-07-21T22:27:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11ca59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc072850 0x7f11cc197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11cad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11cc10c3f0 0x7f11cc19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11c3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11cc073160 0x7f11cc198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11ca59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc072850 0x7f11cc197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46766/0 (socket says 172.21.15.151:46766) 2023-07-21T22:27:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11ca59c700 1 -- 172.21.15.151:0/1202644981 learned_addr learned my addr 172.21.15.151:0/1202644981 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11cad9d700 1 -- 172.21.15.151:0/1202644981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc072850 msgr2=0x7f11cc197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11cad9d700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc072850 0x7f11cc197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11cad9d700 1 -- 172.21.15.151:0/1202644981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11cc073160 msgr2=0x7f11cc198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11cad9d700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11cc073160 0x7f11cc198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11cad9d700 1 -- 172.21.15.151:0/1202644981 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11bc009d00 con 0x7f11cc10c3f0 2023-07-21T22:27:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11ca59c700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc072850 0x7f11cc197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:27:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.385+0000 7f11c3fff700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11cc073160 0x7f11cc198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:27:10.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.386+0000 7f11cad9d700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11cc10c3f0 0x7f11cc19cab0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f11cc074920 tx=0x7f11c400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.386+0000 7f11c37fe700 1 -- 172.21.15.151:0/1202644981 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4011620 con 0x7f11cc10c3f0 2023-07-21T22:27:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.386+0000 7f11c37fe700 1 -- 172.21.15.151:0/1202644981 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11c4011c10 con 0x7f11cc10c3f0 2023-07-21T22:27:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.386+0000 7f11d0fff700 1 -- 172.21.15.151:0/1202644981 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11cc19d700 con 0x7f11cc10c3f0 2023-07-21T22:27:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.386+0000 7f11c37fe700 1 -- 172.21.15.151:0/1202644981 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4010bb0 con 0x7f11cc10c3f0 2023-07-21T22:27:10.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.386+0000 7f11d0fff700 1 -- 172.21.15.151:0/1202644981 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc1a4f40 con 0x7f11cc10c3f0 2023-07-21T22:27:10.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.389+0000 7f11c37fe700 1 -- 172.21.15.151:0/1202644981 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f11c4010d50 con 0x7f11cc10c3f0 2023-07-21T22:27:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.391+0000 7f11c37fe700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11b80a12c0 0x7f11b80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.391+0000 7f11e49bab80 1 Processor -- start 2023-07-21T22:27:10.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.391+0000 7f11c37fe700 1 -- 172.21.15.151:0/1202644981 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f11c40cc5c0 con 0x7f11cc10c3f0 2023-07-21T22:27:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.391+0000 7f11e49bab80 1 -- start start 2023-07-21T22:27:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.391+0000 7f11ca59c700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11b80a12c0 0x7f11b80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 0x55aadcd87cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd824a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11e49bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcc87c50 con 0x55aadcd88210 2023-07-21T22:27:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11e49bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadccda9e0 con 0x55aadcbde6b0 2023-07-21T22:27:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11e49bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadccd3e70 con 0x55aadcd88660 2023-07-21T22:27:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11cad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd824a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11ca59c700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11b80a12c0 0x7f11b80a3770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00b830 tx=0x7f11bc006210 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50738/0 (socket says 172.21.15.151:50738) 2023-07-21T22:27:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11ca59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 0x55aadcd87cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11c3fff700 1 -- 172.21.15.151:0/2547711430 learned_addr learned my addr 172.21.15.151:0/2547711430 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:10.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.392+0000 7f11cad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd824a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46770/0 (socket says 172.21.15.151:46770) 2023-07-21T22:27:10.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.393+0000 7f11cad9d700 1 -- 172.21.15.151:0/2547711430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 msgr2=0x55aadcd87cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:10.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.393+0000 7f11cad9d700 1 --2- 172.21.15.151:0/2547711430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 0x55aadcd87cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.393+0000 7f11cad9d700 1 -- 172.21.15.151:0/2547711430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 msgr2=0x55aadcd81f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.393+0000 7f11cad9d700 1 --2- 172.21.15.151:0/2547711430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.393+0000 7f11cad9d700 1 -- 172.21.15.151:0/2547711430 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aadcb01d80 con 0x55aadcd88660 2023-07-21T22:27:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.393+0000 7f11cad9d700 1 --2- 172.21.15.151:0/2547711430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd824a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f11c40c9db0 tx=0x7f11c4095470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9863ef2c30495039 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.393+0000 7f11c0ff9700 1 -- 172.21.15.151:0/2547711430 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4099730 con 0x55aadcd88660 2023-07-21T22:27:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.393+0000 7f11c0ff9700 1 -- 172.21.15.151:0/2547711430 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11c409d760 con 0x55aadcd88660 2023-07-21T22:27:10.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.393+0000 7f11c0ff9700 1 -- 172.21.15.151:0/2547711430 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11c4001d00 con 0x55aadcd88660 2023-07-21T22:27:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.394+0000 7f11e49bab80 1 -- 172.21.15.151:0/2547711430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 msgr2=0x55aadcd824a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.394+0000 7f11e49bab80 1 --2- 172.21.15.151:0/2547711430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd824a0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f11c40c9db0 tx=0x7f11c4095470 comp rx=0 tx=0).stop 2023-07-21T22:27:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.394+0000 7f11e49bab80 1 -- 172.21.15.151:0/2547711430 shutdown_connections 2023-07-21T22:27:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.394+0000 7f11e49bab80 1 --2- 172.21.15.151:0/2547711430 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 0x55aadcd87cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.394+0000 7f11e49bab80 1 --2- 172.21.15.151:0/2547711430 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd824a0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.394+0000 7f11e49bab80 1 --2- 172.21.15.151:0/2547711430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.394+0000 7f11e49bab80 1 -- 172.21.15.151:0/2547711430 >> 172.21.15.151:0/2547711430 conn(0x55aadcd77ae0 msgr2=0x55aadcd7d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.394+0000 7f11e49bab80 1 -- 172.21.15.151:0/2547711430 shutdown_connections 2023-07-21T22:27:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.394+0000 7f11e49bab80 1 -- 172.21.15.151:0/2547711430 wait complete. 2023-07-21T22:27:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.395+0000 7f11e49bab80 1 -- start start 2023-07-21T22:27:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.395+0000 7f11e49bab80 1 Processor -- start 2023-07-21T22:27:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.395+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd91540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.395+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88210 0x55aadcd91a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.395+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88660 0x55aadcd8b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.395+0000 7f11e49bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcc73a60 con 0x55aadcbde6b0 2023-07-21T22:27:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.395+0000 7f11e49bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcc73760 con 0x55aadcd88660 2023-07-21T22:27:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.395+0000 7f11e49bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcb578c0 con 0x55aadcd88210 2023-07-21T22:27:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.395+0000 7f11e49bab80 10 client.0 _ll_register_callbacks cb 0x55aadcc71700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:27:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11ca59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd91540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11ca59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd91540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50750/0 (socket says 172.21.15.151:50750) 2023-07-21T22:27:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11ca59c700 1 -- 172.21.15.151:0/1365545314 learned_addr learned my addr 172.21.15.151:0/1365545314 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11cad9d700 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88660 0x55aadcd8b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11c3fff700 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88210 0x55aadcd91a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11ca59c700 1 -- 172.21.15.151:0/1365545314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88210 msgr2=0x55aadcd91a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11ca59c700 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88210 0x55aadcd91a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11ca59c700 1 -- 172.21.15.151:0/1365545314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88660 msgr2=0x55aadcd8b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11ca59c700 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88660 0x55aadcd8b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11ca59c700 1 -- 172.21.15.151:0/1365545314 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11cc1a4f40 con 0x55aadcbde6b0 2023-07-21T22:27:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11ca59c700 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd91540 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f11bc01c6c0 tx=0x7f11bc0099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0b1bd2567435b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.396+0000 7f11b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:27:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.397+0000 7f11b1ffb700 1 -- 172.21.15.151:0/1365545314 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11bc00e040 con 0x55aadcbde6b0 2023-07-21T22:27:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.397+0000 7f11e49bab80 1 -- 172.21.15.151:0/1365545314 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aadcc2d490 con 0x55aadcbde6b0 2023-07-21T22:27:10.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.397+0000 7f11b1ffb700 1 -- 172.21.15.151:0/1365545314 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f11bc024040 con 0x55aadcbde6b0 2023-07-21T22:27:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.397+0000 7f11b1ffb700 1 -- 172.21.15.151:0/1365545314 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11bc01ce60 con 0x55aadcbde6b0 2023-07-21T22:27:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.397+0000 7f11e49bab80 10 client.16944 fetch_fsmap learned FSMap version 41 2023-07-21T22:27:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.397+0000 7f11e49bab80 1 -- 172.21.15.151:0/1365545314 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55aadcaeac00 con 0x55aadcbde6b0 2023-07-21T22:27:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.397+0000 7f11b1ffb700 1 -- 172.21.15.151:0/1365545314 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aadcc2d490 con 0x55aadcbde6b0 2023-07-21T22:27:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.398+0000 7f11b1ffb700 1 -- 172.21.15.151:0/1365545314 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f11bc02a890 con 0x55aadcbde6b0 2023-07-21T22:27:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.398+0000 7f11e49bab80 10 client.16944 fetch_fsmap finished waiting for FSMap version 41 2023-07-21T22:27:10.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.398+0000 7f11e49bab80 10 client.16944 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:27:10.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.398+0000 7f11e49bab80 20 client.16944 populate_metadata read hostname 'smithi151' 2023-07-21T22:27:10.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.398+0000 7f11e49bab80 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aadcd9ba80 0x55aadcd9de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.398+0000 7f11e49bab80 4 client.16944 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:27:10.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.398+0000 7f11e49bab80 1 -- 172.21.15.151:0/1365545314 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aadcccce50 con 0x55aadcd9ba80 2023-07-21T22:27:10.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.398+0000 7f11c3fff700 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aadcd9ba80 0x55aadcd9de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.399+0000 7f11c3fff700 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aadcd9ba80 0x55aadcd9de90 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9f39182c3e092bd server_cookie=fc699d9c823279c9 in_seq=0 out_seq=0 2023-07-21T22:27:10.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.399+0000 7f11b1ffb700 10 client.16944 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:10.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.399+0000 7f11b1ffb700 1 -- 172.21.15.151:0/1365545314 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55aadcccce50 con 0x55aadcd9ba80 2023-07-21T22:27:10.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.399+0000 7f11b1ffb700 10 client.16944 handle_command_reply: tid=0 2023-07-21T22:27:10.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 client.16944 shutdown 2023-07-21T22:27:10.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 -- 172.21.15.151:0/1365545314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 msgr2=0x55aadcd91540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:10.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd91540 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f11bc01c6c0 tx=0x7f11bc0099e0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 -- 172.21.15.151:0/1365545314 shutdown_connections 2023-07-21T22:27:10.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aadcd9ba80 0x55aadcd9de90 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88660 0x55aadcd8b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11b1ffb700 0 client.16944 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd91540 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 --2- 172.21.15.151:0/1365545314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88210 0x55aadcd91a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 -- 172.21.15.151:0/1365545314 >> 172.21.15.151:0/1365545314 conn(0x55aadcd77ae0 msgr2=0x55aadcd7c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 -- 172.21.15.151:0/1365545314 shutdown_connections 2023-07-21T22:27:10.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 1 -- 172.21.15.151:0/1365545314 wait complete. 2023-07-21T22:27:10.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.400+0000 7f11e49bab80 20 client.16944 trim_cache size 0 max 16384 2023-07-21T22:27:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.418+0000 7f11e49bab80 1 Processor -- start 2023-07-21T22:27:10.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.418+0000 7f11e49bab80 1 -- start start 2023-07-21T22:27:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.418+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd871b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.418+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.418+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd7cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.418+0000 7f11e49bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcd7de50 con 0x55aadcbde6b0 2023-07-21T22:27:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.418+0000 7f11e49bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcd89da0 con 0x55aadcd88210 2023-07-21T22:27:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.418+0000 7f11e49bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcd878d0 con 0x55aadcd88660 2023-07-21T22:27:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11ca59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11c3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11ca59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd871b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50760/0 (socket says 172.21.15.151:50760) 2023-07-21T22:27:10.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11ca59c700 1 -- 172.21.15.151:0/4263607320 learned_addr learned my addr 172.21.15.151:0/4263607320 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11cad9d700 1 --2- 172.21.15.151:0/4263607320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd7cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11c3fff700 1 -- 172.21.15.151:0/4263607320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 msgr2=0x55aadcd7cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11c3fff700 1 --2- 172.21.15.151:0/4263607320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd7cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11c3fff700 1 -- 172.21.15.151:0/4263607320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 msgr2=0x55aadcd871b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11c3fff700 1 --2- 172.21.15.151:0/4263607320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd871b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11c3fff700 1 -- 172.21.15.151:0/4263607320 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aadcda2a80 con 0x55aadcd88210 2023-07-21T22:27:10.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.419+0000 7f11c3fff700 1 --2- 172.21.15.151:0/4263607320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55aadcd9e700 tx=0x7f11b4004860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4939bcb3b66f1be server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.420+0000 7f11c17fa700 1 -- 172.21.15.151:0/4263607320 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b401b040 con 0x55aadcd88210 2023-07-21T22:27:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.420+0000 7f11c17fa700 1 -- 172.21.15.151:0/4263607320 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11b401e3f0 con 0x55aadcd88210 2023-07-21T22:27:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.420+0000 7f11c17fa700 1 -- 172.21.15.151:0/4263607320 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b4026400 con 0x55aadcd88210 2023-07-21T22:27:10.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.420+0000 7f11e49bab80 1 -- 172.21.15.151:0/4263607320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88210 msgr2=0x55aadcd81f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.420+0000 7f11e49bab80 1 --2- 172.21.15.151:0/4263607320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x55aadcd9e700 tx=0x7f11b4004860 comp rx=0 tx=0).stop 2023-07-21T22:27:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.421+0000 7f11e49bab80 1 -- 172.21.15.151:0/4263607320 shutdown_connections 2023-07-21T22:27:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.421+0000 7f11e49bab80 1 --2- 172.21.15.151:0/4263607320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd7cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.421+0000 7f11e49bab80 1 --2- 172.21.15.151:0/4263607320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcbde6b0 0x55aadcd871b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.421+0000 7f11e49bab80 1 --2- 172.21.15.151:0/4263607320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcd88210 0x55aadcd81f40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.421+0000 7f11e49bab80 1 -- 172.21.15.151:0/4263607320 >> 172.21.15.151:0/4263607320 conn(0x55aadcd77ae0 msgr2=0x55aadcd8b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:10.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.421+0000 7f11e49bab80 1 -- 172.21.15.151:0/4263607320 shutdown_connections 2023-07-21T22:27:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.421+0000 7f11e49bab80 1 -- 172.21.15.151:0/4263607320 wait complete. 2023-07-21T22:27:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.421+0000 7f11e49bab80 1 -- start start 2023-07-21T22:27:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.421+0000 7f11e49bab80 1 Processor -- start 2023-07-21T22:27:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.422+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 0x55aadcd91110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.422+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd91650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.422+0000 7f11e49bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd8f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.422+0000 7f11e49bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcd8fd80 con 0x55aadcd88210 2023-07-21T22:27:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.422+0000 7f11e49bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcd8fef0 con 0x55aadcbde6b0 2023-07-21T22:27:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.422+0000 7f11e49bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aadcd900b0 con 0x55aadcd88660 2023-07-21T22:27:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.422+0000 7f11e49bab80 10 client.0 _ll_register_callbacks cb 0x7f11bc003d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:27:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd91650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd91650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50762/0 (socket says 172.21.15.151:50762) 2023-07-21T22:27:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11c3fff700 1 -- 172.21.15.151:0/875362235 learned_addr learned my addr 172.21.15.151:0/875362235 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:10.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11cad9d700 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd8f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11ca59c700 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 0x55aadcd91110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11c3fff700 1 -- 172.21.15.151:0/875362235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 msgr2=0x55aadcd8f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11c3fff700 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd8f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11c3fff700 1 -- 172.21.15.151:0/875362235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 msgr2=0x55aadcd91110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11c3fff700 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 0x55aadcd91110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11c3fff700 1 -- 172.21.15.151:0/875362235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b4009ca0 con 0x55aadcd88210 2023-07-21T22:27:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11c3fff700 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd91650 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f11b4004790 tx=0x7f11b4015d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb22ae37b73085de server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:10.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.423+0000 7f11b1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:27:10.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11b1ffb700 1 -- 172.21.15.151:0/875362235 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b401b040 con 0x55aadcd88210 2023-07-21T22:27:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11e49bab80 1 -- 172.21.15.151:0/875362235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f11c409d760 con 0x55aadcd88210 2023-07-21T22:27:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11b1ffb700 1 -- 172.21.15.151:0/875362235 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(91..91 src has 1..91) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f11b401e870 con 0x55aadcd88210 2023-07-21T22:27:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11b1ffb700 1 -- 172.21.15.151:0/875362235 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f11b4005e60 con 0x55aadcd88210 2023-07-21T22:27:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11e49bab80 10 client.16950 fetch_fsmap learned FSMap version 41 2023-07-21T22:27:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11e49bab80 1 -- 172.21.15.151:0/875362235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55aadcb281f0 con 0x55aadcd88210 2023-07-21T22:27:10.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11b1ffb700 1 -- 172.21.15.151:0/875362235 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f11c409d760 con 0x55aadcd88210 2023-07-21T22:27:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11b1ffb700 1 -- 172.21.15.151:0/875362235 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f11b402d020 con 0x55aadcd88210 2023-07-21T22:27:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11e49bab80 10 client.16950 fetch_fsmap finished waiting for FSMap version 41 2023-07-21T22:27:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.424+0000 7f11e49bab80 10 client.16950 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:27:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.425+0000 7f11e49bab80 20 client.16950 populate_metadata read hostname 'smithi151' 2023-07-21T22:27:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.425+0000 7f11e49bab80 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aadcdf0910 0x55aadcdf2d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.425+0000 7f11e49bab80 4 client.16950 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:27:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.425+0000 7f11e49bab80 1 -- 172.21.15.151:0/875362235 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aadcc8eff0 con 0x55aadcdf0910 2023-07-21T22:27:10.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.425+0000 7f11ca59c700 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aadcdf0910 0x55aadcdf2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:10.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.425+0000 7f11ca59c700 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aadcdf0910 0x55aadcdf2d20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0c2bb081e02e0ff server_cookie=58f6e0638c31291d in_seq=0 out_seq=0 2023-07-21T22:27:10.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.425+0000 7f11b1ffb700 10 client.16950 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11b1ffb700 1 -- 172.21.15.151:0/875362235 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aadcc8eff0 con 0x55aadcdf0910 2023-07-21T22:27:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11b1ffb700 10 client.16950 handle_command_reply: tid=0 2023-07-21T22:27:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 client.16950 shutdown 2023-07-21T22:27:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 -- 172.21.15.151:0/875362235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 msgr2=0x55aadcd91650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:10.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd91650 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f11b4004790 tx=0x7f11b4015d80 comp rx=0 tx=0).stop 2023-07-21T22:27:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 -- 172.21.15.151:0/875362235 shutdown_connections 2023-07-21T22:27:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aadcdf0910 0x55aadcdf2d20 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aadcbde6b0 0x55aadcd91110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aadcd88660 0x55aadcd8f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11b1ffb700 0 client.16950 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 --2- 172.21.15.151:0/875362235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aadcd88210 0x55aadcd91650 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 -- 172.21.15.151:0/875362235 >> 172.21.15.151:0/875362235 conn(0x55aadcd77ae0 msgr2=0x55aadcd871b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 -- 172.21.15.151:0/875362235 shutdown_connections 2023-07-21T22:27:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.447+0000 7f11e49bab80 1 -- 172.21.15.151:0/875362235 wait complete. 2023-07-21T22:27:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.448+0000 7f11e49bab80 20 client.16950 trim_cache size 0 max 16384 2023-07-21T22:27:10.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:27:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:27:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:27:10.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:27:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 -- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11b80a12c0 msgr2=0x7f11b80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11b80a12c0 0x7f11b80a3770 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f11bc00b830 tx=0x7f11bc006210 comp rx=0 tx=0).stop 2023-07-21T22:27:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 -- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11cc10c3f0 msgr2=0x7f11cc19cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11cc10c3f0 0x7f11cc19cab0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f11cc074920 tx=0x7f11c400b6a0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 -- 172.21.15.151:0/1202644981 shutdown_connections 2023-07-21T22:27:10.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11b80a12c0 0x7f11b80a3770 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11cc10c3f0 0x7f11cc19cab0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11cc072850 0x7f11cc197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 --2- 172.21.15.151:0/1202644981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11cc073160 0x7f11cc198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 -- 172.21.15.151:0/1202644981 >> 172.21.15.151:0/1202644981 conn(0x7f11cc0fb650 msgr2=0x7f11cc10e550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.449+0000 7f11d0fff700 1 -- 172.21.15.151:0/1202644981 shutdown_connections 2023-07-21T22:27:10.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:10.450+0000 7f11d0fff700 1 -- 172.21.15.151:0/1202644981 wait complete. 2023-07-21T22:27:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:10 smithi187 ceph-mon[96918]: pgmap v245: 97 pgs: 97 active+clean; 7.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 28 MiB/s wr, 64 op/s 2023-07-21T22:27:10.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:10 smithi195 ceph-mon[97365]: pgmap v245: 97 pgs: 97 active+clean; 7.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 28 MiB/s wr, 64 op/s 2023-07-21T22:27:10.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:10 smithi151 ceph-mon[95510]: pgmap v245: 97 pgs: 97 active+clean; 7.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 28 MiB/s wr, 64 op/s 2023-07-21T22:27:11.003 INFO:teuthology.orchestra.run.smithi151.stderr:33500000 of 50000000 tuples (67%) done (elapsed 454.49 s, remaining 223.86 s) 2023-07-21T22:27:12.261 INFO:teuthology.orchestra.run.smithi151.stderr:33600000 of 50000000 tuples (67%) done (elapsed 455.75 s, remaining 222.45 s) 2023-07-21T22:27:12.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:12 smithi187 ceph-mon[96918]: pgmap v246: 97 pgs: 97 active+clean; 7.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 28 MiB/s wr, 64 op/s 2023-07-21T22:27:12.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:12 smithi187 ceph-mon[96918]: osdmap e92: 12 total, 12 up, 12 in 2023-07-21T22:27:12.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:12 smithi195 ceph-mon[97365]: pgmap v246: 97 pgs: 97 active+clean; 7.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 28 MiB/s wr, 64 op/s 2023-07-21T22:27:12.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:12 smithi195 ceph-mon[97365]: osdmap e92: 12 total, 12 up, 12 in 2023-07-21T22:27:12.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:12 smithi151 ceph-mon[95510]: pgmap v246: 97 pgs: 97 active+clean; 7.6 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 28 MiB/s wr, 64 op/s 2023-07-21T22:27:12.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:12 smithi151 ceph-mon[95510]: osdmap e92: 12 total, 12 up, 12 in 2023-07-21T22:27:13.599 INFO:teuthology.orchestra.run.smithi151.stderr:33700000 of 50000000 tuples (67%) done (elapsed 457.09 s, remaining 221.09 s) 2023-07-21T22:27:14.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:14 smithi187 ceph-mon[96918]: pgmap v248: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 33 MiB/s wr, 85 op/s 2023-07-21T22:27:14.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:14 smithi195 ceph-mon[97365]: pgmap v248: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 33 MiB/s wr, 85 op/s 2023-07-21T22:27:14.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:14 smithi151 ceph-mon[95510]: pgmap v248: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 162 KiB/s rd, 33 MiB/s wr, 85 op/s 2023-07-21T22:27:14.847 INFO:teuthology.orchestra.run.smithi151.stderr:33800000 of 50000000 tuples (67%) done (elapsed 458.34 s, remaining 219.68 s) 2023-07-21T22:27:16.122 INFO:teuthology.orchestra.run.smithi151.stderr:33900000 of 50000000 tuples (67%) done (elapsed 459.61 s, remaining 218.28 s) 2023-07-21T22:27:16.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:16 smithi187 ceph-mon[96918]: pgmap v249: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 28 MiB/s wr, 72 op/s 2023-07-21T22:27:16.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:16 smithi195 ceph-mon[97365]: pgmap v249: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 28 MiB/s wr, 72 op/s 2023-07-21T22:27:16.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:16 smithi151 ceph-mon[95510]: pgmap v249: 97 pgs: 97 active+clean; 7.7 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 28 MiB/s wr, 72 op/s 2023-07-21T22:27:17.489 INFO:teuthology.orchestra.run.smithi151.stderr:34000000 of 50000000 tuples (68%) done (elapsed 460.98 s, remaining 216.93 s) 2023-07-21T22:27:18.630 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:18 smithi187 ceph-mon[96918]: pgmap v250: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 88 op/s 2023-07-21T22:27:18.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:18 smithi195 ceph-mon[97365]: pgmap v250: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 88 op/s 2023-07-21T22:27:18.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:18 smithi151 ceph-mon[95510]: pgmap v250: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 88 op/s 2023-07-21T22:27:18.755 INFO:teuthology.orchestra.run.smithi151.stderr:34100000 of 50000000 tuples (68%) done (elapsed 462.25 s, remaining 215.53 s) 2023-07-21T22:27:20.008 INFO:teuthology.orchestra.run.smithi151.stderr:34200000 of 50000000 tuples (68%) done (elapsed 463.50 s, remaining 214.13 s) 2023-07-21T22:27:20.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:20 smithi195 ceph-mon[97365]: pgmap v251: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 88 op/s 2023-07-21T22:27:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:20 smithi151 ceph-mon[95510]: pgmap v251: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 88 op/s 2023-07-21T22:27:20.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:20 smithi187 ceph-mon[96918]: pgmap v251: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 88 op/s 2023-07-21T22:27:21.261 INFO:teuthology.orchestra.run.smithi151.stderr:34300000 of 50000000 tuples (68%) done (elapsed 464.75 s, remaining 212.73 s) 2023-07-21T22:27:22.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:22 smithi195 ceph-mon[97365]: pgmap v252: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 88 op/s 2023-07-21T22:27:22.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:22 smithi151 ceph-mon[95510]: pgmap v252: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 88 op/s 2023-07-21T22:27:22.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:22 smithi187 ceph-mon[96918]: pgmap v252: 97 pgs: 97 active+clean; 7.8 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 28 MiB/s wr, 88 op/s 2023-07-21T22:27:23.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.609+0000 7f2855fff700 1 -- 172.21.15.151:0/1612494317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500731c0 msgr2=0x7f285010be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.609+0000 7f2855fff700 1 --2- 172.21.15.151:0/1612494317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500731c0 0x7f285010be00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f2838009990 tx=0x7f2838009ca0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.609+0000 7f2855fff700 1 -- 172.21.15.151:0/1612494317 shutdown_connections 2023-07-21T22:27:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.609+0000 7f2855fff700 1 --2- 172.21.15.151:0/1612494317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28500728b0 0x7f2850072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.609+0000 7f2855fff700 1 --2- 172.21.15.151:0/1612494317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285010c340 0x7f285010e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.609+0000 7f2855fff700 1 --2- 172.21.15.151:0/1612494317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500731c0 0x7f285010be00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.609+0000 7f2855fff700 1 -- 172.21.15.151:0/1612494317 >> 172.21.15.151:0/1612494317 conn(0x7f28500fb600 msgr2=0x7f28500fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.609+0000 7f2855fff700 1 -- 172.21.15.151:0/1612494317 shutdown_connections 2023-07-21T22:27:23.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.609+0000 7f2855fff700 1 -- 172.21.15.151:0/1612494317 wait complete. 2023-07-21T22:27:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.610+0000 7f2855fff700 1 Processor -- start 2023-07-21T22:27:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f2855fff700 1 -- start start 2023-07-21T22:27:23.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f2855fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500728b0 0x7f2850197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f2855fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28500731c0 0x7f2850198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f2855fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285010c340 0x7f285019c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f2855fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285019cfc0 con 0x7f28500728b0 2023-07-21T22:27:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f2855fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285019d130 con 0x7f28500731c0 2023-07-21T22:27:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f2855fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f285019d2f0 con 0x7f285010c340 2023-07-21T22:27:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500728b0 0x7f2850197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500728b0 0x7f2850197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42016/0 (socket says 172.21.15.151:42016) 2023-07-21T22:27:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f284f7fe700 1 -- 172.21.15.151:0/2435240338 learned_addr learned my addr 172.21.15.151:0/2435240338 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f284ffff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285010c340 0x7f285019c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.611+0000 7f2847fff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28500731c0 0x7f2850198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f284f7fe700 1 -- 172.21.15.151:0/2435240338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285010c340 msgr2=0x7f285019c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f284f7fe700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285010c340 0x7f285019c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f284f7fe700 1 -- 172.21.15.151:0/2435240338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28500731c0 msgr2=0x7f2850198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:23.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f284f7fe700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28500731c0 0x7f2850198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f284f7fe700 1 -- 172.21.15.151:0/2435240338 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28380095f0 con 0x7f28500728b0 2023-07-21T22:27:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f284f7fe700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500728b0 0x7f2850197dd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f284000b530 tx=0x7f284000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f284d7fa700 1 -- 172.21.15.151:0/2435240338 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011830 con 0x7f28500728b0 2023-07-21T22:27:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f2855fff700 1 -- 172.21.15.151:0/2435240338 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f285019d5d0 con 0x7f28500728b0 2023-07-21T22:27:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f284d7fa700 1 -- 172.21.15.151:0/2435240338 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2840011e20 con 0x7f28500728b0 2023-07-21T22:27:23.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f284d7fa700 1 -- 172.21.15.151:0/2435240338 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840010db0 con 0x7f28500728b0 2023-07-21T22:27:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.612+0000 7f2855fff700 1 -- 172.21.15.151:0/2435240338 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28501a4e10 con 0x7f28500728b0 2023-07-21T22:27:23.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.616+0000 7f284d7fa700 1 -- 172.21.15.151:0/2435240338 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2840011990 con 0x7f28500728b0 2023-07-21T22:27:23.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.617+0000 7f28699efb80 1 Processor -- start 2023-07-21T22:27:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.618+0000 7f28699efb80 1 -- start start 2023-07-21T22:27:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.618+0000 7f284d7fa700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f283c0a1340 0x7f283c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.618+0000 7f28699efb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c63eb6b0 0x5600c6594cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.618+0000 7f28699efb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595210 0x5600c658ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.618+0000 7f28699efb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595660 0x5600c658f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.618+0000 7f284d7fa700 1 -- 172.21.15.151:0/2435240338 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f28400cc5c0 con 0x7f28500728b0 2023-07-21T22:27:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.618+0000 7f28699efb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c6494c50 con 0x5600c6595660 2023-07-21T22:27:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.618+0000 7f28699efb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c64e79e0 con 0x5600c6595210 2023-07-21T22:27:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.618+0000 7f28699efb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c64e0e70 con 0x5600c63eb6b0 2023-07-21T22:27:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f283c0a1340 0x7f283c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595660 0x5600c658f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595660 0x5600c658f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42022/0 (socket says 172.21.15.151:42022) 2023-07-21T22:27:23.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 -- 172.21.15.151:0/684671880 learned_addr learned my addr 172.21.15.151:0/684671880 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f2847fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595210 0x5600c658ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284f7fe700 1 --2- 172.21.15.151:0/684671880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c63eb6b0 0x5600c6594cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 -- 172.21.15.151:0/684671880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c63eb6b0 msgr2=0x5600c6594cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 --2- 172.21.15.151:0/684671880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c63eb6b0 0x5600c6594cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 -- 172.21.15.151:0/684671880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595210 msgr2=0x5600c658ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 --2- 172.21.15.151:0/684671880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595210 0x5600c658ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 -- 172.21.15.151:0/684671880 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c630ed80 con 0x5600c6595660 2023-07-21T22:27:23.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f2847fff700 1 --2- 172.21.15.151:0/684671880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595210 0x5600c658ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:27:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f283c0a1340 0x7f283c0a37f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2848009fd0 tx=0x7f2848009d80 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.619+0000 7f284ffff700 1 --2- 172.21.15.151:0/684671880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595660 0x5600c658f4a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f28480076b0 tx=0x7f284801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf847e7449059087 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f2845ffb700 1 -- 172.21.15.151:0/684671880 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848027070 con 0x5600c6595660 2023-07-21T22:27:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f2845ffb700 1 -- 172.21.15.151:0/684671880 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2848009460 con 0x5600c6595660 2023-07-21T22:27:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f2845ffb700 1 -- 172.21.15.151:0/684671880 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848004bb0 con 0x5600c6595660 2023-07-21T22:27:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f28699efb80 1 -- 172.21.15.151:0/684671880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595660 msgr2=0x5600c658f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:23.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f28699efb80 1 --2- 172.21.15.151:0/684671880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595660 0x5600c658f4a0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f28480076b0 tx=0x7f284801c000 comp rx=0 tx=0).stop 2023-07-21T22:27:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f28699efb80 1 -- 172.21.15.151:0/684671880 shutdown_connections 2023-07-21T22:27:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f28699efb80 1 --2- 172.21.15.151:0/684671880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595660 0x5600c658f4a0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f28699efb80 1 --2- 172.21.15.151:0/684671880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c63eb6b0 0x5600c6594cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f28699efb80 1 --2- 172.21.15.151:0/684671880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595210 0x5600c658ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.620+0000 7f28699efb80 1 -- 172.21.15.151:0/684671880 >> 172.21.15.151:0/684671880 conn(0x5600c6584ae0 msgr2=0x5600c658a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.621+0000 7f28699efb80 1 -- 172.21.15.151:0/684671880 shutdown_connections 2023-07-21T22:27:23.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.621+0000 7f28699efb80 1 -- 172.21.15.151:0/684671880 wait complete. 2023-07-21T22:27:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.621+0000 7f28699efb80 1 -- start start 2023-07-21T22:27:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.621+0000 7f28699efb80 1 Processor -- start 2023-07-21T22:27:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f28699efb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c63eb6b0 0x5600c659b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f28699efb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595210 0x5600c6598830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f28699efb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595660 0x5600c6598f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f28699efb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c6480a60 con 0x5600c63eb6b0 2023-07-21T22:27:23.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f28699efb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c6480760 con 0x5600c6595660 2023-07-21T22:27:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f28699efb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c63648c0 con 0x5600c6595210 2023-07-21T22:27:23.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f28699efb80 10 client.0 _ll_register_callbacks cb 0x5600c647e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:27:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c63eb6b0 0x5600c659b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c63eb6b0 0x5600c659b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42038/0 (socket says 172.21.15.151:42038) 2023-07-21T22:27:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f2847fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595210 0x5600c6598830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284f7fe700 1 -- 172.21.15.151:0/4239279790 learned_addr learned my addr 172.21.15.151:0/4239279790 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284ffff700 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595660 0x5600c6598f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284f7fe700 1 -- 172.21.15.151:0/4239279790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595210 msgr2=0x5600c6598830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:23.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284f7fe700 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595210 0x5600c6598830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284f7fe700 1 -- 172.21.15.151:0/4239279790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595660 msgr2=0x5600c6598f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284f7fe700 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595660 0x5600c6598f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284f7fe700 1 -- 172.21.15.151:0/4239279790 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f285010f3c0 con 0x5600c63eb6b0 2023-07-21T22:27:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.622+0000 7f284ffff700 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595660 0x5600c6598f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:27:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f284f7fe700 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c63eb6b0 0x5600c659b5b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f284000bb90 tx=0x7f2840004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=402e6bf2cea99407 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f282effd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:27:23.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f282effd700 1 -- 172.21.15.151:0/4239279790 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840011c40 con 0x5600c63eb6b0 2023-07-21T22:27:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f282effd700 1 -- 172.21.15.151:0/4239279790 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2840099760 con 0x5600c63eb6b0 2023-07-21T22:27:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f28699efb80 1 -- 172.21.15.151:0/4239279790 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600c643a490 con 0x5600c63eb6b0 2023-07-21T22:27:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f282effd700 1 -- 172.21.15.151:0/4239279790 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f284009d790 con 0x5600c63eb6b0 2023-07-21T22:27:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f28699efb80 10 client.16962 fetch_fsmap learned FSMap version 41 2023-07-21T22:27:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f28699efb80 1 -- 172.21.15.151:0/4239279790 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x7f2848011040 con 0x5600c63eb6b0 2023-07-21T22:27:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f282effd700 1 -- 172.21.15.151:0/4239279790 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f28400c7020 con 0x5600c63eb6b0 2023-07-21T22:27:23.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.623+0000 7f282effd700 1 -- 172.21.15.151:0/4239279790 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f2840098c50 con 0x5600c63eb6b0 2023-07-21T22:27:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.624+0000 7f28699efb80 10 client.16962 fetch_fsmap finished waiting for FSMap version 41 2023-07-21T22:27:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.624+0000 7f28699efb80 10 client.16962 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:27:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.624+0000 7f28699efb80 20 client.16962 populate_metadata read hostname 'smithi151' 2023-07-21T22:27:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.624+0000 7f28699efb80 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5600c65a8a90 0x5600c65aae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.624+0000 7f28699efb80 4 client.16962 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:27:23.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.624+0000 7f28699efb80 1 -- 172.21.15.151:0/4239279790 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600c64d9e50 con 0x5600c65a8a90 2023-07-21T22:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.624+0000 7f2847fff700 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5600c65a8a90 0x5600c65aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.625+0000 7f2847fff700 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5600c65a8a90 0x5600c65aae70 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dec7d5c2a84ffc6 server_cookie=c3cfb96765eea61d in_seq=0 out_seq=0 2023-07-21T22:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.625+0000 7f282effd700 10 client.16962 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.625+0000 7f282effd700 1 -- 172.21.15.151:0/4239279790 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5600c64d9e50 con 0x5600c65a8a90 2023-07-21T22:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.625+0000 7f282effd700 10 client.16962 handle_command_reply: tid=0 2023-07-21T22:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.625+0000 7f28699efb80 1 client.16962 shutdown 2023-07-21T22:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 -- 172.21.15.151:0/4239279790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c63eb6b0 msgr2=0x5600c659b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c63eb6b0 0x5600c659b5b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f284000bb90 tx=0x7f2840004860 comp rx=0 tx=0).stop 2023-07-21T22:27:23.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 -- 172.21.15.151:0/4239279790 shutdown_connections 2023-07-21T22:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5600c65a8a90 0x5600c65aae70 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c6595660 0x5600c6598f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f282effd700 0 client.16962 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c63eb6b0 0x5600c659b5b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 --2- 172.21.15.151:0/4239279790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595210 0x5600c6598830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 -- 172.21.15.151:0/4239279790 >> 172.21.15.151:0/4239279790 conn(0x5600c6584ae0 msgr2=0x5600c65893e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 -- 172.21.15.151:0/4239279790 shutdown_connections 2023-07-21T22:27:23.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 1 -- 172.21.15.151:0/4239279790 wait complete. 2023-07-21T22:27:23.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.626+0000 7f28699efb80 20 client.16962 trim_cache size 0 max 16384 2023-07-21T22:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.642+0000 7f28699efb80 1 Processor -- start 2023-07-21T22:27:23.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.642+0000 7f28699efb80 1 -- start start 2023-07-21T22:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.642+0000 7f28699efb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 0x5600c65940a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.642+0000 7f28699efb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.642+0000 7f28699efb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 0x5600c658ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.642+0000 7f28699efb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c65a6180 con 0x5600c6595210 2023-07-21T22:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.642+0000 7f28699efb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c658fcd0 con 0x5600c63eb6b0 2023-07-21T22:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.642+0000 7f28699efb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c6590160 con 0x5600c6595660 2023-07-21T22:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f2847fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f2847fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42048/0 (socket says 172.21.15.151:42048) 2023-07-21T22:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f2847fff700 1 -- 172.21.15.151:0/662725371 learned_addr learned my addr 172.21.15.151:0/662725371 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:23.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f284f7fe700 1 --2- 172.21.15.151:0/662725371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 0x5600c65940a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f284ffff700 1 --2- 172.21.15.151:0/662725371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 0x5600c658ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f2847fff700 1 -- 172.21.15.151:0/662725371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 msgr2=0x5600c658ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f2847fff700 1 --2- 172.21.15.151:0/662725371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 0x5600c658ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f2847fff700 1 -- 172.21.15.151:0/662725371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 msgr2=0x5600c65940a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f2847fff700 1 --2- 172.21.15.151:0/662725371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 0x5600c65940a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f2847fff700 1 -- 172.21.15.151:0/662725371 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c65afa70 con 0x5600c6595210 2023-07-21T22:27:23.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.643+0000 7f2847fff700 1 --2- 172.21.15.151:0/662725371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659b0e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f28380098e0 tx=0x7f2838005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5659e36df55e66f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28467fc700 1 -- 172.21.15.151:0/662725371 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283802b070 con 0x5600c6595210 2023-07-21T22:27:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28467fc700 1 -- 172.21.15.151:0/662725371 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f283801e040 con 0x5600c6595210 2023-07-21T22:27:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28467fc700 1 -- 172.21.15.151:0/662725371 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283801d040 con 0x5600c6595210 2023-07-21T22:27:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28699efb80 1 -- 172.21.15.151:0/662725371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 msgr2=0x5600c659b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28699efb80 1 --2- 172.21.15.151:0/662725371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659b0e0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f28380098e0 tx=0x7f2838005e80 comp rx=0 tx=0).stop 2023-07-21T22:27:23.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28699efb80 1 -- 172.21.15.151:0/662725371 shutdown_connections 2023-07-21T22:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28699efb80 1 --2- 172.21.15.151:0/662725371 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 0x5600c65940a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28699efb80 1 --2- 172.21.15.151:0/662725371 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 0x5600c658ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28699efb80 1 --2- 172.21.15.151:0/662725371 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659b0e0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28699efb80 1 -- 172.21.15.151:0/662725371 >> 172.21.15.151:0/662725371 conn(0x5600c6584ae0 msgr2=0x5600c6593990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:23.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.644+0000 7f28699efb80 1 -- 172.21.15.151:0/662725371 shutdown_connections 2023-07-21T22:27:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.645+0000 7f28699efb80 1 -- 172.21.15.151:0/662725371 wait complete. 2023-07-21T22:27:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.645+0000 7f28699efb80 1 -- start start 2023-07-21T22:27:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.645+0000 7f28699efb80 1 Processor -- start 2023-07-21T22:27:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f28699efb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 0x5600c659f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f28699efb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f28699efb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 0x5600c659d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f28699efb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c659e080 con 0x5600c6595210 2023-07-21T22:27:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f28699efb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c659e1f0 con 0x5600c63eb6b0 2023-07-21T22:27:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f28699efb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c659e3b0 con 0x5600c6595660 2023-07-21T22:27:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f28699efb80 10 client.0 _ll_register_callbacks cb 0x7f2840095ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:27:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f2847fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f2847fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42062/0 (socket says 172.21.15.151:42062) 2023-07-21T22:27:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f2847fff700 1 -- 172.21.15.151:0/3461493689 learned_addr learned my addr 172.21.15.151:0/3461493689 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f284f7fe700 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 0x5600c659f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f284ffff700 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 0x5600c659d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f2847fff700 1 -- 172.21.15.151:0/3461493689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 msgr2=0x5600c659d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f2847fff700 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 0x5600c659d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f2847fff700 1 -- 172.21.15.151:0/3461493689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 msgr2=0x5600c659f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f2847fff700 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 0x5600c659f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f2847fff700 1 -- 172.21.15.151:0/3461493689 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28380053c0 con 0x5600c6595210 2023-07-21T22:27:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f284ffff700 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 0x5600c659d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:27:23.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f284f7fe700 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 0x5600c659f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:27:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f2847fff700 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659fb60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2838009ce0 tx=0x7f283800bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696f590bf4c295dd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.646+0000 7f282effd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:27:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f282effd700 1 -- 172.21.15.151:0/3461493689 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283801d030 con 0x5600c6595210 2023-07-21T22:27:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f282effd700 1 -- 172.21.15.151:0/3461493689 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f283800bb80 con 0x5600c6595210 2023-07-21T22:27:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f28699efb80 1 -- 172.21.15.151:0/3461493689 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2848009460 con 0x5600c6595210 2023-07-21T22:27:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f282effd700 1 -- 172.21.15.151:0/3461493689 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2838029070 con 0x5600c6595210 2023-07-21T22:27:23.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f28699efb80 10 client.16968 fetch_fsmap learned FSMap version 41 2023-07-21T22:27:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f28699efb80 1 -- 172.21.15.151:0/3461493689 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x5600c62f7c00 con 0x5600c6595210 2023-07-21T22:27:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f282effd700 1 -- 172.21.15.151:0/3461493689 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2848009460 con 0x5600c6595210 2023-07-21T22:27:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f282effd700 1 -- 172.21.15.151:0/3461493689 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f28380099c0 con 0x5600c6595210 2023-07-21T22:27:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f28699efb80 10 client.16968 fetch_fsmap finished waiting for FSMap version 41 2023-07-21T22:27:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f28699efb80 10 client.16968 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:27:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f28699efb80 20 client.16968 populate_metadata read hostname 'smithi151' 2023-07-21T22:27:23.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f28699efb80 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5600c65fd620 0x5600c65ffa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:23.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f28699efb80 4 client.16968 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:27:23.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.647+0000 7f28699efb80 1 -- 172.21.15.151:0/3461493689 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5600c649bff0 con 0x5600c65fd620 2023-07-21T22:27:23.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.648+0000 7f284f7fe700 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5600c65fd620 0x5600c65ffa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:23.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.648+0000 7f284f7fe700 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5600c65fd620 0x5600c65ffa30 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30233dadf2c092f9 server_cookie=2bd18302e09b181d in_seq=0 out_seq=0 2023-07-21T22:27:23.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.648+0000 7f282effd700 10 client.16968 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:23.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f282effd700 1 -- 172.21.15.151:0/3461493689 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5600c649bff0 con 0x5600c65fd620 2023-07-21T22:27:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f282effd700 10 client.16968 handle_command_reply: tid=0 2023-07-21T22:27:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 client.16968 shutdown 2023-07-21T22:27:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 -- 172.21.15.151:0/3461493689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 msgr2=0x5600c659fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659fb60 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2838009ce0 tx=0x7f283800bf80 comp rx=0 tx=0).stop 2023-07-21T22:27:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 -- 172.21.15.151:0/3461493689 shutdown_connections 2023-07-21T22:27:23.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5600c65fd620 0x5600c65ffa30 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5600c63eb6b0 0x5600c659f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5600c6595660 0x5600c659d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f282effd700 0 client.16968 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 --2- 172.21.15.151:0/3461493689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5600c6595210 0x5600c659fb60 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 -- 172.21.15.151:0/3461493689 >> 172.21.15.151:0/3461493689 conn(0x5600c6584ae0 msgr2=0x5600c6593990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:23.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 -- 172.21.15.151:0/3461493689 shutdown_connections 2023-07-21T22:27:23.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 1 -- 172.21.15.151:0/3461493689 wait complete. 2023-07-21T22:27:23.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f28699efb80 20 client.16968 trim_cache size 0 max 16384 2023-07-21T22:27:23.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:27:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:27:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:27:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:27:23.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.669+0000 7f2855fff700 1 -- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f283c0a1340 msgr2=0x7f283c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f283c0a1340 0x7f283c0a37f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2848009fd0 tx=0x7f2848009d80 comp rx=0 tx=0).stop 2023-07-21T22:27:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 -- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500728b0 msgr2=0x7f2850197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500728b0 0x7f2850197dd0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f284000b530 tx=0x7f284000b840 comp rx=0 tx=0).stop 2023-07-21T22:27:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 -- 172.21.15.151:0/2435240338 shutdown_connections 2023-07-21T22:27:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f283c0a1340 0x7f283c0a37f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f285010c340 0x7f285019c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28500728b0 0x7f2850197dd0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 --2- 172.21.15.151:0/2435240338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28500731c0 0x7f2850198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 -- 172.21.15.151:0/2435240338 >> 172.21.15.151:0/2435240338 conn(0x7f28500fb600 msgr2=0x7f285010e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 -- 172.21.15.151:0/2435240338 shutdown_connections 2023-07-21T22:27:23.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:23.670+0000 7f2855fff700 1 -- 172.21.15.151:0/2435240338 wait complete. 2023-07-21T22:27:24.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:24 smithi195 ceph-mon[97365]: pgmap v253: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 36 MiB/s wr, 101 op/s 2023-07-21T22:27:24.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:24 smithi151 ceph-mon[95510]: pgmap v253: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 36 MiB/s wr, 101 op/s 2023-07-21T22:27:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:24 smithi187 ceph-mon[96918]: pgmap v253: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 36 MiB/s wr, 101 op/s 2023-07-21T22:27:26.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:26 smithi195 ceph-mon[97365]: pgmap v254: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:27:26.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:26 smithi151 ceph-mon[95510]: pgmap v254: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:27:26.801 INFO:teuthology.orchestra.run.smithi151.stderr:34400000 of 50000000 tuples (68%) done (elapsed 470.29 s, remaining 213.27 s) 2023-07-21T22:27:26.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:26 smithi187 ceph-mon[96918]: pgmap v254: 97 pgs: 97 active+clean; 7.9 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 23 MiB/s wr, 63 op/s 2023-07-21T22:27:28.042 INFO:teuthology.orchestra.run.smithi151.stderr:34500000 of 50000000 tuples (69%) done (elapsed 471.53 s, remaining 211.85 s) 2023-07-21T22:27:28.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:28 smithi195 ceph-mon[97365]: pgmap v255: 97 pgs: 97 active+clean; 7.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 25 MiB/s wr, 86 op/s 2023-07-21T22:27:28.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:28 smithi151 ceph-mon[95510]: pgmap v255: 97 pgs: 97 active+clean; 7.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 25 MiB/s wr, 86 op/s 2023-07-21T22:27:28.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:28 smithi187 ceph-mon[96918]: pgmap v255: 97 pgs: 97 active+clean; 7.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 25 MiB/s wr, 86 op/s 2023-07-21T22:27:29.284 INFO:teuthology.orchestra.run.smithi151.stderr:34600000 of 50000000 tuples (69%) done (elapsed 472.78 s, remaining 210.43 s) 2023-07-21T22:27:29.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:27:29.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:27:29.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:27:30.613 INFO:teuthology.orchestra.run.smithi151.stderr:34700000 of 50000000 tuples (69%) done (elapsed 474.10 s, remaining 209.04 s) 2023-07-21T22:27:30.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:30 smithi195 ceph-mon[97365]: pgmap v256: 97 pgs: 97 active+clean; 7.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 13 MiB/s wr, 48 op/s 2023-07-21T22:27:30.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:30 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:27:30.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:30 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:27:30.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:30 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:27:30.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:30 smithi151 ceph-mon[95510]: pgmap v256: 97 pgs: 97 active+clean; 7.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 13 MiB/s wr, 48 op/s 2023-07-21T22:27:30.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:30 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:27:30.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:30 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:27:30.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:30 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:27:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:30 smithi187 ceph-mon[96918]: pgmap v256: 97 pgs: 97 active+clean; 7.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 13 MiB/s wr, 48 op/s 2023-07-21T22:27:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:30 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:27:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:30 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:27:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:30 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:27:31.944 INFO:teuthology.orchestra.run.smithi151.stderr:34800000 of 50000000 tuples (69%) done (elapsed 475.44 s, remaining 207.66 s) 2023-07-21T22:27:32.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:32 smithi195 ceph-mon[97365]: pgmap v257: 97 pgs: 97 active+clean; 7.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 13 MiB/s wr, 48 op/s 2023-07-21T22:27:32.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:32 smithi151 ceph-mon[95510]: pgmap v257: 97 pgs: 97 active+clean; 7.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 13 MiB/s wr, 48 op/s 2023-07-21T22:27:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:32 smithi187 ceph-mon[96918]: pgmap v257: 97 pgs: 97 active+clean; 7.9 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 13 MiB/s wr, 48 op/s 2023-07-21T22:27:33.184 INFO:teuthology.orchestra.run.smithi151.stderr:34900000 of 50000000 tuples (69%) done (elapsed 476.68 s, remaining 206.24 s) 2023-07-21T22:27:34.455 INFO:teuthology.orchestra.run.smithi151.stderr:35000000 of 50000000 tuples (70%) done (elapsed 477.95 s, remaining 204.83 s) 2023-07-21T22:27:34.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:34 smithi195 ceph-mon[97365]: pgmap v258: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 25 MiB/s wr, 84 op/s 2023-07-21T22:27:34.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:34 smithi151 ceph-mon[95510]: pgmap v258: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 25 MiB/s wr, 84 op/s 2023-07-21T22:27:34.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:34 smithi187 ceph-mon[96918]: pgmap v258: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 25 MiB/s wr, 84 op/s 2023-07-21T22:27:35.797 INFO:teuthology.orchestra.run.smithi151.stderr:35100000 of 50000000 tuples (70%) done (elapsed 479.29 s, remaining 203.46 s) 2023-07-21T22:27:36.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:36 smithi151 ceph-mon[95510]: pgmap v259: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 14 MiB/s wr, 58 op/s 2023-07-21T22:27:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.832+0000 7f268efff700 1 -- 172.21.15.151:0/1658066994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 msgr2=0x7f268810c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.832+0000 7f268efff700 1 --2- 172.21.15.151:0/1658066994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 0x7f268810c000 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2674009990 tx=0x7f2674009ca0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.832+0000 7f268efff700 1 -- 172.21.15.151:0/1658066994 shutdown_connections 2023-07-21T22:27:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.832+0000 7f268efff700 1 --2- 172.21.15.151:0/1658066994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f268810c540 0x7f268810e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.832+0000 7f268efff700 1 --2- 172.21.15.151:0/1658066994 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26880679a0 0x7f2688067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.832+0000 7f268efff700 1 --2- 172.21.15.151:0/1658066994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 0x7f268810c000 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.832+0000 7f268efff700 1 -- 172.21.15.151:0/1658066994 >> 172.21.15.151:0/1658066994 conn(0x7f2688074760 msgr2=0x7f2688074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:36.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.832+0000 7f268efff700 1 -- 172.21.15.151:0/1658066994 shutdown_connections 2023-07-21T22:27:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.832+0000 7f268efff700 1 -- 172.21.15.151:0/1658066994 wait complete. 2023-07-21T22:27:36.883 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:36 smithi187 ceph-mon[96918]: pgmap v259: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 14 MiB/s wr, 58 op/s 2023-07-21T22:27:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.834+0000 7f268efff700 1 Processor -- start 2023-07-21T22:27:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.834+0000 7f268efff700 1 -- start start 2023-07-21T22:27:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.834+0000 7f268efff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26880679a0 0x7f268819dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.834+0000 7f268efff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 0x7f268819e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.834+0000 7f268efff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268810c540 0x7f2688197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.834+0000 7f268efff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26881981c0 con 0x7f26880682b0 2023-07-21T22:27:36.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.834+0000 7f268efff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2688198330 con 0x7f26880679a0 2023-07-21T22:27:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.834+0000 7f268efff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26881984f0 con 0x7f268810c540 2023-07-21T22:27:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.834+0000 7f2687fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 0x7f268819e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f2687fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 0x7f268819e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44454/0 (socket says 172.21.15.151:44454) 2023-07-21T22:27:36.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f2687fff700 1 -- 172.21.15.151:0/3674579856 learned_addr learned my addr 172.21.15.151:0/3674579856 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f268cd9b700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26880679a0 0x7f268819dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f268d59c700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268810c540 0x7f2688197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f2687fff700 1 -- 172.21.15.151:0/3674579856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268810c540 msgr2=0x7f2688197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f2687fff700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268810c540 0x7f2688197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f2687fff700 1 -- 172.21.15.151:0/3674579856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26880679a0 msgr2=0x7f268819dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f2687fff700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26880679a0 0x7f268819dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f2687fff700 1 -- 172.21.15.151:0/3674579856 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26740095f0 con 0x7f26880682b0 2023-07-21T22:27:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f268d59c700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268810c540 0x7f2688197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:27:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.835+0000 7f2687fff700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 0x7f268819e230 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f2674009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.836+0000 7f2685ffb700 1 -- 172.21.15.151:0/3674579856 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267401d070 con 0x7f26880682b0 2023-07-21T22:27:36.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.836+0000 7f2685ffb700 1 -- 172.21.15.151:0/3674579856 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2674022470 con 0x7f26880682b0 2023-07-21T22:27:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.836+0000 7f268efff700 1 -- 172.21.15.151:0/3674579856 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2688198770 con 0x7f26880682b0 2023-07-21T22:27:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.836+0000 7f2685ffb700 1 -- 172.21.15.151:0/3674579856 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674017650 con 0x7f26880682b0 2023-07-21T22:27:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.836+0000 7f268efff700 1 -- 172.21.15.151:0/3674579856 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26881a4ce0 con 0x7f26880682b0 2023-07-21T22:27:36.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.840+0000 7f2685ffb700 1 -- 172.21.15.151:0/3674579856 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f267400fb00 con 0x7f26880682b0 2023-07-21T22:27:36.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.841+0000 7f26a2926b80 1 Processor -- start 2023-07-21T22:27:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.841+0000 7f26a2926b80 1 -- start start 2023-07-21T22:27:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.841+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c0ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.841+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c08f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.841+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c094a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.841+0000 7f26a2926b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640b0ec50 con 0x55b640c0f660 2023-07-21T22:27:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.841+0000 7f26a2926b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640b619e0 con 0x55b640c0f210 2023-07-21T22:27:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.841+0000 7f26a2926b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640b5ae70 con 0x55b640a656b0 2023-07-21T22:27:36.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f2687fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c094a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268cd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c08f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f2685ffb700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26780a1340 0x7f26780a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268d59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c0ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268cd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c08f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45044/0 (socket says 172.21.15.151:45044) 2023-07-21T22:27:36.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f2687fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c094a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44458/0 (socket says 172.21.15.151:44458) 2023-07-21T22:27:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268cd9b700 1 -- 172.21.15.151:0/1002505107 learned_addr learned my addr 172.21.15.151:0/1002505107 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f2685ffb700 1 -- 172.21.15.151:0/3674579856 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f26740ce130 con 0x7f26880682b0 2023-07-21T22:27:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268cd9b700 1 -- 172.21.15.151:0/1002505107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 msgr2=0x55b640c0ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268cd9b700 1 --2- 172.21.15.151:0/1002505107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c0ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268cd9b700 1 -- 172.21.15.151:0/1002505107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 msgr2=0x55b640c094a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268cd9b700 1 --2- 172.21.15.151:0/1002505107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c094a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268cd9b700 1 -- 172.21.15.151:0/1002505107 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b640988d80 con 0x55b640c0f210 2023-07-21T22:27:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.842+0000 7f268d59c700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26780a1340 0x7f26780a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.843+0000 7f268cd9b700 1 --2- 172.21.15.151:0/1002505107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c08f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f267c00bd70 tx=0x7f267c00f640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4742b1943a276079 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:36.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.843+0000 7f2672ffd700 1 -- 172.21.15.151:0/1002505107 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c00fba0 con 0x55b640c0f210 2023-07-21T22:27:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.843+0000 7f268d59c700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26780a1340 0x7f26780a37f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f268819e9f0 tx=0x7f2680004b40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.843+0000 7f2672ffd700 1 -- 172.21.15.151:0/1002505107 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f267c00fd00 con 0x55b640c0f210 2023-07-21T22:27:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.843+0000 7f2672ffd700 1 -- 172.21.15.151:0/1002505107 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c0116a0 con 0x55b640c0f210 2023-07-21T22:27:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 -- 172.21.15.151:0/1002505107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 msgr2=0x55b640c08f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:36.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1002505107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c08f40 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f267c00bd70 tx=0x7f267c00f640 comp rx=0 tx=0).stop 2023-07-21T22:27:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 -- 172.21.15.151:0/1002505107 shutdown_connections 2023-07-21T22:27:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1002505107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c094a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1002505107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c0ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1002505107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c08f40 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 -- 172.21.15.151:0/1002505107 >> 172.21.15.151:0/1002505107 conn(0x55b640bfeae0 msgr2=0x55b640c040e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 -- 172.21.15.151:0/1002505107 shutdown_connections 2023-07-21T22:27:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 -- 172.21.15.151:0/1002505107 wait complete. 2023-07-21T22:27:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.844+0000 7f26a2926b80 1 -- start start 2023-07-21T22:27:36.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.845+0000 7f26a2926b80 1 Processor -- start 2023-07-21T22:27:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.845+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640a656b0 0x55b640c15490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.845+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640c0f210 0x55b640c12710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.845+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 0x55b640c12cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.845+0000 7f26a2926b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640afaa60 con 0x55b640a656b0 2023-07-21T22:27:36.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.845+0000 7f26a2926b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640afa760 con 0x55b640c0f660 2023-07-21T22:27:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.845+0000 7f26a2926b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b6409de8c0 con 0x55b640c0f210 2023-07-21T22:27:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.845+0000 7f26a2926b80 10 client.0 _ll_register_callbacks cb 0x55b640af8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:27:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268cd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640a656b0 0x55b640c15490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268cd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640a656b0 0x55b640c15490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44472/0 (socket says 172.21.15.151:44472) 2023-07-21T22:27:36.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268cd9b700 1 -- 172.21.15.151:0/4006540091 learned_addr learned my addr 172.21.15.151:0/4006540091 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268d59c700 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 0x55b640c12cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f2687fff700 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640c0f210 0x55b640c12710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268cd9b700 1 -- 172.21.15.151:0/4006540091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640c0f210 msgr2=0x55b640c12710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268cd9b700 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640c0f210 0x55b640c12710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268cd9b700 1 -- 172.21.15.151:0/4006540091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 msgr2=0x55b640c12cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268cd9b700 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 0x55b640c12cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268cd9b700 1 -- 172.21.15.151:0/4006540091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f267c00b9a0 con 0x55b640a656b0 2023-07-21T22:27:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268d59c700 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 0x55b640c12cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:27:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f2687fff700 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640c0f210 0x55b640c12710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:27:36.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f268cd9b700 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640a656b0 0x55b640c15490 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f267c00b360 tx=0x7f267c01ac60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5872e0f35a530236 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.846+0000 7f2667fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:27:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.847+0000 7f2667fff700 1 -- 172.21.15.151:0/4006540091 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c020070 con 0x55b640a656b0 2023-07-21T22:27:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.847+0000 7f2667fff700 1 -- 172.21.15.151:0/4006540091 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f267c01a670 con 0x55b640a656b0 2023-07-21T22:27:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.847+0000 7f26a2926b80 1 -- 172.21.15.151:0/4006540091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b640ab4490 con 0x55b640a656b0 2023-07-21T22:27:36.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.847+0000 7f2667fff700 1 -- 172.21.15.151:0/4006540091 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f267c01a830 con 0x55b640a656b0 2023-07-21T22:27:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.847+0000 7f26a2926b80 10 client.16980 fetch_fsmap learned FSMap version 41 2023-07-21T22:27:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.847+0000 7f26a2926b80 1 -- 172.21.15.151:0/4006540091 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b640971c00 con 0x55b640a656b0 2023-07-21T22:27:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.847+0000 7f2667fff700 1 -- 172.21.15.151:0/4006540091 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f267c031020 con 0x55b640a656b0 2023-07-21T22:27:36.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.848+0000 7f2667fff700 1 -- 172.21.15.151:0/4006540091 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f267c004a10 con 0x55b640a656b0 2023-07-21T22:27:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.848+0000 7f26a2926b80 10 client.16980 fetch_fsmap finished waiting for FSMap version 41 2023-07-21T22:27:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.848+0000 7f26a2926b80 10 client.16980 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:27:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.848+0000 7f26a2926b80 20 client.16980 populate_metadata read hostname 'smithi151' 2023-07-21T22:27:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.848+0000 7f26a2926b80 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b640c228d0 0x55b640c24ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.848+0000 7f26a2926b80 4 client.16980 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:27:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.848+0000 7f26a2926b80 1 -- 172.21.15.151:0/4006540091 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b640b53e50 con 0x55b640c228d0 2023-07-21T22:27:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.848+0000 7f2687fff700 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b640c228d0 0x55b640c24ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.849+0000 7f2687fff700 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b640c228d0 0x55b640c24ce0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8274ec778acfd267 server_cookie=3196c15afa862b78 in_seq=0 out_seq=0 2023-07-21T22:27:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.849+0000 7f2667fff700 10 client.16980 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:36.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.849+0000 7f2667fff700 1 -- 172.21.15.151:0/4006540091 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b640b53e50 con 0x55b640c228d0 2023-07-21T22:27:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.849+0000 7f2667fff700 10 client.16980 handle_command_reply: tid=0 2023-07-21T22:27:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.849+0000 7f26a2926b80 1 client.16980 shutdown 2023-07-21T22:27:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 -- 172.21.15.151:0/4006540091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640a656b0 msgr2=0x55b640c15490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640a656b0 0x55b640c15490 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f267c00b360 tx=0x7f267c01ac60 comp rx=0 tx=0).stop 2023-07-21T22:27:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 -- 172.21.15.151:0/4006540091 shutdown_connections 2023-07-21T22:27:36.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b640c228d0 0x55b640c24ce0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 0x55b640c12cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f2667fff700 0 client.16980 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640a656b0 0x55b640c15490 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 --2- 172.21.15.151:0/4006540091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640c0f210 0x55b640c12710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 -- 172.21.15.151:0/4006540091 >> 172.21.15.151:0/4006540091 conn(0x55b640bfeae0 msgr2=0x55b640c033e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 -- 172.21.15.151:0/4006540091 shutdown_connections 2023-07-21T22:27:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 1 -- 172.21.15.151:0/4006540091 wait complete. 2023-07-21T22:27:36.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.850+0000 7f26a2926b80 20 client.16980 trim_cache size 0 max 16384 2023-07-21T22:27:36.918 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:36 smithi195 ceph-mon[97365]: pgmap v259: 97 pgs: 97 active+clean; 8.0 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 14 MiB/s wr, 58 op/s 2023-07-21T22:27:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.867+0000 7f26a2926b80 1 Processor -- start 2023-07-21T22:27:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.868+0000 7f26a2926b80 1 -- start start 2023-07-21T22:27:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.868+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c10140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.868+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c19ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.868+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c15030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.868+0000 7f26a2926b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640c09f20 con 0x55b640c0f660 2023-07-21T22:27:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.868+0000 7f26a2926b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640c04f50 con 0x55b640c0f210 2023-07-21T22:27:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.868+0000 7f26a2926b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640c13cc0 con 0x55b640a656b0 2023-07-21T22:27:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268d59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c15030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268cd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c10140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268cd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c10140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39832/0 (socket says 172.21.15.151:39832) 2023-07-21T22:27:36.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268cd9b700 1 -- 172.21.15.151:0/172994367 learned_addr learned my addr 172.21.15.151:0/172994367 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268d59c700 1 --2- 172.21.15.151:0/172994367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c15030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44480/0 (socket says 172.21.15.151:44480) 2023-07-21T22:27:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f2687fff700 1 --2- 172.21.15.151:0/172994367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c19ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268cd9b700 1 -- 172.21.15.151:0/172994367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 msgr2=0x55b640c19ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:36.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268cd9b700 1 --2- 172.21.15.151:0/172994367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c19ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268cd9b700 1 -- 172.21.15.151:0/172994367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 msgr2=0x55b640c15030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268cd9b700 1 --2- 172.21.15.151:0/172994367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c15030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268cd9b700 1 -- 172.21.15.151:0/172994367 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b640c29910 con 0x55b640a656b0 2023-07-21T22:27:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.869+0000 7f268cd9b700 1 --2- 172.21.15.151:0/172994367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c10140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f267c005a60 tx=0x7f267c00f640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fab950754dc135c8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.870+0000 7f26737fe700 1 -- 172.21.15.151:0/172994367 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c020070 con 0x55b640a656b0 2023-07-21T22:27:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.870+0000 7f26737fe700 1 -- 172.21.15.151:0/172994367 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f267c031070 con 0x55b640a656b0 2023-07-21T22:27:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.870+0000 7f26737fe700 1 -- 172.21.15.151:0/172994367 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267c004ad0 con 0x55b640a656b0 2023-07-21T22:27:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 -- 172.21.15.151:0/172994367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 msgr2=0x55b640c10140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 --2- 172.21.15.151:0/172994367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c10140 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f267c005a60 tx=0x7f267c00f640 comp rx=0 tx=0).stop 2023-07-21T22:27:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 -- 172.21.15.151:0/172994367 shutdown_connections 2023-07-21T22:27:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 --2- 172.21.15.151:0/172994367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f660 0x55b640c15030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 --2- 172.21.15.151:0/172994367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c10140 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 --2- 172.21.15.151:0/172994367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f210 0x55b640c19ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 -- 172.21.15.151:0/172994367 >> 172.21.15.151:0/172994367 conn(0x55b640bfeae0 msgr2=0x55b640c0fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 -- 172.21.15.151:0/172994367 shutdown_connections 2023-07-21T22:27:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 -- 172.21.15.151:0/172994367 wait complete. 2023-07-21T22:27:36.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.871+0000 7f26a2926b80 1 -- start start 2023-07-21T22:27:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.872+0000 7f26a2926b80 1 Processor -- start 2023-07-21T22:27:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.872+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c0baf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.872+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f210 0x55b640c0c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f26a2926b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 0x55b640c0a730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f26a2926b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640c0ac70 con 0x55b640c0f210 2023-07-21T22:27:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f26a2926b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640c0ade0 con 0x55b640c0f660 2023-07-21T22:27:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f26a2926b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b640c0afa0 con 0x55b640a656b0 2023-07-21T22:27:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f26a2926b80 10 client.0 _ll_register_callbacks cb 0x7f2680009e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:27:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f2687fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f210 0x55b640c0c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f2687fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f210 0x55b640c0c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44488/0 (socket says 172.21.15.151:44488) 2023-07-21T22:27:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f2687fff700 1 -- 172.21.15.151:0/1415955162 learned_addr learned my addr 172.21.15.151:0/1415955162 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f268d59c700 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 0x55b640c0a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f268cd9b700 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c0baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f2687fff700 1 -- 172.21.15.151:0/1415955162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 msgr2=0x55b640c0baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f2687fff700 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c0baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f2687fff700 1 -- 172.21.15.151:0/1415955162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 msgr2=0x55b640c0a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f2687fff700 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 0x55b640c0a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.873+0000 7f2687fff700 1 -- 172.21.15.151:0/1415955162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b640971c00 con 0x55b640c0f210 2023-07-21T22:27:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.874+0000 7f2687fff700 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f210 0x55b640c0c030 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f267400f740 tx=0x7f2674005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fddaa3f843413f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.874+0000 7f2667fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:27:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.874+0000 7f2667fff700 1 -- 172.21.15.151:0/1415955162 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26740860b0 con 0x55b640c0f210 2023-07-21T22:27:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.874+0000 7f2667fff700 1 -- 172.21.15.151:0/1415955162 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2674022850 con 0x55b640c0f210 2023-07-21T22:27:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.874+0000 7f26a2926b80 1 -- 172.21.15.151:0/1415955162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f267c00fd00 con 0x55b640c0f210 2023-07-21T22:27:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.874+0000 7f2667fff700 1 -- 172.21.15.151:0/1415955162 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=41) v2 ==== 24+0+0 (secure 0 0 0) 0x7f267409b400 con 0x55b640c0f210 2023-07-21T22:27:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.874+0000 7f26a2926b80 10 client.16986 fetch_fsmap learned FSMap version 41 2023-07-21T22:27:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.874+0000 7f26a2926b80 1 -- 172.21.15.151:0/1415955162 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=41,monmap=4+}) v3 -- 0x55b6409af1f0 con 0x55b640c0f210 2023-07-21T22:27:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.874+0000 7f2667fff700 1 -- 172.21.15.151:0/1415955162 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f267c00fd00 con 0x55b640c0f210 2023-07-21T22:27:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.875+0000 7f2667fff700 1 -- 172.21.15.151:0/1415955162 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 41) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f26740a10b0 con 0x55b640c0f210 2023-07-21T22:27:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.875+0000 7f26a2926b80 10 client.16986 fetch_fsmap finished waiting for FSMap version 41 2023-07-21T22:27:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.875+0000 7f26a2926b80 10 client.16986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:27:36.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.875+0000 7f26a2926b80 20 client.16986 populate_metadata read hostname 'smithi151' 2023-07-21T22:27:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.875+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b640c77350 0x55b640c79760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.875+0000 7f26a2926b80 4 client.16986 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:27:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.875+0000 7f26a2926b80 1 -- 172.21.15.151:0/1415955162 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b640b15ff0 con 0x55b640c77350 2023-07-21T22:27:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.875+0000 7f268cd9b700 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b640c77350 0x55b640c79760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.877+0000 7f268cd9b700 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b640c77350 0x55b640c79760 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd1794e8ba071581 server_cookie=30eff07eed6d3735 in_seq=0 out_seq=0 2023-07-21T22:27:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.877+0000 7f2667fff700 10 client.16986 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f2667fff700 1 -- 172.21.15.151:0/1415955162 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b640b15ff0 con 0x55b640c77350 2023-07-21T22:27:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f2667fff700 10 client.16986 handle_command_reply: tid=0 2023-07-21T22:27:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 client.16986 shutdown 2023-07-21T22:27:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 -- 172.21.15.151:0/1415955162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f210 msgr2=0x55b640c0c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f210 0x55b640c0c030 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f267400f740 tx=0x7f2674005fd0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 -- 172.21.15.151:0/1415955162 shutdown_connections 2023-07-21T22:27:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b640c77350 0x55b640c79760 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b640c0f660 0x55b640c0a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b640a656b0 0x55b640c0baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f2667fff700 0 client.16986 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:36.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 --2- 172.21.15.151:0/1415955162 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b640c0f210 0x55b640c0c030 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 -- 172.21.15.151:0/1415955162 >> 172.21.15.151:0/1415955162 conn(0x55b640bfeae0 msgr2=0x55b640c10130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 -- 172.21.15.151:0/1415955162 shutdown_connections 2023-07-21T22:27:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 1 -- 172.21.15.151:0/1415955162 wait complete. 2023-07-21T22:27:36.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.897+0000 7f26a2926b80 20 client.16986 trim_cache size 0 max 16384 2023-07-21T22:27:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:27:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:27:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:27:36.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:27:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 -- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26780a1340 msgr2=0x7f26780a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:36.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26780a1340 0x7f26780a37f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f268819e9f0 tx=0x7f2680004b40 comp rx=0 tx=0).stop 2023-07-21T22:27:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 -- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 msgr2=0x7f268819e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 0x7f268819e230 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2674000c00 tx=0x7f2674009570 comp rx=0 tx=0).stop 2023-07-21T22:27:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 -- 172.21.15.151:0/3674579856 shutdown_connections 2023-07-21T22:27:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26780a1340 0x7f26780a37f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26880679a0 0x7f268819dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f268810c540 0x7f2688197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 --2- 172.21.15.151:0/3674579856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26880682b0 0x7f268819e230 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 -- 172.21.15.151:0/3674579856 >> 172.21.15.151:0/3674579856 conn(0x7f2688074760 msgr2=0x7f26880fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 -- 172.21.15.151:0/3674579856 shutdown_connections 2023-07-21T22:27:36.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:36.898+0000 7f268efff700 1 -- 172.21.15.151:0/3674579856 wait complete. 2023-07-21T22:27:37.068 INFO:teuthology.orchestra.run.smithi151.stderr:35200000 of 50000000 tuples (70%) done (elapsed 480.56 s, remaining 202.05 s) 2023-07-21T22:27:38.301 INFO:teuthology.orchestra.run.smithi151.stderr:35300000 of 50000000 tuples (70%) done (elapsed 481.79 s, remaining 200.63 s) 2023-07-21T22:27:38.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:38 smithi151 ceph-mon[95510]: pgmap v260: 97 pgs: 97 active+clean; 8.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 25 MiB/s wr, 94 op/s 2023-07-21T22:27:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:38 smithi187 ceph-mon[96918]: pgmap v260: 97 pgs: 97 active+clean; 8.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 25 MiB/s wr, 94 op/s 2023-07-21T22:27:38.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:38 smithi195 ceph-mon[97365]: pgmap v260: 97 pgs: 97 active+clean; 8.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 25 MiB/s wr, 94 op/s 2023-07-21T22:27:39.738 INFO:teuthology.orchestra.run.smithi151.stderr:35400000 of 50000000 tuples (70%) done (elapsed 483.23 s, remaining 199.30 s) 2023-07-21T22:27:40.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:40 smithi151 ceph-mon[95510]: pgmap v261: 97 pgs: 97 active+clean; 8.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-07-21T22:27:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:40 smithi187 ceph-mon[96918]: pgmap v261: 97 pgs: 97 active+clean; 8.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-07-21T22:27:40.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:40 smithi195 ceph-mon[97365]: pgmap v261: 97 pgs: 97 active+clean; 8.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-07-21T22:27:40.942 INFO:teuthology.orchestra.run.smithi151.stderr:35500000 of 50000000 tuples (71%) done (elapsed 484.43 s, remaining 197.87 s) 2023-07-21T22:27:42.179 INFO:teuthology.orchestra.run.smithi151.stderr:35600000 of 50000000 tuples (71%) done (elapsed 485.67 s, remaining 196.45 s) 2023-07-21T22:27:42.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:42 smithi151 ceph-mon[95510]: pgmap v262: 97 pgs: 97 active+clean; 8.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-07-21T22:27:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:42 smithi187 ceph-mon[96918]: pgmap v262: 97 pgs: 97 active+clean; 8.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-07-21T22:27:42.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:42 smithi195 ceph-mon[97365]: pgmap v262: 97 pgs: 97 active+clean; 8.1 GiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-07-21T22:27:43.407 INFO:teuthology.orchestra.run.smithi151.stderr:35700000 of 50000000 tuples (71%) done (elapsed 486.90 s, remaining 195.03 s) 2023-07-21T22:27:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:44 smithi151 ceph-mon[95510]: pgmap v263: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:27:44.731 INFO:teuthology.orchestra.run.smithi151.stderr:35800000 of 50000000 tuples (71%) done (elapsed 488.22 s, remaining 193.65 s) 2023-07-21T22:27:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:44 smithi187 ceph-mon[96918]: pgmap v263: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:27:44.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:44 smithi195 ceph-mon[97365]: pgmap v263: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:27:45.959 INFO:teuthology.orchestra.run.smithi151.stderr:35900000 of 50000000 tuples (71%) done (elapsed 489.45 s, remaining 192.24 s) 2023-07-21T22:27:46.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:46 smithi151 ceph-mon[95510]: pgmap v264: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 23 MiB/s wr, 55 op/s 2023-07-21T22:27:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:46 smithi187 ceph-mon[96918]: pgmap v264: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 23 MiB/s wr, 55 op/s 2023-07-21T22:27:46.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:46 smithi195 ceph-mon[97365]: pgmap v264: 97 pgs: 97 active+clean; 8.1 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 23 MiB/s wr, 55 op/s 2023-07-21T22:27:47.201 INFO:teuthology.orchestra.run.smithi151.stderr:36000000 of 50000000 tuples (72%) done (elapsed 490.69 s, remaining 190.82 s) 2023-07-21T22:27:48.536 INFO:teuthology.orchestra.run.smithi151.stderr:36100000 of 50000000 tuples (72%) done (elapsed 492.03 s, remaining 189.45 s) 2023-07-21T22:27:48.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:48 smithi151 ceph-mon[95510]: pgmap v265: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:27:48.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:48 smithi187 ceph-mon[96918]: pgmap v265: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:27:48.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:48 smithi195 ceph-mon[97365]: pgmap v265: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:27:49.790 INFO:teuthology.orchestra.run.smithi151.stderr:36200000 of 50000000 tuples (72%) done (elapsed 493.28 s, remaining 188.05 s) 2023-07-21T22:27:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.059+0000 7fb8463ff700 1 -- 172.21.15.151:0/3605074079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb840104e50 msgr2=0x7fb84010ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.059+0000 7fb8463ff700 1 --2- 172.21.15.151:0/3605074079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb840104e50 0x7fb84010ca00 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb83800b0a0 tx=0x7fb83800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.059+0000 7fb8463ff700 1 -- 172.21.15.151:0/3605074079 shutdown_connections 2023-07-21T22:27:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.059+0000 7fb8463ff700 1 --2- 172.21.15.151:0/3605074079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb840104e50 0x7fb84010ca00 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.059+0000 7fb8463ff700 1 --2- 172.21.15.151:0/3605074079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb840067c10 0x7fb840067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.059+0000 7fb8463ff700 1 --2- 172.21.15.151:0/3605074079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8400685b0 0x7fb840104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.059+0000 7fb8463ff700 1 -- 172.21.15.151:0/3605074079 >> 172.21.15.151:0/3605074079 conn(0x7fb840074760 msgr2=0x7fb840074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.059+0000 7fb8463ff700 1 -- 172.21.15.151:0/3605074079 shutdown_connections 2023-07-21T22:27:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.060+0000 7fb8463ff700 1 -- 172.21.15.151:0/3605074079 wait complete. 2023-07-21T22:27:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.060+0000 7fb8463ff700 1 Processor -- start 2023-07-21T22:27:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.061+0000 7fb8463ff700 1 -- start start 2023-07-21T22:27:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.061+0000 7fb8463ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb840067c10 0x7fb840197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.061+0000 7fb8463ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8400685b0 0x7fb840198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.061+0000 7fb8463ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb840104e50 0x7fb84019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.061+0000 7fb8463ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84019cfd0 con 0x7fb840104e50 2023-07-21T22:27:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.061+0000 7fb8463ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84019d140 con 0x7fb840067c10 2023-07-21T22:27:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.061+0000 7fb8463ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84019d300 con 0x7fb8400685b0 2023-07-21T22:27:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.061+0000 7fb84499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb840104e50 0x7fb84019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb840067c10 0x7fb840197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb840067c10 0x7fb840197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52326/0 (socket says 172.21.15.151:52326) 2023-07-21T22:27:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb83ffff700 1 -- 172.21.15.151:0/1477681634 learned_addr learned my addr 172.21.15.151:0/1477681634 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8400685b0 0x7fb840198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb84499c700 1 -- 172.21.15.151:0/1477681634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8400685b0 msgr2=0x7fb840198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb84499c700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8400685b0 0x7fb840198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb84499c700 1 -- 172.21.15.151:0/1477681634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb840067c10 msgr2=0x7fb840197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb84499c700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb840067c10 0x7fb840197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb84499c700 1 -- 172.21.15.151:0/1477681634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb830009520 con 0x7fb840104e50 2023-07-21T22:27:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb83ffff700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb840067c10 0x7fb840197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:27:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.062+0000 7fb84499c700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb840104e50 0x7fb84019c990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb83800b0a0 tx=0x7fb8380078c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:50.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.063+0000 7fb83d7fa700 1 -- 172.21.15.151:0/1477681634 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83800e040 con 0x7fb840104e50 2023-07-21T22:27:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.063+0000 7fb8463ff700 1 -- 172.21.15.151:0/1477681634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb838009d00 con 0x7fb840104e50 2023-07-21T22:27:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.063+0000 7fb83d7fa700 1 -- 172.21.15.151:0/1477681634 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb83800be40 con 0x7fb840104e50 2023-07-21T22:27:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.063+0000 7fb83d7fa700 1 -- 172.21.15.151:0/1477681634 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb838005040 con 0x7fb840104e50 2023-07-21T22:27:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.063+0000 7fb8463ff700 1 -- 172.21.15.151:0/1477681634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8401a4c40 con 0x7fb840104e50 2023-07-21T22:27:50.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.066+0000 7fb83d7fa700 1 -- 172.21.15.151:0/1477681634 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fb83801d470 con 0x7fb840104e50 2023-07-21T22:27:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb859dd9b80 1 Processor -- start 2023-07-21T22:27:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb83d7fa700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb8280a12c0 0x7fb8280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb859dd9b80 1 -- start start 2023-07-21T22:27:50.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb83d7fa700 1 -- 172.21.15.151:0/1477681634 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb8380ce180 con 0x7fb840104e50 2023-07-21T22:27:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb8280a12c0 0x7fb8280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e57f116b0 0x557e580bacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e580b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e57fbac50 con 0x557e580bb660 2023-07-21T22:27:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e5800d9e0 con 0x557e57f116b0 2023-07-21T22:27:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.068+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e58006e70 con 0x557e580bb210 2023-07-21T22:27:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb84499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e580b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb8280a12c0 0x7fb8280a3770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb840199600 tx=0x7fb834009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:50.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb83f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb84499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e580b54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36952/0 (socket says 172.21.15.151:36952) 2023-07-21T22:27:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb84499c700 1 -- 172.21.15.151:0/1864676376 learned_addr learned my addr 172.21.15.151:0/1864676376 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb83ffff700 1 --2- 172.21.15.151:0/1864676376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e57f116b0 0x557e580bacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb84499c700 1 -- 172.21.15.151:0/1864676376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 msgr2=0x557e580b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb84499c700 1 --2- 172.21.15.151:0/1864676376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb84499c700 1 -- 172.21.15.151:0/1864676376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e57f116b0 msgr2=0x557e580bacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb84499c700 1 --2- 172.21.15.151:0/1864676376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e57f116b0 0x557e580bacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb84499c700 1 -- 172.21.15.151:0/1864676376 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e57e34d80 con 0x557e580bb660 2023-07-21T22:27:50.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb83ffff700 1 --2- 172.21.15.151:0/1864676376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e57f116b0 0x557e580bacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:27:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.069+0000 7fb84499c700 1 --2- 172.21.15.151:0/1864676376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e580b54a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb838097800 tx=0x7fb8380099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a3dbd50edbaf20c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.070+0000 7fb8267fc700 1 -- 172.21.15.151:0/1864676376 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb83809f160 con 0x557e580bb660 2023-07-21T22:27:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.070+0000 7fb8267fc700 1 -- 172.21.15.151:0/1864676376 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb83802e350 con 0x557e580bb660 2023-07-21T22:27:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.070+0000 7fb8267fc700 1 -- 172.21.15.151:0/1864676376 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8380a10d0 con 0x557e580bb660 2023-07-21T22:27:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1864676376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 msgr2=0x557e580b54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/1864676376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e580b54a0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fb838097800 tx=0x7fb8380099e0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1864676376 shutdown_connections 2023-07-21T22:27:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/1864676376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e57f116b0 0x557e580bacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/1864676376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e580b54a0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/1864676376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1864676376 >> 172.21.15.151:0/1864676376 conn(0x557e580aaae0 msgr2=0x557e580b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1864676376 shutdown_connections 2023-07-21T22:27:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1864676376 wait complete. 2023-07-21T22:27:50.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.071+0000 7fb859dd9b80 1 -- start start 2023-07-21T22:27:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb859dd9b80 1 Processor -- start 2023-07-21T22:27:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580c43d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580c4910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580be6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e57fa6a60 con 0x557e57f116b0 2023-07-21T22:27:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e57fa6760 con 0x557e580bb660 2023-07-21T22:27:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e57e8a8c0 con 0x557e580bb210 2023-07-21T22:27:50.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb859dd9b80 10 client.0 _ll_register_callbacks cb 0x557e57fa4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:27:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580c43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580c43d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36968/0 (socket says 172.21.15.151:36968) 2023-07-21T22:27:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.072+0000 7fb83ffff700 1 -- 172.21.15.151:0/3313281849 learned_addr learned my addr 172.21.15.151:0/3313281849 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580c4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb84499c700 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580be6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb83ffff700 1 -- 172.21.15.151:0/3313281849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 msgr2=0x557e580c4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb83ffff700 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580c4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb83ffff700 1 -- 172.21.15.151:0/3313281849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 msgr2=0x557e580be6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb83ffff700 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580be6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb83ffff700 1 -- 172.21.15.151:0/3313281849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb830011440 con 0x557e57f116b0 2023-07-21T22:27:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb84499c700 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580be6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:27:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb83ffff700 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580c43d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb83000f440 tx=0x7fb83000f800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=220a51e79ee5c9a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb81f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:27:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb81f7fe700 1 -- 172.21.15.151:0/3313281849 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830017070 con 0x557e57f116b0 2023-07-21T22:27:50.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb81f7fe700 1 -- 172.21.15.151:0/3313281849 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb83000e5c0 con 0x557e57f116b0 2023-07-21T22:27:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.073+0000 7fb859dd9b80 1 -- 172.21.15.151:0/3313281849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e57f60490 con 0x557e57f116b0 2023-07-21T22:27:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb81f7fe700 1 -- 172.21.15.151:0/3313281849 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb830004830 con 0x557e57f116b0 2023-07-21T22:27:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb859dd9b80 10 client.16998 fetch_fsmap learned FSMap version 42 2023-07-21T22:27:50.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb859dd9b80 1 -- 172.21.15.151:0/3313281849 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x7fb8401a4c40 con 0x557e57f116b0 2023-07-21T22:27:50.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb81f7fe700 1 -- 172.21.15.151:0/3313281849 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb830028020 con 0x557e57f116b0 2023-07-21T22:27:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb81f7fe700 1 -- 172.21.15.151:0/3313281849 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 42) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb83000e780 con 0x557e57f116b0 2023-07-21T22:27:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb859dd9b80 10 client.16998 fetch_fsmap finished waiting for FSMap version 42 2023-07-21T22:27:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb859dd9b80 10 client.16998 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:27:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb859dd9b80 20 client.16998 populate_metadata read hostname 'smithi151' 2023-07-21T22:27:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e580cea00 0x557e580d0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb859dd9b80 4 client.16998 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:27:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.074+0000 7fb859dd9b80 1 -- 172.21.15.151:0/3313281849 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e57fffe50 con 0x557e580cea00 2023-07-21T22:27:50.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.075+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e580cea00 0x557e580d0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.075+0000 7fb81f7fe700 10 client.16998 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.075+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e580cea00 0x557e580d0e10 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e2951053c6957cf server_cookie=c1561ac0f29793f2 in_seq=0 out_seq=0 2023-07-21T22:27:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb81f7fe700 1 -- 172.21.15.151:0/3313281849 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557e57fffe50 con 0x557e580cea00 2023-07-21T22:27:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb81f7fe700 10 client.16998 handle_command_reply: tid=0 2023-07-21T22:27:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb859dd9b80 1 client.16998 shutdown 2023-07-21T22:27:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb859dd9b80 1 -- 172.21.15.151:0/3313281849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 msgr2=0x557e580c43d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:50.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580c43d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fb83000f440 tx=0x7fb83000f800 comp rx=0 tx=0).stop 2023-07-21T22:27:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb859dd9b80 1 -- 172.21.15.151:0/3313281849 shutdown_connections 2023-07-21T22:27:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e580cea00 0x557e580d0e10 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580be6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580c43d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/3313281849 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580c4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb859dd9b80 1 -- 172.21.15.151:0/3313281849 >> 172.21.15.151:0/3313281849 conn(0x557e580aaae0 msgr2=0x557e580af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.076+0000 7fb81f7fe700 0 client.16998 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:50.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.077+0000 7fb859dd9b80 1 -- 172.21.15.151:0/3313281849 shutdown_connections 2023-07-21T22:27:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.077+0000 7fb859dd9b80 1 -- 172.21.15.151:0/3313281849 wait complete. 2023-07-21T22:27:50.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.077+0000 7fb859dd9b80 20 client.16998 trim_cache size 0 max 16384 2023-07-21T22:27:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb859dd9b80 1 Processor -- start 2023-07-21T22:27:50.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb859dd9b80 1 -- start start 2023-07-21T22:27:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580be720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580afb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e57fffe50 con 0x557e57f116b0 2023-07-21T22:27:50.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e580ba920 con 0x557e580bb660 2023-07-21T22:27:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e580b9180 con 0x557e580bb210 2023-07-21T22:27:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580be720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36978/0 (socket says 172.21.15.151:36978) 2023-07-21T22:27:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb83ffff700 1 -- 172.21.15.151:0/1653099549 learned_addr learned my addr 172.21.15.151:0/1653099549 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.095+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb84499c700 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580afb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb83ffff700 1 -- 172.21.15.151:0/1653099549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 msgr2=0x557e580b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb83ffff700 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb83ffff700 1 -- 172.21.15.151:0/1653099549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 msgr2=0x557e580afb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb83ffff700 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580afb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb83ffff700 1 -- 172.21.15.151:0/1653099549 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e57e1dc00 con 0x557e57f116b0 2023-07-21T22:27:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb84499c700 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:27:50.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb83ffff700 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580be720 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb83000f410 tx=0x7fb830009480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b70f32f5b4d5f6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:50.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb826ffd700 1 -- 172.21.15.151:0/1653099549 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830017040 con 0x557e57f116b0 2023-07-21T22:27:50.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb826ffd700 1 -- 172.21.15.151:0/1653099549 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb830028030 con 0x557e57f116b0 2023-07-21T22:27:50.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.096+0000 7fb826ffd700 1 -- 172.21.15.151:0/1653099549 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830003680 con 0x557e57f116b0 2023-07-21T22:27:50.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.097+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1653099549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 msgr2=0x557e580be720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:50.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.097+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580be720 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fb83000f410 tx=0x7fb830009480 comp rx=0 tx=0).stop 2023-07-21T22:27:50.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.097+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1653099549 shutdown_connections 2023-07-21T22:27:50.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.097+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb660 0x557e580afb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.097+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e57f116b0 0x557e580be720 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.097+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/1653099549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e580bb210 0x557e580b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.097+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1653099549 >> 172.21.15.151:0/1653099549 conn(0x557e580aaae0 msgr2=0x557e580be010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.097+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1653099549 shutdown_connections 2023-07-21T22:27:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.097+0000 7fb859dd9b80 1 -- 172.21.15.151:0/1653099549 wait complete. 2023-07-21T22:27:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.098+0000 7fb859dd9b80 1 -- start start 2023-07-21T22:27:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.098+0000 7fb859dd9b80 1 Processor -- start 2023-07-21T22:27:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.098+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e57f116b0 0x557e580c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.098+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb210 0x557e580c25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.098+0000 7fb859dd9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e58121880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.098+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e580c2da0 con 0x557e580bb660 2023-07-21T22:27:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.098+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e580c2f10 con 0x557e580bb210 2023-07-21T22:27:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.098+0000 7fb859dd9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e58121df0 con 0x557e57f116b0 2023-07-21T22:27:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.098+0000 7fb859dd9b80 10 client.0 _ll_register_callbacks cb 0x7fb830012b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:27:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb84499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e58121880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e57f116b0 0x557e580c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb83ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e57f116b0 0x557e580c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:41390/0 (socket says 172.21.15.151:41390) 2023-07-21T22:27:50.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb83ffff700 1 -- 172.21.15.151:0/162764559 learned_addr learned my addr 172.21.15.151:0/162764559 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:27:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb84499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e58121880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36994/0 (socket says 172.21.15.151:36994) 2023-07-21T22:27:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb210 0x557e580c25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb83ffff700 1 -- 172.21.15.151:0/162764559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb210 msgr2=0x557e580c25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb83ffff700 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb210 0x557e580c25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb83ffff700 1 -- 172.21.15.151:0/162764559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 msgr2=0x557e58121880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:27:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb83ffff700 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e58121880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb83ffff700 1 -- 172.21.15.151:0/162764559 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8401a4c40 con 0x557e57f116b0 2023-07-21T22:27:50.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.099+0000 7fb84499c700 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e58121880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:27:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.100+0000 7fb83ffff700 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e57f116b0 0x557e580c20a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb83002f040 tx=0x7fb830012be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7ec0c72549daefb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:27:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.100+0000 7fb81f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:27:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.100+0000 7fb81f7fe700 1 -- 172.21.15.151:0/162764559 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb830017070 con 0x557e57f116b0 2023-07-21T22:27:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.100+0000 7fb859dd9b80 1 -- 172.21.15.151:0/162764559 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb83802e350 con 0x557e57f116b0 2023-07-21T22:27:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.100+0000 7fb81f7fe700 1 -- 172.21.15.151:0/162764559 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb830029080 con 0x557e57f116b0 2023-07-21T22:27:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.100+0000 7fb81f7fe700 1 -- 172.21.15.151:0/162764559 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb83000e8d0 con 0x557e57f116b0 2023-07-21T22:27:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.100+0000 7fb859dd9b80 10 client.26737 fetch_fsmap learned FSMap version 42 2023-07-21T22:27:50.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.100+0000 7fb859dd9b80 1 -- 172.21.15.151:0/162764559 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x557e57e5b1f0 con 0x557e57f116b0 2023-07-21T22:27:50.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.101+0000 7fb81f7fe700 1 -- 172.21.15.151:0/162764559 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb83802e350 con 0x557e57f116b0 2023-07-21T22:27:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.101+0000 7fb81f7fe700 1 -- 172.21.15.151:0/162764559 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 42) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fb830003b90 con 0x557e57f116b0 2023-07-21T22:27:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.101+0000 7fb859dd9b80 10 client.26737 fetch_fsmap finished waiting for FSMap version 42 2023-07-21T22:27:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.101+0000 7fb859dd9b80 10 client.26737 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:27:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.101+0000 7fb859dd9b80 20 client.26737 populate_metadata read hostname 'smithi151' 2023-07-21T22:27:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.101+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e58123110 0x557e58125520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:27:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.101+0000 7fb859dd9b80 4 client.26737 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:27:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.101+0000 7fb859dd9b80 1 -- 172.21.15.151:0/162764559 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557e57fc1ff0 con 0x557e58123110 2023-07-21T22:27:50.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.101+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e58123110 0x557e58125520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:27:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.102+0000 7fb83f7fe700 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e58123110 0x557e58125520 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e6512a3c1c212b5 server_cookie=413de5aa086baaa9 in_seq=0 out_seq=0 2023-07-21T22:27:50.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.102+0000 7fb81f7fe700 10 client.26737 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb81f7fe700 1 -- 172.21.15.151:0/162764559 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557e57fc1ff0 con 0x557e58123110 2023-07-21T22:27:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb81f7fe700 10 client.26737 handle_command_reply: tid=0 2023-07-21T22:27:50.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb859dd9b80 1 client.26737 shutdown 2023-07-21T22:27:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb859dd9b80 1 -- 172.21.15.151:0/162764559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e57f116b0 msgr2=0x557e580c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e57f116b0 0x557e580c20a0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb83002f040 tx=0x7fb830012be0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb859dd9b80 1 -- 172.21.15.151:0/162764559 shutdown_connections 2023-07-21T22:27:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e58123110 0x557e58125520 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e580bb660 0x557e58121880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e57f116b0 0x557e580c20a0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb81f7fe700 0 client.26737 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:27:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb859dd9b80 1 --2- 172.21.15.151:0/162764559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e580bb210 0x557e580c25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.117+0000 7fb859dd9b80 1 -- 172.21.15.151:0/162764559 >> 172.21.15.151:0/162764559 conn(0x557e580aaae0 msgr2=0x557e580bba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:50.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.118+0000 7fb859dd9b80 1 -- 172.21.15.151:0/162764559 shutdown_connections 2023-07-21T22:27:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.118+0000 7fb859dd9b80 1 -- 172.21.15.151:0/162764559 wait complete. 2023-07-21T22:27:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.118+0000 7fb859dd9b80 20 client.26737 trim_cache size 0 max 16384 2023-07-21T22:27:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:27:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:27:50.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:27:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:27:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 -- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb8280a12c0 msgr2=0x7fb8280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb8280a12c0 0x7fb8280a3770 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb840199600 tx=0x7fb834009260 comp rx=0 tx=0).stop 2023-07-21T22:27:50.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 -- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb840104e50 msgr2=0x7fb84019c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:27:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb840104e50 0x7fb84019c990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fb83800b0a0 tx=0x7fb8380078c0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 -- 172.21.15.151:0/1477681634 shutdown_connections 2023-07-21T22:27:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb8280a12c0 0x7fb8280a3770 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb840067c10 0x7fb840197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb840104e50 0x7fb84019c990 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 --2- 172.21.15.151:0/1477681634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb8400685b0 0x7fb840198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:27:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 -- 172.21.15.151:0/1477681634 >> 172.21.15.151:0/1477681634 conn(0x7fb840074760 msgr2=0x7fb8400fc980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:27:50.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 -- 172.21.15.151:0/1477681634 shutdown_connections 2023-07-21T22:27:50.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:27:50.119+0000 7fb8463ff700 1 -- 172.21.15.151:0/1477681634 wait complete. 2023-07-21T22:27:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:50 smithi151 ceph-mon[95510]: pgmap v266: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:50 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:27:50.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:50 smithi187 ceph-mon[96918]: pgmap v266: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:50.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:50 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:27:50.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:50 smithi195 ceph-mon[97365]: pgmap v266: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:50 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:27:51.012 INFO:teuthology.orchestra.run.smithi151.stderr:36300000 of 50000000 tuples (72%) done (elapsed 494.50 s, remaining 186.63 s) 2023-07-21T22:27:52.345 INFO:teuthology.orchestra.run.smithi151.stderr:36400000 of 50000000 tuples (72%) done (elapsed 495.84 s, remaining 185.26 s) 2023-07-21T22:27:52.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:52 smithi151 ceph-mon[95510]: pgmap v267: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:52.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:52 smithi187 ceph-mon[96918]: pgmap v267: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:52.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:52 smithi195 ceph-mon[97365]: pgmap v267: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 24 MiB/s wr, 55 op/s 2023-07-21T22:27:53.604 INFO:teuthology.orchestra.run.smithi151.stderr:36500000 of 50000000 tuples (73%) done (elapsed 497.10 s, remaining 183.86 s) 2023-07-21T22:27:54.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:54 smithi151 ceph-mon[95510]: pgmap v268: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 35 MiB/s wr, 73 op/s 2023-07-21T22:27:54.824 INFO:teuthology.orchestra.run.smithi151.stderr:36600000 of 50000000 tuples (73%) done (elapsed 498.31 s, remaining 182.44 s) 2023-07-21T22:27:54.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:54 smithi187 ceph-mon[96918]: pgmap v268: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 35 MiB/s wr, 73 op/s 2023-07-21T22:27:54.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:54 smithi195 ceph-mon[97365]: pgmap v268: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 35 MiB/s wr, 73 op/s 2023-07-21T22:27:56.060 INFO:teuthology.orchestra.run.smithi151.stderr:36700000 of 50000000 tuples (73%) done (elapsed 499.55 s, remaining 181.04 s) 2023-07-21T22:27:56.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:56 smithi151 ceph-mon[95510]: pgmap v269: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-07-21T22:27:56.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:56 smithi187 ceph-mon[96918]: pgmap v269: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-07-21T22:27:56.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:56 smithi195 ceph-mon[97365]: pgmap v269: 97 pgs: 97 active+clean; 8.3 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 24 MiB/s wr, 53 op/s 2023-07-21T22:27:57.408 INFO:teuthology.orchestra.run.smithi151.stderr:36800000 of 50000000 tuples (73%) done (elapsed 500.90 s, remaining 179.67 s) 2023-07-21T22:27:58.667 INFO:teuthology.orchestra.run.smithi151.stderr:36900000 of 50000000 tuples (73%) done (elapsed 502.16 s, remaining 178.27 s) 2023-07-21T22:27:58.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:27:58 smithi151 ceph-mon[95510]: pgmap v270: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:27:58.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:27:58 smithi187 ceph-mon[96918]: pgmap v270: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:27:58.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:27:58 smithi195 ceph-mon[97365]: pgmap v270: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:27:59.887 INFO:teuthology.orchestra.run.smithi151.stderr:37000000 of 50000000 tuples (74%) done (elapsed 503.38 s, remaining 176.86 s) 2023-07-21T22:28:00.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:00 smithi151 ceph-mon[95510]: pgmap v271: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:28:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:00 smithi187 ceph-mon[96918]: pgmap v271: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:28:00.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:00 smithi195 ceph-mon[97365]: pgmap v271: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:28:01.207 INFO:teuthology.orchestra.run.smithi151.stderr:37100000 of 50000000 tuples (74%) done (elapsed 504.70 s, remaining 175.49 s) 2023-07-21T22:28:02.549 INFO:teuthology.orchestra.run.smithi151.stderr:37200000 of 50000000 tuples (74%) done (elapsed 506.04 s, remaining 174.12 s) 2023-07-21T22:28:02.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:02 smithi187 ceph-mon[96918]: pgmap v272: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:28:02.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:02 smithi195 ceph-mon[97365]: pgmap v272: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:28:02.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:02 smithi151 ceph-mon[95510]: pgmap v272: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 24 MiB/s wr, 50 op/s 2023-07-21T22:28:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.291+0000 7f29693ff700 1 -- 172.21.15.151:0/3576925917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2964105b60 msgr2=0x7f2964105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.291+0000 7f29693ff700 1 --2- 172.21.15.151:0/3576925917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2964105b60 0x7f2964105f30 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f2954009990 tx=0x7f2954009ca0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.291+0000 7f29693ff700 1 -- 172.21.15.151:0/3576925917 shutdown_connections 2023-07-21T22:28:03.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.291+0000 7f29693ff700 1 --2- 172.21.15.151:0/3576925917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2964105b60 0x7f2964105f30 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.291+0000 7f29693ff700 1 --2- 172.21.15.151:0/3576925917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29641004e0 0x7f296410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.291+0000 7f29693ff700 1 --2- 172.21.15.151:0/3576925917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29640ffb30 0x7f29640fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.291+0000 7f29693ff700 1 -- 172.21.15.151:0/3576925917 >> 172.21.15.151:0/3576925917 conn(0x7f29640fb5f0 msgr2=0x7f29640fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.292+0000 7f29693ff700 1 -- 172.21.15.151:0/3576925917 shutdown_connections 2023-07-21T22:28:03.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.292+0000 7f29693ff700 1 -- 172.21.15.151:0/3576925917 wait complete. 2023-07-21T22:28:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.293+0000 7f29693ff700 1 Processor -- start 2023-07-21T22:28:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.293+0000 7f29693ff700 1 -- start start 2023-07-21T22:28:03.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.294+0000 7f29693ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29640ffb30 0x7f29640729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.294+0000 7f29693ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29641004e0 0x7f2964072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.294+0000 7f29693ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964105b60 0x7f29641a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.294+0000 7f29693ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29641a4240 con 0x7f2964105b60 2023-07-21T22:28:03.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.294+0000 7f29693ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29641a4380 con 0x7f29641004e0 2023-07-21T22:28:03.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.294+0000 7f29693ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29641a44f0 con 0x7f29640ffb30 2023-07-21T22:28:03.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29627fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29641004e0 0x7f2964072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29627fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29641004e0 0x7f2964072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35492/0 (socket says 172.21.15.151:35492) 2023-07-21T22:28:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29627fc700 1 -- 172.21.15.151:0/1392578400 learned_addr learned my addr 172.21.15.151:0/1392578400 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f2962ffd700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29640ffb30 0x7f29640729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29637fe700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964105b60 0x7f29641a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29627fc700 1 -- 172.21.15.151:0/1392578400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29640ffb30 msgr2=0x7f29640729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29627fc700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29640ffb30 0x7f29640729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29627fc700 1 -- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964105b60 msgr2=0x7f29641a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29627fc700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964105b60 0x7f29641a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29627fc700 1 -- 172.21.15.151:0/1392578400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29540095f0 con 0x7f29641004e0 2023-07-21T22:28:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.295+0000 7f29627fc700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29641004e0 0x7f2964072f30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f295800d950 tx=0x7f295800dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.296+0000 7f294bfff700 1 -- 172.21.15.151:0/1392578400 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2958009940 con 0x7f29641004e0 2023-07-21T22:28:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.296+0000 7f294bfff700 1 -- 172.21.15.151:0/1392578400 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2958010460 con 0x7f29641004e0 2023-07-21T22:28:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.296+0000 7f294bfff700 1 -- 172.21.15.151:0/1392578400 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295800f620 con 0x7f29641004e0 2023-07-21T22:28:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.296+0000 7f29693ff700 1 -- 172.21.15.151:0/1392578400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29641a47d0 con 0x7f29641004e0 2023-07-21T22:28:03.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.296+0000 7f29693ff700 1 -- 172.21.15.151:0/1392578400 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29641a4c90 con 0x7f29641004e0 2023-07-21T22:28:03.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.299+0000 7f294bfff700 1 -- 172.21.15.151:0/1392578400 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f29580105d0 con 0x7f29641004e0 2023-07-21T22:28:03.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.301+0000 7f297ce15b80 1 Processor -- start 2023-07-21T22:28:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.301+0000 7f297ce15b80 1 -- start start 2023-07-21T22:28:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.301+0000 7f294bfff700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f294c0a1340 0x7f294c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.301+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87bacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.301+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 0x558ee87b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.301+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 0x558ee87b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.301+0000 7f297ce15b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee86bac50 con 0x558ee86116b0 2023-07-21T22:28:03.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.301+0000 7f297ce15b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee870d9e0 con 0x558ee87bb210 2023-07-21T22:28:03.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f297ce15b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee8706e70 con 0x558ee87bb660 2023-07-21T22:28:03.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f294bfff700 1 -- 172.21.15.151:0/1392578400 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f29580ccb30 con 0x7f29641004e0 2023-07-21T22:28:03.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f29637fe700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f294c0a1340 0x7f294c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f2962ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87bacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f2962ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87bacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58246/0 (socket says 172.21.15.151:58246) 2023-07-21T22:28:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f2962ffd700 1 -- 172.21.15.151:0/1951619323 learned_addr learned my addr 172.21.15.151:0/1951619323 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f29637fe700 1 --2- 172.21.15.151:0/1951619323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 0x558ee87b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f29627fc700 1 --2- 172.21.15.151:0/1951619323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 0x558ee87b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f2962ffd700 1 -- 172.21.15.151:0/1951619323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 msgr2=0x558ee87b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f2962ffd700 1 --2- 172.21.15.151:0/1951619323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 0x558ee87b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f2962ffd700 1 -- 172.21.15.151:0/1951619323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 msgr2=0x558ee87b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f2962ffd700 1 --2- 172.21.15.151:0/1951619323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 0x558ee87b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.302+0000 7f2962ffd700 1 -- 172.21.15.151:0/1951619323 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ee8534d80 con 0x558ee86116b0 2023-07-21T22:28:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.303+0000 7f29637fe700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f294c0a1340 0x7f294c0a37f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f295c015da0 tx=0x7f295c015420 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.303+0000 7f2962ffd700 1 --2- 172.21.15.151:0/1951619323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87bacd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2954015000 tx=0x7f2954005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a15ca2750bf12bd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:03.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.303+0000 7f29497fa700 1 -- 172.21.15.151:0/1951619323 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954026070 con 0x558ee86116b0 2023-07-21T22:28:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.303+0000 7f29497fa700 1 -- 172.21.15.151:0/1951619323 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f295401e040 con 0x558ee86116b0 2023-07-21T22:28:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.303+0000 7f29497fa700 1 -- 172.21.15.151:0/1951619323 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295401d070 con 0x558ee86116b0 2023-07-21T22:28:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.304+0000 7f297ce15b80 1 -- 172.21.15.151:0/1951619323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 msgr2=0x558ee87bacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.304+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1951619323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87bacd0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f2954015000 tx=0x7f2954005c00 comp rx=0 tx=0).stop 2023-07-21T22:28:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.304+0000 7f297ce15b80 1 -- 172.21.15.151:0/1951619323 shutdown_connections 2023-07-21T22:28:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.304+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1951619323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 0x558ee87b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.304+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1951619323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87bacd0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.304+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1951619323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 0x558ee87b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.304+0000 7f297ce15b80 1 -- 172.21.15.151:0/1951619323 >> 172.21.15.151:0/1951619323 conn(0x558ee87aaae0 msgr2=0x558ee87b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.304+0000 7f297ce15b80 1 -- 172.21.15.151:0/1951619323 shutdown_connections 2023-07-21T22:28:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.304+0000 7f297ce15b80 1 -- 172.21.15.151:0/1951619323 wait complete. 2023-07-21T22:28:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.305+0000 7f297ce15b80 1 -- start start 2023-07-21T22:28:03.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.305+0000 7f297ce15b80 1 Processor -- start 2023-07-21T22:28:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee86116b0 0x558ee87c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb210 0x558ee87be720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb660 0x558ee87becc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f297ce15b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee86a6a60 con 0x558ee87bb210 2023-07-21T22:28:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f297ce15b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee86a6760 con 0x558ee87bb660 2023-07-21T22:28:03.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f297ce15b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee858a8c0 con 0x558ee86116b0 2023-07-21T22:28:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f297ce15b80 10 client.0 _ll_register_callbacks cb 0x558ee86a4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f29627fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb210 0x558ee87be720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f29627fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb210 0x558ee87be720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58258/0 (socket says 172.21.15.151:58258) 2023-07-21T22:28:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f29627fc700 1 -- 172.21.15.151:0/3964806680 learned_addr learned my addr 172.21.15.151:0/3964806680 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f2962ffd700 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee86116b0 0x558ee87c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.306+0000 7f29637fe700 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb660 0x558ee87becc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f2962ffd700 1 -- 172.21.15.151:0/3964806680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb660 msgr2=0x558ee87becc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f2962ffd700 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb660 0x558ee87becc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f2962ffd700 1 -- 172.21.15.151:0/3964806680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb210 msgr2=0x558ee87be720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f2962ffd700 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb210 0x558ee87be720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f2962ffd700 1 -- 172.21.15.151:0/3964806680 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f296410d220 con 0x558ee86116b0 2023-07-21T22:28:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f29627fc700 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb210 0x558ee87be720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:28:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f2962ffd700 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee86116b0 0x558ee87c14a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2954009350 tx=0x7f295400b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95530468a543246b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:03.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f2946ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:28:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f2946ff5700 1 -- 172.21.15.151:0/3964806680 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954026050 con 0x558ee86116b0 2023-07-21T22:28:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f297ce15b80 1 -- 172.21.15.151:0/3964806680 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558ee8660490 con 0x558ee86116b0 2023-07-21T22:28:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.307+0000 7f2946ff5700 1 -- 172.21.15.151:0/3964806680 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f295400bb30 con 0x558ee86116b0 2023-07-21T22:28:03.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f2946ff5700 1 -- 172.21.15.151:0/3964806680 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f295401d040 con 0x558ee86116b0 2023-07-21T22:28:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f297ce15b80 10 client.26749 fetch_fsmap learned FSMap version 42 2023-07-21T22:28:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f297ce15b80 1 -- 172.21.15.151:0/3964806680 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x558ee851dc00 con 0x558ee86116b0 2023-07-21T22:28:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f2946ff5700 1 -- 172.21.15.151:0/3964806680 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558ee8660490 con 0x558ee86116b0 2023-07-21T22:28:03.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f2946ff5700 1 -- 172.21.15.151:0/3964806680 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 42) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f295402b8c0 con 0x558ee86116b0 2023-07-21T22:28:03.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f297ce15b80 10 client.26749 fetch_fsmap finished waiting for FSMap version 42 2023-07-21T22:28:03.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f297ce15b80 10 client.26749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:03.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f297ce15b80 20 client.26749 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558ee87ce540 0x558ee87d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f297ce15b80 4 client.26749 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:28:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.308+0000 7f297ce15b80 1 -- 172.21.15.151:0/3964806680 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558ee86ffe50 con 0x558ee87ce540 2023-07-21T22:28:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.309+0000 7f29627fc700 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558ee87ce540 0x558ee87d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.309+0000 7f29627fc700 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558ee87ce540 0x558ee87d0920 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce100ca3c71eb59e server_cookie=694ace933756a3bd in_seq=0 out_seq=0 2023-07-21T22:28:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.309+0000 7f2946ff5700 10 client.26749 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f2946ff5700 1 -- 172.21.15.151:0/3964806680 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558ee86ffe50 con 0x558ee87ce540 2023-07-21T22:28:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f2946ff5700 10 client.26749 handle_command_reply: tid=0 2023-07-21T22:28:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 client.26749 shutdown 2023-07-21T22:28:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 -- 172.21.15.151:0/3964806680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee86116b0 msgr2=0x558ee87c14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee86116b0 0x558ee87c14a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2954009350 tx=0x7f295400b940 comp rx=0 tx=0).stop 2023-07-21T22:28:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 -- 172.21.15.151:0/3964806680 shutdown_connections 2023-07-21T22:28:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558ee87ce540 0x558ee87d0920 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb660 0x558ee87becc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee86116b0 0x558ee87c14a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f2946ff5700 0 client.26749 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3964806680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb210 0x558ee87be720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 -- 172.21.15.151:0/3964806680 >> 172.21.15.151:0/3964806680 conn(0x558ee87aaae0 msgr2=0x558ee87af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 -- 172.21.15.151:0/3964806680 shutdown_connections 2023-07-21T22:28:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.310+0000 7f297ce15b80 1 -- 172.21.15.151:0/3964806680 wait complete. 2023-07-21T22:28:03.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.311+0000 7f297ce15b80 20 client.26749 trim_cache size 0 max 16384 2023-07-21T22:28:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.329+0000 7f297ce15b80 1 Processor -- start 2023-07-21T22:28:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.329+0000 7f297ce15b80 1 -- start start 2023-07-21T22:28:03.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee86116b0 0x558ee87bc330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb210 0x558ee87c1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb660 0x558ee87b9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f297ce15b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee87b5cd0 con 0x558ee87bb660 2023-07-21T22:28:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f297ce15b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee87bfd00 con 0x558ee86116b0 2023-07-21T22:28:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f297ce15b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee87b6160 con 0x558ee87bb210 2023-07-21T22:28:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f29637fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb660 0x558ee87b9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f2962ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee86116b0 0x558ee87bc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f29637fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb660 0x558ee87b9f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58264/0 (socket says 172.21.15.151:58264) 2023-07-21T22:28:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f29637fe700 1 -- 172.21.15.151:0/3834129941 learned_addr learned my addr 172.21.15.151:0/3834129941 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f2962ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee86116b0 0x558ee87bc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35510/0 (socket says 172.21.15.151:35510) 2023-07-21T22:28:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.330+0000 7f29627fc700 1 --2- 172.21.15.151:0/3834129941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb210 0x558ee87c1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f29637fe700 1 -- 172.21.15.151:0/3834129941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb210 msgr2=0x558ee87c1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f29637fe700 1 --2- 172.21.15.151:0/3834129941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb210 0x558ee87c1040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f29637fe700 1 -- 172.21.15.151:0/3834129941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee86116b0 msgr2=0x558ee87bc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f29637fe700 1 --2- 172.21.15.151:0/3834129941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee86116b0 0x558ee87bc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f29637fe700 1 -- 172.21.15.151:0/3834129941 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558ee855b1f0 con 0x558ee87bb660 2023-07-21T22:28:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f29627fc700 1 --2- 172.21.15.151:0/3834129941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb210 0x558ee87c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:28:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f29637fe700 1 --2- 172.21.15.151:0/3834129941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb660 0x558ee87b9f30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f295c009fd0 tx=0x7f295c01c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0dbb18deb5f6d97 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f2949ffb700 1 -- 172.21.15.151:0/3834129941 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c00e040 con 0x558ee87bb660 2023-07-21T22:28:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f2949ffb700 1 -- 172.21.15.151:0/3834129941 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f295c019ea0 con 0x558ee87bb660 2023-07-21T22:28:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.331+0000 7f2949ffb700 1 -- 172.21.15.151:0/3834129941 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f295c026a10 con 0x558ee87bb660 2023-07-21T22:28:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.332+0000 7f297ce15b80 1 -- 172.21.15.151:0/3834129941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb660 msgr2=0x558ee87b9f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.332+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3834129941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb660 0x558ee87b9f30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f295c009fd0 tx=0x7f295c01c000 comp rx=0 tx=0).stop 2023-07-21T22:28:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.332+0000 7f297ce15b80 1 -- 172.21.15.151:0/3834129941 shutdown_connections 2023-07-21T22:28:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.332+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3834129941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee86116b0 0x558ee87bc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.332+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3834129941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee87bb660 0x558ee87b9f30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.332+0000 7f297ce15b80 1 --2- 172.21.15.151:0/3834129941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb210 0x558ee87c1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.332+0000 7f297ce15b80 1 -- 172.21.15.151:0/3834129941 >> 172.21.15.151:0/3834129941 conn(0x558ee87aaae0 msgr2=0x558ee87b9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.332+0000 7f297ce15b80 1 -- 172.21.15.151:0/3834129941 shutdown_connections 2023-07-21T22:28:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.332+0000 7f297ce15b80 1 -- 172.21.15.151:0/3834129941 wait complete. 2023-07-21T22:28:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.333+0000 7f297ce15b80 1 -- start start 2023-07-21T22:28:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.333+0000 7f297ce15b80 1 Processor -- start 2023-07-21T22:28:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.333+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87b7970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.333+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 0x558ee87b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.333+0000 7f297ce15b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 0x558ee87b6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.333+0000 7f297ce15b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee87c61c0 con 0x558ee86116b0 2023-07-21T22:28:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.333+0000 7f297ce15b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee87b6c70 con 0x558ee87bb210 2023-07-21T22:28:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.333+0000 7f297ce15b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558ee87b6e30 con 0x558ee87bb660 2023-07-21T22:28:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f297ce15b80 10 client.0 _ll_register_callbacks cb 0x7f295c0158f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2962ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87b7970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2962ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87b7970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58268/0 (socket says 172.21.15.151:58268) 2023-07-21T22:28:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2962ffd700 1 -- 172.21.15.151:0/1190446409 learned_addr learned my addr 172.21.15.151:0/1190446409 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f29637fe700 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 0x558ee87b6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f29627fc700 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 0x558ee87b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2962ffd700 1 -- 172.21.15.151:0/1190446409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 msgr2=0x558ee87b6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2962ffd700 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 0x558ee87b6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2962ffd700 1 -- 172.21.15.151:0/1190446409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 msgr2=0x558ee87b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2962ffd700 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 0x558ee87b7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2962ffd700 1 -- 172.21.15.151:0/1190446409 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f295c009e40 con 0x558ee86116b0 2023-07-21T22:28:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f29627fc700 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 0x558ee87b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:28:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2962ffd700 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87b7970 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f295402bcd0 tx=0x7f295400b2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a76e418bd17797f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.334+0000 7f2946ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:28:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.335+0000 7f2946ff5700 1 -- 172.21.15.151:0/1190446409 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2954026040 con 0x558ee86116b0 2023-07-21T22:28:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.335+0000 7f297ce15b80 1 -- 172.21.15.151:0/1190446409 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f295401e040 con 0x558ee86116b0 2023-07-21T22:28:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.335+0000 7f2946ff5700 1 -- 172.21.15.151:0/1190446409 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(92..92 src has 1..92) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2954000e40 con 0x558ee86116b0 2023-07-21T22:28:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.335+0000 7f2946ff5700 1 -- 172.21.15.151:0/1190446409 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f295400b9b0 con 0x558ee86116b0 2023-07-21T22:28:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.335+0000 7f297ce15b80 10 client.17022 fetch_fsmap learned FSMap version 42 2023-07-21T22:28:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.335+0000 7f297ce15b80 1 -- 172.21.15.151:0/1190446409 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x558ee8533250 con 0x558ee86116b0 2023-07-21T22:28:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.335+0000 7f2946ff5700 1 -- 172.21.15.151:0/1190446409 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f295401e040 con 0x558ee86116b0 2023-07-21T22:28:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f2946ff5700 1 -- 172.21.15.151:0/1190446409 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 42) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2954004a70 con 0x558ee86116b0 2023-07-21T22:28:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f297ce15b80 10 client.17022 fetch_fsmap finished waiting for FSMap version 42 2023-07-21T22:28:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f297ce15b80 10 client.17022 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f297ce15b80 20 client.17022 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558ee8822e00 0x558ee8825210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f297ce15b80 4 client.17022 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:28:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f297ce15b80 1 -- 172.21.15.151:0/1190446409 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558ee86c1ff0 con 0x558ee8822e00 2023-07-21T22:28:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f29627fc700 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558ee8822e00 0x558ee8825210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f29627fc700 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558ee8822e00 0x558ee8825210 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c432b866ab1bd34 server_cookie=cfa340c60f5970b5 in_seq=0 out_seq=0 2023-07-21T22:28:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.336+0000 7f2946ff5700 10 client.17022 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.351+0000 7f2946ff5700 1 -- 172.21.15.151:0/1190446409 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558ee86c1ff0 con 0x558ee8822e00 2023-07-21T22:28:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.351+0000 7f2946ff5700 10 client.17022 handle_command_reply: tid=0 2023-07-21T22:28:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.351+0000 7f297ce15b80 1 client.17022 shutdown 2023-07-21T22:28:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 -- 172.21.15.151:0/1190446409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 msgr2=0x558ee87b7970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87b7970 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f295402bcd0 tx=0x7f295400b2a0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 -- 172.21.15.151:0/1190446409 shutdown_connections 2023-07-21T22:28:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558ee8822e00 0x558ee8825210 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558ee87bb660 0x558ee87b6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558ee86116b0 0x558ee87b7970 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f2946ff5700 0 client.17022 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 --2- 172.21.15.151:0/1190446409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558ee87bb210 0x558ee87b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 -- 172.21.15.151:0/1190446409 >> 172.21.15.151:0/1190446409 conn(0x558ee87aaae0 msgr2=0x558ee87bc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 -- 172.21.15.151:0/1190446409 shutdown_connections 2023-07-21T22:28:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 1 -- 172.21.15.151:0/1190446409 wait complete. 2023-07-21T22:28:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.352+0000 7f297ce15b80 20 client.17022 trim_cache size 0 max 16384 2023-07-21T22:28:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:28:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:28:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:28:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:28:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 -- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f294c0a1340 msgr2=0x7f294c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f294c0a1340 0x7f294c0a37f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f295c015da0 tx=0x7f295c015420 comp rx=0 tx=0).stop 2023-07-21T22:28:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 -- 172.21.15.151:0/1392578400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29641004e0 msgr2=0x7f2964072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29641004e0 0x7f2964072f30 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f295800d950 tx=0x7f295800dc60 comp rx=0 tx=0).stop 2023-07-21T22:28:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 -- 172.21.15.151:0/1392578400 shutdown_connections 2023-07-21T22:28:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f294c0a1340 0x7f294c0a37f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2964105b60 0x7f29641a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f29640ffb30 0x7f29640729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 --2- 172.21.15.151:0/1392578400 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29641004e0 0x7f2964072f30 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 -- 172.21.15.151:0/1392578400 >> 172.21.15.151:0/1392578400 conn(0x7f29640fb5f0 msgr2=0x7f2964103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 -- 172.21.15.151:0/1392578400 shutdown_connections 2023-07-21T22:28:03.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:03.353+0000 7f29693ff700 1 -- 172.21.15.151:0/1392578400 wait complete. 2023-07-21T22:28:03.833 INFO:teuthology.orchestra.run.smithi151.stderr:37300000 of 50000000 tuples (74%) done (elapsed 507.32 s, remaining 172.73 s) 2023-07-21T22:28:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:04 smithi187 ceph-mon[96918]: pgmap v273: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 35 MiB/s wr, 94 op/s 2023-07-21T22:28:04.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:04 smithi195 ceph-mon[97365]: pgmap v273: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 35 MiB/s wr, 94 op/s 2023-07-21T22:28:04.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:04 smithi151 ceph-mon[95510]: pgmap v273: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 35 MiB/s wr, 94 op/s 2023-07-21T22:28:05.204 INFO:teuthology.orchestra.run.smithi151.stderr:37400000 of 50000000 tuples (74%) done (elapsed 508.69 s, remaining 171.38 s) 2023-07-21T22:28:05.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:05 smithi187 ceph-mon[96918]: osdmap e93: 12 total, 12 up, 12 in 2023-07-21T22:28:05.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:05 smithi195 ceph-mon[97365]: osdmap e93: 12 total, 12 up, 12 in 2023-07-21T22:28:05.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:05 smithi151 ceph-mon[95510]: osdmap e93: 12 total, 12 up, 12 in 2023-07-21T22:28:06.549 INFO:teuthology.orchestra.run.smithi151.stderr:37500000 of 50000000 tuples (75%) done (elapsed 510.04 s, remaining 170.01 s) 2023-07-21T22:28:06.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:06 smithi187 ceph-mon[96918]: pgmap v275: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 28 MiB/s wr, 91 op/s 2023-07-21T22:28:06.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:06 smithi195 ceph-mon[97365]: pgmap v275: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 28 MiB/s wr, 91 op/s 2023-07-21T22:28:06.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:06 smithi151 ceph-mon[95510]: pgmap v275: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 28 MiB/s wr, 91 op/s 2023-07-21T22:28:07.815 INFO:teuthology.orchestra.run.smithi151.stderr:37600000 of 50000000 tuples (75%) done (elapsed 511.31 s, remaining 168.62 s) 2023-07-21T22:28:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:08 smithi187 ceph-mon[96918]: pgmap v276: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:28:08.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:08 smithi195 ceph-mon[97365]: pgmap v276: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:28:08.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:08 smithi151 ceph-mon[95510]: pgmap v276: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:28:09.063 INFO:teuthology.orchestra.run.smithi151.stderr:37700000 of 50000000 tuples (75%) done (elapsed 512.55 s, remaining 167.23 s) 2023-07-21T22:28:10.427 INFO:teuthology.orchestra.run.smithi151.stderr:37800000 of 50000000 tuples (75%) done (elapsed 513.92 s, remaining 165.87 s) 2023-07-21T22:28:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:10 smithi187 ceph-mon[96918]: pgmap v277: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:28:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:10 smithi195 ceph-mon[97365]: pgmap v277: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:28:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:10 smithi151 ceph-mon[95510]: pgmap v277: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:28:11.735 INFO:teuthology.orchestra.run.smithi151.stderr:37900000 of 50000000 tuples (75%) done (elapsed 515.23 s, remaining 164.49 s) 2023-07-21T22:28:12.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:12 smithi195 ceph-mon[97365]: pgmap v278: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:28:12.659 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:12 smithi195 ceph-mon[97365]: osdmap e94: 12 total, 12 up, 12 in 2023-07-21T22:28:12.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:12 smithi151 ceph-mon[95510]: pgmap v278: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:28:12.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:12 smithi151 ceph-mon[95510]: osdmap e94: 12 total, 12 up, 12 in 2023-07-21T22:28:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:12 smithi187 ceph-mon[96918]: pgmap v278: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 28 MiB/s wr, 90 op/s 2023-07-21T22:28:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:12 smithi187 ceph-mon[96918]: osdmap e94: 12 total, 12 up, 12 in 2023-07-21T22:28:12.957 INFO:teuthology.orchestra.run.smithi151.stderr:38000000 of 50000000 tuples (76%) done (elapsed 516.45 s, remaining 163.09 s) 2023-07-21T22:28:14.550 INFO:teuthology.orchestra.run.smithi151.stderr:38100000 of 50000000 tuples (76%) done (elapsed 518.04 s, remaining 161.80 s) 2023-07-21T22:28:14.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:14 smithi195 ceph-mon[97365]: pgmap v280: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 32 MiB/s wr, 86 op/s 2023-07-21T22:28:14.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:14 smithi151 ceph-mon[95510]: pgmap v280: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 32 MiB/s wr, 86 op/s 2023-07-21T22:28:14.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:14 smithi187 ceph-mon[96918]: pgmap v280: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 32 MiB/s wr, 86 op/s 2023-07-21T22:28:15.890 INFO:teuthology.orchestra.run.smithi151.stderr:38200000 of 50000000 tuples (76%) done (elapsed 519.38 s, remaining 160.44 s) 2023-07-21T22:28:16.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.515+0000 7f8cd7dff700 1 -- 172.21.15.151:0/3210566698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00682b0 msgr2=0x7f8cd010c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.515+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/3210566698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00682b0 0x7f8cd010c000 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f8cc0009990 tx=0x7f8cc0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.515+0000 7f8cd7dff700 1 -- 172.21.15.151:0/3210566698 shutdown_connections 2023-07-21T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.515+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/3210566698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00679a0 0x7f8cd0067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.515+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/3210566698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd010c540 0x7f8cd010e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.515+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/3210566698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00682b0 0x7f8cd010c000 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.515+0000 7f8cd7dff700 1 -- 172.21.15.151:0/3210566698 >> 172.21.15.151:0/3210566698 conn(0x7f8cd0074760 msgr2=0x7f8cd0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.515+0000 7f8cd7dff700 1 -- 172.21.15.151:0/3210566698 shutdown_connections 2023-07-21T22:28:16.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.515+0000 7f8cd7dff700 1 -- 172.21.15.151:0/3210566698 wait complete. 2023-07-21T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.517+0000 7f8cd7dff700 1 Processor -- start 2023-07-21T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.517+0000 7f8cd7dff700 1 -- start start 2023-07-21T22:28:16.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.517+0000 7f8cd7dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00679a0 0x7f8cd0197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.517+0000 7f8cd7dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00682b0 0x7f8cd01981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.517+0000 7f8cd7dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd010c540 0x7f8cd019b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.517+0000 7f8cd7dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd019bdb0 con 0x7f8cd00679a0 2023-07-21T22:28:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.517+0000 7f8cd7dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd019bf20 con 0x7f8cd00682b0 2023-07-21T22:28:16.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.517+0000 7f8cd7dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd019c0e0 con 0x7f8cd010c540 2023-07-21T22:28:16.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00679a0 0x7f8cd0197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd539a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00682b0 0x7f8cd01981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00679a0 0x7f8cd0197cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38052/0 (socket says 172.21.15.151:38052) 2023-07-21T22:28:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd539a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00682b0 0x7f8cd01981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52004/0 (socket says 172.21.15.151:52004) 2023-07-21T22:28:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/2108177592 learned_addr learned my addr 172.21.15.151:0/2108177592 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd639c700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd010c540 0x7f8cd019b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/2108177592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd010c540 msgr2=0x7f8cd019b7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:16.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd010c540 0x7f8cd019b7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/2108177592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00682b0 msgr2=0x7f8cd01981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00682b0 0x7f8cd01981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/2108177592 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc00095f0 con 0x7f8cd00679a0 2023-07-21T22:28:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd639c700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd010c540 0x7f8cd019b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:28:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.518+0000 7f8cd539a700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00682b0 0x7f8cd01981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:28:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.519+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00679a0 0x7f8cd0197cb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00d950 tx=0x7f8ccc00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.519+0000 7f8cc6ffd700 1 -- 172.21.15.151:0/2108177592 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00f890 con 0x7f8cd00679a0 2023-07-21T22:28:16.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.519+0000 7f8cd7dff700 1 -- 172.21.15.151:0/2108177592 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd019c3c0 con 0x7f8cd00679a0 2023-07-21T22:28:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.519+0000 7f8cc6ffd700 1 -- 172.21.15.151:0/2108177592 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ccc00fe80 con 0x7f8cd00679a0 2023-07-21T22:28:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.519+0000 7f8cc6ffd700 1 -- 172.21.15.151:0/2108177592 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00e3b0 con 0x7f8cd00679a0 2023-07-21T22:28:16.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.519+0000 7f8cd7dff700 1 -- 172.21.15.151:0/2108177592 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd01a4d20 con 0x7f8cd00679a0 2023-07-21T22:28:16.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.523+0000 7f8cc6ffd700 1 -- 172.21.15.151:0/2108177592 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f8ccc010460 con 0x7f8cd00679a0 2023-07-21T22:28:16.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.524+0000 7f8cc6ffd700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8cbc0a12c0 0x7f8cbc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.524+0000 7f8ceb75db80 1 Processor -- start 2023-07-21T22:28:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.524+0000 7f8cc6ffd700 1 -- 172.21.15.151:0/2108177592 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8ccc0ccb00 con 0x7f8cd00679a0 2023-07-21T22:28:16.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.525+0000 7f8cd539a700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8cbc0a12c0 0x7f8cbc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.525+0000 7f8ceb75db80 1 -- start start 2023-07-21T22:28:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.525+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602bde6b0 0x55b602d87cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.525+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602d88210 0x55b602d81f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.525+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d824a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.525+0000 7f8cd539a700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8cbc0a12c0 0x7f8cbc0a3770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0199530 tx=0x7f8cc0005fb0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602c87c50 con 0x55b602d88210 2023-07-21T22:28:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602cda9e0 con 0x55b602bde6b0 2023-07-21T22:28:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602cd3e70 con 0x55b602d88660 2023-07-21T22:28:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602bde6b0 0x55b602d87cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd539a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602d88210 0x55b602d81f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602bde6b0 0x55b602d87cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52020/0 (socket says 172.21.15.151:52020) 2023-07-21T22:28:16.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/337289253 learned_addr learned my addr 172.21.15.151:0/337289253 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:16.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd639c700 1 --2- 172.21.15.151:0/337289253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d824a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/337289253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 msgr2=0x55b602d824a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/337289253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d824a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/337289253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602d88210 msgr2=0x55b602d81f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/337289253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602d88210 0x55b602d81f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/337289253 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b602b01d80 con 0x55b602bde6b0 2023-07-21T22:28:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd639c700 1 --2- 172.21.15.151:0/337289253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d824a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:28:16.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.526+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/337289253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602bde6b0 0x55b602d87cd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc096600 tx=0x7f8ccc0995f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=662b548634c8b1c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.527+0000 7f8cbbfff700 1 -- 172.21.15.151:0/337289253 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc09dbc0 con 0x55b602bde6b0 2023-07-21T22:28:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.527+0000 7f8cbbfff700 1 -- 172.21.15.151:0/337289253 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ccc0a1fe0 con 0x55b602bde6b0 2023-07-21T22:28:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.527+0000 7f8cbbfff700 1 -- 172.21.15.151:0/337289253 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0a1b50 con 0x55b602bde6b0 2023-07-21T22:28:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 -- 172.21.15.151:0/337289253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602bde6b0 msgr2=0x55b602d87cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/337289253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602bde6b0 0x55b602d87cd0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc096600 tx=0x7f8ccc0995f0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 -- 172.21.15.151:0/337289253 shutdown_connections 2023-07-21T22:28:16.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/337289253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602bde6b0 0x55b602d87cd0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/337289253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d824a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/337289253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602d88210 0x55b602d81f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 -- 172.21.15.151:0/337289253 >> 172.21.15.151:0/337289253 conn(0x55b602d77ae0 msgr2=0x55b602d7d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 -- 172.21.15.151:0/337289253 shutdown_connections 2023-07-21T22:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 -- 172.21.15.151:0/337289253 wait complete. 2023-07-21T22:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.528+0000 7f8ceb75db80 1 -- start start 2023-07-21T22:28:16.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.529+0000 7f8ceb75db80 1 Processor -- start 2023-07-21T22:28:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.529+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d915f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.529+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602d91b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.529+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d8b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.529+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602c73a60 con 0x55b602bde6b0 2023-07-21T22:28:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.529+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602c73760 con 0x55b602d88210 2023-07-21T22:28:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.529+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602b578c0 con 0x55b602d88660 2023-07-21T22:28:16.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.529+0000 7f8ceb75db80 10 client.0 _ll_register_callbacks cb 0x55b602c71700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d915f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d915f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38072/0 (socket says 172.21.15.151:38072) 2023-07-21T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/1949830260 learned_addr learned my addr 172.21.15.151:0/1949830260 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd539a700 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602d91b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd639c700 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d8b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/1949830260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 msgr2=0x55b602d8b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:16.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d8b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/1949830260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 msgr2=0x55b602d91b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602d91b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.530+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/1949830260 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd01a4d20 con 0x55b602bde6b0 2023-07-21T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d915f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc097ee0 tx=0x7f8ccc010a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36d1a3511f56725 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8cb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8cb97fa700 1 -- 172.21.15.151:0/1949830260 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc09dbc0 con 0x55b602bde6b0 2023-07-21T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8cb97fa700 1 -- 172.21.15.151:0/1949830260 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8ccc0b1070 con 0x55b602bde6b0 2023-07-21T22:28:16.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8ceb75db80 1 -- 172.21.15.151:0/1949830260 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b602c2d490 con 0x55b602bde6b0 2023-07-21T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8cb97fa700 1 -- 172.21.15.151:0/1949830260 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ccc099080 con 0x55b602bde6b0 2023-07-21T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8ceb75db80 10 client.17034 fetch_fsmap learned FSMap version 42 2023-07-21T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8ceb75db80 1 -- 172.21.15.151:0/1949830260 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x55b602aeac00 con 0x55b602bde6b0 2023-07-21T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8cb97fa700 1 -- 172.21.15.151:0/1949830260 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b602c2d490 con 0x55b602bde6b0 2023-07-21T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8cb97fa700 1 -- 172.21.15.151:0/1949830260 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 42) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8ccc095980 con 0x55b602bde6b0 2023-07-21T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8ceb75db80 10 client.17034 fetch_fsmap finished waiting for FSMap version 42 2023-07-21T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.531+0000 7f8ceb75db80 10 client.17034 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:16.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.532+0000 7f8ceb75db80 20 client.17034 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.532+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b602d9b650 0x55b602d9da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.532+0000 7f8ceb75db80 4 client.17034 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:28:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.532+0000 7f8ceb75db80 1 -- 172.21.15.151:0/1949830260 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b602ccce50 con 0x55b602d9b650 2023-07-21T22:28:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.532+0000 7f8cd539a700 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b602d9b650 0x55b602d9da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.533+0000 7f8cb97fa700 10 client.17034 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.533+0000 7f8cd539a700 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b602d9b650 0x55b602d9da30 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cd88d5786edf737 server_cookie=feebb46ecd7accb5 in_seq=0 out_seq=0 2023-07-21T22:28:16.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.533+0000 7f8cb97fa700 1 -- 172.21.15.151:0/1949830260 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b602ccce50 con 0x55b602d9b650 2023-07-21T22:28:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.533+0000 7f8cb97fa700 10 client.17034 handle_command_reply: tid=0 2023-07-21T22:28:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.533+0000 7f8ceb75db80 1 client.17034 shutdown 2023-07-21T22:28:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 -- 172.21.15.151:0/1949830260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 msgr2=0x55b602d915f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d915f0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc097ee0 tx=0x7f8ccc010a60 comp rx=0 tx=0).stop 2023-07-21T22:28:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 -- 172.21.15.151:0/1949830260 shutdown_connections 2023-07-21T22:28:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b602d9b650 0x55b602d9da30 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d8b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d915f0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8cb97fa700 0 client.17034 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/1949830260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602d91b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 -- 172.21.15.151:0/1949830260 >> 172.21.15.151:0/1949830260 conn(0x55b602d77ae0 msgr2=0x55b602d7c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:16.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 -- 172.21.15.151:0/1949830260 shutdown_connections 2023-07-21T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 1 -- 172.21.15.151:0/1949830260 wait complete. 2023-07-21T22:28:16.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.534+0000 7f8ceb75db80 20 client.17034 trim_cache size 0 max 16384 2023-07-21T22:28:16.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.549+0000 7f8ceb75db80 1 Processor -- start 2023-07-21T22:28:16.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.549+0000 7f8ceb75db80 1 -- start start 2023-07-21T22:28:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d7cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602d7d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d911c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602d83160 con 0x55b602bde6b0 2023-07-21T22:28:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602d7de50 con 0x55b602d88210 2023-07-21T22:28:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602d87900 con 0x55b602d88660 2023-07-21T22:28:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d7cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d7cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38086/0 (socket says 172.21.15.151:38086) 2023-07-21T22:28:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/2790211494 learned_addr learned my addr 172.21.15.151:0/2790211494 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.550+0000 7f8cd539a700 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602d7d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cd639c700 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d911c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cd539a700 1 -- 172.21.15.151:0/2790211494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 msgr2=0x55b602d911c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:16.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cd539a700 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d911c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cd539a700 1 -- 172.21.15.151:0/2790211494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 msgr2=0x55b602d7cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:16.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cd539a700 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d7cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cd539a700 1 -- 172.21.15.151:0/2790211494 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b602d7e7e0 con 0x55b602d88210 2023-07-21T22:28:16.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d7cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:28:16.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cd539a700 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602d7d0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00036c0 tx=0x7f8cc0020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c79215437134561 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:16.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cc4bff700 1 -- 172.21.15.151:0/2790211494 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc002d040 con 0x55b602d88210 2023-07-21T22:28:16.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cc4bff700 1 -- 172.21.15.151:0/2790211494 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cc002e040 con 0x55b602d88210 2023-07-21T22:28:16.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.551+0000 7f8cc4bff700 1 -- 172.21.15.151:0/2790211494 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc0034290 con 0x55b602d88210 2023-07-21T22:28:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.552+0000 7f8ceb75db80 1 -- 172.21.15.151:0/2790211494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 msgr2=0x55b602d7d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.552+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602d7d0a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f8cc00036c0 tx=0x7f8cc0020000 comp rx=0 tx=0).stop 2023-07-21T22:28:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.552+0000 7f8ceb75db80 1 -- 172.21.15.151:0/2790211494 shutdown_connections 2023-07-21T22:28:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.552+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602d911c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.552+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602d7cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.552+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/2790211494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602d7d0a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.552+0000 7f8ceb75db80 1 -- 172.21.15.151:0/2790211494 >> 172.21.15.151:0/2790211494 conn(0x55b602d77ae0 msgr2=0x55b602d8c1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.552+0000 7f8ceb75db80 1 -- 172.21.15.151:0/2790211494 shutdown_connections 2023-07-21T22:28:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.552+0000 7f8ceb75db80 1 -- 172.21.15.151:0/2790211494 wait complete. 2023-07-21T22:28:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.553+0000 7f8ceb75db80 1 -- start start 2023-07-21T22:28:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.553+0000 7f8ceb75db80 1 Processor -- start 2023-07-21T22:28:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.553+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602de3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602de3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8ceb75db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602de8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602de8aa0 con 0x55b602bde6b0 2023-07-21T22:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602de8c10 con 0x55b602d88210 2023-07-21T22:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8ceb75db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b602de8dd0 con 0x55b602d88660 2023-07-21T22:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8ceb75db80 10 client.0 _ll_register_callbacks cb 0x7f8cc0005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602de3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602de3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38090/0 (socket says 172.21.15.151:38090) 2023-07-21T22:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/4066762235 learned_addr learned my addr 172.21.15.151:0/4066762235 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:16.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd639c700 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602de8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd539a700 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602de3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/4066762235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 msgr2=0x55b602de8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602de8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/4066762235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 msgr2=0x55b602de3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602de3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd5b9b700 1 -- 172.21.15.151:0/4066762235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b602aeac00 con 0x55b602bde6b0 2023-07-21T22:28:16.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd539a700 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602de3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.554+0000 7f8cd5b9b700 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602de3660 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc099b20 tx=0x7f8ccc0a1f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38ec0774bc0bc482 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.555+0000 7f8cb97fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.555+0000 7f8cb97fa700 1 -- 172.21.15.151:0/4066762235 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc0a1d50 con 0x55b602bde6b0 2023-07-21T22:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.555+0000 7f8ceb75db80 1 -- 172.21.15.151:0/4066762235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8ccc0a1fe0 con 0x55b602bde6b0 2023-07-21T22:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.555+0000 7f8cb97fa700 1 -- 172.21.15.151:0/4066762235 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8ccc0b1070 con 0x55b602bde6b0 2023-07-21T22:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.555+0000 7f8cb97fa700 1 -- 172.21.15.151:0/4066762235 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ccc0ca120 con 0x55b602bde6b0 2023-07-21T22:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.555+0000 7f8ceb75db80 10 client.17040 fetch_fsmap learned FSMap version 42 2023-07-21T22:28:16.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.555+0000 7f8ceb75db80 1 -- 172.21.15.151:0/4066762235 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) v3 -- 0x7f8cd010f420 con 0x55b602bde6b0 2023-07-21T22:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.555+0000 7f8cb97fa700 1 -- 172.21.15.151:0/4066762235 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ccc0a1fe0 con 0x55b602bde6b0 2023-07-21T22:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.555+0000 7f8cb97fa700 1 -- 172.21.15.151:0/4066762235 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 42) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f8ccc099080 con 0x55b602bde6b0 2023-07-21T22:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.556+0000 7f8ceb75db80 10 client.17040 fetch_fsmap finished waiting for FSMap version 42 2023-07-21T22:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.556+0000 7f8ceb75db80 10 client.17040 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.556+0000 7f8ceb75db80 20 client.17040 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.556+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b602df0140 0x55b602df2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.556+0000 7f8ceb75db80 4 client.17040 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:28:16.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.556+0000 7f8ceb75db80 1 -- 172.21.15.151:0/4066762235 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b602c8eff0 con 0x55b602df0140 2023-07-21T22:28:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.556+0000 7f8cd539a700 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b602df0140 0x55b602df2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.557+0000 7f8cd539a700 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b602df0140 0x55b602df2550 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fc86b5e9ee1bd40 server_cookie=a2f0514d13149b95 in_seq=0 out_seq=0 2023-07-21T22:28:16.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.557+0000 7f8cb97fa700 10 client.17040 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:16.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8cb97fa700 1 -- 172.21.15.151:0/4066762235 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b602c8eff0 con 0x55b602df0140 2023-07-21T22:28:16.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8cb97fa700 10 client.17040 handle_command_reply: tid=0 2023-07-21T22:28:16.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 client.17040 shutdown 2023-07-21T22:28:16.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 -- 172.21.15.151:0/4066762235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 msgr2=0x55b602de3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602de3660 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc099b20 tx=0x7f8ccc0a1f10 comp rx=0 tx=0).stop 2023-07-21T22:28:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 -- 172.21.15.151:0/4066762235 shutdown_connections 2023-07-21T22:28:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b602df0140 0x55b602df2550 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b602d88660 0x55b602de8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b602bde6b0 0x55b602de3660 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 --2- 172.21.15.151:0/4066762235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b602d88210 0x55b602de3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8cb97fa700 0 client.17040 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 -- 172.21.15.151:0/4066762235 >> 172.21.15.151:0/4066762235 conn(0x55b602d77ae0 msgr2=0x55b602d88aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 -- 172.21.15.151:0/4066762235 shutdown_connections 2023-07-21T22:28:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 1 -- 172.21.15.151:0/4066762235 wait complete. 2023-07-21T22:28:16.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.569+0000 7f8ceb75db80 20 client.17040 trim_cache size 0 max 16384 2023-07-21T22:28:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:28:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:28:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:28:16.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:28:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 -- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8cbc0a12c0 msgr2=0x7f8cbc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8cbc0a12c0 0x7f8cbc0a3770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0199530 tx=0x7f8cc0005fb0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 -- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00679a0 msgr2=0x7f8cd0197cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00679a0 0x7f8cd0197cb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc00d950 tx=0x7f8ccc00dc60 comp rx=0 tx=0).stop 2023-07-21T22:28:16.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 -- 172.21.15.151:0/2108177592 shutdown_connections 2023-07-21T22:28:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8cbc0a12c0 0x7f8cbc0a3770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cd010c540 0x7f8cd019b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd00679a0 0x7f8cd0197cb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 --2- 172.21.15.151:0/2108177592 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd00682b0 0x7f8cd01981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 -- 172.21.15.151:0/2108177592 >> 172.21.15.151:0/2108177592 conn(0x7f8cd0074760 msgr2=0x7f8cd00fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 -- 172.21.15.151:0/2108177592 shutdown_connections 2023-07-21T22:28:16.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:16.570+0000 7f8cd7dff700 1 -- 172.21.15.151:0/2108177592 wait complete. 2023-07-21T22:28:16.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:16 smithi195 ceph-mon[97365]: pgmap v281: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 27 MiB/s wr, 73 op/s 2023-07-21T22:28:16.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:16 smithi151 ceph-mon[95510]: pgmap v281: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 27 MiB/s wr, 73 op/s 2023-07-21T22:28:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:16 smithi187 ceph-mon[96918]: pgmap v281: 97 pgs: 97 active+clean; 8.2 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 27 MiB/s wr, 73 op/s 2023-07-21T22:28:17.191 INFO:teuthology.orchestra.run.smithi151.stderr:38300000 of 50000000 tuples (76%) done (elapsed 520.68 s, remaining 159.06 s) 2023-07-21T22:28:18.420 INFO:teuthology.orchestra.run.smithi151.stderr:38400000 of 50000000 tuples (76%) done (elapsed 521.91 s, remaining 157.66 s) 2023-07-21T22:28:18.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:18 smithi195 ceph-mon[97365]: pgmap v282: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-21T22:28:18.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:18 smithi151 ceph-mon[95510]: pgmap v282: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-21T22:28:18.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:18 smithi187 ceph-mon[96918]: pgmap v282: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-21T22:28:19.822 INFO:teuthology.orchestra.run.smithi151.stderr:38500000 of 50000000 tuples (77%) done (elapsed 523.31 s, remaining 156.31 s) 2023-07-21T22:28:20.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:20 smithi195 ceph-mon[97365]: pgmap v283: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-21T22:28:20.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:20 smithi151 ceph-mon[95510]: pgmap v283: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-21T22:28:20.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:20 smithi187 ceph-mon[96918]: pgmap v283: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-21T22:28:21.067 INFO:teuthology.orchestra.run.smithi151.stderr:38600000 of 50000000 tuples (77%) done (elapsed 524.56 s, remaining 154.92 s) 2023-07-21T22:28:22.324 INFO:teuthology.orchestra.run.smithi151.stderr:38700000 of 50000000 tuples (77%) done (elapsed 525.82 s, remaining 153.53 s) 2023-07-21T22:28:22.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:22 smithi195 ceph-mon[97365]: pgmap v284: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-21T22:28:22.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:22 smithi151 ceph-mon[95510]: pgmap v284: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-21T22:28:22.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:22 smithi187 ceph-mon[96918]: pgmap v284: 97 pgs: 97 active+clean; 8.3 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 27 MiB/s wr, 75 op/s 2023-07-21T22:28:23.582 INFO:teuthology.orchestra.run.smithi151.stderr:38800000 of 50000000 tuples (77%) done (elapsed 527.07 s, remaining 152.14 s) 2023-07-21T22:28:24.658 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:24 smithi195 ceph-mon[97365]: pgmap v285: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 35 MiB/s wr, 87 op/s 2023-07-21T22:28:24.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:24 smithi151 ceph-mon[95510]: pgmap v285: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 35 MiB/s wr, 87 op/s 2023-07-21T22:28:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:24 smithi187 ceph-mon[96918]: pgmap v285: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 35 MiB/s wr, 87 op/s 2023-07-21T22:28:24.982 INFO:teuthology.orchestra.run.smithi151.stderr:38900000 of 50000000 tuples (77%) done (elapsed 528.47 s, remaining 150.80 s) 2023-07-21T22:28:26.233 INFO:teuthology.orchestra.run.smithi151.stderr:39000000 of 50000000 tuples (78%) done (elapsed 529.72 s, remaining 149.41 s) 2023-07-21T22:28:26.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:26 smithi151 ceph-mon[95510]: pgmap v286: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 22 MiB/s wr, 54 op/s 2023-07-21T22:28:26.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:26 smithi187 ceph-mon[96918]: pgmap v286: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 22 MiB/s wr, 54 op/s 2023-07-21T22:28:26.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:26 smithi195 ceph-mon[97365]: pgmap v286: 97 pgs: 97 active+clean; 8.4 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 22 MiB/s wr, 54 op/s 2023-07-21T22:28:27.467 INFO:teuthology.orchestra.run.smithi151.stderr:39100000 of 50000000 tuples (78%) done (elapsed 530.96 s, remaining 148.02 s) 2023-07-21T22:28:27.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:27 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:28:27.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:27 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:28:27.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:27 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:28:28.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:28 smithi151 ceph-mon[95510]: pgmap v287: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 34 MiB/s wr, 93 op/s 2023-07-21T22:28:28.705 INFO:teuthology.orchestra.run.smithi151.stderr:39200000 of 50000000 tuples (78%) done (elapsed 532.20 s, remaining 146.63 s) 2023-07-21T22:28:28.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:28 smithi187 ceph-mon[96918]: pgmap v287: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 34 MiB/s wr, 93 op/s 2023-07-21T22:28:28.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:28 smithi195 ceph-mon[97365]: pgmap v287: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 34 MiB/s wr, 93 op/s 2023-07-21T22:28:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.730+0000 7f9eb4dff700 1 -- 172.21.15.151:0/1529330641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eb01004b0 msgr2=0x7f9eb010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.730+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/1529330641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eb01004b0 0x7f9eb010c940 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9ea800b0a0 tx=0x7f9ea800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.730+0000 7f9eb4dff700 1 -- 172.21.15.151:0/1529330641 shutdown_connections 2023-07-21T22:28:29.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.730+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/1529330641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eb01004b0 0x7f9eb010c940 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.730+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/1529330641 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb0105b10 0x7f9eb0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.730+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/1529330641 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eb00ffb00 0x7f9eb00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.730+0000 7f9eb4dff700 1 -- 172.21.15.151:0/1529330641 >> 172.21.15.151:0/1529330641 conn(0x7f9eb00fb600 msgr2=0x7f9eb00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.731+0000 7f9eb4dff700 1 -- 172.21.15.151:0/1529330641 shutdown_connections 2023-07-21T22:28:29.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.731+0000 7f9eb4dff700 1 -- 172.21.15.151:0/1529330641 wait complete. 2023-07-21T22:28:29.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.732+0000 7f9eb4dff700 1 Processor -- start 2023-07-21T22:28:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.732+0000 7f9eb4dff700 1 -- start start 2023-07-21T22:28:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.732+0000 7f9eb4dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb00ffb00 0x7f9eb00729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.732+0000 7f9eb4dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eb01004b0 0x7f9eb0072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.732+0000 7f9eb4dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eb0105b10 0x7f9eb01a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.732+0000 7f9eb4dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01a4370 con 0x7f9eb0105b10 2023-07-21T22:28:29.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.732+0000 7f9eb4dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01a44b0 con 0x7f9eb01004b0 2023-07-21T22:28:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.732+0000 7f9eb4dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eb01a4620 con 0x7f9eb00ffb00 2023-07-21T22:28:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eaed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eb0105b10 0x7f9eb01a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb00ffb00 0x7f9eb00729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb00ffb00 0x7f9eb00729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42860/0 (socket says 172.21.15.151:42860) 2023-07-21T22:28:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eae59c700 1 -- 172.21.15.151:0/67679567 learned_addr learned my addr 172.21.15.151:0/67679567 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eb01004b0 0x7f9eb0072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eae59c700 1 -- 172.21.15.151:0/67679567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eb01004b0 msgr2=0x7f9eb0072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:29.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eae59c700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eb01004b0 0x7f9eb0072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eae59c700 1 -- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eb0105b10 msgr2=0x7f9eb01a3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:29.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eae59c700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eb0105b10 0x7f9eb01a3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eae59c700 1 -- 172.21.15.151:0/67679567 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ea4009520 con 0x7f9eb00ffb00 2023-07-21T22:28:29.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eaed9d700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eb0105b10 0x7f9eb01a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:28:29.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.733+0000 7f9eae59c700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb00ffb00 0x7f9eb00729f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000e9a0 tx=0x7f9ea000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:29.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.734+0000 7f9e9f7fe700 1 -- 172.21.15.151:0/67679567 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0009790 con 0x7f9eb00ffb00 2023-07-21T22:28:29.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.734+0000 7f9e9f7fe700 1 -- 172.21.15.151:0/67679567 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ea0010430 con 0x7f9eb00ffb00 2023-07-21T22:28:29.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.734+0000 7f9eb4dff700 1 -- 172.21.15.151:0/67679567 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ea8009d00 con 0x7f9eb00ffb00 2023-07-21T22:28:29.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.734+0000 7f9e9f7fe700 1 -- 172.21.15.151:0/67679567 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea000cea0 con 0x7f9eb00ffb00 2023-07-21T22:28:29.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.734+0000 7f9eb4dff700 1 -- 172.21.15.151:0/67679567 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eb01a4c80 con 0x7f9eb00ffb00 2023-07-21T22:28:29.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.737+0000 7f9e9f7fe700 1 -- 172.21.15.151:0/67679567 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f9ea00105a0 con 0x7f9eb00ffb00 2023-07-21T22:28:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9ec87c3b80 1 Processor -- start 2023-07-21T22:28:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9e9f7fe700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9e980a12c0 0x7f9e980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9ec87c3b80 1 -- start start 2023-07-21T22:28:29.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9e9f7fe700 1 -- 172.21.15.151:0/67679567 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9ea0014070 con 0x7f9eb00ffb00 2023-07-21T22:28:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9eaed9d700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9e980a12c0 0x7f9e980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd08cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd02f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd034a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bc08c50 con 0x55b91bd09210 2023-07-21T22:28:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bc5b9e0 con 0x55b91bd09660 2023-07-21T22:28:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.740+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bc54e70 con 0x55b91bb5f6b0 2023-07-21T22:28:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eadd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd02f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eadd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd02f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45806/0 (socket says 172.21.15.151:45806) 2023-07-21T22:28:29.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eadd9b700 1 -- 172.21.15.151:0/1288958770 learned_addr learned my addr 172.21.15.151:0/1288958770 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eaed9d700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9e980a12c0 0x7f9e980a3770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009fd0 tx=0x7f9ea800b720 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eae59c700 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd08cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eaed9d700 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd034a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eadd9b700 1 -- 172.21.15.151:0/1288958770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 msgr2=0x55b91bd08cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd08cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eadd9b700 1 -- 172.21.15.151:0/1288958770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 msgr2=0x55b91bd034a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:29.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd034a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eadd9b700 1 -- 172.21.15.151:0/1288958770 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b91ba82d80 con 0x55b91bd09210 2023-07-21T22:28:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.741+0000 7f9eaed9d700 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:28:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.742+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd02f40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009eb0 tx=0x7f9ea4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86682e7329e49ba7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.742+0000 7f9e9cff9700 1 -- 172.21.15.151:0/1288958770 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400e670 con 0x55b91bd09210 2023-07-21T22:28:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.742+0000 7f9e9cff9700 1 -- 172.21.15.151:0/1288958770 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ea400ec60 con 0x55b91bd09210 2023-07-21T22:28:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.742+0000 7f9e9cff9700 1 -- 172.21.15.151:0/1288958770 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4019d00 con 0x55b91bd09210 2023-07-21T22:28:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.743+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/1288958770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 msgr2=0x55b91bd02f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:29.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.743+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd02f40 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009eb0 tx=0x7f9ea4011720 comp rx=0 tx=0).stop 2023-07-21T22:28:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.743+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/1288958770 shutdown_connections 2023-07-21T22:28:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.743+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd034a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.743+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd08cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.743+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/1288958770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd02f40 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.743+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/1288958770 >> 172.21.15.151:0/1288958770 conn(0x55b91bcf8ae0 msgr2=0x55b91bcfe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.743+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/1288958770 shutdown_connections 2023-07-21T22:28:29.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.743+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/1288958770 wait complete. 2023-07-21T22:28:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.744+0000 7f9ec87c3b80 1 -- start start 2023-07-21T22:28:29.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.744+0000 7f9ec87c3b80 1 Processor -- start 2023-07-21T22:28:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bd09210 0x55b91bd0c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd0ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bbf4a60 con 0x55b91bb5f6b0 2023-07-21T22:28:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bbf4760 con 0x55b91bd09660 2023-07-21T22:28:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bad88c0 con 0x55b91bd09210 2023-07-21T22:28:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9ec87c3b80 10 client.0 _ll_register_callbacks cb 0x55b91bbf2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45818/0 (socket says 172.21.15.151:45818) 2023-07-21T22:28:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9eae59c700 1 -- 172.21.15.151:0/313340433 learned_addr learned my addr 172.21.15.151:0/313340433 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bd09210 0x55b91bd0c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9eaed9d700 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd0ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9eae59c700 1 -- 172.21.15.151:0/313340433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bd09210 msgr2=0x55b91bd0c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9eae59c700 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bd09210 0x55b91bd0c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9eae59c700 1 -- 172.21.15.151:0/313340433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 msgr2=0x55b91bd0ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.745+0000 7f9eae59c700 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd0ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.746+0000 7f9eae59c700 1 -- 172.21.15.151:0/313340433 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ea4009b10 con 0x55b91bb5f6b0 2023-07-21T22:28:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.746+0000 7f9eaed9d700 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd0ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:28:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.746+0000 7f9e95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:28:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.746+0000 7f9eae59c700 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f540 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0096490 tx=0x7f9ea0010900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba212314c2bb687 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.746+0000 7f9e95ffb700 1 -- 172.21.15.151:0/313340433 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea009dfc0 con 0x55b91bb5f6b0 2023-07-21T22:28:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.746+0000 7f9e95ffb700 1 -- 172.21.15.151:0/313340433 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9ea00a23e0 con 0x55b91bb5f6b0 2023-07-21T22:28:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.746+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/313340433 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b91bbae490 con 0x55b91bb5f6b0 2023-07-21T22:28:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.747+0000 7f9e95ffb700 1 -- 172.21.15.151:0/313340433 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ea00b82e0 con 0x55b91bb5f6b0 2023-07-21T22:28:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.747+0000 7f9ec87c3b80 10 client.17052 fetch_fsmap learned FSMap version 43 2023-07-21T22:28:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.747+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/313340433 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b91ba6bc00 con 0x55b91bb5f6b0 2023-07-21T22:28:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.747+0000 7f9e95ffb700 1 -- 172.21.15.151:0/313340433 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ea00c8080 con 0x55b91bb5f6b0 2023-07-21T22:28:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.747+0000 7f9e95ffb700 1 -- 172.21.15.151:0/313340433 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 43) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f9ea0098ef0 con 0x55b91bb5f6b0 2023-07-21T22:28:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.747+0000 7f9ec87c3b80 10 client.17052 fetch_fsmap finished waiting for FSMap version 43 2023-07-21T22:28:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.747+0000 7f9ec87c3b80 10 client.17052 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.747+0000 7f9ec87c3b80 20 client.17052 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.748+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b91bd1cbe0 0x55b91bd1eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.748+0000 7f9ec87c3b80 4 client.17052 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:28:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.748+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/313340433 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b91bc4de50 con 0x55b91bd1cbe0 2023-07-21T22:28:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.748+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b91bd1cbe0 0x55b91bd1eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.749+0000 7f9e95ffb700 10 client.17052 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:29.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.749+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b91bd1cbe0 0x55b91bd1eff0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff3f4424a82c79a7 server_cookie=b37a26e8633afdff in_seq=0 out_seq=0 2023-07-21T22:28:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.749+0000 7f9e95ffb700 1 -- 172.21.15.151:0/313340433 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b91bc4de50 con 0x55b91bd1cbe0 2023-07-21T22:28:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.749+0000 7f9e95ffb700 10 client.17052 handle_command_reply: tid=0 2023-07-21T22:28:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 client.17052 shutdown 2023-07-21T22:28:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/313340433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bb5f6b0 msgr2=0x55b91bd0f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f540 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0096490 tx=0x7f9ea0010900 comp rx=0 tx=0).stop 2023-07-21T22:28:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/313340433 shutdown_connections 2023-07-21T22:28:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b91bd1cbe0 0x55b91bd1eff0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09660 0x55b91bd0ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f540 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/313340433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bd09210 0x55b91bd0c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/313340433 >> 172.21.15.151:0/313340433 conn(0x55b91bcf8ae0 msgr2=0x55b91bcfd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9e95ffb700 0 client.17052 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/313340433 shutdown_connections 2023-07-21T22:28:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/313340433 wait complete. 2023-07-21T22:28:29.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.750+0000 7f9ec87c3b80 20 client.17052 trim_cache size 0 max 16384 2023-07-21T22:28:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9ec87c3b80 1 Processor -- start 2023-07-21T22:28:29.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9ec87c3b80 1 -- start start 2023-07-21T22:28:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bcf8ae0 0x55b91bd13c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd0bf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bcfac00 con 0x55b91bd09210 2023-07-21T22:28:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bd0dda0 con 0x55b91bcf8ae0 2023-07-21T22:28:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bd08920 con 0x55b91bb5f6b0 2023-07-21T22:28:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bcf8ae0 0x55b91bd13c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9eaed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd0bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bcf8ae0 0x55b91bd13c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35604/0 (socket says 172.21.15.151:35604) 2023-07-21T22:28:29.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.771+0000 7f9eae59c700 1 -- 172.21.15.151:0/2791866806 learned_addr learned my addr 172.21.15.151:0/2791866806 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/2791866806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9eae59c700 1 -- 172.21.15.151:0/2791866806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 msgr2=0x55b91bd0f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9eae59c700 1 --2- 172.21.15.151:0/2791866806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9eae59c700 1 -- 172.21.15.151:0/2791866806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 msgr2=0x55b91bd0bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9eae59c700 1 --2- 172.21.15.151:0/2791866806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd0bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9eae59c700 1 -- 172.21.15.151:0/2791866806 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b91baa91f0 con 0x55b91bcf8ae0 2023-07-21T22:28:29.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9eae59c700 1 --2- 172.21.15.151:0/2791866806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bcf8ae0 0x55b91bd13c30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0099c90 tx=0x7f9ea0010b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bfa91d24f0d3cb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9e9d7fa700 1 -- 172.21.15.151:0/2791866806 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea009dfc0 con 0x55b91bcf8ae0 2023-07-21T22:28:29.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9e9d7fa700 1 -- 172.21.15.151:0/2791866806 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b91bbae490 con 0x55b91bcf8ae0 2023-07-21T22:28:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.772+0000 7f9e9d7fa700 1 -- 172.21.15.151:0/2791866806 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00a21b0 con 0x55b91bcf8ae0 2023-07-21T22:28:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.773+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2791866806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bcf8ae0 msgr2=0x55b91bd13c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.773+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2791866806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bcf8ae0 0x55b91bd13c30 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0099c90 tx=0x7f9ea0010b80 comp rx=0 tx=0).stop 2023-07-21T22:28:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.773+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2791866806 shutdown_connections 2023-07-21T22:28:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.773+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2791866806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bcf8ae0 0x55b91bd13c30 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.773+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2791866806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bd09210 0x55b91bd0bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.773+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2791866806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd0f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.773+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2791866806 >> 172.21.15.151:0/2791866806 conn(0x55b91bd19130 msgr2=0x55b91bcfdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.773+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2791866806 shutdown_connections 2023-07-21T22:28:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.773+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2791866806 wait complete. 2023-07-21T22:28:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.774+0000 7f9ec87c3b80 1 -- start start 2023-07-21T22:28:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.774+0000 7f9ec87c3b80 1 Processor -- start 2023-07-21T22:28:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd05d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bcf8ae0 0x55b91bd04730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9ec87c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09210 0x55b91bd04c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bd06340 con 0x55b91bcf8ae0 2023-07-21T22:28:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bd064b0 con 0x55b91bd09210 2023-07-21T22:28:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9ec87c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b91bd051b0 con 0x55b91bb5f6b0 2023-07-21T22:28:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9ec87c3b80 10 client.0 _ll_register_callbacks cb 0x7f9ea00998f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:29.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9eadd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bcf8ae0 0x55b91bd04730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd05d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9eae59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd05d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42888/0 (socket says 172.21.15.151:42888) 2023-07-21T22:28:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9eadd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bcf8ae0 0x55b91bd04730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45826/0 (socket says 172.21.15.151:45826) 2023-07-21T22:28:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9eae59c700 1 -- 172.21.15.151:0/2703151848 learned_addr learned my addr 172.21.15.151:0/2703151848 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9eaed9d700 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09210 0x55b91bd04c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9eae59c700 1 -- 172.21.15.151:0/2703151848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09210 msgr2=0x55b91bd04c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:29.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9eae59c700 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09210 0x55b91bd04c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.775+0000 7f9eae59c700 1 -- 172.21.15.151:0/2703151848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bcf8ae0 msgr2=0x55b91bd04730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9eae59c700 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bcf8ae0 0x55b91bd04730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9eae59c700 1 -- 172.21.15.151:0/2703151848 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b91ba6bc00 con 0x55b91bb5f6b0 2023-07-21T22:28:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bcf8ae0 0x55b91bd04730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:28:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9eae59c700 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd05d20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0000c00 tx=0x7f9ea00ca6c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b87a84c6855ebf4c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9e95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:28:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9e95ffb700 1 -- 172.21.15.151:0/2703151848 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00a1f50 con 0x55b91bb5f6b0 2023-07-21T22:28:29.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9e95ffb700 1 -- 172.21.15.151:0/2703151848 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9ea00a20b0 con 0x55b91bb5f6b0 2023-07-21T22:28:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2703151848 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b91bd19500 con 0x55b91bb5f6b0 2023-07-21T22:28:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9e95ffb700 1 -- 172.21.15.151:0/2703151848 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ea0094ba0 con 0x55b91bb5f6b0 2023-07-21T22:28:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9ec87c3b80 10 client.26791 fetch_fsmap learned FSMap version 43 2023-07-21T22:28:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2703151848 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=43,monmap=4+}) v3 -- 0x55b91ba81250 con 0x55b91bb5f6b0 2023-07-21T22:28:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.776+0000 7f9e95ffb700 1 -- 172.21.15.151:0/2703151848 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b91bd19500 con 0x55b91bb5f6b0 2023-07-21T22:28:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.777+0000 7f9e95ffb700 1 -- 172.21.15.151:0/2703151848 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 43) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f9ea0095d80 con 0x55b91bb5f6b0 2023-07-21T22:28:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.777+0000 7f9ec87c3b80 10 client.26791 fetch_fsmap finished waiting for FSMap version 43 2023-07-21T22:28:29.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.777+0000 7f9ec87c3b80 10 client.26791 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.777+0000 7f9ec87c3b80 20 client.26791 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.777+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b91bd09660 0x55b91bd73730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.777+0000 7f9ec87c3b80 4 client.26791 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:28:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.777+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2703151848 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f9ea400ec60 con 0x55b91bd09660 2023-07-21T22:28:29.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.777+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b91bd09660 0x55b91bd73730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.778+0000 7f9e95ffb700 10 client.26791 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:29.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.778+0000 7f9eadd9b700 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b91bd09660 0x55b91bd73730 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6876dd9285bfb73f server_cookie=3f5e8ca9335029cc in_seq=0 out_seq=0 2023-07-21T22:28:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9e95ffb700 1 -- 172.21.15.151:0/2703151848 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f9ea400ec60 con 0x55b91bd09660 2023-07-21T22:28:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9e95ffb700 10 client.26791 handle_command_reply: tid=0 2023-07-21T22:28:29.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 client.26791 shutdown 2023-07-21T22:28:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2703151848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 msgr2=0x55b91bd05d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:29.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd05d20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0000c00 tx=0x7f9ea00ca6c0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2703151848 shutdown_connections 2023-07-21T22:28:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b91bd09660 0x55b91bd73730 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b91bd09210 0x55b91bd04c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9e95ffb700 0 client.26791 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b91bb5f6b0 0x55b91bd05d20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 --2- 172.21.15.151:0/2703151848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b91bcf8ae0 0x55b91bd04730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2703151848 >> 172.21.15.151:0/2703151848 conn(0x55b91bd19130 msgr2=0x55b91bd09aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:29.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2703151848 shutdown_connections 2023-07-21T22:28:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.790+0000 7f9ec87c3b80 1 -- 172.21.15.151:0/2703151848 wait complete. 2023-07-21T22:28:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9ec87c3b80 20 client.26791 trim_cache size 0 max 16384 2023-07-21T22:28:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:28:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:28:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:28:29.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:28:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 -- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9e980a12c0 msgr2=0x7f9e980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9e980a12c0 0x7f9e980a3770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9ea8009fd0 tx=0x7f9ea800b720 comp rx=0 tx=0).stop 2023-07-21T22:28:29.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 -- 172.21.15.151:0/67679567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb00ffb00 msgr2=0x7f9eb00729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb00ffb00 0x7f9eb00729f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000e9a0 tx=0x7f9ea000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 -- 172.21.15.151:0/67679567 shutdown_connections 2023-07-21T22:28:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9e980a12c0 0x7f9e980a3770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eb0105b10 0x7f9eb01a3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eb00ffb00 0x7f9eb00729f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 --2- 172.21.15.151:0/67679567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eb01004b0 0x7f9eb0072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 -- 172.21.15.151:0/67679567 >> 172.21.15.151:0/67679567 conn(0x7f9eb00fb600 msgr2=0x7f9eb00fbb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 -- 172.21.15.151:0/67679567 shutdown_connections 2023-07-21T22:28:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:29.791+0000 7f9eb4dff700 1 -- 172.21.15.151:0/67679567 wait complete. 2023-07-21T22:28:30.059 INFO:teuthology.orchestra.run.smithi151.stderr:39300000 of 50000000 tuples (78%) done (elapsed 533.55 s, remaining 145.27 s) 2023-07-21T22:28:30.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:30 smithi151 ceph-mon[95510]: pgmap v288: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:30 smithi187 ceph-mon[96918]: pgmap v288: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:30.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:30 smithi195 ceph-mon[97365]: pgmap v288: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:31.325 INFO:teuthology.orchestra.run.smithi151.stderr:39400000 of 50000000 tuples (78%) done (elapsed 534.82 s, remaining 143.88 s) 2023-07-21T22:28:31.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:31 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:28:31.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:31 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:28:31.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:31 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:28:32.558 INFO:teuthology.orchestra.run.smithi151.stderr:39500000 of 50000000 tuples (79%) done (elapsed 536.05 s, remaining 142.49 s) 2023-07-21T22:28:32.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:32 smithi151 ceph-mon[95510]: pgmap v289: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:32.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:32 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:28:32.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:32 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:28:32.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:32 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:28:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:32 smithi187 ceph-mon[96918]: pgmap v289: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:32 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:28:32.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:32 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:28:32.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:32 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:28:32.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:32 smithi195 ceph-mon[97365]: pgmap v289: 97 pgs: 97 active+clean; 8.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:32 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:28:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:32 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:28:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:32 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:28:33.904 INFO:teuthology.orchestra.run.smithi151.stderr:39600000 of 50000000 tuples (79%) done (elapsed 537.39 s, remaining 141.13 s) 2023-07-21T22:28:34.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:34 smithi151 ceph-mon[95510]: pgmap v290: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 35 MiB/s wr, 80 op/s 2023-07-21T22:28:34.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:34 smithi187 ceph-mon[96918]: pgmap v290: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 35 MiB/s wr, 80 op/s 2023-07-21T22:28:34.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:34 smithi195 ceph-mon[97365]: pgmap v290: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 35 MiB/s wr, 80 op/s 2023-07-21T22:28:35.149 INFO:teuthology.orchestra.run.smithi151.stderr:39700000 of 50000000 tuples (79%) done (elapsed 538.64 s, remaining 139.75 s) 2023-07-21T22:28:36.420 INFO:teuthology.orchestra.run.smithi151.stderr:39800000 of 50000000 tuples (79%) done (elapsed 539.91 s, remaining 138.37 s) 2023-07-21T22:28:36.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:36 smithi151 ceph-mon[95510]: pgmap v291: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 24 MiB/s wr, 59 op/s 2023-07-21T22:28:36.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:36 smithi187 ceph-mon[96918]: pgmap v291: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 24 MiB/s wr, 59 op/s 2023-07-21T22:28:36.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:36 smithi195 ceph-mon[97365]: pgmap v291: 97 pgs: 97 active+clean; 8.6 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 24 MiB/s wr, 59 op/s 2023-07-21T22:28:37.796 INFO:teuthology.orchestra.run.smithi151.stderr:39900000 of 50000000 tuples (79%) done (elapsed 541.29 s, remaining 137.02 s) 2023-07-21T22:28:38.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:38 smithi151 ceph-mon[95510]: pgmap v292: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 35 MiB/s wr, 92 op/s 2023-07-21T22:28:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:38 smithi187 ceph-mon[96918]: pgmap v292: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 35 MiB/s wr, 92 op/s 2023-07-21T22:28:38.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:38 smithi195 ceph-mon[97365]: pgmap v292: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 35 MiB/s wr, 92 op/s 2023-07-21T22:28:39.049 INFO:teuthology.orchestra.run.smithi151.stderr:40000000 of 50000000 tuples (80%) done (elapsed 542.54 s, remaining 135.63 s) 2023-07-21T22:28:40.264 INFO:teuthology.orchestra.run.smithi151.stderr:40100000 of 50000000 tuples (80%) done (elapsed 543.76 s, remaining 134.24 s) 2023-07-21T22:28:40.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:40 smithi151 ceph-mon[95510]: pgmap v293: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 54 op/s 2023-07-21T22:28:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:40 smithi187 ceph-mon[96918]: pgmap v293: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 54 op/s 2023-07-21T22:28:40.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:40 smithi195 ceph-mon[97365]: pgmap v293: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 54 op/s 2023-07-21T22:28:41.610 INFO:teuthology.orchestra.run.smithi151.stderr:40200000 of 50000000 tuples (80%) done (elapsed 545.10 s, remaining 132.89 s) 2023-07-21T22:28:42.842 INFO:teuthology.orchestra.run.smithi151.stderr:40300000 of 50000000 tuples (80%) done (elapsed 546.33 s, remaining 131.50 s) 2023-07-21T22:28:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:42 smithi187 ceph-mon[96918]: pgmap v294: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 54 op/s 2023-07-21T22:28:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:42 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:28:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:42 smithi195 ceph-mon[97365]: pgmap v294: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 54 op/s 2023-07-21T22:28:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:42 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:28:42.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:42 smithi151 ceph-mon[95510]: pgmap v294: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 23 MiB/s wr, 54 op/s 2023-07-21T22:28:42.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:42 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:28:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.954+0000 7f31cf7ff700 1 -- 172.21.15.151:0/550597241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31c81004b0 msgr2=0x7f31c810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.954+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/550597241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31c81004b0 0x7f31c810c940 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f31c000b0a0 tx=0x7f31c000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.954+0000 7f31cf7ff700 1 -- 172.21.15.151:0/550597241 shutdown_connections 2023-07-21T22:28:43.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.954+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/550597241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31c81004b0 0x7f31c810c940 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.954+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/550597241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31c8105b10 0x7f31c8105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.954+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/550597241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c80ffb00 0x7f31c80fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.954+0000 7f31cf7ff700 1 -- 172.21.15.151:0/550597241 >> 172.21.15.151:0/550597241 conn(0x7f31c80fb600 msgr2=0x7f31c80fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:43.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.954+0000 7f31cf7ff700 1 -- 172.21.15.151:0/550597241 shutdown_connections 2023-07-21T22:28:43.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.954+0000 7f31cf7ff700 1 -- 172.21.15.151:0/550597241 wait complete. 2023-07-21T22:28:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.955+0000 7f31cf7ff700 1 Processor -- start 2023-07-21T22:28:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.956+0000 7f31cf7ff700 1 -- start start 2023-07-21T22:28:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.956+0000 7f31cf7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31c80ffb00 0x7f31c80729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.956+0000 7f31cf7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c81004b0 0x7f31c8072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.956+0000 7f31cf7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31c8105b10 0x7f31c81a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.956+0000 7f31cf7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81a4360 con 0x7f31c80ffb00 2023-07-21T22:28:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.956+0000 7f31cf7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81a44a0 con 0x7f31c81004b0 2023-07-21T22:28:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.956+0000 7f31cf7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c81a4610 con 0x7f31c8105b10 2023-07-21T22:28:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31cd59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31c80ffb00 0x7f31c80729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31ccd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c81004b0 0x7f31c8072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31ccd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c81004b0 0x7f31c8072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34674/0 (socket says 172.21.15.151:34674) 2023-07-21T22:28:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31ccd9a700 1 -- 172.21.15.151:0/2950304980 learned_addr learned my addr 172.21.15.151:0/2950304980 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31cdd9c700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31c8105b10 0x7f31c81a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31cd59b700 1 -- 172.21.15.151:0/2950304980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31c8105b10 msgr2=0x7f31c81a3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31cd59b700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31c8105b10 0x7f31c81a3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31cd59b700 1 -- 172.21.15.151:0/2950304980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c81004b0 msgr2=0x7f31c8072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31cd59b700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c81004b0 0x7f31c8072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31cd59b700 1 -- 172.21.15.151:0/2950304980 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c0009d00 con 0x7f31c80ffb00 2023-07-21T22:28:43.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.957+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c81004b0 0x7f31c8072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:28:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.958+0000 7f31cd59b700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31c80ffb00 0x7f31c80729f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f31c400d950 tx=0x7f31c400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.958+0000 7f31be7fc700 1 -- 172.21.15.151:0/2950304980 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400f890 con 0x7f31c80ffb00 2023-07-21T22:28:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.958+0000 7f31cf7ff700 1 -- 172.21.15.151:0/2950304980 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c81a48f0 con 0x7f31c80ffb00 2023-07-21T22:28:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.958+0000 7f31cf7ff700 1 -- 172.21.15.151:0/2950304980 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c81a4e50 con 0x7f31c80ffb00 2023-07-21T22:28:43.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.958+0000 7f31be7fc700 1 -- 172.21.15.151:0/2950304980 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31c400fe80 con 0x7f31c80ffb00 2023-07-21T22:28:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.958+0000 7f31be7fc700 1 -- 172.21.15.151:0/2950304980 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c400e3b0 con 0x7f31c80ffb00 2023-07-21T22:28:43.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.962+0000 7f31be7fc700 1 -- 172.21.15.151:0/2950304980 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f31c400f9f0 con 0x7f31c80ffb00 2023-07-21T22:28:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.964+0000 7f31e3051b80 1 Processor -- start 2023-07-21T22:28:43.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.964+0000 7f31e3051b80 1 -- start start 2023-07-21T22:28:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.964+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd805fa6b0 0x55cd807a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.964+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd807a4210 0x55cd8079df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.964+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd8079e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.964+0000 7f31be7fc700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f31b40a1340 0x7f31b40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.964+0000 7f31e3051b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd806a3c50 con 0x55cd807a4210 2023-07-21T22:28:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.964+0000 7f31e3051b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd806f69e0 con 0x55cd805fa6b0 2023-07-21T22:28:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.964+0000 7f31e3051b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd806efe70 con 0x55cd807a4660 2023-07-21T22:28:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31be7fc700 1 -- 172.21.15.151:0/2950304980 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f31c40cc8c0 con 0x7f31c80ffb00 2023-07-21T22:28:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31cdd9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd805fa6b0 0x55cd807a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31ccd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd8079e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31cdd9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd805fa6b0 0x55cd807a3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34690/0 (socket says 172.21.15.151:34690) 2023-07-21T22:28:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31cdd9c700 1 -- 172.21.15.151:0/2593305561 learned_addr learned my addr 172.21.15.151:0/2593305561 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31cdd9c700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f31b40a1340 0x7f31b40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31cd59b700 1 --2- 172.21.15.151:0/2593305561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd807a4210 0x55cd8079df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31ccd9a700 1 -- 172.21.15.151:0/2593305561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd805fa6b0 msgr2=0x55cd807a3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/2593305561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd805fa6b0 0x55cd807a3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31ccd9a700 1 -- 172.21.15.151:0/2593305561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd807a4210 msgr2=0x55cd8079df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.965+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/2593305561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd807a4210 0x55cd8079df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.966+0000 7f31ccd9a700 1 -- 172.21.15.151:0/2593305561 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd8051dd80 con 0x55cd807a4660 2023-07-21T22:28:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.966+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/2593305561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd8079e4a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f31b8010450 tx=0x7f31b8010760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4f4a34a7e4919d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:43.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.966+0000 7f31cdd9c700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f31b40a1340 0x7f31b40a37f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009610 tx=0x7f31c0009be0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.966+0000 7f31b37fe700 1 -- 172.21.15.151:0/2593305561 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8004a30 con 0x55cd807a4660 2023-07-21T22:28:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.966+0000 7f31b37fe700 1 -- 172.21.15.151:0/2593305561 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31b8015070 con 0x55cd807a4660 2023-07-21T22:28:43.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.966+0000 7f31b37fe700 1 -- 172.21.15.151:0/2593305561 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b801a480 con 0x55cd807a4660 2023-07-21T22:28:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.967+0000 7f31e3051b80 1 -- 172.21.15.151:0/2593305561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 msgr2=0x55cd8079e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:43.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.967+0000 7f31e3051b80 1 --2- 172.21.15.151:0/2593305561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd8079e4a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f31b8010450 tx=0x7f31b8010760 comp rx=0 tx=0).stop 2023-07-21T22:28:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.967+0000 7f31e3051b80 1 -- 172.21.15.151:0/2593305561 shutdown_connections 2023-07-21T22:28:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.967+0000 7f31e3051b80 1 --2- 172.21.15.151:0/2593305561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd805fa6b0 0x55cd807a3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.967+0000 7f31e3051b80 1 --2- 172.21.15.151:0/2593305561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd8079e4a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.967+0000 7f31e3051b80 1 --2- 172.21.15.151:0/2593305561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd807a4210 0x55cd8079df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.967+0000 7f31e3051b80 1 -- 172.21.15.151:0/2593305561 >> 172.21.15.151:0/2593305561 conn(0x55cd80793ae0 msgr2=0x55cd807990e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.967+0000 7f31e3051b80 1 -- 172.21.15.151:0/2593305561 shutdown_connections 2023-07-21T22:28:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.968+0000 7f31e3051b80 1 -- 172.21.15.151:0/2593305561 wait complete. 2023-07-21T22:28:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.968+0000 7f31e3051b80 1 -- start start 2023-07-21T22:28:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31e3051b80 1 Processor -- start 2023-07-21T22:28:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aa540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd807a7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd807a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31e3051b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8068fa60 con 0x55cd805fa6b0 2023-07-21T22:28:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31e3051b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8068f760 con 0x55cd807a4210 2023-07-21T22:28:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31e3051b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd805738c0 con 0x55cd807a4660 2023-07-21T22:28:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31e3051b80 10 client.0 _ll_register_callbacks cb 0x55cd8068d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31ccd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd807a7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31cd59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aa540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31ccd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd807a7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34694/0 (socket says 172.21.15.151:34694) 2023-07-21T22:28:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31cd59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aa540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48960/0 (socket says 172.21.15.151:48960) 2023-07-21T22:28:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.969+0000 7f31ccd9a700 1 -- 172.21.15.151:0/3083667265 learned_addr learned my addr 172.21.15.151:0/3083667265 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.970+0000 7f31ccd9a700 1 -- 172.21.15.151:0/3083667265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 msgr2=0x55cd807a7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.970+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd807a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.970+0000 7f31ccd9a700 1 -- 172.21.15.151:0/3083667265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 msgr2=0x55cd807aa540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.970+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aa540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.970+0000 7f31ccd9a700 1 -- 172.21.15.151:0/3083667265 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b8007cd0 con 0x55cd807a4210 2023-07-21T22:28:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.970+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd807a7750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31b8005850 tx=0x7f31b8005110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a6a2d0537bc585 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.970+0000 7f31b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:28:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.971+0000 7f31b0ff9700 1 -- 172.21.15.151:0/3083667265 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31b8004020 con 0x55cd807a4210 2023-07-21T22:28:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.971+0000 7f31e3051b80 1 -- 172.21.15.151:0/3083667265 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cd80649490 con 0x55cd807a4210 2023-07-21T22:28:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.971+0000 7f31b0ff9700 1 -- 172.21.15.151:0/3083667265 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f31b8004180 con 0x55cd807a4210 2023-07-21T22:28:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.971+0000 7f31b0ff9700 1 -- 172.21.15.151:0/3083667265 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31b8004340 con 0x55cd807a4210 2023-07-21T22:28:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.971+0000 7f31e3051b80 10 client.26765 fetch_fsmap learned FSMap version 44 2023-07-21T22:28:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.971+0000 7f31e3051b80 1 -- 172.21.15.151:0/3083667265 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55cd80506c00 con 0x55cd807a4210 2023-07-21T22:28:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.971+0000 7f31b0ff9700 1 -- 172.21.15.151:0/3083667265 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cd80649490 con 0x55cd807a4210 2023-07-21T22:28:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.972+0000 7f31b0ff9700 1 -- 172.21.15.151:0/3083667265 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 44) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f31b80038e0 con 0x55cd807a4210 2023-07-21T22:28:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.972+0000 7f31e3051b80 10 client.26765 fetch_fsmap finished waiting for FSMap version 44 2023-07-21T22:28:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.972+0000 7f31e3051b80 10 client.26765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.972+0000 7f31e3051b80 20 client.26765 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.972+0000 7f31e3051b80 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cd807b7a30 0x55cd807b9e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.972+0000 7f31e3051b80 4 client.26765 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:28:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.972+0000 7f31e3051b80 1 -- 172.21.15.151:0/3083667265 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cd806e8e50 con 0x55cd807b7a30 2023-07-21T22:28:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.972+0000 7f31cd59b700 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cd807b7a30 0x55cd807b9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.973+0000 7f31b0ff9700 10 client.26765 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.973+0000 7f31cd59b700 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cd807b7a30 0x55cd807b9e40 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=672a2af1e62bf205 server_cookie=ab6b22c0dfc38bd0 in_seq=0 out_seq=0 2023-07-21T22:28:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31b0ff9700 1 -- 172.21.15.151:0/3083667265 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cd806e8e50 con 0x55cd807b7a30 2023-07-21T22:28:43.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31b0ff9700 10 client.26765 handle_command_reply: tid=0 2023-07-21T22:28:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 client.26765 shutdown 2023-07-21T22:28:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 -- 172.21.15.151:0/3083667265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 msgr2=0x55cd807a7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd807a7750 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f31b8005850 tx=0x7f31b8005110 comp rx=0 tx=0).stop 2023-07-21T22:28:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 -- 172.21.15.151:0/3083667265 shutdown_connections 2023-07-21T22:28:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cd807b7a30 0x55cd807b9e40 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd807a7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aa540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 --2- 172.21.15.151:0/3083667265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd807a7750 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31b0ff9700 0 client.26765 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:43.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 -- 172.21.15.151:0/3083667265 >> 172.21.15.151:0/3083667265 conn(0x55cd80793ae0 msgr2=0x55cd807983e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:43.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 -- 172.21.15.151:0/3083667265 shutdown_connections 2023-07-21T22:28:43.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 1 -- 172.21.15.151:0/3083667265 wait complete. 2023-07-21T22:28:43.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.974+0000 7f31e3051b80 20 client.26765 trim_cache size 0 max 16384 2023-07-21T22:28:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.992+0000 7f31e3051b80 1 Processor -- start 2023-07-21T22:28:43.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.992+0000 7f31e3051b80 1 -- start start 2023-07-21T22:28:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.992+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.992+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4210 0x55cd807a5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.992+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4660 0x55cd807aa070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.992+0000 7f31e3051b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd807a5cd0 con 0x55cd805fa6b0 2023-07-21T22:28:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.992+0000 7f31e3051b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd807a23d0 con 0x55cd807a4660 2023-07-21T22:28:43.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.992+0000 7f31e3051b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd8079a9d0 con 0x55cd807a4210 2023-07-21T22:28:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31cd59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31cd59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48968/0 (socket says 172.21.15.151:48968) 2023-07-21T22:28:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31cd59b700 1 -- 172.21.15.151:0/2626193744 learned_addr learned my addr 172.21.15.151:0/2626193744 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/2626193744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4210 0x55cd807a5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31cdd9c700 1 --2- 172.21.15.151:0/2626193744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4660 0x55cd807aa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31cd59b700 1 -- 172.21.15.151:0/2626193744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4210 msgr2=0x55cd807a5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:43.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31cd59b700 1 --2- 172.21.15.151:0/2626193744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4210 0x55cd807a5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31cd59b700 1 -- 172.21.15.151:0/2626193744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4660 msgr2=0x55cd807aa070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31cd59b700 1 --2- 172.21.15.151:0/2626193744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4660 0x55cd807aa070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.993+0000 7f31cd59b700 1 -- 172.21.15.151:0/2626193744 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cd805441f0 con 0x55cd805fa6b0 2023-07-21T22:28:43.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.994+0000 7f31cd59b700 1 --2- 172.21.15.151:0/2626193744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aec30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f31c40998e0 tx=0x7f31c4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d783b1acb39558 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:43.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.994+0000 7f31b3fff700 1 -- 172.21.15.151:0/2626193744 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c40b1070 con 0x55cd805fa6b0 2023-07-21T22:28:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.994+0000 7f31b3fff700 1 -- 172.21.15.151:0/2626193744 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31c40a1da0 con 0x55cd805fa6b0 2023-07-21T22:28:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.994+0000 7f31b3fff700 1 -- 172.21.15.151:0/2626193744 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c4099bb0 con 0x55cd805fa6b0 2023-07-21T22:28:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 -- 172.21.15.151:0/2626193744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 msgr2=0x55cd807aec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 --2- 172.21.15.151:0/2626193744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aec30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f31c40998e0 tx=0x7f31c4010000 comp rx=0 tx=0).stop 2023-07-21T22:28:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 -- 172.21.15.151:0/2626193744 shutdown_connections 2023-07-21T22:28:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 --2- 172.21.15.151:0/2626193744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4660 0x55cd807aa070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 --2- 172.21.15.151:0/2626193744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807aec30 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 --2- 172.21.15.151:0/2626193744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4210 0x55cd807a5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 -- 172.21.15.151:0/2626193744 >> 172.21.15.151:0/2626193744 conn(0x55cd80793ae0 msgr2=0x55cd807a4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 -- 172.21.15.151:0/2626193744 shutdown_connections 2023-07-21T22:28:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 -- 172.21.15.151:0/2626193744 wait complete. 2023-07-21T22:28:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 -- start start 2023-07-21T22:28:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.995+0000 7f31e3051b80 1 Processor -- start 2023-07-21T22:28:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807a0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd8079f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31e3051b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd8079fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31e3051b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd807a1450 con 0x55cd805fa6b0 2023-07-21T22:28:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31e3051b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd807a01e0 con 0x55cd807a4210 2023-07-21T22:28:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31e3051b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cd807a03a0 con 0x55cd807a4660 2023-07-21T22:28:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31e3051b80 10 client.0 _ll_register_callbacks cb 0x55cd8068d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31cd59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807a0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31cd59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807a0bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48976/0 (socket says 172.21.15.151:48976) 2023-07-21T22:28:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31cd59b700 1 -- 172.21.15.151:0/1605503401 learned_addr learned my addr 172.21.15.151:0/1605503401 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31cdd9c700 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd8079fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.996+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd8079f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31cd59b700 1 -- 172.21.15.151:0/1605503401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 msgr2=0x55cd8079fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31cd59b700 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd8079fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31cd59b700 1 -- 172.21.15.151:0/1605503401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 msgr2=0x55cd8079f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31cd59b700 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd8079f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31cd59b700 1 -- 172.21.15.151:0/1605503401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c81a4e50 con 0x55cd805fa6b0 2023-07-21T22:28:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31cd59b700 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807a0bd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f31c4000c00 tx=0x7f31c4097f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f01570c75eec7892 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31b0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:28:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31b0ff9700 1 -- 172.21.15.151:0/1605503401 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c40b1070 con 0x55cd805fa6b0 2023-07-21T22:28:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31b0ff9700 1 -- 172.21.15.151:0/1605503401 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f31c40b7cf0 con 0x55cd805fa6b0 2023-07-21T22:28:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.997+0000 7f31e3051b80 1 -- 172.21.15.151:0/1605503401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f31b8015070 con 0x55cd805fa6b0 2023-07-21T22:28:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31b0ff9700 1 -- 172.21.15.151:0/1605503401 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31c4014070 con 0x55cd805fa6b0 2023-07-21T22:28:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31e3051b80 10 client.17076 fetch_fsmap learned FSMap version 44 2023-07-21T22:28:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31e3051b80 1 -- 172.21.15.151:0/1605503401 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x55cd8051c250 con 0x55cd805fa6b0 2023-07-21T22:28:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31b0ff9700 1 -- 172.21.15.151:0/1605503401 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31b8015070 con 0x55cd805fa6b0 2023-07-21T22:28:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31b0ff9700 1 -- 172.21.15.151:0/1605503401 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 44) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f31c40a1910 con 0x55cd805fa6b0 2023-07-21T22:28:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31e3051b80 10 client.17076 fetch_fsmap finished waiting for FSMap version 44 2023-07-21T22:28:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31e3051b80 10 client.17076 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31e3051b80 20 client.17076 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31e3051b80 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cd8080c810 0x55cd8080ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31e3051b80 4 client.17076 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:28:43.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.998+0000 7f31e3051b80 1 -- 172.21.15.151:0/1605503401 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cd806aaff0 con 0x55cd8080c810 2023-07-21T22:28:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.999+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cd8080c810 0x55cd8080ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.999+0000 7f31b0ff9700 10 client.17076 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:43.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:42.999+0000 7f31ccd9a700 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cd8080c810 0x55cd8080ec20 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5e54920c8b682d8 server_cookie=858629b3c0213ce4 in_seq=0 out_seq=0 2023-07-21T22:28:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31b0ff9700 1 -- 172.21.15.151:0/1605503401 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cd806aaff0 con 0x55cd8080c810 2023-07-21T22:28:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31b0ff9700 10 client.17076 handle_command_reply: tid=0 2023-07-21T22:28:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 client.17076 shutdown 2023-07-21T22:28:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 -- 172.21.15.151:0/1605503401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 msgr2=0x55cd807a0bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807a0bd0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f31c4000c00 tx=0x7f31c4097f00 comp rx=0 tx=0).stop 2023-07-21T22:28:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 -- 172.21.15.151:0/1605503401 shutdown_connections 2023-07-21T22:28:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cd8080c810 0x55cd8080ec20 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cd807a4660 0x55cd8079fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31b0ff9700 0 client.17076 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cd805fa6b0 0x55cd807a0bd0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 --2- 172.21.15.151:0/1605503401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cd807a4210 0x55cd8079f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 -- 172.21.15.151:0/1605503401 >> 172.21.15.151:0/1605503401 conn(0x55cd80793ae0 msgr2=0x55cd807a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 -- 172.21.15.151:0/1605503401 shutdown_connections 2023-07-21T22:28:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.011+0000 7f31e3051b80 1 -- 172.21.15.151:0/1605503401 wait complete. 2023-07-21T22:28:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31e3051b80 20 client.17076 trim_cache size 0 max 16384 2023-07-21T22:28:43.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:28:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:28:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:28:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:28:43.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 -- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f31b40a1340 msgr2=0x7f31b40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f31b40a1340 0x7f31b40a37f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009610 tx=0x7f31c0009be0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 -- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31c80ffb00 msgr2=0x7f31c80729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31c80ffb00 0x7f31c80729f0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f31c400d950 tx=0x7f31c400dc60 comp rx=0 tx=0).stop 2023-07-21T22:28:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 -- 172.21.15.151:0/2950304980 shutdown_connections 2023-07-21T22:28:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f31b40a1340 0x7f31b40a37f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31c8105b10 0x7f31c81a3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31c80ffb00 0x7f31c80729f0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 --2- 172.21.15.151:0/2950304980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c81004b0 0x7f31c8072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 -- 172.21.15.151:0/2950304980 >> 172.21.15.151:0/2950304980 conn(0x7f31c80fb600 msgr2=0x7f31c80fbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.012+0000 7f31cf7ff700 1 -- 172.21.15.151:0/2950304980 shutdown_connections 2023-07-21T22:28:43.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:43.013+0000 7f31cf7ff700 1 -- 172.21.15.151:0/2950304980 wait complete. 2023-07-21T22:28:44.060 INFO:teuthology.orchestra.run.smithi151.stderr:40400000 of 50000000 tuples (80%) done (elapsed 547.55 s, remaining 130.11 s) 2023-07-21T22:28:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:44 smithi187 ceph-mon[96918]: pgmap v295: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:28:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:44 smithi195 ceph-mon[97365]: pgmap v295: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:28:44.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:44 smithi151 ceph-mon[95510]: pgmap v295: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 90 op/s 2023-07-21T22:28:45.295 INFO:teuthology.orchestra.run.smithi151.stderr:40500000 of 50000000 tuples (81%) done (elapsed 548.79 s, remaining 128.73 s) 2023-07-21T22:28:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:46 smithi187 ceph-mon[96918]: pgmap v296: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-07-21T22:28:46.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:46 smithi195 ceph-mon[97365]: pgmap v296: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-07-21T22:28:46.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:46 smithi151 ceph-mon[95510]: pgmap v296: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 23 MiB/s wr, 69 op/s 2023-07-21T22:28:47.026 INFO:teuthology.orchestra.run.smithi151.stderr:40600000 of 50000000 tuples (81%) done (elapsed 550.52 s, remaining 127.46 s) 2023-07-21T22:28:48.236 INFO:teuthology.orchestra.run.smithi151.stderr:40700000 of 50000000 tuples (81%) done (elapsed 551.73 s, remaining 126.07 s) 2023-07-21T22:28:48.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:48 smithi187 ceph-mon[96918]: pgmap v297: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 92 op/s 2023-07-21T22:28:48.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:48 smithi195 ceph-mon[97365]: pgmap v297: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 92 op/s 2023-07-21T22:28:48.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:48 smithi151 ceph-mon[95510]: pgmap v297: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 34 MiB/s wr, 92 op/s 2023-07-21T22:28:49.508 INFO:teuthology.orchestra.run.smithi151.stderr:40800000 of 50000000 tuples (81%) done (elapsed 553.00 s, remaining 124.70 s) 2023-07-21T22:28:50.811 INFO:teuthology.orchestra.run.smithi151.stderr:40900000 of 50000000 tuples (81%) done (elapsed 554.30 s, remaining 123.33 s) 2023-07-21T22:28:50.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:50 smithi187 ceph-mon[96918]: pgmap v298: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:50.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:50 smithi195 ceph-mon[97365]: pgmap v298: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:50.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:50 smithi151 ceph-mon[95510]: pgmap v298: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:52.077 INFO:teuthology.orchestra.run.smithi151.stderr:41000000 of 50000000 tuples (82%) done (elapsed 555.57 s, remaining 121.95 s) 2023-07-21T22:28:52.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:52 smithi187 ceph-mon[96918]: pgmap v299: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:52.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:52 smithi195 ceph-mon[97365]: pgmap v299: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:52.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:52 smithi151 ceph-mon[95510]: pgmap v299: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 23 MiB/s wr, 59 op/s 2023-07-21T22:28:53.335 INFO:teuthology.orchestra.run.smithi151.stderr:41100000 of 50000000 tuples (82%) done (elapsed 556.83 s, remaining 120.58 s) 2023-07-21T22:28:54.581 INFO:teuthology.orchestra.run.smithi151.stderr:41200000 of 50000000 tuples (82%) done (elapsed 558.07 s, remaining 119.20 s) 2023-07-21T22:28:54.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:54 smithi187 ceph-mon[96918]: pgmap v300: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 79 op/s 2023-07-21T22:28:54.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:54 smithi195 ceph-mon[97365]: pgmap v300: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 79 op/s 2023-07-21T22:28:54.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:54 smithi151 ceph-mon[95510]: pgmap v300: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 35 MiB/s wr, 79 op/s 2023-07-21T22:28:55.870 INFO:teuthology.orchestra.run.smithi151.stderr:41300000 of 50000000 tuples (82%) done (elapsed 559.36 s, remaining 117.83 s) 2023-07-21T22:28:56.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.177+0000 7f118bfff700 1 -- 172.21.15.151:0/3455935467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1184105b10 msgr2=0x7f1184105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.177+0000 7f118bfff700 1 --2- 172.21.15.151:0/3455935467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1184105b10 0x7f1184105ee0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f1180009990 tx=0x7f1180009ca0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.177+0000 7f118bfff700 1 -- 172.21.15.151:0/3455935467 shutdown_connections 2023-07-21T22:28:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.177+0000 7f118bfff700 1 --2- 172.21.15.151:0/3455935467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11841004b0 0x7f118410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.177+0000 7f118bfff700 1 --2- 172.21.15.151:0/3455935467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1184105b10 0x7f1184105ee0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.177+0000 7f118bfff700 1 --2- 172.21.15.151:0/3455935467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11840ffb00 0x7f11840fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.177+0000 7f118bfff700 1 -- 172.21.15.151:0/3455935467 >> 172.21.15.151:0/3455935467 conn(0x7f11840fb600 msgr2=0x7f11840fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:56.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.177+0000 7f118bfff700 1 -- 172.21.15.151:0/3455935467 shutdown_connections 2023-07-21T22:28:56.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.177+0000 7f118bfff700 1 -- 172.21.15.151:0/3455935467 wait complete. 2023-07-21T22:28:56.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.178+0000 7f118bfff700 1 Processor -- start 2023-07-21T22:28:56.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.178+0000 7f118bfff700 1 -- start start 2023-07-21T22:28:56.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f118bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11840ffb00 0x7f118419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f118bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11841004b0 0x7f118419c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f118bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1184105b10 0x7f1184195a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f118bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1184196070 con 0x7f11841004b0 2023-07-21T22:28:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f118bfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11841961e0 con 0x7f1184105b10 2023-07-21T22:28:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f118bfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11841963a0 con 0x7f11840ffb00 2023-07-21T22:28:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f118959a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11841004b0 0x7f118419c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f118959a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11841004b0 0x7f118419c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40054/0 (socket says 172.21.15.151:40054) 2023-07-21T22:28:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f118959a700 1 -- 172.21.15.151:0/2110836942 learned_addr learned my addr 172.21.15.151:0/2110836942 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.179+0000 7f1189d9b700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11840ffb00 0x7f118419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f118959a700 1 -- 172.21.15.151:0/2110836942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11840ffb00 msgr2=0x7f118419bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:56.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f118959a700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11840ffb00 0x7f118419bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f118959a700 1 -- 172.21.15.151:0/2110836942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1184105b10 msgr2=0x7f1184195a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f118959a700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1184105b10 0x7f1184195a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f118959a700 1 -- 172.21.15.151:0/2110836942 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11800095f0 con 0x7f11841004b0 2023-07-21T22:28:56.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f118959a700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11841004b0 0x7f118419c090 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f117400d950 tx=0x7f117400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:56.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f117affd700 1 -- 172.21.15.151:0/2110836942 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1174009940 con 0x7f11841004b0 2023-07-21T22:28:56.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f117affd700 1 -- 172.21.15.151:0/2110836942 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1174010460 con 0x7f11841004b0 2023-07-21T22:28:56.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f118bfff700 1 -- 172.21.15.151:0/2110836942 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1184196680 con 0x7f11841004b0 2023-07-21T22:28:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f117affd700 1 -- 172.21.15.151:0/2110836942 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117400f620 con 0x7f11841004b0 2023-07-21T22:28:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.180+0000 7f118bfff700 1 -- 172.21.15.151:0/2110836942 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11841a2b40 con 0x7f11841004b0 2023-07-21T22:28:56.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.184+0000 7f117affd700 1 -- 172.21.15.151:0/2110836942 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f11740105d0 con 0x7f11841004b0 2023-07-21T22:28:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.186+0000 7f117affd700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11700a12c0 0x7f11700a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.186+0000 7f119f844b80 1 Processor -- start 2023-07-21T22:28:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.186+0000 7f117affd700 1 -- 172.21.15.151:0/2110836942 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f11740ccb40 con 0x7f11841004b0 2023-07-21T22:28:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.186+0000 7f119f844b80 1 -- start start 2023-07-21T22:28:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f1189d9b700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11700a12c0 0x7f11700a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f119f844b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab785fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f119f844b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 0x561ab7859f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f119f844b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab785a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f119f844b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab775fc50 con 0x561ab76b66b0 2023-07-21T22:28:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f119f844b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab77b29e0 con 0x561ab7860210 2023-07-21T22:28:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f119f844b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab77abe70 con 0x561ab7860660 2023-07-21T22:28:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f118a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab785a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f118a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab785a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48376/0 (socket says 172.21.15.151:48376) 2023-07-21T22:28:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.187+0000 7f118a59c700 1 -- 172.21.15.151:0/3385362671 learned_addr learned my addr 172.21.15.151:0/3385362671 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f118959a700 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 0x561ab7859f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f1189d9b700 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab785fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f118a59c700 1 -- 172.21.15.151:0/3385362671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 msgr2=0x561ab7859f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:56.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f118a59c700 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 0x561ab7859f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f118a59c700 1 -- 172.21.15.151:0/3385362671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 msgr2=0x561ab785fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:56.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f118a59c700 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab785fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f118a59c700 1 -- 172.21.15.151:0/3385362671 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ab75d9d80 con 0x561ab7860660 2023-07-21T22:28:56.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f1189d9b700 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab785fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:28:56.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f1189d9b700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11700a12c0 0x7f11700a3770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1180006010 tx=0x7f11800051a0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:56.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f118a59c700 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab785a4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f117c00e3e0 tx=0x7f117c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25c2d25e9bf7d4d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:56.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.188+0000 7f116ffff700 1 -- 172.21.15.151:0/3385362671 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c018070 con 0x561ab7860660 2023-07-21T22:28:56.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.189+0000 7f116ffff700 1 -- 172.21.15.151:0/3385362671 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f117c003e90 con 0x561ab7860660 2023-07-21T22:28:56.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.189+0000 7f116ffff700 1 -- 172.21.15.151:0/3385362671 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c010040 con 0x561ab7860660 2023-07-21T22:28:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.189+0000 7f119f844b80 1 -- 172.21.15.151:0/3385362671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 msgr2=0x561ab785a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.189+0000 7f119f844b80 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab785a4a0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f117c00e3e0 tx=0x7f117c00b040 comp rx=0 tx=0).stop 2023-07-21T22:28:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.190+0000 7f119f844b80 1 -- 172.21.15.151:0/3385362671 shutdown_connections 2023-07-21T22:28:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.190+0000 7f119f844b80 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab785a4a0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.190+0000 7f119f844b80 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab785fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.190+0000 7f119f844b80 1 --2- 172.21.15.151:0/3385362671 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 0x561ab7859f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.190+0000 7f119f844b80 1 -- 172.21.15.151:0/3385362671 >> 172.21.15.151:0/3385362671 conn(0x561ab784fae0 msgr2=0x561ab78550e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.190+0000 7f119f844b80 1 -- 172.21.15.151:0/3385362671 shutdown_connections 2023-07-21T22:28:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.190+0000 7f119f844b80 1 -- 172.21.15.151:0/3385362671 wait complete. 2023-07-21T22:28:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.190+0000 7f119f844b80 1 -- start start 2023-07-21T22:28:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.191+0000 7f119f844b80 1 Processor -- start 2023-07-21T22:28:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.191+0000 7f119f844b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.191+0000 7f119f844b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860210 0x561ab786de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.191+0000 7f119f844b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab7867b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.191+0000 7f119f844b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab774ba60 con 0x561ab76b66b0 2023-07-21T22:28:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.191+0000 7f119f844b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab774b760 con 0x561ab7860660 2023-07-21T22:28:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.191+0000 7f119f844b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab762f8c0 con 0x561ab7860210 2023-07-21T22:28:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.191+0000 7f119f844b80 10 client.0 _ll_register_callbacks cb 0x561ab7749700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f1189d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f118a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab7867b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f1189d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40082/0 (socket says 172.21.15.151:40082) 2023-07-21T22:28:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f1189d9b700 1 -- 172.21.15.151:0/994089113 learned_addr learned my addr 172.21.15.151:0/994089113 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f118959a700 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860210 0x561ab786de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f118a59c700 1 -- 172.21.15.151:0/994089113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860210 msgr2=0x561ab786de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f118a59c700 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860210 0x561ab786de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f118a59c700 1 -- 172.21.15.151:0/994089113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 msgr2=0x561ab786d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f118a59c700 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.192+0000 7f118a59c700 1 -- 172.21.15.151:0/994089113 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f117c00e0c0 con 0x561ab7860660 2023-07-21T22:28:56.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.193+0000 7f118a59c700 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab7867b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f117c009960 tx=0x7f117c003cb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cfdb5146d0003939 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.193+0000 7f116d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:28:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.193+0000 7f116d7fa700 1 -- 172.21.15.151:0/994089113 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f117c020070 con 0x561ab7860660 2023-07-21T22:28:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.193+0000 7f116d7fa700 1 -- 172.21.15.151:0/994089113 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f117c0090d0 con 0x561ab7860660 2023-07-21T22:28:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.193+0000 7f119f844b80 1 -- 172.21.15.151:0/994089113 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561ab7705490 con 0x561ab7860660 2023-07-21T22:28:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.194+0000 7f116d7fa700 1 -- 172.21.15.151:0/994089113 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f117c018040 con 0x561ab7860660 2023-07-21T22:28:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.194+0000 7f119f844b80 10 client.26780 fetch_fsmap learned FSMap version 44 2023-07-21T22:28:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.194+0000 7f119f844b80 1 -- 172.21.15.151:0/994089113 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x561ab75c2c00 con 0x561ab7860660 2023-07-21T22:28:56.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.194+0000 7f116d7fa700 1 -- 172.21.15.151:0/994089113 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561ab7705490 con 0x561ab7860660 2023-07-21T22:28:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.194+0000 7f116d7fa700 1 -- 172.21.15.151:0/994089113 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 44) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f117c023020 con 0x561ab7860660 2023-07-21T22:28:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.194+0000 7f119f844b80 10 client.26780 fetch_fsmap finished waiting for FSMap version 44 2023-07-21T22:28:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.194+0000 7f119f844b80 10 client.26780 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.194+0000 7f119f844b80 20 client.26780 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.195+0000 7f119f844b80 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561ab7877dc0 0x561ab787a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.195+0000 7f119f844b80 4 client.26780 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:28:56.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.195+0000 7f119f844b80 1 -- 172.21.15.151:0/994089113 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561ab77a4e50 con 0x561ab7877dc0 2023-07-21T22:28:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.195+0000 7f1189d9b700 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561ab7877dc0 0x561ab787a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.196+0000 7f1189d9b700 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561ab7877dc0 0x561ab787a1d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c49c248d3bda11eb server_cookie=951d22dc83454dbc in_seq=0 out_seq=0 2023-07-21T22:28:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.196+0000 7f116d7fa700 10 client.26780 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.196+0000 7f116d7fa700 1 -- 172.21.15.151:0/994089113 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561ab77a4e50 con 0x561ab7877dc0 2023-07-21T22:28:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.196+0000 7f116d7fa700 10 client.26780 handle_command_reply: tid=0 2023-07-21T22:28:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.196+0000 7f119f844b80 1 client.26780 shutdown 2023-07-21T22:28:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 -- 172.21.15.151:0/994089113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 msgr2=0x561ab7867b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab7867b90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f117c009960 tx=0x7f117c003cb0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 -- 172.21.15.151:0/994089113 shutdown_connections 2023-07-21T22:28:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561ab7877dc0 0x561ab787a1d0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab7867b90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 --2- 172.21.15.151:0/994089113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860210 0x561ab786de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 -- 172.21.15.151:0/994089113 >> 172.21.15.151:0/994089113 conn(0x561ab784fae0 msgr2=0x561ab78543e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f116d7fa700 0 client.26780 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 -- 172.21.15.151:0/994089113 shutdown_connections 2023-07-21T22:28:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.197+0000 7f119f844b80 1 -- 172.21.15.151:0/994089113 wait complete. 2023-07-21T22:28:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.198+0000 7f119f844b80 20 client.26780 trim_cache size 0 max 16384 2023-07-21T22:28:56.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.221+0000 7f119f844b80 1 Processor -- start 2023-07-21T22:28:56.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f119f844b80 1 -- start start 2023-07-21T22:28:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f119f844b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab76b66b0 0x561ab7865740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f119f844b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab7860210 0x561ab785ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f119f844b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab785f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f119f844b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab785e470 con 0x561ab7860210 2023-07-21T22:28:56.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f119f844b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab784cab0 con 0x561ab7860660 2023-07-21T22:28:56.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f119f844b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab787a830 con 0x561ab76b66b0 2023-07-21T22:28:56.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f1189d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab76b66b0 0x561ab7865740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f1189d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab76b66b0 0x561ab7865740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48404/0 (socket says 172.21.15.151:48404) 2023-07-21T22:28:56.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f1189d9b700 1 -- 172.21.15.151:0/2067783181 learned_addr learned my addr 172.21.15.151:0/2067783181 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:56.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.222+0000 7f118959a700 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab7860210 0x561ab785ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.223+0000 7f118a59c700 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab785f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.223+0000 7f1189d9b700 1 -- 172.21.15.151:0/2067783181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 msgr2=0x561ab785f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:56.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.223+0000 7f1189d9b700 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab785f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.223+0000 7f1189d9b700 1 -- 172.21.15.151:0/2067783181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab7860210 msgr2=0x561ab785ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:56.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.223+0000 7f1189d9b700 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab7860210 0x561ab785ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.223+0000 7f1189d9b700 1 -- 172.21.15.151:0/2067783181 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561ab76001f0 con 0x561ab76b66b0 2023-07-21T22:28:56.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.223+0000 7f118a59c700 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab785f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:28:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.223+0000 7f1189d9b700 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab76b66b0 0x561ab7865740 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1180000c00 tx=0x7f1180022000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f99956a99dd0f20 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.224+0000 7f1178ff9700 1 -- 172.21.15.151:0/2067783181 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118000bdf0 con 0x561ab76b66b0 2023-07-21T22:28:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.224+0000 7f1178ff9700 1 -- 172.21.15.151:0/2067783181 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f118001e040 con 0x561ab76b66b0 2023-07-21T22:28:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.224+0000 7f1178ff9700 1 -- 172.21.15.151:0/2067783181 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180004b70 con 0x561ab76b66b0 2023-07-21T22:28:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.224+0000 7f119f844b80 1 -- 172.21.15.151:0/2067783181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab76b66b0 msgr2=0x561ab7865740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.224+0000 7f119f844b80 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab76b66b0 0x561ab7865740 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1180000c00 tx=0x7f1180022000 comp rx=0 tx=0).stop 2023-07-21T22:28:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.225+0000 7f119f844b80 1 -- 172.21.15.151:0/2067783181 shutdown_connections 2023-07-21T22:28:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.225+0000 7f119f844b80 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860660 0x561ab785f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.225+0000 7f119f844b80 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab76b66b0 0x561ab7865740 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.225+0000 7f119f844b80 1 --2- 172.21.15.151:0/2067783181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab7860210 0x561ab785ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.225+0000 7f119f844b80 1 -- 172.21.15.151:0/2067783181 >> 172.21.15.151:0/2067783181 conn(0x561ab784fae0 msgr2=0x561ab785e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.225+0000 7f119f844b80 1 -- 172.21.15.151:0/2067783181 shutdown_connections 2023-07-21T22:28:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.225+0000 7f119f844b80 1 -- 172.21.15.151:0/2067783181 wait complete. 2023-07-21T22:28:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.226+0000 7f119f844b80 1 -- start start 2023-07-21T22:28:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.226+0000 7f119f844b80 1 Processor -- start 2023-07-21T22:28:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.226+0000 7f119f844b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.226+0000 7f119f844b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 0x561ab786bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.226+0000 7f119f844b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab7863b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f119f844b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab786c700 con 0x561ab76b66b0 2023-07-21T22:28:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f119f844b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab786c870 con 0x561ab7860210 2023-07-21T22:28:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f119f844b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561ab7864080 con 0x561ab7860660 2023-07-21T22:28:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f119f844b80 10 client.0 _ll_register_callbacks cb 0x7f1174010bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:28:56.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f1189d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f1189d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40096/0 (socket says 172.21.15.151:40096) 2023-07-21T22:28:56.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f1189d9b700 1 -- 172.21.15.151:0/2427732843 learned_addr learned my addr 172.21.15.151:0/2427732843 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:28:56.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f118a59c700 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab7863b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f118959a700 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 0x561ab786bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f1189d9b700 1 -- 172.21.15.151:0/2427732843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 msgr2=0x561ab7863b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f1189d9b700 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab7863b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f1189d9b700 1 -- 172.21.15.151:0/2427732843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 msgr2=0x561ab786bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:28:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f1189d9b700 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 0x561ab786bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.227+0000 7f1189d9b700 1 -- 172.21.15.151:0/2427732843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f118410d240 con 0x561ab76b66b0 2023-07-21T22:28:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.228+0000 7f1189d9b700 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786ba30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1180038fc0 tx=0x7f1180038ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6141b3423bba4315 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:28:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.228+0000 7f116d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:28:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.228+0000 7f116d7fa700 1 -- 172.21.15.151:0/2427732843 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1180036560 con 0x561ab76b66b0 2023-07-21T22:28:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.228+0000 7f116d7fa700 1 -- 172.21.15.151:0/2427732843 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f118002c040 con 0x561ab76b66b0 2023-07-21T22:28:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.228+0000 7f119f844b80 1 -- 172.21.15.151:0/2427732843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f117c003e90 con 0x561ab76b66b0 2023-07-21T22:28:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f116d7fa700 1 -- 172.21.15.151:0/2427732843 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) v2 ==== 24+0+0 (secure 0 0 0) 0x7f118000bdf0 con 0x561ab76b66b0 2023-07-21T22:28:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f119f844b80 10 client.17094 fetch_fsmap learned FSMap version 44 2023-07-21T22:28:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f119f844b80 1 -- 172.21.15.151:0/2427732843 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) v3 -- 0x561ab75d8250 con 0x561ab76b66b0 2023-07-21T22:28:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f116d7fa700 1 -- 172.21.15.151:0/2427732843 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f117c003e90 con 0x561ab76b66b0 2023-07-21T22:28:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f116d7fa700 1 -- 172.21.15.151:0/2427732843 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 44) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f118004a070 con 0x561ab76b66b0 2023-07-21T22:28:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f119f844b80 10 client.17094 fetch_fsmap finished waiting for FSMap version 44 2023-07-21T22:28:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f119f844b80 10 client.17094 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:28:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f119f844b80 20 client.17094 populate_metadata read hostname 'smithi151' 2023-07-21T22:28:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f119f844b80 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561ab78d0c80 0x561ab78d3060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:28:56.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f119f844b80 4 client.17094 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:28:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.229+0000 7f119f844b80 1 -- 172.21.15.151:0/2427732843 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561ab7766ff0 con 0x561ab78d0c80 2023-07-21T22:28:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.230+0000 7f118959a700 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561ab78d0c80 0x561ab78d3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:28:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.230+0000 7f116d7fa700 10 client.17094 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:56.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.230+0000 7f118959a700 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561ab78d0c80 0x561ab78d3060 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1781bfd430d9302 server_cookie=90b3b355c8bc8e5 in_seq=0 out_seq=0 2023-07-21T22:28:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f116d7fa700 1 -- 172.21.15.151:0/2427732843 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561ab7766ff0 con 0x561ab78d0c80 2023-07-21T22:28:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f116d7fa700 10 client.17094 handle_command_reply: tid=0 2023-07-21T22:28:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 client.17094 shutdown 2023-07-21T22:28:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 -- 172.21.15.151:0/2427732843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 msgr2=0x561ab786ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786ba30 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f1180038fc0 tx=0x7f1180038ff0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 -- 172.21.15.151:0/2427732843 shutdown_connections 2023-07-21T22:28:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561ab78d0c80 0x561ab78d3060 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561ab7860660 0x561ab7863b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561ab76b66b0 0x561ab786ba30 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 --2- 172.21.15.151:0/2427732843 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561ab7860210 0x561ab786bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f116d7fa700 0 client.17094 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:28:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 -- 172.21.15.151:0/2427732843 >> 172.21.15.151:0/2427732843 conn(0x561ab784fae0 msgr2=0x561ab785f110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.244+0000 7f119f844b80 1 -- 172.21.15.151:0/2427732843 shutdown_connections 2023-07-21T22:28:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.245+0000 7f119f844b80 1 -- 172.21.15.151:0/2427732843 wait complete. 2023-07-21T22:28:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.245+0000 7f119f844b80 20 client.17094 trim_cache size 0 max 16384 2023-07-21T22:28:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:28:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:28:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:28:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:28:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.245+0000 7f118bfff700 1 -- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11700a12c0 msgr2=0x7f11700a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.245+0000 7f118bfff700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11700a12c0 0x7f11700a3770 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1180006010 tx=0x7f11800051a0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.245+0000 7f118bfff700 1 -- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11841004b0 msgr2=0x7f118419c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:28:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.245+0000 7f118bfff700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11841004b0 0x7f118419c090 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f117400d950 tx=0x7f117400dc60 comp rx=0 tx=0).stop 2023-07-21T22:28:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.246+0000 7f118bfff700 1 -- 172.21.15.151:0/2110836942 shutdown_connections 2023-07-21T22:28:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.246+0000 7f118bfff700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11700a12c0 0x7f11700a3770 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.246+0000 7f118bfff700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1184105b10 0x7f1184195a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.246+0000 7f118bfff700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f11840ffb00 0x7f118419bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.246+0000 7f118bfff700 1 --2- 172.21.15.151:0/2110836942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f11841004b0 0x7f118419c090 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:28:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.246+0000 7f118bfff700 1 -- 172.21.15.151:0/2110836942 >> 172.21.15.151:0/2110836942 conn(0x7f11840fb600 msgr2=0x7f11840fbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:28:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.246+0000 7f118bfff700 1 -- 172.21.15.151:0/2110836942 shutdown_connections 2023-07-21T22:28:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:28:56.246+0000 7f118bfff700 1 -- 172.21.15.151:0/2110836942 wait complete. 2023-07-21T22:28:56.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:56 smithi187 ceph-mon[96918]: pgmap v301: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-07-21T22:28:56.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:56 smithi195 ceph-mon[97365]: pgmap v301: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-07-21T22:28:56.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:56 smithi151 ceph-mon[95510]: pgmap v301: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 24 MiB/s wr, 43 op/s 2023-07-21T22:28:57.235 INFO:teuthology.orchestra.run.smithi151.stderr:41400000 of 50000000 tuples (82%) done (elapsed 560.73 s, remaining 116.48 s) 2023-07-21T22:28:58.466 INFO:teuthology.orchestra.run.smithi151.stderr:41500000 of 50000000 tuples (83%) done (elapsed 561.96 s, remaining 115.10 s) 2023-07-21T22:28:58.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:28:58 smithi187 ceph-mon[96918]: pgmap v302: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 35 MiB/s wr, 79 op/s 2023-07-21T22:28:58.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:28:58 smithi195 ceph-mon[97365]: pgmap v302: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 35 MiB/s wr, 79 op/s 2023-07-21T22:28:58.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:28:58 smithi151 ceph-mon[95510]: pgmap v302: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 35 MiB/s wr, 79 op/s 2023-07-21T22:28:59.732 INFO:teuthology.orchestra.run.smithi151.stderr:41600000 of 50000000 tuples (83%) done (elapsed 563.22 s, remaining 113.73 s) 2023-07-21T22:29:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:00 smithi187 ceph-mon[96918]: pgmap v303: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 23 MiB/s wr, 55 op/s 2023-07-21T22:29:00.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:00 smithi195 ceph-mon[97365]: pgmap v303: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 23 MiB/s wr, 55 op/s 2023-07-21T22:29:00.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:00 smithi151 ceph-mon[95510]: pgmap v303: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 23 MiB/s wr, 55 op/s 2023-07-21T22:29:02.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:02 smithi187 ceph-mon[96918]: pgmap v304: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 23 MiB/s wr, 55 op/s 2023-07-21T22:29:02.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:02 smithi195 ceph-mon[97365]: pgmap v304: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 23 MiB/s wr, 55 op/s 2023-07-21T22:29:02.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:02 smithi151 ceph-mon[95510]: pgmap v304: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 23 MiB/s wr, 55 op/s 2023-07-21T22:29:04.396 INFO:teuthology.orchestra.run.smithi151.stderr:41700000 of 50000000 tuples (83%) done (elapsed 567.89 s, remaining 113.03 s) 2023-07-21T22:29:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:04 smithi187 ceph-mon[96918]: pgmap v305: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 32 MiB/s wr, 89 op/s 2023-07-21T22:29:04.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:04 smithi195 ceph-mon[97365]: pgmap v305: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 32 MiB/s wr, 89 op/s 2023-07-21T22:29:04.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:04 smithi151 ceph-mon[95510]: pgmap v305: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 32 MiB/s wr, 89 op/s 2023-07-21T22:29:05.643 INFO:teuthology.orchestra.run.smithi151.stderr:41800000 of 50000000 tuples (83%) done (elapsed 569.13 s, remaining 111.65 s) 2023-07-21T22:29:06.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:06 smithi187 ceph-mon[96918]: pgmap v306: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-07-21T22:29:06.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:06 smithi195 ceph-mon[97365]: pgmap v306: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-07-21T22:29:06.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:06 smithi151 ceph-mon[95510]: pgmap v306: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 20 MiB/s wr, 69 op/s 2023-07-21T22:29:07.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:07 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:29:07.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:07 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:29:07.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:07 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:29:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:08 smithi187 ceph-mon[96918]: pgmap v307: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 25 MiB/s wr, 92 op/s 2023-07-21T22:29:08.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:08 smithi195 ceph-mon[97365]: pgmap v307: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 25 MiB/s wr, 92 op/s 2023-07-21T22:29:08.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:08 smithi151 ceph-mon[95510]: pgmap v307: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 25 MiB/s wr, 92 op/s 2023-07-21T22:29:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.424+0000 7fa8531ff700 1 -- 172.21.15.151:0/4293918453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 msgr2=0x7fa84c0fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.424+0000 7fa8531ff700 1 --2- 172.21.15.151:0/4293918453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 0x7fa84c0fff70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fa838009990 tx=0x7fa838009ca0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.424+0000 7fa8531ff700 1 -- 172.21.15.151:0/4293918453 shutdown_connections 2023-07-21T22:29:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.424+0000 7fa8531ff700 1 --2- 172.21.15.151:0/4293918453 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c105b10 0x7fa84c105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.424+0000 7fa8531ff700 1 --2- 172.21.15.151:0/4293918453 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa84c1004b0 0x7fa84c10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.424+0000 7fa8531ff700 1 --2- 172.21.15.151:0/4293918453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 0x7fa84c0fff70 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.424+0000 7fa8531ff700 1 -- 172.21.15.151:0/4293918453 >> 172.21.15.151:0/4293918453 conn(0x7fa84c0fb600 msgr2=0x7fa84c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.424+0000 7fa8531ff700 1 -- 172.21.15.151:0/4293918453 shutdown_connections 2023-07-21T22:29:09.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.424+0000 7fa8531ff700 1 -- 172.21.15.151:0/4293918453 wait complete. 2023-07-21T22:29:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.425+0000 7fa8531ff700 1 Processor -- start 2023-07-21T22:29:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa8531ff700 1 -- start start 2023-07-21T22:29:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa8531ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 0x7fa84c19bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa8531ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c1004b0 0x7fa84c19c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa8531ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa84c105b10 0x7fa84c1959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa8531ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c196010 con 0x7fa84c0ffb00 2023-07-21T22:29:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa8531ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c196180 con 0x7fa84c1004b0 2023-07-21T22:29:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa8531ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa84c196340 con 0x7fa84c105b10 2023-07-21T22:29:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa850f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 0x7fa84c19bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa850f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 0x7fa84c19bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40234/0 (socket says 172.21.15.151:40234) 2023-07-21T22:29:09.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.426+0000 7fa850f9b700 1 -- 172.21.15.151:0/2294754834 learned_addr learned my addr 172.21.15.151:0/2294754834 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa84bfff700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c1004b0 0x7fa84c19c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa85179c700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa84c105b10 0x7fa84c1959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa850f9b700 1 -- 172.21.15.151:0/2294754834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa84c105b10 msgr2=0x7fa84c1959a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa850f9b700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa84c105b10 0x7fa84c1959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa850f9b700 1 -- 172.21.15.151:0/2294754834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c1004b0 msgr2=0x7fa84c19c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa850f9b700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c1004b0 0x7fa84c19c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa850f9b700 1 -- 172.21.15.151:0/2294754834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8380095f0 con 0x7fa84c0ffb00 2023-07-21T22:29:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa850f9b700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 0x7fa84c19bb40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa84000e9a0 tx=0x7fa84000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa849ffb700 1 -- 172.21.15.151:0/2294754834 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840009790 con 0x7fa84c0ffb00 2023-07-21T22:29:09.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa849ffb700 1 -- 172.21.15.151:0/2294754834 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa84000cbd0 con 0x7fa84c0ffb00 2023-07-21T22:29:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa8531ff700 1 -- 172.21.15.151:0/2294754834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa84c196620 con 0x7fa84c0ffb00 2023-07-21T22:29:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.427+0000 7fa849ffb700 1 -- 172.21.15.151:0/2294754834 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa840018680 con 0x7fa84c0ffb00 2023-07-21T22:29:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.428+0000 7fa8531ff700 1 -- 172.21.15.151:0/2294754834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa84c1a2b30 con 0x7fa84c0ffb00 2023-07-21T22:29:09.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.431+0000 7fa849ffb700 1 -- 172.21.15.151:0/2294754834 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fa84000cd40 con 0x7fa84c0ffb00 2023-07-21T22:29:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.432+0000 7fa849ffb700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa83c0a1340 0x7fa83c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa849ffb700 1 -- 172.21.15.151:0/2294754834 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa840014070 con 0x7fa84c0ffb00 2023-07-21T22:29:09.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa866a56b80 1 Processor -- start 2023-07-21T22:29:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa84bfff700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa83c0a1340 0x7fa83c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa866a56b80 1 -- start start 2023-07-21T22:29:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee64736b0 0x55fee661ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee6616f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d660 0x55fee66174a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa866a56b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee651cc50 con 0x55fee661d210 2023-07-21T22:29:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa866a56b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee656f9e0 con 0x55fee64736b0 2023-07-21T22:29:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.433+0000 7fa866a56b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee6568e70 con 0x55fee661d660 2023-07-21T22:29:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa850f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee64736b0 0x55fee661ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa85179c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d660 0x55fee66174a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa850f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee64736b0 0x55fee661ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52392/0 (socket says 172.21.15.151:52392) 2023-07-21T22:29:09.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa850f9b700 1 -- 172.21.15.151:0/1231631947 learned_addr learned my addr 172.21.15.151:0/1231631947 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa84bfff700 1 --2- 172.21.15.151:0/1231631947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee6616f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa84bfff700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa83c0a1340 0x7fa83c0a37f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa838006010 tx=0x7fa838005c80 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa85179c700 1 -- 172.21.15.151:0/1231631947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee64736b0 msgr2=0x55fee661ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa85179c700 1 --2- 172.21.15.151:0/1231631947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee64736b0 0x55fee661ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa85179c700 1 -- 172.21.15.151:0/1231631947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 msgr2=0x55fee6616f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa85179c700 1 --2- 172.21.15.151:0/1231631947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee6616f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa85179c700 1 -- 172.21.15.151:0/1231631947 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fee6396d80 con 0x55fee661d660 2023-07-21T22:29:09.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.434+0000 7fa85179c700 1 --2- 172.21.15.151:0/1231631947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d660 0x55fee66174a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa844009bc0 tx=0x7fa844009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1818c3f9a3ad2b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.435+0000 7fa836ffd700 1 -- 172.21.15.151:0/1231631947 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844003a00 con 0x55fee661d660 2023-07-21T22:29:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.435+0000 7fa836ffd700 1 -- 172.21.15.151:0/1231631947 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa844004020 con 0x55fee661d660 2023-07-21T22:29:09.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.435+0000 7fa836ffd700 1 -- 172.21.15.151:0/1231631947 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844014660 con 0x55fee661d660 2023-07-21T22:29:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.435+0000 7fa866a56b80 1 -- 172.21.15.151:0/1231631947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d660 msgr2=0x55fee66174a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.435+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1231631947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d660 0x55fee66174a0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa844009bc0 tx=0x7fa844009ed0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.436+0000 7fa866a56b80 1 -- 172.21.15.151:0/1231631947 shutdown_connections 2023-07-21T22:29:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.436+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1231631947 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee64736b0 0x55fee661ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.436+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1231631947 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d660 0x55fee66174a0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.436+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1231631947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee6616f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.436+0000 7fa866a56b80 1 -- 172.21.15.151:0/1231631947 >> 172.21.15.151:0/1231631947 conn(0x55fee660cae0 msgr2=0x55fee66120e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.436+0000 7fa866a56b80 1 -- 172.21.15.151:0/1231631947 shutdown_connections 2023-07-21T22:29:09.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.436+0000 7fa866a56b80 1 -- 172.21.15.151:0/1231631947 wait complete. 2023-07-21T22:29:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.436+0000 7fa866a56b80 1 -- start start 2023-07-21T22:29:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa866a56b80 1 Processor -- start 2023-07-21T22:29:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 0x55fee662aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6624cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa866a56b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee6508a60 con 0x55fee661d210 2023-07-21T22:29:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa866a56b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee6508760 con 0x55fee661d660 2023-07-21T22:29:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa866a56b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee63ec8c0 con 0x55fee64736b0 2023-07-21T22:29:09.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa866a56b80 10 client.0 _ll_register_callbacks cb 0x55fee6506700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:29:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40260/0 (socket says 172.21.15.151:40260) 2023-07-21T22:29:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.437+0000 7fa84bfff700 1 -- 172.21.15.151:0/2873726519 learned_addr learned my addr 172.21.15.151:0/2873726519 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.438+0000 7fa85179c700 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6624cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.438+0000 7fa850f9b700 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 0x55fee662aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.438+0000 7fa84bfff700 1 -- 172.21.15.151:0/2873726519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 msgr2=0x55fee662aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.438+0000 7fa84bfff700 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 0x55fee662aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.438+0000 7fa84bfff700 1 -- 172.21.15.151:0/2873726519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 msgr2=0x55fee6624cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:09.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.438+0000 7fa84bfff700 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6624cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.438+0000 7fa84bfff700 1 -- 172.21.15.151:0/2873726519 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa844009820 con 0x55fee661d210 2023-07-21T22:29:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.438+0000 7fa84bfff700 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662af60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa838009990 tx=0x7fa838009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdfcd917ce31df9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.438+0000 7fa82bfff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:29:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa82bfff700 1 -- 172.21.15.151:0/2873726519 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838004af0 con 0x55fee661d210 2023-07-21T22:29:09.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa866a56b80 1 -- 172.21.15.151:0/2873726519 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fee64c2490 con 0x55fee661d210 2023-07-21T22:29:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa82bfff700 1 -- 172.21.15.151:0/2873726519 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(94..94 src has 1..94) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa838004c50 con 0x55fee661d210 2023-07-21T22:29:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa82bfff700 1 -- 172.21.15.151:0/2873726519 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa838004e50 con 0x55fee661d210 2023-07-21T22:29:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa866a56b80 10 client.17106 fetch_fsmap learned FSMap version 45 2023-07-21T22:29:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa866a56b80 1 -- 172.21.15.151:0/2873726519 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55fee637fc00 con 0x55fee661d210 2023-07-21T22:29:09.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa82bfff700 1 -- 172.21.15.151:0/2873726519 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa83803c020 con 0x55fee661d210 2023-07-21T22:29:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa82bfff700 1 -- 172.21.15.151:0/2873726519 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fa838027430 con 0x55fee661d210 2023-07-21T22:29:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa866a56b80 10 client.17106 fetch_fsmap finished waiting for FSMap version 45 2023-07-21T22:29:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.439+0000 7fa866a56b80 10 client.17106 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:29:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.440+0000 7fa866a56b80 20 client.17106 populate_metadata read hostname 'smithi151' 2023-07-21T22:29:09.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.440+0000 7fa866a56b80 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee6634f40 0x55fee6637350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.440+0000 7fa866a56b80 4 client.17106 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:29:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.440+0000 7fa866a56b80 1 -- 172.21.15.151:0/2873726519 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fee6561e50 con 0x55fee6634f40 2023-07-21T22:29:09.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.440+0000 7fa850f9b700 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee6634f40 0x55fee6637350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.440+0000 7fa82bfff700 10 client.17106 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.440+0000 7fa850f9b700 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee6634f40 0x55fee6637350 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4d1565be3b6d142 server_cookie=d0bcdf6cfcf0c31c in_seq=0 out_seq=0 2023-07-21T22:29:09.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.441+0000 7fa82bfff700 1 -- 172.21.15.151:0/2873726519 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fee6561e50 con 0x55fee6634f40 2023-07-21T22:29:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.441+0000 7fa82bfff700 10 client.17106 handle_command_reply: tid=0 2023-07-21T22:29:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.441+0000 7fa866a56b80 1 client.17106 shutdown 2023-07-21T22:29:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.441+0000 7fa866a56b80 1 -- 172.21.15.151:0/2873726519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 msgr2=0x55fee662af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.441+0000 7fa866a56b80 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662af60 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa838009990 tx=0x7fa838009ca0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa866a56b80 1 -- 172.21.15.151:0/2873726519 shutdown_connections 2023-07-21T22:29:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa866a56b80 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee6634f40 0x55fee6637350 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa866a56b80 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6624cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa866a56b80 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 0x55fee662aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa866a56b80 1 --2- 172.21.15.151:0/2873726519 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662af60 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa82bfff700 0 client.17106 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa866a56b80 1 -- 172.21.15.151:0/2873726519 >> 172.21.15.151:0/2873726519 conn(0x55fee660cae0 msgr2=0x55fee66113e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa866a56b80 1 -- 172.21.15.151:0/2873726519 shutdown_connections 2023-07-21T22:29:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa866a56b80 1 -- 172.21.15.151:0/2873726519 wait complete. 2023-07-21T22:29:09.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.442+0000 7fa866a56b80 20 client.17106 trim_cache size 0 max 16384 2023-07-21T22:29:09.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.464+0000 7fa866a56b80 1 Processor -- start 2023-07-21T22:29:09.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.466+0000 7fa866a56b80 1 -- start start 2023-07-21T22:29:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.466+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee64736b0 0x55fee661c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.466+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d210 0x55fee661f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.467+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6611b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.467+0000 7fa866a56b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee6618160 con 0x55fee64736b0 2023-07-21T22:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.467+0000 7fa866a56b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee6620630 con 0x55fee661d660 2023-07-21T22:29:09.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.467+0000 7fa866a56b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee660ec00 con 0x55fee661d210 2023-07-21T22:29:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.468+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d210 0x55fee661f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.468+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d210 0x55fee661f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42212/0 (socket says 172.21.15.151:42212) 2023-07-21T22:29:09.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.468+0000 7fa84bfff700 1 -- 172.21.15.151:0/362968 learned_addr learned my addr 172.21.15.151:0/362968 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.469+0000 7fa85179c700 1 --2- 172.21.15.151:0/362968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6611b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.470+0000 7fa85179c700 1 -- 172.21.15.151:0/362968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d210 msgr2=0x55fee661f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:09.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.470+0000 7fa85179c700 1 --2- 172.21.15.151:0/362968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d210 0x55fee661f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.470+0000 7fa85179c700 1 -- 172.21.15.151:0/362968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee64736b0 msgr2=0x55fee661c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.470+0000 7fa85179c700 1 --2- 172.21.15.151:0/362968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee64736b0 0x55fee661c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.470+0000 7fa85179c700 1 -- 172.21.15.151:0/362968 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fee63bd1f0 con 0x55fee661d660 2023-07-21T22:29:09.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.470+0000 7fa85179c700 1 --2- 172.21.15.151:0/362968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6611b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8440094f0 tx=0x7fa844006080 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e75730327cecce1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:09.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.473+0000 7fa8377fe700 1 -- 172.21.15.151:0/362968 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa844003a00 con 0x55fee661d660 2023-07-21T22:29:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.473+0000 7fa8377fe700 1 -- 172.21.15.151:0/362968 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa844004190 con 0x55fee661d660 2023-07-21T22:29:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.473+0000 7fa8377fe700 1 -- 172.21.15.151:0/362968 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84401f700 con 0x55fee661d660 2023-07-21T22:29:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.474+0000 7fa866a56b80 1 -- 172.21.15.151:0/362968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 msgr2=0x55fee6611b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:09.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.474+0000 7fa866a56b80 1 --2- 172.21.15.151:0/362968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6611b60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fa8440094f0 tx=0x7fa844006080 comp rx=0 tx=0).stop 2023-07-21T22:29:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.474+0000 7fa866a56b80 1 -- 172.21.15.151:0/362968 shutdown_connections 2023-07-21T22:29:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.474+0000 7fa866a56b80 1 --2- 172.21.15.151:0/362968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6611b60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.474+0000 7fa866a56b80 1 --2- 172.21.15.151:0/362968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee64736b0 0x55fee661c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.474+0000 7fa866a56b80 1 --2- 172.21.15.151:0/362968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee661d210 0x55fee661f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.474+0000 7fa866a56b80 1 -- 172.21.15.151:0/362968 >> 172.21.15.151:0/362968 conn(0x55fee660cae0 msgr2=0x55fee661f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:09.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.482+0000 7fa866a56b80 1 -- 172.21.15.151:0/362968 shutdown_connections 2023-07-21T22:29:09.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.488+0000 7fa866a56b80 1 -- 172.21.15.151:0/362968 wait complete. 2023-07-21T22:29:09.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.488+0000 7fa866a56b80 1 -- start start 2023-07-21T22:29:09.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.489+0000 7fa866a56b80 1 Processor -- start 2023-07-21T22:29:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.490+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 0x55fee662a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.490+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662ada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.490+0000 7fa866a56b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6623400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.490+0000 7fa866a56b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee6623b10 con 0x55fee661d210 2023-07-21T22:29:09.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.490+0000 7fa866a56b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee6623c80 con 0x55fee661d660 2023-07-21T22:29:09.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.490+0000 7fa866a56b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee6623e40 con 0x55fee64736b0 2023-07-21T22:29:09.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.490+0000 7fa866a56b80 10 client.0 _ll_register_callbacks cb 0x7fa83800b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:29:09.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.491+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.491+0000 7fa84bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662ada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40282/0 (socket says 172.21.15.151:40282) 2023-07-21T22:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.491+0000 7fa84bfff700 1 -- 172.21.15.151:0/1711504029 learned_addr learned my addr 172.21.15.151:0/1711504029 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.492+0000 7fa85179c700 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6623400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.492+0000 7fa850f9b700 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 0x55fee662a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.492+0000 7fa84bfff700 1 -- 172.21.15.151:0/1711504029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 msgr2=0x55fee662a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.492+0000 7fa84bfff700 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 0x55fee662a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.492+0000 7fa84bfff700 1 -- 172.21.15.151:0/1711504029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 msgr2=0x55fee6623400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:09.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.492+0000 7fa84bfff700 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6623400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.492+0000 7fa84bfff700 1 -- 172.21.15.151:0/1711504029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fee6396d80 con 0x55fee661d210 2023-07-21T22:29:09.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.493+0000 7fa84bfff700 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662ada0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa838009990 tx=0x7fa838027c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86baa77ff5ad40be server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.493+0000 7fa82bfff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:29:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.494+0000 7fa82bfff700 1 -- 172.21.15.151:0/1711504029 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa838004dc0 con 0x55fee661d210 2023-07-21T22:29:09.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.494+0000 7fa82bfff700 1 -- 172.21.15.151:0/1711504029 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(95..95 src has 1..95) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fa83803d080 con 0x55fee661d210 2023-07-21T22:29:09.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.494+0000 7fa866a56b80 1 -- 172.21.15.151:0/1711504029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa844004020 con 0x55fee661d210 2023-07-21T22:29:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.495+0000 7fa82bfff700 1 -- 172.21.15.151:0/1711504029 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa83800f460 con 0x55fee661d210 2023-07-21T22:29:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.495+0000 7fa866a56b80 10 client.17109 fetch_fsmap learned FSMap version 45 2023-07-21T22:29:09.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.495+0000 7fa866a56b80 1 -- 172.21.15.151:0/1711504029 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) v3 -- 0x55fee6395250 con 0x55fee661d210 2023-07-21T22:29:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.496+0000 7fa82bfff700 1 -- 172.21.15.151:0/1711504029 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa838048030 con 0x55fee661d210 2023-07-21T22:29:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.496+0000 7fa82bfff700 1 -- 172.21.15.151:0/1711504029 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 45) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fa838041540 con 0x55fee661d210 2023-07-21T22:29:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.496+0000 7fa866a56b80 10 client.17109 fetch_fsmap finished waiting for FSMap version 45 2023-07-21T22:29:09.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.496+0000 7fa866a56b80 10 client.17109 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:29:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.496+0000 7fa866a56b80 20 client.17109 populate_metadata read hostname 'smithi151' 2023-07-21T22:29:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.496+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee668e2a0 0x55fee66906b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.496+0000 7fa866a56b80 4 client.17109 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:29:09.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.496+0000 7fa866a56b80 1 -- 172.21.15.151:0/1711504029 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fee6523ff0 con 0x55fee668e2a0 2023-07-21T22:29:09.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.498+0000 7fa850f9b700 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee668e2a0 0x55fee66906b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.502+0000 7fa850f9b700 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee668e2a0 0x55fee66906b0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2bb2f96f379d1c4 server_cookie=6e712f1c57d4ed45 in_seq=0 out_seq=0 2023-07-21T22:29:09.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.502+0000 7fa82bfff700 10 client.17109 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.569+0000 7fa82bfff700 1 -- 172.21.15.151:0/1711504029 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fee6523ff0 con 0x55fee668e2a0 2023-07-21T22:29:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.569+0000 7fa82bfff700 10 client.17109 handle_command_reply: tid=0 2023-07-21T22:29:09.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.570+0000 7fa866a56b80 1 client.17109 shutdown 2023-07-21T22:29:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.572+0000 7fa866a56b80 1 -- 172.21.15.151:0/1711504029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 msgr2=0x55fee662ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:09.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.572+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662ada0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa838009990 tx=0x7fa838027c60 comp rx=0 tx=0).stop 2023-07-21T22:29:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.572+0000 7fa866a56b80 1 -- 172.21.15.151:0/1711504029 shutdown_connections 2023-07-21T22:29:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.572+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee668e2a0 0x55fee66906b0 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.572+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee661d660 0x55fee6623400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.572+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee64736b0 0x55fee662a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.572+0000 7fa866a56b80 1 --2- 172.21.15.151:0/1711504029 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee661d210 0x55fee662ada0 secure :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fa838009990 tx=0x7fa838027c60 comp rx=0 tx=0).stop 2023-07-21T22:29:09.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.572+0000 7fa866a56b80 1 -- 172.21.15.151:0/1711504029 >> 172.21.15.151:0/1711504029 conn(0x55fee660cae0 msgr2=0x55fee661f930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.572+0000 7fa82bfff700 0 client.17109 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.574+0000 7fa866a56b80 1 -- 172.21.15.151:0/1711504029 shutdown_connections 2023-07-21T22:29:09.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.574+0000 7fa866a56b80 1 -- 172.21.15.151:0/1711504029 wait complete. 2023-07-21T22:29:09.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.576+0000 7fa866a56b80 20 client.17109 trim_cache size 0 max 16384 2023-07-21T22:29:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:29:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:29:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:29:09.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:29:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.578+0000 7fa8531ff700 1 -- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa83c0a1340 msgr2=0x7fa83c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:09.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.578+0000 7fa8531ff700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa83c0a1340 0x7fa83c0a37f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa838006010 tx=0x7fa838005c80 comp rx=0 tx=0).stop 2023-07-21T22:29:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.578+0000 7fa8531ff700 1 -- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 msgr2=0x7fa84c19bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.578+0000 7fa8531ff700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 0x7fa84c19bb40 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa84000e9a0 tx=0x7fa84000ed60 comp rx=0 tx=0).stop 2023-07-21T22:29:09.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.579+0000 7fa8531ff700 1 -- 172.21.15.151:0/2294754834 shutdown_connections 2023-07-21T22:29:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.579+0000 7fa8531ff700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa83c0a1340 0x7fa83c0a37f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.579+0000 7fa8531ff700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa84c105b10 0x7fa84c1959a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.579+0000 7fa8531ff700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa84c0ffb00 0x7fa84c19bb40 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.579+0000 7fa8531ff700 1 --2- 172.21.15.151:0/2294754834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa84c1004b0 0x7fa84c19c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.579+0000 7fa8531ff700 1 -- 172.21.15.151:0/2294754834 >> 172.21.15.151:0/2294754834 conn(0x7fa84c0fb600 msgr2=0x7fa84c103610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.579+0000 7fa8531ff700 1 -- 172.21.15.151:0/2294754834 shutdown_connections 2023-07-21T22:29:09.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:09.579+0000 7fa8531ff700 1 -- 172.21.15.151:0/2294754834 wait complete. 2023-07-21T22:29:10.000 INFO:teuthology.orchestra.run.smithi151.stderr:41900000 of 50000000 tuples (83%) done (elapsed 573.49 s, remaining 110.87 s) 2023-07-21T22:29:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:10 smithi187 ceph-mon[96918]: pgmap v308: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 56 op/s 2023-07-21T22:29:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:10 smithi187 ceph-mon[96918]: osdmap e95: 12 total, 12 up, 12 in 2023-07-21T22:29:10.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:10 smithi195 ceph-mon[97365]: pgmap v308: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 56 op/s 2023-07-21T22:29:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:10 smithi195 ceph-mon[97365]: osdmap e95: 12 total, 12 up, 12 in 2023-07-21T22:29:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:10 smithi151 ceph-mon[95510]: pgmap v308: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 14 MiB/s wr, 56 op/s 2023-07-21T22:29:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:10 smithi151 ceph-mon[95510]: osdmap e95: 12 total, 12 up, 12 in 2023-07-21T22:29:11.407 INFO:teuthology.orchestra.run.smithi151.stderr:42000000 of 50000000 tuples (84%) done (elapsed 574.90 s, remaining 109.50 s) 2023-07-21T22:29:12.661 INFO:teuthology.orchestra.run.smithi151.stderr:42100000 of 50000000 tuples (84%) done (elapsed 576.15 s, remaining 108.11 s) 2023-07-21T22:29:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:12 smithi187 ceph-mon[96918]: pgmap v310: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 67 op/s 2023-07-21T22:29:12.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:12 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:29:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:12 smithi195 ceph-mon[97365]: pgmap v310: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 67 op/s 2023-07-21T22:29:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:12 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:29:12.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:12 smithi151 ceph-mon[95510]: pgmap v310: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 67 op/s 2023-07-21T22:29:12.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:12 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:29:13.942 INFO:teuthology.orchestra.run.smithi151.stderr:42200000 of 50000000 tuples (84%) done (elapsed 577.43 s, remaining 106.73 s) 2023-07-21T22:29:14.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:14 smithi187 ceph-mon[96918]: pgmap v311: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 13 MiB/s wr, 65 op/s 2023-07-21T22:29:14.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:14 smithi195 ceph-mon[97365]: pgmap v311: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 13 MiB/s wr, 65 op/s 2023-07-21T22:29:14.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:14 smithi151 ceph-mon[95510]: pgmap v311: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 13 MiB/s wr, 65 op/s 2023-07-21T22:29:15.279 INFO:teuthology.orchestra.run.smithi151.stderr:42300000 of 50000000 tuples (84%) done (elapsed 578.77 s, remaining 105.36 s) 2023-07-21T22:29:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:16 smithi187 ceph-mon[96918]: pgmap v312: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 13 MiB/s wr, 65 op/s 2023-07-21T22:29:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:16 smithi187 ceph-mon[96918]: osdmap e96: 12 total, 12 up, 12 in 2023-07-21T22:29:16.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:16 smithi195 ceph-mon[97365]: pgmap v312: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 13 MiB/s wr, 65 op/s 2023-07-21T22:29:16.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:16 smithi195 ceph-mon[97365]: osdmap e96: 12 total, 12 up, 12 in 2023-07-21T22:29:16.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:16 smithi151 ceph-mon[95510]: pgmap v312: 97 pgs: 97 active+clean; 8.7 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 13 MiB/s wr, 65 op/s 2023-07-21T22:29:16.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:16 smithi151 ceph-mon[95510]: osdmap e96: 12 total, 12 up, 12 in 2023-07-21T22:29:17.173 INFO:teuthology.orchestra.run.smithi151.stderr:42400000 of 50000000 tuples (84%) done (elapsed 580.66 s, remaining 104.08 s) 2023-07-21T22:29:18.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:18 smithi187 ceph-mon[96918]: pgmap v314: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 24 MiB/s wr, 97 op/s 2023-07-21T22:29:18.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:18 smithi195 ceph-mon[97365]: pgmap v314: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 24 MiB/s wr, 97 op/s 2023-07-21T22:29:18.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:18 smithi151 ceph-mon[95510]: pgmap v314: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 183 KiB/s rd, 24 MiB/s wr, 97 op/s 2023-07-21T22:29:19.647 INFO:teuthology.orchestra.run.smithi151.stderr:42500000 of 50000000 tuples (85%) done (elapsed 583.14 s, remaining 102.91 s) 2023-07-21T22:29:20.842 INFO:teuthology.orchestra.run.smithi151.stderr:42600000 of 50000000 tuples (85%) done (elapsed 584.33 s, remaining 101.50 s) 2023-07-21T22:29:20.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:20 smithi187 ceph-mon[96918]: pgmap v315: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 20 MiB/s wr, 81 op/s 2023-07-21T22:29:20.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:20 smithi195 ceph-mon[97365]: pgmap v315: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 20 MiB/s wr, 81 op/s 2023-07-21T22:29:20.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:20 smithi151 ceph-mon[95510]: pgmap v315: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 154 KiB/s rd, 20 MiB/s wr, 81 op/s 2023-07-21T22:29:22.344 INFO:teuthology.orchestra.run.smithi151.stderr:42700000 of 50000000 tuples (85%) done (elapsed 585.84 s, remaining 100.15 s) 2023-07-21T22:29:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.753+0000 7f3febbff700 1 -- 172.21.15.151:0/1447307651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 msgr2=0x7f3fe40fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.753+0000 7f3febbff700 1 --2- 172.21.15.151:0/1447307651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 0x7f3fe40fff70 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f3fd4009990 tx=0x7f3fd4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.753+0000 7f3febbff700 1 -- 172.21.15.151:0/1447307651 shutdown_connections 2023-07-21T22:29:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.753+0000 7f3febbff700 1 --2- 172.21.15.151:0/1447307651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe41004b0 0x7f3fe410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.753+0000 7f3febbff700 1 --2- 172.21.15.151:0/1447307651 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe4105b10 0x7f3fe4105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.753+0000 7f3febbff700 1 --2- 172.21.15.151:0/1447307651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 0x7f3fe40fff70 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.753+0000 7f3febbff700 1 -- 172.21.15.151:0/1447307651 >> 172.21.15.151:0/1447307651 conn(0x7f3fe40fb600 msgr2=0x7f3fe40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.753+0000 7f3febbff700 1 -- 172.21.15.151:0/1447307651 shutdown_connections 2023-07-21T22:29:22.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.753+0000 7f3febbff700 1 -- 172.21.15.151:0/1447307651 wait complete. 2023-07-21T22:29:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.755+0000 7f3febbff700 1 Processor -- start 2023-07-21T22:29:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.755+0000 7f3febbff700 1 -- start start 2023-07-21T22:29:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.755+0000 7f3febbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 0x7f3fe40729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.755+0000 7f3febbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe41004b0 0x7f3fe4072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.755+0000 7f3febbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4105b10 0x7f3fe41a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.755+0000 7f3febbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41a4290 con 0x7f3fe40ffb00 2023-07-21T22:29:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.755+0000 7f3febbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41a43d0 con 0x7f3fe4105b10 2023-07-21T22:29:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.755+0000 7f3febbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe41a4540 con 0x7f3fe41004b0 2023-07-21T22:29:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fe999b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 0x7f3fe40729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fe999b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 0x7f3fe40729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50508/0 (socket says 172.21.15.151:50508) 2023-07-21T22:29:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fe999b700 1 -- 172.21.15.151:0/3612874395 learned_addr learned my addr 172.21.15.151:0/3612874395 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fe919a700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe41004b0 0x7f3fe4072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fea19c700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4105b10 0x7f3fe41a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fe999b700 1 -- 172.21.15.151:0/3612874395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe41004b0 msgr2=0x7f3fe4072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fe999b700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe41004b0 0x7f3fe4072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fe999b700 1 -- 172.21.15.151:0/3612874395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4105b10 msgr2=0x7f3fe41a3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fe999b700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4105b10 0x7f3fe41a3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.756+0000 7f3fe999b700 1 -- 172.21.15.151:0/3612874395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd40095f0 con 0x7f3fe40ffb00 2023-07-21T22:29:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.757+0000 7f3fe999b700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 0x7f3fe40729f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000e9a0 tx=0x7f3fe000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.757+0000 7f3fdaffd700 1 -- 172.21.15.151:0/3612874395 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0009790 con 0x7f3fe40ffb00 2023-07-21T22:29:22.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.757+0000 7f3fdaffd700 1 -- 172.21.15.151:0/3612874395 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fe0010430 con 0x7f3fe40ffb00 2023-07-21T22:29:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.757+0000 7f3febbff700 1 -- 172.21.15.151:0/3612874395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe41a4820 con 0x7f3fe40ffb00 2023-07-21T22:29:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.757+0000 7f3fdaffd700 1 -- 172.21.15.151:0/3612874395 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000cea0 con 0x7f3fe40ffb00 2023-07-21T22:29:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.757+0000 7f3febbff700 1 -- 172.21.15.151:0/3612874395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe41a4d80 con 0x7f3fe40ffb00 2023-07-21T22:29:22.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.760+0000 7f3fdaffd700 1 -- 172.21.15.151:0/3612874395 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f3fe00105a0 con 0x7f3fe40ffb00 2023-07-21T22:29:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.762+0000 7f3fdaffd700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3fd00a1340 0x7f3fd00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.762+0000 7f3fdaffd700 1 -- 172.21.15.151:0/3612874395 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3fe0014070 con 0x7f3fe40ffb00 2023-07-21T22:29:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.762+0000 7f3fe919a700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3fd00a1340 0x7f3fd00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.762+0000 7f3fff44fb80 1 Processor -- start 2023-07-21T22:29:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fff44fb80 1 -- start start 2023-07-21T22:29:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fe919a700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3fd00a1340 0x7f3fd00a37f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4074210 tx=0x7f3fd400b260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 0x5625e88c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e87c7c50 con 0x5625e871e6b0 2023-07-21T22:29:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e881a9e0 con 0x5625e88c8210 2023-07-21T22:29:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e8813e70 con 0x5625e88c8660 2023-07-21T22:29:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fe999b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fe999b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50522/0 (socket says 172.21.15.151:50522) 2023-07-21T22:29:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fe999b700 1 -- 172.21.15.151:0/705818421 learned_addr learned my addr 172.21.15.151:0/705818421 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.763+0000 7f3fe919a700 1 --2- 172.21.15.151:0/705818421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 0x5625e88c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fea19c700 1 --2- 172.21.15.151:0/705818421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fe999b700 1 -- 172.21.15.151:0/705818421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 msgr2=0x5625e88c24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fe999b700 1 --2- 172.21.15.151:0/705818421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fe999b700 1 -- 172.21.15.151:0/705818421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 msgr2=0x5625e88c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:22.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fe999b700 1 --2- 172.21.15.151:0/705818421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 0x5625e88c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fe999b700 1 -- 172.21.15.151:0/705818421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625e8641d80 con 0x5625e871e6b0 2023-07-21T22:29:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fe999b700 1 --2- 172.21.15.151:0/705818421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7cd0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0096950 tx=0x7f3fe00998c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0af8c48478b1d6b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fcffff700 1 -- 172.21.15.151:0/705818421 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe009df10 con 0x5625e871e6b0 2023-07-21T22:29:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fcffff700 1 -- 172.21.15.151:0/705818421 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fe00a2330 con 0x5625e871e6b0 2023-07-21T22:29:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.764+0000 7f3fcffff700 1 -- 172.21.15.151:0/705818421 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe00a1ea0 con 0x5625e871e6b0 2023-07-21T22:29:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.765+0000 7f3fff44fb80 1 -- 172.21.15.151:0/705818421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 msgr2=0x5625e88c7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:22.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.765+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/705818421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7cd0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0096950 tx=0x7f3fe00998c0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.765+0000 7f3fff44fb80 1 -- 172.21.15.151:0/705818421 shutdown_connections 2023-07-21T22:29:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.765+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/705818421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.765+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/705818421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7cd0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.765+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/705818421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 0x5625e88c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.765+0000 7f3fff44fb80 1 -- 172.21.15.151:0/705818421 >> 172.21.15.151:0/705818421 conn(0x5625e88b7ae0 msgr2=0x5625e88bd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.765+0000 7f3fff44fb80 1 -- 172.21.15.151:0/705818421 shutdown_connections 2023-07-21T22:29:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.766+0000 7f3fff44fb80 1 -- 172.21.15.151:0/705818421 wait complete. 2023-07-21T22:29:22.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.766+0000 7f3fff44fb80 1 -- start start 2023-07-21T22:29:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.766+0000 7f3fff44fb80 1 Processor -- start 2023-07-21T22:29:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.767+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.767+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.767+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8660 0x5625e88cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.767+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e87b3a60 con 0x5625e871e6b0 2023-07-21T22:29:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.767+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e87b3760 con 0x5625e88c8660 2023-07-21T22:29:22.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.767+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e86978c0 con 0x5625e88c8210 2023-07-21T22:29:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.767+0000 7f3fff44fb80 10 client.0 _ll_register_callbacks cb 0x5625e87b1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:29:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.767+0000 7f3fe999b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fe999b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50536/0 (socket says 172.21.15.151:50536) 2023-07-21T22:29:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fe999b700 1 -- 172.21.15.151:0/2408740830 learned_addr learned my addr 172.21.15.151:0/2408740830 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fe919a700 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fea19c700 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8660 0x5625e88cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fe999b700 1 -- 172.21.15.151:0/2408740830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 msgr2=0x5625e88d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:22.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fe999b700 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fe999b700 1 -- 172.21.15.151:0/2408740830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8660 msgr2=0x5625e88cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fe999b700 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8660 0x5625e88cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fe999b700 1 -- 172.21.15.151:0/2408740830 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe41a4d80 con 0x5625e871e6b0 2023-07-21T22:29:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.768+0000 7f3fea19c700 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8660 0x5625e88cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:29:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.769+0000 7f3fe999b700 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0010b20 tx=0x7f3fe0099680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cf76c41bbecd982 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:22.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.769+0000 7f3fcd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:29:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.769+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2408740830 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe009df90 con 0x5625e871e6b0 2023-07-21T22:29:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.769+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2408740830 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3fe00b8200 con 0x5625e871e6b0 2023-07-21T22:29:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.769+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2408740830 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5625e876d490 con 0x5625e871e6b0 2023-07-21T22:29:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.769+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2408740830 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fe00ca1a0 con 0x5625e871e6b0 2023-07-21T22:29:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.769+0000 7f3fff44fb80 10 client.17121 fetch_fsmap learned FSMap version 46 2023-07-21T22:29:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.769+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2408740830 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x5625e862ac00 con 0x5625e871e6b0 2023-07-21T22:29:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.769+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2408740830 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5625e876d490 con 0x5625e871e6b0 2023-07-21T22:29:22.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.770+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2408740830 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 46) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3fe0094cf0 con 0x5625e871e6b0 2023-07-21T22:29:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.770+0000 7f3fff44fb80 10 client.17121 fetch_fsmap finished waiting for FSMap version 46 2023-07-21T22:29:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.770+0000 7f3fff44fb80 10 client.17121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:29:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.770+0000 7f3fff44fb80 20 client.17121 populate_metadata read hostname 'smithi151' 2023-07-21T22:29:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.770+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5625e88db680 0x5625e88dda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.770+0000 7f3fff44fb80 4 client.17121 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:29:22.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.770+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2408740830 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5625e880ce50 con 0x5625e88db680 2023-07-21T22:29:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.770+0000 7f3fe919a700 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5625e88db680 0x5625e88dda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.771+0000 7f3fe919a700 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5625e88db680 0x5625e88dda90 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd27241634cbc7d0 server_cookie=22700e084b92ccef in_seq=0 out_seq=0 2023-07-21T22:29:22.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.771+0000 7f3fcd7fa700 10 client.17121 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2408740830 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5625e880ce50 con 0x5625e88db680 2023-07-21T22:29:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fcd7fa700 10 client.17121 handle_command_reply: tid=0 2023-07-21T22:29:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 client.17121 shutdown 2023-07-21T22:29:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2408740830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 msgr2=0x5625e88d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:22.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0010b20 tx=0x7f3fe0099680 comp rx=0 tx=0).stop 2023-07-21T22:29:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2408740830 shutdown_connections 2023-07-21T22:29:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5625e88db680 0x5625e88dda90 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8660 0x5625e88cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fcd7fa700 0 client.17121 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2408740830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2408740830 >> 172.21.15.151:0/2408740830 conn(0x5625e88b7ae0 msgr2=0x5625e88bc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2408740830 shutdown_connections 2023-07-21T22:29:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.772+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2408740830 wait complete. 2023-07-21T22:29:22.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.773+0000 7f3fff44fb80 20 client.17121 trim_cache size 0 max 16384 2023-07-21T22:29:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.795+0000 7f3fff44fb80 1 Processor -- start 2023-07-21T22:29:22.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.795+0000 7f3fff44fb80 1 -- start start 2023-07-21T22:29:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.795+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.795+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 0x5625e88cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.795+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.795+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e880ce50 con 0x5625e871e6b0 2023-07-21T22:29:22.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.795+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e876d490 con 0x5625e88c8210 2023-07-21T22:29:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.795+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e88bdcb0 con 0x5625e88c8660 2023-07-21T22:29:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fea19c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fe999b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fea19c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43738/0 (socket says 172.21.15.151:43738) 2023-07-21T22:29:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fe919a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 0x5625e88cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fea19c700 1 -- 172.21.15.151:0/1341797648 learned_addr learned my addr 172.21.15.151:0/1341797648 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fea19c700 1 -- 172.21.15.151:0/1341797648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 msgr2=0x5625e88cb7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:22.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fea19c700 1 --2- 172.21.15.151:0/1341797648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 0x5625e88cb7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fea19c700 1 -- 172.21.15.151:0/1341797648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 msgr2=0x5625e88c7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fea19c700 1 --2- 172.21.15.151:0/1341797648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fea19c700 1 -- 172.21.15.151:0/1341797648 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5625e86681f0 con 0x5625e88c8660 2023-07-21T22:29:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.796+0000 7f3fea19c700 1 --2- 172.21.15.151:0/1341797648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c91b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009910 tx=0x7f3fdc003f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f25f4d85d43bc57c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.797+0000 7f3fd8bff700 1 -- 172.21.15.151:0/1341797648 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc003c10 con 0x5625e88c8660 2023-07-21T22:29:22.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.797+0000 7f3fd8bff700 1 -- 172.21.15.151:0/1341797648 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fdc00f040 con 0x5625e88c8660 2023-07-21T22:29:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.797+0000 7f3fd8bff700 1 -- 172.21.15.151:0/1341797648 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fdc007a70 con 0x5625e88c8660 2023-07-21T22:29:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.797+0000 7f3fff44fb80 1 -- 172.21.15.151:0/1341797648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 msgr2=0x5625e88c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.797+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/1341797648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c91b0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f3fdc009910 tx=0x7f3fdc003f90 comp rx=0 tx=0).stop 2023-07-21T22:29:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.798+0000 7f3fff44fb80 1 -- 172.21.15.151:0/1341797648 shutdown_connections 2023-07-21T22:29:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.798+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/1341797648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8660 0x5625e88c91b0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.798+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/1341797648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e871e6b0 0x5625e88c7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.798+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/1341797648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e88c8210 0x5625e88cb7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.798+0000 7f3fff44fb80 1 -- 172.21.15.151:0/1341797648 >> 172.21.15.151:0/1341797648 conn(0x5625e88b7ae0 msgr2=0x5625e88c8aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.798+0000 7f3fff44fb80 1 -- 172.21.15.151:0/1341797648 shutdown_connections 2023-07-21T22:29:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.798+0000 7f3fff44fb80 1 -- 172.21.15.151:0/1341797648 wait complete. 2023-07-21T22:29:22.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.798+0000 7f3fff44fb80 1 -- start start 2023-07-21T22:29:22.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.799+0000 7f3fff44fb80 1 Processor -- start 2023-07-21T22:29:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.799+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.799+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.799+0000 7f3fff44fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e88c8660 0x5625e88cfa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.799+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e88d01a0 con 0x5625e88c8660 2023-07-21T22:29:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.799+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e88d0310 con 0x5625e871e6b0 2023-07-21T22:29:22.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.799+0000 7f3fff44fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5625e88d04d0 con 0x5625e88c8210 2023-07-21T22:29:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.799+0000 7f3fff44fb80 10 client.0 _ll_register_callbacks cb 0x7f3fd4005670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:29:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fea19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e88c8660 0x5625e88cfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe919a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fea19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e88c8660 0x5625e88cfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50562/0 (socket says 172.21.15.151:50562) 2023-07-21T22:29:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fea19c700 1 -- 172.21.15.151:0/2361368107 learned_addr learned my addr 172.21.15.151:0/2361368107 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe919a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43752/0 (socket says 172.21.15.151:43752) 2023-07-21T22:29:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe999b700 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe999b700 1 -- 172.21.15.151:0/2361368107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 msgr2=0x5625e88d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe999b700 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe999b700 1 -- 172.21.15.151:0/2361368107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e88c8660 msgr2=0x5625e88cfa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe999b700 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e88c8660 0x5625e88cfa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe999b700 1 -- 172.21.15.151:0/2361368107 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fdc003d70 con 0x5625e871e6b0 2023-07-21T22:29:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe919a700 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:29:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fe999b700 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c2d0 tx=0x7f3fe0010b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be8b12023e6d4cdd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.800+0000 7f3fcd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:29:22.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.801+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2361368107 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0095ec0 con 0x5625e871e6b0 2023-07-21T22:29:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.801+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2361368107 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3fe009df10 con 0x5625e871e6b0 2023-07-21T22:29:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.801+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2361368107 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3fe00a2330 con 0x5625e871e6b0 2023-07-21T22:29:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.801+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2361368107 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fe00ca1a0 con 0x5625e871e6b0 2023-07-21T22:29:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.801+0000 7f3fff44fb80 10 client.26822 fetch_fsmap learned FSMap version 46 2023-07-21T22:29:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.801+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2361368107 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x5625e8640250 con 0x5625e871e6b0 2023-07-21T22:29:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.801+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2361368107 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3fe00a2330 con 0x5625e871e6b0 2023-07-21T22:29:22.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.802+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2361368107 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 46) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3fe000cba0 con 0x5625e871e6b0 2023-07-21T22:29:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.802+0000 7f3fff44fb80 10 client.26822 fetch_fsmap finished waiting for FSMap version 46 2023-07-21T22:29:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.802+0000 7f3fff44fb80 10 client.26822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:29:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.802+0000 7f3fff44fb80 20 client.26822 populate_metadata read hostname 'smithi151' 2023-07-21T22:29:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.802+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5625e89303b0 0x5625e8932790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.802+0000 7f3fff44fb80 4 client.26822 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:29:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.802+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2361368107 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5625e87ceff0 con 0x5625e89303b0 2023-07-21T22:29:22.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.802+0000 7f3fe919a700 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5625e89303b0 0x5625e8932790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.803+0000 7f3fe919a700 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5625e89303b0 0x5625e8932790 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb6ad958fa1ebfdf server_cookie=bcde66d766eccfb7 in_seq=0 out_seq=0 2023-07-21T22:29:22.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.803+0000 7f3fcd7fa700 10 client.26822 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.818+0000 7f3fcd7fa700 1 -- 172.21.15.151:0/2361368107 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5625e87ceff0 con 0x5625e89303b0 2023-07-21T22:29:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.818+0000 7f3fcd7fa700 10 client.26822 handle_command_reply: tid=0 2023-07-21T22:29:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.818+0000 7f3fff44fb80 1 client.26822 shutdown 2023-07-21T22:29:22.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2361368107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e871e6b0 msgr2=0x5625e88d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000c2d0 tx=0x7f3fe0010b80 comp rx=0 tx=0).stop 2023-07-21T22:29:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2361368107 shutdown_connections 2023-07-21T22:29:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5625e89303b0 0x5625e8932790 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5625e871e6b0 0x5625e88d15d0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fcd7fa700 0 client.26822 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:22.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5625e88c8660 0x5625e88cfa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 --2- 172.21.15.151:0/2361368107 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5625e88c8210 0x5625e88d1b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2361368107 >> 172.21.15.151:0/2361368107 conn(0x5625e88b7ae0 msgr2=0x5625e88c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2361368107 shutdown_connections 2023-07-21T22:29:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 1 -- 172.21.15.151:0/2361368107 wait complete. 2023-07-21T22:29:22.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.819+0000 7f3fff44fb80 20 client.26822 trim_cache size 0 max 16384 2023-07-21T22:29:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:29:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:29:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:29:22.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:29:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 -- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3fd00a1340 msgr2=0x7f3fd00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3fd00a1340 0x7f3fd00a37f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f3fe4074210 tx=0x7f3fd400b260 comp rx=0 tx=0).stop 2023-07-21T22:29:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 -- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 msgr2=0x7f3fe40729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 0x7f3fe40729f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f3fe000e9a0 tx=0x7f3fe000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 -- 172.21.15.151:0/3612874395 shutdown_connections 2023-07-21T22:29:22.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3fd00a1340 0x7f3fd00a37f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3fe4105b10 0x7f3fe41a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe40ffb00 0x7f3fe40729f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 --2- 172.21.15.151:0/3612874395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3fe41004b0 0x7f3fe4072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 -- 172.21.15.151:0/3612874395 >> 172.21.15.151:0/3612874395 conn(0x7f3fe40fb600 msgr2=0x7f3fe40fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 -- 172.21.15.151:0/3612874395 shutdown_connections 2023-07-21T22:29:22.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:22.820+0000 7f3febbff700 1 -- 172.21.15.151:0/3612874395 wait complete. 2023-07-21T22:29:22.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:22 smithi187 ceph-mon[96918]: pgmap v316: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 19 MiB/s wr, 77 op/s 2023-07-21T22:29:22.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:22 smithi195 ceph-mon[97365]: pgmap v316: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 19 MiB/s wr, 77 op/s 2023-07-21T22:29:22.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:22 smithi151 ceph-mon[95510]: pgmap v316: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 19 MiB/s wr, 77 op/s 2023-07-21T22:29:23.573 INFO:teuthology.orchestra.run.smithi151.stderr:42800000 of 50000000 tuples (85%) done (elapsed 587.06 s, remaining 98.76 s) 2023-07-21T22:29:24.777 INFO:teuthology.orchestra.run.smithi151.stderr:42900000 of 50000000 tuples (85%) done (elapsed 588.27 s, remaining 97.36 s) 2023-07-21T22:29:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:24 smithi187 ceph-mon[96918]: pgmap v317: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 77 op/s 2023-07-21T22:29:24.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:24 smithi195 ceph-mon[97365]: pgmap v317: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 77 op/s 2023-07-21T22:29:24.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:24 smithi151 ceph-mon[95510]: pgmap v317: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 77 op/s 2023-07-21T22:29:26.219 INFO:teuthology.orchestra.run.smithi151.stderr:43000000 of 50000000 tuples (86%) done (elapsed 589.71 s, remaining 96.00 s) 2023-07-21T22:29:26.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:26 smithi187 ceph-mon[96918]: pgmap v318: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 77 op/s 2023-07-21T22:29:26.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:26 smithi195 ceph-mon[97365]: pgmap v318: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 77 op/s 2023-07-21T22:29:26.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:26 smithi151 ceph-mon[95510]: pgmap v318: 97 pgs: 97 active+clean; 8.8 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 23 MiB/s wr, 77 op/s 2023-07-21T22:29:27.462 INFO:teuthology.orchestra.run.smithi151.stderr:43100000 of 50000000 tuples (86%) done (elapsed 590.95 s, remaining 94.61 s) 2023-07-21T22:29:28.743 INFO:teuthology.orchestra.run.smithi151.stderr:43200000 of 50000000 tuples (86%) done (elapsed 592.23 s, remaining 93.22 s) 2023-07-21T22:29:28.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:28 smithi187 ceph-mon[96918]: pgmap v319: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 34 MiB/s wr, 115 op/s 2023-07-21T22:29:28.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:28 smithi195 ceph-mon[97365]: pgmap v319: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 34 MiB/s wr, 115 op/s 2023-07-21T22:29:28.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:28 smithi151 ceph-mon[95510]: pgmap v319: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 34 MiB/s wr, 115 op/s 2023-07-21T22:29:29.984 INFO:teuthology.orchestra.run.smithi151.stderr:43300000 of 50000000 tuples (86%) done (elapsed 593.48 s, remaining 91.83 s) 2023-07-21T22:29:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:30 smithi187 ceph-mon[96918]: pgmap v320: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:29:30.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:30 smithi195 ceph-mon[97365]: pgmap v320: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:29:30.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:30 smithi151 ceph-mon[95510]: pgmap v320: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:29:31.306 INFO:teuthology.orchestra.run.smithi151.stderr:43400000 of 50000000 tuples (86%) done (elapsed 594.80 s, remaining 90.45 s) 2023-07-21T22:29:32.585 INFO:teuthology.orchestra.run.smithi151.stderr:43500000 of 50000000 tuples (87%) done (elapsed 596.08 s, remaining 89.07 s) 2023-07-21T22:29:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:32 smithi187 ceph-mon[96918]: pgmap v321: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:29:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:32 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:29:32.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:32 smithi195 ceph-mon[97365]: pgmap v321: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:29:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:32 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:29:32.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:32 smithi151 ceph-mon[95510]: pgmap v321: 97 pgs: 97 active+clean; 8.9 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 21 MiB/s wr, 69 op/s 2023-07-21T22:29:32.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:32 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:29:33.905 INFO:teuthology.orchestra.run.smithi151.stderr:43600000 of 50000000 tuples (87%) done (elapsed 597.40 s, remaining 87.69 s) 2023-07-21T22:29:34.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:34 smithi187 ceph-mon[96918]: pgmap v322: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 32 MiB/s wr, 104 op/s 2023-07-21T22:29:34.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:34 smithi195 ceph-mon[97365]: pgmap v322: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 32 MiB/s wr, 104 op/s 2023-07-21T22:29:34.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:34 smithi151 ceph-mon[95510]: pgmap v322: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 32 MiB/s wr, 104 op/s 2023-07-21T22:29:35.217 INFO:teuthology.orchestra.run.smithi151.stderr:43700000 of 50000000 tuples (87%) done (elapsed 598.71 s, remaining 86.31 s) 2023-07-21T22:29:36.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:35.999+0000 7f26507ff700 1 -- 172.21.15.151:0/1862037674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26480685b0 msgr2=0x7f2648104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:35.999+0000 7f26507ff700 1 --2- 172.21.15.151:0/1862037674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26480685b0 0x7f2648104770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f26380099c0 tx=0x7f2638009cd0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:35.999+0000 7f26507ff700 1 -- 172.21.15.151:0/1862037674 shutdown_connections 2023-07-21T22:29:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:35.999+0000 7f26507ff700 1 --2- 172.21.15.151:0/1862037674 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2648104e50 0x7f264810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:35.999+0000 7f26507ff700 1 --2- 172.21.15.151:0/1862037674 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2648067c10 0x7f2648067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:35.999+0000 7f26507ff700 1 --2- 172.21.15.151:0/1862037674 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26480685b0 0x7f2648104770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:35.999+0000 7f26507ff700 1 -- 172.21.15.151:0/1862037674 >> 172.21.15.151:0/1862037674 conn(0x7f2648074760 msgr2=0x7f2648074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:36.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:35.999+0000 7f26507ff700 1 -- 172.21.15.151:0/1862037674 shutdown_connections 2023-07-21T22:29:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:35.999+0000 7f26507ff700 1 -- 172.21.15.151:0/1862037674 wait complete. 2023-07-21T22:29:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.001+0000 7f26507ff700 1 Processor -- start 2023-07-21T22:29:36.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.001+0000 7f26507ff700 1 -- start start 2023-07-21T22:29:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.001+0000 7f26507ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2648067c10 0x7f2648197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.001+0000 7f26507ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26480685b0 0x7f26481982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.001+0000 7f26507ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2648104e50 0x7f264819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.001+0000 7f26507ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264819cf60 con 0x7f2648104e50 2023-07-21T22:29:36.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.001+0000 7f26507ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264819d0d0 con 0x7f2648067c10 2023-07-21T22:29:36.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.001+0000 7f26507ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f264819d290 con 0x7f26480685b0 2023-07-21T22:29:36.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264e59b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2648067c10 0x7f2648197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264e59b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2648067c10 0x7f2648197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57886/0 (socket says 172.21.15.151:57886) 2023-07-21T22:29:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264e59b700 1 -- 172.21.15.151:0/146948689 learned_addr learned my addr 172.21.15.151:0/146948689 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264dd9a700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26480685b0 0x7f26481982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264ed9c700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2648104e50 0x7f264819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264e59b700 1 -- 172.21.15.151:0/146948689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26480685b0 msgr2=0x7f26481982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264e59b700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26480685b0 0x7f26481982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264e59b700 1 -- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2648104e50 msgr2=0x7f264819c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:36.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264e59b700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2648104e50 0x7f264819c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264e59b700 1 -- 172.21.15.151:0/146948689 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26380095f0 con 0x7f2648067c10 2023-07-21T22:29:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.002+0000 7f264ed9c700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2648104e50 0x7f264819c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:29:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.003+0000 7f264e59b700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2648067c10 0x7f2648197d70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f264400e9a0 tx=0x7f264400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.003+0000 7f263f7fe700 1 -- 172.21.15.151:0/146948689 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644009790 con 0x7f2648067c10 2023-07-21T22:29:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.003+0000 7f263f7fe700 1 -- 172.21.15.151:0/146948689 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f264400cbd0 con 0x7f2648067c10 2023-07-21T22:29:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.003+0000 7f263f7fe700 1 -- 172.21.15.151:0/146948689 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2644018680 con 0x7f2648067c10 2023-07-21T22:29:36.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.003+0000 7f26507ff700 1 -- 172.21.15.151:0/146948689 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264819d570 con 0x7f2648067c10 2023-07-21T22:29:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.003+0000 7f26507ff700 1 -- 172.21.15.151:0/146948689 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26481a4db0 con 0x7f2648067c10 2023-07-21T22:29:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.008+0000 7f263f7fe700 1 -- 172.21.15.151:0/146948689 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f264400cd40 con 0x7f2648067c10 2023-07-21T22:29:36.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.009+0000 7f266404eb80 1 Processor -- start 2023-07-21T22:29:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.009+0000 7f266404eb80 1 -- start start 2023-07-21T22:29:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f266404eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 0x5585443c54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f266404eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443bf750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f266404eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5e70 0x5585443bfcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f266404eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585442bcc50 con 0x5585442136b0 2023-07-21T22:29:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f266404eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854430f9e0 con 0x5585443c5a20 2023-07-21T22:29:36.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f266404eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558544308e70 con 0x5585443c5e70 2023-07-21T22:29:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f264ed9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 0x5585443c54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f264e59b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443bf750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f264ed9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 0x5585443c54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47838/0 (socket says 172.21.15.151:47838) 2023-07-21T22:29:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f264ed9c700 1 -- 172.21.15.151:0/2204355285 learned_addr learned my addr 172.21.15.151:0/2204355285 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.010+0000 7f264dd9a700 1 --2- 172.21.15.151:0/2204355285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5e70 0x5585443bfcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.011+0000 7f264e59b700 1 -- 172.21.15.151:0/2204355285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5e70 msgr2=0x5585443bfcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.011+0000 7f264e59b700 1 --2- 172.21.15.151:0/2204355285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5e70 0x5585443bfcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.011+0000 7f264e59b700 1 -- 172.21.15.151:0/2204355285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 msgr2=0x5585443c54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.011+0000 7f264e59b700 1 --2- 172.21.15.151:0/2204355285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 0x5585443c54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.011+0000 7f264e59b700 1 -- 172.21.15.151:0/2204355285 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558544136d80 con 0x5585443c5a20 2023-07-21T22:29:36.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.011+0000 7f264e59b700 1 --2- 172.21.15.151:0/2204355285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443bf750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26440ca710 tx=0x7f26440d3750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54ac0b5503892305 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.012+0000 7f263cff9700 1 -- 172.21.15.151:0/2204355285 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440d8070 con 0x5585443c5a20 2023-07-21T22:29:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.012+0000 7f263cff9700 1 -- 172.21.15.151:0/2204355285 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26440d0e80 con 0x5585443c5a20 2023-07-21T22:29:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.012+0000 7f263cff9700 1 -- 172.21.15.151:0/2204355285 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26440d1dc0 con 0x5585443c5a20 2023-07-21T22:29:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.012+0000 7f263f7fe700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26340a12c0 0x7f26340a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.012+0000 7f263f7fe700 1 -- 172.21.15.151:0/146948689 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2644014070 con 0x7f2648067c10 2023-07-21T22:29:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f266404eb80 1 -- 172.21.15.151:0/2204355285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 msgr2=0x5585443bf750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:36.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f266404eb80 1 --2- 172.21.15.151:0/2204355285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443bf750 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f26440ca710 tx=0x7f26440d3750 comp rx=0 tx=0).stop 2023-07-21T22:29:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f264ed9c700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26340a12c0 0x7f26340a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f266404eb80 1 -- 172.21.15.151:0/2204355285 shutdown_connections 2023-07-21T22:29:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f266404eb80 1 --2- 172.21.15.151:0/2204355285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5e70 0x5585443bfcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f266404eb80 1 --2- 172.21.15.151:0/2204355285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 0x5585443c54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f266404eb80 1 --2- 172.21.15.151:0/2204355285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443bf750 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f266404eb80 1 -- 172.21.15.151:0/2204355285 >> 172.21.15.151:0/2204355285 conn(0x5585443acae0 msgr2=0x5585443b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f266404eb80 1 -- 172.21.15.151:0/2204355285 shutdown_connections 2023-07-21T22:29:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.013+0000 7f266404eb80 1 -- 172.21.15.151:0/2204355285 wait complete. 2023-07-21T22:29:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.014+0000 7f264ed9c700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26340a12c0 0x7f26340a3770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2640009df0 tx=0x7f2640009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.014+0000 7f266404eb80 1 -- start start 2023-07-21T22:29:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.014+0000 7f266404eb80 1 Processor -- start 2023-07-21T22:29:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.015+0000 7f266404eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585442136b0 0x5585443cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.015+0000 7f266404eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.015+0000 7f266404eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 0x5585443c9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.015+0000 7f266404eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585442a8a60 con 0x5585443c5e70 2023-07-21T22:29:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.015+0000 7f266404eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585442a8760 con 0x5585443c5a20 2023-07-21T22:29:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.015+0000 7f266404eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55854418c8c0 con 0x5585442136b0 2023-07-21T22:29:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.015+0000 7f266404eb80 10 client.0 _ll_register_callbacks cb 0x5585442a6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:29:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264dd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264dd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443c9090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57904/0 (socket says 172.21.15.151:57904) 2023-07-21T22:29:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264dd9a700 1 -- 172.21.15.151:0/1811485468 learned_addr learned my addr 172.21.15.151:0/1811485468 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264ed9c700 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 0x5585443c9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264dd9a700 1 -- 172.21.15.151:0/1811485468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585442136b0 msgr2=0x5585443cbda0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:29:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264dd9a700 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585442136b0 0x5585443cbda0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264dd9a700 1 -- 172.21.15.151:0/1811485468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 msgr2=0x5585443c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264dd9a700 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 0x5585443c9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264dd9a700 1 -- 172.21.15.151:0/1811485468 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26481a4db0 con 0x5585443c5a20 2023-07-21T22:29:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.016+0000 7f264ed9c700 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 0x5585443c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:29:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.017+0000 7f264dd9a700 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443c9090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2638009990 tx=0x7f2638005320 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2284c54deb8f7a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.017+0000 7f2631ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:29:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.017+0000 7f2631ffb700 1 -- 172.21.15.151:0/1811485468 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638003960 con 0x5585443c5a20 2023-07-21T22:29:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.017+0000 7f2631ffb700 1 -- 172.21.15.151:0/1811485468 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2638003ac0 con 0x5585443c5a20 2023-07-21T22:29:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.017+0000 7f266404eb80 1 -- 172.21.15.151:0/1811485468 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558544301e50 con 0x5585443c5a20 2023-07-21T22:29:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.017+0000 7f2631ffb700 1 -- 172.21.15.151:0/1811485468 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26380056d0 con 0x5585443c5a20 2023-07-21T22:29:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.017+0000 7f266404eb80 10 client.26834 fetch_fsmap learned FSMap version 46 2023-07-21T22:29:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.018+0000 7f266404eb80 1 -- 172.21.15.151:0/1811485468 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55854411fc00 con 0x5585443c5a20 2023-07-21T22:29:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.018+0000 7f2631ffb700 1 -- 172.21.15.151:0/1811485468 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2638031020 con 0x5585443c5a20 2023-07-21T22:29:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.018+0000 7f2631ffb700 1 -- 172.21.15.151:0/1811485468 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 46) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f263800fc90 con 0x5585443c5a20 2023-07-21T22:29:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.018+0000 7f266404eb80 10 client.26834 fetch_fsmap finished waiting for FSMap version 46 2023-07-21T22:29:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.018+0000 7f266404eb80 10 client.26834 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:29:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.018+0000 7f266404eb80 20 client.26834 populate_metadata read hostname 'smithi151' 2023-07-21T22:29:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.018+0000 7f266404eb80 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585443d9320 0x5585443db730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.018+0000 7f266404eb80 4 client.26834 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:29:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.018+0000 7f266404eb80 1 -- 172.21.15.151:0/1811485468 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585442c3ff0 con 0x5585443d9320 2023-07-21T22:29:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.019+0000 7f264e59b700 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585443d9320 0x5585443db730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.019+0000 7f264e59b700 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585443d9320 0x5585443db730 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=989f998ac9b6eb47 server_cookie=28e0aa7ac82ea423 in_seq=0 out_seq=0 2023-07-21T22:29:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.019+0000 7f2631ffb700 10 client.26834 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.020+0000 7f2631ffb700 1 -- 172.21.15.151:0/1811485468 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5585442c3ff0 con 0x5585443d9320 2023-07-21T22:29:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.020+0000 7f2631ffb700 10 client.26834 handle_command_reply: tid=0 2023-07-21T22:29:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.020+0000 7f266404eb80 1 client.26834 shutdown 2023-07-21T22:29:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 -- 172.21.15.151:0/1811485468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 msgr2=0x5585443c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443c9090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2638009990 tx=0x7f2638005320 comp rx=0 tx=0).stop 2023-07-21T22:29:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 -- 172.21.15.151:0/1811485468 shutdown_connections 2023-07-21T22:29:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585443d9320 0x5585443db730 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 0x5585443c9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f2631ffb700 0 client.26834 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585442136b0 0x5585443cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 --2- 172.21.15.151:0/1811485468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443c9090 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 -- 172.21.15.151:0/1811485468 >> 172.21.15.151:0/1811485468 conn(0x5585443acae0 msgr2=0x5585443b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 -- 172.21.15.151:0/1811485468 shutdown_connections 2023-07-21T22:29:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.021+0000 7f266404eb80 1 -- 172.21.15.151:0/1811485468 wait complete. 2023-07-21T22:29:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.022+0000 7f266404eb80 20 client.26834 trim_cache size 0 max 16384 2023-07-21T22:29:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.042+0000 7f266404eb80 1 Processor -- start 2023-07-21T22:29:36.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.042+0000 7f266404eb80 1 -- start start 2023-07-21T22:29:36.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.042+0000 7f266404eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585442136b0 0x5585443c49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.042+0000 7f266404eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443cb940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.042+0000 7f266404eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 0x5585443c6970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.042+0000 7f266404eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585443d5d10 con 0x5585443c5e70 2023-07-21T22:29:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.042+0000 7f266404eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585443aec00 con 0x5585443c5a20 2023-07-21T22:29:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.042+0000 7f266404eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585443ca600 con 0x5585442136b0 2023-07-21T22:29:36.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264dd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443cb940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264dd9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443cb940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57920/0 (socket says 172.21.15.151:57920) 2023-07-21T22:29:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264e59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585442136b0 0x5585443c49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264dd9a700 1 -- 172.21.15.151:0/308609149 learned_addr learned my addr 172.21.15.151:0/308609149 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264ed9c700 1 --2- 172.21.15.151:0/308609149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 0x5585443c6970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264dd9a700 1 -- 172.21.15.151:0/308609149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585442136b0 msgr2=0x5585443c49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264dd9a700 1 --2- 172.21.15.151:0/308609149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585442136b0 0x5585443c49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264dd9a700 1 -- 172.21.15.151:0/308609149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 msgr2=0x5585443c6970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264dd9a700 1 --2- 172.21.15.151:0/308609149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 0x5585443c6970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264dd9a700 1 -- 172.21.15.151:0/308609149 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585443e0360 con 0x5585443c5a20 2023-07-21T22:29:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.043+0000 7f264dd9a700 1 --2- 172.21.15.151:0/308609149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443cb940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f26380098e0 tx=0x7f2638017560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45d80b17be218988 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.044+0000 7f263d7fa700 1 -- 172.21.15.151:0/308609149 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638005bc0 con 0x5585443c5a20 2023-07-21T22:29:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.044+0000 7f263d7fa700 1 -- 172.21.15.151:0/308609149 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2638031030 con 0x5585443c5a20 2023-07-21T22:29:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.044+0000 7f263d7fa700 1 -- 172.21.15.151:0/308609149 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638017e40 con 0x5585443c5a20 2023-07-21T22:29:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 -- 172.21.15.151:0/308609149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 msgr2=0x5585443cb940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 --2- 172.21.15.151:0/308609149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443cb940 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f26380098e0 tx=0x7f2638017560 comp rx=0 tx=0).stop 2023-07-21T22:29:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 -- 172.21.15.151:0/308609149 shutdown_connections 2023-07-21T22:29:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 --2- 172.21.15.151:0/308609149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585443c5e70 0x5585443c6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 --2- 172.21.15.151:0/308609149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585442136b0 0x5585443c49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 --2- 172.21.15.151:0/308609149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5a20 0x5585443cb940 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 -- 172.21.15.151:0/308609149 >> 172.21.15.151:0/308609149 conn(0x5585443acae0 msgr2=0x5585443c6260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 -- 172.21.15.151:0/308609149 shutdown_connections 2023-07-21T22:29:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 -- 172.21.15.151:0/308609149 wait complete. 2023-07-21T22:29:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.045+0000 7f266404eb80 1 -- start start 2023-07-21T22:29:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.046+0000 7f266404eb80 1 Processor -- start 2023-07-21T22:29:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.046+0000 7f266404eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 0x5585443c2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.046+0000 7f266404eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5a20 0x5585443c2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.046+0000 7f266404eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5e70 0x5585443c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.046+0000 7f266404eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585443c2b70 con 0x5585442136b0 2023-07-21T22:29:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.046+0000 7f266404eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585443c2ce0 con 0x5585443c5e70 2023-07-21T22:29:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.046+0000 7f266404eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585443c1480 con 0x5585443c5a20 2023-07-21T22:29:36.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.046+0000 7f266404eb80 10 client.0 _ll_register_callbacks cb 0x7f263800bb50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:29:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264e59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 0x5585443c2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264dd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5a20 0x5585443c2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264dd9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5a20 0x5585443c2570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:32818/0 (socket says 172.21.15.151:32818) 2023-07-21T22:29:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264dd9a700 1 -- 172.21.15.151:0/1994686076 learned_addr learned my addr 172.21.15.151:0/1994686076 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264ed9c700 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5e70 0x5585443c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264dd9a700 1 -- 172.21.15.151:0/1994686076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5e70 msgr2=0x5585443c0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264dd9a700 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5e70 0x5585443c0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264dd9a700 1 -- 172.21.15.151:0/1994686076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 msgr2=0x5585443c2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264dd9a700 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 0x5585443c2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264dd9a700 1 -- 172.21.15.151:0/1994686076 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55854411fc00 con 0x5585443c5a20 2023-07-21T22:29:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f264dd9a700 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5a20 0x5585443c2570 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2638016e20 tx=0x7f2638016e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e62062d417f2cb78 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.047+0000 7f2631ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:29:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.048+0000 7f2631ffb700 1 -- 172.21.15.151:0/1994686076 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2638005bc0 con 0x5585443c5a20 2023-07-21T22:29:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.048+0000 7f266404eb80 1 -- 172.21.15.151:0/1994686076 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558544262490 con 0x5585443c5a20 2023-07-21T22:29:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.048+0000 7f2631ffb700 1 -- 172.21.15.151:0/1994686076 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2638000e40 con 0x5585443c5a20 2023-07-21T22:29:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.048+0000 7f2631ffb700 1 -- 172.21.15.151:0/1994686076 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26380163a0 con 0x5585443c5a20 2023-07-21T22:29:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.048+0000 7f266404eb80 10 client.26872 fetch_fsmap learned FSMap version 46 2023-07-21T22:29:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.048+0000 7f266404eb80 1 -- 172.21.15.151:0/1994686076 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x55854415d1f0 con 0x5585443c5a20 2023-07-21T22:29:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.048+0000 7f2631ffb700 1 -- 172.21.15.151:0/1994686076 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f263804c020 con 0x5585443c5a20 2023-07-21T22:29:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.048+0000 7f2631ffb700 1 -- 172.21.15.151:0/1994686076 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 46) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2638034070 con 0x5585443c5a20 2023-07-21T22:29:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.049+0000 7f266404eb80 10 client.26872 fetch_fsmap finished waiting for FSMap version 46 2023-07-21T22:29:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.049+0000 7f266404eb80 10 client.26872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:29:36.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.049+0000 7f266404eb80 20 client.26872 populate_metadata read hostname 'smithi151' 2023-07-21T22:29:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.049+0000 7f266404eb80 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55854442d9c0 0x55854442fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.049+0000 7f266404eb80 4 client.26872 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:29:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.049+0000 7f266404eb80 1 -- 172.21.15.151:0/1994686076 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558544157f10 con 0x55854442d9c0 2023-07-21T22:29:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.049+0000 7f264e59b700 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55854442d9c0 0x55854442fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:36.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.050+0000 7f2631ffb700 10 client.26872 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:36.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.050+0000 7f264e59b700 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55854442d9c0 0x55854442fdd0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7e70c4984168749 server_cookie=a62724ee0f392e6b in_seq=0 out_seq=0 2023-07-21T22:29:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.064+0000 7f2631ffb700 1 -- 172.21.15.151:0/1994686076 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558544157f10 con 0x55854442d9c0 2023-07-21T22:29:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.064+0000 7f2631ffb700 10 client.26872 handle_command_reply: tid=0 2023-07-21T22:29:36.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.064+0000 7f266404eb80 1 client.26872 shutdown 2023-07-21T22:29:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 -- 172.21.15.151:0/1994686076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5a20 msgr2=0x5585443c2570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5a20 0x5585443c2570 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2638016e20 tx=0x7f2638016e50 comp rx=0 tx=0).stop 2023-07-21T22:29:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 -- 172.21.15.151:0/1994686076 shutdown_connections 2023-07-21T22:29:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55854442d9c0 0x55854442fdd0 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585443c5e70 0x5585443c0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585442136b0 0x5585443c2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f2631ffb700 0 client.26872 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 --2- 172.21.15.151:0/1994686076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585443c5a20 0x5585443c2570 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 -- 172.21.15.151:0/1994686076 >> 172.21.15.151:0/1994686076 conn(0x5585443acae0 msgr2=0x5585443c4830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 -- 172.21.15.151:0/1994686076 shutdown_connections 2023-07-21T22:29:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 1 -- 172.21.15.151:0/1994686076 wait complete. 2023-07-21T22:29:36.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.065+0000 7f266404eb80 20 client.26872 trim_cache size 0 max 16384 2023-07-21T22:29:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:29:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:29:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:29:36.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:29:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 -- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26340a12c0 msgr2=0x7f26340a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26340a12c0 0x7f26340a3770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2640009df0 tx=0x7f2640009040 comp rx=0 tx=0).stop 2023-07-21T22:29:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 -- 172.21.15.151:0/146948689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2648067c10 msgr2=0x7f2648197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2648067c10 0x7f2648197d70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f264400e9a0 tx=0x7f264400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 -- 172.21.15.151:0/146948689 shutdown_connections 2023-07-21T22:29:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26340a12c0 0x7f26340a3770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2648067c10 0x7f2648197d70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2648104e50 0x7f264819c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 --2- 172.21.15.151:0/146948689 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26480685b0 0x7f26481982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 -- 172.21.15.151:0/146948689 >> 172.21.15.151:0/146948689 conn(0x7f2648074760 msgr2=0x7f264810bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 -- 172.21.15.151:0/146948689 shutdown_connections 2023-07-21T22:29:36.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:36.066+0000 7f26507ff700 1 -- 172.21.15.151:0/146948689 wait complete. 2023-07-21T22:29:36.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: pgmap v323: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 73 op/s 2023-07-21T22:29:36.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.703 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.703 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.703 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.704 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.704 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.704 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.704 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.705 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.705 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.705 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:36 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.715 INFO:teuthology.orchestra.run.smithi151.stderr:43800000 of 50000000 tuples (87%) done (elapsed 600.21 s, remaining 84.96 s) 2023-07-21T22:29:36.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: pgmap v323: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 73 op/s 2023-07-21T22:29:36.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.883 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.883 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.883 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.883 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.884 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.884 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.884 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.884 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:36 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: pgmap v323: 97 pgs: 97 active+clean; 9.0 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 23 MiB/s wr, 73 op/s 2023-07-21T22:29:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:36.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.911 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.911 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.911 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:36.911 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:36 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:29:37.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:29:37.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:29:37.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:29:37.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:29:37.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:29:37.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:37.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:29:37.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:29:37.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:29:37.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:29:37.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:29:37.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:29:37.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:37.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:29:37.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:29:37.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:29:37.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:29:37.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:29:37.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:29:37.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:29:37.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:29:37.963 INFO:teuthology.orchestra.run.smithi151.stderr:43900000 of 50000000 tuples (87%) done (elapsed 601.45 s, remaining 83.57 s) 2023-07-21T22:29:38.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:38 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:29:38.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:38 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:29:38.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:38 smithi151 ceph-mon[95510]: pgmap v324: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 109 op/s 2023-07-21T22:29:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:38 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:29:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:38 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:29:38.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:38 smithi187 ceph-mon[96918]: pgmap v324: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 109 op/s 2023-07-21T22:29:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:38 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:29:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:38 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:29:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:38 smithi195 ceph-mon[97365]: pgmap v324: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 34 MiB/s wr, 109 op/s 2023-07-21T22:29:39.216 INFO:teuthology.orchestra.run.smithi151.stderr:44000000 of 50000000 tuples (88%) done (elapsed 602.71 s, remaining 82.19 s) 2023-07-21T22:29:40.546 INFO:teuthology.orchestra.run.smithi151.stderr:44100000 of 50000000 tuples (88%) done (elapsed 604.04 s, remaining 80.81 s) 2023-07-21T22:29:40.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:40 smithi151 ceph-mon[95510]: pgmap v325: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-07-21T22:29:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:40 smithi187 ceph-mon[96918]: pgmap v325: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-07-21T22:29:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:40 smithi195 ceph-mon[97365]: pgmap v325: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-07-21T22:29:41.804 INFO:teuthology.orchestra.run.smithi151.stderr:44200000 of 50000000 tuples (88%) done (elapsed 605.29 s, remaining 79.43 s) 2023-07-21T22:29:42.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:42 smithi151 ceph-mon[95510]: pgmap v326: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-07-21T22:29:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:42 smithi187 ceph-mon[96918]: pgmap v326: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-07-21T22:29:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:42 smithi195 ceph-mon[97365]: pgmap v326: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-07-21T22:29:43.029 INFO:teuthology.orchestra.run.smithi151.stderr:44300000 of 50000000 tuples (88%) done (elapsed 606.52 s, remaining 78.04 s) 2023-07-21T22:29:44.368 INFO:teuthology.orchestra.run.smithi151.stderr:44400000 of 50000000 tuples (88%) done (elapsed 607.86 s, remaining 76.67 s) 2023-07-21T22:29:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:44 smithi151 ceph-mon[95510]: pgmap v327: 97 pgs: 97 active+clean; 9.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 34 MiB/s wr, 106 op/s 2023-07-21T22:29:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:44 smithi187 ceph-mon[96918]: pgmap v327: 97 pgs: 97 active+clean; 9.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 34 MiB/s wr, 106 op/s 2023-07-21T22:29:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:44 smithi195 ceph-mon[97365]: pgmap v327: 97 pgs: 97 active+clean; 9.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 34 MiB/s wr, 106 op/s 2023-07-21T22:29:45.591 INFO:teuthology.orchestra.run.smithi151.stderr:44500000 of 50000000 tuples (89%) done (elapsed 609.08 s, remaining 75.28 s) 2023-07-21T22:29:46.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:46 smithi151 ceph-mon[95510]: pgmap v328: 97 pgs: 97 active+clean; 9.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-07-21T22:29:46.798 INFO:teuthology.orchestra.run.smithi151.stderr:44600000 of 50000000 tuples (89%) done (elapsed 610.29 s, remaining 73.89 s) 2023-07-21T22:29:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:46 smithi187 ceph-mon[96918]: pgmap v328: 97 pgs: 97 active+clean; 9.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-07-21T22:29:46.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:46 smithi195 ceph-mon[97365]: pgmap v328: 97 pgs: 97 active+clean; 9.2 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 22 MiB/s wr, 71 op/s 2023-07-21T22:29:48.007 INFO:teuthology.orchestra.run.smithi151.stderr:44700000 of 50000000 tuples (89%) done (elapsed 611.50 s, remaining 72.50 s) 2023-07-21T22:29:48.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:48 smithi151 ceph-mon[95510]: pgmap v329: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-07-21T22:29:48.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:48 smithi187 ceph-mon[96918]: pgmap v329: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-07-21T22:29:48.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:48 smithi195 ceph-mon[97365]: pgmap v329: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-07-21T22:29:49.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.237+0000 7f7516bff700 1 -- 172.21.15.151:0/2012026794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 msgr2=0x7f751010ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.237+0000 7f7516bff700 1 --2- 172.21.15.151:0/2012026794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 0x7f751010ebe0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f750800b0d0 tx=0x7f750800b3e0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.237+0000 7f7516bff700 1 -- 172.21.15.151:0/2012026794 shutdown_connections 2023-07-21T22:29:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.237+0000 7f7516bff700 1 --2- 172.21.15.151:0/2012026794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7510101fd0 0x7f75101023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.237+0000 7f7516bff700 1 --2- 172.21.15.151:0/2012026794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 0x7f751010ebe0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.237+0000 7f7516bff700 1 --2- 172.21.15.151:0/2012026794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7510102970 0x7f7510106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.237+0000 7f7516bff700 1 -- 172.21.15.151:0/2012026794 >> 172.21.15.151:0/2012026794 conn(0x7f75100fd840 msgr2=0x7f75100ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.237+0000 7f7516bff700 1 -- 172.21.15.151:0/2012026794 shutdown_connections 2023-07-21T22:29:49.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.237+0000 7f7516bff700 1 -- 172.21.15.151:0/2012026794 wait complete. 2023-07-21T22:29:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.238+0000 7f7516bff700 1 Processor -- start 2023-07-21T22:29:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f7516bff700 1 -- start start 2023-07-21T22:29:49.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f7516bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7510101fd0 0x7f7510197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f7516bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7510102970 0x7f75101983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f7516bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 0x7f751019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f7516bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751019d090 con 0x7f7510107010 2023-07-21T22:29:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f7516bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751019d200 con 0x7f7510101fd0 2023-07-21T22:29:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f7516bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f751019d3c0 con 0x7f7510102970 2023-07-21T22:29:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f751519c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 0x7f751019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f751519c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 0x7f751019ca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47006/0 (socket says 172.21.15.151:47006) 2023-07-21T22:29:49.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.239+0000 7f751519c700 1 -- 172.21.15.151:0/1312821000 learned_addr learned my addr 172.21.15.151:0/1312821000 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f751499b700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7510101fd0 0x7f7510197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f750ffff700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7510102970 0x7f75101983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f751519c700 1 -- 172.21.15.151:0/1312821000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7510102970 msgr2=0x7f75101983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f751519c700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7510102970 0x7f75101983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f751519c700 1 -- 172.21.15.151:0/1312821000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7510101fd0 msgr2=0x7f7510197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f751519c700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7510101fd0 0x7f7510197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f751519c700 1 -- 172.21.15.151:0/1312821000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508009d00 con 0x7f7510107010 2023-07-21T22:29:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f751519c700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 0x7f751019ca50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7508009380 tx=0x7f75080093b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f750dffb700 1 -- 172.21.15.151:0/1312821000 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750800e040 con 0x7f7510107010 2023-07-21T22:29:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.240+0000 7f7516bff700 1 -- 172.21.15.151:0/1312821000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f751019d640 con 0x7f7510107010 2023-07-21T22:29:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.241+0000 7f750dffb700 1 -- 172.21.15.151:0/1312821000 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7508003e10 con 0x7f7510107010 2023-07-21T22:29:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.241+0000 7f750dffb700 1 -- 172.21.15.151:0/1312821000 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f750801b940 con 0x7f7510107010 2023-07-21T22:29:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.241+0000 7f7516bff700 1 -- 172.21.15.151:0/1312821000 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75101a4ee0 con 0x7f7510107010 2023-07-21T22:29:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.245+0000 7f750dffb700 1 -- 172.21.15.151:0/1312821000 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f7508005690 con 0x7f7510107010 2023-07-21T22:29:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.245+0000 7f752a572b80 1 Processor -- start 2023-07-21T22:29:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f752a572b80 1 -- start start 2023-07-21T22:29:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f752a572b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 0x555dbe934cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f752a572b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe92ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f752a572b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe92f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f752a572b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe834c50 con 0x555dbe935660 2023-07-21T22:29:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f752a572b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe8879e0 con 0x555dbe78b6b0 2023-07-21T22:29:49.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f752a572b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe880e70 con 0x555dbe935210 2023-07-21T22:29:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f750ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe92f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f750ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe92f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47022/0 (socket says 172.21.15.151:47022) 2023-07-21T22:29:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.246+0000 7f750ffff700 1 -- 172.21.15.151:0/1131752711 learned_addr learned my addr 172.21.15.151:0/1131752711 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f750dffb700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f75000a12c0 0x7f75000a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f750ffff700 1 --2- 172.21.15.151:0/1131752711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 0x555dbe934cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f751499b700 1 --2- 172.21.15.151:0/1131752711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe92ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f750dffb700 1 -- 172.21.15.151:0/1312821000 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f75080ce410 con 0x7f7510107010 2023-07-21T22:29:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f750ffff700 1 -- 172.21.15.151:0/1131752711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 msgr2=0x555dbe92ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f750ffff700 1 --2- 172.21.15.151:0/1131752711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe92ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f751519c700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f75000a12c0 0x7f75000a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f750ffff700 1 -- 172.21.15.151:0/1131752711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 msgr2=0x555dbe934cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f750ffff700 1 --2- 172.21.15.151:0/1131752711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 0x555dbe934cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f750ffff700 1 -- 172.21.15.151:0/1131752711 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dbe6aed80 con 0x555dbe935660 2023-07-21T22:29:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f750ffff700 1 --2- 172.21.15.151:0/1131752711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe92f4a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f74fc012560 tx=0x7f74fc0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3187ed98e016064 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.247+0000 7f74faffd700 1 -- 172.21.15.151:0/1131752711 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc017070 con 0x555dbe935660 2023-07-21T22:29:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.248+0000 7f751519c700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f75000a12c0 0x7f75000a3770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f75080cbb80 tx=0x7f7508005b60 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.248+0000 7f74faffd700 1 -- 172.21.15.151:0/1131752711 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74fc0044c0 con 0x555dbe935660 2023-07-21T22:29:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.248+0000 7f74faffd700 1 -- 172.21.15.151:0/1131752711 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc010450 con 0x555dbe935660 2023-07-21T22:29:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.248+0000 7f752a572b80 1 -- 172.21.15.151:0/1131752711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 msgr2=0x555dbe92f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.248+0000 7f752a572b80 1 --2- 172.21.15.151:0/1131752711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe92f4a0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f74fc012560 tx=0x7f74fc0047c0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.248+0000 7f752a572b80 1 -- 172.21.15.151:0/1131752711 shutdown_connections 2023-07-21T22:29:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.248+0000 7f752a572b80 1 --2- 172.21.15.151:0/1131752711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 0x555dbe934cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.248+0000 7f752a572b80 1 --2- 172.21.15.151:0/1131752711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe92f4a0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.249+0000 7f752a572b80 1 --2- 172.21.15.151:0/1131752711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe92ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.249+0000 7f752a572b80 1 -- 172.21.15.151:0/1131752711 >> 172.21.15.151:0/1131752711 conn(0x555dbe924ae0 msgr2=0x555dbe92a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.249+0000 7f752a572b80 1 -- 172.21.15.151:0/1131752711 shutdown_connections 2023-07-21T22:29:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.249+0000 7f752a572b80 1 -- 172.21.15.151:0/1131752711 wait complete. 2023-07-21T22:29:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.249+0000 7f752a572b80 1 -- start start 2023-07-21T22:29:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.249+0000 7f752a572b80 1 Processor -- start 2023-07-21T22:29:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f752a572b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f752a572b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe938880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f752a572b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935660 0x555dbe938f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f752a572b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe820a60 con 0x555dbe78b6b0 2023-07-21T22:29:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f752a572b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe820760 con 0x555dbe935660 2023-07-21T22:29:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f752a572b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe7048c0 con 0x555dbe935210 2023-07-21T22:29:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f752a572b80 10 client.0 _ll_register_callbacks cb 0x555dbe81e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:29:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f750ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f750ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47032/0 (socket says 172.21.15.151:47032) 2023-07-21T22:29:49.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f750ffff700 1 -- 172.21.15.151:0/3896527093 learned_addr learned my addr 172.21.15.151:0/3896527093 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.250+0000 7f751499b700 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe938880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.251+0000 7f750ffff700 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935660 0x555dbe938f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.251+0000 7f750ffff700 1 -- 172.21.15.151:0/3896527093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 msgr2=0x555dbe938880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.251+0000 7f750ffff700 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe938880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.251+0000 7f750ffff700 1 -- 172.21.15.151:0/3896527093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935660 msgr2=0x555dbe938f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.251+0000 7f750ffff700 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935660 0x555dbe938f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.251+0000 7f750ffff700 1 -- 172.21.15.151:0/3896527093 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc00bdd0 con 0x555dbe78b6b0 2023-07-21T22:29:49.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.251+0000 7f750ffff700 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93b590 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f74fc012530 tx=0x7f74fc004670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49c408a4a318c45 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.251+0000 7f74effff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:29:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.251+0000 7f74effff700 1 -- 172.21.15.151:0/3896527093 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc017050 con 0x555dbe78b6b0 2023-07-21T22:29:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f752a572b80 1 -- 172.21.15.151:0/3896527093 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555dbe7da490 con 0x555dbe78b6b0 2023-07-21T22:29:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f74effff700 1 -- 172.21.15.151:0/3896527093 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f74fc000e40 con 0x555dbe78b6b0 2023-07-21T22:29:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f74effff700 1 -- 172.21.15.151:0/3896527093 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f74fc0041a0 con 0x555dbe78b6b0 2023-07-21T22:29:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f752a572b80 10 client.17157 fetch_fsmap learned FSMap version 46 2023-07-21T22:29:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f752a572b80 1 -- 172.21.15.151:0/3896527093 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x555dbe697c00 con 0x555dbe78b6b0 2023-07-21T22:29:49.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f74effff700 1 -- 172.21.15.151:0/3896527093 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555dbe7da490 con 0x555dbe78b6b0 2023-07-21T22:29:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f74effff700 1 -- 172.21.15.151:0/3896527093 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 46) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f74fc010450 con 0x555dbe78b6b0 2023-07-21T22:29:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f752a572b80 10 client.17157 fetch_fsmap finished waiting for FSMap version 46 2023-07-21T22:29:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f752a572b80 10 client.17157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:29:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f752a572b80 20 client.17157 populate_metadata read hostname 'smithi151' 2023-07-21T22:29:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f752a572b80 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555dbe948a80 0x555dbe94ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f752a572b80 4 client.17157 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:29:49.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.252+0000 7f752a572b80 1 -- 172.21.15.151:0/3896527093 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555dbe879e50 con 0x555dbe948a80 2023-07-21T22:29:49.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.253+0000 7f751499b700 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555dbe948a80 0x555dbe94ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.253+0000 7f74effff700 10 client.17157 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.253+0000 7f751499b700 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555dbe948a80 0x555dbe94ae90 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ac691feaa1baf753 server_cookie=8a8ab12904c18a81 in_seq=0 out_seq=0 2023-07-21T22:29:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.254+0000 7f74effff700 1 -- 172.21.15.151:0/3896527093 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555dbe879e50 con 0x555dbe948a80 2023-07-21T22:29:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.254+0000 7f74effff700 10 client.17157 handle_command_reply: tid=0 2023-07-21T22:29:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.254+0000 7f752a572b80 1 client.17157 shutdown 2023-07-21T22:29:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.254+0000 7f752a572b80 1 -- 172.21.15.151:0/3896527093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 msgr2=0x555dbe93b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:49.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.254+0000 7f752a572b80 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93b590 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f74fc012530 tx=0x7f74fc004670 comp rx=0 tx=0).stop 2023-07-21T22:29:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f752a572b80 1 -- 172.21.15.151:0/3896527093 shutdown_connections 2023-07-21T22:29:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f752a572b80 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555dbe948a80 0x555dbe94ae90 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f752a572b80 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935660 0x555dbe938f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f752a572b80 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93b590 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f752a572b80 1 --2- 172.21.15.151:0/3896527093 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe938880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f752a572b80 1 -- 172.21.15.151:0/3896527093 >> 172.21.15.151:0/3896527093 conn(0x555dbe924ae0 msgr2=0x555dbe9293e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:49.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f74effff700 0 client.17157 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f752a572b80 1 -- 172.21.15.151:0/3896527093 shutdown_connections 2023-07-21T22:29:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f752a572b80 1 -- 172.21.15.151:0/3896527093 wait complete. 2023-07-21T22:29:49.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.255+0000 7f752a572b80 20 client.17157 trim_cache size 0 max 16384 2023-07-21T22:29:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.273+0000 7f752a572b80 1 Processor -- start 2023-07-21T22:29:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.273+0000 7f752a572b80 1 -- start start 2023-07-21T22:29:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.273+0000 7f752a572b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.273+0000 7f752a572b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935210 0x555dbe936140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.273+0000 7f752a572b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935660 0x555dbe93b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.273+0000 7f752a572b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe926c00 con 0x555dbe78b6b0 2023-07-21T22:29:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.273+0000 7f752a572b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe939df0 con 0x555dbe935210 2023-07-21T22:29:49.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.273+0000 7f752a572b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe92ff20 con 0x555dbe935660 2023-07-21T22:29:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.274+0000 7f750ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.274+0000 7f750ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47046/0 (socket says 172.21.15.151:47046) 2023-07-21T22:29:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.274+0000 7f750ffff700 1 -- 172.21.15.151:0/3968060193 learned_addr learned my addr 172.21.15.151:0/3968060193 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:49.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.274+0000 7f751499b700 1 --2- 172.21.15.151:0/3968060193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935210 0x555dbe936140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.274+0000 7f750ffff700 1 -- 172.21.15.151:0/3968060193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935660 msgr2=0x555dbe93b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.274+0000 7f750ffff700 1 --2- 172.21.15.151:0/3968060193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935660 0x555dbe93b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.274+0000 7f750ffff700 1 -- 172.21.15.151:0/3968060193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935210 msgr2=0x555dbe936140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.274+0000 7f750ffff700 1 --2- 172.21.15.151:0/3968060193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935210 0x555dbe936140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.274+0000 7f750ffff700 1 -- 172.21.15.151:0/3968060193 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555dbe6d51f0 con 0x555dbe78b6b0 2023-07-21T22:29:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.275+0000 7f750ffff700 1 --2- 172.21.15.151:0/3968060193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93fba0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f74fc001eb0 tx=0x7f74fc012b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d349ca7fd5f77238 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:49.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.275+0000 7f74fb7fe700 1 -- 172.21.15.151:0/3968060193 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc017070 con 0x555dbe78b6b0 2023-07-21T22:29:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.275+0000 7f74fb7fe700 1 -- 172.21.15.151:0/3968060193 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74fc010a80 con 0x555dbe78b6b0 2023-07-21T22:29:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.275+0000 7f74fb7fe700 1 -- 172.21.15.151:0/3968060193 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74fc02c380 con 0x555dbe78b6b0 2023-07-21T22:29:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.275+0000 7f752a572b80 1 -- 172.21.15.151:0/3968060193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 msgr2=0x555dbe93fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.275+0000 7f752a572b80 1 --2- 172.21.15.151:0/3968060193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93fba0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f74fc001eb0 tx=0x7f74fc012b70 comp rx=0 tx=0).stop 2023-07-21T22:29:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.276+0000 7f752a572b80 1 -- 172.21.15.151:0/3968060193 shutdown_connections 2023-07-21T22:29:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.276+0000 7f752a572b80 1 --2- 172.21.15.151:0/3968060193 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935660 0x555dbe93b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.276+0000 7f752a572b80 1 --2- 172.21.15.151:0/3968060193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe78b6b0 0x555dbe93fba0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.276+0000 7f752a572b80 1 --2- 172.21.15.151:0/3968060193 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe935210 0x555dbe936140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.276+0000 7f752a572b80 1 -- 172.21.15.151:0/3968060193 >> 172.21.15.151:0/3968060193 conn(0x555dbe924ae0 msgr2=0x555dbe935a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.276+0000 7f752a572b80 1 -- 172.21.15.151:0/3968060193 shutdown_connections 2023-07-21T22:29:49.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.276+0000 7f752a572b80 1 -- 172.21.15.151:0/3968060193 wait complete. 2023-07-21T22:29:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.276+0000 7f752a572b80 1 -- start start 2023-07-21T22:29:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.276+0000 7f752a572b80 1 Processor -- start 2023-07-21T22:29:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f752a572b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 0x555dbe931aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f752a572b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe931fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f752a572b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe930800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f752a572b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe930d40 con 0x555dbe935660 2023-07-21T22:29:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f752a572b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe930eb0 con 0x555dbe78b6b0 2023-07-21T22:29:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f752a572b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555dbe931070 con 0x555dbe935210 2023-07-21T22:29:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f752a572b80 10 client.0 _ll_register_callbacks cb 0x7f750400b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:29:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f750ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe930800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f750ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe930800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47058/0 (socket says 172.21.15.151:47058) 2023-07-21T22:29:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f750ffff700 1 -- 172.21.15.151:0/1237397601 learned_addr learned my addr 172.21.15.151:0/1237397601 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:29:49.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.277+0000 7f751499b700 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe931fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.278+0000 7f750ffff700 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 0x555dbe931aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.278+0000 7f751499b700 1 -- 172.21.15.151:0/1237397601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 msgr2=0x555dbe931aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.278+0000 7f751499b700 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 0x555dbe931aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.278+0000 7f751499b700 1 -- 172.21.15.151:0/1237397601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 msgr2=0x555dbe930800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:29:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.278+0000 7f751499b700 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe930800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.278+0000 7f751499b700 1 -- 172.21.15.151:0/1237397601 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555dbe697c00 con 0x555dbe935210 2023-07-21T22:29:49.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.278+0000 7f750ffff700 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe930800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:29:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.278+0000 7f751499b700 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe931fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555dbe94b700 tx=0x7f750400b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfe1d595a796a370 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:29:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.278+0000 7f74effff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:29:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f74effff700 1 -- 172.21.15.151:0/1237397601 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504016070 con 0x555dbe935210 2023-07-21T22:29:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f752a572b80 1 -- 172.21.15.151:0/1237397601 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f74fc0044c0 con 0x555dbe935210 2023-07-21T22:29:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f74effff700 1 -- 172.21.15.151:0/1237397601 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f750401f510 con 0x555dbe935210 2023-07-21T22:29:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f74effff700 1 -- 172.21.15.151:0/1237397601 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7504004830 con 0x555dbe935210 2023-07-21T22:29:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f752a572b80 10 client.26887 fetch_fsmap learned FSMap version 46 2023-07-21T22:29:49.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f752a572b80 1 -- 172.21.15.151:0/1237397601 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) v3 -- 0x555dbe6ad250 con 0x555dbe935210 2023-07-21T22:29:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f74effff700 1 -- 172.21.15.151:0/1237397601 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f74fc0044c0 con 0x555dbe935210 2023-07-21T22:29:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f74effff700 1 -- 172.21.15.151:0/1237397601 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 46) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f75040115b0 con 0x555dbe935210 2023-07-21T22:29:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f752a572b80 10 client.26887 fetch_fsmap finished waiting for FSMap version 46 2023-07-21T22:29:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f752a572b80 10 client.26887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:29:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f752a572b80 20 client.26887 populate_metadata read hostname 'smithi151' 2023-07-21T22:29:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f752a572b80 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555dbe99d880 0x555dbe99fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:29:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.279+0000 7f752a572b80 4 client.26887 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:29:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.280+0000 7f752a572b80 1 -- 172.21.15.151:0/1237397601 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555dbe83bff0 con 0x555dbe99d880 2023-07-21T22:29:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.280+0000 7f750ffff700 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555dbe99d880 0x555dbe99fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:29:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.280+0000 7f750ffff700 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555dbe99d880 0x555dbe99fc90 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=617ceecb9c50d591 server_cookie=5e1866f62fbf4ddf in_seq=0 out_seq=0 2023-07-21T22:29:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.280+0000 7f74effff700 10 client.26887 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.295+0000 7f74effff700 1 -- 172.21.15.151:0/1237397601 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555dbe83bff0 con 0x555dbe99d880 2023-07-21T22:29:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.295+0000 7f74effff700 10 client.26887 handle_command_reply: tid=0 2023-07-21T22:29:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.295+0000 7f752a572b80 1 client.26887 shutdown 2023-07-21T22:29:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.295+0000 7f752a572b80 1 -- 172.21.15.151:0/1237397601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 msgr2=0x555dbe931fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.295+0000 7f752a572b80 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe931fe0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x555dbe94b700 tx=0x7f750400b9a0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f752a572b80 1 -- 172.21.15.151:0/1237397601 shutdown_connections 2023-07-21T22:29:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f752a572b80 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555dbe99d880 0x555dbe99fc90 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f752a572b80 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555dbe78b6b0 0x555dbe931aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f74effff700 0 client.26887 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:29:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f752a572b80 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555dbe935660 0x555dbe930800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f752a572b80 1 --2- 172.21.15.151:0/1237397601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555dbe935210 0x555dbe931fe0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f752a572b80 1 -- 172.21.15.151:0/1237397601 >> 172.21.15.151:0/1237397601 conn(0x555dbe924ae0 msgr2=0x555dbe934160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f752a572b80 1 -- 172.21.15.151:0/1237397601 shutdown_connections 2023-07-21T22:29:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f752a572b80 1 -- 172.21.15.151:0/1237397601 wait complete. 2023-07-21T22:29:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.296+0000 7f752a572b80 20 client.26887 trim_cache size 0 max 16384 2023-07-21T22:29:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:29:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:29:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:29:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:29:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 -- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f75000a12c0 msgr2=0x7f75000a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f75000a12c0 0x7f75000a3770 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f75080cbb80 tx=0x7f7508005b60 comp rx=0 tx=0).stop 2023-07-21T22:29:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 -- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 msgr2=0x7f751019ca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:29:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 0x7f751019ca50 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7508009380 tx=0x7f75080093b0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 -- 172.21.15.151:0/1312821000 shutdown_connections 2023-07-21T22:29:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f75000a12c0 0x7f75000a3770 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7510101fd0 0x7f7510197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7510107010 0x7f751019ca50 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 --2- 172.21.15.151:0/1312821000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7510102970 0x7f75101983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:29:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 -- 172.21.15.151:0/1312821000 >> 172.21.15.151:0/1312821000 conn(0x7f75100fd840 msgr2=0x7f75100fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:29:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 -- 172.21.15.151:0/1312821000 shutdown_connections 2023-07-21T22:29:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:29:49.297+0000 7f7516bff700 1 -- 172.21.15.151:0/1312821000 wait complete. 2023-07-21T22:29:49.367 INFO:teuthology.orchestra.run.smithi151.stderr:44800000 of 50000000 tuples (89%) done (elapsed 612.86 s, remaining 71.14 s) 2023-07-21T22:29:50.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:50 smithi151 ceph-mon[95510]: pgmap v330: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 61 op/s 2023-07-21T22:29:50.710 INFO:teuthology.orchestra.run.smithi151.stderr:44900000 of 50000000 tuples (89%) done (elapsed 614.20 s, remaining 69.76 s) 2023-07-21T22:29:50.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:50 smithi187 ceph-mon[96918]: pgmap v330: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 61 op/s 2023-07-21T22:29:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:50 smithi195 ceph-mon[97365]: pgmap v330: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 61 op/s 2023-07-21T22:29:51.967 INFO:teuthology.orchestra.run.smithi151.stderr:45000000 of 50000000 tuples (90%) done (elapsed 615.46 s, remaining 68.38 s) 2023-07-21T22:29:52.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:52 smithi151 ceph-mon[95510]: pgmap v331: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 61 op/s 2023-07-21T22:29:52.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:52 smithi187 ceph-mon[96918]: pgmap v331: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 61 op/s 2023-07-21T22:29:52.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:52 smithi195 ceph-mon[97365]: pgmap v331: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 24 MiB/s wr, 61 op/s 2023-07-21T22:29:53.315 INFO:teuthology.orchestra.run.smithi151.stderr:45100000 of 50000000 tuples (90%) done (elapsed 616.81 s, remaining 67.01 s) 2023-07-21T22:29:54.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:54 smithi151 ceph-mon[95510]: pgmap v332: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:29:54.825 INFO:teuthology.orchestra.run.smithi151.stderr:45200000 of 50000000 tuples (90%) done (elapsed 618.32 s, remaining 65.66 s) 2023-07-21T22:29:54.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:54 smithi187 ceph-mon[96918]: pgmap v332: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:29:54.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:54 smithi195 ceph-mon[97365]: pgmap v332: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:29:56.086 INFO:teuthology.orchestra.run.smithi151.stderr:45300000 of 50000000 tuples (90%) done (elapsed 619.58 s, remaining 64.28 s) 2023-07-21T22:29:56.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:56 smithi151 ceph-mon[95510]: pgmap v333: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 24 MiB/s wr, 51 op/s 2023-07-21T22:29:56.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:56 smithi187 ceph-mon[96918]: pgmap v333: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 24 MiB/s wr, 51 op/s 2023-07-21T22:29:56.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:56 smithi195 ceph-mon[97365]: pgmap v333: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 24 MiB/s wr, 51 op/s 2023-07-21T22:29:57.335 INFO:teuthology.orchestra.run.smithi151.stderr:45400000 of 50000000 tuples (90%) done (elapsed 620.83 s, remaining 62.90 s) 2023-07-21T22:29:58.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:29:58 smithi151 ceph-mon[95510]: pgmap v334: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 35 MiB/s wr, 74 op/s 2023-07-21T22:29:58.771 INFO:teuthology.orchestra.run.smithi151.stderr:45500000 of 50000000 tuples (91%) done (elapsed 622.26 s, remaining 61.54 s) 2023-07-21T22:29:58.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:29:58 smithi187 ceph-mon[96918]: pgmap v334: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 35 MiB/s wr, 74 op/s 2023-07-21T22:29:58.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:29:58 smithi195 ceph-mon[97365]: pgmap v334: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 35 MiB/s wr, 74 op/s 2023-07-21T22:30:00.104 INFO:teuthology.orchestra.run.smithi151.stderr:45600000 of 50000000 tuples (91%) done (elapsed 623.59 s, remaining 60.17 s) 2023-07-21T22:30:00.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T22:29:59.999+0000 7f5662017700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:30:00.452 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T22:29:59.999+0000 7f5662017700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-07-21T22:30:00.452 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T22:29:59.999+0000 7f5662017700 -1 log_channel(cluster) log [ERR] : mds.h(mds.2): Metadata damage detected 2023-07-21T22:30:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:00 smithi187 ceph-mon[96918]: pgmap v335: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 48 op/s 2023-07-21T22:30:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:00 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:00 smithi187 ceph-mon[96918]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:30:00.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:00 smithi187 ceph-mon[96918]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-07-21T22:30:00.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:00 smithi187 ceph-mon[96918]: mds.h(mds.2): Metadata damage detected 2023-07-21T22:30:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:00 smithi195 ceph-mon[97365]: pgmap v335: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 48 op/s 2023-07-21T22:30:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:00 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:00 smithi195 ceph-mon[97365]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:30:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:00 smithi195 ceph-mon[97365]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-07-21T22:30:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:00 smithi195 ceph-mon[97365]: mds.h(mds.2): Metadata damage detected 2023-07-21T22:30:00.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:00 smithi151 ceph-mon[95510]: pgmap v335: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 48 op/s 2023-07-21T22:30:00.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:00 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:00.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:00 smithi151 ceph-mon[95510]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:30:00.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:00 smithi151 ceph-mon[95510]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2023-07-21T22:30:00.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:00 smithi151 ceph-mon[95510]: mds.h(mds.2): Metadata damage detected 2023-07-21T22:30:01.412 INFO:teuthology.orchestra.run.smithi151.stderr:45700000 of 50000000 tuples (91%) done (elapsed 624.90 s, remaining 58.80 s) 2023-07-21T22:30:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.467+0000 7fab605ff700 1 -- 172.21.15.151:0/475704620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab58100760 msgr2=0x7fab58104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.467+0000 7fab605ff700 1 --2- 172.21.15.151:0/475704620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab58100760 0x7fab58104720 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fab480099c0 tx=0x7fab48009cd0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.467+0000 7fab605ff700 1 -- 172.21.15.151:0/475704620 shutdown_connections 2023-07-21T22:30:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.467+0000 7fab605ff700 1 --2- 172.21.15.151:0/475704620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab580ffdc0 0x7fab58100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.467+0000 7fab605ff700 1 --2- 172.21.15.151:0/475704620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58104e00 0x7fab5810c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.467+0000 7fab605ff700 1 --2- 172.21.15.151:0/475704620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab58100760 0x7fab58104720 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.467+0000 7fab605ff700 1 -- 172.21.15.151:0/475704620 >> 172.21.15.151:0/475704620 conn(0x7fab580fb650 msgr2=0x7fab580fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:02.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.468+0000 7fab605ff700 1 -- 172.21.15.151:0/475704620 shutdown_connections 2023-07-21T22:30:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.468+0000 7fab605ff700 1 -- 172.21.15.151:0/475704620 wait complete. 2023-07-21T22:30:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.469+0000 7fab605ff700 1 Processor -- start 2023-07-21T22:30:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.469+0000 7fab605ff700 1 -- start start 2023-07-21T22:30:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.469+0000 7fab605ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab580ffdc0 0x7fab58197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.469+0000 7fab605ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab58100760 0x7fab58198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab605ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58104e00 0x7fab5819c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab605ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5819cfc0 con 0x7fab580ffdc0 2023-07-21T22:30:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab605ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5819d130 con 0x7fab58100760 2023-07-21T22:30:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab605ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab5819d2f0 con 0x7fab58104e00 2023-07-21T22:30:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5e39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab580ffdc0 0x7fab58197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5e39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab580ffdc0 0x7fab58197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36788/0 (socket says 172.21.15.151:36788) 2023-07-21T22:30:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5e39b700 1 -- 172.21.15.151:0/2953925163 learned_addr learned my addr 172.21.15.151:0/2953925163 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58104e00 0x7fab5819c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5db9a700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab58100760 0x7fab58198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5e39b700 1 -- 172.21.15.151:0/2953925163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58104e00 msgr2=0x7fab5819c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5e39b700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58104e00 0x7fab5819c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5e39b700 1 -- 172.21.15.151:0/2953925163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab58100760 msgr2=0x7fab58198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5e39b700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab58100760 0x7fab58198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.470+0000 7fab5e39b700 1 -- 172.21.15.151:0/2953925163 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab480095f0 con 0x7fab580ffdc0 2023-07-21T22:30:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.471+0000 7fab5e39b700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab580ffdc0 0x7fab58197dd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fab5400e9a0 tx=0x7fab5400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.471+0000 7fab4f7fe700 1 -- 172.21.15.151:0/2953925163 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab54009790 con 0x7fab580ffdc0 2023-07-21T22:30:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.471+0000 7fab4f7fe700 1 -- 172.21.15.151:0/2953925163 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab54010430 con 0x7fab580ffdc0 2023-07-21T22:30:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.471+0000 7fab4f7fe700 1 -- 172.21.15.151:0/2953925163 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5400cea0 con 0x7fab580ffdc0 2023-07-21T22:30:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.471+0000 7fab605ff700 1 -- 172.21.15.151:0/2953925163 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab5819d5d0 con 0x7fab580ffdc0 2023-07-21T22:30:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.471+0000 7fab605ff700 1 -- 172.21.15.151:0/2953925163 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab581a4e10 con 0x7fab580ffdc0 2023-07-21T22:30:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.474+0000 7fab4f7fe700 1 -- 172.21.15.151:0/2953925163 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fab540105a0 con 0x7fab580ffdc0 2023-07-21T22:30:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab73fc6b80 1 Processor -- start 2023-07-21T22:30:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab4f7fe700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fab440a1340 0x7fab440a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab73fc6b80 1 -- start start 2023-07-21T22:30:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab4f7fe700 1 -- 172.21.15.151:0/2953925163 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fab54014070 con 0x7fab580ffdc0 2023-07-21T22:30:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fab440a1340 0x7fab440a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dc3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dbdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dbe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496cc3c50 con 0x565496dc4660 2023-07-21T22:30:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496d169e0 con 0x565496dc4210 2023-07-21T22:30:02.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.476+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496d0fe70 con 0x565496c1a6b0 2023-07-21T22:30:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5e39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dc3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5e39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dc3cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60406/0 (socket says 172.21.15.151:60406) 2023-07-21T22:30:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5e39b700 1 -- 172.21.15.151:0/1484817132 learned_addr learned my addr 172.21.15.151:0/1484817132 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/1484817132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dbe4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5db9a700 1 --2- 172.21.15.151:0/1484817132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dbdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fab440a1340 0x7fab440a37f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab5000f590 tx=0x7fab50009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5e39b700 1 -- 172.21.15.151:0/1484817132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 msgr2=0x565496dbdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5e39b700 1 --2- 172.21.15.151:0/1484817132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dbdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5e39b700 1 -- 172.21.15.151:0/1484817132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 msgr2=0x565496dbe4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5e39b700 1 --2- 172.21.15.151:0/1484817132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dbe4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.477+0000 7fab5e39b700 1 -- 172.21.15.151:0/1484817132 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565496b3dd80 con 0x565496c1a6b0 2023-07-21T22:30:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.478+0000 7fab5e39b700 1 --2- 172.21.15.151:0/1484817132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dc3cd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fab54096480 tx=0x7fab54099bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d80dcf1404f885e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.478+0000 7fab4cbfe700 1 -- 172.21.15.151:0/1484817132 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a23d0 con 0x565496c1a6b0 2023-07-21T22:30:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.478+0000 7fab4cbfe700 1 -- 172.21.15.151:0/1484817132 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab5409a1e0 con 0x565496c1a6b0 2023-07-21T22:30:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.478+0000 7fab4cbfe700 1 -- 172.21.15.151:0/1484817132 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a1f40 con 0x565496c1a6b0 2023-07-21T22:30:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1484817132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 msgr2=0x565496dc3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1484817132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dc3cd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fab54096480 tx=0x7fab54099bd0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1484817132 shutdown_connections 2023-07-21T22:30:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1484817132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dbe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1484817132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dc3cd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1484817132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dbdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1484817132 >> 172.21.15.151:0/1484817132 conn(0x565496db3ae0 msgr2=0x565496db90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1484817132 shutdown_connections 2023-07-21T22:30:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1484817132 wait complete. 2023-07-21T22:30:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.479+0000 7fab73fc6b80 1 -- start start 2023-07-21T22:30:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab73fc6b80 1 Processor -- start 2023-07-21T22:30:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dcd640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dcdb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc78d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496cafa60 con 0x565496dc4660 2023-07-21T22:30:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496caf760 con 0x565496dc4210 2023-07-21T22:30:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496b938c0 con 0x565496c1a6b0 2023-07-21T22:30:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab73fc6b80 10 client.0 _ll_register_callbacks cb 0x565496cad700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab5eb9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab5db9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dcdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab5eb9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36808/0 (socket says 172.21.15.151:36808) 2023-07-21T22:30:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab5eb9c700 1 -- 172.21.15.151:0/1867262715 learned_addr learned my addr 172.21.15.151:0/1867262715 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.480+0000 7fab5db9a700 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dcdb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54092/0 (socket says 172.21.15.151:54092) 2023-07-21T22:30:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab5e39b700 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dcd640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab5eb9c700 1 -- 172.21.15.151:0/1867262715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 msgr2=0x565496dcd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dcd640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab5eb9c700 1 -- 172.21.15.151:0/1867262715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 msgr2=0x565496dcdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dcdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab5eb9c700 1 -- 172.21.15.151:0/1867262715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab581a4e10 con 0x565496dc4660 2023-07-21T22:30:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab5db9a700 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dcdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:30:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc78d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fab50019e50 tx=0x7fab50004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255df9c3e3f9e6a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.481+0000 7fab41ffb700 1 -- 172.21.15.151:0/1867262715 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab5000e040 con 0x565496dc4660 2023-07-21T22:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1867262715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x565496c69490 con 0x565496dc4660 2023-07-21T22:30:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab41ffb700 1 -- 172.21.15.151:0/1867262715 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fab50004bb0 con 0x565496dc4660 2023-07-21T22:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab41ffb700 1 -- 172.21.15.151:0/1867262715 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab50004d70 con 0x565496dc4660 2023-07-21T22:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab73fc6b80 10 client.17175 fetch_fsmap learned FSMap version 47 2023-07-21T22:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1867262715 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x565496b26c00 con 0x565496dc4660 2023-07-21T22:30:02.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab41ffb700 1 -- 172.21.15.151:0/1867262715 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x565496c69490 con 0x565496dc4660 2023-07-21T22:30:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab41ffb700 1 -- 172.21.15.151:0/1867262715 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 47) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fab500229e0 con 0x565496dc4660 2023-07-21T22:30:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab73fc6b80 10 client.17175 fetch_fsmap finished waiting for FSMap version 47 2023-07-21T22:30:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab73fc6b80 10 client.17175 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab73fc6b80 20 client.17175 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565496dd7bc0 0x565496dd9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab73fc6b80 4 client.17175 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.482+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1867262715 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x565496d08e50 con 0x565496dd7bc0 2023-07-21T22:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.483+0000 7fab5e39b700 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565496dd7bc0 0x565496dd9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.483+0000 7fab41ffb700 10 client.17175 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.483+0000 7fab5e39b700 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565496dd7bc0 0x565496dd9fd0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5309acc1f43491da server_cookie=3a9b11d14af21a79 in_seq=0 out_seq=0 2023-07-21T22:30:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab41ffb700 1 -- 172.21.15.151:0/1867262715 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x565496d08e50 con 0x565496dd7bc0 2023-07-21T22:30:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab41ffb700 10 client.17175 handle_command_reply: tid=0 2023-07-21T22:30:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab73fc6b80 1 client.17175 shutdown 2023-07-21T22:30:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1867262715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 msgr2=0x565496dc78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc78d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fab50019e50 tx=0x7fab50004b40 comp rx=0 tx=0).stop 2023-07-21T22:30:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1867262715 shutdown_connections 2023-07-21T22:30:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565496dd7bc0 0x565496dd9fd0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc78d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dcd640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/1867262715 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dcdb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1867262715 >> 172.21.15.151:0/1867262715 conn(0x565496db3ae0 msgr2=0x565496db83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.484+0000 7fab41ffb700 0 client.17175 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.485+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1867262715 shutdown_connections 2023-07-21T22:30:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.485+0000 7fab73fc6b80 1 -- 172.21.15.151:0/1867262715 wait complete. 2023-07-21T22:30:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.485+0000 7fab73fc6b80 20 client.17175 trim_cache size 0 max 16384 2023-07-21T22:30:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.503+0000 7fab73fc6b80 1 Processor -- start 2023-07-21T22:30:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.503+0000 7fab73fc6b80 1 -- start start 2023-07-21T22:30:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dbd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dc71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496d08e50 con 0x565496dc4660 2023-07-21T22:30:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496c69490 con 0x565496dc4210 2023-07-21T22:30:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496dd5210 con 0x565496c1a6b0 2023-07-21T22:30:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab5eb9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab5e39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dbd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab5eb9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36824/0 (socket says 172.21.15.151:36824) 2023-07-21T22:30:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab5eb9c700 1 -- 172.21.15.151:0/274367244 learned_addr learned my addr 172.21.15.151:0/274367244 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.504+0000 7fab5db9a700 1 --2- 172.21.15.151:0/274367244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dc71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab5e39b700 1 -- 172.21.15.151:0/274367244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 msgr2=0x565496dc71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab5e39b700 1 --2- 172.21.15.151:0/274367244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dc71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab5e39b700 1 -- 172.21.15.151:0/274367244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 msgr2=0x565496dc7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab5e39b700 1 --2- 172.21.15.151:0/274367244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab5e39b700 1 -- 172.21.15.151:0/274367244 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x565496b641f0 con 0x565496c1a6b0 2023-07-21T22:30:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/274367244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:30:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab5e39b700 1 --2- 172.21.15.151:0/274367244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dbd7c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x565496dbec40 tx=0x7fab540999b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab74714825a353df server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab4d3ff700 1 -- 172.21.15.151:0/274367244 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a23d0 con 0x565496c1a6b0 2023-07-21T22:30:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab4d3ff700 1 -- 172.21.15.151:0/274367244 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab5409a350 con 0x565496c1a6b0 2023-07-21T22:30:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.505+0000 7fab4d3ff700 1 -- 172.21.15.151:0/274367244 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab540a2180 con 0x565496c1a6b0 2023-07-21T22:30:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 -- 172.21.15.151:0/274367244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 msgr2=0x565496dbd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/274367244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dbd7c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x565496dbec40 tx=0x7fab540999b0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 -- 172.21.15.151:0/274367244 shutdown_connections 2023-07-21T22:30:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/274367244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4660 0x565496dc7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/274367244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496c1a6b0 0x565496dbd7c0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/274367244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496dc4210 0x565496dc71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 -- 172.21.15.151:0/274367244 >> 172.21.15.151:0/274367244 conn(0x565496db3ae0 msgr2=0x565496dc3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:02.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 -- 172.21.15.151:0/274367244 shutdown_connections 2023-07-21T22:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 -- 172.21.15.151:0/274367244 wait complete. 2023-07-21T22:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.506+0000 7fab73fc6b80 1 -- start start 2023-07-21T22:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.507+0000 7fab73fc6b80 1 Processor -- start 2023-07-21T22:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.507+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496c1a6b0 0x565496e28220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.507+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4210 0x565496e28760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.507+0000 7fab73fc6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496dc4660 0x565496e332a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.507+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496e29030 con 0x565496dc4210 2023-07-21T22:30:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.507+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496e337e0 con 0x565496c1a6b0 2023-07-21T22:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.507+0000 7fab73fc6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x565496e33920 con 0x565496dc4660 2023-07-21T22:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.507+0000 7fab73fc6b80 10 client.0 _ll_register_callbacks cb 0x7fab50019800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5db9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4210 0x565496e28760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5db9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4210 0x565496e28760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36838/0 (socket says 172.21.15.151:36838) 2023-07-21T22:30:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5db9a700 1 -- 172.21.15.151:0/4250974192 learned_addr learned my addr 172.21.15.151:0/4250974192 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496dc4660 0x565496e332a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5e39b700 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496c1a6b0 0x565496e28220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5db9a700 1 -- 172.21.15.151:0/4250974192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496dc4660 msgr2=0x565496e332a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5db9a700 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496dc4660 0x565496e332a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5db9a700 1 -- 172.21.15.151:0/4250974192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496c1a6b0 msgr2=0x565496e28220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5db9a700 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496c1a6b0 0x565496e28220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5db9a700 1 -- 172.21.15.151:0/4250974192 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x565496b26c00 con 0x565496dc4210 2023-07-21T22:30:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5eb9c700 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496dc4660 0x565496e332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:30:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab5db9a700 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4210 0x565496e28760 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fab58100b30 tx=0x7fab4800bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e72bba48331d91f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.508+0000 7fab41ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:30:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.509+0000 7fab41ffb700 1 -- 172.21.15.151:0/4250974192 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48003960 con 0x565496dc4210 2023-07-21T22:30:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.509+0000 7fab73fc6b80 1 -- 172.21.15.151:0/4250974192 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fab5409a1e0 con 0x565496dc4210 2023-07-21T22:30:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.509+0000 7fab41ffb700 1 -- 172.21.15.151:0/4250974192 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(96..96 src has 1..96) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fab48003ac0 con 0x565496dc4210 2023-07-21T22:30:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.509+0000 7fab41ffb700 1 -- 172.21.15.151:0/4250974192 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) v2 ==== 24+0+0 (secure 0 0 0) 0x7fab48003c80 con 0x565496dc4210 2023-07-21T22:30:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.509+0000 7fab73fc6b80 10 client.17181 fetch_fsmap learned FSMap version 47 2023-07-21T22:30:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.509+0000 7fab73fc6b80 1 -- 172.21.15.151:0/4250974192 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) v3 -- 0x565496b3dd80 con 0x565496dc4210 2023-07-21T22:30:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.509+0000 7fab41ffb700 1 -- 172.21.15.151:0/4250974192 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fab5409a1e0 con 0x565496dc4210 2023-07-21T22:30:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.509+0000 7fab41ffb700 1 -- 172.21.15.151:0/4250974192 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 47) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fab480099f0 con 0x565496dc4210 2023-07-21T22:30:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.510+0000 7fab73fc6b80 10 client.17181 fetch_fsmap finished waiting for FSMap version 47 2023-07-21T22:30:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.510+0000 7fab73fc6b80 10 client.17181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.510+0000 7fab73fc6b80 20 client.17181 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.510+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565496e34ef0 0x565496e37300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.510+0000 7fab73fc6b80 4 client.17181 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:30:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.510+0000 7fab73fc6b80 1 -- 172.21.15.151:0/4250974192 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x565496ccaff0 con 0x565496e34ef0 2023-07-21T22:30:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.510+0000 7fab5e39b700 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565496e34ef0 0x565496e37300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.511+0000 7fab5e39b700 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565496e34ef0 0x565496e37300 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=38c5e2aaac31c3f7 server_cookie=b72d6f9e33432867 in_seq=0 out_seq=0 2023-07-21T22:30:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.511+0000 7fab41ffb700 10 client.17181 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.530+0000 7fab41ffb700 1 -- 172.21.15.151:0/4250974192 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x565496ccaff0 con 0x565496e34ef0 2023-07-21T22:30:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.530+0000 7fab41ffb700 10 client.17181 handle_command_reply: tid=0 2023-07-21T22:30:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.530+0000 7fab73fc6b80 1 client.17181 shutdown 2023-07-21T22:30:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 -- 172.21.15.151:0/4250974192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4210 msgr2=0x565496e28760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:02.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4210 0x565496e28760 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fab58100b30 tx=0x7fab4800bf40 comp rx=0 tx=0).stop 2023-07-21T22:30:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 -- 172.21.15.151:0/4250974192 shutdown_connections 2023-07-21T22:30:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x565496e34ef0 0x565496e37300 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x565496c1a6b0 0x565496e28220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab41ffb700 0 client.17181 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x565496dc4660 0x565496e332a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 --2- 172.21.15.151:0/4250974192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x565496dc4210 0x565496e28760 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 -- 172.21.15.151:0/4250974192 >> 172.21.15.151:0/4250974192 conn(0x565496db3ae0 msgr2=0x565496dbd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 -- 172.21.15.151:0/4250974192 shutdown_connections 2023-07-21T22:30:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 1 -- 172.21.15.151:0/4250974192 wait complete. 2023-07-21T22:30:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.531+0000 7fab73fc6b80 20 client.17181 trim_cache size 0 max 16384 2023-07-21T22:30:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:30:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:30:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:30:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:30:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 -- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fab440a1340 msgr2=0x7fab440a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fab440a1340 0x7fab440a37f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab5000f590 tx=0x7fab50009920 comp rx=0 tx=0).stop 2023-07-21T22:30:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 -- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab580ffdc0 msgr2=0x7fab58197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab580ffdc0 0x7fab58197dd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fab5400e9a0 tx=0x7fab5400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 -- 172.21.15.151:0/2953925163 shutdown_connections 2023-07-21T22:30:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fab440a1340 0x7fab440a37f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fab58104e00 0x7fab5819c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab580ffdc0 0x7fab58197dd0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 --2- 172.21.15.151:0/2953925163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab58100760 0x7fab58198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 -- 172.21.15.151:0/2953925163 >> 172.21.15.151:0/2953925163 conn(0x7fab580fb650 msgr2=0x7fab580fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 -- 172.21.15.151:0/2953925163 shutdown_connections 2023-07-21T22:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:02.532+0000 7fab605ff700 1 -- 172.21.15.151:0/2953925163 wait complete. 2023-07-21T22:30:02.698 INFO:teuthology.orchestra.run.smithi151.stderr:45800000 of 50000000 tuples (91%) done (elapsed 626.19 s, remaining 57.42 s) 2023-07-21T22:30:02.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:02 smithi187 ceph-mon[96918]: pgmap v336: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 48 op/s 2023-07-21T22:30:02.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:02 smithi195 ceph-mon[97365]: pgmap v336: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 48 op/s 2023-07-21T22:30:02.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:02 smithi151 ceph-mon[95510]: pgmap v336: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 48 op/s 2023-07-21T22:30:04.039 INFO:teuthology.orchestra.run.smithi151.stderr:45900000 of 50000000 tuples (91%) done (elapsed 627.53 s, remaining 56.05 s) 2023-07-21T22:30:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:04 smithi187 ceph-mon[96918]: pgmap v337: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 34 MiB/s wr, 103 op/s 2023-07-21T22:30:04.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:04 smithi195 ceph-mon[97365]: pgmap v337: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 34 MiB/s wr, 103 op/s 2023-07-21T22:30:04.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:04 smithi151 ceph-mon[95510]: pgmap v337: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 210 KiB/s rd, 34 MiB/s wr, 103 op/s 2023-07-21T22:30:05.384 INFO:teuthology.orchestra.run.smithi151.stderr:46000000 of 50000000 tuples (92%) done (elapsed 628.87 s, remaining 54.68 s) 2023-07-21T22:30:05.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:05 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:05.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:05 smithi151 ceph-mon[95510]: osdmap e97: 12 total, 12 up, 12 in 2023-07-21T22:30:05.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:05 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:05.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:05 smithi187 ceph-mon[96918]: osdmap e97: 12 total, 12 up, 12 in 2023-07-21T22:30:05.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:05 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:05.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:05 smithi195 ceph-mon[97365]: osdmap e97: 12 total, 12 up, 12 in 2023-07-21T22:30:06.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:06 smithi187 ceph-mon[96918]: pgmap v339: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 26 MiB/s wr, 94 op/s 2023-07-21T22:30:06.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:06 smithi195 ceph-mon[97365]: pgmap v339: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 26 MiB/s wr, 94 op/s 2023-07-21T22:30:06.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:06 smithi151 ceph-mon[95510]: pgmap v339: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 26 MiB/s wr, 94 op/s 2023-07-21T22:30:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:08 smithi187 ceph-mon[96918]: pgmap v340: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-07-21T22:30:08.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:08 smithi195 ceph-mon[97365]: pgmap v340: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-07-21T22:30:08.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:08 smithi151 ceph-mon[95510]: pgmap v340: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-07-21T22:30:09.692 INFO:teuthology.orchestra.run.smithi151.stderr:46100000 of 50000000 tuples (92%) done (elapsed 633.18 s, remaining 53.57 s) 2023-07-21T22:30:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:10 smithi187 ceph-mon[96918]: pgmap v341: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-07-21T22:30:10.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:10 smithi195 ceph-mon[97365]: pgmap v341: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-07-21T22:30:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:10 smithi151 ceph-mon[95510]: pgmap v341: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-07-21T22:30:11.028 INFO:teuthology.orchestra.run.smithi151.stderr:46200000 of 50000000 tuples (92%) done (elapsed 634.52 s, remaining 52.19 s) 2023-07-21T22:30:12.293 INFO:teuthology.orchestra.run.smithi151.stderr:46300000 of 50000000 tuples (92%) done (elapsed 635.78 s, remaining 50.81 s) 2023-07-21T22:30:12.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:12 smithi151 ceph-mon[95510]: pgmap v342: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-07-21T22:30:12.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:12 smithi151 ceph-mon[95510]: osdmap e98: 12 total, 12 up, 12 in 2023-07-21T22:30:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:12 smithi187 ceph-mon[96918]: pgmap v342: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-07-21T22:30:12.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:12 smithi187 ceph-mon[96918]: osdmap e98: 12 total, 12 up, 12 in 2023-07-21T22:30:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:12 smithi195 ceph-mon[97365]: pgmap v342: 97 pgs: 97 active+clean; 9.1 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 25 MiB/s wr, 96 op/s 2023-07-21T22:30:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:12 smithi195 ceph-mon[97365]: osdmap e98: 12 total, 12 up, 12 in 2023-07-21T22:30:13.539 INFO:teuthology.orchestra.run.smithi151.stderr:46400000 of 50000000 tuples (92%) done (elapsed 637.03 s, remaining 49.42 s) 2023-07-21T22:30:14.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:14 smithi151 ceph-mon[95510]: pgmap v344: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 22 MiB/s wr, 72 op/s 2023-07-21T22:30:14.871 INFO:teuthology.orchestra.run.smithi151.stderr:46500000 of 50000000 tuples (93%) done (elapsed 638.36 s, remaining 48.05 s) 2023-07-21T22:30:14.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:14 smithi187 ceph-mon[96918]: pgmap v344: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 22 MiB/s wr, 72 op/s 2023-07-21T22:30:14.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:14 smithi195 ceph-mon[97365]: pgmap v344: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 22 MiB/s wr, 72 op/s 2023-07-21T22:30:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.712+0000 7f1f497ff700 1 -- 172.21.15.151:0/1118296535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f440ffb00 msgr2=0x7f1f440fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.712+0000 7f1f497ff700 1 --2- 172.21.15.151:0/1118296535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f440ffb00 0x7f1f440fff70 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f1f38009990 tx=0x7f1f38009ca0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.712+0000 7f1f497ff700 1 -- 172.21.15.151:0/1118296535 shutdown_connections 2023-07-21T22:30:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.712+0000 7f1f497ff700 1 --2- 172.21.15.151:0/1118296535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f441004b0 0x7f1f4410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.712+0000 7f1f497ff700 1 --2- 172.21.15.151:0/1118296535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f44105b10 0x7f1f44105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.712+0000 7f1f497ff700 1 --2- 172.21.15.151:0/1118296535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f440ffb00 0x7f1f440fff70 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.712+0000 7f1f497ff700 1 -- 172.21.15.151:0/1118296535 >> 172.21.15.151:0/1118296535 conn(0x7f1f440fb600 msgr2=0x7f1f440fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:15.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.712+0000 7f1f497ff700 1 -- 172.21.15.151:0/1118296535 shutdown_connections 2023-07-21T22:30:15.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.712+0000 7f1f497ff700 1 -- 172.21.15.151:0/1118296535 wait complete. 2023-07-21T22:30:15.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.713+0000 7f1f497ff700 1 Processor -- start 2023-07-21T22:30:15.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f497ff700 1 -- start start 2023-07-21T22:30:15.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f497ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f440ffb00 0x7f1f440729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f497ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f441004b0 0x7f1f44072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f497ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f44105b10 0x7f1f441a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f497ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441a4290 con 0x7f1f44105b10 2023-07-21T22:30:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f497ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441a43d0 con 0x7f1f440ffb00 2023-07-21T22:30:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f497ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f441a4540 con 0x7f1f441004b0 2023-07-21T22:30:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f44105b10 0x7f1f441a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f440ffb00 0x7f1f440729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f427fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f441004b0 0x7f1f44072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f440ffb00 0x7f1f440729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:47264/0 (socket says 172.21.15.151:47264) 2023-07-21T22:30:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f44105b10 0x7f1f441a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38440/0 (socket says 172.21.15.151:38440) 2023-07-21T22:30:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.714+0000 7f1f42ffd700 1 -- 172.21.15.151:0/128397498 learned_addr learned my addr 172.21.15.151:0/128397498 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f42ffd700 1 -- 172.21.15.151:0/128397498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f441004b0 msgr2=0x7f1f44072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f441004b0 0x7f1f44072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f42ffd700 1 -- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f44105b10 msgr2=0x7f1f441a3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:15.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f44105b10 0x7f1f441a3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f42ffd700 1 -- 172.21.15.151:0/128397498 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f380095f0 con 0x7f1f440ffb00 2023-07-21T22:30:15.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f427fc700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f441004b0 0x7f1f44072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:30:15.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f437fe700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f44105b10 0x7f1f441a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:30:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f440ffb00 0x7f1f440729f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400e9a0 tx=0x7f1f3400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f2bfff700 1 -- 172.21.15.151:0/128397498 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f34009790 con 0x7f1f440ffb00 2023-07-21T22:30:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f2bfff700 1 -- 172.21.15.151:0/128397498 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f34010430 con 0x7f1f440ffb00 2023-07-21T22:30:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f497ff700 1 -- 172.21.15.151:0/128397498 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f441a4820 con 0x7f1f440ffb00 2023-07-21T22:30:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f2bfff700 1 -- 172.21.15.151:0/128397498 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3400cea0 con 0x7f1f440ffb00 2023-07-21T22:30:15.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.715+0000 7f1f497ff700 1 -- 172.21.15.151:0/128397498 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f441a4d80 con 0x7f1f440ffb00 2023-07-21T22:30:15.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.719+0000 7f1f2bfff700 1 -- 172.21.15.151:0/128397498 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f1f340105a0 con 0x7f1f440ffb00 2023-07-21T22:30:15.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.720+0000 7f1f5d18db80 1 Processor -- start 2023-07-21T22:30:15.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.720+0000 7f1f5d18db80 1 -- start start 2023-07-21T22:30:15.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f2bfff700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f2c0a1340 0x7f1f2c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f2bfff700 1 -- 172.21.15.151:0/128397498 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1f34014070 con 0x7f1f440ffb00 2023-07-21T22:30:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcbacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcb54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dbbac50 con 0x55e41dcbb660 2023-07-21T22:30:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dc0d9e0 con 0x55e41db116b0 2023-07-21T22:30:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dc06e70 con 0x55e41dcbb210 2023-07-21T22:30:15.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f437fe700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f2c0a1340 0x7f1f2c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcbacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcbacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:47274/0 (socket says 172.21.15.151:47274) 2023-07-21T22:30:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.721+0000 7f1f42ffd700 1 -- 172.21.15.151:0/3143585398 learned_addr learned my addr 172.21.15.151:0/3143585398 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f437fe700 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcb54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f427fc700 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f42ffd700 1 -- 172.21.15.151:0/3143585398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 msgr2=0x55e41dcb4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:15.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcb4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f42ffd700 1 -- 172.21.15.151:0/3143585398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 msgr2=0x55e41dcb54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcb54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f42ffd700 1 -- 172.21.15.151:0/3143585398 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e41da34d80 con 0x55e41db116b0 2023-07-21T22:30:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f427fc700 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:30:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f437fe700 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcb54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:30:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f437fe700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f2c0a1340 0x7f1f2c0a37f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c003f00 tx=0x7f1f3c004320 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcbacd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f340a1e00 tx=0x7f1f340998c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8576fa29f66a2296 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:15.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f297fa700 1 -- 172.21.15.151:0/3143585398 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3409df10 con 0x55e41db116b0 2023-07-21T22:30:15.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f297fa700 1 -- 172.21.15.151:0/3143585398 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f340a2330 con 0x55e41db116b0 2023-07-21T22:30:15.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.722+0000 7f1f297fa700 1 -- 172.21.15.151:0/3143585398 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340a1ea0 con 0x55e41db116b0 2023-07-21T22:30:15.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.723+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3143585398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 msgr2=0x55e41dcbacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:15.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.723+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcbacd0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f1f340a1e00 tx=0x7f1f340998c0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.723+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3143585398 shutdown_connections 2023-07-21T22:30:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.723+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcbacd0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.723+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcb54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.723+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3143585398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.723+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3143585398 >> 172.21.15.151:0/3143585398 conn(0x55e41dcaaae0 msgr2=0x55e41dcb00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.723+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3143585398 shutdown_connections 2023-07-21T22:30:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.723+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3143585398 wait complete. 2023-07-21T22:30:15.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.724+0000 7f1f5d18db80 1 -- start start 2023-07-21T22:30:15.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.724+0000 7f1f5d18db80 1 Processor -- start 2023-07-21T22:30:15.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.724+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcc45a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.724+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcc4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcbe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dba6a60 con 0x55e41dcbb660 2023-07-21T22:30:15.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dba6760 con 0x55e41db116b0 2023-07-21T22:30:15.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41da8a8c0 con 0x55e41dcbb210 2023-07-21T22:30:15.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f5d18db80 10 client.0 _ll_register_callbacks cb 0x55e41dba4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:15.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcbe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f437fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcbe860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38462/0 (socket says 172.21.15.151:38462) 2023-07-21T22:30:15.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f437fe700 1 -- 172.21.15.151:0/2861143597 learned_addr learned my addr 172.21.15.151:0/2861143597 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:15.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcc45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f427fc700 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcc4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f437fe700 1 -- 172.21.15.151:0/2861143597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 msgr2=0x55e41dcc4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:15.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f437fe700 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcc4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f437fe700 1 -- 172.21.15.151:0/2861143597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 msgr2=0x55e41dcc45a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:15.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f437fe700 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcc45a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.725+0000 7f1f437fe700 1 -- 172.21.15.151:0/2861143597 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f441a4d80 con 0x55e41dcbb660 2023-07-21T22:30:15.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.726+0000 7f1f437fe700 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcbe860 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00eef0 tx=0x7f1f3c004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dc7fb8fd18bc49a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:15.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.726+0000 7f1f26ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:30:15.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.726+0000 7f1f26ff5700 1 -- 172.21.15.151:0/2861143597 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3c018e80 con 0x55e41dcbb660 2023-07-21T22:30:15.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.726+0000 7f1f5d18db80 1 -- 172.21.15.151:0/2861143597 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e41db60490 con 0x55e41dcbb660 2023-07-21T22:30:15.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.726+0000 7f1f26ff5700 1 -- 172.21.15.151:0/2861143597 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1f3c024410 con 0x55e41dcbb660 2023-07-21T22:30:15.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.726+0000 7f1f26ff5700 1 -- 172.21.15.151:0/2861143597 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f3c0245d0 con 0x55e41dcbb660 2023-07-21T22:30:15.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.726+0000 7f1f5d18db80 10 client.17190 fetch_fsmap learned FSMap version 48 2023-07-21T22:30:15.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.726+0000 7f1f5d18db80 1 -- 172.21.15.151:0/2861143597 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55e41da1dc00 con 0x55e41dcbb660 2023-07-21T22:30:15.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.727+0000 7f1f26ff5700 1 -- 172.21.15.151:0/2861143597 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e41db60490 con 0x55e41dcbb660 2023-07-21T22:30:15.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.727+0000 7f1f26ff5700 1 -- 172.21.15.151:0/2861143597 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f1f3c02d610 con 0x55e41dcbb660 2023-07-21T22:30:15.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.727+0000 7f1f5d18db80 10 client.17190 fetch_fsmap finished waiting for FSMap version 48 2023-07-21T22:30:15.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.727+0000 7f1f5d18db80 10 client.17190 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:15.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.727+0000 7f1f5d18db80 20 client.17190 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:15.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.727+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e41dccea40 0x55e41dcd0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.727+0000 7f1f5d18db80 4 client.17190 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:30:15.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.727+0000 7f1f5d18db80 1 -- 172.21.15.151:0/2861143597 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e41dbffe50 con 0x55e41dccea40 2023-07-21T22:30:15.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.727+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e41dccea40 0x55e41dcd0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.728+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e41dccea40 0x55e41dcd0e50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a485ef68184e98c server_cookie=54173cc7b2d346ab in_seq=0 out_seq=0 2023-07-21T22:30:15.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.728+0000 7f1f26ff5700 10 client.17190 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:15.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f26ff5700 1 -- 172.21.15.151:0/2861143597 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e41dbffe50 con 0x55e41dccea40 2023-07-21T22:30:15.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f26ff5700 10 client.17190 handle_command_reply: tid=0 2023-07-21T22:30:15.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 client.17190 shutdown 2023-07-21T22:30:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 -- 172.21.15.151:0/2861143597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 msgr2=0x55e41dcbe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcbe860 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c00eef0 tx=0x7f1f3c004b40 comp rx=0 tx=0).stop 2023-07-21T22:30:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 -- 172.21.15.151:0/2861143597 shutdown_connections 2023-07-21T22:30:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e41dccea40 0x55e41dcd0e50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41db116b0 0x55e41dcc45a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41dcbb660 0x55e41dcbe860 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f26ff5700 0 client.17190 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:15.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/2861143597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcc4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 -- 172.21.15.151:0/2861143597 >> 172.21.15.151:0/2861143597 conn(0x55e41dcaaae0 msgr2=0x55e41dcaf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:15.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 -- 172.21.15.151:0/2861143597 shutdown_connections 2023-07-21T22:30:15.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 1 -- 172.21.15.151:0/2861143597 wait complete. 2023-07-21T22:30:15.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.729+0000 7f1f5d18db80 20 client.17190 trim_cache size 0 max 16384 2023-07-21T22:30:15.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.746+0000 7f1f5d18db80 1 Processor -- start 2023-07-21T22:30:15.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.746+0000 7f1f5d18db80 1 -- start start 2023-07-21T22:30:15.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcb9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcb4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb660 0x55e41dcb5480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dcbfdb0 con 0x55e41db116b0 2023-07-21T22:30:15.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dcac4f0 con 0x55e41dcbb660 2023-07-21T22:30:15.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dcb59c0 con 0x55e41dcbb210 2023-07-21T22:30:15.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcb9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcb9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38464/0 (socket says 172.21.15.151:38464) 2023-07-21T22:30:15.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f42ffd700 1 -- 172.21.15.151:0/886049025 learned_addr learned my addr 172.21.15.151:0/886049025 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:15.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f427fc700 1 --2- 172.21.15.151:0/886049025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcb4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f437fe700 1 --2- 172.21.15.151:0/886049025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb660 0x55e41dcb5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f42ffd700 1 -- 172.21.15.151:0/886049025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 msgr2=0x55e41dcb4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:15.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/886049025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcb4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f42ffd700 1 -- 172.21.15.151:0/886049025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb660 msgr2=0x55e41dcb5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:15.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/886049025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb660 0x55e41dcb5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.747+0000 7f1f42ffd700 1 -- 172.21.15.151:0/886049025 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e41da5b1f0 con 0x55e41db116b0 2023-07-21T22:30:15.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.748+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/886049025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcb9ff0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1f340963e0 tx=0x7f1f3400c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21809e45002bb49c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.748+0000 7f1f29ffb700 1 -- 172.21.15.151:0/886049025 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3409df10 con 0x55e41db116b0 2023-07-21T22:30:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.748+0000 7f1f29ffb700 1 -- 172.21.15.151:0/886049025 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f34098280 con 0x55e41db116b0 2023-07-21T22:30:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.748+0000 7f1f29ffb700 1 -- 172.21.15.151:0/886049025 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f3409a3a0 con 0x55e41db116b0 2023-07-21T22:30:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 -- 172.21.15.151:0/886049025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 msgr2=0x55e41dcb9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/886049025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcb9ff0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f1f340963e0 tx=0x7f1f3400c480 comp rx=0 tx=0).stop 2023-07-21T22:30:15.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 -- 172.21.15.151:0/886049025 shutdown_connections 2023-07-21T22:30:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/886049025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb660 0x55e41dcb5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/886049025 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcb9ff0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/886049025 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb210 0x55e41dcb4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 -- 172.21.15.151:0/886049025 >> 172.21.15.151:0/886049025 conn(0x55e41dcaaae0 msgr2=0x55e41dcbd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 -- 172.21.15.151:0/886049025 shutdown_connections 2023-07-21T22:30:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 -- 172.21.15.151:0/886049025 wait complete. 2023-07-21T22:30:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 -- start start 2023-07-21T22:30:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.749+0000 7f1f5d18db80 1 Processor -- start 2023-07-21T22:30:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcc4550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb210 0x55e41dcc4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f5d18db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb660 0x55e41dcc2a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dcc3140 con 0x55e41db116b0 2023-07-21T22:30:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dcc32b0 con 0x55e41dcbb210 2023-07-21T22:30:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f5d18db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e41dcc3470 con 0x55e41dcbb660 2023-07-21T22:30:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f5d18db80 10 client.0 _ll_register_callbacks cb 0x7f1f3c00e890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:15.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcc4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f42ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcc4550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38470/0 (socket says 172.21.15.151:38470) 2023-07-21T22:30:15.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f42ffd700 1 -- 172.21.15.151:0/3148406300 learned_addr learned my addr 172.21.15.151:0/3148406300 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:15.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f437fe700 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb660 0x55e41dcc2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.750+0000 7f1f427fc700 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb210 0x55e41dcc4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f42ffd700 1 -- 172.21.15.151:0/3148406300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb660 msgr2=0x55e41dcc2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:15.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb660 0x55e41dcc2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f42ffd700 1 -- 172.21.15.151:0/3148406300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb210 msgr2=0x55e41dcc4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb210 0x55e41dcc4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f42ffd700 1 -- 172.21.15.151:0/3148406300 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e41da34d80 con 0x55e41db116b0 2023-07-21T22:30:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f427fc700 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb210 0x55e41dcc4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:30:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f42ffd700 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcc4550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1f340a1e00 tx=0x7f1f340996b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d83d3093518ef36f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f26ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:30:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f26ff5700 1 -- 172.21.15.151:0/3148406300 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f340adbe0 con 0x55e41db116b0 2023-07-21T22:30:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f26ff5700 1 -- 172.21.15.151:0/3148406300 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1f340add40 con 0x55e41db116b0 2023-07-21T22:30:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3148406300 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1f340a2330 con 0x55e41db116b0 2023-07-21T22:30:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f26ff5700 1 -- 172.21.15.151:0/3148406300 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1f3409a140 con 0x55e41db116b0 2023-07-21T22:30:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f5d18db80 10 client.17196 fetch_fsmap learned FSMap version 48 2023-07-21T22:30:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.751+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3148406300 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55e41da33250 con 0x55e41db116b0 2023-07-21T22:30:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.752+0000 7f1f26ff5700 1 -- 172.21.15.151:0/3148406300 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1f340a2330 con 0x55e41db116b0 2023-07-21T22:30:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.752+0000 7f1f26ff5700 1 -- 172.21.15.151:0/3148406300 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f1f340a1f30 con 0x55e41db116b0 2023-07-21T22:30:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.752+0000 7f1f5d18db80 10 client.17196 fetch_fsmap finished waiting for FSMap version 48 2023-07-21T22:30:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.752+0000 7f1f5d18db80 10 client.17196 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.752+0000 7f1f5d18db80 20 client.17196 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.752+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e41dd23690 0x55e41dd25a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.752+0000 7f1f5d18db80 4 client.17196 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:30:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.752+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3148406300 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e41dbc1ff0 con 0x55e41dd23690 2023-07-21T22:30:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.752+0000 7f1f427fc700 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e41dd23690 0x55e41dd25a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.753+0000 7f1f427fc700 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e41dd23690 0x55e41dd25a70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d39c1bf78d732597 server_cookie=d87a5791ae3074bf in_seq=0 out_seq=0 2023-07-21T22:30:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.753+0000 7f1f26ff5700 10 client.17196 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.770+0000 7f1f26ff5700 1 -- 172.21.15.151:0/3148406300 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e41dbc1ff0 con 0x55e41dd23690 2023-07-21T22:30:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.770+0000 7f1f26ff5700 10 client.17196 handle_command_reply: tid=0 2023-07-21T22:30:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.770+0000 7f1f5d18db80 1 client.17196 shutdown 2023-07-21T22:30:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.770+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3148406300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 msgr2=0x55e41dcc4550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.770+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcc4550 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f1f340a1e00 tx=0x7f1f340996b0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.770+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3148406300 shutdown_connections 2023-07-21T22:30:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.770+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e41dd23690 0x55e41dd25a70 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.770+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e41dcbb660 0x55e41dcc2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.771+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e41db116b0 0x55e41dcc4550 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.771+0000 7f1f5d18db80 1 --2- 172.21.15.151:0/3148406300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e41dcbb210 0x55e41dcc4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.771+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3148406300 >> 172.21.15.151:0/3148406300 conn(0x55e41dcaaae0 msgr2=0x55e41dcbd910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.771+0000 7f1f26ff5700 0 client.17196 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.771+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3148406300 shutdown_connections 2023-07-21T22:30:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.771+0000 7f1f5d18db80 1 -- 172.21.15.151:0/3148406300 wait complete. 2023-07-21T22:30:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.771+0000 7f1f5d18db80 20 client.17196 trim_cache size 0 max 16384 2023-07-21T22:30:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:30:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:30:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:30:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:30:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 -- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f2c0a1340 msgr2=0x7f1f2c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f2c0a1340 0x7f1f2c0a37f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1f3c003f00 tx=0x7f1f3c004320 comp rx=0 tx=0).stop 2023-07-21T22:30:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 -- 172.21.15.151:0/128397498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f440ffb00 msgr2=0x7f1f440729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f440ffb00 0x7f1f440729f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f1f3400e9a0 tx=0x7f1f3400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 -- 172.21.15.151:0/128397498 shutdown_connections 2023-07-21T22:30:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1f2c0a1340 0x7f1f2c0a37f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1f440ffb00 0x7f1f440729f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1f44105b10 0x7f1f441a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 --2- 172.21.15.151:0/128397498 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1f441004b0 0x7f1f44072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 -- 172.21.15.151:0/128397498 >> 172.21.15.151:0/128397498 conn(0x7f1f440fb600 msgr2=0x7f1f440fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 -- 172.21.15.151:0/128397498 shutdown_connections 2023-07-21T22:30:15.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:15.772+0000 7f1f497ff700 1 -- 172.21.15.151:0/128397498 wait complete. 2023-07-21T22:30:16.087 INFO:teuthology.orchestra.run.smithi151.stderr:46600000 of 50000000 tuples (93%) done (elapsed 639.58 s, remaining 46.66 s) 2023-07-21T22:30:16.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:16 smithi151 ceph-mon[95510]: pgmap v345: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 19 MiB/s wr, 62 op/s 2023-07-21T22:30:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:16 smithi187 ceph-mon[96918]: pgmap v345: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 19 MiB/s wr, 62 op/s 2023-07-21T22:30:16.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:16 smithi195 ceph-mon[97365]: pgmap v345: 97 pgs: 97 active+clean; 9.2 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 19 MiB/s wr, 62 op/s 2023-07-21T22:30:17.302 INFO:teuthology.orchestra.run.smithi151.stderr:46700000 of 50000000 tuples (93%) done (elapsed 640.79 s, remaining 45.28 s) 2023-07-21T22:30:18.522 INFO:teuthology.orchestra.run.smithi151.stderr:46800000 of 50000000 tuples (93%) done (elapsed 642.01 s, remaining 43.90 s) 2023-07-21T22:30:18.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:18 smithi151 ceph-mon[95510]: pgmap v346: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 22 MiB/s wr, 77 op/s 2023-07-21T22:30:18.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:18 smithi187 ceph-mon[96918]: pgmap v346: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 22 MiB/s wr, 77 op/s 2023-07-21T22:30:18.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:18 smithi195 ceph-mon[97365]: pgmap v346: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 22 MiB/s wr, 77 op/s 2023-07-21T22:30:19.867 INFO:teuthology.orchestra.run.smithi151.stderr:46900000 of 50000000 tuples (93%) done (elapsed 643.36 s, remaining 42.52 s) 2023-07-21T22:30:20.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:20 smithi151 ceph-mon[95510]: pgmap v347: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 22 MiB/s wr, 77 op/s 2023-07-21T22:30:20.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:20 smithi187 ceph-mon[96918]: pgmap v347: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 22 MiB/s wr, 77 op/s 2023-07-21T22:30:20.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:20 smithi195 ceph-mon[97365]: pgmap v347: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 22 MiB/s wr, 77 op/s 2023-07-21T22:30:21.119 INFO:teuthology.orchestra.run.smithi151.stderr:47000000 of 50000000 tuples (94%) done (elapsed 644.61 s, remaining 41.15 s) 2023-07-21T22:30:22.350 INFO:teuthology.orchestra.run.smithi151.stderr:47100000 of 50000000 tuples (94%) done (elapsed 645.84 s, remaining 39.77 s) 2023-07-21T22:30:22.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:22 smithi151 ceph-mon[95510]: pgmap v348: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 22 MiB/s wr, 77 op/s 2023-07-21T22:30:22.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:22 smithi187 ceph-mon[96918]: pgmap v348: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 22 MiB/s wr, 77 op/s 2023-07-21T22:30:22.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:22 smithi195 ceph-mon[97365]: pgmap v348: 97 pgs: 97 active+clean; 9.3 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 22 MiB/s wr, 77 op/s 2023-07-21T22:30:23.674 INFO:teuthology.orchestra.run.smithi151.stderr:47200000 of 50000000 tuples (94%) done (elapsed 647.16 s, remaining 38.39 s) 2023-07-21T22:30:24.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:24 smithi151 ceph-mon[95510]: pgmap v349: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 31 MiB/s wr, 102 op/s 2023-07-21T22:30:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:24 smithi187 ceph-mon[96918]: pgmap v349: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 31 MiB/s wr, 102 op/s 2023-07-21T22:30:24.896 INFO:teuthology.orchestra.run.smithi151.stderr:47300000 of 50000000 tuples (94%) done (elapsed 648.39 s, remaining 37.01 s) 2023-07-21T22:30:24.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:24 smithi195 ceph-mon[97365]: pgmap v349: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 31 MiB/s wr, 102 op/s 2023-07-21T22:30:26.132 INFO:teuthology.orchestra.run.smithi151.stderr:47400000 of 50000000 tuples (94%) done (elapsed 649.62 s, remaining 35.63 s) 2023-07-21T22:30:26.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:26 smithi151 ceph-mon[95510]: pgmap v350: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 72 op/s 2023-07-21T22:30:26.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:26 smithi187 ceph-mon[96918]: pgmap v350: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 72 op/s 2023-07-21T22:30:26.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:26 smithi195 ceph-mon[97365]: pgmap v350: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 24 MiB/s wr, 72 op/s 2023-07-21T22:30:27.487 INFO:teuthology.orchestra.run.smithi151.stderr:47500000 of 50000000 tuples (95%) done (elapsed 650.98 s, remaining 34.26 s) 2023-07-21T22:30:28.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:28 smithi151 ceph-mon[95510]: pgmap v351: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 96 op/s 2023-07-21T22:30:28.713 INFO:teuthology.orchestra.run.smithi151.stderr:47600000 of 50000000 tuples (95%) done (elapsed 652.20 s, remaining 32.88 s) 2023-07-21T22:30:28.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:28 smithi187 ceph-mon[96918]: pgmap v351: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 96 op/s 2023-07-21T22:30:28.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:28 smithi195 ceph-mon[97365]: pgmap v351: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 36 MiB/s wr, 96 op/s 2023-07-21T22:30:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.959+0000 7f00a519d700 1 -- 172.21.15.151:0/3513168823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01062b0 msgr2=0x7f00a0067940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.959+0000 7f00a519d700 1 --2- 172.21.15.151:0/3513168823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01062b0 0x7f00a0067940 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0094009990 tx=0x7f0094009ca0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.959+0000 7f00a519d700 1 -- 172.21.15.151:0/3513168823 shutdown_connections 2023-07-21T22:30:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.959+0000 7f00a519d700 1 --2- 172.21.15.151:0/3513168823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00a01059a0 0x7f00a0105d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.959+0000 7f00a519d700 1 --2- 172.21.15.151:0/3513168823 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00a0068070 0x7f00a010c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.959+0000 7f00a519d700 1 --2- 172.21.15.151:0/3513168823 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01062b0 0x7f00a0067940 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.959+0000 7f00a519d700 1 -- 172.21.15.151:0/3513168823 >> 172.21.15.151:0/3513168823 conn(0x7f00a0074770 msgr2=0x7f00a0074b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.959+0000 7f00a519d700 1 -- 172.21.15.151:0/3513168823 shutdown_connections 2023-07-21T22:30:29.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.959+0000 7f00a519d700 1 -- 172.21.15.151:0/3513168823 wait complete. 2023-07-21T22:30:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.960+0000 7f00a519d700 1 Processor -- start 2023-07-21T22:30:29.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.960+0000 7f00a519d700 1 -- start start 2023-07-21T22:30:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f00a519d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00a0068070 0x7f00a0197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f00a519d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01059a0 0x7f00a0198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f00a519d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00a01062b0 0x7f00a019b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f00a519d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019bbd0 con 0x7f00a01059a0 2023-07-21T22:30:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f00a519d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019bd40 con 0x7f00a0068070 2023-07-21T22:30:29.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f00a519d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00a019bf00 con 0x7f00a01062b0 2023-07-21T22:30:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f009f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01059a0 0x7f00a0198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f009f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01059a0 0x7f00a0198220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38724/0 (socket says 172.21.15.151:38724) 2023-07-21T22:30:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f009f7fe700 1 -- 172.21.15.151:0/2567678958 learned_addr learned my addr 172.21.15.151:0/2567678958 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f00a499c700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00a01062b0 0x7f00a019b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.961+0000 7f009ffff700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00a0068070 0x7f00a0197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f009f7fe700 1 -- 172.21.15.151:0/2567678958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00a01062b0 msgr2=0x7f00a019b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:29.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f009f7fe700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00a01062b0 0x7f00a019b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f009f7fe700 1 -- 172.21.15.151:0/2567678958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00a0068070 msgr2=0x7f00a0197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f009f7fe700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00a0068070 0x7f00a0197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f009f7fe700 1 -- 172.21.15.151:0/2567678958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00940095f0 con 0x7f00a01059a0 2023-07-21T22:30:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f009f7fe700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01059a0 0x7f00a0198220 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f00940098e0 tx=0x7f0094004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:29.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f009d7fa700 1 -- 172.21.15.151:0/2567678958 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009401d070 con 0x7f00a01059a0 2023-07-21T22:30:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f009d7fa700 1 -- 172.21.15.151:0/2567678958 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0094022470 con 0x7f00a01059a0 2023-07-21T22:30:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f00a519d700 1 -- 172.21.15.151:0/2567678958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00a019c180 con 0x7f00a01059a0 2023-07-21T22:30:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f009d7fa700 1 -- 172.21.15.151:0/2567678958 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094017650 con 0x7f00a01059a0 2023-07-21T22:30:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.962+0000 7f00a519d700 1 -- 172.21.15.151:0/2567678958 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a01a4b40 con 0x7f00a01059a0 2023-07-21T22:30:29.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.966+0000 7f009d7fa700 1 -- 172.21.15.151:0/2567678958 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f00940225e0 con 0x7f00a01059a0 2023-07-21T22:30:29.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.968+0000 7f009d7fa700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f00880a1340 0x7f00880a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.968+0000 7f00b9dedb80 1 Processor -- start 2023-07-21T22:30:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.968+0000 7f009d7fa700 1 -- 172.21.15.151:0/2567678958 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f00940ce060 con 0x7f00a01059a0 2023-07-21T22:30:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.968+0000 7f009ffff700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f00880a1340 0x7f00880a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.968+0000 7f00b9dedb80 1 -- start start 2023-07-21T22:30:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 0x55e3d2b50750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b50c90 0x55e3d2b4a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2a47c50 con 0x55e3d2b4adf0 2023-07-21T22:30:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2a9a9e0 con 0x55e3d299e6b0 2023-07-21T22:30:29.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2a93e70 con 0x55e3d2b50c90 2023-07-21T22:30:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009ffff700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f00880a1340 0x7f00880a37f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0090009be0 tx=0x7f0090009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b50c90 0x55e3d2b4a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 0x55e3d2b50750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b50c90 0x55e3d2b4a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35966/0 (socket says 172.21.15.151:35966) 2023-07-21T22:30:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009f7fe700 1 -- 172.21.15.151:0/402469854 learned_addr learned my addr 172.21.15.151:0/402469854 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f00a499c700 1 --2- 172.21.15.151:0/402469854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009f7fe700 1 -- 172.21.15.151:0/402469854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 msgr2=0x55e3d2b50750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009f7fe700 1 --2- 172.21.15.151:0/402469854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 0x55e3d2b50750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009f7fe700 1 -- 172.21.15.151:0/402469854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 msgr2=0x55e3d2b4b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009f7fe700 1 --2- 172.21.15.151:0/402469854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.969+0000 7f009f7fe700 1 -- 172.21.15.151:0/402469854 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3d28c1d80 con 0x55e3d2b50c90 2023-07-21T22:30:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.970+0000 7f009f7fe700 1 --2- 172.21.15.151:0/402469854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b50c90 0x55e3d2b4a8b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0094097bf0 tx=0x7f009409afd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5ce8b4edf00cb94 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.970+0000 7f00867fc700 1 -- 172.21.15.151:0/402469854 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009409aae0 con 0x55e3d2b50c90 2023-07-21T22:30:29.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.970+0000 7f00867fc700 1 -- 172.21.15.151:0/402469854 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00940228c0 con 0x55e3d2b50c90 2023-07-21T22:30:29.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.970+0000 7f00867fc700 1 -- 172.21.15.151:0/402469854 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009409b640 con 0x55e3d2b50c90 2023-07-21T22:30:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.971+0000 7f00b9dedb80 1 -- 172.21.15.151:0/402469854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b50c90 msgr2=0x55e3d2b4a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:29.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.971+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/402469854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b50c90 0x55e3d2b4a8b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0094097bf0 tx=0x7f009409afd0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.971+0000 7f00b9dedb80 1 -- 172.21.15.151:0/402469854 shutdown_connections 2023-07-21T22:30:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.971+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/402469854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 0x55e3d2b50750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.971+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/402469854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.971+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/402469854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b50c90 0x55e3d2b4a8b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.971+0000 7f00b9dedb80 1 -- 172.21.15.151:0/402469854 >> 172.21.15.151:0/402469854 conn(0x55e3d2b37c40 msgr2=0x55e3d2b3d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.971+0000 7f00b9dedb80 1 -- 172.21.15.151:0/402469854 shutdown_connections 2023-07-21T22:30:29.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.971+0000 7f00b9dedb80 1 -- 172.21.15.151:0/402469854 wait complete. 2023-07-21T22:30:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.972+0000 7f00b9dedb80 1 -- start start 2023-07-21T22:30:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.972+0000 7f00b9dedb80 1 Processor -- start 2023-07-21T22:30:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.972+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b59c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.972+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b5a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.972+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 0x55e3d2b53e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.972+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2a33a60 con 0x55e3d2b4adf0 2023-07-21T22:30:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.972+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2a33760 con 0x55e3d2b50c90 2023-07-21T22:30:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.972+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d29178c0 con 0x55e3d299e6b0 2023-07-21T22:30:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.972+0000 7f00b9dedb80 10 client.0 _ll_register_callbacks cb 0x55e3d2a31700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b59c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b5a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b59c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35978/0 (socket says 172.21.15.151:35978) 2023-07-21T22:30:29.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009ffff700 1 -- 172.21.15.151:0/2420178591 learned_addr learned my addr 172.21.15.151:0/2420178591 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f00a499c700 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 0x55e3d2b53e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009ffff700 1 -- 172.21.15.151:0/2420178591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 msgr2=0x55e3d2b53e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009ffff700 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 0x55e3d2b53e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009ffff700 1 -- 172.21.15.151:0/2420178591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 msgr2=0x55e3d2b5a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009ffff700 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b5a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009ffff700 1 -- 172.21.15.151:0/2420178591 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00a01a4b40 con 0x55e3d299e6b0 2023-07-21T22:30:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f00a499c700 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 0x55e3d2b53e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:30:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009f7fe700 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:30:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.973+0000 7f009ffff700 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b59c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f009001f870 tx=0x7f00900047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4cbabb2fbbfc66 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.974+0000 7f007f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:30:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.974+0000 7f007f7fe700 1 -- 172.21.15.151:0/2420178591 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0090004260 con 0x55e3d299e6b0 2023-07-21T22:30:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.974+0000 7f007f7fe700 1 -- 172.21.15.151:0/2420178591 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f00900043c0 con 0x55e3d299e6b0 2023-07-21T22:30:29.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.974+0000 7f00b9dedb80 1 -- 172.21.15.151:0/2420178591 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e3d29ed490 con 0x55e3d299e6b0 2023-07-21T22:30:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.974+0000 7f007f7fe700 1 -- 172.21.15.151:0/2420178591 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0090004580 con 0x55e3d299e6b0 2023-07-21T22:30:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.974+0000 7f00b9dedb80 10 client.26932 fetch_fsmap learned FSMap version 48 2023-07-21T22:30:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.974+0000 7f00b9dedb80 1 -- 172.21.15.151:0/2420178591 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55e3d28aac00 con 0x55e3d299e6b0 2023-07-21T22:30:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.974+0000 7f007f7fe700 1 -- 172.21.15.151:0/2420178591 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e3d29ed490 con 0x55e3d299e6b0 2023-07-21T22:30:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.975+0000 7f007f7fe700 1 -- 172.21.15.151:0/2420178591 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 48) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f0090005590 con 0x55e3d299e6b0 2023-07-21T22:30:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.975+0000 7f00b9dedb80 10 client.26932 fetch_fsmap finished waiting for FSMap version 48 2023-07-21T22:30:29.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.975+0000 7f00b9dedb80 10 client.26932 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.975+0000 7f00b9dedb80 20 client.26932 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.975+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e3d2b641a0 0x55e3d2b665b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.975+0000 7f00b9dedb80 4 client.26932 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:30:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.975+0000 7f00b9dedb80 1 -- 172.21.15.151:0/2420178591 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e3d2a8ce50 con 0x55e3d2b641a0 2023-07-21T22:30:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.975+0000 7f009f7fe700 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e3d2b641a0 0x55e3d2b665b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.976+0000 7f007f7fe700 10 client.26932 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:29.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.976+0000 7f009f7fe700 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e3d2b641a0 0x55e3d2b665b0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bd46ba7867e05fac server_cookie=131117ed422fc85d in_seq=0 out_seq=0 2023-07-21T22:30:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.976+0000 7f007f7fe700 1 -- 172.21.15.151:0/2420178591 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e3d2a8ce50 con 0x55e3d2b641a0 2023-07-21T22:30:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.976+0000 7f007f7fe700 10 client.26932 handle_command_reply: tid=0 2023-07-21T22:30:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 client.26932 shutdown 2023-07-21T22:30:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 -- 172.21.15.151:0/2420178591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 msgr2=0x55e3d2b59c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b59c00 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f009001f870 tx=0x7f00900047c0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 -- 172.21.15.151:0/2420178591 shutdown_connections 2023-07-21T22:30:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e3d2b641a0 0x55e3d2b665b0 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 0x55e3d2b53e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b59c00 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/2420178591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f007f7fe700 0 client.26932 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 -- 172.21.15.151:0/2420178591 >> 172.21.15.151:0/2420178591 conn(0x55e3d2b37c40 msgr2=0x55e3d2b41090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 -- 172.21.15.151:0/2420178591 shutdown_connections 2023-07-21T22:30:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 1 -- 172.21.15.151:0/2420178591 wait complete. 2023-07-21T22:30:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.977+0000 7f00b9dedb80 20 client.26932 trim_cache size 0 max 16384 2023-07-21T22:30:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.995+0000 7f00b9dedb80 1 Processor -- start 2023-07-21T22:30:29.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.995+0000 7f00b9dedb80 1 -- start start 2023-07-21T22:30:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.995+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 0x55e3d2b4d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.995+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.995+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b50c90 0x55e3d2b51260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.995+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d29ed490 con 0x55e3d2b50c90 2023-07-21T22:30:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.995+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2b39d60 con 0x55e3d299e6b0 2023-07-21T22:30:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.995+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2b3e010 con 0x55e3d2b4adf0 2023-07-21T22:30:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35984/0 (socket says 172.21.15.151:35984) 2023-07-21T22:30:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009f7fe700 1 -- 172.21.15.151:0/1477461698 learned_addr learned my addr 172.21.15.151:0/1477461698 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f00a499c700 1 --2- 172.21.15.151:0/1477461698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b50c90 0x55e3d2b51260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009ffff700 1 --2- 172.21.15.151:0/1477461698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 0x55e3d2b4d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009f7fe700 1 -- 172.21.15.151:0/1477461698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 msgr2=0x55e3d2b4d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009f7fe700 1 --2- 172.21.15.151:0/1477461698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 0x55e3d2b4d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009f7fe700 1 -- 172.21.15.151:0/1477461698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b50c90 msgr2=0x55e3d2b51260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:29.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009f7fe700 1 --2- 172.21.15.151:0/1477461698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b50c90 0x55e3d2b51260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009f7fe700 1 -- 172.21.15.151:0/1477461698 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e3d28e81f0 con 0x55e3d2b4adf0 2023-07-21T22:30:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.996+0000 7f009f7fe700 1 --2- 172.21.15.151:0/1477461698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4d650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0094097bf0 tx=0x7f0094096e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d981ca284a0208a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.997+0000 7f0086ffd700 1 -- 172.21.15.151:0/1477461698 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009409b180 con 0x55e3d2b4adf0 2023-07-21T22:30:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.997+0000 7f0086ffd700 1 -- 172.21.15.151:0/1477461698 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f009409f1b0 con 0x55e3d2b4adf0 2023-07-21T22:30:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.997+0000 7f0086ffd700 1 -- 172.21.15.151:0/1477461698 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00940a30b0 con 0x55e3d2b4adf0 2023-07-21T22:30:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.997+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1477461698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b4adf0 msgr2=0x55e3d2b4d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.997+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1477461698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4d650 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f0094097bf0 tx=0x7f0094096e30 comp rx=0 tx=0).stop 2023-07-21T22:30:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.998+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1477461698 shutdown_connections 2023-07-21T22:30:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.998+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1477461698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d299e6b0 0x55e3d2b4d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.998+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1477461698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b50c90 0x55e3d2b51260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.998+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1477461698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b4d650 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.998+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1477461698 >> 172.21.15.151:0/1477461698 conn(0x55e3d2b37c40 msgr2=0x55e3d2b3ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.998+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1477461698 shutdown_connections 2023-07-21T22:30:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.998+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1477461698 wait complete. 2023-07-21T22:30:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.998+0000 7f00b9dedb80 1 -- start start 2023-07-21T22:30:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.998+0000 7f00b9dedb80 1 Processor -- start 2023-07-21T22:30:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b57890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b57dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f00b9dedb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 0x55e3d2bb7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2b58560 con 0x55e3d2b4adf0 2023-07-21T22:30:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2b586d0 con 0x55e3d2b50c90 2023-07-21T22:30:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f00b9dedb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e3d2bb75a0 con 0x55e3d299e6b0 2023-07-21T22:30:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f00b9dedb80 10 client.0 _ll_register_callbacks cb 0x7f009001f430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f009f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b57dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f009f7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b57dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38764/0 (socket says 172.21.15.151:38764) 2023-07-21T22:30:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:28.999+0000 7f009f7fe700 1 -- 172.21.15.151:0/1647144312 learned_addr learned my addr 172.21.15.151:0/1647144312 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f009ffff700 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b57890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f00a499c700 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 0x55e3d2bb7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f009f7fe700 1 -- 172.21.15.151:0/1647144312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 msgr2=0x55e3d2b57890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f009f7fe700 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b57890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f009f7fe700 1 -- 172.21.15.151:0/1647144312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 msgr2=0x55e3d2bb7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f009f7fe700 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 0x55e3d2bb7060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f009f7fe700 1 -- 172.21.15.151:0/1647144312 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e3d28c1d80 con 0x55e3d2b4adf0 2023-07-21T22:30:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f009f7fe700 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b57dd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f0094022a50 tx=0x7f009400b370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0a520a00f9a60a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:29.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f007f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:30:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.000+0000 7f007f7fe700 1 -- 172.21.15.151:0/1647144312 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009409b180 con 0x55e3d2b4adf0 2023-07-21T22:30:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1647144312 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f00940228c0 con 0x55e3d2b4adf0 2023-07-21T22:30:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f007f7fe700 1 -- 172.21.15.151:0/1647144312 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f00940a3540 con 0x55e3d2b4adf0 2023-07-21T22:30:29.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f007f7fe700 1 -- 172.21.15.151:0/1647144312 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) v2 ==== 24+0+0 (secure 0 0 0) 0x7f009409b3e0 con 0x55e3d2b4adf0 2023-07-21T22:30:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f00b9dedb80 10 client.17214 fetch_fsmap learned FSMap version 48 2023-07-21T22:30:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1647144312 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) v3 -- 0x55e3d28c0250 con 0x55e3d2b4adf0 2023-07-21T22:30:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f007f7fe700 1 -- 172.21.15.151:0/1647144312 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f00940228c0 con 0x55e3d2b4adf0 2023-07-21T22:30:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f007f7fe700 1 -- 172.21.15.151:0/1647144312 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 48) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f00940b9170 con 0x55e3d2b4adf0 2023-07-21T22:30:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f00b9dedb80 10 client.17214 fetch_fsmap finished waiting for FSMap version 48 2023-07-21T22:30:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f00b9dedb80 10 client.17214 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:29.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f00b9dedb80 20 client.17214 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e3d2bb8800 0x55e3d2bbabe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f00b9dedb80 4 client.17214 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:30:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.001+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1647144312 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e3d2a4eff0 con 0x55e3d2bb8800 2023-07-21T22:30:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.002+0000 7f009ffff700 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e3d2bb8800 0x55e3d2bbabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.002+0000 7f009ffff700 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e3d2bb8800 0x55e3d2bbabe0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0b4280cc49603cc server_cookie=7d7fc56fa8f92b5a in_seq=0 out_seq=0 2023-07-21T22:30:29.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.002+0000 7f007f7fe700 10 client.17214 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:29.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.018+0000 7f007f7fe700 1 -- 172.21.15.151:0/1647144312 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e3d2a4eff0 con 0x55e3d2bb8800 2023-07-21T22:30:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.018+0000 7f007f7fe700 10 client.17214 handle_command_reply: tid=0 2023-07-21T22:30:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.018+0000 7f00b9dedb80 1 client.17214 shutdown 2023-07-21T22:30:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1647144312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 msgr2=0x55e3d2b57dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b57dd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f0094022a50 tx=0x7f009400b370 comp rx=0 tx=0).stop 2023-07-21T22:30:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1647144312 shutdown_connections 2023-07-21T22:30:29.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e3d2bb8800 0x55e3d2bbabe0 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e3d2b50c90 0x55e3d2bb7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e3d299e6b0 0x55e3d2b57890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 --2- 172.21.15.151:0/1647144312 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e3d2b4adf0 0x55e3d2b57dd0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f007f7fe700 0 client.17214 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1647144312 >> 172.21.15.151:0/1647144312 conn(0x55e3d2b37c40 msgr2=0x55e3d2b536e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1647144312 shutdown_connections 2023-07-21T22:30:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 1 -- 172.21.15.151:0/1647144312 wait complete. 2023-07-21T22:30:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.019+0000 7f00b9dedb80 20 client.17214 trim_cache size 0 max 16384 2023-07-21T22:30:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:30:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:30:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:30:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:30:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 -- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f00880a1340 msgr2=0x7f00880a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f00880a1340 0x7f00880a37f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0090009be0 tx=0x7f0090009260 comp rx=0 tx=0).stop 2023-07-21T22:30:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 -- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01059a0 msgr2=0x7f00a0198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01059a0 0x7f00a0198220 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f00940098e0 tx=0x7f0094004730 comp rx=0 tx=0).stop 2023-07-21T22:30:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 -- 172.21.15.151:0/2567678958 shutdown_connections 2023-07-21T22:30:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f00880a1340 0x7f00880a37f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00a0068070 0x7f00a0197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f00a01062b0 0x7f00a019b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 --2- 172.21.15.151:0/2567678958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a01059a0 0x7f00a0198220 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:29.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 -- 172.21.15.151:0/2567678958 >> 172.21.15.151:0/2567678958 conn(0x7f00a0074770 msgr2=0x7f00a00fcf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:29.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 -- 172.21.15.151:0/2567678958 shutdown_connections 2023-07-21T22:30:29.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:29.020+0000 7f00a519d700 1 -- 172.21.15.151:0/2567678958 wait complete. 2023-07-21T22:30:29.958 INFO:teuthology.orchestra.run.smithi151.stderr:47700000 of 50000000 tuples (95%) done (elapsed 653.45 s, remaining 31.51 s) 2023-07-21T22:30:30.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:30 smithi151 ceph-mon[95510]: pgmap v352: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 58 op/s 2023-07-21T22:30:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:30 smithi187 ceph-mon[96918]: pgmap v352: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 58 op/s 2023-07-21T22:30:30.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:30 smithi195 ceph-mon[97365]: pgmap v352: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 58 op/s 2023-07-21T22:30:31.192 INFO:teuthology.orchestra.run.smithi151.stderr:47800000 of 50000000 tuples (95%) done (elapsed 654.68 s, remaining 30.13 s) 2023-07-21T22:30:32.449 INFO:teuthology.orchestra.run.smithi151.stderr:47900000 of 50000000 tuples (95%) done (elapsed 655.94 s, remaining 28.76 s) 2023-07-21T22:30:32.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:32 smithi151 ceph-mon[95510]: pgmap v353: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 58 op/s 2023-07-21T22:30:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:32 smithi187 ceph-mon[96918]: pgmap v353: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 58 op/s 2023-07-21T22:30:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:32 smithi195 ceph-mon[97365]: pgmap v353: 97 pgs: 97 active+clean; 9.4 GiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 58 op/s 2023-07-21T22:30:33.792 INFO:teuthology.orchestra.run.smithi151.stderr:48000000 of 50000000 tuples (96%) done (elapsed 657.28 s, remaining 27.39 s) 2023-07-21T22:30:34.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:34 smithi151 ceph-mon[95510]: pgmap v354: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:30:34.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:34 smithi187 ceph-mon[96918]: pgmap v354: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:30:34.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:34 smithi195 ceph-mon[97365]: pgmap v354: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 36 MiB/s wr, 86 op/s 2023-07-21T22:30:35.018 INFO:teuthology.orchestra.run.smithi151.stderr:48100000 of 50000000 tuples (96%) done (elapsed 658.51 s, remaining 26.01 s) 2023-07-21T22:30:36.255 INFO:teuthology.orchestra.run.smithi151.stderr:48200000 of 50000000 tuples (96%) done (elapsed 659.75 s, remaining 24.64 s) 2023-07-21T22:30:36.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:36 smithi187 ceph-mon[96918]: pgmap v355: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 51 op/s 2023-07-21T22:30:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:36 smithi195 ceph-mon[97365]: pgmap v355: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 51 op/s 2023-07-21T22:30:36.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:36 smithi151 ceph-mon[95510]: pgmap v355: 97 pgs: 97 active+clean; 9.5 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 24 MiB/s wr, 51 op/s 2023-07-21T22:30:37.705 INFO:teuthology.orchestra.run.smithi151.stderr:48300000 of 50000000 tuples (96%) done (elapsed 661.20 s, remaining 23.27 s) 2023-07-21T22:30:37.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:30:37.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:30:37.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:30:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:38 smithi187 ceph-mon[96918]: pgmap v356: 97 pgs: 97 active+clean; 9.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 MiB/s wr, 88 op/s 2023-07-21T22:30:38.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:38 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:38 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:38 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:38 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:38 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:38 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:38 smithi195 ceph-mon[97365]: pgmap v356: 97 pgs: 97 active+clean; 9.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 MiB/s wr, 88 op/s 2023-07-21T22:30:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:38 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:38 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:38 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:38 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:38 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:38 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:38 smithi151 ceph-mon[95510]: pgmap v356: 97 pgs: 97 active+clean; 9.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 35 MiB/s wr, 88 op/s 2023-07-21T22:30:38.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:38 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:38 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:38 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:38 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:38 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:38.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:38 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:39.062 INFO:teuthology.orchestra.run.smithi151.stderr:48400000 of 50000000 tuples (96%) done (elapsed 662.55 s, remaining 21.90 s) 2023-07-21T22:30:39.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:39 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:30:39.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:39 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:30:39.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:39 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:39.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:39 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:30:39.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:39 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:30:39.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:39 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:39.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:39 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:30:39.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:39 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:30:39.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:39 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:30:40.336 INFO:teuthology.orchestra.run.smithi151.stderr:48500000 of 50000000 tuples (97%) done (elapsed 663.83 s, remaining 20.53 s) 2023-07-21T22:30:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:40 smithi187 ceph-mon[96918]: pgmap v357: 97 pgs: 97 active+clean; 9.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:30:40.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:40 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:40 smithi195 ceph-mon[97365]: pgmap v357: 97 pgs: 97 active+clean; 9.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:30:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:40 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:40.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:40 smithi151 ceph-mon[95510]: pgmap v357: 97 pgs: 97 active+clean; 9.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:30:40.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:40 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:41.669 INFO:teuthology.orchestra.run.smithi151.stderr:48600000 of 50000000 tuples (97%) done (elapsed 665.16 s, remaining 19.16 s) 2023-07-21T22:30:42.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.181+0000 7f6c33fff700 1 -- 172.21.15.151:0/2432810766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c100760 msgr2=0x7f6c2c104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:42.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.181+0000 7f6c33fff700 1 --2- 172.21.15.151:0/2432810766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c100760 0x7f6c2c104720 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0098f0 tx=0x7f6c1c009c00 comp rx=0 tx=0).stop 2023-07-21T22:30:42.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.181+0000 7f6c33fff700 1 -- 172.21.15.151:0/2432810766 shutdown_connections 2023-07-21T22:30:42.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.181+0000 7f6c33fff700 1 --2- 172.21.15.151:0/2432810766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c2c104e00 0x7f6c2c10c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.181+0000 7f6c33fff700 1 --2- 172.21.15.151:0/2432810766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c2c0ffdc0 0x7f6c2c100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.181+0000 7f6c33fff700 1 --2- 172.21.15.151:0/2432810766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c100760 0x7f6c2c104720 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.181+0000 7f6c33fff700 1 -- 172.21.15.151:0/2432810766 >> 172.21.15.151:0/2432810766 conn(0x7f6c2c0fb650 msgr2=0x7f6c2c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:42.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.181+0000 7f6c33fff700 1 -- 172.21.15.151:0/2432810766 shutdown_connections 2023-07-21T22:30:42.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.181+0000 7f6c33fff700 1 -- 172.21.15.151:0/2432810766 wait complete. 2023-07-21T22:30:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.182+0000 7f6c33fff700 1 Processor -- start 2023-07-21T22:30:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c33fff700 1 -- start start 2023-07-21T22:30:42.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c33fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c2c0ffdc0 0x7f6c2c19bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c33fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c2c100760 0x7f6c2c19c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c33fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c104e00 0x7f6c2c195a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c33fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c196080 con 0x7f6c2c100760 2023-07-21T22:30:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c33fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c1961f0 con 0x7f6c2c104e00 2023-07-21T22:30:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c33fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c2c1963b0 con 0x7f6c2c0ffdc0 2023-07-21T22:30:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c3159a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c2c100760 0x7f6c2c19c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c3159a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c2c100760 0x7f6c2c19c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35954/0 (socket says 172.21.15.151:35954) 2023-07-21T22:30:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c3159a700 1 -- 172.21.15.151:0/320713063 learned_addr learned my addr 172.21.15.151:0/320713063 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.183+0000 7f6c31d9b700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c2c0ffdc0 0x7f6c2c19bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c3259c700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c104e00 0x7f6c2c195a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c3159a700 1 -- 172.21.15.151:0/320713063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c2c0ffdc0 msgr2=0x7f6c2c19bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c3159a700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c2c0ffdc0 0x7f6c2c19bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c3159a700 1 -- 172.21.15.151:0/320713063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c104e00 msgr2=0x7f6c2c195a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c3159a700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c104e00 0x7f6c2c195a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c3159a700 1 -- 172.21.15.151:0/320713063 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c1c009520 con 0x7f6c2c100760 2023-07-21T22:30:42.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c3259c700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c104e00 0x7f6c2c195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:30:42.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c3159a700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c2c100760 0x7f6c2c19c0f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c005e90 tx=0x7f6c1c00b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c22ffd700 1 -- 172.21.15.151:0/320713063 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c00ba90 con 0x7f6c2c100760 2023-07-21T22:30:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c22ffd700 1 -- 172.21.15.151:0/320713063 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c1c0054d0 con 0x7f6c2c100760 2023-07-21T22:30:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c33fff700 1 -- 172.21.15.151:0/320713063 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c2c196630 con 0x7f6c2c100760 2023-07-21T22:30:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c22ffd700 1 -- 172.21.15.151:0/320713063 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c003df0 con 0x7f6c2c100760 2023-07-21T22:30:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.184+0000 7f6c33fff700 1 -- 172.21.15.151:0/320713063 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2c1a2ba0 con 0x7f6c2c100760 2023-07-21T22:30:42.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.188+0000 7f6c22ffd700 1 -- 172.21.15.151:0/320713063 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6c1c005040 con 0x7f6c2c100760 2023-07-21T22:30:42.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.189+0000 7f6c47857b80 1 Processor -- start 2023-07-21T22:30:42.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.189+0000 7f6c47857b80 1 -- start start 2023-07-21T22:30:42.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 0x55e97358acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973584f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e9735854a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c47857b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97348ac50 con 0x55e97358b210 2023-07-21T22:30:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c47857b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9734dd9e0 con 0x55e97358b660 2023-07-21T22:30:42.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c47857b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9734d6e70 con 0x55e9733e16b0 2023-07-21T22:30:42.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c22ffd700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6c180a1340 0x7f6c180a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c31d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973584f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c31d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973584f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35958/0 (socket says 172.21.15.151:35958) 2023-07-21T22:30:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c31d9b700 1 -- 172.21.15.151:0/1963985040 learned_addr learned my addr 172.21.15.151:0/1963985040 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c22ffd700 1 -- 172.21.15.151:0/320713063 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6c1c0cdf70 con 0x7f6c2c100760 2023-07-21T22:30:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c3159a700 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e9735854a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c3259c700 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 0x55e97358acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.190+0000 7f6c3259c700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6c180a1340 0x7f6c180a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c3159a700 1 -- 172.21.15.151:0/1963985040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 msgr2=0x55e97358acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:42.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c3159a700 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 0x55e97358acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c3159a700 1 -- 172.21.15.151:0/1963985040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 msgr2=0x55e973584f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:42.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c3159a700 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973584f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c3159a700 1 -- 172.21.15.151:0/1963985040 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e973304d80 con 0x55e97358b660 2023-07-21T22:30:42.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c31d9b700 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973584f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:30:42.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c3159a700 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e9735854a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0cb680 tx=0x7f6c1c09a9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=99a57d3218e92f99 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:42.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c3259c700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6c180a1340 0x7f6c180a37f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009fd0 tx=0x7f6c2400b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:42.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c17fff700 1 -- 172.21.15.151:0/1963985040 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c09f0c0 con 0x55e97358b660 2023-07-21T22:30:42.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c17fff700 1 -- 172.21.15.151:0/1963985040 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c1c0a3450 con 0x55e97358b660 2023-07-21T22:30:42.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.191+0000 7f6c17fff700 1 -- 172.21.15.151:0/1963985040 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c0cb900 con 0x55e97358b660 2023-07-21T22:30:42.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.192+0000 7f6c47857b80 1 -- 172.21.15.151:0/1963985040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 msgr2=0x55e9735854a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:42.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.192+0000 7f6c47857b80 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e9735854a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c0cb680 tx=0x7f6c1c09a9f0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.192+0000 7f6c47857b80 1 -- 172.21.15.151:0/1963985040 shutdown_connections 2023-07-21T22:30:42.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.192+0000 7f6c47857b80 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e9735854a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.192+0000 7f6c47857b80 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 0x55e97358acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.192+0000 7f6c47857b80 1 --2- 172.21.15.151:0/1963985040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973584f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.192+0000 7f6c47857b80 1 -- 172.21.15.151:0/1963985040 >> 172.21.15.151:0/1963985040 conn(0x55e97357aae0 msgr2=0x55e9735800e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:42.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.192+0000 7f6c47857b80 1 -- 172.21.15.151:0/1963985040 shutdown_connections 2023-07-21T22:30:42.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.192+0000 7f6c47857b80 1 -- 172.21.15.151:0/1963985040 wait complete. 2023-07-21T22:30:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.193+0000 7f6c47857b80 1 -- start start 2023-07-21T22:30:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.193+0000 7f6c47857b80 1 Processor -- start 2023-07-21T22:30:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9733e16b0 0x55e973594250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973594790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e97358b660 0x55e97358e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c47857b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e973476a60 con 0x55e97358b210 2023-07-21T22:30:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c47857b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e973476760 con 0x55e9733e16b0 2023-07-21T22:30:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c47857b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97335a8c0 con 0x55e97358b660 2023-07-21T22:30:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c47857b80 10 client.0 _ll_register_callbacks cb 0x55e973474700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c3159a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973594790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c3159a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973594790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35974/0 (socket says 172.21.15.151:35974) 2023-07-21T22:30:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c3159a700 1 -- 172.21.15.151:0/3058477527 learned_addr learned my addr 172.21.15.151:0/3058477527 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c31d9b700 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9733e16b0 0x55e973594250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c3159a700 1 -- 172.21.15.151:0/3058477527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e97358b660 msgr2=0x55e97358e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c3159a700 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e97358b660 0x55e97358e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c3159a700 1 -- 172.21.15.151:0/3058477527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9733e16b0 msgr2=0x55e973594250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c3159a700 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9733e16b0 0x55e973594250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.194+0000 7f6c3159a700 1 -- 172.21.15.151:0/3058477527 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c2800b9a0 con 0x55e97358b210 2023-07-21T22:30:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.195+0000 7f6c3159a700 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973594790 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009810 tx=0x7f6c1c09f190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c2babf0fdd7606 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.195+0000 7f6c157fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:30:42.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.195+0000 7f6c157fa700 1 -- 172.21.15.151:0/3058477527 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c0cb900 con 0x55e97358b210 2023-07-21T22:30:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.195+0000 7f6c157fa700 1 -- 172.21.15.151:0/3058477527 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6c1c0cba60 con 0x55e97358b210 2023-07-21T22:30:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.195+0000 7f6c47857b80 1 -- 172.21.15.151:0/3058477527 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e973430490 con 0x55e97358b210 2023-07-21T22:30:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.195+0000 7f6c157fa700 1 -- 172.21.15.151:0/3058477527 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c1c0cb2f0 con 0x55e97358b210 2023-07-21T22:30:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.195+0000 7f6c47857b80 10 client.17226 fetch_fsmap learned FSMap version 49 2023-07-21T22:30:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.195+0000 7f6c47857b80 1 -- 172.21.15.151:0/3058477527 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x7f6c2c1a2ba0 con 0x55e97358b210 2023-07-21T22:30:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.196+0000 7f6c157fa700 1 -- 172.21.15.151:0/3058477527 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e973430490 con 0x55e97358b210 2023-07-21T22:30:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.196+0000 7f6c157fa700 1 -- 172.21.15.151:0/3058477527 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6c1c09b440 con 0x55e97358b210 2023-07-21T22:30:42.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.196+0000 7f6c47857b80 10 client.17226 fetch_fsmap finished waiting for FSMap version 49 2023-07-21T22:30:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.196+0000 7f6c47857b80 10 client.17226 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.196+0000 7f6c47857b80 20 client.17226 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.196+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e97359e370 0x55e9735a0780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.196+0000 7f6c47857b80 4 client.17226 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:30:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.196+0000 7f6c47857b80 1 -- 172.21.15.151:0/3058477527 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9734cfe50 con 0x55e97359e370 2023-07-21T22:30:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.196+0000 7f6c31d9b700 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e97359e370 0x55e9735a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.197+0000 7f6c31d9b700 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e97359e370 0x55e9735a0780 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a12f6fdcddf6ddc3 server_cookie=ada4b6447ae47c9b in_seq=0 out_seq=0 2023-07-21T22:30:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.197+0000 7f6c157fa700 10 client.17226 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c157fa700 1 -- 172.21.15.151:0/3058477527 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e9734cfe50 con 0x55e97359e370 2023-07-21T22:30:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c157fa700 10 client.17226 handle_command_reply: tid=0 2023-07-21T22:30:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 client.17226 shutdown 2023-07-21T22:30:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 -- 172.21.15.151:0/3058477527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 msgr2=0x55e973594790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:42.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973594790 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009810 tx=0x7f6c1c09f190 comp rx=0 tx=0).stop 2023-07-21T22:30:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 -- 172.21.15.151:0/3058477527 shutdown_connections 2023-07-21T22:30:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e97359e370 0x55e9735a0780 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e9733e16b0 0x55e973594250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e97358b660 0x55e97358e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3058477527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973594790 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 -- 172.21.15.151:0/3058477527 >> 172.21.15.151:0/3058477527 conn(0x55e97357aae0 msgr2=0x55e97357f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c157fa700 0 client.17226 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:42.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 -- 172.21.15.151:0/3058477527 shutdown_connections 2023-07-21T22:30:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.198+0000 7f6c47857b80 1 -- 172.21.15.151:0/3058477527 wait complete. 2023-07-21T22:30:42.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.199+0000 7f6c47857b80 20 client.17226 trim_cache size 0 max 16384 2023-07-21T22:30:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.221+0000 7f6c47857b80 1 Processor -- start 2023-07-21T22:30:42.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.221+0000 7f6c47857b80 1 -- start start 2023-07-21T22:30:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9733e16b0 0x55e973587740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e97358b210 0x55e973587c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e97357fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c47857b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9735881c0 con 0x55e9733e16b0 2023-07-21T22:30:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c47857b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e97358fa80 con 0x55e97358b660 2023-07-21T22:30:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c47857b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e973580f30 con 0x55e97358b210 2023-07-21T22:30:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c31d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9733e16b0 0x55e973587740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c3259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e97357fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c3259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e97357fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:32790/0 (socket says 172.21.15.151:32790) 2023-07-21T22:30:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c31d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9733e16b0 0x55e973587740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35990/0 (socket says 172.21.15.151:35990) 2023-07-21T22:30:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c3259c700 1 -- 172.21.15.151:0/4039467435 learned_addr learned my addr 172.21.15.151:0/4039467435 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.222+0000 7f6c3159a700 1 --2- 172.21.15.151:0/4039467435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e97358b210 0x55e973587c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.223+0000 7f6c3259c700 1 -- 172.21.15.151:0/4039467435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e97358b210 msgr2=0x55e973587c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.223+0000 7f6c3259c700 1 --2- 172.21.15.151:0/4039467435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e97358b210 0x55e973587c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.223+0000 7f6c3259c700 1 -- 172.21.15.151:0/4039467435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9733e16b0 msgr2=0x55e973587740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.223+0000 7f6c3259c700 1 --2- 172.21.15.151:0/4039467435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9733e16b0 0x55e973587740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.223+0000 7f6c3259c700 1 -- 172.21.15.151:0/4039467435 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e97358e730 con 0x55e97358b660 2023-07-21T22:30:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.223+0000 7f6c3259c700 1 --2- 172.21.15.151:0/4039467435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e97357fb60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009610 tx=0x7f6c24004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=261789de0e5b1e8b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.223+0000 7f6c20ff9700 1 -- 172.21.15.151:0/4039467435 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24020070 con 0x55e97358b660 2023-07-21T22:30:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.223+0000 7f6c20ff9700 1 -- 172.21.15.151:0/4039467435 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c24004bb0 con 0x55e97358b660 2023-07-21T22:30:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.223+0000 7f6c20ff9700 1 -- 172.21.15.151:0/4039467435 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24005a60 con 0x55e97358b660 2023-07-21T22:30:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.224+0000 7f6c47857b80 1 -- 172.21.15.151:0/4039467435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 msgr2=0x55e97357fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.224+0000 7f6c47857b80 1 --2- 172.21.15.151:0/4039467435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e97357fb60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009610 tx=0x7f6c24004b40 comp rx=0 tx=0).stop 2023-07-21T22:30:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.224+0000 7f6c47857b80 1 -- 172.21.15.151:0/4039467435 shutdown_connections 2023-07-21T22:30:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.224+0000 7f6c47857b80 1 --2- 172.21.15.151:0/4039467435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e97357fb60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.224+0000 7f6c47857b80 1 --2- 172.21.15.151:0/4039467435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e9733e16b0 0x55e973587740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.224+0000 7f6c47857b80 1 --2- 172.21.15.151:0/4039467435 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e97358b210 0x55e973587c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.224+0000 7f6c47857b80 1 -- 172.21.15.151:0/4039467435 >> 172.21.15.151:0/4039467435 conn(0x55e97357aae0 msgr2=0x55e97358ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.225+0000 7f6c47857b80 1 -- 172.21.15.151:0/4039467435 shutdown_connections 2023-07-21T22:30:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.225+0000 7f6c47857b80 1 -- 172.21.15.151:0/4039467435 wait complete. 2023-07-21T22:30:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.225+0000 7f6c47857b80 1 -- start start 2023-07-21T22:30:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.225+0000 7f6c47857b80 1 Processor -- start 2023-07-21T22:30:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 0x55e973591dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973592300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c47857b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e973592840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c47857b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e973594b90 con 0x55e97358b210 2023-07-21T22:30:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c47857b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9735f5600 con 0x55e97358b660 2023-07-21T22:30:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c47857b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9735f5770 con 0x55e9733e16b0 2023-07-21T22:30:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c47857b80 10 client.0 _ll_register_callbacks cb 0x7f6c2800b810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c3159a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973592300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c3159a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973592300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36000/0 (socket says 172.21.15.151:36000) 2023-07-21T22:30:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c3159a700 1 -- 172.21.15.151:0/3071507606 learned_addr learned my addr 172.21.15.151:0/3071507606 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.226+0000 7f6c3259c700 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e973592840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c31d9b700 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 0x55e973591dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c3159a700 1 -- 172.21.15.151:0/3071507606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 msgr2=0x55e973591dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c3159a700 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 0x55e973591dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c3159a700 1 -- 172.21.15.151:0/3071507606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 msgr2=0x55e973592840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c3159a700 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e973592840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c3159a700 1 -- 172.21.15.151:0/3071507606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c24009480 con 0x55e97358b210 2023-07-21T22:30:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c3159a700 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973592300 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c097590 tx=0x7f6c1c0b3910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d9ceeecdda2832 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c157fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:30:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c157fa700 1 -- 172.21.15.151:0/3071507606 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c09a770 con 0x55e97358b210 2023-07-21T22:30:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c157fa700 1 -- 172.21.15.151:0/3071507606 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6c1c0cb900 con 0x55e97358b210 2023-07-21T22:30:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.227+0000 7f6c47857b80 1 -- 172.21.15.151:0/3071507606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6c1c0a3450 con 0x55e97358b210 2023-07-21T22:30:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c157fa700 1 -- 172.21.15.151:0/3071507606 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6c1c0cbac0 con 0x55e97358b210 2023-07-21T22:30:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c47857b80 10 client.17232 fetch_fsmap learned FSMap version 49 2023-07-21T22:30:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c47857b80 1 -- 172.21.15.151:0/3071507606 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) v3 -- 0x55e9732edc00 con 0x55e97358b210 2023-07-21T22:30:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c157fa700 1 -- 172.21.15.151:0/3071507606 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6c1c0a3450 con 0x55e97358b210 2023-07-21T22:30:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c157fa700 1 -- 172.21.15.151:0/3071507606 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 49) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6c1c0a2fc0 con 0x55e97358b210 2023-07-21T22:30:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c47857b80 10 client.17232 fetch_fsmap finished waiting for FSMap version 49 2023-07-21T22:30:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c47857b80 10 client.17232 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:42.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c47857b80 20 client.17232 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e9735f69b0 0x55e9735f8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c47857b80 4 client.17232 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:30:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.228+0000 7f6c47857b80 1 -- 172.21.15.151:0/3071507606 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e973491ff0 con 0x55e9735f69b0 2023-07-21T22:30:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.229+0000 7f6c31d9b700 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e9735f69b0 0x55e9735f8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.229+0000 7f6c157fa700 10 client.17232 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:42.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.229+0000 7f6c31d9b700 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e9735f69b0 0x55e9735f8d90 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f8c19fdefcd317e server_cookie=1c1f6e2336725f43 in_seq=0 out_seq=0 2023-07-21T22:30:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.254+0000 7f6c157fa700 1 -- 172.21.15.151:0/3071507606 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e973491ff0 con 0x55e9735f69b0 2023-07-21T22:30:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.254+0000 7f6c157fa700 10 client.17232 handle_command_reply: tid=0 2023-07-21T22:30:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.254+0000 7f6c47857b80 1 client.17232 shutdown 2023-07-21T22:30:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 -- 172.21.15.151:0/3071507606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 msgr2=0x55e973592300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973592300 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c097590 tx=0x7f6c1c0b3910 comp rx=0 tx=0).stop 2023-07-21T22:30:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 -- 172.21.15.151:0/3071507606 shutdown_connections 2023-07-21T22:30:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e9735f69b0 0x55e9735f8d90 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e97358b660 0x55e973592840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e9733e16b0 0x55e973591dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 --2- 172.21.15.151:0/3071507606 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e97358b210 0x55e973592300 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 -- 172.21.15.151:0/3071507606 >> 172.21.15.151:0/3071507606 conn(0x55e97357aae0 msgr2=0x55e97358cc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c157fa700 0 client.17232 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 -- 172.21.15.151:0/3071507606 shutdown_connections 2023-07-21T22:30:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 1 -- 172.21.15.151:0/3071507606 wait complete. 2023-07-21T22:30:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.255+0000 7f6c47857b80 20 client.17232 trim_cache size 0 max 16384 2023-07-21T22:30:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:30:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:30:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:30:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:30:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 -- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6c180a1340 msgr2=0x7f6c180a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6c180a1340 0x7f6c180a37f0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009fd0 tx=0x7f6c2400b040 comp rx=0 tx=0).stop 2023-07-21T22:30:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 -- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c2c100760 msgr2=0x7f6c2c19c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c2c100760 0x7f6c2c19c0f0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c005e90 tx=0x7f6c1c00b5e0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 -- 172.21.15.151:0/320713063 shutdown_connections 2023-07-21T22:30:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6c180a1340 0x7f6c180a37f0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c2c104e00 0x7f6c2c195a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6c2c0ffdc0 0x7f6c2c19bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 --2- 172.21.15.151:0/320713063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c2c100760 0x7f6c2c19c0f0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 -- 172.21.15.151:0/320713063 >> 172.21.15.151:0/320713063 conn(0x7f6c2c0fb650 msgr2=0x7f6c2c0fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 -- 172.21.15.151:0/320713063 shutdown_connections 2023-07-21T22:30:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:42.256+0000 7f6c33fff700 1 -- 172.21.15.151:0/320713063 wait complete. 2023-07-21T22:30:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:42 smithi187 ceph-mon[96918]: pgmap v358: 97 pgs: 97 active+clean; 9.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:30:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:42 smithi195 ceph-mon[97365]: pgmap v358: 97 pgs: 97 active+clean; 9.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:30:42.915 INFO:teuthology.orchestra.run.smithi151.stderr:48700000 of 50000000 tuples (97%) done (elapsed 666.41 s, remaining 17.79 s) 2023-07-21T22:30:42.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:42 smithi151 ceph-mon[95510]: pgmap v358: 97 pgs: 97 active+clean; 9.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 24 MiB/s wr, 64 op/s 2023-07-21T22:30:44.206 INFO:teuthology.orchestra.run.smithi151.stderr:48800000 of 50000000 tuples (97%) done (elapsed 667.70 s, remaining 16.42 s) 2023-07-21T22:30:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:44 smithi187 ceph-mon[96918]: pgmap v359: 97 pgs: 97 active+clean; 9.7 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-07-21T22:30:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:44 smithi195 ceph-mon[97365]: pgmap v359: 97 pgs: 97 active+clean; 9.7 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-07-21T22:30:44.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:44 smithi151 ceph-mon[95510]: pgmap v359: 97 pgs: 97 active+clean; 9.7 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 35 MiB/s wr, 98 op/s 2023-07-21T22:30:45.592 INFO:teuthology.orchestra.run.smithi151.stderr:48900000 of 50000000 tuples (97%) done (elapsed 669.08 s, remaining 15.05 s) 2023-07-21T22:30:45.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:45 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:45.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:45 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:45.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:45 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:30:46.829 INFO:teuthology.orchestra.run.smithi151.stderr:49000000 of 50000000 tuples (98%) done (elapsed 670.32 s, remaining 13.68 s) 2023-07-21T22:30:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:46 smithi187 ceph-mon[96918]: pgmap v360: 97 pgs: 97 active+clean; 9.7 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-07-21T22:30:46.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:46 smithi195 ceph-mon[97365]: pgmap v360: 97 pgs: 97 active+clean; 9.7 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-07-21T22:30:46.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:46 smithi151 ceph-mon[95510]: pgmap v360: 97 pgs: 97 active+clean; 9.7 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 23 MiB/s wr, 71 op/s 2023-07-21T22:30:48.104 INFO:teuthology.orchestra.run.smithi151.stderr:49100000 of 50000000 tuples (98%) done (elapsed 671.59 s, remaining 12.31 s) 2023-07-21T22:30:48.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:48 smithi187 ceph-mon[96918]: pgmap v361: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 35 MiB/s wr, 111 op/s 2023-07-21T22:30:48.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:48 smithi195 ceph-mon[97365]: pgmap v361: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 35 MiB/s wr, 111 op/s 2023-07-21T22:30:48.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:48 smithi151 ceph-mon[95510]: pgmap v361: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 178 KiB/s rd, 35 MiB/s wr, 111 op/s 2023-07-21T22:30:49.392 INFO:teuthology.orchestra.run.smithi151.stderr:49200000 of 50000000 tuples (98%) done (elapsed 672.88 s, remaining 10.94 s) 2023-07-21T22:30:50.747 INFO:teuthology.orchestra.run.smithi151.stderr:49300000 of 50000000 tuples (98%) done (elapsed 674.24 s, remaining 9.57 s) 2023-07-21T22:30:50.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:50 smithi187 ceph-mon[96918]: pgmap v362: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 23 MiB/s wr, 74 op/s 2023-07-21T22:30:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:50 smithi195 ceph-mon[97365]: pgmap v362: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 23 MiB/s wr, 74 op/s 2023-07-21T22:30:50.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:50 smithi151 ceph-mon[95510]: pgmap v362: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 23 MiB/s wr, 74 op/s 2023-07-21T22:30:52.006 INFO:teuthology.orchestra.run.smithi151.stderr:49400000 of 50000000 tuples (98%) done (elapsed 675.50 s, remaining 8.20 s) 2023-07-21T22:30:52.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:52 smithi187 ceph-mon[96918]: pgmap v363: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 23 MiB/s wr, 74 op/s 2023-07-21T22:30:52.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:52 smithi195 ceph-mon[97365]: pgmap v363: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 23 MiB/s wr, 74 op/s 2023-07-21T22:30:52.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:52 smithi151 ceph-mon[95510]: pgmap v363: 97 pgs: 97 active+clean; 9.8 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 23 MiB/s wr, 74 op/s 2023-07-21T22:30:53.284 INFO:teuthology.orchestra.run.smithi151.stderr:49500000 of 50000000 tuples (99%) done (elapsed 676.77 s, remaining 6.84 s) 2023-07-21T22:30:54.618 INFO:teuthology.orchestra.run.smithi151.stderr:49600000 of 50000000 tuples (99%) done (elapsed 678.11 s, remaining 5.47 s) 2023-07-21T22:30:54.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:54 smithi187 ceph-mon[96918]: pgmap v364: 97 pgs: 97 active+clean; 9.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 34 MiB/s wr, 114 op/s 2023-07-21T22:30:54.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:54 smithi195 ceph-mon[97365]: pgmap v364: 97 pgs: 97 active+clean; 9.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 34 MiB/s wr, 114 op/s 2023-07-21T22:30:54.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:54 smithi151 ceph-mon[95510]: pgmap v364: 97 pgs: 97 active+clean; 9.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 34 MiB/s wr, 114 op/s 2023-07-21T22:30:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.421+0000 7feed6dff700 1 -- 172.21.15.151:0/1440455158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed01004e0 msgr2=0x7feed010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.421+0000 7feed6dff700 1 --2- 172.21.15.151:0/1440455158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed01004e0 0x7feed010c920 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7feec800b0a0 tx=0x7feec800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.421+0000 7feed6dff700 1 -- 172.21.15.151:0/1440455158 shutdown_connections 2023-07-21T22:30:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.421+0000 7feed6dff700 1 --2- 172.21.15.151:0/1440455158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed01004e0 0x7feed010c920 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.421+0000 7feed6dff700 1 --2- 172.21.15.151:0/1440455158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feed0105b60 0x7feed0105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.421+0000 7feed6dff700 1 --2- 172.21.15.151:0/1440455158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feed00ffb30 0x7feed00fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.421+0000 7feed6dff700 1 -- 172.21.15.151:0/1440455158 >> 172.21.15.151:0/1440455158 conn(0x7feed00fb5f0 msgr2=0x7feed00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.421+0000 7feed6dff700 1 -- 172.21.15.151:0/1440455158 shutdown_connections 2023-07-21T22:30:55.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.421+0000 7feed6dff700 1 -- 172.21.15.151:0/1440455158 wait complete. 2023-07-21T22:30:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.422+0000 7feed6dff700 1 Processor -- start 2023-07-21T22:30:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed6dff700 1 -- start start 2023-07-21T22:30:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed6dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed00ffb30 0x7feed0197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed6dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feed01004e0 0x7feed0198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed6dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feed0105b60 0x7feed019ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed6dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019d040 con 0x7feed00ffb30 2023-07-21T22:30:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed6dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019d1b0 con 0x7feed01004e0 2023-07-21T22:30:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed6dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed019d370 con 0x7feed0105b60 2023-07-21T22:30:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed4b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed00ffb30 0x7feed0197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed4b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed00ffb30 0x7feed0197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39120/0 (socket says 172.21.15.151:39120) 2023-07-21T22:30:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feed4b9b700 1 -- 172.21.15.151:0/1076472414 learned_addr learned my addr 172.21.15.151:0/1076472414 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:55.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.423+0000 7feecffff700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feed01004e0 0x7feed0198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feed539c700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feed0105b60 0x7feed019ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feed4b9b700 1 -- 172.21.15.151:0/1076472414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feed0105b60 msgr2=0x7feed019ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feed4b9b700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feed0105b60 0x7feed019ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feed4b9b700 1 -- 172.21.15.151:0/1076472414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feed01004e0 msgr2=0x7feed0198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feed4b9b700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feed01004e0 0x7feed0198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feed4b9b700 1 -- 172.21.15.151:0/1076472414 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec8009d00 con 0x7feed00ffb30 2023-07-21T22:30:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feed539c700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feed0105b60 0x7feed019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:30:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feecffff700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feed01004e0 0x7feed0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:30:55.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feed4b9b700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed00ffb30 0x7feed0197e50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7feec400e9a0 tx=0x7feec400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feecdffb700 1 -- 172.21.15.151:0/1076472414 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4009790 con 0x7feed00ffb30 2023-07-21T22:30:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feed6dff700 1 -- 172.21.15.151:0/1076472414 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feed019d650 con 0x7feed00ffb30 2023-07-21T22:30:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feecdffb700 1 -- 172.21.15.151:0/1076472414 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec400cbd0 con 0x7feed00ffb30 2023-07-21T22:30:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.424+0000 7feecdffb700 1 -- 172.21.15.151:0/1076472414 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4018680 con 0x7feed00ffb30 2023-07-21T22:30:55.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.425+0000 7feed6dff700 1 -- 172.21.15.151:0/1076472414 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feed01a4e90 con 0x7feed00ffb30 2023-07-21T22:30:55.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.429+0000 7feecdffb700 1 -- 172.21.15.151:0/1076472414 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7feec400cd40 con 0x7feed00ffb30 2023-07-21T22:30:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.430+0000 7feeea6bfb80 1 Processor -- start 2023-07-21T22:30:55.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.431+0000 7feeea6bfb80 1 -- start start 2023-07-21T22:30:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.431+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d83cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.431+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84210 0x55a3b8d7df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.431+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d7e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.431+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8c83c50 con 0x55a3b8d84660 2023-07-21T22:30:55.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.431+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8cd69e0 con 0x55a3b8d84210 2023-07-21T22:30:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.431+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8ccfe70 con 0x55a3b8bda6b0 2023-07-21T22:30:55.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.431+0000 7feecdffb700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feec00a12c0 0x7feec00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feecdffb700 1 -- 172.21.15.151:0/1076472414 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feec4014070 con 0x7feed00ffb30 2023-07-21T22:30:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feecffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d7e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed4b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84210 0x55a3b8d7df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed4b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84210 0x55a3b8d7df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39522/0 (socket says 172.21.15.151:39522) 2023-07-21T22:30:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed4b9b700 1 -- 172.21.15.151:0/4202390557 learned_addr learned my addr 172.21.15.151:0/4202390557 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:55.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feecffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d7e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39134/0 (socket says 172.21.15.151:39134) 2023-07-21T22:30:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed539c700 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d83cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed539c700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feec00a12c0 0x7feec00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed4b9b700 1 -- 172.21.15.151:0/4202390557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 msgr2=0x55a3b8d83cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed4b9b700 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d83cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed4b9b700 1 -- 172.21.15.151:0/4202390557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 msgr2=0x55a3b8d7e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed4b9b700 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d7e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed4b9b700 1 -- 172.21.15.151:0/4202390557 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3b8afdd80 con 0x55a3b8d84210 2023-07-21T22:30:55.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed539c700 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d83cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:30:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feecffff700 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d7e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:30:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.432+0000 7feed4b9b700 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84210 0x55a3b8d7df40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feec400c5b0 tx=0x7feec4099930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de9a8079686ac472 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.433+0000 7feed539c700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feec00a12c0 0x7feec00a3770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feec8009850 tx=0x7feec80060c0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.433+0000 7feebaffd700 1 -- 172.21.15.151:0/4202390557 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec40a2420 con 0x55a3b8d84210 2023-07-21T22:30:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.433+0000 7feebaffd700 1 -- 172.21.15.151:0/4202390557 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec4094be0 con 0x55a3b8d84210 2023-07-21T22:30:55.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.433+0000 7feebaffd700 1 -- 172.21.15.151:0/4202390557 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4099720 con 0x55a3b8d84210 2023-07-21T22:30:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 -- 172.21.15.151:0/4202390557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84210 msgr2=0x55a3b8d7df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84210 0x55a3b8d7df40 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7feec400c5b0 tx=0x7feec4099930 comp rx=0 tx=0).stop 2023-07-21T22:30:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 -- 172.21.15.151:0/4202390557 shutdown_connections 2023-07-21T22:30:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d7e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d83cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/4202390557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84210 0x55a3b8d7df40 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 -- 172.21.15.151:0/4202390557 >> 172.21.15.151:0/4202390557 conn(0x55a3b8d73ae0 msgr2=0x55a3b8d790e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 -- 172.21.15.151:0/4202390557 shutdown_connections 2023-07-21T22:30:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 -- 172.21.15.151:0/4202390557 wait complete. 2023-07-21T22:30:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.434+0000 7feeea6bfb80 1 -- start start 2023-07-21T22:30:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.435+0000 7feeea6bfb80 1 Processor -- start 2023-07-21T22:30:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.435+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d8a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.435+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 0x55a3b8d87840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.435+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d87f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.435+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8c6fa60 con 0x55a3b8d84210 2023-07-21T22:30:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.435+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8c6f760 con 0x55a3b8d84660 2023-07-21T22:30:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.435+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8b538c0 con 0x55a3b8bda6b0 2023-07-21T22:30:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.435+0000 7feeea6bfb80 10 client.0 _ll_register_callbacks cb 0x55a3b8c6d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.435+0000 7feed539c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d87f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feed539c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d87f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39524/0 (socket says 172.21.15.151:39524) 2023-07-21T22:30:55.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feed539c700 1 -- 172.21.15.151:0/1597913120 learned_addr learned my addr 172.21.15.151:0/1597913120 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feecffff700 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 0x55a3b8d87840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feed4b9b700 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d8a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feed539c700 1 -- 172.21.15.151:0/1597913120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 msgr2=0x55a3b8d8a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feed539c700 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d8a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feed539c700 1 -- 172.21.15.151:0/1597913120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 msgr2=0x55a3b8d87840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feed539c700 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 0x55a3b8d87840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feed539c700 1 -- 172.21.15.151:0/1597913120 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc009c90 con 0x55a3b8d84660 2023-07-21T22:30:55.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feed539c700 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d87f80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feec800b0a0 tx=0x7feec80099e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb6e43857a7098b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.436+0000 7feeaffff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:30:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.437+0000 7feeaffff700 1 -- 172.21.15.151:0/1597913120 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec800e040 con 0x55a3b8d84660 2023-07-21T22:30:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.437+0000 7feeaffff700 1 -- 172.21.15.151:0/1597913120 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feec80076b0 con 0x55a3b8d84660 2023-07-21T22:30:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.437+0000 7feeea6bfb80 1 -- 172.21.15.151:0/1597913120 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a3b8c29490 con 0x55a3b8d84660 2023-07-21T22:30:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.437+0000 7feeaffff700 1 -- 172.21.15.151:0/1597913120 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7feec8008f00 con 0x55a3b8d84660 2023-07-21T22:30:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.437+0000 7feeea6bfb80 10 client.26939 fetch_fsmap learned FSMap version 50 2023-07-21T22:30:55.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.437+0000 7feeea6bfb80 1 -- 172.21.15.151:0/1597913120 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x7feed01a4e90 con 0x55a3b8d84660 2023-07-21T22:30:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.438+0000 7feeaffff700 1 -- 172.21.15.151:0/1597913120 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a3b8c29490 con 0x55a3b8d84660 2023-07-21T22:30:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.438+0000 7feeaffff700 1 -- 172.21.15.151:0/1597913120 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 50) v1 ==== 7486+0+0 (secure 0 0 0) 0x7feec8005040 con 0x55a3b8d84660 2023-07-21T22:30:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.438+0000 7feeea6bfb80 10 client.26939 fetch_fsmap finished waiting for FSMap version 50 2023-07-21T22:30:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.438+0000 7feeea6bfb80 10 client.26939 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.438+0000 7feeea6bfb80 20 client.26939 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:55.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.438+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3b8da03e0 0x55a3b8da27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.438+0000 7feeea6bfb80 4 client.26939 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:30:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.438+0000 7feeea6bfb80 1 -- 172.21.15.151:0/1597913120 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a3b8cc8e50 con 0x55a3b8da03e0 2023-07-21T22:30:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.438+0000 7feed4b9b700 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3b8da03e0 0x55a3b8da27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.439+0000 7feeaffff700 10 client.26939 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.439+0000 7feed4b9b700 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3b8da03e0 0x55a3b8da27f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e51eb841f32ec63c server_cookie=c5a07a023ed5a5c8 in_seq=0 out_seq=0 2023-07-21T22:30:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeaffff700 1 -- 172.21.15.151:0/1597913120 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a3b8cc8e50 con 0x55a3b8da03e0 2023-07-21T22:30:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeaffff700 10 client.26939 handle_command_reply: tid=0 2023-07-21T22:30:55.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 client.26939 shutdown 2023-07-21T22:30:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 -- 172.21.15.151:0/1597913120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 msgr2=0x55a3b8d87f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d87f80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feec800b0a0 tx=0x7feec80099e0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 -- 172.21.15.151:0/1597913120 shutdown_connections 2023-07-21T22:30:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3b8da03e0 0x55a3b8da27f0 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d87f80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d8a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeaffff700 0 client.26939 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/1597913120 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 0x55a3b8d87840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 -- 172.21.15.151:0/1597913120 >> 172.21.15.151:0/1597913120 conn(0x55a3b8d73ae0 msgr2=0x55a3b8d783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 -- 172.21.15.151:0/1597913120 shutdown_connections 2023-07-21T22:30:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 1 -- 172.21.15.151:0/1597913120 wait complete. 2023-07-21T22:30:55.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.440+0000 7feeea6bfb80 20 client.26939 trim_cache size 0 max 16384 2023-07-21T22:30:55.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.457+0000 7feeea6bfb80 1 Processor -- start 2023-07-21T22:30:55.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.457+0000 7feeea6bfb80 1 -- start start 2023-07-21T22:30:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d97430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8d84210 0x55a3b8d851b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d8a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8d70b20 con 0x55a3b8d84660 2023-07-21T22:30:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8d88b90 con 0x55a3b8bda6b0 2023-07-21T22:30:55.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8d7ef20 con 0x55a3b8d84210 2023-07-21T22:30:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feed4b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d97430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feed539c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d8a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feecffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8d84210 0x55a3b8d851b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feed4b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d97430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39528/0 (socket says 172.21.15.151:39528) 2023-07-21T22:30:55.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.458+0000 7feed4b9b700 1 -- 172.21.15.151:0/786108183 learned_addr learned my addr 172.21.15.151:0/786108183 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.459+0000 7feecffff700 1 -- 172.21.15.151:0/786108183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8bda6b0 msgr2=0x55a3b8d97430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:55.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.459+0000 7feecffff700 1 --2- 172.21.15.151:0/786108183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d97430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.459+0000 7feecffff700 1 -- 172.21.15.151:0/786108183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 msgr2=0x55a3b8d8a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.459+0000 7feecffff700 1 --2- 172.21.15.151:0/786108183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d8a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.459+0000 7feecffff700 1 -- 172.21.15.151:0/786108183 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a3b8ae6c00 con 0x55a3b8d84210 2023-07-21T22:30:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.459+0000 7feecffff700 1 --2- 172.21.15.151:0/786108183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8d84210 0x55a3b8d851b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55a3b8d84a70 tx=0x7feebc009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=912f3d632413c815 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.459+0000 7feebb7fe700 1 -- 172.21.15.151:0/786108183 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc017070 con 0x55a3b8d84210 2023-07-21T22:30:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.459+0000 7feebb7fe700 1 -- 172.21.15.151:0/786108183 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feebc018040 con 0x55a3b8d84210 2023-07-21T22:30:55.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.459+0000 7feebb7fe700 1 -- 172.21.15.151:0/786108183 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feebc01d460 con 0x55a3b8d84210 2023-07-21T22:30:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.460+0000 7feeea6bfb80 1 -- 172.21.15.151:0/786108183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8d84210 msgr2=0x55a3b8d851b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.460+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/786108183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8d84210 0x55a3b8d851b0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x55a3b8d84a70 tx=0x7feebc009260 comp rx=0 tx=0).stop 2023-07-21T22:30:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.460+0000 7feeea6bfb80 1 -- 172.21.15.151:0/786108183 shutdown_connections 2023-07-21T22:30:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.460+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/786108183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d97430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.460+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/786108183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84660 0x55a3b8d8a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.460+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/786108183 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8d84210 0x55a3b8d851b0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.460+0000 7feeea6bfb80 1 -- 172.21.15.151:0/786108183 >> 172.21.15.151:0/786108183 conn(0x55a3b8d73ae0 msgr2=0x55a3b8d84aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:55.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.460+0000 7feeea6bfb80 1 -- 172.21.15.151:0/786108183 shutdown_connections 2023-07-21T22:30:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.460+0000 7feeea6bfb80 1 -- 172.21.15.151:0/786108183 wait complete. 2023-07-21T22:30:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.461+0000 7feeea6bfb80 1 -- start start 2023-07-21T22:30:55.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.461+0000 7feeea6bfb80 1 Processor -- start 2023-07-21T22:30:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.461+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d97630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.461+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 0x55a3b8d7fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.461+0000 7feeea6bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d80040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.461+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8d80740 con 0x55a3b8d84210 2023-07-21T22:30:55.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.461+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8d808b0 con 0x55a3b8d84660 2023-07-21T22:30:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.461+0000 7feeea6bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a3b8df42a0 con 0x55a3b8bda6b0 2023-07-21T22:30:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.461+0000 7feeea6bfb80 10 client.0 _ll_register_callbacks cb 0x7feec800bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:30:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed539c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d80040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feecffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 0x55a3b8d7fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed539c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d80040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39538/0 (socket says 172.21.15.151:39538) 2023-07-21T22:30:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed539c700 1 -- 172.21.15.151:0/2448693614 learned_addr learned my addr 172.21.15.151:0/2448693614 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:30:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed4b9b700 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d97630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed539c700 1 -- 172.21.15.151:0/2448693614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 msgr2=0x55a3b8d97630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed539c700 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d97630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed539c700 1 -- 172.21.15.151:0/2448693614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 msgr2=0x55a3b8d7fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:30:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed539c700 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 0x55a3b8d7fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed539c700 1 -- 172.21.15.151:0/2448693614 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feebc012500 con 0x55a3b8d84660 2023-07-21T22:30:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feed539c700 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d80040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feec800b3f0 tx=0x7feec8005980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ce680182e31b84 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:30:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.462+0000 7feeaffff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:30:55.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.463+0000 7feeaffff700 1 -- 172.21.15.151:0/2448693614 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec803f070 con 0x55a3b8d84660 2023-07-21T22:30:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.463+0000 7feeaffff700 1 -- 172.21.15.151:0/2448693614 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feec80076b0 con 0x55a3b8d84660 2023-07-21T22:30:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.463+0000 7feeea6bfb80 1 -- 172.21.15.151:0/2448693614 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feec4094be0 con 0x55a3b8d84660 2023-07-21T22:30:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.463+0000 7feeaffff700 1 -- 172.21.15.151:0/2448693614 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) v2 ==== 24+0+0 (secure 0 0 0) 0x7feec800e040 con 0x55a3b8d84660 2023-07-21T22:30:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.463+0000 7feeea6bfb80 10 client.26945 fetch_fsmap learned FSMap version 50 2023-07-21T22:30:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.463+0000 7feeea6bfb80 1 -- 172.21.15.151:0/2448693614 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) v3 -- 0x55a3b8b241f0 con 0x55a3b8d84660 2023-07-21T22:30:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.463+0000 7feeaffff700 1 -- 172.21.15.151:0/2448693614 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec4094be0 con 0x55a3b8d84660 2023-07-21T22:30:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.463+0000 7feeaffff700 1 -- 172.21.15.151:0/2448693614 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 50) v1 ==== 7486+0+0 (secure 0 0 0) 0x7feec8042020 con 0x55a3b8d84660 2023-07-21T22:30:55.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.464+0000 7feeea6bfb80 10 client.26945 fetch_fsmap finished waiting for FSMap version 50 2023-07-21T22:30:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.464+0000 7feeea6bfb80 10 client.26945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:30:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.464+0000 7feeea6bfb80 20 client.26945 populate_metadata read hostname 'smithi151' 2023-07-21T22:30:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.464+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3b8df5510 0x55a3b8df7920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:30:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.464+0000 7feeea6bfb80 4 client.26945 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:30:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.464+0000 7feeea6bfb80 1 -- 172.21.15.151:0/2448693614 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a3b8c8aff0 con 0x55a3b8df5510 2023-07-21T22:30:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.464+0000 7feed4b9b700 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3b8df5510 0x55a3b8df7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:30:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.465+0000 7feed4b9b700 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3b8df5510 0x55a3b8df7920 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ec4d8375f8cb0d2 server_cookie=f359fc1de40a066d in_seq=0 out_seq=0 2023-07-21T22:30:55.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.465+0000 7feeaffff700 10 client.26945 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:55.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.480+0000 7feeaffff700 1 -- 172.21.15.151:0/2448693614 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a3b8c8aff0 con 0x55a3b8df5510 2023-07-21T22:30:55.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.480+0000 7feeaffff700 10 client.26945 handle_command_reply: tid=0 2023-07-21T22:30:55.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.480+0000 7feeea6bfb80 1 client.26945 shutdown 2023-07-21T22:30:55.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.480+0000 7feeea6bfb80 1 -- 172.21.15.151:0/2448693614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 msgr2=0x55a3b8d80040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.480+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d80040 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7feec800b3f0 tx=0x7feec8005980 comp rx=0 tx=0).stop 2023-07-21T22:30:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeea6bfb80 1 -- 172.21.15.151:0/2448693614 shutdown_connections 2023-07-21T22:30:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a3b8df5510 0x55a3b8df7920 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a3b8d84660 0x55a3b8d80040 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a3b8bda6b0 0x55a3b8d97630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeea6bfb80 1 --2- 172.21.15.151:0/2448693614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a3b8d84210 0x55a3b8d7fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeea6bfb80 1 -- 172.21.15.151:0/2448693614 >> 172.21.15.151:0/2448693614 conn(0x55a3b8d73ae0 msgr2=0x55a3b8d7d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeaffff700 0 client.26945 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:30:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeea6bfb80 1 -- 172.21.15.151:0/2448693614 shutdown_connections 2023-07-21T22:30:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeea6bfb80 1 -- 172.21.15.151:0/2448693614 wait complete. 2023-07-21T22:30:55.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.481+0000 7feeea6bfb80 20 client.26945 trim_cache size 0 max 16384 2023-07-21T22:30:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:30:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:30:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:30:55.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:30:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 -- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feec00a12c0 msgr2=0x7feec00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feec00a12c0 0x7feec00a3770 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feec8009850 tx=0x7feec80060c0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 -- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed00ffb30 msgr2=0x7feed0197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:30:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed00ffb30 0x7feed0197e50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7feec400e9a0 tx=0x7feec400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 -- 172.21.15.151:0/1076472414 shutdown_connections 2023-07-21T22:30:55.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feec00a12c0 0x7feec00a3770 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feed0105b60 0x7feed019ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed00ffb30 0x7feed0197e50 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 --2- 172.21.15.151:0/1076472414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feed01004e0 0x7feed0198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:30:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.482+0000 7feed6dff700 1 -- 172.21.15.151:0/1076472414 >> 172.21.15.151:0/1076472414 conn(0x7feed00fb5f0 msgr2=0x7feed010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:30:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.483+0000 7feed6dff700 1 -- 172.21.15.151:0/1076472414 shutdown_connections 2023-07-21T22:30:55.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:30:55.483+0000 7feed6dff700 1 -- 172.21.15.151:0/1076472414 wait complete. 2023-07-21T22:30:55.909 INFO:teuthology.orchestra.run.smithi151.stderr:49700000 of 50000000 tuples (99%) done (elapsed 679.40 s, remaining 4.10 s) 2023-07-21T22:30:56.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:56 smithi187 ceph-mon[96918]: pgmap v365: 97 pgs: 97 active+clean; 9.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 23 MiB/s wr, 79 op/s 2023-07-21T22:30:56.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:56 smithi195 ceph-mon[97365]: pgmap v365: 97 pgs: 97 active+clean; 9.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 23 MiB/s wr, 79 op/s 2023-07-21T22:30:56.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:56 smithi151 ceph-mon[95510]: pgmap v365: 97 pgs: 97 active+clean; 9.9 GiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 23 MiB/s wr, 79 op/s 2023-07-21T22:30:57.149 INFO:teuthology.orchestra.run.smithi151.stderr:49800000 of 50000000 tuples (99%) done (elapsed 680.64 s, remaining 2.73 s) 2023-07-21T22:30:58.407 INFO:teuthology.orchestra.run.smithi151.stderr:49900000 of 50000000 tuples (99%) done (elapsed 681.90 s, remaining 1.37 s) 2023-07-21T22:30:58.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:30:58 smithi187 ceph-mon[96918]: pgmap v366: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 35 MiB/s wr, 119 op/s 2023-07-21T22:30:58.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:30:58 smithi195 ceph-mon[97365]: pgmap v366: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 35 MiB/s wr, 119 op/s 2023-07-21T22:30:58.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:30:58 smithi151 ceph-mon[95510]: pgmap v366: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 35 MiB/s wr, 119 op/s 2023-07-21T22:30:59.796 INFO:teuthology.orchestra.run.smithi151.stderr:50000000 of 50000000 tuples (100%) done (elapsed 683.29 s, remaining 0.00 s) 2023-07-21T22:30:59.858 INFO:teuthology.orchestra.run.smithi151.stderr:vacuum... 2023-07-21T22:31:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:00 smithi187 ceph-mon[96918]: pgmap v367: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-07-21T22:31:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:00 smithi195 ceph-mon[97365]: pgmap v367: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-07-21T22:31:00.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:00 smithi151 ceph-mon[95510]: pgmap v367: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-07-21T22:31:02.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:02 smithi187 ceph-mon[96918]: pgmap v368: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-07-21T22:31:02.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:02 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:31:02.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:02 smithi195 ceph-mon[97365]: pgmap v368: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-07-21T22:31:02.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:02 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:31:02.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:02 smithi151 ceph-mon[95510]: pgmap v368: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 23 MiB/s wr, 80 op/s 2023-07-21T22:31:02.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:02 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:31:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:04 smithi187 ceph-mon[96918]: pgmap v369: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 31 MiB/s wr, 191 op/s 2023-07-21T22:31:04.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:04 smithi195 ceph-mon[97365]: pgmap v369: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 31 MiB/s wr, 191 op/s 2023-07-21T22:31:04.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:04 smithi151 ceph-mon[95510]: pgmap v369: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 31 MiB/s wr, 191 op/s 2023-07-21T22:31:06.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:06 smithi187 ceph-mon[96918]: pgmap v370: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 19 MiB/s wr, 151 op/s 2023-07-21T22:31:06.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:06 smithi195 ceph-mon[97365]: pgmap v370: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 19 MiB/s wr, 151 op/s 2023-07-21T22:31:06.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:06 smithi151 ceph-mon[95510]: pgmap v370: 97 pgs: 97 active+clean; 10 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 19 MiB/s wr, 151 op/s 2023-07-21T22:31:07.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:07 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:31:07.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:07 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:31:07.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:07 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:31:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.663+0000 7f23845ff700 1 -- 172.21.15.151:0/840497737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 msgr2=0x7f237c0fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.663+0000 7f23845ff700 1 --2- 172.21.15.151:0/840497737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 0x7f237c0fff70 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f236c009990 tx=0x7f236c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.663+0000 7f23845ff700 1 -- 172.21.15.151:0/840497737 shutdown_connections 2023-07-21T22:31:08.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.663+0000 7f23845ff700 1 --2- 172.21.15.151:0/840497737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237c1004b0 0x7f237c10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.663+0000 7f23845ff700 1 --2- 172.21.15.151:0/840497737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f237c105b10 0x7f237c105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.663+0000 7f23845ff700 1 --2- 172.21.15.151:0/840497737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 0x7f237c0fff70 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.663+0000 7f23845ff700 1 -- 172.21.15.151:0/840497737 >> 172.21.15.151:0/840497737 conn(0x7f237c0fb600 msgr2=0x7f237c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.663+0000 7f23845ff700 1 -- 172.21.15.151:0/840497737 shutdown_connections 2023-07-21T22:31:08.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.663+0000 7f23845ff700 1 -- 172.21.15.151:0/840497737 wait complete. 2023-07-21T22:31:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.664+0000 7f23845ff700 1 Processor -- start 2023-07-21T22:31:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.664+0000 7f23845ff700 1 -- start start 2023-07-21T22:31:08.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f23845ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 0x7f237c197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f23845ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f237c1004b0 0x7f237c198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f23845ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237c105b10 0x7f237c19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f23845ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c19d010 con 0x7f237c105b10 2023-07-21T22:31:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f23845ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c19d180 con 0x7f237c0ffb00 2023-07-21T22:31:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f23845ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f237c19d340 con 0x7f237c1004b0 2023-07-21T22:31:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f238239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 0x7f237c197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f2382b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237c105b10 0x7f237c19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f238239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 0x7f237c197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52160/0 (socket says 172.21.15.151:52160) 2023-07-21T22:31:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f238239b700 1 -- 172.21.15.151:0/3991894347 learned_addr learned my addr 172.21.15.151:0/3991894347 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.665+0000 7f2381b9a700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f237c1004b0 0x7f237c198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.666+0000 7f238239b700 1 -- 172.21.15.151:0/3991894347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f237c1004b0 msgr2=0x7f237c198360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.666+0000 7f238239b700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f237c1004b0 0x7f237c198360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.666+0000 7f238239b700 1 -- 172.21.15.151:0/3991894347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237c105b10 msgr2=0x7f237c19c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.666+0000 7f238239b700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237c105b10 0x7f237c19c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.666+0000 7f238239b700 1 -- 172.21.15.151:0/3991894347 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2374009c40 con 0x7f237c0ffb00 2023-07-21T22:31:08.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.666+0000 7f238239b700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 0x7f237c197e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f237800e9a0 tx=0x7f237800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.666+0000 7f23737fe700 1 -- 172.21.15.151:0/3991894347 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378009790 con 0x7f237c0ffb00 2023-07-21T22:31:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.666+0000 7f23737fe700 1 -- 172.21.15.151:0/3991894347 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f237800ce50 con 0x7f237c0ffb00 2023-07-21T22:31:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.666+0000 7f23737fe700 1 -- 172.21.15.151:0/3991894347 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378018420 con 0x7f237c0ffb00 2023-07-21T22:31:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.667+0000 7f23845ff700 1 -- 172.21.15.151:0/3991894347 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f236c0095f0 con 0x7f237c0ffb00 2023-07-21T22:31:08.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.667+0000 7f23845ff700 1 -- 172.21.15.151:0/3991894347 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c1a4c80 con 0x7f237c0ffb00 2023-07-21T22:31:08.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.670+0000 7f23737fe700 1 -- 172.21.15.151:0/3991894347 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2378010430 con 0x7f237c0ffb00 2023-07-21T22:31:08.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.672+0000 7f2397fefb80 1 Processor -- start 2023-07-21T22:31:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.672+0000 7f23737fe700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f23680a1340 0x7f23680a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.672+0000 7f23737fe700 1 -- 172.21.15.151:0/3991894347 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2378014070 con 0x7f237c0ffb00 2023-07-21T22:31:08.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.672+0000 7f2397fefb80 1 -- start start 2023-07-21T22:31:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.672+0000 7f2382b9c700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f23680a1340 0x7f23680a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.673+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x55889300dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.673+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e210 0x558893007f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.673+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e660 0x5588930084a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.673+0000 7f2397fefb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558892f0dc50 con 0x55889300e210 2023-07-21T22:31:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.673+0000 7f2397fefb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558892f609e0 con 0x558892e646b0 2023-07-21T22:31:08.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.673+0000 7f2397fefb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558892f59e70 con 0x55889300e660 2023-07-21T22:31:08.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.673+0000 7f238239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x55889300dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.673+0000 7f238239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x55889300dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52168/0 (socket says 172.21.15.151:52168) 2023-07-21T22:31:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.673+0000 7f238239b700 1 -- 172.21.15.151:0/3866215833 learned_addr learned my addr 172.21.15.151:0/3866215833 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f2381b9a700 1 --2- 172.21.15.151:0/3866215833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e210 0x558893007f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f238239b700 1 -- 172.21.15.151:0/3866215833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e660 msgr2=0x5588930084a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f238239b700 1 --2- 172.21.15.151:0/3866215833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e660 0x5588930084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f238239b700 1 -- 172.21.15.151:0/3866215833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e210 msgr2=0x558893007f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:08.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f238239b700 1 --2- 172.21.15.151:0/3866215833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e210 0x558893007f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f2382b9c700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f23680a1340 0x7f23680a37f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2374009fd0 tx=0x7f237400b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f238239b700 1 -- 172.21.15.151:0/3866215833 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558892d87d80 con 0x558892e646b0 2023-07-21T22:31:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f238239b700 1 --2- 172.21.15.151:0/3866215833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x55889300dcd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2378000c00 tx=0x7f23780998d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d0c15f6d4bd86e9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f2370bfe700 1 -- 172.21.15.151:0/3866215833 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237809ded0 con 0x558892e646b0 2023-07-21T22:31:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f2370bfe700 1 -- 172.21.15.151:0/3866215833 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23780a22f0 con 0x558892e646b0 2023-07-21T22:31:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.674+0000 7f2370bfe700 1 -- 172.21.15.151:0/3866215833 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780a1e60 con 0x558892e646b0 2023-07-21T22:31:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.675+0000 7f2397fefb80 1 -- 172.21.15.151:0/3866215833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 msgr2=0x55889300dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:08.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.675+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3866215833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x55889300dcd0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f2378000c00 tx=0x7f23780998d0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.675+0000 7f2397fefb80 1 -- 172.21.15.151:0/3866215833 shutdown_connections 2023-07-21T22:31:08.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.675+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3866215833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x55889300dcd0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.675+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3866215833 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e660 0x5588930084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.675+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3866215833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e210 0x558893007f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.675+0000 7f2397fefb80 1 -- 172.21.15.151:0/3866215833 >> 172.21.15.151:0/3866215833 conn(0x558892ffdae0 msgr2=0x5588930030e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:08.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.675+0000 7f2397fefb80 1 -- 172.21.15.151:0/3866215833 shutdown_connections 2023-07-21T22:31:08.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.675+0000 7f2397fefb80 1 -- 172.21.15.151:0/3866215833 wait complete. 2023-07-21T22:31:08.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.676+0000 7f2397fefb80 1 -- start start 2023-07-21T22:31:08.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.676+0000 7f2397fefb80 1 Processor -- start 2023-07-21T22:31:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.677+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558892e646b0 0x558893017660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.677+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55889300e210 0x558893017ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.677+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e660 0x5588930118f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.677+0000 7f2397fefb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558892ef9a60 con 0x558892e646b0 2023-07-21T22:31:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.677+0000 7f2397fefb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558892ef9760 con 0x55889300e210 2023-07-21T22:31:08.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.677+0000 7f2397fefb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558892ddd8c0 con 0x55889300e660 2023-07-21T22:31:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.677+0000 7f2397fefb80 10 client.0 _ll_register_callbacks cb 0x558892ef7700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:31:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f238239b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558892e646b0 0x558893017660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f238239b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558892e646b0 0x558893017660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54698/0 (socket says 172.21.15.151:54698) 2023-07-21T22:31:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f238239b700 1 -- 172.21.15.151:0/3941542908 learned_addr learned my addr 172.21.15.151:0/3941542908 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f2381b9a700 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55889300e210 0x558893017ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f2382b9c700 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e660 0x5588930118f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f2381b9a700 1 -- 172.21.15.151:0/3941542908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e660 msgr2=0x5588930118f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f2381b9a700 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e660 0x5588930118f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f2381b9a700 1 -- 172.21.15.151:0/3941542908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558892e646b0 msgr2=0x558893017660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f2381b9a700 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558892e646b0 0x558893017660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.678+0000 7f2381b9a700 1 -- 172.21.15.151:0/3941542908 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237c1a4c80 con 0x55889300e210 2023-07-21T22:31:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.679+0000 7f2381b9a700 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55889300e210 0x558893017ba0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f236c0098e0 tx=0x7f236c005730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e472cb1d472249d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.679+0000 7f2365ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:31:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.679+0000 7f2365ffb700 1 -- 172.21.15.151:0/3941542908 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f236c01d070 con 0x55889300e210 2023-07-21T22:31:08.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.679+0000 7f2397fefb80 1 -- 172.21.15.151:0/3941542908 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558892eb3490 con 0x55889300e210 2023-07-21T22:31:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.679+0000 7f2365ffb700 1 -- 172.21.15.151:0/3941542908 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f236c004500 con 0x55889300e210 2023-07-21T22:31:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.679+0000 7f2365ffb700 1 -- 172.21.15.151:0/3941542908 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f236c0046c0 con 0x55889300e210 2023-07-21T22:31:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.679+0000 7f2397fefb80 10 client.26957 fetch_fsmap learned FSMap version 52 2023-07-21T22:31:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.679+0000 7f2397fefb80 1 -- 172.21.15.151:0/3941542908 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x558892d70c00 con 0x55889300e210 2023-07-21T22:31:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.680+0000 7f2365ffb700 1 -- 172.21.15.151:0/3941542908 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558892eb3490 con 0x55889300e210 2023-07-21T22:31:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.680+0000 7f2365ffb700 1 -- 172.21.15.151:0/3941542908 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f236c024640 con 0x55889300e210 2023-07-21T22:31:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.680+0000 7f2397fefb80 10 client.26957 fetch_fsmap finished waiting for FSMap version 52 2023-07-21T22:31:08.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.680+0000 7f2397fefb80 10 client.26957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:31:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.680+0000 7f2397fefb80 20 client.26957 populate_metadata read hostname 'smithi151' 2023-07-21T22:31:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.680+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558893021b50 0x558893023f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.680+0000 7f2397fefb80 4 client.26957 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:31:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.680+0000 7f2397fefb80 1 -- 172.21.15.151:0/3941542908 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558892f52e50 con 0x558893021b50 2023-07-21T22:31:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.680+0000 7f238239b700 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558893021b50 0x558893023f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.681+0000 7f238239b700 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558893021b50 0x558893023f60 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd6f3333495b490 server_cookie=41efc47540d7f30d in_seq=0 out_seq=0 2023-07-21T22:31:08.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.681+0000 7f2365ffb700 10 client.26957 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2365ffb700 1 -- 172.21.15.151:0/3941542908 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558892f52e50 con 0x558893021b50 2023-07-21T22:31:08.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2365ffb700 10 client.26957 handle_command_reply: tid=0 2023-07-21T22:31:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 client.26957 shutdown 2023-07-21T22:31:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 -- 172.21.15.151:0/3941542908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55889300e210 msgr2=0x558893017ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55889300e210 0x558893017ba0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f236c0098e0 tx=0x7f236c005730 comp rx=0 tx=0).stop 2023-07-21T22:31:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 -- 172.21.15.151:0/3941542908 shutdown_connections 2023-07-21T22:31:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558893021b50 0x558893023f60 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e660 0x5588930118f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558892e646b0 0x558893017660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3941542908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55889300e210 0x558893017ba0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2365ffb700 0 client.26957 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 -- 172.21.15.151:0/3941542908 >> 172.21.15.151:0/3941542908 conn(0x558892ffdae0 msgr2=0x5588930023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 -- 172.21.15.151:0/3941542908 shutdown_connections 2023-07-21T22:31:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.682+0000 7f2397fefb80 1 -- 172.21.15.151:0/3941542908 wait complete. 2023-07-21T22:31:08.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.683+0000 7f2397fefb80 20 client.26957 trim_cache size 0 max 16384 2023-07-21T22:31:08.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.702+0000 7f2397fefb80 1 Processor -- start 2023-07-21T22:31:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.702+0000 7f2397fefb80 1 -- start start 2023-07-21T22:31:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.702+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893011a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 0x55889300d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 0x558893002b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f2397fefb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558892eb3490 con 0x55889300e660 2023-07-21T22:31:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f2397fefb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889300d900 con 0x558892e646b0 2023-07-21T22:31:08.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f2397fefb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55889300fe90 con 0x55889300e210 2023-07-21T22:31:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f2382b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 0x558893002b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f238239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893011a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f2382b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 0x558893002b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54710/0 (socket says 172.21.15.151:54710) 2023-07-21T22:31:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f2382b9c700 1 -- 172.21.15.151:0/3603632711 learned_addr learned my addr 172.21.15.151:0/3603632711 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f2381b9a700 1 --2- 172.21.15.151:0/3603632711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 0x55889300d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f238239b700 1 -- 172.21.15.151:0/3603632711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 msgr2=0x55889300d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f238239b700 1 --2- 172.21.15.151:0/3603632711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 0x55889300d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f238239b700 1 -- 172.21.15.151:0/3603632711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 msgr2=0x558893002b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f238239b700 1 --2- 172.21.15.151:0/3603632711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 0x558893002b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.703+0000 7f238239b700 1 -- 172.21.15.151:0/3603632711 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558892dae1f0 con 0x558892e646b0 2023-07-21T22:31:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.704+0000 7f238239b700 1 --2- 172.21.15.151:0/3603632711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893011a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f23780cab20 tx=0x7f2378099800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb0c906d5f8d8b64 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.704+0000 7f23713ff700 1 -- 172.21.15.151:0/3603632711 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780b82d0 con 0x558892e646b0 2023-07-21T22:31:08.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.704+0000 7f23713ff700 1 -- 172.21.15.151:0/3603632711 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23780961e0 con 0x558892e646b0 2023-07-21T22:31:08.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.704+0000 7f23713ff700 1 -- 172.21.15.151:0/3603632711 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23780a20c0 con 0x558892e646b0 2023-07-21T22:31:08.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.705+0000 7f2397fefb80 1 -- 172.21.15.151:0/3603632711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 msgr2=0x558893011a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:08.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.705+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3603632711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893011a20 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f23780cab20 tx=0x7f2378099800 comp rx=0 tx=0).stop 2023-07-21T22:31:08.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.705+0000 7f2397fefb80 1 -- 172.21.15.151:0/3603632711 shutdown_connections 2023-07-21T22:31:08.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.705+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3603632711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893011a20 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.705+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3603632711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 0x558893002b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.705+0000 7f2397fefb80 1 --2- 172.21.15.151:0/3603632711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 0x55889300d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.705+0000 7f2397fefb80 1 -- 172.21.15.151:0/3603632711 >> 172.21.15.151:0/3603632711 conn(0x558892ffdae0 msgr2=0x55889300c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.705+0000 7f2397fefb80 1 -- 172.21.15.151:0/3603632711 shutdown_connections 2023-07-21T22:31:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.705+0000 7f2397fefb80 1 -- 172.21.15.151:0/3603632711 wait complete. 2023-07-21T22:31:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.706+0000 7f2397fefb80 1 -- start start 2023-07-21T22:31:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.706+0000 7f2397fefb80 1 Processor -- start 2023-07-21T22:31:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.706+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893069b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 0x55889306a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f2397fefb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 0x558893074a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f2397fefb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558893074f60 con 0x55889300e660 2023-07-21T22:31:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f2397fefb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588930750a0 con 0x558892e646b0 2023-07-21T22:31:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f2397fefb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5588930751e0 con 0x55889300e210 2023-07-21T22:31:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f2397fefb80 10 client.0 _ll_register_callbacks cb 0x7f236c009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:31:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f238239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893069b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f238239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893069b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52196/0 (socket says 172.21.15.151:52196) 2023-07-21T22:31:08.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f238239b700 1 -- 172.21.15.151:0/764627696 learned_addr learned my addr 172.21.15.151:0/764627696 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f2382b9c700 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 0x558893074a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f2381b9a700 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 0x55889306a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f238239b700 1 -- 172.21.15.151:0/764627696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 msgr2=0x55889306a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f238239b700 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 0x55889306a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f238239b700 1 -- 172.21.15.151:0/764627696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 msgr2=0x558893074a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f238239b700 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 0x558893074a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.707+0000 7f238239b700 1 -- 172.21.15.151:0/764627696 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558892d87d80 con 0x558892e646b0 2023-07-21T22:31:08.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.708+0000 7f238239b700 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893069b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f23780981f0 tx=0x7f23780b82e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3efc1dc7381e7613 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.708+0000 7f2365ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:31:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.708+0000 7f2365ffb700 1 -- 172.21.15.151:0/764627696 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378099390 con 0x558892e646b0 2023-07-21T22:31:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.708+0000 7f2365ffb700 1 -- 172.21.15.151:0/764627696 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(98..98 src has 1..98) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f23780994f0 con 0x558892e646b0 2023-07-21T22:31:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.708+0000 7f2397fefb80 1 -- 172.21.15.151:0/764627696 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f23780a22f0 con 0x558892e646b0 2023-07-21T22:31:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.708+0000 7f2365ffb700 1 -- 172.21.15.151:0/764627696 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23780a1e60 con 0x558892e646b0 2023-07-21T22:31:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.708+0000 7f2397fefb80 10 client.26963 fetch_fsmap learned FSMap version 52 2023-07-21T22:31:08.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.708+0000 7f2397fefb80 1 -- 172.21.15.151:0/764627696 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x558892d86250 con 0x558892e646b0 2023-07-21T22:31:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.708+0000 7f2365ffb700 1 -- 172.21.15.151:0/764627696 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f23780a22f0 con 0x558892e646b0 2023-07-21T22:31:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.709+0000 7f2365ffb700 1 -- 172.21.15.151:0/764627696 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2378095d20 con 0x558892e646b0 2023-07-21T22:31:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.709+0000 7f2397fefb80 10 client.26963 fetch_fsmap finished waiting for FSMap version 52 2023-07-21T22:31:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.709+0000 7f2397fefb80 10 client.26963 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:31:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.709+0000 7f2397fefb80 20 client.26963 populate_metadata read hostname 'smithi151' 2023-07-21T22:31:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.709+0000 7f2397fefb80 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558893076490 0x558893078870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:08.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.709+0000 7f2397fefb80 4 client.26963 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:31:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.709+0000 7f2397fefb80 1 -- 172.21.15.151:0/764627696 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558892f14ff0 con 0x558893076490 2023-07-21T22:31:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.709+0000 7f2381b9a700 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558893076490 0x558893078870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.710+0000 7f2381b9a700 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558893076490 0x558893078870 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d810c72f0aca0eb4 server_cookie=7f20ee099955b78a in_seq=0 out_seq=0 2023-07-21T22:31:08.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.710+0000 7f2365ffb700 10 client.26963 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.732+0000 7f2365ffb700 1 -- 172.21.15.151:0/764627696 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558892f14ff0 con 0x558893076490 2023-07-21T22:31:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.732+0000 7f2365ffb700 10 client.26963 handle_command_reply: tid=0 2023-07-21T22:31:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.732+0000 7f2397fefb80 1 client.26963 shutdown 2023-07-21T22:31:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.732+0000 7f2397fefb80 1 -- 172.21.15.151:0/764627696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 msgr2=0x558893069b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:08.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.732+0000 7f2397fefb80 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893069b90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f23780981f0 tx=0x7f23780b82e0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2397fefb80 1 -- 172.21.15.151:0/764627696 shutdown_connections 2023-07-21T22:31:08.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2397fefb80 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558893076490 0x558893078870 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2365ffb700 0 client.26963 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2397fefb80 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558892e646b0 0x558893069b90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2397fefb80 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55889300e660 0x558893074a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2397fefb80 1 --2- 172.21.15.151:0/764627696 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55889300e210 0x55889306a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2397fefb80 1 -- 172.21.15.151:0/764627696 >> 172.21.15.151:0/764627696 conn(0x558892ffdae0 msgr2=0x558893011890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2397fefb80 1 -- 172.21.15.151:0/764627696 shutdown_connections 2023-07-21T22:31:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2397fefb80 1 -- 172.21.15.151:0/764627696 wait complete. 2023-07-21T22:31:08.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.733+0000 7f2397fefb80 20 client.26963 trim_cache size 0 max 16384 2023-07-21T22:31:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:31:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:31:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:31:08.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:31:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 -- 172.21.15.151:0/3991894347 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f23680a1340 msgr2=0x7f23680a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f23680a1340 0x7f23680a37f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f2374009fd0 tx=0x7f237400b040 comp rx=0 tx=0).stop 2023-07-21T22:31:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 -- 172.21.15.151:0/3991894347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 msgr2=0x7f237c197e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 0x7f237c197e20 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f237800e9a0 tx=0x7f237800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 -- 172.21.15.151:0/3991894347 shutdown_connections 2023-07-21T22:31:08.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f23680a1340 0x7f23680a37f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f237c0ffb00 0x7f237c197e20 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f237c105b10 0x7f237c19c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 --2- 172.21.15.151:0/3991894347 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f237c1004b0 0x7f237c198360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 -- 172.21.15.151:0/3991894347 >> 172.21.15.151:0/3991894347 conn(0x7f237c0fb600 msgr2=0x7f237c10ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 -- 172.21.15.151:0/3991894347 shutdown_connections 2023-07-21T22:31:08.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:08.734+0000 7f23845ff700 1 -- 172.21.15.151:0/3991894347 wait complete. 2023-07-21T22:31:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:08 smithi187 ceph-mon[96918]: pgmap v371: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 21 MiB/s wr, 381 op/s 2023-07-21T22:31:08.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:08 smithi195 ceph-mon[97365]: pgmap v371: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 21 MiB/s wr, 381 op/s 2023-07-21T22:31:08.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:08 smithi151 ceph-mon[95510]: pgmap v371: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 21 MiB/s wr, 381 op/s 2023-07-21T22:31:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:10 smithi187 ceph-mon[96918]: pgmap v372: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 9.7 MiB/s wr, 341 op/s 2023-07-21T22:31:10.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:10 smithi187 ceph-mon[96918]: osdmap e99: 12 total, 12 up, 12 in 2023-07-21T22:31:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:10 smithi195 ceph-mon[97365]: pgmap v372: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 9.7 MiB/s wr, 341 op/s 2023-07-21T22:31:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:10 smithi195 ceph-mon[97365]: osdmap e99: 12 total, 12 up, 12 in 2023-07-21T22:31:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:10 smithi151 ceph-mon[95510]: pgmap v372: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 9.7 MiB/s wr, 341 op/s 2023-07-21T22:31:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:10 smithi151 ceph-mon[95510]: osdmap e99: 12 total, 12 up, 12 in 2023-07-21T22:31:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:12 smithi187 ceph-mon[96918]: pgmap v374: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 12 MiB/s wr, 409 op/s 2023-07-21T22:31:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:12 smithi195 ceph-mon[97365]: pgmap v374: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 12 MiB/s wr, 409 op/s 2023-07-21T22:31:12.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:12 smithi151 ceph-mon[95510]: pgmap v374: 97 pgs: 97 active+clean; 10 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 12 MiB/s wr, 409 op/s 2023-07-21T22:31:14.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:14 smithi187 ceph-mon[96918]: pgmap v375: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.6 MiB/s wr, 547 op/s 2023-07-21T22:31:14.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:14 smithi195 ceph-mon[97365]: pgmap v375: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.6 MiB/s wr, 547 op/s 2023-07-21T22:31:14.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:14 smithi151 ceph-mon[95510]: pgmap v375: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.6 MiB/s wr, 547 op/s 2023-07-21T22:31:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:16 smithi187 ceph-mon[96918]: pgmap v376: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.6 MiB/s wr, 547 op/s 2023-07-21T22:31:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:16 smithi187 ceph-mon[96918]: osdmap e100: 12 total, 12 up, 12 in 2023-07-21T22:31:16.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:16 smithi195 ceph-mon[97365]: pgmap v376: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.6 MiB/s wr, 547 op/s 2023-07-21T22:31:16.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:16 smithi195 ceph-mon[97365]: osdmap e100: 12 total, 12 up, 12 in 2023-07-21T22:31:16.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:16 smithi151 ceph-mon[95510]: pgmap v376: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 4.6 MiB/s wr, 547 op/s 2023-07-21T22:31:16.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:16 smithi151 ceph-mon[95510]: osdmap e100: 12 total, 12 up, 12 in 2023-07-21T22:31:18.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:18 smithi187 ceph-mon[96918]: pgmap v378: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 634 op/s 2023-07-21T22:31:18.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:18 smithi195 ceph-mon[97365]: pgmap v378: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 634 op/s 2023-07-21T22:31:18.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:18 smithi151 ceph-mon[95510]: pgmap v378: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.8 MiB/s wr, 634 op/s 2023-07-21T22:31:20.885 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:20 smithi187 ceph-mon[96918]: pgmap v379: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.1 MiB/s wr, 533 op/s 2023-07-21T22:31:20.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:20 smithi195 ceph-mon[97365]: pgmap v379: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.1 MiB/s wr, 533 op/s 2023-07-21T22:31:20.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:20 smithi151 ceph-mon[95510]: pgmap v379: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.1 MiB/s wr, 533 op/s 2023-07-21T22:31:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.904+0000 7fc3273ff700 1 -- 172.21.15.151:0/889480899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc320101fd0 msgr2=0x7fc3201023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.904+0000 7fc3273ff700 1 --2- 172.21.15.151:0/889480899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc320101fd0 0x7fc3201023a0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc31c009990 tx=0x7fc31c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.904+0000 7fc3273ff700 1 -- 172.21.15.151:0/889480899 shutdown_connections 2023-07-21T22:31:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.904+0000 7fc3273ff700 1 --2- 172.21.15.151:0/889480899 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc320101fd0 0x7fc3201023a0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.904+0000 7fc3273ff700 1 --2- 172.21.15.151:0/889480899 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc320107010 0x7fc32010ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.904+0000 7fc3273ff700 1 --2- 172.21.15.151:0/889480899 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc320102970 0x7fc320106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.904+0000 7fc3273ff700 1 -- 172.21.15.151:0/889480899 >> 172.21.15.151:0/889480899 conn(0x7fc3200fd840 msgr2=0x7fc3200ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.904+0000 7fc3273ff700 1 -- 172.21.15.151:0/889480899 shutdown_connections 2023-07-21T22:31:21.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.904+0000 7fc3273ff700 1 -- 172.21.15.151:0/889480899 wait complete. 2023-07-21T22:31:21.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.905+0000 7fc3273ff700 1 Processor -- start 2023-07-21T22:31:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc3273ff700 1 -- start start 2023-07-21T22:31:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc3273ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc320101fd0 0x7fc320197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc3273ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc320102970 0x7fc3201983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc3273ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc320107010 0x7fc32019ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc3273ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32019d060 con 0x7fc320101fd0 2023-07-21T22:31:21.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc3273ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32019d1d0 con 0x7fc320107010 2023-07-21T22:31:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc3273ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32019d390 con 0x7fc320102970 2023-07-21T22:31:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc32499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc320102970 0x7fc3201983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc32519b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc320101fd0 0x7fc320197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc32499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc320102970 0x7fc3201983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56782/0 (socket says 172.21.15.151:56782) 2023-07-21T22:31:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc32499a700 1 -- 172.21.15.151:0/1544404939 learned_addr learned my addr 172.21.15.151:0/1544404939 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.906+0000 7fc32599c700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc320107010 0x7fc32019ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.907+0000 7fc32519b700 1 -- 172.21.15.151:0/1544404939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc320102970 msgr2=0x7fc3201983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.907+0000 7fc32519b700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc320102970 0x7fc3201983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.907+0000 7fc32519b700 1 -- 172.21.15.151:0/1544404939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc320107010 msgr2=0x7fc32019ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.907+0000 7fc32519b700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc320107010 0x7fc32019ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.907+0000 7fc32519b700 1 -- 172.21.15.151:0/1544404939 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc318009c40 con 0x7fc320101fd0 2023-07-21T22:31:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.907+0000 7fc32599c700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc320107010 0x7fc32019ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:21.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.907+0000 7fc32519b700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc320101fd0 0x7fc320197e70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0098e0 tx=0x7fc31c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.907+0000 7fc3167fc700 1 -- 172.21.15.151:0/1544404939 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c01d070 con 0x7fc320101fd0 2023-07-21T22:31:21.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.908+0000 7fc3273ff700 1 -- 172.21.15.151:0/1544404939 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc31c0095f0 con 0x7fc320101fd0 2023-07-21T22:31:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.908+0000 7fc3167fc700 1 -- 172.21.15.151:0/1544404939 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc31c021410 con 0x7fc320101fd0 2023-07-21T22:31:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.908+0000 7fc3167fc700 1 -- 172.21.15.151:0/1544404939 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c017650 con 0x7fc320101fd0 2023-07-21T22:31:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.908+0000 7fc3273ff700 1 -- 172.21.15.151:0/1544404939 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3201a4cd0 con 0x7fc320101fd0 2023-07-21T22:31:21.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.911+0000 7fc3167fc700 1 -- 172.21.15.151:0/1544404939 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fc31c021580 con 0x7fc320101fd0 2023-07-21T22:31:21.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.913+0000 7fc33ac93b80 1 Processor -- start 2023-07-21T22:31:21.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.913+0000 7fc33ac93b80 1 -- start start 2023-07-21T22:31:21.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.913+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b0028a66b0 0x55b002a4fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.913+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 0x55b002a49f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.913+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 0x55b002a4a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.913+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b00294fc50 con 0x55b002a50660 2023-07-21T22:31:21.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.913+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b0029a29e0 con 0x55b002a50210 2023-07-21T22:31:21.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.913+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b00299be70 con 0x55b0028a66b0 2023-07-21T22:31:21.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.914+0000 7fc3167fc700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc30c0a12c0 0x7fc30c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.914+0000 7fc32599c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b0028a66b0 0x55b002a4fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.914+0000 7fc32599c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b0028a66b0 0x55b002a4fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56790/0 (socket says 172.21.15.151:56790) 2023-07-21T22:31:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.914+0000 7fc32599c700 1 -- 172.21.15.151:0/902287228 learned_addr learned my addr 172.21.15.151:0/902287228 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.914+0000 7fc32499a700 1 --2- 172.21.15.151:0/902287228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 0x55b002a4a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.914+0000 7fc32519b700 1 --2- 172.21.15.151:0/902287228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 0x55b002a49f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.914+0000 7fc32599c700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc30c0a12c0 0x7fc30c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.915+0000 7fc32599c700 1 -- 172.21.15.151:0/902287228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 msgr2=0x55b002a49f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.915+0000 7fc32599c700 1 --2- 172.21.15.151:0/902287228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 0x55b002a49f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.915+0000 7fc32599c700 1 -- 172.21.15.151:0/902287228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 msgr2=0x55b002a4a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.915+0000 7fc32599c700 1 --2- 172.21.15.151:0/902287228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 0x55b002a4a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.915+0000 7fc32599c700 1 -- 172.21.15.151:0/902287228 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b0027c9d80 con 0x55b0028a66b0 2023-07-21T22:31:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.915+0000 7fc3167fc700 1 -- 172.21.15.151:0/1544404939 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc31c0cdec0 con 0x7fc320101fd0 2023-07-21T22:31:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.915+0000 7fc32599c700 1 --2- 172.21.15.151:0/902287228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b0028a66b0 0x55b002a4fcd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc318008c70 tx=0x7fc318008f80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dcd2413d6c36c79 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.915+0000 7fc32599c700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc30c0a12c0 0x7fc30c0a3770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc318011000 tx=0x7fc31801e000 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.915+0000 7fc30b7fe700 1 -- 172.21.15.151:0/902287228 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31801aab0 con 0x55b0028a66b0 2023-07-21T22:31:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.916+0000 7fc30b7fe700 1 -- 172.21.15.151:0/902287228 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc31800f040 con 0x55b0028a66b0 2023-07-21T22:31:21.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.916+0000 7fc30b7fe700 1 -- 172.21.15.151:0/902287228 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc318022e60 con 0x55b0028a66b0 2023-07-21T22:31:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.916+0000 7fc33ac93b80 1 -- 172.21.15.151:0/902287228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b0028a66b0 msgr2=0x55b002a4fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.916+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/902287228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b0028a66b0 0x55b002a4fcd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fc318008c70 tx=0x7fc318008f80 comp rx=0 tx=0).stop 2023-07-21T22:31:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.917+0000 7fc33ac93b80 1 -- 172.21.15.151:0/902287228 shutdown_connections 2023-07-21T22:31:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.917+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/902287228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 0x55b002a4a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.917+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/902287228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b0028a66b0 0x55b002a4fcd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.917+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/902287228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 0x55b002a49f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.917+0000 7fc33ac93b80 1 -- 172.21.15.151:0/902287228 >> 172.21.15.151:0/902287228 conn(0x55b002a3fae0 msgr2=0x55b002a450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.917+0000 7fc33ac93b80 1 -- 172.21.15.151:0/902287228 shutdown_connections 2023-07-21T22:31:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.917+0000 7fc33ac93b80 1 -- 172.21.15.151:0/902287228 wait complete. 2023-07-21T22:31:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.917+0000 7fc33ac93b80 1 -- start start 2023-07-21T22:31:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.918+0000 7fc33ac93b80 1 Processor -- start 2023-07-21T22:31:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.918+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.918+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 0x55b002a59ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.918+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50660 0x55b002a53850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.918+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b00293ba60 con 0x55b0028a66b0 2023-07-21T22:31:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.918+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b00293b760 con 0x55b002a50210 2023-07-21T22:31:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.918+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b00281f8c0 con 0x55b002a50660 2023-07-21T22:31:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.918+0000 7fc33ac93b80 10 client.0 _ll_register_callbacks cb 0x55b002939700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:31:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.918+0000 7fc32519b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32519b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54818/0 (socket says 172.21.15.151:54818) 2023-07-21T22:31:21.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32519b700 1 -- 172.21.15.151:0/3552124813 learned_addr learned my addr 172.21.15.151:0/3552124813 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32599c700 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50660 0x55b002a53850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32499a700 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 0x55b002a59ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32519b700 1 -- 172.21.15.151:0/3552124813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50660 msgr2=0x55b002a53850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32519b700 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50660 0x55b002a53850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32519b700 1 -- 172.21.15.151:0/3552124813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 msgr2=0x55b002a59ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32519b700 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 0x55b002a59ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32519b700 1 -- 172.21.15.151:0/3552124813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc318008830 con 0x55b0028a66b0 2023-07-21T22:31:21.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32599c700 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50660 0x55b002a53850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc32519b700 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59590 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc31c097a50 tx=0x7fc31c029000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce04a6316e66c29f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc308ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:31:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.919+0000 7fc308ff9700 1 -- 172.21.15.151:0/3552124813 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c09b440 con 0x55b0028a66b0 2023-07-21T22:31:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.920+0000 7fc308ff9700 1 -- 172.21.15.151:0/3552124813 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc31c027470 con 0x55b0028a66b0 2023-07-21T22:31:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.920+0000 7fc33ac93b80 1 -- 172.21.15.151:0/3552124813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b0028f5490 con 0x55b0028a66b0 2023-07-21T22:31:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.920+0000 7fc308ff9700 1 -- 172.21.15.151:0/3552124813 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc31c09afe0 con 0x55b0028a66b0 2023-07-21T22:31:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.920+0000 7fc33ac93b80 10 client.17280 fetch_fsmap learned FSMap version 52 2023-07-21T22:31:21.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.920+0000 7fc33ac93b80 1 -- 172.21.15.151:0/3552124813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55b0027b2c00 con 0x55b0028a66b0 2023-07-21T22:31:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.920+0000 7fc308ff9700 1 -- 172.21.15.151:0/3552124813 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b0028f5490 con 0x55b0028a66b0 2023-07-21T22:31:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.920+0000 7fc308ff9700 1 -- 172.21.15.151:0/3552124813 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc31c0cbd20 con 0x55b0028a66b0 2023-07-21T22:31:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.920+0000 7fc33ac93b80 10 client.17280 fetch_fsmap finished waiting for FSMap version 52 2023-07-21T22:31:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.920+0000 7fc33ac93b80 10 client.17280 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:31:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.921+0000 7fc33ac93b80 20 client.17280 populate_metadata read hostname 'smithi151' 2023-07-21T22:31:21.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.921+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b002a635a0 0x55b002a659b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.921+0000 7fc33ac93b80 4 client.17280 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:31:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.921+0000 7fc33ac93b80 1 -- 172.21.15.151:0/3552124813 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b002994e50 con 0x55b002a635a0 2023-07-21T22:31:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.921+0000 7fc32499a700 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b002a635a0 0x55b002a659b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.921+0000 7fc32499a700 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b002a635a0 0x55b002a659b0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b23247113d063dd server_cookie=3f03312bd9167ea7 in_seq=0 out_seq=0 2023-07-21T22:31:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.921+0000 7fc308ff9700 10 client.17280 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc308ff9700 1 -- 172.21.15.151:0/3552124813 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b002994e50 con 0x55b002a635a0 2023-07-21T22:31:21.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc308ff9700 10 client.17280 handle_command_reply: tid=0 2023-07-21T22:31:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc33ac93b80 1 client.17280 shutdown 2023-07-21T22:31:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc33ac93b80 1 -- 172.21.15.151:0/3552124813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 msgr2=0x55b002a59590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59590 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc31c097a50 tx=0x7fc31c029000 comp rx=0 tx=0).stop 2023-07-21T22:31:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc33ac93b80 1 -- 172.21.15.151:0/3552124813 shutdown_connections 2023-07-21T22:31:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b002a635a0 0x55b002a659b0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50660 0x55b002a53850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59590 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/3552124813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50210 0x55b002a59ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc308ff9700 0 client.17280 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.922+0000 7fc33ac93b80 1 -- 172.21.15.151:0/3552124813 >> 172.21.15.151:0/3552124813 conn(0x55b002a3fae0 msgr2=0x55b002a443e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.923+0000 7fc33ac93b80 1 -- 172.21.15.151:0/3552124813 shutdown_connections 2023-07-21T22:31:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.923+0000 7fc33ac93b80 1 -- 172.21.15.151:0/3552124813 wait complete. 2023-07-21T22:31:21.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.923+0000 7fc33ac93b80 20 client.17280 trim_cache size 0 max 16384 2023-07-21T22:31:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.940+0000 7fc33ac93b80 1 Processor -- start 2023-07-21T22:31:21.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.940+0000 7fc33ac93b80 1 -- start start 2023-07-21T22:31:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0028a66b0 0x55b002a4f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a44b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 0x55b002a4c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b002a45fa0 con 0x55b002a50660 2023-07-21T22:31:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b002a4b190 con 0x55b0028a66b0 2023-07-21T22:31:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b002a4e550 con 0x55b002a50210 2023-07-21T22:31:21.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc32499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a44b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc32599c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 0x55b002a4c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc32499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a44b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56804/0 (socket says 172.21.15.151:56804) 2023-07-21T22:31:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc32499a700 1 -- 172.21.15.151:0/1056945517 learned_addr learned my addr 172.21.15.151:0/1056945517 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.941+0000 7fc32519b700 1 --2- 172.21.15.151:0/1056945517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0028a66b0 0x55b002a4f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc32499a700 1 -- 172.21.15.151:0/1056945517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0028a66b0 msgr2=0x55b002a4f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc32499a700 1 --2- 172.21.15.151:0/1056945517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0028a66b0 0x55b002a4f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc32499a700 1 -- 172.21.15.151:0/1056945517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 msgr2=0x55b002a4c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc32499a700 1 --2- 172.21.15.151:0/1056945517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 0x55b002a4c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc32499a700 1 -- 172.21.15.151:0/1056945517 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b002a6a5e0 con 0x55b002a50210 2023-07-21T22:31:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc32519b700 1 --2- 172.21.15.151:0/1056945517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0028a66b0 0x55b002a4f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc32499a700 1 --2- 172.21.15.151:0/1056945517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a44b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55b002a662c0 tx=0x7fc310009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c62d8ab1172605ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc30bfff700 1 -- 172.21.15.151:0/1056945517 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310016040 con 0x55b002a50210 2023-07-21T22:31:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc30bfff700 1 -- 172.21.15.151:0/1056945517 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc310017040 con 0x55b002a50210 2023-07-21T22:31:21.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.942+0000 7fc30bfff700 1 -- 172.21.15.151:0/1056945517 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc310004570 con 0x55b002a50210 2023-07-21T22:31:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.943+0000 7fc33ac93b80 1 -- 172.21.15.151:0/1056945517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 msgr2=0x55b002a44b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.943+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/1056945517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a44b60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x55b002a662c0 tx=0x7fc310009260 comp rx=0 tx=0).stop 2023-07-21T22:31:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.943+0000 7fc33ac93b80 1 -- 172.21.15.151:0/1056945517 shutdown_connections 2023-07-21T22:31:21.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.943+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/1056945517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b0028a66b0 0x55b002a4f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.943+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/1056945517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b002a50660 0x55b002a4c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.943+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/1056945517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a44b60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.943+0000 7fc33ac93b80 1 -- 172.21.15.151:0/1056945517 >> 172.21.15.151:0/1056945517 conn(0x55b002a3fae0 msgr2=0x55b002a4e960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.943+0000 7fc33ac93b80 1 -- 172.21.15.151:0/1056945517 shutdown_connections 2023-07-21T22:31:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.943+0000 7fc33ac93b80 1 -- 172.21.15.151:0/1056945517 wait complete. 2023-07-21T22:31:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.944+0000 7fc33ac93b80 1 -- start start 2023-07-21T22:31:21.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.944+0000 7fc33ac93b80 1 Processor -- start 2023-07-21T22:31:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.944+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.944+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a57950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.944+0000 7fc33ac93b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50660 0x55b002a57e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b002a583d0 con 0x55b0028a66b0 2023-07-21T22:31:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b002a58540 con 0x55b002a50660 2023-07-21T22:31:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc33ac93b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b002a58700 con 0x55b002a50210 2023-07-21T22:31:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc33ac93b80 10 client.0 _ll_register_callbacks cb 0x7fc31c09adb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:31:21.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc32519b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc32519b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54834/0 (socket says 172.21.15.151:54834) 2023-07-21T22:31:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc32519b700 1 -- 172.21.15.151:0/819799822 learned_addr learned my addr 172.21.15.151:0/819799822 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc32599c700 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50660 0x55b002a57e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc32499a700 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a57950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc32519b700 1 -- 172.21.15.151:0/819799822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 msgr2=0x55b002a57950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc32519b700 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a57950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc32519b700 1 -- 172.21.15.151:0/819799822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50660 msgr2=0x55b002a57e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.945+0000 7fc32519b700 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50660 0x55b002a57e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc32519b700 1 -- 172.21.15.151:0/819799822 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b0027b2c00 con 0x55b0028a66b0 2023-07-21T22:31:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc32599c700 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50660 0x55b002a57e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc32519b700 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59620 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc31c099330 tx=0x7fc31c0cbb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90ae740897d043e8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc308ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:31:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc308ff9700 1 -- 172.21.15.151:0/819799822 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc31c0a31a0 con 0x55b0028a66b0 2023-07-21T22:31:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc308ff9700 1 -- 172.21.15.151:0/819799822 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc31c0a2f60 con 0x55b0028a66b0 2023-07-21T22:31:21.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc33ac93b80 1 -- 172.21.15.151:0/819799822 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc31800f040 con 0x55b0028a66b0 2023-07-21T22:31:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc308ff9700 1 -- 172.21.15.151:0/819799822 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc31c09afe0 con 0x55b0028a66b0 2023-07-21T22:31:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc33ac93b80 10 client.17286 fetch_fsmap learned FSMap version 52 2023-07-21T22:31:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.946+0000 7fc33ac93b80 1 -- 172.21.15.151:0/819799822 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x7fc310009c60 con 0x55b0028a66b0 2023-07-21T22:31:21.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.947+0000 7fc308ff9700 1 -- 172.21.15.151:0/819799822 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc31800f040 con 0x55b0028a66b0 2023-07-21T22:31:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.947+0000 7fc308ff9700 1 -- 172.21.15.151:0/819799822 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fc31c021860 con 0x55b0028a66b0 2023-07-21T22:31:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.947+0000 7fc33ac93b80 10 client.17286 fetch_fsmap finished waiting for FSMap version 52 2023-07-21T22:31:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.947+0000 7fc33ac93b80 10 client.17286 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:31:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.947+0000 7fc33ac93b80 20 client.17286 populate_metadata read hostname 'smithi151' 2023-07-21T22:31:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.947+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b002ab84b0 0x55b002aba8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:21.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.947+0000 7fc33ac93b80 4 client.17286 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:31:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.947+0000 7fc33ac93b80 1 -- 172.21.15.151:0/819799822 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b002956ff0 con 0x55b002ab84b0 2023-07-21T22:31:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.947+0000 7fc32499a700 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b002ab84b0 0x55b002aba8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.948+0000 7fc32499a700 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b002ab84b0 0x55b002aba8c0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41b1d8b47f4e4ba9 server_cookie=46f54f870a9c6168 in_seq=0 out_seq=0 2023-07-21T22:31:22.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.948+0000 7fc308ff9700 10 client.17286 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:22.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.961+0000 7fc308ff9700 1 -- 172.21.15.151:0/819799822 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b002956ff0 con 0x55b002ab84b0 2023-07-21T22:31:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.961+0000 7fc308ff9700 10 client.17286 handle_command_reply: tid=0 2023-07-21T22:31:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.961+0000 7fc33ac93b80 1 client.17286 shutdown 2023-07-21T22:31:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 -- 172.21.15.151:0/819799822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 msgr2=0x55b002a59620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59620 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc31c099330 tx=0x7fc31c0cbb30 comp rx=0 tx=0).stop 2023-07-21T22:31:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 -- 172.21.15.151:0/819799822 shutdown_connections 2023-07-21T22:31:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b002ab84b0 0x55b002aba8c0 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b002a50660 0x55b002a57e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b0028a66b0 0x55b002a59620 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 --2- 172.21.15.151:0/819799822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b002a50210 0x55b002a57950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 -- 172.21.15.151:0/819799822 >> 172.21.15.151:0/819799822 conn(0x55b002a3fae0 msgr2=0x55b002a50aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:22.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc308ff9700 0 client.17286 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 -- 172.21.15.151:0/819799822 shutdown_connections 2023-07-21T22:31:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 1 -- 172.21.15.151:0/819799822 wait complete. 2023-07-21T22:31:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.962+0000 7fc33ac93b80 20 client.17286 trim_cache size 0 max 16384 2023-07-21T22:31:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:31:22.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:31:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:31:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:31:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 -- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc30c0a12c0 msgr2=0x7fc30c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc30c0a12c0 0x7fc30c0a3770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc318011000 tx=0x7fc31801e000 comp rx=0 tx=0).stop 2023-07-21T22:31:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 -- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc320101fd0 msgr2=0x7fc320197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc320101fd0 0x7fc320197e70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc31c0098e0 tx=0x7fc31c005740 comp rx=0 tx=0).stop 2023-07-21T22:31:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 -- 172.21.15.151:0/1544404939 shutdown_connections 2023-07-21T22:31:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc30c0a12c0 0x7fc30c0a3770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc320107010 0x7fc32019ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc320101fd0 0x7fc320197e70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 --2- 172.21.15.151:0/1544404939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc320102970 0x7fc3201983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 -- 172.21.15.151:0/1544404939 >> 172.21.15.151:0/1544404939 conn(0x7fc3200fd840 msgr2=0x7fc3200fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 -- 172.21.15.151:0/1544404939 shutdown_connections 2023-07-21T22:31:22.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:21.963+0000 7fc3273ff700 1 -- 172.21.15.151:0/1544404939 wait complete. 2023-07-21T22:31:22.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:22 smithi187 ceph-mon[96918]: pgmap v380: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.9 MiB/s wr, 507 op/s 2023-07-21T22:31:22.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:22 smithi195 ceph-mon[97365]: pgmap v380: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.9 MiB/s wr, 507 op/s 2023-07-21T22:31:22.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:22 smithi151 ceph-mon[95510]: pgmap v380: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.9 MiB/s wr, 507 op/s 2023-07-21T22:31:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:24 smithi187 ceph-mon[96918]: pgmap v381: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 501 op/s 2023-07-21T22:31:24.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:24 smithi195 ceph-mon[97365]: pgmap v381: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 501 op/s 2023-07-21T22:31:24.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:24 smithi151 ceph-mon[95510]: pgmap v381: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 501 op/s 2023-07-21T22:31:26.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:26 smithi187 ceph-mon[96918]: pgmap v382: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 501 op/s 2023-07-21T22:31:26.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:26 smithi195 ceph-mon[97365]: pgmap v382: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 501 op/s 2023-07-21T22:31:26.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:26 smithi151 ceph-mon[95510]: pgmap v382: 97 pgs: 97 active+clean; 9.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 501 op/s 2023-07-21T22:31:28.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:28 smithi187 ceph-mon[96918]: pgmap v383: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.5 MiB/s wr, 720 op/s 2023-07-21T22:31:28.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:28 smithi195 ceph-mon[97365]: pgmap v383: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.5 MiB/s wr, 720 op/s 2023-07-21T22:31:28.955 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:28 smithi151 ceph-mon[95510]: pgmap v383: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.5 MiB/s wr, 720 op/s 2023-07-21T22:31:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:30 smithi187 ceph-mon[96918]: pgmap v384: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 441 op/s 2023-07-21T22:31:30.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:30 smithi195 ceph-mon[97365]: pgmap v384: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 441 op/s 2023-07-21T22:31:30.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:30 smithi151 ceph-mon[95510]: pgmap v384: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 441 op/s 2023-07-21T22:31:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:32 smithi187 ceph-mon[96918]: pgmap v385: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 441 op/s 2023-07-21T22:31:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:32 smithi195 ceph-mon[97365]: pgmap v385: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 441 op/s 2023-07-21T22:31:32.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:32 smithi151 ceph-mon[95510]: pgmap v385: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 441 op/s 2023-07-21T22:31:33.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:33 smithi195 ceph-mon[97365]: pgmap v386: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.0 MiB/s wr, 649 op/s 2023-07-21T22:31:33.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:33 smithi151 ceph-mon[95510]: pgmap v386: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.0 MiB/s wr, 649 op/s 2023-07-21T22:31:34.130 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:33 smithi187 ceph-mon[96918]: pgmap v386: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.0 MiB/s wr, 649 op/s 2023-07-21T22:31:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.130+0000 7f97bc3ff700 1 -- 172.21.15.151:0/4003395091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97b4105b10 msgr2=0x7f97b4105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.130+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/4003395091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97b4105b10 0x7f97b4105ee0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f97b0009990 tx=0x7f97b0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.130+0000 7f97bc3ff700 1 -- 172.21.15.151:0/4003395091 shutdown_connections 2023-07-21T22:31:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.130+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/4003395091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97b4105b10 0x7f97b4105ee0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.130+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/4003395091 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b41004b0 0x7f97b410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.130+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/4003395091 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b40ffb00 0x7f97b40fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.130+0000 7f97bc3ff700 1 -- 172.21.15.151:0/4003395091 >> 172.21.15.151:0/4003395091 conn(0x7f97b40fb600 msgr2=0x7f97b40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.130+0000 7f97bc3ff700 1 -- 172.21.15.151:0/4003395091 shutdown_connections 2023-07-21T22:31:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.130+0000 7f97bc3ff700 1 -- 172.21.15.151:0/4003395091 wait complete. 2023-07-21T22:31:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.131+0000 7f97bc3ff700 1 Processor -- start 2023-07-21T22:31:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97bc3ff700 1 -- start start 2023-07-21T22:31:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97bc3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b40ffb00 0x7f97b4197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97bc3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b41004b0 0x7f97b41982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97bc3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97b4105b10 0x7f97b419c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97bc3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b419cf50 con 0x7f97b40ffb00 2023-07-21T22:31:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97bc3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b419d0c0 con 0x7f97b4105b10 2023-07-21T22:31:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97bc3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97b419d280 con 0x7f97b41004b0 2023-07-21T22:31:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97ba19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b40ffb00 0x7f97b4197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97b999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b41004b0 0x7f97b41982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97b999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b41004b0 0x7f97b41982a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47910/0 (socket says 172.21.15.151:47910) 2023-07-21T22:31:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97b999a700 1 -- 172.21.15.151:0/1259817156 learned_addr learned my addr 172.21.15.151:0/1259817156 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.132+0000 7f97ba19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b40ffb00 0x7f97b4197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50264/0 (socket says 172.21.15.151:50264) 2023-07-21T22:31:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97ba99c700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97b4105b10 0x7f97b419c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97ba19b700 1 -- 172.21.15.151:0/1259817156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b41004b0 msgr2=0x7f97b41982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97ba19b700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b41004b0 0x7f97b41982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97ba19b700 1 -- 172.21.15.151:0/1259817156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97b4105b10 msgr2=0x7f97b419c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97ba19b700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97b4105b10 0x7f97b419c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97ba19b700 1 -- 172.21.15.151:0/1259817156 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97b00095f0 con 0x7f97b40ffb00 2023-07-21T22:31:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97ba99c700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97b4105b10 0x7f97b419c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97b999a700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b41004b0 0x7f97b41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97ba19b700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b40ffb00 0x7f97b4197d60 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f97b0005910 tx=0x7f97b0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.133+0000 7f97ab7fe700 1 -- 172.21.15.151:0/1259817156 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b001d070 con 0x7f97b40ffb00 2023-07-21T22:31:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.134+0000 7f97bc3ff700 1 -- 172.21.15.151:0/1259817156 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97b419d500 con 0x7f97b40ffb00 2023-07-21T22:31:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.134+0000 7f97ab7fe700 1 -- 172.21.15.151:0/1259817156 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97b0022470 con 0x7f97b40ffb00 2023-07-21T22:31:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.134+0000 7f97ab7fe700 1 -- 172.21.15.151:0/1259817156 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b0017650 con 0x7f97b40ffb00 2023-07-21T22:31:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.134+0000 7f97bc3ff700 1 -- 172.21.15.151:0/1259817156 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b41a4da0 con 0x7f97b40ffb00 2023-07-21T22:31:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.138+0000 7f97ab7fe700 1 -- 172.21.15.151:0/1259817156 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f97b00225e0 con 0x7f97b40ffb00 2023-07-21T22:31:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97cfda1b80 1 Processor -- start 2023-07-21T22:31:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97cfda1b80 1 -- start start 2023-07-21T22:31:35.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97ab7fe700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f97a00a12c0 0x7f97a00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bd2f6b0 0x55762bed8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 0x55762bed2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bed9660 0x55762bed34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97ab7fe700 1 -- 172.21.15.151:0/1259817156 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f97b00ce0d0 con 0x7f97b40ffb00 2023-07-21T22:31:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762bdd8c50 con 0x55762bed9210 2023-07-21T22:31:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762be2b9e0 con 0x55762bd2f6b0 2023-07-21T22:31:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.139+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762be24e70 con 0x55762bed9660 2023-07-21T22:31:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba99c700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f97a00a12c0 0x7f97a00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bd2f6b0 0x55762bed8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bd2f6b0 0x55762bed8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40870/0 (socket says 172.21.15.151:40870) 2023-07-21T22:31:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba19b700 1 -- 172.21.15.151:0/2978227710 learned_addr learned my addr 172.21.15.151:0/2978227710 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba99c700 1 --2- 172.21.15.151:0/2978227710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bed9660 0x55762bed34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97b999a700 1 --2- 172.21.15.151:0/2978227710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 0x55762bed2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba19b700 1 -- 172.21.15.151:0/2978227710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bed9660 msgr2=0x55762bed34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:35.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba19b700 1 --2- 172.21.15.151:0/2978227710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bed9660 0x55762bed34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba19b700 1 -- 172.21.15.151:0/2978227710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 msgr2=0x55762bed2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba19b700 1 --2- 172.21.15.151:0/2978227710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 0x55762bed2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.140+0000 7f97ba19b700 1 -- 172.21.15.151:0/2978227710 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55762bc52d80 con 0x55762bd2f6b0 2023-07-21T22:31:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.141+0000 7f97ba99c700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f97a00a12c0 0x7f97a00a3770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009fd0 tx=0x7f97ac003cf0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.141+0000 7f97ba19b700 1 --2- 172.21.15.151:0/2978227710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bd2f6b0 0x55762bed8cd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f97b0097c60 tx=0x7f97b00975e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d434d99b62a4e39c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.141+0000 7f97a8bfe700 1 -- 172.21.15.151:0/2978227710 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b009ad30 con 0x55762bd2f6b0 2023-07-21T22:31:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.141+0000 7f97a8bfe700 1 -- 172.21.15.151:0/2978227710 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97b009ab50 con 0x55762bd2f6b0 2023-07-21T22:31:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.141+0000 7f97a8bfe700 1 -- 172.21.15.151:0/2978227710 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b005efd0 con 0x55762bd2f6b0 2023-07-21T22:31:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.142+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2978227710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bd2f6b0 msgr2=0x55762bed8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.142+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2978227710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bd2f6b0 0x55762bed8cd0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f97b0097c60 tx=0x7f97b00975e0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.142+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2978227710 shutdown_connections 2023-07-21T22:31:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.142+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2978227710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bd2f6b0 0x55762bed8cd0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.142+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2978227710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bed9660 0x55762bed34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.142+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2978227710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 0x55762bed2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.142+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2978227710 >> 172.21.15.151:0/2978227710 conn(0x55762bec8ae0 msgr2=0x55762bece0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.142+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2978227710 shutdown_connections 2023-07-21T22:31:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.142+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2978227710 wait complete. 2023-07-21T22:31:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.143+0000 7f97cfda1b80 1 -- start start 2023-07-21T22:31:35.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.143+0000 7f97cfda1b80 1 Processor -- start 2023-07-21T22:31:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.143+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.143+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 0x55762bee2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.143+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 0x55762bedc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762bdc4a60 con 0x55762bed9660 2023-07-21T22:31:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762bdc4760 con 0x55762bed9210 2023-07-21T22:31:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762bca88c0 con 0x55762bd2f6b0 2023-07-21T22:31:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97cfda1b80 10 client.0 _ll_register_callbacks cb 0x55762bdc2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:31:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97ba19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97ba19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47928/0 (socket says 172.21.15.151:47928) 2023-07-21T22:31:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97ba19b700 1 -- 172.21.15.151:0/2250271277 learned_addr learned my addr 172.21.15.151:0/2250271277 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97ba99c700 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 0x55762bedc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97b999a700 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 0x55762bee2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97ba19b700 1 -- 172.21.15.151:0/2250271277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 msgr2=0x55762bee2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97ba19b700 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 0x55762bee2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97ba19b700 1 -- 172.21.15.151:0/2250271277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 msgr2=0x55762bedc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97ba19b700 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 0x55762bedc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.144+0000 7f97ba19b700 1 -- 172.21.15.151:0/2250271277 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97b41a4da0 con 0x55762bd2f6b0 2023-07-21T22:31:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.145+0000 7f97ba19b700 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee2210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f97b0022890 tx=0x7f97b0011110 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20d69f2e517f3247 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.145+0000 7f979dffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:31:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.145+0000 7f979dffb700 1 -- 172.21.15.151:0/2250271277 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97b009ad30 con 0x55762bd2f6b0 2023-07-21T22:31:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.145+0000 7f979dffb700 1 -- 172.21.15.151:0/2250271277 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f97b009b1f0 con 0x55762bd2f6b0 2023-07-21T22:31:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.145+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2250271277 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55762bd7e490 con 0x55762bd2f6b0 2023-07-21T22:31:35.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.145+0000 7f979dffb700 1 -- 172.21.15.151:0/2250271277 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97b00cbc70 con 0x55762bd2f6b0 2023-07-21T22:31:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.145+0000 7f97cfda1b80 10 client.27013 fetch_fsmap learned FSMap version 52 2023-07-21T22:31:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.145+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2250271277 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55762bc3bc00 con 0x55762bd2f6b0 2023-07-21T22:31:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.145+0000 7f979dffb700 1 -- 172.21.15.151:0/2250271277 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55762bd7e490 con 0x55762bd2f6b0 2023-07-21T22:31:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.146+0000 7f979dffb700 1 -- 172.21.15.151:0/2250271277 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f97b009a6e0 con 0x55762bd2f6b0 2023-07-21T22:31:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.146+0000 7f97cfda1b80 10 client.27013 fetch_fsmap finished waiting for FSMap version 52 2023-07-21T22:31:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.146+0000 7f97cfda1b80 10 client.27013 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:31:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.146+0000 7f97cfda1b80 20 client.27013 populate_metadata read hostname 'smithi151' 2023-07-21T22:31:35.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.146+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55762bef4b60 0x55762bef6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.146+0000 7f97cfda1b80 4 client.27013 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:31:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.146+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2250271277 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55762be1de50 con 0x55762bef4b60 2023-07-21T22:31:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.146+0000 7f97b999a700 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55762bef4b60 0x55762bef6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.147+0000 7f97b999a700 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55762bef4b60 0x55762bef6f70 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccdfdff748558509 server_cookie=277434755e6fb496 in_seq=0 out_seq=0 2023-07-21T22:31:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.147+0000 7f979dffb700 10 client.27013 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.147+0000 7f979dffb700 1 -- 172.21.15.151:0/2250271277 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55762be1de50 con 0x55762bef4b60 2023-07-21T22:31:35.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.147+0000 7f979dffb700 10 client.27013 handle_command_reply: tid=0 2023-07-21T22:31:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.147+0000 7f97cfda1b80 1 client.27013 shutdown 2023-07-21T22:31:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2250271277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 msgr2=0x55762bee2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee2210 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f97b0022890 tx=0x7f97b0011110 comp rx=0 tx=0).stop 2023-07-21T22:31:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2250271277 shutdown_connections 2023-07-21T22:31:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55762bef4b60 0x55762bef6f70 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 0x55762bedc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee2210 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2250271277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 0x55762bee2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2250271277 >> 172.21.15.151:0/2250271277 conn(0x55762bec8ae0 msgr2=0x55762beccb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f979dffb700 0 client.27013 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2250271277 shutdown_connections 2023-07-21T22:31:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2250271277 wait complete. 2023-07-21T22:31:35.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.148+0000 7f97cfda1b80 20 client.27013 trim_cache size 0 max 16384 2023-07-21T22:31:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.164+0000 7f97cfda1b80 1 Processor -- start 2023-07-21T22:31:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.164+0000 7f97cfda1b80 1 -- start start 2023-07-21T22:31:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.164+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bedb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.164+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 0x55762becdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.164+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9660 0x55762bece0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.164+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762becac00 con 0x55762bed9210 2023-07-21T22:31:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.164+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762bedda40 con 0x55762bed9660 2023-07-21T22:31:35.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.164+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762bed8920 con 0x55762bd2f6b0 2023-07-21T22:31:35.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97b999a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 0x55762becdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9660 0x55762bece0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9660 0x55762bece0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40874/0 (socket says 172.21.15.151:40874) 2023-07-21T22:31:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba99c700 1 -- 172.21.15.151:0/2087687664 learned_addr learned my addr 172.21.15.151:0/2087687664 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba19b700 1 --2- 172.21.15.151:0/2087687664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bedb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba99c700 1 -- 172.21.15.151:0/2087687664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 msgr2=0x55762bedb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba99c700 1 --2- 172.21.15.151:0/2087687664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bedb320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba99c700 1 -- 172.21.15.151:0/2087687664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 msgr2=0x55762becdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba99c700 1 --2- 172.21.15.151:0/2087687664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 0x55762becdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba99c700 1 -- 172.21.15.151:0/2087687664 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55762bc791f0 con 0x55762bed9660 2023-07-21T22:31:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.165+0000 7f97ba99c700 1 --2- 172.21.15.151:0/2087687664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9660 0x55762bece0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0090b0 tx=0x7f97ac020000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=366a5b15275b0fd5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.166+0000 7f97a93ff700 1 -- 172.21.15.151:0/2087687664 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac00ee50 con 0x55762bed9660 2023-07-21T22:31:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.166+0000 7f97a93ff700 1 -- 172.21.15.151:0/2087687664 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97ac00f040 con 0x55762bed9660 2023-07-21T22:31:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.166+0000 7f97a93ff700 1 -- 172.21.15.151:0/2087687664 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ac01b8e0 con 0x55762bed9660 2023-07-21T22:31:35.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2087687664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9660 msgr2=0x55762bece0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2087687664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9660 0x55762bece0a0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f97ac0090b0 tx=0x7f97ac020000 comp rx=0 tx=0).stop 2023-07-21T22:31:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2087687664 shutdown_connections 2023-07-21T22:31:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2087687664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9660 0x55762bece0a0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2087687664 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bedb320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/2087687664 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9210 0x55762becdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2087687664 >> 172.21.15.151:0/2087687664 conn(0x55762bec8ae0 msgr2=0x55762bedac10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:35.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2087687664 shutdown_connections 2023-07-21T22:31:35.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 -- 172.21.15.151:0/2087687664 wait complete. 2023-07-21T22:31:35.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 -- start start 2023-07-21T22:31:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.167+0000 7f97cfda1b80 1 Processor -- start 2023-07-21T22:31:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee05d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 0x55762bee0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97cfda1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 0x55762bf419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762bf41ef0 con 0x55762bed9660 2023-07-21T22:31:35.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762bf42060 con 0x55762bed9210 2023-07-21T22:31:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97cfda1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55762bf42220 con 0x55762bd2f6b0 2023-07-21T22:31:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97cfda1b80 10 client.0 _ll_register_callbacks cb 0x7f97a40095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:31:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97ba19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97ba99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 0x55762bf419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97b999a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 0x55762bee0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97ba19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47946/0 (socket says 172.21.15.151:47946) 2023-07-21T22:31:35.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97ba19b700 1 -- 172.21.15.151:0/903750806 learned_addr learned my addr 172.21.15.151:0/903750806 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.168+0000 7f97ba99c700 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 0x55762bf419b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50304/0 (socket says 172.21.15.151:50304) 2023-07-21T22:31:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f97b999a700 1 -- 172.21.15.151:0/903750806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 msgr2=0x55762bee05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f97b999a700 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f97b999a700 1 -- 172.21.15.151:0/903750806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 msgr2=0x55762bf419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f97b999a700 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 0x55762bf419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f97b999a700 1 -- 172.21.15.151:0/903750806 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ac004040 con 0x55762bed9210 2023-07-21T22:31:35.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f97ba19b700 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f97b999a700 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 0x55762bee0b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55762bef7840 tx=0x7f97a4009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a8f893a10b68ca0d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f979dffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:31:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f979dffb700 1 -- 172.21.15.151:0/903750806 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97a4016070 con 0x55762bed9210 2023-07-21T22:31:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f979dffb700 1 -- 172.21.15.151:0/903750806 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f97a4004030 con 0x55762bed9210 2023-07-21T22:31:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.169+0000 7f97cfda1b80 1 -- 172.21.15.151:0/903750806 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f97b009ab50 con 0x55762bed9210 2023-07-21T22:31:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f979dffb700 1 -- 172.21.15.151:0/903750806 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f97a40041f0 con 0x55762bed9210 2023-07-21T22:31:35.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f97cfda1b80 10 client.26999 fetch_fsmap learned FSMap version 52 2023-07-21T22:31:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f97cfda1b80 1 -- 172.21.15.151:0/903750806 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55762bc51250 con 0x55762bed9210 2023-07-21T22:31:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f979dffb700 1 -- 172.21.15.151:0/903750806 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f97b009ab50 con 0x55762bed9210 2023-07-21T22:31:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f979dffb700 1 -- 172.21.15.151:0/903750806 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f97a40037a0 con 0x55762bed9210 2023-07-21T22:31:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f97cfda1b80 10 client.26999 fetch_fsmap finished waiting for FSMap version 52 2023-07-21T22:31:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f97cfda1b80 10 client.26999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:31:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f97cfda1b80 20 client.26999 populate_metadata read hostname 'smithi151' 2023-07-21T22:31:35.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55762bf499e0 0x55762bf4bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f97cfda1b80 4 client.26999 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:31:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.170+0000 7f97cfda1b80 1 -- 172.21.15.151:0/903750806 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55762bddfff0 con 0x55762bf499e0 2023-07-21T22:31:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.171+0000 7f97ba19b700 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55762bf499e0 0x55762bf4bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.171+0000 7f97ba19b700 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55762bf499e0 0x55762bf4bdf0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b950e0cd746cef2e server_cookie=521e0cd49d41cdc1 in_seq=0 out_seq=0 2023-07-21T22:31:35.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.171+0000 7f979dffb700 10 client.26999 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f979dffb700 1 -- 172.21.15.151:0/903750806 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55762bddfff0 con 0x55762bf499e0 2023-07-21T22:31:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f979dffb700 10 client.26999 handle_command_reply: tid=0 2023-07-21T22:31:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 client.26999 shutdown 2023-07-21T22:31:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 -- 172.21.15.151:0/903750806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 msgr2=0x55762bee0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 0x55762bee0b10 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x55762bef7840 tx=0x7f97a4009260 comp rx=0 tx=0).stop 2023-07-21T22:31:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 -- 172.21.15.151:0/903750806 shutdown_connections 2023-07-21T22:31:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55762bf499e0 0x55762bf4bdf0 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55762bed9660 0x55762bf419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55762bd2f6b0 0x55762bee05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f979dffb700 0 client.26999 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 --2- 172.21.15.151:0/903750806 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55762bed9210 0x55762bee0b10 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 -- 172.21.15.151:0/903750806 >> 172.21.15.151:0/903750806 conn(0x55762bec8ae0 msgr2=0x55762bedc3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 -- 172.21.15.151:0/903750806 shutdown_connections 2023-07-21T22:31:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 1 -- 172.21.15.151:0/903750806 wait complete. 2023-07-21T22:31:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.185+0000 7f97cfda1b80 20 client.26999 trim_cache size 0 max 16384 2023-07-21T22:31:35.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:31:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:31:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:31:35.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:31:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 -- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f97a00a12c0 msgr2=0x7f97a00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f97a00a12c0 0x7f97a00a3770 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009fd0 tx=0x7f97ac003cf0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 -- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b40ffb00 msgr2=0x7f97b4197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b40ffb00 0x7f97b4197d60 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f97b0005910 tx=0x7f97b0005740 comp rx=0 tx=0).stop 2023-07-21T22:31:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 -- 172.21.15.151:0/1259817156 shutdown_connections 2023-07-21T22:31:35.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f97a00a12c0 0x7f97a00a3770 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97b4105b10 0x7f97b419c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b40ffb00 0x7f97b4197d60 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 --2- 172.21.15.151:0/1259817156 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f97b41004b0 0x7f97b41982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 -- 172.21.15.151:0/1259817156 >> 172.21.15.151:0/1259817156 conn(0x7f97b40fb600 msgr2=0x7f97b40fbc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 -- 172.21.15.151:0/1259817156 shutdown_connections 2023-07-21T22:31:35.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:35.186+0000 7f97bc3ff700 1 -- 172.21.15.151:0/1259817156 wait complete. 2023-07-21T22:31:36.380 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:36 smithi187 ceph-mon[96918]: pgmap v387: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 429 op/s 2023-07-21T22:31:36.409 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:36 smithi195 ceph-mon[97365]: pgmap v387: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 429 op/s 2023-07-21T22:31:36.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:36 smithi151 ceph-mon[95510]: pgmap v387: 97 pgs: 97 active+clean; 9.7 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 429 op/s 2023-07-21T22:31:38.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:38 smithi151 ceph-mon[95510]: pgmap v388: 97 pgs: 97 active+clean; 9.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 639 op/s 2023-07-21T22:31:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:38 smithi187 ceph-mon[96918]: pgmap v388: 97 pgs: 97 active+clean; 9.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 639 op/s 2023-07-21T22:31:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:38 smithi195 ceph-mon[97365]: pgmap v388: 97 pgs: 97 active+clean; 9.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 639 op/s 2023-07-21T22:31:39.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:39 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:31:39.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:39 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:31:39.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:39 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:31:40.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:40 smithi151 ceph-mon[95510]: pgmap v389: 97 pgs: 97 active+clean; 9.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:31:40.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:40 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:31:40.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:40 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:31:40.702 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:40 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:31:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:40 smithi187 ceph-mon[96918]: pgmap v389: 97 pgs: 97 active+clean; 9.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:31:40.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:40 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:31:40.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:40 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:31:40.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:40 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:31:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:40 smithi195 ceph-mon[97365]: pgmap v389: 97 pgs: 97 active+clean; 9.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:31:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:40 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:31:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:40 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:31:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:40 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:31:42.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:42 smithi151 ceph-mon[95510]: pgmap v390: 97 pgs: 97 active+clean; 9.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:31:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:42 smithi187 ceph-mon[96918]: pgmap v390: 97 pgs: 97 active+clean; 9.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:31:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:42 smithi195 ceph-mon[97365]: pgmap v390: 97 pgs: 97 active+clean; 9.7 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:31:44.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:44 smithi151 ceph-mon[95510]: pgmap v391: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.8 MiB/s wr, 630 op/s 2023-07-21T22:31:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:44 smithi187 ceph-mon[96918]: pgmap v391: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.8 MiB/s wr, 630 op/s 2023-07-21T22:31:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:44 smithi195 ceph-mon[97365]: pgmap v391: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.8 MiB/s wr, 630 op/s 2023-07-21T22:31:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:46 smithi187 ceph-mon[96918]: pgmap v392: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.2 MiB/s wr, 422 op/s 2023-07-21T22:31:46.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:46 smithi195 ceph-mon[97365]: pgmap v392: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.2 MiB/s wr, 422 op/s 2023-07-21T22:31:46.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:46 smithi151 ceph-mon[95510]: pgmap v392: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.2 MiB/s wr, 422 op/s 2023-07-21T22:31:48.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.341+0000 7f0c43bff700 1 -- 172.21.15.151:0/2168090396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c105b10 msgr2=0x7f0c3c105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.341+0000 7f0c43bff700 1 --2- 172.21.15.151:0/2168090396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c105b10 0x7f0c3c105ee0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009990 tx=0x7f0c38009ca0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.341+0000 7f0c43bff700 1 -- 172.21.15.151:0/2168090396 shutdown_connections 2023-07-21T22:31:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.341+0000 7f0c43bff700 1 --2- 172.21.15.151:0/2168090396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c1004b0 0x7f0c3c10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.341+0000 7f0c43bff700 1 --2- 172.21.15.151:0/2168090396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c105b10 0x7f0c3c105ee0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.341+0000 7f0c43bff700 1 --2- 172.21.15.151:0/2168090396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c3c0ffb00 0x7f0c3c0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.341+0000 7f0c43bff700 1 -- 172.21.15.151:0/2168090396 >> 172.21.15.151:0/2168090396 conn(0x7f0c3c0fb600 msgr2=0x7f0c3c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.341+0000 7f0c43bff700 1 -- 172.21.15.151:0/2168090396 shutdown_connections 2023-07-21T22:31:48.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.341+0000 7f0c43bff700 1 -- 172.21.15.151:0/2168090396 wait complete. 2023-07-21T22:31:48.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.342+0000 7f0c43bff700 1 Processor -- start 2023-07-21T22:31:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.342+0000 7f0c43bff700 1 -- start start 2023-07-21T22:31:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.342+0000 7f0c43bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c0ffb00 0x7f0c3c0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.342+0000 7f0c43bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c1004b0 0x7f0c3c072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.342+0000 7f0c43bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c3c105b10 0x7f0c3c1a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.342+0000 7f0c43bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1a42c0 con 0x7f0c3c1004b0 2023-07-21T22:31:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.342+0000 7f0c43bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1a4400 con 0x7f0c3c0ffb00 2023-07-21T22:31:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.342+0000 7f0c43bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c1a4570 con 0x7f0c3c105b10 2023-07-21T22:31:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4119a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c1004b0 0x7f0c3c072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4119a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c1004b0 0x7f0c3c072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34350/0 (socket says 172.21.15.151:34350) 2023-07-21T22:31:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4119a700 1 -- 172.21.15.151:0/3519860279 learned_addr learned my addr 172.21.15.151:0/3519860279 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:48.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4199b700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c0ffb00 0x7f0c3c0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4219c700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c3c105b10 0x7f0c3c1a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4119a700 1 -- 172.21.15.151:0/3519860279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c3c105b10 msgr2=0x7f0c3c1a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4119a700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c3c105b10 0x7f0c3c1a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4119a700 1 -- 172.21.15.151:0/3519860279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c0ffb00 msgr2=0x7f0c3c0729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4119a700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c0ffb00 0x7f0c3c0729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4119a700 1 -- 172.21.15.151:0/3519860279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c380095f0 con 0x7f0c3c1004b0 2023-07-21T22:31:48.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4219c700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c3c105b10 0x7f0c3c1a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.343+0000 7f0c4199b700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c0ffb00 0x7f0c3c0729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.344+0000 7f0c4119a700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c1004b0 0x7f0c3c072f30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c00e9a0 tx=0x7f0c2c00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.344+0000 7f0c32ffd700 1 -- 172.21.15.151:0/3519860279 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c009790 con 0x7f0c3c1004b0 2023-07-21T22:31:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.344+0000 7f0c43bff700 1 -- 172.21.15.151:0/3519860279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c1a4850 con 0x7f0c3c1004b0 2023-07-21T22:31:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.344+0000 7f0c32ffd700 1 -- 172.21.15.151:0/3519860279 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c2c010430 con 0x7f0c3c1004b0 2023-07-21T22:31:48.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.344+0000 7f0c32ffd700 1 -- 172.21.15.151:0/3519860279 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c00cea0 con 0x7f0c3c1004b0 2023-07-21T22:31:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.344+0000 7f0c43bff700 1 -- 172.21.15.151:0/3519860279 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c1a4d60 con 0x7f0c3c1004b0 2023-07-21T22:31:48.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.348+0000 7f0c32ffd700 1 -- 172.21.15.151:0/3519860279 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0c2c0105a0 con 0x7f0c3c1004b0 2023-07-21T22:31:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.349+0000 7f0c5757db80 1 Processor -- start 2023-07-21T22:31:48.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.349+0000 7f0c32ffd700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c280a12c0 0x7f0c280a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.349+0000 7f0c5757db80 1 -- start start 2023-07-21T22:31:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.349+0000 7f0c32ffd700 1 -- 172.21.15.151:0/3519860279 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0c2c014070 con 0x7f0c3c1004b0 2023-07-21T22:31:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4219c700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c280a12c0 0x7f0c280a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a7ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d660 0x55e5f4a774a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c5757db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f497cc50 con 0x55e5f48d36b0 2023-07-21T22:31:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c5757db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f49cf9e0 con 0x55e5f4a7d660 2023-07-21T22:31:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c5757db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f49c8e70 con 0x55e5f4a7d210 2023-07-21T22:31:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a7ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4119a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a7ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34356/0 (socket says 172.21.15.151:34356) 2023-07-21T22:31:48.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4199b700 1 -- 172.21.15.151:0/3599683431 learned_addr learned my addr 172.21.15.151:0/3599683431 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4219c700 1 --2- 172.21.15.151:0/3599683431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d660 0x55e5f4a774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4219c700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c280a12c0 0x7f0c280a3770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c34007fd0 tx=0x7f0c3400da40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4199b700 1 -- 172.21.15.151:0/3599683431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d210 msgr2=0x55e5f4a76f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4199b700 1 --2- 172.21.15.151:0/3599683431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.350+0000 7f0c4199b700 1 -- 172.21.15.151:0/3599683431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d660 msgr2=0x55e5f4a774a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.351+0000 7f0c4199b700 1 --2- 172.21.15.151:0/3599683431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d660 0x55e5f4a774a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.351+0000 7f0c4199b700 1 -- 172.21.15.151:0/3599683431 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5f47f6d80 con 0x55e5f48d36b0 2023-07-21T22:31:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.351+0000 7f0c4119a700 1 --2- 172.21.15.151:0/3599683431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:31:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.351+0000 7f0c4199b700 1 --2- 172.21.15.151:0/3599683431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a7ccd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0c38015000 tx=0x7f0c3800bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b697f1ce88af327 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.351+0000 7f0c27fff700 1 -- 172.21.15.151:0/3599683431 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3801d070 con 0x55e5f48d36b0 2023-07-21T22:31:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.351+0000 7f0c27fff700 1 -- 172.21.15.151:0/3599683431 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c3801e040 con 0x55e5f48d36b0 2023-07-21T22:31:48.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.351+0000 7f0c27fff700 1 -- 172.21.15.151:0/3599683431 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3800f460 con 0x55e5f48d36b0 2023-07-21T22:31:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.352+0000 7f0c5757db80 1 -- 172.21.15.151:0/3599683431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 msgr2=0x55e5f4a7ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.352+0000 7f0c5757db80 1 --2- 172.21.15.151:0/3599683431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a7ccd0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f0c38015000 tx=0x7f0c3800bb70 comp rx=0 tx=0).stop 2023-07-21T22:31:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.352+0000 7f0c5757db80 1 -- 172.21.15.151:0/3599683431 shutdown_connections 2023-07-21T22:31:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.352+0000 7f0c5757db80 1 --2- 172.21.15.151:0/3599683431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d660 0x55e5f4a774a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.352+0000 7f0c5757db80 1 --2- 172.21.15.151:0/3599683431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a7ccd0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.352+0000 7f0c5757db80 1 --2- 172.21.15.151:0/3599683431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.352+0000 7f0c5757db80 1 -- 172.21.15.151:0/3599683431 >> 172.21.15.151:0/3599683431 conn(0x55e5f4a6cae0 msgr2=0x55e5f4a720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.352+0000 7f0c5757db80 1 -- 172.21.15.151:0/3599683431 shutdown_connections 2023-07-21T22:31:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.352+0000 7f0c5757db80 1 -- 172.21.15.151:0/3599683431 wait complete. 2023-07-21T22:31:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.353+0000 7f0c5757db80 1 -- start start 2023-07-21T22:31:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.353+0000 7f0c5757db80 1 Processor -- start 2023-07-21T22:31:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a83540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a80830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d660 0x55e5f4a80eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c5757db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4968a60 con 0x55e5f48d36b0 2023-07-21T22:31:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c5757db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4968760 con 0x55e5f4a7d210 2023-07-21T22:31:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c5757db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f484c8c0 con 0x55e5f4a7d660 2023-07-21T22:31:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c5757db80 10 client.0 _ll_register_callbacks cb 0x55e5f4966700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:31:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a83540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a83540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34360/0 (socket says 172.21.15.151:34360) 2023-07-21T22:31:48.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4199b700 1 -- 172.21.15.151:0/1269576243 learned_addr learned my addr 172.21.15.151:0/1269576243 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4219c700 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d660 0x55e5f4a80eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4119a700 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a80830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4199b700 1 -- 172.21.15.151:0/1269576243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d660 msgr2=0x55e5f4a80eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4199b700 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d660 0x55e5f4a80eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4199b700 1 -- 172.21.15.151:0/1269576243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 msgr2=0x55e5f4a80830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4199b700 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a80830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.354+0000 7f0c4199b700 1 -- 172.21.15.151:0/1269576243 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c1a4d60 con 0x55e5f48d36b0 2023-07-21T22:31:48.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.355+0000 7f0c4199b700 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a83540 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009ce0 tx=0x7f0c38004780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5bf9a339569a8b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.355+0000 7f0c257fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:31:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.355+0000 7f0c257fa700 1 -- 172.21.15.151:0/1269576243 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3801d070 con 0x55e5f48d36b0 2023-07-21T22:31:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.355+0000 7f0c257fa700 1 -- 172.21.15.151:0/1269576243 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0c38005510 con 0x55e5f48d36b0 2023-07-21T22:31:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.355+0000 7f0c5757db80 1 -- 172.21.15.151:0/1269576243 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e5f4922490 con 0x55e5f48d36b0 2023-07-21T22:31:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.355+0000 7f0c257fa700 1 -- 172.21.15.151:0/1269576243 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c3800f460 con 0x55e5f48d36b0 2023-07-21T22:31:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.355+0000 7f0c5757db80 10 client.17316 fetch_fsmap learned FSMap version 52 2023-07-21T22:31:48.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.355+0000 7f0c5757db80 1 -- 172.21.15.151:0/1269576243 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x7f0c3c10d240 con 0x55e5f48d36b0 2023-07-21T22:31:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.356+0000 7f0c257fa700 1 -- 172.21.15.151:0/1269576243 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e5f4922490 con 0x55e5f48d36b0 2023-07-21T22:31:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.356+0000 7f0c257fa700 1 -- 172.21.15.151:0/1269576243 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0c3802c400 con 0x55e5f48d36b0 2023-07-21T22:31:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.356+0000 7f0c5757db80 10 client.17316 fetch_fsmap finished waiting for FSMap version 52 2023-07-21T22:31:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.356+0000 7f0c5757db80 10 client.17316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:31:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.356+0000 7f0c5757db80 20 client.17316 populate_metadata read hostname 'smithi151' 2023-07-21T22:31:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.356+0000 7f0c5757db80 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e5f4a90590 0x55e5f4a92970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.356+0000 7f0c5757db80 4 client.17316 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:31:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.356+0000 7f0c5757db80 1 -- 172.21.15.151:0/1269576243 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5f49c1e50 con 0x55e5f4a90590 2023-07-21T22:31:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.356+0000 7f0c4119a700 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e5f4a90590 0x55e5f4a92970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.357+0000 7f0c257fa700 10 client.17316 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:48.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.357+0000 7f0c4119a700 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e5f4a90590 0x55e5f4a92970 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0b067f1383110ae server_cookie=277adf4cc9c95d68 in_seq=0 out_seq=0 2023-07-21T22:31:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c257fa700 1 -- 172.21.15.151:0/1269576243 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e5f49c1e50 con 0x55e5f4a90590 2023-07-21T22:31:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c257fa700 10 client.17316 handle_command_reply: tid=0 2023-07-21T22:31:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 client.17316 shutdown 2023-07-21T22:31:48.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 -- 172.21.15.151:0/1269576243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 msgr2=0x55e5f4a83540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a83540 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f0c38009ce0 tx=0x7f0c38004780 comp rx=0 tx=0).stop 2023-07-21T22:31:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 -- 172.21.15.151:0/1269576243 shutdown_connections 2023-07-21T22:31:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e5f4a90590 0x55e5f4a92970 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a7d660 0x55e5f4a80eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c257fa700 0 client.17316 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:48.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a83540 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 --2- 172.21.15.151:0/1269576243 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a80830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 -- 172.21.15.151:0/1269576243 >> 172.21.15.151:0/1269576243 conn(0x55e5f4a6cae0 msgr2=0x55e5f4a713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 -- 172.21.15.151:0/1269576243 shutdown_connections 2023-07-21T22:31:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 1 -- 172.21.15.151:0/1269576243 wait complete. 2023-07-21T22:31:48.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.358+0000 7f0c5757db80 20 client.17316 trim_cache size 0 max 16384 2023-07-21T22:31:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.374+0000 7f0c5757db80 1 Processor -- start 2023-07-21T22:31:48.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.374+0000 7f0c5757db80 1 -- start start 2023-07-21T22:31:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f48d36b0 0x55e5f4a76640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c5757db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4a78160 con 0x55e5f4a6cae0 2023-07-21T22:31:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c5757db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4a81da0 con 0x55e5f4a7d210 2023-07-21T22:31:48.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c5757db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4a72f10 con 0x55e5f48d36b0 2023-07-21T22:31:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7c1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34370/0 (socket says 172.21.15.151:34370) 2023-07-21T22:31:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4199b700 1 -- 172.21.15.151:0/3408317634 learned_addr learned my addr 172.21.15.151:0/3408317634 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4119a700 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f48d36b0 0x55e5f4a76640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4219c700 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4199b700 1 -- 172.21.15.151:0/3408317634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f48d36b0 msgr2=0x55e5f4a76640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4199b700 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f48d36b0 0x55e5f4a76640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4199b700 1 -- 172.21.15.151:0/3408317634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 msgr2=0x55e5f4a76b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4199b700 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4199b700 1 -- 172.21.15.151:0/3408317634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e5f4a975a0 con 0x55e5f4a6cae0 2023-07-21T22:31:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.375+0000 7f0c4219c700 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:31:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.376+0000 7f0c4199b700 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7c1e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0c38005930 tx=0x7f0c3800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f591f750adc4837 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.376+0000 7f0c30bff700 1 -- 172.21.15.151:0/3408317634 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3801d040 con 0x55e5f4a6cae0 2023-07-21T22:31:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.376+0000 7f0c30bff700 1 -- 172.21.15.151:0/3408317634 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c3802ca50 con 0x55e5f4a6cae0 2023-07-21T22:31:48.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.376+0000 7f0c30bff700 1 -- 172.21.15.151:0/3408317634 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3802a3b0 con 0x55e5f4a6cae0 2023-07-21T22:31:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 -- 172.21.15.151:0/3408317634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f4a6cae0 msgr2=0x55e5f4a7c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7c1e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f0c38005930 tx=0x7f0c3800b260 comp rx=0 tx=0).stop 2023-07-21T22:31:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 -- 172.21.15.151:0/3408317634 shutdown_connections 2023-07-21T22:31:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a76b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7c1e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 --2- 172.21.15.151:0/3408317634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f48d36b0 0x55e5f4a76640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 -- 172.21.15.151:0/3408317634 >> 172.21.15.151:0/3408317634 conn(0x55e5f4a8c650 msgr2=0x55e5f4a75f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 -- 172.21.15.151:0/3408317634 shutdown_connections 2023-07-21T22:31:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 -- 172.21.15.151:0/3408317634 wait complete. 2023-07-21T22:31:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 -- start start 2023-07-21T22:31:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.377+0000 7f0c5757db80 1 Processor -- start 2023-07-21T22:31:48.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a79ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c5757db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a78730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c5757db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4a78c70 con 0x55e5f48d36b0 2023-07-21T22:31:48.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c5757db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4a78de0 con 0x55e5f4a7d210 2023-07-21T22:31:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c5757db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5f4a78fa0 con 0x55e5f4a6cae0 2023-07-21T22:31:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c5757db80 10 client.0 _ll_register_callbacks cb 0x7f0c2c096380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:31:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c4199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a79ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c4119a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c4119a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52314/0 (socket says 172.21.15.151:52314) 2023-07-21T22:31:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c4119a700 1 -- 172.21.15.151:0/2059784825 learned_addr learned my addr 172.21.15.151:0/2059784825 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:31:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.378+0000 7f0c4219c700 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a78730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c4119a700 1 -- 172.21.15.151:0/2059784825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 msgr2=0x55e5f4a78730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c4119a700 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a78730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c4119a700 1 -- 172.21.15.151:0/2059784825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 msgr2=0x55e5f4a79ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:31:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c4119a700 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a79ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c4119a700 1 -- 172.21.15.151:0/2059784825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c10d240 con 0x55e5f4a6cae0 2023-07-21T22:31:48.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c4119a700 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7a010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c099d40 tx=0x7f0c2c010bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99f8002de9ca00c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:31:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c257fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:31:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c257fa700 1 -- 172.21.15.151:0/2059784825 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c09a4a0 con 0x55e5f4a6cae0 2023-07-21T22:31:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c257fa700 1 -- 172.21.15.151:0/2059784825 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0c2c0b82f0 con 0x55e5f4a6cae0 2023-07-21T22:31:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c5757db80 1 -- 172.21.15.151:0/2059784825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c3801e040 con 0x55e5f4a6cae0 2023-07-21T22:31:48.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c257fa700 1 -- 172.21.15.151:0/2059784825 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c2c099530 con 0x55e5f4a6cae0 2023-07-21T22:31:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c5757db80 10 client.27037 fetch_fsmap learned FSMap version 52 2023-07-21T22:31:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.379+0000 7f0c5757db80 1 -- 172.21.15.151:0/2059784825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) v3 -- 0x55e5f47dfc00 con 0x55e5f4a6cae0 2023-07-21T22:31:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.380+0000 7f0c257fa700 1 -- 172.21.15.151:0/2059784825 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c3801e040 con 0x55e5f4a6cae0 2023-07-21T22:31:48.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.380+0000 7f0c257fa700 1 -- 172.21.15.151:0/2059784825 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 52) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0c2c095e30 con 0x55e5f4a6cae0 2023-07-21T22:31:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.380+0000 7f0c5757db80 10 client.27037 fetch_fsmap finished waiting for FSMap version 52 2023-07-21T22:31:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.380+0000 7f0c5757db80 10 client.27037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:31:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.380+0000 7f0c5757db80 20 client.27037 populate_metadata read hostname 'smithi151' 2023-07-21T22:31:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.380+0000 7f0c5757db80 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e5f4a7d660 0x55e5f4ae7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:31:48.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.380+0000 7f0c5757db80 4 client.27037 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:31:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.380+0000 7f0c5757db80 1 -- 172.21.15.151:0/2059784825 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e5f4983ff0 con 0x55e5f4a7d660 2023-07-21T22:31:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.380+0000 7f0c4199b700 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e5f4a7d660 0x55e5f4ae7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:31:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.381+0000 7f0c257fa700 10 client.27037 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:48.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.381+0000 7f0c4199b700 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e5f4a7d660 0x55e5f4ae7380 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c87f4151134501b server_cookie=136aa926b163ee32 in_seq=0 out_seq=0 2023-07-21T22:31:48.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c257fa700 1 -- 172.21.15.151:0/2059784825 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e5f4983ff0 con 0x55e5f4a7d660 2023-07-21T22:31:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c257fa700 10 client.27037 handle_command_reply: tid=0 2023-07-21T22:31:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 client.27037 shutdown 2023-07-21T22:31:48.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 -- 172.21.15.151:0/2059784825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a6cae0 msgr2=0x55e5f4a7a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7a010 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c099d40 tx=0x7f0c2c010bf0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 -- 172.21.15.151:0/2059784825 shutdown_connections 2023-07-21T22:31:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e5f4a7d660 0x55e5f4ae7380 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5f4a7d210 0x55e5f4a78730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e5f48d36b0 0x55e5f4a79ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c257fa700 0 client.27037 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:31:48.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 --2- 172.21.15.151:0/2059784825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5f4a6cae0 0x55e5f4a7a010 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 -- 172.21.15.151:0/2059784825 >> 172.21.15.151:0/2059784825 conn(0x55e5f4a8c650 msgr2=0x55e5f4a7c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 -- 172.21.15.151:0/2059784825 shutdown_connections 2023-07-21T22:31:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.394+0000 7f0c5757db80 1 -- 172.21.15.151:0/2059784825 wait complete. 2023-07-21T22:31:48.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c5757db80 20 client.27037 trim_cache size 0 max 16384 2023-07-21T22:31:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:31:48.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:31:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:31:48.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:31:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 -- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c280a12c0 msgr2=0x7f0c280a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c280a12c0 0x7f0c280a3770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c34007fd0 tx=0x7f0c3400da40 comp rx=0 tx=0).stop 2023-07-21T22:31:48.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 -- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c1004b0 msgr2=0x7f0c3c072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:31:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c1004b0 0x7f0c3c072f30 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c00e9a0 tx=0x7f0c2c00ecb0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 -- 172.21.15.151:0/3519860279 shutdown_connections 2023-07-21T22:31:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c280a12c0 0x7f0c280a3770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c0ffb00 0x7f0c3c0729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c3c105b10 0x7f0c3c1a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 --2- 172.21.15.151:0/3519860279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c3c1004b0 0x7f0c3c072f30 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:31:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 -- 172.21.15.151:0/3519860279 >> 172.21.15.151:0/3519860279 conn(0x7f0c3c0fb600 msgr2=0x7f0c3c0fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:31:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 -- 172.21.15.151:0/3519860279 shutdown_connections 2023-07-21T22:31:48.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:31:48.395+0000 7f0c43bff700 1 -- 172.21.15.151:0/3519860279 wait complete. 2023-07-21T22:31:48.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:48 smithi187 ceph-mon[96918]: pgmap v393: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 635 op/s 2023-07-21T22:31:48.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:48 smithi195 ceph-mon[97365]: pgmap v393: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 635 op/s 2023-07-21T22:31:48.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:48 smithi151 ceph-mon[95510]: pgmap v393: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.9 MiB/s wr, 635 op/s 2023-07-21T22:31:50.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:50 smithi187 ceph-mon[96918]: pgmap v394: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-07-21T22:31:50.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:50 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:31:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:50 smithi195 ceph-mon[97365]: pgmap v394: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-07-21T22:31:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:50 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:31:50.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:50 smithi151 ceph-mon[95510]: pgmap v394: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-07-21T22:31:50.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:50 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:31:52.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:52 smithi187 ceph-mon[96918]: pgmap v395: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-07-21T22:31:52.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:52 smithi195 ceph-mon[97365]: pgmap v395: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-07-21T22:31:52.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:52 smithi151 ceph-mon[95510]: pgmap v395: 97 pgs: 97 active+clean; 9.7 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.3 MiB/s wr, 425 op/s 2023-07-21T22:31:54.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:54 smithi187 ceph-mon[96918]: pgmap v396: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.0 MiB/s wr, 652 op/s 2023-07-21T22:31:54.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:54 smithi195 ceph-mon[97365]: pgmap v396: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.0 MiB/s wr, 652 op/s 2023-07-21T22:31:54.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:54 smithi151 ceph-mon[95510]: pgmap v396: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 5.0 MiB/s wr, 652 op/s 2023-07-21T22:31:56.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:56 smithi187 ceph-mon[96918]: pgmap v397: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.4 MiB/s wr, 440 op/s 2023-07-21T22:31:56.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:56 smithi195 ceph-mon[97365]: pgmap v397: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.4 MiB/s wr, 440 op/s 2023-07-21T22:31:56.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:56 smithi151 ceph-mon[95510]: pgmap v397: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.4 MiB/s wr, 440 op/s 2023-07-21T22:31:58.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:31:58 smithi187 ceph-mon[96918]: pgmap v398: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.0 MiB/s wr, 651 op/s 2023-07-21T22:31:58.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:31:58 smithi195 ceph-mon[97365]: pgmap v398: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.0 MiB/s wr, 651 op/s 2023-07-21T22:31:58.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:31:58 smithi151 ceph-mon[95510]: pgmap v398: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.0 MiB/s wr, 651 op/s 2023-07-21T22:32:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:00 smithi187 ceph-mon[96918]: pgmap v399: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.4 MiB/s wr, 438 op/s 2023-07-21T22:32:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:00 smithi195 ceph-mon[97365]: pgmap v399: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.4 MiB/s wr, 438 op/s 2023-07-21T22:32:00.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:00 smithi151 ceph-mon[95510]: pgmap v399: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.4 MiB/s wr, 438 op/s 2023-07-21T22:32:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.550+0000 7ff778bff700 1 -- 172.21.15.151:0/2636372799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff774105b10 msgr2=0x7ff774105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.550+0000 7ff778bff700 1 --2- 172.21.15.151:0/2636372799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff774105b10 0x7ff774105ee0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff764009990 tx=0x7ff764009ca0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.550+0000 7ff778bff700 1 -- 172.21.15.151:0/2636372799 shutdown_connections 2023-07-21T22:32:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.550+0000 7ff778bff700 1 --2- 172.21.15.151:0/2636372799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff774105b10 0x7ff774105ee0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.550+0000 7ff778bff700 1 --2- 172.21.15.151:0/2636372799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7741004b0 0x7ff77410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.550+0000 7ff778bff700 1 --2- 172.21.15.151:0/2636372799 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7740ffb00 0x7ff7740fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.550+0000 7ff778bff700 1 -- 172.21.15.151:0/2636372799 >> 172.21.15.151:0/2636372799 conn(0x7ff7740fb600 msgr2=0x7ff7740fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.550+0000 7ff778bff700 1 -- 172.21.15.151:0/2636372799 shutdown_connections 2023-07-21T22:32:01.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.550+0000 7ff778bff700 1 -- 172.21.15.151:0/2636372799 wait complete. 2023-07-21T22:32:01.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.552+0000 7ff778bff700 1 Processor -- start 2023-07-21T22:32:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.552+0000 7ff778bff700 1 -- start start 2023-07-21T22:32:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.552+0000 7ff778bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7740ffb00 0x7ff774197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.552+0000 7ff778bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7741004b0 0x7ff774198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.552+0000 7ff778bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff774105b10 0x7ff77419c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.552+0000 7ff778bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77419cf40 con 0x7ff7741004b0 2023-07-21T22:32:01.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.552+0000 7ff778bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77419d0b0 con 0x7ff774105b10 2023-07-21T22:32:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.552+0000 7ff778bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77419d270 con 0x7ff7740ffb00 2023-07-21T22:32:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff77259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7740ffb00 0x7ff774197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff77259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7740ffb00 0x7ff774197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52322/0 (socket says 172.21.15.151:52322) 2023-07-21T22:32:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff77259c700 1 -- 172.21.15.151:0/316437537 learned_addr learned my addr 172.21.15.151:0/316437537 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff771d9b700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7741004b0 0x7ff774198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff772d9d700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff774105b10 0x7ff77419c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff77259c700 1 -- 172.21.15.151:0/316437537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff774105b10 msgr2=0x7ff77419c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff77259c700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff774105b10 0x7ff77419c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff77259c700 1 -- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7741004b0 msgr2=0x7ff774198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff77259c700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7741004b0 0x7ff774198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff77259c700 1 -- 172.21.15.151:0/316437537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7640095f0 con 0x7ff7740ffb00 2023-07-21T22:32:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff77259c700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7740ffb00 0x7ff774197d50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff764005740 tx=0x7ff764005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff76b7fe700 1 -- 172.21.15.151:0/316437537 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76401d070 con 0x7ff7740ffb00 2023-07-21T22:32:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff76b7fe700 1 -- 172.21.15.151:0/316437537 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff764022470 con 0x7ff7740ffb00 2023-07-21T22:32:01.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff76b7fe700 1 -- 172.21.15.151:0/316437537 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff764017650 con 0x7ff7740ffb00 2023-07-21T22:32:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff778bff700 1 -- 172.21.15.151:0/316437537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff77419d4f0 con 0x7ff7740ffb00 2023-07-21T22:32:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.554+0000 7ff778bff700 1 -- 172.21.15.151:0/316437537 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77419d770 con 0x7ff7740ffb00 2023-07-21T22:32:01.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.557+0000 7ff76b7fe700 1 -- 172.21.15.151:0/316437537 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff7640225e0 con 0x7ff7740ffb00 2023-07-21T22:32:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.558+0000 7ff78c4bab80 1 Processor -- start 2023-07-21T22:32:01.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff78c4bab80 1 -- start start 2023-07-21T22:32:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 0x557f811a8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff76b7fe700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7580a12c0 0x7ff7580a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9660 0x557f811a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f810a8c50 con 0x557f811a9210 2023-07-21T22:32:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f810fb9e0 con 0x557f811a9660 2023-07-21T22:32:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f810f4e70 con 0x557f80fff6b0 2023-07-21T22:32:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff76b7fe700 1 -- 172.21.15.151:0/316437537 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff7640cded0 con 0x7ff7740ffb00 2023-07-21T22:32:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.559+0000 7ff77259c700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7580a12c0 0x7ff7580a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9660 0x557f811a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9660 0x557f811a34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35568/0 (socket says 172.21.15.151:35568) 2023-07-21T22:32:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 -- 172.21.15.151:0/4245976812 learned_addr learned my addr 172.21.15.151:0/4245976812 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff771d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 --2- 172.21.15.151:0/4245976812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 0x557f811a8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 -- 172.21.15.151:0/4245976812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 msgr2=0x557f811a8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 --2- 172.21.15.151:0/4245976812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 0x557f811a8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 -- 172.21.15.151:0/4245976812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 msgr2=0x557f811a2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 --2- 172.21.15.151:0/4245976812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 -- 172.21.15.151:0/4245976812 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f80f22d80 con 0x557f811a9660 2023-07-21T22:32:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff771d9b700 1 --2- 172.21.15.151:0/4245976812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff77259c700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7580a12c0 0x7ff7580a3770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff76409acf0 tx=0x7ff764005910 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.560+0000 7ff772d9d700 1 --2- 172.21.15.151:0/4245976812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9660 0x557f811a34a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff76c008cd0 tx=0x7ff76c009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ccabc6d9906c29cd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:01.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff768ff9700 1 -- 172.21.15.151:0/4245976812 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c00e050 con 0x557f811a9660 2023-07-21T22:32:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff768ff9700 1 -- 172.21.15.151:0/4245976812 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff76c00f040 con 0x557f811a9660 2023-07-21T22:32:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff768ff9700 1 -- 172.21.15.151:0/4245976812 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff76c004020 con 0x557f811a9660 2023-07-21T22:32:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff78c4bab80 1 -- 172.21.15.151:0/4245976812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9660 msgr2=0x557f811a34a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/4245976812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9660 0x557f811a34a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff76c008cd0 tx=0x7ff76c009920 comp rx=0 tx=0).stop 2023-07-21T22:32:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff78c4bab80 1 -- 172.21.15.151:0/4245976812 shutdown_connections 2023-07-21T22:32:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/4245976812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9660 0x557f811a34a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/4245976812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 0x557f811a8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/4245976812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.561+0000 7ff78c4bab80 1 -- 172.21.15.151:0/4245976812 >> 172.21.15.151:0/4245976812 conn(0x557f81198ae0 msgr2=0x557f8119e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.562+0000 7ff78c4bab80 1 -- 172.21.15.151:0/4245976812 shutdown_connections 2023-07-21T22:32:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.562+0000 7ff78c4bab80 1 -- 172.21.15.151:0/4245976812 wait complete. 2023-07-21T22:32:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.562+0000 7ff78c4bab80 1 -- start start 2023-07-21T22:32:01.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.563+0000 7ff78c4bab80 1 Processor -- start 2023-07-21T22:32:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.563+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 0x557f811ac870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.563+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9210 0x557f811acdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.563+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 0x557f811ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.563+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f81094a60 con 0x557f811a9660 2023-07-21T22:32:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.563+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f81094760 con 0x557f811a9210 2023-07-21T22:32:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.563+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f80f788c0 con 0x557f80fff6b0 2023-07-21T22:32:01.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.563+0000 7ff78c4bab80 10 client.0 _ll_register_callbacks cb 0x557f81092700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff771d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9210 0x557f811acdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff771d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9210 0x557f811acdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35582/0 (socket says 172.21.15.151:35582) 2023-07-21T22:32:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff771d9b700 1 -- 172.21.15.151:0/3977488787 learned_addr learned my addr 172.21.15.151:0/3977488787 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff772d9d700 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 0x557f811ac870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff772d9d700 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 0x557f811ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff771d9b700 1 -- 172.21.15.151:0/3977488787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 msgr2=0x557f811ac870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff771d9b700 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 0x557f811ac870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff771d9b700 1 -- 172.21.15.151:0/3977488787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 msgr2=0x557f811ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff771d9b700 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 0x557f811ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff771d9b700 1 -- 172.21.15.151:0/3977488787 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7600098e0 con 0x557f811a9210 2023-07-21T22:32:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff771d9b700 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9210 0x557f811acdb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff760012980 tx=0x7ff760012c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=698948abc1e07892 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.564+0000 7ff755ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:32:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff755ffb700 1 -- 172.21.15.151:0/3977488787 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760017070 con 0x557f811a9210 2023-07-21T22:32:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff755ffb700 1 -- 172.21.15.151:0/3977488787 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff760004030 con 0x557f811a9210 2023-07-21T22:32:01.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff78c4bab80 1 -- 172.21.15.151:0/3977488787 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f8104e490 con 0x557f811a9210 2023-07-21T22:32:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff755ffb700 1 -- 172.21.15.151:0/3977488787 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7600041f0 con 0x557f811a9210 2023-07-21T22:32:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff78c4bab80 10 client.27023 fetch_fsmap learned FSMap version 53 2023-07-21T22:32:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff78c4bab80 1 -- 172.21.15.151:0/3977488787 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x7ff76c0089b0 con 0x557f811a9210 2023-07-21T22:32:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff755ffb700 1 -- 172.21.15.151:0/3977488787 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557f8104e490 con 0x557f811a9210 2023-07-21T22:32:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff755ffb700 1 -- 172.21.15.151:0/3977488787 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 53) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff76000f670 con 0x557f811a9210 2023-07-21T22:32:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff78c4bab80 10 client.27023 fetch_fsmap finished waiting for FSMap version 53 2023-07-21T22:32:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff78c4bab80 10 client.27023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:01.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff78c4bab80 20 client.27023 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f811bcc00 0x557f811bf010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff78c4bab80 4 client.27023 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:32:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.565+0000 7ff78c4bab80 1 -- 172.21.15.151:0/3977488787 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f810ede50 con 0x557f811bcc00 2023-07-21T22:32:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.566+0000 7ff772d9d700 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f811bcc00 0x557f811bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.566+0000 7ff772d9d700 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f811bcc00 0x557f811bf010 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29b3a9067d6ddd74 server_cookie=389c71a0eb5ef8e8 in_seq=0 out_seq=0 2023-07-21T22:32:01.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.566+0000 7ff755ffb700 10 client.27023 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.567+0000 7ff755ffb700 1 -- 172.21.15.151:0/3977488787 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557f810ede50 con 0x557f811bcc00 2023-07-21T22:32:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.567+0000 7ff755ffb700 10 client.27023 handle_command_reply: tid=0 2023-07-21T22:32:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.567+0000 7ff78c4bab80 1 client.27023 shutdown 2023-07-21T22:32:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.567+0000 7ff78c4bab80 1 -- 172.21.15.151:0/3977488787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9210 msgr2=0x557f811acdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.567+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9210 0x557f811acdb0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff760012980 tx=0x7ff760012c90 comp rx=0 tx=0).stop 2023-07-21T22:32:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.567+0000 7ff78c4bab80 1 -- 172.21.15.151:0/3977488787 shutdown_connections 2023-07-21T22:32:01.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.567+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f811bcc00 0x557f811bf010 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.567+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 0x557f811ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.568+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f80fff6b0 0x557f811ac870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.568+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/3977488787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f811a9210 0x557f811acdb0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.568+0000 7ff78c4bab80 1 -- 172.21.15.151:0/3977488787 >> 172.21.15.151:0/3977488787 conn(0x557f81198ae0 msgr2=0x557f8119d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.567+0000 7ff755ffb700 0 client.27023 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.568+0000 7ff78c4bab80 1 -- 172.21.15.151:0/3977488787 shutdown_connections 2023-07-21T22:32:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.568+0000 7ff78c4bab80 1 -- 172.21.15.151:0/3977488787 wait complete. 2023-07-21T22:32:01.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.568+0000 7ff78c4bab80 20 client.27023 trim_cache size 0 max 16384 2023-07-21T22:32:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff78c4bab80 1 Processor -- start 2023-07-21T22:32:01.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff78c4bab80 1 -- start start 2023-07-21T22:32:01.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 0x557f811b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9660 0x557f811a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f811a3f20 con 0x557f811a9210 2023-07-21T22:32:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f8119a4f0 con 0x557f80fff6b0 2023-07-21T22:32:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f811a7580 con 0x557f811a9660 2023-07-21T22:32:01.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff771d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff771d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58534/0 (socket says 172.21.15.151:58534) 2023-07-21T22:32:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff771d9b700 1 -- 172.21.15.151:0/2769326753 learned_addr learned my addr 172.21.15.151:0/2769326753 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff772d9d700 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 0x557f811b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.584+0000 7ff772d9d700 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9660 0x557f811a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff771d9b700 1 -- 172.21.15.151:0/2769326753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9660 msgr2=0x557f811a2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff771d9b700 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9660 0x557f811a2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff771d9b700 1 -- 172.21.15.151:0/2769326753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 msgr2=0x557f811b3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff771d9b700 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 0x557f811b3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff771d9b700 1 -- 172.21.15.151:0/2769326753 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f80f0bc00 con 0x557f811a9210 2023-07-21T22:32:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff772d9d700 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9660 0x557f811a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:01.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff771d9b700 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a80a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff76000fa00 tx=0x7ff7600096d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e54a2a533b32c1c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff7697fa700 1 -- 172.21.15.151:0/2769326753 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760017040 con 0x557f811a9210 2023-07-21T22:32:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff7697fa700 1 -- 172.21.15.151:0/2769326753 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff76000fcf0 con 0x557f811a9210 2023-07-21T22:32:01.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.585+0000 7ff7697fa700 1 -- 172.21.15.151:0/2769326753 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7600038e0 con 0x557f811a9210 2023-07-21T22:32:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.586+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2769326753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 msgr2=0x557f811a80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.586+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a80a0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7ff76000fa00 tx=0x7ff7600096d0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.586+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2769326753 shutdown_connections 2023-07-21T22:32:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.586+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 0x557f811b3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.586+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9660 0x557f811a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.586+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2769326753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9210 0x557f811a80a0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.586+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2769326753 >> 172.21.15.151:0/2769326753 conn(0x557f81198ae0 msgr2=0x557f811a7990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.586+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2769326753 shutdown_connections 2023-07-21T22:32:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.586+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2769326753 wait complete. 2023-07-21T22:32:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.587+0000 7ff78c4bab80 1 -- start start 2023-07-21T22:32:01.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.587+0000 7ff78c4bab80 1 Processor -- start 2023-07-21T22:32:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.587+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 0x557f81204a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.587+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9210 0x557f81204f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.587+0000 7ff78c4bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 0x557f8120fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.587+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f812057a0 con 0x557f811a9660 2023-07-21T22:32:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.587+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f81205910 con 0x557f80fff6b0 2023-07-21T22:32:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.587+0000 7ff78c4bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f81210060 con 0x557f811a9210 2023-07-21T22:32:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.587+0000 7ff78c4bab80 10 client.0 _ll_register_callbacks cb 0x7ff760012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:01.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff772d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 0x557f81204a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff772d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 0x557f8120fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff771d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9210 0x557f81204f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff771d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9210 0x557f81204f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52350/0 (socket says 172.21.15.151:52350) 2023-07-21T22:32:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff772d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 0x557f81204a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35604/0 (socket says 172.21.15.151:35604) 2023-07-21T22:32:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff771d9b700 1 -- 172.21.15.151:0/2570697343 learned_addr learned my addr 172.21.15.151:0/2570697343 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff771d9b700 1 -- 172.21.15.151:0/2570697343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 msgr2=0x557f81204a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff771d9b700 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 0x557f81204a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff771d9b700 1 -- 172.21.15.151:0/2570697343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 msgr2=0x557f8120fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff771d9b700 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 0x557f8120fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff771d9b700 1 -- 172.21.15.151:0/2570697343 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff76c0089b0 con 0x557f811a9210 2023-07-21T22:32:01.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff771d9b700 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9210 0x557f81204f90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x557f811ba370 tx=0x7ff760005300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beb721f7575448dc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:01.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.588+0000 7ff755ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:32:01.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff755ffb700 1 -- 172.21.15.151:0/2570697343 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff760017070 con 0x557f811a9210 2023-07-21T22:32:01.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff755ffb700 1 -- 172.21.15.151:0/2570697343 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(100..100 src has 1..100) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff7600057b0 con 0x557f811a9210 2023-07-21T22:32:01.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2570697343 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff76c00f040 con 0x557f811a9210 2023-07-21T22:32:01.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff755ffb700 1 -- 172.21.15.151:0/2570697343 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7600092b0 con 0x557f811a9210 2023-07-21T22:32:01.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff78c4bab80 10 client.27055 fetch_fsmap learned FSMap version 53 2023-07-21T22:32:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2570697343 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) v3 -- 0x557f80f491f0 con 0x557f811a9210 2023-07-21T22:32:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff755ffb700 1 -- 172.21.15.151:0/2570697343 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff76c00f040 con 0x557f811a9210 2023-07-21T22:32:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff755ffb700 1 -- 172.21.15.151:0/2570697343 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 53) v1 ==== 7482+0+0 (secure 0 0 0) 0x7ff760038780 con 0x557f811a9210 2023-07-21T22:32:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff78c4bab80 10 client.27055 fetch_fsmap finished waiting for FSMap version 53 2023-07-21T22:32:01.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff78c4bab80 10 client.27055 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff78c4bab80 20 client.27055 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f812115a0 0x557f812139b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff78c4bab80 4 client.27055 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:32:01.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.589+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2570697343 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557f810afff0 con 0x557f812115a0 2023-07-21T22:32:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.590+0000 7ff772d9d700 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f812115a0 0x557f812139b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.590+0000 7ff755ffb700 10 client.27055 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.590+0000 7ff772d9d700 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f812115a0 0x557f812139b0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70cfb79d670267fd server_cookie=be89bba28ed776c1 in_seq=0 out_seq=0 2023-07-21T22:32:01.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.600+0000 7ff755ffb700 1 -- 172.21.15.151:0/2570697343 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557f810afff0 con 0x557f812115a0 2023-07-21T22:32:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.600+0000 7ff755ffb700 10 client.27055 handle_command_reply: tid=0 2023-07-21T22:32:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.600+0000 7ff78c4bab80 1 client.27055 shutdown 2023-07-21T22:32:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2570697343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9210 msgr2=0x557f81204f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9210 0x557f81204f90 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x557f811ba370 tx=0x7ff760005300 comp rx=0 tx=0).stop 2023-07-21T22:32:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2570697343 shutdown_connections 2023-07-21T22:32:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f812115a0 0x557f812139b0 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f80fff6b0 0x557f81204a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff755ffb700 0 client.27055 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f811a9660 0x557f8120fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 --2- 172.21.15.151:0/2570697343 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f811a9210 0x557f81204f90 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2570697343 >> 172.21.15.151:0/2570697343 conn(0x557f81198ae0 msgr2=0x557f811a8220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2570697343 shutdown_connections 2023-07-21T22:32:01.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 1 -- 172.21.15.151:0/2570697343 wait complete. 2023-07-21T22:32:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.601+0000 7ff78c4bab80 20 client.27055 trim_cache size 0 max 16384 2023-07-21T22:32:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:32:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:32:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:32:01.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:32:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 -- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7580a12c0 msgr2=0x7ff7580a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7580a12c0 0x7ff7580a3770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff76409acf0 tx=0x7ff764005910 comp rx=0 tx=0).stop 2023-07-21T22:32:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 -- 172.21.15.151:0/316437537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7740ffb00 msgr2=0x7ff774197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:01.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7740ffb00 0x7ff774197d50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7ff764005740 tx=0x7ff764005770 comp rx=0 tx=0).stop 2023-07-21T22:32:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 -- 172.21.15.151:0/316437537 shutdown_connections 2023-07-21T22:32:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7580a12c0 0x7ff7580a3770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff774105b10 0x7ff77419c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7740ffb00 0x7ff774197d50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 --2- 172.21.15.151:0/316437537 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7741004b0 0x7ff774198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:01.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 -- 172.21.15.151:0/316437537 >> 172.21.15.151:0/316437537 conn(0x7ff7740fb600 msgr2=0x7ff77410ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 -- 172.21.15.151:0/316437537 shutdown_connections 2023-07-21T22:32:01.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:01.602+0000 7ff778bff700 1 -- 172.21.15.151:0/316437537 wait complete. 2023-07-21T22:32:02.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:02 smithi187 ceph-mon[96918]: pgmap v400: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.4 MiB/s wr, 438 op/s 2023-07-21T22:32:02.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:02 smithi195 ceph-mon[97365]: pgmap v400: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.4 MiB/s wr, 438 op/s 2023-07-21T22:32:02.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:02 smithi151 ceph-mon[95510]: pgmap v400: 97 pgs: 97 active+clean; 9.8 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.4 MiB/s wr, 438 op/s 2023-07-21T22:32:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:04 smithi187 ceph-mon[96918]: pgmap v401: 97 pgs: 97 active+clean; 9.8 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.1 MiB/s wr, 669 op/s 2023-07-21T22:32:04.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:04 smithi195 ceph-mon[97365]: pgmap v401: 97 pgs: 97 active+clean; 9.8 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.1 MiB/s wr, 669 op/s 2023-07-21T22:32:04.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:04 smithi151 ceph-mon[95510]: pgmap v401: 97 pgs: 97 active+clean; 9.8 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.1 MiB/s wr, 669 op/s 2023-07-21T22:32:05.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:05 smithi187 ceph-mon[96918]: osdmap e101: 12 total, 12 up, 12 in 2023-07-21T22:32:05.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:05 smithi195 ceph-mon[97365]: osdmap e101: 12 total, 12 up, 12 in 2023-07-21T22:32:05.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:05 smithi151 ceph-mon[95510]: osdmap e101: 12 total, 12 up, 12 in 2023-07-21T22:32:06.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:06 smithi187 ceph-mon[96918]: pgmap v403: 97 pgs: 97 active+clean; 9.8 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 530 op/s 2023-07-21T22:32:06.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:06 smithi195 ceph-mon[97365]: pgmap v403: 97 pgs: 97 active+clean; 9.8 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 530 op/s 2023-07-21T22:32:06.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:06 smithi151 ceph-mon[95510]: pgmap v403: 97 pgs: 97 active+clean; 9.8 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.0 MiB/s wr, 530 op/s 2023-07-21T22:32:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:08 smithi187 ceph-mon[96918]: pgmap v404: 97 pgs: 97 active+clean; 9.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 517 op/s 2023-07-21T22:32:08.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:08 smithi195 ceph-mon[97365]: pgmap v404: 97 pgs: 97 active+clean; 9.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 517 op/s 2023-07-21T22:32:08.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:08 smithi151 ceph-mon[95510]: pgmap v404: 97 pgs: 97 active+clean; 9.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 517 op/s 2023-07-21T22:32:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:10 smithi187 ceph-mon[96918]: pgmap v405: 97 pgs: 97 active+clean; 9.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 517 op/s 2023-07-21T22:32:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:10 smithi195 ceph-mon[97365]: pgmap v405: 97 pgs: 97 active+clean; 9.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 517 op/s 2023-07-21T22:32:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:10 smithi151 ceph-mon[95510]: pgmap v405: 97 pgs: 97 active+clean; 9.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 517 op/s 2023-07-21T22:32:12.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:12 smithi151 ceph-mon[95510]: pgmap v406: 97 pgs: 97 active+clean; 9.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 517 op/s 2023-07-21T22:32:12.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:12 smithi151 ceph-mon[95510]: osdmap e102: 12 total, 12 up, 12 in 2023-07-21T22:32:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:12 smithi187 ceph-mon[96918]: pgmap v406: 97 pgs: 97 active+clean; 9.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 517 op/s 2023-07-21T22:32:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:12 smithi187 ceph-mon[96918]: osdmap e102: 12 total, 12 up, 12 in 2023-07-21T22:32:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:12 smithi195 ceph-mon[97365]: pgmap v406: 97 pgs: 97 active+clean; 9.3 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.9 MiB/s wr, 517 op/s 2023-07-21T22:32:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:12 smithi195 ceph-mon[97365]: osdmap e102: 12 total, 12 up, 12 in 2023-07-21T22:32:14.701 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:14 smithi151 ceph-mon[95510]: pgmap v408: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 556 op/s 2023-07-21T22:32:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.754+0000 7f3522bff700 1 -- 172.21.15.151:0/484049633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 msgr2=0x7f351c10be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.754+0000 7f3522bff700 1 --2- 172.21.15.151:0/484049633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 0x7f351c10be90 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f3508009990 tx=0x7f3508009ca0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.754+0000 7f3522bff700 1 -- 172.21.15.151:0/484049633 shutdown_connections 2023-07-21T22:32:14.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.754+0000 7f3522bff700 1 --2- 172.21.15.151:0/484049633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f351c072830 0x7f351c072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.754+0000 7f3522bff700 1 --2- 172.21.15.151:0/484049633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c10c3d0 0x7f351c10e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.754+0000 7f3522bff700 1 --2- 172.21.15.151:0/484049633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 0x7f351c10be90 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.754+0000 7f3522bff700 1 -- 172.21.15.151:0/484049633 >> 172.21.15.151:0/484049633 conn(0x7f351c0fb5f0 msgr2=0x7f351c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:14.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.754+0000 7f3522bff700 1 -- 172.21.15.151:0/484049633 shutdown_connections 2023-07-21T22:32:14.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.754+0000 7f3522bff700 1 -- 172.21.15.151:0/484049633 wait complete. 2023-07-21T22:32:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.755+0000 7f3522bff700 1 Processor -- start 2023-07-21T22:32:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.755+0000 7f3522bff700 1 -- start start 2023-07-21T22:32:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f3522bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f351c072830 0x7f351c197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f3522bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 0x7f351c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f3522bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c10c3d0 0x7f351c19c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f3522bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c19cf20 con 0x7f351c073140 2023-07-21T22:32:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f3522bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c19d090 con 0x7f351c072830 2023-07-21T22:32:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f3522bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351c19d250 con 0x7f351c10c3d0 2023-07-21T22:32:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f351bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 0x7f351c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f351bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 0x7f351c198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37990/0 (socket says 172.21.15.151:37990) 2023-07-21T22:32:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f351bfff700 1 -- 172.21.15.151:0/2985307098 learned_addr learned my addr 172.21.15.151:0/2985307098 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f352099b700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f351c072830 0x7f351c197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f352119c700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c10c3d0 0x7f351c19c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f351bfff700 1 -- 172.21.15.151:0/2985307098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c10c3d0 msgr2=0x7f351c19c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f351bfff700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c10c3d0 0x7f351c19c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f351bfff700 1 -- 172.21.15.151:0/2985307098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f351c072830 msgr2=0x7f351c197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f351bfff700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f351c072830 0x7f351c197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f351bfff700 1 -- 172.21.15.151:0/2985307098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35080095f0 con 0x7f351c073140 2023-07-21T22:32:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.756+0000 7f352099b700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f351c072830 0x7f351c197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.757+0000 7f351bfff700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 0x7f351c198270 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3508005740 tx=0x7f3508005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:14.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.757+0000 7f3519ffb700 1 -- 172.21.15.151:0/2985307098 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350801d070 con 0x7f351c073140 2023-07-21T22:32:14.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.757+0000 7f3519ffb700 1 -- 172.21.15.151:0/2985307098 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3508022470 con 0x7f351c073140 2023-07-21T22:32:14.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.757+0000 7f3522bff700 1 -- 172.21.15.151:0/2985307098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f351c19d4d0 con 0x7f351c073140 2023-07-21T22:32:14.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.757+0000 7f3519ffb700 1 -- 172.21.15.151:0/2985307098 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3508017650 con 0x7f351c073140 2023-07-21T22:32:14.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.757+0000 7f3522bff700 1 -- 172.21.15.151:0/2985307098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c1a4d70 con 0x7f351c073140 2023-07-21T22:32:14.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.762+0000 7f3519ffb700 1 -- 172.21.15.151:0/2985307098 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f350800fb00 con 0x7f351c073140 2023-07-21T22:32:14.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3536500b80 1 Processor -- start 2023-07-21T22:32:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3536500b80 1 -- start start 2023-07-21T22:32:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3519ffb700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f350c0a12c0 0x7f350c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3536500b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc8fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3536500b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 0x55981fc89f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3536500b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90660 0x55981fc8a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3536500b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fb8fc50 con 0x55981fae66b0 2023-07-21T22:32:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3536500b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fbe29e0 con 0x55981fc90210 2023-07-21T22:32:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3536500b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fbdbe70 con 0x55981fc90660 2023-07-21T22:32:14.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.763+0000 7f3519ffb700 1 -- 172.21.15.151:0/2985307098 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f35080ce280 con 0x7f351c073140 2023-07-21T22:32:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352119c700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f350c0a12c0 0x7f350c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352099b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc8fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352099b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc8fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38000/0 (socket says 172.21.15.151:38000) 2023-07-21T22:32:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352099b700 1 -- 172.21.15.151:0/122725562 learned_addr learned my addr 172.21.15.151:0/122725562 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:14.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f351bfff700 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 0x55981fc89f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352119c700 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90660 0x55981fc8a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352099b700 1 -- 172.21.15.151:0/122725562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90660 msgr2=0x55981fc8a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352099b700 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90660 0x55981fc8a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352099b700 1 -- 172.21.15.151:0/122725562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 msgr2=0x55981fc89f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352099b700 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 0x55981fc89f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352099b700 1 -- 172.21.15.151:0/122725562 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55981fa09d80 con 0x55981fae66b0 2023-07-21T22:32:14.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f351bfff700 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 0x55981fc89f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:14.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352119c700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f350c0a12c0 0x7f350c0a3770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f35140076f0 tx=0x7f3514007ab0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:14.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.764+0000 7f352099b700 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc8fcd0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f35100115f0 tx=0x7f3510011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94a0d4aa43531cc9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:14.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3506ffd700 1 -- 172.21.15.151:0/122725562 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510019630 con 0x55981fae66b0 2023-07-21T22:32:14.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3506ffd700 1 -- 172.21.15.151:0/122725562 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3510019c20 con 0x55981fae66b0 2023-07-21T22:32:14.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3506ffd700 1 -- 172.21.15.151:0/122725562 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000eac0 con 0x55981fae66b0 2023-07-21T22:32:14.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3536500b80 1 -- 172.21.15.151:0/122725562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 msgr2=0x55981fc8fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3536500b80 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc8fcd0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f35100115f0 tx=0x7f3510011900 comp rx=0 tx=0).stop 2023-07-21T22:32:14.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3536500b80 1 -- 172.21.15.151:0/122725562 shutdown_connections 2023-07-21T22:32:14.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3536500b80 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90660 0x55981fc8a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3536500b80 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc8fcd0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3536500b80 1 --2- 172.21.15.151:0/122725562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 0x55981fc89f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.765+0000 7f3536500b80 1 -- 172.21.15.151:0/122725562 >> 172.21.15.151:0/122725562 conn(0x55981fc7fae0 msgr2=0x55981fc850e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:14.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.766+0000 7f3536500b80 1 -- 172.21.15.151:0/122725562 shutdown_connections 2023-07-21T22:32:14.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.766+0000 7f3536500b80 1 -- 172.21.15.151:0/122725562 wait complete. 2023-07-21T22:32:14.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.766+0000 7f3536500b80 1 -- start start 2023-07-21T22:32:14.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.766+0000 7f3536500b80 1 Processor -- start 2023-07-21T22:32:14.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f3536500b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc96580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f3536500b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 0x55981fc93790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f3536500b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90660 0x55981fc93da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f3536500b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fb7ba60 con 0x55981fae66b0 2023-07-21T22:32:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f3536500b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fb7b760 con 0x55981fc90660 2023-07-21T22:32:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f3536500b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fa5f8c0 con 0x55981fc90210 2023-07-21T22:32:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f3536500b80 10 client.0 _ll_register_callbacks cb 0x55981fb79700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f352099b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f352119c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90660 0x55981fc93da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f352099b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc96580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38006/0 (socket says 172.21.15.151:38006) 2023-07-21T22:32:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f352099b700 1 -- 172.21.15.151:0/655768239 learned_addr learned my addr 172.21.15.151:0/655768239 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.767+0000 7f351bfff700 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 0x55981fc93790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f352119c700 1 -- 172.21.15.151:0/655768239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 msgr2=0x55981fc93790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f352119c700 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 0x55981fc93790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f352119c700 1 -- 172.21.15.151:0/655768239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 msgr2=0x55981fc96580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f352119c700 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc96580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f352119c700 1 -- 172.21.15.151:0/655768239 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f351c1a4d70 con 0x55981fc90660 2023-07-21T22:32:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f352119c700 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90660 0x55981fc93da0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55981fc90a70 tx=0x7f3514004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5ed8b8da5178dcc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f34fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:32:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f34fbfff700 1 -- 172.21.15.151:0/655768239 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400e050 con 0x55981fc90660 2023-07-21T22:32:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f3536500b80 1 -- 172.21.15.151:0/655768239 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55981fb35490 con 0x55981fc90660 2023-07-21T22:32:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.768+0000 7f34fbfff700 1 -- 172.21.15.151:0/655768239 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3514019830 con 0x55981fc90660 2023-07-21T22:32:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f34fbfff700 1 -- 172.21.15.151:0/655768239 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f351401cea0 con 0x55981fc90660 2023-07-21T22:32:14.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f3536500b80 10 client.27041 fetch_fsmap learned FSMap version 54 2023-07-21T22:32:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f3536500b80 1 -- 172.21.15.151:0/655768239 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f3510009dd0 con 0x55981fc90660 2023-07-21T22:32:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f34fbfff700 1 -- 172.21.15.151:0/655768239 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3514032020 con 0x55981fc90660 2023-07-21T22:32:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f34fbfff700 1 -- 172.21.15.151:0/655768239 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 54) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f351401a950 con 0x55981fc90660 2023-07-21T22:32:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f3536500b80 10 client.27041 fetch_fsmap finished waiting for FSMap version 54 2023-07-21T22:32:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f3536500b80 10 client.27041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f3536500b80 20 client.27041 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f3536500b80 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55981fca3a80 0x55981fca5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f3536500b80 4 client.27041 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:32:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.769+0000 7f3536500b80 1 -- 172.21.15.151:0/655768239 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55981fbd4e50 con 0x55981fca3a80 2023-07-21T22:32:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.770+0000 7f352099b700 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55981fca3a80 0x55981fca5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.770+0000 7f352099b700 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55981fca3a80 0x55981fca5e90 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7617802e29a09c1 server_cookie=638fd960e3d2e5c3 in_seq=0 out_seq=0 2023-07-21T22:32:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.770+0000 7f34fbfff700 10 client.27041 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f34fbfff700 1 -- 172.21.15.151:0/655768239 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55981fbd4e50 con 0x55981fca3a80 2023-07-21T22:32:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f34fbfff700 10 client.27041 handle_command_reply: tid=0 2023-07-21T22:32:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 client.27041 shutdown 2023-07-21T22:32:14.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 -- 172.21.15.151:0/655768239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90660 msgr2=0x55981fc93da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90660 0x55981fc93da0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x55981fc90a70 tx=0x7f3514004b40 comp rx=0 tx=0).stop 2023-07-21T22:32:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 -- 172.21.15.151:0/655768239 shutdown_connections 2023-07-21T22:32:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55981fca3a80 0x55981fca5e90 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90660 0x55981fc93da0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f34fbfff700 0 client.27041 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fae66b0 0x55981fc96580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 --2- 172.21.15.151:0/655768239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 0x55981fc93790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 -- 172.21.15.151:0/655768239 >> 172.21.15.151:0/655768239 conn(0x55981fc7fae0 msgr2=0x55981fc843e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 -- 172.21.15.151:0/655768239 shutdown_connections 2023-07-21T22:32:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 1 -- 172.21.15.151:0/655768239 wait complete. 2023-07-21T22:32:14.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.771+0000 7f3536500b80 20 client.27041 trim_cache size 0 max 16384 2023-07-21T22:32:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f3536500b80 1 Processor -- start 2023-07-21T22:32:14.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f3536500b80 1 -- start start 2023-07-21T22:32:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f3536500b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fae66b0 0x55981fc9aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f3536500b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 0x55981fc911b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f3536500b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc960b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f3536500b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fc86760 con 0x55981fc90660 2023-07-21T22:32:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f3536500b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fc91d50 con 0x55981fae66b0 2023-07-21T22:32:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f3536500b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fc8e4b0 con 0x55981fc90210 2023-07-21T22:32:14.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f352119c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc960b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f351bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 0x55981fc911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f352119c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc960b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38010/0 (socket says 172.21.15.151:38010) 2023-07-21T22:32:14.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f352099b700 1 --2- 172.21.15.151:0/1630496791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fae66b0 0x55981fc9aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.787+0000 7f352119c700 1 -- 172.21.15.151:0/1630496791 learned_addr learned my addr 172.21.15.151:0/1630496791 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:14.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f352119c700 1 -- 172.21.15.151:0/1630496791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 msgr2=0x55981fc911b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f352119c700 1 --2- 172.21.15.151:0/1630496791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 0x55981fc911b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f352119c700 1 -- 172.21.15.151:0/1630496791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fae66b0 msgr2=0x55981fc9aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f352119c700 1 --2- 172.21.15.151:0/1630496791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fae66b0 0x55981fc9aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f352119c700 1 -- 172.21.15.151:0/1630496791 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55981f9f2c00 con 0x55981fc90660 2023-07-21T22:32:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f352099b700 1 --2- 172.21.15.151:0/1630496791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fae66b0 0x55981fc9aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:14.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f352119c700 1 --2- 172.21.15.151:0/1630496791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc960b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f35140094b0 tx=0x7f35140060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5586f9cecada812a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:14.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f35077fe700 1 -- 172.21.15.151:0/1630496791 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351400e070 con 0x55981fc90660 2023-07-21T22:32:14.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f35077fe700 1 -- 172.21.15.151:0/1630496791 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3514032030 con 0x55981fc90660 2023-07-21T22:32:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.788+0000 7f35077fe700 1 -- 172.21.15.151:0/1630496791 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3514019ad0 con 0x55981fc90660 2023-07-21T22:32:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.789+0000 7f3536500b80 1 -- 172.21.15.151:0/1630496791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 msgr2=0x55981fc960b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.789+0000 7f3536500b80 1 --2- 172.21.15.151:0/1630496791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc960b0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f35140094b0 tx=0x7f35140060e0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.789+0000 7f3536500b80 1 -- 172.21.15.151:0/1630496791 shutdown_connections 2023-07-21T22:32:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.789+0000 7f3536500b80 1 --2- 172.21.15.151:0/1630496791 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fae66b0 0x55981fc9aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.789+0000 7f3536500b80 1 --2- 172.21.15.151:0/1630496791 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc960b0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.789+0000 7f3536500b80 1 --2- 172.21.15.151:0/1630496791 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fc90210 0x55981fc911b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.789+0000 7f3536500b80 1 -- 172.21.15.151:0/1630496791 >> 172.21.15.151:0/1630496791 conn(0x55981fc7fae0 msgr2=0x55981fc90aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.789+0000 7f3536500b80 1 -- 172.21.15.151:0/1630496791 shutdown_connections 2023-07-21T22:32:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.789+0000 7f3536500b80 1 -- 172.21.15.151:0/1630496791 wait complete. 2023-07-21T22:32:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.790+0000 7f3536500b80 1 -- start start 2023-07-21T22:32:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.790+0000 7f3536500b80 1 Processor -- start 2023-07-21T22:32:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.790+0000 7f3536500b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fae66b0 0x55981fc8cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.790+0000 7f3536500b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 0x55981fc8b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.790+0000 7f3536500b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc8bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.790+0000 7f3536500b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fc8c1b0 con 0x55981fc90660 2023-07-21T22:32:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.790+0000 7f3536500b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fc8c320 con 0x55981fc90210 2023-07-21T22:32:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.790+0000 7f3536500b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55981fc8c4e0 con 0x55981fae66b0 2023-07-21T22:32:14.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.790+0000 7f3536500b80 10 client.0 _ll_register_callbacks cb 0x7f351401c7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:14.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352099b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fae66b0 0x55981fc8cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f351bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 0x55981fc8b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352099b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fae66b0 0x55981fc8cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60932/0 (socket says 172.21.15.151:60932) 2023-07-21T22:32:14.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352099b700 1 -- 172.21.15.151:0/3891853477 learned_addr learned my addr 172.21.15.151:0/3891853477 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352119c700 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc8bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352099b700 1 -- 172.21.15.151:0/3891853477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 msgr2=0x55981fc8b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352099b700 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 0x55981fc8b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352099b700 1 -- 172.21.15.151:0/3891853477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 msgr2=0x55981fc8bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352099b700 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc8bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352099b700 1 -- 172.21.15.151:0/3891853477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55981fa09d80 con 0x55981fae66b0 2023-07-21T22:32:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f352099b700 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fae66b0 0x55981fc8cee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3510005950 tx=0x7f3510009340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d13e4ca35d3d38e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.791+0000 7f34fbfff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:32:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f34fbfff700 1 -- 172.21.15.151:0/3891853477 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510028070 con 0x55981fae66b0 2023-07-21T22:32:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f3536500b80 1 -- 172.21.15.151:0/3891853477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3510019c20 con 0x55981fae66b0 2023-07-21T22:32:14.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f34fbfff700 1 -- 172.21.15.151:0/3891853477 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f35100050b0 con 0x55981fae66b0 2023-07-21T22:32:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f34fbfff700 1 -- 172.21.15.151:0/3891853477 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f351000e3b0 con 0x55981fae66b0 2023-07-21T22:32:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f3536500b80 10 client.27073 fetch_fsmap learned FSMap version 54 2023-07-21T22:32:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f3536500b80 1 -- 172.21.15.151:0/3891853477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f3510009dd0 con 0x55981fae66b0 2023-07-21T22:32:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f34fbfff700 1 -- 172.21.15.151:0/3891853477 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3510019c20 con 0x55981fae66b0 2023-07-21T22:32:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f34fbfff700 1 -- 172.21.15.151:0/3891853477 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 54) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3510003680 con 0x55981fae66b0 2023-07-21T22:32:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f3536500b80 10 client.27073 fetch_fsmap finished waiting for FSMap version 54 2023-07-21T22:32:14.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f3536500b80 10 client.27073 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:14.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f3536500b80 20 client.27073 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:14.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f3536500b80 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55981fcf8b70 0x55981fcfaf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:14.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f3536500b80 4 client.27073 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:32:14.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.792+0000 7f3536500b80 1 -- 172.21.15.151:0/3891853477 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55981fb96ff0 con 0x55981fcf8b70 2023-07-21T22:32:14.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.793+0000 7f351bfff700 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55981fcf8b70 0x55981fcfaf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:14.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.793+0000 7f351bfff700 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55981fcf8b70 0x55981fcfaf80 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bdbbe561febb725 server_cookie=1bfd8a0fd4f076fd in_seq=0 out_seq=0 2023-07-21T22:32:14.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.793+0000 7f34fbfff700 10 client.27073 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:14.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f34fbfff700 1 -- 172.21.15.151:0/3891853477 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55981fb96ff0 con 0x55981fcf8b70 2023-07-21T22:32:14.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f34fbfff700 10 client.27073 handle_command_reply: tid=0 2023-07-21T22:32:14.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 client.27073 shutdown 2023-07-21T22:32:14.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 -- 172.21.15.151:0/3891853477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fae66b0 msgr2=0x55981fc8cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fae66b0 0x55981fc8cee0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f3510005950 tx=0x7f3510009340 comp rx=0 tx=0).stop 2023-07-21T22:32:14.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 -- 172.21.15.151:0/3891853477 shutdown_connections 2023-07-21T22:32:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55981fcf8b70 0x55981fcfaf80 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55981fc90660 0x55981fc8bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55981fae66b0 0x55981fc8cee0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 --2- 172.21.15.151:0/3891853477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55981fc90210 0x55981fc8b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f34fbfff700 0 client.27073 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 -- 172.21.15.151:0/3891853477 >> 172.21.15.151:0/3891853477 conn(0x55981fc7fae0 msgr2=0x55981fc912c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:14.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 -- 172.21.15.151:0/3891853477 shutdown_connections 2023-07-21T22:32:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 1 -- 172.21.15.151:0/3891853477 wait complete. 2023-07-21T22:32:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.803+0000 7f3536500b80 20 client.27073 trim_cache size 0 max 16384 2023-07-21T22:32:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:32:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:32:14.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:32:14.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:32:14.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 -- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f350c0a12c0 msgr2=0x7f350c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f350c0a12c0 0x7f350c0a3770 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f35140076f0 tx=0x7f3514007ab0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 -- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 msgr2=0x7f351c198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 0x7f351c198270 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3508005740 tx=0x7f3508005770 comp rx=0 tx=0).stop 2023-07-21T22:32:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 -- 172.21.15.151:0/2985307098 shutdown_connections 2023-07-21T22:32:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f350c0a12c0 0x7f350c0a3770 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f351c072830 0x7f351c197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f351c10c3d0 0x7f351c19c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 --2- 172.21.15.151:0/2985307098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f351c073140 0x7f351c198270 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 -- 172.21.15.151:0/2985307098 >> 172.21.15.151:0/2985307098 conn(0x7f351c0fb5f0 msgr2=0x7f351c10e5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 -- 172.21.15.151:0/2985307098 shutdown_connections 2023-07-21T22:32:14.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:14.804+0000 7f3522bff700 1 -- 172.21.15.151:0/2985307098 wait complete. 2023-07-21T22:32:14.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:14 smithi187 ceph-mon[96918]: pgmap v408: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 556 op/s 2023-07-21T22:32:14.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:14 smithi195 ceph-mon[97365]: pgmap v408: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.3 MiB/s wr, 556 op/s 2023-07-21T22:32:15.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:15 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:32:15.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:15 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:32:15.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:15 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:32:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:16 smithi187 ceph-mon[96918]: pgmap v409: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 478 op/s 2023-07-21T22:32:16.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:16 smithi195 ceph-mon[97365]: pgmap v409: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 478 op/s 2023-07-21T22:32:16.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:16 smithi151 ceph-mon[95510]: pgmap v409: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 478 op/s 2023-07-21T22:32:18.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:18 smithi187 ceph-mon[96918]: pgmap v410: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:32:18.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:18 smithi195 ceph-mon[97365]: pgmap v410: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:32:18.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:18 smithi151 ceph-mon[95510]: pgmap v410: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:32:20.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:20 smithi187 ceph-mon[96918]: pgmap v411: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:32:20.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:20 smithi195 ceph-mon[97365]: pgmap v411: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:32:20.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:20 smithi151 ceph-mon[95510]: pgmap v411: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:32:22.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:22 smithi187 ceph-mon[96918]: pgmap v412: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:32:22.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:22 smithi195 ceph-mon[97365]: pgmap v412: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:32:22.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:22 smithi151 ceph-mon[95510]: pgmap v412: 97 pgs: 97 active+clean; 9.4 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:32:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:24 smithi187 ceph-mon[96918]: pgmap v413: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.7 MiB/s wr, 617 op/s 2023-07-21T22:32:24.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:24 smithi195 ceph-mon[97365]: pgmap v413: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.7 MiB/s wr, 617 op/s 2023-07-21T22:32:24.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:24 smithi151 ceph-mon[95510]: pgmap v413: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.7 MiB/s wr, 617 op/s 2023-07-21T22:32:26.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:26 smithi187 ceph-mon[96918]: pgmap v414: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:32:26.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:26 smithi195 ceph-mon[97365]: pgmap v414: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:32:26.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:26 smithi151 ceph-mon[95510]: pgmap v414: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:32:28.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.960+0000 7f178afff700 1 -- 172.21.15.151:0/2596833524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784105b60 msgr2=0x7f1784105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.960+0000 7f178afff700 1 --2- 172.21.15.151:0/2596833524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784105b60 0x7f1784105f30 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f1778009990 tx=0x7f1778009ca0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.961+0000 7f178afff700 1 -- 172.21.15.151:0/2596833524 shutdown_connections 2023-07-21T22:32:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.961+0000 7f178afff700 1 --2- 172.21.15.151:0/2596833524 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17841004e0 0x7f178410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.961+0000 7f178afff700 1 --2- 172.21.15.151:0/2596833524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784105b60 0x7f1784105f30 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.961+0000 7f178afff700 1 --2- 172.21.15.151:0/2596833524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17840ffb30 0x7f17840fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.961+0000 7f178afff700 1 -- 172.21.15.151:0/2596833524 >> 172.21.15.151:0/2596833524 conn(0x7f17840fb5f0 msgr2=0x7f17840fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.961+0000 7f178afff700 1 -- 172.21.15.151:0/2596833524 shutdown_connections 2023-07-21T22:32:28.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.961+0000 7f178afff700 1 -- 172.21.15.151:0/2596833524 wait complete. 2023-07-21T22:32:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.962+0000 7f178afff700 1 Processor -- start 2023-07-21T22:32:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.962+0000 7f178afff700 1 -- start start 2023-07-21T22:32:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f178afff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ffb30 0x7f1784197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f178afff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17841004e0 0x7f1784198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f178afff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784105b60 0x7f178419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f178afff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178419cf30 con 0x7f1784105b60 2023-07-21T22:32:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f178afff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178419d0a0 con 0x7f17841004e0 2023-07-21T22:32:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f178afff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178419d260 con 0x7f17840ffb30 2023-07-21T22:32:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f178959c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784105b60 0x7f178419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f1788d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ffb30 0x7f1784197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f1788d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ffb30 0x7f1784197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47496/0 (socket says 172.21.15.151:47496) 2023-07-21T22:32:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f1788d9b700 1 -- 172.21.15.151:0/22353249 learned_addr learned my addr 172.21.15.151:0/22353249 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:28.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f1783fff700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17841004e0 0x7f1784198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f1788d9b700 1 -- 172.21.15.151:0/22353249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17841004e0 msgr2=0x7f1784198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:28.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f1788d9b700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17841004e0 0x7f1784198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f1788d9b700 1 -- 172.21.15.151:0/22353249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784105b60 msgr2=0x7f178419c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f1788d9b700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784105b60 0x7f178419c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.963+0000 7f1788d9b700 1 -- 172.21.15.151:0/22353249 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17780095f0 con 0x7f17840ffb30 2023-07-21T22:32:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.964+0000 7f1788d9b700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ffb30 0x7f1784197d40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1778005740 tx=0x7f1778005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.964+0000 7f1781ffb700 1 -- 172.21.15.151:0/22353249 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177801d070 con 0x7f17840ffb30 2023-07-21T22:32:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.964+0000 7f178afff700 1 -- 172.21.15.151:0/22353249 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178419d4e0 con 0x7f17840ffb30 2023-07-21T22:32:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.964+0000 7f1781ffb700 1 -- 172.21.15.151:0/22353249 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1778022470 con 0x7f17840ffb30 2023-07-21T22:32:28.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.964+0000 7f1781ffb700 1 -- 172.21.15.151:0/22353249 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778017650 con 0x7f17840ffb30 2023-07-21T22:32:28.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.964+0000 7f178afff700 1 -- 172.21.15.151:0/22353249 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17841a4d80 con 0x7f17840ffb30 2023-07-21T22:32:28.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.967+0000 7f1781ffb700 1 -- 172.21.15.151:0/22353249 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f17780225e0 con 0x7f17840ffb30 2023-07-21T22:32:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.969+0000 7f179e9a9b80 1 Processor -- start 2023-07-21T22:32:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.969+0000 7f1781ffb700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17740a12c0 0x7f17740a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.969+0000 7f179e9a9b80 1 -- start start 2023-07-21T22:32:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.969+0000 7f1781ffb700 1 -- 172.21.15.151:0/22353249 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f17780ce080 con 0x7f17840ffb30 2023-07-21T22:32:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.969+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf7dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.969+0000 7f178959c700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17740a12c0 0x7f17740a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.969+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf77f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e660 0x55d14bf784a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14be7dc50 con 0x55d14bdd46b0 2023-07-21T22:32:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14bed09e0 con 0x55d14bf7e660 2023-07-21T22:32:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14bec9e70 con 0x55d14bf7e210 2023-07-21T22:32:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f1788d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf7dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f1783fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf77f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f1788d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf7dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44294/0 (socket says 172.21.15.151:44294) 2023-07-21T22:32:28.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f1788d9b700 1 -- 172.21.15.151:0/1217915983 learned_addr learned my addr 172.21.15.151:0/1217915983 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f178959c700 1 --2- 172.21.15.151:0/1217915983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e660 0x55d14bf784a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f1783fff700 1 -- 172.21.15.151:0/1217915983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e660 msgr2=0x55d14bf784a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f1783fff700 1 --2- 172.21.15.151:0/1217915983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e660 0x55d14bf784a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f1783fff700 1 -- 172.21.15.151:0/1217915983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 msgr2=0x55d14bf7dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f1783fff700 1 --2- 172.21.15.151:0/1217915983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf7dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.970+0000 7f178959c700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17740a12c0 0x7f17740a3770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f177c00f540 tx=0x7f177c009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:28.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.971+0000 7f1783fff700 1 -- 172.21.15.151:0/1217915983 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d14bcf7d80 con 0x55d14bf7e210 2023-07-21T22:32:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.971+0000 7f1788d9b700 1 --2- 172.21.15.151:0/1217915983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf7dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.971+0000 7f1783fff700 1 --2- 172.21.15.151:0/1217915983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf77f40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1770009c80 tx=0x7f1770009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55eef07b1c21d34c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.971+0000 7f176effd700 1 -- 172.21.15.151:0/1217915983 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770011cb0 con 0x55d14bf7e210 2023-07-21T22:32:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.971+0000 7f176effd700 1 -- 172.21.15.151:0/1217915983 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1770011e10 con 0x55d14bf7e210 2023-07-21T22:32:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.971+0000 7f176effd700 1 -- 172.21.15.151:0/1217915983 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770005280 con 0x55d14bf7e210 2023-07-21T22:32:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.972+0000 7f179e9a9b80 1 -- 172.21.15.151:0/1217915983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 msgr2=0x55d14bf77f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.972+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/1217915983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf77f40 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1770009c80 tx=0x7f1770009f90 comp rx=0 tx=0).stop 2023-07-21T22:32:28.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.972+0000 7f179e9a9b80 1 -- 172.21.15.151:0/1217915983 shutdown_connections 2023-07-21T22:32:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.972+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/1217915983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e660 0x55d14bf784a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.972+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/1217915983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf7dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.972+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/1217915983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf77f40 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.972+0000 7f179e9a9b80 1 -- 172.21.15.151:0/1217915983 >> 172.21.15.151:0/1217915983 conn(0x55d14bf6dae0 msgr2=0x55d14bf730e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.972+0000 7f179e9a9b80 1 -- 172.21.15.151:0/1217915983 shutdown_connections 2023-07-21T22:32:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.972+0000 7f179e9a9b80 1 -- 172.21.15.151:0/1217915983 wait complete. 2023-07-21T22:32:28.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.973+0000 7f179e9a9b80 1 -- start start 2023-07-21T22:32:28.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.973+0000 7f179e9a9b80 1 Processor -- start 2023-07-21T22:32:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bdd46b0 0x55d14bf84590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 0x55d14bf81880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 0x55d14bf81f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14be69a60 con 0x55d14bf7e660 2023-07-21T22:32:28.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14be69760 con 0x55d14bf7e210 2023-07-21T22:32:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14bd4d8c0 con 0x55d14bdd46b0 2023-07-21T22:32:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f179e9a9b80 10 client.0 _ll_register_callbacks cb 0x55d14be67700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f1788d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bdd46b0 0x55d14bf84590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f1788d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bdd46b0 0x55d14bf84590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47516/0 (socket says 172.21.15.151:47516) 2023-07-21T22:32:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f1788d9b700 1 -- 172.21.15.151:0/3069907483 learned_addr learned my addr 172.21.15.151:0/3069907483 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f178959c700 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 0x55d14bf81f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.974+0000 7f1783fff700 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 0x55d14bf81880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1788d9b700 1 -- 172.21.15.151:0/3069907483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 msgr2=0x55d14bf81880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1788d9b700 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 0x55d14bf81880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1788d9b700 1 -- 172.21.15.151:0/3069907483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 msgr2=0x55d14bf81f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1788d9b700 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 0x55d14bf81f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1788d9b700 1 -- 172.21.15.151:0/3069907483 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17841a4d80 con 0x55d14bdd46b0 2023-07-21T22:32:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1788d9b700 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bdd46b0 0x55d14bf84590 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1778005cd0 tx=0x7f177809ad60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ec787a120154ad2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1763fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:32:28.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1763fff700 1 -- 172.21.15.151:0/3069907483 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177809f1d0 con 0x55d14bdd46b0 2023-07-21T22:32:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1763fff700 1 -- 172.21.15.151:0/3069907483 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f17780a3560 con 0x55d14bdd46b0 2023-07-21T22:32:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f179e9a9b80 1 -- 172.21.15.151:0/3069907483 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d14be23490 con 0x55d14bdd46b0 2023-07-21T22:32:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f1763fff700 1 -- 172.21.15.151:0/3069907483 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17780b92a0 con 0x55d14bdd46b0 2023-07-21T22:32:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f179e9a9b80 10 client.27085 fetch_fsmap learned FSMap version 54 2023-07-21T22:32:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.975+0000 7f179e9a9b80 1 -- 172.21.15.151:0/3069907483 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f17700098e0 con 0x55d14bdd46b0 2023-07-21T22:32:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.976+0000 7f1763fff700 1 -- 172.21.15.151:0/3069907483 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17780c9020 con 0x55d14bdd46b0 2023-07-21T22:32:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.976+0000 7f1763fff700 1 -- 172.21.15.151:0/3069907483 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 54) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f17780a30d0 con 0x55d14bdd46b0 2023-07-21T22:32:28.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.976+0000 7f179e9a9b80 10 client.27085 fetch_fsmap finished waiting for FSMap version 54 2023-07-21T22:32:28.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.976+0000 7f179e9a9b80 10 client.27085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:28.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.976+0000 7f179e9a9b80 20 client.27085 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:28.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.976+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d14bf917f0 0x55d14bf93c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.976+0000 7f179e9a9b80 4 client.27085 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:32:28.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.976+0000 7f179e9a9b80 1 -- 172.21.15.151:0/3069907483 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d14bec2e50 con 0x55d14bf917f0 2023-07-21T22:32:28.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.977+0000 7f1783fff700 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d14bf917f0 0x55d14bf93c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.977+0000 7f1783fff700 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d14bf917f0 0x55d14bf93c00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb6759f26eeadb33 server_cookie=99eefd01ca90da5 in_seq=0 out_seq=0 2023-07-21T22:32:28.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.977+0000 7f1763fff700 10 client.27085 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:28.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f1763fff700 1 -- 172.21.15.151:0/3069907483 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d14bec2e50 con 0x55d14bf917f0 2023-07-21T22:32:28.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f1763fff700 10 client.27085 handle_command_reply: tid=0 2023-07-21T22:32:28.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 client.27085 shutdown 2023-07-21T22:32:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 -- 172.21.15.151:0/3069907483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bdd46b0 msgr2=0x55d14bf84590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bdd46b0 0x55d14bf84590 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1778005cd0 tx=0x7f177809ad60 comp rx=0 tx=0).stop 2023-07-21T22:32:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 -- 172.21.15.151:0/3069907483 shutdown_connections 2023-07-21T22:32:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d14bf917f0 0x55d14bf93c00 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 0x55d14bf81f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f1763fff700 0 client.27085 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bdd46b0 0x55d14bf84590 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/3069907483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 0x55d14bf81880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 -- 172.21.15.151:0/3069907483 >> 172.21.15.151:0/3069907483 conn(0x55d14bf6dae0 msgr2=0x55d14bf723e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 -- 172.21.15.151:0/3069907483 shutdown_connections 2023-07-21T22:32:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.978+0000 7f179e9a9b80 1 -- 172.21.15.151:0/3069907483 wait complete. 2023-07-21T22:32:28.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.979+0000 7f179e9a9b80 20 client.27085 trim_cache size 0 max 16384 2023-07-21T22:32:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.998+0000 7f179e9a9b80 1 Processor -- start 2023-07-21T22:32:28.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.998+0000 7f179e9a9b80 1 -- start start 2023-07-21T22:32:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf88c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 0x55d14bf80eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e660 0x55d14bf84130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14bf7c560 con 0x55d14bdd46b0 2023-07-21T22:32:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14bf7d8a0 con 0x55d14bf7e210 2023-07-21T22:32:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14bf89170 con 0x55d14bf7e660 2023-07-21T22:32:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f1788d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf88c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f178959c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e660 0x55d14bf84130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f1788d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf88c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44306/0 (socket says 172.21.15.151:44306) 2023-07-21T22:32:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f1788d9b700 1 -- 172.21.15.151:0/2673843207 learned_addr learned my addr 172.21.15.151:0/2673843207 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f1783fff700 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 0x55d14bf80eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f178959c700 1 -- 172.21.15.151:0/2673843207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 msgr2=0x55d14bf80eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f178959c700 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 0x55d14bf80eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f178959c700 1 -- 172.21.15.151:0/2673843207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 msgr2=0x55d14bf88c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f178959c700 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf88c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f178959c700 1 -- 172.21.15.151:0/2673843207 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d14bce0c00 con 0x55d14bf7e660 2023-07-21T22:32:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f1783fff700 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 0x55d14bf80eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:28.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:27.999+0000 7f1788d9b700 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf88c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:28.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.000+0000 7f178959c700 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e660 0x55d14bf84130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f177c00f400 tx=0x7f177c01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4d3f65fdc5b707d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:28.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.000+0000 7f176f7fe700 1 -- 172.21.15.151:0/2673843207 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c00e040 con 0x55d14bf7e660 2023-07-21T22:32:28.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.000+0000 7f176f7fe700 1 -- 172.21.15.151:0/2673843207 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f177c00f040 con 0x55d14bf7e660 2023-07-21T22:32:28.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.000+0000 7f176f7fe700 1 -- 172.21.15.151:0/2673843207 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177c023760 con 0x55d14bf7e660 2023-07-21T22:32:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.001+0000 7f179e9a9b80 1 -- 172.21.15.151:0/2673843207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e660 msgr2=0x55d14bf84130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.001+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e660 0x55d14bf84130 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f177c00f400 tx=0x7f177c01c000 comp rx=0 tx=0).stop 2023-07-21T22:32:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.001+0000 7f179e9a9b80 1 -- 172.21.15.151:0/2673843207 shutdown_connections 2023-07-21T22:32:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.001+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e660 0x55d14bf84130 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.001+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bdd46b0 0x55d14bf88c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.001+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/2673843207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bf7e210 0x55d14bf80eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.001+0000 7f179e9a9b80 1 -- 172.21.15.151:0/2673843207 >> 172.21.15.151:0/2673843207 conn(0x55d14bf6dae0 msgr2=0x55d14bf7b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:28.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.001+0000 7f179e9a9b80 1 -- 172.21.15.151:0/2673843207 shutdown_connections 2023-07-21T22:32:28.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.001+0000 7f179e9a9b80 1 -- 172.21.15.151:0/2673843207 wait complete. 2023-07-21T22:32:28.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.002+0000 7f179e9a9b80 1 -- start start 2023-07-21T22:32:28.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.002+0000 7f179e9a9b80 1 Processor -- start 2023-07-21T22:32:28.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.002+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bdd46b0 0x55d14bf79b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.002+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf7a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.002+0000 7f179e9a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 0x55d14bf7a600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14bf89000 con 0x55d14bf7e660 2023-07-21T22:32:28.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14bfe5670 con 0x55d14bdd46b0 2023-07-21T22:32:28.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f179e9a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d14bfe5830 con 0x55d14bf7e210 2023-07-21T22:32:28.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f179e9a9b80 10 client.0 _ll_register_callbacks cb 0x55d14be67700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:28.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1783fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf7a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1783fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf7a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47548/0 (socket says 172.21.15.151:47548) 2023-07-21T22:32:28.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1783fff700 1 -- 172.21.15.151:0/448304588 learned_addr learned my addr 172.21.15.151:0/448304588 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:28.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f178959c700 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 0x55d14bf7a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1788d9b700 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bdd46b0 0x55d14bf79b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1783fff700 1 -- 172.21.15.151:0/448304588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bdd46b0 msgr2=0x55d14bf79b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1783fff700 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bdd46b0 0x55d14bf79b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1783fff700 1 -- 172.21.15.151:0/448304588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 msgr2=0x55d14bf7a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1783fff700 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 0x55d14bf7a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1783fff700 1 -- 172.21.15.151:0/448304588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17700098e0 con 0x55d14bf7e210 2023-07-21T22:32:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.003+0000 7f1783fff700 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf7a0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1770000c00 tx=0x7f1770009710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ab6b0a1b53251e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:28.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.004+0000 7f1763fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:32:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.004+0000 7f1763fff700 1 -- 172.21.15.151:0/448304588 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1770005ce0 con 0x55d14bf7e210 2023-07-21T22:32:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.004+0000 7f1763fff700 1 -- 172.21.15.151:0/448304588 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1770027b50 con 0x55d14bf7e210 2023-07-21T22:32:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.004+0000 7f179e9a9b80 1 -- 172.21.15.151:0/448304588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1770011e10 con 0x55d14bf7e210 2023-07-21T22:32:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.004+0000 7f1763fff700 1 -- 172.21.15.151:0/448304588 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1770027d10 con 0x55d14bf7e210 2023-07-21T22:32:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.004+0000 7f179e9a9b80 10 client.27091 fetch_fsmap learned FSMap version 54 2023-07-21T22:32:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.004+0000 7f179e9a9b80 1 -- 172.21.15.151:0/448304588 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) v3 -- 0x7f177c019540 con 0x55d14bf7e210 2023-07-21T22:32:28.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.004+0000 7f1763fff700 1 -- 172.21.15.151:0/448304588 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1770011e10 con 0x55d14bf7e210 2023-07-21T22:32:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.005+0000 7f1763fff700 1 -- 172.21.15.151:0/448304588 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 54) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1770004270 con 0x55d14bf7e210 2023-07-21T22:32:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.005+0000 7f179e9a9b80 10 client.27091 fetch_fsmap finished waiting for FSMap version 54 2023-07-21T22:32:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.005+0000 7f179e9a9b80 10 client.27091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.005+0000 7f179e9a9b80 20 client.27091 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.005+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d14bfe7000 0x55d14bfe9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.005+0000 7f179e9a9b80 4 client.27091 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:32:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.005+0000 7f179e9a9b80 1 -- 172.21.15.151:0/448304588 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d14be84ff0 con 0x55d14bfe7000 2023-07-21T22:32:28.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.005+0000 7f1788d9b700 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d14bfe7000 0x55d14bfe9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.006+0000 7f1788d9b700 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d14bfe7000 0x55d14bfe9410 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7add5c284a27237b server_cookie=5629dfced5a2fdd1 in_seq=0 out_seq=0 2023-07-21T22:32:28.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.006+0000 7f1763fff700 10 client.27091 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f1763fff700 1 -- 172.21.15.151:0/448304588 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d14be84ff0 con 0x55d14bfe7000 2023-07-21T22:32:28.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f1763fff700 10 client.27091 handle_command_reply: tid=0 2023-07-21T22:32:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f179e9a9b80 1 client.27091 shutdown 2023-07-21T22:32:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f179e9a9b80 1 -- 172.21.15.151:0/448304588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 msgr2=0x55d14bf7a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf7a0c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1770000c00 tx=0x7f1770009710 comp rx=0 tx=0).stop 2023-07-21T22:32:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f179e9a9b80 1 -- 172.21.15.151:0/448304588 shutdown_connections 2023-07-21T22:32:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d14bfe7000 0x55d14bfe9410 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d14bdd46b0 0x55d14bf79b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d14bf7e660 0x55d14bf7a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f1763fff700 0 client.27091 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f179e9a9b80 1 --2- 172.21.15.151:0/448304588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d14bf7e210 0x55d14bf7a0c0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.016+0000 7f179e9a9b80 1 -- 172.21.15.151:0/448304588 >> 172.21.15.151:0/448304588 conn(0x55d14bf6dae0 msgr2=0x55d14bf7c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.017+0000 7f179e9a9b80 1 -- 172.21.15.151:0/448304588 shutdown_connections 2023-07-21T22:32:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.017+0000 7f179e9a9b80 1 -- 172.21.15.151:0/448304588 wait complete. 2023-07-21T22:32:28.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.017+0000 7f179e9a9b80 20 client.27091 trim_cache size 0 max 16384 2023-07-21T22:32:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:32:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:32:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:32:28.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:32:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.017+0000 7f178afff700 1 -- 172.21.15.151:0/22353249 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17740a12c0 msgr2=0x7f17740a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.017+0000 7f178afff700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17740a12c0 0x7f17740a3770 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f177c00f540 tx=0x7f177c009920 comp rx=0 tx=0).stop 2023-07-21T22:32:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.017+0000 7f178afff700 1 -- 172.21.15.151:0/22353249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ffb30 msgr2=0x7f1784197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.017+0000 7f178afff700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ffb30 0x7f1784197d40 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1778005740 tx=0x7f1778005770 comp rx=0 tx=0).stop 2023-07-21T22:32:28.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.018+0000 7f178afff700 1 -- 172.21.15.151:0/22353249 shutdown_connections 2023-07-21T22:32:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.018+0000 7f178afff700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17740a12c0 0x7f17740a3770 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.018+0000 7f178afff700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1784105b60 0x7f178419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.018+0000 7f178afff700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17840ffb30 0x7f1784197d40 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.018+0000 7f178afff700 1 --2- 172.21.15.151:0/22353249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17841004e0 0x7f1784198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.018+0000 7f178afff700 1 -- 172.21.15.151:0/22353249 >> 172.21.15.151:0/22353249 conn(0x7f17840fb5f0 msgr2=0x7f1784072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.018+0000 7f178afff700 1 -- 172.21.15.151:0/22353249 shutdown_connections 2023-07-21T22:32:28.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:28.018+0000 7f178afff700 1 -- 172.21.15.151:0/22353249 wait complete. 2023-07-21T22:32:28.888 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:28 smithi187 ceph-mon[96918]: pgmap v415: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 618 op/s 2023-07-21T22:32:28.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:28 smithi195 ceph-mon[97365]: pgmap v415: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 618 op/s 2023-07-21T22:32:28.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:28 smithi151 ceph-mon[95510]: pgmap v415: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.8 MiB/s wr, 618 op/s 2023-07-21T22:32:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:30 smithi187 ceph-mon[96918]: pgmap v416: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 MiB/s wr, 416 op/s 2023-07-21T22:32:30.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:30 smithi195 ceph-mon[97365]: pgmap v416: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 MiB/s wr, 416 op/s 2023-07-21T22:32:30.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:30 smithi151 ceph-mon[95510]: pgmap v416: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 MiB/s wr, 416 op/s 2023-07-21T22:32:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:32 smithi187 ceph-mon[96918]: pgmap v417: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 MiB/s wr, 416 op/s 2023-07-21T22:32:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:32 smithi195 ceph-mon[97365]: pgmap v417: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 MiB/s wr, 416 op/s 2023-07-21T22:32:32.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:32 smithi151 ceph-mon[95510]: pgmap v417: 97 pgs: 97 active+clean; 9.4 GiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.2 MiB/s wr, 416 op/s 2023-07-21T22:32:34.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:34 smithi187 ceph-mon[96918]: pgmap v418: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 630 op/s 2023-07-21T22:32:34.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:34 smithi195 ceph-mon[97365]: pgmap v418: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 630 op/s 2023-07-21T22:32:34.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:34 smithi151 ceph-mon[95510]: pgmap v418: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.9 MiB/s wr, 630 op/s 2023-07-21T22:32:36.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:36 smithi187 ceph-mon[96918]: pgmap v419: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.3 MiB/s wr, 432 op/s 2023-07-21T22:32:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:36 smithi195 ceph-mon[97365]: pgmap v419: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.3 MiB/s wr, 432 op/s 2023-07-21T22:32:36.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:36 smithi151 ceph-mon[95510]: pgmap v419: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.3 MiB/s wr, 432 op/s 2023-07-21T22:32:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:38 smithi187 ceph-mon[96918]: pgmap v420: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.9 MiB/s wr, 636 op/s 2023-07-21T22:32:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:38 smithi195 ceph-mon[97365]: pgmap v420: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.9 MiB/s wr, 636 op/s 2023-07-21T22:32:38.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:38 smithi151 ceph-mon[95510]: pgmap v420: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.9 MiB/s wr, 636 op/s 2023-07-21T22:32:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:40 smithi187 ceph-mon[96918]: pgmap v421: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:32:40.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:40 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:32:40.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:40 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:32:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:40 smithi195 ceph-mon[97365]: pgmap v421: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:32:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:40 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:32:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:40 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:32:40.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:40 smithi151 ceph-mon[95510]: pgmap v421: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:32:40.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:40 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:32:40.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:40 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:32:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.203+0000 7ff8dfdff700 1 -- 172.21.15.151:0/663586414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d8107010 msgr2=0x7ff8d810ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:41.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.203+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/663586414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d8107010 0x7ff8d810ebe0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009f90 tx=0x7ff8d000b330 comp rx=0 tx=0).stop 2023-07-21T22:32:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.204+0000 7ff8dfdff700 1 -- 172.21.15.151:0/663586414 shutdown_connections 2023-07-21T22:32:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.204+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/663586414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d8107010 0x7ff8d810ebe0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.204+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/663586414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8101fd0 0x7ff8d81023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.204+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/663586414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8d8102970 0x7ff8d8106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.204+0000 7ff8dfdff700 1 -- 172.21.15.151:0/663586414 >> 172.21.15.151:0/663586414 conn(0x7ff8d80fd840 msgr2=0x7ff8d80ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.204+0000 7ff8dfdff700 1 -- 172.21.15.151:0/663586414 shutdown_connections 2023-07-21T22:32:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.204+0000 7ff8dfdff700 1 -- 172.21.15.151:0/663586414 wait complete. 2023-07-21T22:32:41.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.205+0000 7ff8dfdff700 1 Processor -- start 2023-07-21T22:32:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.205+0000 7ff8dfdff700 1 -- start start 2023-07-21T22:32:41.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8dfdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d8101fd0 0x7ff8d8197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8dfdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8102970 0x7ff8d8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8dfdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8d8107010 0x7ff8d819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8dfdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d819d0f0 con 0x7ff8d8102970 2023-07-21T22:32:41.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8dfdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d819d260 con 0x7ff8d8101fd0 2023-07-21T22:32:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8dfdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d819d420 con 0x7ff8d8107010 2023-07-21T22:32:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8de39c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8d8107010 0x7ff8d819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8de39c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8d8107010 0x7ff8d819cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48560/0 (socket says 172.21.15.151:48560) 2023-07-21T22:32:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8de39c700 1 -- 172.21.15.151:0/1285620049 learned_addr learned my addr 172.21.15.151:0/1285620049 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.206+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8102970 0x7ff8d8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8ddb9b700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d8101fd0 0x7ff8d8197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8de39c700 1 -- 172.21.15.151:0/1285620049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d8101fd0 msgr2=0x7ff8d8197f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8de39c700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d8101fd0 0x7ff8d8197f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8de39c700 1 -- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8102970 msgr2=0x7ff8d8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8de39c700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8102970 0x7ff8d8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8de39c700 1 -- 172.21.15.151:0/1285620049 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c80095f0 con 0x7ff8d8107010 2023-07-21T22:32:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8102970 0x7ff8d8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8de39c700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8d8107010 0x7ff8d819cab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009f60 tx=0x7ff8d0008b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8ceffd700 1 -- 172.21.15.151:0/1285620049 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000e040 con 0x7ff8d8107010 2023-07-21T22:32:41.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8dfdff700 1 -- 172.21.15.151:0/1285620049 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d0009c40 con 0x7ff8d8107010 2023-07-21T22:32:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8ceffd700 1 -- 172.21.15.151:0/1285620049 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8d000bbf0 con 0x7ff8d8107010 2023-07-21T22:32:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.207+0000 7ff8ceffd700 1 -- 172.21.15.151:0/1285620049 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d00052a0 con 0x7ff8d8107010 2023-07-21T22:32:41.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.208+0000 7ff8dfdff700 1 -- 172.21.15.151:0/1285620049 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d81a4d60 con 0x7ff8d8107010 2023-07-21T22:32:41.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.213+0000 7ff8ceffd700 1 -- 172.21.15.151:0/1285620049 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff8d001d470 con 0x7ff8d8107010 2023-07-21T22:32:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.213+0000 7ff8f3725b80 1 Processor -- start 2023-07-21T22:32:41.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.213+0000 7ff8f3725b80 1 -- start start 2023-07-21T22:32:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.214+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b33973a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.214+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b339734750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.214+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 0x55b339734cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.214+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b339631c50 con 0x55b3395886b0 2023-07-21T22:32:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.214+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3396849e0 con 0x55b33973ae70 2023-07-21T22:32:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.214+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33967de70 con 0x55b33973aa20 2023-07-21T22:32:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.214+0000 7ff8dd39a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b33973a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.214+0000 7ff8ddb9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b339734750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8dd39a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b33973a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39398/0 (socket says 172.21.15.151:39398) 2023-07-21T22:32:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8dd39a700 1 -- 172.21.15.151:0/3733636316 learned_addr learned my addr 172.21.15.151:0/3733636316 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:41.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/3733636316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 0x55b339734cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8dd39a700 1 -- 172.21.15.151:0/3733636316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 msgr2=0x55b339734750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/3733636316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b339734750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8dd39a700 1 -- 172.21.15.151:0/3733636316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 msgr2=0x55b339734cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/3733636316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 0x55b339734cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8dd39a700 1 -- 172.21.15.151:0/3733636316 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b3394abd80 con 0x55b3395886b0 2023-07-21T22:32:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8ceffd700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8c40a1340 0x7ff8c40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.215+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/3733636316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b33973a4e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8012940 tx=0x7ff8c8009940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e83ed7854a8b5e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:41.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.216+0000 7ff8ceffd700 1 -- 172.21.15.151:0/1285620049 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff8d00ce360 con 0x7ff8d8107010 2023-07-21T22:32:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.216+0000 7ff8ddb9b700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8c40a1340 0x7ff8c40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.216+0000 7ff8c3fff700 1 -- 172.21.15.151:0/3733636316 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8004830 con 0x55b3395886b0 2023-07-21T22:32:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.216+0000 7ff8c3fff700 1 -- 172.21.15.151:0/3733636316 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8c8004e20 con 0x55b3395886b0 2023-07-21T22:32:41.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.216+0000 7ff8c3fff700 1 -- 172.21.15.151:0/3733636316 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c800f450 con 0x55b3395886b0 2023-07-21T22:32:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.217+0000 7ff8f3725b80 1 -- 172.21.15.151:0/3733636316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 msgr2=0x55b33973a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.217+0000 7ff8ddb9b700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8c40a1340 0x7ff8c40a37f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009d80 tx=0x7ff8d4009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.217+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/3733636316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b33973a4e0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8012940 tx=0x7ff8c8009940 comp rx=0 tx=0).stop 2023-07-21T22:32:41.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.217+0000 7ff8f3725b80 1 -- 172.21.15.151:0/3733636316 shutdown_connections 2023-07-21T22:32:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.217+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/3733636316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 0x55b339734cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.217+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/3733636316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b33973a4e0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.217+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/3733636316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b339734750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.217+0000 7ff8f3725b80 1 -- 172.21.15.151:0/3733636316 >> 172.21.15.151:0/3733636316 conn(0x55b339721ae0 msgr2=0x55b3397270e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.217+0000 7ff8f3725b80 1 -- 172.21.15.151:0/3733636316 shutdown_connections 2023-07-21T22:32:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.218+0000 7ff8f3725b80 1 -- 172.21.15.151:0/3733636316 wait complete. 2023-07-21T22:32:41.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.218+0000 7ff8f3725b80 1 -- start start 2023-07-21T22:32:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.218+0000 7ff8f3725b80 1 Processor -- start 2023-07-21T22:32:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.219+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b339740db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.219+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b33973e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.219+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 0x55b33973e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.219+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33961da60 con 0x55b3395886b0 2023-07-21T22:32:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.219+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33961d760 con 0x55b33973ae70 2023-07-21T22:32:41.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.219+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3395018c0 con 0x55b33973aa20 2023-07-21T22:32:41.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.219+0000 7ff8f3725b80 10 client.0 _ll_register_callbacks cb 0x55b33961b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8ddb9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b339740db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8ddb9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b339740db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39412/0 (socket says 172.21.15.151:39412) 2023-07-21T22:32:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8ddb9b700 1 -- 172.21.15.151:0/378337359 learned_addr learned my addr 172.21.15.151:0/378337359 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:41.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8de39c700 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 0x55b33973e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b33973e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8de39c700 1 -- 172.21.15.151:0/378337359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 msgr2=0x55b33973e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8de39c700 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b33973e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8de39c700 1 -- 172.21.15.151:0/378337359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 msgr2=0x55b339740db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8de39c700 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b339740db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.220+0000 7ff8de39c700 1 -- 172.21.15.151:0/378337359 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8c801a040 con 0x55b33973ae70 2023-07-21T22:32:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.221+0000 7ff8de39c700 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 0x55b33973e740 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00cbad0 tx=0x7ff8d009b3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=993ab19a53dbcee1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:41.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.221+0000 7ff8c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:32:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.221+0000 7ff8c17fa700 1 -- 172.21.15.151:0/378337359 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d009f510 con 0x55b33973ae70 2023-07-21T22:32:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.221+0000 7ff8c17fa700 1 -- 172.21.15.151:0/378337359 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff8d00a38a0 con 0x55b33973ae70 2023-07-21T22:32:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.221+0000 7ff8f3725b80 1 -- 172.21.15.151:0/378337359 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b3395d7490 con 0x55b33973ae70 2023-07-21T22:32:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.221+0000 7ff8c17fa700 1 -- 172.21.15.151:0/378337359 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8d009f150 con 0x55b33973ae70 2023-07-21T22:32:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.221+0000 7ff8f3725b80 10 client.27077 fetch_fsmap learned FSMap version 55 2023-07-21T22:32:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.221+0000 7ff8f3725b80 1 -- 172.21.15.151:0/378337359 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55b339494c00 con 0x55b33973ae70 2023-07-21T22:32:41.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.222+0000 7ff8c17fa700 1 -- 172.21.15.151:0/378337359 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b3395d7490 con 0x55b33973ae70 2023-07-21T22:32:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.222+0000 7ff8c17fa700 1 -- 172.21.15.151:0/378337359 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 55) v1 ==== 7474+0+0 (secure 0 0 0) 0x7ff8d009b7d0 con 0x55b33973ae70 2023-07-21T22:32:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.222+0000 7ff8f3725b80 10 client.27077 fetch_fsmap finished waiting for FSMap version 55 2023-07-21T22:32:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.222+0000 7ff8f3725b80 10 client.27077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.222+0000 7ff8f3725b80 20 client.27077 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.222+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b33974e1f0 0x55b339750600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.222+0000 7ff8f3725b80 4 client.27077 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:32:41.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.222+0000 7ff8f3725b80 1 -- 172.21.15.151:0/378337359 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b339676e50 con 0x55b33974e1f0 2023-07-21T22:32:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.223+0000 7ff8ddb9b700 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b33974e1f0 0x55b339750600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.223+0000 7ff8ddb9b700 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b33974e1f0 0x55b339750600 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c5e6b51c437c385 server_cookie=4b61303c05c7f943 in_seq=0 out_seq=0 2023-07-21T22:32:41.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.223+0000 7ff8c17fa700 10 client.27077 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.224+0000 7ff8c17fa700 1 -- 172.21.15.151:0/378337359 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b339676e50 con 0x55b33974e1f0 2023-07-21T22:32:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.224+0000 7ff8c17fa700 10 client.27077 handle_command_reply: tid=0 2023-07-21T22:32:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.224+0000 7ff8f3725b80 1 client.27077 shutdown 2023-07-21T22:32:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 -- 172.21.15.151:0/378337359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 msgr2=0x55b33973e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 0x55b33973e740 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00cbad0 tx=0x7ff8d009b3a0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 -- 172.21.15.151:0/378337359 shutdown_connections 2023-07-21T22:32:41.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b33974e1f0 0x55b339750600 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b33973ae70 0x55b33973e740 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8c17fa700 0 client.27077 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b3395886b0 0x55b339740db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/378337359 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b33973e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 -- 172.21.15.151:0/378337359 >> 172.21.15.151:0/378337359 conn(0x55b339721ae0 msgr2=0x55b3397263e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 -- 172.21.15.151:0/378337359 shutdown_connections 2023-07-21T22:32:41.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 1 -- 172.21.15.151:0/378337359 wait complete. 2023-07-21T22:32:41.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.225+0000 7ff8f3725b80 20 client.27077 trim_cache size 0 max 16384 2023-07-21T22:32:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.255+0000 7ff8f3725b80 1 Processor -- start 2023-07-21T22:32:41.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.255+0000 7ff8f3725b80 1 -- start start 2023-07-21T22:32:41.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339745440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973aa20 0x55b3397398b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973ae70 0x55b339740950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3395d7490 con 0x55b33973aa20 2023-07-21T22:32:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b33973f050 con 0x55b3395886b0 2023-07-21T22:32:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b339735970 con 0x55b33973ae70 2023-07-21T22:32:41.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8ddb9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339745440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8ddb9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339745440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53132/0 (socket says 172.21.15.151:53132) 2023-07-21T22:32:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8ddb9b700 1 -- 172.21.15.151:0/1099470873 learned_addr learned my addr 172.21.15.151:0/1099470873 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8de39c700 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973ae70 0x55b339740950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.256+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973aa20 0x55b3397398b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8de39c700 1 -- 172.21.15.151:0/1099470873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 msgr2=0x55b339745440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8de39c700 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339745440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8de39c700 1 -- 172.21.15.151:0/1099470873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973aa20 msgr2=0x55b3397398b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:41.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8de39c700 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973aa20 0x55b3397398b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8de39c700 1 -- 172.21.15.151:0/1099470873 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b339755230 con 0x55b33973ae70 2023-07-21T22:32:41.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8ddb9b700 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339745440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8de39c700 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973ae70 0x55b339740950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00cc0d0 tx=0x7ff8d000b330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d6671190b87b1b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8ccbff700 1 -- 172.21.15.151:0/1099470873 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d009ae40 con 0x55b33973ae70 2023-07-21T22:32:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8ccbff700 1 -- 172.21.15.151:0/1099470873 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8d00a38a0 con 0x55b33973ae70 2023-07-21T22:32:41.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.257+0000 7ff8ccbff700 1 -- 172.21.15.151:0/1099470873 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d009b740 con 0x55b33973ae70 2023-07-21T22:32:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.258+0000 7ff8f3725b80 1 -- 172.21.15.151:0/1099470873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973ae70 msgr2=0x55b339740950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.258+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973ae70 0x55b339740950 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00cc0d0 tx=0x7ff8d000b330 comp rx=0 tx=0).stop 2023-07-21T22:32:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.258+0000 7ff8f3725b80 1 -- 172.21.15.151:0/1099470873 shutdown_connections 2023-07-21T22:32:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.258+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339745440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.258+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973ae70 0x55b339740950 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.258+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/1099470873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973aa20 0x55b3397398b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.258+0000 7ff8f3725b80 1 -- 172.21.15.151:0/1099470873 >> 172.21.15.151:0/1099470873 conn(0x55b339721ae0 msgr2=0x55b3397391a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.258+0000 7ff8f3725b80 1 -- 172.21.15.151:0/1099470873 shutdown_connections 2023-07-21T22:32:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.258+0000 7ff8f3725b80 1 -- 172.21.15.151:0/1099470873 wait complete. 2023-07-21T22:32:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.259+0000 7ff8f3725b80 1 -- start start 2023-07-21T22:32:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.259+0000 7ff8f3725b80 1 Processor -- start 2023-07-21T22:32:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339735f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b339736480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8f3725b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973ae70 0x55b3397369c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b339736f40 con 0x55b33973ae70 2023-07-21T22:32:41.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b3397370b0 con 0x55b3395886b0 2023-07-21T22:32:41.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8f3725b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b339737270 con 0x55b33973aa20 2023-07-21T22:32:41.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8f3725b80 10 client.0 _ll_register_callbacks cb 0x7ff8d0009b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:41.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8ddb9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339735f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8ddb9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339735f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53148/0 (socket says 172.21.15.151:53148) 2023-07-21T22:32:41.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8ddb9b700 1 -- 172.21.15.151:0/4231409281 learned_addr learned my addr 172.21.15.151:0/4231409281 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:41.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.260+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b339736480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.261+0000 7ff8de39c700 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973ae70 0x55b3397369c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.261+0000 7ff8ddb9b700 1 -- 172.21.15.151:0/4231409281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 msgr2=0x55b339736480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.261+0000 7ff8ddb9b700 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b339736480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.261+0000 7ff8ddb9b700 1 -- 172.21.15.151:0/4231409281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973ae70 msgr2=0x55b3397369c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.261+0000 7ff8ddb9b700 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973ae70 0x55b3397369c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.261+0000 7ff8ddb9b700 1 -- 172.21.15.151:0/4231409281 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d4012eb0 con 0x55b3395886b0 2023-07-21T22:32:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.261+0000 7ff8ddb9b700 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339735f40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8d402a560 tx=0x7ff8d4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb1bd3ded37a2f2c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.261+0000 7ff8c17fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:32:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.262+0000 7ff8c17fa700 1 -- 172.21.15.151:0/4231409281 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d4025040 con 0x55b3395886b0 2023-07-21T22:32:41.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.262+0000 7ff8f3725b80 1 -- 172.21.15.151:0/4231409281 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff8c8004e20 con 0x55b3395886b0 2023-07-21T22:32:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.262+0000 7ff8c17fa700 1 -- 172.21.15.151:0/4231409281 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff8d401f540 con 0x55b3395886b0 2023-07-21T22:32:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.262+0000 7ff8c17fa700 1 -- 172.21.15.151:0/4231409281 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff8d4017070 con 0x55b3395886b0 2023-07-21T22:32:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.262+0000 7ff8f3725b80 10 client.27083 fetch_fsmap learned FSMap version 55 2023-07-21T22:32:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.262+0000 7ff8f3725b80 1 -- 172.21.15.151:0/4231409281 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x55b339494c00 con 0x55b3395886b0 2023-07-21T22:32:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.262+0000 7ff8c17fa700 1 -- 172.21.15.151:0/4231409281 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff8d403f020 con 0x55b3395886b0 2023-07-21T22:32:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.263+0000 7ff8c17fa700 1 -- 172.21.15.151:0/4231409281 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 55) v1 ==== 7474+0+0 (secure 0 0 0) 0x7ff8d401e7e0 con 0x55b3395886b0 2023-07-21T22:32:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.263+0000 7ff8f3725b80 10 client.27083 fetch_fsmap finished waiting for FSMap version 55 2023-07-21T22:32:41.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.263+0000 7ff8f3725b80 10 client.27083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.263+0000 7ff8f3725b80 20 client.27083 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.263+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b3397a2c00 0x55b3397a5010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.263+0000 7ff8f3725b80 4 client.27083 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:32:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.263+0000 7ff8f3725b80 1 -- 172.21.15.151:0/4231409281 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b339638ff0 con 0x55b3397a2c00 2023-07-21T22:32:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.263+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b3397a2c00 0x55b3397a5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:41.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.264+0000 7ff8c17fa700 10 client.27083 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:41.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.264+0000 7ff8dd39a700 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b3397a2c00 0x55b3397a5010 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83e2f63043980cb3 server_cookie=ab84ec789970c175 in_seq=0 out_seq=0 2023-07-21T22:32:41.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.274+0000 7ff8c17fa700 1 -- 172.21.15.151:0/4231409281 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b339638ff0 con 0x55b3397a2c00 2023-07-21T22:32:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.274+0000 7ff8c17fa700 10 client.27083 handle_command_reply: tid=0 2023-07-21T22:32:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.274+0000 7ff8f3725b80 1 client.27083 shutdown 2023-07-21T22:32:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.274+0000 7ff8f3725b80 1 -- 172.21.15.151:0/4231409281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 msgr2=0x55b339735f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.274+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339735f40 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff8d402a560 tx=0x7ff8d4004750 comp rx=0 tx=0).stop 2023-07-21T22:32:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8f3725b80 1 -- 172.21.15.151:0/4231409281 shutdown_connections 2023-07-21T22:32:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b3397a2c00 0x55b3397a5010 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b3395886b0 0x55b339735f40 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b33973ae70 0x55b3397369c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8c17fa700 0 client.27083 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8f3725b80 1 --2- 172.21.15.151:0/4231409281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b33973aa20 0x55b339736480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8f3725b80 1 -- 172.21.15.151:0/4231409281 >> 172.21.15.151:0/4231409281 conn(0x55b339721ae0 msgr2=0x55b33972b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8f3725b80 1 -- 172.21.15.151:0/4231409281 shutdown_connections 2023-07-21T22:32:41.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8f3725b80 1 -- 172.21.15.151:0/4231409281 wait complete. 2023-07-21T22:32:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.275+0000 7ff8f3725b80 20 client.27083 trim_cache size 0 max 16384 2023-07-21T22:32:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:32:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:32:41.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:32:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:32:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 -- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8c40a1340 msgr2=0x7ff8c40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:41.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8c40a1340 0x7ff8c40a37f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff8d4009d80 tx=0x7ff8d4009260 comp rx=0 tx=0).stop 2023-07-21T22:32:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 -- 172.21.15.151:0/1285620049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8d8107010 msgr2=0x7ff8d819cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8d8107010 0x7ff8d819cab0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0009f60 tx=0x7ff8d0008b50 comp rx=0 tx=0).stop 2023-07-21T22:32:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 -- 172.21.15.151:0/1285620049 shutdown_connections 2023-07-21T22:32:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8c40a1340 0x7ff8c40a37f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8d8101fd0 0x7ff8d8197f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff8d8107010 0x7ff8d819cab0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 --2- 172.21.15.151:0/1285620049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8d8102970 0x7ff8d8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:41.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 -- 172.21.15.151:0/1285620049 >> 172.21.15.151:0/1285620049 conn(0x7ff8d80fd840 msgr2=0x7ff8d80fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 -- 172.21.15.151:0/1285620049 shutdown_connections 2023-07-21T22:32:41.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:41.276+0000 7ff8dfdff700 1 -- 172.21.15.151:0/1285620049 wait complete. 2023-07-21T22:32:41.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:41 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:32:41.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:41 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:32:41.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:41 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:32:41.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:41 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:32:41.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:41 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:32:41.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:41 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:32:41.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:41 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:32:41.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:41 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:32:41.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:41 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:32:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:42 smithi187 ceph-mon[96918]: pgmap v422: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:32:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:42 smithi195 ceph-mon[97365]: pgmap v422: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:32:42.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:42 smithi151 ceph-mon[95510]: pgmap v422: 97 pgs: 97 active+clean; 9.4 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.2 MiB/s wr, 418 op/s 2023-07-21T22:32:44.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:44 smithi187 ceph-mon[96918]: pgmap v423: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.7 MiB/s wr, 615 op/s 2023-07-21T22:32:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:44 smithi195 ceph-mon[97365]: pgmap v423: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.7 MiB/s wr, 615 op/s 2023-07-21T22:32:44.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:44 smithi151 ceph-mon[95510]: pgmap v423: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.7 MiB/s wr, 615 op/s 2023-07-21T22:32:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:46 smithi187 ceph-mon[96918]: pgmap v424: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:32:46.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:46 smithi195 ceph-mon[97365]: pgmap v424: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:32:46.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:46 smithi151 ceph-mon[95510]: pgmap v424: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:32:48.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:48 smithi187 ceph-mon[96918]: pgmap v425: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.6 MiB/s wr, 597 op/s 2023-07-21T22:32:48.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:48 smithi195 ceph-mon[97365]: pgmap v425: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.6 MiB/s wr, 597 op/s 2023-07-21T22:32:48.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:48 smithi151 ceph-mon[95510]: pgmap v425: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.6 MiB/s wr, 597 op/s 2023-07-21T22:32:50.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:50 smithi187 ceph-mon[96918]: pgmap v426: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:32:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:50 smithi195 ceph-mon[97365]: pgmap v426: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:32:50.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:50 smithi151 ceph-mon[95510]: pgmap v426: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:32:52.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:52 smithi187 ceph-mon[96918]: pgmap v427: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 393 op/s 2023-07-21T22:32:52.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:52 smithi195 ceph-mon[97365]: pgmap v427: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 393 op/s 2023-07-21T22:32:52.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:52 smithi151 ceph-mon[95510]: pgmap v427: 97 pgs: 97 active+clean; 9.5 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 3.0 MiB/s wr, 393 op/s 2023-07-21T22:32:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.433+0000 7fe7c8bff700 1 -- 172.21.15.151:0/2606134043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c40ffdc0 msgr2=0x7fe7c4100190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.433+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/2606134043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c40ffdc0 0x7fe7c4100190 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40099c0 tx=0x7fe7b4009cd0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.434+0000 7fe7c8bff700 1 -- 172.21.15.151:0/2606134043 shutdown_connections 2023-07-21T22:32:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.434+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/2606134043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7c4104e00 0x7fe7c410c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.434+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/2606134043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c40ffdc0 0x7fe7c4100190 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.434+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/2606134043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c4100760 0x7fe7c4104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.434+0000 7fe7c8bff700 1 -- 172.21.15.151:0/2606134043 >> 172.21.15.151:0/2606134043 conn(0x7fe7c40fb650 msgr2=0x7fe7c40fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.434+0000 7fe7c8bff700 1 -- 172.21.15.151:0/2606134043 shutdown_connections 2023-07-21T22:32:54.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.434+0000 7fe7c8bff700 1 -- 172.21.15.151:0/2606134043 wait complete. 2023-07-21T22:32:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.435+0000 7fe7c8bff700 1 Processor -- start 2023-07-21T22:32:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.435+0000 7fe7c8bff700 1 -- start start 2023-07-21T22:32:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.435+0000 7fe7c8bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c40ffdc0 0x7fe7c419bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.435+0000 7fe7c8bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7c4100760 0x7fe7c419c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.435+0000 7fe7c8bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c4104e00 0x7fe7c4195a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.435+0000 7fe7c8bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c41960d0 con 0x7fe7c4104e00 2023-07-21T22:32:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.435+0000 7fe7c8bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c4196240 con 0x7fe7c40ffdc0 2023-07-21T22:32:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.435+0000 7fe7c8bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c4196400 con 0x7fe7c4100760 2023-07-21T22:32:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.435+0000 7fe7c2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c4104e00 0x7fe7c4195a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7c4100760 0x7fe7c419c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c4104e00 0x7fe7c4195a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52774/0 (socket says 172.21.15.151:52774) 2023-07-21T22:32:54.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c2d9d700 1 -- 172.21.15.151:0/1955025620 learned_addr learned my addr 172.21.15.151:0/1955025620 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c259c700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c40ffdc0 0x7fe7c419bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c2d9d700 1 -- 172.21.15.151:0/1955025620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7c4100760 msgr2=0x7fe7c419c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7c4100760 0x7fe7c419c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c2d9d700 1 -- 172.21.15.151:0/1955025620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c40ffdc0 msgr2=0x7fe7c419bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c40ffdc0 0x7fe7c419bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c2d9d700 1 -- 172.21.15.151:0/1955025620 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b40095f0 con 0x7fe7c4104e00 2023-07-21T22:32:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c259c700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c40ffdc0 0x7fe7c419bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c4104e00 0x7fe7c4195a70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00ef30 tx=0x7fe7bc00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7bb7fe700 1 -- 172.21.15.151:0/1955025620 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc018070 con 0x7fe7c4104e00 2023-07-21T22:32:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.436+0000 7fe7bb7fe700 1 -- 172.21.15.151:0/1955025620 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7bc00f040 con 0x7fe7c4104e00 2023-07-21T22:32:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.437+0000 7fe7c8bff700 1 -- 172.21.15.151:0/1955025620 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c4196680 con 0x7fe7c4104e00 2023-07-21T22:32:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.437+0000 7fe7bb7fe700 1 -- 172.21.15.151:0/1955025620 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc00cc70 con 0x7fe7c4104e00 2023-07-21T22:32:54.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.437+0000 7fe7c8bff700 1 -- 172.21.15.151:0/1955025620 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c41a2c00 con 0x7fe7c4104e00 2023-07-21T22:32:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.440+0000 7fe7bb7fe700 1 -- 172.21.15.151:0/1955025620 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fe7bc007500 con 0x7fe7c4104e00 2023-07-21T22:32:54.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7dc5eab80 1 Processor -- start 2023-07-21T22:32:54.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7dc5eab80 1 -- start start 2023-07-21T22:32:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7bb7fe700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7b00a12c0 0x7fe7b00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 0x56215cc860e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc80350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7bb7fe700 1 -- 172.21.15.151:0/1955025620 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe7bc0cc820 con 0x7fe7c4104e00 2023-07-21T22:32:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cb81c50 con 0x56215cc86a70 2023-07-21T22:32:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cbd49e0 con 0x56215cad86b0 2023-07-21T22:32:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cbcde70 con 0x56215cc86620 2023-07-21T22:32:54.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.442+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7b00a12c0 0x7fe7b00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc80350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc808b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52784/0 (socket says 172.21.15.151:52784) 2023-07-21T22:32:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c2d9d700 1 -- 172.21.15.151:0/1362532646 learned_addr learned my addr 172.21.15.151:0/1362532646 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c259c700 1 --2- 172.21.15.151:0/1362532646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 0x56215cc860e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c2d9d700 1 -- 172.21.15.151:0/1362532646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 msgr2=0x56215cc80350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/1362532646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc80350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c2d9d700 1 -- 172.21.15.151:0/1362532646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 msgr2=0x56215cc860e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/1362532646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 0x56215cc860e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c2d9d700 1 -- 172.21.15.151:0/1362532646 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56215c9fbd80 con 0x56215cc86a70 2023-07-21T22:32:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7b00a12c0 0x7fe7b00a3770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe7c41973e0 tx=0x7fe7ac012780 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.443+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/1362532646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc808b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00ef00 tx=0x7fe7bc099550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37c360a718f021c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:54.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.444+0000 7fe7b8ff9700 1 -- 172.21.15.151:0/1362532646 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc09d970 con 0x56215cc86a70 2023-07-21T22:32:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.444+0000 7fe7b8ff9700 1 -- 172.21.15.151:0/1362532646 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7bc084040 con 0x56215cc86a70 2023-07-21T22:32:54.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.444+0000 7fe7b8ff9700 1 -- 172.21.15.151:0/1362532646 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7bc099e00 con 0x56215cc86a70 2023-07-21T22:32:54.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.444+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1362532646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 msgr2=0x56215cc808b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.444+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1362532646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc808b0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00ef00 tx=0x7fe7bc099550 comp rx=0 tx=0).stop 2023-07-21T22:32:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.445+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1362532646 shutdown_connections 2023-07-21T22:32:54.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.445+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1362532646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 0x56215cc860e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.445+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1362532646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc808b0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.445+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1362532646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc80350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.445+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1362532646 >> 172.21.15.151:0/1362532646 conn(0x56215cc71ae0 msgr2=0x56215cc770e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:54.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.445+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1362532646 shutdown_connections 2023-07-21T22:32:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.445+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1362532646 wait complete. 2023-07-21T22:32:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.445+0000 7fe7dc5eab80 1 -- start start 2023-07-21T22:32:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.445+0000 7fe7dc5eab80 1 Processor -- start 2023-07-21T22:32:54.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 0x56215cc8fad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc90010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc89d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cb6da60 con 0x56215cc86a70 2023-07-21T22:32:54.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cb6d760 con 0x56215cad86b0 2023-07-21T22:32:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215ca518c0 con 0x56215cc86620 2023-07-21T22:32:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7dc5eab80 10 client.0 _ll_register_callbacks cb 0x56215cb6b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7c1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc90010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7c2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc89d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7c1d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc90010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43034/0 (socket says 172.21.15.151:43034) 2023-07-21T22:32:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.446+0000 7fe7c1d9b700 1 -- 172.21.15.151:0/1536020301 learned_addr learned my addr 172.21.15.151:0/1536020301 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:54.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.447+0000 7fe7c259c700 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 0x56215cc8fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.447+0000 7fe7c1d9b700 1 -- 172.21.15.151:0/1536020301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 msgr2=0x56215cc8fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:54.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.447+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 0x56215cc8fad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.447+0000 7fe7c1d9b700 1 -- 172.21.15.151:0/1536020301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 msgr2=0x56215cc89d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:54.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.447+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc89d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.447+0000 7fe7c1d9b700 1 -- 172.21.15.151:0/1536020301 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c41a2c00 con 0x56215cc86620 2023-07-21T22:32:54.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.447+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc89d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:32:54.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.447+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc90010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac010760 tx=0x7fe7ac0047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=afdd3a340abe309d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.447+0000 7fe7a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:32:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.448+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/1536020301 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac004a30 con 0x56215cc86620 2023-07-21T22:32:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.448+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/1536020301 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe7ac004b90 con 0x56215cc86620 2023-07-21T22:32:54.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.448+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1536020301 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56215cb27490 con 0x56215cc86620 2023-07-21T22:32:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.448+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/1536020301 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7ac004d50 con 0x56215cc86620 2023-07-21T22:32:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.448+0000 7fe7dc5eab80 10 client.27121 fetch_fsmap learned FSMap version 55 2023-07-21T22:32:54.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.448+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1536020301 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x56215c9e4c00 con 0x56215cc86620 2023-07-21T22:32:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.448+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/1536020301 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56215cb27490 con 0x56215cc86620 2023-07-21T22:32:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.448+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/1536020301 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 55) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe7ac028680 con 0x56215cc86620 2023-07-21T22:32:54.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.449+0000 7fe7dc5eab80 10 client.27121 fetch_fsmap finished waiting for FSMap version 55 2023-07-21T22:32:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.449+0000 7fe7dc5eab80 10 client.27121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.449+0000 7fe7dc5eab80 20 client.27121 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.449+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56215cc99fe0 0x56215cc9c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.449+0000 7fe7dc5eab80 4 client.27121 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:32:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.449+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1536020301 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56215cbc6e50 con 0x56215cc99fe0 2023-07-21T22:32:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.449+0000 7fe7c259c700 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56215cc99fe0 0x56215cc9c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.450+0000 7fe7a9ffb700 10 client.27121 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.449+0000 7fe7c259c700 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56215cc99fe0 0x56215cc9c3f0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea72deca8d39c8a8 server_cookie=b1296c88e8863d84 in_seq=0 out_seq=0 2023-07-21T22:32:54.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.450+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/1536020301 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56215cbc6e50 con 0x56215cc99fe0 2023-07-21T22:32:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.450+0000 7fe7a9ffb700 10 client.27121 handle_command_reply: tid=0 2023-07-21T22:32:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.450+0000 7fe7dc5eab80 1 client.27121 shutdown 2023-07-21T22:32:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.450+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1536020301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 msgr2=0x56215cc90010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.450+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc90010 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac010760 tx=0x7fe7ac0047c0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1536020301 shutdown_connections 2023-07-21T22:32:54.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56215cc99fe0 0x56215cc9c3f0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cad86b0 0x56215cc8fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc86a70 0x56215cc89d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7a9ffb700 0 client.27121 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/1536020301 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc86620 0x56215cc90010 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1536020301 >> 172.21.15.151:0/1536020301 conn(0x56215cc71ae0 msgr2=0x56215cc7af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1536020301 shutdown_connections 2023-07-21T22:32:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/1536020301 wait complete. 2023-07-21T22:32:54.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.451+0000 7fe7dc5eab80 20 client.27121 trim_cache size 0 max 16384 2023-07-21T22:32:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7dc5eab80 1 Processor -- start 2023-07-21T22:32:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7dc5eab80 1 -- start start 2023-07-21T22:32:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc71ae0 0x56215cc8ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cad86b0 0x56215cc85670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 0x56215cc7b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cbc6e50 con 0x56215cad86b0 2023-07-21T22:32:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cb27490 con 0x56215cc86620 2023-07-21T22:32:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cc85d10 con 0x56215cc71ae0 2023-07-21T22:32:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7c1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cad86b0 0x56215cc85670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7c1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cad86b0 0x56215cc85670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52790/0 (socket says 172.21.15.151:52790) 2023-07-21T22:32:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7c1d9b700 1 -- 172.21.15.151:0/3987323972 learned_addr learned my addr 172.21.15.151:0/3987323972 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7c259c700 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc71ae0 0x56215cc8ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.468+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 0x56215cc7b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7c1d9b700 1 -- 172.21.15.151:0/3987323972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc71ae0 msgr2=0x56215cc8ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc71ae0 0x56215cc8ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7c1d9b700 1 -- 172.21.15.151:0/3987323972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 msgr2=0x56215cc7b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:54.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 0x56215cc7b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7c1d9b700 1 -- 172.21.15.151:0/3987323972 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56215cca1020 con 0x56215cad86b0 2023-07-21T22:32:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7c259c700 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc71ae0 0x56215cc8ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 0x56215cc7b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:32:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cad86b0 0x56215cc85670 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac013f00 tx=0x7fe7ac0058e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3afb6f77b873fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7b97fa700 1 -- 172.21.15.151:0/3987323972 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac010d50 con 0x56215cad86b0 2023-07-21T22:32:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7b97fa700 1 -- 172.21.15.151:0/3987323972 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7ac023070 con 0x56215cad86b0 2023-07-21T22:32:54.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.469+0000 7fe7b97fa700 1 -- 172.21.15.151:0/3987323972 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7ac004d60 con 0x56215cad86b0 2023-07-21T22:32:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/3987323972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cad86b0 msgr2=0x56215cc85670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cad86b0 0x56215cc85670 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fe7ac013f00 tx=0x7fe7ac0058e0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/3987323972 shutdown_connections 2023-07-21T22:32:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 0x56215cc7b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cc71ae0 0x56215cc8ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/3987323972 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cad86b0 0x56215cc85670 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/3987323972 >> 172.21.15.151:0/3987323972 conn(0x56215cc842e0 msgr2=0x56215cc7af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/3987323972 shutdown_connections 2023-07-21T22:32:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/3987323972 wait complete. 2023-07-21T22:32:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 -- start start 2023-07-21T22:32:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.470+0000 7fe7dc5eab80 1 Processor -- start 2023-07-21T22:32:54.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cad86b0 0x56215cc96580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc71ae0 0x56215cc948b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7dc5eab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 0x56215cc94e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cc95540 con 0x56215cc71ae0 2023-07-21T22:32:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215cc956b0 con 0x56215cc86620 2023-07-21T22:32:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7dc5eab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56215ccedeb0 con 0x56215cad86b0 2023-07-21T22:32:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7dc5eab80 10 client.0 _ll_register_callbacks cb 0x56215cb6b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:32:54.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7c1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc71ae0 0x56215cc948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7c259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cad86b0 0x56215cc96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7c1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc71ae0 0x56215cc948b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52798/0 (socket says 172.21.15.151:52798) 2023-07-21T22:32:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7c259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cad86b0 0x56215cc96580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43038/0 (socket says 172.21.15.151:43038) 2023-07-21T22:32:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.471+0000 7fe7c1d9b700 1 -- 172.21.15.151:0/511635878 learned_addr learned my addr 172.21.15.151:0/511635878 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:32:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.472+0000 7fe7c2d9d700 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 0x56215cc94e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.472+0000 7fe7c259c700 1 -- 172.21.15.151:0/511635878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 msgr2=0x56215cc94e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:54.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.472+0000 7fe7c259c700 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 0x56215cc94e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.472+0000 7fe7c259c700 1 -- 172.21.15.151:0/511635878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc71ae0 msgr2=0x56215cc948b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:32:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.472+0000 7fe7c259c700 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc71ae0 0x56215cc948b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.472+0000 7fe7c259c700 1 -- 172.21.15.151:0/511635878 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56215c9e4c00 con 0x56215cad86b0 2023-07-21T22:32:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.472+0000 7fe7c259c700 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cad86b0 0x56215cc96580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009990 tx=0x7fe7b400bac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67b0e156fc725ac1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:32:54.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.472+0000 7fe7a9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:32:54.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.473+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/511635878 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b402b040 con 0x56215cad86b0 2023-07-21T22:32:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.473+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/511635878 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(102..102 src has 1..102) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe7b40052d0 con 0x56215cad86b0 2023-07-21T22:32:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.473+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/511635878 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7bc084040 con 0x56215cad86b0 2023-07-21T22:32:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.476+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/511635878 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7b401d040 con 0x56215cad86b0 2023-07-21T22:32:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.476+0000 7fe7dc5eab80 10 client.27127 fetch_fsmap learned FSMap version 55 2023-07-21T22:32:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.476+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/511635878 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) v3 -- 0x56215ca221f0 con 0x56215cad86b0 2023-07-21T22:32:54.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.477+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/511635878 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7bc084040 con 0x56215cad86b0 2023-07-21T22:32:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.477+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/511635878 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 55) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe7b400f460 con 0x56215cad86b0 2023-07-21T22:32:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.477+0000 7fe7dc5eab80 10 client.27127 fetch_fsmap finished waiting for FSMap version 55 2023-07-21T22:32:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.477+0000 7fe7dc5eab80 10 client.27127 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:32:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.477+0000 7fe7dc5eab80 20 client.27127 populate_metadata read hostname 'smithi151' 2023-07-21T22:32:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.477+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56215cc86a70 0x56215ccf1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:32:54.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.477+0000 7fe7dc5eab80 4 client.27127 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:32:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.477+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/511635878 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56215cb88ff0 con 0x56215cc86a70 2023-07-21T22:32:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.477+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56215cc86a70 0x56215ccf1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:32:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.478+0000 7fe7a9ffb700 10 client.27127 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:54.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.478+0000 7fe7c1d9b700 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56215cc86a70 0x56215ccf1580 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c9237d0d4d4d6d8 server_cookie=7fb409610ad965ec in_seq=0 out_seq=0 2023-07-21T22:32:54.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7a9ffb700 1 -- 172.21.15.151:0/511635878 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56215cb88ff0 con 0x56215cc86a70 2023-07-21T22:32:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7a9ffb700 10 client.27127 handle_command_reply: tid=0 2023-07-21T22:32:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 client.27127 shutdown 2023-07-21T22:32:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/511635878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cad86b0 msgr2=0x56215cc96580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cad86b0 0x56215cc96580 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe7b4009990 tx=0x7fe7b400bac0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/511635878 shutdown_connections 2023-07-21T22:32:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56215cc86a70 0x56215ccf1580 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56215cc86620 0x56215cc94e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7a9ffb700 0 client.27127 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:32:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56215cad86b0 0x56215cc96580 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 --2- 172.21.15.151:0/511635878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56215cc71ae0 0x56215cc948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/511635878 >> 172.21.15.151:0/511635878 conn(0x56215cc842e0 msgr2=0x56215cc7b7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.487+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/511635878 shutdown_connections 2023-07-21T22:32:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7dc5eab80 1 -- 172.21.15.151:0/511635878 wait complete. 2023-07-21T22:32:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7dc5eab80 20 client.27127 trim_cache size 0 max 16384 2023-07-21T22:32:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:32:54.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:32:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:32:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:32:54.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 -- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7b00a12c0 msgr2=0x7fe7b00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7b00a12c0 0x7fe7b00a3770 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe7c41973e0 tx=0x7fe7ac012780 comp rx=0 tx=0).stop 2023-07-21T22:32:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 -- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c4104e00 msgr2=0x7fe7c4195a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:32:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c4104e00 0x7fe7c4195a70 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fe7bc00ef30 tx=0x7fe7bc00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 -- 172.21.15.151:0/1955025620 shutdown_connections 2023-07-21T22:32:54.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7b00a12c0 0x7fe7b00a3770 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c40ffdc0 0x7fe7c419bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7c4104e00 0x7fe7c4195a70 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 --2- 172.21.15.151:0/1955025620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7c4100760 0x7fe7c419c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:32:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.488+0000 7fe7c8bff700 1 -- 172.21.15.151:0/1955025620 >> 172.21.15.151:0/1955025620 conn(0x7fe7c40fb650 msgr2=0x7fe7c40fc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:32:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.489+0000 7fe7c8bff700 1 -- 172.21.15.151:0/1955025620 shutdown_connections 2023-07-21T22:32:54.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:32:54.489+0000 7fe7c8bff700 1 -- 172.21.15.151:0/1955025620 wait complete. 2023-07-21T22:32:54.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:54 smithi187 ceph-mon[96918]: pgmap v428: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.6 MiB/s wr, 606 op/s 2023-07-21T22:32:54.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:54 smithi195 ceph-mon[97365]: pgmap v428: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.6 MiB/s wr, 606 op/s 2023-07-21T22:32:54.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:54 smithi151 ceph-mon[95510]: pgmap v428: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.6 MiB/s wr, 606 op/s 2023-07-21T22:32:56.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:56 smithi187 ceph-mon[96918]: pgmap v429: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.2 MiB/s wr, 410 op/s 2023-07-21T22:32:56.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:56 smithi195 ceph-mon[97365]: pgmap v429: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.2 MiB/s wr, 410 op/s 2023-07-21T22:32:56.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:56 smithi151 ceph-mon[95510]: pgmap v429: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 3.2 MiB/s wr, 410 op/s 2023-07-21T22:32:58.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:32:58 smithi187 ceph-mon[96918]: pgmap v430: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 626 op/s 2023-07-21T22:32:58.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:32:58 smithi195 ceph-mon[97365]: pgmap v430: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 626 op/s 2023-07-21T22:32:58.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:32:58 smithi151 ceph-mon[95510]: pgmap v430: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 4.8 MiB/s wr, 626 op/s 2023-07-21T22:33:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:00 smithi187 ceph-mon[96918]: pgmap v431: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:33:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:00 smithi195 ceph-mon[97365]: pgmap v431: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:33:00.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:00 smithi151 ceph-mon[95510]: pgmap v431: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:33:02.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:02 smithi187 ceph-mon[96918]: pgmap v432: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:33:02.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:02 smithi195 ceph-mon[97365]: pgmap v432: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:33:02.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:02 smithi151 ceph-mon[95510]: pgmap v432: 97 pgs: 97 active+clean; 9.5 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:33:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:04 smithi187 ceph-mon[96918]: pgmap v433: 97 pgs: 97 active+clean; 9.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 647 op/s 2023-07-21T22:33:04.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:04 smithi195 ceph-mon[97365]: pgmap v433: 97 pgs: 97 active+clean; 9.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 647 op/s 2023-07-21T22:33:04.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:04 smithi151 ceph-mon[95510]: pgmap v433: 97 pgs: 97 active+clean; 9.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 647 op/s 2023-07-21T22:33:05.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:05 smithi187 ceph-mon[96918]: osdmap e103: 12 total, 12 up, 12 in 2023-07-21T22:33:05.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:05 smithi195 ceph-mon[97365]: osdmap e103: 12 total, 12 up, 12 in 2023-07-21T22:33:05.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:05 smithi151 ceph-mon[95510]: osdmap e103: 12 total, 12 up, 12 in 2023-07-21T22:33:06.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:06 smithi187 ceph-mon[96918]: pgmap v435: 97 pgs: 97 active+clean; 9.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.9 MiB/s wr, 521 op/s 2023-07-21T22:33:06.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:06 smithi195 ceph-mon[97365]: pgmap v435: 97 pgs: 97 active+clean; 9.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.9 MiB/s wr, 521 op/s 2023-07-21T22:33:06.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:06 smithi151 ceph-mon[95510]: pgmap v435: 97 pgs: 97 active+clean; 9.5 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.9 MiB/s wr, 521 op/s 2023-07-21T22:33:07.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.648+0000 7f160ebff700 1 -- 172.21.15.151:0/2338309125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16080ffb00 msgr2=0x7f16080fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:07.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.648+0000 7f160ebff700 1 --2- 172.21.15.151:0/2338309125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16080ffb00 0x7f16080fff70 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009990 tx=0x7f15f4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.648+0000 7f160ebff700 1 -- 172.21.15.151:0/2338309125 shutdown_connections 2023-07-21T22:33:07.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.648+0000 7f160ebff700 1 --2- 172.21.15.151:0/2338309125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f16081004b0 0x7f160810c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.648+0000 7f160ebff700 1 --2- 172.21.15.151:0/2338309125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1608105b10 0x7f1608105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.648+0000 7f160ebff700 1 --2- 172.21.15.151:0/2338309125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16080ffb00 0x7f16080fff70 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.648+0000 7f160ebff700 1 -- 172.21.15.151:0/2338309125 >> 172.21.15.151:0/2338309125 conn(0x7f16080fb600 msgr2=0x7f16080fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:07.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.648+0000 7f160ebff700 1 -- 172.21.15.151:0/2338309125 shutdown_connections 2023-07-21T22:33:07.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.648+0000 7f160ebff700 1 -- 172.21.15.151:0/2338309125 wait complete. 2023-07-21T22:33:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.649+0000 7f160ebff700 1 Processor -- start 2023-07-21T22:33:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160ebff700 1 -- start start 2023-07-21T22:33:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160ebff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16080ffb00 0x7f160819bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160ebff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16081004b0 0x7f160819c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160ebff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1608105b10 0x7f1608195990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160ebff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608196000 con 0x7f16080ffb00 2023-07-21T22:33:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160ebff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608196170 con 0x7f1608105b10 2023-07-21T22:33:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160ebff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1608196330 con 0x7f16081004b0 2023-07-21T22:33:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160c99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16080ffb00 0x7f160819bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160c99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16080ffb00 0x7f160819bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58670/0 (socket says 172.21.15.151:58670) 2023-07-21T22:33:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160c99b700 1 -- 172.21.15.151:0/1642373892 learned_addr learned my addr 172.21.15.151:0/1642373892 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f160d19c700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1608105b10 0x7f1608195990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.650+0000 7f1607fff700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16081004b0 0x7f160819c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f160c99b700 1 -- 172.21.15.151:0/1642373892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16081004b0 msgr2=0x7f160819c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f160c99b700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16081004b0 0x7f160819c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f160c99b700 1 -- 172.21.15.151:0/1642373892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1608105b10 msgr2=0x7f1608195990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f160c99b700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1608105b10 0x7f1608195990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f160c99b700 1 -- 172.21.15.151:0/1642373892 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15f40095f0 con 0x7f16080ffb00 2023-07-21T22:33:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f160d19c700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1608105b10 0x7f1608195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:33:07.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f1607fff700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16081004b0 0x7f160819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:33:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f160c99b700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16080ffb00 0x7f160819bb30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e9a0 tx=0x7f15fc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f1605ffb700 1 -- 172.21.15.151:0/1642373892 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc009790 con 0x7f16080ffb00 2023-07-21T22:33:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f160ebff700 1 -- 172.21.15.151:0/1642373892 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1608196610 con 0x7f16080ffb00 2023-07-21T22:33:07.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f1605ffb700 1 -- 172.21.15.151:0/1642373892 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15fc010430 con 0x7f16080ffb00 2023-07-21T22:33:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.651+0000 7f1605ffb700 1 -- 172.21.15.151:0/1642373892 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc00cea0 con 0x7f16080ffb00 2023-07-21T22:33:07.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.652+0000 7f160ebff700 1 -- 172.21.15.151:0/1642373892 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16081a2b20 con 0x7f16080ffb00 2023-07-21T22:33:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.656+0000 7f1605ffb700 1 -- 172.21.15.151:0/1642373892 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f15fc0105a0 con 0x7f16080ffb00 2023-07-21T22:33:07.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.657+0000 7f1622561b80 1 Processor -- start 2023-07-21T22:33:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.657+0000 7f1622561b80 1 -- start start 2023-07-21T22:33:07.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.657+0000 7f1622561b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b293a6b0 0x5569b2ae80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.657+0000 7f1622561b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 0x5569b2ae2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.657+0000 7f1622561b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2ae28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.657+0000 7f1622561b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b29e3c50 con 0x5569b2ae8620 2023-07-21T22:33:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.657+0000 7f1622561b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b2a369e0 con 0x5569b2ae8a70 2023-07-21T22:33:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.657+0000 7f1622561b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b2a2fe70 con 0x5569b293a6b0 2023-07-21T22:33:07.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f160d19c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b293a6b0 0x5569b2ae80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f160d19c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b293a6b0 0x5569b2ae80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57798/0 (socket says 172.21.15.151:57798) 2023-07-21T22:33:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f160d19c700 1 -- 172.21.15.151:0/3279611956 learned_addr learned my addr 172.21.15.151:0/3279611956 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f160c99b700 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 0x5569b2ae2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f1607fff700 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2ae28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f1605ffb700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f15f80a12c0 0x7f15f80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f1605ffb700 1 -- 172.21.15.151:0/1642373892 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f15fc014070 con 0x7f16080ffb00 2023-07-21T22:33:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f160c99b700 1 -- 172.21.15.151:0/3279611956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b293a6b0 msgr2=0x5569b2ae80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:07.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f160c99b700 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b293a6b0 0x5569b2ae80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f160c99b700 1 -- 172.21.15.151:0/3279611956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 msgr2=0x5569b2ae28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f160c99b700 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2ae28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.658+0000 7f160c99b700 1 -- 172.21.15.151:0/3279611956 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569b285dd80 con 0x5569b2ae8620 2023-07-21T22:33:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.659+0000 7f1607fff700 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2ae28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:33:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.659+0000 7f160d19c700 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b293a6b0 0x5569b2ae80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:33:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.659+0000 7f160d19c700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f15f80a12c0 0x7f15f80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.659+0000 7f160c99b700 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 0x5569b2ae2350 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0ca610 tx=0x7f15fc010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c424665f52eb8e24 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.659+0000 7f15f2ffd700 1 -- 172.21.15.151:0/3279611956 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc099ad0 con 0x5569b2ae8620 2023-07-21T22:33:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.659+0000 7f15f2ffd700 1 -- 172.21.15.151:0/3279611956 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15fc0998f0 con 0x5569b2ae8620 2023-07-21T22:33:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.659+0000 7f15f2ffd700 1 -- 172.21.15.151:0/3279611956 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc0996e0 con 0x5569b2ae8620 2023-07-21T22:33:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f160d19c700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f15f80a12c0 0x7f15f80a3770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1600009ec0 tx=0x7f1600004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f1622561b80 1 -- 172.21.15.151:0/3279611956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 msgr2=0x5569b2ae2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f1622561b80 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 0x5569b2ae2350 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f15fc0ca610 tx=0x7f15fc010a70 comp rx=0 tx=0).stop 2023-07-21T22:33:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f1622561b80 1 -- 172.21.15.151:0/3279611956 shutdown_connections 2023-07-21T22:33:07.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f1622561b80 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2ae28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f1622561b80 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b293a6b0 0x5569b2ae80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f1622561b80 1 --2- 172.21.15.151:0/3279611956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 0x5569b2ae2350 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f1622561b80 1 -- 172.21.15.151:0/3279611956 >> 172.21.15.151:0/3279611956 conn(0x5569b2ad3ae0 msgr2=0x5569b2ad90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f1622561b80 1 -- 172.21.15.151:0/3279611956 shutdown_connections 2023-07-21T22:33:07.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.660+0000 7f1622561b80 1 -- 172.21.15.151:0/3279611956 wait complete. 2023-07-21T22:33:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.661+0000 7f1622561b80 1 -- start start 2023-07-21T22:33:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.661+0000 7f1622561b80 1 Processor -- start 2023-07-21T22:33:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f1622561b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2af1930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f1622561b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2af1e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f1622561b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2aebc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f1622561b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b29cfa60 con 0x5569b293a6b0 2023-07-21T22:33:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f1622561b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b29cf760 con 0x5569b2ae8a70 2023-07-21T22:33:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f1622561b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b28b38c0 con 0x5569b2ae8620 2023-07-21T22:33:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f1622561b80 10 client.0 _ll_register_callbacks cb 0x5569b29cd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:33:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f160c99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2af1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f1607fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2af1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f160c99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2af1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58690/0 (socket says 172.21.15.151:58690) 2023-07-21T22:33:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f160c99b700 1 -- 172.21.15.151:0/331638491 learned_addr learned my addr 172.21.15.151:0/331638491 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:07.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.662+0000 7f160d19c700 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2aebc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.663+0000 7f160c99b700 1 -- 172.21.15.151:0/331638491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 msgr2=0x5569b2af1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:07.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.663+0000 7f160c99b700 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2af1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.663+0000 7f160c99b700 1 -- 172.21.15.151:0/331638491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 msgr2=0x5569b2aebc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:07.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.663+0000 7f160c99b700 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2aebc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.663+0000 7f160c99b700 1 -- 172.21.15.151:0/331638491 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1600003bb0 con 0x5569b293a6b0 2023-07-21T22:33:07.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.663+0000 7f160d19c700 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2aebc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:33:07.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.663+0000 7f160c99b700 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2af1930 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f15fc099c90 tx=0x7f15fc0a2200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fceb9d73adb1b51a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:07.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.663+0000 7f15e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:33:07.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.663+0000 7f15e7fff700 1 -- 172.21.15.151:0/331638491 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc010880 con 0x5569b293a6b0 2023-07-21T22:33:07.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.664+0000 7f15e7fff700 1 -- 172.21.15.151:0/331638491 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f15fc0966a0 con 0x5569b293a6b0 2023-07-21T22:33:07.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.664+0000 7f1622561b80 1 -- 172.21.15.151:0/331638491 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5569b2989490 con 0x5569b293a6b0 2023-07-21T22:33:07.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.664+0000 7f15e7fff700 1 -- 172.21.15.151:0/331638491 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15fc0a23e0 con 0x5569b293a6b0 2023-07-21T22:33:07.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.664+0000 7f1622561b80 10 client.17424 fetch_fsmap learned FSMap version 56 2023-07-21T22:33:07.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.664+0000 7f1622561b80 1 -- 172.21.15.151:0/331638491 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x7f160810d240 con 0x5569b293a6b0 2023-07-21T22:33:07.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.664+0000 7f15e7fff700 1 -- 172.21.15.151:0/331638491 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15fc0b8030 con 0x5569b293a6b0 2023-07-21T22:33:07.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.665+0000 7f15e7fff700 1 -- 172.21.15.151:0/331638491 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 56) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f15fc095d80 con 0x5569b293a6b0 2023-07-21T22:33:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.665+0000 7f1622561b80 10 client.17424 fetch_fsmap finished waiting for FSMap version 56 2023-07-21T22:33:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.665+0000 7f1622561b80 10 client.17424 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:33:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.665+0000 7f1622561b80 20 client.17424 populate_metadata read hostname 'smithi151' 2023-07-21T22:33:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.665+0000 7f1622561b80 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b2afbb70 0x5569b2afdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.665+0000 7f1622561b80 4 client.17424 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:33:07.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.665+0000 7f1622561b80 1 -- 172.21.15.151:0/331638491 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5569b2a28e50 con 0x5569b2afbb70 2023-07-21T22:33:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.665+0000 7f1607fff700 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b2afbb70 0x5569b2afdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.666+0000 7f1607fff700 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b2afbb70 0x5569b2afdf50 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2865789f9a443ea server_cookie=cce56ca120eb2c33 in_seq=0 out_seq=0 2023-07-21T22:33:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.666+0000 7f15e7fff700 10 client.17424 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.666+0000 7f15e7fff700 1 -- 172.21.15.151:0/331638491 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5569b2a28e50 con 0x5569b2afbb70 2023-07-21T22:33:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f15e7fff700 10 client.17424 handle_command_reply: tid=0 2023-07-21T22:33:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 client.17424 shutdown 2023-07-21T22:33:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 -- 172.21.15.151:0/331638491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 msgr2=0x5569b2af1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2af1930 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f15fc099c90 tx=0x7f15fc0a2200 comp rx=0 tx=0).stop 2023-07-21T22:33:07.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 -- 172.21.15.151:0/331638491 shutdown_connections 2023-07-21T22:33:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b2afbb70 0x5569b2afdf50 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2aebc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2af1930 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f15e7fff700 0 client.17424 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 --2- 172.21.15.151:0/331638491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2af1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 -- 172.21.15.151:0/331638491 >> 172.21.15.151:0/331638491 conn(0x5569b2ad3ae0 msgr2=0x5569b2ad83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 -- 172.21.15.151:0/331638491 shutdown_connections 2023-07-21T22:33:07.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.667+0000 7f1622561b80 1 -- 172.21.15.151:0/331638491 wait complete. 2023-07-21T22:33:07.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.668+0000 7f1622561b80 20 client.17424 trim_cache size 0 max 16384 2023-07-21T22:33:07.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.685+0000 7f1622561b80 1 Processor -- start 2023-07-21T22:33:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.685+0000 7f1622561b80 1 -- start start 2023-07-21T22:33:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f1622561b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b293a6b0 0x5569b2aebd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f1622561b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 0x5569b2ae9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f1622561b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8a70 0x5569b2ad8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f1622561b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b2ad5c00 con 0x5569b2ae8620 2023-07-21T22:33:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f1622561b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b2ae6870 con 0x5569b293a6b0 2023-07-21T22:33:07.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f1622561b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b2ada9d0 con 0x5569b2ae8a70 2023-07-21T22:33:07.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f160c99b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b293a6b0 0x5569b2aebd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f160c99b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b293a6b0 0x5569b2aebd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54436/0 (socket says 172.21.15.151:54436) 2023-07-21T22:33:07.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f1607fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 0x5569b2ae9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f160c99b700 1 -- 172.21.15.151:0/1878415571 learned_addr learned my addr 172.21.15.151:0/1878415571 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:07.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f160d19c700 1 --2- 172.21.15.151:0/1878415571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8a70 0x5569b2ad8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f160c99b700 1 -- 172.21.15.151:0/1878415571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8a70 msgr2=0x5569b2ad8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:07.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.686+0000 7f160c99b700 1 --2- 172.21.15.151:0/1878415571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8a70 0x5569b2ad8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.687+0000 7f160c99b700 1 -- 172.21.15.151:0/1878415571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 msgr2=0x5569b2ae9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:07.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.687+0000 7f160c99b700 1 --2- 172.21.15.151:0/1878415571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 0x5569b2ae9550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.687+0000 7f160c99b700 1 -- 172.21.15.151:0/1878415571 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5569b2b02b10 con 0x5569b293a6b0 2023-07-21T22:33:07.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.687+0000 7f160c99b700 1 --2- 172.21.15.151:0/1878415571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b293a6b0 0x5569b2aebd60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f15fc096a00 tx=0x7f15fc010a70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e6693b3673d45e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:07.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.687+0000 7f15f37fe700 1 -- 172.21.15.151:0/1878415571 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc010880 con 0x5569b293a6b0 2023-07-21T22:33:07.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.687+0000 7f15f37fe700 1 -- 172.21.15.151:0/1878415571 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15fc0b8040 con 0x5569b293a6b0 2023-07-21T22:33:07.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.687+0000 7f15f37fe700 1 -- 172.21.15.151:0/1878415571 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15fc095d80 con 0x5569b293a6b0 2023-07-21T22:33:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.688+0000 7f1622561b80 1 -- 172.21.15.151:0/1878415571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b293a6b0 msgr2=0x5569b2aebd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.688+0000 7f1622561b80 1 --2- 172.21.15.151:0/1878415571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b293a6b0 0x5569b2aebd60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f15fc096a00 tx=0x7f15fc010a70 comp rx=0 tx=0).stop 2023-07-21T22:33:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.688+0000 7f1622561b80 1 -- 172.21.15.151:0/1878415571 shutdown_connections 2023-07-21T22:33:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.688+0000 7f1622561b80 1 --2- 172.21.15.151:0/1878415571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b293a6b0 0x5569b2aebd60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.688+0000 7f1622561b80 1 --2- 172.21.15.151:0/1878415571 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8a70 0x5569b2ad8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.688+0000 7f1622561b80 1 --2- 172.21.15.151:0/1878415571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b2ae8620 0x5569b2ae9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.688+0000 7f1622561b80 1 -- 172.21.15.151:0/1878415571 >> 172.21.15.151:0/1878415571 conn(0x5569b2ad3ae0 msgr2=0x5569b2ae8e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.688+0000 7f1622561b80 1 -- 172.21.15.151:0/1878415571 shutdown_connections 2023-07-21T22:33:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.688+0000 7f1622561b80 1 -- 172.21.15.151:0/1878415571 wait complete. 2023-07-21T22:33:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.689+0000 7f1622561b80 1 -- start start 2023-07-21T22:33:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.689+0000 7f1622561b80 1 Processor -- start 2023-07-21T22:33:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.689+0000 7f1622561b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2aef5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1622561b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2aefb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1622561b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2b4e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1622561b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b2af0370 con 0x5569b293a6b0 2023-07-21T22:33:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1622561b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b2b4eed0 con 0x5569b2ae8a70 2023-07-21T22:33:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1622561b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5569b2b4f010 con 0x5569b2ae8620 2023-07-21T22:33:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1622561b80 10 client.0 _ll_register_callbacks cb 0x7f15fc005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:33:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f160c99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2aef5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1607fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2aefb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1607fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2aefb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57810/0 (socket says 172.21.15.151:57810) 2023-07-21T22:33:07.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1607fff700 1 -- 172.21.15.151:0/398506589 learned_addr learned my addr 172.21.15.151:0/398506589 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f160d19c700 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2b4e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1607fff700 1 -- 172.21.15.151:0/398506589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 msgr2=0x5569b2b4e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1607fff700 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2b4e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1607fff700 1 -- 172.21.15.151:0/398506589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 msgr2=0x5569b2aef5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1607fff700 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2aef5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.690+0000 7f1607fff700 1 -- 172.21.15.151:0/398506589 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f160810d240 con 0x5569b2ae8620 2023-07-21T22:33:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.691+0000 7f1607fff700 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2aefb20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009990 tx=0x7f15f400bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9902bc71213af5ce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:07.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.691+0000 7f15e7fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:33:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.691+0000 7f15e7fff700 1 -- 172.21.15.151:0/398506589 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15f401d040 con 0x5569b2ae8620 2023-07-21T22:33:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.691+0000 7f15e7fff700 1 -- 172.21.15.151:0/398506589 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(103..103 src has 1..103) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f15f4029e10 con 0x5569b2ae8620 2023-07-21T22:33:07.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.691+0000 7f1622561b80 1 -- 172.21.15.151:0/398506589 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f15fc0998f0 con 0x5569b2ae8620 2023-07-21T22:33:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.691+0000 7f15e7fff700 1 -- 172.21.15.151:0/398506589 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7f15f40292b0 con 0x5569b2ae8620 2023-07-21T22:33:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.691+0000 7f1622561b80 10 client.27145 fetch_fsmap learned FSMap version 56 2023-07-21T22:33:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.691+0000 7f1622561b80 1 -- 172.21.15.151:0/398506589 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x7f16081a2b20 con 0x5569b2ae8620 2023-07-21T22:33:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.692+0000 7f15e7fff700 1 -- 172.21.15.151:0/398506589 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f15fc0998f0 con 0x5569b2ae8620 2023-07-21T22:33:07.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.692+0000 7f15e7fff700 1 -- 172.21.15.151:0/398506589 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 56) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f15f4004600 con 0x5569b2ae8620 2023-07-21T22:33:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.692+0000 7f1622561b80 10 client.27145 fetch_fsmap finished waiting for FSMap version 56 2023-07-21T22:33:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.692+0000 7f1622561b80 10 client.27145 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:33:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.692+0000 7f1622561b80 20 client.27145 populate_metadata read hostname 'smithi151' 2023-07-21T22:33:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.692+0000 7f1622561b80 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b2b50620 0x5569b2b52a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.692+0000 7f1622561b80 4 client.27145 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:33:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.692+0000 7f1622561b80 1 -- 172.21.15.151:0/398506589 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5569b29eaff0 con 0x5569b2b50620 2023-07-21T22:33:07.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.693+0000 7f160c99b700 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b2b50620 0x5569b2b52a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:07.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.693+0000 7f160c99b700 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b2b50620 0x5569b2b52a30 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0f21a2f8964a2ec server_cookie=d8f4b6ddf053e534 in_seq=0 out_seq=0 2023-07-21T22:33:07.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.693+0000 7f15e7fff700 10 client.27145 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f15e7fff700 1 -- 172.21.15.151:0/398506589 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5569b29eaff0 con 0x5569b2b50620 2023-07-21T22:33:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f15e7fff700 10 client.27145 handle_command_reply: tid=0 2023-07-21T22:33:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f1622561b80 1 client.27145 shutdown 2023-07-21T22:33:07.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f1622561b80 1 -- 172.21.15.151:0/398506589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 msgr2=0x5569b2aefb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f1622561b80 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2aefb20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f15f4009990 tx=0x7f15f400bf70 comp rx=0 tx=0).stop 2023-07-21T22:33:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f1622561b80 1 -- 172.21.15.151:0/398506589 shutdown_connections 2023-07-21T22:33:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f1622561b80 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5569b2b50620 0x5569b2b52a30 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f1622561b80 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5569b2ae8a70 0x5569b2b4e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f1622561b80 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5569b293a6b0 0x5569b2aef5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f15e7fff700 0 client.27145 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:07.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f1622561b80 1 --2- 172.21.15.151:0/398506589 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5569b2ae8620 0x5569b2aefb20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.703+0000 7f1622561b80 1 -- 172.21.15.151:0/398506589 >> 172.21.15.151:0/398506589 conn(0x5569b2ad3ae0 msgr2=0x5569b2aeac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.704+0000 7f1622561b80 1 -- 172.21.15.151:0/398506589 shutdown_connections 2023-07-21T22:33:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.704+0000 7f1622561b80 1 -- 172.21.15.151:0/398506589 wait complete. 2023-07-21T22:33:07.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.704+0000 7f1622561b80 20 client.27145 trim_cache size 0 max 16384 2023-07-21T22:33:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:33:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:33:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:33:07.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:33:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.704+0000 7f160ebff700 1 -- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f15f80a12c0 msgr2=0x7f15f80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.704+0000 7f160ebff700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f15f80a12c0 0x7f15f80a3770 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1600009ec0 tx=0x7f1600004ad0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.704+0000 7f160ebff700 1 -- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16080ffb00 msgr2=0x7f160819bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.704+0000 7f160ebff700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16080ffb00 0x7f160819bb30 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f15fc00e9a0 tx=0x7f15fc00ecb0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.705+0000 7f160ebff700 1 -- 172.21.15.151:0/1642373892 shutdown_connections 2023-07-21T22:33:07.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.705+0000 7f160ebff700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f15f80a12c0 0x7f15f80a3770 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.705+0000 7f160ebff700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1608105b10 0x7f1608195990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.705+0000 7f160ebff700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16080ffb00 0x7f160819bb30 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.705+0000 7f160ebff700 1 --2- 172.21.15.151:0/1642373892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f16081004b0 0x7f160819c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.705+0000 7f160ebff700 1 -- 172.21.15.151:0/1642373892 >> 172.21.15.151:0/1642373892 conn(0x7f16080fb600 msgr2=0x7f16080fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.705+0000 7f160ebff700 1 -- 172.21.15.151:0/1642373892 shutdown_connections 2023-07-21T22:33:07.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:07.705+0000 7f160ebff700 1 -- 172.21.15.151:0/1642373892 wait complete. 2023-07-21T22:33:07.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:07 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:07.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:07 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:07.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:07 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:08 smithi187 ceph-mon[96918]: pgmap v436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.8 MiB/s wr, 507 op/s 2023-07-21T22:33:08.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:08 smithi195 ceph-mon[97365]: pgmap v436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.8 MiB/s wr, 507 op/s 2023-07-21T22:33:08.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:08 smithi151 ceph-mon[95510]: pgmap v436: 97 pgs: 97 active+clean; 9.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.8 MiB/s wr, 507 op/s 2023-07-21T22:33:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:10 smithi187 ceph-mon[96918]: pgmap v437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.8 MiB/s wr, 507 op/s 2023-07-21T22:33:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:10 smithi195 ceph-mon[97365]: pgmap v437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.8 MiB/s wr, 507 op/s 2023-07-21T22:33:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:10 smithi151 ceph-mon[95510]: pgmap v437: 97 pgs: 97 active+clean; 9.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.8 MiB/s wr, 507 op/s 2023-07-21T22:33:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:12 smithi187 ceph-mon[96918]: pgmap v438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.8 MiB/s wr, 507 op/s 2023-07-21T22:33:12.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:12 smithi187 ceph-mon[96918]: osdmap e104: 12 total, 12 up, 12 in 2023-07-21T22:33:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:12 smithi195 ceph-mon[97365]: pgmap v438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.8 MiB/s wr, 507 op/s 2023-07-21T22:33:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:12 smithi195 ceph-mon[97365]: osdmap e104: 12 total, 12 up, 12 in 2023-07-21T22:33:12.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:12 smithi151 ceph-mon[95510]: pgmap v438: 97 pgs: 97 active+clean; 9.1 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.8 MiB/s wr, 507 op/s 2023-07-21T22:33:12.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:12 smithi151 ceph-mon[95510]: osdmap e104: 12 total, 12 up, 12 in 2023-07-21T22:33:14.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:14 smithi187 ceph-mon[96918]: pgmap v440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 574 op/s 2023-07-21T22:33:14.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:14 smithi195 ceph-mon[97365]: pgmap v440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 574 op/s 2023-07-21T22:33:14.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:14 smithi151 ceph-mon[95510]: pgmap v440: 97 pgs: 97 active+clean; 9.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.4 MiB/s wr, 574 op/s 2023-07-21T22:33:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:16 smithi187 ceph-mon[96918]: pgmap v441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-07-21T22:33:16.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:16 smithi195 ceph-mon[97365]: pgmap v441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-07-21T22:33:16.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:16 smithi151 ceph-mon[95510]: pgmap v441: 97 pgs: 97 active+clean; 9.1 GiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-07-21T22:33:18.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:18 smithi187 ceph-mon[96918]: pgmap v442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.8 MiB/s wr, 495 op/s 2023-07-21T22:33:18.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:18 smithi195 ceph-mon[97365]: pgmap v442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.8 MiB/s wr, 495 op/s 2023-07-21T22:33:18.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:18 smithi151 ceph-mon[95510]: pgmap v442: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.8 MiB/s wr, 495 op/s 2023-07-21T22:33:20.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:20 smithi187 ceph-mon[96918]: pgmap v443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.8 MiB/s wr, 495 op/s 2023-07-21T22:33:20.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:20 smithi195 ceph-mon[97365]: pgmap v443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.8 MiB/s wr, 495 op/s 2023-07-21T22:33:20.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.880+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2141036605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9480685b0 msgr2=0x7ff948104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:20.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.880+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2141036605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9480685b0 0x7ff948104770 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7ff93c009990 tx=0x7ff93c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.880+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2141036605 shutdown_connections 2023-07-21T22:33:20.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.880+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2141036605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff948067c10 0x7ff948067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.880+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2141036605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff948104e50 0x7ff94810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.880+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2141036605 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9480685b0 0x7ff948104770 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.880+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2141036605 >> 172.21.15.151:0/2141036605 conn(0x7ff948074760 msgr2=0x7ff948074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.880+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2141036605 shutdown_connections 2023-07-21T22:33:20.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.880+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2141036605 wait complete. 2023-07-21T22:33:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.881+0000 7ff94e3ff700 1 Processor -- start 2023-07-21T22:33:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.881+0000 7ff94e3ff700 1 -- start start 2023-07-21T22:33:20.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff94e3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff948067c10 0x7ff948197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff94e3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9480685b0 0x7ff9481982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff94e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff948104e50 0x7ff94819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff94e3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94819cfa0 con 0x7ff948067c10 2023-07-21T22:33:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff94e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94819d110 con 0x7ff948104e50 2023-07-21T22:33:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff94e3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff94819d2d0 con 0x7ff9480685b0 2023-07-21T22:33:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff947fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff948067c10 0x7ff948197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9480685b0 0x7ff9481982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff947fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff948067c10 0x7ff948197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35236/0 (socket says 172.21.15.151:35236) 2023-07-21T22:33:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff947fff700 1 -- 172.21.15.151:0/2617252477 learned_addr learned my addr 172.21.15.151:0/2617252477 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff94c99c700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff948104e50 0x7ff94819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff9477fe700 1 -- 172.21.15.151:0/2617252477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff948104e50 msgr2=0x7ff94819c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff9477fe700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff948104e50 0x7ff94819c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.882+0000 7ff9477fe700 1 -- 172.21.15.151:0/2617252477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff948067c10 msgr2=0x7ff948197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.883+0000 7ff9477fe700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff948067c10 0x7ff948197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.883+0000 7ff9477fe700 1 -- 172.21.15.151:0/2617252477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff940009c40 con 0x7ff9480685b0 2023-07-21T22:33:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.883+0000 7ff9477fe700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9480685b0 0x7ff9481982f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0098e0 tx=0x7ff93c005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.883+0000 7ff9457fa700 1 -- 172.21.15.151:0/2617252477 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c01d070 con 0x7ff9480685b0 2023-07-21T22:33:20.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.883+0000 7ff9457fa700 1 -- 172.21.15.151:0/2617252477 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff93c021410 con 0x7ff9480685b0 2023-07-21T22:33:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.883+0000 7ff9457fa700 1 -- 172.21.15.151:0/2617252477 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c017650 con 0x7ff9480685b0 2023-07-21T22:33:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.883+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2617252477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff93c0095f0 con 0x7ff9480685b0 2023-07-21T22:33:20.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.883+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2617252477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94819d790 con 0x7ff9480685b0 2023-07-21T22:33:20.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.888+0000 7ff9457fa700 1 -- 172.21.15.151:0/2617252477 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff93c021580 con 0x7ff9480685b0 2023-07-21T22:33:20.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.889+0000 7ff961d7cb80 1 Processor -- start 2023-07-21T22:33:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff961d7cb80 1 -- start start 2023-07-21T22:33:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff9457fa700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff9300a1340 0x7ff9300a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c230c16b0 0x561c2326acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff9457fa700 1 -- 172.21.15.151:0/2617252477 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff93c0cdf50 con 0x7ff9480685b0 2023-07-21T22:33:20.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b210 0x561c23264f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b660 0x561c232654a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c2316ac50 con 0x561c2326b210 2023-07-21T22:33:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c231bd9e0 con 0x561c2326b660 2023-07-21T22:33:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c231b6e70 con 0x561c230c16b0 2023-07-21T22:33:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.890+0000 7ff94c99c700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff9300a1340 0x7ff9300a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff947fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c230c16b0 0x561c2326acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b210 0x561c23264f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff947fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c230c16b0 0x561c2326acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46718/0 (socket says 172.21.15.151:46718) 2023-07-21T22:33:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff947fff700 1 -- 172.21.15.151:0/533765105 learned_addr learned my addr 172.21.15.151:0/533765105 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:20.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff94c99c700 1 --2- 172.21.15.151:0/533765105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b660 0x561c232654a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff9477fe700 1 -- 172.21.15.151:0/533765105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c230c16b0 msgr2=0x561c2326acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff9477fe700 1 --2- 172.21.15.151:0/533765105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c230c16b0 0x561c2326acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff9477fe700 1 -- 172.21.15.151:0/533765105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b660 msgr2=0x561c232654a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff9477fe700 1 --2- 172.21.15.151:0/533765105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b660 0x561c232654a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff9477fe700 1 -- 172.21.15.151:0/533765105 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c22fe4d80 con 0x561c2326b210 2023-07-21T22:33:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff94c99c700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff9300a1340 0x7ff9300a37f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff940009fd0 tx=0x7ff94000fdd0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.891+0000 7ff9477fe700 1 --2- 172.21.15.151:0/533765105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b210 0x561c23264f40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0cb6c0 tx=0x7ff93c09afc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c62e83ec16f741fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:20.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.892+0000 7ff92e7fc700 1 -- 172.21.15.151:0/533765105 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c09f100 con 0x561c2326b210 2023-07-21T22:33:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.892+0000 7ff92e7fc700 1 -- 172.21.15.151:0/533765105 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff93c0a3490 con 0x561c2326b210 2023-07-21T22:33:20.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.892+0000 7ff92e7fc700 1 -- 172.21.15.151:0/533765105 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c09a5c0 con 0x561c2326b210 2023-07-21T22:33:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.892+0000 7ff961d7cb80 1 -- 172.21.15.151:0/533765105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b210 msgr2=0x561c23264f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.892+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/533765105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b210 0x561c23264f40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0cb6c0 tx=0x7ff93c09afc0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.892+0000 7ff961d7cb80 1 -- 172.21.15.151:0/533765105 shutdown_connections 2023-07-21T22:33:20.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.892+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/533765105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b660 0x561c232654a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.892+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/533765105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c230c16b0 0x561c2326acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.892+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/533765105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b210 0x561c23264f40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.893+0000 7ff961d7cb80 1 -- 172.21.15.151:0/533765105 >> 172.21.15.151:0/533765105 conn(0x561c2325aae0 msgr2=0x561c232600e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:20.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.893+0000 7ff961d7cb80 1 -- 172.21.15.151:0/533765105 shutdown_connections 2023-07-21T22:33:20.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.893+0000 7ff961d7cb80 1 -- 172.21.15.151:0/533765105 wait complete. 2023-07-21T22:33:20.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.893+0000 7ff961d7cb80 1 -- start start 2023-07-21T22:33:20.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.893+0000 7ff961d7cb80 1 Processor -- start 2023-07-21T22:33:20.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c230c16b0 0x561c23274200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b210 0x561c23274740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b660 0x561c2326e490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c23156a60 con 0x561c2326b660 2023-07-21T22:33:20.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c23156760 con 0x561c230c16b0 2023-07-21T22:33:20.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c2303a8c0 con 0x561c2326b210 2023-07-21T22:33:20.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff961d7cb80 10 client.0 _ll_register_callbacks cb 0x561c23154700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:33:20.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff947fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c230c16b0 0x561c23274200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff94c99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b660 0x561c2326e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff947fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c230c16b0 0x561c23274200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38774/0 (socket says 172.21.15.151:38774) 2023-07-21T22:33:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.894+0000 7ff947fff700 1 -- 172.21.15.151:0/825461415 learned_addr learned my addr 172.21.15.151:0/825461415 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.895+0000 7ff9477fe700 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b210 0x561c23274740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.895+0000 7ff947fff700 1 -- 172.21.15.151:0/825461415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b210 msgr2=0x561c23274740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.895+0000 7ff947fff700 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b210 0x561c23274740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.895+0000 7ff947fff700 1 -- 172.21.15.151:0/825461415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b660 msgr2=0x561c2326e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:20.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.895+0000 7ff947fff700 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b660 0x561c2326e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.895+0000 7ff947fff700 1 -- 172.21.15.151:0/825461415 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff94819d790 con 0x561c230c16b0 2023-07-21T22:33:20.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.895+0000 7ff947fff700 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c230c16b0 0x561c23274200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff9380128a0 tx=0x7ff938012bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31269237f1f9a1e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:20.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.895+0000 7ff9277fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:33:20.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.896+0000 7ff9277fe700 1 -- 172.21.15.151:0/825461415 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff938017070 con 0x561c230c16b0 2023-07-21T22:33:20.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.896+0000 7ff9277fe700 1 -- 172.21.15.151:0/825461415 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff93800f540 con 0x561c230c16b0 2023-07-21T22:33:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.896+0000 7ff961d7cb80 1 -- 172.21.15.151:0/825461415 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561c23110490 con 0x561c230c16b0 2023-07-21T22:33:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.896+0000 7ff9277fe700 1 -- 172.21.15.151:0/825461415 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff9380122e0 con 0x561c230c16b0 2023-07-21T22:33:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.896+0000 7ff961d7cb80 10 client.27131 fetch_fsmap learned FSMap version 56 2023-07-21T22:33:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.896+0000 7ff961d7cb80 1 -- 172.21.15.151:0/825461415 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x561c22fcdc00 con 0x561c230c16b0 2023-07-21T22:33:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.896+0000 7ff9277fe700 1 -- 172.21.15.151:0/825461415 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561c23110490 con 0x561c230c16b0 2023-07-21T22:33:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.896+0000 7ff9277fe700 1 -- 172.21.15.151:0/825461415 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 56) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff938010760 con 0x561c230c16b0 2023-07-21T22:33:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.897+0000 7ff961d7cb80 10 client.27131 fetch_fsmap finished waiting for FSMap version 56 2023-07-21T22:33:20.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.897+0000 7ff961d7cb80 10 client.27131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:33:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.897+0000 7ff961d7cb80 20 client.27131 populate_metadata read hostname 'smithi151' 2023-07-21T22:33:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.897+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561c2327e780 0x561c23280b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.897+0000 7ff961d7cb80 4 client.27131 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:33:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.897+0000 7ff961d7cb80 1 -- 172.21.15.151:0/825461415 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561c231afe50 con 0x561c2327e780 2023-07-21T22:33:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.897+0000 7ff9477fe700 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561c2327e780 0x561c23280b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.898+0000 7ff9477fe700 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561c2327e780 0x561c23280b90 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fbd180d4ff934cb server_cookie=92836668176533e4 in_seq=0 out_seq=0 2023-07-21T22:33:20.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.898+0000 7ff9277fe700 10 client.27131 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.898+0000 7ff9277fe700 1 -- 172.21.15.151:0/825461415 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561c231afe50 con 0x561c2327e780 2023-07-21T22:33:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.898+0000 7ff9277fe700 10 client.27131 handle_command_reply: tid=0 2023-07-21T22:33:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.898+0000 7ff961d7cb80 1 client.27131 shutdown 2023-07-21T22:33:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 -- 172.21.15.151:0/825461415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c230c16b0 msgr2=0x561c23274200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c230c16b0 0x561c23274200 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7ff9380128a0 tx=0x7ff938012bb0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 -- 172.21.15.151:0/825461415 shutdown_connections 2023-07-21T22:33:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561c2327e780 0x561c23280b90 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c230c16b0 0x561c23274200 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c2326b660 0x561c2326e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/825461415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b210 0x561c23274740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff9277fe700 0 client.27131 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 -- 172.21.15.151:0/825461415 >> 172.21.15.151:0/825461415 conn(0x561c2325aae0 msgr2=0x561c2325f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 -- 172.21.15.151:0/825461415 shutdown_connections 2023-07-21T22:33:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 1 -- 172.21.15.151:0/825461415 wait complete. 2023-07-21T22:33:20.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.899+0000 7ff961d7cb80 20 client.27131 trim_cache size 0 max 16384 2023-07-21T22:33:20.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:20 smithi151 ceph-mon[95510]: pgmap v443: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.8 MiB/s wr, 495 op/s 2023-07-21T22:33:20.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff961d7cb80 1 Processor -- start 2023-07-21T22:33:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff961d7cb80 1 -- start start 2023-07-21T22:33:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 0x561c23264f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c2326dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 0x561c2326e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c232619d0 con 0x561c230c16b0 2023-07-21T22:33:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c231afe80 con 0x561c2326b210 2023-07-21T22:33:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c23265480 con 0x561c2326b660 2023-07-21T22:33:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c2326dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.916+0000 7ff947fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 0x561c23264f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c2326dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38780/0 (socket says 172.21.15.151:38780) 2023-07-21T22:33:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff9477fe700 1 -- 172.21.15.151:0/3998976466 learned_addr learned my addr 172.21.15.151:0/3998976466 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:20.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff94c99c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 0x561c2326e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff9477fe700 1 -- 172.21.15.151:0/3998976466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 msgr2=0x561c2326e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff9477fe700 1 --2- 172.21.15.151:0/3998976466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 0x561c2326e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff9477fe700 1 -- 172.21.15.151:0/3998976466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 msgr2=0x561c23264f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff9477fe700 1 --2- 172.21.15.151:0/3998976466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 0x561c23264f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff9477fe700 1 -- 172.21.15.151:0/3998976466 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561c2300b1f0 con 0x561c2326b210 2023-07-21T22:33:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff9477fe700 1 --2- 172.21.15.151:0/3998976466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c2326dcc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff93c005f50 tx=0x7ff93c097530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=660aa183efbaed12 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:20.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff92effd700 1 -- 172.21.15.151:0/3998976466 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c0218a0 con 0x561c2326b210 2023-07-21T22:33:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff92effd700 1 -- 172.21.15.151:0/3998976466 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff93c021a00 con 0x561c2326b210 2023-07-21T22:33:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.917+0000 7ff92effd700 1 -- 172.21.15.151:0/3998976466 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c09b590 con 0x561c2326b210 2023-07-21T22:33:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.918+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3998976466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 msgr2=0x561c2326dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.918+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3998976466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c2326dcc0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff93c005f50 tx=0x7ff93c097530 comp rx=0 tx=0).stop 2023-07-21T22:33:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.918+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3998976466 shutdown_connections 2023-07-21T22:33:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.918+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3998976466 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 0x561c2326e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.918+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3998976466 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 0x561c23264f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.918+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3998976466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c2326dcc0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.918+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3998976466 >> 172.21.15.151:0/3998976466 conn(0x561c2325aae0 msgr2=0x561c23269550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.918+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3998976466 shutdown_connections 2023-07-21T22:33:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.918+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3998976466 wait complete. 2023-07-21T22:33:20.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.919+0000 7ff961d7cb80 1 -- start start 2023-07-21T22:33:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.919+0000 7ff961d7cb80 1 Processor -- start 2023-07-21T22:33:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 0x561c232c6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c232c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff961d7cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 0x561c232d1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c232c72a0 con 0x561c230c16b0 2023-07-21T22:33:20.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c232c7410 con 0x561c2326b210 2023-07-21T22:33:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff961d7cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561c232d1b80 con 0x561c2326b660 2023-07-21T22:33:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff961d7cb80 10 client.0 _ll_register_callbacks cb 0x7ff938009f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:33:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c232c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff947fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 0x561c232c6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff9477fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c232c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38792/0 (socket says 172.21.15.151:38792) 2023-07-21T22:33:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff9477fe700 1 -- 172.21.15.151:0/3668343398 learned_addr learned my addr 172.21.15.151:0/3668343398 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff94c99c700 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 0x561c232d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff9477fe700 1 -- 172.21.15.151:0/3668343398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 msgr2=0x561c232d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff9477fe700 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 0x561c232d1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff9477fe700 1 -- 172.21.15.151:0/3668343398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 msgr2=0x561c232c6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.920+0000 7ff9477fe700 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 0x561c232c6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.921+0000 7ff9477fe700 1 -- 172.21.15.151:0/3668343398 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561c22fe4d80 con 0x561c2326b210 2023-07-21T22:33:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.921+0000 7ff9477fe700 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c232c6ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00b2e0 tx=0x7ff93c09af50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fd039739f980e5a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.921+0000 7ff9277fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:33:20.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.921+0000 7ff9277fe700 1 -- 172.21.15.151:0/3668343398 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff93c09b330 con 0x561c2326b210 2023-07-21T22:33:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.921+0000 7ff9277fe700 1 -- 172.21.15.151:0/3668343398 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff93c09b490 con 0x561c2326b210 2023-07-21T22:33:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.921+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3668343398 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff93c0a3490 con 0x561c2326b210 2023-07-21T22:33:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.921+0000 7ff9277fe700 1 -- 172.21.15.151:0/3668343398 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff93c09a5c0 con 0x561c2326b210 2023-07-21T22:33:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.921+0000 7ff961d7cb80 10 client.27137 fetch_fsmap learned FSMap version 56 2023-07-21T22:33:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.921+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3668343398 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) v3 -- 0x561c22fe3250 con 0x561c2326b210 2023-07-21T22:33:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.922+0000 7ff9277fe700 1 -- 172.21.15.151:0/3668343398 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff93c0a3490 con 0x561c2326b210 2023-07-21T22:33:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.922+0000 7ff9277fe700 1 -- 172.21.15.151:0/3668343398 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 56) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff93c00fad0 con 0x561c2326b210 2023-07-21T22:33:20.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.922+0000 7ff961d7cb80 10 client.27137 fetch_fsmap finished waiting for FSMap version 56 2023-07-21T22:33:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.922+0000 7ff961d7cb80 10 client.27137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:33:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.922+0000 7ff961d7cb80 20 client.27137 populate_metadata read hostname 'smithi151' 2023-07-21T22:33:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.922+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561c232d2de0 0x561c232d51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.922+0000 7ff961d7cb80 4 client.27137 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:33:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.922+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3668343398 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561c23171ff0 con 0x561c232d2de0 2023-07-21T22:33:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.922+0000 7ff947fff700 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561c232d2de0 0x561c232d51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.923+0000 7ff9277fe700 10 client.27137 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:20.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.923+0000 7ff947fff700 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561c232d2de0 0x561c232d51c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12aa9d0db3afa333 server_cookie=afbf55a13622e500 in_seq=0 out_seq=0 2023-07-21T22:33:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff9277fe700 1 -- 172.21.15.151:0/3668343398 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561c23171ff0 con 0x561c232d2de0 2023-07-21T22:33:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff9277fe700 10 client.27137 handle_command_reply: tid=0 2023-07-21T22:33:20.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 client.27137 shutdown 2023-07-21T22:33:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3668343398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 msgr2=0x561c232c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c232c6ad0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff93c00b2e0 tx=0x7ff93c09af50 comp rx=0 tx=0).stop 2023-07-21T22:33:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3668343398 shutdown_connections 2023-07-21T22:33:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561c232d2de0 0x561c232d51c0 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561c2326b660 0x561c232d1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561c230c16b0 0x561c232c6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 --2- 172.21.15.151:0/3668343398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561c2326b210 0x561c232c6ad0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff9277fe700 0 client.27137 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3668343398 >> 172.21.15.151:0/3668343398 conn(0x561c2325aae0 msgr2=0x561c232647c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3668343398 shutdown_connections 2023-07-21T22:33:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.932+0000 7ff961d7cb80 1 -- 172.21.15.151:0/3668343398 wait complete. 2023-07-21T22:33:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.933+0000 7ff961d7cb80 20 client.27137 trim_cache size 0 max 16384 2023-07-21T22:33:20.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:33:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:33:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:33:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:33:20.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.933+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2617252477 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff9300a1340 msgr2=0x7ff9300a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.933+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff9300a1340 0x7ff9300a37f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff940009fd0 tx=0x7ff94000fdd0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.933+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2617252477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9480685b0 msgr2=0x7ff9481982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.933+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9480685b0 0x7ff9481982f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ff93c0098e0 tx=0x7ff93c005740 comp rx=0 tx=0).stop 2023-07-21T22:33:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.933+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2617252477 shutdown_connections 2023-07-21T22:33:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.934+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff9300a1340 0x7ff9300a37f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.934+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff948104e50 0x7ff94819c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.934+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff948067c10 0x7ff948197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.934+0000 7ff94e3ff700 1 --2- 172.21.15.151:0/2617252477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff9480685b0 0x7ff9481982f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.934+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2617252477 >> 172.21.15.151:0/2617252477 conn(0x7ff948074760 msgr2=0x7ff9480fc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.934+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2617252477 shutdown_connections 2023-07-21T22:33:20.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:20.934+0000 7ff94e3ff700 1 -- 172.21.15.151:0/2617252477 wait complete. 2023-07-21T22:33:22.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:22 smithi187 ceph-mon[96918]: pgmap v444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.8 MiB/s wr, 495 op/s 2023-07-21T22:33:22.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:22 smithi195 ceph-mon[97365]: pgmap v444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.8 MiB/s wr, 495 op/s 2023-07-21T22:33:22.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:22 smithi151 ceph-mon[95510]: pgmap v444: 97 pgs: 97 active+clean; 9.1 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.8 MiB/s wr, 495 op/s 2023-07-21T22:33:24.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:24 smithi187 ceph-mon[96918]: pgmap v445: 97 pgs: 97 active+clean; 9.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 612 op/s 2023-07-21T22:33:24.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:24 smithi195 ceph-mon[97365]: pgmap v445: 97 pgs: 97 active+clean; 9.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 612 op/s 2023-07-21T22:33:24.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:24 smithi151 ceph-mon[95510]: pgmap v445: 97 pgs: 97 active+clean; 9.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.7 MiB/s wr, 612 op/s 2023-07-21T22:33:26.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:26 smithi187 ceph-mon[96918]: pgmap v446: 97 pgs: 97 active+clean; 9.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-07-21T22:33:26.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:26 smithi195 ceph-mon[97365]: pgmap v446: 97 pgs: 97 active+clean; 9.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-07-21T22:33:26.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:26 smithi151 ceph-mon[95510]: pgmap v446: 97 pgs: 97 active+clean; 9.2 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-07-21T22:33:28.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:28 smithi187 ceph-mon[96918]: pgmap v447: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.5 MiB/s wr, 588 op/s 2023-07-21T22:33:28.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:28 smithi195 ceph-mon[97365]: pgmap v447: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.5 MiB/s wr, 588 op/s 2023-07-21T22:33:28.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:28 smithi151 ceph-mon[95510]: pgmap v447: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.5 MiB/s wr, 588 op/s 2023-07-21T22:33:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:30 smithi187 ceph-mon[96918]: pgmap v448: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 MiB/s wr, 380 op/s 2023-07-21T22:33:30.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:30 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:30.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:30 smithi195 ceph-mon[97365]: pgmap v448: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 MiB/s wr, 380 op/s 2023-07-21T22:33:30.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:30 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:30.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:30 smithi151 ceph-mon[95510]: pgmap v448: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 MiB/s wr, 380 op/s 2023-07-21T22:33:30.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:30 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:32 smithi187 ceph-mon[96918]: pgmap v449: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 MiB/s wr, 380 op/s 2023-07-21T22:33:32.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:32 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:32 smithi195 ceph-mon[97365]: pgmap v449: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 MiB/s wr, 380 op/s 2023-07-21T22:33:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:32 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:32.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:32 smithi151 ceph-mon[95510]: pgmap v449: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.9 MiB/s wr, 380 op/s 2023-07-21T22:33:32.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:32 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:34.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.104+0000 7f035f19d700 1 -- 172.21.15.151:0/44625406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0358073410 msgr2=0x7f035810bca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.104+0000 7f035f19d700 1 --2- 172.21.15.151:0/44625406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0358073410 0x7f035810bca0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0348009990 tx=0x7f0348009ca0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.104+0000 7f035f19d700 1 -- 172.21.15.151:0/44625406 shutdown_connections 2023-07-21T22:33:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.104+0000 7f035f19d700 1 --2- 172.21.15.151:0/44625406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f035810c310 0x7f035810e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.104+0000 7f035f19d700 1 --2- 172.21.15.151:0/44625406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0358072b00 0x7f0358072ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.104+0000 7f035f19d700 1 --2- 172.21.15.151:0/44625406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0358073410 0x7f035810bca0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.104+0000 7f035f19d700 1 -- 172.21.15.151:0/44625406 >> 172.21.15.151:0/44625406 conn(0x7f03580fb440 msgr2=0x7f03580fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:34.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.104+0000 7f035f19d700 1 -- 172.21.15.151:0/44625406 shutdown_connections 2023-07-21T22:33:34.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.104+0000 7f035f19d700 1 -- 172.21.15.151:0/44625406 wait complete. 2023-07-21T22:33:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.105+0000 7f035f19d700 1 Processor -- start 2023-07-21T22:33:34.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035f19d700 1 -- start start 2023-07-21T22:33:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035f19d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0358072b00 0x7f035819da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035f19d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0358073410 0x7f035819dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035f19d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f035810c310 0x7f0358197ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035f19d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358198140 con 0x7f0358072b00 2023-07-21T22:33:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035f19d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03581982b0 con 0x7f0358073410 2023-07-21T22:33:34.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035f19d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0358198470 con 0x7f035810c310 2023-07-21T22:33:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0358072b00 0x7f035819da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035d99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0358073410 0x7f035819dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0358072b00 0x7f035819da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48240/0 (socket says 172.21.15.151:48240) 2023-07-21T22:33:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035e19b700 1 -- 172.21.15.151:0/3699386228 learned_addr learned my addr 172.21.15.151:0/3699386228 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.106+0000 7f035e99c700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f035810c310 0x7f0358197ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.107+0000 7f035d99a700 1 -- 172.21.15.151:0/3699386228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f035810c310 msgr2=0x7f0358197ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:34.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.107+0000 7f035d99a700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f035810c310 0x7f0358197ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.107+0000 7f035d99a700 1 -- 172.21.15.151:0/3699386228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0358072b00 msgr2=0x7f035819da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.107+0000 7f035d99a700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0358072b00 0x7f035819da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.107+0000 7f035d99a700 1 -- 172.21.15.151:0/3699386228 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03480095f0 con 0x7f0358073410 2023-07-21T22:33:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.107+0000 7f035d99a700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0358073410 0x7f035819dfa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0348000c00 tx=0x7f03480057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.107+0000 7f034f7fe700 1 -- 172.21.15.151:0/3699386228 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034801d070 con 0x7f0358073410 2023-07-21T22:33:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.107+0000 7f034f7fe700 1 -- 172.21.15.151:0/3699386228 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0348021410 con 0x7f0358073410 2023-07-21T22:33:34.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.107+0000 7f035f19d700 1 -- 172.21.15.151:0/3699386228 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03581986f0 con 0x7f0358073410 2023-07-21T22:33:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.108+0000 7f034f7fe700 1 -- 172.21.15.151:0/3699386228 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348017650 con 0x7f0358073410 2023-07-21T22:33:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.108+0000 7f035f19d700 1 -- 172.21.15.151:0/3699386228 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03581a4a50 con 0x7f0358073410 2023-07-21T22:33:34.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.111+0000 7f034f7fe700 1 -- 172.21.15.151:0/3699386228 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0348021580 con 0x7f0358073410 2023-07-21T22:33:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.112+0000 7f0373c56b80 1 Processor -- start 2023-07-21T22:33:34.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f0373c56b80 1 -- start start 2023-07-21T22:33:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df6746f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df6747480 0x562df67410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df67415e0 0x562df6741a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f0373c56b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df6646c50 con 0x562df6747480 2023-07-21T22:33:34.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f0373c56b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df66999e0 con 0x562df67415e0 2023-07-21T22:33:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f0373c56b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df6692e70 con 0x562df659d6b0 2023-07-21T22:33:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f034f7fe700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f03440a1340 0x7f03440a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f035e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df6747480 0x562df67410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f035d99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df67415e0 0x562df6741a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f035e99c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df6746f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f035e99c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df6746f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35192/0 (socket says 172.21.15.151:35192) 2023-07-21T22:33:34.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f035e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df6747480 0x562df67410a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48250/0 (socket says 172.21.15.151:48250) 2023-07-21T22:33:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.113+0000 7f035e99c700 1 -- 172.21.15.151:0/1108930080 learned_addr learned my addr 172.21.15.151:0/1108930080 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f035e99c700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f03440a1340 0x7f03440a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f034f7fe700 1 -- 172.21.15.151:0/3699386228 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f03480cded0 con 0x7f0358073410 2023-07-21T22:33:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f035d99a700 1 -- 172.21.15.151:0/1108930080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 msgr2=0x562df6746f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f035d99a700 1 --2- 172.21.15.151:0/1108930080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df6746f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f035d99a700 1 -- 172.21.15.151:0/1108930080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df6747480 msgr2=0x562df67410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:34.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f035d99a700 1 --2- 172.21.15.151:0/1108930080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df6747480 0x562df67410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f035d99a700 1 -- 172.21.15.151:0/1108930080 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562df64c0d80 con 0x562df67415e0 2023-07-21T22:33:34.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f035d99a700 1 --2- 172.21.15.151:0/1108930080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df67415e0 0x562df6741a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f03480cb640 tx=0x7f0348009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2d001ec011f066a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f035e99c700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f03440a1340 0x7f03440a37f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0350009ec0 tx=0x7f035000b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f034cbfe700 1 -- 172.21.15.151:0/1108930080 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034809ab90 con 0x562df67415e0 2023-07-21T22:33:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.114+0000 7f034cbfe700 1 -- 172.21.15.151:0/1108930080 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f034809a9b0 con 0x562df67415e0 2023-07-21T22:33:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.115+0000 7f034cbfe700 1 -- 172.21.15.151:0/1108930080 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348020eb0 con 0x562df67415e0 2023-07-21T22:33:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.115+0000 7f0373c56b80 1 -- 172.21.15.151:0/1108930080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df67415e0 msgr2=0x562df6741a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.115+0000 7f0373c56b80 1 --2- 172.21.15.151:0/1108930080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df67415e0 0x562df6741a30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f03480cb640 tx=0x7f0348009ca0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.115+0000 7f0373c56b80 1 -- 172.21.15.151:0/1108930080 shutdown_connections 2023-07-21T22:33:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.115+0000 7f0373c56b80 1 --2- 172.21.15.151:0/1108930080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df67415e0 0x562df6741a30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.115+0000 7f0373c56b80 1 --2- 172.21.15.151:0/1108930080 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df6746f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.115+0000 7f0373c56b80 1 --2- 172.21.15.151:0/1108930080 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df6747480 0x562df67410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.115+0000 7f0373c56b80 1 -- 172.21.15.151:0/1108930080 >> 172.21.15.151:0/1108930080 conn(0x562df6736c40 msgr2=0x562df673c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.115+0000 7f0373c56b80 1 -- 172.21.15.151:0/1108930080 shutdown_connections 2023-07-21T22:33:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.116+0000 7f0373c56b80 1 -- 172.21.15.151:0/1108930080 wait complete. 2023-07-21T22:33:34.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.116+0000 7f0373c56b80 1 -- start start 2023-07-21T22:33:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.116+0000 7f0373c56b80 1 Processor -- start 2023-07-21T22:33:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df659d6b0 0x562df67503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6750930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df6747480 0x562df674a680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f0373c56b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df6632a60 con 0x562df67415e0 2023-07-21T22:33:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f0373c56b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df6632760 con 0x562df659d6b0 2023-07-21T22:33:34.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f0373c56b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df65168c0 con 0x562df6747480 2023-07-21T22:33:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f0373c56b80 10 client.0 _ll_register_callbacks cb 0x562df6630700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:33:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f035d99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6750930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f035e19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df659d6b0 0x562df67503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f035d99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6750930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48258/0 (socket says 172.21.15.151:48258) 2023-07-21T22:33:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f035d99a700 1 -- 172.21.15.151:0/3986872210 learned_addr learned my addr 172.21.15.151:0/3986872210 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.117+0000 7f035e99c700 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df6747480 0x562df674a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f035d99a700 1 -- 172.21.15.151:0/3986872210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df6747480 msgr2=0x562df674a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f035d99a700 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df6747480 0x562df674a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f035d99a700 1 -- 172.21.15.151:0/3986872210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df659d6b0 msgr2=0x562df67503f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f035d99a700 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df659d6b0 0x562df67503f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f035d99a700 1 -- 172.21.15.151:0/3986872210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03581a4a50 con 0x562df67415e0 2023-07-21T22:33:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f035e19b700 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df659d6b0 0x562df67503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:33:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f035d99a700 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6750930 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0348097550 tx=0x7f0348020fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436e1bf35622b901 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:34.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f0341ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:33:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f0341ffb700 1 -- 172.21.15.151:0/3986872210 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0348021a90 con 0x562df67415e0 2023-07-21T22:33:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f0341ffb700 1 -- 172.21.15.151:0/3986872210 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f034809f080 con 0x562df67415e0 2023-07-21T22:33:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f0373c56b80 1 -- 172.21.15.151:0/3986872210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562df65ec490 con 0x562df67415e0 2023-07-21T22:33:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f0341ffb700 1 -- 172.21.15.151:0/3986872210 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f03480cb2e0 con 0x562df67415e0 2023-07-21T22:33:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f0373c56b80 10 client.17460 fetch_fsmap learned FSMap version 58 2023-07-21T22:33:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.118+0000 7f0373c56b80 1 -- 172.21.15.151:0/3986872210 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x562df64a9c00 con 0x562df67415e0 2023-07-21T22:33:34.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.119+0000 7f0341ffb700 1 -- 172.21.15.151:0/3986872210 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562df65ec490 con 0x562df67415e0 2023-07-21T22:33:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.119+0000 7f0341ffb700 1 -- 172.21.15.151:0/3986872210 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 58) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f034809a5d0 con 0x562df67415e0 2023-07-21T22:33:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.119+0000 7f0373c56b80 10 client.17460 fetch_fsmap finished waiting for FSMap version 58 2023-07-21T22:33:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.119+0000 7f0373c56b80 10 client.17460 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:33:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.119+0000 7f0373c56b80 20 client.17460 populate_metadata read hostname 'smithi151' 2023-07-21T22:33:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.119+0000 7f0373c56b80 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562df675a4a0 0x562df675c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.119+0000 7f0373c56b80 4 client.17460 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:33:34.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.119+0000 7f0373c56b80 1 -- 172.21.15.151:0/3986872210 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562df668be50 con 0x562df675a4a0 2023-07-21T22:33:34.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.120+0000 7f035e19b700 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562df675a4a0 0x562df675c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.120+0000 7f035e19b700 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562df675a4a0 0x562df675c8b0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64accaea05ca1527 server_cookie=247925f809738a66 in_seq=0 out_seq=0 2023-07-21T22:33:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.120+0000 7f0341ffb700 10 client.17460 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0341ffb700 1 -- 172.21.15.151:0/3986872210 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562df668be50 con 0x562df675a4a0 2023-07-21T22:33:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0341ffb700 10 client.17460 handle_command_reply: tid=0 2023-07-21T22:33:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0373c56b80 1 client.17460 shutdown 2023-07-21T22:33:34.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0373c56b80 1 -- 172.21.15.151:0/3986872210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 msgr2=0x562df6750930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0373c56b80 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6750930 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f0348097550 tx=0x7f0348020fc0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0373c56b80 1 -- 172.21.15.151:0/3986872210 shutdown_connections 2023-07-21T22:33:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0373c56b80 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562df675a4a0 0x562df675c8b0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0373c56b80 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df659d6b0 0x562df67503f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0373c56b80 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df6747480 0x562df674a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0373c56b80 1 --2- 172.21.15.151:0/3986872210 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6750930 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.121+0000 7f0373c56b80 1 -- 172.21.15.151:0/3986872210 >> 172.21.15.151:0/3986872210 conn(0x562df6736c40 msgr2=0x562df673b540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.122+0000 7f0341ffb700 0 client.17460 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.122+0000 7f0373c56b80 1 -- 172.21.15.151:0/3986872210 shutdown_connections 2023-07-21T22:33:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.122+0000 7f0373c56b80 1 -- 172.21.15.151:0/3986872210 wait complete. 2023-07-21T22:33:34.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.122+0000 7f0373c56b80 20 client.17460 trim_cache size 0 max 16384 2023-07-21T22:33:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.139+0000 7f0373c56b80 1 Processor -- start 2023-07-21T22:33:34.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.139+0000 7f0373c56b80 1 -- start start 2023-07-21T22:33:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.139+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df67410a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.139+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6748160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.139+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 0x562df6743900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.139+0000 7f0373c56b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df65ec490 con 0x562df67415e0 2023-07-21T22:33:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.139+0000 7f0373c56b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df673cee0 con 0x562df6747480 2023-07-21T22:33:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.139+0000 7f0373c56b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df67486a0 con 0x562df659d6b0 2023-07-21T22:33:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035d99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6748160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df67410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df67410a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35216/0 (socket says 172.21.15.151:35216) 2023-07-21T22:33:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e19b700 1 -- 172.21.15.151:0/1498490512 learned_addr learned my addr 172.21.15.151:0/1498490512 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e99c700 1 --2- 172.21.15.151:0/1498490512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 0x562df6743900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e19b700 1 -- 172.21.15.151:0/1498490512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 msgr2=0x562df6743900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e19b700 1 --2- 172.21.15.151:0/1498490512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 0x562df6743900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e19b700 1 -- 172.21.15.151:0/1498490512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 msgr2=0x562df6748160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:34.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e19b700 1 --2- 172.21.15.151:0/1498490512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6748160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e19b700 1 -- 172.21.15.151:0/1498490512 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562df64e71f0 con 0x562df659d6b0 2023-07-21T22:33:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.140+0000 7f035e99c700 1 --2- 172.21.15.151:0/1498490512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 0x562df6743900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:33:34.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.141+0000 7f035e19b700 1 --2- 172.21.15.151:0/1498490512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df67410a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0354005d90 tx=0x7f0354004750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1621e549be244ff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.141+0000 7f034d3ff700 1 -- 172.21.15.151:0/1498490512 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f035401c3c0 con 0x562df659d6b0 2023-07-21T22:33:34.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.141+0000 7f034d3ff700 1 -- 172.21.15.151:0/1498490512 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0354017040 con 0x562df659d6b0 2023-07-21T22:33:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.141+0000 7f034d3ff700 1 -- 172.21.15.151:0/1498490512 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0354005400 con 0x562df659d6b0 2023-07-21T22:33:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 -- 172.21.15.151:0/1498490512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 msgr2=0x562df67410a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 --2- 172.21.15.151:0/1498490512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df67410a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f0354005d90 tx=0x7f0354004750 comp rx=0 tx=0).stop 2023-07-21T22:33:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 -- 172.21.15.151:0/1498490512 shutdown_connections 2023-07-21T22:33:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 --2- 172.21.15.151:0/1498490512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 0x562df6743900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 --2- 172.21.15.151:0/1498490512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df659d6b0 0x562df67410a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 --2- 172.21.15.151:0/1498490512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df67415e0 0x562df6748160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 -- 172.21.15.151:0/1498490512 >> 172.21.15.151:0/1498490512 conn(0x562df6736c40 msgr2=0x562df6747a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 -- 172.21.15.151:0/1498490512 shutdown_connections 2023-07-21T22:33:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 -- 172.21.15.151:0/1498490512 wait complete. 2023-07-21T22:33:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.142+0000 7f0373c56b80 1 -- start start 2023-07-21T22:33:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.143+0000 7f0373c56b80 1 Processor -- start 2023-07-21T22:33:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.143+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df659d6b0 0x562df6750070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.143+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df67415e0 0x562df67505b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.143+0000 7f0373c56b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 0x562df674e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.143+0000 7f0373c56b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df674ec70 con 0x562df659d6b0 2023-07-21T22:33:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.143+0000 7f0373c56b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df674ede0 con 0x562df6747480 2023-07-21T22:33:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.143+0000 7f0373c56b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562df674efa0 con 0x562df67415e0 2023-07-21T22:33:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.143+0000 7f0373c56b80 10 client.0 _ll_register_callbacks cb 0x7f03540095c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:33:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df659d6b0 0x562df6750070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035e99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 0x562df674e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df659d6b0 0x562df6750070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48270/0 (socket says 172.21.15.151:48270) 2023-07-21T22:33:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035e19b700 1 -- 172.21.15.151:0/2512520626 learned_addr learned my addr 172.21.15.151:0/2512520626 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035d99a700 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df67415e0 0x562df67505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035d99a700 1 -- 172.21.15.151:0/2512520626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 msgr2=0x562df674e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035d99a700 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 0x562df674e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035d99a700 1 -- 172.21.15.151:0/2512520626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df659d6b0 msgr2=0x562df6750070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:34.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035d99a700 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df659d6b0 0x562df6750070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035d99a700 1 -- 172.21.15.151:0/2512520626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0354009c10 con 0x562df67415e0 2023-07-21T22:33:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.144+0000 7f035e19b700 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df659d6b0 0x562df6750070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:33:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f035d99a700 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df67415e0 0x562df67505b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0348005910 tx=0x7f0348005fb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=225062d58dd078b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0341ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:33:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0341ffb700 1 -- 172.21.15.151:0/2512520626 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03480a31d0 con 0x562df67415e0 2023-07-21T22:33:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0373c56b80 1 -- 172.21.15.151:0/2512520626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f034809a9b0 con 0x562df67415e0 2023-07-21T22:33:34.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0341ffb700 1 -- 172.21.15.151:0/2512520626 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f034809f080 con 0x562df67415e0 2023-07-21T22:33:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0341ffb700 1 -- 172.21.15.151:0/2512520626 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0348021a90 con 0x562df67415e0 2023-07-21T22:33:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0373c56b80 10 client.27181 fetch_fsmap learned FSMap version 58 2023-07-21T22:33:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0373c56b80 1 -- 172.21.15.151:0/2512520626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x562df64bf250 con 0x562df67415e0 2023-07-21T22:33:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0341ffb700 1 -- 172.21.15.151:0/2512520626 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f034809a9b0 con 0x562df67415e0 2023-07-21T22:33:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0341ffb700 1 -- 172.21.15.151:0/2512520626 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 58) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f03480cb2e0 con 0x562df67415e0 2023-07-21T22:33:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0373c56b80 10 client.27181 fetch_fsmap finished waiting for FSMap version 58 2023-07-21T22:33:34.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0373c56b80 10 client.27181 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:33:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0373c56b80 20 client.27181 populate_metadata read hostname 'smithi151' 2023-07-21T22:33:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0373c56b80 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562df67aef00 0x562df67b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0373c56b80 4 client.27181 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:33:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.145+0000 7f0373c56b80 1 -- 172.21.15.151:0/2512520626 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562df664dff0 con 0x562df67aef00 2023-07-21T22:33:34.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.146+0000 7f035e19b700 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562df67aef00 0x562df67b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.147+0000 7f035e19b700 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562df67aef00 0x562df67b12e0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3647b56e62c436a server_cookie=b0c2aefbb7d409b3 in_seq=0 out_seq=0 2023-07-21T22:33:34.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.147+0000 7f0341ffb700 10 client.27181 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0341ffb700 1 -- 172.21.15.151:0/2512520626 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562df664dff0 con 0x562df67aef00 2023-07-21T22:33:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0341ffb700 10 client.27181 handle_command_reply: tid=0 2023-07-21T22:33:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 client.27181 shutdown 2023-07-21T22:33:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 -- 172.21.15.151:0/2512520626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df67415e0 msgr2=0x562df67505b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:34.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df67415e0 0x562df67505b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0348005910 tx=0x7f0348005fb0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 -- 172.21.15.151:0/2512520626 shutdown_connections 2023-07-21T22:33:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562df67aef00 0x562df67b12e0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562df6747480 0x562df674e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562df659d6b0 0x562df6750070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0341ffb700 0 client.27181 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 --2- 172.21.15.151:0/2512520626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562df67415e0 0x562df67505b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 -- 172.21.15.151:0/2512520626 >> 172.21.15.151:0/2512520626 conn(0x562df6736c40 msgr2=0x562df6748be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 -- 172.21.15.151:0/2512520626 shutdown_connections 2023-07-21T22:33:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.156+0000 7f0373c56b80 1 -- 172.21.15.151:0/2512520626 wait complete. 2023-07-21T22:33:34.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.157+0000 7f0373c56b80 20 client.27181 trim_cache size 0 max 16384 2023-07-21T22:33:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:33:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:33:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:33:34.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:33:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.157+0000 7f035f19d700 1 -- 172.21.15.151:0/3699386228 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f03440a1340 msgr2=0x7f03440a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.157+0000 7f035f19d700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f03440a1340 0x7f03440a37f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0350009ec0 tx=0x7f035000b040 comp rx=0 tx=0).stop 2023-07-21T22:33:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.157+0000 7f035f19d700 1 -- 172.21.15.151:0/3699386228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0358073410 msgr2=0x7f035819dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.157+0000 7f035f19d700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0358073410 0x7f035819dfa0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0348000c00 tx=0x7f03480057c0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.158+0000 7f035f19d700 1 -- 172.21.15.151:0/3699386228 shutdown_connections 2023-07-21T22:33:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.158+0000 7f035f19d700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f03440a1340 0x7f03440a37f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.158+0000 7f035f19d700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f035810c310 0x7f0358197ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.158+0000 7f035f19d700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0358072b00 0x7f035819da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.158+0000 7f035f19d700 1 --2- 172.21.15.151:0/3699386228 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0358073410 0x7f035819dfa0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.158+0000 7f035f19d700 1 -- 172.21.15.151:0/3699386228 >> 172.21.15.151:0/3699386228 conn(0x7f03580fb440 msgr2=0x7f035810e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.158+0000 7f035f19d700 1 -- 172.21.15.151:0/3699386228 shutdown_connections 2023-07-21T22:33:34.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:34.158+0000 7f035f19d700 1 -- 172.21.15.151:0/3699386228 wait complete. 2023-07-21T22:33:34.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:34 smithi187 ceph-mon[96918]: pgmap v450: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 580 op/s 2023-07-21T22:33:34.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:34 smithi195 ceph-mon[97365]: pgmap v450: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 580 op/s 2023-07-21T22:33:34.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:34 smithi151 ceph-mon[95510]: pgmap v450: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 580 op/s 2023-07-21T22:33:36.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:36 smithi187 ceph-mon[96918]: pgmap v451: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 399 op/s 2023-07-21T22:33:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:36 smithi195 ceph-mon[97365]: pgmap v451: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 399 op/s 2023-07-21T22:33:36.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:36 smithi151 ceph-mon[95510]: pgmap v451: 97 pgs: 97 active+clean; 9.2 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 3.1 MiB/s wr, 399 op/s 2023-07-21T22:33:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:38 smithi187 ceph-mon[96918]: pgmap v452: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 588 op/s 2023-07-21T22:33:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:38 smithi195 ceph-mon[97365]: pgmap v452: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 588 op/s 2023-07-21T22:33:38.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:38 smithi151 ceph-mon[95510]: pgmap v452: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 588 op/s 2023-07-21T22:33:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:40 smithi187 ceph-mon[96918]: pgmap v453: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2023-07-21T22:33:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:40 smithi195 ceph-mon[97365]: pgmap v453: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2023-07-21T22:33:40.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:40 smithi151 ceph-mon[95510]: pgmap v453: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2023-07-21T22:33:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:42 smithi187 ceph-mon[96918]: pgmap v454: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2023-07-21T22:33:42.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:42 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:33:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:42 smithi195 ceph-mon[97365]: pgmap v454: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2023-07-21T22:33:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:42 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:33:42.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:42 smithi151 ceph-mon[95510]: pgmap v454: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.0 MiB/s wr, 388 op/s 2023-07-21T22:33:42.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:42 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:33:43.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:43 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:33:43.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:43 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:33:43.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:43 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:33:43.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:43 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:33:43.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:43 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:33:43.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:43 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:33:43.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:43 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:33:43.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:43 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:33:43.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:43 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:33:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:44 smithi187 ceph-mon[96918]: pgmap v455: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 580 op/s 2023-07-21T22:33:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:44 smithi195 ceph-mon[97365]: pgmap v455: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 580 op/s 2023-07-21T22:33:44.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:44 smithi151 ceph-mon[95510]: pgmap v455: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.4 MiB/s wr, 580 op/s 2023-07-21T22:33:46.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:46 smithi187 ceph-mon[96918]: pgmap v456: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.9 MiB/s wr, 380 op/s 2023-07-21T22:33:46.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:46 smithi195 ceph-mon[97365]: pgmap v456: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.9 MiB/s wr, 380 op/s 2023-07-21T22:33:46.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:46 smithi151 ceph-mon[95510]: pgmap v456: 97 pgs: 97 active+clean; 9.2 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.9 MiB/s wr, 380 op/s 2023-07-21T22:33:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.323+0000 7f82cafff700 1 -- 172.21.15.151:0/114757863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c4105b10 msgr2=0x7f82c4105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:47.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.323+0000 7f82cafff700 1 --2- 172.21.15.151:0/114757863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c4105b10 0x7f82c4105ee0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f82b8009990 tx=0x7f82b8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.323+0000 7f82cafff700 1 -- 172.21.15.151:0/114757863 shutdown_connections 2023-07-21T22:33:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.323+0000 7f82cafff700 1 --2- 172.21.15.151:0/114757863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82c41004b0 0x7f82c410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.323+0000 7f82cafff700 1 --2- 172.21.15.151:0/114757863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c4105b10 0x7f82c4105ee0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.323+0000 7f82cafff700 1 --2- 172.21.15.151:0/114757863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82c40ffb00 0x7f82c40fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.323+0000 7f82cafff700 1 -- 172.21.15.151:0/114757863 >> 172.21.15.151:0/114757863 conn(0x7f82c40fb600 msgr2=0x7f82c40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.323+0000 7f82cafff700 1 -- 172.21.15.151:0/114757863 shutdown_connections 2023-07-21T22:33:47.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.323+0000 7f82cafff700 1 -- 172.21.15.151:0/114757863 wait complete. 2023-07-21T22:33:47.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.324+0000 7f82cafff700 1 Processor -- start 2023-07-21T22:33:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.325+0000 7f82cafff700 1 -- start start 2023-07-21T22:33:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.325+0000 7f82cafff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c40ffb00 0x7f82c419bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.325+0000 7f82cafff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82c41004b0 0x7f82c419c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.325+0000 7f82cafff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82c4105b10 0x7f82c4195a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.325+0000 7f82cafff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4196090 con 0x7f82c41004b0 2023-07-21T22:33:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.325+0000 7f82cafff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c4196200 con 0x7f82c4105b10 2023-07-21T22:33:47.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.325+0000 7f82cafff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82c41963c0 con 0x7f82c40ffb00 2023-07-21T22:33:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c8d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c40ffb00 0x7f82c419bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c8d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c40ffb00 0x7f82c419bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42326/0 (socket says 172.21.15.151:42326) 2023-07-21T22:33:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c8d9b700 1 -- 172.21.15.151:0/2381703155 learned_addr learned my addr 172.21.15.151:0/2381703155 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c3fff700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82c41004b0 0x7f82c419c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c959c700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82c4105b10 0x7f82c4195a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c8d9b700 1 -- 172.21.15.151:0/2381703155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82c4105b10 msgr2=0x7f82c4195a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:47.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82c4105b10 0x7f82c4195a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c8d9b700 1 -- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82c41004b0 msgr2=0x7f82c419c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82c41004b0 0x7f82c419c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c8d9b700 1 -- 172.21.15.151:0/2381703155 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b80095f0 con 0x7f82c40ffb00 2023-07-21T22:33:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.326+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c40ffb00 0x7f82c419bbc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f82b8000c00 tx=0x7f82b8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.327+0000 7f82c1ffb700 1 -- 172.21.15.151:0/2381703155 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b801d070 con 0x7f82c40ffb00 2023-07-21T22:33:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.327+0000 7f82c1ffb700 1 -- 172.21.15.151:0/2381703155 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82b8022470 con 0x7f82c40ffb00 2023-07-21T22:33:47.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.327+0000 7f82c1ffb700 1 -- 172.21.15.151:0/2381703155 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b8017650 con 0x7f82c40ffb00 2023-07-21T22:33:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.327+0000 7f82cafff700 1 -- 172.21.15.151:0/2381703155 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82c4196640 con 0x7f82c40ffb00 2023-07-21T22:33:47.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.327+0000 7f82cafff700 1 -- 172.21.15.151:0/2381703155 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82c41a2bb0 con 0x7f82c40ffb00 2023-07-21T22:33:47.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.331+0000 7f82c1ffb700 1 -- 172.21.15.151:0/2381703155 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f82b80225e0 con 0x7f82c40ffb00 2023-07-21T22:33:47.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.332+0000 7f82de8d5b80 1 Processor -- start 2023-07-21T22:33:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.332+0000 7f82de8d5b80 1 -- start start 2023-07-21T22:33:47.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.332+0000 7f82c1ffb700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82b40a1340 0x7f82b40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e94cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3e8ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82c1ffb700 1 -- 172.21.15.151:0/2381703155 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f82b80ce080 con 0x7f82c40ffb00 2023-07-21T22:33:47.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e8f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3d94c50 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3de79e0 con 0x55f9e3e95210 2023-07-21T22:33:47.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3de0e70 con 0x55f9e3e95660 2023-07-21T22:33:47.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82c959c700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82b40a1340 0x7f82b40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82c8d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e94cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82c8d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e94cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57628/0 (socket says 172.21.15.151:57628) 2023-07-21T22:33:47.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82c8d9b700 1 -- 172.21.15.151:0/2629987173 learned_addr learned my addr 172.21.15.151:0/2629987173 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:47.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82c3fff700 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3e8ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.333+0000 7f82c959c700 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e8f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82c3fff700 1 -- 172.21.15.151:0/2629987173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 msgr2=0x55f9e3e8f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:47.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82c3fff700 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e8f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82c3fff700 1 -- 172.21.15.151:0/2629987173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3ceb6b0 msgr2=0x55f9e3e94cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82c3fff700 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e94cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82c3fff700 1 -- 172.21.15.151:0/2629987173 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e3c0ed80 con 0x55f9e3e95210 2023-07-21T22:33:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82c959c700 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e8f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:33:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82c959c700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82b40a1340 0x7f82b40a37f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009ec0 tx=0x7f82bc00fc40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82c3fff700 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3e8ef40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009c80 tx=0x7f82b0009f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59b964c44e2910ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82aeffd700 1 -- 172.21.15.151:0/2629987173 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0011cb0 con 0x55f9e3e95210 2023-07-21T22:33:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82aeffd700 1 -- 172.21.15.151:0/2629987173 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82b0011e10 con 0x55f9e3e95210 2023-07-21T22:33:47.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.334+0000 7f82aeffd700 1 -- 172.21.15.151:0/2629987173 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b0003e30 con 0x55f9e3e95210 2023-07-21T22:33:47.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.335+0000 7f82de8d5b80 1 -- 172.21.15.151:0/2629987173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 msgr2=0x55f9e3e8ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:47.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.335+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3e8ef40 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f82b0009c80 tx=0x7f82b0009f90 comp rx=0 tx=0).stop 2023-07-21T22:33:47.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.335+0000 7f82de8d5b80 1 -- 172.21.15.151:0/2629987173 shutdown_connections 2023-07-21T22:33:47.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.335+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e8f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.335+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e94cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.335+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/2629987173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3e8ef40 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.335+0000 7f82de8d5b80 1 -- 172.21.15.151:0/2629987173 >> 172.21.15.151:0/2629987173 conn(0x55f9e3e84ae0 msgr2=0x55f9e3e8a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:47.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.336+0000 7f82de8d5b80 1 -- 172.21.15.151:0/2629987173 shutdown_connections 2023-07-21T22:33:47.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.336+0000 7f82de8d5b80 1 -- 172.21.15.151:0/2629987173 wait complete. 2023-07-21T22:33:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.336+0000 7f82de8d5b80 1 -- start start 2023-07-21T22:33:47.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.336+0000 7f82de8d5b80 1 Processor -- start 2023-07-21T22:33:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e9b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 0x55f9e3e98780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e98d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3d80a60 con 0x55f9e3e95210 2023-07-21T22:33:47.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3d80760 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3c648c0 con 0x55f9e3e95660 2023-07-21T22:33:47.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82de8d5b80 10 client.0 _ll_register_callbacks cb 0x55f9e3d7e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:33:47.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82c959c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e98d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82c959c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e98d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42354/0 (socket says 172.21.15.151:42354) 2023-07-21T22:33:47.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82c959c700 1 -- 172.21.15.151:0/1529564457 learned_addr learned my addr 172.21.15.151:0/1529564457 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e9b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.337+0000 7f82c3fff700 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 0x55f9e3e98780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82c959c700 1 -- 172.21.15.151:0/1529564457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 msgr2=0x55f9e3e9b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82c959c700 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e9b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82c959c700 1 -- 172.21.15.151:0/1529564457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 msgr2=0x55f9e3e98780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:47.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82c959c700 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 0x55f9e3e98780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82c959c700 1 -- 172.21.15.151:0/1529564457 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b00098e0 con 0x55f9e3e95660 2023-07-21T22:33:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e9b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:33:47.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82c959c700 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e98d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f82bc018dd0 tx=0x7f82bc004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c34a880b9732749 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:33:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82a3fff700 1 -- 172.21.15.151:0/1529564457 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82bc00e040 con 0x55f9e3e95660 2023-07-21T22:33:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1529564457 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f9e3d3a490 con 0x55f9e3e95660 2023-07-21T22:33:47.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.338+0000 7f82a3fff700 1 -- 172.21.15.151:0/1529564457 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f82bc00fdc0 con 0x55f9e3e95660 2023-07-21T22:33:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.339+0000 7f82a3fff700 1 -- 172.21.15.151:0/1529564457 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82bc008c80 con 0x55f9e3e95660 2023-07-21T22:33:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.339+0000 7f82de8d5b80 10 client.27193 fetch_fsmap learned FSMap version 58 2023-07-21T22:33:47.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.339+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1529564457 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x55f9e3bf7c00 con 0x55f9e3e95660 2023-07-21T22:33:47.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.339+0000 7f82a3fff700 1 -- 172.21.15.151:0/1529564457 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f9e3d3a490 con 0x55f9e3e95660 2023-07-21T22:33:47.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.339+0000 7f82a3fff700 1 -- 172.21.15.151:0/1529564457 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 58) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f82bc024980 con 0x55f9e3e95660 2023-07-21T22:33:47.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.340+0000 7f82de8d5b80 10 client.27193 fetch_fsmap finished waiting for FSMap version 58 2023-07-21T22:33:47.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.340+0000 7f82de8d5b80 10 client.27193 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:33:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.340+0000 7f82de8d5b80 20 client.27193 populate_metadata read hostname 'smithi151' 2023-07-21T22:33:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.340+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9e3eaced0 0x55f9e3eaf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.340+0000 7f82de8d5b80 4 client.27193 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:33:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.340+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1529564457 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f9e3dd9e50 con 0x55f9e3eaced0 2023-07-21T22:33:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.340+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9e3eaced0 0x55f9e3eaf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.341+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9e3eaced0 0x55f9e3eaf2e0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bf6317b107de521 server_cookie=90ce28d6da80333a in_seq=0 out_seq=0 2023-07-21T22:33:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.341+0000 7f82a3fff700 10 client.27193 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.341+0000 7f82a3fff700 1 -- 172.21.15.151:0/1529564457 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f9e3dd9e50 con 0x55f9e3eaced0 2023-07-21T22:33:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.341+0000 7f82a3fff700 10 client.27193 handle_command_reply: tid=0 2023-07-21T22:33:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.341+0000 7f82de8d5b80 1 client.27193 shutdown 2023-07-21T22:33:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1529564457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 msgr2=0x55f9e3e98d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e98d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f82bc018dd0 tx=0x7f82bc004b40 comp rx=0 tx=0).stop 2023-07-21T22:33:47.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1529564457 shutdown_connections 2023-07-21T22:33:47.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9e3eaced0 0x55f9e3eaf2e0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e9b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e98d90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1529564457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 0x55f9e3e98780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82a3fff700 0 client.27193 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:47.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1529564457 >> 172.21.15.151:0/1529564457 conn(0x55f9e3e84ae0 msgr2=0x55f9e3e893e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:47.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1529564457 shutdown_connections 2023-07-21T22:33:47.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1529564457 wait complete. 2023-07-21T22:33:47.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.342+0000 7f82de8d5b80 20 client.27193 trim_cache size 0 max 16384 2023-07-21T22:33:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.361+0000 7f82de8d5b80 1 Processor -- start 2023-07-21T22:33:47.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.361+0000 7f82de8d5b80 1 -- start start 2023-07-21T22:33:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.361+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e98730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.361+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3ea4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95660 0x55f9e3e9b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3e95060 con 0x55f9e3e95660 2023-07-21T22:33:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3e8ff20 con 0x55f9e3e95210 2023-07-21T22:33:47.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3e933c0 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c8d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e98730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c8d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e98730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42358/0 (socket says 172.21.15.151:42358) 2023-07-21T22:33:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c8d9b700 1 -- 172.21.15.151:0/33234929 learned_addr learned my addr 172.21.15.151:0/33234929 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3ea4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c959c700 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95660 0x55f9e3e9b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c8d9b700 1 -- 172.21.15.151:0/33234929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 msgr2=0x55f9e3ea4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3ea4030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c8d9b700 1 -- 172.21.15.151:0/33234929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95660 msgr2=0x55f9e3e9b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:47.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95660 0x55f9e3e9b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c8d9b700 1 -- 172.21.15.151:0/33234929 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f9e3eb3f10 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c959c700 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95660 0x55f9e3e9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:33:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.362+0000 7f82c3fff700 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3ea4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:33:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.363+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e98730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f82b809aea0 tx=0x7f82b80a1040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f58f509151ab8c94 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.363+0000 7f82af7fe700 1 -- 172.21.15.151:0/33234929 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b809ace0 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.363+0000 7f82af7fe700 1 -- 172.21.15.151:0/33234929 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82b809ab00 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.363+0000 7f82af7fe700 1 -- 172.21.15.151:0/33234929 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b80a3560 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 -- 172.21.15.151:0/33234929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3ceb6b0 msgr2=0x55f9e3e98730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e98730 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f82b809aea0 tx=0x7f82b80a1040 comp rx=0 tx=0).stop 2023-07-21T22:33:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 -- 172.21.15.151:0/33234929 shutdown_connections 2023-07-21T22:33:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95660 0x55f9e3e9b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e98730 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/33234929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3e95210 0x55f9e3ea4030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 -- 172.21.15.151:0/33234929 >> 172.21.15.151:0/33234929 conn(0x55f9e3e84ae0 msgr2=0x55f9e3e98020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 -- 172.21.15.151:0/33234929 shutdown_connections 2023-07-21T22:33:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 -- 172.21.15.151:0/33234929 wait complete. 2023-07-21T22:33:47.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.364+0000 7f82de8d5b80 1 -- start start 2023-07-21T22:33:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82de8d5b80 1 Processor -- start 2023-07-21T22:33:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e90730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 0x55f9e3e90c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82de8d5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e911b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3e91740 con 0x55f9e3e95210 2023-07-21T22:33:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3e918b0 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82de8d5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f9e3e91a70 con 0x55f9e3e95660 2023-07-21T22:33:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82de8d5b80 10 client.0 _ll_register_callbacks cb 0x7f82bc009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:33:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82c8d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e90730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 0x55f9e3e90c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.365+0000 7f82c8d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e90730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35040/0 (socket says 172.21.15.151:35040) 2023-07-21T22:33:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82c8d9b700 1 -- 172.21.15.151:0/1410251538 learned_addr learned my addr 172.21.15.151:0/1410251538 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:33:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82c959c700 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e911b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82c8d9b700 1 -- 172.21.15.151:0/1410251538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 msgr2=0x55f9e3e911b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e911b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82c8d9b700 1 -- 172.21.15.151:0/1410251538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 msgr2=0x55f9e3e90c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:33:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 0x55f9e3e90c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82c8d9b700 1 -- 172.21.15.151:0/1410251538 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82b001e040 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82c8d9b700 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e90730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f82b809b800 tx=0x7f82b800b390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffe60c0130a8158f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:33:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82a3fff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:33:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82a3fff700 1 -- 172.21.15.151:0/1410251538 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82b809a890 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82a3fff700 1 -- 172.21.15.151:0/1410251538 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f82b80a3560 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.366+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1410251538 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f82b0011e10 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82a3fff700 1 -- 172.21.15.151:0/1410251538 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82b809b1a0 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82de8d5b80 10 client.27173 fetch_fsmap learned FSMap version 58 2023-07-21T22:33:47.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1410251538 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) v3 -- 0x7f82c41a2bb0 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82a3fff700 1 -- 172.21.15.151:0/1410251538 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82b0011e10 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82a3fff700 1 -- 172.21.15.151:0/1410251538 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 58) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f82b80a30d0 con 0x55f9e3ceb6b0 2023-07-21T22:33:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82de8d5b80 10 client.27173 fetch_fsmap finished waiting for FSMap version 58 2023-07-21T22:33:47.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82de8d5b80 10 client.27173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:33:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82de8d5b80 20 client.27173 populate_metadata read hostname 'smithi151' 2023-07-21T22:33:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9e3f01510 0x55f9e3f038f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:33:47.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82de8d5b80 4 client.27173 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:33:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.367+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1410251538 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f9e3d9bff0 con 0x55f9e3f01510 2023-07-21T22:33:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.368+0000 7f82c3fff700 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9e3f01510 0x55f9e3f038f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:33:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.368+0000 7f82a3fff700 10 client.27173 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:47.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.368+0000 7f82c3fff700 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9e3f01510 0x55f9e3f038f0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9eda9be3c92066a server_cookie=d3cf581d5409fac8 in_seq=0 out_seq=0 2023-07-21T22:33:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.378+0000 7f82a3fff700 1 -- 172.21.15.151:0/1410251538 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f9e3d9bff0 con 0x55f9e3f01510 2023-07-21T22:33:47.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.378+0000 7f82a3fff700 10 client.27173 handle_command_reply: tid=0 2023-07-21T22:33:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.378+0000 7f82de8d5b80 1 client.27173 shutdown 2023-07-21T22:33:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1410251538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 msgr2=0x55f9e3e90730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e90730 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f82b809b800 tx=0x7f82b800b390 comp rx=0 tx=0).stop 2023-07-21T22:33:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1410251538 shutdown_connections 2023-07-21T22:33:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9e3f01510 0x55f9e3f038f0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f9e3ceb6b0 0x55f9e3e90730 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f9e3e95660 0x55f9e3e911b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82a3fff700 0 client.27173 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:33:47.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 --2- 172.21.15.151:0/1410251538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f9e3e95210 0x55f9e3e90c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1410251538 >> 172.21.15.151:0/1410251538 conn(0x55f9e3e84ae0 msgr2=0x55f9e3e95a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:47.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1410251538 shutdown_connections 2023-07-21T22:33:47.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 1 -- 172.21.15.151:0/1410251538 wait complete. 2023-07-21T22:33:47.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.379+0000 7f82de8d5b80 20 client.27173 trim_cache size 0 max 16384 2023-07-21T22:33:47.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:33:47.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:33:47.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:33:47.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:33:47.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 -- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82b40a1340 msgr2=0x7f82b40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:47.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82b40a1340 0x7f82b40a37f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f82bc009ec0 tx=0x7f82bc00fc40 comp rx=0 tx=0).stop 2023-07-21T22:33:47.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 -- 172.21.15.151:0/2381703155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c40ffb00 msgr2=0x7f82c419bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:33:47.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c40ffb00 0x7f82c419bbc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f82b8000c00 tx=0x7f82b8004730 comp rx=0 tx=0).stop 2023-07-21T22:33:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 -- 172.21.15.151:0/2381703155 shutdown_connections 2023-07-21T22:33:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82b40a1340 0x7f82b40a37f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82c4105b10 0x7f82c4195a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82c40ffb00 0x7f82c419bbc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 --2- 172.21.15.151:0/2381703155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82c41004b0 0x7f82c419c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:33:47.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 -- 172.21.15.151:0/2381703155 >> 172.21.15.151:0/2381703155 conn(0x7f82c40fb600 msgr2=0x7f82c40fbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:33:47.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 -- 172.21.15.151:0/2381703155 shutdown_connections 2023-07-21T22:33:47.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:33:47.380+0000 7f82cafff700 1 -- 172.21.15.151:0/2381703155 wait complete. 2023-07-21T22:33:48.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:48 smithi187 ceph-mon[96918]: pgmap v457: 97 pgs: 97 active+clean; 9.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.4 MiB/s wr, 579 op/s 2023-07-21T22:33:48.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:48 smithi195 ceph-mon[97365]: pgmap v457: 97 pgs: 97 active+clean; 9.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.4 MiB/s wr, 579 op/s 2023-07-21T22:33:48.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:48 smithi151 ceph-mon[95510]: pgmap v457: 97 pgs: 97 active+clean; 9.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.4 MiB/s wr, 579 op/s 2023-07-21T22:33:50.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:50 smithi187 ceph-mon[96918]: pgmap v458: 97 pgs: 97 active+clean; 9.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.0 MiB/s wr, 390 op/s 2023-07-21T22:33:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:50 smithi195 ceph-mon[97365]: pgmap v458: 97 pgs: 97 active+clean; 9.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.0 MiB/s wr, 390 op/s 2023-07-21T22:33:50.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:50 smithi151 ceph-mon[95510]: pgmap v458: 97 pgs: 97 active+clean; 9.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.0 MiB/s wr, 390 op/s 2023-07-21T22:33:52.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:52 smithi187 ceph-mon[96918]: pgmap v459: 97 pgs: 97 active+clean; 9.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.0 MiB/s wr, 390 op/s 2023-07-21T22:33:52.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:52 smithi195 ceph-mon[97365]: pgmap v459: 97 pgs: 97 active+clean; 9.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.0 MiB/s wr, 390 op/s 2023-07-21T22:33:52.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:52 smithi151 ceph-mon[95510]: pgmap v459: 97 pgs: 97 active+clean; 9.3 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.0 MiB/s wr, 390 op/s 2023-07-21T22:33:54.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:54 smithi187 ceph-mon[96918]: pgmap v460: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.5 MiB/s wr, 588 op/s 2023-07-21T22:33:54.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:54 smithi195 ceph-mon[97365]: pgmap v460: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.5 MiB/s wr, 588 op/s 2023-07-21T22:33:54.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:54 smithi151 ceph-mon[95510]: pgmap v460: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.5 MiB/s wr, 588 op/s 2023-07-21T22:33:55.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:55 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:55.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:55 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:55.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:55 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:33:56.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:56 smithi187 ceph-mon[96918]: pgmap v461: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 MiB/s wr, 397 op/s 2023-07-21T22:33:56.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:56 smithi195 ceph-mon[97365]: pgmap v461: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 MiB/s wr, 397 op/s 2023-07-21T22:33:56.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:56 smithi151 ceph-mon[95510]: pgmap v461: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 MiB/s wr, 397 op/s 2023-07-21T22:33:58.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:33:58 smithi187 ceph-mon[96918]: pgmap v462: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.5 MiB/s wr, 583 op/s 2023-07-21T22:33:58.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:33:58 smithi195 ceph-mon[97365]: pgmap v462: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.5 MiB/s wr, 583 op/s 2023-07-21T22:33:58.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:33:58 smithi151 ceph-mon[95510]: pgmap v462: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.5 MiB/s wr, 583 op/s 2023-07-21T22:34:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.557+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3330807745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 msgr2=0x7f4d78072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.557+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3330807745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 0x7f4d78072c20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009990 tx=0x7f4d68009ca0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.557+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3330807745 shutdown_connections 2023-07-21T22:34:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.557+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3330807745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d7810c3f0 0x7f4d7810e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.557+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3330807745 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 0x7f4d78072c20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.557+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3330807745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d78073160 0x7f4d7810beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.557+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3330807745 >> 172.21.15.151:0/3330807745 conn(0x7f4d780fb650 msgr2=0x7f4d780fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.557+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3330807745 shutdown_connections 2023-07-21T22:34:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.557+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3330807745 wait complete. 2023-07-21T22:34:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.558+0000 7f4d7cdff700 1 Processor -- start 2023-07-21T22:34:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7cdff700 1 -- start start 2023-07-21T22:34:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7cdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 0x7f4d78197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7cdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d78073160 0x7f4d78198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7cdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d7810c3f0 0x7f4d7819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7cdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7819cfb0 con 0x7f4d78073160 2023-07-21T22:34:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7cdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7819d120 con 0x7f4d7810c3f0 2023-07-21T22:34:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7cdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d7819d2e0 con 0x7f4d78072850 2023-07-21T22:34:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 0x7f4d78197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 0x7f4d78197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54408/0 (socket says 172.21.15.151:54408) 2023-07-21T22:34:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d7659c700 1 -- 172.21.15.151:0/3956756979 learned_addr learned my addr 172.21.15.151:0/3956756979 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:00.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.559+0000 7f4d75d9b700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d78073160 0x7f4d78198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.560+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d7810c3f0 0x7f4d7819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.560+0000 7f4d7659c700 1 -- 172.21.15.151:0/3956756979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d7810c3f0 msgr2=0x7f4d7819c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.560+0000 7f4d7659c700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d7810c3f0 0x7f4d7819c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.560+0000 7f4d7659c700 1 -- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d78073160 msgr2=0x7f4d78198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.560+0000 7f4d7659c700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d78073160 0x7f4d78198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.560+0000 7f4d7659c700 1 -- 172.21.15.151:0/3956756979 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680095f0 con 0x7f4d78072850 2023-07-21T22:34:00.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.560+0000 7f4d7659c700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 0x7f4d78197dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4d68005740 tx=0x7f4d68005770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:00.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.560+0000 7f4d677fe700 1 -- 172.21.15.151:0/3956756979 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6801d070 con 0x7f4d78072850 2023-07-21T22:34:00.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.561+0000 7f4d677fe700 1 -- 172.21.15.151:0/3956756979 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d68022470 con 0x7f4d78072850 2023-07-21T22:34:00.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.561+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3956756979 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d7819d560 con 0x7f4d78072850 2023-07-21T22:34:00.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.561+0000 7f4d677fe700 1 -- 172.21.15.151:0/3956756979 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68017650 con 0x7f4d78072850 2023-07-21T22:34:00.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.561+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3956756979 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d781a4e00 con 0x7f4d78072850 2023-07-21T22:34:00.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.564+0000 7f4d677fe700 1 -- 172.21.15.151:0/3956756979 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4d680225e0 con 0x7f4d78072850 2023-07-21T22:34:00.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.566+0000 7f4d90725b80 1 Processor -- start 2023-07-21T22:34:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.566+0000 7f4d90725b80 1 -- start start 2023-07-21T22:34:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.566+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d7716b0 0x55dc0d91acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.566+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 0x55dc0d914f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.566+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 0x55dc0d9154a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.566+0000 7f4d90725b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d81ac50 con 0x55dc0d91b660 2023-07-21T22:34:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d90725b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d86d9e0 con 0x55dc0d91b210 2023-07-21T22:34:00.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d90725b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d866e70 con 0x55dc0d7716b0 2023-07-21T22:34:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d76d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d7716b0 0x55dc0d91acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d76d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d7716b0 0x55dc0d91acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54420/0 (socket says 172.21.15.151:54420) 2023-07-21T22:34:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d76d9d700 1 -- 172.21.15.151:0/1578625287 learned_addr learned my addr 172.21.15.151:0/1578625287 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:00.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d677fe700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d600a1340 0x7f4d600a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d75d9b700 1 --2- 172.21.15.151:0/1578625287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 0x55dc0d9154a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d677fe700 1 -- 172.21.15.151:0/3956756979 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4d680cdff0 con 0x7f4d78072850 2023-07-21T22:34:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d76d9d700 1 -- 172.21.15.151:0/1578625287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 msgr2=0x55dc0d914f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/1578625287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 0x55dc0d914f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d76d9d700 1 -- 172.21.15.151:0/1578625287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 msgr2=0x55dc0d9154a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/1578625287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 0x55dc0d9154a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.567+0000 7f4d76d9d700 1 -- 172.21.15.151:0/1578625287 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc0d694d80 con 0x55dc0d7716b0 2023-07-21T22:34:00.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.568+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d600a1340 0x7f4d600a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.568+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/1578625287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d7716b0 0x55dc0d91acd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4d70011690 tx=0x7f4d700119a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aa16e760e310f8c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:00.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.568+0000 7f4d64ff9700 1 -- 172.21.15.151:0/1578625287 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d7000e040 con 0x55dc0d7716b0 2023-07-21T22:34:00.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.568+0000 7f4d64ff9700 1 -- 172.21.15.151:0/1578625287 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d7000f040 con 0x55dc0d7716b0 2023-07-21T22:34:00.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.568+0000 7f4d64ff9700 1 -- 172.21.15.151:0/1578625287 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d70020700 con 0x55dc0d7716b0 2023-07-21T22:34:00.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.569+0000 7f4d90725b80 1 -- 172.21.15.151:0/1578625287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d7716b0 msgr2=0x55dc0d91acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:00.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.569+0000 7f4d90725b80 1 --2- 172.21.15.151:0/1578625287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d7716b0 0x55dc0d91acd0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f4d70011690 tx=0x7f4d700119a0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.569+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d600a1340 0x7f4d600a37f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4d70022000 tx=0x7f4d7001f000 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:00.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.569+0000 7f4d90725b80 1 -- 172.21.15.151:0/1578625287 shutdown_connections 2023-07-21T22:34:00.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.569+0000 7f4d90725b80 1 --2- 172.21.15.151:0/1578625287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 0x55dc0d9154a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.569+0000 7f4d90725b80 1 --2- 172.21.15.151:0/1578625287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d7716b0 0x55dc0d91acd0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.569+0000 7f4d90725b80 1 --2- 172.21.15.151:0/1578625287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 0x55dc0d914f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.569+0000 7f4d90725b80 1 -- 172.21.15.151:0/1578625287 >> 172.21.15.151:0/1578625287 conn(0x55dc0d90aae0 msgr2=0x55dc0d9100e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.569+0000 7f4d90725b80 1 -- 172.21.15.151:0/1578625287 shutdown_connections 2023-07-21T22:34:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.570+0000 7f4d90725b80 1 -- 172.21.15.151:0/1578625287 wait complete. 2023-07-21T22:34:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.570+0000 7f4d90725b80 1 -- start start 2023-07-21T22:34:00.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.571+0000 7f4d90725b80 1 Processor -- start 2023-07-21T22:34:00.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.571+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d7716b0 0x55dc0d921630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.571+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 0x55dc0d91e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.571+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 0x55dc0d91ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.571+0000 7f4d90725b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d806a60 con 0x55dc0d7716b0 2023-07-21T22:34:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d90725b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d806760 con 0x55dc0d91b210 2023-07-21T22:34:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d90725b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d6ea8c0 con 0x55dc0d91b660 2023-07-21T22:34:00.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d90725b80 10 client.0 _ll_register_callbacks cb 0x55dc0d804700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d75d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 0x55dc0d91e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d75d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 0x55dc0d91e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51846/0 (socket says 172.21.15.151:51846) 2023-07-21T22:34:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d75d9b700 1 -- 172.21.15.151:0/2309038559 learned_addr learned my addr 172.21.15.151:0/2309038559 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 0x55dc0d91ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d7659c700 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d7716b0 0x55dc0d921630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d75d9b700 1 -- 172.21.15.151:0/2309038559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 msgr2=0x55dc0d91ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d75d9b700 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 0x55dc0d91ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d75d9b700 1 -- 172.21.15.151:0/2309038559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d7716b0 msgr2=0x55dc0d921630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.572+0000 7f4d75d9b700 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d7716b0 0x55dc0d921630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.573+0000 7f4d75d9b700 1 -- 172.21.15.151:0/2309038559 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d700112c0 con 0x55dc0d91b210 2023-07-21T22:34:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.573+0000 7f4d75d9b700 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 0x55dc0d91e840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0116d0 tx=0x7f4d6c0119e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f91ed0d2c7d84f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.573+0000 7f4d5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:34:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.573+0000 7f4d5dffb700 1 -- 172.21.15.151:0/2309038559 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6c016070 con 0x55dc0d91b210 2023-07-21T22:34:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.573+0000 7f4d5dffb700 1 -- 172.21.15.151:0/2309038559 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4d6c004260 con 0x55dc0d91b210 2023-07-21T22:34:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.573+0000 7f4d90725b80 1 -- 172.21.15.151:0/2309038559 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc0d7c0490 con 0x55dc0d91b210 2023-07-21T22:34:00.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d5dffb700 1 -- 172.21.15.151:0/2309038559 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d6c004420 con 0x55dc0d91b210 2023-07-21T22:34:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d90725b80 10 client.27182 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:00.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d90725b80 1 -- 172.21.15.151:0/2309038559 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55dc0d67dc00 con 0x55dc0d91b210 2023-07-21T22:34:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d5dffb700 1 -- 172.21.15.151:0/2309038559 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d6c027020 con 0x55dc0d91b210 2023-07-21T22:34:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d5dffb700 1 -- 172.21.15.151:0/2309038559 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4d6c00f580 con 0x55dc0d91b210 2023-07-21T22:34:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d90725b80 10 client.27182 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:00.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d90725b80 10 client.27182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d90725b80 20 client.27182 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d90725b80 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc0d92ebd0 0x55dc0d930fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d90725b80 4 client.27182 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:34:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.574+0000 7f4d90725b80 1 -- 172.21.15.151:0/2309038559 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc0d85fe50 con 0x55dc0d92ebd0 2023-07-21T22:34:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.575+0000 7f4d7659c700 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc0d92ebd0 0x55dc0d930fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.575+0000 7f4d7659c700 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc0d92ebd0 0x55dc0d930fe0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd16cba9d2d2b2e2 server_cookie=6aadd5cc4aa8e6a3 in_seq=0 out_seq=0 2023-07-21T22:34:00.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.575+0000 7f4d5dffb700 10 client.27182 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d5dffb700 1 -- 172.21.15.151:0/2309038559 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dc0d85fe50 con 0x55dc0d92ebd0 2023-07-21T22:34:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d5dffb700 10 client.27182 handle_command_reply: tid=0 2023-07-21T22:34:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d90725b80 1 client.27182 shutdown 2023-07-21T22:34:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d90725b80 1 -- 172.21.15.151:0/2309038559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 msgr2=0x55dc0d91e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d90725b80 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 0x55dc0d91e840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c0116d0 tx=0x7f4d6c0119e0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d90725b80 1 -- 172.21.15.151:0/2309038559 shutdown_connections 2023-07-21T22:34:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d90725b80 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc0d92ebd0 0x55dc0d930fe0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d90725b80 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 0x55dc0d91ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d5dffb700 0 client.27182 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d90725b80 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d7716b0 0x55dc0d921630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d90725b80 1 --2- 172.21.15.151:0/2309038559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d91b210 0x55dc0d91e840 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.576+0000 7f4d90725b80 1 -- 172.21.15.151:0/2309038559 >> 172.21.15.151:0/2309038559 conn(0x55dc0d90aae0 msgr2=0x55dc0d90f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.577+0000 7f4d90725b80 1 -- 172.21.15.151:0/2309038559 shutdown_connections 2023-07-21T22:34:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.577+0000 7f4d90725b80 1 -- 172.21.15.151:0/2309038559 wait complete. 2023-07-21T22:34:00.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.577+0000 7f4d90725b80 20 client.27182 trim_cache size 0 max 16384 2023-07-21T22:34:00.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.597+0000 7f4d90725b80 1 Processor -- start 2023-07-21T22:34:00.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d90725b80 1 -- start start 2023-07-21T22:34:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d917740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b210 0x55dc0d925c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 0x55dc0d921160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d90725b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d917d10 con 0x55dc0d91b210 2023-07-21T22:34:00.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d90725b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d92c250 con 0x55dc0d7716b0 2023-07-21T22:34:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d90725b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d91a8d0 con 0x55dc0d91b660 2023-07-21T22:34:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d75d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b210 0x55dc0d925c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d7659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d917740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d75d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b210 0x55dc0d925c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58830/0 (socket says 172.21.15.151:58830) 2023-07-21T22:34:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d7659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d917740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51856/0 (socket says 172.21.15.151:51856) 2023-07-21T22:34:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d75d9b700 1 -- 172.21.15.151:0/96020416 learned_addr learned my addr 172.21.15.151:0/96020416 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:00.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.598+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/96020416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 0x55dc0d921160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.599+0000 7f4d7659c700 1 -- 172.21.15.151:0/96020416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 msgr2=0x55dc0d921160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.599+0000 7f4d7659c700 1 --2- 172.21.15.151:0/96020416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 0x55dc0d921160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.599+0000 7f4d7659c700 1 -- 172.21.15.151:0/96020416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b210 msgr2=0x55dc0d925c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.599+0000 7f4d7659c700 1 --2- 172.21.15.151:0/96020416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b210 0x55dc0d925c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.599+0000 7f4d7659c700 1 -- 172.21.15.151:0/96020416 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc0d6bb1f0 con 0x55dc0d7716b0 2023-07-21T22:34:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.599+0000 7f4d7659c700 1 --2- 172.21.15.151:0/96020416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d917740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4d680cb700 tx=0x7f4d6801a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d2ca1e4bdbf10ead server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:00.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.599+0000 7f4d657fa700 1 -- 172.21.15.151:0/96020416 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68097450 con 0x55dc0d7716b0 2023-07-21T22:34:00.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.599+0000 7f4d657fa700 1 -- 172.21.15.151:0/96020416 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d6809b110 con 0x55dc0d7716b0 2023-07-21T22:34:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.599+0000 7f4d657fa700 1 -- 172.21.15.151:0/96020416 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d680cb980 con 0x55dc0d7716b0 2023-07-21T22:34:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.600+0000 7f4d90725b80 1 -- 172.21.15.151:0/96020416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 msgr2=0x55dc0d917740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.600+0000 7f4d90725b80 1 --2- 172.21.15.151:0/96020416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d917740 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4d680cb700 tx=0x7f4d6801a040 comp rx=0 tx=0).stop 2023-07-21T22:34:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.600+0000 7f4d90725b80 1 -- 172.21.15.151:0/96020416 shutdown_connections 2023-07-21T22:34:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.600+0000 7f4d90725b80 1 --2- 172.21.15.151:0/96020416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d917740 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.600+0000 7f4d90725b80 1 --2- 172.21.15.151:0/96020416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b660 0x55dc0d921160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.600+0000 7f4d90725b80 1 --2- 172.21.15.151:0/96020416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b210 0x55dc0d925c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.600+0000 7f4d90725b80 1 -- 172.21.15.151:0/96020416 >> 172.21.15.151:0/96020416 conn(0x55dc0d90aae0 msgr2=0x55dc0d918990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.601+0000 7f4d90725b80 1 -- 172.21.15.151:0/96020416 shutdown_connections 2023-07-21T22:34:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.601+0000 7f4d90725b80 1 -- 172.21.15.151:0/96020416 wait complete. 2023-07-21T22:34:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.601+0000 7f4d90725b80 1 -- start start 2023-07-21T22:34:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.602+0000 7f4d90725b80 1 Processor -- start 2023-07-21T22:34:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.602+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d90fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.602+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b210 0x55dc0d910180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.602+0000 7f4d90725b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 0x55dc0d90eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.602+0000 7f4d90725b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d90f090 con 0x55dc0d91b660 2023-07-21T22:34:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.602+0000 7f4d90725b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d90f200 con 0x55dc0d7716b0 2023-07-21T22:34:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.602+0000 7f4d90725b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc0d90f3c0 con 0x55dc0d91b210 2023-07-21T22:34:00.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d90725b80 10 client.0 _ll_register_callbacks cb 0x7f4d6c009d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:00.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d75d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b210 0x55dc0d910180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d75d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b210 0x55dc0d910180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54458/0 (socket says 172.21.15.151:54458) 2023-07-21T22:34:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d75d9b700 1 -- 172.21.15.151:0/3320250108 learned_addr learned my addr 172.21.15.151:0/3320250108 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d7659c700 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d90fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 0x55dc0d90eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d7659c700 1 -- 172.21.15.151:0/3320250108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b210 msgr2=0x55dc0d910180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:00.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d7659c700 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b210 0x55dc0d910180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d7659c700 1 -- 172.21.15.151:0/3320250108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 msgr2=0x55dc0d90eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d7659c700 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 0x55dc0d90eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d7659c700 1 -- 172.21.15.151:0/3320250108 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d781a4e00 con 0x55dc0d7716b0 2023-07-21T22:34:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.603+0000 7f4d76d9d700 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 0x55dc0d90eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.604+0000 7f4d7659c700 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d90fc40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4d680cb700 tx=0x7f4d68005910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=672e649690e3c916 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.604+0000 7f4d5dffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:34:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.604+0000 7f4d5dffb700 1 -- 172.21.15.151:0/3320250108 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d68022ad0 con 0x55dc0d7716b0 2023-07-21T22:34:00.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.604+0000 7f4d5dffb700 1 -- 172.21.15.151:0/3320250108 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(104..104 src has 1..104) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4d6809f140 con 0x55dc0d7716b0 2023-07-21T22:34:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.604+0000 7f4d90725b80 1 -- 172.21.15.151:0/3320250108 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d7000f040 con 0x55dc0d7716b0 2023-07-21T22:34:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.604+0000 7f4d5dffb700 1 -- 172.21.15.151:0/3320250108 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d680cb2e0 con 0x55dc0d7716b0 2023-07-21T22:34:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.604+0000 7f4d90725b80 10 client.27188 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.604+0000 7f4d90725b80 1 -- 172.21.15.151:0/3320250108 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55dc0d693250 con 0x55dc0d7716b0 2023-07-21T22:34:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.605+0000 7f4d5dffb700 1 -- 172.21.15.151:0/3320250108 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d7000f040 con 0x55dc0d7716b0 2023-07-21T22:34:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.605+0000 7f4d5dffb700 1 -- 172.21.15.151:0/3320250108 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4d680b9290 con 0x55dc0d7716b0 2023-07-21T22:34:00.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.605+0000 7f4d90725b80 10 client.27188 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.605+0000 7f4d90725b80 10 client.27188 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.605+0000 7f4d90725b80 20 client.27188 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.605+0000 7f4d90725b80 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc0d9835f0 0x55dc0d985a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.605+0000 7f4d90725b80 4 client.27188 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:34:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.605+0000 7f4d90725b80 1 -- 172.21.15.151:0/3320250108 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dc0d821ff0 con 0x55dc0d9835f0 2023-07-21T22:34:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.605+0000 7f4d75d9b700 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc0d9835f0 0x55dc0d985a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.606+0000 7f4d75d9b700 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc0d9835f0 0x55dc0d985a00 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4033919672691fcf server_cookie=1039eefb560a197f in_seq=0 out_seq=0 2023-07-21T22:34:00.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.606+0000 7f4d5dffb700 10 client.27188 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.671+0000 7f4d5dffb700 1 -- 172.21.15.151:0/3320250108 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dc0d821ff0 con 0x55dc0d9835f0 2023-07-21T22:34:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.671+0000 7f4d5dffb700 10 client.27188 handle_command_reply: tid=0 2023-07-21T22:34:00.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.671+0000 7f4d90725b80 1 client.27188 shutdown 2023-07-21T22:34:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 -- 172.21.15.151:0/3320250108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 msgr2=0x55dc0d90fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d90fc40 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4d680cb700 tx=0x7f4d68005910 comp rx=0 tx=0).stop 2023-07-21T22:34:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 -- 172.21.15.151:0/3320250108 shutdown_connections 2023-07-21T22:34:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc0d9835f0 0x55dc0d985a00 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc0d7716b0 0x55dc0d90fc40 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc0d91b660 0x55dc0d90eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 --2- 172.21.15.151:0/3320250108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc0d91b210 0x55dc0d910180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d5dffb700 0 client.27188 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 -- 172.21.15.151:0/3320250108 >> 172.21.15.151:0/3320250108 conn(0x55dc0d90aae0 msgr2=0x55dc0d919900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 -- 172.21.15.151:0/3320250108 shutdown_connections 2023-07-21T22:34:00.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.672+0000 7f4d90725b80 1 -- 172.21.15.151:0/3320250108 wait complete. 2023-07-21T22:34:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.673+0000 7f4d90725b80 20 client.27188 trim_cache size 0 max 16384 2023-07-21T22:34:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:34:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:34:00.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:34:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:34:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.673+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d600a1340 msgr2=0x7f4d600a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.673+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d600a1340 0x7f4d600a37f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4d70022000 tx=0x7f4d7001f000 comp rx=0 tx=0).stop 2023-07-21T22:34:00.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.673+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3956756979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 msgr2=0x7f4d78197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.673+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 0x7f4d78197dc0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4d68005740 tx=0x7f4d68005770 comp rx=0 tx=0).stop 2023-07-21T22:34:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.674+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3956756979 shutdown_connections 2023-07-21T22:34:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.674+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d600a1340 0x7f4d600a37f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.674+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d7810c3f0 0x7f4d7819c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.674+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4d78072850 0x7f4d78197dc0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.674+0000 7f4d7cdff700 1 --2- 172.21.15.151:0/3956756979 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4d78073160 0x7f4d78198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:00.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.674+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3956756979 >> 172.21.15.151:0/3956756979 conn(0x7f4d780fb650 msgr2=0x7f4d7810e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.674+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3956756979 shutdown_connections 2023-07-21T22:34:00.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:00.674+0000 7f4d7cdff700 1 -- 172.21.15.151:0/3956756979 wait complete. 2023-07-21T22:34:00.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:00 smithi187 ceph-mon[96918]: pgmap v463: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 384 op/s 2023-07-21T22:34:00.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:00 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:34:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:00 smithi195 ceph-mon[97365]: pgmap v463: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 384 op/s 2023-07-21T22:34:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:00 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:34:00.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:00 smithi151 ceph-mon[95510]: pgmap v463: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 384 op/s 2023-07-21T22:34:00.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:00 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:34:02.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:02 smithi187 ceph-mon[96918]: pgmap v464: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 384 op/s 2023-07-21T22:34:02.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:02 smithi195 ceph-mon[97365]: pgmap v464: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 384 op/s 2023-07-21T22:34:02.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:02 smithi151 ceph-mon[95510]: pgmap v464: 97 pgs: 97 active+clean; 9.3 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 384 op/s 2023-07-21T22:34:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:04 smithi187 ceph-mon[96918]: pgmap v465: 97 pgs: 97 active+clean; 9.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 589 op/s 2023-07-21T22:34:04.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:04 smithi195 ceph-mon[97365]: pgmap v465: 97 pgs: 97 active+clean; 9.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 589 op/s 2023-07-21T22:34:04.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:04 smithi151 ceph-mon[95510]: pgmap v465: 97 pgs: 97 active+clean; 9.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 589 op/s 2023-07-21T22:34:05.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:05 smithi187 ceph-mon[96918]: osdmap e105: 12 total, 12 up, 12 in 2023-07-21T22:34:05.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:05 smithi195 ceph-mon[97365]: osdmap e105: 12 total, 12 up, 12 in 2023-07-21T22:34:05.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:05 smithi151 ceph-mon[95510]: osdmap e105: 12 total, 12 up, 12 in 2023-07-21T22:34:06.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:06 smithi187 ceph-mon[96918]: pgmap v467: 97 pgs: 97 active+clean; 9.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 3.5 MiB/s wr, 470 op/s 2023-07-21T22:34:06.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:06 smithi195 ceph-mon[97365]: pgmap v467: 97 pgs: 97 active+clean; 9.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 3.5 MiB/s wr, 470 op/s 2023-07-21T22:34:06.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:06 smithi151 ceph-mon[95510]: pgmap v467: 97 pgs: 97 active+clean; 9.3 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 3.5 MiB/s wr, 470 op/s 2023-07-21T22:34:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:08 smithi187 ceph-mon[96918]: pgmap v468: 97 pgs: 97 active+clean; 8.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:34:08.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:08 smithi195 ceph-mon[97365]: pgmap v468: 97 pgs: 97 active+clean; 8.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:34:08.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:08 smithi151 ceph-mon[95510]: pgmap v468: 97 pgs: 97 active+clean; 8.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:34:10.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:10 smithi187 ceph-mon[96918]: pgmap v469: 97 pgs: 97 active+clean; 8.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:34:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:10 smithi195 ceph-mon[97365]: pgmap v469: 97 pgs: 97 active+clean; 8.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:34:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:10 smithi151 ceph-mon[95510]: pgmap v469: 97 pgs: 97 active+clean; 8.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:34:12.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:12 smithi187 ceph-mon[96918]: pgmap v470: 97 pgs: 97 active+clean; 8.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:34:12.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:12 smithi187 ceph-mon[96918]: osdmap e106: 12 total, 12 up, 12 in 2023-07-21T22:34:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:12 smithi195 ceph-mon[97365]: pgmap v470: 97 pgs: 97 active+clean; 8.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:34:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:12 smithi195 ceph-mon[97365]: osdmap e106: 12 total, 12 up, 12 in 2023-07-21T22:34:12.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:12 smithi151 ceph-mon[95510]: pgmap v470: 97 pgs: 97 active+clean; 8.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:34:12.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:12 smithi151 ceph-mon[95510]: osdmap e106: 12 total, 12 up, 12 in 2023-07-21T22:34:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.843+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/3015337007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ec40ffb30 msgr2=0x7f3ec40fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.843+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/3015337007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ec40ffb30 0x7f3ec40fffa0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f3eb4009990 tx=0x7f3eb4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.843+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/3015337007 shutdown_connections 2023-07-21T22:34:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.843+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/3015337007 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ec41004e0 0x7f3ec410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.843+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/3015337007 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ec4105b60 0x7f3ec4105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.843+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/3015337007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ec40ffb30 0x7f3ec40fffa0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.843+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/3015337007 >> 172.21.15.151:0/3015337007 conn(0x7f3ec40fb5f0 msgr2=0x7f3ec40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.844+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/3015337007 shutdown_connections 2023-07-21T22:34:13.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.844+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/3015337007 wait complete. 2023-07-21T22:34:13.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.845+0000 7f3ecb9ff700 1 Processor -- start 2023-07-21T22:34:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.845+0000 7f3ecb9ff700 1 -- start start 2023-07-21T22:34:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ecb9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ec40ffb30 0x7f3ec419ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ecb9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ec41004e0 0x7f3ec419bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ecb9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ec4105b60 0x7f3ec41958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ecb9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4195f40 con 0x7f3ec4105b60 2023-07-21T22:34:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ecb9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec41960b0 con 0x7f3ec41004e0 2023-07-21T22:34:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ecb9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ec4196270 con 0x7f3ec40ffb30 2023-07-21T22:34:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ec979b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ec40ffb30 0x7f3ec419ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ec979b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ec40ffb30 0x7f3ec419ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:44714/0 (socket says 172.21.15.151:44714) 2023-07-21T22:34:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ec979b700 1 -- 172.21.15.151:0/2554714236 learned_addr learned my addr 172.21.15.151:0/2554714236 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ec8f9a700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ec41004e0 0x7f3ec419bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.846+0000 7f3ec9f9c700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ec4105b60 0x7f3ec41958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3ec979b700 1 -- 172.21.15.151:0/2554714236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ec41004e0 msgr2=0x7f3ec419bfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3ec979b700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ec41004e0 0x7f3ec419bfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3ec979b700 1 -- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ec4105b60 msgr2=0x7f3ec41958d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3ec979b700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ec4105b60 0x7f3ec41958d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3ec979b700 1 -- 172.21.15.151:0/2554714236 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40095f0 con 0x7f3ec40ffb30 2023-07-21T22:34:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3ec979b700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ec40ffb30 0x7f3ec419ba70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000e9a0 tx=0x7f3ec000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3eba7fc700 1 -- 172.21.15.151:0/2554714236 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0009790 con 0x7f3ec40ffb30 2023-07-21T22:34:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3eba7fc700 1 -- 172.21.15.151:0/2554714236 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ec0010430 con 0x7f3ec40ffb30 2023-07-21T22:34:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/2554714236 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ec4196550 con 0x7f3ec40ffb30 2023-07-21T22:34:13.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.847+0000 7f3eba7fc700 1 -- 172.21.15.151:0/2554714236 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec000cea0 con 0x7f3ec40ffb30 2023-07-21T22:34:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.848+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/2554714236 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec41a2a60 con 0x7f3ec40ffb30 2023-07-21T22:34:13.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.851+0000 7f3eba7fc700 1 -- 172.21.15.151:0/2554714236 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f3ec00105a0 con 0x7f3ec40ffb30 2023-07-21T22:34:13.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.852+0000 7f3edf396b80 1 Processor -- start 2023-07-21T22:34:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3edf396b80 1 -- start start 2023-07-21T22:34:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715c236b0 0x55e715dd10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715dcb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1a70 0x55e715dcb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3edf396b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715cccc50 con 0x55e715dd1a70 2023-07-21T22:34:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3edf396b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715d1f9e0 con 0x55e715dd1620 2023-07-21T22:34:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3edf396b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715d18e70 con 0x55e715c236b0 2023-07-21T22:34:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3eba7fc700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3eb00a12c0 0x7f3eb00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3ec979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715dcb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.853+0000 7f3ec979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715dcb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:32888/0 (socket says 172.21.15.151:32888) 2023-07-21T22:34:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec979b700 1 -- 172.21.15.151:0/1999557220 learned_addr learned my addr 172.21.15.151:0/1999557220 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec9f9c700 1 --2- 172.21.15.151:0/1999557220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715c236b0 0x55e715dd10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec8f9a700 1 --2- 172.21.15.151:0/1999557220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1a70 0x55e715dcb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3eba7fc700 1 -- 172.21.15.151:0/2554714236 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3ec0014070 con 0x7f3ec40ffb30 2023-07-21T22:34:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec9f9c700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3eb00a12c0 0x7f3eb00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec979b700 1 -- 172.21.15.151:0/1999557220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715c236b0 msgr2=0x55e715dd10e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec979b700 1 --2- 172.21.15.151:0/1999557220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715c236b0 0x55e715dd10e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec979b700 1 -- 172.21.15.151:0/1999557220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1a70 msgr2=0x55e715dcb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec979b700 1 --2- 172.21.15.151:0/1999557220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1a70 0x55e715dcb8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec979b700 1 -- 172.21.15.151:0/1999557220 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e715b46d80 con 0x55e715dd1620 2023-07-21T22:34:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.854+0000 7f3ec979b700 1 --2- 172.21.15.151:0/1999557220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715dcb350 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00a1f60 tx=0x7f3ec006c0b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dc4acfd9f611025 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3eaf7fe700 1 -- 172.21.15.151:0/1999557220 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec009e070 con 0x55e715dd1620 2023-07-21T22:34:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3eaf7fe700 1 -- 172.21.15.151:0/1999557220 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ec00a2490 con 0x55e715dd1620 2023-07-21T22:34:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3eaf7fe700 1 -- 172.21.15.151:0/1999557220 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec0099530 con 0x55e715dd1620 2023-07-21T22:34:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3edf396b80 1 -- 172.21.15.151:0/1999557220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 msgr2=0x55e715dcb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3ec9f9c700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3eb00a12c0 0x7f3eb00a3770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009ec0 tx=0x7f3ebc00b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1999557220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715dcb350 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3ec00a1f60 tx=0x7f3ec006c0b0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3edf396b80 1 -- 172.21.15.151:0/1999557220 shutdown_connections 2023-07-21T22:34:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1999557220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1a70 0x55e715dcb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1999557220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715c236b0 0x55e715dd10e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1999557220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715dcb350 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.855+0000 7f3edf396b80 1 -- 172.21.15.151:0/1999557220 >> 172.21.15.151:0/1999557220 conn(0x55e715dbcae0 msgr2=0x55e715dc20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:13.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.856+0000 7f3edf396b80 1 -- 172.21.15.151:0/1999557220 shutdown_connections 2023-07-21T22:34:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.856+0000 7f3edf396b80 1 -- 172.21.15.151:0/1999557220 wait complete. 2023-07-21T22:34:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.856+0000 7f3edf396b80 1 -- start start 2023-07-21T22:34:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.856+0000 7f3edf396b80 1 Processor -- start 2023-07-21T22:34:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715dd79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1620 0x55e715dd4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1a70 0x55e715dd5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3edf396b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715cb8a60 con 0x55e715c236b0 2023-07-21T22:34:13.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3edf396b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715cb8760 con 0x55e715dd1a70 2023-07-21T22:34:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3edf396b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715b9c8c0 con 0x55e715dd1620 2023-07-21T22:34:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3edf396b80 10 client.0 _ll_register_callbacks cb 0x55e715cb6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3ec979b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715dd79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3ec979b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715dd79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37174/0 (socket says 172.21.15.151:37174) 2023-07-21T22:34:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3ec979b700 1 -- 172.21.15.151:0/4052366998 learned_addr learned my addr 172.21.15.151:0/4052366998 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3ec8f9a700 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1620 0x55e715dd4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.857+0000 7f3ec9f9c700 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1a70 0x55e715dd5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3ec979b700 1 -- 172.21.15.151:0/4052366998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1620 msgr2=0x55e715dd4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3ec979b700 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1620 0x55e715dd4c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3ec979b700 1 -- 172.21.15.151:0/4052366998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1a70 msgr2=0x55e715dd5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3ec979b700 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1a70 0x55e715dd5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3ec979b700 1 -- 172.21.15.151:0/4052366998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec41a2a60 con 0x55e715c236b0 2023-07-21T22:34:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3ec979b700 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715dd79f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0096540 tx=0x7f3ec009a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d916d29f6e772b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:13.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3eacff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:34:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3eacff9700 1 -- 172.21.15.151:0/4052366998 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00b1070 con 0x55e715c236b0 2023-07-21T22:34:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3eacff9700 1 -- 172.21.15.151:0/4052366998 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3ec009e070 con 0x55e715c236b0 2023-07-21T22:34:13.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.858+0000 7f3edf396b80 1 -- 172.21.15.151:0/4052366998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e715c72490 con 0x55e715c236b0 2023-07-21T22:34:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3eacff9700 1 -- 172.21.15.151:0/4052366998 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ec0099e10 con 0x55e715c236b0 2023-07-21T22:34:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3edf396b80 10 client.17514 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3edf396b80 1 -- 172.21.15.151:0/4052366998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55e715b2fc00 con 0x55e715c236b0 2023-07-21T22:34:13.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3eacff9700 1 -- 172.21.15.151:0/4052366998 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ec00c8080 con 0x55e715c236b0 2023-07-21T22:34:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3eacff9700 1 -- 172.21.15.151:0/4052366998 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3ec0095e30 con 0x55e715c236b0 2023-07-21T22:34:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3edf396b80 10 client.17514 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3edf396b80 10 client.17514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:13.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3edf396b80 20 client.17514 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3edf396b80 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e715de4a50 0x55e715de6e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3edf396b80 4 client.17514 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:34:13.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.859+0000 7f3edf396b80 1 -- 172.21.15.151:0/4052366998 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e715d11e50 con 0x55e715de4a50 2023-07-21T22:34:13.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.860+0000 7f3ec8f9a700 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e715de4a50 0x55e715de6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.860+0000 7f3ec8f9a700 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e715de4a50 0x55e715de6e60 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d4e6167b480d030 server_cookie=d0139f8fb055f3e7 in_seq=0 out_seq=0 2023-07-21T22:34:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.860+0000 7f3eacff9700 10 client.17514 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3eacff9700 1 -- 172.21.15.151:0/4052366998 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e715d11e50 con 0x55e715de4a50 2023-07-21T22:34:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3eacff9700 10 client.17514 handle_command_reply: tid=0 2023-07-21T22:34:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 client.17514 shutdown 2023-07-21T22:34:13.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 -- 172.21.15.151:0/4052366998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 msgr2=0x55e715dd79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715dd79f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f3ec0096540 tx=0x7f3ec009a550 comp rx=0 tx=0).stop 2023-07-21T22:34:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 -- 172.21.15.151:0/4052366998 shutdown_connections 2023-07-21T22:34:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e715de4a50 0x55e715de6e60 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1a70 0x55e715dd5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715dd79f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3eacff9700 0 client.17514 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:13.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 --2- 172.21.15.151:0/4052366998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1620 0x55e715dd4c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 -- 172.21.15.151:0/4052366998 >> 172.21.15.151:0/4052366998 conn(0x55e715dbcae0 msgr2=0x55e715dc13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.861+0000 7f3edf396b80 1 -- 172.21.15.151:0/4052366998 shutdown_connections 2023-07-21T22:34:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.862+0000 7f3edf396b80 1 -- 172.21.15.151:0/4052366998 wait complete. 2023-07-21T22:34:13.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.862+0000 7f3edf396b80 20 client.17514 trim_cache size 0 max 16384 2023-07-21T22:34:13.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.882+0000 7f3edf396b80 1 Processor -- start 2023-07-21T22:34:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3edf396b80 1 -- start start 2023-07-21T22:34:13.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715c236b0 0x55e715ddbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1620 0x55e715dd2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 0x55e715dd7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3edf396b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715dcc320 con 0x55e715dd1620 2023-07-21T22:34:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3edf396b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715dd10e0 con 0x55e715c236b0 2023-07-21T22:34:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3edf396b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715dd0cd0 con 0x55e715dd1a70 2023-07-21T22:34:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3ec8f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1620 0x55e715dd2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3ec979b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715c236b0 0x55e715ddbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3ec8f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1620 0x55e715dd2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37176/0 (socket says 172.21.15.151:37176) 2023-07-21T22:34:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3ec9f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 0x55e715dd7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.883+0000 7f3ec8f9a700 1 -- 172.21.15.151:0/1102081986 learned_addr learned my addr 172.21.15.151:0/1102081986 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3ec979b700 1 -- 172.21.15.151:0/1102081986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 msgr2=0x55e715dd7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3ec979b700 1 --2- 172.21.15.151:0/1102081986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 0x55e715dd7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3ec979b700 1 -- 172.21.15.151:0/1102081986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1620 msgr2=0x55e715dd2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3ec979b700 1 --2- 172.21.15.151:0/1102081986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1620 0x55e715dd2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3ec979b700 1 -- 172.21.15.151:0/1102081986 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e715b6d1f0 con 0x55e715c236b0 2023-07-21T22:34:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3ec8f9a700 1 --2- 172.21.15.151:0/1102081986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1620 0x55e715dd2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:13.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3ec979b700 1 --2- 172.21.15.151:0/1102081986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715c236b0 0x55e715ddbfb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000c510 tx=0x7f3ec0099ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=241994ff86a478af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3eaffff700 1 -- 172.21.15.151:0/1102081986 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00b1070 con 0x55e715c236b0 2023-07-21T22:34:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3eaffff700 1 -- 172.21.15.151:0/1102081986 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e715c72490 con 0x55e715c236b0 2023-07-21T22:34:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.884+0000 7f3eaffff700 1 -- 172.21.15.151:0/1102081986 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ec00b83d0 con 0x55e715c236b0 2023-07-21T22:34:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.885+0000 7f3edf396b80 1 -- 172.21.15.151:0/1102081986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715c236b0 msgr2=0x55e715ddbfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.885+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1102081986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715c236b0 0x55e715ddbfb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000c510 tx=0x7f3ec0099ad0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.885+0000 7f3edf396b80 1 -- 172.21.15.151:0/1102081986 shutdown_connections 2023-07-21T22:34:13.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.885+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1102081986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715c236b0 0x55e715ddbfb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.885+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1102081986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 0x55e715dd7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.885+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1102081986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715dd1620 0x55e715dd2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.885+0000 7f3edf396b80 1 -- 172.21.15.151:0/1102081986 >> 172.21.15.151:0/1102081986 conn(0x55e715dbcae0 msgr2=0x55e715dd1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.885+0000 7f3edf396b80 1 -- 172.21.15.151:0/1102081986 shutdown_connections 2023-07-21T22:34:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.885+0000 7f3edf396b80 1 -- 172.21.15.151:0/1102081986 wait complete. 2023-07-21T22:34:13.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.886+0000 7f3edf396b80 1 -- start start 2023-07-21T22:34:13.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.886+0000 7f3edf396b80 1 Processor -- start 2023-07-21T22:34:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715ddb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715ddbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3edf396b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 0x55e715dd8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3edf396b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715dd8b40 con 0x55e715c236b0 2023-07-21T22:34:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3edf396b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715dd8cb0 con 0x55e715dd1620 2023-07-21T22:34:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3edf396b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e715dd8e70 con 0x55e715dd1a70 2023-07-21T22:34:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3edf396b80 10 client.0 _ll_register_callbacks cb 0x7f3ebc0097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec979b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715ddb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec8f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715ddbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec979b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715ddb8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37186/0 (socket says 172.21.15.151:37186) 2023-07-21T22:34:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec8f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715ddbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:32918/0 (socket says 172.21.15.151:32918) 2023-07-21T22:34:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec979b700 1 -- 172.21.15.151:0/1204349376 learned_addr learned my addr 172.21.15.151:0/1204349376 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec9f9c700 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 0x55e715dd8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec8f9a700 1 -- 172.21.15.151:0/1204349376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 msgr2=0x55e715dd8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec8f9a700 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 0x55e715dd8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec8f9a700 1 -- 172.21.15.151:0/1204349376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 msgr2=0x55e715ddb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:13.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec8f9a700 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715ddb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec8f9a700 1 -- 172.21.15.151:0/1204349376 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ec410d220 con 0x55e715dd1620 2023-07-21T22:34:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.887+0000 7f3ec979b700 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715ddb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.888+0000 7f3ec8f9a700 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715ddbe10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55e715dd5a50 tx=0x7f3eb4005270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6f5dead040500a9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.888+0000 7f3eacff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:34:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.888+0000 7f3eacff9700 1 -- 172.21.15.151:0/1204349376 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb401d040 con 0x55e715dd1620 2023-07-21T22:34:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.888+0000 7f3eacff9700 1 -- 172.21.15.151:0/1204349376 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3eb400b910 con 0x55e715dd1620 2023-07-21T22:34:13.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.888+0000 7f3edf396b80 1 -- 172.21.15.151:0/1204349376 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ec00a2490 con 0x55e715dd1620 2023-07-21T22:34:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.888+0000 7f3eacff9700 1 -- 172.21.15.151:0/1204349376 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3eb400bad0 con 0x55e715dd1620 2023-07-21T22:34:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.888+0000 7f3edf396b80 10 client.27206 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.888+0000 7f3edf396b80 1 -- 172.21.15.151:0/1204349376 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55e715b2fc00 con 0x55e715dd1620 2023-07-21T22:34:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.889+0000 7f3eacff9700 1 -- 172.21.15.151:0/1204349376 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ec00a2490 con 0x55e715dd1620 2023-07-21T22:34:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.889+0000 7f3eacff9700 1 -- 172.21.15.151:0/1204349376 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3eb400f460 con 0x55e715dd1620 2023-07-21T22:34:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.889+0000 7f3edf396b80 10 client.27206 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.889+0000 7f3edf396b80 10 client.27206 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:13.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.889+0000 7f3edf396b80 20 client.27206 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.889+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e715e39a60 0x55e715e3be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.889+0000 7f3edf396b80 4 client.27206 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:34:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.889+0000 7f3edf396b80 1 -- 172.21.15.151:0/1204349376 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e715cd3ff0 con 0x55e715e39a60 2023-07-21T22:34:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.890+0000 7f3ec979b700 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e715e39a60 0x55e715e3be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.890+0000 7f3eacff9700 10 client.27206 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:13.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.890+0000 7f3ec979b700 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e715e39a60 0x55e715e3be70 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50c95ce064bd13dc server_cookie=b03ad7950d565207 in_seq=0 out_seq=0 2023-07-21T22:34:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3eacff9700 1 -- 172.21.15.151:0/1204349376 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e715cd3ff0 con 0x55e715e39a60 2023-07-21T22:34:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3eacff9700 10 client.27206 handle_command_reply: tid=0 2023-07-21T22:34:13.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 client.27206 shutdown 2023-07-21T22:34:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 -- 172.21.15.151:0/1204349376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 msgr2=0x55e715ddbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715ddbe10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x55e715dd5a50 tx=0x7f3eb4005270 comp rx=0 tx=0).stop 2023-07-21T22:34:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 -- 172.21.15.151:0/1204349376 shutdown_connections 2023-07-21T22:34:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e715e39a60 0x55e715e3be70 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e715dd1a70 0x55e715dd8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e715c236b0 0x55e715ddb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 --2- 172.21.15.151:0/1204349376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e715dd1620 0x55e715ddbe10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3eacff9700 0 client.27206 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 -- 172.21.15.151:0/1204349376 >> 172.21.15.151:0/1204349376 conn(0x55e715dbcae0 msgr2=0x55e715dd1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 -- 172.21.15.151:0/1204349376 shutdown_connections 2023-07-21T22:34:13.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.899+0000 7f3edf396b80 1 -- 172.21.15.151:0/1204349376 wait complete. 2023-07-21T22:34:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3edf396b80 20 client.27206 trim_cache size 0 max 16384 2023-07-21T22:34:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:34:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:34:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:34:13.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:34:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3eb00a12c0 msgr2=0x7f3eb00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3eb00a12c0 0x7f3eb00a3770 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f3ebc009ec0 tx=0x7f3ebc00b040 comp rx=0 tx=0).stop 2023-07-21T22:34:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/2554714236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ec40ffb30 msgr2=0x7f3ec419ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:13.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ec40ffb30 0x7f3ec419ba70 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3ec000e9a0 tx=0x7f3ec000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/2554714236 shutdown_connections 2023-07-21T22:34:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3eb00a12c0 0x7f3eb00a3770 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ec4105b60 0x7f3ec41958d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3ec40ffb30 0x7f3ec419ba70 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 --2- 172.21.15.151:0/2554714236 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ec41004e0 0x7f3ec419bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.900+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/2554714236 >> 172.21.15.151:0/2554714236 conn(0x7f3ec40fb5f0 msgr2=0x7f3ec4103730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.901+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/2554714236 shutdown_connections 2023-07-21T22:34:13.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:13.901+0000 7f3ecb9ff700 1 -- 172.21.15.151:0/2554714236 wait complete. 2023-07-21T22:34:14.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:14 smithi187 ceph-mon[96918]: pgmap v472: 97 pgs: 97 active+clean; 8.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.1 MiB/s wr, 532 op/s 2023-07-21T22:34:14.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:14 smithi195 ceph-mon[97365]: pgmap v472: 97 pgs: 97 active+clean; 8.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.1 MiB/s wr, 532 op/s 2023-07-21T22:34:14.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:14 smithi151 ceph-mon[95510]: pgmap v472: 97 pgs: 97 active+clean; 8.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.1 MiB/s wr, 532 op/s 2023-07-21T22:34:16.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:16 smithi187 ceph-mon[96918]: pgmap v473: 97 pgs: 97 active+clean; 8.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 3.5 MiB/s wr, 455 op/s 2023-07-21T22:34:16.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:16 smithi195 ceph-mon[97365]: pgmap v473: 97 pgs: 97 active+clean; 8.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 3.5 MiB/s wr, 455 op/s 2023-07-21T22:34:16.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:16 smithi151 ceph-mon[95510]: pgmap v473: 97 pgs: 97 active+clean; 8.9 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 3.5 MiB/s wr, 455 op/s 2023-07-21T22:34:18.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:18 smithi187 ceph-mon[96918]: pgmap v474: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:34:18.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:18 smithi195 ceph-mon[97365]: pgmap v474: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:34:18.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:18 smithi151 ceph-mon[95510]: pgmap v474: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:34:20.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:20 smithi187 ceph-mon[96918]: pgmap v475: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:34:20.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:20 smithi195 ceph-mon[97365]: pgmap v475: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:34:20.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:20 smithi151 ceph-mon[95510]: pgmap v475: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:34:22.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:22 smithi187 ceph-mon[96918]: pgmap v476: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:34:22.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:22 smithi195 ceph-mon[97365]: pgmap v476: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:34:22.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:22 smithi151 ceph-mon[95510]: pgmap v476: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.7 MiB/s wr, 480 op/s 2023-07-21T22:34:24.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:24 smithi187 ceph-mon[96918]: pgmap v477: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 601 op/s 2023-07-21T22:34:24.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:24 smithi195 ceph-mon[97365]: pgmap v477: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 601 op/s 2023-07-21T22:34:24.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:24 smithi151 ceph-mon[95510]: pgmap v477: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.6 MiB/s wr, 601 op/s 2023-07-21T22:34:26.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:26 smithi187 ceph-mon[96918]: pgmap v478: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:34:26.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:26 smithi195 ceph-mon[97365]: pgmap v478: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:34:26.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:26 smithi151 ceph-mon[95510]: pgmap v478: 97 pgs: 97 active+clean; 8.9 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:34:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.062+0000 7f7b20dff700 1 -- 172.21.15.151:0/3460518385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c0ffb30 msgr2=0x7f7b1c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.062+0000 7f7b20dff700 1 --2- 172.21.15.151:0/3460518385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c0ffb30 0x7f7b1c0fffa0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f7b10009990 tx=0x7f7b10009ca0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.062+0000 7f7b20dff700 1 -- 172.21.15.151:0/3460518385 shutdown_connections 2023-07-21T22:34:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.062+0000 7f7b20dff700 1 --2- 172.21.15.151:0/3460518385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b1c105b60 0x7f7b1c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.062+0000 7f7b20dff700 1 --2- 172.21.15.151:0/3460518385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b1c1004e0 0x7f7b1c10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.062+0000 7f7b20dff700 1 --2- 172.21.15.151:0/3460518385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c0ffb30 0x7f7b1c0fffa0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.062+0000 7f7b20dff700 1 -- 172.21.15.151:0/3460518385 >> 172.21.15.151:0/3460518385 conn(0x7f7b1c0fb5f0 msgr2=0x7f7b1c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.062+0000 7f7b20dff700 1 -- 172.21.15.151:0/3460518385 shutdown_connections 2023-07-21T22:34:27.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.062+0000 7f7b20dff700 1 -- 172.21.15.151:0/3460518385 wait complete. 2023-07-21T22:34:27.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.063+0000 7f7b20dff700 1 Processor -- start 2023-07-21T22:34:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.063+0000 7f7b20dff700 1 -- start start 2023-07-21T22:34:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b20dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b1c0ffb30 0x7f7b1c19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b20dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b1c1004e0 0x7f7b1c19bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b20dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c105b60 0x7f7b1c195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b20dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c195f80 con 0x7f7b1c105b60 2023-07-21T22:34:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b20dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c1960f0 con 0x7f7b1c1004e0 2023-07-21T22:34:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b20dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b1c1962b0 con 0x7f7b1c0ffb30 2023-07-21T22:34:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b19d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b1c1004e0 0x7f7b1c19bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b1ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c105b60 0x7f7b1c195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b19d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b1c1004e0 0x7f7b1c19bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54082/0 (socket says 172.21.15.151:54082) 2023-07-21T22:34:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b19d9b700 1 -- 172.21.15.151:0/4279816966 learned_addr learned my addr 172.21.15.151:0/4279816966 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.064+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b1c0ffb30 0x7f7b1c19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b1ad9d700 1 -- 172.21.15.151:0/4279816966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b1c0ffb30 msgr2=0x7f7b1c19bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b1ad9d700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b1c0ffb30 0x7f7b1c19bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b1ad9d700 1 -- 172.21.15.151:0/4279816966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b1c1004e0 msgr2=0x7f7b1c19bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b1ad9d700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b1c1004e0 0x7f7b1c19bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b1ad9d700 1 -- 172.21.15.151:0/4279816966 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b100095f0 con 0x7f7b1c105b60 2023-07-21T22:34:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b1c0ffb30 0x7f7b1c19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b1c1004e0 0x7f7b1c19bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:27.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b1ad9d700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c105b60 0x7f7b1c195910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400efc0 tx=0x7f7b1400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b0b7fe700 1 -- 172.21.15.151:0/4279816966 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14018070 con 0x7f7b1c105b60 2023-07-21T22:34:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b20dff700 1 -- 172.21.15.151:0/4279816966 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b1c196530 con 0x7f7b1c105b60 2023-07-21T22:34:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b0b7fe700 1 -- 172.21.15.151:0/4279816966 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b1400f040 con 0x7f7b1c105b60 2023-07-21T22:34:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b0b7fe700 1 -- 172.21.15.151:0/4279816966 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1400cc50 con 0x7f7b1c105b60 2023-07-21T22:34:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.065+0000 7f7b20dff700 1 -- 172.21.15.151:0/4279816966 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c1a2aa0 con 0x7f7b1c105b60 2023-07-21T22:34:27.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.069+0000 7f7b0b7fe700 1 -- 172.21.15.151:0/4279816966 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f7b14003a00 con 0x7f7b1c105b60 2023-07-21T22:34:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.070+0000 7f7b0b7fe700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7b040a12c0 0x7f7b040a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.070+0000 7f7b0b7fe700 1 -- 172.21.15.151:0/4279816966 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7b140cc910 con 0x7f7b1c105b60 2023-07-21T22:34:27.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.070+0000 7f7b346fcb80 1 Processor -- start 2023-07-21T22:34:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.070+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7b040a12c0 0x7f7b040a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b346fcb80 1 -- start start 2023-07-21T22:34:27.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a7ca6b0 0x55815a9780e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a972350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a978a70 0x55815a9728b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a873c50 con 0x55815a978620 2023-07-21T22:34:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a8c69e0 con 0x55815a978a70 2023-07-21T22:34:27.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a8bfe70 con 0x55815a7ca6b0 2023-07-21T22:34:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7b040a12c0 0x7f7b040a3770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009cb0 tx=0x7f7b0c009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b1ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a978a70 0x55815a9728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b19d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a972350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b1ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a978a70 0x55815a9728b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54098/0 (socket says 172.21.15.151:54098) 2023-07-21T22:34:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.071+0000 7f7b1ad9d700 1 -- 172.21.15.151:0/3767940756 learned_addr learned my addr 172.21.15.151:0/3767940756 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3767940756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a7ca6b0 0x55815a9780e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b1ad9d700 1 -- 172.21.15.151:0/3767940756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a7ca6b0 msgr2=0x55815a9780e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b1ad9d700 1 --2- 172.21.15.151:0/3767940756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a7ca6b0 0x55815a9780e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b1ad9d700 1 -- 172.21.15.151:0/3767940756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 msgr2=0x55815a972350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b1ad9d700 1 --2- 172.21.15.151:0/3767940756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a972350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b1ad9d700 1 -- 172.21.15.151:0/3767940756 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55815a6edd80 con 0x55815a978a70 2023-07-21T22:34:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/3767940756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a972350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b1ad9d700 1 --2- 172.21.15.151:0/3767940756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a978a70 0x55815a9728b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7b140964a0 tx=0x7f7b14099640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcf4e0ffadef7d23 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b08ff9700 1 -- 172.21.15.151:0/3767940756 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14099a30 con 0x55815a978a70 2023-07-21T22:34:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b08ff9700 1 -- 172.21.15.151:0/3767940756 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b1409ae90 con 0x55815a978a70 2023-07-21T22:34:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.072+0000 7f7b08ff9700 1 -- 172.21.15.151:0/3767940756 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b14099ed0 con 0x55815a978a70 2023-07-21T22:34:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.073+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3767940756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a978a70 msgr2=0x55815a9728b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.073+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3767940756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a978a70 0x55815a9728b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7b140964a0 tx=0x7f7b14099640 comp rx=0 tx=0).stop 2023-07-21T22:34:27.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.074+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3767940756 shutdown_connections 2023-07-21T22:34:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.074+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3767940756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a978a70 0x55815a9728b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.074+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3767940756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a7ca6b0 0x55815a9780e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.074+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3767940756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a972350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.074+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3767940756 >> 172.21.15.151:0/3767940756 conn(0x55815a963ae0 msgr2=0x55815a9690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.074+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3767940756 shutdown_connections 2023-07-21T22:34:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.074+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3767940756 wait complete. 2023-07-21T22:34:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.074+0000 7f7b346fcb80 1 -- start start 2023-07-21T22:34:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.074+0000 7f7b346fcb80 1 Processor -- start 2023-07-21T22:34:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a97e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a97bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978a70 0x55815a97c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a85fa60 con 0x55815a978620 2023-07-21T22:34:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a85f760 con 0x55815a7ca6b0 2023-07-21T22:34:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a7438c0 con 0x55815a978a70 2023-07-21T22:34:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b346fcb80 10 client.0 _ll_register_callbacks cb 0x55815a85d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b19d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a97bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b1a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a97e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b1a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a97e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54114/0 (socket says 172.21.15.151:54114) 2023-07-21T22:34:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.075+0000 7f7b1a59c700 1 -- 172.21.15.151:0/3828028287 learned_addr learned my addr 172.21.15.151:0/3828028287 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.076+0000 7f7b1ad9d700 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978a70 0x55815a97c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.076+0000 7f7b19d9b700 1 -- 172.21.15.151:0/3828028287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978a70 msgr2=0x55815a97c420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.076+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978a70 0x55815a97c420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.076+0000 7f7b19d9b700 1 -- 172.21.15.151:0/3828028287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 msgr2=0x55815a97e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.076+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a97e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.076+0000 7f7b19d9b700 1 -- 172.21.15.151:0/3828028287 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c10d220 con 0x55815a978620 2023-07-21T22:34:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.076+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a97e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.076+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a97bce0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7b10006010 tx=0x7f7b10005270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbd022b10c1b2e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.076+0000 7f7b01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:34:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.077+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3828028287 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1001d070 con 0x55815a978620 2023-07-21T22:34:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.077+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3828028287 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55815a819490 con 0x55815a978620 2023-07-21T22:34:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.077+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3828028287 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7b100056c0 con 0x55815a978620 2023-07-21T22:34:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.077+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3828028287 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b10004910 con 0x55815a978620 2023-07-21T22:34:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.077+0000 7f7b346fcb80 10 client.17532 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.077+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3828028287 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x7f7b1c1a2aa0 con 0x55815a978620 2023-07-21T22:34:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.077+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3828028287 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b10033020 con 0x55815a978620 2023-07-21T22:34:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.078+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3828028287 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7b1000fc00 con 0x55815a978620 2023-07-21T22:34:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.078+0000 7f7b346fcb80 10 client.17532 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.078+0000 7f7b346fcb80 10 client.17532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.078+0000 7f7b346fcb80 20 client.17532 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.078+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55815a98bfe0 0x55815a98e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.078+0000 7f7b346fcb80 4 client.17532 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:34:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.078+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3828028287 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55815a8b8e50 con 0x55815a98bfe0 2023-07-21T22:34:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.078+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55815a98bfe0 0x55815a98e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.079+0000 7f7b01ffb700 10 client.17532 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:27.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.079+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55815a98bfe0 0x55815a98e3f0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f99fb191600a9abf server_cookie=ae4390797278af90 in_seq=0 out_seq=0 2023-07-21T22:34:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.079+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3828028287 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55815a8b8e50 con 0x55815a98bfe0 2023-07-21T22:34:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.079+0000 7f7b01ffb700 10 client.17532 handle_command_reply: tid=0 2023-07-21T22:34:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.079+0000 7f7b346fcb80 1 client.17532 shutdown 2023-07-21T22:34:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3828028287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 msgr2=0x55815a97bce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a97bce0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f7b10006010 tx=0x7f7b10005270 comp rx=0 tx=0).stop 2023-07-21T22:34:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3828028287 shutdown_connections 2023-07-21T22:34:27.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55815a98bfe0 0x55815a98e3f0 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a97e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978a70 0x55815a97c420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b01ffb700 0 client.17532 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3828028287 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978620 0x55815a97bce0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3828028287 >> 172.21.15.151:0/3828028287 conn(0x55815a963ae0 msgr2=0x55815a96cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3828028287 shutdown_connections 2023-07-21T22:34:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3828028287 wait complete. 2023-07-21T22:34:27.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.080+0000 7f7b346fcb80 20 client.17532 trim_cache size 0 max 16384 2023-07-21T22:34:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.096+0000 7f7b346fcb80 1 Processor -- start 2023-07-21T22:34:27.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.096+0000 7f7b346fcb80 1 -- start start 2023-07-21T22:34:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.096+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a977650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.096+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 0x55815a9815b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.096+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 0x55815a96d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.096+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a972e10 con 0x55815a978a70 2023-07-21T22:34:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.096+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a969f10 con 0x55815a7ca6b0 2023-07-21T22:34:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.096+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a98ea50 con 0x55815a978620 2023-07-21T22:34:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a977650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a977650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54126/0 (socket says 172.21.15.151:54126) 2023-07-21T22:34:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1a59c700 1 -- 172.21.15.151:0/3514795494 learned_addr learned my addr 172.21.15.151:0/3514795494 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:27.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1ad9d700 1 --2- 172.21.15.151:0/3514795494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 0x55815a96d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/3514795494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 0x55815a9815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1a59c700 1 -- 172.21.15.151:0/3514795494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 msgr2=0x55815a9815b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3514795494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 0x55815a9815b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1a59c700 1 -- 172.21.15.151:0/3514795494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 msgr2=0x55815a96d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3514795494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 0x55815a96d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1a59c700 1 -- 172.21.15.151:0/3514795494 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55815a6d6c00 con 0x55815a7ca6b0 2023-07-21T22:34:27.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.097+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3514795494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a977650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c011a50 tx=0x7f7b0c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=262fa0f669235539 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.098+0000 7f7b097fa700 1 -- 172.21.15.151:0/3514795494 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c026040 con 0x55815a7ca6b0 2023-07-21T22:34:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.098+0000 7f7b097fa700 1 -- 172.21.15.151:0/3514795494 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b0c02b310 con 0x55815a7ca6b0 2023-07-21T22:34:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.098+0000 7f7b097fa700 1 -- 172.21.15.151:0/3514795494 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c0126b0 con 0x55815a7ca6b0 2023-07-21T22:34:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.098+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3514795494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 msgr2=0x55815a977650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.098+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3514795494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a977650 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c011a50 tx=0x7f7b0c014000 comp rx=0 tx=0).stop 2023-07-21T22:34:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.099+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3514795494 shutdown_connections 2023-07-21T22:34:27.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.099+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3514795494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a977650 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.099+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3514795494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 0x55815a96d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.099+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3514795494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 0x55815a9815b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.099+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3514795494 >> 172.21.15.151:0/3514795494 conn(0x55815a963ae0 msgr2=0x55815a96cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.099+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3514795494 shutdown_connections 2023-07-21T22:34:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.099+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3514795494 wait complete. 2023-07-21T22:34:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.099+0000 7f7b346fcb80 1 -- start start 2023-07-21T22:34:27.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.099+0000 7f7b346fcb80 1 Processor -- start 2023-07-21T22:34:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a981360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 0x55815a97f650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b346fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 0x55815a97fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a9800d0 con 0x55815a978a70 2023-07-21T22:34:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a980240 con 0x55815a7ca6b0 2023-07-21T22:34:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b346fcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55815a980400 con 0x55815a978620 2023-07-21T22:34:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b346fcb80 10 client.0 _ll_register_callbacks cb 0x7f7b1000bdd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:27.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b1a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a981360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b1a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a981360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54130/0 (socket says 172.21.15.151:54130) 2023-07-21T22:34:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b1a59c700 1 -- 172.21.15.151:0/3540509915 learned_addr learned my addr 172.21.15.151:0/3540509915 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 0x55815a97f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.100+0000 7f7b1ad9d700 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 0x55815a97fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b1a59c700 1 -- 172.21.15.151:0/3540509915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 msgr2=0x55815a97f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 0x55815a97f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b1a59c700 1 -- 172.21.15.151:0/3540509915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 msgr2=0x55815a97fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 0x55815a97fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b1a59c700 1 -- 172.21.15.151:0/3540509915 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b0c004540 con 0x55815a7ca6b0 2023-07-21T22:34:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 0x55815a97f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b1a59c700 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a981360 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c003e80 tx=0x7f7b0c003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4471fb101c6d0f6e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b01ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:34:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3540509915 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b0c026050 con 0x55815a7ca6b0 2023-07-21T22:34:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3540509915 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7b0c018040 con 0x55815a7ca6b0 2023-07-21T22:34:27.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3540509915 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7b1409ae90 con 0x55815a7ca6b0 2023-07-21T22:34:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.101+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3540509915 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b0c003890 con 0x55815a7ca6b0 2023-07-21T22:34:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b346fcb80 10 client.27224 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3540509915 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55815a7141f0 con 0x55815a7ca6b0 2023-07-21T22:34:27.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3540509915 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7b1409ae90 con 0x55815a7ca6b0 2023-07-21T22:34:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3540509915 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7b0c034460 con 0x55815a7ca6b0 2023-07-21T22:34:27.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b346fcb80 10 client.27224 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b346fcb80 10 client.27224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b346fcb80 20 client.27224 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55815a9e1160 0x55815a9e3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b346fcb80 4 client.27224 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:34:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.102+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3540509915 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55815a87aff0 con 0x55815a9e1160 2023-07-21T22:34:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.103+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55815a9e1160 0x55815a9e3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:27.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.103+0000 7f7b19d9b700 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55815a9e1160 0x55815a9e3570 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64d8434550f170a1 server_cookie=79bd08a7ec143dae in_seq=0 out_seq=0 2023-07-21T22:34:27.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.103+0000 7f7b01ffb700 10 client.27224 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b01ffb700 1 -- 172.21.15.151:0/3540509915 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55815a87aff0 con 0x55815a9e1160 2023-07-21T22:34:27.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b01ffb700 10 client.27224 handle_command_reply: tid=0 2023-07-21T22:34:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 client.27224 shutdown 2023-07-21T22:34:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3540509915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 msgr2=0x55815a981360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a981360 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c003e80 tx=0x7f7b0c003eb0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3540509915 shutdown_connections 2023-07-21T22:34:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55815a9e1160 0x55815a9e3570 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55815a7ca6b0 0x55815a981360 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55815a978a70 0x55815a97fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 --2- 172.21.15.151:0/3540509915 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55815a978620 0x55815a97f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b01ffb700 0 client.27224 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3540509915 >> 172.21.15.151:0/3540509915 conn(0x55815a963ae0 msgr2=0x55815a96d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3540509915 shutdown_connections 2023-07-21T22:34:27.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.113+0000 7f7b346fcb80 1 -- 172.21.15.151:0/3540509915 wait complete. 2023-07-21T22:34:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b346fcb80 20 client.27224 trim_cache size 0 max 16384 2023-07-21T22:34:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:34:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:34:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:34:27.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:34:27.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 -- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7b040a12c0 msgr2=0x7f7b040a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7b040a12c0 0x7f7b040a3770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009cb0 tx=0x7f7b0c009260 comp rx=0 tx=0).stop 2023-07-21T22:34:27.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 -- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c105b60 msgr2=0x7f7b1c195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:27.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c105b60 0x7f7b1c195910 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f7b1400efc0 tx=0x7f7b1400c3a0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 -- 172.21.15.151:0/4279816966 shutdown_connections 2023-07-21T22:34:27.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7b040a12c0 0x7f7b040a3770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c105b60 0x7f7b1c195910 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7b1c0ffb30 0x7f7b1c19bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 --2- 172.21.15.151:0/4279816966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b1c1004e0 0x7f7b1c19bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:27.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.114+0000 7f7b20dff700 1 -- 172.21.15.151:0/4279816966 >> 172.21.15.151:0/4279816966 conn(0x7f7b1c0fb5f0 msgr2=0x7f7b1c1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:27.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.115+0000 7f7b20dff700 1 -- 172.21.15.151:0/4279816966 shutdown_connections 2023-07-21T22:34:27.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:27.115+0000 7f7b20dff700 1 -- 172.21.15.151:0/4279816966 wait complete. 2023-07-21T22:34:28.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:28 smithi187 ceph-mon[96918]: pgmap v479: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 587 op/s 2023-07-21T22:34:28.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:28 smithi195 ceph-mon[97365]: pgmap v479: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 587 op/s 2023-07-21T22:34:28.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:28 smithi151 ceph-mon[95510]: pgmap v479: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.5 MiB/s wr, 587 op/s 2023-07-21T22:34:30.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:30 smithi187 ceph-mon[96918]: pgmap v480: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 376 op/s 2023-07-21T22:34:30.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:30 smithi195 ceph-mon[97365]: pgmap v480: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 376 op/s 2023-07-21T22:34:30.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:30 smithi151 ceph-mon[95510]: pgmap v480: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 376 op/s 2023-07-21T22:34:32.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:32 smithi187 ceph-mon[96918]: pgmap v481: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 376 op/s 2023-07-21T22:34:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:32 smithi195 ceph-mon[97365]: pgmap v481: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 376 op/s 2023-07-21T22:34:32.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:32 smithi151 ceph-mon[95510]: pgmap v481: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.9 MiB/s wr, 376 op/s 2023-07-21T22:34:34.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:34 smithi187 ceph-mon[96918]: pgmap v482: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.4 MiB/s wr, 571 op/s 2023-07-21T22:34:34.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:34 smithi195 ceph-mon[97365]: pgmap v482: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.4 MiB/s wr, 571 op/s 2023-07-21T22:34:34.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:34 smithi151 ceph-mon[95510]: pgmap v482: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 4.4 MiB/s wr, 571 op/s 2023-07-21T22:34:36.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:36 smithi187 ceph-mon[96918]: pgmap v483: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-07-21T22:34:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:36 smithi195 ceph-mon[97365]: pgmap v483: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-07-21T22:34:36.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:36 smithi151 ceph-mon[95510]: pgmap v483: 97 pgs: 97 active+clean; 8.9 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-07-21T22:34:38.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:38 smithi187 ceph-mon[96918]: pgmap v484: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 587 op/s 2023-07-21T22:34:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:38 smithi195 ceph-mon[97365]: pgmap v484: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 587 op/s 2023-07-21T22:34:38.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:38 smithi151 ceph-mon[95510]: pgmap v484: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.5 MiB/s wr, 587 op/s 2023-07-21T22:34:40.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.275+0000 7f9abf1ff700 1 -- 172.21.15.151:0/1014086496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab8101fb0 msgr2=0x7f9ab8102380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.275+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/1014086496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab8101fb0 0x7f9ab8102380 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0099c0 tx=0x7f9aac009cd0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.275+0000 7f9abf1ff700 1 -- 172.21.15.151:0/1014086496 shutdown_connections 2023-07-21T22:34:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.275+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/1014086496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ab8106ff0 0x7f9ab810ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.275+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/1014086496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab8101fb0 0x7f9ab8102380 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.275+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/1014086496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8102950 0x7f9ab8106910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.275+0000 7f9abf1ff700 1 -- 172.21.15.151:0/1014086496 >> 172.21.15.151:0/1014086496 conn(0x7f9ab80fd800 msgr2=0x7f9ab80ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.275+0000 7f9abf1ff700 1 -- 172.21.15.151:0/1014086496 shutdown_connections 2023-07-21T22:34:40.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.275+0000 7f9abf1ff700 1 -- 172.21.15.151:0/1014086496 wait complete. 2023-07-21T22:34:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.276+0000 7f9abf1ff700 1 Processor -- start 2023-07-21T22:34:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.276+0000 7f9abf1ff700 1 -- start start 2023-07-21T22:34:40.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abf1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ab8101fb0 0x7f9ab8197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abf1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab8102950 0x7f9ab8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abf1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8106ff0 0x7f9ab819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abf1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab819d040 con 0x7f9ab8102950 2023-07-21T22:34:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abf1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab819d1b0 con 0x7f9ab8101fb0 2023-07-21T22:34:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abf1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ab819d370 con 0x7f9ab8106ff0 2023-07-21T22:34:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9ab7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab8102950 0x7f9ab8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abcf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ab8101fb0 0x7f9ab8197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9ab7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab8102950 0x7f9ab8198390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45096/0 (socket says 172.21.15.151:45096) 2023-07-21T22:34:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9ab7fff700 1 -- 172.21.15.151:0/3528819046 learned_addr learned my addr 172.21.15.151:0/3528819046 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abd79c700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8106ff0 0x7f9ab819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abcf9b700 1 -- 172.21.15.151:0/3528819046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8106ff0 msgr2=0x7f9ab819ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8106ff0 0x7f9ab819ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abcf9b700 1 -- 172.21.15.151:0/3528819046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab8102950 msgr2=0x7f9ab8198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:40.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab8102950 0x7f9ab8198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.277+0000 7f9abcf9b700 1 -- 172.21.15.151:0/3528819046 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9aac0095f0 con 0x7f9ab8101fb0 2023-07-21T22:34:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.278+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ab8101fb0 0x7f9ab8197e50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009990 tx=0x7f9aac00f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.278+0000 7f9ab5ffb700 1 -- 172.21.15.151:0/3528819046 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac01d070 con 0x7f9ab8101fb0 2023-07-21T22:34:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.278+0000 7f9ab5ffb700 1 -- 172.21.15.151:0/3528819046 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9aac005030 con 0x7f9ab8101fb0 2023-07-21T22:34:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.278+0000 7f9abf1ff700 1 -- 172.21.15.151:0/3528819046 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ab819d5f0 con 0x7f9ab8101fb0 2023-07-21T22:34:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.278+0000 7f9ab5ffb700 1 -- 172.21.15.151:0/3528819046 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac004950 con 0x7f9ab8101fb0 2023-07-21T22:34:40.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.278+0000 7f9abf1ff700 1 -- 172.21.15.151:0/3528819046 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab81a4e90 con 0x7f9ab8101fb0 2023-07-21T22:34:40.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.282+0000 7f9ab5ffb700 1 -- 172.21.15.151:0/3528819046 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f9aac005410 con 0x7f9ab8101fb0 2023-07-21T22:34:40.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.283+0000 7f9ab5ffb700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9aa80a12c0 0x7f9aa80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.283+0000 7f9ad2b8fb80 1 Processor -- start 2023-07-21T22:34:40.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.283+0000 7f9ab5ffb700 1 -- 172.21.15.151:0/3528819046 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9aac0cd820 con 0x7f9ab8101fb0 2023-07-21T22:34:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.283+0000 7f9ad2b8fb80 1 -- start start 2023-07-21T22:34:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9aa80a12c0 0x7f9aa80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d133cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d12df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d12e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d033c50 con 0x557d8d134660 2023-07-21T22:34:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d0869e0 con 0x557d8cf8a6b0 2023-07-21T22:34:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d07fe70 con 0x557d8d134210 2023-07-21T22:34:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9abcf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d133cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9abcf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d133cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53100/0 (socket says 172.21.15.151:53100) 2023-07-21T22:34:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9abcf9b700 1 -- 172.21.15.151:0/3103064790 learned_addr learned my addr 172.21.15.151:0/3103064790 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:40.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.284+0000 7f9abd79c700 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d12e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d12df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9abcf9b700 1 -- 172.21.15.151:0/3103064790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 msgr2=0x557d8d12df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d12df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9abcf9b700 1 -- 172.21.15.151:0/3103064790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 msgr2=0x557d8d12e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d12e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9abcf9b700 1 -- 172.21.15.151:0/3103064790 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d8ceadd80 con 0x557d8cf8a6b0 2023-07-21T22:34:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9abd79c700 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d12e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:40.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9aa80a12c0 0x7f9aa80a3770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8199670 tx=0x7f9aa40119c0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:40.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d133cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9aac097410 tx=0x7f9aac09a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd9a088360e5344f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9aa2ffd700 1 -- 172.21.15.151:0/3103064790 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0a2d60 con 0x557d8cf8a6b0 2023-07-21T22:34:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9aa2ffd700 1 -- 172.21.15.151:0/3103064790 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9aac0051a0 con 0x557d8cf8a6b0 2023-07-21T22:34:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.285+0000 7f9aa2ffd700 1 -- 172.21.15.151:0/3103064790 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac09a0f0 con 0x557d8cf8a6b0 2023-07-21T22:34:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.286+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3103064790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 msgr2=0x557d8d133cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.286+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d133cd0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9aac097410 tx=0x7f9aac09a300 comp rx=0 tx=0).stop 2023-07-21T22:34:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.286+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3103064790 shutdown_connections 2023-07-21T22:34:40.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.286+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d133cd0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.286+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d12e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.286+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3103064790 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d12df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.286+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3103064790 >> 172.21.15.151:0/3103064790 conn(0x557d8d123ae0 msgr2=0x557d8d1290e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.286+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3103064790 shutdown_connections 2023-07-21T22:34:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.286+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3103064790 wait complete. 2023-07-21T22:34:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.287+0000 7f9ad2b8fb80 1 -- start start 2023-07-21T22:34:40.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.287+0000 7f9ad2b8fb80 1 Processor -- start 2023-07-21T22:34:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d1375b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d01fa60 con 0x557d8d134660 2023-07-21T22:34:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d01f760 con 0x557d8cf8a6b0 2023-07-21T22:34:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8cf038c0 con 0x557d8d134210 2023-07-21T22:34:40.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9ad2b8fb80 10 client.0 _ll_register_callbacks cb 0x557d8d01d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9abcf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9abcf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53110/0 (socket says 172.21.15.151:53110) 2023-07-21T22:34:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9abcf9b700 1 -- 172.21.15.151:0/1994588142 learned_addr learned my addr 172.21.15.151:0/1994588142 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9abd79c700 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d1375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.288+0000 7f9abcf9b700 1 -- 172.21.15.151:0/1994588142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 msgr2=0x557d8d13d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9abcf9b700 1 -- 172.21.15.151:0/1994588142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 msgr2=0x557d8d1375b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d1375b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9abcf9b700 1 -- 172.21.15.151:0/1994588142 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ab81a4e90 con 0x557d8cf8a6b0 2023-07-21T22:34:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9abd79c700 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d1375b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:34:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13d2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9aac096e50 tx=0x7f9aac09a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5cabc888b1477842 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9a97fff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:34:40.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9a97fff700 1 -- 172.21.15.151:0/1994588142 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0a2d60 con 0x557d8cf8a6b0 2023-07-21T22:34:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9a97fff700 1 -- 172.21.15.151:0/1994588142 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9aac09ac00 con 0x557d8cf8a6b0 2023-07-21T22:34:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/1994588142 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d8cfd9490 con 0x557d8cf8a6b0 2023-07-21T22:34:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9a97fff700 1 -- 172.21.15.151:0/1994588142 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aac09adc0 con 0x557d8cf8a6b0 2023-07-21T22:34:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9ad2b8fb80 10 client.27236 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:40.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.289+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/1994588142 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x557d8ce96c00 con 0x557d8cf8a6b0 2023-07-21T22:34:40.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.290+0000 7f9a97fff700 1 -- 172.21.15.151:0/1994588142 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557d8cfd9490 con 0x557d8cf8a6b0 2023-07-21T22:34:40.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.290+0000 7f9a97fff700 1 -- 172.21.15.151:0/1994588142 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9aac096790 con 0x557d8cf8a6b0 2023-07-21T22:34:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.290+0000 7f9ad2b8fb80 10 client.27236 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.290+0000 7f9ad2b8fb80 10 client.27236 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.290+0000 7f9ad2b8fb80 20 client.27236 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:40.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.290+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557d8d147310 0x557d8d1496f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.290+0000 7f9ad2b8fb80 4 client.27236 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:34:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.290+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/1994588142 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d8d078e50 con 0x557d8d147310 2023-07-21T22:34:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.290+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557d8d147310 0x557d8d1496f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.291+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557d8d147310 0x557d8d1496f0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ed939189302ad86 server_cookie=b0ecdda859e80ee1 in_seq=0 out_seq=0 2023-07-21T22:34:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.291+0000 7f9a97fff700 10 client.27236 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:40.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9a97fff700 1 -- 172.21.15.151:0/1994588142 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557d8d078e50 con 0x557d8d147310 2023-07-21T22:34:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9a97fff700 10 client.27236 handle_command_reply: tid=0 2023-07-21T22:34:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 client.27236 shutdown 2023-07-21T22:34:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/1994588142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 msgr2=0x557d8d13d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13d2f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f9aac096e50 tx=0x7f9aac09a250 comp rx=0 tx=0).stop 2023-07-21T22:34:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/1994588142 shutdown_connections 2023-07-21T22:34:40.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557d8d147310 0x557d8d1496f0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13d2f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d1375b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9a97fff700 0 client.27236 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/1994588142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/1994588142 >> 172.21.15.151:0/1994588142 conn(0x557d8d123ae0 msgr2=0x557d8d1283e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/1994588142 shutdown_connections 2023-07-21T22:34:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.292+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/1994588142 wait complete. 2023-07-21T22:34:40.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.293+0000 7f9ad2b8fb80 20 client.27236 trim_cache size 0 max 16384 2023-07-21T22:34:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.310+0000 7f9ad2b8fb80 1 Processor -- start 2023-07-21T22:34:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.310+0000 7f9ad2b8fb80 1 -- start start 2023-07-21T22:34:40.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.310+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8cf8a6b0 0x557d8d137520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.310+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134210 0x557d8d1364e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.310+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8d134660 0x557d8d128b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.310+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d12f160 con 0x557d8d134210 2023-07-21T22:34:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.310+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d138b20 con 0x557d8d134660 2023-07-21T22:34:40.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.310+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d135b80 con 0x557d8cf8a6b0 2023-07-21T22:34:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.310+0000 7f9abd79c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8d134660 0x557d8d128b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9ab7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134210 0x557d8d1364e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9abd79c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8d134660 0x557d8d128b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53126/0 (socket says 172.21.15.151:53126) 2023-07-21T22:34:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9abd79c700 1 -- 172.21.15.151:0/222969314 learned_addr learned my addr 172.21.15.151:0/222969314 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/222969314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8cf8a6b0 0x557d8d137520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9abcf9b700 1 -- 172.21.15.151:0/222969314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8d134660 msgr2=0x557d8d128b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/222969314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8d134660 0x557d8d128b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9abcf9b700 1 -- 172.21.15.151:0/222969314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134210 msgr2=0x557d8d1364e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/222969314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134210 0x557d8d1364e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9abcf9b700 1 -- 172.21.15.151:0/222969314 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d8d14e2b0 con 0x557d8cf8a6b0 2023-07-21T22:34:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/222969314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134210 0x557d8d1364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/222969314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8cf8a6b0 0x557d8d137520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0caff0 tx=0x7f9aac09eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aa8794e42c647204 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.311+0000 7f9aa37fe700 1 -- 172.21.15.151:0/222969314 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0a2d60 con 0x557d8cf8a6b0 2023-07-21T22:34:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.312+0000 7f9aa37fe700 1 -- 172.21.15.151:0/222969314 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9aac0c6050 con 0x557d8cf8a6b0 2023-07-21T22:34:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.312+0000 7f9aa37fe700 1 -- 172.21.15.151:0/222969314 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aac0cd640 con 0x557d8cf8a6b0 2023-07-21T22:34:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.312+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/222969314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8cf8a6b0 msgr2=0x557d8d137520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.312+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/222969314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8cf8a6b0 0x557d8d137520 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9aac0caff0 tx=0x7f9aac09eb50 comp rx=0 tx=0).stop 2023-07-21T22:34:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.312+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/222969314 shutdown_connections 2023-07-21T22:34:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.312+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/222969314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8d134660 0x557d8d128b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.312+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/222969314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8cf8a6b0 0x557d8d137520 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.312+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/222969314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134210 0x557d8d1364e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.312+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/222969314 >> 172.21.15.151:0/222969314 conn(0x557d8d123ae0 msgr2=0x557d8d135dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.313+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/222969314 shutdown_connections 2023-07-21T22:34:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.313+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/222969314 wait complete. 2023-07-21T22:34:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.313+0000 7f9ad2b8fb80 1 -- start start 2023-07-21T22:34:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.313+0000 7f9ad2b8fb80 1 Processor -- start 2023-07-21T22:34:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ad2b8fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d19a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d19a670 con 0x557d8d134660 2023-07-21T22:34:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d19a7b0 con 0x557d8cf8a6b0 2023-07-21T22:34:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ad2b8fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d8d19a8f0 con 0x557d8d134210 2023-07-21T22:34:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ad2b8fb80 10 client.0 _ll_register_callbacks cb 0x7f9aac09a500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9abcf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ab7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ab7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38088/0 (socket says 172.21.15.151:38088) 2023-07-21T22:34:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9abcf9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53132/0 (socket says 172.21.15.151:53132) 2023-07-21T22:34:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9ab7fff700 1 -- 172.21.15.151:0/3364138196 learned_addr learned my addr 172.21.15.151:0/3364138196 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.314+0000 7f9abd79c700 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d19a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9ab7fff700 1 -- 172.21.15.151:0/3364138196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 msgr2=0x557d8d13b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9ab7fff700 1 -- 172.21.15.151:0/3364138196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 msgr2=0x557d8d19a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:40.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d19a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9ab7fff700 1 -- 172.21.15.151:0/3364138196 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9aa4009d80 con 0x557d8d134210 2023-07-21T22:34:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9ab7fff700 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13b9e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009b80 tx=0x7f9aa401b000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cbb4d6806c0d2416 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9a97fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:34:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9a97fff700 1 -- 172.21.15.151:0/3364138196 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9aa4025040 con 0x557d8d134210 2023-07-21T22:34:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9a97fff700 1 -- 172.21.15.151:0/3364138196 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9aa402a5a0 con 0x557d8d134210 2023-07-21T22:34:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.315+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3364138196 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9aac0051a0 con 0x557d8d134210 2023-07-21T22:34:40.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9a97fff700 1 -- 172.21.15.151:0/3364138196 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9aa402aea0 con 0x557d8d134210 2023-07-21T22:34:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9ad2b8fb80 10 client.27271 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:40.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3364138196 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x557d8ce96c00 con 0x557d8d134210 2023-07-21T22:34:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9a97fff700 1 -- 172.21.15.151:0/3364138196 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9aac0051a0 con 0x557d8d134210 2023-07-21T22:34:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9a97fff700 1 -- 172.21.15.151:0/3364138196 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9aa4005020 con 0x557d8d134210 2023-07-21T22:34:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9ad2b8fb80 10 client.27271 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9ad2b8fb80 10 client.27271 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9ad2b8fb80 20 client.27271 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557d8d19c070 0x557d8d19e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9ad2b8fb80 4 client.27271 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:34:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.316+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3364138196 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557d8d03aff0 con 0x557d8d19c070 2023-07-21T22:34:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.317+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557d8d19c070 0x557d8d19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.317+0000 7f9a97fff700 10 client.27271 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.317+0000 7f9abcf9b700 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557d8d19c070 0x557d8d19e480 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51ff9aa5800700c server_cookie=c9b6d5035dddbce9 in_seq=0 out_seq=0 2023-07-21T22:34:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.325+0000 7f9a97fff700 1 -- 172.21.15.151:0/3364138196 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557d8d03aff0 con 0x557d8d19c070 2023-07-21T22:34:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.325+0000 7f9a97fff700 10 client.27271 handle_command_reply: tid=0 2023-07-21T22:34:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.325+0000 7f9ad2b8fb80 1 client.27271 shutdown 2023-07-21T22:34:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3364138196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 msgr2=0x557d8d13b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13b9e0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f9aa4009b80 tx=0x7f9aa401b000 comp rx=0 tx=0).stop 2023-07-21T22:34:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3364138196 shutdown_connections 2023-07-21T22:34:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557d8d19c070 0x557d8d19e480 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557d8cf8a6b0 0x557d8d13b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557d8d134660 0x557d8d19a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 --2- 172.21.15.151:0/3364138196 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557d8d134210 0x557d8d13b9e0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9a97fff700 0 client.27271 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3364138196 >> 172.21.15.151:0/3364138196 conn(0x557d8d123ae0 msgr2=0x557d8d135dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3364138196 shutdown_connections 2023-07-21T22:34:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 1 -- 172.21.15.151:0/3364138196 wait complete. 2023-07-21T22:34:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.326+0000 7f9ad2b8fb80 20 client.27271 trim_cache size 0 max 16384 2023-07-21T22:34:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:34:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:34:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:34:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:34:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 -- 172.21.15.151:0/3528819046 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9aa80a12c0 msgr2=0x7f9aa80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9aa80a12c0 0x7f9aa80a3770 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9ab8199670 tx=0x7f9aa40119c0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 -- 172.21.15.151:0/3528819046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ab8101fb0 msgr2=0x7f9ab8197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ab8101fb0 0x7f9ab8197e50 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f9aac009990 tx=0x7f9aac00f670 comp rx=0 tx=0).stop 2023-07-21T22:34:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 -- 172.21.15.151:0/3528819046 shutdown_connections 2023-07-21T22:34:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9aa80a12c0 0x7f9aa80a3770 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ab8101fb0 0x7f9ab8197e50 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ab8106ff0 0x7f9ab819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 --2- 172.21.15.151:0/3528819046 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ab8102950 0x7f9ab8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 -- 172.21.15.151:0/3528819046 >> 172.21.15.151:0/3528819046 conn(0x7f9ab80fd800 msgr2=0x7f9ab80fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 -- 172.21.15.151:0/3528819046 shutdown_connections 2023-07-21T22:34:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:40.327+0000 7f9abf1ff700 1 -- 172.21.15.151:0/3528819046 wait complete. 2023-07-21T22:34:40.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:40 smithi187 ceph-mon[96918]: pgmap v485: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:34:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:40 smithi195 ceph-mon[97365]: pgmap v485: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:34:40.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:40 smithi151 ceph-mon[95510]: pgmap v485: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:34:42.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:42 smithi187 ceph-mon[96918]: pgmap v486: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.0 MiB/s wr, 393 op/s 2023-07-21T22:34:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:42 smithi195 ceph-mon[97365]: pgmap v486: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.0 MiB/s wr, 393 op/s 2023-07-21T22:34:42.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:42 smithi151 ceph-mon[95510]: pgmap v486: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.0 MiB/s wr, 393 op/s 2023-07-21T22:34:43.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:43 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:34:43.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:43 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:34:43.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:43 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:34:44.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:44 smithi187 ceph-mon[96918]: pgmap v487: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.5 MiB/s wr, 595 op/s 2023-07-21T22:34:44.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:44 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:34:44.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:44 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:34:44.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:44 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:34:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:44 smithi195 ceph-mon[97365]: pgmap v487: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.5 MiB/s wr, 595 op/s 2023-07-21T22:34:44.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:44 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:34:44.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:44 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:34:44.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:44 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:34:44.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:44 smithi151 ceph-mon[95510]: pgmap v487: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.5 MiB/s wr, 595 op/s 2023-07-21T22:34:44.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:44 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:34:44.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:44 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:34:44.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:44 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:34:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:46 smithi187 ceph-mon[96918]: pgmap v488: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:34:46.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:46 smithi195 ceph-mon[97365]: pgmap v488: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:34:46.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:46 smithi151 ceph-mon[95510]: pgmap v488: 97 pgs: 97 active+clean; 9.0 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:34:48.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:48 smithi187 ceph-mon[96918]: pgmap v489: 97 pgs: 97 active+clean; 9.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 596 op/s 2023-07-21T22:34:48.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:48 smithi195 ceph-mon[97365]: pgmap v489: 97 pgs: 97 active+clean; 9.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 596 op/s 2023-07-21T22:34:48.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:48 smithi151 ceph-mon[95510]: pgmap v489: 97 pgs: 97 active+clean; 9.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.6 MiB/s wr, 596 op/s 2023-07-21T22:34:50.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:50 smithi187 ceph-mon[96918]: pgmap v490: 97 pgs: 97 active+clean; 9.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 398 op/s 2023-07-21T22:34:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:50 smithi195 ceph-mon[97365]: pgmap v490: 97 pgs: 97 active+clean; 9.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 398 op/s 2023-07-21T22:34:50.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:50 smithi151 ceph-mon[95510]: pgmap v490: 97 pgs: 97 active+clean; 9.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 398 op/s 2023-07-21T22:34:52.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:52 smithi187 ceph-mon[96918]: pgmap v491: 97 pgs: 97 active+clean; 9.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 398 op/s 2023-07-21T22:34:52.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:52 smithi195 ceph-mon[97365]: pgmap v491: 97 pgs: 97 active+clean; 9.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 398 op/s 2023-07-21T22:34:52.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:52 smithi151 ceph-mon[95510]: pgmap v491: 97 pgs: 97 active+clean; 9.0 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.0 MiB/s wr, 398 op/s 2023-07-21T22:34:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.492+0000 7f1173dff700 1 -- 172.21.15.151:0/811932928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f116c073160 msgr2=0x7f116c10be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.492+0000 7f1173dff700 1 --2- 172.21.15.151:0/811932928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f116c073160 0x7f116c10be90 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f115c009990 tx=0x7f115c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.492+0000 7f1173dff700 1 -- 172.21.15.151:0/811932928 shutdown_connections 2023-07-21T22:34:53.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.492+0000 7f1173dff700 1 --2- 172.21.15.151:0/811932928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f116c10c3d0 0x7f116c10e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.492+0000 7f1173dff700 1 --2- 172.21.15.151:0/811932928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f116c072850 0x7f116c072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.492+0000 7f1173dff700 1 --2- 172.21.15.151:0/811932928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f116c073160 0x7f116c10be90 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.492+0000 7f1173dff700 1 -- 172.21.15.151:0/811932928 >> 172.21.15.151:0/811932928 conn(0x7f116c0fb650 msgr2=0x7f116c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.492+0000 7f1173dff700 1 -- 172.21.15.151:0/811932928 shutdown_connections 2023-07-21T22:34:53.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.493+0000 7f1173dff700 1 -- 172.21.15.151:0/811932928 wait complete. 2023-07-21T22:34:53.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.494+0000 7f1173dff700 1 Processor -- start 2023-07-21T22:34:53.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.494+0000 7f1173dff700 1 -- start start 2023-07-21T22:34:53.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.494+0000 7f1173dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f116c072850 0x7f116c197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.494+0000 7f1173dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f116c073160 0x7f116c198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.494+0000 7f1173dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f116c10c3d0 0x7f116c19c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.494+0000 7f1173dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c19cfc0 con 0x7f116c073160 2023-07-21T22:34:53.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.494+0000 7f1173dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c19d130 con 0x7f116c072850 2023-07-21T22:34:53.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.494+0000 7f1173dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f116c19d2f0 con 0x7f116c10c3d0 2023-07-21T22:34:53.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f1171b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f116c072850 0x7f116c197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f117139a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f116c073160 0x7f116c198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f1171b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f116c072850 0x7f116c197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38730/0 (socket says 172.21.15.151:38730) 2023-07-21T22:34:53.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f1171b9b700 1 -- 172.21.15.151:0/1850591496 learned_addr learned my addr 172.21.15.151:0/1850591496 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:53.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f117239c700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f116c10c3d0 0x7f116c19c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f1171b9b700 1 -- 172.21.15.151:0/1850591496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f116c10c3d0 msgr2=0x7f116c19c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f1171b9b700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f116c10c3d0 0x7f116c19c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f1171b9b700 1 -- 172.21.15.151:0/1850591496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f116c073160 msgr2=0x7f116c198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f1171b9b700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f116c073160 0x7f116c198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f1171b9b700 1 -- 172.21.15.151:0/1850591496 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0095f0 con 0x7f116c072850 2023-07-21T22:34:53.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.495+0000 7f1171b9b700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f116c072850 0x7f116c197dd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f116800e9a0 tx=0x7f116800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.496+0000 7f1162ffd700 1 -- 172.21.15.151:0/1850591496 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168009790 con 0x7f116c072850 2023-07-21T22:34:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.496+0000 7f1162ffd700 1 -- 172.21.15.151:0/1850591496 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1168010430 con 0x7f116c072850 2023-07-21T22:34:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.496+0000 7f1173dff700 1 -- 172.21.15.151:0/1850591496 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f116c19d5d0 con 0x7f116c072850 2023-07-21T22:34:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.496+0000 7f1162ffd700 1 -- 172.21.15.151:0/1850591496 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116800cea0 con 0x7f116c072850 2023-07-21T22:34:53.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.496+0000 7f1173dff700 1 -- 172.21.15.151:0/1850591496 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116c1a4e10 con 0x7f116c072850 2023-07-21T22:34:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.499+0000 7f1162ffd700 1 -- 172.21.15.151:0/1850591496 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f116800ca10 con 0x7f116c072850 2023-07-21T22:34:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.500+0000 7f1162ffd700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11580a1340 0x7f11580a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.500+0000 7f11876cab80 1 Processor -- start 2023-07-21T22:34:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f1162ffd700 1 -- 172.21.15.151:0/1850591496 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1168014070 con 0x7f116c072850 2023-07-21T22:34:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f11876cab80 1 -- start start 2023-07-21T22:34:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f117139a700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11580a1340 0x7f11580a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f11876cab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 0x55682d6fe4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f11876cab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fea20 0x55682d6f8750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f11876cab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6f8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f11876cab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d5f5c50 con 0x55682d54c6b0 2023-07-21T22:34:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f11876cab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d6489e0 con 0x55682d6fea20 2023-07-21T22:34:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f11876cab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d641e70 con 0x55682d6fee70 2023-07-21T22:34:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f117239c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6f8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f1171b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 0x55682d6fe4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f117239c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6f8cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45224/0 (socket says 172.21.15.151:45224) 2023-07-21T22:34:53.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.501+0000 7f117239c700 1 -- 172.21.15.151:0/2866593480 learned_addr learned my addr 172.21.15.151:0/2866593480 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f117139a700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11580a1340 0x7f11580a37f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f116c1995f0 tx=0x7f115c00b260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f117139a700 1 --2- 172.21.15.151:0/2866593480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fea20 0x55682d6f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f1171b9b700 1 -- 172.21.15.151:0/2866593480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 msgr2=0x55682d6f8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f1171b9b700 1 --2- 172.21.15.151:0/2866593480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6f8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f1171b9b700 1 -- 172.21.15.151:0/2866593480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fea20 msgr2=0x55682d6f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f1171b9b700 1 --2- 172.21.15.151:0/2866593480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fea20 0x55682d6f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f1171b9b700 1 -- 172.21.15.151:0/2866593480 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55682d46fd80 con 0x55682d54c6b0 2023-07-21T22:34:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f117239c700 1 --2- 172.21.15.151:0/2866593480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:34:53.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f1171b9b700 1 --2- 172.21.15.151:0/2866593480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 0x55682d6fe4e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f11680ca5f0 tx=0x7f11680999a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6849f73dfee7e524 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f1157fff700 1 -- 172.21.15.151:0/2866593480 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168099f70 con 0x55682d54c6b0 2023-07-21T22:34:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f1157fff700 1 -- 172.21.15.151:0/2866593480 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f116809dfa0 con 0x55682d54c6b0 2023-07-21T22:34:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.502+0000 7f1157fff700 1 -- 172.21.15.151:0/2866593480 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168099460 con 0x55682d54c6b0 2023-07-21T22:34:53.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.503+0000 7f11876cab80 1 -- 172.21.15.151:0/2866593480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 msgr2=0x55682d6fe4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.503+0000 7f11876cab80 1 --2- 172.21.15.151:0/2866593480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 0x55682d6fe4e0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f11680ca5f0 tx=0x7f11680999a0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.503+0000 7f11876cab80 1 -- 172.21.15.151:0/2866593480 shutdown_connections 2023-07-21T22:34:53.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.503+0000 7f11876cab80 1 --2- 172.21.15.151:0/2866593480 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6f8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.503+0000 7f11876cab80 1 --2- 172.21.15.151:0/2866593480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 0x55682d6fe4e0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.503+0000 7f11876cab80 1 --2- 172.21.15.151:0/2866593480 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fea20 0x55682d6f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.503+0000 7f11876cab80 1 -- 172.21.15.151:0/2866593480 >> 172.21.15.151:0/2866593480 conn(0x55682d6e5ae0 msgr2=0x55682d6eb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.503+0000 7f11876cab80 1 -- 172.21.15.151:0/2866593480 shutdown_connections 2023-07-21T22:34:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.504+0000 7f11876cab80 1 -- 172.21.15.151:0/2866593480 wait complete. 2023-07-21T22:34:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.504+0000 7f11876cab80 1 -- start start 2023-07-21T22:34:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.504+0000 7f11876cab80 1 Processor -- start 2023-07-21T22:34:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f11876cab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d704d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f11876cab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 0x55682d702000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f11876cab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d702680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f11876cab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d5e1a60 con 0x55682d6fea20 2023-07-21T22:34:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f11876cab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d5e1760 con 0x55682d54c6b0 2023-07-21T22:34:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f11876cab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d4c58c0 con 0x55682d6fee70 2023-07-21T22:34:53.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f11876cab80 10 client.0 _ll_register_callbacks cb 0x55682d5df700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f1171b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d704d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f1171b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d704d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38748/0 (socket says 172.21.15.151:38748) 2023-07-21T22:34:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f1171b9b700 1 -- 172.21.15.151:0/846034910 learned_addr learned my addr 172.21.15.151:0/846034910 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f117139a700 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 0x55682d702000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f117239c700 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d702680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f1171b9b700 1 -- 172.21.15.151:0/846034910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 msgr2=0x55682d702680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f1171b9b700 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d702680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f1171b9b700 1 -- 172.21.15.151:0/846034910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 msgr2=0x55682d702000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.505+0000 7f1171b9b700 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 0x55682d702000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.506+0000 7f1171b9b700 1 -- 172.21.15.151:0/846034910 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1164011270 con 0x55682d54c6b0 2023-07-21T22:34:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.506+0000 7f1171b9b700 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d704d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f11680ca650 tx=0x7f11680107d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1936511c156308b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.506+0000 7f11557fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:34:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.506+0000 7f11557fa700 1 -- 172.21.15.151:0/846034910 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1168099ff0 con 0x55682d54c6b0 2023-07-21T22:34:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.506+0000 7f11557fa700 1 -- 172.21.15.151:0/846034910 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1168098310 con 0x55682d54c6b0 2023-07-21T22:34:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.506+0000 7f11876cab80 1 -- 172.21.15.151:0/846034910 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55682d59b490 con 0x55682d54c6b0 2023-07-21T22:34:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.506+0000 7f11557fa700 1 -- 172.21.15.151:0/846034910 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f116809a3e0 con 0x55682d54c6b0 2023-07-21T22:34:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.506+0000 7f11876cab80 10 client.27254 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.506+0000 7f11876cab80 1 -- 172.21.15.151:0/846034910 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x7f116c1a4e10 con 0x55682d54c6b0 2023-07-21T22:34:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.507+0000 7f11557fa700 1 -- 172.21.15.151:0/846034910 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55682d59b490 con 0x55682d54c6b0 2023-07-21T22:34:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.507+0000 7f11557fa700 1 -- 172.21.15.151:0/846034910 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1168094b80 con 0x55682d54c6b0 2023-07-21T22:34:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.507+0000 7f11876cab80 10 client.27254 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.507+0000 7f11876cab80 10 client.27254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.507+0000 7f11876cab80 20 client.27254 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.507+0000 7f11876cab80 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55682d711f80 0x55682d714390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.507+0000 7f11876cab80 4 client.27254 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:34:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.507+0000 7f11876cab80 1 -- 172.21.15.151:0/846034910 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55682d63ae50 con 0x55682d711f80 2023-07-21T22:34:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.507+0000 7f117139a700 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55682d711f80 0x55682d714390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.508+0000 7f117139a700 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55682d711f80 0x55682d714390 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5805c67266738bb server_cookie=249a5dc3129a8c36 in_seq=0 out_seq=0 2023-07-21T22:34:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.508+0000 7f11557fa700 10 client.27254 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.508+0000 7f11557fa700 1 -- 172.21.15.151:0/846034910 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55682d63ae50 con 0x55682d711f80 2023-07-21T22:34:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.508+0000 7f11557fa700 10 client.27254 handle_command_reply: tid=0 2023-07-21T22:34:53.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.508+0000 7f11876cab80 1 client.27254 shutdown 2023-07-21T22:34:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 -- 172.21.15.151:0/846034910 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 msgr2=0x55682d704d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d704d80 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f11680ca650 tx=0x7f11680107d0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 -- 172.21.15.151:0/846034910 shutdown_connections 2023-07-21T22:34:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55682d711f80 0x55682d714390 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d704d80 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d702680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11557fa700 0 client.27254 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 --2- 172.21.15.151:0/846034910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 0x55682d702000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 -- 172.21.15.151:0/846034910 >> 172.21.15.151:0/846034910 conn(0x55682d6e5ae0 msgr2=0x55682d6ea3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 -- 172.21.15.151:0/846034910 shutdown_connections 2023-07-21T22:34:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 1 -- 172.21.15.151:0/846034910 wait complete. 2023-07-21T22:34:53.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.509+0000 7f11876cab80 20 client.27254 trim_cache size 0 max 16384 2023-07-21T22:34:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.526+0000 7f11876cab80 1 Processor -- start 2023-07-21T22:34:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.526+0000 7f11876cab80 1 -- start start 2023-07-21T22:34:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.526+0000 7f11876cab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 0x55682d709380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.526+0000 7f11876cab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fea20 0x55682d6ff9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.526+0000 7f11876cab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fee70 0x55682d704920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.526+0000 7f11876cab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d702f90 con 0x55682d54c6b0 2023-07-21T22:34:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.526+0000 7f11876cab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d7035e0 con 0x55682d6fee70 2023-07-21T22:34:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.526+0000 7f11876cab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d6f94e0 con 0x55682d6fea20 2023-07-21T22:34:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f1171b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 0x55682d709380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f117139a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fea20 0x55682d6ff9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f117139a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fea20 0x55682d6ff9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45248/0 (socket says 172.21.15.151:45248) 2023-07-21T22:34:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f117139a700 1 -- 172.21.15.151:0/912070902 learned_addr learned my addr 172.21.15.151:0/912070902 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f117239c700 1 --2- 172.21.15.151:0/912070902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fee70 0x55682d704920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f117139a700 1 -- 172.21.15.151:0/912070902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fee70 msgr2=0x55682d704920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f117139a700 1 --2- 172.21.15.151:0/912070902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fee70 0x55682d704920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f117139a700 1 -- 172.21.15.151:0/912070902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 msgr2=0x55682d709380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f117139a700 1 --2- 172.21.15.151:0/912070902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 0x55682d709380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.527+0000 7f117139a700 1 -- 172.21.15.151:0/912070902 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55682d458c00 con 0x55682d6fea20 2023-07-21T22:34:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.528+0000 7f117139a700 1 --2- 172.21.15.151:0/912070902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fea20 0x55682d6ff9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f115c015000 tx=0x7f115c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d948d3981357614e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.528+0000 7f1160bff700 1 -- 172.21.15.151:0/912070902 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c00bd00 con 0x55682d6fea20 2023-07-21T22:34:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.528+0000 7f1160bff700 1 -- 172.21.15.151:0/912070902 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f115c01e040 con 0x55682d6fea20 2023-07-21T22:34:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.528+0000 7f1160bff700 1 -- 172.21.15.151:0/912070902 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115c004500 con 0x55682d6fea20 2023-07-21T22:34:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.529+0000 7f11876cab80 1 -- 172.21.15.151:0/912070902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fea20 msgr2=0x55682d6ff9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.529+0000 7f11876cab80 1 --2- 172.21.15.151:0/912070902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fea20 0x55682d6ff9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f115c015000 tx=0x7f115c020000 comp rx=0 tx=0).stop 2023-07-21T22:34:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.529+0000 7f11876cab80 1 -- 172.21.15.151:0/912070902 shutdown_connections 2023-07-21T22:34:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.529+0000 7f11876cab80 1 --2- 172.21.15.151:0/912070902 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d6fee70 0x55682d704920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.529+0000 7f11876cab80 1 --2- 172.21.15.151:0/912070902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d54c6b0 0x55682d709380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.529+0000 7f11876cab80 1 --2- 172.21.15.151:0/912070902 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fea20 0x55682d6ff9c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.529+0000 7f11876cab80 1 -- 172.21.15.151:0/912070902 >> 172.21.15.151:0/912070902 conn(0x55682d6e5ae0 msgr2=0x55682d6ff2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.529+0000 7f11876cab80 1 -- 172.21.15.151:0/912070902 shutdown_connections 2023-07-21T22:34:53.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.529+0000 7f11876cab80 1 -- 172.21.15.151:0/912070902 wait complete. 2023-07-21T22:34:53.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.530+0000 7f11876cab80 1 -- start start 2023-07-21T22:34:53.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.530+0000 7f11876cab80 1 Processor -- start 2023-07-21T22:34:53.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.530+0000 7f11876cab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d6fb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.530+0000 7f11876cab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 0x55682d6f9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f11876cab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6fa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f11876cab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d6fbce0 con 0x55682d6fea20 2023-07-21T22:34:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f11876cab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d6fa9c0 con 0x55682d54c6b0 2023-07-21T22:34:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f11876cab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55682d6fab30 con 0x55682d6fee70 2023-07-21T22:34:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f11876cab80 10 client.0 _ll_register_callbacks cb 0x7f1164009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:34:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117139a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 0x55682d6f9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117239c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6fa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117139a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 0x55682d6f9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43760/0 (socket says 172.21.15.151:43760) 2023-07-21T22:34:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117239c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6fa480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45256/0 (socket says 172.21.15.151:45256) 2023-07-21T22:34:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117139a700 1 -- 172.21.15.151:0/2607842625 learned_addr learned my addr 172.21.15.151:0/2607842625 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:34:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f1171b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d6fb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117239c700 1 -- 172.21.15.151:0/2607842625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 msgr2=0x55682d6fb680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117239c700 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d6fb680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117239c700 1 -- 172.21.15.151:0/2607842625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 msgr2=0x55682d6f9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:34:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117239c700 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 0x55682d6f9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.531+0000 7f117239c700 1 -- 172.21.15.151:0/2607842625 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f116c10f3f0 con 0x55682d6fee70 2023-07-21T22:34:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.532+0000 7f117239c700 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6fa480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55682d6ff280 tx=0x7f1164007fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8bdc94e84e226e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:34:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.532+0000 7f11557fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:34:53.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.532+0000 7f11557fa700 1 -- 172.21.15.151:0/2607842625 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f116401c070 con 0x55682d6fee70 2023-07-21T22:34:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.532+0000 7f11876cab80 1 -- 172.21.15.151:0/2607842625 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f116809dfa0 con 0x55682d6fee70 2023-07-21T22:34:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.532+0000 7f11557fa700 1 -- 172.21.15.151:0/2607842625 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1164004700 con 0x55682d6fee70 2023-07-21T22:34:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.532+0000 7f11557fa700 1 -- 172.21.15.151:0/2607842625 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f116400e040 con 0x55682d6fee70 2023-07-21T22:34:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.532+0000 7f11876cab80 10 client.27289 fetch_fsmap learned FSMap version 60 2023-07-21T22:34:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.532+0000 7f11876cab80 1 -- 172.21.15.151:0/2607842625 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55682d4961f0 con 0x55682d6fee70 2023-07-21T22:34:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.532+0000 7f11557fa700 1 -- 172.21.15.151:0/2607842625 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f116809dfa0 con 0x55682d6fee70 2023-07-21T22:34:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.533+0000 7f11557fa700 1 -- 172.21.15.151:0/2607842625 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1164016490 con 0x55682d6fee70 2023-07-21T22:34:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.533+0000 7f11876cab80 10 client.27289 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:34:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.533+0000 7f11876cab80 10 client.27289 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:34:53.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.533+0000 7f11876cab80 20 client.27289 populate_metadata read hostname 'smithi151' 2023-07-21T22:34:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.533+0000 7f11876cab80 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55682d767170 0x55682d769580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:34:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.533+0000 7f11876cab80 4 client.27289 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:34:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.533+0000 7f11876cab80 1 -- 172.21.15.151:0/2607842625 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55682d5fcff0 con 0x55682d767170 2023-07-21T22:34:53.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.533+0000 7f1171b9b700 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55682d767170 0x55682d769580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:34:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.534+0000 7f11557fa700 10 client.27289 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:53.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.534+0000 7f1171b9b700 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55682d767170 0x55682d769580 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9a4e609cb650ca1 server_cookie=609d779381b6b67c in_seq=0 out_seq=0 2023-07-21T22:34:53.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11557fa700 1 -- 172.21.15.151:0/2607842625 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55682d5fcff0 con 0x55682d767170 2023-07-21T22:34:53.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11557fa700 10 client.27289 handle_command_reply: tid=0 2023-07-21T22:34:53.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11876cab80 1 client.27289 shutdown 2023-07-21T22:34:53.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11876cab80 1 -- 172.21.15.151:0/2607842625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 msgr2=0x55682d6fa480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11876cab80 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6fa480 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55682d6ff280 tx=0x7f1164007fd0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11876cab80 1 -- 172.21.15.151:0/2607842625 shutdown_connections 2023-07-21T22:34:53.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11876cab80 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55682d767170 0x55682d769580 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11876cab80 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55682d54c6b0 0x55682d6fb680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11876cab80 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55682d6fee70 0x55682d6fa480 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.543+0000 7f11876cab80 1 --2- 172.21.15.151:0/2607842625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55682d6fea20 0x55682d6f9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.542+0000 7f11557fa700 0 client.27289 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:34:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.543+0000 7f11876cab80 1 -- 172.21.15.151:0/2607842625 >> 172.21.15.151:0/2607842625 conn(0x55682d6e5ae0 msgr2=0x55682d6ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.543+0000 7f11876cab80 1 -- 172.21.15.151:0/2607842625 shutdown_connections 2023-07-21T22:34:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.543+0000 7f11876cab80 1 -- 172.21.15.151:0/2607842625 wait complete. 2023-07-21T22:34:53.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.543+0000 7f11876cab80 20 client.27289 trim_cache size 0 max 16384 2023-07-21T22:34:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:34:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:34:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:34:53.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:34:53.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.543+0000 7f1173dff700 1 -- 172.21.15.151:0/1850591496 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11580a1340 msgr2=0x7f11580a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.543+0000 7f1173dff700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11580a1340 0x7f11580a37f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f116c1995f0 tx=0x7f115c00b260 comp rx=0 tx=0).stop 2023-07-21T22:34:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 -- 172.21.15.151:0/1850591496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f116c072850 msgr2=0x7f116c197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:34:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f116c072850 0x7f116c197dd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f116800e9a0 tx=0x7f116800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 -- 172.21.15.151:0/1850591496 shutdown_connections 2023-07-21T22:34:53.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f11580a1340 0x7f11580a37f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f116c072850 0x7f116c197dd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f116c10c3d0 0x7f116c19c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 --2- 172.21.15.151:0/1850591496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f116c073160 0x7f116c198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:34:53.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 -- 172.21.15.151:0/1850591496 >> 172.21.15.151:0/1850591496 conn(0x7f116c0fb650 msgr2=0x7f116c10e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:34:53.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 -- 172.21.15.151:0/1850591496 shutdown_connections 2023-07-21T22:34:53.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:34:53.544+0000 7f1173dff700 1 -- 172.21.15.151:0/1850591496 wait complete. 2023-07-21T22:34:54.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:54 smithi187 ceph-mon[96918]: pgmap v492: 97 pgs: 97 active+clean; 9.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.4 MiB/s wr, 577 op/s 2023-07-21T22:34:54.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:54 smithi195 ceph-mon[97365]: pgmap v492: 97 pgs: 97 active+clean; 9.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.4 MiB/s wr, 577 op/s 2023-07-21T22:34:54.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:54 smithi151 ceph-mon[95510]: pgmap v492: 97 pgs: 97 active+clean; 9.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.4 MiB/s wr, 577 op/s 2023-07-21T22:34:56.882 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:56 smithi187 ceph-mon[96918]: pgmap v493: 97 pgs: 97 active+clean; 9.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.9 MiB/s wr, 375 op/s 2023-07-21T22:34:56.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:56 smithi195 ceph-mon[97365]: pgmap v493: 97 pgs: 97 active+clean; 9.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.9 MiB/s wr, 375 op/s 2023-07-21T22:34:56.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:56 smithi151 ceph-mon[95510]: pgmap v493: 97 pgs: 97 active+clean; 9.0 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.9 MiB/s wr, 375 op/s 2023-07-21T22:34:58.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:34:58 smithi187 ceph-mon[96918]: pgmap v494: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 561 op/s 2023-07-21T22:34:58.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:34:58 smithi195 ceph-mon[97365]: pgmap v494: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 561 op/s 2023-07-21T22:34:58.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:34:58 smithi151 ceph-mon[95510]: pgmap v494: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 561 op/s 2023-07-21T22:35:00.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:00 smithi187 ceph-mon[96918]: pgmap v495: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 366 op/s 2023-07-21T22:35:00.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:00 smithi195 ceph-mon[97365]: pgmap v495: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 366 op/s 2023-07-21T22:35:00.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:00 smithi151 ceph-mon[95510]: pgmap v495: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 366 op/s 2023-07-21T22:35:02.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:02 smithi187 ceph-mon[96918]: pgmap v496: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 366 op/s 2023-07-21T22:35:02.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:02 smithi195 ceph-mon[97365]: pgmap v496: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 366 op/s 2023-07-21T22:35:02.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:02 smithi151 ceph-mon[95510]: pgmap v496: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 2.8 MiB/s wr, 366 op/s 2023-07-21T22:35:04.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:04 smithi187 ceph-mon[96918]: pgmap v497: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.3 MiB/s wr, 572 op/s 2023-07-21T22:35:04.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:04 smithi195 ceph-mon[97365]: pgmap v497: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.3 MiB/s wr, 572 op/s 2023-07-21T22:35:04.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:04 smithi151 ceph-mon[95510]: pgmap v497: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.3 MiB/s wr, 572 op/s 2023-07-21T22:35:06.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.706+0000 7f7c33dff700 1 -- 172.21.15.151:0/2475549135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c2c0685b0 msgr2=0x7f7c2c104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.706+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2475549135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c2c0685b0 0x7f7c2c104770 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0099c0 tx=0x7f7c1c009cd0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.706+0000 7f7c33dff700 1 -- 172.21.15.151:0/2475549135 shutdown_connections 2023-07-21T22:35:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.706+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2475549135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c104e50 0x7f7c2c10ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.706+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2475549135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c2c067c10 0x7f7c2c067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.706+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2475549135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c2c0685b0 0x7f7c2c104770 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.706+0000 7f7c33dff700 1 -- 172.21.15.151:0/2475549135 >> 172.21.15.151:0/2475549135 conn(0x7f7c2c074760 msgr2=0x7f7c2c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.706+0000 7f7c33dff700 1 -- 172.21.15.151:0/2475549135 shutdown_connections 2023-07-21T22:35:06.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.706+0000 7f7c33dff700 1 -- 172.21.15.151:0/2475549135 wait complete. 2023-07-21T22:35:06.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.707+0000 7f7c33dff700 1 Processor -- start 2023-07-21T22:35:06.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.707+0000 7f7c33dff700 1 -- start start 2023-07-21T22:35:06.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c33dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c2c067c10 0x7f7c2c197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c33dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c2c0685b0 0x7f7c2c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c33dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c104e50 0x7f7c2c19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c33dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c19cfe0 con 0x7f7c2c104e50 2023-07-21T22:35:06.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c33dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c19d150 con 0x7f7c2c0685b0 2023-07-21T22:35:06.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c33dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c19d310 con 0x7f7c2c067c10 2023-07-21T22:35:06.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c31b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c2c067c10 0x7f7c2c197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c31b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c2c067c10 0x7f7c2c197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42192/0 (socket says 172.21.15.151:42192) 2023-07-21T22:35:06.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c31b9b700 1 -- 172.21.15.151:0/2540121614 learned_addr learned my addr 172.21.15.151:0/2540121614 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:06.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c3139a700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c2c0685b0 0x7f7c2c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.708+0000 7f7c3239c700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c104e50 0x7f7c2c19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c3139a700 1 -- 172.21.15.151:0/2540121614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c2c067c10 msgr2=0x7f7c2c197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c3139a700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c2c067c10 0x7f7c2c197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c3139a700 1 -- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c104e50 msgr2=0x7f7c2c19c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c3139a700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c104e50 0x7f7c2c19c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c3139a700 1 -- 172.21.15.151:0/2540121614 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1c0095f0 con 0x7f7c2c0685b0 2023-07-21T22:35:06.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c3139a700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c2c0685b0 0x7f7c2c198330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0098e0 tx=0x7f7c1c00f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c22ffd700 1 -- 172.21.15.151:0/2540121614 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c01d070 con 0x7f7c2c0685b0 2023-07-21T22:35:06.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c33dff700 1 -- 172.21.15.151:0/2540121614 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c19d590 con 0x7f7c2c0685b0 2023-07-21T22:35:06.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c22ffd700 1 -- 172.21.15.151:0/2540121614 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c1c005050 con 0x7f7c2c0685b0 2023-07-21T22:35:06.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.709+0000 7f7c22ffd700 1 -- 172.21.15.151:0/2540121614 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c004950 con 0x7f7c2c0685b0 2023-07-21T22:35:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.710+0000 7f7c33dff700 1 -- 172.21.15.151:0/2540121614 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c1a4e30 con 0x7f7c2c0685b0 2023-07-21T22:35:06.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.713+0000 7f7c22ffd700 1 -- 172.21.15.151:0/2540121614 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f7c1c0051c0 con 0x7f7c2c0685b0 2023-07-21T22:35:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.715+0000 7f7c477c3b80 1 Processor -- start 2023-07-21T22:35:06.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.715+0000 7f7c477c3b80 1 -- start start 2023-07-21T22:35:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.715+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5123cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.715+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e511df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e511e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e5023c50 con 0x5634e4f7a6b0 2023-07-21T22:35:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e50769e0 con 0x5634e5124210 2023-07-21T22:35:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e506fe70 con 0x5634e5124660 2023-07-21T22:35:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c31b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e511df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c22ffd700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7c180a12c0 0x7f7c180a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c31b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e511df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49870/0 (socket says 172.21.15.151:49870) 2023-07-21T22:35:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c31b9b700 1 -- 172.21.15.151:0/4042212801 learned_addr learned my addr 172.21.15.151:0/4042212801 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c3139a700 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e511e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c3239c700 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5123cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c22ffd700 1 -- 172.21.15.151:0/2540121614 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7c1c0cd8a0 con 0x7f7c2c0685b0 2023-07-21T22:35:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c31b9b700 1 -- 172.21.15.151:0/4042212801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 msgr2=0x5634e511e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.716+0000 7f7c31b9b700 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e511e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c31b9b700 1 -- 172.21.15.151:0/4042212801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 msgr2=0x5634e5123cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c31b9b700 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5123cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c31b9b700 1 -- 172.21.15.151:0/4042212801 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634e4e9dd80 con 0x5634e5124210 2023-07-21T22:35:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c3139a700 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e511e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c3239c700 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5123cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c3239c700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7c180a12c0 0x7f7c180a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c31b9b700 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e511df40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009e50 tx=0x7f7c28011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=740f34cbd46b6643 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c17fff700 1 -- 172.21.15.151:0/4042212801 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28004a30 con 0x5634e5124210 2023-07-21T22:35:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c17fff700 1 -- 172.21.15.151:0/4042212801 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c280054b0 con 0x5634e5124210 2023-07-21T22:35:06.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.717+0000 7f7c17fff700 1 -- 172.21.15.151:0/4042212801 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c280198d0 con 0x5634e5124210 2023-07-21T22:35:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c477c3b80 1 -- 172.21.15.151:0/4042212801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 msgr2=0x5634e511df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e511df40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009e50 tx=0x7f7c28011720 comp rx=0 tx=0).stop 2023-07-21T22:35:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c3239c700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7c180a12c0 0x7f7c180a3770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009ec0 tx=0x7f7c24009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c477c3b80 1 -- 172.21.15.151:0/4042212801 shutdown_connections 2023-07-21T22:35:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e511e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5123cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/4042212801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e511df40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c477c3b80 1 -- 172.21.15.151:0/4042212801 >> 172.21.15.151:0/4042212801 conn(0x5634e5113ae0 msgr2=0x5634e51190e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c477c3b80 1 -- 172.21.15.151:0/4042212801 shutdown_connections 2023-07-21T22:35:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.718+0000 7f7c477c3b80 1 -- 172.21.15.151:0/4042212801 wait complete. 2023-07-21T22:35:06.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.719+0000 7f7c477c3b80 1 -- start start 2023-07-21T22:35:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.719+0000 7f7c477c3b80 1 Processor -- start 2023-07-21T22:35:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e512a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51277a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5127dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e500fa60 con 0x5634e4f7a6b0 2023-07-21T22:35:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e500f760 con 0x5634e5124210 2023-07-21T22:35:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e4ef38c0 con 0x5634e5124660 2023-07-21T22:35:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c477c3b80 10 client.0 _ll_register_callbacks cb 0x5634e500d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3139a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3139a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51277a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49882/0 (socket says 172.21.15.151:49882) 2023-07-21T22:35:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3139a700 1 -- 172.21.15.151:0/3465344471 learned_addr learned my addr 172.21.15.151:0/3465344471 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c31b9b700 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e512a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3239c700 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5127dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3139a700 1 -- 172.21.15.151:0/3465344471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 msgr2=0x5634e5127dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3139a700 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5127dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3139a700 1 -- 172.21.15.151:0/3465344471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 msgr2=0x5634e512a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3139a700 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e512a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3139a700 1 -- 172.21.15.151:0/3465344471 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c1a4e30 con 0x5634e5124210 2023-07-21T22:35:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.720+0000 7f7c3239c700 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5127dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.721+0000 7f7c3139a700 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51277a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00b580 tx=0x7f7c1c09a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1908dc4dc54bf3e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.721+0000 7f7c157fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:35:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.721+0000 7f7c157fa700 1 -- 172.21.15.151:0/3465344471 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0a2de0 con 0x5634e5124210 2023-07-21T22:35:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.721+0000 7f7c477c3b80 1 -- 172.21.15.151:0/3465344471 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5634e4fc9490 con 0x5634e5124210 2023-07-21T22:35:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.721+0000 7f7c157fa700 1 -- 172.21.15.151:0/3465344471 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7c1c099f10 con 0x5634e5124210 2023-07-21T22:35:06.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.721+0000 7f7c157fa700 1 -- 172.21.15.151:0/3465344471 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c1c0b3150 con 0x5634e5124210 2023-07-21T22:35:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.721+0000 7f7c477c3b80 10 client.27272 fetch_fsmap learned FSMap version 60 2023-07-21T22:35:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.721+0000 7f7c477c3b80 1 -- 172.21.15.151:0/3465344471 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x7f7c28009a80 con 0x5634e5124210 2023-07-21T22:35:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.721+0000 7f7c157fa700 1 -- 172.21.15.151:0/3465344471 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5634e4fc9490 con 0x5634e5124210 2023-07-21T22:35:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.722+0000 7f7c157fa700 1 -- 172.21.15.151:0/3465344471 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7c1c0ba0b0 con 0x5634e5124210 2023-07-21T22:35:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.722+0000 7f7c477c3b80 10 client.27272 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:35:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.722+0000 7f7c477c3b80 10 client.27272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.722+0000 7f7c477c3b80 20 client.27272 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:06.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.722+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5634e5137720 0x5634e5139b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.722+0000 7f7c477c3b80 4 client.27272 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:35:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.722+0000 7f7c477c3b80 1 -- 172.21.15.151:0/3465344471 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5634e5068e50 con 0x5634e5137720 2023-07-21T22:35:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.722+0000 7f7c31b9b700 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5634e5137720 0x5634e5139b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.723+0000 7f7c31b9b700 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5634e5137720 0x5634e5139b30 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b19a4f654d41fcb server_cookie=370de36e0565c391 in_seq=0 out_seq=0 2023-07-21T22:35:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.723+0000 7f7c157fa700 10 client.27272 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:06.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c157fa700 1 -- 172.21.15.151:0/3465344471 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5634e5068e50 con 0x5634e5137720 2023-07-21T22:35:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c157fa700 10 client.27272 handle_command_reply: tid=0 2023-07-21T22:35:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c477c3b80 1 client.27272 shutdown 2023-07-21T22:35:06.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c477c3b80 1 -- 172.21.15.151:0/3465344471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 msgr2=0x5634e51277a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51277a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c00b580 tx=0x7f7c1c09a400 comp rx=0 tx=0).stop 2023-07-21T22:35:06.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c477c3b80 1 -- 172.21.15.151:0/3465344471 shutdown_connections 2023-07-21T22:35:06.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5634e5137720 0x5634e5139b30 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5127dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e512a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/3465344471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51277a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c157fa700 0 client.27272 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:06.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.724+0000 7f7c477c3b80 1 -- 172.21.15.151:0/3465344471 >> 172.21.15.151:0/3465344471 conn(0x5634e5113ae0 msgr2=0x5634e51183e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.725+0000 7f7c477c3b80 1 -- 172.21.15.151:0/3465344471 shutdown_connections 2023-07-21T22:35:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.725+0000 7f7c477c3b80 1 -- 172.21.15.151:0/3465344471 wait complete. 2023-07-21T22:35:06.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.725+0000 7f7c477c3b80 20 client.27272 trim_cache size 0 max 16384 2023-07-21T22:35:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.743+0000 7f7c477c3b80 1 Processor -- start 2023-07-21T22:35:06.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.743+0000 7f7c477c3b80 1 -- start start 2023-07-21T22:35:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.743+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5118b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.743+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51190a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.743+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5124a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.743+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e50e3fc0 con 0x5634e4f7a6b0 2023-07-21T22:35:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.743+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e511ed30 con 0x5634e5124210 2023-07-21T22:35:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.743+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e5068e50 con 0x5634e5124660 2023-07-21T22:35:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c31b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5118b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c31b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5118b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40052/0 (socket says 172.21.15.151:40052) 2023-07-21T22:35:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c31b9b700 1 -- 172.21.15.151:0/2609350338 learned_addr learned my addr 172.21.15.151:0/2609350338 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c3239c700 1 --2- 172.21.15.151:0/2609350338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5124a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c3139a700 1 --2- 172.21.15.151:0/2609350338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51190a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c3239c700 1 -- 172.21.15.151:0/2609350338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 msgr2=0x5634e51190a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c3239c700 1 --2- 172.21.15.151:0/2609350338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51190a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c3239c700 1 -- 172.21.15.151:0/2609350338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 msgr2=0x5634e5118b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c3239c700 1 --2- 172.21.15.151:0/2609350338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5118b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c3239c700 1 -- 172.21.15.151:0/2609350338 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5634e513e760 con 0x5634e5124660 2023-07-21T22:35:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.744+0000 7f7c3239c700 1 --2- 172.21.15.151:0/2609350338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5124a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009550 tx=0x7f7c24004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c87c001a67e8f54c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.745+0000 7f7c20bff700 1 -- 172.21.15.151:0/2609350338 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24027070 con 0x5634e5124660 2023-07-21T22:35:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.745+0000 7f7c20bff700 1 -- 172.21.15.151:0/2609350338 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c2400f040 con 0x5634e5124660 2023-07-21T22:35:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.745+0000 7f7c20bff700 1 -- 172.21.15.151:0/2609350338 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24007ea0 con 0x5634e5124660 2023-07-21T22:35:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 -- 172.21.15.151:0/2609350338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 msgr2=0x5634e5124a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/2609350338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5124a30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009550 tx=0x7f7c24004b40 comp rx=0 tx=0).stop 2023-07-21T22:35:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 -- 172.21.15.151:0/2609350338 shutdown_connections 2023-07-21T22:35:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/2609350338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124660 0x5634e5124a30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/2609350338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e4f7a6b0 0x5634e5118b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/2609350338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e5124210 0x5634e51190a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 -- 172.21.15.151:0/2609350338 >> 172.21.15.151:0/2609350338 conn(0x5634e5113ae0 msgr2=0x5634e5121990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 -- 172.21.15.151:0/2609350338 shutdown_connections 2023-07-21T22:35:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 -- 172.21.15.151:0/2609350338 wait complete. 2023-07-21T22:35:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 -- start start 2023-07-21T22:35:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.746+0000 7f7c477c3b80 1 Processor -- start 2023-07-21T22:35:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e4f7a6b0 0x5634e512cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124210 0x5634e512d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c477c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e5124660 0x5634e518a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e518ab20 con 0x5634e5124660 2023-07-21T22:35:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e518ac60 con 0x5634e4f7a6b0 2023-07-21T22:35:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c477c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5634e518ae20 con 0x5634e5124210 2023-07-21T22:35:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c477c3b80 10 client.0 _ll_register_callbacks cb 0x7f7c1c009310 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c31b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e4f7a6b0 0x5634e512cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c31b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e4f7a6b0 0x5634e512cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49894/0 (socket says 172.21.15.151:49894) 2023-07-21T22:35:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c31b9b700 1 -- 172.21.15.151:0/661759184 learned_addr learned my addr 172.21.15.151:0/661759184 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c3139a700 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124210 0x5634e512d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.747+0000 7f7c3239c700 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e5124660 0x5634e518a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c31b9b700 1 -- 172.21.15.151:0/661759184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124210 msgr2=0x5634e512d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c31b9b700 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124210 0x5634e512d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c31b9b700 1 -- 172.21.15.151:0/661759184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e5124660 msgr2=0x5634e518a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c31b9b700 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e5124660 0x5634e518a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c31b9b700 1 -- 172.21.15.151:0/661759184 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c240175e0 con 0x5634e4f7a6b0 2023-07-21T22:35:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c31b9b700 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e4f7a6b0 0x5634e512cd00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009e50 tx=0x7f7c28009790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a86171f489cc83 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c157fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:35:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c157fa700 1 -- 172.21.15.151:0/661759184 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28029040 con 0x5634e4f7a6b0 2023-07-21T22:35:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c477c3b80 1 -- 172.21.15.151:0/661759184 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c280054b0 con 0x5634e4f7a6b0 2023-07-21T22:35:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.748+0000 7f7c157fa700 1 -- 172.21.15.151:0/661759184 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(106..106 src has 1..106) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7c2802b4b0 con 0x5634e4f7a6b0 2023-07-21T22:35:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c157fa700 1 -- 172.21.15.151:0/661759184 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c2802b860 con 0x5634e4f7a6b0 2023-07-21T22:35:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c477c3b80 10 client.27278 fetch_fsmap learned FSMap version 60 2023-07-21T22:35:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c477c3b80 1 -- 172.21.15.151:0/661759184 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x5634e4e86c00 con 0x5634e4f7a6b0 2023-07-21T22:35:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c157fa700 1 -- 172.21.15.151:0/661759184 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7c280054b0 con 0x5634e4f7a6b0 2023-07-21T22:35:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c157fa700 1 -- 172.21.15.151:0/661759184 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f7c28011440 con 0x5634e4f7a6b0 2023-07-21T22:35:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c477c3b80 10 client.27278 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:35:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c477c3b80 10 client.27278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:06.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c477c3b80 20 client.27278 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:06.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5634e518c5a0 0x5634e518e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:06.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c477c3b80 4 client.27278 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:35:06.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c477c3b80 1 -- 172.21.15.151:0/661759184 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5634e502aff0 con 0x5634e518c5a0 2023-07-21T22:35:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.749+0000 7f7c3139a700 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5634e518c5a0 0x5634e518e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.750+0000 7f7c3139a700 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5634e518c5a0 0x5634e518e9b0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc491619537344ca server_cookie=5d86c7db013c3cd6 in_seq=0 out_seq=0 2023-07-21T22:35:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.750+0000 7f7c157fa700 10 client.27278 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.758+0000 7f7c157fa700 1 -- 172.21.15.151:0/661759184 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5634e502aff0 con 0x5634e518c5a0 2023-07-21T22:35:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.758+0000 7f7c157fa700 10 client.27278 handle_command_reply: tid=0 2023-07-21T22:35:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.758+0000 7f7c477c3b80 1 client.27278 shutdown 2023-07-21T22:35:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 -- 172.21.15.151:0/661759184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e4f7a6b0 msgr2=0x5634e512cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e4f7a6b0 0x5634e512cd00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009e50 tx=0x7f7c28009790 comp rx=0 tx=0).stop 2023-07-21T22:35:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 -- 172.21.15.151:0/661759184 shutdown_connections 2023-07-21T22:35:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5634e518c5a0 0x5634e518e9b0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5634e4f7a6b0 0x5634e512cd00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5634e5124660 0x5634e518a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c157fa700 0 client.27278 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 --2- 172.21.15.151:0/661759184 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5634e5124210 0x5634e512d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 -- 172.21.15.151:0/661759184 >> 172.21.15.151:0/661759184 conn(0x5634e5113ae0 msgr2=0x5634e5124a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 -- 172.21.15.151:0/661759184 shutdown_connections 2023-07-21T22:35:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 1 -- 172.21.15.151:0/661759184 wait complete. 2023-07-21T22:35:06.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.759+0000 7f7c477c3b80 20 client.27278 trim_cache size 0 max 16384 2023-07-21T22:35:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:35:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:35:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:35:06.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:35:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 -- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7c180a12c0 msgr2=0x7f7c180a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7c180a12c0 0x7f7c180a3770 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f7c24009ec0 tx=0x7f7c24009040 comp rx=0 tx=0).stop 2023-07-21T22:35:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 -- 172.21.15.151:0/2540121614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c2c0685b0 msgr2=0x7f7c2c198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c2c0685b0 0x7f7c2c198330 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0098e0 tx=0x7f7c1c00f690 comp rx=0 tx=0).stop 2023-07-21T22:35:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 -- 172.21.15.151:0/2540121614 shutdown_connections 2023-07-21T22:35:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7c180a12c0 0x7f7c180a3770 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c2c104e50 0x7f7c2c19c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7c2c067c10 0x7f7c2c197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 --2- 172.21.15.151:0/2540121614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c2c0685b0 0x7f7c2c198330 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 -- 172.21.15.151:0/2540121614 >> 172.21.15.151:0/2540121614 conn(0x7f7c2c074760 msgr2=0x7f7c2c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 -- 172.21.15.151:0/2540121614 shutdown_connections 2023-07-21T22:35:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:06.760+0000 7f7c33dff700 1 -- 172.21.15.151:0/2540121614 wait complete. 2023-07-21T22:35:06.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:06 smithi187 ceph-mon[96918]: pgmap v498: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.9 MiB/s wr, 392 op/s 2023-07-21T22:35:06.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:06 smithi195 ceph-mon[97365]: pgmap v498: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.9 MiB/s wr, 392 op/s 2023-07-21T22:35:06.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:06 smithi151 ceph-mon[95510]: pgmap v498: 97 pgs: 97 active+clean; 9.0 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.9 MiB/s wr, 392 op/s 2023-07-21T22:35:08.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:08 smithi187 ceph-mon[96918]: pgmap v499: 97 pgs: 97 active+clean; 9.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 580 op/s 2023-07-21T22:35:08.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:08 smithi195 ceph-mon[97365]: pgmap v499: 97 pgs: 97 active+clean; 9.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 580 op/s 2023-07-21T22:35:08.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:08 smithi151 ceph-mon[95510]: pgmap v499: 97 pgs: 97 active+clean; 9.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.4 MiB/s wr, 580 op/s 2023-07-21T22:35:10.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:10 smithi187 ceph-mon[96918]: pgmap v500: 97 pgs: 97 active+clean; 9.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.0 MiB/s wr, 394 op/s 2023-07-21T22:35:10.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:10 smithi187 ceph-mon[96918]: osdmap e107: 12 total, 12 up, 12 in 2023-07-21T22:35:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:10 smithi195 ceph-mon[97365]: pgmap v500: 97 pgs: 97 active+clean; 9.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.0 MiB/s wr, 394 op/s 2023-07-21T22:35:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:10 smithi195 ceph-mon[97365]: osdmap e107: 12 total, 12 up, 12 in 2023-07-21T22:35:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:10 smithi151 ceph-mon[95510]: pgmap v500: 97 pgs: 97 active+clean; 9.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.0 MiB/s wr, 394 op/s 2023-07-21T22:35:10.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:10 smithi151 ceph-mon[95510]: osdmap e107: 12 total, 12 up, 12 in 2023-07-21T22:35:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:12 smithi187 ceph-mon[96918]: pgmap v502: 97 pgs: 97 active+clean; 9.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:35:12.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:12 smithi195 ceph-mon[97365]: pgmap v502: 97 pgs: 97 active+clean; 9.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:35:12.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:12 smithi151 ceph-mon[95510]: pgmap v502: 97 pgs: 97 active+clean; 9.1 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:35:14.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:14 smithi187 ceph-mon[96918]: pgmap v503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-07-21T22:35:14.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:14 smithi195 ceph-mon[97365]: pgmap v503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-07-21T22:35:14.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:14 smithi151 ceph-mon[95510]: pgmap v503: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-07-21T22:35:16.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:16 smithi187 ceph-mon[96918]: pgmap v504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-07-21T22:35:16.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:16 smithi187 ceph-mon[96918]: osdmap e108: 12 total, 12 up, 12 in 2023-07-21T22:35:16.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:16 smithi195 ceph-mon[97365]: pgmap v504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-07-21T22:35:16.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:16 smithi195 ceph-mon[97365]: osdmap e108: 12 total, 12 up, 12 in 2023-07-21T22:35:16.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:16 smithi151 ceph-mon[95510]: pgmap v504: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.3 MiB/s wr, 434 op/s 2023-07-21T22:35:16.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:16 smithi151 ceph-mon[95510]: osdmap e108: 12 total, 12 up, 12 in 2023-07-21T22:35:18.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:18 smithi187 ceph-mon[96918]: pgmap v506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.0 MiB/s wr, 516 op/s 2023-07-21T22:35:18.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:18 smithi195 ceph-mon[97365]: pgmap v506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.0 MiB/s wr, 516 op/s 2023-07-21T22:35:18.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:18 smithi151 ceph-mon[95510]: pgmap v506: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.0 MiB/s wr, 516 op/s 2023-07-21T22:35:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.931+0000 7fdfb77ff700 1 -- 172.21.15.151:0/2065396911 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb00fea30 msgr2=0x7fdfb00feea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.931+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/2065396911 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb00fea30 0x7fdfb00feea0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009990 tx=0x7fdfa0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.931+0000 7fdfb77ff700 1 -- 172.21.15.151:0/2065396911 shutdown_connections 2023-07-21T22:35:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.931+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/2065396911 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb00ff3e0 0x7fdfb010b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.931+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/2065396911 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb0104a30 0x7fdfb0104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.931+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/2065396911 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb00fea30 0x7fdfb00feea0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.931+0000 7fdfb77ff700 1 -- 172.21.15.151:0/2065396911 >> 172.21.15.151:0/2065396911 conn(0x7fdfb0074760 msgr2=0x7fdfb0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.932+0000 7fdfb77ff700 1 -- 172.21.15.151:0/2065396911 shutdown_connections 2023-07-21T22:35:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.932+0000 7fdfb77ff700 1 -- 172.21.15.151:0/2065396911 wait complete. 2023-07-21T22:35:19.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.933+0000 7fdfb77ff700 1 Processor -- start 2023-07-21T22:35:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.933+0000 7fdfb77ff700 1 -- start start 2023-07-21T22:35:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.933+0000 7fdfb77ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb00fea30 0x7fdfb0197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.933+0000 7fdfb77ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb00ff3e0 0x7fdfb0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.933+0000 7fdfb77ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb0104a30 0x7fdfb019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.933+0000 7fdfb77ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb019cf30 con 0x7fdfb00fea30 2023-07-21T22:35:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.933+0000 7fdfb77ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb019d0a0 con 0x7fdfb0104a30 2023-07-21T22:35:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.933+0000 7fdfb77ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb019d260 con 0x7fdfb00ff3e0 2023-07-21T22:35:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb559b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb00fea30 0x7fdfb0197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb4d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb00ff3e0 0x7fdfb0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb559b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb00fea30 0x7fdfb0197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51238/0 (socket says 172.21.15.151:51238) 2023-07-21T22:35:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb559b700 1 -- 172.21.15.151:0/3904784246 learned_addr learned my addr 172.21.15.151:0/3904784246 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb4d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb00ff3e0 0x7fdfb0198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54488/0 (socket says 172.21.15.151:54488) 2023-07-21T22:35:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb0104a30 0x7fdfb019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb559b700 1 -- 172.21.15.151:0/3904784246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb00ff3e0 msgr2=0x7fdfb0198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb559b700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb00ff3e0 0x7fdfb0198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb559b700 1 -- 172.21.15.151:0/3904784246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb0104a30 msgr2=0x7fdfb019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb559b700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb0104a30 0x7fdfb019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb559b700 1 -- 172.21.15.151:0/3904784246 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa00095f0 con 0x7fdfb00fea30 2023-07-21T22:35:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb0104a30 0x7fdfb019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.934+0000 7fdfb559b700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb00fea30 0x7fdfb0197d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00e970 tx=0x7fdfac00ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.935+0000 7fdfa67fc700 1 -- 172.21.15.151:0/3904784246 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac009790 con 0x7fdfb00fea30 2023-07-21T22:35:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.935+0000 7fdfb77ff700 1 -- 172.21.15.151:0/3904784246 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb019d540 con 0x7fdfb00fea30 2023-07-21T22:35:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.935+0000 7fdfa67fc700 1 -- 172.21.15.151:0/3904784246 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfac00c7e0 con 0x7fdfb00fea30 2023-07-21T22:35:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.935+0000 7fdfa67fc700 1 -- 172.21.15.151:0/3904784246 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac003bd0 con 0x7fdfb00fea30 2023-07-21T22:35:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.935+0000 7fdfb77ff700 1 -- 172.21.15.151:0/3904784246 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb01a4d80 con 0x7fdfb00fea30 2023-07-21T22:35:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.939+0000 7fdfa67fc700 1 -- 172.21.15.151:0/3904784246 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdfac00c950 con 0x7fdfb00fea30 2023-07-21T22:35:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.940+0000 7fdfa67fc700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a12c0 0x7fdf9c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.940+0000 7fdfcb0e6b80 1 Processor -- start 2023-07-21T22:35:19.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.940+0000 7fdfa67fc700 1 -- 172.21.15.151:0/3904784246 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdfac014070 con 0x7fdfb00fea30 2023-07-21T22:35:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.940+0000 7fdfcb0e6b80 1 -- start start 2023-07-21T22:35:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.940+0000 7fdfb4d9a700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a12c0 0x7fdf9c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 0x55b86610ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d210 0x55b866106f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d660 0x55b8661074a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86600cc50 con 0x55b86610d660 2023-07-21T22:35:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86605f9e0 con 0x55b865f636b0 2023-07-21T22:35:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b866058e70 con 0x55b86610d210 2023-07-21T22:35:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfb5d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d660 0x55b8661074a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfb5d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d660 0x55b8661074a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51240/0 (socket says 172.21.15.151:51240) 2023-07-21T22:35:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfb5d9c700 1 -- 172.21.15.151:0/2329275106 learned_addr learned my addr 172.21.15.151:0/2329275106 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:19.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.941+0000 7fdfb559b700 1 --2- 172.21.15.151:0/2329275106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 0x55b86610ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdfb4d9a700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a12c0 0x7fdf9c0a3770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00059d0 tx=0x7fdfa0005960 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdfb4d9a700 1 --2- 172.21.15.151:0/2329275106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d210 0x55b866106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdfb5d9c700 1 -- 172.21.15.151:0/2329275106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d210 msgr2=0x55b866106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/2329275106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d210 0x55b866106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdfb5d9c700 1 -- 172.21.15.151:0/2329275106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 msgr2=0x55b86610ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/2329275106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 0x55b86610ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdfb5d9c700 1 -- 172.21.15.151:0/2329275106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b865e86d80 con 0x55b86610d660 2023-07-21T22:35:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/2329275106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d660 0x55b8661074a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8003eb0 tx=0x7fdfa8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a151e3fb8b86a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:19.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdf9b7fe700 1 -- 172.21.15.151:0/2329275106 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa80092d0 con 0x55b86610d660 2023-07-21T22:35:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdf9b7fe700 1 -- 172.21.15.151:0/2329275106 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfa800f040 con 0x55b86610d660 2023-07-21T22:35:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.942+0000 7fdf9b7fe700 1 -- 172.21.15.151:0/2329275106 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa800e750 con 0x55b86610d660 2023-07-21T22:35:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.943+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2329275106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d660 msgr2=0x55b8661074a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.943+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2329275106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d660 0x55b8661074a0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8003eb0 tx=0x7fdfa8009920 comp rx=0 tx=0).stop 2023-07-21T22:35:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.943+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2329275106 shutdown_connections 2023-07-21T22:35:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.943+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2329275106 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 0x55b86610ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.943+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2329275106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d660 0x55b8661074a0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.943+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2329275106 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d210 0x55b866106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.943+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2329275106 >> 172.21.15.151:0/2329275106 conn(0x55b8660fcae0 msgr2=0x55b8661020e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.943+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2329275106 shutdown_connections 2023-07-21T22:35:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.944+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2329275106 wait complete. 2023-07-21T22:35:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.944+0000 7fdfcb0e6b80 1 -- start start 2023-07-21T22:35:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.944+0000 7fdfcb0e6b80 1 Processor -- start 2023-07-21T22:35:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 0x55b8661135c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 0x55b8661108b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d660 0x55b866110ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b865ff8a60 con 0x55b86610d210 2023-07-21T22:35:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b865ff8760 con 0x55b865f636b0 2023-07-21T22:35:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b865edc8c0 con 0x55b86610d660 2023-07-21T22:35:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfcb0e6b80 10 client.0 _ll_register_callbacks cb 0x55b865ff6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfb5d9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d660 0x55b866110ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfb4d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 0x55b8661108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfb5d9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d660 0x55b866110ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54520/0 (socket says 172.21.15.151:54520) 2023-07-21T22:35:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfb5d9c700 1 -- 172.21.15.151:0/1370828220 learned_addr learned my addr 172.21.15.151:0/1370828220 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.945+0000 7fdfb559b700 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 0x55b8661135c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdfb5d9c700 1 -- 172.21.15.151:0/1370828220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 msgr2=0x55b8661135c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 0x55b8661135c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdfb5d9c700 1 -- 172.21.15.151:0/1370828220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 msgr2=0x55b8661108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 0x55b8661108b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdfb5d9c700 1 -- 172.21.15.151:0/1370828220 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa8003b90 con 0x55b86610d660 2023-07-21T22:35:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d660 0x55b866110ff0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009040 tx=0x7fdfa8004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8305c963d5bc7333 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdf98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:35:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdf98ff9700 1 -- 172.21.15.151:0/1370828220 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8007700 con 0x55b86610d660 2023-07-21T22:35:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdf98ff9700 1 -- 172.21.15.151:0/1370828220 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdfa8007860 con 0x55b86610d660 2023-07-21T22:35:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.946+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/1370828220 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b865fb2490 con 0x55b86610d660 2023-07-21T22:35:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.947+0000 7fdf98ff9700 1 -- 172.21.15.151:0/1370828220 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfa8007a60 con 0x55b86610d660 2023-07-21T22:35:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.947+0000 7fdfcb0e6b80 10 client.27319 fetch_fsmap learned FSMap version 60 2023-07-21T22:35:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.947+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/1370828220 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55b865e6fc00 con 0x55b86610d660 2023-07-21T22:35:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.947+0000 7fdf98ff9700 1 -- 172.21.15.151:0/1370828220 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b865fb2490 con 0x55b86610d660 2023-07-21T22:35:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.948+0000 7fdf98ff9700 1 -- 172.21.15.151:0/1370828220 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdfa8015550 con 0x55b86610d660 2023-07-21T22:35:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.948+0000 7fdfcb0e6b80 10 client.27319 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:35:20.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.948+0000 7fdfcb0e6b80 10 client.27319 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.948+0000 7fdfcb0e6b80 20 client.27319 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.948+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b866120a30 0x55b866122e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.948+0000 7fdfcb0e6b80 4 client.27319 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:35:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.948+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/1370828220 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b866051e50 con 0x55b866120a30 2023-07-21T22:35:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.948+0000 7fdfb559b700 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b866120a30 0x55b866122e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.949+0000 7fdfb559b700 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b866120a30 0x55b866122e40 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=199ae9492c2867aa server_cookie=1b2e3137fe8a3fb8 in_seq=0 out_seq=0 2023-07-21T22:35:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.949+0000 7fdf98ff9700 10 client.27319 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.949+0000 7fdf98ff9700 1 -- 172.21.15.151:0/1370828220 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b866051e50 con 0x55b866120a30 2023-07-21T22:35:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.949+0000 7fdf98ff9700 10 client.27319 handle_command_reply: tid=0 2023-07-21T22:35:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.949+0000 7fdfcb0e6b80 1 client.27319 shutdown 2023-07-21T22:35:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/1370828220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d660 msgr2=0x55b866110ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d660 0x55b866110ff0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009040 tx=0x7fdfa8004ad0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/1370828220 shutdown_connections 2023-07-21T22:35:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b866120a30 0x55b866122e40 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b865f636b0 0x55b8661135c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86610d660 0x55b866110ff0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/1370828220 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 0x55b8661108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/1370828220 >> 172.21.15.151:0/1370828220 conn(0x55b8660fcae0 msgr2=0x55b8661013e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:20.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdf98ff9700 0 client.27319 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:20.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/1370828220 shutdown_connections 2023-07-21T22:35:20.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/1370828220 wait complete. 2023-07-21T22:35:20.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.950+0000 7fdfcb0e6b80 20 client.27319 trim_cache size 0 max 16384 2023-07-21T22:35:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.969+0000 7fdfcb0e6b80 1 Processor -- start 2023-07-21T22:35:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.969+0000 7fdfcb0e6b80 1 -- start start 2023-07-21T22:35:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8660fcae0 0x55b866117b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b865f636b0 0x55b866106f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b86610d210 0x55b8661101f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b866103760 con 0x55b865f636b0 2023-07-21T22:35:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86610ee60 con 0x55b86610d210 2023-07-21T22:35:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86610b530 con 0x55b8660fcae0 2023-07-21T22:35:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfb4d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b865f636b0 0x55b866106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfb4d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b865f636b0 0x55b866106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51250/0 (socket says 172.21.15.151:51250) 2023-07-21T22:35:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfb4d9a700 1 -- 172.21.15.151:0/3297429677 learned_addr learned my addr 172.21.15.151:0/3297429677 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfb559b700 1 --2- 172.21.15.151:0/3297429677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8660fcae0 0x55b866117b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/3297429677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b86610d210 0x55b8661101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfb559b700 1 -- 172.21.15.151:0/3297429677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b86610d210 msgr2=0x55b8661101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfb559b700 1 --2- 172.21.15.151:0/3297429677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b86610d210 0x55b8661101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfb559b700 1 -- 172.21.15.151:0/3297429677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b865f636b0 msgr2=0x55b866106f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.970+0000 7fdfb559b700 1 --2- 172.21.15.151:0/3297429677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b865f636b0 0x55b866106f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.971+0000 7fdfb559b700 1 -- 172.21.15.151:0/3297429677 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b865ead1f0 con 0x55b8660fcae0 2023-07-21T22:35:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.971+0000 7fdfb559b700 1 --2- 172.21.15.151:0/3297429677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8660fcae0 0x55b866117b80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0ca5c0 tx=0x7fdfac00cf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=810687daa36a648d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.971+0000 7fdf9bfff700 1 -- 172.21.15.151:0/3297429677 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac09df70 con 0x55b8660fcae0 2023-07-21T22:35:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.971+0000 7fdf9bfff700 1 -- 172.21.15.151:0/3297429677 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfac0a2390 con 0x55b8660fcae0 2023-07-21T22:35:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.971+0000 7fdf9bfff700 1 -- 172.21.15.151:0/3297429677 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0ca840 con 0x55b8660fcae0 2023-07-21T22:35:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/3297429677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8660fcae0 msgr2=0x55b866117b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/3297429677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8660fcae0 0x55b866117b80 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0ca5c0 tx=0x7fdfac00cf50 comp rx=0 tx=0).stop 2023-07-21T22:35:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/3297429677 shutdown_connections 2023-07-21T22:35:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/3297429677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b86610d210 0x55b8661101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/3297429677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8660fcae0 0x55b866117b80 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/3297429677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b865f636b0 0x55b866106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/3297429677 >> 172.21.15.151:0/3297429677 conn(0x55b86611d140 msgr2=0x55b86610a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/3297429677 shutdown_connections 2023-07-21T22:35:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/3297429677 wait complete. 2023-07-21T22:35:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.972+0000 7fdfcb0e6b80 1 -- start start 2023-07-21T22:35:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfcb0e6b80 1 Processor -- start 2023-07-21T22:35:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b865f636b0 0x55b8661178a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b8660fcae0 0x55b866108830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfcb0e6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 0x55b866108d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b866117f70 con 0x55b86610d210 2023-07-21T22:35:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8661180e0 con 0x55b8660fcae0 2023-07-21T22:35:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfcb0e6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8661092b0 con 0x55b865f636b0 2023-07-21T22:35:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfcb0e6b80 10 client.0 _ll_register_callbacks cb 0x7fdfac095b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfb559b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b865f636b0 0x55b8661178a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfb559b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b865f636b0 0x55b8661178a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54542/0 (socket says 172.21.15.151:54542) 2023-07-21T22:35:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfb4d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b8660fcae0 0x55b866108830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.973+0000 7fdfb559b700 1 -- 172.21.15.151:0/2100002272 learned_addr learned my addr 172.21.15.151:0/2100002272 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:20.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdfb5d9c700 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 0x55b866108d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdfb559b700 1 -- 172.21.15.151:0/2100002272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b8660fcae0 msgr2=0x55b866108830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdfb559b700 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b8660fcae0 0x55b866108830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdfb559b700 1 -- 172.21.15.151:0/2100002272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 msgr2=0x55b866108d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdfb559b700 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 0x55b866108d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdfb559b700 1 -- 172.21.15.151:0/2100002272 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb01a4d80 con 0x55b865f636b0 2023-07-21T22:35:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdfb559b700 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b865f636b0 0x55b8661178a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdfac096440 tx=0x7fdfac005c80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b46edf49e4522fa9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:20.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdf98ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:35:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdf98ff9700 1 -- 172.21.15.151:0/2100002272 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac0b8200 con 0x55b865f636b0 2023-07-21T22:35:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdf98ff9700 1 -- 172.21.15.151:0/2100002272 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdfac096650 con 0x55b865f636b0 2023-07-21T22:35:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2100002272 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdfa800f040 con 0x55b865f636b0 2023-07-21T22:35:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.974+0000 7fdf98ff9700 1 -- 172.21.15.151:0/2100002272 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfac0b8360 con 0x55b865f636b0 2023-07-21T22:35:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdfcb0e6b80 10 client.27325 fetch_fsmap learned FSMap version 60 2023-07-21T22:35:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2100002272 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x55b865e85250 con 0x55b865f636b0 2023-07-21T22:35:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdf98ff9700 1 -- 172.21.15.151:0/2100002272 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfa800f040 con 0x55b865f636b0 2023-07-21T22:35:20.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdf98ff9700 1 -- 172.21.15.151:0/2100002272 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fdfac09a2f0 con 0x55b865f636b0 2023-07-21T22:35:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdfcb0e6b80 10 client.27325 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:35:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdfcb0e6b80 10 client.27325 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdfcb0e6b80 20 client.27325 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b86610d660 0x55b8661775a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdfcb0e6b80 4 client.27325 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:35:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.975+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2100002272 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b866013ff0 con 0x55b86610d660 2023-07-21T22:35:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.976+0000 7fdfb4d9a700 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b86610d660 0x55b8661775a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:20.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.976+0000 7fdfb4d9a700 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b86610d660 0x55b8661775a0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80353752cab38466 server_cookie=eeffafd1ece551b in_seq=0 out_seq=0 2023-07-21T22:35:20.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.976+0000 7fdf98ff9700 10 client.27325 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.984+0000 7fdf98ff9700 1 -- 172.21.15.151:0/2100002272 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b866013ff0 con 0x55b86610d660 2023-07-21T22:35:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.984+0000 7fdf98ff9700 10 client.27325 handle_command_reply: tid=0 2023-07-21T22:35:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.984+0000 7fdfcb0e6b80 1 client.27325 shutdown 2023-07-21T22:35:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2100002272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b865f636b0 msgr2=0x55b8661178a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b865f636b0 0x55b8661178a0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdfac096440 tx=0x7fdfac005c80 comp rx=0 tx=0).stop 2023-07-21T22:35:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2100002272 shutdown_connections 2023-07-21T22:35:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b86610d660 0x55b8661775a0 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86610d210 0x55b866108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b865f636b0 0x55b8661178a0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdf98ff9700 0 client.27325 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 --2- 172.21.15.151:0/2100002272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b8660fcae0 0x55b866108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2100002272 >> 172.21.15.151:0/2100002272 conn(0x55b86611d140 msgr2=0x55b86610b940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2100002272 shutdown_connections 2023-07-21T22:35:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 1 -- 172.21.15.151:0/2100002272 wait complete. 2023-07-21T22:35:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.985+0000 7fdfcb0e6b80 20 client.27325 trim_cache size 0 max 16384 2023-07-21T22:35:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:35:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:35:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:35:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:35:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 -- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a12c0 msgr2=0x7fdf9c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a12c0 0x7fdf9c0a3770 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00059d0 tx=0x7fdfa0005960 comp rx=0 tx=0).stop 2023-07-21T22:35:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 -- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb00fea30 msgr2=0x7fdfb0197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb00fea30 0x7fdfb0197d40 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00e970 tx=0x7fdfac00ec80 comp rx=0 tx=0).stop 2023-07-21T22:35:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 -- 172.21.15.151:0/3904784246 shutdown_connections 2023-07-21T22:35:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a12c0 0x7fdf9c0a3770 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb0104a30 0x7fdfb019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb00fea30 0x7fdfb0197d40 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 --2- 172.21.15.151:0/3904784246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb00ff3e0 0x7fdfb0198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 -- 172.21.15.151:0/3904784246 >> 172.21.15.151:0/3904784246 conn(0x7fdfb0074760 msgr2=0x7fdfb00fd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 -- 172.21.15.151:0/3904784246 shutdown_connections 2023-07-21T22:35:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:19.986+0000 7fdfb77ff700 1 -- 172.21.15.151:0/3904784246 wait complete. 2023-07-21T22:35:20.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:20 smithi187 ceph-mon[96918]: pgmap v507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.3 MiB/s wr, 432 op/s 2023-07-21T22:35:20.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:20 smithi195 ceph-mon[97365]: pgmap v507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.3 MiB/s wr, 432 op/s 2023-07-21T22:35:20.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:20 smithi151 ceph-mon[95510]: pgmap v507: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.3 MiB/s wr, 432 op/s 2023-07-21T22:35:22.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:22 smithi187 ceph-mon[96918]: pgmap v508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 MiB/s wr, 413 op/s 2023-07-21T22:35:22.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:22 smithi195 ceph-mon[97365]: pgmap v508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 MiB/s wr, 413 op/s 2023-07-21T22:35:22.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:22 smithi151 ceph-mon[95510]: pgmap v508: 97 pgs: 97 active+clean; 8.7 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.1 KiB/s rd, 3.2 MiB/s wr, 413 op/s 2023-07-21T22:35:24.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:24 smithi187 ceph-mon[96918]: pgmap v509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 428 op/s 2023-07-21T22:35:24.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:24 smithi195 ceph-mon[97365]: pgmap v509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 428 op/s 2023-07-21T22:35:24.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:24 smithi151 ceph-mon[95510]: pgmap v509: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 428 op/s 2023-07-21T22:35:26.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:26 smithi187 ceph-mon[96918]: pgmap v510: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 428 op/s 2023-07-21T22:35:26.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:26 smithi195 ceph-mon[97365]: pgmap v510: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 428 op/s 2023-07-21T22:35:26.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:26 smithi151 ceph-mon[95510]: pgmap v510: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.3 MiB/s wr, 428 op/s 2023-07-21T22:35:28.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:28 smithi187 ceph-mon[96918]: pgmap v511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.6 MiB/s wr, 598 op/s 2023-07-21T22:35:28.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:28 smithi195 ceph-mon[97365]: pgmap v511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.6 MiB/s wr, 598 op/s 2023-07-21T22:35:28.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:28 smithi151 ceph-mon[95510]: pgmap v511: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 4.6 MiB/s wr, 598 op/s 2023-07-21T22:35:30.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:30 smithi187 ceph-mon[96918]: pgmap v512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:35:30.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:30 smithi195 ceph-mon[97365]: pgmap v512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:35:30.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:30 smithi151 ceph-mon[95510]: pgmap v512: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:35:32.884 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:32 smithi187 ceph-mon[96918]: pgmap v513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:35:32.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:32 smithi195 ceph-mon[97365]: pgmap v513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:35:32.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:32 smithi151 ceph-mon[95510]: pgmap v513: 97 pgs: 97 active+clean; 8.7 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:35:33.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.138+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/114286657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 msgr2=0x7fc0a01000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.138+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/114286657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 0x7fc0a01000f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009990 tx=0x7fc09c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.138+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/114286657 shutdown_connections 2023-07-21T22:35:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.138+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/114286657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a0101e50 0x7fc0a010c8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.138+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/114286657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 0x7fc0a01000f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.138+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/114286657 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a01014a0 0x7fc0a0101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.138+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/114286657 >> 172.21.15.151:0/114286657 conn(0x7fc0a00fb440 msgr2=0x7fc0a00fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.138+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/114286657 shutdown_connections 2023-07-21T22:35:33.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.138+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/114286657 wait complete. 2023-07-21T22:35:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.139+0000 7fc0a6b9d700 1 Processor -- start 2023-07-21T22:35:33.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.139+0000 7fc0a6b9d700 1 -- start start 2023-07-21T22:35:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a6b9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 0x7fc0a0072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a6b9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a01014a0 0x7fc0a0072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a6b9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a0101e50 0x7fc0a01a3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a6b9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a0073580 con 0x7fc0a00ffd20 2023-07-21T22:35:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a6b9d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a01a40f0 con 0x7fc0a0101e50 2023-07-21T22:35:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a6b9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0a01a4230 con 0x7fc0a01014a0 2023-07-21T22:35:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 0x7fc0a0072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a539a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a01014a0 0x7fc0a0072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 0x7fc0a0072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58304/0 (socket says 172.21.15.151:58304) 2023-07-21T22:35:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/3992442621 learned_addr learned my addr 172.21.15.151:0/3992442621 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a639c700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a0101e50 0x7fc0a01a3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/3992442621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a01014a0 msgr2=0x7fc0a0072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a01014a0 0x7fc0a0072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/3992442621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a0101e50 msgr2=0x7fc0a01a3bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a0101e50 0x7fc0a01a3bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/3992442621 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc09c0095f0 con 0x7fc0a00ffd20 2023-07-21T22:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.140+0000 7fc0a539a700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a01014a0 0x7fc0a0072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.141+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 0x7fc0a0072810 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000c00 tx=0x7fc09c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.141+0000 7fc096ffd700 1 -- 172.21.15.151:0/3992442621 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c01d070 con 0x7fc0a00ffd20 2023-07-21T22:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.141+0000 7fc096ffd700 1 -- 172.21.15.151:0/3992442621 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc09c022470 con 0x7fc0a00ffd20 2023-07-21T22:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.141+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/3992442621 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0a01a4430 con 0x7fc0a00ffd20 2023-07-21T22:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.141+0000 7fc096ffd700 1 -- 172.21.15.151:0/3992442621 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c017650 con 0x7fc0a00ffd20 2023-07-21T22:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.141+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/3992442621 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a01a48b0 con 0x7fc0a00ffd20 2023-07-21T22:35:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.144+0000 7fc096ffd700 1 -- 172.21.15.151:0/3992442621 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fc09c0225e0 con 0x7fc0a00ffd20 2023-07-21T22:35:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.146+0000 7fc0bb74db80 1 Processor -- start 2023-07-21T22:35:33.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.146+0000 7fc096ffd700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc08c0a12c0 0x7fc08c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.146+0000 7fc096ffd700 1 -- 172.21.15.151:0/3992442621 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc09c0ce0f0 con 0x7fc0a00ffd20 2023-07-21T22:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.146+0000 7fc0bb74db80 1 -- start start 2023-07-21T22:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.146+0000 7fc0a639c700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc08c0a12c0 0x7fc08c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede833f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede834480 0x563ede82e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede82e5e0 0x563ede82ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede733c50 con 0x563ede68a6b0 2023-07-21T22:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede7869e0 con 0x563ede82e5e0 2023-07-21T22:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede77fe70 con 0x563ede834480 2023-07-21T22:35:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede833f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a639c700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc08c0a12c0 0x7fc08c0a3770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0074920 tx=0x7fc09800b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede833f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58306/0 (socket says 172.21.15.151:58306) 2023-07-21T22:35:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/2823017211 learned_addr learned my addr 172.21.15.151:0/2823017211 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a539a700 1 --2- 172.21.15.151:0/2823017211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede834480 0x563ede82e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/2823017211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede834480 msgr2=0x563ede82e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/2823017211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede834480 0x563ede82e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/2823017211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede82e5e0 msgr2=0x563ede82ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/2823017211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede82e5e0 0x563ede82ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.147+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/2823017211 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ede5add80 con 0x563ede68a6b0 2023-07-21T22:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.148+0000 7fc0a539a700 1 --2- 172.21.15.151:0/2823017211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede834480 0x563ede82e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.148+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/2823017211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede833f40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0a30a0 tx=0x7fc09c097670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54922e593ffa8fb8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.148+0000 7fc08bfff700 1 -- 172.21.15.151:0/2823017211 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c09f030 con 0x563ede68a6b0 2023-07-21T22:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.148+0000 7fc08bfff700 1 -- 172.21.15.151:0/2823017211 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc09c0228c0 con 0x563ede68a6b0 2023-07-21T22:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.148+0000 7fc08bfff700 1 -- 172.21.15.151:0/2823017211 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c09b470 con 0x563ede68a6b0 2023-07-21T22:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 -- 172.21.15.151:0/2823017211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 msgr2=0x563ede833f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/2823017211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede833f40 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc09c0a30a0 tx=0x7fc09c097670 comp rx=0 tx=0).stop 2023-07-21T22:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 -- 172.21.15.151:0/2823017211 shutdown_connections 2023-07-21T22:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/2823017211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede82e5e0 0x563ede82ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/2823017211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede833f40 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/2823017211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede834480 0x563ede82e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 -- 172.21.15.151:0/2823017211 >> 172.21.15.151:0/2823017211 conn(0x563ede823c40 msgr2=0x563ede829300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 -- 172.21.15.151:0/2823017211 shutdown_connections 2023-07-21T22:35:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 -- 172.21.15.151:0/2823017211 wait complete. 2023-07-21T22:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.149+0000 7fc0bb74db80 1 -- start start 2023-07-21T22:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0bb74db80 1 Processor -- start 2023-07-21T22:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede83d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede82e5e0 0x563ede83da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede837790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede71fa60 con 0x563ede68a6b0 2023-07-21T22:35:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede71f760 con 0x563ede834480 2023-07-21T22:35:33.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede6038c0 con 0x563ede82e5e0 2023-07-21T22:35:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0bb74db80 10 client.0 _ll_register_callbacks cb 0x563ede71d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede83d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede83d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58316/0 (socket says 172.21.15.151:58316) 2023-07-21T22:35:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0a539a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede82e5e0 0x563ede83da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/1650488203 learned_addr learned my addr 172.21.15.151:0/1650488203 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.150+0000 7fc0a639c700 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede837790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/1650488203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede82e5e0 msgr2=0x563ede83da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede82e5e0 0x563ede83da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/1650488203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 msgr2=0x563ede837790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede837790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/1650488203 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc090009c90 con 0x563ede68a6b0 2023-07-21T22:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede83d540 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc09c006010 tx=0x7fc09c09ac30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aee418e746b9e70 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0897fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0897fa700 1 -- 172.21.15.151:0/1650488203 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c09b210 con 0x563ede68a6b0 2023-07-21T22:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0897fa700 1 -- 172.21.15.151:0/1650488203 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc09c09f240 con 0x563ede68a6b0 2023-07-21T22:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1650488203 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563ede6d9490 con 0x563ede68a6b0 2023-07-21T22:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0897fa700 1 -- 172.21.15.151:0/1650488203 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc09c0a3140 con 0x563ede68a6b0 2023-07-21T22:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0bb74db80 10 client.17622 fetch_fsmap learned FSMap version 60 2023-07-21T22:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.151+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1650488203 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x7fc0a01a48b0 con 0x563ede68a6b0 2023-07-21T22:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.152+0000 7fc0897fa700 1 -- 172.21.15.151:0/1650488203 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563ede6d9490 con 0x563ede68a6b0 2023-07-21T22:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.152+0000 7fc0897fa700 1 -- 172.21.15.151:0/1650488203 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc09c0b9350 con 0x563ede68a6b0 2023-07-21T22:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.152+0000 7fc0bb74db80 10 client.17622 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.152+0000 7fc0bb74db80 10 client.17622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.152+0000 7fc0bb74db80 20 client.17622 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.152+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563ede847590 0x563ede8499a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.152+0000 7fc0bb74db80 4 client.17622 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.152+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1650488203 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563ede778e50 con 0x563ede847590 2023-07-21T22:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.152+0000 7fc0a539a700 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563ede847590 0x563ede8499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.153+0000 7fc0897fa700 10 client.17622 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.153+0000 7fc0a539a700 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563ede847590 0x563ede8499a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb0ddaf0290d2815 server_cookie=6c8dfe610a38e2a2 in_seq=0 out_seq=0 2023-07-21T22:35:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0897fa700 1 -- 172.21.15.151:0/1650488203 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563ede778e50 con 0x563ede847590 2023-07-21T22:35:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0897fa700 10 client.17622 handle_command_reply: tid=0 2023-07-21T22:35:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 client.17622 shutdown 2023-07-21T22:35:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1650488203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 msgr2=0x563ede83d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede83d540 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc09c006010 tx=0x7fc09c09ac30 comp rx=0 tx=0).stop 2023-07-21T22:35:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1650488203 shutdown_connections 2023-07-21T22:35:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563ede847590 0x563ede8499a0 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede837790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede68a6b0 0x563ede83d540 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1650488203 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede82e5e0 0x563ede83da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1650488203 >> 172.21.15.151:0/1650488203 conn(0x563ede823c40 msgr2=0x563ede828540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0897fa700 0 client.17622 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1650488203 shutdown_connections 2023-07-21T22:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1650488203 wait complete. 2023-07-21T22:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.154+0000 7fc0bb74db80 20 client.17622 trim_cache size 0 max 16384 2023-07-21T22:35:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.170+0000 7fc0bb74db80 1 Processor -- start 2023-07-21T22:35:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.170+0000 7fc0bb74db80 1 -- start start 2023-07-21T22:35:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede837740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 0x563ede830900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede830e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede825d60 con 0x563ede82e5e0 2023-07-21T22:35:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede838740 con 0x563ede834480 2023-07-21T22:35:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede82a6d0 con 0x563ede68a6b0 2023-07-21T22:35:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0a539a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 0x563ede830900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede837740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede837740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57792/0 (socket says 172.21.15.151:57792) 2023-07-21T22:35:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/156415361 learned_addr learned my addr 172.21.15.151:0/156415361 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0a639c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede830e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/156415361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 msgr2=0x563ede830e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/156415361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede830e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/156415361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 msgr2=0x563ede830900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.171+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/156415361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 0x563ede830900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.172+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/156415361 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563ede596c00 con 0x563ede68a6b0 2023-07-21T22:35:33.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.172+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/156415361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede837740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc09c022c70 tx=0x7fc09c0cbd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=363bb156b9018314 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.172+0000 7fc094bff700 1 -- 172.21.15.151:0/156415361 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c09f240 con 0x563ede68a6b0 2023-07-21T22:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.172+0000 7fc094bff700 1 -- 172.21.15.151:0/156415361 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc09c09b210 con 0x563ede68a6b0 2023-07-21T22:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.172+0000 7fc094bff700 1 -- 172.21.15.151:0/156415361 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0cb2f0 con 0x563ede68a6b0 2023-07-21T22:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 -- 172.21.15.151:0/156415361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 msgr2=0x563ede837740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/156415361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede837740 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc09c022c70 tx=0x7fc09c0cbd60 comp rx=0 tx=0).stop 2023-07-21T22:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 -- 172.21.15.151:0/156415361 shutdown_connections 2023-07-21T22:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/156415361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede830e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/156415361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede837740 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/156415361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 0x563ede830900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 -- 172.21.15.151:0/156415361 >> 172.21.15.151:0/156415361 conn(0x563ede823c40 msgr2=0x563ede837030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 -- 172.21.15.151:0/156415361 shutdown_connections 2023-07-21T22:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 -- 172.21.15.151:0/156415361 wait complete. 2023-07-21T22:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.173+0000 7fc0bb74db80 1 -- start start 2023-07-21T22:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0bb74db80 1 Processor -- start 2023-07-21T22:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede83b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 0x563ede83b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0bb74db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede83bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede89a5c0 con 0x563ede82e5e0 2023-07-21T22:35:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede89a730 con 0x563ede834480 2023-07-21T22:35:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0bb74db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563ede89a8f0 con 0x563ede68a6b0 2023-07-21T22:35:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0bb74db80 10 client.0 _ll_register_callbacks cb 0x7fc090009be0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede83b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0a539a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 0x563ede83b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0a5b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede83b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57798/0 (socket says 172.21.15.151:57798) 2023-07-21T22:35:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/1478766291 learned_addr learned my addr 172.21.15.151:0/1478766291 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.174+0000 7fc0a639c700 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede83bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/1478766291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 msgr2=0x563ede83bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede83bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/1478766291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 msgr2=0x563ede83b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 0x563ede83b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0a5b9b700 1 -- 172.21.15.151:0/1478766291 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0a01a48b0 con 0x563ede68a6b0 2023-07-21T22:35:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0a5b9b700 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede83b0b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc09c022a50 tx=0x7fc09c09ac30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87977305b1a566b7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0897fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:35:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0897fa700 1 -- 172.21.15.151:0/1478766291 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0cb4f0 con 0x563ede68a6b0 2023-07-21T22:35:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0897fa700 1 -- 172.21.15.151:0/1478766291 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc09c0a35d0 con 0x563ede68a6b0 2023-07-21T22:35:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1478766291 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc09c0228c0 con 0x563ede68a6b0 2023-07-21T22:35:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0897fa700 1 -- 172.21.15.151:0/1478766291 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc09c097000 con 0x563ede68a6b0 2023-07-21T22:35:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0bb74db80 10 client.27343 fetch_fsmap learned FSMap version 60 2023-07-21T22:35:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.175+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1478766291 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=4+}) v3 -- 0x563ede5d41f0 con 0x563ede68a6b0 2023-07-21T22:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.176+0000 7fc0897fa700 1 -- 172.21.15.151:0/1478766291 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc09c0be080 con 0x563ede68a6b0 2023-07-21T22:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.176+0000 7fc0897fa700 1 -- 172.21.15.151:0/1478766291 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 60) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc09c00fac0 con 0x563ede68a6b0 2023-07-21T22:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.176+0000 7fc0bb74db80 10 client.27343 fetch_fsmap finished waiting for FSMap version 60 2023-07-21T22:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.176+0000 7fc0bb74db80 10 client.27343 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.176+0000 7fc0bb74db80 20 client.27343 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.176+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563ede89bb10 0x563ede89def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.176+0000 7fc0bb74db80 4 client.27343 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.176+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1478766291 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563ede73aff0 con 0x563ede89bb10 2023-07-21T22:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.176+0000 7fc0a539a700 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563ede89bb10 0x563ede89def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.177+0000 7fc0a539a700 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563ede89bb10 0x563ede89def0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77f961f5cb38f66b server_cookie=266e40ba06fe8e7c in_seq=0 out_seq=0 2023-07-21T22:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.177+0000 7fc0897fa700 10 client.27343 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.185+0000 7fc0897fa700 1 -- 172.21.15.151:0/1478766291 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563ede73aff0 con 0x563ede89bb10 2023-07-21T22:35:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.185+0000 7fc0897fa700 10 client.27343 handle_command_reply: tid=0 2023-07-21T22:35:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.185+0000 7fc0bb74db80 1 client.27343 shutdown 2023-07-21T22:35:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1478766291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 msgr2=0x563ede83b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede83b0b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fc09c022a50 tx=0x7fc09c09ac30 comp rx=0 tx=0).stop 2023-07-21T22:35:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1478766291 shutdown_connections 2023-07-21T22:35:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563ede89bb10 0x563ede89def0 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563ede834480 0x563ede83bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563ede68a6b0 0x563ede83b0b0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 --2- 172.21.15.151:0/1478766291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ede82e5e0 0x563ede83b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0897fa700 0 client.27343 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1478766291 >> 172.21.15.151:0/1478766291 conn(0x563ede823c40 msgr2=0x563ede834ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1478766291 shutdown_connections 2023-07-21T22:35:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 1 -- 172.21.15.151:0/1478766291 wait complete. 2023-07-21T22:35:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.186+0000 7fc0bb74db80 20 client.27343 trim_cache size 0 max 16384 2023-07-21T22:35:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:35:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:35:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:35:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:35:33.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc08c0a12c0 msgr2=0x7fc08c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc08c0a12c0 0x7fc08c0a3770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0074920 tx=0x7fc09800b040 comp rx=0 tx=0).stop 2023-07-21T22:35:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 msgr2=0x7fc0a0072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 0x7fc0a0072810 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fc09c000c00 tx=0x7fc09c004730 comp rx=0 tx=0).stop 2023-07-21T22:35:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/3992442621 shutdown_connections 2023-07-21T22:35:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc08c0a12c0 0x7fc08c0a3770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0a0101e50 0x7fc0a01a3bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0a00ffd20 0x7fc0a0072810 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 --2- 172.21.15.151:0/3992442621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc0a01014a0 0x7fc0a0072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/3992442621 >> 172.21.15.151:0/3992442621 conn(0x7fc0a00fb440 msgr2=0x7fc0a00fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/3992442621 shutdown_connections 2023-07-21T22:35:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:33.187+0000 7fc0a6b9d700 1 -- 172.21.15.151:0/3992442621 wait complete. 2023-07-21T22:35:34.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:34 smithi187 ceph-mon[96918]: pgmap v514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.3 MiB/s wr, 552 op/s 2023-07-21T22:35:34.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:34 smithi195 ceph-mon[97365]: pgmap v514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.3 MiB/s wr, 552 op/s 2023-07-21T22:35:34.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:34 smithi151 ceph-mon[95510]: pgmap v514: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 4.3 MiB/s wr, 552 op/s 2023-07-21T22:35:36.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:36 smithi187 ceph-mon[96918]: pgmap v515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.9 MiB/s wr, 365 op/s 2023-07-21T22:35:36.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:36 smithi195 ceph-mon[97365]: pgmap v515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.9 MiB/s wr, 365 op/s 2023-07-21T22:35:36.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:36 smithi151 ceph-mon[95510]: pgmap v515: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.9 MiB/s wr, 365 op/s 2023-07-21T22:35:38.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:38 smithi187 ceph-mon[96918]: pgmap v516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.3 MiB/s wr, 546 op/s 2023-07-21T22:35:38.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:38 smithi195 ceph-mon[97365]: pgmap v516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.3 MiB/s wr, 546 op/s 2023-07-21T22:35:38.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:38 smithi151 ceph-mon[95510]: pgmap v516: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.3 MiB/s wr, 546 op/s 2023-07-21T22:35:40.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:40 smithi187 ceph-mon[96918]: pgmap v517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:35:40.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:40 smithi195 ceph-mon[97365]: pgmap v517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:35:40.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:40 smithi151 ceph-mon[95510]: pgmap v517: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:35:42.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:42 smithi187 ceph-mon[96918]: pgmap v518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:35:42.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:42 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:35:42.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:42 smithi195 ceph-mon[97365]: pgmap v518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:35:42.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:42 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:35:42.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:42 smithi151 ceph-mon[95510]: pgmap v518: 97 pgs: 97 active+clean; 8.7 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:35:42.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:42 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:35:44.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:44 smithi187 ceph-mon[96918]: pgmap v519: 97 pgs: 97 active+clean; 8.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 4.3 MiB/s wr, 554 op/s 2023-07-21T22:35:44.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:44 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:35:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:44 smithi195 ceph-mon[97365]: pgmap v519: 97 pgs: 97 active+clean; 8.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 4.3 MiB/s wr, 554 op/s 2023-07-21T22:35:44.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:44 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:35:44.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:44 smithi151 ceph-mon[95510]: pgmap v519: 97 pgs: 97 active+clean; 8.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 4.3 MiB/s wr, 554 op/s 2023-07-21T22:35:44.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:44 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:35:45.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:45 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:35:45.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:45 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:35:45.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:45 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:35:45.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:45 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:35:45.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:45 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:35:45.910 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:45 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:35:45.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:45 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:35:45.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:45 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:35:45.952 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:45 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.370+0000 7f521359e700 1 -- 172.21.15.151:0/2117453274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5214101db0 msgr2=0x7f5214102180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.370+0000 7f521359e700 1 --2- 172.21.15.151:0/2117453274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5214101db0 0x7f5214102180 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f52040099c0 tx=0x7f5204009cd0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.370+0000 7f521359e700 1 -- 172.21.15.151:0/2117453274 shutdown_connections 2023-07-21T22:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.370+0000 7f521359e700 1 --2- 172.21.15.151:0/2117453274 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5214106df0 0x7f521410e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.370+0000 7f521359e700 1 --2- 172.21.15.151:0/2117453274 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5214101db0 0x7f5214102180 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.370+0000 7f521359e700 1 --2- 172.21.15.151:0/2117453274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5214102750 0x7f5214106710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.370+0000 7f521359e700 1 -- 172.21.15.151:0/2117453274 >> 172.21.15.151:0/2117453274 conn(0x7f52140fd660 msgr2=0x7f52140ffa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.370+0000 7f521359e700 1 -- 172.21.15.151:0/2117453274 shutdown_connections 2023-07-21T22:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.370+0000 7f521359e700 1 -- 172.21.15.151:0/2117453274 wait complete. 2023-07-21T22:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.371+0000 7f521359e700 1 Processor -- start 2023-07-21T22:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521359e700 1 -- start start 2023-07-21T22:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521359e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5214101db0 0x7f5214197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5214102750 0x7f52141982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5214106df0 0x7f521419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521359e700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521419cd40 con 0x7f5214106df0 2023-07-21T22:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521359e700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521419ceb0 con 0x7f5214101db0 2023-07-21T22:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521359e700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f521419d070 con 0x7f5214102750 2023-07-21T22:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f5212d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5214106df0 0x7f521419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5214101db0 0x7f5214197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f5211d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5214102750 0x7f52141982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5214101db0 0x7f5214197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41102/0 (socket says 172.21.15.151:41102) 2023-07-21T22:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.372+0000 7f521259c700 1 -- 172.21.15.151:0/1621830038 learned_addr learned my addr 172.21.15.151:0/1621830038 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f5211d9b700 1 -- 172.21.15.151:0/1621830038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5214101db0 msgr2=0x7f5214197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f5211d9b700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5214101db0 0x7f5214197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f5211d9b700 1 -- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5214106df0 msgr2=0x7f521419c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f5211d9b700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5214106df0 0x7f521419c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f5211d9b700 1 -- 172.21.15.151:0/1621830038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52040095f0 con 0x7f5214102750 2023-07-21T22:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f5212d9d700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5214106df0 0x7f521419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f521259c700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5214101db0 0x7f5214197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f5211d9b700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5214102750 0x7f52141982a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5214102b20 tx=0x7f520800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f52037fe700 1 -- 172.21.15.151:0/1621830038 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208010900 con 0x7f5214102750 2023-07-21T22:35:46.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f52037fe700 1 -- 172.21.15.151:0/1621830038 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f520800c430 con 0x7f5214102750 2023-07-21T22:35:46.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.373+0000 7f521359e700 1 -- 172.21.15.151:0/1621830038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f521419d350 con 0x7f5214102750 2023-07-21T22:35:46.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.374+0000 7f52037fe700 1 -- 172.21.15.151:0/1621830038 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5208018680 con 0x7f5214102750 2023-07-21T22:35:46.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.374+0000 7f521359e700 1 -- 172.21.15.151:0/1621830038 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52141a4b90 con 0x7f5214102750 2023-07-21T22:35:46.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.378+0000 7f52037fe700 1 -- 172.21.15.151:0/1621830038 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f520800c5a0 con 0x7f5214102750 2023-07-21T22:35:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.378+0000 7f522c59fb80 1 Processor -- start 2023-07-21T22:35:46.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f522c59fb80 1 -- start start 2023-07-21T22:35:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f622df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f62280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6228a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f522c59fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f612dc50 con 0x5647f60846b0 2023-07-21T22:35:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f522c59fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f61809e0 con 0x5647f622e480 2023-07-21T22:35:46.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f522c59fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f6179e70 con 0x5647f62285e0 2023-07-21T22:35:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f5212d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f622df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f521259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f62280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f5212d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f622df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53764/0 (socket says 172.21.15.151:53764) 2023-07-21T22:35:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.379+0000 7f5212d9d700 1 -- 172.21.15.151:0/889012680 learned_addr learned my addr 172.21.15.151:0/889012680 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f52037fe700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f51fc0a12c0 0x7f51fc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f5211d9b700 1 --2- 172.21.15.151:0/889012680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6228a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f521259c700 1 -- 172.21.15.151:0/889012680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 msgr2=0x5647f6228a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f521259c700 1 --2- 172.21.15.151:0/889012680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6228a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f521259c700 1 -- 172.21.15.151:0/889012680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 msgr2=0x5647f622df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f521259c700 1 --2- 172.21.15.151:0/889012680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f622df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f521259c700 1 -- 172.21.15.151:0/889012680 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f5fa7d80 con 0x5647f622e480 2023-07-21T22:35:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f52037fe700 1 -- 172.21.15.151:0/1621830038 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5208014070 con 0x7f5214102750 2023-07-21T22:35:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f5211d9b700 1 --2- 172.21.15.151:0/889012680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6228a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:35:46.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f5212d9d700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f51fc0a12c0 0x7f51fc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.380+0000 7f521259c700 1 --2- 172.21.15.151:0/889012680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f62280a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5204006010 tx=0x7f5204005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=167d41171883ee5e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.381+0000 7f5200ff9700 1 -- 172.21.15.151:0/889012680 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520400bdc0 con 0x5647f622e480 2023-07-21T22:35:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.381+0000 7f5200ff9700 1 -- 172.21.15.151:0/889012680 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f520401e040 con 0x5647f622e480 2023-07-21T22:35:46.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.381+0000 7f5200ff9700 1 -- 172.21.15.151:0/889012680 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204003dc0 con 0x5647f622e480 2023-07-21T22:35:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.381+0000 7f5212d9d700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f51fc0a12c0 0x7f51fc0a3770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f520c009790 tx=0x7f520c00b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.381+0000 7f522c59fb80 1 -- 172.21.15.151:0/889012680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 msgr2=0x5647f62280a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.381+0000 7f522c59fb80 1 --2- 172.21.15.151:0/889012680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f62280a0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5204006010 tx=0x7f5204005c70 comp rx=0 tx=0).stop 2023-07-21T22:35:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.382+0000 7f522c59fb80 1 -- 172.21.15.151:0/889012680 shutdown_connections 2023-07-21T22:35:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.382+0000 7f522c59fb80 1 --2- 172.21.15.151:0/889012680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6228a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.382+0000 7f522c59fb80 1 --2- 172.21.15.151:0/889012680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f622df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.382+0000 7f522c59fb80 1 --2- 172.21.15.151:0/889012680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f62280a0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.382+0000 7f522c59fb80 1 -- 172.21.15.151:0/889012680 >> 172.21.15.151:0/889012680 conn(0x5647f621dc40 msgr2=0x5647f6223300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.382+0000 7f522c59fb80 1 -- 172.21.15.151:0/889012680 shutdown_connections 2023-07-21T22:35:46.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.382+0000 7f522c59fb80 1 -- 172.21.15.151:0/889012680 wait complete. 2023-07-21T22:35:46.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.382+0000 7f522c59fb80 1 -- start start 2023-07-21T22:35:46.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.382+0000 7f522c59fb80 1 Processor -- start 2023-07-21T22:35:46.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f6234630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6231840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f6231dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f522c59fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f6119a60 con 0x5647f60846b0 2023-07-21T22:35:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f522c59fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f6119760 con 0x5647f622e480 2023-07-21T22:35:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f522c59fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f5ffd8c0 con 0x5647f62285e0 2023-07-21T22:35:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f522c59fb80 10 client.0 _ll_register_callbacks cb 0x5647f6117700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f521259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f6234630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f521259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f6234630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53770/0 (socket says 172.21.15.151:53770) 2023-07-21T22:35:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f521259c700 1 -- 172.21.15.151:0/2902078053 learned_addr learned my addr 172.21.15.151:0/2902078053 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.383+0000 7f5212d9d700 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f6231dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.384+0000 7f5211d9b700 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6231840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.384+0000 7f521259c700 1 -- 172.21.15.151:0/2902078053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 msgr2=0x5647f6231840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.384+0000 7f521259c700 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6231840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.384+0000 7f521259c700 1 -- 172.21.15.151:0/2902078053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 msgr2=0x5647f6231dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.384+0000 7f521259c700 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f6231dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.384+0000 7f521259c700 1 -- 172.21.15.151:0/2902078053 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f521410f200 con 0x5647f60846b0 2023-07-21T22:35:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.384+0000 7f521259c700 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f6234630 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5204010680 tx=0x7f52040106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25da4e63a7383d63 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.384+0000 7f51f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:35:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.385+0000 7f51f9ffb700 1 -- 172.21.15.151:0/2902078053 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204003dd0 con 0x5647f60846b0 2023-07-21T22:35:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.385+0000 7f522c59fb80 1 -- 172.21.15.151:0/2902078053 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5647f60d3490 con 0x5647f60846b0 2023-07-21T22:35:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.385+0000 7f51f9ffb700 1 -- 172.21.15.151:0/2902078053 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f52040037d0 con 0x5647f60846b0 2023-07-21T22:35:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.385+0000 7f51f9ffb700 1 -- 172.21.15.151:0/2902078053 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5204005070 con 0x5647f60846b0 2023-07-21T22:35:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.385+0000 7f522c59fb80 10 client.17640 fetch_fsmap learned FSMap version 61 2023-07-21T22:35:46.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.385+0000 7f522c59fb80 1 -- 172.21.15.151:0/2902078053 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x5647f5f90c00 con 0x5647f60846b0 2023-07-21T22:35:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.385+0000 7f51f9ffb700 1 -- 172.21.15.151:0/2902078053 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5647f60d3490 con 0x5647f60846b0 2023-07-21T22:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.385+0000 7f51f9ffb700 1 -- 172.21.15.151:0/2902078053 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 61) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f5204021070 con 0x5647f60846b0 2023-07-21T22:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.386+0000 7f522c59fb80 10 client.17640 fetch_fsmap finished waiting for FSMap version 61 2023-07-21T22:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.386+0000 7f522c59fb80 10 client.17640 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.386+0000 7f522c59fb80 20 client.17640 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.386+0000 7f522c59fb80 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5647f6241640 0x5647f6243a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.386+0000 7f522c59fb80 4 client.17640 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.386+0000 7f522c59fb80 1 -- 172.21.15.151:0/2902078053 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5647f6172e50 con 0x5647f6241640 2023-07-21T22:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.386+0000 7f5211d9b700 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5647f6241640 0x5647f6243a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.387+0000 7f5211d9b700 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5647f6241640 0x5647f6243a50 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de4a5193c93dc549 server_cookie=f8870b9f71ffcbab in_seq=0 out_seq=0 2023-07-21T22:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.387+0000 7f51f9ffb700 10 client.17640 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.387+0000 7f51f9ffb700 1 -- 172.21.15.151:0/2902078053 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5647f6172e50 con 0x5647f6241640 2023-07-21T22:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.387+0000 7f51f9ffb700 10 client.17640 handle_command_reply: tid=0 2023-07-21T22:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.387+0000 7f522c59fb80 1 client.17640 shutdown 2023-07-21T22:35:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 -- 172.21.15.151:0/2902078053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 msgr2=0x5647f6234630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f6234630 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f5204010680 tx=0x7f52040106b0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 -- 172.21.15.151:0/2902078053 shutdown_connections 2023-07-21T22:35:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5647f6241640 0x5647f6243a50 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f6231dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f6234630 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f51f9ffb700 0 client.17640 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 --2- 172.21.15.151:0/2902078053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6231840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 -- 172.21.15.151:0/2902078053 >> 172.21.15.151:0/2902078053 conn(0x5647f621dc40 msgr2=0x5647f6222540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 -- 172.21.15.151:0/2902078053 shutdown_connections 2023-07-21T22:35:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 1 -- 172.21.15.151:0/2902078053 wait complete. 2023-07-21T22:35:46.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.388+0000 7f522c59fb80 20 client.17640 trim_cache size 0 max 16384 2023-07-21T22:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.406+0000 7f522c59fb80 1 Processor -- start 2023-07-21T22:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.406+0000 7f522c59fb80 1 -- start start 2023-07-21T22:35:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.406+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f62280a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.406+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f622f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.406+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f6238dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.406+0000 7f522c59fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f623e600 con 0x5647f60846b0 2023-07-21T22:35:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.406+0000 7f522c59fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f622e850 con 0x5647f622e480 2023-07-21T22:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.406+0000 7f522c59fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f62323f0 con 0x5647f62285e0 2023-07-21T22:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f521259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f62280a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f521259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f62280a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53772/0 (socket says 172.21.15.151:53772) 2023-07-21T22:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f521259c700 1 -- 172.21.15.151:0/488245739 learned_addr learned my addr 172.21.15.151:0/488245739 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f5211d9b700 1 --2- 172.21.15.151:0/488245739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f622f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f5212d9d700 1 --2- 172.21.15.151:0/488245739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f6238dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f521259c700 1 -- 172.21.15.151:0/488245739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 msgr2=0x5647f622f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f521259c700 1 --2- 172.21.15.151:0/488245739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f622f2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f521259c700 1 -- 172.21.15.151:0/488245739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 msgr2=0x5647f6238dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f521259c700 1 --2- 172.21.15.151:0/488245739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f6238dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f521259c700 1 -- 172.21.15.151:0/488245739 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5647f6248680 con 0x5647f60846b0 2023-07-21T22:35:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.407+0000 7f521259c700 1 --2- 172.21.15.151:0/488245739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f62280a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5204006010 tx=0x7f5204001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f39b96010a1a1f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.408+0000 7f52017fa700 1 -- 172.21.15.151:0/488245739 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5204003dd0 con 0x5647f60846b0 2023-07-21T22:35:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.408+0000 7f52017fa700 1 -- 172.21.15.151:0/488245739 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f52040037d0 con 0x5647f60846b0 2023-07-21T22:35:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.408+0000 7f52017fa700 1 -- 172.21.15.151:0/488245739 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520400eef0 con 0x5647f60846b0 2023-07-21T22:35:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.408+0000 7f522c59fb80 1 -- 172.21.15.151:0/488245739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 msgr2=0x5647f62280a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.408+0000 7f522c59fb80 1 --2- 172.21.15.151:0/488245739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f62280a0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f5204006010 tx=0x7f5204001e50 comp rx=0 tx=0).stop 2023-07-21T22:35:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.409+0000 7f522c59fb80 1 -- 172.21.15.151:0/488245739 shutdown_connections 2023-07-21T22:35:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.409+0000 7f522c59fb80 1 --2- 172.21.15.151:0/488245739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f622e480 0x5647f6238dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.409+0000 7f522c59fb80 1 --2- 172.21.15.151:0/488245739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f60846b0 0x5647f62280a0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.409+0000 7f522c59fb80 1 --2- 172.21.15.151:0/488245739 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f622f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.409+0000 7f522c59fb80 1 -- 172.21.15.151:0/488245739 >> 172.21.15.151:0/488245739 conn(0x5647f621dc40 msgr2=0x5647f622c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.409+0000 7f522c59fb80 1 -- 172.21.15.151:0/488245739 shutdown_connections 2023-07-21T22:35:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.409+0000 7f522c59fb80 1 -- 172.21.15.151:0/488245739 wait complete. 2023-07-21T22:35:46.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.409+0000 7f522c59fb80 1 -- start start 2023-07-21T22:35:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.409+0000 7f522c59fb80 1 Processor -- start 2023-07-21T22:35:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f60846b0 0x5647f6238a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6238fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f522c59fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f622e480 0x5647f6234fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f522c59fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f62356f0 con 0x5647f622e480 2023-07-21T22:35:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f522c59fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f6235860 con 0x5647f60846b0 2023-07-21T22:35:46.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f522c59fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5647f6235a20 con 0x5647f62285e0 2023-07-21T22:35:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f522c59fb80 10 client.0 _ll_register_callbacks cb 0x7f520c0096c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f521259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f60846b0 0x5647f6238a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f5212d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f622e480 0x5647f6234fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f5211d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6238fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f521259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f60846b0 0x5647f6238a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41140/0 (socket says 172.21.15.151:41140) 2023-07-21T22:35:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f5212d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f622e480 0x5647f6234fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53780/0 (socket says 172.21.15.151:53780) 2023-07-21T22:35:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.410+0000 7f5212d9d700 1 -- 172.21.15.151:0/845711645 learned_addr learned my addr 172.21.15.151:0/845711645 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:46.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f5212d9d700 1 -- 172.21.15.151:0/845711645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 msgr2=0x5647f6238fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f5212d9d700 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6238fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f5212d9d700 1 -- 172.21.15.151:0/845711645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f60846b0 msgr2=0x5647f6238a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f5212d9d700 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f60846b0 0x5647f6238a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f5212d9d700 1 -- 172.21.15.151:0/845711645 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5647f5f90c00 con 0x5647f622e480 2023-07-21T22:35:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f521259c700 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f60846b0 0x5647f6238a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f5211d9b700 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6238fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f5212d9d700 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f622e480 0x5647f6234fb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f520c017f00 tx=0x7f520c009130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62f3768cb00bd7db server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:46.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f51f9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:35:46.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f51f9ffb700 1 -- 172.21.15.151:0/845711645 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f520c02e440 con 0x5647f622e480 2023-07-21T22:35:46.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f522c59fb80 1 -- 172.21.15.151:0/845711645 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f520401e040 con 0x5647f622e480 2023-07-21T22:35:46.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f51f9ffb700 1 -- 172.21.15.151:0/845711645 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f520c023450 con 0x5647f622e480 2023-07-21T22:35:46.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f51f9ffb700 1 -- 172.21.15.151:0/845711645 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) v2 ==== 24+0+0 (secure 0 0 0) 0x7f520c023610 con 0x5647f622e480 2023-07-21T22:35:46.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.411+0000 7f522c59fb80 10 client.17646 fetch_fsmap learned FSMap version 61 2023-07-21T22:35:46.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f522c59fb80 1 -- 172.21.15.151:0/845711645 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) v3 -- 0x5647f5fce1f0 con 0x5647f622e480 2023-07-21T22:35:46.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f51f9ffb700 1 -- 172.21.15.151:0/845711645 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f520401e040 con 0x5647f622e480 2023-07-21T22:35:46.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f51f9ffb700 1 -- 172.21.15.151:0/845711645 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 61) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f520c02e8a0 con 0x5647f622e480 2023-07-21T22:35:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f522c59fb80 10 client.17646 fetch_fsmap finished waiting for FSMap version 61 2023-07-21T22:35:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f522c59fb80 10 client.17646 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f522c59fb80 20 client.17646 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f522c59fb80 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5647f6296900 0x5647f6298d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f522c59fb80 4 client.17646 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:35:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f522c59fb80 1 -- 172.21.15.151:0/845711645 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5647f6134ff0 con 0x5647f6296900 2023-07-21T22:35:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.412+0000 7f521259c700 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5647f6296900 0x5647f6298d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:46.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.413+0000 7f521259c700 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5647f6296900 0x5647f6298d10 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=117e31e422026b80 server_cookie=d0e422f41fd85d4a in_seq=0 out_seq=0 2023-07-21T22:35:46.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.413+0000 7f51f9ffb700 10 client.17646 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.426+0000 7f51f9ffb700 1 -- 172.21.15.151:0/845711645 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5647f6134ff0 con 0x5647f6296900 2023-07-21T22:35:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.426+0000 7f51f9ffb700 10 client.17646 handle_command_reply: tid=0 2023-07-21T22:35:46.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.426+0000 7f522c59fb80 1 client.17646 shutdown 2023-07-21T22:35:46.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 -- 172.21.15.151:0/845711645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f622e480 msgr2=0x5647f6234fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f622e480 0x5647f6234fb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f520c017f00 tx=0x7f520c009130 comp rx=0 tx=0).stop 2023-07-21T22:35:46.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 -- 172.21.15.151:0/845711645 shutdown_connections 2023-07-21T22:35:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5647f6296900 0x5647f6298d10 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5647f60846b0 0x5647f6238a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5647f622e480 0x5647f6234fb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 --2- 172.21.15.151:0/845711645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5647f62285e0 0x5647f6238fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f51f9ffb700 0 client.17646 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 -- 172.21.15.151:0/845711645 >> 172.21.15.151:0/845711645 conn(0x5647f621dc40 msgr2=0x5647f622ea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 -- 172.21.15.151:0/845711645 shutdown_connections 2023-07-21T22:35:46.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.427+0000 7f522c59fb80 1 -- 172.21.15.151:0/845711645 wait complete. 2023-07-21T22:35:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.428+0000 7f522c59fb80 20 client.17646 trim_cache size 0 max 16384 2023-07-21T22:35:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:35:46.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:35:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:35:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:35:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.428+0000 7f521359e700 1 -- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f51fc0a12c0 msgr2=0x7f51fc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.428+0000 7f521359e700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f51fc0a12c0 0x7f51fc0a3770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f520c009790 tx=0x7f520c00b040 comp rx=0 tx=0).stop 2023-07-21T22:35:46.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.428+0000 7f521359e700 1 -- 172.21.15.151:0/1621830038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5214102750 msgr2=0x7f52141982a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.429+0000 7f521359e700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5214102750 0x7f52141982a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f5214102b20 tx=0x7f520800eca0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.429+0000 7f521359e700 1 -- 172.21.15.151:0/1621830038 shutdown_connections 2023-07-21T22:35:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.429+0000 7f521359e700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f51fc0a12c0 0x7f51fc0a3770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.429+0000 7f521359e700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5214101db0 0x7f5214197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.429+0000 7f521359e700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5214106df0 0x7f521419c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.429+0000 7f521359e700 1 --2- 172.21.15.151:0/1621830038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5214102750 0x7f52141982a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:46.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.429+0000 7f521359e700 1 -- 172.21.15.151:0/1621830038 >> 172.21.15.151:0/1621830038 conn(0x7f52140fd660 msgr2=0x7f52140fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:46.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.429+0000 7f521359e700 1 -- 172.21.15.151:0/1621830038 shutdown_connections 2023-07-21T22:35:46.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:46.429+0000 7f521359e700 1 -- 172.21.15.151:0/1621830038 wait complete. 2023-07-21T22:35:46.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:46 smithi187 ceph-mon[96918]: pgmap v520: 97 pgs: 97 active+clean; 8.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.8 MiB/s wr, 362 op/s 2023-07-21T22:35:46.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:46 smithi195 ceph-mon[97365]: pgmap v520: 97 pgs: 97 active+clean; 8.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.8 MiB/s wr, 362 op/s 2023-07-21T22:35:46.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:46 smithi151 ceph-mon[95510]: pgmap v520: 97 pgs: 97 active+clean; 8.8 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 2.8 MiB/s wr, 362 op/s 2023-07-21T22:35:47.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:47 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:35:47.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:47 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:35:47.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:47 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:35:48.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:48 smithi187 ceph-mon[96918]: pgmap v521: 97 pgs: 97 active+clean; 8.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 13 MiB/s wr, 402 op/s 2023-07-21T22:35:48.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:48 smithi195 ceph-mon[97365]: pgmap v521: 97 pgs: 97 active+clean; 8.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 13 MiB/s wr, 402 op/s 2023-07-21T22:35:48.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:48 smithi151 ceph-mon[95510]: pgmap v521: 97 pgs: 97 active+clean; 8.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 13 MiB/s wr, 402 op/s 2023-07-21T22:35:50.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:50 smithi187 ceph-mon[96918]: pgmap v522: 97 pgs: 97 active+clean; 8.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 222 op/s 2023-07-21T22:35:50.881 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:50 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:35:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:50 smithi195 ceph-mon[97365]: pgmap v522: 97 pgs: 97 active+clean; 8.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 222 op/s 2023-07-21T22:35:50.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:50 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:35:50.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:50 smithi151 ceph-mon[95510]: pgmap v522: 97 pgs: 97 active+clean; 8.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 222 op/s 2023-07-21T22:35:50.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:50 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:35:52.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:52 smithi187 ceph-mon[96918]: pgmap v523: 97 pgs: 97 active+clean; 8.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 222 op/s 2023-07-21T22:35:52.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:52 smithi195 ceph-mon[97365]: pgmap v523: 97 pgs: 97 active+clean; 8.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 222 op/s 2023-07-21T22:35:52.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:52 smithi151 ceph-mon[95510]: pgmap v523: 97 pgs: 97 active+clean; 8.9 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 222 op/s 2023-07-21T22:35:54.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:54 smithi187 ceph-mon[96918]: pgmap v524: 97 pgs: 97 active+clean; 9.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 25 MiB/s wr, 232 op/s 2023-07-21T22:35:54.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:54 smithi195 ceph-mon[97365]: pgmap v524: 97 pgs: 97 active+clean; 9.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 25 MiB/s wr, 232 op/s 2023-07-21T22:35:54.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:54 smithi151 ceph-mon[95510]: pgmap v524: 97 pgs: 97 active+clean; 9.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 25 MiB/s wr, 232 op/s 2023-07-21T22:35:56.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:56 smithi187 ceph-mon[96918]: pgmap v525: 97 pgs: 97 active+clean; 9.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 49 op/s 2023-07-21T22:35:56.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:56 smithi195 ceph-mon[97365]: pgmap v525: 97 pgs: 97 active+clean; 9.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 49 op/s 2023-07-21T22:35:56.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:56 smithi151 ceph-mon[95510]: pgmap v525: 97 pgs: 97 active+clean; 9.0 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 24 MiB/s wr, 49 op/s 2023-07-21T22:35:58.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:35:58 smithi187 ceph-mon[96918]: pgmap v526: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 37 MiB/s wr, 60 op/s 2023-07-21T22:35:58.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:35:58 smithi195 ceph-mon[97365]: pgmap v526: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 37 MiB/s wr, 60 op/s 2023-07-21T22:35:58.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:35:58 smithi151 ceph-mon[95510]: pgmap v526: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 37 MiB/s wr, 60 op/s 2023-07-21T22:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.594+0000 7fcd793ff700 1 -- 172.21.15.151:0/2690023401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74073160 msgr2=0x7fcd7410beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.594+0000 7fcd793ff700 1 --2- 172.21.15.151:0/2690023401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74073160 0x7fcd7410beb0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009990 tx=0x7fcd68009ca0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.594+0000 7fcd793ff700 1 -- 172.21.15.151:0/2690023401 shutdown_connections 2023-07-21T22:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.594+0000 7fcd793ff700 1 --2- 172.21.15.151:0/2690023401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd74072850 0x7fcd74072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.594+0000 7fcd793ff700 1 --2- 172.21.15.151:0/2690023401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd7410c3f0 0x7fcd7410e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.594+0000 7fcd793ff700 1 --2- 172.21.15.151:0/2690023401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74073160 0x7fcd7410beb0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.594+0000 7fcd793ff700 1 -- 172.21.15.151:0/2690023401 >> 172.21.15.151:0/2690023401 conn(0x7fcd740fb650 msgr2=0x7fcd740fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.595+0000 7fcd793ff700 1 -- 172.21.15.151:0/2690023401 shutdown_connections 2023-07-21T22:35:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.595+0000 7fcd793ff700 1 -- 172.21.15.151:0/2690023401 wait complete. 2023-07-21T22:35:59.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.596+0000 7fcd793ff700 1 Processor -- start 2023-07-21T22:35:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.596+0000 7fcd793ff700 1 -- start start 2023-07-21T22:35:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.596+0000 7fcd793ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74072850 0x7fcd74197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.596+0000 7fcd793ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd74073160 0x7fcd741982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.596+0000 7fcd793ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7410c3f0 0x7fcd7419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.596+0000 7fcd793ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7419cf70 con 0x7fcd74072850 2023-07-21T22:35:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.596+0000 7fcd793ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7419d0e0 con 0x7fcd7410c3f0 2023-07-21T22:35:59.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.596+0000 7fcd793ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd7419d2a0 con 0x7fcd74073160 2023-07-21T22:35:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.596+0000 7fcd72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74072850 0x7fcd74197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74072850 0x7fcd74197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44068/0 (socket says 172.21.15.151:44068) 2023-07-21T22:35:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1282446127 learned_addr learned my addr 172.21.15.151:0/1282446127 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd737fe700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7410c3f0 0x7fcd7419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd727fc700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd74073160 0x7fcd741982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1282446127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd74073160 msgr2=0x7fcd741982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd74073160 0x7fcd741982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1282446127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7410c3f0 msgr2=0x7fcd7419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7410c3f0 0x7fcd7419c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1282446127 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd680095f0 con 0x7fcd74072850 2023-07-21T22:35:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd737fe700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7410c3f0 0x7fcd7419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:35:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.597+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74072850 0x7fcd74197d80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400e9a0 tx=0x7fcd6400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.598+0000 7fcd5bfff700 1 -- 172.21.15.151:0/1282446127 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd64009790 con 0x7fcd74072850 2023-07-21T22:35:59.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.598+0000 7fcd793ff700 1 -- 172.21.15.151:0/1282446127 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd7419d580 con 0x7fcd74072850 2023-07-21T22:35:59.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.598+0000 7fcd5bfff700 1 -- 172.21.15.151:0/1282446127 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd64010430 con 0x7fcd74072850 2023-07-21T22:35:59.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.598+0000 7fcd5bfff700 1 -- 172.21.15.151:0/1282446127 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6400cea0 con 0x7fcd74072850 2023-07-21T22:35:59.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.598+0000 7fcd793ff700 1 -- 172.21.15.151:0/1282446127 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd741a4dc0 con 0x7fcd74072850 2023-07-21T22:35:59.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.602+0000 7fcd5bfff700 1 -- 172.21.15.151:0/1282446127 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fcd640105a0 con 0x7fcd74072850 2023-07-21T22:35:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.603+0000 7fcd8ccc4b80 1 Processor -- start 2023-07-21T22:35:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.604+0000 7fcd8ccc4b80 1 -- start start 2023-07-21T22:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.604+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89045cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.604+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 0x55be8903ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.604+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 0x55be890404a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.604+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be88f45c50 con 0x55be88e9c6b0 2023-07-21T22:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.604+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be88f989e0 con 0x55be89046660 2023-07-21T22:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.604+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be88f91e70 con 0x55be89046210 2023-07-21T22:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd5bfff700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd5c0a12c0 0x7fcd5c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd737fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89045cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd737fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89045cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44078/0 (socket says 172.21.15.151:44078) 2023-07-21T22:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd737fe700 1 -- 172.21.15.151:0/1070904035 learned_addr learned my addr 172.21.15.151:0/1070904035 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1070904035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 0x55be8903ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd5bfff700 1 -- 172.21.15.151:0/1282446127 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcd64014070 con 0x7fcd74072850 2023-07-21T22:35:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd727fc700 1 --2- 172.21.15.151:0/1070904035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 0x55be890404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd737fe700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd5c0a12c0 0x7fcd5c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1070904035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 msgr2=0x55be890404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:59.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1070904035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 0x55be890404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1070904035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 msgr2=0x55be89045cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1070904035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89045cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.605+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1070904035 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be88dbfd80 con 0x55be89046210 2023-07-21T22:35:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.606+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1070904035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 0x55be8903ff40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd640ca6c0 tx=0x7fcd640999a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4eb2580182978c41 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.606+0000 7fcd737fe700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd5c0a12c0 0x7fcd5c0a3770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c004480 tx=0x7fcd6c004b40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.606+0000 7fcd597fa700 1 -- 172.21.15.151:0/1070904035 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6409e070 con 0x55be89046210 2023-07-21T22:35:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.606+0000 7fcd597fa700 1 -- 172.21.15.151:0/1070904035 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd640a2490 con 0x55be89046210 2023-07-21T22:35:59.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.606+0000 7fcd597fa700 1 -- 172.21.15.151:0/1070904035 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd640a2000 con 0x55be89046210 2023-07-21T22:35:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1070904035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 msgr2=0x55be8903ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1070904035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 0x55be8903ff40 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcd640ca6c0 tx=0x7fcd640999a0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1070904035 shutdown_connections 2023-07-21T22:35:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1070904035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 0x55be890404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1070904035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89045cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1070904035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 0x55be8903ff40 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1070904035 >> 172.21.15.151:0/1070904035 conn(0x55be89035ae0 msgr2=0x55be8903b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:59.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1070904035 shutdown_connections 2023-07-21T22:35:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1070904035 wait complete. 2023-07-21T22:35:59.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.607+0000 7fcd8ccc4b80 1 -- start start 2023-07-21T22:35:59.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd8ccc4b80 1 Processor -- start 2023-07-21T22:35:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 0x55be8904c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89046210 0x55be89049820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 0x55be89049f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be88f31a60 con 0x55be89046210 2023-07-21T22:35:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be88f31760 con 0x55be89046660 2023-07-21T22:35:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be88e158c0 con 0x55be88e9c6b0 2023-07-21T22:35:59.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd8ccc4b80 10 client.0 _ll_register_callbacks cb 0x55be88f2f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd727fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89046210 0x55be89049820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd727fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89046210 0x55be89049820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44090/0 (socket says 172.21.15.151:44090) 2023-07-21T22:35:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.608+0000 7fcd727fc700 1 -- 172.21.15.151:0/1873688518 learned_addr learned my addr 172.21.15.151:0/1873688518 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 0x55be8904c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd737fe700 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 0x55be89049f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd727fc700 1 -- 172.21.15.151:0/1873688518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 msgr2=0x55be8904c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:59.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd727fc700 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 0x55be8904c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd727fc700 1 -- 172.21.15.151:0/1873688518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 msgr2=0x55be89049f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd727fc700 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 0x55be89049f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd727fc700 1 -- 172.21.15.151:0/1873688518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd741a4dc0 con 0x55be89046210 2023-07-21T22:35:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd727fc700 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89046210 0x55be89049820 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009990 tx=0x7fcd68005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50cd876d87b787a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd56ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:35:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.609+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1873688518 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd6801d070 con 0x55be89046210 2023-07-21T22:35:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1873688518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be88eeb490 con 0x55be89046210 2023-07-21T22:35:59.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1873688518 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcd68004500 con 0x55be89046210 2023-07-21T22:35:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1873688518 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd680046c0 con 0x55be89046210 2023-07-21T22:35:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd8ccc4b80 10 client.17658 fetch_fsmap learned FSMap version 63 2023-07-21T22:35:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1873688518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55be88da8c00 con 0x55be89046210 2023-07-21T22:35:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1873688518 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd68033020 con 0x55be89046210 2023-07-21T22:35:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1873688518 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 63) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fcd6800f930 con 0x55be89046210 2023-07-21T22:35:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd8ccc4b80 10 client.17658 fetch_fsmap finished waiting for FSMap version 63 2023-07-21T22:35:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd8ccc4b80 10 client.17658 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:59.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd8ccc4b80 20 client.17658 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55be89059b10 0x55be8905bf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.610+0000 7fcd8ccc4b80 4 client.17658 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:35:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.611+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1873688518 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55be88f8ae50 con 0x55be89059b10 2023-07-21T22:35:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.611+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55be89059b10 0x55be8905bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.611+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55be89059b10 0x55be8905bf20 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d97f7d6d1c31658 server_cookie=346203e54c5449df in_seq=0 out_seq=0 2023-07-21T22:35:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.611+0000 7fcd56ff5700 10 client.17658 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:59.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1873688518 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55be88f8ae50 con 0x55be89059b10 2023-07-21T22:35:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd56ff5700 10 client.17658 handle_command_reply: tid=0 2023-07-21T22:35:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd8ccc4b80 1 client.17658 shutdown 2023-07-21T22:35:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1873688518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89046210 msgr2=0x55be89049820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89046210 0x55be89049820 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fcd68009990 tx=0x7fcd68005800 comp rx=0 tx=0).stop 2023-07-21T22:35:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1873688518 shutdown_connections 2023-07-21T22:35:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55be89059b10 0x55be8905bf20 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046660 0x55be89049f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 0x55be8904c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1873688518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89046210 0x55be89049820 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1873688518 >> 172.21.15.151:0/1873688518 conn(0x55be89035ae0 msgr2=0x55be8903a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.612+0000 7fcd56ff5700 0 client.17658 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.613+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1873688518 shutdown_connections 2023-07-21T22:35:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.613+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1873688518 wait complete. 2023-07-21T22:35:59.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.613+0000 7fcd8ccc4b80 20 client.17658 trim_cache size 0 max 16384 2023-07-21T22:35:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd8ccc4b80 1 Processor -- start 2023-07-21T22:35:59.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd8ccc4b80 1 -- start start 2023-07-21T22:35:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89035ae0 0x55be890497d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 0x55be89050ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046210 0x55be8904c140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be89041160 con 0x55be89035ae0 2023-07-21T22:35:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be8903c8d0 con 0x55be89046210 2023-07-21T22:35:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be89040f20 con 0x55be88e9c6b0 2023-07-21T22:35:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89035ae0 0x55be890497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89035ae0 0x55be890497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44104/0 (socket says 172.21.15.151:44104) 2023-07-21T22:35:59.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.630+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1772347624 learned_addr learned my addr 172.21.15.151:0/1772347624 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd727fc700 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 0x55be89050ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd737fe700 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046210 0x55be8904c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1772347624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 msgr2=0x55be89050ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 0x55be89050ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1772347624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046210 msgr2=0x55be8904c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:59.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046210 0x55be8904c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1772347624 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55be88de61f0 con 0x55be89035ae0 2023-07-21T22:35:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd737fe700 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046210 0x55be8904c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:35:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89035ae0 0x55be890497d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcd64098390 tx=0x7fcd6409a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cef320003bb35cd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd59ffb700 1 -- 172.21.15.151:0/1772347624 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd640cd050 con 0x55be89035ae0 2023-07-21T22:35:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd59ffb700 1 -- 172.21.15.151:0/1772347624 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd6409a2a0 con 0x55be89035ae0 2023-07-21T22:35:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.631+0000 7fcd59ffb700 1 -- 172.21.15.151:0/1772347624 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd640b8420 con 0x55be89035ae0 2023-07-21T22:35:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.632+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1772347624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89035ae0 msgr2=0x55be890497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.632+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89035ae0 0x55be890497d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fcd64098390 tx=0x7fcd6409a1c0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.632+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1772347624 shutdown_connections 2023-07-21T22:35:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.632+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89046210 0x55be8904c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.632+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be89035ae0 0x55be890497d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.632+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1772347624 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be88e9c6b0 0x55be89050ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.632+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1772347624 >> 172.21.15.151:0/1772347624 conn(0x55be89056140 msgr2=0x55be890490c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:59.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.632+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1772347624 shutdown_connections 2023-07-21T22:35:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.632+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1772347624 wait complete. 2023-07-21T22:35:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.633+0000 7fcd8ccc4b80 1 -- start start 2023-07-21T22:35:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.633+0000 7fcd8ccc4b80 1 Processor -- start 2023-07-21T22:35:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.633+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89042820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89035ae0 0x55be89042d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd8ccc4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 0x55be89041730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be89043360 con 0x55be88e9c6b0 2023-07-21T22:35:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be890434d0 con 0x55be89035ae0 2023-07-21T22:35:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd8ccc4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55be89041ca0 con 0x55be89046210 2023-07-21T22:35:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd8ccc4b80 10 client.0 _ll_register_callbacks cb 0x7fcd68005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:35:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89042820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89042820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44112/0 (socket says 172.21.15.151:44112) 2023-07-21T22:35:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1923387490 learned_addr learned my addr 172.21.15.151:0/1923387490 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:35:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd727fc700 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89035ae0 0x55be89042d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd737fe700 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 0x55be89041730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1923387490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 msgr2=0x55be89041730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 0x55be89041730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1923387490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89035ae0 msgr2=0x55be89042d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:35:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89035ae0 0x55be89042d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.634+0000 7fcd72ffd700 1 -- 172.21.15.151:0/1923387490 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55be88dbfd80 con 0x55be88e9c6b0 2023-07-21T22:35:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd72ffd700 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89042820 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcd64099fd0 tx=0x7fcd640cd050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9858644344ddedd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:35:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd56ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:35:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1923387490 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd640ca070 con 0x55be88e9c6b0 2023-07-21T22:35:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1923387490 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(108..108 src has 1..108) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcd640b81c0 con 0x55be88e9c6b0 2023-07-21T22:35:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1923387490 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55be89056510 con 0x55be88e9c6b0 2023-07-21T22:35:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1923387490 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd640995f0 con 0x55be88e9c6b0 2023-07-21T22:35:59.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd8ccc4b80 10 client.17664 fetch_fsmap learned FSMap version 63 2023-07-21T22:35:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1923387490 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=4+}) v3 -- 0x55be88dbe250 con 0x55be88e9c6b0 2023-07-21T22:35:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1923387490 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd6407c020 con 0x55be88e9c6b0 2023-07-21T22:35:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.635+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1923387490 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 63) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fcd64095f50 con 0x55be88e9c6b0 2023-07-21T22:35:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.636+0000 7fcd8ccc4b80 10 client.17664 fetch_fsmap finished waiting for FSMap version 63 2023-07-21T22:35:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.636+0000 7fcd8ccc4b80 10 client.17664 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:35:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.636+0000 7fcd8ccc4b80 20 client.17664 populate_metadata read hostname 'smithi151' 2023-07-21T22:35:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.636+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55be89046660 0x55be890b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:35:59.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.636+0000 7fcd8ccc4b80 4 client.17664 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:35:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.636+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1923387490 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7fcd640a2490 con 0x55be89046660 2023-07-21T22:35:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.636+0000 7fcd727fc700 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55be89046660 0x55be890b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:35:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.637+0000 7fcd56ff5700 10 client.17664 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:59.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.637+0000 7fcd727fc700 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55be89046660 0x55be890b0200 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc848fad13dac357 server_cookie=3f96ab3cfb2e7b28 in_seq=0 out_seq=0 2023-07-21T22:35:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd56ff5700 1 -- 172.21.15.151:0/1923387490 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7fcd640a2490 con 0x55be89046660 2023-07-21T22:35:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd56ff5700 10 client.17664 handle_command_reply: tid=0 2023-07-21T22:35:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd8ccc4b80 1 client.17664 shutdown 2023-07-21T22:35:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1923387490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 msgr2=0x55be89042820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89042820 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7fcd64099fd0 tx=0x7fcd640cd050 comp rx=0 tx=0).stop 2023-07-21T22:35:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1923387490 shutdown_connections 2023-07-21T22:35:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55be89046660 0x55be890b0200 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55be89046210 0x55be89041730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55be88e9c6b0 0x55be89042820 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd56ff5700 0 client.17664 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:35:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd8ccc4b80 1 --2- 172.21.15.151:0/1923387490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55be89035ae0 0x55be89042d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.651+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1923387490 >> 172.21.15.151:0/1923387490 conn(0x55be89056140 msgr2=0x55be89046a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.652+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1923387490 shutdown_connections 2023-07-21T22:35:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.652+0000 7fcd8ccc4b80 1 -- 172.21.15.151:0/1923387490 wait complete. 2023-07-21T22:35:59.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.652+0000 7fcd8ccc4b80 20 client.17664 trim_cache size 0 max 16384 2023-07-21T22:35:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:35:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:35:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:35:59.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:35:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.652+0000 7fcd793ff700 1 -- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd5c0a12c0 msgr2=0x7fcd5c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.652+0000 7fcd793ff700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd5c0a12c0 0x7fcd5c0a3770 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcd6c004480 tx=0x7fcd6c004b40 comp rx=0 tx=0).stop 2023-07-21T22:35:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.652+0000 7fcd793ff700 1 -- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74072850 msgr2=0x7fcd74197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:35:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.652+0000 7fcd793ff700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74072850 0x7fcd74197d80 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fcd6400e9a0 tx=0x7fcd6400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.653+0000 7fcd793ff700 1 -- 172.21.15.151:0/1282446127 shutdown_connections 2023-07-21T22:35:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.653+0000 7fcd793ff700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd5c0a12c0 0x7fcd5c0a3770 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.653+0000 7fcd793ff700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd7410c3f0 0x7fcd7419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.653+0000 7fcd793ff700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd74072850 0x7fcd74197d80 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.653+0000 7fcd793ff700 1 --2- 172.21.15.151:0/1282446127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcd74073160 0x7fcd741982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:35:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.653+0000 7fcd793ff700 1 -- 172.21.15.151:0/1282446127 >> 172.21.15.151:0/1282446127 conn(0x7fcd740fb650 msgr2=0x7fcd7410e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:35:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.653+0000 7fcd793ff700 1 -- 172.21.15.151:0/1282446127 shutdown_connections 2023-07-21T22:35:59.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:35:59.653+0000 7fcd793ff700 1 -- 172.21.15.151:0/1282446127 wait complete. 2023-07-21T22:36:00.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:00 smithi187 ceph-mon[96918]: pgmap v527: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-21T22:36:00.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:00 smithi195 ceph-mon[97365]: pgmap v527: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-21T22:36:00.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:00 smithi151 ceph-mon[95510]: pgmap v527: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-21T22:36:02.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:02 smithi187 ceph-mon[96918]: pgmap v528: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-21T22:36:02.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:02 smithi195 ceph-mon[97365]: pgmap v528: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-21T22:36:02.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:02 smithi151 ceph-mon[95510]: pgmap v528: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 26 MiB/s wr, 20 op/s 2023-07-21T22:36:04.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:04 smithi187 ceph-mon[96918]: pgmap v529: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-07-21T22:36:04.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:04 smithi195 ceph-mon[97365]: pgmap v529: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-07-21T22:36:04.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:04 smithi151 ceph-mon[95510]: pgmap v529: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-07-21T22:36:06.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:06 smithi187 ceph-mon[96918]: pgmap v530: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:36:06.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:06 smithi195 ceph-mon[97365]: pgmap v530: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:36:06.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:06 smithi151 ceph-mon[95510]: pgmap v530: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 26 MiB/s wr, 37 op/s 2023-07-21T22:36:08.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:08 smithi187 ceph-mon[96918]: pgmap v531: 97 pgs: 97 active+clean; 9.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-07-21T22:36:08.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:08 smithi195 ceph-mon[97365]: pgmap v531: 97 pgs: 97 active+clean; 9.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-07-21T22:36:08.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:08 smithi151 ceph-mon[95510]: pgmap v531: 97 pgs: 97 active+clean; 9.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 39 MiB/s wr, 47 op/s 2023-07-21T22:36:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:10 smithi187 ceph-mon[96918]: pgmap v532: 97 pgs: 97 active+clean; 9.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 36 op/s 2023-07-21T22:36:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:10 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:36:10.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:10 smithi187 ceph-mon[96918]: osdmap e109: 12 total, 12 up, 12 in 2023-07-21T22:36:10.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:10 smithi195 ceph-mon[97365]: pgmap v532: 97 pgs: 97 active+clean; 9.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 36 op/s 2023-07-21T22:36:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:10 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:36:10.909 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:10 smithi195 ceph-mon[97365]: osdmap e109: 12 total, 12 up, 12 in 2023-07-21T22:36:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:10 smithi151 ceph-mon[95510]: pgmap v532: 97 pgs: 97 active+clean; 9.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 26 MiB/s wr, 36 op/s 2023-07-21T22:36:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:10 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:36:10.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:10 smithi151 ceph-mon[95510]: osdmap e109: 12 total, 12 up, 12 in 2023-07-21T22:36:12.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:12 smithi187 ceph-mon[96918]: pgmap v534: 97 pgs: 97 active+clean; 9.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 44 op/s 2023-07-21T22:36:12.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:12 smithi195 ceph-mon[97365]: pgmap v534: 97 pgs: 97 active+clean; 9.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 44 op/s 2023-07-21T22:36:12.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:12 smithi151 ceph-mon[95510]: pgmap v534: 97 pgs: 97 active+clean; 9.5 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 31 MiB/s wr, 44 op/s 2023-07-21T22:36:13.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.977+0000 7f0f793ff700 1 -- 172.21.15.151:0/2789466995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f741004b0 msgr2=0x7f0f7410c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.977+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2789466995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f741004b0 0x7f0f7410c940 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c00b0a0 tx=0x7f0f6c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.977+0000 7f0f793ff700 1 -- 172.21.15.151:0/2789466995 shutdown_connections 2023-07-21T22:36:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.977+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2789466995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f74105b10 0x7f0f74105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.977+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2789466995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f741004b0 0x7f0f7410c940 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.977+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2789466995 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f740ffb00 0x7f0f740fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.977+0000 7f0f793ff700 1 -- 172.21.15.151:0/2789466995 >> 172.21.15.151:0/2789466995 conn(0x7f0f740fb600 msgr2=0x7f0f740fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.977+0000 7f0f793ff700 1 -- 172.21.15.151:0/2789466995 shutdown_connections 2023-07-21T22:36:13.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.977+0000 7f0f793ff700 1 -- 172.21.15.151:0/2789466995 wait complete. 2023-07-21T22:36:13.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.978+0000 7f0f793ff700 1 Processor -- start 2023-07-21T22:36:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.978+0000 7f0f793ff700 1 -- start start 2023-07-21T22:36:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f793ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f740ffb00 0x7f0f74197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f793ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f741004b0 0x7f0f74198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f793ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f74105b10 0x7f0f7419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f793ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7419cfd0 con 0x7f0f74105b10 2023-07-21T22:36:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f793ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7419d140 con 0x7f0f741004b0 2023-07-21T22:36:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f793ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7419d300 con 0x7f0f740ffb00 2023-07-21T22:36:13.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f740ffb00 0x7f0f74197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f737fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f74105b10 0x7f0f7419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f740ffb00 0x7f0f74197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43012/0 (socket says 172.21.15.151:43012) 2023-07-21T22:36:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f72ffd700 1 -- 172.21.15.151:0/2523951086 learned_addr learned my addr 172.21.15.151:0/2523951086 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f727fc700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f741004b0 0x7f0f74198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f737fe700 1 -- 172.21.15.151:0/2523951086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f740ffb00 msgr2=0x7f0f74197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f737fe700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f740ffb00 0x7f0f74197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.979+0000 7f0f737fe700 1 -- 172.21.15.151:0/2523951086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f741004b0 msgr2=0x7f0f74198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f737fe700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f741004b0 0x7f0f74198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f737fe700 1 -- 172.21.15.151:0/2523951086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c009d00 con 0x7f0f74105b10 2023-07-21T22:36:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f740ffb00 0x7f0f74197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f727fc700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f741004b0 0x7f0f74198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:36:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f737fe700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f74105b10 0x7f0f7419c990 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009fd0 tx=0x7f0f6c00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f5bfff700 1 -- 172.21.15.151:0/2523951086 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c00e040 con 0x7f0f74105b10 2023-07-21T22:36:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f793ff700 1 -- 172.21.15.151:0/2523951086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7419d580 con 0x7f0f74105b10 2023-07-21T22:36:13.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f5bfff700 1 -- 172.21.15.151:0/2523951086 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f6c009480 con 0x7f0f74105b10 2023-07-21T22:36:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f5bfff700 1 -- 172.21.15.151:0/2523951086 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6c0052a0 con 0x7f0f74105b10 2023-07-21T22:36:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.980+0000 7f0f793ff700 1 -- 172.21.15.151:0/2523951086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f741a4e20 con 0x7f0f74105b10 2023-07-21T22:36:13.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.984+0000 7f0f5bfff700 1 -- 172.21.15.151:0/2523951086 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0f6c005400 con 0x7f0f74105b10 2023-07-21T22:36:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.986+0000 7f0f5bfff700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f5c0a12c0 0x7f0f5c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.986+0000 7f0f5bfff700 1 -- 172.21.15.151:0/2523951086 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f0f6c0cdfe0 con 0x7f0f74105b10 2023-07-21T22:36:13.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.986+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f5c0a12c0 0x7f0f5c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:12.987+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f5c0a12c0 0x7f0f5c0a3770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f64011550 tx=0x7f0f64009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:13.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.018+0000 7f0f8cce2b80 1 Processor -- start 2023-07-21T22:36:13.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f8cce2b80 1 -- start start 2023-07-21T22:36:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acb58cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 0x5654acb52f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acb534a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654aca58c50 con 0x5654ac9af6b0 2023-07-21T22:36:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654acaab9e0 con 0x5654acb59210 2023-07-21T22:36:13.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654acaa4e70 con 0x5654acb59660 2023-07-21T22:36:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acb58cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acb58cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36830/0 (socket says 172.21.15.151:36830) 2023-07-21T22:36:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f72ffd700 1 -- 172.21.15.151:0/352469856 learned_addr learned my addr 172.21.15.151:0/352469856 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f727fc700 1 --2- 172.21.15.151:0/352469856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 0x5654acb52f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.019+0000 7f0f737fe700 1 --2- 172.21.15.151:0/352469856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acb534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.020+0000 7f0f72ffd700 1 -- 172.21.15.151:0/352469856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 msgr2=0x5654acb534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:13.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.020+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/352469856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acb534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.020+0000 7f0f72ffd700 1 -- 172.21.15.151:0/352469856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 msgr2=0x5654acb52f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.020+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/352469856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 0x5654acb52f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.020+0000 7f0f72ffd700 1 -- 172.21.15.151:0/352469856 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654ac8d2d80 con 0x5654ac9af6b0 2023-07-21T22:36:13.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.020+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/352469856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acb58cd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e730 tx=0x7f0f64014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f35aa8e7bca9a5b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:13.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.020+0000 7f0f597fa700 1 -- 172.21.15.151:0/352469856 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64004830 con 0x5654ac9af6b0 2023-07-21T22:36:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.020+0000 7f0f597fa700 1 -- 172.21.15.151:0/352469856 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f64011e90 con 0x5654ac9af6b0 2023-07-21T22:36:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.020+0000 7f0f597fa700 1 -- 172.21.15.151:0/352469856 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6401e420 con 0x5654ac9af6b0 2023-07-21T22:36:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.021+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/352469856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 msgr2=0x5654acb58cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.021+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/352469856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acb58cd0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e730 tx=0x7f0f64014000 comp rx=0 tx=0).stop 2023-07-21T22:36:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.021+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/352469856 shutdown_connections 2023-07-21T22:36:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.021+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/352469856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acb534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.021+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/352469856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acb58cd0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.021+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/352469856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 0x5654acb52f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.021+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/352469856 >> 172.21.15.151:0/352469856 conn(0x5654acb48ae0 msgr2=0x5654acb4e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.021+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/352469856 shutdown_connections 2023-07-21T22:36:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.021+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/352469856 wait complete. 2023-07-21T22:36:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.022+0000 7f0f8cce2b80 1 -- start start 2023-07-21T22:36:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.022+0000 7f0f8cce2b80 1 Processor -- start 2023-07-21T22:36:13.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 0x5654acb5f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59210 0x5654acb5c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59660 0x5654acb5cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654aca44a60 con 0x5654acb59660 2023-07-21T22:36:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654aca44760 con 0x5654ac9af6b0 2023-07-21T22:36:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ac9288c0 con 0x5654acb59210 2023-07-21T22:36:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f8cce2b80 10 client.0 _ll_register_callbacks cb 0x5654aca42700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:36:13.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f737fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59660 0x5654acb5cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f727fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59210 0x5654acb5c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f727fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59210 0x5654acb5c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43030/0 (socket says 172.21.15.151:43030) 2023-07-21T22:36:13.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.023+0000 7f0f727fc700 1 -- 172.21.15.151:0/3903437469 learned_addr learned my addr 172.21.15.151:0/3903437469 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 0x5654acb5f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f727fc700 1 -- 172.21.15.151:0/3903437469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 msgr2=0x5654acb5f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f727fc700 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 0x5654acb5f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f727fc700 1 -- 172.21.15.151:0/3903437469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59660 msgr2=0x5654acb5cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:13.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f727fc700 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59660 0x5654acb5cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f727fc700 1 -- 172.21.15.151:0/3903437469 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f64017070 con 0x5654acb59210 2023-07-21T22:36:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f737fe700 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59660 0x5654acb5cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f727fc700 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59210 0x5654acb5c880 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800baa0 tx=0x7f0f6800bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e255fed7ee47ab17 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f56ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:36:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f56ff5700 1 -- 172.21.15.151:0/3903437469 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f680041f0 con 0x5654acb59210 2023-07-21T22:36:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/3903437469 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5654ac9fe490 con 0x5654acb59210 2023-07-21T22:36:13.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.024+0000 7f0f56ff5700 1 -- 172.21.15.151:0/3903437469 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f0f68011440 con 0x5654acb59210 2023-07-21T22:36:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.025+0000 7f0f56ff5700 1 -- 172.21.15.151:0/3903437469 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f68011600 con 0x5654acb59210 2023-07-21T22:36:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.025+0000 7f0f8cce2b80 10 client.27388 fetch_fsmap learned FSMap version 64 2023-07-21T22:36:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.025+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/3903437469 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5654ac8bbc00 con 0x5654acb59210 2023-07-21T22:36:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.025+0000 7f0f56ff5700 1 -- 172.21.15.151:0/3903437469 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5654ac9fe490 con 0x5654acb59210 2023-07-21T22:36:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.025+0000 7f0f56ff5700 1 -- 172.21.15.151:0/3903437469 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0f6801b7f0 con 0x5654acb59210 2023-07-21T22:36:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.025+0000 7f0f8cce2b80 10 client.27388 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:36:13.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.025+0000 7f0f8cce2b80 10 client.27388 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:36:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.025+0000 7f0f8cce2b80 20 client.27388 populate_metadata read hostname 'smithi151' 2023-07-21T22:36:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.026+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5654acb6cbd0 0x5654acb6efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.026+0000 7f0f8cce2b80 4 client.27388 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:36:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.026+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/3903437469 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5654aca9de50 con 0x5654acb6cbd0 2023-07-21T22:36:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.026+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5654acb6cbd0 0x5654acb6efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.027+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5654acb6cbd0 0x5654acb6efe0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff5a6edb96e277a9 server_cookie=7b230f4088f230b2 in_seq=0 out_seq=0 2023-07-21T22:36:13.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.027+0000 7f0f56ff5700 10 client.27388 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.027+0000 7f0f56ff5700 1 -- 172.21.15.151:0/3903437469 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5654aca9de50 con 0x5654acb6cbd0 2023-07-21T22:36:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.027+0000 7f0f56ff5700 10 client.27388 handle_command_reply: tid=0 2023-07-21T22:36:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 client.27388 shutdown 2023-07-21T22:36:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/3903437469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59210 msgr2=0x5654acb5c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59210 0x5654acb5c880 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f0f6800baa0 tx=0x7f0f6800bdb0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/3903437469 shutdown_connections 2023-07-21T22:36:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5654acb6cbd0 0x5654acb6efe0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 0x5654acb5f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59660 0x5654acb5cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f56ff5700 0 client.27388 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/3903437469 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59210 0x5654acb5c880 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/3903437469 >> 172.21.15.151:0/3903437469 conn(0x5654acb48ae0 msgr2=0x5654acb4d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/3903437469 shutdown_connections 2023-07-21T22:36:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/3903437469 wait complete. 2023-07-21T22:36:13.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.028+0000 7f0f8cce2b80 20 client.27388 trim_cache size 0 max 16384 2023-07-21T22:36:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f8cce2b80 1 Processor -- start 2023-07-21T22:36:13.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f8cce2b80 1 -- start start 2023-07-21T22:36:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 0x5654acb58230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59210 0x5654acb62150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acb5a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654ac9fe490 con 0x5654acb59210 2023-07-21T22:36:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654acb6a180 con 0x5654ac9af6b0 2023-07-21T22:36:13.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654acb45b20 con 0x5654acb59660 2023-07-21T22:36:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f727fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59210 0x5654acb62150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f727fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59210 0x5654acb62150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36846/0 (socket says 172.21.15.151:36846) 2023-07-21T22:36:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.048+0000 7f0f727fc700 1 -- 172.21.15.151:0/734922317 learned_addr learned my addr 172.21.15.151:0/734922317 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 0x5654acb58230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f737fe700 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acb5a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f727fc700 1 -- 172.21.15.151:0/734922317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 msgr2=0x5654acb5a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f727fc700 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acb5a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f727fc700 1 -- 172.21.15.151:0/734922317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 msgr2=0x5654acb58230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:13.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f727fc700 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 0x5654acb58230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f727fc700 1 -- 172.21.15.151:0/734922317 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5654ac8f91f0 con 0x5654acb59210 2023-07-21T22:36:13.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 0x5654acb58230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:13.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f727fc700 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59210 0x5654acb62150 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0f6801bbd0 tx=0x7f0f68005880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f43d47a9f8038f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:13.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.049+0000 7f0f59ffb700 1 -- 172.21.15.151:0/734922317 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68003f80 con 0x5654acb59210 2023-07-21T22:36:13.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.050+0000 7f0f59ffb700 1 -- 172.21.15.151:0/734922317 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f68003960 con 0x5654acb59210 2023-07-21T22:36:13.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.050+0000 7f0f59ffb700 1 -- 172.21.15.151:0/734922317 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f68011bd0 con 0x5654acb59210 2023-07-21T22:36:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.050+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/734922317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59210 msgr2=0x5654acb62150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.050+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59210 0x5654acb62150 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f0f6801bbd0 tx=0x7f0f68005880 comp rx=0 tx=0).stop 2023-07-21T22:36:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.050+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/734922317 shutdown_connections 2023-07-21T22:36:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.050+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654ac9af6b0 0x5654acb58230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.050+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acb5a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.050+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/734922317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654acb59210 0x5654acb62150 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.050+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/734922317 >> 172.21.15.151:0/734922317 conn(0x5654acb48ae0 msgr2=0x5654acb59a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:13.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.051+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/734922317 shutdown_connections 2023-07-21T22:36:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.051+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/734922317 wait complete. 2023-07-21T22:36:13.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.051+0000 7f0f8cce2b80 1 -- start start 2023-07-21T22:36:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.051+0000 7f0f8cce2b80 1 Processor -- start 2023-07-21T22:36:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.052+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acbb4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.052+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 0x5654acbb5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.052+0000 7f0f8cce2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acbb9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.052+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654acbba0a0 con 0x5654ac9af6b0 2023-07-21T22:36:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.052+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654acbba210 con 0x5654acb59210 2023-07-21T22:36:13.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.052+0000 7f0f8cce2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5654acbba3d0 con 0x5654acb59660 2023-07-21T22:36:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.052+0000 7f0f8cce2b80 10 client.0 _ll_register_callbacks cb 0x7f0f680043e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:36:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.052+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acbb4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.052+0000 7f0f72ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acbb4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36858/0 (socket says 172.21.15.151:36858) 2023-07-21T22:36:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f72ffd700 1 -- 172.21.15.151:0/1270179482 learned_addr learned my addr 172.21.15.151:0/1270179482 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f727fc700 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 0x5654acbb5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f72ffd700 1 -- 172.21.15.151:0/1270179482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 msgr2=0x5654acbb9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f737fe700 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acbb9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acbb9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f72ffd700 1 -- 172.21.15.151:0/1270179482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 msgr2=0x5654acbb5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 0x5654acbb5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f72ffd700 1 -- 172.21.15.151:0/1270179482 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5654ac8d2d80 con 0x5654ac9af6b0 2023-07-21T22:36:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f727fc700 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 0x5654acbb5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:36:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f737fe700 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acbb9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:36:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f72ffd700 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acbb4c10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e700 tx=0x7f0f6400ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22566c4ba66696d8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:13.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.053+0000 7f0f56ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:36:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f56ff5700 1 -- 172.21.15.151:0/1270179482 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64037030 con 0x5654ac9af6b0 2023-07-21T22:36:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/1270179482 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f64011e90 con 0x5654ac9af6b0 2023-07-21T22:36:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f56ff5700 1 -- 172.21.15.151:0/1270179482 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(109..109 src has 1..109) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f0f64038070 con 0x5654ac9af6b0 2023-07-21T22:36:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f56ff5700 1 -- 172.21.15.151:0/1270179482 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f6402b040 con 0x5654ac9af6b0 2023-07-21T22:36:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f8cce2b80 10 client.17682 fetch_fsmap learned FSMap version 64 2023-07-21T22:36:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/1270179482 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5654ac8bbc00 con 0x5654ac9af6b0 2023-07-21T22:36:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f56ff5700 1 -- 172.21.15.151:0/1270179482 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f64011e90 con 0x5654ac9af6b0 2023-07-21T22:36:13.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f56ff5700 1 -- 172.21.15.151:0/1270179482 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f0f64024030 con 0x5654ac9af6b0 2023-07-21T22:36:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f8cce2b80 10 client.17682 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:36:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f8cce2b80 10 client.17682 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:36:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f8cce2b80 20 client.17682 populate_metadata read hostname 'smithi151' 2023-07-21T22:36:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5654acbc1be0 0x5654acbc3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f8cce2b80 4 client.17682 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:36:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.054+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/1270179482 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5654aca5fff0 con 0x5654acbc1be0 2023-07-21T22:36:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.055+0000 7f0f727fc700 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5654acbc1be0 0x5654acbc3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:13.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.055+0000 7f0f727fc700 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5654acbc1be0 0x5654acbc3ff0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9d310e258a9e6d6 server_cookie=94e8f1a0befd9fd4 in_seq=0 out_seq=0 2023-07-21T22:36:13.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.055+0000 7f0f56ff5700 10 client.17682 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.068+0000 7f0f56ff5700 1 -- 172.21.15.151:0/1270179482 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5654aca5fff0 con 0x5654acbc1be0 2023-07-21T22:36:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.068+0000 7f0f56ff5700 10 client.17682 handle_command_reply: tid=0 2023-07-21T22:36:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.068+0000 7f0f8cce2b80 1 client.17682 shutdown 2023-07-21T22:36:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/1270179482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 msgr2=0x5654acbb4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acbb4c10 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400e700 tx=0x7f0f6400ef00 comp rx=0 tx=0).stop 2023-07-21T22:36:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/1270179482 shutdown_connections 2023-07-21T22:36:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5654acbc1be0 0x5654acbc3ff0 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5654acb59660 0x5654acbb9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5654ac9af6b0 0x5654acbb4c10 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 --2- 172.21.15.151:0/1270179482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5654acb59210 0x5654acbb5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/1270179482 >> 172.21.15.151:0/1270179482 conn(0x5654acb48ae0 msgr2=0x5654acb579a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f56ff5700 0 client.17682 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/1270179482 shutdown_connections 2023-07-21T22:36:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 1 -- 172.21.15.151:0/1270179482 wait complete. 2023-07-21T22:36:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.069+0000 7f0f8cce2b80 20 client.17682 trim_cache size 0 max 16384 2023-07-21T22:36:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:36:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:36:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:36:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:36:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 -- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f5c0a12c0 msgr2=0x7f0f5c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f5c0a12c0 0x7f0f5c0a3770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f0f64011550 tx=0x7f0f64009260 comp rx=0 tx=0).stop 2023-07-21T22:36:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 -- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f74105b10 msgr2=0x7f0f7419c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f74105b10 0x7f0f7419c990 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c009fd0 tx=0x7f0f6c00bce0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 -- 172.21.15.151:0/2523951086 shutdown_connections 2023-07-21T22:36:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f5c0a12c0 0x7f0f5c0a3770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f74105b10 0x7f0f7419c990 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0f740ffb00 0x7f0f74197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 --2- 172.21.15.151:0/2523951086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f741004b0 0x7f0f74198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 -- 172.21.15.151:0/2523951086 >> 172.21.15.151:0/2523951086 conn(0x7f0f740fb600 msgr2=0x7f0f7410b020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 -- 172.21.15.151:0/2523951086 shutdown_connections 2023-07-21T22:36:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:13.070+0000 7f0f793ff700 1 -- 172.21.15.151:0/2523951086 wait complete. 2023-07-21T22:36:14.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:14 smithi187 ceph-mon[96918]: pgmap v535: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 24 op/s 2023-07-21T22:36:14.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:14 smithi195 ceph-mon[97365]: pgmap v535: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 24 op/s 2023-07-21T22:36:14.991 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:14 smithi151 ceph-mon[95510]: pgmap v535: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 24 op/s 2023-07-21T22:36:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:16 smithi187 ceph-mon[96918]: pgmap v536: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 24 op/s 2023-07-21T22:36:16.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:16 smithi187 ceph-mon[96918]: osdmap e110: 12 total, 12 up, 12 in 2023-07-21T22:36:16.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:16 smithi195 ceph-mon[97365]: pgmap v536: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 24 op/s 2023-07-21T22:36:16.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:16 smithi195 ceph-mon[97365]: osdmap e110: 12 total, 12 up, 12 in 2023-07-21T22:36:16.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:16 smithi151 ceph-mon[95510]: pgmap v536: 97 pgs: 97 active+clean; 9.2 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 30 MiB/s wr, 24 op/s 2023-07-21T22:36:16.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:16 smithi151 ceph-mon[95510]: osdmap e110: 12 total, 12 up, 12 in 2023-07-21T22:36:18.880 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:18 smithi187 ceph-mon[96918]: pgmap v538: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 63 op/s 2023-07-21T22:36:18.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:18 smithi195 ceph-mon[97365]: pgmap v538: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 63 op/s 2023-07-21T22:36:18.951 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:18 smithi151 ceph-mon[95510]: pgmap v538: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 36 MiB/s wr, 63 op/s 2023-07-21T22:36:20.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:20 smithi187 ceph-mon[96918]: pgmap v539: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 30 MiB/s wr, 53 op/s 2023-07-21T22:36:20.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:20 smithi195 ceph-mon[97365]: pgmap v539: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 30 MiB/s wr, 53 op/s 2023-07-21T22:36:20.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:20 smithi151 ceph-mon[95510]: pgmap v539: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 30 MiB/s wr, 53 op/s 2023-07-21T22:36:22.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:22 smithi187 ceph-mon[96918]: pgmap v540: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 29 MiB/s wr, 51 op/s 2023-07-21T22:36:22.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:22 smithi195 ceph-mon[97365]: pgmap v540: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 29 MiB/s wr, 51 op/s 2023-07-21T22:36:22.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:22 smithi151 ceph-mon[95510]: pgmap v540: 97 pgs: 97 active+clean; 9.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 29 MiB/s wr, 51 op/s 2023-07-21T22:36:24.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:24 smithi187 ceph-mon[96918]: pgmap v541: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 260 op/s 2023-07-21T22:36:24.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:24 smithi195 ceph-mon[97365]: pgmap v541: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 260 op/s 2023-07-21T22:36:24.969 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:24 smithi151 ceph-mon[95510]: pgmap v541: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 260 op/s 2023-07-21T22:36:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.360+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/1570734803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f281004b0 msgr2=0x7f4f2810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.360+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/1570734803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f281004b0 0x7f4f2810c940 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000b0a0 tx=0x7f4f2000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.360+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/1570734803 shutdown_connections 2023-07-21T22:36:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.360+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/1570734803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f28105b10 0x7f4f28105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.360+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/1570734803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f281004b0 0x7f4f2810c940 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.360+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/1570734803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f280ffb00 0x7f4f280fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.360+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/1570734803 >> 172.21.15.151:0/1570734803 conn(0x7f4f280fb600 msgr2=0x7f4f280fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.360+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/1570734803 shutdown_connections 2023-07-21T22:36:26.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.360+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/1570734803 wait complete. 2023-07-21T22:36:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.361+0000 7f4f2e9ff700 1 Processor -- start 2023-07-21T22:36:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.361+0000 7f4f2e9ff700 1 -- start start 2023-07-21T22:36:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f2e9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f280ffb00 0x7f4f28197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f2e9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f281004b0 0x7f4f28198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f2e9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28105b10 0x7f4f2819c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f2e9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2819cfe0 con 0x7f4f28105b10 2023-07-21T22:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f2e9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2819d150 con 0x7f4f281004b0 2023-07-21T22:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f2e9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2819d310 con 0x7f4f280ffb00 2023-07-21T22:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f2cf9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28105b10 0x7f4f2819c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f2cf9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28105b10 0x7f4f2819c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48370/0 (socket says 172.21.15.151:48370) 2023-07-21T22:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f2cf9c700 1 -- 172.21.15.151:0/221876174 learned_addr learned my addr 172.21.15.151:0/221876174 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f277fe700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f281004b0 0x7f4f28198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f27fff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f280ffb00 0x7f4f28197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f277fe700 1 -- 172.21.15.151:0/221876174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f280ffb00 msgr2=0x7f4f28197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.362+0000 7f4f277fe700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f280ffb00 0x7f4f28197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f277fe700 1 -- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28105b10 msgr2=0x7f4f2819c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f277fe700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28105b10 0x7f4f2819c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f277fe700 1 -- 172.21.15.151:0/221876174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20009d00 con 0x7f4f281004b0 2023-07-21T22:36:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f27fff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f280ffb00 0x7f4f28197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f2cf9c700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28105b10 0x7f4f2819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f277fe700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f281004b0 0x7f4f28198330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00e9f0 tx=0x7f4f1c00ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f257fa700 1 -- 172.21.15.151:0/221876174 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c00c9c0 con 0x7f4f281004b0 2023-07-21T22:36:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/221876174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2819d5f0 con 0x7f4f281004b0 2023-07-21T22:36:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f257fa700 1 -- 172.21.15.151:0/221876174 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f1c010430 con 0x7f4f281004b0 2023-07-21T22:36:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f257fa700 1 -- 172.21.15.151:0/221876174 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c018680 con 0x7f4f281004b0 2023-07-21T22:36:26.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.363+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/221876174 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f281a4e30 con 0x7f4f281004b0 2023-07-21T22:36:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.367+0000 7f4f257fa700 1 -- 172.21.15.151:0/221876174 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4f1c0105a0 con 0x7f4f281004b0 2023-07-21T22:36:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.369+0000 7f4f257fa700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4f100a1340 0x7f4f100a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.369+0000 7f4f257fa700 1 -- 172.21.15.151:0/221876174 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4f1c014070 con 0x7f4f281004b0 2023-07-21T22:36:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.369+0000 7f4f27fff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4f100a1340 0x7f4f100a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.370+0000 7f4f27fff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4f100a1340 0x7f4f100a37f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009fd0 tx=0x7f4f18009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.382+0000 7f4f42305b80 1 Processor -- start 2023-07-21T22:36:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.382+0000 7f4f42305b80 1 -- start start 2023-07-21T22:36:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a237cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a231f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238660 0x564a6a2324a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f42305b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a137c50 con 0x564a6a08e6b0 2023-07-21T22:36:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f42305b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a18a9e0 con 0x564a6a238660 2023-07-21T22:36:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f42305b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a183e70 con 0x564a6a238210 2023-07-21T22:36:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a237cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f2cf9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238660 0x564a6a2324a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a237cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48384/0 (socket says 172.21.15.151:48384) 2023-07-21T22:36:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f27fff700 1 -- 172.21.15.151:0/3241780149 learned_addr learned my addr 172.21.15.151:0/3241780149 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f277fe700 1 --2- 172.21.15.151:0/3241780149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a231f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f27fff700 1 -- 172.21.15.151:0/3241780149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 msgr2=0x564a6a231f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f27fff700 1 --2- 172.21.15.151:0/3241780149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a231f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f27fff700 1 -- 172.21.15.151:0/3241780149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238660 msgr2=0x564a6a2324a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.383+0000 7f4f27fff700 1 --2- 172.21.15.151:0/3241780149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238660 0x564a6a2324a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.384+0000 7f4f27fff700 1 -- 172.21.15.151:0/3241780149 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a69fb1d80 con 0x564a6a08e6b0 2023-07-21T22:36:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.384+0000 7f4f27fff700 1 --2- 172.21.15.151:0/3241780149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a237cd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800e720 tx=0x7f4f18014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea29866cefe8cea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.384+0000 7f4f0e7fc700 1 -- 172.21.15.151:0/3241780149 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18026600 con 0x564a6a08e6b0 2023-07-21T22:36:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.384+0000 7f4f0e7fc700 1 -- 172.21.15.151:0/3241780149 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f18026bf0 con 0x564a6a08e6b0 2023-07-21T22:36:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.384+0000 7f4f0e7fc700 1 -- 172.21.15.151:0/3241780149 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1801eb50 con 0x564a6a08e6b0 2023-07-21T22:36:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.385+0000 7f4f42305b80 1 -- 172.21.15.151:0/3241780149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 msgr2=0x564a6a237cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.385+0000 7f4f42305b80 1 --2- 172.21.15.151:0/3241780149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a237cd0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800e720 tx=0x7f4f18014000 comp rx=0 tx=0).stop 2023-07-21T22:36:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.385+0000 7f4f42305b80 1 -- 172.21.15.151:0/3241780149 shutdown_connections 2023-07-21T22:36:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.385+0000 7f4f42305b80 1 --2- 172.21.15.151:0/3241780149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238660 0x564a6a2324a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.385+0000 7f4f42305b80 1 --2- 172.21.15.151:0/3241780149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a237cd0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.385+0000 7f4f42305b80 1 --2- 172.21.15.151:0/3241780149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a231f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.385+0000 7f4f42305b80 1 -- 172.21.15.151:0/3241780149 >> 172.21.15.151:0/3241780149 conn(0x564a6a227ae0 msgr2=0x564a6a22d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.385+0000 7f4f42305b80 1 -- 172.21.15.151:0/3241780149 shutdown_connections 2023-07-21T22:36:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.385+0000 7f4f42305b80 1 -- 172.21.15.151:0/3241780149 wait complete. 2023-07-21T22:36:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.386+0000 7f4f42305b80 1 -- start start 2023-07-21T22:36:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.386+0000 7f4f42305b80 1 Processor -- start 2023-07-21T22:36:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a08e6b0 0x564a6a23b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a23be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a238660 0x564a6a23c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f42305b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a123a60 con 0x564a6a238660 2023-07-21T22:36:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f42305b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a123760 con 0x564a6a08e6b0 2023-07-21T22:36:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f42305b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a0078c0 con 0x564a6a238210 2023-07-21T22:36:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f42305b80 10 client.0 _ll_register_callbacks cb 0x564a6a121700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:36:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a08e6b0 0x564a6a23b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a08e6b0 0x564a6a23b8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42670/0 (socket says 172.21.15.151:42670) 2023-07-21T22:36:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f27fff700 1 -- 172.21.15.151:0/1939916376 learned_addr learned my addr 172.21.15.151:0/1939916376 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f2cf9c700 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a238660 0x564a6a23c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.387+0000 7f4f277fe700 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a23be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f277fe700 1 -- 172.21.15.151:0/1939916376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a08e6b0 msgr2=0x564a6a23b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f277fe700 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a08e6b0 0x564a6a23b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f277fe700 1 -- 172.21.15.151:0/1939916376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a238660 msgr2=0x564a6a23c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f277fe700 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a238660 0x564a6a23c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f277fe700 1 -- 172.21.15.151:0/1939916376 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f18017070 con 0x564a6a238210 2023-07-21T22:36:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f27fff700 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a08e6b0 0x564a6a23b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f2cf9c700 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a238660 0x564a6a23c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f277fe700 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a23be10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0ca530 tx=0x7f4f1c0108f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b059b686e272c24 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f077fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:36:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f077fe700 1 -- 172.21.15.151:0/1939916376 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1c0b1070 con 0x564a6a238210 2023-07-21T22:36:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f077fe700 1 -- 172.21.15.151:0/1939916376 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4f1c09dee0 con 0x564a6a238210 2023-07-21T22:36:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f42305b80 1 -- 172.21.15.151:0/1939916376 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564a6a0dd490 con 0x564a6a238210 2023-07-21T22:36:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.388+0000 7f4f077fe700 1 -- 172.21.15.151:0/1939916376 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f1c0a2300 con 0x564a6a238210 2023-07-21T22:36:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f42305b80 10 client.27403 fetch_fsmap learned FSMap version 64 2023-07-21T22:36:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f42305b80 1 -- 172.21.15.151:0/1939916376 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x564a69f9ac00 con 0x564a6a238210 2023-07-21T22:36:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f077fe700 1 -- 172.21.15.151:0/1939916376 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f1c0c8080 con 0x564a6a238210 2023-07-21T22:36:26.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f077fe700 1 -- 172.21.15.151:0/1939916376 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4f1c0adbb0 con 0x564a6a238210 2023-07-21T22:36:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f42305b80 10 client.27403 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:36:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f42305b80 10 client.27403 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:36:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f42305b80 20 client.27403 populate_metadata read hostname 'smithi151' 2023-07-21T22:36:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564a6a24bb60 0x564a6a24df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f42305b80 4 client.27403 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:36:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.389+0000 7f4f42305b80 1 -- 172.21.15.151:0/1939916376 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564a6a17ce50 con 0x564a6a24bb60 2023-07-21T22:36:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.390+0000 7f4f27fff700 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564a6a24bb60 0x564a6a24df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.390+0000 7f4f27fff700 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564a6a24bb60 0x564a6a24df70 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a06455a7b4e1a7a server_cookie=58eb3dc9149f18e8 in_seq=0 out_seq=0 2023-07-21T22:36:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.390+0000 7f4f077fe700 10 client.27403 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.391+0000 7f4f077fe700 1 -- 172.21.15.151:0/1939916376 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564a6a17ce50 con 0x564a6a24bb60 2023-07-21T22:36:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.391+0000 7f4f077fe700 10 client.27403 handle_command_reply: tid=0 2023-07-21T22:36:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.391+0000 7f4f42305b80 1 client.27403 shutdown 2023-07-21T22:36:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 -- 172.21.15.151:0/1939916376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 msgr2=0x564a6a23be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a23be10 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c0ca530 tx=0x7f4f1c0108f0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 -- 172.21.15.151:0/1939916376 shutdown_connections 2023-07-21T22:36:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564a6a24bb60 0x564a6a24df70 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a08e6b0 0x564a6a23b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a238660 0x564a6a23c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1939916376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a23be10 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 -- 172.21.15.151:0/1939916376 >> 172.21.15.151:0/1939916376 conn(0x564a6a227ae0 msgr2=0x564a6a22c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f077fe700 0 client.27403 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 -- 172.21.15.151:0/1939916376 shutdown_connections 2023-07-21T22:36:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 1 -- 172.21.15.151:0/1939916376 wait complete. 2023-07-21T22:36:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.392+0000 7f4f42305b80 20 client.27403 trim_cache size 0 max 16384 2023-07-21T22:36:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.412+0000 7f4f42305b80 1 Processor -- start 2023-07-21T22:36:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f42305b80 1 -- start start 2023-07-21T22:36:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a227ae0 0x564a6a237240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a08e6b0 0x564a6a242b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238210 0x564a6a22cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f42305b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a224b20 con 0x564a6a227ae0 2023-07-21T22:36:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f42305b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a237920 con 0x564a6a238210 2023-07-21T22:36:26.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f42305b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a2294f0 con 0x564a6a08e6b0 2023-07-21T22:36:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f2cf9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238210 0x564a6a22cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f2cf9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238210 0x564a6a22cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42680/0 (socket says 172.21.15.151:42680) 2023-07-21T22:36:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f2cf9c700 1 -- 172.21.15.151:0/2259335886 learned_addr learned my addr 172.21.15.151:0/2259335886 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.413+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a227ae0 0x564a6a237240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.414+0000 7f4f277fe700 1 --2- 172.21.15.151:0/2259335886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a08e6b0 0x564a6a242b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.414+0000 7f4f2cf9c700 1 -- 172.21.15.151:0/2259335886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a08e6b0 msgr2=0x564a6a242b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.414+0000 7f4f2cf9c700 1 --2- 172.21.15.151:0/2259335886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a08e6b0 0x564a6a242b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.414+0000 7f4f2cf9c700 1 -- 172.21.15.151:0/2259335886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a227ae0 msgr2=0x564a6a237240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.414+0000 7f4f2cf9c700 1 --2- 172.21.15.151:0/2259335886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a227ae0 0x564a6a237240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.414+0000 7f4f2cf9c700 1 -- 172.21.15.151:0/2259335886 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564a69fd81f0 con 0x564a6a238210 2023-07-21T22:36:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.414+0000 7f4f27fff700 1 --2- 172.21.15.151:0/2259335886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a227ae0 0x564a6a237240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:36:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.414+0000 7f4f2cf9c700 1 --2- 172.21.15.151:0/2259335886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238210 0x564a6a22cb60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000bf70 tx=0x7f4f20009420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff7e9acfa3d650a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:26.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f0effd700 1 -- 172.21.15.151:0/2259335886 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20021070 con 0x564a6a238210 2023-07-21T22:36:26.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f0effd700 1 -- 172.21.15.151:0/2259335886 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f20003a00 con 0x564a6a238210 2023-07-21T22:36:26.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f0effd700 1 -- 172.21.15.151:0/2259335886 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000e040 con 0x564a6a238210 2023-07-21T22:36:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f42305b80 1 -- 172.21.15.151:0/2259335886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238210 msgr2=0x564a6a22cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:26.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f42305b80 1 --2- 172.21.15.151:0/2259335886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238210 0x564a6a22cb60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4f2000bf70 tx=0x7f4f20009420 comp rx=0 tx=0).stop 2023-07-21T22:36:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f42305b80 1 -- 172.21.15.151:0/2259335886 shutdown_connections 2023-07-21T22:36:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f42305b80 1 --2- 172.21.15.151:0/2259335886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a238210 0x564a6a22cb60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f42305b80 1 --2- 172.21.15.151:0/2259335886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a227ae0 0x564a6a237240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f42305b80 1 --2- 172.21.15.151:0/2259335886 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a08e6b0 0x564a6a242b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.415+0000 7f4f42305b80 1 -- 172.21.15.151:0/2259335886 >> 172.21.15.151:0/2259335886 conn(0x564a6a247690 msgr2=0x564a6a23b890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.416+0000 7f4f42305b80 1 -- 172.21.15.151:0/2259335886 shutdown_connections 2023-07-21T22:36:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.416+0000 7f4f42305b80 1 -- 172.21.15.151:0/2259335886 wait complete. 2023-07-21T22:36:26.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.416+0000 7f4f42305b80 1 -- start start 2023-07-21T22:36:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.416+0000 7f4f42305b80 1 Processor -- start 2023-07-21T22:36:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a242c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a227ae0 0x564a6a29a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f42305b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a29af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f42305b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a29b640 con 0x564a6a08e6b0 2023-07-21T22:36:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f42305b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a29b7b0 con 0x564a6a227ae0 2023-07-21T22:36:26.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f42305b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564a6a233d70 con 0x564a6a238210 2023-07-21T22:36:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f42305b80 10 client.0 _ll_register_callbacks cb 0x7f4f1c0999f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:36:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a242c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f27fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a242c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48408/0 (socket says 172.21.15.151:48408) 2023-07-21T22:36:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.417+0000 7f4f27fff700 1 -- 172.21.15.151:0/1238282487 learned_addr learned my addr 172.21.15.151:0/1238282487 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.418+0000 7f4f277fe700 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a227ae0 0x564a6a29a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.418+0000 7f4f2cf9c700 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a29af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.418+0000 7f4f27fff700 1 -- 172.21.15.151:0/1238282487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 msgr2=0x564a6a29af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:26.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.418+0000 7f4f27fff700 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a29af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.418+0000 7f4f27fff700 1 -- 172.21.15.151:0/1238282487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a227ae0 msgr2=0x564a6a29a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.418+0000 7f4f27fff700 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a227ae0 0x564a6a29a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.418+0000 7f4f27fff700 1 -- 172.21.15.151:0/1238282487 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2810d240 con 0x564a6a08e6b0 2023-07-21T22:36:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.418+0000 7f4f27fff700 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a242c20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x564a6a24e880 tx=0x7f4f1801e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9acf951bf950d86f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:26.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.418+0000 7f4f077fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:36:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f077fe700 1 -- 172.21.15.151:0/1238282487 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1802c040 con 0x564a6a08e6b0 2023-07-21T22:36:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f077fe700 1 -- 172.21.15.151:0/1238282487 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4f18026910 con 0x564a6a08e6b0 2023-07-21T22:36:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f42305b80 1 -- 172.21.15.151:0/1238282487 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f18026bf0 con 0x564a6a08e6b0 2023-07-21T22:36:26.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f077fe700 1 -- 172.21.15.151:0/1238282487 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f180329c0 con 0x564a6a08e6b0 2023-07-21T22:36:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f42305b80 10 client.17700 fetch_fsmap learned FSMap version 64 2023-07-21T22:36:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f42305b80 1 -- 172.21.15.151:0/1238282487 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x564a69fb0250 con 0x564a6a08e6b0 2023-07-21T22:36:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f077fe700 1 -- 172.21.15.151:0/1238282487 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4f18026bf0 con 0x564a6a08e6b0 2023-07-21T22:36:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f077fe700 1 -- 172.21.15.151:0/1238282487 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4f18024020 con 0x564a6a08e6b0 2023-07-21T22:36:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f42305b80 10 client.17700 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:36:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f42305b80 10 client.17700 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:36:26.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f42305b80 20 client.17700 populate_metadata read hostname 'smithi151' 2023-07-21T22:36:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.419+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564a6a238660 0x564a6a241fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.420+0000 7f4f42305b80 4 client.17700 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:36:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.420+0000 7f4f42305b80 1 -- 172.21.15.151:0/1238282487 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564a6a13eff0 con 0x564a6a238660 2023-07-21T22:36:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.420+0000 7f4f277fe700 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564a6a238660 0x564a6a241fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.420+0000 7f4f277fe700 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564a6a238660 0x564a6a241fe0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4622d07c96c14807 server_cookie=bc38cbcb78b6d995 in_seq=0 out_seq=0 2023-07-21T22:36:26.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.420+0000 7f4f077fe700 10 client.17700 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f077fe700 1 -- 172.21.15.151:0/1238282487 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564a6a13eff0 con 0x564a6a238660 2023-07-21T22:36:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f077fe700 10 client.17700 handle_command_reply: tid=0 2023-07-21T22:36:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 client.17700 shutdown 2023-07-21T22:36:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 -- 172.21.15.151:0/1238282487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 msgr2=0x564a6a242c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:26.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a242c20 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x564a6a24e880 tx=0x7f4f1801e490 comp rx=0 tx=0).stop 2023-07-21T22:36:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 -- 172.21.15.151:0/1238282487 shutdown_connections 2023-07-21T22:36:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564a6a238660 0x564a6a241fe0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564a6a238210 0x564a6a29af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564a6a08e6b0 0x564a6a242c20 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f077fe700 0 client.17700 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 --2- 172.21.15.151:0/1238282487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564a6a227ae0 0x564a6a29a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 -- 172.21.15.151:0/1238282487 >> 172.21.15.151:0/1238282487 conn(0x564a6a247690 msgr2=0x564a6a2370b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:26.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 -- 172.21.15.151:0/1238282487 shutdown_connections 2023-07-21T22:36:26.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 1 -- 172.21.15.151:0/1238282487 wait complete. 2023-07-21T22:36:26.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.429+0000 7f4f42305b80 20 client.17700 trim_cache size 0 max 16384 2023-07-21T22:36:26.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:36:26.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:36:26.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:36:26.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:36:26.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4f100a1340 msgr2=0x7f4f100a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:26.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4f100a1340 0x7f4f100a37f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f18009fd0 tx=0x7f4f18009260 comp rx=0 tx=0).stop 2023-07-21T22:36:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/221876174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f281004b0 msgr2=0x7f4f28198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f281004b0 0x7f4f28198330 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c00e9f0 tx=0x7f4f1c00ed00 comp rx=0 tx=0).stop 2023-07-21T22:36:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/221876174 shutdown_connections 2023-07-21T22:36:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4f100a1340 0x7f4f100a37f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28105b10 0x7f4f2819c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4f280ffb00 0x7f4f28197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 --2- 172.21.15.151:0/221876174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f281004b0 0x7f4f28198330 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:26.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.430+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/221876174 >> 172.21.15.151:0/221876174 conn(0x7f4f280fb600 msgr2=0x7f4f2810ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:26.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.431+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/221876174 shutdown_connections 2023-07-21T22:36:26.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:26.431+0000 7f4f2e9ff700 1 -- 172.21.15.151:0/221876174 wait complete. 2023-07-21T22:36:26.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:26 smithi187 ceph-mon[96918]: pgmap v542: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 260 op/s 2023-07-21T22:36:26.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:26 smithi195 ceph-mon[97365]: pgmap v542: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 260 op/s 2023-07-21T22:36:26.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:26 smithi151 ceph-mon[95510]: pgmap v542: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 16 MiB/s wr, 260 op/s 2023-07-21T22:36:28.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:28 smithi187 ceph-mon[96918]: pgmap v543: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 452 op/s 2023-07-21T22:36:28.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:28 smithi195 ceph-mon[97365]: pgmap v543: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 452 op/s 2023-07-21T22:36:28.958 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:28 smithi151 ceph-mon[95510]: pgmap v543: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 17 MiB/s wr, 452 op/s 2023-07-21T22:36:30.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:30 smithi187 ceph-mon[96918]: pgmap v544: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.2 MiB/s wr, 368 op/s 2023-07-21T22:36:30.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:30 smithi195 ceph-mon[97365]: pgmap v544: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.2 MiB/s wr, 368 op/s 2023-07-21T22:36:30.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:30 smithi151 ceph-mon[95510]: pgmap v544: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.2 MiB/s wr, 368 op/s 2023-07-21T22:36:32.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:32 smithi187 ceph-mon[96918]: pgmap v545: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.2 MiB/s wr, 368 op/s 2023-07-21T22:36:32.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:32 smithi195 ceph-mon[97365]: pgmap v545: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.2 MiB/s wr, 368 op/s 2023-07-21T22:36:32.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:32 smithi151 ceph-mon[95510]: pgmap v545: 97 pgs: 97 active+clean; 9.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.2 MiB/s wr, 368 op/s 2023-07-21T22:36:34.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:34 smithi187 ceph-mon[96918]: pgmap v546: 97 pgs: 97 active+clean; 9.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 545 op/s 2023-07-21T22:36:34.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:34 smithi195 ceph-mon[97365]: pgmap v546: 97 pgs: 97 active+clean; 9.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 545 op/s 2023-07-21T22:36:34.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:34 smithi151 ceph-mon[95510]: pgmap v546: 97 pgs: 97 active+clean; 9.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.5 MiB/s wr, 545 op/s 2023-07-21T22:36:36.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:36 smithi187 ceph-mon[96918]: pgmap v547: 97 pgs: 97 active+clean; 9.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.1 MiB/s wr, 360 op/s 2023-07-21T22:36:36.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:36 smithi195 ceph-mon[97365]: pgmap v547: 97 pgs: 97 active+clean; 9.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.1 MiB/s wr, 360 op/s 2023-07-21T22:36:36.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:36 smithi151 ceph-mon[95510]: pgmap v547: 97 pgs: 97 active+clean; 9.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.1 MiB/s wr, 360 op/s 2023-07-21T22:36:38.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:38 smithi187 ceph-mon[96918]: pgmap v548: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2023-07-21T22:36:38.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:38 smithi195 ceph-mon[97365]: pgmap v548: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2023-07-21T22:36:38.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:38 smithi151 ceph-mon[95510]: pgmap v548: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.5 MiB/s wr, 538 op/s 2023-07-21T22:36:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.714+0000 7f67565ff700 1 -- 172.21.15.151:0/1455483079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67500685b0 msgr2=0x7f6750104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.714+0000 7f67565ff700 1 --2- 172.21.15.151:0/1455483079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67500685b0 0x7f6750104770 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f67380099c0 tx=0x7f6738009cd0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.714+0000 7f67565ff700 1 -- 172.21.15.151:0/1455483079 shutdown_connections 2023-07-21T22:36:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.714+0000 7f67565ff700 1 --2- 172.21.15.151:0/1455483079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6750104e50 0x7f675010ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.714+0000 7f67565ff700 1 --2- 172.21.15.151:0/1455483079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6750067c10 0x7f6750067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.714+0000 7f67565ff700 1 --2- 172.21.15.151:0/1455483079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67500685b0 0x7f6750104770 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.714+0000 7f67565ff700 1 -- 172.21.15.151:0/1455483079 >> 172.21.15.151:0/1455483079 conn(0x7f6750074760 msgr2=0x7f6750074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.714+0000 7f67565ff700 1 -- 172.21.15.151:0/1455483079 shutdown_connections 2023-07-21T22:36:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.714+0000 7f67565ff700 1 -- 172.21.15.151:0/1455483079 wait complete. 2023-07-21T22:36:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.715+0000 7f67565ff700 1 Processor -- start 2023-07-21T22:36:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.715+0000 7f67565ff700 1 -- start start 2023-07-21T22:36:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f67565ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6750067c10 0x7f675019bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f67565ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67500685b0 0x7f675019c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f67565ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6750104e50 0x7f67501959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f67565ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6750196020 con 0x7f6750104e50 2023-07-21T22:36:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f67565ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6750196190 con 0x7f67500685b0 2023-07-21T22:36:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f67565ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6750196350 con 0x7f6750067c10 2023-07-21T22:36:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f6754b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6750104e50 0x7f67501959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f674ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6750067c10 0x7f675019bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f6747fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67500685b0 0x7f675019c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f674ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6750067c10 0x7f675019bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47688/0 (socket says 172.21.15.151:47688) 2023-07-21T22:36:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f6754b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6750104e50 0x7f67501959b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41764/0 (socket says 172.21.15.151:41764) 2023-07-21T22:36:39.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.716+0000 7f674ffff700 1 -- 172.21.15.151:0/2576140649 learned_addr learned my addr 172.21.15.151:0/2576140649 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:39.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f6747fff700 1 -- 172.21.15.151:0/2576140649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6750067c10 msgr2=0x7f675019bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:39.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f6747fff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6750067c10 0x7f675019bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f6747fff700 1 -- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6750104e50 msgr2=0x7f67501959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:39.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f6747fff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6750104e50 0x7f67501959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f6747fff700 1 -- 172.21.15.151:0/2576140649 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67380095f0 con 0x7f67500685b0 2023-07-21T22:36:39.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f6754b9c700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6750104e50 0x7f67501959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f674ffff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6750067c10 0x7f675019bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f6747fff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67500685b0 0x7f675019c090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f67380098e0 tx=0x7f673800f690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f674dffb700 1 -- 172.21.15.151:0/2576140649 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673801d070 con 0x7f67500685b0 2023-07-21T22:36:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f674dffb700 1 -- 172.21.15.151:0/2576140649 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6738005050 con 0x7f67500685b0 2023-07-21T22:36:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f67565ff700 1 -- 172.21.15.151:0/2576140649 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67501965d0 con 0x7f67500685b0 2023-07-21T22:36:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f674dffb700 1 -- 172.21.15.151:0/2576140649 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6738004970 con 0x7f67500685b0 2023-07-21T22:36:39.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.717+0000 7f67565ff700 1 -- 172.21.15.151:0/2576140649 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67500feb70 con 0x7f67500685b0 2023-07-21T22:36:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.720+0000 7f674dffb700 1 -- 172.21.15.151:0/2576140649 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f67380051c0 con 0x7f67500685b0 2023-07-21T22:36:39.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.722+0000 7f674dffb700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f673c0a1340 0x7f673c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.722+0000 7f6769fb0b80 1 Processor -- start 2023-07-21T22:36:39.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.722+0000 7f674dffb700 1 -- 172.21.15.151:0/2576140649 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f67380cd870 con 0x7f67500685b0 2023-07-21T22:36:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.722+0000 7f674ffff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f673c0a1340 0x7f673c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.722+0000 7f6769fb0b80 1 -- start start 2023-07-21T22:36:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3caf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e2d0c50 con 0x55ab9e2276b0 2023-07-21T22:36:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e3239e0 con 0x55ab9e3d1660 2023-07-21T22:36:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e31ce70 con 0x55ab9e3d1210 2023-07-21T22:36:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f674ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f674ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41768/0 (socket says 172.21.15.151:41768) 2023-07-21T22:36:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f674ffff700 1 -- 172.21.15.151:0/954243230 learned_addr learned my addr 172.21.15.151:0/954243230 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:39.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6747fff700 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6754b9c700 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f674ffff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f673c0a1340 0x7f673c0a37f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6740011550 tx=0x7f6740009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6747fff700 1 -- 172.21.15.151:0/954243230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 msgr2=0x55ab9e3cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6747fff700 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6747fff700 1 -- 172.21.15.151:0/954243230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 msgr2=0x55ab9e3d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6747fff700 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.723+0000 7f6747fff700 1 -- 172.21.15.151:0/954243230 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab9e14ad80 con 0x55ab9e3d1210 2023-07-21T22:36:39.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.724+0000 7f674ffff700 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.724+0000 7f6747fff700 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3caf40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f67380cafe0 tx=0x7f673809a440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ecf0e49ac2a0e956 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.724+0000 7f67467fc700 1 -- 172.21.15.151:0/954243230 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380a2db0 con 0x55ab9e3d1210 2023-07-21T22:36:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.724+0000 7f67467fc700 1 -- 172.21.15.151:0/954243230 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6738097100 con 0x55ab9e3d1210 2023-07-21T22:36:39.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.724+0000 7f67467fc700 1 -- 172.21.15.151:0/954243230 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673809aeb0 con 0x55ab9e3d1210 2023-07-21T22:36:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 -- 172.21.15.151:0/954243230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 msgr2=0x55ab9e3caf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3caf40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f67380cafe0 tx=0x7f673809a440 comp rx=0 tx=0).stop 2023-07-21T22:36:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 -- 172.21.15.151:0/954243230 shutdown_connections 2023-07-21T22:36:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/954243230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3caf40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 -- 172.21.15.151:0/954243230 >> 172.21.15.151:0/954243230 conn(0x55ab9e3c0ae0 msgr2=0x55ab9e3c60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 -- 172.21.15.151:0/954243230 shutdown_connections 2023-07-21T22:36:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 -- 172.21.15.151:0/954243230 wait complete. 2023-07-21T22:36:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.725+0000 7f6769fb0b80 1 -- start start 2023-07-21T22:36:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.726+0000 7f6769fb0b80 1 Processor -- start 2023-07-21T22:36:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.726+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.726+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.726+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d4500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.726+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e2bca60 con 0x55ab9e2276b0 2023-07-21T22:36:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.726+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e2bc760 con 0x55ab9e3d1660 2023-07-21T22:36:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.726+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e1a08c0 con 0x55ab9e3d1210 2023-07-21T22:36:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.726+0000 7f6769fb0b80 10 client.0 _ll_register_callbacks cb 0x55ab9e2ba700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:36:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.726+0000 7f674ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f6747fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f6747fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3da7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47710/0 (socket says 172.21.15.151:47710) 2023-07-21T22:36:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f6747fff700 1 -- 172.21.15.151:0/1456218730 learned_addr learned my addr 172.21.15.151:0/1456218730 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f6754b9c700 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f674ffff700 1 -- 172.21.15.151:0/1456218730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 msgr2=0x55ab9e3da7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f674ffff700 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3da7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f674ffff700 1 -- 172.21.15.151:0/1456218730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 msgr2=0x55ab9e3d4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f674ffff700 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d4500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f674ffff700 1 -- 172.21.15.151:0/1456218730 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6740017070 con 0x55ab9e2276b0 2023-07-21T22:36:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f6747fff700 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3da7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f6754b9c700 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:36:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f674ffff700 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da270 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6740011ca0 tx=0x7f67400047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a563ec4a70cf23e0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.727+0000 7f672f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:36:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f672f7fe700 1 -- 172.21.15.151:0/1456218730 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740022070 con 0x55ab9e2276b0 2023-07-21T22:36:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f672f7fe700 1 -- 172.21.15.151:0/1456218730 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f674001dd90 con 0x55ab9e2276b0 2023-07-21T22:36:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f6769fb0b80 1 -- 172.21.15.151:0/1456218730 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ab9e276490 con 0x55ab9e2276b0 2023-07-21T22:36:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f672f7fe700 1 -- 172.21.15.151:0/1456218730 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f674000ee80 con 0x55ab9e2276b0 2023-07-21T22:36:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f6769fb0b80 10 client.17712 fetch_fsmap learned FSMap version 64 2023-07-21T22:36:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f6769fb0b80 1 -- 172.21.15.151:0/1456218730 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x7f67500feb70 con 0x55ab9e2276b0 2023-07-21T22:36:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f672f7fe700 1 -- 172.21.15.151:0/1456218730 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ab9e276490 con 0x55ab9e2276b0 2023-07-21T22:36:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f672f7fe700 1 -- 172.21.15.151:0/1456218730 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f67400053a0 con 0x55ab9e2276b0 2023-07-21T22:36:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f6769fb0b80 10 client.17712 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:36:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f6769fb0b80 10 client.17712 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:36:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f6769fb0b80 20 client.17712 populate_metadata read hostname 'smithi151' 2023-07-21T22:36:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ab9e3e4830 0x55ab9e3e6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f6769fb0b80 4 client.17712 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:36:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.728+0000 7f6769fb0b80 1 -- 172.21.15.151:0/1456218730 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ab9e315e50 con 0x55ab9e3e4830 2023-07-21T22:36:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.729+0000 7f6747fff700 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ab9e3e4830 0x55ab9e3e6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.729+0000 7f6747fff700 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ab9e3e4830 0x55ab9e3e6c40 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e843f49de9d79ef server_cookie=31e165e4c24c59a9 in_seq=0 out_seq=0 2023-07-21T22:36:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.729+0000 7f672f7fe700 10 client.17712 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f672f7fe700 1 -- 172.21.15.151:0/1456218730 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ab9e315e50 con 0x55ab9e3e4830 2023-07-21T22:36:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f672f7fe700 10 client.17712 handle_command_reply: tid=0 2023-07-21T22:36:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f6769fb0b80 1 client.17712 shutdown 2023-07-21T22:36:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f6769fb0b80 1 -- 172.21.15.151:0/1456218730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 msgr2=0x55ab9e3da270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da270 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6740011ca0 tx=0x7f67400047c0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f6769fb0b80 1 -- 172.21.15.151:0/1456218730 shutdown_connections 2023-07-21T22:36:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ab9e3e4830 0x55ab9e3e6c40 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d4500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da270 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f672f7fe700 0 client.17712 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/1456218730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3da7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.730+0000 7f6769fb0b80 1 -- 172.21.15.151:0/1456218730 >> 172.21.15.151:0/1456218730 conn(0x55ab9e3c0ae0 msgr2=0x55ab9e3c53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.731+0000 7f6769fb0b80 1 -- 172.21.15.151:0/1456218730 shutdown_connections 2023-07-21T22:36:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.731+0000 7f6769fb0b80 1 -- 172.21.15.151:0/1456218730 wait complete. 2023-07-21T22:36:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.731+0000 7f6769fb0b80 20 client.17712 trim_cache size 0 max 16384 2023-07-21T22:36:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.746+0000 7f6769fb0b80 1 Processor -- start 2023-07-21T22:36:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.746+0000 7f6769fb0b80 1 -- start start 2023-07-21T22:36:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d4630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e3cbf80 con 0x55ab9e3d1210 2023-07-21T22:36:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e315e50 con 0x55ab9e2276b0 2023-07-21T22:36:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e276490 con 0x55ab9e3d1660 2023-07-21T22:36:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6747fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6747fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41780/0 (socket says 172.21.15.151:41780) 2023-07-21T22:36:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6747fff700 1 -- 172.21.15.151:0/2436234665 learned_addr learned my addr 172.21.15.151:0/2436234665 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6754b9c700 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f674ffff700 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6747fff700 1 -- 172.21.15.151:0/2436234665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1660 msgr2=0x55ab9e3d4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6747fff700 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d4630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6747fff700 1 -- 172.21.15.151:0/2436234665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e2276b0 msgr2=0x55ab9e3d0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6747fff700 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f6747fff700 1 -- 172.21.15.151:0/2436234665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ab9e3eb870 con 0x55ab9e3d1210 2023-07-21T22:36:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.747+0000 7f674ffff700 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:36:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.748+0000 7f6747fff700 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d2120 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f67380cb560 tx=0x7f6738096e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a23980c4519bc2c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.748+0000 7f6746ffd700 1 -- 172.21.15.151:0/2436234665 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67380b8cf0 con 0x55ab9e3d1210 2023-07-21T22:36:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.748+0000 7f6746ffd700 1 -- 172.21.15.151:0/2436234665 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67380b2070 con 0x55ab9e3d1210 2023-07-21T22:36:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.748+0000 7f6746ffd700 1 -- 172.21.15.151:0/2436234665 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f673809ac50 con 0x55ab9e3d1210 2023-07-21T22:36:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 -- 172.21.15.151:0/2436234665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e3d1210 msgr2=0x55ab9e3d2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d2120 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f67380cb560 tx=0x7f6738096e60 comp rx=0 tx=0).stop 2023-07-21T22:36:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 -- 172.21.15.151:0/2436234665 shutdown_connections 2023-07-21T22:36:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e2276b0 0x55ab9e3d0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d4630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/2436234665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d2120 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 -- 172.21.15.151:0/2436234665 >> 172.21.15.151:0/2436234665 conn(0x55ab9e3c0ae0 msgr2=0x55ab9e3d2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 -- 172.21.15.151:0/2436234665 shutdown_connections 2023-07-21T22:36:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 -- 172.21.15.151:0/2436234665 wait complete. 2023-07-21T22:36:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 -- start start 2023-07-21T22:36:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.749+0000 7f6769fb0b80 1 Processor -- start 2023-07-21T22:36:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6769fb0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e3d8b20 con 0x55ab9e2276b0 2023-07-21T22:36:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e3d8c90 con 0x55ab9e3d1660 2023-07-21T22:36:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6769fb0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ab9e437720 con 0x55ab9e3d1210 2023-07-21T22:36:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6769fb0b80 10 client.0 _ll_register_callbacks cb 0x7f674000e980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:36:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f674ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f674ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41790/0 (socket says 172.21.15.151:41790) 2023-07-21T22:36:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f674ffff700 1 -- 172.21.15.151:0/4129117077 learned_addr learned my addr 172.21.15.151:0/4129117077 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:39.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6747fff700 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6754b9c700 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f674ffff700 1 -- 172.21.15.151:0/4129117077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 msgr2=0x55ab9e3d7e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f674ffff700 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d7e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f674ffff700 1 -- 172.21.15.151:0/4129117077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 msgr2=0x55ab9e3d83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f674ffff700 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f674ffff700 1 -- 172.21.15.151:0/4129117077 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ab9e14ad80 con 0x55ab9e2276b0 2023-07-21T22:36:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.750+0000 7f6747fff700 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:36:39.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.751+0000 7f674ffff700 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da680 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f674000a010 tx=0x7f6740026f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51592d62a601e003 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.751+0000 7f672f7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:36:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.751+0000 7f672f7fe700 1 -- 172.21.15.151:0/4129117077 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6740022070 con 0x55ab9e2276b0 2023-07-21T22:36:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.751+0000 7f672f7fe700 1 -- 172.21.15.151:0/4129117077 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6740026560 con 0x55ab9e2276b0 2023-07-21T22:36:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.751+0000 7f6769fb0b80 1 -- 172.21.15.151:0/4129117077 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6738097100 con 0x55ab9e2276b0 2023-07-21T22:36:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.751+0000 7f672f7fe700 1 -- 172.21.15.151:0/4129117077 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67400092d0 con 0x55ab9e2276b0 2023-07-21T22:36:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.751+0000 7f6769fb0b80 10 client.17718 fetch_fsmap learned FSMap version 64 2023-07-21T22:36:39.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.751+0000 7f6769fb0b80 1 -- 172.21.15.151:0/4129117077 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x55ab9e133c00 con 0x55ab9e2276b0 2023-07-21T22:36:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.751+0000 7f672f7fe700 1 -- 172.21.15.151:0/4129117077 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6738097100 con 0x55ab9e2276b0 2023-07-21T22:36:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.752+0000 7f672f7fe700 1 -- 172.21.15.151:0/4129117077 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f674001b690 con 0x55ab9e2276b0 2023-07-21T22:36:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.752+0000 7f6769fb0b80 10 client.17718 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:36:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.752+0000 7f6769fb0b80 10 client.17718 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:36:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.752+0000 7f6769fb0b80 20 client.17718 populate_metadata read hostname 'smithi151' 2023-07-21T22:36:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.752+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ab9e438e20 0x55ab9e43b230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.752+0000 7f6769fb0b80 4 client.17718 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:36:39.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.752+0000 7f6769fb0b80 1 -- 172.21.15.151:0/4129117077 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ab9e2d7ff0 con 0x55ab9e438e20 2023-07-21T22:36:39.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.752+0000 7f6747fff700 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ab9e438e20 0x55ab9e43b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:39.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.753+0000 7f6747fff700 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ab9e438e20 0x55ab9e43b230 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc920078f87580b7 server_cookie=b5a087f8a5fe3ed3 in_seq=0 out_seq=0 2023-07-21T22:36:39.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.753+0000 7f672f7fe700 10 client.17718 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:39.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f672f7fe700 1 -- 172.21.15.151:0/4129117077 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ab9e2d7ff0 con 0x55ab9e438e20 2023-07-21T22:36:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f672f7fe700 10 client.17718 handle_command_reply: tid=0 2023-07-21T22:36:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f6769fb0b80 1 client.17718 shutdown 2023-07-21T22:36:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f6769fb0b80 1 -- 172.21.15.151:0/4129117077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 msgr2=0x55ab9e3da680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da680 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f674000a010 tx=0x7f6740026f70 comp rx=0 tx=0).stop 2023-07-21T22:36:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f6769fb0b80 1 -- 172.21.15.151:0/4129117077 shutdown_connections 2023-07-21T22:36:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ab9e438e20 0x55ab9e43b230 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ab9e3d1660 0x55ab9e3d83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab9e2276b0 0x55ab9e3da680 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f672f7fe700 0 client.17718 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f6769fb0b80 1 --2- 172.21.15.151:0/4129117077 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ab9e3d1210 0x55ab9e3d7e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.764+0000 7f6769fb0b80 1 -- 172.21.15.151:0/4129117077 >> 172.21.15.151:0/4129117077 conn(0x55ab9e3c0ae0 msgr2=0x55ab9e3c9f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f6769fb0b80 1 -- 172.21.15.151:0/4129117077 shutdown_connections 2023-07-21T22:36:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f6769fb0b80 1 -- 172.21.15.151:0/4129117077 wait complete. 2023-07-21T22:36:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f6769fb0b80 20 client.17718 trim_cache size 0 max 16384 2023-07-21T22:36:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:36:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:36:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:36:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:36:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 -- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f673c0a1340 msgr2=0x7f673c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f673c0a1340 0x7f673c0a37f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f6740011550 tx=0x7f6740009260 comp rx=0 tx=0).stop 2023-07-21T22:36:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 -- 172.21.15.151:0/2576140649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67500685b0 msgr2=0x7f675019c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67500685b0 0x7f675019c090 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f67380098e0 tx=0x7f673800f690 comp rx=0 tx=0).stop 2023-07-21T22:36:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 -- 172.21.15.151:0/2576140649 shutdown_connections 2023-07-21T22:36:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f673c0a1340 0x7f673c0a37f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6750104e50 0x7f67501959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6750067c10 0x7f675019bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 --2- 172.21.15.151:0/2576140649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67500685b0 0x7f675019c090 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.765+0000 7f67565ff700 1 -- 172.21.15.151:0/2576140649 >> 172.21.15.151:0/2576140649 conn(0x7f6750074760 msgr2=0x7f6750103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.766+0000 7f67565ff700 1 -- 172.21.15.151:0/2576140649 shutdown_connections 2023-07-21T22:36:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:39.766+0000 7f67565ff700 1 -- 172.21.15.151:0/2576140649 wait complete. 2023-07-21T22:36:40.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:40 smithi187 ceph-mon[96918]: pgmap v549: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 354 op/s 2023-07-21T22:36:40.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:40 smithi195 ceph-mon[97365]: pgmap v549: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 354 op/s 2023-07-21T22:36:40.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:40 smithi151 ceph-mon[95510]: pgmap v549: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 354 op/s 2023-07-21T22:36:42.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:42 smithi187 ceph-mon[96918]: pgmap v550: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 354 op/s 2023-07-21T22:36:42.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:42 smithi195 ceph-mon[97365]: pgmap v550: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 354 op/s 2023-07-21T22:36:42.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:42 smithi151 ceph-mon[95510]: pgmap v550: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 354 op/s 2023-07-21T22:36:44.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:44 smithi187 ceph-mon[96918]: pgmap v551: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.1 MiB/s wr, 540 op/s 2023-07-21T22:36:44.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:44 smithi195 ceph-mon[97365]: pgmap v551: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.1 MiB/s wr, 540 op/s 2023-07-21T22:36:44.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:44 smithi151 ceph-mon[95510]: pgmap v551: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.1 MiB/s wr, 540 op/s 2023-07-21T22:36:45.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:45 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:36:45.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:45 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:36:45.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:45 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:36:46.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:46 smithi187 ceph-mon[96918]: pgmap v552: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:36:46.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:46 smithi195 ceph-mon[97365]: pgmap v552: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:36:46.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:46 smithi151 ceph-mon[95510]: pgmap v552: 97 pgs: 97 active+clean; 9.4 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:36:47.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:47 smithi187 ceph-mon[96918]: pgmap v553: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.4 MiB/s wr, 549 op/s 2023-07-21T22:36:47.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:47 smithi195 ceph-mon[97365]: pgmap v553: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.4 MiB/s wr, 549 op/s 2023-07-21T22:36:47.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:47 smithi151 ceph-mon[95510]: pgmap v553: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.4 MiB/s wr, 549 op/s 2023-07-21T22:36:48.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:36:48.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:36:48.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:36:48.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:36:48.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:36:48.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:36:48.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:36:48.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:36:48.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:36:49.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:49 smithi195 ceph-mon[97365]: pgmap v554: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.0 MiB/s wr, 371 op/s 2023-07-21T22:36:49.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:49 smithi151 ceph-mon[95510]: pgmap v554: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.0 MiB/s wr, 371 op/s 2023-07-21T22:36:50.129 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:49 smithi187 ceph-mon[96918]: pgmap v554: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.0 MiB/s wr, 371 op/s 2023-07-21T22:36:52.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:52 smithi187 ceph-mon[96918]: pgmap v555: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.0 MiB/s wr, 371 op/s 2023-07-21T22:36:52.908 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:52 smithi195 ceph-mon[97365]: pgmap v555: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.0 MiB/s wr, 371 op/s 2023-07-21T22:36:52.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:52 smithi151 ceph-mon[95510]: pgmap v555: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.0 MiB/s wr, 371 op/s 2023-07-21T22:36:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.992+0000 7fd7a4fff700 1 -- 172.21.15.151:0/4145213131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7a0105b60 msgr2=0x7fd7a0105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.992+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/4145213131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7a0105b60 0x7fd7a0105f30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd790009990 tx=0x7fd790009ca0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.992+0000 7fd7a4fff700 1 -- 172.21.15.151:0/4145213131 shutdown_connections 2023-07-21T22:36:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.992+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/4145213131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7a0105b60 0x7fd7a0105f30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.992+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/4145213131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a01004e0 0x7fd7a010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.992+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/4145213131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a00ffb30 0x7fd7a00fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.992+0000 7fd7a4fff700 1 -- 172.21.15.151:0/4145213131 >> 172.21.15.151:0/4145213131 conn(0x7fd7a00fb5f0 msgr2=0x7fd7a00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.992+0000 7fd7a4fff700 1 -- 172.21.15.151:0/4145213131 shutdown_connections 2023-07-21T22:36:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.992+0000 7fd7a4fff700 1 -- 172.21.15.151:0/4145213131 wait complete. 2023-07-21T22:36:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.993+0000 7fd7a4fff700 1 Processor -- start 2023-07-21T22:36:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.994+0000 7fd7a4fff700 1 -- start start 2023-07-21T22:36:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.994+0000 7fd7a4fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00ffb30 0x7fd7a019bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.994+0000 7fd7a4fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a01004e0 0x7fd7a019c060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.994+0000 7fd7a4fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7a0105b60 0x7fd7a0195980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.994+0000 7fd7a4fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a0195ff0 con 0x7fd7a00ffb30 2023-07-21T22:36:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.994+0000 7fd7a4fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a0196160 con 0x7fd7a0105b60 2023-07-21T22:36:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.994+0000 7fd7a4fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7a0196320 con 0x7fd7a01004e0 2023-07-21T22:36:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00ffb30 0x7fd7a019bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a01004e0 0x7fd7a019c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00ffb30 0x7fd7a019bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46720/0 (socket says 172.21.15.151:46720) 2023-07-21T22:36:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79e59c700 1 -- 172.21.15.151:0/3927268684 learned_addr learned my addr 172.21.15.151:0/3927268684 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79ed9d700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7a0105b60 0x7fd7a0195980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79dd9b700 1 -- 172.21.15.151:0/3927268684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7a0105b60 msgr2=0x7fd7a0195980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7a0105b60 0x7fd7a0195980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79dd9b700 1 -- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00ffb30 msgr2=0x7fd7a019bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00ffb30 0x7fd7a019bb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79dd9b700 1 -- 172.21.15.151:0/3927268684 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd798009c40 con 0x7fd7a01004e0 2023-07-21T22:36:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79ed9d700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7a0105b60 0x7fd7a0195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79e59c700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00ffb30 0x7fd7a019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:53.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.995+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a01004e0 0x7fd7a019c060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd79400e9f0 tx=0x7fd79400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.996+0000 7fd78f7fe700 1 -- 172.21.15.151:0/3927268684 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79400c9c0 con 0x7fd7a01004e0 2023-07-21T22:36:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.996+0000 7fd78f7fe700 1 -- 172.21.15.151:0/3927268684 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd794010430 con 0x7fd7a01004e0 2023-07-21T22:36:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.996+0000 7fd78f7fe700 1 -- 172.21.15.151:0/3927268684 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd794018680 con 0x7fd7a01004e0 2023-07-21T22:36:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.996+0000 7fd7a4fff700 1 -- 172.21.15.151:0/3927268684 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7900095f0 con 0x7fd7a01004e0 2023-07-21T22:36:53.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.996+0000 7fd7a4fff700 1 -- 172.21.15.151:0/3927268684 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a01a2930 con 0x7fd7a01004e0 2023-07-21T22:36:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:52.999+0000 7fd78f7fe700 1 -- 172.21.15.151:0/3927268684 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fd7940105a0 con 0x7fd7a01004e0 2023-07-21T22:36:53.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.000+0000 7fd7b8900b80 1 Processor -- start 2023-07-21T22:36:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.001+0000 7fd7b8900b80 1 -- start start 2023-07-21T22:36:53.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.001+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef327c7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.001+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.001+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8660 0x55ef327c24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.001+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef326c7c50 con 0x55ef327c8210 2023-07-21T22:36:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.001+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef3271a9e0 con 0x55ef327c8660 2023-07-21T22:36:53.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.001+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef32713e70 con 0x55ef3261e6b0 2023-07-21T22:36:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd78f7fe700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd7880a1340 0x7fd7880a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef327c7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef327c7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:41186/0 (socket says 172.21.15.151:41186) 2023-07-21T22:36:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79ed9d700 1 -- 172.21.15.151:0/2846237254 learned_addr learned my addr 172.21.15.151:0/2846237254 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/2846237254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8660 0x55ef327c24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd78f7fe700 1 -- 172.21.15.151:0/3927268684 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd794014070 con 0x7fd7a01004e0 2023-07-21T22:36:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79dd9b700 1 -- 172.21.15.151:0/2846237254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 msgr2=0x55ef327c7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:53.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/2846237254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef327c7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79ed9d700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd7880a1340 0x7fd7880a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79dd9b700 1 -- 172.21.15.151:0/2846237254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 msgr2=0x55ef327c1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/2846237254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327c1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79dd9b700 1 -- 172.21.15.151:0/2846237254 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef32541d80 con 0x55ef327c8660 2023-07-21T22:36:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79e59c700 1 --2- 172.21.15.151:0/2846237254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:36:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.002+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/2846237254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8660 0x55ef327c24a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd7940ca720 tx=0x7fd79406c110 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa924b112ab62211 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.003+0000 7fd78cff9700 1 -- 172.21.15.151:0/2846237254 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79409a0a0 con 0x55ef327c8660 2023-07-21T22:36:53.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.003+0000 7fd78cff9700 1 -- 172.21.15.151:0/2846237254 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd79409e0d0 con 0x55ef327c8660 2023-07-21T22:36:53.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.003+0000 7fd78cff9700 1 -- 172.21.15.151:0/2846237254 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79409a500 con 0x55ef327c8660 2023-07-21T22:36:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.003+0000 7fd7b8900b80 1 -- 172.21.15.151:0/2846237254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8660 msgr2=0x55ef327c24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.003+0000 7fd79ed9d700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd7880a1340 0x7fd7880a37f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd798009550 tx=0x7fd798004b40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.003+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/2846237254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8660 0x55ef327c24a0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd7940ca720 tx=0x7fd79406c110 comp rx=0 tx=0).stop 2023-07-21T22:36:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.003+0000 7fd7b8900b80 1 -- 172.21.15.151:0/2846237254 shutdown_connections 2023-07-21T22:36:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.004+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/2846237254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8660 0x55ef327c24a0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.004+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/2846237254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef327c7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.004+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/2846237254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327c1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.004+0000 7fd7b8900b80 1 -- 172.21.15.151:0/2846237254 >> 172.21.15.151:0/2846237254 conn(0x55ef327b7ae0 msgr2=0x55ef327bd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.004+0000 7fd7b8900b80 1 -- 172.21.15.151:0/2846237254 shutdown_connections 2023-07-21T22:36:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.004+0000 7fd7b8900b80 1 -- 172.21.15.151:0/2846237254 wait complete. 2023-07-21T22:36:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.004+0000 7fd7b8900b80 1 -- start start 2023-07-21T22:36:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.004+0000 7fd7b8900b80 1 Processor -- start 2023-07-21T22:36:53.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8660 0x55ef327cb840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef326b3a60 con 0x55ef327c8210 2023-07-21T22:36:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef326b3760 con 0x55ef3261e6b0 2023-07-21T22:36:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef325978c0 con 0x55ef327c8660 2023-07-21T22:36:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd7b8900b80 10 client.0 _ll_register_callbacks cb 0x55ef326b1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:36:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd79dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd79e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd79dd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46738/0 (socket says 172.21.15.151:46738) 2023-07-21T22:36:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd79dd9b700 1 -- 172.21.15.151:0/1757811342 learned_addr learned my addr 172.21.15.151:0/1757811342 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.005+0000 7fd79ed9d700 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8660 0x55ef327cb840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd79dd9b700 1 -- 172.21.15.151:0/1757811342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8660 msgr2=0x55ef327cb840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8660 0x55ef327cb840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd79dd9b700 1 -- 172.21.15.151:0/1757811342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 msgr2=0x55ef327d1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:53.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327d1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd79dd9b700 1 -- 172.21.15.151:0/1757811342 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7a010d220 con 0x55ef327c8210 2023-07-21T22:36:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327d1a80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd79400c5b0 tx=0x7fd794099b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d5ebd515844c405 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd785ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:36:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd785ffb700 1 -- 172.21.15.151:0/1757811342 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79409a0a0 con 0x55ef327c8210 2023-07-21T22:36:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd785ffb700 1 -- 172.21.15.151:0/1757811342 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd7940a24f0 con 0x55ef327c8210 2023-07-21T22:36:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1757811342 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef3266d490 con 0x55ef327c8210 2023-07-21T22:36:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd785ffb700 1 -- 172.21.15.151:0/1757811342 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd7940a2270 con 0x55ef327c8210 2023-07-21T22:36:53.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd7b8900b80 10 client.17730 fetch_fsmap learned FSMap version 64 2023-07-21T22:36:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.006+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1757811342 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x7fd7a01a2930 con 0x55ef327c8210 2023-07-21T22:36:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.007+0000 7fd785ffb700 1 -- 172.21.15.151:0/1757811342 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd7940b6080 con 0x55ef327c8210 2023-07-21T22:36:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.007+0000 7fd785ffb700 1 -- 172.21.15.151:0/1757811342 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd794099190 con 0x55ef327c8210 2023-07-21T22:36:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.007+0000 7fd7b8900b80 10 client.17730 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:36:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.007+0000 7fd7b8900b80 10 client.17730 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:36:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.007+0000 7fd7b8900b80 20 client.17730 populate_metadata read hostname 'smithi151' 2023-07-21T22:36:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.007+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef327db770 0x55ef327ddb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.007+0000 7fd7b8900b80 4 client.17730 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:36:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.007+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1757811342 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef3270ce50 con 0x55ef327db770 2023-07-21T22:36:53.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.007+0000 7fd79e59c700 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef327db770 0x55ef327ddb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.008+0000 7fd79e59c700 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef327db770 0x55ef327ddb80 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e780efe3e62ff29 server_cookie=ff2d71c5045ecb7a in_seq=0 out_seq=0 2023-07-21T22:36:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.008+0000 7fd785ffb700 10 client.17730 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd785ffb700 1 -- 172.21.15.151:0/1757811342 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ef3270ce50 con 0x55ef327db770 2023-07-21T22:36:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd785ffb700 10 client.17730 handle_command_reply: tid=0 2023-07-21T22:36:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 client.17730 shutdown 2023-07-21T22:36:53.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1757811342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 msgr2=0x55ef327d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327d1a80 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7fd79400c5b0 tx=0x7fd794099b30 comp rx=0 tx=0).stop 2023-07-21T22:36:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1757811342 shutdown_connections 2023-07-21T22:36:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef327db770 0x55ef327ddb80 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327d1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8660 0x55ef327cb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1757811342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8210 0x55ef327d1a80 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1757811342 >> 172.21.15.151:0/1757811342 conn(0x55ef327b7ae0 msgr2=0x55ef327bc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:53.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd785ffb700 0 client.17730 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1757811342 shutdown_connections 2023-07-21T22:36:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.009+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1757811342 wait complete. 2023-07-21T22:36:53.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.010+0000 7fd7b8900b80 20 client.17730 trim_cache size 0 max 16384 2023-07-21T22:36:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.027+0000 7fd7b8900b80 1 Processor -- start 2023-07-21T22:36:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.027+0000 7fd7b8900b80 1 -- start start 2023-07-21T22:36:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327c7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8210 0x55ef327cb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 0x55ef327ca720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef327cbca0 con 0x55ef327c8660 2023-07-21T22:36:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef327be510 con 0x55ef3261e6b0 2023-07-21T22:36:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef327b4b20 con 0x55ef327c8210 2023-07-21T22:36:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 0x55ef327ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 0x55ef327ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46740/0 (socket says 172.21.15.151:46740) 2023-07-21T22:36:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79ed9d700 1 -- 172.21.15.151:0/4120555342 learned_addr learned my addr 172.21.15.151:0/4120555342 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79e59c700 1 --2- 172.21.15.151:0/4120555342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50472/0 (socket says 172.21.15.151:50472) 2023-07-21T22:36:53.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/4120555342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8210 0x55ef327cb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79e59c700 1 -- 172.21.15.151:0/4120555342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8210 msgr2=0x55ef327cb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79e59c700 1 --2- 172.21.15.151:0/4120555342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8210 0x55ef327cb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79e59c700 1 -- 172.21.15.151:0/4120555342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 msgr2=0x55ef327ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:53.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79e59c700 1 --2- 172.21.15.151:0/4120555342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 0x55ef327ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.028+0000 7fd79e59c700 1 -- 172.21.15.151:0/4120555342 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef327e2770 con 0x55ef3261e6b0 2023-07-21T22:36:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.029+0000 7fd79e59c700 1 --2- 172.21.15.151:0/4120555342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327c7220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55ef327de3f0 tx=0x7fd79000b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f522d53daf3da88 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.029+0000 7fd78d7fa700 1 -- 172.21.15.151:0/4120555342 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79001d040 con 0x55ef3261e6b0 2023-07-21T22:36:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.029+0000 7fd78d7fa700 1 -- 172.21.15.151:0/4120555342 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd79001e040 con 0x55ef3261e6b0 2023-07-21T22:36:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.029+0000 7fd78d7fa700 1 -- 172.21.15.151:0/4120555342 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7900054e0 con 0x55ef3261e6b0 2023-07-21T22:36:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.030+0000 7fd7b8900b80 1 -- 172.21.15.151:0/4120555342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 msgr2=0x55ef327c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:53.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.030+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/4120555342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327c7220 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x55ef327de3f0 tx=0x7fd79000b260 comp rx=0 tx=0).stop 2023-07-21T22:36:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.030+0000 7fd7b8900b80 1 -- 172.21.15.151:0/4120555342 shutdown_connections 2023-07-21T22:36:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.030+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/4120555342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef3261e6b0 0x55ef327c7220 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.030+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/4120555342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 0x55ef327ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.030+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/4120555342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef327c8210 0x55ef327cb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.030+0000 7fd7b8900b80 1 -- 172.21.15.151:0/4120555342 >> 172.21.15.151:0/4120555342 conn(0x55ef327b7ae0 msgr2=0x55ef327ca010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.030+0000 7fd7b8900b80 1 -- 172.21.15.151:0/4120555342 shutdown_connections 2023-07-21T22:36:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.030+0000 7fd7b8900b80 1 -- 172.21.15.151:0/4120555342 wait complete. 2023-07-21T22:36:53.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.031+0000 7fd7b8900b80 1 -- start start 2023-07-21T22:36:53.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.031+0000 7fd7b8900b80 1 Processor -- start 2023-07-21T22:36:53.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.031+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef3282cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.031+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8210 0x55ef3282d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.031+0000 7fd7b8900b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 0x55ef3282b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.031+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef3282bf40 con 0x55ef327c8660 2023-07-21T22:36:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.031+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef3282c0b0 con 0x55ef327c8210 2023-07-21T22:36:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.031+0000 7fd7b8900b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef3282c270 con 0x55ef3261e6b0 2023-07-21T22:36:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.031+0000 7fd7b8900b80 10 client.0 _ll_register_callbacks cb 0x7fd7980097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:36:53.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef3282cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef3282cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:41204/0 (socket says 172.21.15.151:41204) 2023-07-21T22:36:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79e59c700 1 -- 172.21.15.151:0/1556260313 learned_addr learned my addr 172.21.15.151:0/1556260313 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:36:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8210 0x55ef3282d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79ed9d700 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 0x55ef3282b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79e59c700 1 -- 172.21.15.151:0/1556260313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8210 msgr2=0x55ef3282d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79e59c700 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8210 0x55ef3282d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79e59c700 1 -- 172.21.15.151:0/1556260313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 msgr2=0x55ef3282b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:36:53.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79e59c700 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 0x55ef3282b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79e59c700 1 -- 172.21.15.151:0/1556260313 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd79000be80 con 0x55ef3261e6b0 2023-07-21T22:36:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd79e59c700 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef3282cc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd790009ce0 tx=0x7fd790029ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd267bbc5e740933 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:36:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.032+0000 7fd785ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:36:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.033+0000 7fd785ffb700 1 -- 172.21.15.151:0/1556260313 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd79001d040 con 0x55ef3261e6b0 2023-07-21T22:36:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.033+0000 7fd785ffb700 1 -- 172.21.15.151:0/1556260313 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd790029e40 con 0x55ef3261e6b0 2023-07-21T22:36:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.033+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1556260313 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd79409e0d0 con 0x55ef3261e6b0 2023-07-21T22:36:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.033+0000 7fd785ffb700 1 -- 172.21.15.151:0/1556260313 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd790029560 con 0x55ef3261e6b0 2023-07-21T22:36:53.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.033+0000 7fd7b8900b80 10 client.27445 fetch_fsmap learned FSMap version 64 2023-07-21T22:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.033+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1556260313 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x55ef3252ac00 con 0x55ef3261e6b0 2023-07-21T22:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.033+0000 7fd785ffb700 1 -- 172.21.15.151:0/1556260313 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd790043080 con 0x55ef3261e6b0 2023-07-21T22:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.033+0000 7fd785ffb700 1 -- 172.21.15.151:0/1556260313 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fd7900049f0 con 0x55ef3261e6b0 2023-07-21T22:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.034+0000 7fd7b8900b80 10 client.27445 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.034+0000 7fd7b8900b80 10 client.27445 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.034+0000 7fd7b8900b80 20 client.27445 populate_metadata read hostname 'smithi151' 2023-07-21T22:36:53.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.034+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef32834740 0x55ef32836b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:36:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.034+0000 7fd7b8900b80 4 client.27445 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:36:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.034+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1556260313 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ef326ceff0 con 0x55ef32834740 2023-07-21T22:36:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.034+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef32834740 0x55ef32836b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:36:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.034+0000 7fd79dd9b700 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef32834740 0x55ef32836b20 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f02ea8e54e116ee server_cookie=8d3a27c2152a207c in_seq=0 out_seq=0 2023-07-21T22:36:53.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.034+0000 7fd785ffb700 10 client.27445 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd785ffb700 1 -- 172.21.15.151:0/1556260313 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ef326ceff0 con 0x55ef32834740 2023-07-21T22:36:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd785ffb700 10 client.27445 handle_command_reply: tid=0 2023-07-21T22:36:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd7b8900b80 1 client.27445 shutdown 2023-07-21T22:36:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1556260313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 msgr2=0x55ef3282cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:53.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef3282cc40 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd790009ce0 tx=0x7fd790029ca0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1556260313 shutdown_connections 2023-07-21T22:36:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef32834740 0x55ef32836b20 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef327c8660 0x55ef3282b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef3261e6b0 0x55ef3282cc40 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd7b8900b80 1 --2- 172.21.15.151:0/1556260313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef327c8210 0x55ef3282d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd785ffb700 0 client.27445 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:36:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.046+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1556260313 >> 172.21.15.151:0/1556260313 conn(0x55ef327b7ae0 msgr2=0x55ef327ca8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:53.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.047+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1556260313 shutdown_connections 2023-07-21T22:36:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.047+0000 7fd7b8900b80 1 -- 172.21.15.151:0/1556260313 wait complete. 2023-07-21T22:36:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.047+0000 7fd7b8900b80 20 client.27445 trim_cache size 0 max 16384 2023-07-21T22:36:53.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:36:53.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:36:53.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:36:53.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:36:53.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.047+0000 7fd7a4fff700 1 -- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd7880a1340 msgr2=0x7fd7880a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.047+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd7880a1340 0x7fd7880a37f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd798009550 tx=0x7fd798004b40 comp rx=0 tx=0).stop 2023-07-21T22:36:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.047+0000 7fd7a4fff700 1 -- 172.21.15.151:0/3927268684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a01004e0 msgr2=0x7fd7a019c060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:36:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.047+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a01004e0 0x7fd7a019c060 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fd79400e9f0 tx=0x7fd79400ed00 comp rx=0 tx=0).stop 2023-07-21T22:36:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.048+0000 7fd7a4fff700 1 -- 172.21.15.151:0/3927268684 shutdown_connections 2023-07-21T22:36:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.048+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd7880a1340 0x7fd7880a37f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.048+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7a0105b60 0x7fd7a0195980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.048+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd7a00ffb30 0x7fd7a019bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.048+0000 7fd7a4fff700 1 --2- 172.21.15.151:0/3927268684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd7a01004e0 0x7fd7a019c060 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:36:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.048+0000 7fd7a4fff700 1 -- 172.21.15.151:0/3927268684 >> 172.21.15.151:0/3927268684 conn(0x7fd7a00fb5f0 msgr2=0x7fd7a00fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:36:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.048+0000 7fd7a4fff700 1 -- 172.21.15.151:0/3927268684 shutdown_connections 2023-07-21T22:36:53.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:36:53.048+0000 7fd7a4fff700 1 -- 172.21.15.151:0/3927268684 wait complete. 2023-07-21T22:36:54.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:54 smithi187 ceph-mon[96918]: pgmap v556: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 559 op/s 2023-07-21T22:36:54.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:54 smithi195 ceph-mon[97365]: pgmap v556: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 559 op/s 2023-07-21T22:36:54.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:54 smithi151 ceph-mon[95510]: pgmap v556: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 559 op/s 2023-07-21T22:36:56.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:56 smithi187 ceph-mon[96918]: pgmap v557: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.1 MiB/s wr, 373 op/s 2023-07-21T22:36:56.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:56 smithi195 ceph-mon[97365]: pgmap v557: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.1 MiB/s wr, 373 op/s 2023-07-21T22:36:56.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:56 smithi151 ceph-mon[95510]: pgmap v557: 97 pgs: 97 active+clean; 9.4 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.1 MiB/s wr, 373 op/s 2023-07-21T22:36:58.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:36:58 smithi187 ceph-mon[96918]: pgmap v558: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.5 MiB/s wr, 555 op/s 2023-07-21T22:36:58.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:36:58 smithi195 ceph-mon[97365]: pgmap v558: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.5 MiB/s wr, 555 op/s 2023-07-21T22:36:58.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:36:58 smithi151 ceph-mon[95510]: pgmap v558: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.5 MiB/s wr, 555 op/s 2023-07-21T22:37:00.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:00 smithi187 ceph-mon[96918]: pgmap v559: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:37:00.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:00 smithi195 ceph-mon[97365]: pgmap v559: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:37:00.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:00 smithi151 ceph-mon[95510]: pgmap v559: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:37:02.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:02 smithi187 ceph-mon[96918]: pgmap v560: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:37:02.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:02 smithi195 ceph-mon[97365]: pgmap v560: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:37:02.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:02 smithi151 ceph-mon[95510]: pgmap v560: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:37:04.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:04 smithi187 ceph-mon[96918]: pgmap v561: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.5 MiB/s wr, 563 op/s 2023-07-21T22:37:04.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:04 smithi195 ceph-mon[97365]: pgmap v561: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.5 MiB/s wr, 563 op/s 2023-07-21T22:37:04.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:04 smithi151 ceph-mon[95510]: pgmap v561: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.5 MiB/s wr, 563 op/s 2023-07-21T22:37:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.210+0000 7f6376dff700 1 -- 172.21.15.151:0/47554450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63700728b0 msgr2=0x7f6370072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.210+0000 7f6376dff700 1 --2- 172.21.15.151:0/47554450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63700728b0 0x7f6370072c80 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6364009990 tx=0x7f6364009ca0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.210+0000 7f6376dff700 1 -- 172.21.15.151:0/47554450 shutdown_connections 2023-07-21T22:37:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.210+0000 7f6376dff700 1 --2- 172.21.15.151:0/47554450 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63700728b0 0x7f6370072c80 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.210+0000 7f6376dff700 1 --2- 172.21.15.151:0/47554450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f637010c340 0x7f637010e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.210+0000 7f6376dff700 1 --2- 172.21.15.151:0/47554450 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63700731c0 0x7f637010be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.210+0000 7f6376dff700 1 -- 172.21.15.151:0/47554450 >> 172.21.15.151:0/47554450 conn(0x7f63700fb600 msgr2=0x7f63700fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.210+0000 7f6376dff700 1 -- 172.21.15.151:0/47554450 shutdown_connections 2023-07-21T22:37:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.210+0000 7f6376dff700 1 -- 172.21.15.151:0/47554450 wait complete. 2023-07-21T22:37:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.211+0000 7f6376dff700 1 Processor -- start 2023-07-21T22:37:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f6376dff700 1 -- start start 2023-07-21T22:37:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f6376dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63700728b0 0x7f6370197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f6376dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63700731c0 0x7f63701982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f6376dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f637010c340 0x7f637019c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f6376dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637019cf50 con 0x7f637010c340 2023-07-21T22:37:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f6376dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637019d0c0 con 0x7f63700728b0 2023-07-21T22:37:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f6376dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f637019d280 con 0x7f63700731c0 2023-07-21T22:37:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f637539c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f637010c340 0x7f637019c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f636ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63700731c0 0x7f63701982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f637539c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f637010c340 0x7f637019c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45394/0 (socket says 172.21.15.151:45394) 2023-07-21T22:37:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.212+0000 7f637539c700 1 -- 172.21.15.151:0/2009149390 learned_addr learned my addr 172.21.15.151:0/2009149390 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f6374b9b700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63700728b0 0x7f6370197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f637539c700 1 -- 172.21.15.151:0/2009149390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63700731c0 msgr2=0x7f63701982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f637539c700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63700731c0 0x7f63701982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f637539c700 1 -- 172.21.15.151:0/2009149390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63700728b0 msgr2=0x7f6370197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f637539c700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63700728b0 0x7f6370197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f637539c700 1 -- 172.21.15.151:0/2009149390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63640095f0 con 0x7f637010c340 2023-07-21T22:37:06.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f6374b9b700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63700728b0 0x7f6370197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f637539c700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f637010c340 0x7f637019c910 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f636800ef30 tx=0x7f636800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f636dffb700 1 -- 172.21.15.151:0/2009149390 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6368018070 con 0x7f637010c340 2023-07-21T22:37:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f6376dff700 1 -- 172.21.15.151:0/2009149390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f637019d500 con 0x7f637010c340 2023-07-21T22:37:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f636dffb700 1 -- 172.21.15.151:0/2009149390 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f636800f040 con 0x7f637010c340 2023-07-21T22:37:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.213+0000 7f636dffb700 1 -- 172.21.15.151:0/2009149390 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636800cc70 con 0x7f637010c340 2023-07-21T22:37:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.214+0000 7f6376dff700 1 -- 172.21.15.151:0/2009149390 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63701a4da0 con 0x7f637010c340 2023-07-21T22:37:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.218+0000 7f636dffb700 1 -- 172.21.15.151:0/2009149390 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6368007500 con 0x7f637010c340 2023-07-21T22:37:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.220+0000 7f638a72ab80 1 Processor -- start 2023-07-21T22:37:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.220+0000 7f638a72ab80 1 -- start start 2023-07-21T22:37:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.220+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x55967397ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.220+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x559673976f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.220+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 0x5596739774a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.220+0000 7f638a72ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967387cc50 con 0x55967397d210 2023-07-21T22:37:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.220+0000 7f638a72ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596738cf9e0 con 0x55967397d660 2023-07-21T22:37:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.220+0000 7f638a72ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5596738c8e70 con 0x5596737d36b0 2023-07-21T22:37:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.220+0000 7f636dffb700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f63600a12c0 0x7f63600a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636dffb700 1 -- 172.21.15.151:0/2009149390 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f63680cc810 con 0x7f637010c340 2023-07-21T22:37:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x55967397ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f6374b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x559673976f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x55967397ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34782/0 (socket says 172.21.15.151:34782) 2023-07-21T22:37:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 -- 172.21.15.151:0/2665169535 learned_addr learned my addr 172.21.15.151:0/2665169535 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 --2- 172.21.15.151:0/2665169535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 0x5596739774a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f637539c700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f63600a12c0 0x7f63600a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 -- 172.21.15.151:0/2665169535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 msgr2=0x5596739774a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 --2- 172.21.15.151:0/2665169535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 0x5596739774a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 -- 172.21.15.151:0/2665169535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 msgr2=0x559673976f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 --2- 172.21.15.151:0/2665169535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x559673976f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 -- 172.21.15.151:0/2665169535 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5596736f6d80 con 0x5596737d36b0 2023-07-21T22:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.221+0000 7f636ffff700 1 --2- 172.21.15.151:0/2665169535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x55967397ccd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f635c011880 tx=0x7f635c0058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c7df73931ee4f30 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f637539c700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f63600a12c0 0x7f63600a3770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f63680a1820 tx=0x7f6368004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f635affd700 1 -- 172.21.15.151:0/2665169535 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c011ea0 con 0x5596737d36b0 2023-07-21T22:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f635affd700 1 -- 172.21.15.151:0/2665169535 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f635c0044c0 con 0x5596737d36b0 2023-07-21T22:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f635affd700 1 -- 172.21.15.151:0/2665169535 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c005220 con 0x5596737d36b0 2023-07-21T22:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f638a72ab80 1 -- 172.21.15.151:0/2665169535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 msgr2=0x55967397ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2665169535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x55967397ccd0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f635c011880 tx=0x7f635c0058e0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f638a72ab80 1 -- 172.21.15.151:0/2665169535 shutdown_connections 2023-07-21T22:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2665169535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 0x5596739774a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2665169535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x55967397ccd0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2665169535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x559673976f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.222+0000 7f638a72ab80 1 -- 172.21.15.151:0/2665169535 >> 172.21.15.151:0/2665169535 conn(0x55967396cae0 msgr2=0x5596739720e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.223+0000 7f638a72ab80 1 -- 172.21.15.151:0/2665169535 shutdown_connections 2023-07-21T22:37:06.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.223+0000 7f638a72ab80 1 -- 172.21.15.151:0/2665169535 wait complete. 2023-07-21T22:37:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.223+0000 7f638a72ab80 1 -- start start 2023-07-21T22:37:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.223+0000 7f638a72ab80 1 Processor -- start 2023-07-21T22:37:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x5596739835a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x559673980820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 0x559673980ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f638a72ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559673868a60 con 0x55967397d210 2023-07-21T22:37:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f638a72ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559673868760 con 0x55967397d660 2023-07-21T22:37:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f638a72ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967374c8c0 con 0x5596737d36b0 2023-07-21T22:37:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f638a72ab80 10 client.0 _ll_register_callbacks cb 0x559673866700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f6374b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x559673980820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f636ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x5596739835a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f636ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x5596739835a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34788/0 (socket says 172.21.15.151:34788) 2023-07-21T22:37:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f636ffff700 1 -- 172.21.15.151:0/1330553756 learned_addr learned my addr 172.21.15.151:0/1330553756 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.224+0000 7f636ffff700 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 0x559673980ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f6374b9b700 1 -- 172.21.15.151:0/1330553756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 msgr2=0x5596739835a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f6374b9b700 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x5596739835a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f6374b9b700 1 -- 172.21.15.151:0/1330553756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 msgr2=0x559673980ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f6374b9b700 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 0x559673980ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f6374b9b700 1 -- 172.21.15.151:0/1330553756 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635c019040 con 0x55967397d210 2023-07-21T22:37:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f6374b9b700 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x559673980820 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6364005910 tx=0x7f63640056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663a01afbba2fc55 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f634ffff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:37:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f634ffff700 1 -- 172.21.15.151:0/1330553756 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364028070 con 0x55967397d210 2023-07-21T22:37:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f638a72ab80 1 -- 172.21.15.151:0/1330553756 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559673822490 con 0x55967397d210 2023-07-21T22:37:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.225+0000 7f634ffff700 1 -- 172.21.15.151:0/1330553756 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f636400bd80 con 0x55967397d210 2023-07-21T22:37:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.226+0000 7f634ffff700 1 -- 172.21.15.151:0/1330553756 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6364004500 con 0x55967397d210 2023-07-21T22:37:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.226+0000 7f638a72ab80 10 client.17748 fetch_fsmap learned FSMap version 64 2023-07-21T22:37:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.226+0000 7f638a72ab80 1 -- 172.21.15.151:0/1330553756 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5596736dfc00 con 0x55967397d210 2023-07-21T22:37:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.226+0000 7f634ffff700 1 -- 172.21.15.151:0/1330553756 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559673822490 con 0x55967397d210 2023-07-21T22:37:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.226+0000 7f634ffff700 1 -- 172.21.15.151:0/1330553756 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f636402b020 con 0x55967397d210 2023-07-21T22:37:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.226+0000 7f638a72ab80 10 client.17748 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:37:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.226+0000 7f638a72ab80 10 client.17748 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.226+0000 7f638a72ab80 20 client.17748 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.226+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559673990b90 0x559673992fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.227+0000 7f638a72ab80 4 client.17748 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:37:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.227+0000 7f638a72ab80 1 -- 172.21.15.151:0/1330553756 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5596738c1e50 con 0x559673990b90 2023-07-21T22:37:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.227+0000 7f636ffff700 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559673990b90 0x559673992fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.227+0000 7f636ffff700 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559673990b90 0x559673992fa0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c90daff01f07bb9 server_cookie=31e92e173ffe0fca in_seq=0 out_seq=0 2023-07-21T22:37:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.227+0000 7f634ffff700 10 client.17748 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.228+0000 7f634ffff700 1 -- 172.21.15.151:0/1330553756 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5596738c1e50 con 0x559673990b90 2023-07-21T22:37:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.228+0000 7f634ffff700 10 client.17748 handle_command_reply: tid=0 2023-07-21T22:37:06.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.228+0000 7f638a72ab80 1 client.17748 shutdown 2023-07-21T22:37:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.228+0000 7f638a72ab80 1 -- 172.21.15.151:0/1330553756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 msgr2=0x559673980820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.228+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x559673980820 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f6364005910 tx=0x7f63640056e0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.228+0000 7f638a72ab80 1 -- 172.21.15.151:0/1330553756 shutdown_connections 2023-07-21T22:37:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.229+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559673990b90 0x559673992fa0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.229+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55967397d660 0x559673980ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.229+0000 7f634ffff700 0 client.17748 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:06.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.229+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5596737d36b0 0x5596739835a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.229+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1330553756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x559673980820 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.229+0000 7f638a72ab80 1 -- 172.21.15.151:0/1330553756 >> 172.21.15.151:0/1330553756 conn(0x55967396cae0 msgr2=0x5596739713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.229+0000 7f638a72ab80 1 -- 172.21.15.151:0/1330553756 shutdown_connections 2023-07-21T22:37:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.229+0000 7f638a72ab80 1 -- 172.21.15.151:0/1330553756 wait complete. 2023-07-21T22:37:06.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.229+0000 7f638a72ab80 20 client.17748 trim_cache size 0 max 16384 2023-07-21T22:37:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.246+0000 7f638a72ab80 1 Processor -- start 2023-07-21T22:37:06.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.246+0000 7f638a72ab80 1 -- start start 2023-07-21T22:37:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967396cae0 0x559673980050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673987ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x55967397c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f638a72ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559673980c80 con 0x55967397d210 2023-07-21T22:37:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f638a72ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967397edf0 con 0x5596737d36b0 2023-07-21T22:37:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f638a72ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55967397c8d0 con 0x55967396cae0 2023-07-21T22:37:06.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f636ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967396cae0 0x559673980050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f6374b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673987ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f636ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967396cae0 0x559673980050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34796/0 (socket says 172.21.15.151:34796) 2023-07-21T22:37:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f636ffff700 1 -- 172.21.15.151:0/1598986923 learned_addr learned my addr 172.21.15.151:0/1598986923 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f6374b9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673987ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49270/0 (socket says 172.21.15.151:49270) 2023-07-21T22:37:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f636ffff700 1 --2- 172.21.15.151:0/1598986923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x55967397c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f6374b9b700 1 -- 172.21.15.151:0/1598986923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967396cae0 msgr2=0x559673980050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f6374b9b700 1 --2- 172.21.15.151:0/1598986923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967396cae0 0x559673980050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.247+0000 7f6374b9b700 1 -- 172.21.15.151:0/1598986923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 msgr2=0x55967397c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.248+0000 7f6374b9b700 1 --2- 172.21.15.151:0/1598986923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x55967397c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.248+0000 7f6374b9b700 1 -- 172.21.15.151:0/1598986923 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55967371d1f0 con 0x5596737d36b0 2023-07-21T22:37:06.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.248+0000 7f6374b9b700 1 --2- 172.21.15.151:0/1598986923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673987ba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6364005b40 tx=0x7f6364024700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b0e35dc97ad0ce2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.248+0000 7f635b7fe700 1 -- 172.21.15.151:0/1598986923 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364028040 con 0x5596737d36b0 2023-07-21T22:37:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.248+0000 7f635b7fe700 1 -- 172.21.15.151:0/1598986923 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f636401e040 con 0x5596737d36b0 2023-07-21T22:37:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.248+0000 7f635b7fe700 1 -- 172.21.15.151:0/1598986923 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6364023ee0 con 0x5596737d36b0 2023-07-21T22:37:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 -- 172.21.15.151:0/1598986923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 msgr2=0x559673987ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1598986923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673987ba0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6364005b40 tx=0x7f6364024700 comp rx=0 tx=0).stop 2023-07-21T22:37:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 -- 172.21.15.151:0/1598986923 shutdown_connections 2023-07-21T22:37:06.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1598986923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967397d210 0x55967397c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1598986923 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967396cae0 0x559673980050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 --2- 172.21.15.151:0/1598986923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673987ba0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 -- 172.21.15.151:0/1598986923 >> 172.21.15.151:0/1598986923 conn(0x55967398d140 msgr2=0x55967397b920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 -- 172.21.15.151:0/1598986923 shutdown_connections 2023-07-21T22:37:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 -- 172.21.15.151:0/1598986923 wait complete. 2023-07-21T22:37:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.249+0000 7f638a72ab80 1 -- start start 2023-07-21T22:37:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f638a72ab80 1 Processor -- start 2023-07-21T22:37:06.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673979bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967396cae0 0x55967397a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f638a72ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967397d210 0x559673978730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f638a72ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559673978d00 con 0x55967396cae0 2023-07-21T22:37:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f638a72ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559673978e70 con 0x5596737d36b0 2023-07-21T22:37:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f638a72ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559673979030 con 0x55967397d210 2023-07-21T22:37:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f638a72ab80 10 client.0 _ll_register_callbacks cb 0x7f6364009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f6374b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967396cae0 0x55967397a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.250+0000 7f636ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673979bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f636ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673979bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49272/0 (socket says 172.21.15.151:49272) 2023-07-21T22:37:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f636ffff700 1 -- 172.21.15.151:0/2504295842 learned_addr learned my addr 172.21.15.151:0/2504295842 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f636ffff700 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967397d210 0x559673978730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f636ffff700 1 -- 172.21.15.151:0/2504295842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967397d210 msgr2=0x559673978730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f636ffff700 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967397d210 0x559673978730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f636ffff700 1 -- 172.21.15.151:0/2504295842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967396cae0 msgr2=0x55967397a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:06.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f636ffff700 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967396cae0 0x55967397a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f636ffff700 1 -- 172.21.15.151:0/2504295842 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5596736dfc00 con 0x5596737d36b0 2023-07-21T22:37:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f636ffff700 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673979bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f635c009890 tx=0x7f635c022040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce07109bab8dc345 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.251+0000 7f634ffff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:37:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f634ffff700 1 -- 172.21.15.151:0/2504295842 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635c011ea0 con 0x5596737d36b0 2023-07-21T22:37:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f634ffff700 1 -- 172.21.15.151:0/2504295842 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(110..110 src has 1..110) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f635c025070 con 0x5596737d36b0 2023-07-21T22:37:06.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f638a72ab80 1 -- 172.21.15.151:0/2504295842 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55967398d510 con 0x5596737d36b0 2023-07-21T22:37:06.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f634ffff700 1 -- 172.21.15.151:0/2504295842 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f635c011030 con 0x5596737d36b0 2023-07-21T22:37:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f638a72ab80 10 client.27434 fetch_fsmap learned FSMap version 64 2023-07-21T22:37:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f638a72ab80 1 -- 172.21.15.151:0/2504295842 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5596736f5250 con 0x5596737d36b0 2023-07-21T22:37:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f634ffff700 1 -- 172.21.15.151:0/2504295842 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55967398d510 con 0x5596737d36b0 2023-07-21T22:37:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f634ffff700 1 -- 172.21.15.151:0/2504295842 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f635c01d070 con 0x5596737d36b0 2023-07-21T22:37:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f638a72ab80 10 client.27434 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:37:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f638a72ab80 10 client.27434 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:06.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f638a72ab80 20 client.27434 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55967397d660 0x5596739e7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f638a72ab80 4 client.27434 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:37:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.252+0000 7f638a72ab80 1 -- 172.21.15.151:0/2504295842 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f635c0044c0 con 0x55967397d660 2023-07-21T22:37:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.253+0000 7f6374b9b700 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55967397d660 0x5596739e7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.253+0000 7f634ffff700 10 client.27434 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:06.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.253+0000 7f6374b9b700 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55967397d660 0x5596739e7a00 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3049c4fb35201662 server_cookie=c2da8a16a7d8c65d in_seq=0 out_seq=0 2023-07-21T22:37:06.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.264+0000 7f634ffff700 1 -- 172.21.15.151:0/2504295842 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f635c0044c0 con 0x55967397d660 2023-07-21T22:37:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.264+0000 7f634ffff700 10 client.27434 handle_command_reply: tid=0 2023-07-21T22:37:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.264+0000 7f638a72ab80 1 client.27434 shutdown 2023-07-21T22:37:06.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 -- 172.21.15.151:0/2504295842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 msgr2=0x559673979bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673979bf0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f635c009890 tx=0x7f635c022040 comp rx=0 tx=0).stop 2023-07-21T22:37:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 -- 172.21.15.151:0/2504295842 shutdown_connections 2023-07-21T22:37:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55967397d660 0x5596739e7a00 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5596737d36b0 0x559673979bf0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55967397d210 0x559673978730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f634ffff700 0 client.27434 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 --2- 172.21.15.151:0/2504295842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55967396cae0 0x55967397a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 -- 172.21.15.151:0/2504295842 >> 172.21.15.151:0/2504295842 conn(0x55967398d140 msgr2=0x55967397c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 -- 172.21.15.151:0/2504295842 shutdown_connections 2023-07-21T22:37:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 1 -- 172.21.15.151:0/2504295842 wait complete. 2023-07-21T22:37:06.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.265+0000 7f638a72ab80 20 client.27434 trim_cache size 0 max 16384 2023-07-21T22:37:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:37:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:37:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:37:06.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:37:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 -- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f63600a12c0 msgr2=0x7f63600a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f63600a12c0 0x7f63600a3770 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f63680a1820 tx=0x7f6368004ad0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 -- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f637010c340 msgr2=0x7f637019c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f637010c340 0x7f637019c910 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f636800ef30 tx=0x7f636800c3a0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 -- 172.21.15.151:0/2009149390 shutdown_connections 2023-07-21T22:37:06.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f63600a12c0 0x7f63600a3770 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f63700728b0 0x7f6370197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f637010c340 0x7f637019c910 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 --2- 172.21.15.151:0/2009149390 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f63700731c0 0x7f63701982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 -- 172.21.15.151:0/2009149390 >> 172.21.15.151:0/2009149390 conn(0x7f63700fb600 msgr2=0x7f637010e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 -- 172.21.15.151:0/2009149390 shutdown_connections 2023-07-21T22:37:06.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:06.266+0000 7f6376dff700 1 -- 172.21.15.151:0/2009149390 wait complete. 2023-07-21T22:37:06.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:06 smithi187 ceph-mon[96918]: pgmap v562: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.0 MiB/s wr, 375 op/s 2023-07-21T22:37:06.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:06 smithi195 ceph-mon[97365]: pgmap v562: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.0 MiB/s wr, 375 op/s 2023-07-21T22:37:06.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:06 smithi151 ceph-mon[95510]: pgmap v562: 97 pgs: 97 active+clean; 9.4 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.0 MiB/s wr, 375 op/s 2023-07-21T22:37:08.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:08 smithi187 ceph-mon[96918]: pgmap v563: 97 pgs: 97 active+clean; 9.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 567 op/s 2023-07-21T22:37:08.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:08 smithi195 ceph-mon[97365]: pgmap v563: 97 pgs: 97 active+clean; 9.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 567 op/s 2023-07-21T22:37:08.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:08 smithi151 ceph-mon[95510]: pgmap v563: 97 pgs: 97 active+clean; 9.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 567 op/s 2023-07-21T22:37:10.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:10 smithi187 ceph-mon[96918]: pgmap v564: 97 pgs: 97 active+clean; 9.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.1 MiB/s wr, 385 op/s 2023-07-21T22:37:10.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:10 smithi187 ceph-mon[96918]: osdmap e111: 12 total, 12 up, 12 in 2023-07-21T22:37:10.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:10 smithi195 ceph-mon[97365]: pgmap v564: 97 pgs: 97 active+clean; 9.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.1 MiB/s wr, 385 op/s 2023-07-21T22:37:10.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:10 smithi195 ceph-mon[97365]: osdmap e111: 12 total, 12 up, 12 in 2023-07-21T22:37:10.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:10 smithi151 ceph-mon[95510]: pgmap v564: 97 pgs: 97 active+clean; 9.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.1 MiB/s wr, 385 op/s 2023-07-21T22:37:10.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:10 smithi151 ceph-mon[95510]: osdmap e111: 12 total, 12 up, 12 in 2023-07-21T22:37:12.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:12 smithi187 ceph-mon[96918]: pgmap v566: 97 pgs: 97 active+clean; 9.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.7 MiB/s wr, 462 op/s 2023-07-21T22:37:12.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:12 smithi195 ceph-mon[97365]: pgmap v566: 97 pgs: 97 active+clean; 9.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.7 MiB/s wr, 462 op/s 2023-07-21T22:37:12.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:12 smithi151 ceph-mon[95510]: pgmap v566: 97 pgs: 97 active+clean; 9.5 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 3.7 MiB/s wr, 462 op/s 2023-07-21T22:37:14.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:14 smithi187 ceph-mon[96918]: pgmap v567: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:37:14.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:14 smithi195 ceph-mon[97365]: pgmap v567: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:37:14.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:14 smithi151 ceph-mon[95510]: pgmap v567: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:37:16.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:16 smithi187 ceph-mon[96918]: pgmap v568: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:37:16.879 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:16 smithi187 ceph-mon[96918]: osdmap e112: 12 total, 12 up, 12 in 2023-07-21T22:37:16.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:16 smithi195 ceph-mon[97365]: pgmap v568: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:37:16.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:16 smithi195 ceph-mon[97365]: osdmap e112: 12 total, 12 up, 12 in 2023-07-21T22:37:16.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:16 smithi151 ceph-mon[95510]: pgmap v568: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:37:16.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:16 smithi151 ceph-mon[95510]: osdmap e112: 12 total, 12 up, 12 in 2023-07-21T22:37:18.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:18 smithi187 ceph-mon[96918]: pgmap v570: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.9 MiB/s wr, 511 op/s 2023-07-21T22:37:18.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:18 smithi195 ceph-mon[97365]: pgmap v570: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.9 MiB/s wr, 511 op/s 2023-07-21T22:37:18.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:18 smithi151 ceph-mon[95510]: pgmap v570: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 3.9 MiB/s wr, 511 op/s 2023-07-21T22:37:19.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.438+0000 7fe7b51ff700 1 -- 172.21.15.151:0/3751792297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b0105b60 msgr2=0x7fe7b0105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.438+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/3751792297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b0105b60 0x7fe7b0105f30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0009990 tx=0x7fe7a0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.438+0000 7fe7b51ff700 1 -- 172.21.15.151:0/3751792297 shutdown_connections 2023-07-21T22:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.438+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/3751792297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7b01004e0 0x7fe7b010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.438+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/3751792297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b0105b60 0x7fe7b0105f30 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.438+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/3751792297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7b00ffb30 0x7fe7b00fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.438+0000 7fe7b51ff700 1 -- 172.21.15.151:0/3751792297 >> 172.21.15.151:0/3751792297 conn(0x7fe7b00fb5f0 msgr2=0x7fe7b00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.438+0000 7fe7b51ff700 1 -- 172.21.15.151:0/3751792297 shutdown_connections 2023-07-21T22:37:19.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.439+0000 7fe7b51ff700 1 -- 172.21.15.151:0/3751792297 wait complete. 2023-07-21T22:37:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7b51ff700 1 Processor -- start 2023-07-21T22:37:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7b51ff700 1 -- start start 2023-07-21T22:37:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7b51ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b00ffb30 0x7fe7b0197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7b51ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7b01004e0 0x7fe7b0198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7b51ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7b0105b60 0x7fe7b019c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7b51ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b019cf20 con 0x7fe7b00ffb30 2023-07-21T22:37:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7b51ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b019d090 con 0x7fe7b01004e0 2023-07-21T22:37:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7b51ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7b019d250 con 0x7fe7b0105b60 2023-07-21T22:37:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b00ffb30 0x7fe7b0197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b00ffb30 0x7fe7b0197d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38014/0 (socket says 172.21.15.151:38014) 2023-07-21T22:37:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.440+0000 7fe7aed9d700 1 -- 172.21.15.151:0/154340190 learned_addr learned my addr 172.21.15.151:0/154340190 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:19.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.441+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7b01004e0 0x7fe7b0198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.441+0000 7fe7af59e700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7b0105b60 0x7fe7b019c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.441+0000 7fe7aed9d700 1 -- 172.21.15.151:0/154340190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7b0105b60 msgr2=0x7fe7b019c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.441+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7b0105b60 0x7fe7b019c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.441+0000 7fe7aed9d700 1 -- 172.21.15.151:0/154340190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7b01004e0 msgr2=0x7fe7b0198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.441+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7b01004e0 0x7fe7b0198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.441+0000 7fe7aed9d700 1 -- 172.21.15.151:0/154340190 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7a00095f0 con 0x7fe7b00ffb30 2023-07-21T22:37:19.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.441+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b00ffb30 0x7fe7b0197d30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005720 tx=0x7fe7a0005750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.442+0000 7fe797fff700 1 -- 172.21.15.151:0/154340190 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a001d070 con 0x7fe7b00ffb30 2023-07-21T22:37:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.442+0000 7fe7b51ff700 1 -- 172.21.15.151:0/154340190 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7b019d4d0 con 0x7fe7b00ffb30 2023-07-21T22:37:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.442+0000 7fe797fff700 1 -- 172.21.15.151:0/154340190 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a000be30 con 0x7fe7b00ffb30 2023-07-21T22:37:19.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.442+0000 7fe797fff700 1 -- 172.21.15.151:0/154340190 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a0022e60 con 0x7fe7b00ffb30 2023-07-21T22:37:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.442+0000 7fe7b51ff700 1 -- 172.21.15.151:0/154340190 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b01a4d70 con 0x7fe7b00ffb30 2023-07-21T22:37:19.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.445+0000 7fe797fff700 1 -- 172.21.15.151:0/154340190 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fe7a0022600 con 0x7fe7b00ffb30 2023-07-21T22:37:19.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.447+0000 7fe797fff700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7980a12c0 0x7fe7980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.447+0000 7fe7c8ae5b80 1 Processor -- start 2023-07-21T22:37:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.447+0000 7fe797fff700 1 -- 172.21.15.151:0/154340190 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe7a00ce0a0 con 0x7fe7b00ffb30 2023-07-21T22:37:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.447+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7980a12c0 0x7fe7980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.447+0000 7fe7c8ae5b80 1 -- start start 2023-07-21T22:37:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b6176b0 0x56381b7c0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1210 0x56381b7baf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1660 0x56381b7bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b6c0c50 con 0x56381b7c1210 2023-07-21T22:37:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b7139e0 con 0x56381b6176b0 2023-07-21T22:37:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b70ce70 con 0x56381b7c1660 2023-07-21T22:37:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7ae59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1210 0x56381b7baf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b6176b0 0x56381b7c0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b6176b0 0x56381b7c0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49036/0 (socket says 172.21.15.151:49036) 2023-07-21T22:37:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7aed9d700 1 -- 172.21.15.151:0/331392494 learned_addr learned my addr 172.21.15.151:0/331392494 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7980a12c0 0x7fe7980a3770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0199550 tx=0x7fe7a40073d0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.448+0000 7fe7af59e700 1 --2- 172.21.15.151:0/331392494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1660 0x56381b7bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.449+0000 7fe7aed9d700 1 -- 172.21.15.151:0/331392494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1660 msgr2=0x56381b7bb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.449+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/331392494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1660 0x56381b7bb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.449+0000 7fe7aed9d700 1 -- 172.21.15.151:0/331392494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1210 msgr2=0x56381b7baf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.449+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/331392494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1210 0x56381b7baf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.449+0000 7fe7aed9d700 1 -- 172.21.15.151:0/331392494 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56381b53ad80 con 0x56381b6176b0 2023-07-21T22:37:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.449+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/331392494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b6176b0 0x56381b7c0cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0097720 tx=0x7fe7a0005910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe2339aa7cb4c19a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.449+0000 7fe7957fa700 1 -- 172.21.15.151:0/331392494 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a009f030 con 0x56381b6176b0 2023-07-21T22:37:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.449+0000 7fe7957fa700 1 -- 172.21.15.151:0/331392494 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a00aee90 con 0x56381b6176b0 2023-07-21T22:37:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.449+0000 7fe7957fa700 1 -- 172.21.15.151:0/331392494 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a009b680 con 0x56381b6176b0 2023-07-21T22:37:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.450+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/331392494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b6176b0 msgr2=0x56381b7c0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.450+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/331392494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b6176b0 0x56381b7c0cd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0097720 tx=0x7fe7a0005910 comp rx=0 tx=0).stop 2023-07-21T22:37:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.450+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/331392494 shutdown_connections 2023-07-21T22:37:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.450+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/331392494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b6176b0 0x56381b7c0cd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.450+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/331392494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1660 0x56381b7bb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.450+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/331392494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1210 0x56381b7baf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.450+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/331392494 >> 172.21.15.151:0/331392494 conn(0x56381b7b0ae0 msgr2=0x56381b7b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.450+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/331392494 shutdown_connections 2023-07-21T22:37:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.450+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/331392494 wait complete. 2023-07-21T22:37:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.451+0000 7fe7c8ae5b80 1 -- start start 2023-07-21T22:37:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.451+0000 7fe7c8ae5b80 1 Processor -- start 2023-07-21T22:37:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7ca300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1660 0x56381b7c4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b6aca60 con 0x56381b6176b0 2023-07-21T22:37:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b6ac760 con 0x56381b7c1210 2023-07-21T22:37:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b5908c0 con 0x56381b7c1660 2023-07-21T22:37:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7c8ae5b80 10 client.0 _ll_register_callbacks cb 0x56381b6aa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7ae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7ae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49044/0 (socket says 172.21.15.151:49044) 2023-07-21T22:37:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7ae59c700 1 -- 172.21.15.151:0/2961415229 learned_addr learned my addr 172.21.15.151:0/2961415229 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7ca300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7ae59c700 1 -- 172.21.15.151:0/2961415229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1660 msgr2=0x56381b7c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1660 0x56381b7c4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7ae59c700 1 -- 172.21.15.151:0/2961415229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 msgr2=0x56381b7ca300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.452+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7ca300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.453+0000 7fe7ae59c700 1 -- 172.21.15.151:0/2961415229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7b01a4d70 con 0x56381b7c1210 2023-07-21T22:37:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.453+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7ca840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4011490 tx=0x7fe7a40047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea05ac6d0ce360b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.453+0000 7fe792ff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:37:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.453+0000 7fe792ff5700 1 -- 172.21.15.151:0/2961415229 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a4028640 con 0x56381b7c1210 2023-07-21T22:37:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.453+0000 7fe792ff5700 1 -- 172.21.15.151:0/2961415229 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe7a4017070 con 0x56381b7c1210 2023-07-21T22:37:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.453+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2961415229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56381b666490 con 0x56381b7c1210 2023-07-21T22:37:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe792ff5700 1 -- 172.21.15.151:0/2961415229 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a40287a0 con 0x56381b7c1210 2023-07-21T22:37:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe7c8ae5b80 10 client.27446 fetch_fsmap learned FSMap version 64 2023-07-21T22:37:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2961415229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x56381b523c00 con 0x56381b7c1210 2023-07-21T22:37:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe792ff5700 1 -- 172.21.15.151:0/2961415229 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56381b666490 con 0x56381b7c1210 2023-07-21T22:37:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe792ff5700 1 -- 172.21.15.151:0/2961415229 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe7a40318a0 con 0x56381b7c1210 2023-07-21T22:37:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe7c8ae5b80 10 client.27446 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:37:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe7c8ae5b80 10 client.27446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe7c8ae5b80 20 client.27446 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56381b7d4890 0x56381b7d6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe7c8ae5b80 4 client.27446 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:37:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.454+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2961415229 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56381b705e50 con 0x56381b7d4890 2023-07-21T22:37:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.455+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56381b7d4890 0x56381b7d6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.455+0000 7fe792ff5700 10 client.27446 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.455+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56381b7d4890 0x56381b7d6ca0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c6a42239690efcd server_cookie=d0c712d33830d0a2 in_seq=0 out_seq=0 2023-07-21T22:37:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe792ff5700 1 -- 172.21.15.151:0/2961415229 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56381b705e50 con 0x56381b7d4890 2023-07-21T22:37:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe792ff5700 10 client.27446 handle_command_reply: tid=0 2023-07-21T22:37:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe7c8ae5b80 1 client.27446 shutdown 2023-07-21T22:37:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2961415229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 msgr2=0x56381b7ca840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7ca840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe7a4011490 tx=0x7fe7a40047c0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2961415229 shutdown_connections 2023-07-21T22:37:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56381b7d4890 0x56381b7d6ca0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1660 0x56381b7c4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7ca300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe792ff5700 0 client.27446 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2961415229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7ca840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.456+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2961415229 >> 172.21.15.151:0/2961415229 conn(0x56381b7b0ae0 msgr2=0x56381b7b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.457+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2961415229 shutdown_connections 2023-07-21T22:37:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.457+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2961415229 wait complete. 2023-07-21T22:37:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.457+0000 7fe7c8ae5b80 20 client.27446 trim_cache size 0 max 16384 2023-07-21T22:37:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.474+0000 7fe7c8ae5b80 1 Processor -- start 2023-07-21T22:37:19.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.474+0000 7fe7c8ae5b80 1 -- start start 2023-07-21T22:37:19.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7c2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1210 0x56381b7c3450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1660 0x56381b7bd740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b7b2c00 con 0x56381b6176b0 2023-07-21T22:37:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b7b7900 con 0x56381b7c1660 2023-07-21T22:37:19.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b7bbd30 con 0x56381b7c1210 2023-07-21T22:37:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7c2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7af59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1660 0x56381b7bd740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7c2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38044/0 (socket says 172.21.15.151:38044) 2023-07-21T22:37:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7aed9d700 1 -- 172.21.15.151:0/4284245214 learned_addr learned my addr 172.21.15.151:0/4284245214 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.475+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1210 0x56381b7c3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe7af59e700 1 -- 172.21.15.151:0/4284245214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1210 msgr2=0x56381b7c3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe7af59e700 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1210 0x56381b7c3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe7af59e700 1 -- 172.21.15.151:0/4284245214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 msgr2=0x56381b7c2120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe7af59e700 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7c2120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe7af59e700 1 -- 172.21.15.151:0/4284245214 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56381b5611f0 con 0x56381b7c1660 2023-07-21T22:37:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1210 0x56381b7c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:19.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe7af59e700 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1660 0x56381b7bd740 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009440 tx=0x7fe7a8009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1083140b5926006a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe795ffb700 1 -- 172.21.15.151:0/4284245214 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a800e030 con 0x56381b7c1660 2023-07-21T22:37:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe795ffb700 1 -- 172.21.15.151:0/4284245214 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a800f040 con 0x56381b7c1660 2023-07-21T22:37:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.476+0000 7fe795ffb700 1 -- 172.21.15.151:0/4284245214 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a80047d0 con 0x56381b7c1660 2023-07-21T22:37:19.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.477+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/4284245214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1660 msgr2=0x56381b7bd740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.477+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1660 0x56381b7bd740 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fe7a8009440 tx=0x7fe7a8009920 comp rx=0 tx=0).stop 2023-07-21T22:37:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.477+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/4284245214 shutdown_connections 2023-07-21T22:37:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.477+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1660 0x56381b7bd740 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.477+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b6176b0 0x56381b7c2120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.477+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/4284245214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b7c1210 0x56381b7c3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.477+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/4284245214 >> 172.21.15.151:0/4284245214 conn(0x56381b7b0ae0 msgr2=0x56381b7c2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:19.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.477+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/4284245214 shutdown_connections 2023-07-21T22:37:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.477+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/4284245214 wait complete. 2023-07-21T22:37:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.478+0000 7fe7c8ae5b80 1 -- start start 2023-07-21T22:37:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.478+0000 7fe7c8ae5b80 1 Processor -- start 2023-07-21T22:37:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b6176b0 0x56381b7ca3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7c8ae5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1660 0x56381b7c8c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b7c9170 con 0x56381b7c1660 2023-07-21T22:37:19.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b7c92e0 con 0x56381b7c1210 2023-07-21T22:37:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7c8ae5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56381b7c94a0 con 0x56381b6176b0 2023-07-21T22:37:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7c8ae5b80 10 client.0 _ll_register_callbacks cb 0x56381b6aa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b6176b0 0x56381b7ca3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7af59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1660 0x56381b7c8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7aed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b6176b0 0x56381b7ca3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45526/0 (socket says 172.21.15.151:45526) 2023-07-21T22:37:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7aed9d700 1 -- 172.21.15.151:0/2715660137 learned_addr learned my addr 172.21.15.151:0/2715660137 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7aed9d700 1 -- 172.21.15.151:0/2715660137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 msgr2=0x56381b7c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7aed9d700 1 -- 172.21.15.151:0/2715660137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1660 msgr2=0x56381b7c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1660 0x56381b7c8c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.479+0000 7fe7aed9d700 1 -- 172.21.15.151:0/2715660137 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56381b53ad80 con 0x56381b6176b0 2023-07-21T22:37:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.480+0000 7fe7aed9d700 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b6176b0 0x56381b7ca3c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0097720 tx=0x7fe7a000bfa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=becd4237303a5b73 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.480+0000 7fe792ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:37:19.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.480+0000 7fe792ff5700 1 -- 172.21.15.151:0/2715660137 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7a009f250 con 0x56381b6176b0 2023-07-21T22:37:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.480+0000 7fe792ff5700 1 -- 172.21.15.151:0/2715660137 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe7a00b3040 con 0x56381b6176b0 2023-07-21T22:37:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.480+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2715660137 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe7a00aee90 con 0x56381b6176b0 2023-07-21T22:37:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.480+0000 7fe792ff5700 1 -- 172.21.15.151:0/2715660137 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe7a00a35e0 con 0x56381b6176b0 2023-07-21T22:37:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.480+0000 7fe7c8ae5b80 10 client.27478 fetch_fsmap learned FSMap version 64 2023-07-21T22:37:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.480+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2715660137 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x56381b523c00 con 0x56381b6176b0 2023-07-21T22:37:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.481+0000 7fe792ff5700 1 -- 172.21.15.151:0/2715660137 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe7a00aee90 con 0x56381b6176b0 2023-07-21T22:37:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.481+0000 7fe792ff5700 1 -- 172.21.15.151:0/2715660137 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fe7a00a3150 con 0x56381b6176b0 2023-07-21T22:37:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.481+0000 7fe7c8ae5b80 10 client.27478 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:37:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.481+0000 7fe7c8ae5b80 10 client.27478 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.481+0000 7fe7c8ae5b80 20 client.27478 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.481+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56381b8296d0 0x56381b82bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.481+0000 7fe7c8ae5b80 4 client.27478 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:37:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.481+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2715660137 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56381b6c7ff0 con 0x56381b8296d0 2023-07-21T22:37:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.481+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56381b8296d0 0x56381b82bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.482+0000 7fe7ae59c700 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56381b8296d0 0x56381b82bab0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27d8dbf57d3ee1a3 server_cookie=f90fdc531c57b90 in_seq=0 out_seq=0 2023-07-21T22:37:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.482+0000 7fe792ff5700 10 client.27478 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe792ff5700 1 -- 172.21.15.151:0/2715660137 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56381b6c7ff0 con 0x56381b8296d0 2023-07-21T22:37:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe792ff5700 10 client.27478 handle_command_reply: tid=0 2023-07-21T22:37:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 client.27478 shutdown 2023-07-21T22:37:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2715660137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b6176b0 msgr2=0x56381b7ca3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b6176b0 0x56381b7ca3c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0097720 tx=0x7fe7a000bfa0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2715660137 shutdown_connections 2023-07-21T22:37:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56381b8296d0 0x56381b82bab0 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56381b7c1660 0x56381b7c8c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56381b6176b0 0x56381b7ca3c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe792ff5700 0 client.27478 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 --2- 172.21.15.151:0/2715660137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56381b7c1210 0x56381b7c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2715660137 >> 172.21.15.151:0/2715660137 conn(0x56381b7b0ae0 msgr2=0x56381b7c35d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2715660137 shutdown_connections 2023-07-21T22:37:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.493+0000 7fe7c8ae5b80 1 -- 172.21.15.151:0/2715660137 wait complete. 2023-07-21T22:37:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7c8ae5b80 20 client.27478 trim_cache size 0 max 16384 2023-07-21T22:37:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:37:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:37:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:37:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:37:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 -- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7980a12c0 msgr2=0x7fe7980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7980a12c0 0x7fe7980a3770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fe7b0199550 tx=0x7fe7a40073d0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 -- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b00ffb30 msgr2=0x7fe7b0197d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b00ffb30 0x7fe7b0197d30 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fe7a0005720 tx=0x7fe7a0005750 comp rx=0 tx=0).stop 2023-07-21T22:37:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 -- 172.21.15.151:0/154340190 shutdown_connections 2023-07-21T22:37:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe7980a12c0 0x7fe7980a3770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe7b0105b60 0x7fe7b019c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7b00ffb30 0x7fe7b0197d30 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 --2- 172.21.15.151:0/154340190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7b01004e0 0x7fe7b0198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:19.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.494+0000 7fe7b51ff700 1 -- 172.21.15.151:0/154340190 >> 172.21.15.151:0/154340190 conn(0x7fe7b00fb5f0 msgr2=0x7fe7b0072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:19.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.495+0000 7fe7b51ff700 1 -- 172.21.15.151:0/154340190 shutdown_connections 2023-07-21T22:37:19.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:19.495+0000 7fe7b51ff700 1 -- 172.21.15.151:0/154340190 wait complete. 2023-07-21T22:37:20.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:20 smithi187 ceph-mon[96918]: pgmap v571: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.3 MiB/s wr, 426 op/s 2023-07-21T22:37:20.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:20 smithi195 ceph-mon[97365]: pgmap v571: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.3 MiB/s wr, 426 op/s 2023-07-21T22:37:20.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:20 smithi151 ceph-mon[95510]: pgmap v571: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 3.3 MiB/s wr, 426 op/s 2023-07-21T22:37:22.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:22 smithi187 ceph-mon[96918]: pgmap v572: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.1 MiB/s wr, 409 op/s 2023-07-21T22:37:22.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:22 smithi195 ceph-mon[97365]: pgmap v572: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.1 MiB/s wr, 409 op/s 2023-07-21T22:37:22.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:22 smithi151 ceph-mon[95510]: pgmap v572: 97 pgs: 97 active+clean; 9.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 3.1 MiB/s wr, 409 op/s 2023-07-21T22:37:24.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:24 smithi187 ceph-mon[96918]: pgmap v573: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 MiB/s wr, 451 op/s 2023-07-21T22:37:24.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:24 smithi195 ceph-mon[97365]: pgmap v573: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 MiB/s wr, 451 op/s 2023-07-21T22:37:24.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:24 smithi151 ceph-mon[95510]: pgmap v573: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 MiB/s wr, 451 op/s 2023-07-21T22:37:26.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:26 smithi187 ceph-mon[96918]: pgmap v574: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 MiB/s wr, 451 op/s 2023-07-21T22:37:26.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:26 smithi195 ceph-mon[97365]: pgmap v574: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 MiB/s wr, 451 op/s 2023-07-21T22:37:26.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:26 smithi151 ceph-mon[95510]: pgmap v574: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.6 MiB/s wr, 451 op/s 2023-07-21T22:37:28.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:28 smithi187 ceph-mon[96918]: pgmap v575: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.9 MiB/s wr, 615 op/s 2023-07-21T22:37:28.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:28 smithi195 ceph-mon[97365]: pgmap v575: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.9 MiB/s wr, 615 op/s 2023-07-21T22:37:28.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:28 smithi151 ceph-mon[95510]: pgmap v575: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 4.9 MiB/s wr, 615 op/s 2023-07-21T22:37:30.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:30 smithi187 ceph-mon[96918]: pgmap v576: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.0 MiB/s wr, 370 op/s 2023-07-21T22:37:30.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:30 smithi195 ceph-mon[97365]: pgmap v576: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.0 MiB/s wr, 370 op/s 2023-07-21T22:37:30.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:30 smithi151 ceph-mon[95510]: pgmap v576: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.0 MiB/s wr, 370 op/s 2023-07-21T22:37:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.656+0000 7f43a9fff700 1 -- 172.21.15.151:0/417378880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a40ffb30 msgr2=0x7f43a40fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.656+0000 7f43a9fff700 1 --2- 172.21.15.151:0/417378880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a40ffb30 0x7f43a40fffa0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f4398009990 tx=0x7f4398009ca0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.656+0000 7f43a9fff700 1 -- 172.21.15.151:0/417378880 shutdown_connections 2023-07-21T22:37:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.656+0000 7f43a9fff700 1 --2- 172.21.15.151:0/417378880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a41004e0 0x7f43a410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.656+0000 7f43a9fff700 1 --2- 172.21.15.151:0/417378880 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a4105b60 0x7f43a4105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.656+0000 7f43a9fff700 1 --2- 172.21.15.151:0/417378880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a40ffb30 0x7f43a40fffa0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.656+0000 7f43a9fff700 1 -- 172.21.15.151:0/417378880 >> 172.21.15.151:0/417378880 conn(0x7f43a40fb5f0 msgr2=0x7f43a40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.656+0000 7f43a9fff700 1 -- 172.21.15.151:0/417378880 shutdown_connections 2023-07-21T22:37:32.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.656+0000 7f43a9fff700 1 -- 172.21.15.151:0/417378880 wait complete. 2023-07-21T22:37:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.657+0000 7f43a9fff700 1 Processor -- start 2023-07-21T22:37:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.657+0000 7f43a9fff700 1 -- start start 2023-07-21T22:37:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a9fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb30 0x7f43a4197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a9fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a41004e0 0x7f43a4198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a9fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4105b60 0x7f43a419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a9fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a419bdc0 con 0x7f43a4105b60 2023-07-21T22:37:32.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a9fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a419bf30 con 0x7f43a41004e0 2023-07-21T22:37:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a9fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43a419c0f0 con 0x7f43a40ffb30 2023-07-21T22:37:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb30 0x7f43a4197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb30 0x7f43a4197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:55794/0 (socket says 172.21.15.151:55794) 2023-07-21T22:37:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a37fe700 1 -- 172.21.15.151:0/3411474209 learned_addr learned my addr 172.21.15.151:0/3411474209 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4105b60 0x7f43a419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a41004e0 0x7f43a4198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a37fe700 1 -- 172.21.15.151:0/3411474209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a41004e0 msgr2=0x7f43a4198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a37fe700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a41004e0 0x7f43a4198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a37fe700 1 -- 172.21.15.151:0/3411474209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4105b60 msgr2=0x7f43a419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a37fe700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4105b60 0x7f43a419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.658+0000 7f43a37fe700 1 -- 172.21.15.151:0/3411474209 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43980095f0 con 0x7f43a40ffb30 2023-07-21T22:37:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.659+0000 7f43a37fe700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb30 0x7f43a4197cc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f439400e9a0 tx=0x7f439400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.659+0000 7f43a0ff9700 1 -- 172.21.15.151:0/3411474209 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394009790 con 0x7f43a40ffb30 2023-07-21T22:37:32.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.659+0000 7f43a0ff9700 1 -- 172.21.15.151:0/3411474209 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4394010430 con 0x7f43a40ffb30 2023-07-21T22:37:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.659+0000 7f43a9fff700 1 -- 172.21.15.151:0/3411474209 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43a419c3d0 con 0x7f43a40ffb30 2023-07-21T22:37:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.659+0000 7f43a0ff9700 1 -- 172.21.15.151:0/3411474209 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439400cea0 con 0x7f43a40ffb30 2023-07-21T22:37:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.659+0000 7f43a9fff700 1 -- 172.21.15.151:0/3411474209 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a41a4d30 con 0x7f43a40ffb30 2023-07-21T22:37:32.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.662+0000 7f43a0ff9700 1 -- 172.21.15.151:0/3411474209 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f43940105a0 con 0x7f43a40ffb30 2023-07-21T22:37:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.663+0000 7f43bd834b80 1 Processor -- start 2023-07-21T22:37:32.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43bd834b80 1 -- start start 2023-07-21T22:37:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43a0ff9700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f438c0a12c0 0x7f438c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43a0ff9700 1 -- 172.21.15.151:0/3411474209 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4394014070 con 0x7f43a40ffb30 2023-07-21T22:37:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 0x5601e0231cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43a3fff700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f438c0a12c0 0x7f438c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e022bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 0x5601e022c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43bd834b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e0131c50 con 0x5601e0232210 2023-07-21T22:37:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43bd834b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e01849e0 con 0x5601e0232660 2023-07-21T22:37:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.664+0000 7f43bd834b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e017de70 con 0x5601e00886b0 2023-07-21T22:37:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e022bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e022bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39606/0 (socket says 172.21.15.151:39606) 2023-07-21T22:37:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a2ffd700 1 -- 172.21.15.151:0/1733401601 learned_addr learned my addr 172.21.15.151:0/1733401601 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a37fe700 1 --2- 172.21.15.151:0/1733401601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 0x5601e0231cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a3fff700 1 --2- 172.21.15.151:0/1733401601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 0x5601e022c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a3fff700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f438c0a12c0 0x7f438c0a3770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f439c00f540 tx=0x7f439c009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a2ffd700 1 -- 172.21.15.151:0/1733401601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 msgr2=0x5601e0231cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/1733401601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 0x5601e0231cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a2ffd700 1 -- 172.21.15.151:0/1733401601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 msgr2=0x5601e022c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/1733401601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 0x5601e022c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a2ffd700 1 -- 172.21.15.151:0/1733401601 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601dffabd80 con 0x5601e0232210 2023-07-21T22:37:32.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.665+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/1733401601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e022bf40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4398009990 tx=0x7f4398005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6dec3c61a965620 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f4389ffb700 1 -- 172.21.15.151:0/1733401601 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439801d070 con 0x5601e0232210 2023-07-21T22:37:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f4389ffb700 1 -- 172.21.15.151:0/1733401601 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f439801e040 con 0x5601e0232210 2023-07-21T22:37:32.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f4389ffb700 1 -- 172.21.15.151:0/1733401601 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4398004760 con 0x5601e0232210 2023-07-21T22:37:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f43bd834b80 1 -- 172.21.15.151:0/1733401601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 msgr2=0x5601e022bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1733401601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e022bf40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f4398009990 tx=0x7f4398005f00 comp rx=0 tx=0).stop 2023-07-21T22:37:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f43bd834b80 1 -- 172.21.15.151:0/1733401601 shutdown_connections 2023-07-21T22:37:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1733401601 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 0x5601e022c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1733401601 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 0x5601e0231cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1733401601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e022bf40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f43bd834b80 1 -- 172.21.15.151:0/1733401601 >> 172.21.15.151:0/1733401601 conn(0x5601e0221ae0 msgr2=0x5601e02270e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.666+0000 7f43bd834b80 1 -- 172.21.15.151:0/1733401601 shutdown_connections 2023-07-21T22:37:32.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.667+0000 7f43bd834b80 1 -- 172.21.15.151:0/1733401601 wait complete. 2023-07-21T22:37:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.667+0000 7f43bd834b80 1 -- start start 2023-07-21T22:37:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.667+0000 7f43bd834b80 1 Processor -- start 2023-07-21T22:37:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 0x5601e02384f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0235770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 0x5601e0235da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43bd834b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e011da60 con 0x5601e0232210 2023-07-21T22:37:32.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43bd834b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e011d760 con 0x5601e0232660 2023-07-21T22:37:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43bd834b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e00018c0 con 0x5601e00886b0 2023-07-21T22:37:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43bd834b80 10 client.0 _ll_register_callbacks cb 0x5601e011b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:32.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0235770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0235770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39620/0 (socket says 172.21.15.151:39620) 2023-07-21T22:37:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43a2ffd700 1 -- 172.21.15.151:0/2349342386 learned_addr learned my addr 172.21.15.151:0/2349342386 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43a37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 0x5601e02384f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.668+0000 7f43a3fff700 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 0x5601e0235da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43a2ffd700 1 -- 172.21.15.151:0/2349342386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 msgr2=0x5601e02384f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 0x5601e02384f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43a2ffd700 1 -- 172.21.15.151:0/2349342386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 msgr2=0x5601e0235da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 0x5601e0235da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43a2ffd700 1 -- 172.21.15.151:0/2349342386 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43a410d220 con 0x5601e0232210 2023-07-21T22:37:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43a37fe700 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 0x5601e02384f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:32.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0235770 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f43980095c0 tx=0x7f4398005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69ca006df29e1e8e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f4382ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:37:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f4382ffd700 1 -- 172.21.15.151:0/2349342386 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439801d030 con 0x5601e0232210 2023-07-21T22:37:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43bd834b80 1 -- 172.21.15.151:0/2349342386 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5601e00d7490 con 0x5601e0232210 2023-07-21T22:37:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f4382ffd700 1 -- 172.21.15.151:0/2349342386 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4398004500 con 0x5601e0232210 2023-07-21T22:37:32.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f4382ffd700 1 -- 172.21.15.151:0/2349342386 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f439800bb20 con 0x5601e0232210 2023-07-21T22:37:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43bd834b80 10 client.17784 fetch_fsmap learned FSMap version 64 2023-07-21T22:37:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.669+0000 7f43bd834b80 1 -- 172.21.15.151:0/2349342386 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5601dff94c00 con 0x5601e0232210 2023-07-21T22:37:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.670+0000 7f4382ffd700 1 -- 172.21.15.151:0/2349342386 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5601e00d7490 con 0x5601e0232210 2023-07-21T22:37:32.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.670+0000 7f4382ffd700 1 -- 172.21.15.151:0/2349342386 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f439800f8a0 con 0x5601e0232210 2023-07-21T22:37:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.670+0000 7f43bd834b80 10 client.17784 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:37:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.670+0000 7f43bd834b80 10 client.17784 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.670+0000 7f43bd834b80 20 client.17784 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:32.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.670+0000 7f43bd834b80 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5601e02456b0 0x5601e0247ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.670+0000 7f43bd834b80 4 client.17784 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:37:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.670+0000 7f43bd834b80 1 -- 172.21.15.151:0/2349342386 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5601e0176e50 con 0x5601e02456b0 2023-07-21T22:37:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.671+0000 7f43a37fe700 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5601e02456b0 0x5601e0247ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.671+0000 7f43a37fe700 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5601e02456b0 0x5601e0247ac0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1a48a2ca444d0aa6 server_cookie=1e219f6d6a4d7eb6 in_seq=0 out_seq=0 2023-07-21T22:37:32.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.671+0000 7f4382ffd700 10 client.17784 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f4382ffd700 1 -- 172.21.15.151:0/2349342386 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5601e0176e50 con 0x5601e02456b0 2023-07-21T22:37:32.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f4382ffd700 10 client.17784 handle_command_reply: tid=0 2023-07-21T22:37:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f43bd834b80 1 client.17784 shutdown 2023-07-21T22:37:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f43bd834b80 1 -- 172.21.15.151:0/2349342386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 msgr2=0x5601e0235770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f43bd834b80 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0235770 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f43980095c0 tx=0x7f4398005810 comp rx=0 tx=0).stop 2023-07-21T22:37:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f43bd834b80 1 -- 172.21.15.151:0/2349342386 shutdown_connections 2023-07-21T22:37:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f43bd834b80 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5601e02456b0 0x5601e0247ac0 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f43bd834b80 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e0232660 0x5601e0235da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f43bd834b80 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e00886b0 0x5601e02384f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f43bd834b80 1 --2- 172.21.15.151:0/2349342386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0235770 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f43bd834b80 1 -- 172.21.15.151:0/2349342386 >> 172.21.15.151:0/2349342386 conn(0x5601e0221ae0 msgr2=0x5601e02263e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.672+0000 7f4382ffd700 0 client.17784 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.673+0000 7f43bd834b80 1 -- 172.21.15.151:0/2349342386 shutdown_connections 2023-07-21T22:37:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.673+0000 7f43bd834b80 1 -- 172.21.15.151:0/2349342386 wait complete. 2023-07-21T22:37:32.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.673+0000 7f43bd834b80 20 client.17784 trim_cache size 0 max 16384 2023-07-21T22:37:32.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.688+0000 7f43bd834b80 1 Processor -- start 2023-07-21T22:37:32.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.688+0000 7f43bd834b80 1 -- start start 2023-07-21T22:37:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.688+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e02331b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.688+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0238090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.688+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232660 0x5601e0226b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.688+0000 7f43bd834b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e0176e50 con 0x5601e0232210 2023-07-21T22:37:32.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.688+0000 7f43bd834b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e00d7490 con 0x5601e00886b0 2023-07-21T22:37:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.688+0000 7f43bd834b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e0227cb0 con 0x5601e0232660 2023-07-21T22:37:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0238090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232660 0x5601e0226b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e02331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232660 0x5601e0226b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:55832/0 (socket says 172.21.15.151:55832) 2023-07-21T22:37:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0238090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39628/0 (socket says 172.21.15.151:39628) 2023-07-21T22:37:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a3fff700 1 -- 172.21.15.151:0/18828014 learned_addr learned my addr 172.21.15.151:0/18828014 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:32.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e02331b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40142/0 (socket says 172.21.15.151:40142) 2023-07-21T22:37:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a2ffd700 1 -- 172.21.15.151:0/18828014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232660 msgr2=0x5601e0226b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/18828014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232660 0x5601e0226b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a2ffd700 1 -- 172.21.15.151:0/18828014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 msgr2=0x5601e02331b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/18828014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e02331b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a2ffd700 1 -- 172.21.15.151:0/18828014 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5601dffd21f0 con 0x5601e0232210 2023-07-21T22:37:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a3fff700 1 --2- 172.21.15.151:0/18828014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232660 0x5601e0226b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:32.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.689+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/18828014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0238090 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f439800fcb0 tx=0x7f439800b2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51fcff43a9c2aeb5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f438a7fc700 1 -- 172.21.15.151:0/18828014 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439801d070 con 0x5601e0232210 2023-07-21T22:37:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f438a7fc700 1 -- 172.21.15.151:0/18828014 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f439800bb20 con 0x5601e0232210 2023-07-21T22:37:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f438a7fc700 1 -- 172.21.15.151:0/18828014 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439802c8a0 con 0x5601e0232210 2023-07-21T22:37:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f43bd834b80 1 -- 172.21.15.151:0/18828014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 msgr2=0x5601e0238090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f43bd834b80 1 --2- 172.21.15.151:0/18828014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0238090 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f439800fcb0 tx=0x7f439800b2a0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f43bd834b80 1 -- 172.21.15.151:0/18828014 shutdown_connections 2023-07-21T22:37:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f43bd834b80 1 --2- 172.21.15.151:0/18828014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e02331b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f43bd834b80 1 --2- 172.21.15.151:0/18828014 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232660 0x5601e0226b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f43bd834b80 1 --2- 172.21.15.151:0/18828014 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232210 0x5601e0238090 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.690+0000 7f43bd834b80 1 -- 172.21.15.151:0/18828014 >> 172.21.15.151:0/18828014 conn(0x5601e0221ae0 msgr2=0x5601e0232aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.691+0000 7f43bd834b80 1 -- 172.21.15.151:0/18828014 shutdown_connections 2023-07-21T22:37:32.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.691+0000 7f43bd834b80 1 -- 172.21.15.151:0/18828014 wait complete. 2023-07-21T22:37:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.691+0000 7f43bd834b80 1 -- start start 2023-07-21T22:37:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.691+0000 7f43bd834b80 1 Processor -- start 2023-07-21T22:37:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e022ee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232210 0x5601e023aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43bd834b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232660 0x5601e023b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43bd834b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e023d070 con 0x5601e0232660 2023-07-21T22:37:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43bd834b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e023b560 con 0x5601e00886b0 2023-07-21T22:37:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43bd834b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5601e023b720 con 0x5601e0232210 2023-07-21T22:37:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43bd834b80 10 client.0 _ll_register_callbacks cb 0x7f439c00fd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232660 0x5601e023b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e022ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232210 0x5601e023aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e022ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40154/0 (socket says 172.21.15.151:40154) 2023-07-21T22:37:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a37fe700 1 -- 172.21.15.151:0/1732452342 learned_addr learned my addr 172.21.15.151:0/1732452342 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a2ffd700 1 -- 172.21.15.151:0/1732452342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 msgr2=0x5601e022ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e022ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a2ffd700 1 -- 172.21.15.151:0/1732452342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232660 msgr2=0x5601e023b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232660 0x5601e023b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a2ffd700 1 -- 172.21.15.151:0/1732452342 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f439c0195d0 con 0x5601e0232210 2023-07-21T22:37:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.692+0000 7f43a37fe700 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e022ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.693+0000 7f43a2ffd700 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232210 0x5601e023aae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5601e00ee720 tx=0x7f439800f7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7d2e8f9f031ff9a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.693+0000 7f4382ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:37:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.693+0000 7f4382ffd700 1 -- 172.21.15.151:0/1732452342 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439801d070 con 0x5601e0232210 2023-07-21T22:37:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.693+0000 7f4382ffd700 1 -- 172.21.15.151:0/1732452342 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4398000e40 con 0x5601e0232210 2023-07-21T22:37:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.693+0000 7f43bd834b80 1 -- 172.21.15.151:0/1732452342 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f439801e040 con 0x5601e0232210 2023-07-21T22:37:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.693+0000 7f4382ffd700 1 -- 172.21.15.151:0/1732452342 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7f439802c7b0 con 0x5601e0232210 2023-07-21T22:37:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.693+0000 7f43bd834b80 10 client.27496 fetch_fsmap learned FSMap version 64 2023-07-21T22:37:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.693+0000 7f43bd834b80 1 -- 172.21.15.151:0/1732452342 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5601dff94c00 con 0x5601e0232210 2023-07-21T22:37:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.693+0000 7f4382ffd700 1 -- 172.21.15.151:0/1732452342 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f439801e040 con 0x5601e0232210 2023-07-21T22:37:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f4382ffd700 1 -- 172.21.15.151:0/1732452342 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4398004600 con 0x5601e0232210 2023-07-21T22:37:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f43bd834b80 10 client.27496 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:37:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f43bd834b80 10 client.27496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f43bd834b80 20 client.27496 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5601e0299360 0x5601e029b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:32.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f43bd834b80 4 client.27496 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:37:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f43bd834b80 1 -- 172.21.15.151:0/1732452342 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5601e0138ff0 con 0x5601e0299360 2023-07-21T22:37:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f43a37fe700 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5601e0299360 0x5601e029b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f4382ffd700 10 client.27496 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.694+0000 7f43a37fe700 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5601e0299360 0x5601e029b770 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e4fa2aa8342a587 server_cookie=b004808daf185324 in_seq=0 out_seq=0 2023-07-21T22:37:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f4382ffd700 1 -- 172.21.15.151:0/1732452342 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5601e0138ff0 con 0x5601e0299360 2023-07-21T22:37:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f4382ffd700 10 client.27496 handle_command_reply: tid=0 2023-07-21T22:37:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 client.27496 shutdown 2023-07-21T22:37:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 -- 172.21.15.151:0/1732452342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232210 msgr2=0x5601e023aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232210 0x5601e023aae0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x5601e00ee720 tx=0x7f439800f7c0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 -- 172.21.15.151:0/1732452342 shutdown_connections 2023-07-21T22:37:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5601e0299360 0x5601e029b770 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5601e00886b0 0x5601e022ee40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5601e0232660 0x5601e023b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f4382ffd700 0 client.27496 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 --2- 172.21.15.151:0/1732452342 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5601e0232210 0x5601e023aae0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 -- 172.21.15.151:0/1732452342 >> 172.21.15.151:0/1732452342 conn(0x5601e0221ae0 msgr2=0x5601e02307b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.705+0000 7f43bd834b80 1 -- 172.21.15.151:0/1732452342 shutdown_connections 2023-07-21T22:37:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43bd834b80 1 -- 172.21.15.151:0/1732452342 wait complete. 2023-07-21T22:37:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43bd834b80 20 client.27496 trim_cache size 0 max 16384 2023-07-21T22:37:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:37:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:37:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:37:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:37:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 -- 172.21.15.151:0/3411474209 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f438c0a12c0 msgr2=0x7f438c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f438c0a12c0 0x7f438c0a3770 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f439c00f540 tx=0x7f439c009920 comp rx=0 tx=0).stop 2023-07-21T22:37:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 -- 172.21.15.151:0/3411474209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb30 msgr2=0x7f43a4197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb30 0x7f43a4197cc0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f439400e9a0 tx=0x7f439400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 -- 172.21.15.151:0/3411474209 shutdown_connections 2023-07-21T22:37:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f438c0a12c0 0x7f438c0a3770 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43a4105b60 0x7f43a419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f43a40ffb30 0x7f43a4197cc0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 --2- 172.21.15.151:0/3411474209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f43a41004e0 0x7f43a4198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 -- 172.21.15.151:0/3411474209 >> 172.21.15.151:0/3411474209 conn(0x7f43a40fb5f0 msgr2=0x7f43a40fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.706+0000 7f43a9fff700 1 -- 172.21.15.151:0/3411474209 shutdown_connections 2023-07-21T22:37:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:32.707+0000 7f43a9fff700 1 -- 172.21.15.151:0/3411474209 wait complete. 2023-07-21T22:37:32.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:32 smithi187 ceph-mon[96918]: pgmap v577: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.0 MiB/s wr, 370 op/s 2023-07-21T22:37:32.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:32 smithi195 ceph-mon[97365]: pgmap v577: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.0 MiB/s wr, 370 op/s 2023-07-21T22:37:32.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:32 smithi151 ceph-mon[95510]: pgmap v577: 97 pgs: 97 active+clean; 9.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 3.0 MiB/s wr, 370 op/s 2023-07-21T22:37:34.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:34 smithi187 ceph-mon[96918]: pgmap v578: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 543 op/s 2023-07-21T22:37:34.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:34 smithi195 ceph-mon[97365]: pgmap v578: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 543 op/s 2023-07-21T22:37:34.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:34 smithi151 ceph-mon[95510]: pgmap v578: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.3 MiB/s wr, 543 op/s 2023-07-21T22:37:36.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:36 smithi187 ceph-mon[96918]: pgmap v579: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-07-21T22:37:36.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:36 smithi195 ceph-mon[97365]: pgmap v579: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-07-21T22:37:36.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:36 smithi151 ceph-mon[95510]: pgmap v579: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-07-21T22:37:38.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:38 smithi187 ceph-mon[96918]: pgmap v580: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-07-21T22:37:38.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:38 smithi195 ceph-mon[97365]: pgmap v580: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-07-21T22:37:38.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:38 smithi151 ceph-mon[95510]: pgmap v580: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-07-21T22:37:40.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:40 smithi187 ceph-mon[96918]: pgmap v581: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-07-21T22:37:40.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:40 smithi195 ceph-mon[97365]: pgmap v581: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-07-21T22:37:40.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:40 smithi151 ceph-mon[95510]: pgmap v581: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-07-21T22:37:42.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:42 smithi187 ceph-mon[96918]: pgmap v582: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-07-21T22:37:42.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:42 smithi195 ceph-mon[97365]: pgmap v582: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-07-21T22:37:42.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:42 smithi151 ceph-mon[95510]: pgmap v582: 97 pgs: 97 active+clean; 9.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.6 MiB/s wr, 342 op/s 2023-07-21T22:37:44.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:44 smithi187 ceph-mon[96918]: pgmap v583: 97 pgs: 97 active+clean; 9.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.0 MiB/s wr, 526 op/s 2023-07-21T22:37:44.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:44 smithi195 ceph-mon[97365]: pgmap v583: 97 pgs: 97 active+clean; 9.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.0 MiB/s wr, 526 op/s 2023-07-21T22:37:44.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:44 smithi151 ceph-mon[95510]: pgmap v583: 97 pgs: 97 active+clean; 9.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 4.0 MiB/s wr, 526 op/s 2023-07-21T22:37:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.859+0000 7ff6dddff700 1 -- 172.21.15.151:0/1417919865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6d810c3f0 msgr2=0x7ff6d810e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.859+0000 7ff6dddff700 1 --2- 172.21.15.151:0/1417919865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6d810c3f0 0x7ff6d810e7d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009f90 tx=0x7ff6d000b330 comp rx=0 tx=0).stop 2023-07-21T22:37:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.859+0000 7ff6dddff700 1 -- 172.21.15.151:0/1417919865 shutdown_connections 2023-07-21T22:37:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.859+0000 7ff6dddff700 1 --2- 172.21.15.151:0/1417919865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6d8072830 0x7ff6d8072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.859+0000 7ff6dddff700 1 --2- 172.21.15.151:0/1417919865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6d810c3f0 0x7ff6d810e7d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.859+0000 7ff6dddff700 1 --2- 172.21.15.151:0/1417919865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d8073140 0x7ff6d810beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.859+0000 7ff6dddff700 1 -- 172.21.15.151:0/1417919865 >> 172.21.15.151:0/1417919865 conn(0x7ff6d80fb650 msgr2=0x7ff6d80fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.859+0000 7ff6dddff700 1 -- 172.21.15.151:0/1417919865 shutdown_connections 2023-07-21T22:37:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.859+0000 7ff6dddff700 1 -- 172.21.15.151:0/1417919865 wait complete. 2023-07-21T22:37:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.860+0000 7ff6dddff700 1 Processor -- start 2023-07-21T22:37:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.860+0000 7ff6dddff700 1 -- start start 2023-07-21T22:37:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6dddff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d8072830 0x7ff6d8197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6dddff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6d8073140 0x7ff6d81983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6dddff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6d810c3f0 0x7ff6d819ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6dddff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d819d090 con 0x7ff6d8072830 2023-07-21T22:37:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6dddff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d819d200 con 0x7ff6d810c3f0 2023-07-21T22:37:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6dddff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d819d3c0 con 0x7ff6d8073140 2023-07-21T22:37:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d8072830 0x7ff6d8197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6d8073140 0x7ff6d81983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d8072830 0x7ff6d8197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49510/0 (socket says 172.21.15.151:49510) 2023-07-21T22:37:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d77fe700 1 -- 172.21.15.151:0/2519528870 learned_addr learned my addr 172.21.15.151:0/2519528870 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d7fff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6d810c3f0 0x7ff6d819ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d77fe700 1 -- 172.21.15.151:0/2519528870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6d8073140 msgr2=0x7ff6d81983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6d8073140 0x7ff6d81983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d77fe700 1 -- 172.21.15.151:0/2519528870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6d810c3f0 msgr2=0x7ff6d819ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6d810c3f0 0x7ff6d819ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d77fe700 1 -- 172.21.15.151:0/2519528870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6cc0095f0 con 0x7ff6d8072830 2023-07-21T22:37:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d6ffd700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6d8073140 0x7ff6d81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.861+0000 7ff6d7fff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6d810c3f0 0x7ff6d819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.862+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d8072830 0x7ff6d8197ea0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800e9a0 tx=0x7ff6c800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.862+0000 7ff6d4ff9700 1 -- 172.21.15.151:0/2519528870 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c8009790 con 0x7ff6d8072830 2023-07-21T22:37:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.862+0000 7ff6dddff700 1 -- 172.21.15.151:0/2519528870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d0009c40 con 0x7ff6d8072830 2023-07-21T22:37:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.862+0000 7ff6d4ff9700 1 -- 172.21.15.151:0/2519528870 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6c8010430 con 0x7ff6d8072830 2023-07-21T22:37:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.862+0000 7ff6d4ff9700 1 -- 172.21.15.151:0/2519528870 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c800cea0 con 0x7ff6d8072830 2023-07-21T22:37:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.862+0000 7ff6dddff700 1 -- 172.21.15.151:0/2519528870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d81a4d00 con 0x7ff6d8072830 2023-07-21T22:37:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.865+0000 7ff6d4ff9700 1 -- 172.21.15.151:0/2519528870 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff6c80105a0 con 0x7ff6d8072830 2023-07-21T22:37:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.866+0000 7ff6f1689b80 1 Processor -- start 2023-07-21T22:37:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6d4ff9700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff6c00a12c0 0x7ff6c00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6f1689b80 1 -- start start 2023-07-21T22:37:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6d4ff9700 1 -- 172.21.15.151:0/2519528870 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff6c8014070 con 0x7ff6d8072830 2023-07-21T22:37:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6d7fff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff6c00a12c0 0x7ff6c00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0210 0x5621a94a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0660 0x5621a94aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a93afc50 con 0x5621a94b0210 2023-07-21T22:37:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a94029e0 con 0x5621a93066b0 2023-07-21T22:37:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.867+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a93fbe70 con 0x5621a94b0660 2023-07-21T22:37:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0210 0x5621a94a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94afcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57264/0 (socket says 172.21.15.151:57264) 2023-07-21T22:37:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d77fe700 1 -- 172.21.15.151:0/312984295 learned_addr learned my addr 172.21.15.151:0/312984295 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d7fff700 1 --2- 172.21.15.151:0/312984295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0660 0x5621a94aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d77fe700 1 -- 172.21.15.151:0/312984295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0660 msgr2=0x5621a94aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/312984295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0660 0x5621a94aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d77fe700 1 -- 172.21.15.151:0/312984295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0210 msgr2=0x5621a94a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/312984295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0210 0x5621a94a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d77fe700 1 -- 172.21.15.151:0/312984295 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621a9229d80 con 0x5621a93066b0 2023-07-21T22:37:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d6ffd700 1 --2- 172.21.15.151:0/312984295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0210 0x5621a94a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d7fff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff6c00a12c0 0x7ff6c00a3770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009790 tx=0x7ff6d00096c0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.868+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/312984295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94afcd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8096a50 tx=0x7ff6c8099c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8ba23d5e62add3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:45.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6bdffb700 1 -- 172.21.15.151:0/312984295 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80a2430 con 0x5621a93066b0 2023-07-21T22:37:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6bdffb700 1 -- 172.21.15.151:0/312984295 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6c809a240 con 0x5621a93066b0 2023-07-21T22:37:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6bdffb700 1 -- 172.21.15.151:0/312984295 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80a1fa0 con 0x5621a93066b0 2023-07-21T22:37:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6f1689b80 1 -- 172.21.15.151:0/312984295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 msgr2=0x5621a94afcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/312984295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94afcd0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8096a50 tx=0x7ff6c8099c30 comp rx=0 tx=0).stop 2023-07-21T22:37:45.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6f1689b80 1 -- 172.21.15.151:0/312984295 shutdown_connections 2023-07-21T22:37:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/312984295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94afcd0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/312984295 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0660 0x5621a94aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/312984295 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0210 0x5621a94a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6f1689b80 1 -- 172.21.15.151:0/312984295 >> 172.21.15.151:0/312984295 conn(0x5621a949fae0 msgr2=0x5621a94a50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:45.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.869+0000 7ff6f1689b80 1 -- 172.21.15.151:0/312984295 shutdown_connections 2023-07-21T22:37:45.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.870+0000 7ff6f1689b80 1 -- 172.21.15.151:0/312984295 wait complete. 2023-07-21T22:37:45.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.870+0000 7ff6f1689b80 1 -- start start 2023-07-21T22:37:45.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.870+0000 7ff6f1689b80 1 Processor -- start 2023-07-21T22:37:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b95c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 0x5621a94b3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a939ba60 con 0x5621a93066b0 2023-07-21T22:37:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a939b760 con 0x5621a94b0660 2023-07-21T22:37:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a927f8c0 con 0x5621a94b0210 2023-07-21T22:37:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6f1689b80 10 client.0 _ll_register_callbacks cb 0x5621a9399700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6d77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b95c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6d6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6d77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b95c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49528/0 (socket says 172.21.15.151:49528) 2023-07-21T22:37:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6d77fe700 1 -- 172.21.15.151:0/3337725781 learned_addr learned my addr 172.21.15.151:0/3337725781 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.871+0000 7ff6d7fff700 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 0x5621a94b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6d77fe700 1 -- 172.21.15.151:0/3337725781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 msgr2=0x5621a94b9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6d77fe700 1 -- 172.21.15.151:0/3337725781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 msgr2=0x5621a94b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 0x5621a94b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6d77fe700 1 -- 172.21.15.151:0/3337725781 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6cc011440 con 0x5621a93066b0 2023-07-21T22:37:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6d6ffd700 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b95c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8098330 tx=0x7ff6c8010bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e73563b927f514 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:37:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/3337725781 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80a2430 con 0x5621a93066b0 2023-07-21T22:37:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/3337725781 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff6c80a21b0 con 0x5621a93066b0 2023-07-21T22:37:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6f1689b80 1 -- 172.21.15.151:0/3337725781 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5621a9355490 con 0x5621a93066b0 2023-07-21T22:37:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/3337725781 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6c80ca2e0 con 0x5621a93066b0 2023-07-21T22:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6f1689b80 10 client.17802 fetch_fsmap learned FSMap version 64 2023-07-21T22:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6f1689b80 1 -- 172.21.15.151:0/3337725781 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x7ff6d81a4d00 con 0x5621a93066b0 2023-07-21T22:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.872+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/3337725781 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5621a9355490 con 0x5621a93066b0 2023-07-21T22:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.873+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/3337725781 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff6c8095e40 con 0x5621a93066b0 2023-07-21T22:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.873+0000 7ff6f1689b80 10 client.17802 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.873+0000 7ff6f1689b80 10 client.17802 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.873+0000 7ff6f1689b80 20 client.17802 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.873+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5621a94c3760 0x5621a94c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.873+0000 7ff6f1689b80 4 client.17802 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.873+0000 7ff6f1689b80 1 -- 172.21.15.151:0/3337725781 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5621a93f4e50 con 0x5621a94c3760 2023-07-21T22:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.873+0000 7ff6d6ffd700 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5621a94c3760 0x5621a94c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.874+0000 7ff6b6ffd700 10 client.17802 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.874+0000 7ff6d6ffd700 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5621a94c3760 0x5621a94c5b70 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=666e7bc42546c3f8 server_cookie=b73531de2de80eef in_seq=0 out_seq=0 2023-07-21T22:37:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/3337725781 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5621a93f4e50 con 0x5621a94c3760 2023-07-21T22:37:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6b6ffd700 10 client.17802 handle_command_reply: tid=0 2023-07-21T22:37:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 client.17802 shutdown 2023-07-21T22:37:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 -- 172.21.15.151:0/3337725781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 msgr2=0x5621a94b95c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b95c0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8098330 tx=0x7ff6c8010bf0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 -- 172.21.15.151:0/3337725781 shutdown_connections 2023-07-21T22:37:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5621a94c3760 0x5621a94c5b70 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 0x5621a94b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b95c0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/3337725781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 -- 172.21.15.151:0/3337725781 >> 172.21.15.151:0/3337725781 conn(0x5621a949fae0 msgr2=0x5621a94a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6b6ffd700 0 client.17802 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 -- 172.21.15.151:0/3337725781 shutdown_connections 2023-07-21T22:37:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 1 -- 172.21.15.151:0/3337725781 wait complete. 2023-07-21T22:37:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.875+0000 7ff6f1689b80 20 client.17802 trim_cache size 0 max 16384 2023-07-21T22:37:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6f1689b80 1 Processor -- start 2023-07-21T22:37:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6f1689b80 1 -- start start 2023-07-21T22:37:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0660 0x5621a94a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a94b1d70 con 0x5621a94b0660 2023-07-21T22:37:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a94a55e0 con 0x5621a93066b0 2023-07-21T22:37:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a94ae4c0 con 0x5621a94b0210 2023-07-21T22:37:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6d77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6d7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0660 0x5621a94a50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6d77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57286/0 (socket says 172.21.15.151:57286) 2023-07-21T22:37:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6d77fe700 1 -- 172.21.15.151:0/2423977811 learned_addr learned my addr 172.21.15.151:0/2423977811 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.891+0000 7ff6d6ffd700 1 --2- 172.21.15.151:0/2423977811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.892+0000 7ff6d77fe700 1 -- 172.21.15.151:0/2423977811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 msgr2=0x5621a94a4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.892+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/2423977811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94a4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.892+0000 7ff6d77fe700 1 -- 172.21.15.151:0/2423977811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0660 msgr2=0x5621a94a50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.892+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/2423977811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0660 0x5621a94a50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.892+0000 7ff6d77fe700 1 -- 172.21.15.151:0/2423977811 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5621a94a67e0 con 0x5621a93066b0 2023-07-21T22:37:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.892+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/2423977811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94b37c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8099ce0 tx=0x7ff6c80963d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93b026ded4d1bc7f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.892+0000 7ff6be7fc700 1 -- 172.21.15.151:0/2423977811 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80992d0 con 0x5621a93066b0 2023-07-21T22:37:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.892+0000 7ff6be7fc700 1 -- 172.21.15.151:0/2423977811 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6c8099090 con 0x5621a93066b0 2023-07-21T22:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.892+0000 7ff6be7fc700 1 -- 172.21.15.151:0/2423977811 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c80ca2e0 con 0x5621a93066b0 2023-07-21T22:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2423977811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 msgr2=0x5621a94b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2423977811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94b37c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6c8099ce0 tx=0x7ff6c80963d0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2423977811 shutdown_connections 2023-07-21T22:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2423977811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a93066b0 0x5621a94b37c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2423977811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a94b0660 0x5621a94a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2423977811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94a4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2423977811 >> 172.21.15.151:0/2423977811 conn(0x5621a949fae0 msgr2=0x5621a94b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2423977811 shutdown_connections 2023-07-21T22:37:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2423977811 wait complete. 2023-07-21T22:37:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 -- start start 2023-07-21T22:37:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.893+0000 7ff6f1689b80 1 Processor -- start 2023-07-21T22:37:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b7130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6f1689b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 0x5621a94b7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a94b7e50 con 0x5621a93066b0 2023-07-21T22:37:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a94b7fc0 con 0x5621a94b0660 2023-07-21T22:37:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6f1689b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5621a9516630 con 0x5621a94b0210 2023-07-21T22:37:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6f1689b80 10 client.0 _ll_register_callbacks cb 0x7ff6cc009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6d77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6d6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6d7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 0x5621a94b7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6d6ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b7130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:59504/0 (socket says 172.21.15.151:59504) 2023-07-21T22:37:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6d7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 0x5621a94b7740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57292/0 (socket says 172.21.15.151:57292) 2023-07-21T22:37:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.894+0000 7ff6d6ffd700 1 -- 172.21.15.151:0/2830841157 learned_addr learned my addr 172.21.15.151:0/2830841157 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6d6ffd700 1 -- 172.21.15.151:0/2830841157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 msgr2=0x5621a94b7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6d6ffd700 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 0x5621a94b7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6d6ffd700 1 -- 172.21.15.151:0/2830841157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 msgr2=0x5621a94b9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6d6ffd700 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6d6ffd700 1 -- 172.21.15.151:0/2830841157 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d81a4d00 con 0x5621a94b0210 2023-07-21T22:37:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6d6ffd700 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b7130 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5621a94a5f30 tx=0x7ff6cc020e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c9a42d284c93e4e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6b6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:37:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/2830841157 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6cc017040 con 0x5621a94b0210 2023-07-21T22:37:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/2830841157 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff6cc020300 con 0x5621a94b0210 2023-07-21T22:37:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2830841157 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff6c809a240 con 0x5621a94b0210 2023-07-21T22:37:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/2830841157 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=64) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6cc0204c0 con 0x5621a94b0210 2023-07-21T22:37:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6f1689b80 10 client.27514 fetch_fsmap learned FSMap version 64 2023-07-21T22:37:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.895+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2830841157 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=64,monmap=4+}) v3 -- 0x5621a9212c00 con 0x5621a94b0210 2023-07-21T22:37:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.896+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/2830841157 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff6c809a240 con 0x5621a94b0210 2023-07-21T22:37:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.896+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/2830841157 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 64) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff6cc005320 con 0x5621a94b0210 2023-07-21T22:37:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.896+0000 7ff6f1689b80 10 client.27514 fetch_fsmap finished waiting for FSMap version 64 2023-07-21T22:37:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.896+0000 7ff6f1689b80 10 client.27514 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.896+0000 7ff6f1689b80 20 client.27514 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.896+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5621a9517e10 0x5621a951a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.896+0000 7ff6f1689b80 4 client.27514 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:37:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.896+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2830841157 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5621a93b6ff0 con 0x5621a9517e10 2023-07-21T22:37:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.897+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5621a9517e10 0x5621a951a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.897+0000 7ff6d77fe700 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5621a9517e10 0x5621a951a220 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7260b3230ba06eaf server_cookie=2798acf992a65889 in_seq=0 out_seq=0 2023-07-21T22:37:45.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.897+0000 7ff6b6ffd700 10 client.27514 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.908+0000 7ff6b6ffd700 1 -- 172.21.15.151:0/2830841157 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5621a93b6ff0 con 0x5621a9517e10 2023-07-21T22:37:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.908+0000 7ff6b6ffd700 10 client.27514 handle_command_reply: tid=0 2023-07-21T22:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.908+0000 7ff6f1689b80 1 client.27514 shutdown 2023-07-21T22:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.908+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2830841157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 msgr2=0x5621a94b7130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.908+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b7130 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x5621a94a5f30 tx=0x7ff6cc020e20 comp rx=0 tx=0).stop 2023-07-21T22:37:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.908+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2830841157 shutdown_connections 2023-07-21T22:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.908+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5621a9517e10 0x5621a951a220 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5621a94b0660 0x5621a94b7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5621a93066b0 0x5621a94b9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6b6ffd700 0 client.27514 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6f1689b80 1 --2- 172.21.15.151:0/2830841157 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5621a94b0210 0x5621a94b7130 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2830841157 >> 172.21.15.151:0/2830841157 conn(0x5621a949fae0 msgr2=0x5621a94b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2830841157 shutdown_connections 2023-07-21T22:37:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6f1689b80 1 -- 172.21.15.151:0/2830841157 wait complete. 2023-07-21T22:37:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6f1689b80 20 client.27514 trim_cache size 0 max 16384 2023-07-21T22:37:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:37:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:37:45.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:37:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:37:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6dddff700 1 -- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff6c00a12c0 msgr2=0x7ff6c00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6dddff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff6c00a12c0 0x7ff6c00a3770 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009790 tx=0x7ff6d00096c0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6dddff700 1 -- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d8072830 msgr2=0x7ff6d8197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.909+0000 7ff6dddff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d8072830 0x7ff6d8197ea0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7ff6c800e9a0 tx=0x7ff6c800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.910+0000 7ff6dddff700 1 -- 172.21.15.151:0/2519528870 shutdown_connections 2023-07-21T22:37:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.910+0000 7ff6dddff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff6c00a12c0 0x7ff6c00a3770 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.910+0000 7ff6dddff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6d810c3f0 0x7ff6d819ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.910+0000 7ff6dddff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6d8072830 0x7ff6d8197ea0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.910+0000 7ff6dddff700 1 --2- 172.21.15.151:0/2519528870 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff6d8073140 0x7ff6d81983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:45.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.910+0000 7ff6dddff700 1 -- 172.21.15.151:0/2519528870 >> 172.21.15.151:0/2519528870 conn(0x7ff6d80fb650 msgr2=0x7ff6d810e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.910+0000 7ff6dddff700 1 -- 172.21.15.151:0/2519528870 shutdown_connections 2023-07-21T22:37:45.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:45.910+0000 7ff6dddff700 1 -- 172.21.15.151:0/2519528870 wait complete. 2023-07-21T22:37:46.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:46 smithi187 ceph-mon[96918]: pgmap v584: 97 pgs: 97 active+clean; 9.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.7 MiB/s wr, 353 op/s 2023-07-21T22:37:46.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:46 smithi195 ceph-mon[97365]: pgmap v584: 97 pgs: 97 active+clean; 9.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.7 MiB/s wr, 353 op/s 2023-07-21T22:37:46.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:46 smithi151 ceph-mon[95510]: pgmap v584: 97 pgs: 97 active+clean; 9.4 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 2.7 MiB/s wr, 353 op/s 2023-07-21T22:37:48.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:48 smithi187 ceph-mon[96918]: pgmap v585: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.2 MiB/s wr, 548 op/s 2023-07-21T22:37:48.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:48 smithi195 ceph-mon[97365]: pgmap v585: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.2 MiB/s wr, 548 op/s 2023-07-21T22:37:48.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:48 smithi151 ceph-mon[95510]: pgmap v585: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 4.2 MiB/s wr, 548 op/s 2023-07-21T22:37:49.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:49 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:37:49.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:49 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:37:49.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:49 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:37:50.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:50 smithi187 ceph-mon[96918]: pgmap v586: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:37:50.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:50 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:37:50.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:50 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:37:50.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:50 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:37:50.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:50 smithi195 ceph-mon[97365]: pgmap v586: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:37:50.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:50 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:37:50.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:50 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:37:50.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:50 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:37:50.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:50 smithi151 ceph-mon[95510]: pgmap v586: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:37:50.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:50 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:37:50.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:50 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:37:50.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:50 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:37:52.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:52 smithi187 ceph-mon[96918]: pgmap v587: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:37:52.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:52 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:37:52.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:52 smithi195 ceph-mon[97365]: pgmap v587: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:37:52.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:52 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:37:52.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:52 smithi151 ceph-mon[95510]: pgmap v587: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:37:52.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:52 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:37:54.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:54 smithi187 ceph-mon[96918]: pgmap v588: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 4.6 MiB/s wr, 561 op/s 2023-07-21T22:37:54.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:54 smithi195 ceph-mon[97365]: pgmap v588: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 4.6 MiB/s wr, 561 op/s 2023-07-21T22:37:54.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:54 smithi151 ceph-mon[95510]: pgmap v588: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 4.6 MiB/s wr, 561 op/s 2023-07-21T22:37:56.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:56 smithi187 ceph-mon[96918]: pgmap v589: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 3.2 MiB/s wr, 376 op/s 2023-07-21T22:37:56.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:56 smithi195 ceph-mon[97365]: pgmap v589: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 3.2 MiB/s wr, 376 op/s 2023-07-21T22:37:56.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:56 smithi151 ceph-mon[95510]: pgmap v589: 97 pgs: 97 active+clean; 9.4 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 3.2 MiB/s wr, 376 op/s 2023-07-21T22:37:58.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:37:58 smithi187 ceph-mon[96918]: pgmap v590: 97 pgs: 97 active+clean; 9.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 4.6 MiB/s wr, 557 op/s 2023-07-21T22:37:58.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:37:58 smithi195 ceph-mon[97365]: pgmap v590: 97 pgs: 97 active+clean; 9.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 4.6 MiB/s wr, 557 op/s 2023-07-21T22:37:58.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:37:58 smithi151 ceph-mon[95510]: pgmap v590: 97 pgs: 97 active+clean; 9.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 4.6 MiB/s wr, 557 op/s 2023-07-21T22:37:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.822+0000 7f6b821ff700 1 -- 172.21.15.151:0/3661442163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ffb00 msgr2=0x7f6b7c0fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.822+0000 7f6b821ff700 1 --2- 172.21.15.151:0/3661442163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ffb00 0x7f6b7c0fff70 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009990 tx=0x7f6b70009ca0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.822+0000 7f6b821ff700 1 -- 172.21.15.151:0/3661442163 shutdown_connections 2023-07-21T22:37:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.822+0000 7f6b821ff700 1 --2- 172.21.15.151:0/3661442163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7c1004b0 0x7f6b7c10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.822+0000 7f6b821ff700 1 --2- 172.21.15.151:0/3661442163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b7c105b10 0x7f6b7c105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.822+0000 7f6b821ff700 1 --2- 172.21.15.151:0/3661442163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ffb00 0x7f6b7c0fff70 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.822+0000 7f6b821ff700 1 -- 172.21.15.151:0/3661442163 >> 172.21.15.151:0/3661442163 conn(0x7f6b7c0fb600 msgr2=0x7f6b7c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.822+0000 7f6b821ff700 1 -- 172.21.15.151:0/3661442163 shutdown_connections 2023-07-21T22:37:59.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.822+0000 7f6b821ff700 1 -- 172.21.15.151:0/3661442163 wait complete. 2023-07-21T22:37:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.823+0000 7f6b821ff700 1 Processor -- start 2023-07-21T22:37:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.823+0000 7f6b821ff700 1 -- start start 2023-07-21T22:37:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b821ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ffb00 0x7f6b7c19bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b821ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b7c1004b0 0x7f6b7c19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b821ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7c105b10 0x7f6b7c1959f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b821ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c196060 con 0x7f6b7c0ffb00 2023-07-21T22:37:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b821ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c1961d0 con 0x7f6b7c105b10 2023-07-21T22:37:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b821ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b7c196390 con 0x7f6b7c1004b0 2023-07-21T22:37:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b7c1004b0 0x7f6b7c19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ffb00 0x7f6b7c19bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b7c1004b0 0x7f6b7c19c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:59584/0 (socket says 172.21.15.151:59584) 2023-07-21T22:37:59.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7affd700 1 -- 172.21.15.151:0/1633985357 learned_addr learned my addr 172.21.15.151:0/1633985357 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7bfff700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7c105b10 0x7f6b7c1959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7affd700 1 -- 172.21.15.151:0/1633985357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7c105b10 msgr2=0x7f6b7c1959f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7affd700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7c105b10 0x7f6b7c1959f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7affd700 1 -- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ffb00 msgr2=0x7f6b7c19bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7affd700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ffb00 0x7f6b7c19bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7affd700 1 -- 172.21.15.151:0/1633985357 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700095f0 con 0x7f6b7c1004b0 2023-07-21T22:37:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.824+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ffb00 0x7f6b7c19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.825+0000 7f6b7affd700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b7c1004b0 0x7f6b7c19c0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b70000c00 tx=0x7f6b70004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:59.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.825+0000 7f6b78ff9700 1 -- 172.21.15.151:0/1633985357 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7001d070 con 0x7f6b7c1004b0 2023-07-21T22:37:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.825+0000 7f6b78ff9700 1 -- 172.21.15.151:0/1633985357 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b70022470 con 0x7f6b7c1004b0 2023-07-21T22:37:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.825+0000 7f6b821ff700 1 -- 172.21.15.151:0/1633985357 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b7c196610 con 0x7f6b7c1004b0 2023-07-21T22:37:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.825+0000 7f6b78ff9700 1 -- 172.21.15.151:0/1633985357 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70017650 con 0x7f6b7c1004b0 2023-07-21T22:37:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.825+0000 7f6b821ff700 1 -- 172.21.15.151:0/1633985357 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b7c1a2b80 con 0x7f6b7c1004b0 2023-07-21T22:37:59.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.829+0000 7f6b78ff9700 1 -- 172.21.15.151:0/1633985357 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6b700225e0 con 0x7f6b7c1004b0 2023-07-21T22:37:59.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.830+0000 7f6b95a27b80 1 Processor -- start 2023-07-21T22:37:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b95a27b80 1 -- start start 2023-07-21T22:37:59.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b78ff9700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6b640a12c0 0x7f6b640a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d47426b0 0x5609d48f00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b78ff9700 1 -- 172.21.15.151:0/1633985357 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6b700ce0f0 con 0x7f6b7c1004b0 2023-07-21T22:37:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d48f0620 0x5609d48ea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48ea8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d47ebc50 con 0x5609d48f0620 2023-07-21T22:37:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d483e9e0 con 0x5609d48f0a70 2023-07-21T22:37:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d4837e70 con 0x5609d47426b0 2023-07-21T22:37:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.831+0000 7f6b7bfff700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6b640a12c0 0x7f6b640a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d47426b0 0x5609d48f00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d47426b0 0x5609d48f00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:59598/0 (socket says 172.21.15.151:59598) 2023-07-21T22:37:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7b7fe700 1 -- 172.21.15.151:0/850170213 learned_addr learned my addr 172.21.15.151:0/850170213 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7bfff700 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48ea8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7affd700 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d48f0620 0x5609d48ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7b7fe700 1 -- 172.21.15.151:0/850170213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 msgr2=0x5609d48ea8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48ea8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7b7fe700 1 -- 172.21.15.151:0/850170213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d48f0620 msgr2=0x5609d48ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d48f0620 0x5609d48ea350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7b7fe700 1 -- 172.21.15.151:0/850170213 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609d4665d80 con 0x5609d47426b0 2023-07-21T22:37:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7affd700 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d48f0620 0x5609d48ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:37:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d47426b0 0x5609d48f00e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0115f0 tx=0x7f6b6c011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4b9c896cf5d0dd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:59.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b7bfff700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6b640a12c0 0x7f6b640a3770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009ec0 tx=0x7f6b74013480 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.832+0000 7f6b61ffb700 1 -- 172.21.15.151:0/850170213 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c019630 con 0x5609d47426b0 2023-07-21T22:37:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.833+0000 7f6b61ffb700 1 -- 172.21.15.151:0/850170213 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b6c019c20 con 0x5609d47426b0 2023-07-21T22:37:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.833+0000 7f6b61ffb700 1 -- 172.21.15.151:0/850170213 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c00eb40 con 0x5609d47426b0 2023-07-21T22:37:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.833+0000 7f6b95a27b80 1 -- 172.21.15.151:0/850170213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d47426b0 msgr2=0x5609d48f00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:59.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.833+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d47426b0 0x5609d48f00e0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c0115f0 tx=0x7f6b6c011900 comp rx=0 tx=0).stop 2023-07-21T22:37:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.834+0000 7f6b95a27b80 1 -- 172.21.15.151:0/850170213 shutdown_connections 2023-07-21T22:37:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.834+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48ea8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.834+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d47426b0 0x5609d48f00e0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.834+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/850170213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d48f0620 0x5609d48ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.834+0000 7f6b95a27b80 1 -- 172.21.15.151:0/850170213 >> 172.21.15.151:0/850170213 conn(0x5609d48dbae0 msgr2=0x5609d48e10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.834+0000 7f6b95a27b80 1 -- 172.21.15.151:0/850170213 shutdown_connections 2023-07-21T22:37:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.834+0000 7f6b95a27b80 1 -- 172.21.15.151:0/850170213 wait complete. 2023-07-21T22:37:59.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.834+0000 7f6b95a27b80 1 -- start start 2023-07-21T22:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.835+0000 7f6b95a27b80 1 Processor -- start 2023-07-21T22:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.835+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48f6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.835+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.835+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48f41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.835+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d47d7a60 con 0x5609d47426b0 2023-07-21T22:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.835+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d47d7760 con 0x5609d48f0a70 2023-07-21T22:37:59.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.835+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d46bb8c0 con 0x5609d48f0620 2023-07-21T22:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.835+0000 7f6b95a27b80 10 client.0 _ll_register_callbacks cb 0x5609d47d5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48f6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48f3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:59606/0 (socket says 172.21.15.151:59606) 2023-07-21T22:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7affd700 1 -- 172.21.15.151:0/2439564016 learned_addr learned my addr 172.21.15.151:0/2439564016 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7bfff700 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48f41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7affd700 1 -- 172.21.15.151:0/2439564016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 msgr2=0x5609d48f41b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:59.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7affd700 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48f41b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7affd700 1 -- 172.21.15.151:0/2439564016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 msgr2=0x5609d48f6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7affd700 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48f6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7affd700 1 -- 172.21.15.151:0/2439564016 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c009d50 con 0x5609d48f0620 2023-07-21T22:37:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b7affd700 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48f3ba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000f740 tx=0x7f6b7009add0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9e80fe6dd3a893f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.836+0000 7f6b5affd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:37:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b5affd700 1 -- 172.21.15.151:0/2439564016 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7009a900 con 0x5609d48f0620 2023-07-21T22:37:59.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b5affd700 1 -- 172.21.15.151:0/2439564016 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6b700228c0 con 0x5609d48f0620 2023-07-21T22:37:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b95a27b80 1 -- 172.21.15.151:0/2439564016 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5609d4791490 con 0x5609d48f0620 2023-07-21T22:37:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b5affd700 1 -- 172.21.15.151:0/2439564016 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b7009f030 con 0x5609d48f0620 2023-07-21T22:37:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b95a27b80 10 client.27526 fetch_fsmap learned FSMap version 66 2023-07-21T22:37:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b95a27b80 1 -- 172.21.15.151:0/2439564016 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5609d464ec00 con 0x5609d48f0620 2023-07-21T22:37:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b5affd700 1 -- 172.21.15.151:0/2439564016 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5609d4791490 con 0x5609d48f0620 2023-07-21T22:37:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b5affd700 1 -- 172.21.15.151:0/2439564016 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 66) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6b700b9240 con 0x5609d48f0620 2023-07-21T22:37:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b95a27b80 10 client.27526 fetch_fsmap finished waiting for FSMap version 66 2023-07-21T22:37:59.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b95a27b80 10 client.27526 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b95a27b80 20 client.27526 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5609d4903b70 0x5609d4905f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b95a27b80 4 client.27526 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.837+0000 7f6b95a27b80 1 -- 172.21.15.151:0/2439564016 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5609d4830e50 con 0x5609d4903b70 2023-07-21T22:37:59.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.838+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5609d4903b70 0x5609d4905f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.838+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5609d4903b70 0x5609d4905f80 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d3abe23a248d90c server_cookie=999fc1cd285c9707 in_seq=0 out_seq=0 2023-07-21T22:37:59.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.838+0000 7f6b5affd700 10 client.27526 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b5affd700 1 -- 172.21.15.151:0/2439564016 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5609d4830e50 con 0x5609d4903b70 2023-07-21T22:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b5affd700 10 client.27526 handle_command_reply: tid=0 2023-07-21T22:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b95a27b80 1 client.27526 shutdown 2023-07-21T22:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b95a27b80 1 -- 172.21.15.151:0/2439564016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 msgr2=0x5609d48f3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48f3ba0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6b7000f740 tx=0x7f6b7009add0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b95a27b80 1 -- 172.21.15.151:0/2439564016 shutdown_connections 2023-07-21T22:37:59.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5609d4903b70 0x5609d4905f80 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48f41b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48f6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b5affd700 0 client.27526 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.839+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/2439564016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48f3ba0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.840+0000 7f6b95a27b80 1 -- 172.21.15.151:0/2439564016 >> 172.21.15.151:0/2439564016 conn(0x5609d48dbae0 msgr2=0x5609d48e03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.840+0000 7f6b95a27b80 1 -- 172.21.15.151:0/2439564016 shutdown_connections 2023-07-21T22:37:59.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.840+0000 7f6b95a27b80 1 -- 172.21.15.151:0/2439564016 wait complete. 2023-07-21T22:37:59.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.840+0000 7f6b95a27b80 20 client.27526 trim_cache size 0 max 16384 2023-07-21T22:37:59.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b95a27b80 1 Processor -- start 2023-07-21T22:37:59.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b95a27b80 1 -- start start 2023-07-21T22:37:59.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48eab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0620 0x5609d48f1740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0a70 0x5609d48fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d4830e50 con 0x5609d47426b0 2023-07-21T22:37:59.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d4791490 con 0x5609d48f0620 2023-07-21T22:37:59.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d48eb360 con 0x5609d48f0a70 2023-07-21T22:37:59.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b7b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48eab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b7b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48eab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47984/0 (socket says 172.21.15.151:47984) 2023-07-21T22:37:59.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b7b7fe700 1 -- 172.21.15.151:0/28842112 learned_addr learned my addr 172.21.15.151:0/28842112 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:59.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b7affd700 1 --2- 172.21.15.151:0/28842112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0620 0x5609d48f1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.858+0000 7f6b7bfff700 1 --2- 172.21.15.151:0/28842112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0a70 0x5609d48fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.859+0000 7f6b7b7fe700 1 -- 172.21.15.151:0/28842112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0a70 msgr2=0x5609d48fafb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.859+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/28842112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0a70 0x5609d48fafb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.859+0000 7f6b7b7fe700 1 -- 172.21.15.151:0/28842112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0620 msgr2=0x5609d48f1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.859+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/28842112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0620 0x5609d48f1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.859+0000 7f6b7b7fe700 1 -- 172.21.15.151:0/28842112 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5609d468c1f0 con 0x5609d47426b0 2023-07-21T22:37:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.859+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/28842112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48eab30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c01c040 tx=0x7f6b6c011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09f9cb57b579373 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.859+0000 7f6b627fc700 1 -- 172.21.15.151:0/28842112 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c02e070 con 0x5609d47426b0 2023-07-21T22:37:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.859+0000 7f6b627fc700 1 -- 172.21.15.151:0/28842112 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b6c005ce0 con 0x5609d47426b0 2023-07-21T22:37:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.859+0000 7f6b627fc700 1 -- 172.21.15.151:0/28842112 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6c029a50 con 0x5609d47426b0 2023-07-21T22:37:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.860+0000 7f6b95a27b80 1 -- 172.21.15.151:0/28842112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 msgr2=0x5609d48eab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.860+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/28842112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48eab30 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c01c040 tx=0x7f6b6c011900 comp rx=0 tx=0).stop 2023-07-21T22:37:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.860+0000 7f6b95a27b80 1 -- 172.21.15.151:0/28842112 shutdown_connections 2023-07-21T22:37:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.860+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/28842112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0a70 0x5609d48fafb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.860+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/28842112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48eab30 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.860+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/28842112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0620 0x5609d48f1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.860+0000 7f6b95a27b80 1 -- 172.21.15.151:0/28842112 >> 172.21.15.151:0/28842112 conn(0x5609d48dbae0 msgr2=0x5609d48f2350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.860+0000 7f6b95a27b80 1 -- 172.21.15.151:0/28842112 shutdown_connections 2023-07-21T22:37:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.860+0000 7f6b95a27b80 1 -- 172.21.15.151:0/28842112 wait complete. 2023-07-21T22:37:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.861+0000 7f6b95a27b80 1 -- start start 2023-07-21T22:37:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.861+0000 7f6b95a27b80 1 Processor -- start 2023-07-21T22:37:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48fafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48ebc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b95a27b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48ec1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d48ec770 con 0x5609d47426b0 2023-07-21T22:37:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d48ec8e0 con 0x5609d48f0a70 2023-07-21T22:37:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b95a27b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5609d48ecaa0 con 0x5609d48f0620 2023-07-21T22:37:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b95a27b80 10 client.0 _ll_register_callbacks cb 0x7f6b700cbf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:37:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48ebc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48fafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48ebc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:59636/0 (socket says 172.21.15.151:59636) 2023-07-21T22:37:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7affd700 1 -- 172.21.15.151:0/1138375367 learned_addr learned my addr 172.21.15.151:0/1138375367 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:37:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7bfff700 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48ec1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7affd700 1 -- 172.21.15.151:0/1138375367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 msgr2=0x5609d48ec1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7affd700 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48ec1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7affd700 1 -- 172.21.15.151:0/1138375367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 msgr2=0x5609d48fafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:37:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7affd700 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48fafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.862+0000 7f6b7affd700 1 -- 172.21.15.151:0/1138375367 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5609d4665d80 con 0x5609d48f0620 2023-07-21T22:37:59.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:37:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b7affd700 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48ebc60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6b70004800 tx=0x7f6b70097000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=597d0104d5a9c03 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:37:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b5affd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:37:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b5affd700 1 -- 172.21.15.151:0/1138375367 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7009a900 con 0x5609d48f0620 2023-07-21T22:37:59.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b5affd700 1 -- 172.21.15.151:0/1138375367 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6b700228c0 con 0x5609d48f0620 2023-07-21T22:37:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b95a27b80 1 -- 172.21.15.151:0/1138375367 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6b6c019c20 con 0x5609d48f0620 2023-07-21T22:37:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b5affd700 1 -- 172.21.15.151:0/1138375367 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b7009f240 con 0x5609d48f0620 2023-07-21T22:37:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b95a27b80 10 client.27532 fetch_fsmap learned FSMap version 66 2023-07-21T22:37:59.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b95a27b80 1 -- 172.21.15.151:0/1138375367 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) v3 -- 0x5609d4664250 con 0x5609d48f0620 2023-07-21T22:37:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.863+0000 7f6b5affd700 1 -- 172.21.15.151:0/1138375367 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6b6c019c20 con 0x5609d48f0620 2023-07-21T22:37:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.864+0000 7f6b5affd700 1 -- 172.21.15.151:0/1138375367 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 66) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f6b7000fac0 con 0x5609d48f0620 2023-07-21T22:37:59.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.864+0000 7f6b95a27b80 10 client.27532 fetch_fsmap finished waiting for FSMap version 66 2023-07-21T22:37:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.864+0000 7f6b95a27b80 10 client.27532 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:37:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.864+0000 7f6b95a27b80 20 client.27532 populate_metadata read hostname 'smithi151' 2023-07-21T22:37:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.864+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5609d4958b70 0x5609d495af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:37:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.864+0000 7f6b95a27b80 4 client.27532 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:37:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.864+0000 7f6b95a27b80 1 -- 172.21.15.151:0/1138375367 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5609d47f2ff0 con 0x5609d4958b70 2023-07-21T22:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.864+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5609d4958b70 0x5609d495af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.865+0000 7f6b7b7fe700 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5609d4958b70 0x5609d495af80 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2836590cef48114e server_cookie=a5865d7b1aafad88 in_seq=0 out_seq=0 2023-07-21T22:37:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.865+0000 7f6b5affd700 10 client.27532 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b5affd700 1 -- 172.21.15.151:0/1138375367 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5609d47f2ff0 con 0x5609d4958b70 2023-07-21T22:37:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b5affd700 10 client.27532 handle_command_reply: tid=0 2023-07-21T22:37:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 client.27532 shutdown 2023-07-21T22:37:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 -- 172.21.15.151:0/1138375367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 msgr2=0x5609d48ebc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48ebc60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6b70004800 tx=0x7f6b70097000 comp rx=0 tx=0).stop 2023-07-21T22:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 -- 172.21.15.151:0/1138375367 shutdown_connections 2023-07-21T22:37:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5609d4958b70 0x5609d495af80 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5609d48f0a70 0x5609d48ec1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5609d47426b0 0x5609d48fafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b5affd700 0 client.27532 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:37:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 --2- 172.21.15.151:0/1138375367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5609d48f0620 0x5609d48ebc60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 -- 172.21.15.151:0/1138375367 >> 172.21.15.151:0/1138375367 conn(0x5609d48dbae0 msgr2=0x5609d48e57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.877+0000 7f6b95a27b80 1 -- 172.21.15.151:0/1138375367 shutdown_connections 2023-07-21T22:37:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.878+0000 7f6b95a27b80 1 -- 172.21.15.151:0/1138375367 wait complete. 2023-07-21T22:37:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.878+0000 7f6b95a27b80 20 client.27532 trim_cache size 0 max 16384 2023-07-21T22:37:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:37:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.878+0000 7f6b821ff700 1 -- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6b640a12c0 msgr2=0x7f6b640a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.878+0000 7f6b821ff700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6b640a12c0 0x7f6b640a3770 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009ec0 tx=0x7f6b74013480 comp rx=0 tx=0).stop 2023-07-21T22:37:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.878+0000 7f6b821ff700 1 -- 172.21.15.151:0/1633985357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b7c1004b0 msgr2=0x7f6b7c19c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.878+0000 7f6b821ff700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b7c1004b0 0x7f6b7c19c0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f6b70000c00 tx=0x7f6b70004730 comp rx=0 tx=0).stop 2023-07-21T22:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.879+0000 7f6b821ff700 1 -- 172.21.15.151:0/1633985357 shutdown_connections 2023-07-21T22:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.879+0000 7f6b821ff700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6b640a12c0 0x7f6b640a3770 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.879+0000 7f6b821ff700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b7c105b10 0x7f6b7c1959f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.879+0000 7f6b821ff700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b7c0ffb00 0x7f6b7c19bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.879+0000 7f6b821ff700 1 --2- 172.21.15.151:0/1633985357 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6b7c1004b0 0x7f6b7c19c0d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:37:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.879+0000 7f6b821ff700 1 -- 172.21.15.151:0/1633985357 >> 172.21.15.151:0/1633985357 conn(0x7f6b7c0fb600 msgr2=0x7f6b7c0fbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.879+0000 7f6b821ff700 1 -- 172.21.15.151:0/1633985357 shutdown_connections 2023-07-21T22:37:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:37:59.879+0000 7f6b821ff700 1 -- 172.21.15.151:0/1633985357 wait complete. 2023-07-21T22:38:00.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:00 smithi187 ceph-mon[96918]: pgmap v591: 97 pgs: 97 active+clean; 9.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 3.1 MiB/s wr, 362 op/s 2023-07-21T22:38:00.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:00 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:00.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:00 smithi195 ceph-mon[97365]: pgmap v591: 97 pgs: 97 active+clean; 9.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 3.1 MiB/s wr, 362 op/s 2023-07-21T22:38:00.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:00 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:00.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:00 smithi151 ceph-mon[95510]: pgmap v591: 97 pgs: 97 active+clean; 9.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 3.1 MiB/s wr, 362 op/s 2023-07-21T22:38:00.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:00 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:02.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:02 smithi187 ceph-mon[96918]: pgmap v592: 97 pgs: 97 active+clean; 9.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 3.1 MiB/s wr, 362 op/s 2023-07-21T22:38:02.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:02 smithi195 ceph-mon[97365]: pgmap v592: 97 pgs: 97 active+clean; 9.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 3.1 MiB/s wr, 362 op/s 2023-07-21T22:38:02.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:02 smithi151 ceph-mon[95510]: pgmap v592: 97 pgs: 97 active+clean; 9.4 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 3.1 MiB/s wr, 362 op/s 2023-07-21T22:38:04.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:04 smithi187 ceph-mon[96918]: pgmap v593: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 4.5 MiB/s wr, 540 op/s 2023-07-21T22:38:04.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:04 smithi195 ceph-mon[97365]: pgmap v593: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 4.5 MiB/s wr, 540 op/s 2023-07-21T22:38:04.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:04 smithi151 ceph-mon[95510]: pgmap v593: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 172 KiB/s rd, 4.5 MiB/s wr, 540 op/s 2023-07-21T22:38:05.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:05 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:05.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:05 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:05.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:05 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:06.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:06 smithi187 ceph-mon[96918]: pgmap v594: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 2.7 MiB/s wr, 358 op/s 2023-07-21T22:38:06.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:06 smithi195 ceph-mon[97365]: pgmap v594: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 2.7 MiB/s wr, 358 op/s 2023-07-21T22:38:06.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:06 smithi151 ceph-mon[95510]: pgmap v594: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 2.7 MiB/s wr, 358 op/s 2023-07-21T22:38:07.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:07 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:07.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:07 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:07.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:07 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:08.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:08 smithi187 ceph-mon[96918]: pgmap v595: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 4.2 MiB/s wr, 555 op/s 2023-07-21T22:38:08.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:08 smithi195 ceph-mon[97365]: pgmap v595: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 4.2 MiB/s wr, 555 op/s 2023-07-21T22:38:08.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:08 smithi151 ceph-mon[95510]: pgmap v595: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 4.2 MiB/s wr, 555 op/s 2023-07-21T22:38:10.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:10 smithi187 ceph-mon[96918]: pgmap v596: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 2.8 MiB/s wr, 374 op/s 2023-07-21T22:38:10.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:10 smithi195 ceph-mon[97365]: pgmap v596: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 2.8 MiB/s wr, 374 op/s 2023-07-21T22:38:10.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:10 smithi151 ceph-mon[95510]: pgmap v596: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 2.8 MiB/s wr, 374 op/s 2023-07-21T22:38:12.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:12 smithi187 ceph-mon[96918]: pgmap v597: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 2.8 MiB/s wr, 375 op/s 2023-07-21T22:38:12.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:12 smithi195 ceph-mon[97365]: pgmap v597: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 2.8 MiB/s wr, 375 op/s 2023-07-21T22:38:12.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:12 smithi151 ceph-mon[95510]: pgmap v597: 97 pgs: 97 active+clean; 9.4 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 2.8 MiB/s wr, 375 op/s 2023-07-21T22:38:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.065+0000 7fe1c61ff700 1 -- 172.21.15.151:0/2850789158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1c00ffb50 msgr2=0x7fe1c00fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.065+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/2850789158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1c00ffb50 0x7fe1c00fffc0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fe1b4009990 tx=0x7fe1b4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.065+0000 7fe1c61ff700 1 -- 172.21.15.151:0/2850789158 shutdown_connections 2023-07-21T22:38:13.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.065+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/2850789158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c0105b80 0x7fe1c0105f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.065+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/2850789158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1c0100500 0x7fe1c010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.065+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/2850789158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1c00ffb50 0x7fe1c00fffc0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.065+0000 7fe1c61ff700 1 -- 172.21.15.151:0/2850789158 >> 172.21.15.151:0/2850789158 conn(0x7fe1c00fb650 msgr2=0x7fe1c00fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.065+0000 7fe1c61ff700 1 -- 172.21.15.151:0/2850789158 shutdown_connections 2023-07-21T22:38:13.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.065+0000 7fe1c61ff700 1 -- 172.21.15.151:0/2850789158 wait complete. 2023-07-21T22:38:13.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.066+0000 7fe1c61ff700 1 Processor -- start 2023-07-21T22:38:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.066+0000 7fe1c61ff700 1 -- start start 2023-07-21T22:38:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.066+0000 7fe1c61ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c00ffb50 0x7fe1c019dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.066+0000 7fe1c61ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1c0100500 0x7fe1c019e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1c61ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1c0105b80 0x7fe1c0197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1c61ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01981b0 con 0x7fe1c0105b80 2023-07-21T22:38:13.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1c61ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c0198320 con 0x7fe1c00ffb50 2023-07-21T22:38:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1c61ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1c01984e0 con 0x7fe1c0100500 2023-07-21T22:38:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c00ffb50 0x7fe1c019dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1beffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1c0100500 0x7fe1c019e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c00ffb50 0x7fe1c019dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38212/0 (socket says 172.21.15.151:38212) 2023-07-21T22:38:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/4142579596 learned_addr learned my addr 172.21.15.151:0/4142579596 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1bffff700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1c0105b80 0x7fe1c0197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/4142579596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1c0100500 msgr2=0x7fe1c019e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1c0100500 0x7fe1c019e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1c0105b80 msgr2=0x7fe1c0197b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1c0105b80 0x7fe1c0197b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/4142579596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b40095f0 con 0x7fe1c00ffb50 2023-07-21T22:38:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.067+0000 7fe1beffd700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1c0100500 0x7fe1c019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:13.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.068+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c00ffb50 0x7fe1c019dce0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000e9a0 tx=0x7fe1b000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.068+0000 7fe1bcff9700 1 -- 172.21.15.151:0/4142579596 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0009790 con 0x7fe1c00ffb50 2023-07-21T22:38:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.068+0000 7fe1c61ff700 1 -- 172.21.15.151:0/4142579596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c01987c0 con 0x7fe1c00ffb50 2023-07-21T22:38:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.068+0000 7fe1bcff9700 1 -- 172.21.15.151:0/4142579596 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1b0010430 con 0x7fe1c00ffb50 2023-07-21T22:38:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.068+0000 7fe1bcff9700 1 -- 172.21.15.151:0/4142579596 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b000cea0 con 0x7fe1c00ffb50 2023-07-21T22:38:13.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.068+0000 7fe1c61ff700 1 -- 172.21.15.151:0/4142579596 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c01a4cd0 con 0x7fe1c00ffb50 2023-07-21T22:38:13.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.073+0000 7fe1bcff9700 1 -- 172.21.15.151:0/4142579596 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fe1b00105a0 con 0x7fe1c00ffb50 2023-07-21T22:38:13.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.074+0000 7fe1d9bfab80 1 Processor -- start 2023-07-21T22:38:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.074+0000 7fe1d9bfab80 1 -- start start 2023-07-21T22:38:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.074+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546aaecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.074+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546aa8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.074+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf660 0x55e546aa94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.074+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5469aec50 con 0x55e546aaf210 2023-07-21T22:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.074+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e546a019e0 con 0x55e546aaf660 2023-07-21T22:38:13.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.074+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e5469fae70 con 0x55e5469056b0 2023-07-21T22:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546aaecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546aa8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546aaecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46830/0 (socket says 172.21.15.151:46830) 2023-07-21T22:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bffff700 1 -- 172.21.15.151:0/2665233385 learned_addr learned my addr 172.21.15.151:0/2665233385 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1beffd700 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf660 0x55e546aa94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bcff9700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1a80a12c0 0x7fe1a80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bcff9700 1 -- 172.21.15.151:0/4142579596 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe1b0014070 con 0x7fe1c00ffb50 2023-07-21T22:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/2665233385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 msgr2=0x55e546aaecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546aaecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/2665233385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf660 msgr2=0x55e546aa94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf660 0x55e546aa94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/2665233385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e546828d80 con 0x55e546aaf210 2023-07-21T22:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bffff700 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546aaecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1beffd700 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf660 0x55e546aa94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.075+0000 7fe1bffff700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1a80a12c0 0x7fe1a80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.076+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546aa8f40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00ca6c0 tx=0x7fe1b0010a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6d6bf1dbde36801 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.076+0000 7fe1a5ffb700 1 -- 172.21.15.151:0/2665233385 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00999a0 con 0x55e546aaf210 2023-07-21T22:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.076+0000 7fe1a5ffb700 1 -- 172.21.15.151:0/2665233385 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1b0010880 con 0x55e546aaf210 2023-07-21T22:38:13.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.076+0000 7fe1a5ffb700 1 -- 172.21.15.151:0/2665233385 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b009a500 con 0x55e546aaf210 2023-07-21T22:38:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2665233385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 msgr2=0x55e546aa8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1bffff700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1a80a12c0 0x7fe1a80a3770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80076a0 tx=0x7fe1b8009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546aa8f40 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fe1b00ca6c0 tx=0x7fe1b0010a70 comp rx=0 tx=0).stop 2023-07-21T22:38:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2665233385 shutdown_connections 2023-07-21T22:38:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf660 0x55e546aa94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546aaecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2665233385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546aa8f40 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2665233385 >> 172.21.15.151:0/2665233385 conn(0x55e546a9eae0 msgr2=0x55e546aa40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2665233385 shutdown_connections 2023-07-21T22:38:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.077+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2665233385 wait complete. 2023-07-21T22:38:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.078+0000 7fe1d9bfab80 1 -- start start 2023-07-21T22:38:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.078+0000 7fe1d9bfab80 1 Processor -- start 2023-07-21T22:38:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.078+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.078+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf210 0x55e546ab8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.078+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 0x55e546ab2840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.078+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54699aa60 con 0x55e546aaf660 2023-07-21T22:38:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.078+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54699a760 con 0x55e5469056b0 2023-07-21T22:38:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.078+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e54687e8c0 con 0x55e546aaf210 2023-07-21T22:38:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.078+0000 7fe1d9bfab80 10 client.0 _ll_register_callbacks cb 0x55e546998700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1beffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf210 0x55e546ab8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38218/0 (socket says 172.21.15.151:38218) 2023-07-21T22:38:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 0x55e546ab2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1beffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf210 0x55e546ab8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46832/0 (socket says 172.21.15.151:46832) 2023-07-21T22:38:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/2285464006 learned_addr learned my addr 172.21.15.151:0/2285464006 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/2285464006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf210 msgr2=0x55e546ab8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf210 0x55e546ab8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/2285464006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 msgr2=0x55e546ab2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 0x55e546ab2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/2285464006 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1b8011300 con 0x55e5469056b0 2023-07-21T22:38:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab8540 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0096ab0 tx=0x7fe1b009a4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=896ac080595f7d7f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.079+0000 7fe19effd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:38:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe19effd700 1 -- 172.21.15.151:0/2285464006 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00999a0 con 0x55e5469056b0 2023-07-21T22:38:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe19effd700 1 -- 172.21.15.151:0/2285464006 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe1b009a040 con 0x55e5469056b0 2023-07-21T22:38:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2285464006 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e546954490 con 0x55e5469056b0 2023-07-21T22:38:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe19effd700 1 -- 172.21.15.151:0/2285464006 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1b00a2210 con 0x55e5469056b0 2023-07-21T22:38:13.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe1d9bfab80 10 client.27518 fetch_fsmap learned FSMap version 68 2023-07-21T22:38:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2285464006 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x7fe1c010d240 con 0x55e5469056b0 2023-07-21T22:38:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe19effd700 1 -- 172.21.15.151:0/2285464006 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e546954490 con 0x55e5469056b0 2023-07-21T22:38:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe19effd700 1 -- 172.21.15.151:0/2285464006 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 68) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe1b0098fa0 con 0x55e5469056b0 2023-07-21T22:38:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe1d9bfab80 10 client.27518 fetch_fsmap finished waiting for FSMap version 68 2023-07-21T22:38:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe1d9bfab80 10 client.27518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:38:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe1d9bfab80 20 client.27518 populate_metadata read hostname 'smithi151' 2023-07-21T22:38:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e546ac2780 0x55e546ac4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe1d9bfab80 4 client.27518 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:38:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.080+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2285464006 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e5469f3e50 con 0x55e546ac2780 2023-07-21T22:38:13.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.081+0000 7fe1beffd700 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e546ac2780 0x55e546ac4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.082+0000 7fe1beffd700 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e546ac2780 0x55e546ac4b60 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a68889f602137b1f server_cookie=c891e05f9fff1854 in_seq=0 out_seq=0 2023-07-21T22:38:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.082+0000 7fe19effd700 10 client.27518 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.082+0000 7fe19effd700 1 -- 172.21.15.151:0/2285464006 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e5469f3e50 con 0x55e546ac2780 2023-07-21T22:38:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.082+0000 7fe19effd700 10 client.27518 handle_command_reply: tid=0 2023-07-21T22:38:13.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.082+0000 7fe1d9bfab80 1 client.27518 shutdown 2023-07-21T22:38:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2285464006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 msgr2=0x55e546ab8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab8540 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0096ab0 tx=0x7fe1b009a4d0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2285464006 shutdown_connections 2023-07-21T22:38:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e546ac2780 0x55e546ac4b60 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab8540 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 0x55e546ab2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe19effd700 0 client.27518 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:13.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/2285464006 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf210 0x55e546ab8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2285464006 >> 172.21.15.151:0/2285464006 conn(0x55e546a9eae0 msgr2=0x55e546aa33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2285464006 shutdown_connections 2023-07-21T22:38:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/2285464006 wait complete. 2023-07-21T22:38:13.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.083+0000 7fe1d9bfab80 20 client.27518 trim_cache size 0 max 16384 2023-07-21T22:38:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.099+0000 7fe1d9bfab80 1 Processor -- start 2023-07-21T22:38:13.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.099+0000 7fe1d9bfab80 1 -- start start 2023-07-21T22:38:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.099+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546ab27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.099+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf210 0x55e546aa3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.099+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 0x55e546aa40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e546aaa160 con 0x55e546aaf660 2023-07-21T22:38:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e546ab37f0 con 0x55e546aaf210 2023-07-21T22:38:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e546ab0dc0 con 0x55e5469056b0 2023-07-21T22:38:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546ab27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546ab27f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46846/0 (socket says 172.21.15.151:46846) 2023-07-21T22:38:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1bffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 0x55e546aa40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/86558289 learned_addr learned my addr 172.21.15.151:0/86558289 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:13.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1beffd700 1 --2- 172.21.15.151:0/86558289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf210 0x55e546aa3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/86558289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf210 msgr2=0x55e546aa3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/86558289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf210 0x55e546aa3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/86558289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 msgr2=0x55e546aa40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/86558289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 0x55e546aa40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.100+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/86558289 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c01a4cd0 con 0x55e5469056b0 2023-07-21T22:38:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.101+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/86558289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546ab27f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000c2d0 tx=0x7fe1b0010a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c68217b3f3bf5224 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.101+0000 7fe1a67fc700 1 -- 172.21.15.151:0/86558289 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b0099b80 con 0x55e5469056b0 2023-07-21T22:38:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.101+0000 7fe1a67fc700 1 -- 172.21.15.151:0/86558289 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1b009a040 con 0x55e5469056b0 2023-07-21T22:38:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.101+0000 7fe1a67fc700 1 -- 172.21.15.151:0/86558289 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00ca560 con 0x55e5469056b0 2023-07-21T22:38:13.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/86558289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 msgr2=0x55e546ab27f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/86558289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546ab27f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000c2d0 tx=0x7fe1b0010a70 comp rx=0 tx=0).stop 2023-07-21T22:38:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/86558289 shutdown_connections 2023-07-21T22:38:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/86558289 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf660 0x55e546aa40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/86558289 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e5469056b0 0x55e546ab27f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/86558289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e546aaf210 0x55e546aa3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/86558289 >> 172.21.15.151:0/86558289 conn(0x55e546a9eae0 msgr2=0x55e546ab20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:13.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/86558289 shutdown_connections 2023-07-21T22:38:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/86558289 wait complete. 2023-07-21T22:38:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.102+0000 7fe1d9bfab80 1 -- start start 2023-07-21T22:38:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1d9bfab80 1 Processor -- start 2023-07-21T22:38:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546ab6690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1d9bfab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf660 0x55e546ab6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e546b157c0 con 0x55e546aaf210 2023-07-21T22:38:13.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e546b15930 con 0x55e5469056b0 2023-07-21T22:38:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1d9bfab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e546b15af0 con 0x55e546aaf660 2023-07-21T22:38:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1d9bfab80 10 client.0 _ll_register_callbacks cb 0x7fe1b0005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546ab6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab6150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38238/0 (socket says 172.21.15.151:38238) 2023-07-21T22:38:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.103+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/151331433 learned_addr learned my addr 172.21.15.151:0/151331433 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:13.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1bffff700 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf660 0x55e546ab6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/151331433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf660 msgr2=0x55e546ab6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf660 0x55e546ab6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/151331433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 msgr2=0x55e546ab6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546ab6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1bf7fe700 1 -- 172.21.15.151:0/151331433 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1c010d240 con 0x55e5469056b0 2023-07-21T22:38:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1beffd700 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546ab6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:13.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1bffff700 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf660 0x55e546ab6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1bf7fe700 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab6150 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0099320 tx=0x7fe1b0099e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93a329192b340f35 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:13.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe19effd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:38:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe19effd700 1 -- 172.21.15.151:0/151331433 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1b00b82f0 con 0x55e5469056b0 2023-07-21T22:38:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe19effd700 1 -- 172.21.15.151:0/151331433 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(112..112 src has 1..112) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe1b009e070 con 0x55e5469056b0 2023-07-21T22:38:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.104+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/151331433 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe1b0010880 con 0x55e5469056b0 2023-07-21T22:38:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe19effd700 1 -- 172.21.15.151:0/151331433 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1b00b8450 con 0x55e5469056b0 2023-07-21T22:38:13.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe1d9bfab80 10 client.27524 fetch_fsmap learned FSMap version 68 2023-07-21T22:38:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/151331433 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=4+}) v3 -- 0x55e546811c00 con 0x55e5469056b0 2023-07-21T22:38:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe19effd700 1 -- 172.21.15.151:0/151331433 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1b0010880 con 0x55e5469056b0 2023-07-21T22:38:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe19effd700 1 -- 172.21.15.151:0/151331433 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 68) v1 ==== 7474+0+0 (secure 0 0 0) 0x7fe1b009af80 con 0x55e5469056b0 2023-07-21T22:38:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe1d9bfab80 10 client.27524 fetch_fsmap finished waiting for FSMap version 68 2023-07-21T22:38:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe1d9bfab80 10 client.27524 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:38:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe1d9bfab80 20 client.27524 populate_metadata read hostname 'smithi151' 2023-07-21T22:38:13.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e546b16d50 0x55e546b19130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe1d9bfab80 4 client.27524 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:38:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.105+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/151331433 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e5469b5ff0 con 0x55e546b16d50 2023-07-21T22:38:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.106+0000 7fe1beffd700 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e546b16d50 0x55e546b19130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.106+0000 7fe1beffd700 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e546b16d50 0x55e546b19130 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=587d788748f38f09 server_cookie=75cf72e035c1d77c in_seq=0 out_seq=0 2023-07-21T22:38:13.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.106+0000 7fe19effd700 10 client.27524 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe19effd700 1 -- 172.21.15.151:0/151331433 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e5469b5ff0 con 0x55e546b16d50 2023-07-21T22:38:13.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe19effd700 10 client.27524 handle_command_reply: tid=0 2023-07-21T22:38:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 client.27524 shutdown 2023-07-21T22:38:13.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/151331433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 msgr2=0x55e546ab6150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab6150 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fe1b0099320 tx=0x7fe1b0099e30 comp rx=0 tx=0).stop 2023-07-21T22:38:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/151331433 shutdown_connections 2023-07-21T22:38:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e546b16d50 0x55e546b19130 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e5469056b0 0x55e546ab6150 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e546aaf660 0x55e546ab6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe19effd700 0 client.27524 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:13.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 --2- 172.21.15.151:0/151331433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e546aaf210 0x55e546ab6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/151331433 >> 172.21.15.151:0/151331433 conn(0x55e546a9eae0 msgr2=0x55e546ab02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/151331433 shutdown_connections 2023-07-21T22:38:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 1 -- 172.21.15.151:0/151331433 wait complete. 2023-07-21T22:38:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.119+0000 7fe1d9bfab80 20 client.27524 trim_cache size 0 max 16384 2023-07-21T22:38:13.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:38:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:38:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:38:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:38:13.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 -- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1a80a12c0 msgr2=0x7fe1a80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1a80a12c0 0x7fe1a80a3770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe1b80076a0 tx=0x7fe1b8009040 comp rx=0 tx=0).stop 2023-07-21T22:38:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 -- 172.21.15.151:0/4142579596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c00ffb50 msgr2=0x7fe1c019dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c00ffb50 0x7fe1c019dce0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe1b000e9a0 tx=0x7fe1b000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 -- 172.21.15.151:0/4142579596 shutdown_connections 2023-07-21T22:38:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1a80a12c0 0x7fe1a80a3770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1c00ffb50 0x7fe1c019dce0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1c0105b80 0x7fe1c0197b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 --2- 172.21.15.151:0/4142579596 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe1c0100500 0x7fe1c019e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 -- 172.21.15.151:0/4142579596 >> 172.21.15.151:0/4142579596 conn(0x7fe1c00fb650 msgr2=0x7fe1c00fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 -- 172.21.15.151:0/4142579596 shutdown_connections 2023-07-21T22:38:13.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:13.120+0000 7fe1c61ff700 1 -- 172.21.15.151:0/4142579596 wait complete. 2023-07-21T22:38:14.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:14 smithi187 ceph-mon[96918]: pgmap v598: 97 pgs: 97 active+clean; 9.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 4.0 MiB/s wr, 528 op/s 2023-07-21T22:38:14.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:14 smithi195 ceph-mon[97365]: pgmap v598: 97 pgs: 97 active+clean; 9.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 4.0 MiB/s wr, 528 op/s 2023-07-21T22:38:14.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:14 smithi151 ceph-mon[95510]: pgmap v598: 97 pgs: 97 active+clean; 9.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 4.0 MiB/s wr, 528 op/s 2023-07-21T22:38:15.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:15 smithi187 ceph-mon[96918]: osdmap e113: 12 total, 12 up, 12 in 2023-07-21T22:38:15.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:15 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:15.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:15 smithi195 ceph-mon[97365]: osdmap e113: 12 total, 12 up, 12 in 2023-07-21T22:38:15.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:15 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:15.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:15 smithi151 ceph-mon[95510]: osdmap e113: 12 total, 12 up, 12 in 2023-07-21T22:38:15.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:15 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:16.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:16 smithi187 ceph-mon[96918]: pgmap v600: 97 pgs: 97 active+clean; 9.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 3.2 MiB/s wr, 421 op/s 2023-07-21T22:38:16.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:16 smithi195 ceph-mon[97365]: pgmap v600: 97 pgs: 97 active+clean; 9.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 3.2 MiB/s wr, 421 op/s 2023-07-21T22:38:16.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:16 smithi151 ceph-mon[95510]: pgmap v600: 97 pgs: 97 active+clean; 9.5 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 3.2 MiB/s wr, 421 op/s 2023-07-21T22:38:17.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:17 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:17.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:17 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:17.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:17 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:18.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:18 smithi187 ceph-mon[96918]: pgmap v601: 97 pgs: 97 active+clean; 9.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.9 MiB/s wr, 378 op/s 2023-07-21T22:38:18.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:18 smithi195 ceph-mon[97365]: pgmap v601: 97 pgs: 97 active+clean; 9.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.9 MiB/s wr, 378 op/s 2023-07-21T22:38:18.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:18 smithi151 ceph-mon[95510]: pgmap v601: 97 pgs: 97 active+clean; 9.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.9 MiB/s wr, 378 op/s 2023-07-21T22:38:20.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:20 smithi187 ceph-mon[96918]: pgmap v602: 97 pgs: 97 active+clean; 9.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.9 MiB/s wr, 378 op/s 2023-07-21T22:38:20.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:20 smithi195 ceph-mon[97365]: pgmap v602: 97 pgs: 97 active+clean; 9.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.9 MiB/s wr, 378 op/s 2023-07-21T22:38:20.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:20 smithi151 ceph-mon[95510]: pgmap v602: 97 pgs: 97 active+clean; 9.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.9 MiB/s wr, 378 op/s 2023-07-21T22:38:22.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:22 smithi187 ceph-mon[96918]: pgmap v603: 97 pgs: 97 active+clean; 9.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.9 MiB/s wr, 378 op/s 2023-07-21T22:38:22.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:22 smithi187 ceph-mon[96918]: osdmap e114: 12 total, 12 up, 12 in 2023-07-21T22:38:22.878 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:22 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:22.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:22 smithi195 ceph-mon[97365]: pgmap v603: 97 pgs: 97 active+clean; 9.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.9 MiB/s wr, 378 op/s 2023-07-21T22:38:22.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:22 smithi195 ceph-mon[97365]: osdmap e114: 12 total, 12 up, 12 in 2023-07-21T22:38:22.907 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:22 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:22.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:22 smithi151 ceph-mon[95510]: pgmap v603: 97 pgs: 97 active+clean; 9.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 2.9 MiB/s wr, 378 op/s 2023-07-21T22:38:22.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:22 smithi151 ceph-mon[95510]: osdmap e114: 12 total, 12 up, 12 in 2023-07-21T22:38:22.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:22 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:38:24.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:24 smithi187 ceph-mon[96918]: pgmap v605: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 3.8 MiB/s wr, 492 op/s 2023-07-21T22:38:24.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:24 smithi195 ceph-mon[97365]: pgmap v605: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 3.8 MiB/s wr, 492 op/s 2023-07-21T22:38:24.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:24 smithi151 ceph-mon[95510]: pgmap v605: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 3.8 MiB/s wr, 492 op/s 2023-07-21T22:38:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.358+0000 7f1d343ff700 1 -- 172.21.15.151:0/2821725079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d2c0ffb30 msgr2=0x7f1d2c0fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.358+0000 7f1d343ff700 1 --2- 172.21.15.151:0/2821725079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d2c0ffb30 0x7f1d2c0fffa0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0098f0 tx=0x7f1d1c009c00 comp rx=0 tx=0).stop 2023-07-21T22:38:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.358+0000 7f1d343ff700 1 -- 172.21.15.151:0/2821725079 shutdown_connections 2023-07-21T22:38:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.358+0000 7f1d343ff700 1 --2- 172.21.15.151:0/2821725079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d2c1004e0 0x7f1d2c10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.359+0000 7f1d343ff700 1 --2- 172.21.15.151:0/2821725079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c105b60 0x7f1d2c105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.359+0000 7f1d343ff700 1 --2- 172.21.15.151:0/2821725079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d2c0ffb30 0x7f1d2c0fffa0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.359+0000 7f1d343ff700 1 -- 172.21.15.151:0/2821725079 >> 172.21.15.151:0/2821725079 conn(0x7f1d2c0fb5f0 msgr2=0x7f1d2c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.359+0000 7f1d343ff700 1 -- 172.21.15.151:0/2821725079 shutdown_connections 2023-07-21T22:38:26.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.359+0000 7f1d343ff700 1 -- 172.21.15.151:0/2821725079 wait complete. 2023-07-21T22:38:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d343ff700 1 Processor -- start 2023-07-21T22:38:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d343ff700 1 -- start start 2023-07-21T22:38:26.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d343ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d2c0ffb30 0x7f1d2c19bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d343ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c1004e0 0x7f1d2c19c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d343ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d2c105b60 0x7f1d2c195930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d343ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c195fa0 con 0x7f1d2c1004e0 2023-07-21T22:38:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d343ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c196110 con 0x7f1d2c105b60 2023-07-21T22:38:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d343ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c1962d0 con 0x7f1d2c0ffb30 2023-07-21T22:38:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d3199a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c1004e0 0x7f1d2c19c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d3199a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c1004e0 0x7f1d2c19c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39938/0 (socket says 172.21.15.151:39938) 2023-07-21T22:38:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d3199a700 1 -- 172.21.15.151:0/326293057 learned_addr learned my addr 172.21.15.151:0/326293057 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.360+0000 7f1d3219b700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d2c0ffb30 0x7f1d2c19bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d3299c700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d2c105b60 0x7f1d2c195930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d3199a700 1 -- 172.21.15.151:0/326293057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d2c0ffb30 msgr2=0x7f1d2c19bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d3199a700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d2c0ffb30 0x7f1d2c19bad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d3199a700 1 -- 172.21.15.151:0/326293057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d2c105b60 msgr2=0x7f1d2c195930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d3199a700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d2c105b60 0x7f1d2c195930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d3199a700 1 -- 172.21.15.151:0/326293057 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c009520 con 0x7f1d2c1004e0 2023-07-21T22:38:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d3199a700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c1004e0 0x7f1d2c19c010 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009810 tx=0x7f1d1c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d237fe700 1 -- 172.21.15.151:0/326293057 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c01c070 con 0x7f1d2c1004e0 2023-07-21T22:38:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d343ff700 1 -- 172.21.15.151:0/326293057 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c196550 con 0x7f1d2c1004e0 2023-07-21T22:38:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d237fe700 1 -- 172.21.15.151:0/326293057 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d1c005040 con 0x7f1d2c1004e0 2023-07-21T22:38:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d237fe700 1 -- 172.21.15.151:0/326293057 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c004930 con 0x7f1d2c1004e0 2023-07-21T22:38:26.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.361+0000 7f1d343ff700 1 -- 172.21.15.151:0/326293057 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c1a2ac0 con 0x7f1d2c1004e0 2023-07-21T22:38:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.364+0000 7f1d237fe700 1 -- 172.21.15.151:0/326293057 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f1d1c020070 con 0x7f1d2c1004e0 2023-07-21T22:38:26.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.366+0000 7f1d47c52b80 1 Processor -- start 2023-07-21T22:38:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.366+0000 7f1d237fe700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1d180a12c0 0x7f1d180a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.366+0000 7f1d237fe700 1 -- 172.21.15.151:0/326293057 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1d1c0cda00 con 0x7f1d2c1004e0 2023-07-21T22:38:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.366+0000 7f1d47c52b80 1 -- start start 2023-07-21T22:38:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.366+0000 7f1d3299c700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1d180a12c0 0x7f1d180a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63e620 0x5564eb638350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63ea70 0x5564eb6388b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb539c50 con 0x5564eb63e620 2023-07-21T22:38:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb58c9e0 con 0x5564eb4906b0 2023-07-21T22:38:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb585e70 con 0x5564eb63ea70 2023-07-21T22:38:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3219b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3219b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57080/0 (socket says 172.21.15.151:57080) 2023-07-21T22:38:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3219b700 1 -- 172.21.15.151:0/855749422 learned_addr learned my addr 172.21.15.151:0/855749422 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:26.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3199a700 1 --2- 172.21.15.151:0/855749422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63e620 0x5564eb638350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3299c700 1 --2- 172.21.15.151:0/855749422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63ea70 0x5564eb6388b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3299c700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1d180a12c0 0x7f1d180a3770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c19c7d0 tx=0x7f1d2400b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3219b700 1 -- 172.21.15.151:0/855749422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63ea70 msgr2=0x5564eb6388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3219b700 1 --2- 172.21.15.151:0/855749422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63ea70 0x5564eb6388b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3219b700 1 -- 172.21.15.151:0/855749422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63e620 msgr2=0x5564eb638350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3219b700 1 --2- 172.21.15.151:0/855749422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63e620 0x5564eb638350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.367+0000 7f1d3219b700 1 -- 172.21.15.151:0/855749422 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564eb3b3d80 con 0x5564eb4906b0 2023-07-21T22:38:26.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.368+0000 7f1d3219b700 1 --2- 172.21.15.151:0/855749422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63e0e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d60 tx=0x7f1d28011720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fa7c99852a97842a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.368+0000 7f1d20bfe700 1 -- 172.21.15.151:0/855749422 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28019630 con 0x5564eb4906b0 2023-07-21T22:38:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.368+0000 7f1d20bfe700 1 -- 172.21.15.151:0/855749422 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d28019c20 con 0x5564eb4906b0 2023-07-21T22:38:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.368+0000 7f1d20bfe700 1 -- 172.21.15.151:0/855749422 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2800eb40 con 0x5564eb4906b0 2023-07-21T22:38:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.368+0000 7f1d47c52b80 1 -- 172.21.15.151:0/855749422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 msgr2=0x5564eb63e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.368+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/855749422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63e0e0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f1d28009d60 tx=0x7f1d28011720 comp rx=0 tx=0).stop 2023-07-21T22:38:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.369+0000 7f1d47c52b80 1 -- 172.21.15.151:0/855749422 shutdown_connections 2023-07-21T22:38:26.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.369+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/855749422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63e0e0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.369+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/855749422 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63ea70 0x5564eb6388b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.369+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/855749422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63e620 0x5564eb638350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.369+0000 7f1d47c52b80 1 -- 172.21.15.151:0/855749422 >> 172.21.15.151:0/855749422 conn(0x5564eb629ae0 msgr2=0x5564eb62f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.369+0000 7f1d47c52b80 1 -- 172.21.15.151:0/855749422 shutdown_connections 2023-07-21T22:38:26.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.369+0000 7f1d47c52b80 1 -- 172.21.15.151:0/855749422 wait complete. 2023-07-21T22:38:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.369+0000 7f1d47c52b80 1 -- start start 2023-07-21T22:38:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.370+0000 7f1d47c52b80 1 Processor -- start 2023-07-21T22:38:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.370+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb644950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.370+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb641c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.370+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 0x5564eb6422c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.370+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb525a60 con 0x5564eb63ea70 2023-07-21T22:38:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.370+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb525760 con 0x5564eb4906b0 2023-07-21T22:38:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.370+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb4098c0 con 0x5564eb63e620 2023-07-21T22:38:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.370+0000 7f1d47c52b80 10 client.0 _ll_register_callbacks cb 0x5564eb523700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3219b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb644950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3199a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb641c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3219b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb644950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57082/0 (socket says 172.21.15.151:57082) 2023-07-21T22:38:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3219b700 1 -- 172.21.15.151:0/943359940 learned_addr learned my addr 172.21.15.151:0/943359940 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:26.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3299c700 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 0x5564eb6422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3219b700 1 -- 172.21.15.151:0/943359940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 msgr2=0x5564eb641c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3219b700 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb641c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3219b700 1 -- 172.21.15.151:0/943359940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 msgr2=0x5564eb6422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3219b700 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 0x5564eb6422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3219b700 1 -- 172.21.15.151:0/943359940 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d280099c0 con 0x5564eb4906b0 2023-07-21T22:38:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3299c700 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 0x5564eb6422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:26.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d3219b700 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb644950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1d28000c00 tx=0x7f1d28019a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e69288c1a25fef6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.371+0000 7f1d15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:38:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d15ffb700 1 -- 172.21.15.151:0/943359940 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28005450 con 0x5564eb4906b0 2023-07-21T22:38:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d47c52b80 1 -- 172.21.15.151:0/943359940 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5564eb4df490 con 0x5564eb4906b0 2023-07-21T22:38:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d15ffb700 1 -- 172.21.15.151:0/943359940 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1d2800e4d0 con 0x5564eb4906b0 2023-07-21T22:38:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d15ffb700 1 -- 172.21.15.151:0/943359940 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d280055b0 con 0x5564eb4906b0 2023-07-21T22:38:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d47c52b80 10 client.27536 fetch_fsmap learned FSMap version 71 2023-07-21T22:38:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d47c52b80 1 -- 172.21.15.151:0/943359940 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x5564eb39cc00 con 0x5564eb4906b0 2023-07-21T22:38:26.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d15ffb700 1 -- 172.21.15.151:0/943359940 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5564eb4df490 con 0x5564eb4906b0 2023-07-21T22:38:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d15ffb700 1 -- 172.21.15.151:0/943359940 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1d28004c90 con 0x5564eb4906b0 2023-07-21T22:38:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d47c52b80 10 client.27536 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:38:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d47c52b80 10 client.27536 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:38:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d47c52b80 20 client.27536 populate_metadata read hostname 'smithi151' 2023-07-21T22:38:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5564eb651cd0 0x5564eb6540e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d47c52b80 4 client.27536 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:38:26.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.372+0000 7f1d47c52b80 1 -- 172.21.15.151:0/943359940 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5564eb57ee50 con 0x5564eb651cd0 2023-07-21T22:38:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.373+0000 7f1d3199a700 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5564eb651cd0 0x5564eb6540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.373+0000 7f1d3199a700 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5564eb651cd0 0x5564eb6540e0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3efb48f8cb35bec server_cookie=d7528a3bfa9c16b3 in_seq=0 out_seq=0 2023-07-21T22:38:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.373+0000 7f1d15ffb700 10 client.27536 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d15ffb700 1 -- 172.21.15.151:0/943359940 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5564eb57ee50 con 0x5564eb651cd0 2023-07-21T22:38:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d15ffb700 10 client.27536 handle_command_reply: tid=0 2023-07-21T22:38:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 client.27536 shutdown 2023-07-21T22:38:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 -- 172.21.15.151:0/943359940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 msgr2=0x5564eb644950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb644950 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f1d28000c00 tx=0x7f1d28019a90 comp rx=0 tx=0).stop 2023-07-21T22:38:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 -- 172.21.15.151:0/943359940 shutdown_connections 2023-07-21T22:38:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5564eb651cd0 0x5564eb6540e0 crc :-1 s=READY pgs=268 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb644950 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 0x5564eb6422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/943359940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb641c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 -- 172.21.15.151:0/943359940 >> 172.21.15.151:0/943359940 conn(0x5564eb629ae0 msgr2=0x5564eb62e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d15ffb700 0 client.27536 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 -- 172.21.15.151:0/943359940 shutdown_connections 2023-07-21T22:38:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 1 -- 172.21.15.151:0/943359940 wait complete. 2023-07-21T22:38:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.374+0000 7f1d47c52b80 20 client.27536 trim_cache size 0 max 16384 2023-07-21T22:38:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.390+0000 7f1d47c52b80 1 Processor -- start 2023-07-21T22:38:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.390+0000 7f1d47c52b80 1 -- start start 2023-07-21T22:38:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.390+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb4906b0 0x5564eb648f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.390+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb63d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.390+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb63ea70 0x5564eb6444f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.390+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb6306b0 con 0x5564eb4906b0 2023-07-21T22:38:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.390+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb62b4f0 con 0x5564eb63ea70 2023-07-21T22:38:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.390+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb64e840 con 0x5564eb63e620 2023-07-21T22:38:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3219b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb4906b0 0x5564eb648f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3299c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb63ea70 0x5564eb6444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3219b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb4906b0 0x5564eb648f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39956/0 (socket says 172.21.15.151:39956) 2023-07-21T22:38:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3219b700 1 -- 172.21.15.151:0/2843707676 learned_addr learned my addr 172.21.15.151:0/2843707676 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3199a700 1 --2- 172.21.15.151:0/2843707676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb63d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3219b700 1 -- 172.21.15.151:0/2843707676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 msgr2=0x5564eb63d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3219b700 1 --2- 172.21.15.151:0/2843707676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb63d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3219b700 1 -- 172.21.15.151:0/2843707676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb63ea70 msgr2=0x5564eb6444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3219b700 1 --2- 172.21.15.151:0/2843707676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb63ea70 0x5564eb6444f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3219b700 1 -- 172.21.15.151:0/2843707676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5564eb64e460 con 0x5564eb4906b0 2023-07-21T22:38:26.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d3219b700 1 --2- 172.21.15.151:0/2843707676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb4906b0 0x5564eb648f50 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1d28022f20 tx=0x7f1d28005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a661e9dc35d222 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.391+0000 7f1d213ff700 1 -- 172.21.15.151:0/2843707676 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28011b20 con 0x5564eb4906b0 2023-07-21T22:38:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d213ff700 1 -- 172.21.15.151:0/2843707676 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d280056e0 con 0x5564eb4906b0 2023-07-21T22:38:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d213ff700 1 -- 172.21.15.151:0/2843707676 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d28022960 con 0x5564eb4906b0 2023-07-21T22:38:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d47c52b80 1 -- 172.21.15.151:0/2843707676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb4906b0 msgr2=0x5564eb648f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/2843707676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb4906b0 0x5564eb648f50 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f1d28022f20 tx=0x7f1d28005fb0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d47c52b80 1 -- 172.21.15.151:0/2843707676 shutdown_connections 2023-07-21T22:38:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/2843707676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb63ea70 0x5564eb6444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/2843707676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb4906b0 0x5564eb648f50 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/2843707676 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb63d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d47c52b80 1 -- 172.21.15.151:0/2843707676 >> 172.21.15.151:0/2843707676 conn(0x5564eb629ae0 msgr2=0x5564eb63cd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d47c52b80 1 -- 172.21.15.151:0/2843707676 shutdown_connections 2023-07-21T22:38:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.392+0000 7f1d47c52b80 1 -- 172.21.15.151:0/2843707676 wait complete. 2023-07-21T22:38:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.393+0000 7f1d47c52b80 1 -- start start 2023-07-21T22:38:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.393+0000 7f1d47c52b80 1 Processor -- start 2023-07-21T22:38:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.393+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63b320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.393+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb641310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.393+0000 7f1d47c52b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 0x5564eb641850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.393+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb641d90 con 0x5564eb63ea70 2023-07-21T22:38:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.393+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb641f00 con 0x5564eb4906b0 2023-07-21T22:38:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.393+0000 7f1d47c52b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5564eb6420c0 con 0x5564eb63e620 2023-07-21T22:38:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.393+0000 7f1d47c52b80 10 client.0 _ll_register_callbacks cb 0x7f1d1c005b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3219b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3219b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57102/0 (socket says 172.21.15.151:57102) 2023-07-21T22:38:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3199a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb641310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3219b700 1 -- 172.21.15.151:0/994782940 learned_addr learned my addr 172.21.15.151:0/994782940 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3299c700 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 0x5564eb641850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3199a700 1 -- 172.21.15.151:0/994782940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 msgr2=0x5564eb63b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3199a700 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3199a700 1 -- 172.21.15.151:0/994782940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 msgr2=0x5564eb641850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3199a700 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 0x5564eb641850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3199a700 1 -- 172.21.15.151:0/994782940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5564eb39cc00 con 0x5564eb63e620 2023-07-21T22:38:26.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3219b700 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d3199a700 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb641310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0cb110 tx=0x7f1d1c019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ac3b085bfe6aa60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d15ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:38:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d15ffb700 1 -- 172.21.15.151:0/994782940 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1c0a2ee0 con 0x5564eb63e620 2023-07-21T22:38:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d47c52b80 1 -- 172.21.15.151:0/994782940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1d28019c20 con 0x5564eb63e620 2023-07-21T22:38:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.394+0000 7f1d15ffb700 1 -- 172.21.15.151:0/994782940 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1d1c097230 con 0x5564eb63e620 2023-07-21T22:38:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d15ffb700 1 -- 172.21.15.151:0/994782940 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1d1c097410 con 0x5564eb63e620 2023-07-21T22:38:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d47c52b80 10 client.27568 fetch_fsmap learned FSMap version 71 2023-07-21T22:38:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d47c52b80 1 -- 172.21.15.151:0/994782940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x5564eb3da1f0 con 0x5564eb63e620 2023-07-21T22:38:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d15ffb700 1 -- 172.21.15.151:0/994782940 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1d28019c20 con 0x5564eb63e620 2023-07-21T22:38:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d15ffb700 1 -- 172.21.15.151:0/994782940 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f1d1c09a030 con 0x5564eb63e620 2023-07-21T22:38:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d47c52b80 10 client.27568 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:38:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d47c52b80 10 client.27568 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:38:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d47c52b80 20 client.27568 populate_metadata read hostname 'smithi151' 2023-07-21T22:38:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5564eb6a5be0 0x5564eb6a7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d47c52b80 4 client.27568 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:38:26.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d47c52b80 1 -- 172.21.15.151:0/994782940 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5564eb540ff0 con 0x5564eb6a5be0 2023-07-21T22:38:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.395+0000 7f1d3219b700 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5564eb6a5be0 0x5564eb6a7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.396+0000 7f1d3219b700 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5564eb6a5be0 0x5564eb6a7fc0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c833fee47a79348 server_cookie=d104bf89d96662c8 in_seq=0 out_seq=0 2023-07-21T22:38:26.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.396+0000 7f1d15ffb700 10 client.27568 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d15ffb700 1 -- 172.21.15.151:0/994782940 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5564eb540ff0 con 0x5564eb6a5be0 2023-07-21T22:38:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d15ffb700 10 client.27568 handle_command_reply: tid=0 2023-07-21T22:38:26.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 client.27568 shutdown 2023-07-21T22:38:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 -- 172.21.15.151:0/994782940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 msgr2=0x5564eb641310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb641310 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0cb110 tx=0x7f1d1c019040 comp rx=0 tx=0).stop 2023-07-21T22:38:26.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 -- 172.21.15.151:0/994782940 shutdown_connections 2023-07-21T22:38:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5564eb6a5be0 0x5564eb6a7fc0 crc :-1 s=READY pgs=269 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5564eb4906b0 0x5564eb63b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5564eb63ea70 0x5564eb641850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d15ffb700 0 client.27568 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 --2- 172.21.15.151:0/994782940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5564eb63e620 0x5564eb641310 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 -- 172.21.15.151:0/994782940 >> 172.21.15.151:0/994782940 conn(0x5564eb629ae0 msgr2=0x5564eb632f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 -- 172.21.15.151:0/994782940 shutdown_connections 2023-07-21T22:38:26.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 1 -- 172.21.15.151:0/994782940 wait complete. 2023-07-21T22:38:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.410+0000 7f1d47c52b80 20 client.27568 trim_cache size 0 max 16384 2023-07-21T22:38:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:38:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:38:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:38:26.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:38:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 -- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1d180a12c0 msgr2=0x7f1d180a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1d180a12c0 0x7f1d180a3770 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c19c7d0 tx=0x7f1d2400b040 comp rx=0 tx=0).stop 2023-07-21T22:38:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 -- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c1004e0 msgr2=0x7f1d2c19c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c1004e0 0x7f1d2c19c010 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c009810 tx=0x7f1d1c00fa00 comp rx=0 tx=0).stop 2023-07-21T22:38:26.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 -- 172.21.15.151:0/326293057 shutdown_connections 2023-07-21T22:38:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1d180a12c0 0x7f1d180a3770 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d2c105b60 0x7f1d2c195930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1d2c0ffb30 0x7f1d2c19bad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 --2- 172.21.15.151:0/326293057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c1004e0 0x7f1d2c19c010 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 -- 172.21.15.151:0/326293057 >> 172.21.15.151:0/326293057 conn(0x7f1d2c0fb5f0 msgr2=0x7f1d2c1037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 -- 172.21.15.151:0/326293057 shutdown_connections 2023-07-21T22:38:26.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:26.411+0000 7f1d343ff700 1 -- 172.21.15.151:0/326293057 wait complete. 2023-07-21T22:38:26.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:26 smithi187 ceph-mon[96918]: pgmap v606: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.2 MiB/s wr, 422 op/s 2023-07-21T22:38:26.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:26 smithi195 ceph-mon[97365]: pgmap v606: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.2 MiB/s wr, 422 op/s 2023-07-21T22:38:26.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:26 smithi151 ceph-mon[95510]: pgmap v606: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.2 MiB/s wr, 422 op/s 2023-07-21T22:38:28.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:28 smithi187 ceph-mon[96918]: pgmap v607: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 443 op/s 2023-07-21T22:38:28.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:28 smithi195 ceph-mon[97365]: pgmap v607: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 443 op/s 2023-07-21T22:38:28.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:28 smithi151 ceph-mon[95510]: pgmap v607: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 443 op/s 2023-07-21T22:38:30.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:30 smithi187 ceph-mon[96918]: pgmap v608: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 443 op/s 2023-07-21T22:38:30.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:30 smithi195 ceph-mon[97365]: pgmap v608: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 443 op/s 2023-07-21T22:38:30.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:30 smithi151 ceph-mon[95510]: pgmap v608: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 443 op/s 2023-07-21T22:38:32.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:32 smithi187 ceph-mon[96918]: pgmap v609: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 443 op/s 2023-07-21T22:38:32.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:32 smithi195 ceph-mon[97365]: pgmap v609: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 443 op/s 2023-07-21T22:38:32.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:32 smithi151 ceph-mon[95510]: pgmap v609: 97 pgs: 97 active+clean; 9.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.4 MiB/s wr, 443 op/s 2023-07-21T22:38:34.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:34 smithi187 ceph-mon[96918]: pgmap v610: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.3 MiB/s wr, 561 op/s 2023-07-21T22:38:34.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:34 smithi195 ceph-mon[97365]: pgmap v610: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.3 MiB/s wr, 561 op/s 2023-07-21T22:38:34.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:34 smithi151 ceph-mon[95510]: pgmap v610: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 4.3 MiB/s wr, 561 op/s 2023-07-21T22:38:36.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:36 smithi187 ceph-mon[96918]: pgmap v611: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.7 MiB/s wr, 353 op/s 2023-07-21T22:38:36.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:36 smithi195 ceph-mon[97365]: pgmap v611: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.7 MiB/s wr, 353 op/s 2023-07-21T22:38:36.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:36 smithi151 ceph-mon[95510]: pgmap v611: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.7 MiB/s wr, 353 op/s 2023-07-21T22:38:38.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:38 smithi187 ceph-mon[96918]: pgmap v612: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.9 MiB/s wr, 514 op/s 2023-07-21T22:38:38.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:38 smithi195 ceph-mon[97365]: pgmap v612: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.9 MiB/s wr, 514 op/s 2023-07-21T22:38:38.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:38 smithi151 ceph-mon[95510]: pgmap v612: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.9 MiB/s wr, 514 op/s 2023-07-21T22:38:39.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.694+0000 7ff0fefff700 1 -- 172.21.15.151:0/1952423625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f8067c10 msgr2=0x7ff0f8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.694+0000 7ff0fefff700 1 --2- 172.21.15.151:0/1952423625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f8067c10 0x7ff0f8067fe0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009920 tx=0x7ff0ec009c30 comp rx=0 tx=0).stop 2023-07-21T22:38:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.694+0000 7ff0fefff700 1 -- 172.21.15.151:0/1952423625 shutdown_connections 2023-07-21T22:38:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.694+0000 7ff0fefff700 1 --2- 172.21.15.151:0/1952423625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f8067c10 0x7ff0f8067fe0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.694+0000 7ff0fefff700 1 --2- 172.21.15.151:0/1952423625 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0f8104e50 0x7ff0f810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.694+0000 7ff0fefff700 1 --2- 172.21.15.151:0/1952423625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f80685b0 0x7ff0f8104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.694+0000 7ff0fefff700 1 -- 172.21.15.151:0/1952423625 >> 172.21.15.151:0/1952423625 conn(0x7ff0f8074760 msgr2=0x7ff0f8074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:39.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.694+0000 7ff0fefff700 1 -- 172.21.15.151:0/1952423625 shutdown_connections 2023-07-21T22:38:39.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.694+0000 7ff0fefff700 1 -- 172.21.15.151:0/1952423625 wait complete. 2023-07-21T22:38:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.695+0000 7ff0fefff700 1 Processor -- start 2023-07-21T22:38:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.695+0000 7ff0fefff700 1 -- start start 2023-07-21T22:38:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0fefff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0f8067c10 0x7ff0f8197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0fefff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f80685b0 0x7ff0f81982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0fefff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f8104e50 0x7ff0f819c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0fefff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f819cf80 con 0x7ff0f80685b0 2023-07-21T22:38:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0fefff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f819d0f0 con 0x7ff0f8104e50 2023-07-21T22:38:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0fefff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f819d2b0 con 0x7ff0f8067c10 2023-07-21T22:38:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f80685b0 0x7ff0f81982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f80685b0 0x7ff0f81982d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52068/0 (socket says 172.21.15.151:52068) 2023-07-21T22:38:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0f7fff700 1 -- 172.21.15.151:0/3201386433 learned_addr learned my addr 172.21.15.151:0/3201386433 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0f8067c10 0x7ff0f8197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.696+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f8104e50 0x7ff0f819c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/3201386433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f8104e50 msgr2=0x7ff0f819c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:39.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f8104e50 0x7ff0f819c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f80685b0 msgr2=0x7ff0f81982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f80685b0 0x7ff0f81982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/3201386433 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0e40095f0 con 0x7ff0f8067c10 2023-07-21T22:38:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f80685b0 0x7ff0f81982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0f8067c10 0x7ff0f8197d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009230 tx=0x7ff0ec00fa00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0f5ffb700 1 -- 172.21.15.151:0/3201386433 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec01c070 con 0x7ff0f8067c10 2023-07-21T22:38:39.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0fefff700 1 -- 172.21.15.151:0/3201386433 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0ec009520 con 0x7ff0f8067c10 2023-07-21T22:38:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.697+0000 7ff0f5ffb700 1 -- 172.21.15.151:0/3201386433 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0ec00bab0 con 0x7ff0f8067c10 2023-07-21T22:38:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.698+0000 7ff0f5ffb700 1 -- 172.21.15.151:0/3201386433 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec004950 con 0x7ff0f8067c10 2023-07-21T22:38:39.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.698+0000 7ff0fefff700 1 -- 172.21.15.151:0/3201386433 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f81a4bf0 con 0x7ff0f8067c10 2023-07-21T22:38:39.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.702+0000 7ff0f5ffb700 1 -- 172.21.15.151:0/3201386433 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff0ec020070 con 0x7ff0f8067c10 2023-07-21T22:38:39.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.703+0000 7ff11291db80 1 Processor -- start 2023-07-21T22:38:39.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.704+0000 7ff11291db80 1 -- start start 2023-07-21T22:38:39.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.704+0000 7ff11291db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3034cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.704+0000 7ff11291db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f3035210 0x55e6f302ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.704+0000 7ff11291db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f302f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.704+0000 7ff11291db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f2f34c50 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.704+0000 7ff11291db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f2f879e0 con 0x55e6f3035210 2023-07-21T22:38:39.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.704+0000 7ff11291db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f2f80e70 con 0x55e6f3035660 2023-07-21T22:38:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.704+0000 7ff0f5ffb700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0e80a1340 0x7ff0e80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0f7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f302f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0f7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f302f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:55928/0 (socket says 172.21.15.151:55928) 2023-07-21T22:38:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0f7fff700 1 -- 172.21.15.151:0/775488201 learned_addr learned my addr 172.21.15.151:0/775488201 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3034cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0f5ffb700 1 -- 172.21.15.151:0/3201386433 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff0ec0cd800 con 0x7ff0f8067c10 2023-07-21T22:38:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f3035210 0x55e6f302ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0e80a1340 0x7ff0e80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0f7fff700 1 -- 172.21.15.151:0/775488201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f3035210 msgr2=0x55e6f302ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f3035210 0x55e6f302ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0f7fff700 1 -- 172.21.15.151:0/775488201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f2e8b6b0 msgr2=0x55e6f3034cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3034cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0f7fff700 1 -- 172.21.15.151:0/775488201 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6f2daed80 con 0x55e6f3035660 2023-07-21T22:38:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.705+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f3035210 0x55e6f302ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.706+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f302f4a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4011830 tx=0x7ff0e4011b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=855e24e13a182062 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.706+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0e80a1340 0x7ff0e80a37f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009ec0 tx=0x7ff0f000b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:39.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.706+0000 7ff0e2ffd700 1 -- 172.21.15.151:0/775488201 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e4004830 con 0x55e6f3035660 2023-07-21T22:38:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.706+0000 7ff0e2ffd700 1 -- 172.21.15.151:0/775488201 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0e4004e20 con 0x55e6f3035660 2023-07-21T22:38:39.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.706+0000 7ff0e2ffd700 1 -- 172.21.15.151:0/775488201 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400f760 con 0x55e6f3035660 2023-07-21T22:38:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 -- 172.21.15.151:0/775488201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 msgr2=0x55e6f302f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:39.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f302f4a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff0e4011830 tx=0x7ff0e4011b40 comp rx=0 tx=0).stop 2023-07-21T22:38:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 -- 172.21.15.151:0/775488201 shutdown_connections 2023-07-21T22:38:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f302f4a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3034cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 --2- 172.21.15.151:0/775488201 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f3035210 0x55e6f302ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 -- 172.21.15.151:0/775488201 >> 172.21.15.151:0/775488201 conn(0x55e6f3024ae0 msgr2=0x55e6f302a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 -- 172.21.15.151:0/775488201 shutdown_connections 2023-07-21T22:38:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 -- 172.21.15.151:0/775488201 wait complete. 2023-07-21T22:38:39.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.707+0000 7ff11291db80 1 -- start start 2023-07-21T22:38:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.708+0000 7ff11291db80 1 Processor -- start 2023-07-21T22:38:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.708+0000 7ff11291db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f303b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.708+0000 7ff11291db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f3038720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.708+0000 7ff11291db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f3038cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.708+0000 7ff11291db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f2f20a60 con 0x55e6f3035210 2023-07-21T22:38:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff11291db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f2f20760 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff11291db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f2e048c0 con 0x55e6f3035660 2023-07-21T22:38:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff11291db80 10 client.0 _ll_register_callbacks cb 0x55e6f2f1e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f3038720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f3038720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52092/0 (socket says 172.21.15.151:52092) 2023-07-21T22:38:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0f7fff700 1 -- 172.21.15.151:0/3047276013 learned_addr learned my addr 172.21.15.151:0/3047276013 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0fcd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f303b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f3038cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/3047276013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 msgr2=0x55e6f3038cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:39.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f3038cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/3047276013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 msgr2=0x55e6f3038720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f3038720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/3047276013 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f81a4bf0 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.709+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f3038720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.710+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f303b510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0caf70 tx=0x7ff0ec009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=478abcabaca79c0e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.710+0000 7ff0d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:38:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.710+0000 7ff0d7fff700 1 -- 172.21.15.151:0/3047276013 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec0cb3f0 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.710+0000 7ff0d7fff700 1 -- 172.21.15.151:0/3047276013 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff0ec0a2d40 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.710+0000 7ff11291db80 1 -- 172.21.15.151:0/3047276013 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e6f2eda490 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.710+0000 7ff0d7fff700 1 -- 172.21.15.151:0/3047276013 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0ec09abe0 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.710+0000 7ff11291db80 10 client.27554 fetch_fsmap learned FSMap version 71 2023-07-21T22:38:39.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.710+0000 7ff11291db80 1 -- 172.21.15.151:0/3047276013 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x7ff0e4011460 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.711+0000 7ff0d7fff700 1 -- 172.21.15.151:0/3047276013 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e6f2eda490 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.711+0000 7ff0d7fff700 1 -- 172.21.15.151:0/3047276013 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff0ec0a28b0 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.711+0000 7ff11291db80 10 client.27554 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:38:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.711+0000 7ff11291db80 10 client.27554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:38:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.711+0000 7ff11291db80 20 client.27554 populate_metadata read hostname 'smithi151' 2023-07-21T22:38:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.711+0000 7ff11291db80 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e6f30487c0 0x55e6f304abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.711+0000 7ff11291db80 4 client.27554 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:38:39.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.711+0000 7ff11291db80 1 -- 172.21.15.151:0/3047276013 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e6f2f79e50 con 0x55e6f30487c0 2023-07-21T22:38:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.712+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e6f30487c0 0x55e6f304abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.712+0000 7ff0d7fff700 10 client.27554 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.712+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e6f30487c0 0x55e6f304abd0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=558623f1dd2c9847 server_cookie=ae2f2edc7ea0df8 in_seq=0 out_seq=0 2023-07-21T22:38:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff0d7fff700 1 -- 172.21.15.151:0/3047276013 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e6f2f79e50 con 0x55e6f30487c0 2023-07-21T22:38:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff0d7fff700 10 client.27554 handle_command_reply: tid=0 2023-07-21T22:38:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff11291db80 1 client.27554 shutdown 2023-07-21T22:38:39.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff11291db80 1 -- 172.21.15.151:0/3047276013 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 msgr2=0x55e6f303b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff11291db80 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f303b510 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec0caf70 tx=0x7ff0ec009260 comp rx=0 tx=0).stop 2023-07-21T22:38:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff11291db80 1 -- 172.21.15.151:0/3047276013 shutdown_connections 2023-07-21T22:38:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff11291db80 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e6f30487c0 0x55e6f304abd0 crc :-1 s=READY pgs=270 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff11291db80 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f303b510 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff11291db80 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f3038cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff0d7fff700 0 client.27554 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff11291db80 1 --2- 172.21.15.151:0/3047276013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f3038720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.713+0000 7ff11291db80 1 -- 172.21.15.151:0/3047276013 >> 172.21.15.151:0/3047276013 conn(0x55e6f3024ae0 msgr2=0x55e6f30293e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.714+0000 7ff11291db80 1 -- 172.21.15.151:0/3047276013 shutdown_connections 2023-07-21T22:38:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.714+0000 7ff11291db80 1 -- 172.21.15.151:0/3047276013 wait complete. 2023-07-21T22:38:39.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.714+0000 7ff11291db80 20 client.27554 trim_cache size 0 max 16384 2023-07-21T22:38:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.731+0000 7ff11291db80 1 Processor -- start 2023-07-21T22:38:39.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff11291db80 1 -- start start 2023-07-21T22:38:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff11291db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f302ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff11291db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f303fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff11291db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f3036140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff11291db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f3021b20 con 0x55e6f3035210 2023-07-21T22:38:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff11291db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f3030160 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff11291db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f30392c0 con 0x55e6f3035660 2023-07-21T22:38:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff0f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f303fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff0f7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f303fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52108/0 (socket says 172.21.15.151:52108) 2023-07-21T22:38:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff0f7fff700 1 -- 172.21.15.151:0/2809773441 learned_addr learned my addr 172.21.15.151:0/2809773441 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.732+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f3036140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.733+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f302ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.733+0000 7ff0fd59c700 1 -- 172.21.15.151:0/2809773441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 msgr2=0x55e6f302ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.733+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f302ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.733+0000 7ff0fd59c700 1 -- 172.21.15.151:0/2809773441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 msgr2=0x55e6f303fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.733+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f303fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.733+0000 7ff0fd59c700 1 -- 172.21.15.151:0/2809773441 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e6f2d97c00 con 0x55e6f3035660 2023-07-21T22:38:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.733+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f303fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.733+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f3036140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0003e20 tx=0x7ff0f0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0e123a8f656de8a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.734+0000 7ff0e37fe700 1 -- 172.21.15.151:0/2809773441 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f000e070 con 0x55e6f3035660 2023-07-21T22:38:39.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.734+0000 7ff0e37fe700 1 -- 172.21.15.151:0/2809773441 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0f000f040 con 0x55e6f3035660 2023-07-21T22:38:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.734+0000 7ff0e37fe700 1 -- 172.21.15.151:0/2809773441 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0004bb0 con 0x55e6f3035660 2023-07-21T22:38:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.734+0000 7ff11291db80 1 -- 172.21.15.151:0/2809773441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 msgr2=0x55e6f3036140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.734+0000 7ff11291db80 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f3036140 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0003e20 tx=0x7ff0f0009920 comp rx=0 tx=0).stop 2023-07-21T22:38:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.734+0000 7ff11291db80 1 -- 172.21.15.151:0/2809773441 shutdown_connections 2023-07-21T22:38:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.734+0000 7ff11291db80 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f302ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.734+0000 7ff11291db80 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035660 0x55e6f3036140 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.734+0000 7ff11291db80 1 --2- 172.21.15.151:0/2809773441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035210 0x55e6f303fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.735+0000 7ff11291db80 1 -- 172.21.15.151:0/2809773441 >> 172.21.15.151:0/2809773441 conn(0x55e6f3024ae0 msgr2=0x55e6f3035a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.735+0000 7ff11291db80 1 -- 172.21.15.151:0/2809773441 shutdown_connections 2023-07-21T22:38:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.735+0000 7ff11291db80 1 -- 172.21.15.151:0/2809773441 wait complete. 2023-07-21T22:38:39.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.735+0000 7ff11291db80 1 -- start start 2023-07-21T22:38:39.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.735+0000 7ff11291db80 1 Processor -- start 2023-07-21T22:38:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff11291db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3031890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff11291db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035210 0x55e6f3031dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff11291db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035660 0x55e6f3030730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff11291db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f3032390 con 0x55e6f3035660 2023-07-21T22:38:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff11291db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f3030c70 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff11291db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e6f3030e30 con 0x55e6f3035210 2023-07-21T22:38:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff11291db80 10 client.0 _ll_register_callbacks cb 0x55e6f2f1e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff0fcd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3031890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff0fd59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035660 0x55e6f3030730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff0fcd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3031890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37068/0 (socket says 172.21.15.151:37068) 2023-07-21T22:38:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/4112508963 learned_addr learned my addr 172.21.15.151:0/4112508963 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.736+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035210 0x55e6f3031dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/4112508963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035210 msgr2=0x55e6f3031dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:39.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035210 0x55e6f3031dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/4112508963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035660 msgr2=0x55e6f3030730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035660 0x55e6f3030730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0fcd9b700 1 -- 172.21.15.151:0/4112508963 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f0003b90 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0fd59c700 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035660 0x55e6f3030730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035210 0x55e6f3031dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0fcd9b700 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3031890 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec09a680 tx=0x7ff0ec0ba510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=843cde75df70c1a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:39.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0d7fff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:38:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0d7fff700 1 -- 172.21.15.151:0/4112508963 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec09a070 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.737+0000 7ff0d7fff700 1 -- 172.21.15.151:0/4112508963 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff0ec0a2d40 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff11291db80 1 -- 172.21.15.151:0/4112508963 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0e4004e20 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff0d7fff700 1 -- 172.21.15.151:0/4112508963 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0ec0ba0b0 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff11291db80 10 client.27560 fetch_fsmap learned FSMap version 71 2023-07-21T22:38:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff11291db80 1 -- 172.21.15.151:0/4112508963 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x55e6f2dd51f0 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff0d7fff700 1 -- 172.21.15.151:0/4112508963 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0e4004e20 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff0d7fff700 1 -- 172.21.15.151:0/4112508963 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7ff0ec096890 con 0x55e6f2e8b6b0 2023-07-21T22:38:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff11291db80 10 client.27560 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:38:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff11291db80 10 client.27560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:38:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff11291db80 20 client.27560 populate_metadata read hostname 'smithi151' 2023-07-21T22:38:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff11291db80 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e6f309cfb0 0x55e6f309f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff11291db80 4 client.27560 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:38:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.738+0000 7ff11291db80 1 -- 172.21.15.151:0/4112508963 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e6f2f3bff0 con 0x55e6f309cfb0 2023-07-21T22:38:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.739+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e6f309cfb0 0x55e6f309f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:39.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.739+0000 7ff0d7fff700 10 client.27560 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:39.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.739+0000 7ff0f7fff700 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e6f309cfb0 0x55e6f309f3c0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=12e7be0f8d3f3406 server_cookie=a5f3a91627f7d9c6 in_seq=0 out_seq=0 2023-07-21T22:38:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff0d7fff700 1 -- 172.21.15.151:0/4112508963 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e6f2f3bff0 con 0x55e6f309cfb0 2023-07-21T22:38:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff0d7fff700 10 client.27560 handle_command_reply: tid=0 2023-07-21T22:38:39.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 client.27560 shutdown 2023-07-21T22:38:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 -- 172.21.15.151:0/4112508963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 msgr2=0x55e6f3031890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:39.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3031890 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec09a680 tx=0x7ff0ec0ba510 comp rx=0 tx=0).stop 2023-07-21T22:38:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 -- 172.21.15.151:0/4112508963 shutdown_connections 2023-07-21T22:38:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e6f309cfb0 0x55e6f309f3c0 crc :-1 s=READY pgs=271 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e6f2e8b6b0 0x55e6f3031890 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff0d7fff700 0 client.27560 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e6f3035660 0x55e6f3030730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 --2- 172.21.15.151:0/4112508963 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e6f3035210 0x55e6f3031dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 -- 172.21.15.151:0/4112508963 >> 172.21.15.151:0/4112508963 conn(0x55e6f3024ae0 msgr2=0x55e6f30362c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 -- 172.21.15.151:0/4112508963 shutdown_connections 2023-07-21T22:38:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.749+0000 7ff11291db80 1 -- 172.21.15.151:0/4112508963 wait complete. 2023-07-21T22:38:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff11291db80 20 client.27560 trim_cache size 0 max 16384 2023-07-21T22:38:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:38:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:38:39.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:38:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:38:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 -- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0e80a1340 msgr2=0x7ff0e80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0e80a1340 0x7ff0e80a37f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0009ec0 tx=0x7ff0f000b040 comp rx=0 tx=0).stop 2023-07-21T22:38:39.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 -- 172.21.15.151:0/3201386433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0f8067c10 msgr2=0x7ff0f8197d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0f8067c10 0x7ff0f8197d90 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009230 tx=0x7ff0ec00fa00 comp rx=0 tx=0).stop 2023-07-21T22:38:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 -- 172.21.15.151:0/3201386433 shutdown_connections 2023-07-21T22:38:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0e80a1340 0x7ff0e80a37f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0f8104e50 0x7ff0f819c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0f8067c10 0x7ff0f8197d90 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 --2- 172.21.15.151:0/3201386433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f80685b0 0x7ff0f81982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:39.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.750+0000 7ff0fefff700 1 -- 172.21.15.151:0/3201386433 >> 172.21.15.151:0/3201386433 conn(0x7ff0f8074760 msgr2=0x7ff0f80fc930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.751+0000 7ff0fefff700 1 -- 172.21.15.151:0/3201386433 shutdown_connections 2023-07-21T22:38:39.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:39.751+0000 7ff0fefff700 1 -- 172.21.15.151:0/3201386433 wait complete. 2023-07-21T22:38:40.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:40 smithi187 ceph-mon[96918]: pgmap v613: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:38:40.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:40 smithi195 ceph-mon[97365]: pgmap v613: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:38:40.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:40 smithi151 ceph-mon[95510]: pgmap v613: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:38:42.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:42 smithi187 ceph-mon[96918]: pgmap v614: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:38:42.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:42 smithi195 ceph-mon[97365]: pgmap v614: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:38:42.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:42 smithi151 ceph-mon[95510]: pgmap v614: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:38:44.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:44 smithi187 ceph-mon[96918]: pgmap v615: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.0 MiB/s wr, 524 op/s 2023-07-21T22:38:44.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:44 smithi195 ceph-mon[97365]: pgmap v615: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.0 MiB/s wr, 524 op/s 2023-07-21T22:38:44.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:44 smithi151 ceph-mon[95510]: pgmap v615: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.0 MiB/s wr, 524 op/s 2023-07-21T22:38:46.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:46 smithi187 ceph-mon[96918]: pgmap v616: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:38:46.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:46 smithi195 ceph-mon[97365]: pgmap v616: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:38:46.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:46 smithi151 ceph-mon[95510]: pgmap v616: 97 pgs: 97 active+clean; 9.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:38:48.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:48 smithi187 ceph-mon[96918]: pgmap v617: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.0 MiB/s wr, 529 op/s 2023-07-21T22:38:48.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:48 smithi195 ceph-mon[97365]: pgmap v617: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.0 MiB/s wr, 529 op/s 2023-07-21T22:38:48.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:48 smithi151 ceph-mon[95510]: pgmap v617: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 4.0 MiB/s wr, 529 op/s 2023-07-21T22:38:50.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:50 smithi187 ceph-mon[96918]: pgmap v618: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:38:50.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:50 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:38:50.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:50 smithi195 ceph-mon[97365]: pgmap v618: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:38:50.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:50 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:38:50.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:50 smithi151 ceph-mon[95510]: pgmap v618: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:38:50.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:50 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:38:52.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:52 smithi187 ceph-mon[96918]: pgmap v619: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:38:52.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:38:52.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:38:52.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:38:52.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:52 smithi195 ceph-mon[97365]: pgmap v619: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:38:52.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:38:52.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:38:52.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:38:52.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:52 smithi151 ceph-mon[95510]: pgmap v619: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:38:52.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:38:52.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:38:52.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:38:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.935+0000 7f35603ff700 1 -- 172.21.15.151:0/2971958334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3558105b60 msgr2=0x7f3558105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.935+0000 7f35603ff700 1 --2- 172.21.15.151:0/2971958334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3558105b60 0x7f3558105f30 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f3554009990 tx=0x7f3554009ca0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.935+0000 7f35603ff700 1 -- 172.21.15.151:0/2971958334 shutdown_connections 2023-07-21T22:38:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.935+0000 7f35603ff700 1 --2- 172.21.15.151:0/2971958334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35581004e0 0x7f355810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.935+0000 7f35603ff700 1 --2- 172.21.15.151:0/2971958334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3558105b60 0x7f3558105f30 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.935+0000 7f35603ff700 1 --2- 172.21.15.151:0/2971958334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35580ffb30 0x7f35580fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.935+0000 7f35603ff700 1 -- 172.21.15.151:0/2971958334 >> 172.21.15.151:0/2971958334 conn(0x7f35580fb5f0 msgr2=0x7f35580fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.936+0000 7f35603ff700 1 -- 172.21.15.151:0/2971958334 shutdown_connections 2023-07-21T22:38:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.936+0000 7f35603ff700 1 -- 172.21.15.151:0/2971958334 wait complete. 2023-07-21T22:38:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.937+0000 7f35603ff700 1 Processor -- start 2023-07-21T22:38:52.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.937+0000 7f35603ff700 1 -- start start 2023-07-21T22:38:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f35603ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35580ffb30 0x7f355819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f35603ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35581004e0 0x7f355819d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f35603ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3558105b60 0x7f3558198090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f35603ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35581987d0 con 0x7f3558105b60 2023-07-21T22:38:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f35603ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558198940 con 0x7f35581004e0 2023-07-21T22:38:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f35603ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3558198b00 con 0x7f35580ffb30 2023-07-21T22:38:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f355d99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35581004e0 0x7f355819d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f355d99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35581004e0 0x7f355819d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42602/0 (socket says 172.21.15.151:42602) 2023-07-21T22:38:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f355d99a700 1 -- 172.21.15.151:0/2149789039 learned_addr learned my addr 172.21.15.151:0/2149789039 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f355e99c700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3558105b60 0x7f3558198090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.938+0000 7f355e19b700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35580ffb30 0x7f355819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.939+0000 7f355d99a700 1 -- 172.21.15.151:0/2149789039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35580ffb30 msgr2=0x7f355819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.939+0000 7f355d99a700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35580ffb30 0x7f355819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.939+0000 7f355d99a700 1 -- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3558105b60 msgr2=0x7f3558198090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.939+0000 7f355d99a700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3558105b60 0x7f3558198090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.939+0000 7f355d99a700 1 -- 172.21.15.151:0/2149789039 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35540095f0 con 0x7f35581004e0 2023-07-21T22:38:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.939+0000 7f355e99c700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3558105b60 0x7f3558198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:52.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.939+0000 7f355d99a700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35581004e0 0x7f355819d0f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f354800e9a0 tx=0x7f354800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.939+0000 7f354f7fe700 1 -- 172.21.15.151:0/2149789039 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548009790 con 0x7f35581004e0 2023-07-21T22:38:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.940+0000 7f35603ff700 1 -- 172.21.15.151:0/2149789039 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3558198de0 con 0x7f35581004e0 2023-07-21T22:38:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.940+0000 7f354f7fe700 1 -- 172.21.15.151:0/2149789039 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3548010430 con 0x7f35581004e0 2023-07-21T22:38:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.940+0000 7f354f7fe700 1 -- 172.21.15.151:0/2149789039 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354800cea0 con 0x7f35581004e0 2023-07-21T22:38:52.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.940+0000 7f35603ff700 1 -- 172.21.15.151:0/2149789039 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35581a4d70 con 0x7f35581004e0 2023-07-21T22:38:52.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.944+0000 7f354f7fe700 1 -- 172.21.15.151:0/2149789039 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f35480105a0 con 0x7f35581004e0 2023-07-21T22:38:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.945+0000 7f3573ce5b80 1 Processor -- start 2023-07-21T22:38:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.946+0000 7f3573ce5b80 1 -- start start 2023-07-21T22:38:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.946+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd84cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.946+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd7ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.946+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85660 0x55c92fd7f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.946+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fc84c50 con 0x55c92fbdb6b0 2023-07-21T22:38:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.946+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fcd79e0 con 0x55c92fd85210 2023-07-21T22:38:52.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.946+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fcd0e70 con 0x55c92fd85660 2023-07-21T22:38:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd7ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355d99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85660 0x55c92fd7f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd7ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42604/0 (socket says 172.21.15.151:42604) 2023-07-21T22:38:52.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e19b700 1 -- 172.21.15.151:0/1020999535 learned_addr learned my addr 172.21.15.151:0/1020999535 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e99c700 1 --2- 172.21.15.151:0/1020999535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd84cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f354f7fe700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35440a1340 0x7f35440a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e19b700 1 -- 172.21.15.151:0/1020999535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85660 msgr2=0x55c92fd7f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e19b700 1 --2- 172.21.15.151:0/1020999535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85660 0x55c92fd7f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e19b700 1 -- 172.21.15.151:0/1020999535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 msgr2=0x55c92fd84cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e19b700 1 --2- 172.21.15.151:0/1020999535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd84cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e19b700 1 -- 172.21.15.151:0/1020999535 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c92fafed80 con 0x55c92fd85210 2023-07-21T22:38:52.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f354f7fe700 1 -- 172.21.15.151:0/2149789039 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(114..114 src has 1..114) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3548014070 con 0x7f35581004e0 2023-07-21T22:38:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.947+0000 7f355e99c700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35440a1340 0x7f35440a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.948+0000 7f355e19b700 1 --2- 172.21.15.151:0/1020999535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd7ef40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3554015000 tx=0x7f3554005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1cacd702bbfd0eef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.948+0000 7f354cbfe700 1 -- 172.21.15.151:0/1020999535 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355401d070 con 0x55c92fd85210 2023-07-21T22:38:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.948+0000 7f354cbfe700 1 -- 172.21.15.151:0/1020999535 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f355401e040 con 0x55c92fd85210 2023-07-21T22:38:52.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.948+0000 7f354cbfe700 1 -- 172.21.15.151:0/1020999535 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554004830 con 0x55c92fd85210 2023-07-21T22:38:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f3573ce5b80 1 -- 172.21.15.151:0/1020999535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 msgr2=0x55c92fd7ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f355e99c700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35440a1340 0x7f35440a37f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3550009110 tx=0x7f3550004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/1020999535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd7ef40 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3554015000 tx=0x7f3554005f00 comp rx=0 tx=0).stop 2023-07-21T22:38:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f3573ce5b80 1 -- 172.21.15.151:0/1020999535 shutdown_connections 2023-07-21T22:38:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/1020999535 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85660 0x55c92fd7f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/1020999535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd84cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/1020999535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd7ef40 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f3573ce5b80 1 -- 172.21.15.151:0/1020999535 >> 172.21.15.151:0/1020999535 conn(0x55c92fd74ae0 msgr2=0x55c92fd7a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f3573ce5b80 1 -- 172.21.15.151:0/1020999535 shutdown_connections 2023-07-21T22:38:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.949+0000 7f3573ce5b80 1 -- 172.21.15.151:0/1020999535 wait complete. 2023-07-21T22:38:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.950+0000 7f3573ce5b80 1 -- start start 2023-07-21T22:38:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.950+0000 7f3573ce5b80 1 Processor -- start 2023-07-21T22:38:52.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.950+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fbdb6b0 0x55c92fd8b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.950+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd88800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.950+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd85660 0x55c92fd88e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.950+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fc70a60 con 0x55c92fd85660 2023-07-21T22:38:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.950+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fc70760 con 0x55c92fd85210 2023-07-21T22:38:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.950+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fb548c0 con 0x55c92fbdb6b0 2023-07-21T22:38:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f3573ce5b80 10 client.0 _ll_register_callbacks cb 0x55c92fc6e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd85660 0x55c92fd88e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fbdb6b0 0x55c92fd8b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd85660 0x55c92fd88e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57910/0 (socket says 172.21.15.151:57910) 2023-07-21T22:38:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e99c700 1 -- 172.21.15.151:0/2863426792 learned_addr learned my addr 172.21.15.151:0/2863426792 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e19b700 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fbdb6b0 0x55c92fd8b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54966/0 (socket says 172.21.15.151:54966) 2023-07-21T22:38:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355d99a700 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd88800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e99c700 1 -- 172.21.15.151:0/2863426792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fbdb6b0 msgr2=0x55c92fd8b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e99c700 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fbdb6b0 0x55c92fd8b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e99c700 1 -- 172.21.15.151:0/2863426792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 msgr2=0x55c92fd88800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:52.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e99c700 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd88800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e99c700 1 -- 172.21.15.151:0/2863426792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355810d220 con 0x55c92fd85660 2023-07-21T22:38:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355e19b700 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fbdb6b0 0x55c92fd8b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.951+0000 7f355d99a700 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd88800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:38:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.952+0000 7f355e99c700 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd85660 0x55c92fd88e10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3550007a80 tx=0x7f355000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae765b56ff31a77 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:52.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.952+0000 7f3541ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:38:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.952+0000 7f3541ffb700 1 -- 172.21.15.151:0/2863426792 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355000eb00 con 0x55c92fd85660 2023-07-21T22:38:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.952+0000 7f3541ffb700 1 -- 172.21.15.151:0/2863426792 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f355000ec60 con 0x55c92fd85660 2023-07-21T22:38:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.952+0000 7f3573ce5b80 1 -- 172.21.15.151:0/2863426792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c92fc2a490 con 0x55c92fd85660 2023-07-21T22:38:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.953+0000 7f3541ffb700 1 -- 172.21.15.151:0/2863426792 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3550007ea0 con 0x55c92fd85660 2023-07-21T22:38:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.953+0000 7f3573ce5b80 10 client.17892 fetch_fsmap learned FSMap version 71 2023-07-21T22:38:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.953+0000 7f3573ce5b80 1 -- 172.21.15.151:0/2863426792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x55c92fae7c00 con 0x55c92fd85660 2023-07-21T22:38:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.953+0000 7f3541ffb700 1 -- 172.21.15.151:0/2863426792 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c92fc2a490 con 0x55c92fd85660 2023-07-21T22:38:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.953+0000 7f3541ffb700 1 -- 172.21.15.151:0/2863426792 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3550017440 con 0x55c92fd85660 2023-07-21T22:38:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.954+0000 7f3573ce5b80 10 client.17892 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:38:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.954+0000 7f3573ce5b80 10 client.17892 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:38:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.954+0000 7f3573ce5b80 20 client.17892 populate_metadata read hostname 'smithi151' 2023-07-21T22:38:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.954+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c92fd98a60 0x55c92fd9ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.954+0000 7f3573ce5b80 4 client.17892 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:38:53.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.954+0000 7f3573ce5b80 1 -- 172.21.15.151:0/2863426792 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c92fcc9e50 con 0x55c92fd98a60 2023-07-21T22:38:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.954+0000 7f355e19b700 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c92fd98a60 0x55c92fd9ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.954+0000 7f3541ffb700 10 client.17892 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.954+0000 7f355e19b700 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c92fd98a60 0x55c92fd9ae70 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87d4de19313320b server_cookie=22b052ca417123 in_seq=0 out_seq=0 2023-07-21T22:38:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.955+0000 7f3541ffb700 1 -- 172.21.15.151:0/2863426792 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c92fcc9e50 con 0x55c92fd98a60 2023-07-21T22:38:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.955+0000 7f3541ffb700 10 client.17892 handle_command_reply: tid=0 2023-07-21T22:38:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.955+0000 7f3573ce5b80 1 client.17892 shutdown 2023-07-21T22:38:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 -- 172.21.15.151:0/2863426792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd85660 msgr2=0x55c92fd88e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd85660 0x55c92fd88e10 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f3550007a80 tx=0x7f355000b040 comp rx=0 tx=0).stop 2023-07-21T22:38:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 -- 172.21.15.151:0/2863426792 shutdown_connections 2023-07-21T22:38:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c92fd98a60 0x55c92fd9ae70 crc :-1 s=READY pgs=272 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd85660 0x55c92fd88e10 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fbdb6b0 0x55c92fd8b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3541ffb700 0 client.17892 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/2863426792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd88800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 -- 172.21.15.151:0/2863426792 >> 172.21.15.151:0/2863426792 conn(0x55c92fd74ae0 msgr2=0x55c92fd793e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:53.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 -- 172.21.15.151:0/2863426792 shutdown_connections 2023-07-21T22:38:53.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 1 -- 172.21.15.151:0/2863426792 wait complete. 2023-07-21T22:38:53.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.956+0000 7f3573ce5b80 20 client.17892 trim_cache size 0 max 16384 2023-07-21T22:38:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.974+0000 7f3573ce5b80 1 Processor -- start 2023-07-21T22:38:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f3573ce5b80 1 -- start start 2023-07-21T22:38:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd74ae0 0x55c92fd86330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fbdb6b0 0x55c92fd7ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85210 0x55c92fd8fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fd89410 con 0x55c92fd74ae0 2023-07-21T22:38:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fd7f480 con 0x55c92fbdb6b0 2023-07-21T22:38:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fd86db0 con 0x55c92fd85210 2023-07-21T22:38:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f355e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd74ae0 0x55c92fd86330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f355e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd74ae0 0x55c92fd86330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57914/0 (socket says 172.21.15.151:57914) 2023-07-21T22:38:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f355e19b700 1 -- 172.21.15.151:0/3139219813 learned_addr learned my addr 172.21.15.151:0/3139219813 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f355d99a700 1 --2- 172.21.15.151:0/3139219813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fbdb6b0 0x55c92fd7ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.975+0000 7f355e99c700 1 --2- 172.21.15.151:0/3139219813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85210 0x55c92fd8fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.976+0000 7f355e19b700 1 -- 172.21.15.151:0/3139219813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85210 msgr2=0x55c92fd8fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.976+0000 7f355e19b700 1 --2- 172.21.15.151:0/3139219813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85210 0x55c92fd8fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.976+0000 7f355e19b700 1 -- 172.21.15.151:0/3139219813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fbdb6b0 msgr2=0x55c92fd7ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.976+0000 7f355e19b700 1 --2- 172.21.15.151:0/3139219813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fbdb6b0 0x55c92fd7ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.976+0000 7f355e19b700 1 -- 172.21.15.151:0/3139219813 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c92fb251f0 con 0x55c92fd74ae0 2023-07-21T22:38:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.976+0000 7f355e19b700 1 --2- 172.21.15.151:0/3139219813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd74ae0 0x55c92fd86330 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3554009990 tx=0x7f355401a040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=635f29f8ebfdf981 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.976+0000 7f354d3ff700 1 -- 172.21.15.151:0/3139219813 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355401d040 con 0x55c92fd74ae0 2023-07-21T22:38:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.976+0000 7f354d3ff700 1 -- 172.21.15.151:0/3139219813 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3554034340 con 0x55c92fd74ae0 2023-07-21T22:38:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.976+0000 7f354d3ff700 1 -- 172.21.15.151:0/3139219813 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3554034e70 con 0x55c92fd74ae0 2023-07-21T22:38:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.977+0000 7f3573ce5b80 1 -- 172.21.15.151:0/3139219813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd74ae0 msgr2=0x55c92fd86330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.977+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/3139219813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd74ae0 0x55c92fd86330 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f3554009990 tx=0x7f355401a040 comp rx=0 tx=0).stop 2023-07-21T22:38:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.977+0000 7f3573ce5b80 1 -- 172.21.15.151:0/3139219813 shutdown_connections 2023-07-21T22:38:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.977+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/3139219813 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd85210 0x55c92fd8fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.977+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/3139219813 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fd74ae0 0x55c92fd86330 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.977+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/3139219813 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fbdb6b0 0x55c92fd7ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.977+0000 7f3573ce5b80 1 -- 172.21.15.151:0/3139219813 >> 172.21.15.151:0/3139219813 conn(0x55c92fd946b0 msgr2=0x55c92fd87000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.977+0000 7f3573ce5b80 1 -- 172.21.15.151:0/3139219813 shutdown_connections 2023-07-21T22:38:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.977+0000 7f3573ce5b80 1 -- 172.21.15.151:0/3139219813 wait complete. 2023-07-21T22:38:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.978+0000 7f3573ce5b80 1 -- start start 2023-07-21T22:38:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.978+0000 7f3573ce5b80 1 Processor -- start 2023-07-21T22:38:53.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd81900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd74ae0 0x55c92fd81e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f3573ce5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd80730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fd90150 con 0x55c92fbdb6b0 2023-07-21T22:38:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fd80c70 con 0x55c92fd85210 2023-07-21T22:38:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f3573ce5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c92fd80e30 con 0x55c92fd74ae0 2023-07-21T22:38:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f3573ce5b80 10 client.0 _ll_register_callbacks cb 0x7f3550004960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:38:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd81900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355d99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd74ae0 0x55c92fd81e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355e19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd81900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57924/0 (socket says 172.21.15.151:57924) 2023-07-21T22:38:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355e19b700 1 -- 172.21.15.151:0/4195452276 learned_addr learned my addr 172.21.15.151:0/4195452276 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:38:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355e99c700 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd80730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355d99a700 1 -- 172.21.15.151:0/4195452276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 msgr2=0x55c92fd80730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355d99a700 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd80730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355d99a700 1 -- 172.21.15.151:0/4195452276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 msgr2=0x55c92fd81900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:38:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355d99a700 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd81900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355d99a700 1 -- 172.21.15.151:0/4195452276 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c92fafed80 con 0x55c92fd74ae0 2023-07-21T22:38:53.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.979+0000 7f355e19b700 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd81900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:38:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.980+0000 7f355d99a700 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd74ae0 0x55c92fd81e40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35480ca600 tx=0x7f35480cab60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65172aa5138672a2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:38:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.980+0000 7f3541ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:38:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.980+0000 7f3541ffb700 1 -- 172.21.15.151:0/4195452276 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3548010880 con 0x55c92fd74ae0 2023-07-21T22:38:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.980+0000 7f3541ffb700 1 -- 172.21.15.151:0/4195452276 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(114..114 src has 1..114) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3548099f80 con 0x55c92fd74ae0 2023-07-21T22:38:53.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.980+0000 7f3573ce5b80 1 -- 172.21.15.151:0/4195452276 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f355401e040 con 0x55c92fd74ae0 2023-07-21T22:38:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.980+0000 7f3541ffb700 1 -- 172.21.15.151:0/4195452276 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f354809dfb0 con 0x55c92fd74ae0 2023-07-21T22:38:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.980+0000 7f3573ce5b80 10 client.27604 fetch_fsmap learned FSMap version 71 2023-07-21T22:38:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.980+0000 7f3573ce5b80 1 -- 172.21.15.151:0/4195452276 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x55c92fafd250 con 0x55c92fd74ae0 2023-07-21T22:38:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.981+0000 7f3541ffb700 1 -- 172.21.15.151:0/4195452276 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f355401e040 con 0x55c92fd74ae0 2023-07-21T22:38:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.981+0000 7f3541ffb700 1 -- 172.21.15.151:0/4195452276 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f3548095d70 con 0x55c92fd74ae0 2023-07-21T22:38:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.981+0000 7f3573ce5b80 10 client.27604 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:38:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.981+0000 7f3573ce5b80 10 client.27604 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:38:53.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.981+0000 7f3573ce5b80 20 client.27604 populate_metadata read hostname 'smithi151' 2023-07-21T22:38:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.981+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c92fd85660 0x55c92fdf7f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:38:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.981+0000 7f3573ce5b80 4 client.27604 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:38:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.981+0000 7f3573ce5b80 1 -- 172.21.15.151:0/4195452276 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c92fc8bff0 con 0x55c92fd85660 2023-07-21T22:38:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.981+0000 7f355e19b700 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c92fd85660 0x55c92fdf7f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:38:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.982+0000 7f355e19b700 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c92fd85660 0x55c92fdf7f70 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1bcad8eed5e226f server_cookie=574e705d602db3ae in_seq=0 out_seq=0 2023-07-21T22:38:53.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.982+0000 7f3541ffb700 10 client.27604 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.993+0000 7f3541ffb700 1 -- 172.21.15.151:0/4195452276 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c92fc8bff0 con 0x55c92fd85660 2023-07-21T22:38:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.993+0000 7f3541ffb700 10 client.27604 handle_command_reply: tid=0 2023-07-21T22:38:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.993+0000 7f3573ce5b80 1 client.27604 shutdown 2023-07-21T22:38:53.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 -- 172.21.15.151:0/4195452276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd74ae0 msgr2=0x55c92fd81e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd74ae0 0x55c92fd81e40 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f35480ca600 tx=0x7f35480cab60 comp rx=0 tx=0).stop 2023-07-21T22:38:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 -- 172.21.15.151:0/4195452276 shutdown_connections 2023-07-21T22:38:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c92fd85660 0x55c92fdf7f70 crc :-1 s=READY pgs=273 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c92fd85210 0x55c92fd80730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c92fbdb6b0 0x55c92fd81900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 --2- 172.21.15.151:0/4195452276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c92fd74ae0 0x55c92fd81e40 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 -- 172.21.15.151:0/4195452276 >> 172.21.15.151:0/4195452276 conn(0x55c92fd946b0 msgr2=0x55c92fd861a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:53.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3541ffb700 0 client.27604 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:38:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 -- 172.21.15.151:0/4195452276 shutdown_connections 2023-07-21T22:38:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 1 -- 172.21.15.151:0/4195452276 wait complete. 2023-07-21T22:38:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.994+0000 7f3573ce5b80 20 client.27604 trim_cache size 0 max 16384 2023-07-21T22:38:53.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:38:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:38:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:38:53.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:38:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 -- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35440a1340 msgr2=0x7f35440a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35440a1340 0x7f35440a37f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3550009110 tx=0x7f3550004ad0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 -- 172.21.15.151:0/2149789039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35581004e0 msgr2=0x7f355819d0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:38:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35581004e0 0x7f355819d0f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f354800e9a0 tx=0x7f354800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 -- 172.21.15.151:0/2149789039 shutdown_connections 2023-07-21T22:38:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f35440a1340 0x7f35440a37f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3558105b60 0x7f3558198090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f35580ffb30 0x7f355819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 --2- 172.21.15.151:0/2149789039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35581004e0 0x7f355819d0f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:38:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 -- 172.21.15.151:0/2149789039 >> 172.21.15.151:0/2149789039 conn(0x7f35580fb5f0 msgr2=0x7f35580fbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:38:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 -- 172.21.15.151:0/2149789039 shutdown_connections 2023-07-21T22:38:53.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:38:52.995+0000 7f35603ff700 1 -- 172.21.15.151:0/2149789039 wait complete. 2023-07-21T22:38:54.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:54 smithi187 ceph-mon[96918]: pgmap v620: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.1 MiB/s wr, 537 op/s 2023-07-21T22:38:54.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:54 smithi195 ceph-mon[97365]: pgmap v620: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.1 MiB/s wr, 537 op/s 2023-07-21T22:38:54.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:54 smithi151 ceph-mon[95510]: pgmap v620: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 4.1 MiB/s wr, 537 op/s 2023-07-21T22:38:56.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:56 smithi187 ceph-mon[96918]: pgmap v621: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 MiB/s wr, 348 op/s 2023-07-21T22:38:56.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:56 smithi195 ceph-mon[97365]: pgmap v621: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 MiB/s wr, 348 op/s 2023-07-21T22:38:56.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:56 smithi151 ceph-mon[95510]: pgmap v621: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.7 MiB/s wr, 348 op/s 2023-07-21T22:38:58.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:38:58 smithi187 ceph-mon[96918]: pgmap v622: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 505 op/s 2023-07-21T22:38:58.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:38:58 smithi195 ceph-mon[97365]: pgmap v622: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 505 op/s 2023-07-21T22:38:58.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:38:58 smithi151 ceph-mon[95510]: pgmap v622: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.9 MiB/s wr, 505 op/s 2023-07-21T22:39:00.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:00 smithi187 ceph-mon[96918]: pgmap v623: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-07-21T22:39:00.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:00 smithi195 ceph-mon[97365]: pgmap v623: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-07-21T22:39:00.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:00 smithi151 ceph-mon[95510]: pgmap v623: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-07-21T22:39:02.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:02 smithi187 ceph-mon[96918]: pgmap v624: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-07-21T22:39:02.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:02 smithi195 ceph-mon[97365]: pgmap v624: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-07-21T22:39:02.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:02 smithi151 ceph-mon[95510]: pgmap v624: 97 pgs: 97 active+clean; 9.4 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.5 MiB/s wr, 326 op/s 2023-07-21T22:39:04.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:04 smithi187 ceph-mon[96918]: pgmap v625: 97 pgs: 97 active+clean; 9.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 493 op/s 2023-07-21T22:39:04.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:04 smithi195 ceph-mon[97365]: pgmap v625: 97 pgs: 97 active+clean; 9.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 493 op/s 2023-07-21T22:39:04.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:04 smithi151 ceph-mon[95510]: pgmap v625: 97 pgs: 97 active+clean; 9.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 493 op/s 2023-07-21T22:39:05.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:05 smithi187 ceph-mon[96918]: osdmap e115: 12 total, 12 up, 12 in 2023-07-21T22:39:05.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:05 smithi195 ceph-mon[97365]: osdmap e115: 12 total, 12 up, 12 in 2023-07-21T22:39:05.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:05 smithi151 ceph-mon[95510]: osdmap e115: 12 total, 12 up, 12 in 2023-07-21T22:39:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.173+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2833211052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac1004e0 msgr2=0x7fcdac10c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.173+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2833211052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac1004e0 0x7fcdac10c920 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fcda400b0a0 tx=0x7fcda400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.173+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2833211052 shutdown_connections 2023-07-21T22:39:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.173+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2833211052 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdac105b60 0x7fcdac105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.173+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2833211052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac1004e0 0x7fcdac10c920 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.173+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2833211052 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac0ffb30 0x7fcdac0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.173+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2833211052 >> 172.21.15.151:0/2833211052 conn(0x7fcdac0fb5f0 msgr2=0x7fcdac0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.173+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2833211052 shutdown_connections 2023-07-21T22:39:06.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.173+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2833211052 wait complete. 2023-07-21T22:39:06.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.174+0000 7fcdb1fff700 1 Processor -- start 2023-07-21T22:39:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.174+0000 7fcdb1fff700 1 -- start start 2023-07-21T22:39:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdb1fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ffb30 0x7fcdac0729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdb1fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac1004e0 0x7fcdac072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdb1fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdac105b60 0x7fcdac1a3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdb1fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1a4350 con 0x7fcdac0ffb30 2023-07-21T22:39:06.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdb1fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1a4490 con 0x7fcdac105b60 2023-07-21T22:39:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdb1fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac1a4600 con 0x7fcdac1004e0 2023-07-21T22:39:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ffb30 0x7fcdac0729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ffb30 0x7fcdac0729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33666/0 (socket says 172.21.15.151:33666) 2023-07-21T22:39:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdab7fe700 1 -- 172.21.15.151:0/2752598155 learned_addr learned my addr 172.21.15.151:0/2752598155 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac1004e0 0x7fcdac072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdabfff700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdac105b60 0x7fcdac1a3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdaaffd700 1 -- 172.21.15.151:0/2752598155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdac105b60 msgr2=0x7fcdac1a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdac105b60 0x7fcdac1a3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdaaffd700 1 -- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ffb30 msgr2=0x7fcdac0729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ffb30 0x7fcdac0729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdaaffd700 1 -- 172.21.15.151:0/2752598155 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda4009d00 con 0x7fcdac1004e0 2023-07-21T22:39:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.175+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ffb30 0x7fcdac0729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:06.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.176+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac1004e0 0x7fcdac072f30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcda000e9f0 tx=0x7fcda000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.176+0000 7fcda8ff9700 1 -- 172.21.15.151:0/2752598155 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda000c9c0 con 0x7fcdac1004e0 2023-07-21T22:39:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.176+0000 7fcda8ff9700 1 -- 172.21.15.151:0/2752598155 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcda0010430 con 0x7fcdac1004e0 2023-07-21T22:39:06.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.176+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2752598155 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac1a48e0 con 0x7fcdac1004e0 2023-07-21T22:39:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.176+0000 7fcda8ff9700 1 -- 172.21.15.151:0/2752598155 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0018680 con 0x7fcdac1004e0 2023-07-21T22:39:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.176+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2752598155 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac1a4e40 con 0x7fcdac1004e0 2023-07-21T22:39:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.180+0000 7fcda8ff9700 1 -- 172.21.15.151:0/2752598155 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fcda00105a0 con 0x7fcdac1004e0 2023-07-21T22:39:06.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.181+0000 7fcdc591eb80 1 Processor -- start 2023-07-21T22:39:06.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.181+0000 7fcdc591eb80 1 -- start start 2023-07-21T22:39:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.181+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec7d06b0 0x55b5ec979cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.181+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec973f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.181+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a660 0x55b5ec9744a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.181+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec879c50 con 0x55b5ec97a660 2023-07-21T22:39:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.181+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec8cc9e0 con 0x55b5ec7d06b0 2023-07-21T22:39:06.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.181+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec8c5e70 con 0x55b5ec97a210 2023-07-21T22:39:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcda8ff9700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd940a1340 0x7fcd940a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdabfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec7d06b0 0x55b5ec979cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec973f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdabfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec7d06b0 0x55b5ec979cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54188/0 (socket says 172.21.15.151:54188) 2023-07-21T22:39:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdabfff700 1 -- 172.21.15.151:0/540726508 learned_addr learned my addr 172.21.15.151:0/540726508 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:06.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcda8ff9700 1 -- 172.21.15.151:0/2752598155 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(115..115 src has 1..115) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fcda0014070 con 0x7fcdac1004e0 2023-07-21T22:39:06.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/540726508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a660 0x55b5ec9744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdab7fe700 1 -- 172.21.15.151:0/540726508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec7d06b0 msgr2=0x55b5ec979cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/540726508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec7d06b0 0x55b5ec979cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdab7fe700 1 -- 172.21.15.151:0/540726508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a660 msgr2=0x55b5ec9744a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdabfff700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd940a1340 0x7fcd940a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/540726508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a660 0x55b5ec9744a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdab7fe700 1 -- 172.21.15.151:0/540726508 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ec6f3d80 con 0x55b5ec97a210 2023-07-21T22:39:06.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/540726508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a660 0x55b5ec9744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.182+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/540726508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec973f40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0114c0 tx=0x7fcd9c0117d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88c7d56bcbfc0b6b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.183+0000 7fcd91ffb700 1 -- 172.21.15.151:0/540726508 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c004230 con 0x55b5ec97a210 2023-07-21T22:39:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.183+0000 7fcd91ffb700 1 -- 172.21.15.151:0/540726508 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd9c004390 con 0x55b5ec97a210 2023-07-21T22:39:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.183+0000 7fcd91ffb700 1 -- 172.21.15.151:0/540726508 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c00e810 con 0x55b5ec97a210 2023-07-21T22:39:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.183+0000 7fcdabfff700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd940a1340 0x7fcd940a37f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009cd0 tx=0x7fcda400b3b0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.184+0000 7fcdc591eb80 1 -- 172.21.15.151:0/540726508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 msgr2=0x55b5ec973f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.184+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/540726508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec973f40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c0114c0 tx=0x7fcd9c0117d0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.184+0000 7fcdc591eb80 1 -- 172.21.15.151:0/540726508 shutdown_connections 2023-07-21T22:39:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.184+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/540726508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec7d06b0 0x55b5ec979cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.184+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/540726508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a660 0x55b5ec9744a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.184+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/540726508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec973f40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.184+0000 7fcdc591eb80 1 -- 172.21.15.151:0/540726508 >> 172.21.15.151:0/540726508 conn(0x55b5ec969ae0 msgr2=0x55b5ec96f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.184+0000 7fcdc591eb80 1 -- 172.21.15.151:0/540726508 shutdown_connections 2023-07-21T22:39:06.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.184+0000 7fcdc591eb80 1 -- 172.21.15.151:0/540726508 wait complete. 2023-07-21T22:39:06.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.185+0000 7fcdc591eb80 1 -- start start 2023-07-21T22:39:06.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.185+0000 7fcdc591eb80 1 Processor -- start 2023-07-21T22:39:06.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.185+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec7d06b0 0x55b5ec9804b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a210 0x55b5ec97d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 0x55b5ec97dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec865a60 con 0x55b5ec97a210 2023-07-21T22:39:06.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec865760 con 0x55b5ec97a660 2023-07-21T22:39:06.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec7498c0 con 0x55b5ec7d06b0 2023-07-21T22:39:06.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdc591eb80 10 client.0 _ll_register_callbacks cb 0x55b5ec863700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:06.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec7d06b0 0x55b5ec9804b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec7d06b0 0x55b5ec9804b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33190/0 (socket says 172.21.15.151:33190) 2023-07-21T22:39:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdab7fe700 1 -- 172.21.15.151:0/3786235474 learned_addr learned my addr 172.21.15.151:0/3786235474 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a210 0x55b5ec97d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdabfff700 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 0x55b5ec97dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdab7fe700 1 -- 172.21.15.151:0/3786235474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 msgr2=0x55b5ec97dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 0x55b5ec97dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdab7fe700 1 -- 172.21.15.151:0/3786235474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a210 msgr2=0x55b5ec97d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:06.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a210 0x55b5ec97d730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdab7fe700 1 -- 172.21.15.151:0/3786235474 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd9c009ce0 con 0x55b5ec7d06b0 2023-07-21T22:39:06.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.186+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a210 0x55b5ec97d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:06.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.187+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec7d06b0 0x55b5ec9804b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009850 tx=0x7fcd9c0052f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fecaeba37d401c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:06.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.187+0000 7fcd8affd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:39:06.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.187+0000 7fcd8affd700 1 -- 172.21.15.151:0/3786235474 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c004950 con 0x55b5ec7d06b0 2023-07-21T22:39:06.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.187+0000 7fcdc591eb80 1 -- 172.21.15.151:0/3786235474 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5ec81f490 con 0x55b5ec7d06b0 2023-07-21T22:39:06.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.187+0000 7fcd8affd700 1 -- 172.21.15.151:0/3786235474 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fcd9c004ab0 con 0x55b5ec7d06b0 2023-07-21T22:39:06.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.187+0000 7fcd8affd700 1 -- 172.21.15.151:0/3786235474 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd9c004c70 con 0x55b5ec7d06b0 2023-07-21T22:39:06.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.187+0000 7fcdc591eb80 10 client.27616 fetch_fsmap learned FSMap version 71 2023-07-21T22:39:06.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.187+0000 7fcdc591eb80 1 -- 172.21.15.151:0/3786235474 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x55b5ec6dcc00 con 0x55b5ec7d06b0 2023-07-21T22:39:06.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.188+0000 7fcd8affd700 1 -- 172.21.15.151:0/3786235474 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b5ec81f490 con 0x55b5ec7d06b0 2023-07-21T22:39:06.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.188+0000 7fcd8affd700 1 -- 172.21.15.151:0/3786235474 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcd9c028020 con 0x55b5ec7d06b0 2023-07-21T22:39:06.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.188+0000 7fcdc591eb80 10 client.27616 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:39:06.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.188+0000 7fcdc591eb80 10 client.27616 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:06.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.188+0000 7fcdc591eb80 20 client.27616 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:06.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.188+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ec98d930 0x55b5ec98fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.188+0000 7fcdc591eb80 4 client.27616 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:39:06.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.188+0000 7fcdc591eb80 1 -- 172.21.15.151:0/3786235474 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5ec8bee50 con 0x55b5ec98d930 2023-07-21T22:39:06.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.188+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ec98d930 0x55b5ec98fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.189+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ec98d930 0x55b5ec98fd40 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5c3f6cfd1f69d0 server_cookie=db3a073f107ec692 in_seq=0 out_seq=0 2023-07-21T22:39:06.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.189+0000 7fcd8affd700 10 client.27616 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:06.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcd8affd700 1 -- 172.21.15.151:0/3786235474 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b5ec8bee50 con 0x55b5ec98d930 2023-07-21T22:39:06.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcd8affd700 10 client.27616 handle_command_reply: tid=0 2023-07-21T22:39:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 client.27616 shutdown 2023-07-21T22:39:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 -- 172.21.15.151:0/3786235474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec7d06b0 msgr2=0x55b5ec9804b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec7d06b0 0x55b5ec9804b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c009850 tx=0x7fcd9c0052f0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 -- 172.21.15.151:0/3786235474 shutdown_connections 2023-07-21T22:39:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ec98d930 0x55b5ec98fd40 crc :-1 s=READY pgs=274 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 0x55b5ec97dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec7d06b0 0x55b5ec9804b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/3786235474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec97a210 0x55b5ec97d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcd8affd700 0 client.27616 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 -- 172.21.15.151:0/3786235474 >> 172.21.15.151:0/3786235474 conn(0x55b5ec969ae0 msgr2=0x55b5ec96e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 -- 172.21.15.151:0/3786235474 shutdown_connections 2023-07-21T22:39:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.190+0000 7fcdc591eb80 1 -- 172.21.15.151:0/3786235474 wait complete. 2023-07-21T22:39:06.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.191+0000 7fcdc591eb80 20 client.27616 trim_cache size 0 max 16384 2023-07-21T22:39:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.208+0000 7fcdc591eb80 1 Processor -- start 2023-07-21T22:39:06.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.208+0000 7fcdc591eb80 1 -- start start 2023-07-21T22:39:06.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec97d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec984c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 0x55b5ec97ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec966b20 con 0x55b5ec7d06b0 2023-07-21T22:39:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec979920 con 0x55b5ec97a660 2023-07-21T22:39:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec96fd50 con 0x55b5ec97a210 2023-07-21T22:39:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec97d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdaaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec984c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdaaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec984c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33198/0 (socket says 172.21.15.151:33198) 2023-07-21T22:39:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec97d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33708/0 (socket says 172.21.15.151:33708) 2023-07-21T22:39:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdaaffd700 1 -- 172.21.15.151:0/4088711197 learned_addr learned my addr 172.21.15.151:0/4088711197 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdabfff700 1 --2- 172.21.15.151:0/4088711197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 0x55b5ec97ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdaaffd700 1 -- 172.21.15.151:0/4088711197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 msgr2=0x55b5ec97ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/4088711197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 0x55b5ec97ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdaaffd700 1 -- 172.21.15.151:0/4088711197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 msgr2=0x55b5ec97d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/4088711197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec97d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdaaffd700 1 -- 172.21.15.151:0/4088711197 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ec9707e0 con 0x55b5ec97a210 2023-07-21T22:39:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.209+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/4088711197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec97d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.210+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/4088711197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec984c30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcda0010b20 tx=0x7fcda00109d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=516b96ac97352d7a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.210+0000 7fcd927fc700 1 -- 172.21.15.151:0/4088711197 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda0099e80 con 0x55b5ec97a210 2023-07-21T22:39:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.210+0000 7fcd927fc700 1 -- 172.21.15.151:0/4088711197 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcda009deb0 con 0x55b5ec97a210 2023-07-21T22:39:06.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.210+0000 7fcd927fc700 1 -- 172.21.15.151:0/4088711197 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda00a1e40 con 0x55b5ec97a210 2023-07-21T22:39:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 -- 172.21.15.151:0/4088711197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 msgr2=0x55b5ec984c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/4088711197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec984c30 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcda0010b20 tx=0x7fcda00109d0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 -- 172.21.15.151:0/4088711197 shutdown_connections 2023-07-21T22:39:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/4088711197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a660 0x55b5ec97ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/4088711197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec97d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/4088711197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a210 0x55b5ec984c30 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 -- 172.21.15.151:0/4088711197 >> 172.21.15.151:0/4088711197 conn(0x55b5ec969ae0 msgr2=0x55b5ec97cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 -- 172.21.15.151:0/4088711197 shutdown_connections 2023-07-21T22:39:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 -- 172.21.15.151:0/4088711197 wait complete. 2023-07-21T22:39:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.211+0000 7fcdc591eb80 1 -- start start 2023-07-21T22:39:06.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdc591eb80 1 Processor -- start 2023-07-21T22:39:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec976900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a210 0x55b5ec976e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdc591eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a660 0x55b5ec975730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec977460 con 0x55b5ec7d06b0 2023-07-21T22:39:06.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec975c70 con 0x55b5ec97a210 2023-07-21T22:39:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdc591eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ec975e30 con 0x55b5ec97a660 2023-07-21T22:39:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdc591eb80 10 client.0 _ll_register_callbacks cb 0x7fcd9c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec976900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdab7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec976900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33710/0 (socket says 172.21.15.151:33710) 2023-07-21T22:39:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.212+0000 7fcdab7fe700 1 -- 172.21.15.151:0/749909216 learned_addr learned my addr 172.21.15.151:0/749909216 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdabfff700 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a660 0x55b5ec975730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a210 0x55b5ec976e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdab7fe700 1 -- 172.21.15.151:0/749909216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a660 msgr2=0x55b5ec975730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a660 0x55b5ec975730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdab7fe700 1 -- 172.21.15.151:0/749909216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a210 msgr2=0x55b5ec976e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a210 0x55b5ec976e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdab7fe700 1 -- 172.21.15.151:0/749909216 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b5ec6dcc00 con 0x55b5ec7d06b0 2023-07-21T22:39:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a210 0x55b5ec976e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:06.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdab7fe700 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec976900 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00e6a0 tx=0x7fcd9c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abdebee4aa14d909 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcd8affd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:39:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcd8affd700 1 -- 172.21.15.151:0/749909216 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd9c011230 con 0x55b5ec7d06b0 2023-07-21T22:39:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcd8affd700 1 -- 172.21.15.151:0/749909216 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(115..115 src has 1..115) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fcd9c00ee60 con 0x55b5ec7d06b0 2023-07-21T22:39:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.213+0000 7fcdc591eb80 1 -- 172.21.15.151:0/749909216 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcd9c004390 con 0x55b5ec7d06b0 2023-07-21T22:39:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcd8affd700 1 -- 172.21.15.151:0/749909216 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcd9c003e70 con 0x55b5ec7d06b0 2023-07-21T22:39:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcdc591eb80 10 client.17916 fetch_fsmap learned FSMap version 71 2023-07-21T22:39:06.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcdc591eb80 1 -- 172.21.15.151:0/749909216 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x7fcdac1a4e40 con 0x55b5ec7d06b0 2023-07-21T22:39:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcd8affd700 1 -- 172.21.15.151:0/749909216 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcd9c004390 con 0x55b5ec7d06b0 2023-07-21T22:39:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcd8affd700 1 -- 172.21.15.151:0/749909216 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fcd9c011840 con 0x55b5ec7d06b0 2023-07-21T22:39:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcdc591eb80 10 client.17916 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:39:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcdc591eb80 10 client.17916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcdc591eb80 20 client.17916 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ec9e2100 0x55b5ec9e44e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcdc591eb80 4 client.17916 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:39:06.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.214+0000 7fcdc591eb80 1 -- 172.21.15.151:0/749909216 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b5ec880ff0 con 0x55b5ec9e2100 2023-07-21T22:39:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.215+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ec9e2100 0x55b5ec9e44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.215+0000 7fcdaaffd700 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ec9e2100 0x55b5ec9e44e0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1b2feaa7612a6d8 server_cookie=b77946e21856ecb7 in_seq=0 out_seq=0 2023-07-21T22:39:06.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.215+0000 7fcd8affd700 10 client.17916 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.229+0000 7fcd8affd700 1 -- 172.21.15.151:0/749909216 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b5ec880ff0 con 0x55b5ec9e2100 2023-07-21T22:39:06.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.229+0000 7fcd8affd700 10 client.17916 handle_command_reply: tid=0 2023-07-21T22:39:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.229+0000 7fcdc591eb80 1 client.17916 shutdown 2023-07-21T22:39:06.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 -- 172.21.15.151:0/749909216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 msgr2=0x55b5ec976900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec976900 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fcd9c00e6a0 tx=0x7fcd9c0039c0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 -- 172.21.15.151:0/749909216 shutdown_connections 2023-07-21T22:39:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ec9e2100 0x55b5ec9e44e0 crc :-1 s=READY pgs=275 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ec97a660 0x55b5ec975730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ec7d06b0 0x55b5ec976900 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcd8affd700 0 client.17916 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 --2- 172.21.15.151:0/749909216 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ec97a210 0x55b5ec976e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 -- 172.21.15.151:0/749909216 >> 172.21.15.151:0/749909216 conn(0x55b5ec969ae0 msgr2=0x55b5ec97aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 -- 172.21.15.151:0/749909216 shutdown_connections 2023-07-21T22:39:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 1 -- 172.21.15.151:0/749909216 wait complete. 2023-07-21T22:39:06.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.230+0000 7fcdc591eb80 20 client.17916 trim_cache size 0 max 16384 2023-07-21T22:39:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:39:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:39:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:39:06.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:39:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd940a1340 msgr2=0x7fcd940a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd940a1340 0x7fcd940a37f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fcda4009cd0 tx=0x7fcda400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2752598155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac1004e0 msgr2=0x7fcdac072f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac1004e0 0x7fcdac072f30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcda000e9f0 tx=0x7fcda000ed00 comp rx=0 tx=0).stop 2023-07-21T22:39:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2752598155 shutdown_connections 2023-07-21T22:39:06.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcd940a1340 0x7fcd940a37f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcdac105b60 0x7fcdac1a3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdac0ffb30 0x7fcdac0729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 --2- 172.21.15.151:0/2752598155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcdac1004e0 0x7fcdac072f30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2752598155 >> 172.21.15.151:0/2752598155 conn(0x7fcdac0fb5f0 msgr2=0x7fcdac0fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2752598155 shutdown_connections 2023-07-21T22:39:06.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:06.231+0000 7fcdb1fff700 1 -- 172.21.15.151:0/2752598155 wait complete. 2023-07-21T22:39:06.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:06 smithi187 ceph-mon[96918]: pgmap v627: 97 pgs: 97 active+clean; 9.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 388 op/s 2023-07-21T22:39:06.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:06 smithi195 ceph-mon[97365]: pgmap v627: 97 pgs: 97 active+clean; 9.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 388 op/s 2023-07-21T22:39:06.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:06 smithi151 ceph-mon[95510]: pgmap v627: 97 pgs: 97 active+clean; 9.4 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 388 op/s 2023-07-21T22:39:08.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:08 smithi187 ceph-mon[96918]: pgmap v628: 97 pgs: 97 active+clean; 9.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 403 op/s 2023-07-21T22:39:08.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:08 smithi195 ceph-mon[97365]: pgmap v628: 97 pgs: 97 active+clean; 9.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 403 op/s 2023-07-21T22:39:08.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:08 smithi151 ceph-mon[95510]: pgmap v628: 97 pgs: 97 active+clean; 9.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 403 op/s 2023-07-21T22:39:10.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:10 smithi187 ceph-mon[96918]: pgmap v629: 97 pgs: 97 active+clean; 9.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 403 op/s 2023-07-21T22:39:10.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:10 smithi195 ceph-mon[97365]: pgmap v629: 97 pgs: 97 active+clean; 9.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 403 op/s 2023-07-21T22:39:10.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:10 smithi151 ceph-mon[95510]: pgmap v629: 97 pgs: 97 active+clean; 9.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 403 op/s 2023-07-21T22:39:12.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:12 smithi187 ceph-mon[96918]: pgmap v630: 97 pgs: 97 active+clean; 9.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 403 op/s 2023-07-21T22:39:12.877 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:12 smithi187 ceph-mon[96918]: osdmap e116: 12 total, 12 up, 12 in 2023-07-21T22:39:12.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:12 smithi195 ceph-mon[97365]: pgmap v630: 97 pgs: 97 active+clean; 9.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 403 op/s 2023-07-21T22:39:12.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:12 smithi195 ceph-mon[97365]: osdmap e116: 12 total, 12 up, 12 in 2023-07-21T22:39:12.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:12 smithi151 ceph-mon[95510]: pgmap v630: 97 pgs: 97 active+clean; 9.2 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.0 MiB/s wr, 403 op/s 2023-07-21T22:39:12.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:12 smithi151 ceph-mon[95510]: osdmap e116: 12 total, 12 up, 12 in 2023-07-21T22:39:14.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:14 smithi187 ceph-mon[96918]: pgmap v632: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 481 op/s 2023-07-21T22:39:14.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:14 smithi195 ceph-mon[97365]: pgmap v632: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 481 op/s 2023-07-21T22:39:14.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:14 smithi151 ceph-mon[95510]: pgmap v632: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.7 MiB/s wr, 481 op/s 2023-07-21T22:39:16.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:16 smithi187 ceph-mon[96918]: pgmap v633: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.2 MiB/s wr, 412 op/s 2023-07-21T22:39:16.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:16 smithi195 ceph-mon[97365]: pgmap v633: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.2 MiB/s wr, 412 op/s 2023-07-21T22:39:16.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:16 smithi151 ceph-mon[95510]: pgmap v633: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.2 MiB/s wr, 412 op/s 2023-07-21T22:39:18.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:18 smithi187 ceph-mon[96918]: pgmap v634: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 396 op/s 2023-07-21T22:39:18.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:18 smithi195 ceph-mon[97365]: pgmap v634: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 396 op/s 2023-07-21T22:39:18.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:18 smithi151 ceph-mon[95510]: pgmap v634: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 396 op/s 2023-07-21T22:39:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.451+0000 7f1103bff700 1 -- 172.21.15.151:0/1599998637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc101f70 msgr2=0x7f10fc102340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.451+0000 7f1103bff700 1 --2- 172.21.15.151:0/1599998637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc101f70 0x7f10fc102340 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f10f80099c0 tx=0x7f10f8009cd0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.451+0000 7f1103bff700 1 -- 172.21.15.151:0/1599998637 shutdown_connections 2023-07-21T22:39:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.451+0000 7f1103bff700 1 --2- 172.21.15.151:0/1599998637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10fc106fb0 0x7f10fc10eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.451+0000 7f1103bff700 1 --2- 172.21.15.151:0/1599998637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc101f70 0x7f10fc102340 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.451+0000 7f1103bff700 1 --2- 172.21.15.151:0/1599998637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10fc102910 0x7f10fc1068d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.451+0000 7f1103bff700 1 -- 172.21.15.151:0/1599998637 >> 172.21.15.151:0/1599998637 conn(0x7f10fc0fd7e0 msgr2=0x7f10fc0ffbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.451+0000 7f1103bff700 1 -- 172.21.15.151:0/1599998637 shutdown_connections 2023-07-21T22:39:19.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.451+0000 7f1103bff700 1 -- 172.21.15.151:0/1599998637 wait complete. 2023-07-21T22:39:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.453+0000 7f1103bff700 1 Processor -- start 2023-07-21T22:39:19.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.453+0000 7f1103bff700 1 -- start start 2023-07-21T22:39:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.453+0000 7f1103bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10fc101f70 0x7f10fc197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f1103bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc102910 0x7f10fc1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f1103bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10fc106fb0 0x7f10fc19ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f1103bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc19d090 con 0x7f10fc102910 2023-07-21T22:39:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f1103bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc19d200 con 0x7f10fc106fb0 2023-07-21T22:39:19.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f1103bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc19d3c0 con 0x7f10fc101f70 2023-07-21T22:39:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110119a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc102910 0x7f10fc1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110219c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10fc106fb0 0x7f10fc19ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110119a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc102910 0x7f10fc1983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36992/0 (socket says 172.21.15.151:36992) 2023-07-21T22:39:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110119a700 1 -- 172.21.15.151:0/2337250509 learned_addr learned my addr 172.21.15.151:0/2337250509 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:19.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110199b700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10fc101f70 0x7f10fc197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110119a700 1 -- 172.21.15.151:0/2337250509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10fc101f70 msgr2=0x7f10fc197ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110119a700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10fc101f70 0x7f10fc197ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110119a700 1 -- 172.21.15.151:0/2337250509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10fc106fb0 msgr2=0x7f10fc19ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110119a700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10fc106fb0 0x7f10fc19ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110119a700 1 -- 172.21.15.151:0/2337250509 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f80095f0 con 0x7f10fc102910 2023-07-21T22:39:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.454+0000 7f110219c700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10fc106fb0 0x7f10fc19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.455+0000 7f110119a700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc102910 0x7f10fc1983e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00d950 tx=0x7f10ec00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.455+0000 7f10f2ffd700 1 -- 172.21.15.151:0/2337250509 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00f890 con 0x7f10fc102910 2023-07-21T22:39:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.455+0000 7f10f2ffd700 1 -- 172.21.15.151:0/2337250509 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10ec00fe80 con 0x7f10fc102910 2023-07-21T22:39:19.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.455+0000 7f1103bff700 1 -- 172.21.15.151:0/2337250509 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc19d6a0 con 0x7f10fc102910 2023-07-21T22:39:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.455+0000 7f10f2ffd700 1 -- 172.21.15.151:0/2337250509 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ec00e3b0 con 0x7f10fc102910 2023-07-21T22:39:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.455+0000 7f1103bff700 1 -- 172.21.15.151:0/2337250509 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc1a4ee0 con 0x7f10fc102910 2023-07-21T22:39:19.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.459+0000 7f10f2ffd700 1 -- 172.21.15.151:0/2337250509 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f10ec00f9f0 con 0x7f10fc102910 2023-07-21T22:39:19.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.460+0000 7f11174a1b80 1 Processor -- start 2023-07-21T22:39:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f10f2ffd700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10e80a1340 0x7f10e80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f11174a1b80 1 -- start start 2023-07-21T22:39:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f10f2ffd700 1 -- 172.21.15.151:0/2337250509 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f10ec0cc740 con 0x7f10fc102910 2023-07-21T22:39:19.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f110219c700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10e80a1340 0x7f10e80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dcacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dc4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dc54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f11174a1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620ccac50 con 0x561620c216b0 2023-07-21T22:39:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f11174a1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620d1d9e0 con 0x561620dcb660 2023-07-21T22:39:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.461+0000 7f11174a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620d16e70 con 0x561620dcb210 2023-07-21T22:39:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dcacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dcacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36996/0 (socket says 172.21.15.151:36996) 2023-07-21T22:39:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110199b700 1 -- 172.21.15.151:0/537917419 learned_addr learned my addr 172.21.15.151:0/537917419 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:19.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110119a700 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dc4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110219c700 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dc54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110199b700 1 -- 172.21.15.151:0/537917419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 msgr2=0x561620dc4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110219c700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10e80a1340 0x7f10e80a37f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f10f4003e80 tx=0x7f10f4009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110199b700 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dc4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110199b700 1 -- 172.21.15.151:0/537917419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 msgr2=0x561620dc54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110199b700 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dc54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110199b700 1 -- 172.21.15.151:0/537917419 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561620b44d80 con 0x561620c216b0 2023-07-21T22:39:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110119a700 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dc4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:19.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.462+0000 7f110199b700 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dcacd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f10f800b580 tx=0x7f10f8005c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ae7e31d10682de server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.463+0000 7f10e7fff700 1 -- 172.21.15.151:0/537917419 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800ba90 con 0x561620c216b0 2023-07-21T22:39:19.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.463+0000 7f10e7fff700 1 -- 172.21.15.151:0/537917419 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10f801e040 con 0x561620c216b0 2023-07-21T22:39:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.463+0000 7f10e7fff700 1 -- 172.21.15.151:0/537917419 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8003ae0 con 0x561620c216b0 2023-07-21T22:39:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 -- 172.21.15.151:0/537917419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 msgr2=0x561620dcacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dcacd0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f10f800b580 tx=0x7f10f8005c70 comp rx=0 tx=0).stop 2023-07-21T22:39:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 -- 172.21.15.151:0/537917419 shutdown_connections 2023-07-21T22:39:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dc54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dcacd0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 --2- 172.21.15.151:0/537917419 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dc4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 -- 172.21.15.151:0/537917419 >> 172.21.15.151:0/537917419 conn(0x561620dbaae0 msgr2=0x561620dc00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 -- 172.21.15.151:0/537917419 shutdown_connections 2023-07-21T22:39:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 -- 172.21.15.151:0/537917419 wait complete. 2023-07-21T22:39:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.464+0000 7f11174a1b80 1 -- start start 2023-07-21T22:39:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.465+0000 7f11174a1b80 1 Processor -- start 2023-07-21T22:39:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.465+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.465+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dce8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.465+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dceff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.465+0000 7f11174a1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620cb6a60 con 0x561620c216b0 2023-07-21T22:39:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.465+0000 7f11174a1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620cb6760 con 0x561620dcb660 2023-07-21T22:39:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.465+0000 7f11174a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620b9a8c0 con 0x561620dcb210 2023-07-21T22:39:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.465+0000 7f11174a1b80 10 client.0 _ll_register_callbacks cb 0x561620cb4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110219c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110219c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dceff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42648/0 (socket says 172.21.15.151:42648) 2023-07-21T22:39:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110219c700 1 -- 172.21.15.151:0/1034247830 learned_addr learned my addr 172.21.15.151:0/1034247830 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:19.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110119a700 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dce8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110199b700 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110219c700 1 -- 172.21.15.151:0/1034247830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 msgr2=0x561620dce8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110219c700 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dce8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110219c700 1 -- 172.21.15.151:0/1034247830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 msgr2=0x561620dd15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110219c700 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110219c700 1 -- 172.21.15.151:0/1034247830 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc10f3c0 con 0x561620dcb660 2023-07-21T22:39:19.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.467+0000 7f10e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:39:19.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.466+0000 7f110219c700 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dceff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f10f400eef0 tx=0x7f10f4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e73788b441049a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.467+0000 7f10e57fa700 1 -- 172.21.15.151:0/1034247830 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4009020 con 0x561620dcb660 2023-07-21T22:39:19.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.467+0000 7f11174a1b80 1 -- 172.21.15.151:0/1034247830 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561620c70490 con 0x561620dcb660 2023-07-21T22:39:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.467+0000 7f10e57fa700 1 -- 172.21.15.151:0/1034247830 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f10f4009180 con 0x561620dcb660 2023-07-21T22:39:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.467+0000 7f10e57fa700 1 -- 172.21.15.151:0/1034247830 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10f4009340 con 0x561620dcb660 2023-07-21T22:39:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.467+0000 7f11174a1b80 10 client.27605 fetch_fsmap learned FSMap version 71 2023-07-21T22:39:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.467+0000 7f11174a1b80 1 -- 172.21.15.151:0/1034247830 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x561620b2dc00 con 0x561620dcb660 2023-07-21T22:39:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.467+0000 7f10e57fa700 1 -- 172.21.15.151:0/1034247830 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561620c70490 con 0x561620dcb660 2023-07-21T22:39:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.468+0000 7f10e57fa700 1 -- 172.21.15.151:0/1034247830 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f10f4008b60 con 0x561620dcb660 2023-07-21T22:39:19.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.468+0000 7f11174a1b80 10 client.27605 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:39:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.468+0000 7f11174a1b80 10 client.27605 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.468+0000 7f11174a1b80 20 client.27605 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.468+0000 7f11174a1b80 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561620de7370 0x561620de9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.468+0000 7f11174a1b80 4 client.27605 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:39:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.468+0000 7f11174a1b80 1 -- 172.21.15.151:0/1034247830 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561620d0fe50 con 0x561620de7370 2023-07-21T22:39:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.468+0000 7f110199b700 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561620de7370 0x561620de9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.469+0000 7f110199b700 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561620de7370 0x561620de9780 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5dfbd23f078cfbe server_cookie=fa7bdd414a0a4c81 in_seq=0 out_seq=0 2023-07-21T22:39:19.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.469+0000 7f10e57fa700 10 client.27605 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.469+0000 7f10e57fa700 1 -- 172.21.15.151:0/1034247830 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561620d0fe50 con 0x561620de7370 2023-07-21T22:39:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.469+0000 7f10e57fa700 10 client.27605 handle_command_reply: tid=0 2023-07-21T22:39:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.469+0000 7f11174a1b80 1 client.27605 shutdown 2023-07-21T22:39:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 -- 172.21.15.151:0/1034247830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 msgr2=0x561620dceff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dceff0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f10f400eef0 tx=0x7f10f4004b40 comp rx=0 tx=0).stop 2023-07-21T22:39:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 -- 172.21.15.151:0/1034247830 shutdown_connections 2023-07-21T22:39:19.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561620de7370 0x561620de9780 crc :-1 s=READY pgs=276 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb660 0x561620dceff0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 --2- 172.21.15.151:0/1034247830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dce8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f10e57fa700 0 client.27605 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 -- 172.21.15.151:0/1034247830 >> 172.21.15.151:0/1034247830 conn(0x561620dbaae0 msgr2=0x561620dbf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 -- 172.21.15.151:0/1034247830 shutdown_connections 2023-07-21T22:39:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 1 -- 172.21.15.151:0/1034247830 wait complete. 2023-07-21T22:39:19.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.470+0000 7f11174a1b80 20 client.27605 trim_cache size 0 max 16384 2023-07-21T22:39:19.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.487+0000 7f11174a1b80 1 Processor -- start 2023-07-21T22:39:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.487+0000 7f11174a1b80 1 -- start start 2023-07-21T22:39:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.487+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dbaae0 0x561620dca220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.487+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dcc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f11174a1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620dcfc90 con 0x561620c216b0 2023-07-21T22:39:19.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f11174a1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620dc0f40 con 0x561620dbaae0 2023-07-21T22:39:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f11174a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620dcf380 con 0x561620dcb210 2023-07-21T22:39:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f110199b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dbaae0 0x561620dca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f110119a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f110199b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dbaae0 0x561620dca220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42658/0 (socket says 172.21.15.151:42658) 2023-07-21T22:39:19.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f110199b700 1 -- 172.21.15.151:0/2476404698 learned_addr learned my addr 172.21.15.151:0/2476404698 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:19.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f110199b700 1 -- 172.21.15.151:0/2476404698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 msgr2=0x561620dcc140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f110199b700 1 --2- 172.21.15.151:0/2476404698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dcc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f110199b700 1 -- 172.21.15.151:0/2476404698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 msgr2=0x561620dd4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f110199b700 1 --2- 172.21.15.151:0/2476404698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.488+0000 7f110199b700 1 -- 172.21.15.151:0/2476404698 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561620dc17e0 con 0x561620dbaae0 2023-07-21T22:39:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.489+0000 7f110199b700 1 --2- 172.21.15.151:0/2476404698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dbaae0 0x561620dca220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f10f8025040 tx=0x7f10f8009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5121aa9fae0c4a6c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.489+0000 7f10f0bff700 1 -- 172.21.15.151:0/2476404698 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80058e0 con 0x561620dbaae0 2023-07-21T22:39:19.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.489+0000 7f10f0bff700 1 -- 172.21.15.151:0/2476404698 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f10f8030030 con 0x561620dbaae0 2023-07-21T22:39:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.489+0000 7f10f0bff700 1 -- 172.21.15.151:0/2476404698 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f80052a0 con 0x561620dbaae0 2023-07-21T22:39:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 -- 172.21.15.151:0/2476404698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dbaae0 msgr2=0x561620dca220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 --2- 172.21.15.151:0/2476404698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dbaae0 0x561620dca220 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f10f8025040 tx=0x7f10f8009510 comp rx=0 tx=0).stop 2023-07-21T22:39:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 -- 172.21.15.151:0/2476404698 shutdown_connections 2023-07-21T22:39:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 --2- 172.21.15.151:0/2476404698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dbaae0 0x561620dca220 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 --2- 172.21.15.151:0/2476404698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dcb210 0x561620dcc140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 --2- 172.21.15.151:0/2476404698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 -- 172.21.15.151:0/2476404698 >> 172.21.15.151:0/2476404698 conn(0x561620de3940 msgr2=0x561620dcba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 -- 172.21.15.151:0/2476404698 shutdown_connections 2023-07-21T22:39:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 -- 172.21.15.151:0/2476404698 wait complete. 2023-07-21T22:39:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.490+0000 7f11174a1b80 1 -- start start 2023-07-21T22:39:19.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f11174a1b80 1 Processor -- start 2023-07-21T22:39:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dbaae0 0x561620dd2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f11174a1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb210 0x561620e342e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f11174a1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620e34820 con 0x561620c216b0 2023-07-21T22:39:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f11174a1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620e34990 con 0x561620dcb210 2023-07-21T22:39:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f11174a1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561620e34b50 con 0x561620dbaae0 2023-07-21T22:39:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f11174a1b80 10 client.0 _ll_register_callbacks cb 0x7f10f400e890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f110199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f110199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd2350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37020/0 (socket says 172.21.15.151:37020) 2023-07-21T22:39:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.491+0000 7f110199b700 1 -- 172.21.15.151:0/871718186 learned_addr learned my addr 172.21.15.151:0/871718186 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:19.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f110219c700 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb210 0x561620e342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f110119a700 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dbaae0 0x561620dd2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f110199b700 1 -- 172.21.15.151:0/871718186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dbaae0 msgr2=0x561620dd2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f110199b700 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dbaae0 0x561620dd2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f110199b700 1 -- 172.21.15.151:0/871718186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb210 msgr2=0x561620e342e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f110199b700 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb210 0x561620e342e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f110199b700 1 -- 172.21.15.151:0/871718186 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561620b44d80 con 0x561620c216b0 2023-07-21T22:39:19.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f110219c700 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb210 0x561620e342e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f110199b700 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd2350 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f10f8000c00 tx=0x7f10f800b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f244f20f500ec8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.492+0000 7f10e57fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:39:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.493+0000 7f10e57fa700 1 -- 172.21.15.151:0/871718186 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8030d20 con 0x561620c216b0 2023-07-21T22:39:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.493+0000 7f10e57fa700 1 -- 172.21.15.151:0/871718186 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f10f80301a0 con 0x561620c216b0 2023-07-21T22:39:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.493+0000 7f11174a1b80 1 -- 172.21.15.151:0/871718186 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561620de3d10 con 0x561620c216b0 2023-07-21T22:39:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.493+0000 7f10e57fa700 1 -- 172.21.15.151:0/871718186 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10f8030360 con 0x561620c216b0 2023-07-21T22:39:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.493+0000 7f11174a1b80 10 client.17934 fetch_fsmap learned FSMap version 71 2023-07-21T22:39:19.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.493+0000 7f11174a1b80 1 -- 172.21.15.151:0/871718186 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x7f10fc078bd0 con 0x561620c216b0 2023-07-21T22:39:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.493+0000 7f10e57fa700 1 -- 172.21.15.151:0/871718186 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561620de3d10 con 0x561620c216b0 2023-07-21T22:39:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.493+0000 7f10e57fa700 1 -- 172.21.15.151:0/871718186 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f10f8003920 con 0x561620c216b0 2023-07-21T22:39:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.494+0000 7f11174a1b80 10 client.17934 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:39:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.494+0000 7f11174a1b80 10 client.17934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.494+0000 7f11174a1b80 20 client.17934 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.494+0000 7f11174a1b80 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561620dcb660 0x561620e3dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.494+0000 7f11174a1b80 4 client.17934 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:39:19.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.494+0000 7f11174a1b80 1 -- 172.21.15.151:0/871718186 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f10f801e040 con 0x561620dcb660 2023-07-21T22:39:19.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.494+0000 7f110119a700 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561620dcb660 0x561620e3dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:19.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.494+0000 7f110119a700 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561620dcb660 0x561620e3dd80 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b75b284925fa0b04 server_cookie=d6af9a746acfafe1 in_seq=0 out_seq=0 2023-07-21T22:39:19.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.494+0000 7f10e57fa700 10 client.17934 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.505+0000 7f10e57fa700 1 -- 172.21.15.151:0/871718186 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f10f801e040 con 0x561620dcb660 2023-07-21T22:39:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.505+0000 7f10e57fa700 10 client.17934 handle_command_reply: tid=0 2023-07-21T22:39:19.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.505+0000 7f11174a1b80 1 client.17934 shutdown 2023-07-21T22:39:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.505+0000 7f11174a1b80 1 -- 172.21.15.151:0/871718186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 msgr2=0x561620dd2350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.505+0000 7f11174a1b80 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd2350 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f10f8000c00 tx=0x7f10f800b540 comp rx=0 tx=0).stop 2023-07-21T22:39:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f11174a1b80 1 -- 172.21.15.151:0/871718186 shutdown_connections 2023-07-21T22:39:19.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f11174a1b80 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561620dcb660 0x561620e3dd80 crc :-1 s=READY pgs=277 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f11174a1b80 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561620dcb210 0x561620e342e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f11174a1b80 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561620c216b0 0x561620dd2350 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f10e57fa700 0 client.17934 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f11174a1b80 1 --2- 172.21.15.151:0/871718186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561620dbaae0 0x561620dd2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f11174a1b80 1 -- 172.21.15.151:0/871718186 >> 172.21.15.151:0/871718186 conn(0x561620de3940 msgr2=0x561620dca090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f11174a1b80 1 -- 172.21.15.151:0/871718186 shutdown_connections 2023-07-21T22:39:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f11174a1b80 1 -- 172.21.15.151:0/871718186 wait complete. 2023-07-21T22:39:19.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.506+0000 7f11174a1b80 20 client.17934 trim_cache size 0 max 16384 2023-07-21T22:39:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:39:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:39:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:39:19.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:39:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 -- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10e80a1340 msgr2=0x7f10e80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10e80a1340 0x7f10e80a37f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f10f4003e80 tx=0x7f10f4009920 comp rx=0 tx=0).stop 2023-07-21T22:39:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 -- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc102910 msgr2=0x7f10fc1983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc102910 0x7f10fc1983e0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f10ec00d950 tx=0x7f10ec00dc60 comp rx=0 tx=0).stop 2023-07-21T22:39:19.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 -- 172.21.15.151:0/2337250509 shutdown_connections 2023-07-21T22:39:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f10e80a1340 0x7f10e80a37f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f10fc106fb0 0x7f10fc19ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f10fc101f70 0x7f10fc197ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 --2- 172.21.15.151:0/2337250509 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f10fc102910 0x7f10fc1983e0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 -- 172.21.15.151:0/2337250509 >> 172.21.15.151:0/2337250509 conn(0x7f10fc0fd7e0 msgr2=0x7f10fc0fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 -- 172.21.15.151:0/2337250509 shutdown_connections 2023-07-21T22:39:19.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:19.507+0000 7f1103bff700 1 -- 172.21.15.151:0/2337250509 wait complete. 2023-07-21T22:39:20.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:20 smithi187 ceph-mon[96918]: pgmap v635: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 396 op/s 2023-07-21T22:39:20.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:20 smithi195 ceph-mon[97365]: pgmap v635: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 396 op/s 2023-07-21T22:39:20.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:20 smithi151 ceph-mon[95510]: pgmap v635: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 396 op/s 2023-07-21T22:39:22.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:22 smithi187 ceph-mon[96918]: pgmap v636: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 396 op/s 2023-07-21T22:39:22.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:22 smithi195 ceph-mon[97365]: pgmap v636: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 396 op/s 2023-07-21T22:39:22.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:22 smithi151 ceph-mon[95510]: pgmap v636: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.0 MiB/s wr, 396 op/s 2023-07-21T22:39:24.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:24 smithi187 ceph-mon[96918]: pgmap v637: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 522 op/s 2023-07-21T22:39:24.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:24 smithi195 ceph-mon[97365]: pgmap v637: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 522 op/s 2023-07-21T22:39:24.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:24 smithi151 ceph-mon[95510]: pgmap v637: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.0 MiB/s wr, 522 op/s 2023-07-21T22:39:26.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:26 smithi187 ceph-mon[96918]: pgmap v638: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.5 MiB/s wr, 331 op/s 2023-07-21T22:39:26.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:26 smithi195 ceph-mon[97365]: pgmap v638: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.5 MiB/s wr, 331 op/s 2023-07-21T22:39:26.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:26 smithi151 ceph-mon[95510]: pgmap v638: 97 pgs: 97 active+clean; 9.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 2.5 MiB/s wr, 331 op/s 2023-07-21T22:39:28.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:28 smithi187 ceph-mon[96918]: pgmap v639: 97 pgs: 97 active+clean; 9.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.9 MiB/s wr, 506 op/s 2023-07-21T22:39:28.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:28 smithi195 ceph-mon[97365]: pgmap v639: 97 pgs: 97 active+clean; 9.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.9 MiB/s wr, 506 op/s 2023-07-21T22:39:28.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:28 smithi151 ceph-mon[95510]: pgmap v639: 97 pgs: 97 active+clean; 9.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.9 MiB/s wr, 506 op/s 2023-07-21T22:39:30.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:30 smithi187 ceph-mon[96918]: pgmap v640: 97 pgs: 97 active+clean; 9.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:39:30.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:30 smithi195 ceph-mon[97365]: pgmap v640: 97 pgs: 97 active+clean; 9.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:39:30.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:30 smithi151 ceph-mon[95510]: pgmap v640: 97 pgs: 97 active+clean; 9.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:39:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.704+0000 7fdf151ff700 1 -- 172.21.15.151:0/3338479816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf10110570 msgr2=0x7fdf10110940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.704+0000 7fdf151ff700 1 --2- 172.21.15.151:0/3338479816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf10110570 0x7fdf10110940 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fdf000098f0 tx=0x7fdf00009c00 comp rx=0 tx=0).stop 2023-07-21T22:39:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.704+0000 7fdf151ff700 1 -- 172.21.15.151:0/3338479816 shutdown_connections 2023-07-21T22:39:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.704+0000 7fdf151ff700 1 --2- 172.21.15.151:0/3338479816 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf10110570 0x7fdf10110940 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.704+0000 7fdf151ff700 1 --2- 172.21.15.151:0/3338479816 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf1010af00 0x7fdf10117330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.704+0000 7fdf151ff700 1 --2- 172.21.15.151:0/3338479816 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf1010a550 0x7fdf1010a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.704+0000 7fdf151ff700 1 -- 172.21.15.151:0/3338479816 >> 172.21.15.151:0/3338479816 conn(0x7fdf1006a900 msgr2=0x7fdf1006ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.704+0000 7fdf151ff700 1 -- 172.21.15.151:0/3338479816 shutdown_connections 2023-07-21T22:39:32.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.704+0000 7fdf151ff700 1 -- 172.21.15.151:0/3338479816 wait complete. 2023-07-21T22:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.705+0000 7fdf151ff700 1 Processor -- start 2023-07-21T22:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.705+0000 7fdf151ff700 1 -- start start 2023-07-21T22:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf151ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf1010a550 0x7fdf101a6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf151ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf1010af00 0x7fdf101a6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf151ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf10110570 0x7fdf101a0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf151ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf101a0c30 con 0x7fdf1010a550 2023-07-21T22:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf151ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf101a0da0 con 0x7fdf1010af00 2023-07-21T22:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf151ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf101a0f60 con 0x7fdf10110570 2023-07-21T22:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf0ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf1010a550 0x7fdf101a6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf0ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf1010a550 0x7fdf101a6690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44948/0 (socket says 172.21.15.151:44948) 2023-07-21T22:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/2025144473 learned_addr learned my addr 172.21.15.151:0/2025144473 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf1010af00 0x7fdf101a6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.706+0000 7fdf0f59e700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf10110570 0x7fdf101a0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdf0f59e700 1 -- 172.21.15.151:0/2025144473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf1010af00 msgr2=0x7fdf101a6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdf0f59e700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf1010af00 0x7fdf101a6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdf0f59e700 1 -- 172.21.15.151:0/2025144473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf1010a550 msgr2=0x7fdf101a6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:32.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdf0f59e700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf1010a550 0x7fdf101a6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdf0f59e700 1 -- 172.21.15.151:0/2025144473 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf040095f0 con 0x7fdf10110570 2023-07-21T22:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdf0f59e700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf10110570 0x7fdf101a0460 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800efb0 tx=0x7fdf0800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdef7fff700 1 -- 172.21.15.151:0/2025144473 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf08003a00 con 0x7fdf10110570 2023-07-21T22:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdef7fff700 1 -- 172.21.15.151:0/2025144473 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf0800f040 con 0x7fdf10110570 2023-07-21T22:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdf151ff700 1 -- 172.21.15.151:0/2025144473 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf08009c40 con 0x7fdf10110570 2023-07-21T22:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdef7fff700 1 -- 172.21.15.151:0/2025144473 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf080044d0 con 0x7fdf10110570 2023-07-21T22:39:32.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.707+0000 7fdf151ff700 1 -- 172.21.15.151:0/2025144473 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf00009520 con 0x7fdf10110570 2023-07-21T22:39:32.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.712+0000 7fdef7fff700 1 -- 172.21.15.151:0/2025144473 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdf0800cbc0 con 0x7fdf10110570 2023-07-21T22:39:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.712+0000 7fdf28bb2b80 1 Processor -- start 2023-07-21T22:39:32.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.712+0000 7fdf28bb2b80 1 -- start start 2023-07-21T22:39:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd13536b0 0x559dd14fccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd210 0x559dd14f6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd660 0x559dd14f74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd13fcc50 con 0x559dd13536b0 2023-07-21T22:39:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd144f9e0 con 0x559dd14fd210 2023-07-21T22:39:32.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1448e70 con 0x559dd14fd660 2023-07-21T22:39:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf0e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd13536b0 0x559dd14fccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf0e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd13536b0 0x559dd14fccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44960/0 (socket says 172.21.15.151:44960) 2023-07-21T22:39:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf0e59c700 1 -- 172.21.15.151:0/2902049199 learned_addr learned my addr 172.21.15.151:0/2902049199 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd210 0x559dd14f6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.713+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd660 0x559dd14f74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/2902049199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd660 msgr2=0x559dd14f74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd660 0x559dd14f74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/2902049199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd13536b0 msgr2=0x559dd14fccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:32.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd13536b0 0x559dd14fccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/2902049199 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd1276d80 con 0x559dd14fd210 2023-07-21T22:39:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd660 0x559dd14f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd210 0x559dd14f6f40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdf000098c0 tx=0x7fdf00005e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dab41ba462389be0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdef7fff700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdef80a1340 0x7fdef80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdef7fff700 1 -- 172.21.15.151:0/2025144473 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdf080cc7f0 con 0x7fdf10110570 2023-07-21T22:39:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdef57fa700 1 -- 172.21.15.151:0/2902049199 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000fe60 con 0x559dd14fd210 2023-07-21T22:39:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.714+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdef80a1340 0x7fdef80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.715+0000 7fdef57fa700 1 -- 172.21.15.151:0/2902049199 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf0001d040 con 0x559dd14fd210 2023-07-21T22:39:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.715+0000 7fdef57fa700 1 -- 172.21.15.151:0/2902049199 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf00005040 con 0x559dd14fd210 2023-07-21T22:39:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.715+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdef80a1340 0x7fdef80a37f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x559dd14fda70 tx=0x7fdf04009820 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.715+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/2902049199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd210 msgr2=0x559dd14f6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:32.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.715+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd210 0x559dd14f6f40 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fdf000098c0 tx=0x7fdf00005e00 comp rx=0 tx=0).stop 2023-07-21T22:39:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.716+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/2902049199 shutdown_connections 2023-07-21T22:39:32.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.716+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd660 0x559dd14f74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.716+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd13536b0 0x559dd14fccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.716+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/2902049199 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd210 0x559dd14f6f40 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.716+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/2902049199 >> 172.21.15.151:0/2902049199 conn(0x559dd14ecae0 msgr2=0x559dd14f20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.716+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/2902049199 shutdown_connections 2023-07-21T22:39:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.716+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/2902049199 wait complete. 2023-07-21T22:39:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.717+0000 7fdf28bb2b80 1 -- start start 2023-07-21T22:39:32.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.717+0000 7fdf28bb2b80 1 Processor -- start 2023-07-21T22:39:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.717+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd15035c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd15007d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 0x559dd1500f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd13e8a60 con 0x559dd14fd210 2023-07-21T22:39:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd13e8760 con 0x559dd14fd660 2023-07-21T22:39:32.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd12cc8c0 con 0x559dd13536b0 2023-07-21T22:39:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf28bb2b80 10 client.0 _ll_register_callbacks cb 0x559dd13e6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd15035c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd15035c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38908/0 (socket says 172.21.15.151:38908) 2023-07-21T22:39:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/1652310711 learned_addr learned my addr 172.21.15.151:0/1652310711 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0f59e700 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 0x559dd1500f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd15007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/1652310711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 msgr2=0x559dd1500f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 0x559dd1500f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/1652310711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 msgr2=0x559dd15007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd15007d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/1652310711 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf04019040 con 0x559dd13536b0 2023-07-21T22:39:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.718+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd15007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.719+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd15035c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009ff0 tx=0x7fdf0000f740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c200fb8895159ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.719+0000 7fdef2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:39:32.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.719+0000 7fdef2ff5700 1 -- 172.21.15.151:0/1652310711 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0000b760 con 0x559dd13536b0 2023-07-21T22:39:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.719+0000 7fdef2ff5700 1 -- 172.21.15.151:0/1652310711 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdf0000b8c0 con 0x559dd13536b0 2023-07-21T22:39:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.719+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/1652310711 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559dd13a2490 con 0x559dd13536b0 2023-07-21T22:39:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.719+0000 7fdef2ff5700 1 -- 172.21.15.151:0/1652310711 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf0000ba80 con 0x559dd13536b0 2023-07-21T22:39:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.719+0000 7fdf28bb2b80 10 client.27649 fetch_fsmap learned FSMap version 71 2023-07-21T22:39:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.719+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/1652310711 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x7fdf10117c30 con 0x559dd13536b0 2023-07-21T22:39:32.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.720+0000 7fdef2ff5700 1 -- 172.21.15.151:0/1652310711 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x559dd13a2490 con 0x559dd13536b0 2023-07-21T22:39:32.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.720+0000 7fdef2ff5700 1 -- 172.21.15.151:0/1652310711 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdf00015020 con 0x559dd13536b0 2023-07-21T22:39:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.720+0000 7fdf28bb2b80 10 client.27649 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:39:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.720+0000 7fdf28bb2b80 10 client.27649 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.720+0000 7fdf28bb2b80 20 client.27649 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.720+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559dd15105a0 0x559dd15129b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.720+0000 7fdf28bb2b80 4 client.27649 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:39:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.720+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/1652310711 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559dd1441e50 con 0x559dd15105a0 2023-07-21T22:39:32.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.721+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559dd15105a0 0x559dd15129b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.721+0000 7fdef2ff5700 10 client.27649 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.721+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559dd15105a0 0x559dd15129b0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=462066b559ed9dd9 server_cookie=563b7943dc4038b5 in_seq=0 out_seq=0 2023-07-21T22:39:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdef2ff5700 1 -- 172.21.15.151:0/1652310711 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x559dd1441e50 con 0x559dd15105a0 2023-07-21T22:39:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdef2ff5700 10 client.27649 handle_command_reply: tid=0 2023-07-21T22:39:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdf28bb2b80 1 client.27649 shutdown 2023-07-21T22:39:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/1652310711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 msgr2=0x559dd15035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:32.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd15035c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009ff0 tx=0x7fdf0000f740 comp rx=0 tx=0).stop 2023-07-21T22:39:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/1652310711 shutdown_connections 2023-07-21T22:39:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559dd15105a0 0x559dd15129b0 crc :-1 s=READY pgs=278 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 0x559dd1500f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd15035c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/1652310711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd15007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdef2ff5700 0 client.27649 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.722+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/1652310711 >> 172.21.15.151:0/1652310711 conn(0x559dd14ecae0 msgr2=0x559dd14f13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.723+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/1652310711 shutdown_connections 2023-07-21T22:39:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.723+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/1652310711 wait complete. 2023-07-21T22:39:32.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.723+0000 7fdf28bb2b80 20 client.27649 trim_cache size 0 max 16384 2023-07-21T22:39:32.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.742+0000 7fdf28bb2b80 1 Processor -- start 2023-07-21T22:39:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.742+0000 7fdf28bb2b80 1 -- start start 2023-07-21T22:39:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.742+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd1507b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.742+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd14fe1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.742+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 0x559dd15030f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.742+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd14f39d0 con 0x559dd14fd210 2023-07-21T22:39:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.742+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1501b20 con 0x559dd14fd660 2023-07-21T22:39:32.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.742+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1501510 con 0x559dd13536b0 2023-07-21T22:39:32.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd1507b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd1507b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38916/0 (socket says 172.21.15.151:38916) 2023-07-21T22:39:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/3522407459 learned_addr learned my addr 172.21.15.151:0/3522407459 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd14fe1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0f59e700 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 0x559dd15030f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/3522407459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 msgr2=0x559dd15030f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:32.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 0x559dd15030f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/3522407459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 msgr2=0x559dd14fe1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd14fe1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0ed9d700 1 -- 172.21.15.151:0/3522407459 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559dd15175e0 con 0x559dd13536b0 2023-07-21T22:39:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0f59e700 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 0x559dd15030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd14fe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.743+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd1507b80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009340 tx=0x7fdf00005dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=defc0d156f913dee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:32.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.744+0000 7fdef5ffb700 1 -- 172.21.15.151:0/3522407459 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000213e0 con 0x559dd13536b0 2023-07-21T22:39:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.744+0000 7fdef5ffb700 1 -- 172.21.15.151:0/3522407459 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf00003d00 con 0x559dd13536b0 2023-07-21T22:39:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.744+0000 7fdef5ffb700 1 -- 172.21.15.151:0/3522407459 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf000053c0 con 0x559dd13536b0 2023-07-21T22:39:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/3522407459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 msgr2=0x559dd1507b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd1507b80 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fdf00009340 tx=0x7fdf00005dc0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/3522407459 shutdown_connections 2023-07-21T22:39:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd14fd660 0x559dd15030f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd13536b0 0x559dd1507b80 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/3522407459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd210 0x559dd14fe1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/3522407459 >> 172.21.15.151:0/3522407459 conn(0x559dd14ecae0 msgr2=0x559dd14fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/3522407459 shutdown_connections 2023-07-21T22:39:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/3522407459 wait complete. 2023-07-21T22:39:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.745+0000 7fdf28bb2b80 1 -- start start 2023-07-21T22:39:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.746+0000 7fdf28bb2b80 1 Processor -- start 2023-07-21T22:39:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.746+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd13536b0 0x559dd15040f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.746+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd210 0x559dd1504630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.746+0000 7fdf28bb2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd660 0x559dd1504bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.746+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1563620 con 0x559dd14fd660 2023-07-21T22:39:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.746+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1563790 con 0x559dd13536b0 2023-07-21T22:39:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf28bb2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x559dd1563950 con 0x559dd14fd210 2023-07-21T22:39:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf28bb2b80 10 client.0 _ll_register_callbacks cb 0x7fdf04009cb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf0e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd210 0x559dd1504630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf0e59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd210 0x559dd1504630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38928/0 (socket says 172.21.15.151:38928) 2023-07-21T22:39:32.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf0e59c700 1 -- 172.21.15.151:0/867218475 learned_addr learned my addr 172.21.15.151:0/867218475 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf0f59e700 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd660 0x559dd1504bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf0e59c700 1 -- 172.21.15.151:0/867218475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd13536b0 msgr2=0x559dd15040f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd13536b0 0x559dd15040f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf0e59c700 1 -- 172.21.15.151:0/867218475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd660 msgr2=0x559dd1504bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd660 0x559dd1504bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.747+0000 7fdf0e59c700 1 -- 172.21.15.151:0/867218475 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf10117c30 con 0x559dd14fd210 2023-07-21T22:39:32.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.748+0000 7fdf0e59c700 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd210 0x559dd1504630 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x559dd1501d80 tx=0x7fdf040047c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc6ceccaf4abc645 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.748+0000 7fdef2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:39:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.748+0000 7fdef2ff5700 1 -- 172.21.15.151:0/867218475 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf0401e880 con 0x559dd14fd210 2023-07-21T22:39:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.748+0000 7fdef2ff5700 1 -- 172.21.15.151:0/867218475 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdf0401e9e0 con 0x559dd14fd210 2023-07-21T22:39:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.748+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/867218475 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdf0001d040 con 0x559dd14fd210 2023-07-21T22:39:32.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.748+0000 7fdef2ff5700 1 -- 172.21.15.151:0/867218475 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdf0401eba0 con 0x559dd14fd210 2023-07-21T22:39:32.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.748+0000 7fdf28bb2b80 10 client.27655 fetch_fsmap learned FSMap version 71 2023-07-21T22:39:32.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.748+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/867218475 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) v3 -- 0x559dd125fc00 con 0x559dd14fd210 2023-07-21T22:39:32.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.749+0000 7fdef2ff5700 1 -- 172.21.15.151:0/867218475 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdf0001d040 con 0x559dd14fd210 2023-07-21T22:39:32.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.749+0000 7fdef2ff5700 1 -- 172.21.15.151:0/867218475 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 71) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdf04005020 con 0x559dd14fd210 2023-07-21T22:39:32.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.749+0000 7fdf28bb2b80 10 client.27655 fetch_fsmap finished waiting for FSMap version 71 2023-07-21T22:39:32.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.749+0000 7fdf28bb2b80 10 client.27655 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:32.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.749+0000 7fdf28bb2b80 20 client.27655 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:32.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.749+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559dd15650b0 0x559dd15674c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.749+0000 7fdf28bb2b80 4 client.27655 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:39:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.749+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/867218475 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x559dd1403ff0 con 0x559dd15650b0 2023-07-21T22:39:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.749+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559dd15650b0 0x559dd15674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:32.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.750+0000 7fdf0ed9d700 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559dd15650b0 0x559dd15674c0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c3b9c14ca1b52b0 server_cookie=ca3bb65803951d5e in_seq=0 out_seq=0 2023-07-21T22:39:32.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.750+0000 7fdef2ff5700 10 client.27655 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdef2ff5700 1 -- 172.21.15.151:0/867218475 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x559dd1403ff0 con 0x559dd15650b0 2023-07-21T22:39:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdef2ff5700 10 client.27655 handle_command_reply: tid=0 2023-07-21T22:39:32.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 client.27655 shutdown 2023-07-21T22:39:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/867218475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd210 msgr2=0x559dd1504630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd210 0x559dd1504630 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x559dd1501d80 tx=0x7fdf040047c0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/867218475 shutdown_connections 2023-07-21T22:39:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x559dd15650b0 0x559dd15674c0 crc :-1 s=READY pgs=279 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559dd13536b0 0x559dd15040f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559dd14fd660 0x559dd1504bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdef2ff5700 0 client.27655 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 --2- 172.21.15.151:0/867218475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x559dd14fd210 0x559dd1504630 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/867218475 >> 172.21.15.151:0/867218475 conn(0x559dd14ecae0 msgr2=0x559dd14fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/867218475 shutdown_connections 2023-07-21T22:39:32.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.763+0000 7fdf28bb2b80 1 -- 172.21.15.151:0/867218475 wait complete. 2023-07-21T22:39:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.764+0000 7fdf28bb2b80 20 client.27655 trim_cache size 0 max 16384 2023-07-21T22:39:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:39:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:39:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:39:32.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:39:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.764+0000 7fdf151ff700 1 -- 172.21.15.151:0/2025144473 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdef80a1340 msgr2=0x7fdef80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.764+0000 7fdf151ff700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdef80a1340 0x7fdef80a37f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x559dd14fda70 tx=0x7fdf04009820 comp rx=0 tx=0).stop 2023-07-21T22:39:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.764+0000 7fdf151ff700 1 -- 172.21.15.151:0/2025144473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf10110570 msgr2=0x7fdf101a0460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:32.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.764+0000 7fdf151ff700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf10110570 0x7fdf101a0460 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf0800efb0 tx=0x7fdf0800c3a0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.765+0000 7fdf151ff700 1 -- 172.21.15.151:0/2025144473 shutdown_connections 2023-07-21T22:39:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.765+0000 7fdf151ff700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdef80a1340 0x7fdef80a37f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.765+0000 7fdf151ff700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdf10110570 0x7fdf101a0460 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.765+0000 7fdf151ff700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf1010a550 0x7fdf101a6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.765+0000 7fdf151ff700 1 --2- 172.21.15.151:0/2025144473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf1010af00 0x7fdf101a6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.765+0000 7fdf151ff700 1 -- 172.21.15.151:0/2025144473 >> 172.21.15.151:0/2025144473 conn(0x7fdf1006a900 msgr2=0x7fdf101090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:32.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.765+0000 7fdf151ff700 1 -- 172.21.15.151:0/2025144473 shutdown_connections 2023-07-21T22:39:32.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:32.765+0000 7fdf151ff700 1 -- 172.21.15.151:0/2025144473 wait complete. 2023-07-21T22:39:32.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:32 smithi187 ceph-mon[96918]: pgmap v641: 97 pgs: 97 active+clean; 9.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:39:32.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:32 smithi195 ceph-mon[97365]: pgmap v641: 97 pgs: 97 active+clean; 9.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:39:32.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:32 smithi151 ceph-mon[95510]: pgmap v641: 97 pgs: 97 active+clean; 9.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:39:34.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:34 smithi187 ceph-mon[96918]: pgmap v642: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.1 MiB/s wr, 530 op/s 2023-07-21T22:39:34.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:34 smithi195 ceph-mon[97365]: pgmap v642: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.1 MiB/s wr, 530 op/s 2023-07-21T22:39:34.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:34 smithi151 ceph-mon[95510]: pgmap v642: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.1 MiB/s wr, 530 op/s 2023-07-21T22:39:36.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:36 smithi187 ceph-mon[96918]: pgmap v643: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 354 op/s 2023-07-21T22:39:36.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:36 smithi195 ceph-mon[97365]: pgmap v643: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 354 op/s 2023-07-21T22:39:36.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:36 smithi151 ceph-mon[95510]: pgmap v643: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 2.7 MiB/s wr, 354 op/s 2023-07-21T22:39:38.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:38 smithi187 ceph-mon[96918]: pgmap v644: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 520 op/s 2023-07-21T22:39:38.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:38 smithi195 ceph-mon[97365]: pgmap v644: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 520 op/s 2023-07-21T22:39:38.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:38 smithi151 ceph-mon[95510]: pgmap v644: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.0 MiB/s wr, 520 op/s 2023-07-21T22:39:40.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:40 smithi187 ceph-mon[96918]: pgmap v645: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.6 MiB/s wr, 344 op/s 2023-07-21T22:39:40.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:40 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:39:40.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:40 smithi195 ceph-mon[97365]: pgmap v645: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.6 MiB/s wr, 344 op/s 2023-07-21T22:39:40.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:40 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:39:40.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:40 smithi151 ceph-mon[95510]: pgmap v645: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.6 MiB/s wr, 344 op/s 2023-07-21T22:39:40.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:40 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:39:42.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:42 smithi187 ceph-mon[96918]: pgmap v646: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.6 MiB/s wr, 344 op/s 2023-07-21T22:39:42.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:42 smithi195 ceph-mon[97365]: pgmap v646: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.6 MiB/s wr, 344 op/s 2023-07-21T22:39:42.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:42 smithi151 ceph-mon[95510]: pgmap v646: 97 pgs: 97 active+clean; 9.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.6 MiB/s wr, 344 op/s 2023-07-21T22:39:44.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:44 smithi187 ceph-mon[96918]: pgmap v647: 97 pgs: 97 active+clean; 9.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.0 MiB/s wr, 522 op/s 2023-07-21T22:39:44.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:44 smithi195 ceph-mon[97365]: pgmap v647: 97 pgs: 97 active+clean; 9.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.0 MiB/s wr, 522 op/s 2023-07-21T22:39:44.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:44 smithi151 ceph-mon[95510]: pgmap v647: 97 pgs: 97 active+clean; 9.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.0 MiB/s wr, 522 op/s 2023-07-21T22:39:45.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:45 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:39:45.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:45 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:39:45.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:45 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:39:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.947+0000 7feda53ff700 1 -- 172.21.15.151:0/515304588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00679a0 msgr2=0x7feda0067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.947+0000 7feda53ff700 1 --2- 172.21.15.151:0/515304588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00679a0 0x7feda0067d70 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7fed90009990 tx=0x7fed90009ca0 comp rx=0 tx=0).stop 2023-07-21T22:39:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.947+0000 7feda53ff700 1 -- 172.21.15.151:0/515304588 shutdown_connections 2023-07-21T22:39:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.947+0000 7feda53ff700 1 --2- 172.21.15.151:0/515304588 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feda010c540 0x7feda010e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.947+0000 7feda53ff700 1 --2- 172.21.15.151:0/515304588 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00679a0 0x7feda0067d70 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.947+0000 7feda53ff700 1 --2- 172.21.15.151:0/515304588 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feda00682b0 0x7feda010c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.947+0000 7feda53ff700 1 -- 172.21.15.151:0/515304588 >> 172.21.15.151:0/515304588 conn(0x7feda0074760 msgr2=0x7feda0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.947+0000 7feda53ff700 1 -- 172.21.15.151:0/515304588 shutdown_connections 2023-07-21T22:39:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.947+0000 7feda53ff700 1 -- 172.21.15.151:0/515304588 wait complete. 2023-07-21T22:39:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.948+0000 7feda53ff700 1 Processor -- start 2023-07-21T22:39:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.948+0000 7feda53ff700 1 -- start start 2023-07-21T22:39:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.948+0000 7feda53ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feda00679a0 0x7feda0197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.948+0000 7feda53ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00682b0 0x7feda0198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.948+0000 7feda53ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feda010c540 0x7feda019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.948+0000 7feda53ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda019bdc0 con 0x7feda00682b0 2023-07-21T22:39:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.948+0000 7feda53ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda019bf30 con 0x7feda010c540 2023-07-21T22:39:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.948+0000 7feda53ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feda019c0f0 con 0x7feda00679a0 2023-07-21T22:39:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9e7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00682b0 0x7feda0198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9e7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00682b0 0x7feda0198200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39294/0 (socket says 172.21.15.151:39294) 2023-07-21T22:39:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9e7fc700 1 -- 172.21.15.151:0/953205623 learned_addr learned my addr 172.21.15.151:0/953205623 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9effd700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feda00679a0 0x7feda0197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9f7fe700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feda010c540 0x7feda019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9e7fc700 1 -- 172.21.15.151:0/953205623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feda00679a0 msgr2=0x7feda0197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feda00679a0 0x7feda0197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9e7fc700 1 -- 172.21.15.151:0/953205623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feda010c540 msgr2=0x7feda019b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feda010c540 0x7feda019b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9e7fc700 1 -- 172.21.15.151:0/953205623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed900095f0 con 0x7feda00682b0 2023-07-21T22:39:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.949+0000 7fed9effd700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feda00679a0 0x7feda0197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.950+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00682b0 0x7feda0198200 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fed9400e9a0 tx=0x7fed9400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.950+0000 7fed87fff700 1 -- 172.21.15.151:0/953205623 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94009790 con 0x7feda00682b0 2023-07-21T22:39:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.950+0000 7feda53ff700 1 -- 172.21.15.151:0/953205623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feda019c3d0 con 0x7feda00682b0 2023-07-21T22:39:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.950+0000 7fed87fff700 1 -- 172.21.15.151:0/953205623 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed94010430 con 0x7feda00682b0 2023-07-21T22:39:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.950+0000 7fed87fff700 1 -- 172.21.15.151:0/953205623 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9400cea0 con 0x7feda00682b0 2023-07-21T22:39:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.950+0000 7feda53ff700 1 -- 172.21.15.151:0/953205623 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda01a4d30 con 0x7feda00682b0 2023-07-21T22:39:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.953+0000 7fed87fff700 1 -- 172.21.15.151:0/953205623 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fed940105a0 con 0x7feda00682b0 2023-07-21T22:39:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.955+0000 7fedb8c7bb80 1 Processor -- start 2023-07-21T22:39:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.955+0000 7fed87fff700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fed880a12c0 0x7fed880a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.955+0000 7fedb8c7bb80 1 -- start start 2023-07-21T22:39:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.955+0000 7fed87fff700 1 -- 172.21.15.151:0/953205623 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fed94014070 con 0x7feda00682b0 2023-07-21T22:39:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.955+0000 7fed9f7fe700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fed880a12c0 0x7fed880a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7571c26b0 0x55a75736bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a75736c210 0x55a757365f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 0x55a7573664a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75726bc50 con 0x55a7571c26b0 2023-07-21T22:39:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7572be9e0 con 0x55a75736c210 2023-07-21T22:39:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7572b7e70 con 0x55a75736c660 2023-07-21T22:39:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9effd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7571c26b0 0x55a75736bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9effd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7571c26b0 0x55a75736bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39310/0 (socket says 172.21.15.151:39310) 2023-07-21T22:39:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9effd700 1 -- 172.21.15.151:0/897284302 learned_addr learned my addr 172.21.15.151:0/897284302 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9f7fe700 1 --2- 172.21.15.151:0/897284302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 0x55a7573664a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/897284302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a75736c210 0x55a757365f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9effd700 1 -- 172.21.15.151:0/897284302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 msgr2=0x55a7573664a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:46.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9effd700 1 --2- 172.21.15.151:0/897284302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 0x55a7573664a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9f7fe700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fed880a12c0 0x7fed880a3770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feda00733d0 tx=0x7fed98009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9effd700 1 -- 172.21.15.151:0/897284302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a75736c210 msgr2=0x55a757365f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9effd700 1 --2- 172.21.15.151:0/897284302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a75736c210 0x55a757365f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.956+0000 7fed9effd700 1 -- 172.21.15.151:0/897284302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a7570e5d80 con 0x55a7571c26b0 2023-07-21T22:39:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.957+0000 7fed9effd700 1 --2- 172.21.15.151:0/897284302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7571c26b0 0x55a75736bcd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fed90015000 tx=0x7fed90005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4abf813b9abbee4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.957+0000 7fed857fa700 1 -- 172.21.15.151:0/897284302 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9001d070 con 0x55a7571c26b0 2023-07-21T22:39:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.957+0000 7fed857fa700 1 -- 172.21.15.151:0/897284302 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed9001e040 con 0x55a7571c26b0 2023-07-21T22:39:46.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.957+0000 7fed857fa700 1 -- 172.21.15.151:0/897284302 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90004cd0 con 0x55a7571c26b0 2023-07-21T22:39:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.958+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/897284302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7571c26b0 msgr2=0x55a75736bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.958+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/897284302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7571c26b0 0x55a75736bcd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7fed90015000 tx=0x7fed90005f00 comp rx=0 tx=0).stop 2023-07-21T22:39:46.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.958+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/897284302 shutdown_connections 2023-07-21T22:39:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.958+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/897284302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 0x55a7573664a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.958+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/897284302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a7571c26b0 0x55a75736bcd0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.958+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/897284302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a75736c210 0x55a757365f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.958+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/897284302 >> 172.21.15.151:0/897284302 conn(0x55a75735bae0 msgr2=0x55a7573610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.958+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/897284302 shutdown_connections 2023-07-21T22:39:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.958+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/897284302 wait complete. 2023-07-21T22:39:46.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.959+0000 7fedb8c7bb80 1 -- start start 2023-07-21T22:39:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.959+0000 7fedb8c7bb80 1 Processor -- start 2023-07-21T22:39:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a7573724f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 0x55a75736f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 0x55a75736fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a757257a60 con 0x55a75736c660 2023-07-21T22:39:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a757257760 con 0x55a7571c26b0 2023-07-21T22:39:46.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a75713b8c0 con 0x55a75736c210 2023-07-21T22:39:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fedb8c7bb80 10 client.0 _ll_register_callbacks cb 0x55a757255700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fed9effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a7573724f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fed9effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a7573724f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34072/0 (socket says 172.21.15.151:34072) 2023-07-21T22:39:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fed9effd700 1 -- 172.21.15.151:0/1244732131 learned_addr learned my addr 172.21.15.151:0/1244732131 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fed9f7fe700 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 0x55a75736fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.960+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 0x55a75736f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed9effd700 1 -- 172.21.15.151:0/1244732131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 msgr2=0x55a75736f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed9effd700 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 0x55a75736f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed9effd700 1 -- 172.21.15.151:0/1244732131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 msgr2=0x55a75736fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed9effd700 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 0x55a75736fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed9effd700 1 -- 172.21.15.151:0/1244732131 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feda010f420 con 0x55a7571c26b0 2023-07-21T22:39:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed9f7fe700 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 0x55a75736fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 0x55a75736f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:46.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed9effd700 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a7573724f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed9000fb70 tx=0x7fed9000fba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e7cb436d8446460d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:39:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed82ff5700 1 -- 172.21.15.151:0/1244732131 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9001d040 con 0x55a7571c26b0 2023-07-21T22:39:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fed82ff5700 1 -- 172.21.15.151:0/1244732131 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fed90004500 con 0x55a7571c26b0 2023-07-21T22:39:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.961+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/1244732131 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a757211490 con 0x55a7571c26b0 2023-07-21T22:39:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fed82ff5700 1 -- 172.21.15.151:0/1244732131 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed90005bc0 con 0x55a7571c26b0 2023-07-21T22:39:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fedb8c7bb80 10 client.27638 fetch_fsmap learned FSMap version 73 2023-07-21T22:39:46.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/1244732131 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x55a7570cec00 con 0x55a7571c26b0 2023-07-21T22:39:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fed82ff5700 1 -- 172.21.15.151:0/1244732131 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a757211490 con 0x55a7571c26b0 2023-07-21T22:39:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fed82ff5700 1 -- 172.21.15.151:0/1244732131 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 73) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fed9003d8a0 con 0x55a7571c26b0 2023-07-21T22:39:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fedb8c7bb80 10 client.27638 fetch_fsmap finished waiting for FSMap version 73 2023-07-21T22:39:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fedb8c7bb80 10 client.27638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fedb8c7bb80 20 client.27638 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a75737f660 0x55a757381a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fedb8c7bb80 4 client.27638 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:39:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.962+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/1244732131 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a7572b0e50 con 0x55a75737f660 2023-07-21T22:39:46.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.963+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a75737f660 0x55a757381a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.963+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a75737f660 0x55a757381a70 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=278cc39376c5af01 server_cookie=206e0c10affc92d5 in_seq=0 out_seq=0 2023-07-21T22:39:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.963+0000 7fed82ff5700 10 client.27638 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fed82ff5700 1 -- 172.21.15.151:0/1244732131 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a7572b0e50 con 0x55a75737f660 2023-07-21T22:39:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fed82ff5700 10 client.27638 handle_command_reply: tid=0 2023-07-21T22:39:46.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 client.27638 shutdown 2023-07-21T22:39:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/1244732131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 msgr2=0x55a7573724f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a7573724f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fed9000fb70 tx=0x7fed9000fba0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/1244732131 shutdown_connections 2023-07-21T22:39:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a75737f660 0x55a757381a70 crc :-1 s=READY pgs=280 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a7573724f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 0x55a75736fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/1244732131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 0x55a75736f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fed82ff5700 0 client.27638 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/1244732131 >> 172.21.15.151:0/1244732131 conn(0x55a75735bae0 msgr2=0x55a7573603e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/1244732131 shutdown_connections 2023-07-21T22:39:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.964+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/1244732131 wait complete. 2023-07-21T22:39:46.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.965+0000 7fedb8c7bb80 20 client.27638 trim_cache size 0 max 16384 2023-07-21T22:39:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.980+0000 7fedb8c7bb80 1 Processor -- start 2023-07-21T22:39:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.980+0000 7fedb8c7bb80 1 -- start start 2023-07-21T22:39:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a75736ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c210 0x55a757376ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 0x55a757372020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a757362760 con 0x55a75736c210 2023-07-21T22:39:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a757365f40 con 0x55a7571c26b0 2023-07-21T22:39:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a757367160 con 0x55a75736c660 2023-07-21T22:39:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fed9e7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c210 0x55a757376ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fed9e7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c210 0x55a757376ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39340/0 (socket says 172.21.15.151:39340) 2023-07-21T22:39:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fed9e7fc700 1 -- 172.21.15.151:0/2914421729 learned_addr learned my addr 172.21.15.151:0/2914421729 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fed9effd700 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a75736ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.981+0000 7fed9f7fe700 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 0x55a757372020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed9e7fc700 1 -- 172.21.15.151:0/2914421729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 msgr2=0x55a757372020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 0x55a757372020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed9e7fc700 1 -- 172.21.15.151:0/2914421729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 msgr2=0x55a75736ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a75736ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed9e7fc700 1 -- 172.21.15.151:0/2914421729 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a75710c1f0 con 0x55a75736c210 2023-07-21T22:39:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed9f7fe700 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 0x55a757372020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c210 0x55a757376ba0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fed940ca720 tx=0x7fed940cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a929f80163c245 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed85ffb700 1 -- 172.21.15.151:0/2914421729 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed9409a040 con 0x55a75736c210 2023-07-21T22:39:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed85ffb700 1 -- 172.21.15.151:0/2914421729 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed9409e070 con 0x55a75736c210 2023-07-21T22:39:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.982+0000 7fed85ffb700 1 -- 172.21.15.151:0/2914421729 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed94099790 con 0x55a75736c210 2023-07-21T22:39:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.983+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/2914421729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c210 msgr2=0x55a757376ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.983+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c210 0x55a757376ba0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fed940ca720 tx=0x7fed940cc040 comp rx=0 tx=0).stop 2023-07-21T22:39:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.983+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/2914421729 shutdown_connections 2023-07-21T22:39:46.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.983+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a75736ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.983+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c660 0x55a757372020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.983+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/2914421729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c210 0x55a757376ba0 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.983+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/2914421729 >> 172.21.15.151:0/2914421729 conn(0x55a75735bae0 msgr2=0x55a75737b350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.983+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/2914421729 shutdown_connections 2023-07-21T22:39:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.983+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/2914421729 wait complete. 2023-07-21T22:39:46.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.984+0000 7fedb8c7bb80 1 -- start start 2023-07-21T22:39:46.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.984+0000 7fedb8c7bb80 1 Processor -- start 2023-07-21T22:39:46.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.984+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a757368ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.984+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 0x55a757368ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.984+0000 7fedb8c7bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 0x55a757367730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.984+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a7573771e0 con 0x55a75736c660 2023-07-21T22:39:46.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.984+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a757367ca0 con 0x55a7571c26b0 2023-07-21T22:39:46.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.984+0000 7fedb8c7bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a757367e60 con 0x55a75736c210 2023-07-21T22:39:46.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.984+0000 7fedb8c7bb80 10 client.0 _ll_register_callbacks cb 0x7fed9800f330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:46.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a757368ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a757368ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34076/0 (socket says 172.21.15.151:34076) 2023-07-21T22:39:46.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9effd700 1 -- 172.21.15.151:0/615114159 learned_addr learned my addr 172.21.15.151:0/615114159 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:46.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 0x55a757368ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9f7fe700 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 0x55a757367730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9effd700 1 -- 172.21.15.151:0/615114159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 msgr2=0x55a757368ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:46.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9effd700 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 0x55a757368ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9effd700 1 -- 172.21.15.151:0/615114159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 msgr2=0x55a757367730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9effd700 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 0x55a757367730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9effd700 1 -- 172.21.15.151:0/615114159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed98019770 con 0x55a7571c26b0 2023-07-21T22:39:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed9effd700 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a757368ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed90009ce0 tx=0x7fed9002b3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad4ad800642d7097 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.985+0000 7fed82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:39:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fed82ff5700 1 -- 172.21.15.151:0/615114159 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90005bc0 con 0x55a7571c26b0 2023-07-21T22:39:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fed82ff5700 1 -- 172.21.15.151:0/615114159 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fed90000e40 con 0x55a7571c26b0 2023-07-21T22:39:46.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/615114159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fed9001e040 con 0x55a7571c26b0 2023-07-21T22:39:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fed82ff5700 1 -- 172.21.15.151:0/615114159 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) v2 ==== 24+0+0 (secure 0 0 0) 0x7fed9000b310 con 0x55a7571c26b0 2023-07-21T22:39:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fedb8c7bb80 10 client.27644 fetch_fsmap learned FSMap version 73 2023-07-21T22:39:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/615114159 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) v3 -- 0x7feda01a4d30 con 0x55a7571c26b0 2023-07-21T22:39:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fed82ff5700 1 -- 172.21.15.151:0/615114159 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fed9004a020 con 0x55a7571c26b0 2023-07-21T22:39:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fed82ff5700 1 -- 172.21.15.151:0/615114159 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 73) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fed9002aa80 con 0x55a7571c26b0 2023-07-21T22:39:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fedb8c7bb80 10 client.27644 fetch_fsmap finished waiting for FSMap version 73 2023-07-21T22:39:46.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fedb8c7bb80 10 client.27644 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:46.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fedb8c7bb80 20 client.27644 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:46.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.986+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a7573d4010 0x55a7573d6420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:46.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.987+0000 7fedb8c7bb80 4 client.27644 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:39:46.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.987+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/615114159 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a757272ff0 con 0x55a7573d4010 2023-07-21T22:39:46.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.987+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a7573d4010 0x55a7573d6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:46.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.987+0000 7fed9e7fc700 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a7573d4010 0x55a7573d6420 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b90cb6237ee39bc4 server_cookie=f6678efb381dd616 in_seq=0 out_seq=0 2023-07-21T22:39:46.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.987+0000 7fed82ff5700 10 client.27644 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:46.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fed82ff5700 1 -- 172.21.15.151:0/615114159 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a757272ff0 con 0x55a7573d4010 2023-07-21T22:39:46.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fed82ff5700 10 client.27644 handle_command_reply: tid=0 2023-07-21T22:39:46.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 client.27644 shutdown 2023-07-21T22:39:46.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/615114159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 msgr2=0x55a757368ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:46.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a757368ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fed90009ce0 tx=0x7fed9002b3f0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/615114159 shutdown_connections 2023-07-21T22:39:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a7573d4010 0x55a7573d6420 crc :-1 s=READY pgs=281 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a7571c26b0 0x55a757368ab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a75736c660 0x55a757367730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fed82ff5700 0 client.27644 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 --2- 172.21.15.151:0/615114159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a75736c210 0x55a757368ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/615114159 >> 172.21.15.151:0/615114159 conn(0x55a75735bae0 msgr2=0x55a757369990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:46.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.997+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/615114159 shutdown_connections 2023-07-21T22:39:46.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7fedb8c7bb80 1 -- 172.21.15.151:0/615114159 wait complete. 2023-07-21T22:39:46.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7fedb8c7bb80 20 client.27644 trim_cache size 0 max 16384 2023-07-21T22:39:46.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:39:46.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:39:46.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:39:46.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:39:46.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7feda53ff700 1 -- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fed880a12c0 msgr2=0x7fed880a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:46.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7feda53ff700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fed880a12c0 0x7fed880a3770 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feda00733d0 tx=0x7fed98009920 comp rx=0 tx=0).stop 2023-07-21T22:39:46.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7feda53ff700 1 -- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00682b0 msgr2=0x7feda0198200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:46.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7feda53ff700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00682b0 0x7feda0198200 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7fed9400e9a0 tx=0x7fed9400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7feda53ff700 1 -- 172.21.15.151:0/953205623 shutdown_connections 2023-07-21T22:39:46.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7feda53ff700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fed880a12c0 0x7fed880a3770 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7feda53ff700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feda010c540 0x7feda019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7feda53ff700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feda00679a0 0x7feda0197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.998+0000 7feda53ff700 1 --2- 172.21.15.151:0/953205623 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feda00682b0 0x7feda0198200 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.999+0000 7feda53ff700 1 -- 172.21.15.151:0/953205623 >> 172.21.15.151:0/953205623 conn(0x7feda0074760 msgr2=0x7feda00fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.999+0000 7feda53ff700 1 -- 172.21.15.151:0/953205623 shutdown_connections 2023-07-21T22:39:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:45.999+0000 7feda53ff700 1 -- 172.21.15.151:0/953205623 wait complete. 2023-07-21T22:39:46.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:46 smithi187 ceph-mon[96918]: pgmap v648: 97 pgs: 97 active+clean; 9.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-07-21T22:39:46.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:46 smithi195 ceph-mon[97365]: pgmap v648: 97 pgs: 97 active+clean; 9.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-07-21T22:39:46.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:46 smithi151 ceph-mon[95510]: pgmap v648: 97 pgs: 97 active+clean; 9.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-07-21T22:39:48.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:48 smithi187 ceph-mon[96918]: pgmap v649: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.9 MiB/s wr, 509 op/s 2023-07-21T22:39:48.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:48 smithi195 ceph-mon[97365]: pgmap v649: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.9 MiB/s wr, 509 op/s 2023-07-21T22:39:48.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:48 smithi151 ceph-mon[95510]: pgmap v649: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 3.9 MiB/s wr, 509 op/s 2023-07-21T22:39:50.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:50 smithi187 ceph-mon[96918]: pgmap v650: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-07-21T22:39:50.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:50 smithi195 ceph-mon[97365]: pgmap v650: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-07-21T22:39:50.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:50 smithi151 ceph-mon[95510]: pgmap v650: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-07-21T22:39:52.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:52 smithi187 ceph-mon[96918]: pgmap v651: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-07-21T22:39:52.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:52 smithi195 ceph-mon[97365]: pgmap v651: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-07-21T22:39:52.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:52 smithi151 ceph-mon[95510]: pgmap v651: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 2.6 MiB/s wr, 343 op/s 2023-07-21T22:39:53.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:53 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:39:53.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:53 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:39:54.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:53 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:39:54.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:54 smithi195 ceph-mon[97365]: pgmap v652: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-07-21T22:39:54.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:54 smithi151 ceph-mon[95510]: pgmap v652: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-07-21T22:39:55.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:54 smithi187 ceph-mon[96918]: pgmap v652: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.9 MiB/s wr, 510 op/s 2023-07-21T22:39:55.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:55 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:39:55.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:55 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:39:56.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:55 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:39:56.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:56 smithi195 ceph-mon[97365]: pgmap v653: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 333 op/s 2023-07-21T22:39:56.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:56 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:56.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:56 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:56.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:56 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:56.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:56 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:56.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:56 smithi151 ceph-mon[95510]: pgmap v653: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 333 op/s 2023-07-21T22:39:56.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:56 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:56.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:56 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:56.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:56 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:56.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:56 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:57.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:56 smithi187 ceph-mon[96918]: pgmap v653: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.6 MiB/s wr, 333 op/s 2023-07-21T22:39:57.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:56 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:57.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:56 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:57.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:56 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:57.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:56 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:39:57.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: pgmap v654: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 477 op/s 2023-07-21T22:39:57.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:39:57.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:39:57.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:39:57.906 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:39:57 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:39:57.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: pgmap v654: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 477 op/s 2023-07-21T22:39:57.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:39:57.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:39:57.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:57.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:39:57.949 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:39:57 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:39:58.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: pgmap v654: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.7 MiB/s wr, 477 op/s 2023-07-21T22:39:58.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:58.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:58.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:58.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:58.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:39:58.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:39:58.127 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:58.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:58.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:58.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:39:58.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:39:58.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:39:57 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:39:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.176+0000 7f16a23ff700 1 -- 172.21.15.151:0/346846283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 msgr2=0x7f169c0fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.176+0000 7f16a23ff700 1 --2- 172.21.15.151:0/346846283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 0x7f169c0fff70 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f16900098f0 tx=0x7f1690009c00 comp rx=0 tx=0).stop 2023-07-21T22:39:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.176+0000 7f16a23ff700 1 -- 172.21.15.151:0/346846283 shutdown_connections 2023-07-21T22:39:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.176+0000 7f16a23ff700 1 --2- 172.21.15.151:0/346846283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f169c1004b0 0x7f169c10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.176+0000 7f16a23ff700 1 --2- 172.21.15.151:0/346846283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c105b10 0x7f169c105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.176+0000 7f16a23ff700 1 --2- 172.21.15.151:0/346846283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 0x7f169c0fff70 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.176+0000 7f16a23ff700 1 -- 172.21.15.151:0/346846283 >> 172.21.15.151:0/346846283 conn(0x7f169c0fb600 msgr2=0x7f169c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.176+0000 7f16a23ff700 1 -- 172.21.15.151:0/346846283 shutdown_connections 2023-07-21T22:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.177+0000 7f16a23ff700 1 -- 172.21.15.151:0/346846283 wait complete. 2023-07-21T22:39:59.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.178+0000 7f16a23ff700 1 Processor -- start 2023-07-21T22:39:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.178+0000 7f16a23ff700 1 -- start start 2023-07-21T22:39:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f16a23ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 0x7f169c19bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f16a23ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f169c1004b0 0x7f169c19c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f16a23ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c105b10 0x7f169c195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f16a23ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1960a0 con 0x7f169c105b10 2023-07-21T22:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f16a23ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c196210 con 0x7f169c0ffb00 2023-07-21T22:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f16a23ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169c1963d0 con 0x7f169c1004b0 2023-07-21T22:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f169bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 0x7f169c19bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f169bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 0x7f169c19bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51926/0 (socket says 172.21.15.151:51926) 2023-07-21T22:39:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f169bfff700 1 -- 172.21.15.151:0/277299037 learned_addr learned my addr 172.21.15.151:0/277299037 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.179+0000 7f16a099c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c105b10 0x7f169c195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f169b7fe700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f169c1004b0 0x7f169c19c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f169bfff700 1 -- 172.21.15.151:0/277299037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f169c1004b0 msgr2=0x7f169c19c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f169bfff700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f169c1004b0 0x7f169c19c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f169bfff700 1 -- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c105b10 msgr2=0x7f169c195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f169bfff700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c105b10 0x7f169c195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f169bfff700 1 -- 172.21.15.151:0/277299037 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f168c0095f0 con 0x7f169c0ffb00 2023-07-21T22:39:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f169b7fe700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f169c1004b0 0x7f169c19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:39:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f16a099c700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c105b10 0x7f169c195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f169bfff700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 0x7f169c19bbd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f168c00ec10 tx=0x7f168c00ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f16997fa700 1 -- 172.21.15.151:0/277299037 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c00cd40 con 0x7f169c0ffb00 2023-07-21T22:39:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f16997fa700 1 -- 172.21.15.151:0/277299037 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f168c0044b0 con 0x7f169c0ffb00 2023-07-21T22:39:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f16a23ff700 1 -- 172.21.15.151:0/277299037 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1690009520 con 0x7f169c0ffb00 2023-07-21T22:39:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f16997fa700 1 -- 172.21.15.151:0/277299037 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c010430 con 0x7f169c0ffb00 2023-07-21T22:39:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.180+0000 7f16a23ff700 1 -- 172.21.15.151:0/277299037 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c1a29e0 con 0x7f169c0ffb00 2023-07-21T22:39:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.185+0000 7f16997fa700 1 -- 172.21.15.151:0/277299037 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f168c004000 con 0x7f169c0ffb00 2023-07-21T22:39:59.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.186+0000 7f16b5cf5b80 1 Processor -- start 2023-07-21T22:39:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.186+0000 7f16b5cf5b80 1 -- start start 2023-07-21T22:39:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.186+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec83d6b0 0x556dec9eb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.186+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9e5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.186+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec9eba70 0x556dec9e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.186+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec8e6c50 con 0x556dec9eb620 2023-07-21T22:39:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.186+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec9399e0 con 0x556dec9eba70 2023-07-21T22:39:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.186+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec932e70 con 0x556dec83d6b0 2023-07-21T22:39:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f169b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec9eba70 0x556dec9e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f169bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f169b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec9eba70 0x556dec9e58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51928/0 (socket says 172.21.15.151:51928) 2023-07-21T22:39:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f169b7fe700 1 -- 172.21.15.151:0/3840461113 learned_addr learned my addr 172.21.15.151:0/3840461113 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f16a099c700 1 --2- 172.21.15.151:0/3840461113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec83d6b0 0x556dec9eb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f16997fa700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f16840a12c0 0x7f16840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f169b7fe700 1 -- 172.21.15.151:0/3840461113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec83d6b0 msgr2=0x556dec9eb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f169b7fe700 1 --2- 172.21.15.151:0/3840461113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec83d6b0 0x556dec9eb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f169b7fe700 1 -- 172.21.15.151:0/3840461113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 msgr2=0x556dec9e5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f169b7fe700 1 --2- 172.21.15.151:0/3840461113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9e5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f169b7fe700 1 -- 172.21.15.151:0/3840461113 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dec760d80 con 0x556dec9eba70 2023-07-21T22:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.187+0000 7f16997fa700 1 -- 172.21.15.151:0/277299037 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f168c014070 con 0x7f169c0ffb00 2023-07-21T22:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.188+0000 7f16a099c700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f16840a12c0 0x7f16840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.188+0000 7f169b7fe700 1 --2- 172.21.15.151:0/3840461113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec9eba70 0x556dec9e58b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1690009230 tx=0x7f1690009460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=858c63d3f1acabd0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.188+0000 7f16827fc700 1 -- 172.21.15.151:0/3840461113 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169001c070 con 0x556dec9eba70 2023-07-21T22:39:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.188+0000 7f16827fc700 1 -- 172.21.15.151:0/3840461113 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f169000f8f0 con 0x556dec9eba70 2023-07-21T22:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.188+0000 7f16827fc700 1 -- 172.21.15.151:0/3840461113 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1690005040 con 0x556dec9eba70 2023-07-21T22:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3840461113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec9eba70 msgr2=0x556dec9e58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16a099c700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f16840a12c0 0x7f16840a3770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f169c19c8d0 tx=0x7f1694004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3840461113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec9eba70 0x556dec9e58b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1690009230 tx=0x7f1690009460 comp rx=0 tx=0).stop 2023-07-21T22:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3840461113 shutdown_connections 2023-07-21T22:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3840461113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec9eba70 0x556dec9e58b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3840461113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec83d6b0 0x556dec9eb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3840461113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9e5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3840461113 >> 172.21.15.151:0/3840461113 conn(0x556dec9d6ae0 msgr2=0x556dec9dc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3840461113 shutdown_connections 2023-07-21T22:39:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.189+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3840461113 wait complete. 2023-07-21T22:39:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.190+0000 7f16b5cf5b80 1 -- start start 2023-07-21T22:39:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.190+0000 7f16b5cf5b80 1 Processor -- start 2023-07-21T22:39:59.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eb620 0x556dec9f4f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eba70 0x556dec9eec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec8d2a60 con 0x556dec9eba70 2023-07-21T22:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec8d2760 con 0x556dec83d6b0 2023-07-21T22:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec7b68c0 con 0x556dec9eb620 2023-07-21T22:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f16b5cf5b80 10 client.0 _ll_register_callbacks cb 0x556dec8d0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f16a099c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eba70 0x556dec9eec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f169bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f169bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9f49d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51938/0 (socket says 172.21.15.151:51938) 2023-07-21T22:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f16a099c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eba70 0x556dec9eec60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52238/0 (socket says 172.21.15.151:52238) 2023-07-21T22:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f169bfff700 1 -- 172.21.15.151:0/3481110370 learned_addr learned my addr 172.21.15.151:0/3481110370 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.191+0000 7f169b7fe700 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eb620 0x556dec9f4f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f169bfff700 1 -- 172.21.15.151:0/3481110370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eb620 msgr2=0x556dec9f4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f169bfff700 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eb620 0x556dec9f4f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f169bfff700 1 -- 172.21.15.151:0/3481110370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eba70 msgr2=0x556dec9eec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:59.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f169bfff700 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eba70 0x556dec9eec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f169bfff700 1 -- 172.21.15.151:0/3481110370 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f169c10d240 con 0x556dec83d6b0 2023-07-21T22:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f169bfff700 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9f49d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f168c0ca920 tx=0x7f168c0d0790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d30e858d70cdcb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f167b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f167b7fe700 1 -- 172.21.15.151:0/3481110370 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c009a10 con 0x556dec83d6b0 2023-07-21T22:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f167b7fe700 1 -- 172.21.15.151:0/3481110370 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f168c003710 con 0x556dec83d6b0 2023-07-21T22:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.192+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3481110370 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556dec92be50 con 0x556dec83d6b0 2023-07-21T22:39:59.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.193+0000 7f167b7fe700 1 -- 172.21.15.151:0/3481110370 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f168c099d80 con 0x556dec83d6b0 2023-07-21T22:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.193+0000 7f16b5cf5b80 10 client.27656 fetch_fsmap learned FSMap version 74 2023-07-21T22:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.193+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3481110370 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x556dec749c00 con 0x556dec83d6b0 2023-07-21T22:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.193+0000 7f167b7fe700 1 -- 172.21.15.151:0/3481110370 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556dec92be50 con 0x556dec83d6b0 2023-07-21T22:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.193+0000 7f167b7fe700 1 -- 172.21.15.151:0/3481110370 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 74) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f168c09a4a0 con 0x556dec83d6b0 2023-07-21T22:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.193+0000 7f16b5cf5b80 10 client.27656 fetch_fsmap finished waiting for FSMap version 74 2023-07-21T22:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.193+0000 7f16b5cf5b80 10 client.27656 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.193+0000 7f16b5cf5b80 20 client.27656 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:59.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.193+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556dec9fef20 0x556deca01330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.194+0000 7f16b5cf5b80 4 client.27656 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.194+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3481110370 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556dec8edff0 con 0x556dec9fef20 2023-07-21T22:39:59.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.194+0000 7f169b7fe700 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556dec9fef20 0x556deca01330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.194+0000 7f169b7fe700 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556dec9fef20 0x556deca01330 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=68fe600884adcfe6 server_cookie=c5c323e005c75a18 in_seq=0 out_seq=0 2023-07-21T22:39:59.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.194+0000 7f167b7fe700 10 client.27656 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:59.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f167b7fe700 1 -- 172.21.15.151:0/3481110370 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556dec8edff0 con 0x556dec9fef20 2023-07-21T22:39:59.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f167b7fe700 10 client.27656 handle_command_reply: tid=0 2023-07-21T22:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f16b5cf5b80 1 client.27656 shutdown 2023-07-21T22:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3481110370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 msgr2=0x556dec9f49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9f49d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f168c0ca920 tx=0x7f168c0d0790 comp rx=0 tx=0).stop 2023-07-21T22:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3481110370 shutdown_connections 2023-07-21T22:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556dec9fef20 0x556deca01330 crc :-1 s=READY pgs=282 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9f49d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eba70 0x556dec9eec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/3481110370 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eb620 0x556dec9f4f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f167b7fe700 0 client.27656 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.195+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3481110370 >> 172.21.15.151:0/3481110370 conn(0x556dec9d6ae0 msgr2=0x556dec9db3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.196+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3481110370 shutdown_connections 2023-07-21T22:39:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.196+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/3481110370 wait complete. 2023-07-21T22:39:59.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.196+0000 7f16b5cf5b80 20 client.27656 trim_cache size 0 max 16384 2023-07-21T22:39:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.213+0000 7f16b5cf5b80 1 Processor -- start 2023-07-21T22:39:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f16b5cf5b80 1 -- start start 2023-07-21T22:39:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9eed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9e5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9dbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec9dda10 con 0x556dec9eb620 2023-07-21T22:39:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec9efe40 con 0x556dec83d6b0 2023-07-21T22:39:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec9ed1c0 con 0x556dec9eba70 2023-07-21T22:39:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f169bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9eed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f169bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9eed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51954/0 (socket says 172.21.15.151:51954) 2023-07-21T22:39:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f169bfff700 1 -- 172.21.15.151:0/1450579584 learned_addr learned my addr 172.21.15.151:0/1450579584 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f169b7fe700 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9e5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.214+0000 7f16a099c700 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9dbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f169bfff700 1 -- 172.21.15.151:0/1450579584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 msgr2=0x556dec9dbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f169bfff700 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9dbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f169bfff700 1 -- 172.21.15.151:0/1450579584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 msgr2=0x556dec9e5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f169bfff700 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9e5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f169bfff700 1 -- 172.21.15.151:0/1450579584 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556dec7871f0 con 0x556dec83d6b0 2023-07-21T22:39:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f169b7fe700 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9e5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:39:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f169bfff700 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9eed90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f168c096740 tx=0x7f168c000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4c6b6f6f115159d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f1682ffd700 1 -- 172.21.15.151:0/1450579584 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c009a10 con 0x556dec83d6b0 2023-07-21T22:39:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f1682ffd700 1 -- 172.21.15.151:0/1450579584 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f168c0d2e80 con 0x556dec83d6b0 2023-07-21T22:39:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.215+0000 7f1682ffd700 1 -- 172.21.15.151:0/1450579584 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c09e270 con 0x556dec83d6b0 2023-07-21T22:39:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.216+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/1450579584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 msgr2=0x556dec9eed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:59.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.216+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9eed90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f168c096740 tx=0x7f168c000bc0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.216+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/1450579584 shutdown_connections 2023-07-21T22:39:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.216+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9eed90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.216+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9dbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.216+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/1450579584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9e5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.216+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/1450579584 >> 172.21.15.151:0/1450579584 conn(0x556dec9d6ae0 msgr2=0x556dec9f4d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.216+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/1450579584 shutdown_connections 2023-07-21T22:39:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.217+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/1450579584 wait complete. 2023-07-21T22:39:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.217+0000 7f16b5cf5b80 1 -- start start 2023-07-21T22:39:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.217+0000 7f16b5cf5b80 1 Processor -- start 2023-07-21T22:39:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9fb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9f7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16b5cf5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec9f8180 con 0x556dec9eb620 2023-07-21T22:39:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec9f82f0 con 0x556dec83d6b0 2023-07-21T22:39:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16b5cf5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556dec9f84b0 con 0x556dec9eba70 2023-07-21T22:39:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16b5cf5b80 10 client.0 _ll_register_callbacks cb 0x7f168c003900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:39:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16a099c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16a099c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9f7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35944/0 (socket says 172.21.15.151:35944) 2023-07-21T22:39:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f16a099c700 1 -- 172.21.15.151:0/615256837 learned_addr learned my addr 172.21.15.151:0/615256837 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:39:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f169b7fe700 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9f7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.218+0000 7f169bfff700 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9fb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f169b7fe700 1 -- 172.21.15.151:0/615256837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 msgr2=0x556dec9f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f169b7fe700 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f169b7fe700 1 -- 172.21.15.151:0/615256837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 msgr2=0x556dec9fb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:39:59.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f169b7fe700 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9fb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f169b7fe700 1 -- 172.21.15.151:0/615256837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x556dec749c00 con 0x556dec9eb620 2023-07-21T22:39:59.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f16a099c700 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:39:59.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f169b7fe700 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9f7700 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1690009c40 tx=0x7f169000fbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efc3aaf4ef0e91e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:39:59.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f167b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:39:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f167b7fe700 1 -- 172.21.15.151:0/615256837 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169001c040 con 0x556dec9eb620 2023-07-21T22:39:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f167b7fe700 1 -- 172.21.15.151:0/615256837 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(116..116 src has 1..116) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f169002ba60 con 0x556dec9eb620 2023-07-21T22:39:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.219+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/615256837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556dec88c490 con 0x556dec9eb620 2023-07-21T22:39:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f167b7fe700 1 -- 172.21.15.151:0/615256837 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=74) v2 ==== 24+0+0 (secure 0 0 0) 0x7f169000f8f0 con 0x556dec9eb620 2023-07-21T22:39:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f16b5cf5b80 10 client.17985 fetch_fsmap learned FSMap version 74 2023-07-21T22:39:59.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/615256837 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=74,monmap=4+}) v3 -- 0x556dec75f250 con 0x556dec9eb620 2023-07-21T22:39:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f167b7fe700 1 -- 172.21.15.151:0/615256837 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556dec88c490 con 0x556dec9eb620 2023-07-21T22:39:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f167b7fe700 1 -- 172.21.15.151:0/615256837 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 74) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f1690033070 con 0x556dec9eb620 2023-07-21T22:39:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f16b5cf5b80 10 client.17985 fetch_fsmap finished waiting for FSMap version 74 2023-07-21T22:39:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f16b5cf5b80 10 client.17985 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:39:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f16b5cf5b80 20 client.17985 populate_metadata read hostname 'smithi151' 2023-07-21T22:39:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556deca53e20 0x556deca56230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:39:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f16b5cf5b80 4 client.17985 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:39:59.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.220+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/615256837 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556dec781f10 con 0x556deca53e20 2023-07-21T22:39:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.221+0000 7f169bfff700 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556deca53e20 0x556deca56230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:39:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.221+0000 7f169bfff700 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556deca53e20 0x556deca56230 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a27098e292d9ef server_cookie=5ca86c11f7fdd8d8 in_seq=0 out_seq=0 2023-07-21T22:39:59.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.221+0000 7f167b7fe700 10 client.17985 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:59.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f167b7fe700 1 -- 172.21.15.151:0/615256837 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556dec781f10 con 0x556deca53e20 2023-07-21T22:39:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f167b7fe700 10 client.17985 handle_command_reply: tid=0 2023-07-21T22:39:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f16b5cf5b80 1 client.17985 shutdown 2023-07-21T22:39:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/615256837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 msgr2=0x556dec9f7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:59.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9f7700 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f1690009c40 tx=0x7f169000fbc0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/615256837 shutdown_connections 2023-07-21T22:39:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556deca53e20 0x556deca56230 crc :-1 s=READY pgs=283 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556dec83d6b0 0x556dec9fb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556dec9eba70 0x556dec9f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f167b7fe700 0 client.17985 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:39:59.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f16b5cf5b80 1 --2- 172.21.15.151:0/615256837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556dec9eb620 0x556dec9f7700 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.230+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/615256837 >> 172.21.15.151:0/615256837 conn(0x556dec9d6ae0 msgr2=0x556dec9ebeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.231+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/615256837 shutdown_connections 2023-07-21T22:39:59.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.231+0000 7f16b5cf5b80 1 -- 172.21.15.151:0/615256837 wait complete. 2023-07-21T22:39:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.231+0000 7f16b5cf5b80 20 client.17985 trim_cache size 0 max 16384 2023-07-21T22:39:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:39:59.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:39:59.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:39:59.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:39:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 -- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f16840a12c0 msgr2=0x7f16840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f16840a12c0 0x7f16840a3770 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f169c19c8d0 tx=0x7f1694004ad0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 -- 172.21.15.151:0/277299037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 msgr2=0x7f169c19bbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:39:59.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 0x7f169c19bbd0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f168c00ec10 tx=0x7f168c00ef20 comp rx=0 tx=0).stop 2023-07-21T22:39:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 -- 172.21.15.151:0/277299037 shutdown_connections 2023-07-21T22:39:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f16840a12c0 0x7f16840a3770 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169c0ffb00 0x7f169c19bbd0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169c105b10 0x7f169c195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 --2- 172.21.15.151:0/277299037 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f169c1004b0 0x7f169c19c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:39:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 -- 172.21.15.151:0/277299037 >> 172.21.15.151:0/277299037 conn(0x7f169c0fb600 msgr2=0x7f169c103610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:39:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 -- 172.21.15.151:0/277299037 shutdown_connections 2023-07-21T22:39:59.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:39:59.232+0000 7f16a23ff700 1 -- 172.21.15.151:0/277299037 wait complete. 2023-07-21T22:40:00.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:40:00.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:40:00.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: pgmap v655: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-07-21T22:40:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:40:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:40:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:40:00.377 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:00 smithi187 ceph-mon[96918]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:40:00.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:40:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:40:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: pgmap v655: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-07-21T22:40:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:40:00.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:40:00.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:40:00.406 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:00 smithi195 ceph-mon[97365]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:40:00.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T22:39:59.999+0000 7f5662017700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:40:00.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:40:00.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:40:00.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: pgmap v655: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-07-21T22:40:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:40:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:40:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:40:00.448 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:40:00.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:00 smithi151 ceph-mon[95510]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:40:01.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:01 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:40:01.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:01 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:40:01.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:01 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:40:01.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:01 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:40:01.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:01 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:40:01.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:01 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:40:02.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:02 smithi187 ceph-mon[96918]: pgmap v656: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-07-21T22:40:02.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:02 smithi195 ceph-mon[97365]: pgmap v656: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-07-21T22:40:02.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:02 smithi151 ceph-mon[95510]: pgmap v656: 97 pgs: 97 active+clean; 9.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-07-21T22:40:04.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:04 smithi187 ceph-mon[96918]: pgmap v657: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.6 MiB/s wr, 478 op/s 2023-07-21T22:40:04.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:04 smithi195 ceph-mon[97365]: pgmap v657: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.6 MiB/s wr, 478 op/s 2023-07-21T22:40:04.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:04 smithi151 ceph-mon[95510]: pgmap v657: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.6 MiB/s wr, 478 op/s 2023-07-21T22:40:05.697 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:05 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:05.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:05 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:05.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:05 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:06.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:06 smithi187 ceph-mon[96918]: pgmap v658: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.3 MiB/s wr, 310 op/s 2023-07-21T22:40:06.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:06 smithi195 ceph-mon[97365]: pgmap v658: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.3 MiB/s wr, 310 op/s 2023-07-21T22:40:06.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:06 smithi151 ceph-mon[95510]: pgmap v658: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.3 MiB/s wr, 310 op/s 2023-07-21T22:40:08.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:08 smithi187 ceph-mon[96918]: pgmap v659: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.6 MiB/s wr, 472 op/s 2023-07-21T22:40:08.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:08 smithi195 ceph-mon[97365]: pgmap v659: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.6 MiB/s wr, 472 op/s 2023-07-21T22:40:08.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:08 smithi151 ceph-mon[95510]: pgmap v659: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.6 MiB/s wr, 472 op/s 2023-07-21T22:40:10.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:10 smithi187 ceph-mon[96918]: pgmap v660: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.4 MiB/s wr, 328 op/s 2023-07-21T22:40:10.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:10 smithi187 ceph-mon[96918]: osdmap e117: 12 total, 12 up, 12 in 2023-07-21T22:40:10.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:10 smithi195 ceph-mon[97365]: pgmap v660: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.4 MiB/s wr, 328 op/s 2023-07-21T22:40:10.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:10 smithi195 ceph-mon[97365]: osdmap e117: 12 total, 12 up, 12 in 2023-07-21T22:40:10.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:10 smithi151 ceph-mon[95510]: pgmap v660: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.4 MiB/s wr, 328 op/s 2023-07-21T22:40:10.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:10 smithi151 ceph-mon[95510]: osdmap e117: 12 total, 12 up, 12 in 2023-07-21T22:40:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.447+0000 7f04409ff700 1 -- 172.21.15.151:0/3455194760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c110b10 msgr2=0x7f043c112ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.447+0000 7f04409ff700 1 --2- 172.21.15.151:0/3455194760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c110b10 0x7f043c112ef0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f0434009f90 tx=0x7f043400b330 comp rx=0 tx=0).stop 2023-07-21T22:40:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.447+0000 7f04409ff700 1 -- 172.21.15.151:0/3455194760 shutdown_connections 2023-07-21T22:40:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.447+0000 7f04409ff700 1 --2- 172.21.15.151:0/3455194760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f043c0728b0 0x7f043c072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.447+0000 7f04409ff700 1 --2- 172.21.15.151:0/3455194760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c110b10 0x7f043c112ef0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.447+0000 7f04409ff700 1 --2- 172.21.15.151:0/3455194760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f043c0731c0 0x7f043c1105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.447+0000 7f04409ff700 1 -- 172.21.15.151:0/3455194760 >> 172.21.15.151:0/3455194760 conn(0x7f043c0fb600 msgr2=0x7f043c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.447+0000 7f04409ff700 1 -- 172.21.15.151:0/3455194760 shutdown_connections 2023-07-21T22:40:12.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.447+0000 7f04409ff700 1 -- 172.21.15.151:0/3455194760 wait complete. 2023-07-21T22:40:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.449+0000 7f04409ff700 1 Processor -- start 2023-07-21T22:40:12.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.449+0000 7f04409ff700 1 -- start start 2023-07-21T22:40:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f04409ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c0728b0 0x7f043c19c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f04409ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f043c0731c0 0x7f043c19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f04409ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f043c110b10 0x7f043c1a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f04409ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1a1450 con 0x7f043c110b10 2023-07-21T22:40:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f04409ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1a15c0 con 0x7f043c0731c0 2023-07-21T22:40:12.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f04409ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c1a1780 con 0x7f043c0728b0 2023-07-21T22:40:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f043a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c0728b0 0x7f043c19c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f043a59c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c0728b0 0x7f043c19c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57938/0 (socket says 172.21.15.151:57938) 2023-07-21T22:40:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f043a59c700 1 -- 172.21.15.151:0/1879336186 learned_addr learned my addr 172.21.15.151:0/1879336186 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.450+0000 7f043ad9d700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f043c110b10 0x7f043c1a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f0439d9b700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f043c0731c0 0x7f043c19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f043a59c700 1 -- 172.21.15.151:0/1879336186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f043c0731c0 msgr2=0x7f043c19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:12.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f043a59c700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f043c0731c0 0x7f043c19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f043a59c700 1 -- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f043c110b10 msgr2=0x7f043c1a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f043a59c700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f043c110b10 0x7f043c1a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f043a59c700 1 -- 172.21.15.151:0/1879336186 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0434009c40 con 0x7f043c0728b0 2023-07-21T22:40:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f043a59c700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c0728b0 0x7f043c19c260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f042c00e9c0 tx=0x7f042c00ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f042b7fe700 1 -- 172.21.15.151:0/1879336186 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00cbd0 con 0x7f043c0728b0 2023-07-21T22:40:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f042b7fe700 1 -- 172.21.15.151:0/1879336186 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f042c00eeb0 con 0x7f043c0728b0 2023-07-21T22:40:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f04409ff700 1 -- 172.21.15.151:0/1879336186 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c1a1a60 con 0x7f043c0728b0 2023-07-21T22:40:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.451+0000 7f042b7fe700 1 -- 172.21.15.151:0/1879336186 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c005410 con 0x7f043c0728b0 2023-07-21T22:40:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.452+0000 7f04409ff700 1 -- 172.21.15.151:0/1879336186 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c1a92a0 con 0x7f043c0728b0 2023-07-21T22:40:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.455+0000 7f042b7fe700 1 -- 172.21.15.151:0/1879336186 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f042c0055b0 con 0x7f043c0728b0 2023-07-21T22:40:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.457+0000 7f04543c1b80 1 Processor -- start 2023-07-21T22:40:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.458+0000 7f04543c1b80 1 -- start start 2023-07-21T22:40:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.458+0000 7f042b7fe700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04240a1340 0x7f04240a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.458+0000 7f042b7fe700 1 -- 172.21.15.151:0/1879336186 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f042c014070 con 0x7f043c0728b0 2023-07-21T22:40:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.458+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.458+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.458+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 0x5620e13ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.458+0000 7f04543c1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e12f2c50 con 0x5620e12496b0 2023-07-21T22:40:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.458+0000 7f04543c1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e13459e0 con 0x5620e13f3660 2023-07-21T22:40:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.458+0000 7f04543c1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e133ee70 con 0x5620e13f3210 2023-07-21T22:40:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f0439d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f043a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f0439d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13ecf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57942/0 (socket says 172.21.15.151:57942) 2023-07-21T22:40:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f0439d9b700 1 -- 172.21.15.151:0/753941473 learned_addr learned my addr 172.21.15.151:0/753941473 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f043ad9d700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04240a1340 0x7f04240a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f043ad9d700 1 --2- 172.21.15.151:0/753941473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 0x5620e13ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f0439d9b700 1 -- 172.21.15.151:0/753941473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 msgr2=0x5620e13ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f0439d9b700 1 --2- 172.21.15.151:0/753941473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 0x5620e13ed4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f0439d9b700 1 -- 172.21.15.151:0/753941473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 msgr2=0x5620e13f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f0439d9b700 1 --2- 172.21.15.151:0/753941473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f0439d9b700 1 -- 172.21.15.151:0/753941473 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620e116cd80 con 0x5620e13f3210 2023-07-21T22:40:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.459+0000 7f043ad9d700 1 --2- 172.21.15.151:0/753941473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 0x5620e13ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:40:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.460+0000 7f0439d9b700 1 --2- 172.21.15.151:0/753941473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13ecf40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0430009c90 tx=0x7f04300103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a081da335833dd92 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:12.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.460+0000 7f043ad9d700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04240a1340 0x7f04240a37f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5620e13f3a70 tx=0x7f0434006000 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.460+0000 7f0428ff9700 1 -- 172.21.15.151:0/753941473 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430009790 con 0x5620e13f3210 2023-07-21T22:40:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.460+0000 7f0428ff9700 1 -- 172.21.15.151:0/753941473 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0430015070 con 0x5620e13f3210 2023-07-21T22:40:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.460+0000 7f0428ff9700 1 -- 172.21.15.151:0/753941473 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04300116a0 con 0x5620e13f3210 2023-07-21T22:40:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.461+0000 7f04543c1b80 1 -- 172.21.15.151:0/753941473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 msgr2=0x5620e13ecf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.461+0000 7f04543c1b80 1 --2- 172.21.15.151:0/753941473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13ecf40 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0430009c90 tx=0x7f04300103d0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.461+0000 7f04543c1b80 1 -- 172.21.15.151:0/753941473 shutdown_connections 2023-07-21T22:40:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.461+0000 7f04543c1b80 1 --2- 172.21.15.151:0/753941473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 0x5620e13ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.461+0000 7f04543c1b80 1 --2- 172.21.15.151:0/753941473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.461+0000 7f04543c1b80 1 --2- 172.21.15.151:0/753941473 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13ecf40 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.461+0000 7f04543c1b80 1 -- 172.21.15.151:0/753941473 >> 172.21.15.151:0/753941473 conn(0x5620e13e2ae0 msgr2=0x5620e13e80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.461+0000 7f04543c1b80 1 -- 172.21.15.151:0/753941473 shutdown_connections 2023-07-21T22:40:12.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.461+0000 7f04543c1b80 1 -- 172.21.15.151:0/753941473 wait complete. 2023-07-21T22:40:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.462+0000 7f04543c1b80 1 -- start start 2023-07-21T22:40:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.462+0000 7f04543c1b80 1 Processor -- start 2023-07-21T22:40:12.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.463+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f9580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.463+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3210 0x5620e13f6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.463+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3660 0x5620e13f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.463+0000 7f04543c1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e12dea60 con 0x5620e12496b0 2023-07-21T22:40:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.463+0000 7f04543c1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e12de760 con 0x5620e13f3210 2023-07-21T22:40:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.463+0000 7f04543c1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e11c28c0 con 0x5620e13f3660 2023-07-21T22:40:12.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.463+0000 7f04543c1b80 10 client.0 _ll_register_callbacks cb 0x5620e12dc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:40:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f0439d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3210 0x5620e13f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f043ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3660 0x5620e13f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f0439d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3210 0x5620e13f6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44016/0 (socket says 172.21.15.151:44016) 2023-07-21T22:40:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f0439d9b700 1 -- 172.21.15.151:0/238697749 learned_addr learned my addr 172.21.15.151:0/238697749 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f043ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3660 0x5620e13f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57958/0 (socket says 172.21.15.151:57958) 2023-07-21T22:40:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f043a59c700 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f9580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f0439d9b700 1 -- 172.21.15.151:0/238697749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3660 msgr2=0x5620e13f6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f0439d9b700 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3660 0x5620e13f6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f0439d9b700 1 -- 172.21.15.151:0/238697749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 msgr2=0x5620e13f9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f0439d9b700 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f9580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f0439d9b700 1 -- 172.21.15.151:0/238697749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04300098f0 con 0x5620e13f3210 2023-07-21T22:40:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.464+0000 7f043ad9d700 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3660 0x5620e13f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:40:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.465+0000 7f0439d9b700 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3210 0x5620e13f6870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f043001c6b0 tx=0x7f043001c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee451633ba588bed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.465+0000 7f0421ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:40:12.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.465+0000 7f0421ffb700 1 -- 172.21.15.151:0/238697749 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430020040 con 0x5620e13f3210 2023-07-21T22:40:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.465+0000 7f04543c1b80 1 -- 172.21.15.151:0/238697749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5620e1298490 con 0x5620e13f3210 2023-07-21T22:40:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.465+0000 7f0421ffb700 1 -- 172.21.15.151:0/238697749 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f0430017070 con 0x5620e13f3210 2023-07-21T22:40:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.465+0000 7f0421ffb700 1 -- 172.21.15.151:0/238697749 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0430010e00 con 0x5620e13f3210 2023-07-21T22:40:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.465+0000 7f04543c1b80 10 client.27674 fetch_fsmap learned FSMap version 76 2023-07-21T22:40:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.465+0000 7f04543c1b80 1 -- 172.21.15.151:0/238697749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x5620e1155c00 con 0x5620e13f3210 2023-07-21T22:40:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.466+0000 7f0421ffb700 1 -- 172.21.15.151:0/238697749 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0430032020 con 0x5620e13f3210 2023-07-21T22:40:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.466+0000 7f0421ffb700 1 -- 172.21.15.151:0/238697749 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 76) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f0430003a90 con 0x5620e13f3210 2023-07-21T22:40:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.466+0000 7f04543c1b80 10 client.27674 fetch_fsmap finished waiting for FSMap version 76 2023-07-21T22:40:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.466+0000 7f04543c1b80 10 client.27674 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:40:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.466+0000 7f04543c1b80 20 client.27674 populate_metadata read hostname 'smithi151' 2023-07-21T22:40:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.466+0000 7f04543c1b80 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5620e1406a20 0x5620e1408e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.466+0000 7f04543c1b80 4 client.27674 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:40:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.466+0000 7f04543c1b80 1 -- 172.21.15.151:0/238697749 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5620e1337e50 con 0x5620e1406a20 2023-07-21T22:40:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.467+0000 7f043a59c700 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5620e1406a20 0x5620e1408e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.467+0000 7f043a59c700 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5620e1406a20 0x5620e1408e30 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c047353904d4e332 server_cookie=3bb053ebfbeac6be in_seq=0 out_seq=0 2023-07-21T22:40:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.467+0000 7f0421ffb700 10 client.27674 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.468+0000 7f0421ffb700 1 -- 172.21.15.151:0/238697749 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5620e1337e50 con 0x5620e1406a20 2023-07-21T22:40:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.468+0000 7f0421ffb700 10 client.27674 handle_command_reply: tid=0 2023-07-21T22:40:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.468+0000 7f04543c1b80 1 client.27674 shutdown 2023-07-21T22:40:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.469+0000 7f04543c1b80 1 -- 172.21.15.151:0/238697749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3210 msgr2=0x5620e13f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.469+0000 7f04543c1b80 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3210 0x5620e13f6870 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f043001c6b0 tx=0x7f043001c6e0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.469+0000 7f04543c1b80 1 -- 172.21.15.151:0/238697749 shutdown_connections 2023-07-21T22:40:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.469+0000 7f04543c1b80 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5620e1406a20 0x5620e1408e30 crc :-1 s=READY pgs=284 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.469+0000 7f04543c1b80 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3660 0x5620e13f6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.469+0000 7f04543c1b80 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f9580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.469+0000 7f04543c1b80 1 --2- 172.21.15.151:0/238697749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3210 0x5620e13f6870 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.469+0000 7f04543c1b80 1 -- 172.21.15.151:0/238697749 >> 172.21.15.151:0/238697749 conn(0x5620e13e2ae0 msgr2=0x5620e13e73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.469+0000 7f0421ffb700 0 client.27674 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.470+0000 7f04543c1b80 1 -- 172.21.15.151:0/238697749 shutdown_connections 2023-07-21T22:40:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.470+0000 7f04543c1b80 1 -- 172.21.15.151:0/238697749 wait complete. 2023-07-21T22:40:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.470+0000 7f04543c1b80 20 client.27674 trim_cache size 0 max 16384 2023-07-21T22:40:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.488+0000 7f04543c1b80 1 Processor -- start 2023-07-21T22:40:12.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.488+0000 7f04543c1b80 1 -- start start 2023-07-21T22:40:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.488+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.488+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.488+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 0x5620e13f2020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.488+0000 7f04543c1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e13f15a0 con 0x5620e12496b0 2023-07-21T22:40:12.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.488+0000 7f04543c1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e13e99d0 con 0x5620e13f3660 2023-07-21T22:40:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.488+0000 7f04543c1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e13fe170 con 0x5620e13f3210 2023-07-21T22:40:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f0439d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f043a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f0439d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13fdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57974/0 (socket says 172.21.15.151:57974) 2023-07-21T22:40:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f0439d9b700 1 -- 172.21.15.151:0/62628197 learned_addr learned my addr 172.21.15.151:0/62628197 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f043ad9d700 1 --2- 172.21.15.151:0/62628197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 0x5620e13f2020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f0439d9b700 1 -- 172.21.15.151:0/62628197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 msgr2=0x5620e13f2020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f0439d9b700 1 --2- 172.21.15.151:0/62628197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 0x5620e13f2020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f0439d9b700 1 -- 172.21.15.151:0/62628197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 msgr2=0x5620e13f4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f0439d9b700 1 --2- 172.21.15.151:0/62628197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f0439d9b700 1 -- 172.21.15.151:0/62628197 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5620e11931f0 con 0x5620e13f3210 2023-07-21T22:40:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f0439d9b700 1 --2- 172.21.15.151:0/62628197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13fdc30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f04300093d0 tx=0x7f0430009bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ff11d2a959f77945 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.489+0000 7f04297fa700 1 -- 172.21.15.151:0/62628197 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430020070 con 0x5620e13f3210 2023-07-21T22:40:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.490+0000 7f04297fa700 1 -- 172.21.15.151:0/62628197 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0430032030 con 0x5620e13f3210 2023-07-21T22:40:12.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.490+0000 7f04297fa700 1 -- 172.21.15.151:0/62628197 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430010e60 con 0x5620e13f3210 2023-07-21T22:40:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.490+0000 7f04543c1b80 1 -- 172.21.15.151:0/62628197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 msgr2=0x5620e13fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.490+0000 7f04543c1b80 1 --2- 172.21.15.151:0/62628197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13fdc30 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f04300093d0 tx=0x7f0430009bc0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.491+0000 7f04543c1b80 1 -- 172.21.15.151:0/62628197 shutdown_connections 2023-07-21T22:40:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.491+0000 7f04543c1b80 1 --2- 172.21.15.151:0/62628197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e13f3660 0x5620e13f2020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.491+0000 7f04543c1b80 1 --2- 172.21.15.151:0/62628197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e12496b0 0x5620e13f4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.491+0000 7f04543c1b80 1 --2- 172.21.15.151:0/62628197 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13fdc30 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.491+0000 7f04543c1b80 1 -- 172.21.15.151:0/62628197 >> 172.21.15.151:0/62628197 conn(0x5620e13e2ae0 msgr2=0x5620e13f1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.491+0000 7f04543c1b80 1 -- 172.21.15.151:0/62628197 shutdown_connections 2023-07-21T22:40:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.491+0000 7f04543c1b80 1 -- 172.21.15.151:0/62628197 wait complete. 2023-07-21T22:40:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.491+0000 7f04543c1b80 1 -- start start 2023-07-21T22:40:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.491+0000 7f04543c1b80 1 Processor -- start 2023-07-21T22:40:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.492+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e12496b0 0x5620e13efa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.492+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13eff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.492+0000 7f04543c1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e13f3660 0x5620e13ee730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.492+0000 7f04543c1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e13eec70 con 0x5620e13f3660 2023-07-21T22:40:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.492+0000 7f04543c1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e13eede0 con 0x5620e12496b0 2023-07-21T22:40:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.492+0000 7f04543c1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5620e13eefa0 con 0x5620e13f3210 2023-07-21T22:40:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.492+0000 7f04543c1b80 10 client.0 _ll_register_callbacks cb 0x7f042c0963e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:40:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f043ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e13f3660 0x5620e13ee730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f043ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e13f3660 0x5620e13ee730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53328/0 (socket says 172.21.15.151:53328) 2023-07-21T22:40:12.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f043a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e12496b0 0x5620e13efa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f043ad9d700 1 -- 172.21.15.151:0/3138479426 learned_addr learned my addr 172.21.15.151:0/3138479426 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f0439d9b700 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13eff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f0439d9b700 1 -- 172.21.15.151:0/3138479426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e12496b0 msgr2=0x5620e13efa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f0439d9b700 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e12496b0 0x5620e13efa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f0439d9b700 1 -- 172.21.15.151:0/3138479426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e13f3660 msgr2=0x5620e13ee730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f0439d9b700 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e13f3660 0x5620e13ee730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.493+0000 7f0439d9b700 1 -- 172.21.15.151:0/3138479426 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5620e1155c00 con 0x5620e13f3210 2023-07-21T22:40:12.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.494+0000 7f0439d9b700 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13eff50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0430003e50 tx=0x7f0430005970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bf492d97bd7ec757 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.494+0000 7f0421ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:40:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.494+0000 7f0421ffb700 1 -- 172.21.15.151:0/3138479426 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430020040 con 0x5620e13f3210 2023-07-21T22:40:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.494+0000 7f0421ffb700 1 -- 172.21.15.151:0/3138479426 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(117..117 src has 1..117) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f0430017070 con 0x5620e13f3210 2023-07-21T22:40:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.494+0000 7f04543c1b80 1 -- 172.21.15.151:0/3138479426 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0430015070 con 0x5620e13f3210 2023-07-21T22:40:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.494+0000 7f0421ffb700 1 -- 172.21.15.151:0/3138479426 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f043001ca10 con 0x5620e13f3210 2023-07-21T22:40:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.494+0000 7f04543c1b80 10 client.27706 fetch_fsmap learned FSMap version 76 2023-07-21T22:40:12.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.494+0000 7f04543c1b80 1 -- 172.21.15.151:0/3138479426 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x5620e116b250 con 0x5620e13f3210 2023-07-21T22:40:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.495+0000 7f0421ffb700 1 -- 172.21.15.151:0/3138479426 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0430015070 con 0x5620e13f3210 2023-07-21T22:40:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.495+0000 7f0421ffb700 1 -- 172.21.15.151:0/3138479426 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 76) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f0430003680 con 0x5620e13f3210 2023-07-21T22:40:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.495+0000 7f04543c1b80 10 client.27706 fetch_fsmap finished waiting for FSMap version 76 2023-07-21T22:40:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.495+0000 7f04543c1b80 10 client.27706 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:40:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.495+0000 7f04543c1b80 20 client.27706 populate_metadata read hostname 'smithi151' 2023-07-21T22:40:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.495+0000 7f04543c1b80 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5620e145b310 0x5620e145d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.495+0000 7f04543c1b80 4 client.27706 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:40:12.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.495+0000 7f04543c1b80 1 -- 172.21.15.151:0/3138479426 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5620e12f9ff0 con 0x5620e145b310 2023-07-21T22:40:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.496+0000 7f043a59c700 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5620e145b310 0x5620e145d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.496+0000 7f043a59c700 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5620e145b310 0x5620e145d720 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cf5a0a5303696b4 server_cookie=9c5f4584741f51be in_seq=0 out_seq=0 2023-07-21T22:40:12.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.496+0000 7f0421ffb700 10 client.27706 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.507+0000 7f0421ffb700 1 -- 172.21.15.151:0/3138479426 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5620e12f9ff0 con 0x5620e145b310 2023-07-21T22:40:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.507+0000 7f0421ffb700 10 client.27706 handle_command_reply: tid=0 2023-07-21T22:40:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.507+0000 7f04543c1b80 1 client.27706 shutdown 2023-07-21T22:40:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 -- 172.21.15.151:0/3138479426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 msgr2=0x5620e13eff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13eff50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0430003e50 tx=0x7f0430005970 comp rx=0 tx=0).stop 2023-07-21T22:40:12.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 -- 172.21.15.151:0/3138479426 shutdown_connections 2023-07-21T22:40:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5620e145b310 0x5620e145d720 crc :-1 s=READY pgs=285 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5620e12496b0 0x5620e13efa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5620e13f3660 0x5620e13ee730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 --2- 172.21.15.151:0/3138479426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5620e13f3210 0x5620e13eff50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 -- 172.21.15.151:0/3138479426 >> 172.21.15.151:0/3138479426 conn(0x5620e13e2ae0 msgr2=0x5620e13f21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:12.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f0421ffb700 0 client.27706 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 -- 172.21.15.151:0/3138479426 shutdown_connections 2023-07-21T22:40:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 1 -- 172.21.15.151:0/3138479426 wait complete. 2023-07-21T22:40:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.508+0000 7f04543c1b80 20 client.27706 trim_cache size 0 max 16384 2023-07-21T22:40:12.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:40:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:40:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:40:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:40:12.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 -- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04240a1340 msgr2=0x7f04240a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04240a1340 0x7f04240a37f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x5620e13f3a70 tx=0x7f0434006000 comp rx=0 tx=0).stop 2023-07-21T22:40:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 -- 172.21.15.151:0/1879336186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c0728b0 msgr2=0x7f043c19c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c0728b0 0x7f043c19c260 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f042c00e9c0 tx=0x7f042c00ecd0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 -- 172.21.15.151:0/1879336186 shutdown_connections 2023-07-21T22:40:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04240a1340 0x7f04240a37f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f043c110b10 0x7f043c1a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f043c0728b0 0x7f043c19c260 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 --2- 172.21.15.151:0/1879336186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f043c0731c0 0x7f043c19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 -- 172.21.15.151:0/1879336186 >> 172.21.15.151:0/1879336186 conn(0x7f043c0fb600 msgr2=0x7f043c0fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 -- 172.21.15.151:0/1879336186 shutdown_connections 2023-07-21T22:40:12.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:12.509+0000 7f04409ff700 1 -- 172.21.15.151:0/1879336186 wait complete. 2023-07-21T22:40:12.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:12 smithi187 ceph-mon[96918]: pgmap v662: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.9 MiB/s wr, 393 op/s 2023-07-21T22:40:12.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:12 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:12.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:12 smithi195 ceph-mon[97365]: pgmap v662: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.9 MiB/s wr, 393 op/s 2023-07-21T22:40:12.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:12 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:12.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:12 smithi151 ceph-mon[95510]: pgmap v662: 97 pgs: 97 active+clean; 9.4 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 2.9 MiB/s wr, 393 op/s 2023-07-21T22:40:12.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:12 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:14.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:14 smithi187 ceph-mon[96918]: pgmap v663: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:40:14.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:14 smithi195 ceph-mon[97365]: pgmap v663: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:40:14.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:14 smithi151 ceph-mon[95510]: pgmap v663: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:40:16.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:16 smithi187 ceph-mon[96918]: pgmap v664: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:40:16.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:16 smithi187 ceph-mon[96918]: osdmap e118: 12 total, 12 up, 12 in 2023-07-21T22:40:16.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:16 smithi195 ceph-mon[97365]: pgmap v664: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:40:16.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:16 smithi195 ceph-mon[97365]: osdmap e118: 12 total, 12 up, 12 in 2023-07-21T22:40:16.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:16 smithi151 ceph-mon[95510]: pgmap v664: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.8 MiB/s wr, 369 op/s 2023-07-21T22:40:16.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:16 smithi151 ceph-mon[95510]: osdmap e118: 12 total, 12 up, 12 in 2023-07-21T22:40:18.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:18 smithi187 ceph-mon[96918]: pgmap v666: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.5 MiB/s wr, 455 op/s 2023-07-21T22:40:18.913 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:18 smithi195 ceph-mon[97365]: pgmap v666: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.5 MiB/s wr, 455 op/s 2023-07-21T22:40:18.947 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:18 smithi151 ceph-mon[95510]: pgmap v666: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.5 MiB/s wr, 455 op/s 2023-07-21T22:40:20.876 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:20 smithi187 ceph-mon[96918]: pgmap v667: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:40:20.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:20 smithi195 ceph-mon[97365]: pgmap v667: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:40:20.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:20 smithi151 ceph-mon[95510]: pgmap v667: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:40:22.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:22 smithi187 ceph-mon[96918]: pgmap v668: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:40:22.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:22 smithi195 ceph-mon[97365]: pgmap v668: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:40:22.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:22 smithi151 ceph-mon[95510]: pgmap v668: 97 pgs: 97 active+clean; 9.2 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:40:24.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:24 smithi187 ceph-mon[96918]: pgmap v669: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:40:24.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:24 smithi195 ceph-mon[97365]: pgmap v669: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:40:24.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:24 smithi151 ceph-mon[95510]: pgmap v669: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.676+0000 7f58b2bff700 1 -- 172.21.15.151:0/789345043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58ac073160 msgr2=0x7f58ac10bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.676+0000 7f58b2bff700 1 --2- 172.21.15.151:0/789345043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58ac073160 0x7f58ac10bed0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f58980098f0 tx=0x7f5898009c00 comp rx=0 tx=0).stop 2023-07-21T22:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.676+0000 7f58b2bff700 1 -- 172.21.15.151:0/789345043 shutdown_connections 2023-07-21T22:40:25.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.676+0000 7f58b2bff700 1 --2- 172.21.15.151:0/789345043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58ac072850 0x7f58ac072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.676+0000 7f58b2bff700 1 --2- 172.21.15.151:0/789345043 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58ac10c410 0x7f58ac10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.676+0000 7f58b2bff700 1 --2- 172.21.15.151:0/789345043 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58ac073160 0x7f58ac10bed0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.676+0000 7f58b2bff700 1 -- 172.21.15.151:0/789345043 >> 172.21.15.151:0/789345043 conn(0x7f58ac0fb6f0 msgr2=0x7f58ac0fdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.676+0000 7f58b2bff700 1 -- 172.21.15.151:0/789345043 shutdown_connections 2023-07-21T22:40:25.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.676+0000 7f58b2bff700 1 -- 172.21.15.151:0/789345043 wait complete. 2023-07-21T22:40:25.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.677+0000 7f58b2bff700 1 Processor -- start 2023-07-21T22:40:25.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.677+0000 7f58b2bff700 1 -- start start 2023-07-21T22:40:25.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b2bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58ac072850 0x7f58ac197e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b2bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58ac073160 0x7f58ac198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b2bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58ac10c410 0x7f58ac19c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b2bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac19d000 con 0x7f58ac10c410 2023-07-21T22:40:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b2bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac19d170 con 0x7f58ac072850 2023-07-21T22:40:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b2bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58ac19d330 con 0x7f58ac073160 2023-07-21T22:40:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b099b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58ac072850 0x7f58ac197e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b099b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58ac072850 0x7f58ac197e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43442/0 (socket says 172.21.15.151:43442) 2023-07-21T22:40:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b099b700 1 -- 172.21.15.151:0/2207305485 learned_addr learned my addr 172.21.15.151:0/2207305485 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b119c700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58ac10c410 0x7f58ac19c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58abfff700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58ac073160 0x7f58ac198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b099b700 1 -- 172.21.15.151:0/2207305485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58ac073160 msgr2=0x7f58ac198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b099b700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58ac073160 0x7f58ac198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b099b700 1 -- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58ac10c410 msgr2=0x7f58ac19c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b099b700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58ac10c410 0x7f58ac19c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.678+0000 7f58b099b700 1 -- 172.21.15.151:0/2207305485 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5898009520 con 0x7f58ac072850 2023-07-21T22:40:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.679+0000 7f58b099b700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58ac072850 0x7f58ac197e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f58a000e9a0 tx=0x7f58a000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.679+0000 7f58a9ffb700 1 -- 172.21.15.151:0/2207305485 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0009790 con 0x7f58ac072850 2023-07-21T22:40:25.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.679+0000 7f58a9ffb700 1 -- 172.21.15.151:0/2207305485 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a000cbd0 con 0x7f58ac072850 2023-07-21T22:40:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.679+0000 7f58b2bff700 1 -- 172.21.15.151:0/2207305485 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58ac19d610 con 0x7f58ac072850 2023-07-21T22:40:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.679+0000 7f58a9ffb700 1 -- 172.21.15.151:0/2207305485 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0018680 con 0x7f58ac072850 2023-07-21T22:40:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.679+0000 7f58b2bff700 1 -- 172.21.15.151:0/2207305485 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac1a4e50 con 0x7f58ac072850 2023-07-21T22:40:25.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.683+0000 7f58a9ffb700 1 -- 172.21.15.151:0/2207305485 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f58a000cd40 con 0x7f58ac072850 2023-07-21T22:40:25.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.684+0000 7f58c643ab80 1 Processor -- start 2023-07-21T22:40:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.684+0000 7f58c643ab80 1 -- start start 2023-07-21T22:40:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.684+0000 7f58a9ffb700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f589c0a12c0 0x7f589c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.684+0000 7f58a9ffb700 1 -- 172.21.15.151:0/2207305485 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f58a0014070 con 0x7f58ac072850 2023-07-21T22:40:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb353cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b119c700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f589c0a12c0 0x7f589c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 0x55dafb34df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 0x55dafb34e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58c643ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb253c50 con 0x55dafb354210 2023-07-21T22:40:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58c643ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb2a69e0 con 0x55dafb354660 2023-07-21T22:40:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58c643ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb29fe70 con 0x55dafb1aa6b0 2023-07-21T22:40:25.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b099b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb353cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b099b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb353cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48534/0 (socket says 172.21.15.151:48534) 2023-07-21T22:40:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b099b700 1 -- 172.21.15.151:0/107015135 learned_addr learned my addr 172.21.15.151:0/107015135 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b119c700 1 --2- 172.21.15.151:0/107015135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 0x55dafb34e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58abfff700 1 --2- 172.21.15.151:0/107015135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 0x55dafb34df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b099b700 1 -- 172.21.15.151:0/107015135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 msgr2=0x55dafb34e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b099b700 1 --2- 172.21.15.151:0/107015135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 0x55dafb34e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b099b700 1 -- 172.21.15.151:0/107015135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 msgr2=0x55dafb34df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b099b700 1 --2- 172.21.15.151:0/107015135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 0x55dafb34df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b099b700 1 -- 172.21.15.151:0/107015135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dafb0cdd80 con 0x55dafb1aa6b0 2023-07-21T22:40:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.685+0000 7f58b119c700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f589c0a12c0 0x7f589c0a3770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f58ac069b00 tx=0x7f58a40099e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.686+0000 7f58b099b700 1 --2- 172.21.15.151:0/107015135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb353cd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f58a00a1fb0 tx=0x7f58a0099f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0ddb2edf2a7f359 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.686+0000 7f5896ffd700 1 -- 172.21.15.151:0/107015135 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a00a24e0 con 0x55dafb1aa6b0 2023-07-21T22:40:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.686+0000 7f5896ffd700 1 -- 172.21.15.151:0/107015135 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a009a2f0 con 0x55dafb1aa6b0 2023-07-21T22:40:25.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.686+0000 7f5896ffd700 1 -- 172.21.15.151:0/107015135 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a00a2270 con 0x55dafb1aa6b0 2023-07-21T22:40:25.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.687+0000 7f58c643ab80 1 -- 172.21.15.151:0/107015135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 msgr2=0x55dafb353cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.687+0000 7f58c643ab80 1 --2- 172.21.15.151:0/107015135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb353cd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f58a00a1fb0 tx=0x7f58a0099f70 comp rx=0 tx=0).stop 2023-07-21T22:40:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.687+0000 7f58c643ab80 1 -- 172.21.15.151:0/107015135 shutdown_connections 2023-07-21T22:40:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.687+0000 7f58c643ab80 1 --2- 172.21.15.151:0/107015135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 0x55dafb34e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.687+0000 7f58c643ab80 1 --2- 172.21.15.151:0/107015135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb353cd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.687+0000 7f58c643ab80 1 --2- 172.21.15.151:0/107015135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 0x55dafb34df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.687+0000 7f58c643ab80 1 -- 172.21.15.151:0/107015135 >> 172.21.15.151:0/107015135 conn(0x55dafb343ae0 msgr2=0x55dafb3490e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:25.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.687+0000 7f58c643ab80 1 -- 172.21.15.151:0/107015135 shutdown_connections 2023-07-21T22:40:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.687+0000 7f58c643ab80 1 -- 172.21.15.151:0/107015135 wait complete. 2023-07-21T22:40:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.688+0000 7f58c643ab80 1 -- start start 2023-07-21T22:40:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.688+0000 7f58c643ab80 1 Processor -- start 2023-07-21T22:40:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb1aa6b0 0x55dafb3578d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb354210 0x55dafb357e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 0x55dafb358350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58c643ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb23fa60 con 0x55dafb1aa6b0 2023-07-21T22:40:25.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58c643ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb23f760 con 0x55dafb354660 2023-07-21T22:40:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58c643ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb1238c0 con 0x55dafb354210 2023-07-21T22:40:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58c643ab80 10 client.0 _ll_register_callbacks cb 0x55dafb23d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:40:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58abfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb354210 0x55dafb357e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58abfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb354210 0x55dafb357e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48550/0 (socket says 172.21.15.151:48550) 2023-07-21T22:40:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58abfff700 1 -- 172.21.15.151:0/2255307379 learned_addr learned my addr 172.21.15.151:0/2255307379 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58b099b700 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb1aa6b0 0x55dafb3578d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.689+0000 7f58b119c700 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 0x55dafb358350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.690+0000 7f58abfff700 1 -- 172.21.15.151:0/2255307379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 msgr2=0x55dafb358350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.690+0000 7f58abfff700 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 0x55dafb358350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.690+0000 7f58abfff700 1 -- 172.21.15.151:0/2255307379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb1aa6b0 msgr2=0x55dafb3578d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.690+0000 7f58abfff700 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb1aa6b0 0x55dafb3578d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.690+0000 7f58abfff700 1 -- 172.21.15.151:0/2255307379 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58ac1a4e50 con 0x55dafb354210 2023-07-21T22:40:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.690+0000 7f58abfff700 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb354210 0x55dafb357e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f58980098f0 tx=0x7f589800f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f505141e6cd0752 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.690+0000 7f588bfff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:40:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.690+0000 7f588bfff700 1 -- 172.21.15.151:0/2255307379 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589801c040 con 0x55dafb354210 2023-07-21T22:40:25.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f58c643ab80 1 -- 172.21.15.151:0/2255307379 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dafb1f9490 con 0x55dafb354210 2023-07-21T22:40:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f588bfff700 1 -- 172.21.15.151:0/2255307379 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f589800b970 con 0x55dafb354210 2023-07-21T22:40:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f588bfff700 1 -- 172.21.15.151:0/2255307379 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f589800bec0 con 0x55dafb354210 2023-07-21T22:40:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f58c643ab80 10 client.27718 fetch_fsmap learned FSMap version 76 2023-07-21T22:40:25.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f58c643ab80 1 -- 172.21.15.151:0/2255307379 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x55dafb0b6c00 con 0x55dafb354210 2023-07-21T22:40:25.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f588bfff700 1 -- 172.21.15.151:0/2255307379 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dafb1f9490 con 0x55dafb354210 2023-07-21T22:40:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f588bfff700 1 -- 172.21.15.151:0/2255307379 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 76) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f589801f030 con 0x55dafb354210 2023-07-21T22:40:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f58c643ab80 10 client.27718 fetch_fsmap finished waiting for FSMap version 76 2023-07-21T22:40:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f58c643ab80 10 client.27718 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:40:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f58c643ab80 20 client.27718 populate_metadata read hostname 'smithi151' 2023-07-21T22:40:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dafb367c50 0x55dafb36a060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f58c643ab80 4 client.27718 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:40:25.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.691+0000 7f58c643ab80 1 -- 172.21.15.151:0/2255307379 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dafb298e50 con 0x55dafb367c50 2023-07-21T22:40:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.692+0000 7f58b099b700 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dafb367c50 0x55dafb36a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.692+0000 7f58b099b700 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dafb367c50 0x55dafb36a060 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f6779022ed556211 server_cookie=856ce0a4486f2fcf in_seq=0 out_seq=0 2023-07-21T22:40:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.692+0000 7f588bfff700 10 client.27718 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f588bfff700 1 -- 172.21.15.151:0/2255307379 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dafb298e50 con 0x55dafb367c50 2023-07-21T22:40:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f588bfff700 10 client.27718 handle_command_reply: tid=0 2023-07-21T22:40:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 client.27718 shutdown 2023-07-21T22:40:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 -- 172.21.15.151:0/2255307379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb354210 msgr2=0x55dafb357e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:25.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb354210 0x55dafb357e10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f58980098f0 tx=0x7f589800f710 comp rx=0 tx=0).stop 2023-07-21T22:40:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 -- 172.21.15.151:0/2255307379 shutdown_connections 2023-07-21T22:40:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dafb367c50 0x55dafb36a060 crc :-1 s=READY pgs=286 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354660 0x55dafb358350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb1aa6b0 0x55dafb3578d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f588bfff700 0 client.27718 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2255307379 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb354210 0x55dafb357e10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 -- 172.21.15.151:0/2255307379 >> 172.21.15.151:0/2255307379 conn(0x55dafb343ae0 msgr2=0x55dafb3483e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 -- 172.21.15.151:0/2255307379 shutdown_connections 2023-07-21T22:40:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.693+0000 7f58c643ab80 1 -- 172.21.15.151:0/2255307379 wait complete. 2023-07-21T22:40:25.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.694+0000 7f58c643ab80 20 client.27718 trim_cache size 0 max 16384 2023-07-21T22:40:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58c643ab80 1 Processor -- start 2023-07-21T22:40:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58c643ab80 1 -- start start 2023-07-21T22:40:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb343ae0 0x55dafb353260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb358180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354210 0x55dafb34d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58c643ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb353920 con 0x55dafb343ae0 2023-07-21T22:40:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58c643ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb3454f0 con 0x55dafb354210 2023-07-21T22:40:25.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58c643ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb3525c0 con 0x55dafb1aa6b0 2023-07-21T22:40:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58b099b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb343ae0 0x55dafb353260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.710+0000 7f58abfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb358180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58b119c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354210 0x55dafb34d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58abfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb358180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48558/0 (socket says 172.21.15.151:48558) 2023-07-21T22:40:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58b099b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb343ae0 0x55dafb353260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41742/0 (socket says 172.21.15.151:41742) 2023-07-21T22:40:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58abfff700 1 -- 172.21.15.151:0/958792128 learned_addr learned my addr 172.21.15.151:0/958792128 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58b119c700 1 -- 172.21.15.151:0/958792128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 msgr2=0x55dafb358180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58b119c700 1 --2- 172.21.15.151:0/958792128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb358180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58b119c700 1 -- 172.21.15.151:0/958792128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb343ae0 msgr2=0x55dafb353260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58b119c700 1 --2- 172.21.15.151:0/958792128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb343ae0 0x55dafb353260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58b119c700 1 -- 172.21.15.151:0/958792128 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dafb36ec50 con 0x55dafb354210 2023-07-21T22:40:25.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58abfff700 1 --2- 172.21.15.151:0/958792128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb358180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:40:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.711+0000 7f58b119c700 1 --2- 172.21.15.151:0/958792128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354210 0x55dafb34d640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f58a401b000 tx=0x7f58a401c000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1390b910368945fe server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58977fe700 1 -- 172.21.15.151:0/958792128 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a400e040 con 0x55dafb354210 2023-07-21T22:40:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58977fe700 1 -- 172.21.15.151:0/958792128 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a400f040 con 0x55dafb354210 2023-07-21T22:40:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58977fe700 1 -- 172.21.15.151:0/958792128 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4022830 con 0x55dafb354210 2023-07-21T22:40:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58c643ab80 1 -- 172.21.15.151:0/958792128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354210 msgr2=0x55dafb34d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58c643ab80 1 --2- 172.21.15.151:0/958792128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354210 0x55dafb34d640 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f58a401b000 tx=0x7f58a401c000 comp rx=0 tx=0).stop 2023-07-21T22:40:25.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58c643ab80 1 -- 172.21.15.151:0/958792128 shutdown_connections 2023-07-21T22:40:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58c643ab80 1 --2- 172.21.15.151:0/958792128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb354210 0x55dafb34d640 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58c643ab80 1 --2- 172.21.15.151:0/958792128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb343ae0 0x55dafb353260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58c643ab80 1 --2- 172.21.15.151:0/958792128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb1aa6b0 0x55dafb358180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.712+0000 7f58c643ab80 1 -- 172.21.15.151:0/958792128 >> 172.21.15.151:0/958792128 conn(0x55dafb3634b0 msgr2=0x55dafb34cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.713+0000 7f58c643ab80 1 -- 172.21.15.151:0/958792128 shutdown_connections 2023-07-21T22:40:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.713+0000 7f58c643ab80 1 -- 172.21.15.151:0/958792128 wait complete. 2023-07-21T22:40:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.713+0000 7f58c643ab80 1 -- start start 2023-07-21T22:40:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.713+0000 7f58c643ab80 1 Processor -- start 2023-07-21T22:40:25.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb1aa6b0 0x55dafb35e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb343ae0 0x55dafb35cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58c643ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 0x55dafb35d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58c643ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb35d920 con 0x55dafb354210 2023-07-21T22:40:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58c643ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb35da60 con 0x55dafb1aa6b0 2023-07-21T22:40:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58c643ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dafb35dc20 con 0x55dafb343ae0 2023-07-21T22:40:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58c643ab80 10 client.0 _ll_register_callbacks cb 0x7f58a0005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:40:25.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58abfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb343ae0 0x55dafb35cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58b099b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb1aa6b0 0x55dafb35e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58b119c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 0x55dafb35d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58abfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb343ae0 0x55dafb35cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48568/0 (socket says 172.21.15.151:48568) 2023-07-21T22:40:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58abfff700 1 -- 172.21.15.151:0/2217504148 learned_addr learned my addr 172.21.15.151:0/2217504148 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58abfff700 1 -- 172.21.15.151:0/2217504148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb1aa6b0 msgr2=0x55dafb35e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58abfff700 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb1aa6b0 0x55dafb35e950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58abfff700 1 -- 172.21.15.151:0/2217504148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 msgr2=0x55dafb35d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:25.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58abfff700 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 0x55dafb35d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58abfff700 1 -- 172.21.15.151:0/2217504148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dafb0b6c00 con 0x55dafb343ae0 2023-07-21T22:40:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.714+0000 7f58b099b700 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb1aa6b0 0x55dafb35e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:40:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.715+0000 7f58abfff700 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb343ae0 0x55dafb35cdc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5898005850 tx=0x7f589800ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd96b371eb66049d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.715+0000 7f588bfff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:40:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.715+0000 7f588bfff700 1 -- 172.21.15.151:0/2217504148 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f589802bbb0 con 0x55dafb343ae0 2023-07-21T22:40:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.715+0000 7f588bfff700 1 -- 172.21.15.151:0/2217504148 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f58980058e0 con 0x55dafb343ae0 2023-07-21T22:40:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.715+0000 7f58c643ab80 1 -- 172.21.15.151:0/2217504148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58a009a2f0 con 0x55dafb343ae0 2023-07-21T22:40:25.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.715+0000 7f588bfff700 1 -- 172.21.15.151:0/2217504148 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) v2 ==== 24+0+0 (secure 0 0 0) 0x7f589800bec0 con 0x55dafb343ae0 2023-07-21T22:40:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.715+0000 7f58c643ab80 10 client.27724 fetch_fsmap learned FSMap version 76 2023-07-21T22:40:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.715+0000 7f58c643ab80 1 -- 172.21.15.151:0/2217504148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=4+}) v3 -- 0x7f58a4019460 con 0x55dafb343ae0 2023-07-21T22:40:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.716+0000 7f588bfff700 1 -- 172.21.15.151:0/2217504148 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a009a2f0 con 0x55dafb343ae0 2023-07-21T22:40:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.716+0000 7f588bfff700 1 -- 172.21.15.151:0/2217504148 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 76) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f589801f050 con 0x55dafb343ae0 2023-07-21T22:40:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.716+0000 7f58c643ab80 10 client.27724 fetch_fsmap finished waiting for FSMap version 76 2023-07-21T22:40:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.716+0000 7f58c643ab80 10 client.27724 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:40:25.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.716+0000 7f58c643ab80 20 client.27724 populate_metadata read hostname 'smithi151' 2023-07-21T22:40:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.716+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dafb354660 0x55dafb3bed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.716+0000 7f58c643ab80 4 client.27724 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:40:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.716+0000 7f58c643ab80 1 -- 172.21.15.151:0/2217504148 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dafb25aff0 con 0x55dafb354660 2023-07-21T22:40:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.716+0000 7f58b099b700 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dafb354660 0x55dafb3bed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.717+0000 7f588bfff700 10 client.27724 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:25.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.717+0000 7f58b099b700 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dafb354660 0x55dafb3bed70 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5715eb98e3e6c527 server_cookie=8cc8964ad6e62ea2 in_seq=0 out_seq=0 2023-07-21T22:40:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.725+0000 7f588bfff700 1 -- 172.21.15.151:0/2217504148 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dafb25aff0 con 0x55dafb354660 2023-07-21T22:40:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.725+0000 7f588bfff700 10 client.27724 handle_command_reply: tid=0 2023-07-21T22:40:25.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.725+0000 7f58c643ab80 1 client.27724 shutdown 2023-07-21T22:40:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 -- 172.21.15.151:0/2217504148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb343ae0 msgr2=0x55dafb35cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb343ae0 0x55dafb35cdc0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5898005850 tx=0x7f589800ba20 comp rx=0 tx=0).stop 2023-07-21T22:40:25.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 -- 172.21.15.151:0/2217504148 shutdown_connections 2023-07-21T22:40:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dafb354660 0x55dafb3bed70 crc :-1 s=READY pgs=287 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dafb1aa6b0 0x55dafb35e950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dafb354210 0x55dafb35d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 --2- 172.21.15.151:0/2217504148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dafb343ae0 0x55dafb35cdc0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f588bfff700 0 client.27724 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 -- 172.21.15.151:0/2217504148 >> 172.21.15.151:0/2217504148 conn(0x55dafb3634b0 msgr2=0x55dafb3566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 -- 172.21.15.151:0/2217504148 shutdown_connections 2023-07-21T22:40:25.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 1 -- 172.21.15.151:0/2217504148 wait complete. 2023-07-21T22:40:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.726+0000 7f58c643ab80 20 client.27724 trim_cache size 0 max 16384 2023-07-21T22:40:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:40:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:40:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:40:25.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:40:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 -- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f589c0a12c0 msgr2=0x7f589c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f589c0a12c0 0x7f589c0a3770 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f58ac069b00 tx=0x7f58a40099e0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 -- 172.21.15.151:0/2207305485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58ac072850 msgr2=0x7f58ac197e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:25.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58ac072850 0x7f58ac197e10 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f58a000e9a0 tx=0x7f58a000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 -- 172.21.15.151:0/2207305485 shutdown_connections 2023-07-21T22:40:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f589c0a12c0 0x7f589c0a3770 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58ac072850 0x7f58ac197e10 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58ac10c410 0x7f58ac19c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 --2- 172.21.15.151:0/2207305485 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58ac073160 0x7f58ac198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 -- 172.21.15.151:0/2207305485 >> 172.21.15.151:0/2207305485 conn(0x7f58ac0fb6f0 msgr2=0x7f58ac0fd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 -- 172.21.15.151:0/2207305485 shutdown_connections 2023-07-21T22:40:25.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:25.727+0000 7f58b2bff700 1 -- 172.21.15.151:0/2207305485 wait complete. 2023-07-21T22:40:26.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:26 smithi187 ceph-mon[96918]: pgmap v670: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:40:26.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:26 smithi195 ceph-mon[97365]: pgmap v670: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:40:26.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:26 smithi151 ceph-mon[95510]: pgmap v670: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.9 MiB/s wr, 372 op/s 2023-07-21T22:40:28.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:28 smithi187 ceph-mon[96918]: pgmap v671: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.0 MiB/s wr, 520 op/s 2023-07-21T22:40:28.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:28 smithi195 ceph-mon[97365]: pgmap v671: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.0 MiB/s wr, 520 op/s 2023-07-21T22:40:28.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:28 smithi151 ceph-mon[95510]: pgmap v671: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.0 MiB/s wr, 520 op/s 2023-07-21T22:40:30.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:30 smithi195 ceph-mon[97365]: pgmap v672: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:40:30.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:30 smithi151 ceph-mon[95510]: pgmap v672: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:40:31.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:30 smithi187 ceph-mon[96918]: pgmap v672: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:40:32.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:32 smithi195 ceph-mon[97365]: pgmap v673: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:40:32.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:32 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:32.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:32 smithi151 ceph-mon[95510]: pgmap v673: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:40:32.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:32 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:33.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:32 smithi187 ceph-mon[96918]: pgmap v673: 97 pgs: 97 active+clean; 9.2 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:40:33.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:32 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:34.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:34 smithi195 ceph-mon[97365]: pgmap v674: 97 pgs: 97 active+clean; 9.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-07-21T22:40:34.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:34 smithi151 ceph-mon[95510]: pgmap v674: 97 pgs: 97 active+clean; 9.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-07-21T22:40:35.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:34 smithi187 ceph-mon[96918]: pgmap v674: 97 pgs: 97 active+clean; 9.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-07-21T22:40:36.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:36 smithi195 ceph-mon[97365]: pgmap v675: 97 pgs: 97 active+clean; 9.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-07-21T22:40:36.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:36 smithi151 ceph-mon[95510]: pgmap v675: 97 pgs: 97 active+clean; 9.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-07-21T22:40:37.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:36 smithi187 ceph-mon[96918]: pgmap v675: 97 pgs: 97 active+clean; 9.2 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 2.4 MiB/s wr, 312 op/s 2023-07-21T22:40:37.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:37 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:37.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:37 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:38.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:37 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:38.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:38 smithi195 ceph-mon[97365]: pgmap v676: 97 pgs: 97 active+clean; 9.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-07-21T22:40:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.902+0000 7f711bdff700 1 -- 172.21.15.151:0/833591444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 msgr2=0x7f7114072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.902+0000 7f711bdff700 1 --2- 172.21.15.151:0/833591444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 0x7f7114072c80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f7110009990 tx=0x7f7110009ca0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.902+0000 7f711bdff700 1 -- 172.21.15.151:0/833591444 shutdown_connections 2023-07-21T22:40:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.902+0000 7f711bdff700 1 --2- 172.21.15.151:0/833591444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f711410c340 0x7f711410e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.902+0000 7f711bdff700 1 --2- 172.21.15.151:0/833591444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 0x7f7114072c80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.902+0000 7f711bdff700 1 --2- 172.21.15.151:0/833591444 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71140731c0 0x7f711410be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.902+0000 7f711bdff700 1 -- 172.21.15.151:0/833591444 >> 172.21.15.151:0/833591444 conn(0x7f71140fb600 msgr2=0x7f71140fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.902+0000 7f711bdff700 1 -- 172.21.15.151:0/833591444 shutdown_connections 2023-07-21T22:40:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.902+0000 7f711bdff700 1 -- 172.21.15.151:0/833591444 wait complete. 2023-07-21T22:40:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.903+0000 7f711bdff700 1 Processor -- start 2023-07-21T22:40:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.903+0000 7f711bdff700 1 -- start start 2023-07-21T22:40:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f711bdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 0x7f7114197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f711bdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71140731c0 0x7f71141982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f711bdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711410c340 0x7f711419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f711bdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711419cf70 con 0x7f71140728b0 2023-07-21T22:40:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f711bdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711419d0e0 con 0x7f71140731c0 2023-07-21T22:40:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f711bdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711419d2a0 con 0x7f711410c340 2023-07-21T22:40:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 0x7f7114197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 0x7f7114197d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43318/0 (socket says 172.21.15.151:43318) 2023-07-21T22:40:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f7119b9b700 1 -- 172.21.15.151:0/2863467033 learned_addr learned my addr 172.21.15.151:0/2863467033 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f711a39c700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711410c340 0x7f711419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.904+0000 7f711939a700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71140731c0 0x7f71141982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f7119b9b700 1 -- 172.21.15.151:0/2863467033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711410c340 msgr2=0x7f711419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f7119b9b700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711410c340 0x7f711419c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f7119b9b700 1 -- 172.21.15.151:0/2863467033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71140731c0 msgr2=0x7f71141982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f7119b9b700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71140731c0 0x7f71141982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f7119b9b700 1 -- 172.21.15.151:0/2863467033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71100095f0 con 0x7f71140728b0 2023-07-21T22:40:38.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f711939a700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71140731c0 0x7f71141982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:40:38.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f711a39c700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711410c340 0x7f711419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:40:38.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f7119b9b700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 0x7f7114197d80 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7110005740 tx=0x7f7110005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:38.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f710affd700 1 -- 172.21.15.151:0/2863467033 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711001d070 con 0x7f71140728b0 2023-07-21T22:40:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f711bdff700 1 -- 172.21.15.151:0/2863467033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f711419d520 con 0x7f71140728b0 2023-07-21T22:40:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f710affd700 1 -- 172.21.15.151:0/2863467033 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7110022470 con 0x7f71140728b0 2023-07-21T22:40:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f710affd700 1 -- 172.21.15.151:0/2863467033 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110017650 con 0x7f71140728b0 2023-07-21T22:40:38.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.905+0000 7f711bdff700 1 -- 172.21.15.151:0/2863467033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71141a4dc0 con 0x7f71140728b0 2023-07-21T22:40:38.950 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:38 smithi151 ceph-mon[95510]: pgmap v676: 97 pgs: 97 active+clean; 9.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-07-21T22:40:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.910+0000 7f710affd700 1 -- 172.21.15.151:0/2863467033 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f711000fb00 con 0x7f71140728b0 2023-07-21T22:40:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.911+0000 7f712f731b80 1 Processor -- start 2023-07-21T22:40:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.911+0000 7f712f731b80 1 -- start start 2023-07-21T22:40:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.911+0000 7f712f731b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a07425a6b0 0x55a074403cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.911+0000 7f712f731b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404210 0x55a0743fdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.911+0000 7f712f731b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a074404660 0x55a0743fe4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.911+0000 7f712f731b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a074303c50 con 0x55a074404210 2023-07-21T22:40:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.911+0000 7f712f731b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0743569e0 con 0x55a07425a6b0 2023-07-21T22:40:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.911+0000 7f712f731b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a07434fe70 con 0x55a074404660 2023-07-21T22:40:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404210 0x55a0743fdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f711939a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a074404660 0x55a0743fe4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404210 0x55a0743fdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43334/0 (socket says 172.21.15.151:43334) 2023-07-21T22:40:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f7119b9b700 1 -- 172.21.15.151:0/3247503112 learned_addr learned my addr 172.21.15.151:0/3247503112 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f711a39c700 1 --2- 172.21.15.151:0/3247503112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a07425a6b0 0x55a074403cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f710affd700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71000a12c0 0x7f71000a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f7119b9b700 1 -- 172.21.15.151:0/3247503112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a074404660 msgr2=0x55a0743fe4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f7119b9b700 1 --2- 172.21.15.151:0/3247503112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a074404660 0x55a0743fe4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f7119b9b700 1 -- 172.21.15.151:0/3247503112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a07425a6b0 msgr2=0x55a074403cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f7119b9b700 1 --2- 172.21.15.151:0/3247503112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a07425a6b0 0x55a074403cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.912+0000 7f7119b9b700 1 -- 172.21.15.151:0/3247503112 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a07417dd80 con 0x55a074404210 2023-07-21T22:40:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.913+0000 7f711939a700 1 --2- 172.21.15.151:0/3247503112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a074404660 0x55a0743fe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:40:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.913+0000 7f710affd700 1 -- 172.21.15.151:0/2863467033 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f71100ce220 con 0x7f71140728b0 2023-07-21T22:40:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.913+0000 7f711a39c700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71000a12c0 0x7f71000a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.913+0000 7f7119b9b700 1 --2- 172.21.15.151:0/3247503112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404210 0x55a0743fdf40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f71100cb900 tx=0x7f711002e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbbc6d6a50a4def server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.913+0000 7f70fffff700 1 -- 172.21.15.151:0/3247503112 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711009b170 con 0x55a074404210 2023-07-21T22:40:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.913+0000 7f70fffff700 1 -- 172.21.15.151:0/3247503112 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f711009aee0 con 0x55a074404210 2023-07-21T22:40:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.913+0000 7f70fffff700 1 -- 172.21.15.151:0/3247503112 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711009ad00 con 0x55a074404210 2023-07-21T22:40:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f712f731b80 1 -- 172.21.15.151:0/3247503112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404210 msgr2=0x55a0743fdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f711a39c700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71000a12c0 0x7f71000a3770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f710c009110 tx=0x7f710c004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f712f731b80 1 --2- 172.21.15.151:0/3247503112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404210 0x55a0743fdf40 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f71100cb900 tx=0x7f711002e000 comp rx=0 tx=0).stop 2023-07-21T22:40:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f712f731b80 1 -- 172.21.15.151:0/3247503112 shutdown_connections 2023-07-21T22:40:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f712f731b80 1 --2- 172.21.15.151:0/3247503112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a07425a6b0 0x55a074403cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f712f731b80 1 --2- 172.21.15.151:0/3247503112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a074404660 0x55a0743fe4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f712f731b80 1 --2- 172.21.15.151:0/3247503112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404210 0x55a0743fdf40 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f712f731b80 1 -- 172.21.15.151:0/3247503112 >> 172.21.15.151:0/3247503112 conn(0x55a0743f3ae0 msgr2=0x55a0743f90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f712f731b80 1 -- 172.21.15.151:0/3247503112 shutdown_connections 2023-07-21T22:40:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.914+0000 7f712f731b80 1 -- 172.21.15.151:0/3247503112 wait complete. 2023-07-21T22:40:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.915+0000 7f712f731b80 1 -- start start 2023-07-21T22:40:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.915+0000 7f712f731b80 1 Processor -- start 2023-07-21T22:40:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f712f731b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744159a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f712f731b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074415ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f712f731b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a07440fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f712f731b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0742efa60 con 0x55a074404660 2023-07-21T22:40:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f712f731b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0742ef760 con 0x55a074404210 2023-07-21T22:40:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f712f731b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0741d38c0 con 0x55a07425a6b0 2023-07-21T22:40:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f712f731b80 10 client.0 _ll_register_callbacks cb 0x55a0742ed700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:40:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744159a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f711a39c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a07440fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744159a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46240/0 (socket says 172.21.15.151:46240) 2023-07-21T22:40:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f7119b9b700 1 -- 172.21.15.151:0/1304000955 learned_addr learned my addr 172.21.15.151:0/1304000955 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f711939a700 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074415ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f7119b9b700 1 -- 172.21.15.151:0/1304000955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 msgr2=0x55a074415ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f7119b9b700 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074415ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f7119b9b700 1 -- 172.21.15.151:0/1304000955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 msgr2=0x55a07440fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f7119b9b700 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a07440fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f7119b9b700 1 -- 172.21.15.151:0/1304000955 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71040098f0 con 0x55a07425a6b0 2023-07-21T22:40:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.916+0000 7f711939a700 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074415ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:40:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.917+0000 7f7119b9b700 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744159a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7110009ce0 tx=0x7f7110022b20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d54aa5a75a5c0431 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.917+0000 7f70fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:40:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.917+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1304000955 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711007a160 con 0x55a07425a6b0 2023-07-21T22:40:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.917+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1304000955 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f711009b3a0 con 0x55a07425a6b0 2023-07-21T22:40:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.917+0000 7f712f731b80 1 -- 172.21.15.151:0/1304000955 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a0742a9490 con 0x55a07425a6b0 2023-07-21T22:40:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.917+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1304000955 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f711009b170 con 0x55a07425a6b0 2023-07-21T22:40:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.917+0000 7f712f731b80 10 client.27736 fetch_fsmap learned FSMap version 78 2023-07-21T22:40:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.917+0000 7f712f731b80 1 -- 172.21.15.151:0/1304000955 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x7f71141a4dc0 con 0x55a07425a6b0 2023-07-21T22:40:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.917+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1304000955 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a0742a9490 con 0x55a07425a6b0 2023-07-21T22:40:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.918+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1304000955 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 78) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f7110097210 con 0x55a07425a6b0 2023-07-21T22:40:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.918+0000 7f712f731b80 10 client.27736 fetch_fsmap finished waiting for FSMap version 78 2023-07-21T22:40:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.918+0000 7f712f731b80 10 client.27736 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:40:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.918+0000 7f712f731b80 20 client.27736 populate_metadata read hostname 'smithi151' 2023-07-21T22:40:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.918+0000 7f712f731b80 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a07441fa60 0x55a074421e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.918+0000 7f712f731b80 4 client.27736 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:40:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.918+0000 7f712f731b80 1 -- 172.21.15.151:0/1304000955 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a074348e50 con 0x55a07441fa60 2023-07-21T22:40:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.918+0000 7f711939a700 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a07441fa60 0x55a074421e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.919+0000 7f70fd7fa700 10 client.27736 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.919+0000 7f711939a700 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a07441fa60 0x55a074421e70 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=716545e41a0b9c77 server_cookie=a7821c240005476b in_seq=0 out_seq=0 2023-07-21T22:40:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.919+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1304000955 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a074348e50 con 0x55a07441fa60 2023-07-21T22:40:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.919+0000 7f70fd7fa700 10 client.27736 handle_command_reply: tid=0 2023-07-21T22:40:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.919+0000 7f712f731b80 1 client.27736 shutdown 2023-07-21T22:40:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 -- 172.21.15.151:0/1304000955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 msgr2=0x55a0744159a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744159a0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7110009ce0 tx=0x7f7110022b20 comp rx=0 tx=0).stop 2023-07-21T22:40:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 -- 172.21.15.151:0/1304000955 shutdown_connections 2023-07-21T22:40:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a07441fa60 0x55a074421e70 crc :-1 s=READY pgs=288 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a07440fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744159a0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 --2- 172.21.15.151:0/1304000955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074415ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f70fd7fa700 0 client.27736 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 -- 172.21.15.151:0/1304000955 >> 172.21.15.151:0/1304000955 conn(0x55a0743f3ae0 msgr2=0x55a0743f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 -- 172.21.15.151:0/1304000955 shutdown_connections 2023-07-21T22:40:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 1 -- 172.21.15.151:0/1304000955 wait complete. 2023-07-21T22:40:38.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.920+0000 7f712f731b80 20 client.27736 trim_cache size 0 max 16384 2023-07-21T22:40:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.940+0000 7f712f731b80 1 Processor -- start 2023-07-21T22:40:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.940+0000 7f712f731b80 1 -- start start 2023-07-21T22:40:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f712f731b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0743fdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f712f731b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a07440fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f712f731b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a0743f8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f712f731b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a074348e50 con 0x55a074404660 2023-07-21T22:40:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f712f731b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a0742a9490 con 0x55a074404210 2023-07-21T22:40:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f712f731b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a074410be0 con 0x55a07425a6b0 2023-07-21T22:40:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0743fdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f711939a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a07440fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0743fdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46252/0 (socket says 172.21.15.151:46252) 2023-07-21T22:40:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f7119b9b700 1 -- 172.21.15.151:0/406632048 learned_addr learned my addr 172.21.15.151:0/406632048 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f711939a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a07440fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39046/0 (socket says 172.21.15.151:39046) 2023-07-21T22:40:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f711a39c700 1 --2- 172.21.15.151:0/406632048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a0743f8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f7119b9b700 1 -- 172.21.15.151:0/406632048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 msgr2=0x55a07440fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f7119b9b700 1 --2- 172.21.15.151:0/406632048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a07440fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f7119b9b700 1 -- 172.21.15.151:0/406632048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 msgr2=0x55a0743f8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f7119b9b700 1 --2- 172.21.15.151:0/406632048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a0743f8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.941+0000 7f7119b9b700 1 -- 172.21.15.151:0/406632048 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a074166c00 con 0x55a07425a6b0 2023-07-21T22:40:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.942+0000 7f711a39c700 1 --2- 172.21.15.151:0/406632048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a0743f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:40:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.942+0000 7f7119b9b700 1 --2- 172.21.15.151:0/406632048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0743fdf40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f711009b330 tx=0x7f711009f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a225140d57fd2644 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.942+0000 7f7108bff700 1 -- 172.21.15.151:0/406632048 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71100226d0 con 0x55a07425a6b0 2023-07-21T22:40:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.942+0000 7f7108bff700 1 -- 172.21.15.151:0/406632048 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f711007a160 con 0x55a07425a6b0 2023-07-21T22:40:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.942+0000 7f7108bff700 1 -- 172.21.15.151:0/406632048 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711009b3a0 con 0x55a07425a6b0 2023-07-21T22:40:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.943+0000 7f712f731b80 1 -- 172.21.15.151:0/406632048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 msgr2=0x55a0743fdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.943+0000 7f712f731b80 1 --2- 172.21.15.151:0/406632048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0743fdf40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f711009b330 tx=0x7f711009f180 comp rx=0 tx=0).stop 2023-07-21T22:40:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.943+0000 7f712f731b80 1 -- 172.21.15.151:0/406632048 shutdown_connections 2023-07-21T22:40:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.943+0000 7f712f731b80 1 --2- 172.21.15.151:0/406632048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a0743f8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.943+0000 7f712f731b80 1 --2- 172.21.15.151:0/406632048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0743fdf40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.943+0000 7f712f731b80 1 --2- 172.21.15.151:0/406632048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a07440fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.943+0000 7f712f731b80 1 -- 172.21.15.151:0/406632048 >> 172.21.15.151:0/406632048 conn(0x55a0743f3ae0 msgr2=0x55a07440f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.943+0000 7f712f731b80 1 -- 172.21.15.151:0/406632048 shutdown_connections 2023-07-21T22:40:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.943+0000 7f712f731b80 1 -- 172.21.15.151:0/406632048 wait complete. 2023-07-21T22:40:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.944+0000 7f712f731b80 1 -- start start 2023-07-21T22:40:38.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.944+0000 7f712f731b80 1 Processor -- start 2023-07-21T22:40:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f712f731b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744678b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f712f731b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074467df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f712f731b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a074468330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f712f731b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a074472a70 con 0x55a074404660 2023-07-21T22:40:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f712f731b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a074472be0 con 0x55a074404210 2023-07-21T22:40:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f712f731b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a074472da0 con 0x55a07425a6b0 2023-07-21T22:40:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f712f731b80 10 client.0 _ll_register_callbacks cb 0x7f710c009f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:40:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f711a39c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a074468330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f7119b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744678b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46266/0 (socket says 172.21.15.151:46266) 2023-07-21T22:40:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f7119b9b700 1 -- 172.21.15.151:0/1907525752 learned_addr learned my addr 172.21.15.151:0/1907525752 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f711939a700 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074467df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f7119b9b700 1 -- 172.21.15.151:0/1907525752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 msgr2=0x55a074467df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f7119b9b700 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074467df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f7119b9b700 1 -- 172.21.15.151:0/1907525752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 msgr2=0x55a074468330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f7119b9b700 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a074468330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.945+0000 7f7119b9b700 1 -- 172.21.15.151:0/1907525752 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71141a4dc0 con 0x55a07425a6b0 2023-07-21T22:40:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.946+0000 7f711939a700 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074467df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:40:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.946+0000 7f7119b9b700 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744678b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7110077ee0 tx=0x7f71100a3760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5c68e52463c750f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.946+0000 7f70fd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:40:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.946+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1907525752 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711009b170 con 0x55a07425a6b0 2023-07-21T22:40:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.946+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1907525752 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f711009f3d0 con 0x55a07425a6b0 2023-07-21T22:40:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.946+0000 7f712f731b80 1 -- 172.21.15.151:0/1907525752 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f711009aee0 con 0x55a07425a6b0 2023-07-21T22:40:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.946+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1907525752 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) v2 ==== 24+0+0 (secure 0 0 0) 0x7f711009ad00 con 0x55a07425a6b0 2023-07-21T22:40:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.946+0000 7f712f731b80 10 client.27742 fetch_fsmap learned FSMap version 78 2023-07-21T22:40:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.946+0000 7f712f731b80 1 -- 172.21.15.151:0/1907525752 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) v3 -- 0x55a0741a41f0 con 0x55a07425a6b0 2023-07-21T22:40:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.947+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1907525752 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f711009aee0 con 0x55a07425a6b0 2023-07-21T22:40:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.947+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1907525752 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 78) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f7110097190 con 0x55a07425a6b0 2023-07-21T22:40:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.947+0000 7f712f731b80 10 client.27742 fetch_fsmap finished waiting for FSMap version 78 2023-07-21T22:40:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.947+0000 7f712f731b80 10 client.27742 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:40:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.947+0000 7f712f731b80 20 client.27742 populate_metadata read hostname 'smithi151' 2023-07-21T22:40:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.947+0000 7f712f731b80 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a074474000 0x55a0744763e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.947+0000 7f712f731b80 4 client.27742 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:40:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.947+0000 7f712f731b80 1 -- 172.21.15.151:0/1907525752 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a07430aff0 con 0x55a074474000 2023-07-21T22:40:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.947+0000 7f711939a700 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a074474000 0x55a0744763e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.948+0000 7f711939a700 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a074474000 0x55a0744763e0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b2997e922c3ca1b server_cookie=75eb13d9611fd7d in_seq=0 out_seq=0 2023-07-21T22:40:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.948+0000 7f70fd7fa700 10 client.27742 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.971+0000 7f70fd7fa700 1 -- 172.21.15.151:0/1907525752 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a07430aff0 con 0x55a074474000 2023-07-21T22:40:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f70fd7fa700 10 client.27742 handle_command_reply: tid=0 2023-07-21T22:40:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 client.27742 shutdown 2023-07-21T22:40:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 -- 172.21.15.151:0/1907525752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 msgr2=0x55a0744678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:39.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744678b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7110077ee0 tx=0x7f71100a3760 comp rx=0 tx=0).stop 2023-07-21T22:40:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 -- 172.21.15.151:0/1907525752 shutdown_connections 2023-07-21T22:40:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a074474000 0x55a0744763e0 crc :-1 s=READY pgs=289 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a074404660 0x55a074468330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a07425a6b0 0x55a0744678b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 --2- 172.21.15.151:0/1907525752 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a074404210 0x55a074467df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f70fd7fa700 0 client.27742 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 -- 172.21.15.151:0/1907525752 >> 172.21.15.151:0/1907525752 conn(0x55a0743f3ae0 msgr2=0x55a07440e420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:39.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 -- 172.21.15.151:0/1907525752 shutdown_connections 2023-07-21T22:40:39.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 1 -- 172.21.15.151:0/1907525752 wait complete. 2023-07-21T22:40:39.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.972+0000 7f712f731b80 20 client.27742 trim_cache size 0 max 16384 2023-07-21T22:40:39.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:40:39.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:40:39.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:40:39.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:40:39.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 -- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71000a12c0 msgr2=0x7f71000a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:39.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71000a12c0 0x7f71000a3770 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f710c009110 tx=0x7f710c004ad0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 -- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 msgr2=0x7f7114197d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:39.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 0x7f7114197d80 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f7110005740 tx=0x7f7110005770 comp rx=0 tx=0).stop 2023-07-21T22:40:39.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 -- 172.21.15.151:0/2863467033 shutdown_connections 2023-07-21T22:40:39.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71000a12c0 0x7f71000a3770 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f711410c340 0x7f711419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71140728b0 0x7f7114197d80 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 --2- 172.21.15.151:0/2863467033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71140731c0 0x7f71141982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 -- 172.21.15.151:0/2863467033 >> 172.21.15.151:0/2863467033 conn(0x7f71140fb600 msgr2=0x7f711410e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 -- 172.21.15.151:0/2863467033 shutdown_connections 2023-07-21T22:40:39.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:38.973+0000 7f711bdff700 1 -- 172.21.15.151:0/2863467033 wait complete. 2023-07-21T22:40:39.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:38 smithi187 ceph-mon[96918]: pgmap v676: 97 pgs: 97 active+clean; 9.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 3.6 MiB/s wr, 464 op/s 2023-07-21T22:40:39.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:39 smithi151 ceph-mon[95510]: pgmap v677: 97 pgs: 97 active+clean; 9.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 314 op/s 2023-07-21T22:40:40.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:39 smithi187 ceph-mon[96918]: pgmap v677: 97 pgs: 97 active+clean; 9.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 314 op/s 2023-07-21T22:40:40.154 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:39 smithi195 ceph-mon[97365]: pgmap v677: 97 pgs: 97 active+clean; 9.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 314 op/s 2023-07-21T22:40:42.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:41 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:42.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:41 smithi187 ceph-mon[96918]: pgmap v678: 97 pgs: 97 active+clean; 9.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 314 op/s 2023-07-21T22:40:42.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:41 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:42.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:41 smithi195 ceph-mon[97365]: pgmap v678: 97 pgs: 97 active+clean; 9.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 314 op/s 2023-07-21T22:40:42.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:41 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:42.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:41 smithi151 ceph-mon[95510]: pgmap v678: 97 pgs: 97 active+clean; 9.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 314 op/s 2023-07-21T22:40:44.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:44 smithi187 ceph-mon[96918]: pgmap v679: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:40:44.653 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:44 smithi195 ceph-mon[97365]: pgmap v679: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:40:44.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:44 smithi151 ceph-mon[95510]: pgmap v679: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 164 KiB/s rd, 3.6 MiB/s wr, 473 op/s 2023-07-21T22:40:46.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:46 smithi187 ceph-mon[96918]: pgmap v680: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 2.3 MiB/s wr, 311 op/s 2023-07-21T22:40:46.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:46 smithi195 ceph-mon[97365]: pgmap v680: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 2.3 MiB/s wr, 311 op/s 2023-07-21T22:40:46.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:46 smithi151 ceph-mon[95510]: pgmap v680: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 2.3 MiB/s wr, 311 op/s 2023-07-21T22:40:48.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:48 smithi187 ceph-mon[96918]: pgmap v681: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.6 MiB/s wr, 467 op/s 2023-07-21T22:40:48.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:48 smithi195 ceph-mon[97365]: pgmap v681: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.6 MiB/s wr, 467 op/s 2023-07-21T22:40:48.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:48 smithi151 ceph-mon[95510]: pgmap v681: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 3.6 MiB/s wr, 467 op/s 2023-07-21T22:40:50.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:50 smithi187 ceph-mon[96918]: pgmap v682: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 2.4 MiB/s wr, 315 op/s 2023-07-21T22:40:50.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:50 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:50.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:50 smithi195 ceph-mon[97365]: pgmap v682: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 2.4 MiB/s wr, 315 op/s 2023-07-21T22:40:50.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:50 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:50.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:50 smithi151 ceph-mon[95510]: pgmap v682: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 2.4 MiB/s wr, 315 op/s 2023-07-21T22:40:50.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:50 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.142+0000 7f99073ff700 1 -- 172.21.15.151:0/701911152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 msgr2=0x7f990010e750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:52.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.142+0000 7f99073ff700 1 --2- 172.21.15.151:0/701911152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 0x7f990010e750 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f98f800b0a0 tx=0x7f98f800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.142+0000 7f99073ff700 1 -- 172.21.15.151:0/701911152 shutdown_connections 2023-07-21T22:40:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.142+0000 7f99073ff700 1 --2- 172.21.15.151:0/701911152 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 0x7f990010e750 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.142+0000 7f99073ff700 1 --2- 172.21.15.151:0/701911152 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000728b0 0x7f9900072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.142+0000 7f99073ff700 1 --2- 172.21.15.151:0/701911152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99000731c0 0x7f990010be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.142+0000 7f99073ff700 1 -- 172.21.15.151:0/701911152 >> 172.21.15.151:0/701911152 conn(0x7f99000fb650 msgr2=0x7f99000fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.143+0000 7f99073ff700 1 -- 172.21.15.151:0/701911152 shutdown_connections 2023-07-21T22:40:52.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.143+0000 7f99073ff700 1 -- 172.21.15.151:0/701911152 wait complete. 2023-07-21T22:40:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.144+0000 7f99073ff700 1 Processor -- start 2023-07-21T22:40:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.144+0000 7f99073ff700 1 -- start start 2023-07-21T22:40:52.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.144+0000 7f99073ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99000728b0 0x7f9900197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.144+0000 7f99073ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000731c0 0x7f9900198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.144+0000 7f99073ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 0x7f990019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.144+0000 7f99073ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990019d030 con 0x7f990010c370 2023-07-21T22:40:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.144+0000 7f99073ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990019d1a0 con 0x7f99000728b0 2023-07-21T22:40:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.144+0000 7f99073ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990019d360 con 0x7f99000731c0 2023-07-21T22:40:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990599c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 0x7f990019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990519b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99000728b0 0x7f9900197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990599c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 0x7f990019c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59048/0 (socket says 172.21.15.151:59048) 2023-07-21T22:40:52.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990599c700 1 -- 172.21.15.151:0/3394682948 learned_addr learned my addr 172.21.15.151:0/3394682948 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:52.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990499a700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000731c0 0x7f9900198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990599c700 1 -- 172.21.15.151:0/3394682948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000731c0 msgr2=0x7f9900198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990599c700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000731c0 0x7f9900198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990599c700 1 -- 172.21.15.151:0/3394682948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99000728b0 msgr2=0x7f9900197e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990599c700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99000728b0 0x7f9900197e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990599c700 1 -- 172.21.15.151:0/3394682948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98f8009d00 con 0x7f990010c370 2023-07-21T22:40:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.145+0000 7f990599c700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 0x7f990019c9f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f98f800b070 tx=0x7f98f800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:52.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.146+0000 7f98f67fc700 1 -- 172.21.15.151:0/3394682948 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f800e040 con 0x7f990010c370 2023-07-21T22:40:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.146+0000 7f99073ff700 1 -- 172.21.15.151:0/3394682948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f990019d5e0 con 0x7f990010c370 2023-07-21T22:40:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.146+0000 7f98f67fc700 1 -- 172.21.15.151:0/3394682948 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98f8009480 con 0x7f990010c370 2023-07-21T22:40:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.146+0000 7f98f67fc700 1 -- 172.21.15.151:0/3394682948 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f8005040 con 0x7f990010c370 2023-07-21T22:40:52.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.146+0000 7f99073ff700 1 -- 172.21.15.151:0/3394682948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99001a4e80 con 0x7f990010c370 2023-07-21T22:40:52.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.149+0000 7f98f67fc700 1 -- 172.21.15.151:0/3394682948 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f98f801d480 con 0x7f990010c370 2023-07-21T22:40:52.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.151+0000 7f991ac98b80 1 Processor -- start 2023-07-21T22:40:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.151+0000 7f991ac98b80 1 -- start start 2023-07-21T22:40:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c35cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c2ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f991ac98b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21b35c50 con 0x558a21a8c6b0 2023-07-21T22:40:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f991ac98b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21b889e0 con 0x558a21c36660 2023-07-21T22:40:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f991ac98b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21b81e70 con 0x558a21c36210 2023-07-21T22:40:52.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f98f67fc700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98ec0a12c0 0x7f98ec0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c35cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990519b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c2ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c35cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59052/0 (socket says 172.21.15.151:59052) 2023-07-21T22:40:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990499a700 1 -- 172.21.15.151:0/1781858747 learned_addr learned my addr 172.21.15.151:0/1781858747 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f98f67fc700 1 -- 172.21.15.151:0/3394682948 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f98f80cdd10 con 0x7f990010c370 2023-07-21T22:40:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990599c700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98ec0a12c0 0x7f98ec0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990499a700 1 --2- 172.21.15.151:0/1781858747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990519b700 1 -- 172.21.15.151:0/1781858747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 msgr2=0x558a21c304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990519b700 1 --2- 172.21.15.151:0/1781858747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990519b700 1 -- 172.21.15.151:0/1781858747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 msgr2=0x558a21c35cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990519b700 1 --2- 172.21.15.151:0/1781858747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c35cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.152+0000 7f990519b700 1 -- 172.21.15.151:0/1781858747 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a219afd80 con 0x558a21c36210 2023-07-21T22:40:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.153+0000 7f990499a700 1 --2- 172.21.15.151:0/1781858747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:40:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.153+0000 7f990519b700 1 --2- 172.21.15.151:0/1781858747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c2ff40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009cb0 tx=0x7f98fc011440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4feae95d4f53a61a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.153+0000 7f990599c700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98ec0a12c0 0x7f98ec0a3770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009670 tx=0x7f98f8009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.153+0000 7f98eb7fe700 1 -- 172.21.15.151:0/1781858747 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc011d20 con 0x558a21c36210 2023-07-21T22:40:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.153+0000 7f98eb7fe700 1 -- 172.21.15.151:0/1781858747 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98fc011e80 con 0x558a21c36210 2023-07-21T22:40:52.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.153+0000 7f98eb7fe700 1 -- 172.21.15.151:0/1781858747 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc005280 con 0x558a21c36210 2023-07-21T22:40:52.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.154+0000 7f991ac98b80 1 -- 172.21.15.151:0/1781858747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 msgr2=0x558a21c2ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:52.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.154+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1781858747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c2ff40 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009cb0 tx=0x7f98fc011440 comp rx=0 tx=0).stop 2023-07-21T22:40:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.154+0000 7f991ac98b80 1 -- 172.21.15.151:0/1781858747 shutdown_connections 2023-07-21T22:40:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.154+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1781858747 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.154+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1781858747 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c35cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.154+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1781858747 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c2ff40 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.154+0000 7f991ac98b80 1 -- 172.21.15.151:0/1781858747 >> 172.21.15.151:0/1781858747 conn(0x558a21c25ae0 msgr2=0x558a21c2b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.154+0000 7f991ac98b80 1 -- 172.21.15.151:0/1781858747 shutdown_connections 2023-07-21T22:40:52.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.154+0000 7f991ac98b80 1 -- 172.21.15.151:0/1781858747 wait complete. 2023-07-21T22:40:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.155+0000 7f991ac98b80 1 -- start start 2023-07-21T22:40:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.155+0000 7f991ac98b80 1 Processor -- start 2023-07-21T22:40:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.155+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21a8c6b0 0x558a21c39900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.155+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21c36210 0x558a21c39e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.155+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c3a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.155+0000 7f991ac98b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21b21a60 con 0x558a21c36210 2023-07-21T22:40:52.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.155+0000 7f991ac98b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21b21760 con 0x558a21c36660 2023-07-21T22:40:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.155+0000 7f991ac98b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21a058c0 con 0x558a21a8c6b0 2023-07-21T22:40:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f991ac98b80 10 client.0 _ll_register_callbacks cb 0x558a21b1f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:40:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21a8c6b0 0x558a21c39900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21a8c6b0 0x558a21c39900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47116/0 (socket says 172.21.15.151:47116) 2023-07-21T22:40:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990499a700 1 -- 172.21.15.151:0/1654049889 learned_addr learned my addr 172.21.15.151:0/1654049889 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990519b700 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21c36210 0x558a21c39e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990499a700 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c3a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990499a700 1 -- 172.21.15.151:0/1654049889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 msgr2=0x558a21c3a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990499a700 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c3a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990499a700 1 -- 172.21.15.151:0/1654049889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21c36210 msgr2=0x558a21c39e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990499a700 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21c36210 0x558a21c39e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990499a700 1 -- 172.21.15.151:0/1654049889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc0098e0 con 0x558a21a8c6b0 2023-07-21T22:40:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.156+0000 7f990519b700 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21c36210 0x558a21c39e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:40:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.157+0000 7f990499a700 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21a8c6b0 0x558a21c39900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f98f0013f00 tx=0x7f98f0009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5d3f3d1250bc8d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.157+0000 7f98e8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:40:52.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.157+0000 7f98e8ff9700 1 -- 172.21.15.151:0/1654049889 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0018030 con 0x558a21a8c6b0 2023-07-21T22:40:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.157+0000 7f98e8ff9700 1 -- 172.21.15.151:0/1654049889 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f98f0019070 con 0x558a21a8c6b0 2023-07-21T22:40:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.157+0000 7f991ac98b80 1 -- 172.21.15.151:0/1654049889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a21b7ae50 con 0x558a21a8c6b0 2023-07-21T22:40:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.157+0000 7f98e8ff9700 1 -- 172.21.15.151:0/1654049889 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98f00131b0 con 0x558a21a8c6b0 2023-07-21T22:40:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.157+0000 7f991ac98b80 10 client.27754 fetch_fsmap learned FSMap version 80 2023-07-21T22:40:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.157+0000 7f991ac98b80 1 -- 172.21.15.151:0/1654049889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x558a21998c00 con 0x558a21a8c6b0 2023-07-21T22:40:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.158+0000 7f98e8ff9700 1 -- 172.21.15.151:0/1654049889 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a21b7ae50 con 0x558a21a8c6b0 2023-07-21T22:40:52.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.158+0000 7f98e8ff9700 1 -- 172.21.15.151:0/1654049889 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 80) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f98f00037a0 con 0x558a21a8c6b0 2023-07-21T22:40:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.158+0000 7f991ac98b80 10 client.27754 fetch_fsmap finished waiting for FSMap version 80 2023-07-21T22:40:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.158+0000 7f991ac98b80 10 client.27754 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:40:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.158+0000 7f991ac98b80 20 client.27754 populate_metadata read hostname 'smithi151' 2023-07-21T22:40:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.158+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a21c49b20 0x558a21c4bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.158+0000 7f991ac98b80 4 client.27754 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:40:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.158+0000 7f991ac98b80 1 -- 172.21.15.151:0/1654049889 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558a21b3cff0 con 0x558a21c49b20 2023-07-21T22:40:52.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.158+0000 7f990519b700 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a21c49b20 0x558a21c4bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.159+0000 7f98e8ff9700 10 client.27754 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:52.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.159+0000 7f990519b700 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a21c49b20 0x558a21c4bf30 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1af63d8f4cae974a server_cookie=d73d7dcaaf28aaf4 in_seq=0 out_seq=0 2023-07-21T22:40:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f98e8ff9700 1 -- 172.21.15.151:0/1654049889 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558a21b3cff0 con 0x558a21c49b20 2023-07-21T22:40:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f98e8ff9700 10 client.27754 handle_command_reply: tid=0 2023-07-21T22:40:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 client.27754 shutdown 2023-07-21T22:40:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 -- 172.21.15.151:0/1654049889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21a8c6b0 msgr2=0x558a21c39900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21a8c6b0 0x558a21c39900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f98f0013f00 tx=0x7f98f0009260 comp rx=0 tx=0).stop 2023-07-21T22:40:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 -- 172.21.15.151:0/1654049889 shutdown_connections 2023-07-21T22:40:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a21c49b20 0x558a21c4bf30 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c3a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21a8c6b0 0x558a21c39900 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f98e8ff9700 0 client.27754 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 --2- 172.21.15.151:0/1654049889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21c36210 0x558a21c39e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 -- 172.21.15.151:0/1654049889 >> 172.21.15.151:0/1654049889 conn(0x558a21c25ae0 msgr2=0x558a21c2a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 -- 172.21.15.151:0/1654049889 shutdown_connections 2023-07-21T22:40:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.160+0000 7f991ac98b80 1 -- 172.21.15.151:0/1654049889 wait complete. 2023-07-21T22:40:52.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.161+0000 7f991ac98b80 20 client.27754 trim_cache size 0 max 16384 2023-07-21T22:40:52.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.178+0000 7f991ac98b80 1 Processor -- start 2023-07-21T22:40:52.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.178+0000 7f991ac98b80 1 -- start start 2023-07-21T22:40:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.178+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c40aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.178+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36210 0x558a21c35050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.178+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36660 0x558a21c2ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.178+0000 7f991ac98b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21c3a8d0 con 0x558a21a8c6b0 2023-07-21T22:40:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.178+0000 7f991ac98b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21c31030 con 0x558a21c36210 2023-07-21T22:40:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.178+0000 7f991ac98b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21c30ad0 con 0x558a21c36660 2023-07-21T22:40:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c40aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990519b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36210 0x558a21c35050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990519b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36210 0x558a21c35050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46190/0 (socket says 172.21.15.151:46190) 2023-07-21T22:40:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c40aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59066/0 (socket says 172.21.15.151:59066) 2023-07-21T22:40:52.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990519b700 1 -- 172.21.15.151:0/2241963350 learned_addr learned my addr 172.21.15.151:0/2241963350 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:52.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990499a700 1 --2- 172.21.15.151:0/2241963350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36660 0x558a21c2ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990519b700 1 -- 172.21.15.151:0/2241963350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36660 msgr2=0x558a21c2ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990519b700 1 --2- 172.21.15.151:0/2241963350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36660 0x558a21c2ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990519b700 1 -- 172.21.15.151:0/2241963350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 msgr2=0x558a21c40aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990519b700 1 --2- 172.21.15.151:0/2241963350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c40aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990519b700 1 -- 172.21.15.151:0/2241963350 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558a219d61f0 con 0x558a21c36210 2023-07-21T22:40:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990499a700 1 --2- 172.21.15.151:0/2241963350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36660 0x558a21c2ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:40:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.179+0000 7f990519b700 1 --2- 172.21.15.151:0/2241963350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36210 0x558a21c35050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009c50 tx=0x7f98fc011840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7814079475acf1d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f98ebfff700 1 -- 172.21.15.151:0/2241963350 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc005ce0 con 0x558a21c36210 2023-07-21T22:40:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f98ebfff700 1 -- 172.21.15.151:0/2241963350 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98fc0044e0 con 0x558a21c36210 2023-07-21T22:40:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f98ebfff700 1 -- 172.21.15.151:0/2241963350 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98fc003c70 con 0x558a21c36210 2023-07-21T22:40:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f991ac98b80 1 -- 172.21.15.151:0/2241963350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36210 msgr2=0x558a21c35050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:52.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f991ac98b80 1 --2- 172.21.15.151:0/2241963350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36210 0x558a21c35050 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f98fc009c50 tx=0x7f98fc011840 comp rx=0 tx=0).stop 2023-07-21T22:40:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f991ac98b80 1 -- 172.21.15.151:0/2241963350 shutdown_connections 2023-07-21T22:40:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f991ac98b80 1 --2- 172.21.15.151:0/2241963350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36660 0x558a21c2ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f991ac98b80 1 --2- 172.21.15.151:0/2241963350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c40aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f991ac98b80 1 --2- 172.21.15.151:0/2241963350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36210 0x558a21c35050 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.180+0000 7f991ac98b80 1 -- 172.21.15.151:0/2241963350 >> 172.21.15.151:0/2241963350 conn(0x558a21c25ae0 msgr2=0x558a21c34940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.181+0000 7f991ac98b80 1 -- 172.21.15.151:0/2241963350 shutdown_connections 2023-07-21T22:40:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.181+0000 7f991ac98b80 1 -- 172.21.15.151:0/2241963350 wait complete. 2023-07-21T22:40:52.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.181+0000 7f991ac98b80 1 -- start start 2023-07-21T22:40:52.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.181+0000 7f991ac98b80 1 Processor -- start 2023-07-21T22:40:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c329d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c32f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f991ac98b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c31800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f991ac98b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21c41000 con 0x558a21a8c6b0 2023-07-21T22:40:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f991ac98b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21c31d40 con 0x558a21c36660 2023-07-21T22:40:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f991ac98b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558a21c31f00 con 0x558a21c36210 2023-07-21T22:40:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f991ac98b80 10 client.0 _ll_register_callbacks cb 0x7f98f0013c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:40:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f990499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c329d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f990499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c329d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59076/0 (socket says 172.21.15.151:59076) 2023-07-21T22:40:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f990499a700 1 -- 172.21.15.151:0/3973280386 learned_addr learned my addr 172.21.15.151:0/3973280386 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:40:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.182+0000 7f990519b700 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c32f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f990499a700 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c31800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f990499a700 1 -- 172.21.15.151:0/3973280386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 msgr2=0x558a21c32f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f990499a700 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c32f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f990499a700 1 -- 172.21.15.151:0/3973280386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 msgr2=0x558a21c31800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:40:52.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f990499a700 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c31800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f990499a700 1 -- 172.21.15.151:0/3973280386 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98fc01d040 con 0x558a21a8c6b0 2023-07-21T22:40:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f990519b700 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c32f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:40:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f990499a700 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c329d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f98f0013d90 tx=0x7f98f0009fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aef6a5baca1ddd1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:40:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f98e8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:40:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f98e8ff9700 1 -- 172.21.15.151:0/3973280386 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98f0018040 con 0x558a21a8c6b0 2023-07-21T22:40:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f991ac98b80 1 -- 172.21.15.151:0/3973280386 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558a21adb490 con 0x558a21a8c6b0 2023-07-21T22:40:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.183+0000 7f98e8ff9700 1 -- 172.21.15.151:0/3973280386 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f98f0003880 con 0x558a21a8c6b0 2023-07-21T22:40:52.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f98e8ff9700 1 -- 172.21.15.151:0/3973280386 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=80) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98f0021410 con 0x558a21a8c6b0 2023-07-21T22:40:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f991ac98b80 10 client.18057 fetch_fsmap learned FSMap version 80 2023-07-21T22:40:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f991ac98b80 1 -- 172.21.15.151:0/3973280386 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=80,monmap=4+}) v3 -- 0x558a219ae250 con 0x558a21a8c6b0 2023-07-21T22:40:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f98e8ff9700 1 -- 172.21.15.151:0/3973280386 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558a21adb490 con 0x558a21a8c6b0 2023-07-21T22:40:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f98e8ff9700 1 -- 172.21.15.151:0/3973280386 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 80) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f98f00052c0 con 0x558a21a8c6b0 2023-07-21T22:40:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f991ac98b80 10 client.18057 fetch_fsmap finished waiting for FSMap version 80 2023-07-21T22:40:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f991ac98b80 10 client.18057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:40:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f991ac98b80 20 client.18057 populate_metadata read hostname 'smithi151' 2023-07-21T22:40:52.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f991ac98b80 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a21c9e690 0x558a21ca0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:40:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f991ac98b80 4 client.18057 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:40:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.184+0000 7f991ac98b80 1 -- 172.21.15.151:0/3973280386 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558a219d0f10 con 0x558a21c9e690 2023-07-21T22:40:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.185+0000 7f990519b700 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a21c9e690 0x558a21ca0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:40:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.185+0000 7f98e8ff9700 10 client.18057 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:52.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.185+0000 7f990519b700 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a21c9e690 0x558a21ca0aa0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9f153ca1da551e6 server_cookie=55fa603bf99fe422 in_seq=0 out_seq=0 2023-07-21T22:40:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f98e8ff9700 1 -- 172.21.15.151:0/3973280386 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558a219d0f10 con 0x558a21c9e690 2023-07-21T22:40:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f98e8ff9700 10 client.18057 handle_command_reply: tid=0 2023-07-21T22:40:52.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f991ac98b80 1 client.18057 shutdown 2023-07-21T22:40:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f991ac98b80 1 -- 172.21.15.151:0/3973280386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 msgr2=0x558a21c329d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:52.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f991ac98b80 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c329d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f98f0013d90 tx=0x7f98f0009fd0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f991ac98b80 1 -- 172.21.15.151:0/3973280386 shutdown_connections 2023-07-21T22:40:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f991ac98b80 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558a21c9e690 0x558a21ca0aa0 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f991ac98b80 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558a21c36660 0x558a21c31800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f991ac98b80 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558a21a8c6b0 0x558a21c329d0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f991ac98b80 1 --2- 172.21.15.151:0/3973280386 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558a21c36210 0x558a21c32f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f98e8ff9700 0 client.18057 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:40:52.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.202+0000 7f991ac98b80 1 -- 172.21.15.151:0/3973280386 >> 172.21.15.151:0/3973280386 conn(0x558a21c25ae0 msgr2=0x558a21c381e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.203+0000 7f991ac98b80 1 -- 172.21.15.151:0/3973280386 shutdown_connections 2023-07-21T22:40:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.203+0000 7f991ac98b80 1 -- 172.21.15.151:0/3973280386 wait complete. 2023-07-21T22:40:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.203+0000 7f991ac98b80 20 client.18057 trim_cache size 0 max 16384 2023-07-21T22:40:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:40:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:40:52.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:40:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:40:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 -- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98ec0a12c0 msgr2=0x7f98ec0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98ec0a12c0 0x7f98ec0a3770 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f98f8009670 tx=0x7f98f8009040 comp rx=0 tx=0).stop 2023-07-21T22:40:52.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 -- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 msgr2=0x7f990019c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:40:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 0x7f990019c9f0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f98f800b070 tx=0x7f98f800bce0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 -- 172.21.15.151:0/3394682948 shutdown_connections 2023-07-21T22:40:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98ec0a12c0 0x7f98ec0a3770 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99000728b0 0x7f9900197e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f990010c370 0x7f990019c9f0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 --2- 172.21.15.151:0/3394682948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f99000731c0 0x7f9900198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:40:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 -- 172.21.15.151:0/3394682948 >> 172.21.15.151:0/3394682948 conn(0x7f99000fb650 msgr2=0x7f990010e430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:40:52.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 -- 172.21.15.151:0/3394682948 shutdown_connections 2023-07-21T22:40:52.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:40:52.204+0000 7f99073ff700 1 -- 172.21.15.151:0/3394682948 wait complete. 2023-07-21T22:40:52.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:52 smithi187 ceph-mon[96918]: pgmap v683: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 2.4 MiB/s wr, 315 op/s 2023-07-21T22:40:52.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:52 smithi195 ceph-mon[97365]: pgmap v683: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 2.4 MiB/s wr, 315 op/s 2023-07-21T22:40:52.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:52 smithi151 ceph-mon[95510]: pgmap v683: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 128 KiB/s rd, 2.4 MiB/s wr, 315 op/s 2023-07-21T22:40:54.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:54 smithi187 ceph-mon[96918]: pgmap v684: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 3.7 MiB/s wr, 483 op/s 2023-07-21T22:40:54.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:54 smithi195 ceph-mon[97365]: pgmap v684: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 3.7 MiB/s wr, 483 op/s 2023-07-21T22:40:54.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:54 smithi151 ceph-mon[95510]: pgmap v684: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 3.7 MiB/s wr, 483 op/s 2023-07-21T22:40:55.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:55 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:55.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:55 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:55.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:55 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:40:56.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:56 smithi187 ceph-mon[96918]: pgmap v685: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 2.5 MiB/s wr, 324 op/s 2023-07-21T22:40:56.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:56 smithi195 ceph-mon[97365]: pgmap v685: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 2.5 MiB/s wr, 324 op/s 2023-07-21T22:40:56.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:56 smithi151 ceph-mon[95510]: pgmap v685: 97 pgs: 97 active+clean; 9.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 2.5 MiB/s wr, 324 op/s 2023-07-21T22:40:58.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:40:58 smithi187 ceph-mon[96918]: pgmap v686: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-07-21T22:40:58.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:40:58 smithi195 ceph-mon[97365]: pgmap v686: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-07-21T22:40:58.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:40:58 smithi151 ceph-mon[95510]: pgmap v686: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 155 KiB/s rd, 3.8 MiB/s wr, 491 op/s 2023-07-21T22:41:00.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:00 smithi187 ceph-mon[96918]: pgmap v687: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:41:00.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:41:00.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:00 smithi195 ceph-mon[97365]: pgmap v687: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:41:00.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:41:00.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:00 smithi151 ceph-mon[95510]: pgmap v687: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:41:00.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:41:02.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: pgmap v688: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:41:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:41:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:41:02.376 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.403 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: pgmap v688: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:41:02.404 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:41:02.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:41:02.405 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: pgmap v688: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 2.6 MiB/s wr, 335 op/s 2023-07-21T22:41:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:41:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:41:02.447 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:41:04.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:04 smithi187 ceph-mon[96918]: pgmap v689: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 3.8 MiB/s wr, 504 op/s 2023-07-21T22:41:04.653 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:04 smithi195 ceph-mon[97365]: pgmap v689: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 3.8 MiB/s wr, 504 op/s 2023-07-21T22:41:04.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:04 smithi151 ceph-mon[95510]: pgmap v689: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 3.8 MiB/s wr, 504 op/s 2023-07-21T22:41:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.370+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/3046718812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a4105b60 msgr2=0x7ff5a4105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.370+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/3046718812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a4105b60 0x7ff5a4105f30 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff598009990 tx=0x7ff598009ca0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.370+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/3046718812 shutdown_connections 2023-07-21T22:41:05.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.370+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/3046718812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a4105b60 0x7ff5a4105f30 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.370+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/3046718812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a41004e0 0x7ff5a410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.370+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/3046718812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a40ffb30 0x7ff5a40fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.370+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/3046718812 >> 172.21.15.151:0/3046718812 conn(0x7ff5a40fb5f0 msgr2=0x7ff5a40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.371+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/3046718812 shutdown_connections 2023-07-21T22:41:05.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.371+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/3046718812 wait complete. 2023-07-21T22:41:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5ab1ff700 1 Processor -- start 2023-07-21T22:41:05.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5ab1ff700 1 -- start start 2023-07-21T22:41:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5ab1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a40ffb30 0x7ff5a4197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5ab1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a41004e0 0x7ff5a4198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5ab1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a4105b60 0x7ff5a419c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5ab1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a419cf30 con 0x7ff5a40ffb30 2023-07-21T22:41:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5ab1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a419d0a0 con 0x7ff5a41004e0 2023-07-21T22:41:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5ab1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5a419d260 con 0x7ff5a4105b60 2023-07-21T22:41:05.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5a8f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a40ffb30 0x7ff5a4197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5a8f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a40ffb30 0x7ff5a4197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38134/0 (socket says 172.21.15.151:38134) 2023-07-21T22:41:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/525809297 learned_addr learned my addr 172.21.15.151:0/525809297 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.372+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a41004e0 0x7ff5a4198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.373+0000 7ff5a979c700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a4105b60 0x7ff5a419c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.373+0000 7ff5a3fff700 1 -- 172.21.15.151:0/525809297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a4105b60 msgr2=0x7ff5a419c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.373+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a4105b60 0x7ff5a419c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.373+0000 7ff5a3fff700 1 -- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a40ffb30 msgr2=0x7ff5a4197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:05.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.373+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a40ffb30 0x7ff5a4197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.373+0000 7ff5a3fff700 1 -- 172.21.15.151:0/525809297 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5980095f0 con 0x7ff5a41004e0 2023-07-21T22:41:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.373+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a40ffb30 0x7ff5a4197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.373+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a41004e0 0x7ff5a4198280 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff59000e9f0 tx=0x7ff59000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:05.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.373+0000 7ff5a1ffb700 1 -- 172.21.15.151:0/525809297 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59000c9c0 con 0x7ff5a41004e0 2023-07-21T22:41:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.374+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/525809297 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5a419d540 con 0x7ff5a41004e0 2023-07-21T22:41:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.374+0000 7ff5a1ffb700 1 -- 172.21.15.151:0/525809297 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff590010430 con 0x7ff5a41004e0 2023-07-21T22:41:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.374+0000 7ff5a1ffb700 1 -- 172.21.15.151:0/525809297 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590018680 con 0x7ff5a41004e0 2023-07-21T22:41:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.374+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/525809297 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a41a4d80 con 0x7ff5a41004e0 2023-07-21T22:41:05.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.377+0000 7ff5a1ffb700 1 -- 172.21.15.151:0/525809297 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff5900105a0 con 0x7ff5a41004e0 2023-07-21T22:41:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.378+0000 7ff5beb81b80 1 Processor -- start 2023-07-21T22:41:05.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.378+0000 7ff5beb81b80 1 -- start start 2023-07-21T22:41:05.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.378+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x56225089ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d210 0x562250896f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x5622508974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225079cc50 con 0x5622506f36b0 2023-07-21T22:41:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622507ef9e0 con 0x56225089d210 2023-07-21T22:41:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622507e8e70 con 0x56225089d660 2023-07-21T22:41:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a1ffb700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff5940a1340 0x7ff5940a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a1ffb700 1 -- 172.21.15.151:0/525809297 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff590014070 con 0x7ff5a41004e0 2023-07-21T22:41:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x5622508974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a8f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d210 0x562250896f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x5622508974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60314/0 (socket says 172.21.15.151:60314) 2023-07-21T22:41:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a3fff700 1 -- 172.21.15.151:0/156509802 learned_addr learned my addr 172.21.15.151:0/156509802 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a979c700 1 --2- 172.21.15.151:0/156509802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x56225089ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a979c700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff5940a1340 0x7ff5940a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a3fff700 1 -- 172.21.15.151:0/156509802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d210 msgr2=0x562250896f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:05.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/156509802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d210 0x562250896f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a3fff700 1 -- 172.21.15.151:0/156509802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 msgr2=0x56225089ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/156509802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x56225089ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.379+0000 7ff5a3fff700 1 -- 172.21.15.151:0/156509802 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562250616d80 con 0x56225089d660 2023-07-21T22:41:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.380+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/156509802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x5622508974a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff5900a1dd0 tx=0x7ff590099d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da21b8b1cf45e9b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.380+0000 7ff58effd700 1 -- 172.21.15.151:0/156509802 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff590010880 con 0x56225089d660 2023-07-21T22:41:05.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.380+0000 7ff5a979c700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff5940a1340 0x7ff5940a37f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff59c007800 tx=0x7ff59c009100 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.380+0000 7ff58effd700 1 -- 172.21.15.151:0/156509802 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff590099eb0 con 0x56225089d660 2023-07-21T22:41:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.380+0000 7ff58effd700 1 -- 172.21.15.151:0/156509802 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5900995a0 con 0x56225089d660 2023-07-21T22:41:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 -- 172.21.15.151:0/156509802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 msgr2=0x5622508974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/156509802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x5622508974a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ff5900a1dd0 tx=0x7ff590099d00 comp rx=0 tx=0).stop 2023-07-21T22:41:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 -- 172.21.15.151:0/156509802 shutdown_connections 2023-07-21T22:41:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/156509802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x5622508974a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/156509802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x56225089ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/156509802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d210 0x562250896f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 -- 172.21.15.151:0/156509802 >> 172.21.15.151:0/156509802 conn(0x56225088cae0 msgr2=0x5622508920e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 -- 172.21.15.151:0/156509802 shutdown_connections 2023-07-21T22:41:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 -- 172.21.15.151:0/156509802 wait complete. 2023-07-21T22:41:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 -- start start 2023-07-21T22:41:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.381+0000 7ff5beb81b80 1 Processor -- start 2023-07-21T22:41:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x5622508a34f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 0x5622508a0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d660 0x5622508a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562250788a60 con 0x5622506f36b0 2023-07-21T22:41:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562250788760 con 0x56225089d660 2023-07-21T22:41:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225066c8c0 con 0x56225089d210 2023-07-21T22:41:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5beb81b80 10 client.0 _ll_register_callbacks cb 0x562250786700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5a8f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x5622508a34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5a3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 0x5622508a0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5a8f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x5622508a34f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38150/0 (socket says 172.21.15.151:38150) 2023-07-21T22:41:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/3315761292 learned_addr learned my addr 172.21.15.151:0/3315761292 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.382+0000 7ff5a979c700 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d660 0x5622508a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5a3fff700 1 -- 172.21.15.151:0/3315761292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d660 msgr2=0x5622508a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d660 0x5622508a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5a3fff700 1 -- 172.21.15.151:0/3315761292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 msgr2=0x5622508a34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x5622508a34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5a3fff700 1 -- 172.21.15.151:0/3315761292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a41a4d80 con 0x56225089d210 2023-07-21T22:41:05.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5a979c700 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d660 0x5622508a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x5622508a34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 0x5622508a0770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff590000c00 tx=0x7ff59009a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6bbae02bc4f5308 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff583fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:41:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff583fff700 1 -- 172.21.15.151:0/3315761292 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59009dee0 con 0x56225089d210 2023-07-21T22:41:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff583fff700 1 -- 172.21.15.151:0/3315761292 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff590010880 con 0x56225089d210 2023-07-21T22:41:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5beb81b80 1 -- 172.21.15.151:0/3315761292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562250742490 con 0x56225089d210 2023-07-21T22:41:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff583fff700 1 -- 172.21.15.151:0/3315761292 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff5900a2300 con 0x56225089d210 2023-07-21T22:41:05.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5beb81b80 10 client.27772 fetch_fsmap learned FSMap version 81 2023-07-21T22:41:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.383+0000 7ff5beb81b80 1 -- 172.21.15.151:0/3315761292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) v3 -- 0x5622505ffc00 con 0x56225089d210 2023-07-21T22:41:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.384+0000 7ff583fff700 1 -- 172.21.15.151:0/3315761292 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff59007c080 con 0x56225089d210 2023-07-21T22:41:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.384+0000 7ff583fff700 1 -- 172.21.15.151:0/3315761292 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 81) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff590095ca0 con 0x56225089d210 2023-07-21T22:41:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.384+0000 7ff5beb81b80 10 client.27772 fetch_fsmap finished waiting for FSMap version 81 2023-07-21T22:41:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.384+0000 7ff5beb81b80 10 client.27772 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.384+0000 7ff5beb81b80 20 client.27772 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:05.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.384+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5622508b0630 0x5622508b2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.384+0000 7ff5beb81b80 4 client.27772 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:41:05.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.384+0000 7ff5beb81b80 1 -- 172.21.15.151:0/3315761292 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5622507e1e50 con 0x5622508b0630 2023-07-21T22:41:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.384+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5622508b0630 0x5622508b2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.385+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5622508b0630 0x5622508b2a40 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=457f9905e23159f9 server_cookie=272e64cb90fdf0d0 in_seq=0 out_seq=0 2023-07-21T22:41:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.385+0000 7ff583fff700 10 client.27772 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff583fff700 1 -- 172.21.15.151:0/3315761292 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5622507e1e50 con 0x5622508b0630 2023-07-21T22:41:05.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff583fff700 10 client.27772 handle_command_reply: tid=0 2023-07-21T22:41:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 client.27772 shutdown 2023-07-21T22:41:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 -- 172.21.15.151:0/3315761292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 msgr2=0x5622508a0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 0x5622508a0770 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7ff590000c00 tx=0x7ff59009a340 comp rx=0 tx=0).stop 2023-07-21T22:41:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 -- 172.21.15.151:0/3315761292 shutdown_connections 2023-07-21T22:41:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5622508b0630 0x5622508b2a40 crc :-1 s=READY pgs=292 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56225089d660 0x5622508a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff583fff700 0 client.27772 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622506f36b0 0x5622508a34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/3315761292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 0x5622508a0770 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 -- 172.21.15.151:0/3315761292 >> 172.21.15.151:0/3315761292 conn(0x56225088cae0 msgr2=0x5622508913e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 -- 172.21.15.151:0/3315761292 shutdown_connections 2023-07-21T22:41:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 1 -- 172.21.15.151:0/3315761292 wait complete. 2023-07-21T22:41:05.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.386+0000 7ff5beb81b80 20 client.27772 trim_cache size 0 max 16384 2023-07-21T22:41:05.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.401+0000 7ff5beb81b80 1 Processor -- start 2023-07-21T22:41:05.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.401+0000 7ff5beb81b80 1 -- start start 2023-07-21T22:41:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x5622508a7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 0x56225089e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d660 0x56225089ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225088ec00 con 0x56225089d660 2023-07-21T22:41:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622508ad400 con 0x5622506f36b0 2023-07-21T22:41:05.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56225089b3d0 con 0x56225089d210 2023-07-21T22:41:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5a8f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x5622508a7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5a979c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d660 0x56225089ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5a8f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x5622508a7b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45464/0 (socket says 172.21.15.151:45464) 2023-07-21T22:41:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/111284989 learned_addr learned my addr 172.21.15.151:0/111284989 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/111284989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 0x56225089e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/111284989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 msgr2=0x56225089e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/111284989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 0x56225089e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/111284989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d660 msgr2=0x56225089ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.402+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/111284989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d660 0x56225089ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.403+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/111284989 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56225063d1f0 con 0x5622506f36b0 2023-07-21T22:41:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.403+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/111284989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x5622508a7b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5622508b3320 tx=0x7ff59800b410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eb649313825941ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.403+0000 7ff58f7fe700 1 -- 172.21.15.151:0/111284989 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59802a070 con 0x5622506f36b0 2023-07-21T22:41:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.403+0000 7ff58f7fe700 1 -- 172.21.15.151:0/111284989 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff59801e040 con 0x5622506f36b0 2023-07-21T22:41:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.403+0000 7ff58f7fe700 1 -- 172.21.15.151:0/111284989 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59801d040 con 0x5622506f36b0 2023-07-21T22:41:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 -- 172.21.15.151:0/111284989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 msgr2=0x5622508a7b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:05.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/111284989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x5622508a7b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x5622508b3320 tx=0x7ff59800b410 comp rx=0 tx=0).stop 2023-07-21T22:41:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 -- 172.21.15.151:0/111284989 shutdown_connections 2023-07-21T22:41:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/111284989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x5622508a7b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/111284989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d660 0x56225089ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/111284989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d210 0x56225089e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 -- 172.21.15.151:0/111284989 >> 172.21.15.151:0/111284989 conn(0x56225088cae0 msgr2=0x56225089da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 -- 172.21.15.151:0/111284989 shutdown_connections 2023-07-21T22:41:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 -- 172.21.15.151:0/111284989 wait complete. 2023-07-21T22:41:05.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 -- start start 2023-07-21T22:41:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.404+0000 7ff5beb81b80 1 Processor -- start 2023-07-21T22:41:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x562250899dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d210 0x562250898730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5beb81b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x562250898c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622508991b0 con 0x56225089d210 2023-07-21T22:41:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562250899320 con 0x5622506f36b0 2023-07-21T22:41:05.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5beb81b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622508994e0 con 0x56225089d660 2023-07-21T22:41:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5beb81b80 10 client.0 _ll_register_callbacks cb 0x562250786700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5a8f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x562250899dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d210 0x562250898730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5a8f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x562250899dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45476/0 (socket says 172.21.15.151:45476) 2023-07-21T22:41:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/313417822 learned_addr learned my addr 172.21.15.151:0/313417822 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.405+0000 7ff5a979c700 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x562250898c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/313417822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 msgr2=0x562250898c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:05.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x562250898c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/313417822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d210 msgr2=0x562250898730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d210 0x562250898730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff5a8f9b700 1 -- 172.21.15.151:0/313417822 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5a410d220 con 0x5622506f36b0 2023-07-21T22:41:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d210 0x562250898730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff5a8f9b700 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x562250899dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff59800be70 tx=0x7ff598005430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f21f9aec296d56b6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff583fff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:41:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff583fff700 1 -- 172.21.15.151:0/313417822 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff59802a050 con 0x5622506f36b0 2023-07-21T22:41:05.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff583fff700 1 -- 172.21.15.151:0/313417822 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(118..118 src has 1..118) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff598005690 con 0x5622506f36b0 2023-07-21T22:41:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff5beb81b80 1 -- 172.21.15.151:0/313417822 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff590099eb0 con 0x5622506f36b0 2023-07-21T22:41:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff583fff700 1 -- 172.21.15.151:0/313417822 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff59801d040 con 0x5622506f36b0 2023-07-21T22:41:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.406+0000 7ff5beb81b80 10 client.27749 fetch_fsmap learned FSMap version 81 2023-07-21T22:41:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff5beb81b80 1 -- 172.21.15.151:0/313417822 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) v3 -- 0x562250615250 con 0x5622506f36b0 2023-07-21T22:41:05.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff583fff700 1 -- 172.21.15.151:0/313417822 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff590099eb0 con 0x5622506f36b0 2023-07-21T22:41:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff583fff700 1 -- 172.21.15.151:0/313417822 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 81) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff598035070 con 0x5622506f36b0 2023-07-21T22:41:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff5beb81b80 10 client.27749 fetch_fsmap finished waiting for FSMap version 81 2023-07-21T22:41:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff5beb81b80 10 client.27749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff5beb81b80 20 client.27749 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:05.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562250905320 0x562250907700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff5beb81b80 4 client.27749 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:41:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff5beb81b80 1 -- 172.21.15.151:0/313417822 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5622507a3ff0 con 0x562250905320 2023-07-21T22:41:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.407+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562250905320 0x562250907700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.408+0000 7ff5a3fff700 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562250905320 0x562250907700 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83f0a8ae49e41f2d server_cookie=1a1bcd43c61549b in_seq=0 out_seq=0 2023-07-21T22:41:05.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.408+0000 7ff583fff700 10 client.27749 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:05.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff583fff700 1 -- 172.21.15.151:0/313417822 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5622507a3ff0 con 0x562250905320 2023-07-21T22:41:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff583fff700 10 client.27749 handle_command_reply: tid=0 2023-07-21T22:41:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 client.27749 shutdown 2023-07-21T22:41:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 -- 172.21.15.151:0/313417822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 msgr2=0x562250899dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x562250899dc0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff59800be70 tx=0x7ff598005430 comp rx=0 tx=0).stop 2023-07-21T22:41:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 -- 172.21.15.151:0/313417822 shutdown_connections 2023-07-21T22:41:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562250905320 0x562250907700 crc :-1 s=READY pgs=293 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5622506f36b0 0x562250899dc0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56225089d660 0x562250898c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 --2- 172.21.15.151:0/313417822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56225089d210 0x562250898730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff583fff700 0 client.27749 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 -- 172.21.15.151:0/313417822 >> 172.21.15.151:0/313417822 conn(0x56225088cae0 msgr2=0x56225089e2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 -- 172.21.15.151:0/313417822 shutdown_connections 2023-07-21T22:41:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 1 -- 172.21.15.151:0/313417822 wait complete. 2023-07-21T22:41:05.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.422+0000 7ff5beb81b80 20 client.27749 trim_cache size 0 max 16384 2023-07-21T22:41:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:41:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:41:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:41:05.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:41:05.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff5940a1340 msgr2=0x7ff5940a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:05.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff5940a1340 0x7ff5940a37f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7ff59c007800 tx=0x7ff59c009100 comp rx=0 tx=0).stop 2023-07-21T22:41:05.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/525809297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a41004e0 msgr2=0x7ff5a4198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:05.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a41004e0 0x7ff5a4198280 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7ff59000e9f0 tx=0x7ff59000ed00 comp rx=0 tx=0).stop 2023-07-21T22:41:05.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/525809297 shutdown_connections 2023-07-21T22:41:05.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff5940a1340 0x7ff5940a37f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff5a4105b60 0x7ff5a419c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a40ffb30 0x7ff5a4197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 --2- 172.21.15.151:0/525809297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5a41004e0 0x7ff5a4198280 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:05.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/525809297 >> 172.21.15.151:0/525809297 conn(0x7ff5a40fb5f0 msgr2=0x7ff5a4072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:05.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/525809297 shutdown_connections 2023-07-21T22:41:05.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:05.423+0000 7ff5ab1ff700 1 -- 172.21.15.151:0/525809297 wait complete. 2023-07-21T22:41:06.625 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:06 smithi187 ceph-mon[96918]: pgmap v690: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 336 op/s 2023-07-21T22:41:06.654 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:06 smithi195 ceph-mon[97365]: pgmap v690: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 336 op/s 2023-07-21T22:41:06.696 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:06 smithi151 ceph-mon[95510]: pgmap v690: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 2.5 MiB/s wr, 336 op/s 2023-07-21T22:41:08.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:08 smithi187 ceph-mon[96918]: pgmap v691: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 3.6 MiB/s wr, 481 op/s 2023-07-21T22:41:08.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:08 smithi195 ceph-mon[97365]: pgmap v691: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 3.6 MiB/s wr, 481 op/s 2023-07-21T22:41:08.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:08 smithi151 ceph-mon[95510]: pgmap v691: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 3.6 MiB/s wr, 481 op/s 2023-07-21T22:41:10.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:10 smithi187 ceph-mon[96918]: pgmap v692: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 2.3 MiB/s wr, 313 op/s 2023-07-21T22:41:10.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:10 smithi187 ceph-mon[96918]: osdmap e119: 12 total, 12 up, 12 in 2023-07-21T22:41:10.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:10 smithi195 ceph-mon[97365]: pgmap v692: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 2.3 MiB/s wr, 313 op/s 2023-07-21T22:41:10.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:10 smithi195 ceph-mon[97365]: osdmap e119: 12 total, 12 up, 12 in 2023-07-21T22:41:10.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:10 smithi151 ceph-mon[95510]: pgmap v692: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 2.3 MiB/s wr, 313 op/s 2023-07-21T22:41:10.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:10 smithi151 ceph-mon[95510]: osdmap e119: 12 total, 12 up, 12 in 2023-07-21T22:41:12.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:12 smithi187 ceph-mon[96918]: pgmap v694: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.8 MiB/s wr, 376 op/s 2023-07-21T22:41:12.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:12 smithi195 ceph-mon[97365]: pgmap v694: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.8 MiB/s wr, 376 op/s 2023-07-21T22:41:12.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:12 smithi151 ceph-mon[95510]: pgmap v694: 97 pgs: 97 active+clean; 9.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.8 MiB/s wr, 376 op/s 2023-07-21T22:41:14.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:14 smithi187 ceph-mon[96918]: pgmap v695: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:41:14.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:14 smithi195 ceph-mon[97365]: pgmap v695: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:41:14.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:14 smithi151 ceph-mon[95510]: pgmap v695: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:41:16.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:16 smithi187 ceph-mon[96918]: pgmap v696: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:41:16.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:16 smithi187 ceph-mon[96918]: osdmap e120: 12 total, 12 up, 12 in 2023-07-21T22:41:16.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:16 smithi195 ceph-mon[97365]: pgmap v696: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:41:16.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:16 smithi195 ceph-mon[97365]: osdmap e120: 12 total, 12 up, 12 in 2023-07-21T22:41:16.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:16 smithi151 ceph-mon[95510]: pgmap v696: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:41:16.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:16 smithi151 ceph-mon[95510]: osdmap e120: 12 total, 12 up, 12 in 2023-07-21T22:41:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.592+0000 7f95b99ff700 1 -- 172.21.15.151:0/3841127245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b41004e0 msgr2=0x7f95b410c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:18.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.592+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3841127245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b41004e0 0x7f95b410c920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00b0a0 tx=0x7f95ac00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.592+0000 7f95b99ff700 1 -- 172.21.15.151:0/3841127245 shutdown_connections 2023-07-21T22:41:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.592+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3841127245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b4105b60 0x7f95b4105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.592+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3841127245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b41004e0 0x7f95b410c920 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.592+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3841127245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95b40ffb30 0x7f95b40fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.592+0000 7f95b99ff700 1 -- 172.21.15.151:0/3841127245 >> 172.21.15.151:0/3841127245 conn(0x7f95b40fb5f0 msgr2=0x7f95b40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:18.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.592+0000 7f95b99ff700 1 -- 172.21.15.151:0/3841127245 shutdown_connections 2023-07-21T22:41:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.592+0000 7f95b99ff700 1 -- 172.21.15.151:0/3841127245 wait complete. 2023-07-21T22:41:18.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.593+0000 7f95b99ff700 1 Processor -- start 2023-07-21T22:41:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.593+0000 7f95b99ff700 1 -- start start 2023-07-21T22:41:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b99ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b40ffb30 0x7f95b4197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b99ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b41004e0 0x7f95b4198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b99ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95b4105b60 0x7f95b419c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b99ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b419cfd0 con 0x7f95b4105b60 2023-07-21T22:41:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b99ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b419d140 con 0x7f95b40ffb30 2023-07-21T22:41:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b99ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b419d300 con 0x7f95b41004e0 2023-07-21T22:41:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95b4105b60 0x7f95b419c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b40ffb30 0x7f95b4197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b41004e0 0x7f95b4198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95b4105b60 0x7f95b419c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51052/0 (socket says 172.21.15.151:51052) 2023-07-21T22:41:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b40ffb30 0x7f95b4197de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51190/0 (socket says 172.21.15.151:51190) 2023-07-21T22:41:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b37fe700 1 -- 172.21.15.151:0/3446987407 learned_addr learned my addr 172.21.15.151:0/3446987407 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b37fe700 1 -- 172.21.15.151:0/3446987407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b41004e0 msgr2=0x7f95b4198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b37fe700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b41004e0 0x7f95b4198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b37fe700 1 -- 172.21.15.151:0/3446987407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b40ffb30 msgr2=0x7f95b4197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b37fe700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b40ffb30 0x7f95b4197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.594+0000 7f95b37fe700 1 -- 172.21.15.151:0/3446987407 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95a8009520 con 0x7f95b4105b60 2023-07-21T22:41:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.595+0000 7f95b37fe700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95b4105b60 0x7f95b419c990 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00b070 tx=0x7f95ac00bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.595+0000 7f95b89fd700 1 -- 172.21.15.151:0/3446987407 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac00e040 con 0x7f95b4105b60 2023-07-21T22:41:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.595+0000 7f95b99ff700 1 -- 172.21.15.151:0/3446987407 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ac009d00 con 0x7f95b4105b60 2023-07-21T22:41:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.595+0000 7f95b89fd700 1 -- 172.21.15.151:0/3446987407 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95ac009480 con 0x7f95b4105b60 2023-07-21T22:41:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.595+0000 7f95b89fd700 1 -- 172.21.15.151:0/3446987407 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac005040 con 0x7f95b4105b60 2023-07-21T22:41:18.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.595+0000 7f95b99ff700 1 -- 172.21.15.151:0/3446987407 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b419d810 con 0x7f95b4105b60 2023-07-21T22:41:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.598+0000 7f95b89fd700 1 -- 172.21.15.151:0/3446987407 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f95ac01d480 con 0x7f95b4105b60 2023-07-21T22:41:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.599+0000 7f95cd316b80 1 Processor -- start 2023-07-21T22:41:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95cd316b80 1 -- start start 2023-07-21T22:41:18.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95b89fd700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f959c0a12c0 0x7f959c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee83c66b0 0x55fee856fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee8569f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570660 0x55fee856a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95cd316b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee846fc50 con 0x55fee83c66b0 2023-07-21T22:41:18.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95cd316b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee84c29e0 con 0x55fee8570660 2023-07-21T22:41:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95cd316b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee84bbe70 con 0x55fee8570210 2023-07-21T22:41:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95b89fd700 1 -- 172.21.15.151:0/3446987407 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f95ac0cdfc0 con 0x7f95b4105b60 2023-07-21T22:41:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95b27fc700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f959c0a12c0 0x7f959c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95b2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee83c66b0 0x55fee856fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95b2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee83c66b0 0x55fee856fcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51056/0 (socket says 172.21.15.151:51056) 2023-07-21T22:41:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95b2ffd700 1 -- 172.21.15.151:0/2607571261 learned_addr learned my addr 172.21.15.151:0/2607571261 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:18.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95b37fe700 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570660 0x55fee856a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.600+0000 7f95b27fc700 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee8569f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f95b2ffd700 1 -- 172.21.15.151:0/2607571261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 msgr2=0x55fee8569f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee8569f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f95b2ffd700 1 -- 172.21.15.151:0/2607571261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570660 msgr2=0x55fee856a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570660 0x55fee856a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f95b2ffd700 1 -- 172.21.15.151:0/2607571261 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fee82e9d80 con 0x55fee83c66b0 2023-07-21T22:41:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f95b37fe700 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570660 0x55fee856a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:18.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee83c66b0 0x55fee856fcd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009d00 tx=0x7f95a4011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b7e5f221d368554 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f95b27fc700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f959c0a12c0 0x7f959c0a3770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009fd0 tx=0x7f95a8009d80 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f9599ffb700 1 -- 172.21.15.151:0/2607571261 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4019630 con 0x55fee83c66b0 2023-07-21T22:41:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f9599ffb700 1 -- 172.21.15.151:0/2607571261 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95a4019c20 con 0x55fee83c66b0 2023-07-21T22:41:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.601+0000 7f9599ffb700 1 -- 172.21.15.151:0/2607571261 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a400eab0 con 0x55fee83c66b0 2023-07-21T22:41:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.602+0000 7f95cd316b80 1 -- 172.21.15.151:0/2607571261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee83c66b0 msgr2=0x55fee856fcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:18.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.602+0000 7f95cd316b80 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee83c66b0 0x55fee856fcd0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f95a4009d00 tx=0x7f95a4011720 comp rx=0 tx=0).stop 2023-07-21T22:41:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.602+0000 7f95cd316b80 1 -- 172.21.15.151:0/2607571261 shutdown_connections 2023-07-21T22:41:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.602+0000 7f95cd316b80 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570660 0x55fee856a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.602+0000 7f95cd316b80 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee83c66b0 0x55fee856fcd0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.602+0000 7f95cd316b80 1 --2- 172.21.15.151:0/2607571261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee8569f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.602+0000 7f95cd316b80 1 -- 172.21.15.151:0/2607571261 >> 172.21.15.151:0/2607571261 conn(0x55fee855fae0 msgr2=0x55fee85650e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.602+0000 7f95cd316b80 1 -- 172.21.15.151:0/2607571261 shutdown_connections 2023-07-21T22:41:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.602+0000 7f95cd316b80 1 -- 172.21.15.151:0/2607571261 wait complete. 2023-07-21T22:41:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.603+0000 7f95cd316b80 1 -- start start 2023-07-21T22:41:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.603+0000 7f95cd316b80 1 Processor -- start 2023-07-21T22:41:18.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.603+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee83c66b0 0x55fee8576520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570210 0x55fee8573810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee8573e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95cd316b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee845ba60 con 0x55fee8570660 2023-07-21T22:41:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95cd316b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee845b760 con 0x55fee8570210 2023-07-21T22:41:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95cd316b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee833f8c0 con 0x55fee83c66b0 2023-07-21T22:41:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95cd316b80 10 client.0 _ll_register_callbacks cb 0x55fee8459700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee83c66b0 0x55fee8576520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee8573e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee83c66b0 0x55fee8576520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42162/0 (socket says 172.21.15.151:42162) 2023-07-21T22:41:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b27fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570210 0x55fee8573810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b2ffd700 1 -- 172.21.15.151:0/602975084 learned_addr learned my addr 172.21.15.151:0/602975084 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b2ffd700 1 -- 172.21.15.151:0/602975084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570210 msgr2=0x55fee8573810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570210 0x55fee8573810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b2ffd700 1 -- 172.21.15.151:0/602975084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 msgr2=0x55fee8573e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:18.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee8573e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b2ffd700 1 -- 172.21.15.151:0/602975084 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b419d810 con 0x55fee83c66b0 2023-07-21T22:41:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.604+0000 7f95b37fe700 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee8573e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee83c66b0 0x55fee8576520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f95a4000c00 tx=0x7f95a4005d60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9de0cf4dad7c27 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f9592ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:41:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f9592ffd700 1 -- 172.21.15.151:0/602975084 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a4019840 con 0x55fee83c66b0 2023-07-21T22:41:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f9592ffd700 1 -- 172.21.15.151:0/602975084 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f95a40199a0 con 0x55fee83c66b0 2023-07-21T22:41:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f95cd316b80 1 -- 172.21.15.151:0/602975084 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fee8415490 con 0x55fee83c66b0 2023-07-21T22:41:18.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f9592ffd700 1 -- 172.21.15.151:0/602975084 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95a400e430 con 0x55fee83c66b0 2023-07-21T22:41:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f95cd316b80 10 client.27790 fetch_fsmap learned FSMap version 81 2023-07-21T22:41:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f95cd316b80 1 -- 172.21.15.151:0/602975084 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) v3 -- 0x7f95a4009960 con 0x55fee83c66b0 2023-07-21T22:41:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f9592ffd700 1 -- 172.21.15.151:0/602975084 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fee8415490 con 0x55fee83c66b0 2023-07-21T22:41:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f9592ffd700 1 -- 172.21.15.151:0/602975084 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 81) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f95a4004c20 con 0x55fee83c66b0 2023-07-21T22:41:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f95cd316b80 10 client.27790 fetch_fsmap finished waiting for FSMap version 81 2023-07-21T22:41:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.605+0000 7f95cd316b80 10 client.27790 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:18.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.606+0000 7f95cd316b80 20 client.27790 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.606+0000 7f95cd316b80 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee85839d0 0x55fee8585de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.606+0000 7f95cd316b80 4 client.27790 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:41:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.606+0000 7f95cd316b80 1 -- 172.21.15.151:0/602975084 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fee84b4e50 con 0x55fee85839d0 2023-07-21T22:41:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.606+0000 7f95b27fc700 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee85839d0 0x55fee8585de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.606+0000 7f95b27fc700 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee85839d0 0x55fee8585de0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbd4425889845d7 server_cookie=7a1afb2c1a5625dc in_seq=0 out_seq=0 2023-07-21T22:41:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.606+0000 7f9592ffd700 10 client.27790 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:18.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f9592ffd700 1 -- 172.21.15.151:0/602975084 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fee84b4e50 con 0x55fee85839d0 2023-07-21T22:41:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f9592ffd700 10 client.27790 handle_command_reply: tid=0 2023-07-21T22:41:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f95cd316b80 1 client.27790 shutdown 2023-07-21T22:41:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f95cd316b80 1 -- 172.21.15.151:0/602975084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee83c66b0 msgr2=0x55fee8576520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f95cd316b80 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee83c66b0 0x55fee8576520 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f95a4000c00 tx=0x7f95a4005d60 comp rx=0 tx=0).stop 2023-07-21T22:41:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f95cd316b80 1 -- 172.21.15.151:0/602975084 shutdown_connections 2023-07-21T22:41:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f95cd316b80 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee85839d0 0x55fee8585de0 crc :-1 s=READY pgs=294 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f95cd316b80 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee8573e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f95cd316b80 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee83c66b0 0x55fee8576520 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f95cd316b80 1 --2- 172.21.15.151:0/602975084 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee8570210 0x55fee8573810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f9592ffd700 0 client.27790 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.607+0000 7f95cd316b80 1 -- 172.21.15.151:0/602975084 >> 172.21.15.151:0/602975084 conn(0x55fee855fae0 msgr2=0x55fee85643e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.608+0000 7f95cd316b80 1 -- 172.21.15.151:0/602975084 shutdown_connections 2023-07-21T22:41:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.608+0000 7f95cd316b80 1 -- 172.21.15.151:0/602975084 wait complete. 2023-07-21T22:41:18.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.608+0000 7f95cd316b80 20 client.27790 trim_cache size 0 max 16384 2023-07-21T22:41:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.623+0000 7f95cd316b80 1 Processor -- start 2023-07-21T22:41:18.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.623+0000 7f95cd316b80 1 -- start start 2023-07-21T22:41:18.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 0x55fee856f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee8573020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee85760c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95cd316b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee856af20 con 0x55fee8570660 2023-07-21T22:41:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95cd316b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee8565f10 con 0x55fee83c66b0 2023-07-21T22:41:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95cd316b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee8586440 con 0x55fee8570210 2023-07-21T22:41:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee85760c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee85760c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51080/0 (socket says 172.21.15.151:51080) 2023-07-21T22:41:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b37fe700 1 -- 172.21.15.151:0/2764493053 learned_addr learned my addr 172.21.15.151:0/2764493053 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/2764493053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 0x55fee856f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b27fc700 1 --2- 172.21.15.151:0/2764493053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee8573020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b37fe700 1 -- 172.21.15.151:0/2764493053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 msgr2=0x55fee8573020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b37fe700 1 --2- 172.21.15.151:0/2764493053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee8573020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b37fe700 1 -- 172.21.15.151:0/2764493053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 msgr2=0x55fee856f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b37fe700 1 --2- 172.21.15.151:0/2764493053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 0x55fee856f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.624+0000 7f95b37fe700 1 -- 172.21.15.151:0/2764493053 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fee82d2c00 con 0x55fee8570660 2023-07-21T22:41:18.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.625+0000 7f95b37fe700 1 --2- 172.21.15.151:0/2764493053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee85760c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f95ac007fd0 tx=0x7f95ac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd24db5708e8c1f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.625+0000 7f959a7fc700 1 -- 172.21.15.151:0/2764493053 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac09b0e0 con 0x55fee8570660 2023-07-21T22:41:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.625+0000 7f959a7fc700 1 -- 172.21.15.151:0/2764493053 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95ac09f110 con 0x55fee8570660 2023-07-21T22:41:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.625+0000 7f959a7fc700 1 -- 172.21.15.151:0/2764493053 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac09b340 con 0x55fee8570660 2023-07-21T22:41:18.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.625+0000 7f95cd316b80 1 -- 172.21.15.151:0/2764493053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 msgr2=0x55fee85760c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.625+0000 7f95cd316b80 1 --2- 172.21.15.151:0/2764493053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee85760c0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f95ac007fd0 tx=0x7f95ac009040 comp rx=0 tx=0).stop 2023-07-21T22:41:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.626+0000 7f95cd316b80 1 -- 172.21.15.151:0/2764493053 shutdown_connections 2023-07-21T22:41:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.626+0000 7f95cd316b80 1 --2- 172.21.15.151:0/2764493053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 0x55fee856f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.626+0000 7f95cd316b80 1 --2- 172.21.15.151:0/2764493053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee85760c0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.626+0000 7f95cd316b80 1 --2- 172.21.15.151:0/2764493053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee8573020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.626+0000 7f95cd316b80 1 -- 172.21.15.151:0/2764493053 >> 172.21.15.151:0/2764493053 conn(0x55fee855fae0 msgr2=0x55fee8570a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.626+0000 7f95cd316b80 1 -- 172.21.15.151:0/2764493053 shutdown_connections 2023-07-21T22:41:18.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.626+0000 7f95cd316b80 1 -- 172.21.15.151:0/2764493053 wait complete. 2023-07-21T22:41:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.626+0000 7f95cd316b80 1 -- start start 2023-07-21T22:41:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.626+0000 7f95cd316b80 1 Processor -- start 2023-07-21T22:41:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 0x55fee856cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee856b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95cd316b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee856bc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95cd316b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee856d3c0 con 0x55fee8570660 2023-07-21T22:41:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95cd316b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee856d530 con 0x55fee83c66b0 2023-07-21T22:41:18.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95cd316b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fee856c1e0 con 0x55fee8570210 2023-07-21T22:41:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95cd316b80 10 client.0 _ll_register_callbacks cb 0x7f95ac003ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee856b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee856b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42170/0 (socket says 172.21.15.151:42170) 2023-07-21T22:41:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b27fc700 1 -- 172.21.15.151:0/3211218383 learned_addr learned my addr 172.21.15.151:0/3211218383 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 0x55fee856cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b37fe700 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee856bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.673 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b27fc700 1 -- 172.21.15.151:0/3211218383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 msgr2=0x55fee856cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b27fc700 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 0x55fee856cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b27fc700 1 -- 172.21.15.151:0/3211218383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 msgr2=0x55fee856bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b27fc700 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee856bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.627+0000 7f95b27fc700 1 -- 172.21.15.151:0/3211218383 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ac02c070 con 0x55fee8570210 2023-07-21T22:41:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.628+0000 7f95b27fc700 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee856b730 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55fee8565ee0 tx=0x7f95a8009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b7849527e4bcdc5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.628+0000 7f9592ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:41:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.628+0000 7f9592ffd700 1 -- 172.21.15.151:0/3211218383 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95a8030070 con 0x55fee8570210 2023-07-21T22:41:18.674 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.628+0000 7f9592ffd700 1 -- 172.21.15.151:0/3211218383 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f95a80044b0 con 0x55fee8570210 2023-07-21T22:41:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.628+0000 7f95cd316b80 1 -- 172.21.15.151:0/3211218383 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f95a4019c20 con 0x55fee8570210 2023-07-21T22:41:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.628+0000 7f9592ffd700 1 -- 172.21.15.151:0/3211218383 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95a8016040 con 0x55fee8570210 2023-07-21T22:41:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.628+0000 7f95cd316b80 10 client.27796 fetch_fsmap learned FSMap version 81 2023-07-21T22:41:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.628+0000 7f95cd316b80 1 -- 172.21.15.151:0/3211218383 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) v3 -- 0x55fee83101f0 con 0x55fee8570210 2023-07-21T22:41:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.628+0000 7f9592ffd700 1 -- 172.21.15.151:0/3211218383 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95a8042020 con 0x55fee8570210 2023-07-21T22:41:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.629+0000 7f9592ffd700 1 -- 172.21.15.151:0/3211218383 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 81) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f95a800fb40 con 0x55fee8570210 2023-07-21T22:41:18.675 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.629+0000 7f95cd316b80 10 client.27796 fetch_fsmap finished waiting for FSMap version 81 2023-07-21T22:41:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.629+0000 7f95cd316b80 10 client.27796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.629+0000 7f95cd316b80 20 client.27796 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.629+0000 7f95cd316b80 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee85d8af0 0x55fee85daf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.629+0000 7f95cd316b80 4 client.27796 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:41:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.629+0000 7f95cd316b80 1 -- 172.21.15.151:0/3211218383 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fee8476ff0 con 0x55fee85d8af0 2023-07-21T22:41:18.676 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.629+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee85d8af0 0x55fee85daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.630+0000 7f9592ffd700 10 client.27796 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:18.677 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.630+0000 7f95b2ffd700 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee85d8af0 0x55fee85daf00 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=62a3c4f5d1223ce3 server_cookie=2c7ef2afd2e2e7d1 in_seq=0 out_seq=0 2023-07-21T22:41:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.639+0000 7f9592ffd700 1 -- 172.21.15.151:0/3211218383 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fee8476ff0 con 0x55fee85d8af0 2023-07-21T22:41:18.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.639+0000 7f9592ffd700 10 client.27796 handle_command_reply: tid=0 2023-07-21T22:41:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.639+0000 7f95cd316b80 1 client.27796 shutdown 2023-07-21T22:41:18.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 -- 172.21.15.151:0/3211218383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 msgr2=0x55fee856b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee856b730 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x55fee8565ee0 tx=0x7f95a8009260 comp rx=0 tx=0).stop 2023-07-21T22:41:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 -- 172.21.15.151:0/3211218383 shutdown_connections 2023-07-21T22:41:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fee85d8af0 0x55fee85daf00 crc :-1 s=READY pgs=295 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fee83c66b0 0x55fee856cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fee8570660 0x55fee856bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 --2- 172.21.15.151:0/3211218383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fee8570210 0x55fee856b730 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f9592ffd700 0 client.27796 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:18.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 -- 172.21.15.151:0/3211218383 >> 172.21.15.151:0/3211218383 conn(0x55fee855fae0 msgr2=0x55fee856f020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 -- 172.21.15.151:0/3211218383 shutdown_connections 2023-07-21T22:41:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 1 -- 172.21.15.151:0/3211218383 wait complete. 2023-07-21T22:41:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.640+0000 7f95cd316b80 20 client.27796 trim_cache size 0 max 16384 2023-07-21T22:41:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:41:18.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:41:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:41:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:41:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 -- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f959c0a12c0 msgr2=0x7f959c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:18.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f959c0a12c0 0x7f959c0a3770 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009fd0 tx=0x7f95a8009d80 comp rx=0 tx=0).stop 2023-07-21T22:41:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 -- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95b4105b60 msgr2=0x7f95b419c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95b4105b60 0x7f95b419c990 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f95ac00b070 tx=0x7f95ac00bce0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 -- 172.21.15.151:0/3446987407 shutdown_connections 2023-07-21T22:41:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f959c0a12c0 0x7f959c0a3770 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b40ffb30 0x7f95b4197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95b4105b60 0x7f95b419c990 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 --2- 172.21.15.151:0/3446987407 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95b41004e0 0x7f95b4198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:18.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 -- 172.21.15.151:0/3446987407 >> 172.21.15.151:0/3446987407 conn(0x7f95b40fb5f0 msgr2=0x7f95b410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:18.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 -- 172.21.15.151:0/3446987407 shutdown_connections 2023-07-21T22:41:18.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:18.641+0000 7f95b99ff700 1 -- 172.21.15.151:0/3446987407 wait complete. 2023-07-21T22:41:18.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:18 smithi187 ceph-mon[96918]: pgmap v698: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 MiB/s wr, 436 op/s 2023-07-21T22:41:18.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:18 smithi195 ceph-mon[97365]: pgmap v698: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 MiB/s wr, 436 op/s 2023-07-21T22:41:18.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:18 smithi151 ceph-mon[95510]: pgmap v698: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 3.3 MiB/s wr, 436 op/s 2023-07-21T22:41:20.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:20 smithi187 ceph-mon[96918]: pgmap v699: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 363 op/s 2023-07-21T22:41:20.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:20 smithi195 ceph-mon[97365]: pgmap v699: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 363 op/s 2023-07-21T22:41:20.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:20 smithi151 ceph-mon[95510]: pgmap v699: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 2.8 MiB/s wr, 363 op/s 2023-07-21T22:41:22.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:22 smithi187 ceph-mon[96918]: pgmap v700: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.7 MiB/s wr, 349 op/s 2023-07-21T22:41:22.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:22 smithi195 ceph-mon[97365]: pgmap v700: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.7 MiB/s wr, 349 op/s 2023-07-21T22:41:22.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:22 smithi151 ceph-mon[95510]: pgmap v700: 97 pgs: 97 active+clean; 8.7 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 2.7 MiB/s wr, 349 op/s 2023-07-21T22:41:24.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:24 smithi187 ceph-mon[96918]: pgmap v701: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 349 op/s 2023-07-21T22:41:24.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:24 smithi195 ceph-mon[97365]: pgmap v701: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 349 op/s 2023-07-21T22:41:24.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:24 smithi151 ceph-mon[95510]: pgmap v701: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 349 op/s 2023-07-21T22:41:26.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:26 smithi187 ceph-mon[96918]: pgmap v702: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 349 op/s 2023-07-21T22:41:26.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:26 smithi195 ceph-mon[97365]: pgmap v702: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 349 op/s 2023-07-21T22:41:26.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:26 smithi151 ceph-mon[95510]: pgmap v702: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.7 MiB/s wr, 349 op/s 2023-07-21T22:41:28.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:28 smithi187 ceph-mon[96918]: pgmap v703: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 488 op/s 2023-07-21T22:41:28.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:28 smithi195 ceph-mon[97365]: pgmap v703: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 488 op/s 2023-07-21T22:41:28.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:28 smithi151 ceph-mon[95510]: pgmap v703: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.7 MiB/s wr, 488 op/s 2023-07-21T22:41:30.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:30 smithi187 ceph-mon[96918]: pgmap v704: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-07-21T22:41:30.905 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:30 smithi195 ceph-mon[97365]: pgmap v704: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-07-21T22:41:30.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:30 smithi151 ceph-mon[95510]: pgmap v704: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-07-21T22:41:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.830+0000 7f85f29ff700 1 -- 172.21.15.151:0/2536803814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec105b60 msgr2=0x7f85ec105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:31.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.830+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2536803814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec105b60 0x7f85ec105f30 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f85dc009990 tx=0x7f85dc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.830+0000 7f85f29ff700 1 -- 172.21.15.151:0/2536803814 shutdown_connections 2023-07-21T22:41:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.830+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2536803814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec1004e0 0x7f85ec10c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.830+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2536803814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec105b60 0x7f85ec105f30 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.830+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2536803814 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec0ffb30 0x7f85ec0fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.830+0000 7f85f29ff700 1 -- 172.21.15.151:0/2536803814 >> 172.21.15.151:0/2536803814 conn(0x7f85ec0fb5f0 msgr2=0x7f85ec0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:31.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.830+0000 7f85f29ff700 1 -- 172.21.15.151:0/2536803814 shutdown_connections 2023-07-21T22:41:31.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.830+0000 7f85f29ff700 1 -- 172.21.15.151:0/2536803814 wait complete. 2023-07-21T22:41:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.831+0000 7f85f29ff700 1 Processor -- start 2023-07-21T22:41:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.832+0000 7f85f29ff700 1 -- start start 2023-07-21T22:41:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.832+0000 7f85f29ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec0ffb30 0x7f85ec197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.832+0000 7f85f29ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec1004e0 0x7f85ec198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.832+0000 7f85f29ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec105b60 0x7f85ec19b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.832+0000 7f85f29ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec19bdc0 con 0x7f85ec0ffb30 2023-07-21T22:41:31.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.832+0000 7f85f29ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec19bf30 con 0x7f85ec1004e0 2023-07-21T22:41:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.832+0000 7f85f29ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ec19c0f0 con 0x7f85ec105b60 2023-07-21T22:41:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85ebfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec0ffb30 0x7f85ec197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85ebfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec0ffb30 0x7f85ec197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33198/0 (socket says 172.21.15.151:33198) 2023-07-21T22:41:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85ebfff700 1 -- 172.21.15.151:0/2482051458 learned_addr learned my addr 172.21.15.151:0/2482051458 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85f0f9c700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec105b60 0x7f85ec19b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec1004e0 0x7f85ec198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85ebfff700 1 -- 172.21.15.151:0/2482051458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec105b60 msgr2=0x7f85ec19b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:31.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85ebfff700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec105b60 0x7f85ec19b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85ebfff700 1 -- 172.21.15.151:0/2482051458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec1004e0 msgr2=0x7f85ec198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85ebfff700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec1004e0 0x7f85ec198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85ebfff700 1 -- 172.21.15.151:0/2482051458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85dc0095f0 con 0x7f85ec0ffb30 2023-07-21T22:41:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.833+0000 7f85ebfff700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec0ffb30 0x7f85ec197cc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0036c0 tx=0x7f85dc005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.834+0000 7f85e97fa700 1 -- 172.21.15.151:0/2482051458 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc01d070 con 0x7f85ec0ffb30 2023-07-21T22:41:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.834+0000 7f85e97fa700 1 -- 172.21.15.151:0/2482051458 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85dc003f40 con 0x7f85ec0ffb30 2023-07-21T22:41:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.834+0000 7f85f29ff700 1 -- 172.21.15.151:0/2482051458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85ec19c370 con 0x7f85ec0ffb30 2023-07-21T22:41:31.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.834+0000 7f85e97fa700 1 -- 172.21.15.151:0/2482051458 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85dc022c40 con 0x7f85ec0ffb30 2023-07-21T22:41:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.834+0000 7f85f29ff700 1 -- 172.21.15.151:0/2482051458 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85ec1a4d30 con 0x7f85ec0ffb30 2023-07-21T22:41:31.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.837+0000 7f85e97fa700 1 -- 172.21.15.151:0/2482051458 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f85dc022470 con 0x7f85ec0ffb30 2023-07-21T22:41:31.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.839+0000 7f85e97fa700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f85d40a1340 0x7f85d40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.839+0000 7f85e97fa700 1 -- 172.21.15.151:0/2482051458 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f85dc0ce150 con 0x7f85ec0ffb30 2023-07-21T22:41:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.839+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f85d40a1340 0x7f85d40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.839+0000 7f86062dcb80 1 Processor -- start 2023-07-21T22:41:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.839+0000 7f86062dcb80 1 -- start start 2023-07-21T22:41:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f85d40a1340 0x7f85d40a37f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f85e0005950 tx=0x7f85e00058e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6afcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0660 0x55dc3a6aa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f86062dcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a5afc50 con 0x55dc3a6b0660 2023-07-21T22:41:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f86062dcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a6029e0 con 0x55dc3a5066b0 2023-07-21T22:41:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f86062dcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a5fbe70 con 0x55dc3a6b0210 2023-07-21T22:41:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6a9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57550/0 (socket says 172.21.15.151:57550) 2023-07-21T22:41:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f85f0f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0660 0x55dc3a6aa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f85eb7fe700 1 -- 172.21.15.151:0/1140728253 learned_addr learned my addr 172.21.15.151:0/1140728253 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f85ebfff700 1 --2- 172.21.15.151:0/1140728253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6afcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f85eb7fe700 1 -- 172.21.15.151:0/1140728253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 msgr2=0x55dc3a6afcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.840+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/1140728253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6afcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.841+0000 7f85eb7fe700 1 -- 172.21.15.151:0/1140728253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0660 msgr2=0x55dc3a6aa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.841+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/1140728253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0660 0x55dc3a6aa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.841+0000 7f85eb7fe700 1 -- 172.21.15.151:0/1140728253 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc3a429d80 con 0x55dc3a6b0210 2023-07-21T22:41:31.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.841+0000 7f85f0f9c700 1 --2- 172.21.15.151:0/1140728253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0660 0x55dc3a6aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:31.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.841+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/1140728253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6a9f40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f85e000fd10 tx=0x7f85e0012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=287d561bd74d6ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.841+0000 7f85d27fc700 1 -- 172.21.15.151:0/1140728253 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e0011ad0 con 0x55dc3a6b0210 2023-07-21T22:41:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.841+0000 7f85d27fc700 1 -- 172.21.15.151:0/1140728253 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85e0011c30 con 0x55dc3a6b0210 2023-07-21T22:41:31.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.841+0000 7f85d27fc700 1 -- 172.21.15.151:0/1140728253 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e001d610 con 0x55dc3a6b0210 2023-07-21T22:41:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.842+0000 7f86062dcb80 1 -- 172.21.15.151:0/1140728253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 msgr2=0x55dc3a6a9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.842+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1140728253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6a9f40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f85e000fd10 tx=0x7f85e0012000 comp rx=0 tx=0).stop 2023-07-21T22:41:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.842+0000 7f86062dcb80 1 -- 172.21.15.151:0/1140728253 shutdown_connections 2023-07-21T22:41:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.842+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1140728253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6afcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.842+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1140728253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0660 0x55dc3a6aa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.842+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1140728253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6a9f40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.842+0000 7f86062dcb80 1 -- 172.21.15.151:0/1140728253 >> 172.21.15.151:0/1140728253 conn(0x55dc3a69fae0 msgr2=0x55dc3a6a50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.842+0000 7f86062dcb80 1 -- 172.21.15.151:0/1140728253 shutdown_connections 2023-07-21T22:41:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.842+0000 7f86062dcb80 1 -- 172.21.15.151:0/1140728253 wait complete. 2023-07-21T22:41:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.843+0000 7f86062dcb80 1 -- start start 2023-07-21T22:41:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.843+0000 7f86062dcb80 1 Processor -- start 2023-07-21T22:41:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6b6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6b3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f86062dcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a59ba60 con 0x55dc3a6b0210 2023-07-21T22:41:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f86062dcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a59b760 con 0x55dc3a5066b0 2023-07-21T22:41:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f86062dcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a47f8c0 con 0x55dc3a6b0660 2023-07-21T22:41:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f86062dcb80 10 client.0 _ll_register_callbacks cb 0x55dc3a599700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6b3800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33210/0 (socket says 172.21.15.151:33210) 2023-07-21T22:41:31.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f85eb7fe700 1 -- 172.21.15.151:0/2839345307 learned_addr learned my addr 172.21.15.151:0/2839345307 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f85f0f9c700 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.844+0000 7f85ebfff700 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6b6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85eb7fe700 1 -- 172.21.15.151:0/2839345307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 msgr2=0x55dc3a6b3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:31.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85eb7fe700 1 -- 172.21.15.151:0/2839345307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 msgr2=0x55dc3a6b6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6b6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85eb7fe700 1 -- 172.21.15.151:0/2839345307 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e4007d90 con 0x55dc3a6b0210 2023-07-21T22:41:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85f0f9c700 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6b3800 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b930 tx=0x7f85e0011b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eae01ede949b9eb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:41:31.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85cb7fe700 1 -- 172.21.15.151:0/2839345307 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e002d070 con 0x55dc3a6b0210 2023-07-21T22:41:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f85cb7fe700 1 -- 172.21.15.151:0/2839345307 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f85e0005320 con 0x55dc3a6b0210 2023-07-21T22:41:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.845+0000 7f86062dcb80 1 -- 172.21.15.151:0/2839345307 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dc3a555490 con 0x55dc3a6b0210 2023-07-21T22:41:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.846+0000 7f85cb7fe700 1 -- 172.21.15.151:0/2839345307 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85e00054e0 con 0x55dc3a6b0210 2023-07-21T22:41:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.846+0000 7f86062dcb80 10 client.18105 fetch_fsmap learned FSMap version 81 2023-07-21T22:41:31.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.846+0000 7f86062dcb80 1 -- 172.21.15.151:0/2839345307 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) v3 -- 0x7f85e000f9f0 con 0x55dc3a6b0210 2023-07-21T22:41:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.846+0000 7f85cb7fe700 1 -- 172.21.15.151:0/2839345307 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dc3a555490 con 0x55dc3a6b0210 2023-07-21T22:41:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.846+0000 7f85cb7fe700 1 -- 172.21.15.151:0/2839345307 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 81) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f85e0039070 con 0x55dc3a6b0210 2023-07-21T22:41:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.846+0000 7f86062dcb80 10 client.18105 fetch_fsmap finished waiting for FSMap version 81 2023-07-21T22:41:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.846+0000 7f86062dcb80 10 client.18105 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.846+0000 7f86062dcb80 20 client.18105 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.847+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc3a6c39c0 0x55dc3a6c5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.847+0000 7f86062dcb80 4 client.18105 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:41:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.847+0000 7f86062dcb80 1 -- 172.21.15.151:0/2839345307 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dc3a5f4e50 con 0x55dc3a6c39c0 2023-07-21T22:41:31.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.847+0000 7f85ebfff700 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc3a6c39c0 0x55dc3a6c5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.847+0000 7f85cb7fe700 10 client.18105 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:31.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.847+0000 7f85ebfff700 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc3a6c39c0 0x55dc3a6c5dd0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d152e9cb6f9e1e87 server_cookie=80d0b39e884056fe in_seq=0 out_seq=0 2023-07-21T22:41:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.848+0000 7f85cb7fe700 1 -- 172.21.15.151:0/2839345307 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dc3a5f4e50 con 0x55dc3a6c39c0 2023-07-21T22:41:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.848+0000 7f85cb7fe700 10 client.18105 handle_command_reply: tid=0 2023-07-21T22:41:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.848+0000 7f86062dcb80 1 client.18105 shutdown 2023-07-21T22:41:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 -- 172.21.15.151:0/2839345307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 msgr2=0x55dc3a6b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6b3800 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f85e000b930 tx=0x7f85e0011b00 comp rx=0 tx=0).stop 2023-07-21T22:41:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 -- 172.21.15.151:0/2839345307 shutdown_connections 2023-07-21T22:41:31.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc3a6c39c0 0x55dc3a6c5dd0 crc :-1 s=READY pgs=296 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6b6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f85cb7fe700 0 client.18105 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2839345307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6b3800 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 -- 172.21.15.151:0/2839345307 >> 172.21.15.151:0/2839345307 conn(0x55dc3a69fae0 msgr2=0x55dc3a6a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 -- 172.21.15.151:0/2839345307 shutdown_connections 2023-07-21T22:41:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 1 -- 172.21.15.151:0/2839345307 wait complete. 2023-07-21T22:41:31.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.849+0000 7f86062dcb80 20 client.18105 trim_cache size 0 max 16384 2023-07-21T22:41:31.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.866+0000 7f86062dcb80 1 Processor -- start 2023-07-21T22:41:31.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.866+0000 7f86062dcb80 1 -- start start 2023-07-21T22:41:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.866+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6a9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.866+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6baba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.866+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.866+0000 7f86062dcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a5554c0 con 0x55dc3a6b0210 2023-07-21T22:41:31.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.866+0000 7f86062dcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a6a5ce0 con 0x55dc3a5066b0 2023-07-21T22:41:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.866+0000 7f86062dcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a6aad30 con 0x55dc3a6b0660 2023-07-21T22:41:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6baba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85f0f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85f0f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57580/0 (socket says 172.21.15.151:57580) 2023-07-21T22:41:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6baba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33220/0 (socket says 172.21.15.151:33220) 2023-07-21T22:41:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85f0f9c700 1 -- 172.21.15.151:0/2688380165 learned_addr learned my addr 172.21.15.151:0/2688380165 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:31.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85ebfff700 1 --2- 172.21.15.151:0/2688380165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6a9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85f0f9c700 1 -- 172.21.15.151:0/2688380165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 msgr2=0x55dc3a6a9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85f0f9c700 1 --2- 172.21.15.151:0/2688380165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6a9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85f0f9c700 1 -- 172.21.15.151:0/2688380165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 msgr2=0x55dc3a6baba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85f0f9c700 1 --2- 172.21.15.151:0/2688380165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6baba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85f0f9c700 1 -- 172.21.15.151:0/2688380165 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dc3a412c00 con 0x55dc3a6b0660 2023-07-21T22:41:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.867+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/2688380165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6baba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.868+0000 7f85f0f9c700 1 --2- 172.21.15.151:0/2688380165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b11b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85e4004a60 tx=0x7f85e4010b00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17056cd86e449959 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.868+0000 7f85d2ffd700 1 -- 172.21.15.151:0/2688380165 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e40166f0 con 0x55dc3a6b0660 2023-07-21T22:41:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.868+0000 7f85d2ffd700 1 -- 172.21.15.151:0/2688380165 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85e4016ce0 con 0x55dc3a6b0660 2023-07-21T22:41:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.868+0000 7f85d2ffd700 1 -- 172.21.15.151:0/2688380165 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e4015e40 con 0x55dc3a6b0660 2023-07-21T22:41:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 -- 172.21.15.151:0/2688380165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 msgr2=0x55dc3a6b11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2688380165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b11b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f85e4004a60 tx=0x7f85e4010b00 comp rx=0 tx=0).stop 2023-07-21T22:41:31.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 -- 172.21.15.151:0/2688380165 shutdown_connections 2023-07-21T22:41:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2688380165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a5066b0 0x55dc3a6a9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2688380165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0660 0x55dc3a6b11b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 --2- 172.21.15.151:0/2688380165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a6b0210 0x55dc3a6baba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 -- 172.21.15.151:0/2688380165 >> 172.21.15.151:0/2688380165 conn(0x55dc3a69fae0 msgr2=0x55dc3a6b0aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 -- 172.21.15.151:0/2688380165 shutdown_connections 2023-07-21T22:41:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 -- 172.21.15.151:0/2688380165 wait complete. 2023-07-21T22:41:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.869+0000 7f86062dcb80 1 -- start start 2023-07-21T22:41:31.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f86062dcb80 1 Processor -- start 2023-07-21T22:41:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a5066b0 0x55dc3a6acbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6ab730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f86062dcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a6b0660 0x55dc3a6abc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f86062dcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a6ad200 con 0x55dc3a5066b0 2023-07-21T22:41:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f86062dcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a6ad370 con 0x55dc3a6b0660 2023-07-21T22:41:31.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f86062dcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dc3a6ac1b0 con 0x55dc3a6b0210 2023-07-21T22:41:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f86062dcb80 10 client.0 _ll_register_callbacks cb 0x7f85e4007c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f85ebfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a5066b0 0x55dc3a6acbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6ab730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f85eb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6ab730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57584/0 (socket says 172.21.15.151:57584) 2023-07-21T22:41:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.870+0000 7f85eb7fe700 1 -- 172.21.15.151:0/1005718862 learned_addr learned my addr 172.21.15.151:0/1005718862 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85f0f9c700 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a6b0660 0x55dc3a6abc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85eb7fe700 1 -- 172.21.15.151:0/1005718862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a6b0660 msgr2=0x55dc3a6abc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a6b0660 0x55dc3a6abc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85eb7fe700 1 -- 172.21.15.151:0/1005718862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a5066b0 msgr2=0x55dc3a6acbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a5066b0 0x55dc3a6acbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85eb7fe700 1 -- 172.21.15.151:0/1005718862 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85e000f9f0 con 0x55dc3a6b0210 2023-07-21T22:41:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85ebfff700 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a5066b0 0x55dc3a6acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85eb7fe700 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6ab730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55dc3a6a5ee0 tx=0x7f85e000b440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e539c8cdd478f12a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85cb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:41:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85cb7fe700 1 -- 172.21.15.151:0/1005718862 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e002d040 con 0x55dc3a6b0210 2023-07-21T22:41:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f85cb7fe700 1 -- 172.21.15.151:0/1005718862 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f85e0010450 con 0x55dc3a6b0210 2023-07-21T22:41:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.871+0000 7f86062dcb80 1 -- 172.21.15.151:0/1005718862 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f85e0011c30 con 0x55dc3a6b0210 2023-07-21T22:41:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f85cb7fe700 1 -- 172.21.15.151:0/1005718862 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85e00048d0 con 0x55dc3a6b0210 2023-07-21T22:41:31.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f86062dcb80 10 client.27814 fetch_fsmap learned FSMap version 81 2023-07-21T22:41:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f86062dcb80 1 -- 172.21.15.151:0/1005718862 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) v3 -- 0x7f85e40107e0 con 0x55dc3a6b0210 2023-07-21T22:41:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f85cb7fe700 1 -- 172.21.15.151:0/1005718862 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f85e0011c30 con 0x55dc3a6b0210 2023-07-21T22:41:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f85cb7fe700 1 -- 172.21.15.151:0/1005718862 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 81) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f85e0039070 con 0x55dc3a6b0210 2023-07-21T22:41:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f86062dcb80 10 client.27814 fetch_fsmap finished waiting for FSMap version 81 2023-07-21T22:41:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f86062dcb80 10 client.27814 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f86062dcb80 20 client.27814 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc3a718600 0x55dc3a71aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:31.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f86062dcb80 4 client.27814 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:41:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.872+0000 7f86062dcb80 1 -- 172.21.15.151:0/1005718862 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dc3a5b6ff0 con 0x55dc3a718600 2023-07-21T22:41:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.873+0000 7f85ebfff700 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc3a718600 0x55dc3a71aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.873+0000 7f85cb7fe700 10 client.27814 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:31.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.873+0000 7f85ebfff700 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc3a718600 0x55dc3a71aa10 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8bbb5ed845b44d4f server_cookie=f3bc7b58679dbd3b in_seq=0 out_seq=0 2023-07-21T22:41:31.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f85cb7fe700 1 -- 172.21.15.151:0/1005718862 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dc3a5b6ff0 con 0x55dc3a718600 2023-07-21T22:41:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f85cb7fe700 10 client.27814 handle_command_reply: tid=0 2023-07-21T22:41:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f86062dcb80 1 client.27814 shutdown 2023-07-21T22:41:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f86062dcb80 1 -- 172.21.15.151:0/1005718862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 msgr2=0x55dc3a6ab730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6ab730 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55dc3a6a5ee0 tx=0x7f85e000b440 comp rx=0 tx=0).stop 2023-07-21T22:41:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f86062dcb80 1 -- 172.21.15.151:0/1005718862 shutdown_connections 2023-07-21T22:41:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dc3a718600 0x55dc3a71aa10 crc :-1 s=READY pgs=297 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dc3a6b0660 0x55dc3a6abc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f85cb7fe700 0 client.27814 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dc3a5066b0 0x55dc3a6acbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f86062dcb80 1 --2- 172.21.15.151:0/1005718862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dc3a6b0210 0x55dc3a6ab730 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.884+0000 7f86062dcb80 1 -- 172.21.15.151:0/1005718862 >> 172.21.15.151:0/1005718862 conn(0x55dc3a69fae0 msgr2=0x55dc3a6b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.885+0000 7f86062dcb80 1 -- 172.21.15.151:0/1005718862 shutdown_connections 2023-07-21T22:41:31.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.885+0000 7f86062dcb80 1 -- 172.21.15.151:0/1005718862 wait complete. 2023-07-21T22:41:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.885+0000 7f86062dcb80 20 client.27814 trim_cache size 0 max 16384 2023-07-21T22:41:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:41:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:41:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:41:31.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:41:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.885+0000 7f85f29ff700 1 -- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f85d40a1340 msgr2=0x7f85d40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.885+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f85d40a1340 0x7f85d40a37f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f85e0005950 tx=0x7f85e00058e0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.885+0000 7f85f29ff700 1 -- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec0ffb30 msgr2=0x7f85ec197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.885+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec0ffb30 0x7f85ec197cc0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f85dc0036c0 tx=0x7f85dc005740 comp rx=0 tx=0).stop 2023-07-21T22:41:31.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.886+0000 7f85f29ff700 1 -- 172.21.15.151:0/2482051458 shutdown_connections 2023-07-21T22:41:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.886+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f85d40a1340 0x7f85d40a37f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.886+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f85ec105b60 0x7f85ec19b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.886+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85ec0ffb30 0x7f85ec197cc0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.886+0000 7f85f29ff700 1 --2- 172.21.15.151:0/2482051458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85ec1004e0 0x7f85ec198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.886+0000 7f85f29ff700 1 -- 172.21.15.151:0/2482051458 >> 172.21.15.151:0/2482051458 conn(0x7f85ec0fb5f0 msgr2=0x7f85ec0fcb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.886+0000 7f85f29ff700 1 -- 172.21.15.151:0/2482051458 shutdown_connections 2023-07-21T22:41:31.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:31.886+0000 7f85f29ff700 1 -- 172.21.15.151:0/2482051458 wait complete. 2023-07-21T22:41:32.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:32 smithi187 ceph-mon[96918]: pgmap v705: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-07-21T22:41:32.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:32 smithi195 ceph-mon[97365]: pgmap v705: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-07-21T22:41:32.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:32 smithi151 ceph-mon[95510]: pgmap v705: 97 pgs: 97 active+clean; 8.7 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-07-21T22:41:34.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:34 smithi187 ceph-mon[96918]: pgmap v706: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.4 MiB/s wr, 444 op/s 2023-07-21T22:41:34.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:34 smithi195 ceph-mon[97365]: pgmap v706: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.4 MiB/s wr, 444 op/s 2023-07-21T22:41:34.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:34 smithi151 ceph-mon[95510]: pgmap v706: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.4 MiB/s wr, 444 op/s 2023-07-21T22:41:36.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:36 smithi187 ceph-mon[96918]: pgmap v707: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-07-21T22:41:36.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:36 smithi195 ceph-mon[97365]: pgmap v707: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-07-21T22:41:36.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:36 smithi151 ceph-mon[95510]: pgmap v707: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-07-21T22:41:38.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:38 smithi195 ceph-mon[97365]: pgmap v708: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.5 MiB/s wr, 454 op/s 2023-07-21T22:41:38.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:38 smithi151 ceph-mon[95510]: pgmap v708: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.5 MiB/s wr, 454 op/s 2023-07-21T22:41:39.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:38 smithi187 ceph-mon[96918]: pgmap v708: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.5 MiB/s wr, 454 op/s 2023-07-21T22:41:40.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:40 smithi195 ceph-mon[97365]: pgmap v709: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:41:40.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:40 smithi151 ceph-mon[95510]: pgmap v709: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:41:41.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:40 smithi187 ceph-mon[96918]: pgmap v709: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:41:42.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:42 smithi195 ceph-mon[97365]: pgmap v710: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:41:42.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:42 smithi151 ceph-mon[95510]: pgmap v710: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:41:43.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:42 smithi187 ceph-mon[96918]: pgmap v710: 97 pgs: 97 active+clean; 8.7 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:41:44.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:44 smithi195 ceph-mon[97365]: pgmap v711: 97 pgs: 97 active+clean; 8.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.6 MiB/s wr, 477 op/s 2023-07-21T22:41:44.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:44 smithi151 ceph-mon[95510]: pgmap v711: 97 pgs: 97 active+clean; 8.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.6 MiB/s wr, 477 op/s 2023-07-21T22:41:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.060+0000 7f05651ff700 1 -- 172.21.15.151:0/2628916560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f056010c3f0 msgr2=0x7f056010e7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.060+0000 7f05651ff700 1 --2- 172.21.15.151:0/2628916560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f056010c3f0 0x7f056010e7d0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f055800b0a0 tx=0x7f055800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.060+0000 7f05651ff700 1 -- 172.21.15.151:0/2628916560 shutdown_connections 2023-07-21T22:41:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.060+0000 7f05651ff700 1 --2- 172.21.15.151:0/2628916560 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0560072830 0x7f0560072c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.060+0000 7f05651ff700 1 --2- 172.21.15.151:0/2628916560 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f056010c3f0 0x7f056010e7d0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.060+0000 7f05651ff700 1 --2- 172.21.15.151:0/2628916560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0560073140 0x7f056010beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.060+0000 7f05651ff700 1 -- 172.21.15.151:0/2628916560 >> 172.21.15.151:0/2628916560 conn(0x7f05600fb650 msgr2=0x7f05600fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.060+0000 7f05651ff700 1 -- 172.21.15.151:0/2628916560 shutdown_connections 2023-07-21T22:41:45.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.060+0000 7f05651ff700 1 -- 172.21.15.151:0/2628916560 wait complete. 2023-07-21T22:41:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.062+0000 7f05651ff700 1 Processor -- start 2023-07-21T22:41:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.062+0000 7f05651ff700 1 -- start start 2023-07-21T22:41:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.062+0000 7f05651ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0560072830 0x7f0560197e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.062+0000 7f05651ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0560073140 0x7f0560198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.062+0000 7f05651ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f056010c3f0 0x7f056019c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.062+0000 7f05651ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056019d030 con 0x7f0560073140 2023-07-21T22:41:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.062+0000 7f05651ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056019d1a0 con 0x7f0560072830 2023-07-21T22:41:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.062+0000 7f05651ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056019d360 con 0x7f056010c3f0 2023-07-21T22:41:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055ed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0560072830 0x7f0560197e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0560073140 0x7f0560198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f056010c3f0 0x7f056019c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055ed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0560072830 0x7f0560197e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38308/0 (socket says 172.21.15.151:38308) 2023-07-21T22:41:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055ed9d700 1 -- 172.21.15.151:0/66571699 learned_addr learned my addr 172.21.15.151:0/66571699 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055ed9d700 1 -- 172.21.15.151:0/66571699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f056010c3f0 msgr2=0x7f056019c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055ed9d700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f056010c3f0 0x7f056019c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055ed9d700 1 -- 172.21.15.151:0/66571699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0560073140 msgr2=0x7f0560198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055ed9d700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0560073140 0x7f0560198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055ed9d700 1 -- 172.21.15.151:0/66571699 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0558009d00 con 0x7f0560072830 2023-07-21T22:41:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055f59e700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f056010c3f0 0x7f056019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f055ed9d700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0560072830 0x7f0560197e40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f055000e9a0 tx=0x7f055000ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.063+0000 7f0547fff700 1 -- 172.21.15.151:0/66571699 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0550009790 con 0x7f0560072830 2023-07-21T22:41:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.064+0000 7f0547fff700 1 -- 172.21.15.151:0/66571699 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0550010430 con 0x7f0560072830 2023-07-21T22:41:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.064+0000 7f05651ff700 1 -- 172.21.15.151:0/66571699 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056019d640 con 0x7f0560072830 2023-07-21T22:41:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.064+0000 7f0547fff700 1 -- 172.21.15.151:0/66571699 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000cea0 con 0x7f0560072830 2023-07-21T22:41:45.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.064+0000 7f05651ff700 1 -- 172.21.15.151:0/66571699 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05601a4e80 con 0x7f0560072830 2023-07-21T22:41:45.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.067+0000 7f0547fff700 1 -- 172.21.15.151:0/66571699 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f05500105a0 con 0x7f0560072830 2023-07-21T22:41:45.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.068+0000 7f0547fff700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05480a12c0 0x7f05480a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.068+0000 7f0578c19b80 1 Processor -- start 2023-07-21T22:41:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.069+0000 7f0547fff700 1 -- 172.21.15.151:0/66571699 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0550014070 con 0x7f0560072830 2023-07-21T22:41:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.069+0000 7f0578c19b80 1 -- start start 2023-07-21T22:41:45.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.069+0000 7f055e59c700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05480a12c0 0x7f05480a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.069+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 0x56244ab7c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.069+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab76750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.069+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 0x56244ab76cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.069+0000 7f0578c19b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244aa73c50 con 0x56244ab7ca20 2023-07-21T22:41:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.069+0000 7f0578c19b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244aac69e0 con 0x56244a9ca6b0 2023-07-21T22:41:45.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.069+0000 7f0578c19b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244aabfe70 con 0x56244ab7ce70 2023-07-21T22:41:45.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055ed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 0x56244ab7c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055ed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 0x56244ab7c4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38316/0 (socket says 172.21.15.151:38316) 2023-07-21T22:41:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 0x56244ab76cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055ed9d700 1 -- 172.21.15.151:0/2318790098 learned_addr learned my addr 172.21.15.151:0/2318790098 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055e59c700 1 --2- 172.21.15.151:0/2318790098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab76750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055e59c700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05480a12c0 0x7f05480a3770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0560199660 tx=0x7f0554009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055f59e700 1 -- 172.21.15.151:0/2318790098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 msgr2=0x56244ab7c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055f59e700 1 --2- 172.21.15.151:0/2318790098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 0x56244ab7c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055f59e700 1 -- 172.21.15.151:0/2318790098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 msgr2=0x56244ab76750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055f59e700 1 --2- 172.21.15.151:0/2318790098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab76750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.070+0000 7f055f59e700 1 -- 172.21.15.151:0/2318790098 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56244a8edd80 con 0x56244ab7ce70 2023-07-21T22:41:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.071+0000 7f055f59e700 1 --2- 172.21.15.151:0/2318790098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 0x56244ab76cb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0558009fd0 tx=0x7f0558009ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3803bff51c509893 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.071+0000 7f05457fa700 1 -- 172.21.15.151:0/2318790098 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800e040 con 0x56244ab7ce70 2023-07-21T22:41:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.071+0000 7f05457fa700 1 -- 172.21.15.151:0/2318790098 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f05580074e0 con 0x56244ab7ce70 2023-07-21T22:41:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.071+0000 7f05457fa700 1 -- 172.21.15.151:0/2318790098 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0558005040 con 0x56244ab7ce70 2023-07-21T22:41:45.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 -- 172.21.15.151:0/2318790098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 msgr2=0x56244ab76cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 --2- 172.21.15.151:0/2318790098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 0x56244ab76cb0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0558009fd0 tx=0x7f0558009ba0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 -- 172.21.15.151:0/2318790098 shutdown_connections 2023-07-21T22:41:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 --2- 172.21.15.151:0/2318790098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 0x56244ab7c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 --2- 172.21.15.151:0/2318790098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 0x56244ab76cb0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 --2- 172.21.15.151:0/2318790098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab76750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 -- 172.21.15.151:0/2318790098 >> 172.21.15.151:0/2318790098 conn(0x56244ab63ae0 msgr2=0x56244ab690e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:45.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 -- 172.21.15.151:0/2318790098 shutdown_connections 2023-07-21T22:41:45.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 -- 172.21.15.151:0/2318790098 wait complete. 2023-07-21T22:41:45.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.072+0000 7f0578c19b80 1 -- start start 2023-07-21T22:41:45.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.073+0000 7f0578c19b80 1 Processor -- start 2023-07-21T22:41:45.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.073+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244a9ca6b0 0x56244ab85e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.073+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ca20 0x56244ab86390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.073+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ce70 0x56244ab800e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.073+0000 7f0578c19b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244aa5fa60 con 0x56244ab7ce70 2023-07-21T22:41:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.073+0000 7f0578c19b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244aa5f760 con 0x56244ab7ca20 2023-07-21T22:41:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.073+0000 7f0578c19b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244a9438c0 con 0x56244a9ca6b0 2023-07-21T22:41:45.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.073+0000 7f0578c19b80 10 client.0 _ll_register_callbacks cb 0x56244aa5d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.073+0000 7f055ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244a9ca6b0 0x56244ab85e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055ed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244a9ca6b0 0x56244ab85e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34252/0 (socket says 172.21.15.151:34252) 2023-07-21T22:41:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055ed9d700 1 -- 172.21.15.151:0/3892755246 learned_addr learned my addr 172.21.15.151:0/3892755246 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055f59e700 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ce70 0x56244ab800e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055e59c700 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ca20 0x56244ab86390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055ed9d700 1 -- 172.21.15.151:0/3892755246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ca20 msgr2=0x56244ab86390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:45.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055ed9d700 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ca20 0x56244ab86390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055ed9d700 1 -- 172.21.15.151:0/3892755246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ce70 msgr2=0x56244ab800e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055ed9d700 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ce70 0x56244ab800e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055ed9d700 1 -- 172.21.15.151:0/3892755246 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056010f3d0 con 0x56244a9ca6b0 2023-07-21T22:41:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f055ed9d700 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244a9ca6b0 0x56244ab85e50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f05500ca710 tx=0x7f0550099fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=86d4b6c5d305b83 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f0542ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:41:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f0542ff5700 1 -- 172.21.15.151:0/3892755246 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05500a2430 con 0x56244a9ca6b0 2023-07-21T22:41:45.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f0542ff5700 1 -- 172.21.15.151:0/3892755246 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f05500b82f0 con 0x56244a9ca6b0 2023-07-21T22:41:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.074+0000 7f0578c19b80 1 -- 172.21.15.151:0/3892755246 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56244aa19490 con 0x56244a9ca6b0 2023-07-21T22:41:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0542ff5700 1 -- 172.21.15.151:0/3892755246 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f05500a1fa0 con 0x56244a9ca6b0 2023-07-21T22:41:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0578c19b80 10 client.27826 fetch_fsmap learned FSMap version 82 2023-07-21T22:41:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0578c19b80 1 -- 172.21.15.151:0/3892755246 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) v3 -- 0x56244a8d6c00 con 0x56244a9ca6b0 2023-07-21T22:41:45.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0542ff5700 1 -- 172.21.15.151:0/3892755246 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56244aa19490 con 0x56244a9ca6b0 2023-07-21T22:41:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0542ff5700 1 -- 172.21.15.151:0/3892755246 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 82) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f0550098f40 con 0x56244a9ca6b0 2023-07-21T22:41:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0578c19b80 10 client.27826 fetch_fsmap finished waiting for FSMap version 82 2023-07-21T22:41:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0578c19b80 10 client.27826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0578c19b80 20 client.27826 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56244ab90360 0x56244ab92770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0578c19b80 4 client.27826 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:41:45.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.075+0000 7f0578c19b80 1 -- 172.21.15.151:0/3892755246 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56244aab8e50 con 0x56244ab90360 2023-07-21T22:41:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.076+0000 7f055e59c700 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56244ab90360 0x56244ab92770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.076+0000 7f0542ff5700 10 client.27826 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.076+0000 7f055e59c700 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56244ab90360 0x56244ab92770 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e886ed8d42939268 server_cookie=2604d7cf77d63ac7 in_seq=0 out_seq=0 2023-07-21T22:41:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0542ff5700 1 -- 172.21.15.151:0/3892755246 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56244aab8e50 con 0x56244ab90360 2023-07-21T22:41:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0542ff5700 10 client.27826 handle_command_reply: tid=0 2023-07-21T22:41:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0578c19b80 1 client.27826 shutdown 2023-07-21T22:41:45.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0578c19b80 1 -- 172.21.15.151:0/3892755246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244a9ca6b0 msgr2=0x56244ab85e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244a9ca6b0 0x56244ab85e50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f05500ca710 tx=0x7f0550099fe0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0578c19b80 1 -- 172.21.15.151:0/3892755246 shutdown_connections 2023-07-21T22:41:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56244ab90360 0x56244ab92770 crc :-1 s=READY pgs=298 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ce70 0x56244ab800e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244a9ca6b0 0x56244ab85e50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3892755246 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ca20 0x56244ab86390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0542ff5700 0 client.27826 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.077+0000 7f0578c19b80 1 -- 172.21.15.151:0/3892755246 >> 172.21.15.151:0/3892755246 conn(0x56244ab63ae0 msgr2=0x56244ab6cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.078+0000 7f0578c19b80 1 -- 172.21.15.151:0/3892755246 shutdown_connections 2023-07-21T22:41:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.078+0000 7f0578c19b80 1 -- 172.21.15.151:0/3892755246 wait complete. 2023-07-21T22:41:45.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.078+0000 7f0578c19b80 20 client.27826 trim_cache size 0 max 16384 2023-07-21T22:41:45.128 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:44 smithi187 ceph-mon[96918]: pgmap v711: 97 pgs: 97 active+clean; 8.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 3.6 MiB/s wr, 477 op/s 2023-07-21T22:41:45.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.095+0000 7f0578c19b80 1 Processor -- start 2023-07-21T22:41:45.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.095+0000 7f0578c19b80 1 -- start start 2023-07-21T22:41:45.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244a9ca6b0 0x56244ab7f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ca20 0x56244ab7fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ce70 0x56244ab7b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f0578c19b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244ab65c00 con 0x56244a9ca6b0 2023-07-21T22:41:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f0578c19b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244ab7c130 con 0x56244ab7ce70 2023-07-21T22:41:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f0578c19b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244ab771a0 con 0x56244ab7ca20 2023-07-21T22:41:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f055ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244a9ca6b0 0x56244ab7f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f055ed9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244a9ca6b0 0x56244ab7f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34766/0 (socket says 172.21.15.151:34766) 2023-07-21T22:41:45.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f055ed9d700 1 -- 172.21.15.151:0/1269159789 learned_addr learned my addr 172.21.15.151:0/1269159789 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f055e59c700 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ca20 0x56244ab7fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f055f59e700 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ce70 0x56244ab7b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f055e59c700 1 -- 172.21.15.151:0/1269159789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ce70 msgr2=0x56244ab7b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f055e59c700 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ce70 0x56244ab7b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f055e59c700 1 -- 172.21.15.151:0/1269159789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244a9ca6b0 msgr2=0x56244ab7f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.096+0000 7f055e59c700 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244a9ca6b0 0x56244ab7f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.097+0000 7f055e59c700 1 -- 172.21.15.151:0/1269159789 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56244a9141f0 con 0x56244ab7ca20 2023-07-21T22:41:45.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.097+0000 7f055ed9d700 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244a9ca6b0 0x56244ab7f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:41:45.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.097+0000 7f055e59c700 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ca20 0x56244ab7fec0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x56244ab93080 tx=0x7f0554014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da115329e693f850 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.097+0000 7f0545ffb700 1 -- 172.21.15.151:0/1269159789 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554023040 con 0x56244ab7ca20 2023-07-21T22:41:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.097+0000 7f0545ffb700 1 -- 172.21.15.151:0/1269159789 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0554011b10 con 0x56244ab7ca20 2023-07-21T22:41:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.097+0000 7f0545ffb700 1 -- 172.21.15.151:0/1269159789 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554028e90 con 0x56244ab7ca20 2023-07-21T22:41:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.098+0000 7f0578c19b80 1 -- 172.21.15.151:0/1269159789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ca20 msgr2=0x56244ab7fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:45.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.098+0000 7f0578c19b80 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ca20 0x56244ab7fec0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x56244ab93080 tx=0x7f0554014000 comp rx=0 tx=0).stop 2023-07-21T22:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.098+0000 7f0578c19b80 1 -- 172.21.15.151:0/1269159789 shutdown_connections 2023-07-21T22:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.098+0000 7f0578c19b80 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244ab7ce70 0x56244ab7b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.098+0000 7f0578c19b80 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244a9ca6b0 0x56244ab7f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.098+0000 7f0578c19b80 1 --2- 172.21.15.151:0/1269159789 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ca20 0x56244ab7fec0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.098+0000 7f0578c19b80 1 -- 172.21.15.151:0/1269159789 >> 172.21.15.151:0/1269159789 conn(0x56244ab63ae0 msgr2=0x56244ab80a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:45.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.098+0000 7f0578c19b80 1 -- 172.21.15.151:0/1269159789 shutdown_connections 2023-07-21T22:41:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.098+0000 7f0578c19b80 1 -- 172.21.15.151:0/1269159789 wait complete. 2023-07-21T22:41:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.099+0000 7f0578c19b80 1 -- start start 2023-07-21T22:41:45.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.099+0000 7f0578c19b80 1 Processor -- start 2023-07-21T22:41:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 0x56244ab85b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab86080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f0578c19b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 0x56244ab84000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f0578c19b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244ab845c0 con 0x56244ab7ca20 2023-07-21T22:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f0578c19b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244ab84730 con 0x56244a9ca6b0 2023-07-21T22:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f0578c19b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56244ab848f0 con 0x56244ab7ce70 2023-07-21T22:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f0578c19b80 10 client.0 _ll_register_callbacks cb 0x56244aa5d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:45.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab86080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab86080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34768/0 (socket says 172.21.15.151:34768) 2023-07-21T22:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055e59c700 1 -- 172.21.15.151:0/3663286866 learned_addr learned my addr 172.21.15.151:0/3663286866 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055f59e700 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 0x56244ab84000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055ed9d700 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 0x56244ab85b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055e59c700 1 -- 172.21.15.151:0/3663286866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 msgr2=0x56244ab84000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055e59c700 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 0x56244ab84000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055e59c700 1 -- 172.21.15.151:0/3663286866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 msgr2=0x56244ab85b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:45.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055e59c700 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 0x56244ab85b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.100+0000 7f055e59c700 1 -- 172.21.15.151:0/3663286866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56244a8d6c00 con 0x56244ab7ca20 2023-07-21T22:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.101+0000 7f055e59c700 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab86080 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0554005950 tx=0x7f05540283b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8032078728529110 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:45.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.101+0000 7f0542ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:41:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.101+0000 7f0542ff5700 1 -- 172.21.15.151:0/3663286866 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554023030 con 0x56244ab7ca20 2023-07-21T22:41:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.101+0000 7f0578c19b80 1 -- 172.21.15.151:0/3663286866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f05580074e0 con 0x56244ab7ca20 2023-07-21T22:41:45.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.101+0000 7f0542ff5700 1 -- 172.21.15.151:0/3663286866 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0554028d70 con 0x56244ab7ca20 2023-07-21T22:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.101+0000 7f0542ff5700 1 -- 172.21.15.151:0/3663286866 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) v2 ==== 24+0+0 (secure 0 0 0) 0x7f055401da50 con 0x56244ab7ca20 2023-07-21T22:41:45.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.101+0000 7f0578c19b80 10 client.18129 fetch_fsmap learned FSMap version 82 2023-07-21T22:41:45.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.101+0000 7f0578c19b80 1 -- 172.21.15.151:0/3663286866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) v3 -- 0x7f0554017070 con 0x56244ab7ca20 2023-07-21T22:41:45.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.102+0000 7f0542ff5700 1 -- 172.21.15.151:0/3663286866 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f055403f020 con 0x56244ab7ca20 2023-07-21T22:41:45.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.102+0000 7f0542ff5700 1 -- 172.21.15.151:0/3663286866 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 82) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f055402e070 con 0x56244ab7ca20 2023-07-21T22:41:45.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.102+0000 7f0578c19b80 10 client.18129 fetch_fsmap finished waiting for FSMap version 82 2023-07-21T22:41:45.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.102+0000 7f0578c19b80 10 client.18129 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:45.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.102+0000 7f0578c19b80 20 client.18129 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:45.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.102+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56244abe5320 0x56244abe7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:45.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.102+0000 7f0578c19b80 4 client.18129 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:41:45.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.102+0000 7f0578c19b80 1 -- 172.21.15.151:0/3663286866 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56244aa7aff0 con 0x56244abe5320 2023-07-21T22:41:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.102+0000 7f055ed9d700 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56244abe5320 0x56244abe7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.103+0000 7f0542ff5700 10 client.18129 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:45.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.103+0000 7f055ed9d700 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56244abe5320 0x56244abe7730 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962a9a2735352b7f server_cookie=4de0b5da0004757f in_seq=0 out_seq=0 2023-07-21T22:41:45.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.114+0000 7f0542ff5700 1 -- 172.21.15.151:0/3663286866 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56244aa7aff0 con 0x56244abe5320 2023-07-21T22:41:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0542ff5700 10 client.18129 handle_command_reply: tid=0 2023-07-21T22:41:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 client.18129 shutdown 2023-07-21T22:41:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 -- 172.21.15.151:0/3663286866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 msgr2=0x56244ab86080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab86080 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f0554005950 tx=0x7f05540283b0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 -- 172.21.15.151:0/3663286866 shutdown_connections 2023-07-21T22:41:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56244abe5320 0x56244abe7730 crc :-1 s=READY pgs=299 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56244a9ca6b0 0x56244ab85b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0542ff5700 0 client.18129 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56244ab7ce70 0x56244ab84000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 --2- 172.21.15.151:0/3663286866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56244ab7ca20 0x56244ab86080 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 -- 172.21.15.151:0/3663286866 >> 172.21.15.151:0/3663286866 conn(0x56244ab63ae0 msgr2=0x56244ab67b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 -- 172.21.15.151:0/3663286866 shutdown_connections 2023-07-21T22:41:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 1 -- 172.21.15.151:0/3663286866 wait complete. 2023-07-21T22:41:45.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.115+0000 7f0578c19b80 20 client.18129 trim_cache size 0 max 16384 2023-07-21T22:41:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:41:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:41:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:41:45.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:41:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 -- 172.21.15.151:0/66571699 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05480a12c0 msgr2=0x7f05480a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05480a12c0 0x7f05480a3770 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f0560199660 tx=0x7f0554009260 comp rx=0 tx=0).stop 2023-07-21T22:41:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 -- 172.21.15.151:0/66571699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0560072830 msgr2=0x7f0560197e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0560072830 0x7f0560197e40 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f055000e9a0 tx=0x7f055000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 -- 172.21.15.151:0/66571699 shutdown_connections 2023-07-21T22:41:45.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f05480a12c0 0x7f05480a3770 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0560072830 0x7f0560197e40 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f056010c3f0 0x7f056019c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 --2- 172.21.15.151:0/66571699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0560073140 0x7f0560198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:45.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 -- 172.21.15.151:0/66571699 >> 172.21.15.151:0/66571699 conn(0x7f05600fb650 msgr2=0x7f056010e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:45.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 -- 172.21.15.151:0/66571699 shutdown_connections 2023-07-21T22:41:45.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:45.116+0000 7f05651ff700 1 -- 172.21.15.151:0/66571699 wait complete. 2023-07-21T22:41:45.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:45 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:41:45.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:45 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:41:46.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:45 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:41:46.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:46 smithi195 ceph-mon[97365]: pgmap v712: 97 pgs: 97 active+clean; 8.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.5 MiB/s wr, 321 op/s 2023-07-21T22:41:46.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:46 smithi151 ceph-mon[95510]: pgmap v712: 97 pgs: 97 active+clean; 8.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.5 MiB/s wr, 321 op/s 2023-07-21T22:41:47.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:46 smithi187 ceph-mon[96918]: pgmap v712: 97 pgs: 97 active+clean; 8.8 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.5 MiB/s wr, 321 op/s 2023-07-21T22:41:48.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:48 smithi195 ceph-mon[97365]: pgmap v713: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.7 MiB/s wr, 482 op/s 2023-07-21T22:41:48.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:48 smithi151 ceph-mon[95510]: pgmap v713: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.7 MiB/s wr, 482 op/s 2023-07-21T22:41:49.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:48 smithi187 ceph-mon[96918]: pgmap v713: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 3.7 MiB/s wr, 482 op/s 2023-07-21T22:41:50.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:50 smithi151 ceph-mon[95510]: pgmap v714: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 325 op/s 2023-07-21T22:41:50.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:50 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:41:51.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:50 smithi187 ceph-mon[96918]: pgmap v714: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 325 op/s 2023-07-21T22:41:51.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:50 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:41:51.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:50 smithi195 ceph-mon[97365]: pgmap v714: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 325 op/s 2023-07-21T22:41:51.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:50 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:41:52.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:52 smithi187 ceph-mon[96918]: pgmap v715: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 325 op/s 2023-07-21T22:41:52.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:52 smithi195 ceph-mon[97365]: pgmap v715: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 325 op/s 2023-07-21T22:41:52.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:52 smithi151 ceph-mon[95510]: pgmap v715: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 2.5 MiB/s wr, 325 op/s 2023-07-21T22:41:54.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:54 smithi187 ceph-mon[96918]: pgmap v716: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.6 MiB/s wr, 468 op/s 2023-07-21T22:41:54.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:54 smithi195 ceph-mon[97365]: pgmap v716: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.6 MiB/s wr, 468 op/s 2023-07-21T22:41:54.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:54 smithi151 ceph-mon[95510]: pgmap v716: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.6 MiB/s wr, 468 op/s 2023-07-21T22:41:56.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:56 smithi187 ceph-mon[96918]: pgmap v717: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.3 MiB/s wr, 304 op/s 2023-07-21T22:41:56.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:56 smithi195 ceph-mon[97365]: pgmap v717: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.3 MiB/s wr, 304 op/s 2023-07-21T22:41:56.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:56 smithi151 ceph-mon[95510]: pgmap v717: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.3 MiB/s wr, 304 op/s 2023-07-21T22:41:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.287+0000 7effc1bff700 1 -- 172.21.15.151:0/897703822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc1004b0 msgr2=0x7effbc10c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:58.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.287+0000 7effc1bff700 1 --2- 172.21.15.151:0/897703822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc1004b0 0x7effbc10c940 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7effb400b0a0 tx=0x7effb400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.287+0000 7effc1bff700 1 -- 172.21.15.151:0/897703822 shutdown_connections 2023-07-21T22:41:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.287+0000 7effc1bff700 1 --2- 172.21.15.151:0/897703822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effbc105b10 0x7effbc105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.287+0000 7effc1bff700 1 --2- 172.21.15.151:0/897703822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc1004b0 0x7effbc10c940 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.287+0000 7effc1bff700 1 --2- 172.21.15.151:0/897703822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc0ffb00 0x7effbc0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.287+0000 7effc1bff700 1 -- 172.21.15.151:0/897703822 >> 172.21.15.151:0/897703822 conn(0x7effbc0fb600 msgr2=0x7effbc0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.287+0000 7effc1bff700 1 -- 172.21.15.151:0/897703822 shutdown_connections 2023-07-21T22:41:58.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.287+0000 7effc1bff700 1 -- 172.21.15.151:0/897703822 wait complete. 2023-07-21T22:41:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.289+0000 7effc1bff700 1 Processor -- start 2023-07-21T22:41:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.289+0000 7effc1bff700 1 -- start start 2023-07-21T22:41:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.289+0000 7effc1bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effbc0ffb00 0x7effbc197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.289+0000 7effc1bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1004b0 0x7effbc198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.289+0000 7effc1bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc105b10 0x7effbc19c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.289+0000 7effc1bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc19cfe0 con 0x7effbc105b10 2023-07-21T22:41:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.289+0000 7effc1bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc19d150 con 0x7effbc0ffb00 2023-07-21T22:41:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.289+0000 7effc1bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc19d310 con 0x7effbc1004b0 2023-07-21T22:41:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.289+0000 7effbbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc105b10 0x7effbc19c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc105b10 0x7effbc19c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56462/0 (socket says 172.21.15.151:56462) 2023-07-21T22:41:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1004b0 0x7effbc198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbbfff700 1 -- 172.21.15.151:0/267127263 learned_addr learned my addr 172.21.15.151:0/267127263 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbb7fe700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effbc0ffb00 0x7effbc197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbbfff700 1 -- 172.21.15.151:0/267127263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1004b0 msgr2=0x7effbc198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbbfff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1004b0 0x7effbc198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbbfff700 1 -- 172.21.15.151:0/267127263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effbc0ffb00 msgr2=0x7effbc197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbbfff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effbc0ffb00 0x7effbc197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbbfff700 1 -- 172.21.15.151:0/267127263 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb4009d00 con 0x7effbc105b10 2023-07-21T22:41:58.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effbbfff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc105b10 0x7effbc19c9a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7effb400b070 tx=0x7effb400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effb8ff9700 1 -- 172.21.15.151:0/267127263 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb400e040 con 0x7effbc105b10 2023-07-21T22:41:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effb8ff9700 1 -- 172.21.15.151:0/267127263 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effb4009480 con 0x7effbc105b10 2023-07-21T22:41:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effc1bff700 1 -- 172.21.15.151:0/267127263 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc19d590 con 0x7effbc105b10 2023-07-21T22:41:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.290+0000 7effb8ff9700 1 -- 172.21.15.151:0/267127263 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb4005040 con 0x7effbc105b10 2023-07-21T22:41:58.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.291+0000 7effc1bff700 1 -- 172.21.15.151:0/267127263 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc19d810 con 0x7effbc105b10 2023-07-21T22:41:58.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.295+0000 7effb8ff9700 1 -- 172.21.15.151:0/267127263 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7effb401d480 con 0x7effbc105b10 2023-07-21T22:41:58.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.296+0000 7effd55f8b80 1 Processor -- start 2023-07-21T22:41:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.296+0000 7effd55f8b80 1 -- start start 2023-07-21T22:41:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.296+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f0b26b0 0x56252f25bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f255f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f25c660 0x56252f2564a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effd55f8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f15bc50 con 0x56252f25c660 2023-07-21T22:41:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effd55f8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f1ae9e0 con 0x56252f25c210 2023-07-21T22:41:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effd55f8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f1a7e70 con 0x56252f0b26b0 2023-07-21T22:41:58.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effb8ff9700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7effa40a12c0 0x7effa40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f0b26b0 0x56252f25bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effb8ff9700 1 -- 172.21.15.151:0/267127263 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7effb40cddf0 con 0x7effbc105b10 2023-07-21T22:41:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f255f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f0b26b0 0x56252f25bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42366/0 (socket says 172.21.15.151:42366) 2023-07-21T22:41:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbaffd700 1 -- 172.21.15.151:0/812704164 learned_addr learned my addr 172.21.15.151:0/812704164 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbaffd700 1 --2- 172.21.15.151:0/812704164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f25c660 0x56252f2564a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbbfff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7effa40a12c0 0x7effa40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbb7fe700 1 -- 172.21.15.151:0/812704164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f0b26b0 msgr2=0x56252f25bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbb7fe700 1 --2- 172.21.15.151:0/812704164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f0b26b0 0x56252f25bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbb7fe700 1 -- 172.21.15.151:0/812704164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f25c660 msgr2=0x56252f2564a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbb7fe700 1 --2- 172.21.15.151:0/812704164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f25c660 0x56252f2564a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbb7fe700 1 -- 172.21.15.151:0/812704164 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56252efd5d80 con 0x56252f25c210 2023-07-21T22:41:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.297+0000 7effbaffd700 1 --2- 172.21.15.151:0/812704164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f25c660 0x56252f2564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:41:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.298+0000 7effbb7fe700 1 --2- 172.21.15.151:0/812704164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f255f40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7effac009cb0 tx=0x7effac0058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70d794c9ef761c62 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:58.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.298+0000 7effbbfff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7effa40a12c0 0x7effa40a3770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7effb40cb5c0 tx=0x7effb4009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.298+0000 7effa1ffb700 1 -- 172.21.15.151:0/812704164 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac011ce0 con 0x56252f25c210 2023-07-21T22:41:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.298+0000 7effa1ffb700 1 -- 172.21.15.151:0/812704164 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effac011e40 con 0x56252f25c210 2023-07-21T22:41:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.298+0000 7effa1ffb700 1 -- 172.21.15.151:0/812704164 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac005280 con 0x56252f25c210 2023-07-21T22:41:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 -- 172.21.15.151:0/812704164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 msgr2=0x56252f255f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 --2- 172.21.15.151:0/812704164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f255f40 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7effac009cb0 tx=0x7effac0058e0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 -- 172.21.15.151:0/812704164 shutdown_connections 2023-07-21T22:41:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 --2- 172.21.15.151:0/812704164 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f25c660 0x56252f2564a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 --2- 172.21.15.151:0/812704164 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f0b26b0 0x56252f25bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 --2- 172.21.15.151:0/812704164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f255f40 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 -- 172.21.15.151:0/812704164 >> 172.21.15.151:0/812704164 conn(0x56252f24bae0 msgr2=0x56252f2510e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 -- 172.21.15.151:0/812704164 shutdown_connections 2023-07-21T22:41:58.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 -- 172.21.15.151:0/812704164 wait complete. 2023-07-21T22:41:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.299+0000 7effd55f8b80 1 -- start start 2023-07-21T22:41:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effd55f8b80 1 Processor -- start 2023-07-21T22:41:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f262520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25f810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 0x56252f25fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effd55f8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f147a60 con 0x56252f0b26b0 2023-07-21T22:41:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effd55f8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f147760 con 0x56252f25c210 2023-07-21T22:41:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effd55f8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f02b8c0 con 0x56252f25c660 2023-07-21T22:41:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effd55f8b80 10 client.0 _ll_register_callbacks cb 0x56252f145700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effbaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f262520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effbaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f262520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56484/0 (socket says 172.21.15.151:56484) 2023-07-21T22:41:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.300+0000 7effbaffd700 1 -- 172.21.15.151:0/4150784832 learned_addr learned my addr 172.21.15.151:0/4150784832 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:58.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7effbaffd700 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 0x56252f25fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7effbb7fe700 1 -- 172.21.15.151:0/4150784832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 msgr2=0x56252f25fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7effbb7fe700 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 0x56252f25fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7effbb7fe700 1 -- 172.21.15.151:0/4150784832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 msgr2=0x56252f262520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7effbb7fe700 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f262520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7effbb7fe700 1 -- 172.21.15.151:0/4150784832 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effac0098e0 con 0x56252f25c210 2023-07-21T22:41:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7effbaffd700 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 0x56252f25fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:41:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7effbb7fe700 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25f810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7effac000c00 tx=0x7effac011ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0a29843c2ee98a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:58.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7eff9affd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:41:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7eff9affd700 1 -- 172.21.15.151:0/4150784832 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac004260 con 0x56252f25c210 2023-07-21T22:41:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7effd55f8b80 1 -- 172.21.15.151:0/4150784832 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56252f101490 con 0x56252f25c210 2023-07-21T22:41:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.301+0000 7eff9affd700 1 -- 172.21.15.151:0/4150784832 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7effac0043c0 con 0x56252f25c210 2023-07-21T22:41:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7eff9affd700 1 -- 172.21.15.151:0/4150784832 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7effac004580 con 0x56252f25c210 2023-07-21T22:41:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7effd55f8b80 10 client.27812 fetch_fsmap learned FSMap version 83 2023-07-21T22:41:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7effd55f8b80 1 -- 172.21.15.151:0/4150784832 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) v3 -- 0x56252efbec00 con 0x56252f25c210 2023-07-21T22:41:58.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7eff9affd700 1 -- 172.21.15.151:0/4150784832 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56252f101490 con 0x56252f25c210 2023-07-21T22:41:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7eff9affd700 1 -- 172.21.15.151:0/4150784832 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 83) v1 ==== 7486+0+0 (secure 0 0 0) 0x7effac005130 con 0x56252f25c210 2023-07-21T22:41:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7effd55f8b80 10 client.27812 fetch_fsmap finished waiting for FSMap version 83 2023-07-21T22:41:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7effd55f8b80 10 client.27812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7effd55f8b80 20 client.27812 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7effd55f8b80 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56252f26f990 0x56252f271da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7effd55f8b80 4 client.27812 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:41:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.302+0000 7effd55f8b80 1 -- 172.21.15.151:0/4150784832 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56252f1a0e50 con 0x56252f26f990 2023-07-21T22:41:58.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.303+0000 7effbaffd700 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56252f26f990 0x56252f271da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.303+0000 7effbaffd700 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56252f26f990 0x56252f271da0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6526c3bf13610236 server_cookie=38c6404ddc373e15 in_seq=0 out_seq=0 2023-07-21T22:41:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.303+0000 7eff9affd700 10 client.27812 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.304+0000 7eff9affd700 1 -- 172.21.15.151:0/4150784832 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56252f1a0e50 con 0x56252f26f990 2023-07-21T22:41:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.304+0000 7eff9affd700 10 client.27812 handle_command_reply: tid=0 2023-07-21T22:41:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.304+0000 7effd55f8b80 1 client.27812 shutdown 2023-07-21T22:41:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.304+0000 7effd55f8b80 1 -- 172.21.15.151:0/4150784832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 msgr2=0x56252f25f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:58.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.304+0000 7effd55f8b80 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25f810 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7effac000c00 tx=0x7effac011ae0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.304+0000 7effd55f8b80 1 -- 172.21.15.151:0/4150784832 shutdown_connections 2023-07-21T22:41:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.304+0000 7effd55f8b80 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56252f26f990 0x56252f271da0 crc :-1 s=READY pgs=300 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.305+0000 7effd55f8b80 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 0x56252f25fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.305+0000 7effd55f8b80 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f262520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.305+0000 7effd55f8b80 1 --2- 172.21.15.151:0/4150784832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25f810 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.305+0000 7effd55f8b80 1 -- 172.21.15.151:0/4150784832 >> 172.21.15.151:0/4150784832 conn(0x56252f24bae0 msgr2=0x56252f2503e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.305+0000 7eff9affd700 0 client.27812 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:58.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.305+0000 7effd55f8b80 1 -- 172.21.15.151:0/4150784832 shutdown_connections 2023-07-21T22:41:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.305+0000 7effd55f8b80 1 -- 172.21.15.151:0/4150784832 wait complete. 2023-07-21T22:41:58.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.305+0000 7effd55f8b80 20 client.27812 trim_cache size 0 max 16384 2023-07-21T22:41:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.320+0000 7effd55f8b80 1 Processor -- start 2023-07-21T22:41:58.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.320+0000 7effd55f8b80 1 -- start start 2023-07-21T22:41:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.320+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f266b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.320+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.320+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 0x56252f2620c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effd55f8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f257160 con 0x56252f0b26b0 2023-07-21T22:41:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effd55f8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f26c420 con 0x56252f25c210 2023-07-21T22:41:58.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effd55f8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f25de00 con 0x56252f25c660 2023-07-21T22:41:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f266b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43748/0 (socket says 172.21.15.151:43748) 2023-07-21T22:41:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbb7fe700 1 -- 172.21.15.151:0/549609175 learned_addr learned my addr 172.21.15.151:0/549609175 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f266b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56490/0 (socket says 172.21.15.151:56490) 2023-07-21T22:41:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbaffd700 1 --2- 172.21.15.151:0/549609175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 0x56252f2620c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbb7fe700 1 -- 172.21.15.151:0/549609175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 msgr2=0x56252f2620c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbb7fe700 1 --2- 172.21.15.151:0/549609175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 0x56252f2620c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbb7fe700 1 -- 172.21.15.151:0/549609175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 msgr2=0x56252f266b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbb7fe700 1 --2- 172.21.15.151:0/549609175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f266b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.321+0000 7effbb7fe700 1 -- 172.21.15.151:0/549609175 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56252f276990 con 0x56252f25c210 2023-07-21T22:41:58.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.322+0000 7effbb7fe700 1 --2- 172.21.15.151:0/549609175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25b000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7effac009290 tx=0x7effac005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=851f04a45a59977f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.322+0000 7effa27fc700 1 -- 172.21.15.151:0/549609175 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac018390 con 0x56252f25c210 2023-07-21T22:41:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.322+0000 7effa27fc700 1 -- 172.21.15.151:0/549609175 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7effac011c00 con 0x56252f25c210 2023-07-21T22:41:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.322+0000 7effa27fc700 1 -- 172.21.15.151:0/549609175 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac003680 con 0x56252f25c210 2023-07-21T22:41:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.322+0000 7effd55f8b80 1 -- 172.21.15.151:0/549609175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 msgr2=0x56252f25b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.322+0000 7effd55f8b80 1 --2- 172.21.15.151:0/549609175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25b000 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7effac009290 tx=0x7effac005a00 comp rx=0 tx=0).stop 2023-07-21T22:41:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.323+0000 7effd55f8b80 1 -- 172.21.15.151:0/549609175 shutdown_connections 2023-07-21T22:41:58.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.323+0000 7effd55f8b80 1 --2- 172.21.15.151:0/549609175 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c660 0x56252f2620c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.323+0000 7effd55f8b80 1 --2- 172.21.15.151:0/549609175 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f266b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.323+0000 7effd55f8b80 1 --2- 172.21.15.151:0/549609175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c210 0x56252f25b000 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.323+0000 7effd55f8b80 1 -- 172.21.15.151:0/549609175 >> 172.21.15.151:0/549609175 conn(0x56252f24bae0 msgr2=0x56252f25a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.323+0000 7effd55f8b80 1 -- 172.21.15.151:0/549609175 shutdown_connections 2023-07-21T22:41:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.323+0000 7effd55f8b80 1 -- 172.21.15.151:0/549609175 wait complete. 2023-07-21T22:41:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.323+0000 7effd55f8b80 1 -- start start 2023-07-21T22:41:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.323+0000 7effd55f8b80 1 Processor -- start 2023-07-21T22:41:58.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.324+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f257730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.324+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c210 0x56252f257c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.324+0000 7effd55f8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c660 0x56252f2581b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.324+0000 7effd55f8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f258880 con 0x56252f0b26b0 2023-07-21T22:41:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.324+0000 7effd55f8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f2589f0 con 0x56252f25c660 2023-07-21T22:41:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.324+0000 7effd55f8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56252f258bb0 con 0x56252f25c210 2023-07-21T22:41:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.324+0000 7effd55f8b80 10 client.0 _ll_register_callbacks cb 0x7effb0009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:41:58.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f257730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbaffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f257730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56506/0 (socket says 172.21.15.151:56506) 2023-07-21T22:41:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbaffd700 1 -- 172.21.15.151:0/2006506100 learned_addr learned my addr 172.21.15.151:0/2006506100 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:41:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbaffd700 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c660 0x56252f2581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbb7fe700 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c210 0x56252f257c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbaffd700 1 -- 172.21.15.151:0/2006506100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c210 msgr2=0x56252f257c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:58.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbaffd700 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c210 0x56252f257c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbaffd700 1 -- 172.21.15.151:0/2006506100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c660 msgr2=0x56252f2581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:41:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbaffd700 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c660 0x56252f2581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.325+0000 7effbaffd700 1 -- 172.21.15.151:0/2006506100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56252efbec00 con 0x56252f0b26b0 2023-07-21T22:41:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.326+0000 7effbaffd700 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f257730 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x56252f272640 tx=0x7effb0009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55048367e28d91de server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:41:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.326+0000 7eff9affd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:41:58.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.326+0000 7eff9affd700 1 -- 172.21.15.151:0/2006506100 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb0010a50 con 0x56252f0b26b0 2023-07-21T22:41:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.326+0000 7eff9affd700 1 -- 172.21.15.151:0/2006506100 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(120..120 src has 1..120) v4 ==== 8492+0+0 (secure 0 0 0) 0x7effb0010bb0 con 0x56252f0b26b0 2023-07-21T22:41:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.326+0000 7effd55f8b80 1 -- 172.21.15.151:0/2006506100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56252f162ff0 con 0x56252f0b26b0 2023-07-21T22:41:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.326+0000 7eff9affd700 1 -- 172.21.15.151:0/2006506100 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7effb0010d70 con 0x56252f0b26b0 2023-07-21T22:41:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.326+0000 7effd55f8b80 10 client.18147 fetch_fsmap learned FSMap version 83 2023-07-21T22:41:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.326+0000 7effd55f8b80 1 -- 172.21.15.151:0/2006506100 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) v3 -- 0x56252effc1f0 con 0x56252f0b26b0 2023-07-21T22:41:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.327+0000 7eff9affd700 1 -- 172.21.15.151:0/2006506100 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56252f162ff0 con 0x56252f0b26b0 2023-07-21T22:41:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.327+0000 7eff9affd700 1 -- 172.21.15.151:0/2006506100 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 83) v1 ==== 7486+0+0 (secure 0 0 0) 0x7effb002e060 con 0x56252f0b26b0 2023-07-21T22:41:58.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.327+0000 7effd55f8b80 10 client.18147 fetch_fsmap finished waiting for FSMap version 83 2023-07-21T22:41:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.327+0000 7effd55f8b80 10 client.18147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:41:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.327+0000 7effd55f8b80 20 client.18147 populate_metadata read hostname 'smithi151' 2023-07-21T22:41:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.327+0000 7effd55f8b80 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56252f2c44f0 0x56252f2c6900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:41:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.327+0000 7effd55f8b80 4 client.18147 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:41:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.327+0000 7effd55f8b80 1 -- 172.21.15.151:0/2006506100 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56252eff6f10 con 0x56252f2c44f0 2023-07-21T22:41:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.327+0000 7effbb7fe700 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56252f2c44f0 0x56252f2c6900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:41:58.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.328+0000 7effbb7fe700 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56252f2c44f0 0x56252f2c6900 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5452fd64d7e653a server_cookie=56a0bf4a4c5bca7e in_seq=0 out_seq=0 2023-07-21T22:41:58.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.328+0000 7eff9affd700 10 client.18147 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:58.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.341+0000 7eff9affd700 1 -- 172.21.15.151:0/2006506100 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56252eff6f10 con 0x56252f2c44f0 2023-07-21T22:41:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.341+0000 7eff9affd700 10 client.18147 handle_command_reply: tid=0 2023-07-21T22:41:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.341+0000 7effd55f8b80 1 client.18147 shutdown 2023-07-21T22:41:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 -- 172.21.15.151:0/2006506100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 msgr2=0x56252f257730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f257730 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x56252f272640 tx=0x7effb0009260 comp rx=0 tx=0).stop 2023-07-21T22:41:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 -- 172.21.15.151:0/2006506100 shutdown_connections 2023-07-21T22:41:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56252f2c44f0 0x56252f2c6900 crc :-1 s=READY pgs=301 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56252f25c660 0x56252f2581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56252f0b26b0 0x56252f257730 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7eff9affd700 0 client.18147 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:41:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 --2- 172.21.15.151:0/2006506100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56252f25c210 0x56252f257c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 -- 172.21.15.151:0/2006506100 >> 172.21.15.151:0/2006506100 conn(0x56252f24bae0 msgr2=0x56252f25b180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 -- 172.21.15.151:0/2006506100 shutdown_connections 2023-07-21T22:41:58.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 1 -- 172.21.15.151:0/2006506100 wait complete. 2023-07-21T22:41:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.342+0000 7effd55f8b80 20 client.18147 trim_cache size 0 max 16384 2023-07-21T22:41:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:41:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:41:58.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:41:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:41:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 -- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7effa40a12c0 msgr2=0x7effa40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7effa40a12c0 0x7effa40a3770 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7effb40cb5c0 tx=0x7effb4009040 comp rx=0 tx=0).stop 2023-07-21T22:41:58.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 -- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc105b10 msgr2=0x7effbc19c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:41:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc105b10 0x7effbc19c9a0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7effb400b070 tx=0x7effb400bce0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 -- 172.21.15.151:0/267127263 shutdown_connections 2023-07-21T22:41:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7effa40a12c0 0x7effa40a3770 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7effbc0ffb00 0x7effbc197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7effbc105b10 0x7effbc19c9a0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 --2- 172.21.15.151:0/267127263 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7effbc1004b0 0x7effbc198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:41:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 -- 172.21.15.151:0/267127263 >> 172.21.15.151:0/267127263 conn(0x7effbc0fb600 msgr2=0x7effbc10ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:41:58.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 -- 172.21.15.151:0/267127263 shutdown_connections 2023-07-21T22:41:58.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:41:58.343+0000 7effc1bff700 1 -- 172.21.15.151:0/267127263 wait complete. 2023-07-21T22:41:58.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:41:58 smithi187 ceph-mon[96918]: pgmap v718: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.5 MiB/s wr, 462 op/s 2023-07-21T22:41:58.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:41:58 smithi195 ceph-mon[97365]: pgmap v718: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.5 MiB/s wr, 462 op/s 2023-07-21T22:41:58.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:41:58 smithi151 ceph-mon[95510]: pgmap v718: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.5 MiB/s wr, 462 op/s 2023-07-21T22:42:00.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:00 smithi187 ceph-mon[96918]: pgmap v719: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 MiB/s wr, 301 op/s 2023-07-21T22:42:00.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:00 smithi195 ceph-mon[97365]: pgmap v719: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 MiB/s wr, 301 op/s 2023-07-21T22:42:00.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:00 smithi151 ceph-mon[95510]: pgmap v719: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 MiB/s wr, 301 op/s 2023-07-21T22:42:02.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:02 smithi187 ceph-mon[96918]: pgmap v720: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 MiB/s wr, 301 op/s 2023-07-21T22:42:02.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:02 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:42:02.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:02 smithi195 ceph-mon[97365]: pgmap v720: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 MiB/s wr, 301 op/s 2023-07-21T22:42:02.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:02 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:42:02.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:02 smithi151 ceph-mon[95510]: pgmap v720: 97 pgs: 97 active+clean; 8.8 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 2.3 MiB/s wr, 301 op/s 2023-07-21T22:42:02.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:02 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:42:03.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:03 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:42:03.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:03 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:42:03.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:03 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:42:03.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:03 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:42:03.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:03 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:42:03.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:03 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:42:03.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:03 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:42:03.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:03 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:42:03.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:03 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:42:04.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:04 smithi187 ceph-mon[96918]: pgmap v721: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.5 MiB/s wr, 464 op/s 2023-07-21T22:42:04.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:04 smithi195 ceph-mon[97365]: pgmap v721: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.5 MiB/s wr, 464 op/s 2023-07-21T22:42:04.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:04 smithi151 ceph-mon[95510]: pgmap v721: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.5 MiB/s wr, 464 op/s 2023-07-21T22:42:06.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:06 smithi187 ceph-mon[96918]: pgmap v722: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.4 MiB/s wr, 321 op/s 2023-07-21T22:42:06.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:06 smithi195 ceph-mon[97365]: pgmap v722: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.4 MiB/s wr, 321 op/s 2023-07-21T22:42:06.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:06 smithi151 ceph-mon[95510]: pgmap v722: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.4 MiB/s wr, 321 op/s 2023-07-21T22:42:08.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:08 smithi187 ceph-mon[96918]: pgmap v723: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.5 MiB/s wr, 467 op/s 2023-07-21T22:42:08.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:08 smithi195 ceph-mon[97365]: pgmap v723: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.5 MiB/s wr, 467 op/s 2023-07-21T22:42:08.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:08 smithi151 ceph-mon[95510]: pgmap v723: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.5 MiB/s wr, 467 op/s 2023-07-21T22:42:10.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:10 smithi187 ceph-mon[96918]: pgmap v724: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 2.3 MiB/s wr, 310 op/s 2023-07-21T22:42:10.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:10 smithi187 ceph-mon[96918]: osdmap e121: 12 total, 12 up, 12 in 2023-07-21T22:42:10.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:10 smithi195 ceph-mon[97365]: pgmap v724: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 2.3 MiB/s wr, 310 op/s 2023-07-21T22:42:10.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:10 smithi195 ceph-mon[97365]: osdmap e121: 12 total, 12 up, 12 in 2023-07-21T22:42:10.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:10 smithi151 ceph-mon[95510]: pgmap v724: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 2.3 MiB/s wr, 310 op/s 2023-07-21T22:42:10.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:10 smithi151 ceph-mon[95510]: osdmap e121: 12 total, 12 up, 12 in 2023-07-21T22:42:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.501+0000 7f6aa79ff700 1 -- 172.21.15.151:0/2704143337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa01004b0 msgr2=0x7f6aa010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.501+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/2704143337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa01004b0 0x7f6aa010c940 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009f90 tx=0x7f6a9800b330 comp rx=0 tx=0).stop 2023-07-21T22:42:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.502+0000 7f6aa79ff700 1 -- 172.21.15.151:0/2704143337 shutdown_connections 2023-07-21T22:42:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.502+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/2704143337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6aa0105b10 0x7f6aa0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.502+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/2704143337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa01004b0 0x7f6aa010c940 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.502+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/2704143337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6aa00ffb00 0x7f6aa00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.502+0000 7f6aa79ff700 1 -- 172.21.15.151:0/2704143337 >> 172.21.15.151:0/2704143337 conn(0x7f6aa00fb600 msgr2=0x7f6aa00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.502+0000 7f6aa79ff700 1 -- 172.21.15.151:0/2704143337 shutdown_connections 2023-07-21T22:42:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.502+0000 7f6aa79ff700 1 -- 172.21.15.151:0/2704143337 wait complete. 2023-07-21T22:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.503+0000 7f6aa79ff700 1 Processor -- start 2023-07-21T22:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.503+0000 7f6aa79ff700 1 -- start start 2023-07-21T22:42:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.503+0000 7f6aa79ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa00ffb00 0x7f6aa0197f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.503+0000 7f6aa79ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6aa01004b0 0x7f6aa0198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.503+0000 7f6aa79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6aa0105b10 0x7f6aa019cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.503+0000 7f6aa79ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa019d0f0 con 0x7f6aa00ffb00 2023-07-21T22:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.503+0000 7f6aa79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa019d260 con 0x7f6aa0105b10 2023-07-21T22:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.503+0000 7f6aa79ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6aa019d420 con 0x7f6aa01004b0 2023-07-21T22:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa00ffb00 0x7f6aa0197f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa00ffb00 0x7f6aa0197f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48014/0 (socket says 172.21.15.151:48014) 2023-07-21T22:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa579b700 1 -- 172.21.15.151:0/3923039615 learned_addr learned my addr 172.21.15.151:0/3923039615 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa5f9c700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6aa0105b10 0x7f6aa019cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa4f9a700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6aa01004b0 0x7f6aa0198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa579b700 1 -- 172.21.15.151:0/3923039615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6aa01004b0 msgr2=0x7f6aa0198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa579b700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6aa01004b0 0x7f6aa0198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa579b700 1 -- 172.21.15.151:0/3923039615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6aa0105b10 msgr2=0x7f6aa019cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa579b700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6aa0105b10 0x7f6aa019cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa579b700 1 -- 172.21.15.151:0/3923039615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a98009c40 con 0x7f6aa00ffb00 2023-07-21T22:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.504+0000 7f6aa579b700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa00ffb00 0x7f6aa0197f00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00e9c0 tx=0x7f6a9c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.505+0000 7f6a967fc700 1 -- 172.21.15.151:0/3923039615 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c004a30 con 0x7f6aa00ffb00 2023-07-21T22:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.505+0000 7f6aa79ff700 1 -- 172.21.15.151:0/3923039615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6aa019d700 con 0x7f6aa00ffb00 2023-07-21T22:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.505+0000 7f6a967fc700 1 -- 172.21.15.151:0/3923039615 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a9c00cc50 con 0x7f6aa00ffb00 2023-07-21T22:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.505+0000 7f6a967fc700 1 -- 172.21.15.151:0/3923039615 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c005410 con 0x7f6aa00ffb00 2023-07-21T22:42:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.505+0000 7f6aa79ff700 1 -- 172.21.15.151:0/3923039615 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa01a4f40 con 0x7f6aa00ffb00 2023-07-21T22:42:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.509+0000 7f6a967fc700 1 -- 172.21.15.151:0/3923039615 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6a9c005570 con 0x7f6aa00ffb00 2023-07-21T22:42:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.510+0000 7f6abb311b80 1 Processor -- start 2023-07-21T22:42:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.510+0000 7f6abb311b80 1 -- start start 2023-07-21T22:42:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 0x55caf8745cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 0x55caf873ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8746660 0x55caf87404a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6abb311b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf8645c50 con 0x55caf8746660 2023-07-21T22:42:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6abb311b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf86989e0 con 0x55caf859c6b0 2023-07-21T22:42:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6abb311b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf8691e70 con 0x55caf8746210 2023-07-21T22:42:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6a967fc700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6a8c0a12c0 0x7f6a8c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6aa579b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 0x55caf873ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6aa4f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8746660 0x55caf87404a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6aa4f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8746660 0x55caf87404a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48020/0 (socket says 172.21.15.151:48020) 2023-07-21T22:42:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6aa4f9a700 1 -- 172.21.15.151:0/1058009272 learned_addr learned my addr 172.21.15.151:0/1058009272 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6aa5f9c700 1 --2- 172.21.15.151:0/1058009272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 0x55caf8745cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6a967fc700 1 -- 172.21.15.151:0/3923039615 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f6a9c014070 con 0x7f6aa00ffb00 2023-07-21T22:42:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.511+0000 7f6aa5f9c700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6a8c0a12c0 0x7f6a8c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6aa579b700 1 -- 172.21.15.151:0/1058009272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 msgr2=0x55caf8745cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6aa579b700 1 --2- 172.21.15.151:0/1058009272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 0x55caf8745cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6aa579b700 1 -- 172.21.15.151:0/1058009272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8746660 msgr2=0x55caf87404a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6aa579b700 1 --2- 172.21.15.151:0/1058009272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8746660 0x55caf87404a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6aa579b700 1 -- 172.21.15.151:0/1058009272 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55caf84bfd80 con 0x55caf8746210 2023-07-21T22:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6aa5f9c700 1 --2- 172.21.15.151:0/1058009272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 0x55caf8745cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6aa579b700 1 --2- 172.21.15.151:0/1058009272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 0x55caf873ff40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ca4c0 tx=0x7f6a9c06beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac7ae953c0efeabf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6a8b7fe700 1 -- 172.21.15.151:0/1058009272 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c099e40 con 0x55caf8746210 2023-07-21T22:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6a8b7fe700 1 -- 172.21.15.151:0/1058009272 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a9c09de70 con 0x55caf8746210 2023-07-21T22:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6a8b7fe700 1 -- 172.21.15.151:0/1058009272 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c004d70 con 0x55caf8746210 2023-07-21T22:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.512+0000 7f6aa5f9c700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6a8c0a12c0 0x7f6a8c0a3770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009790 tx=0x7f6a980096c0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.513+0000 7f6abb311b80 1 -- 172.21.15.151:0/1058009272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 msgr2=0x55caf873ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.513+0000 7f6abb311b80 1 --2- 172.21.15.151:0/1058009272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 0x55caf873ff40 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0ca4c0 tx=0x7f6a9c06beb0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.513+0000 7f6abb311b80 1 -- 172.21.15.151:0/1058009272 shutdown_connections 2023-07-21T22:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.513+0000 7f6abb311b80 1 --2- 172.21.15.151:0/1058009272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 0x55caf8745cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.513+0000 7f6abb311b80 1 --2- 172.21.15.151:0/1058009272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8746660 0x55caf87404a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.513+0000 7f6abb311b80 1 --2- 172.21.15.151:0/1058009272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 0x55caf873ff40 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.513+0000 7f6abb311b80 1 -- 172.21.15.151:0/1058009272 >> 172.21.15.151:0/1058009272 conn(0x55caf8735ae0 msgr2=0x55caf873b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.513+0000 7f6abb311b80 1 -- 172.21.15.151:0/1058009272 shutdown_connections 2023-07-21T22:42:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.513+0000 7f6abb311b80 1 -- 172.21.15.151:0/1058009272 wait complete. 2023-07-21T22:42:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6abb311b80 1 -- start start 2023-07-21T22:42:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6abb311b80 1 Processor -- start 2023-07-21T22:42:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf859c6b0 0x55caf874c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 0x55caf87497f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8746660 0x55caf8749e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6abb311b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf8631a60 con 0x55caf859c6b0 2023-07-21T22:42:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6abb311b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf8631760 con 0x55caf8746660 2023-07-21T22:42:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6abb311b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf85158c0 con 0x55caf8746210 2023-07-21T22:42:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6abb311b80 10 client.0 _ll_register_callbacks cb 0x55caf862f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:42:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.514+0000 7f6aa579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf859c6b0 0x55caf874c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf859c6b0 0x55caf874c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48022/0 (socket says 172.21.15.151:48022) 2023-07-21T22:42:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa4f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 0x55caf87497f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa579b700 1 -- 172.21.15.151:0/2312551989 learned_addr learned my addr 172.21.15.151:0/2312551989 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa5f9c700 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8746660 0x55caf8749e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa579b700 1 -- 172.21.15.151:0/2312551989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 msgr2=0x55caf87497f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa579b700 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 0x55caf87497f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa579b700 1 -- 172.21.15.151:0/2312551989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8746660 msgr2=0x55caf8749e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa579b700 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8746660 0x55caf8749e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa579b700 1 -- 172.21.15.151:0/2312551989 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6aa01a4f40 con 0x55caf859c6b0 2023-07-21T22:42:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6aa579b700 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf859c6b0 0x55caf874c570 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0a1d60 tx=0x7f6a9c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49844e727464969b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6a88ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:42:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6a88ff9700 1 -- 172.21.15.151:0/2312551989 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0ca940 con 0x55caf859c6b0 2023-07-21T22:42:11.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6a88ff9700 1 -- 172.21.15.151:0/2312551989 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f6a9c0a1e00 con 0x55caf859c6b0 2023-07-21T22:42:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.515+0000 7f6abb311b80 1 -- 172.21.15.151:0/2312551989 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55caf85eb490 con 0x55caf859c6b0 2023-07-21T22:42:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6a88ff9700 1 -- 172.21.15.151:0/2312551989 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a9c0a1fe0 con 0x55caf859c6b0 2023-07-21T22:42:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6abb311b80 10 client.18159 fetch_fsmap learned FSMap version 83 2023-07-21T22:42:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6abb311b80 1 -- 172.21.15.151:0/2312551989 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) v3 -- 0x55caf84a8c00 con 0x55caf859c6b0 2023-07-21T22:42:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6a88ff9700 1 -- 172.21.15.151:0/2312551989 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55caf85eb490 con 0x55caf859c6b0 2023-07-21T22:42:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6a88ff9700 1 -- 172.21.15.151:0/2312551989 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 83) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6a9c0993c0 con 0x55caf859c6b0 2023-07-21T22:42:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6abb311b80 10 client.18159 fetch_fsmap finished waiting for FSMap version 83 2023-07-21T22:42:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6abb311b80 10 client.18159 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:42:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6abb311b80 20 client.18159 populate_metadata read hostname 'smithi151' 2023-07-21T22:42:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6abb311b80 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55caf8759830 0x55caf875bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6abb311b80 4 client.18159 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:42:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6abb311b80 1 -- 172.21.15.151:0/2312551989 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55caf868ae50 con 0x55caf8759830 2023-07-21T22:42:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.516+0000 7f6aa4f9a700 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55caf8759830 0x55caf875bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.517+0000 7f6a88ff9700 10 client.18159 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.517+0000 7f6aa4f9a700 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55caf8759830 0x55caf875bc40 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5788878e2ad67b14 server_cookie=f2a7322db30594b0 in_seq=0 out_seq=0 2023-07-21T22:42:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6a88ff9700 1 -- 172.21.15.151:0/2312551989 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55caf868ae50 con 0x55caf8759830 2023-07-21T22:42:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6a88ff9700 10 client.18159 handle_command_reply: tid=0 2023-07-21T22:42:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 client.18159 shutdown 2023-07-21T22:42:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 -- 172.21.15.151:0/2312551989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf859c6b0 msgr2=0x55caf874c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf859c6b0 0x55caf874c570 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0a1d60 tx=0x7f6a9c009f90 comp rx=0 tx=0).stop 2023-07-21T22:42:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 -- 172.21.15.151:0/2312551989 shutdown_connections 2023-07-21T22:42:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55caf8759830 0x55caf875bc40 crc :-1 s=READY pgs=302 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8746660 0x55caf8749e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf859c6b0 0x55caf874c570 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 --2- 172.21.15.151:0/2312551989 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf8746210 0x55caf87497f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 -- 172.21.15.151:0/2312551989 >> 172.21.15.151:0/2312551989 conn(0x55caf8735ae0 msgr2=0x55caf873a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6a88ff9700 0 client.18159 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 -- 172.21.15.151:0/2312551989 shutdown_connections 2023-07-21T22:42:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 1 -- 172.21.15.151:0/2312551989 wait complete. 2023-07-21T22:42:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.518+0000 7f6abb311b80 20 client.18159 trim_cache size 0 max 16384 2023-07-21T22:42:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.534+0000 7f6abb311b80 1 Processor -- start 2023-07-21T22:42:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.534+0000 7f6abb311b80 1 -- start start 2023-07-21T22:42:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.534+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf87440a0 0x55caf8745150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.534+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8735ae0 0x55caf874c110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.534+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf859c6b0 0x55caf873ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.534+0000 7f6abb311b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf874a780 con 0x55caf87440a0 2023-07-21T22:42:11.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.534+0000 7f6abb311b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf874add0 con 0x55caf8735ae0 2023-07-21T22:42:11.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.534+0000 7f6abb311b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf8740f20 con 0x55caf859c6b0 2023-07-21T22:42:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf87440a0 0x55caf8745150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa5f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf859c6b0 0x55caf873ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa4f9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8735ae0 0x55caf874c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf87440a0 0x55caf8745150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48034/0 (socket says 172.21.15.151:48034) 2023-07-21T22:42:11.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa5f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf859c6b0 0x55caf873ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49166/0 (socket says 172.21.15.151:49166) 2023-07-21T22:42:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa579b700 1 -- 172.21.15.151:0/493704973 learned_addr learned my addr 172.21.15.151:0/493704973 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa579b700 1 -- 172.21.15.151:0/493704973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf859c6b0 msgr2=0x55caf873ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa579b700 1 --2- 172.21.15.151:0/493704973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf859c6b0 0x55caf873ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa579b700 1 -- 172.21.15.151:0/493704973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8735ae0 msgr2=0x55caf874c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa579b700 1 --2- 172.21.15.151:0/493704973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8735ae0 0x55caf874c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa579b700 1 -- 172.21.15.151:0/493704973 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55caf8760830 con 0x55caf87440a0 2023-07-21T22:42:11.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6aa579b700 1 --2- 172.21.15.151:0/493704973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf87440a0 0x55caf8745150 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c099910 tx=0x7f6a9c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f006107e7c3e83c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.535+0000 7f6a8bfff700 1 -- 172.21.15.151:0/493704973 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c0c9ff0 con 0x55caf87440a0 2023-07-21T22:42:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6a8bfff700 1 -- 172.21.15.151:0/493704973 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a9c099e40 con 0x55caf87440a0 2023-07-21T22:42:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6a8bfff700 1 -- 172.21.15.151:0/493704973 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a9c099330 con 0x55caf87440a0 2023-07-21T22:42:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6abb311b80 1 -- 172.21.15.151:0/493704973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf87440a0 msgr2=0x55caf8745150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6abb311b80 1 --2- 172.21.15.151:0/493704973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf87440a0 0x55caf8745150 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c099910 tx=0x7f6a9c000bc0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6abb311b80 1 -- 172.21.15.151:0/493704973 shutdown_connections 2023-07-21T22:42:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6abb311b80 1 --2- 172.21.15.151:0/493704973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf859c6b0 0x55caf873ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6abb311b80 1 --2- 172.21.15.151:0/493704973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf87440a0 0x55caf8745150 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6abb311b80 1 --2- 172.21.15.151:0/493704973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf8735ae0 0x55caf874c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6abb311b80 1 -- 172.21.15.151:0/493704973 >> 172.21.15.151:0/493704973 conn(0x55caf8743cd0 msgr2=0x55caf8747120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6abb311b80 1 -- 172.21.15.151:0/493704973 shutdown_connections 2023-07-21T22:42:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.536+0000 7f6abb311b80 1 -- 172.21.15.151:0/493704973 wait complete. 2023-07-21T22:42:11.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.537+0000 7f6abb311b80 1 -- start start 2023-07-21T22:42:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.537+0000 7f6abb311b80 1 Processor -- start 2023-07-21T22:42:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.537+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 0x55caf8742e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.537+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8735ae0 0x55caf8741730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.537+0000 7f6abb311b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf87440a0 0x55caf8741c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.537+0000 7f6abb311b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf8751120 con 0x55caf8735ae0 2023-07-21T22:42:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.537+0000 7f6abb311b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf87421b0 con 0x55caf859c6b0 2023-07-21T22:42:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.537+0000 7f6abb311b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55caf8742370 con 0x55caf87440a0 2023-07-21T22:42:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.537+0000 7f6abb311b80 10 client.0 _ll_register_callbacks cb 0x55caf862f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:42:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa4f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8735ae0 0x55caf8741730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa4f9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8735ae0 0x55caf8741730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48040/0 (socket says 172.21.15.151:48040) 2023-07-21T22:42:11.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa5f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf87440a0 0x55caf8741c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa4f9a700 1 -- 172.21.15.151:0/3038535980 learned_addr learned my addr 172.21.15.151:0/3038535980 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa579b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 0x55caf8742e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa4f9a700 1 -- 172.21.15.151:0/3038535980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf87440a0 msgr2=0x55caf8741c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa4f9a700 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf87440a0 0x55caf8741c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa4f9a700 1 -- 172.21.15.151:0/3038535980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 msgr2=0x55caf8742e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa4f9a700 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 0x55caf8742e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa4f9a700 1 -- 172.21.15.151:0/3038535980 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55caf84a8c00 con 0x55caf8735ae0 2023-07-21T22:42:11.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6aa4f9a700 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8735ae0 0x55caf8741730 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x55caf874cb50 tx=0x7f6a9000b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a0b018168f472c5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6a88ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:42:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.538+0000 7f6a88ff9700 1 -- 172.21.15.151:0/3038535980 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a90016070 con 0x55caf8735ae0 2023-07-21T22:42:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6abb311b80 1 -- 172.21.15.151:0/3038535980 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6a9c09de70 con 0x55caf8735ae0 2023-07-21T22:42:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6a88ff9700 1 -- 172.21.15.151:0/3038535980 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(121..121 src has 1..121) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f6a9001f450 con 0x55caf8735ae0 2023-07-21T22:42:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6a88ff9700 1 -- 172.21.15.151:0/3038535980 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a9001f610 con 0x55caf8735ae0 2023-07-21T22:42:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6abb311b80 10 client.18165 fetch_fsmap learned FSMap version 83 2023-07-21T22:42:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6abb311b80 1 -- 172.21.15.151:0/3038535980 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) v3 -- 0x55caf84e61f0 con 0x55caf8735ae0 2023-07-21T22:42:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6a88ff9700 1 -- 172.21.15.151:0/3038535980 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6a9c09de70 con 0x55caf8735ae0 2023-07-21T22:42:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6a88ff9700 1 -- 172.21.15.151:0/3038535980 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 83) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6a90011680 con 0x55caf8735ae0 2023-07-21T22:42:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6abb311b80 10 client.18165 fetch_fsmap finished waiting for FSMap version 83 2023-07-21T22:42:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6abb311b80 10 client.18165 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:42:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6abb311b80 20 client.18165 populate_metadata read hostname 'smithi151' 2023-07-21T22:42:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6abb311b80 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55caf8746210 0x55caf87b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6abb311b80 4 client.18165 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:42:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.539+0000 7f6abb311b80 1 -- 172.21.15.151:0/3038535980 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55caf864cff0 con 0x55caf8746210 2023-07-21T22:42:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.540+0000 7f6aa579b700 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55caf8746210 0x55caf87b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.540+0000 7f6aa579b700 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55caf8746210 0x55caf87b0a50 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aeeedf10cd58521 server_cookie=7f426994c53b8eda in_seq=0 out_seq=0 2023-07-21T22:42:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.540+0000 7f6a88ff9700 10 client.18165 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.549+0000 7f6a88ff9700 1 -- 172.21.15.151:0/3038535980 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55caf864cff0 con 0x55caf8746210 2023-07-21T22:42:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.549+0000 7f6a88ff9700 10 client.18165 handle_command_reply: tid=0 2023-07-21T22:42:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.549+0000 7f6abb311b80 1 client.18165 shutdown 2023-07-21T22:42:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.549+0000 7f6abb311b80 1 -- 172.21.15.151:0/3038535980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8735ae0 msgr2=0x55caf8741730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.549+0000 7f6abb311b80 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8735ae0 0x55caf8741730 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x55caf874cb50 tx=0x7f6a9000b920 comp rx=0 tx=0).stop 2023-07-21T22:42:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6abb311b80 1 -- 172.21.15.151:0/3038535980 shutdown_connections 2023-07-21T22:42:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6abb311b80 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55caf8746210 0x55caf87b0a50 crc :-1 s=READY pgs=303 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6abb311b80 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55caf859c6b0 0x55caf8742e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6abb311b80 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55caf87440a0 0x55caf8741c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6abb311b80 1 --2- 172.21.15.151:0/3038535980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55caf8735ae0 0x55caf8741730 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6a88ff9700 0 client.18165 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6abb311b80 1 -- 172.21.15.151:0/3038535980 >> 172.21.15.151:0/3038535980 conn(0x55caf8743cd0 msgr2=0x55caf8745150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6abb311b80 1 -- 172.21.15.151:0/3038535980 shutdown_connections 2023-07-21T22:42:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6abb311b80 1 -- 172.21.15.151:0/3038535980 wait complete. 2023-07-21T22:42:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6abb311b80 20 client.18165 trim_cache size 0 max 16384 2023-07-21T22:42:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:42:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:42:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:42:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:42:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6aa79ff700 1 -- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6a8c0a12c0 msgr2=0x7f6a8c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6a8c0a12c0 0x7f6a8c0a3770 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6a98009790 tx=0x7f6a980096c0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6aa79ff700 1 -- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa00ffb00 msgr2=0x7f6aa0197f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.550+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa00ffb00 0x7f6aa0197f00 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c00e9c0 tx=0x7f6a9c00ecd0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.551+0000 7f6aa79ff700 1 -- 172.21.15.151:0/3923039615 shutdown_connections 2023-07-21T22:42:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.551+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6a8c0a12c0 0x7f6a8c0a3770 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.551+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6aa0105b10 0x7f6aa019cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.551+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6aa00ffb00 0x7f6aa0197f00 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.551+0000 7f6aa79ff700 1 --2- 172.21.15.151:0/3923039615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6aa01004b0 0x7f6aa0198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.551+0000 7f6aa79ff700 1 -- 172.21.15.151:0/3923039615 >> 172.21.15.151:0/3923039615 conn(0x7f6aa00fb600 msgr2=0x7f6aa010ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.551+0000 7f6aa79ff700 1 -- 172.21.15.151:0/3923039615 shutdown_connections 2023-07-21T22:42:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:11.551+0000 7f6aa79ff700 1 -- 172.21.15.151:0/3923039615 wait complete. 2023-07-21T22:42:12.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:12 smithi195 ceph-mon[97365]: pgmap v726: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.8 MiB/s wr, 372 op/s 2023-07-21T22:42:12.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:12 smithi151 ceph-mon[95510]: pgmap v726: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.8 MiB/s wr, 372 op/s 2023-07-21T22:42:13.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:12 smithi187 ceph-mon[96918]: pgmap v726: 97 pgs: 97 active+clean; 8.8 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 2.8 MiB/s wr, 372 op/s 2023-07-21T22:42:14.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:14 smithi195 ceph-mon[97365]: pgmap v727: 97 pgs: 97 active+clean; 8.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.7 MiB/s wr, 357 op/s 2023-07-21T22:42:14.946 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:14 smithi151 ceph-mon[95510]: pgmap v727: 97 pgs: 97 active+clean; 8.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.7 MiB/s wr, 357 op/s 2023-07-21T22:42:15.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:14 smithi187 ceph-mon[96918]: pgmap v727: 97 pgs: 97 active+clean; 8.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.7 MiB/s wr, 357 op/s 2023-07-21T22:42:16.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:16 smithi195 ceph-mon[97365]: pgmap v728: 97 pgs: 97 active+clean; 8.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.7 MiB/s wr, 357 op/s 2023-07-21T22:42:16.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:16 smithi195 ceph-mon[97365]: osdmap e122: 12 total, 12 up, 12 in 2023-07-21T22:42:16.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:16 smithi151 ceph-mon[95510]: pgmap v728: 97 pgs: 97 active+clean; 8.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.7 MiB/s wr, 357 op/s 2023-07-21T22:42:16.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:16 smithi151 ceph-mon[95510]: osdmap e122: 12 total, 12 up, 12 in 2023-07-21T22:42:17.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:16 smithi187 ceph-mon[96918]: pgmap v728: 97 pgs: 97 active+clean; 8.2 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.7 MiB/s wr, 357 op/s 2023-07-21T22:42:17.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:16 smithi187 ceph-mon[96918]: osdmap e122: 12 total, 12 up, 12 in 2023-07-21T22:42:18.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:18 smithi195 ceph-mon[97365]: pgmap v730: 97 pgs: 97 active+clean; 8.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.4 MiB/s wr, 440 op/s 2023-07-21T22:42:18.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:18 smithi151 ceph-mon[95510]: pgmap v730: 97 pgs: 97 active+clean; 8.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.4 MiB/s wr, 440 op/s 2023-07-21T22:42:19.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:18 smithi187 ceph-mon[96918]: pgmap v730: 97 pgs: 97 active+clean; 8.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.4 MiB/s wr, 440 op/s 2023-07-21T22:42:20.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:20 smithi195 ceph-mon[97365]: pgmap v731: 97 pgs: 97 active+clean; 8.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:42:20.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:20 smithi151 ceph-mon[95510]: pgmap v731: 97 pgs: 97 active+clean; 8.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:42:21.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:20 smithi187 ceph-mon[96918]: pgmap v731: 97 pgs: 97 active+clean; 8.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:42:22.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:22 smithi195 ceph-mon[97365]: pgmap v732: 97 pgs: 97 active+clean; 8.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 352 op/s 2023-07-21T22:42:22.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:22 smithi151 ceph-mon[95510]: pgmap v732: 97 pgs: 97 active+clean; 8.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 352 op/s 2023-07-21T22:42:23.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:22 smithi187 ceph-mon[96918]: pgmap v732: 97 pgs: 97 active+clean; 8.2 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 352 op/s 2023-07-21T22:42:24.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.723+0000 7f3509dff700 1 -- 172.21.15.151:0/3002366891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3504072850 msgr2=0x7f3504072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.723+0000 7f3509dff700 1 --2- 172.21.15.151:0/3002366891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3504072850 0x7f3504072c20 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f34f4009990 tx=0x7f34f4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.723+0000 7f3509dff700 1 -- 172.21.15.151:0/3002366891 shutdown_connections 2023-07-21T22:42:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.723+0000 7f3509dff700 1 --2- 172.21.15.151:0/3002366891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350410c3b0 0x7f350410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.723+0000 7f3509dff700 1 --2- 172.21.15.151:0/3002366891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3504072850 0x7f3504072c20 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.723+0000 7f3509dff700 1 --2- 172.21.15.151:0/3002366891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3504073160 0x7f350410be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.723+0000 7f3509dff700 1 -- 172.21.15.151:0/3002366891 >> 172.21.15.151:0/3002366891 conn(0x7f35040fb5f0 msgr2=0x7f35040fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.723+0000 7f3509dff700 1 -- 172.21.15.151:0/3002366891 shutdown_connections 2023-07-21T22:42:24.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.723+0000 7f3509dff700 1 -- 172.21.15.151:0/3002366891 wait complete. 2023-07-21T22:42:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.724+0000 7f3509dff700 1 Processor -- start 2023-07-21T22:42:24.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.724+0000 7f3509dff700 1 -- start start 2023-07-21T22:42:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3509dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3504072850 0x7f3504197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3509dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3504073160 0x7f35041982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3509dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350410c3b0 0x7f350419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3509dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350419cfa0 con 0x7f350410c3b0 2023-07-21T22:42:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3509dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350419d110 con 0x7f3504072850 2023-07-21T22:42:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3509dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f350419d2d0 con 0x7f3504073160 2023-07-21T22:42:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3503fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350410c3b0 0x7f350419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f35037fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3504072850 0x7f3504197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3503fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350410c3b0 0x7f350419c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37146/0 (socket says 172.21.15.151:37146) 2023-07-21T22:42:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3502ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3504073160 0x7f35041982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f3503fff700 1 -- 172.21.15.151:0/2146053260 learned_addr learned my addr 172.21.15.151:0/2146053260 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f35037fe700 1 -- 172.21.15.151:0/2146053260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3504073160 msgr2=0x7f35041982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f35037fe700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3504073160 0x7f35041982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.725+0000 7f35037fe700 1 -- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350410c3b0 msgr2=0x7f350419c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:24.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.726+0000 7f35037fe700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350410c3b0 0x7f350419c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.726+0000 7f35037fe700 1 -- 172.21.15.151:0/2146053260 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f40095f0 con 0x7f3504072850 2023-07-21T22:42:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.726+0000 7f3502ffd700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3504073160 0x7f35041982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:42:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.726+0000 7f3503fff700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350410c3b0 0x7f350419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:42:24.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.726+0000 7f35037fe700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3504072850 0x7f3504197db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098e0 tx=0x7f34f4004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.726+0000 7f3500ff9700 1 -- 172.21.15.151:0/2146053260 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f401d070 con 0x7f3504072850 2023-07-21T22:42:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.726+0000 7f3500ff9700 1 -- 172.21.15.151:0/2146053260 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34f4022470 con 0x7f3504072850 2023-07-21T22:42:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.726+0000 7f3509dff700 1 -- 172.21.15.151:0/2146053260 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f350419d550 con 0x7f3504072850 2023-07-21T22:42:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.726+0000 7f3500ff9700 1 -- 172.21.15.151:0/2146053260 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4017650 con 0x7f3504072850 2023-07-21T22:42:24.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.727+0000 7f3509dff700 1 -- 172.21.15.151:0/2146053260 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35041a4df0 con 0x7f3504072850 2023-07-21T22:42:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.730+0000 7f3500ff9700 1 -- 172.21.15.151:0/2146053260 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f34f40225e0 con 0x7f3504072850 2023-07-21T22:42:24.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.731+0000 7f351d687b80 1 Processor -- start 2023-07-21T22:42:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.731+0000 7f351d687b80 1 -- start start 2023-07-21T22:42:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f351d687b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b313cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f351d687b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314210 0x56309b30df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f351d687b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314660 0x56309b30e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f351d687b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b213c50 con 0x56309b16a6b0 2023-07-21T22:42:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f351d687b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b2669e0 con 0x56309b314660 2023-07-21T22:42:24.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f351d687b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b25fe70 con 0x56309b314210 2023-07-21T22:42:24.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f3503fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b313cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f35037fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314210 0x56309b30df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f3500ff9700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f34ec0a1340 0x7f34ec0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f35037fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314210 0x56309b30df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:53650/0 (socket says 172.21.15.151:53650) 2023-07-21T22:42:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f3503fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b313cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37150/0 (socket says 172.21.15.151:37150) 2023-07-21T22:42:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f35037fe700 1 -- 172.21.15.151:0/2808028955 learned_addr learned my addr 172.21.15.151:0/2808028955 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:24.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.732+0000 7f3502ffd700 1 --2- 172.21.15.151:0/2808028955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314660 0x56309b30e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f3500ff9700 1 -- 172.21.15.151:0/2146053260 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f34f40cdfe0 con 0x7f3504072850 2023-07-21T22:42:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f3503fff700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f34ec0a1340 0x7f34ec0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f35037fe700 1 -- 172.21.15.151:0/2808028955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314660 msgr2=0x56309b30e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f35037fe700 1 --2- 172.21.15.151:0/2808028955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314660 0x56309b30e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f35037fe700 1 -- 172.21.15.151:0/2808028955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 msgr2=0x56309b313cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f35037fe700 1 --2- 172.21.15.151:0/2808028955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b313cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f35037fe700 1 -- 172.21.15.151:0/2808028955 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56309b08dd80 con 0x56309b314210 2023-07-21T22:42:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f3502ffd700 1 --2- 172.21.15.151:0/2808028955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314660 0x56309b30e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:42:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f35037fe700 1 --2- 172.21.15.151:0/2808028955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314210 0x56309b30df40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f34f40cb660 tx=0x7f34f4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c32b5cf19b4283f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f34e9ffb700 1 -- 172.21.15.151:0/2808028955 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f409f130 con 0x56309b314210 2023-07-21T22:42:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f34e9ffb700 1 -- 172.21.15.151:0/2808028955 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34f409b100 con 0x56309b314210 2023-07-21T22:42:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.733+0000 7f34e9ffb700 1 -- 172.21.15.151:0/2808028955 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f409a5f0 con 0x56309b314210 2023-07-21T22:42:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f351d687b80 1 -- 172.21.15.151:0/2808028955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314210 msgr2=0x56309b30df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:24.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f351d687b80 1 --2- 172.21.15.151:0/2808028955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314210 0x56309b30df40 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f34f40cb660 tx=0x7f34f4000bc0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f3503fff700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f34ec0a1340 0x7f34ec0a37f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009fd0 tx=0x7f34fc004b40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f351d687b80 1 -- 172.21.15.151:0/2808028955 shutdown_connections 2023-07-21T22:42:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f351d687b80 1 --2- 172.21.15.151:0/2808028955 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314660 0x56309b30e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f351d687b80 1 --2- 172.21.15.151:0/2808028955 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b313cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f351d687b80 1 --2- 172.21.15.151:0/2808028955 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314210 0x56309b30df40 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f351d687b80 1 -- 172.21.15.151:0/2808028955 >> 172.21.15.151:0/2808028955 conn(0x56309b303ae0 msgr2=0x56309b3090e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f351d687b80 1 -- 172.21.15.151:0/2808028955 shutdown_connections 2023-07-21T22:42:24.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.734+0000 7f351d687b80 1 -- 172.21.15.151:0/2808028955 wait complete. 2023-07-21T22:42:24.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.735+0000 7f351d687b80 1 -- start start 2023-07-21T22:42:24.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.735+0000 7f351d687b80 1 Processor -- start 2023-07-21T22:42:24.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f351d687b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b31d220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f351d687b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b31d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f351d687b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 0x56309b317470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f351d687b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b1ffa60 con 0x56309b314660 2023-07-21T22:42:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f351d687b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b1ff760 con 0x56309b314210 2023-07-21T22:42:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f351d687b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b0e38c0 con 0x56309b16a6b0 2023-07-21T22:42:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f351d687b80 10 client.0 _ll_register_callbacks cb 0x56309b1fd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:42:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f35037fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b31d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f35037fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b31d220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:53652/0 (socket says 172.21.15.151:53652) 2023-07-21T22:42:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f35037fe700 1 -- 172.21.15.151:0/280853510 learned_addr learned my addr 172.21.15.151:0/280853510 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f3502ffd700 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b31d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f3503fff700 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 0x56309b317470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f35037fe700 1 -- 172.21.15.151:0/280853510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 msgr2=0x56309b31d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f35037fe700 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b31d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f35037fe700 1 -- 172.21.15.151:0/280853510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 msgr2=0x56309b317470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f35037fe700 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 0x56309b317470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f35037fe700 1 -- 172.21.15.151:0/280853510 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35041a4df0 con 0x56309b16a6b0 2023-07-21T22:42:24.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.736+0000 7f3503fff700 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 0x56309b317470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:42:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.737+0000 7f35037fe700 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b31d220 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f34f409b090 tx=0x7f34f409a8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f47d6367d620c0fc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.737+0000 7f34e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:42:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.737+0000 7f34e2ffd700 1 -- 172.21.15.151:0/280853510 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40a34c0 con 0x56309b16a6b0 2023-07-21T22:42:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.737+0000 7f34e2ffd700 1 -- 172.21.15.151:0/280853510 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f34f40cbe40 con 0x56309b16a6b0 2023-07-21T22:42:24.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.737+0000 7f351d687b80 1 -- 172.21.15.151:0/280853510 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56309b1b9490 con 0x56309b16a6b0 2023-07-21T22:42:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.737+0000 7f34e2ffd700 1 -- 172.21.15.151:0/280853510 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34f409b570 con 0x56309b16a6b0 2023-07-21T22:42:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.737+0000 7f351d687b80 10 client.27880 fetch_fsmap learned FSMap version 83 2023-07-21T22:42:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.737+0000 7f351d687b80 1 -- 172.21.15.151:0/280853510 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) v3 -- 0x56309b076c00 con 0x56309b16a6b0 2023-07-21T22:42:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.738+0000 7f34e2ffd700 1 -- 172.21.15.151:0/280853510 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56309b1b9490 con 0x56309b16a6b0 2023-07-21T22:42:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.738+0000 7f34e2ffd700 1 -- 172.21.15.151:0/280853510 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 83) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f34f40a3030 con 0x56309b16a6b0 2023-07-21T22:42:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.738+0000 7f351d687b80 10 client.27880 fetch_fsmap finished waiting for FSMap version 83 2023-07-21T22:42:24.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.738+0000 7f351d687b80 10 client.27880 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:42:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.738+0000 7f351d687b80 20 client.27880 populate_metadata read hostname 'smithi151' 2023-07-21T22:42:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.738+0000 7f351d687b80 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56309b3271a0 0x56309b3295b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.738+0000 7f351d687b80 4 client.27880 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:42:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.738+0000 7f351d687b80 1 -- 172.21.15.151:0/280853510 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56309b258e50 con 0x56309b3271a0 2023-07-21T22:42:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.738+0000 7f3502ffd700 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56309b3271a0 0x56309b3295b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.739+0000 7f3502ffd700 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56309b3271a0 0x56309b3295b0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e2a381612e983aa server_cookie=e9b23762bfdf2bd2 in_seq=0 out_seq=0 2023-07-21T22:42:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.739+0000 7f34e2ffd700 10 client.27880 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:24.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.739+0000 7f34e2ffd700 1 -- 172.21.15.151:0/280853510 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56309b258e50 con 0x56309b3271a0 2023-07-21T22:42:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.739+0000 7f34e2ffd700 10 client.27880 handle_command_reply: tid=0 2023-07-21T22:42:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 client.27880 shutdown 2023-07-21T22:42:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 -- 172.21.15.151:0/280853510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 msgr2=0x56309b31d220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b31d220 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f34f409b090 tx=0x7f34f409a8a0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 -- 172.21.15.151:0/280853510 shutdown_connections 2023-07-21T22:42:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56309b3271a0 0x56309b3295b0 crc :-1 s=READY pgs=304 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 0x56309b317470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b31d220 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f34e2ffd700 0 client.27880 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 --2- 172.21.15.151:0/280853510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b31d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 -- 172.21.15.151:0/280853510 >> 172.21.15.151:0/280853510 conn(0x56309b303ae0 msgr2=0x56309b3083e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 -- 172.21.15.151:0/280853510 shutdown_connections 2023-07-21T22:42:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 1 -- 172.21.15.151:0/280853510 wait complete. 2023-07-21T22:42:24.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.740+0000 7f351d687b80 20 client.27880 trim_cache size 0 max 16384 2023-07-21T22:42:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.756+0000 7f351d687b80 1 Processor -- start 2023-07-21T22:42:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.756+0000 7f351d687b80 1 -- start start 2023-07-21T22:42:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f351d687b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b313560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f351d687b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b315120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f351d687b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 0x56309b3163c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f351d687b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b305c00 con 0x56309b314660 2023-07-21T22:42:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f351d687b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b318a50 con 0x56309b314210 2023-07-21T22:42:24.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f351d687b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b30f160 con 0x56309b16a6b0 2023-07-21T22:42:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f35037fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b313560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f35037fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b313560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:53668/0 (socket says 172.21.15.151:53668) 2023-07-21T22:42:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f35037fe700 1 -- 172.21.15.151:0/766872349 learned_addr learned my addr 172.21.15.151:0/766872349 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f3502ffd700 1 --2- 172.21.15.151:0/766872349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b315120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f3503fff700 1 --2- 172.21.15.151:0/766872349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 0x56309b3163c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f35037fe700 1 -- 172.21.15.151:0/766872349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 msgr2=0x56309b315120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f35037fe700 1 --2- 172.21.15.151:0/766872349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b315120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f35037fe700 1 -- 172.21.15.151:0/766872349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 msgr2=0x56309b3163c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:24.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.757+0000 7f35037fe700 1 --2- 172.21.15.151:0/766872349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 0x56309b3163c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.758+0000 7f35037fe700 1 -- 172.21.15.151:0/766872349 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56309b0b41f0 con 0x56309b16a6b0 2023-07-21T22:42:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.758+0000 7f35037fe700 1 --2- 172.21.15.151:0/766872349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b313560 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f34f4099450 tx=0x7f34f409f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ccba720a16437761 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.758+0000 7f34ea7fc700 1 -- 172.21.15.151:0/766872349 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f4097440 con 0x56309b16a6b0 2023-07-21T22:42:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.758+0000 7f34ea7fc700 1 -- 172.21.15.151:0/766872349 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34f40b9450 con 0x56309b16a6b0 2023-07-21T22:42:24.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.758+0000 7f34ea7fc700 1 -- 172.21.15.151:0/766872349 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f40b34b0 con 0x56309b16a6b0 2023-07-21T22:42:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 -- 172.21.15.151:0/766872349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 msgr2=0x56309b313560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 --2- 172.21.15.151:0/766872349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b313560 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f34f4099450 tx=0x7f34f409f1f0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 -- 172.21.15.151:0/766872349 shutdown_connections 2023-07-21T22:42:24.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 --2- 172.21.15.151:0/766872349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b314660 0x56309b3163c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 --2- 172.21.15.151:0/766872349 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b16a6b0 0x56309b313560 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 --2- 172.21.15.151:0/766872349 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b315120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 -- 172.21.15.151:0/766872349 >> 172.21.15.151:0/766872349 conn(0x56309b303ae0 msgr2=0x56309b315cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 -- 172.21.15.151:0/766872349 shutdown_connections 2023-07-21T22:42:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 -- 172.21.15.151:0/766872349 wait complete. 2023-07-21T22:42:24.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.759+0000 7f351d687b80 1 -- start start 2023-07-21T22:42:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.760+0000 7f351d687b80 1 Processor -- start 2023-07-21T22:42:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.760+0000 7f351d687b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b36f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.760+0000 7f351d687b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b36f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.760+0000 7f351d687b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314660 0x56309b37a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.760+0000 7f351d687b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b36fe90 con 0x56309b16a6b0 2023-07-21T22:42:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.760+0000 7f351d687b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b37a5b0 con 0x56309b314210 2023-07-21T22:42:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.760+0000 7f351d687b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56309b37a770 con 0x56309b314660 2023-07-21T22:42:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.760+0000 7f351d687b80 10 client.0 _ll_register_callbacks cb 0x7f34fc009050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:42:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.760+0000 7f35037fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b36f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f35037fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b36f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37176/0 (socket says 172.21.15.151:37176) 2023-07-21T22:42:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f3503fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314660 0x56309b37a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f35037fe700 1 -- 172.21.15.151:0/3777373097 learned_addr learned my addr 172.21.15.151:0/3777373097 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f3502ffd700 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b36f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f3503fff700 1 -- 172.21.15.151:0/3777373097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 msgr2=0x56309b36f720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f3503fff700 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b36f720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f3503fff700 1 -- 172.21.15.151:0/3777373097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 msgr2=0x56309b36f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f3503fff700 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b36f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f3503fff700 1 -- 172.21.15.151:0/3777373097 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56309b076c00 con 0x56309b314660 2023-07-21T22:42:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f35037fe700 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b36f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:42:24.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f3502ffd700 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b36f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:42:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f3503fff700 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314660 0x56309b37a070 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009d70 tx=0x7f34fc004ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8b2a3e56d852f32 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.761+0000 7f34e2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:42:24.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.762+0000 7f34e2ffd700 1 -- 172.21.15.151:0/3777373097 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc004bb0 con 0x56309b314660 2023-07-21T22:42:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.762+0000 7f34e2ffd700 1 -- 172.21.15.151:0/3777373097 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f34fc01f070 con 0x56309b314660 2023-07-21T22:42:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.762+0000 7f351d687b80 1 -- 172.21.15.151:0/3777373097 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f34f409b100 con 0x56309b314660 2023-07-21T22:42:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.762+0000 7f34e2ffd700 1 -- 172.21.15.151:0/3777373097 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=83) v2 ==== 24+0+0 (secure 0 0 0) 0x7f34fc004d10 con 0x56309b314660 2023-07-21T22:42:24.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.762+0000 7f351d687b80 10 client.27886 fetch_fsmap learned FSMap version 83 2023-07-21T22:42:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.762+0000 7f351d687b80 1 -- 172.21.15.151:0/3777373097 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=83,monmap=4+}) v3 -- 0x56309b08c250 con 0x56309b314660 2023-07-21T22:42:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.762+0000 7f34e2ffd700 1 -- 172.21.15.151:0/3777373097 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f34f409b100 con 0x56309b314660 2023-07-21T22:42:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.762+0000 7f34e2ffd700 1 -- 172.21.15.151:0/3777373097 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 83) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f34fc0259d0 con 0x56309b314660 2023-07-21T22:42:24.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.763+0000 7f351d687b80 10 client.27886 fetch_fsmap finished waiting for FSMap version 83 2023-07-21T22:42:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.763+0000 7f351d687b80 10 client.27886 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:42:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.763+0000 7f351d687b80 20 client.27886 populate_metadata read hostname 'smithi151' 2023-07-21T22:42:24.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.763+0000 7f351d687b80 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56309b37bf90 0x56309b37e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.763+0000 7f351d687b80 4 client.27886 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:42:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.763+0000 7f351d687b80 1 -- 172.21.15.151:0/3777373097 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56309b21aff0 con 0x56309b37bf90 2023-07-21T22:42:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.763+0000 7f35037fe700 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56309b37bf90 0x56309b37e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:24.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.763+0000 7f34e2ffd700 10 client.27886 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:24.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.763+0000 7f35037fe700 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56309b37bf90 0x56309b37e3a0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b664c10247e79f8 server_cookie=6137d9132e3b2475 in_seq=0 out_seq=0 2023-07-21T22:42:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f34e2ffd700 1 -- 172.21.15.151:0/3777373097 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56309b21aff0 con 0x56309b37bf90 2023-07-21T22:42:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f34e2ffd700 10 client.27886 handle_command_reply: tid=0 2023-07-21T22:42:24.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 client.27886 shutdown 2023-07-21T22:42:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 -- 172.21.15.151:0/3777373097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314660 msgr2=0x56309b37a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314660 0x56309b37a070 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009d70 tx=0x7f34fc004ad0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 -- 172.21.15.151:0/3777373097 shutdown_connections 2023-07-21T22:42:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56309b37bf90 0x56309b37e3a0 crc :-1 s=READY pgs=305 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56309b314660 0x56309b37a070 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56309b16a6b0 0x56309b36f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f34e2ffd700 0 client.27886 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 --2- 172.21.15.151:0/3777373097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56309b314210 0x56309b36f720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 -- 172.21.15.151:0/3777373097 >> 172.21.15.151:0/3777373097 conn(0x56309b303ae0 msgr2=0x56309b317430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:24.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 -- 172.21.15.151:0/3777373097 shutdown_connections 2023-07-21T22:42:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.771+0000 7f351d687b80 1 -- 172.21.15.151:0/3777373097 wait complete. 2023-07-21T22:42:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f351d687b80 20 client.27886 trim_cache size 0 max 16384 2023-07-21T22:42:24.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:42:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:42:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:42:24.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:42:24.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 -- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f34ec0a1340 msgr2=0x7f34ec0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f34ec0a1340 0x7f34ec0a37f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009fd0 tx=0x7f34fc004b40 comp rx=0 tx=0).stop 2023-07-21T22:42:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 -- 172.21.15.151:0/2146053260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3504072850 msgr2=0x7f3504197db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:24.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3504072850 0x7f3504197db0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f34f40098e0 tx=0x7f34f4004730 comp rx=0 tx=0).stop 2023-07-21T22:42:24.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 -- 172.21.15.151:0/2146053260 shutdown_connections 2023-07-21T22:42:24.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f34ec0a1340 0x7f34ec0a37f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3504072850 0x7f3504197db0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f350410c3b0 0x7f350419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 --2- 172.21.15.151:0/2146053260 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3504073160 0x7f35041982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:24.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 -- 172.21.15.151:0/2146053260 >> 172.21.15.151:0/2146053260 conn(0x7f35040fb5f0 msgr2=0x7f350410e530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:24.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 -- 172.21.15.151:0/2146053260 shutdown_connections 2023-07-21T22:42:24.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:24.772+0000 7f3509dff700 1 -- 172.21.15.151:0/2146053260 wait complete. 2023-07-21T22:42:24.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:24 smithi195 ceph-mon[97365]: pgmap v733: 97 pgs: 97 active+clean; 8.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:42:24.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:24 smithi151 ceph-mon[95510]: pgmap v733: 97 pgs: 97 active+clean; 8.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:42:25.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:24 smithi187 ceph-mon[96918]: pgmap v733: 97 pgs: 97 active+clean; 8.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:42:26.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:26 smithi195 ceph-mon[97365]: pgmap v734: 97 pgs: 97 active+clean; 8.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:42:26.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:26 smithi151 ceph-mon[95510]: pgmap v734: 97 pgs: 97 active+clean; 8.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:42:27.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:26 smithi187 ceph-mon[96918]: pgmap v734: 97 pgs: 97 active+clean; 8.2 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 364 op/s 2023-07-21T22:42:28.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:28 smithi195 ceph-mon[97365]: pgmap v735: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.9 MiB/s wr, 506 op/s 2023-07-21T22:42:28.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:28 smithi151 ceph-mon[95510]: pgmap v735: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.9 MiB/s wr, 506 op/s 2023-07-21T22:42:29.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:28 smithi187 ceph-mon[96918]: pgmap v735: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.9 MiB/s wr, 506 op/s 2023-07-21T22:42:30.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:30 smithi195 ceph-mon[97365]: pgmap v736: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.4 MiB/s wr, 306 op/s 2023-07-21T22:42:30.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:30 smithi151 ceph-mon[95510]: pgmap v736: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.4 MiB/s wr, 306 op/s 2023-07-21T22:42:31.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:30 smithi187 ceph-mon[96918]: pgmap v736: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.4 MiB/s wr, 306 op/s 2023-07-21T22:42:32.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:32 smithi151 ceph-mon[95510]: pgmap v737: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.4 MiB/s wr, 306 op/s 2023-07-21T22:42:32.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:32 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:42:33.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:32 smithi187 ceph-mon[96918]: pgmap v737: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.4 MiB/s wr, 306 op/s 2023-07-21T22:42:33.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:32 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:42:33.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:32 smithi195 ceph-mon[97365]: pgmap v737: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.4 MiB/s wr, 306 op/s 2023-07-21T22:42:33.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:32 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:42:34.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:34 smithi151 ceph-mon[95510]: pgmap v738: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 441 op/s 2023-07-21T22:42:35.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:34 smithi187 ceph-mon[96918]: pgmap v738: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 441 op/s 2023-07-21T22:42:35.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:34 smithi195 ceph-mon[97365]: pgmap v738: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.4 MiB/s wr, 441 op/s 2023-07-21T22:42:36.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:35 smithi187 ceph-mon[96918]: pgmap v739: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:42:36.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:35 smithi195 ceph-mon[97365]: pgmap v739: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:42:36.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:35 smithi151 ceph-mon[95510]: pgmap v739: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:42:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.943+0000 7f26c9fff700 1 -- 172.21.15.151:0/3629743398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c40ffb00 msgr2=0x7f26c40fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:37.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.943+0000 7f26c9fff700 1 --2- 172.21.15.151:0/3629743398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c40ffb00 0x7f26c40fff70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f26b800fb60 tx=0x7f26b800fe70 comp rx=0 tx=0).stop 2023-07-21T22:42:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.943+0000 7f26c9fff700 1 -- 172.21.15.151:0/3629743398 shutdown_connections 2023-07-21T22:42:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.943+0000 7f26c9fff700 1 --2- 172.21.15.151:0/3629743398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26c41004b0 0x7f26c410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.943+0000 7f26c9fff700 1 --2- 172.21.15.151:0/3629743398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26c4105b10 0x7f26c4105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.943+0000 7f26c9fff700 1 --2- 172.21.15.151:0/3629743398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c40ffb00 0x7f26c40fff70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.943+0000 7f26c9fff700 1 -- 172.21.15.151:0/3629743398 >> 172.21.15.151:0/3629743398 conn(0x7f26c40fb600 msgr2=0x7f26c40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.943+0000 7f26c9fff700 1 -- 172.21.15.151:0/3629743398 shutdown_connections 2023-07-21T22:42:37.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.943+0000 7f26c9fff700 1 -- 172.21.15.151:0/3629743398 wait complete. 2023-07-21T22:42:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.944+0000 7f26c9fff700 1 Processor -- start 2023-07-21T22:42:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.944+0000 7f26c9fff700 1 -- start start 2023-07-21T22:42:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c9fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26c40ffb00 0x7f26c4199ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c9fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26c41004b0 0x7f26c4199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c9fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c4105b10 0x7f26c4193910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:37.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c9fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c4193f80 con 0x7f26c40ffb00 2023-07-21T22:42:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c9fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c41940f0 con 0x7f26c41004b0 2023-07-21T22:42:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c9fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26c41942b0 con 0x7f26c4105b10 2023-07-21T22:42:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26c40ffb00 0x7f26c4199ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26c41004b0 0x7f26c4199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26c40ffb00 0x7f26c4199ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59520/0 (socket says 172.21.15.151:59520) 2023-07-21T22:42:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c37fe700 1 -- 172.21.15.151:0/472175998 learned_addr learned my addr 172.21.15.151:0/472175998 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.945+0000 7f26c3fff700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c4105b10 0x7f26c4193910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:37.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c37fe700 1 -- 172.21.15.151:0/472175998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c4105b10 msgr2=0x7f26c4193910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c37fe700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c4105b10 0x7f26c4193910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c37fe700 1 -- 172.21.15.151:0/472175998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26c41004b0 msgr2=0x7f26c4199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c37fe700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26c41004b0 0x7f26c4199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c37fe700 1 -- 172.21.15.151:0/472175998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26b800f790 con 0x7f26c40ffb00 2023-07-21T22:42:37.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26c41004b0 0x7f26c4199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:42:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c37fe700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26c40ffb00 0x7f26c4199ab0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f26b400e9c0 tx=0x7f26b400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c0ff9700 1 -- 172.21.15.151:0/472175998 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4004a30 con 0x7f26c40ffb00 2023-07-21T22:42:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c0ff9700 1 -- 172.21.15.151:0/472175998 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26b400cc50 con 0x7f26c40ffb00 2023-07-21T22:42:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c9fff700 1 -- 172.21.15.151:0/472175998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26c4194590 con 0x7f26c40ffb00 2023-07-21T22:42:37.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c0ff9700 1 -- 172.21.15.151:0/472175998 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4005410 con 0x7f26c40ffb00 2023-07-21T22:42:37.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.946+0000 7f26c9fff700 1 -- 172.21.15.151:0/472175998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26c41a0aa0 con 0x7f26c40ffb00 2023-07-21T22:42:37.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.951+0000 7f26c0ff9700 1 -- 172.21.15.151:0/472175998 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f26b4005570 con 0x7f26c40ffb00 2023-07-21T22:42:37.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.952+0000 7f26dd88db80 1 Processor -- start 2023-07-21T22:42:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.952+0000 7f26dd88db80 1 -- start start 2023-07-21T22:42:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f81e696b0 0x558f8201b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f8201ba20 0x558f82015750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:37.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26c0ff9700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26ac0a12c0 0x7f26ac0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:37.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f82015cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:37.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26dd88db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f81f12c50 con 0x558f8201be70 2023-07-21T22:42:37.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26dd88db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f81f659e0 con 0x558f8201ba20 2023-07-21T22:42:37.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26dd88db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f81f5ee70 con 0x558f81e696b0 2023-07-21T22:42:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26c3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f81e696b0 0x558f8201b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f8201ba20 0x558f82015750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:37.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26c3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f81e696b0 0x558f8201b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48890/0 (socket says 172.21.15.151:48890) 2023-07-21T22:42:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f8201ba20 0x558f82015750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39778/0 (socket says 172.21.15.151:39778) 2023-07-21T22:42:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26c3fff700 1 -- 172.21.15.151:0/3086920877 learned_addr learned my addr 172.21.15.151:0/3086920877 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26ac0a12c0 0x7f26ac0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:37.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26c3fff700 1 --2- 172.21.15.151:0/3086920877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f82015cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.953+0000 7f26c0ff9700 1 -- 172.21.15.151:0/472175998 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f26b4014070 con 0x7f26c40ffb00 2023-07-21T22:42:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.954+0000 7f26c3fff700 1 -- 172.21.15.151:0/3086920877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f8201ba20 msgr2=0x558f82015750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.954+0000 7f26c3fff700 1 --2- 172.21.15.151:0/3086920877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f8201ba20 0x558f82015750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.954+0000 7f26c3fff700 1 -- 172.21.15.151:0/3086920877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 msgr2=0x558f82015cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.954+0000 7f26c3fff700 1 --2- 172.21.15.151:0/3086920877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f82015cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.954+0000 7f26c3fff700 1 -- 172.21.15.151:0/3086920877 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f81d8cd80 con 0x558f81e696b0 2023-07-21T22:42:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.954+0000 7f26c3fff700 1 --2- 172.21.15.151:0/3086920877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f81e696b0 0x558f8201b4e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f26bc008c60 tx=0x7f26bc009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94322fe48506291b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:37.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.954+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26ac0a12c0 0x7f26ac0a3770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26b800fb30 tx=0x7f26b8005040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.954+0000 7f26a9ffb700 1 -- 172.21.15.151:0/3086920877 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc00e070 con 0x558f81e696b0 2023-07-21T22:42:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.954+0000 7f26a9ffb700 1 -- 172.21.15.151:0/3086920877 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26bc00f040 con 0x558f81e696b0 2023-07-21T22:42:37.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26a9ffb700 1 -- 172.21.15.151:0/3086920877 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26bc018a20 con 0x558f81e696b0 2023-07-21T22:42:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26dd88db80 1 -- 172.21.15.151:0/3086920877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f81e696b0 msgr2=0x558f8201b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26dd88db80 1 --2- 172.21.15.151:0/3086920877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f81e696b0 0x558f8201b4e0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f26bc008c60 tx=0x7f26bc009920 comp rx=0 tx=0).stop 2023-07-21T22:42:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26dd88db80 1 -- 172.21.15.151:0/3086920877 shutdown_connections 2023-07-21T22:42:38.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26dd88db80 1 --2- 172.21.15.151:0/3086920877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f82015cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26dd88db80 1 --2- 172.21.15.151:0/3086920877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f81e696b0 0x558f8201b4e0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26dd88db80 1 --2- 172.21.15.151:0/3086920877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f8201ba20 0x558f82015750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26dd88db80 1 -- 172.21.15.151:0/3086920877 >> 172.21.15.151:0/3086920877 conn(0x558f82002ae0 msgr2=0x558f820080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26dd88db80 1 -- 172.21.15.151:0/3086920877 shutdown_connections 2023-07-21T22:42:38.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.955+0000 7f26dd88db80 1 -- 172.21.15.151:0/3086920877 wait complete. 2023-07-21T22:42:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.956+0000 7f26dd88db80 1 -- start start 2023-07-21T22:42:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.956+0000 7f26dd88db80 1 Processor -- start 2023-07-21T22:42:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82021df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 0x558f8201f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f8201f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26dd88db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f81efea60 con 0x558f8201be70 2023-07-21T22:42:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26dd88db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f81efe760 con 0x558f81e696b0 2023-07-21T22:42:38.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26dd88db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f81de28c0 con 0x558f8201ba20 2023-07-21T22:42:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26dd88db80 10 client.0 _ll_register_callbacks cb 0x558f81efc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:42:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f8201f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f8201f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59546/0 (socket says 172.21.15.151:59546) 2023-07-21T22:42:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26c3fff700 1 -- 172.21.15.151:0/1265605681 learned_addr learned my addr 172.21.15.151:0/1265605681 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26c37fe700 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82021df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.957+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 0x558f8201f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26c37fe700 1 -- 172.21.15.151:0/1265605681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 msgr2=0x558f8201f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:38.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26c37fe700 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 0x558f8201f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26c37fe700 1 -- 172.21.15.151:0/1265605681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 msgr2=0x558f8201f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26c37fe700 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f8201f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26c37fe700 1 -- 172.21.15.151:0/1265605681 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26bc008910 con 0x558f81e696b0 2023-07-21T22:42:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26c37fe700 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82021df0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ca4d0 tx=0x7f26b400cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=173dacdd4749aa05 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:42:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26a2ffd700 1 -- 172.21.15.151:0/1265605681 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4074870 con 0x558f81e696b0 2023-07-21T22:42:38.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26a2ffd700 1 -- 172.21.15.151:0/1265605681 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f26b409de80 con 0x558f81e696b0 2023-07-21T22:42:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26dd88db80 1 -- 172.21.15.151:0/1265605681 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558f81eb8490 con 0x558f81e696b0 2023-07-21T22:42:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.958+0000 7f26a2ffd700 1 -- 172.21.15.151:0/1265605681 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26b4004da0 con 0x558f81e696b0 2023-07-21T22:42:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26dd88db80 10 client.27866 fetch_fsmap learned FSMap version 84 2023-07-21T22:42:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26dd88db80 1 -- 172.21.15.151:0/1265605681 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x558f81d75c00 con 0x558f81e696b0 2023-07-21T22:42:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26a2ffd700 1 -- 172.21.15.151:0/1265605681 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26b40b8030 con 0x558f81e696b0 2023-07-21T22:42:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26a2ffd700 1 -- 172.21.15.151:0/1265605681 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 84) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f26b409c040 con 0x558f81e696b0 2023-07-21T22:42:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26dd88db80 10 client.27866 fetch_fsmap finished waiting for FSMap version 84 2023-07-21T22:42:38.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26dd88db80 10 client.27866 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:42:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26dd88db80 20 client.27866 populate_metadata read hostname 'smithi151' 2023-07-21T22:42:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558f8202f410 0x558f82031820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26dd88db80 4 client.27866 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:42:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26dd88db80 1 -- 172.21.15.151:0/1265605681 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558f81f57e50 con 0x558f8202f410 2023-07-21T22:42:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.959+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558f8202f410 0x558f82031820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.960+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558f8202f410 0x558f82031820 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e8fd8d8718bd915 server_cookie=36055928da2c7b90 in_seq=0 out_seq=0 2023-07-21T22:42:38.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.960+0000 7f26a2ffd700 10 client.27866 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:38.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26a2ffd700 1 -- 172.21.15.151:0/1265605681 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558f81f57e50 con 0x558f8202f410 2023-07-21T22:42:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26a2ffd700 10 client.27866 handle_command_reply: tid=0 2023-07-21T22:42:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 client.27866 shutdown 2023-07-21T22:42:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 -- 172.21.15.151:0/1265605681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 msgr2=0x558f82021df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82021df0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f26b40ca4d0 tx=0x7f26b400cdc0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 -- 172.21.15.151:0/1265605681 shutdown_connections 2023-07-21T22:42:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558f8202f410 0x558f82031820 crc :-1 s=READY pgs=306 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82021df0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f8201f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26a2ffd700 0 client.27866 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1265605681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 0x558f8201f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 -- 172.21.15.151:0/1265605681 >> 172.21.15.151:0/1265605681 conn(0x558f82002ae0 msgr2=0x558f820073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.961+0000 7f26dd88db80 1 -- 172.21.15.151:0/1265605681 shutdown_connections 2023-07-21T22:42:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.962+0000 7f26dd88db80 1 -- 172.21.15.151:0/1265605681 wait complete. 2023-07-21T22:42:38.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.962+0000 7f26dd88db80 20 client.27866 trim_cache size 0 max 16384 2023-07-21T22:42:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.979+0000 7f26dd88db80 1 Processor -- start 2023-07-21T22:42:38.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26dd88db80 1 -- start start 2023-07-21T22:42:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f820249b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 0x558f8201a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f82007b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26dd88db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f8202c9f0 con 0x558f8201be70 2023-07-21T22:42:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26dd88db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f82009910 con 0x558f81e696b0 2023-07-21T22:42:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26dd88db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f82019d80 con 0x558f8201ba20 2023-07-21T22:42:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f820249b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26c2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 0x558f8201a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26c3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f82007b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f820249b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39800/0 (socket says 172.21.15.151:39800) 2023-07-21T22:42:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.980+0000 7f26c37fe700 1 -- 172.21.15.151:0/1782921489 learned_addr learned my addr 172.21.15.151:0/1782921489 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.981+0000 7f26c37fe700 1 -- 172.21.15.151:0/1782921489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 msgr2=0x558f8201a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.981+0000 7f26c37fe700 1 --2- 172.21.15.151:0/1782921489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 0x558f8201a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.981+0000 7f26c37fe700 1 -- 172.21.15.151:0/1782921489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 msgr2=0x558f82007b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:38.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.981+0000 7f26c37fe700 1 --2- 172.21.15.151:0/1782921489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f82007b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.981+0000 7f26c37fe700 1 -- 172.21.15.151:0/1782921489 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558f81db31f0 con 0x558f81e696b0 2023-07-21T22:42:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.981+0000 7f26c37fe700 1 --2- 172.21.15.151:0/1782921489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f820249b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f26b4099b50 tx=0x7f26b40962c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0a2588ac23fcd9e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.981+0000 7f26aa7fc700 1 -- 172.21.15.151:0/1782921489 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b4004da0 con 0x558f81e696b0 2023-07-21T22:42:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.981+0000 7f26aa7fc700 1 -- 172.21.15.151:0/1782921489 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26b40b8040 con 0x558f81e696b0 2023-07-21T22:42:38.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.981+0000 7f26aa7fc700 1 -- 172.21.15.151:0/1782921489 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b409a2f0 con 0x558f81e696b0 2023-07-21T22:42:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.982+0000 7f26dd88db80 1 -- 172.21.15.151:0/1782921489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 msgr2=0x558f820249b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.982+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1782921489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f820249b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f26b4099b50 tx=0x7f26b40962c0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.982+0000 7f26dd88db80 1 -- 172.21.15.151:0/1782921489 shutdown_connections 2023-07-21T22:42:38.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.982+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1782921489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f820249b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.982+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1782921489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201be70 0x558f82007b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.982+0000 7f26dd88db80 1 --2- 172.21.15.151:0/1782921489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201ba20 0x558f8201a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.982+0000 7f26dd88db80 1 -- 172.21.15.151:0/1782921489 >> 172.21.15.151:0/1782921489 conn(0x558f82002ae0 msgr2=0x558f8201cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:38.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.982+0000 7f26dd88db80 1 -- 172.21.15.151:0/1782921489 shutdown_connections 2023-07-21T22:42:38.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.982+0000 7f26dd88db80 1 -- 172.21.15.151:0/1782921489 wait complete. 2023-07-21T22:42:38.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26dd88db80 1 -- start start 2023-07-21T22:42:38.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26dd88db80 1 Processor -- start 2023-07-21T22:42:38.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82023120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201ba20 0x558f82023660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26dd88db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201be70 0x558f82023ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26dd88db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f820832a0 con 0x558f8201ba20 2023-07-21T22:42:38.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26dd88db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f820833e0 con 0x558f81e696b0 2023-07-21T22:42:38.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26dd88db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558f820835a0 con 0x558f8201be70 2023-07-21T22:42:38.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26dd88db80 10 client.0 _ll_register_callbacks cb 0x7f26b40999f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:42:38.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.983+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82023120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82023120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39802/0 (socket says 172.21.15.151:39802) 2023-07-21T22:42:38.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c37fe700 1 -- 172.21.15.151:0/601901980 learned_addr learned my addr 172.21.15.151:0/601901980 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:38.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201ba20 0x558f82023660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c3fff700 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201be70 0x558f82023ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c37fe700 1 -- 172.21.15.151:0/601901980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201be70 msgr2=0x558f82023ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c37fe700 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201be70 0x558f82023ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c37fe700 1 -- 172.21.15.151:0/601901980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201ba20 msgr2=0x558f82023660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c37fe700 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201ba20 0x558f82023660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c37fe700 1 -- 172.21.15.151:0/601901980 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558f81d75c00 con 0x558f81e696b0 2023-07-21T22:42:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201ba20 0x558f82023660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:42:38.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26c37fe700 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82023120 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f26b400f010 tx=0x7f26b400cdc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1eb2a5f9ca934968 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:38.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.984+0000 7f26a2ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:42:38.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26a2ffd700 1 -- 172.21.15.151:0/601901980 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26b40a2010 con 0x558f81e696b0 2023-07-21T22:42:38.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26a2ffd700 1 -- 172.21.15.151:0/601901980 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f26b409de80 con 0x558f81e696b0 2023-07-21T22:42:38.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26dd88db80 1 -- 172.21.15.151:0/601901980 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f26bc00f040 con 0x558f81e696b0 2023-07-21T22:42:38.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26a2ffd700 1 -- 172.21.15.151:0/601901980 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) v2 ==== 24+0+0 (secure 0 0 0) 0x7f26b409a2c0 con 0x558f81e696b0 2023-07-21T22:42:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26dd88db80 10 client.27872 fetch_fsmap learned FSMap version 84 2023-07-21T22:42:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26dd88db80 1 -- 172.21.15.151:0/601901980 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) v3 -- 0x558f81d8b250 con 0x558f81e696b0 2023-07-21T22:42:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26a2ffd700 1 -- 172.21.15.151:0/601901980 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f26b407c020 con 0x558f81e696b0 2023-07-21T22:42:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26a2ffd700 1 -- 172.21.15.151:0/601901980 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 84) v1 ==== 7482+0+0 (secure 0 0 0) 0x7f26b4078d20 con 0x558f81e696b0 2023-07-21T22:42:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26dd88db80 10 client.27872 fetch_fsmap finished waiting for FSMap version 84 2023-07-21T22:42:38.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26dd88db80 10 client.27872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:42:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26dd88db80 20 client.27872 populate_metadata read hostname 'smithi151' 2023-07-21T22:42:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26dd88db80 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558f82084800 0x558f82086be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26dd88db80 4 client.27872 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:42:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.985+0000 7f26dd88db80 1 -- 172.21.15.151:0/601901980 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558f81f19ff0 con 0x558f82084800 2023-07-21T22:42:38.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.986+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558f82084800 0x558f82086be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.986+0000 7f26c2ffd700 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558f82084800 0x558f82086be0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45880f0139032735 server_cookie=848541167ed8bb5 in_seq=0 out_seq=0 2023-07-21T22:42:38.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:37.986+0000 7f26a2ffd700 10 client.27872 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.003+0000 7f26a2ffd700 1 -- 172.21.15.151:0/601901980 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558f81f19ff0 con 0x558f82084800 2023-07-21T22:42:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.003+0000 7f26a2ffd700 10 client.27872 handle_command_reply: tid=0 2023-07-21T22:42:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.003+0000 7f26dd88db80 1 client.27872 shutdown 2023-07-21T22:42:38.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 -- 172.21.15.151:0/601901980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 msgr2=0x558f82023120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82023120 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f26b400f010 tx=0x7f26b400cdc0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 -- 172.21.15.151:0/601901980 shutdown_connections 2023-07-21T22:42:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558f82084800 0x558f82086be0 crc :-1 s=READY pgs=307 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558f81e696b0 0x558f82023120 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558f8201be70 0x558f82023ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 --2- 172.21.15.151:0/601901980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f8201ba20 0x558f82023660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26a2ffd700 0 client.27872 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:38.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 -- 172.21.15.151:0/601901980 >> 172.21.15.151:0/601901980 conn(0x558f82002ae0 msgr2=0x558f8201cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 -- 172.21.15.151:0/601901980 shutdown_connections 2023-07-21T22:42:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 1 -- 172.21.15.151:0/601901980 wait complete. 2023-07-21T22:42:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.004+0000 7f26dd88db80 20 client.27872 trim_cache size 0 max 16384 2023-07-21T22:42:38.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:42:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:42:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:42:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:42:38.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 -- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26ac0a12c0 msgr2=0x7f26ac0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26ac0a12c0 0x7f26ac0a3770 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26b800fb30 tx=0x7f26b8005040 comp rx=0 tx=0).stop 2023-07-21T22:42:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 -- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26c40ffb00 msgr2=0x7f26c4199ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26c40ffb00 0x7f26c4199ab0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f26b400e9c0 tx=0x7f26b400ecd0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 -- 172.21.15.151:0/472175998 shutdown_connections 2023-07-21T22:42:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f26ac0a12c0 0x7f26ac0a3770 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f26c4105b10 0x7f26c4193910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f26c40ffb00 0x7f26c4199ab0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 --2- 172.21.15.151:0/472175998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26c41004b0 0x7f26c4199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 -- 172.21.15.151:0/472175998 >> 172.21.15.151:0/472175998 conn(0x7f26c40fb600 msgr2=0x7f26c40fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 -- 172.21.15.151:0/472175998 shutdown_connections 2023-07-21T22:42:38.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:38.005+0000 7f26c9fff700 1 -- 172.21.15.151:0/472175998 wait complete. 2023-07-21T22:42:38.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:38 smithi187 ceph-mon[96918]: pgmap v740: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.4 MiB/s wr, 440 op/s 2023-07-21T22:42:38.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:38 smithi195 ceph-mon[97365]: pgmap v740: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.4 MiB/s wr, 440 op/s 2023-07-21T22:42:38.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:38 smithi151 ceph-mon[95510]: pgmap v740: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.4 MiB/s wr, 440 op/s 2023-07-21T22:42:40.873 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:40 smithi187 ceph-mon[96918]: pgmap v741: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-07-21T22:42:40.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:40 smithi195 ceph-mon[97365]: pgmap v741: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-07-21T22:42:40.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:40 smithi151 ceph-mon[95510]: pgmap v741: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-07-21T22:42:42.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:42 smithi187 ceph-mon[96918]: pgmap v742: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-07-21T22:42:42.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:42 smithi195 ceph-mon[97365]: pgmap v742: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-07-21T22:42:42.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:42 smithi151 ceph-mon[95510]: pgmap v742: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.3 MiB/s wr, 296 op/s 2023-07-21T22:42:44.873 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:44 smithi187 ceph-mon[96918]: pgmap v743: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.5 MiB/s wr, 463 op/s 2023-07-21T22:42:44.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:44 smithi195 ceph-mon[97365]: pgmap v743: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.5 MiB/s wr, 463 op/s 2023-07-21T22:42:44.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:44 smithi151 ceph-mon[95510]: pgmap v743: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 3.5 MiB/s wr, 463 op/s 2023-07-21T22:42:45.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:45 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:42:45.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:45 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:42:45.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:45 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:42:46.873 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:46 smithi187 ceph-mon[96918]: pgmap v744: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2023-07-21T22:42:46.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:46 smithi195 ceph-mon[97365]: pgmap v744: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2023-07-21T22:42:46.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:46 smithi151 ceph-mon[95510]: pgmap v744: 97 pgs: 97 active+clean; 8.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2023-07-21T22:42:48.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:48 smithi187 ceph-mon[96918]: pgmap v745: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.5 MiB/s wr, 466 op/s 2023-07-21T22:42:48.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:48 smithi195 ceph-mon[97365]: pgmap v745: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.5 MiB/s wr, 466 op/s 2023-07-21T22:42:48.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:48 smithi151 ceph-mon[95510]: pgmap v745: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 3.5 MiB/s wr, 466 op/s 2023-07-21T22:42:50.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:50 smithi195 ceph-mon[97365]: pgmap v746: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 305 op/s 2023-07-21T22:42:50.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:50 smithi151 ceph-mon[95510]: pgmap v746: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 305 op/s 2023-07-21T22:42:51.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:50 smithi187 ceph-mon[96918]: pgmap v746: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 305 op/s 2023-07-21T22:42:51.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.183+0000 7feb9d7ff700 1 -- 172.21.15.151:0/2318518711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb981004b0 msgr2=0x7feb9810c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.183+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/2318518711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb981004b0 0x7feb9810c940 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7feb90009990 tx=0x7feb90009ca0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.183+0000 7feb9d7ff700 1 -- 172.21.15.151:0/2318518711 shutdown_connections 2023-07-21T22:42:51.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.183+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/2318518711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb98105b10 0x7feb98105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.183+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/2318518711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb981004b0 0x7feb9810c940 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.183+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/2318518711 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb980ffb00 0x7feb980fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.183+0000 7feb9d7ff700 1 -- 172.21.15.151:0/2318518711 >> 172.21.15.151:0/2318518711 conn(0x7feb980fb600 msgr2=0x7feb980fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:51.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.183+0000 7feb9d7ff700 1 -- 172.21.15.151:0/2318518711 shutdown_connections 2023-07-21T22:42:51.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.183+0000 7feb9d7ff700 1 -- 172.21.15.151:0/2318518711 wait complete. 2023-07-21T22:42:51.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.184+0000 7feb9d7ff700 1 Processor -- start 2023-07-21T22:42:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb9d7ff700 1 -- start start 2023-07-21T22:42:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb9d7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb980ffb00 0x7feb9819dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb9d7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb981004b0 0x7feb9819e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb9d7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb98105b10 0x7feb98197ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb9d7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98198150 con 0x7feb981004b0 2023-07-21T22:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb9d7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb981982c0 con 0x7feb98105b10 2023-07-21T22:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb9d7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb98198480 con 0x7feb980ffb00 2023-07-21T22:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb967fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb981004b0 0x7feb9819e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb980ffb00 0x7feb9819dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb980ffb00 0x7feb9819dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58732/0 (socket says 172.21.15.151:58732) 2023-07-21T22:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.185+0000 7feb96ffd700 1 -- 172.21.15.151:0/229214235 learned_addr learned my addr 172.21.15.151:0/229214235 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb977fe700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb98105b10 0x7feb98197ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb96ffd700 1 -- 172.21.15.151:0/229214235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb98105b10 msgr2=0x7feb98197ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:51.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb96ffd700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb98105b10 0x7feb98197ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb96ffd700 1 -- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb981004b0 msgr2=0x7feb9819e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb96ffd700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb981004b0 0x7feb9819e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb96ffd700 1 -- 172.21.15.151:0/229214235 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb900095f0 con 0x7feb980ffb00 2023-07-21T22:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb967fc700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb981004b0 0x7feb9819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:42:51.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb96ffd700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb980ffb00 0x7feb9819dc80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feb8800ef10 tx=0x7feb8800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb7ffff700 1 -- 172.21.15.151:0/229214235 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800ca70 con 0x7feb980ffb00 2023-07-21T22:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb9d7ff700 1 -- 172.21.15.151:0/229214235 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb98198700 con 0x7feb980ffb00 2023-07-21T22:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb7ffff700 1 -- 172.21.15.151:0/229214235 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb8800f040 con 0x7feb980ffb00 2023-07-21T22:42:51.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.186+0000 7feb7ffff700 1 -- 172.21.15.151:0/229214235 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88014480 con 0x7feb980ffb00 2023-07-21T22:42:51.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.187+0000 7feb9d7ff700 1 -- 172.21.15.151:0/229214235 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb981a4c70 con 0x7feb980ffb00 2023-07-21T22:42:51.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.190+0000 7feb7ffff700 1 -- 172.21.15.151:0/229214235 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7feb88007500 con 0x7feb980ffb00 2023-07-21T22:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.192+0000 7febb11aeb80 1 Processor -- start 2023-07-21T22:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.192+0000 7febb11aeb80 1 -- start start 2023-07-21T22:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.192+0000 7feb7ffff700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feb800a12c0 0x7feb800a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.192+0000 7feb7ffff700 1 -- 172.21.15.151:0/229214235 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feb880ccfb0 con 0x7feb980ffb00 2023-07-21T22:42:51.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d0492cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d048cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d048d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7febb11aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d0392c50 con 0x55f7d0493210 2023-07-21T22:42:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7febb11aeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d03e59e0 con 0x55f7d02e96b0 2023-07-21T22:42:51.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7febb11aeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d03dee70 con 0x55f7d0493660 2023-07-21T22:42:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d0492cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d0492cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43776/0 (socket says 172.21.15.151:43776) 2023-07-21T22:42:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d048d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb96ffd700 1 -- 172.21.15.151:0/2189928820 learned_addr learned my addr 172.21.15.151:0/2189928820 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb967fc700 1 --2- 172.21.15.151:0/2189928820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d048cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb977fe700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feb800a12c0 0x7feb800a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb96ffd700 1 -- 172.21.15.151:0/2189928820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 msgr2=0x55f7d048d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb96ffd700 1 --2- 172.21.15.151:0/2189928820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d048d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb96ffd700 1 -- 172.21.15.151:0/2189928820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 msgr2=0x55f7d048cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb96ffd700 1 --2- 172.21.15.151:0/2189928820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d048cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.193+0000 7feb96ffd700 1 -- 172.21.15.151:0/2189928820 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7d020cd80 con 0x55f7d02e96b0 2023-07-21T22:42:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.194+0000 7feb96ffd700 1 --2- 172.21.15.151:0/2189928820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d0492cd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feb880965a0 tx=0x7feb88099be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9b3c4c48bab3028 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.194+0000 7feb977fe700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feb800a12c0 0x7feb800a3770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb90005f50 tx=0x7feb90005fb0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:51.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.194+0000 7feb7d7fa700 1 -- 172.21.15.151:0/2189928820 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8809a0a0 con 0x55f7d02e96b0 2023-07-21T22:42:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.194+0000 7feb7d7fa700 1 -- 172.21.15.151:0/2189928820 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb8809e0d0 con 0x55f7d02e96b0 2023-07-21T22:42:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.194+0000 7feb7d7fa700 1 -- 172.21.15.151:0/2189928820 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8809a300 con 0x55f7d02e96b0 2023-07-21T22:42:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.195+0000 7febb11aeb80 1 -- 172.21.15.151:0/2189928820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 msgr2=0x55f7d0492cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.195+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2189928820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d0492cd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7feb880965a0 tx=0x7feb88099be0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.195+0000 7febb11aeb80 1 -- 172.21.15.151:0/2189928820 shutdown_connections 2023-07-21T22:42:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.195+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2189928820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d0492cd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.195+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2189928820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d048d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.195+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2189928820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d048cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.195+0000 7febb11aeb80 1 -- 172.21.15.151:0/2189928820 >> 172.21.15.151:0/2189928820 conn(0x55f7d0482ae0 msgr2=0x55f7d04880e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:51.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.195+0000 7febb11aeb80 1 -- 172.21.15.151:0/2189928820 shutdown_connections 2023-07-21T22:42:51.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.195+0000 7febb11aeb80 1 -- 172.21.15.151:0/2189928820 wait complete. 2023-07-21T22:42:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.196+0000 7febb11aeb80 1 -- start start 2023-07-21T22:42:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.196+0000 7febb11aeb80 1 Processor -- start 2023-07-21T22:42:51.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d04995d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d0496850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d0496f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7febb11aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d037ea60 con 0x55f7d0493210 2023-07-21T22:42:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7febb11aeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d037e760 con 0x55f7d02e96b0 2023-07-21T22:42:51.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7febb11aeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d02628c0 con 0x55f7d0493660 2023-07-21T22:42:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7febb11aeb80 10 client.0 _ll_register_callbacks cb 0x55f7d037c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:42:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7feb967fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d0496850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7feb977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d0496f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7feb977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d0496f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58750/0 (socket says 172.21.15.151:58750) 2023-07-21T22:42:51.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7feb967fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d0496850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41432/0 (socket says 172.21.15.151:41432) 2023-07-21T22:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7feb977fe700 1 -- 172.21.15.151:0/89795785 learned_addr learned my addr 172.21.15.151:0/89795785 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.197+0000 7feb96ffd700 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d04995d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb977fe700 1 -- 172.21.15.151:0/89795785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 msgr2=0x55f7d04995d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:51.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb977fe700 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d04995d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb977fe700 1 -- 172.21.15.151:0/89795785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 msgr2=0x55f7d0496850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb977fe700 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d0496850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb977fe700 1 -- 172.21.15.151:0/89795785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb981a4c70 con 0x55f7d0493660 2023-07-21T22:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb96ffd700 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d04995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:42:51.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb977fe700 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d0496f90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feb90015000 tx=0x7feb90009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=380f59508f24bf92 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb7aff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb7aff5700 1 -- 172.21.15.151:0/89795785 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb90004d10 con 0x55f7d0493660 2023-07-21T22:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7feb7aff5700 1 -- 172.21.15.151:0/89795785 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feb90027480 con 0x55f7d0493660 2023-07-21T22:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.198+0000 7febb11aeb80 1 -- 172.21.15.151:0/89795785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f7d0338490 con 0x55f7d0493660 2023-07-21T22:42:51.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7feb7aff5700 1 -- 172.21.15.151:0/89795785 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb90004e70 con 0x55f7d0493660 2023-07-21T22:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7febb11aeb80 10 client.27916 fetch_fsmap learned FSMap version 85 2023-07-21T22:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7febb11aeb80 1 -- 172.21.15.151:0/89795785 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=4+}) v3 -- 0x55f7d01f5c00 con 0x55f7d0493660 2023-07-21T22:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7feb7aff5700 1 -- 172.21.15.151:0/89795785 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f7d0338490 con 0x55f7d0493660 2023-07-21T22:42:51.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7feb7aff5700 1 -- 172.21.15.151:0/89795785 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 85) v1 ==== 7478+0+0 (secure 0 0 0) 0x7feb900295e0 con 0x55f7d0493660 2023-07-21T22:42:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7febb11aeb80 10 client.27916 fetch_fsmap finished waiting for FSMap version 85 2023-07-21T22:42:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7febb11aeb80 10 client.27916 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:42:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7febb11aeb80 20 client.27916 populate_metadata read hostname 'smithi151' 2023-07-21T22:42:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7febb11aeb80 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7d04a6be0 0x55f7d04a8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7febb11aeb80 4 client.27916 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:42:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.199+0000 7febb11aeb80 1 -- 172.21.15.151:0/89795785 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7d03d7e50 con 0x55f7d04a6be0 2023-07-21T22:42:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.200+0000 7feb96ffd700 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7d04a6be0 0x55f7d04a8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.200+0000 7feb96ffd700 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7d04a6be0 0x55f7d04a8ff0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35a150800cd37f4f server_cookie=7ceb7ce31cfc4ca5 in_seq=0 out_seq=0 2023-07-21T22:42:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.200+0000 7feb7aff5700 10 client.27916 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:51.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.201+0000 7feb7aff5700 1 -- 172.21.15.151:0/89795785 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f7d03d7e50 con 0x55f7d04a6be0 2023-07-21T22:42:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.201+0000 7feb7aff5700 10 client.27916 handle_command_reply: tid=0 2023-07-21T22:42:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.201+0000 7febb11aeb80 1 client.27916 shutdown 2023-07-21T22:42:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.201+0000 7febb11aeb80 1 -- 172.21.15.151:0/89795785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 msgr2=0x55f7d0496f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:51.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.201+0000 7febb11aeb80 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d0496f90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7feb90015000 tx=0x7feb90009ca0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7febb11aeb80 1 -- 172.21.15.151:0/89795785 shutdown_connections 2023-07-21T22:42:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7febb11aeb80 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7d04a6be0 0x55f7d04a8ff0 crc :-1 s=READY pgs=308 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7febb11aeb80 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d04995d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7febb11aeb80 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d0496f90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7feb7aff5700 0 client.27916 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7febb11aeb80 1 --2- 172.21.15.151:0/89795785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d0496850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7febb11aeb80 1 -- 172.21.15.151:0/89795785 >> 172.21.15.151:0/89795785 conn(0x55f7d0482ae0 msgr2=0x55f7d04873e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7febb11aeb80 1 -- 172.21.15.151:0/89795785 shutdown_connections 2023-07-21T22:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7febb11aeb80 1 -- 172.21.15.151:0/89795785 wait complete. 2023-07-21T22:42:51.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.202+0000 7febb11aeb80 20 client.27916 trim_cache size 0 max 16384 2023-07-21T22:42:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.220+0000 7febb11aeb80 1 Processor -- start 2023-07-21T22:42:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7febb11aeb80 1 -- start start 2023-07-21T22:42:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d02e96b0 0x55f7d049dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d0487b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d0493660 0x55f7d048f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7febb11aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d04a41e0 con 0x55f7d0493210 2023-07-21T22:42:51.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7febb11aeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d0484c00 con 0x55f7d0493660 2023-07-21T22:42:51.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7febb11aeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d0488d50 con 0x55f7d02e96b0 2023-07-21T22:42:51.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d02e96b0 0x55f7d049dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7feb967fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d0487b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d02e96b0 0x55f7d049dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58762/0 (socket says 172.21.15.151:58762) 2023-07-21T22:42:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7feb96ffd700 1 -- 172.21.15.151:0/3966328820 learned_addr learned my addr 172.21.15.151:0/3966328820 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:51.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.221+0000 7feb977fe700 1 --2- 172.21.15.151:0/3966328820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d0493660 0x55f7d048f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.222+0000 7feb96ffd700 1 -- 172.21.15.151:0/3966328820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d0493660 msgr2=0x55f7d048f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.222+0000 7feb96ffd700 1 --2- 172.21.15.151:0/3966328820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d0493660 0x55f7d048f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.222+0000 7feb96ffd700 1 -- 172.21.15.151:0/3966328820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 msgr2=0x55f7d0487b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.222+0000 7feb96ffd700 1 --2- 172.21.15.151:0/3966328820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d0487b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.222+0000 7feb96ffd700 1 -- 172.21.15.151:0/3966328820 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7d04adc20 con 0x55f7d02e96b0 2023-07-21T22:42:51.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.222+0000 7feb96ffd700 1 --2- 172.21.15.151:0/3966328820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d02e96b0 0x55f7d049dba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feb880ca7d0 tx=0x7feb88009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f58e79bee391f15 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:51.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.222+0000 7feb7dffb700 1 -- 172.21.15.151:0/3966328820 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8800cd60 con 0x55f7d02e96b0 2023-07-21T22:42:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.222+0000 7feb7dffb700 1 -- 172.21.15.151:0/3966328820 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb880077b0 con 0x55f7d02e96b0 2023-07-21T22:42:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.222+0000 7feb7dffb700 1 -- 172.21.15.151:0/3966328820 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb8809a560 con 0x55f7d02e96b0 2023-07-21T22:42:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.223+0000 7febb11aeb80 1 -- 172.21.15.151:0/3966328820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d02e96b0 msgr2=0x55f7d049dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.223+0000 7febb11aeb80 1 --2- 172.21.15.151:0/3966328820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d02e96b0 0x55f7d049dba0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7feb880ca7d0 tx=0x7feb88009eb0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.223+0000 7febb11aeb80 1 -- 172.21.15.151:0/3966328820 shutdown_connections 2023-07-21T22:42:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.223+0000 7febb11aeb80 1 --2- 172.21.15.151:0/3966328820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d0493660 0x55f7d048f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.223+0000 7febb11aeb80 1 --2- 172.21.15.151:0/3966328820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d02e96b0 0x55f7d049dba0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.223+0000 7febb11aeb80 1 --2- 172.21.15.151:0/3966328820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d0487b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.223+0000 7febb11aeb80 1 -- 172.21.15.151:0/3966328820 >> 172.21.15.151:0/3966328820 conn(0x55f7d0482ae0 msgr2=0x55f7d0490a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.223+0000 7febb11aeb80 1 -- 172.21.15.151:0/3966328820 shutdown_connections 2023-07-21T22:42:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.223+0000 7febb11aeb80 1 -- 172.21.15.151:0/3966328820 wait complete. 2023-07-21T22:42:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.224+0000 7febb11aeb80 1 -- start start 2023-07-21T22:42:51.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.224+0000 7febb11aeb80 1 Processor -- start 2023-07-21T22:42:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.224+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d049d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.224+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d049ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.224+0000 7febb11aeb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d04958a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.224+0000 7febb11aeb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d0495f80 con 0x55f7d0493210 2023-07-21T22:42:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.224+0000 7febb11aeb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d04960f0 con 0x55f7d02e96b0 2023-07-21T22:42:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.224+0000 7febb11aeb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7d04962b0 con 0x55f7d0493660 2023-07-21T22:42:51.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7febb11aeb80 10 client.0 _ll_register_callbacks cb 0x7feb90005360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:42:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d049d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d04958a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb96ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d049d880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43806/0 (socket says 172.21.15.151:43806) 2023-07-21T22:42:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d04958a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58776/0 (socket says 172.21.15.151:58776) 2023-07-21T22:42:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb96ffd700 1 -- 172.21.15.151:0/2661224846 learned_addr learned my addr 172.21.15.151:0/2661224846 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:42:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb967fc700 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d049ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb96ffd700 1 -- 172.21.15.151:0/2661224846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 msgr2=0x55f7d04958a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb96ffd700 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d04958a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb96ffd700 1 -- 172.21.15.151:0/2661224846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 msgr2=0x55f7d049ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:42:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb96ffd700 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d049ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.225+0000 7feb96ffd700 1 -- 172.21.15.151:0/2661224846 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f7d020cd80 con 0x55f7d02e96b0 2023-07-21T22:42:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.226+0000 7feb96ffd700 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d049d880 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feb88009c10 tx=0x7feb880998a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=79c531e11b8894d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:42:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.226+0000 7feb7aff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:42:51.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.226+0000 7feb7aff5700 1 -- 172.21.15.151:0/2661224846 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb88098500 con 0x55f7d02e96b0 2023-07-21T22:42:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.226+0000 7feb7aff5700 1 -- 172.21.15.151:0/2661224846 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feb8809a300 con 0x55f7d02e96b0 2023-07-21T22:42:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.226+0000 7febb11aeb80 1 -- 172.21.15.151:0/2661224846 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feb8809e0d0 con 0x55f7d02e96b0 2023-07-21T22:42:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.226+0000 7feb7aff5700 1 -- 172.21.15.151:0/2661224846 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=85) v2 ==== 24+0+0 (secure 0 0 0) 0x7feb8809a4c0 con 0x55f7d02e96b0 2023-07-21T22:42:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.226+0000 7febb11aeb80 10 client.27890 fetch_fsmap learned FSMap version 85 2023-07-21T22:42:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.226+0000 7febb11aeb80 1 -- 172.21.15.151:0/2661224846 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=85,monmap=4+}) v3 -- 0x55f7d02331f0 con 0x55f7d02e96b0 2023-07-21T22:42:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.226+0000 7feb7aff5700 1 -- 172.21.15.151:0/2661224846 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feb8807c080 con 0x55f7d02e96b0 2023-07-21T22:42:51.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.227+0000 7feb7aff5700 1 -- 172.21.15.151:0/2661224846 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 85) v1 ==== 7478+0+0 (secure 0 0 0) 0x7feb88095e90 con 0x55f7d02e96b0 2023-07-21T22:42:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.227+0000 7febb11aeb80 10 client.27890 fetch_fsmap finished waiting for FSMap version 85 2023-07-21T22:42:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.227+0000 7febb11aeb80 10 client.27890 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:42:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.227+0000 7febb11aeb80 20 client.27890 populate_metadata read hostname 'smithi151' 2023-07-21T22:42:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.227+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7d04fb820 0x55f7d04fdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:42:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.227+0000 7febb11aeb80 4 client.27890 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:42:51.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.227+0000 7febb11aeb80 1 -- 172.21.15.151:0/2661224846 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f7d0399ff0 con 0x55f7d04fb820 2023-07-21T22:42:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.227+0000 7feb967fc700 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7d04fb820 0x55f7d04fdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:42:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.228+0000 7feb7aff5700 10 client.27890 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:51.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.228+0000 7feb967fc700 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7d04fb820 0x55f7d04fdc00 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db7539046c12758 server_cookie=25545ffcf783e66 in_seq=0 out_seq=0 2023-07-21T22:42:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7feb7aff5700 1 -- 172.21.15.151:0/2661224846 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f7d0399ff0 con 0x55f7d04fb820 2023-07-21T22:42:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7feb7aff5700 10 client.27890 handle_command_reply: tid=0 2023-07-21T22:42:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 client.27890 shutdown 2023-07-21T22:42:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 -- 172.21.15.151:0/2661224846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 msgr2=0x55f7d049d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:51.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d049d880 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7feb88009c10 tx=0x7feb880998a0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 -- 172.21.15.151:0/2661224846 shutdown_connections 2023-07-21T22:42:51.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7d04fb820 0x55f7d04fdc00 crc :-1 s=READY pgs=309 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7d02e96b0 0x55f7d049d880 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7feb7aff5700 0 client.27890 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:42:51.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7d0493660 0x55f7d04958a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 --2- 172.21.15.151:0/2661224846 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7d0493210 0x55f7d049ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 -- 172.21.15.151:0/2661224846 >> 172.21.15.151:0/2661224846 conn(0x55f7d0482ae0 msgr2=0x55f7d04921c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:51.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 -- 172.21.15.151:0/2661224846 shutdown_connections 2023-07-21T22:42:51.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 1 -- 172.21.15.151:0/2661224846 wait complete. 2023-07-21T22:42:51.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.238+0000 7febb11aeb80 20 client.27890 trim_cache size 0 max 16384 2023-07-21T22:42:51.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:42:51.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:42:51.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:42:51.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:42:51.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 -- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feb800a12c0 msgr2=0x7feb800a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:51.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feb800a12c0 0x7feb800a3770 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7feb90005f50 tx=0x7feb90005fb0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 -- 172.21.15.151:0/229214235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb980ffb00 msgr2=0x7feb9819dc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:42:51.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb980ffb00 0x7feb9819dc80 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7feb8800ef10 tx=0x7feb8800c3a0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 -- 172.21.15.151:0/229214235 shutdown_connections 2023-07-21T22:42:51.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feb800a12c0 0x7feb800a3770 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb98105b10 0x7feb98197ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feb980ffb00 0x7feb9819dc80 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 --2- 172.21.15.151:0/229214235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb981004b0 0x7feb9819e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:42:51.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.239+0000 7feb9d7ff700 1 -- 172.21.15.151:0/229214235 >> 172.21.15.151:0/229214235 conn(0x7feb980fb600 msgr2=0x7feb9810ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:42:51.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.240+0000 7feb9d7ff700 1 -- 172.21.15.151:0/229214235 shutdown_connections 2023-07-21T22:42:51.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:42:51.240+0000 7feb9d7ff700 1 -- 172.21.15.151:0/229214235 wait complete. 2023-07-21T22:42:52.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:52 smithi195 ceph-mon[97365]: pgmap v747: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 305 op/s 2023-07-21T22:42:52.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:52 smithi151 ceph-mon[95510]: pgmap v747: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 305 op/s 2023-07-21T22:42:53.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:52 smithi187 ceph-mon[96918]: pgmap v747: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 305 op/s 2023-07-21T22:42:54.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:54 smithi195 ceph-mon[97365]: pgmap v748: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.5 MiB/s wr, 459 op/s 2023-07-21T22:42:54.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:54 smithi151 ceph-mon[95510]: pgmap v748: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.5 MiB/s wr, 459 op/s 2023-07-21T22:42:55.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:54 smithi187 ceph-mon[96918]: pgmap v748: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.5 MiB/s wr, 459 op/s 2023-07-21T22:42:56.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:56 smithi195 ceph-mon[97365]: pgmap v749: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-07-21T22:42:56.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:56 smithi151 ceph-mon[95510]: pgmap v749: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-07-21T22:42:57.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:56 smithi187 ceph-mon[96918]: pgmap v749: 97 pgs: 97 active+clean; 8.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-07-21T22:42:57.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:57 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:42:57.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:57 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:42:58.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:57 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:42:58.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:42:58 smithi195 ceph-mon[97365]: pgmap v750: 97 pgs: 97 active+clean; 8.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.4 MiB/s wr, 447 op/s 2023-07-21T22:42:58.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:42:58 smithi151 ceph-mon[95510]: pgmap v750: 97 pgs: 97 active+clean; 8.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.4 MiB/s wr, 447 op/s 2023-07-21T22:42:59.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:42:58 smithi187 ceph-mon[96918]: pgmap v750: 97 pgs: 97 active+clean; 8.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.4 MiB/s wr, 447 op/s 2023-07-21T22:43:00.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:00 smithi195 ceph-mon[97365]: pgmap v751: 97 pgs: 97 active+clean; 8.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:00.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:00 smithi151 ceph-mon[95510]: pgmap v751: 97 pgs: 97 active+clean; 8.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:01.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:00 smithi187 ceph-mon[96918]: pgmap v751: 97 pgs: 97 active+clean; 8.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:02.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:02 smithi151 ceph-mon[95510]: pgmap v752: 97 pgs: 97 active+clean; 8.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:03.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:02 smithi187 ceph-mon[96918]: pgmap v752: 97 pgs: 97 active+clean; 8.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:03.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:02 smithi195 ceph-mon[97365]: pgmap v752: 97 pgs: 97 active+clean; 8.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:04.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.420+0000 7f81791ff700 1 -- 172.21.15.151:0/3669124873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81740ffb00 msgr2=0x7f81740fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.420+0000 7f81791ff700 1 --2- 172.21.15.151:0/3669124873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81740ffb00 0x7f81740fff70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f8168009990 tx=0x7f8168009ca0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.421+0000 7f81791ff700 1 -- 172.21.15.151:0/3669124873 shutdown_connections 2023-07-21T22:43:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.421+0000 7f81791ff700 1 --2- 172.21.15.151:0/3669124873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f81741004b0 0x7f817410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.421+0000 7f81791ff700 1 --2- 172.21.15.151:0/3669124873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8174105b10 0x7f8174105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.421+0000 7f81791ff700 1 --2- 172.21.15.151:0/3669124873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81740ffb00 0x7f81740fff70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.421+0000 7f81791ff700 1 -- 172.21.15.151:0/3669124873 >> 172.21.15.151:0/3669124873 conn(0x7f81740fb600 msgr2=0x7f81740fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.421+0000 7f81791ff700 1 -- 172.21.15.151:0/3669124873 shutdown_connections 2023-07-21T22:43:04.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.421+0000 7f81791ff700 1 -- 172.21.15.151:0/3669124873 wait complete. 2023-07-21T22:43:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.423+0000 7f81791ff700 1 Processor -- start 2023-07-21T22:43:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.423+0000 7f81791ff700 1 -- start start 2023-07-21T22:43:04.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.423+0000 7f81791ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81740ffb00 0x7f817419bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.423+0000 7f81791ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81741004b0 0x7f817419c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.423+0000 7f81791ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8174105b10 0x7f81741959c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.423+0000 7f81791ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8174196030 con 0x7f81740ffb00 2023-07-21T22:43:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.423+0000 7f81791ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81741961a0 con 0x7f81741004b0 2023-07-21T22:43:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.423+0000 7f81791ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8174196360 con 0x7f8174105b10 2023-07-21T22:43:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f8172d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81740ffb00 0x7f817419bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f817359e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8174105b10 0x7f81741959c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f8172d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81740ffb00 0x7f817419bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37794/0 (socket says 172.21.15.151:37794) 2023-07-21T22:43:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f8172d9d700 1 -- 172.21.15.151:0/3371891646 learned_addr learned my addr 172.21.15.151:0/3371891646 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f817259c700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81741004b0 0x7f817419c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f817359e700 1 -- 172.21.15.151:0/3371891646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81741004b0 msgr2=0x7f817419c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f817359e700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81741004b0 0x7f817419c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f817359e700 1 -- 172.21.15.151:0/3371891646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81740ffb00 msgr2=0x7f817419bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f817359e700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81740ffb00 0x7f817419bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.424+0000 7f817359e700 1 -- 172.21.15.151:0/3371891646 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680095f0 con 0x7f8174105b10 2023-07-21T22:43:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.425+0000 7f817359e700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8174105b10 0x7f81741959c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f816c00efc0 tx=0x7f816c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.425+0000 7f815bfff700 1 -- 172.21.15.151:0/3371891646 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c018070 con 0x7f8174105b10 2023-07-21T22:43:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.425+0000 7f815bfff700 1 -- 172.21.15.151:0/3371891646 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f816c00f040 con 0x7f8174105b10 2023-07-21T22:43:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.425+0000 7f81791ff700 1 -- 172.21.15.151:0/3371891646 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81741965e0 con 0x7f8174105b10 2023-07-21T22:43:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.425+0000 7f815bfff700 1 -- 172.21.15.151:0/3371891646 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816c00cc50 con 0x7f8174105b10 2023-07-21T22:43:04.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.425+0000 7f81791ff700 1 -- 172.21.15.151:0/3371891646 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8174072920 con 0x7f8174105b10 2023-07-21T22:43:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.429+0000 7f815bfff700 1 -- 172.21.15.151:0/3371891646 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f816c003a00 con 0x7f8174105b10 2023-07-21T22:43:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.431+0000 7f815bfff700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f815c0a1340 0x7f815c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.431+0000 7f815bfff700 1 -- 172.21.15.151:0/3371891646 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f816c0cc800 con 0x7f8174105b10 2023-07-21T22:43:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.431+0000 7f8172d9d700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f815c0a1340 0x7f815c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.432+0000 7f818cbefb80 1 Processor -- start 2023-07-21T22:43:04.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.432+0000 7f818cbefb80 1 -- start start 2023-07-21T22:43:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f8172d9d700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f815c0a1340 0x7f815c0a37f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8164009ca0 tx=0x7f8164009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72a94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9a20 0x5594c72a3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9e70 0x5594c72a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f818cbefb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c71a0c50 con 0x5594c72a9e70 2023-07-21T22:43:04.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f818cbefb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c71f39e0 con 0x5594c72a9a20 2023-07-21T22:43:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f818cbefb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c71ece70 con 0x5594c70f76b0 2023-07-21T22:43:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f817359e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9e70 0x5594c72a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f817259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9a20 0x5594c72a3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f8172d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72a94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f817259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9a20 0x5594c72a3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41362/0 (socket says 172.21.15.151:41362) 2023-07-21T22:43:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.433+0000 7f817259c700 1 -- 172.21.15.151:0/3852934998 learned_addr learned my addr 172.21.15.151:0/3852934998 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.434+0000 7f817259c700 1 -- 172.21.15.151:0/3852934998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 msgr2=0x5594c72a94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.434+0000 7f817259c700 1 --2- 172.21.15.151:0/3852934998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72a94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.434+0000 7f817259c700 1 -- 172.21.15.151:0/3852934998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9e70 msgr2=0x5594c72a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:04.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.434+0000 7f817259c700 1 --2- 172.21.15.151:0/3852934998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9e70 0x5594c72a3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.434+0000 7f817259c700 1 -- 172.21.15.151:0/3852934998 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594c701ad80 con 0x5594c72a9a20 2023-07-21T22:43:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.434+0000 7f817259c700 1 --2- 172.21.15.151:0/3852934998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9a20 0x5594c72a3750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8168006010 tx=0x7f8168005ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6fd052f5ece9db7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.434+0000 7f81597fa700 1 -- 172.21.15.151:0/3852934998 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680056a0 con 0x5594c72a9a20 2023-07-21T22:43:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.434+0000 7f81597fa700 1 -- 172.21.15.151:0/3852934998 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f816801e040 con 0x5594c72a9a20 2023-07-21T22:43:04.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.434+0000 7f81597fa700 1 -- 172.21.15.151:0/3852934998 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81680049c0 con 0x5594c72a9a20 2023-07-21T22:43:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.435+0000 7f818cbefb80 1 -- 172.21.15.151:0/3852934998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9a20 msgr2=0x5594c72a3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.435+0000 7f818cbefb80 1 --2- 172.21.15.151:0/3852934998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9a20 0x5594c72a3750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8168006010 tx=0x7f8168005ee0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.436+0000 7f818cbefb80 1 -- 172.21.15.151:0/3852934998 shutdown_connections 2023-07-21T22:43:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.436+0000 7f818cbefb80 1 --2- 172.21.15.151:0/3852934998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9e70 0x5594c72a3cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.436+0000 7f818cbefb80 1 --2- 172.21.15.151:0/3852934998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72a94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.436+0000 7f818cbefb80 1 --2- 172.21.15.151:0/3852934998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9a20 0x5594c72a3750 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.436+0000 7f818cbefb80 1 -- 172.21.15.151:0/3852934998 >> 172.21.15.151:0/3852934998 conn(0x5594c7290ae0 msgr2=0x5594c72960e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.436+0000 7f818cbefb80 1 -- 172.21.15.151:0/3852934998 shutdown_connections 2023-07-21T22:43:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.436+0000 7f818cbefb80 1 -- 172.21.15.151:0/3852934998 wait complete. 2023-07-21T22:43:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.437+0000 7f818cbefb80 1 -- start start 2023-07-21T22:43:04.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.437+0000 7f818cbefb80 1 Processor -- start 2023-07-21T22:43:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 0x5594c72b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72acff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f818cbefb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c718ca60 con 0x5594c70f76b0 2023-07-21T22:43:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f818cbefb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c718c760 con 0x5594c72a9e70 2023-07-21T22:43:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f818cbefb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c70708c0 con 0x5594c72a9a20 2023-07-21T22:43:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f818cbefb80 10 client.0 _ll_register_callbacks cb 0x5594c718a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f8172d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 0x5594c72b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f817259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f8172d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 0x5594c72b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37802/0 (socket says 172.21.15.151:37802) 2023-07-21T22:43:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.438+0000 7f8172d9d700 1 -- 172.21.15.151:0/9140725 learned_addr learned my addr 172.21.15.151:0/9140725 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.439+0000 7f817359e700 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72acff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.439+0000 7f817259c700 1 -- 172.21.15.151:0/9140725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 msgr2=0x5594c72acff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.439+0000 7f817259c700 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72acff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.439+0000 7f817259c700 1 -- 172.21.15.151:0/9140725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 msgr2=0x5594c72b2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.439+0000 7f817259c700 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 0x5594c72b2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.439+0000 7f817259c700 1 -- 172.21.15.151:0/9140725 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817410d240 con 0x5594c72a9a20 2023-07-21T22:43:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.439+0000 7f817259c700 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b32a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f816800b2e0 tx=0x7f816800b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d6dc68c8e57a6ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.439+0000 7f8156ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:43:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.440+0000 7f8156ff5700 1 -- 172.21.15.151:0/9140725 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168004640 con 0x5594c72a9a20 2023-07-21T22:43:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.440+0000 7f818cbefb80 1 -- 172.21.15.151:0/9140725 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5594c7146490 con 0x5594c72a9a20 2023-07-21T22:43:04.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.440+0000 7f8156ff5700 1 -- 172.21.15.151:0/9140725 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f81680047a0 con 0x5594c72a9a20 2023-07-21T22:43:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.440+0000 7f8156ff5700 1 -- 172.21.15.151:0/9140725 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8168004960 con 0x5594c72a9a20 2023-07-21T22:43:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.440+0000 7f818cbefb80 10 client.27934 fetch_fsmap learned FSMap version 86 2023-07-21T22:43:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.440+0000 7f818cbefb80 1 -- 172.21.15.151:0/9140725 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) v3 -- 0x5594c7003c00 con 0x5594c72a9a20 2023-07-21T22:43:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.440+0000 7f8156ff5700 1 -- 172.21.15.151:0/9140725 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5594c7146490 con 0x5594c72a9a20 2023-07-21T22:43:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.441+0000 7f8156ff5700 1 -- 172.21.15.151:0/9140725 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 86) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f816802b9e0 con 0x5594c72a9a20 2023-07-21T22:43:04.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.441+0000 7f818cbefb80 10 client.27934 fetch_fsmap finished waiting for FSMap version 86 2023-07-21T22:43:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.441+0000 7f818cbefb80 10 client.27934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.441+0000 7f818cbefb80 20 client.27934 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.441+0000 7f818cbefb80 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5594c72bcdd0 0x5594c72bf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.441+0000 7f818cbefb80 4 client.27934 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:43:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.441+0000 7f818cbefb80 1 -- 172.21.15.151:0/9140725 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5594c71e5e50 con 0x5594c72bcdd0 2023-07-21T22:43:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.441+0000 7f8172d9d700 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5594c72bcdd0 0x5594c72bf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.442+0000 7f8172d9d700 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5594c72bcdd0 0x5594c72bf1e0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8495d2c5fe2c92c7 server_cookie=1113a38ffc604acb in_seq=0 out_seq=0 2023-07-21T22:43:04.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.442+0000 7f8156ff5700 10 client.27934 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f8156ff5700 1 -- 172.21.15.151:0/9140725 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5594c71e5e50 con 0x5594c72bcdd0 2023-07-21T22:43:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f8156ff5700 10 client.27934 handle_command_reply: tid=0 2023-07-21T22:43:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 client.27934 shutdown 2023-07-21T22:43:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 -- 172.21.15.151:0/9140725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 msgr2=0x5594c72b32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b32a0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f816800b2e0 tx=0x7f816800b9c0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 -- 172.21.15.151:0/9140725 shutdown_connections 2023-07-21T22:43:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5594c72bcdd0 0x5594c72bf1e0 crc :-1 s=READY pgs=310 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72acff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 0x5594c72b2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 --2- 172.21.15.151:0/9140725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b32a0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f8156ff5700 0 client.27934 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 -- 172.21.15.151:0/9140725 >> 172.21.15.151:0/9140725 conn(0x5594c7290ae0 msgr2=0x5594c72953e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.443+0000 7f818cbefb80 1 -- 172.21.15.151:0/9140725 shutdown_connections 2023-07-21T22:43:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.444+0000 7f818cbefb80 1 -- 172.21.15.151:0/9140725 wait complete. 2023-07-21T22:43:04.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.444+0000 7f818cbefb80 20 client.27934 trim_cache size 0 max 16384 2023-07-21T22:43:04.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.463+0000 7f818cbefb80 1 Processor -- start 2023-07-21T22:43:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.463+0000 7f818cbefb80 1 -- start start 2023-07-21T22:43:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.463+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72aa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.463+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9a20 0x5594c72a5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.463+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72a6500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.463+0000 7f818cbefb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c71e5e50 con 0x5594c72a9a20 2023-07-21T22:43:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.463+0000 7f818cbefb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c7146490 con 0x5594c72a9e70 2023-07-21T22:43:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.463+0000 7f818cbefb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c728db70 con 0x5594c70f76b0 2023-07-21T22:43:04.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f8172d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72aa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f817359e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72a6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f8172d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72aa950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:40096/0 (socket says 172.21.15.151:40096) 2023-07-21T22:43:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f8172d9d700 1 -- 172.21.15.151:0/4182247076 learned_addr learned my addr 172.21.15.151:0/4182247076 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f817259c700 1 --2- 172.21.15.151:0/4182247076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9a20 0x5594c72a5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f8172d9d700 1 -- 172.21.15.151:0/4182247076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 msgr2=0x5594c72a6500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:04.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f8172d9d700 1 --2- 172.21.15.151:0/4182247076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72a6500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f8172d9d700 1 -- 172.21.15.151:0/4182247076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9a20 msgr2=0x5594c72a5fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f8172d9d700 1 --2- 172.21.15.151:0/4182247076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9a20 0x5594c72a5fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.464+0000 7f8172d9d700 1 -- 172.21.15.151:0/4182247076 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5594c72c3dd0 con 0x5594c70f76b0 2023-07-21T22:43:04.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.465+0000 7f8172d9d700 1 --2- 172.21.15.151:0/4182247076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72aa950 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8164011ab0 tx=0x7f8164014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=424d242a23cf3cbf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.465+0000 7f8159ffb700 1 -- 172.21.15.151:0/4182247076 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164022070 con 0x5594c70f76b0 2023-07-21T22:43:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.465+0000 7f8159ffb700 1 -- 172.21.15.151:0/4182247076 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8164023040 con 0x5594c70f76b0 2023-07-21T22:43:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.465+0000 7f8159ffb700 1 -- 172.21.15.151:0/4182247076 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8164029a70 con 0x5594c70f76b0 2023-07-21T22:43:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.466+0000 7f818cbefb80 1 -- 172.21.15.151:0/4182247076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 msgr2=0x5594c72aa950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.466+0000 7f818cbefb80 1 --2- 172.21.15.151:0/4182247076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72aa950 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8164011ab0 tx=0x7f8164014000 comp rx=0 tx=0).stop 2023-07-21T22:43:04.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.466+0000 7f818cbefb80 1 -- 172.21.15.151:0/4182247076 shutdown_connections 2023-07-21T22:43:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.466+0000 7f818cbefb80 1 --2- 172.21.15.151:0/4182247076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72a6500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.466+0000 7f818cbefb80 1 --2- 172.21.15.151:0/4182247076 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c70f76b0 0x5594c72aa950 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.466+0000 7f818cbefb80 1 --2- 172.21.15.151:0/4182247076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c72a9a20 0x5594c72a5fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.466+0000 7f818cbefb80 1 -- 172.21.15.151:0/4182247076 >> 172.21.15.151:0/4182247076 conn(0x5594c7290ae0 msgr2=0x5594c72aa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.466+0000 7f818cbefb80 1 -- 172.21.15.151:0/4182247076 shutdown_connections 2023-07-21T22:43:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.466+0000 7f818cbefb80 1 -- 172.21.15.151:0/4182247076 wait complete. 2023-07-21T22:43:04.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.467+0000 7f818cbefb80 1 -- start start 2023-07-21T22:43:04.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.467+0000 7f818cbefb80 1 Processor -- start 2023-07-21T22:43:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 0x5594c72b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f818cbefb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72b0f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f818cbefb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c72b14d0 con 0x5594c70f76b0 2023-07-21T22:43:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f818cbefb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c72b1640 con 0x5594c72a9e70 2023-07-21T22:43:04.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f818cbefb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5594c72b1800 con 0x5594c72a9a20 2023-07-21T22:43:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f818cbefb80 10 client.0 _ll_register_callbacks cb 0x7f816c004ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f817359e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72b0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f817259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f817259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b2f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:40104/0 (socket says 172.21.15.151:40104) 2023-07-21T22:43:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f817259c700 1 -- 172.21.15.151:0/2859088285 learned_addr learned my addr 172.21.15.151:0/2859088285 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.468+0000 7f8172d9d700 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 0x5594c72b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f817259c700 1 -- 172.21.15.151:0/2859088285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 msgr2=0x5594c72b0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:04.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f817259c700 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72b0f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f817259c700 1 -- 172.21.15.151:0/2859088285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 msgr2=0x5594c72b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f817259c700 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 0x5594c72b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f817259c700 1 -- 172.21.15.151:0/2859088285 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8164017070 con 0x5594c72a9a20 2023-07-21T22:43:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f817259c700 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b2f90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8168009990 tx=0x7f816800bab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65f1dbb5bb5913c7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f8156ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:43:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f8156ff5700 1 -- 172.21.15.151:0/2859088285 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800e9c0 con 0x5594c72a9a20 2023-07-21T22:43:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f8156ff5700 1 -- 172.21.15.151:0/2859088285 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8168005c00 con 0x5594c72a9a20 2023-07-21T22:43:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.469+0000 7f818cbefb80 1 -- 172.21.15.151:0/2859088285 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f816801e040 con 0x5594c72a9a20 2023-07-21T22:43:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.470+0000 7f8156ff5700 1 -- 172.21.15.151:0/2859088285 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=86) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8168017440 con 0x5594c72a9a20 2023-07-21T22:43:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.470+0000 7f818cbefb80 10 client.27940 fetch_fsmap learned FSMap version 86 2023-07-21T22:43:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.470+0000 7f818cbefb80 1 -- 172.21.15.151:0/2859088285 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=86,monmap=4+}) v3 -- 0x5594c70411f0 con 0x5594c72a9a20 2023-07-21T22:43:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.470+0000 7f8156ff5700 1 -- 172.21.15.151:0/2859088285 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f816804a020 con 0x5594c72a9a20 2023-07-21T22:43:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.470+0000 7f8156ff5700 1 -- 172.21.15.151:0/2859088285 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 86) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f816802b950 con 0x5594c72a9a20 2023-07-21T22:43:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.470+0000 7f818cbefb80 10 client.27940 fetch_fsmap finished waiting for FSMap version 86 2023-07-21T22:43:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.470+0000 7f818cbefb80 10 client.27940 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.470+0000 7f818cbefb80 20 client.27940 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.470+0000 7f818cbefb80 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5594c73119a0 0x5594c7313db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.471+0000 7f818cbefb80 4 client.27940 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:43:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.471+0000 7f818cbefb80 1 -- 172.21.15.151:0/2859088285 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5594c71a7ff0 con 0x5594c73119a0 2023-07-21T22:43:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.471+0000 7f8172d9d700 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5594c73119a0 0x5594c7313db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.471+0000 7f8172d9d700 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5594c73119a0 0x5594c7313db0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=749e273723ca3ac3 server_cookie=14bd774b72d07540 in_seq=0 out_seq=0 2023-07-21T22:43:04.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.471+0000 7f8156ff5700 10 client.27940 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:04.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.484+0000 7f8156ff5700 1 -- 172.21.15.151:0/2859088285 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5594c71a7ff0 con 0x5594c73119a0 2023-07-21T22:43:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.484+0000 7f8156ff5700 10 client.27940 handle_command_reply: tid=0 2023-07-21T22:43:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.484+0000 7f818cbefb80 1 client.27940 shutdown 2023-07-21T22:43:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.484+0000 7f818cbefb80 1 -- 172.21.15.151:0/2859088285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 msgr2=0x5594c72b2f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.484+0000 7f818cbefb80 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b2f90 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8168009990 tx=0x7f816800bab0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f818cbefb80 1 -- 172.21.15.151:0/2859088285 shutdown_connections 2023-07-21T22:43:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f818cbefb80 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5594c73119a0 0x5594c7313db0 crc :-1 s=READY pgs=311 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f818cbefb80 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5594c72a9e70 0x5594c72b0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f818cbefb80 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5594c70f76b0 0x5594c72b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f818cbefb80 1 --2- 172.21.15.151:0/2859088285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5594c72a9a20 0x5594c72b2f90 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f818cbefb80 1 -- 172.21.15.151:0/2859088285 >> 172.21.15.151:0/2859088285 conn(0x5594c7290ae0 msgr2=0x5594c72aa240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f8156ff5700 0 client.27940 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f818cbefb80 1 -- 172.21.15.151:0/2859088285 shutdown_connections 2023-07-21T22:43:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f818cbefb80 1 -- 172.21.15.151:0/2859088285 wait complete. 2023-07-21T22:43:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.485+0000 7f818cbefb80 20 client.27940 trim_cache size 0 max 16384 2023-07-21T22:43:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:43:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:43:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:43:04.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:43:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 -- 172.21.15.151:0/3371891646 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f815c0a1340 msgr2=0x7f815c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f815c0a1340 0x7f815c0a37f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8164009ca0 tx=0x7f8164009260 comp rx=0 tx=0).stop 2023-07-21T22:43:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 -- 172.21.15.151:0/3371891646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8174105b10 msgr2=0x7f81741959c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8174105b10 0x7f81741959c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f816c00efc0 tx=0x7f816c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 -- 172.21.15.151:0/3371891646 shutdown_connections 2023-07-21T22:43:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f815c0a1340 0x7f815c0a37f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8174105b10 0x7f81741959c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81740ffb00 0x7f817419bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 --2- 172.21.15.151:0/3371891646 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81741004b0 0x7f817419c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 -- 172.21.15.151:0/3371891646 >> 172.21.15.151:0/3371891646 conn(0x7f81740fb600 msgr2=0x7f81740fbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 -- 172.21.15.151:0/3371891646 shutdown_connections 2023-07-21T22:43:04.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:04.486+0000 7f81791ff700 1 -- 172.21.15.151:0/3371891646 wait complete. 2023-07-21T22:43:04.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:04 smithi151 ceph-mon[95510]: pgmap v753: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.5 MiB/s wr, 469 op/s 2023-07-21T22:43:04.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:04 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:43:05.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:04 smithi187 ceph-mon[96918]: pgmap v753: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.5 MiB/s wr, 469 op/s 2023-07-21T22:43:05.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:04 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:43:05.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:04 smithi195 ceph-mon[97365]: pgmap v753: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.5 MiB/s wr, 469 op/s 2023-07-21T22:43:05.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:04 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:43:05.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:05 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:43:05.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:05 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:43:05.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:05 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:43:05.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:05 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:43:06.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:05 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:43:06.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:05 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:43:06.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:05 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:43:06.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:05 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:43:06.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:05 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:43:06.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:05 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:43:06.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:05 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:43:06.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:05 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:43:06.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:06 smithi151 ceph-mon[95510]: pgmap v754: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 315 op/s 2023-07-21T22:43:07.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:06 smithi187 ceph-mon[96918]: pgmap v754: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 315 op/s 2023-07-21T22:43:07.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:06 smithi195 ceph-mon[97365]: pgmap v754: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 315 op/s 2023-07-21T22:43:08.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:07 smithi187 ceph-mon[96918]: pgmap v755: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.5 MiB/s wr, 459 op/s 2023-07-21T22:43:08.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:07 smithi195 ceph-mon[97365]: pgmap v755: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.5 MiB/s wr, 459 op/s 2023-07-21T22:43:08.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:07 smithi151 ceph-mon[95510]: pgmap v755: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.5 MiB/s wr, 459 op/s 2023-07-21T22:43:10.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:09 smithi187 ceph-mon[96918]: osdmap e123: 12 total, 12 up, 12 in 2023-07-21T22:43:10.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:09 smithi187 ceph-mon[96918]: pgmap v757: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.7 MiB/s wr, 363 op/s 2023-07-21T22:43:10.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:09 smithi195 ceph-mon[97365]: osdmap e123: 12 total, 12 up, 12 in 2023-07-21T22:43:10.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:09 smithi195 ceph-mon[97365]: pgmap v757: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.7 MiB/s wr, 363 op/s 2023-07-21T22:43:10.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:09 smithi151 ceph-mon[95510]: osdmap e123: 12 total, 12 up, 12 in 2023-07-21T22:43:10.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:09 smithi151 ceph-mon[95510]: pgmap v757: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.7 MiB/s wr, 363 op/s 2023-07-21T22:43:12.873 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:12 smithi187 ceph-mon[96918]: pgmap v758: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.7 MiB/s wr, 363 op/s 2023-07-21T22:43:12.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:12 smithi195 ceph-mon[97365]: pgmap v758: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.7 MiB/s wr, 363 op/s 2023-07-21T22:43:12.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:12 smithi151 ceph-mon[95510]: pgmap v758: 97 pgs: 97 active+clean; 8.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.7 MiB/s wr, 363 op/s 2023-07-21T22:43:14.873 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:14 smithi187 ceph-mon[96918]: pgmap v759: 97 pgs: 97 active+clean; 8.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.6 MiB/s wr, 345 op/s 2023-07-21T22:43:14.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:14 smithi195 ceph-mon[97365]: pgmap v759: 97 pgs: 97 active+clean; 8.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.6 MiB/s wr, 345 op/s 2023-07-21T22:43:14.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:14 smithi151 ceph-mon[95510]: pgmap v759: 97 pgs: 97 active+clean; 8.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.6 MiB/s wr, 345 op/s 2023-07-21T22:43:16.873 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:16 smithi187 ceph-mon[96918]: pgmap v760: 97 pgs: 97 active+clean; 8.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.6 MiB/s wr, 345 op/s 2023-07-21T22:43:16.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:16 smithi187 ceph-mon[96918]: osdmap e124: 12 total, 12 up, 12 in 2023-07-21T22:43:16.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:16 smithi195 ceph-mon[97365]: pgmap v760: 97 pgs: 97 active+clean; 8.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.6 MiB/s wr, 345 op/s 2023-07-21T22:43:16.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:16 smithi195 ceph-mon[97365]: osdmap e124: 12 total, 12 up, 12 in 2023-07-21T22:43:16.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:16 smithi151 ceph-mon[95510]: pgmap v760: 97 pgs: 97 active+clean; 8.2 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.6 MiB/s wr, 345 op/s 2023-07-21T22:43:16.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:16 smithi151 ceph-mon[95510]: osdmap e124: 12 total, 12 up, 12 in 2023-07-21T22:43:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.654+0000 7f47ccfff700 1 -- 172.21.15.151:0/1632385582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c80ffb30 msgr2=0x7f47c80fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:17.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.654+0000 7f47ccfff700 1 --2- 172.21.15.151:0/1632385582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c80ffb30 0x7f47c80fffa0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f47bc009990 tx=0x7f47bc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.654+0000 7f47ccfff700 1 -- 172.21.15.151:0/1632385582 shutdown_connections 2023-07-21T22:43:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.654+0000 7f47ccfff700 1 --2- 172.21.15.151:0/1632385582 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81004e0 0x7f47c810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.654+0000 7f47ccfff700 1 --2- 172.21.15.151:0/1632385582 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c8105b60 0x7f47c8105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.654+0000 7f47ccfff700 1 --2- 172.21.15.151:0/1632385582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c80ffb30 0x7f47c80fffa0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.654+0000 7f47ccfff700 1 -- 172.21.15.151:0/1632385582 >> 172.21.15.151:0/1632385582 conn(0x7f47c80fb5f0 msgr2=0x7f47c80fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.654+0000 7f47ccfff700 1 -- 172.21.15.151:0/1632385582 shutdown_connections 2023-07-21T22:43:17.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.654+0000 7f47ccfff700 1 -- 172.21.15.151:0/1632385582 wait complete. 2023-07-21T22:43:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.655+0000 7f47ccfff700 1 Processor -- start 2023-07-21T22:43:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.655+0000 7f47ccfff700 1 -- start start 2023-07-21T22:43:17.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47ccfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c80ffb30 0x7f47c8197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47ccfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81004e0 0x7f47c8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47ccfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c8105b60 0x7f47c819c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47ccfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c819cf40 con 0x7f47c8105b60 2023-07-21T22:43:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47ccfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c819d0b0 con 0x7f47c80ffb30 2023-07-21T22:43:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47ccfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c819d270 con 0x7f47c81004e0 2023-07-21T22:43:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47c5d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81004e0 0x7f47c8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47c5d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81004e0 0x7f47c8198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33930/0 (socket says 172.21.15.151:33930) 2023-07-21T22:43:17.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47c5d9b700 1 -- 172.21.15.151:0/2935225460 learned_addr learned my addr 172.21.15.151:0/2935225460 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47c659c700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c80ffb30 0x7f47c8197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.656+0000 7f47c6d9d700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c8105b60 0x7f47c819c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47c5d9b700 1 -- 172.21.15.151:0/2935225460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c80ffb30 msgr2=0x7f47c8197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c80ffb30 0x7f47c8197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47c5d9b700 1 -- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c8105b60 msgr2=0x7f47c819c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c8105b60 0x7f47c819c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47c5d9b700 1 -- 172.21.15.151:0/2935225460 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47bc0095f0 con 0x7f47c81004e0 2023-07-21T22:43:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81004e0 0x7f47c8198290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000c00 tx=0x7f47bc004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47b77fe700 1 -- 172.21.15.151:0/2935225460 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc01d070 con 0x7f47c81004e0 2023-07-21T22:43:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47ccfff700 1 -- 172.21.15.151:0/2935225460 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c819d4f0 con 0x7f47c81004e0 2023-07-21T22:43:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47b77fe700 1 -- 172.21.15.151:0/2935225460 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47bc022470 con 0x7f47c81004e0 2023-07-21T22:43:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47b77fe700 1 -- 172.21.15.151:0/2935225460 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc017650 con 0x7f47c81004e0 2023-07-21T22:43:17.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.657+0000 7f47ccfff700 1 -- 172.21.15.151:0/2935225460 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c81a4d90 con 0x7f47c81004e0 2023-07-21T22:43:17.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.661+0000 7f47b77fe700 1 -- 172.21.15.151:0/2935225460 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f47bc0225e0 con 0x7f47c81004e0 2023-07-21T22:43:17.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.662+0000 7f47e098cb80 1 Processor -- start 2023-07-21T22:43:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.662+0000 7f47b77fe700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47b00a12c0 0x7f47b00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47e098cb80 1 -- start start 2023-07-21T22:43:17.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47b77fe700 1 -- 172.21.15.151:0/2935225460 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47bc0ce0f0 con 0x7f47c81004e0 2023-07-21T22:43:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968efcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 0x557f968ea4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47e098cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f967efc50 con 0x557f967466b0 2023-07-21T22:43:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47e098cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f968429e0 con 0x557f968f0660 2023-07-21T22:43:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47e098cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f9683be70 con 0x557f968f0210 2023-07-21T22:43:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47c6d9d700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47b00a12c0 0x7f47b00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47c659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968efcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47c659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968efcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53766/0 (socket says 172.21.15.151:53766) 2023-07-21T22:43:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.663+0000 7f47c659c700 1 -- 172.21.15.151:0/1062782384 learned_addr learned my addr 172.21.15.151:0/1062782384 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.664+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/1062782384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.664+0000 7f47c6d9d700 1 --2- 172.21.15.151:0/1062782384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 0x557f968ea4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.664+0000 7f47c659c700 1 -- 172.21.15.151:0/1062782384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 msgr2=0x557f968e9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.664+0000 7f47c659c700 1 --2- 172.21.15.151:0/1062782384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968e9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.664+0000 7f47c659c700 1 -- 172.21.15.151:0/1062782384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 msgr2=0x557f968ea4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.664+0000 7f47c659c700 1 --2- 172.21.15.151:0/1062782384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 0x557f968ea4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.664+0000 7f47c659c700 1 -- 172.21.15.151:0/1062782384 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f96669d80 con 0x557f967466b0 2023-07-21T22:43:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.664+0000 7f47c6d9d700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47b00a12c0 0x7f47b00a3770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f47c00139c0 tx=0x7f47c0013250 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:17.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.664+0000 7f47c659c700 1 --2- 172.21.15.151:0/1062782384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968efcd0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009d00 tx=0x7f47b8011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75cc99203f81a5f9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.665+0000 7f47b4ff9700 1 -- 172.21.15.151:0/1062782384 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8004230 con 0x557f967466b0 2023-07-21T22:43:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.665+0000 7f47b4ff9700 1 -- 172.21.15.151:0/1062782384 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47b8004390 con 0x557f967466b0 2023-07-21T22:43:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.665+0000 7f47b4ff9700 1 -- 172.21.15.151:0/1062782384 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b8019680 con 0x557f967466b0 2023-07-21T22:43:17.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.665+0000 7f47e098cb80 1 -- 172.21.15.151:0/1062782384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 msgr2=0x557f968efcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.665+0000 7f47e098cb80 1 --2- 172.21.15.151:0/1062782384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968efcd0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009d00 tx=0x7f47b8011720 comp rx=0 tx=0).stop 2023-07-21T22:43:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.666+0000 7f47e098cb80 1 -- 172.21.15.151:0/1062782384 shutdown_connections 2023-07-21T22:43:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.666+0000 7f47e098cb80 1 --2- 172.21.15.151:0/1062782384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 0x557f968ea4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.666+0000 7f47e098cb80 1 --2- 172.21.15.151:0/1062782384 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968efcd0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.666+0000 7f47e098cb80 1 --2- 172.21.15.151:0/1062782384 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.666+0000 7f47e098cb80 1 -- 172.21.15.151:0/1062782384 >> 172.21.15.151:0/1062782384 conn(0x557f968dfae0 msgr2=0x557f968e50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:17.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.666+0000 7f47e098cb80 1 -- 172.21.15.151:0/1062782384 shutdown_connections 2023-07-21T22:43:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.666+0000 7f47e098cb80 1 -- 172.21.15.151:0/1062782384 wait complete. 2023-07-21T22:43:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.666+0000 7f47e098cb80 1 -- start start 2023-07-21T22:43:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.666+0000 7f47e098cb80 1 Processor -- start 2023-07-21T22:43:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f967466b0 0x557f968f6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f968f0210 0x557f968f3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47e098cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f967dba60 con 0x557f968f0210 2023-07-21T22:43:17.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47e098cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f967db760 con 0x557f967466b0 2023-07-21T22:43:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47e098cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f966bf8c0 con 0x557f968f0660 2023-07-21T22:43:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47e098cb80 10 client.0 _ll_register_callbacks cb 0x557f967d9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47c5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f968f0210 0x557f968f3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47c659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f967466b0 0x557f968f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47c6d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47c5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f968f0210 0x557f968f3700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53782/0 (socket says 172.21.15.151:53782) 2023-07-21T22:43:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47c659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f967466b0 0x557f968f6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35714/0 (socket says 172.21.15.151:35714) 2023-07-21T22:43:17.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.667+0000 7f47c5d9b700 1 -- 172.21.15.151:0/4096322738 learned_addr learned my addr 172.21.15.151:0/4096322738 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47c6d9d700 1 -- 172.21.15.151:0/4096322738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f967466b0 msgr2=0x557f968f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47c6d9d700 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f967466b0 0x557f968f6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47c6d9d700 1 -- 172.21.15.151:0/4096322738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f968f0210 msgr2=0x557f968f3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47c6d9d700 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f968f0210 0x557f968f3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47c6d9d700 1 -- 172.21.15.151:0/4096322738 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b8009960 con 0x557f968f0660 2023-07-21T22:43:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f968f0210 0x557f968f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:43:17.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47c6d9d700 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968f3c80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x557f968f0a70 tx=0x7f47c0004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9d55ed84738add5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47adffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:43:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47adffb700 1 -- 172.21.15.151:0/4096322738 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c0029070 con 0x557f968f0660 2023-07-21T22:43:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47adffb700 1 -- 172.21.15.151:0/4096322738 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47c0008c50 con 0x557f968f0660 2023-07-21T22:43:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.668+0000 7f47e098cb80 1 -- 172.21.15.151:0/4096322738 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f96795490 con 0x557f968f0660 2023-07-21T22:43:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47adffb700 1 -- 172.21.15.151:0/4096322738 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47c000e040 con 0x557f968f0660 2023-07-21T22:43:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47e098cb80 10 client.27952 fetch_fsmap learned FSMap version 87 2023-07-21T22:43:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47e098cb80 1 -- 172.21.15.151:0/4096322738 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) v3 -- 0x557f96652c00 con 0x557f968f0660 2023-07-21T22:43:17.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47adffb700 1 -- 172.21.15.151:0/4096322738 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557f96795490 con 0x557f968f0660 2023-07-21T22:43:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47adffb700 1 -- 172.21.15.151:0/4096322738 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 87) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47c002c020 con 0x557f968f0660 2023-07-21T22:43:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47e098cb80 10 client.27952 fetch_fsmap finished waiting for FSMap version 87 2023-07-21T22:43:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47e098cb80 10 client.27952 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47e098cb80 20 client.27952 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f96903af0 0x557f96905f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47e098cb80 4 client.27952 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:43:17.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.669+0000 7f47e098cb80 1 -- 172.21.15.151:0/4096322738 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f96834e50 con 0x557f96903af0 2023-07-21T22:43:17.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.670+0000 7f47c659c700 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f96903af0 0x557f96905f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.670+0000 7f47adffb700 10 client.27952 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.670+0000 7f47c659c700 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f96903af0 0x557f96905f00 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6dc81c15226a142 server_cookie=f7c10bbfe6d475c5 in_seq=0 out_seq=0 2023-07-21T22:43:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47adffb700 1 -- 172.21.15.151:0/4096322738 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557f96834e50 con 0x557f96903af0 2023-07-21T22:43:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47adffb700 10 client.27952 handle_command_reply: tid=0 2023-07-21T22:43:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47e098cb80 1 client.27952 shutdown 2023-07-21T22:43:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47e098cb80 1 -- 172.21.15.151:0/4096322738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 msgr2=0x557f968f3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968f3c80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x557f968f0a70 tx=0x7f47c0004b40 comp rx=0 tx=0).stop 2023-07-21T22:43:17.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47e098cb80 1 -- 172.21.15.151:0/4096322738 shutdown_connections 2023-07-21T22:43:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f96903af0 0x557f96905f00 crc :-1 s=READY pgs=312 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f967466b0 0x557f968f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968f3c80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4096322738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f968f0210 0x557f968f3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47e098cb80 1 -- 172.21.15.151:0/4096322738 >> 172.21.15.151:0/4096322738 conn(0x557f968dfae0 msgr2=0x557f968e43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.671+0000 7f47adffb700 0 client.27952 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.672+0000 7f47e098cb80 1 -- 172.21.15.151:0/4096322738 shutdown_connections 2023-07-21T22:43:17.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.672+0000 7f47e098cb80 1 -- 172.21.15.151:0/4096322738 wait complete. 2023-07-21T22:43:17.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.672+0000 7f47e098cb80 20 client.27952 trim_cache size 0 max 16384 2023-07-21T22:43:17.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.689+0000 7f47e098cb80 1 Processor -- start 2023-07-21T22:43:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.689+0000 7f47e098cb80 1 -- start start 2023-07-21T22:43:17.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.689+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.689+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0210 0x557f968e50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.689+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968e9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.689+0000 7f47e098cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f969010d0 con 0x557f967466b0 2023-07-21T22:43:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.689+0000 7f47e098cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f968ef920 con 0x557f968f0210 2023-07-21T22:43:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.689+0000 7f47e098cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f968e55e0 con 0x557f968f0660 2023-07-21T22:43:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c5d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0210 0x557f968e50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c5d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0210 0x557f968e50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35720/0 (socket says 172.21.15.151:35720) 2023-07-21T22:43:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968e4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53788/0 (socket says 172.21.15.151:53788) 2023-07-21T22:43:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c5d9b700 1 -- 172.21.15.151:0/4186889038 learned_addr learned my addr 172.21.15.151:0/4186889038 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c6d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968e9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c5d9b700 1 -- 172.21.15.151:0/4186889038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 msgr2=0x557f968e9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/4186889038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968e9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c5d9b700 1 -- 172.21.15.151:0/4186889038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 msgr2=0x557f968e4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/4186889038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968e4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c5d9b700 1 -- 172.21.15.151:0/4186889038 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f966901f0 con 0x557f968f0210 2023-07-21T22:43:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c6d9d700 1 --2- 172.21.15.151:0/4186889038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:43:17.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c659c700 1 --2- 172.21.15.151:0/4186889038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968e4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:43:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/4186889038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0210 0x557f968e50a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f47bc09b1a0 tx=0x7f47bc00bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7a0fa8adcbd991bf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:17.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.690+0000 7f47b57fa700 1 -- 172.21.15.151:0/4186889038 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc09ad50 con 0x557f968f0210 2023-07-21T22:43:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47b57fa700 1 -- 172.21.15.151:0/4186889038 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47bc09ab70 con 0x557f968f0210 2023-07-21T22:43:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47b57fa700 1 -- 172.21.15.151:0/4186889038 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc09a960 con 0x557f968f0210 2023-07-21T22:43:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47e098cb80 1 -- 172.21.15.151:0/4186889038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0210 msgr2=0x557f968e50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4186889038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0210 0x557f968e50a0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f47bc09b1a0 tx=0x7f47bc00bf50 comp rx=0 tx=0).stop 2023-07-21T22:43:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47e098cb80 1 -- 172.21.15.151:0/4186889038 shutdown_connections 2023-07-21T22:43:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4186889038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0660 0x557f968e9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4186889038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968e4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47e098cb80 1 --2- 172.21.15.151:0/4186889038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0210 0x557f968e50a0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47e098cb80 1 -- 172.21.15.151:0/4186889038 >> 172.21.15.151:0/4186889038 conn(0x557f968dfae0 msgr2=0x557f968ed830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47e098cb80 1 -- 172.21.15.151:0/4186889038 shutdown_connections 2023-07-21T22:43:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.691+0000 7f47e098cb80 1 -- 172.21.15.151:0/4186889038 wait complete. 2023-07-21T22:43:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.692+0000 7f47e098cb80 1 -- start start 2023-07-21T22:43:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.692+0000 7f47e098cb80 1 Processor -- start 2023-07-21T22:43:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968f9160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47e098cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 0x557f968f96a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47e098cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f96956b30 con 0x557f967466b0 2023-07-21T22:43:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47e098cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f96956ca0 con 0x557f968f0660 2023-07-21T22:43:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47e098cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f96956e60 con 0x557f968f0210 2023-07-21T22:43:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47e098cb80 10 client.0 _ll_register_callbacks cb 0x7f47c0009350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47c5d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968f9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47c659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47c5d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968f9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33954/0 (socket says 172.21.15.151:33954) 2023-07-21T22:43:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47c5d9b700 1 -- 172.21.15.151:0/2665422728 learned_addr learned my addr 172.21.15.151:0/2665422728 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47c6d9d700 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 0x557f968f96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47c5d9b700 1 -- 172.21.15.151:0/2665422728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 msgr2=0x557f968f96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 0x557f968f96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47c5d9b700 1 -- 172.21.15.151:0/2665422728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 msgr2=0x557f968f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.693+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47c5d9b700 1 -- 172.21.15.151:0/2665422728 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f96669d80 con 0x557f968f0210 2023-07-21T22:43:17.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47c5d9b700 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968f9160 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0a30a0 tx=0x7f47bc009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ebf0d2386f554ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47adffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:43:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47adffb700 1 -- 172.21.15.151:0/2665422728 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc0b7070 con 0x557f968f0210 2023-07-21T22:43:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47adffb700 1 -- 172.21.15.151:0/2665422728 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47bc0228c0 con 0x557f968f0210 2023-07-21T22:43:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47e098cb80 1 -- 172.21.15.151:0/2665422728 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47b8004390 con 0x557f968f0210 2023-07-21T22:43:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47adffb700 1 -- 172.21.15.151:0/2665422728 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47bc09ad50 con 0x557f968f0210 2023-07-21T22:43:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47e098cb80 10 client.27958 fetch_fsmap learned FSMap version 87 2023-07-21T22:43:17.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47e098cb80 1 -- 172.21.15.151:0/2665422728 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) v3 -- 0x557f96652c00 con 0x557f968f0210 2023-07-21T22:43:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.694+0000 7f47adffb700 1 -- 172.21.15.151:0/2665422728 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47b8004390 con 0x557f968f0210 2023-07-21T22:43:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.695+0000 7f47adffb700 1 -- 172.21.15.151:0/2665422728 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 87) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47bc0b92b0 con 0x557f968f0210 2023-07-21T22:43:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.695+0000 7f47e098cb80 10 client.27958 fetch_fsmap finished waiting for FSMap version 87 2023-07-21T22:43:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.695+0000 7f47e098cb80 10 client.27958 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.695+0000 7f47e098cb80 20 client.27958 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.695+0000 7f47e098cb80 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f969580a0 0x557f9695a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.695+0000 7f47e098cb80 4 client.27958 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:43:17.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.695+0000 7f47e098cb80 1 -- 172.21.15.151:0/2665422728 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557f967f6ff0 con 0x557f969580a0 2023-07-21T22:43:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.695+0000 7f47c659c700 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f969580a0 0x557f9695a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.696+0000 7f47c659c700 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f969580a0 0x557f9695a4b0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d942222fa49fe138 server_cookie=2bee79cc3b434954 in_seq=0 out_seq=0 2023-07-21T22:43:17.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.696+0000 7f47adffb700 10 client.27958 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.703+0000 7f47adffb700 1 -- 172.21.15.151:0/2665422728 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557f967f6ff0 con 0x557f969580a0 2023-07-21T22:43:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.703+0000 7f47adffb700 10 client.27958 handle_command_reply: tid=0 2023-07-21T22:43:17.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.703+0000 7f47e098cb80 1 client.27958 shutdown 2023-07-21T22:43:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 -- 172.21.15.151:0/2665422728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 msgr2=0x557f968f9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968f9160 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f47bc0a30a0 tx=0x7f47bc009ca0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 -- 172.21.15.151:0/2665422728 shutdown_connections 2023-07-21T22:43:17.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f969580a0 0x557f9695a4b0 crc :-1 s=READY pgs=313 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f968f0660 0x557f968f96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47adffb700 0 client.27958 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f967466b0 0x557f968f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 --2- 172.21.15.151:0/2665422728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f968f0210 0x557f968f9160 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 -- 172.21.15.151:0/2665422728 >> 172.21.15.151:0/2665422728 conn(0x557f968dfae0 msgr2=0x557f968ee7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 -- 172.21.15.151:0/2665422728 shutdown_connections 2023-07-21T22:43:17.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 1 -- 172.21.15.151:0/2665422728 wait complete. 2023-07-21T22:43:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.704+0000 7f47e098cb80 20 client.27958 trim_cache size 0 max 16384 2023-07-21T22:43:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:43:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:43:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:43:17.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:43:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 -- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47b00a12c0 msgr2=0x7f47b00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47b00a12c0 0x7f47b00a3770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f47c00139c0 tx=0x7f47c0013250 comp rx=0 tx=0).stop 2023-07-21T22:43:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 -- 172.21.15.151:0/2935225460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81004e0 msgr2=0x7f47c8198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81004e0 0x7f47c8198290 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f47bc000c00 tx=0x7f47bc004730 comp rx=0 tx=0).stop 2023-07-21T22:43:17.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 -- 172.21.15.151:0/2935225460 shutdown_connections 2023-07-21T22:43:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47b00a12c0 0x7f47b00a3770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c80ffb30 0x7f47c8197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c8105b60 0x7f47c819c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 --2- 172.21.15.151:0/2935225460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c81004e0 0x7f47c8198290 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 -- 172.21.15.151:0/2935225460 >> 172.21.15.151:0/2935225460 conn(0x7f47c80fb5f0 msgr2=0x7f47c810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 -- 172.21.15.151:0/2935225460 shutdown_connections 2023-07-21T22:43:17.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:17.705+0000 7f47ccfff700 1 -- 172.21.15.151:0/2935225460 wait complete. 2023-07-21T22:43:18.873 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:18 smithi187 ceph-mon[96918]: pgmap v762: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.9 MiB/s wr, 374 op/s 2023-07-21T22:43:18.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:18 smithi195 ceph-mon[97365]: pgmap v762: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.9 MiB/s wr, 374 op/s 2023-07-21T22:43:18.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:18 smithi151 ceph-mon[95510]: pgmap v762: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.9 MiB/s wr, 374 op/s 2023-07-21T22:43:20.874 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:20 smithi187 ceph-mon[96918]: pgmap v763: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.4 MiB/s wr, 318 op/s 2023-07-21T22:43:20.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:20 smithi195 ceph-mon[97365]: pgmap v763: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.4 MiB/s wr, 318 op/s 2023-07-21T22:43:20.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:20 smithi151 ceph-mon[95510]: pgmap v763: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.4 MiB/s wr, 318 op/s 2023-07-21T22:43:22.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:22 smithi195 ceph-mon[97365]: pgmap v764: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.4 MiB/s wr, 318 op/s 2023-07-21T22:43:22.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:22 smithi151 ceph-mon[95510]: pgmap v764: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.4 MiB/s wr, 318 op/s 2023-07-21T22:43:23.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:22 smithi187 ceph-mon[96918]: pgmap v764: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.4 MiB/s wr, 318 op/s 2023-07-21T22:43:24.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:24 smithi195 ceph-mon[97365]: pgmap v765: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2023-07-21T22:43:24.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:24 smithi151 ceph-mon[95510]: pgmap v765: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2023-07-21T22:43:25.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:24 smithi187 ceph-mon[96918]: pgmap v765: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2023-07-21T22:43:26.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:26 smithi195 ceph-mon[97365]: pgmap v766: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2023-07-21T22:43:26.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:26 smithi151 ceph-mon[95510]: pgmap v766: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2023-07-21T22:43:27.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:26 smithi187 ceph-mon[96918]: pgmap v766: 97 pgs: 97 active+clean; 8.2 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.5 MiB/s wr, 328 op/s 2023-07-21T22:43:28.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:28 smithi195 ceph-mon[97365]: pgmap v767: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 479 op/s 2023-07-21T22:43:28.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:28 smithi151 ceph-mon[95510]: pgmap v767: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 479 op/s 2023-07-21T22:43:29.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:28 smithi187 ceph-mon[96918]: pgmap v767: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.7 MiB/s wr, 479 op/s 2023-07-21T22:43:30.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:30 smithi195 ceph-mon[97365]: pgmap v768: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.3 MiB/s wr, 302 op/s 2023-07-21T22:43:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.873+0000 7f092c99d700 1 -- 172.21.15.151:0/3205992265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0928072850 msgr2=0x7f0928072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.873+0000 7f092c99d700 1 --2- 172.21.15.151:0/3205992265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0928072850 0x7f0928072c20 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f0918009990 tx=0x7f0918009ca0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.873+0000 7f092c99d700 1 -- 172.21.15.151:0/3205992265 shutdown_connections 2023-07-21T22:43:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.873+0000 7f092c99d700 1 --2- 172.21.15.151:0/3205992265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f092810c1f0 0x7f092810e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.873+0000 7f092c99d700 1 --2- 172.21.15.151:0/3205992265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0928072850 0x7f0928072c20 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.873+0000 7f092c99d700 1 --2- 172.21.15.151:0/3205992265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0928073160 0x7f092810bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.873+0000 7f092c99d700 1 -- 172.21.15.151:0/3205992265 >> 172.21.15.151:0/3205992265 conn(0x7f09280fb470 msgr2=0x7f09280fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.873+0000 7f092c99d700 1 -- 172.21.15.151:0/3205992265 shutdown_connections 2023-07-21T22:43:30.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.873+0000 7f092c99d700 1 -- 172.21.15.151:0/3205992265 wait complete. 2023-07-21T22:43:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.874+0000 7f092c99d700 1 Processor -- start 2023-07-21T22:43:30.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.874+0000 7f092c99d700 1 -- start start 2023-07-21T22:43:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f092c99d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0928072850 0x7f092810b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f092c99d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0928073160 0x7f092810bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f092c99d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f092810c1f0 0x7f0928108970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f092c99d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0928109140 con 0x7f0928073160 2023-07-21T22:43:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f092c99d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09281092b0 con 0x7f092810c1f0 2023-07-21T22:43:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f092c99d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0928109470 con 0x7f0928072850 2023-07-21T22:43:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f09277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0928072850 0x7f092810b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f09277fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0928072850 0x7f092810b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48808/0 (socket says 172.21.15.151:48808) 2023-07-21T22:43:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f09277fe700 1 -- 172.21.15.151:0/2271531300 learned_addr learned my addr 172.21.15.151:0/2271531300 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f0927fff700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f092810c1f0 0x7f0928108970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f0926ffd700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0928073160 0x7f092810bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f09277fe700 1 -- 172.21.15.151:0/2271531300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f092810c1f0 msgr2=0x7f0928108970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.875+0000 7f09277fe700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f092810c1f0 0x7f0928108970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.876+0000 7f09277fe700 1 -- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0928073160 msgr2=0x7f092810bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:30.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.876+0000 7f09277fe700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0928073160 0x7f092810bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.876+0000 7f09277fe700 1 -- 172.21.15.151:0/2271531300 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f091c009520 con 0x7f0928072850 2023-07-21T22:43:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.876+0000 7f09277fe700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0928072850 0x7f092810b750 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0918000c00 tx=0x7f0918004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.876+0000 7f0924ff9700 1 -- 172.21.15.151:0/2271531300 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091801d070 con 0x7f0928072850 2023-07-21T22:43:30.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.876+0000 7f0924ff9700 1 -- 172.21.15.151:0/2271531300 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0918022470 con 0x7f0928072850 2023-07-21T22:43:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.876+0000 7f0924ff9700 1 -- 172.21.15.151:0/2271531300 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0918017650 con 0x7f0928072850 2023-07-21T22:43:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.876+0000 7f092c99d700 1 -- 172.21.15.151:0/2271531300 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09180095f0 con 0x7f0928072850 2023-07-21T22:43:30.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.877+0000 7f092c99d700 1 -- 172.21.15.151:0/2271531300 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09281a8b10 con 0x7f0928072850 2023-07-21T22:43:30.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.881+0000 7f0924ff9700 1 -- 172.21.15.151:0/2271531300 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f09180225e0 con 0x7f0928072850 2023-07-21T22:43:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.882+0000 7f0941501b80 1 Processor -- start 2023-07-21T22:43:30.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0941501b80 1 -- start start 2023-07-21T22:43:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0941501b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b70f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0941501b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 0x55fa04b6b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0941501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b6ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0941501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04a70c50 con 0x55fa04b6b5e0 2023-07-21T22:43:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0941501b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04ac39e0 con 0x55fa049c76b0 2023-07-21T22:43:30.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0941501b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04abce70 con 0x55fa04b71480 2023-07-21T22:43:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0924ff9700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f09100a12c0 0x7f09100a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0927fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b70f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0927fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b70f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53502/0 (socket says 172.21.15.151:53502) 2023-07-21T22:43:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0927fff700 1 -- 172.21.15.151:0/2323104656 learned_addr learned my addr 172.21.15.151:0/2323104656 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f09277fe700 1 --2- 172.21.15.151:0/2323104656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 0x55fa04b6b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.883+0000 7f0926ffd700 1 --2- 172.21.15.151:0/2323104656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b6ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.884+0000 7f0924ff9700 1 -- 172.21.15.151:0/2271531300 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f09180ce090 con 0x7f0928072850 2023-07-21T22:43:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.884+0000 7f0927fff700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f09100a12c0 0x7f09100a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.884+0000 7f0926ffd700 1 -- 172.21.15.151:0/2323104656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 msgr2=0x55fa04b6b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:30.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.884+0000 7f0926ffd700 1 --2- 172.21.15.151:0/2323104656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 0x55fa04b6b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.884+0000 7f0926ffd700 1 -- 172.21.15.151:0/2323104656 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 msgr2=0x55fa04b70f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.884+0000 7f0926ffd700 1 --2- 172.21.15.151:0/2323104656 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b70f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.884+0000 7f0926ffd700 1 -- 172.21.15.151:0/2323104656 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa048ead80 con 0x55fa04b6b5e0 2023-07-21T22:43:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.884+0000 7f0926ffd700 1 --2- 172.21.15.151:0/2323104656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b6ba30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f092810d830 tx=0x7f091c011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9d5c93f9dcab850 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.885+0000 7f0927fff700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f09100a12c0 0x7f09100a3770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0920013c10 tx=0x7f0920004b40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.885+0000 7f090dffb700 1 -- 172.21.15.151:0/2323104656 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c019630 con 0x55fa04b6b5e0 2023-07-21T22:43:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.885+0000 7f090dffb700 1 -- 172.21.15.151:0/2323104656 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f091c019c20 con 0x55fa04b6b5e0 2023-07-21T22:43:30.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.885+0000 7f090dffb700 1 -- 172.21.15.151:0/2323104656 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091c00ebd0 con 0x55fa04b6b5e0 2023-07-21T22:43:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.885+0000 7f0941501b80 1 -- 172.21.15.151:0/2323104656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 msgr2=0x55fa04b6ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.885+0000 7f0941501b80 1 --2- 172.21.15.151:0/2323104656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b6ba30 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f092810d830 tx=0x7f091c011720 comp rx=0 tx=0).stop 2023-07-21T22:43:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.886+0000 7f0941501b80 1 -- 172.21.15.151:0/2323104656 shutdown_connections 2023-07-21T22:43:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.886+0000 7f0941501b80 1 --2- 172.21.15.151:0/2323104656 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b70f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.886+0000 7f0941501b80 1 --2- 172.21.15.151:0/2323104656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b6ba30 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.886+0000 7f0941501b80 1 --2- 172.21.15.151:0/2323104656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 0x55fa04b6b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.886+0000 7f0941501b80 1 -- 172.21.15.151:0/2323104656 >> 172.21.15.151:0/2323104656 conn(0x55fa04b60c40 msgr2=0x55fa04b66300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.886+0000 7f0941501b80 1 -- 172.21.15.151:0/2323104656 shutdown_connections 2023-07-21T22:43:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.886+0000 7f0941501b80 1 -- 172.21.15.151:0/2323104656 wait complete. 2023-07-21T22:43:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.886+0000 7f0941501b80 1 -- start start 2023-07-21T22:43:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.887+0000 7f0941501b80 1 Processor -- start 2023-07-21T22:43:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.887+0000 7f0941501b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b77650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.887+0000 7f0941501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b74860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.887+0000 7f0941501b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 0x55fa04b74e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.887+0000 7f0941501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04a5ca60 con 0x55fa04b6b5e0 2023-07-21T22:43:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.887+0000 7f0941501b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04a5c760 con 0x55fa049c76b0 2023-07-21T22:43:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.887+0000 7f0941501b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa049408c0 con 0x55fa04b71480 2023-07-21T22:43:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.887+0000 7f0941501b80 10 client.0 _ll_register_callbacks cb 0x55fa04a5a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f09277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b77650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f09277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b77650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53504/0 (socket says 172.21.15.151:53504) 2023-07-21T22:43:30.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f09277fe700 1 -- 172.21.15.151:0/425558244 learned_addr learned my addr 172.21.15.151:0/425558244 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f0926ffd700 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b74860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f0927fff700 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 0x55fa04b74e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f09277fe700 1 -- 172.21.15.151:0/425558244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 msgr2=0x55fa04b74e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f09277fe700 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 0x55fa04b74e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f09277fe700 1 -- 172.21.15.151:0/425558244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 msgr2=0x55fa04b74860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f09277fe700 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b74860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f09277fe700 1 -- 172.21.15.151:0/425558244 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f091c009a70 con 0x55fa049c76b0 2023-07-21T22:43:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f0926ffd700 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b74860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:43:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f0927fff700 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 0x55fa04b74e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:43:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f09277fe700 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b77650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0918097c80 tx=0x7f091806a7b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f7e69fdaac8b3ea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.888+0000 7f0906ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:43:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0906ffd700 1 -- 172.21.15.151:0/425558244 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091809b670 con 0x55fa049c76b0 2023-07-21T22:43:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0906ffd700 1 -- 172.21.15.151:0/425558244 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f09180228c0 con 0x55fa049c76b0 2023-07-21T22:43:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0941501b80 1 -- 172.21.15.151:0/425558244 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa04a16490 con 0x55fa049c76b0 2023-07-21T22:43:30.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0906ffd700 1 -- 172.21.15.151:0/425558244 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f091809ab70 con 0x55fa049c76b0 2023-07-21T22:43:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0941501b80 10 client.27938 fetch_fsmap learned FSMap version 87 2023-07-21T22:43:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0941501b80 1 -- 172.21.15.151:0/425558244 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) v3 -- 0x55fa048d3c00 con 0x55fa049c76b0 2023-07-21T22:43:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0906ffd700 1 -- 172.21.15.151:0/425558244 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fa04a16490 con 0x55fa049c76b0 2023-07-21T22:43:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0906ffd700 1 -- 172.21.15.151:0/425558244 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 87) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f091809a700 con 0x55fa049c76b0 2023-07-21T22:43:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0941501b80 10 client.27938 fetch_fsmap finished waiting for FSMap version 87 2023-07-21T22:43:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0941501b80 10 client.27938 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:30.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0941501b80 20 client.27938 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0941501b80 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa04b84900 0x55fa04b86d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0941501b80 4 client.27938 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:43:30.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.889+0000 7f0941501b80 1 -- 172.21.15.151:0/425558244 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa04ab5e50 con 0x55fa04b84900 2023-07-21T22:43:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.890+0000 7f0926ffd700 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa04b84900 0x55fa04b86d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.890+0000 7f0926ffd700 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa04b84900 0x55fa04b86d10 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a7591b4ef8d72c4 server_cookie=9b7e06366fa12e2 in_seq=0 out_seq=0 2023-07-21T22:43:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.890+0000 7f0906ffd700 10 client.27938 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.891+0000 7f0906ffd700 1 -- 172.21.15.151:0/425558244 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fa04ab5e50 con 0x55fa04b84900 2023-07-21T22:43:30.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.891+0000 7f0906ffd700 10 client.27938 handle_command_reply: tid=0 2023-07-21T22:43:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.891+0000 7f0941501b80 1 client.27938 shutdown 2023-07-21T22:43:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.891+0000 7f0941501b80 1 -- 172.21.15.151:0/425558244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 msgr2=0x55fa04b77650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.891+0000 7f0941501b80 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b77650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f0918097c80 tx=0x7f091806a7b0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.891+0000 7f0941501b80 1 -- 172.21.15.151:0/425558244 shutdown_connections 2023-07-21T22:43:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.891+0000 7f0941501b80 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa04b84900 0x55fa04b86d10 crc :-1 s=READY pgs=314 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.892+0000 7f0941501b80 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b77650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.892+0000 7f0906ffd700 0 client.27938 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.892+0000 7f0941501b80 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b71480 0x55fa04b74e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.892+0000 7f0941501b80 1 --2- 172.21.15.151:0/425558244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b6b5e0 0x55fa04b74860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.892+0000 7f0941501b80 1 -- 172.21.15.151:0/425558244 >> 172.21.15.151:0/425558244 conn(0x55fa04b60c40 msgr2=0x55fa04b65540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.892+0000 7f0941501b80 1 -- 172.21.15.151:0/425558244 shutdown_connections 2023-07-21T22:43:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.892+0000 7f0941501b80 1 -- 172.21.15.151:0/425558244 wait complete. 2023-07-21T22:43:30.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.892+0000 7f0941501b80 20 client.27938 trim_cache size 0 max 16384 2023-07-21T22:43:30.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:30 smithi151 ceph-mon[95510]: pgmap v768: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.3 MiB/s wr, 302 op/s 2023-07-21T22:43:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.909+0000 7f0941501b80 1 Processor -- start 2023-07-21T22:43:30.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.909+0000 7f0941501b80 1 -- start start 2023-07-21T22:43:30.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.909+0000 7f0941501b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b7be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.909+0000 7f0941501b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 0x55fa04b721c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.909+0000 7f0941501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 0x55fa04b77180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.909+0000 7f0941501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04b670b0 con 0x55fa04b71480 2023-07-21T22:43:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.909+0000 7f0941501b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04b72de0 con 0x55fa049c76b0 2023-07-21T22:43:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.909+0000 7f0941501b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04b6f550 con 0x55fa04b6b5e0 2023-07-21T22:43:30.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f09277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b7be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f09277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b7be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53512/0 (socket says 172.21.15.151:53512) 2023-07-21T22:43:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f09277fe700 1 -- 172.21.15.151:0/3251976041 learned_addr learned my addr 172.21.15.151:0/3251976041 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f0927fff700 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 0x55fa04b77180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f0926ffd700 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 0x55fa04b721c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f09277fe700 1 -- 172.21.15.151:0/3251976041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 msgr2=0x55fa04b721c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f09277fe700 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 0x55fa04b721c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f09277fe700 1 -- 172.21.15.151:0/3251976041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 msgr2=0x55fa04b77180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:30.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f09277fe700 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 0x55fa04b77180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f09277fe700 1 -- 172.21.15.151:0/3251976041 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa049111f0 con 0x55fa049c76b0 2023-07-21T22:43:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f0927fff700 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 0x55fa04b77180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:43:30.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f09277fe700 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b7be20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f091809b1a0 tx=0x7f0918009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=406b4b9606b2e409 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.910+0000 7f090e7fc700 1 -- 172.21.15.151:0/3251976041 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091809a900 con 0x55fa049c76b0 2023-07-21T22:43:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f090e7fc700 1 -- 172.21.15.151:0/3251976041 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f091809ab70 con 0x55fa049c76b0 2023-07-21T22:43:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f090e7fc700 1 -- 172.21.15.151:0/3251976041 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f091809b6d0 con 0x55fa049c76b0 2023-07-21T22:43:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f0941501b80 1 -- 172.21.15.151:0/3251976041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 msgr2=0x55fa04b7be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f0941501b80 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b7be20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f091809b1a0 tx=0x7f0918009ca0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f0941501b80 1 -- 172.21.15.151:0/3251976041 shutdown_connections 2023-07-21T22:43:30.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f0941501b80 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b7be20 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f0941501b80 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 0x55fa04b77180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f0941501b80 1 --2- 172.21.15.151:0/3251976041 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 0x55fa04b721c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f0941501b80 1 -- 172.21.15.151:0/3251976041 >> 172.21.15.151:0/3251976041 conn(0x55fa04b60c40 msgr2=0x55fa04b71ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.911+0000 7f0941501b80 1 -- 172.21.15.151:0/3251976041 shutdown_connections 2023-07-21T22:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.912+0000 7f0941501b80 1 -- 172.21.15.151:0/3251976041 wait complete. 2023-07-21T22:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.912+0000 7f0941501b80 1 -- start start 2023-07-21T22:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.912+0000 7f0941501b80 1 Processor -- start 2023-07-21T22:43:30.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f0941501b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b6dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f0941501b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 0x55fa04b6c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f0941501b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 0x55fa04b6ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f0941501b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04b6e270 con 0x55fa04b71480 2023-07-21T22:43:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f0941501b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04b6e3e0 con 0x55fa049c76b0 2023-07-21T22:43:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f0941501b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa04b6e5a0 con 0x55fa04b6b5e0 2023-07-21T22:43:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f0941501b80 10 client.0 _ll_register_callbacks cb 0x55fa04a5a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f09277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b6dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f09277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b6dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53518/0 (socket says 172.21.15.151:53518) 2023-07-21T22:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f09277fe700 1 -- 172.21.15.151:0/1399856714 learned_addr learned my addr 172.21.15.151:0/1399856714 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f0927fff700 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 0x55fa04b6ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.913+0000 7f0926ffd700 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 0x55fa04b6c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f09277fe700 1 -- 172.21.15.151:0/1399856714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 msgr2=0x55fa04b6c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f09277fe700 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 0x55fa04b6c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f09277fe700 1 -- 172.21.15.151:0/1399856714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 msgr2=0x55fa04b6ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:30.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f09277fe700 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 0x55fa04b6ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f09277fe700 1 -- 172.21.15.151:0/1399856714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa048d3c00 con 0x55fa049c76b0 2023-07-21T22:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f09277fe700 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b6dce0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0918099560 tx=0x7f091809b6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5dd6a673f762e19 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f0906ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f0906ffd700 1 -- 172.21.15.151:0/1399856714 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09180228c0 con 0x55fa049c76b0 2023-07-21T22:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f0906ffd700 1 -- 172.21.15.151:0/1399856714 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f091809f240 con 0x55fa049c76b0 2023-07-21T22:43:30.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f0941501b80 1 -- 172.21.15.151:0/1399856714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f091c019c20 con 0x55fa049c76b0 2023-07-21T22:43:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f0906ffd700 1 -- 172.21.15.151:0/1399856714 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=87) v2 ==== 24+0+0 (secure 0 0 0) 0x7f09180a35d0 con 0x55fa049c76b0 2023-07-21T22:43:30.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f0941501b80 10 client.27944 fetch_fsmap learned FSMap version 87 2023-07-21T22:43:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.914+0000 7f0941501b80 1 -- 172.21.15.151:0/1399856714 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=87,monmap=4+}) v3 -- 0x55fa048e9250 con 0x55fa049c76b0 2023-07-21T22:43:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.915+0000 7f0906ffd700 1 -- 172.21.15.151:0/1399856714 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f091c019c20 con 0x55fa049c76b0 2023-07-21T22:43:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.915+0000 7f0906ffd700 1 -- 172.21.15.151:0/1399856714 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 87) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f091800fac0 con 0x55fa049c76b0 2023-07-21T22:43:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.915+0000 7f0941501b80 10 client.27944 fetch_fsmap finished waiting for FSMap version 87 2023-07-21T22:43:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.915+0000 7f0941501b80 10 client.27944 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.915+0000 7f0941501b80 20 client.27944 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.915+0000 7f0941501b80 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa04b84900 0x55fa04bdb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:30.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.915+0000 7f0941501b80 4 client.27944 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:43:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.915+0000 7f0941501b80 1 -- 172.21.15.151:0/1399856714 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fa04a77ff0 con 0x55fa04b84900 2023-07-21T22:43:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.915+0000 7f0926ffd700 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa04b84900 0x55fa04bdb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.916+0000 7f0906ffd700 10 client.27944 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:30.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.916+0000 7f0926ffd700 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa04b84900 0x55fa04bdb320 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e53369da100ae441 server_cookie=b6743f0bb9e025d0 in_seq=0 out_seq=0 2023-07-21T22:43:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0906ffd700 1 -- 172.21.15.151:0/1399856714 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fa04a77ff0 con 0x55fa04b84900 2023-07-21T22:43:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0906ffd700 10 client.27944 handle_command_reply: tid=0 2023-07-21T22:43:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 client.27944 shutdown 2023-07-21T22:43:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 -- 172.21.15.151:0/1399856714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 msgr2=0x55fa04b6dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b6dce0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f0918099560 tx=0x7f091809b6a0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 -- 172.21.15.151:0/1399856714 shutdown_connections 2023-07-21T22:43:30.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa04b84900 0x55fa04bdb320 crc :-1 s=READY pgs=315 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa049c76b0 0x55fa04b6dce0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa04b71480 0x55fa04b6ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0906ffd700 0 client.27944 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 --2- 172.21.15.151:0/1399856714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa04b6b5e0 0x55fa04b6c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 -- 172.21.15.151:0/1399856714 >> 172.21.15.151:0/1399856714 conn(0x55fa04b60c40 msgr2=0x55fa04b72340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 -- 172.21.15.151:0/1399856714 shutdown_connections 2023-07-21T22:43:30.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 1 -- 172.21.15.151:0/1399856714 wait complete. 2023-07-21T22:43:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.924+0000 7f0941501b80 20 client.27944 trim_cache size 0 max 16384 2023-07-21T22:43:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:43:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:43:30.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:43:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:43:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 -- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f09100a12c0 msgr2=0x7f09100a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f09100a12c0 0x7f09100a3770 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0920013c10 tx=0x7f0920004b40 comp rx=0 tx=0).stop 2023-07-21T22:43:30.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 -- 172.21.15.151:0/2271531300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0928072850 msgr2=0x7f092810b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0928072850 0x7f092810b750 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f0918000c00 tx=0x7f0918004730 comp rx=0 tx=0).stop 2023-07-21T22:43:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 -- 172.21.15.151:0/2271531300 shutdown_connections 2023-07-21T22:43:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f09100a12c0 0x7f09100a3770 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f092810c1f0 0x7f0928108970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0928072850 0x7f092810b750 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 --2- 172.21.15.151:0/2271531300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0928073160 0x7f092810bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 -- 172.21.15.151:0/2271531300 >> 172.21.15.151:0/2271531300 conn(0x7f09280fb470 msgr2=0x7f092810e340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:30.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 -- 172.21.15.151:0/2271531300 shutdown_connections 2023-07-21T22:43:30.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:30.925+0000 7f092c99d700 1 -- 172.21.15.151:0/2271531300 wait complete. 2023-07-21T22:43:31.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:30 smithi187 ceph-mon[96918]: pgmap v768: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.3 MiB/s wr, 302 op/s 2023-07-21T22:43:32.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:32 smithi195 ceph-mon[97365]: pgmap v769: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.3 MiB/s wr, 302 op/s 2023-07-21T22:43:32.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:32 smithi151 ceph-mon[95510]: pgmap v769: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.3 MiB/s wr, 302 op/s 2023-07-21T22:43:33.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:32 smithi187 ceph-mon[96918]: pgmap v769: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 2.3 MiB/s wr, 302 op/s 2023-07-21T22:43:34.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:34 smithi195 ceph-mon[97365]: pgmap v770: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.5 MiB/s wr, 460 op/s 2023-07-21T22:43:34.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:34 smithi151 ceph-mon[95510]: pgmap v770: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.5 MiB/s wr, 460 op/s 2023-07-21T22:43:35.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:34 smithi187 ceph-mon[96918]: pgmap v770: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.5 MiB/s wr, 460 op/s 2023-07-21T22:43:35.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:35 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:43:35.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:35 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:43:36.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:35 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:43:36.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:36 smithi195 ceph-mon[97365]: pgmap v771: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.4 MiB/s wr, 307 op/s 2023-07-21T22:43:36.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:36 smithi151 ceph-mon[95510]: pgmap v771: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.4 MiB/s wr, 307 op/s 2023-07-21T22:43:37.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:36 smithi187 ceph-mon[96918]: pgmap v771: 97 pgs: 97 active+clean; 8.2 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 2.4 MiB/s wr, 307 op/s 2023-07-21T22:43:38.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:38 smithi151 ceph-mon[95510]: pgmap v772: 97 pgs: 97 active+clean; 8.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.5 MiB/s wr, 459 op/s 2023-07-21T22:43:39.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:38 smithi187 ceph-mon[96918]: pgmap v772: 97 pgs: 97 active+clean; 8.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.5 MiB/s wr, 459 op/s 2023-07-21T22:43:39.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:38 smithi195 ceph-mon[97365]: pgmap v772: 97 pgs: 97 active+clean; 8.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.5 MiB/s wr, 459 op/s 2023-07-21T22:43:40.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:40 smithi151 ceph-mon[95510]: pgmap v773: 97 pgs: 97 active+clean; 8.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:41.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:40 smithi187 ceph-mon[96918]: pgmap v773: 97 pgs: 97 active+clean; 8.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:41.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:40 smithi195 ceph-mon[97365]: pgmap v773: 97 pgs: 97 active+clean; 8.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:42.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:42 smithi151 ceph-mon[95510]: pgmap v774: 97 pgs: 97 active+clean; 8.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:43.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:42 smithi187 ceph-mon[96918]: pgmap v774: 97 pgs: 97 active+clean; 8.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:43.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:42 smithi195 ceph-mon[97365]: pgmap v774: 97 pgs: 97 active+clean; 8.2 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:43:44.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.079+0000 7f8a281ff700 1 -- 172.21.15.151:0/1709052471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a20105b10 msgr2=0x7f8a20105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.079+0000 7f8a281ff700 1 --2- 172.21.15.151:0/1709052471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a20105b10 0x7f8a20105ee0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c009990 tx=0x7f8a1c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.079+0000 7f8a281ff700 1 -- 172.21.15.151:0/1709052471 shutdown_connections 2023-07-21T22:43:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.079+0000 7f8a281ff700 1 --2- 172.21.15.151:0/1709052471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a20105b10 0x7f8a20105ee0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.079+0000 7f8a281ff700 1 --2- 172.21.15.151:0/1709052471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a201004b0 0x7f8a2010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.079+0000 7f8a281ff700 1 --2- 172.21.15.151:0/1709052471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a200ffb00 0x7f8a200fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.079+0000 7f8a281ff700 1 -- 172.21.15.151:0/1709052471 >> 172.21.15.151:0/1709052471 conn(0x7f8a200fb600 msgr2=0x7f8a200fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.079+0000 7f8a281ff700 1 -- 172.21.15.151:0/1709052471 shutdown_connections 2023-07-21T22:43:44.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.079+0000 7f8a281ff700 1 -- 172.21.15.151:0/1709052471 wait complete. 2023-07-21T22:43:44.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.080+0000 7f8a281ff700 1 Processor -- start 2023-07-21T22:43:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.080+0000 7f8a281ff700 1 -- start start 2023-07-21T22:43:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.080+0000 7f8a281ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a200ffb00 0x7f8a20197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.080+0000 7f8a281ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a201004b0 0x7f8a20198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a281ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a20105b10 0x7f8a2019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a281ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2019cf40 con 0x7f8a200ffb00 2023-07-21T22:43:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a281ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2019d0b0 con 0x7f8a20105b10 2023-07-21T22:43:44.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a281ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a2019d270 con 0x7f8a201004b0 2023-07-21T22:43:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a25f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a200ffb00 0x7f8a20197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a25f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a200ffb00 0x7f8a20197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44738/0 (socket says 172.21.15.151:44738) 2023-07-21T22:43:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a25f9b700 1 -- 172.21.15.151:0/376461389 learned_addr learned my addr 172.21.15.151:0/376461389 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a2579a700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a201004b0 0x7f8a20198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a2679c700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a20105b10 0x7f8a2019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a25f9b700 1 -- 172.21.15.151:0/376461389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a201004b0 msgr2=0x7f8a20198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a201004b0 0x7f8a20198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a25f9b700 1 -- 172.21.15.151:0/376461389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a20105b10 msgr2=0x7f8a2019c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:44.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a20105b10 0x7f8a2019c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a25f9b700 1 -- 172.21.15.151:0/376461389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a18009c40 con 0x7f8a200ffb00 2023-07-21T22:43:44.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.081+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a200ffb00 0x7f8a20197d50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005910 tx=0x7f8a1c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:44.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.082+0000 7f8a16ffd700 1 -- 172.21.15.151:0/376461389 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c01d070 con 0x7f8a200ffb00 2023-07-21T22:43:44.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.082+0000 7f8a281ff700 1 -- 172.21.15.151:0/376461389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a1c0095f0 con 0x7f8a200ffb00 2023-07-21T22:43:44.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.082+0000 7f8a16ffd700 1 -- 172.21.15.151:0/376461389 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a1c021410 con 0x7f8a200ffb00 2023-07-21T22:43:44.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.082+0000 7f8a16ffd700 1 -- 172.21.15.151:0/376461389 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c017650 con 0x7f8a200ffb00 2023-07-21T22:43:44.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.082+0000 7f8a281ff700 1 -- 172.21.15.151:0/376461389 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a201a4bb0 con 0x7f8a200ffb00 2023-07-21T22:43:44.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.085+0000 7f8a16ffd700 1 -- 172.21.15.151:0/376461389 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f8a1c00fb00 con 0x7f8a200ffb00 2023-07-21T22:43:44.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a3bab8b80 1 Processor -- start 2023-07-21T22:43:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a16ffd700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a0c0a12c0 0x7f8a0c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a3bab8b80 1 -- start start 2023-07-21T22:43:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a16ffd700 1 -- 172.21.15.151:0/376461389 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8a1c021e40 con 0x7f8a200ffb00 2023-07-21T22:43:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a2679c700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a0c0a12c0 0x7f8a0c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec14cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15210 0x55f0eec0ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eeb14c50 con 0x55f0eec15660 2023-07-21T22:43:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eeb679e0 con 0x55f0eea6b6b0 2023-07-21T22:43:44.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.087+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eeb60e70 con 0x55f0eec15210 2023-07-21T22:43:44.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2579a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15210 0x55f0eec0ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2579a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15210 0x55f0eec0ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48550/0 (socket says 172.21.15.151:48550) 2023-07-21T22:43:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a25f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec14cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2579a700 1 -- 172.21.15.151:0/3145938351 learned_addr learned my addr 172.21.15.151:0/3145938351 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2679c700 1 --2- 172.21.15.151:0/3145938351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2579a700 1 -- 172.21.15.151:0/3145938351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 msgr2=0x55f0eec14cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2579a700 1 --2- 172.21.15.151:0/3145938351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec14cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2579a700 1 -- 172.21.15.151:0/3145938351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 msgr2=0x55f0eec0f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2579a700 1 --2- 172.21.15.151:0/3145938351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2679c700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a0c0a12c0 0x7f8a0c0a3770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009fd0 tx=0x7f8a18009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2579a700 1 -- 172.21.15.151:0/3145938351 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ee98ed80 con 0x55f0eec15210 2023-07-21T22:43:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.088+0000 7f8a2579a700 1 --2- 172.21.15.151:0/3145938351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15210 0x55f0eec0ef40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009d20 tx=0x7f8a10011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b47e60d15815f764 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a0bfff700 1 -- 172.21.15.151:0/3145938351 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a10019630 con 0x55f0eec15210 2023-07-21T22:43:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a0bfff700 1 -- 172.21.15.151:0/3145938351 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a10019c20 con 0x55f0eec15210 2023-07-21T22:43:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a0bfff700 1 -- 172.21.15.151:0/3145938351 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000eb00 con 0x55f0eec15210 2023-07-21T22:43:44.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/3145938351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15210 msgr2=0x55f0eec0ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/3145938351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15210 0x55f0eec0ef40 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009d20 tx=0x7f8a10011720 comp rx=0 tx=0).stop 2023-07-21T22:43:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/3145938351 shutdown_connections 2023-07-21T22:43:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/3145938351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec14cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/3145938351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/3145938351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15210 0x55f0eec0ef40 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.089+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/3145938351 >> 172.21.15.151:0/3145938351 conn(0x55f0eec04ae0 msgr2=0x55f0eec0a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.090+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/3145938351 shutdown_connections 2023-07-21T22:43:44.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.090+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/3145938351 wait complete. 2023-07-21T22:43:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.090+0000 7f8a3bab8b80 1 -- start start 2023-07-21T22:43:44.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.090+0000 7f8a3bab8b80 1 Processor -- start 2023-07-21T22:43:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15210 0x55f0eec18830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 0x55f0eec18f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eeb00a60 con 0x55f0eec15210 2023-07-21T22:43:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eeb00760 con 0x55f0eea6b6b0 2023-07-21T22:43:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0ee9e48c0 con 0x55f0eec15660 2023-07-21T22:43:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a3bab8b80 10 client.0 _ll_register_callbacks cb 0x55f0eeafe700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a25f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a25f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41652/0 (socket says 172.21.15.151:41652) 2023-07-21T22:43:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a25f9b700 1 -- 172.21.15.151:0/576006569 learned_addr learned my addr 172.21.15.151:0/576006569 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:44.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a2579a700 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15210 0x55f0eec18830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a2679c700 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 0x55f0eec18f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a25f9b700 1 -- 172.21.15.151:0/576006569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 msgr2=0x55f0eec18f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 0x55f0eec18f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a25f9b700 1 -- 172.21.15.151:0/576006569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15210 msgr2=0x55f0eec18830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15210 0x55f0eec18830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.091+0000 7f8a25f9b700 1 -- 172.21.15.151:0/576006569 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a10009980 con 0x55f0eea6b6b0 2023-07-21T22:43:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.092+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1b5b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c09ae20 tx=0x7f8a1c096e50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3674aaf3717310a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:44.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.092+0000 7f8a097fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:43:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.092+0000 7f8a097fa700 1 -- 172.21.15.151:0/576006569 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c09b120 con 0x55f0eea6b6b0 2023-07-21T22:43:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.092+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/576006569 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f0eeaba490 con 0x55f0eea6b6b0 2023-07-21T22:43:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.092+0000 7f8a097fa700 1 -- 172.21.15.151:0/576006569 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8a1c09f150 con 0x55f0eea6b6b0 2023-07-21T22:43:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.092+0000 7f8a097fa700 1 -- 172.21.15.151:0/576006569 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a1c0a34e0 con 0x55f0eea6b6b0 2023-07-21T22:43:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.092+0000 7f8a3bab8b80 10 client.27956 fetch_fsmap learned FSMap version 88 2023-07-21T22:43:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.092+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/576006569 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) v3 -- 0x55f0ee977c00 con 0x55f0eea6b6b0 2023-07-21T22:43:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.092+0000 7f8a097fa700 1 -- 172.21.15.151:0/576006569 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f0eeaba490 con 0x55f0eea6b6b0 2023-07-21T22:43:44.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.093+0000 7f8a097fa700 1 -- 172.21.15.151:0/576006569 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 88) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f8a1c09a610 con 0x55f0eea6b6b0 2023-07-21T22:43:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.093+0000 7f8a3bab8b80 10 client.27956 fetch_fsmap finished waiting for FSMap version 88 2023-07-21T22:43:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.093+0000 7f8a3bab8b80 10 client.27956 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.093+0000 7f8a3bab8b80 20 client.27956 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.093+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f0eec287f0 0x55f0eec2ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.093+0000 7f8a3bab8b80 4 client.27956 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:43:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.093+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/576006569 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f0eeb59e50 con 0x55f0eec287f0 2023-07-21T22:43:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.093+0000 7f8a2579a700 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f0eec287f0 0x55f0eec2ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.094+0000 7f8a2579a700 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f0eec287f0 0x55f0eec2ac00 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b7c5638523b27d server_cookie=e1353469d336dc23 in_seq=0 out_seq=0 2023-07-21T22:43:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.094+0000 7f8a097fa700 10 client.27956 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.094+0000 7f8a097fa700 1 -- 172.21.15.151:0/576006569 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f0eeb59e50 con 0x55f0eec287f0 2023-07-21T22:43:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.094+0000 7f8a097fa700 10 client.27956 handle_command_reply: tid=0 2023-07-21T22:43:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.094+0000 7f8a3bab8b80 1 client.27956 shutdown 2023-07-21T22:43:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.094+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/576006569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 msgr2=0x55f0eec1b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.094+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1b5b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c09ae20 tx=0x7f8a1c096e50 comp rx=0 tx=0).stop 2023-07-21T22:43:44.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/576006569 shutdown_connections 2023-07-21T22:43:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f0eec287f0 0x55f0eec2ac00 crc :-1 s=READY pgs=316 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1b5b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 0x55f0eec18f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a097fa700 0 client.27956 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/576006569 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15210 0x55f0eec18830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/576006569 >> 172.21.15.151:0/576006569 conn(0x55f0eec04ae0 msgr2=0x55f0eec093e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/576006569 shutdown_connections 2023-07-21T22:43:44.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/576006569 wait complete. 2023-07-21T22:43:44.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.095+0000 7f8a3bab8b80 20 client.27956 trim_cache size 0 max 16384 2023-07-21T22:43:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a3bab8b80 1 Processor -- start 2023-07-21T22:43:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a3bab8b80 1 -- start start 2023-07-21T22:43:44.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eea6b6b0 0x55f0eec0f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 0x55f0eec16330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eec197e0 con 0x55f0eec15660 2023-07-21T22:43:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eec06c00 con 0x55f0eec15210 2023-07-21T22:43:44.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eec19e10 con 0x55f0eea6b6b0 2023-07-21T22:43:44.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a2679c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a25f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eea6b6b0 0x55f0eec0f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a2579a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 0x55f0eec16330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a2579a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 0x55f0eec16330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41664/0 (socket says 172.21.15.151:41664) 2023-07-21T22:43:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a25f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eea6b6b0 0x55f0eec0f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48562/0 (socket says 172.21.15.151:48562) 2023-07-21T22:43:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a2679c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44758/0 (socket says 172.21.15.151:44758) 2023-07-21T22:43:44.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.111+0000 7f8a2579a700 1 -- 172.21.15.151:0/1764417245 learned_addr learned my addr 172.21.15.151:0/1764417245 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a25f9b700 1 -- 172.21.15.151:0/1764417245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 msgr2=0x55f0eec16330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/1764417245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 0x55f0eec16330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a25f9b700 1 -- 172.21.15.151:0/1764417245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 msgr2=0x55f0eec0e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/1764417245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a25f9b700 1 -- 172.21.15.151:0/1764417245 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f0ee9b51f0 con 0x55f0eea6b6b0 2023-07-21T22:43:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a2679c700 1 --2- 172.21.15.151:0/1764417245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:43:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/1764417245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eea6b6b0 0x55f0eec0f720 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c097b90 tx=0x7f8a1c009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fda209cd3bf2d4d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:44.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a14ff9700 1 -- 172.21.15.151:0/1764417245 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0b1ef0 con 0x55f0eea6b6b0 2023-07-21T22:43:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a14ff9700 1 -- 172.21.15.151:0/1764417245 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a1c09f150 con 0x55f0eea6b6b0 2023-07-21T22:43:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.112+0000 7f8a14ff9700 1 -- 172.21.15.151:0/1764417245 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0b92e0 con 0x55f0eea6b6b0 2023-07-21T22:43:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/1764417245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eea6b6b0 msgr2=0x55f0eec0f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/1764417245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eea6b6b0 0x55f0eec0f720 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c097b90 tx=0x7f8a1c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/1764417245 shutdown_connections 2023-07-21T22:43:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/1764417245 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eec15660 0x55f0eec0e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/1764417245 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eea6b6b0 0x55f0eec0f720 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/1764417245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 0x55f0eec16330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/1764417245 >> 172.21.15.151:0/1764417245 conn(0x55f0eec04ae0 msgr2=0x55f0eec0df30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/1764417245 shutdown_connections 2023-07-21T22:43:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/1764417245 wait complete. 2023-07-21T22:43:44.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.113+0000 7f8a3bab8b80 1 -- start start 2023-07-21T22:43:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a3bab8b80 1 Processor -- start 2023-07-21T22:43:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 0x55f0eec1c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a3bab8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 0x55f0eec7b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eec1cfb0 con 0x55f0eea6b6b0 2023-07-21T22:43:44.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eec7bba0 con 0x55f0eec15210 2023-07-21T22:43:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a3bab8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f0eec7bd30 con 0x55f0eec15660 2023-07-21T22:43:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a3bab8b80 10 client.0 _ll_register_callbacks cb 0x55f0eeafe700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a25f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a25f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44772/0 (socket says 172.21.15.151:44772) 2023-07-21T22:43:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a25f9b700 1 -- 172.21.15.151:0/2971016224 learned_addr learned my addr 172.21.15.151:0/2971016224 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a2579a700 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 0x55f0eec1c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.114+0000 7f8a2679c700 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 0x55f0eec7b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a25f9b700 1 -- 172.21.15.151:0/2971016224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 msgr2=0x55f0eec7b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 0x55f0eec7b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a25f9b700 1 -- 172.21.15.151:0/2971016224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 msgr2=0x55f0eec1c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 0x55f0eec1c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a25f9b700 1 -- 172.21.15.151:0/2971016224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a180197b0 con 0x55f0eea6b6b0 2023-07-21T22:43:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a25f9b700 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1c340 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c09b0b0 tx=0x7f8a1c0cb7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ee7bb6903e348b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a097fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:43:44.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a097fa700 1 -- 172.21.15.151:0/2971016224 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c09b120 con 0x55f0eea6b6b0 2023-07-21T22:43:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a097fa700 1 -- 172.21.15.151:0/2971016224 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8a1c0a34e0 con 0x55f0eea6b6b0 2023-07-21T22:43:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/2971016224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8a10019c20 con 0x55f0eea6b6b0 2023-07-21T22:43:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a097fa700 1 -- 172.21.15.151:0/2971016224 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=88) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a1c0a30a0 con 0x55f0eea6b6b0 2023-07-21T22:43:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a3bab8b80 10 client.18291 fetch_fsmap learned FSMap version 88 2023-07-21T22:43:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.115+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/2971016224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=88,monmap=4+}) v3 -- 0x55f0ee977c00 con 0x55f0eea6b6b0 2023-07-21T22:43:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.116+0000 7f8a097fa700 1 -- 172.21.15.151:0/2971016224 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a10019c20 con 0x55f0eea6b6b0 2023-07-21T22:43:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.116+0000 7f8a097fa700 1 -- 172.21.15.151:0/2971016224 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 88) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f8a1c0b3a70 con 0x55f0eea6b6b0 2023-07-21T22:43:44.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.116+0000 7f8a3bab8b80 10 client.18291 fetch_fsmap finished waiting for FSMap version 88 2023-07-21T22:43:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.116+0000 7f8a3bab8b80 10 client.18291 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.116+0000 7f8a3bab8b80 20 client.18291 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.116+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f0eec7cf90 0x55f0eec7f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.116+0000 7f8a3bab8b80 4 client.18291 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:43:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.116+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/2971016224 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f0eeb1bff0 con 0x55f0eec7cf90 2023-07-21T22:43:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.116+0000 7f8a2579a700 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f0eec7cf90 0x55f0eec7f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.117+0000 7f8a2579a700 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f0eec7cf90 0x55f0eec7f370 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8347ff17ce6175 server_cookie=62bab67395578567 in_seq=0 out_seq=0 2023-07-21T22:43:44.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.117+0000 7f8a097fa700 10 client.18291 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a097fa700 1 -- 172.21.15.151:0/2971016224 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f0eeb1bff0 con 0x55f0eec7cf90 2023-07-21T22:43:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a097fa700 10 client.18291 handle_command_reply: tid=0 2023-07-21T22:43:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 client.18291 shutdown 2023-07-21T22:43:44.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/2971016224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eea6b6b0 msgr2=0x55f0eec1c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1c340 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c09b0b0 tx=0x7f8a1c0cb7f0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/2971016224 shutdown_connections 2023-07-21T22:43:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f0eec7cf90 0x55f0eec7f370 crc :-1 s=READY pgs=317 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f0eec15660 0x55f0eec7b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f0eea6b6b0 0x55f0eec1c340 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 --2- 172.21.15.151:0/2971016224 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f0eec15210 0x55f0eec1c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a097fa700 0 client.18291 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:44.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/2971016224 >> 172.21.15.151:0/2971016224 conn(0x55f0eec04ae0 msgr2=0x55f0eec0e7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/2971016224 shutdown_connections 2023-07-21T22:43:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 1 -- 172.21.15.151:0/2971016224 wait complete. 2023-07-21T22:43:44.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.129+0000 7f8a3bab8b80 20 client.18291 trim_cache size 0 max 16384 2023-07-21T22:43:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:43:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:43:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:43:44.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:43:44.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 -- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a0c0a12c0 msgr2=0x7f8a0c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:44.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a0c0a12c0 0x7f8a0c0a3770 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f8a18009fd0 tx=0x7f8a18009920 comp rx=0 tx=0).stop 2023-07-21T22:43:44.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 -- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a200ffb00 msgr2=0x7f8a20197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:44.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a200ffb00 0x7f8a20197d50 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c005910 tx=0x7f8a1c0047b0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 -- 172.21.15.151:0/376461389 shutdown_connections 2023-07-21T22:43:44.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a0c0a12c0 0x7f8a0c0a3770 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a20105b10 0x7f8a2019c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8a200ffb00 0x7f8a20197d50 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 --2- 172.21.15.151:0/376461389 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8a201004b0 0x7f8a20198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:44.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 -- 172.21.15.151:0/376461389 >> 172.21.15.151:0/376461389 conn(0x7f8a200fb600 msgr2=0x7f8a2010ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:44.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 -- 172.21.15.151:0/376461389 shutdown_connections 2023-07-21T22:43:44.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:44.130+0000 7f8a281ff700 1 -- 172.21.15.151:0/376461389 wait complete. 2023-07-21T22:43:44.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:44 smithi151 ceph-mon[95510]: pgmap v775: 97 pgs: 97 active+clean; 8.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.7 MiB/s wr, 476 op/s 2023-07-21T22:43:45.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:44 smithi187 ceph-mon[96918]: pgmap v775: 97 pgs: 97 active+clean; 8.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.7 MiB/s wr, 476 op/s 2023-07-21T22:43:45.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:44 smithi195 ceph-mon[97365]: pgmap v775: 97 pgs: 97 active+clean; 8.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 3.7 MiB/s wr, 476 op/s 2023-07-21T22:43:46.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:46 smithi151 ceph-mon[95510]: pgmap v776: 97 pgs: 97 active+clean; 8.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 318 op/s 2023-07-21T22:43:47.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:46 smithi187 ceph-mon[96918]: pgmap v776: 97 pgs: 97 active+clean; 8.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 318 op/s 2023-07-21T22:43:47.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:46 smithi195 ceph-mon[97365]: pgmap v776: 97 pgs: 97 active+clean; 8.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.4 MiB/s wr, 318 op/s 2023-07-21T22:43:48.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:47 smithi187 ceph-mon[96918]: pgmap v777: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 3.6 MiB/s wr, 465 op/s 2023-07-21T22:43:48.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:47 smithi195 ceph-mon[97365]: pgmap v777: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 3.6 MiB/s wr, 465 op/s 2023-07-21T22:43:48.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:47 smithi151 ceph-mon[95510]: pgmap v777: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 3.6 MiB/s wr, 465 op/s 2023-07-21T22:43:50.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:49 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:43:50.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:49 smithi187 ceph-mon[96918]: pgmap v778: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:43:50.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:49 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:43:50.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:49 smithi195 ceph-mon[97365]: pgmap v778: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:43:50.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:49 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:43:50.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:49 smithi151 ceph-mon[95510]: pgmap v778: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:43:52.873 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:52 smithi187 ceph-mon[96918]: pgmap v779: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:43:52.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:52 smithi195 ceph-mon[97365]: pgmap v779: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:43:52.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:52 smithi151 ceph-mon[95510]: pgmap v779: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 2.4 MiB/s wr, 313 op/s 2023-07-21T22:43:54.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:54 smithi195 ceph-mon[97365]: pgmap v780: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 3.5 MiB/s wr, 456 op/s 2023-07-21T22:43:54.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:54 smithi151 ceph-mon[95510]: pgmap v780: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 3.5 MiB/s wr, 456 op/s 2023-07-21T22:43:55.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:54 smithi187 ceph-mon[96918]: pgmap v780: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 3.5 MiB/s wr, 456 op/s 2023-07-21T22:43:56.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:56 smithi195 ceph-mon[97365]: pgmap v781: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-07-21T22:43:56.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:56 smithi151 ceph-mon[95510]: pgmap v781: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-07-21T22:43:57.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:56 smithi187 ceph-mon[96918]: pgmap v781: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.2 MiB/s wr, 289 op/s 2023-07-21T22:43:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.291+0000 7f7f9dbff700 1 -- 172.21.15.151:0/1411960607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f98104a30 msgr2=0x7f7f98104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.291+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/1411960607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f98104a30 0x7f7f98104e00 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009990 tx=0x7f7f88009ca0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.291+0000 7f7f9dbff700 1 -- 172.21.15.151:0/1411960607 shutdown_connections 2023-07-21T22:43:57.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.291+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/1411960607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f980ff3e0 0x7f7f9810b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.291+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/1411960607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f98104a30 0x7f7f98104e00 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.291+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/1411960607 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f980fea30 0x7f7f980feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.291+0000 7f7f9dbff700 1 -- 172.21.15.151:0/1411960607 >> 172.21.15.151:0/1411960607 conn(0x7f7f98074760 msgr2=0x7f7f98074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.292+0000 7f7f9dbff700 1 -- 172.21.15.151:0/1411960607 shutdown_connections 2023-07-21T22:43:57.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.292+0000 7f7f9dbff700 1 -- 172.21.15.151:0/1411960607 wait complete. 2023-07-21T22:43:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.293+0000 7f7f9dbff700 1 Processor -- start 2023-07-21T22:43:57.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.293+0000 7f7f9dbff700 1 -- start start 2023-07-21T22:43:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.293+0000 7f7f9dbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f980fea30 0x7f7f98100810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.293+0000 7f7f9dbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f980ff3e0 0x7f7f98100d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.293+0000 7f7f9dbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f98104a30 0x7f7f981a3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.293+0000 7f7f9dbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f981a4280 con 0x7f7f980fea30 2023-07-21T22:43:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.293+0000 7f7f9dbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f981a43c0 con 0x7f7f980ff3e0 2023-07-21T22:43:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.293+0000 7f7f9dbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f981a4530 con 0x7f7f98104a30 2023-07-21T22:43:57.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.293+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f980fea30 0x7f7f98100810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f980fea30 0x7f7f98100810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58922/0 (socket says 172.21.15.151:58922) 2023-07-21T22:43:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f977fe700 1 -- 172.21.15.151:0/3866448061 learned_addr learned my addr 172.21.15.151:0/3866448061 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f97fff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f98104a30 0x7f7f981a3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f980ff3e0 0x7f7f98100d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f97fff700 1 -- 172.21.15.151:0/3866448061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f980ff3e0 msgr2=0x7f7f98100d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f97fff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f980ff3e0 0x7f7f98100d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f97fff700 1 -- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f980fea30 msgr2=0x7f7f98100810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:57.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f97fff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f980fea30 0x7f7f98100810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f97fff700 1 -- 172.21.15.151:0/3866448061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f880095f0 con 0x7f7f98104a30 2023-07-21T22:43:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f977fe700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f980fea30 0x7f7f98100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:43:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.294+0000 7f7f97fff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f98104a30 0x7f7f981a3d40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7f90007f10 tx=0x7f7f9000d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:57.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.295+0000 7f7f94ff9700 1 -- 172.21.15.151:0/3866448061 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90004db0 con 0x7f7f98104a30 2023-07-21T22:43:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.295+0000 7f7f94ff9700 1 -- 172.21.15.151:0/3866448061 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f9000f040 con 0x7f7f98104a30 2023-07-21T22:43:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.295+0000 7f7f9dbff700 1 -- 172.21.15.151:0/3866448061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f981a4810 con 0x7f7f98104a30 2023-07-21T22:43:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.295+0000 7f7f94ff9700 1 -- 172.21.15.151:0/3866448061 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f90005960 con 0x7f7f98104a30 2023-07-21T22:43:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.295+0000 7f7f9dbff700 1 -- 172.21.15.151:0/3866448061 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f981a4d20 con 0x7f7f98104a30 2023-07-21T22:43:57.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.298+0000 7f7f94ff9700 1 -- 172.21.15.151:0/3866448061 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f7f9000db20 con 0x7f7f98104a30 2023-07-21T22:43:57.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.299+0000 7f7fb15e1b80 1 Processor -- start 2023-07-21T22:43:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.300+0000 7f7fb15e1b80 1 -- start start 2023-07-21T22:43:57.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.300+0000 7f7f94ff9700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7f800a12c0 0x7f7f800a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.300+0000 7f7f94ff9700 1 -- 172.21.15.151:0/3866448061 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7f900cc5b0 con 0x7f7f98104a30 2023-07-21T22:43:57.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.300+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb56cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.300+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb50f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.300+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 0x56029bb514a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.300+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029ba56c50 con 0x56029bb57210 2023-07-21T22:43:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.300+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029baa99e0 con 0x56029bb57660 2023-07-21T22:43:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.300+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029baa2e70 con 0x56029b9ad6b0 2023-07-21T22:43:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7f800a12c0 0x7f7f800a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f96ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb50f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb56cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb56cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51926/0 (socket says 172.21.15.151:51926) 2023-07-21T22:43:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f96ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb50f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58938/0 (socket says 172.21.15.151:58938) 2023-07-21T22:43:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f977fe700 1 -- 172.21.15.151:0/1016287882 learned_addr learned my addr 172.21.15.151:0/1016287882 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f97fff700 1 --2- 172.21.15.151:0/1016287882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 0x56029bb514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f977fe700 1 -- 172.21.15.151:0/1016287882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 msgr2=0x56029bb514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f977fe700 1 --2- 172.21.15.151:0/1016287882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 0x56029bb514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f977fe700 1 -- 172.21.15.151:0/1016287882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 msgr2=0x56029bb50f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f977fe700 1 --2- 172.21.15.151:0/1016287882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb50f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f977fe700 1 -- 172.21.15.151:0/1016287882 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56029b8d0d80 con 0x56029b9ad6b0 2023-07-21T22:43:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.301+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7f800a12c0 0x7f7f800a3770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f98102030 tx=0x7f7f8c009bf0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.302+0000 7f7f977fe700 1 --2- 172.21.15.151:0/1016287882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb56cd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7f88005f00 tx=0x7f7f88004500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71ff0e6ff81f398d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.302+0000 7f7f7dffb700 1 -- 172.21.15.151:0/1016287882 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8801d050 con 0x56029b9ad6b0 2023-07-21T22:43:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.302+0000 7f7f7dffb700 1 -- 172.21.15.151:0/1016287882 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f8801e040 con 0x56029b9ad6b0 2023-07-21T22:43:57.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.302+0000 7f7f7dffb700 1 -- 172.21.15.151:0/1016287882 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88004c80 con 0x56029b9ad6b0 2023-07-21T22:43:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/1016287882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 msgr2=0x56029bb56cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/1016287882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb56cd0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f7f88005f00 tx=0x7f7f88004500 comp rx=0 tx=0).stop 2023-07-21T22:43:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/1016287882 shutdown_connections 2023-07-21T22:43:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/1016287882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 0x56029bb514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/1016287882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb56cd0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/1016287882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb50f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/1016287882 >> 172.21.15.151:0/1016287882 conn(0x56029bb46ae0 msgr2=0x56029bb4c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:57.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/1016287882 shutdown_connections 2023-07-21T22:43:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/1016287882 wait complete. 2023-07-21T22:43:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.303+0000 7f7fb15e1b80 1 -- start start 2023-07-21T22:43:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.304+0000 7f7fb15e1b80 1 Processor -- start 2023-07-21T22:43:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.304+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.304+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 0x56029bb60a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.304+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 0x56029bb5a850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.304+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029ba42a60 con 0x56029bb57660 2023-07-21T22:43:57.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.304+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029ba42760 con 0x56029bb57210 2023-07-21T22:43:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.304+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029b9268c0 con 0x56029b9ad6b0 2023-07-21T22:43:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.304+0000 7f7fb15e1b80 10 client.0 _ll_register_callbacks cb 0x56029ba40700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51938/0 (socket says 172.21.15.151:51938) 2023-07-21T22:43:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f977fe700 1 -- 172.21.15.151:0/4220803282 learned_addr learned my addr 172.21.15.151:0/4220803282 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 0x56029bb60a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f97fff700 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 0x56029bb5a850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f977fe700 1 -- 172.21.15.151:0/4220803282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 msgr2=0x56029bb60a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f977fe700 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 0x56029bb60a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f977fe700 1 -- 172.21.15.151:0/4220803282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 msgr2=0x56029bb5a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f977fe700 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 0x56029bb5a850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f977fe700 1 -- 172.21.15.151:0/4220803282 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9810c160 con 0x56029b9ad6b0 2023-07-21T22:43:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f977fe700 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60550 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009ce0 tx=0x7f7f88023ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b735b064eecb7550 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.305+0000 7f7f76ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:43:57.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.306+0000 7f7f76ffd700 1 -- 172.21.15.151:0/4220803282 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8800f660 con 0x56029b9ad6b0 2023-07-21T22:43:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.306+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/4220803282 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56029b9fc490 con 0x56029b9ad6b0 2023-07-21T22:43:57.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.306+0000 7f7f76ffd700 1 -- 172.21.15.151:0/4220803282 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7f8800f7c0 con 0x56029b9ad6b0 2023-07-21T22:43:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.306+0000 7f7f76ffd700 1 -- 172.21.15.151:0/4220803282 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f8801d020 con 0x56029b9ad6b0 2023-07-21T22:43:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.306+0000 7f7fb15e1b80 10 client.28003 fetch_fsmap learned FSMap version 89 2023-07-21T22:43:57.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.306+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/4220803282 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x56029b8b9c00 con 0x56029b9ad6b0 2023-07-21T22:43:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.306+0000 7f7f76ffd700 1 -- 172.21.15.151:0/4220803282 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56029b9fc490 con 0x56029b9ad6b0 2023-07-21T22:43:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.306+0000 7f7f76ffd700 1 -- 172.21.15.151:0/4220803282 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7f8802d5b0 con 0x56029b9ad6b0 2023-07-21T22:43:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.307+0000 7f7fb15e1b80 10 client.28003 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:43:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.307+0000 7f7fb15e1b80 10 client.28003 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.307+0000 7f7fb15e1b80 20 client.28003 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.307+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56029bb6a510 0x56029bb6c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.307+0000 7f7fb15e1b80 4 client.28003 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:43:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.307+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/4220803282 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56029ba9be50 con 0x56029bb6a510 2023-07-21T22:43:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.307+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56029bb6a510 0x56029bb6c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.308+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56029bb6a510 0x56029bb6c8f0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=318cfc8177f7f80f server_cookie=dbcfa71b4c8cd269 in_seq=0 out_seq=0 2023-07-21T22:43:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.308+0000 7f7f76ffd700 10 client.28003 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7f76ffd700 1 -- 172.21.15.151:0/4220803282 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56029ba9be50 con 0x56029bb6a510 2023-07-21T22:43:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7f76ffd700 10 client.28003 handle_command_reply: tid=0 2023-07-21T22:43:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 client.28003 shutdown 2023-07-21T22:43:57.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/4220803282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 msgr2=0x56029bb60550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60550 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009ce0 tx=0x7f7f88023ac0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/4220803282 shutdown_connections 2023-07-21T22:43:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56029bb6a510 0x56029bb6c8f0 crc :-1 s=READY pgs=318 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 0x56029bb5a850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7f76ffd700 0 client.28003 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60550 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/4220803282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 0x56029bb60a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/4220803282 >> 172.21.15.151:0/4220803282 conn(0x56029bb46ae0 msgr2=0x56029bb4b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/4220803282 shutdown_connections 2023-07-21T22:43:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/4220803282 wait complete. 2023-07-21T22:43:57.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.309+0000 7f7fb15e1b80 20 client.28003 trim_cache size 0 max 16384 2023-07-21T22:43:57.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.325+0000 7f7fb15e1b80 1 Processor -- start 2023-07-21T22:43:57.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.325+0000 7f7fb15e1b80 1 -- start start 2023-07-21T22:43:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.325+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb5a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.325+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb56060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.325+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 0x56029bb50f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.325+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029bb48c40 con 0x56029bb57210 2023-07-21T22:43:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029bb56900 con 0x56029bb57660 2023-07-21T22:43:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029bb55540 con 0x56029b9ad6b0 2023-07-21T22:43:57.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f96ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb56060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb5a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f96ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb56060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58942/0 (socket says 172.21.15.151:58942) 2023-07-21T22:43:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f96ffd700 1 -- 172.21.15.151:0/2553832968 learned_addr learned my addr 172.21.15.151:0/2553832968 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f97fff700 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 0x56029bb50f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f96ffd700 1 -- 172.21.15.151:0/2553832968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 msgr2=0x56029bb5a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb5a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f96ffd700 1 -- 172.21.15.151:0/2553832968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 msgr2=0x56029bb50f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:57.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 0x56029bb50f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f96ffd700 1 -- 172.21.15.151:0/2553832968 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56029b8f71f0 con 0x56029bb57210 2023-07-21T22:43:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f977fe700 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb5a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:43:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.326+0000 7f7f97fff700 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 0x56029bb50f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:43:57.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.327+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb56060 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x56029bb5be40 tx=0x7f7f8c021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114e57d8179d18a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.327+0000 7f7f7e7fc700 1 -- 172.21.15.151:0/2553832968 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c016040 con 0x56029bb57210 2023-07-21T22:43:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.327+0000 7f7f7e7fc700 1 -- 172.21.15.151:0/2553832968 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f8c011320 con 0x56029bb57210 2023-07-21T22:43:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.327+0000 7f7f7e7fc700 1 -- 172.21.15.151:0/2553832968 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8c004830 con 0x56029bb57210 2023-07-21T22:43:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2553832968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 msgr2=0x56029bb56060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb56060 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x56029bb5be40 tx=0x7f7f8c021000 comp rx=0 tx=0).stop 2023-07-21T22:43:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2553832968 shutdown_connections 2023-07-21T22:43:57.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57660 0x56029bb50f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb5a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2553832968 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57210 0x56029bb56060 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2553832968 >> 172.21.15.151:0/2553832968 conn(0x56029bb46ae0 msgr2=0x56029bb55950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2553832968 shutdown_connections 2023-07-21T22:43:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2553832968 wait complete. 2023-07-21T22:43:57.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 -- start start 2023-07-21T22:43:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.328+0000 7f7fb15e1b80 1 Processor -- start 2023-07-21T22:43:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 0x56029bb5e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7fb15e1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 0x56029bb5ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029bb5f3a0 con 0x56029bb57660 2023-07-21T22:43:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029bb5f510 con 0x56029bb57210 2023-07-21T22:43:57.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7fb15e1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56029bb5f6d0 con 0x56029b9ad6b0 2023-07-21T22:43:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7fb15e1b80 10 client.0 _ll_register_callbacks cb 0x7f7f8c011500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:43:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7f977fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51952/0 (socket says 172.21.15.151:51952) 2023-07-21T22:43:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7f977fe700 1 -- 172.21.15.151:0/2805213733 learned_addr learned my addr 172.21.15.151:0/2805213733 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:43:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.329+0000 7f7f97fff700 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 0x56029bb5ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.330+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 0x56029bb5e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.330+0000 7f7f977fe700 1 -- 172.21.15.151:0/2805213733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 msgr2=0x56029bb5e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:57.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.330+0000 7f7f977fe700 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 0x56029bb5e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.330+0000 7f7f977fe700 1 -- 172.21.15.151:0/2805213733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 msgr2=0x56029bb5ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:43:57.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.330+0000 7f7f977fe700 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 0x56029bb5ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.330+0000 7f7f977fe700 1 -- 172.21.15.151:0/2805213733 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56029b8b9c00 con 0x56029b9ad6b0 2023-07-21T22:43:57.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.330+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 0x56029bb5e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:43:57.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.330+0000 7f7f977fe700 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60660 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f8802d960 tx=0x7f7f88005f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0e7fb7cd8c37261 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:43:57.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.330+0000 7f7f76ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:43:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.331+0000 7f7f76ffd700 1 -- 172.21.15.151:0/2805213733 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8801d070 con 0x56029b9ad6b0 2023-07-21T22:43:57.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.331+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2805213733 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7f8801e040 con 0x56029b9ad6b0 2023-07-21T22:43:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.331+0000 7f7f76ffd700 1 -- 172.21.15.151:0/2805213733 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(124..124 src has 1..124) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7f88000e40 con 0x56029b9ad6b0 2023-07-21T22:43:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.331+0000 7f7f76ffd700 1 -- 172.21.15.151:0/2805213733 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7f88005450 con 0x56029b9ad6b0 2023-07-21T22:43:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.331+0000 7f7fb15e1b80 10 client.28009 fetch_fsmap learned FSMap version 89 2023-07-21T22:43:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.331+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2805213733 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x7f7f8c025040 con 0x56029b9ad6b0 2023-07-21T22:43:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.332+0000 7f7f76ffd700 1 -- 172.21.15.151:0/2805213733 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7f8801e040 con 0x56029b9ad6b0 2023-07-21T22:43:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.332+0000 7f7f76ffd700 1 -- 172.21.15.151:0/2805213733 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7f88048460 con 0x56029b9ad6b0 2023-07-21T22:43:57.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.332+0000 7f7fb15e1b80 10 client.28009 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:43:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.332+0000 7f7fb15e1b80 10 client.28009 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:43:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.332+0000 7f7fb15e1b80 20 client.28009 populate_metadata read hostname 'smithi151' 2023-07-21T22:43:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.332+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56029bbbf2d0 0x56029bbc16b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:43:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.332+0000 7f7fb15e1b80 4 client.28009 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:43:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.332+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2805213733 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56029ba5dff0 con 0x56029bbbf2d0 2023-07-21T22:43:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.332+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56029bbbf2d0 0x56029bbc16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:43:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.333+0000 7f7f96ffd700 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56029bbbf2d0 0x56029bbc16b0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70708d1498bc0101 server_cookie=65a12997d8e03cc8 in_seq=0 out_seq=0 2023-07-21T22:43:57.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.333+0000 7f7f76ffd700 10 client.28009 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:57.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7f76ffd700 1 -- 172.21.15.151:0/2805213733 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56029ba5dff0 con 0x56029bbbf2d0 2023-07-21T22:43:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7f76ffd700 10 client.28009 handle_command_reply: tid=0 2023-07-21T22:43:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 client.28009 shutdown 2023-07-21T22:43:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2805213733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 msgr2=0x56029bb60660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60660 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f7f8802d960 tx=0x7f7f88005f10 comp rx=0 tx=0).stop 2023-07-21T22:43:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2805213733 shutdown_connections 2023-07-21T22:43:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56029bbbf2d0 0x56029bbc16b0 crc :-1 s=READY pgs=319 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56029bb57660 0x56029bb5ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56029b9ad6b0 0x56029bb60660 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7f76ffd700 0 client.28009 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:43:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 --2- 172.21.15.151:0/2805213733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56029bb57210 0x56029bb5e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2805213733 >> 172.21.15.151:0/2805213733 conn(0x56029bb46ae0 msgr2=0x56029bb59040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2805213733 shutdown_connections 2023-07-21T22:43:57.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.341+0000 7f7fb15e1b80 1 -- 172.21.15.151:0/2805213733 wait complete. 2023-07-21T22:43:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7fb15e1b80 20 client.28009 trim_cache size 0 max 16384 2023-07-21T22:43:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:43:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:43:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:43:57.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:43:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 -- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7f800a12c0 msgr2=0x7f7f800a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7f800a12c0 0x7f7f800a3770 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7f98102030 tx=0x7f7f8c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 -- 172.21.15.151:0/3866448061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f98104a30 msgr2=0x7f7f981a3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:43:57.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f98104a30 0x7f7f981a3d40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f7f90007f10 tx=0x7f7f9000d3b0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 -- 172.21.15.151:0/3866448061 shutdown_connections 2023-07-21T22:43:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f7f800a12c0 0x7f7f800a3770 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f7f98104a30 0x7f7f981a3d40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f980fea30 0x7f7f98100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 --2- 172.21.15.151:0/3866448061 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f980ff3e0 0x7f7f98100d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:43:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.342+0000 7f7f9dbff700 1 -- 172.21.15.151:0/3866448061 >> 172.21.15.151:0/3866448061 conn(0x7f7f98074760 msgr2=0x7f7f980fd630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:43:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.343+0000 7f7f9dbff700 1 -- 172.21.15.151:0/3866448061 shutdown_connections 2023-07-21T22:43:57.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:43:57.343+0000 7f7f9dbff700 1 -- 172.21.15.151:0/3866448061 wait complete. 2023-07-21T22:43:58.904 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:43:58 smithi195 ceph-mon[97365]: pgmap v782: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.4 MiB/s wr, 442 op/s 2023-07-21T22:43:58.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:43:58 smithi151 ceph-mon[95510]: pgmap v782: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.4 MiB/s wr, 442 op/s 2023-07-21T22:43:59.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:43:58 smithi187 ceph-mon[96918]: pgmap v782: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 3.4 MiB/s wr, 442 op/s 2023-07-21T22:44:00.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:00 smithi195 ceph-mon[97365]: pgmap v783: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.3 MiB/s wr, 295 op/s 2023-07-21T22:44:00.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:00 smithi151 ceph-mon[95510]: pgmap v783: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.3 MiB/s wr, 295 op/s 2023-07-21T22:44:01.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:00 smithi187 ceph-mon[96918]: pgmap v783: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.3 MiB/s wr, 295 op/s 2023-07-21T22:44:02.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:02 smithi195 ceph-mon[97365]: pgmap v784: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.3 MiB/s wr, 295 op/s 2023-07-21T22:44:02.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:02 smithi151 ceph-mon[95510]: pgmap v784: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.3 MiB/s wr, 295 op/s 2023-07-21T22:44:03.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:02 smithi187 ceph-mon[96918]: pgmap v784: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.3 MiB/s wr, 295 op/s 2023-07-21T22:44:04.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:04 smithi195 ceph-mon[97365]: pgmap v785: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.3 MiB/s wr, 441 op/s 2023-07-21T22:44:04.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:04 smithi151 ceph-mon[95510]: pgmap v785: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.3 MiB/s wr, 441 op/s 2023-07-21T22:44:05.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:04 smithi187 ceph-mon[96918]: pgmap v785: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.3 MiB/s wr, 441 op/s 2023-07-21T22:44:05.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:05 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:44:05.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:05 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:44:06.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:05 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:44:06.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:06 smithi195 ceph-mon[97365]: pgmap v786: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 299 op/s 2023-07-21T22:44:06.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:06 smithi151 ceph-mon[95510]: pgmap v786: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 299 op/s 2023-07-21T22:44:07.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:06 smithi187 ceph-mon[96918]: pgmap v786: 97 pgs: 97 active+clean; 8.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.2 MiB/s wr, 299 op/s 2023-07-21T22:44:08.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:08 smithi195 ceph-mon[97365]: pgmap v787: 97 pgs: 97 active+clean; 8.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.3 MiB/s wr, 432 op/s 2023-07-21T22:44:08.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:08 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:44:08.902 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:08 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:44:08.903 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:08 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:44:08.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:08 smithi151 ceph-mon[95510]: pgmap v787: 97 pgs: 97 active+clean; 8.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.3 MiB/s wr, 432 op/s 2023-07-21T22:44:08.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:08 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:44:08.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:08 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:44:08.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:08 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:44:09.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:08 smithi187 ceph-mon[96918]: pgmap v787: 97 pgs: 97 active+clean; 8.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 3.3 MiB/s wr, 432 op/s 2023-07-21T22:44:09.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:08 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:44:09.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:08 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:44:09.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:08 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:44:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.519+0000 7fa87e1ff700 1 -- 172.21.15.151:0/3116605714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa878073160 msgr2=0x7fa87810be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:10.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.519+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/3116605714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa878073160 0x7fa87810be90 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009990 tx=0x7fa86c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.519+0000 7fa87e1ff700 1 -- 172.21.15.151:0/3116605714 shutdown_connections 2023-07-21T22:44:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.519+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/3116605714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87810c3d0 0x7fa87810e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.519+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/3116605714 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa878072850 0x7fa878072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.519+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/3116605714 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa878073160 0x7fa87810be90 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.519+0000 7fa87e1ff700 1 -- 172.21.15.151:0/3116605714 >> 172.21.15.151:0/3116605714 conn(0x7fa8780fb650 msgr2=0x7fa8780fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.519+0000 7fa87e1ff700 1 -- 172.21.15.151:0/3116605714 shutdown_connections 2023-07-21T22:44:10.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.519+0000 7fa87e1ff700 1 -- 172.21.15.151:0/3116605714 wait complete. 2023-07-21T22:44:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.521+0000 7fa87e1ff700 1 Processor -- start 2023-07-21T22:44:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.521+0000 7fa87e1ff700 1 -- start start 2023-07-21T22:44:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.521+0000 7fa87e1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa878072850 0x7fa878197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa87e1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa878073160 0x7fa8781982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa87e1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87810c3d0 0x7fa87819c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa87e1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87819cfa0 con 0x7fa878072850 2023-07-21T22:44:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa87e1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87819d110 con 0x7fa87810c3d0 2023-07-21T22:44:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa87e1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa87819d2d0 con 0x7fa878073160 2023-07-21T22:44:10.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa878072850 0x7fa878197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa877fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87810c3d0 0x7fa87819c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa877fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87810c3d0 0x7fa87819c960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:59318/0 (socket says 172.21.15.151:59318) 2023-07-21T22:44:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa877fff700 1 -- 172.21.15.151:0/2369484217 learned_addr learned my addr 172.21.15.151:0/2369484217 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:10.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa876ffd700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa878073160 0x7fa8781982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa877fff700 1 -- 172.21.15.151:0/2369484217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa878073160 msgr2=0x7fa8781982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa877fff700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa878073160 0x7fa8781982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa877fff700 1 -- 172.21.15.151:0/2369484217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa878072850 msgr2=0x7fa878197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa877fff700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa878072850 0x7fa878197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.522+0000 7fa877fff700 1 -- 172.21.15.151:0/2369484217 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa86c0095f0 con 0x7fa87810c3d0 2023-07-21T22:44:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.523+0000 7fa877fff700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87810c3d0 0x7fa87819c960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa870009fd0 tx=0x7fa87000ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.523+0000 7fa874ff9700 1 -- 172.21.15.151:0/2369484217 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa870018070 con 0x7fa87810c3d0 2023-07-21T22:44:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.523+0000 7fa87e1ff700 1 -- 172.21.15.151:0/2369484217 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa87819d550 con 0x7fa87810c3d0 2023-07-21T22:44:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.523+0000 7fa874ff9700 1 -- 172.21.15.151:0/2369484217 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa87000f040 con 0x7fa87810c3d0 2023-07-21T22:44:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.523+0000 7fa874ff9700 1 -- 172.21.15.151:0/2369484217 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa87000cc10 con 0x7fa87810c3d0 2023-07-21T22:44:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.523+0000 7fa87e1ff700 1 -- 172.21.15.151:0/2369484217 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8781a4df0 con 0x7fa87810c3d0 2023-07-21T22:44:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.527+0000 7fa874ff9700 1 -- 172.21.15.151:0/2369484217 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fa870003a00 con 0x7fa87810c3d0 2023-07-21T22:44:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.529+0000 7fa891bbcb80 1 Processor -- start 2023-07-21T22:44:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.529+0000 7fa891bbcb80 1 -- start start 2023-07-21T22:44:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa874ff9700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa8600a12c0 0x7fa8600a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60e8916b0 0x55d60ea3acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea34f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 0x55d60ea354a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60e93ac50 con 0x55d60ea3b660 2023-07-21T22:44:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60e98d9e0 con 0x55d60ea3b210 2023-07-21T22:44:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60e986e70 con 0x55d60e8916b0 2023-07-21T22:44:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa874ff9700 1 -- 172.21.15.151:0/2369484217 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fa8700cc7c0 con 0x7fa87810c3d0 2023-07-21T22:44:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60e8916b0 0x55d60ea3acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60e8916b0 0x55d60ea3acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58442/0 (socket says 172.21.15.151:58442) 2023-07-21T22:44:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa8777fe700 1 -- 172.21.15.151:0/2832667792 learned_addr learned my addr 172.21.15.151:0/2832667792 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa876ffd700 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea34f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa877fff700 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 0x55d60ea354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa876ffd700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa8600a12c0 0x7fa8600a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa8777fe700 1 -- 172.21.15.151:0/2832667792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 msgr2=0x55d60ea34f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa8777fe700 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea34f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa8777fe700 1 -- 172.21.15.151:0/2832667792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 msgr2=0x55d60ea354a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa8777fe700 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 0x55d60ea354a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.530+0000 7fa8777fe700 1 -- 172.21.15.151:0/2832667792 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d60e7b4d80 con 0x55d60e8916b0 2023-07-21T22:44:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.531+0000 7fa877fff700 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 0x55d60ea354a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:44:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.531+0000 7fa8777fe700 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60e8916b0 0x55d60ea3acd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa868009d80 tx=0x7fa868011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63105d8e829ca48d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.531+0000 7fa85dffb700 1 -- 172.21.15.151:0/2832667792 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868004230 con 0x55d60e8916b0 2023-07-21T22:44:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.531+0000 7fa876ffd700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa8600a12c0 0x7fa8600a3770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa8781995d0 tx=0x7fa86c00b260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.531+0000 7fa85dffb700 1 -- 172.21.15.151:0/2832667792 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa868004390 con 0x55d60e8916b0 2023-07-21T22:44:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.531+0000 7fa85dffb700 1 -- 172.21.15.151:0/2832667792 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868019800 con 0x55d60e8916b0 2023-07-21T22:44:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.532+0000 7fa891bbcb80 1 -- 172.21.15.151:0/2832667792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60e8916b0 msgr2=0x55d60ea3acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.532+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60e8916b0 0x55d60ea3acd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa868009d80 tx=0x7fa868011720 comp rx=0 tx=0).stop 2023-07-21T22:44:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.532+0000 7fa891bbcb80 1 -- 172.21.15.151:0/2832667792 shutdown_connections 2023-07-21T22:44:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.532+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 0x55d60ea354a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.532+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60e8916b0 0x55d60ea3acd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.532+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/2832667792 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea34f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.532+0000 7fa891bbcb80 1 -- 172.21.15.151:0/2832667792 >> 172.21.15.151:0/2832667792 conn(0x55d60ea2aae0 msgr2=0x55d60ea300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.532+0000 7fa891bbcb80 1 -- 172.21.15.151:0/2832667792 shutdown_connections 2023-07-21T22:44:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.533+0000 7fa891bbcb80 1 -- 172.21.15.151:0/2832667792 wait complete. 2023-07-21T22:44:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.533+0000 7fa891bbcb80 1 -- start start 2023-07-21T22:44:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.533+0000 7fa891bbcb80 1 Processor -- start 2023-07-21T22:44:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea41580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea3e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 0x55d60ea3eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60e926a60 con 0x55d60e8916b0 2023-07-21T22:44:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60e926760 con 0x55d60ea3b210 2023-07-21T22:44:10.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60e80a8c0 con 0x55d60ea3b660 2023-07-21T22:44:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa891bbcb80 10 client.0 _ll_register_callbacks cb 0x55d60e924700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:44:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea41580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea41580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46936/0 (socket says 172.21.15.151:46936) 2023-07-21T22:44:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.534+0000 7fa8777fe700 1 -- 172.21.15.151:0/192414847 learned_addr learned my addr 172.21.15.151:0/192414847 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa877fff700 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 0x55d60ea3eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa876ffd700 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea3e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa8777fe700 1 -- 172.21.15.151:0/192414847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 msgr2=0x55d60ea3eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa8777fe700 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 0x55d60ea3eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa8777fe700 1 -- 172.21.15.151:0/192414847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 msgr2=0x55d60ea3e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa8777fe700 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea3e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa8777fe700 1 -- 172.21.15.151:0/192414847 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8680099e0 con 0x55d60e8916b0 2023-07-21T22:44:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa876ffd700 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea3e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:44:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa8777fe700 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea41580 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa86801b040 tx=0x7fa8680038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78d75d172310c87 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:10.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.535+0000 7fa856ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:44:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.536+0000 7fa856ffd700 1 -- 172.21.15.151:0/192414847 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868005450 con 0x55d60e8916b0 2023-07-21T22:44:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.536+0000 7fa891bbcb80 1 -- 172.21.15.151:0/192414847 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d60e8e0490 con 0x55d60e8916b0 2023-07-21T22:44:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.536+0000 7fa856ffd700 1 -- 172.21.15.151:0/192414847 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fa868005ce0 con 0x55d60e8916b0 2023-07-21T22:44:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.536+0000 7fa856ffd700 1 -- 172.21.15.151:0/192414847 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa868009ed0 con 0x55d60e8916b0 2023-07-21T22:44:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.536+0000 7fa891bbcb80 10 client.18318 fetch_fsmap learned FSMap version 89 2023-07-21T22:44:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.536+0000 7fa891bbcb80 1 -- 172.21.15.151:0/192414847 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55d60e79dc00 con 0x55d60e8916b0 2023-07-21T22:44:10.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.537+0000 7fa856ffd700 1 -- 172.21.15.151:0/192414847 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d60e8e0490 con 0x55d60e8916b0 2023-07-21T22:44:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.537+0000 7fa856ffd700 1 -- 172.21.15.151:0/192414847 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa868021040 con 0x55d60e8916b0 2023-07-21T22:44:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.537+0000 7fa891bbcb80 10 client.18318 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:44:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.537+0000 7fa891bbcb80 10 client.18318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:44:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.537+0000 7fa891bbcb80 20 client.18318 populate_metadata read hostname 'smithi151' 2023-07-21T22:44:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.537+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d60ea4e8a0 0x55d60ea50cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.537+0000 7fa891bbcb80 4 client.18318 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:44:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.537+0000 7fa891bbcb80 1 -- 172.21.15.151:0/192414847 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d60e97fe50 con 0x55d60ea4e8a0 2023-07-21T22:44:10.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.537+0000 7fa876ffd700 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d60ea4e8a0 0x55d60ea50cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.538+0000 7fa876ffd700 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d60ea4e8a0 0x55d60ea50cb0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ce61e9d1c2fd153 server_cookie=b770705f1003e1d0 in_seq=0 out_seq=0 2023-07-21T22:44:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.538+0000 7fa856ffd700 10 client.18318 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa856ffd700 1 -- 172.21.15.151:0/192414847 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d60e97fe50 con 0x55d60ea4e8a0 2023-07-21T22:44:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa856ffd700 10 client.18318 handle_command_reply: tid=0 2023-07-21T22:44:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 client.18318 shutdown 2023-07-21T22:44:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 -- 172.21.15.151:0/192414847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 msgr2=0x55d60ea41580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea41580 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fa86801b040 tx=0x7fa8680038b0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 -- 172.21.15.151:0/192414847 shutdown_connections 2023-07-21T22:44:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d60ea4e8a0 0x55d60ea50cb0 crc :-1 s=READY pgs=320 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 0x55d60ea3eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea41580 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa856ffd700 0 client.18318 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/192414847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea3e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 -- 172.21.15.151:0/192414847 >> 172.21.15.151:0/192414847 conn(0x55d60ea2aae0 msgr2=0x55d60ea2f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 -- 172.21.15.151:0/192414847 shutdown_connections 2023-07-21T22:44:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.539+0000 7fa891bbcb80 1 -- 172.21.15.151:0/192414847 wait complete. 2023-07-21T22:44:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.540+0000 7fa891bbcb80 20 client.18318 trim_cache size 0 max 16384 2023-07-21T22:44:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.559+0000 7fa891bbcb80 1 Processor -- start 2023-07-21T22:44:10.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa891bbcb80 1 -- start start 2023-07-21T22:44:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60e8916b0 0x55d60ea45b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b210 0x55d60ea3e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 0x55d60ea41120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60ea3f800 con 0x55d60ea3b660 2023-07-21T22:44:10.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60ea35a70 con 0x55d60e8916b0 2023-07-21T22:44:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60ea35800 con 0x55d60ea3b210 2023-07-21T22:44:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60e8916b0 0x55d60ea45b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60e8916b0 0x55d60ea45b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:59354/0 (socket says 172.21.15.151:59354) 2023-07-21T22:44:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa8777fe700 1 -- 172.21.15.151:0/1738257094 learned_addr learned my addr 172.21.15.151:0/1738257094 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa877fff700 1 --2- 172.21.15.151:0/1738257094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 0x55d60ea41120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.560+0000 7fa876ffd700 1 --2- 172.21.15.151:0/1738257094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b210 0x55d60ea3e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.561+0000 7fa8777fe700 1 -- 172.21.15.151:0/1738257094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b210 msgr2=0x55d60ea3e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.561+0000 7fa8777fe700 1 --2- 172.21.15.151:0/1738257094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b210 0x55d60ea3e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.561+0000 7fa8777fe700 1 -- 172.21.15.151:0/1738257094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 msgr2=0x55d60ea41120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.561+0000 7fa8777fe700 1 --2- 172.21.15.151:0/1738257094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 0x55d60ea41120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.561+0000 7fa8777fe700 1 -- 172.21.15.151:0/1738257094 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d60e7db1f0 con 0x55d60e8916b0 2023-07-21T22:44:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.561+0000 7fa8777fe700 1 --2- 172.21.15.151:0/1738257094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60e8916b0 0x55d60ea45b80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa868011760 tx=0x7fa868005a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f51667e2cfa6fe27 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.561+0000 7fa85e7fc700 1 -- 172.21.15.151:0/1738257094 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868015030 con 0x55d60e8916b0 2023-07-21T22:44:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.561+0000 7fa85e7fc700 1 -- 172.21.15.151:0/1738257094 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa868009ed0 con 0x55d60e8916b0 2023-07-21T22:44:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.561+0000 7fa85e7fc700 1 -- 172.21.15.151:0/1738257094 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8680054b0 con 0x55d60e8916b0 2023-07-21T22:44:10.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.562+0000 7fa891bbcb80 1 -- 172.21.15.151:0/1738257094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60e8916b0 msgr2=0x55d60ea45b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.562+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/1738257094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60e8916b0 0x55d60ea45b80 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa868011760 tx=0x7fa868005a40 comp rx=0 tx=0).stop 2023-07-21T22:44:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.562+0000 7fa891bbcb80 1 -- 172.21.15.151:0/1738257094 shutdown_connections 2023-07-21T22:44:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.562+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/1738257094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60e8916b0 0x55d60ea45b80 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.562+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/1738257094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60ea3b660 0x55d60ea41120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.562+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/1738257094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b210 0x55d60ea3e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.562+0000 7fa891bbcb80 1 -- 172.21.15.151:0/1738257094 >> 172.21.15.151:0/1738257094 conn(0x55d60ea2aae0 msgr2=0x55d60ea4ada0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:10.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.562+0000 7fa891bbcb80 1 -- 172.21.15.151:0/1738257094 shutdown_connections 2023-07-21T22:44:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.562+0000 7fa891bbcb80 1 -- 172.21.15.151:0/1738257094 wait complete. 2023-07-21T22:44:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.563+0000 7fa891bbcb80 1 -- start start 2023-07-21T22:44:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.563+0000 7fa891bbcb80 1 Processor -- start 2023-07-21T22:44:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea37900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea37e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa891bbcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 0x55d60ea36730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60ea38540 con 0x55d60e8916b0 2023-07-21T22:44:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60ea36c70 con 0x55d60ea3b210 2023-07-21T22:44:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa891bbcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d60ea36e30 con 0x55d60ea3b660 2023-07-21T22:44:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa891bbcb80 10 client.0 _ll_register_callbacks cb 0x7fa868009c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:44:10.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea37900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa8777fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea37900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46960/0 (socket says 172.21.15.151:46960) 2023-07-21T22:44:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa877fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 0x55d60ea36730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa8777fe700 1 -- 172.21.15.151:0/4060841737 learned_addr learned my addr 172.21.15.151:0/4060841737 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa876ffd700 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea37e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa8777fe700 1 -- 172.21.15.151:0/4060841737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 msgr2=0x55d60ea36730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.564+0000 7fa8777fe700 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 0x55d60ea36730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.565+0000 7fa8777fe700 1 -- 172.21.15.151:0/4060841737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 msgr2=0x55d60ea37e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.565+0000 7fa8777fe700 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea37e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.565+0000 7fa8777fe700 1 -- 172.21.15.151:0/4060841737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d60e79dc00 con 0x55d60e8916b0 2023-07-21T22:44:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.565+0000 7fa876ffd700 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea37e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:44:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.565+0000 7fa8777fe700 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea37900 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa868018560 tx=0x7fa868003d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11a315078d0e390 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:10.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.565+0000 7fa856ffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:44:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.565+0000 7fa856ffd700 1 -- 172.21.15.151:0/4060841737 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa868023d20 con 0x55d60e8916b0 2023-07-21T22:44:10.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.565+0000 7fa856ffd700 1 -- 172.21.15.151:0/4060841737 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(125..125 src has 1..125) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fa868000e40 con 0x55d60e8916b0 2023-07-21T22:44:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.565+0000 7fa891bbcb80 1 -- 172.21.15.151:0/4060841737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa868004390 con 0x55d60e8916b0 2023-07-21T22:44:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.566+0000 7fa856ffd700 1 -- 172.21.15.151:0/4060841737 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa868003ad0 con 0x55d60e8916b0 2023-07-21T22:44:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.566+0000 7fa891bbcb80 10 client.18324 fetch_fsmap learned FSMap version 89 2023-07-21T22:44:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.566+0000 7fa891bbcb80 1 -- 172.21.15.151:0/4060841737 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55d60e7b3250 con 0x55d60e8916b0 2023-07-21T22:44:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.566+0000 7fa856ffd700 1 -- 172.21.15.151:0/4060841737 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa868004390 con 0x55d60e8916b0 2023-07-21T22:44:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.566+0000 7fa856ffd700 1 -- 172.21.15.151:0/4060841737 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa868021070 con 0x55d60e8916b0 2023-07-21T22:44:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.566+0000 7fa891bbcb80 10 client.18324 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:44:10.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.566+0000 7fa891bbcb80 10 client.18324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:44:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.566+0000 7fa891bbcb80 20 client.18324 populate_metadata read hostname 'smithi151' 2023-07-21T22:44:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.567+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d60eaab790 0x55d60eaadb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.567+0000 7fa891bbcb80 4 client.18324 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:44:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.567+0000 7fa891bbcb80 1 -- 172.21.15.151:0/4060841737 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d60e941ff0 con 0x55d60eaab790 2023-07-21T22:44:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.567+0000 7fa876ffd700 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d60eaab790 0x55d60eaadb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.567+0000 7fa876ffd700 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d60eaab790 0x55d60eaadb70 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe25a4e6ba59ebb server_cookie=8b3256a87ee7a088 in_seq=0 out_seq=0 2023-07-21T22:44:10.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.567+0000 7fa856ffd700 10 client.18324 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa856ffd700 1 -- 172.21.15.151:0/4060841737 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d60e941ff0 con 0x55d60eaab790 2023-07-21T22:44:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa856ffd700 10 client.18324 handle_command_reply: tid=0 2023-07-21T22:44:10.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 client.18324 shutdown 2023-07-21T22:44:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 -- 172.21.15.151:0/4060841737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 msgr2=0x55d60ea37900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea37900 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fa868018560 tx=0x7fa868003d70 comp rx=0 tx=0).stop 2023-07-21T22:44:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 -- 172.21.15.151:0/4060841737 shutdown_connections 2023-07-21T22:44:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d60eaab790 0x55d60eaadb70 crc :-1 s=READY pgs=321 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d60ea3b660 0x55d60ea36730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d60e8916b0 0x55d60ea37900 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa856ffd700 0 client.18324 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 --2- 172.21.15.151:0/4060841737 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d60ea3b210 0x55d60ea37e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 -- 172.21.15.151:0/4060841737 >> 172.21.15.151:0/4060841737 conn(0x55d60ea2aae0 msgr2=0x55d60ea39950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 -- 172.21.15.151:0/4060841737 shutdown_connections 2023-07-21T22:44:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.577+0000 7fa891bbcb80 1 -- 172.21.15.151:0/4060841737 wait complete. 2023-07-21T22:44:10.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa891bbcb80 20 client.18324 trim_cache size 0 max 16384 2023-07-21T22:44:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:44:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:44:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:44:10.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:44:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 -- 172.21.15.151:0/2369484217 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa8600a12c0 msgr2=0x7fa8600a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa8600a12c0 0x7fa8600a3770 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fa8781995d0 tx=0x7fa86c00b260 comp rx=0 tx=0).stop 2023-07-21T22:44:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 -- 172.21.15.151:0/2369484217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87810c3d0 msgr2=0x7fa87819c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87810c3d0 0x7fa87819c960 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fa870009fd0 tx=0x7fa87000ef90 comp rx=0 tx=0).stop 2023-07-21T22:44:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 -- 172.21.15.151:0/2369484217 shutdown_connections 2023-07-21T22:44:10.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa8600a12c0 0x7fa8600a3770 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa87810c3d0 0x7fa87819c960 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa878072850 0x7fa878197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 --2- 172.21.15.151:0/2369484217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa878073160 0x7fa8781982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.578+0000 7fa87e1ff700 1 -- 172.21.15.151:0/2369484217 >> 172.21.15.151:0/2369484217 conn(0x7fa8780fb650 msgr2=0x7fa87810e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.579+0000 7fa87e1ff700 1 -- 172.21.15.151:0/2369484217 shutdown_connections 2023-07-21T22:44:10.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:10.579+0000 7fa87e1ff700 1 -- 172.21.15.151:0/2369484217 wait complete. 2023-07-21T22:44:10.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:10 smithi151 ceph-mon[95510]: pgmap v788: 97 pgs: 97 active+clean; 8.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.1 MiB/s wr, 279 op/s 2023-07-21T22:44:10.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:10 smithi151 ceph-mon[95510]: osdmap e125: 12 total, 12 up, 12 in 2023-07-21T22:44:11.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:10 smithi187 ceph-mon[96918]: pgmap v788: 97 pgs: 97 active+clean; 8.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.1 MiB/s wr, 279 op/s 2023-07-21T22:44:11.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:10 smithi187 ceph-mon[96918]: osdmap e125: 12 total, 12 up, 12 in 2023-07-21T22:44:11.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:10 smithi195 ceph-mon[97365]: pgmap v788: 97 pgs: 97 active+clean; 8.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.1 MiB/s wr, 279 op/s 2023-07-21T22:44:11.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:10 smithi195 ceph-mon[97365]: osdmap e125: 12 total, 12 up, 12 in 2023-07-21T22:44:12.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:12 smithi151 ceph-mon[95510]: pgmap v790: 97 pgs: 97 active+clean; 8.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.5 MiB/s wr, 335 op/s 2023-07-21T22:44:13.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:12 smithi187 ceph-mon[96918]: pgmap v790: 97 pgs: 97 active+clean; 8.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.5 MiB/s wr, 335 op/s 2023-07-21T22:44:13.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:12 smithi195 ceph-mon[97365]: pgmap v790: 97 pgs: 97 active+clean; 8.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.5 MiB/s wr, 335 op/s 2023-07-21T22:44:14.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:14 smithi151 ceph-mon[95510]: pgmap v791: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.3 MiB/s wr, 306 op/s 2023-07-21T22:44:15.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:14 smithi187 ceph-mon[96918]: pgmap v791: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.3 MiB/s wr, 306 op/s 2023-07-21T22:44:15.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:14 smithi195 ceph-mon[97365]: pgmap v791: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.3 MiB/s wr, 306 op/s 2023-07-21T22:44:16.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:16 smithi151 ceph-mon[95510]: pgmap v792: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.3 MiB/s wr, 306 op/s 2023-07-21T22:44:16.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:16 smithi151 ceph-mon[95510]: osdmap e126: 12 total, 12 up, 12 in 2023-07-21T22:44:17.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:16 smithi187 ceph-mon[96918]: pgmap v792: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.3 MiB/s wr, 306 op/s 2023-07-21T22:44:17.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:16 smithi187 ceph-mon[96918]: osdmap e126: 12 total, 12 up, 12 in 2023-07-21T22:44:17.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:16 smithi195 ceph-mon[97365]: pgmap v792: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 2.3 MiB/s wr, 306 op/s 2023-07-21T22:44:17.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:16 smithi195 ceph-mon[97365]: osdmap e126: 12 total, 12 up, 12 in 2023-07-21T22:44:18.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:18 smithi151 ceph-mon[95510]: pgmap v794: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 403 op/s 2023-07-21T22:44:19.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:18 smithi187 ceph-mon[96918]: pgmap v794: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 403 op/s 2023-07-21T22:44:19.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:18 smithi195 ceph-mon[97365]: pgmap v794: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 403 op/s 2023-07-21T22:44:20.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:20 smithi151 ceph-mon[95510]: pgmap v795: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.6 MiB/s wr, 336 op/s 2023-07-21T22:44:21.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:20 smithi187 ceph-mon[96918]: pgmap v795: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.6 MiB/s wr, 336 op/s 2023-07-21T22:44:21.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:20 smithi195 ceph-mon[97365]: pgmap v795: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.6 MiB/s wr, 336 op/s 2023-07-21T22:44:22.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:22 smithi151 ceph-mon[95510]: pgmap v796: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.5 MiB/s wr, 322 op/s 2023-07-21T22:44:23.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:22 smithi187 ceph-mon[96918]: pgmap v796: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.5 MiB/s wr, 322 op/s 2023-07-21T22:44:23.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:22 smithi195 ceph-mon[97365]: pgmap v796: 97 pgs: 97 active+clean; 8.2 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.5 MiB/s wr, 322 op/s 2023-07-21T22:44:23.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.755+0000 7f17e8fff700 1 -- 172.21.15.151:0/82737699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17e4067c10 msgr2=0x7f17e4067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.755+0000 7f17e8fff700 1 --2- 172.21.15.151:0/82737699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17e4067c10 0x7f17e4067fe0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f17d40099c0 tx=0x7f17d4009cd0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.755+0000 7f17e8fff700 1 -- 172.21.15.151:0/82737699 shutdown_connections 2023-07-21T22:44:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.755+0000 7f17e8fff700 1 --2- 172.21.15.151:0/82737699 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17e4104e50 0x7f17e410ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.755+0000 7f17e8fff700 1 --2- 172.21.15.151:0/82737699 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17e4067c10 0x7f17e4067fe0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.755+0000 7f17e8fff700 1 --2- 172.21.15.151:0/82737699 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17e40685b0 0x7f17e4104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.755+0000 7f17e8fff700 1 -- 172.21.15.151:0/82737699 >> 172.21.15.151:0/82737699 conn(0x7f17e4074760 msgr2=0x7f17e4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:23.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.755+0000 7f17e8fff700 1 -- 172.21.15.151:0/82737699 shutdown_connections 2023-07-21T22:44:23.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.755+0000 7f17e8fff700 1 -- 172.21.15.151:0/82737699 wait complete. 2023-07-21T22:44:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.757+0000 7f17e8fff700 1 Processor -- start 2023-07-21T22:44:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.757+0000 7f17e8fff700 1 -- start start 2023-07-21T22:44:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.757+0000 7f17e8fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17e4067c10 0x7f17e4197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.757+0000 7f17e8fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17e40685b0 0x7f17e4198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.757+0000 7f17e8fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17e4104e50 0x7f17e419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.757+0000 7f17e8fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e419cf20 con 0x7f17e4067c10 2023-07-21T22:44:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.757+0000 7f17e8fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e419d090 con 0x7f17e4104e50 2023-07-21T22:44:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.757+0000 7f17e8fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17e419d250 con 0x7f17e40685b0 2023-07-21T22:44:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.757+0000 7f17e259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17e4067c10 0x7f17e4197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17e4067c10 0x7f17e4197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38478/0 (socket says 172.21.15.151:38478) 2023-07-21T22:44:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e259c700 1 -- 172.21.15.151:0/283674361 learned_addr learned my addr 172.21.15.151:0/283674361 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17e40685b0 0x7f17e4198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e2d9d700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17e4104e50 0x7f17e419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e1d9b700 1 -- 172.21.15.151:0/283674361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17e4104e50 msgr2=0x7f17e419c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17e4104e50 0x7f17e419c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e1d9b700 1 -- 172.21.15.151:0/283674361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17e4067c10 msgr2=0x7f17e4197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17e4067c10 0x7f17e4197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e1d9b700 1 -- 172.21.15.151:0/283674361 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d40095f0 con 0x7f17e40685b0 2023-07-21T22:44:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17e40685b0 0x7f17e4198310 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f17e4068980 tx=0x7f17d800eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.758+0000 7f17d37fe700 1 -- 172.21.15.151:0/283674361 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8010900 con 0x7f17e40685b0 2023-07-21T22:44:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.759+0000 7f17d37fe700 1 -- 172.21.15.151:0/283674361 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17d800c430 con 0x7f17e40685b0 2023-07-21T22:44:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.759+0000 7f17e8fff700 1 -- 172.21.15.151:0/283674361 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17e419d530 con 0x7f17e40685b0 2023-07-21T22:44:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.759+0000 7f17d37fe700 1 -- 172.21.15.151:0/283674361 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8018680 con 0x7f17e40685b0 2023-07-21T22:44:23.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.759+0000 7f17e8fff700 1 -- 172.21.15.151:0/283674361 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e41a4d70 con 0x7f17e40685b0 2023-07-21T22:44:23.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.762+0000 7f17d37fe700 1 -- 172.21.15.151:0/283674361 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f17d800c5a0 con 0x7f17e40685b0 2023-07-21T22:44:23.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17fc9fdb80 1 Processor -- start 2023-07-21T22:44:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17fc9fdb80 1 -- start start 2023-07-21T22:44:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17d37fe700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17cc0a12c0 0x7f17cc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17d37fe700 1 -- 172.21.15.151:0/283674361 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f17d8014070 con 0x7f17e40685b0 2023-07-21T22:44:23.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a1c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e0921c50 con 0x5578e0a22210 2023-07-21T22:44:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e09749e0 con 0x5578e0a22660 2023-07-21T22:44:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e096de70 con 0x5578e08786b0 2023-07-21T22:44:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.764+0000 7f17e2d9d700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17cc0a12c0 0x7f17cc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54122/0 (socket says 172.21.15.151:54122) 2023-07-21T22:44:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e259c700 1 -- 172.21.15.151:0/218757257 learned_addr learned my addr 172.21.15.151:0/218757257 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e2d9d700 1 --2- 172.21.15.151:0/218757257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a1c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/218757257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e259c700 1 -- 172.21.15.151:0/218757257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 msgr2=0x5578e0a1c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e259c700 1 --2- 172.21.15.151:0/218757257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a1c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e259c700 1 -- 172.21.15.151:0/218757257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 msgr2=0x5578e0a1bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:23.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e259c700 1 --2- 172.21.15.151:0/218757257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e259c700 1 -- 172.21.15.151:0/218757257 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578e079bd80 con 0x5578e08786b0 2023-07-21T22:44:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e259c700 1 --2- 172.21.15.151:0/218757257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21cd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005f00 tx=0x7f17d4005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d712c2b4c5363b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.765+0000 7f17e2d9d700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17cc0a12c0 0x7f17cc0a3770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009ec0 tx=0x7f17dc0134a0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17d0ff9700 1 -- 172.21.15.151:0/218757257 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400bb50 con 0x5578e08786b0 2023-07-21T22:44:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17d0ff9700 1 -- 172.21.15.151:0/218757257 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17d401e040 con 0x5578e08786b0 2023-07-21T22:44:23.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17d0ff9700 1 -- 172.21.15.151:0/218757257 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d40039a0 con 0x5578e08786b0 2023-07-21T22:44:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/218757257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 msgr2=0x5578e0a21cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/218757257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21cd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005f00 tx=0x7f17d4005bc0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/218757257 shutdown_connections 2023-07-21T22:44:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/218757257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a1c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/218757257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21cd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/218757257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.766+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/218757257 >> 172.21.15.151:0/218757257 conn(0x5578e0a11ae0 msgr2=0x5578e0a170e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.767+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/218757257 shutdown_connections 2023-07-21T22:44:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.767+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/218757257 wait complete. 2023-07-21T22:44:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.767+0000 7f17fc9fdb80 1 -- start start 2023-07-21T22:44:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.768+0000 7f17fc9fdb80 1 Processor -- start 2023-07-21T22:44:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.768+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e08786b0 0x5578e0a2b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.768+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e0a22210 0x5578e0a2ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.768+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22660 0x5578e0a257c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.768+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e090da60 con 0x5578e0a22660 2023-07-21T22:44:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.768+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e090d760 con 0x5578e08786b0 2023-07-21T22:44:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.768+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e07f18c0 con 0x5578e0a22210 2023-07-21T22:44:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.768+0000 7f17fc9fdb80 10 client.0 _ll_register_callbacks cb 0x5578e090b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:44:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22660 0x5578e0a257c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22660 0x5578e0a257c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38490/0 (socket says 172.21.15.151:38490) 2023-07-21T22:44:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e2d9d700 1 -- 172.21.15.151:0/4085332889 learned_addr learned my addr 172.21.15.151:0/4085332889 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:23.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e259c700 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e08786b0 0x5578e0a2b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e0a22210 0x5578e0a2ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e259c700 1 -- 172.21.15.151:0/4085332889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e0a22210 msgr2=0x5578e0a2ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e259c700 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e0a22210 0x5578e0a2ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e259c700 1 -- 172.21.15.151:0/4085332889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22660 msgr2=0x5578e0a257c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e259c700 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22660 0x5578e0a257c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e259c700 1 -- 172.21.15.151:0/4085332889 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e410d210 con 0x5578e08786b0 2023-07-21T22:44:23.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e2d9d700 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22660 0x5578e0a257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:44:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.769+0000 7f17e259c700 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e08786b0 0x5578e0a2b530 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005f50 tx=0x7f17d4005280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80e79ed1c93b6cd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.770+0000 7f17c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:44:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.770+0000 7f17c9ffb700 1 -- 172.21.15.151:0/4085332889 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d4003b70 con 0x5578e08786b0 2023-07-21T22:44:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.770+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/4085332889 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5578e08c7490 con 0x5578e08786b0 2023-07-21T22:44:23.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.770+0000 7f17c9ffb700 1 -- 172.21.15.151:0/4085332889 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f17d40056a0 con 0x5578e08786b0 2023-07-21T22:44:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.770+0000 7f17c9ffb700 1 -- 172.21.15.151:0/4085332889 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17d4005980 con 0x5578e08786b0 2023-07-21T22:44:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.770+0000 7f17fc9fdb80 10 client.28010 fetch_fsmap learned FSMap version 89 2023-07-21T22:44:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.770+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/4085332889 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x5578e0784c00 con 0x5578e08786b0 2023-07-21T22:44:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.770+0000 7f17c9ffb700 1 -- 172.21.15.151:0/4085332889 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5578e08c7490 con 0x5578e08786b0 2023-07-21T22:44:23.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.771+0000 7f17c9ffb700 1 -- 172.21.15.151:0/4085332889 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f17d402ba80 con 0x5578e08786b0 2023-07-21T22:44:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.771+0000 7f17fc9fdb80 10 client.28010 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:44:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.771+0000 7f17fc9fdb80 10 client.28010 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:44:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.771+0000 7f17fc9fdb80 20 client.28010 populate_metadata read hostname 'smithi151' 2023-07-21T22:44:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.771+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5578e0a354f0 0x5578e0a378d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.771+0000 7f17fc9fdb80 4 client.28010 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:44:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.771+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/4085332889 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5578e0966e50 con 0x5578e0a354f0 2023-07-21T22:44:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.771+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5578e0a354f0 0x5578e0a378d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.772+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5578e0a354f0 0x5578e0a378d0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1ae9e2bd76d523b server_cookie=fc99c630b4e23268 in_seq=0 out_seq=0 2023-07-21T22:44:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.772+0000 7f17c9ffb700 10 client.28010 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.772+0000 7f17c9ffb700 1 -- 172.21.15.151:0/4085332889 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5578e0966e50 con 0x5578e0a354f0 2023-07-21T22:44:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17c9ffb700 10 client.28010 handle_command_reply: tid=0 2023-07-21T22:44:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 client.28010 shutdown 2023-07-21T22:44:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/4085332889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e08786b0 msgr2=0x5578e0a2b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e08786b0 0x5578e0a2b530 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f17d4005f50 tx=0x7f17d4005280 comp rx=0 tx=0).stop 2023-07-21T22:44:23.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/4085332889 shutdown_connections 2023-07-21T22:44:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5578e0a354f0 0x5578e0a378d0 crc :-1 s=READY pgs=322 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e08786b0 0x5578e0a2b530 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22660 0x5578e0a257c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/4085332889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e0a22210 0x5578e0a2ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/4085332889 >> 172.21.15.151:0/4085332889 conn(0x5578e0a11ae0 msgr2=0x5578e0a163e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17c9ffb700 0 client.28010 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/4085332889 shutdown_connections 2023-07-21T22:44:23.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/4085332889 wait complete. 2023-07-21T22:44:23.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.773+0000 7f17fc9fdb80 20 client.28010 trim_cache size 0 max 16384 2023-07-21T22:44:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.789+0000 7f17fc9fdb80 1 Processor -- start 2023-07-21T22:44:23.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.789+0000 7f17fc9fdb80 1 -- start start 2023-07-21T22:44:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a1bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e0a134f0 con 0x5578e0a22210 2023-07-21T22:44:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e0a23d40 con 0x5578e0a22660 2023-07-21T22:44:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e0a189d0 con 0x5578e08786b0 2023-07-21T22:44:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17e1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17e1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38498/0 (socket says 172.21.15.151:38498) 2023-07-21T22:44:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17e1d9b700 1 -- 172.21.15.151:0/1668864876 learned_addr learned my addr 172.21.15.151:0/1668864876 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:23.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17e259c700 1 --2- 172.21.15.151:0/1668864876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.790+0000 7f17e2d9d700 1 --2- 172.21.15.151:0/1668864876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a1bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.791+0000 7f17e1d9b700 1 -- 172.21.15.151:0/1668864876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 msgr2=0x5578e0a21170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.791+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/1668864876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.791+0000 7f17e1d9b700 1 -- 172.21.15.151:0/1668864876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 msgr2=0x5578e0a1bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.791+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/1668864876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a1bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.791+0000 7f17e1d9b700 1 -- 172.21.15.151:0/1668864876 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5578e07c21f0 con 0x5578e0a22210 2023-07-21T22:44:23.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.791+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/1668864876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1b640 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f17d80ca5f0 tx=0x7f17d8005bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eaf0c6d71f60147 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.791+0000 7f17d17fa700 1 -- 172.21.15.151:0/1668864876 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d8099ec0 con 0x5578e0a22210 2023-07-21T22:44:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.791+0000 7f17d17fa700 1 -- 172.21.15.151:0/1668864876 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17d809def0 con 0x5578e0a22210 2023-07-21T22:44:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.791+0000 7f17d17fa700 1 -- 172.21.15.151:0/1668864876 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d80993b0 con 0x5578e0a22210 2023-07-21T22:44:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.792+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1668864876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 msgr2=0x5578e0a1b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.792+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1668864876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1b640 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f17d80ca5f0 tx=0x7f17d8005bb0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.792+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1668864876 shutdown_connections 2023-07-21T22:44:23.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.792+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1668864876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a1bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.792+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1668864876 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a21170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.792+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1668864876 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a1b640 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.792+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1668864876 >> 172.21.15.151:0/1668864876 conn(0x5578e0a11ae0 msgr2=0x5578e0a1af30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.792+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1668864876 shutdown_connections 2023-07-21T22:44:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.792+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1668864876 wait complete. 2023-07-21T22:44:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.793+0000 7f17fc9fdb80 1 -- start start 2023-07-21T22:44:23.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.793+0000 7f17fc9fdb80 1 Processor -- start 2023-07-21T22:44:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a29720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a29c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17fc9fdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a882e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e0a88820 con 0x5578e0a22210 2023-07-21T22:44:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e0a88960 con 0x5578e0a22660 2023-07-21T22:44:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17fc9fdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5578e0a88b20 con 0x5578e08786b0 2023-07-21T22:44:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17fc9fdb80 10 client.0 _ll_register_callbacks cb 0x7f17dc013970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:44:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17e259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a29720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17e1d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a29c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17e259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a29720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54152/0 (socket says 172.21.15.151:54152) 2023-07-21T22:44:23.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17e259c700 1 -- 172.21.15.151:0/1613790300 learned_addr learned my addr 172.21.15.151:0/1613790300 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.794+0000 7f17e2d9d700 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a882e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17e259c700 1 -- 172.21.15.151:0/1613790300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 msgr2=0x5578e0a882e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17e259c700 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a882e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17e259c700 1 -- 172.21.15.151:0/1613790300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 msgr2=0x5578e0a29c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17e259c700 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a29c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17e259c700 1 -- 172.21.15.151:0/1613790300 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17e41a4d70 con 0x5578e08786b0 2023-07-21T22:44:23.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a29c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:44:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17e259c700 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a29720 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f17d4001eb0 tx=0x7f17d400b800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac9232bc323b9c8c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17c9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:44:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17c9ffb700 1 -- 172.21.15.151:0/1613790300 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d400f530 con 0x5578e08786b0 2023-07-21T22:44:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1613790300 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f17d401e040 con 0x5578e08786b0 2023-07-21T22:44:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.795+0000 7f17c9ffb700 1 -- 172.21.15.151:0/1613790300 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f17d4000e40 con 0x5578e08786b0 2023-07-21T22:44:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17c9ffb700 1 -- 172.21.15.151:0/1613790300 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f17d4003970 con 0x5578e08786b0 2023-07-21T22:44:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17fc9fdb80 10 client.28045 fetch_fsmap learned FSMap version 89 2023-07-21T22:44:23.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1613790300 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x5578e079a250 con 0x5578e08786b0 2023-07-21T22:44:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17c9ffb700 1 -- 172.21.15.151:0/1613790300 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f17d404e020 con 0x5578e08786b0 2023-07-21T22:44:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17c9ffb700 1 -- 172.21.15.151:0/1613790300 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f17d402b460 con 0x5578e08786b0 2023-07-21T22:44:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17fc9fdb80 10 client.28045 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:44:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17fc9fdb80 10 client.28045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:44:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17fc9fdb80 20 client.28045 populate_metadata read hostname 'smithi151' 2023-07-21T22:44:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5578e0a89e20 0x5578e0a8c230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17fc9fdb80 4 client.28045 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:44:23.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.796+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1613790300 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5578e0928ff0 con 0x5578e0a89e20 2023-07-21T22:44:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.797+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5578e0a89e20 0x5578e0a8c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.797+0000 7f17e1d9b700 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5578e0a89e20 0x5578e0a8c230 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2a3514995d0cfc3 server_cookie=8f58efcc726d5532 in_seq=0 out_seq=0 2023-07-21T22:44:23.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.797+0000 7f17c9ffb700 10 client.28045 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.804+0000 7f17c9ffb700 1 -- 172.21.15.151:0/1613790300 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5578e0928ff0 con 0x5578e0a89e20 2023-07-21T22:44:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.804+0000 7f17c9ffb700 10 client.28045 handle_command_reply: tid=0 2023-07-21T22:44:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 client.28045 shutdown 2023-07-21T22:44:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1613790300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 msgr2=0x5578e0a29720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a29720 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f17d4001eb0 tx=0x7f17d400b800 comp rx=0 tx=0).stop 2023-07-21T22:44:23.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1613790300 shutdown_connections 2023-07-21T22:44:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5578e0a89e20 0x5578e0a8c230 crc :-1 s=READY pgs=323 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5578e0a22660 0x5578e0a882e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5578e08786b0 0x5578e0a29720 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17c9ffb700 0 client.28045 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 --2- 172.21.15.151:0/1613790300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5578e0a22210 0x5578e0a29c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1613790300 >> 172.21.15.151:0/1613790300 conn(0x5578e0a11ae0 msgr2=0x5578e0a23300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1613790300 shutdown_connections 2023-07-21T22:44:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 1 -- 172.21.15.151:0/1613790300 wait complete. 2023-07-21T22:44:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.805+0000 7f17fc9fdb80 20 client.28045 trim_cache size 0 max 16384 2023-07-21T22:44:23.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:44:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:44:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:44:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:44:23.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 -- 172.21.15.151:0/283674361 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17cc0a12c0 msgr2=0x7f17cc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17cc0a12c0 0x7f17cc0a3770 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17dc009ec0 tx=0x7f17dc0134a0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 -- 172.21.15.151:0/283674361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17e40685b0 msgr2=0x7f17e4198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17e40685b0 0x7f17e4198310 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f17e4068980 tx=0x7f17d800eca0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 -- 172.21.15.151:0/283674361 shutdown_connections 2023-07-21T22:44:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f17cc0a12c0 0x7f17cc0a3770 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17e4104e50 0x7f17e419c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17e4067c10 0x7f17e4197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 --2- 172.21.15.151:0/283674361 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f17e40685b0 0x7f17e4198310 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 -- 172.21.15.151:0/283674361 >> 172.21.15.151:0/283674361 conn(0x7f17e4074760 msgr2=0x7f17e40fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 -- 172.21.15.151:0/283674361 shutdown_connections 2023-07-21T22:44:23.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:23.806+0000 7f17e8fff700 1 -- 172.21.15.151:0/283674361 wait complete. 2023-07-21T22:44:24.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:24 smithi151 ceph-mon[95510]: pgmap v797: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.5 MiB/s wr, 323 op/s 2023-07-21T22:44:25.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:24 smithi187 ceph-mon[96918]: pgmap v797: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.5 MiB/s wr, 323 op/s 2023-07-21T22:44:25.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:24 smithi195 ceph-mon[97365]: pgmap v797: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.5 MiB/s wr, 323 op/s 2023-07-21T22:44:25.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:25 smithi151 ceph-mon[95510]: pgmap v798: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.5 MiB/s wr, 323 op/s 2023-07-21T22:44:26.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:25 smithi187 ceph-mon[96918]: pgmap v798: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.5 MiB/s wr, 323 op/s 2023-07-21T22:44:26.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:25 smithi195 ceph-mon[97365]: pgmap v798: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.5 MiB/s wr, 323 op/s 2023-07-21T22:44:28.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:28 smithi195 ceph-mon[97365]: pgmap v799: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.6 MiB/s wr, 467 op/s 2023-07-21T22:44:28.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:28 smithi151 ceph-mon[95510]: pgmap v799: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.6 MiB/s wr, 467 op/s 2023-07-21T22:44:29.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:28 smithi187 ceph-mon[96918]: pgmap v799: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.6 MiB/s wr, 467 op/s 2023-07-21T22:44:30.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:30 smithi195 ceph-mon[97365]: pgmap v800: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-07-21T22:44:30.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:30 smithi151 ceph-mon[95510]: pgmap v800: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-07-21T22:44:31.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:30 smithi187 ceph-mon[96918]: pgmap v800: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-07-21T22:44:32.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:32 smithi195 ceph-mon[97365]: pgmap v801: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-07-21T22:44:32.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:32 smithi151 ceph-mon[95510]: pgmap v801: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-07-21T22:44:33.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:32 smithi187 ceph-mon[96918]: pgmap v801: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 266 op/s 2023-07-21T22:44:34.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:34 smithi195 ceph-mon[97365]: pgmap v802: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.1 MiB/s wr, 398 op/s 2023-07-21T22:44:34.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:34 smithi151 ceph-mon[95510]: pgmap v802: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.1 MiB/s wr, 398 op/s 2023-07-21T22:44:35.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:34 smithi187 ceph-mon[96918]: pgmap v802: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 3.1 MiB/s wr, 398 op/s 2023-07-21T22:44:36.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:36 smithi195 ceph-mon[97365]: pgmap v803: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-07-21T22:44:36.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:36 smithi151 ceph-mon[95510]: pgmap v803: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-07-21T22:44:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.054+0000 7fc4a01ff700 1 -- 172.21.15.151:0/941853946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498107010 msgr2=0x7fc49810ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:37.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.054+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/941853946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498107010 0x7fc49810ebe0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fc4900099c0 tx=0x7fc490009cd0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.054+0000 7fc4a01ff700 1 -- 172.21.15.151:0/941853946 shutdown_connections 2023-07-21T22:44:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.054+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/941853946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498107010 0x7fc49810ebe0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.054+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/941853946 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc498101fd0 0x7fc4981023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.054+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/941853946 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc498102970 0x7fc498106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.054+0000 7fc4a01ff700 1 -- 172.21.15.151:0/941853946 >> 172.21.15.151:0/941853946 conn(0x7fc4980fd840 msgr2=0x7fc4980ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:37.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.054+0000 7fc4a01ff700 1 -- 172.21.15.151:0/941853946 shutdown_connections 2023-07-21T22:44:37.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.054+0000 7fc4a01ff700 1 -- 172.21.15.151:0/941853946 wait complete. 2023-07-21T22:44:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.055+0000 7fc4a01ff700 1 Processor -- start 2023-07-21T22:44:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.055+0000 7fc4a01ff700 1 -- start start 2023-07-21T22:44:37.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc4a01ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc498101fd0 0x7fc498197d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc4a01ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498102970 0x7fc498198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc4a01ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc498107010 0x7fc49819c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc4a01ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49819cf20 con 0x7fc498102970 2023-07-21T22:44:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc4a01ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49819d090 con 0x7fc498107010 2023-07-21T22:44:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc4a01ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc49819d250 con 0x7fc498101fd0 2023-07-21T22:44:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498102970 0x7fc498198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498102970 0x7fc498198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56840/0 (socket says 172.21.15.151:56840) 2023-07-21T22:44:37.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49e79c700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc498107010 0x7fc49819c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49d79a700 1 -- 172.21.15.151:0/2419784033 learned_addr learned my addr 172.21.15.151:0/2419784033 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49df9b700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc498101fd0 0x7fc498197d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49d79a700 1 -- 172.21.15.151:0/2419784033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc498101fd0 msgr2=0x7fc498197d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49d79a700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc498101fd0 0x7fc498197d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49d79a700 1 -- 172.21.15.151:0/2419784033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc498107010 msgr2=0x7fc49819c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:37.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49d79a700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc498107010 0x7fc49819c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49d79a700 1 -- 172.21.15.151:0/2419784033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc494009c40 con 0x7fc498102970 2023-07-21T22:44:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.056+0000 7fc49e79c700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc498107010 0x7fc49819c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:44:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.057+0000 7fc49d79a700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498102970 0x7fc498198270 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc48800e940 tx=0x7fc48800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.057+0000 7fc48effd700 1 -- 172.21.15.151:0/2419784033 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488009730 con 0x7fc498102970 2023-07-21T22:44:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.057+0000 7fc4a01ff700 1 -- 172.21.15.151:0/2419784033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4900095f0 con 0x7fc498102970 2023-07-21T22:44:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.057+0000 7fc48effd700 1 -- 172.21.15.151:0/2419784033 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc48800ce70 con 0x7fc498102970 2023-07-21T22:44:37.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.057+0000 7fc48effd700 1 -- 172.21.15.151:0/2419784033 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488018420 con 0x7fc498102970 2023-07-21T22:44:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.057+0000 7fc4a01ff700 1 -- 172.21.15.151:0/2419784033 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4981a4b90 con 0x7fc498102970 2023-07-21T22:44:37.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.060+0000 7fc48effd700 1 -- 172.21.15.151:0/2419784033 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fc48800c9e0 con 0x7fc498102970 2023-07-21T22:44:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.062+0000 7fc4b3a94b80 1 Processor -- start 2023-07-21T22:44:37.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.062+0000 7fc4b3a94b80 1 -- start start 2023-07-21T22:44:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.062+0000 7fc48effd700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc4840a12c0 0x7fc4840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda020c6b0 0x55bda03b5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda02b5c50 con 0x55bda020c6b0 2023-07-21T22:44:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda03089e0 con 0x55bda03b6660 2023-07-21T22:44:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda0301e70 con 0x55bda03b6210 2023-07-21T22:44:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc48effd700 1 -- 172.21.15.151:0/2419784033 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc488014070 con 0x7fc498102970 2023-07-21T22:44:37.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49df9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda020c6b0 0x55bda03b5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49e79c700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc4840a12c0 0x7fc4840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42500/0 (socket says 172.21.15.151:42500) 2023-07-21T22:44:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49d79a700 1 -- 172.21.15.151:0/2971960406 learned_addr learned my addr 172.21.15.151:0/2971960406 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49e79c700 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49d79a700 1 -- 172.21.15.151:0/2971960406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 msgr2=0x55bda03b04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:37.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49d79a700 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49d79a700 1 -- 172.21.15.151:0/2971960406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda020c6b0 msgr2=0x55bda03b5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49d79a700 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda020c6b0 0x55bda03b5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49d79a700 1 -- 172.21.15.151:0/2971960406 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bda012fd80 con 0x55bda03b6210 2023-07-21T22:44:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.063+0000 7fc49e79c700 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:44:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.064+0000 7fc49df9b700 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda020c6b0 0x55bda03b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:44:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.064+0000 7fc49d79a700 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03aff40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc488096920 tx=0x7fc488099d00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=19c0205ec21a5487 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.064+0000 7fc49e79c700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc4840a12c0 0x7fc4840a3770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55bda03b6a70 tx=0x7fc490005bc0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:37.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.064+0000 7fc483fff700 1 -- 172.21.15.151:0/2971960406 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488019d40 con 0x55bda03b6210 2023-07-21T22:44:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.064+0000 7fc483fff700 1 -- 172.21.15.151:0/2971960406 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc488019b60 con 0x55bda03b6210 2023-07-21T22:44:37.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.064+0000 7fc483fff700 1 -- 172.21.15.151:0/2971960406 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc488099eb0 con 0x55bda03b6210 2023-07-21T22:44:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2971960406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 msgr2=0x55bda03aff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03aff40 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fc488096920 tx=0x7fc488099d00 comp rx=0 tx=0).stop 2023-07-21T22:44:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2971960406 shutdown_connections 2023-07-21T22:44:37.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda020c6b0 0x55bda03b5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2971960406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03aff40 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2971960406 >> 172.21.15.151:0/2971960406 conn(0x55bda03a5ae0 msgr2=0x55bda03ab0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2971960406 shutdown_connections 2023-07-21T22:44:37.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2971960406 wait complete. 2023-07-21T22:44:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.065+0000 7fc4b3a94b80 1 -- start start 2023-07-21T22:44:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.066+0000 7fc4b3a94b80 1 Processor -- start 2023-07-21T22:44:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03bc580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03b9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6660 0x55bda03b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda02a1a60 con 0x55bda03b6660 2023-07-21T22:44:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda02a1760 con 0x55bda020c6b0 2023-07-21T22:44:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda01858c0 con 0x55bda03b6210 2023-07-21T22:44:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc4b3a94b80 10 client.0 _ll_register_callbacks cb 0x55bda029f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:44:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03b9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49df9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03bc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49e79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6660 0x55bda03b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49df9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03bc580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44650/0 (socket says 172.21.15.151:44650) 2023-07-21T22:44:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49df9b700 1 -- 172.21.15.151:0/127233887 learned_addr learned my addr 172.21.15.151:0/127233887 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03b9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42512/0 (socket says 172.21.15.151:42512) 2023-07-21T22:44:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49d79a700 1 -- 172.21.15.151:0/127233887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 msgr2=0x55bda03bc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:37.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49d79a700 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03bc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49d79a700 1 -- 172.21.15.151:0/127233887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6660 msgr2=0x55bda03b9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49d79a700 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6660 0x55bda03b9e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49d79a700 1 -- 172.21.15.151:0/127233887 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49400e330 con 0x55bda03b6210 2023-07-21T22:44:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc49d79a700 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03b9800 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc48800f010 tx=0x7fc488095bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=338b05b48a1bbbd8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.067+0000 7fc4817fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:44:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4817fa700 1 -- 172.21.15.151:0/127233887 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48809a310 con 0x55bda03b6210 2023-07-21T22:44:37.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4817fa700 1 -- 172.21.15.151:0/127233887 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc48800cc90 con 0x55bda03b6210 2023-07-21T22:44:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/127233887 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bda025b490 con 0x55bda03b6210 2023-07-21T22:44:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4817fa700 1 -- 172.21.15.151:0/127233887 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4880b82f0 con 0x55bda03b6210 2023-07-21T22:44:37.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4b3a94b80 10 client.28057 fetch_fsmap learned FSMap version 89 2023-07-21T22:44:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/127233887 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x7fc4981a4b90 con 0x55bda03b6210 2023-07-21T22:44:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4817fa700 1 -- 172.21.15.151:0/127233887 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bda025b490 con 0x55bda03b6210 2023-07-21T22:44:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4817fa700 1 -- 172.21.15.151:0/127233887 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc4880994c0 con 0x55bda03b6210 2023-07-21T22:44:37.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4b3a94b80 10 client.28057 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:44:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4b3a94b80 10 client.28057 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:44:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4b3a94b80 20 client.28057 populate_metadata read hostname 'smithi151' 2023-07-21T22:44:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bda03c9800 0x55bda03cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4b3a94b80 4 client.28057 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:44:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.068+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/127233887 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bda02fae50 con 0x55bda03c9800 2023-07-21T22:44:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.069+0000 7fc49df9b700 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bda03c9800 0x55bda03cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.069+0000 7fc4817fa700 10 client.28057 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.069+0000 7fc49df9b700 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bda03c9800 0x55bda03cbbe0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9229dac5ab3f685 server_cookie=9d836de1493a94cc in_seq=0 out_seq=0 2023-07-21T22:44:37.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.070+0000 7fc4817fa700 1 -- 172.21.15.151:0/127233887 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bda02fae50 con 0x55bda03c9800 2023-07-21T22:44:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.070+0000 7fc4817fa700 10 client.28057 handle_command_reply: tid=0 2023-07-21T22:44:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.070+0000 7fc4b3a94b80 1 client.28057 shutdown 2023-07-21T22:44:37.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/127233887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 msgr2=0x55bda03b9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03b9800 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fc48800f010 tx=0x7fc488095bd0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/127233887 shutdown_connections 2023-07-21T22:44:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bda03c9800 0x55bda03cbbe0 crc :-1 s=READY pgs=324 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03bc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6660 0x55bda03b9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/127233887 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6210 0x55bda03b9800 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4817fa700 0 client.28057 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/127233887 >> 172.21.15.151:0/127233887 conn(0x55bda03a5ae0 msgr2=0x55bda03aa3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/127233887 shutdown_connections 2023-07-21T22:44:37.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/127233887 wait complete. 2023-07-21T22:44:37.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.071+0000 7fc4b3a94b80 20 client.28057 trim_cache size 0 max 16384 2023-07-21T22:44:37.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:36 smithi187 ceph-mon[96918]: pgmap v803: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-07-21T22:44:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc4b3a94b80 1 Processor -- start 2023-07-21T22:44:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc4b3a94b80 1 -- start start 2023-07-21T22:44:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03aff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03c0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6660 0x55bda03aab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda025b490 con 0x55bda03b6210 2023-07-21T22:44:37.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda03a2b40 con 0x55bda020c6b0 2023-07-21T22:44:37.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda03b0d30 con 0x55bda03b6660 2023-07-21T22:44:37.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03c0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03c0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56860/0 (socket says 172.21.15.151:56860) 2023-07-21T22:44:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc49d79a700 1 -- 172.21.15.151:0/1437849416 learned_addr learned my addr 172.21.15.151:0/1437849416 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc49df9b700 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.087+0000 7fc49e79c700 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6660 0x55bda03aab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc49d79a700 1 -- 172.21.15.151:0/1437849416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6660 msgr2=0x55bda03aab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc49d79a700 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6660 0x55bda03aab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc49d79a700 1 -- 172.21.15.151:0/1437849416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 msgr2=0x55bda03aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:37.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc49d79a700 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc49d79a700 1 -- 172.21.15.151:0/1437849416 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bda0118c00 con 0x55bda03b6210 2023-07-21T22:44:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc49df9b700 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:44:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc49d79a700 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03c0ba0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc488099980 tx=0x7fc488098460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23dad8c05a2d8f93 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc48cff9700 1 -- 172.21.15.151:0/1437849416 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4880b82f0 con 0x55bda03b6210 2023-07-21T22:44:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc48cff9700 1 -- 172.21.15.151:0/1437849416 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc4880addb0 con 0x55bda03b6210 2023-07-21T22:44:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.088+0000 7fc48cff9700 1 -- 172.21.15.151:0/1437849416 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc48809a370 con 0x55bda03b6210 2023-07-21T22:44:37.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/1437849416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 msgr2=0x55bda03c0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03c0ba0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fc488099980 tx=0x7fc488098460 comp rx=0 tx=0).stop 2023-07-21T22:44:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/1437849416 shutdown_connections 2023-07-21T22:44:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda020c6b0 0x55bda03aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda03b6660 0x55bda03aab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/1437849416 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03c0ba0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/1437849416 >> 172.21.15.151:0/1437849416 conn(0x55bda03a5ae0 msgr2=0x55bda03b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/1437849416 shutdown_connections 2023-07-21T22:44:37.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/1437849416 wait complete. 2023-07-21T22:44:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.089+0000 7fc4b3a94b80 1 -- start start 2023-07-21T22:44:37.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc4b3a94b80 1 Processor -- start 2023-07-21T22:44:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda020c6b0 0x55bda03b27b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03b2cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc4b3a94b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda03b33d0 con 0x55bda03b6210 2023-07-21T22:44:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda03b1c70 con 0x55bda03b6660 2023-07-21T22:44:37.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc4b3a94b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bda03b1e30 con 0x55bda020c6b0 2023-07-21T22:44:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc4b3a94b80 10 client.0 _ll_register_callbacks cb 0x7fc49400e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:44:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03b2cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc49e79c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc49d79a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03b2cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56864/0 (socket says 172.21.15.151:56864) 2023-07-21T22:44:37.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc49d79a700 1 -- 172.21.15.151:0/2003520254 learned_addr learned my addr 172.21.15.151:0/2003520254 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.090+0000 7fc49df9b700 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda020c6b0 0x55bda03b27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc49e79c700 1 -- 172.21.15.151:0/2003520254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda020c6b0 msgr2=0x55bda03b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc49e79c700 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda020c6b0 0x55bda03b27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc49e79c700 1 -- 172.21.15.151:0/2003520254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 msgr2=0x55bda03b2cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc49e79c700 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03b2cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc49e79c700 1 -- 172.21.15.151:0/2003520254 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc49400e930 con 0x55bda03b6660 2023-07-21T22:44:37.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc49e79c700 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b1730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc490009990 tx=0x7fc490009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b04fb57b40eb6a3e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc4817fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:44:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc4817fa700 1 -- 172.21.15.151:0/2003520254 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc49000f870 con 0x55bda03b6660 2023-07-21T22:44:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2003520254 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc488019b60 con 0x55bda03b6660 2023-07-21T22:44:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.091+0000 7fc4817fa700 1 -- 172.21.15.151:0/2003520254 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc49000f9d0 con 0x55bda03b6660 2023-07-21T22:44:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4817fa700 1 -- 172.21.15.151:0/2003520254 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc490003e60 con 0x55bda03b6660 2023-07-21T22:44:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4b3a94b80 10 client.28031 fetch_fsmap learned FSMap version 89 2023-07-21T22:44:37.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2003520254 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x7fc4981a4b90 con 0x55bda03b6660 2023-07-21T22:44:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4817fa700 1 -- 172.21.15.151:0/2003520254 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc49003f020 con 0x55bda03b6660 2023-07-21T22:44:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4817fa700 1 -- 172.21.15.151:0/2003520254 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fc49003bcb0 con 0x55bda03b6660 2023-07-21T22:44:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4b3a94b80 10 client.28031 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:44:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4b3a94b80 10 client.28031 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:44:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4b3a94b80 20 client.28031 populate_metadata read hostname 'smithi151' 2023-07-21T22:44:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bda041e290 0x55bda04206a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:37.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4b3a94b80 4 client.28031 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:44:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.092+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2003520254 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bda02bcff0 con 0x55bda041e290 2023-07-21T22:44:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.093+0000 7fc49df9b700 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bda041e290 0x55bda04206a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.093+0000 7fc49df9b700 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bda041e290 0x55bda04206a0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ca7283ef1eb96e8 server_cookie=77f59c20dbe5c7d5 in_seq=0 out_seq=0 2023-07-21T22:44:37.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.093+0000 7fc4817fa700 10 client.28031 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4817fa700 1 -- 172.21.15.151:0/2003520254 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bda02bcff0 con 0x55bda041e290 2023-07-21T22:44:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4817fa700 10 client.28031 handle_command_reply: tid=0 2023-07-21T22:44:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 client.28031 shutdown 2023-07-21T22:44:37.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2003520254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 msgr2=0x55bda03b1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b1730 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fc490009990 tx=0x7fc490009310 comp rx=0 tx=0).stop 2023-07-21T22:44:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2003520254 shutdown_connections 2023-07-21T22:44:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bda041e290 0x55bda04206a0 crc :-1 s=READY pgs=325 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bda03b6660 0x55bda03b1730 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bda020c6b0 0x55bda03b27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4817fa700 0 client.28031 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 --2- 172.21.15.151:0/2003520254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bda03b6210 0x55bda03b2cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2003520254 >> 172.21.15.151:0/2003520254 conn(0x55bda03a5ae0 msgr2=0x55bda03b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2003520254 shutdown_connections 2023-07-21T22:44:37.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 1 -- 172.21.15.151:0/2003520254 wait complete. 2023-07-21T22:44:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.101+0000 7fc4b3a94b80 20 client.28031 trim_cache size 0 max 16384 2023-07-21T22:44:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:44:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:44:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:44:37.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:44:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 -- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc4840a12c0 msgr2=0x7fc4840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:37.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc4840a12c0 0x7fc4840a3770 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x55bda03b6a70 tx=0x7fc490005bc0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 -- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498102970 msgr2=0x7fc498198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498102970 0x7fc498198270 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fc48800e940 tx=0x7fc48800ec50 comp rx=0 tx=0).stop 2023-07-21T22:44:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 -- 172.21.15.151:0/2419784033 shutdown_connections 2023-07-21T22:44:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc4840a12c0 0x7fc4840a3770 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc498107010 0x7fc49819c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc498101fd0 0x7fc498197d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 --2- 172.21.15.151:0/2419784033 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc498102970 0x7fc498198270 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:37.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 -- 172.21.15.151:0/2419784033 >> 172.21.15.151:0/2419784033 conn(0x7fc4980fd840 msgr2=0x7fc4980fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:37.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 -- 172.21.15.151:0/2419784033 shutdown_connections 2023-07-21T22:44:37.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:37.102+0000 7fc4a01ff700 1 -- 172.21.15.151:0/2419784033 wait complete. 2023-07-21T22:44:38.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:38 smithi195 ceph-mon[97365]: pgmap v804: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 MiB/s wr, 404 op/s 2023-07-21T22:44:38.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:38 smithi151 ceph-mon[95510]: pgmap v804: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 MiB/s wr, 404 op/s 2023-07-21T22:44:39.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:38 smithi187 ceph-mon[96918]: pgmap v804: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 3.1 MiB/s wr, 404 op/s 2023-07-21T22:44:40.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:40 smithi195 ceph-mon[97365]: pgmap v805: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:44:40.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:40 smithi151 ceph-mon[95510]: pgmap v805: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:44:41.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:40 smithi187 ceph-mon[96918]: pgmap v805: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:44:42.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:42 smithi195 ceph-mon[97365]: pgmap v806: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:44:42.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:42 smithi151 ceph-mon[95510]: pgmap v806: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:44:43.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:42 smithi187 ceph-mon[96918]: pgmap v806: 97 pgs: 97 active+clean; 8.2 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:44:44.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:44 smithi195 ceph-mon[97365]: pgmap v807: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.1 MiB/s wr, 403 op/s 2023-07-21T22:44:44.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:44 smithi151 ceph-mon[95510]: pgmap v807: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.1 MiB/s wr, 403 op/s 2023-07-21T22:44:45.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:44 smithi187 ceph-mon[96918]: pgmap v807: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 3.1 MiB/s wr, 403 op/s 2023-07-21T22:44:46.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:46 smithi151 ceph-mon[95510]: pgmap v808: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 271 op/s 2023-07-21T22:44:47.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:46 smithi187 ceph-mon[96918]: pgmap v808: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 271 op/s 2023-07-21T22:44:47.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:46 smithi195 ceph-mon[97365]: pgmap v808: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 2.1 MiB/s wr, 271 op/s 2023-07-21T22:44:48.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:48 smithi151 ceph-mon[95510]: pgmap v809: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 3.1 MiB/s wr, 409 op/s 2023-07-21T22:44:49.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:48 smithi187 ceph-mon[96918]: pgmap v809: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 3.1 MiB/s wr, 409 op/s 2023-07-21T22:44:49.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:48 smithi195 ceph-mon[97365]: pgmap v809: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 3.1 MiB/s wr, 409 op/s 2023-07-21T22:44:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.264+0000 7fa24e9ff700 1 -- 172.21.15.151:0/1925679149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2481004e0 msgr2=0x7fa24810c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.264+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/1925679149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2481004e0 0x7fa24810c920 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa24000b0a0 tx=0x7fa24000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.264+0000 7fa24e9ff700 1 -- 172.21.15.151:0/1925679149 shutdown_connections 2023-07-21T22:44:50.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.264+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/1925679149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2481004e0 0x7fa24810c920 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.264+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/1925679149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa248105b60 0x7fa248105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.264+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/1925679149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2480ffb30 0x7fa2480fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.264+0000 7fa24e9ff700 1 -- 172.21.15.151:0/1925679149 >> 172.21.15.151:0/1925679149 conn(0x7fa2480fb5f0 msgr2=0x7fa2480fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.264+0000 7fa24e9ff700 1 -- 172.21.15.151:0/1925679149 shutdown_connections 2023-07-21T22:44:50.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.264+0000 7fa24e9ff700 1 -- 172.21.15.151:0/1925679149 wait complete. 2023-07-21T22:44:50.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.265+0000 7fa24e9ff700 1 Processor -- start 2023-07-21T22:44:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa24e9ff700 1 -- start start 2023-07-21T22:44:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa24e9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2480ffb30 0x7fa24819bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa24e9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2481004e0 0x7fa24819c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa24e9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa248105b60 0x7fa2481959e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa24e9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248196050 con 0x7fa2480ffb30 2023-07-21T22:44:50.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa24e9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2481961c0 con 0x7fa248105b60 2023-07-21T22:44:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa24e9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248196380 con 0x7fa2481004e0 2023-07-21T22:44:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa247fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2480ffb30 0x7fa24819bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa247fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2480ffb30 0x7fa24819bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36182/0 (socket says 172.21.15.151:36182) 2023-07-21T22:44:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa247fff700 1 -- 172.21.15.151:0/3248592697 learned_addr learned my addr 172.21.15.151:0/3248592697 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.266+0000 7fa24cf9c700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa248105b60 0x7fa2481959e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa2477fe700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2481004e0 0x7fa24819c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa247fff700 1 -- 172.21.15.151:0/3248592697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2481004e0 msgr2=0x7fa24819c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa247fff700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2481004e0 0x7fa24819c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa247fff700 1 -- 172.21.15.151:0/3248592697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa248105b60 msgr2=0x7fa2481959e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa247fff700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa248105b60 0x7fa2481959e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa247fff700 1 -- 172.21.15.151:0/3248592697 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa240009d00 con 0x7fa2480ffb30 2023-07-21T22:44:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa247fff700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2480ffb30 0x7fa24819bb80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e9a0 tx=0x7fa23800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:50.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa2457fa700 1 -- 172.21.15.151:0/3248592697 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa238009790 con 0x7fa2480ffb30 2023-07-21T22:44:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa24e9ff700 1 -- 172.21.15.151:0/3248592697 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa248196660 con 0x7fa2480ffb30 2023-07-21T22:44:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa2457fa700 1 -- 172.21.15.151:0/3248592697 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa238010430 con 0x7fa2480ffb30 2023-07-21T22:44:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa2457fa700 1 -- 172.21.15.151:0/3248592697 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23800cea0 con 0x7fa2480ffb30 2023-07-21T22:44:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.267+0000 7fa24e9ff700 1 -- 172.21.15.151:0/3248592697 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa248072920 con 0x7fa2480ffb30 2023-07-21T22:44:50.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.271+0000 7fa2457fa700 1 -- 172.21.15.151:0/3248592697 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fa2380105a0 con 0x7fa2480ffb30 2023-07-21T22:44:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.272+0000 7fa2457fa700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2300a12c0 0x7fa2300a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.272+0000 7fa26229eb80 1 Processor -- start 2023-07-21T22:44:50.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.272+0000 7fa2457fa700 1 -- 172.21.15.151:0/3248592697 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa238014070 con 0x7fa2480ffb30 2023-07-21T22:44:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa2477fe700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2300a12c0 0x7fa2300a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa26229eb80 1 -- start start 2023-07-21T22:44:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe555cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe5504a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa26229eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe455c50 con 0x55b5fe556660 2023-07-21T22:44:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa26229eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe4a89e0 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa26229eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe4a1e70 con 0x55b5fe556210 2023-07-21T22:44:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa2477fe700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2300a12c0 0x7fa2300a3770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa2480ff070 tx=0x7fa23c009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa247fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe555cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa2477fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa24cf9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe5504a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa247fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe555cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39060/0 (socket says 172.21.15.151:39060) 2023-07-21T22:44:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.273+0000 7fa247fff700 1 -- 172.21.15.151:0/1626241805 learned_addr learned my addr 172.21.15.151:0/1626241805 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.274+0000 7fa247fff700 1 -- 172.21.15.151:0/1626241805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 msgr2=0x55b5fe54ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.274+0000 7fa247fff700 1 --2- 172.21.15.151:0/1626241805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.274+0000 7fa247fff700 1 -- 172.21.15.151:0/1626241805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 msgr2=0x55b5fe5504a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.274+0000 7fa247fff700 1 --2- 172.21.15.151:0/1626241805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe5504a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.274+0000 7fa247fff700 1 -- 172.21.15.151:0/1626241805 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5fe2cfd80 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.274+0000 7fa247fff700 1 --2- 172.21.15.151:0/1626241805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe555cd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa238096ab0 tx=0x7fa238099c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57c2fb22a4e0e1bd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.274+0000 7fa22e7fc700 1 -- 172.21.15.151:0/1626241805 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380a2490 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.274+0000 7fa22e7fc700 1 -- 172.21.15.151:0/1626241805 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa23809a2a0 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.274+0000 7fa22e7fc700 1 -- 172.21.15.151:0/1626241805 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380a2200 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.275+0000 7fa26229eb80 1 -- 172.21.15.151:0/1626241805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 msgr2=0x55b5fe555cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:50.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.275+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1626241805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe555cd0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa238096ab0 tx=0x7fa238099c90 comp rx=0 tx=0).stop 2023-07-21T22:44:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.275+0000 7fa26229eb80 1 -- 172.21.15.151:0/1626241805 shutdown_connections 2023-07-21T22:44:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.275+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1626241805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe555cd0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.275+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1626241805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe5504a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.275+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1626241805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.275+0000 7fa26229eb80 1 -- 172.21.15.151:0/1626241805 >> 172.21.15.151:0/1626241805 conn(0x55b5fe545ae0 msgr2=0x55b5fe54b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.275+0000 7fa26229eb80 1 -- 172.21.15.151:0/1626241805 shutdown_connections 2023-07-21T22:44:50.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.275+0000 7fa26229eb80 1 -- 172.21.15.151:0/1626241805 wait complete. 2023-07-21T22:44:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.276+0000 7fa26229eb80 1 -- start start 2023-07-21T22:44:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.276+0000 7fa26229eb80 1 Processor -- start 2023-07-21T22:44:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556210 0x55b5fe55fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 0x55b5fe559810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa26229eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe441a60 con 0x55b5fe556210 2023-07-21T22:44:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa26229eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe441760 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa26229eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe3258c0 con 0x55b5fe556660 2023-07-21T22:44:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa26229eb80 10 client.0 _ll_register_callbacks cb 0x55b5fe43f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:44:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa247fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa2477fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556210 0x55b5fe55fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa247fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39062/0 (socket says 172.21.15.151:39062) 2023-07-21T22:44:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa2477fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556210 0x55b5fe55fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36198/0 (socket says 172.21.15.151:36198) 2023-07-21T22:44:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa247fff700 1 -- 172.21.15.151:0/1074655510 learned_addr learned my addr 172.21.15.151:0/1074655510 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:50.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa24cf9c700 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 0x55b5fe559810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa247fff700 1 -- 172.21.15.151:0/1074655510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 msgr2=0x55b5fe559810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa247fff700 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 0x55b5fe559810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa247fff700 1 -- 172.21.15.151:0/1074655510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556210 msgr2=0x55b5fe55fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa247fff700 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556210 0x55b5fe55fb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.277+0000 7fa247fff700 1 -- 172.21.15.151:0/1074655510 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa248072920 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa247fff700 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f5c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa23800c2d0 tx=0x7fa2380998f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c4710fc8a3c7d25 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa2277fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:44:50.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa2277fe700 1 -- 172.21.15.151:0/1074655510 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2380a2490 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa2277fe700 1 -- 172.21.15.151:0/1074655510 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa2380a2210 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa26229eb80 1 -- 172.21.15.151:0/1074655510 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5fe3fb490 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa2277fe700 1 -- 172.21.15.151:0/1074655510 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2380ca2e0 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa26229eb80 10 client.28043 fetch_fsmap learned FSMap version 89 2023-07-21T22:44:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa26229eb80 1 -- 172.21.15.151:0/1074655510 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55b5fe2b8c00 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa2277fe700 1 -- 172.21.15.151:0/1074655510 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa238063020 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.278+0000 7fa2277fe700 1 -- 172.21.15.151:0/1074655510 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa238095e30 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.279+0000 7fa26229eb80 10 client.28043 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:44:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.279+0000 7fa26229eb80 10 client.28043 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:44:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.279+0000 7fa26229eb80 20 client.28043 populate_metadata read hostname 'smithi151' 2023-07-21T22:44:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.279+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5fe569730 0x55b5fe56bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.279+0000 7fa26229eb80 4 client.28043 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:44:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.279+0000 7fa26229eb80 1 -- 172.21.15.151:0/1074655510 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5fe49ae50 con 0x55b5fe569730 2023-07-21T22:44:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.279+0000 7fa2477fe700 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5fe569730 0x55b5fe56bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.279+0000 7fa2477fe700 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5fe569730 0x55b5fe56bb40 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52c40710bc491969 server_cookie=bc1e0c4fc0ff4d47 in_seq=0 out_seq=0 2023-07-21T22:44:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.279+0000 7fa2277fe700 10 client.28043 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa2277fe700 1 -- 172.21.15.151:0/1074655510 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b5fe49ae50 con 0x55b5fe569730 2023-07-21T22:44:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa2277fe700 10 client.28043 handle_command_reply: tid=0 2023-07-21T22:44:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa26229eb80 1 client.28043 shutdown 2023-07-21T22:44:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa26229eb80 1 -- 172.21.15.151:0/1074655510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 msgr2=0x55b5fe55f5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f5c0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa23800c2d0 tx=0x7fa2380998f0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa26229eb80 1 -- 172.21.15.151:0/1074655510 shutdown_connections 2023-07-21T22:44:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5fe569730 0x55b5fe56bb40 crc :-1 s=READY pgs=326 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f5c0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 0x55b5fe559810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa2277fe700 0 client.28043 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa26229eb80 1 --2- 172.21.15.151:0/1074655510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556210 0x55b5fe55fb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.280+0000 7fa26229eb80 1 -- 172.21.15.151:0/1074655510 >> 172.21.15.151:0/1074655510 conn(0x55b5fe545ae0 msgr2=0x55b5fe549b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.281+0000 7fa26229eb80 1 -- 172.21.15.151:0/1074655510 shutdown_connections 2023-07-21T22:44:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.281+0000 7fa26229eb80 1 -- 172.21.15.151:0/1074655510 wait complete. 2023-07-21T22:44:50.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.281+0000 7fa26229eb80 20 client.28043 trim_cache size 0 max 16384 2023-07-21T22:44:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.296+0000 7fa26229eb80 1 Processor -- start 2023-07-21T22:44:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa26229eb80 1 -- start start 2023-07-21T22:44:50.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe554fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 0x55b5fe550480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa26229eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe547530 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa26229eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe557d70 con 0x55b5fe556210 2023-07-21T22:44:50.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa26229eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe554510 con 0x55b5fe556660 2023-07-21T22:44:50.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa247fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe554fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa2477fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa2477fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39068/0 (socket says 172.21.15.151:39068) 2023-07-21T22:44:50.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa2477fe700 1 -- 172.21.15.151:0/175599426 learned_addr learned my addr 172.21.15.151:0/175599426 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:50.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.297+0000 7fa24cf9c700 1 --2- 172.21.15.151:0/175599426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 0x55b5fe550480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.298+0000 7fa2477fe700 1 -- 172.21.15.151:0/175599426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 msgr2=0x55b5fe550480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:50.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.298+0000 7fa2477fe700 1 --2- 172.21.15.151:0/175599426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 0x55b5fe550480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.298+0000 7fa2477fe700 1 -- 172.21.15.151:0/175599426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe3ac6b0 msgr2=0x55b5fe554fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:50.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.298+0000 7fa2477fe700 1 --2- 172.21.15.151:0/175599426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe554fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.298+0000 7fa2477fe700 1 -- 172.21.15.151:0/175599426 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5fe2f61f0 con 0x55b5fe556210 2023-07-21T22:44:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.298+0000 7fa2477fe700 1 --2- 172.21.15.151:0/175599426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa23c005950 tx=0x7fa23c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf035d7550099eb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.298+0000 7fa22effd700 1 -- 172.21.15.151:0/175599426 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c022030 con 0x55b5fe556210 2023-07-21T22:44:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.298+0000 7fa22effd700 1 -- 172.21.15.151:0/175599426 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa23c023040 con 0x55b5fe556210 2023-07-21T22:44:50.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.298+0000 7fa22effd700 1 -- 172.21.15.151:0/175599426 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa23c004d80 con 0x55b5fe556210 2023-07-21T22:44:50.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 -- 172.21.15.151:0/175599426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe556210 msgr2=0x55b5fe54ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:50.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 --2- 172.21.15.151:0/175599426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fa23c005950 tx=0x7fa23c014000 comp rx=0 tx=0).stop 2023-07-21T22:44:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 -- 172.21.15.151:0/175599426 shutdown_connections 2023-07-21T22:44:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 --2- 172.21.15.151:0/175599426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556660 0x55b5fe550480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 --2- 172.21.15.151:0/175599426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe554fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 --2- 172.21.15.151:0/175599426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe556210 0x55b5fe54ff40 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 -- 172.21.15.151:0/175599426 >> 172.21.15.151:0/175599426 conn(0x55b5fe545ae0 msgr2=0x55b5fe558850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:50.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 -- 172.21.15.151:0/175599426 shutdown_connections 2023-07-21T22:44:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 -- 172.21.15.151:0/175599426 wait complete. 2023-07-21T22:44:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.299+0000 7fa26229eb80 1 -- start start 2023-07-21T22:44:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa26229eb80 1 Processor -- start 2023-07-21T22:44:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 0x55b5fe55dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa26229eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe55e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa26229eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe55e840 con 0x55b5fe556660 2023-07-21T22:44:50.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa26229eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe55e9b0 con 0x55b5fe3ac6b0 2023-07-21T22:44:50.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa26229eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5fe5bd5c0 con 0x55b5fe556210 2023-07-21T22:44:50.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa26229eb80 10 client.0 _ll_register_callbacks cb 0x7fa23c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:44:50.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa24cf9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe55e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa24cf9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe55e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36218/0 (socket says 172.21.15.151:36218) 2023-07-21T22:44:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa24cf9c700 1 -- 172.21.15.151:0/176021256 learned_addr learned my addr 172.21.15.151:0/176021256 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:44:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.300+0000 7fa2477fe700 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 0x55b5fe55dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa247fff700 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa24cf9c700 1 -- 172.21.15.151:0/176021256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 msgr2=0x55b5fe55dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa24cf9c700 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 0x55b5fe55dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa24cf9c700 1 -- 172.21.15.151:0/176021256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 msgr2=0x55b5fe55f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:44:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa24cf9c700 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa24cf9c700 1 -- 172.21.15.151:0/176021256 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa23c017070 con 0x55b5fe556660 2023-07-21T22:44:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa24cf9c700 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe55e150 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa24000b0a0 tx=0x7fa24000be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b2cb879dd5470da server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:44:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa2277fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:44:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa2277fe700 1 -- 172.21.15.151:0/176021256 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24000e040 con 0x55b5fe556660 2023-07-21T22:44:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa2277fe700 1 -- 172.21.15.151:0/176021256 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa2400076f0 con 0x55b5fe556660 2023-07-21T22:44:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.301+0000 7fa26229eb80 1 -- 172.21.15.151:0/176021256 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa23809a2a0 con 0x55b5fe556660 2023-07-21T22:44:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa2277fe700 1 -- 172.21.15.151:0/176021256 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2400078b0 con 0x55b5fe556660 2023-07-21T22:44:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa26229eb80 10 client.18378 fetch_fsmap learned FSMap version 89 2023-07-21T22:44:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa26229eb80 1 -- 172.21.15.151:0/176021256 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55b5fe2ce250 con 0x55b5fe556660 2023-07-21T22:44:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa2277fe700 1 -- 172.21.15.151:0/176021256 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa23809a2a0 con 0x55b5fe556660 2023-07-21T22:44:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa2277fe700 1 -- 172.21.15.151:0/176021256 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa24000b0d0 con 0x55b5fe556660 2023-07-21T22:44:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa26229eb80 10 client.18378 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:44:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa26229eb80 10 client.18378 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:44:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa26229eb80 20 client.18378 populate_metadata read hostname 'smithi151' 2023-07-21T22:44:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa26229eb80 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5fe5bebd0 0x55b5fe5c0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:44:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa26229eb80 4 client.18378 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:44:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.302+0000 7fa26229eb80 1 -- 172.21.15.151:0/176021256 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b5fe45cff0 con 0x55b5fe5bebd0 2023-07-21T22:44:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.303+0000 7fa247fff700 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5fe5bebd0 0x55b5fe5c0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:44:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.303+0000 7fa247fff700 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5fe5bebd0 0x55b5fe5c0fe0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b777e2556196e3b server_cookie=43f15d6ea695d9bb in_seq=0 out_seq=0 2023-07-21T22:44:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.303+0000 7fa2277fe700 10 client.18378 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:50.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa2277fe700 1 -- 172.21.15.151:0/176021256 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b5fe45cff0 con 0x55b5fe5bebd0 2023-07-21T22:44:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa2277fe700 10 client.18378 handle_command_reply: tid=0 2023-07-21T22:44:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 client.18378 shutdown 2023-07-21T22:44:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 -- 172.21.15.151:0/176021256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 msgr2=0x55b5fe55e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe55e150 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fa24000b0a0 tx=0x7fa24000be00 comp rx=0 tx=0).stop 2023-07-21T22:44:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 -- 172.21.15.151:0/176021256 shutdown_connections 2023-07-21T22:44:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5fe5bebd0 0x55b5fe5c0fe0 crc :-1 s=READY pgs=327 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5fe3ac6b0 0x55b5fe55f950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5fe556660 0x55b5fe55e150 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 --2- 172.21.15.151:0/176021256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5fe556210 0x55b5fe55dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 -- 172.21.15.151:0/176021256 >> 172.21.15.151:0/176021256 conn(0x55b5fe545ae0 msgr2=0x55b5fe558850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa2277fe700 0 client.18378 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:44:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 -- 172.21.15.151:0/176021256 shutdown_connections 2023-07-21T22:44:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 1 -- 172.21.15.151:0/176021256 wait complete. 2023-07-21T22:44:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.315+0000 7fa26229eb80 20 client.18378 trim_cache size 0 max 16384 2023-07-21T22:44:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:44:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:44:50.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:44:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:44:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 -- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2300a12c0 msgr2=0x7fa2300a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2300a12c0 0x7fa2300a3770 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa2480ff070 tx=0x7fa23c009260 comp rx=0 tx=0).stop 2023-07-21T22:44:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 -- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2480ffb30 msgr2=0x7fa24819bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:44:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2480ffb30 0x7fa24819bb80 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa23800e9a0 tx=0x7fa23800ecb0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 -- 172.21.15.151:0/3248592697 shutdown_connections 2023-07-21T22:44:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2300a12c0 0x7fa2300a3770 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa248105b60 0x7fa2481959e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2480ffb30 0x7fa24819bb80 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 --2- 172.21.15.151:0/3248592697 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2481004e0 0x7fa24819c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:44:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 -- 172.21.15.151:0/3248592697 >> 172.21.15.151:0/3248592697 conn(0x7fa2480fb5f0 msgr2=0x7fa2480fcb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:44:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 -- 172.21.15.151:0/3248592697 shutdown_connections 2023-07-21T22:44:50.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:44:50.316+0000 7fa24e9ff700 1 -- 172.21.15.151:0/3248592697 wait complete. 2023-07-21T22:44:50.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:50 smithi151 ceph-mon[95510]: pgmap v810: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:44:51.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:50 smithi187 ceph-mon[96918]: pgmap v810: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:44:51.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:50 smithi195 ceph-mon[97365]: pgmap v810: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:44:52.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:52 smithi151 ceph-mon[95510]: pgmap v811: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:44:53.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:52 smithi187 ceph-mon[96918]: pgmap v811: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:44:53.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:52 smithi195 ceph-mon[97365]: pgmap v811: 97 pgs: 97 active+clean; 8.2 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:44:54.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:54 smithi151 ceph-mon[95510]: pgmap v812: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.2 MiB/s wr, 414 op/s 2023-07-21T22:44:55.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:54 smithi187 ceph-mon[96918]: pgmap v812: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.2 MiB/s wr, 414 op/s 2023-07-21T22:44:55.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:54 smithi195 ceph-mon[97365]: pgmap v812: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 3.2 MiB/s wr, 414 op/s 2023-07-21T22:44:56.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:56 smithi151 ceph-mon[95510]: pgmap v813: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.1 MiB/s wr, 271 op/s 2023-07-21T22:44:57.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:56 smithi187 ceph-mon[96918]: pgmap v813: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.1 MiB/s wr, 271 op/s 2023-07-21T22:44:57.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:56 smithi195 ceph-mon[97365]: pgmap v813: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.1 MiB/s wr, 271 op/s 2023-07-21T22:44:58.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:44:58 smithi151 ceph-mon[95510]: pgmap v814: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 410 op/s 2023-07-21T22:44:59.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:44:58 smithi187 ceph-mon[96918]: pgmap v814: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 410 op/s 2023-07-21T22:44:59.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:44:58 smithi195 ceph-mon[97365]: pgmap v814: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.1 MiB/s wr, 410 op/s 2023-07-21T22:45:00.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:00 smithi151 ceph-mon[95510]: pgmap v815: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.1 MiB/s wr, 272 op/s 2023-07-21T22:45:01.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:00 smithi187 ceph-mon[96918]: pgmap v815: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.1 MiB/s wr, 272 op/s 2023-07-21T22:45:01.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:00 smithi195 ceph-mon[97365]: pgmap v815: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.1 MiB/s wr, 272 op/s 2023-07-21T22:45:02.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:02 smithi151 ceph-mon[95510]: pgmap v816: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.1 MiB/s wr, 272 op/s 2023-07-21T22:45:03.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:02 smithi187 ceph-mon[96918]: pgmap v816: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.1 MiB/s wr, 272 op/s 2023-07-21T22:45:03.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:02 smithi195 ceph-mon[97365]: pgmap v816: 97 pgs: 97 active+clean; 8.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.1 MiB/s wr, 272 op/s 2023-07-21T22:45:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.476+0000 7f22071ff700 1 -- 172.21.15.151:0/2741374194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 msgr2=0x7f2200105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.476+0000 7f22071ff700 1 --2- 172.21.15.151:0/2741374194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 0x7f2200105f30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f21f4009990 tx=0x7f21f4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.476+0000 7f22071ff700 1 -- 172.21.15.151:0/2741374194 shutdown_connections 2023-07-21T22:45:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.476+0000 7f22071ff700 1 --2- 172.21.15.151:0/2741374194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22001004e0 0x7f220010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.476+0000 7f22071ff700 1 --2- 172.21.15.151:0/2741374194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 0x7f2200105f30 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.476+0000 7f22071ff700 1 --2- 172.21.15.151:0/2741374194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22000ffb30 0x7f22000fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.476+0000 7f22071ff700 1 -- 172.21.15.151:0/2741374194 >> 172.21.15.151:0/2741374194 conn(0x7f22000fb5f0 msgr2=0x7f22000fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.477+0000 7f22071ff700 1 -- 172.21.15.151:0/2741374194 shutdown_connections 2023-07-21T22:45:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.477+0000 7f22071ff700 1 -- 172.21.15.151:0/2741374194 wait complete. 2023-07-21T22:45:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.478+0000 7f22071ff700 1 Processor -- start 2023-07-21T22:45:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.478+0000 7f22071ff700 1 -- start start 2023-07-21T22:45:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.478+0000 7f22071ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22000ffb30 0x7f220019b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.478+0000 7f22071ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22001004e0 0x7f220019bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.478+0000 7f22071ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 0x7f2200195880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.478+0000 7f22071ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2200195ee0 con 0x7f2200105b60 2023-07-21T22:45:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.478+0000 7f22071ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2200196050 con 0x7f22001004e0 2023-07-21T22:45:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.478+0000 7f22071ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2200196210 con 0x7f22000ffb30 2023-07-21T22:45:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f220579c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 0x7f2200195880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f21fffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22001004e0 0x7f220019bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f21fffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22001004e0 0x7f220019bef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41810/0 (socket says 172.21.15.151:41810) 2023-07-21T22:45:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f220579c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 0x7f2200195880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50292/0 (socket says 172.21.15.151:50292) 2023-07-21T22:45:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f21fffff700 1 -- 172.21.15.151:0/3823465128 learned_addr learned my addr 172.21.15.151:0/3823465128 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:03.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f2204f9b700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22000ffb30 0x7f220019b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f21fffff700 1 -- 172.21.15.151:0/3823465128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22000ffb30 msgr2=0x7f220019b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f21fffff700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22000ffb30 0x7f220019b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f21fffff700 1 -- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 msgr2=0x7f2200195880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f21fffff700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 0x7f2200195880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f21fffff700 1 -- 172.21.15.151:0/3823465128 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f40095f0 con 0x7f22001004e0 2023-07-21T22:45:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.479+0000 7f220579c700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 0x7f2200195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.480+0000 7f21fffff700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22001004e0 0x7f220019bef0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e9a0 tx=0x7f21ec00ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.480+0000 7f21fdffb700 1 -- 172.21.15.151:0/3823465128 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec009790 con 0x7f22001004e0 2023-07-21T22:45:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.480+0000 7f22071ff700 1 -- 172.21.15.151:0/3823465128 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22001964f0 con 0x7f22001004e0 2023-07-21T22:45:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.480+0000 7f21fdffb700 1 -- 172.21.15.151:0/3823465128 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21ec010430 con 0x7f22001004e0 2023-07-21T22:45:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.480+0000 7f21fdffb700 1 -- 172.21.15.151:0/3823465128 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec00cea0 con 0x7f22001004e0 2023-07-21T22:45:03.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.480+0000 7f22071ff700 1 -- 172.21.15.151:0/3823465128 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22001a29a0 con 0x7f22001004e0 2023-07-21T22:45:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.485+0000 7f21fdffb700 1 -- 172.21.15.151:0/3823465128 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f21ec0105a0 con 0x7f22001004e0 2023-07-21T22:45:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.486+0000 7f221ab4ab80 1 Processor -- start 2023-07-21T22:45:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.486+0000 7f221ab4ab80 1 -- start start 2023-07-21T22:45:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.486+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cec696b0 0x55d4cee170e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.486+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 0x55d4cee11350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.486+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 0x55d4cee118b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.486+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ced12c50 con 0x55d4cee17a70 2023-07-21T22:45:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ced659e0 con 0x55d4cec696b0 2023-07-21T22:45:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4ced5ee70 con 0x55d4cee17620 2023-07-21T22:45:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f220579c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cec696b0 0x55d4cee170e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f220579c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cec696b0 0x55d4cee170e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41812/0 (socket says 172.21.15.151:41812) 2023-07-21T22:45:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f220579c700 1 -- 172.21.15.151:0/2186896685 learned_addr learned my addr 172.21.15.151:0/2186896685 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f2204f9b700 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 0x55d4cee11350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f21fffff700 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 0x55d4cee118b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f21fdffb700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f21f00a12c0 0x7f21f00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f2204f9b700 1 -- 172.21.15.151:0/2186896685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cec696b0 msgr2=0x55d4cee170e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f2204f9b700 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cec696b0 0x55d4cee170e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f2204f9b700 1 -- 172.21.15.151:0/2186896685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 msgr2=0x55d4cee118b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f2204f9b700 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 0x55d4cee118b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f21fdffb700 1 -- 172.21.15.151:0/3823465128 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f21ec014070 con 0x7f22001004e0 2023-07-21T22:45:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f2204f9b700 1 -- 172.21.15.151:0/2186896685 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4ceb8cd80 con 0x55d4cee17620 2023-07-21T22:45:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.487+0000 7f220579c700 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cec696b0 0x55d4cee170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.488+0000 7f220579c700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f21f00a12c0 0x7f21f00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.488+0000 7f2204f9b700 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 0x55d4cee11350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21f40059d0 tx=0x7f21f4005040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1243c6d076547e28 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.488+0000 7f220579c700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f21f00a12c0 0x7f21f00a3770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009550 tx=0x7f21f800b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.488+0000 7f21eaffd700 1 -- 172.21.15.151:0/2186896685 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f401d070 con 0x55d4cee17620 2023-07-21T22:45:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.488+0000 7f21eaffd700 1 -- 172.21.15.151:0/2186896685 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21f401e040 con 0x55d4cee17620 2023-07-21T22:45:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.488+0000 7f21eaffd700 1 -- 172.21.15.151:0/2186896685 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4004830 con 0x55d4cee17620 2023-07-21T22:45:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.489+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2186896685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 msgr2=0x55d4cee11350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.489+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 0x55d4cee11350 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f21f40059d0 tx=0x7f21f4005040 comp rx=0 tx=0).stop 2023-07-21T22:45:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.489+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2186896685 shutdown_connections 2023-07-21T22:45:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.489+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cec696b0 0x55d4cee170e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.489+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 0x55d4cee118b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.489+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2186896685 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 0x55d4cee11350 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.489+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2186896685 >> 172.21.15.151:0/2186896685 conn(0x55d4cee02ae0 msgr2=0x55d4cee080e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.489+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2186896685 shutdown_connections 2023-07-21T22:45:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.489+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2186896685 wait complete. 2023-07-21T22:45:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.490+0000 7f221ab4ab80 1 -- start start 2023-07-21T22:45:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.490+0000 7f221ab4ab80 1 Processor -- start 2023-07-21T22:45:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee20890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17620 0x55d4cee20dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 0x55d4cee1aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cecfea60 con 0x55d4cee17620 2023-07-21T22:45:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cecfe760 con 0x55d4cee17a70 2023-07-21T22:45:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cebe28c0 con 0x55d4cec696b0 2023-07-21T22:45:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f221ab4ab80 10 client.0 _ll_register_callbacks cb 0x55d4cecfc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f21fffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17620 0x55d4cee20dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f2204f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee20890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f2204f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee20890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38272/0 (socket says 172.21.15.151:38272) 2023-07-21T22:45:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f2204f9b700 1 -- 172.21.15.151:0/3791306038 learned_addr learned my addr 172.21.15.151:0/3791306038 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.491+0000 7f220579c700 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 0x55d4cee1aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21fffff700 1 -- 172.21.15.151:0/3791306038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 msgr2=0x55d4cee20890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21fffff700 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee20890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21fffff700 1 -- 172.21.15.151:0/3791306038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 msgr2=0x55d4cee1aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21fffff700 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 0x55d4cee1aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21fffff700 1 -- 172.21.15.151:0/3791306038 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f8007500 con 0x55d4cee17620 2023-07-21T22:45:03.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21fffff700 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17620 0x55d4cee20dd0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0ca6c0 tx=0x7f21ec0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb8bcb2d3f63d138 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21dffff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:45:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21dffff700 1 -- 172.21.15.151:0/3791306038 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0999a0 con 0x55d4cee17620 2023-07-21T22:45:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f221ab4ab80 1 -- 172.21.15.151:0/3791306038 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4cecb8490 con 0x55d4cee17620 2023-07-21T22:45:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21dffff700 1 -- 172.21.15.151:0/3791306038 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f21ec010880 con 0x55d4cee17620 2023-07-21T22:45:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f21dffff700 1 -- 172.21.15.151:0/3791306038 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21ec09a040 con 0x55d4cee17620 2023-07-21T22:45:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f221ab4ab80 10 client.18390 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.492+0000 7f221ab4ab80 1 -- 172.21.15.151:0/3791306038 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x7f220010d220 con 0x55d4cee17620 2023-07-21T22:45:03.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.493+0000 7f21dffff700 1 -- 172.21.15.151:0/3791306038 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d4cecb8490 con 0x55d4cee17620 2023-07-21T22:45:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.493+0000 7f21dffff700 1 -- 172.21.15.151:0/3791306038 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f21ec095e30 con 0x55d4cee17620 2023-07-21T22:45:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.493+0000 7f221ab4ab80 10 client.18390 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.493+0000 7f221ab4ab80 10 client.18390 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.493+0000 7f221ab4ab80 20 client.18390 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.493+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d4cee2ad10 0x55d4cee2d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.493+0000 7f221ab4ab80 4 client.18390 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:45:03.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.493+0000 7f221ab4ab80 1 -- 172.21.15.151:0/3791306038 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4ced57e50 con 0x55d4cee2ad10 2023-07-21T22:45:03.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.493+0000 7f2204f9b700 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d4cee2ad10 0x55d4cee2d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.494+0000 7f2204f9b700 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d4cee2ad10 0x55d4cee2d120 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45271b288034e0bd server_cookie=7121cf4100d5e814 in_seq=0 out_seq=0 2023-07-21T22:45:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.494+0000 7f21dffff700 10 client.18390 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f21dffff700 1 -- 172.21.15.151:0/3791306038 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d4ced57e50 con 0x55d4cee2ad10 2023-07-21T22:45:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f21dffff700 10 client.18390 handle_command_reply: tid=0 2023-07-21T22:45:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 client.18390 shutdown 2023-07-21T22:45:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 -- 172.21.15.151:0/3791306038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17620 msgr2=0x55d4cee20dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:03.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17620 0x55d4cee20dd0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f21ec0ca6c0 tx=0x7f21ec0092d0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 -- 172.21.15.151:0/3791306038 shutdown_connections 2023-07-21T22:45:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d4cee2ad10 0x55d4cee2d120 crc :-1 s=READY pgs=328 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 0x55d4cee1aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee20890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/3791306038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17620 0x55d4cee20dd0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 -- 172.21.15.151:0/3791306038 >> 172.21.15.151:0/3791306038 conn(0x55d4cee02ae0 msgr2=0x55d4cee073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f21dffff700 0 client.18390 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:03.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 -- 172.21.15.151:0/3791306038 shutdown_connections 2023-07-21T22:45:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.495+0000 7f221ab4ab80 1 -- 172.21.15.151:0/3791306038 wait complete. 2023-07-21T22:45:03.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.496+0000 7f221ab4ab80 20 client.18390 trim_cache size 0 max 16384 2023-07-21T22:45:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.512+0000 7f221ab4ab80 1 Processor -- start 2023-07-21T22:45:03.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.512+0000 7f221ab4ab80 1 -- start start 2023-07-21T22:45:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee17e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17620 0x55d4cee18380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 0x55d4cee13b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cee170e0 con 0x55d4cee17a70 2023-07-21T22:45:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cee1af40 con 0x55d4cee17620 2023-07-21T22:45:03.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cee12570 con 0x55d4cec696b0 2023-07-21T22:45:03.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f21fffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17620 0x55d4cee18380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f220579c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 0x55d4cee13b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f2204f9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee17e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f21fffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17620 0x55d4cee18380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41834/0 (socket says 172.21.15.151:41834) 2023-07-21T22:45:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f21fffff700 1 -- 172.21.15.151:0/1127559629 learned_addr learned my addr 172.21.15.151:0/1127559629 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f21fffff700 1 -- 172.21.15.151:0/1127559629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 msgr2=0x55d4cee17e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:03.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f21fffff700 1 --2- 172.21.15.151:0/1127559629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee17e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f21fffff700 1 -- 172.21.15.151:0/1127559629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 msgr2=0x55d4cee13b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f21fffff700 1 --2- 172.21.15.151:0/1127559629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 0x55d4cee13b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.513+0000 7f21fffff700 1 -- 172.21.15.151:0/1127559629 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d4cee1a650 con 0x55d4cee17620 2023-07-21T22:45:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.514+0000 7f2204f9b700 1 --2- 172.21.15.151:0/1127559629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee17e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.514+0000 7f21fffff700 1 --2- 172.21.15.151:0/1127559629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17620 0x55d4cee18380 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e970 tx=0x7f21ec09a580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6788536cb041d33 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.514+0000 7f21eb7fe700 1 -- 172.21.15.151:0/1127559629 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0961b0 con 0x55d4cee17620 2023-07-21T22:45:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.514+0000 7f21eb7fe700 1 -- 172.21.15.151:0/1127559629 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21ec010880 con 0x55d4cee17620 2023-07-21T22:45:03.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.514+0000 7f21eb7fe700 1 -- 172.21.15.151:0/1127559629 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ec0a2260 con 0x55d4cee17620 2023-07-21T22:45:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 -- 172.21.15.151:0/1127559629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17620 msgr2=0x55d4cee18380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/1127559629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17620 0x55d4cee18380 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e970 tx=0x7f21ec09a580 comp rx=0 tx=0).stop 2023-07-21T22:45:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 -- 172.21.15.151:0/1127559629 shutdown_connections 2023-07-21T22:45:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/1127559629 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cee17a70 0x55d4cee13b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/1127559629 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cec696b0 0x55d4cee17e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/1127559629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17620 0x55d4cee18380 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 -- 172.21.15.151:0/1127559629 >> 172.21.15.151:0/1127559629 conn(0x55d4cee02ae0 msgr2=0x55d4cee07cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:03.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 -- 172.21.15.151:0/1127559629 shutdown_connections 2023-07-21T22:45:03.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 -- 172.21.15.151:0/1127559629 wait complete. 2023-07-21T22:45:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.515+0000 7f221ab4ab80 1 -- start start 2023-07-21T22:45:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f221ab4ab80 1 Processor -- start 2023-07-21T22:45:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cec696b0 0x55d4cee1e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 0x55d4cee1eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f221ab4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 0x55d4cee7db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cee1f420 con 0x55d4cec696b0 2023-07-21T22:45:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cee7e0d0 con 0x55d4cee17a70 2023-07-21T22:45:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f221ab4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4cee7e210 con 0x55d4cee17620 2023-07-21T22:45:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f221ab4ab80 10 client.0 _ll_register_callbacks cb 0x55d4cecfc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f2204f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cec696b0 0x55d4cee1e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f2204f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cec696b0 0x55d4cee1e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50318/0 (socket says 172.21.15.151:50318) 2023-07-21T22:45:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.516+0000 7f2204f9b700 1 -- 172.21.15.151:0/2364549412 learned_addr learned my addr 172.21.15.151:0/2364549412 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:03.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f21fffff700 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 0x55d4cee1eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f220579c700 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 0x55d4cee7db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f2204f9b700 1 -- 172.21.15.151:0/2364549412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 msgr2=0x55d4cee1eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f2204f9b700 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 0x55d4cee1eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f2204f9b700 1 -- 172.21.15.151:0/2364549412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 msgr2=0x55d4cee7db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f2204f9b700 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 0x55d4cee7db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f2204f9b700 1 -- 172.21.15.151:0/2364549412 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4ceb8cd80 con 0x55d4cec696b0 2023-07-21T22:45:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f2204f9b700 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cec696b0 0x55d4cee1e600 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f21f4005850 tx=0x7f21f4005480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a058ac8dba05c0a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:03.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f21dffff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:45:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.517+0000 7f21dffff700 1 -- 172.21.15.151:0/2364549412 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f4032070 con 0x55d4cec696b0 2023-07-21T22:45:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2364549412 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f21f401e040 con 0x55d4cec696b0 2023-07-21T22:45:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f21dffff700 1 -- 172.21.15.151:0/2364549412 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(126..126 src has 1..126) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f21f4033480 con 0x55d4cec696b0 2023-07-21T22:45:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f21dffff700 1 -- 172.21.15.151:0/2364549412 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21f401d040 con 0x55d4cec696b0 2023-07-21T22:45:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f221ab4ab80 10 client.18396 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2364549412 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x7f220010d220 con 0x55d4cec696b0 2023-07-21T22:45:03.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f21dffff700 1 -- 172.21.15.151:0/2364549412 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f21f401e040 con 0x55d4cec696b0 2023-07-21T22:45:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f21dffff700 1 -- 172.21.15.151:0/2364549412 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f21f4033b60 con 0x55d4cec696b0 2023-07-21T22:45:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f221ab4ab80 10 client.18396 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f221ab4ab80 10 client.18396 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f221ab4ab80 20 client.18396 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.518+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d4cee7f4c0 0x55d4cee818a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.519+0000 7f221ab4ab80 4 client.18396 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:45:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.519+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2364549412 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d4ced19ff0 con 0x55d4cee7f4c0 2023-07-21T22:45:03.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.519+0000 7f21fffff700 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d4cee7f4c0 0x55d4cee818a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.519+0000 7f21fffff700 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d4cee7f4c0 0x55d4cee818a0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=596e2e05bb67c211 server_cookie=eba63cbf2f271010 in_seq=0 out_seq=0 2023-07-21T22:45:03.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.519+0000 7f21dffff700 10 client.18396 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f21dffff700 1 -- 172.21.15.151:0/2364549412 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d4ced19ff0 con 0x55d4cee7f4c0 2023-07-21T22:45:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f21dffff700 10 client.18396 handle_command_reply: tid=0 2023-07-21T22:45:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 client.18396 shutdown 2023-07-21T22:45:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2364549412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cec696b0 msgr2=0x55d4cee1e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cec696b0 0x55d4cee1e600 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f21f4005850 tx=0x7f21f4005480 comp rx=0 tx=0).stop 2023-07-21T22:45:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2364549412 shutdown_connections 2023-07-21T22:45:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d4cee7f4c0 0x55d4cee818a0 crc :-1 s=READY pgs=329 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d4cee17a70 0x55d4cee7db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f21dffff700 0 client.18396 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d4cec696b0 0x55d4cee1e600 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 --2- 172.21.15.151:0/2364549412 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d4cee17620 0x55d4cee1eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2364549412 >> 172.21.15.151:0/2364549412 conn(0x55d4cee02ae0 msgr2=0x55d4cee17e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2364549412 shutdown_connections 2023-07-21T22:45:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.653+0000 7f221ab4ab80 1 -- 172.21.15.151:0/2364549412 wait complete. 2023-07-21T22:45:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f221ab4ab80 20 client.18396 trim_cache size 0 max 16384 2023-07-21T22:45:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:45:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:45:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:45:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:45:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 -- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f21f00a12c0 msgr2=0x7f21f00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f21f00a12c0 0x7f21f00a3770 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009550 tx=0x7f21f800b040 comp rx=0 tx=0).stop 2023-07-21T22:45:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 -- 172.21.15.151:0/3823465128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22001004e0 msgr2=0x7f220019bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22001004e0 0x7f220019bef0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f21ec00e9a0 tx=0x7f21ec00ecb0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 -- 172.21.15.151:0/3823465128 shutdown_connections 2023-07-21T22:45:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f21f00a12c0 0x7f21f00a3770 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2200105b60 0x7f2200195880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22000ffb30 0x7f220019b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 --2- 172.21.15.151:0/3823465128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22001004e0 0x7f220019bef0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.654+0000 7f22071ff700 1 -- 172.21.15.151:0/3823465128 >> 172.21.15.151:0/3823465128 conn(0x7f22000fb5f0 msgr2=0x7f22000fcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.655+0000 7f22071ff700 1 -- 172.21.15.151:0/3823465128 shutdown_connections 2023-07-21T22:45:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:03.655+0000 7f22071ff700 1 -- 172.21.15.151:0/3823465128 wait complete. 2023-07-21T22:45:05.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:04 smithi187 ceph-mon[96918]: pgmap v817: 97 pgs: 97 active+clean; 8.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.2 MiB/s wr, 432 op/s 2023-07-21T22:45:05.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:04 smithi195 ceph-mon[97365]: pgmap v817: 97 pgs: 97 active+clean; 8.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.2 MiB/s wr, 432 op/s 2023-07-21T22:45:05.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:04 smithi151 ceph-mon[95510]: pgmap v817: 97 pgs: 97 active+clean; 8.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.2 MiB/s wr, 432 op/s 2023-07-21T22:45:06.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:05 smithi187 ceph-mon[96918]: osdmap e127: 12 total, 12 up, 12 in 2023-07-21T22:45:06.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:05 smithi187 ceph-mon[96918]: pgmap v819: 97 pgs: 97 active+clean; 8.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.7 MiB/s wr, 358 op/s 2023-07-21T22:45:06.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:05 smithi195 ceph-mon[97365]: osdmap e127: 12 total, 12 up, 12 in 2023-07-21T22:45:06.152 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:05 smithi195 ceph-mon[97365]: pgmap v819: 97 pgs: 97 active+clean; 8.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.7 MiB/s wr, 358 op/s 2023-07-21T22:45:06.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:05 smithi151 ceph-mon[95510]: osdmap e127: 12 total, 12 up, 12 in 2023-07-21T22:45:06.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:05 smithi151 ceph-mon[95510]: pgmap v819: 97 pgs: 97 active+clean; 8.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.7 MiB/s wr, 358 op/s 2023-07-21T22:45:08.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:08 smithi195 ceph-mon[97365]: pgmap v820: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 348 op/s 2023-07-21T22:45:08.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:08 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:45:08.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:08 smithi151 ceph-mon[95510]: pgmap v820: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 348 op/s 2023-07-21T22:45:08.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:08 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:45:09.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:08 smithi187 ceph-mon[96918]: pgmap v820: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 348 op/s 2023-07-21T22:45:09.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:08 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:45:09.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:09 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:45:09.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:09 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:45:09.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:09 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:45:09.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:09 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:45:09.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:09 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:45:09.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:09 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:45:10.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:09 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:45:10.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:09 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:45:10.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:09 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:45:10.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:10 smithi195 ceph-mon[97365]: pgmap v821: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 348 op/s 2023-07-21T22:45:10.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:10 smithi151 ceph-mon[95510]: pgmap v821: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 348 op/s 2023-07-21T22:45:11.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:10 smithi187 ceph-mon[96918]: pgmap v821: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 348 op/s 2023-07-21T22:45:12.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:12 smithi195 ceph-mon[97365]: pgmap v822: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 348 op/s 2023-07-21T22:45:12.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:12 smithi195 ceph-mon[97365]: osdmap e128: 12 total, 12 up, 12 in 2023-07-21T22:45:12.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:12 smithi151 ceph-mon[95510]: pgmap v822: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 348 op/s 2023-07-21T22:45:12.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:12 smithi151 ceph-mon[95510]: osdmap e128: 12 total, 12 up, 12 in 2023-07-21T22:45:13.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:12 smithi187 ceph-mon[96918]: pgmap v822: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 2.6 MiB/s wr, 348 op/s 2023-07-21T22:45:13.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:12 smithi187 ceph-mon[96918]: osdmap e128: 12 total, 12 up, 12 in 2023-07-21T22:45:14.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:14 smithi195 ceph-mon[97365]: pgmap v824: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:45:14.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:14 smithi151 ceph-mon[95510]: pgmap v824: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:45:15.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:14 smithi187 ceph-mon[96918]: pgmap v824: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.7 MiB/s wr, 350 op/s 2023-07-21T22:45:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.828+0000 7ff8335ff700 1 -- 172.21.15.151:0/1410144804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c104e50 msgr2=0x7ff82c10ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.828+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1410144804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c104e50 0x7ff82c10ca00 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff82400b0d0 tx=0x7ff82400b3e0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.829+0000 7ff8335ff700 1 -- 172.21.15.151:0/1410144804 shutdown_connections 2023-07-21T22:45:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.829+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1410144804 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c104e50 0x7ff82c10ca00 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.829+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1410144804 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff82c067c10 0x7ff82c067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.829+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1410144804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff82c0685b0 0x7ff82c104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.829+0000 7ff8335ff700 1 -- 172.21.15.151:0/1410144804 >> 172.21.15.151:0/1410144804 conn(0x7ff82c074760 msgr2=0x7ff82c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.829+0000 7ff8335ff700 1 -- 172.21.15.151:0/1410144804 shutdown_connections 2023-07-21T22:45:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.829+0000 7ff8335ff700 1 -- 172.21.15.151:0/1410144804 wait complete. 2023-07-21T22:45:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.830+0000 7ff8335ff700 1 Processor -- start 2023-07-21T22:45:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.831+0000 7ff8335ff700 1 -- start start 2023-07-21T22:45:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.831+0000 7ff8335ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff82c067c10 0x7ff82c10b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.831+0000 7ff8335ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c0685b0 0x7ff82c10be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.831+0000 7ff8335ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff82c104e50 0x7ff82c1a0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.831+0000 7ff8335ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c1a1390 con 0x7ff82c104e50 2023-07-21T22:45:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.831+0000 7ff8335ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c1a1500 con 0x7ff82c0685b0 2023-07-21T22:45:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.831+0000 7ff8335ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff82c1a16c0 con 0x7ff82c067c10 2023-07-21T22:45:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.831+0000 7ff830b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c0685b0 0x7ff82c10be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff830b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c0685b0 0x7ff82c10be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36628/0 (socket says 172.21.15.151:36628) 2023-07-21T22:45:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff830b9a700 1 -- 172.21.15.151:0/1194482494 learned_addr learned my addr 172.21.15.151:0/1194482494 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff83139b700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff82c067c10 0x7ff82c10b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff831b9c700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff82c104e50 0x7ff82c1a0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff830b9a700 1 -- 172.21.15.151:0/1194482494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff82c067c10 msgr2=0x7ff82c10b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff830b9a700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff82c067c10 0x7ff82c10b910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff830b9a700 1 -- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff82c104e50 msgr2=0x7ff82c1a0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff830b9a700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff82c104e50 0x7ff82c1a0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff830b9a700 1 -- 172.21.15.151:0/1194482494 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff824009d00 con 0x7ff82c0685b0 2023-07-21T22:45:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff830b9a700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c0685b0 0x7ff82c10be50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00e940 tx=0x7ff81c00ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.832+0000 7ff8227fc700 1 -- 172.21.15.151:0/1194482494 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c009730 con 0x7ff82c0685b0 2023-07-21T22:45:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.833+0000 7ff8335ff700 1 -- 172.21.15.151:0/1194482494 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff82c1a19a0 con 0x7ff82c0685b0 2023-07-21T22:45:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.833+0000 7ff8227fc700 1 -- 172.21.15.151:0/1194482494 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff81c00ce70 con 0x7ff82c0685b0 2023-07-21T22:45:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.833+0000 7ff8227fc700 1 -- 172.21.15.151:0/1194482494 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c018420 con 0x7ff82c0685b0 2023-07-21T22:45:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.833+0000 7ff8335ff700 1 -- 172.21.15.151:0/1194482494 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c1a91e0 con 0x7ff82c0685b0 2023-07-21T22:45:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.836+0000 7ff8227fc700 1 -- 172.21.15.151:0/1194482494 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff81c00c9e0 con 0x7ff82c0685b0 2023-07-21T22:45:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.837+0000 7ff846f4fb80 1 Processor -- start 2023-07-21T22:45:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff8227fc700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8180a1340 0x7ff8180a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff846f4fb80 1 -- start start 2023-07-21T22:45:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff8227fc700 1 -- 172.21.15.151:0/1194482494 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff81c014070 con 0x7ff82c0685b0 2023-07-21T22:45:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff831b9c700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8180a1340 0x7ff8180a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea400ed6b0 0x55ea40296cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40297210 0x55ea40290f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297660 0x55ea402914a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea40196c50 con 0x55ea400ed6b0 2023-07-21T22:45:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea401e99e0 con 0x55ea40297210 2023-07-21T22:45:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.838+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea401e2e70 con 0x55ea40297660 2023-07-21T22:45:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff83139b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea400ed6b0 0x55ea40296cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff83139b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea400ed6b0 0x55ea40296cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46906/0 (socket says 172.21.15.151:46906) 2023-07-21T22:45:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff83139b700 1 -- 172.21.15.151:0/2611651053 learned_addr learned my addr 172.21.15.151:0/2611651053 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff830b9a700 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40297210 0x55ea40290f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff831b9c700 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297660 0x55ea402914a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff830b9a700 1 -- 172.21.15.151:0/2611651053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297660 msgr2=0x55ea402914a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff830b9a700 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297660 0x55ea402914a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff830b9a700 1 -- 172.21.15.151:0/2611651053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea400ed6b0 msgr2=0x55ea40296cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff830b9a700 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea400ed6b0 0x55ea40296cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff831b9c700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8180a1340 0x7ff8180a37f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff8240062a0 tx=0x7ff82400b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff830b9a700 1 -- 172.21.15.151:0/2611651053 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea40010d80 con 0x55ea40297210 2023-07-21T22:45:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff83139b700 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea400ed6b0 0x55ea40296cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.839+0000 7ff830b9a700 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40297210 0x55ea40290f40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0ca520 tx=0x7ff81c099800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac5bde78d5a1e5f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.840+0000 7ff8177fe700 1 -- 172.21.15.151:0/2611651053 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c099ea0 con 0x55ea40297210 2023-07-21T22:45:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.840+0000 7ff8177fe700 1 -- 172.21.15.151:0/2611651053 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff81c09ded0 con 0x55ea40297210 2023-07-21T22:45:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.840+0000 7ff8177fe700 1 -- 172.21.15.151:0/2611651053 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c099390 con 0x55ea40297210 2023-07-21T22:45:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.840+0000 7ff846f4fb80 1 -- 172.21.15.151:0/2611651053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40297210 msgr2=0x55ea40290f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.840+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40297210 0x55ea40290f40 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff81c0ca520 tx=0x7ff81c099800 comp rx=0 tx=0).stop 2023-07-21T22:45:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.841+0000 7ff846f4fb80 1 -- 172.21.15.151:0/2611651053 shutdown_connections 2023-07-21T22:45:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.841+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297660 0x55ea402914a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.841+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea400ed6b0 0x55ea40296cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.841+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/2611651053 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40297210 0x55ea40290f40 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.841+0000 7ff846f4fb80 1 -- 172.21.15.151:0/2611651053 >> 172.21.15.151:0/2611651053 conn(0x55ea40286ae0 msgr2=0x55ea4028c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.841+0000 7ff846f4fb80 1 -- 172.21.15.151:0/2611651053 shutdown_connections 2023-07-21T22:45:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.841+0000 7ff846f4fb80 1 -- 172.21.15.151:0/2611651053 wait complete. 2023-07-21T22:45:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.841+0000 7ff846f4fb80 1 -- start start 2023-07-21T22:45:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff846f4fb80 1 Processor -- start 2023-07-21T22:45:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea400ed6b0 0x55ea4029d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297210 0x55ea4029a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297660 0x55ea4029af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea40182a60 con 0x55ea40297660 2023-07-21T22:45:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea40182760 con 0x55ea400ed6b0 2023-07-21T22:45:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea400668c0 con 0x55ea40297210 2023-07-21T22:45:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff846f4fb80 10 client.0 _ll_register_callbacks cb 0x55ea40180700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff83139b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea400ed6b0 0x55ea4029d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff83139b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea400ed6b0 0x55ea4029d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36640/0 (socket says 172.21.15.151:36640) 2023-07-21T22:45:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.842+0000 7ff83139b700 1 -- 172.21.15.151:0/62240451 learned_addr learned my addr 172.21.15.151:0/62240451 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff830b9a700 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297210 0x55ea4029a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff831b9c700 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297660 0x55ea4029af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff83139b700 1 -- 172.21.15.151:0/62240451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297210 msgr2=0x55ea4029a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff83139b700 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297210 0x55ea4029a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff83139b700 1 -- 172.21.15.151:0/62240451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297660 msgr2=0x55ea4029af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff83139b700 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297660 0x55ea4029af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff83139b700 1 -- 172.21.15.151:0/62240451 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8280099e0 con 0x55ea400ed6b0 2023-07-21T22:45:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff830b9a700 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297210 0x55ea4029a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff83139b700 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea400ed6b0 0x55ea4029d5c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff828012a10 tx=0x7ff828012d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b19dec23a77f3024 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.843+0000 7ff814ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:45:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.844+0000 7ff814ff9700 1 -- 172.21.15.151:0/62240451 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828017070 con 0x55ea400ed6b0 2023-07-21T22:45:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.844+0000 7ff814ff9700 1 -- 172.21.15.151:0/62240451 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff828004050 con 0x55ea400ed6b0 2023-07-21T22:45:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.844+0000 7ff846f4fb80 1 -- 172.21.15.151:0/62240451 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea4013c490 con 0x55ea400ed6b0 2023-07-21T22:45:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.844+0000 7ff814ff9700 1 -- 172.21.15.151:0/62240451 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff828004210 con 0x55ea400ed6b0 2023-07-21T22:45:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.844+0000 7ff846f4fb80 10 client.28079 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.844+0000 7ff846f4fb80 1 -- 172.21.15.151:0/62240451 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x7ff82c1a91e0 con 0x55ea400ed6b0 2023-07-21T22:45:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.844+0000 7ff814ff9700 1 -- 172.21.15.151:0/62240451 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ea4013c490 con 0x55ea400ed6b0 2023-07-21T22:45:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.844+0000 7ff814ff9700 1 -- 172.21.15.151:0/62240451 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff828003710 con 0x55ea400ed6b0 2023-07-21T22:45:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.845+0000 7ff846f4fb80 10 client.28079 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.845+0000 7ff846f4fb80 10 client.28079 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.845+0000 7ff846f4fb80 20 client.28079 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.845+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea402aaab0 0x55ea402acec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.845+0000 7ff846f4fb80 4 client.28079 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:45:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.845+0000 7ff846f4fb80 1 -- 172.21.15.151:0/62240451 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea401dbe50 con 0x55ea402aaab0 2023-07-21T22:45:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.845+0000 7ff830b9a700 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea402aaab0 0x55ea402acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.845+0000 7ff830b9a700 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea402aaab0 0x55ea402acec0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a12e073ba5043c38 server_cookie=9103ab07cb96e89b in_seq=0 out_seq=0 2023-07-21T22:45:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.845+0000 7ff814ff9700 10 client.28079 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.846+0000 7ff814ff9700 1 -- 172.21.15.151:0/62240451 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ea401dbe50 con 0x55ea402aaab0 2023-07-21T22:45:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.846+0000 7ff814ff9700 10 client.28079 handle_command_reply: tid=0 2023-07-21T22:45:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.846+0000 7ff846f4fb80 1 client.28079 shutdown 2023-07-21T22:45:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.846+0000 7ff846f4fb80 1 -- 172.21.15.151:0/62240451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea400ed6b0 msgr2=0x55ea4029d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.846+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea400ed6b0 0x55ea4029d5c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7ff828012a10 tx=0x7ff828012d20 comp rx=0 tx=0).stop 2023-07-21T22:45:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff846f4fb80 1 -- 172.21.15.151:0/62240451 shutdown_connections 2023-07-21T22:45:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea402aaab0 0x55ea402acec0 crc :-1 s=READY pgs=330 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea400ed6b0 0x55ea4029d5c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff814ff9700 0 client.28079 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297660 0x55ea4029af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/62240451 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea40297210 0x55ea4029a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff846f4fb80 1 -- 172.21.15.151:0/62240451 >> 172.21.15.151:0/62240451 conn(0x55ea40286ae0 msgr2=0x55ea4028b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff846f4fb80 1 -- 172.21.15.151:0/62240451 shutdown_connections 2023-07-21T22:45:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff846f4fb80 1 -- 172.21.15.151:0/62240451 wait complete. 2023-07-21T22:45:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.847+0000 7ff846f4fb80 20 client.28079 trim_cache size 0 max 16384 2023-07-21T22:45:16.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:16 smithi195 ceph-mon[97365]: pgmap v825: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.3 MiB/s wr, 300 op/s 2023-07-21T22:45:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.867+0000 7ff846f4fb80 1 Processor -- start 2023-07-21T22:45:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.867+0000 7ff846f4fb80 1 -- start start 2023-07-21T22:45:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.867+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea402a1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.867+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 0x55ea4029a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.867+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea402981b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.867+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea40288c00 con 0x55ea40297210 2023-07-21T22:45:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.867+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea40291f20 con 0x55ea40286ae0 2023-07-21T22:45:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.867+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea4029b7c0 con 0x55ea400ed6b0 2023-07-21T22:45:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff831b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea402981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff831b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea402981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46924/0 (socket says 172.21.15.151:46924) 2023-07-21T22:45:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff831b9c700 1 -- 172.21.15.151:0/544156396 learned_addr learned my addr 172.21.15.151:0/544156396 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff83139b700 1 --2- 172.21.15.151:0/544156396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea402a1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff830b9a700 1 --2- 172.21.15.151:0/544156396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 0x55ea4029a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff831b9c700 1 -- 172.21.15.151:0/544156396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 msgr2=0x55ea4029a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff831b9c700 1 --2- 172.21.15.151:0/544156396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 0x55ea4029a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff831b9c700 1 -- 172.21.15.151:0/544156396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 msgr2=0x55ea402a1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff831b9c700 1 --2- 172.21.15.151:0/544156396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea402a1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff831b9c700 1 -- 172.21.15.151:0/544156396 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea3fff9c00 con 0x55ea40297210 2023-07-21T22:45:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.868+0000 7ff831b9c700 1 --2- 172.21.15.151:0/544156396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea402981b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff824007530 tx=0x7ff82401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a78168cb240ae4b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.869+0000 7ff817fff700 1 -- 172.21.15.151:0/544156396 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82400e040 con 0x55ea40297210 2023-07-21T22:45:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.869+0000 7ff817fff700 1 -- 172.21.15.151:0/544156396 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff824003e90 con 0x55ea40297210 2023-07-21T22:45:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.869+0000 7ff817fff700 1 -- 172.21.15.151:0/544156396 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824005970 con 0x55ea40297210 2023-07-21T22:45:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 -- 172.21.15.151:0/544156396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 msgr2=0x55ea402981b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/544156396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea402981b0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff824007530 tx=0x7ff82401c000 comp rx=0 tx=0).stop 2023-07-21T22:45:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 -- 172.21.15.151:0/544156396 shutdown_connections 2023-07-21T22:45:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/544156396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea402a1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/544156396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea402981b0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/544156396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 0x55ea4029a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 -- 172.21.15.151:0/544156396 >> 172.21.15.151:0/544156396 conn(0x55ea402a7120 msgr2=0x55ea40297aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 -- 172.21.15.151:0/544156396 shutdown_connections 2023-07-21T22:45:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 -- 172.21.15.151:0/544156396 wait complete. 2023-07-21T22:45:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.870+0000 7ff846f4fb80 1 -- start start 2023-07-21T22:45:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff846f4fb80 1 Processor -- start 2023-07-21T22:45:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 0x55ea402a1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea4029e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff846f4fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea4029e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea4029edb0 con 0x55ea40297210 2023-07-21T22:45:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea4029ef20 con 0x55ea40286ae0 2023-07-21T22:45:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff846f4fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea402fe970 con 0x55ea400ed6b0 2023-07-21T22:45:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff846f4fb80 10 client.0 _ll_register_callbacks cb 0x7ff8280124e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff830b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea4029e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.871+0000 7ff83139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 0x55ea402a1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff830b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea4029e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36668/0 (socket says 172.21.15.151:36668) 2023-07-21T22:45:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff830b9a700 1 -- 172.21.15.151:0/886604618 learned_addr learned my addr 172.21.15.151:0/886604618 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff83139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 0x55ea402a1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58346/0 (socket says 172.21.15.151:58346) 2023-07-21T22:45:16.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff831b9c700 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea4029e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff830b9a700 1 -- 172.21.15.151:0/886604618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 msgr2=0x55ea402a1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff830b9a700 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 0x55ea402a1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff830b9a700 1 -- 172.21.15.151:0/886604618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 msgr2=0x55ea4029e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:16.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff830b9a700 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea4029e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff830b9a700 1 -- 172.21.15.151:0/886604618 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff82c10d210 con 0x55ea40286ae0 2023-07-21T22:45:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff830b9a700 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea4029e160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00e910 tx=0x7ff81c010f80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62433e2cd042eec server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:16.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff814ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:45:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.872+0000 7ff814ff9700 1 -- 172.21.15.151:0/886604618 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff81c0a22f0 con 0x55ea40286ae0 2023-07-21T22:45:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff814ff9700 1 -- 172.21.15.151:0/886604618 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff81c0b8030 con 0x55ea40286ae0 2023-07-21T22:45:16.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff846f4fb80 1 -- 172.21.15.151:0/886604618 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff81c09ded0 con 0x55ea40286ae0 2023-07-21T22:45:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff814ff9700 1 -- 172.21.15.151:0/886604618 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff81c098240 con 0x55ea40286ae0 2023-07-21T22:45:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff846f4fb80 10 client.28085 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:16.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff846f4fb80 1 -- 172.21.15.151:0/886604618 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55ea400371f0 con 0x55ea40286ae0 2023-07-21T22:45:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff814ff9700 1 -- 172.21.15.151:0/886604618 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff81c09ded0 con 0x55ea40286ae0 2023-07-21T22:45:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff814ff9700 1 -- 172.21.15.151:0/886604618 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff81c0a1ed0 con 0x55ea40286ae0 2023-07-21T22:45:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff846f4fb80 10 client.28085 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff846f4fb80 10 client.28085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff846f4fb80 20 client.28085 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea40297660 0x55ea40301d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff846f4fb80 4 client.28085 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:45:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.873+0000 7ff846f4fb80 1 -- 172.21.15.151:0/886604618 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ea4019dff0 con 0x55ea40297660 2023-07-21T22:45:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.874+0000 7ff83139b700 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea40297660 0x55ea40301d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.874+0000 7ff83139b700 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea40297660 0x55ea40301d50 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8fe7ab7f25f1042 server_cookie=a5d30e14ef39885b in_seq=0 out_seq=0 2023-07-21T22:45:16.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.874+0000 7ff814ff9700 10 client.28085 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff814ff9700 1 -- 172.21.15.151:0/886604618 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ea4019dff0 con 0x55ea40297660 2023-07-21T22:45:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff814ff9700 10 client.28085 handle_command_reply: tid=0 2023-07-21T22:45:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 client.28085 shutdown 2023-07-21T22:45:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 -- 172.21.15.151:0/886604618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 msgr2=0x55ea4029e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea4029e160 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00e910 tx=0x7ff81c010f80 comp rx=0 tx=0).stop 2023-07-21T22:45:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 -- 172.21.15.151:0/886604618 shutdown_connections 2023-07-21T22:45:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea40297660 0x55ea40301d50 crc :-1 s=READY pgs=331 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea40297210 0x55ea4029e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea400ed6b0 0x55ea402a1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff814ff9700 0 client.28085 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 --2- 172.21.15.151:0/886604618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea40286ae0 0x55ea4029e160 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 -- 172.21.15.151:0/886604618 >> 172.21.15.151:0/886604618 conn(0x55ea402a7120 msgr2=0x55ea402907c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 -- 172.21.15.151:0/886604618 shutdown_connections 2023-07-21T22:45:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.883+0000 7ff846f4fb80 1 -- 172.21.15.151:0/886604618 wait complete. 2023-07-21T22:45:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff846f4fb80 20 client.28085 trim_cache size 0 max 16384 2023-07-21T22:45:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:45:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:45:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:45:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:45:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 -- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8180a1340 msgr2=0x7ff8180a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8180a1340 0x7ff8180a37f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff8240062a0 tx=0x7ff82400b040 comp rx=0 tx=0).stop 2023-07-21T22:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 -- 172.21.15.151:0/1194482494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c0685b0 msgr2=0x7ff82c10be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c0685b0 0x7ff82c10be50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff81c00e940 tx=0x7ff81c00ec50 comp rx=0 tx=0).stop 2023-07-21T22:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 -- 172.21.15.151:0/1194482494 shutdown_connections 2023-07-21T22:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff8180a1340 0x7ff8180a37f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff82c104e50 0x7ff82c1a0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff82c067c10 0x7ff82c10b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 --2- 172.21.15.151:0/1194482494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff82c0685b0 0x7ff82c10be50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.884+0000 7ff8335ff700 1 -- 172.21.15.151:0/1194482494 >> 172.21.15.151:0/1194482494 conn(0x7ff82c074760 msgr2=0x7ff82c1016d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.885+0000 7ff8335ff700 1 -- 172.21.15.151:0/1194482494 shutdown_connections 2023-07-21T22:45:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:16.885+0000 7ff8335ff700 1 -- 172.21.15.151:0/1194482494 wait complete. 2023-07-21T22:45:16.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:16 smithi151 ceph-mon[95510]: pgmap v825: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.3 MiB/s wr, 300 op/s 2023-07-21T22:45:17.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:16 smithi187 ceph-mon[96918]: pgmap v825: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.3 MiB/s wr, 300 op/s 2023-07-21T22:45:18.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:18 smithi195 ceph-mon[97365]: pgmap v826: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 311 op/s 2023-07-21T22:45:18.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:18 smithi151 ceph-mon[95510]: pgmap v826: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 311 op/s 2023-07-21T22:45:19.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:18 smithi187 ceph-mon[96918]: pgmap v826: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 311 op/s 2023-07-21T22:45:20.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:20 smithi195 ceph-mon[97365]: pgmap v827: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 311 op/s 2023-07-21T22:45:20.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:20 smithi151 ceph-mon[95510]: pgmap v827: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 311 op/s 2023-07-21T22:45:21.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:20 smithi187 ceph-mon[96918]: pgmap v827: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 311 op/s 2023-07-21T22:45:22.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:22 smithi195 ceph-mon[97365]: pgmap v828: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 311 op/s 2023-07-21T22:45:22.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:22 smithi151 ceph-mon[95510]: pgmap v828: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 311 op/s 2023-07-21T22:45:23.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:22 smithi187 ceph-mon[96918]: pgmap v828: 97 pgs: 97 active+clean; 8.1 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.4 MiB/s wr, 311 op/s 2023-07-21T22:45:24.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:24 smithi151 ceph-mon[95510]: pgmap v829: 97 pgs: 97 active+clean; 8.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.0 MiB/s wr, 393 op/s 2023-07-21T22:45:25.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:24 smithi187 ceph-mon[96918]: pgmap v829: 97 pgs: 97 active+clean; 8.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.0 MiB/s wr, 393 op/s 2023-07-21T22:45:25.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:24 smithi195 ceph-mon[97365]: pgmap v829: 97 pgs: 97 active+clean; 8.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 3.0 MiB/s wr, 393 op/s 2023-07-21T22:45:26.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:26 smithi151 ceph-mon[95510]: pgmap v830: 97 pgs: 97 active+clean; 8.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:45:27.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:26 smithi187 ceph-mon[96918]: pgmap v830: 97 pgs: 97 active+clean; 8.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:45:27.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:26 smithi195 ceph-mon[97365]: pgmap v830: 97 pgs: 97 active+clean; 8.2 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:45:28.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:28 smithi151 ceph-mon[95510]: pgmap v831: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 3.2 MiB/s wr, 410 op/s 2023-07-21T22:45:29.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:28 smithi187 ceph-mon[96918]: pgmap v831: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 3.2 MiB/s wr, 410 op/s 2023-07-21T22:45:29.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:28 smithi195 ceph-mon[97365]: pgmap v831: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 3.2 MiB/s wr, 410 op/s 2023-07-21T22:45:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.039+0000 7fbe8719d700 1 -- 172.21.15.151:0/3367765186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe80101e50 msgr2=0x7fbe8010c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.039+0000 7fbe8719d700 1 --2- 172.21.15.151:0/3367765186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe80101e50 0x7fbe8010c8a0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009f90 tx=0x7fbe7800b330 comp rx=0 tx=0).stop 2023-07-21T22:45:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.039+0000 7fbe8719d700 1 -- 172.21.15.151:0/3367765186 shutdown_connections 2023-07-21T22:45:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.039+0000 7fbe8719d700 1 --2- 172.21.15.151:0/3367765186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe80101e50 0x7fbe8010c8a0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.039+0000 7fbe8719d700 1 --2- 172.21.15.151:0/3367765186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe800ffd20 0x7fbe801000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.039+0000 7fbe8719d700 1 --2- 172.21.15.151:0/3367765186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe801014a0 0x7fbe80101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.039+0000 7fbe8719d700 1 -- 172.21.15.151:0/3367765186 >> 172.21.15.151:0/3367765186 conn(0x7fbe800fb440 msgr2=0x7fbe800fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.039+0000 7fbe8719d700 1 -- 172.21.15.151:0/3367765186 shutdown_connections 2023-07-21T22:45:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.040+0000 7fbe8719d700 1 -- 172.21.15.151:0/3367765186 wait complete. 2023-07-21T22:45:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.040+0000 7fbe8719d700 1 Processor -- start 2023-07-21T22:45:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8719d700 1 -- start start 2023-07-21T22:45:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8719d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe800ffd20 0x7fbe80072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8719d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe801014a0 0x7fbe80072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8719d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe80101e50 0x7fbe801a3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8719d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe80073580 con 0x7fbe801014a0 2023-07-21T22:45:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8719d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe801a4210 con 0x7fbe800ffd20 2023-07-21T22:45:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8719d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe801a4350 con 0x7fbe80101e50 2023-07-21T22:45:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe801014a0 0x7fbe80072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe801014a0 0x7fbe80072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53806/0 (socket says 172.21.15.151:53806) 2023-07-21T22:45:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8599a700 1 -- 172.21.15.151:0/4055936873 learned_addr learned my addr 172.21.15.151:0/4055936873 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8619b700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe800ffd20 0x7fbe80072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.041+0000 7fbe8699c700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe80101e50 0x7fbe801a3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe8699c700 1 -- 172.21.15.151:0/4055936873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe800ffd20 msgr2=0x7fbe80072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe8699c700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe800ffd20 0x7fbe80072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe8699c700 1 -- 172.21.15.151:0/4055936873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe801014a0 msgr2=0x7fbe80072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe8699c700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe801014a0 0x7fbe80072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe8699c700 1 -- 172.21.15.151:0/4055936873 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe78009c40 con 0x7fbe80101e50 2023-07-21T22:45:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe8699c700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe80101e50 0x7fbe801a3cd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800b6c0 tx=0x7fbe78008ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe777fe700 1 -- 172.21.15.151:0/4055936873 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7800e040 con 0x7fbe80101e50 2023-07-21T22:45:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe777fe700 1 -- 172.21.15.151:0/4055936873 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe78004e30 con 0x7fbe80101e50 2023-07-21T22:45:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe8719d700 1 -- 172.21.15.151:0/4055936873 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe801a4550 con 0x7fbe80101e50 2023-07-21T22:45:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.042+0000 7fbe777fe700 1 -- 172.21.15.151:0/4055936873 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe78005040 con 0x7fbe80101e50 2023-07-21T22:45:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.043+0000 7fbe8719d700 1 -- 172.21.15.151:0/4055936873 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe801a4a30 con 0x7fbe80101e50 2023-07-21T22:45:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.046+0000 7fbe777fe700 1 -- 172.21.15.151:0/4055936873 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fbe7801d470 con 0x7fbe80101e50 2023-07-21T22:45:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.047+0000 7fbe9bc29b80 1 Processor -- start 2023-07-21T22:45:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe9bc29b80 1 -- start start 2023-07-21T22:45:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5c2480 0x55a6da5bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 0x55a6da5bca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da4c1c50 con 0x55a6da4186b0 2023-07-21T22:45:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da5149e0 con 0x55a6da5c2480 2023-07-21T22:45:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da50de70 con 0x55a6da5bc5e0 2023-07-21T22:45:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe777fe700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbe6c0a1340 0x7fbe6c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe777fe700 1 -- 172.21.15.151:0/4055936873 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbe780ce150 con 0x7fbe80101e50 2023-07-21T22:45:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.048+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53814/0 (socket says 172.21.15.151:53814) 2023-07-21T22:45:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8599a700 1 -- 172.21.15.151:0/476986324 learned_addr learned my addr 172.21.15.151:0/476986324 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8619b700 1 --2- 172.21.15.151:0/476986324 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5c2480 0x55a6da5bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8699c700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbe6c0a1340 0x7fbe6c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8599a700 1 --2- 172.21.15.151:0/476986324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 0x55a6da5bca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8599a700 1 -- 172.21.15.151:0/476986324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 msgr2=0x55a6da5bca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8599a700 1 --2- 172.21.15.151:0/476986324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 0x55a6da5bca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8599a700 1 -- 172.21.15.151:0/476986324 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5c2480 msgr2=0x55a6da5bc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8599a700 1 --2- 172.21.15.151:0/476986324 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5c2480 0x55a6da5bc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8599a700 1 -- 172.21.15.151:0/476986324 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6da33bd80 con 0x55a6da4186b0 2023-07-21T22:45:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8599a700 1 --2- 172.21.15.151:0/476986324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5c1f40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009fc0 tx=0x7fbe70009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd9ba7a815f65d0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe8699c700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbe6c0a1340 0x7fbe6c0a37f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbe780cb970 tx=0x7fbe78009750 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.049+0000 7fbe74bfe700 1 -- 172.21.15.151:0/476986324 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70018070 con 0x55a6da4186b0 2023-07-21T22:45:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.050+0000 7fbe74bfe700 1 -- 172.21.15.151:0/476986324 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe700108c0 con 0x55a6da4186b0 2023-07-21T22:45:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.050+0000 7fbe74bfe700 1 -- 172.21.15.151:0/476986324 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe7000e610 con 0x55a6da4186b0 2023-07-21T22:45:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.050+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/476986324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 msgr2=0x55a6da5c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.050+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/476986324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5c1f40 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fbe70009fc0 tx=0x7fbe70009260 comp rx=0 tx=0).stop 2023-07-21T22:45:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.051+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/476986324 shutdown_connections 2023-07-21T22:45:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.051+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/476986324 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 0x55a6da5bca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.051+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/476986324 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5c1f40 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.051+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/476986324 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5c2480 0x55a6da5bc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.051+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/476986324 >> 172.21.15.151:0/476986324 conn(0x55a6da5b1c40 msgr2=0x55a6da5b7300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.051+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/476986324 shutdown_connections 2023-07-21T22:45:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.051+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/476986324 wait complete. 2023-07-21T22:45:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.051+0000 7fbe9bc29b80 1 -- start start 2023-07-21T22:45:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.052+0000 7fbe9bc29b80 1 Processor -- start 2023-07-21T22:45:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.052+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.052+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 0x55a6da5c5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.052+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5c2480 0x55a6da5c5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.052+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da4ada60 con 0x55a6da5c2480 2023-07-21T22:45:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.052+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da4ad760 con 0x55a6da4186b0 2023-07-21T22:45:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.052+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da3918c0 con 0x55a6da5bc5e0 2023-07-21T22:45:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe9bc29b80 10 client.0 _ll_register_callbacks cb 0x55a6da4ab700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5c2480 0x55a6da5c5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8619b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 0x55a6da5c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5c2480 0x55a6da5c5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53816/0 (socket says 172.21.15.151:53816) 2023-07-21T22:45:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8599a700 1 -- 172.21.15.151:0/2733830842 learned_addr learned my addr 172.21.15.151:0/2733830842 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8619b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 0x55a6da5c5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38322/0 (socket says 172.21.15.151:38322) 2023-07-21T22:45:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8599a700 1 -- 172.21.15.151:0/2733830842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 msgr2=0x55a6da5c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8599a700 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 0x55a6da5c5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8599a700 1 -- 172.21.15.151:0/2733830842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 msgr2=0x55a6da5c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8599a700 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.053+0000 7fbe8599a700 1 -- 172.21.15.151:0/2733830842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe70013460 con 0x55a6da5c2480 2023-07-21T22:45:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.054+0000 7fbe8599a700 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5c2480 0x55a6da5c5f30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbe70010f90 tx=0x7fbe700095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcd870869862805 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.054+0000 7fbe69ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:45:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.054+0000 7fbe69ffb700 1 -- 172.21.15.151:0/2733830842 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70025070 con 0x55a6da5c2480 2023-07-21T22:45:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.054+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2733830842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a6da467490 con 0x55a6da5c2480 2023-07-21T22:45:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.054+0000 7fbe69ffb700 1 -- 172.21.15.151:0/2733830842 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbe70005110 con 0x55a6da5c2480 2023-07-21T22:45:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.054+0000 7fbe69ffb700 1 -- 172.21.15.151:0/2733830842 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe70018070 con 0x55a6da5c2480 2023-07-21T22:45:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.054+0000 7fbe9bc29b80 10 client.18426 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.054+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2733830842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55a6da324c00 con 0x55a6da5c2480 2023-07-21T22:45:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.054+0000 7fbe69ffb700 1 -- 172.21.15.151:0/2733830842 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a6da467490 con 0x55a6da5c2480 2023-07-21T22:45:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.055+0000 7fbe69ffb700 1 -- 172.21.15.151:0/2733830842 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbe7002c060 con 0x55a6da5c2480 2023-07-21T22:45:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.055+0000 7fbe9bc29b80 10 client.18426 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.055+0000 7fbe9bc29b80 10 client.18426 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.055+0000 7fbe9bc29b80 20 client.18426 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.055+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a6da5d5bd0 0x55a6da5d7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.055+0000 7fbe9bc29b80 4 client.18426 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:45:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.055+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2733830842 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a6da506e50 con 0x55a6da5d5bd0 2023-07-21T22:45:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.055+0000 7fbe8619b700 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a6da5d5bd0 0x55a6da5d7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.056+0000 7fbe69ffb700 10 client.18426 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.056+0000 7fbe8619b700 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a6da5d5bd0 0x55a6da5d7fe0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=150937b14c2a450a server_cookie=8e8afd6ad3dd5fb0 in_seq=0 out_seq=0 2023-07-21T22:45:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.056+0000 7fbe69ffb700 1 -- 172.21.15.151:0/2733830842 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a6da506e50 con 0x55a6da5d5bd0 2023-07-21T22:45:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.056+0000 7fbe69ffb700 10 client.18426 handle_command_reply: tid=0 2023-07-21T22:45:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.056+0000 7fbe9bc29b80 1 client.18426 shutdown 2023-07-21T22:45:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2733830842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5c2480 msgr2=0x55a6da5c5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5c2480 0x55a6da5c5f30 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fbe70010f90 tx=0x7fbe700095c0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2733830842 shutdown_connections 2023-07-21T22:45:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a6da5d5bd0 0x55a6da5d7fe0 crc :-1 s=READY pgs=332 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5c2480 0x55a6da5c5f30 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2733830842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5bc5e0 0x55a6da5c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe69ffb700 0 client.18426 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2733830842 >> 172.21.15.151:0/2733830842 conn(0x55a6da5b1c40 msgr2=0x55a6da5b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2733830842 shutdown_connections 2023-07-21T22:45:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2733830842 wait complete. 2023-07-21T22:45:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.057+0000 7fbe9bc29b80 20 client.18426 trim_cache size 0 max 16384 2023-07-21T22:45:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.072+0000 7fbe9bc29b80 1 Processor -- start 2023-07-21T22:45:30.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.072+0000 7fbe9bc29b80 1 -- start start 2023-07-21T22:45:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5bc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5bc5e0 0x55a6da5cce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 0x55a6da5c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da5b1670 con 0x55a6da5bc5e0 2023-07-21T22:45:30.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da5d8640 con 0x55a6da4186b0 2023-07-21T22:45:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da5c3e60 con 0x55a6da5c2480 2023-07-21T22:45:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5bc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8619b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5bc5e0 0x55a6da5cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5bc0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39938/0 (socket says 172.21.15.151:39938) 2023-07-21T22:45:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8599a700 1 -- 172.21.15.151:0/2520518070 learned_addr learned my addr 172.21.15.151:0/2520518070 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:30.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8599a700 1 --2- 172.21.15.151:0/2520518070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 0x55a6da5c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8599a700 1 -- 172.21.15.151:0/2520518070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 msgr2=0x55a6da5c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8599a700 1 --2- 172.21.15.151:0/2520518070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 0x55a6da5c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8599a700 1 -- 172.21.15.151:0/2520518070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5bc5e0 msgr2=0x55a6da5cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8599a700 1 --2- 172.21.15.151:0/2520518070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5bc5e0 0x55a6da5cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8599a700 1 -- 172.21.15.151:0/2520518070 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a6da3621f0 con 0x55a6da4186b0 2023-07-21T22:45:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.073+0000 7fbe8619b700 1 --2- 172.21.15.151:0/2520518070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5bc5e0 0x55a6da5cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:30.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.074+0000 7fbe8599a700 1 --2- 172.21.15.151:0/2520518070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5bc0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbe70013430 tx=0x7fbe70009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e9f28d0cbe72daa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.074+0000 7fbe753ff700 1 -- 172.21.15.151:0/2520518070 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70018070 con 0x55a6da4186b0 2023-07-21T22:45:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.074+0000 7fbe753ff700 1 -- 172.21.15.151:0/2520518070 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe70005770 con 0x55a6da4186b0 2023-07-21T22:45:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.074+0000 7fbe753ff700 1 -- 172.21.15.151:0/2520518070 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70025040 con 0x55a6da4186b0 2023-07-21T22:45:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2520518070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 msgr2=0x55a6da5bc0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2520518070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5bc0a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbe70013430 tx=0x7fbe70009260 comp rx=0 tx=0).stop 2023-07-21T22:45:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2520518070 shutdown_connections 2023-07-21T22:45:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2520518070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da4186b0 0x55a6da5bc0a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2520518070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 0x55a6da5c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/2520518070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da5bc5e0 0x55a6da5cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2520518070 >> 172.21.15.151:0/2520518070 conn(0x55a6da5b1c40 msgr2=0x55a6da5bfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2520518070 shutdown_connections 2023-07-21T22:45:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/2520518070 wait complete. 2023-07-21T22:45:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 -- start start 2023-07-21T22:45:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.075+0000 7fbe9bc29b80 1 Processor -- start 2023-07-21T22:45:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5bc5e0 0x55a6da5cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe9bc29b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 0x55a6da628a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da5cbcc0 con 0x55a6da4186b0 2023-07-21T22:45:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da628f90 con 0x55a6da5bc5e0 2023-07-21T22:45:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe9bc29b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a6da629100 con 0x55a6da5c2480 2023-07-21T22:45:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe9bc29b80 10 client.0 _ll_register_callbacks cb 0x7fbe70010d40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe8599a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53828/0 (socket says 172.21.15.151:53828) 2023-07-21T22:45:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe8599a700 1 -- 172.21.15.151:0/1728185616 learned_addr learned my addr 172.21.15.151:0/1728185616 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe8619b700 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5bc5e0 0x55a6da5cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.076+0000 7fbe8599a700 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 0x55a6da628a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe8599a700 1 -- 172.21.15.151:0/1728185616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 msgr2=0x55a6da628a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe8599a700 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 0x55a6da628a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe8599a700 1 -- 172.21.15.151:0/1728185616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5bc5e0 msgr2=0x55a6da5cb540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe8599a700 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5bc5e0 0x55a6da5cb540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe8599a700 1 -- 172.21.15.151:0/1728185616 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe7c009c50 con 0x55a6da4186b0 2023-07-21T22:45:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe8599a700 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5cb000 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbe70013e00 tx=0x7fbe70009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad32a812fcdacd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe69ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:45:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe69ffb700 1 -- 172.21.15.151:0/1728185616 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe70025040 con 0x55a6da4186b0 2023-07-21T22:45:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe69ffb700 1 -- 172.21.15.151:0/1728185616 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbe70000e40 con 0x55a6da4186b0 2023-07-21T22:45:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/1728185616 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbe700108c0 con 0x55a6da4186b0 2023-07-21T22:45:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe69ffb700 1 -- 172.21.15.151:0/1728185616 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbe70018040 con 0x55a6da4186b0 2023-07-21T22:45:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe9bc29b80 10 client.18432 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.077+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/1728185616 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55a6da324c00 con 0x55a6da4186b0 2023-07-21T22:45:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.078+0000 7fbe69ffb700 1 -- 172.21.15.151:0/1728185616 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbe70047080 con 0x55a6da4186b0 2023-07-21T22:45:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.078+0000 7fbe69ffb700 1 -- 172.21.15.151:0/1728185616 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fbe7002c070 con 0x55a6da4186b0 2023-07-21T22:45:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.078+0000 7fbe9bc29b80 10 client.18432 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.078+0000 7fbe9bc29b80 10 client.18432 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.078+0000 7fbe9bc29b80 20 client.18432 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.078+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a6da62a2b0 0x55a6da62c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.078+0000 7fbe9bc29b80 4 client.18432 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:45:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.078+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/1728185616 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a6da4c8ff0 con 0x55a6da62a2b0 2023-07-21T22:45:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.078+0000 7fbe8619b700 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a6da62a2b0 0x55a6da62c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.079+0000 7fbe8619b700 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a6da62a2b0 0x55a6da62c690 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae36a40c51e749f server_cookie=3bc959ef513a4e5b in_seq=0 out_seq=0 2023-07-21T22:45:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.079+0000 7fbe69ffb700 10 client.18432 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe69ffb700 1 -- 172.21.15.151:0/1728185616 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a6da4c8ff0 con 0x55a6da62a2b0 2023-07-21T22:45:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe69ffb700 10 client.18432 handle_command_reply: tid=0 2023-07-21T22:45:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe9bc29b80 1 client.18432 shutdown 2023-07-21T22:45:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/1728185616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 msgr2=0x55a6da5cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5cb000 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fbe70013e00 tx=0x7fbe70009390 comp rx=0 tx=0).stop 2023-07-21T22:45:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/1728185616 shutdown_connections 2023-07-21T22:45:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a6da62a2b0 0x55a6da62c690 crc :-1 s=READY pgs=333 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a6da5c2480 0x55a6da628a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a6da4186b0 0x55a6da5cb000 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe69ffb700 0 client.18432 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe9bc29b80 1 --2- 172.21.15.151:0/1728185616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a6da5bc5e0 0x55a6da5cb540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.094+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/1728185616 >> 172.21.15.151:0/1728185616 conn(0x55a6da5b1c40 msgr2=0x55a6da5c2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/1728185616 shutdown_connections 2023-07-21T22:45:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe9bc29b80 1 -- 172.21.15.151:0/1728185616 wait complete. 2023-07-21T22:45:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe9bc29b80 20 client.18432 trim_cache size 0 max 16384 2023-07-21T22:45:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:45:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:45:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:45:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:45:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 -- 172.21.15.151:0/4055936873 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbe6c0a1340 msgr2=0x7fbe6c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbe6c0a1340 0x7fbe6c0a37f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbe780cb970 tx=0x7fbe78009750 comp rx=0 tx=0).stop 2023-07-21T22:45:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 -- 172.21.15.151:0/4055936873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe80101e50 msgr2=0x7fbe801a3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe80101e50 0x7fbe801a3cd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800b6c0 tx=0x7fbe78008ca0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 -- 172.21.15.151:0/4055936873 shutdown_connections 2023-07-21T22:45:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbe6c0a1340 0x7fbe6c0a37f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbe800ffd20 0x7fbe80072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbe80101e50 0x7fbe801a3cd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 --2- 172.21.15.151:0/4055936873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbe801014a0 0x7fbe80072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.095+0000 7fbe8719d700 1 -- 172.21.15.151:0/4055936873 >> 172.21.15.151:0/4055936873 conn(0x7fbe800fb440 msgr2=0x7fbe801045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.096+0000 7fbe8719d700 1 -- 172.21.15.151:0/4055936873 shutdown_connections 2023-07-21T22:45:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:30.096+0000 7fbe8719d700 1 -- 172.21.15.151:0/4055936873 wait complete. 2023-07-21T22:45:30.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:30 smithi151 ceph-mon[95510]: pgmap v832: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-07-21T22:45:31.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:30 smithi187 ceph-mon[96918]: pgmap v832: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-07-21T22:45:31.153 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:30 smithi195 ceph-mon[97365]: pgmap v832: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-07-21T22:45:32.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:32 smithi151 ceph-mon[95510]: pgmap v833: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-07-21T22:45:33.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:32 smithi187 ceph-mon[96918]: pgmap v833: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-07-21T22:45:33.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:32 smithi195 ceph-mon[97365]: pgmap v833: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-07-21T22:45:34.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:34 smithi151 ceph-mon[95510]: pgmap v834: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.1 MiB/s wr, 404 op/s 2023-07-21T22:45:35.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:34 smithi187 ceph-mon[96918]: pgmap v834: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.1 MiB/s wr, 404 op/s 2023-07-21T22:45:35.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:34 smithi195 ceph-mon[97365]: pgmap v834: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 3.1 MiB/s wr, 404 op/s 2023-07-21T22:45:36.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:36 smithi151 ceph-mon[95510]: pgmap v835: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 2.2 MiB/s wr, 283 op/s 2023-07-21T22:45:37.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:36 smithi187 ceph-mon[96918]: pgmap v835: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 2.2 MiB/s wr, 283 op/s 2023-07-21T22:45:37.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:36 smithi195 ceph-mon[97365]: pgmap v835: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 2.2 MiB/s wr, 283 op/s 2023-07-21T22:45:38.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:38 smithi151 ceph-mon[95510]: pgmap v836: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 3.2 MiB/s wr, 411 op/s 2023-07-21T22:45:39.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:38 smithi187 ceph-mon[96918]: pgmap v836: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 3.2 MiB/s wr, 411 op/s 2023-07-21T22:45:39.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:38 smithi195 ceph-mon[97365]: pgmap v836: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 3.2 MiB/s wr, 411 op/s 2023-07-21T22:45:40.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:40 smithi151 ceph-mon[95510]: pgmap v837: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:45:41.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:40 smithi187 ceph-mon[96918]: pgmap v837: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:45:41.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:40 smithi195 ceph-mon[97365]: pgmap v837: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:45:42.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:42 smithi151 ceph-mon[95510]: pgmap v838: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:45:43.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:42 smithi187 ceph-mon[96918]: pgmap v838: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:45:43.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:42 smithi195 ceph-mon[97365]: pgmap v838: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:45:43.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.363+0000 7fde925ff700 1 -- 172.21.15.151:0/1520692938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c105aa0 msgr2=0x7fde8c105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.363+0000 7fde925ff700 1 --2- 172.21.15.151:0/1520692938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c105aa0 0x7fde8c105e70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fde7c009990 tx=0x7fde7c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.363+0000 7fde925ff700 1 -- 172.21.15.151:0/1520692938 shutdown_connections 2023-07-21T22:45:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.363+0000 7fde925ff700 1 --2- 172.21.15.151:0/1520692938 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde8c100440 0x7fde8c10c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.363+0000 7fde925ff700 1 --2- 172.21.15.151:0/1520692938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c105aa0 0x7fde8c105e70 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.363+0000 7fde925ff700 1 --2- 172.21.15.151:0/1520692938 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde8c0ffa90 0x7fde8c0fff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.363+0000 7fde925ff700 1 -- 172.21.15.151:0/1520692938 >> 172.21.15.151:0/1520692938 conn(0x7fde8c0fb550 msgr2=0x7fde8c0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:43.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.363+0000 7fde925ff700 1 -- 172.21.15.151:0/1520692938 shutdown_connections 2023-07-21T22:45:43.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.363+0000 7fde925ff700 1 -- 172.21.15.151:0/1520692938 wait complete. 2023-07-21T22:45:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.364+0000 7fde925ff700 1 Processor -- start 2023-07-21T22:45:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.364+0000 7fde925ff700 1 -- start start 2023-07-21T22:45:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde925ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c0ffa90 0x7fde8c19dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde925ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde8c100440 0x7fde8c19e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde925ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde8c105aa0 0x7fde8c197b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde925ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c1981a0 con 0x7fde8c0ffa90 2023-07-21T22:45:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde925ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c198310 con 0x7fde8c105aa0 2023-07-21T22:45:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde925ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde8c1984d0 con 0x7fde8c100440 2023-07-21T22:45:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde8bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c0ffa90 0x7fde8c19dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde8bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c0ffa90 0x7fde8c19dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38260/0 (socket says 172.21.15.151:38260) 2023-07-21T22:45:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde8bfff700 1 -- 172.21.15.151:0/1859701610 learned_addr learned my addr 172.21.15.151:0/1859701610 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:43.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde83fff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde8c100440 0x7fde8c19e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.365+0000 7fde90b9c700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde8c105aa0 0x7fde8c197b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde8bfff700 1 -- 172.21.15.151:0/1859701610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde8c100440 msgr2=0x7fde8c19e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde8bfff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde8c100440 0x7fde8c19e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde8bfff700 1 -- 172.21.15.151:0/1859701610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde8c105aa0 msgr2=0x7fde8c197b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde8bfff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde8c105aa0 0x7fde8c197b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde8bfff700 1 -- 172.21.15.151:0/1859701610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde7c0095f0 con 0x7fde8c0ffa90 2023-07-21T22:45:43.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde8bfff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c0ffa90 0x7fde8c19dac0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fde7c000c00 tx=0x7fde7c0057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde89ffb700 1 -- 172.21.15.151:0/1859701610 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c01d070 con 0x7fde8c0ffa90 2023-07-21T22:45:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde89ffb700 1 -- 172.21.15.151:0/1859701610 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde7c00be70 con 0x7fde8c0ffa90 2023-07-21T22:45:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde925ff700 1 -- 172.21.15.151:0/1859701610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde8c198750 con 0x7fde8c0ffa90 2023-07-21T22:45:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde89ffb700 1 -- 172.21.15.151:0/1859701610 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c00fdc0 con 0x7fde8c0ffa90 2023-07-21T22:45:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.366+0000 7fde925ff700 1 -- 172.21.15.151:0/1859701610 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c1a4ab0 con 0x7fde8c0ffa90 2023-07-21T22:45:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.370+0000 7fde89ffb700 1 -- 172.21.15.151:0/1859701610 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fde7c00f560 con 0x7fde8c0ffa90 2023-07-21T22:45:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.371+0000 7fdea600fb80 1 Processor -- start 2023-07-21T22:45:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.371+0000 7fdea600fb80 1 -- start start 2023-07-21T22:45:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.371+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6adcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.371+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6a7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.371+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6a84a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fdea600fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c5adc50 con 0x55734c5046b0 2023-07-21T22:45:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fdea600fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c6009e0 con 0x55734c6ae210 2023-07-21T22:45:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fdea600fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c5f9e70 con 0x55734c6ae660 2023-07-21T22:45:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde90b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6adcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde89ffb700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde780a1340 0x7fde780a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde83fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6a84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde8bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6a7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde83fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6a84a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37482/0 (socket says 172.21.15.151:37482) 2023-07-21T22:45:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde83fff700 1 -- 172.21.15.151:0/160432446 learned_addr learned my addr 172.21.15.151:0/160432446 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde89ffb700 1 -- 172.21.15.151:0/1859701610 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fde7c0cdf80 con 0x7fde8c0ffa90 2023-07-21T22:45:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde83fff700 1 -- 172.21.15.151:0/160432446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 msgr2=0x55734c6a7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde83fff700 1 --2- 172.21.15.151:0/160432446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6a7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde83fff700 1 -- 172.21.15.151:0/160432446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 msgr2=0x55734c6adcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde83fff700 1 --2- 172.21.15.151:0/160432446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6adcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde90b9c700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde780a1340 0x7fde780a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.372+0000 7fde83fff700 1 -- 172.21.15.151:0/160432446 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55734c427d80 con 0x55734c6ae660 2023-07-21T22:45:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.373+0000 7fde83fff700 1 --2- 172.21.15.151:0/160432446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6a84a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fde74009d20 tx=0x7fde74011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38014fa15c2165ee server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.373+0000 7fde827fc700 1 -- 172.21.15.151:0/160432446 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74019630 con 0x55734c6ae660 2023-07-21T22:45:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.373+0000 7fde90b9c700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde780a1340 0x7fde780a37f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fde84009ec0 tx=0x7fde84004b40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.373+0000 7fde827fc700 1 -- 172.21.15.151:0/160432446 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde74019c20 con 0x55734c6ae660 2023-07-21T22:45:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.373+0000 7fde827fc700 1 -- 172.21.15.151:0/160432446 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7400eb00 con 0x55734c6ae660 2023-07-21T22:45:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.374+0000 7fdea600fb80 1 -- 172.21.15.151:0/160432446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 msgr2=0x55734c6a84a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.374+0000 7fdea600fb80 1 --2- 172.21.15.151:0/160432446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6a84a0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fde74009d20 tx=0x7fde74011720 comp rx=0 tx=0).stop 2023-07-21T22:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.374+0000 7fdea600fb80 1 -- 172.21.15.151:0/160432446 shutdown_connections 2023-07-21T22:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.374+0000 7fdea600fb80 1 --2- 172.21.15.151:0/160432446 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6a84a0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.374+0000 7fdea600fb80 1 --2- 172.21.15.151:0/160432446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6adcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.374+0000 7fdea600fb80 1 --2- 172.21.15.151:0/160432446 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6a7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.374+0000 7fdea600fb80 1 -- 172.21.15.151:0/160432446 >> 172.21.15.151:0/160432446 conn(0x55734c69dae0 msgr2=0x55734c6a30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.374+0000 7fdea600fb80 1 -- 172.21.15.151:0/160432446 shutdown_connections 2023-07-21T22:45:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.374+0000 7fdea600fb80 1 -- 172.21.15.151:0/160432446 wait complete. 2023-07-21T22:45:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.375+0000 7fdea600fb80 1 -- start start 2023-07-21T22:45:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.375+0000 7fdea600fb80 1 Processor -- start 2023-07-21T22:45:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.375+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.375+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 0x55734c6b18e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.375+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae660 0x55734c6b1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.375+0000 7fdea600fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c599a60 con 0x55734c5046b0 2023-07-21T22:45:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.375+0000 7fdea600fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c599760 con 0x55734c6ae660 2023-07-21T22:45:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.375+0000 7fdea600fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c47d8c0 con 0x55734c6ae210 2023-07-21T22:45:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.375+0000 7fdea600fb80 10 client.0 _ll_register_callbacks cb 0x55734c597700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde8bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde90b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae660 0x55734c6b1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde8bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b45f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38278/0 (socket says 172.21.15.151:38278) 2023-07-21T22:45:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde8bfff700 1 -- 172.21.15.151:0/488548414 learned_addr learned my addr 172.21.15.151:0/488548414 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde83fff700 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 0x55734c6b18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde83fff700 1 -- 172.21.15.151:0/488548414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae660 msgr2=0x55734c6b1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde83fff700 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae660 0x55734c6b1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde83fff700 1 -- 172.21.15.151:0/488548414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 msgr2=0x55734c6b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde83fff700 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde83fff700 1 -- 172.21.15.151:0/488548414 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde74009980 con 0x55734c6ae210 2023-07-21T22:45:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde8bfff700 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde83fff700 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 0x55734c6b18e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fde7401c040 tx=0x7fde74019a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee8e1227a892033 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.376+0000 7fde6b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:45:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.377+0000 7fde6b7fe700 1 -- 172.21.15.151:0/488548414 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74004230 con 0x55734c6ae210 2023-07-21T22:45:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.377+0000 7fde6b7fe700 1 -- 172.21.15.151:0/488548414 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fde74004390 con 0x55734c6ae210 2023-07-21T22:45:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.377+0000 7fdea600fb80 1 -- 172.21.15.151:0/488548414 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55734c553490 con 0x55734c6ae210 2023-07-21T22:45:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.377+0000 7fde6b7fe700 1 -- 172.21.15.151:0/488548414 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde74004550 con 0x55734c6ae210 2023-07-21T22:45:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.377+0000 7fdea600fb80 10 client.28147 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.377+0000 7fdea600fb80 1 -- 172.21.15.151:0/488548414 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55734c410c00 con 0x55734c6ae210 2023-07-21T22:45:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.377+0000 7fde6b7fe700 1 -- 172.21.15.151:0/488548414 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55734c553490 con 0x55734c6ae210 2023-07-21T22:45:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.377+0000 7fde6b7fe700 1 -- 172.21.15.151:0/488548414 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fde74004b20 con 0x55734c6ae210 2023-07-21T22:45:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.378+0000 7fdea600fb80 10 client.28147 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.378+0000 7fdea600fb80 10 client.28147 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.378+0000 7fdea600fb80 20 client.28147 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.378+0000 7fdea600fb80 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55734c6c1a30 0x55734c6c3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.378+0000 7fdea600fb80 4 client.28147 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:45:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.378+0000 7fdea600fb80 1 -- 172.21.15.151:0/488548414 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55734c5f2e50 con 0x55734c6c1a30 2023-07-21T22:45:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.378+0000 7fde8bfff700 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55734c6c1a30 0x55734c6c3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.379+0000 7fde6b7fe700 10 client.28147 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.379+0000 7fde8bfff700 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55734c6c1a30 0x55734c6c3e40 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10baef9e7ea7b221 server_cookie=9e3320e6e4a02597 in_seq=0 out_seq=0 2023-07-21T22:45:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.379+0000 7fde6b7fe700 1 -- 172.21.15.151:0/488548414 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55734c5f2e50 con 0x55734c6c1a30 2023-07-21T22:45:43.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.379+0000 7fde6b7fe700 10 client.28147 handle_command_reply: tid=0 2023-07-21T22:45:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.379+0000 7fdea600fb80 1 client.28147 shutdown 2023-07-21T22:45:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.379+0000 7fdea600fb80 1 -- 172.21.15.151:0/488548414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 msgr2=0x55734c6b18e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 0x55734c6b18e0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fde7401c040 tx=0x7fde74019a90 comp rx=0 tx=0).stop 2023-07-21T22:45:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 1 -- 172.21.15.151:0/488548414 shutdown_connections 2023-07-21T22:45:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55734c6c1a30 0x55734c6c3e40 crc :-1 s=READY pgs=334 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae660 0x55734c6b1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 1 --2- 172.21.15.151:0/488548414 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 0x55734c6b18e0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fde6b7fe700 0 client.28147 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 1 -- 172.21.15.151:0/488548414 >> 172.21.15.151:0/488548414 conn(0x55734c69dae0 msgr2=0x55734c6a23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 1 -- 172.21.15.151:0/488548414 shutdown_connections 2023-07-21T22:45:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 1 -- 172.21.15.151:0/488548414 wait complete. 2023-07-21T22:45:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.380+0000 7fdea600fb80 20 client.28147 trim_cache size 0 max 16384 2023-07-21T22:45:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.397+0000 7fdea600fb80 1 Processor -- start 2023-07-21T22:45:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.397+0000 7fdea600fb80 1 -- start start 2023-07-21T22:45:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c5046b0 0x55734c6ad040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 0x55734c6b4190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c6ae660 0x55734c6a2b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fdea600fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c6ad900 con 0x55734c6ae660 2023-07-21T22:45:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fdea600fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c6afe60 con 0x55734c5046b0 2023-07-21T22:45:43.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fdea600fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c6ac520 con 0x55734c6ae210 2023-07-21T22:45:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde90b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c6ae660 0x55734c6a2b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde83fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 0x55734c6b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde8bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c5046b0 0x55734c6ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde90b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c6ae660 0x55734c6a2b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38290/0 (socket says 172.21.15.151:38290) 2023-07-21T22:45:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde90b9c700 1 -- 172.21.15.151:0/4274170796 learned_addr learned my addr 172.21.15.151:0/4274170796 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:43.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde8bfff700 1 -- 172.21.15.151:0/4274170796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 msgr2=0x55734c6b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde8bfff700 1 --2- 172.21.15.151:0/4274170796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 0x55734c6b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde8bfff700 1 -- 172.21.15.151:0/4274170796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c6ae660 msgr2=0x55734c6a2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde8bfff700 1 --2- 172.21.15.151:0/4274170796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c6ae660 0x55734c6a2b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.398+0000 7fde8bfff700 1 -- 172.21.15.151:0/4274170796 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55734c44e1f0 con 0x55734c5046b0 2023-07-21T22:45:43.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.399+0000 7fde8bfff700 1 --2- 172.21.15.151:0/4274170796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c5046b0 0x55734c6ad040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fde7c09b030 tx=0x7fde7c0a1040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77c63fe51202ac0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.399+0000 7fde82ffd700 1 -- 172.21.15.151:0/4274170796 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c09b0a0 con 0x55734c5046b0 2023-07-21T22:45:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.399+0000 7fde82ffd700 1 -- 172.21.15.151:0/4274170796 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde7c0a3460 con 0x55734c5046b0 2023-07-21T22:45:43.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.399+0000 7fde82ffd700 1 -- 172.21.15.151:0/4274170796 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7c09a590 con 0x55734c5046b0 2023-07-21T22:45:43.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 -- 172.21.15.151:0/4274170796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c5046b0 msgr2=0x55734c6ad040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:43.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 --2- 172.21.15.151:0/4274170796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c5046b0 0x55734c6ad040 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fde7c09b030 tx=0x7fde7c0a1040 comp rx=0 tx=0).stop 2023-07-21T22:45:43.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 -- 172.21.15.151:0/4274170796 shutdown_connections 2023-07-21T22:45:43.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 --2- 172.21.15.151:0/4274170796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c5046b0 0x55734c6ad040 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 --2- 172.21.15.151:0/4274170796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c6ae660 0x55734c6a2b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 --2- 172.21.15.151:0/4274170796 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae210 0x55734c6b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 -- 172.21.15.151:0/4274170796 >> 172.21.15.151:0/4274170796 conn(0x55734c69dae0 msgr2=0x55734c6ac930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:43.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 -- 172.21.15.151:0/4274170796 shutdown_connections 2023-07-21T22:45:43.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 -- 172.21.15.151:0/4274170796 wait complete. 2023-07-21T22:45:43.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 -- start start 2023-07-21T22:45:43.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.400+0000 7fdea600fb80 1 Processor -- start 2023-07-21T22:45:43.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6b70d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fdea600fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6b7610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fdea600fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c714a10 con 0x55734c5046b0 2023-07-21T22:45:43.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fdea600fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c714b80 con 0x55734c6ae210 2023-07-21T22:45:43.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fdea600fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55734c714d40 con 0x55734c6ae660 2023-07-21T22:45:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fdea600fb80 10 client.0 _ll_register_callbacks cb 0x7fde7401c070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fde83fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6b70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fde83fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6b70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:33208/0 (socket says 172.21.15.151:33208) 2023-07-21T22:45:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fde83fff700 1 -- 172.21.15.151:0/2610253265 learned_addr learned my addr 172.21.15.151:0/2610253265 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fde8bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.401+0000 7fde90b9c700 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6b7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde83fff700 1 -- 172.21.15.151:0/2610253265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 msgr2=0x55734c6b7610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde83fff700 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6b7610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde83fff700 1 -- 172.21.15.151:0/2610253265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 msgr2=0x55734c6b6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde83fff700 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde83fff700 1 -- 172.21.15.151:0/2610253265 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde8c1a4ab0 con 0x55734c6ae210 2023-07-21T22:45:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde83fff700 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6b70d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fde74011af0 tx=0x7fde7402bf00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d978b637a226c3c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde6b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:45:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde6b7fe700 1 -- 172.21.15.151:0/2610253265 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde74003e20 con 0x55734c6ae210 2023-07-21T22:45:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fdea600fb80 1 -- 172.21.15.151:0/2610253265 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde74019c20 con 0x55734c6ae210 2023-07-21T22:45:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde6b7fe700 1 -- 172.21.15.151:0/2610253265 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fde74005ce0 con 0x55734c6ae210 2023-07-21T22:45:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.402+0000 7fde6b7fe700 1 -- 172.21.15.151:0/2610253265 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde74005b00 con 0x55734c6ae210 2023-07-21T22:45:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fdea600fb80 10 client.28121 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fdea600fb80 1 -- 172.21.15.151:0/2610253265 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55734c426250 con 0x55734c6ae210 2023-07-21T22:45:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fde6b7fe700 1 -- 172.21.15.151:0/2610253265 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde74043020 con 0x55734c6ae210 2023-07-21T22:45:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fde6b7fe700 1 -- 172.21.15.151:0/2610253265 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fde740051c0 con 0x55734c6ae210 2023-07-21T22:45:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fdea600fb80 10 client.28121 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fdea600fb80 10 client.28121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fdea600fb80 20 client.28121 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fdea600fb80 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55734c715fb0 0x55734c7183c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fdea600fb80 4 client.28121 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:45:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fdea600fb80 1 -- 172.21.15.151:0/2610253265 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55734c5b4ff0 con 0x55734c715fb0 2023-07-21T22:45:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.403+0000 7fde8bfff700 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55734c715fb0 0x55734c7183c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.404+0000 7fde8bfff700 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55734c715fb0 0x55734c7183c0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3e6411253de0c92 server_cookie=229f5030081664b0 in_seq=0 out_seq=0 2023-07-21T22:45:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.404+0000 7fde6b7fe700 10 client.28121 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.419+0000 7fde6b7fe700 1 -- 172.21.15.151:0/2610253265 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55734c5b4ff0 con 0x55734c715fb0 2023-07-21T22:45:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.419+0000 7fde6b7fe700 10 client.28121 handle_command_reply: tid=0 2023-07-21T22:45:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 client.28121 shutdown 2023-07-21T22:45:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 -- 172.21.15.151:0/2610253265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 msgr2=0x55734c6b70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6b70d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fde74011af0 tx=0x7fde7402bf00 comp rx=0 tx=0).stop 2023-07-21T22:45:43.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 -- 172.21.15.151:0/2610253265 shutdown_connections 2023-07-21T22:45:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55734c715fb0 0x55734c7183c0 crc :-1 s=READY pgs=335 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55734c6ae660 0x55734c6b7610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55734c5046b0 0x55734c6b6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fde6b7fe700 0 client.28121 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 --2- 172.21.15.151:0/2610253265 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55734c6ae210 0x55734c6b70d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 -- 172.21.15.151:0/2610253265 >> 172.21.15.151:0/2610253265 conn(0x55734c69dae0 msgr2=0x55734c6ad1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 -- 172.21.15.151:0/2610253265 shutdown_connections 2023-07-21T22:45:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 1 -- 172.21.15.151:0/2610253265 wait complete. 2023-07-21T22:45:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.420+0000 7fdea600fb80 20 client.28121 trim_cache size 0 max 16384 2023-07-21T22:45:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:45:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:45:43.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:45:43.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:45:43.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 -- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde780a1340 msgr2=0x7fde780a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:43.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde780a1340 0x7fde780a37f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fde84009ec0 tx=0x7fde84004b40 comp rx=0 tx=0).stop 2023-07-21T22:45:43.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 -- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c0ffa90 msgr2=0x7fde8c19dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c0ffa90 0x7fde8c19dac0 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fde7c000c00 tx=0x7fde7c0057c0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 -- 172.21.15.151:0/1859701610 shutdown_connections 2023-07-21T22:45:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde780a1340 0x7fde780a37f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde8c105aa0 0x7fde8c197b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde8c0ffa90 0x7fde8c19dac0 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 --2- 172.21.15.151:0/1859701610 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde8c100440 0x7fde8c19e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 -- 172.21.15.151:0/1859701610 >> 172.21.15.151:0/1859701610 conn(0x7fde8c0fb550 msgr2=0x7fde8c072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 -- 172.21.15.151:0/1859701610 shutdown_connections 2023-07-21T22:45:43.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:43.421+0000 7fde925ff700 1 -- 172.21.15.151:0/1859701610 wait complete. 2023-07-21T22:45:44.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:44 smithi151 ceph-mon[95510]: pgmap v839: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 3.3 MiB/s wr, 426 op/s 2023-07-21T22:45:45.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:44 smithi187 ceph-mon[96918]: pgmap v839: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 3.3 MiB/s wr, 426 op/s 2023-07-21T22:45:45.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:44 smithi195 ceph-mon[97365]: pgmap v839: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 3.3 MiB/s wr, 426 op/s 2023-07-21T22:45:45.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:45 smithi151 ceph-mon[95510]: pgmap v840: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:45:46.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:45 smithi187 ceph-mon[96918]: pgmap v840: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:45:46.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:45 smithi195 ceph-mon[97365]: pgmap v840: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:45:48.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:48 smithi195 ceph-mon[97365]: pgmap v841: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 3.3 MiB/s wr, 435 op/s 2023-07-21T22:45:48.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:48 smithi151 ceph-mon[95510]: pgmap v841: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 3.3 MiB/s wr, 435 op/s 2023-07-21T22:45:49.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:48 smithi187 ceph-mon[96918]: pgmap v841: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 3.3 MiB/s wr, 435 op/s 2023-07-21T22:45:50.900 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:50 smithi195 ceph-mon[97365]: pgmap v842: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.3 MiB/s wr, 307 op/s 2023-07-21T22:45:50.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:50 smithi151 ceph-mon[95510]: pgmap v842: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.3 MiB/s wr, 307 op/s 2023-07-21T22:45:51.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:50 smithi187 ceph-mon[96918]: pgmap v842: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.3 MiB/s wr, 307 op/s 2023-07-21T22:45:52.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:52 smithi151 ceph-mon[95510]: pgmap v843: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.3 MiB/s wr, 307 op/s 2023-07-21T22:45:53.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:52 smithi187 ceph-mon[96918]: pgmap v843: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.3 MiB/s wr, 307 op/s 2023-07-21T22:45:53.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:52 smithi195 ceph-mon[97365]: pgmap v843: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 2.3 MiB/s wr, 307 op/s 2023-07-21T22:45:54.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:54 smithi151 ceph-mon[95510]: pgmap v844: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 3.3 MiB/s wr, 433 op/s 2023-07-21T22:45:55.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:54 smithi187 ceph-mon[96918]: pgmap v844: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 3.3 MiB/s wr, 433 op/s 2023-07-21T22:45:55.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:54 smithi195 ceph-mon[97365]: pgmap v844: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 3.3 MiB/s wr, 433 op/s 2023-07-21T22:45:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.576+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3921918276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 msgr2=0x7f83a4105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.576+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3921918276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 0x7f83a4105ee0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f8394009990 tx=0x7f8394009ca0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.576+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3921918276 shutdown_connections 2023-07-21T22:45:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.576+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3921918276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83a41004b0 0x7f83a410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.576+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3921918276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 0x7f83a4105ee0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.576+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3921918276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a40ffb00 0x7f83a40fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.576+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3921918276 >> 172.21.15.151:0/3921918276 conn(0x7f83a40fb600 msgr2=0x7f83a40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.576+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3921918276 shutdown_connections 2023-07-21T22:45:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.576+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3921918276 wait complete. 2023-07-21T22:45:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.577+0000 7f83aa5ff700 1 Processor -- start 2023-07-21T22:45:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.577+0000 7f83aa5ff700 1 -- start start 2023-07-21T22:45:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83aa5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83a40ffb00 0x7f83a40729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83aa5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a41004b0 0x7f83a4072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83aa5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 0x7f83a41a3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83aa5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a41a4220 con 0x7f83a4105b10 2023-07-21T22:45:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83aa5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a41a4360 con 0x7f83a41004b0 2023-07-21T22:45:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83aa5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a41a44d0 con 0x7f83a40ffb00 2023-07-21T22:45:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83a8b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 0x7f83a41a3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83a40ffb00 0x7f83a40729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83a8b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 0x7f83a41a3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42312/0 (socket says 172.21.15.151:42312) 2023-07-21T22:45:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83a8b9c700 1 -- 172.21.15.151:0/3252850770 learned_addr learned my addr 172.21.15.151:0/3252850770 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.578+0000 7f83a37fe700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a41004b0 0x7f83a4072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83a8b9c700 1 -- 172.21.15.151:0/3252850770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83a40ffb00 msgr2=0x7f83a40729f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83a40ffb00 0x7f83a40729f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83a8b9c700 1 -- 172.21.15.151:0/3252850770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a41004b0 msgr2=0x7f83a4072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a41004b0 0x7f83a4072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83a8b9c700 1 -- 172.21.15.151:0/3252850770 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83940095f0 con 0x7f83a4105b10 2023-07-21T22:45:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 0x7f83a41a3ce0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f839c00ef30 tx=0x7f839c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83a17fa700 1 -- 172.21.15.151:0/3252850770 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c018070 con 0x7f83a4105b10 2023-07-21T22:45:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83a17fa700 1 -- 172.21.15.151:0/3252850770 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f839c00f040 con 0x7f83a4105b10 2023-07-21T22:45:56.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3252850770 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a41a4750 con 0x7f83a4105b10 2023-07-21T22:45:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83a17fa700 1 -- 172.21.15.151:0/3252850770 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c00cbc0 con 0x7f83a4105b10 2023-07-21T22:45:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.579+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3252850770 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a41a4cb0 con 0x7f83a4105b10 2023-07-21T22:45:56.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.583+0000 7f83a17fa700 1 -- 172.21.15.151:0/3252850770 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f839c00cd60 con 0x7f83a4105b10 2023-07-21T22:45:56.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.584+0000 7f83bdfbab80 1 Processor -- start 2023-07-21T22:45:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.584+0000 7f83bdfbab80 1 -- start start 2023-07-21T22:45:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.584+0000 7f83a17fa700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f838c0a1340 0x7f838c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83a17fa700 1 -- 172.21.15.151:0/3252850770 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f839c0cc710 con 0x7f83a4105b10 2023-07-21T22:45:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b65cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83a37fe700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f838c0a1340 0x7f838c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b604a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1a65c50 con 0x55d8f1b66210 2023-07-21T22:45:56.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1ab89e0 con 0x55d8f19bc6b0 2023-07-21T22:45:56.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1ab1e70 con 0x55d8f1b66660 2023-07-21T22:45:56.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b65cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b65cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45456/0 (socket says 172.21.15.151:45456) 2023-07-21T22:45:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83a3fff700 1 -- 172.21.15.151:0/1568918960 learned_addr learned my addr 172.21.15.151:0/1568918960 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83a37fe700 1 --2- 172.21.15.151:0/1568918960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.585+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/1568918960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f83a3fff700 1 -- 172.21.15.151:0/1568918960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 msgr2=0x55d8f1b604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f83a3fff700 1 --2- 172.21.15.151:0/1568918960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f83a3fff700 1 -- 172.21.15.151:0/1568918960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 msgr2=0x55d8f1b5ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:56.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f83a3fff700 1 --2- 172.21.15.151:0/1568918960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f83a3fff700 1 -- 172.21.15.151:0/1568918960 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8f18dfd80 con 0x55d8f19bc6b0 2023-07-21T22:45:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f83a3fff700 1 --2- 172.21.15.151:0/1568918960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b65cd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8394000c00 tx=0x7f8394005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a4f6049993ad1d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f83a37fe700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f838c0a1340 0x7f838c0a37f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8398009fd0 tx=0x7f8398009b40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f838a7fc700 1 -- 172.21.15.151:0/1568918960 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839401d070 con 0x55d8f19bc6b0 2023-07-21T22:45:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f838a7fc700 1 -- 172.21.15.151:0/1568918960 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f839401e040 con 0x55d8f19bc6b0 2023-07-21T22:45:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.586+0000 7f838a7fc700 1 -- 172.21.15.151:0/1568918960 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8394004760 con 0x55d8f19bc6b0 2023-07-21T22:45:56.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.587+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1568918960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 msgr2=0x55d8f1b65cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.587+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1568918960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b65cd0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8394000c00 tx=0x7f8394005bc0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.587+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1568918960 shutdown_connections 2023-07-21T22:45:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.587+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1568918960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b65cd0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.587+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1568918960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.587+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1568918960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.587+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1568918960 >> 172.21.15.151:0/1568918960 conn(0x55d8f1b55ae0 msgr2=0x55d8f1b5b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.587+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1568918960 shutdown_connections 2023-07-21T22:45:56.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.587+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1568918960 wait complete. 2023-07-21T22:45:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.588+0000 7f83bdfbab80 1 -- start start 2023-07-21T22:45:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.588+0000 7f83bdfbab80 1 Processor -- start 2023-07-21T22:45:56.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.588+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.588+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66210 0x55d8f1b6fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.588+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 0x55d8f1b697e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.588+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1a51a60 con 0x55d8f19bc6b0 2023-07-21T22:45:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.588+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1a51760 con 0x55d8f1b66660 2023-07-21T22:45:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.588+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f19358c0 con 0x55d8f1b66210 2023-07-21T22:45:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.588+0000 7f83bdfbab80 10 client.0 _ll_register_callbacks cb 0x55d8f1a4f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42326/0 (socket says 172.21.15.151:42326) 2023-07-21T22:45:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a3fff700 1 -- 172.21.15.151:0/1626688382 learned_addr learned my addr 172.21.15.151:0/1626688382 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a37fe700 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66210 0x55d8f1b6fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 0x55d8f1b697e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a3fff700 1 -- 172.21.15.151:0/1626688382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66210 msgr2=0x55d8f1b6fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a3fff700 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66210 0x55d8f1b6fa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a3fff700 1 -- 172.21.15.151:0/1626688382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 msgr2=0x55d8f1b697e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a3fff700 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 0x55d8f1b697e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a3fff700 1 -- 172.21.15.151:0/1626688382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a410d240 con 0x55d8f19bc6b0 2023-07-21T22:45:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83a3fff700 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f4e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8394009ce0 tx=0x7f839400b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44443930a538e2f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.589+0000 7f83837fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:45:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83837fe700 1 -- 172.21.15.151:0/1626688382 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839401d040 con 0x55d8f19bc6b0 2023-07-21T22:45:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1626688382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8f1a0b490 con 0x55d8f19bc6b0 2023-07-21T22:45:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83837fe700 1 -- 172.21.15.151:0/1626688382 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8394004500 con 0x55d8f19bc6b0 2023-07-21T22:45:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83837fe700 1 -- 172.21.15.151:0/1626688382 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f83940046c0 con 0x55d8f19bc6b0 2023-07-21T22:45:56.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83bdfbab80 10 client.18462 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1626688382 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55d8f18c8c00 con 0x55d8f19bc6b0 2023-07-21T22:45:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83837fe700 1 -- 172.21.15.151:0/1626688382 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f839403d020 con 0x55d8f19bc6b0 2023-07-21T22:45:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83837fe700 1 -- 172.21.15.151:0/1626688382 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f83940238e0 con 0x55d8f19bc6b0 2023-07-21T22:45:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83bdfbab80 10 client.18462 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83bdfbab80 10 client.18462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.590+0000 7f83bdfbab80 20 client.18462 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.591+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d8f1b794a0 0x55d8f1b7b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.591+0000 7f83bdfbab80 4 client.18462 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.591+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1626688382 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8f1aaae50 con 0x55d8f1b794a0 2023-07-21T22:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.591+0000 7f83a37fe700 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d8f1b794a0 0x55d8f1b7b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.592+0000 7f83837fe700 10 client.18462 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.592+0000 7f83a37fe700 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d8f1b794a0 0x55d8f1b7b880 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f717a89a88219bc0 server_cookie=701c102fc466f91e in_seq=0 out_seq=0 2023-07-21T22:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.592+0000 7f83837fe700 1 -- 172.21.15.151:0/1626688382 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d8f1aaae50 con 0x55d8f1b794a0 2023-07-21T22:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.592+0000 7f83837fe700 10 client.18462 handle_command_reply: tid=0 2023-07-21T22:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.592+0000 7f83bdfbab80 1 client.18462 shutdown 2023-07-21T22:45:56.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1626688382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f19bc6b0 msgr2=0x55d8f1b6f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f4e0 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f8394009ce0 tx=0x7f839400b400 comp rx=0 tx=0).stop 2023-07-21T22:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1626688382 shutdown_connections 2023-07-21T22:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d8f1b794a0 0x55d8f1b7b880 crc :-1 s=READY pgs=336 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 0x55d8f1b697e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f4e0 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/1626688382 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66210 0x55d8f1b6fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1626688382 >> 172.21.15.151:0/1626688382 conn(0x55d8f1b55ae0 msgr2=0x55d8f1b5a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83837fe700 0 client.18462 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1626688382 shutdown_connections 2023-07-21T22:45:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 1 -- 172.21.15.151:0/1626688382 wait complete. 2023-07-21T22:45:56.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.593+0000 7f83bdfbab80 20 client.18462 trim_cache size 0 max 16384 2023-07-21T22:45:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.609+0000 7f83bdfbab80 1 Processor -- start 2023-07-21T22:45:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.609+0000 7f83bdfbab80 1 -- start start 2023-07-21T22:45:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.609+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b69910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.609+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.609+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 0x55d8f1b67160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.609+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1b64550 con 0x55d8f1b66210 2023-07-21T22:45:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.609+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1b5ca00 con 0x55d8f1b66660 2023-07-21T22:45:56.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.609+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1b60ec0 con 0x55d8f19bc6b0 2023-07-21T22:45:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b69910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42340/0 (socket says 172.21.15.151:42340) 2023-07-21T22:45:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a37fe700 1 -- 172.21.15.151:0/984396541 learned_addr learned my addr 172.21.15.151:0/984396541 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 0x55d8f1b67160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a8b9c700 1 -- 172.21.15.151:0/984396541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f19bc6b0 msgr2=0x55d8f1b69910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b69910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a8b9c700 1 -- 172.21.15.151:0/984396541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 msgr2=0x55d8f1b5ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a8b9c700 1 -- 172.21.15.151:0/984396541 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8f19061f0 con 0x55d8f1b66660 2023-07-21T22:45:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a3fff700 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b69910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a37fe700 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.610+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 0x55d8f1b67160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f839c0c9e20 tx=0x7f839c099190 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dc7a305442256e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f838affd700 1 -- 172.21.15.151:0/984396541 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c09d860 con 0x55d8f1b66660 2023-07-21T22:45:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f838affd700 1 -- 172.21.15.151:0/984396541 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f839c0a1bf0 con 0x55d8f1b66660 2023-07-21T22:45:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f838affd700 1 -- 172.21.15.151:0/984396541 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c098d20 con 0x55d8f1b66660 2023-07-21T22:45:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f83bdfbab80 1 -- 172.21.15.151:0/984396541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 msgr2=0x55d8f1b67160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 0x55d8f1b67160 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f839c0c9e20 tx=0x7f839c099190 comp rx=0 tx=0).stop 2023-07-21T22:45:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f83bdfbab80 1 -- 172.21.15.151:0/984396541 shutdown_connections 2023-07-21T22:45:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f1b66660 0x55d8f1b67160 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b69910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/984396541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b5ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.611+0000 7f83bdfbab80 1 -- 172.21.15.151:0/984396541 >> 172.21.15.151:0/984396541 conn(0x55d8f1b55ae0 msgr2=0x55d8f1b66a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.612+0000 7f83bdfbab80 1 -- 172.21.15.151:0/984396541 shutdown_connections 2023-07-21T22:45:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.612+0000 7f83bdfbab80 1 -- 172.21.15.151:0/984396541 wait complete. 2023-07-21T22:45:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.612+0000 7f83bdfbab80 1 -- start start 2023-07-21T22:45:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.612+0000 7f83bdfbab80 1 Processor -- start 2023-07-21T22:45:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b6da50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83bdfbab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b6df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1b6e510 con 0x55d8f1b66210 2023-07-21T22:45:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1b6e680 con 0x55d8f19bc6b0 2023-07-21T22:45:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83bdfbab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8f1b6e840 con 0x55d8f1b66660 2023-07-21T22:45:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83bdfbab80 10 client.0 _ll_register_callbacks cb 0x7f8398013500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:45:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a8b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b6df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b6da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a8b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b6df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42458/0 (socket says 172.21.15.151:42458) 2023-07-21T22:45:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a8b9c700 1 -- 172.21.15.151:0/2616328073 learned_addr learned my addr 172.21.15.151:0/2616328073 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:45:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45484/0 (socket says 172.21.15.151:45484) 2023-07-21T22:45:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a8b9c700 1 -- 172.21.15.151:0/2616328073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 msgr2=0x55d8f1b6f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a8b9c700 1 -- 172.21.15.151:0/2616328073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 msgr2=0x55d8f1b6da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:45:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b6da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a8b9c700 1 -- 172.21.15.151:0/2616328073 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8f18c8c00 con 0x55d8f1b66660 2023-07-21T22:45:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.613+0000 7f83a37fe700 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b6da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:45:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.614+0000 7f83a8b9c700 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b6df90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f839c0c9e80 tx=0x7f839c09d8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44d6d925573a00e7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:45:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.614+0000 7f83837fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:45:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.614+0000 7f83837fe700 1 -- 172.21.15.151:0/2616328073 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c099a90 con 0x55d8f1b66660 2023-07-21T22:45:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.614+0000 7f83bdfbab80 1 -- 172.21.15.151:0/2616328073 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f839401e040 con 0x55d8f1b66660 2023-07-21T22:45:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.614+0000 7f83837fe700 1 -- 172.21.15.151:0/2616328073 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(128..128 src has 1..128) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f839c099bf0 con 0x55d8f1b66660 2023-07-21T22:45:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.614+0000 7f83837fe700 1 -- 172.21.15.151:0/2616328073 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f839c0a1760 con 0x55d8f1b66660 2023-07-21T22:45:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.614+0000 7f83bdfbab80 10 client.28171 fetch_fsmap learned FSMap version 89 2023-07-21T22:45:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.614+0000 7f83bdfbab80 1 -- 172.21.15.151:0/2616328073 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x7f8398013e70 con 0x55d8f1b66660 2023-07-21T22:45:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.615+0000 7f83837fe700 1 -- 172.21.15.151:0/2616328073 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f839c07c080 con 0x55d8f1b66660 2023-07-21T22:45:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.615+0000 7f83837fe700 1 -- 172.21.15.151:0/2616328073 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f839c09dac0 con 0x55d8f1b66660 2023-07-21T22:45:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.615+0000 7f83bdfbab80 10 client.28171 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:45:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.615+0000 7f83bdfbab80 10 client.28171 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:45:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.615+0000 7f83bdfbab80 20 client.28171 populate_metadata read hostname 'smithi151' 2023-07-21T22:45:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.615+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d8f1bce350 0x55d8f1bd0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:45:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.615+0000 7f83bdfbab80 4 client.28171 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:45:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.615+0000 7f83bdfbab80 1 -- 172.21.15.151:0/2616328073 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d8f1a6cff0 con 0x55d8f1bce350 2023-07-21T22:45:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.615+0000 7f83a3fff700 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d8f1bce350 0x55d8f1bd0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:45:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.616+0000 7f83837fe700 10 client.28171 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:56.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.616+0000 7f83a3fff700 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d8f1bce350 0x55d8f1bd0730 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80f6219a3a59d457 server_cookie=fb7b14702d0d4e1d in_seq=0 out_seq=0 2023-07-21T22:45:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83837fe700 1 -- 172.21.15.151:0/2616328073 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d8f1a6cff0 con 0x55d8f1bce350 2023-07-21T22:45:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83837fe700 10 client.28171 handle_command_reply: tid=0 2023-07-21T22:45:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83bdfbab80 1 client.28171 shutdown 2023-07-21T22:45:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83bdfbab80 1 -- 172.21.15.151:0/2616328073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 msgr2=0x55d8f1b6df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b6df90 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f839c0c9e80 tx=0x7f839c09d8e0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83bdfbab80 1 -- 172.21.15.151:0/2616328073 shutdown_connections 2023-07-21T22:45:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d8f1bce350 0x55d8f1bd0730 crc :-1 s=READY pgs=337 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8f19bc6b0 0x55d8f1b6f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d8f1b66660 0x55d8f1b6df90 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83bdfbab80 1 --2- 172.21.15.151:0/2616328073 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d8f1b66210 0x55d8f1b6da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83837fe700 0 client.28171 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:45:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.625+0000 7f83bdfbab80 1 -- 172.21.15.151:0/2616328073 >> 172.21.15.151:0/2616328073 conn(0x55d8f1b55ae0 msgr2=0x55d8f1b672c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83bdfbab80 1 -- 172.21.15.151:0/2616328073 shutdown_connections 2023-07-21T22:45:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83bdfbab80 1 -- 172.21.15.151:0/2616328073 wait complete. 2023-07-21T22:45:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83bdfbab80 20 client.28171 trim_cache size 0 max 16384 2023-07-21T22:45:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:45:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:45:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:45:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:45:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f838c0a1340 msgr2=0x7f838c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f838c0a1340 0x7f838c0a37f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f8398009fd0 tx=0x7f8398009b40 comp rx=0 tx=0).stop 2023-07-21T22:45:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 msgr2=0x7f83a41a3ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:45:56.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 0x7f83a41a3ce0 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f839c00ef30 tx=0x7f839c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3252850770 shutdown_connections 2023-07-21T22:45:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f838c0a1340 0x7f838c0a37f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83a4105b10 0x7f83a41a3ce0 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83a40ffb00 0x7f83a40729f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.626+0000 7f83aa5ff700 1 --2- 172.21.15.151:0/3252850770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83a41004b0 0x7f83a4072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:45:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.627+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3252850770 >> 172.21.15.151:0/3252850770 conn(0x7f83a40fb600 msgr2=0x7f83a40fbc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:45:56.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.627+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3252850770 shutdown_connections 2023-07-21T22:45:56.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:45:56.627+0000 7f83aa5ff700 1 -- 172.21.15.151:0/3252850770 wait complete. 2023-07-21T22:45:56.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:56 smithi151 ceph-mon[95510]: pgmap v845: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 269 op/s 2023-07-21T22:45:57.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:56 smithi187 ceph-mon[96918]: pgmap v845: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 269 op/s 2023-07-21T22:45:57.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:56 smithi195 ceph-mon[97365]: pgmap v845: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.0 MiB/s wr, 269 op/s 2023-07-21T22:45:58.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:45:58 smithi151 ceph-mon[95510]: pgmap v846: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-07-21T22:45:59.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:45:58 smithi187 ceph-mon[96918]: pgmap v846: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-07-21T22:45:59.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:45:58 smithi195 ceph-mon[97365]: pgmap v846: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 3.0 MiB/s wr, 389 op/s 2023-07-21T22:46:00.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:00 smithi151 ceph-mon[95510]: pgmap v847: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.9 MiB/s wr, 246 op/s 2023-07-21T22:46:01.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:00 smithi187 ceph-mon[96918]: pgmap v847: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.9 MiB/s wr, 246 op/s 2023-07-21T22:46:01.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:00 smithi195 ceph-mon[97365]: pgmap v847: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.9 MiB/s wr, 246 op/s 2023-07-21T22:46:02.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:02 smithi151 ceph-mon[95510]: pgmap v848: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.9 MiB/s wr, 246 op/s 2023-07-21T22:46:03.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:02 smithi187 ceph-mon[96918]: pgmap v848: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.9 MiB/s wr, 246 op/s 2023-07-21T22:46:03.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:02 smithi195 ceph-mon[97365]: pgmap v848: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.9 MiB/s wr, 246 op/s 2023-07-21T22:46:04.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:04 smithi151 ceph-mon[95510]: pgmap v849: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.8 MiB/s wr, 376 op/s 2023-07-21T22:46:05.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:04 smithi187 ceph-mon[96918]: pgmap v849: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.8 MiB/s wr, 376 op/s 2023-07-21T22:46:05.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:04 smithi195 ceph-mon[97365]: pgmap v849: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.8 MiB/s wr, 376 op/s 2023-07-21T22:46:06.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:06 smithi151 ceph-mon[95510]: pgmap v850: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 250 op/s 2023-07-21T22:46:07.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:06 smithi187 ceph-mon[96918]: pgmap v850: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 250 op/s 2023-07-21T22:46:07.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:06 smithi195 ceph-mon[97365]: pgmap v850: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.8 MiB/s wr, 250 op/s 2023-07-21T22:46:08.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:08 smithi151 ceph-mon[95510]: pgmap v851: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.7 MiB/s wr, 359 op/s 2023-07-21T22:46:09.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:08 smithi187 ceph-mon[96918]: pgmap v851: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.7 MiB/s wr, 359 op/s 2023-07-21T22:46:09.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:08 smithi195 ceph-mon[97365]: pgmap v851: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.7 MiB/s wr, 359 op/s 2023-07-21T22:46:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.872+0000 7faf08bff700 1 -- 172.21.15.151:0/88229178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406d3a0 msgr2=0x7faf0411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.872+0000 7faf08bff700 1 --2- 172.21.15.151:0/88229178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406d3a0 0x7faf0411b470 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faeec01a9a0 tx=0x7faeec01acb0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.873+0000 7faf08bff700 1 -- 172.21.15.151:0/88229178 shutdown_connections 2023-07-21T22:46:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.873+0000 7faf08bff700 1 --2- 172.21.15.151:0/88229178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406d3a0 0x7faf0411b470 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.873+0000 7faf08bff700 1 --2- 172.21.15.151:0/88229178 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0410e2a0 0x7faf0410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.873+0000 7faf08bff700 1 --2- 172.21.15.151:0/88229178 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf0406c910 0x7faf0406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.873+0000 7faf08bff700 1 -- 172.21.15.151:0/88229178 >> 172.21.15.151:0/88229178 conn(0x7faf0406bd70 msgr2=0x7faf04070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.876+0000 7faf08bff700 1 -- 172.21.15.151:0/88229178 shutdown_connections 2023-07-21T22:46:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.877+0000 7faf08bff700 1 -- 172.21.15.151:0/88229178 wait complete. 2023-07-21T22:46:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.878+0000 7faf08bff700 1 Processor -- start 2023-07-21T22:46:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.879+0000 7faf08bff700 1 -- start start 2023-07-21T22:46:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.879+0000 7faf08bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406c910 0x7faf04116cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.879+0000 7faf08bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0406d3a0 0x7faf04117200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.879+0000 7faf08bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf0410e2a0 0x7faf0411a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.879+0000 7faf08bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0411aea0 con 0x7faf0410e2a0 2023-07-21T22:46:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.879+0000 7faf08bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0411b010 con 0x7faf0406c910 2023-07-21T22:46:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.879+0000 7faf08bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf0411b1d0 con 0x7faf0406d3a0 2023-07-21T22:46:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.880+0000 7faf0259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406c910 0x7faf04116cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.880+0000 7faf0259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406c910 0x7faf04116cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57588/0 (socket says 172.21.15.151:57588) 2023-07-21T22:46:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.880+0000 7faf0259c700 1 -- 172.21.15.151:0/1962026351 learned_addr learned my addr 172.21.15.151:0/1962026351 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.881+0000 7faf01d9b700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0406d3a0 0x7faf04117200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.881+0000 7faf0259c700 1 -- 172.21.15.151:0/1962026351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0406d3a0 msgr2=0x7faf04117200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.881+0000 7faf0259c700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0406d3a0 0x7faf04117200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.881+0000 7faf0259c700 1 -- 172.21.15.151:0/1962026351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf0410e2a0 msgr2=0x7faf0411a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.881+0000 7faf0259c700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf0410e2a0 0x7faf0411a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.881+0000 7faf0259c700 1 -- 172.21.15.151:0/1962026351 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec01a600 con 0x7faf0406c910 2023-07-21T22:46:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.881+0000 7faf0259c700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406c910 0x7faf04116cc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d950 tx=0x7faefc00dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.882+0000 7faefb7fe700 1 -- 172.21.15.151:0/1962026351 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc009b40 con 0x7faf0406c910 2023-07-21T22:46:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.882+0000 7faefb7fe700 1 -- 172.21.15.151:0/1962026351 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faefc009ca0 con 0x7faf0406c910 2023-07-21T22:46:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.882+0000 7faefb7fe700 1 -- 172.21.15.151:0/1962026351 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faefc00f3c0 con 0x7faf0406c910 2023-07-21T22:46:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.882+0000 7faf08bff700 1 -- 172.21.15.151:0/1962026351 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf0411b4b0 con 0x7faf0406c910 2023-07-21T22:46:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.882+0000 7faf08bff700 1 -- 172.21.15.151:0/1962026351 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf041a9210 con 0x7faf0406c910 2023-07-21T22:46:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.889+0000 7faf1c5b5b80 1 Processor -- start 2023-07-21T22:46:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.890+0000 7faf1c5b5b80 1 -- start start 2023-07-21T22:46:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.891+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.891+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536210 0x55cf7e52ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.891+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e5304a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.891+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e435c50 con 0x55cf7e536660 2023-07-21T22:46:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.891+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e4889e0 con 0x55cf7e536210 2023-07-21T22:46:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.891+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e481e70 con 0x55cf7e38c6b0 2023-07-21T22:46:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.891+0000 7faf02d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.892+0000 7faf02d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:59226/0 (socket says 172.21.15.151:59226) 2023-07-21T22:46:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.892+0000 7faf02d9d700 1 -- 172.21.15.151:0/1298007576 learned_addr learned my addr 172.21.15.151:0/1298007576 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.893+0000 7faf01d9b700 1 --2- 172.21.15.151:0/1298007576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e5304a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.894+0000 7faf02d9d700 1 -- 172.21.15.151:0/1298007576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536210 msgr2=0x55cf7e52ff40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:46:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.894+0000 7faf02d9d700 1 --2- 172.21.15.151:0/1298007576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536210 0x55cf7e52ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.894+0000 7faf02d9d700 1 -- 172.21.15.151:0/1298007576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 msgr2=0x55cf7e5304a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.894+0000 7faf02d9d700 1 --2- 172.21.15.151:0/1298007576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e5304a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.894+0000 7faf02d9d700 1 -- 172.21.15.151:0/1298007576 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf7e2afd80 con 0x55cf7e38c6b0 2023-07-21T22:46:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.894+0000 7faefb7fe700 1 -- 172.21.15.151:0/1962026351 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7faefc010460 con 0x7faf0406c910 2023-07-21T22:46:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.894+0000 7faf02d9d700 1 --2- 172.21.15.151:0/1298007576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faeec005b40 tx=0x7faeec005ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4ca826de34802b66 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.896+0000 7faefb7fe700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faef00a1450 0x7faef00a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.896+0000 7faefb7fe700 1 -- 172.21.15.151:0/1962026351 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 8536+0+0 (secure 0 0 0) 0x7faefc0ccc40 con 0x7faf0406c910 2023-07-21T22:46:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.896+0000 7faf0259c700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faef00a1450 0x7faef00a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.897+0000 7faef8ff9700 1 -- 172.21.15.151:0/1298007576 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec01c9f0 con 0x55cf7e38c6b0 2023-07-21T22:46:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.897+0000 7faef8ff9700 1 -- 172.21.15.151:0/1298007576 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faeec005220 con 0x55cf7e38c6b0 2023-07-21T22:46:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.897+0000 7faef8ff9700 1 -- 172.21.15.151:0/1298007576 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec003e30 con 0x55cf7e38c6b0 2023-07-21T22:46:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.898+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1298007576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 msgr2=0x55cf7e535cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.898+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1298007576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535cd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7faeec005b40 tx=0x7faeec005ab0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.898+0000 7faf0259c700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faef00a1450 0x7faef00a3900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faefc099a00 tx=0x7faefc010990 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.899+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1298007576 shutdown_connections 2023-07-21T22:46:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.899+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1298007576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e5304a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.899+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1298007576 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535cd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.899+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1298007576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536210 0x55cf7e52ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.899+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1298007576 >> 172.21.15.151:0/1298007576 conn(0x55cf7e525ae0 msgr2=0x55cf7e52b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.899+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1298007576 shutdown_connections 2023-07-21T22:46:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.899+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1298007576 wait complete. 2023-07-21T22:46:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.900+0000 7faf1c5b5b80 1 -- start start 2023-07-21T22:46:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.900+0000 7faf1c5b5b80 1 Processor -- start 2023-07-21T22:46:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.901+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 0x55cf7e53f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.901+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536210 0x55cf7e53fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.901+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536660 0x55cf7e539890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.901+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e421a60 con 0x55cf7e536210 2023-07-21T22:46:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.901+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e421760 con 0x55cf7e536660 2023-07-21T22:46:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.901+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e3058c0 con 0x55cf7e38c6b0 2023-07-21T22:46:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.901+0000 7faf1c5b5b80 10 client.0 _ll_register_callbacks cb 0x55cf7e41f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:46:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.902+0000 7faf02d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536660 0x55cf7e539890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.902+0000 7faf02d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536660 0x55cf7e539890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57600/0 (socket says 172.21.15.151:57600) 2023-07-21T22:46:09.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.902+0000 7faf02d9d700 1 -- 172.21.15.151:0/1029959358 learned_addr learned my addr 172.21.15.151:0/1029959358 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.902+0000 7faf01d9b700 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536210 0x55cf7e53fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.903+0000 7faf01d9b700 1 -- 172.21.15.151:0/1029959358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 msgr2=0x55cf7e53f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.903+0000 7faf01d9b700 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 0x55cf7e53f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.903+0000 7faf01d9b700 1 -- 172.21.15.151:0/1029959358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536660 msgr2=0x55cf7e539890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.903+0000 7faf01d9b700 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536660 0x55cf7e539890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.903+0000 7faf01d9b700 1 -- 172.21.15.151:0/1029959358 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf0411bfb0 con 0x55cf7e536210 2023-07-21T22:46:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.904+0000 7faf01d9b700 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536210 0x55cf7e53fb40 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7faf041184e0 tx=0x7faef400ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20a7b68e42e613d7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.904+0000 7faee9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:46:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.904+0000 7faee9ffb700 1 -- 172.21.15.151:0/1029959358 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faef4011040 con 0x55cf7e536210 2023-07-21T22:46:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.904+0000 7faee9ffb700 1 -- 172.21.15.151:0/1029959358 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8536+0+0 (secure 0 0 0) 0x7faef4006e40 con 0x55cf7e536210 2023-07-21T22:46:09.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.904+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1029959358 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cf7e3db490 con 0x55cf7e536210 2023-07-21T22:46:09.945 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:09 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:46:09.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.905+0000 7faee9ffb700 1 -- 172.21.15.151:0/1029959358 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7faef4007940 con 0x55cf7e536210 2023-07-21T22:46:09.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.905+0000 7faf1c5b5b80 10 client.18474 fetch_fsmap learned FSMap version 89 2023-07-21T22:46:09.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.905+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1029959358 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55cf7e298c00 con 0x55cf7e536210 2023-07-21T22:46:09.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.906+0000 7faee9ffb700 1 -- 172.21.15.151:0/1029959358 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faef4023020 con 0x55cf7e536210 2023-07-21T22:46:09.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.906+0000 7faee9ffb700 1 -- 172.21.15.151:0/1029959358 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faef4015b20 con 0x55cf7e536210 2023-07-21T22:46:09.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.906+0000 7faf1c5b5b80 10 client.18474 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:46:09.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.906+0000 7faf1c5b5b80 10 client.18474 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:46:09.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.906+0000 7faf1c5b5b80 20 client.18474 populate_metadata read hostname 'smithi151' 2023-07-21T22:46:09.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.906+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cf7e549b80 0x55cf7e54bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.906+0000 7faf1c5b5b80 4 client.18474 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:46:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.906+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1029959358 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cf7e47ae50 con 0x55cf7e549b80 2023-07-21T22:46:09.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.907+0000 7faf02d9d700 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cf7e549b80 0x55cf7e54bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.908+0000 7faf02d9d700 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cf7e549b80 0x55cf7e54bf90 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e55bf8865ccfa32 server_cookie=f8b1ce6b600a7ecf in_seq=0 out_seq=0 2023-07-21T22:46:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.908+0000 7faee9ffb700 10 client.18474 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.909+0000 7faee9ffb700 1 -- 172.21.15.151:0/1029959358 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cf7e47ae50 con 0x55cf7e549b80 2023-07-21T22:46:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.909+0000 7faee9ffb700 10 client.18474 handle_command_reply: tid=0 2023-07-21T22:46:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.909+0000 7faf1c5b5b80 1 client.18474 shutdown 2023-07-21T22:46:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.909+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1029959358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536210 msgr2=0x55cf7e53fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.909+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536210 0x55cf7e53fb40 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7faf041184e0 tx=0x7faef400ab90 comp rx=0 tx=0).stop 2023-07-21T22:46:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1029959358 shutdown_connections 2023-07-21T22:46:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cf7e549b80 0x55cf7e54bf90 crc :-1 s=READY pgs=338 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e536660 0x55cf7e539890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e38c6b0 0x55cf7e53f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/1029959358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536210 0x55cf7e53fb40 secure :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7faf041184e0 tx=0x7faef400ab90 comp rx=0 tx=0).stop 2023-07-21T22:46:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1029959358 >> 172.21.15.151:0/1029959358 conn(0x55cf7e525ae0 msgr2=0x55cf7e52a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faee9ffb700 0 client.18474 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:09.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1029959358 shutdown_connections 2023-07-21T22:46:09.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/1029959358 wait complete. 2023-07-21T22:46:09.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.910+0000 7faf1c5b5b80 20 client.18474 trim_cache size 0 max 16384 2023-07-21T22:46:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.929+0000 7faf1c5b5b80 1 Processor -- start 2023-07-21T22:46:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.929+0000 7faf1c5b5b80 1 -- start start 2023-07-21T22:46:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.929+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.929+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e52ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.929+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 0x55cf7e52ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.929+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e5274f0 con 0x55cf7e536660 2023-07-21T22:46:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.929+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e537e10 con 0x55cf7e38c6b0 2023-07-21T22:46:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.929+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e534560 con 0x55cf7e530480 2023-07-21T22:46:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf02d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf02d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57612/0 (socket says 172.21.15.151:57612) 2023-07-21T22:46:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf02d9d700 1 -- 172.21.15.151:0/29133325 learned_addr learned my addr 172.21.15.151:0/29133325 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:09.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf02d9d700 1 --2- 172.21.15.151:0/29133325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 0x55cf7e52ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf01d9b700 1 --2- 172.21.15.151:0/29133325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e52ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf02d9d700 1 -- 172.21.15.151:0/29133325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 msgr2=0x55cf7e52ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf02d9d700 1 --2- 172.21.15.151:0/29133325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 0x55cf7e52ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf02d9d700 1 -- 172.21.15.151:0/29133325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 msgr2=0x55cf7e52ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:09.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf02d9d700 1 --2- 172.21.15.151:0/29133325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e52ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.930+0000 7faf02d9d700 1 -- 172.21.15.151:0/29133325 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cf7e52c7e0 con 0x55cf7e38c6b0 2023-07-21T22:46:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.931+0000 7faf02d9d700 1 --2- 172.21.15.151:0/29133325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faeec000c00 tx=0x7faeec01af70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7977e9f779650ce2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.931+0000 7faef97fa700 1 -- 172.21.15.151:0/29133325 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec041030 con 0x55cf7e38c6b0 2023-07-21T22:46:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.931+0000 7faef97fa700 1 -- 172.21.15.151:0/29133325 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faeec003d50 con 0x55cf7e38c6b0 2023-07-21T22:46:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.931+0000 7faef97fa700 1 -- 172.21.15.151:0/29133325 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec01cc30 con 0x55cf7e38c6b0 2023-07-21T22:46:09.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/29133325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 msgr2=0x55cf7e535200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/29133325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535200 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faeec000c00 tx=0x7faeec01af70 comp rx=0 tx=0).stop 2023-07-21T22:46:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/29133325 shutdown_connections 2023-07-21T22:46:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/29133325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e535200 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/29133325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 0x55cf7e52ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/29133325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e52ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/29133325 >> 172.21.15.151:0/29133325 conn(0x55cf7e525ae0 msgr2=0x55cf7e5397b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/29133325 shutdown_connections 2023-07-21T22:46:09.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/29133325 wait complete. 2023-07-21T22:46:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.932+0000 7faf1c5b5b80 1 -- start start 2023-07-21T22:46:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.933+0000 7faf1c5b5b80 1 Processor -- start 2023-07-21T22:46:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.933+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e53f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.933+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 0x55cf7e53f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.933+0000 7faf1c5b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e53d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e53ddf0 con 0x55cf7e536660 2023-07-21T22:46:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e53df60 con 0x55cf7e38c6b0 2023-07-21T22:46:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf1c5b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cf7e53e120 con 0x55cf7e530480 2023-07-21T22:46:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf1c5b5b80 10 client.0 _ll_register_callbacks cb 0x7faef400a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:46:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf02d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e53f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf01d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 0x55cf7e53f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf02d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e53f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57622/0 (socket says 172.21.15.151:57622) 2023-07-21T22:46:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf02d9d700 1 -- 172.21.15.151:0/3961598613 learned_addr learned my addr 172.21.15.151:0/3961598613 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf02d9d700 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e53d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf02d9d700 1 -- 172.21.15.151:0/3961598613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 msgr2=0x55cf7e53f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf02d9d700 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 0x55cf7e53f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf02d9d700 1 -- 172.21.15.151:0/3961598613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 msgr2=0x55cf7e53d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf02d9d700 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e53d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.934+0000 7faf02d9d700 1 -- 172.21.15.151:0/3961598613 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cf7e2afd80 con 0x55cf7e38c6b0 2023-07-21T22:46:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.935+0000 7faf02d9d700 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e53f310 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faeec01c750 tx=0x7faeec03d040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=75287a1f1432ea61 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.935+0000 7faee9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:46:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.935+0000 7faee9ffb700 1 -- 172.21.15.151:0/3961598613 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faeec041040 con 0x55cf7e38c6b0 2023-07-21T22:46:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.935+0000 7faee9ffb700 1 -- 172.21.15.151:0/3961598613 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(129..129 src has 1..129) v4 ==== 8536+0+0 (secure 0 0 0) 0x7faeec042070 con 0x55cf7e38c6b0 2023-07-21T22:46:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.935+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/3961598613 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faeec005220 con 0x55cf7e38c6b0 2023-07-21T22:46:09.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faee9ffb700 1 -- 172.21.15.151:0/3961598613 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7faeec01c9f0 con 0x55cf7e38c6b0 2023-07-21T22:46:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faf1c5b5b80 10 client.28154 fetch_fsmap learned FSMap version 89 2023-07-21T22:46:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/3961598613 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55cf7e2d61f0 con 0x55cf7e38c6b0 2023-07-21T22:46:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faee9ffb700 1 -- 172.21.15.151:0/3961598613 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faeec005220 con 0x55cf7e38c6b0 2023-07-21T22:46:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faee9ffb700 1 -- 172.21.15.151:0/3961598613 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faeec01c270 con 0x55cf7e38c6b0 2023-07-21T22:46:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faf1c5b5b80 10 client.28154 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:46:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faf1c5b5b80 10 client.28154 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:46:09.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faf1c5b5b80 20 client.28154 populate_metadata read hostname 'smithi151' 2023-07-21T22:46:09.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cf7e59e760 0x55cf7e5a0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:09.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faf1c5b5b80 4 client.28154 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:46:09.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.936+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/3961598613 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cf7e43cff0 con 0x55cf7e59e760 2023-07-21T22:46:09.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.937+0000 7faf01d9b700 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cf7e59e760 0x55cf7e5a0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:09.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.937+0000 7faee9ffb700 10 client.28154 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:09.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.937+0000 7faf01d9b700 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cf7e59e760 0x55cf7e5a0b40 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a385f7f6d2ed3a server_cookie=f41d22a1792873b8 in_seq=0 out_seq=0 2023-07-21T22:46:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.946+0000 7faee9ffb700 1 -- 172.21.15.151:0/3961598613 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cf7e43cff0 con 0x55cf7e59e760 2023-07-21T22:46:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.946+0000 7faee9ffb700 10 client.28154 handle_command_reply: tid=0 2023-07-21T22:46:09.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.946+0000 7faf1c5b5b80 1 client.28154 shutdown 2023-07-21T22:46:09.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.946+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/3961598613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 msgr2=0x55cf7e53f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:09.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.946+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e53f310 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faeec01c750 tx=0x7faeec03d040 comp rx=0 tx=0).stop 2023-07-21T22:46:09.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.948+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/3961598613 shutdown_connections 2023-07-21T22:46:09.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.948+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cf7e59e760 0x55cf7e5a0b40 crc :-1 s=READY pgs=339 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.948+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cf7e38c6b0 0x55cf7e53f310 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.948+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cf7e536660 0x55cf7e53d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.948+0000 7faf1c5b5b80 1 --2- 172.21.15.151:0/3961598613 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cf7e530480 0x55cf7e53f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.948+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/3961598613 >> 172.21.15.151:0/3961598613 conn(0x55cf7e525ae0 msgr2=0x55cf7e536a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.948+0000 7faee9ffb700 0 client.28154 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.948+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/3961598613 shutdown_connections 2023-07-21T22:46:09.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.948+0000 7faf1c5b5b80 1 -- 172.21.15.151:0/3961598613 wait complete. 2023-07-21T22:46:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf1c5b5b80 20 client.28154 trim_cache size 0 max 16384 2023-07-21T22:46:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:46:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:46:09.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:46:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:46:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 -- 172.21.15.151:0/1962026351 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faef00a1450 msgr2=0x7faef00a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faef00a1450 0x7faef00a3900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faefc099a00 tx=0x7faefc010990 comp rx=0 tx=0).stop 2023-07-21T22:46:09.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 -- 172.21.15.151:0/1962026351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406c910 msgr2=0x7faf04116cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406c910 0x7faf04116cc0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d950 tx=0x7faefc00dd10 comp rx=0 tx=0).stop 2023-07-21T22:46:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 -- 172.21.15.151:0/1962026351 shutdown_connections 2023-07-21T22:46:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faef00a1450 0x7faef00a3900 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf0406c910 0x7faf04116cc0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf0410e2a0 0x7faf0411a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 --2- 172.21.15.151:0/1962026351 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf0406d3a0 0x7faf04117200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:09.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.949+0000 7faf08bff700 1 -- 172.21.15.151:0/1962026351 >> 172.21.15.151:0/1962026351 conn(0x7faf0406bd70 msgr2=0x7faf0406f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.950+0000 7faf08bff700 1 -- 172.21.15.151:0/1962026351 shutdown_connections 2023-07-21T22:46:09.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:09.950+0000 7faf08bff700 1 -- 172.21.15.151:0/1962026351 wait complete. 2023-07-21T22:46:10.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:09 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:46:10.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:09 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:46:10.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:10 smithi151 ceph-mon[95510]: pgmap v852: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.8 MiB/s wr, 239 op/s 2023-07-21T22:46:10.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:10 smithi151 ceph-mon[95510]: osdmap e129: 12 total, 12 up, 12 in 2023-07-21T22:46:11.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:10 smithi187 ceph-mon[96918]: pgmap v852: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.8 MiB/s wr, 239 op/s 2023-07-21T22:46:11.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:10 smithi187 ceph-mon[96918]: osdmap e129: 12 total, 12 up, 12 in 2023-07-21T22:46:11.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:10 smithi195 ceph-mon[97365]: pgmap v852: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 1.8 MiB/s wr, 239 op/s 2023-07-21T22:46:11.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:10 smithi195 ceph-mon[97365]: osdmap e129: 12 total, 12 up, 12 in 2023-07-21T22:46:12.906 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:12 smithi187 ceph-mon[96918]: pgmap v854: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.1 MiB/s wr, 287 op/s 2023-07-21T22:46:12.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:12 smithi151 ceph-mon[95510]: pgmap v854: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.1 MiB/s wr, 287 op/s 2023-07-21T22:46:13.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:12 smithi195 ceph-mon[97365]: pgmap v854: 97 pgs: 97 active+clean; 8.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 2.1 MiB/s wr, 287 op/s 2023-07-21T22:46:13.872 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:13 smithi187 ceph-mon[96918]: pgmap v855: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-07-21T22:46:14.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:13 smithi195 ceph-mon[97365]: pgmap v855: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-07-21T22:46:14.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:13 smithi151 ceph-mon[95510]: pgmap v855: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-07-21T22:46:16.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:46:16.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:46:16.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:15 smithi187 ceph-mon[96918]: pgmap v856: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-07-21T22:46:16.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:46:16.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:46:16.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:15 smithi195 ceph-mon[97365]: pgmap v856: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-07-21T22:46:16.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:46:16.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:46:16.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:46:16.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:15 smithi151 ceph-mon[95510]: pgmap v856: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.1 MiB/s wr, 276 op/s 2023-07-21T22:46:17.900 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:17 smithi195 ceph-mon[97365]: osdmap e130: 12 total, 12 up, 12 in 2023-07-21T22:46:17.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:17 smithi151 ceph-mon[95510]: osdmap e130: 12 total, 12 up, 12 in 2023-07-21T22:46:18.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:17 smithi187 ceph-mon[96918]: osdmap e130: 12 total, 12 up, 12 in 2023-07-21T22:46:18.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:18 smithi151 ceph-mon[95510]: pgmap v858: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:46:19.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:18 smithi187 ceph-mon[96918]: pgmap v858: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:46:19.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:18 smithi195 ceph-mon[97365]: pgmap v858: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 2.9 MiB/s wr, 379 op/s 2023-07-21T22:46:20.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:20 smithi151 ceph-mon[95510]: pgmap v859: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 316 op/s 2023-07-21T22:46:21.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:20 smithi187 ceph-mon[96918]: pgmap v859: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 316 op/s 2023-07-21T22:46:21.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:20 smithi195 ceph-mon[97365]: pgmap v859: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.4 MiB/s wr, 316 op/s 2023-07-21T22:46:22.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:22 smithi151 ceph-mon[95510]: pgmap v860: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:46:23.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:22 smithi187 ceph-mon[96918]: pgmap v860: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:46:23.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:22 smithi195 ceph-mon[97365]: pgmap v860: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:46:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.184+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2279087540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9c0728b0 msgr2=0x7f4b9c072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.184+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2279087540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9c0728b0 0x7f4b9c072c80 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009990 tx=0x7f4b8c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.185+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2279087540 shutdown_connections 2023-07-21T22:46:23.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.185+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2279087540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b9c10c340 0x7f4b9c10e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.185+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2279087540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9c0728b0 0x7f4b9c072c80 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.185+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2279087540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b9c0731c0 0x7f4b9c10be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.185+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2279087540 >> 172.21.15.151:0/2279087540 conn(0x7f4b9c0fb600 msgr2=0x7f4b9c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.185+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2279087540 shutdown_connections 2023-07-21T22:46:23.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.185+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2279087540 wait complete. 2023-07-21T22:46:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.186+0000 7f4ba1bff700 1 Processor -- start 2023-07-21T22:46:23.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.186+0000 7f4ba1bff700 1 -- start start 2023-07-21T22:46:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.186+0000 7f4ba1bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b9c0728b0 0x7f4b9c197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.186+0000 7f4ba1bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b9c0731c0 0x7f4b9c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.186+0000 7f4ba1bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9c10c340 0x7f4b9c19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.186+0000 7f4ba1bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c19cf50 con 0x7f4b9c0731c0 2023-07-21T22:46:23.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.186+0000 7f4ba1bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c19d0c0 con 0x7f4b9c0728b0 2023-07-21T22:46:23.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.186+0000 7f4ba1bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b9c19d280 con 0x7f4b9c10c340 2023-07-21T22:46:23.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b9c0731c0 0x7f4b9c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b9c0728b0 0x7f4b9c197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b9c0728b0 0x7f4b9c197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52910/0 (socket says 172.21.15.151:52910) 2023-07-21T22:46:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2531076513 learned_addr learned my addr 172.21.15.151:0/2531076513 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9bfff700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9c10c340 0x7f4b9c19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2531076513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9c10c340 msgr2=0x7f4b9c19c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:23.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9c10c340 0x7f4b9c19c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b9c0731c0 msgr2=0x7f4b9c1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b9c0731c0 0x7f4b9c1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2531076513 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b8c0095f0 con 0x7f4b9c0728b0 2023-07-21T22:46:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9affd700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b9c0731c0 0x7f4b9c1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:46:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.187+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b9c0728b0 0x7f4b9c197d60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c000c00 tx=0x7f4b8c004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:23.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.188+0000 7f4b98ff9700 1 -- 172.21.15.151:0/2531076513 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c01d070 con 0x7f4b9c0728b0 2023-07-21T22:46:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.188+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2531076513 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b9c19d500 con 0x7f4b9c0728b0 2023-07-21T22:46:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.188+0000 7f4b98ff9700 1 -- 172.21.15.151:0/2531076513 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b8c022470 con 0x7f4b9c0728b0 2023-07-21T22:46:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.188+0000 7f4b98ff9700 1 -- 172.21.15.151:0/2531076513 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c017650 con 0x7f4b9c0728b0 2023-07-21T22:46:23.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.188+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2531076513 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c1a4da0 con 0x7f4b9c0728b0 2023-07-21T22:46:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.193+0000 7f4b98ff9700 1 -- 172.21.15.151:0/2531076513 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4b8c0225e0 con 0x7f4b9c0728b0 2023-07-21T22:46:23.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4bb5548b80 1 Processor -- start 2023-07-21T22:46:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4bb5548b80 1 -- start start 2023-07-21T22:46:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b06f6b0 0x55ee7b218cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b212f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4b98ff9700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b840a12c0 0x7f4b840a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219660 0x55ee7b2134a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b118c50 con 0x55ee7b219210 2023-07-21T22:46:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b16b9e0 con 0x55ee7b219660 2023-07-21T22:46:23.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b164e70 con 0x55ee7b06f6b0 2023-07-21T22:46:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.194+0000 7f4b98ff9700 1 -- 172.21.15.151:0/2531076513 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4b8c0ce090 con 0x7f4b9c0728b0 2023-07-21T22:46:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b212f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b06f6b0 0x55ee7b218cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b212f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46892/0 (socket says 172.21.15.151:46892) 2023-07-21T22:46:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2950937011 learned_addr learned my addr 172.21.15.151:0/2950937011 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9affd700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b840a12c0 0x7f4b840a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9bfff700 1 --2- 172.21.15.151:0/2950937011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219660 0x55ee7b2134a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2950937011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b06f6b0 msgr2=0x55ee7b218cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:23.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/2950937011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b06f6b0 0x55ee7b218cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2950937011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219660 msgr2=0x55ee7b2134a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/2950937011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219660 0x55ee7b2134a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2950937011 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee7af92d80 con 0x55ee7b219210 2023-07-21T22:46:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/2950937011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b212f40 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c097c80 tx=0x7f4b8c005c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7a86ed7676bae15 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.195+0000 7f4b9affd700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b840a12c0 0x7f4b840a3770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c199580 tx=0x7f4b90009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.196+0000 7f4b81ffb700 1 -- 172.21.15.151:0/2950937011 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c09ad50 con 0x55ee7b219210 2023-07-21T22:46:23.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.196+0000 7f4b81ffb700 1 -- 172.21.15.151:0/2950937011 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b8c09ab70 con 0x55ee7b219210 2023-07-21T22:46:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.196+0000 7f4b81ffb700 1 -- 172.21.15.151:0/2950937011 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c01f2d0 con 0x55ee7b219210 2023-07-21T22:46:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.196+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2950937011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 msgr2=0x55ee7b212f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.196+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/2950937011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b212f40 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c097c80 tx=0x7f4b8c005c80 comp rx=0 tx=0).stop 2023-07-21T22:46:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.196+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2950937011 shutdown_connections 2023-07-21T22:46:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.197+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/2950937011 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219660 0x55ee7b2134a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.197+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/2950937011 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b06f6b0 0x55ee7b218cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.197+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/2950937011 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b212f40 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.197+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2950937011 >> 172.21.15.151:0/2950937011 conn(0x55ee7b208ae0 msgr2=0x55ee7b20e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.197+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2950937011 shutdown_connections 2023-07-21T22:46:23.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.197+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2950937011 wait complete. 2023-07-21T22:46:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.197+0000 7f4bb5548b80 1 -- start start 2023-07-21T22:46:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.198+0000 7f4bb5548b80 1 Processor -- start 2023-07-21T22:46:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.198+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b222260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.198+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b2227a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.198+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b219660 0x55ee7b21c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b104a60 con 0x55ee7b219210 2023-07-21T22:46:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b104760 con 0x55ee7b06f6b0 2023-07-21T22:46:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7afe88c0 con 0x55ee7b219660 2023-07-21T22:46:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4bb5548b80 10 client.0 _ll_register_callbacks cb 0x55ee7b102700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:46:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b2227a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b222260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b2227a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46900/0 (socket says 172.21.15.151:46900) 2023-07-21T22:46:23.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9affd700 1 -- 172.21.15.151:0/574139211 learned_addr learned my addr 172.21.15.151:0/574139211 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9bfff700 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b219660 0x55ee7b21c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/574139211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b219660 msgr2=0x55ee7b21c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b219660 0x55ee7b21c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/574139211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 msgr2=0x55ee7b2227a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b2227a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/574139211 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b9c1a4da0 con 0x55ee7b06f6b0 2023-07-21T22:46:23.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.199+0000 7f4b9bfff700 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b219660 0x55ee7b21c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:46:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b222260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0ce400 tx=0x7f4b8c022c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=accacafdb88479b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4b7affd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:46:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4b7affd700 1 -- 172.21.15.151:0/574139211 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c09a900 con 0x55ee7b06f6b0 2023-07-21T22:46:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4b7affd700 1 -- 172.21.15.151:0/574139211 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4b8c0228c0 con 0x55ee7b06f6b0 2023-07-21T22:46:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4bb5548b80 1 -- 172.21.15.151:0/574139211 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee7b0be490 con 0x55ee7b06f6b0 2023-07-21T22:46:23.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4b7affd700 1 -- 172.21.15.151:0/574139211 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b8c015e20 con 0x55ee7b06f6b0 2023-07-21T22:46:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4bb5548b80 10 client.28166 fetch_fsmap learned FSMap version 89 2023-07-21T22:46:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4bb5548b80 1 -- 172.21.15.151:0/574139211 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x55ee7af7bc00 con 0x55ee7b06f6b0 2023-07-21T22:46:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4b7affd700 1 -- 172.21.15.151:0/574139211 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ee7b0be490 con 0x55ee7b06f6b0 2023-07-21T22:46:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4b7affd700 1 -- 172.21.15.151:0/574139211 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4b8c0a3140 con 0x55ee7b06f6b0 2023-07-21T22:46:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4bb5548b80 10 client.28166 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:46:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.200+0000 7f4bb5548b80 10 client.28166 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:46:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.201+0000 7f4bb5548b80 20 client.28166 populate_metadata read hostname 'smithi151' 2023-07-21T22:46:23.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.201+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ee7b22c360 0x55ee7b22e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.201+0000 7f4bb5548b80 4 client.28166 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:46:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.201+0000 7f4bb5548b80 1 -- 172.21.15.151:0/574139211 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee7b15de50 con 0x55ee7b22c360 2023-07-21T22:46:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.201+0000 7f4b9affd700 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ee7b22c360 0x55ee7b22e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.201+0000 7f4b9affd700 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ee7b22c360 0x55ee7b22e740 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc25f2f1ee4d71d9 server_cookie=ddcfb8d369a31ba6 in_seq=0 out_seq=0 2023-07-21T22:46:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.201+0000 7f4b7affd700 10 client.28166 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4b7affd700 1 -- 172.21.15.151:0/574139211 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ee7b15de50 con 0x55ee7b22c360 2023-07-21T22:46:23.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4b7affd700 10 client.28166 handle_command_reply: tid=0 2023-07-21T22:46:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4bb5548b80 1 client.28166 shutdown 2023-07-21T22:46:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4bb5548b80 1 -- 172.21.15.151:0/574139211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 msgr2=0x55ee7b222260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b222260 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0ce400 tx=0x7f4b8c022c30 comp rx=0 tx=0).stop 2023-07-21T22:46:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4bb5548b80 1 -- 172.21.15.151:0/574139211 shutdown_connections 2023-07-21T22:46:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ee7b22c360 0x55ee7b22e740 crc :-1 s=READY pgs=340 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b222260 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b219660 0x55ee7b21c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/574139211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b2227a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4bb5548b80 1 -- 172.21.15.151:0/574139211 >> 172.21.15.151:0/574139211 conn(0x55ee7b208ae0 msgr2=0x55ee7b20d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.202+0000 7f4b7affd700 0 client.28166 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.203+0000 7f4bb5548b80 1 -- 172.21.15.151:0/574139211 shutdown_connections 2023-07-21T22:46:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.203+0000 7f4bb5548b80 1 -- 172.21.15.151:0/574139211 wait complete. 2023-07-21T22:46:23.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.203+0000 7f4bb5548b80 20 client.28166 trim_cache size 0 max 16384 2023-07-21T22:46:23.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4bb5548b80 1 Processor -- start 2023-07-21T22:46:23.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4bb5548b80 1 -- start start 2023-07-21T22:46:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b21a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21b420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219210 0x55ee7b20db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b15de50 con 0x55ee7b06f6b0 2023-07-21T22:46:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b0be490 con 0x55ee7b219210 2023-07-21T22:46:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b20ac00 con 0x55ee7b208ae0 2023-07-21T22:46:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b21a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b21a120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:59182/0 (socket says 172.21.15.151:59182) 2023-07-21T22:46:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2676885 learned_addr learned my addr 172.21.15.151:0/2676885 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9bfff700 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219210 0x55ee7b20db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2676885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219210 msgr2=0x55ee7b20db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219210 0x55ee7b20db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2676885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b06f6b0 msgr2=0x55ee7b21b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/2676885 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee7b233340 con 0x55ee7b208ae0 2023-07-21T22:46:23.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9bfff700 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219210 0x55ee7b20db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:46:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9affd700 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:46:23.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.221+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b21a120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c099560 tx=0x7f4b8c0997c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=177590b7710a1542 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:23.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.222+0000 7f4b827fc700 1 -- 172.21.15.151:0/2676885 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0228c0 con 0x55ee7b208ae0 2023-07-21T22:46:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.222+0000 7f4b827fc700 1 -- 172.21.15.151:0/2676885 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b8c0a10b0 con 0x55ee7b208ae0 2023-07-21T22:46:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.222+0000 7f4b827fc700 1 -- 172.21.15.151:0/2676885 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c09a960 con 0x55ee7b208ae0 2023-07-21T22:46:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.222+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2676885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 msgr2=0x55ee7b21a120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.222+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b21a120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c099560 tx=0x7f4b8c0997c0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.222+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2676885 shutdown_connections 2023-07-21T22:46:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.222+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b219210 0x55ee7b20db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.222+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b21a120 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.222+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/2676885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.223+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2676885 >> 172.21.15.151:0/2676885 conn(0x55ee7b216a90 msgr2=0x55ee7b21ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.223+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2676885 shutdown_connections 2023-07-21T22:46:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.223+0000 7f4bb5548b80 1 -- 172.21.15.151:0/2676885 wait complete. 2023-07-21T22:46:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.223+0000 7f4bb5548b80 1 -- start start 2023-07-21T22:46:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.223+0000 7f4bb5548b80 1 Processor -- start 2023-07-21T22:46:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b220350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4bb5548b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b220890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b27f1c0 con 0x55ee7b219210 2023-07-21T22:46:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b27f300 con 0x55ee7b06f6b0 2023-07-21T22:46:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4bb5548b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee7b27f440 con 0x55ee7b208ae0 2023-07-21T22:46:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4bb5548b80 10 client.0 _ll_register_callbacks cb 0x55ee7b102700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:46:23.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4b9b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4b9b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52944/0 (socket says 172.21.15.151:52944) 2023-07-21T22:46:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.224+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/3351761559 learned_addr learned my addr 172.21.15.151:0/3351761559 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b9bfff700 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b220890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b9affd700 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b220350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/3351761559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 msgr2=0x55ee7b220350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b220350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/3351761559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 msgr2=0x55ee7b220890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b220890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b9b7fe700 1 -- 172.21.15.151:0/3351761559 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b90017070 con 0x55ee7b06f6b0 2023-07-21T22:46:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b9b7fe700 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21fe10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0cbe00 tx=0x7f4b8c09a990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd4105effad856b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b7affd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:46:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b7affd700 1 -- 172.21.15.151:0/3351761559 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b8c0228c0 con 0x55ee7b06f6b0 2023-07-21T22:46:23.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4b7affd700 1 -- 172.21.15.151:0/3351761559 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4b8c0b9020 con 0x55ee7b06f6b0 2023-07-21T22:46:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.225+0000 7f4bb5548b80 1 -- 172.21.15.151:0/3351761559 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b8c09ab70 con 0x55ee7b06f6b0 2023-07-21T22:46:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4b7affd700 1 -- 172.21.15.151:0/3351761559 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b8c0a35d0 con 0x55ee7b06f6b0 2023-07-21T22:46:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4bb5548b80 10 client.28172 fetch_fsmap learned FSMap version 89 2023-07-21T22:46:23.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4bb5548b80 1 -- 172.21.15.151:0/3351761559 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x7f4b94003a00 con 0x55ee7b06f6b0 2023-07-21T22:46:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4b7affd700 1 -- 172.21.15.151:0/3351761559 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b8c09ab70 con 0x55ee7b06f6b0 2023-07-21T22:46:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4b7affd700 1 -- 172.21.15.151:0/3351761559 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4b8c0cb060 con 0x55ee7b06f6b0 2023-07-21T22:46:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4bb5548b80 10 client.28172 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:46:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4bb5548b80 10 client.28172 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:46:23.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4bb5548b80 20 client.28172 populate_metadata read hostname 'smithi151' 2023-07-21T22:46:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ee7b219660 0x55ee7b282620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4bb5548b80 4 client.28172 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:46:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4bb5548b80 1 -- 172.21.15.151:0/3351761559 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ee7b11fff0 con 0x55ee7b219660 2023-07-21T22:46:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.226+0000 7f4b9affd700 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ee7b219660 0x55ee7b282620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.227+0000 7f4b9affd700 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ee7b219660 0x55ee7b282620 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4e18711094ed76f9 server_cookie=fa2baa8ca8ec18b in_seq=0 out_seq=0 2023-07-21T22:46:23.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.227+0000 7f4b7affd700 10 client.28172 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:23.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4b7affd700 1 -- 172.21.15.151:0/3351761559 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ee7b11fff0 con 0x55ee7b219660 2023-07-21T22:46:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4b7affd700 10 client.28172 handle_command_reply: tid=0 2023-07-21T22:46:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4bb5548b80 1 client.28172 shutdown 2023-07-21T22:46:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4bb5548b80 1 -- 172.21.15.151:0/3351761559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 msgr2=0x55ee7b21fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:23.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21fe10 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0cbe00 tx=0x7f4b8c09a990 comp rx=0 tx=0).stop 2023-07-21T22:46:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4bb5548b80 1 -- 172.21.15.151:0/3351761559 shutdown_connections 2023-07-21T22:46:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ee7b219660 0x55ee7b282620 crc :-1 s=READY pgs=341 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee7b06f6b0 0x55ee7b21fe10 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ee7b219210 0x55ee7b220890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4b7affd700 0 client.28172 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4bb5548b80 1 --2- 172.21.15.151:0/3351761559 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ee7b208ae0 0x55ee7b220350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.234+0000 7f4bb5548b80 1 -- 172.21.15.151:0/3351761559 >> 172.21.15.151:0/3351761559 conn(0x55ee7b216a90 msgr2=0x55ee7b21c500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.235+0000 7f4bb5548b80 1 -- 172.21.15.151:0/3351761559 shutdown_connections 2023-07-21T22:46:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.235+0000 7f4bb5548b80 1 -- 172.21.15.151:0/3351761559 wait complete. 2023-07-21T22:46:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.235+0000 7f4bb5548b80 20 client.28172 trim_cache size 0 max 16384 2023-07-21T22:46:23.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:46:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:46:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:46:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:46:23.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.235+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b840a12c0 msgr2=0x7f4b840a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:23.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.235+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b840a12c0 0x7f4b840a3770 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4b9c199580 tx=0x7f4b90009260 comp rx=0 tx=0).stop 2023-07-21T22:46:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.235+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2531076513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b9c0728b0 msgr2=0x7f4b9c197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.235+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b9c0728b0 0x7f4b9c197d60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c000c00 tx=0x7f4b8c004730 comp rx=0 tx=0).stop 2023-07-21T22:46:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.236+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2531076513 shutdown_connections 2023-07-21T22:46:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.236+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b840a12c0 0x7f4b840a3770 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.236+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b9c0728b0 0x7f4b9c197d60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.236+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b9c10c340 0x7f4b9c19c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.236+0000 7f4ba1bff700 1 --2- 172.21.15.151:0/2531076513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b9c0731c0 0x7f4b9c1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.236+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2531076513 >> 172.21.15.151:0/2531076513 conn(0x7f4b9c0fb600 msgr2=0x7f4b9c10e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.236+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2531076513 shutdown_connections 2023-07-21T22:46:23.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:23.236+0000 7f4ba1bff700 1 -- 172.21.15.151:0/2531076513 wait complete. 2023-07-21T22:46:24.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:24 smithi151 ceph-mon[95510]: pgmap v861: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:46:25.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:24 smithi187 ceph-mon[96918]: pgmap v861: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:46:25.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:24 smithi195 ceph-mon[97365]: pgmap v861: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:46:26.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:26 smithi151 ceph-mon[95510]: pgmap v862: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:46:27.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:26 smithi187 ceph-mon[96918]: pgmap v862: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:46:27.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:26 smithi195 ceph-mon[97365]: pgmap v862: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.3 MiB/s wr, 303 op/s 2023-07-21T22:46:28.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:28 smithi151 ceph-mon[95510]: pgmap v863: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.4 MiB/s wr, 445 op/s 2023-07-21T22:46:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:28 smithi187 ceph-mon[96918]: pgmap v863: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.4 MiB/s wr, 445 op/s 2023-07-21T22:46:29.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:28 smithi195 ceph-mon[97365]: pgmap v863: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 3.4 MiB/s wr, 445 op/s 2023-07-21T22:46:30.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:30 smithi151 ceph-mon[95510]: pgmap v864: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 263 op/s 2023-07-21T22:46:31.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:30 smithi187 ceph-mon[96918]: pgmap v864: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 263 op/s 2023-07-21T22:46:31.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:30 smithi195 ceph-mon[97365]: pgmap v864: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 263 op/s 2023-07-21T22:46:32.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:32 smithi151 ceph-mon[95510]: pgmap v865: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 263 op/s 2023-07-21T22:46:33.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:32 smithi187 ceph-mon[96918]: pgmap v865: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 263 op/s 2023-07-21T22:46:33.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:32 smithi195 ceph-mon[97365]: pgmap v865: 97 pgs: 97 active+clean; 8.1 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 263 op/s 2023-07-21T22:46:34.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:34 smithi151 ceph-mon[95510]: pgmap v866: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.8 MiB/s wr, 361 op/s 2023-07-21T22:46:35.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:34 smithi187 ceph-mon[96918]: pgmap v866: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.8 MiB/s wr, 361 op/s 2023-07-21T22:46:35.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:34 smithi195 ceph-mon[97365]: pgmap v866: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.8 MiB/s wr, 361 op/s 2023-07-21T22:46:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.409+0000 7fe9999ff700 1 -- 172.21.15.151:0/3097274487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994105b80 msgr2=0x7fe994105f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.409+0000 7fe9999ff700 1 --2- 172.21.15.151:0/3097274487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994105b80 0x7fe994105f50 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7fe984009990 tx=0x7fe984009ca0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.409+0000 7fe9999ff700 1 -- 172.21.15.151:0/3097274487 shutdown_connections 2023-07-21T22:46:36.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.409+0000 7fe9999ff700 1 --2- 172.21.15.151:0/3097274487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe994100500 0x7fe99410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.409+0000 7fe9999ff700 1 --2- 172.21.15.151:0/3097274487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994105b80 0x7fe994105f50 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.409+0000 7fe9999ff700 1 --2- 172.21.15.151:0/3097274487 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9940ffb50 0x7fe9940fffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.409+0000 7fe9999ff700 1 -- 172.21.15.151:0/3097274487 >> 172.21.15.151:0/3097274487 conn(0x7fe9940fb650 msgr2=0x7fe9940fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:36.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.409+0000 7fe9999ff700 1 -- 172.21.15.151:0/3097274487 shutdown_connections 2023-07-21T22:46:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.409+0000 7fe9999ff700 1 -- 172.21.15.151:0/3097274487 wait complete. 2023-07-21T22:46:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.411+0000 7fe9999ff700 1 Processor -- start 2023-07-21T22:46:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.411+0000 7fe9999ff700 1 -- start start 2023-07-21T22:46:36.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.411+0000 7fe9999ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9940ffb50 0x7fe994197cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.411+0000 7fe9999ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe994100500 0x7fe9941981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.411+0000 7fe9999ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994105b80 0x7fe99419b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.411+0000 7fe9999ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99419bdb0 con 0x7fe994105b80 2023-07-21T22:46:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.411+0000 7fe9999ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99419bf20 con 0x7fe994100500 2023-07-21T22:46:36.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.411+0000 7fe9999ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe99419c0e0 con 0x7fe9940ffb50 2023-07-21T22:46:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe9927fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe994100500 0x7fe9941981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe9927fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe994100500 0x7fe9941981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37666/0 (socket says 172.21.15.151:37666) 2023-07-21T22:46:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe9937fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994105b80 0x7fe99419b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe9927fc700 1 -- 172.21.15.151:0/2453412712 learned_addr learned my addr 172.21.15.151:0/2453412712 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe992ffd700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9940ffb50 0x7fe994197cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe9937fe700 1 -- 172.21.15.151:0/2453412712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9940ffb50 msgr2=0x7fe994197cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe9937fe700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9940ffb50 0x7fe994197cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe9937fe700 1 -- 172.21.15.151:0/2453412712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe994100500 msgr2=0x7fe9941981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:36.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe9937fe700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe994100500 0x7fe9941981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe9937fe700 1 -- 172.21.15.151:0/2453412712 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe98c009c40 con 0x7fe994105b80 2023-07-21T22:46:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.412+0000 7fe992ffd700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9940ffb50 0x7fe994197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:46:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.413+0000 7fe9937fe700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994105b80 0x7fe99419b7b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00efb0 tx=0x7fe98c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.413+0000 7fe9989fd700 1 -- 172.21.15.151:0/2453412712 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c003a00 con 0x7fe994105b80 2023-07-21T22:46:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.413+0000 7fe9989fd700 1 -- 172.21.15.151:0/2453412712 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe98c00f040 con 0x7fe994105b80 2023-07-21T22:46:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.413+0000 7fe9989fd700 1 -- 172.21.15.151:0/2453412712 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe98c0044d0 con 0x7fe994105b80 2023-07-21T22:46:36.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.413+0000 7fe9999ff700 1 -- 172.21.15.151:0/2453412712 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9840095f0 con 0x7fe994105b80 2023-07-21T22:46:36.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.413+0000 7fe9999ff700 1 -- 172.21.15.151:0/2453412712 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe994106880 con 0x7fe994105b80 2023-07-21T22:46:36.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.417+0000 7fe9989fd700 1 -- 172.21.15.151:0/2453412712 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fe98c00cbc0 con 0x7fe994105b80 2023-07-21T22:46:36.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9ad2d3b80 1 Processor -- start 2023-07-21T22:46:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9ad2d3b80 1 -- start start 2023-07-21T22:46:36.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9989fd700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe97c0a1340 0x7fe97c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498bacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9989fd700 1 -- 172.21.15.151:0/2453412712 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe98c0cc870 con 0x7fe994105b80 2023-07-21T22:46:36.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498b54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d497bac50 con 0x562d498bb210 2023-07-21T22:46:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d4980d9e0 con 0x562d497116b0 2023-07-21T22:46:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.419+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d49806e70 con 0x562d498bb660 2023-07-21T22:46:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe9927fc700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe97c0a1340 0x7fe97c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe992ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498bacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe992ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498bacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37680/0 (socket says 172.21.15.151:37680) 2023-07-21T22:46:36.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe992ffd700 1 -- 172.21.15.151:0/1945447198 learned_addr learned my addr 172.21.15.151:0/1945447198 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe9927fc700 1 --2- 172.21.15.151:0/1945447198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe9937fe700 1 --2- 172.21.15.151:0/1945447198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498b54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe992ffd700 1 -- 172.21.15.151:0/1945447198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 msgr2=0x562d498b54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe992ffd700 1 --2- 172.21.15.151:0/1945447198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498b54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe992ffd700 1 -- 172.21.15.151:0/1945447198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 msgr2=0x562d498b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe992ffd700 1 --2- 172.21.15.151:0/1945447198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.420+0000 7fe992ffd700 1 -- 172.21.15.151:0/1945447198 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d49634d80 con 0x562d497116b0 2023-07-21T22:46:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.421+0000 7fe992ffd700 1 --2- 172.21.15.151:0/1945447198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498bacd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe984000c00 tx=0x7fe984005960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaa32440ceb93ef5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.421+0000 7fe9927fc700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe97c0a1340 0x7fe97c0a37f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe98800b7f0 tx=0x7fe98800bca0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.421+0000 7fe979ffb700 1 -- 172.21.15.151:0/1945447198 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984025050 con 0x562d497116b0 2023-07-21T22:46:36.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.421+0000 7fe979ffb700 1 -- 172.21.15.151:0/1945447198 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe984026040 con 0x562d497116b0 2023-07-21T22:46:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.421+0000 7fe979ffb700 1 -- 172.21.15.151:0/1945447198 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9840053b0 con 0x562d497116b0 2023-07-21T22:46:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.422+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/1945447198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 msgr2=0x562d498bacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.422+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/1945447198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498bacd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fe984000c00 tx=0x7fe984005960 comp rx=0 tx=0).stop 2023-07-21T22:46:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.422+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/1945447198 shutdown_connections 2023-07-21T22:46:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.422+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/1945447198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498bacd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.422+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/1945447198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498b54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.422+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/1945447198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.422+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/1945447198 >> 172.21.15.151:0/1945447198 conn(0x562d498aaae0 msgr2=0x562d498b00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.422+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/1945447198 shutdown_connections 2023-07-21T22:46:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.422+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/1945447198 wait complete. 2023-07-21T22:46:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.423+0000 7fe9ad2d3b80 1 -- start start 2023-07-21T22:46:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.423+0000 7fe9ad2d3b80 1 Processor -- start 2023-07-21T22:46:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498be750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498bed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d497a6a60 con 0x562d498bb210 2023-07-21T22:46:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d497a6760 con 0x562d497116b0 2023-07-21T22:46:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d4968a8c0 con 0x562d498bb660 2023-07-21T22:46:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe9ad2d3b80 10 client.0 _ll_register_callbacks cb 0x562d497a4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:46:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe992ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe992ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37684/0 (socket says 172.21.15.151:37684) 2023-07-21T22:46:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe992ffd700 1 -- 172.21.15.151:0/2844519633 learned_addr learned my addr 172.21.15.151:0/2844519633 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:36.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.424+0000 7fe9927fc700 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498be750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe9937fe700 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498bed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe992ffd700 1 -- 172.21.15.151:0/2844519633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 msgr2=0x562d498bed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe992ffd700 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498bed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe992ffd700 1 -- 172.21.15.151:0/2844519633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 msgr2=0x562d498be750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe992ffd700 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498be750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe992ffd700 1 -- 172.21.15.151:0/2844519633 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe99410d240 con 0x562d497116b0 2023-07-21T22:46:36.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe992ffd700 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c1540 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe984005a80 tx=0x7fe984004a10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=315c335072e9bcb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe972ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:46:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe972ffd700 1 -- 172.21.15.151:0/2844519633 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984005200 con 0x562d497116b0 2023-07-21T22:46:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/2844519633 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d49760490 con 0x562d497116b0 2023-07-21T22:46:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.425+0000 7fe972ffd700 1 -- 172.21.15.151:0/2844519633 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe984005360 con 0x562d497116b0 2023-07-21T22:46:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe972ffd700 1 -- 172.21.15.151:0/2844519633 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe984004e10 con 0x562d497116b0 2023-07-21T22:46:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe9ad2d3b80 10 client.28184 fetch_fsmap learned FSMap version 89 2023-07-21T22:46:36.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/2844519633 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x562d4961dc00 con 0x562d497116b0 2023-07-21T22:46:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe972ffd700 1 -- 172.21.15.151:0/2844519633 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562d49760490 con 0x562d497116b0 2023-07-21T22:46:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe972ffd700 1 -- 172.21.15.151:0/2844519633 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe984037420 con 0x562d497116b0 2023-07-21T22:46:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe9ad2d3b80 10 client.28184 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:46:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe9ad2d3b80 10 client.28184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:46:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe9ad2d3b80 20 client.28184 populate_metadata read hostname 'smithi151' 2023-07-21T22:46:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d498ce5e0 0x562d498d09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe9ad2d3b80 4 client.28184 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:46:36.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.426+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/2844519633 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d497ffe50 con 0x562d498ce5e0 2023-07-21T22:46:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.427+0000 7fe9927fc700 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d498ce5e0 0x562d498d09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.428+0000 7fe972ffd700 10 client.28184 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.427+0000 7fe9927fc700 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d498ce5e0 0x562d498d09f0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a0a3a14c2aff29f server_cookie=4cd7fa70bb974b70 in_seq=0 out_seq=0 2023-07-21T22:46:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.428+0000 7fe972ffd700 1 -- 172.21.15.151:0/2844519633 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562d497ffe50 con 0x562d498ce5e0 2023-07-21T22:46:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.428+0000 7fe972ffd700 10 client.28184 handle_command_reply: tid=0 2023-07-21T22:46:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.428+0000 7fe9ad2d3b80 1 client.28184 shutdown 2023-07-21T22:46:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/2844519633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 msgr2=0x562d498c1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:36.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c1540 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe984005a80 tx=0x7fe984004a10 comp rx=0 tx=0).stop 2023-07-21T22:46:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/2844519633 shutdown_connections 2023-07-21T22:46:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d498ce5e0 0x562d498d09f0 crc :-1 s=READY pgs=342 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c1540 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498bed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe972ffd700 0 client.28184 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/2844519633 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498be750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/2844519633 >> 172.21.15.151:0/2844519633 conn(0x562d498aaae0 msgr2=0x562d498af3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/2844519633 shutdown_connections 2023-07-21T22:46:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/2844519633 wait complete. 2023-07-21T22:46:36.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.429+0000 7fe9ad2d3b80 20 client.28184 trim_cache size 0 max 16384 2023-07-21T22:46:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.446+0000 7fe9ad2d3b80 1 Processor -- start 2023-07-21T22:46:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.446+0000 7fe9ad2d3b80 1 -- start start 2023-07-21T22:46:36.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.446+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d497116b0 0x562d498b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.446+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d498bb210 0x562d498c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.446+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498bc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.446+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d498b54b0 con 0x562d497116b0 2023-07-21T22:46:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.446+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d498bfbe0 con 0x562d498bb210 2023-07-21T22:46:36.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.446+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d498bccf0 con 0x562d498bb660 2023-07-21T22:46:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe9927fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d498bb210 0x562d498c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe992ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d497116b0 0x562d498b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe9927fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d498bb210 0x562d498c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37692/0 (socket says 172.21.15.151:37692) 2023-07-21T22:46:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe9927fc700 1 -- 172.21.15.151:0/439349735 learned_addr learned my addr 172.21.15.151:0/439349735 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe9937fe700 1 --2- 172.21.15.151:0/439349735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498bc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe9927fc700 1 -- 172.21.15.151:0/439349735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 msgr2=0x562d498bc180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe9927fc700 1 --2- 172.21.15.151:0/439349735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498bc180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe9927fc700 1 -- 172.21.15.151:0/439349735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d497116b0 msgr2=0x562d498b4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe9927fc700 1 --2- 172.21.15.151:0/439349735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d497116b0 0x562d498b4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.447+0000 7fe9927fc700 1 -- 172.21.15.151:0/439349735 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d4965b1f0 con 0x562d498bb210 2023-07-21T22:46:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.448+0000 7fe9927fc700 1 --2- 172.21.15.151:0/439349735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d498bb210 0x562d498c5b40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe994199490 tx=0x7fe98800bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8dad82263dc36dda server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.448+0000 7fe97a7fc700 1 -- 172.21.15.151:0/439349735 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988028250 con 0x562d498bb210 2023-07-21T22:46:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.448+0000 7fe97a7fc700 1 -- 172.21.15.151:0/439349735 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe988027040 con 0x562d498bb210 2023-07-21T22:46:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.448+0000 7fe97a7fc700 1 -- 172.21.15.151:0/439349735 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe988005040 con 0x562d498bb210 2023-07-21T22:46:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/439349735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d498bb210 msgr2=0x562d498c5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:36.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/439349735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d498bb210 0x562d498c5b40 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe994199490 tx=0x7fe98800bf90 comp rx=0 tx=0).stop 2023-07-21T22:46:36.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/439349735 shutdown_connections 2023-07-21T22:46:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/439349735 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498bc180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/439349735 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d497116b0 0x562d498b4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/439349735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d498bb210 0x562d498c5b40 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/439349735 >> 172.21.15.151:0/439349735 conn(0x562d498aaae0 msgr2=0x562d498bba70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/439349735 shutdown_connections 2023-07-21T22:46:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/439349735 wait complete. 2023-07-21T22:46:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.449+0000 7fe9ad2d3b80 1 -- start start 2023-07-21T22:46:36.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.450+0000 7fe9ad2d3b80 1 Processor -- start 2023-07-21T22:46:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.450+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c5d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.450+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498b6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.450+0000 7fe9ad2d3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498b7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.450+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d498b7850 con 0x562d498bb210 2023-07-21T22:46:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.450+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d498b79c0 con 0x562d497116b0 2023-07-21T22:46:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.450+0000 7fe9ad2d3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d49922460 con 0x562d498bb660 2023-07-21T22:46:36.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.450+0000 7fe9ad2d3b80 10 client.0 _ll_register_callbacks cb 0x7fe9880125f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:46:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe992ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe992ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37708/0 (socket says 172.21.15.151:37708) 2023-07-21T22:46:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe992ffd700 1 -- 172.21.15.151:0/580957835 learned_addr learned my addr 172.21.15.151:0/580957835 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe9927fc700 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498b6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe9937fe700 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498b7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe992ffd700 1 -- 172.21.15.151:0/580957835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 msgr2=0x562d498b7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe992ffd700 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498b7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe992ffd700 1 -- 172.21.15.151:0/580957835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 msgr2=0x562d498b6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe992ffd700 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498b6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe992ffd700 1 -- 172.21.15.151:0/580957835 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe98801a040 con 0x562d497116b0 2023-07-21T22:46:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe9927fc700 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:46:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe992ffd700 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c5d40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe984022010 tx=0x7fe984037650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91719e8e2efcdfc7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.451+0000 7fe972ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:46:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.452+0000 7fe972ffd700 1 -- 172.21.15.151:0/580957835 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe984025070 con 0x562d497116b0 2023-07-21T22:46:36.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.452+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/580957835 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe984026040 con 0x562d497116b0 2023-07-21T22:46:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.452+0000 7fe972ffd700 1 -- 172.21.15.151:0/580957835 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe984000e40 con 0x562d497116b0 2023-07-21T22:46:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.452+0000 7fe972ffd700 1 -- 172.21.15.151:0/580957835 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=89) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe98400eef0 con 0x562d497116b0 2023-07-21T22:46:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.452+0000 7fe9ad2d3b80 10 client.28190 fetch_fsmap learned FSMap version 89 2023-07-21T22:46:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.452+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/580957835 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=89,monmap=4+}) v3 -- 0x562d49633250 con 0x562d497116b0 2023-07-21T22:46:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.452+0000 7fe972ffd700 1 -- 172.21.15.151:0/580957835 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe984026040 con 0x562d497116b0 2023-07-21T22:46:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.453+0000 7fe972ffd700 1 -- 172.21.15.151:0/580957835 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 89) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fe984005000 con 0x562d497116b0 2023-07-21T22:46:36.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.453+0000 7fe9ad2d3b80 10 client.28190 fetch_fsmap finished waiting for FSMap version 89 2023-07-21T22:46:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.453+0000 7fe9ad2d3b80 10 client.28190 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:46:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.453+0000 7fe9ad2d3b80 20 client.28190 populate_metadata read hostname 'smithi151' 2023-07-21T22:46:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.453+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d499236e0 0x562d49925af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.453+0000 7fe9ad2d3b80 4 client.28190 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:46:36.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.453+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/580957835 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562d497c1ff0 con 0x562d499236e0 2023-07-21T22:46:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.453+0000 7fe9927fc700 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d499236e0 0x562d49925af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.454+0000 7fe972ffd700 10 client.28190 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:36.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.454+0000 7fe9927fc700 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d499236e0 0x562d49925af0 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c0831986bc116a4 server_cookie=7141f96dffb72037 in_seq=0 out_seq=0 2023-07-21T22:46:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe972ffd700 1 -- 172.21.15.151:0/580957835 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562d497c1ff0 con 0x562d499236e0 2023-07-21T22:46:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe972ffd700 10 client.28190 handle_command_reply: tid=0 2023-07-21T22:46:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 client.28190 shutdown 2023-07-21T22:46:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/580957835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 msgr2=0x562d498c5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c5d40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe984022010 tx=0x7fe984037650 comp rx=0 tx=0).stop 2023-07-21T22:46:36.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/580957835 shutdown_connections 2023-07-21T22:46:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d499236e0 0x562d49925af0 crc :-1 s=READY pgs=343 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d497116b0 0x562d498c5d40 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d498bb660 0x562d498b7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 --2- 172.21.15.151:0/580957835 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d498bb210 0x562d498b6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe972ffd700 0 client.28190 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:36.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/580957835 >> 172.21.15.151:0/580957835 conn(0x562d498aaae0 msgr2=0x562d498bc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/580957835 shutdown_connections 2023-07-21T22:46:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 1 -- 172.21.15.151:0/580957835 wait complete. 2023-07-21T22:46:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.462+0000 7fe9ad2d3b80 20 client.28190 trim_cache size 0 max 16384 2023-07-21T22:46:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:46:36.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:46:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:46:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:46:36.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 -- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe97c0a1340 msgr2=0x7fe97c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe97c0a1340 0x7fe97c0a37f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe98800b7f0 tx=0x7fe98800bca0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 -- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994105b80 msgr2=0x7fe99419b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994105b80 0x7fe99419b7b0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fe98c00efb0 tx=0x7fe98c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 -- 172.21.15.151:0/2453412712 shutdown_connections 2023-07-21T22:46:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe97c0a1340 0x7fe97c0a37f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe994105b80 0x7fe99419b7b0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe9940ffb50 0x7fe994197cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 --2- 172.21.15.151:0/2453412712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe994100500 0x7fe9941981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 -- 172.21.15.151:0/2453412712 >> 172.21.15.151:0/2453412712 conn(0x7fe9940fb650 msgr2=0x7fe994072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 -- 172.21.15.151:0/2453412712 shutdown_connections 2023-07-21T22:46:36.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:36.463+0000 7fe9999ff700 1 -- 172.21.15.151:0/2453412712 wait complete. 2023-07-21T22:46:36.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:36 smithi151 ceph-mon[95510]: pgmap v867: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 239 op/s 2023-07-21T22:46:37.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:36 smithi187 ceph-mon[96918]: pgmap v867: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 239 op/s 2023-07-21T22:46:37.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:36 smithi195 ceph-mon[97365]: pgmap v867: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 1.8 MiB/s wr, 239 op/s 2023-07-21T22:46:38.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:38 smithi151 ceph-mon[95510]: pgmap v868: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 MiB/s wr, 362 op/s 2023-07-21T22:46:39.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:38 smithi187 ceph-mon[96918]: pgmap v868: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 MiB/s wr, 362 op/s 2023-07-21T22:46:39.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:38 smithi195 ceph-mon[97365]: pgmap v868: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.8 MiB/s wr, 362 op/s 2023-07-21T22:46:41.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:40 smithi187 ceph-mon[96918]: pgmap v869: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2023-07-21T22:46:41.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:40 smithi195 ceph-mon[97365]: pgmap v869: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2023-07-21T22:46:41.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:40 smithi151 ceph-mon[95510]: pgmap v869: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2023-07-21T22:46:43.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:42 smithi187 ceph-mon[96918]: pgmap v870: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2023-07-21T22:46:43.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:42 smithi195 ceph-mon[97365]: pgmap v870: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2023-07-21T22:46:43.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:42 smithi151 ceph-mon[95510]: pgmap v870: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 221 op/s 2023-07-21T22:46:44.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:43 smithi187 ceph-mon[96918]: pgmap v871: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:46:44.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:43 smithi195 ceph-mon[97365]: pgmap v871: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:46:44.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:43 smithi151 ceph-mon[95510]: pgmap v871: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:46:45.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:44 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:46:45.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:44 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:46:45.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:44 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:46:46.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:45 smithi187 ceph-mon[96918]: pgmap v872: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.9 MiB/s wr, 252 op/s 2023-07-21T22:46:46.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:45 smithi195 ceph-mon[97365]: pgmap v872: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.9 MiB/s wr, 252 op/s 2023-07-21T22:46:46.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:45 smithi151 ceph-mon[95510]: pgmap v872: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.9 MiB/s wr, 252 op/s 2023-07-21T22:46:48.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:48 smithi151 ceph-mon[95510]: pgmap v873: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 3.0 MiB/s wr, 390 op/s 2023-07-21T22:46:49.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:48 smithi187 ceph-mon[96918]: pgmap v873: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 3.0 MiB/s wr, 390 op/s 2023-07-21T22:46:49.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:48 smithi195 ceph-mon[97365]: pgmap v873: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 3.0 MiB/s wr, 390 op/s 2023-07-21T22:46:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.720+0000 7f4e409ff700 1 -- 172.21.15.151:0/3561131687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c0ffb00 msgr2=0x7f4e3c0fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.720+0000 7f4e409ff700 1 --2- 172.21.15.151:0/3561131687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c0ffb00 0x7f4e3c0fff70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009990 tx=0x7f4e30009ca0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.720+0000 7f4e409ff700 1 -- 172.21.15.151:0/3561131687 shutdown_connections 2023-07-21T22:46:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.720+0000 7f4e409ff700 1 --2- 172.21.15.151:0/3561131687 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c1004b0 0x7f4e3c10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.720+0000 7f4e409ff700 1 --2- 172.21.15.151:0/3561131687 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e3c105b10 0x7f4e3c105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.720+0000 7f4e409ff700 1 --2- 172.21.15.151:0/3561131687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c0ffb00 0x7f4e3c0fff70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.720+0000 7f4e409ff700 1 -- 172.21.15.151:0/3561131687 >> 172.21.15.151:0/3561131687 conn(0x7f4e3c0fb600 msgr2=0x7f4e3c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.721+0000 7f4e409ff700 1 -- 172.21.15.151:0/3561131687 shutdown_connections 2023-07-21T22:46:49.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.721+0000 7f4e409ff700 1 -- 172.21.15.151:0/3561131687 wait complete. 2023-07-21T22:46:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e409ff700 1 Processor -- start 2023-07-21T22:46:49.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e409ff700 1 -- start start 2023-07-21T22:46:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e409ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c0ffb00 0x7f4e3c197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e409ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c1004b0 0x7f4e3c1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e409ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e3c105b10 0x7f4e3c19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e409ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c19cf50 con 0x7f4e3c0ffb00 2023-07-21T22:46:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e409ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c19d0c0 con 0x7f4e3c1004b0 2023-07-21T22:46:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e409ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c19d280 con 0x7f4e3c105b10 2023-07-21T22:46:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e3a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c0ffb00 0x7f4e3c197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e3ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e3c105b10 0x7f4e3c19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e3a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c0ffb00 0x7f4e3c197d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41042/0 (socket says 172.21.15.151:41042) 2023-07-21T22:46:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.722+0000 7f4e3a59c700 1 -- 172.21.15.151:0/2579010369 learned_addr learned my addr 172.21.15.151:0/2579010369 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:49.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.723+0000 7f4e39d9b700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c1004b0 0x7f4e3c1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.723+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/2579010369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c1004b0 msgr2=0x7f4e3c1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.723+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c1004b0 0x7f4e3c1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.723+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/2579010369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c0ffb00 msgr2=0x7f4e3c197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.723+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c0ffb00 0x7f4e3c197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.723+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/2579010369 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e2c009520 con 0x7f4e3c105b10 2023-07-21T22:46:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.723+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e3c105b10 0x7f4e3c19c910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400efc0 tx=0x7f4e3400c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:49.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.723+0000 7f4e2b7fe700 1 -- 172.21.15.151:0/2579010369 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34018070 con 0x7f4e3c105b10 2023-07-21T22:46:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.724+0000 7f4e2b7fe700 1 -- 172.21.15.151:0/2579010369 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e3400f040 con 0x7f4e3c105b10 2023-07-21T22:46:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.724+0000 7f4e2b7fe700 1 -- 172.21.15.151:0/2579010369 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3400cc50 con 0x7f4e3c105b10 2023-07-21T22:46:49.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.724+0000 7f4e409ff700 1 -- 172.21.15.151:0/2579010369 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e300095f0 con 0x7f4e3c105b10 2023-07-21T22:46:49.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.724+0000 7f4e409ff700 1 -- 172.21.15.151:0/2579010369 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c1a4bc0 con 0x7f4e3c105b10 2023-07-21T22:46:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.727+0000 7f4e2b7fe700 1 -- 172.21.15.151:0/2579010369 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4e34003a00 con 0x7f4e3c105b10 2023-07-21T22:46:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.728+0000 7f4e2b7fe700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4e240a1340 0x7f4e240a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.728+0000 7f4e2b7fe700 1 -- 172.21.15.151:0/2579010369 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4e340cc800 con 0x7f4e3c105b10 2023-07-21T22:46:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.729+0000 7f4e54385b80 1 Processor -- start 2023-07-21T22:46:49.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.729+0000 7f4e3a59c700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4e240a1340 0x7f4e240a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.729+0000 7f4e54385b80 1 -- start start 2023-07-21T22:46:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.729+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581677496b0 0x5581678f2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.729+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678ecf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.729+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581678f3660 0x5581678ed4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.729+0000 7f4e54385b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581677f2c50 con 0x5581677496b0 2023-07-21T22:46:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.729+0000 7f4e54385b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581678459e0 con 0x5581678f3660 2023-07-21T22:46:49.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.729+0000 7f4e54385b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55816783ee70 con 0x5581678f3210 2023-07-21T22:46:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e39d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678ecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e3a59c700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4e240a1340 0x7f4e240a37f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009e70 tx=0x7f4e2c009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e3a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581677496b0 0x5581678f2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e39d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678ecf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:36160/0 (socket says 172.21.15.151:36160) 2023-07-21T22:46:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e39d9b700 1 -- 172.21.15.151:0/203382293 learned_addr learned my addr 172.21.15.151:0/203382293 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/203382293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581678f3660 0x5581678ed4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e39d9b700 1 -- 172.21.15.151:0/203382293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581678f3660 msgr2=0x5581678ed4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e39d9b700 1 --2- 172.21.15.151:0/203382293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581678f3660 0x5581678ed4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e39d9b700 1 -- 172.21.15.151:0/203382293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581677496b0 msgr2=0x5581678f2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e39d9b700 1 --2- 172.21.15.151:0/203382293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581677496b0 0x5581678f2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e39d9b700 1 -- 172.21.15.151:0/203382293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55816766cd80 con 0x5581678f3210 2023-07-21T22:46:49.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.730+0000 7f4e39d9b700 1 --2- 172.21.15.151:0/203382293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678ecf40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4e30006010 tx=0x7f4e30005ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=284d61a13f54482d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e28ff9700 1 -- 172.21.15.151:0/203382293 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300056a0 con 0x5581678f3210 2023-07-21T22:46:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e28ff9700 1 -- 172.21.15.151:0/203382293 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e3001e040 con 0x5581678f3210 2023-07-21T22:46:49.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e28ff9700 1 -- 172.21.15.151:0/203382293 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300049e0 con 0x5581678f3210 2023-07-21T22:46:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e54385b80 1 -- 172.21.15.151:0/203382293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 msgr2=0x5581678ecf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e54385b80 1 --2- 172.21.15.151:0/203382293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678ecf40 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4e30006010 tx=0x7f4e30005ee0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e54385b80 1 -- 172.21.15.151:0/203382293 shutdown_connections 2023-07-21T22:46:49.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e54385b80 1 --2- 172.21.15.151:0/203382293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581678f3660 0x5581678ed4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e54385b80 1 --2- 172.21.15.151:0/203382293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581677496b0 0x5581678f2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e54385b80 1 --2- 172.21.15.151:0/203382293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678ecf40 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.731+0000 7f4e54385b80 1 -- 172.21.15.151:0/203382293 >> 172.21.15.151:0/203382293 conn(0x5581678e2ae0 msgr2=0x5581678e80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:49.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.732+0000 7f4e54385b80 1 -- 172.21.15.151:0/203382293 shutdown_connections 2023-07-21T22:46:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.732+0000 7f4e54385b80 1 -- 172.21.15.151:0/203382293 wait complete. 2023-07-21T22:46:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.732+0000 7f4e54385b80 1 -- start start 2023-07-21T22:46:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.732+0000 7f4e54385b80 1 Processor -- start 2023-07-21T22:46:49.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x5581678fc570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x5581678fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x5581678f6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e54385b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581677dea60 con 0x5581678f3210 2023-07-21T22:46:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e54385b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581677de760 con 0x5581677496b0 2023-07-21T22:46:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e54385b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581676c28c0 con 0x5581678f3660 2023-07-21T22:46:49.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e54385b80 10 client.0 _ll_register_callbacks cb 0x5581677dc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:46:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e39d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x5581678fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e39d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x5581678fcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41064/0 (socket says 172.21.15.151:41064) 2023-07-21T22:46:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e3ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x5581678f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.733+0000 7f4e39d9b700 1 -- 172.21.15.151:0/1978736626 learned_addr learned my addr 172.21.15.151:0/1978736626 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:49.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e3a59c700 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x5581678fc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/1978736626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 msgr2=0x5581678fc570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:49.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x5581678fc570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/1978736626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 msgr2=0x5581678fcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x5581678fcab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/1978736626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3c10d240 con 0x5581678f3660 2023-07-21T22:46:49.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x5581678f6870 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4e340c9f10 tx=0x7f4e34099280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=504e57d0cd96ae63 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:46:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e21ffb700 1 -- 172.21.15.151:0/1978736626 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e34099920 con 0x5581678f3660 2023-07-21T22:46:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e21ffb700 1 -- 172.21.15.151:0/1978736626 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4e3409d950 con 0x5581678f3660 2023-07-21T22:46:49.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.734+0000 7f4e54385b80 1 -- 172.21.15.151:0/1978736626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558167798490 con 0x5581678f3660 2023-07-21T22:46:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e21ffb700 1 -- 172.21.15.151:0/1978736626 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e340a1ce0 con 0x5581678f3660 2023-07-21T22:46:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e54385b80 10 client.28234 fetch_fsmap learned FSMap version 91 2023-07-21T22:46:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e54385b80 1 -- 172.21.15.151:0/1978736626 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x558167655c00 con 0x5581678f3660 2023-07-21T22:46:49.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e21ffb700 1 -- 172.21.15.151:0/1978736626 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558167798490 con 0x5581678f3660 2023-07-21T22:46:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e21ffb700 1 -- 172.21.15.151:0/1978736626 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4e340b1ef0 con 0x5581678f3660 2023-07-21T22:46:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e54385b80 10 client.28234 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:46:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e54385b80 10 client.28234 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:46:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e54385b80 20 client.28234 populate_metadata read hostname 'smithi151' 2023-07-21T22:46:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e54385b80 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558167906920 0x558167908d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e54385b80 4 client.28234 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:46:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.735+0000 7f4e54385b80 1 -- 172.21.15.151:0/1978736626 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558167837e50 con 0x558167906920 2023-07-21T22:46:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.736+0000 7f4e3a59c700 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558167906920 0x558167908d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.736+0000 7f4e3a59c700 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558167906920 0x558167908d30 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e69cc501622433f9 server_cookie=e98386adcdf37850 in_seq=0 out_seq=0 2023-07-21T22:46:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.736+0000 7f4e21ffb700 10 client.28234 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e21ffb700 1 -- 172.21.15.151:0/1978736626 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558167837e50 con 0x558167906920 2023-07-21T22:46:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e21ffb700 10 client.28234 handle_command_reply: tid=0 2023-07-21T22:46:49.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 client.28234 shutdown 2023-07-21T22:46:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 -- 172.21.15.151:0/1978736626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 msgr2=0x5581678f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x5581678f6870 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4e340c9f10 tx=0x7f4e34099280 comp rx=0 tx=0).stop 2023-07-21T22:46:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 -- 172.21.15.151:0/1978736626 shutdown_connections 2023-07-21T22:46:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558167906920 0x558167908d30 crc :-1 s=READY pgs=344 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x5581678fc570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x5581678f6870 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 --2- 172.21.15.151:0/1978736626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x5581678fcab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 -- 172.21.15.151:0/1978736626 >> 172.21.15.151:0/1978736626 conn(0x5581678e2ae0 msgr2=0x5581678e73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e21ffb700 0 client.28234 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 -- 172.21.15.151:0/1978736626 shutdown_connections 2023-07-21T22:46:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.737+0000 7f4e54385b80 1 -- 172.21.15.151:0/1978736626 wait complete. 2023-07-21T22:46:49.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.738+0000 7f4e54385b80 20 client.28234 trim_cache size 0 max 16384 2023-07-21T22:46:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e54385b80 1 Processor -- start 2023-07-21T22:46:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e54385b80 1 -- start start 2023-07-21T22:46:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x5581678f2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678f6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3660 0x5581678f5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e54385b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558167837e50 con 0x5581678f3660 2023-07-21T22:46:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e54385b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558167798490 con 0x5581677496b0 2023-07-21T22:46:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e54385b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5581678f1300 con 0x5581678f3210 2023-07-21T22:46:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e39d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e3ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3660 0x5581678f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e39d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678f6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:36172/0 (socket says 172.21.15.151:36172) 2023-07-21T22:46:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.754+0000 7f4e39d9b700 1 -- 172.21.15.151:0/535514672 learned_addr learned my addr 172.21.15.151:0/535514672 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e3a59c700 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x5581678f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e39d9b700 1 -- 172.21.15.151:0/535514672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 msgr2=0x5581678f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e39d9b700 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x5581678f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e39d9b700 1 -- 172.21.15.151:0/535514672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3660 msgr2=0x5581678f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e39d9b700 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3660 0x5581678f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e39d9b700 1 -- 172.21.15.151:0/535514672 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55816790d960 con 0x5581678f3210 2023-07-21T22:46:49.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e3a59c700 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x5581678f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:46:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3660 0x5581678f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:46:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e39d9b700 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678f6790 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4e30005f50 tx=0x7f4e30004500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554ae4e5fac93a92 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e297fa700 1 -- 172.21.15.151:0/535514672 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3000b710 con 0x5581678f3210 2023-07-21T22:46:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e297fa700 1 -- 172.21.15.151:0/535514672 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e3000bd00 con 0x5581678f3210 2023-07-21T22:46:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.755+0000 7f4e297fa700 1 -- 172.21.15.151:0/535514672 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e30004d10 con 0x5581678f3210 2023-07-21T22:46:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.756+0000 7f4e54385b80 1 -- 172.21.15.151:0/535514672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 msgr2=0x5581678f6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:49.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.756+0000 7f4e54385b80 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678f6790 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4e30005f50 tx=0x7f4e30004500 comp rx=0 tx=0).stop 2023-07-21T22:46:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.756+0000 7f4e54385b80 1 -- 172.21.15.151:0/535514672 shutdown_connections 2023-07-21T22:46:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.756+0000 7f4e54385b80 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x5581678f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.756+0000 7f4e54385b80 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3660 0x5581678f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.756+0000 7f4e54385b80 1 --2- 172.21.15.151:0/535514672 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3210 0x5581678f6790 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.756+0000 7f4e54385b80 1 -- 172.21.15.151:0/535514672 >> 172.21.15.151:0/535514672 conn(0x5581678e2ae0 msgr2=0x5581678f5020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.756+0000 7f4e54385b80 1 -- 172.21.15.151:0/535514672 shutdown_connections 2023-07-21T22:46:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.756+0000 7f4e54385b80 1 -- 172.21.15.151:0/535514672 wait complete. 2023-07-21T22:46:49.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.757+0000 7f4e54385b80 1 -- start start 2023-07-21T22:46:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.757+0000 7f4e54385b80 1 Processor -- start 2023-07-21T22:46:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.757+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x55816794e770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.757+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x55816794ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.757+0000 7f4e54385b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x55816794f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.757+0000 7f4e54385b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558167959920 con 0x5581678f3210 2023-07-21T22:46:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.757+0000 7f4e54385b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558167959a60 con 0x5581677496b0 2023-07-21T22:46:49.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.757+0000 7f4e54385b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558167959c20 con 0x5581678f3660 2023-07-21T22:46:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e54385b80 10 client.0 _ll_register_callbacks cb 0x7f4e340996f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:46:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e39d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x55816794ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x55816794f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x55816794e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x55816794f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:36176/0 (socket says 172.21.15.151:36176) 2023-07-21T22:46:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/3266585100 learned_addr learned my addr 172.21.15.151:0/3266585100 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:46:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e39d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x55816794ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41082/0 (socket says 172.21.15.151:41082) 2023-07-21T22:46:49.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/3266585100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 msgr2=0x55816794e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x55816794e770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/3266585100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 msgr2=0x55816794ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:46:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x55816794ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3ad9d700 1 -- 172.21.15.151:0/3266585100 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558167655c00 con 0x5581678f3660 2023-07-21T22:46:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e3ad9d700 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x55816794f1f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4e34096390 tx=0x7f4e34099530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97981a3ea787c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:46:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.758+0000 7f4e21ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:46:49.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e21ffb700 1 -- 172.21.15.151:0/3266585100 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3409dc00 con 0x5581678f3660 2023-07-21T22:46:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e21ffb700 1 -- 172.21.15.151:0/3266585100 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4e3409d950 con 0x5581678f3660 2023-07-21T22:46:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e54385b80 1 -- 172.21.15.151:0/3266585100 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4e3001e040 con 0x5581678f3660 2023-07-21T22:46:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e21ffb700 1 -- 172.21.15.151:0/3266585100 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4e34099920 con 0x5581678f3660 2023-07-21T22:46:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e54385b80 10 client.28240 fetch_fsmap learned FSMap version 91 2023-07-21T22:46:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e54385b80 1 -- 172.21.15.151:0/3266585100 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55816766cd80 con 0x5581678f3660 2023-07-21T22:46:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e21ffb700 1 -- 172.21.15.151:0/3266585100 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4e3407c080 con 0x5581678f3660 2023-07-21T22:46:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e21ffb700 1 -- 172.21.15.151:0/3266585100 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f4e3401b9d0 con 0x5581678f3660 2023-07-21T22:46:49.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e54385b80 10 client.28240 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:46:49.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e54385b80 10 client.28240 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:46:49.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e54385b80 20 client.28240 populate_metadata read hostname 'smithi151' 2023-07-21T22:46:49.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e54385b80 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55816795b000 0x55816795d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:46:49.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e54385b80 4 client.28240 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:46:49.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.759+0000 7f4e54385b80 1 -- 172.21.15.151:0/3266585100 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5581677f9ff0 con 0x55816795b000 2023-07-21T22:46:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.760+0000 7f4e3a59c700 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55816795b000 0x55816795d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:46:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.760+0000 7f4e3a59c700 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55816795b000 0x55816795d410 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70e71aaee576ffa4 server_cookie=29642c20b98a10a6 in_seq=0 out_seq=0 2023-07-21T22:46:49.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.760+0000 7f4e21ffb700 10 client.28240 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:49.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e21ffb700 1 -- 172.21.15.151:0/3266585100 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5581677f9ff0 con 0x55816795b000 2023-07-21T22:46:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e21ffb700 10 client.28240 handle_command_reply: tid=0 2023-07-21T22:46:49.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 client.28240 shutdown 2023-07-21T22:46:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 -- 172.21.15.151:0/3266585100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 msgr2=0x55816794f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x55816794f1f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4e34096390 tx=0x7f4e34099530 comp rx=0 tx=0).stop 2023-07-21T22:46:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 -- 172.21.15.151:0/3266585100 shutdown_connections 2023-07-21T22:46:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55816795b000 0x55816795d410 crc :-1 s=READY pgs=345 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5581677496b0 0x55816794e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5581678f3660 0x55816794f1f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e21ffb700 0 client.28240 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:46:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 --2- 172.21.15.151:0/3266585100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5581678f3210 0x55816794ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 -- 172.21.15.151:0/3266585100 >> 172.21.15.151:0/3266585100 conn(0x5581678e2ae0 msgr2=0x5581678f1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 -- 172.21.15.151:0/3266585100 shutdown_connections 2023-07-21T22:46:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.772+0000 7f4e54385b80 1 -- 172.21.15.151:0/3266585100 wait complete. 2023-07-21T22:46:49.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.773+0000 7f4e54385b80 20 client.28240 trim_cache size 0 max 16384 2023-07-21T22:46:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:46:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:46:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:46:49.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:46:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.773+0000 7f4e409ff700 1 -- 172.21.15.151:0/2579010369 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4e240a1340 msgr2=0x7f4e240a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.773+0000 7f4e409ff700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4e240a1340 0x7f4e240a37f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4e2c009e70 tx=0x7f4e2c009260 comp rx=0 tx=0).stop 2023-07-21T22:46:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.773+0000 7f4e409ff700 1 -- 172.21.15.151:0/2579010369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e3c105b10 msgr2=0x7f4e3c19c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:46:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.773+0000 7f4e409ff700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e3c105b10 0x7f4e3c19c910 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4e3400efc0 tx=0x7f4e3400c3a0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.774+0000 7f4e409ff700 1 -- 172.21.15.151:0/2579010369 shutdown_connections 2023-07-21T22:46:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.774+0000 7f4e409ff700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4e240a1340 0x7f4e240a37f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.774+0000 7f4e409ff700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4e3c105b10 0x7f4e3c19c910 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.774+0000 7f4e409ff700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4e3c0ffb00 0x7f4e3c197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.774+0000 7f4e409ff700 1 --2- 172.21.15.151:0/2579010369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c1004b0 0x7f4e3c1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:46:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.774+0000 7f4e409ff700 1 -- 172.21.15.151:0/2579010369 >> 172.21.15.151:0/2579010369 conn(0x7f4e3c0fb600 msgr2=0x7f4e3c0fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:46:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.774+0000 7f4e409ff700 1 -- 172.21.15.151:0/2579010369 shutdown_connections 2023-07-21T22:46:49.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:46:49.774+0000 7f4e409ff700 1 -- 172.21.15.151:0/2579010369 wait complete. 2023-07-21T22:46:50.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:50 smithi151 ceph-mon[95510]: pgmap v874: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.1 MiB/s wr, 267 op/s 2023-07-21T22:46:50.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:50 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:46:51.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:50 smithi187 ceph-mon[96918]: pgmap v874: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.1 MiB/s wr, 267 op/s 2023-07-21T22:46:51.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:50 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:46:51.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:50 smithi195 ceph-mon[97365]: pgmap v874: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.1 MiB/s wr, 267 op/s 2023-07-21T22:46:51.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:50 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:46:52.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:52 smithi151 ceph-mon[95510]: pgmap v875: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.1 MiB/s wr, 267 op/s 2023-07-21T22:46:53.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:52 smithi187 ceph-mon[96918]: pgmap v875: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.1 MiB/s wr, 267 op/s 2023-07-21T22:46:53.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:52 smithi195 ceph-mon[97365]: pgmap v875: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 2.1 MiB/s wr, 267 op/s 2023-07-21T22:46:54.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:54 smithi151 ceph-mon[95510]: pgmap v876: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 3.1 MiB/s wr, 410 op/s 2023-07-21T22:46:55.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:54 smithi187 ceph-mon[96918]: pgmap v876: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 3.1 MiB/s wr, 410 op/s 2023-07-21T22:46:55.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:54 smithi195 ceph-mon[97365]: pgmap v876: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 3.1 MiB/s wr, 410 op/s 2023-07-21T22:46:56.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:56 smithi151 ceph-mon[95510]: pgmap v877: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:46:57.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:56 smithi187 ceph-mon[96918]: pgmap v877: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:46:57.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:56 smithi195 ceph-mon[97365]: pgmap v877: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.1 MiB/s wr, 280 op/s 2023-07-21T22:46:58.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:46:58 smithi151 ceph-mon[95510]: pgmap v878: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.1 MiB/s wr, 407 op/s 2023-07-21T22:46:59.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:46:58 smithi187 ceph-mon[96918]: pgmap v878: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.1 MiB/s wr, 407 op/s 2023-07-21T22:46:59.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:46:58 smithi195 ceph-mon[97365]: pgmap v878: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 3.1 MiB/s wr, 407 op/s 2023-07-21T22:47:00.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:00 smithi151 ceph-mon[95510]: pgmap v879: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2023-07-21T22:47:01.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:00 smithi187 ceph-mon[96918]: pgmap v879: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2023-07-21T22:47:01.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:00 smithi195 ceph-mon[97365]: pgmap v879: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2023-07-21T22:47:02.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:02 smithi151 ceph-mon[95510]: pgmap v880: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2023-07-21T22:47:02.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.957+0000 7faf73bff700 1 -- 172.21.15.151:0/3913086741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf6c105b10 msgr2=0x7faf6c105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.957+0000 7faf73bff700 1 --2- 172.21.15.151:0/3913086741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf6c105b10 0x7faf6c105ee0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7faf68009990 tx=0x7faf68009ca0 comp rx=0 tx=0).stop 2023-07-21T22:47:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.958+0000 7faf73bff700 1 -- 172.21.15.151:0/3913086741 shutdown_connections 2023-07-21T22:47:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.958+0000 7faf73bff700 1 --2- 172.21.15.151:0/3913086741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c1004b0 0x7faf6c10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.958+0000 7faf73bff700 1 --2- 172.21.15.151:0/3913086741 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf6c105b10 0x7faf6c105ee0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:02.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.958+0000 7faf73bff700 1 --2- 172.21.15.151:0/3913086741 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf6c0ffb00 0x7faf6c0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.958+0000 7faf73bff700 1 -- 172.21.15.151:0/3913086741 >> 172.21.15.151:0/3913086741 conn(0x7faf6c0fb600 msgr2=0x7faf6c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.958+0000 7faf73bff700 1 -- 172.21.15.151:0/3913086741 shutdown_connections 2023-07-21T22:47:02.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.958+0000 7faf73bff700 1 -- 172.21.15.151:0/3913086741 wait complete. 2023-07-21T22:47:02.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.959+0000 7faf73bff700 1 Processor -- start 2023-07-21T22:47:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.959+0000 7faf73bff700 1 -- start start 2023-07-21T22:47:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.959+0000 7faf73bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c0ffb00 0x7faf6c197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.959+0000 7faf73bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf6c1004b0 0x7faf6c1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.959+0000 7faf73bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf6c105b10 0x7faf6c19c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.959+0000 7faf73bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c19cfa0 con 0x7faf6c0ffb00 2023-07-21T22:47:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.959+0000 7faf73bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c19d110 con 0x7faf6c105b10 2023-07-21T22:47:02.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.959+0000 7faf73bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf6c19d2d0 con 0x7faf6c1004b0 2023-07-21T22:47:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c0ffb00 0x7faf6c197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7119a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf6c1004b0 0x7faf6c1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7219c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf6c105b10 0x7faf6c19c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c0ffb00 0x7faf6c197db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60142/0 (socket says 172.21.15.151:60142) 2023-07-21T22:47:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7199b700 1 -- 172.21.15.151:0/3480496303 learned_addr learned my addr 172.21.15.151:0/3480496303 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7119a700 1 -- 172.21.15.151:0/3480496303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf6c105b10 msgr2=0x7faf6c19c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:03.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7119a700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf6c105b10 0x7faf6c19c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7119a700 1 -- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c0ffb00 msgr2=0x7faf6c197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7119a700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c0ffb00 0x7faf6c197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7119a700 1 -- 172.21.15.151:0/3480496303 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf680095f0 con 0x7faf6c1004b0 2023-07-21T22:47:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.960+0000 7faf7199b700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c0ffb00 0x7faf6c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.961+0000 7faf7119a700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf6c1004b0 0x7faf6c1982f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00e9f0 tx=0x7faf5c00ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:03.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.961+0000 7faf62ffd700 1 -- 172.21.15.151:0/3480496303 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c00c9c0 con 0x7faf6c1004b0 2023-07-21T22:47:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.961+0000 7faf62ffd700 1 -- 172.21.15.151:0/3480496303 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf5c010430 con 0x7faf6c1004b0 2023-07-21T22:47:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.961+0000 7faf73bff700 1 -- 172.21.15.151:0/3480496303 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf6c19d5b0 con 0x7faf6c1004b0 2023-07-21T22:47:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.961+0000 7faf62ffd700 1 -- 172.21.15.151:0/3480496303 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c018680 con 0x7faf6c1004b0 2023-07-21T22:47:03.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.961+0000 7faf73bff700 1 -- 172.21.15.151:0/3480496303 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c1a4df0 con 0x7faf6c1004b0 2023-07-21T22:47:03.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.964+0000 7faf62ffd700 1 -- 172.21.15.151:0/3480496303 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7faf5c0105a0 con 0x7faf6c1004b0 2023-07-21T22:47:03.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.966+0000 7faf874c3b80 1 Processor -- start 2023-07-21T22:47:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.966+0000 7faf874c3b80 1 -- start start 2023-07-21T22:47:03.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.966+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eaaee06b0 0x555eab089cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.966+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab083f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 0x555eab0844a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf874c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eaaf89c50 con 0x555eab08a660 2023-07-21T22:47:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf62ffd700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faf580a1340 0x7faf580a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf874c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eaafdc9e0 con 0x555eaaee06b0 2023-07-21T22:47:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf874c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eaafd5e70 con 0x555eab08a210 2023-07-21T22:47:03.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7219c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eaaee06b0 0x555eab089cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab083f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab083f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46630/0 (socket says 172.21.15.151:46630) 2023-07-21T22:47:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7199b700 1 -- 172.21.15.151:0/330286957 learned_addr learned my addr 172.21.15.151:0/330286957 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7119a700 1 --2- 172.21.15.151:0/330286957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 0x555eab0844a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf62ffd700 1 -- 172.21.15.151:0/3480496303 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7faf5c014070 con 0x7faf6c1004b0 2023-07-21T22:47:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7219c700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faf580a1340 0x7faf580a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7199b700 1 -- 172.21.15.151:0/330286957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eaaee06b0 msgr2=0x555eab089cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7199b700 1 --2- 172.21.15.151:0/330286957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eaaee06b0 0x555eab089cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7199b700 1 -- 172.21.15.151:0/330286957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 msgr2=0x555eab0844a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7199b700 1 --2- 172.21.15.151:0/330286957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 0x555eab0844a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.967+0000 7faf7199b700 1 -- 172.21.15.151:0/330286957 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555eaae03d80 con 0x555eab08a210 2023-07-21T22:47:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.968+0000 7faf7199b700 1 --2- 172.21.15.151:0/330286957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab083f40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf68005bc0 tx=0x7faf68005bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=34697daca1ce526c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.968+0000 7faf7219c700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faf580a1340 0x7faf580a37f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faf64009ec0 tx=0x7faf6400b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:03.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.968+0000 7faf57fff700 1 -- 172.21.15.151:0/330286957 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6801d050 con 0x555eab08a210 2023-07-21T22:47:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.968+0000 7faf57fff700 1 -- 172.21.15.151:0/330286957 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf6801e040 con 0x555eab08a210 2023-07-21T22:47:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.968+0000 7faf57fff700 1 -- 172.21.15.151:0/330286957 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68005590 con 0x555eab08a210 2023-07-21T22:47:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.969+0000 7faf874c3b80 1 -- 172.21.15.151:0/330286957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 msgr2=0x555eab083f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.969+0000 7faf874c3b80 1 --2- 172.21.15.151:0/330286957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab083f40 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faf68005bc0 tx=0x7faf68005bf0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.969+0000 7faf874c3b80 1 -- 172.21.15.151:0/330286957 shutdown_connections 2023-07-21T22:47:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.969+0000 7faf874c3b80 1 --2- 172.21.15.151:0/330286957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eaaee06b0 0x555eab089cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.969+0000 7faf874c3b80 1 --2- 172.21.15.151:0/330286957 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 0x555eab0844a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.969+0000 7faf874c3b80 1 --2- 172.21.15.151:0/330286957 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab083f40 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.969+0000 7faf874c3b80 1 -- 172.21.15.151:0/330286957 >> 172.21.15.151:0/330286957 conn(0x555eab079ae0 msgr2=0x555eab07f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.969+0000 7faf874c3b80 1 -- 172.21.15.151:0/330286957 shutdown_connections 2023-07-21T22:47:03.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.969+0000 7faf874c3b80 1 -- 172.21.15.151:0/330286957 wait complete. 2023-07-21T22:47:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.970+0000 7faf874c3b80 1 -- start start 2023-07-21T22:47:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.970+0000 7faf874c3b80 1 Processor -- start 2023-07-21T22:47:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab090560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a210 0x555eab08d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 0x555eab08ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf874c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eaaf75a60 con 0x555eab08a210 2023-07-21T22:47:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf874c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eaaf75760 con 0x555eab08a660 2023-07-21T22:47:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf874c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eaae598c0 con 0x555eaaee06b0 2023-07-21T22:47:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf874c3b80 10 client.0 _ll_register_callbacks cb 0x555eaaf73700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:03.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf7119a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a210 0x555eab08d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf7199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab090560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf7119a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a210 0x555eab08d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60146/0 (socket says 172.21.15.151:60146) 2023-07-21T22:47:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf7119a700 1 -- 172.21.15.151:0/58347467 learned_addr learned my addr 172.21.15.151:0/58347467 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf7199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab090560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46636/0 (socket says 172.21.15.151:46636) 2023-07-21T22:47:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.971+0000 7faf7219c700 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 0x555eab08ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf7199b700 1 -- 172.21.15.151:0/58347467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 msgr2=0x555eab08ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:03.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf7199b700 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 0x555eab08ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf7199b700 1 -- 172.21.15.151:0/58347467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a210 msgr2=0x555eab08d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf7199b700 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a210 0x555eab08d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf7199b700 1 -- 172.21.15.151:0/58347467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c10d240 con 0x555eaaee06b0 2023-07-21T22:47:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf7219c700 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 0x555eab08ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf7119a700 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a210 0x555eab08d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf7199b700 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab090560 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faf68000c00 tx=0x7faf68004ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3efad08f8d3abd87 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf557fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:47:03.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf557fa700 1 -- 172.21.15.151:0/58347467 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68004cb0 con 0x555eaaee06b0 2023-07-21T22:47:03.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.972+0000 7faf557fa700 1 -- 172.21.15.151:0/58347467 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7faf680053e0 con 0x555eaaee06b0 2023-07-21T22:47:03.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf874c3b80 1 -- 172.21.15.151:0/58347467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555eaaf2f490 con 0x555eaaee06b0 2023-07-21T22:47:03.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf557fa700 1 -- 172.21.15.151:0/58347467 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf6801d020 con 0x555eaaee06b0 2023-07-21T22:47:03.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf874c3b80 10 client.28252 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:03.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf874c3b80 1 -- 172.21.15.151:0/58347467 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x555eaadecc00 con 0x555eaaee06b0 2023-07-21T22:47:03.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf557fa700 1 -- 172.21.15.151:0/58347467 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555eaaf2f490 con 0x555eaaee06b0 2023-07-21T22:47:03.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf557fa700 1 -- 172.21.15.151:0/58347467 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7faf6800fc20 con 0x555eaaee06b0 2023-07-21T22:47:03.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf874c3b80 10 client.28252 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:03.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf874c3b80 10 client.28252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:03.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf874c3b80 20 client.28252 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:03.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf874c3b80 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555eab09d590 0x555eab09f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf874c3b80 4 client.28252 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:47:03.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.973+0000 7faf874c3b80 1 -- 172.21.15.151:0/58347467 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555eaafcee50 con 0x555eab09d590 2023-07-21T22:47:03.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.974+0000 7faf7119a700 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555eab09d590 0x555eab09f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.974+0000 7faf7119a700 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555eab09d590 0x555eab09f9a0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca6ae593b6643741 server_cookie=dec8f093b934bbcb in_seq=0 out_seq=0 2023-07-21T22:47:03.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.974+0000 7faf557fa700 10 client.28252 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf557fa700 1 -- 172.21.15.151:0/58347467 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555eaafcee50 con 0x555eab09d590 2023-07-21T22:47:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf557fa700 10 client.28252 handle_command_reply: tid=0 2023-07-21T22:47:03.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 client.28252 shutdown 2023-07-21T22:47:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 -- 172.21.15.151:0/58347467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 msgr2=0x555eab090560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab090560 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7faf68000c00 tx=0x7faf68004ac0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 -- 172.21.15.151:0/58347467 shutdown_connections 2023-07-21T22:47:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555eab09d590 0x555eab09f9a0 crc :-1 s=READY pgs=346 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 0x555eab08ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab090560 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 --2- 172.21.15.151:0/58347467 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a210 0x555eab08d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf557fa700 0 client.28252 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 -- 172.21.15.151:0/58347467 >> 172.21.15.151:0/58347467 conn(0x555eab079ae0 msgr2=0x555eab07e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.975+0000 7faf874c3b80 1 -- 172.21.15.151:0/58347467 shutdown_connections 2023-07-21T22:47:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.976+0000 7faf874c3b80 1 -- 172.21.15.151:0/58347467 wait complete. 2023-07-21T22:47:03.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.976+0000 7faf874c3b80 20 client.28252 trim_cache size 0 max 16384 2023-07-21T22:47:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.994+0000 7faf874c3b80 1 Processor -- start 2023-07-21T22:47:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.994+0000 7faf874c3b80 1 -- start start 2023-07-21T22:47:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.994+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eaaee06b0 0x555eab083f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.994+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab094b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.994+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 0x555eab090090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.994+0000 7faf874c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eab0848d0 con 0x555eaaee06b0 2023-07-21T22:47:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.994+0000 7faf874c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eab084480 con 0x555eab08a660 2023-07-21T22:47:03.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.994+0000 7faf874c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eab08bd60 con 0x555eab08a210 2023-07-21T22:47:03.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eaaee06b0 0x555eab083f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7199b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eaaee06b0 0x555eab083f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60158/0 (socket says 172.21.15.151:60158) 2023-07-21T22:47:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7199b700 1 -- 172.21.15.151:0/1022020410 learned_addr learned my addr 172.21.15.151:0/1022020410 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7119a700 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab094b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7219c700 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 0x555eab090090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7199b700 1 -- 172.21.15.151:0/1022020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 msgr2=0x555eab094b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:03.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7199b700 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab094b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7199b700 1 -- 172.21.15.151:0/1022020410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 msgr2=0x555eab090090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7199b700 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 0x555eab090090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7199b700 1 -- 172.21.15.151:0/1022020410 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555eaae2a1f0 con 0x555eaaee06b0 2023-07-21T22:47:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.995+0000 7faf7119a700 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab094b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.996+0000 7faf7199b700 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eaaee06b0 0x555eab083f40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7faf68005c00 tx=0x7faf68009550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56bea84ca33d2b30 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.996+0000 7faf60bff700 1 -- 172.21.15.151:0/1022020410 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6801d040 con 0x555eaaee06b0 2023-07-21T22:47:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.996+0000 7faf60bff700 1 -- 172.21.15.151:0/1022020410 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf68005940 con 0x555eaaee06b0 2023-07-21T22:47:03.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.996+0000 7faf60bff700 1 -- 172.21.15.151:0/1022020410 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf68023dd0 con 0x555eaaee06b0 2023-07-21T22:47:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 -- 172.21.15.151:0/1022020410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eaaee06b0 msgr2=0x555eab083f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eaaee06b0 0x555eab083f40 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7faf68005c00 tx=0x7faf68009550 comp rx=0 tx=0).stop 2023-07-21T22:47:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 -- 172.21.15.151:0/1022020410 shutdown_connections 2023-07-21T22:47:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a660 0x555eab090090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eaaee06b0 0x555eab083f40 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1022020410 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eab08a210 0x555eab094b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 -- 172.21.15.151:0/1022020410 >> 172.21.15.151:0/1022020410 conn(0x555eab079ae0 msgr2=0x555eab0878d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 -- 172.21.15.151:0/1022020410 shutdown_connections 2023-07-21T22:47:03.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 -- 172.21.15.151:0/1022020410 wait complete. 2023-07-21T22:47:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.997+0000 7faf874c3b80 1 -- start start 2023-07-21T22:47:03.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.998+0000 7faf874c3b80 1 Processor -- start 2023-07-21T22:47:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.998+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab094b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.998+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a210 0x555eab085730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.998+0000 7faf874c3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 0x555eab085c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.998+0000 7faf874c3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eab086200 con 0x555eab08a660 2023-07-21T22:47:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.998+0000 7faf874c3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eab086370 con 0x555eab08a210 2023-07-21T22:47:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.998+0000 7faf874c3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555eab086530 con 0x555eaaee06b0 2023-07-21T22:47:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.998+0000 7faf874c3b80 10 client.0 _ll_register_callbacks cb 0x7faf5c010b80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:03.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.998+0000 7faf7199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab094b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7199b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab094b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46648/0 (socket says 172.21.15.151:46648) 2023-07-21T22:47:03.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7119a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a210 0x555eab085730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7199b700 1 -- 172.21.15.151:0/1881821489 learned_addr learned my addr 172.21.15.151:0/1881821489 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:03.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7219c700 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 0x555eab085c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7199b700 1 -- 172.21.15.151:0/1881821489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a210 msgr2=0x555eab085730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:03.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7199b700 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a210 0x555eab085730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7199b700 1 -- 172.21.15.151:0/1881821489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 msgr2=0x555eab085c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7199b700 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 0x555eab085c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7199b700 1 -- 172.21.15.151:0/1881821489 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf6c1a4df0 con 0x555eaaee06b0 2023-07-21T22:47:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf7199b700 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab094b70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faf6800b2a0 tx=0x7faf68023880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b1bb055c13ec162 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf557fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:47:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf557fa700 1 -- 172.21.15.151:0/1881821489 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6801d040 con 0x555eaaee06b0 2023-07-21T22:47:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:02.999+0000 7faf874c3b80 1 -- 172.21.15.151:0/1881821489 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faf6801e040 con 0x555eaaee06b0 2023-07-21T22:47:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf557fa700 1 -- 172.21.15.151:0/1881821489 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(130..130 src has 1..130) v4 ==== 8492+0+0 (secure 0 0 0) 0x7faf68000e40 con 0x555eaaee06b0 2023-07-21T22:47:03.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf557fa700 1 -- 172.21.15.151:0/1881821489 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7faf68023b60 con 0x555eaaee06b0 2023-07-21T22:47:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf874c3b80 10 client.28258 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf874c3b80 1 -- 172.21.15.151:0/1881821489 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x555eaadecc00 con 0x555eaaee06b0 2023-07-21T22:47:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf557fa700 1 -- 172.21.15.151:0/1881821489 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faf6801e040 con 0x555eaaee06b0 2023-07-21T22:47:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf557fa700 1 -- 172.21.15.151:0/1881821489 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7faf68037450 con 0x555eaaee06b0 2023-07-21T22:47:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf874c3b80 10 client.28258 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:03.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf874c3b80 10 client.28258 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf874c3b80 20 client.28258 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555eab0f1630 0x555eab0f3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf874c3b80 4 client.28258 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:47:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.000+0000 7faf874c3b80 1 -- 172.21.15.151:0/1881821489 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555eaaf90ff0 con 0x555eab0f1630 2023-07-21T22:47:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.001+0000 7faf7119a700 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555eab0f1630 0x555eab0f3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.001+0000 7faf7119a700 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555eab0f1630 0x555eab0f3a40 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2106861ee285057d server_cookie=5fb02241ca7315d4 in_seq=0 out_seq=0 2023-07-21T22:47:03.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.001+0000 7faf557fa700 10 client.28258 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:03.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:02 smithi187 ceph-mon[96918]: pgmap v880: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2023-07-21T22:47:03.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:02 smithi195 ceph-mon[97365]: pgmap v880: 97 pgs: 97 active+clean; 8.2 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 2.1 MiB/s wr, 269 op/s 2023-07-21T22:47:03.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf557fa700 1 -- 172.21.15.151:0/1881821489 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555eaaf90ff0 con 0x555eab0f1630 2023-07-21T22:47:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf557fa700 10 client.28258 handle_command_reply: tid=0 2023-07-21T22:47:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf874c3b80 1 client.28258 shutdown 2023-07-21T22:47:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf874c3b80 1 -- 172.21.15.151:0/1881821489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 msgr2=0x555eab094b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab094b70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7faf6800b2a0 tx=0x7faf68023880 comp rx=0 tx=0).stop 2023-07-21T22:47:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf874c3b80 1 -- 172.21.15.151:0/1881821489 shutdown_connections 2023-07-21T22:47:03.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555eab0f1630 0x555eab0f3a40 crc :-1 s=READY pgs=347 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555eab08a660 0x555eab085c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555eaaee06b0 0x555eab094b70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf557fa700 0 client.28258 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf874c3b80 1 --2- 172.21.15.151:0/1881821489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555eab08a210 0x555eab085730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.653+0000 7faf874c3b80 1 -- 172.21.15.151:0/1881821489 >> 172.21.15.151:0/1881821489 conn(0x555eab079ae0 msgr2=0x555eab08aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.654+0000 7faf874c3b80 1 -- 172.21.15.151:0/1881821489 shutdown_connections 2023-07-21T22:47:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.654+0000 7faf874c3b80 1 -- 172.21.15.151:0/1881821489 wait complete. 2023-07-21T22:47:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.654+0000 7faf874c3b80 20 client.28258 trim_cache size 0 max 16384 2023-07-21T22:47:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:47:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:47:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:47:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:47:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.654+0000 7faf73bff700 1 -- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faf580a1340 msgr2=0x7faf580a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.654+0000 7faf73bff700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faf580a1340 0x7faf580a37f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7faf64009ec0 tx=0x7faf6400b040 comp rx=0 tx=0).stop 2023-07-21T22:47:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.654+0000 7faf73bff700 1 -- 172.21.15.151:0/3480496303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf6c1004b0 msgr2=0x7faf6c1982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.654+0000 7faf73bff700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf6c1004b0 0x7faf6c1982f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7faf5c00e9f0 tx=0x7faf5c00ed00 comp rx=0 tx=0).stop 2023-07-21T22:47:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.655+0000 7faf73bff700 1 -- 172.21.15.151:0/3480496303 shutdown_connections 2023-07-21T22:47:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.655+0000 7faf73bff700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7faf580a1340 0x7faf580a37f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.655+0000 7faf73bff700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf6c105b10 0x7faf6c19c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.655+0000 7faf73bff700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faf6c0ffb00 0x7faf6c197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.655+0000 7faf73bff700 1 --2- 172.21.15.151:0/3480496303 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7faf6c1004b0 0x7faf6c1982f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.655+0000 7faf73bff700 1 -- 172.21.15.151:0/3480496303 >> 172.21.15.151:0/3480496303 conn(0x7faf6c0fb600 msgr2=0x7faf6c10ae80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.655+0000 7faf73bff700 1 -- 172.21.15.151:0/3480496303 shutdown_connections 2023-07-21T22:47:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:03.655+0000 7faf73bff700 1 -- 172.21.15.151:0/3480496303 wait complete. 2023-07-21T22:47:05.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:04 smithi187 ceph-mon[96918]: pgmap v881: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.1 MiB/s wr, 413 op/s 2023-07-21T22:47:05.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:04 smithi195 ceph-mon[97365]: pgmap v881: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.1 MiB/s wr, 413 op/s 2023-07-21T22:47:05.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:04 smithi151 ceph-mon[95510]: pgmap v881: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.1 MiB/s wr, 413 op/s 2023-07-21T22:47:06.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:05 smithi187 ceph-mon[96918]: osdmap e131: 12 total, 12 up, 12 in 2023-07-21T22:47:06.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:05 smithi187 ceph-mon[96918]: pgmap v883: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.4 MiB/s wr, 324 op/s 2023-07-21T22:47:06.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:05 smithi195 ceph-mon[97365]: osdmap e131: 12 total, 12 up, 12 in 2023-07-21T22:47:06.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:05 smithi195 ceph-mon[97365]: pgmap v883: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.4 MiB/s wr, 324 op/s 2023-07-21T22:47:06.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:05 smithi151 ceph-mon[95510]: osdmap e131: 12 total, 12 up, 12 in 2023-07-21T22:47:06.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:05 smithi151 ceph-mon[95510]: pgmap v883: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.4 MiB/s wr, 324 op/s 2023-07-21T22:47:08.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:08 smithi151 ceph-mon[95510]: pgmap v884: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-07-21T22:47:09.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:08 smithi187 ceph-mon[96918]: pgmap v884: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-07-21T22:47:09.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:08 smithi195 ceph-mon[97365]: pgmap v884: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-07-21T22:47:10.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:10 smithi151 ceph-mon[95510]: pgmap v885: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-07-21T22:47:11.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:10 smithi187 ceph-mon[96918]: pgmap v885: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-07-21T22:47:11.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:10 smithi195 ceph-mon[97365]: pgmap v885: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-07-21T22:47:12.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:12 smithi151 ceph-mon[95510]: pgmap v886: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-07-21T22:47:12.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:12 smithi151 ceph-mon[95510]: osdmap e132: 12 total, 12 up, 12 in 2023-07-21T22:47:13.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:12 smithi187 ceph-mon[96918]: pgmap v886: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-07-21T22:47:13.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:12 smithi187 ceph-mon[96918]: osdmap e132: 12 total, 12 up, 12 in 2023-07-21T22:47:13.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:12 smithi195 ceph-mon[97365]: pgmap v886: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 2.2 MiB/s wr, 296 op/s 2023-07-21T22:47:13.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:12 smithi195 ceph-mon[97365]: osdmap e132: 12 total, 12 up, 12 in 2023-07-21T22:47:14.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:14 smithi151 ceph-mon[95510]: pgmap v888: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:47:15.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:14 smithi187 ceph-mon[96918]: pgmap v888: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:47:15.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:14 smithi195 ceph-mon[97365]: pgmap v888: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.4 MiB/s wr, 309 op/s 2023-07-21T22:47:15.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:15 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:47:16.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:15 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:47:16.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:15 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:47:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.807+0000 7fd5b57ff700 1 -- 172.21.15.151:0/3777769026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b01004b0 msgr2=0x7fd5b010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.807+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/3777769026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b01004b0 0x7fd5b010c940 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800b0a0 tx=0x7fd5a800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.807+0000 7fd5b57ff700 1 -- 172.21.15.151:0/3777769026 shutdown_connections 2023-07-21T22:47:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.807+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/3777769026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5b0105b10 0x7fd5b0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.807+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/3777769026 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b01004b0 0x7fd5b010c940 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.807+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/3777769026 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5b00ffb00 0x7fd5b00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.807+0000 7fd5b57ff700 1 -- 172.21.15.151:0/3777769026 >> 172.21.15.151:0/3777769026 conn(0x7fd5b00fb600 msgr2=0x7fd5b00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.807+0000 7fd5b57ff700 1 -- 172.21.15.151:0/3777769026 shutdown_connections 2023-07-21T22:47:16.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.807+0000 7fd5b57ff700 1 -- 172.21.15.151:0/3777769026 wait complete. 2023-07-21T22:47:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.808+0000 7fd5b57ff700 1 Processor -- start 2023-07-21T22:47:16.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.809+0000 7fd5b57ff700 1 -- start start 2023-07-21T22:47:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.809+0000 7fd5b57ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5b00ffb00 0x7fd5b019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.809+0000 7fd5b57ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5b01004b0 0x7fd5b019c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.809+0000 7fd5b57ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b0105b10 0x7fd5b0195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.809+0000 7fd5b57ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b01960b0 con 0x7fd5b0105b10 2023-07-21T22:47:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.809+0000 7fd5b57ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b0196220 con 0x7fd5b00ffb00 2023-07-21T22:47:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.809+0000 7fd5b57ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b01963e0 con 0x7fd5b01004b0 2023-07-21T22:47:16.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5af7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b0105b10 0x7fd5b0195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5ae7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5b01004b0 0x7fd5b019c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5af7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b0105b10 0x7fd5b0195a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60072/0 (socket says 172.21.15.151:60072) 2023-07-21T22:47:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5ae7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5b01004b0 0x7fd5b019c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58140/0 (socket says 172.21.15.151:58140) 2023-07-21T22:47:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5af7fe700 1 -- 172.21.15.151:0/4043700 learned_addr learned my addr 172.21.15.151:0/4043700 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:16.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5b00ffb00 0x7fd5b019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5af7fe700 1 -- 172.21.15.151:0/4043700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5b01004b0 msgr2=0x7fd5b019c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:16.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5af7fe700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5b01004b0 0x7fd5b019c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5af7fe700 1 -- 172.21.15.151:0/4043700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5b00ffb00 msgr2=0x7fd5b019bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5af7fe700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5b00ffb00 0x7fd5b019bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5af7fe700 1 -- 172.21.15.151:0/4043700 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5a8009d00 con 0x7fd5b0105b10 2023-07-21T22:47:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5b01004b0 0x7fd5b019c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.810+0000 7fd5af7fe700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b0105b10 0x7fd5b0195a40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800b070 tx=0x7fd5a800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.811+0000 7fd597fff700 1 -- 172.21.15.151:0/4043700 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a800e040 con 0x7fd5b0105b10 2023-07-21T22:47:16.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.811+0000 7fd5b57ff700 1 -- 172.21.15.151:0/4043700 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b0196660 con 0x7fd5b0105b10 2023-07-21T22:47:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.811+0000 7fd597fff700 1 -- 172.21.15.151:0/4043700 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5a8009480 con 0x7fd5b0105b10 2023-07-21T22:47:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.811+0000 7fd597fff700 1 -- 172.21.15.151:0/4043700 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8005040 con 0x7fd5b0105b10 2023-07-21T22:47:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.811+0000 7fd5b57ff700 1 -- 172.21.15.151:0/4043700 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b01a2bd0 con 0x7fd5b0105b10 2023-07-21T22:47:16.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.814+0000 7fd597fff700 1 -- 172.21.15.151:0/4043700 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fd5a801d480 con 0x7fd5b0105b10 2023-07-21T22:47:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.815+0000 7fd5c918fb80 1 Processor -- start 2023-07-21T22:47:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd597fff700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5980a12c0 0x7fd5980a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5c918fb80 1 -- start start 2023-07-21T22:47:16.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd597fff700 1 -- 172.21.15.151:0/4043700 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd5a80cdd40 con 0x7fd5b0105b10 2023-07-21T22:47:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a046c56b0 0x563a0486ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a04868f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 0x563a048694a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5980a12c0 0x7fd5980a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0476ec50 con 0x563a0486f210 2023-07-21T22:47:16.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a047c19e0 con 0x563a046c56b0 2023-07-21T22:47:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a047bae70 con 0x563a0486f660 2023-07-21T22:47:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5ae7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a04868f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5aeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a046c56b0 0x563a0486ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5ae7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a04868f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60080/0 (socket says 172.21.15.151:60080) 2023-07-21T22:47:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.816+0000 7fd5ae7fc700 1 -- 172.21.15.151:0/2330307617 learned_addr learned my addr 172.21.15.151:0/2330307617 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:16.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.817+0000 7fd5af7fe700 1 --2- 172.21.15.151:0/2330307617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 0x563a048694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.817+0000 7fd5aeffd700 1 -- 172.21.15.151:0/2330307617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 msgr2=0x563a048694a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.817+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/2330307617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 0x563a048694a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.817+0000 7fd5aeffd700 1 -- 172.21.15.151:0/2330307617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 msgr2=0x563a04868f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.817+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/2330307617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a04868f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.817+0000 7fd5aeffd700 1 -- 172.21.15.151:0/2330307617 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a045e8d80 con 0x563a046c56b0 2023-07-21T22:47:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.817+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/2330307617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a04868f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:16.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.817+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5980a12c0 0x7fd5980a3770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4013e40 tx=0x7fd5a4013460 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.817+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/2330307617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a046c56b0 0x563a0486ecd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009cb0 tx=0x7fd5a00058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86de3047aef0e10d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5957fa700 1 -- 172.21.15.151:0/2330307617 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0011ce0 con 0x563a046c56b0 2023-07-21T22:47:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5957fa700 1 -- 172.21.15.151:0/2330307617 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5a0011e40 con 0x563a046c56b0 2023-07-21T22:47:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5957fa700 1 -- 172.21.15.151:0/2330307617 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0005020 con 0x563a046c56b0 2023-07-21T22:47:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2330307617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a046c56b0 msgr2=0x563a0486ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2330307617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a046c56b0 0x563a0486ecd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0009cb0 tx=0x7fd5a00058e0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2330307617 shutdown_connections 2023-07-21T22:47:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2330307617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a046c56b0 0x563a0486ecd0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2330307617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 0x563a048694a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2330307617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a04868f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.818+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2330307617 >> 172.21.15.151:0/2330307617 conn(0x563a0485eae0 msgr2=0x563a048640e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.819+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2330307617 shutdown_connections 2023-07-21T22:47:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.819+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2330307617 wait complete. 2023-07-21T22:47:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.819+0000 7fd5c918fb80 1 -- start start 2023-07-21T22:47:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.819+0000 7fd5c918fb80 1 Processor -- start 2023-07-21T22:47:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f210 0x563a048727f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 0x563a04872e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0475aa60 con 0x563a046c56b0 2023-07-21T22:47:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0475a760 con 0x563a0486f210 2023-07-21T22:47:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0463e8c0 con 0x563a0486f660 2023-07-21T22:47:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5c918fb80 10 client.0 _ll_register_callbacks cb 0x563a04758700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5aeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5aeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60094/0 (socket says 172.21.15.151:60094) 2023-07-21T22:47:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5aeffd700 1 -- 172.21.15.151:0/2674936665 learned_addr learned my addr 172.21.15.151:0/2674936665 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5af7fe700 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 0x563a04872e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.820+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f210 0x563a048727f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd5aeffd700 1 -- 172.21.15.151:0/2674936665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 msgr2=0x563a04872e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 0x563a04872e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd5aeffd700 1 -- 172.21.15.151:0/2674936665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f210 msgr2=0x563a048727f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f210 0x563a048727f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd5aeffd700 1 -- 172.21.15.151:0/2674936665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a401b040 con 0x563a046c56b0 2023-07-21T22:47:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f210 0x563a048727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:47:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875500 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0000c00 tx=0x7fd5a0005e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff6c1770258d19 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd592ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:47:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd592ff5700 1 -- 172.21.15.151:0/2674936665 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0004260 con 0x563a046c56b0 2023-07-21T22:47:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2674936665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563a04714490 con 0x563a046c56b0 2023-07-21T22:47:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.821+0000 7fd592ff5700 1 -- 172.21.15.151:0/2674936665 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd5a00043c0 con 0x563a046c56b0 2023-07-21T22:47:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd592ff5700 1 -- 172.21.15.151:0/2674936665 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5a0003680 con 0x563a046c56b0 2023-07-21T22:47:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd5c918fb80 10 client.18564 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2674936665 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x7fd5a00098e0 con 0x563a046c56b0 2023-07-21T22:47:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd592ff5700 1 -- 172.21.15.151:0/2674936665 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563a04714490 con 0x563a046c56b0 2023-07-21T22:47:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd592ff5700 1 -- 172.21.15.151:0/2674936665 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd5a0005100 con 0x563a046c56b0 2023-07-21T22:47:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd5c918fb80 10 client.18564 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd5c918fb80 10 client.18564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd5c918fb80 20 client.18564 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563a04886e30 0x563a04889240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd5c918fb80 4 client.18564 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:47:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.822+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2674936665 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563a047b3e50 con 0x563a04886e30 2023-07-21T22:47:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.823+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563a04886e30 0x563a04889240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.823+0000 7fd592ff5700 10 client.18564 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.823+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563a04886e30 0x563a04889240 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1992096b1f3325d server_cookie=fa3c24579bff5c41 in_seq=0 out_seq=0 2023-07-21T22:47:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd592ff5700 1 -- 172.21.15.151:0/2674936665 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563a047b3e50 con 0x563a04886e30 2023-07-21T22:47:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd592ff5700 10 client.18564 handle_command_reply: tid=0 2023-07-21T22:47:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 client.18564 shutdown 2023-07-21T22:47:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2674936665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 msgr2=0x563a04875500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875500 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0000c00 tx=0x7fd5a0005e00 comp rx=0 tx=0).stop 2023-07-21T22:47:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2674936665 shutdown_connections 2023-07-21T22:47:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563a04886e30 0x563a04889240 crc :-1 s=READY pgs=348 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f660 0x563a04872e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875500 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2674936665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f210 0x563a048727f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2674936665 >> 172.21.15.151:0/2674936665 conn(0x563a0485eae0 msgr2=0x563a048633e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd592ff5700 0 client.18564 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.824+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2674936665 shutdown_connections 2023-07-21T22:47:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.825+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2674936665 wait complete. 2023-07-21T22:47:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.825+0000 7fd5c918fb80 20 client.18564 trim_cache size 0 max 16384 2023-07-21T22:47:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.841+0000 7fd5c918fb80 1 Processor -- start 2023-07-21T22:47:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5c918fb80 1 -- start start 2023-07-21T22:47:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a046c56b0 0x563a0486e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a048750a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 0x563a04870140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a048604f0 con 0x563a0486f210 2023-07-21T22:47:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a048898a0 con 0x563a0486f660 2023-07-21T22:47:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0486e8d0 con 0x563a046c56b0 2023-07-21T22:47:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5ae7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a048750a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5ae7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a048750a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60100/0 (socket says 172.21.15.151:60100) 2023-07-21T22:47:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5ae7fc700 1 -- 172.21.15.151:0/2737081365 learned_addr learned my addr 172.21.15.151:0/2737081365 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a046c56b0 0x563a0486e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5af7fe700 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 0x563a04870140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.842+0000 7fd5ae7fc700 1 -- 172.21.15.151:0/2737081365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a046c56b0 msgr2=0x563a0486e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.843+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a046c56b0 0x563a0486e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.843+0000 7fd5ae7fc700 1 -- 172.21.15.151:0/2737081365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 msgr2=0x563a04870140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.843+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 0x563a04870140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.843+0000 7fd5ae7fc700 1 -- 172.21.15.151:0/2737081365 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563a0488de30 con 0x563a0486f210 2023-07-21T22:47:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.843+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a046c56b0 0x563a0486e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:47:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.843+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a048750a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x563a04873d30 tx=0x7fd5a4023040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e70b904fb503dc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.843+0000 7fd595ffb700 1 -- 172.21.15.151:0/2737081365 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a40293f0 con 0x563a0486f210 2023-07-21T22:47:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.843+0000 7fd595ffb700 1 -- 172.21.15.151:0/2737081365 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5a4029550 con 0x563a0486f210 2023-07-21T22:47:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.843+0000 7fd595ffb700 1 -- 172.21.15.151:0/2737081365 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4021c40 con 0x563a0486f210 2023-07-21T22:47:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2737081365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 msgr2=0x563a048750a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a048750a0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x563a04873d30 tx=0x7fd5a4023040 comp rx=0 tx=0).stop 2023-07-21T22:47:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2737081365 shutdown_connections 2023-07-21T22:47:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 0x563a04870140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a046c56b0 0x563a0486e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/2737081365 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a0486f210 0x563a048750a0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2737081365 >> 172.21.15.151:0/2737081365 conn(0x563a0485eae0 msgr2=0x563a0486fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2737081365 shutdown_connections 2023-07-21T22:47:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 -- 172.21.15.151:0/2737081365 wait complete. 2023-07-21T22:47:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.844+0000 7fd5c918fb80 1 -- start start 2023-07-21T22:47:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5c918fb80 1 Processor -- start 2023-07-21T22:47:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f210 0x563a048762f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5c918fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 0x563a0487a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0487a8a0 con 0x563a046c56b0 2023-07-21T22:47:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0487a9e0 con 0x563a0486f660 2023-07-21T22:47:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5c918fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563a0487aba0 con 0x563a0486f210 2023-07-21T22:47:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5c918fb80 10 client.0 _ll_register_callbacks cb 0x7fd5a4013990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5aeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5aeffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60112/0 (socket says 172.21.15.151:60112) 2023-07-21T22:47:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5aeffd700 1 -- 172.21.15.151:0/779939866 learned_addr learned my addr 172.21.15.151:0/779939866 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.845+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f210 0x563a048762f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5af7fe700 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 0x563a0487a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5aeffd700 1 -- 172.21.15.151:0/779939866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f210 msgr2=0x563a048762f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f210 0x563a048762f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5aeffd700 1 -- 172.21.15.151:0/779939866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 msgr2=0x563a0487a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 0x563a0487a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5aeffd700 1 -- 172.21.15.151:0/779939866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a4013790 con 0x563a046c56b0 2023-07-21T22:47:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5af7fe700 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 0x563a0487a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:47:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5aeffd700 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875db0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0005d20 tx=0x7fd5a00227b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c46fd7fc07a89e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd592ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:47:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd592ff5700 1 -- 172.21.15.151:0/779939866 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a0004800 con 0x563a046c56b0 2023-07-21T22:47:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5c918fb80 1 -- 172.21.15.151:0/779939866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5a0011e40 con 0x563a046c56b0 2023-07-21T22:47:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd592ff5700 1 -- 172.21.15.151:0/779939866 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd5a0000e40 con 0x563a046c56b0 2023-07-21T22:47:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd592ff5700 1 -- 172.21.15.151:0/779939866 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd5a0004470 con 0x563a046c56b0 2023-07-21T22:47:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5c918fb80 10 client.18570 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.846+0000 7fd5c918fb80 1 -- 172.21.15.151:0/779939866 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x563a045d1c00 con 0x563a046c56b0 2023-07-21T22:47:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.847+0000 7fd592ff5700 1 -- 172.21.15.151:0/779939866 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5a0011e40 con 0x563a046c56b0 2023-07-21T22:47:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.847+0000 7fd592ff5700 1 -- 172.21.15.151:0/779939866 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fd5a0004c60 con 0x563a046c56b0 2023-07-21T22:47:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.847+0000 7fd5c918fb80 10 client.18570 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.847+0000 7fd5c918fb80 10 client.18570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.847+0000 7fd5c918fb80 20 client.18570 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.847+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563a048e0120 0x563a048e2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.847+0000 7fd5c918fb80 4 client.18570 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:47:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.847+0000 7fd5c918fb80 1 -- 172.21.15.151:0/779939866 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563a04775ff0 con 0x563a048e0120 2023-07-21T22:47:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.847+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563a048e0120 0x563a048e2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.848+0000 7fd5ae7fc700 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563a048e0120 0x563a048e2530 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa5bb21a2aa78573 server_cookie=5154546ba994c398 in_seq=0 out_seq=0 2023-07-21T22:47:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.848+0000 7fd592ff5700 10 client.18570 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:16.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.858+0000 7fd592ff5700 1 -- 172.21.15.151:0/779939866 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563a04775ff0 con 0x563a048e0120 2023-07-21T22:47:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.858+0000 7fd592ff5700 10 client.18570 handle_command_reply: tid=0 2023-07-21T22:47:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.858+0000 7fd5c918fb80 1 client.18570 shutdown 2023-07-21T22:47:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 -- 172.21.15.151:0/779939866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 msgr2=0x563a04875db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875db0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd5a0005d20 tx=0x7fd5a00227b0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 -- 172.21.15.151:0/779939866 shutdown_connections 2023-07-21T22:47:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563a048e0120 0x563a048e2530 crc :-1 s=READY pgs=349 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563a0486f660 0x563a0487a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563a046c56b0 0x563a04875db0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 --2- 172.21.15.151:0/779939866 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563a0486f210 0x563a048762f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 -- 172.21.15.151:0/779939866 >> 172.21.15.151:0/779939866 conn(0x563a0485eae0 msgr2=0x563a0486e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd592ff5700 0 client.18570 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 -- 172.21.15.151:0/779939866 shutdown_connections 2023-07-21T22:47:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 1 -- 172.21.15.151:0/779939866 wait complete. 2023-07-21T22:47:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5c918fb80 20 client.18570 trim_cache size 0 max 16384 2023-07-21T22:47:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:47:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:47:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:47:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:47:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5b57ff700 1 -- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5980a12c0 msgr2=0x7fd5980a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.859+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5980a12c0 0x7fd5980a3770 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4013e40 tx=0x7fd5a4013460 comp rx=0 tx=0).stop 2023-07-21T22:47:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 -- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b0105b10 msgr2=0x7fd5b0195a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b0105b10 0x7fd5b0195a40 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800b070 tx=0x7fd5a800bce0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 -- 172.21.15.151:0/4043700 shutdown_connections 2023-07-21T22:47:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5980a12c0 0x7fd5980a3770 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5b00ffb00 0x7fd5b019bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd5b0105b10 0x7fd5b0195a40 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 --2- 172.21.15.151:0/4043700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd5b01004b0 0x7fd5b019c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 -- 172.21.15.151:0/4043700 >> 172.21.15.151:0/4043700 conn(0x7fd5b00fb600 msgr2=0x7fd5b00fbba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 -- 172.21.15.151:0/4043700 shutdown_connections 2023-07-21T22:47:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:16.860+0000 7fd5b57ff700 1 -- 172.21.15.151:0/4043700 wait complete. 2023-07-21T22:47:16.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:16 smithi151 ceph-mon[95510]: pgmap v889: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 265 op/s 2023-07-21T22:47:17.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:16 smithi187 ceph-mon[96918]: pgmap v889: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 265 op/s 2023-07-21T22:47:17.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:16 smithi195 ceph-mon[97365]: pgmap v889: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.0 MiB/s wr, 265 op/s 2023-07-21T22:47:18.836 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:18 smithi195 ceph-mon[97365]: pgmap v890: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 274 op/s 2023-07-21T22:47:18.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:18 smithi151 ceph-mon[95510]: pgmap v890: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 274 op/s 2023-07-21T22:47:19.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:18 smithi187 ceph-mon[96918]: pgmap v890: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 274 op/s 2023-07-21T22:47:20.900 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:20 smithi195 ceph-mon[97365]: pgmap v891: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 274 op/s 2023-07-21T22:47:20.900 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:47:20.900 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:47:20.900 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:47:20.900 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:47:20.901 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:20 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:47:20.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:20 smithi151 ceph-mon[95510]: pgmap v891: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 274 op/s 2023-07-21T22:47:20.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:47:20.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:47:20.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:47:20.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:47:20.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:20 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:47:21.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:20 smithi187 ceph-mon[96918]: pgmap v891: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 274 op/s 2023-07-21T22:47:21.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:47:21.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:47:21.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:47:21.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:47:21.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:20 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:47:22.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:22 smithi151 ceph-mon[95510]: pgmap v892: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 274 op/s 2023-07-21T22:47:23.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:22 smithi187 ceph-mon[96918]: pgmap v892: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 274 op/s 2023-07-21T22:47:23.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:22 smithi195 ceph-mon[97365]: pgmap v892: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 274 op/s 2023-07-21T22:47:24.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:24 smithi151 ceph-mon[95510]: pgmap v893: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:47:25.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:24 smithi187 ceph-mon[96918]: pgmap v893: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:47:25.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:24 smithi195 ceph-mon[97365]: pgmap v893: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.7 MiB/s wr, 351 op/s 2023-07-21T22:47:26.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:26 smithi151 ceph-mon[95510]: pgmap v894: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.7 MiB/s wr, 222 op/s 2023-07-21T22:47:27.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:26 smithi187 ceph-mon[96918]: pgmap v894: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.7 MiB/s wr, 222 op/s 2023-07-21T22:47:27.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:26 smithi195 ceph-mon[97365]: pgmap v894: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.7 MiB/s wr, 222 op/s 2023-07-21T22:47:28.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:28 smithi151 ceph-mon[95510]: pgmap v895: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.6 MiB/s wr, 337 op/s 2023-07-21T22:47:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:28 smithi187 ceph-mon[96918]: pgmap v895: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.6 MiB/s wr, 337 op/s 2023-07-21T22:47:29.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:28 smithi195 ceph-mon[97365]: pgmap v895: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.6 MiB/s wr, 337 op/s 2023-07-21T22:47:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.137+0000 7f7011fff700 1 -- 172.21.15.151:0/3519647200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c1004b0 msgr2=0x7f700c10c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.137+0000 7f7011fff700 1 --2- 172.21.15.151:0/3519647200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c1004b0 0x7f700c10c940 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f700400b0a0 tx=0x7f700400b3b0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.138+0000 7f7011fff700 1 -- 172.21.15.151:0/3519647200 shutdown_connections 2023-07-21T22:47:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.138+0000 7f7011fff700 1 --2- 172.21.15.151:0/3519647200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c1004b0 0x7f700c10c940 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.138+0000 7f7011fff700 1 --2- 172.21.15.151:0/3519647200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f700c105b10 0x7f700c105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.138+0000 7f7011fff700 1 --2- 172.21.15.151:0/3519647200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f700c0ffb00 0x7f700c0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.138+0000 7f7011fff700 1 -- 172.21.15.151:0/3519647200 >> 172.21.15.151:0/3519647200 conn(0x7f700c0fb600 msgr2=0x7f700c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.138+0000 7f7011fff700 1 -- 172.21.15.151:0/3519647200 shutdown_connections 2023-07-21T22:47:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.138+0000 7f7011fff700 1 -- 172.21.15.151:0/3519647200 wait complete. 2023-07-21T22:47:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.139+0000 7f7011fff700 1 Processor -- start 2023-07-21T22:47:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.139+0000 7f7011fff700 1 -- start start 2023-07-21T22:47:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.139+0000 7f7011fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f700c0ffb00 0x7f700c19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.139+0000 7f7011fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f700c1004b0 0x7f700c19c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f7011fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c105b10 0x7f700c195a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f7011fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c1960c0 con 0x7f700c105b10 2023-07-21T22:47:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f7011fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c196230 con 0x7f700c1004b0 2023-07-21T22:47:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f7011fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700c1963f0 con 0x7f700c0ffb00 2023-07-21T22:47:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c105b10 0x7f700c195a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f700c1004b0 0x7f700c19c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f700c0ffb00 0x7f700c19bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c105b10 0x7f700c195a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33992/0 (socket says 172.21.15.151:33992) 2023-07-21T22:47:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700bfff700 1 -- 172.21.15.151:0/3176474917 learned_addr learned my addr 172.21.15.151:0/3176474917 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f700c1004b0 0x7f700c19c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46738/0 (socket says 172.21.15.151:46738) 2023-07-21T22:47:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700affd700 1 -- 172.21.15.151:0/3176474917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f700c0ffb00 msgr2=0x7f700c19bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700affd700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f700c0ffb00 0x7f700c19bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700affd700 1 -- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c105b10 msgr2=0x7f700c195a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700affd700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c105b10 0x7f700c195a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700affd700 1 -- 172.21.15.151:0/3176474917 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7004009d00 con 0x7f700c1004b0 2023-07-21T22:47:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.140+0000 7f700bfff700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c105b10 0x7f700c195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.141+0000 7f700affd700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f700c1004b0 0x7f700c19c130 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f700000e9f0 tx=0x7f700000ed00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.141+0000 7f7008ff9700 1 -- 172.21.15.151:0/3176474917 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700000c9c0 con 0x7f700c1004b0 2023-07-21T22:47:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.141+0000 7f7011fff700 1 -- 172.21.15.151:0/3176474917 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700c1966d0 con 0x7f700c1004b0 2023-07-21T22:47:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.141+0000 7f7008ff9700 1 -- 172.21.15.151:0/3176474917 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7000010430 con 0x7f700c1004b0 2023-07-21T22:47:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.141+0000 7f7008ff9700 1 -- 172.21.15.151:0/3176474917 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000018680 con 0x7f700c1004b0 2023-07-21T22:47:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.141+0000 7f7011fff700 1 -- 172.21.15.151:0/3176474917 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f700c072920 con 0x7f700c1004b0 2023-07-21T22:47:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.144+0000 7f7008ff9700 1 -- 172.21.15.151:0/3176474917 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f70000105a0 con 0x7f700c1004b0 2023-07-21T22:47:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.146+0000 7f7008ff9700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6ff40a1340 0x7f6ff40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.146+0000 7f7008ff9700 1 -- 172.21.15.151:0/3176474917 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7000014070 con 0x7f700c1004b0 2023-07-21T22:47:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.146+0000 7f700b7fe700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6ff40a1340 0x7f6ff40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.146+0000 7f70258d6b80 1 Processor -- start 2023-07-21T22:47:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f70258d6b80 1 -- start start 2023-07-21T22:47:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f700b7fe700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6ff40a1340 0x7f6ff40a37f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009be0 tx=0x7f6ffc009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9210 0x562b7b9a2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9660 0x562b7b9a34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f70258d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b8a8c50 con 0x562b7b9a9660 2023-07-21T22:47:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f70258d6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b8fb9e0 con 0x562b7b9a9210 2023-07-21T22:47:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f70258d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b8f4e70 con 0x562b7b7ff6b0 2023-07-21T22:47:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f700bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9660 0x562b7b9a34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f700affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9210 0x562b7b9a2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46846/0 (socket says 172.21.15.151:46846) 2023-07-21T22:47:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f700bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9660 0x562b7b9a34a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33994/0 (socket says 172.21.15.151:33994) 2023-07-21T22:47:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.147+0000 7f700b7fe700 1 -- 172.21.15.151:0/3993024935 learned_addr learned my addr 172.21.15.151:0/3993024935 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.148+0000 7f700b7fe700 1 -- 172.21.15.151:0/3993024935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9210 msgr2=0x562b7b9a2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.148+0000 7f700b7fe700 1 --2- 172.21.15.151:0/3993024935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9210 0x562b7b9a2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.148+0000 7f700b7fe700 1 -- 172.21.15.151:0/3993024935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9660 msgr2=0x562b7b9a34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.148+0000 7f700b7fe700 1 --2- 172.21.15.151:0/3993024935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9660 0x562b7b9a34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.148+0000 7f700b7fe700 1 -- 172.21.15.151:0/3993024935 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b7b722d80 con 0x562b7b7ff6b0 2023-07-21T22:47:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.148+0000 7f700b7fe700 1 --2- 172.21.15.151:0/3993024935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc011d70 tx=0x7f6ffc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=94b69e7a6fe4e2ff server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.148+0000 7f6ff1ffb700 1 -- 172.21.15.151:0/3993024935 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc011da0 con 0x562b7b7ff6b0 2023-07-21T22:47:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f6ff1ffb700 1 -- 172.21.15.151:0/3993024935 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ffc004020 con 0x562b7b7ff6b0 2023-07-21T22:47:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f6ff1ffb700 1 -- 172.21.15.151:0/3993024935 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc003c30 con 0x562b7b7ff6b0 2023-07-21T22:47:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f70258d6b80 1 -- 172.21.15.151:0/3993024935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b7ff6b0 msgr2=0x562b7b9a8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3993024935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8cd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc011d70 tx=0x7f6ffc014000 comp rx=0 tx=0).stop 2023-07-21T22:47:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f70258d6b80 1 -- 172.21.15.151:0/3993024935 shutdown_connections 2023-07-21T22:47:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3993024935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9660 0x562b7b9a34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3993024935 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8cd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3993024935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9210 0x562b7b9a2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f70258d6b80 1 -- 172.21.15.151:0/3993024935 >> 172.21.15.151:0/3993024935 conn(0x562b7b998ae0 msgr2=0x562b7b99e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:30.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.149+0000 7f70258d6b80 1 -- 172.21.15.151:0/3993024935 shutdown_connections 2023-07-21T22:47:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.150+0000 7f70258d6b80 1 -- 172.21.15.151:0/3993024935 wait complete. 2023-07-21T22:47:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.150+0000 7f70258d6b80 1 -- start start 2023-07-21T22:47:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.150+0000 7f70258d6b80 1 Processor -- start 2023-07-21T22:47:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9ac810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 0x562b7b9ace40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f70258d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b894a60 con 0x562b7b9a9210 2023-07-21T22:47:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f70258d6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b894760 con 0x562b7b7ff6b0 2023-07-21T22:47:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f70258d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b7788c0 con 0x562b7b9a9660 2023-07-21T22:47:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f70258d6b80 10 client.0 _ll_register_callbacks cb 0x562b7b892700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f700affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9ac810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f700affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9ac810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34000/0 (socket says 172.21.15.151:34000) 2023-07-21T22:47:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f700affd700 1 -- 172.21.15.151:0/3266441431 learned_addr learned my addr 172.21.15.151:0/3266441431 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f700bfff700 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 0x562b7b9ace40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.151+0000 7f700b7fe700 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f700affd700 1 -- 172.21.15.151:0/3266441431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 msgr2=0x562b7b9ace40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f700affd700 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 0x562b7b9ace40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f700affd700 1 -- 172.21.15.151:0/3266441431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 msgr2=0x562b7b9af520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f700affd700 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9af520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f700affd700 1 -- 172.21.15.151:0/3266441431 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ffc017070 con 0x562b7b9a9210 2023-07-21T22:47:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f700affd700 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9ac810 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7000099e40 tx=0x7f70000108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef83c5b1aa5bd60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:30.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f6feaffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:47:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f6feaffd700 1 -- 172.21.15.151:0/3266441431 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70000b1070 con 0x562b7b9a9210 2023-07-21T22:47:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f6feaffd700 1 -- 172.21.15.151:0/3266441431 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f700009dee0 con 0x562b7b9a9210 2023-07-21T22:47:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.152+0000 7f70258d6b80 1 -- 172.21.15.151:0/3266441431 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562b7b84e490 con 0x562b7b9a9210 2023-07-21T22:47:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f6feaffd700 1 -- 172.21.15.151:0/3266441431 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70000a2300 con 0x562b7b9a9210 2023-07-21T22:47:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f70258d6b80 10 client.18582 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f70258d6b80 1 -- 172.21.15.151:0/3266441431 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x562b7b70bc00 con 0x562b7b9a9210 2023-07-21T22:47:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f6feaffd700 1 -- 172.21.15.151:0/3266441431 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f70000c8080 con 0x562b7b9a9210 2023-07-21T22:47:30.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f6feaffd700 1 -- 172.21.15.151:0/3266441431 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f70000adbb0 con 0x562b7b9a9210 2023-07-21T22:47:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f70258d6b80 10 client.18582 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f70258d6b80 10 client.18582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f70258d6b80 20 client.18582 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562b7b9bca30 0x562b7b9bee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f70258d6b80 4 client.18582 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:47:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f70258d6b80 1 -- 172.21.15.151:0/3266441431 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562b7b8ede50 con 0x562b7b9bca30 2023-07-21T22:47:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.153+0000 7f700b7fe700 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562b7b9bca30 0x562b7b9bee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.154+0000 7f6feaffd700 10 client.18582 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.154+0000 7f700b7fe700 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562b7b9bca30 0x562b7b9bee40 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d12707d3ee4d264f server_cookie=80ef9683df491c4f in_seq=0 out_seq=0 2023-07-21T22:47:30.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f6feaffd700 1 -- 172.21.15.151:0/3266441431 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562b7b8ede50 con 0x562b7b9bca30 2023-07-21T22:47:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f6feaffd700 10 client.18582 handle_command_reply: tid=0 2023-07-21T22:47:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 client.18582 shutdown 2023-07-21T22:47:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 -- 172.21.15.151:0/3266441431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 msgr2=0x562b7b9ac810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9ac810 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f7000099e40 tx=0x7f70000108f0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 -- 172.21.15.151:0/3266441431 shutdown_connections 2023-07-21T22:47:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562b7b9bca30 0x562b7b9bee40 crc :-1 s=READY pgs=350 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9af520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 0x562b7b9ace40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f6feaffd700 0 client.18582 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 --2- 172.21.15.151:0/3266441431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9ac810 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 -- 172.21.15.151:0/3266441431 >> 172.21.15.151:0/3266441431 conn(0x562b7b998ae0 msgr2=0x562b7b99d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 -- 172.21.15.151:0/3266441431 shutdown_connections 2023-07-21T22:47:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.155+0000 7f70258d6b80 1 -- 172.21.15.151:0/3266441431 wait complete. 2023-07-21T22:47:30.199 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.156+0000 7f70258d6b80 20 client.18582 trim_cache size 0 max 16384 2023-07-21T22:47:30.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.173+0000 7f70258d6b80 1 Processor -- start 2023-07-21T22:47:30.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.173+0000 7f70258d6b80 1 -- start start 2023-07-21T22:47:30.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.173+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.173+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9af0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.173+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 0x562b7b9aa1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.173+0000 7f70258d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b9ba100 con 0x562b7b9a9210 2023-07-21T22:47:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.173+0000 7f70258d6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b9add80 con 0x562b7b7ff6b0 2023-07-21T22:47:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.173+0000 7f70258d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b99a4f0 con 0x562b7b9a9660 2023-07-21T22:47:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9af0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46752/0 (socket says 172.21.15.151:46752) 2023-07-21T22:47:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700b7fe700 1 -- 172.21.15.151:0/1888795859 learned_addr learned my addr 172.21.15.151:0/1888795859 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:30.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700bfff700 1 --2- 172.21.15.151:0/1888795859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 0x562b7b9aa1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700b7fe700 1 -- 172.21.15.151:0/1888795859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 msgr2=0x562b7b9aa1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700b7fe700 1 --2- 172.21.15.151:0/1888795859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 0x562b7b9aa1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700b7fe700 1 -- 172.21.15.151:0/1888795859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 msgr2=0x562b7b9af0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700b7fe700 1 --2- 172.21.15.151:0/1888795859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9af0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700b7fe700 1 -- 172.21.15.151:0/1888795859 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562b7b9c3a70 con 0x562b7b7ff6b0 2023-07-21T22:47:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.174+0000 7f700b7fe700 1 --2- 172.21.15.151:0/1888795859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc005950 tx=0x7f6ffc029040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=838b9779f4df89be server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.175+0000 7f6ff27fc700 1 -- 172.21.15.151:0/1888795859 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc02c040 con 0x562b7b7ff6b0 2023-07-21T22:47:30.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.175+0000 7f6ff27fc700 1 -- 172.21.15.151:0/1888795859 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ffc032e50 con 0x562b7b7ff6b0 2023-07-21T22:47:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.175+0000 7f6ff27fc700 1 -- 172.21.15.151:0/1888795859 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc0324e0 con 0x562b7b7ff6b0 2023-07-21T22:47:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 -- 172.21.15.151:0/1888795859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 msgr2=0x562b7b9a8180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 --2- 172.21.15.151:0/1888795859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8180 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc005950 tx=0x7f6ffc029040 comp rx=0 tx=0).stop 2023-07-21T22:47:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 -- 172.21.15.151:0/1888795859 shutdown_connections 2023-07-21T22:47:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 --2- 172.21.15.151:0/1888795859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b7ff6b0 0x562b7b9a8180 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 --2- 172.21.15.151:0/1888795859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9660 0x562b7b9aa1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 --2- 172.21.15.151:0/1888795859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b9a9210 0x562b7b9af0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 -- 172.21.15.151:0/1888795859 >> 172.21.15.151:0/1888795859 conn(0x562b7b998ae0 msgr2=0x562b7b9a9aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 -- 172.21.15.151:0/1888795859 shutdown_connections 2023-07-21T22:47:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 -- 172.21.15.151:0/1888795859 wait complete. 2023-07-21T22:47:30.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.176+0000 7f70258d6b80 1 -- start start 2023-07-21T22:47:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f70258d6b80 1 Processor -- start 2023-07-21T22:47:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b7ff6b0 0x562b7b9b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9210 0x562b7b9aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f70258d6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9660 0x562b7b9ab500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f70258d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b9aba40 con 0x562b7b7ff6b0 2023-07-21T22:47:30.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f70258d6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b9abbb0 con 0x562b7b9a9660 2023-07-21T22:47:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f70258d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562b7b9abd70 con 0x562b7b9a9210 2023-07-21T22:47:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f70258d6b80 10 client.0 _ll_register_callbacks cb 0x7f7000099a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b7ff6b0 0x562b7b9b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f700b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b7ff6b0 0x562b7b9b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34018/0 (socket says 172.21.15.151:34018) 2023-07-21T22:47:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f700b7fe700 1 -- 172.21.15.151:0/95104179 learned_addr learned my addr 172.21.15.151:0/95104179 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.177+0000 7f700affd700 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9210 0x562b7b9aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f700bfff700 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9660 0x562b7b9ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f700b7fe700 1 -- 172.21.15.151:0/95104179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9210 msgr2=0x562b7b9aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f700b7fe700 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9210 0x562b7b9aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f700b7fe700 1 -- 172.21.15.151:0/95104179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9660 msgr2=0x562b7b9ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f700b7fe700 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9660 0x562b7b9ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f700b7fe700 1 -- 172.21.15.151:0/95104179 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562b7b722d80 con 0x562b7b7ff6b0 2023-07-21T22:47:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f700affd700 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9210 0x562b7b9aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f700b7fe700 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b7ff6b0 0x562b7b9b3b50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc005cf0 tx=0x7f6ffc005d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7cdcd8b91af2a43 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:30.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f6feaffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:47:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.178+0000 7f6feaffd700 1 -- 172.21.15.151:0/95104179 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ffc02c040 con 0x562b7b7ff6b0 2023-07-21T22:47:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f6feaffd700 1 -- 172.21.15.151:0/95104179 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6ffc032bc0 con 0x562b7b7ff6b0 2023-07-21T22:47:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f70258d6b80 1 -- 172.21.15.151:0/95104179 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6ffc004020 con 0x562b7b7ff6b0 2023-07-21T22:47:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f6feaffd700 1 -- 172.21.15.151:0/95104179 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6ffc00ee70 con 0x562b7b7ff6b0 2023-07-21T22:47:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f70258d6b80 10 client.18588 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f70258d6b80 1 -- 172.21.15.151:0/95104179 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x562b7b7491f0 con 0x562b7b7ff6b0 2023-07-21T22:47:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f6feaffd700 1 -- 172.21.15.151:0/95104179 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6ffc004020 con 0x562b7b7ff6b0 2023-07-21T22:47:30.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f6feaffd700 1 -- 172.21.15.151:0/95104179 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6ffc024030 con 0x562b7b7ff6b0 2023-07-21T22:47:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f70258d6b80 10 client.18588 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f70258d6b80 10 client.18588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f70258d6b80 20 client.18588 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f70258d6b80 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562b7ba11820 0x562b7ba13c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f70258d6b80 4 client.18588 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:47:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.179+0000 7f70258d6b80 1 -- 172.21.15.151:0/95104179 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562b7b8afff0 con 0x562b7ba11820 2023-07-21T22:47:30.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.180+0000 7f700affd700 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562b7ba11820 0x562b7ba13c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.180+0000 7f700affd700 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562b7ba11820 0x562b7ba13c00 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1f2f13c29ab8e102 server_cookie=aecd4e12164e87b2 in_seq=0 out_seq=0 2023-07-21T22:47:30.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.180+0000 7f6feaffd700 10 client.18588 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f6feaffd700 1 -- 172.21.15.151:0/95104179 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562b7b8afff0 con 0x562b7ba11820 2023-07-21T22:47:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f6feaffd700 10 client.18588 handle_command_reply: tid=0 2023-07-21T22:47:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f70258d6b80 1 client.18588 shutdown 2023-07-21T22:47:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f70258d6b80 1 -- 172.21.15.151:0/95104179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b7ff6b0 msgr2=0x562b7b9b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:30.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f70258d6b80 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b7ff6b0 0x562b7b9b3b50 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc005cf0 tx=0x7f6ffc005d20 comp rx=0 tx=0).stop 2023-07-21T22:47:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f70258d6b80 1 -- 172.21.15.151:0/95104179 shutdown_connections 2023-07-21T22:47:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f70258d6b80 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562b7ba11820 0x562b7ba13c00 crc :-1 s=READY pgs=351 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f70258d6b80 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562b7b9a9660 0x562b7b9ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f70258d6b80 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562b7b7ff6b0 0x562b7b9b3b50 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.187+0000 7f70258d6b80 1 --2- 172.21.15.151:0/95104179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562b7b9a9210 0x562b7b9aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.188+0000 7f70258d6b80 1 -- 172.21.15.151:0/95104179 >> 172.21.15.151:0/95104179 conn(0x562b7b998ae0 msgr2=0x562b7b9a7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:30.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.188+0000 7f6feaffd700 0 client.18588 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.188+0000 7f70258d6b80 1 -- 172.21.15.151:0/95104179 shutdown_connections 2023-07-21T22:47:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.188+0000 7f70258d6b80 1 -- 172.21.15.151:0/95104179 wait complete. 2023-07-21T22:47:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.188+0000 7f70258d6b80 20 client.18588 trim_cache size 0 max 16384 2023-07-21T22:47:30.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:47:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:47:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:47:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:47:30.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.188+0000 7f7011fff700 1 -- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6ff40a1340 msgr2=0x7f6ff40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6ff40a1340 0x7f6ff40a37f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f6ffc009be0 tx=0x7f6ffc009260 comp rx=0 tx=0).stop 2023-07-21T22:47:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 -- 172.21.15.151:0/3176474917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f700c1004b0 msgr2=0x7f700c19c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f700c1004b0 0x7f700c19c130 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f700000e9f0 tx=0x7f700000ed00 comp rx=0 tx=0).stop 2023-07-21T22:47:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 -- 172.21.15.151:0/3176474917 shutdown_connections 2023-07-21T22:47:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6ff40a1340 0x7f6ff40a37f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f700c105b10 0x7f700c195a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f700c0ffb00 0x7f700c19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 --2- 172.21.15.151:0/3176474917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f700c1004b0 0x7f700c19c130 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:30.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 -- 172.21.15.151:0/3176474917 >> 172.21.15.151:0/3176474917 conn(0x7f700c0fb600 msgr2=0x7f700c0fbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:30.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 -- 172.21.15.151:0/3176474917 shutdown_connections 2023-07-21T22:47:30.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:30.189+0000 7f7011fff700 1 -- 172.21.15.151:0/3176474917 wait complete. 2023-07-21T22:47:31.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:30 smithi187 ceph-mon[96918]: pgmap v896: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 226 op/s 2023-07-21T22:47:31.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:30 smithi195 ceph-mon[97365]: pgmap v896: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 226 op/s 2023-07-21T22:47:31.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:30 smithi151 ceph-mon[95510]: pgmap v896: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 226 op/s 2023-07-21T22:47:33.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:32 smithi187 ceph-mon[96918]: pgmap v897: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 226 op/s 2023-07-21T22:47:33.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:32 smithi195 ceph-mon[97365]: pgmap v897: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 226 op/s 2023-07-21T22:47:33.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:32 smithi151 ceph-mon[95510]: pgmap v897: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.7 MiB/s wr, 226 op/s 2023-07-21T22:47:35.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:34 smithi187 ceph-mon[96918]: pgmap v898: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:47:35.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:34 smithi195 ceph-mon[97365]: pgmap v898: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:47:35.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:34 smithi151 ceph-mon[95510]: pgmap v898: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:47:37.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:36 smithi187 ceph-mon[96918]: pgmap v899: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 249 op/s 2023-07-21T22:47:37.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:36 smithi195 ceph-mon[97365]: pgmap v899: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 249 op/s 2023-07-21T22:47:37.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:36 smithi151 ceph-mon[95510]: pgmap v899: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 249 op/s 2023-07-21T22:47:38.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:37 smithi187 ceph-mon[96918]: pgmap v900: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 368 op/s 2023-07-21T22:47:38.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:37 smithi195 ceph-mon[97365]: pgmap v900: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 368 op/s 2023-07-21T22:47:38.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:37 smithi151 ceph-mon[95510]: pgmap v900: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.8 MiB/s wr, 368 op/s 2023-07-21T22:47:40.621 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:40 smithi187 ceph-mon[96918]: pgmap v901: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 253 op/s 2023-07-21T22:47:40.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:40 smithi195 ceph-mon[97365]: pgmap v901: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 253 op/s 2023-07-21T22:47:40.692 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:40 smithi151 ceph-mon[95510]: pgmap v901: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 253 op/s 2023-07-21T22:47:42.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:42 smithi151 ceph-mon[95510]: pgmap v902: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 253 op/s 2023-07-21T22:47:43.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:42 smithi187 ceph-mon[96918]: pgmap v902: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 253 op/s 2023-07-21T22:47:43.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:42 smithi195 ceph-mon[97365]: pgmap v902: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 253 op/s 2023-07-21T22:47:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.374+0000 7f492e9ff700 1 -- 172.21.15.151:0/2557434047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4928067c10 msgr2=0x7f4928067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.374+0000 7f492e9ff700 1 --2- 172.21.15.151:0/2557434047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4928067c10 0x7f4928067fe0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f49180099c0 tx=0x7f4918009cd0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.374+0000 7f492e9ff700 1 -- 172.21.15.151:0/2557434047 shutdown_connections 2023-07-21T22:47:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.374+0000 7f492e9ff700 1 --2- 172.21.15.151:0/2557434047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4928104e50 0x7f492810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.374+0000 7f492e9ff700 1 --2- 172.21.15.151:0/2557434047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4928067c10 0x7f4928067fe0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.374+0000 7f492e9ff700 1 --2- 172.21.15.151:0/2557434047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f49280685b0 0x7f4928104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.374+0000 7f492e9ff700 1 -- 172.21.15.151:0/2557434047 >> 172.21.15.151:0/2557434047 conn(0x7f4928074760 msgr2=0x7f4928074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.374+0000 7f492e9ff700 1 -- 172.21.15.151:0/2557434047 shutdown_connections 2023-07-21T22:47:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.374+0000 7f492e9ff700 1 -- 172.21.15.151:0/2557434047 wait complete. 2023-07-21T22:47:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.376+0000 7f492e9ff700 1 Processor -- start 2023-07-21T22:47:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.376+0000 7f492e9ff700 1 -- start start 2023-07-21T22:47:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.376+0000 7f492e9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4928067c10 0x7f49280fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.376+0000 7f492e9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49280685b0 0x7f49280ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f492e9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4928104e50 0x7f49281a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f492e9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49281a42f0 con 0x7f49280685b0 2023-07-21T22:47:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f492e9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49281a4430 con 0x7f4928104e50 2023-07-21T22:47:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f492e9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49281a45a0 con 0x7f4928067c10 2023-07-21T22:47:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f49277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49280685b0 0x7f49280ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f49277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49280685b0 0x7f49280ff180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53780/0 (socket says 172.21.15.151:53780) 2023-07-21T22:47:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f49277fe700 1 -- 172.21.15.151:0/1164689511 learned_addr learned my addr 172.21.15.151:0/1164689511 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f4927fff700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4928067c10 0x7f49280fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f492cf9c700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4928104e50 0x7f49281a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f49277fe700 1 -- 172.21.15.151:0/1164689511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4928067c10 msgr2=0x7f49280fec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:43.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f49277fe700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4928067c10 0x7f49280fec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f49277fe700 1 -- 172.21.15.151:0/1164689511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4928104e50 msgr2=0x7f49281a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f49277fe700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4928104e50 0x7f49281a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f49277fe700 1 -- 172.21.15.151:0/1164689511 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49180095f0 con 0x7f49280685b0 2023-07-21T22:47:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.377+0000 7f49277fe700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49280685b0 0x7f49280ff180 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f491c00e940 tx=0x7f491c00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.378+0000 7f49257fa700 1 -- 172.21.15.151:0/1164689511 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c009730 con 0x7f49280685b0 2023-07-21T22:47:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.378+0000 7f492e9ff700 1 -- 172.21.15.151:0/1164689511 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49281a4880 con 0x7f49280685b0 2023-07-21T22:47:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.378+0000 7f49257fa700 1 -- 172.21.15.151:0/1164689511 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f491c00ce70 con 0x7f49280685b0 2023-07-21T22:47:43.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.378+0000 7f49257fa700 1 -- 172.21.15.151:0/1164689511 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c018420 con 0x7f49280685b0 2023-07-21T22:47:43.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.378+0000 7f492e9ff700 1 -- 172.21.15.151:0/1164689511 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49281a4d90 con 0x7f49280685b0 2023-07-21T22:47:43.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.382+0000 7f49257fa700 1 -- 172.21.15.151:0/1164689511 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f491c00c9e0 con 0x7f49280685b0 2023-07-21T22:47:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.383+0000 7f4942410b80 1 Processor -- start 2023-07-21T22:47:43.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.383+0000 7f4942410b80 1 -- start start 2023-07-21T22:47:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.383+0000 7f4942410b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f7676b0 0x557b5f910cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.383+0000 7f4942410b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 0x557b5f90af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.383+0000 7f4942410b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f911660 0x557b5f90b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.383+0000 7f4942410b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f810c50 con 0x557b5f911660 2023-07-21T22:47:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.383+0000 7f4942410b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f8639e0 con 0x557b5f911210 2023-07-21T22:47:43.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.383+0000 7f4942410b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f85ce70 con 0x557b5f7676b0 2023-07-21T22:47:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f492cf9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f7676b0 0x557b5f910cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f49277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f911660 0x557b5f90b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f4927fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 0x557b5f90af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f492cf9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f7676b0 0x557b5f910cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37446/0 (socket says 172.21.15.151:37446) 2023-07-21T22:47:43.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f492cf9c700 1 -- 172.21.15.151:0/2614689134 learned_addr learned my addr 172.21.15.151:0/2614689134 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f4927fff700 1 -- 172.21.15.151:0/2614689134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f7676b0 msgr2=0x557b5f910cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:43.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f4927fff700 1 --2- 172.21.15.151:0/2614689134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f7676b0 0x557b5f910cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f4927fff700 1 -- 172.21.15.151:0/2614689134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f911660 msgr2=0x557b5f90b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f4927fff700 1 --2- 172.21.15.151:0/2614689134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f911660 0x557b5f90b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f4927fff700 1 -- 172.21.15.151:0/2614689134 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b5f68ad80 con 0x557b5f911210 2023-07-21T22:47:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f49257fa700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f49100a12c0 0x7f49100a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.384+0000 7f4927fff700 1 --2- 172.21.15.151:0/2614689134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 0x557b5f90af40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4918000c00 tx=0x7f4918005bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49f9d6f83b3d720 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.385+0000 7f49257fa700 1 -- 172.21.15.151:0/1164689511 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f491c014070 con 0x7f49280685b0 2023-07-21T22:47:43.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.385+0000 7f492cf9c700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f49100a12c0 0x7f49100a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.385+0000 7f490e7fc700 1 -- 172.21.15.151:0/2614689134 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491800ba10 con 0x557b5f911210 2023-07-21T22:47:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.385+0000 7f490e7fc700 1 -- 172.21.15.151:0/2614689134 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f491801e040 con 0x557b5f911210 2023-07-21T22:47:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.385+0000 7f490e7fc700 1 -- 172.21.15.151:0/2614689134 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49180039c0 con 0x557b5f911210 2023-07-21T22:47:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f4942410b80 1 -- 172.21.15.151:0/2614689134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 msgr2=0x557b5f90af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f492cf9c700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f49100a12c0 0x7f49100a3770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f49200075c0 tx=0x7f492000b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f4942410b80 1 --2- 172.21.15.151:0/2614689134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 0x557b5f90af40 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f4918000c00 tx=0x7f4918005bc0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f4942410b80 1 -- 172.21.15.151:0/2614689134 shutdown_connections 2023-07-21T22:47:43.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f4942410b80 1 --2- 172.21.15.151:0/2614689134 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f911660 0x557b5f90b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f4942410b80 1 --2- 172.21.15.151:0/2614689134 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f7676b0 0x557b5f910cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f4942410b80 1 --2- 172.21.15.151:0/2614689134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 0x557b5f90af40 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f4942410b80 1 -- 172.21.15.151:0/2614689134 >> 172.21.15.151:0/2614689134 conn(0x557b5f900ae0 msgr2=0x557b5f9060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f4942410b80 1 -- 172.21.15.151:0/2614689134 shutdown_connections 2023-07-21T22:47:43.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.386+0000 7f4942410b80 1 -- 172.21.15.151:0/2614689134 wait complete. 2023-07-21T22:47:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.387+0000 7f4942410b80 1 -- start start 2023-07-21T22:47:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.387+0000 7f4942410b80 1 Processor -- start 2023-07-21T22:47:43.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.387+0000 7f4942410b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.387+0000 7f4942410b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 0x557b5f91aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.387+0000 7f4942410b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911660 0x557b5f9147e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.387+0000 7f4942410b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f7fca60 con 0x557b5f7676b0 2023-07-21T22:47:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.387+0000 7f4942410b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f7fc760 con 0x557b5f911210 2023-07-21T22:47:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.387+0000 7f4942410b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f6e08c0 con 0x557b5f911660 2023-07-21T22:47:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4942410b80 10 client.0 _ll_register_callbacks cb 0x557b5f7fa700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:43.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4927fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4927fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53798/0 (socket says 172.21.15.151:53798) 2023-07-21T22:47:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f49277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 0x557b5f91aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4927fff700 1 -- 172.21.15.151:0/433453634 learned_addr learned my addr 172.21.15.151:0/433453634 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4927fff700 1 -- 172.21.15.151:0/433453634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911660 msgr2=0x557b5f9147e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4927fff700 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911660 0x557b5f9147e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4927fff700 1 -- 172.21.15.151:0/433453634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 msgr2=0x557b5f91aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4927fff700 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 0x557b5f91aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4927fff700 1 -- 172.21.15.151:0/433453634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f492810d210 con 0x557b5f7676b0 2023-07-21T22:47:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f4927fff700 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a550 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4918009d10 tx=0x7f491800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a67894f5d332548 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.388+0000 7f49077fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:47:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.389+0000 7f49077fe700 1 -- 172.21.15.151:0/433453634 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49180056b0 con 0x557b5f7676b0 2023-07-21T22:47:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.389+0000 7f4942410b80 1 -- 172.21.15.151:0/433453634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557b5f7b6490 con 0x557b5f7676b0 2023-07-21T22:47:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.389+0000 7f49077fe700 1 -- 172.21.15.151:0/433453634 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4918003760 con 0x557b5f7676b0 2023-07-21T22:47:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.389+0000 7f49077fe700 1 -- 172.21.15.151:0/433453634 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4918003920 con 0x557b5f7676b0 2023-07-21T22:47:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.389+0000 7f4942410b80 10 client.18600 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:43.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.389+0000 7f4942410b80 1 -- 172.21.15.151:0/433453634 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x557b5f673c00 con 0x557b5f7676b0 2023-07-21T22:47:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.389+0000 7f49077fe700 1 -- 172.21.15.151:0/433453634 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4918038020 con 0x557b5f7676b0 2023-07-21T22:47:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.390+0000 7f49077fe700 1 -- 172.21.15.151:0/433453634 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f491800fb00 con 0x557b5f7676b0 2023-07-21T22:47:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.390+0000 7f4942410b80 10 client.18600 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.390+0000 7f4942410b80 10 client.18600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.390+0000 7f4942410b80 20 client.18600 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.390+0000 7f4942410b80 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557b5f924610 0x557b5f926a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.390+0000 7f4942410b80 4 client.18600 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:47:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.390+0000 7f4942410b80 1 -- 172.21.15.151:0/433453634 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557b5f855e50 con 0x557b5f924610 2023-07-21T22:47:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.390+0000 7f49277fe700 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557b5f924610 0x557b5f926a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.391+0000 7f49277fe700 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557b5f924610 0x557b5f926a20 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f96d7ed321a09be server_cookie=724cc8c5d4f118b9 in_seq=0 out_seq=0 2023-07-21T22:47:43.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.391+0000 7f49077fe700 10 client.18600 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.391+0000 7f49077fe700 1 -- 172.21.15.151:0/433453634 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557b5f855e50 con 0x557b5f924610 2023-07-21T22:47:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.391+0000 7f49077fe700 10 client.18600 handle_command_reply: tid=0 2023-07-21T22:47:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.391+0000 7f4942410b80 1 client.18600 shutdown 2023-07-21T22:47:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 -- 172.21.15.151:0/433453634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 msgr2=0x557b5f91a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a550 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f4918009d10 tx=0x7f491800bec0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 -- 172.21.15.151:0/433453634 shutdown_connections 2023-07-21T22:47:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557b5f924610 0x557b5f926a20 crc :-1 s=READY pgs=352 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911660 0x557b5f9147e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a550 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 --2- 172.21.15.151:0/433453634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f911210 0x557b5f91aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 -- 172.21.15.151:0/433453634 >> 172.21.15.151:0/433453634 conn(0x557b5f900ae0 msgr2=0x557b5f9053e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f49077fe700 0 client.18600 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:43.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 -- 172.21.15.151:0/433453634 shutdown_connections 2023-07-21T22:47:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 1 -- 172.21.15.151:0/433453634 wait complete. 2023-07-21T22:47:43.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.392+0000 7f4942410b80 20 client.18600 trim_cache size 0 max 16384 2023-07-21T22:47:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f4942410b80 1 Processor -- start 2023-07-21T22:47:43.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f4942410b80 1 -- start start 2023-07-21T22:47:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f4942410b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f914790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f4942410b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f90d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f4942410b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 0x557b5f90dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f4942410b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f906d80 con 0x557b5f7676b0 2023-07-21T22:47:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f4942410b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f9024f0 con 0x557b5f900ae0 2023-07-21T22:47:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f4942410b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f90f490 con 0x557b5f911210 2023-07-21T22:47:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f49277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f90d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f49277fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f90d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53806/0 (socket says 172.21.15.151:53806) 2023-07-21T22:47:43.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f4927fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f914790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.409+0000 7f49277fe700 1 -- 172.21.15.151:0/3153814508 learned_addr learned my addr 172.21.15.151:0/3153814508 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f492cf9c700 1 --2- 172.21.15.151:0/3153814508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 0x557b5f90dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f49277fe700 1 -- 172.21.15.151:0/3153814508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 msgr2=0x557b5f90dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f49277fe700 1 --2- 172.21.15.151:0/3153814508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 0x557b5f90dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f49277fe700 1 -- 172.21.15.151:0/3153814508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 msgr2=0x557b5f914790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f49277fe700 1 --2- 172.21.15.151:0/3153814508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f914790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f49277fe700 1 -- 172.21.15.151:0/3153814508 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557b5f92b610 con 0x557b5f7676b0 2023-07-21T22:47:43.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f4927fff700 1 --2- 172.21.15.151:0/3153814508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f914790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:43.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f49277fe700 1 --2- 172.21.15.151:0/3153814508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f90d740 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f491c00e910 tx=0x7f491c00c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee146944c3c841a5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:43.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f490effd700 1 -- 172.21.15.151:0/3153814508 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c099cf0 con 0x557b5f7676b0 2023-07-21T22:47:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f490effd700 1 -- 172.21.15.151:0/3153814508 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f491c099a60 con 0x557b5f7676b0 2023-07-21T22:47:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.410+0000 7f490effd700 1 -- 172.21.15.151:0/3153814508 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c0a2370 con 0x557b5f7676b0 2023-07-21T22:47:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.411+0000 7f4942410b80 1 -- 172.21.15.151:0/3153814508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 msgr2=0x557b5f90d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.411+0000 7f4942410b80 1 --2- 172.21.15.151:0/3153814508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f90d740 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f491c00e910 tx=0x7f491c00c3d0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.411+0000 7f4942410b80 1 -- 172.21.15.151:0/3153814508 shutdown_connections 2023-07-21T22:47:43.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.411+0000 7f4942410b80 1 --2- 172.21.15.151:0/3153814508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f914790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.411+0000 7f4942410b80 1 --2- 172.21.15.151:0/3153814508 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 0x557b5f90dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.411+0000 7f4942410b80 1 --2- 172.21.15.151:0/3153814508 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f90d740 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.411+0000 7f4942410b80 1 -- 172.21.15.151:0/3153814508 >> 172.21.15.151:0/3153814508 conn(0x557b5f90ecf0 msgr2=0x557b5f914080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.411+0000 7f4942410b80 1 -- 172.21.15.151:0/3153814508 shutdown_connections 2023-07-21T22:47:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.411+0000 7f4942410b80 1 -- 172.21.15.151:0/3153814508 wait complete. 2023-07-21T22:47:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.412+0000 7f4942410b80 1 -- start start 2023-07-21T22:47:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.412+0000 7f4942410b80 1 Processor -- start 2023-07-21T22:47:43.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.412+0000 7f4942410b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.412+0000 7f4942410b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f91aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.412+0000 7f4942410b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 0x557b5f9189c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f4942410b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f919090 con 0x557b5f7676b0 2023-07-21T22:47:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f4942410b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f919200 con 0x557b5f900ae0 2023-07-21T22:47:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f4942410b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557b5f9193c0 con 0x557b5f911210 2023-07-21T22:47:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f4942410b80 10 client.0 _ll_register_callbacks cb 0x7f491c0d0610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f4927fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f49277fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f91aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f4927fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53822/0 (socket says 172.21.15.151:53822) 2023-07-21T22:47:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f4927fff700 1 -- 172.21.15.151:0/3749659155 learned_addr learned my addr 172.21.15.151:0/3749659155 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f492cf9c700 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 0x557b5f9189c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f49277fe700 1 -- 172.21.15.151:0/3749659155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 msgr2=0x557b5f9189c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f49277fe700 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 0x557b5f9189c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f49277fe700 1 -- 172.21.15.151:0/3749659155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 msgr2=0x557b5f91a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f49277fe700 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f49277fe700 1 -- 172.21.15.151:0/3749659155 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557b5f673c00 con 0x557b5f900ae0 2023-07-21T22:47:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.413+0000 7f4927fff700 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.414+0000 7f49277fe700 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f91aa70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f491c0b9000 tx=0x7f491c099d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25787cbafca868ca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.414+0000 7f49077fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:47:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.414+0000 7f49077fe700 1 -- 172.21.15.151:0/3749659155 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f491c00cc90 con 0x557b5f900ae0 2023-07-21T22:47:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.414+0000 7f49077fe700 1 -- 172.21.15.151:0/3749659155 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f491c0a2370 con 0x557b5f900ae0 2023-07-21T22:47:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.414+0000 7f4942410b80 1 -- 172.21.15.151:0/3749659155 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f491801e040 con 0x557b5f900ae0 2023-07-21T22:47:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.414+0000 7f49077fe700 1 -- 172.21.15.151:0/3749659155 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f491c0b8330 con 0x557b5f900ae0 2023-07-21T22:47:43.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.414+0000 7f4942410b80 10 client.28274 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.414+0000 7f4942410b80 1 -- 172.21.15.151:0/3749659155 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x7f49281a4d90 con 0x557b5f900ae0 2023-07-21T22:47:43.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.414+0000 7f49077fe700 1 -- 172.21.15.151:0/3749659155 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f491801e040 con 0x557b5f900ae0 2023-07-21T22:47:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f49077fe700 1 -- 172.21.15.151:0/3749659155 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f491c099410 con 0x557b5f900ae0 2023-07-21T22:47:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f4942410b80 10 client.28274 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f4942410b80 10 client.28274 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f4942410b80 20 client.28274 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f4942410b80 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557b5f911660 0x557b5f97b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f4942410b80 4 client.28274 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:47:43.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f4942410b80 1 -- 172.21.15.151:0/3749659155 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557b5f817ff0 con 0x557b5f911660 2023-07-21T22:47:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f4927fff700 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557b5f911660 0x557b5f97b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f4927fff700 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557b5f911660 0x557b5f97b4f0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74c79b836648fe8b server_cookie=c7ae02a543aa9001 in_seq=0 out_seq=0 2023-07-21T22:47:43.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.415+0000 7f49077fe700 10 client.28274 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:43.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.430+0000 7f49077fe700 1 -- 172.21.15.151:0/3749659155 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557b5f817ff0 con 0x557b5f911660 2023-07-21T22:47:43.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.430+0000 7f49077fe700 10 client.28274 handle_command_reply: tid=0 2023-07-21T22:47:43.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.430+0000 7f4942410b80 1 client.28274 shutdown 2023-07-21T22:47:43.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 -- 172.21.15.151:0/3749659155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 msgr2=0x557b5f91aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:43.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f91aa70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f491c0b9000 tx=0x7f491c099d60 comp rx=0 tx=0).stop 2023-07-21T22:47:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 -- 172.21.15.151:0/3749659155 shutdown_connections 2023-07-21T22:47:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557b5f911660 0x557b5f97b4f0 crc :-1 s=READY pgs=353 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557b5f911210 0x557b5f9189c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b5f7676b0 0x557b5f91a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f49077fe700 0 client.28274 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 --2- 172.21.15.151:0/3749659155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557b5f900ae0 0x557b5f91aa70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 -- 172.21.15.151:0/3749659155 >> 172.21.15.151:0/3749659155 conn(0x557b5f90ecf0 msgr2=0x557b5f912f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 -- 172.21.15.151:0/3749659155 shutdown_connections 2023-07-21T22:47:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 1 -- 172.21.15.151:0/3749659155 wait complete. 2023-07-21T22:47:43.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.431+0000 7f4942410b80 20 client.28274 trim_cache size 0 max 16384 2023-07-21T22:47:43.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:47:43.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:47:43.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:47:43.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:47:43.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 -- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f49100a12c0 msgr2=0x7f49100a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f49100a12c0 0x7f49100a3770 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f49200075c0 tx=0x7f492000b040 comp rx=0 tx=0).stop 2023-07-21T22:47:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 -- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49280685b0 msgr2=0x7f49280ff180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49280685b0 0x7f49280ff180 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f491c00e940 tx=0x7f491c00ec50 comp rx=0 tx=0).stop 2023-07-21T22:47:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 -- 172.21.15.151:0/1164689511 shutdown_connections 2023-07-21T22:47:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f49100a12c0 0x7f49100a3770 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4928104e50 0x7f49281a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4928067c10 0x7f49280fec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 --2- 172.21.15.151:0/1164689511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f49280685b0 0x7f49280ff180 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 -- 172.21.15.151:0/1164689511 >> 172.21.15.151:0/1164689511 conn(0x7f4928074760 msgr2=0x7f49280fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 -- 172.21.15.151:0/1164689511 shutdown_connections 2023-07-21T22:47:43.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:43.432+0000 7f492e9ff700 1 -- 172.21.15.151:0/1164689511 wait complete. 2023-07-21T22:47:44.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:44 smithi151 ceph-mon[95510]: pgmap v903: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.9 MiB/s wr, 373 op/s 2023-07-21T22:47:45.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:44 smithi187 ceph-mon[96918]: pgmap v903: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.9 MiB/s wr, 373 op/s 2023-07-21T22:47:45.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:44 smithi195 ceph-mon[97365]: pgmap v903: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 2.9 MiB/s wr, 373 op/s 2023-07-21T22:47:46.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:46 smithi151 ceph-mon[95510]: pgmap v904: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.8 MiB/s wr, 239 op/s 2023-07-21T22:47:47.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:46 smithi187 ceph-mon[96918]: pgmap v904: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.8 MiB/s wr, 239 op/s 2023-07-21T22:47:47.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:46 smithi195 ceph-mon[97365]: pgmap v904: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 1.8 MiB/s wr, 239 op/s 2023-07-21T22:47:48.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:48 smithi151 ceph-mon[95510]: pgmap v905: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:47:49.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:48 smithi187 ceph-mon[96918]: pgmap v905: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:47:49.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:48 smithi195 ceph-mon[97365]: pgmap v905: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 3.1 MiB/s wr, 400 op/s 2023-07-21T22:47:50.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:50 smithi151 ceph-mon[95510]: pgmap v906: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 2.2 MiB/s wr, 281 op/s 2023-07-21T22:47:51.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:50 smithi187 ceph-mon[96918]: pgmap v906: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 2.2 MiB/s wr, 281 op/s 2023-07-21T22:47:51.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:50 smithi195 ceph-mon[97365]: pgmap v906: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 2.2 MiB/s wr, 281 op/s 2023-07-21T22:47:52.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:52 smithi151 ceph-mon[95510]: pgmap v907: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 2.2 MiB/s wr, 281 op/s 2023-07-21T22:47:53.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:52 smithi187 ceph-mon[96918]: pgmap v907: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 2.2 MiB/s wr, 281 op/s 2023-07-21T22:47:53.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:52 smithi195 ceph-mon[97365]: pgmap v907: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 2.2 MiB/s wr, 281 op/s 2023-07-21T22:47:54.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:54 smithi151 ceph-mon[95510]: pgmap v908: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 3.2 MiB/s wr, 414 op/s 2023-07-21T22:47:55.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:54 smithi187 ceph-mon[96918]: pgmap v908: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 3.2 MiB/s wr, 414 op/s 2023-07-21T22:47:55.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:54 smithi195 ceph-mon[97365]: pgmap v908: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 3.2 MiB/s wr, 414 op/s 2023-07-21T22:47:56.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.603+0000 7fa00f3ff700 1 -- 172.21.15.151:0/251664079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0081004e0 msgr2=0x7fa00810c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.603+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/251664079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0081004e0 0x7fa00810c920 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fa00000b0a0 tx=0x7fa00000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.603+0000 7fa00f3ff700 1 -- 172.21.15.151:0/251664079 shutdown_connections 2023-07-21T22:47:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.603+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/251664079 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0081004e0 0x7fa00810c920 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.603+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/251664079 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa008105b60 0x7fa008105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.603+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/251664079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0080ffb30 0x7fa0080fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.603+0000 7fa00f3ff700 1 -- 172.21.15.151:0/251664079 >> 172.21.15.151:0/251664079 conn(0x7fa0080fb5f0 msgr2=0x7fa0080fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.603+0000 7fa00f3ff700 1 -- 172.21.15.151:0/251664079 shutdown_connections 2023-07-21T22:47:56.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.603+0000 7fa00f3ff700 1 -- 172.21.15.151:0/251664079 wait complete. 2023-07-21T22:47:56.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.604+0000 7fa00f3ff700 1 Processor -- start 2023-07-21T22:47:56.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.605+0000 7fa00f3ff700 1 -- start start 2023-07-21T22:47:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.605+0000 7fa00f3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0080ffb30 0x7fa0080729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.605+0000 7fa00f3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0081004e0 0x7fa008072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.605+0000 7fa00f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa008105b60 0x7fa0081a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.605+0000 7fa00f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0081a42d0 con 0x7fa008105b60 2023-07-21T22:47:56.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.605+0000 7fa00f3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0081a4410 con 0x7fa0080ffb30 2023-07-21T22:47:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.605+0000 7fa00f3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0081a4580 con 0x7fa0081004e0 2023-07-21T22:47:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0080ffb30 0x7fa0080729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0080ffb30 0x7fa0080729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43150/0 (socket says 172.21.15.151:43150) 2023-07-21T22:47:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d19b700 1 -- 172.21.15.151:0/1545511094 learned_addr learned my addr 172.21.15.151:0/1545511094 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:56.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d99c700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa008105b60 0x7fa0081a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d19b700 1 -- 172.21.15.151:0/1545511094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0081004e0 msgr2=0x7fa008072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00c99a700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0081004e0 0x7fa008072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d19b700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0081004e0 0x7fa008072f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d19b700 1 -- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa008105b60 msgr2=0x7fa0081a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d19b700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa008105b60 0x7fa0081a3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d19b700 1 -- 172.21.15.151:0/1545511094 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff8009520 con 0x7fa0080ffb30 2023-07-21T22:47:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.606+0000 7fa00d99c700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa008105b60 0x7fa0081a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.607+0000 7fa00d19b700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0080ffb30 0x7fa0080729f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa00400e9c0 tx=0x7fa00400ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.607+0000 7f9ffe7fc700 1 -- 172.21.15.151:0/1545511094 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0040097b0 con 0x7fa0080ffb30 2023-07-21T22:47:56.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.607+0000 7f9ffe7fc700 1 -- 172.21.15.151:0/1545511094 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa004004cc0 con 0x7fa0080ffb30 2023-07-21T22:47:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.607+0000 7f9ffe7fc700 1 -- 172.21.15.151:0/1545511094 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa004005530 con 0x7fa0080ffb30 2023-07-21T22:47:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.607+0000 7fa00f3ff700 1 -- 172.21.15.151:0/1545511094 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa000009d00 con 0x7fa0080ffb30 2023-07-21T22:47:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.607+0000 7fa00f3ff700 1 -- 172.21.15.151:0/1545511094 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0081a4b90 con 0x7fa0080ffb30 2023-07-21T22:47:56.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.610+0000 7f9ffe7fc700 1 -- 172.21.15.151:0/1545511094 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fa004004750 con 0x7fa0080ffb30 2023-07-21T22:47:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.612+0000 7fa022e01b80 1 Processor -- start 2023-07-21T22:47:56.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.612+0000 7fa022e01b80 1 -- start start 2023-07-21T22:47:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7f9ffe7fc700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ff40a12c0 0x7f9ff40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec5fecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 0x55bfec5f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5f94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa022e01b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec4fec50 con 0x55bfec4556b0 2023-07-21T22:47:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa022e01b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec5519e0 con 0x55bfec5ff660 2023-07-21T22:47:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa022e01b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec54ae70 con 0x55bfec5ff210 2023-07-21T22:47:56.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7f9ffe7fc700 1 -- 172.21.15.151:0/1545511094 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa004014070 con 0x7fa0080ffb30 2023-07-21T22:47:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa00d99c700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ff40a12c0 0x7f9ff40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa00d99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5f94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa00d99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5f94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43156/0 (socket says 172.21.15.151:43156) 2023-07-21T22:47:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.613+0000 7fa00d99c700 1 -- 172.21.15.151:0/3764419481 learned_addr learned my addr 172.21.15.151:0/3764419481 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00c99a700 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 0x55bfec5f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00d19b700 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec5fecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00d99c700 1 -- 172.21.15.151:0/3764419481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 msgr2=0x55bfec5f8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00d99c700 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 0x55bfec5f8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00d99c700 1 -- 172.21.15.151:0/3764419481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 msgr2=0x55bfec5fecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00d99c700 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec5fecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00d99c700 1 -- 172.21.15.151:0/3764419481 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfec378d80 con 0x55bfec5ff660 2023-07-21T22:47:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00d19b700 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec5fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:47:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00d99c700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ff40a12c0 0x7f9ff40a3770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa000009610 tx=0x7fa0000093e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.614+0000 7fa00d99c700 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5f94a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa00000d010 tx=0x7fa000025000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=802baccd660f2945 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.615+0000 7f9ff37fe700 1 -- 172.21.15.151:0/3764419481 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa000025070 con 0x55bfec5ff660 2023-07-21T22:47:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.615+0000 7f9ff37fe700 1 -- 172.21.15.151:0/3764419481 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa00000bb70 con 0x55bfec5ff660 2023-07-21T22:47:56.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.615+0000 7f9ff37fe700 1 -- 172.21.15.151:0/3764419481 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00000e040 con 0x55bfec5ff660 2023-07-21T22:47:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.616+0000 7fa022e01b80 1 -- 172.21.15.151:0/3764419481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 msgr2=0x55bfec5f94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.616+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5f94a0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fa00000d010 tx=0x7fa000025000 comp rx=0 tx=0).stop 2023-07-21T22:47:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.616+0000 7fa022e01b80 1 -- 172.21.15.151:0/3764419481 shutdown_connections 2023-07-21T22:47:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.616+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5f94a0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.616+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec5fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.616+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3764419481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 0x55bfec5f8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.616+0000 7fa022e01b80 1 -- 172.21.15.151:0/3764419481 >> 172.21.15.151:0/3764419481 conn(0x55bfec5eeae0 msgr2=0x55bfec5f40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.616+0000 7fa022e01b80 1 -- 172.21.15.151:0/3764419481 shutdown_connections 2023-07-21T22:47:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.616+0000 7fa022e01b80 1 -- 172.21.15.151:0/3764419481 wait complete. 2023-07-21T22:47:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.617+0000 7fa022e01b80 1 -- start start 2023-07-21T22:47:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.617+0000 7fa022e01b80 1 Processor -- start 2023-07-21T22:47:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec4556b0 0x55bfec605540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 0x55bfec6027c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff660 0x55bfec602dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa022e01b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec4eaa60 con 0x55bfec5ff660 2023-07-21T22:47:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa022e01b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec4ea760 con 0x55bfec4556b0 2023-07-21T22:47:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa022e01b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec3ce8c0 con 0x55bfec5ff210 2023-07-21T22:47:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa022e01b80 10 client.0 _ll_register_callbacks cb 0x55bfec4e8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa00d99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff660 0x55bfec602dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa00c99a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 0x55bfec6027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa00d99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff660 0x55bfec602dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55518/0 (socket says 172.21.15.151:55518) 2023-07-21T22:47:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa00d99c700 1 -- 172.21.15.151:0/3808395148 learned_addr learned my addr 172.21.15.151:0/3808395148 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.618+0000 7fa00d19b700 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec4556b0 0x55bfec605540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7fa00c99a700 1 -- 172.21.15.151:0/3808395148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec4556b0 msgr2=0x55bfec605540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7fa00c99a700 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec4556b0 0x55bfec605540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7fa00c99a700 1 -- 172.21.15.151:0/3808395148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff660 msgr2=0x55bfec602dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7fa00c99a700 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff660 0x55bfec602dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7fa00c99a700 1 -- 172.21.15.151:0/3808395148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa00810d220 con 0x55bfec5ff210 2023-07-21T22:47:56.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7fa00d99c700 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff660 0x55bfec602dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7fa00c99a700 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 0x55bfec6027c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8013750 tx=0x7f9ff8013a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1d9d006de6d813d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:56.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7f9ff0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:47:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/3808395148 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff8011770 con 0x55bfec5ff210 2023-07-21T22:47:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.619+0000 7fa022e01b80 1 -- 172.21.15.151:0/3808395148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfec543e50 con 0x55bfec5ff210 2023-07-21T22:47:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/3808395148 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9ff80118d0 con 0x55bfec5ff210 2023-07-21T22:47:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/3808395148 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ff8011a90 con 0x55bfec5ff210 2023-07-21T22:47:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7fa022e01b80 10 client.28318 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7fa022e01b80 1 -- 172.21.15.151:0/3808395148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55bfec361c00 con 0x55bfec5ff210 2023-07-21T22:47:56.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/3808395148 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ff8028020 con 0x55bfec5ff210 2023-07-21T22:47:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/3808395148 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9ff800ece0 con 0x55bfec5ff210 2023-07-21T22:47:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7fa022e01b80 10 client.28318 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7fa022e01b80 10 client.28318 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7fa022e01b80 20 client.28318 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bfec612a80 0x55bfec614e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7fa022e01b80 4 client.28318 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:47:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.620+0000 7fa022e01b80 1 -- 172.21.15.151:0/3808395148 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bfec505ff0 con 0x55bfec612a80 2023-07-21T22:47:56.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.621+0000 7fa00d19b700 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bfec612a80 0x55bfec614e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.621+0000 7f9ff0ff9700 10 client.28318 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.621+0000 7fa00d19b700 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bfec612a80 0x55bfec614e90 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=50852c6f6c3d3fec server_cookie=aab18481ae214e36 in_seq=0 out_seq=0 2023-07-21T22:47:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.622+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/3808395148 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bfec505ff0 con 0x55bfec612a80 2023-07-21T22:47:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.622+0000 7f9ff0ff9700 10 client.28318 handle_command_reply: tid=0 2023-07-21T22:47:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.622+0000 7fa022e01b80 1 client.28318 shutdown 2023-07-21T22:47:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.622+0000 7fa022e01b80 1 -- 172.21.15.151:0/3808395148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 msgr2=0x55bfec6027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:56.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.622+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 0x55bfec6027c0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8013750 tx=0x7f9ff8013a60 comp rx=0 tx=0).stop 2023-07-21T22:47:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7fa022e01b80 1 -- 172.21.15.151:0/3808395148 shutdown_connections 2023-07-21T22:47:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bfec612a80 0x55bfec614e90 crc :-1 s=READY pgs=354 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec4556b0 0x55bfec605540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff660 0x55bfec602dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7fa022e01b80 1 --2- 172.21.15.151:0/3808395148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff210 0x55bfec6027c0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7f9ff0ff9700 0 client.28318 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7fa022e01b80 1 -- 172.21.15.151:0/3808395148 >> 172.21.15.151:0/3808395148 conn(0x55bfec5eeae0 msgr2=0x55bfec5f33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:56.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7fa022e01b80 1 -- 172.21.15.151:0/3808395148 shutdown_connections 2023-07-21T22:47:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7fa022e01b80 1 -- 172.21.15.151:0/3808395148 wait complete. 2023-07-21T22:47:56.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.623+0000 7fa022e01b80 20 client.28318 trim_cache size 0 max 16384 2023-07-21T22:47:56.678 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.641+0000 7fa022e01b80 1 Processor -- start 2023-07-21T22:47:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.641+0000 7fa022e01b80 1 -- start start 2023-07-21T22:47:56.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec609b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff210 0x55bfec5f8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff660 0x55bfec600140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa022e01b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec610080 con 0x55bfec4556b0 2023-07-21T22:47:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa022e01b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec5ebb20 con 0x55bfec5ff210 2023-07-21T22:47:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa022e01b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec5fe920 con 0x55bfec5ff660 2023-07-21T22:47:56.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa00d19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec609b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa00c99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff210 0x55bfec5f8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa00d99c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff660 0x55bfec600140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa00d19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec609b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55520/0 (socket says 172.21.15.151:55520) 2023-07-21T22:47:56.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.642+0000 7fa00d19b700 1 -- 172.21.15.151:0/1730224738 learned_addr learned my addr 172.21.15.151:0/1730224738 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.643+0000 7fa00c99a700 1 -- 172.21.15.151:0/1730224738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff660 msgr2=0x55bfec600140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.643+0000 7fa00c99a700 1 --2- 172.21.15.151:0/1730224738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff660 0x55bfec600140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.643+0000 7fa00c99a700 1 -- 172.21.15.151:0/1730224738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 msgr2=0x55bfec609b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:56.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.643+0000 7fa00c99a700 1 --2- 172.21.15.151:0/1730224738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec609b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.643+0000 7fa00c99a700 1 -- 172.21.15.151:0/1730224738 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bfec39f1f0 con 0x55bfec5ff210 2023-07-21T22:47:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.643+0000 7fa00c99a700 1 --2- 172.21.15.151:0/1730224738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff210 0x55bfec5f8f40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8000c00 tx=0x7f9ff8013db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e094c7d68d484001 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.643+0000 7f9ff3fff700 1 -- 172.21.15.151:0/1730224738 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff800d530 con 0x55bfec5ff210 2023-07-21T22:47:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.643+0000 7f9ff3fff700 1 -- 172.21.15.151:0/1730224738 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ff8028030 con 0x55bfec5ff210 2023-07-21T22:47:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.643+0000 7f9ff3fff700 1 -- 172.21.15.151:0/1730224738 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ff80053e0 con 0x55bfec5ff210 2023-07-21T22:47:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.644+0000 7fa022e01b80 1 -- 172.21.15.151:0/1730224738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff210 msgr2=0x55bfec5f8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:56.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.644+0000 7fa022e01b80 1 --2- 172.21.15.151:0/1730224738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff210 0x55bfec5f8f40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f9ff8000c00 tx=0x7f9ff8013db0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.644+0000 7fa022e01b80 1 -- 172.21.15.151:0/1730224738 shutdown_connections 2023-07-21T22:47:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.644+0000 7fa022e01b80 1 --2- 172.21.15.151:0/1730224738 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec5ff660 0x55bfec600140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.644+0000 7fa022e01b80 1 --2- 172.21.15.151:0/1730224738 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec4556b0 0x55bfec609b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.644+0000 7fa022e01b80 1 --2- 172.21.15.151:0/1730224738 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff210 0x55bfec5f8f40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.644+0000 7fa022e01b80 1 -- 172.21.15.151:0/1730224738 >> 172.21.15.151:0/1730224738 conn(0x55bfec5eeae0 msgr2=0x55bfec5ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.644+0000 7fa022e01b80 1 -- 172.21.15.151:0/1730224738 shutdown_connections 2023-07-21T22:47:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.644+0000 7fa022e01b80 1 -- 172.21.15.151:0/1730224738 wait complete. 2023-07-21T22:47:56.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.645+0000 7fa022e01b80 1 -- start start 2023-07-21T22:47:56.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.645+0000 7fa022e01b80 1 Processor -- start 2023-07-21T22:47:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.645+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec4556b0 0x55bfec5fbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.645+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff210 0x55bfec5fa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.645+0000 7fa022e01b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5fac70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.645+0000 7fa022e01b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec5fc2b0 con 0x55bfec5ff210 2023-07-21T22:47:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.645+0000 7fa022e01b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec5fc420 con 0x55bfec5ff660 2023-07-21T22:47:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.645+0000 7fa022e01b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bfec5fb1b0 con 0x55bfec4556b0 2023-07-21T22:47:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa022e01b80 10 client.0 _ll_register_callbacks cb 0x7f9ff8009d90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:47:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00c99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff210 0x55bfec5fa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00d19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec4556b0 0x55bfec5fbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00d19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec4556b0 0x55bfec5fbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51890/0 (socket says 172.21.15.151:51890) 2023-07-21T22:47:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00c99a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff210 0x55bfec5fa730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55524/0 (socket says 172.21.15.151:55524) 2023-07-21T22:47:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00d19b700 1 -- 172.21.15.151:0/2298352383 learned_addr learned my addr 172.21.15.151:0/2298352383 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:47:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00d99c700 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5fac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00d19b700 1 -- 172.21.15.151:0/2298352383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 msgr2=0x55bfec5fac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00d19b700 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5fac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00d19b700 1 -- 172.21.15.151:0/2298352383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff210 msgr2=0x55bfec5fa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:47:56.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00d19b700 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff210 0x55bfec5fa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00d19b700 1 -- 172.21.15.151:0/2298352383 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55bfec361c00 con 0x55bfec4556b0 2023-07-21T22:47:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.646+0000 7fa00c99a700 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff210 0x55bfec5fa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:47:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7fa00d19b700 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec4556b0 0x55bfec5fbc10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa004099e60 tx=0x7fa004004ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd726c97f0a88f2a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:47:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7f9ff0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:47:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/2298352383 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa00409a160 con 0x55bfec4556b0 2023-07-21T22:47:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/2298352383 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(132..132 src has 1..132) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa00409e190 con 0x55bfec4556b0 2023-07-21T22:47:56.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7fa022e01b80 1 -- 172.21.15.151:0/2298352383 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bfec4a4490 con 0x55bfec4556b0 2023-07-21T22:47:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/2298352383 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0040a25b0 con 0x55bfec4556b0 2023-07-21T22:47:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7fa022e01b80 10 client.28324 fetch_fsmap learned FSMap version 91 2023-07-21T22:47:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7fa022e01b80 1 -- 172.21.15.151:0/2298352383 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55bfec377250 con 0x55bfec4556b0 2023-07-21T22:47:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/2298352383 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bfec4a4490 con 0x55bfec4556b0 2023-07-21T22:47:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.647+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/2298352383 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fa004099650 con 0x55bfec4556b0 2023-07-21T22:47:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.648+0000 7fa022e01b80 10 client.28324 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:47:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.648+0000 7fa022e01b80 10 client.28324 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:47:56.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.648+0000 7fa022e01b80 20 client.28324 populate_metadata read hostname 'smithi151' 2023-07-21T22:47:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.648+0000 7fa022e01b80 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bfec667980 0x55bfec669d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:47:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.648+0000 7fa022e01b80 4 client.28324 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:47:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.648+0000 7fa022e01b80 1 -- 172.21.15.151:0/2298352383 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bfec399f10 con 0x55bfec667980 2023-07-21T22:47:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.648+0000 7fa00c99a700 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bfec667980 0x55bfec669d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:47:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.649+0000 7fa00c99a700 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bfec667980 0x55bfec669d90 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56c20e6b617a8d2a server_cookie=81eb9ad59e585306 in_seq=0 out_seq=0 2023-07-21T22:47:56.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.649+0000 7f9ff0ff9700 10 client.28324 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7f9ff0ff9700 1 -- 172.21.15.151:0/2298352383 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bfec399f10 con 0x55bfec667980 2023-07-21T22:47:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7f9ff0ff9700 10 client.28324 handle_command_reply: tid=0 2023-07-21T22:47:56.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7fa022e01b80 1 client.28324 shutdown 2023-07-21T22:47:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7fa022e01b80 1 -- 172.21.15.151:0/2298352383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec4556b0 msgr2=0x55bfec5fbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7fa022e01b80 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec4556b0 0x55bfec5fbc10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fa004099e60 tx=0x7fa004004ee0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7fa022e01b80 1 -- 172.21.15.151:0/2298352383 shutdown_connections 2023-07-21T22:47:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7fa022e01b80 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bfec667980 0x55bfec669d90 crc :-1 s=READY pgs=355 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7fa022e01b80 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bfec5ff660 0x55bfec5fac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7fa022e01b80 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bfec4556b0 0x55bfec5fbc10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7f9ff0ff9700 0 client.28324 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:47:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7fa022e01b80 1 --2- 172.21.15.151:0/2298352383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bfec5ff210 0x55bfec5fa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.658+0000 7fa022e01b80 1 -- 172.21.15.151:0/2298352383 >> 172.21.15.151:0/2298352383 conn(0x55bfec5eeae0 msgr2=0x55bfec6002c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:56.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.659+0000 7fa022e01b80 1 -- 172.21.15.151:0/2298352383 shutdown_connections 2023-07-21T22:47:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.659+0000 7fa022e01b80 1 -- 172.21.15.151:0/2298352383 wait complete. 2023-07-21T22:47:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.659+0000 7fa022e01b80 20 client.28324 trim_cache size 0 max 16384 2023-07-21T22:47:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:47:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:47:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:47:56.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:47:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.659+0000 7fa00f3ff700 1 -- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ff40a12c0 msgr2=0x7f9ff40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.659+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ff40a12c0 0x7f9ff40a3770 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa000009610 tx=0x7fa0000093e0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.659+0000 7fa00f3ff700 1 -- 172.21.15.151:0/1545511094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0080ffb30 msgr2=0x7fa0080729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:47:56.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.660+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0080ffb30 0x7fa0080729f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fa00400e9c0 tx=0x7fa00400ecd0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.660+0000 7fa00f3ff700 1 -- 172.21.15.151:0/1545511094 shutdown_connections 2023-07-21T22:47:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.660+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ff40a12c0 0x7f9ff40a3770 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.660+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0080ffb30 0x7fa0080729f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.660+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa008105b60 0x7fa0081a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.660+0000 7fa00f3ff700 1 --2- 172.21.15.151:0/1545511094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0081004e0 0x7fa008072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:47:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.660+0000 7fa00f3ff700 1 -- 172.21.15.151:0/1545511094 >> 172.21.15.151:0/1545511094 conn(0x7fa0080fb5f0 msgr2=0x7fa0080fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:47:56.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.660+0000 7fa00f3ff700 1 -- 172.21.15.151:0/1545511094 shutdown_connections 2023-07-21T22:47:56.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:47:56.660+0000 7fa00f3ff700 1 -- 172.21.15.151:0/1545511094 wait complete. 2023-07-21T22:47:57.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:56 smithi187 ceph-mon[96918]: pgmap v909: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:47:57.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:56 smithi195 ceph-mon[97365]: pgmap v909: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:47:57.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:56 smithi151 ceph-mon[95510]: pgmap v909: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:47:59.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:47:58 smithi187 ceph-mon[96918]: pgmap v910: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.2 MiB/s wr, 422 op/s 2023-07-21T22:47:59.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:47:58 smithi195 ceph-mon[97365]: pgmap v910: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.2 MiB/s wr, 422 op/s 2023-07-21T22:47:59.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:47:58 smithi151 ceph-mon[95510]: pgmap v910: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 3.2 MiB/s wr, 422 op/s 2023-07-21T22:48:01.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:00 smithi187 ceph-mon[96918]: pgmap v911: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:48:01.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:00 smithi195 ceph-mon[97365]: pgmap v911: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:48:01.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:00 smithi151 ceph-mon[95510]: pgmap v911: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:48:03.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:02 smithi187 ceph-mon[96918]: pgmap v912: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:48:03.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:02 smithi195 ceph-mon[97365]: pgmap v912: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:48:03.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:02 smithi151 ceph-mon[95510]: pgmap v912: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 2.0 MiB/s wr, 261 op/s 2023-07-21T22:48:05.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:04 smithi187 ceph-mon[96918]: pgmap v913: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.9 MiB/s wr, 389 op/s 2023-07-21T22:48:05.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:04 smithi195 ceph-mon[97365]: pgmap v913: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.9 MiB/s wr, 389 op/s 2023-07-21T22:48:05.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:04 smithi151 ceph-mon[95510]: pgmap v913: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 2.9 MiB/s wr, 389 op/s 2023-07-21T22:48:06.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:05 smithi187 ceph-mon[96918]: pgmap v914: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2023-07-21T22:48:06.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:05 smithi195 ceph-mon[97365]: pgmap v914: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2023-07-21T22:48:06.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:05 smithi151 ceph-mon[95510]: pgmap v914: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2023-07-21T22:48:08.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:08 smithi151 ceph-mon[95510]: pgmap v915: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.9 MiB/s wr, 384 op/s 2023-07-21T22:48:09.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:08 smithi187 ceph-mon[96918]: pgmap v915: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.9 MiB/s wr, 384 op/s 2023-07-21T22:48:09.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:08 smithi195 ceph-mon[97365]: pgmap v915: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 2.9 MiB/s wr, 384 op/s 2023-07-21T22:48:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.876+0000 7f9b235ff700 1 -- 172.21.15.151:0/1640228100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c100760 msgr2=0x7f9b1c104720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.876+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1640228100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c100760 0x7f9b1c104720 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0099c0 tx=0x7f9b0c009cd0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.876+0000 7f9b235ff700 1 -- 172.21.15.151:0/1640228100 shutdown_connections 2023-07-21T22:48:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.876+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1640228100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b1c104e00 0x7f9b1c10c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.876+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1640228100 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1c0ffdc0 0x7f9b1c100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.876+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1640228100 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c100760 0x7f9b1c104720 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.876+0000 7f9b235ff700 1 -- 172.21.15.151:0/1640228100 >> 172.21.15.151:0/1640228100 conn(0x7f9b1c0fb650 msgr2=0x7f9b1c0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.876+0000 7f9b235ff700 1 -- 172.21.15.151:0/1640228100 shutdown_connections 2023-07-21T22:48:09.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.876+0000 7f9b235ff700 1 -- 172.21.15.151:0/1640228100 wait complete. 2023-07-21T22:48:09.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.877+0000 7f9b235ff700 1 Processor -- start 2023-07-21T22:48:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.877+0000 7f9b235ff700 1 -- start start 2023-07-21T22:48:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b235ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1c0ffdc0 0x7f9b1c197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b235ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b1c100760 0x7f9b1c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b235ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c104e00 0x7f9b1c19c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b235ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c19d020 con 0x7f9b1c104e00 2023-07-21T22:48:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b235ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c19d190 con 0x7f9b1c100760 2023-07-21T22:48:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b235ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c19d350 con 0x7f9b1c0ffdc0 2023-07-21T22:48:09.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b20b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b1c100760 0x7f9b1c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b20b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b1c100760 0x7f9b1c198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35908/0 (socket says 172.21.15.151:35908) 2023-07-21T22:48:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b20b9a700 1 -- 172.21.15.151:0/1422039279 learned_addr learned my addr 172.21.15.151:0/1422039279 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b2139b700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1c0ffdc0 0x7f9b1c197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b21b9c700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c104e00 0x7f9b1c19c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b20b9a700 1 -- 172.21.15.151:0/1422039279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1c0ffdc0 msgr2=0x7f9b1c197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1c0ffdc0 0x7f9b1c197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b20b9a700 1 -- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c104e00 msgr2=0x7f9b1c19c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c104e00 0x7f9b1c19c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b20b9a700 1 -- 172.21.15.151:0/1422039279 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b14009520 con 0x7f9b1c100760 2023-07-21T22:48:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b21b9c700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c104e00 0x7f9b1c19c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:48:09.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.878+0000 7f9b2139b700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1c0ffdc0 0x7f9b1c197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:48:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.879+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b1c100760 0x7f9b1c198370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c006010 tx=0x7f9b0c00f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.879+0000 7f9b127fc700 1 -- 172.21.15.151:0/1422039279 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c01d070 con 0x7f9b1c100760 2023-07-21T22:48:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.879+0000 7f9b235ff700 1 -- 172.21.15.151:0/1422039279 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c0095f0 con 0x7f9b1c100760 2023-07-21T22:48:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.879+0000 7f9b127fc700 1 -- 172.21.15.151:0/1422039279 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b0c005030 con 0x7f9b1c100760 2023-07-21T22:48:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.879+0000 7f9b127fc700 1 -- 172.21.15.151:0/1422039279 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c004a70 con 0x7f9b1c100760 2023-07-21T22:48:09.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.879+0000 7f9b235ff700 1 -- 172.21.15.151:0/1422039279 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c1a4c90 con 0x7f9b1c100760 2023-07-21T22:48:09.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.883+0000 7f9b127fc700 1 -- 172.21.15.151:0/1422039279 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f9b0c0051a0 con 0x7f9b1c100760 2023-07-21T22:48:09.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.884+0000 7f9b36f1eb80 1 Processor -- start 2023-07-21T22:48:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.884+0000 7f9b36f1eb80 1 -- start start 2023-07-21T22:48:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b127fc700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b080a1340 0x7f9b080a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b127fc700 1 -- 172.21.15.151:0/1422039279 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f9b0c0cd940 con 0x7f9b1c100760 2023-07-21T22:48:09.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e37746b0 0x55b9e391dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 0x55b9e3917f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e391e660 0x55b9e39184a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e381dc50 con 0x55b9e391e210 2023-07-21T22:48:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e38709e0 con 0x55b9e391e660 2023-07-21T22:48:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e3869e70 con 0x55b9e37746b0 2023-07-21T22:48:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b2139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e37746b0 0x55b9e391dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b2139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e37746b0 0x55b9e391dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42530/0 (socket says 172.21.15.151:42530) 2023-07-21T22:48:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b2139b700 1 -- 172.21.15.151:0/2207821048 learned_addr learned my addr 172.21.15.151:0/2207821048 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:09.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.885+0000 7f9b21b9c700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b080a1340 0x7f9b080a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/2207821048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 0x55b9e3917f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b2139b700 1 -- 172.21.15.151:0/2207821048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e391e660 msgr2=0x55b9e39184a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b2139b700 1 --2- 172.21.15.151:0/2207821048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e391e660 0x55b9e39184a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b2139b700 1 -- 172.21.15.151:0/2207821048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 msgr2=0x55b9e3917f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b2139b700 1 --2- 172.21.15.151:0/2207821048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 0x55b9e3917f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b2139b700 1 -- 172.21.15.151:0/2207821048 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9e3697d80 con 0x55b9e37746b0 2023-07-21T22:48:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b2139b700 1 --2- 172.21.15.151:0/2207821048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e37746b0 0x55b9e391dcd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9b180060b0 tx=0x7f9b18009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4acee690ffcc2c3f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:09.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b21b9c700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b080a1340 0x7f9b080a37f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55b9e391ea70 tx=0x7f9b14009930 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b077fe700 1 -- 172.21.15.151:0/2207821048 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800e900 con 0x55b9e37746b0 2023-07-21T22:48:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b077fe700 1 -- 172.21.15.151:0/2207821048 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b1800f040 con 0x55b9e37746b0 2023-07-21T22:48:09.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.886+0000 7f9b077fe700 1 -- 172.21.15.151:0/2207821048 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18015d30 con 0x55b9e37746b0 2023-07-21T22:48:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.887+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2207821048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e37746b0 msgr2=0x55b9e391dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.887+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2207821048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e37746b0 0x55b9e391dcd0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f9b180060b0 tx=0x7f9b18009920 comp rx=0 tx=0).stop 2023-07-21T22:48:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.887+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2207821048 shutdown_connections 2023-07-21T22:48:09.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.887+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2207821048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e391e660 0x55b9e39184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.887+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2207821048 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e37746b0 0x55b9e391dcd0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.887+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2207821048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 0x55b9e3917f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.887+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2207821048 >> 172.21.15.151:0/2207821048 conn(0x55b9e390dae0 msgr2=0x55b9e39130e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.888+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2207821048 shutdown_connections 2023-07-21T22:48:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.888+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2207821048 wait complete. 2023-07-21T22:48:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.888+0000 7f9b36f1eb80 1 -- start start 2023-07-21T22:48:09.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.889+0000 7f9b36f1eb80 1 Processor -- start 2023-07-21T22:48:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.889+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e37746b0 0x55b9e39244b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.889+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 0x55b9e3921730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.889+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e391e660 0x55b9e3921cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.889+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e3809a60 con 0x55b9e37746b0 2023-07-21T22:48:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.889+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e3809760 con 0x55b9e391e660 2023-07-21T22:48:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.889+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e36ed8c0 con 0x55b9e391e210 2023-07-21T22:48:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.889+0000 7f9b36f1eb80 10 client.0 _ll_register_callbacks cb 0x55b9e3807700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:48:09.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b2139b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e37746b0 0x55b9e39244b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b20b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 0x55b9e3921730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b2139b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e37746b0 0x55b9e39244b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57344/0 (socket says 172.21.15.151:57344) 2023-07-21T22:48:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b2139b700 1 -- 172.21.15.151:0/2171873437 learned_addr learned my addr 172.21.15.151:0/2171873437 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b21b9c700 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e391e660 0x55b9e3921cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b20b9a700 1 -- 172.21.15.151:0/2171873437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e391e660 msgr2=0x55b9e3921cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e391e660 0x55b9e3921cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b20b9a700 1 -- 172.21.15.151:0/2171873437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e37746b0 msgr2=0x55b9e39244b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:09.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e37746b0 0x55b9e39244b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b20b9a700 1 -- 172.21.15.151:0/2171873437 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b180091e0 con 0x55b9e391e210 2023-07-21T22:48:09.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b2139b700 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e37746b0 0x55b9e39244b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:48:09.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 0x55b9e3921730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0cb020 tx=0x7f9b0c09ab70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41f7817538cb9515 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b04ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:48:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.890+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2171873437 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0c099f20 con 0x55b9e391e210 2023-07-21T22:48:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2171873437 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f9b0c09a080 con 0x55b9e391e210 2023-07-21T22:48:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2171873437 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9e37c3490 con 0x55b9e391e210 2023-07-21T22:48:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2171873437 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b0c0b3120 con 0x55b9e391e210 2023-07-21T22:48:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b36f1eb80 10 client.28336 fetch_fsmap learned FSMap version 91 2023-07-21T22:48:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2171873437 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55b9e3680c00 con 0x55b9e391e210 2023-07-21T22:48:09.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2171873437 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b9e37c3490 con 0x55b9e391e210 2023-07-21T22:48:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2171873437 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9b0c004cd0 con 0x55b9e391e210 2023-07-21T22:48:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b36f1eb80 10 client.28336 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:48:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b36f1eb80 10 client.28336 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:48:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b36f1eb80 20 client.28336 populate_metadata read hostname 'smithi151' 2023-07-21T22:48:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b9e3931660 0x55b9e3933a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b36f1eb80 4 client.28336 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:48:09.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.891+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2171873437 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9e3862e50 con 0x55b9e3931660 2023-07-21T22:48:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.892+0000 7f9b2139b700 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b9e3931660 0x55b9e3933a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.892+0000 7f9b04ff9700 10 client.28336 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.892+0000 7f9b2139b700 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b9e3931660 0x55b9e3933a70 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=55abcfc1aefbb28e server_cookie=200a305bf9b1711c in_seq=0 out_seq=0 2023-07-21T22:48:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2171873437 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b9e3862e50 con 0x55b9e3931660 2023-07-21T22:48:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b04ff9700 10 client.28336 handle_command_reply: tid=0 2023-07-21T22:48:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b36f1eb80 1 client.28336 shutdown 2023-07-21T22:48:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2171873437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 msgr2=0x55b9e3921730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:09.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 0x55b9e3921730 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0cb020 tx=0x7f9b0c09ab70 comp rx=0 tx=0).stop 2023-07-21T22:48:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2171873437 shutdown_connections 2023-07-21T22:48:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b9e3931660 0x55b9e3933a70 crc :-1 s=READY pgs=356 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e391e660 0x55b9e3921cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e37746b0 0x55b9e39244b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2171873437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 0x55b9e3921730 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b04ff9700 0 client.28336 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.893+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2171873437 >> 172.21.15.151:0/2171873437 conn(0x55b9e390dae0 msgr2=0x55b9e39123e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:09.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.894+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2171873437 shutdown_connections 2023-07-21T22:48:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.894+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2171873437 wait complete. 2023-07-21T22:48:09.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.894+0000 7f9b36f1eb80 20 client.28336 trim_cache size 0 max 16384 2023-07-21T22:48:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.911+0000 7f9b36f1eb80 1 Processor -- start 2023-07-21T22:48:09.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.911+0000 7f9b36f1eb80 1 -- start start 2023-07-21T22:48:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.911+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3917f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.911+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 0x55b9e391f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.911+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e660 0x55b9e3928c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.911+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e3862e80 con 0x55b9e391e660 2023-07-21T22:48:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.911+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e37c34c0 con 0x55b9e37746b0 2023-07-21T22:48:09.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.911+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e3914760 con 0x55b9e391e210 2023-07-21T22:48:09.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b2139b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3917f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b21b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e660 0x55b9e3928c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b2139b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3917f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35932/0 (socket says 172.21.15.151:35932) 2023-07-21T22:48:09.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b2139b700 1 -- 172.21.15.151:0/3907476766 learned_addr learned my addr 172.21.15.151:0/3907476766 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:09.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/3907476766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 0x55b9e391f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b2139b700 1 -- 172.21.15.151:0/3907476766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 msgr2=0x55b9e391f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:09.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b2139b700 1 --2- 172.21.15.151:0/3907476766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 0x55b9e391f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b2139b700 1 -- 172.21.15.151:0/3907476766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e660 msgr2=0x55b9e3928c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b2139b700 1 --2- 172.21.15.151:0/3907476766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e660 0x55b9e3928c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b2139b700 1 -- 172.21.15.151:0/3907476766 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9e36be1f0 con 0x55b9e37746b0 2023-07-21T22:48:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b21b9c700 1 --2- 172.21.15.151:0/3907476766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e660 0x55b9e3928c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:48:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.912+0000 7f9b2139b700 1 --2- 172.21.15.151:0/3907476766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3917f40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009ce0 tx=0x7f9b1800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e81650c081e02a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b07fff700 1 -- 172.21.15.151:0/3907476766 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18023070 con 0x55b9e37746b0 2023-07-21T22:48:09.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b07fff700 1 -- 172.21.15.151:0/3907476766 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b18024040 con 0x55b9e37746b0 2023-07-21T22:48:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b07fff700 1 -- 172.21.15.151:0/3907476766 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18015c10 con 0x55b9e37746b0 2023-07-21T22:48:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/3907476766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 msgr2=0x55b9e3917f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/3907476766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3917f40 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b18009ce0 tx=0x7f9b1800b040 comp rx=0 tx=0).stop 2023-07-21T22:48:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/3907476766 shutdown_connections 2023-07-21T22:48:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/3907476766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3917f40 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/3907476766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e660 0x55b9e3928c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/3907476766 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e210 0x55b9e391f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/3907476766 >> 172.21.15.151:0/3907476766 conn(0x55b9e390dae0 msgr2=0x55b9e391eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/3907476766 shutdown_connections 2023-07-21T22:48:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.913+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/3907476766 wait complete. 2023-07-21T22:48:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.914+0000 7f9b36f1eb80 1 -- start start 2023-07-21T22:48:09.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.914+0000 7f9b36f1eb80 1 Processor -- start 2023-07-21T22:48:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3927d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 0x55b9e39282c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b36f1eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e660 0x55b9e3984520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e3928ba0 con 0x55b9e391e210 2023-07-21T22:48:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e3984a60 con 0x55b9e37746b0 2023-07-21T22:48:09.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b36f1eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9e3984ba0 con 0x55b9e391e660 2023-07-21T22:48:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b36f1eb80 10 client.0 _ll_register_callbacks cb 0x7f9b0c09a390 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:48:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b20b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 0x55b9e39282c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b2139b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3927d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b2139b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3927d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35940/0 (socket says 172.21.15.151:35940) 2023-07-21T22:48:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b2139b700 1 -- 172.21.15.151:0/2500877740 learned_addr learned my addr 172.21.15.151:0/2500877740 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.915+0000 7f9b21b9c700 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e660 0x55b9e3984520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b2139b700 1 -- 172.21.15.151:0/2500877740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e660 msgr2=0x55b9e3984520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:09.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b2139b700 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e660 0x55b9e3984520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b2139b700 1 -- 172.21.15.151:0/2500877740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 msgr2=0x55b9e39282c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b2139b700 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 0x55b9e39282c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b2139b700 1 -- 172.21.15.151:0/2500877740 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1401c5f0 con 0x55b9e37746b0 2023-07-21T22:48:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b2139b700 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3927d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b18000f80 tx=0x7f9b1802cca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59f04467f27974c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b04ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:48:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2500877740 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b18023070 con 0x55b9e37746b0 2023-07-21T22:48:09.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2500877740 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(133..133 src has 1..133) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f9b18007e40 con 0x55b9e37746b0 2023-07-21T22:48:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.916+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2500877740 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b1800f040 con 0x55b9e37746b0 2023-07-21T22:48:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2500877740 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b1802c540 con 0x55b9e37746b0 2023-07-21T22:48:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b36f1eb80 10 client.28307 fetch_fsmap learned FSMap version 91 2023-07-21T22:48:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2500877740 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55b9e3697d80 con 0x55b9e37746b0 2023-07-21T22:48:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2500877740 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b1800f040 con 0x55b9e37746b0 2023-07-21T22:48:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2500877740 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f9b1800eaa0 con 0x55b9e37746b0 2023-07-21T22:48:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b36f1eb80 10 client.28307 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:48:09.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b36f1eb80 10 client.28307 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:48:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b36f1eb80 20 client.28307 populate_metadata read hostname 'smithi151' 2023-07-21T22:48:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b9e3985dd0 0x55b9e39881e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b36f1eb80 4 client.28307 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:48:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.917+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2500877740 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b9e3824ff0 con 0x55b9e3985dd0 2023-07-21T22:48:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.918+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b9e3985dd0 0x55b9e39881e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.918+0000 7f9b04ff9700 10 client.28307 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:09.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.918+0000 7f9b20b9a700 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b9e3985dd0 0x55b9e39881e0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d5af8018934d4b2 server_cookie=db76427c74385f17 in_seq=0 out_seq=0 2023-07-21T22:48:09.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b04ff9700 1 -- 172.21.15.151:0/2500877740 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b9e3824ff0 con 0x55b9e3985dd0 2023-07-21T22:48:09.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b04ff9700 10 client.28307 handle_command_reply: tid=0 2023-07-21T22:48:09.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 client.28307 shutdown 2023-07-21T22:48:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2500877740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 msgr2=0x55b9e3927d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3927d80 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f9b18000f80 tx=0x7f9b1802cca0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2500877740 shutdown_connections 2023-07-21T22:48:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b9e3985dd0 0x55b9e39881e0 crc :-1 s=READY pgs=357 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9e37746b0 0x55b9e3927d80 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b9e391e660 0x55b9e3984520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b04ff9700 0 client.28307 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 --2- 172.21.15.151:0/2500877740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b9e391e210 0x55b9e39282c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2500877740 >> 172.21.15.151:0/2500877740 conn(0x55b9e390dae0 msgr2=0x55b9e3923040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2500877740 shutdown_connections 2023-07-21T22:48:09.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.926+0000 7f9b36f1eb80 1 -- 172.21.15.151:0/2500877740 wait complete. 2023-07-21T22:48:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.927+0000 7f9b36f1eb80 20 client.28307 trim_cache size 0 max 16384 2023-07-21T22:48:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:48:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:48:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:48:09.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:48:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.927+0000 7f9b235ff700 1 -- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b080a1340 msgr2=0x7f9b080a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.927+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b080a1340 0x7f9b080a37f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x55b9e391ea70 tx=0x7f9b14009930 comp rx=0 tx=0).stop 2023-07-21T22:48:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.927+0000 7f9b235ff700 1 -- 172.21.15.151:0/1422039279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b1c100760 msgr2=0x7f9b1c198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.927+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b1c100760 0x7f9b1c198370 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c006010 tx=0x7f9b0c00f670 comp rx=0 tx=0).stop 2023-07-21T22:48:09.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.927+0000 7f9b235ff700 1 -- 172.21.15.151:0/1422039279 shutdown_connections 2023-07-21T22:48:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.928+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b080a1340 0x7f9b080a37f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.928+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b1c104e00 0x7f9b1c19c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.928+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9b1c0ffdc0 0x7f9b1c197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.928+0000 7f9b235ff700 1 --2- 172.21.15.151:0/1422039279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b1c100760 0x7f9b1c198370 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.928+0000 7f9b235ff700 1 -- 172.21.15.151:0/1422039279 >> 172.21.15.151:0/1422039279 conn(0x7f9b1c0fb650 msgr2=0x7f9b1c0fc340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.928+0000 7f9b235ff700 1 -- 172.21.15.151:0/1422039279 shutdown_connections 2023-07-21T22:48:09.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:09.928+0000 7f9b235ff700 1 -- 172.21.15.151:0/1422039279 wait complete. 2023-07-21T22:48:10.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:10 smithi151 ceph-mon[95510]: pgmap v916: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2023-07-21T22:48:10.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:10 smithi151 ceph-mon[95510]: osdmap e133: 12 total, 12 up, 12 in 2023-07-21T22:48:11.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:10 smithi187 ceph-mon[96918]: pgmap v916: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2023-07-21T22:48:11.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:10 smithi187 ceph-mon[96918]: osdmap e133: 12 total, 12 up, 12 in 2023-07-21T22:48:11.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:10 smithi195 ceph-mon[97365]: pgmap v916: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2023-07-21T22:48:11.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:10 smithi195 ceph-mon[97365]: osdmap e133: 12 total, 12 up, 12 in 2023-07-21T22:48:12.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:12 smithi151 ceph-mon[95510]: pgmap v918: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.3 MiB/s wr, 307 op/s 2023-07-21T22:48:13.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:12 smithi187 ceph-mon[96918]: pgmap v918: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.3 MiB/s wr, 307 op/s 2023-07-21T22:48:13.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:12 smithi195 ceph-mon[97365]: pgmap v918: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 2.3 MiB/s wr, 307 op/s 2023-07-21T22:48:14.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:14 smithi151 ceph-mon[95510]: pgmap v919: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-07-21T22:48:15.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:14 smithi187 ceph-mon[96918]: pgmap v919: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-07-21T22:48:15.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:14 smithi195 ceph-mon[97365]: pgmap v919: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-07-21T22:48:16.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:16 smithi151 ceph-mon[95510]: pgmap v920: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-07-21T22:48:16.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:16 smithi151 ceph-mon[95510]: osdmap e134: 12 total, 12 up, 12 in 2023-07-21T22:48:17.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:16 smithi187 ceph-mon[96918]: pgmap v920: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-07-21T22:48:17.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:16 smithi187 ceph-mon[96918]: osdmap e134: 12 total, 12 up, 12 in 2023-07-21T22:48:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:16 smithi195 ceph-mon[97365]: pgmap v920: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 2.2 MiB/s wr, 291 op/s 2023-07-21T22:48:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:16 smithi195 ceph-mon[97365]: osdmap e134: 12 total, 12 up, 12 in 2023-07-21T22:48:19.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:18 smithi187 ceph-mon[96918]: pgmap v922: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.6 MiB/s wr, 337 op/s 2023-07-21T22:48:19.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:18 smithi195 ceph-mon[97365]: pgmap v922: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.6 MiB/s wr, 337 op/s 2023-07-21T22:48:19.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:18 smithi151 ceph-mon[95510]: pgmap v922: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 2.6 MiB/s wr, 337 op/s 2023-07-21T22:48:21.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:20 smithi187 ceph-mon[96918]: pgmap v923: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 MiB/s wr, 281 op/s 2023-07-21T22:48:21.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:20 smithi195 ceph-mon[97365]: pgmap v923: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 MiB/s wr, 281 op/s 2023-07-21T22:48:21.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:20 smithi151 ceph-mon[95510]: pgmap v923: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 2.1 MiB/s wr, 281 op/s 2023-07-21T22:48:22.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:21 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:48:22.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:21 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:48:22.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:21 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:48:23.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.080+0000 7feecc3ff700 1 -- 172.21.15.151:0/1371448314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feec40ffb30 msgr2=0x7feec40fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.080+0000 7feecc3ff700 1 --2- 172.21.15.151:0/1371448314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feec40ffb30 0x7feec40fffa0 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009990 tx=0x7feeb4009ca0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.080+0000 7feecc3ff700 1 -- 172.21.15.151:0/1371448314 shutdown_connections 2023-07-21T22:48:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.080+0000 7feecc3ff700 1 --2- 172.21.15.151:0/1371448314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec4105b60 0x7feec4105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.080+0000 7feecc3ff700 1 --2- 172.21.15.151:0/1371448314 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feec41004e0 0x7feec410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.080+0000 7feecc3ff700 1 --2- 172.21.15.151:0/1371448314 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feec40ffb30 0x7feec40fffa0 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.080+0000 7feecc3ff700 1 -- 172.21.15.151:0/1371448314 >> 172.21.15.151:0/1371448314 conn(0x7feec40fb5f0 msgr2=0x7feec40fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:23.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.080+0000 7feecc3ff700 1 -- 172.21.15.151:0/1371448314 shutdown_connections 2023-07-21T22:48:23.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.080+0000 7feecc3ff700 1 -- 172.21.15.151:0/1371448314 wait complete. 2023-07-21T22:48:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.081+0000 7feecc3ff700 1 Processor -- start 2023-07-21T22:48:23.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.081+0000 7feecc3ff700 1 -- start start 2023-07-21T22:48:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feecc3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feec40ffb30 0x7feec4197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feecc3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec41004e0 0x7feec4198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feecc3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feec4105b60 0x7feec419b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feecc3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec419bdc0 con 0x7feec4105b60 2023-07-21T22:48:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feecc3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec419bf30 con 0x7feec41004e0 2023-07-21T22:48:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feecc3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feec419c0f0 con 0x7feec40ffb30 2023-07-21T22:48:23.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feeca19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feec40ffb30 0x7feec4197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feec999a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec41004e0 0x7feec4198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feeca19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feec40ffb30 0x7feec4197cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58596/0 (socket says 172.21.15.151:58596) 2023-07-21T22:48:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feeca19b700 1 -- 172.21.15.151:0/3950779937 learned_addr learned my addr 172.21.15.151:0/3950779937 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feeca99c700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feec4105b60 0x7feec419b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feeca19b700 1 -- 172.21.15.151:0/3950779937 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec41004e0 msgr2=0x7feec4198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feeca19b700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec41004e0 0x7feec4198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feeca19b700 1 -- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feec4105b60 msgr2=0x7feec419b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feeca19b700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feec4105b60 0x7feec419b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.082+0000 7feeca19b700 1 -- 172.21.15.151:0/3950779937 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feeb40095f0 con 0x7feec40ffb30 2023-07-21T22:48:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.083+0000 7feeca19b700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feec40ffb30 0x7feec4197cc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feec000e9a0 tx=0x7feec000ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.083+0000 7feebb7fe700 1 -- 172.21.15.151:0/3950779937 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec0009790 con 0x7feec40ffb30 2023-07-21T22:48:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.083+0000 7feecc3ff700 1 -- 172.21.15.151:0/3950779937 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feec419c3d0 con 0x7feec40ffb30 2023-07-21T22:48:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.083+0000 7feebb7fe700 1 -- 172.21.15.151:0/3950779937 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feec0010430 con 0x7feec40ffb30 2023-07-21T22:48:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.083+0000 7feebb7fe700 1 -- 172.21.15.151:0/3950779937 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec000cea0 con 0x7feec40ffb30 2023-07-21T22:48:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.083+0000 7feecc3ff700 1 -- 172.21.15.151:0/3950779937 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec41a4d30 con 0x7feec40ffb30 2023-07-21T22:48:23.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:22 smithi187 ceph-mon[96918]: pgmap v924: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-07-21T22:48:23.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:22 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:48:23.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:22 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:48:23.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:22 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:48:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.086+0000 7feebb7fe700 1 -- 172.21.15.151:0/3950779937 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7feec00105a0 con 0x7feec40ffb30 2023-07-21T22:48:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.087+0000 7feedfdafb80 1 Processor -- start 2023-07-21T22:48:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feedfdafb80 1 -- start start 2023-07-21T22:48:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feebb7fe700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feeb00a12c0 0x7feeb00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325decd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325d8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d325d94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feedfdafb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d324dec50 con 0x561d325df660 2023-07-21T22:48:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feedfdafb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d325319e0 con 0x561d324356b0 2023-07-21T22:48:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feedfdafb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d3252ae70 con 0x561d325df210 2023-07-21T22:48:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feeca99c700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feeb00a12c0 0x7feeb00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feec999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325d8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feec999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325d8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58602/0 (socket says 172.21.15.151:58602) 2023-07-21T22:48:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feec999a700 1 -- 172.21.15.151:0/1168439863 learned_addr learned my addr 172.21.15.151:0/1168439863 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.088+0000 7feebb7fe700 1 -- 172.21.15.151:0/3950779937 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feec0014070 con 0x7feec40ffb30 2023-07-21T22:48:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feeca99c700 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d325d94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feeca19b700 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325decd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feec999a700 1 -- 172.21.15.151:0/1168439863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 msgr2=0x561d325decd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feec999a700 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325decd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feec999a700 1 -- 172.21.15.151:0/1168439863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 msgr2=0x561d325d94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feec999a700 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d325d94a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feec999a700 1 -- 172.21.15.151:0/1168439863 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d32358d80 con 0x561d325df210 2023-07-21T22:48:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.089+0000 7feeca19b700 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325decd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:48:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.090+0000 7feec999a700 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325d8f40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009990 tx=0x7feeb4005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=938fa1a0a73c3ccc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.090+0000 7feeca99c700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feeb00a12c0 0x7feeb00a3770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x561d325dfa70 tx=0x7feebc009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.090+0000 7feeb8bfe700 1 -- 172.21.15.151:0/1168439863 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb401d070 con 0x561d325df210 2023-07-21T22:48:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.090+0000 7feeb8bfe700 1 -- 172.21.15.151:0/1168439863 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feeb401e040 con 0x561d325df210 2023-07-21T22:48:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.090+0000 7feeb8bfe700 1 -- 172.21.15.151:0/1168439863 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb4004760 con 0x561d325df210 2023-07-21T22:48:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 -- 172.21.15.151:0/1168439863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 msgr2=0x561d325d8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325d8f40 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009990 tx=0x7feeb4005f00 comp rx=0 tx=0).stop 2023-07-21T22:48:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 -- 172.21.15.151:0/1168439863 shutdown_connections 2023-07-21T22:48:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325decd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d325d94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1168439863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325d8f40 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 -- 172.21.15.151:0/1168439863 >> 172.21.15.151:0/1168439863 conn(0x561d325ceae0 msgr2=0x561d325d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 -- 172.21.15.151:0/1168439863 shutdown_connections 2023-07-21T22:48:23.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 -- 172.21.15.151:0/1168439863 wait complete. 2023-07-21T22:48:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.091+0000 7feedfdafb80 1 -- start start 2023-07-21T22:48:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feedfdafb80 1 Processor -- start 2023-07-21T22:48:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325e8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d325e27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feedfdafb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d324caa60 con 0x561d325df660 2023-07-21T22:48:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feedfdafb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d324ca760 con 0x561d324356b0 2023-07-21T22:48:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feedfdafb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d323ae8c0 con 0x561d325df210 2023-07-21T22:48:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feedfdafb80 10 client.0 _ll_register_callbacks cb 0x561d324c8700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:48:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feec999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feeca19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325e8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feec999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58614/0 (socket says 172.21.15.151:58614) 2023-07-21T22:48:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feec999a700 1 -- 172.21.15.151:0/3642475983 learned_addr learned my addr 172.21.15.151:0/3642475983 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.092+0000 7feeca99c700 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d325e27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feec999a700 1 -- 172.21.15.151:0/3642475983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 msgr2=0x561d325e8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feec999a700 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325e8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feec999a700 1 -- 172.21.15.151:0/3642475983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 msgr2=0x561d325e27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feec999a700 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d325e27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feec999a700 1 -- 172.21.15.151:0/3642475983 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec41a4d30 con 0x561d325df210 2023-07-21T22:48:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feec999a700 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e8a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feeb40095c0 tx=0x7feeb4005810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f20342679feff2cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feeadffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:48:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.093+0000 7feeadffb700 1 -- 172.21.15.151:0/3642475983 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb401d070 con 0x561d325df210 2023-07-21T22:48:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feedfdafb80 1 -- 172.21.15.151:0/3642475983 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561d32484490 con 0x561d325df210 2023-07-21T22:48:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feeadffb700 1 -- 172.21.15.151:0/3642475983 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feeb4004500 con 0x561d325df210 2023-07-21T22:48:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feeadffb700 1 -- 172.21.15.151:0/3642475983 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb400bb20 con 0x561d325df210 2023-07-21T22:48:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feedfdafb80 10 client.28354 fetch_fsmap learned FSMap version 91 2023-07-21T22:48:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feedfdafb80 1 -- 172.21.15.151:0/3642475983 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x7feec410d220 con 0x561d325df210 2023-07-21T22:48:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feeadffb700 1 -- 172.21.15.151:0/3642475983 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561d32484490 con 0x561d325df210 2023-07-21T22:48:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feeadffb700 1 -- 172.21.15.151:0/3642475983 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feeb400f830 con 0x561d325df210 2023-07-21T22:48:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feedfdafb80 10 client.28354 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:48:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feedfdafb80 10 client.28354 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:48:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feedfdafb80 20 client.28354 populate_metadata read hostname 'smithi151' 2023-07-21T22:48:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561d325f2600 0x561d325f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feedfdafb80 4 client.28354 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:48:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.094+0000 7feedfdafb80 1 -- 172.21.15.151:0/3642475983 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561d32523e50 con 0x561d325f2600 2023-07-21T22:48:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.095+0000 7feeca19b700 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561d325f2600 0x561d325f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.096+0000 7feeca19b700 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561d325f2600 0x561d325f4a10 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=70825a5339e998f server_cookie=fc537f0e2a2afaa7 in_seq=0 out_seq=0 2023-07-21T22:48:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.096+0000 7feeadffb700 10 client.28354 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.096+0000 7feeadffb700 1 -- 172.21.15.151:0/3642475983 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561d32523e50 con 0x561d325f2600 2023-07-21T22:48:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.096+0000 7feeadffb700 10 client.28354 handle_command_reply: tid=0 2023-07-21T22:48:23.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.096+0000 7feedfdafb80 1 client.28354 shutdown 2023-07-21T22:48:23.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 -- 172.21.15.151:0/3642475983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 msgr2=0x561d325e8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:23.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e8a80 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7feeb40095c0 tx=0x7feeb4005810 comp rx=0 tx=0).stop 2023-07-21T22:48:23.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 -- 172.21.15.151:0/3642475983 shutdown_connections 2023-07-21T22:48:23.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561d325f2600 0x561d325f4a10 crc :-1 s=READY pgs=358 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325e8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feeadffb700 0 client.28354 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:23.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d325e27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3642475983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e8a80 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 -- 172.21.15.151:0/3642475983 >> 172.21.15.151:0/3642475983 conn(0x561d325ceae0 msgr2=0x561d325d33e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:23.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 -- 172.21.15.151:0/3642475983 shutdown_connections 2023-07-21T22:48:23.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 1 -- 172.21.15.151:0/3642475983 wait complete. 2023-07-21T22:48:23.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.097+0000 7feedfdafb80 20 client.28354 trim_cache size 0 max 16384 2023-07-21T22:48:23.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:22 smithi195 ceph-mon[97365]: pgmap v924: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-07-21T22:48:23.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:22 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:48:23.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:22 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:48:23.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:22 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:48:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.112+0000 7feedfdafb80 1 Processor -- start 2023-07-21T22:48:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.112+0000 7feedfdafb80 1 -- start start 2023-07-21T22:48:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d324356b0 0x561d325e0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325db740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d325df660 0x561d325d3b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feedfdafb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d32484490 con 0x561d324356b0 2023-07-21T22:48:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feedfdafb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d325d4f80 con 0x561d325df660 2023-07-21T22:48:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feedfdafb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d325da160 con 0x561d325df210 2023-07-21T22:48:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feeca19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d324356b0 0x561d325e0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feec999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325db740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feeca19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d324356b0 0x561d325e0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37928/0 (socket says 172.21.15.151:37928) 2023-07-21T22:48:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feeca19b700 1 -- 172.21.15.151:0/3650645083 learned_addr learned my addr 172.21.15.151:0/3650645083 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feeca99c700 1 --2- 172.21.15.151:0/3650645083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d325df660 0x561d325d3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feec999a700 1 -- 172.21.15.151:0/3650645083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d325df660 msgr2=0x561d325d3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feec999a700 1 --2- 172.21.15.151:0/3650645083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d325df660 0x561d325d3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feec999a700 1 -- 172.21.15.151:0/3650645083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d324356b0 msgr2=0x561d325e0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feec999a700 1 --2- 172.21.15.151:0/3650645083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d324356b0 0x561d325e0330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feec999a700 1 -- 172.21.15.151:0/3650645083 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561d325f9600 con 0x561d325df210 2023-07-21T22:48:23.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.113+0000 7feeca19b700 1 --2- 172.21.15.151:0/3650645083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d324356b0 0x561d325e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:48:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feec999a700 1 --2- 172.21.15.151:0/3650645083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325db740 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feeb400fc40 tx=0x7feeb4005ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a8637aab96c8a1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feeb93ff700 1 -- 172.21.15.151:0/3650645083 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb401d070 con 0x561d325df210 2023-07-21T22:48:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feeb93ff700 1 -- 172.21.15.151:0/3650645083 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feeb400bb20 con 0x561d325df210 2023-07-21T22:48:23.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feeb93ff700 1 -- 172.21.15.151:0/3650645083 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb402ca00 con 0x561d325df210 2023-07-21T22:48:23.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feedfdafb80 1 -- 172.21.15.151:0/3650645083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 msgr2=0x561d325db740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3650645083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325db740 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7feeb400fc40 tx=0x7feeb4005ac0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feedfdafb80 1 -- 172.21.15.151:0/3650645083 shutdown_connections 2023-07-21T22:48:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3650645083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d325df660 0x561d325d3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3650645083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d324356b0 0x561d325e0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feedfdafb80 1 --2- 172.21.15.151:0/3650645083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325db740 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.114+0000 7feedfdafb80 1 -- 172.21.15.151:0/3650645083 >> 172.21.15.151:0/3650645083 conn(0x561d325ceae0 msgr2=0x561d325e26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:23.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.115+0000 7feedfdafb80 1 -- 172.21.15.151:0/3650645083 shutdown_connections 2023-07-21T22:48:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.115+0000 7feedfdafb80 1 -- 172.21.15.151:0/3650645083 wait complete. 2023-07-21T22:48:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.115+0000 7feedfdafb80 1 -- start start 2023-07-21T22:48:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.115+0000 7feedfdafb80 1 Processor -- start 2023-07-21T22:48:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325e6730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e6c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feedfdafb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d32645480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feedfdafb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d326459c0 con 0x561d325df660 2023-07-21T22:48:23.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feedfdafb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d32645b00 con 0x561d324356b0 2023-07-21T22:48:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feedfdafb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561d32645cc0 con 0x561d325df210 2023-07-21T22:48:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feedfdafb80 10 client.0 _ll_register_callbacks cb 0x7feebc009260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:48:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feec999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feeca19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325e6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feec999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58644/0 (socket says 172.21.15.151:58644) 2023-07-21T22:48:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feec999a700 1 -- 172.21.15.151:0/1248663621 learned_addr learned my addr 172.21.15.151:0/1248663621 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feeca99c700 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d32645480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feec999a700 1 -- 172.21.15.151:0/1248663621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 msgr2=0x561d325e6730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feec999a700 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325e6730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.116+0000 7feec999a700 1 -- 172.21.15.151:0/1248663621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 msgr2=0x561d32645480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feec999a700 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d32645480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feec999a700 1 -- 172.21.15.151:0/1248663621 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feec419c3d0 con 0x561d325df210 2023-07-21T22:48:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feec999a700 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e6c70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009520 tx=0x7feeb400f710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63272da9b5b29d72 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feeadffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:48:23.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feeadffb700 1 -- 172.21.15.151:0/1248663621 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feeb401d070 con 0x561d325df210 2023-07-21T22:48:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feedfdafb80 1 -- 172.21.15.151:0/1248663621 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7feeb401e040 con 0x561d325df210 2023-07-21T22:48:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feeadffb700 1 -- 172.21.15.151:0/1248663621 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7feeb4000e40 con 0x561d325df210 2023-07-21T22:48:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feeadffb700 1 -- 172.21.15.151:0/1248663621 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7feeb40173f0 con 0x561d325df210 2023-07-21T22:48:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feedfdafb80 10 client.28360 fetch_fsmap learned FSMap version 91 2023-07-21T22:48:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feedfdafb80 1 -- 172.21.15.151:0/1248663621 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x7feec410d220 con 0x561d325df210 2023-07-21T22:48:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.117+0000 7feeadffb700 1 -- 172.21.15.151:0/1248663621 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7feeb401e040 con 0x561d325df210 2023-07-21T22:48:23.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.118+0000 7feeadffb700 1 -- 172.21.15.151:0/1248663621 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7feeb402c640 con 0x561d325df210 2023-07-21T22:48:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.118+0000 7feedfdafb80 10 client.28360 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:48:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.118+0000 7feedfdafb80 10 client.28360 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:48:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.118+0000 7feedfdafb80 20 client.28360 populate_metadata read hostname 'smithi151' 2023-07-21T22:48:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.118+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561d32647010 0x561d326493f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.118+0000 7feedfdafb80 4 client.28360 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:48:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.118+0000 7feedfdafb80 1 -- 172.21.15.151:0/1248663621 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561d324e5ff0 con 0x561d32647010 2023-07-21T22:48:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.118+0000 7feeca19b700 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561d32647010 0x561d326493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:23.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.119+0000 7feeadffb700 10 client.28360 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.119+0000 7feeca19b700 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561d32647010 0x561d326493f0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fea9228629ab440 server_cookie=521cdb5d80999c5a in_seq=0 out_seq=0 2023-07-21T22:48:23.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.123+0000 7feeadffb700 1 -- 172.21.15.151:0/1248663621 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561d324e5ff0 con 0x561d32647010 2023-07-21T22:48:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.123+0000 7feeadffb700 10 client.28360 handle_command_reply: tid=0 2023-07-21T22:48:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.123+0000 7feedfdafb80 1 client.28360 shutdown 2023-07-21T22:48:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 -- 172.21.15.151:0/1248663621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 msgr2=0x561d325e6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e6c70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7feeb4009520 tx=0x7feeb400f710 comp rx=0 tx=0).stop 2023-07-21T22:48:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 -- 172.21.15.151:0/1248663621 shutdown_connections 2023-07-21T22:48:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561d32647010 0x561d326493f0 crc :-1 s=READY pgs=359 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561d324356b0 0x561d325e6730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561d325df660 0x561d32645480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feeadffb700 0 client.28360 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 --2- 172.21.15.151:0/1248663621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561d325df210 0x561d325e6c70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 -- 172.21.15.151:0/1248663621 >> 172.21.15.151:0/1248663621 conn(0x561d325ceae0 msgr2=0x561d325e0f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 -- 172.21.15.151:0/1248663621 shutdown_connections 2023-07-21T22:48:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 1 -- 172.21.15.151:0/1248663621 wait complete. 2023-07-21T22:48:23.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.124+0000 7feedfdafb80 20 client.28360 trim_cache size 0 max 16384 2023-07-21T22:48:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:48:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:48:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:48:23.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:48:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 -- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feeb00a12c0 msgr2=0x7feeb00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feeb00a12c0 0x7feeb00a3770 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x561d325dfa70 tx=0x7feebc009920 comp rx=0 tx=0).stop 2023-07-21T22:48:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 -- 172.21.15.151:0/3950779937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feec40ffb30 msgr2=0x7feec4197cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:23.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feec40ffb30 0x7feec4197cc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7feec000e9a0 tx=0x7feec000ecb0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 -- 172.21.15.151:0/3950779937 shutdown_connections 2023-07-21T22:48:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7feeb00a12c0 0x7feeb00a3770 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feec4105b60 0x7feec419b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7feec40ffb30 0x7feec4197cc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 --2- 172.21.15.151:0/3950779937 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feec41004e0 0x7feec4198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 -- 172.21.15.151:0/3950779937 >> 172.21.15.151:0/3950779937 conn(0x7feec40fb5f0 msgr2=0x7feec410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:23.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 -- 172.21.15.151:0/3950779937 shutdown_connections 2023-07-21T22:48:23.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:23.125+0000 7feecc3ff700 1 -- 172.21.15.151:0/3950779937 wait complete. 2023-07-21T22:48:23.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:22 smithi151 ceph-mon[95510]: pgmap v924: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.1 MiB/s wr, 270 op/s 2023-07-21T22:48:23.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:22 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:48:23.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:22 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:48:23.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:22 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:48:24.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:23 smithi187 ceph-mon[96918]: pgmap v925: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:48:24.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:23 smithi195 ceph-mon[97365]: pgmap v925: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:48:24.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:23 smithi151 ceph-mon[95510]: pgmap v925: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:48:26.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:26 smithi187 ceph-mon[96918]: pgmap v926: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:48:26.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:26 smithi195 ceph-mon[97365]: pgmap v926: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:48:26.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:26 smithi151 ceph-mon[95510]: pgmap v926: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.2 MiB/s wr, 293 op/s 2023-07-21T22:48:28.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:28 smithi151 ceph-mon[95510]: pgmap v927: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 421 op/s 2023-07-21T22:48:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:28 smithi187 ceph-mon[96918]: pgmap v927: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 421 op/s 2023-07-21T22:48:29.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:28 smithi195 ceph-mon[97365]: pgmap v927: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 3.2 MiB/s wr, 421 op/s 2023-07-21T22:48:30.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:30 smithi151 ceph-mon[95510]: pgmap v928: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:48:31.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:30 smithi187 ceph-mon[96918]: pgmap v928: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:48:31.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:30 smithi195 ceph-mon[97365]: pgmap v928: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:48:32.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:32 smithi151 ceph-mon[95510]: pgmap v929: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:48:33.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:32 smithi187 ceph-mon[96918]: pgmap v929: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:48:33.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:32 smithi195 ceph-mon[97365]: pgmap v929: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.0 MiB/s wr, 262 op/s 2023-07-21T22:48:34.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:34 smithi151 ceph-mon[95510]: pgmap v930: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:48:35.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:34 smithi187 ceph-mon[96918]: pgmap v930: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:48:35.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:34 smithi195 ceph-mon[97365]: pgmap v930: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 3.0 MiB/s wr, 392 op/s 2023-07-21T22:48:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.318+0000 7f1ddb39d700 1 -- 172.21.15.151:0/3891616281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1dd41002e0 msgr2=0x7f1dd410c770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.318+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/3891616281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1dd41002e0 0x7f1dd410c770 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc009f90 tx=0x7f1dcc00b330 comp rx=0 tx=0).stop 2023-07-21T22:48:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.319+0000 7f1ddb39d700 1 -- 172.21.15.151:0/3891616281 shutdown_connections 2023-07-21T22:48:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.319+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/3891616281 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1dd41002e0 0x7f1dd410c770 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.319+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/3891616281 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd4105940 0x7f1dd4105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.319+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/3891616281 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dd40ff930 0x7f1dd40ffda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.319+0000 7f1ddb39d700 1 -- 172.21.15.151:0/3891616281 >> 172.21.15.151:0/3891616281 conn(0x7f1dd40fb450 msgr2=0x7f1dd40fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.319+0000 7f1ddb39d700 1 -- 172.21.15.151:0/3891616281 shutdown_connections 2023-07-21T22:48:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.319+0000 7f1ddb39d700 1 -- 172.21.15.151:0/3891616281 wait complete. 2023-07-21T22:48:36.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.320+0000 7f1ddb39d700 1 Processor -- start 2023-07-21T22:48:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.320+0000 7f1ddb39d700 1 -- start start 2023-07-21T22:48:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1ddb39d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd40ff930 0x7f1dd4072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1ddb39d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1dd41002e0 0x7f1dd4072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1ddb39d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dd4105940 0x7f1dd41a3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1ddb39d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd4073580 con 0x7f1dd41002e0 2023-07-21T22:48:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1ddb39d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41a4130 con 0x7f1dd4105940 2023-07-21T22:48:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1ddb39d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dd41a4270 con 0x7f1dd40ff930 2023-07-21T22:48:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1dd9b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1dd41002e0 0x7f1dd4072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1dd9b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1dd41002e0 0x7f1dd4072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44780/0 (socket says 172.21.15.151:44780) 2023-07-21T22:48:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1dd9b9a700 1 -- 172.21.15.151:0/1283392067 learned_addr learned my addr 172.21.15.151:0/1283392067 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:36.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dd4105940 0x7f1dd41a3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.321+0000 7f1dda39b700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd40ff930 0x7f1dd4072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.322+0000 7f1ddab9c700 1 -- 172.21.15.151:0/1283392067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd40ff930 msgr2=0x7f1dd4072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.322+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd40ff930 0x7f1dd4072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.322+0000 7f1ddab9c700 1 -- 172.21.15.151:0/1283392067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1dd41002e0 msgr2=0x7f1dd4072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.322+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1dd41002e0 0x7f1dd4072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.322+0000 7f1ddab9c700 1 -- 172.21.15.151:0/1283392067 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc009c40 con 0x7f1dd4105940 2023-07-21T22:48:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.322+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dd4105940 0x7f1dd41a3bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00b6c0 tx=0x7f1dcc008ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.322+0000 7f1dcb7fe700 1 -- 172.21.15.151:0/1283392067 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc00e040 con 0x7f1dd4105940 2023-07-21T22:48:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.323+0000 7f1ddb39d700 1 -- 172.21.15.151:0/1283392067 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dd41a4470 con 0x7f1dd4105940 2023-07-21T22:48:36.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.323+0000 7f1ddb39d700 1 -- 172.21.15.151:0/1283392067 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd41a4940 con 0x7f1dd4105940 2023-07-21T22:48:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.323+0000 7f1dcb7fe700 1 -- 172.21.15.151:0/1283392067 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dcc004e30 con 0x7f1dd4105940 2023-07-21T22:48:36.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.323+0000 7f1dcb7fe700 1 -- 172.21.15.151:0/1283392067 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc005040 con 0x7f1dd4105940 2023-07-21T22:48:36.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.326+0000 7f1dcb7fe700 1 -- 172.21.15.151:0/1283392067 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f1dcc01d470 con 0x7f1dd4105940 2023-07-21T22:48:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.328+0000 7f1dcb7fe700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1dc00a1340 0x7f1dc00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.328+0000 7f1dcb7fe700 1 -- 172.21.15.151:0/1283392067 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1dcc0cdee0 con 0x7f1dd4105940 2023-07-21T22:48:36.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.329+0000 7f1dda39b700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1dc00a1340 0x7f1dc00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.329+0000 7f1deff26b80 1 Processor -- start 2023-07-21T22:48:36.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.329+0000 7f1deff26b80 1 -- start start 2023-07-21T22:48:36.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.329+0000 7f1dda39b700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1dc00a1340 0x7f1dc00a37f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4100a70 tx=0x7f1dd0009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:36.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 0x5568c5bae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 0x5568c5baea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1deff26b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5ab3c50 con 0x5568c5bb4480 2023-07-21T22:48:36.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1deff26b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5b069e0 con 0x5568c5a0a6b0 2023-07-21T22:48:36.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1deff26b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5affe70 con 0x5568c5bae5e0 2023-07-21T22:48:36.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1dda39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1dd9b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 0x5568c5bae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1dd9b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 0x5568c5bae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44788/0 (socket says 172.21.15.151:44788) 2023-07-21T22:48:36.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1dd9b9a700 1 -- 172.21.15.151:0/205568070 learned_addr learned my addr 172.21.15.151:0/205568070 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:36.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.330+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/205568070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 0x5568c5baea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.331+0000 7f1dda39b700 1 -- 172.21.15.151:0/205568070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 msgr2=0x5568c5baea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:36.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.331+0000 7f1dda39b700 1 --2- 172.21.15.151:0/205568070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 0x5568c5baea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.331+0000 7f1dda39b700 1 -- 172.21.15.151:0/205568070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 msgr2=0x5568c5bae0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.331+0000 7f1dda39b700 1 --2- 172.21.15.151:0/205568070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 0x5568c5bae0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.331+0000 7f1dda39b700 1 -- 172.21.15.151:0/205568070 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c592dd80 con 0x5568c5a0a6b0 2023-07-21T22:48:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.331+0000 7f1dda39b700 1 --2- 172.21.15.151:0/205568070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb3f40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009fd0 tx=0x7f1dd0014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45d5dced9fe0b362 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.331+0000 7f1dc8bfe700 1 -- 172.21.15.151:0/205568070 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0004020 con 0x5568c5a0a6b0 2023-07-21T22:48:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.331+0000 7f1dc8bfe700 1 -- 172.21.15.151:0/205568070 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dd0021070 con 0x5568c5a0a6b0 2023-07-21T22:48:36.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.331+0000 7f1dc8bfe700 1 -- 172.21.15.151:0/205568070 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd00038e0 con 0x5568c5a0a6b0 2023-07-21T22:48:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.332+0000 7f1deff26b80 1 -- 172.21.15.151:0/205568070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5a0a6b0 msgr2=0x5568c5bb3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.332+0000 7f1deff26b80 1 --2- 172.21.15.151:0/205568070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb3f40 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0009fd0 tx=0x7f1dd0014000 comp rx=0 tx=0).stop 2023-07-21T22:48:36.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.332+0000 7f1deff26b80 1 -- 172.21.15.151:0/205568070 shutdown_connections 2023-07-21T22:48:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.332+0000 7f1deff26b80 1 --2- 172.21.15.151:0/205568070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb3f40 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.332+0000 7f1deff26b80 1 --2- 172.21.15.151:0/205568070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 0x5568c5baea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.332+0000 7f1deff26b80 1 --2- 172.21.15.151:0/205568070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 0x5568c5bae0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.332+0000 7f1deff26b80 1 -- 172.21.15.151:0/205568070 >> 172.21.15.151:0/205568070 conn(0x5568c5ba3c40 msgr2=0x5568c5ba9300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.333+0000 7f1deff26b80 1 -- 172.21.15.151:0/205568070 shutdown_connections 2023-07-21T22:48:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.333+0000 7f1deff26b80 1 -- 172.21.15.151:0/205568070 wait complete. 2023-07-21T22:48:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.333+0000 7f1deff26b80 1 -- start start 2023-07-21T22:48:36.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.333+0000 7f1deff26b80 1 Processor -- start 2023-07-21T22:48:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 0x5568c5bba700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5bae5e0 0x5568c5bb7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 0x5568c5bb7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1deff26b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5a9fa60 con 0x5568c5bb4480 2023-07-21T22:48:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1deff26b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5a9f760 con 0x5568c5bae5e0 2023-07-21T22:48:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1deff26b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c59838c0 con 0x5568c5a0a6b0 2023-07-21T22:48:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1deff26b80 10 client.0 _ll_register_callbacks cb 0x5568c5a9d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:48:36.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1dd9b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5bae5e0 0x5568c5bb7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1dd9b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5bae5e0 0x5568c5bb7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37310/0 (socket says 172.21.15.151:37310) 2023-07-21T22:48:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1dd9b9a700 1 -- 172.21.15.151:0/2781657267 learned_addr learned my addr 172.21.15.151:0/2781657267 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.334+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 0x5568c5bb7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dda39b700 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 0x5568c5bba700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dd9b9a700 1 -- 172.21.15.151:0/2781657267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 msgr2=0x5568c5bba700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dd9b9a700 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 0x5568c5bba700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dd9b9a700 1 -- 172.21.15.151:0/2781657267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 msgr2=0x5568c5bb7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:36.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dd9b9a700 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 0x5568c5bb7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dd9b9a700 1 -- 172.21.15.151:0/2781657267 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dd0017070 con 0x5568c5bae5e0 2023-07-21T22:48:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dda39b700 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 0x5568c5bba700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:48:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dd9b9a700 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5bae5e0 0x5568c5bb7910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4005950 tx=0x7f1dc4012c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3cfc6afecbb82c91 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:48:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dbdffb700 1 -- 172.21.15.151:0/2781657267 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dc4017070 con 0x5568c5bae5e0 2023-07-21T22:48:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1deff26b80 1 -- 172.21.15.151:0/2781657267 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5568c5a59490 con 0x5568c5bae5e0 2023-07-21T22:48:36.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dbdffb700 1 -- 172.21.15.151:0/2781657267 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1dc400f830 con 0x5568c5bae5e0 2023-07-21T22:48:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.335+0000 7f1dbdffb700 1 -- 172.21.15.151:0/2781657267 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dc40122e0 con 0x5568c5bae5e0 2023-07-21T22:48:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1deff26b80 10 client.28337 fetch_fsmap learned FSMap version 91 2023-07-21T22:48:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1deff26b80 1 -- 172.21.15.151:0/2781657267 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x5568c5916c00 con 0x5568c5bae5e0 2023-07-21T22:48:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1dbdffb700 1 -- 172.21.15.151:0/2781657267 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5568c5a59490 con 0x5568c5bae5e0 2023-07-21T22:48:36.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1dbdffb700 1 -- 172.21.15.151:0/2781657267 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1dc4010b80 con 0x5568c5bae5e0 2023-07-21T22:48:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1deff26b80 10 client.28337 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:48:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1deff26b80 10 client.28337 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:48:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1deff26b80 20 client.28337 populate_metadata read hostname 'smithi151' 2023-07-21T22:48:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1deff26b80 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5568c5bc7e20 0x5568c5bca230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1deff26b80 4 client.28337 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:48:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1deff26b80 1 -- 172.21.15.151:0/2781657267 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5568c5af8e50 con 0x5568c5bc7e20 2023-07-21T22:48:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.336+0000 7f1dda39b700 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5568c5bc7e20 0x5568c5bca230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.337+0000 7f1dbdffb700 10 client.28337 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.337+0000 7f1dda39b700 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5568c5bc7e20 0x5568c5bca230 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96b24cc24cd41dd8 server_cookie=93c27c9abbfdb8ea in_seq=0 out_seq=0 2023-07-21T22:48:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1dbdffb700 1 -- 172.21.15.151:0/2781657267 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5568c5af8e50 con 0x5568c5bc7e20 2023-07-21T22:48:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1dbdffb700 10 client.28337 handle_command_reply: tid=0 2023-07-21T22:48:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1deff26b80 1 client.28337 shutdown 2023-07-21T22:48:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1deff26b80 1 -- 172.21.15.151:0/2781657267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5bae5e0 msgr2=0x5568c5bb7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1deff26b80 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5bae5e0 0x5568c5bb7910 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1dc4005950 tx=0x7f1dc4012c70 comp rx=0 tx=0).stop 2023-07-21T22:48:36.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1deff26b80 1 -- 172.21.15.151:0/2781657267 shutdown_connections 2023-07-21T22:48:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1deff26b80 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5568c5bc7e20 0x5568c5bca230 crc :-1 s=READY pgs=360 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1deff26b80 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bb4480 0x5568c5bb7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1deff26b80 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 0x5568c5bba700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1deff26b80 1 --2- 172.21.15.151:0/2781657267 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5bae5e0 0x5568c5bb7910 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1deff26b80 1 -- 172.21.15.151:0/2781657267 >> 172.21.15.151:0/2781657267 conn(0x5568c5ba3c40 msgr2=0x5568c5ba8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.338+0000 7f1dbdffb700 0 client.28337 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.339+0000 7f1deff26b80 1 -- 172.21.15.151:0/2781657267 shutdown_connections 2023-07-21T22:48:36.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.339+0000 7f1deff26b80 1 -- 172.21.15.151:0/2781657267 wait complete. 2023-07-21T22:48:36.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.339+0000 7f1deff26b80 20 client.28337 trim_cache size 0 max 16384 2023-07-21T22:48:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.358+0000 7f1deff26b80 1 Processor -- start 2023-07-21T22:48:36.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.358+0000 7f1deff26b80 1 -- start start 2023-07-21T22:48:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bae0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 0x5568c5bbee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1deff26b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5bc46c0 con 0x5568c5a0a6b0 2023-07-21T22:48:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1deff26b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5baa960 con 0x5568c5ba3c40 2023-07-21T22:48:36.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1deff26b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5bb48a0 con 0x5568c5bae5e0 2023-07-21T22:48:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1dd9b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1dda39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bae0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1dda39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bae0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37314/0 (socket says 172.21.15.151:37314) 2023-07-21T22:48:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1dda39b700 1 -- 172.21.15.151:0/286926877 learned_addr learned my addr 172.21.15.151:0/286926877 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.359+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/286926877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 0x5568c5bbee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.360+0000 7f1dda39b700 1 -- 172.21.15.151:0/286926877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 msgr2=0x5568c5bbee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.360+0000 7f1dda39b700 1 --2- 172.21.15.151:0/286926877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 0x5568c5bbee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.360+0000 7f1dda39b700 1 -- 172.21.15.151:0/286926877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5a0a6b0 msgr2=0x5568c5bb78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.360+0000 7f1dda39b700 1 --2- 172.21.15.151:0/286926877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.360+0000 7f1dda39b700 1 -- 172.21.15.151:0/286926877 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5568c5ba5480 con 0x5568c5ba3c40 2023-07-21T22:48:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.360+0000 7f1dda39b700 1 --2- 172.21.15.151:0/286926877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bae0a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0011c20 tx=0x7f1dd000ed90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664fa96756b85df6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.360+0000 7f1dc93ff700 1 -- 172.21.15.151:0/286926877 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd000ebb0 con 0x5568c5ba3c40 2023-07-21T22:48:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.360+0000 7f1dc93ff700 1 -- 172.21.15.151:0/286926877 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dd00054d0 con 0x5568c5ba3c40 2023-07-21T22:48:36.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.360+0000 7f1dc93ff700 1 -- 172.21.15.151:0/286926877 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd0004950 con 0x5568c5ba3c40 2023-07-21T22:48:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.361+0000 7f1deff26b80 1 -- 172.21.15.151:0/286926877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 msgr2=0x5568c5bae0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.361+0000 7f1deff26b80 1 --2- 172.21.15.151:0/286926877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bae0a0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f1dd0011c20 tx=0x7f1dd000ed90 comp rx=0 tx=0).stop 2023-07-21T22:48:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.361+0000 7f1deff26b80 1 -- 172.21.15.151:0/286926877 shutdown_connections 2023-07-21T22:48:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.361+0000 7f1deff26b80 1 --2- 172.21.15.151:0/286926877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bae0a0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.361+0000 7f1deff26b80 1 --2- 172.21.15.151:0/286926877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5bae5e0 0x5568c5bbee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.361+0000 7f1deff26b80 1 --2- 172.21.15.151:0/286926877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.361+0000 7f1deff26b80 1 -- 172.21.15.151:0/286926877 >> 172.21.15.151:0/286926877 conn(0x5568c5bc42f0 msgr2=0x5568c5bb71b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.361+0000 7f1deff26b80 1 -- 172.21.15.151:0/286926877 shutdown_connections 2023-07-21T22:48:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.361+0000 7f1deff26b80 1 -- 172.21.15.151:0/286926877 wait complete. 2023-07-21T22:48:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.362+0000 7f1deff26b80 1 -- start start 2023-07-21T22:48:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.362+0000 7f1deff26b80 1 Processor -- start 2023-07-21T22:48:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.362+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bb0f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1deff26b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bae5e0 0x5568c5baf8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1deff26b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5bb1630 con 0x5568c5bae5e0 2023-07-21T22:48:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1deff26b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5bafe30 con 0x5568c5ba3c40 2023-07-21T22:48:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1deff26b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5568c5bafff0 con 0x5568c5a0a6b0 2023-07-21T22:48:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1deff26b80 10 client.0 _ll_register_callbacks cb 0x7f1dc4012450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:48:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1ddab9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bae5e0 0x5568c5baf8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1ddab9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bae5e0 0x5568c5baf8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44822/0 (socket says 172.21.15.151:44822) 2023-07-21T22:48:36.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1ddab9c700 1 -- 172.21.15.151:0/830398694 learned_addr learned my addr 172.21.15.151:0/830398694 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1dd9b9a700 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bb0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1dda39b700 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1ddab9c700 1 -- 172.21.15.151:0/830398694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 msgr2=0x5568c5bb09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1ddab9c700 1 -- 172.21.15.151:0/830398694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 msgr2=0x5568c5bb0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bb0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1ddab9c700 1 -- 172.21.15.151:0/830398694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5568c592dd80 con 0x5568c5bae5e0 2023-07-21T22:48:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.363+0000 7f1dd9b9a700 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bb0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:48:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.364+0000 7f1ddab9c700 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bae5e0 0x5568c5baf8f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc09aff0 tx=0x7f1dcc09aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25d881c33afcf57c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:36.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.364+0000 7f1dbdffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:48:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.364+0000 7f1dbdffb700 1 -- 172.21.15.151:0/830398694 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dcc09f090 con 0x5568c5bae5e0 2023-07-21T22:48:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.364+0000 7f1deff26b80 1 -- 172.21.15.151:0/830398694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1dd0021070 con 0x5568c5bae5e0 2023-07-21T22:48:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.364+0000 7f1dbdffb700 1 -- 172.21.15.151:0/830398694 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f1dcc0a3420 con 0x5568c5bae5e0 2023-07-21T22:48:36.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.364+0000 7f1dbdffb700 1 -- 172.21.15.151:0/830398694 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1dcc0b92e0 con 0x5568c5bae5e0 2023-07-21T22:48:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.364+0000 7f1deff26b80 10 client.18678 fetch_fsmap learned FSMap version 91 2023-07-21T22:48:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.364+0000 7f1deff26b80 1 -- 172.21.15.151:0/830398694 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x5568c59541f0 con 0x5568c5bae5e0 2023-07-21T22:48:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.365+0000 7f1dbdffb700 1 -- 172.21.15.151:0/830398694 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1dcc0c9080 con 0x5568c5bae5e0 2023-07-21T22:48:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.365+0000 7f1dbdffb700 1 -- 172.21.15.151:0/830398694 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f1dcc0a2f90 con 0x5568c5bae5e0 2023-07-21T22:48:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.365+0000 7f1deff26b80 10 client.18678 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:48:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.365+0000 7f1deff26b80 10 client.18678 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:48:36.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.365+0000 7f1deff26b80 20 client.18678 populate_metadata read hostname 'smithi151' 2023-07-21T22:48:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.365+0000 7f1deff26b80 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5568c5bb4480 0x5568c5c1e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.365+0000 7f1deff26b80 4 client.18678 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:48:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.365+0000 7f1deff26b80 1 -- 172.21.15.151:0/830398694 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5568c5abaff0 con 0x5568c5bb4480 2023-07-21T22:48:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.365+0000 7f1dda39b700 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5568c5bb4480 0x5568c5c1e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.366+0000 7f1dda39b700 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5568c5bb4480 0x5568c5c1e730 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d601913aa9de229 server_cookie=608985654704e976 in_seq=0 out_seq=0 2023-07-21T22:48:36.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.366+0000 7f1dbdffb700 10 client.18678 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1dbdffb700 1 -- 172.21.15.151:0/830398694 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5568c5abaff0 con 0x5568c5bb4480 2023-07-21T22:48:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1dbdffb700 10 client.18678 handle_command_reply: tid=0 2023-07-21T22:48:36.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1deff26b80 1 client.18678 shutdown 2023-07-21T22:48:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1deff26b80 1 -- 172.21.15.151:0/830398694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bae5e0 msgr2=0x5568c5baf8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1deff26b80 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bae5e0 0x5568c5baf8f0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc09aff0 tx=0x7f1dcc09aa40 comp rx=0 tx=0).stop 2023-07-21T22:48:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1deff26b80 1 -- 172.21.15.151:0/830398694 shutdown_connections 2023-07-21T22:48:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1deff26b80 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5568c5bb4480 0x5568c5c1e730 crc :-1 s=READY pgs=361 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1deff26b80 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5568c5bae5e0 0x5568c5baf8f0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1deff26b80 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5568c5a0a6b0 0x5568c5bb09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1dbdffb700 0 client.18678 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1deff26b80 1 --2- 172.21.15.151:0/830398694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5568c5ba3c40 0x5568c5bb0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.374+0000 7f1deff26b80 1 -- 172.21.15.151:0/830398694 >> 172.21.15.151:0/830398694 conn(0x5568c5bc42f0 msgr2=0x5568c5bb4ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.375+0000 7f1deff26b80 1 -- 172.21.15.151:0/830398694 shutdown_connections 2023-07-21T22:48:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.375+0000 7f1deff26b80 1 -- 172.21.15.151:0/830398694 wait complete. 2023-07-21T22:48:36.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.375+0000 7f1deff26b80 20 client.18678 trim_cache size 0 max 16384 2023-07-21T22:48:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:48:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:48:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:48:36.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:48:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.375+0000 7f1ddb39d700 1 -- 172.21.15.151:0/1283392067 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1dc00a1340 msgr2=0x7f1dc00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.375+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1dc00a1340 0x7f1dc00a37f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1dd4100a70 tx=0x7f1dd0009260 comp rx=0 tx=0).stop 2023-07-21T22:48:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.375+0000 7f1ddb39d700 1 -- 172.21.15.151:0/1283392067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dd4105940 msgr2=0x7f1dd41a3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.375+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dd4105940 0x7f1dd41a3bf0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1dcc00b6c0 tx=0x7f1dcc008ca0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.376+0000 7f1ddb39d700 1 -- 172.21.15.151:0/1283392067 shutdown_connections 2023-07-21T22:48:36.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.376+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f1dc00a1340 0x7f1dc00a37f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.376+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dd4105940 0x7f1dd41a3bf0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.376+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1dd40ff930 0x7f1dd4072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.376+0000 7f1ddb39d700 1 --2- 172.21.15.151:0/1283392067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1dd41002e0 0x7f1dd4072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.376+0000 7f1ddb39d700 1 -- 172.21.15.151:0/1283392067 >> 172.21.15.151:0/1283392067 conn(0x7f1dd40fb450 msgr2=0x7f1dd4103480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.376+0000 7f1ddb39d700 1 -- 172.21.15.151:0/1283392067 shutdown_connections 2023-07-21T22:48:36.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:36.376+0000 7f1ddb39d700 1 -- 172.21.15.151:0/1283392067 wait complete. 2023-07-21T22:48:36.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:36 smithi151 ceph-mon[95510]: pgmap v931: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 258 op/s 2023-07-21T22:48:37.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:36 smithi187 ceph-mon[96918]: pgmap v931: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 258 op/s 2023-07-21T22:48:37.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:36 smithi195 ceph-mon[97365]: pgmap v931: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 2.0 MiB/s wr, 258 op/s 2023-07-21T22:48:39.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:38 smithi187 ceph-mon[96918]: pgmap v932: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:48:39.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:38 smithi195 ceph-mon[97365]: pgmap v932: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:48:39.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:38 smithi151 ceph-mon[95510]: pgmap v932: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.8 MiB/s wr, 360 op/s 2023-07-21T22:48:41.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:40 smithi187 ceph-mon[96918]: pgmap v933: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.8 MiB/s wr, 231 op/s 2023-07-21T22:48:41.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:40 smithi195 ceph-mon[97365]: pgmap v933: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.8 MiB/s wr, 231 op/s 2023-07-21T22:48:41.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:40 smithi151 ceph-mon[95510]: pgmap v933: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.8 MiB/s wr, 231 op/s 2023-07-21T22:48:43.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:42 smithi187 ceph-mon[96918]: pgmap v934: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.8 MiB/s wr, 231 op/s 2023-07-21T22:48:43.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:42 smithi195 ceph-mon[97365]: pgmap v934: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.8 MiB/s wr, 231 op/s 2023-07-21T22:48:43.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:42 smithi151 ceph-mon[95510]: pgmap v934: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 1.8 MiB/s wr, 231 op/s 2023-07-21T22:48:45.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:44 smithi187 ceph-mon[96918]: pgmap v935: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:48:45.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:44 smithi195 ceph-mon[97365]: pgmap v935: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:48:45.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:44 smithi151 ceph-mon[95510]: pgmap v935: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 2.8 MiB/s wr, 367 op/s 2023-07-21T22:48:47.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:46 smithi187 ceph-mon[96918]: pgmap v936: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1.8 MiB/s wr, 238 op/s 2023-07-21T22:48:47.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:46 smithi195 ceph-mon[97365]: pgmap v936: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1.8 MiB/s wr, 238 op/s 2023-07-21T22:48:47.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:46 smithi151 ceph-mon[95510]: pgmap v936: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 1.8 MiB/s wr, 238 op/s 2023-07-21T22:48:49.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:48 smithi187 ceph-mon[96918]: pgmap v937: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 3.0 MiB/s wr, 385 op/s 2023-07-21T22:48:49.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:48 smithi195 ceph-mon[97365]: pgmap v937: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 3.0 MiB/s wr, 385 op/s 2023-07-21T22:48:49.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:48 smithi151 ceph-mon[95510]: pgmap v937: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 3.0 MiB/s wr, 385 op/s 2023-07-21T22:48:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.544+0000 7f47e7bff700 1 -- 172.21.15.151:0/3257656587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47e00ffb50 msgr2=0x7f47e00fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.544+0000 7f47e7bff700 1 --2- 172.21.15.151:0/3257656587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47e00ffb50 0x7f47e00fffc0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009990 tx=0x7f47d0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.544+0000 7f47e7bff700 1 -- 172.21.15.151:0/3257656587 shutdown_connections 2023-07-21T22:48:49.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.544+0000 7f47e7bff700 1 --2- 172.21.15.151:0/3257656587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e0105b80 0x7f47e0105f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.544+0000 7f47e7bff700 1 --2- 172.21.15.151:0/3257656587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e0100500 0x7f47e010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.544+0000 7f47e7bff700 1 --2- 172.21.15.151:0/3257656587 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47e00ffb50 0x7f47e00fffc0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.544+0000 7f47e7bff700 1 -- 172.21.15.151:0/3257656587 >> 172.21.15.151:0/3257656587 conn(0x7f47e00fb650 msgr2=0x7f47e00fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.544+0000 7f47e7bff700 1 -- 172.21.15.151:0/3257656587 shutdown_connections 2023-07-21T22:48:49.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.544+0000 7f47e7bff700 1 -- 172.21.15.151:0/3257656587 wait complete. 2023-07-21T22:48:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.545+0000 7f47e7bff700 1 Processor -- start 2023-07-21T22:48:49.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.545+0000 7f47e7bff700 1 -- start start 2023-07-21T22:48:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e7bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00ffb50 0x7f47e0197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e7bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e0100500 0x7f47e0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e7bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47e0105b80 0x7f47e019c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e7bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e019cf30 con 0x7f47e0100500 2023-07-21T22:48:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e7bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e019d0a0 con 0x7f47e00ffb50 2023-07-21T22:48:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e7bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e019d260 con 0x7f47e0105b80 2023-07-21T22:48:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e519a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e0100500 0x7f47e0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e599b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00ffb50 0x7f47e0197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e519a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e0100500 0x7f47e0198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34474/0 (socket says 172.21.15.151:34474) 2023-07-21T22:48:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e519a700 1 -- 172.21.15.151:0/998266518 learned_addr learned my addr 172.21.15.151:0/998266518 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e619c700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47e0105b80 0x7f47e019c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e519a700 1 -- 172.21.15.151:0/998266518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47e0105b80 msgr2=0x7f47e019c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e519a700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47e0105b80 0x7f47e019c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e519a700 1 -- 172.21.15.151:0/998266518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00ffb50 msgr2=0x7f47e0197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:49.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e519a700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00ffb50 0x7f47e0197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e519a700 1 -- 172.21.15.151:0/998266518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8009c40 con 0x7f47e0100500 2023-07-21T22:48:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.546+0000 7f47e599b700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00ffb50 0x7f47e0197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:48:49.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.547+0000 7f47e519a700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e0100500 0x7f47e0198280 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f47d0000c00 tx=0x7f47d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.547+0000 7f47d6ffd700 1 -- 172.21.15.151:0/998266518 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d001d070 con 0x7f47e0100500 2023-07-21T22:48:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.547+0000 7f47e7bff700 1 -- 172.21.15.151:0/998266518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d00095f0 con 0x7f47e0100500 2023-07-21T22:48:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.547+0000 7f47d6ffd700 1 -- 172.21.15.151:0/998266518 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47d0022470 con 0x7f47e0100500 2023-07-21T22:48:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.547+0000 7f47d6ffd700 1 -- 172.21.15.151:0/998266518 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0017650 con 0x7f47e0100500 2023-07-21T22:48:49.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.547+0000 7f47e7bff700 1 -- 172.21.15.151:0/998266518 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e01a4ba0 con 0x7f47e0100500 2023-07-21T22:48:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.551+0000 7f47d6ffd700 1 -- 172.21.15.151:0/998266518 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f47d00225e0 con 0x7f47e0100500 2023-07-21T22:48:49.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.552+0000 7f47fb47eb80 1 Processor -- start 2023-07-21T22:48:49.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.552+0000 7f47fb47eb80 1 -- start start 2023-07-21T22:48:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.552+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.552+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.552+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.552+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd3b3c50 con 0x55d5cd30a6b0 2023-07-21T22:48:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.552+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd4069e0 con 0x55d5cd4b4660 2023-07-21T22:48:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.552+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd3ffe70 con 0x55d5cd4b4210 2023-07-21T22:48:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e599b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e619c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e599b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60456/0 (socket says 172.21.15.151:60456) 2023-07-21T22:48:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e599b700 1 -- 172.21.15.151:0/4255463139 learned_addr learned my addr 172.21.15.151:0/4255463139 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e519a700 1 --2- 172.21.15.151:0/4255463139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47d6ffd700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47cc0a12c0 0x7f47cc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e599b700 1 -- 172.21.15.151:0/4255463139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 msgr2=0x55d5cd4ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e599b700 1 --2- 172.21.15.151:0/4255463139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e599b700 1 -- 172.21.15.151:0/4255463139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 msgr2=0x55d5cd4b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e599b700 1 --2- 172.21.15.151:0/4255463139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47e599b700 1 -- 172.21.15.151:0/4255463139 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5cd22dd80 con 0x55d5cd4b4210 2023-07-21T22:48:49.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.553+0000 7f47d6ffd700 1 -- 172.21.15.151:0/998266518 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47d00ce100 con 0x7f47e0100500 2023-07-21T22:48:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.554+0000 7f47e619c700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47cc0a12c0 0x7f47cc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.554+0000 7f47e599b700 1 --2- 172.21.15.151:0/4255463139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0115f0 tx=0x7f47dc011900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f76c9897977d7239 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.554+0000 7f47cbfff700 1 -- 172.21.15.151:0/4255463139 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc019630 con 0x55d5cd4b4210 2023-07-21T22:48:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.554+0000 7f47cbfff700 1 -- 172.21.15.151:0/4255463139 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47dc019c20 con 0x55d5cd4b4210 2023-07-21T22:48:49.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.554+0000 7f47cbfff700 1 -- 172.21.15.151:0/4255463139 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00eb30 con 0x55d5cd4b4210 2023-07-21T22:48:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4255463139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 msgr2=0x55d5cd4adf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47e619c700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47cc0a12c0 0x7f47cc0a3770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009fd0 tx=0x7f47d8004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4255463139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0115f0 tx=0x7f47dc011900 comp rx=0 tx=0).stop 2023-07-21T22:48:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4255463139 shutdown_connections 2023-07-21T22:48:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4255463139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4255463139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4255463139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4255463139 >> 172.21.15.151:0/4255463139 conn(0x55d5cd4a3ae0 msgr2=0x55d5cd4a90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4255463139 shutdown_connections 2023-07-21T22:48:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.555+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4255463139 wait complete. 2023-07-21T22:48:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.556+0000 7f47fb47eb80 1 -- start start 2023-07-21T22:48:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.556+0000 7f47fb47eb80 1 Processor -- start 2023-07-21T22:48:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.556+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b7940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.556+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4b7e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.556+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4660 0x55d5cd4b83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.556+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd39fa60 con 0x55d5cd4b4660 2023-07-21T22:48:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.556+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd39f760 con 0x55d5cd30a6b0 2023-07-21T22:48:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.556+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd2838c0 con 0x55d5cd4b4210 2023-07-21T22:48:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.556+0000 7f47fb47eb80 10 client.0 _ll_register_callbacks cb 0x55d5cd39d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:48:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e619c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4660 0x55d5cd4b83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e599b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e619c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4660 0x55d5cd4b83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34486/0 (socket says 172.21.15.151:34486) 2023-07-21T22:48:49.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e519a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4b7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e619c700 1 -- 172.21.15.151:0/4126441205 learned_addr learned my addr 172.21.15.151:0/4126441205 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e599b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b7940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:58434/0 (socket says 172.21.15.151:58434) 2023-07-21T22:48:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e599b700 1 -- 172.21.15.151:0/4126441205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 msgr2=0x55d5cd4b7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e599b700 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4b7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e599b700 1 -- 172.21.15.151:0/4126441205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4660 msgr2=0x55d5cd4b83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e599b700 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4660 0x55d5cd4b83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e599b700 1 -- 172.21.15.151:0/4126441205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47dc009d50 con 0x55d5cd30a6b0 2023-07-21T22:48:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47e599b700 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b7940 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0115c0 tx=0x7f47dc005d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1639c9fdff43b76 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.557+0000 7f47c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:48:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.558+0000 7f47c97fa700 1 -- 172.21.15.151:0/4126441205 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc019840 con 0x55d5cd30a6b0 2023-07-21T22:48:49.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.558+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4126441205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d5cd359490 con 0x55d5cd30a6b0 2023-07-21T22:48:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.558+0000 7f47c97fa700 1 -- 172.21.15.151:0/4126441205 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47dc01ae20 con 0x55d5cd30a6b0 2023-07-21T22:48:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.558+0000 7f47c97fa700 1 -- 172.21.15.151:0/4126441205 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47dc0199a0 con 0x55d5cd30a6b0 2023-07-21T22:48:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.558+0000 7f47fb47eb80 10 client.28355 fetch_fsmap learned FSMap version 91 2023-07-21T22:48:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.558+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4126441205 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55d5cd216c00 con 0x55d5cd30a6b0 2023-07-21T22:48:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.558+0000 7f47c97fa700 1 -- 172.21.15.151:0/4126441205 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d5cd359490 con 0x55d5cd30a6b0 2023-07-21T22:48:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.559+0000 7f47c97fa700 1 -- 172.21.15.151:0/4126441205 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47dc025590 con 0x55d5cd30a6b0 2023-07-21T22:48:49.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.559+0000 7f47fb47eb80 10 client.28355 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:48:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.559+0000 7f47fb47eb80 10 client.28355 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:48:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.559+0000 7f47fb47eb80 20 client.28355 populate_metadata read hostname 'smithi151' 2023-07-21T22:48:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.559+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d5cd4c7ab0 0x55d5cd4c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.559+0000 7f47fb47eb80 4 client.28355 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:48:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.559+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4126441205 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d5cd3f8e50 con 0x55d5cd4c7ab0 2023-07-21T22:48:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.559+0000 7f47e519a700 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d5cd4c7ab0 0x55d5cd4c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.560+0000 7f47c97fa700 10 client.28355 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:49.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.560+0000 7f47e519a700 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d5cd4c7ab0 0x55d5cd4c9ec0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb3465f86d56708c server_cookie=7021c9bfb4030b1e in_seq=0 out_seq=0 2023-07-21T22:48:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.560+0000 7f47c97fa700 1 -- 172.21.15.151:0/4126441205 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d5cd3f8e50 con 0x55d5cd4c7ab0 2023-07-21T22:48:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.560+0000 7f47c97fa700 10 client.28355 handle_command_reply: tid=0 2023-07-21T22:48:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.560+0000 7f47fb47eb80 1 client.28355 shutdown 2023-07-21T22:48:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.560+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4126441205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd30a6b0 msgr2=0x55d5cd4b7940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.560+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b7940 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f47dc0115c0 tx=0x7f47dc005d40 comp rx=0 tx=0).stop 2023-07-21T22:48:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4126441205 shutdown_connections 2023-07-21T22:48:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d5cd4c7ab0 0x55d5cd4c9ec0 crc :-1 s=READY pgs=362 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b7940 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4660 0x55d5cd4b83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47c97fa700 0 client.28355 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:49.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4126441205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4b7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4126441205 >> 172.21.15.151:0/4126441205 conn(0x55d5cd4a3ae0 msgr2=0x55d5cd4a83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:49.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4126441205 shutdown_connections 2023-07-21T22:48:49.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4126441205 wait complete. 2023-07-21T22:48:49.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.561+0000 7f47fb47eb80 20 client.28355 trim_cache size 0 max 16384 2023-07-21T22:48:49.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47fb47eb80 1 Processor -- start 2023-07-21T22:48:49.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47fb47eb80 1 -- start start 2023-07-21T22:48:49.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4a8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd4aeb60 con 0x55d5cd30a6b0 2023-07-21T22:48:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd4b2580 con 0x55d5cd4b4660 2023-07-21T22:48:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd4b38c0 con 0x55d5cd4b4210 2023-07-21T22:48:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47e599b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47e599b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b30a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34494/0 (socket says 172.21.15.151:34494) 2023-07-21T22:48:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47e619c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4a8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47e599b700 1 -- 172.21.15.151:0/4200628746 learned_addr learned my addr 172.21.15.151:0/4200628746 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.577+0000 7f47e519a700 1 --2- 172.21.15.151:0/4200628746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.578+0000 7f47e599b700 1 -- 172.21.15.151:0/4200628746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 msgr2=0x55d5cd4adf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.578+0000 7f47e599b700 1 --2- 172.21.15.151:0/4200628746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.578+0000 7f47e599b700 1 -- 172.21.15.151:0/4200628746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 msgr2=0x55d5cd4a8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:49.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.578+0000 7f47e599b700 1 --2- 172.21.15.151:0/4200628746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4a8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.578+0000 7f47e599b700 1 -- 172.21.15.151:0/4200628746 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d5cd2541f0 con 0x55d5cd30a6b0 2023-07-21T22:48:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.578+0000 7f47e599b700 1 --2- 172.21.15.151:0/4200628746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b30a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f47dc000c00 tx=0x7f47dc011900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c6ac411f956394 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.578+0000 7f47d4bff700 1 -- 172.21.15.151:0/4200628746 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc011d00 con 0x55d5cd30a6b0 2023-07-21T22:48:49.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.578+0000 7f47d4bff700 1 -- 172.21.15.151:0/4200628746 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47dc025be0 con 0x55d5cd30a6b0 2023-07-21T22:48:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.578+0000 7f47d4bff700 1 -- 172.21.15.151:0/4200628746 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc005030 con 0x55d5cd30a6b0 2023-07-21T22:48:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.579+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4200628746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 msgr2=0x55d5cd4b30a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.579+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4200628746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b30a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f47dc000c00 tx=0x7f47dc011900 comp rx=0 tx=0).stop 2023-07-21T22:48:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.579+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4200628746 shutdown_connections 2023-07-21T22:48:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.579+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4200628746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4a8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.579+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4200628746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4b30a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.579+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/4200628746 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd4b4210 0x55d5cd4adf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.579+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4200628746 >> 172.21.15.151:0/4200628746 conn(0x55d5cd4a3ae0 msgr2=0x55d5cd4b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.579+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4200628746 shutdown_connections 2023-07-21T22:48:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.579+0000 7f47fb47eb80 1 -- 172.21.15.151:0/4200628746 wait complete. 2023-07-21T22:48:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.580+0000 7f47fb47eb80 1 -- start start 2023-07-21T22:48:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.580+0000 7f47fb47eb80 1 Processor -- start 2023-07-21T22:48:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4be490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4210 0x55d5cd4be9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47fb47eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4bc900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd4bcee0 con 0x55d5cd4b4210 2023-07-21T22:48:49.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd4bd050 con 0x55d5cd4b4660 2023-07-21T22:48:49.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47fb47eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d5cd4bd210 con 0x55d5cd30a6b0 2023-07-21T22:48:49.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47fb47eb80 10 client.0 _ll_register_callbacks cb 0x7f47d800e280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:48:49.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e519a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4210 0x55d5cd4be9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e599b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4be490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e599b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4be490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60470/0 (socket says 172.21.15.151:60470) 2023-07-21T22:48:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e599b700 1 -- 172.21.15.151:0/2191780018 learned_addr learned my addr 172.21.15.151:0/2191780018 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:48:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e619c700 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4bc900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e519a700 1 -- 172.21.15.151:0/2191780018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd30a6b0 msgr2=0x55d5cd4be490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e519a700 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4be490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e519a700 1 -- 172.21.15.151:0/2191780018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 msgr2=0x55d5cd4bc900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:48:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e519a700 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4bc900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.581+0000 7f47e519a700 1 -- 172.21.15.151:0/2191780018 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d5cd216c00 con 0x55d5cd4b4210 2023-07-21T22:48:49.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47e599b700 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4be490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:48:49.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47e519a700 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4210 0x55d5cd4be9d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f47d00cb810 tx=0x7f47d00d1b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=662a076a09f313ae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:48:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47c97fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:48:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47c97fa700 1 -- 172.21.15.151:0/2191780018 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d00cbc90 con 0x55d5cd4b4210 2023-07-21T22:48:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47fb47eb80 1 -- 172.21.15.151:0/2191780018 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47dc019c20 con 0x55d5cd4b4210 2023-07-21T22:48:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47c97fa700 1 -- 172.21.15.151:0/2191780018 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47d00228c0 con 0x55d5cd4b4210 2023-07-21T22:48:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47c97fa700 1 -- 172.21.15.151:0/2191780018 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=91) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47d009aff0 con 0x55d5cd4b4210 2023-07-21T22:48:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47fb47eb80 10 client.18696 fetch_fsmap learned FSMap version 91 2023-07-21T22:48:49.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47fb47eb80 1 -- 172.21.15.151:0/2191780018 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=91,monmap=4+}) v3 -- 0x55d5cd22c250 con 0x55d5cd4b4210 2023-07-21T22:48:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.582+0000 7f47c97fa700 1 -- 172.21.15.151:0/2191780018 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47d00aee90 con 0x55d5cd4b4210 2023-07-21T22:48:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.583+0000 7f47c97fa700 1 -- 172.21.15.151:0/2191780018 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 91) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f47d00d1760 con 0x55d5cd4b4210 2023-07-21T22:48:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.583+0000 7f47fb47eb80 10 client.18696 fetch_fsmap finished waiting for FSMap version 91 2023-07-21T22:48:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.583+0000 7f47fb47eb80 10 client.18696 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:48:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.583+0000 7f47fb47eb80 20 client.18696 populate_metadata read hostname 'smithi151' 2023-07-21T22:48:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.583+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d5cd51c6e0 0x55d5cd51eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:48:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.583+0000 7f47fb47eb80 4 client.18696 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:48:49.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.583+0000 7f47fb47eb80 1 -- 172.21.15.151:0/2191780018 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d5cd3baff0 con 0x55d5cd51c6e0 2023-07-21T22:48:49.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.583+0000 7f47e599b700 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d5cd51c6e0 0x55d5cd51eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:48:49.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.584+0000 7f47c97fa700 10 client.18696 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:49.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.584+0000 7f47e599b700 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d5cd51c6e0 0x55d5cd51eaf0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95ce49d25d6a738e server_cookie=4e9a9c7b56c5c56d in_seq=0 out_seq=0 2023-07-21T22:48:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47c97fa700 1 -- 172.21.15.151:0/2191780018 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d5cd3baff0 con 0x55d5cd51c6e0 2023-07-21T22:48:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47c97fa700 10 client.18696 handle_command_reply: tid=0 2023-07-21T22:48:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 client.18696 shutdown 2023-07-21T22:48:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 -- 172.21.15.151:0/2191780018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4210 msgr2=0x55d5cd4be9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4210 0x55d5cd4be9d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f47d00cb810 tx=0x7f47d00d1b70 comp rx=0 tx=0).stop 2023-07-21T22:48:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 -- 172.21.15.151:0/2191780018 shutdown_connections 2023-07-21T22:48:49.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d5cd51c6e0 0x55d5cd51eaf0 crc :-1 s=READY pgs=363 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d5cd4b4660 0x55d5cd4bc900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47c97fa700 0 client.18696 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:48:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d5cd30a6b0 0x55d5cd4be490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 --2- 172.21.15.151:0/2191780018 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d5cd4b4210 0x55d5cd4be9d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 -- 172.21.15.151:0/2191780018 >> 172.21.15.151:0/2191780018 conn(0x55d5cd4a3ae0 msgr2=0x55d5cd4b4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 -- 172.21.15.151:0/2191780018 shutdown_connections 2023-07-21T22:48:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 1 -- 172.21.15.151:0/2191780018 wait complete. 2023-07-21T22:48:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.596+0000 7f47fb47eb80 20 client.18696 trim_cache size 0 max 16384 2023-07-21T22:48:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:48:49.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:48:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:48:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:48:49.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 -- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47cc0a12c0 msgr2=0x7f47cc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47cc0a12c0 0x7f47cc0a3770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f47d8009fd0 tx=0x7f47d8004ad0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 -- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e0100500 msgr2=0x7f47e0198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:48:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e0100500 0x7f47e0198280 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f47d0000c00 tx=0x7f47d0004730 comp rx=0 tx=0).stop 2023-07-21T22:48:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 -- 172.21.15.151:0/998266518 shutdown_connections 2023-07-21T22:48:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47cc0a12c0 0x7f47cc0a3770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e00ffb50 0x7f47e0197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47e0105b80 0x7f47e019c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 --2- 172.21.15.151:0/998266518 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47e0100500 0x7f47e0198280 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:48:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 -- 172.21.15.151:0/998266518 >> 172.21.15.151:0/998266518 conn(0x7f47e00fb650 msgr2=0x7f47e010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:48:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 -- 172.21.15.151:0/998266518 shutdown_connections 2023-07-21T22:48:49.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:48:49.597+0000 7f47e7bff700 1 -- 172.21.15.151:0/998266518 wait complete. 2023-07-21T22:48:51.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:50 smithi187 ceph-mon[96918]: pgmap v938: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 283 op/s 2023-07-21T22:48:51.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:50 smithi195 ceph-mon[97365]: pgmap v938: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 283 op/s 2023-07-21T22:48:51.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:50 smithi151 ceph-mon[95510]: pgmap v938: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 283 op/s 2023-07-21T22:48:52.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:52 smithi151 ceph-mon[95510]: pgmap v939: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 283 op/s 2023-07-21T22:48:53.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:52 smithi187 ceph-mon[96918]: pgmap v939: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 283 op/s 2023-07-21T22:48:53.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:52 smithi195 ceph-mon[97365]: pgmap v939: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 2.2 MiB/s wr, 283 op/s 2023-07-21T22:48:54.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:54 smithi151 ceph-mon[95510]: pgmap v940: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:48:55.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:54 smithi187 ceph-mon[96918]: pgmap v940: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:48:55.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:54 smithi195 ceph-mon[97365]: pgmap v940: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 3.3 MiB/s wr, 430 op/s 2023-07-21T22:48:56.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:55 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:48:56.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:55 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:48:56.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:55 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:48:57.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:56 smithi187 ceph-mon[96918]: pgmap v941: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.2 MiB/s wr, 294 op/s 2023-07-21T22:48:57.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:56 smithi195 ceph-mon[97365]: pgmap v941: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.2 MiB/s wr, 294 op/s 2023-07-21T22:48:57.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:56 smithi151 ceph-mon[95510]: pgmap v941: 97 pgs: 97 active+clean; 8.1 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.2 MiB/s wr, 294 op/s 2023-07-21T22:48:59.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:48:58 smithi187 ceph-mon[96918]: pgmap v942: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 386 op/s 2023-07-21T22:48:59.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:48:58 smithi195 ceph-mon[97365]: pgmap v942: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 386 op/s 2023-07-21T22:48:59.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:48:58 smithi151 ceph-mon[95510]: pgmap v942: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.3 MiB/s wr, 386 op/s 2023-07-21T22:49:01.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:00 smithi187 ceph-mon[96918]: pgmap v943: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.2 MiB/s wr, 238 op/s 2023-07-21T22:49:01.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:00 smithi195 ceph-mon[97365]: pgmap v943: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.2 MiB/s wr, 238 op/s 2023-07-21T22:49:01.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:00 smithi151 ceph-mon[95510]: pgmap v943: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.2 MiB/s wr, 238 op/s 2023-07-21T22:49:02.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.764+0000 7ff46d3ff700 1 -- 172.21.15.151:0/2147537172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4681004e0 msgr2=0x7ff46810c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.764+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/2147537172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4681004e0 0x7ff46810c920 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7ff46000b0a0 tx=0x7ff46000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.765+0000 7ff46d3ff700 1 -- 172.21.15.151:0/2147537172 shutdown_connections 2023-07-21T22:49:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.765+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/2147537172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff468105b60 0x7ff468105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.765+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/2147537172 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4681004e0 0x7ff46810c920 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.765+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/2147537172 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4680ffb30 0x7ff4680fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.765+0000 7ff46d3ff700 1 -- 172.21.15.151:0/2147537172 >> 172.21.15.151:0/2147537172 conn(0x7ff4680fb5f0 msgr2=0x7ff4680fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.765+0000 7ff46d3ff700 1 -- 172.21.15.151:0/2147537172 shutdown_connections 2023-07-21T22:49:02.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.765+0000 7ff46d3ff700 1 -- 172.21.15.151:0/2147537172 wait complete. 2023-07-21T22:49:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.766+0000 7ff46d3ff700 1 Processor -- start 2023-07-21T22:49:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.766+0000 7ff46d3ff700 1 -- start start 2023-07-21T22:49:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.766+0000 7ff46d3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4680ffb30 0x7ff468197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.766+0000 7ff46d3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4681004e0 0x7ff4681982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.766+0000 7ff46d3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff468105b60 0x7ff46819c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.766+0000 7ff46d3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46819cf60 con 0x7ff468105b60 2023-07-21T22:49:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.766+0000 7ff46d3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46819d0d0 con 0x7ff4680ffb30 2023-07-21T22:49:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.766+0000 7ff46d3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff46819d290 con 0x7ff4681004e0 2023-07-21T22:49:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff466ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4680ffb30 0x7ff468197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff4667fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4681004e0 0x7ff4681982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff468105b60 0x7ff46819c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff466ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4680ffb30 0x7ff468197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54640/0 (socket says 172.21.15.151:54640) 2023-07-21T22:49:02.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff466ffd700 1 -- 172.21.15.151:0/1091038781 learned_addr learned my addr 172.21.15.151:0/1091038781 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff4677fe700 1 -- 172.21.15.151:0/1091038781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4681004e0 msgr2=0x7ff4681982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff4677fe700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4681004e0 0x7ff4681982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff4677fe700 1 -- 172.21.15.151:0/1091038781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4680ffb30 msgr2=0x7ff468197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff4677fe700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4680ffb30 0x7ff468197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff4677fe700 1 -- 172.21.15.151:0/1091038781 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff460009d00 con 0x7ff468105b60 2023-07-21T22:49:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.767+0000 7ff4677fe700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff468105b60 0x7ff46819c920 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff460009fd0 tx=0x7ff46000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.768+0000 7ff44ffff700 1 -- 172.21.15.151:0/1091038781 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46000e040 con 0x7ff468105b60 2023-07-21T22:49:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.768+0000 7ff46d3ff700 1 -- 172.21.15.151:0/1091038781 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff46819d510 con 0x7ff468105b60 2023-07-21T22:49:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.768+0000 7ff44ffff700 1 -- 172.21.15.151:0/1091038781 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff460009480 con 0x7ff468105b60 2023-07-21T22:49:02.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.768+0000 7ff44ffff700 1 -- 172.21.15.151:0/1091038781 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600052a0 con 0x7ff468105b60 2023-07-21T22:49:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.768+0000 7ff46d3ff700 1 -- 172.21.15.151:0/1091038781 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4681a4db0 con 0x7ff468105b60 2023-07-21T22:49:02.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.771+0000 7ff44ffff700 1 -- 172.21.15.151:0/1091038781 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff46001d480 con 0x7ff468105b60 2023-07-21T22:49:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.773+0000 7ff480ce1b80 1 Processor -- start 2023-07-21T22:49:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff480ce1b80 1 -- start start 2023-07-21T22:49:02.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff44ffff700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff4500a1340 0x7ff4500a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 0x55aea947acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff44ffff700 1 -- 172.21.15.151:0/1091038781 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff4600cdd60 con 0x7ff468105b60 2023-07-21T22:49:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b210 0x55aea9474f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b660 0x55aea94754a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea937ac50 con 0x55aea947b210 2023-07-21T22:49:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea93cd9e0 con 0x55aea947b660 2023-07-21T22:49:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea93c6e70 con 0x55aea92d16b0 2023-07-21T22:49:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff4667fc700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff4500a1340 0x7ff4500a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b660 0x55aea94754a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff4667fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b210 0x55aea9474f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.774+0000 7ff466ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 0x55aea947acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b660 0x55aea94754a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54642/0 (socket says 172.21.15.151:54642) 2023-07-21T22:49:02.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff4677fe700 1 -- 172.21.15.151:0/2980420276 learned_addr learned my addr 172.21.15.151:0/2980420276 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:02.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff4677fe700 1 -- 172.21.15.151:0/2980420276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 msgr2=0x55aea947acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:02.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff4677fe700 1 --2- 172.21.15.151:0/2980420276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 0x55aea947acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff4677fe700 1 -- 172.21.15.151:0/2980420276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b210 msgr2=0x55aea9474f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff4677fe700 1 --2- 172.21.15.151:0/2980420276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b210 0x55aea9474f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff4677fe700 1 -- 172.21.15.151:0/2980420276 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aea91f4d80 con 0x55aea947b660 2023-07-21T22:49:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff466ffd700 1 --2- 172.21.15.151:0/2980420276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 0x55aea947acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:49:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff4667fc700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff4500a1340 0x7ff4500a37f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff468199590 tx=0x7ff45c009bf0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff4677fe700 1 --2- 172.21.15.151:0/2980420276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b660 0x55aea94754a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff4600a2d10 tx=0x7ff46000bf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14d0782c31c1d95e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff44d7fa700 1 -- 172.21.15.151:0/2980420276 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46009ae80 con 0x55aea947b660 2023-07-21T22:49:02.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.775+0000 7ff44d7fa700 1 -- 172.21.15.151:0/2980420276 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff46009eeb0 con 0x55aea947b660 2023-07-21T22:49:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.776+0000 7ff44d7fa700 1 -- 172.21.15.151:0/2980420276 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff46009b370 con 0x55aea947b660 2023-07-21T22:49:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.776+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2980420276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b660 msgr2=0x55aea94754a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.776+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2980420276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b660 0x55aea94754a0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7ff4600a2d10 tx=0x7ff46000bf10 comp rx=0 tx=0).stop 2023-07-21T22:49:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.776+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2980420276 shutdown_connections 2023-07-21T22:49:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.776+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2980420276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b660 0x55aea94754a0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.776+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2980420276 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 0x55aea947acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.776+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2980420276 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b210 0x55aea9474f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.776+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2980420276 >> 172.21.15.151:0/2980420276 conn(0x55aea946aae0 msgr2=0x55aea94700e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.776+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2980420276 shutdown_connections 2023-07-21T22:49:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.777+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2980420276 wait complete. 2023-07-21T22:49:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.777+0000 7ff480ce1b80 1 -- start start 2023-07-21T22:49:02.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.777+0000 7ff480ce1b80 1 Processor -- start 2023-07-21T22:49:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 0x55aea94843c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9484900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b660 0x55aea947e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea9366a60 con 0x55aea947b660 2023-07-21T22:49:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea9366760 con 0x55aea947b210 2023-07-21T22:49:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea924a8c0 con 0x55aea92d16b0 2023-07-21T22:49:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff480ce1b80 10 client.0 _ll_register_callbacks cb 0x55aea9364700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b660 0x55aea947e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff4677fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b660 0x55aea947e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45782/0 (socket says 172.21.15.151:45782) 2023-07-21T22:49:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff4677fe700 1 -- 172.21.15.151:0/2971404812 learned_addr learned my addr 172.21.15.151:0/2971404812 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.778+0000 7ff466ffd700 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 0x55aea94843c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff4667fc700 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9484900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff4677fe700 1 -- 172.21.15.151:0/2971404812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 msgr2=0x55aea94843c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff4677fe700 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 0x55aea94843c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff4677fe700 1 -- 172.21.15.151:0/2971404812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 msgr2=0x55aea9484900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff4677fe700 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9484900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff4677fe700 1 -- 172.21.15.151:0/2971404812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4580078d0 con 0x55aea947b660 2023-07-21T22:49:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff4677fe700 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b660 0x55aea947e6c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff460007a00 tx=0x7ff460007550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad0ecc889905ecc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff44aff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:49:02.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff44aff5700 1 -- 172.21.15.151:0/2971404812 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4600a3240 con 0x55aea947b660 2023-07-21T22:49:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff44aff5700 1 -- 172.21.15.151:0/2971404812 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff46009ae80 con 0x55aea947b660 2023-07-21T22:49:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.779+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2971404812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55aea9320490 con 0x55aea947b660 2023-07-21T22:49:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff44aff5700 1 -- 172.21.15.151:0/2971404812 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff46009a580 con 0x55aea947b660 2023-07-21T22:49:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff480ce1b80 10 client.18708 fetch_fsmap learned FSMap version 92 2023-07-21T22:49:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2971404812 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x7ff4681a4db0 con 0x55aea947b660 2023-07-21T22:49:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff44aff5700 1 -- 172.21.15.151:0/2971404812 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55aea9320490 con 0x55aea947b660 2023-07-21T22:49:02.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff44aff5700 1 -- 172.21.15.151:0/2971404812 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 92) v1 ==== 7466+0+0 (secure 0 0 0) 0x7ff4600cbbc0 con 0x55aea947b660 2023-07-21T22:49:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff480ce1b80 10 client.18708 fetch_fsmap finished waiting for FSMap version 92 2023-07-21T22:49:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff480ce1b80 10 client.18708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff480ce1b80 20 client.18708 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aea948e3d0 0x55aea94907e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff480ce1b80 4 client.18708 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:49:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.780+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2971404812 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55aea93bfe50 con 0x55aea948e3d0 2023-07-21T22:49:02.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.781+0000 7ff466ffd700 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aea948e3d0 0x55aea94907e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.781+0000 7ff44aff5700 10 client.18708 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.781+0000 7ff466ffd700 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aea948e3d0 0x55aea94907e0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13ccb10977c35f35 server_cookie=a44759397f4aecd2 in_seq=0 out_seq=0 2023-07-21T22:49:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff44aff5700 1 -- 172.21.15.151:0/2971404812 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55aea93bfe50 con 0x55aea948e3d0 2023-07-21T22:49:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff44aff5700 10 client.18708 handle_command_reply: tid=0 2023-07-21T22:49:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff480ce1b80 1 client.18708 shutdown 2023-07-21T22:49:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2971404812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b660 msgr2=0x55aea947e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b660 0x55aea947e6c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7ff460007a00 tx=0x7ff460007550 comp rx=0 tx=0).stop 2023-07-21T22:49:02.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2971404812 shutdown_connections 2023-07-21T22:49:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aea948e3d0 0x55aea94907e0 crc :-1 s=READY pgs=364 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea947b660 0x55aea947e6c0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea92d16b0 0x55aea94843c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/2971404812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9484900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2971404812 >> 172.21.15.151:0/2971404812 conn(0x55aea946aae0 msgr2=0x55aea946f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.782+0000 7ff44aff5700 0 client.18708 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.783+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2971404812 shutdown_connections 2023-07-21T22:49:02.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.783+0000 7ff480ce1b80 1 -- 172.21.15.151:0/2971404812 wait complete. 2023-07-21T22:49:02.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.783+0000 7ff480ce1b80 20 client.18708 trim_cache size 0 max 16384 2023-07-21T22:49:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.799+0000 7ff480ce1b80 1 Processor -- start 2023-07-21T22:49:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.799+0000 7ff480ce1b80 1 -- start start 2023-07-21T22:49:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea947e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9474f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 0x55aea947ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea9320490 con 0x55aea92d16b0 2023-07-21T22:49:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea9470f80 con 0x55aea947b210 2023-07-21T22:49:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea946cc00 con 0x55aea947b660 2023-07-21T22:49:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff466ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea947e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff466ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea947e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45798/0 (socket says 172.21.15.151:45798) 2023-07-21T22:49:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff466ffd700 1 -- 172.21.15.151:0/1738388449 learned_addr learned my addr 172.21.15.151:0/1738388449 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff4667fc700 1 --2- 172.21.15.151:0/1738388449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9474f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff4677fe700 1 --2- 172.21.15.151:0/1738388449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 0x55aea947ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff466ffd700 1 -- 172.21.15.151:0/1738388449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 msgr2=0x55aea947ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff466ffd700 1 --2- 172.21.15.151:0/1738388449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 0x55aea947ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff466ffd700 1 -- 172.21.15.151:0/1738388449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 msgr2=0x55aea9474f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff466ffd700 1 --2- 172.21.15.151:0/1738388449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9474f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.800+0000 7ff466ffd700 1 -- 172.21.15.151:0/1738388449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55aea9495410 con 0x55aea92d16b0 2023-07-21T22:49:02.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.801+0000 7ff466ffd700 1 --2- 172.21.15.151:0/1738388449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea947e670 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff45801fe30 tx=0x7ff458007480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=deb3f6987738c682 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.801+0000 7ff44dffb700 1 -- 172.21.15.151:0/1738388449 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458016070 con 0x55aea92d16b0 2023-07-21T22:49:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.801+0000 7ff44dffb700 1 -- 172.21.15.151:0/1738388449 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff458017040 con 0x55aea92d16b0 2023-07-21T22:49:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.801+0000 7ff44dffb700 1 -- 172.21.15.151:0/1738388449 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4580038e0 con 0x55aea92d16b0 2023-07-21T22:49:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.802+0000 7ff480ce1b80 1 -- 172.21.15.151:0/1738388449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 msgr2=0x55aea947e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.802+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/1738388449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea947e670 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff45801fe30 tx=0x7ff458007480 comp rx=0 tx=0).stop 2023-07-21T22:49:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.802+0000 7ff480ce1b80 1 -- 172.21.15.151:0/1738388449 shutdown_connections 2023-07-21T22:49:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.802+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/1738388449 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 0x55aea947ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.802+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/1738388449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea947e670 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.802+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/1738388449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9474f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.802+0000 7ff480ce1b80 1 -- 172.21.15.151:0/1738388449 >> 172.21.15.151:0/1738388449 conn(0x55aea946aae0 msgr2=0x55aea947df60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.802+0000 7ff480ce1b80 1 -- 172.21.15.151:0/1738388449 shutdown_connections 2023-07-21T22:49:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.802+0000 7ff480ce1b80 1 -- 172.21.15.151:0/1738388449 wait complete. 2023-07-21T22:49:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.803+0000 7ff480ce1b80 1 -- start start 2023-07-21T22:49:02.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.803+0000 7ff480ce1b80 1 Processor -- start 2023-07-21T22:49:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea9482010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9482550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff480ce1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 0x55aea9482ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea94e1460 con 0x55aea92d16b0 2023-07-21T22:49:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea94e15d0 con 0x55aea947b210 2023-07-21T22:49:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff480ce1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55aea94e1790 con 0x55aea947b660 2023-07-21T22:49:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff480ce1b80 10 client.0 _ll_register_callbacks cb 0x7ff45c011500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff466ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea9482010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff4667fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9482550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff466ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea9482010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45800/0 (socket says 172.21.15.151:45800) 2023-07-21T22:49:02.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff466ffd700 1 -- 172.21.15.151:0/3378286328 learned_addr learned my addr 172.21.15.151:0/3378286328 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff4677fe700 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 0x55aea9482ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.804+0000 7ff466ffd700 1 -- 172.21.15.151:0/3378286328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 msgr2=0x55aea9482ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff466ffd700 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 0x55aea9482ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff466ffd700 1 -- 172.21.15.151:0/3378286328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 msgr2=0x55aea9482550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff466ffd700 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9482550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff466ffd700 1 -- 172.21.15.151:0/3378286328 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff45801fab0 con 0x55aea92d16b0 2023-07-21T22:49:02.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff4677fe700 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 0x55aea9482ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:49:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff4667fc700 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9482550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:49:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff466ffd700 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea9482010 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff458004460 tx=0x7ff458004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=254d22d0c11d6b54 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff44aff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:49:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff44aff5700 1 -- 172.21.15.151:0/3378286328 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff458016070 con 0x55aea92d16b0 2023-07-21T22:49:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff480ce1b80 1 -- 172.21.15.151:0/3378286328 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff46009eeb0 con 0x55aea92d16b0 2023-07-21T22:49:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff44aff5700 1 -- 172.21.15.151:0/3378286328 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(134..134 src has 1..134) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff45801f2d0 con 0x55aea92d16b0 2023-07-21T22:49:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.805+0000 7ff44aff5700 1 -- 172.21.15.151:0/3378286328 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff4580042b0 con 0x55aea92d16b0 2023-07-21T22:49:02.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff480ce1b80 10 client.18714 fetch_fsmap learned FSMap version 92 2023-07-21T22:49:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff480ce1b80 1 -- 172.21.15.151:0/3378286328 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=4+}) v3 -- 0x55aea91ddc00 con 0x55aea92d16b0 2023-07-21T22:49:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff44aff5700 1 -- 172.21.15.151:0/3378286328 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff46009eeb0 con 0x55aea92d16b0 2023-07-21T22:49:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff44aff5700 1 -- 172.21.15.151:0/3378286328 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 92) v1 ==== 7466+0+0 (secure 0 0 0) 0x7ff4580274a0 con 0x55aea92d16b0 2023-07-21T22:49:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff480ce1b80 10 client.18714 fetch_fsmap finished waiting for FSMap version 92 2023-07-21T22:49:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff480ce1b80 10 client.18714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff480ce1b80 20 client.18714 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:02.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aea94e2e50 0x55aea94e5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff480ce1b80 4 client.18714 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:49:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.806+0000 7ff480ce1b80 1 -- 172.21.15.151:0/3378286328 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55aea9381ff0 con 0x55aea94e2e50 2023-07-21T22:49:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.807+0000 7ff4667fc700 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aea94e2e50 0x55aea94e5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.807+0000 7ff4667fc700 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aea94e2e50 0x55aea94e5260 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5ee3521dc0f3e2b server_cookie=4787b5e61f509674 in_seq=0 out_seq=0 2023-07-21T22:49:02.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:02.807+0000 7ff44aff5700 10 client.18714 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:03.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:02 smithi187 ceph-mon[96918]: pgmap v944: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.2 MiB/s wr, 238 op/s 2023-07-21T22:49:03.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:02 smithi195 ceph-mon[97365]: pgmap v944: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.2 MiB/s wr, 238 op/s 2023-07-21T22:49:03.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:02 smithi151 ceph-mon[95510]: pgmap v944: 97 pgs: 97 active+clean; 8.2 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 3.2 MiB/s wr, 238 op/s 2023-07-21T22:49:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff44aff5700 1 -- 172.21.15.151:0/3378286328 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55aea9381ff0 con 0x55aea94e2e50 2023-07-21T22:49:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff44aff5700 10 client.18714 handle_command_reply: tid=0 2023-07-21T22:49:03.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 client.18714 shutdown 2023-07-21T22:49:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 -- 172.21.15.151:0/3378286328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 msgr2=0x55aea9482010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea9482010 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff458004460 tx=0x7ff458004490 comp rx=0 tx=0).stop 2023-07-21T22:49:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 -- 172.21.15.151:0/3378286328 shutdown_connections 2023-07-21T22:49:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55aea94e2e50 0x55aea94e5260 crc :-1 s=READY pgs=365 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55aea947b660 0x55aea9482ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55aea92d16b0 0x55aea9482010 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff44aff5700 0 client.18714 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 --2- 172.21.15.151:0/3378286328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55aea947b210 0x55aea9482550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 -- 172.21.15.151:0/3378286328 >> 172.21.15.151:0/3378286328 conn(0x55aea946aae0 msgr2=0x55aea946eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 -- 172.21.15.151:0/3378286328 shutdown_connections 2023-07-21T22:49:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.656+0000 7ff480ce1b80 1 -- 172.21.15.151:0/3378286328 wait complete. 2023-07-21T22:49:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff480ce1b80 20 client.18714 trim_cache size 0 max 16384 2023-07-21T22:49:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:49:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:49:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:49:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:49:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 -- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff4500a1340 msgr2=0x7ff4500a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff4500a1340 0x7ff4500a37f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7ff468199590 tx=0x7ff45c009bf0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 -- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff468105b60 msgr2=0x7ff46819c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff468105b60 0x7ff46819c920 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7ff460009fd0 tx=0x7ff46000bce0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 -- 172.21.15.151:0/1091038781 shutdown_connections 2023-07-21T22:49:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff4500a1340 0x7ff4500a37f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4680ffb30 0x7ff468197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff468105b60 0x7ff46819c920 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 --2- 172.21.15.151:0/1091038781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff4681004e0 0x7ff4681982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 -- 172.21.15.151:0/1091038781 >> 172.21.15.151:0/1091038781 conn(0x7ff4680fb5f0 msgr2=0x7ff4680fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.657+0000 7ff46d3ff700 1 -- 172.21.15.151:0/1091038781 shutdown_connections 2023-07-21T22:49:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:03.658+0000 7ff46d3ff700 1 -- 172.21.15.151:0/1091038781 wait complete. 2023-07-21T22:49:04.650 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: *** Caught signal (Segmentation fault) ** 2023-07-21T22:49:04.650 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: in thread 7f05bc4a5700 thread_name:md_log_replay 2023-07-21T22:49:04.650 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:49:04.650 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f05cd053cf0] 2023-07-21T22:49:04.650 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2: /usr/bin/ceph-mds(+0x4c4c52) [0x55c86f256c52] 2023-07-21T22:49:04.650 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55c86f258ea3] 2023-07-21T22:49:04.651 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 4: (MDLog::_replay_thread()+0x66d) [0x55c86f2c4ced] 2023-07-21T22:49:04.651 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55c86ef727e1] 2023-07-21T22:49:04.651 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f05cd0491ca] 2023-07-21T22:49:04.651 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 7: clone() 2023-07-21T22:49:04.651 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2023-07-21T22:49:04.140+0000 7f05bc4a5700 -1 *** Caught signal (Segmentation fault) ** 2023-07-21T22:49:04.651 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: in thread 7f05bc4a5700 thread_name:md_log_replay 2023-07-21T22:49:04.651 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2023-07-21T22:49:04.651 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:49:04.652 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f05cd053cf0] 2023-07-21T22:49:04.652 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2: /usr/bin/ceph-mds(+0x4c4c52) [0x55c86f256c52] 2023-07-21T22:49:04.652 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55c86f258ea3] 2023-07-21T22:49:04.652 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 4: (MDLog::_replay_thread()+0x66d) [0x55c86f2c4ced] 2023-07-21T22:49:04.652 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55c86ef727e1] 2023-07-21T22:49:04.652 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f05cd0491ca] 2023-07-21T22:49:04.652 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 7: clone() 2023-07-21T22:49:04.653 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-21T22:49:04.653 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2023-07-21T22:49:04.653 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 0> 2023-07-21T22:49:04.140+0000 7f05bc4a5700 -1 *** Caught signal (Segmentation fault) ** 2023-07-21T22:49:04.653 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: in thread 7f05bc4a5700 thread_name:md_log_replay 2023-07-21T22:49:04.653 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2023-07-21T22:49:04.653 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:49:04.653 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f05cd053cf0] 2023-07-21T22:49:04.653 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2: /usr/bin/ceph-mds(+0x4c4c52) [0x55c86f256c52] 2023-07-21T22:49:04.654 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55c86f258ea3] 2023-07-21T22:49:04.654 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 4: (MDLog::_replay_thread()+0x66d) [0x55c86f2c4ced] 2023-07-21T22:49:04.654 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55c86ef727e1] 2023-07-21T22:49:04.654 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f05cd0491ca] 2023-07-21T22:49:04.654 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 7: clone() 2023-07-21T22:49:04.654 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-21T22:49:04.654 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2023-07-21T22:49:04.654 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 0> 2023-07-21T22:49:04.140+0000 7f05bc4a5700 -1 *** Caught signal (Segmentation fault) ** 2023-07-21T22:49:04.655 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: in thread 7f05bc4a5700 thread_name:md_log_replay 2023-07-21T22:49:04.655 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2023-07-21T22:49:04.655 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:49:04.655 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7f05cd053cf0] 2023-07-21T22:49:04.655 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2: /usr/bin/ceph-mds(+0x4c4c52) [0x55c86f256c52] 2023-07-21T22:49:04.655 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x55c86f258ea3] 2023-07-21T22:49:04.655 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 4: (MDLog::_replay_thread()+0x66d) [0x55c86f2c4ced] 2023-07-21T22:49:04.655 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 5: (MDLog::ReplayThread::entry()+0x11) [0x55c86ef727e1] 2023-07-21T22:49:04.656 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7f05cd0491ca] 2023-07-21T22:49:04.656 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 7: clone() 2023-07-21T22:49:04.656 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-21T22:49:04.656 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[123196]: 2023-07-21T22:49:05.006 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-mon[97365]: pgmap v945: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 16 MiB/s wr, 262 op/s 2023-07-21T22:49:05.007 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:49:05.007 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:04 smithi195 ceph-mon[97365]: osdmap e135: 12 total, 12 up, 12 in 2023-07-21T22:49:05.008 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service: Main process exited, code=exited, status=139/n/a 2023-07-21T22:49:05.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:04 smithi187 ceph-mon[96918]: pgmap v945: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 16 MiB/s wr, 262 op/s 2023-07-21T22:49:05.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:04 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:49:05.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:04 smithi187 ceph-mon[96918]: osdmap e135: 12 total, 12 up, 12 in 2023-07-21T22:49:05.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:04 smithi151 ceph-mon[95510]: pgmap v945: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 16 MiB/s wr, 262 op/s 2023-07-21T22:49:05.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:04 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:49:05.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:04 smithi151 ceph-mon[95510]: osdmap e135: 12 total, 12 up, 12 in 2023-07-21T22:49:05.399 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:04 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service: Failed with result 'exit-code'. 2023-07-21T22:49:07.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:06 smithi187 ceph-mon[96918]: pgmap v947: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 137 op/s 2023-07-21T22:49:07.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:06 smithi195 ceph-mon[97365]: pgmap v947: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 137 op/s 2023-07-21T22:49:07.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:06 smithi151 ceph-mon[95510]: pgmap v947: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 18 MiB/s wr, 137 op/s 2023-07-21T22:49:08.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:07 smithi187 ceph-mon[96918]: pgmap v948: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-21T22:49:08.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:07 smithi195 ceph-mon[97365]: pgmap v948: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-21T22:49:08.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:07 smithi151 ceph-mon[95510]: pgmap v948: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-21T22:49:10.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:10 smithi187 ceph-mon[96918]: pgmap v949: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-21T22:49:10.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:10 smithi195 ceph-mon[97365]: pgmap v949: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-21T22:49:10.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:10 smithi151 ceph-mon[95510]: pgmap v949: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-21T22:49:12.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:12 smithi151 ceph-mon[95510]: pgmap v950: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-21T22:49:12.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:12 smithi151 ceph-mon[95510]: osdmap e136: 12 total, 12 up, 12 in 2023-07-21T22:49:13.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:12 smithi187 ceph-mon[96918]: pgmap v950: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-21T22:49:13.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:12 smithi187 ceph-mon[96918]: osdmap e136: 12 total, 12 up, 12 in 2023-07-21T22:49:13.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:12 smithi195 ceph-mon[97365]: pgmap v950: 97 pgs: 97 active+clean; 8.3 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 31 MiB/s wr, 39 op/s 2023-07-21T22:49:13.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:12 smithi195 ceph-mon[97365]: osdmap e136: 12 total, 12 up, 12 in 2023-07-21T22:49:15.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:14 smithi187 ceph-mon[96918]: pgmap v952: 97 pgs: 97 active+clean; 8.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 32 MiB/s wr, 21 op/s 2023-07-21T22:49:15.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:14 smithi195 ceph-mon[97365]: pgmap v952: 97 pgs: 97 active+clean; 8.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 32 MiB/s wr, 21 op/s 2023-07-21T22:49:15.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:14 smithi151 ceph-mon[95510]: pgmap v952: 97 pgs: 97 active+clean; 8.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 32 MiB/s wr, 21 op/s 2023-07-21T22:49:15.649 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:15 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service: Service RestartSec=10s expired, scheduling restart. 2023-07-21T22:49:15.649 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:15 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service: Scheduled restart job, restart counter is at 1. 2023-07-21T22:49:15.649 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:15 smithi195 systemd[1]: Stopped Ceph mds.f for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:49:15.649 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:15 smithi195 systemd[1]: Starting Ceph mds.f for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:49:15.969 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:15 smithi195 podman[133579]: 2023-07-21T22:49:15.970 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:15 smithi195 bash[133579]: cef075427fc3883aa02d540a71951b779dd7806fec36ca8b84c7fcc54b0d6012 2023-07-21T22:49:16.399 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:15 smithi195 ceph-mds[133619]: -- 172.21.15.195:0/1019994676 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562092d451e0 con 0x562092d1a800 2023-07-21T22:49:16.399 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:15 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: starting mds.f at 2023-07-21T22:49:16.399 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:49:15 smithi195 systemd[1]: Started Ceph mds.f for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:49:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.828+0000 7f0bd61ff700 1 -- 172.21.15.151:0/1071672456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd01004b0 msgr2=0x7f0bd010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.828+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/1071672456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd01004b0 0x7f0bd010c940 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800b0a0 tx=0x7f0bc800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.828+0000 7f0bd61ff700 1 -- 172.21.15.151:0/1071672456 shutdown_connections 2023-07-21T22:49:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.828+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/1071672456 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bd0105b10 0x7f0bd0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.828+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/1071672456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd01004b0 0x7f0bd010c940 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.828+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/1071672456 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bd00ffb00 0x7f0bd00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.828+0000 7f0bd61ff700 1 -- 172.21.15.151:0/1071672456 >> 172.21.15.151:0/1071672456 conn(0x7f0bd00fb600 msgr2=0x7f0bd00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.828+0000 7f0bd61ff700 1 -- 172.21.15.151:0/1071672456 shutdown_connections 2023-07-21T22:49:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.828+0000 7f0bd61ff700 1 -- 172.21.15.151:0/1071672456 wait complete. 2023-07-21T22:49:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.829+0000 7f0bd61ff700 1 Processor -- start 2023-07-21T22:49:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.829+0000 7f0bd61ff700 1 -- start start 2023-07-21T22:49:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bd61ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bd00ffb00 0x7f0bd019bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bd61ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bd01004b0 0x7f0bd019c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bd61ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd0105b10 0x7f0bd0195a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bd61ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd01960b0 con 0x7f0bd0105b10 2023-07-21T22:49:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bd61ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd0196220 con 0x7f0bd01004b0 2023-07-21T22:49:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bd61ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bd01963e0 con 0x7f0bd00ffb00 2023-07-21T22:49:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bcffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd0105b10 0x7f0bd0195a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bcf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bd00ffb00 0x7f0bd019bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bcffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd0105b10 0x7f0bd0195a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38284/0 (socket says 172.21.15.151:38284) 2023-07-21T22:49:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.830+0000 7f0bcffff700 1 -- 172.21.15.151:0/3638882117 learned_addr learned my addr 172.21.15.151:0/3638882117 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bceffd700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bd01004b0 0x7f0bd019c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bcffff700 1 -- 172.21.15.151:0/3638882117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bd00ffb00 msgr2=0x7f0bd019bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bcffff700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bd00ffb00 0x7f0bd019bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bcffff700 1 -- 172.21.15.151:0/3638882117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bd01004b0 msgr2=0x7f0bd019c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bcffff700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bd01004b0 0x7f0bd019c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bcffff700 1 -- 172.21.15.151:0/3638882117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bc8009d00 con 0x7f0bd0105b10 2023-07-21T22:49:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bd00ffb00 0x7f0bd019bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:49:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bceffd700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bd01004b0 0x7f0bd019c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:49:16.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bcffff700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd0105b10 0x7f0bd0195a40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800b070 tx=0x7f0bc800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bccff9700 1 -- 172.21.15.151:0/3638882117 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc800e040 con 0x7f0bd0105b10 2023-07-21T22:49:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bccff9700 1 -- 172.21.15.151:0/3638882117 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bc8009480 con 0x7f0bd0105b10 2023-07-21T22:49:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bd61ff700 1 -- 172.21.15.151:0/3638882117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bd0196660 con 0x7f0bd0105b10 2023-07-21T22:49:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.831+0000 7f0bccff9700 1 -- 172.21.15.151:0/3638882117 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc8005040 con 0x7f0bd0105b10 2023-07-21T22:49:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.832+0000 7f0bd61ff700 1 -- 172.21.15.151:0/3638882117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd01a2bd0 con 0x7f0bd0105b10 2023-07-21T22:49:16.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.835+0000 7f0bccff9700 1 -- 172.21.15.151:0/3638882117 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0bc801d480 con 0x7f0bd0105b10 2023-07-21T22:49:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.837+0000 7f0bccff9700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0bb80a12c0 0x7f0bb80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.837+0000 7f0be9bdab80 1 Processor -- start 2023-07-21T22:49:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.837+0000 7f0bccff9700 1 -- 172.21.15.151:0/3638882117 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0bc80ce040 con 0x7f0bd0105b10 2023-07-21T22:49:16.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.837+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0bb80a12c0 0x7f0bb80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.837+0000 7f0be9bdab80 1 -- start start 2023-07-21T22:49:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4a616b0 0x5577b4c0f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c09350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0bb80a12c0 0x7f0bb80a3770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009fd0 tx=0x7f0bc0009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 0x5577b4c098b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4b0ac50 con 0x5577b4c0f620 2023-07-21T22:49:16.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4b5d9e0 con 0x5577b4a616b0 2023-07-21T22:49:16.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4b56e70 con 0x5577b4c0fa70 2023-07-21T22:49:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0bceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c09350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0bceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c09350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38294/0 (socket says 172.21.15.151:38294) 2023-07-21T22:49:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0bceffd700 1 -- 172.21.15.151:0/3004504982 learned_addr learned my addr 172.21.15.151:0/3004504982 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4a616b0 0x5577b4c0f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.838+0000 7f0bcffff700 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 0x5577b4c098b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bceffd700 1 -- 172.21.15.151:0/3004504982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 msgr2=0x5577b4c098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bceffd700 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 0x5577b4c098b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bceffd700 1 -- 172.21.15.151:0/3004504982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4a616b0 msgr2=0x5577b4c0f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bceffd700 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4a616b0 0x5577b4c0f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bceffd700 1 -- 172.21.15.151:0/3004504982 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577b4984d80 con 0x5577b4c0f620 2023-07-21T22:49:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4a616b0 0x5577b4c0f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:49:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bceffd700 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c09350 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009d80 tx=0x7f0bc40116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfb1ef56f6eb85f8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bb5ffb700 1 -- 172.21.15.151:0/3004504982 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4011e20 con 0x5577b4c0f620 2023-07-21T22:49:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bb5ffb700 1 -- 172.21.15.151:0/3004504982 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bc40128e0 con 0x5577b4c0f620 2023-07-21T22:49:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.839+0000 7f0bb5ffb700 1 -- 172.21.15.151:0/3004504982 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc400f770 con 0x5577b4c0f620 2023-07-21T22:49:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.840+0000 7f0be9bdab80 1 -- 172.21.15.151:0/3004504982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 msgr2=0x5577b4c09350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.840+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c09350 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4009d80 tx=0x7f0bc40116c0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.840+0000 7f0be9bdab80 1 -- 172.21.15.151:0/3004504982 shutdown_connections 2023-07-21T22:49:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.840+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4a616b0 0x5577b4c0f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.840+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 0x5577b4c098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.840+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/3004504982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c09350 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.840+0000 7f0be9bdab80 1 -- 172.21.15.151:0/3004504982 >> 172.21.15.151:0/3004504982 conn(0x5577b4bfaae0 msgr2=0x5577b4c000e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.840+0000 7f0be9bdab80 1 -- 172.21.15.151:0/3004504982 shutdown_connections 2023-07-21T22:49:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.840+0000 7f0be9bdab80 1 -- 172.21.15.151:0/3004504982 wait complete. 2023-07-21T22:49:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.841+0000 7f0be9bdab80 1 -- start start 2023-07-21T22:49:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.841+0000 7f0be9bdab80 1 Processor -- start 2023-07-21T22:49:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4a616b0 0x5577b4c15a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0f620 0x5577b4c12c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 0x5577b4c13370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4af6a60 con 0x5577b4a616b0 2023-07-21T22:49:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4af6760 con 0x5577b4c0f620 2023-07-21T22:49:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b49da8c0 con 0x5577b4c0fa70 2023-07-21T22:49:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0be9bdab80 10 client.0 _ll_register_callbacks cb 0x5577b4af4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bcf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4a616b0 0x5577b4c15a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bcf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4a616b0 0x5577b4c15a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38310/0 (socket says 172.21.15.151:38310) 2023-07-21T22:49:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bcf7fe700 1 -- 172.21.15.151:0/4162405760 learned_addr learned my addr 172.21.15.151:0/4162405760 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bcffff700 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 0x5577b4c13370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bceffd700 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0f620 0x5577b4c12c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bcf7fe700 1 -- 172.21.15.151:0/4162405760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 msgr2=0x5577b4c13370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 0x5577b4c13370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bcf7fe700 1 -- 172.21.15.151:0/4162405760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0f620 msgr2=0x5577b4c12c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0f620 0x5577b4c12c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.842+0000 7f0bcf7fe700 1 -- 172.21.15.151:0/4162405760 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bc0017070 con 0x5577b4a616b0 2023-07-21T22:49:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.843+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4a616b0 0x5577b4c15a00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000eca0 tx=0x7f0bc00047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dca22418bf713e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.843+0000 7f0baeffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:49:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.843+0000 7f0baeffd700 1 -- 172.21.15.151:0/4162405760 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc001fd50 con 0x5577b4a616b0 2023-07-21T22:49:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.843+0000 7f0be9bdab80 1 -- 172.21.15.151:0/4162405760 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5577b4ab0490 con 0x5577b4a616b0 2023-07-21T22:49:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.843+0000 7f0baeffd700 1 -- 172.21.15.151:0/4162405760 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0bc0004050 con 0x5577b4a616b0 2023-07-21T22:49:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.843+0000 7f0baeffd700 1 -- 172.21.15.151:0/4162405760 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bc0004210 con 0x5577b4a616b0 2023-07-21T22:49:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.843+0000 7f0be9bdab80 10 client.18729 fetch_fsmap learned FSMap version 94 2023-07-21T22:49:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.843+0000 7f0be9bdab80 1 -- 172.21.15.151:0/4162405760 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x7f0bc40099b0 con 0x5577b4a616b0 2023-07-21T22:49:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.844+0000 7f0baeffd700 1 -- 172.21.15.151:0/4162405760 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5577b4ab0490 con 0x5577b4a616b0 2023-07-21T22:49:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.844+0000 7f0baeffd700 1 -- 172.21.15.151:0/4162405760 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0bc0032480 con 0x5577b4a616b0 2023-07-21T22:49:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.844+0000 7f0be9bdab80 10 client.18729 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:49:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.844+0000 7f0be9bdab80 10 client.18729 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.844+0000 7f0be9bdab80 20 client.18729 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.844+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5577b4c22fb0 0x5577b4c253c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.844+0000 7f0be9bdab80 4 client.18729 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:49:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.844+0000 7f0be9bdab80 1 -- 172.21.15.151:0/4162405760 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5577b4b4fe50 con 0x5577b4c22fb0 2023-07-21T22:49:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.844+0000 7f0bceffd700 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5577b4c22fb0 0x5577b4c253c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.845+0000 7f0baeffd700 10 client.18729 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.845+0000 7f0bceffd700 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5577b4c22fb0 0x5577b4c253c0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=958a8ee4212e5ed7 server_cookie=cf257ead90accb9f in_seq=0 out_seq=0 2023-07-21T22:49:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0baeffd700 1 -- 172.21.15.151:0/4162405760 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5577b4b4fe50 con 0x5577b4c22fb0 2023-07-21T22:49:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0baeffd700 10 client.18729 handle_command_reply: tid=0 2023-07-21T22:49:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 client.18729 shutdown 2023-07-21T22:49:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 -- 172.21.15.151:0/4162405760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4a616b0 msgr2=0x5577b4c15a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4a616b0 0x5577b4c15a00 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f0bc000eca0 tx=0x7f0bc00047c0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 -- 172.21.15.151:0/4162405760 shutdown_connections 2023-07-21T22:49:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5577b4c22fb0 0x5577b4c253c0 crc :-1 s=READY pgs=367 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4c0fa70 0x5577b4c13370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4a616b0 0x5577b4c15a00 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/4162405760 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0f620 0x5577b4c12c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0baeffd700 0 client.18729 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 -- 172.21.15.151:0/4162405760 >> 172.21.15.151:0/4162405760 conn(0x5577b4bfaae0 msgr2=0x5577b4bff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 -- 172.21.15.151:0/4162405760 shutdown_connections 2023-07-21T22:49:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.846+0000 7f0be9bdab80 1 -- 172.21.15.151:0/4162405760 wait complete. 2023-07-21T22:49:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.847+0000 7f0be9bdab80 20 client.18729 trim_cache size 0 max 16384 2023-07-21T22:49:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.863+0000 7f0be9bdab80 1 Processor -- start 2023-07-21T22:49:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.863+0000 7f0be9bdab80 1 -- start start 2023-07-21T22:49:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 0x5577b4c19fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c155a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 0x5577b4bffb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4c09e80 con 0x5577b4c0f620 2023-07-21T22:49:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4c111e0 con 0x5577b4c0fa70 2023-07-21T22:49:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4c1a4f0 con 0x5577b4a616b0 2023-07-21T22:49:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c155a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c155a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38316/0 (socket says 172.21.15.151:38316) 2023-07-21T22:49:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bcffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 0x5577b4bffb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bceffd700 1 -- 172.21.15.151:0/2795115322 learned_addr learned my addr 172.21.15.151:0/2795115322 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/2795115322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 0x5577b4c19fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bceffd700 1 -- 172.21.15.151:0/2795115322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 msgr2=0x5577b4c19fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bceffd700 1 --2- 172.21.15.151:0/2795115322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 0x5577b4c19fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bceffd700 1 -- 172.21.15.151:0/2795115322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 msgr2=0x5577b4bffb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bceffd700 1 --2- 172.21.15.151:0/2795115322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 0x5577b4bffb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bceffd700 1 -- 172.21.15.151:0/2795115322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5577b496dc00 con 0x5577b4c0f620 2023-07-21T22:49:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.864+0000 7f0bcffff700 1 --2- 172.21.15.151:0/2795115322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 0x5577b4bffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:49:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.865+0000 7f0bceffd700 1 --2- 172.21.15.151:0/2795115322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c155a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4011a10 tx=0x7f0bc4009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1c193215068dd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.865+0000 7f0bb67fc700 1 -- 172.21.15.151:0/2795115322 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4011d40 con 0x5577b4c0f620 2023-07-21T22:49:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.865+0000 7f0bb67fc700 1 -- 172.21.15.151:0/2795115322 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bc4028ae0 con 0x5577b4c0f620 2023-07-21T22:49:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.865+0000 7f0bb67fc700 1 -- 172.21.15.151:0/2795115322 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc40280e0 con 0x5577b4c0f620 2023-07-21T22:49:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.866+0000 7f0be9bdab80 1 -- 172.21.15.151:0/2795115322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 msgr2=0x5577b4c155a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.866+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/2795115322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c155a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4011a10 tx=0x7f0bc4009870 comp rx=0 tx=0).stop 2023-07-21T22:49:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.866+0000 7f0be9bdab80 1 -- 172.21.15.151:0/2795115322 shutdown_connections 2023-07-21T22:49:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.866+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/2795115322 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 0x5577b4bffb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.866+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/2795115322 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 0x5577b4c19fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.866+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/2795115322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c155a0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.866+0000 7f0be9bdab80 1 -- 172.21.15.151:0/2795115322 >> 172.21.15.151:0/2795115322 conn(0x5577b4bfaae0 msgr2=0x5577b4c09350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.866+0000 7f0be9bdab80 1 -- 172.21.15.151:0/2795115322 shutdown_connections 2023-07-21T22:49:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.866+0000 7f0be9bdab80 1 -- 172.21.15.151:0/2795115322 wait complete. 2023-07-21T22:49:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.867+0000 7f0be9bdab80 1 -- start start 2023-07-21T22:49:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.867+0000 7f0be9bdab80 1 Processor -- start 2023-07-21T22:49:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 0x5577b4c198a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c19de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0be9bdab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 0x5577b4c165a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4c16cb0 con 0x5577b4c0f620 2023-07-21T22:49:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4c16e20 con 0x5577b4c0fa70 2023-07-21T22:49:16.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0be9bdab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5577b4c16fe0 con 0x5577b4a616b0 2023-07-21T22:49:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0be9bdab80 10 client.0 _ll_register_callbacks cb 0x7f0bc000eb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c19de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bceffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c19de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38322/0 (socket says 172.21.15.151:38322) 2023-07-21T22:49:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bceffd700 1 -- 172.21.15.151:0/1876062200 learned_addr learned my addr 172.21.15.151:0/1876062200 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bcffff700 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 0x5577b4c165a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 0x5577b4c198a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bceffd700 1 -- 172.21.15.151:0/1876062200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 msgr2=0x5577b4c198a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bceffd700 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 0x5577b4c198a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bceffd700 1 -- 172.21.15.151:0/1876062200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 msgr2=0x5577b4c165a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bceffd700 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 0x5577b4c165a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.868+0000 7f0bceffd700 1 -- 172.21.15.151:0/1876062200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bd01a2bd0 con 0x5577b4c0f620 2023-07-21T22:49:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.869+0000 7f0bceffd700 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c19de0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4011fe0 tx=0x7f0bc4009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3967b52029aabb14 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.869+0000 7f0baeffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:49:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.869+0000 7f0baeffd700 1 -- 172.21.15.151:0/1876062200 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bc4012720 con 0x5577b4c0f620 2023-07-21T22:49:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.869+0000 7f0baeffd700 1 -- 172.21.15.151:0/1876062200 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f0bc4012a50 con 0x5577b4c0f620 2023-07-21T22:49:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.869+0000 7f0be9bdab80 1 -- 172.21.15.151:0/1876062200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0bc40128e0 con 0x5577b4c0f620 2023-07-21T22:49:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0baeffd700 1 -- 172.21.15.151:0/1876062200 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0bc4012c10 con 0x5577b4c0f620 2023-07-21T22:49:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0be9bdab80 10 client.18735 fetch_fsmap learned FSMap version 94 2023-07-21T22:49:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0be9bdab80 1 -- 172.21.15.151:0/1876062200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x5577b4984d80 con 0x5577b4c0f620 2023-07-21T22:49:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0baeffd700 1 -- 172.21.15.151:0/1876062200 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0bc40128e0 con 0x5577b4c0f620 2023-07-21T22:49:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0baeffd700 1 -- 172.21.15.151:0/1876062200 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0bc40053b0 con 0x5577b4c0f620 2023-07-21T22:49:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0be9bdab80 10 client.18735 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:49:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0be9bdab80 10 client.18735 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0be9bdab80 20 client.18735 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5577b4c77a90 0x5577b4c79ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0be9bdab80 4 client.18735 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:49:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.870+0000 7f0be9bdab80 1 -- 172.21.15.151:0/1876062200 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5577b4b11ff0 con 0x5577b4c77a90 2023-07-21T22:49:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.871+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5577b4c77a90 0x5577b4c79ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.871+0000 7f0bcf7fe700 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5577b4c77a90 0x5577b4c79ea0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6737329f1512431 server_cookie=e60731a32c7e8034 in_seq=0 out_seq=0 2023-07-21T22:49:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.871+0000 7f0baeffd700 10 client.18735 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0baeffd700 1 -- 172.21.15.151:0/1876062200 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5577b4b11ff0 con 0x5577b4c77a90 2023-07-21T22:49:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0baeffd700 10 client.18735 handle_command_reply: tid=0 2023-07-21T22:49:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0be9bdab80 1 client.18735 shutdown 2023-07-21T22:49:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0be9bdab80 1 -- 172.21.15.151:0/1876062200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 msgr2=0x5577b4c19de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c19de0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f0bc4011fe0 tx=0x7f0bc4009370 comp rx=0 tx=0).stop 2023-07-21T22:49:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0be9bdab80 1 -- 172.21.15.151:0/1876062200 shutdown_connections 2023-07-21T22:49:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5577b4c77a90 0x5577b4c79ea0 crc :-1 s=READY pgs=368 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5577b4c0fa70 0x5577b4c165a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0baeffd700 0 client.18735 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5577b4a616b0 0x5577b4c198a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0be9bdab80 1 --2- 172.21.15.151:0/1876062200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5577b4c0f620 0x5577b4c19de0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.879+0000 7f0be9bdab80 1 -- 172.21.15.151:0/1876062200 >> 172.21.15.151:0/1876062200 conn(0x5577b4bfaae0 msgr2=0x5577b4c0dd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.880+0000 7f0be9bdab80 1 -- 172.21.15.151:0/1876062200 shutdown_connections 2023-07-21T22:49:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.880+0000 7f0be9bdab80 1 -- 172.21.15.151:0/1876062200 wait complete. 2023-07-21T22:49:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.880+0000 7f0be9bdab80 20 client.18735 trim_cache size 0 max 16384 2023-07-21T22:49:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:49:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:49:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:49:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:49:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 -- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0bb80a12c0 msgr2=0x7f0bb80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0bb80a12c0 0x7f0bb80a3770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f0bc0009fd0 tx=0x7f0bc0009260 comp rx=0 tx=0).stop 2023-07-21T22:49:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 -- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd0105b10 msgr2=0x7f0bd0195a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd0105b10 0x7f0bd0195a40 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800b070 tx=0x7f0bc800bce0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 -- 172.21.15.151:0/3638882117 shutdown_connections 2023-07-21T22:49:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0bb80a12c0 0x7f0bb80a3770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0bd0105b10 0x7f0bd0195a40 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0bd00ffb00 0x7f0bd019bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 --2- 172.21.15.151:0/3638882117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bd01004b0 0x7f0bd019c120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 -- 172.21.15.151:0/3638882117 >> 172.21.15.151:0/3638882117 conn(0x7f0bd00fb600 msgr2=0x7f0bd00fbbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 -- 172.21.15.151:0/3638882117 shutdown_connections 2023-07-21T22:49:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:16.881+0000 7f0bd61ff700 1 -- 172.21.15.151:0/3638882117 wait complete. 2023-07-21T22:49:17.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:16 smithi187 ceph-mon[96918]: pgmap v953: 97 pgs: 97 active+clean; 8.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 31 MiB/s wr, 20 op/s 2023-07-21T22:49:17.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:16 smithi187 ceph-mon[96918]: daemon mds.f restarted 2023-07-21T22:49:17.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:16 smithi187 ceph-mon[96918]: osdmap e137: 12 total, 12 up, 12 in 2023-07-21T22:49:17.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:16 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.195:6834/2138358195,v1:172.21.15.195:6835/2138358195] up:boot 2023-07-21T22:49:17.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:16 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:49:17.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:16 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:49:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:16 smithi195 ceph-mon[97365]: pgmap v953: 97 pgs: 97 active+clean; 8.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 31 MiB/s wr, 20 op/s 2023-07-21T22:49:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:16 smithi195 ceph-mon[97365]: daemon mds.f restarted 2023-07-21T22:49:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:16 smithi195 ceph-mon[97365]: osdmap e137: 12 total, 12 up, 12 in 2023-07-21T22:49:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:16 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.195:6834/2138358195,v1:172.21.15.195:6835/2138358195] up:boot 2023-07-21T22:49:17.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:16 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:49:17.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:16 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:49:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:16 smithi151 ceph-mon[95510]: pgmap v953: 97 pgs: 97 active+clean; 8.5 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 31 MiB/s wr, 20 op/s 2023-07-21T22:49:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:16 smithi151 ceph-mon[95510]: daemon mds.f restarted 2023-07-21T22:49:17.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:16 smithi151 ceph-mon[95510]: osdmap e137: 12 total, 12 up, 12 in 2023-07-21T22:49:17.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:16 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.195:6834/2138358195,v1:172.21.15.195:6835/2138358195] up:boot 2023-07-21T22:49:17.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:16 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:49:17.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:16 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:49:19.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:18 smithi187 ceph-mon[96918]: pgmap v955: 97 pgs: 97 active+clean; 8.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 38 MiB/s wr, 24 op/s 2023-07-21T22:49:19.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:18 smithi195 ceph-mon[97365]: pgmap v955: 97 pgs: 97 active+clean; 8.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 38 MiB/s wr, 24 op/s 2023-07-21T22:49:19.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:18 smithi151 ceph-mon[95510]: pgmap v955: 97 pgs: 97 active+clean; 8.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 38 MiB/s wr, 24 op/s 2023-07-21T22:49:21.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:20 smithi187 ceph-mon[96918]: pgmap v956: 97 pgs: 97 active+clean; 8.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 38 MiB/s wr, 24 op/s 2023-07-21T22:49:21.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:20 smithi195 ceph-mon[97365]: pgmap v956: 97 pgs: 97 active+clean; 8.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 38 MiB/s wr, 24 op/s 2023-07-21T22:49:21.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:20 smithi151 ceph-mon[95510]: pgmap v956: 97 pgs: 97 active+clean; 8.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 38 MiB/s wr, 24 op/s 2023-07-21T22:49:23.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:22 smithi187 ceph-mon[96918]: pgmap v957: 97 pgs: 97 active+clean; 8.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 32 MiB/s wr, 20 op/s 2023-07-21T22:49:23.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:22 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:49:23.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:22 smithi195 ceph-mon[97365]: pgmap v957: 97 pgs: 97 active+clean; 8.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 32 MiB/s wr, 20 op/s 2023-07-21T22:49:23.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:22 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:49:23.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:22 smithi151 ceph-mon[95510]: pgmap v957: 97 pgs: 97 active+clean; 8.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 32 MiB/s wr, 20 op/s 2023-07-21T22:49:23.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:22 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:49:24.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: pgmap v958: 97 pgs: 97 active+clean; 8.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 31 MiB/s wr, 21 op/s 2023-07-21T22:49:24.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:24.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:24.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:24.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:24.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:24.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:24.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:49:24.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:49:24.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: pgmap v958: 97 pgs: 97 active+clean; 8.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 31 MiB/s wr, 21 op/s 2023-07-21T22:49:25.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:49:25.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:49:25.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: pgmap v958: 97 pgs: 97 active+clean; 8.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 31 MiB/s wr, 21 op/s 2023-07-21T22:49:25.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:25.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:49:25.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:49:25.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:49:26.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:26 smithi151 ceph-mon[95510]: pgmap v959: 97 pgs: 97 active+clean; 8.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 31 MiB/s wr, 21 op/s 2023-07-21T22:49:27.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:26 smithi187 ceph-mon[96918]: pgmap v959: 97 pgs: 97 active+clean; 8.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 31 MiB/s wr, 21 op/s 2023-07-21T22:49:27.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:26 smithi195 ceph-mon[97365]: pgmap v959: 97 pgs: 97 active+clean; 8.8 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 31 MiB/s wr, 21 op/s 2023-07-21T22:49:29.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:28 smithi187 ceph-mon[96918]: pgmap v960: 97 pgs: 97 active+clean; 8.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 44 MiB/s wr, 30 op/s 2023-07-21T22:49:29.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:28 smithi195 ceph-mon[97365]: pgmap v960: 97 pgs: 97 active+clean; 8.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 44 MiB/s wr, 30 op/s 2023-07-21T22:49:29.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:28 smithi151 ceph-mon[95510]: pgmap v960: 97 pgs: 97 active+clean; 8.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 44 MiB/s wr, 30 op/s 2023-07-21T22:49:30.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.037+0000 7f845a19d700 1 -- 172.21.15.151:0/2248910751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84541059a0 msgr2=0x7f8454105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.037+0000 7f845a19d700 1 --2- 172.21.15.151:0/2248910751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84541059a0 0x7f8454105d70 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f8450009990 tx=0x7f8450009ca0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.037+0000 7f845a19d700 1 -- 172.21.15.151:0/2248910751 shutdown_connections 2023-07-21T22:49:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.037+0000 7f845a19d700 1 --2- 172.21.15.151:0/2248910751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8454068070 0x7f845410c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.037+0000 7f845a19d700 1 --2- 172.21.15.151:0/2248910751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f84541059a0 0x7f8454105d70 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.037+0000 7f845a19d700 1 --2- 172.21.15.151:0/2248910751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84541062b0 0x7f8454067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.037+0000 7f845a19d700 1 -- 172.21.15.151:0/2248910751 >> 172.21.15.151:0/2248910751 conn(0x7f8454074770 msgr2=0x7f8454074b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:30.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.038+0000 7f845a19d700 1 -- 172.21.15.151:0/2248910751 shutdown_connections 2023-07-21T22:49:30.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.038+0000 7f845a19d700 1 -- 172.21.15.151:0/2248910751 wait complete. 2023-07-21T22:49:30.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.039+0000 7f845a19d700 1 Processor -- start 2023-07-21T22:49:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.039+0000 7f845a19d700 1 -- start start 2023-07-21T22:49:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.040+0000 7f845a19d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454068070 0x7f84541959a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.040+0000 7f845a19d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84541059a0 0x7f8454195ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.040+0000 7f845a19d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84541062b0 0x7f845419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.040+0000 7f845a19d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845419a940 con 0x7f8454068070 2023-07-21T22:49:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.040+0000 7f845a19d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845419aab0 con 0x7f84541059a0 2023-07-21T22:49:30.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.040+0000 7f845a19d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845419ac70 con 0x7f84541062b0 2023-07-21T22:49:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.040+0000 7f845919b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454068070 0x7f84541959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.040+0000 7f845919b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454068070 0x7f84541959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39170/0 (socket says 172.21.15.151:39170) 2023-07-21T22:49:30.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.040+0000 7f845919b700 1 -- 172.21.15.151:0/2760741854 learned_addr learned my addr 172.21.15.151:0/2760741854 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:30.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.041+0000 7f845899a700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84541059a0 0x7f8454195ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.041+0000 7f845919b700 1 -- 172.21.15.151:0/2760741854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84541062b0 msgr2=0x7f845419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:30.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.041+0000 7f845919b700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84541062b0 0x7f845419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.041+0000 7f845919b700 1 -- 172.21.15.151:0/2760741854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84541059a0 msgr2=0x7f8454195ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.041+0000 7f845919b700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84541059a0 0x7f8454195ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.041+0000 7f845919b700 1 -- 172.21.15.151:0/2760741854 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84500095f0 con 0x7f8454068070 2023-07-21T22:49:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.041+0000 7f845919b700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454068070 0x7f84541959a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8450005740 tx=0x7f8450005770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.042+0000 7f844a7fc700 1 -- 172.21.15.151:0/2760741854 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845001d070 con 0x7f8454068070 2023-07-21T22:49:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.042+0000 7f844a7fc700 1 -- 172.21.15.151:0/2760741854 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8450022470 con 0x7f8454068070 2023-07-21T22:49:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.042+0000 7f844a7fc700 1 -- 172.21.15.151:0/2760741854 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8450017650 con 0x7f8454068070 2023-07-21T22:49:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.042+0000 7f845a19d700 1 -- 172.21.15.151:0/2760741854 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845419aef0 con 0x7f8454068070 2023-07-21T22:49:30.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.042+0000 7f845a19d700 1 -- 172.21.15.151:0/2760741854 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845419b1c0 con 0x7f8454068070 2023-07-21T22:49:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.047+0000 7f844a7fc700 1 -- 172.21.15.151:0/2760741854 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f845000fb00 con 0x7f8454068070 2023-07-21T22:49:30.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.048+0000 7f846ec4db80 1 Processor -- start 2023-07-21T22:49:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.049+0000 7f846ec4db80 1 -- start start 2023-07-21T22:49:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.049+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.049+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x5586541a30a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.049+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541a3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.049+0000 7f846ec4db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586540a8c50 con 0x5586541a35e0 2023-07-21T22:49:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.049+0000 7f846ec4db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586540fb9e0 con 0x5586541b0c70 2023-07-21T22:49:30.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.049+0000 7f846ec4db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586540f4e70 con 0x558653fff6b0 2023-07-21T22:49:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.050+0000 7f845999c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.050+0000 7f845999c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:40152/0 (socket says 172.21.15.151:40152) 2023-07-21T22:49:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.050+0000 7f845999c700 1 -- 172.21.15.151:0/3911992834 learned_addr learned my addr 172.21.15.151:0/3911992834 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.050+0000 7f845919b700 1 --2- 172.21.15.151:0/3911992834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x5586541a30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.050+0000 7f845899a700 1 --2- 172.21.15.151:0/3911992834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541a3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.050+0000 7f845999c700 1 -- 172.21.15.151:0/3911992834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 msgr2=0x5586541a30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.050+0000 7f845999c700 1 --2- 172.21.15.151:0/3911992834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x5586541a30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.050+0000 7f845999c700 1 -- 172.21.15.151:0/3911992834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 msgr2=0x5586541a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.050+0000 7f845999c700 1 --2- 172.21.15.151:0/3911992834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541a3a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.051+0000 7f845999c700 1 -- 172.21.15.151:0/3911992834 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558653f22d80 con 0x558653fff6b0 2023-07-21T22:49:30.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.051+0000 7f845999c700 1 --2- 172.21.15.151:0/3911992834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541b0730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f844c00e490 tx=0x7f844c00e7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1ecd26afe254dcf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.051+0000 7f844a7fc700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f84400a1340 0x7f84400a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.052+0000 7f843f7fe700 1 -- 172.21.15.151:0/3911992834 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c018070 con 0x558653fff6b0 2023-07-21T22:49:30.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.052+0000 7f843f7fe700 1 -- 172.21.15.151:0/3911992834 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f844c00f040 con 0x558653fff6b0 2023-07-21T22:49:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.052+0000 7f843f7fe700 1 -- 172.21.15.151:0/3911992834 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c004080 con 0x558653fff6b0 2023-07-21T22:49:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.052+0000 7f844a7fc700 1 -- 172.21.15.151:0/2760741854 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f84500ce190 con 0x7f8454068070 2023-07-21T22:49:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.052+0000 7f845919b700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f84400a1340 0x7f84400a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.053+0000 7f846ec4db80 1 -- 172.21.15.151:0/3911992834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 msgr2=0x5586541b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.053+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3911992834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541b0730 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f844c00e490 tx=0x7f844c00e7a0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.053+0000 7f845919b700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f84400a1340 0x7f84400a37f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f84500cb990 tx=0x7f8450097040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:30.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.053+0000 7f846ec4db80 1 -- 172.21.15.151:0/3911992834 shutdown_connections 2023-07-21T22:49:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.053+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3911992834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541a3a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.053+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3911992834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541b0730 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.053+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3911992834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x5586541a30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.053+0000 7f846ec4db80 1 -- 172.21.15.151:0/3911992834 >> 172.21.15.151:0/3911992834 conn(0x558654198c40 msgr2=0x55865419dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.054+0000 7f846ec4db80 1 -- 172.21.15.151:0/3911992834 shutdown_connections 2023-07-21T22:49:30.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.054+0000 7f846ec4db80 1 -- 172.21.15.151:0/3911992834 wait complete. 2023-07-21T22:49:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.055+0000 7f846ec4db80 1 -- start start 2023-07-21T22:49:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.055+0000 7f846ec4db80 1 Processor -- start 2023-07-21T22:49:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558653fff6b0 0x5586541b5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541b5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541b0c70 0x5586541b5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f846ec4db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558654094a60 con 0x5586541a35e0 2023-07-21T22:49:30.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f846ec4db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558654094760 con 0x558653fff6b0 2023-07-21T22:49:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f846ec4db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558653f788c0 con 0x5586541b0c70 2023-07-21T22:49:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f846ec4db80 10 client.0 _ll_register_callbacks cb 0x558654092700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f845999c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558653fff6b0 0x5586541b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f845999c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558653fff6b0 0x5586541b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36658/0 (socket says 172.21.15.151:36658) 2023-07-21T22:49:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f845999c700 1 -- 172.21.15.151:0/1485988401 learned_addr learned my addr 172.21.15.151:0/1485988401 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:30.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f845899a700 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.056+0000 7f845999c700 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541b0c70 0x5586541b5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.057+0000 7f845999c700 1 -- 172.21.15.151:0/1485988401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541b0c70 msgr2=0x5586541b5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.057+0000 7f845999c700 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541b0c70 0x5586541b5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.057+0000 7f845999c700 1 -- 172.21.15.151:0/1485988401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 msgr2=0x5586541b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.057+0000 7f845999c700 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.057+0000 7f845999c700 1 -- 172.21.15.151:0/1485988401 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f844c00e140 con 0x558653fff6b0 2023-07-21T22:49:30.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.057+0000 7f845999c700 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558653fff6b0 0x5586541b5210 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f844c009550 tx=0x7f844c009e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80df9354a90723a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.057+0000 7f843cff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:49:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.057+0000 7f843cff9700 1 -- 172.21.15.151:0/1485988401 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c018070 con 0x558653fff6b0 2023-07-21T22:49:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.058+0000 7f846ec4db80 1 -- 172.21.15.151:0/1485988401 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55865404e490 con 0x558653fff6b0 2023-07-21T22:49:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.058+0000 7f843cff9700 1 -- 172.21.15.151:0/1485988401 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f844c003c10 con 0x558653fff6b0 2023-07-21T22:49:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.058+0000 7f843cff9700 1 -- 172.21.15.151:0/1485988401 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f844c003dd0 con 0x558653fff6b0 2023-07-21T22:49:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.058+0000 7f846ec4db80 10 client.28415 fetch_fsmap learned FSMap version 94 2023-07-21T22:49:30.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.058+0000 7f846ec4db80 1 -- 172.21.15.151:0/1485988401 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x558653f0bc00 con 0x558653fff6b0 2023-07-21T22:49:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.059+0000 7f843cff9700 1 -- 172.21.15.151:0/1485988401 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55865404e490 con 0x558653fff6b0 2023-07-21T22:49:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.059+0000 7f843cff9700 1 -- 172.21.15.151:0/1485988401 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f844c0076a0 con 0x558653fff6b0 2023-07-21T22:49:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.059+0000 7f846ec4db80 10 client.28415 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:49:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.059+0000 7f846ec4db80 10 client.28415 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.059+0000 7f846ec4db80 20 client.28415 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.059+0000 7f846ec4db80 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5586541cdc70 0x5586541d0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.059+0000 7f846ec4db80 4 client.28415 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:49:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.059+0000 7f846ec4db80 1 -- 172.21.15.151:0/1485988401 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5586540ede50 con 0x5586541cdc70 2023-07-21T22:49:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.059+0000 7f845899a700 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5586541cdc70 0x5586541d0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.060+0000 7f845899a700 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5586541cdc70 0x5586541d0080 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3fe73d4bcd746fc server_cookie=6eb947f951653471 in_seq=0 out_seq=0 2023-07-21T22:49:30.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.060+0000 7f843cff9700 10 client.28415 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f843cff9700 1 -- 172.21.15.151:0/1485988401 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5586540ede50 con 0x5586541cdc70 2023-07-21T22:49:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f843cff9700 10 client.28415 handle_command_reply: tid=0 2023-07-21T22:49:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f846ec4db80 1 client.28415 shutdown 2023-07-21T22:49:30.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f846ec4db80 1 -- 172.21.15.151:0/1485988401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558653fff6b0 msgr2=0x5586541b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f846ec4db80 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558653fff6b0 0x5586541b5210 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f844c009550 tx=0x7f844c009e80 comp rx=0 tx=0).stop 2023-07-21T22:49:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f846ec4db80 1 -- 172.21.15.151:0/1485988401 shutdown_connections 2023-07-21T22:49:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f846ec4db80 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5586541cdc70 0x5586541d0080 crc :-1 s=READY pgs=369 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f846ec4db80 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558653fff6b0 0x5586541b5210 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f846ec4db80 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541b0c70 0x5586541b5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f846ec4db80 1 --2- 172.21.15.151:0/1485988401 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.061+0000 7f846ec4db80 1 -- 172.21.15.151:0/1485988401 >> 172.21.15.151:0/1485988401 conn(0x558654198c40 msgr2=0x55865419d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.062+0000 7f843cff9700 0 client.28415 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.062+0000 7f846ec4db80 1 -- 172.21.15.151:0/1485988401 shutdown_connections 2023-07-21T22:49:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.062+0000 7f846ec4db80 1 -- 172.21.15.151:0/1485988401 wait complete. 2023-07-21T22:49:30.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.062+0000 7f846ec4db80 20 client.28415 trim_cache size 0 max 16384 2023-07-21T22:49:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.080+0000 7f846ec4db80 1 Processor -- start 2023-07-21T22:49:30.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.080+0000 7f846ec4db80 1 -- start start 2023-07-21T22:49:30.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.080+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558653fff6b0 0x5586541a8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.080+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541a35e0 0x5586541b5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.080+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x5586541b2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.080+0000 7f846ec4db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586541b8230 con 0x558653fff6b0 2023-07-21T22:49:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.080+0000 7f846ec4db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5586541b66a0 con 0x5586541b0c70 2023-07-21T22:49:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.080+0000 7f846ec4db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55865419fb90 con 0x5586541a35e0 2023-07-21T22:49:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.080+0000 7f845999c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558653fff6b0 0x5586541a8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845899a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541a35e0 0x5586541b5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845899a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541a35e0 0x5586541b5b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:40156/0 (socket says 172.21.15.151:40156) 2023-07-21T22:49:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845899a700 1 -- 172.21.15.151:0/486297631 learned_addr learned my addr 172.21.15.151:0/486297631 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845999c700 1 --2- 172.21.15.151:0/486297631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x5586541b2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845899a700 1 -- 172.21.15.151:0/486297631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 msgr2=0x5586541b2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845899a700 1 --2- 172.21.15.151:0/486297631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x5586541b2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845899a700 1 -- 172.21.15.151:0/486297631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558653fff6b0 msgr2=0x5586541a8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845899a700 1 --2- 172.21.15.151:0/486297631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558653fff6b0 0x5586541a8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845899a700 1 -- 172.21.15.151:0/486297631 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558653f491f0 con 0x5586541a35e0 2023-07-21T22:49:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845999c700 1 --2- 172.21.15.151:0/486297631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x5586541b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:49:30.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.081+0000 7f845899a700 1 --2- 172.21.15.151:0/486297631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541a35e0 0x5586541b5b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8454196fb0 tx=0x7f844401cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7a1af62d1802bc3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.082+0000 7f843ffff700 1 -- 172.21.15.151:0/486297631 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444017040 con 0x5586541a35e0 2023-07-21T22:49:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.082+0000 7f843ffff700 1 -- 172.21.15.151:0/486297631 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8444020020 con 0x5586541a35e0 2023-07-21T22:49:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.082+0000 7f843ffff700 1 -- 172.21.15.151:0/486297631 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8444003e10 con 0x5586541a35e0 2023-07-21T22:49:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 -- 172.21.15.151:0/486297631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541a35e0 msgr2=0x5586541b5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 --2- 172.21.15.151:0/486297631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541a35e0 0x5586541b5b10 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8454196fb0 tx=0x7f844401cc30 comp rx=0 tx=0).stop 2023-07-21T22:49:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 -- 172.21.15.151:0/486297631 shutdown_connections 2023-07-21T22:49:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 --2- 172.21.15.151:0/486297631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x5586541b2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 --2- 172.21.15.151:0/486297631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558653fff6b0 0x5586541a8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 --2- 172.21.15.151:0/486297631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5586541a35e0 0x5586541b5b10 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 -- 172.21.15.151:0/486297631 >> 172.21.15.151:0/486297631 conn(0x558654198c40 msgr2=0x5586541a27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 -- 172.21.15.151:0/486297631 shutdown_connections 2023-07-21T22:49:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 -- 172.21.15.151:0/486297631 wait complete. 2023-07-21T22:49:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.083+0000 7f846ec4db80 1 -- start start 2023-07-21T22:49:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.084+0000 7f846ec4db80 1 Processor -- start 2023-07-21T22:49:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.084+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541a6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.084+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541a6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.084+0000 7f846ec4db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x558654220af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.084+0000 7f846ec4db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558654221030 con 0x5586541a35e0 2023-07-21T22:49:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.084+0000 7f846ec4db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558654221170 con 0x5586541b0c70 2023-07-21T22:49:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.084+0000 7f846ec4db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558654221300 con 0x558653fff6b0 2023-07-21T22:49:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f846ec4db80 10 client.0 _ll_register_callbacks cb 0x7f844c009340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845999c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845999c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541a6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:40162/0 (socket says 172.21.15.151:40162) 2023-07-21T22:49:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845999c700 1 -- 172.21.15.151:0/3528800408 learned_addr learned my addr 172.21.15.151:0/3528800408 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845899a700 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845999c700 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x558654220af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845999c700 1 -- 172.21.15.151:0/3528800408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 msgr2=0x558654220af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845999c700 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x558654220af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845999c700 1 -- 172.21.15.151:0/3528800408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 msgr2=0x5586541a6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845999c700 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541a6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845999c700 1 -- 172.21.15.151:0/3528800408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8444007a20 con 0x558653fff6b0 2023-07-21T22:49:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.085+0000 7f845899a700 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:49:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.086+0000 7f845999c700 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541a6310 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f844c009450 tx=0x7f844c0021d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=14af9f4259436798 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.086+0000 7f843cff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:49:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.086+0000 7f843cff9700 1 -- 172.21.15.151:0/3528800408 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c018070 con 0x558653fff6b0 2023-07-21T22:49:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.086+0000 7f843cff9700 1 -- 172.21.15.151:0/3528800408 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f844c007700 con 0x558653fff6b0 2023-07-21T22:49:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.086+0000 7f846ec4db80 1 -- 172.21.15.151:0/3528800408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f844c00f040 con 0x558653fff6b0 2023-07-21T22:49:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.086+0000 7f843cff9700 1 -- 172.21.15.151:0/3528800408 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f844c0040a0 con 0x558653fff6b0 2023-07-21T22:49:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.086+0000 7f846ec4db80 10 client.28450 fetch_fsmap learned FSMap version 94 2023-07-21T22:49:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.086+0000 7f846ec4db80 1 -- 172.21.15.151:0/3528800408 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x558653f21250 con 0x558653fff6b0 2023-07-21T22:49:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.087+0000 7f843cff9700 1 -- 172.21.15.151:0/3528800408 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f844c00f040 con 0x558653fff6b0 2023-07-21T22:49:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.087+0000 7f843cff9700 1 -- 172.21.15.151:0/3528800408 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f844c0436e0 con 0x558653fff6b0 2023-07-21T22:49:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.087+0000 7f846ec4db80 10 client.28450 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:49:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.087+0000 7f846ec4db80 10 client.28450 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.087+0000 7f846ec4db80 20 client.28450 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.087+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5586542225f0 0x558654224a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.087+0000 7f846ec4db80 4 client.28450 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:49:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.087+0000 7f846ec4db80 1 -- 172.21.15.151:0/3528800408 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5586540afff0 con 0x5586542225f0 2023-07-21T22:49:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.088+0000 7f845899a700 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5586542225f0 0x558654224a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.088+0000 7f845899a700 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5586542225f0 0x558654224a00 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18b800b14d8b62d1 server_cookie=e0392cfc128facfa in_seq=0 out_seq=0 2023-07-21T22:49:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.088+0000 7f843cff9700 10 client.28450 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.096+0000 7f843cff9700 1 -- 172.21.15.151:0/3528800408 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5586540afff0 con 0x5586542225f0 2023-07-21T22:49:30.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.096+0000 7f843cff9700 10 client.28450 handle_command_reply: tid=0 2023-07-21T22:49:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.096+0000 7f846ec4db80 1 client.28450 shutdown 2023-07-21T22:49:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.096+0000 7f846ec4db80 1 -- 172.21.15.151:0/3528800408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 msgr2=0x5586541a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.096+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541a6310 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f844c009450 tx=0x7f844c0021d0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f846ec4db80 1 -- 172.21.15.151:0/3528800408 shutdown_connections 2023-07-21T22:49:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5586542225f0 0x558654224a00 crc :-1 s=READY pgs=370 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5586541b0c70 0x558654220af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558653fff6b0 0x5586541a6310 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f846ec4db80 1 --2- 172.21.15.151:0/3528800408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586541a35e0 0x5586541a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f843cff9700 0 client.28450 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f846ec4db80 1 -- 172.21.15.151:0/3528800408 >> 172.21.15.151:0/3528800408 conn(0x558654198c40 msgr2=0x5586541b57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f846ec4db80 1 -- 172.21.15.151:0/3528800408 shutdown_connections 2023-07-21T22:49:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f846ec4db80 1 -- 172.21.15.151:0/3528800408 wait complete. 2023-07-21T22:49:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.097+0000 7f846ec4db80 20 client.28450 trim_cache size 0 max 16384 2023-07-21T22:49:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:49:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:49:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:49:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:49:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 -- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f84400a1340 msgr2=0x7f84400a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f84400a1340 0x7f84400a37f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f84500cb990 tx=0x7f8450097040 comp rx=0 tx=0).stop 2023-07-21T22:49:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 -- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454068070 msgr2=0x7f84541959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454068070 0x7f84541959a0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f8450005740 tx=0x7f8450005770 comp rx=0 tx=0).stop 2023-07-21T22:49:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 -- 172.21.15.151:0/2760741854 shutdown_connections 2023-07-21T22:49:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f84400a1340 0x7f84400a37f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f84541062b0 0x7f845419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8454068070 0x7f84541959a0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 --2- 172.21.15.151:0/2760741854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84541059a0 0x7f8454195ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 -- 172.21.15.151:0/2760741854 >> 172.21.15.151:0/2760741854 conn(0x7f8454074770 msgr2=0x7f84540fcf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 -- 172.21.15.151:0/2760741854 shutdown_connections 2023-07-21T22:49:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:30.098+0000 7f845a19d700 1 -- 172.21.15.151:0/2760741854 wait complete. 2023-07-21T22:49:31.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:30 smithi187 ceph-mon[96918]: pgmap v961: 97 pgs: 97 active+clean; 8.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:31.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:30 smithi195 ceph-mon[97365]: pgmap v961: 97 pgs: 97 active+clean; 8.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:31.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:30 smithi151 ceph-mon[95510]: pgmap v961: 97 pgs: 97 active+clean; 8.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:33.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:32 smithi187 ceph-mon[96918]: pgmap v962: 97 pgs: 97 active+clean; 8.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:33.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:32 smithi195 ceph-mon[97365]: pgmap v962: 97 pgs: 97 active+clean; 8.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:33.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:32 smithi151 ceph-mon[95510]: pgmap v962: 97 pgs: 97 active+clean; 8.9 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:35.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:34 smithi187 ceph-mon[96918]: pgmap v963: 97 pgs: 97 active+clean; 9.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 39 MiB/s wr, 27 op/s 2023-07-21T22:49:35.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:34 smithi195 ceph-mon[97365]: pgmap v963: 97 pgs: 97 active+clean; 9.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 39 MiB/s wr, 27 op/s 2023-07-21T22:49:35.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:34 smithi151 ceph-mon[95510]: pgmap v963: 97 pgs: 97 active+clean; 9.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 39 MiB/s wr, 27 op/s 2023-07-21T22:49:37.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:36 smithi187 ceph-mon[96918]: pgmap v964: 97 pgs: 97 active+clean; 9.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:37.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:36 smithi195 ceph-mon[97365]: pgmap v964: 97 pgs: 97 active+clean; 9.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:37.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:36 smithi151 ceph-mon[95510]: pgmap v964: 97 pgs: 97 active+clean; 9.1 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:38.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:37 smithi187 ceph-mon[96918]: pgmap v965: 97 pgs: 97 active+clean; 9.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 39 MiB/s wr, 27 op/s 2023-07-21T22:49:38.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:37 smithi195 ceph-mon[97365]: pgmap v965: 97 pgs: 97 active+clean; 9.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 39 MiB/s wr, 27 op/s 2023-07-21T22:49:38.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:37 smithi151 ceph-mon[95510]: pgmap v965: 97 pgs: 97 active+clean; 9.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 39 MiB/s wr, 27 op/s 2023-07-21T22:49:40.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:40 smithi187 ceph-mon[96918]: pgmap v966: 97 pgs: 97 active+clean; 9.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:40.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:40 smithi195 ceph-mon[97365]: pgmap v966: 97 pgs: 97 active+clean; 9.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:40.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:40 smithi151 ceph-mon[95510]: pgmap v966: 97 pgs: 97 active+clean; 9.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:43.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:42 smithi187 ceph-mon[96918]: pgmap v967: 97 pgs: 97 active+clean; 9.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:43.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:42 smithi195 ceph-mon[97365]: pgmap v967: 97 pgs: 97 active+clean; 9.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:43.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:42 smithi151 ceph-mon[95510]: pgmap v967: 97 pgs: 97 active+clean; 9.2 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 26 MiB/s wr, 18 op/s 2023-07-21T22:49:43.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.260+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/4201456315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 msgr2=0x7ff0e40fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.260+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/4201456315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 0x7ff0e40fff70 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7ff0d8009990 tx=0x7ff0d8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.260+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/4201456315 shutdown_connections 2023-07-21T22:49:43.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.260+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/4201456315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0e4105b10 0x7ff0e4105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.260+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/4201456315 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e41004b0 0x7ff0e410c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.260+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/4201456315 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 0x7ff0e40fff70 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.260+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/4201456315 >> 172.21.15.151:0/4201456315 conn(0x7ff0e40fb600 msgr2=0x7ff0e40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.260+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/4201456315 shutdown_connections 2023-07-21T22:49:43.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.260+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/4201456315 wait complete. 2023-07-21T22:49:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.261+0000 7ff0ea7ff700 1 Processor -- start 2023-07-21T22:49:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.261+0000 7ff0ea7ff700 1 -- start start 2023-07-21T22:49:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.262+0000 7ff0ea7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 0x7ff0e40729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.262+0000 7ff0ea7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0e41004b0 0x7ff0e4072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.262+0000 7ff0ea7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e4105b10 0x7ff0e41a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.262+0000 7ff0ea7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41a4240 con 0x7ff0e40ffb00 2023-07-21T22:49:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.262+0000 7ff0ea7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41a4380 con 0x7ff0e41004b0 2023-07-21T22:49:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.262+0000 7ff0ea7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0e41a44f0 con 0x7ff0e4105b10 2023-07-21T22:49:43.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.262+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 0x7ff0e40729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.262+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 0x7ff0e40729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37176/0 (socket says 172.21.15.151:37176) 2023-07-21T22:49:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.262+0000 7ff0e3fff700 1 -- 172.21.15.151:0/2732186481 learned_addr learned my addr 172.21.15.151:0/2732186481 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:43.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.263+0000 7ff0e8d9c700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e4105b10 0x7ff0e41a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.263+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0e41004b0 0x7ff0e4072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.263+0000 7ff0e3fff700 1 -- 172.21.15.151:0/2732186481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e4105b10 msgr2=0x7ff0e41a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.263+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e4105b10 0x7ff0e41a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.263+0000 7ff0e3fff700 1 -- 172.21.15.151:0/2732186481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0e41004b0 msgr2=0x7ff0e4072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:43.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.263+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0e41004b0 0x7ff0e4072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.263+0000 7ff0e3fff700 1 -- 172.21.15.151:0/2732186481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d80095f0 con 0x7ff0e40ffb00 2023-07-21T22:49:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.263+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 0x7ff0e40729f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400e9a0 tx=0x7ff0d400ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.263+0000 7ff0e17fa700 1 -- 172.21.15.151:0/2732186481 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4009790 con 0x7ff0e40ffb00 2023-07-21T22:49:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.264+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/2732186481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e41a47d0 con 0x7ff0e40ffb00 2023-07-21T22:49:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.264+0000 7ff0e17fa700 1 -- 172.21.15.151:0/2732186481 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d4010430 con 0x7ff0e40ffb00 2023-07-21T22:49:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.264+0000 7ff0e17fa700 1 -- 172.21.15.151:0/2732186481 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d400cea0 con 0x7ff0e40ffb00 2023-07-21T22:49:43.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.264+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/2732186481 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e41a4cb0 con 0x7ff0e40ffb00 2023-07-21T22:49:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.267+0000 7ff0e17fa700 1 -- 172.21.15.151:0/2732186481 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff0d40105a0 con 0x7ff0e40ffb00 2023-07-21T22:49:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.269+0000 7ff0fe0a3b80 1 Processor -- start 2023-07-21T22:49:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.269+0000 7ff0e17fa700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0cc0a12c0 0x7ff0cc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.269+0000 7ff0fe0a3b80 1 -- start start 2023-07-21T22:49:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.269+0000 7ff0e17fa700 1 -- 172.21.15.151:0/2732186481 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff0d4014070 con 0x7ff0e40ffb00 2023-07-21T22:49:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.269+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbe4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.269+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbdef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 0x5584bdbdf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdae4c50 con 0x5584bdbe5660 2023-07-21T22:49:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdb379e0 con 0x5584bdbe5210 2023-07-21T22:49:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdb30e70 con 0x5584bda3b6b0 2023-07-21T22:49:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e8d9c700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0cc0a12c0 0x7ff0cc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbe4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbe4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45396/0 (socket says 172.21.15.151:45396) 2023-07-21T22:49:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e3fff700 1 -- 172.21.15.151:0/3811684326 learned_addr learned my addr 172.21.15.151:0/3811684326 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e8d9c700 1 --2- 172.21.15.151:0/3811684326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 0x5584bdbdf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/3811684326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbdef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e3fff700 1 -- 172.21.15.151:0/3811684326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 msgr2=0x5584bdbdef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/3811684326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbdef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e3fff700 1 -- 172.21.15.151:0/3811684326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 msgr2=0x5584bdbdf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.270+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/3811684326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 0x5584bdbdf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.271+0000 7ff0e3fff700 1 -- 172.21.15.151:0/3811684326 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584bd95ed80 con 0x5584bda3b6b0 2023-07-21T22:49:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.271+0000 7ff0e8d9c700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0cc0a12c0 0x7ff0cc0a3770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc007b70 tx=0x7ff0dc009c70 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.271+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/3811684326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbe4cd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4096a00 tx=0x7ff0d4099970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=50aa64f302eae095 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.271+0000 7ff0ca7fc700 1 -- 172.21.15.151:0/3811684326 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d409dfc0 con 0x5584bda3b6b0 2023-07-21T22:49:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.271+0000 7ff0ca7fc700 1 -- 172.21.15.151:0/3811684326 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d40a23e0 con 0x5584bda3b6b0 2023-07-21T22:49:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.271+0000 7ff0ca7fc700 1 -- 172.21.15.151:0/3811684326 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d40a1f50 con 0x5584bda3b6b0 2023-07-21T22:49:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.272+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3811684326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 msgr2=0x5584bdbe4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.272+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3811684326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbe4cd0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4096a00 tx=0x7ff0d4099970 comp rx=0 tx=0).stop 2023-07-21T22:49:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.272+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3811684326 shutdown_connections 2023-07-21T22:49:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.272+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3811684326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 0x5584bdbdf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.272+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3811684326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbe4cd0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.272+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3811684326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbdef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.272+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3811684326 >> 172.21.15.151:0/3811684326 conn(0x5584bdbd4ae0 msgr2=0x5584bdbda0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.272+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3811684326 shutdown_connections 2023-07-21T22:49:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.272+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3811684326 wait complete. 2023-07-21T22:49:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.273+0000 7ff0fe0a3b80 1 -- start start 2023-07-21T22:49:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.273+0000 7ff0fe0a3b80 1 Processor -- start 2023-07-21T22:49:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbee5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbeeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 0x5584bdbe8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdad0a60 con 0x5584bdbe5660 2023-07-21T22:49:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdad0760 con 0x5584bdbe5210 2023-07-21T22:49:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bd9b48c0 con 0x5584bda3b6b0 2023-07-21T22:49:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0fe0a3b80 10 client.0 _ll_register_callbacks cb 0x5584bdace700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbee5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbee5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45404/0 (socket says 172.21.15.151:45404) 2023-07-21T22:49:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0e3fff700 1 -- 172.21.15.151:0/4120824060 learned_addr learned my addr 172.21.15.151:0/4120824060 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0e8d9c700 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 0x5584bdbe8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.274+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbeeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0e3fff700 1 -- 172.21.15.151:0/4120824060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 msgr2=0x5584bdbeeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbeeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0e3fff700 1 -- 172.21.15.151:0/4120824060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 msgr2=0x5584bdbe8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 0x5584bdbe8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0e3fff700 1 -- 172.21.15.151:0/4120824060 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0e41a4cb0 con 0x5584bda3b6b0 2023-07-21T22:49:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbee5d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4010c30 tx=0x7ff0d4099730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a7f1957b2b6bedd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:49:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0c37fe700 1 -- 172.21.15.151:0/4120824060 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d409dfc0 con 0x5584bda3b6b0 2023-07-21T22:49:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0c37fe700 1 -- 172.21.15.151:0/4120824060 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff0d40a2160 con 0x5584bda3b6b0 2023-07-21T22:49:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/4120824060 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5584bda8a490 con 0x5584bda3b6b0 2023-07-21T22:49:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0c37fe700 1 -- 172.21.15.151:0/4120824060 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0d40b8200 con 0x5584bda3b6b0 2023-07-21T22:49:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.275+0000 7ff0fe0a3b80 10 client.28462 fetch_fsmap learned FSMap version 94 2023-07-21T22:49:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.276+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/4120824060 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x5584bd947c00 con 0x5584bda3b6b0 2023-07-21T22:49:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.276+0000 7ff0c37fe700 1 -- 172.21.15.151:0/4120824060 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5584bda8a490 con 0x5584bda3b6b0 2023-07-21T22:49:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.276+0000 7ff0c37fe700 1 -- 172.21.15.151:0/4120824060 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff0d4095d80 con 0x5584bda3b6b0 2023-07-21T22:49:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.276+0000 7ff0fe0a3b80 10 client.28462 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:49:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.276+0000 7ff0fe0a3b80 10 client.28462 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.276+0000 7ff0fe0a3b80 20 client.28462 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.276+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5584bdbf8640 0x5584bdbfaa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.276+0000 7ff0fe0a3b80 4 client.28462 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:49:43.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.276+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/4120824060 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5584bdb29e50 con 0x5584bdbf8640 2023-07-21T22:49:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.277+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5584bdbf8640 0x5584bdbfaa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.277+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5584bdbf8640 0x5584bdbfaa20 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83f483bec41ae376 server_cookie=a0334a8a0dfadb68 in_seq=0 out_seq=0 2023-07-21T22:49:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.277+0000 7ff0c37fe700 10 client.28462 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0c37fe700 1 -- 172.21.15.151:0/4120824060 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5584bdb29e50 con 0x5584bdbf8640 2023-07-21T22:49:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0c37fe700 10 client.28462 handle_command_reply: tid=0 2023-07-21T22:49:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0fe0a3b80 1 client.28462 shutdown 2023-07-21T22:49:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/4120824060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 msgr2=0x5584bdbee5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbee5d0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4010c30 tx=0x7ff0d4099730 comp rx=0 tx=0).stop 2023-07-21T22:49:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/4120824060 shutdown_connections 2023-07-21T22:49:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5584bdbf8640 0x5584bdbfaa20 crc :-1 s=READY pgs=371 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bdbe5660 0x5584bdbe8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bda3b6b0 0x5584bdbee5d0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/4120824060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbeeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/4120824060 >> 172.21.15.151:0/4120824060 conn(0x5584bdbd4ae0 msgr2=0x5584bdbd93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.278+0000 7ff0c37fe700 0 client.28462 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.279+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/4120824060 shutdown_connections 2023-07-21T22:49:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.279+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/4120824060 wait complete. 2023-07-21T22:49:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.279+0000 7ff0fe0a3b80 20 client.28462 trim_cache size 0 max 16384 2023-07-21T22:49:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.295+0000 7ff0fe0a3b80 1 Processor -- start 2023-07-21T22:49:43.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.295+0000 7ff0fe0a3b80 1 -- start start 2023-07-21T22:49:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbe3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbdef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 0x5584bdbdf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdbd64f0 con 0x5584bda3b6b0 2023-07-21T22:49:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdbe97e0 con 0x5584bdbe5210 2023-07-21T22:49:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdbe6df0 con 0x5584bdbe5660 2023-07-21T22:49:43.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbe3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbe3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37216/0 (socket says 172.21.15.151:37216) 2023-07-21T22:49:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e3fff700 1 -- 172.21.15.151:0/2740420385 learned_addr learned my addr 172.21.15.151:0/2740420385 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbdef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e8d9c700 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 0x5584bdbdf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e3fff700 1 -- 172.21.15.151:0/2740420385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 msgr2=0x5584bdbdf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 0x5584bdbdf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e3fff700 1 -- 172.21.15.151:0/2740420385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 msgr2=0x5584bdbdef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbdef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.296+0000 7ff0e3fff700 1 -- 172.21.15.151:0/2740420385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5584bdbe9400 con 0x5584bda3b6b0 2023-07-21T22:49:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.297+0000 7ff0e8d9c700 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 0x5584bdbdf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:49:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.297+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbe3fd0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4099f20 tx=0x7ff0d4094d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32cf187da9660431 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.297+0000 7ff0caffd700 1 -- 172.21.15.151:0/2740420385 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4094ba0 con 0x5584bda3b6b0 2023-07-21T22:49:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.297+0000 7ff0caffd700 1 -- 172.21.15.151:0/2740420385 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d409dfc0 con 0x5584bda3b6b0 2023-07-21T22:49:43.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.297+0000 7ff0caffd700 1 -- 172.21.15.151:0/2740420385 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4095d80 con 0x5584bda3b6b0 2023-07-21T22:49:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.298+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/2740420385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 msgr2=0x5584bdbe3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.298+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbe3fd0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4099f20 tx=0x7ff0d4094d80 comp rx=0 tx=0).stop 2023-07-21T22:49:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.298+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/2740420385 shutdown_connections 2023-07-21T22:49:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.298+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 0x5584bdbdf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.298+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbe3fd0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.298+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/2740420385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbdef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.298+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/2740420385 >> 172.21.15.151:0/2740420385 conn(0x5584bdbd4ae0 msgr2=0x5584bdbe78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:43.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.298+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/2740420385 shutdown_connections 2023-07-21T22:49:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.298+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/2740420385 wait complete. 2023-07-21T22:49:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.299+0000 7ff0fe0a3b80 1 -- start start 2023-07-21T22:49:43.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.299+0000 7ff0fe0a3b80 1 Processor -- start 2023-07-21T22:49:43.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.299+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.299+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbeca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.299+0000 7ff0fe0a3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 0x5584bdbecf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.299+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdbed480 con 0x5584bda3b6b0 2023-07-21T22:49:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.299+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdbed5f0 con 0x5584bdbe5210 2023-07-21T22:49:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.299+0000 7ff0fe0a3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5584bdbed7b0 con 0x5584bdbe5660 2023-07-21T22:49:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0fe0a3b80 10 client.0 _ll_register_callbacks cb 0x7ff0dc0076c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:43.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbee740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37220/0 (socket says 172.21.15.151:37220) 2023-07-21T22:49:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e3fff700 1 -- 172.21.15.151:0/3534980270 learned_addr learned my addr 172.21.15.151:0/3534980270 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbeca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e8d9c700 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 0x5584bdbecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e3fff700 1 -- 172.21.15.151:0/3534980270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 msgr2=0x5584bdbecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 0x5584bdbecf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e3fff700 1 -- 172.21.15.151:0/3534980270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 msgr2=0x5584bdbeca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbeca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e3fff700 1 -- 172.21.15.151:0/3534980270 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5584bd947c00 con 0x5584bda3b6b0 2023-07-21T22:49:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.300+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbeca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:49:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.301+0000 7ff0e3fff700 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbee740 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4096490 tx=0x7ff0d4099d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbfd4ee9f69e6241 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.301+0000 7ff0c37fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:49:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.301+0000 7ff0c37fe700 1 -- 172.21.15.151:0/3534980270 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0d4094ba0 con 0x5584bda3b6b0 2023-07-21T22:49:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.301+0000 7ff0c37fe700 1 -- 172.21.15.151:0/3534980270 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff0d4095d80 con 0x5584bda3b6b0 2023-07-21T22:49:43.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.301+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3534980270 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff0d40a23e0 con 0x5584bda3b6b0 2023-07-21T22:49:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.301+0000 7ff0c37fe700 1 -- 172.21.15.151:0/3534980270 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff0d4095f80 con 0x5584bda3b6b0 2023-07-21T22:49:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.301+0000 7ff0fe0a3b80 10 client.18771 fetch_fsmap learned FSMap version 94 2023-07-21T22:49:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.301+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3534980270 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x5584bd9851f0 con 0x5584bda3b6b0 2023-07-21T22:49:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.301+0000 7ff0c37fe700 1 -- 172.21.15.151:0/3534980270 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff0d40a23e0 con 0x5584bda3b6b0 2023-07-21T22:49:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.302+0000 7ff0c37fe700 1 -- 172.21.15.151:0/3534980270 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff0d40990f0 con 0x5584bda3b6b0 2023-07-21T22:49:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.302+0000 7ff0fe0a3b80 10 client.18771 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:49:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.302+0000 7ff0fe0a3b80 10 client.18771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:43.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.302+0000 7ff0fe0a3b80 20 client.18771 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.302+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5584bdc4d460 0x5584bdc4f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.302+0000 7ff0fe0a3b80 4 client.18771 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:49:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.302+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3534980270 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5584bdaebff0 con 0x5584bdc4d460 2023-07-21T22:49:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.302+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5584bdc4d460 0x5584bdc4f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.303+0000 7ff0e37fe700 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5584bdc4d460 0x5584bdc4f840 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c10beca6e7a8d8a server_cookie=96ded702247292e0 in_seq=0 out_seq=0 2023-07-21T22:49:43.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.303+0000 7ff0c37fe700 10 client.18771 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.322+0000 7ff0c37fe700 1 -- 172.21.15.151:0/3534980270 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5584bdaebff0 con 0x5584bdc4d460 2023-07-21T22:49:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.322+0000 7ff0c37fe700 10 client.18771 handle_command_reply: tid=0 2023-07-21T22:49:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.322+0000 7ff0fe0a3b80 1 client.18771 shutdown 2023-07-21T22:49:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3534980270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 msgr2=0x5584bdbee740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbee740 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7ff0d4096490 tx=0x7ff0d4099d60 comp rx=0 tx=0).stop 2023-07-21T22:49:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3534980270 shutdown_connections 2023-07-21T22:49:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5584bdc4d460 0x5584bdc4f840 crc :-1 s=READY pgs=372 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5584bdbe5660 0x5584bdbecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5584bda3b6b0 0x5584bdbee740 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 --2- 172.21.15.151:0/3534980270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5584bdbe5210 0x5584bdbeca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3534980270 >> 172.21.15.151:0/3534980270 conn(0x5584bdbd4ae0 msgr2=0x5584bdbe78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0c37fe700 0 client.18771 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3534980270 shutdown_connections 2023-07-21T22:49:43.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 1 -- 172.21.15.151:0/3534980270 wait complete. 2023-07-21T22:49:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.323+0000 7ff0fe0a3b80 20 client.18771 trim_cache size 0 max 16384 2023-07-21T22:49:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:49:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:49:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:49:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:49:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0cc0a12c0 msgr2=0x7ff0cc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0cc0a12c0 0x7ff0cc0a3770 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff0dc007b70 tx=0x7ff0dc009c70 comp rx=0 tx=0).stop 2023-07-21T22:49:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 msgr2=0x7ff0e40729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 0x7ff0e40729f0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7ff0d400e9a0 tx=0x7ff0d400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/2732186481 shutdown_connections 2023-07-21T22:49:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff0cc0a12c0 0x7ff0cc0a3770 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff0e4105b10 0x7ff0e41a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0e40ffb00 0x7ff0e40729f0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 --2- 172.21.15.151:0/2732186481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0e41004b0 0x7ff0e4072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/2732186481 >> 172.21.15.151:0/2732186481 conn(0x7ff0e40fb600 msgr2=0x7ff0e40fbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/2732186481 shutdown_connections 2023-07-21T22:49:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:43.324+0000 7ff0ea7ff700 1 -- 172.21.15.151:0/2732186481 wait complete. 2023-07-21T22:49:45.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:44 smithi187 ceph-mon[96918]: pgmap v968: 97 pgs: 97 active+clean; 9.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 39 MiB/s wr, 33 op/s 2023-07-21T22:49:45.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:44 smithi195 ceph-mon[97365]: pgmap v968: 97 pgs: 97 active+clean; 9.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 39 MiB/s wr, 33 op/s 2023-07-21T22:49:45.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:44 smithi151 ceph-mon[95510]: pgmap v968: 97 pgs: 97 active+clean; 9.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 39 MiB/s wr, 33 op/s 2023-07-21T22:49:47.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:46 smithi187 ceph-mon[96918]: pgmap v969: 97 pgs: 97 active+clean; 9.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-07-21T22:49:47.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:46 smithi195 ceph-mon[97365]: pgmap v969: 97 pgs: 97 active+clean; 9.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-07-21T22:49:47.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:46 smithi151 ceph-mon[95510]: pgmap v969: 97 pgs: 97 active+clean; 9.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 26 MiB/s wr, 24 op/s 2023-07-21T22:49:49.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:48 smithi187 ceph-mon[96918]: pgmap v970: 97 pgs: 97 active+clean; 9.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 39 MiB/s wr, 36 op/s 2023-07-21T22:49:49.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:48 smithi195 ceph-mon[97365]: pgmap v970: 97 pgs: 97 active+clean; 9.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 39 MiB/s wr, 36 op/s 2023-07-21T22:49:49.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:48 smithi151 ceph-mon[95510]: pgmap v970: 97 pgs: 97 active+clean; 9.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 39 MiB/s wr, 36 op/s 2023-07-21T22:49:51.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:50 smithi187 ceph-mon[96918]: pgmap v971: 97 pgs: 97 active+clean; 9.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-21T22:49:51.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:50 smithi195 ceph-mon[97365]: pgmap v971: 97 pgs: 97 active+clean; 9.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-21T22:49:51.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:50 smithi151 ceph-mon[95510]: pgmap v971: 97 pgs: 97 active+clean; 9.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-21T22:49:53.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:52 smithi187 ceph-mon[96918]: pgmap v972: 97 pgs: 97 active+clean; 9.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-21T22:49:53.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:52 smithi195 ceph-mon[97365]: pgmap v972: 97 pgs: 97 active+clean; 9.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-21T22:49:53.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:52 smithi151 ceph-mon[95510]: pgmap v972: 97 pgs: 97 active+clean; 9.5 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 26 MiB/s wr, 27 op/s 2023-07-21T22:49:54.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:53 smithi187 ceph-mon[96918]: pgmap v973: 97 pgs: 97 active+clean; 9.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 39 MiB/s wr, 36 op/s 2023-07-21T22:49:54.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:53 smithi195 ceph-mon[97365]: pgmap v973: 97 pgs: 97 active+clean; 9.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 39 MiB/s wr, 36 op/s 2023-07-21T22:49:54.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:53 smithi151 ceph-mon[95510]: pgmap v973: 97 pgs: 97 active+clean; 9.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 39 MiB/s wr, 36 op/s 2023-07-21T22:49:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.507+0000 7ff802fff700 1 -- 172.21.15.151:0/1757416832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7fc067c10 msgr2=0x7ff7fc067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.507+0000 7ff802fff700 1 --2- 172.21.15.151:0/1757416832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7fc067c10 0x7ff7fc067fe0 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00099c0 tx=0x7ff7f0009cd0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.507+0000 7ff802fff700 1 -- 172.21.15.151:0/1757416832 shutdown_connections 2023-07-21T22:49:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.507+0000 7ff802fff700 1 --2- 172.21.15.151:0/1757416832 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7fc104e50 0x7ff7fc10ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.507+0000 7ff802fff700 1 --2- 172.21.15.151:0/1757416832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7fc067c10 0x7ff7fc067fe0 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.507+0000 7ff802fff700 1 --2- 172.21.15.151:0/1757416832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0685b0 0x7ff7fc104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.507+0000 7ff802fff700 1 -- 172.21.15.151:0/1757416832 >> 172.21.15.151:0/1757416832 conn(0x7ff7fc074760 msgr2=0x7ff7fc074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.507+0000 7ff802fff700 1 -- 172.21.15.151:0/1757416832 shutdown_connections 2023-07-21T22:49:56.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.507+0000 7ff802fff700 1 -- 172.21.15.151:0/1757416832 wait complete. 2023-07-21T22:49:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.508+0000 7ff802fff700 1 Processor -- start 2023-07-21T22:49:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.509+0000 7ff802fff700 1 -- start start 2023-07-21T22:49:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.509+0000 7ff802fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7fc067c10 0x7ff7fc19dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.509+0000 7ff802fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0685b0 0x7ff7fc19e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.509+0000 7ff802fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7fc104e50 0x7ff7fc197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.509+0000 7ff802fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1981c0 con 0x7ff7fc104e50 2023-07-21T22:49:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.509+0000 7ff802fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc198330 con 0x7ff7fc0685b0 2023-07-21T22:49:56.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.509+0000 7ff802fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7fc1984f0 con 0x7ff7fc067c10 2023-07-21T22:49:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff800d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7fc067c10 0x7ff7fc19dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff800d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7fc067c10 0x7ff7fc19dcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34412/0 (socket says 172.21.15.151:34412) 2023-07-21T22:49:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff80159c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7fc104e50 0x7ff7fc197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff800d9b700 1 -- 172.21.15.151:0/612241857 learned_addr learned my addr 172.21.15.151:0/612241857 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:56.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff7fbfff700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0685b0 0x7ff7fc19e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff800d9b700 1 -- 172.21.15.151:0/612241857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0685b0 msgr2=0x7ff7fc19e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff800d9b700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0685b0 0x7ff7fc19e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff800d9b700 1 -- 172.21.15.151:0/612241857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7fc104e50 msgr2=0x7ff7fc197b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff800d9b700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7fc104e50 0x7ff7fc197b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.510+0000 7ff800d9b700 1 -- 172.21.15.151:0/612241857 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f00095f0 con 0x7ff7fc067c10 2023-07-21T22:49:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.511+0000 7ff800d9b700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7fc067c10 0x7ff7fc19dcf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0005910 tx=0x7ff7f000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:56.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.511+0000 7ff7f9ffb700 1 -- 172.21.15.151:0/612241857 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f001d070 con 0x7ff7fc067c10 2023-07-21T22:49:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.511+0000 7ff802fff700 1 -- 172.21.15.151:0/612241857 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7fc198770 con 0x7ff7fc067c10 2023-07-21T22:49:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.511+0000 7ff7f9ffb700 1 -- 172.21.15.151:0/612241857 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7f0005050 con 0x7ff7fc067c10 2023-07-21T22:49:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.511+0000 7ff7f9ffb700 1 -- 172.21.15.151:0/612241857 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0004a00 con 0x7ff7fc067c10 2023-07-21T22:49:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.511+0000 7ff802fff700 1 -- 172.21.15.151:0/612241857 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc1a4ce0 con 0x7ff7fc067c10 2023-07-21T22:49:56.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.514+0000 7ff7f9ffb700 1 -- 172.21.15.151:0/612241857 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff7f00051c0 con 0x7ff7fc067c10 2023-07-21T22:49:56.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff8169d4b80 1 Processor -- start 2023-07-21T22:49:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff7f9ffb700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7ec0a12c0 0x7ff7ec0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff8169d4b80 1 -- start start 2023-07-21T22:49:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff7f9ffb700 1 -- 172.21.15.151:0/612241857 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff7f00cdac0 con 0x7ff7fc067c10 2023-07-21T22:49:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a80cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff80159c700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7ec0a12c0 0x7ff7ec0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a7b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b827980c50 con 0x55b827a81210 2023-07-21T22:49:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8279d39e0 con 0x55b827a81660 2023-07-21T22:49:56.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.516+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8279cce70 con 0x55b8278d76b0 2023-07-21T22:49:56.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37872/0 (socket says 172.21.15.151:37872) 2023-07-21T22:49:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff7fbfff700 1 -- 172.21.15.151:0/1109509283 learned_addr learned my addr 172.21.15.151:0/1109509283 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff800d9b700 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a80cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff80159c700 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a7b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff800d9b700 1 -- 172.21.15.151:0/1109509283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 msgr2=0x55b827a7b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff800d9b700 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a7b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff800d9b700 1 -- 172.21.15.151:0/1109509283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 msgr2=0x55b827a7af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff800d9b700 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff800d9b700 1 -- 172.21.15.151:0/1109509283 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8277fad80 con 0x55b8278d76b0 2023-07-21T22:49:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff7fbfff700 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:49:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff80159c700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7ec0a12c0 0x7ff7ec0a3770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc19e9f0 tx=0x7ff7f4011be0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:56.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.517+0000 7ff800d9b700 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a80cd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00cb220 tx=0x7ff7f009acb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d26097b83daa867 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff7e6ffd700 1 -- 172.21.15.151:0/1109509283 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f0098fd0 con 0x55b8278d76b0 2023-07-21T22:49:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff7e6ffd700 1 -- 172.21.15.151:0/1109509283 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7f0097340 con 0x55b8278d76b0 2023-07-21T22:49:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff7e6ffd700 1 -- 172.21.15.151:0/1109509283 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f009a380 con 0x55b8278d76b0 2023-07-21T22:49:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff8169d4b80 1 -- 172.21.15.151:0/1109509283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 msgr2=0x55b827a80cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a80cd0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7ff7f00cb220 tx=0x7ff7f009acb0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff8169d4b80 1 -- 172.21.15.151:0/1109509283 shutdown_connections 2023-07-21T22:49:56.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a7b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a80cd0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/1109509283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff8169d4b80 1 -- 172.21.15.151:0/1109509283 >> 172.21.15.151:0/1109509283 conn(0x55b827a70ae0 msgr2=0x55b827a760e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff8169d4b80 1 -- 172.21.15.151:0/1109509283 shutdown_connections 2023-07-21T22:49:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.518+0000 7ff8169d4b80 1 -- 172.21.15.151:0/1109509283 wait complete. 2023-07-21T22:49:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.519+0000 7ff8169d4b80 1 -- start start 2023-07-21T22:49:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.519+0000 7ff8169d4b80 1 Processor -- start 2023-07-21T22:49:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.520+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8278d76b0 0x55b827a8a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.520+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81210 0x55b827a8a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.520+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b827a81660 0x55b827a84550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.520+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82796ca60 con 0x55b8278d76b0 2023-07-21T22:49:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.520+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b82796c760 con 0x55b827a81210 2023-07-21T22:49:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.520+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8278508c0 con 0x55b827a81660 2023-07-21T22:49:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.520+0000 7ff8169d4b80 10 client.0 _ll_register_callbacks cb 0x55b82796a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.520+0000 7ff800d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8278d76b0 0x55b827a8a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81210 0x55b827a8a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff800d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8278d76b0 0x55b827a8a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37888/0 (socket says 172.21.15.151:37888) 2023-07-21T22:49:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff800d9b700 1 -- 172.21.15.151:0/3658328770 learned_addr learned my addr 172.21.15.151:0/3658328770 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff80159c700 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b827a81660 0x55b827a84550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff800d9b700 1 -- 172.21.15.151:0/3658328770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b827a81660 msgr2=0x55b827a84550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff800d9b700 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b827a81660 0x55b827a84550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff800d9b700 1 -- 172.21.15.151:0/3658328770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81210 msgr2=0x55b827a8a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff800d9b700 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81210 0x55b827a8a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff800d9b700 1 -- 172.21.15.151:0/3658328770 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7fc1a4ce0 con 0x55b8278d76b0 2023-07-21T22:49:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff7fbfff700 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81210 0x55b827a8a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:49:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff800d9b700 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8278d76b0 0x55b827a8a290 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0098f80 tx=0x7ff7f009a4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde1b5f1e35c3dea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff7dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:49:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.521+0000 7ff7dbfff700 1 -- 172.21.15.151:0/3658328770 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f009b090 con 0x55b8278d76b0 2023-07-21T22:49:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff7dbfff700 1 -- 172.21.15.151:0/3658328770 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff7f00a2b60 con 0x55b8278d76b0 2023-07-21T22:49:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3658328770 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b827926490 con 0x55b8278d76b0 2023-07-21T22:49:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff7dbfff700 1 -- 172.21.15.151:0/3658328770 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f00a2d20 con 0x55b8278d76b0 2023-07-21T22:49:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff8169d4b80 10 client.18783 fetch_fsmap learned FSMap version 94 2023-07-21T22:49:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3658328770 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x55b8277e3c00 con 0x55b8278d76b0 2023-07-21T22:49:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff7dbfff700 1 -- 172.21.15.151:0/3658328770 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b827926490 con 0x55b8278d76b0 2023-07-21T22:49:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff7dbfff700 1 -- 172.21.15.151:0/3658328770 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff7f0096a20 con 0x55b8278d76b0 2023-07-21T22:49:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff8169d4b80 10 client.18783 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:49:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff8169d4b80 10 client.18783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff8169d4b80 20 client.18783 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b827a94210 0x55b827a965f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff8169d4b80 4 client.18783 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:49:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.522+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3658328770 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b8279c5e50 con 0x55b827a94210 2023-07-21T22:49:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.523+0000 7ff7fbfff700 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b827a94210 0x55b827a965f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.523+0000 7ff7fbfff700 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b827a94210 0x55b827a965f0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78e176a1d0e2f511 server_cookie=d24a153ab24a7a9a in_seq=0 out_seq=0 2023-07-21T22:49:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.523+0000 7ff7dbfff700 10 client.18783 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff7dbfff700 1 -- 172.21.15.151:0/3658328770 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b8279c5e50 con 0x55b827a94210 2023-07-21T22:49:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff7dbfff700 10 client.18783 handle_command_reply: tid=0 2023-07-21T22:49:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff8169d4b80 1 client.18783 shutdown 2023-07-21T22:49:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3658328770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8278d76b0 msgr2=0x55b827a8a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8278d76b0 0x55b827a8a290 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0098f80 tx=0x7ff7f009a4e0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3658328770 shutdown_connections 2023-07-21T22:49:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b827a94210 0x55b827a965f0 crc :-1 s=READY pgs=373 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b827a81660 0x55b827a84550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8278d76b0 0x55b827a8a290 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.524+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3658328770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81210 0x55b827a8a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.525+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3658328770 >> 172.21.15.151:0/3658328770 conn(0x55b827a70ae0 msgr2=0x55b827a753e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.525+0000 7ff7dbfff700 0 client.18783 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.525+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3658328770 shutdown_connections 2023-07-21T22:49:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.525+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3658328770 wait complete. 2023-07-21T22:49:56.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.525+0000 7ff8169d4b80 20 client.18783 trim_cache size 0 max 16384 2023-07-21T22:49:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.543+0000 7ff8169d4b80 1 Processor -- start 2023-07-21T22:49:56.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.543+0000 7ff8169d4b80 1 -- start start 2023-07-21T22:49:56.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a84550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a7b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b827a72c00 con 0x55b827a81210 2023-07-21T22:49:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b827a85ac0 con 0x55b827a81660 2023-07-21T22:49:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b827a6db00 con 0x55b8278d76b0 2023-07-21T22:49:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37900/0 (socket says 172.21.15.151:37900) 2023-07-21T22:49:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff7fbfff700 1 -- 172.21.15.151:0/3520909102 learned_addr learned my addr 172.21.15.151:0/3520909102 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.544+0000 7ff800d9b700 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a84550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff80159c700 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a7b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff7fbfff700 1 -- 172.21.15.151:0/3520909102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 msgr2=0x55b827a84550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff7fbfff700 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a84550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff7fbfff700 1 -- 172.21.15.151:0/3520909102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 msgr2=0x55b827a7b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff7fbfff700 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a7b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff7fbfff700 1 -- 172.21.15.151:0/3520909102 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b827a9b220 con 0x55b827a81210 2023-07-21T22:49:56.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff80159c700 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a7b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:49:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff7fbfff700 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80123c0 tx=0x7ff7e8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a22872fb9290056 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff7e77fe700 1 -- 172.21.15.151:0/3520909102 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8017070 con 0x55b827a81210 2023-07-21T22:49:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff7e77fe700 1 -- 172.21.15.151:0/3520909102 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7e8018040 con 0x55b827a81210 2023-07-21T22:49:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.545+0000 7ff7e77fe700 1 -- 172.21.15.151:0/3520909102 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8003ba0 con 0x55b827a81210 2023-07-21T22:49:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.546+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3520909102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 msgr2=0x55b827a7af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.546+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80123c0 tx=0x7ff7e8009260 comp rx=0 tx=0).stop 2023-07-21T22:49:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.546+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3520909102 shutdown_connections 2023-07-21T22:49:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.546+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a7b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.546+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a84550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.546+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/3520909102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a7af40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.546+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3520909102 >> 172.21.15.151:0/3520909102 conn(0x55b827a70ae0 msgr2=0x55b827a83e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.546+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3520909102 shutdown_connections 2023-07-21T22:49:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.546+0000 7ff8169d4b80 1 -- 172.21.15.151:0/3520909102 wait complete. 2023-07-21T22:49:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.547+0000 7ff8169d4b80 1 -- start start 2023-07-21T22:49:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.547+0000 7ff8169d4b80 1 Processor -- start 2023-07-21T22:49:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.547+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a87e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.547+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a88340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.547+0000 7ff8169d4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a88880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.547+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b827ae70a0 con 0x55b827a81210 2023-07-21T22:49:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.547+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b827ae71e0 con 0x55b827a81660 2023-07-21T22:49:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.547+0000 7ff8169d4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b827ae7320 con 0x55b8278d76b0 2023-07-21T22:49:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.547+0000 7ff8169d4b80 10 client.0 _ll_register_callbacks cb 0x7ff7f4007c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:49:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a88340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff80159c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a88880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff800d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a87e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff7fbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a88340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37902/0 (socket says 172.21.15.151:37902) 2023-07-21T22:49:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff800d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a87e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34444/0 (socket says 172.21.15.151:34444) 2023-07-21T22:49:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff7fbfff700 1 -- 172.21.15.151:0/2987777970 learned_addr learned my addr 172.21.15.151:0/2987777970 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:49:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff80159c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a88880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:38060/0 (socket says 172.21.15.151:38060) 2023-07-21T22:49:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff80159c700 1 -- 172.21.15.151:0/2987777970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 msgr2=0x55b827a87e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff80159c700 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a87e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff80159c700 1 -- 172.21.15.151:0/2987777970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 msgr2=0x55b827a88340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:49:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff80159c700 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a88340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.548+0000 7ff80159c700 1 -- 172.21.15.151:0/2987777970 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e8012050 con 0x55b827a81660 2023-07-21T22:49:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.549+0000 7ff80159c700 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a88880 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4007d90 tx=0x7ff7f4004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ce5408aea4c8af1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:49:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.549+0000 7ff7dbfff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:49:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.549+0000 7ff7dbfff700 1 -- 172.21.15.151:0/2987777970 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7f40199d0 con 0x55b827a81660 2023-07-21T22:49:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.549+0000 7ff8169d4b80 1 -- 172.21.15.151:0/2987777970 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff7f0097340 con 0x55b827a81660 2023-07-21T22:49:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.549+0000 7ff7dbfff700 1 -- 172.21.15.151:0/2987777970 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 8448+0+0 (secure 0 0 0) 0x7ff7f4019b30 con 0x55b827a81660 2023-07-21T22:49:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.549+0000 7ff7dbfff700 1 -- 172.21.15.151:0/2987777970 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff7f4019cf0 con 0x55b827a81660 2023-07-21T22:49:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.549+0000 7ff8169d4b80 10 client.28454 fetch_fsmap learned FSMap version 94 2023-07-21T22:49:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.549+0000 7ff8169d4b80 1 -- 172.21.15.151:0/2987777970 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x55b8278211f0 con 0x55b827a81660 2023-07-21T22:49:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.549+0000 7ff7dbfff700 1 -- 172.21.15.151:0/2987777970 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff7f0097340 con 0x55b827a81660 2023-07-21T22:49:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.550+0000 7ff7dbfff700 1 -- 172.21.15.151:0/2987777970 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff7f402c020 con 0x55b827a81660 2023-07-21T22:49:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.550+0000 7ff8169d4b80 10 client.28454 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:49:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.550+0000 7ff8169d4b80 10 client.28454 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:49:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.550+0000 7ff8169d4b80 20 client.28454 populate_metadata read hostname 'smithi151' 2023-07-21T22:49:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.550+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b827ae8920 0x55b827aead00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:49:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.550+0000 7ff8169d4b80 4 client.28454 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:49:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.550+0000 7ff8169d4b80 1 -- 172.21.15.151:0/2987777970 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b827987ff0 con 0x55b827ae8920 2023-07-21T22:49:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.550+0000 7ff800d9b700 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b827ae8920 0x55b827aead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:49:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.551+0000 7ff7dbfff700 10 client.28454 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:56.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.551+0000 7ff800d9b700 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b827ae8920 0x55b827aead00 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f42b42c0b7cf736 server_cookie=665c7ea36b8bf701 in_seq=0 out_seq=0 2023-07-21T22:49:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.559+0000 7ff7dbfff700 1 -- 172.21.15.151:0/2987777970 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b827987ff0 con 0x55b827ae8920 2023-07-21T22:49:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.559+0000 7ff7dbfff700 10 client.28454 handle_command_reply: tid=0 2023-07-21T22:49:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.559+0000 7ff8169d4b80 1 client.28454 shutdown 2023-07-21T22:49:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 -- 172.21.15.151:0/2987777970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 msgr2=0x55b827a88880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a88880 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff7f4007d90 tx=0x7ff7f4004b40 comp rx=0 tx=0).stop 2023-07-21T22:49:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 -- 172.21.15.151:0/2987777970 shutdown_connections 2023-07-21T22:49:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b827ae8920 0x55b827aead00 crc :-1 s=READY pgs=374 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b827a81660 0x55b827a88880 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b8278d76b0 0x55b827a87e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 --2- 172.21.15.151:0/2987777970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b827a81210 0x55b827a88340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 -- 172.21.15.151:0/2987777970 >> 172.21.15.151:0/2987777970 conn(0x55b827a70ae0 msgr2=0x55b827a82d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff7dbfff700 0 client.28454 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:49:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 -- 172.21.15.151:0/2987777970 shutdown_connections 2023-07-21T22:49:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 1 -- 172.21.15.151:0/2987777970 wait complete. 2023-07-21T22:49:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.560+0000 7ff8169d4b80 20 client.28454 trim_cache size 0 max 16384 2023-07-21T22:49:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:49:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:49:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:49:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:49:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 -- 172.21.15.151:0/612241857 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7ec0a12c0 msgr2=0x7ff7ec0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7ec0a12c0 0x7ff7ec0a3770 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff7fc19e9f0 tx=0x7ff7f4011be0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 -- 172.21.15.151:0/612241857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7fc067c10 msgr2=0x7ff7fc19dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:49:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7fc067c10 0x7ff7fc19dcf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7ff7f0005910 tx=0x7ff7f000f690 comp rx=0 tx=0).stop 2023-07-21T22:49:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 -- 172.21.15.151:0/612241857 shutdown_connections 2023-07-21T22:49:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff7ec0a12c0 0x7ff7ec0a3770 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7fc104e50 0x7ff7fc197b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff7fc067c10 0x7ff7fc19dcf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 --2- 172.21.15.151:0/612241857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7fc0685b0 0x7ff7fc19e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:49:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 -- 172.21.15.151:0/612241857 >> 172.21.15.151:0/612241857 conn(0x7ff7fc074760 msgr2=0x7ff7fc0fc960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:49:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 -- 172.21.15.151:0/612241857 shutdown_connections 2023-07-21T22:49:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:49:56.561+0000 7ff802fff700 1 -- 172.21.15.151:0/612241857 wait complete. 2023-07-21T22:49:56.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:56 smithi187 ceph-mon[96918]: pgmap v974: 97 pgs: 97 active+clean; 9.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-07-21T22:49:56.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:56 smithi195 ceph-mon[97365]: pgmap v974: 97 pgs: 97 active+clean; 9.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-07-21T22:49:56.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:56 smithi151 ceph-mon[95510]: pgmap v974: 97 pgs: 97 active+clean; 9.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 21 op/s 2023-07-21T22:49:59.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:49:58 smithi187 ceph-mon[96918]: pgmap v975: 97 pgs: 97 active+clean; 9.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 39 MiB/s wr, 31 op/s 2023-07-21T22:49:59.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:49:58 smithi195 ceph-mon[97365]: pgmap v975: 97 pgs: 97 active+clean; 9.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 39 MiB/s wr, 31 op/s 2023-07-21T22:49:59.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:49:58 smithi151 ceph-mon[95510]: pgmap v975: 97 pgs: 97 active+clean; 9.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 39 MiB/s wr, 31 op/s 2023-07-21T22:50:00.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T22:49:59.999+0000 7f5662017700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:50:01.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:00 smithi187 ceph-mon[96918]: pgmap v976: 97 pgs: 97 active+clean; 9.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 18 op/s 2023-07-21T22:50:01.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:00 smithi187 ceph-mon[96918]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:50:01.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:00 smithi195 ceph-mon[97365]: pgmap v976: 97 pgs: 97 active+clean; 9.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 18 op/s 2023-07-21T22:50:01.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:00 smithi195 ceph-mon[97365]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:50:01.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:00 smithi151 ceph-mon[95510]: pgmap v976: 97 pgs: 97 active+clean; 9.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 18 op/s 2023-07-21T22:50:01.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:00 smithi151 ceph-mon[95510]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T22:50:03.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:02 smithi187 ceph-mon[96918]: pgmap v977: 97 pgs: 97 active+clean; 9.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 18 op/s 2023-07-21T22:50:03.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:02 smithi195 ceph-mon[97365]: pgmap v977: 97 pgs: 97 active+clean; 9.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 18 op/s 2023-07-21T22:50:03.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:02 smithi151 ceph-mon[95510]: pgmap v977: 97 pgs: 97 active+clean; 9.8 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 27 MiB/s wr, 18 op/s 2023-07-21T22:50:05.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:04 smithi187 ceph-mon[96918]: pgmap v978: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 40 MiB/s wr, 42 op/s 2023-07-21T22:50:05.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:04 smithi195 ceph-mon[97365]: pgmap v978: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 40 MiB/s wr, 42 op/s 2023-07-21T22:50:05.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:04 smithi151 ceph-mon[95510]: pgmap v978: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 40 MiB/s wr, 42 op/s 2023-07-21T22:50:07.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:06 smithi187 ceph-mon[96918]: pgmap v979: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-07-21T22:50:07.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:06 smithi195 ceph-mon[97365]: pgmap v979: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-07-21T22:50:07.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:06 smithi151 ceph-mon[95510]: pgmap v979: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 26 MiB/s wr, 33 op/s 2023-07-21T22:50:09.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:08 smithi187 ceph-mon[96918]: pgmap v980: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 39 MiB/s wr, 42 op/s 2023-07-21T22:50:09.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:08 smithi195 ceph-mon[97365]: pgmap v980: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 39 MiB/s wr, 42 op/s 2023-07-21T22:50:09.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:08 smithi151 ceph-mon[95510]: pgmap v980: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 39 MiB/s wr, 42 op/s 2023-07-21T22:50:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.739+0000 7f58babff700 1 -- 172.21.15.151:0/3726257678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4102970 msgr2=0x7f58b4106930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.739+0000 7f58babff700 1 --2- 172.21.15.151:0/3726257678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4102970 0x7f58b4106930 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f58a00099c0 tx=0x7f58a0009cd0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.740+0000 7f58babff700 1 -- 172.21.15.151:0/3726257678 shutdown_connections 2023-07-21T22:50:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.740+0000 7f58babff700 1 --2- 172.21.15.151:0/3726257678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b4101fd0 0x7f58b41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.740+0000 7f58babff700 1 --2- 172.21.15.151:0/3726257678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b4107010 0x7f58b410ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.740+0000 7f58babff700 1 --2- 172.21.15.151:0/3726257678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4102970 0x7f58b4106930 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.740+0000 7f58babff700 1 -- 172.21.15.151:0/3726257678 >> 172.21.15.151:0/3726257678 conn(0x7f58b40fd840 msgr2=0x7f58b40ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.740+0000 7f58babff700 1 -- 172.21.15.151:0/3726257678 shutdown_connections 2023-07-21T22:50:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.740+0000 7f58babff700 1 -- 172.21.15.151:0/3726257678 wait complete. 2023-07-21T22:50:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.742+0000 7f58babff700 1 Processor -- start 2023-07-21T22:50:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.742+0000 7f58babff700 1 -- start start 2023-07-21T22:50:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.742+0000 7f58babff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b4101fd0 0x7f58b4197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.742+0000 7f58babff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4102970 0x7f58b4198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.742+0000 7f58babff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b4107010 0x7f58b419ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.742+0000 7f58babff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b419d0c0 con 0x7f58b4107010 2023-07-21T22:50:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.742+0000 7f58babff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b419d230 con 0x7f58b4101fd0 2023-07-21T22:50:09.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.742+0000 7f58babff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58b419d3f0 con 0x7f58b4102970 2023-07-21T22:50:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b899b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b4101fd0 0x7f58b4197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4102970 0x7f58b4198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b899b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b4101fd0 0x7f58b4197ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54080/0 (socket says 172.21.15.151:54080) 2023-07-21T22:50:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b899b700 1 -- 172.21.15.151:0/118643825 learned_addr learned my addr 172.21.15.151:0/118643825 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b919c700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b4107010 0x7f58b419ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b3fff700 1 -- 172.21.15.151:0/118643825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b4101fd0 msgr2=0x7f58b4197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b3fff700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b4101fd0 0x7f58b4197ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b3fff700 1 -- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b4107010 msgr2=0x7f58b419ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b3fff700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b4107010 0x7f58b419ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.743+0000 7f58b3fff700 1 -- 172.21.15.151:0/118643825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a00095f0 con 0x7f58b4102970 2023-07-21T22:50:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.744+0000 7f58b3fff700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4102970 0x7f58b4198410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009fd0 tx=0x7f58a000f690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.744+0000 7f58b1ffb700 1 -- 172.21.15.151:0/118643825 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a001d070 con 0x7f58b4102970 2023-07-21T22:50:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.744+0000 7f58babff700 1 -- 172.21.15.151:0/118643825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58b419d670 con 0x7f58b4102970 2023-07-21T22:50:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.744+0000 7f58babff700 1 -- 172.21.15.151:0/118643825 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b41a4f10 con 0x7f58b4102970 2023-07-21T22:50:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.744+0000 7f58b1ffb700 1 -- 172.21.15.151:0/118643825 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a0022470 con 0x7f58b4102970 2023-07-21T22:50:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.744+0000 7f58b1ffb700 1 -- 172.21.15.151:0/118643825 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0017650 con 0x7f58b4102970 2023-07-21T22:50:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.747+0000 7f58b1ffb700 1 -- 172.21.15.151:0/118643825 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f58a0022830 con 0x7f58b4102970 2023-07-21T22:50:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.749+0000 7f58b1ffb700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f58a40a12c0 0x7f58a40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.749+0000 7f58b1ffb700 1 -- 172.21.15.151:0/118643825 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f58a00cdbd0 con 0x7f58b4102970 2023-07-21T22:50:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.749+0000 7f58b899b700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f58a40a12c0 0x7f58a40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.750+0000 7f58ce593b80 1 Processor -- start 2023-07-21T22:50:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.750+0000 7f58ce593b80 1 -- start start 2023-07-21T22:50:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.750+0000 7f58b899b700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f58a40a12c0 0x7f58a40a3770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009d20 tx=0x7f58a8009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.750+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9f5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.750+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9eff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.750+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9f04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.750+0000 7f58ce593b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7b8f5c50 con 0x556a7b9f6210 2023-07-21T22:50:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.750+0000 7f58ce593b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7b9489e0 con 0x556a7b84c6b0 2023-07-21T22:50:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.750+0000 7f58ce593b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7b941e70 con 0x556a7b9f6660 2023-07-21T22:50:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9eff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b919c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9f04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9eff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53738/0 (socket says 172.21.15.151:53738) 2023-07-21T22:50:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b3fff700 1 -- 172.21.15.151:0/3048862953 learned_addr learned my addr 172.21.15.151:0/3048862953 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b899b700 1 --2- 172.21.15.151:0/3048862953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9f5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b3fff700 1 -- 172.21.15.151:0/3048862953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 msgr2=0x556a7b9f04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b3fff700 1 --2- 172.21.15.151:0/3048862953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9f04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b3fff700 1 -- 172.21.15.151:0/3048862953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 msgr2=0x556a7b9f5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b3fff700 1 --2- 172.21.15.151:0/3048862953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9f5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b3fff700 1 -- 172.21.15.151:0/3048862953 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a7b76fd80 con 0x556a7b9f6210 2023-07-21T22:50:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b899b700 1 --2- 172.21.15.151:0/3048862953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:50:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.751+0000 7f58b3fff700 1 --2- 172.21.15.151:0/3048862953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9eff40 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f58a0006010 tx=0x7f58a009abb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8759e9db22ab00af server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f589effd700 1 -- 172.21.15.151:0/3048862953 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a009ecf0 con 0x556a7b9f6210 2023-07-21T22:50:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f589effd700 1 -- 172.21.15.151:0/3048862953 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a00a3080 con 0x556a7b9f6210 2023-07-21T22:50:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f589effd700 1 -- 172.21.15.151:0/3048862953 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a009b120 con 0x556a7b9f6210 2023-07-21T22:50:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f58ce593b80 1 -- 172.21.15.151:0/3048862953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 msgr2=0x556a7b9eff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3048862953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9eff40 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f58a0006010 tx=0x7f58a009abb0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f58ce593b80 1 -- 172.21.15.151:0/3048862953 shutdown_connections 2023-07-21T22:50:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3048862953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9f5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3048862953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9f04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3048862953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9eff40 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.752+0000 7f58ce593b80 1 -- 172.21.15.151:0/3048862953 >> 172.21.15.151:0/3048862953 conn(0x556a7b9e5ae0 msgr2=0x556a7b9eb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.753+0000 7f58ce593b80 1 -- 172.21.15.151:0/3048862953 shutdown_connections 2023-07-21T22:50:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.753+0000 7f58ce593b80 1 -- 172.21.15.151:0/3048862953 wait complete. 2023-07-21T22:50:09.794 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.753+0000 7f58ce593b80 1 -- start start 2023-07-21T22:50:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.753+0000 7f58ce593b80 1 Processor -- start 2023-07-21T22:50:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.754+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9ff2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.754+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9ff820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.754+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9f9530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.754+0000 7f58ce593b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7b8e1a60 con 0x556a7b9f6210 2023-07-21T22:50:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.754+0000 7f58ce593b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7b8e1760 con 0x556a7b84c6b0 2023-07-21T22:50:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.754+0000 7f58ce593b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7b7c58c0 con 0x556a7b9f6660 2023-07-21T22:50:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.754+0000 7f58ce593b80 10 client.0 _ll_register_callbacks cb 0x556a7b8df700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:50:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b899b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9ff2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9ff820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b899b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9ff2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54100/0 (socket says 172.21.15.151:54100) 2023-07-21T22:50:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b899b700 1 -- 172.21.15.151:0/3427353017 learned_addr learned my addr 172.21.15.151:0/3427353017 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b919c700 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9f9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b3fff700 1 -- 172.21.15.151:0/3427353017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 msgr2=0x556a7b9f9530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b3fff700 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9f9530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b3fff700 1 -- 172.21.15.151:0/3427353017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 msgr2=0x556a7b9ff2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b3fff700 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9ff2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b3fff700 1 -- 172.21.15.151:0/3427353017 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a8017070 con 0x556a7b9f6210 2023-07-21T22:50:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b899b700 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9ff2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:50:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f58b3fff700 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9ff820 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f58a0097730 tx=0x7f58a00cb250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe401984cb9a4661 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.755+0000 7f5893fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:50:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f5893fff700 1 -- 172.21.15.151:0/3427353017 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a009a3b0 con 0x556a7b9f6210 2023-07-21T22:50:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f58ce593b80 1 -- 172.21.15.151:0/3427353017 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556a7b89b490 con 0x556a7b9f6210 2023-07-21T22:50:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f5893fff700 1 -- 172.21.15.151:0/3427353017 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f58a009af20 con 0x556a7b9f6210 2023-07-21T22:50:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f5893fff700 1 -- 172.21.15.151:0/3427353017 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58a009b0e0 con 0x556a7b9f6210 2023-07-21T22:50:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f58ce593b80 10 client.18801 fetch_fsmap learned FSMap version 94 2023-07-21T22:50:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f58ce593b80 1 -- 172.21.15.151:0/3427353017 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x7f58b41a4f10 con 0x556a7b9f6210 2023-07-21T22:50:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f5893fff700 1 -- 172.21.15.151:0/3427353017 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556a7b89b490 con 0x556a7b9f6210 2023-07-21T22:50:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f5893fff700 1 -- 172.21.15.151:0/3427353017 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f58a0099c20 con 0x556a7b9f6210 2023-07-21T22:50:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f58ce593b80 10 client.18801 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:50:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f58ce593b80 10 client.18801 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:50:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f58ce593b80 20 client.18801 populate_metadata read hostname 'smithi151' 2023-07-21T22:50:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556a7ba09260 0x556a7ba0b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f58ce593b80 4 client.18801 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:50:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.756+0000 7f58ce593b80 1 -- 172.21.15.151:0/3427353017 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556a7b93ae50 con 0x556a7ba09260 2023-07-21T22:50:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.757+0000 7f58b899b700 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556a7ba09260 0x556a7ba0b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.758+0000 7f5893fff700 10 client.18801 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.758+0000 7f58b899b700 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556a7ba09260 0x556a7ba0b640 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfa449f3375870c7 server_cookie=bf81242470d5f1ad in_seq=0 out_seq=0 2023-07-21T22:50:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.758+0000 7f5893fff700 1 -- 172.21.15.151:0/3427353017 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556a7b93ae50 con 0x556a7ba09260 2023-07-21T22:50:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.758+0000 7f5893fff700 10 client.18801 handle_command_reply: tid=0 2023-07-21T22:50:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.758+0000 7f58ce593b80 1 client.18801 shutdown 2023-07-21T22:50:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 -- 172.21.15.151:0/3427353017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 msgr2=0x556a7b9ff820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9ff820 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f58a0097730 tx=0x7f58a00cb250 comp rx=0 tx=0).stop 2023-07-21T22:50:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 -- 172.21.15.151:0/3427353017 shutdown_connections 2023-07-21T22:50:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556a7ba09260 0x556a7ba0b640 crc :-1 s=READY pgs=375 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9ff2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9f9530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3427353017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9ff820 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f5893fff700 0 client.18801 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 -- 172.21.15.151:0/3427353017 >> 172.21.15.151:0/3427353017 conn(0x556a7b9e5ae0 msgr2=0x556a7b9ea3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 -- 172.21.15.151:0/3427353017 shutdown_connections 2023-07-21T22:50:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 1 -- 172.21.15.151:0/3427353017 wait complete. 2023-07-21T22:50:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.759+0000 7f58ce593b80 20 client.18801 trim_cache size 0 max 16384 2023-07-21T22:50:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.778+0000 7f58ce593b80 1 Processor -- start 2023-07-21T22:50:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.778+0000 7f58ce593b80 1 -- start start 2023-07-21T22:50:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9f5590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9f83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9eab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58ce593b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7b93ae50 con 0x556a7b9f6210 2023-07-21T22:50:09.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58ce593b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7b89b490 con 0x556a7b84c6b0 2023-07-21T22:50:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58ce593b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7b9ebcb0 con 0x556a7b9f6660 2023-07-21T22:50:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9f83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9f83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53758/0 (socket says 172.21.15.151:53758) 2023-07-21T22:50:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b3fff700 1 -- 172.21.15.151:0/2427410238 learned_addr learned my addr 172.21.15.151:0/2427410238 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b919c700 1 --2- 172.21.15.151:0/2427410238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9eab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b899b700 1 --2- 172.21.15.151:0/2427410238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9f5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b3fff700 1 -- 172.21.15.151:0/2427410238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 msgr2=0x556a7b9eab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b3fff700 1 --2- 172.21.15.151:0/2427410238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9eab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b3fff700 1 -- 172.21.15.151:0/2427410238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 msgr2=0x556a7b9f5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b3fff700 1 --2- 172.21.15.151:0/2427410238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9f5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.779+0000 7f58b3fff700 1 -- 172.21.15.151:0/2427410238 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556a7b758c00 con 0x556a7b9f6210 2023-07-21T22:50:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.780+0000 7f58b3fff700 1 --2- 172.21.15.151:0/2427410238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9f83f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f58a00095c0 tx=0x7f58a0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aebe885902dbb529 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.780+0000 7f589f7fe700 1 -- 172.21.15.151:0/2427410238 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a009a800 con 0x556a7b9f6210 2023-07-21T22:50:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.780+0000 7f589f7fe700 1 -- 172.21.15.151:0/2427410238 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a0079cb0 con 0x556a7b9f6210 2023-07-21T22:50:09.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.780+0000 7f589f7fe700 1 -- 172.21.15.151:0/2427410238 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a009b120 con 0x556a7b9f6210 2023-07-21T22:50:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 -- 172.21.15.151:0/2427410238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 msgr2=0x556a7b9f83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 --2- 172.21.15.151:0/2427410238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9f83f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f58a00095c0 tx=0x7f58a0000bc0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 -- 172.21.15.151:0/2427410238 shutdown_connections 2023-07-21T22:50:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 --2- 172.21.15.151:0/2427410238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b84c6b0 0x556a7b9f5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 --2- 172.21.15.151:0/2427410238 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6660 0x556a7b9eab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 --2- 172.21.15.151:0/2427410238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b9f6210 0x556a7b9f83f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 -- 172.21.15.151:0/2427410238 >> 172.21.15.151:0/2427410238 conn(0x556a7b9e5ae0 msgr2=0x556a7b9f7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 -- 172.21.15.151:0/2427410238 shutdown_connections 2023-07-21T22:50:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 -- 172.21.15.151:0/2427410238 wait complete. 2023-07-21T22:50:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.781+0000 7f58ce593b80 1 -- start start 2023-07-21T22:50:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.782+0000 7f58ce593b80 1 Processor -- start 2023-07-21T22:50:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.782+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b84c6b0 0x556a7b9fce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.782+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6210 0x556a7b9fd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.782+0000 7f58ce593b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b9f6660 0x556a7b9fd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.782+0000 7f58ce593b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7ba5c1a0 con 0x556a7b84c6b0 2023-07-21T22:50:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.782+0000 7f58ce593b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7ba5c310 con 0x556a7b9f6660 2023-07-21T22:50:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.782+0000 7f58ce593b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556a7ba5c4d0 con 0x556a7b9f6210 2023-07-21T22:50:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.782+0000 7f58ce593b80 10 client.0 _ll_register_callbacks cb 0x7f58a8009f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:50:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b899b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b84c6b0 0x556a7b9fce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b899b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b84c6b0 0x556a7b9fce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53774/0 (socket says 172.21.15.151:53774) 2023-07-21T22:50:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b899b700 1 -- 172.21.15.151:0/3661108684 learned_addr learned my addr 172.21.15.151:0/3661108684 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b3fff700 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6210 0x556a7b9fd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b919c700 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b9f6660 0x556a7b9fd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b899b700 1 -- 172.21.15.151:0/3661108684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6210 msgr2=0x556a7b9fd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b899b700 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6210 0x556a7b9fd350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b899b700 1 -- 172.21.15.151:0/3661108684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b9f6660 msgr2=0x556a7b9fd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b899b700 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b9f6660 0x556a7b9fd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b899b700 1 -- 172.21.15.151:0/3661108684 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58b41a4f10 con 0x556a7b84c6b0 2023-07-21T22:50:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b919c700 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b9f6660 0x556a7b9fd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:50:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f58b899b700 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b84c6b0 0x556a7b9fce10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x556a7ba0bec0 tx=0x7f58a80047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5716d6b45c79cd9b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.783+0000 7f5893fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:50:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.784+0000 7f5893fff700 1 -- 172.21.15.151:0/3661108684 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a8022050 con 0x556a7b84c6b0 2023-07-21T22:50:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.784+0000 7f58ce593b80 1 -- 172.21.15.151:0/3661108684 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f58a00a3080 con 0x556a7b84c6b0 2023-07-21T22:50:09.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.784+0000 7f5893fff700 1 -- 172.21.15.151:0/3661108684 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(138..138 src has 1..138) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f58a802b2e0 con 0x556a7b84c6b0 2023-07-21T22:50:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.784+0000 7f5893fff700 1 -- 172.21.15.151:0/3661108684 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=94) v2 ==== 24+0+0 (secure 0 0 0) 0x7f58a802b4a0 con 0x556a7b84c6b0 2023-07-21T22:50:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.784+0000 7f58ce593b80 10 client.18807 fetch_fsmap learned FSMap version 94 2023-07-21T22:50:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.784+0000 7f58ce593b80 1 -- 172.21.15.151:0/3661108684 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=94,monmap=4+}) v3 -- 0x556a7b7961f0 con 0x556a7b84c6b0 2023-07-21T22:50:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.784+0000 7f5893fff700 1 -- 172.21.15.151:0/3661108684 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f58a8040080 con 0x556a7b84c6b0 2023-07-21T22:50:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.785+0000 7f5893fff700 1 -- 172.21.15.151:0/3661108684 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 94) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f58a803c410 con 0x556a7b84c6b0 2023-07-21T22:50:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.785+0000 7f58ce593b80 10 client.18807 fetch_fsmap finished waiting for FSMap version 94 2023-07-21T22:50:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.785+0000 7f58ce593b80 10 client.18807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:50:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.785+0000 7f58ce593b80 20 client.18807 populate_metadata read hostname 'smithi151' 2023-07-21T22:50:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.785+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556a7ba5dca0 0x556a7ba600b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.785+0000 7f58ce593b80 4 client.18807 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:50:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.785+0000 7f58ce593b80 1 -- 172.21.15.151:0/3661108684 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556a7b8fcff0 con 0x556a7ba5dca0 2023-07-21T22:50:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.785+0000 7f58b3fff700 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556a7ba5dca0 0x556a7ba600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.786+0000 7f58b3fff700 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556a7ba5dca0 0x556a7ba600b0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41a4b978c4879043 server_cookie=b26a04aa530b5cfc in_seq=0 out_seq=0 2023-07-21T22:50:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.786+0000 7f5893fff700 10 client.18807 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f5893fff700 1 -- 172.21.15.151:0/3661108684 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556a7b8fcff0 con 0x556a7ba5dca0 2023-07-21T22:50:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f5893fff700 10 client.18807 handle_command_reply: tid=0 2023-07-21T22:50:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 client.18807 shutdown 2023-07-21T22:50:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 -- 172.21.15.151:0/3661108684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b84c6b0 msgr2=0x556a7b9fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b84c6b0 0x556a7b9fce10 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x556a7ba0bec0 tx=0x7f58a80047c0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 -- 172.21.15.151:0/3661108684 shutdown_connections 2023-07-21T22:50:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556a7ba5dca0 0x556a7ba600b0 crc :-1 s=READY pgs=376 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556a7b9f6660 0x556a7b9fd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556a7b84c6b0 0x556a7b9fce10 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 --2- 172.21.15.151:0/3661108684 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556a7b9f6210 0x556a7b9fd350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f5893fff700 0 client.18807 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 -- 172.21.15.151:0/3661108684 >> 172.21.15.151:0/3661108684 conn(0x556a7b9e5ae0 msgr2=0x556a7b9f8570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.793+0000 7f58ce593b80 1 -- 172.21.15.151:0/3661108684 shutdown_connections 2023-07-21T22:50:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.794+0000 7f58ce593b80 1 -- 172.21.15.151:0/3661108684 wait complete. 2023-07-21T22:50:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.794+0000 7f58ce593b80 20 client.18807 trim_cache size 0 max 16384 2023-07-21T22:50:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:50:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:50:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:50:09.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:50:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.794+0000 7f58babff700 1 -- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f58a40a12c0 msgr2=0x7f58a40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.794+0000 7f58babff700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f58a40a12c0 0x7f58a40a3770 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f58a8009d20 tx=0x7f58a8009260 comp rx=0 tx=0).stop 2023-07-21T22:50:09.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.794+0000 7f58babff700 1 -- 172.21.15.151:0/118643825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4102970 msgr2=0x7f58b4198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.794+0000 7f58babff700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4102970 0x7f58b4198410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009fd0 tx=0x7f58a000f690 comp rx=0 tx=0).stop 2023-07-21T22:50:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.795+0000 7f58babff700 1 -- 172.21.15.151:0/118643825 shutdown_connections 2023-07-21T22:50:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.795+0000 7f58babff700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f58a40a12c0 0x7f58a40a3770 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.795+0000 7f58babff700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58b4101fd0 0x7f58b4197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.795+0000 7f58babff700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58b4107010 0x7f58b419ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.795+0000 7f58babff700 1 --2- 172.21.15.151:0/118643825 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f58b4102970 0x7f58b4198410 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:09.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.795+0000 7f58babff700 1 -- 172.21.15.151:0/118643825 >> 172.21.15.151:0/118643825 conn(0x7f58b40fd840 msgr2=0x7f58b40fe380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.795+0000 7f58babff700 1 -- 172.21.15.151:0/118643825 shutdown_connections 2023-07-21T22:50:09.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:09.795+0000 7f58babff700 1 -- 172.21.15.151:0/118643825 wait complete. 2023-07-21T22:50:10.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:09 smithi187 ceph-mon[96918]: osdmap e138: 12 total, 12 up, 12 in 2023-07-21T22:50:10.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:09 smithi187 ceph-mon[96918]: pgmap v982: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 32 MiB/s wr, 38 op/s 2023-07-21T22:50:10.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:09 smithi195 ceph-mon[97365]: osdmap e138: 12 total, 12 up, 12 in 2023-07-21T22:50:10.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:09 smithi195 ceph-mon[97365]: pgmap v982: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 32 MiB/s wr, 38 op/s 2023-07-21T22:50:10.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:09 smithi151 ceph-mon[95510]: osdmap e138: 12 total, 12 up, 12 in 2023-07-21T22:50:10.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:09 smithi151 ceph-mon[95510]: pgmap v982: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 32 MiB/s wr, 38 op/s 2023-07-21T22:50:13.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:12 smithi187 ceph-mon[96918]: pgmap v983: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 32 MiB/s wr, 38 op/s 2023-07-21T22:50:13.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:12 smithi195 ceph-mon[97365]: pgmap v983: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 32 MiB/s wr, 38 op/s 2023-07-21T22:50:13.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:12 smithi151 ceph-mon[95510]: pgmap v983: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 32 MiB/s wr, 38 op/s 2023-07-21T22:50:15.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:14 smithi187 ceph-mon[96918]: pgmap v984: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 27 MiB/s wr, 189 op/s 2023-07-21T22:50:15.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:14 smithi195 ceph-mon[97365]: pgmap v984: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 27 MiB/s wr, 189 op/s 2023-07-21T22:50:15.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:14 smithi151 ceph-mon[95510]: pgmap v984: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 27 MiB/s wr, 189 op/s 2023-07-21T22:50:17.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:16 smithi187 ceph-mon[96918]: pgmap v985: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 27 MiB/s wr, 189 op/s 2023-07-21T22:50:17.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:16 smithi187 ceph-mon[96918]: osdmap e139: 12 total, 12 up, 12 in 2023-07-21T22:50:17.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:16 smithi195 ceph-mon[97365]: pgmap v985: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 27 MiB/s wr, 189 op/s 2023-07-21T22:50:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:16 smithi195 ceph-mon[97365]: osdmap e139: 12 total, 12 up, 12 in 2023-07-21T22:50:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:16 smithi151 ceph-mon[95510]: pgmap v985: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 27 MiB/s wr, 189 op/s 2023-07-21T22:50:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:16 smithi151 ceph-mon[95510]: osdmap e139: 12 total, 12 up, 12 in 2023-07-21T22:50:18.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:17 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:50:18.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:17 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:50:18.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:17 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:50:18.560 INFO:teuthology.orchestra.run.smithi151.stderr:set primary keys... 2023-07-21T22:50:19.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:18 smithi187 ceph-mon[96918]: pgmap v987: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 13 MiB/s wr, 1.01k op/s 2023-07-21T22:50:19.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:18 smithi195 ceph-mon[97365]: pgmap v987: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 13 MiB/s wr, 1.01k op/s 2023-07-21T22:50:19.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:18 smithi151 ceph-mon[95510]: pgmap v987: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 10 MiB/s rd, 13 MiB/s wr, 1.01k op/s 2023-07-21T22:50:20.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:19 smithi187 ceph-mon[96918]: pgmap v988: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 11 MiB/s wr, 867 op/s 2023-07-21T22:50:20.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:19 smithi195 ceph-mon[97365]: pgmap v988: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 11 MiB/s wr, 867 op/s 2023-07-21T22:50:20.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:19 smithi151 ceph-mon[95510]: pgmap v988: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 11 MiB/s wr, 867 op/s 2023-07-21T22:50:22.370 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:22 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:50:22.370 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:22 smithi187 ceph-mon[96918]: pgmap v989: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 11 MiB/s wr, 867 op/s 2023-07-21T22:50:22.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:22 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:50:22.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:22 smithi195 ceph-mon[97365]: pgmap v989: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 11 MiB/s wr, 867 op/s 2023-07-21T22:50:22.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:22 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:50:22.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:22 smithi151 ceph-mon[95510]: pgmap v989: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 MiB/s rd, 11 MiB/s wr, 867 op/s 2023-07-21T22:50:22.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.952+0000 7f0c88fff700 1 -- 172.21.15.151:0/3725843234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c840731c0 msgr2=0x7f0c8410be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.952+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3725843234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c840731c0 0x7f0c8410be00 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f0c78009990 tx=0x7f0c78009ca0 comp rx=0 tx=0).stop 2023-07-21T22:50:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.952+0000 7f0c88fff700 1 -- 172.21.15.151:0/3725843234 shutdown_connections 2023-07-21T22:50:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.952+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3725843234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c8410c340 0x7f0c8410e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.952+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3725843234 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c840728b0 0x7f0c84072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.952+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3725843234 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c840731c0 0x7f0c8410be00 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.952+0000 7f0c88fff700 1 -- 172.21.15.151:0/3725843234 >> 172.21.15.151:0/3725843234 conn(0x7f0c840fb600 msgr2=0x7f0c840fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:22.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.952+0000 7f0c88fff700 1 -- 172.21.15.151:0/3725843234 shutdown_connections 2023-07-21T22:50:22.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.952+0000 7f0c88fff700 1 -- 172.21.15.151:0/3725843234 wait complete. 2023-07-21T22:50:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.953+0000 7f0c88fff700 1 Processor -- start 2023-07-21T22:50:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.953+0000 7f0c88fff700 1 -- start start 2023-07-21T22:50:22.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.953+0000 7f0c88fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c840728b0 0x7f0c8419dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.953+0000 7f0c88fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c840731c0 0x7f0c8419e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.953+0000 7f0c88fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c8410c340 0x7f0c84197b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.953+0000 7f0c88fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c841981b0 con 0x7f0c8410c340 2023-07-21T22:50:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.953+0000 7f0c88fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c84198320 con 0x7f0c840731c0 2023-07-21T22:50:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.953+0000 7f0c88fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c841984e0 con 0x7f0c840728b0 2023-07-21T22:50:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c82d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c8410c340 0x7f0c84197b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c82d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c8410c340 0x7f0c84197b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60274/0 (socket says 172.21.15.151:60274) 2023-07-21T22:50:22.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c82d9d700 1 -- 172.21.15.151:0/3739032423 learned_addr learned my addr 172.21.15.151:0/3739032423 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c840731c0 0x7f0c8419e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c8259c700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c840728b0 0x7f0c8419dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c82d9d700 1 -- 172.21.15.151:0/3739032423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c840728b0 msgr2=0x7f0c8419dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c840728b0 0x7f0c8419dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c82d9d700 1 -- 172.21.15.151:0/3739032423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c840731c0 msgr2=0x7f0c8419e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c840731c0 0x7f0c8419e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:22.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c82d9d700 1 -- 172.21.15.151:0/3739032423 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c780095f0 con 0x7f0c8410c340 2023-07-21T22:50:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c8259c700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c840728b0 0x7f0c8419dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:50:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.954+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c8410c340 0x7f0c84197b40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00ef30 tx=0x7f0c7c00c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.955+0000 7f0c737fe700 1 -- 172.21.15.151:0/3739032423 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c018070 con 0x7f0c8410c340 2023-07-21T22:50:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.955+0000 7f0c88fff700 1 -- 172.21.15.151:0/3739032423 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c84198760 con 0x7f0c8410c340 2023-07-21T22:50:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.955+0000 7f0c737fe700 1 -- 172.21.15.151:0/3739032423 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c7c00f040 con 0x7f0c8410c340 2023-07-21T22:50:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.955+0000 7f0c737fe700 1 -- 172.21.15.151:0/3739032423 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c00cc30 con 0x7f0c8410c340 2023-07-21T22:50:22.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.955+0000 7f0c88fff700 1 -- 172.21.15.151:0/3739032423 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c841a4cd0 con 0x7f0c8410c340 2023-07-21T22:50:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.958+0000 7f0c737fe700 1 -- 172.21.15.151:0/3739032423 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0c7c007500 con 0x7f0c8410c340 2023-07-21T22:50:22.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.959+0000 7f0c9c91cb80 1 Processor -- start 2023-07-21T22:50:22.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.959+0000 7f0c9c91cb80 1 -- start start 2023-07-21T22:50:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 0x564b060bfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c737fe700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c6c0a12c0 0x7f0c6c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 0x564b060b9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060ba4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b05fbfc50 con 0x564b060c0660 2023-07-21T22:50:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b060129e0 con 0x564b060c0210 2023-07-21T22:50:22.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0600be70 con 0x564b05f166b0 2023-07-21T22:50:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c737fe700 1 -- 172.21.15.151:0/3739032423 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0c7c0cc820 con 0x7f0c8410c340 2023-07-21T22:50:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c82d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060ba4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c82d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060ba4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60288/0 (socket says 172.21.15.151:60288) 2023-07-21T22:50:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c82d9d700 1 -- 172.21.15.151:0/38291822 learned_addr learned my addr 172.21.15.151:0/38291822 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c8259c700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c6c0a12c0 0x7f0c6c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/38291822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 0x564b060bfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.960+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/38291822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 0x564b060b9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c82d9d700 1 -- 172.21.15.151:0/38291822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 msgr2=0x564b060bfcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/38291822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 0x564b060bfcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c82d9d700 1 -- 172.21.15.151:0/38291822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 msgr2=0x564b060b9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/38291822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 0x564b060b9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c82d9d700 1 -- 172.21.15.151:0/38291822 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b05e39d80 con 0x564b060c0660 2023-07-21T22:50:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/38291822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060ba4a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0090a0 tx=0x7f0c7c0993a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f570db69b2efdb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c8259c700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c6c0a12c0 0x7f0c6c0a3770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0c74005950 tx=0x7f0c740058e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c70ff9700 1 -- 172.21.15.151:0/38291822 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c09d970 con 0x564b060c0660 2023-07-21T22:50:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c70ff9700 1 -- 172.21.15.151:0/38291822 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c7c084040 con 0x564b060c0660 2023-07-21T22:50:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.961+0000 7f0c70ff9700 1 -- 172.21.15.151:0/38291822 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c097b10 con 0x564b060c0660 2023-07-21T22:50:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.962+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/38291822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 msgr2=0x564b060ba4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.962+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/38291822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060ba4a0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0090a0 tx=0x7f0c7c0993a0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.962+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/38291822 shutdown_connections 2023-07-21T22:50:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.962+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/38291822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060ba4a0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.962+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/38291822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 0x564b060bfcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.962+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/38291822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 0x564b060b9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.962+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/38291822 >> 172.21.15.151:0/38291822 conn(0x564b060afae0 msgr2=0x564b060b50e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.962+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/38291822 shutdown_connections 2023-07-21T22:50:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.962+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/38291822 wait complete. 2023-07-21T22:50:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.963+0000 7f0c9c91cb80 1 -- start start 2023-07-21T22:50:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.963+0000 7f0c9c91cb80 1 Processor -- start 2023-07-21T22:50:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b05f166b0 0x564b060c6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0210 0x564b060c3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0660 0x564b060c3f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b05faba60 con 0x564b060c0210 2023-07-21T22:50:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b05fab760 con 0x564b05f166b0 2023-07-21T22:50:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b05e8f8c0 con 0x564b060c0660 2023-07-21T22:50:23.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c9c91cb80 10 client.0 _ll_register_callbacks cb 0x564b05fa9700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:50:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c81d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0210 0x564b060c3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c81d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0210 0x564b060c3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60300/0 (socket says 172.21.15.151:60300) 2023-07-21T22:50:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c81d9b700 1 -- 172.21.15.151:0/2197087945 learned_addr learned my addr 172.21.15.151:0/2197087945 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c8259c700 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b05f166b0 0x564b060c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c81d9b700 1 -- 172.21.15.151:0/2197087945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0660 msgr2=0x564b060c3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0660 0x564b060c3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c81d9b700 1 -- 172.21.15.151:0/2197087945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b05f166b0 msgr2=0x564b060c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b05f166b0 0x564b060c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.964+0000 7f0c81d9b700 1 -- 172.21.15.151:0/2197087945 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c841a4cd0 con 0x564b060c0210 2023-07-21T22:50:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.965+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0210 0x564b060c3880 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0c780098e0 tx=0x7f0c7800bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d279b3cc1e32c55a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.965+0000 7f0c69ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:50:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.965+0000 7f0c69ffb700 1 -- 172.21.15.151:0/2197087945 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c78004710 con 0x564b060c0210 2023-07-21T22:50:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.965+0000 7f0c69ffb700 1 -- 172.21.15.151:0/2197087945 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0c78004870 con 0x564b060c0210 2023-07-21T22:50:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.965+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2197087945 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564b05f65490 con 0x564b060c0210 2023-07-21T22:50:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.965+0000 7f0c69ffb700 1 -- 172.21.15.151:0/2197087945 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c78004a30 con 0x564b060c0210 2023-07-21T22:50:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.965+0000 7f0c9c91cb80 10 client.18819 fetch_fsmap learned FSMap version 96 2023-07-21T22:50:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.965+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2197087945 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=4+}) v3 -- 0x564b05e22c00 con 0x564b060c0210 2023-07-21T22:50:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.965+0000 7f0c69ffb700 1 -- 172.21.15.151:0/2197087945 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c78035020 con 0x564b060c0210 2023-07-21T22:50:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.966+0000 7f0c69ffb700 1 -- 172.21.15.151:0/2197087945 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 96) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0c7800fb90 con 0x564b060c0210 2023-07-21T22:50:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.966+0000 7f0c9c91cb80 10 client.18819 fetch_fsmap finished waiting for FSMap version 96 2023-07-21T22:50:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.966+0000 7f0c9c91cb80 10 client.18819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:50:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.966+0000 7f0c9c91cb80 20 client.18819 populate_metadata read hostname 'smithi151' 2023-07-21T22:50:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.966+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564b060d3b00 0x564b060d5f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.966+0000 7f0c9c91cb80 4 client.18819 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:50:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.966+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2197087945 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564b06004e50 con 0x564b060d3b00 2023-07-21T22:50:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.966+0000 7f0c8259c700 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564b060d3b00 0x564b060d5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.967+0000 7f0c69ffb700 10 client.18819 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.967+0000 7f0c8259c700 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564b060d3b00 0x564b060d5f10 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afaf1e95e5485ac2 server_cookie=86903de9b562b791 in_seq=0 out_seq=0 2023-07-21T22:50:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c69ffb700 1 -- 172.21.15.151:0/2197087945 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564b06004e50 con 0x564b060d3b00 2023-07-21T22:50:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c69ffb700 10 client.18819 handle_command_reply: tid=0 2023-07-21T22:50:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 client.18819 shutdown 2023-07-21T22:50:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2197087945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0210 msgr2=0x564b060c3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0210 0x564b060c3880 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f0c780098e0 tx=0x7f0c7800bb30 comp rx=0 tx=0).stop 2023-07-21T22:50:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2197087945 shutdown_connections 2023-07-21T22:50:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564b060d3b00 0x564b060d5f10 crc :-1 s=READY pgs=377 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b05f166b0 0x564b060c6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0660 0x564b060c3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c69ffb700 0 client.18819 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2197087945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0210 0x564b060c3880 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2197087945 >> 172.21.15.151:0/2197087945 conn(0x564b060afae0 msgr2=0x564b060b43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2197087945 shutdown_connections 2023-07-21T22:50:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2197087945 wait complete. 2023-07-21T22:50:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.968+0000 7f0c9c91cb80 20 client.18819 trim_cache size 0 max 16384 2023-07-21T22:50:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.983+0000 7f0c9c91cb80 1 Processor -- start 2023-07-21T22:50:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.983+0000 7f0c9c91cb80 1 -- start start 2023-07-21T22:50:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 0x564b060c37a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 0x564b060bf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060c9150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b060b5d50 con 0x564b060c0660 2023-07-21T22:50:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b060acb20 con 0x564b060c0210 2023-07-21T22:50:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b060bacd0 con 0x564b05f166b0 2023-07-21T22:50:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c82d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060c9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c82d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060c9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60310/0 (socket says 172.21.15.151:60310) 2023-07-21T22:50:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c82d9d700 1 -- 172.21.15.151:0/2279205572 learned_addr learned my addr 172.21.15.151:0/2279205572 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c8259c700 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 0x564b060c37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 0x564b060bf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c82d9d700 1 -- 172.21.15.151:0/2279205572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 msgr2=0x564b060c37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 0x564b060c37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c82d9d700 1 -- 172.21.15.151:0/2279205572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 msgr2=0x564b060bf220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 0x564b060bf220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c82d9d700 1 -- 172.21.15.151:0/2279205572 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564b05e601f0 con 0x564b060c0660 2023-07-21T22:50:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.984+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 0x564b060bf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:50:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060c9150 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0998d0 tx=0x7f0c7c099710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48dab2ff78d1cdaf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c717fa700 1 -- 172.21.15.151:0/2279205572 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c09d970 con 0x564b060c0660 2023-07-21T22:50:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c717fa700 1 -- 172.21.15.151:0/2279205572 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c7c0a1d00 con 0x564b060c0660 2023-07-21T22:50:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c717fa700 1 -- 172.21.15.151:0/2279205572 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7c0ca3f0 con 0x564b060c0660 2023-07-21T22:50:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2279205572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 msgr2=0x564b060c9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060c9150 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c0998d0 tx=0x7f0c7c099710 comp rx=0 tx=0).stop 2023-07-21T22:50:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2279205572 shutdown_connections 2023-07-21T22:50:23.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b060c0660 0x564b060c9150 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b05f166b0 0x564b060c37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/2279205572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0210 0x564b060bf220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2279205572 >> 172.21.15.151:0/2279205572 conn(0x564b060afae0 msgr2=0x564b060c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2279205572 shutdown_connections 2023-07-21T22:50:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.985+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/2279205572 wait complete. 2023-07-21T22:50:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.986+0000 7f0c9c91cb80 1 -- start start 2023-07-21T22:50:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.986+0000 7f0c9c91cb80 1 Processor -- start 2023-07-21T22:50:23.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.986+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b05f166b0 0x564b0611bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.986+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0210 0x564b0611c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.986+0000 7f0c9c91cb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0660 0x564b061269d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.986+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b0611c790 con 0x564b05f166b0 2023-07-21T22:50:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.986+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b06126f10 con 0x564b060c0660 2023-07-21T22:50:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.986+0000 7f0c9c91cb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564b06127080 con 0x564b060c0210 2023-07-21T22:50:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c9c91cb80 10 client.0 _ll_register_callbacks cb 0x7f0c78005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:50:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c8259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b05f166b0 0x564b0611bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c8259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b05f166b0 0x564b0611bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60320/0 (socket says 172.21.15.151:60320) 2023-07-21T22:50:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c8259c700 1 -- 172.21.15.151:0/623925070 learned_addr learned my addr 172.21.15.151:0/623925070 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0210 0x564b0611c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c82d9d700 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0660 0x564b061269d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c8259c700 1 -- 172.21.15.151:0/623925070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0210 msgr2=0x564b0611c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:23.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c8259c700 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0210 0x564b0611c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c8259c700 1 -- 172.21.15.151:0/623925070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0660 msgr2=0x564b061269d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c8259c700 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0660 0x564b061269d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c8259c700 1 -- 172.21.15.151:0/623925070 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x564b05e39d80 con 0x564b05f166b0 2023-07-21T22:50:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.987+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0210 0x564b0611c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:50:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c8259c700 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b05f166b0 0x564b0611bb40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x564b060d6820 tx=0x7f0c74004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f2c37f5c371a8c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c69ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:50:23.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c69ffb700 1 -- 172.21.15.151:0/623925070 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7402a070 con 0x564b05f166b0 2023-07-21T22:50:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/623925070 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0c7c084040 con 0x564b05f166b0 2023-07-21T22:50:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c69ffb700 1 -- 172.21.15.151:0/623925070 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0c74003890 con 0x564b05f166b0 2023-07-21T22:50:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c69ffb700 1 -- 172.21.15.151:0/623925070 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0c74017040 con 0x564b05f166b0 2023-07-21T22:50:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c9c91cb80 10 client.18825 fetch_fsmap learned FSMap version 96 2023-07-21T22:50:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/623925070 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=4+}) v3 -- 0x564b05e38250 con 0x564b05f166b0 2023-07-21T22:50:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c69ffb700 1 -- 172.21.15.151:0/623925070 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0c7c084040 con 0x564b05f166b0 2023-07-21T22:50:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c69ffb700 1 -- 172.21.15.151:0/623925070 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 96) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f0c7401d050 con 0x564b05f166b0 2023-07-21T22:50:23.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c9c91cb80 10 client.18825 fetch_fsmap finished waiting for FSMap version 96 2023-07-21T22:50:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c9c91cb80 10 client.18825 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:50:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c9c91cb80 20 client.18825 populate_metadata read hostname 'smithi151' 2023-07-21T22:50:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.988+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564b061287b0 0x564b0612abc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.989+0000 7f0c9c91cb80 4 client.18825 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:50:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.989+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/623925070 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x564b05fc6ff0 con 0x564b061287b0 2023-07-21T22:50:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.989+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564b061287b0 0x564b0612abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:23.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.989+0000 7f0c81d9b700 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564b061287b0 0x564b0612abc0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aea2557d8cb932b server_cookie=3f800458dd3ea50 in_seq=0 out_seq=0 2023-07-21T22:50:23.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:22.989+0000 7f0c69ffb700 10 client.18825 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.011+0000 7f0c69ffb700 1 -- 172.21.15.151:0/623925070 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x564b05fc6ff0 con 0x564b061287b0 2023-07-21T22:50:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.011+0000 7f0c69ffb700 10 client.18825 handle_command_reply: tid=0 2023-07-21T22:50:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.011+0000 7f0c9c91cb80 1 client.18825 shutdown 2023-07-21T22:50:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.011+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/623925070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b05f166b0 msgr2=0x564b0611bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.011+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b05f166b0 0x564b0611bb40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x564b060d6820 tx=0x7f0c74004750 comp rx=0 tx=0).stop 2023-07-21T22:50:23.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/623925070 shutdown_connections 2023-07-21T22:50:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x564b061287b0 0x564b0612abc0 crc :-1 s=READY pgs=378 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x564b060c0660 0x564b061269d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564b05f166b0 0x564b0611bb40 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c69ffb700 0 client.18825 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c9c91cb80 1 --2- 172.21.15.151:0/623925070 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x564b060c0210 0x564b0611c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/623925070 >> 172.21.15.151:0/623925070 conn(0x564b060afae0 msgr2=0x564b060c12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/623925070 shutdown_connections 2023-07-21T22:50:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c9c91cb80 1 -- 172.21.15.151:0/623925070 wait complete. 2023-07-21T22:50:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.012+0000 7f0c9c91cb80 20 client.18825 trim_cache size 0 max 16384 2023-07-21T22:50:23.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:50:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:50:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:50:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:50:23.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 -- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c6c0a12c0 msgr2=0x7f0c6c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c6c0a12c0 0x7f0c6c0a3770 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0c74005950 tx=0x7f0c740058e0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 -- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c8410c340 msgr2=0x7f0c84197b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c8410c340 0x7f0c84197b40 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c00ef30 tx=0x7f0c7c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 -- 172.21.15.151:0/3739032423 shutdown_connections 2023-07-21T22:50:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0c6c0a12c0 0x7f0c6c0a3770 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0c8410c340 0x7f0c84197b40 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0c840728b0 0x7f0c8419dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 --2- 172.21.15.151:0/3739032423 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c840731c0 0x7f0c8419e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 -- 172.21.15.151:0/3739032423 >> 172.21.15.151:0/3739032423 conn(0x7f0c840fb600 msgr2=0x7f0c8410e450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 -- 172.21.15.151:0/3739032423 shutdown_connections 2023-07-21T22:50:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:23.013+0000 7f0c88fff700 1 -- 172.21.15.151:0/3739032423 wait complete. 2023-07-21T22:50:24.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:24 smithi195 ceph-mon[97365]: pgmap v990: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 128 KiB/s wr, 894 op/s 2023-07-21T22:50:24.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:50:24.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:24 smithi151 ceph-mon[95510]: pgmap v990: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 128 KiB/s wr, 894 op/s 2023-07-21T22:50:24.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:50:24.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:24 smithi187 ceph-mon[96918]: pgmap v990: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 128 KiB/s wr, 894 op/s 2023-07-21T22:50:24.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:50:26.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:26 smithi195 ceph-mon[97365]: pgmap v991: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 128 KiB/s wr, 894 op/s 2023-07-21T22:50:26.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:26 smithi151 ceph-mon[95510]: pgmap v991: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 128 KiB/s wr, 894 op/s 2023-07-21T22:50:26.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:26 smithi187 ceph-mon[96918]: pgmap v991: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 MiB/s rd, 128 KiB/s wr, 894 op/s 2023-07-21T22:50:29.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: pgmap v992: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 MiB/s rd, 3.0 MiB/s wr, 1.21k op/s 2023-07-21T22:50:29.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:28 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: pgmap v992: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 MiB/s rd, 3.0 MiB/s wr, 1.21k op/s 2023-07-21T22:50:29.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:28 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: pgmap v992: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 MiB/s rd, 3.0 MiB/s wr, 1.21k op/s 2023-07-21T22:50:29.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:29.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:29.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:28 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:50:30.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:50:30.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:50:30.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:50:30.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:50:30.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:50:30.123 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:29 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:30.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:50:30.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:50:30.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:50:30.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:50:30.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:50:30.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:50:30.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:29 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:30.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T22:50:30.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:50:30.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T22:50:30.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T22:50:30.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T22:50:30.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:50:30.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:50:30.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:29 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:50:31.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:30 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:50:31.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:30 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:50:31.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:30 smithi187 ceph-mon[96918]: pgmap v993: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.6 MiB/s wr, 491 op/s 2023-07-21T22:50:31.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:30 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:50:31.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:30 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:50:31.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:30 smithi195 ceph-mon[97365]: pgmap v993: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.6 MiB/s wr, 491 op/s 2023-07-21T22:50:31.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:30 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T22:50:31.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:30 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T22:50:31.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:30 smithi151 ceph-mon[95510]: pgmap v993: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.6 MiB/s wr, 491 op/s 2023-07-21T22:50:33.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:32 smithi187 ceph-mon[96918]: pgmap v994: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.6 MiB/s wr, 491 op/s 2023-07-21T22:50:33.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:32 smithi195 ceph-mon[97365]: pgmap v994: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.6 MiB/s wr, 491 op/s 2023-07-21T22:50:33.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:32 smithi151 ceph-mon[95510]: pgmap v994: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 26 MiB/s rd, 2.6 MiB/s wr, 491 op/s 2023-07-21T22:50:35.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:34 smithi187 ceph-mon[96918]: pgmap v995: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 7.4 MiB/s wr, 943 op/s 2023-07-21T22:50:35.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:34 smithi195 ceph-mon[97365]: pgmap v995: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 7.4 MiB/s wr, 943 op/s 2023-07-21T22:50:35.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:34 smithi151 ceph-mon[95510]: pgmap v995: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 61 MiB/s rd, 7.4 MiB/s wr, 943 op/s 2023-07-21T22:50:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.180+0000 7ff1637ff700 1 -- 172.21.15.151:0/3127379648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff15c100dd0 msgr2=0x7ff15c1011a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.180+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3127379648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff15c100dd0 0x7ff15c1011a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7ff15800b0a0 tx=0x7ff15800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.180+0000 7ff1637ff700 1 -- 172.21.15.151:0/3127379648 shutdown_connections 2023-07-21T22:50:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.180+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3127379648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff15c10a110 0x7ff15c10c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.180+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3127379648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff15c100dd0 0x7ff15c1011a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.180+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3127379648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff15c1016e0 0x7ff15c109bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.180+0000 7ff1637ff700 1 -- 172.21.15.151:0/3127379648 >> 172.21.15.151:0/3127379648 conn(0x7ff15c075ba0 msgr2=0x7ff15c075fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.180+0000 7ff1637ff700 1 -- 172.21.15.151:0/3127379648 shutdown_connections 2023-07-21T22:50:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.180+0000 7ff1637ff700 1 -- 172.21.15.151:0/3127379648 wait complete. 2023-07-21T22:50:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.181+0000 7ff1637ff700 1 Processor -- start 2023-07-21T22:50:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.181+0000 7ff1637ff700 1 -- start start 2023-07-21T22:50:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.181+0000 7ff1637ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff15c100dd0 0x7ff15c197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.181+0000 7ff1637ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff15c1016e0 0x7ff15c1983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.181+0000 7ff1637ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff15c10a110 0x7ff15c19ca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff1637ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c19d060 con 0x7ff15c10a110 2023-07-21T22:50:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff1637ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c19d1d0 con 0x7ff15c1016e0 2023-07-21T22:50:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff1637ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff15c19d390 con 0x7ff15c100dd0 2023-07-21T22:50:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff16159b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff15c100dd0 0x7ff15c197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff161d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff15c10a110 0x7ff15c19ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff16159b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff15c100dd0 0x7ff15c197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:35764/0 (socket says 172.21.15.151:35764) 2023-07-21T22:50:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff16159b700 1 -- 172.21.15.151:0/3287385828 learned_addr learned my addr 172.21.15.151:0/3287385828 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff160d9a700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff15c1016e0 0x7ff15c1983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff16159b700 1 -- 172.21.15.151:0/3287385828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff15c1016e0 msgr2=0x7ff15c1983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:36.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff16159b700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff15c1016e0 0x7ff15c1983b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff16159b700 1 -- 172.21.15.151:0/3287385828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff15c10a110 msgr2=0x7ff15c19ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff16159b700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff15c10a110 0x7ff15c19ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.182+0000 7ff16159b700 1 -- 172.21.15.151:0/3287385828 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158009d00 con 0x7ff15c100dd0 2023-07-21T22:50:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.183+0000 7ff16159b700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff15c100dd0 0x7ff15c197e70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff15800b070 tx=0x7ff1580079b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.183+0000 7ff1527fc700 1 -- 172.21.15.151:0/3287385828 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15800e040 con 0x7ff15c100dd0 2023-07-21T22:50:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.183+0000 7ff1637ff700 1 -- 172.21.15.151:0/3287385828 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff15c19d610 con 0x7ff15c100dd0 2023-07-21T22:50:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.183+0000 7ff1527fc700 1 -- 172.21.15.151:0/3287385828 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff15800be40 con 0x7ff15c100dd0 2023-07-21T22:50:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.183+0000 7ff1527fc700 1 -- 172.21.15.151:0/3287385828 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158005040 con 0x7ff15c100dd0 2023-07-21T22:50:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.183+0000 7ff1637ff700 1 -- 172.21.15.151:0/3287385828 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c1a4eb0 con 0x7ff15c100dd0 2023-07-21T22:50:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.187+0000 7ff1527fc700 1 -- 172.21.15.151:0/3287385828 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff15801b450 con 0x7ff15c100dd0 2023-07-21T22:50:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.188+0000 7ff1527fc700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1480a12c0 0x7ff1480a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.188+0000 7ff1527fc700 1 -- 172.21.15.151:0/3287385828 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff1580ce150 con 0x7ff15c100dd0 2023-07-21T22:50:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.189+0000 7ff160d9a700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1480a12c0 0x7ff1480a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.189+0000 7ff1770b5b80 1 Processor -- start 2023-07-21T22:50:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.189+0000 7ff1770b5b80 1 -- start start 2023-07-21T22:50:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.189+0000 7ff160d9a700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1480a12c0 0x7ff1480a3770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff15c199690 tx=0x7ff14c009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.189+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8d7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 0x562aeb8d1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 0x562aeb8d24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb7d7c50 con 0x562aeb8d8210 2023-07-21T22:50:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb82a9e0 con 0x562aeb72e6b0 2023-07-21T22:50:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb823e70 con 0x562aeb8d8660 2023-07-21T22:50:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff16159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8d7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff160d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 0x562aeb8d1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff16159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8d7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57272/0 (socket says 172.21.15.151:57272) 2023-07-21T22:50:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff16159b700 1 -- 172.21.15.151:0/3911641820 learned_addr learned my addr 172.21.15.151:0/3911641820 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff161d9c700 1 --2- 172.21.15.151:0/3911641820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 0x562aeb8d24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff16159b700 1 -- 172.21.15.151:0/3911641820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 msgr2=0x562aeb8d24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff16159b700 1 --2- 172.21.15.151:0/3911641820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 0x562aeb8d24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff16159b700 1 -- 172.21.15.151:0/3911641820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 msgr2=0x562aeb8d1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff16159b700 1 --2- 172.21.15.151:0/3911641820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 0x562aeb8d1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.190+0000 7ff16159b700 1 -- 172.21.15.151:0/3911641820 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aeb651d80 con 0x562aeb72e6b0 2023-07-21T22:50:36.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.191+0000 7ff16159b700 1 --2- 172.21.15.151:0/3911641820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8d7cd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff158097770 tx=0x7ff15809b140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ba260de7c8208932 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.191+0000 7ff1477fe700 1 -- 172.21.15.151:0/3911641820 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15809f080 con 0x562aeb72e6b0 2023-07-21T22:50:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.191+0000 7ff1477fe700 1 -- 172.21.15.151:0/3911641820 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff15809b270 con 0x562aeb72e6b0 2023-07-21T22:50:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.191+0000 7ff1477fe700 1 -- 172.21.15.151:0/3911641820 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1580996a0 con 0x562aeb72e6b0 2023-07-21T22:50:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3911641820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 msgr2=0x562aeb8d7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3911641820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8d7cd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7ff158097770 tx=0x7ff15809b140 comp rx=0 tx=0).stop 2023-07-21T22:50:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3911641820 shutdown_connections 2023-07-21T22:50:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3911641820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8d7cd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3911641820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 0x562aeb8d24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3911641820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 0x562aeb8d1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3911641820 >> 172.21.15.151:0/3911641820 conn(0x562aeb8c7ae0 msgr2=0x562aeb8cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3911641820 shutdown_connections 2023-07-21T22:50:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3911641820 wait complete. 2023-07-21T22:50:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.192+0000 7ff1770b5b80 1 -- start start 2023-07-21T22:50:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.193+0000 7ff1770b5b80 1 Processor -- start 2023-07-21T22:50:36.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.193+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.193+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8210 0x562aeb8e18d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.193+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8660 0x562aeb8db5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.193+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb7c3a60 con 0x562aeb72e6b0 2023-07-21T22:50:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.193+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb7c3760 con 0x562aeb8d8660 2023-07-21T22:50:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.193+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb6a78c0 con 0x562aeb8d8210 2023-07-21T22:50:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.193+0000 7ff1770b5b80 10 client.0 _ll_register_callbacks cb 0x562aeb7c1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:50:36.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff16159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff160d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8210 0x562aeb8e18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff16159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43930/0 (socket says 172.21.15.151:43930) 2023-07-21T22:50:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff16159b700 1 -- 172.21.15.151:0/3130900249 learned_addr learned my addr 172.21.15.151:0/3130900249 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff161d9c700 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8660 0x562aeb8db5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff16159b700 1 -- 172.21.15.151:0/3130900249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8210 msgr2=0x562aeb8e18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff16159b700 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8210 0x562aeb8e18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff16159b700 1 -- 172.21.15.151:0/3130900249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8660 msgr2=0x562aeb8db5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:36.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff16159b700 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8660 0x562aeb8db5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff16159b700 1 -- 172.21.15.151:0/3130900249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff15c1a4eb0 con 0x562aeb72e6b0 2023-07-21T22:50:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff16159b700 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1390 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff1580cbde0 tx=0x7ff15801a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b9c420590f55b2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.194+0000 7ff144ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:50:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff144ff9700 1 -- 172.21.15.151:0/3130900249 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15809f2a0 con 0x562aeb72e6b0 2023-07-21T22:50:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff144ff9700 1 -- 172.21.15.151:0/3130900249 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff1580a3630 con 0x562aeb72e6b0 2023-07-21T22:50:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3130900249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562aeb77d490 con 0x562aeb72e6b0 2023-07-21T22:50:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff144ff9700 1 -- 172.21.15.151:0/3130900249 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff15801b700 con 0x562aeb72e6b0 2023-07-21T22:50:36.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff1770b5b80 10 client.18837 fetch_fsmap learned FSMap version 96 2023-07-21T22:50:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3130900249 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=4+}) v3 -- 0x562aeb63ac00 con 0x562aeb72e6b0 2023-07-21T22:50:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff144ff9700 1 -- 172.21.15.151:0/3130900249 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562aeb77d490 con 0x562aeb72e6b0 2023-07-21T22:50:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff144ff9700 1 -- 172.21.15.151:0/3130900249 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 96) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff15809a760 con 0x562aeb72e6b0 2023-07-21T22:50:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff1770b5b80 10 client.18837 fetch_fsmap finished waiting for FSMap version 96 2023-07-21T22:50:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff1770b5b80 10 client.18837 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:50:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff1770b5b80 20 client.18837 populate_metadata read hostname 'smithi151' 2023-07-21T22:50:36.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aeb8eb310 0x562aeb8ed6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff1770b5b80 4 client.18837 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:50:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.195+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3130900249 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562aeb81ce50 con 0x562aeb8eb310 2023-07-21T22:50:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.196+0000 7ff160d9a700 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aeb8eb310 0x562aeb8ed6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.197+0000 7ff160d9a700 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aeb8eb310 0x562aeb8ed6f0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d75129e7c5eb426a server_cookie=3270f5756242cb81 in_seq=0 out_seq=0 2023-07-21T22:50:36.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.197+0000 7ff144ff9700 10 client.18837 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.197+0000 7ff144ff9700 1 -- 172.21.15.151:0/3130900249 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562aeb81ce50 con 0x562aeb8eb310 2023-07-21T22:50:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.197+0000 7ff144ff9700 10 client.18837 handle_command_reply: tid=0 2023-07-21T22:50:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.197+0000 7ff1770b5b80 1 client.18837 shutdown 2023-07-21T22:50:36.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3130900249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb72e6b0 msgr2=0x562aeb8e1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1390 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7ff1580cbde0 tx=0x7ff15801a470 comp rx=0 tx=0).stop 2023-07-21T22:50:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3130900249 shutdown_connections 2023-07-21T22:50:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aeb8eb310 0x562aeb8ed6f0 crc :-1 s=READY pgs=379 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8660 0x562aeb8db5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1390 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff144ff9700 0 client.18837 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/3130900249 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8210 0x562aeb8e18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3130900249 >> 172.21.15.151:0/3130900249 conn(0x562aeb8c7ae0 msgr2=0x562aeb8cc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3130900249 shutdown_connections 2023-07-21T22:50:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 1 -- 172.21.15.151:0/3130900249 wait complete. 2023-07-21T22:50:36.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.198+0000 7ff1770b5b80 20 client.18837 trim_cache size 0 max 16384 2023-07-21T22:50:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.215+0000 7ff1770b5b80 1 Processor -- start 2023-07-21T22:50:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.215+0000 7ff1770b5b80 1 -- start start 2023-07-21T22:50:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb72e6b0 0x562aeb8db710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8210 0x562aeb8d9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8660 0x562aeb8da4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb77d4c0 con 0x562aeb8d8660 2023-07-21T22:50:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb8cdf90 con 0x562aeb8d8210 2023-07-21T22:50:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb8c4b20 con 0x562aeb72e6b0 2023-07-21T22:50:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff160d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8210 0x562aeb8d9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff160d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8210 0x562aeb8d9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57296/0 (socket says 172.21.15.151:57296) 2023-07-21T22:50:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff160d9a700 1 -- 172.21.15.151:0/1873728503 learned_addr learned my addr 172.21.15.151:0/1873728503 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.216+0000 7ff161d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8660 0x562aeb8da4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff16159b700 1 --2- 172.21.15.151:0/1873728503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb72e6b0 0x562aeb8db710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff160d9a700 1 -- 172.21.15.151:0/1873728503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb72e6b0 msgr2=0x562aeb8db710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff160d9a700 1 --2- 172.21.15.151:0/1873728503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb72e6b0 0x562aeb8db710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff160d9a700 1 -- 172.21.15.151:0/1873728503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8660 msgr2=0x562aeb8da4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff160d9a700 1 --2- 172.21.15.151:0/1873728503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8660 0x562aeb8da4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff160d9a700 1 -- 172.21.15.151:0/1873728503 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aeb6781f0 con 0x562aeb8d8210 2023-07-21T22:50:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff160d9a700 1 --2- 172.21.15.151:0/1873728503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8210 0x562aeb8d9120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x562aeb8cdf30 tx=0x7ff14c014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2bcfdc2787be8a28 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff147fff700 1 -- 172.21.15.151:0/1873728503 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c022030 con 0x562aeb8d8210 2023-07-21T22:50:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff147fff700 1 -- 172.21.15.151:0/1873728503 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff14c023040 con 0x562aeb8d8210 2023-07-21T22:50:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.217+0000 7ff147fff700 1 -- 172.21.15.151:0/1873728503 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14c003bd0 con 0x562aeb8d8210 2023-07-21T22:50:36.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.218+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1873728503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8210 msgr2=0x562aeb8d9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.218+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1873728503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8210 0x562aeb8d9120 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x562aeb8cdf30 tx=0x7ff14c014000 comp rx=0 tx=0).stop 2023-07-21T22:50:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.218+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1873728503 shutdown_connections 2023-07-21T22:50:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.218+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1873728503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8660 0x562aeb8da4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.218+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1873728503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb72e6b0 0x562aeb8db710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.218+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1873728503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb8d8210 0x562aeb8d9120 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.218+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1873728503 >> 172.21.15.151:0/1873728503 conn(0x562aeb8c7ae0 msgr2=0x562aeb8d9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.219+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1873728503 shutdown_connections 2023-07-21T22:50:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.219+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1873728503 wait complete. 2023-07-21T22:50:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.219+0000 7ff1770b5b80 1 -- start start 2023-07-21T22:50:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.220+0000 7ff1770b5b80 1 Processor -- start 2023-07-21T22:50:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.220+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.220+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 0x562aeb8df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.220+0000 7ff1770b5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 0x562aeb8dfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.220+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb8e01e0 con 0x562aeb8d8210 2023-07-21T22:50:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.220+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb8e0350 con 0x562aeb72e6b0 2023-07-21T22:50:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.220+0000 7ff1770b5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aeb8e0510 con 0x562aeb8d8660 2023-07-21T22:50:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.220+0000 7ff1770b5b80 10 client.0 _ll_register_callbacks cb 0x7ff14c0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:50:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff16159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff161d9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 0x562aeb8dfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff16159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57298/0 (socket says 172.21.15.151:57298) 2023-07-21T22:50:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff16159b700 1 -- 172.21.15.151:0/1463940367 learned_addr learned my addr 172.21.15.151:0/1463940367 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff160d9a700 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 0x562aeb8df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff16159b700 1 -- 172.21.15.151:0/1463940367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 msgr2=0x562aeb8dfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff16159b700 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 0x562aeb8dfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff16159b700 1 -- 172.21.15.151:0/1463940367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 msgr2=0x562aeb8df760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff16159b700 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 0x562aeb8df760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff16159b700 1 -- 172.21.15.151:0/1463940367 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c017070 con 0x562aeb72e6b0 2023-07-21T22:50:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.221+0000 7ff160d9a700 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 0x562aeb8df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:50:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.222+0000 7ff16159b700 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1430 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff15809b200 tx=0x7ff15809b0c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b980aea37892f13b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.222+0000 7ff144ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:50:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.222+0000 7ff144ff9700 1 -- 172.21.15.151:0/1463940367 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158063080 con 0x562aeb72e6b0 2023-07-21T22:50:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.222+0000 7ff144ff9700 1 -- 172.21.15.151:0/1463940367 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff1580a3630 con 0x562aeb72e6b0 2023-07-21T22:50:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.222+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1463940367 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff15809b270 con 0x562aeb72e6b0 2023-07-21T22:50:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.222+0000 7ff144ff9700 1 -- 172.21.15.151:0/1463940367 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff1580a33e0 con 0x562aeb72e6b0 2023-07-21T22:50:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.222+0000 7ff1770b5b80 10 client.28505 fetch_fsmap learned FSMap version 96 2023-07-21T22:50:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.222+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1463940367 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=4+}) v3 -- 0x562aeb650250 con 0x562aeb72e6b0 2023-07-21T22:50:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.223+0000 7ff144ff9700 1 -- 172.21.15.151:0/1463940367 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff15809b270 con 0x562aeb72e6b0 2023-07-21T22:50:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.223+0000 7ff144ff9700 1 -- 172.21.15.151:0/1463940367 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 96) v1 ==== 7470+0+0 (secure 0 0 0) 0x7ff15801b700 con 0x562aeb72e6b0 2023-07-21T22:50:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.223+0000 7ff1770b5b80 10 client.28505 fetch_fsmap finished waiting for FSMap version 96 2023-07-21T22:50:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.223+0000 7ff1770b5b80 10 client.28505 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:50:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.223+0000 7ff1770b5b80 20 client.28505 populate_metadata read hostname 'smithi151' 2023-07-21T22:50:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.223+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aeb940000 0x562aeb9423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.223+0000 7ff1770b5b80 4 client.28505 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:50:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.223+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1463940367 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562aeb7deff0 con 0x562aeb940000 2023-07-21T22:50:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.223+0000 7ff160d9a700 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aeb940000 0x562aeb9423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.224+0000 7ff144ff9700 10 client.28505 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:36.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.224+0000 7ff160d9a700 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aeb940000 0x562aeb9423e0 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd2b17c1bba0f9e7 server_cookie=6d62759f80a8570d in_seq=0 out_seq=0 2023-07-21T22:50:36.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.238+0000 7ff144ff9700 1 -- 172.21.15.151:0/1463940367 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562aeb7deff0 con 0x562aeb940000 2023-07-21T22:50:36.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff144ff9700 10 client.28505 handle_command_reply: tid=0 2023-07-21T22:50:36.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 client.28505 shutdown 2023-07-21T22:50:36.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1463940367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 msgr2=0x562aeb8e1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:36.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1430 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7ff15809b200 tx=0x7ff15809b0c0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1463940367 shutdown_connections 2023-07-21T22:50:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aeb940000 0x562aeb9423e0 crc :-1 s=READY pgs=380 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aeb72e6b0 0x562aeb8e1430 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aeb8d8660 0x562aeb8dfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 --2- 172.21.15.151:0/1463940367 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aeb8d8210 0x562aeb8df760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff144ff9700 0 client.28505 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1463940367 >> 172.21.15.151:0/1463940367 conn(0x562aeb8c7ae0 msgr2=0x562aeb8d9d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1463940367 shutdown_connections 2023-07-21T22:50:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.239+0000 7ff1770b5b80 1 -- 172.21.15.151:0/1463940367 wait complete. 2023-07-21T22:50:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.240+0000 7ff1770b5b80 20 client.28505 trim_cache size 0 max 16384 2023-07-21T22:50:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:50:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:50:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:50:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:50:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 -- 172.21.15.151:0/3287385828 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1480a12c0 msgr2=0x7ff1480a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1480a12c0 0x7ff1480a3770 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7ff15c199690 tx=0x7ff14c009260 comp rx=0 tx=0).stop 2023-07-21T22:50:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 -- 172.21.15.151:0/3287385828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff15c100dd0 msgr2=0x7ff15c197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff15c100dd0 0x7ff15c197e70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7ff15800b070 tx=0x7ff1580079b0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 -- 172.21.15.151:0/3287385828 shutdown_connections 2023-07-21T22:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1480a12c0 0x7ff1480a3770 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff15c10a110 0x7ff15c19ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff15c100dd0 0x7ff15c197e70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 --2- 172.21.15.151:0/3287385828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff15c1016e0 0x7ff15c1983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 -- 172.21.15.151:0/3287385828 >> 172.21.15.151:0/3287385828 conn(0x7ff15c075ba0 msgr2=0x7ff15c0fef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 -- 172.21.15.151:0/3287385828 shutdown_connections 2023-07-21T22:50:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:36.241+0000 7ff1637ff700 1 -- 172.21.15.151:0/3287385828 wait complete. 2023-07-21T22:50:37.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:36 smithi187 ceph-mon[96918]: pgmap v996: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 7.3 MiB/s wr, 772 op/s 2023-07-21T22:50:37.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:36 smithi195 ceph-mon[97365]: pgmap v996: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 7.3 MiB/s wr, 772 op/s 2023-07-21T22:50:37.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:36 smithi151 ceph-mon[95510]: pgmap v996: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 7.3 MiB/s wr, 772 op/s 2023-07-21T22:50:38.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:37 smithi187 ceph-mon[96918]: pgmap v997: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-21T22:50:38.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:37 smithi195 ceph-mon[97365]: pgmap v997: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-21T22:50:38.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:37 smithi151 ceph-mon[95510]: pgmap v997: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 13 MiB/s wr, 1.17k op/s 2023-07-21T22:50:40.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:40 smithi195 ceph-mon[97365]: pgmap v998: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 10 MiB/s wr, 845 op/s 2023-07-21T22:50:40.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:40 smithi151 ceph-mon[95510]: pgmap v998: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 10 MiB/s wr, 845 op/s 2023-07-21T22:50:40.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:40 smithi187 ceph-mon[96918]: pgmap v998: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 10 MiB/s wr, 845 op/s 2023-07-21T22:50:43.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:42 smithi187 ceph-mon[96918]: pgmap v999: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 10 MiB/s wr, 845 op/s 2023-07-21T22:50:43.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:42 smithi195 ceph-mon[97365]: pgmap v999: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 10 MiB/s wr, 845 op/s 2023-07-21T22:50:43.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:42 smithi151 ceph-mon[95510]: pgmap v999: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 68 MiB/s rd, 10 MiB/s wr, 845 op/s 2023-07-21T22:50:45.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:44 smithi187 ceph-mon[96918]: pgmap v1000: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-21T22:50:45.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:44 smithi195 ceph-mon[97365]: pgmap v1000: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-21T22:50:45.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:44 smithi151 ceph-mon[95510]: pgmap v1000: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 107 MiB/s rd, 16 MiB/s wr, 1.26k op/s 2023-07-21T22:50:47.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:46 smithi187 ceph-mon[96918]: pgmap v1001: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 72 MiB/s rd, 11 MiB/s wr, 806 op/s 2023-07-21T22:50:47.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:46 smithi195 ceph-mon[97365]: pgmap v1001: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 72 MiB/s rd, 11 MiB/s wr, 806 op/s 2023-07-21T22:50:47.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:46 smithi151 ceph-mon[95510]: pgmap v1001: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 72 MiB/s rd, 11 MiB/s wr, 806 op/s 2023-07-21T22:50:49.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:48 smithi187 ceph-mon[96918]: pgmap v1002: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s rd, 18 MiB/s wr, 1.17k op/s 2023-07-21T22:50:49.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:48 smithi195 ceph-mon[97365]: pgmap v1002: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s rd, 18 MiB/s wr, 1.17k op/s 2023-07-21T22:50:49.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:48 smithi151 ceph-mon[95510]: pgmap v1002: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 108 MiB/s rd, 18 MiB/s wr, 1.17k op/s 2023-07-21T22:50:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.429+0000 7f88c43ff700 1 -- 172.21.15.151:0/1553774424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88bc104a30 msgr2=0x7f88bc104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.429+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1553774424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88bc104a30 0x7f88bc104e00 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f88b8009990 tx=0x7f88b8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.429+0000 7f88c43ff700 1 -- 172.21.15.151:0/1553774424 shutdown_connections 2023-07-21T22:50:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.430+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1553774424 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88bc0ff3e0 0x7f88bc10b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.430+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1553774424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88bc104a30 0x7f88bc104e00 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.430+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1553774424 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc0fea30 0x7f88bc0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.430+0000 7f88c43ff700 1 -- 172.21.15.151:0/1553774424 >> 172.21.15.151:0/1553774424 conn(0x7f88bc074760 msgr2=0x7f88bc074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.430+0000 7f88c43ff700 1 -- 172.21.15.151:0/1553774424 shutdown_connections 2023-07-21T22:50:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.430+0000 7f88c43ff700 1 -- 172.21.15.151:0/1553774424 wait complete. 2023-07-21T22:50:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.431+0000 7f88c43ff700 1 Processor -- start 2023-07-21T22:50:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.431+0000 7f88c43ff700 1 -- start start 2023-07-21T22:50:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c43ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88bc0fea30 0x7f88bc197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c43ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc0ff3e0 0x7f88bc1982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c43ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88bc104a30 0x7f88bc19c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c43ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc19cf50 con 0x7f88bc104a30 2023-07-21T22:50:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c43ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc19d0c0 con 0x7f88bc0ff3e0 2023-07-21T22:50:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c43ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88bc19d280 con 0x7f88bc0fea30 2023-07-21T22:50:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c299c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88bc104a30 0x7f88bc19c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c299c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88bc104a30 0x7f88bc19c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53740/0 (socket says 172.21.15.151:53740) 2023-07-21T22:50:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c299c700 1 -- 172.21.15.151:0/1956547147 learned_addr learned my addr 172.21.15.151:0/1956547147 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c219b700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88bc0fea30 0x7f88bc197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.432+0000 7f88c199a700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc0ff3e0 0x7f88bc1982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.433+0000 7f88c219b700 1 -- 172.21.15.151:0/1956547147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc0ff3e0 msgr2=0x7f88bc1982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.433+0000 7f88c219b700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc0ff3e0 0x7f88bc1982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.433+0000 7f88c219b700 1 -- 172.21.15.151:0/1956547147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88bc104a30 msgr2=0x7f88bc19c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.433+0000 7f88c219b700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88bc104a30 0x7f88bc19c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.433+0000 7f88c219b700 1 -- 172.21.15.151:0/1956547147 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b80095f0 con 0x7f88bc0fea30 2023-07-21T22:50:49.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.433+0000 7f88c219b700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88bc0fea30 0x7f88bc197d60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000c00 tx=0x7f88b8004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:49.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.433+0000 7f88b37fe700 1 -- 172.21.15.151:0/1956547147 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b801d070 con 0x7f88bc0fea30 2023-07-21T22:50:49.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.433+0000 7f88c43ff700 1 -- 172.21.15.151:0/1956547147 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88bc19d500 con 0x7f88bc0fea30 2023-07-21T22:50:49.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.433+0000 7f88b37fe700 1 -- 172.21.15.151:0/1956547147 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88b8022470 con 0x7f88bc0fea30 2023-07-21T22:50:49.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.434+0000 7f88b37fe700 1 -- 172.21.15.151:0/1956547147 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b8017650 con 0x7f88bc0fea30 2023-07-21T22:50:49.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.434+0000 7f88c43ff700 1 -- 172.21.15.151:0/1956547147 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88bc1a4da0 con 0x7f88bc0fea30 2023-07-21T22:50:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.438+0000 7f88b37fe700 1 -- 172.21.15.151:0/1956547147 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f88b80225e0 con 0x7f88bc0fea30 2023-07-21T22:50:49.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.439+0000 7f88d7cabb80 1 Processor -- start 2023-07-21T22:50:49.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.439+0000 7f88d7cabb80 1 -- start start 2023-07-21T22:50:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7f3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 0x5585dd7edf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7ee4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd6f3c50 con 0x5585dd7f4660 2023-07-21T22:50:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd7469e0 con 0x5585dd64a6b0 2023-07-21T22:50:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd73fe70 con 0x5585dd7f4210 2023-07-21T22:50:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88c199a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7ee4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88c199a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7ee4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53744/0 (socket says 172.21.15.151:53744) 2023-07-21T22:50:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88c199a700 1 -- 172.21.15.151:0/3086594679 learned_addr learned my addr 172.21.15.151:0/3086594679 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88c219b700 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 0x5585dd7edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.440+0000 7f88c299c700 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7f3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.441+0000 7f88c199a700 1 -- 172.21.15.151:0/3086594679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 msgr2=0x5585dd7edf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.441+0000 7f88c199a700 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 0x5585dd7edf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.441+0000 7f88b37fe700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88a80a1340 0x7f88a80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.441+0000 7f88c199a700 1 -- 172.21.15.151:0/3086594679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 msgr2=0x5585dd7f3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.441+0000 7f88c199a700 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7f3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.441+0000 7f88c199a700 1 -- 172.21.15.151:0/3086594679 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585dd56dd80 con 0x5585dd7f4660 2023-07-21T22:50:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.441+0000 7f88c299c700 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:50:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.442+0000 7f88b37fe700 1 -- 172.21.15.151:0/1956547147 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f88b80ce0a0 con 0x7f88bc0fea30 2023-07-21T22:50:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.442+0000 7f88c299c700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88a80a1340 0x7f88a80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.442+0000 7f88c199a700 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7ee4a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00bd30 tx=0x7f88ac0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5fbdcd05cd0022a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.442+0000 7f88c299c700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88a80a1340 0x7f88a80a37f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009be0 tx=0x7f88b4009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:49.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.443+0000 7f88b0bfe700 1 -- 172.21.15.151:0/3086594679 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac010e10 con 0x5585dd7f4660 2023-07-21T22:50:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.443+0000 7f88b0bfe700 1 -- 172.21.15.151:0/3086594679 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88ac015070 con 0x5585dd7f4660 2023-07-21T22:50:49.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.443+0000 7f88b0bfe700 1 -- 172.21.15.151:0/3086594679 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88ac003de0 con 0x5585dd7f4660 2023-07-21T22:50:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.444+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3086594679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 msgr2=0x5585dd7ee4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.444+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7ee4a0 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00bd30 tx=0x7f88ac0106b0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.444+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3086594679 shutdown_connections 2023-07-21T22:50:49.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.444+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7f3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.444+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7ee4a0 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.444+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3086594679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 0x5585dd7edf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.444+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3086594679 >> 172.21.15.151:0/3086594679 conn(0x5585dd7e3ae0 msgr2=0x5585dd7e90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.444+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3086594679 shutdown_connections 2023-07-21T22:50:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.444+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3086594679 wait complete. 2023-07-21T22:50:49.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.445+0000 7f88d7cabb80 1 -- start start 2023-07-21T22:50:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.445+0000 7f88d7cabb80 1 Processor -- start 2023-07-21T22:50:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fa640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 0x5585dd7f7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7f7f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd6dfa60 con 0x5585dd7f4660 2023-07-21T22:50:49.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd6df760 con 0x5585dd64a6b0 2023-07-21T22:50:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd5c38c0 con 0x5585dd7f4210 2023-07-21T22:50:49.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88d7cabb80 10 client.0 _ll_register_callbacks cb 0x5585dd6dd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:50:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88c299c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7f7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88c199a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 0x5585dd7f7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88c199a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 0x5585dd7f7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46098/0 (socket says 172.21.15.151:46098) 2023-07-21T22:50:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88c299c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7f7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53748/0 (socket says 172.21.15.151:53748) 2023-07-21T22:50:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.446+0000 7f88c199a700 1 -- 172.21.15.151:0/1239506794 learned_addr learned my addr 172.21.15.151:0/1239506794 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.447+0000 7f88c219b700 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fa640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.447+0000 7f88c219b700 1 -- 172.21.15.151:0/1239506794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 msgr2=0x5585dd7f7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.447+0000 7f88c219b700 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 0x5585dd7f7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.447+0000 7f88c219b700 1 -- 172.21.15.151:0/1239506794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 msgr2=0x5585dd7f7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.447+0000 7f88c219b700 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7f7f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.447+0000 7f88c219b700 1 -- 172.21.15.151:0/1239506794 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ac00b960 con 0x5585dd64a6b0 2023-07-21T22:50:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.447+0000 7f88c299c700 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:50:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.447+0000 7f88c219b700 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fa640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f88b80cb810 tx=0x7f88b8009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26923e677c35ab48 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.447+0000 7f88a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:50:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.448+0000 7f88a5ffb700 1 -- 172.21.15.151:0/1239506794 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b809b680 con 0x5585dd64a6b0 2023-07-21T22:50:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.448+0000 7f88a5ffb700 1 -- 172.21.15.151:0/1239506794 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f88b80a10d0 con 0x5585dd64a6b0 2023-07-21T22:50:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.448+0000 7f88d7cabb80 1 -- 172.21.15.151:0/1239506794 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5585dd699490 con 0x5585dd64a6b0 2023-07-21T22:50:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.448+0000 7f88a5ffb700 1 -- 172.21.15.151:0/1239506794 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88b809aff0 con 0x5585dd64a6b0 2023-07-21T22:50:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.448+0000 7f88d7cabb80 10 client.28517 fetch_fsmap learned FSMap version 96 2023-07-21T22:50:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.448+0000 7f88d7cabb80 1 -- 172.21.15.151:0/1239506794 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=4+}) v3 -- 0x5585dd556c00 con 0x5585dd64a6b0 2023-07-21T22:50:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.449+0000 7f88a5ffb700 1 -- 172.21.15.151:0/1239506794 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5585dd699490 con 0x5585dd64a6b0 2023-07-21T22:50:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.449+0000 7f88a5ffb700 1 -- 172.21.15.151:0/1239506794 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 96) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f88b809a710 con 0x5585dd64a6b0 2023-07-21T22:50:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.449+0000 7f88d7cabb80 10 client.28517 fetch_fsmap finished waiting for FSMap version 96 2023-07-21T22:50:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.449+0000 7f88d7cabb80 10 client.28517 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:50:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.449+0000 7f88d7cabb80 20 client.28517 populate_metadata read hostname 'smithi151' 2023-07-21T22:50:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.449+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585dd8077a0 0x5585dd809bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.449+0000 7f88d7cabb80 4 client.28517 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:50:49.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.449+0000 7f88d7cabb80 1 -- 172.21.15.151:0/1239506794 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5585dd738e50 con 0x5585dd8077a0 2023-07-21T22:50:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.450+0000 7f88c199a700 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585dd8077a0 0x5585dd809bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.450+0000 7f88c199a700 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585dd8077a0 0x5585dd809bb0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=202ebf00b9411bf4 server_cookie=8f35d059ef2feec in_seq=0 out_seq=0 2023-07-21T22:50:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.450+0000 7f88a5ffb700 10 client.28517 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:49.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.451+0000 7f88a5ffb700 1 -- 172.21.15.151:0/1239506794 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5585dd738e50 con 0x5585dd8077a0 2023-07-21T22:50:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.451+0000 7f88a5ffb700 10 client.28517 handle_command_reply: tid=0 2023-07-21T22:50:49.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.451+0000 7f88d7cabb80 1 client.28517 shutdown 2023-07-21T22:50:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.451+0000 7f88d7cabb80 1 -- 172.21.15.151:0/1239506794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 msgr2=0x5585dd7fa640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:49.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.451+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fa640 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f88b80cb810 tx=0x7f88b8009310 comp rx=0 tx=0).stop 2023-07-21T22:50:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88d7cabb80 1 -- 172.21.15.151:0/1239506794 shutdown_connections 2023-07-21T22:50:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585dd8077a0 0x5585dd809bb0 crc :-1 s=READY pgs=381 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fa640 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88a5ffb700 0 client.28517 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4660 0x5585dd7f7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/1239506794 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4210 0x5585dd7f7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88d7cabb80 1 -- 172.21.15.151:0/1239506794 >> 172.21.15.151:0/1239506794 conn(0x5585dd7e3ae0 msgr2=0x5585dd7e83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:49.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88d7cabb80 1 -- 172.21.15.151:0/1239506794 shutdown_connections 2023-07-21T22:50:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88d7cabb80 1 -- 172.21.15.151:0/1239506794 wait complete. 2023-07-21T22:50:49.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.452+0000 7f88d7cabb80 20 client.28517 trim_cache size 0 max 16384 2023-07-21T22:50:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.471+0000 7f88d7cabb80 1 Processor -- start 2023-07-21T22:50:49.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.471+0000 7f88d7cabb80 1 -- start start 2023-07-21T22:50:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.472+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7edf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.472+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7e8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.472+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7e90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.472+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd7ea790 con 0x5585dd7f4210 2023-07-21T22:50:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.472+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd7e0b50 con 0x5585dd64a6b0 2023-07-21T22:50:49.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.472+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd7ee480 con 0x5585dd7f4660 2023-07-21T22:50:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.472+0000 7f88c199a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7e8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.472+0000 7f88c199a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7e8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53760/0 (socket says 172.21.15.151:53760) 2023-07-21T22:50:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.472+0000 7f88c199a700 1 -- 172.21.15.151:0/330852978 learned_addr learned my addr 172.21.15.151:0/330852978 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.473+0000 7f88c219b700 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7edf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.473+0000 7f88c299c700 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7e90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.473+0000 7f88c299c700 1 -- 172.21.15.151:0/330852978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 msgr2=0x5585dd7edf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.473+0000 7f88c299c700 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7edf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.473+0000 7f88c299c700 1 -- 172.21.15.151:0/330852978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 msgr2=0x5585dd7e8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.473+0000 7f88c299c700 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7e8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.473+0000 7f88c299c700 1 -- 172.21.15.151:0/330852978 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5585dd5941f0 con 0x5585dd7f4660 2023-07-21T22:50:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.473+0000 7f88c199a700 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:50:49.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.474+0000 7f88c299c700 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7e90a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009550 tx=0x7f88b4004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3f775216e780440c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.474+0000 7f88b13ff700 1 -- 172.21.15.151:0/330852978 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400e040 con 0x5585dd7f4660 2023-07-21T22:50:49.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.474+0000 7f88b13ff700 1 -- 172.21.15.151:0/330852978 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88b400f040 con 0x5585dd7f4660 2023-07-21T22:50:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.474+0000 7f88b13ff700 1 -- 172.21.15.151:0/330852978 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4023d80 con 0x5585dd7f4660 2023-07-21T22:50:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.475+0000 7f88d7cabb80 1 -- 172.21.15.151:0/330852978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 msgr2=0x5585dd7e90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.475+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7e90a0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009550 tx=0x7f88b4004b40 comp rx=0 tx=0).stop 2023-07-21T22:50:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.475+0000 7f88d7cabb80 1 -- 172.21.15.151:0/330852978 shutdown_connections 2023-07-21T22:50:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.475+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7edf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.475+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7e90a0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.475+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/330852978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7e8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.475+0000 7f88d7cabb80 1 -- 172.21.15.151:0/330852978 >> 172.21.15.151:0/330852978 conn(0x5585dd7e3ae0 msgr2=0x5585dd7f52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.475+0000 7f88d7cabb80 1 -- 172.21.15.151:0/330852978 shutdown_connections 2023-07-21T22:50:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.475+0000 7f88d7cabb80 1 -- 172.21.15.151:0/330852978 wait complete. 2023-07-21T22:50:49.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.476+0000 7f88d7cabb80 1 -- start start 2023-07-21T22:50:49.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.476+0000 7f88d7cabb80 1 Processor -- start 2023-07-21T22:50:49.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.477+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.477+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7fd0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.477+0000 7f88d7cabb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7fb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.477+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd7fb880 con 0x5585dd7f4210 2023-07-21T22:50:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.477+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd7fb9f0 con 0x5585dd64a6b0 2023-07-21T22:50:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.477+0000 7f88d7cabb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5585dd7fbbb0 con 0x5585dd7f4660 2023-07-21T22:50:49.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.477+0000 7f88d7cabb80 10 client.0 _ll_register_callbacks cb 0x5585dd6dd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:50:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c219b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c299c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7fb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c219b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55970/0 (socket says 172.21.15.151:55970) 2023-07-21T22:50:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c219b700 1 -- 172.21.15.151:0/3284931863 learned_addr learned my addr 172.21.15.151:0/3284931863 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:50:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c299c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7fb170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46122/0 (socket says 172.21.15.151:46122) 2023-07-21T22:50:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c199a700 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7fd0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c219b700 1 -- 172.21.15.151:0/3284931863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 msgr2=0x5585dd7fb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c219b700 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7fb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c219b700 1 -- 172.21.15.151:0/3284931863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 msgr2=0x5585dd7fd0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:50:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c219b700 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7fd0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c219b700 1 -- 172.21.15.151:0/3284931863 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5585dd56dd80 con 0x5585dd64a6b0 2023-07-21T22:50:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88c219b700 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fcb80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f88b8005cb0 tx=0x7f88b809a940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4208ea11a6959ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:50:49.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.478+0000 7f88a5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:50:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88a5ffb700 1 -- 172.21.15.151:0/3284931863 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b809aff0 con 0x5585dd64a6b0 2023-07-21T22:50:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88a5ffb700 1 -- 172.21.15.151:0/3284931863 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f88b80a10d0 con 0x5585dd64a6b0 2023-07-21T22:50:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3284931863 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f88ac015070 con 0x5585dd64a6b0 2023-07-21T22:50:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88a5ffb700 1 -- 172.21.15.151:0/3284931863 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88b809f250 con 0x5585dd64a6b0 2023-07-21T22:50:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88d7cabb80 10 client.28523 fetch_fsmap learned FSMap version 96 2023-07-21T22:50:49.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3284931863 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=4+}) v3 -- 0x7f88b4017920 con 0x5585dd64a6b0 2023-07-21T22:50:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88a5ffb700 1 -- 172.21.15.151:0/3284931863 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f88ac015070 con 0x5585dd64a6b0 2023-07-21T22:50:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88a5ffb700 1 -- 172.21.15.151:0/3284931863 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 96) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f88b809a180 con 0x5585dd64a6b0 2023-07-21T22:50:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88d7cabb80 10 client.28523 fetch_fsmap finished waiting for FSMap version 96 2023-07-21T22:50:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88d7cabb80 10 client.28523 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:50:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88d7cabb80 20 client.28523 populate_metadata read hostname 'smithi151' 2023-07-21T22:50:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585dd85c290 0x5585dd85e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:50:49.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88d7cabb80 4 client.28523 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:50:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.479+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3284931863 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5585dd6faff0 con 0x5585dd85c290 2023-07-21T22:50:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.480+0000 7f88c199a700 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585dd85c290 0x5585dd85e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:50:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.480+0000 7f88c199a700 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585dd85c290 0x5585dd85e670 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=269650d912d3149b server_cookie=2dff4a746ee5d5a8 in_seq=0 out_seq=0 2023-07-21T22:50:49.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.480+0000 7f88a5ffb700 10 client.28523 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:49.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88a5ffb700 1 -- 172.21.15.151:0/3284931863 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5585dd6faff0 con 0x5585dd85c290 2023-07-21T22:50:49.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88a5ffb700 10 client.28523 handle_command_reply: tid=0 2023-07-21T22:50:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88d7cabb80 1 client.28523 shutdown 2023-07-21T22:50:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3284931863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 msgr2=0x5585dd7fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:49.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fcb80 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f88b8005cb0 tx=0x7f88b809a940 comp rx=0 tx=0).stop 2023-07-21T22:50:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3284931863 shutdown_connections 2023-07-21T22:50:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5585dd85c290 0x5585dd85e670 crc :-1 s=READY pgs=382 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5585dd64a6b0 0x5585dd7fcb80 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5585dd7f4660 0x5585dd7fb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88d7cabb80 1 --2- 172.21.15.151:0/3284931863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5585dd7f4210 0x5585dd7fd0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88a5ffb700 0 client.28523 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:50:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.496+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3284931863 >> 172.21.15.151:0/3284931863 conn(0x5585dd7e3ae0 msgr2=0x5585dd7f28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:49.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.497+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3284931863 shutdown_connections 2023-07-21T22:50:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.497+0000 7f88d7cabb80 1 -- 172.21.15.151:0/3284931863 wait complete. 2023-07-21T22:50:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.497+0000 7f88d7cabb80 20 client.28523 trim_cache size 0 max 16384 2023-07-21T22:50:49.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:50:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:50:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:50:49.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:50:49.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.497+0000 7f88c43ff700 1 -- 172.21.15.151:0/1956547147 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88a80a1340 msgr2=0x7f88a80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.497+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88a80a1340 0x7f88a80a37f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f88b4009be0 tx=0x7f88b4009040 comp rx=0 tx=0).stop 2023-07-21T22:50:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.497+0000 7f88c43ff700 1 -- 172.21.15.151:0/1956547147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88bc0fea30 msgr2=0x7f88bc197d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:50:49.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.497+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88bc0fea30 0x7f88bc197d60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f88b8000c00 tx=0x7f88b8004730 comp rx=0 tx=0).stop 2023-07-21T22:50:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.498+0000 7f88c43ff700 1 -- 172.21.15.151:0/1956547147 shutdown_connections 2023-07-21T22:50:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.498+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88a80a1340 0x7f88a80a37f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.498+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88bc104a30 0x7f88bc19c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.498+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88bc0fea30 0x7f88bc197d60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.498+0000 7f88c43ff700 1 --2- 172.21.15.151:0/1956547147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88bc0ff3e0 0x7f88bc1982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:50:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.498+0000 7f88c43ff700 1 -- 172.21.15.151:0/1956547147 >> 172.21.15.151:0/1956547147 conn(0x7f88bc074760 msgr2=0x7f88bc0fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:50:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.498+0000 7f88c43ff700 1 -- 172.21.15.151:0/1956547147 shutdown_connections 2023-07-21T22:50:49.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:50:49.498+0000 7f88c43ff700 1 -- 172.21.15.151:0/1956547147 wait complete. 2023-07-21T22:50:51.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:50 smithi187 ceph-mon[96918]: pgmap v1003: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 12 MiB/s wr, 772 op/s 2023-07-21T22:50:51.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:50 smithi195 ceph-mon[97365]: pgmap v1003: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 12 MiB/s wr, 772 op/s 2023-07-21T22:50:51.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:50 smithi151 ceph-mon[95510]: pgmap v1003: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 12 MiB/s wr, 772 op/s 2023-07-21T22:50:53.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:52 smithi187 ceph-mon[96918]: pgmap v1004: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 12 MiB/s wr, 772 op/s 2023-07-21T22:50:53.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:52 smithi195 ceph-mon[97365]: pgmap v1004: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 12 MiB/s wr, 772 op/s 2023-07-21T22:50:53.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:52 smithi151 ceph-mon[95510]: pgmap v1004: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 75 MiB/s rd, 12 MiB/s wr, 772 op/s 2023-07-21T22:50:55.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:54 smithi187 ceph-mon[96918]: pgmap v1005: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s rd, 17 MiB/s wr, 1.22k op/s 2023-07-21T22:50:55.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:54 smithi195 ceph-mon[97365]: pgmap v1005: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s rd, 17 MiB/s wr, 1.22k op/s 2023-07-21T22:50:55.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:54 smithi151 ceph-mon[95510]: pgmap v1005: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 110 MiB/s rd, 17 MiB/s wr, 1.22k op/s 2023-07-21T22:50:57.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:56 smithi187 ceph-mon[96918]: pgmap v1006: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 71 MiB/s rd, 11 MiB/s wr, 807 op/s 2023-07-21T22:50:57.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:56 smithi195 ceph-mon[97365]: pgmap v1006: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 71 MiB/s rd, 11 MiB/s wr, 807 op/s 2023-07-21T22:50:57.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:56 smithi151 ceph-mon[95510]: pgmap v1006: 97 pgs: 97 active+clean; 10 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 71 MiB/s rd, 11 MiB/s wr, 807 op/s 2023-07-21T22:50:59.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:50:58 smithi187 ceph-mon[96918]: pgmap v1007: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 96 MiB/s rd, 18 MiB/s wr, 1.12k op/s 2023-07-21T22:50:59.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:50:58 smithi195 ceph-mon[97365]: pgmap v1007: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 96 MiB/s rd, 18 MiB/s wr, 1.12k op/s 2023-07-21T22:50:59.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:50:58 smithi151 ceph-mon[95510]: pgmap v1007: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 96 MiB/s rd, 18 MiB/s wr, 1.12k op/s 2023-07-21T22:51:01.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:00 smithi187 ceph-mon[96918]: pgmap v1008: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 11 MiB/s wr, 762 op/s 2023-07-21T22:51:01.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:00 smithi195 ceph-mon[97365]: pgmap v1008: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 11 MiB/s wr, 762 op/s 2023-07-21T22:51:01.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:00 smithi151 ceph-mon[95510]: pgmap v1008: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 11 MiB/s wr, 762 op/s 2023-07-21T22:51:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.667+0000 7f06d95ff700 1 -- 172.21.15.151:0/2132918950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d4102950 msgr2=0x7f06d4106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.667+0000 7f06d95ff700 1 --2- 172.21.15.151:0/2132918950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d4102950 0x7f06d4106910 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f06c80099c0 tx=0x7f06c8009cd0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.667+0000 7f06d95ff700 1 -- 172.21.15.151:0/2132918950 shutdown_connections 2023-07-21T22:51:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.667+0000 7f06d95ff700 1 --2- 172.21.15.151:0/2132918950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d4106ff0 0x7f06d410ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.667+0000 7f06d95ff700 1 --2- 172.21.15.151:0/2132918950 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06d4101fb0 0x7f06d4102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.667+0000 7f06d95ff700 1 --2- 172.21.15.151:0/2132918950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d4102950 0x7f06d4106910 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.667+0000 7f06d95ff700 1 -- 172.21.15.151:0/2132918950 >> 172.21.15.151:0/2132918950 conn(0x7f06d40fd800 msgr2=0x7f06d40ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.667+0000 7f06d95ff700 1 -- 172.21.15.151:0/2132918950 shutdown_connections 2023-07-21T22:51:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.667+0000 7f06d95ff700 1 -- 172.21.15.151:0/2132918950 wait complete. 2023-07-21T22:51:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.668+0000 7f06d95ff700 1 Processor -- start 2023-07-21T22:51:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.668+0000 7f06d95ff700 1 -- start start 2023-07-21T22:51:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.668+0000 7f06d95ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d4101fb0 0x7f06d4197e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.668+0000 7f06d95ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06d4102950 0x7f06d41983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.668+0000 7f06d95ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d4106ff0 0x7f06d419c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.668+0000 7f06d95ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d419cff0 con 0x7f06d4106ff0 2023-07-21T22:51:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.668+0000 7f06d95ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d419d160 con 0x7f06d4101fb0 2023-07-21T22:51:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.668+0000 7f06d95ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d419d320 con 0x7f06d4102950 2023-07-21T22:51:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d4101fb0 0x7f06d4197e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d4101fb0 0x7f06d4197e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55098/0 (socket says 172.21.15.151:55098) 2023-07-21T22:51:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d2ffd700 1 -- 172.21.15.151:0/3328664556 learned_addr learned my addr 172.21.15.151:0/3328664556 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d37fe700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d4106ff0 0x7f06d419c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d27fc700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06d4102950 0x7f06d41983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d2ffd700 1 -- 172.21.15.151:0/3328664556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06d4102950 msgr2=0x7f06d41983b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06d4102950 0x7f06d41983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d2ffd700 1 -- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d4106ff0 msgr2=0x7f06d419c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d4106ff0 0x7f06d419c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d2ffd700 1 -- 172.21.15.151:0/3328664556 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80095f0 con 0x7f06d4101fb0 2023-07-21T22:51:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.669+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d4101fb0 0x7f06d4197e70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f06c400e9a0 tx=0x7f06c400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.670+0000 7f06bbfff700 1 -- 172.21.15.151:0/3328664556 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400cbd0 con 0x7f06d4101fb0 2023-07-21T22:51:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.670+0000 7f06bbfff700 1 -- 172.21.15.151:0/3328664556 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06c400cd30 con 0x7f06d4101fb0 2023-07-21T22:51:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.670+0000 7f06d95ff700 1 -- 172.21.15.151:0/3328664556 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d419d600 con 0x7f06d4101fb0 2023-07-21T22:51:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.670+0000 7f06bbfff700 1 -- 172.21.15.151:0/3328664556 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4018680 con 0x7f06d4101fb0 2023-07-21T22:51:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.670+0000 7f06d95ff700 1 -- 172.21.15.151:0/3328664556 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d41a4e40 con 0x7f06d4101fb0 2023-07-21T22:51:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.675+0000 7f06bbfff700 1 -- 172.21.15.151:0/3328664556 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f06c4010430 con 0x7f06d4101fb0 2023-07-21T22:51:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.676+0000 7f06ed00fb80 1 Processor -- start 2023-07-21T22:51:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.676+0000 7f06ed00fb80 1 -- start start 2023-07-21T22:51:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56421801a6b0 0x5642181c3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4660 0x5642181be4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642180c3c50 con 0x5642181c4210 2023-07-21T22:51:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642181169e0 con 0x56421801a6b0 2023-07-21T22:51:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56421810fe70 con 0x5642181c4660 2023-07-21T22:51:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06bbfff700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06bc0a1340 0x7f06bc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06d2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06d37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56421801a6b0 0x5642181c3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06d2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181bdf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37242/0 (socket says 172.21.15.151:37242) 2023-07-21T22:51:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06d2ffd700 1 -- 172.21.15.151:0/3703882702 learned_addr learned my addr 172.21.15.151:0/3703882702 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06bbfff700 1 -- 172.21.15.151:0/3328664556 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f06c4014070 con 0x7f06d4101fb0 2023-07-21T22:51:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06d27fc700 1 --2- 172.21.15.151:0/3703882702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4660 0x5642181be4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.677+0000 7f06d37fe700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06bc0a1340 0x7f06bc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06d2ffd700 1 -- 172.21.15.151:0/3703882702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4660 msgr2=0x5642181be4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/3703882702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4660 0x5642181be4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06d2ffd700 1 -- 172.21.15.151:0/3703882702 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56421801a6b0 msgr2=0x5642181c3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/3703882702 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56421801a6b0 0x5642181c3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06d2ffd700 1 -- 172.21.15.151:0/3703882702 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564217f3dd80 con 0x5642181c4210 2023-07-21T22:51:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/3703882702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181bdf40 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f06c400e970 tx=0x7f06c406c0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=901d7e29c0185583 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06d37fe700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06bc0a1340 0x7f06bc0a37f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009790 tx=0x7f06cc009130 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06b97fa700 1 -- 172.21.15.151:0/3703882702 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c40999c0 con 0x5642181c4210 2023-07-21T22:51:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06b97fa700 1 -- 172.21.15.151:0/3703882702 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06c409a060 con 0x5642181c4210 2023-07-21T22:51:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.678+0000 7f06b97fa700 1 -- 172.21.15.151:0/3703882702 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c40cab60 con 0x5642181c4210 2023-07-21T22:51:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.679+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3703882702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 msgr2=0x5642181bdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.679+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/3703882702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181bdf40 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f06c400e970 tx=0x7f06c406c0d0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.679+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3703882702 shutdown_connections 2023-07-21T22:51:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.679+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/3703882702 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56421801a6b0 0x5642181c3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.679+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/3703882702 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4660 0x5642181be4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.679+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/3703882702 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181bdf40 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.679+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3703882702 >> 172.21.15.151:0/3703882702 conn(0x5642181b3ae0 msgr2=0x5642181b90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.679+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3703882702 shutdown_connections 2023-07-21T22:51:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.679+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3703882702 wait complete. 2023-07-21T22:51:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.680+0000 7f06ed00fb80 1 -- start start 2023-07-21T22:51:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.680+0000 7f06ed00fb80 1 Processor -- start 2023-07-21T22:51:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421801a6b0 0x5642181cd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4210 0x5642181cda30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181c7780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642180afa60 con 0x56421801a6b0 2023-07-21T22:51:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642180af760 con 0x5642181c4660 2023-07-21T22:51:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x564217f938c0 con 0x5642181c4210 2023-07-21T22:51:02.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06ed00fb80 10 client.0 _ll_register_callbacks cb 0x5642180ad700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06d2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421801a6b0 0x5642181cd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06d37fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181c7780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06d27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4210 0x5642181cda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06d2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421801a6b0 0x5642181cd4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37244/0 (socket says 172.21.15.151:37244) 2023-07-21T22:51:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.681+0000 7f06d2ffd700 1 -- 172.21.15.151:0/2326241068 learned_addr learned my addr 172.21.15.151:0/2326241068 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.682+0000 7f06d37fe700 1 -- 172.21.15.151:0/2326241068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4210 msgr2=0x5642181cda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.682+0000 7f06d37fe700 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4210 0x5642181cda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.682+0000 7f06d37fe700 1 -- 172.21.15.151:0/2326241068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421801a6b0 msgr2=0x5642181cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.682+0000 7f06d37fe700 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421801a6b0 0x5642181cd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.682+0000 7f06d37fe700 1 -- 172.21.15.151:0/2326241068 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d41a4e40 con 0x5642181c4660 2023-07-21T22:51:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.682+0000 7f06d37fe700 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181c7780 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f06cc003c80 tx=0x7f06cc004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5773e643165638ab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.682+0000 7f06b6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:51:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.686+0000 7f06b6ff5700 1 -- 172.21.15.151:0/2326241068 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc022070 con 0x5642181c4660 2023-07-21T22:51:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.686+0000 7f06b6ff5700 1 -- 172.21.15.151:0/2326241068 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f06cc019d30 con 0x5642181c4660 2023-07-21T22:51:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.686+0000 7f06ed00fb80 1 -- 172.21.15.151:0/2326241068 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564218069490 con 0x5642181c4660 2023-07-21T22:51:02.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.686+0000 7f06b6ff5700 1 -- 172.21.15.151:0/2326241068 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06cc004bb0 con 0x5642181c4660 2023-07-21T22:51:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.686+0000 7f06ed00fb80 10 client.28535 fetch_fsmap learned FSMap version 96 2023-07-21T22:51:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.686+0000 7f06ed00fb80 1 -- 172.21.15.151:0/2326241068 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=4+}) v3 -- 0x564217f26c00 con 0x5642181c4660 2023-07-21T22:51:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.687+0000 7f06b6ff5700 1 -- 172.21.15.151:0/2326241068 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06cc032020 con 0x5642181c4660 2023-07-21T22:51:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.687+0000 7f06b6ff5700 1 -- 172.21.15.151:0/2326241068 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 96) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f06cc004660 con 0x5642181c4660 2023-07-21T22:51:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.687+0000 7f06ed00fb80 10 client.28535 fetch_fsmap finished waiting for FSMap version 96 2023-07-21T22:51:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.687+0000 7f06ed00fb80 10 client.28535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:02.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.687+0000 7f06ed00fb80 20 client.28535 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.687+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642181d7990 0x5642181d9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.687+0000 7f06ed00fb80 4 client.28535 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:51:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.687+0000 7f06ed00fb80 1 -- 172.21.15.151:0/2326241068 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564218108e50 con 0x5642181d7990 2023-07-21T22:51:02.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.687+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642181d7990 0x5642181d9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.688+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642181d7990 0x5642181d9da0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=103bfb6f63010f09 server_cookie=302d0889f863ca9b in_seq=0 out_seq=0 2023-07-21T22:51:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.688+0000 7f06b6ff5700 10 client.28535 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06b6ff5700 1 -- 172.21.15.151:0/2326241068 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x564218108e50 con 0x5642181d7990 2023-07-21T22:51:02.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06b6ff5700 10 client.28535 handle_command_reply: tid=0 2023-07-21T22:51:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 client.28535 shutdown 2023-07-21T22:51:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 -- 172.21.15.151:0/2326241068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 msgr2=0x5642181c7780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181c7780 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f06cc003c80 tx=0x7f06cc004b40 comp rx=0 tx=0).stop 2023-07-21T22:51:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 -- 172.21.15.151:0/2326241068 shutdown_connections 2023-07-21T22:51:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642181d7990 0x5642181d9da0 crc :-1 s=READY pgs=383 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181c7780 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56421801a6b0 0x5642181cd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06b6ff5700 0 client.28535 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/2326241068 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642181c4210 0x5642181cda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 -- 172.21.15.151:0/2326241068 >> 172.21.15.151:0/2326241068 conn(0x5642181b3ae0 msgr2=0x5642181b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 -- 172.21.15.151:0/2326241068 shutdown_connections 2023-07-21T22:51:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 1 -- 172.21.15.151:0/2326241068 wait complete. 2023-07-21T22:51:02.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.689+0000 7f06ed00fb80 20 client.28535 trim_cache size 0 max 16384 2023-07-21T22:51:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06ed00fb80 1 Processor -- start 2023-07-21T22:51:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06ed00fb80 1 -- start start 2023-07-21T22:51:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 0x5642181c7900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4210 0x5642181c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4660 0x5642181b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642181beec0 con 0x5642181c4660 2023-07-21T22:51:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642181ba9d0 con 0x5642181c4210 2023-07-21T22:51:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642181c5680 con 0x56421801a6b0 2023-07-21T22:51:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06d37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4660 0x5642181b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06d37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4660 0x5642181b8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37246/0 (socket says 172.21.15.151:37246) 2023-07-21T22:51:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06d37fe700 1 -- 172.21.15.151:0/3006951585 learned_addr learned my addr 172.21.15.151:0/3006951585 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.708+0000 7f06d27fc700 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4210 0x5642181c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 0x5642181c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06d37fe700 1 -- 172.21.15.151:0/3006951585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 msgr2=0x5642181c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06d37fe700 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 0x5642181c7900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06d37fe700 1 -- 172.21.15.151:0/3006951585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4210 msgr2=0x5642181c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06d37fe700 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4210 0x5642181c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06d37fe700 1 -- 172.21.15.151:0/3006951585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564217f641f0 con 0x5642181c4660 2023-07-21T22:51:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06d27fc700 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4210 0x5642181c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:51:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06d37fe700 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4660 0x5642181b8b60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009740 tx=0x7f06cc006000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4966b12dc45ad18a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06b9ffb700 1 -- 172.21.15.151:0/3006951585 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc022070 con 0x5642181c4660 2023-07-21T22:51:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06b9ffb700 1 -- 172.21.15.151:0/3006951585 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06cc032040 con 0x5642181c4660 2023-07-21T22:51:02.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.709+0000 7f06b9ffb700 1 -- 172.21.15.151:0/3006951585 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc01bcf0 con 0x5642181c4660 2023-07-21T22:51:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.710+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3006951585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4660 msgr2=0x5642181b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.710+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4660 0x5642181b8b60 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009740 tx=0x7f06cc006000 comp rx=0 tx=0).stop 2023-07-21T22:51:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.710+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3006951585 shutdown_connections 2023-07-21T22:51:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.710+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4660 0x5642181b8b60 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.710+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 0x5642181c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.710+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/3006951585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4210 0x5642181c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.710+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3006951585 >> 172.21.15.151:0/3006951585 conn(0x5642181b3ae0 msgr2=0x5642181c4a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.710+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3006951585 shutdown_connections 2023-07-21T22:51:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.710+0000 7f06ed00fb80 1 -- 172.21.15.151:0/3006951585 wait complete. 2023-07-21T22:51:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.711+0000 7f06ed00fb80 1 -- start start 2023-07-21T22:51:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.711+0000 7f06ed00fb80 1 Processor -- start 2023-07-21T22:51:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 0x5642181cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06ed00fb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642181cc040 con 0x5642181c4210 2023-07-21T22:51:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642181cc1b0 con 0x5642181c4660 2023-07-21T22:51:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06ed00fb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642181cc370 con 0x56421801a6b0 2023-07-21T22:51:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06ed00fb80 10 client.0 _ll_register_callbacks cb 0x7f06cc009860 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37248/0 (socket says 172.21.15.151:37248) 2023-07-21T22:51:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d27fc700 1 -- 172.21.15.151:0/1974726292 learned_addr learned my addr 172.21.15.151:0/1974726292 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 0x5642181cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d37fe700 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d27fc700 1 -- 172.21.15.151:0/1974726292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 msgr2=0x5642181cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d27fc700 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 0x5642181cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d27fc700 1 -- 172.21.15.151:0/1974726292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 msgr2=0x5642181cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:02.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d27fc700 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:02.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d27fc700 1 -- 172.21.15.151:0/1974726292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d410f400 con 0x5642181c4210 2023-07-21T22:51:02.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.712+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 0x5642181cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:51:02.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.713+0000 7f06d37fe700 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:51:02.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.713+0000 7f06d27fc700 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181cd9c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f06c8000c00 tx=0x7f06c8005790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d87d6700c3c730 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:02.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.713+0000 7f06b6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:51:02.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.713+0000 7f06b6ff5700 1 -- 172.21.15.151:0/1974726292 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c801f040 con 0x5642181c4210 2023-07-21T22:51:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.713+0000 7f06ed00fb80 1 -- 172.21.15.151:0/1974726292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f06c409a060 con 0x5642181c4210 2023-07-21T22:51:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.713+0000 7f06b6ff5700 1 -- 172.21.15.151:0/1974726292 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(139..139 src has 1..139) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f06c800bd90 con 0x5642181c4210 2023-07-21T22:51:02.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.713+0000 7f06b6ff5700 1 -- 172.21.15.151:0/1974726292 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=96) v2 ==== 24+0+0 (secure 0 0 0) 0x7f06c8003760 con 0x5642181c4210 2023-07-21T22:51:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.713+0000 7f06ed00fb80 10 client.18879 fetch_fsmap learned FSMap version 96 2023-07-21T22:51:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.713+0000 7f06ed00fb80 1 -- 172.21.15.151:0/1974726292 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=96,monmap=4+}) v3 -- 0x564217f26c00 con 0x5642181c4210 2023-07-21T22:51:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.714+0000 7f06b6ff5700 1 -- 172.21.15.151:0/1974726292 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f06c8035020 con 0x5642181c4210 2023-07-21T22:51:02.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.714+0000 7f06b6ff5700 1 -- 172.21.15.151:0/1974726292 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 96) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f06c800f950 con 0x5642181c4210 2023-07-21T22:51:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.714+0000 7f06ed00fb80 10 client.18879 fetch_fsmap finished waiting for FSMap version 96 2023-07-21T22:51:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.714+0000 7f06ed00fb80 10 client.18879 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.714+0000 7f06ed00fb80 20 client.18879 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:02.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.714+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56421822caf0 0x56421822ef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.714+0000 7f06ed00fb80 4 client.18879 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:51:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.714+0000 7f06ed00fb80 1 -- 172.21.15.151:0/1974726292 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5642180caff0 con 0x56421822caf0 2023-07-21T22:51:02.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.715+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56421822caf0 0x56421822ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.715+0000 7f06d2ffd700 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56421822caf0 0x56421822ef00 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5933831a24fbd742 server_cookie=f7ad89a4659cc73e in_seq=0 out_seq=0 2023-07-21T22:51:02.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:02.715+0000 7f06b6ff5700 10 client.18879 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:03.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:02 smithi187 ceph-mon[96918]: pgmap v1009: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 11 MiB/s wr, 762 op/s 2023-07-21T22:51:03.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:02 smithi195 ceph-mon[97365]: pgmap v1009: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 11 MiB/s wr, 762 op/s 2023-07-21T22:51:03.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:02 smithi151 ceph-mon[95510]: pgmap v1009: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 59 MiB/s rd, 11 MiB/s wr, 762 op/s 2023-07-21T22:51:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06b6ff5700 1 -- 172.21.15.151:0/1974726292 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5642180caff0 con 0x56421822caf0 2023-07-21T22:51:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06b6ff5700 10 client.18879 handle_command_reply: tid=0 2023-07-21T22:51:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 client.18879 shutdown 2023-07-21T22:51:03.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 -- 172.21.15.151:0/1974726292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 msgr2=0x5642181cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181cd9c0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f06c8000c00 tx=0x7f06c8005790 comp rx=0 tx=0).stop 2023-07-21T22:51:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 -- 172.21.15.151:0/1974726292 shutdown_connections 2023-07-21T22:51:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56421822caf0 0x56421822ef00 crc :-1 s=READY pgs=384 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642181c4660 0x5642181cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56421801a6b0 0x5642181cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 --2- 172.21.15.151:0/1974726292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642181c4210 0x5642181cd9c0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:03.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 -- 172.21.15.151:0/1974726292 >> 172.21.15.151:0/1974726292 conn(0x5642181b3ae0 msgr2=0x5642181c30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06b6ff5700 0 client.18879 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 -- 172.21.15.151:0/1974726292 shutdown_connections 2023-07-21T22:51:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 1 -- 172.21.15.151:0/1974726292 wait complete. 2023-07-21T22:51:03.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.658+0000 7f06ed00fb80 20 client.18879 trim_cache size 0 max 16384 2023-07-21T22:51:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:51:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:51:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:51:03.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:51:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 -- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06bc0a1340 msgr2=0x7f06bc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06bc0a1340 0x7f06bc0a37f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009790 tx=0x7f06cc009130 comp rx=0 tx=0).stop 2023-07-21T22:51:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 -- 172.21.15.151:0/3328664556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d4101fb0 msgr2=0x7f06d4197e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d4101fb0 0x7f06d4197e70 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f06c400e9a0 tx=0x7f06c400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:51:03.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 -- 172.21.15.151:0/3328664556 shutdown_connections 2023-07-21T22:51:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06bc0a1340 0x7f06bc0a37f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d4101fb0 0x7f06d4197e70 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d4106ff0 0x7f06d419c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 --2- 172.21.15.151:0/3328664556 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06d4102950 0x7f06d41983b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 -- 172.21.15.151:0/3328664556 >> 172.21.15.151:0/3328664556 conn(0x7f06d40fd800 msgr2=0x7f06d40fe330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 -- 172.21.15.151:0/3328664556 shutdown_connections 2023-07-21T22:51:03.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:03.659+0000 7f06d95ff700 1 -- 172.21.15.151:0/3328664556 wait complete. 2023-07-21T22:51:04.264 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: *** Caught signal (Segmentation fault) ** 2023-07-21T22:51:04.264 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: in thread 7ff27a0cb700 thread_name:md_log_replay 2023-07-21T22:51:04.264 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:51:04.264 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff28ac79cf0] 2023-07-21T22:51:04.264 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2: /usr/bin/ceph-mds(+0x4c4c6f) [0x562091ed4c6f] 2023-07-21T22:51:04.265 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x562091ed6ea3] 2023-07-21T22:51:04.265 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 4: (MDLog::_replay_thread()+0x66d) [0x562091f42ced] 2023-07-21T22:51:04.265 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 5: (MDLog::ReplayThread::entry()+0x11) [0x562091bf07e1] 2023-07-21T22:51:04.265 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7ff28ac6f1ca] 2023-07-21T22:51:04.265 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 7: clone() 2023-07-21T22:51:04.265 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2023-07-21T22:51:03.934+0000 7ff27a0cb700 -1 *** Caught signal (Segmentation fault) ** 2023-07-21T22:51:04.265 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: in thread 7ff27a0cb700 thread_name:md_log_replay 2023-07-21T22:51:04.266 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2023-07-21T22:51:04.266 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:51:04.266 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff28ac79cf0] 2023-07-21T22:51:04.266 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2: /usr/bin/ceph-mds(+0x4c4c6f) [0x562091ed4c6f] 2023-07-21T22:51:04.266 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x562091ed6ea3] 2023-07-21T22:51:04.266 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 4: (MDLog::_replay_thread()+0x66d) [0x562091f42ced] 2023-07-21T22:51:04.266 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 5: (MDLog::ReplayThread::entry()+0x11) [0x562091bf07e1] 2023-07-21T22:51:04.266 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7ff28ac6f1ca] 2023-07-21T22:51:04.267 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 7: clone() 2023-07-21T22:51:04.267 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-21T22:51:04.267 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2023-07-21T22:51:04.267 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 0> 2023-07-21T22:51:03.934+0000 7ff27a0cb700 -1 *** Caught signal (Segmentation fault) ** 2023-07-21T22:51:04.267 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: in thread 7ff27a0cb700 thread_name:md_log_replay 2023-07-21T22:51:04.267 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2023-07-21T22:51:04.267 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:51:04.267 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff28ac79cf0] 2023-07-21T22:51:04.268 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2: /usr/bin/ceph-mds(+0x4c4c6f) [0x562091ed4c6f] 2023-07-21T22:51:04.268 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x562091ed6ea3] 2023-07-21T22:51:04.268 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 4: (MDLog::_replay_thread()+0x66d) [0x562091f42ced] 2023-07-21T22:51:04.268 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 5: (MDLog::ReplayThread::entry()+0x11) [0x562091bf07e1] 2023-07-21T22:51:04.268 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7ff28ac6f1ca] 2023-07-21T22:51:04.268 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 7: clone() 2023-07-21T22:51:04.268 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-21T22:51:04.268 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2023-07-21T22:51:04.269 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: -10> 2023-07-21T22:51:03.934+0000 7ff27a0cb700 -1 *** Caught signal (Segmentation fault) ** 2023-07-21T22:51:04.269 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: in thread 7ff27a0cb700 thread_name:md_log_replay 2023-07-21T22:51:04.269 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2023-07-21T22:51:04.269 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: ceph version 18.0.0-4735-gbffe049d (bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea) reef (dev) 2023-07-21T22:51:04.269 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 1: /lib64/libpthread.so.0(+0x12cf0) [0x7ff28ac79cf0] 2023-07-21T22:51:04.269 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2: /usr/bin/ceph-mds(+0x4c4c6f) [0x562091ed4c6f] 2023-07-21T22:51:04.269 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 3: (MDSTableClient::got_journaled_ack(unsigned long)+0x173) [0x562091ed6ea3] 2023-07-21T22:51:04.269 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 4: (MDLog::_replay_thread()+0x66d) [0x562091f42ced] 2023-07-21T22:51:04.270 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 5: (MDLog::ReplayThread::entry()+0x11) [0x562091bf07e1] 2023-07-21T22:51:04.270 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 6: /lib64/libpthread.so.0(+0x81ca) [0x7ff28ac6f1ca] 2023-07-21T22:51:04.270 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 7: clone() 2023-07-21T22:51:04.270 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-07-21T22:51:04.270 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[133595]: 2023-07-21T22:51:04.648 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:04 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service: Main process exited, code=exited, status=139/n/a 2023-07-21T22:51:05.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:04 smithi187 ceph-mon[96918]: pgmap v1010: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 17 MiB/s wr, 1.06k op/s 2023-07-21T22:51:05.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:04 smithi187 ceph-mon[96918]: osdmap e140: 12 total, 12 up, 12 in 2023-07-21T22:51:05.148 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:04 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service: Failed with result 'exit-code'. 2023-07-21T22:51:05.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:04 smithi195 ceph-mon[97365]: pgmap v1010: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 17 MiB/s wr, 1.06k op/s 2023-07-21T22:51:05.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:04 smithi195 ceph-mon[97365]: osdmap e140: 12 total, 12 up, 12 in 2023-07-21T22:51:05.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:04 smithi151 ceph-mon[95510]: pgmap v1010: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 92 MiB/s rd, 17 MiB/s wr, 1.06k op/s 2023-07-21T22:51:05.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:04 smithi151 ceph-mon[95510]: osdmap e140: 12 total, 12 up, 12 in 2023-07-21T22:51:07.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:06 smithi187 ceph-mon[96918]: pgmap v1012: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 15 MiB/s wr, 732 op/s 2023-07-21T22:51:07.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:06 smithi195 ceph-mon[97365]: pgmap v1012: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 15 MiB/s wr, 732 op/s 2023-07-21T22:51:07.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:06 smithi151 ceph-mon[95510]: pgmap v1012: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 69 MiB/s rd, 15 MiB/s wr, 732 op/s 2023-07-21T22:51:08.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:07 smithi187 ceph-mon[96918]: pgmap v1013: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 13 MiB/s wr, 668 op/s 2023-07-21T22:51:08.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:07 smithi195 ceph-mon[97365]: pgmap v1013: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 13 MiB/s wr, 668 op/s 2023-07-21T22:51:08.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:07 smithi151 ceph-mon[95510]: pgmap v1013: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 13 MiB/s wr, 668 op/s 2023-07-21T22:51:10.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:10 smithi195 ceph-mon[97365]: pgmap v1014: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 13 MiB/s wr, 668 op/s 2023-07-21T22:51:10.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:10 smithi151 ceph-mon[95510]: pgmap v1014: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 13 MiB/s wr, 668 op/s 2023-07-21T22:51:10.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:10 smithi187 ceph-mon[96918]: pgmap v1014: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 13 MiB/s wr, 668 op/s 2023-07-21T22:51:13.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:12 smithi187 ceph-mon[96918]: pgmap v1015: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 13 MiB/s wr, 668 op/s 2023-07-21T22:51:13.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:12 smithi187 ceph-mon[96918]: osdmap e141: 12 total, 12 up, 12 in 2023-07-21T22:51:13.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:12 smithi195 ceph-mon[97365]: pgmap v1015: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 13 MiB/s wr, 668 op/s 2023-07-21T22:51:13.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:12 smithi195 ceph-mon[97365]: osdmap e141: 12 total, 12 up, 12 in 2023-07-21T22:51:13.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:12 smithi151 ceph-mon[95510]: pgmap v1015: 97 pgs: 97 active+clean; 11 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 MiB/s rd, 13 MiB/s wr, 668 op/s 2023-07-21T22:51:13.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:12 smithi151 ceph-mon[95510]: osdmap e141: 12 total, 12 up, 12 in 2023-07-21T22:51:15.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:14 smithi187 ceph-mon[96918]: pgmap v1017: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s rd, 13 MiB/s wr, 766 op/s 2023-07-21T22:51:15.148 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:14 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service: Service RestartSec=10s expired, scheduling restart. 2023-07-21T22:51:15.149 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:14 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service: Scheduled restart job, restart counter is at 2. 2023-07-21T22:51:15.149 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:14 smithi195 systemd[1]: Stopped Ceph mds.f for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:51:15.149 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:14 smithi195 systemd[1]: Starting Ceph mds.f for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T22:51:15.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:14 smithi195 ceph-mon[97365]: pgmap v1017: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s rd, 13 MiB/s wr, 766 op/s 2023-07-21T22:51:15.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:14 smithi151 ceph-mon[95510]: pgmap v1017: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 86 MiB/s rd, 13 MiB/s wr, 766 op/s 2023-07-21T22:51:15.648 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:15 smithi195 podman[134539]: 2023-07-21T22:51:16.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:15 smithi187 ceph-mon[96918]: daemon mds.f restarted 2023-07-21T22:51:16.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:15 smithi195 ceph-mon[97365]: daemon mds.f restarted 2023-07-21T22:51:16.149 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:15 smithi195 bash[134539]: 37f4ea1882906a67136e1e8e8f068cafaaa6c8eebc8542ab75c50b1d96dc1009 2023-07-21T22:51:16.149 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:15 smithi195 ceph-mds[134580]: -- 172.21.15.195:0/27627392 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f7bec5d1e0 con 0x55f7bec33000 2023-07-21T22:51:16.149 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:15 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[134556]: starting mds.f at 2023-07-21T22:51:16.150 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:51:15 smithi195 systemd[1]: Started Ceph mds.f for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T22:51:16.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:15 smithi151 ceph-mon[95510]: daemon mds.f restarted 2023-07-21T22:51:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.823+0000 7f95cdbff700 1 -- 172.21.15.151:0/2795629325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 msgr2=0x7f95c8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:16.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.823+0000 7f95cdbff700 1 --2- 172.21.15.151:0/2795629325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 0x7f95c8067fe0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f95b80099c0 tx=0x7f95b8009cd0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.823+0000 7f95cdbff700 1 -- 172.21.15.151:0/2795629325 shutdown_connections 2023-07-21T22:51:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.823+0000 7f95cdbff700 1 --2- 172.21.15.151:0/2795629325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95c8104e50 0x7f95c810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.823+0000 7f95cdbff700 1 --2- 172.21.15.151:0/2795629325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 0x7f95c8067fe0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.823+0000 7f95cdbff700 1 --2- 172.21.15.151:0/2795629325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95c80685b0 0x7f95c8104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.823+0000 7f95cdbff700 1 -- 172.21.15.151:0/2795629325 >> 172.21.15.151:0/2795629325 conn(0x7f95c8074760 msgr2=0x7f95c8074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.823+0000 7f95cdbff700 1 -- 172.21.15.151:0/2795629325 shutdown_connections 2023-07-21T22:51:16.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.823+0000 7f95cdbff700 1 -- 172.21.15.151:0/2795629325 wait complete. 2023-07-21T22:51:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.824+0000 7f95cdbff700 1 Processor -- start 2023-07-21T22:51:16.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.824+0000 7f95cdbff700 1 -- start start 2023-07-21T22:51:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95cdbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 0x7f95c80fec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95cdbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95c80685b0 0x7f95c80ff180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95cdbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95c8104e50 0x7f95c81a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95cdbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c81a42f0 con 0x7f95c8067c10 2023-07-21T22:51:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95cdbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c81a4430 con 0x7f95c80685b0 2023-07-21T22:51:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95cdbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95c81a45a0 con 0x7f95c8104e50 2023-07-21T22:51:16.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 0x7f95c80fec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 0x7f95c80fec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40476/0 (socket says 172.21.15.151:40476) 2023-07-21T22:51:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c77fe700 1 -- 172.21.15.151:0/3673046740 learned_addr learned my addr 172.21.15.151:0/3673046740 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c6ffd700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95c80685b0 0x7f95c80ff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c7fff700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95c8104e50 0x7f95c81a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c77fe700 1 -- 172.21.15.151:0/3673046740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95c8104e50 msgr2=0x7f95c81a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c77fe700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95c8104e50 0x7f95c81a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c77fe700 1 -- 172.21.15.151:0/3673046740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95c80685b0 msgr2=0x7f95c80ff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:16.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c77fe700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95c80685b0 0x7f95c80ff180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.825+0000 7f95c77fe700 1 -- 172.21.15.151:0/3673046740 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b80095f0 con 0x7f95c8067c10 2023-07-21T22:51:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.826+0000 7f95c77fe700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 0x7f95c80fec40 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f95b8005910 tx=0x7f95b800f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:16.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.826+0000 7f95c4ff9700 1 -- 172.21.15.151:0/3673046740 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b801d070 con 0x7f95c8067c10 2023-07-21T22:51:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.826+0000 7f95c4ff9700 1 -- 172.21.15.151:0/3673046740 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95b8005050 con 0x7f95c8067c10 2023-07-21T22:51:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.826+0000 7f95c4ff9700 1 -- 172.21.15.151:0/3673046740 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b8004950 con 0x7f95c8067c10 2023-07-21T22:51:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.826+0000 7f95cdbff700 1 -- 172.21.15.151:0/3673046740 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95c81a4820 con 0x7f95c8067c10 2023-07-21T22:51:16.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.826+0000 7f95cdbff700 1 -- 172.21.15.151:0/3673046740 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c81a4c40 con 0x7f95c8067c10 2023-07-21T22:51:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.830+0000 7f95c4ff9700 1 -- 172.21.15.151:0/3673046740 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f95b80051c0 con 0x7f95c8067c10 2023-07-21T22:51:16.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.831+0000 7f95e15beb80 1 Processor -- start 2023-07-21T22:51:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.831+0000 7f95e15beb80 1 -- start start 2023-07-21T22:51:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.831+0000 7f95c4ff9700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f95b00a1340 0x7f95b00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.831+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b10336b0 0x5598b11dccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.831+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd210 0x5598b11d6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.831+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 0x5598b11d74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95e15beb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b10dcc50 con 0x5598b10336b0 2023-07-21T22:51:16.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95e15beb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b112f9e0 con 0x5598b11dd660 2023-07-21T22:51:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95e15beb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1128e70 con 0x5598b11dd210 2023-07-21T22:51:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c4ff9700 1 -- 172.21.15.151:0/3673046740 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f95b80cd9b0 con 0x7f95c8067c10 2023-07-21T22:51:16.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c7fff700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f95b00a1340 0x7f95b00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b10336b0 0x5598b11dccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b10336b0 0x5598b11dccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40488/0 (socket says 172.21.15.151:40488) 2023-07-21T22:51:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c77fe700 1 -- 172.21.15.151:0/1420844356 learned_addr learned my addr 172.21.15.151:0/1420844356 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c6ffd700 1 --2- 172.21.15.151:0/1420844356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd210 0x5598b11d6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c7fff700 1 --2- 172.21.15.151:0/1420844356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 0x5598b11d74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c77fe700 1 -- 172.21.15.151:0/1420844356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd210 msgr2=0x5598b11d6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c77fe700 1 --2- 172.21.15.151:0/1420844356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd210 0x5598b11d6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c77fe700 1 -- 172.21.15.151:0/1420844356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 msgr2=0x5598b11d74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c77fe700 1 --2- 172.21.15.151:0/1420844356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 0x5598b11d74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.832+0000 7f95c77fe700 1 -- 172.21.15.151:0/1420844356 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b0f56d80 con 0x5598b10336b0 2023-07-21T22:51:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.833+0000 7f95c77fe700 1 --2- 172.21.15.151:0/1420844356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b10336b0 0x5598b11dccd0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f95b8097590 tx=0x7f95b802e980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cc4139a26b71fea server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.833+0000 7f95c7fff700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f95b00a1340 0x7f95b00a37f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009ec0 tx=0x7f95c000fc40 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.833+0000 7f95adffb700 1 -- 172.21.15.151:0/1420844356 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b809ab20 con 0x5598b10336b0 2023-07-21T22:51:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.833+0000 7f95adffb700 1 -- 172.21.15.151:0/1420844356 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95b809eb50 con 0x5598b10336b0 2023-07-21T22:51:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.833+0000 7f95adffb700 1 -- 172.21.15.151:0/1420844356 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b802d5f0 con 0x5598b10336b0 2023-07-21T22:51:16.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 -- 172.21.15.151:0/1420844356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b10336b0 msgr2=0x5598b11dccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 --2- 172.21.15.151:0/1420844356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b10336b0 0x5598b11dccd0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f95b8097590 tx=0x7f95b802e980 comp rx=0 tx=0).stop 2023-07-21T22:51:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 -- 172.21.15.151:0/1420844356 shutdown_connections 2023-07-21T22:51:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 --2- 172.21.15.151:0/1420844356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 0x5598b11d74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 --2- 172.21.15.151:0/1420844356 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b10336b0 0x5598b11dccd0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 --2- 172.21.15.151:0/1420844356 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd210 0x5598b11d6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 -- 172.21.15.151:0/1420844356 >> 172.21.15.151:0/1420844356 conn(0x5598b11ccae0 msgr2=0x5598b11d20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:16.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 -- 172.21.15.151:0/1420844356 shutdown_connections 2023-07-21T22:51:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 -- 172.21.15.151:0/1420844356 wait complete. 2023-07-21T22:51:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.834+0000 7f95e15beb80 1 -- start start 2023-07-21T22:51:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.835+0000 7f95e15beb80 1 Processor -- start 2023-07-21T22:51:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.835+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b10336b0 0x5598b11e61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.835+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 0x5598b11e6710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.835+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd660 0x5598b11e04d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.835+0000 7f95e15beb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b10c8a60 con 0x5598b11dd210 2023-07-21T22:51:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.835+0000 7f95e15beb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b10c8760 con 0x5598b10336b0 2023-07-21T22:51:16.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.835+0000 7f95e15beb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b0fac8c0 con 0x5598b11dd660 2023-07-21T22:51:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.835+0000 7f95e15beb80 10 client.0 _ll_register_callbacks cb 0x5598b10c6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b10336b0 0x5598b11e61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 0x5598b11e6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c77fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b10336b0 0x5598b11e61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39614/0 (socket says 172.21.15.151:39614) 2023-07-21T22:51:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c77fe700 1 -- 172.21.15.151:0/295404686 learned_addr learned my addr 172.21.15.151:0/295404686 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c7fff700 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd660 0x5598b11e04d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c77fe700 1 -- 172.21.15.151:0/295404686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd660 msgr2=0x5598b11e04d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:16.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c77fe700 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd660 0x5598b11e04d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c77fe700 1 -- 172.21.15.151:0/295404686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 msgr2=0x5598b11e6710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c77fe700 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 0x5598b11e6710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c77fe700 1 -- 172.21.15.151:0/295404686 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95c81a4c40 con 0x5598b10336b0 2023-07-21T22:51:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c7fff700 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd660 0x5598b11e04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:51:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95c77fe700 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b10336b0 0x5598b11e61d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f95b809aab0 tx=0x7f95b80a2fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c3430f93c27ee55 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:16.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.836+0000 7f95a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:51:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.837+0000 7f95a6ffd700 1 -- 172.21.15.151:0/295404686 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80b2070 con 0x5598b10336b0 2023-07-21T22:51:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.837+0000 7f95a6ffd700 1 -- 172.21.15.151:0/295404686 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f95b80b3220 con 0x5598b10336b0 2023-07-21T22:51:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.837+0000 7f95e15beb80 1 -- 172.21.15.151:0/295404686 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5598b1082490 con 0x5598b10336b0 2023-07-21T22:51:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.837+0000 7f95a6ffd700 1 -- 172.21.15.151:0/295404686 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95b80cb590 con 0x5598b10336b0 2023-07-21T22:51:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.837+0000 7f95e15beb80 10 client.28556 fetch_fsmap learned FSMap version 98 2023-07-21T22:51:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.837+0000 7f95e15beb80 1 -- 172.21.15.151:0/295404686 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x5598b0f3fc00 con 0x5598b10336b0 2023-07-21T22:51:16.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.837+0000 7f95a6ffd700 1 -- 172.21.15.151:0/295404686 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5598b1082490 con 0x5598b10336b0 2023-07-21T22:51:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.838+0000 7f95a6ffd700 1 -- 172.21.15.151:0/295404686 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f95b80a2b70 con 0x5598b10336b0 2023-07-21T22:51:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.838+0000 7f95e15beb80 10 client.28556 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:51:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.838+0000 7f95e15beb80 10 client.28556 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.838+0000 7f95e15beb80 20 client.28556 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.838+0000 7f95e15beb80 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5598b11f0230 0x5598b11f2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.838+0000 7f95e15beb80 4 client.28556 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:51:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.838+0000 7f95e15beb80 1 -- 172.21.15.151:0/295404686 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5598b1121e50 con 0x5598b11f0230 2023-07-21T22:51:16.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.838+0000 7f95c6ffd700 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5598b11f0230 0x5598b11f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.839+0000 7f95c6ffd700 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5598b11f0230 0x5598b11f2610 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dab79173288196ba server_cookie=6e4378e7666122c4 in_seq=0 out_seq=0 2023-07-21T22:51:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.839+0000 7f95a6ffd700 10 client.28556 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.839+0000 7f95a6ffd700 1 -- 172.21.15.151:0/295404686 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5598b1121e50 con 0x5598b11f0230 2023-07-21T22:51:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.839+0000 7f95a6ffd700 10 client.28556 handle_command_reply: tid=0 2023-07-21T22:51:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.839+0000 7f95e15beb80 1 client.28556 shutdown 2023-07-21T22:51:16.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 -- 172.21.15.151:0/295404686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b10336b0 msgr2=0x5598b11e61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b10336b0 0x5598b11e61d0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f95b809aab0 tx=0x7f95b80a2fd0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 -- 172.21.15.151:0/295404686 shutdown_connections 2023-07-21T22:51:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5598b11f0230 0x5598b11f2610 crc :-1 s=READY pgs=385 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b10336b0 0x5598b11e61d0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b11dd660 0x5598b11e04d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95a6ffd700 0 client.28556 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:16.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 --2- 172.21.15.151:0/295404686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 0x5598b11e6710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 -- 172.21.15.151:0/295404686 >> 172.21.15.151:0/295404686 conn(0x5598b11ccae0 msgr2=0x5598b11d13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 -- 172.21.15.151:0/295404686 shutdown_connections 2023-07-21T22:51:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 1 -- 172.21.15.151:0/295404686 wait complete. 2023-07-21T22:51:16.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.840+0000 7f95e15beb80 20 client.28556 trim_cache size 0 max 16384 2023-07-21T22:51:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.855+0000 7f95e15beb80 1 Processor -- start 2023-07-21T22:51:16.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95e15beb80 1 -- start start 2023-07-21T22:51:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd210 0x5598b11d1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd660 0x5598b11d20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95e15beb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1121e50 con 0x5598b11dd660 2023-07-21T22:51:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95e15beb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b1082490 con 0x5598b11dd210 2023-07-21T22:51:16.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95e15beb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b11e09c0 con 0x5598b10336b0 2023-07-21T22:51:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95c6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd210 0x5598b11d1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95c7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd660 0x5598b11d20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95c77fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95c6ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd210 0x5598b11d1b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39618/0 (socket says 172.21.15.151:39618) 2023-07-21T22:51:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.856+0000 7f95c6ffd700 1 -- 172.21.15.151:0/3074642493 learned_addr learned my addr 172.21.15.151:0/3074642493 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:16.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.857+0000 7f95c6ffd700 1 -- 172.21.15.151:0/3074642493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 msgr2=0x5598b11e0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.857+0000 7f95c6ffd700 1 --2- 172.21.15.151:0/3074642493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.857+0000 7f95c6ffd700 1 -- 172.21.15.151:0/3074642493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd660 msgr2=0x5598b11d20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.857+0000 7f95c6ffd700 1 --2- 172.21.15.151:0/3074642493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd660 0x5598b11d20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.857+0000 7f95c6ffd700 1 -- 172.21.15.151:0/3074642493 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5598b0f7d1f0 con 0x5598b11dd210 2023-07-21T22:51:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.857+0000 7f95c77fe700 1 --2- 172.21.15.151:0/3074642493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:51:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.857+0000 7f95c6ffd700 1 --2- 172.21.15.151:0/3074642493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd210 0x5598b11d1b60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f95bc004790 tx=0x7f95bc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6684c54713560ced server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:16.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.857+0000 7f95ae7fc700 1 -- 172.21.15.151:0/3074642493 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc017070 con 0x5598b11dd210 2023-07-21T22:51:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.857+0000 7f95ae7fc700 1 -- 172.21.15.151:0/3074642493 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95bc018040 con 0x5598b11dd210 2023-07-21T22:51:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95ae7fc700 1 -- 172.21.15.151:0/3074642493 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95bc010430 con 0x5598b11dd210 2023-07-21T22:51:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95e15beb80 1 -- 172.21.15.151:0/3074642493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd210 msgr2=0x5598b11d1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95e15beb80 1 --2- 172.21.15.151:0/3074642493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd210 0x5598b11d1b60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f95bc004790 tx=0x7f95bc009260 comp rx=0 tx=0).stop 2023-07-21T22:51:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95e15beb80 1 -- 172.21.15.151:0/3074642493 shutdown_connections 2023-07-21T22:51:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95e15beb80 1 --2- 172.21.15.151:0/3074642493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd660 0x5598b11d20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95e15beb80 1 --2- 172.21.15.151:0/3074642493 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95e15beb80 1 --2- 172.21.15.151:0/3074642493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd210 0x5598b11d1b60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95e15beb80 1 -- 172.21.15.151:0/3074642493 >> 172.21.15.151:0/3074642493 conn(0x5598b11ccae0 msgr2=0x5598b11dfd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95e15beb80 1 -- 172.21.15.151:0/3074642493 shutdown_connections 2023-07-21T22:51:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.858+0000 7f95e15beb80 1 -- 172.21.15.151:0/3074642493 wait complete. 2023-07-21T22:51:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.859+0000 7f95e15beb80 1 -- start start 2023-07-21T22:51:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.859+0000 7f95e15beb80 1 Processor -- start 2023-07-21T22:51:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.859+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e5e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.859+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 0x5598b11e63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.859+0000 7f95e15beb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 0x5598b11e43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.859+0000 7f95e15beb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b11e4ad0 con 0x5598b11dd210 2023-07-21T22:51:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.859+0000 7f95e15beb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b11e4c40 con 0x5598b11dd660 2023-07-21T22:51:16.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.859+0000 7f95e15beb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5598b11e4e00 con 0x5598b10336b0 2023-07-21T22:51:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.859+0000 7f95e15beb80 10 client.0 _ll_register_callbacks cb 0x7f95bc009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 0x5598b11e63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c6ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 0x5598b11e63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40510/0 (socket says 172.21.15.151:40510) 2023-07-21T22:51:16.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c6ffd700 1 -- 172.21.15.151:0/528595919 learned_addr learned my addr 172.21.15.151:0/528595919 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c77fe700 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e5e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c7fff700 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 0x5598b11e43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c77fe700 1 -- 172.21.15.151:0/528595919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 msgr2=0x5598b11e43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c77fe700 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 0x5598b11e43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c77fe700 1 -- 172.21.15.151:0/528595919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 msgr2=0x5598b11e63a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c77fe700 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 0x5598b11e63a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c77fe700 1 -- 172.21.15.151:0/528595919 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5598b0f3fc00 con 0x5598b10336b0 2023-07-21T22:51:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c7fff700 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 0x5598b11e43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:51:16.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95c77fe700 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e5e60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f95b809a820 tx=0x7f95b80098f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c0abcc859b5ec58 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.860+0000 7f95a6ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:51:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95a6ffd700 1 -- 172.21.15.151:0/528595919 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b80b2070 con 0x5598b10336b0 2023-07-21T22:51:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95e15beb80 1 -- 172.21.15.151:0/528595919 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f95b809eb50 con 0x5598b10336b0 2023-07-21T22:51:16.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95a6ffd700 1 -- 172.21.15.151:0/528595919 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f95b809a220 con 0x5598b10336b0 2023-07-21T22:51:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95a6ffd700 1 -- 172.21.15.151:0/528595919 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f95b80b3230 con 0x5598b10336b0 2023-07-21T22:51:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95e15beb80 10 client.28591 fetch_fsmap learned FSMap version 98 2023-07-21T22:51:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95e15beb80 1 -- 172.21.15.151:0/528595919 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x7f95bc009b30 con 0x5598b10336b0 2023-07-21T22:51:16.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95a6ffd700 1 -- 172.21.15.151:0/528595919 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f95b809eb50 con 0x5598b10336b0 2023-07-21T22:51:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95a6ffd700 1 -- 172.21.15.151:0/528595919 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f95b80969a0 con 0x5598b10336b0 2023-07-21T22:51:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95e15beb80 10 client.28591 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:51:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95e15beb80 10 client.28591 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:16.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95e15beb80 20 client.28591 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95e15beb80 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5598b1244ca0 0x5598b12470b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95e15beb80 4 client.28591 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:51:16.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.861+0000 7f95e15beb80 1 -- 172.21.15.151:0/528595919 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5598b10e3ff0 con 0x5598b1244ca0 2023-07-21T22:51:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.862+0000 7f95c6ffd700 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5598b1244ca0 0x5598b12470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.862+0000 7f95a6ffd700 10 client.28591 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.862+0000 7f95c6ffd700 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5598b1244ca0 0x5598b12470b0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d66d4a0e68804021 server_cookie=4f058a642d6c848f in_seq=0 out_seq=0 2023-07-21T22:51:16.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.869+0000 7f95a6ffd700 1 -- 172.21.15.151:0/528595919 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5598b10e3ff0 con 0x5598b1244ca0 2023-07-21T22:51:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.869+0000 7f95a6ffd700 10 client.28591 handle_command_reply: tid=0 2023-07-21T22:51:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.869+0000 7f95e15beb80 1 client.28591 shutdown 2023-07-21T22:51:16.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.869+0000 7f95e15beb80 1 -- 172.21.15.151:0/528595919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 msgr2=0x5598b11e5e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.869+0000 7f95e15beb80 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e5e60 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f95b809a820 tx=0x7f95b80098f0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95e15beb80 1 -- 172.21.15.151:0/528595919 shutdown_connections 2023-07-21T22:51:16.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95e15beb80 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5598b1244ca0 0x5598b12470b0 crc :-1 s=READY pgs=386 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95e15beb80 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5598b11dd660 0x5598b11e43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95e15beb80 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5598b10336b0 0x5598b11e5e60 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95e15beb80 1 --2- 172.21.15.151:0/528595919 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5598b11dd210 0x5598b11e63a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95e15beb80 1 -- 172.21.15.151:0/528595919 >> 172.21.15.151:0/528595919 conn(0x5598b11ccae0 msgr2=0x5598b11deca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:16.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95a6ffd700 0 client.28591 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95e15beb80 1 -- 172.21.15.151:0/528595919 shutdown_connections 2023-07-21T22:51:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95e15beb80 1 -- 172.21.15.151:0/528595919 wait complete. 2023-07-21T22:51:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.870+0000 7f95e15beb80 20 client.28591 trim_cache size 0 max 16384 2023-07-21T22:51:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:51:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:51:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:51:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:51:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 -- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f95b00a1340 msgr2=0x7f95b00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f95b00a1340 0x7f95b00a37f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009ec0 tx=0x7f95c000fc40 comp rx=0 tx=0).stop 2023-07-21T22:51:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 -- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 msgr2=0x7f95c80fec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 0x7f95c80fec40 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f95b8005910 tx=0x7f95b800f690 comp rx=0 tx=0).stop 2023-07-21T22:51:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 -- 172.21.15.151:0/3673046740 shutdown_connections 2023-07-21T22:51:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f95b00a1340 0x7f95b00a37f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f95c8104e50 0x7f95c81a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95c8067c10 0x7f95c80fec40 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 --2- 172.21.15.151:0/3673046740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95c80685b0 0x7f95c80ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 -- 172.21.15.151:0/3673046740 >> 172.21.15.151:0/3673046740 conn(0x7f95c8074760 msgr2=0x7f95c80fc640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 -- 172.21.15.151:0/3673046740 shutdown_connections 2023-07-21T22:51:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:16.871+0000 7f95cdbff700 1 -- 172.21.15.151:0/3673046740 wait complete. 2023-07-21T22:51:17.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:16 smithi187 ceph-mon[96918]: pgmap v1018: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 13 MiB/s wr, 735 op/s 2023-07-21T22:51:17.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:16 smithi187 ceph-mon[96918]: osdmap e142: 12 total, 12 up, 12 in 2023-07-21T22:51:17.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:16 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.195:6834/3555249106,v1:172.21.15.195:6835/3555249106] up:boot 2023-07-21T22:51:17.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:16 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2023-07-21T22:51:17.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:16 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:51:17.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:16 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:51:17.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:16 smithi195 ceph-mon[97365]: pgmap v1018: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 13 MiB/s wr, 735 op/s 2023-07-21T22:51:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:16 smithi195 ceph-mon[97365]: osdmap e142: 12 total, 12 up, 12 in 2023-07-21T22:51:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:16 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.195:6834/3555249106,v1:172.21.15.195:6835/3555249106] up:boot 2023-07-21T22:51:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:16 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2023-07-21T22:51:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:16 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:51:17.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:16 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:51:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:16 smithi151 ceph-mon[95510]: pgmap v1018: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 83 MiB/s rd, 13 MiB/s wr, 735 op/s 2023-07-21T22:51:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:16 smithi151 ceph-mon[95510]: osdmap e142: 12 total, 12 up, 12 in 2023-07-21T22:51:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:16 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.195:6834/3555249106,v1:172.21.15.195:6835/3555249106] up:boot 2023-07-21T22:51:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:16 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 2 up:standby-replay 7 up:standby 2023-07-21T22:51:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:16 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:51:17.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:16 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:51:18.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:17 smithi187 ceph-mon[96918]: pgmap v1020: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 18 MiB/s wr, 981 op/s 2023-07-21T22:51:18.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:17 smithi195 ceph-mon[97365]: pgmap v1020: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 18 MiB/s wr, 981 op/s 2023-07-21T22:51:18.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:17 smithi151 ceph-mon[95510]: pgmap v1020: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 18 MiB/s wr, 981 op/s 2023-07-21T22:51:20.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:20 smithi195 ceph-mon[97365]: pgmap v1021: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 18 MiB/s wr, 981 op/s 2023-07-21T22:51:20.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:20 smithi151 ceph-mon[95510]: pgmap v1021: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 18 MiB/s wr, 981 op/s 2023-07-21T22:51:20.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:20 smithi187 ceph-mon[96918]: pgmap v1021: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 100 MiB/s rd, 18 MiB/s wr, 981 op/s 2023-07-21T22:51:23.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:22 smithi187 ceph-mon[96918]: pgmap v1022: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 84 MiB/s rd, 15 MiB/s wr, 817 op/s 2023-07-21T22:51:23.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:22 smithi195 ceph-mon[97365]: pgmap v1022: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 84 MiB/s rd, 15 MiB/s wr, 817 op/s 2023-07-21T22:51:23.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:22 smithi151 ceph-mon[95510]: pgmap v1022: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 84 MiB/s rd, 15 MiB/s wr, 817 op/s 2023-07-21T22:51:25.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:24 smithi187 ceph-mon[96918]: pgmap v1023: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 MiB/s rd, 19 MiB/s wr, 421 op/s 2023-07-21T22:51:25.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:24 smithi195 ceph-mon[97365]: pgmap v1023: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 MiB/s rd, 19 MiB/s wr, 421 op/s 2023-07-21T22:51:25.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:24 smithi151 ceph-mon[95510]: pgmap v1023: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 MiB/s rd, 19 MiB/s wr, 421 op/s 2023-07-21T22:51:27.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:26 smithi187 ceph-mon[96918]: pgmap v1024: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 MiB/s rd, 19 MiB/s wr, 421 op/s 2023-07-21T22:51:27.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:26 smithi195 ceph-mon[97365]: pgmap v1024: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 MiB/s rd, 19 MiB/s wr, 421 op/s 2023-07-21T22:51:27.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:26 smithi151 ceph-mon[95510]: pgmap v1024: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 MiB/s rd, 19 MiB/s wr, 421 op/s 2023-07-21T22:51:28.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:27 smithi187 ceph-mon[96918]: pgmap v1025: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 MiB/s rd, 26 MiB/s wr, 385 op/s 2023-07-21T22:51:28.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:27 smithi195 ceph-mon[97365]: pgmap v1025: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 MiB/s rd, 26 MiB/s wr, 385 op/s 2023-07-21T22:51:28.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:27 smithi151 ceph-mon[95510]: pgmap v1025: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 35 MiB/s rd, 26 MiB/s wr, 385 op/s 2023-07-21T22:51:30.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.082+0000 7fd0047ff700 1 -- 172.21.15.151:0/1713168441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcffc104a30 msgr2=0x7fcffc104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.082+0000 7fd0047ff700 1 --2- 172.21.15.151:0/1713168441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcffc104a30 0x7fcffc104e00 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fcfec009990 tx=0x7fcfec009ca0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.082+0000 7fd0047ff700 1 -- 172.21.15.151:0/1713168441 shutdown_connections 2023-07-21T22:51:30.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.082+0000 7fd0047ff700 1 --2- 172.21.15.151:0/1713168441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcffc0ff3e0 0x7fcffc10b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.082+0000 7fd0047ff700 1 --2- 172.21.15.151:0/1713168441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcffc104a30 0x7fcffc104e00 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.082+0000 7fd0047ff700 1 --2- 172.21.15.151:0/1713168441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcffc0fea30 0x7fcffc0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.082+0000 7fd0047ff700 1 -- 172.21.15.151:0/1713168441 >> 172.21.15.151:0/1713168441 conn(0x7fcffc074760 msgr2=0x7fcffc074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.082+0000 7fd0047ff700 1 -- 172.21.15.151:0/1713168441 shutdown_connections 2023-07-21T22:51:30.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.082+0000 7fd0047ff700 1 -- 172.21.15.151:0/1713168441 wait complete. 2023-07-21T22:51:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.083+0000 7fd0047ff700 1 Processor -- start 2023-07-21T22:51:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.084+0000 7fd0047ff700 1 -- start start 2023-07-21T22:51:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.084+0000 7fd0047ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcffc0fea30 0x7fcffc19c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.084+0000 7fd0047ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcffc0ff3e0 0x7fcffc19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.084+0000 7fd0047ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcffc104a30 0x7fcffc1a0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.084+0000 7fd0047ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc1a1320 con 0x7fcffc0ff3e0 2023-07-21T22:51:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.084+0000 7fd0047ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc1a1490 con 0x7fcffc0fea30 2023-07-21T22:51:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.084+0000 7fd0047ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcffc1a1650 con 0x7fcffc104a30 2023-07-21T22:51:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd00259b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcffc0fea30 0x7fcffc19c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd00259b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcffc0fea30 0x7fcffc19c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:47566/0 (socket says 172.21.15.151:47566) 2023-07-21T22:51:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd00259b700 1 -- 172.21.15.151:0/2007856644 learned_addr learned my addr 172.21.15.151:0/2007856644 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd001d9a700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcffc0ff3e0 0x7fcffc19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd002d9c700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcffc104a30 0x7fcffc1a0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd00259b700 1 -- 172.21.15.151:0/2007856644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcffc104a30 msgr2=0x7fcffc1a0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd00259b700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcffc104a30 0x7fcffc1a0ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd00259b700 1 -- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcffc0ff3e0 msgr2=0x7fcffc19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd00259b700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcffc0ff3e0 0x7fcffc19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd00259b700 1 -- 172.21.15.151:0/2007856644 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfec0095f0 con 0x7fcffc0fea30 2023-07-21T22:51:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.085+0000 7fd00259b700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcffc0fea30 0x7fcffc19c130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcfec006010 tx=0x7fcfec004140 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.086+0000 7fcff37fe700 1 -- 172.21.15.151:0/2007856644 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec003680 con 0x7fcffc0fea30 2023-07-21T22:51:30.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.086+0000 7fcff37fe700 1 -- 172.21.15.151:0/2007856644 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfec0054d0 con 0x7fcffc0fea30 2023-07-21T22:51:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.086+0000 7fd0047ff700 1 -- 172.21.15.151:0/2007856644 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcffc1a18d0 con 0x7fcffc0fea30 2023-07-21T22:51:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.086+0000 7fcff37fe700 1 -- 172.21.15.151:0/2007856644 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec004d80 con 0x7fcffc0fea30 2023-07-21T22:51:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.086+0000 7fd0047ff700 1 -- 172.21.15.151:0/2007856644 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc1a9170 con 0x7fcffc0fea30 2023-07-21T22:51:30.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.090+0000 7fcff37fe700 1 -- 172.21.15.151:0/2007856644 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fcfec005040 con 0x7fcffc0fea30 2023-07-21T22:51:30.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.091+0000 7fcff37fe700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcfe80a1340 0x7fcfe80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.091+0000 7fcff37fe700 1 -- 172.21.15.151:0/2007856644 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcfec0ce900 con 0x7fcffc0fea30 2023-07-21T22:51:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.091+0000 7fd01819ab80 1 Processor -- start 2023-07-21T22:51:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.092+0000 7fd001d9a700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcfe80a1340 0x7fcfe80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.092+0000 7fd01819ab80 1 -- start start 2023-07-21T22:51:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.092+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556895286b0 0x5556896d1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.092+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556896d2210 0x5556896cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.092+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2660 0x5556896cc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.092+0000 7fd01819ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556895d1c50 con 0x5556896d2660 2023-07-21T22:51:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.092+0000 7fd01819ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556896249e0 con 0x5556896d2210 2023-07-21T22:51:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.092+0000 7fd01819ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55568961de70 con 0x5556895286b0 2023-07-21T22:51:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd001d9a700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcfe80a1340 0x7fcfe80a37f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcffc19d950 tx=0x7fcff800b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd00259b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556895286b0 0x5556896d1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd00259b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556895286b0 0x5556896d1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34254/0 (socket says 172.21.15.151:34254) 2023-07-21T22:51:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd00259b700 1 -- 172.21.15.151:0/122416497 learned_addr learned my addr 172.21.15.151:0/122416497 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd001d9a700 1 --2- 172.21.15.151:0/122416497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556896d2210 0x5556896cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd002d9c700 1 --2- 172.21.15.151:0/122416497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2660 0x5556896cc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd00259b700 1 -- 172.21.15.151:0/122416497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556896d2210 msgr2=0x5556896cbf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd00259b700 1 --2- 172.21.15.151:0/122416497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556896d2210 0x5556896cbf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd00259b700 1 -- 172.21.15.151:0/122416497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2660 msgr2=0x5556896cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:30.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd00259b700 1 --2- 172.21.15.151:0/122416497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2660 0x5556896cc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd00259b700 1 -- 172.21.15.151:0/122416497 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55568944bd80 con 0x5556895286b0 2023-07-21T22:51:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.093+0000 7fd00259b700 1 --2- 172.21.15.151:0/122416497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556895286b0 0x5556896d1cd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0a3a10 tx=0x7fcfec09b5b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1950e8cab883874d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.094+0000 7fcff0ff9700 1 -- 172.21.15.151:0/122416497 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0052f0 con 0x5556895286b0 2023-07-21T22:51:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.094+0000 7fcff0ff9700 1 -- 172.21.15.151:0/122416497 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfec09bb80 con 0x5556895286b0 2023-07-21T22:51:30.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.094+0000 7fcff0ff9700 1 -- 172.21.15.151:0/122416497 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec09bde0 con 0x5556895286b0 2023-07-21T22:51:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.094+0000 7fd01819ab80 1 -- 172.21.15.151:0/122416497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556895286b0 msgr2=0x5556896d1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.094+0000 7fd01819ab80 1 --2- 172.21.15.151:0/122416497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556895286b0 0x5556896d1cd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fcfec0a3a10 tx=0x7fcfec09b5b0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.095+0000 7fd01819ab80 1 -- 172.21.15.151:0/122416497 shutdown_connections 2023-07-21T22:51:30.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.095+0000 7fd01819ab80 1 --2- 172.21.15.151:0/122416497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2660 0x5556896cc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.095+0000 7fd01819ab80 1 --2- 172.21.15.151:0/122416497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556895286b0 0x5556896d1cd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.095+0000 7fd01819ab80 1 --2- 172.21.15.151:0/122416497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556896d2210 0x5556896cbf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.095+0000 7fd01819ab80 1 -- 172.21.15.151:0/122416497 >> 172.21.15.151:0/122416497 conn(0x5556896c1ae0 msgr2=0x5556896c70e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.095+0000 7fd01819ab80 1 -- 172.21.15.151:0/122416497 shutdown_connections 2023-07-21T22:51:30.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.095+0000 7fd01819ab80 1 -- 172.21.15.151:0/122416497 wait complete. 2023-07-21T22:51:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.095+0000 7fd01819ab80 1 -- start start 2023-07-21T22:51:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.096+0000 7fd01819ab80 1 Processor -- start 2023-07-21T22:51:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.096+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896db350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896db890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd01819ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556895bda60 con 0x5556896d2210 2023-07-21T22:51:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd01819ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556895bd760 con 0x5556895286b0 2023-07-21T22:51:30.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd01819ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556894a18c0 con 0x5556896d2660 2023-07-21T22:51:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd01819ab80 10 client.0 _ll_register_callbacks cb 0x5556895bb700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd00259b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896db350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd00259b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896db350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:47584/0 (socket says 172.21.15.151:47584) 2023-07-21T22:51:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd00259b700 1 -- 172.21.15.151:0/1937174137 learned_addr learned my addr 172.21.15.151:0/1937174137 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd002d9c700 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd001d9a700 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896db890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd00259b700 1 -- 172.21.15.151:0/1937174137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 msgr2=0x5556896d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd00259b700 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896d55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd00259b700 1 -- 172.21.15.151:0/1937174137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 msgr2=0x5556896db890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd00259b700 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896db890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.097+0000 7fd00259b700 1 -- 172.21.15.151:0/1937174137 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcffc1a9170 con 0x5556895286b0 2023-07-21T22:51:30.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.098+0000 7fd00259b700 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896db350 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcfec003d90 tx=0x7fcfec0052f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62af4a8939d15412 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.098+0000 7fcfe5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:51:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.098+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/1937174137 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfec0a3f40 con 0x5556895286b0 2023-07-21T22:51:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.098+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/1937174137 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcfec09b070 con 0x5556895286b0 2023-07-21T22:51:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.098+0000 7fd01819ab80 1 -- 172.21.15.151:0/1937174137 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555689577490 con 0x5556895286b0 2023-07-21T22:51:30.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.098+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/1937174137 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcfec09b230 con 0x5556895286b0 2023-07-21T22:51:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.098+0000 7fd01819ab80 10 client.28571 fetch_fsmap learned FSMap version 98 2023-07-21T22:51:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.098+0000 7fd01819ab80 1 -- 172.21.15.151:0/1937174137 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x555689434c00 con 0x5556895286b0 2023-07-21T22:51:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.098+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/1937174137 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555689577490 con 0x5556895286b0 2023-07-21T22:51:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.099+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/1937174137 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcfec0a3ab0 con 0x5556895286b0 2023-07-21T22:51:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.099+0000 7fd01819ab80 10 client.28571 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:51:30.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.099+0000 7fd01819ab80 10 client.28571 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.099+0000 7fd01819ab80 20 client.28571 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.099+0000 7fd01819ab80 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5556896e5310 0x5556896e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.099+0000 7fd01819ab80 4 client.28571 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:51:30.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.099+0000 7fd01819ab80 1 -- 172.21.15.151:0/1937174137 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555689616e50 con 0x5556896e5310 2023-07-21T22:51:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.099+0000 7fd001d9a700 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5556896e5310 0x5556896e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.100+0000 7fcfe5ffb700 10 client.28571 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.100+0000 7fd001d9a700 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5556896e5310 0x5556896e76f0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a73eab95e9ee141a server_cookie=1f4e64e32a49f607 in_seq=0 out_seq=0 2023-07-21T22:51:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/1937174137 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555689616e50 con 0x5556896e5310 2023-07-21T22:51:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fcfe5ffb700 10 client.28571 handle_command_reply: tid=0 2023-07-21T22:51:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 client.28571 shutdown 2023-07-21T22:51:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 -- 172.21.15.151:0/1937174137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 msgr2=0x5556896db350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896db350 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fcfec003d90 tx=0x7fcfec0052f0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.144 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 -- 172.21.15.151:0/1937174137 shutdown_connections 2023-07-21T22:51:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5556896e5310 0x5556896e76f0 crc :-1 s=READY pgs=387 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896db350 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896d55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 --2- 172.21.15.151:0/1937174137 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896db890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 -- 172.21.15.151:0/1937174137 >> 172.21.15.151:0/1937174137 conn(0x5556896c1ae0 msgr2=0x5556896c63e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fcfe5ffb700 0 client.28571 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:30.145 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 -- 172.21.15.151:0/1937174137 shutdown_connections 2023-07-21T22:51:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.101+0000 7fd01819ab80 1 -- 172.21.15.151:0/1937174137 wait complete. 2023-07-21T22:51:30.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.102+0000 7fd01819ab80 20 client.28571 trim_cache size 0 max 16384 2023-07-21T22:51:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.125+0000 7fd01819ab80 1 Processor -- start 2023-07-21T22:51:30.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.125+0000 7fd01819ab80 1 -- start start 2023-07-21T22:51:30.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896d55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896c6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896c70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd01819ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555689577490 con 0x5556896d2210 2023-07-21T22:51:30.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd01819ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556896d6a70 con 0x5556895286b0 2023-07-21T22:51:30.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd01819ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556896d3bb0 con 0x5556896d2660 2023-07-21T22:51:30.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd001d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896c6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd002d9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896c70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd002d9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896c70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34272/0 (socket says 172.21.15.151:34272) 2023-07-21T22:51:30.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd002d9c700 1 -- 172.21.15.151:0/2914770818 learned_addr learned my addr 172.21.15.151:0/2914770818 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.126+0000 7fd00259b700 1 --2- 172.21.15.151:0/2914770818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896d55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.127+0000 7fd002d9c700 1 -- 172.21.15.151:0/2914770818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 msgr2=0x5556896d55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.127+0000 7fd002d9c700 1 --2- 172.21.15.151:0/2914770818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896d55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.127+0000 7fd002d9c700 1 -- 172.21.15.151:0/2914770818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 msgr2=0x5556896c6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:30.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.127+0000 7fd002d9c700 1 --2- 172.21.15.151:0/2914770818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896c6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.127+0000 7fd002d9c700 1 -- 172.21.15.151:0/2914770818 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5556894721f0 con 0x5556896d2660 2023-07-21T22:51:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.127+0000 7fd002d9c700 1 --2- 172.21.15.151:0/2914770818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896c70a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009ed0 tx=0x7fcff4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b5b4bc29828a6812 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.127+0000 7fcff17fa700 1 -- 172.21.15.151:0/2914770818 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4017050 con 0x5556896d2660 2023-07-21T22:51:30.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.127+0000 7fcff17fa700 1 -- 172.21.15.151:0/2914770818 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcff4018040 con 0x5556896d2660 2023-07-21T22:51:30.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.127+0000 7fcff17fa700 1 -- 172.21.15.151:0/2914770818 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff4003970 con 0x5556896d2660 2023-07-21T22:51:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.128+0000 7fd01819ab80 1 -- 172.21.15.151:0/2914770818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 msgr2=0x5556896c70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.128+0000 7fd01819ab80 1 --2- 172.21.15.151:0/2914770818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896c70a0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcff4009ed0 tx=0x7fcff4009260 comp rx=0 tx=0).stop 2023-07-21T22:51:30.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.129+0000 7fd01819ab80 1 -- 172.21.15.151:0/2914770818 shutdown_connections 2023-07-21T22:51:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.129+0000 7fd01819ab80 1 --2- 172.21.15.151:0/2914770818 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896d55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.129+0000 7fd01819ab80 1 --2- 172.21.15.151:0/2914770818 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556896c70a0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.129+0000 7fd01819ab80 1 --2- 172.21.15.151:0/2914770818 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896c6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.129+0000 7fd01819ab80 1 -- 172.21.15.151:0/2914770818 >> 172.21.15.151:0/2914770818 conn(0x5556896c1ae0 msgr2=0x5556896d4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.129+0000 7fd01819ab80 1 -- 172.21.15.151:0/2914770818 shutdown_connections 2023-07-21T22:51:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.129+0000 7fd01819ab80 1 -- 172.21.15.151:0/2914770818 wait complete. 2023-07-21T22:51:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.129+0000 7fd01819ab80 1 -- start start 2023-07-21T22:51:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.130+0000 7fd01819ab80 1 Processor -- start 2023-07-21T22:51:30.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.130+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896d9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.130+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896d9a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.130+0000 7fd01819ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556897320a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.130+0000 7fd01819ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5556897325e0 con 0x5556896d2210 2023-07-21T22:51:30.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.130+0000 7fd01819ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555689732750 con 0x5556895286b0 2023-07-21T22:51:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.130+0000 7fd01819ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555689732910 con 0x5556896d2660 2023-07-21T22:51:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.130+0000 7fd01819ab80 10 client.0 _ll_register_callbacks cb 0x7fcff4009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd001d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896d9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd001d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896d9a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54702/0 (socket says 172.21.15.151:54702) 2023-07-21T22:51:30.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd001d9a700 1 -- 172.21.15.151:0/4227328028 learned_addr learned my addr 172.21.15.151:0/4227328028 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd00259b700 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896d9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd001d9a700 1 -- 172.21.15.151:0/4227328028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 msgr2=0x5556897320a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:51:30.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd001d9a700 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556897320a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd001d9a700 1 -- 172.21.15.151:0/4227328028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 msgr2=0x5556896d9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd001d9a700 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896d9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd001d9a700 1 -- 172.21.15.151:0/4227328028 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcff4009bb0 con 0x5556896d2210 2023-07-21T22:51:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.131+0000 7fd00259b700 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896d9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:51:30.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.132+0000 7fd001d9a700 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896d9a60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x5556896e7f30 tx=0x7fcff8004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57b20951f43d0841 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.132+0000 7fcfe5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:51:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.132+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/4227328028 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcff802a040 con 0x5556896d2210 2023-07-21T22:51:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.132+0000 7fd01819ab80 1 -- 172.21.15.151:0/4227328028 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcfec09bb80 con 0x5556896d2210 2023-07-21T22:51:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.132+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/4227328028 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fcff8030070 con 0x5556896d2210 2023-07-21T22:51:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.132+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/4227328028 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcff8004bb0 con 0x5556896d2210 2023-07-21T22:51:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fd01819ab80 10 client.18921 fetch_fsmap learned FSMap version 98 2023-07-21T22:51:30.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fd01819ab80 1 -- 172.21.15.151:0/4227328028 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x55568944a250 con 0x5556896d2210 2023-07-21T22:51:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/4227328028 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcfec09bb80 con 0x5556896d2210 2023-07-21T22:51:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/4227328028 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fcff803e4a0 con 0x5556896d2210 2023-07-21T22:51:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fd01819ab80 10 client.18921 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:51:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fd01819ab80 10 client.18921 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fd01819ab80 20 client.18921 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:30.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fd01819ab80 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55568973a140 0x55568973c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fd01819ab80 4 client.18921 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:51:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.133+0000 7fd01819ab80 1 -- 172.21.15.151:0/4227328028 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5556895d8ff0 con 0x55568973a140 2023-07-21T22:51:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.134+0000 7fd00259b700 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55568973a140 0x55568973c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.134+0000 7fcfe5ffb700 10 client.18921 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:30.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.134+0000 7fd00259b700 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55568973a140 0x55568973c550 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1ff0527535d25a1 server_cookie=6be06d4686cc60c7 in_seq=0 out_seq=0 2023-07-21T22:51:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.142+0000 7fcfe5ffb700 1 -- 172.21.15.151:0/4227328028 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5556895d8ff0 con 0x55568973a140 2023-07-21T22:51:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.142+0000 7fcfe5ffb700 10 client.18921 handle_command_reply: tid=0 2023-07-21T22:51:30.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.142+0000 7fd01819ab80 1 client.18921 shutdown 2023-07-21T22:51:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.142+0000 7fd01819ab80 1 -- 172.21.15.151:0/4227328028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 msgr2=0x5556896d9a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896d9a60 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x5556896e7f30 tx=0x7fcff8004b40 comp rx=0 tx=0).stop 2023-07-21T22:51:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 1 -- 172.21.15.151:0/4227328028 shutdown_connections 2023-07-21T22:51:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55568973a140 0x55568973c550 crc :-1 s=READY pgs=388 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5556895286b0 0x5556896d9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5556896d2660 0x5556897320a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fcfe5ffb700 0 client.18921 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 1 --2- 172.21.15.151:0/4227328028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5556896d2210 0x5556896d9a60 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 1 -- 172.21.15.151:0/4227328028 >> 172.21.15.151:0/4227328028 conn(0x5556896c1ae0 msgr2=0x5556896d3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 1 -- 172.21.15.151:0/4227328028 shutdown_connections 2023-07-21T22:51:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 1 -- 172.21.15.151:0/4227328028 wait complete. 2023-07-21T22:51:30.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.143+0000 7fd01819ab80 20 client.18921 trim_cache size 0 max 16384 2023-07-21T22:51:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:51:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:51:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:51:30.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:51:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 -- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcfe80a1340 msgr2=0x7fcfe80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcfe80a1340 0x7fcfe80a37f0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fcffc19d950 tx=0x7fcff800b040 comp rx=0 tx=0).stop 2023-07-21T22:51:30.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 -- 172.21.15.151:0/2007856644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcffc0fea30 msgr2=0x7fcffc19c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcffc0fea30 0x7fcffc19c130 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fcfec006010 tx=0x7fcfec004140 comp rx=0 tx=0).stop 2023-07-21T22:51:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 -- 172.21.15.151:0/2007856644 shutdown_connections 2023-07-21T22:51:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcfe80a1340 0x7fcfe80a37f0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcffc0fea30 0x7fcffc19c130 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcffc104a30 0x7fcffc1a0ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 --2- 172.21.15.151:0/2007856644 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcffc0ff3e0 0x7fcffc19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:30.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 -- 172.21.15.151:0/2007856644 >> 172.21.15.151:0/2007856644 conn(0x7fcffc074760 msgr2=0x7fcffc1026c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 -- 172.21.15.151:0/2007856644 shutdown_connections 2023-07-21T22:51:30.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:30.144+0000 7fd0047ff700 1 -- 172.21.15.151:0/2007856644 wait complete. 2023-07-21T22:51:30.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:30 smithi195 ceph-mon[97365]: pgmap v1026: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 18 MiB/s wr, 69 op/s 2023-07-21T22:51:30.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:30 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:51:30.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:30 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:30 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:30 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:30 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:30 smithi151 ceph-mon[95510]: pgmap v1026: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 18 MiB/s wr, 69 op/s 2023-07-21T22:51:30.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:30 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:51:30.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:30 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:30 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:30 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:30 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:30 smithi187 ceph-mon[96918]: pgmap v1026: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 18 MiB/s wr, 69 op/s 2023-07-21T22:51:30.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:30 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:51:30.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:30 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:30 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:30 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:30.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:30 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:32.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:31 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:32.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:31 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:32.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:31 smithi187 ceph-mon[96918]: pgmap v1027: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 18 MiB/s wr, 69 op/s 2023-07-21T22:51:32.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:31 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:32.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:31 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:32.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:31 smithi195 ceph-mon[97365]: pgmap v1027: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 18 MiB/s wr, 69 op/s 2023-07-21T22:51:32.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:31 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:32.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:31 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:32.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:31 smithi151 ceph-mon[95510]: pgmap v1027: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 18 MiB/s wr, 69 op/s 2023-07-21T22:51:33.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:32 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:51:33.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:32 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:51:33.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:32 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:33.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:32 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:51:33.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:32 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:51:33.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:32 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:33.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:32 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:51:33.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:32 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:51:33.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:32 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:51:34.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:33 smithi187 ceph-mon[96918]: pgmap v1028: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 27 MiB/s wr, 121 op/s 2023-07-21T22:51:34.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:33 smithi195 ceph-mon[97365]: pgmap v1028: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 27 MiB/s wr, 121 op/s 2023-07-21T22:51:34.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:33 smithi151 ceph-mon[95510]: pgmap v1028: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 27 MiB/s wr, 121 op/s 2023-07-21T22:51:36.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:36 smithi195 ceph-mon[97365]: pgmap v1029: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 18 MiB/s wr, 73 op/s 2023-07-21T22:51:36.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:36 smithi151 ceph-mon[95510]: pgmap v1029: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 18 MiB/s wr, 73 op/s 2023-07-21T22:51:36.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:36 smithi187 ceph-mon[96918]: pgmap v1029: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 18 MiB/s wr, 73 op/s 2023-07-21T22:51:38.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:37 smithi187 ceph-mon[96918]: pgmap v1030: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 29 MiB/s wr, 120 op/s 2023-07-21T22:51:38.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:37 smithi195 ceph-mon[97365]: pgmap v1030: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 29 MiB/s wr, 120 op/s 2023-07-21T22:51:38.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:37 smithi151 ceph-mon[95510]: pgmap v1030: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 29 MiB/s wr, 120 op/s 2023-07-21T22:51:40.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:40 smithi195 ceph-mon[97365]: pgmap v1031: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 20 MiB/s wr, 99 op/s 2023-07-21T22:51:40.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:40 smithi151 ceph-mon[95510]: pgmap v1031: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 20 MiB/s wr, 99 op/s 2023-07-21T22:51:40.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:40 smithi187 ceph-mon[96918]: pgmap v1031: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 20 MiB/s wr, 99 op/s 2023-07-21T22:51:43.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:42 smithi187 ceph-mon[96918]: pgmap v1032: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 20 MiB/s wr, 99 op/s 2023-07-21T22:51:43.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:42 smithi195 ceph-mon[97365]: pgmap v1032: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 20 MiB/s wr, 99 op/s 2023-07-21T22:51:43.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:42 smithi151 ceph-mon[95510]: pgmap v1032: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 761 KiB/s rd, 20 MiB/s wr, 99 op/s 2023-07-21T22:51:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.314+0000 7fc7f73ff700 1 -- 172.21.15.151:0/952897086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f0105b10 msgr2=0x7fc7f0105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.314+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/952897086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f0105b10 0x7fc7f0105ee0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec009990 tx=0x7fc7ec009ca0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.314+0000 7fc7f73ff700 1 -- 172.21.15.151:0/952897086 shutdown_connections 2023-07-21T22:51:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.314+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/952897086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f01004b0 0x7fc7f010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.314+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/952897086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f0105b10 0x7fc7f0105ee0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.314+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/952897086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f00ffb00 0x7fc7f00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.314+0000 7fc7f73ff700 1 -- 172.21.15.151:0/952897086 >> 172.21.15.151:0/952897086 conn(0x7fc7f00fb600 msgr2=0x7fc7f00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.314+0000 7fc7f73ff700 1 -- 172.21.15.151:0/952897086 shutdown_connections 2023-07-21T22:51:43.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.314+0000 7fc7f73ff700 1 -- 172.21.15.151:0/952897086 wait complete. 2023-07-21T22:51:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.315+0000 7fc7f73ff700 1 Processor -- start 2023-07-21T22:51:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.315+0000 7fc7f73ff700 1 -- start start 2023-07-21T22:51:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f73ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f00ffb00 0x7fc7f0197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f73ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f01004b0 0x7fc7f0198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f73ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f0105b10 0x7fc7f019c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f73ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f019cf40 con 0x7fc7f0105b10 2023-07-21T22:51:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f73ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f019d0b0 con 0x7fc7f01004b0 2023-07-21T22:51:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f73ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f019d270 con 0x7fc7f00ffb00 2023-07-21T22:51:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f519b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f00ffb00 0x7fc7f0197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f499a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f01004b0 0x7fc7f0198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f599c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f0105b10 0x7fc7f019c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f519b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f00ffb00 0x7fc7f0197d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43888/0 (socket says 172.21.15.151:43888) 2023-07-21T22:51:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f519b700 1 -- 172.21.15.151:0/4144928991 learned_addr learned my addr 172.21.15.151:0/4144928991 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f519b700 1 -- 172.21.15.151:0/4144928991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f01004b0 msgr2=0x7fc7f0198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f519b700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f01004b0 0x7fc7f0198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f519b700 1 -- 172.21.15.151:0/4144928991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f0105b10 msgr2=0x7fc7f019c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f519b700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f0105b10 0x7fc7f019c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.316+0000 7fc7f519b700 1 -- 172.21.15.151:0/4144928991 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7ec0095f0 con 0x7fc7f00ffb00 2023-07-21T22:51:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.317+0000 7fc7f519b700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f00ffb00 0x7fc7f0197d50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000c00 tx=0x7fc7ec004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.317+0000 7fc7e67fc700 1 -- 172.21.15.151:0/4144928991 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec01d070 con 0x7fc7f00ffb00 2023-07-21T22:51:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.317+0000 7fc7e67fc700 1 -- 172.21.15.151:0/4144928991 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7ec022470 con 0x7fc7f00ffb00 2023-07-21T22:51:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.317+0000 7fc7f73ff700 1 -- 172.21.15.151:0/4144928991 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f019d4f0 con 0x7fc7f00ffb00 2023-07-21T22:51:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.317+0000 7fc7e67fc700 1 -- 172.21.15.151:0/4144928991 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7ec017650 con 0x7fc7f00ffb00 2023-07-21T22:51:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.317+0000 7fc7f73ff700 1 -- 172.21.15.151:0/4144928991 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f01a4d90 con 0x7fc7f00ffb00 2023-07-21T22:51:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.320+0000 7fc7e67fc700 1 -- 172.21.15.151:0/4144928991 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fc7ec0225e0 con 0x7fc7f00ffb00 2023-07-21T22:51:43.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.321+0000 7fc80add9b80 1 Processor -- start 2023-07-21T22:51:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc80add9b80 1 -- start start 2023-07-21T22:51:43.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24bd7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc7e67fc700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7dc0a13c0 0x7fc7dc0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8210 0x561a24bd1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bd24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc80add9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24ad7c50 con 0x561a24bd8660 2023-07-21T22:51:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc80add9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24b2a9e0 con 0x561a24a2e6b0 2023-07-21T22:51:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc80add9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24b23e70 con 0x561a24bd8210 2023-07-21T22:51:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc7e67fc700 1 -- 172.21.15.151:0/4144928991 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc7ec0ce0f0 con 0x7fc7f00ffb00 2023-07-21T22:51:43.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc7f599c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24bd7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.322+0000 7fc7f519b700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7dc0a13c0 0x7fc7dc0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8210 0x561a24bd1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f499a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8210 0x561a24bd1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43894/0 (socket says 172.21.15.151:43894) 2023-07-21T22:51:43.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f499a700 1 -- 172.21.15.151:0/909178481 learned_addr learned my addr 172.21.15.151:0/909178481 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:43.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f599c700 1 --2- 172.21.15.151:0/909178481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bd24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f499a700 1 -- 172.21.15.151:0/909178481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 msgr2=0x561a24bd7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f499a700 1 --2- 172.21.15.151:0/909178481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24bd7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f499a700 1 -- 172.21.15.151:0/909178481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 msgr2=0x561a24bd24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f499a700 1 --2- 172.21.15.151:0/909178481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bd24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f499a700 1 -- 172.21.15.151:0/909178481 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a24951d80 con 0x561a24bd8210 2023-07-21T22:51:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f599c700 1 --2- 172.21.15.151:0/909178481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bd24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:51:43.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f519b700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7dc0a13c0 0x7fc7dc0a3870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0a30f0 tx=0x7fc7ec0047a0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.323+0000 7fc7f499a700 1 --2- 172.21.15.151:0/909178481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8210 0x561a24bd1f40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009d20 tx=0x7fc7e0011720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=313aa5143d6deb39 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc7db7fe700 1 -- 172.21.15.151:0/909178481 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0019630 con 0x561a24bd8210 2023-07-21T22:51:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc7db7fe700 1 -- 172.21.15.151:0/909178481 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7e0019c20 con 0x561a24bd8210 2023-07-21T22:51:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc7db7fe700 1 -- 172.21.15.151:0/909178481 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e000eb60 con 0x561a24bd8210 2023-07-21T22:51:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc80add9b80 1 -- 172.21.15.151:0/909178481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8210 msgr2=0x561a24bd1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc80add9b80 1 --2- 172.21.15.151:0/909178481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8210 0x561a24bd1f40 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0009d20 tx=0x7fc7e0011720 comp rx=0 tx=0).stop 2023-07-21T22:51:43.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc80add9b80 1 -- 172.21.15.151:0/909178481 shutdown_connections 2023-07-21T22:51:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc80add9b80 1 --2- 172.21.15.151:0/909178481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24bd7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc80add9b80 1 --2- 172.21.15.151:0/909178481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bd24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc80add9b80 1 --2- 172.21.15.151:0/909178481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8210 0x561a24bd1f40 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.324+0000 7fc80add9b80 1 -- 172.21.15.151:0/909178481 >> 172.21.15.151:0/909178481 conn(0x561a24bc7ae0 msgr2=0x561a24bcd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:43.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.325+0000 7fc80add9b80 1 -- 172.21.15.151:0/909178481 shutdown_connections 2023-07-21T22:51:43.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.325+0000 7fc80add9b80 1 -- 172.21.15.151:0/909178481 wait complete. 2023-07-21T22:51:43.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.325+0000 7fc80add9b80 1 -- start start 2023-07-21T22:51:43.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.325+0000 7fc80add9b80 1 Processor -- start 2023-07-21T22:51:43.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8210 0x561a24be1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8660 0x561a24bdb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc80add9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24ac3a60 con 0x561a24bd8210 2023-07-21T22:51:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc80add9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24ac3760 con 0x561a24a2e6b0 2023-07-21T22:51:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc80add9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a249a78c0 con 0x561a24bd8660 2023-07-21T22:51:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc80add9b80 10 client.0 _ll_register_callbacks cb 0x561a24ac1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8210 0x561a24be1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f599c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f599c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35364/0 (socket says 172.21.15.151:35364) 2023-07-21T22:51:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8210 0x561a24be1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53358/0 (socket says 172.21.15.151:53358) 2023-07-21T22:51:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f599c700 1 -- 172.21.15.151:0/3200440808 learned_addr learned my addr 172.21.15.151:0/3200440808 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f599c700 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8660 0x561a24bdb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f599c700 1 -- 172.21.15.151:0/3200440808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8660 msgr2=0x561a24bdb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f599c700 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8660 0x561a24bdb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f599c700 1 -- 172.21.15.151:0/3200440808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8210 msgr2=0x561a24be1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f599c700 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8210 0x561a24be1b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.326+0000 7fc7f599c700 1 -- 172.21.15.151:0/3200440808 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7e0009980 con 0x561a24a2e6b0 2023-07-21T22:51:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.327+0000 7fc7f599c700 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8007fc0 tx=0x7fc7e8009100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f30edeb8de4ebde server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:43.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.327+0000 7fc7d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:51:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.327+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/3200440808 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8018e50 con 0x561a24a2e6b0 2023-07-21T22:51:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.327+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/3200440808 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc7e8003a00 con 0x561a24a2e6b0 2023-07-21T22:51:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.327+0000 7fc80add9b80 1 -- 172.21.15.151:0/3200440808 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561a24a7d490 con 0x561a24a2e6b0 2023-07-21T22:51:43.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.327+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/3200440808 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7e8003bc0 con 0x561a24a2e6b0 2023-07-21T22:51:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.327+0000 7fc80add9b80 10 client.28589 fetch_fsmap learned FSMap version 98 2023-07-21T22:51:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.327+0000 7fc80add9b80 1 -- 172.21.15.151:0/3200440808 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x561a2493ac00 con 0x561a24a2e6b0 2023-07-21T22:51:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.328+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/3200440808 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561a24a7d490 con 0x561a24a2e6b0 2023-07-21T22:51:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.328+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/3200440808 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc7e801a430 con 0x561a24a2e6b0 2023-07-21T22:51:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.328+0000 7fc80add9b80 10 client.28589 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:51:43.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.328+0000 7fc80add9b80 10 client.28589 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.328+0000 7fc80add9b80 20 client.28589 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.328+0000 7fc80add9b80 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561a24bebb40 0x561a24bedf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.328+0000 7fc80add9b80 4 client.28589 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:51:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.328+0000 7fc80add9b80 1 -- 172.21.15.151:0/3200440808 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561a24b1ce50 con 0x561a24bebb40 2023-07-21T22:51:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.328+0000 7fc7f499a700 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561a24bebb40 0x561a24bedf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.329+0000 7fc7d8ff9700 10 client.28589 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:43.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.329+0000 7fc7f499a700 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561a24bebb40 0x561a24bedf50 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69adbec9f4dc3909 server_cookie=8b5bcd5cc2a20cba in_seq=0 out_seq=0 2023-07-21T22:51:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/3200440808 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561a24b1ce50 con 0x561a24bebb40 2023-07-21T22:51:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc7d8ff9700 10 client.28589 handle_command_reply: tid=0 2023-07-21T22:51:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 client.28589 shutdown 2023-07-21T22:51:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 -- 172.21.15.151:0/3200440808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 msgr2=0x561a24be1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fc7e8007fc0 tx=0x7fc7e8009100 comp rx=0 tx=0).stop 2023-07-21T22:51:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 -- 172.21.15.151:0/3200440808 shutdown_connections 2023-07-21T22:51:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561a24bebb40 0x561a24bedf50 crc :-1 s=READY pgs=389 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24bd8660 0x561a24bdb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc7d8ff9700 0 client.28589 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 --2- 172.21.15.151:0/3200440808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8210 0x561a24be1b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 -- 172.21.15.151:0/3200440808 >> 172.21.15.151:0/3200440808 conn(0x561a24bc7ae0 msgr2=0x561a24bcc3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:43.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 -- 172.21.15.151:0/3200440808 shutdown_connections 2023-07-21T22:51:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.330+0000 7fc80add9b80 1 -- 172.21.15.151:0/3200440808 wait complete. 2023-07-21T22:51:43.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.331+0000 7fc80add9b80 20 client.28589 trim_cache size 0 max 16384 2023-07-21T22:51:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.347+0000 7fc80add9b80 1 Processor -- start 2023-07-21T22:51:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.347+0000 7fc80add9b80 1 -- start start 2023-07-21T22:51:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.347+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24bd1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.347+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24bdb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.347+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bccb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.347+0000 7fc80add9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24bc9c00 con 0x561a24bd8660 2023-07-21T22:51:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.347+0000 7fc80add9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24be91c0 con 0x561a24bd8210 2023-07-21T22:51:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.347+0000 7fc80add9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24bd2480 con 0x561a24a2e6b0 2023-07-21T22:51:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24bd1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24bd1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43916/0 (socket says 172.21.15.151:43916) 2023-07-21T22:51:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 -- 172.21.15.151:0/2923456567 learned_addr learned my addr 172.21.15.151:0/2923456567 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 --2- 172.21.15.151:0/2923456567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f499a700 1 --2- 172.21.15.151:0/2923456567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24bdb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 -- 172.21.15.151:0/2923456567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 msgr2=0x561a24bdb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 --2- 172.21.15.151:0/2923456567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24bdb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 -- 172.21.15.151:0/2923456567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 msgr2=0x561a24bccb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 --2- 172.21.15.151:0/2923456567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bccb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 -- 172.21.15.151:0/2923456567 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561a24bf2b40 con 0x561a24a2e6b0 2023-07-21T22:51:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.348+0000 7fc7f599c700 1 --2- 172.21.15.151:0/2923456567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24bd1f40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x561a24bdb050 tx=0x7fc7e8005bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=951aed13e11c2845 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.349+0000 7fc7dbfff700 1 -- 172.21.15.151:0/2923456567 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80189d0 con 0x561a24a2e6b0 2023-07-21T22:51:43.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.349+0000 7fc7dbfff700 1 -- 172.21.15.151:0/2923456567 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7e800f040 con 0x561a24a2e6b0 2023-07-21T22:51:43.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.349+0000 7fc7dbfff700 1 -- 172.21.15.151:0/2923456567 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e801a430 con 0x561a24a2e6b0 2023-07-21T22:51:43.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.349+0000 7fc80add9b80 1 -- 172.21.15.151:0/2923456567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 msgr2=0x561a24bd1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.349+0000 7fc80add9b80 1 --2- 172.21.15.151:0/2923456567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24bd1f40 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x561a24bdb050 tx=0x7fc7e8005bc0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.350+0000 7fc80add9b80 1 -- 172.21.15.151:0/2923456567 shutdown_connections 2023-07-21T22:51:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.350+0000 7fc80add9b80 1 --2- 172.21.15.151:0/2923456567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.350+0000 7fc80add9b80 1 --2- 172.21.15.151:0/2923456567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24bd1f40 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.350+0000 7fc80add9b80 1 --2- 172.21.15.151:0/2923456567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24bdb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.350+0000 7fc80add9b80 1 -- 172.21.15.151:0/2923456567 >> 172.21.15.151:0/2923456567 conn(0x561a24bc7ae0 msgr2=0x561a24bd92c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:43.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.350+0000 7fc80add9b80 1 -- 172.21.15.151:0/2923456567 shutdown_connections 2023-07-21T22:51:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.350+0000 7fc80add9b80 1 -- 172.21.15.151:0/2923456567 wait complete. 2023-07-21T22:51:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.350+0000 7fc80add9b80 1 -- start start 2023-07-21T22:51:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.350+0000 7fc80add9b80 1 Processor -- start 2023-07-21T22:51:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24be1b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc80add9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bdfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc80add9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24be01c0 con 0x561a24bd8660 2023-07-21T22:51:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc80add9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24be0330 con 0x561a24bd8210 2023-07-21T22:51:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc80add9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561a24be04f0 con 0x561a24a2e6b0 2023-07-21T22:51:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc80add9b80 10 client.0 _ll_register_callbacks cb 0x7fc7e8007ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc7f599c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bdfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc7f599c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc7f499a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24be1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc7f599c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43926/0 (socket says 172.21.15.151:43926) 2023-07-21T22:51:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc7f599c700 1 -- 172.21.15.151:0/1940349477 learned_addr learned my addr 172.21.15.151:0/1940349477 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.351+0000 7fc7f499a700 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24be1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35384/0 (socket says 172.21.15.151:35384) 2023-07-21T22:51:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.352+0000 7fc7f499a700 1 -- 172.21.15.151:0/1940349477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 msgr2=0x561a24be1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.352+0000 7fc7f499a700 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.352+0000 7fc7f499a700 1 -- 172.21.15.151:0/1940349477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 msgr2=0x561a24bdfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.352+0000 7fc7f499a700 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bdfaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.352+0000 7fc7f499a700 1 -- 172.21.15.151:0/1940349477 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x561a2493ac00 con 0x561a24bd8210 2023-07-21T22:51:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.352+0000 7fc7f599c700 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:51:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.352+0000 7fc7f499a700 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24be1b40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x561a24bdce00 tx=0x7fc7e00058e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5677e0fc56f15d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.352+0000 7fc7d8ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:51:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.352+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/1940349477 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0005ce0 con 0x561a24bd8210 2023-07-21T22:51:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc80add9b80 1 -- 172.21.15.151:0/1940349477 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc7e0019c20 con 0x561a24bd8210 2023-07-21T22:51:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/1940349477 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc7e0029040 con 0x561a24bd8210 2023-07-21T22:51:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/1940349477 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc7e00195d0 con 0x561a24bd8210 2023-07-21T22:51:43.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc80add9b80 10 client.28595 fetch_fsmap learned FSMap version 98 2023-07-21T22:51:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc80add9b80 1 -- 172.21.15.151:0/1940349477 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x561a249781f0 con 0x561a24bd8210 2023-07-21T22:51:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/1940349477 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc7e0019c20 con 0x561a24bd8210 2023-07-21T22:51:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/1940349477 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc7e0005040 con 0x561a24bd8210 2023-07-21T22:51:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc80add9b80 10 client.28595 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:51:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc80add9b80 10 client.28595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.353+0000 7fc80add9b80 20 client.28595 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:43.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.354+0000 7fc80add9b80 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561a24c40b80 0x561a24c42f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.354+0000 7fc80add9b80 4 client.28595 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:51:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.354+0000 7fc80add9b80 1 -- 172.21.15.151:0/1940349477 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561a24adeff0 con 0x561a24c40b80 2023-07-21T22:51:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.354+0000 7fc7f599c700 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561a24c40b80 0x561a24c42f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.354+0000 7fc7f599c700 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561a24c40b80 0x561a24c42f90 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d5875d07fe0192 server_cookie=be0cd0c57e8c39b9 in_seq=0 out_seq=0 2023-07-21T22:51:43.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.354+0000 7fc7d8ff9700 10 client.28595 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:43.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc7d8ff9700 1 -- 172.21.15.151:0/1940349477 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561a24adeff0 con 0x561a24c40b80 2023-07-21T22:51:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc7d8ff9700 10 client.28595 handle_command_reply: tid=0 2023-07-21T22:51:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 client.28595 shutdown 2023-07-21T22:51:43.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 -- 172.21.15.151:0/1940349477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 msgr2=0x561a24be1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24be1b40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x561a24bdce00 tx=0x7fc7e00058e0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 -- 172.21.15.151:0/1940349477 shutdown_connections 2023-07-21T22:51:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561a24c40b80 0x561a24c42f90 crc :-1 s=READY pgs=390 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a24bd8660 0x561a24bdfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561a24a2e6b0 0x561a24be1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 --2- 172.21.15.151:0/1940349477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561a24bd8210 0x561a24be1b40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc7d8ff9700 0 client.28595 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 -- 172.21.15.151:0/1940349477 >> 172.21.15.151:0/1940349477 conn(0x561a24bc7ae0 msgr2=0x561a24bda890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 -- 172.21.15.151:0/1940349477 shutdown_connections 2023-07-21T22:51:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 1 -- 172.21.15.151:0/1940349477 wait complete. 2023-07-21T22:51:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.371+0000 7fc80add9b80 20 client.28595 trim_cache size 0 max 16384 2023-07-21T22:51:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:51:43.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:51:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:51:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:51:43.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 -- 172.21.15.151:0/4144928991 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7dc0a13c0 msgr2=0x7fc7dc0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7dc0a13c0 0x7fc7dc0a3870 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0a30f0 tx=0x7fc7ec0047a0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 -- 172.21.15.151:0/4144928991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f00ffb00 msgr2=0x7fc7f0197d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f00ffb00 0x7fc7f0197d50 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec000c00 tx=0x7fc7ec004730 comp rx=0 tx=0).stop 2023-07-21T22:51:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 -- 172.21.15.151:0/4144928991 shutdown_connections 2023-07-21T22:51:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc7dc0a13c0 0x7fc7dc0a3870 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f0105b10 0x7fc7f019c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc7f00ffb00 0x7fc7f0197d50 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 --2- 172.21.15.151:0/4144928991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f01004b0 0x7fc7f0198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 -- 172.21.15.151:0/4144928991 >> 172.21.15.151:0/4144928991 conn(0x7fc7f00fb600 msgr2=0x7fc7f010ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 -- 172.21.15.151:0/4144928991 shutdown_connections 2023-07-21T22:51:43.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:43.372+0000 7fc7f73ff700 1 -- 172.21.15.151:0/4144928991 wait complete. 2023-07-21T22:51:45.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:44 smithi187 ceph-mon[96918]: pgmap v1033: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 32 MiB/s wr, 151 op/s 2023-07-21T22:51:45.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:44 smithi195 ceph-mon[97365]: pgmap v1033: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 32 MiB/s wr, 151 op/s 2023-07-21T22:51:45.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:44 smithi151 ceph-mon[95510]: pgmap v1033: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 817 KiB/s rd, 32 MiB/s wr, 151 op/s 2023-07-21T22:51:46.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:45 smithi187 ceph-mon[96918]: pgmap v1034: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 23 MiB/s wr, 99 op/s 2023-07-21T22:51:46.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:45 smithi195 ceph-mon[97365]: pgmap v1034: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 23 MiB/s wr, 99 op/s 2023-07-21T22:51:46.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:45 smithi151 ceph-mon[95510]: pgmap v1034: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 23 MiB/s wr, 99 op/s 2023-07-21T22:51:49.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:48 smithi187 ceph-mon[96918]: pgmap v1035: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 35 MiB/s wr, 143 op/s 2023-07-21T22:51:49.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:48 smithi195 ceph-mon[97365]: pgmap v1035: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 35 MiB/s wr, 143 op/s 2023-07-21T22:51:49.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:48 smithi151 ceph-mon[95510]: pgmap v1035: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 153 KiB/s rd, 35 MiB/s wr, 143 op/s 2023-07-21T22:51:50.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:49 smithi187 ceph-mon[96918]: pgmap v1036: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 95 op/s 2023-07-21T22:51:50.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:49 smithi195 ceph-mon[97365]: pgmap v1036: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 95 op/s 2023-07-21T22:51:50.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:49 smithi151 ceph-mon[95510]: pgmap v1036: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 95 op/s 2023-07-21T22:51:53.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:52 smithi187 ceph-mon[96918]: pgmap v1037: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 95 op/s 2023-07-21T22:51:53.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:52 smithi195 ceph-mon[97365]: pgmap v1037: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 95 op/s 2023-07-21T22:51:53.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:52 smithi151 ceph-mon[95510]: pgmap v1037: 97 pgs: 97 active+clean; 11 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 24 MiB/s wr, 95 op/s 2023-07-21T22:51:54.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:53 smithi187 ceph-mon[96918]: pgmap v1038: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 37 MiB/s wr, 135 op/s 2023-07-21T22:51:54.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:53 smithi195 ceph-mon[97365]: pgmap v1038: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 37 MiB/s wr, 135 op/s 2023-07-21T22:51:54.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:53 smithi151 ceph-mon[95510]: pgmap v1038: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 37 MiB/s wr, 135 op/s 2023-07-21T22:51:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.523+0000 7fc2929ff700 1 -- 172.21.15.151:0/1760905231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c105b10 msgr2=0x7fc28c105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.523+0000 7fc2929ff700 1 --2- 172.21.15.151:0/1760905231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c105b10 0x7fc28c105ee0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fc27c009990 tx=0x7fc27c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.523+0000 7fc2929ff700 1 -- 172.21.15.151:0/1760905231 shutdown_connections 2023-07-21T22:51:56.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.523+0000 7fc2929ff700 1 --2- 172.21.15.151:0/1760905231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc28c1004b0 0x7fc28c10c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.523+0000 7fc2929ff700 1 --2- 172.21.15.151:0/1760905231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c105b10 0x7fc28c105ee0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.523+0000 7fc2929ff700 1 --2- 172.21.15.151:0/1760905231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c0ffb00 0x7fc28c0fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.523+0000 7fc2929ff700 1 -- 172.21.15.151:0/1760905231 >> 172.21.15.151:0/1760905231 conn(0x7fc28c0fb600 msgr2=0x7fc28c0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.523+0000 7fc2929ff700 1 -- 172.21.15.151:0/1760905231 shutdown_connections 2023-07-21T22:51:56.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.523+0000 7fc2929ff700 1 -- 172.21.15.151:0/1760905231 wait complete. 2023-07-21T22:51:56.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.524+0000 7fc2929ff700 1 Processor -- start 2023-07-21T22:51:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.524+0000 7fc2929ff700 1 -- start start 2023-07-21T22:51:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc2929ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c0ffb00 0x7fc28c19bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc2929ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc28c1004b0 0x7fc28c19c040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc2929ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c105b10 0x7fc28c195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc2929ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c195fd0 con 0x7fc28c0ffb00 2023-07-21T22:51:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc2929ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c196140 con 0x7fc28c1004b0 2023-07-21T22:51:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc2929ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c196300 con 0x7fc28c105b10 2023-07-21T22:51:56.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc28bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c0ffb00 0x7fc28c19bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc28bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c0ffb00 0x7fc28c19bb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42976/0 (socket says 172.21.15.151:42976) 2023-07-21T22:51:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc28bfff700 1 -- 172.21.15.151:0/4060982805 learned_addr learned my addr 172.21.15.151:0/4060982805 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc28bfff700 1 -- 172.21.15.151:0/4060982805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c105b10 msgr2=0x7fc28c195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc28bfff700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c105b10 0x7fc28c195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc28bfff700 1 -- 172.21.15.151:0/4060982805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc28c1004b0 msgr2=0x7fc28c19c040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc28bfff700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc28c1004b0 0x7fc28c19c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.525+0000 7fc28bfff700 1 -- 172.21.15.151:0/4060982805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc27c0095f0 con 0x7fc28c0ffb00 2023-07-21T22:51:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.526+0000 7fc28bfff700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c0ffb00 0x7fc28c19bb00 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc27c005740 tx=0x7fc27c005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.526+0000 7fc2897fa700 1 -- 172.21.15.151:0/4060982805 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c01d070 con 0x7fc28c0ffb00 2023-07-21T22:51:56.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.526+0000 7fc2929ff700 1 -- 172.21.15.151:0/4060982805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c196580 con 0x7fc28c0ffb00 2023-07-21T22:51:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.526+0000 7fc2897fa700 1 -- 172.21.15.151:0/4060982805 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc27c00fbb0 con 0x7fc28c0ffb00 2023-07-21T22:51:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.526+0000 7fc2897fa700 1 -- 172.21.15.151:0/4060982805 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c0173f0 con 0x7fc28c0ffb00 2023-07-21T22:51:56.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.526+0000 7fc2929ff700 1 -- 172.21.15.151:0/4060982805 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c1a2af0 con 0x7fc28c0ffb00 2023-07-21T22:51:56.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.530+0000 7fc2897fa700 1 -- 172.21.15.151:0/4060982805 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fc27c00fd20 con 0x7fc28c0ffb00 2023-07-21T22:51:56.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2a63ceb80 1 Processor -- start 2023-07-21T22:51:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2a63ceb80 1 -- start start 2023-07-21T22:51:56.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2897fa700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc2740a12c0 0x7fc2740a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b440e6b0 0x5630b45bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2897fa700 1 -- 172.21.15.151:0/4060982805 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc27c0ce0a0 con 0x7fc28c0ffb00 2023-07-21T22:51:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b45bc620 0x5630b45b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45b68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b44b7c50 con 0x5630b45bca70 2023-07-21T22:51:56.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b450a9e0 con 0x5630b440e6b0 2023-07-21T22:51:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.532+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b4503e70 con 0x5630b45bc620 2023-07-21T22:51:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc290f9c700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc2740a12c0 0x7fc2740a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc290f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45b68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc290f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45b68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42988/0 (socket says 172.21.15.151:42988) 2023-07-21T22:51:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc290f9c700 1 -- 172.21.15.151:0/830625992 learned_addr learned my addr 172.21.15.151:0/830625992 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:56.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc28b7fe700 1 --2- 172.21.15.151:0/830625992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b45bc620 0x5630b45b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc28bfff700 1 --2- 172.21.15.151:0/830625992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b440e6b0 0x5630b45bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc28b7fe700 1 -- 172.21.15.151:0/830625992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b440e6b0 msgr2=0x5630b45bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc28b7fe700 1 --2- 172.21.15.151:0/830625992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b440e6b0 0x5630b45bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc28b7fe700 1 -- 172.21.15.151:0/830625992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 msgr2=0x5630b45b68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc28b7fe700 1 --2- 172.21.15.151:0/830625992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45b68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.533+0000 7fc28b7fe700 1 -- 172.21.15.151:0/830625992 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630b4331d80 con 0x5630b45bc620 2023-07-21T22:51:56.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.534+0000 7fc290f9c700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc2740a12c0 0x7fc2740a3770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc284012c20 tx=0x7fc2840121e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.534+0000 7fc28b7fe700 1 --2- 172.21.15.151:0/830625992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b45bc620 0x5630b45b6350 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc280009ba0 tx=0x7fc280009eb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ac3a62e5a9938a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.534+0000 7fc2727fc700 1 -- 172.21.15.151:0/830625992 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280004230 con 0x5630b45bc620 2023-07-21T22:51:56.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.534+0000 7fc2727fc700 1 -- 172.21.15.151:0/830625992 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc28000ed10 con 0x5630b45bc620 2023-07-21T22:51:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.534+0000 7fc2727fc700 1 -- 172.21.15.151:0/830625992 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280004dc0 con 0x5630b45bc620 2023-07-21T22:51:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.535+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/830625992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b45bc620 msgr2=0x5630b45b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.535+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/830625992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b45bc620 0x5630b45b6350 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fc280009ba0 tx=0x7fc280009eb0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.535+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/830625992 shutdown_connections 2023-07-21T22:51:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.535+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/830625992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b440e6b0 0x5630b45bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.535+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/830625992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45b68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.535+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/830625992 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b45bc620 0x5630b45b6350 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.535+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/830625992 >> 172.21.15.151:0/830625992 conn(0x5630b45a7ae0 msgr2=0x5630b45ad0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.535+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/830625992 shutdown_connections 2023-07-21T22:51:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.535+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/830625992 wait complete. 2023-07-21T22:51:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.536+0000 7fc2a63ceb80 1 -- start start 2023-07-21T22:51:56.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.536+0000 7fc2a63ceb80 1 Processor -- start 2023-07-21T22:51:56.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 0x5630b45bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c0250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b44a3a60 con 0x5630b45bca70 2023-07-21T22:51:56.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b44a3760 con 0x5630b45bc620 2023-07-21T22:51:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b43878c0 con 0x5630b440e6b0 2023-07-21T22:51:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc2a63ceb80 10 client.0 _ll_register_callbacks cb 0x5630b44a1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc290f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc290f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c0250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42990/0 (socket says 172.21.15.151:42990) 2023-07-21T22:51:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc290f9c700 1 -- 172.21.15.151:0/1616359124 learned_addr learned my addr 172.21.15.151:0/1616359124 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:56.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc28bfff700 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.537+0000 7fc28b7fe700 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 0x5630b45bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc290f9c700 1 -- 172.21.15.151:0/1616359124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 msgr2=0x5630b45c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc290f9c700 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc290f9c700 1 -- 172.21.15.151:0/1616359124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 msgr2=0x5630b45bfbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc290f9c700 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 0x5630b45bfbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc290f9c700 1 -- 172.21.15.151:0/1616359124 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc280009880 con 0x5630b45bca70 2023-07-21T22:51:56.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc290f9c700 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c0250 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc284009300 tx=0x7fc284009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c12c5aa70938ffe9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc26b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc26b7fe700 1 -- 172.21.15.151:0/1616359124 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284009d70 con 0x5630b45bca70 2023-07-21T22:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/1616359124 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5630b445d490 con 0x5630b45bca70 2023-07-21T22:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc26b7fe700 1 -- 172.21.15.151:0/1616359124 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc284016d70 con 0x5630b45bca70 2023-07-21T22:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc26b7fe700 1 -- 172.21.15.151:0/1616359124 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc284004030 con 0x5630b45bca70 2023-07-21T22:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc2a63ceb80 10 client.18951 fetch_fsmap learned FSMap version 98 2023-07-21T22:51:56.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.538+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/1616359124 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x5630b431ac00 con 0x5630b45bca70 2023-07-21T22:51:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.539+0000 7fc26b7fe700 1 -- 172.21.15.151:0/1616359124 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5630b445d490 con 0x5630b45bca70 2023-07-21T22:51:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.539+0000 7fc26b7fe700 1 -- 172.21.15.151:0/1616359124 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc2840075e0 con 0x5630b45bca70 2023-07-21T22:51:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.539+0000 7fc2a63ceb80 10 client.18951 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:51:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.539+0000 7fc2a63ceb80 10 client.18951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.539+0000 7fc2a63ceb80 20 client.18951 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.539+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5630b45cff10 0x5630b45d2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.539+0000 7fc2a63ceb80 4 client.18951 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:51:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.539+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/1616359124 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5630b44fce50 con 0x5630b45cff10 2023-07-21T22:51:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.540+0000 7fc28bfff700 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5630b45cff10 0x5630b45d2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.540+0000 7fc28bfff700 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5630b45cff10 0x5630b45d2320 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a945d6cf2b1ebfa8 server_cookie=14c9305af5e6e247 in_seq=0 out_seq=0 2023-07-21T22:51:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.540+0000 7fc26b7fe700 10 client.18951 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc26b7fe700 1 -- 172.21.15.151:0/1616359124 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5630b44fce50 con 0x5630b45cff10 2023-07-21T22:51:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc26b7fe700 10 client.18951 handle_command_reply: tid=0 2023-07-21T22:51:56.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 client.18951 shutdown 2023-07-21T22:51:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/1616359124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 msgr2=0x5630b45c0250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c0250 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc284009300 tx=0x7fc284009620 comp rx=0 tx=0).stop 2023-07-21T22:51:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/1616359124 shutdown_connections 2023-07-21T22:51:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5630b45cff10 0x5630b45d2320 crc :-1 s=READY pgs=391 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c0250 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/1616359124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 0x5630b45bfbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/1616359124 >> 172.21.15.151:0/1616359124 conn(0x5630b45a7ae0 msgr2=0x5630b45ac3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc26b7fe700 0 client.18951 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/1616359124 shutdown_connections 2023-07-21T22:51:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.541+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/1616359124 wait complete. 2023-07-21T22:51:56.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.542+0000 7fc2a63ceb80 20 client.18951 trim_cache size 0 max 16384 2023-07-21T22:51:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.557+0000 7fc2a63ceb80 1 Processor -- start 2023-07-21T22:51:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc2a63ceb80 1 -- start start 2023-07-21T22:51:56.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45bd6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bc620 0x5630b45c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bca70 0x5630b45b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b45b7360 con 0x5630b45bc620 2023-07-21T22:51:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b45b7140 con 0x5630b45bca70 2023-07-21T22:51:56.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b45c0850 con 0x5630b440e6b0 2023-07-21T22:51:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc28b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bc620 0x5630b45c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc28b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bc620 0x5630b45c6f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43006/0 (socket says 172.21.15.151:43006) 2023-07-21T22:51:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.558+0000 7fc28b7fe700 1 -- 172.21.15.151:0/347228824 learned_addr learned my addr 172.21.15.151:0/347228824 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc290f9c700 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bca70 0x5630b45b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc28bfff700 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45bd6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc28b7fe700 1 -- 172.21.15.151:0/347228824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 msgr2=0x5630b45bd6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc28b7fe700 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45bd6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc28b7fe700 1 -- 172.21.15.151:0/347228824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bca70 msgr2=0x5630b45b5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc28b7fe700 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bca70 0x5630b45b5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc28b7fe700 1 -- 172.21.15.151:0/347228824 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5630b43581f0 con 0x5630b45bc620 2023-07-21T22:51:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc28bfff700 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:51:56.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc28b7fe700 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bc620 0x5630b45c6f60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc280009850 tx=0x7fc280005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b568cac61010b681 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc272ffd700 1 -- 172.21.15.151:0/347228824 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc280027070 con 0x5630b45bc620 2023-07-21T22:51:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc272ffd700 1 -- 172.21.15.151:0/347228824 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc280004830 con 0x5630b45bc620 2023-07-21T22:51:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.559+0000 7fc272ffd700 1 -- 172.21.15.151:0/347228824 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc28001f040 con 0x5630b45bc620 2023-07-21T22:51:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.560+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/347228824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bc620 msgr2=0x5630b45c6f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.560+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bc620 0x5630b45c6f60 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fc280009850 tx=0x7fc280005e20 comp rx=0 tx=0).stop 2023-07-21T22:51:56.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.560+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/347228824 shutdown_connections 2023-07-21T22:51:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.560+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bca70 0x5630b45b5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.560+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45bd6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.560+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/347228824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bc620 0x5630b45c6f60 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.560+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/347228824 >> 172.21.15.151:0/347228824 conn(0x5630b45a7ae0 msgr2=0x5630b45b5340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.560+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/347228824 shutdown_connections 2023-07-21T22:51:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.560+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/347228824 wait complete. 2023-07-21T22:51:56.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.561+0000 7fc2a63ceb80 1 -- start start 2023-07-21T22:51:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.561+0000 7fc2a63ceb80 1 Processor -- start 2023-07-21T22:51:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.561+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.561+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 0x5630b45c6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc2a63ceb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b45c5500 con 0x5630b45bca70 2023-07-21T22:51:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b45c5670 con 0x5630b45bc620 2023-07-21T22:51:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc2a63ceb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5630b45c5830 con 0x5630b440e6b0 2023-07-21T22:51:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc2a63ceb80 10 client.0 _ll_register_callbacks cb 0x7fc28401e040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:51:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc290f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc290f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43018/0 (socket says 172.21.15.151:43018) 2023-07-21T22:51:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc290f9c700 1 -- 172.21.15.151:0/358858527 learned_addr learned my addr 172.21.15.151:0/358858527 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:51:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc28b7fe700 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 0x5630b45c6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc28bfff700 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc290f9c700 1 -- 172.21.15.151:0/358858527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 msgr2=0x5630b45c68f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:56.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc290f9c700 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45c68f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc290f9c700 1 -- 172.21.15.151:0/358858527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 msgr2=0x5630b45c6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:51:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc290f9c700 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 0x5630b45c6e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.562+0000 7fc290f9c700 1 -- 172.21.15.151:0/358858527 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5630b4331d80 con 0x5630b45bca70 2023-07-21T22:51:56.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.563+0000 7fc290f9c700 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c4f40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc284009930 tx=0x7fc28401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e03177fc1eb65af2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:51:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.563+0000 7fc26b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:51:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.563+0000 7fc26b7fe700 1 -- 172.21.15.151:0/358858527 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc284009cf0 con 0x5630b45bca70 2023-07-21T22:51:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.563+0000 7fc26b7fe700 1 -- 172.21.15.151:0/358858527 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(142..142 src has 1..142) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fc284007c30 con 0x5630b45bca70 2023-07-21T22:51:56.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.563+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/358858527 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc28000ed10 con 0x5630b45bca70 2023-07-21T22:51:56.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.563+0000 7fc26b7fe700 1 -- 172.21.15.151:0/358858527 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc284007500 con 0x5630b45bca70 2023-07-21T22:51:56.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.563+0000 7fc2a63ceb80 10 client.18957 fetch_fsmap learned FSMap version 98 2023-07-21T22:51:56.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.563+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/358858527 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x5630b4330250 con 0x5630b45bca70 2023-07-21T22:51:56.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.563+0000 7fc26b7fe700 1 -- 172.21.15.151:0/358858527 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc28000ed10 con 0x5630b45bca70 2023-07-21T22:51:56.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.564+0000 7fc26b7fe700 1 -- 172.21.15.151:0/358858527 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fc284035070 con 0x5630b45bca70 2023-07-21T22:51:56.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.564+0000 7fc2a63ceb80 10 client.18957 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:51:56.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.564+0000 7fc2a63ceb80 10 client.18957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:51:56.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.564+0000 7fc2a63ceb80 20 client.18957 populate_metadata read hostname 'smithi151' 2023-07-21T22:51:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.564+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5630b4624f60 0x5630b4627370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:51:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.564+0000 7fc2a63ceb80 4 client.18957 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:51:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.564+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/358858527 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5630b44beff0 con 0x5630b4624f60 2023-07-21T22:51:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.564+0000 7fc28bfff700 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5630b4624f60 0x5630b4627370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:51:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.565+0000 7fc28bfff700 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5630b4624f60 0x5630b4627370 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f981da6892506dc6 server_cookie=7c24af85286dd4ad in_seq=0 out_seq=0 2023-07-21T22:51:56.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.565+0000 7fc26b7fe700 10 client.18957 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc26b7fe700 1 -- 172.21.15.151:0/358858527 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5630b44beff0 con 0x5630b4624f60 2023-07-21T22:51:56.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc26b7fe700 10 client.18957 handle_command_reply: tid=0 2023-07-21T22:51:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc2a63ceb80 1 client.18957 shutdown 2023-07-21T22:51:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/358858527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 msgr2=0x5630b45c4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c4f40 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fc284009930 tx=0x7fc28401c000 comp rx=0 tx=0).stop 2023-07-21T22:51:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/358858527 shutdown_connections 2023-07-21T22:51:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5630b4624f60 0x5630b4627370 crc :-1 s=READY pgs=392 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5630b45bca70 0x5630b45c4f40 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5630b440e6b0 0x5630b45c68f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc26b7fe700 0 client.18957 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:51:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc2a63ceb80 1 --2- 172.21.15.151:0/358858527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5630b45bc620 0x5630b45c6e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.577+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/358858527 >> 172.21.15.151:0/358858527 conn(0x5630b45a7ae0 msgr2=0x5630b45bd540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.578+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/358858527 shutdown_connections 2023-07-21T22:51:56.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.578+0000 7fc2a63ceb80 1 -- 172.21.15.151:0/358858527 wait complete. 2023-07-21T22:51:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.578+0000 7fc2a63ceb80 20 client.18957 trim_cache size 0 max 16384 2023-07-21T22:51:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:51:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:51:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:51:56.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:51:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.578+0000 7fc2929ff700 1 -- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc2740a12c0 msgr2=0x7fc2740a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc2740a12c0 0x7fc2740a3770 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fc284012c20 tx=0x7fc2840121e0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 -- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c0ffb00 msgr2=0x7fc28c19bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:51:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c0ffb00 0x7fc28c19bb00 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc27c005740 tx=0x7fc27c005e80 comp rx=0 tx=0).stop 2023-07-21T22:51:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 -- 172.21.15.151:0/4060982805 shutdown_connections 2023-07-21T22:51:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc2740a12c0 0x7fc2740a3770 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc28c105b10 0x7fc28c195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc28c0ffb00 0x7fc28c19bb00 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 --2- 172.21.15.151:0/4060982805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc28c1004b0 0x7fc28c19c040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:51:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 -- 172.21.15.151:0/4060982805 >> 172.21.15.151:0/4060982805 conn(0x7fc28c0fb600 msgr2=0x7fc28c103610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:51:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 -- 172.21.15.151:0/4060982805 shutdown_connections 2023-07-21T22:51:56.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:51:56.579+0000 7fc2929ff700 1 -- 172.21.15.151:0/4060982805 wait complete. 2023-07-21T22:51:56.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:56 smithi195 ceph-mon[97365]: pgmap v1039: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 24 MiB/s wr, 83 op/s 2023-07-21T22:51:56.692 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:56 smithi151 ceph-mon[95510]: pgmap v1039: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 24 MiB/s wr, 83 op/s 2023-07-21T22:51:56.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:56 smithi187 ceph-mon[96918]: pgmap v1039: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 24 MiB/s wr, 83 op/s 2023-07-21T22:51:59.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:58 smithi187 ceph-mon[96918]: pgmap v1040: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 34 MiB/s wr, 147 op/s 2023-07-21T22:51:59.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:58 smithi195 ceph-mon[97365]: pgmap v1040: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 34 MiB/s wr, 147 op/s 2023-07-21T22:51:59.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:58 smithi151 ceph-mon[95510]: pgmap v1040: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 34 MiB/s wr, 147 op/s 2023-07-21T22:52:00.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:51:59 smithi187 ceph-mon[96918]: pgmap v1041: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 103 op/s 2023-07-21T22:52:00.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:51:59 smithi195 ceph-mon[97365]: pgmap v1041: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 103 op/s 2023-07-21T22:52:00.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:51:59 smithi151 ceph-mon[95510]: pgmap v1041: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 103 op/s 2023-07-21T22:52:03.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:02 smithi187 ceph-mon[96918]: pgmap v1042: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 103 op/s 2023-07-21T22:52:03.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:02 smithi195 ceph-mon[97365]: pgmap v1042: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 103 op/s 2023-07-21T22:52:03.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:02 smithi151 ceph-mon[95510]: pgmap v1042: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 22 MiB/s wr, 103 op/s 2023-07-21T22:52:04.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:03 smithi187 ceph-mon[96918]: pgmap v1043: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 33 MiB/s wr, 179 op/s 2023-07-21T22:52:04.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:03 smithi195 ceph-mon[97365]: pgmap v1043: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 33 MiB/s wr, 179 op/s 2023-07-21T22:52:04.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:03 smithi151 ceph-mon[95510]: pgmap v1043: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 33 MiB/s wr, 179 op/s 2023-07-21T22:52:05.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:04 smithi187 ceph-mon[96918]: osdmap e143: 12 total, 12 up, 12 in 2023-07-21T22:52:05.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:04 smithi195 ceph-mon[97365]: osdmap e143: 12 total, 12 up, 12 in 2023-07-21T22:52:05.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:04 smithi151 ceph-mon[95510]: osdmap e143: 12 total, 12 up, 12 in 2023-07-21T22:52:06.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:05 smithi187 ceph-mon[96918]: pgmap v1045: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 24 MiB/s wr, 167 op/s 2023-07-21T22:52:06.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:05 smithi195 ceph-mon[97365]: pgmap v1045: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 24 MiB/s wr, 167 op/s 2023-07-21T22:52:06.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:05 smithi151 ceph-mon[95510]: pgmap v1045: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 24 MiB/s wr, 167 op/s 2023-07-21T22:52:08.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:07 smithi187 ceph-mon[96918]: pgmap v1046: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 24 MiB/s wr, 162 op/s 2023-07-21T22:52:08.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:07 smithi195 ceph-mon[97365]: pgmap v1046: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 24 MiB/s wr, 162 op/s 2023-07-21T22:52:08.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:07 smithi151 ceph-mon[95510]: pgmap v1046: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 24 MiB/s wr, 162 op/s 2023-07-21T22:52:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.747+0000 7f25d21ff700 1 -- 172.21.15.151:0/1239729544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25cc104e00 msgr2=0x7f25cc10c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.747+0000 7f25d21ff700 1 --2- 172.21.15.151:0/1239729544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25cc104e00 0x7f25cc10c9d0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f25c400b0d0 tx=0x7f25c400b3e0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.747+0000 7f25d21ff700 1 -- 172.21.15.151:0/1239729544 shutdown_connections 2023-07-21T22:52:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.747+0000 7f25d21ff700 1 --2- 172.21.15.151:0/1239729544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25cc104e00 0x7f25cc10c9d0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.747+0000 7f25d21ff700 1 --2- 172.21.15.151:0/1239729544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc0ffdc0 0x7f25cc100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.747+0000 7f25d21ff700 1 --2- 172.21.15.151:0/1239729544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc100760 0x7f25cc104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.747+0000 7f25d21ff700 1 -- 172.21.15.151:0/1239729544 >> 172.21.15.151:0/1239729544 conn(0x7f25cc0fb650 msgr2=0x7f25cc0fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.747+0000 7f25d21ff700 1 -- 172.21.15.151:0/1239729544 shutdown_connections 2023-07-21T22:52:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.747+0000 7f25d21ff700 1 -- 172.21.15.151:0/1239729544 wait complete. 2023-07-21T22:52:09.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.748+0000 7f25d21ff700 1 Processor -- start 2023-07-21T22:52:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.748+0000 7f25d21ff700 1 -- start start 2023-07-21T22:52:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25d21ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc0ffdc0 0x7f25cc19bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25d21ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc100760 0x7f25cc19c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25d21ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25cc104e00 0x7f25cc195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25d21ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc196140 con 0x7f25cc104e00 2023-07-21T22:52:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25d21ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc1962b0 con 0x7f25cc0ffdc0 2023-07-21T22:52:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25d21ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25cc196470 con 0x7f25cc100760 2023-07-21T22:52:09.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc0ffdc0 0x7f25cc19bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc0ffdc0 0x7f25cc19bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44762/0 (socket says 172.21.15.151:44762) 2023-07-21T22:52:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2040854882 learned_addr learned my addr 172.21.15.151:0/2040854882 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25cbfff700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25cc104e00 0x7f25cc195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25caffd700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc100760 0x7f25cc19c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2040854882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc100760 msgr2=0x7f25cc19c1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc100760 0x7f25cc19c1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25cc104e00 msgr2=0x7f25cc195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25cc104e00 0x7f25cc195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2040854882 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25c4009d00 con 0x7f25cc0ffdc0 2023-07-21T22:52:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.749+0000 7f25caffd700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc100760 0x7f25cc19c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:52:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.750+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc0ffdc0 0x7f25cc19bc70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00d950 tx=0x7f25bc00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.750+0000 7f25c8ff9700 1 -- 172.21.15.151:0/2040854882 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc009940 con 0x7f25cc0ffdc0 2023-07-21T22:52:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.750+0000 7f25d21ff700 1 -- 172.21.15.151:0/2040854882 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25cc196750 con 0x7f25cc0ffdc0 2023-07-21T22:52:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.750+0000 7f25c8ff9700 1 -- 172.21.15.151:0/2040854882 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25bc010460 con 0x7f25cc0ffdc0 2023-07-21T22:52:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.750+0000 7f25c8ff9700 1 -- 172.21.15.151:0/2040854882 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc00f620 con 0x7f25cc0ffdc0 2023-07-21T22:52:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.750+0000 7f25d21ff700 1 -- 172.21.15.151:0/2040854882 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1a2c60 con 0x7f25cc0ffdc0 2023-07-21T22:52:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.754+0000 7f25c8ff9700 1 -- 172.21.15.151:0/2040854882 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f25bc0105d0 con 0x7f25cc0ffdc0 2023-07-21T22:52:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.755+0000 7f25e5b69b80 1 Processor -- start 2023-07-21T22:52:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.755+0000 7f25e5b69b80 1 -- start start 2023-07-21T22:52:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25c8ff9700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f25b40a12c0 0x7f25b40a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f92f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92f620 0x55700f929350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92fa70 0x55700f9298b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f82ac50 con 0x55700f92f620 2023-07-21T22:52:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f87d9e0 con 0x55700f7816b0 2023-07-21T22:52:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f876e70 con 0x55700f92fa70 2023-07-21T22:52:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25c8ff9700 1 -- 172.21.15.151:0/2040854882 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f25bc0ccb80 con 0x7f25cc0ffdc0 2023-07-21T22:52:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25cbfff700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f25b40a12c0 0x7f25b40a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f92f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f92f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44764/0 (socket says 172.21.15.151:44764) 2023-07-21T22:52:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2091419781 learned_addr learned my addr 172.21.15.151:0/2091419781 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25cbfff700 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92fa70 0x55700f9298b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.756+0000 7f25caffd700 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92f620 0x55700f929350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2091419781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92fa70 msgr2=0x55700f9298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92fa70 0x55700f9298b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2091419781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92f620 msgr2=0x55700f929350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92f620 0x55700f929350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2091419781 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55700f6a4d80 con 0x55700f7816b0 2023-07-21T22:52:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25caffd700 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92f620 0x55700f929350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:52:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f92f0e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0a1b60 tx=0x7f25bc0995a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3dfd332afc608e50 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25cbfff700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f25b40a12c0 0x7f25b40a3770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009610 tx=0x7f25c4009360 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25b1ffb700 1 -- 172.21.15.151:0/2091419781 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc09dc70 con 0x55700f7816b0 2023-07-21T22:52:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25b1ffb700 1 -- 172.21.15.151:0/2091419781 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25bc0a2090 con 0x55700f7816b0 2023-07-21T22:52:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.757+0000 7f25b1ffb700 1 -- 172.21.15.151:0/2091419781 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc09a100 con 0x55700f7816b0 2023-07-21T22:52:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.758+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2091419781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 msgr2=0x55700f92f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.758+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f92f0e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f25bc0a1b60 tx=0x7f25bc0995a0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.758+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2091419781 shutdown_connections 2023-07-21T22:52:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.758+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f92f0e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.758+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92fa70 0x55700f9298b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.758+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2091419781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92f620 0x55700f929350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.758+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2091419781 >> 172.21.15.151:0/2091419781 conn(0x55700f91aae0 msgr2=0x55700f9200e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.758+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2091419781 shutdown_connections 2023-07-21T22:52:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.758+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2091419781 wait complete. 2023-07-21T22:52:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.759+0000 7f25e5b69b80 1 -- start start 2023-07-21T22:52:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.759+0000 7f25e5b69b80 1 Processor -- start 2023-07-21T22:52:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.759+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f7816b0 0x55700f935990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.759+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92f620 0x55700f932c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.759+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 0x55700f933300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.759+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f816a60 con 0x55700f92fa70 2023-07-21T22:52:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.759+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f816760 con 0x55700f92f620 2023-07-21T22:52:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.759+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f6fa8c0 con 0x55700f7816b0 2023-07-21T22:52:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.759+0000 7f25e5b69b80 10 client.0 _ll_register_callbacks cb 0x55700f814700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:52:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25caffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92f620 0x55700f932c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25cbfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 0x55700f933300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25caffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92f620 0x55700f932c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44774/0 (socket says 172.21.15.151:44774) 2023-07-21T22:52:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25caffd700 1 -- 172.21.15.151:0/2530452099 learned_addr learned my addr 172.21.15.151:0/2530452099 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f7816b0 0x55700f935990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.804 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25caffd700 1 -- 172.21.15.151:0/2530452099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f7816b0 msgr2=0x55700f935990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25caffd700 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f7816b0 0x55700f935990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25caffd700 1 -- 172.21.15.151:0/2530452099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 msgr2=0x55700f933300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25caffd700 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 0x55700f933300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.805 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.760+0000 7f25caffd700 1 -- 172.21.15.151:0/2530452099 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25cc1a2c60 con 0x55700f92f620 2023-07-21T22:52:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.761+0000 7f25caffd700 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92f620 0x55700f932c80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f25c0012780 tx=0x7f25c0012a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2f4623128e62981 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.761+0000 7f25aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:52:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.761+0000 7f25aaffd700 1 -- 172.21.15.151:0/2530452099 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25c0010850 con 0x55700f92f620 2023-07-21T22:52:09.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.761+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2530452099 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55700f7d0490 con 0x55700f92f620 2023-07-21T22:52:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.761+0000 7f25aaffd700 1 -- 172.21.15.151:0/2530452099 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f25c00109b0 con 0x55700f92f620 2023-07-21T22:52:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.761+0000 7f25aaffd700 1 -- 172.21.15.151:0/2530452099 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25c0010b70 con 0x55700f92f620 2023-07-21T22:52:09.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.761+0000 7f25e5b69b80 10 client.28622 fetch_fsmap learned FSMap version 98 2023-07-21T22:52:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.761+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2530452099 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x55700f68dc00 con 0x55700f92f620 2023-07-21T22:52:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.761+0000 7f25aaffd700 1 -- 172.21.15.151:0/2530452099 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55700f7d0490 con 0x55700f92f620 2023-07-21T22:52:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.762+0000 7f25aaffd700 1 -- 172.21.15.151:0/2530452099 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f25c001cd10 con 0x55700f92f620 2023-07-21T22:52:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.762+0000 7f25e5b69b80 10 client.28622 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:52:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.762+0000 7f25e5b69b80 10 client.28622 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:52:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.762+0000 7f25e5b69b80 20 client.28622 populate_metadata read hostname 'smithi151' 2023-07-21T22:52:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.762+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55700f942fe0 0x55700f9453f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.762+0000 7f25e5b69b80 4 client.28622 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:52:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.762+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2530452099 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55700f86fe50 con 0x55700f942fe0 2023-07-21T22:52:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.762+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55700f942fe0 0x55700f9453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.763+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55700f942fe0 0x55700f9453f0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bfe2761259faba5 server_cookie=7bd0a6f00fbed89f in_seq=0 out_seq=0 2023-07-21T22:52:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.763+0000 7f25aaffd700 10 client.28622 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.763+0000 7f25aaffd700 1 -- 172.21.15.151:0/2530452099 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55700f86fe50 con 0x55700f942fe0 2023-07-21T22:52:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.763+0000 7f25aaffd700 10 client.28622 handle_command_reply: tid=0 2023-07-21T22:52:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.763+0000 7f25e5b69b80 1 client.28622 shutdown 2023-07-21T22:52:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2530452099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92f620 msgr2=0x55700f932c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92f620 0x55700f932c80 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f25c0012780 tx=0x7f25c0012a90 comp rx=0 tx=0).stop 2023-07-21T22:52:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2530452099 shutdown_connections 2023-07-21T22:52:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55700f942fe0 0x55700f9453f0 crc :-1 s=READY pgs=393 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 0x55700f933300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f7816b0 0x55700f935990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2530452099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92f620 0x55700f932c80 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25aaffd700 0 client.28622 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2530452099 >> 172.21.15.151:0/2530452099 conn(0x55700f91aae0 msgr2=0x55700f91f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2530452099 shutdown_connections 2023-07-21T22:52:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2530452099 wait complete. 2023-07-21T22:52:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.764+0000 7f25e5b69b80 20 client.28622 trim_cache size 0 max 16384 2023-07-21T22:52:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.782+0000 7f25e5b69b80 1 Processor -- start 2023-07-21T22:52:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.782+0000 7f25e5b69b80 1 -- start start 2023-07-21T22:52:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.782+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f7816b0 0x55700f91fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.782+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 0x55700f9324e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.782+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92fa70 0x55700f932a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.782+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f940610 con 0x55700f7816b0 2023-07-21T22:52:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.782+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f91cc00 con 0x55700f92fa70 2023-07-21T22:52:09.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.782+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f92a330 con 0x55700f92f620 2023-07-21T22:52:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f7816b0 0x55700f91fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f7816b0 0x55700f91fb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49918/0 (socket says 172.21.15.151:49918) 2023-07-21T22:52:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2116385098 learned_addr learned my addr 172.21.15.151:0/2116385098 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cbfff700 1 --2- 172.21.15.151:0/2116385098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92fa70 0x55700f932a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25caffd700 1 --2- 172.21.15.151:0/2116385098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 0x55700f9324e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2116385098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 msgr2=0x55700f9324e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2116385098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 0x55700f9324e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2116385098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92fa70 msgr2=0x55700f932a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2116385098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92fa70 0x55700f932a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cb7fe700 1 -- 172.21.15.151:0/2116385098 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55700f949fe0 con 0x55700f7816b0 2023-07-21T22:52:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.783+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/2116385098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f7816b0 0x55700f91fb60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00b2f0 tx=0x7f25bc0ca2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e93067d32d390cc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.784+0000 7f25b27fc700 1 -- 172.21.15.151:0/2116385098 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc097fe0 con 0x55700f7816b0 2023-07-21T22:52:09.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.784+0000 7f25b27fc700 1 -- 172.21.15.151:0/2116385098 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25bc0b2220 con 0x55700f7816b0 2023-07-21T22:52:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.784+0000 7f25b27fc700 1 -- 172.21.15.151:0/2116385098 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc099ea0 con 0x55700f7816b0 2023-07-21T22:52:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2116385098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f7816b0 msgr2=0x55700f91fb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2116385098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f7816b0 0x55700f91fb60 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00b2f0 tx=0x7f25bc0ca2e0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2116385098 shutdown_connections 2023-07-21T22:52:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2116385098 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f92fa70 0x55700f932a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2116385098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f7816b0 0x55700f91fb60 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/2116385098 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 0x55700f9324e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2116385098 >> 172.21.15.151:0/2116385098 conn(0x55700f91aae0 msgr2=0x55700f92ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2116385098 shutdown_connections 2023-07-21T22:52:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 -- 172.21.15.151:0/2116385098 wait complete. 2023-07-21T22:52:09.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 -- start start 2023-07-21T22:52:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.785+0000 7f25e5b69b80 1 Processor -- start 2023-07-21T22:52:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f939d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 0x55700f938060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25e5b69b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 0x55700f9385a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f938ae0 con 0x55700f92fa70 2023-07-21T22:52:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f938c50 con 0x55700f7816b0 2023-07-21T22:52:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25e5b69b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55700f938e10 con 0x55700f92f620 2023-07-21T22:52:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25e5b69b80 10 client.0 _ll_register_callbacks cb 0x7f25c0009bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:52:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f939d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25cb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f939d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44780/0 (socket says 172.21.15.151:44780) 2023-07-21T22:52:09.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25cb7fe700 1 -- 172.21.15.151:0/3379752111 learned_addr learned my addr 172.21.15.151:0/3379752111 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.786+0000 7f25cbfff700 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 0x55700f9385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25caffd700 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 0x55700f938060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25cb7fe700 1 -- 172.21.15.151:0/3379752111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 msgr2=0x55700f938060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 0x55700f938060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25cb7fe700 1 -- 172.21.15.151:0/3379752111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 msgr2=0x55700f9385a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 0x55700f9385a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25cb7fe700 1 -- 172.21.15.151:0/3379752111 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55700f6a4d80 con 0x55700f7816b0 2023-07-21T22:52:09.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25cb7fe700 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f939d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f25bc099940 tx=0x7f25bc0995a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4798bbe95a4fdc63 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25aaffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:52:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25aaffd700 1 -- 172.21.15.151:0/3379752111 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25bc09a0a0 con 0x55700f7816b0 2023-07-21T22:52:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25aaffd700 1 -- 172.21.15.151:0/3379752111 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(143..143 src has 1..143) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f25bc099340 con 0x55700f7816b0 2023-07-21T22:52:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.787+0000 7f25e5b69b80 1 -- 172.21.15.151:0/3379752111 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f25bc0a2090 con 0x55700f7816b0 2023-07-21T22:52:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25aaffd700 1 -- 172.21.15.151:0/3379752111 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f25bc097e40 con 0x55700f7816b0 2023-07-21T22:52:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25e5b69b80 10 client.28628 fetch_fsmap learned FSMap version 98 2023-07-21T22:52:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25e5b69b80 1 -- 172.21.15.151:0/3379752111 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x55700f6cb1f0 con 0x55700f7816b0 2023-07-21T22:52:09.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25aaffd700 1 -- 172.21.15.151:0/3379752111 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f25bc065080 con 0x55700f7816b0 2023-07-21T22:52:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25aaffd700 1 -- 172.21.15.151:0/3379752111 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f25bc098ba0 con 0x55700f7816b0 2023-07-21T22:52:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25e5b69b80 10 client.28628 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:52:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25e5b69b80 10 client.28628 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:52:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25e5b69b80 20 client.28628 populate_metadata read hostname 'smithi151' 2023-07-21T22:52:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55700f997d10 0x55700f99a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25e5b69b80 4 client.28628 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:52:09.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25e5b69b80 1 -- 172.21.15.151:0/3379752111 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55700f831ff0 con 0x55700f997d10 2023-07-21T22:52:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.788+0000 7f25caffd700 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55700f997d10 0x55700f99a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.789+0000 7f25caffd700 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55700f997d10 0x55700f99a0f0 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e77a0ad85cd76a02 server_cookie=88f01a4172d97371 in_seq=0 out_seq=0 2023-07-21T22:52:09.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.789+0000 7f25aaffd700 10 client.28628 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.801+0000 7f25aaffd700 1 -- 172.21.15.151:0/3379752111 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55700f831ff0 con 0x55700f997d10 2023-07-21T22:52:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.801+0000 7f25aaffd700 10 client.28628 handle_command_reply: tid=0 2023-07-21T22:52:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.801+0000 7f25e5b69b80 1 client.28628 shutdown 2023-07-21T22:52:09.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 -- 172.21.15.151:0/3379752111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 msgr2=0x55700f939d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:09.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f939d70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f25bc099940 tx=0x7f25bc0995a0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 -- 172.21.15.151:0/3379752111 shutdown_connections 2023-07-21T22:52:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55700f997d10 0x55700f99a0f0 crc :-1 s=READY pgs=394 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55700f7816b0 0x55700f939d70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55700f92fa70 0x55700f9385a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 --2- 172.21.15.151:0/3379752111 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55700f92f620 0x55700f938060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 -- 172.21.15.151:0/3379752111 >> 172.21.15.151:0/3379752111 conn(0x55700f91aae0 msgr2=0x55700f934520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25aaffd700 0 client.28628 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 -- 172.21.15.151:0/3379752111 shutdown_connections 2023-07-21T22:52:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 1 -- 172.21.15.151:0/3379752111 wait complete. 2023-07-21T22:52:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.802+0000 7f25e5b69b80 20 client.28628 trim_cache size 0 max 16384 2023-07-21T22:52:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:52:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:52:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:52:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:52:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 -- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f25b40a12c0 msgr2=0x7f25b40a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f25b40a12c0 0x7f25b40a3770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f25c4009610 tx=0x7f25c4009360 comp rx=0 tx=0).stop 2023-07-21T22:52:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 -- 172.21.15.151:0/2040854882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc0ffdc0 msgr2=0x7f25cc19bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc0ffdc0 0x7f25cc19bc70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00d950 tx=0x7f25bc00dc60 comp rx=0 tx=0).stop 2023-07-21T22:52:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 -- 172.21.15.151:0/2040854882 shutdown_connections 2023-07-21T22:52:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f25b40a12c0 0x7f25b40a3770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f25cc0ffdc0 0x7f25cc19bc70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f25cc104e00 0x7f25cc195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 --2- 172.21.15.151:0/2040854882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f25cc100760 0x7f25cc19c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 -- 172.21.15.151:0/2040854882 >> 172.21.15.151:0/2040854882 conn(0x7f25cc0fb650 msgr2=0x7f25cc0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 -- 172.21.15.151:0/2040854882 shutdown_connections 2023-07-21T22:52:09.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:09.803+0000 7f25d21ff700 1 -- 172.21.15.151:0/2040854882 wait complete. 2023-07-21T22:52:10.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:10 smithi195 ceph-mon[97365]: pgmap v1047: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 24 MiB/s wr, 162 op/s 2023-07-21T22:52:10.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:10 smithi151 ceph-mon[95510]: pgmap v1047: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 24 MiB/s wr, 162 op/s 2023-07-21T22:52:10.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:10 smithi187 ceph-mon[96918]: pgmap v1047: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 24 MiB/s wr, 162 op/s 2023-07-21T22:52:12.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:12 smithi195 ceph-mon[97365]: pgmap v1048: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 24 MiB/s wr, 162 op/s 2023-07-21T22:52:12.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:12 smithi195 ceph-mon[97365]: osdmap e144: 12 total, 12 up, 12 in 2023-07-21T22:52:12.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:12 smithi151 ceph-mon[95510]: pgmap v1048: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 24 MiB/s wr, 162 op/s 2023-07-21T22:52:12.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:12 smithi151 ceph-mon[95510]: osdmap e144: 12 total, 12 up, 12 in 2023-07-21T22:52:12.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:12 smithi187 ceph-mon[96918]: pgmap v1048: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 24 MiB/s wr, 162 op/s 2023-07-21T22:52:12.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:12 smithi187 ceph-mon[96918]: osdmap e144: 12 total, 12 up, 12 in 2023-07-21T22:52:14.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:14 smithi151 ceph-mon[95510]: pgmap v1050: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 26 MiB/s wr, 137 op/s 2023-07-21T22:52:14.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:14 smithi187 ceph-mon[96918]: pgmap v1050: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 26 MiB/s wr, 137 op/s 2023-07-21T22:52:14.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:14 smithi195 ceph-mon[97365]: pgmap v1050: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 26 MiB/s wr, 137 op/s 2023-07-21T22:52:16.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:16 smithi151 ceph-mon[95510]: pgmap v1051: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 25 MiB/s wr, 132 op/s 2023-07-21T22:52:16.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:16 smithi187 ceph-mon[96918]: pgmap v1051: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 25 MiB/s wr, 132 op/s 2023-07-21T22:52:16.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:16 smithi195 ceph-mon[97365]: pgmap v1051: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 25 MiB/s wr, 132 op/s 2023-07-21T22:52:18.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:17 smithi187 ceph-mon[96918]: pgmap v1052: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 29 MiB/s wr, 99 op/s 2023-07-21T22:52:18.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:17 smithi195 ceph-mon[97365]: pgmap v1052: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 29 MiB/s wr, 99 op/s 2023-07-21T22:52:18.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:17 smithi151 ceph-mon[95510]: pgmap v1052: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 29 MiB/s wr, 99 op/s 2023-07-21T22:52:20.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:20 smithi195 ceph-mon[97365]: pgmap v1053: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 29 MiB/s wr, 99 op/s 2023-07-21T22:52:20.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:20 smithi151 ceph-mon[95510]: pgmap v1053: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 29 MiB/s wr, 99 op/s 2023-07-21T22:52:20.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:20 smithi187 ceph-mon[96918]: pgmap v1053: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 29 MiB/s wr, 99 op/s 2023-07-21T22:52:22.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:22 smithi151 ceph-mon[95510]: pgmap v1054: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 29 MiB/s wr, 99 op/s 2023-07-21T22:52:22.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:22 smithi187 ceph-mon[96918]: pgmap v1054: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 29 MiB/s wr, 99 op/s 2023-07-21T22:52:22.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:22 smithi195 ceph-mon[97365]: pgmap v1054: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 29 MiB/s wr, 99 op/s 2023-07-21T22:52:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.962+0000 7fbde4dff700 1 -- 172.21.15.151:0/2580123481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbde0072830 msgr2=0x7fbde0072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:22.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.962+0000 7fbde4dff700 1 --2- 172.21.15.151:0/2580123481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbde0072830 0x7fbde0072c00 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0009990 tx=0x7fbdd0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:52:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.962+0000 7fbde4dff700 1 -- 172.21.15.151:0/2580123481 shutdown_connections 2023-07-21T22:52:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.962+0000 7fbde4dff700 1 --2- 172.21.15.151:0/2580123481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde010c3f0 0x7fbde010e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.962+0000 7fbde4dff700 1 --2- 172.21.15.151:0/2580123481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbde0072830 0x7fbde0072c00 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.962+0000 7fbde4dff700 1 --2- 172.21.15.151:0/2580123481 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbde0073140 0x7fbde010beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.962+0000 7fbde4dff700 1 -- 172.21.15.151:0/2580123481 >> 172.21.15.151:0/2580123481 conn(0x7fbde00fb650 msgr2=0x7fbde00fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:22.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.962+0000 7fbde4dff700 1 -- 172.21.15.151:0/2580123481 shutdown_connections 2023-07-21T22:52:23.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.962+0000 7fbde4dff700 1 -- 172.21.15.151:0/2580123481 wait complete. 2023-07-21T22:52:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.964+0000 7fbde4dff700 1 Processor -- start 2023-07-21T22:52:23.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.964+0000 7fbde4dff700 1 -- start start 2023-07-21T22:52:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.964+0000 7fbde4dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbde0072830 0x7fbde0197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.964+0000 7fbde4dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0073140 0x7fbde01982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.964+0000 7fbde4dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbde010c3f0 0x7fbde019c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.964+0000 7fbde4dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde019cf60 con 0x7fbde0072830 2023-07-21T22:52:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.964+0000 7fbde4dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde019d0d0 con 0x7fbde0073140 2023-07-21T22:52:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.964+0000 7fbde4dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbde019d290 con 0x7fbde010c3f0 2023-07-21T22:52:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdde59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbde0072830 0x7fbde0197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdddd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0073140 0x7fbde01982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdddd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0073140 0x7fbde01982b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36168/0 (socket says 172.21.15.151:36168) 2023-07-21T22:52:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdddd9b700 1 -- 172.21.15.151:0/3342209924 learned_addr learned my addr 172.21.15.151:0/3342209924 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdded9d700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbde010c3f0 0x7fbde019c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdddd9b700 1 -- 172.21.15.151:0/3342209924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbde010c3f0 msgr2=0x7fbde019c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbde010c3f0 0x7fbde019c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdddd9b700 1 -- 172.21.15.151:0/3342209924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbde0072830 msgr2=0x7fbde0197d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:23.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbde0072830 0x7fbde0197d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdddd9b700 1 -- 172.21.15.151:0/3342209924 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdd00095f0 con 0x7fbde0073140 2023-07-21T22:52:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.965+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0073140 0x7fbde01982b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400e9a0 tx=0x7fbdd400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.966+0000 7fbdcf7fe700 1 -- 172.21.15.151:0/3342209924 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd4009790 con 0x7fbde0073140 2023-07-21T22:52:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.966+0000 7fbdcf7fe700 1 -- 172.21.15.151:0/3342209924 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbdd4010430 con 0x7fbde0073140 2023-07-21T22:52:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.966+0000 7fbde4dff700 1 -- 172.21.15.151:0/3342209924 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbde019d570 con 0x7fbde0073140 2023-07-21T22:52:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.966+0000 7fbdcf7fe700 1 -- 172.21.15.151:0/3342209924 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd400cea0 con 0x7fbde0073140 2023-07-21T22:52:23.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.966+0000 7fbde4dff700 1 -- 172.21.15.151:0/3342209924 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde01a4db0 con 0x7fbde0073140 2023-07-21T22:52:23.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.970+0000 7fbdcf7fe700 1 -- 172.21.15.151:0/3342209924 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fbdd40105a0 con 0x7fbde0073140 2023-07-21T22:52:23.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdf8754b80 1 Processor -- start 2023-07-21T22:52:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdf8754b80 1 -- start start 2023-07-21T22:52:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdcf7fe700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbdc80a1340 0x7fbdc80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdcf7fe700 1 -- 172.21.15.151:0/3342209924 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbdd4014070 con 0x7fbde0073140 2023-07-21T22:52:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8dbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8d5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8dc660 0x5555fa8d64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa7dbc50 con 0x5555fa7326b0 2023-07-21T22:52:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa82e9e0 con 0x5555fa8dc660 2023-07-21T22:52:23.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa827e70 con 0x5555fa8dc210 2023-07-21T22:52:23.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.972+0000 7fbdded9d700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbdc80a1340 0x7fbdc80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdddd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8d5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdded9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8dc660 0x5555fa8d64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdde59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8dbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdddd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8d5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37940/0 (socket says 172.21.15.151:37940) 2023-07-21T22:52:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdddd9b700 1 -- 172.21.15.151:0/557414445 learned_addr learned my addr 172.21.15.151:0/557414445 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdddd9b700 1 -- 172.21.15.151:0/557414445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8dc660 msgr2=0x5555fa8d64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:23.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/557414445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8dc660 0x5555fa8d64a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdddd9b700 1 -- 172.21.15.151:0/557414445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 msgr2=0x5555fa8dbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/557414445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8dbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdddd9b700 1 -- 172.21.15.151:0/557414445 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555fa655d80 con 0x5555fa8dc210 2023-07-21T22:52:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdded9d700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbdc80a1340 0x7fbdc80a37f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009ec0 tx=0x7fbdd8016450 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.973+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/557414445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8d5f40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40a1e70 tx=0x7fbdd40999d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb1f0a87797956f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdccff9700 1 -- 172.21.15.151:0/557414445 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd409df80 con 0x5555fa8dc210 2023-07-21T22:52:23.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdccff9700 1 -- 172.21.15.151:0/557414445 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbdd40a23a0 con 0x5555fa8dc210 2023-07-21T22:52:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdccff9700 1 -- 172.21.15.151:0/557414445 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40a1f10 con 0x5555fa8dc210 2023-07-21T22:52:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdf8754b80 1 -- 172.21.15.151:0/557414445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 msgr2=0x5555fa8d5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/557414445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8d5f40 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fbdd40a1e70 tx=0x7fbdd40999d0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdf8754b80 1 -- 172.21.15.151:0/557414445 shutdown_connections 2023-07-21T22:52:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/557414445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8dc660 0x5555fa8d64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/557414445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8dbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/557414445 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8d5f40 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.974+0000 7fbdf8754b80 1 -- 172.21.15.151:0/557414445 >> 172.21.15.151:0/557414445 conn(0x5555fa8cbae0 msgr2=0x5555fa8d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.975+0000 7fbdf8754b80 1 -- 172.21.15.151:0/557414445 shutdown_connections 2023-07-21T22:52:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.975+0000 7fbdf8754b80 1 -- 172.21.15.151:0/557414445 wait complete. 2023-07-21T22:52:23.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.975+0000 7fbdf8754b80 1 -- start start 2023-07-21T22:52:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.975+0000 7fbdf8754b80 1 Processor -- start 2023-07-21T22:52:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8df840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8dc660 0x5555fa8dff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa7c7a60 con 0x5555fa8dc660 2023-07-21T22:52:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa7c7760 con 0x5555fa7326b0 2023-07-21T22:52:23.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa6ab8c0 con 0x5555fa8dc210 2023-07-21T22:52:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdf8754b80 10 client.0 _ll_register_callbacks cb 0x5555fa7c5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:52:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdddd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8df840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdde59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdde59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e25c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36192/0 (socket says 172.21.15.151:36192) 2023-07-21T22:52:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdddd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8df840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37950/0 (socket says 172.21.15.151:37950) 2023-07-21T22:52:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdde59c700 1 -- 172.21.15.151:0/3242577319 learned_addr learned my addr 172.21.15.151:0/3242577319 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:23.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.976+0000 7fbdded9d700 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8dc660 0x5555fa8dff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdde59c700 1 -- 172.21.15.151:0/3242577319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 msgr2=0x5555fa8df840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdde59c700 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8df840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdde59c700 1 -- 172.21.15.151:0/3242577319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8dc660 msgr2=0x5555fa8dff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdde59c700 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8dc660 0x5555fa8dff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdde59c700 1 -- 172.21.15.151:0/3242577319 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde01a4db0 con 0x5555fa7326b0 2023-07-21T22:52:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:52:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdde59c700 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e25c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0015000 tx=0x7fbdd00057e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b81a39aca31afd0b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:23.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdc5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:52:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/3242577319 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd001d070 con 0x5555fa7326b0 2023-07-21T22:52:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/3242577319 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbdd0004500 con 0x5555fa7326b0 2023-07-21T22:52:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.977+0000 7fbdf8754b80 1 -- 172.21.15.151:0/3242577319 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5555fa781490 con 0x5555fa7326b0 2023-07-21T22:52:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/3242577319 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdd00046c0 con 0x5555fa7326b0 2023-07-21T22:52:23.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdf8754b80 10 client.28640 fetch_fsmap learned FSMap version 98 2023-07-21T22:52:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdf8754b80 1 -- 172.21.15.151:0/3242577319 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x5555fa63ec00 con 0x5555fa7326b0 2023-07-21T22:52:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/3242577319 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5555fa781490 con 0x5555fa7326b0 2023-07-21T22:52:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/3242577319 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fbdd000f810 con 0x5555fa7326b0 2023-07-21T22:52:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdf8754b80 10 client.28640 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:52:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdf8754b80 10 client.28640 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:52:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdf8754b80 20 client.28640 populate_metadata read hostname 'smithi151' 2023-07-21T22:52:23.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555fa8efb60 0x5555fa8f1f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdf8754b80 4 client.28640 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:52:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.978+0000 7fbdf8754b80 1 -- 172.21.15.151:0/3242577319 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5555fa820e50 con 0x5555fa8efb60 2023-07-21T22:52:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.979+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555fa8efb60 0x5555fa8f1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.979+0000 7fbdc5ffb700 10 client.28640 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.979+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555fa8efb60 0x5555fa8f1f70 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5a9d8a78cf9b229 server_cookie=f3f8345a888d3e0c in_seq=0 out_seq=0 2023-07-21T22:52:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/3242577319 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5555fa820e50 con 0x5555fa8efb60 2023-07-21T22:52:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdc5ffb700 10 client.28640 handle_command_reply: tid=0 2023-07-21T22:52:23.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 client.28640 shutdown 2023-07-21T22:52:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 -- 172.21.15.151:0/3242577319 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 msgr2=0x5555fa8e25c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e25c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7fbdd0015000 tx=0x7fbdd00057e0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 -- 172.21.15.151:0/3242577319 shutdown_connections 2023-07-21T22:52:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555fa8efb60 0x5555fa8f1f70 crc :-1 s=READY pgs=395 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e25c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8dc660 0x5555fa8dff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdc5ffb700 0 client.28640 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:23.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/3242577319 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8df840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 -- 172.21.15.151:0/3242577319 >> 172.21.15.151:0/3242577319 conn(0x5555fa8cbae0 msgr2=0x5555fa8d03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 -- 172.21.15.151:0/3242577319 shutdown_connections 2023-07-21T22:52:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.980+0000 7fbdf8754b80 1 -- 172.21.15.151:0/3242577319 wait complete. 2023-07-21T22:52:23.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.981+0000 7fbdf8754b80 20 client.28640 trim_cache size 0 max 16384 2023-07-21T22:52:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.999+0000 7fbdf8754b80 1 Processor -- start 2023-07-21T22:52:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.999+0000 7fbdf8754b80 1 -- start start 2023-07-21T22:52:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.999+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8cbae0 0x5555fa8dd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.999+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8d5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.999+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8dafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.999+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa8dd870 con 0x5555fa7326b0 2023-07-21T22:52:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.999+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa8cdc00 con 0x5555fa8cbae0 2023-07-21T22:52:23.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:22.999+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa8e0e50 con 0x5555fa8dc210 2023-07-21T22:52:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdddd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8d5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdde59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8cbae0 0x5555fa8dd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdded9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8dafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdddd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8d5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49166/0 (socket says 172.21.15.151:49166) 2023-07-21T22:52:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdddd9b700 1 -- 172.21.15.151:0/760405486 learned_addr learned my addr 172.21.15.151:0/760405486 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdde59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8cbae0 0x5555fa8dd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36202/0 (socket says 172.21.15.151:36202) 2023-07-21T22:52:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdddd9b700 1 -- 172.21.15.151:0/760405486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 msgr2=0x5555fa8dafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/760405486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8dafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdddd9b700 1 -- 172.21.15.151:0/760405486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8cbae0 msgr2=0x5555fa8dd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/760405486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8cbae0 0x5555fa8dd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdddd9b700 1 -- 172.21.15.151:0/760405486 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5555fa67c1f0 con 0x5555fa7326b0 2023-07-21T22:52:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdde59c700 1 --2- 172.21.15.151:0/760405486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8cbae0 0x5555fa8dd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:52:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/760405486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8d5f40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4096450 tx=0x7fbdd409a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62a15a8493f7a537 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.000+0000 7fbdcd7fa700 1 -- 172.21.15.151:0/760405486 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40b81c0 con 0x5555fa7326b0 2023-07-21T22:52:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdcd7fa700 1 -- 172.21.15.151:0/760405486 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbdd40b8320 con 0x5555fa7326b0 2023-07-21T22:52:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdcd7fa700 1 -- 172.21.15.151:0/760405486 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40a2170 con 0x5555fa7326b0 2023-07-21T22:52:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdf8754b80 1 -- 172.21.15.151:0/760405486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 msgr2=0x5555fa8d5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:23.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/760405486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8d5f40 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7fbdd4096450 tx=0x7fbdd409a0d0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdf8754b80 1 -- 172.21.15.151:0/760405486 shutdown_connections 2023-07-21T22:52:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/760405486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa8cbae0 0x5555fa8dd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/760405486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa8dafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/760405486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa7326b0 0x5555fa8d5f40 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdf8754b80 1 -- 172.21.15.151:0/760405486 >> 172.21.15.151:0/760405486 conn(0x5555fa8ec180 msgr2=0x5555fa8da8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:23.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdf8754b80 1 -- 172.21.15.151:0/760405486 shutdown_connections 2023-07-21T22:52:23.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.001+0000 7fbdf8754b80 1 -- 172.21.15.151:0/760405486 wait complete. 2023-07-21T22:52:23.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.002+0000 7fbdf8754b80 1 -- start start 2023-07-21T22:52:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.002+0000 7fbdf8754b80 1 Processor -- start 2023-07-21T22:52:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8cbae0 0x5555fa8e3890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdf8754b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa93c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa93cf10 con 0x5555fa8cbae0 2023-07-21T22:52:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa93d080 con 0x5555fa7326b0 2023-07-21T22:52:23.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdf8754b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5555fa93d240 con 0x5555fa8dc210 2023-07-21T22:52:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdf8754b80 10 client.0 _ll_register_callbacks cb 0x7fbdd0005350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:52:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdde59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdddd9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8cbae0 0x5555fa8e3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdde59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e3350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36208/0 (socket says 172.21.15.151:36208) 2023-07-21T22:52:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdde59c700 1 -- 172.21.15.151:0/2638910185 learned_addr learned my addr 172.21.15.151:0/2638910185 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.003+0000 7fbdded9d700 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa93c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdddd9b700 1 -- 172.21.15.151:0/2638910185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 msgr2=0x5555fa93c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:23.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa93c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdddd9b700 1 -- 172.21.15.151:0/2638910185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 msgr2=0x5555fa8e3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdddd9b700 1 -- 172.21.15.151:0/2638910185 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5555fa63ec00 con 0x5555fa8cbae0 2023-07-21T22:52:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdde59c700 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:52:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdddd9b700 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8cbae0 0x5555fa8e3890 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x5555fa8dfe40 tx=0x7fbdd4099b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6de843679fa32b66 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdc5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:52:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/2638910185 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdd40b81c0 con 0x5555fa8cbae0 2023-07-21T22:52:23.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdf8754b80 1 -- 172.21.15.151:0/2638910185 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fbdd40a23a0 con 0x5555fa8cbae0 2023-07-21T22:52:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/2638910185 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbdd4099650 con 0x5555fa8cbae0 2023-07-21T22:52:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/2638910185 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdd40a1f10 con 0x5555fa8cbae0 2023-07-21T22:52:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdf8754b80 10 client.18993 fetch_fsmap learned FSMap version 98 2023-07-21T22:52:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.004+0000 7fbdf8754b80 1 -- 172.21.15.151:0/2638910185 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x5555fa655d80 con 0x5555fa8cbae0 2023-07-21T22:52:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.005+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/2638910185 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbdd40a23a0 con 0x5555fa8cbae0 2023-07-21T22:52:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.005+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/2638910185 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fbdd40cad20 con 0x5555fa8cbae0 2023-07-21T22:52:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.005+0000 7fbdf8754b80 10 client.18993 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:52:23.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.005+0000 7fbdf8754b80 10 client.18993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:52:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.005+0000 7fbdf8754b80 20 client.18993 populate_metadata read hostname 'smithi151' 2023-07-21T22:52:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.005+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555fa8dc660 0x5555fa946510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.005+0000 7fbdf8754b80 4 client.18993 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:52:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.005+0000 7fbdf8754b80 1 -- 172.21.15.151:0/2638910185 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5555fa7e2ff0 con 0x5555fa8dc660 2023-07-21T22:52:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.005+0000 7fbdde59c700 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555fa8dc660 0x5555fa946510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.006+0000 7fbdde59c700 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555fa8dc660 0x5555fa946510 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b586fcd50c68dbf6 server_cookie=798d22f3dbb0bb75 in_seq=0 out_seq=0 2023-07-21T22:52:23.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.006+0000 7fbdc5ffb700 10 client.18993 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:23.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdc5ffb700 1 -- 172.21.15.151:0/2638910185 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5555fa7e2ff0 con 0x5555fa8dc660 2023-07-21T22:52:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdc5ffb700 10 client.18993 handle_command_reply: tid=0 2023-07-21T22:52:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 client.18993 shutdown 2023-07-21T22:52:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 -- 172.21.15.151:0/2638910185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8cbae0 msgr2=0x5555fa8e3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:23.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8cbae0 0x5555fa8e3890 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x5555fa8dfe40 tx=0x7fbdd4099b40 comp rx=0 tx=0).stop 2023-07-21T22:52:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 -- 172.21.15.151:0/2638910185 shutdown_connections 2023-07-21T22:52:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5555fa8dc660 0x5555fa946510 crc :-1 s=READY pgs=396 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5555fa7326b0 0x5555fa8e3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5555fa8dc210 0x5555fa93c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 --2- 172.21.15.151:0/2638910185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5555fa8cbae0 0x5555fa8e3890 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdc5ffb700 0 client.18993 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 -- 172.21.15.151:0/2638910185 >> 172.21.15.151:0/2638910185 conn(0x5555fa8ec180 msgr2=0x5555fa8db140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 -- 172.21.15.151:0/2638910185 shutdown_connections 2023-07-21T22:52:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.017+0000 7fbdf8754b80 1 -- 172.21.15.151:0/2638910185 wait complete. 2023-07-21T22:52:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbdf8754b80 20 client.18993 trim_cache size 0 max 16384 2023-07-21T22:52:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:52:23.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:52:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:52:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:52:23.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 -- 172.21.15.151:0/3342209924 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbdc80a1340 msgr2=0x7fbdc80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbdc80a1340 0x7fbdc80a37f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fbdd8009ec0 tx=0x7fbdd8016450 comp rx=0 tx=0).stop 2023-07-21T22:52:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 -- 172.21.15.151:0/3342209924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0073140 msgr2=0x7fbde01982b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0073140 0x7fbde01982b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fbdd400e9a0 tx=0x7fbdd400ecb0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 -- 172.21.15.151:0/3342209924 shutdown_connections 2023-07-21T22:52:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbdc80a1340 0x7fbdc80a37f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbde010c3f0 0x7fbde019c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbde0072830 0x7fbde0197d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 --2- 172.21.15.151:0/3342209924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbde0073140 0x7fbde01982b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.018+0000 7fbde4dff700 1 -- 172.21.15.151:0/3342209924 >> 172.21.15.151:0/3342209924 conn(0x7fbde00fb650 msgr2=0x7fbde010e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.019+0000 7fbde4dff700 1 -- 172.21.15.151:0/3342209924 shutdown_connections 2023-07-21T22:52:23.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:23.019+0000 7fbde4dff700 1 -- 172.21.15.151:0/3342209924 wait complete. 2023-07-21T22:52:24.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:24 smithi151 ceph-mon[95510]: pgmap v1055: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 38 MiB/s wr, 127 op/s 2023-07-21T22:52:24.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:24 smithi187 ceph-mon[96918]: pgmap v1055: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 38 MiB/s wr, 127 op/s 2023-07-21T22:52:24.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:24 smithi195 ceph-mon[97365]: pgmap v1055: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 38 MiB/s wr, 127 op/s 2023-07-21T22:52:26.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:26 smithi151 ceph-mon[95510]: pgmap v1056: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 26 MiB/s wr, 72 op/s 2023-07-21T22:52:26.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:26 smithi187 ceph-mon[96918]: pgmap v1056: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 26 MiB/s wr, 72 op/s 2023-07-21T22:52:26.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:26 smithi195 ceph-mon[97365]: pgmap v1056: 97 pgs: 97 active+clean; 12 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 26 MiB/s wr, 72 op/s 2023-07-21T22:52:28.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:27 smithi187 ceph-mon[96918]: pgmap v1057: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 36 MiB/s wr, 132 op/s 2023-07-21T22:52:28.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:27 smithi195 ceph-mon[97365]: pgmap v1057: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 36 MiB/s wr, 132 op/s 2023-07-21T22:52:28.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:27 smithi151 ceph-mon[95510]: pgmap v1057: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 36 MiB/s wr, 132 op/s 2023-07-21T22:52:30.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:30 smithi151 ceph-mon[95510]: pgmap v1058: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 100 op/s 2023-07-21T22:52:30.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:30 smithi187 ceph-mon[96918]: pgmap v1058: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 100 op/s 2023-07-21T22:52:30.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:30 smithi195 ceph-mon[97365]: pgmap v1058: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 100 op/s 2023-07-21T22:52:32.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:32 smithi151 ceph-mon[95510]: pgmap v1059: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 100 op/s 2023-07-21T22:52:32.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:32 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:52:32.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:32 smithi187 ceph-mon[96918]: pgmap v1059: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 100 op/s 2023-07-21T22:52:32.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:32 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:52:32.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:32 smithi195 ceph-mon[97365]: pgmap v1059: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 23 MiB/s wr, 100 op/s 2023-07-21T22:52:32.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:32 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:52:33.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:33 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:52:33.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:33 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:52:33.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:33 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:52:33.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:33 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:52:33.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:33 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:52:33.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:33 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:52:33.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:33 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:52:33.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:33 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:52:33.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:33 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:52:34.692 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:34 smithi151 ceph-mon[95510]: pgmap v1060: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 34 MiB/s wr, 165 op/s 2023-07-21T22:52:34.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:34 smithi187 ceph-mon[96918]: pgmap v1060: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 34 MiB/s wr, 165 op/s 2023-07-21T22:52:34.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:34 smithi195 ceph-mon[97365]: pgmap v1060: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 34 MiB/s wr, 165 op/s 2023-07-21T22:52:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.168+0000 7f8855fff700 1 -- 172.21.15.151:0/3318734930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88500ffb50 msgr2=0x7f88500fffc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.168+0000 7f8855fff700 1 --2- 172.21.15.151:0/3318734930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88500ffb50 0x7f88500fffc0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f8844009990 tx=0x7f8844009ca0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.168+0000 7f8855fff700 1 -- 172.21.15.151:0/3318734930 shutdown_connections 2023-07-21T22:52:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.168+0000 7f8855fff700 1 --2- 172.21.15.151:0/3318734930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850100500 0x7f885010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.168+0000 7f8855fff700 1 --2- 172.21.15.151:0/3318734930 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8850105b80 0x7f8850105f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.168+0000 7f8855fff700 1 --2- 172.21.15.151:0/3318734930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88500ffb50 0x7f88500fffc0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.168+0000 7f8855fff700 1 -- 172.21.15.151:0/3318734930 >> 172.21.15.151:0/3318734930 conn(0x7f88500fb650 msgr2=0x7f88500fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.168+0000 7f8855fff700 1 -- 172.21.15.151:0/3318734930 shutdown_connections 2023-07-21T22:52:36.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.168+0000 7f8855fff700 1 -- 172.21.15.151:0/3318734930 wait complete. 2023-07-21T22:52:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.169+0000 7f8855fff700 1 Processor -- start 2023-07-21T22:52:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.169+0000 7f8855fff700 1 -- start start 2023-07-21T22:52:36.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.169+0000 7f8855fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88500ffb50 0x7f885019dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.169+0000 7f8855fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850100500 0x7f885019e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.169+0000 7f8855fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8850105b80 0x7f8850197b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f8855fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88501981c0 con 0x7f8850105b80 2023-07-21T22:52:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f8855fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850198330 con 0x7f8850100500 2023-07-21T22:52:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f8855fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88501984f0 con 0x7f88500ffb50 2023-07-21T22:52:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8850105b80 0x7f8850197b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850100500 0x7f885019e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8850105b80 0x7f8850197b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53872/0 (socket says 172.21.15.151:53872) 2023-07-21T22:52:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850100500 0x7f885019e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57270/0 (socket says 172.21.15.151:57270) 2023-07-21T22:52:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884ffff700 1 -- 172.21.15.151:0/38050117 learned_addr learned my addr 172.21.15.151:0/38050117 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884f7fe700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88500ffb50 0x7f885019dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884ffff700 1 -- 172.21.15.151:0/38050117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88500ffb50 msgr2=0x7f885019dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884ffff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88500ffb50 0x7f885019dcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884ffff700 1 -- 172.21.15.151:0/38050117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850100500 msgr2=0x7f885019e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:36.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884ffff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850100500 0x7f885019e230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884ffff700 1 -- 172.21.15.151:0/38050117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88440095f0 con 0x7f8850105b80 2023-07-21T22:52:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.170+0000 7f884ffff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8850105b80 0x7f8850197b50 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8848007ee0 tx=0x7f884800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:36.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.171+0000 7f884cff9700 1 -- 172.21.15.151:0/38050117 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848017070 con 0x7f8850105b80 2023-07-21T22:52:36.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.171+0000 7f884cff9700 1 -- 172.21.15.151:0/38050117 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f884800f040 con 0x7f8850105b80 2023-07-21T22:52:36.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.171+0000 7f8855fff700 1 -- 172.21.15.151:0/38050117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88501987d0 con 0x7f8850105b80 2023-07-21T22:52:36.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.171+0000 7f884cff9700 1 -- 172.21.15.151:0/38050117 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848005710 con 0x7f8850105b80 2023-07-21T22:52:36.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.171+0000 7f8855fff700 1 -- 172.21.15.151:0/38050117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88501a4ce0 con 0x7f8850105b80 2023-07-21T22:52:36.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.176+0000 7f884cff9700 1 -- 172.21.15.151:0/38050117 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f8848005870 con 0x7f8850105b80 2023-07-21T22:52:36.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.176+0000 7f88699fbb80 1 Processor -- start 2023-07-21T22:52:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f88699fbb80 1 -- start start 2023-07-21T22:52:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 0x558287aa6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287aa7210 0x558287aa0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 0x558287aa14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f88699fbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582879a6c50 con 0x5582878fd6b0 2023-07-21T22:52:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f88699fbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582879f99e0 con 0x558287aa7210 2023-07-21T22:52:36.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f88699fbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582879f2e70 con 0x558287aa7660 2023-07-21T22:52:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f884cff9700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88380a1340 0x7f88380a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f884f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287aa7210 0x558287aa0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f884effd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 0x558287aa6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f884f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287aa7210 0x558287aa0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57280/0 (socket says 172.21.15.151:57280) 2023-07-21T22:52:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.177+0000 7f884f7fe700 1 -- 172.21.15.151:0/1322425441 learned_addr learned my addr 172.21.15.151:0/1322425441 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884ffff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88380a1340 0x7f88380a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884cff9700 1 -- 172.21.15.151:0/38050117 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f88480cc4e0 con 0x7f8850105b80 2023-07-21T22:52:36.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884effd700 1 --2- 172.21.15.151:0/1322425441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 0x558287aa14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884f7fe700 1 -- 172.21.15.151:0/1322425441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 msgr2=0x558287aa14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884f7fe700 1 --2- 172.21.15.151:0/1322425441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 0x558287aa14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884f7fe700 1 -- 172.21.15.151:0/1322425441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 msgr2=0x558287aa6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884f7fe700 1 --2- 172.21.15.151:0/1322425441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 0x558287aa6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884f7fe700 1 -- 172.21.15.151:0/1322425441 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558287820d80 con 0x558287aa7210 2023-07-21T22:52:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884effd700 1 --2- 172.21.15.151:0/1322425441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 0x558287aa14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:52:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884f7fe700 1 --2- 172.21.15.151:0/1322425441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287aa7210 0x558287aa0f40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8840009d10 tx=0x7f88400116c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f89897cdf500ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:36.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.178+0000 7f884ffff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88380a1340 0x7f88380a37f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8848095a70 tx=0x7f8848084040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.179+0000 7f8835ffb700 1 -- 172.21.15.151:0/1322425441 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400097e0 con 0x558287aa7210 2023-07-21T22:52:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.179+0000 7f8835ffb700 1 -- 172.21.15.151:0/1322425441 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8840009e60 con 0x558287aa7210 2023-07-21T22:52:36.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.179+0000 7f8835ffb700 1 -- 172.21.15.151:0/1322425441 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884000f770 con 0x558287aa7210 2023-07-21T22:52:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.180+0000 7f88699fbb80 1 -- 172.21.15.151:0/1322425441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287aa7210 msgr2=0x558287aa0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.180+0000 7f88699fbb80 1 --2- 172.21.15.151:0/1322425441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287aa7210 0x558287aa0f40 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f8840009d10 tx=0x7f88400116c0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.180+0000 7f88699fbb80 1 -- 172.21.15.151:0/1322425441 shutdown_connections 2023-07-21T22:52:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.180+0000 7f88699fbb80 1 --2- 172.21.15.151:0/1322425441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 0x558287aa14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.180+0000 7f88699fbb80 1 --2- 172.21.15.151:0/1322425441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 0x558287aa6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.180+0000 7f88699fbb80 1 --2- 172.21.15.151:0/1322425441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287aa7210 0x558287aa0f40 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.180+0000 7f88699fbb80 1 -- 172.21.15.151:0/1322425441 >> 172.21.15.151:0/1322425441 conn(0x558287a96ae0 msgr2=0x558287a9c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.180+0000 7f88699fbb80 1 -- 172.21.15.151:0/1322425441 shutdown_connections 2023-07-21T22:52:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.181+0000 7f88699fbb80 1 -- 172.21.15.151:0/1322425441 wait complete. 2023-07-21T22:52:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.181+0000 7f88699fbb80 1 -- start start 2023-07-21T22:52:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.182+0000 7f88699fbb80 1 Processor -- start 2023-07-21T22:52:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aaa880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558287aa7210 0x558287aaadc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 0x558287aab300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f88699fbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558287992a60 con 0x558287aa7210 2023-07-21T22:52:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f88699fbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558287992760 con 0x5582878fd6b0 2023-07-21T22:52:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f88699fbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5582878768c0 con 0x558287aa7660 2023-07-21T22:52:36.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f88699fbb80 10 client.0 _ll_register_callbacks cb 0x558287990700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:52:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f884effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aaa880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f884effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aaa880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57292/0 (socket says 172.21.15.151:57292) 2023-07-21T22:52:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f884effd700 1 -- 172.21.15.151:0/2488714375 learned_addr learned my addr 172.21.15.151:0/2488714375 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.183+0000 7f884effd700 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 0x558287aab300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.184+0000 7f884effd700 1 -- 172.21.15.151:0/2488714375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 msgr2=0x558287aab300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.184+0000 7f884effd700 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 0x558287aab300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.184+0000 7f884effd700 1 -- 172.21.15.151:0/2488714375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558287aa7210 msgr2=0x558287aaadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:36.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.184+0000 7f884effd700 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558287aa7210 0x558287aaadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.184+0000 7f884effd700 1 -- 172.21.15.151:0/2488714375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8840009940 con 0x5582878fd6b0 2023-07-21T22:52:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.185+0000 7f884effd700 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aaa880 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8844005910 tx=0x7f884401a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=611638546f40f01c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.185+0000 7f882effd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:52:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.186+0000 7f882effd700 1 -- 172.21.15.151:0/2488714375 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884401d070 con 0x5582878fd6b0 2023-07-21T22:52:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.186+0000 7f882effd700 1 -- 172.21.15.151:0/2488714375 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8844004500 con 0x5582878fd6b0 2023-07-21T22:52:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.186+0000 7f88699fbb80 1 -- 172.21.15.151:0/2488714375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55828794c490 con 0x5582878fd6b0 2023-07-21T22:52:36.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.186+0000 7f882effd700 1 -- 172.21.15.151:0/2488714375 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f88440046c0 con 0x5582878fd6b0 2023-07-21T22:52:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.186+0000 7f88699fbb80 10 client.28658 fetch_fsmap learned FSMap version 98 2023-07-21T22:52:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.186+0000 7f88699fbb80 1 -- 172.21.15.151:0/2488714375 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x558287809c00 con 0x5582878fd6b0 2023-07-21T22:52:36.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.187+0000 7f882effd700 1 -- 172.21.15.151:0/2488714375 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55828794c490 con 0x5582878fd6b0 2023-07-21T22:52:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.187+0000 7f882effd700 1 -- 172.21.15.151:0/2488714375 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f884402a830 con 0x5582878fd6b0 2023-07-21T22:52:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.187+0000 7f88699fbb80 10 client.28658 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:52:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.187+0000 7f88699fbb80 10 client.28658 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:52:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.187+0000 7f88699fbb80 20 client.28658 populate_metadata read hostname 'smithi151' 2023-07-21T22:52:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.187+0000 7f88699fbb80 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558287ac3340 0x558287ac5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.187+0000 7f88699fbb80 4 client.28658 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:52:36.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.187+0000 7f88699fbb80 1 -- 172.21.15.151:0/2488714375 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5582879ebe50 con 0x558287ac3340 2023-07-21T22:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.188+0000 7f884f7fe700 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558287ac3340 0x558287ac5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.189+0000 7f882effd700 10 client.28658 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.189+0000 7f884f7fe700 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558287ac3340 0x558287ac5750 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=765bff534a414a4a server_cookie=a62e071296ef3a7f in_seq=0 out_seq=0 2023-07-21T22:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.189+0000 7f882effd700 1 -- 172.21.15.151:0/2488714375 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5582879ebe50 con 0x558287ac3340 2023-07-21T22:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.189+0000 7f882effd700 10 client.28658 handle_command_reply: tid=0 2023-07-21T22:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 client.28658 shutdown 2023-07-21T22:52:36.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 -- 172.21.15.151:0/2488714375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 msgr2=0x558287aaa880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aaa880 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f8844005910 tx=0x7f884401a040 comp rx=0 tx=0).stop 2023-07-21T22:52:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 -- 172.21.15.151:0/2488714375 shutdown_connections 2023-07-21T22:52:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558287ac3340 0x558287ac5750 crc :-1 s=READY pgs=397 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aaa880 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287aa7660 0x558287aab300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 --2- 172.21.15.151:0/2488714375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558287aa7210 0x558287aaadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 -- 172.21.15.151:0/2488714375 >> 172.21.15.151:0/2488714375 conn(0x558287a96ae0 msgr2=0x558287a9b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f882effd700 0 client.28658 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.190+0000 7f88699fbb80 1 -- 172.21.15.151:0/2488714375 shutdown_connections 2023-07-21T22:52:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.191+0000 7f88699fbb80 1 -- 172.21.15.151:0/2488714375 wait complete. 2023-07-21T22:52:36.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.191+0000 7f88699fbb80 20 client.28658 trim_cache size 0 max 16384 2023-07-21T22:52:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.215+0000 7f88699fbb80 1 Processor -- start 2023-07-21T22:52:36.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.215+0000 7f88699fbb80 1 -- start start 2023-07-21T22:52:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.215+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287abef40 0x558287aba430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aab130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 0x558287a9bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f88699fbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558287aad910 con 0x5582878fd6b0 2023-07-21T22:52:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f88699fbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558287a9d6b0 con 0x558287abef40 2023-07-21T22:52:36.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f88699fbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558287a984f0 con 0x558287a96ae0 2023-07-21T22:52:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f884effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287abef40 0x558287aba430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f884effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287abef40 0x558287aba430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57294/0 (socket says 172.21.15.151:57294) 2023-07-21T22:52:36.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f884effd700 1 -- 172.21.15.151:0/3322871631 learned_addr learned my addr 172.21.15.151:0/3322871631 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f884f7fe700 1 --2- 172.21.15.151:0/3322871631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f884effd700 1 --2- 172.21.15.151:0/3322871631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 0x558287a9bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f884effd700 1 -- 172.21.15.151:0/3322871631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 msgr2=0x558287aab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f884effd700 1 --2- 172.21.15.151:0/3322871631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f884effd700 1 -- 172.21.15.151:0/3322871631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 msgr2=0x558287a9bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:36.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.216+0000 7f884effd700 1 --2- 172.21.15.151:0/3322871631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 0x558287a9bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.217+0000 7f884effd700 1 -- 172.21.15.151:0/3322871631 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5582878471f0 con 0x558287abef40 2023-07-21T22:52:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.217+0000 7f884effd700 1 --2- 172.21.15.151:0/3322871631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287abef40 0x558287aba430 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f884402afd0 tx=0x7f884402c040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a60745c1b6cee5ed server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.217+0000 7f88367fc700 1 -- 172.21.15.151:0/3322871631 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884401d020 con 0x558287abef40 2023-07-21T22:52:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.217+0000 7f88367fc700 1 -- 172.21.15.151:0/3322871631 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8844004500 con 0x558287abef40 2023-07-21T22:52:36.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.217+0000 7f88367fc700 1 -- 172.21.15.151:0/3322871631 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8844004ec0 con 0x558287abef40 2023-07-21T22:52:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.218+0000 7f88699fbb80 1 -- 172.21.15.151:0/3322871631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287abef40 msgr2=0x558287aba430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.218+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3322871631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287abef40 0x558287aba430 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f884402afd0 tx=0x7f884402c040 comp rx=0 tx=0).stop 2023-07-21T22:52:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.218+0000 7f88699fbb80 1 -- 172.21.15.151:0/3322871631 shutdown_connections 2023-07-21T22:52:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.218+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3322871631 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558287abef40 0x558287aba430 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.218+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3322871631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5582878fd6b0 0x558287a9bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.218+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3322871631 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.218+0000 7f88699fbb80 1 -- 172.21.15.151:0/3322871631 >> 172.21.15.151:0/3322871631 conn(0x558287aa4cf0 msgr2=0x558287aa82c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.218+0000 7f88699fbb80 1 -- 172.21.15.151:0/3322871631 shutdown_connections 2023-07-21T22:52:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.219+0000 7f88699fbb80 1 -- 172.21.15.151:0/3322871631 wait complete. 2023-07-21T22:52:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.219+0000 7f88699fbb80 1 -- start start 2023-07-21T22:52:36.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.219+0000 7f88699fbb80 1 Processor -- start 2023-07-21T22:52:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aa3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aa2730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f88699fbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558287abef40 0x558287aa2c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f88699fbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558287aa44f0 con 0x558287abef40 2023-07-21T22:52:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f88699fbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558287aa31b0 con 0x5582878fd6b0 2023-07-21T22:52:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f88699fbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558287aa3340 con 0x558287a96ae0 2023-07-21T22:52:36.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f88699fbb80 10 client.0 _ll_register_callbacks cb 0x7f884400b7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:52:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f884effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aa3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f884f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aa2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f884effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aa3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57308/0 (socket says 172.21.15.151:57308) 2023-07-21T22:52:36.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f884effd700 1 -- 172.21.15.151:0/3862114781 learned_addr learned my addr 172.21.15.151:0/3862114781 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f884f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aa2730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:53870/0 (socket says 172.21.15.151:53870) 2023-07-21T22:52:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.220+0000 7f884effd700 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558287abef40 0x558287aa2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.221+0000 7f884f7fe700 1 -- 172.21.15.151:0/3862114781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 msgr2=0x558287aa3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.221+0000 7f884f7fe700 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aa3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.221+0000 7f884f7fe700 1 -- 172.21.15.151:0/3862114781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558287abef40 msgr2=0x558287aa2c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.221+0000 7f884f7fe700 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558287abef40 0x558287aa2c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.221+0000 7f884f7fe700 1 -- 172.21.15.151:0/3862114781 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558287809c00 con 0x558287a96ae0 2023-07-21T22:52:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.221+0000 7f884f7fe700 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aa2730 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8840012c80 tx=0x7f8840005880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30fd4b6946cf7e8c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:36.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.221+0000 7f882effd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:52:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.221+0000 7f882effd700 1 -- 172.21.15.151:0/3862114781 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8840029cf0 con 0x558287a96ae0 2023-07-21T22:52:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.222+0000 7f882effd700 1 -- 172.21.15.151:0/3862114781 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f884002f070 con 0x558287a96ae0 2023-07-21T22:52:36.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.222+0000 7f88699fbb80 1 -- 172.21.15.151:0/3862114781 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8840009e60 con 0x558287a96ae0 2023-07-21T22:52:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.222+0000 7f882effd700 1 -- 172.21.15.151:0/3862114781 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=98) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8840029e50 con 0x558287a96ae0 2023-07-21T22:52:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.222+0000 7f88699fbb80 10 client.28687 fetch_fsmap learned FSMap version 98 2023-07-21T22:52:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.222+0000 7f88699fbb80 1 -- 172.21.15.151:0/3862114781 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=98,monmap=4+}) v3 -- 0x55828781f250 con 0x558287a96ae0 2023-07-21T22:52:36.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.223+0000 7f882effd700 1 -- 172.21.15.151:0/3862114781 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8840009e60 con 0x558287a96ae0 2023-07-21T22:52:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.223+0000 7f882effd700 1 -- 172.21.15.151:0/3862114781 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 98) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f88400113e0 con 0x558287a96ae0 2023-07-21T22:52:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.223+0000 7f88699fbb80 10 client.28687 fetch_fsmap finished waiting for FSMap version 98 2023-07-21T22:52:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.223+0000 7f88699fbb80 10 client.28687 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:52:36.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.223+0000 7f88699fbb80 20 client.28687 populate_metadata read hostname 'smithi151' 2023-07-21T22:52:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.223+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558287aa7210 0x558287b1a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.223+0000 7f88699fbb80 4 client.28687 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:52:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.223+0000 7f88699fbb80 1 -- 172.21.15.151:0/3862114781 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5582879adff0 con 0x558287aa7210 2023-07-21T22:52:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.223+0000 7f884effd700 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558287aa7210 0x558287b1a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.224+0000 7f884effd700 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558287aa7210 0x558287b1a3b0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8984a1c49f4cc47 server_cookie=86d9b99864ed12b in_seq=0 out_seq=0 2023-07-21T22:52:36.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.224+0000 7f882effd700 10 client.28687 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:36.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f882effd700 1 -- 172.21.15.151:0/3862114781 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5582879adff0 con 0x558287aa7210 2023-07-21T22:52:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f882effd700 10 client.28687 handle_command_reply: tid=0 2023-07-21T22:52:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f88699fbb80 1 client.28687 shutdown 2023-07-21T22:52:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f88699fbb80 1 -- 172.21.15.151:0/3862114781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 msgr2=0x558287aa2730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:36.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aa2730 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f8840012c80 tx=0x7f8840005880 comp rx=0 tx=0).stop 2023-07-21T22:52:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f88699fbb80 1 -- 172.21.15.151:0/3862114781 shutdown_connections 2023-07-21T22:52:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558287aa7210 0x558287b1a3b0 crc :-1 s=READY pgs=398 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5582878fd6b0 0x558287aa3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558287abef40 0x558287aa2c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f88699fbb80 1 --2- 172.21.15.151:0/3862114781 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558287a96ae0 0x558287aa2730 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f882effd700 0 client.28687 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.241+0000 7f88699fbb80 1 -- 172.21.15.151:0/3862114781 >> 172.21.15.151:0/3862114781 conn(0x558287aa4cf0 msgr2=0x558287aa9030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.242+0000 7f88699fbb80 1 -- 172.21.15.151:0/3862114781 shutdown_connections 2023-07-21T22:52:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.242+0000 7f88699fbb80 1 -- 172.21.15.151:0/3862114781 wait complete. 2023-07-21T22:52:36.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.242+0000 7f88699fbb80 20 client.28687 trim_cache size 0 max 16384 2023-07-21T22:52:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:52:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:52:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:52:36.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:52:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 -- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88380a1340 msgr2=0x7f88380a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88380a1340 0x7f88380a37f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f8848095a70 tx=0x7f8848084040 comp rx=0 tx=0).stop 2023-07-21T22:52:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 -- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8850105b80 msgr2=0x7f8850197b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8850105b80 0x7f8850197b50 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f8848007ee0 tx=0x7f884800d3b0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 -- 172.21.15.151:0/38050117 shutdown_connections 2023-07-21T22:52:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f88380a1340 0x7f88380a37f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8850105b80 0x7f8850197b50 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f88500ffb50 0x7f885019dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 --2- 172.21.15.151:0/38050117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850100500 0x7f885019e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 -- 172.21.15.151:0/38050117 >> 172.21.15.151:0/38050117 conn(0x7f88500fb650 msgr2=0x7f885010ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 -- 172.21.15.151:0/38050117 shutdown_connections 2023-07-21T22:52:36.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:36.243+0000 7f8855fff700 1 -- 172.21.15.151:0/38050117 wait complete. 2023-07-21T22:52:36.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:36 smithi151 ceph-mon[95510]: pgmap v1061: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 21 MiB/s wr, 125 op/s 2023-07-21T22:52:36.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:36 smithi187 ceph-mon[96918]: pgmap v1061: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 21 MiB/s wr, 125 op/s 2023-07-21T22:52:36.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:36 smithi195 ceph-mon[97365]: pgmap v1061: 97 pgs: 97 active+clean; 12 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 21 MiB/s wr, 125 op/s 2023-07-21T22:52:38.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:37 smithi187 ceph-mon[96918]: pgmap v1062: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 31 MiB/s wr, 191 op/s 2023-07-21T22:52:38.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:37 smithi195 ceph-mon[97365]: pgmap v1062: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 31 MiB/s wr, 191 op/s 2023-07-21T22:52:38.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:37 smithi151 ceph-mon[95510]: pgmap v1062: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 31 MiB/s wr, 191 op/s 2023-07-21T22:52:40.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:40 smithi151 ceph-mon[95510]: pgmap v1063: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 21 MiB/s wr, 131 op/s 2023-07-21T22:52:40.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:40 smithi187 ceph-mon[96918]: pgmap v1063: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 21 MiB/s wr, 131 op/s 2023-07-21T22:52:40.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:40 smithi195 ceph-mon[97365]: pgmap v1063: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 21 MiB/s wr, 131 op/s 2023-07-21T22:52:42.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:42 smithi151 ceph-mon[95510]: pgmap v1064: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 21 MiB/s wr, 131 op/s 2023-07-21T22:52:42.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:42 smithi187 ceph-mon[96918]: pgmap v1064: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 21 MiB/s wr, 131 op/s 2023-07-21T22:52:42.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:42 smithi195 ceph-mon[97365]: pgmap v1064: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 21 MiB/s wr, 131 op/s 2023-07-21T22:52:44.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:44 smithi151 ceph-mon[95510]: pgmap v1065: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 31 MiB/s wr, 200 op/s 2023-07-21T22:52:44.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:44 smithi187 ceph-mon[96918]: pgmap v1065: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 31 MiB/s wr, 200 op/s 2023-07-21T22:52:44.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:44 smithi195 ceph-mon[97365]: pgmap v1065: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 357 KiB/s rd, 31 MiB/s wr, 200 op/s 2023-07-21T22:52:45.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:45 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:52:45.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:45 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:52:45.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:45 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:52:46.463 INFO:teuthology.orchestra.run.smithi151.stderr:done. 2023-07-21T22:52:46.489 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2023-07-21T22:52:46.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:46 smithi151 ceph-mon[95510]: pgmap v1066: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 20 MiB/s wr, 135 op/s 2023-07-21T22:52:46.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:46 smithi187 ceph-mon[96918]: pgmap v1066: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 20 MiB/s wr, 135 op/s 2023-07-21T22:52:46.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:46 smithi195 ceph-mon[97365]: pgmap v1066: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 284 KiB/s rd, 20 MiB/s wr, 135 op/s 2023-07-21T22:52:48.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:47 smithi187 ceph-mon[96918]: pgmap v1067: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 31 MiB/s wr, 192 op/s 2023-07-21T22:52:48.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:47 smithi195 ceph-mon[97365]: pgmap v1067: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 31 MiB/s wr, 192 op/s 2023-07-21T22:52:48.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:47 smithi151 ceph-mon[95510]: pgmap v1067: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 557 KiB/s rd, 31 MiB/s wr, 192 op/s 2023-07-21T22:52:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.400+0000 7fa22f5ff700 1 -- 172.21.15.151:0/4266504736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2280ffb30 msgr2=0x7fa2280fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.400+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/4266504736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2280ffb30 0x7fa2280fffa0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fa218009990 tx=0x7fa218009ca0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.400+0000 7fa22f5ff700 1 -- 172.21.15.151:0/4266504736 shutdown_connections 2023-07-21T22:52:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.400+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/4266504736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa228105b60 0x7fa228105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.400+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/4266504736 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2281004e0 0x7fa22810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.400+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/4266504736 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2280ffb30 0x7fa2280fffa0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.400+0000 7fa22f5ff700 1 -- 172.21.15.151:0/4266504736 >> 172.21.15.151:0/4266504736 conn(0x7fa2280fb5f0 msgr2=0x7fa2280fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.400+0000 7fa22f5ff700 1 -- 172.21.15.151:0/4266504736 shutdown_connections 2023-07-21T22:52:49.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.400+0000 7fa22f5ff700 1 -- 172.21.15.151:0/4266504736 wait complete. 2023-07-21T22:52:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.401+0000 7fa22f5ff700 1 Processor -- start 2023-07-21T22:52:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.401+0000 7fa22f5ff700 1 -- start start 2023-07-21T22:52:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22f5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280ffb30 0x7fa22819bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22f5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2281004e0 0x7fa22819bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22f5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa228105b60 0x7fa228195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22f5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa228195f80 con 0x7fa228105b60 2023-07-21T22:52:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22f5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281960f0 con 0x7fa2281004e0 2023-07-21T22:52:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22f5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2281962b0 con 0x7fa2280ffb30 2023-07-21T22:52:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa228105b60 0x7fa228195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa228105b60 0x7fa228195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53718/0 (socket says 172.21.15.151:53718) 2023-07-21T22:52:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22db9c700 1 -- 172.21.15.151:0/816594909 learned_addr learned my addr 172.21.15.151:0/816594909 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:49.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2281004e0 0x7fa22819bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22d39b700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280ffb30 0x7fa22819bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22db9c700 1 -- 172.21.15.151:0/816594909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280ffb30 msgr2=0x7fa22819bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22db9c700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280ffb30 0x7fa22819bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22db9c700 1 -- 172.21.15.151:0/816594909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2281004e0 msgr2=0x7fa22819bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22db9c700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2281004e0 0x7fa22819bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22db9c700 1 -- 172.21.15.151:0/816594909 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2180095f0 con 0x7fa228105b60 2023-07-21T22:52:49.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2281004e0 0x7fa22819bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:52:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.402+0000 7fa22d39b700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280ffb30 0x7fa22819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:52:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.403+0000 7fa22db9c700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa228105b60 0x7fa228195910 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fa220007ee0 tx=0x7fa22000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.403+0000 7fa21e7fc700 1 -- 172.21.15.151:0/816594909 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220017070 con 0x7fa228105b60 2023-07-21T22:52:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.403+0000 7fa22f5ff700 1 -- 172.21.15.151:0/816594909 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa228196590 con 0x7fa228105b60 2023-07-21T22:52:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.403+0000 7fa21e7fc700 1 -- 172.21.15.151:0/816594909 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa22000f040 con 0x7fa228105b60 2023-07-21T22:52:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.403+0000 7fa21e7fc700 1 -- 172.21.15.151:0/816594909 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220005710 con 0x7fa228105b60 2023-07-21T22:52:49.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.403+0000 7fa22f5ff700 1 -- 172.21.15.151:0/816594909 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2281a2aa0 con 0x7fa228105b60 2023-07-21T22:52:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.406+0000 7fa21e7fc700 1 -- 172.21.15.151:0/816594909 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fa220005870 con 0x7fa228105b60 2023-07-21T22:52:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.407+0000 7fa242e99b80 1 Processor -- start 2023-07-21T22:52:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.407+0000 7fa242e99b80 1 -- start start 2023-07-21T22:52:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.407+0000 7fa21e7fc700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2140a12c0 0x7fa2140a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e7ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e78f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e794a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa242e99b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979d7ec50 con 0x563979e7f660 2023-07-21T22:52:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa242e99b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979dd19e0 con 0x563979cd56b0 2023-07-21T22:52:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa242e99b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979dcae70 con 0x563979e7f210 2023-07-21T22:52:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa21e7fc700 1 -- 172.21.15.151:0/816594909 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa2200cc570 con 0x7fa228105b60 2023-07-21T22:52:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2140a12c0 0x7fa2140a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e794a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22d39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e7ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22d39b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e7ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54112/0 (socket says 172.21.15.151:54112) 2023-07-21T22:52:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e794a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53726/0 (socket says 172.21.15.151:53726) 2023-07-21T22:52:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22d39b700 1 -- 172.21.15.151:0/1250672409 learned_addr learned my addr 172.21.15.151:0/1250672409 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/1250672409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e78f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22d39b700 1 -- 172.21.15.151:0/1250672409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 msgr2=0x563979e78f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22d39b700 1 --2- 172.21.15.151:0/1250672409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e78f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.446 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22d39b700 1 -- 172.21.15.151:0/1250672409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 msgr2=0x563979e794a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22d39b700 1 --2- 172.21.15.151:0/1250672409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e794a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22d39b700 1 -- 172.21.15.151:0/1250672409 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563979bf8d80 con 0x563979cd56b0 2023-07-21T22:52:49.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.408+0000 7fa22db9c700 1 --2- 172.21.15.151:0/1250672409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e794a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:52:49.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.409+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2140a12c0 0x7fa2140a3770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa21800b5c0 tx=0x7fa21800bb80 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.409+0000 7fa22d39b700 1 --2- 172.21.15.151:0/1250672409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e7ecd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa22400bd90 tx=0x7fa22400f640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbf781417cb3b606 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.409+0000 7fa2137fe700 1 -- 172.21.15.151:0/1250672409 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22400fda0 con 0x563979cd56b0 2023-07-21T22:52:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.409+0000 7fa2137fe700 1 -- 172.21.15.151:0/1250672409 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2240118d0 con 0x563979cd56b0 2023-07-21T22:52:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.409+0000 7fa2137fe700 1 -- 172.21.15.151:0/1250672409 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22401b6a0 con 0x563979cd56b0 2023-07-21T22:52:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 -- 172.21.15.151:0/1250672409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 msgr2=0x563979e7ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:49.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 --2- 172.21.15.151:0/1250672409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e7ecd0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa22400bd90 tx=0x7fa22400f640 comp rx=0 tx=0).stop 2023-07-21T22:52:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 -- 172.21.15.151:0/1250672409 shutdown_connections 2023-07-21T22:52:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 --2- 172.21.15.151:0/1250672409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e7ecd0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 --2- 172.21.15.151:0/1250672409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e794a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 --2- 172.21.15.151:0/1250672409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e78f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 -- 172.21.15.151:0/1250672409 >> 172.21.15.151:0/1250672409 conn(0x563979e6eae0 msgr2=0x563979e740e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 -- 172.21.15.151:0/1250672409 shutdown_connections 2023-07-21T22:52:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 -- 172.21.15.151:0/1250672409 wait complete. 2023-07-21T22:52:49.451 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 -- start start 2023-07-21T22:52:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.410+0000 7fa242e99b80 1 Processor -- start 2023-07-21T22:52:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e85470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e82760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e82ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa242e99b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979d6aa60 con 0x563979e7f660 2023-07-21T22:52:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa242e99b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979d6a760 con 0x563979cd56b0 2023-07-21T22:52:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa242e99b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979c4e8c0 con 0x563979e7f210 2023-07-21T22:52:49.452 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa242e99b80 10 client.0 _ll_register_callbacks cb 0x563979d68700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:52:49.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa22db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e82ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa22db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e82ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53730/0 (socket says 172.21.15.151:53730) 2023-07-21T22:52:49.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa22db9c700 1 -- 172.21.15.151:0/4196450621 learned_addr learned my addr 172.21.15.151:0/4196450621 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:49.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e82760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.411+0000 7fa22d39b700 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa22db9c700 1 -- 172.21.15.151:0/4196450621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 msgr2=0x563979e82760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:49.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa22db9c700 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e82760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa22db9c700 1 -- 172.21.15.151:0/4196450621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 msgr2=0x563979e85470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa22db9c700 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e85470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa22db9c700 1 -- 172.21.15.151:0/4196450621 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2281a2aa0 con 0x563979e7f660 2023-07-21T22:52:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa22d39b700 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e85470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:52:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa22db9c700 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e82ce0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa22000d7b0 tx=0x7fa2200991c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2485b7b2fbdba6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa210ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:52:49.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa210ff9700 1 -- 172.21.15.151:0/4196450621 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa220099600 con 0x563979e7f660 2023-07-21T22:52:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa210ff9700 1 -- 172.21.15.151:0/4196450621 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa22009d630 con 0x563979e7f660 2023-07-21T22:52:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa242e99b80 1 -- 172.21.15.151:0/4196450621 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563979d24490 con 0x563979e7f660 2023-07-21T22:52:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa210ff9700 1 -- 172.21.15.151:0/4196450621 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2200a1a50 con 0x563979e7f660 2023-07-21T22:52:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa242e99b80 10 client.19020 fetch_fsmap learned FSMap version 100 2023-07-21T22:52:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa242e99b80 1 -- 172.21.15.151:0/4196450621 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x7fa22400b9c0 con 0x563979e7f660 2023-07-21T22:52:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.412+0000 7fa210ff9700 1 -- 172.21.15.151:0/4196450621 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa2200b5080 con 0x563979e7f660 2023-07-21T22:52:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.413+0000 7fa210ff9700 1 -- 172.21.15.151:0/4196450621 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 100) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa2200840a0 con 0x563979e7f660 2023-07-21T22:52:49.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.413+0000 7fa242e99b80 10 client.19020 fetch_fsmap finished waiting for FSMap version 100 2023-07-21T22:52:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.413+0000 7fa242e99b80 10 client.19020 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:52:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.413+0000 7fa242e99b80 20 client.19020 populate_metadata read hostname 'smithi151' 2023-07-21T22:52:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.413+0000 7fa242e99b80 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563979e92a70 0x563979e94e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.413+0000 7fa242e99b80 4 client.19020 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:52:49.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.413+0000 7fa242e99b80 1 -- 172.21.15.151:0/4196450621 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563979dc3e50 con 0x563979e92a70 2023-07-21T22:52:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.413+0000 7fa22d39b700 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563979e92a70 0x563979e94e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.414+0000 7fa22d39b700 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563979e92a70 0x563979e94e80 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7cc7a3923aa3f61 server_cookie=d6db9ae1fbbfd835 in_seq=0 out_seq=0 2023-07-21T22:52:49.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.414+0000 7fa210ff9700 10 client.19020 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.414+0000 7fa210ff9700 1 -- 172.21.15.151:0/4196450621 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563979dc3e50 con 0x563979e92a70 2023-07-21T22:52:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.414+0000 7fa210ff9700 10 client.19020 handle_command_reply: tid=0 2023-07-21T22:52:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 client.19020 shutdown 2023-07-21T22:52:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 -- 172.21.15.151:0/4196450621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 msgr2=0x563979e82ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e82ce0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fa22000d7b0 tx=0x7fa2200991c0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 -- 172.21.15.151:0/4196450621 shutdown_connections 2023-07-21T22:52:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563979e92a70 0x563979e94e80 crc :-1 s=READY pgs=399 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979cd56b0 0x563979e85470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979e7f660 0x563979e82ce0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa210ff9700 0 client.19020 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 --2- 172.21.15.151:0/4196450621 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e82760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 -- 172.21.15.151:0/4196450621 >> 172.21.15.151:0/4196450621 conn(0x563979e6eae0 msgr2=0x563979e733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:49.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 -- 172.21.15.151:0/4196450621 shutdown_connections 2023-07-21T22:52:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 1 -- 172.21.15.151:0/4196450621 wait complete. 2023-07-21T22:52:49.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.415+0000 7fa242e99b80 20 client.19020 trim_cache size 0 max 16384 2023-07-21T22:52:49.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.430+0000 7fa242e99b80 1 Processor -- start 2023-07-21T22:52:49.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.430+0000 7fa242e99b80 1 -- start start 2023-07-21T22:52:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e78f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e7e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 0x563979e89c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa242e99b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979e704f0 con 0x563979cd56b0 2023-07-21T22:52:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa242e99b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979e7d500 con 0x563979e7f660 2023-07-21T22:52:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa242e99b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979e6bab0 con 0x563979e7f210 2023-07-21T22:52:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e78f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e78f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53736/0 (socket says 172.21.15.151:53736) 2023-07-21T22:52:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22d39b700 1 -- 172.21.15.151:0/1478435653 learned_addr learned my addr 172.21.15.151:0/1478435653 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e7e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22db9c700 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 0x563979e89c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22d39b700 1 -- 172.21.15.151:0/1478435653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 msgr2=0x563979e7e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22d39b700 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e7e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22d39b700 1 -- 172.21.15.151:0/1478435653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 msgr2=0x563979e89c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22d39b700 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 0x563979e89c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22d39b700 1 -- 172.21.15.151:0/1478435653 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563979e8efe0 con 0x563979cd56b0 2023-07-21T22:52:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22db9c700 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 0x563979e89c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:52:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.431+0000 7fa22d39b700 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e78f40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa224014040 tx=0x7fa224000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e10de5552a872e5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:49.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa213fff700 1 -- 172.21.15.151:0/1478435653 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224020040 con 0x563979cd56b0 2023-07-21T22:52:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa213fff700 1 -- 172.21.15.151:0/1478435653 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa22400fcc0 con 0x563979cd56b0 2023-07-21T22:52:49.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa213fff700 1 -- 172.21.15.151:0/1478435653 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224028c30 con 0x563979cd56b0 2023-07-21T22:52:49.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa242e99b80 1 -- 172.21.15.151:0/1478435653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 msgr2=0x563979e78f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:49.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa242e99b80 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e78f40 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7fa224014040 tx=0x7fa224000bc0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa242e99b80 1 -- 172.21.15.151:0/1478435653 shutdown_connections 2023-07-21T22:52:49.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa242e99b80 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 0x563979e89c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa242e99b80 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e78f40 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa242e99b80 1 --2- 172.21.15.151:0/1478435653 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e7e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa242e99b80 1 -- 172.21.15.151:0/1478435653 >> 172.21.15.151:0/1478435653 conn(0x563979e6eae0 msgr2=0x563979e7fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.432+0000 7fa242e99b80 1 -- 172.21.15.151:0/1478435653 shutdown_connections 2023-07-21T22:52:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.433+0000 7fa242e99b80 1 -- 172.21.15.151:0/1478435653 wait complete. 2023-07-21T22:52:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.433+0000 7fa242e99b80 1 -- start start 2023-07-21T22:52:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.433+0000 7fa242e99b80 1 Processor -- start 2023-07-21T22:52:49.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.433+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e89b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e87e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa242e99b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 0x563979e883c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa242e99b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979e88940 con 0x563979cd56b0 2023-07-21T22:52:49.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa242e99b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979e88a80 con 0x563979e7f660 2023-07-21T22:52:49.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa242e99b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563979e88c40 con 0x563979e7f210 2023-07-21T22:52:49.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa242e99b80 10 client.0 _ll_register_callbacks cb 0x563979d68700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:52:49.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e89b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e89b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53750/0 (socket says 172.21.15.151:53750) 2023-07-21T22:52:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22cb9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e87e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22d39b700 1 -- 172.21.15.151:0/3522844035 learned_addr learned my addr 172.21.15.151:0/3522844035 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:52:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22db9c700 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 0x563979e883c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22d39b700 1 -- 172.21.15.151:0/3522844035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 msgr2=0x563979e87e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22d39b700 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e87e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22d39b700 1 -- 172.21.15.151:0/3522844035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 msgr2=0x563979e883c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:52:49.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22d39b700 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 0x563979e883c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22d39b700 1 -- 172.21.15.151:0/3522844035 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563979bf8d80 con 0x563979cd56b0 2023-07-21T22:52:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.434+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e87e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:52:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa22d39b700 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e89b20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa224005b90 tx=0x7fa224005bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af37a71ca09ca4a8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:52:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa210ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:52:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa210ff9700 1 -- 172.21.15.151:0/3522844035 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa224020040 con 0x563979cd56b0 2023-07-21T22:52:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa210ff9700 1 -- 172.21.15.151:0/3522844035 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa2240114c0 con 0x563979cd56b0 2023-07-21T22:52:49.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa242e99b80 1 -- 172.21.15.151:0/3522844035 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563979d85ff0 con 0x563979cd56b0 2023-07-21T22:52:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa210ff9700 1 -- 172.21.15.151:0/3522844035 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=100) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2240116a0 con 0x563979cd56b0 2023-07-21T22:52:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa242e99b80 10 client.19026 fetch_fsmap learned FSMap version 100 2023-07-21T22:52:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa242e99b80 1 -- 172.21.15.151:0/3522844035 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=100,monmap=4+}) v3 -- 0x563979be1c00 con 0x563979cd56b0 2023-07-21T22:52:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa210ff9700 1 -- 172.21.15.151:0/3522844035 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x563979d85ff0 con 0x563979cd56b0 2023-07-21T22:52:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.435+0000 7fa210ff9700 1 -- 172.21.15.151:0/3522844035 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 100) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fa224039070 con 0x563979cd56b0 2023-07-21T22:52:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.436+0000 7fa242e99b80 10 client.19026 fetch_fsmap finished waiting for FSMap version 100 2023-07-21T22:52:49.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.436+0000 7fa242e99b80 10 client.19026 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:52:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.436+0000 7fa242e99b80 20 client.19026 populate_metadata read hostname 'smithi151' 2023-07-21T22:52:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.436+0000 7fa242e99b80 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563979ee79e0 0x563979ee9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:52:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.436+0000 7fa242e99b80 4 client.19026 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:52:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.436+0000 7fa242e99b80 1 -- 172.21.15.151:0/3522844035 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563979c19f10 con 0x563979ee79e0 2023-07-21T22:52:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.436+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563979ee79e0 0x563979ee9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:52:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.436+0000 7fa22cb9a700 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563979ee79e0 0x563979ee9df0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ab124783cdf45e6 server_cookie=69b38614eb8335bd in_seq=0 out_seq=0 2023-07-21T22:52:49.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.436+0000 7fa210ff9700 10 client.19026 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.451+0000 7fa210ff9700 1 -- 172.21.15.151:0/3522844035 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563979c19f10 con 0x563979ee79e0 2023-07-21T22:52:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.451+0000 7fa210ff9700 10 client.19026 handle_command_reply: tid=0 2023-07-21T22:52:49.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.451+0000 7fa242e99b80 1 client.19026 shutdown 2023-07-21T22:52:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.451+0000 7fa242e99b80 1 -- 172.21.15.151:0/3522844035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 msgr2=0x563979e89b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.451+0000 7fa242e99b80 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e89b20 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa224005b90 tx=0x7fa224005bc0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa242e99b80 1 -- 172.21.15.151:0/3522844035 shutdown_connections 2023-07-21T22:52:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa242e99b80 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563979ee79e0 0x563979ee9df0 crc :-1 s=READY pgs=400 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa242e99b80 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563979e7f660 0x563979e883c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa242e99b80 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563979cd56b0 0x563979e89b20 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa210ff9700 0 client.19026 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:52:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa242e99b80 1 --2- 172.21.15.151:0/3522844035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563979e7f210 0x563979e87e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa242e99b80 1 -- 172.21.15.151:0/3522844035 >> 172.21.15.151:0/3522844035 conn(0x563979e6eae0 msgr2=0x563979e7e010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa242e99b80 1 -- 172.21.15.151:0/3522844035 shutdown_connections 2023-07-21T22:52:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa242e99b80 1 -- 172.21.15.151:0/3522844035 wait complete. 2023-07-21T22:52:49.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa242e99b80 20 client.19026 trim_cache size 0 max 16384 2023-07-21T22:52:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:52:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:52:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:52:49.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:52:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa22f5ff700 1 -- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2140a12c0 msgr2=0x7fa2140a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2140a12c0 0x7fa2140a3770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa21800b5c0 tx=0x7fa21800bb80 comp rx=0 tx=0).stop 2023-07-21T22:52:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa22f5ff700 1 -- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa228105b60 msgr2=0x7fa228195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:52:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.452+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa228105b60 0x7fa228195910 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fa220007ee0 tx=0x7fa22000d3b0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.453+0000 7fa22f5ff700 1 -- 172.21.15.151:0/816594909 shutdown_connections 2023-07-21T22:52:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.453+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa2140a12c0 0x7fa2140a3770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.453+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa228105b60 0x7fa228195910 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.453+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa2280ffb30 0x7fa22819bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.453+0000 7fa22f5ff700 1 --2- 172.21.15.151:0/816594909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2281004e0 0x7fa22819bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:52:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.453+0000 7fa22f5ff700 1 -- 172.21.15.151:0/816594909 >> 172.21.15.151:0/816594909 conn(0x7fa2280fb5f0 msgr2=0x7fa2281037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:52:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.453+0000 7fa22f5ff700 1 -- 172.21.15.151:0/816594909 shutdown_connections 2023-07-21T22:52:49.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:52:49.453+0000 7fa22f5ff700 1 -- 172.21.15.151:0/816594909 wait complete. 2023-07-21T22:52:50.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:49 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:52:50.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:49 smithi187 ceph-mon[96918]: pgmap v1068: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 21 MiB/s wr, 126 op/s 2023-07-21T22:52:50.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:49 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:52:50.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:49 smithi195 ceph-mon[97365]: pgmap v1068: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 21 MiB/s wr, 126 op/s 2023-07-21T22:52:50.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:49 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:52:50.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:49 smithi151 ceph-mon[95510]: pgmap v1068: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 21 MiB/s wr, 126 op/s 2023-07-21T22:52:52.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:52 smithi151 ceph-mon[95510]: pgmap v1069: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 21 MiB/s wr, 126 op/s 2023-07-21T22:52:52.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:52 smithi187 ceph-mon[96918]: pgmap v1069: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 21 MiB/s wr, 126 op/s 2023-07-21T22:52:52.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:52 smithi195 ceph-mon[97365]: pgmap v1069: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 21 MiB/s wr, 126 op/s 2023-07-21T22:52:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:starting vacuum...end. 2023-07-21T22:52:54.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:54 smithi151 ceph-mon[95510]: pgmap v1070: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 21 MiB/s wr, 158 op/s 2023-07-21T22:52:54.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:54 smithi187 ceph-mon[96918]: pgmap v1070: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 21 MiB/s wr, 158 op/s 2023-07-21T22:52:54.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:54 smithi195 ceph-mon[97365]: pgmap v1070: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 483 KiB/s rd, 21 MiB/s wr, 158 op/s 2023-07-21T22:52:56.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:56 smithi151 ceph-mon[95510]: pgmap v1071: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 11 MiB/s wr, 89 op/s 2023-07-21T22:52:56.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:56 smithi187 ceph-mon[96918]: pgmap v1071: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 11 MiB/s wr, 89 op/s 2023-07-21T22:52:56.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:56 smithi195 ceph-mon[97365]: pgmap v1071: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 325 KiB/s rd, 11 MiB/s wr, 89 op/s 2023-07-21T22:52:57.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:57 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:52:57.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:57 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:52:57.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:57 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:52:58.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:52:58 smithi151 ceph-mon[95510]: pgmap v1072: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 12 MiB/s wr, 125 op/s 2023-07-21T22:52:58.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:52:58 smithi187 ceph-mon[96918]: pgmap v1072: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 12 MiB/s wr, 125 op/s 2023-07-21T22:52:58.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:52:58 smithi195 ceph-mon[97365]: pgmap v1072: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 773 KiB/s rd, 12 MiB/s wr, 125 op/s 2023-07-21T22:52:59.292 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 5.0 s, 59.4 tps, lat 473.460 ms stddev 403.800 2023-07-21T22:53:00.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:00 smithi151 ceph-mon[95510]: pgmap v1073: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2023-07-21T22:53:00.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:00 smithi187 ceph-mon[96918]: pgmap v1073: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2023-07-21T22:53:00.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:00 smithi195 ceph-mon[97365]: pgmap v1073: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2023-07-21T22:53:02.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:02 smithi151 ceph-mon[95510]: pgmap v1074: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2023-07-21T22:53:02.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:02 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.655+0000 7f8248fff700 1 -- 172.21.15.151:0/1152651751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8244067c10 msgr2=0x7f8244067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.655+0000 7f8248fff700 1 --2- 172.21.15.151:0/1152651751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8244067c10 0x7f8244067fe0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f82340099c0 tx=0x7f8234009cd0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.655+0000 7f8248fff700 1 -- 172.21.15.151:0/1152651751 shutdown_connections 2023-07-21T22:53:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.655+0000 7f8248fff700 1 --2- 172.21.15.151:0/1152651751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8244067c10 0x7f8244067fe0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.655+0000 7f8248fff700 1 --2- 172.21.15.151:0/1152651751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8244104e50 0x7f824410ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.655+0000 7f8248fff700 1 --2- 172.21.15.151:0/1152651751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82440685b0 0x7f8244104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.655+0000 7f8248fff700 1 -- 172.21.15.151:0/1152651751 >> 172.21.15.151:0/1152651751 conn(0x7f8244074760 msgr2=0x7f8244074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.655+0000 7f8248fff700 1 -- 172.21.15.151:0/1152651751 shutdown_connections 2023-07-21T22:53:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.655+0000 7f8248fff700 1 -- 172.21.15.151:0/1152651751 wait complete. 2023-07-21T22:53:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.657+0000 7f8248fff700 1 Processor -- start 2023-07-21T22:53:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.657+0000 7f8248fff700 1 -- start start 2023-07-21T22:53:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.657+0000 7f8248fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8244067c10 0x7f824410b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8248fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82440685b0 0x7f824410bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8248fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8244104e50 0x7f8244199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8248fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8244199e00 con 0x7f82440685b0 2023-07-21T22:53:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8248fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8244199f70 con 0x7f8244067c10 2023-07-21T22:53:02.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8248fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f824419a130 con 0x7f8244104e50 2023-07-21T22:53:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8242d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8244104e50 0x7f8244199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8242d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8244104e50 0x7f8244199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37424/0 (socket says 172.21.15.151:37424) 2023-07-21T22:53:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8242d9d700 1 -- 172.21.15.151:0/3062758892 learned_addr learned my addr 172.21.15.151:0/3062758892 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8241d9b700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82440685b0 0x7f824410bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f824259c700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8244067c10 0x7f824410b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8242d9d700 1 -- 172.21.15.151:0/3062758892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8244067c10 msgr2=0x7f824410b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:02.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8242d9d700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8244067c10 0x7f824410b890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8242d9d700 1 -- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82440685b0 msgr2=0x7f824410bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.658+0000 7f8242d9d700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82440685b0 0x7f824410bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.659+0000 7f8242d9d700 1 -- 172.21.15.151:0/3062758892 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82340095f0 con 0x7f8244104e50 2023-07-21T22:53:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.659+0000 7f824259c700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8244067c10 0x7f824410b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:53:02.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.659+0000 7f8242d9d700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8244104e50 0x7f8244199830 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f823c00ef30 tx=0x7f823c00c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.659+0000 7f82337fe700 1 -- 172.21.15.151:0/3062758892 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c018070 con 0x7f8244104e50 2023-07-21T22:53:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.659+0000 7f82337fe700 1 -- 172.21.15.151:0/3062758892 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f823c00f040 con 0x7f8244104e50 2023-07-21T22:53:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.659+0000 7f8248fff700 1 -- 172.21.15.151:0/3062758892 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f824419a350 con 0x7f8244104e50 2023-07-21T22:53:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.659+0000 7f82337fe700 1 -- 172.21.15.151:0/3062758892 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823c00cc70 con 0x7f8244104e50 2023-07-21T22:53:02.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.659+0000 7f8248fff700 1 -- 172.21.15.151:0/3062758892 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8244196940 con 0x7f8244104e50 2023-07-21T22:53:02.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.664+0000 7f82337fe700 1 -- 172.21.15.151:0/3062758892 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f823c007500 con 0x7f8244104e50 2023-07-21T22:53:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.666+0000 7f825c8bfb80 1 Processor -- start 2023-07-21T22:53:02.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.666+0000 7f825c8bfb80 1 -- start start 2023-07-21T22:53:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba30cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba2af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 0x557ddba2b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.702 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddb930c50 con 0x557ddba31210 2023-07-21T22:53:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddb9839e0 con 0x557ddb8876b0 2023-07-21T22:53:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddb97ce70 con 0x557ddba31660 2023-07-21T22:53:02.703 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f82337fe700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f822c0a1340 0x7f822c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f8241d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba30cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f8241d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba30cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41076/0 (socket says 172.21.15.151:41076) 2023-07-21T22:53:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f8241d9b700 1 -- 172.21.15.151:0/819816999 learned_addr learned my addr 172.21.15.151:0/819816999 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f8241d9b700 1 --2- 172.21.15.151:0/819816999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 0x557ddba2b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.667+0000 7f82337fe700 1 -- 172.21.15.151:0/3062758892 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f823c0cc790 con 0x7f8244104e50 2023-07-21T22:53:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.668+0000 7f8242d9d700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f822c0a1340 0x7f822c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.668+0000 7f8241d9b700 1 -- 172.21.15.151:0/819816999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 msgr2=0x557ddba2b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.668+0000 7f8241d9b700 1 --2- 172.21.15.151:0/819816999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 0x557ddba2b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.668+0000 7f8241d9b700 1 -- 172.21.15.151:0/819816999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 msgr2=0x557ddba2af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.668+0000 7f8241d9b700 1 --2- 172.21.15.151:0/819816999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba2af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.668+0000 7f8241d9b700 1 -- 172.21.15.151:0/819816999 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ddb7aad80 con 0x557ddb8876b0 2023-07-21T22:53:02.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.668+0000 7f8241d9b700 1 --2- 172.21.15.151:0/819816999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba30cd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8244068980 tx=0x7f8238009750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2687f1db340fa520 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.668+0000 7f8242d9d700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f822c0a1340 0x7f822c0a37f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f823c009c10 tx=0x7f823c004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.669+0000 7f8230ff9700 1 -- 172.21.15.151:0/819816999 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238004050 con 0x557ddb8876b0 2023-07-21T22:53:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.669+0000 7f8230ff9700 1 -- 172.21.15.151:0/819816999 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8238011e90 con 0x557ddb8876b0 2023-07-21T22:53:02.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.669+0000 7f8230ff9700 1 -- 172.21.15.151:0/819816999 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238005280 con 0x557ddb8876b0 2023-07-21T22:53:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.670+0000 7f825c8bfb80 1 -- 172.21.15.151:0/819816999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 msgr2=0x557ddba30cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.670+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/819816999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba30cd0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f8244068980 tx=0x7f8238009750 comp rx=0 tx=0).stop 2023-07-21T22:53:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.670+0000 7f825c8bfb80 1 -- 172.21.15.151:0/819816999 shutdown_connections 2023-07-21T22:53:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.670+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/819816999 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba30cd0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.670+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/819816999 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 0x557ddba2b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.670+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/819816999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba2af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.670+0000 7f825c8bfb80 1 -- 172.21.15.151:0/819816999 >> 172.21.15.151:0/819816999 conn(0x557ddba20ae0 msgr2=0x557ddba260e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:02.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.670+0000 7f825c8bfb80 1 -- 172.21.15.151:0/819816999 shutdown_connections 2023-07-21T22:53:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.670+0000 7f825c8bfb80 1 -- 172.21.15.151:0/819816999 wait complete. 2023-07-21T22:53:02.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.671+0000 7f825c8bfb80 1 -- start start 2023-07-21T22:53:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.671+0000 7f825c8bfb80 1 Processor -- start 2023-07-21T22:53:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.672+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba37520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.672+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba34810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.672+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 0x557ddba34e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.672+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddb91ca60 con 0x557ddba31210 2023-07-21T22:53:02.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.672+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddb91c760 con 0x557ddb8876b0 2023-07-21T22:53:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.672+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddb8008c0 con 0x557ddba31660 2023-07-21T22:53:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.672+0000 7f825c8bfb80 10 client.0 _ll_register_callbacks cb 0x557ddb91a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.672+0000 7f824259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba34810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba37520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba37520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41078/0 (socket says 172.21.15.151:41078) 2023-07-21T22:53:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 -- 172.21.15.151:0/3566251392 learned_addr learned my addr 172.21.15.151:0/3566251392 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:02.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f824259c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba34810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58132/0 (socket says 172.21.15.151:58132) 2023-07-21T22:53:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 0x557ddba34e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 -- 172.21.15.151:0/3566251392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 msgr2=0x557ddba34e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 0x557ddba34e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 -- 172.21.15.151:0/3566251392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 msgr2=0x557ddba34810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba34810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 -- 172.21.15.151:0/3566251392 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8238019040 con 0x557ddb8876b0 2023-07-21T22:53:02.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.673+0000 7f8241d9b700 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba37520 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8238011620 tx=0x7f82380115b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61c2190014e7e685 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:02.713 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.674+0000 7f8229ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:53:02.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.674+0000 7f8229ffb700 1 -- 172.21.15.151:0/3566251392 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8238004110 con 0x557ddb8876b0 2023-07-21T22:53:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.674+0000 7f8229ffb700 1 -- 172.21.15.151:0/3566251392 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8238004270 con 0x557ddb8876b0 2023-07-21T22:53:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.674+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3566251392 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ddb8d6490 con 0x557ddb8876b0 2023-07-21T22:53:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.674+0000 7f8229ffb700 1 -- 172.21.15.151:0/3566251392 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8238004430 con 0x557ddb8876b0 2023-07-21T22:53:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.674+0000 7f825c8bfb80 10 client.28691 fetch_fsmap learned FSMap version 102 2023-07-21T22:53:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.674+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3566251392 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x557ddb793c00 con 0x557ddb8876b0 2023-07-21T22:53:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.675+0000 7f8229ffb700 1 -- 172.21.15.151:0/3566251392 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557ddb8d6490 con 0x557ddb8876b0 2023-07-21T22:53:02.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.675+0000 7f8229ffb700 1 -- 172.21.15.151:0/3566251392 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 102) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f823801d070 con 0x557ddb8876b0 2023-07-21T22:53:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.675+0000 7f825c8bfb80 10 client.28691 fetch_fsmap finished waiting for FSMap version 102 2023-07-21T22:53:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.675+0000 7f825c8bfb80 10 client.28691 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.675+0000 7f825c8bfb80 20 client.28691 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.675+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557ddba44ac0 0x557ddba46ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.675+0000 7f825c8bfb80 4 client.28691 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:53:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.675+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3566251392 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557ddb975e50 con 0x557ddba44ac0 2023-07-21T22:53:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.675+0000 7f824259c700 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557ddba44ac0 0x557ddba46ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.676+0000 7f8229ffb700 10 client.28691 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.676+0000 7f824259c700 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557ddba44ac0 0x557ddba46ed0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76a2c046937169d0 server_cookie=31ef45e25fedd17e in_seq=0 out_seq=0 2023-07-21T22:53:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.677+0000 7f8229ffb700 1 -- 172.21.15.151:0/3566251392 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557ddb975e50 con 0x557ddba44ac0 2023-07-21T22:53:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.677+0000 7f8229ffb700 10 client.28691 handle_command_reply: tid=0 2023-07-21T22:53:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.677+0000 7f825c8bfb80 1 client.28691 shutdown 2023-07-21T22:53:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.677+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3566251392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 msgr2=0x557ddba37520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.677+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba37520 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f8238011620 tx=0x7f82380115b0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.678+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3566251392 shutdown_connections 2023-07-21T22:53:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.678+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557ddba44ac0 0x557ddba46ed0 crc :-1 s=READY pgs=401 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.678+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba37520 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.678+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31660 0x557ddba34e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.678+0000 7f8229ffb700 0 client.28691 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.678+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3566251392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba34810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.678+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3566251392 >> 172.21.15.151:0/3566251392 conn(0x557ddba20ae0 msgr2=0x557ddba253e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.678+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3566251392 shutdown_connections 2023-07-21T22:53:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.678+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3566251392 wait complete. 2023-07-21T22:53:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.679+0000 7f825c8bfb80 20 client.28691 trim_cache size 0 max 16384 2023-07-21T22:53:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.704+0000 7f825c8bfb80 1 Processor -- start 2023-07-21T22:53:02.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.704+0000 7f825c8bfb80 1 -- start start 2023-07-21T22:53:02.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.704+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddba20ae0 0x557ddba30210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.704+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddb8876b0 0x557ddba34070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.704+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba32140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.704+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddba35d80 con 0x557ddba31210 2023-07-21T22:53:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.704+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddba30920 con 0x557ddba20ae0 2023-07-21T22:53:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.704+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddba345b0 con 0x557ddb8876b0 2023-07-21T22:53:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f8241d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddba20ae0 0x557ddba30210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f8241d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddba20ae0 0x557ddba30210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41094/0 (socket says 172.21.15.151:41094) 2023-07-21T22:53:02.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f8241d9b700 1 -- 172.21.15.151:0/1126553859 learned_addr learned my addr 172.21.15.151:0/1126553859 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f824259c700 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddb8876b0 0x557ddba34070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f8241d9b700 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba32140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f8241d9b700 1 -- 172.21.15.151:0/1126553859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddb8876b0 msgr2=0x557ddba34070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f8241d9b700 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddb8876b0 0x557ddba34070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f8241d9b700 1 -- 172.21.15.151:0/1126553859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 msgr2=0x557ddba32140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f8241d9b700 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba32140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f8241d9b700 1 -- 172.21.15.151:0/1126553859 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557ddb7d11f0 con 0x557ddba20ae0 2023-07-21T22:53:02.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.705+0000 7f824259c700 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddb8876b0 0x557ddba34070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:53:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.706+0000 7f8241d9b700 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddba20ae0 0x557ddba30210 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8238001eb0 tx=0x7f8238005a00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a665c9c82fb3778 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.706+0000 7f82317fa700 1 -- 172.21.15.151:0/1126553859 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f823802dea0 con 0x557ddba20ae0 2023-07-21T22:53:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.706+0000 7f82317fa700 1 -- 172.21.15.151:0/1126553859 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8238004df0 con 0x557ddba20ae0 2023-07-21T22:53:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.706+0000 7f82317fa700 1 -- 172.21.15.151:0/1126553859 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82380051b0 con 0x557ddba20ae0 2023-07-21T22:53:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.707+0000 7f825c8bfb80 1 -- 172.21.15.151:0/1126553859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddba20ae0 msgr2=0x557ddba30210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.707+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddba20ae0 0x557ddba30210 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f8238001eb0 tx=0x7f8238005a00 comp rx=0 tx=0).stop 2023-07-21T22:53:02.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.707+0000 7f825c8bfb80 1 -- 172.21.15.151:0/1126553859 shutdown_connections 2023-07-21T22:53:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.707+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddba20ae0 0x557ddba30210 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.707+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba31210 0x557ddba32140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.707+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/1126553859 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddb8876b0 0x557ddba34070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.707+0000 7f825c8bfb80 1 -- 172.21.15.151:0/1126553859 >> 172.21.15.151:0/1126553859 conn(0x557ddba41170 msgr2=0x557ddba31a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:02.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.707+0000 7f825c8bfb80 1 -- 172.21.15.151:0/1126553859 shutdown_connections 2023-07-21T22:53:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.708+0000 7f825c8bfb80 1 -- 172.21.15.151:0/1126553859 wait complete. 2023-07-21T22:53:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.708+0000 7f825c8bfb80 1 -- start start 2023-07-21T22:53:02.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.708+0000 7f825c8bfb80 1 Processor -- start 2023-07-21T22:53:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba2cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba20ae0 0x557ddba2d430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f825c8bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31210 0x557ddba2d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddba98a20 con 0x557ddba20ae0 2023-07-21T22:53:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddba98b60 con 0x557ddb8876b0 2023-07-21T22:53:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f825c8bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557ddba98d20 con 0x557ddba31210 2023-07-21T22:53:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f825c8bfb80 10 client.0 _ll_register_callbacks cb 0x7f8238009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f8241d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba2cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f8241d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba2cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41110/0 (socket says 172.21.15.151:41110) 2023-07-21T22:53:02.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.709+0000 7f8241d9b700 1 -- 172.21.15.151:0/3960277055 learned_addr learned my addr 172.21.15.151:0/3960277055 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f8241d9b700 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31210 0x557ddba2d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f824259c700 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba20ae0 0x557ddba2d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f8241d9b700 1 -- 172.21.15.151:0/3960277055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31210 msgr2=0x557ddba2d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f8241d9b700 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31210 0x557ddba2d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f8241d9b700 1 -- 172.21.15.151:0/3960277055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba20ae0 msgr2=0x557ddba2d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f8241d9b700 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba20ae0 0x557ddba2d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f8241d9b700 1 -- 172.21.15.151:0/3960277055 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f824410d210 con 0x557ddb8876b0 2023-07-21T22:53:02.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f824259c700 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba20ae0 0x557ddba2d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:53:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f8241d9b700 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba2cef0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8238011620 tx=0x7f8238004a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecc0fe5cb1f6a139 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.710+0000 7f8229ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:53:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.711+0000 7f8229ffb700 1 -- 172.21.15.151:0/3960277055 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82380043e0 con 0x557ddb8876b0 2023-07-21T22:53:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.711+0000 7f8229ffb700 1 -- 172.21.15.151:0/3960277055 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(144..144 src has 1..144) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8238000e40 con 0x557ddb8876b0 2023-07-21T22:53:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.711+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3960277055 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557ddba41540 con 0x557ddb8876b0 2023-07-21T22:53:02.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.711+0000 7f8229ffb700 1 -- 172.21.15.151:0/3960277055 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=102) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8238004540 con 0x557ddb8876b0 2023-07-21T22:53:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.711+0000 7f825c8bfb80 10 client.28697 fetch_fsmap learned FSMap version 102 2023-07-21T22:53:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.711+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3960277055 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=102,monmap=4+}) v3 -- 0x557ddb793c00 con 0x557ddb8876b0 2023-07-21T22:53:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.712+0000 7f8229ffb700 1 -- 172.21.15.151:0/3960277055 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557ddba41540 con 0x557ddb8876b0 2023-07-21T22:53:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.712+0000 7f8229ffb700 1 -- 172.21.15.151:0/3960277055 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 102) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f823801d070 con 0x557ddb8876b0 2023-07-21T22:53:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.712+0000 7f825c8bfb80 10 client.28697 fetch_fsmap finished waiting for FSMap version 102 2023-07-21T22:53:02.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.712+0000 7f825c8bfb80 10 client.28697 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.712+0000 7f825c8bfb80 20 client.28697 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.712+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557ddba31660 0x557ddba9bee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.712+0000 7f825c8bfb80 4 client.28697 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:53:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.712+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3960277055 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f8238011e90 con 0x557ddba31660 2023-07-21T22:53:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.713+0000 7f824259c700 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557ddba31660 0x557ddba9bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.713+0000 7f824259c700 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557ddba31660 0x557ddba9bee0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e94577ebfa7a8bb server_cookie=8222b3c260068d1b in_seq=0 out_seq=0 2023-07-21T22:53:02.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.713+0000 7f8229ffb700 10 client.28697 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:02.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.746+0000 7f8229ffb700 1 -- 172.21.15.151:0/3960277055 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f8238011e90 con 0x557ddba31660 2023-07-21T22:53:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.746+0000 7f8229ffb700 10 client.28697 handle_command_reply: tid=0 2023-07-21T22:53:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.746+0000 7f825c8bfb80 1 client.28697 shutdown 2023-07-21T22:53:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.746+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3960277055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 msgr2=0x557ddba2cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba2cef0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8238011620 tx=0x7f8238004a60 comp rx=0 tx=0).stop 2023-07-21T22:53:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3960277055 shutdown_connections 2023-07-21T22:53:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557ddba31660 0x557ddba9bee0 crc :-1 s=READY pgs=402 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557ddb8876b0 0x557ddba2cef0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f8229ffb700 0 client.28697 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557ddba31210 0x557ddba2d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f825c8bfb80 1 --2- 172.21.15.151:0/3960277055 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557ddba20ae0 0x557ddba2d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3960277055 >> 172.21.15.151:0/3960277055 conn(0x557ddba41170 msgr2=0x557ddba2f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3960277055 shutdown_connections 2023-07-21T22:53:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.747+0000 7f825c8bfb80 1 -- 172.21.15.151:0/3960277055 wait complete. 2023-07-21T22:53:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.748+0000 7f825c8bfb80 20 client.28697 trim_cache size 0 max 16384 2023-07-21T22:53:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:53:02.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:53:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:53:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:53:02.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.748+0000 7f8248fff700 1 -- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f822c0a1340 msgr2=0x7f822c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.748+0000 7f8248fff700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f822c0a1340 0x7f822c0a37f0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f823c009c10 tx=0x7f823c004ad0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.748+0000 7f8248fff700 1 -- 172.21.15.151:0/3062758892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8244104e50 msgr2=0x7f8244199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.748+0000 7f8248fff700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8244104e50 0x7f8244199830 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f823c00ef30 tx=0x7f823c00c3a0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.749+0000 7f8248fff700 1 -- 172.21.15.151:0/3062758892 shutdown_connections 2023-07-21T22:53:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.749+0000 7f8248fff700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f822c0a1340 0x7f822c0a37f0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.749+0000 7f8248fff700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8244067c10 0x7f824410b890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.749+0000 7f8248fff700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8244104e50 0x7f8244199830 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.749+0000 7f8248fff700 1 --2- 172.21.15.151:0/3062758892 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82440685b0 0x7f824410bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.749+0000 7f8248fff700 1 -- 172.21.15.151:0/3062758892 >> 172.21.15.151:0/3062758892 conn(0x7f8244074760 msgr2=0x7f82440fc680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.749+0000 7f8248fff700 1 -- 172.21.15.151:0/3062758892 shutdown_connections 2023-07-21T22:53:02.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:02.749+0000 7f8248fff700 1 -- 172.21.15.151:0/3062758892 wait complete. 2023-07-21T22:53:02.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:02 smithi187 ceph-mon[96918]: pgmap v1074: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2023-07-21T22:53:02.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:02 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:02.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:02 smithi195 ceph-mon[97365]: pgmap v1074: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 500 KiB/s rd, 1.0 MiB/s wr, 67 op/s 2023-07-21T22:53:02.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:02 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:04.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 10.0 s, 391.6 tps, lat 412.584 ms stddev 1126.261 2023-07-21T22:53:04.694 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:04 smithi151 ceph-mon[95510]: pgmap v1075: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 181 op/s 2023-07-21T22:53:04.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:04 smithi187 ceph-mon[96918]: pgmap v1075: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 181 op/s 2023-07-21T22:53:04.899 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:04 smithi195 ceph-mon[97365]: pgmap v1075: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.0 MiB/s wr, 181 op/s 2023-07-21T22:53:05.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:05 smithi187 ceph-mon[96918]: osdmap e145: 12 total, 12 up, 12 in 2023-07-21T22:53:05.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:05 smithi195 ceph-mon[97365]: osdmap e145: 12 total, 12 up, 12 in 2023-07-21T22:53:05.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:05 smithi151 ceph-mon[95510]: osdmap e145: 12 total, 12 up, 12 in 2023-07-21T22:53:06.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:06 smithi187 ceph-mon[96918]: pgmap v1077: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 178 op/s 2023-07-21T22:53:06.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:06 smithi195 ceph-mon[97365]: pgmap v1077: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 178 op/s 2023-07-21T22:53:06.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:06 smithi151 ceph-mon[95510]: pgmap v1077: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.5 MiB/s wr, 178 op/s 2023-07-21T22:53:07.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:07 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:07.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:07 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:07.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:07 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:08.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:08 smithi187 ceph-mon[96918]: pgmap v1078: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 251 op/s 2023-07-21T22:53:08.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:08 smithi195 ceph-mon[97365]: pgmap v1078: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 251 op/s 2023-07-21T22:53:08.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:08 smithi151 ceph-mon[95510]: pgmap v1078: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 251 op/s 2023-07-21T22:53:09.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 15.0 s, 543.6 tps, lat 183.638 ms stddev 93.251 2023-07-21T22:53:10.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:10 smithi187 ceph-mon[96918]: pgmap v1079: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 251 op/s 2023-07-21T22:53:10.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:10 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:10.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:10 smithi195 ceph-mon[97365]: pgmap v1079: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 251 op/s 2023-07-21T22:53:10.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:10 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:10.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:10 smithi151 ceph-mon[95510]: pgmap v1079: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 251 op/s 2023-07-21T22:53:10.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:10 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:12.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:12 smithi187 ceph-mon[96918]: pgmap v1080: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 251 op/s 2023-07-21T22:53:12.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:12 smithi187 ceph-mon[96918]: osdmap e146: 12 total, 12 up, 12 in 2023-07-21T22:53:12.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:12 smithi195 ceph-mon[97365]: pgmap v1080: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 251 op/s 2023-07-21T22:53:12.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:12 smithi195 ceph-mon[97365]: osdmap e146: 12 total, 12 up, 12 in 2023-07-21T22:53:12.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:12 smithi151 ceph-mon[95510]: pgmap v1080: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 7.0 MiB/s wr, 251 op/s 2023-07-21T22:53:12.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:12 smithi151 ceph-mon[95510]: osdmap e146: 12 total, 12 up, 12 in 2023-07-21T22:53:14.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 20.0 s, 499.8 tps, lat 181.304 ms stddev 147.067 2023-07-21T22:53:14.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:14 smithi187 ceph-mon[96918]: pgmap v1082: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 11 MiB/s wr, 275 op/s 2023-07-21T22:53:14.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:14 smithi195 ceph-mon[97365]: pgmap v1082: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 11 MiB/s wr, 275 op/s 2023-07-21T22:53:14.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:14 smithi151 ceph-mon[95510]: pgmap v1082: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 11 MiB/s wr, 275 op/s 2023-07-21T22:53:15.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:15 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:15.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:15 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:15.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:15 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:53:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.974+0000 7f9bb49ff700 1 -- 172.21.15.151:0/3569047408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 msgr2=0x7f9bb010ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:16.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.974+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/3569047408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 0x7f9bb010ca00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8009fc0 tx=0x7f9ba800b330 comp rx=0 tx=0).stop 2023-07-21T22:53:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.974+0000 7f9bb49ff700 1 -- 172.21.15.151:0/3569047408 shutdown_connections 2023-07-21T22:53:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.974+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/3569047408 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 0x7f9bb010ca00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.974+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/3569047408 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bb0067c10 0x7f9bb0067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.974+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/3569047408 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bb00685b0 0x7f9bb0104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.974+0000 7f9bb49ff700 1 -- 172.21.15.151:0/3569047408 >> 172.21.15.151:0/3569047408 conn(0x7f9bb0074760 msgr2=0x7f9bb0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:16.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.974+0000 7f9bb49ff700 1 -- 172.21.15.151:0/3569047408 shutdown_connections 2023-07-21T22:53:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.974+0000 7f9bb49ff700 1 -- 172.21.15.151:0/3569047408 wait complete. 2023-07-21T22:53:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.976+0000 7f9bb49ff700 1 Processor -- start 2023-07-21T22:53:16.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.976+0000 7f9bb49ff700 1 -- start start 2023-07-21T22:53:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.976+0000 7f9bb49ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bb0067c10 0x7f9bb0071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.976+0000 7f9bb49ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bb00685b0 0x7f9bb00720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.976+0000 7f9bb49ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 0x7f9bb006aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.976+0000 7f9bb49ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb006b230 con 0x7f9bb0067c10 2023-07-21T22:53:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.976+0000 7f9bb49ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb006b3a0 con 0x7f9bb0104e50 2023-07-21T22:53:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.976+0000 7f9bb49ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bb006b560 con 0x7f9bb00685b0 2023-07-21T22:53:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.978+0000 7f9bae59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bb0067c10 0x7f9bb0071b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.978+0000 7f9baed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 0x7f9bb006aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.979+0000 7f9baed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 0x7f9bb006aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44654/0 (socket says 172.21.15.151:44654) 2023-07-21T22:53:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.979+0000 7f9baed9d700 1 -- 172.21.15.151:0/156151486 learned_addr learned my addr 172.21.15.151:0/156151486 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.979+0000 7f9baed9d700 1 -- 172.21.15.151:0/156151486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bb00685b0 msgr2=0x7f9bb00720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.979+0000 7f9baed9d700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bb00685b0 0x7f9bb00720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.979+0000 7f9baed9d700 1 -- 172.21.15.151:0/156151486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bb0067c10 msgr2=0x7f9bb0071b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.979+0000 7f9baed9d700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bb0067c10 0x7f9bb0071b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.979+0000 7f9baed9d700 1 -- 172.21.15.151:0/156151486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ba8009c40 con 0x7f9bb0104e50 2023-07-21T22:53:16.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.986+0000 7f9baed9d700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 0x7f9bb006aaa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8008ca0 tx=0x7f9ba8008d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.990+0000 7f9b9f7fe700 1 -- 172.21.15.151:0/156151486 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba800e040 con 0x7f9bb0104e50 2023-07-21T22:53:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.990+0000 7f9b9f7fe700 1 -- 172.21.15.151:0/156151486 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ba8004e90 con 0x7f9bb0104e50 2023-07-21T22:53:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.990+0000 7f9b9f7fe700 1 -- 172.21.15.151:0/156151486 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba80052a0 con 0x7f9bb0104e50 2023-07-21T22:53:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.990+0000 7f9bb49ff700 1 -- 172.21.15.151:0/156151486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bb006b7e0 con 0x7f9bb0104e50 2023-07-21T22:53:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.991+0000 7f9bb49ff700 1 -- 172.21.15.151:0/156151486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bb006f960 con 0x7f9bb0104e50 2023-07-21T22:53:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.996+0000 7f9b9f7fe700 1 -- 172.21.15.151:0/156151486 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f9ba801d470 con 0x7f9bb0104e50 2023-07-21T22:53:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.996+0000 7f9bc8303b80 1 Processor -- start 2023-07-21T22:53:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.996+0000 7f9bc8303b80 1 -- start start 2023-07-21T22:53:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.997+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 0x55954a41dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.997+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a417f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.997+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a4184a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.997+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a31dc50 con 0x55954a41e660 2023-07-21T22:53:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.997+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a3709e0 con 0x55954a41e210 2023-07-21T22:53:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.997+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a369e70 con 0x55954a2746b0 2023-07-21T22:53:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.998+0000 7f9badd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 0x55954a41dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.998+0000 7f9badd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 0x55954a41dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37336/0 (socket says 172.21.15.151:37336) 2023-07-21T22:53:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.998+0000 7f9badd9b700 1 -- 172.21.15.151:0/1103421802 learned_addr learned my addr 172.21.15.151:0/1103421802 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.998+0000 7f9bae59c700 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a417f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9badd9b700 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a4184a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9bae59c700 1 -- 172.21.15.151:0/1103421802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 msgr2=0x55954a41dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9bae59c700 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 0x55954a41dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9bae59c700 1 -- 172.21.15.151:0/1103421802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 msgr2=0x55954a4184a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9bae59c700 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a4184a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9bae59c700 1 -- 172.21.15.151:0/1103421802 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55954a197d80 con 0x55954a41e210 2023-07-21T22:53:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9b9f7fe700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a1490 0x7f9b980a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9b9f7fe700 1 -- 172.21.15.151:0/156151486 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9ba80ce170 con 0x7f9bb0104e50 2023-07-21T22:53:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9badd9b700 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a4184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:53:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:15.999+0000 7f9bae59c700 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a417f40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009cc0 tx=0x7f9ba0011440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daccab79faec7030 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.000+0000 7f9badd9b700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a1490 0x7f9b980a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.000+0000 7f9b9cff9700 1 -- 172.21.15.151:0/1103421802 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0011cf0 con 0x55954a41e210 2023-07-21T22:53:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.000+0000 7f9b9cff9700 1 -- 172.21.15.151:0/1103421802 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ba0011e50 con 0x55954a41e210 2023-07-21T22:53:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.000+0000 7f9b9cff9700 1 -- 172.21.15.151:0/1103421802 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0005280 con 0x55954a41e210 2023-07-21T22:53:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1103421802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 msgr2=0x55954a417f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a417f40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009cc0 tx=0x7f9ba0011440 comp rx=0 tx=0).stop 2023-07-21T22:53:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9badd9b700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a1490 0x7f9b980a3940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55954a41ea70 tx=0x7f9ba40058e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1103421802 shutdown_connections 2023-07-21T22:53:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a4184a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 0x55954a41dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1103421802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a417f40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1103421802 >> 172.21.15.151:0/1103421802 conn(0x55954a40dae0 msgr2=0x55954a4130e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1103421802 shutdown_connections 2023-07-21T22:53:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.001+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1103421802 wait complete. 2023-07-21T22:53:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.002+0000 7f9bc8303b80 1 -- start start 2023-07-21T22:53:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.002+0000 7f9bc8303b80 1 Processor -- start 2023-07-21T22:53:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.003+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 0x55954a424530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.003+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e210 0x55954a421820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.003+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e660 0x55954a421e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.003+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a309a60 con 0x55954a41e210 2023-07-21T22:53:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.003+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a309760 con 0x55954a41e660 2023-07-21T22:53:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.003+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a1ed8c0 con 0x55954a2746b0 2023-07-21T22:53:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.003+0000 7f9bc8303b80 10 client.0 _ll_register_callbacks cb 0x55954a307700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.004+0000 7f9baed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e660 0x55954a421e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.004+0000 7f9baed9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e660 0x55954a421e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44674/0 (socket says 172.21.15.151:44674) 2023-07-21T22:53:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.004+0000 7f9baed9d700 1 -- 172.21.15.151:0/846892330 learned_addr learned my addr 172.21.15.151:0/846892330 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.004+0000 7f9bae59c700 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 0x55954a424530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.004+0000 7f9baed9d700 1 -- 172.21.15.151:0/846892330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 msgr2=0x55954a424530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.004+0000 7f9baed9d700 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 0x55954a424530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.004+0000 7f9baed9d700 1 -- 172.21.15.151:0/846892330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e210 msgr2=0x55954a421820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.004+0000 7f9baed9d700 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e210 0x55954a421820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.004+0000 7f9baed9d700 1 -- 172.21.15.151:0/846892330 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba0009920 con 0x55954a41e660 2023-07-21T22:53:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.005+0000 7f9baed9d700 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e660 0x55954a421e50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80a3120 tx=0x7f9ba809abf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=461d73f056d8a1e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.005+0000 7f9b95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:53:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.006+0000 7f9b95ffb700 1 -- 172.21.15.151:0/846892330 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8095ea0 con 0x55954a41e660 2023-07-21T22:53:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.006+0000 7f9b95ffb700 1 -- 172.21.15.151:0/846892330 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9ba809b290 con 0x55954a41e660 2023-07-21T22:53:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.006+0000 7f9bc8303b80 1 -- 172.21.15.151:0/846892330 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55954a2c3490 con 0x55954a41e660 2023-07-21T22:53:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.006+0000 7f9b95ffb700 1 -- 172.21.15.151:0/846892330 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba80cbd00 con 0x55954a41e660 2023-07-21T22:53:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.006+0000 7f9bc8303b80 10 client.28709 fetch_fsmap learned FSMap version 105 2023-07-21T22:53:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.006+0000 7f9bc8303b80 1 -- 172.21.15.151:0/846892330 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55954a180c00 con 0x55954a41e660 2023-07-21T22:53:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.007+0000 7f9b95ffb700 1 -- 172.21.15.151:0/846892330 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ba80b8020 con 0x55954a41e660 2023-07-21T22:53:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.007+0000 7f9b95ffb700 1 -- 172.21.15.151:0/846892330 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f9ba809a780 con 0x55954a41e660 2023-07-21T22:53:16.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.007+0000 7f9bc8303b80 10 client.28709 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:53:16.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.007+0000 7f9bc8303b80 10 client.28709 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:16.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.007+0000 7f9bc8303b80 20 client.28709 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:16.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.007+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55954a4287c0 0x55954a42abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.007+0000 7f9bc8303b80 4 client.28709 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:53:16.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.007+0000 7f9bc8303b80 1 -- 172.21.15.151:0/846892330 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55954a362e50 con 0x55954a4287c0 2023-07-21T22:53:16.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.007+0000 7f9bae59c700 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55954a4287c0 0x55954a42abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.008+0000 7f9bae59c700 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55954a4287c0 0x55954a42abd0 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2d29e47b7e4018e server_cookie=54b65893cc0ab446 in_seq=0 out_seq=0 2023-07-21T22:53:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.008+0000 7f9b95ffb700 10 client.28709 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9b95ffb700 1 -- 172.21.15.151:0/846892330 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55954a362e50 con 0x55954a4287c0 2023-07-21T22:53:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9b95ffb700 10 client.28709 handle_command_reply: tid=0 2023-07-21T22:53:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9bc8303b80 1 client.28709 shutdown 2023-07-21T22:53:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9bc8303b80 1 -- 172.21.15.151:0/846892330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e660 msgr2=0x55954a421e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e660 0x55954a421e50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80a3120 tx=0x7f9ba809abf0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9bc8303b80 1 -- 172.21.15.151:0/846892330 shutdown_connections 2023-07-21T22:53:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55954a4287c0 0x55954a42abd0 crc :-1 s=READY pgs=403 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e660 0x55954a421e50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9b95ffb700 0 client.28709 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a2746b0 0x55954a424530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/846892330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e210 0x55954a421820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.009+0000 7f9bc8303b80 1 -- 172.21.15.151:0/846892330 >> 172.21.15.151:0/846892330 conn(0x55954a40dae0 msgr2=0x55954a4123e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.010+0000 7f9bc8303b80 1 -- 172.21.15.151:0/846892330 shutdown_connections 2023-07-21T22:53:16.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.010+0000 7f9bc8303b80 1 -- 172.21.15.151:0/846892330 wait complete. 2023-07-21T22:53:16.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.010+0000 7f9bc8303b80 20 client.28709 trim_cache size 0 max 16384 2023-07-21T22:53:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.038+0000 7f9bc8303b80 1 Processor -- start 2023-07-21T22:53:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.039+0000 7f9bc8303b80 1 -- start start 2023-07-21T22:53:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.039+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a2746b0 0x55954a41dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.039+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a42aba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.039+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e660 0x55954a41f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.039+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a41fd80 con 0x55954a2746b0 2023-07-21T22:53:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.039+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a41c460 con 0x55954a41e210 2023-07-21T22:53:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.039+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a41d880 con 0x55954a41e660 2023-07-21T22:53:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9badd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a42aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9baed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e660 0x55954a41f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9baed9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e660 0x55954a41f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37354/0 (socket says 172.21.15.151:37354) 2023-07-21T22:53:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9baed9d700 1 -- 172.21.15.151:0/2353912231 learned_addr learned my addr 172.21.15.151:0/2353912231 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:16.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9bae59c700 1 --2- 172.21.15.151:0/2353912231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a2746b0 0x55954a41dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9baed9d700 1 -- 172.21.15.151:0/2353912231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 msgr2=0x55954a42aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9baed9d700 1 --2- 172.21.15.151:0/2353912231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a42aba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9baed9d700 1 -- 172.21.15.151:0/2353912231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a2746b0 msgr2=0x55954a41dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9baed9d700 1 --2- 172.21.15.151:0/2353912231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a2746b0 0x55954a41dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9baed9d700 1 -- 172.21.15.151:0/2353912231 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55954a1be1f0 con 0x55954a41e660 2023-07-21T22:53:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.040+0000 7f9badd9b700 1 --2- 172.21.15.151:0/2353912231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a42aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:53:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.041+0000 7f9baed9d700 1 --2- 172.21.15.151:0/2353912231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e660 0x55954a41f330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80cbe80 tx=0x7f9ba801da20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ac4dba5794d8b73 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.041+0000 7f9b9d7fa700 1 -- 172.21.15.151:0/2353912231 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba8095ea0 con 0x55954a41e660 2023-07-21T22:53:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.041+0000 7f9b9d7fa700 1 -- 172.21.15.151:0/2353912231 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ba80b8070 con 0x55954a41e660 2023-07-21T22:53:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.041+0000 7f9b9d7fa700 1 -- 172.21.15.151:0/2353912231 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba809f2c0 con 0x55954a41e660 2023-07-21T22:53:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.042+0000 7f9bc8303b80 1 -- 172.21.15.151:0/2353912231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e660 msgr2=0x55954a41f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.042+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/2353912231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e660 0x55954a41f330 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9ba80cbe80 tx=0x7f9ba801da20 comp rx=0 tx=0).stop 2023-07-21T22:53:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.042+0000 7f9bc8303b80 1 -- 172.21.15.151:0/2353912231 shutdown_connections 2023-07-21T22:53:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.042+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/2353912231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e660 0x55954a41f330 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.042+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/2353912231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a2746b0 0x55954a41dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.042+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/2353912231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a41e210 0x55954a42aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.042+0000 7f9bc8303b80 1 -- 172.21.15.151:0/2353912231 >> 172.21.15.151:0/2353912231 conn(0x55954a40dae0 msgr2=0x55954a435cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.042+0000 7f9bc8303b80 1 -- 172.21.15.151:0/2353912231 shutdown_connections 2023-07-21T22:53:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.042+0000 7f9bc8303b80 1 -- 172.21.15.151:0/2353912231 wait complete. 2023-07-21T22:53:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.043+0000 7f9bc8303b80 1 -- start start 2023-07-21T22:53:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.043+0000 7f9bc8303b80 1 Processor -- start 2023-07-21T22:53:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a2746b0 0x55954a419730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e210 0x55954a419c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bc8303b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a41a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a41a8c0 con 0x55954a41e660 2023-07-21T22:53:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a41aa30 con 0x55954a2746b0 2023-07-21T22:53:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bc8303b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55954a41abf0 con 0x55954a41e210 2023-07-21T22:53:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bc8303b80 10 client.0 _ll_register_callbacks cb 0x7f9ba809b060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a2746b0 0x55954a419730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a2746b0 0x55954a419730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44682/0 (socket says 172.21.15.151:44682) 2023-07-21T22:53:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9bae59c700 1 -- 172.21.15.151:0/1727243802 learned_addr learned my addr 172.21.15.151:0/1727243802 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:16.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.044+0000 7f9badd9b700 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e210 0x55954a419c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9baed9d700 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a41a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9bae59c700 1 -- 172.21.15.151:0/1727243802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e210 msgr2=0x55954a419c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9bae59c700 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e210 0x55954a419c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9bae59c700 1 -- 172.21.15.151:0/1727243802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 msgr2=0x55954a41a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9bae59c700 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a41a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9bae59c700 1 -- 172.21.15.151:0/1727243802 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba4011c90 con 0x55954a2746b0 2023-07-21T22:53:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9badd9b700 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e210 0x55954a419c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:53:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9baed9d700 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a41a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:53:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9bae59c700 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a2746b0 0x55954a419730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009cc0 tx=0x7f9ba0005ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=887c9d2fb87715c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.045+0000 7f9b95ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:53:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.046+0000 7f9b95ffb700 1 -- 172.21.15.151:0/1727243802 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ba0011af0 con 0x55954a2746b0 2023-07-21T22:53:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.046+0000 7f9b95ffb700 1 -- 172.21.15.151:0/1727243802 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9ba0011c50 con 0x55954a2746b0 2023-07-21T22:53:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.046+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1727243802 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ba0011e50 con 0x55954a2746b0 2023-07-21T22:53:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.046+0000 7f9b95ffb700 1 -- 172.21.15.151:0/1727243802 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ba0004040 con 0x55954a2746b0 2023-07-21T22:53:16.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.047+0000 7f9bc8303b80 10 client.28715 fetch_fsmap learned FSMap version 105 2023-07-21T22:53:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.047+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1727243802 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55954a180c00 con 0x55954a2746b0 2023-07-21T22:53:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.048+0000 7f9b95ffb700 1 -- 172.21.15.151:0/1727243802 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ba0011e50 con 0x55954a2746b0 2023-07-21T22:53:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.048+0000 7f9b95ffb700 1 -- 172.21.15.151:0/1727243802 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f9ba0003b60 con 0x55954a2746b0 2023-07-21T22:53:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.048+0000 7f9bc8303b80 10 client.28715 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:53:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.048+0000 7f9bc8303b80 10 client.28715 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.048+0000 7f9bc8303b80 20 client.28715 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.048+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55954a497310 0x55954a499720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:16.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.048+0000 7f9bc8303b80 4 client.28715 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:53:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.048+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1727243802 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55954a324ff0 con 0x55954a497310 2023-07-21T22:53:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.048+0000 7f9badd9b700 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55954a497310 0x55954a499720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.049+0000 7f9badd9b700 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55954a497310 0x55954a499720 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92a4ccd13874cb06 server_cookie=255230ad58ab4296 in_seq=0 out_seq=0 2023-07-21T22:53:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.049+0000 7f9b95ffb700 10 client.28715 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.070+0000 7f9b95ffb700 1 -- 172.21.15.151:0/1727243802 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55954a324ff0 con 0x55954a497310 2023-07-21T22:53:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.070+0000 7f9b95ffb700 10 client.28715 handle_command_reply: tid=0 2023-07-21T22:53:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.070+0000 7f9bc8303b80 1 client.28715 shutdown 2023-07-21T22:53:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.070+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1727243802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a2746b0 msgr2=0x55954a419730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.070+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a2746b0 0x55954a419730 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9ba0009cc0 tx=0x7f9ba0005ef0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.071+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1727243802 shutdown_connections 2023-07-21T22:53:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.071+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55954a497310 0x55954a499720 crc :-1 s=READY pgs=404 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.071+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55954a2746b0 0x55954a419730 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.071+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55954a41e660 0x55954a41a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.071+0000 7f9b95ffb700 0 client.28715 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.071+0000 7f9bc8303b80 1 --2- 172.21.15.151:0/1727243802 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55954a41e210 0x55954a419c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.071+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1727243802 >> 172.21.15.151:0/1727243802 conn(0x55954a40dae0 msgr2=0x55954a41eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.071+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1727243802 shutdown_connections 2023-07-21T22:53:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.071+0000 7f9bc8303b80 1 -- 172.21.15.151:0/1727243802 wait complete. 2023-07-21T22:53:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.072+0000 7f9bc8303b80 20 client.28715 trim_cache size 0 max 16384 2023-07-21T22:53:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:53:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:53:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:53:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:53:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 -- 172.21.15.151:0/156151486 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a1490 msgr2=0x7f9b980a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a1490 0x7f9b980a3940 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55954a41ea70 tx=0x7f9ba40058e0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 -- 172.21.15.151:0/156151486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 msgr2=0x7f9bb006aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 0x7f9bb006aaa0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f9ba8008ca0 tx=0x7f9ba8008d80 comp rx=0 tx=0).stop 2023-07-21T22:53:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 -- 172.21.15.151:0/156151486 shutdown_connections 2023-07-21T22:53:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b980a1490 0x7f9b980a3940 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bb0104e50 0x7f9bb006aaa0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9bb0067c10 0x7f9bb0071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 --2- 172.21.15.151:0/156151486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9bb00685b0 0x7f9bb00720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 -- 172.21.15.151:0/156151486 >> 172.21.15.151:0/156151486 conn(0x7f9bb0074760 msgr2=0x7f9bb01036e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 -- 172.21.15.151:0/156151486 shutdown_connections 2023-07-21T22:53:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:16.073+0000 7f9bb49ff700 1 -- 172.21.15.151:0/156151486 wait complete. 2023-07-21T22:53:16.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:16 smithi187 ceph-mon[96918]: pgmap v1083: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 9.7 MiB/s wr, 245 op/s 2023-07-21T22:53:16.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:16 smithi195 ceph-mon[97365]: pgmap v1083: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 9.7 MiB/s wr, 245 op/s 2023-07-21T22:53:16.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:16 smithi151 ceph-mon[95510]: pgmap v1083: 97 pgs: 97 active+clean; 13 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 950 KiB/s rd, 9.7 MiB/s wr, 245 op/s 2023-07-21T22:53:18.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:17 smithi187 ceph-mon[96918]: pgmap v1084: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 8.2 MiB/s wr, 258 op/s 2023-07-21T22:53:18.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:17 smithi195 ceph-mon[97365]: pgmap v1084: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 8.2 MiB/s wr, 258 op/s 2023-07-21T22:53:18.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:17 smithi151 ceph-mon[95510]: pgmap v1084: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 8.2 MiB/s wr, 258 op/s 2023-07-21T22:53:19.291 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 25.0 s, 225.0 tps, lat 415.356 ms stddev 549.049 2023-07-21T22:53:20.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:20 smithi151 ceph-mon[95510]: pgmap v1085: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 8.2 MiB/s wr, 258 op/s 2023-07-21T22:53:20.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:20 smithi187 ceph-mon[96918]: pgmap v1085: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 8.2 MiB/s wr, 258 op/s 2023-07-21T22:53:20.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:20 smithi195 ceph-mon[97365]: pgmap v1085: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 8.2 MiB/s wr, 258 op/s 2023-07-21T22:53:22.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:22 smithi151 ceph-mon[95510]: pgmap v1086: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 8.2 MiB/s wr, 258 op/s 2023-07-21T22:53:22.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:22 smithi187 ceph-mon[96918]: pgmap v1086: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 8.2 MiB/s wr, 258 op/s 2023-07-21T22:53:22.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:22 smithi195 ceph-mon[97365]: pgmap v1086: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 8.2 MiB/s wr, 258 op/s 2023-07-21T22:53:24.292 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 30.0 s, 166.7 tps, lat 519.407 ms stddev 761.370 2023-07-21T22:53:24.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:24 smithi187 ceph-mon[96918]: pgmap v1087: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 9.7 MiB/s wr, 447 op/s 2023-07-21T22:53:24.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:24 smithi195 ceph-mon[97365]: pgmap v1087: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 9.7 MiB/s wr, 447 op/s 2023-07-21T22:53:24.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:24 smithi151 ceph-mon[95510]: pgmap v1087: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 874 KiB/s rd, 9.7 MiB/s wr, 447 op/s 2023-07-21T22:53:26.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:26 smithi187 ceph-mon[96918]: pgmap v1088: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 5.3 MiB/s wr, 325 op/s 2023-07-21T22:53:26.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:26 smithi195 ceph-mon[97365]: pgmap v1088: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 5.3 MiB/s wr, 325 op/s 2023-07-21T22:53:26.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:26 smithi151 ceph-mon[95510]: pgmap v1088: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 442 KiB/s rd, 5.3 MiB/s wr, 325 op/s 2023-07-21T22:53:28.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:27 smithi187 ceph-mon[96918]: pgmap v1089: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 8.7 MiB/s wr, 623 op/s 2023-07-21T22:53:28.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:27 smithi195 ceph-mon[97365]: pgmap v1089: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 8.7 MiB/s wr, 623 op/s 2023-07-21T22:53:28.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:27 smithi151 ceph-mon[95510]: pgmap v1089: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 580 KiB/s rd, 8.7 MiB/s wr, 623 op/s 2023-07-21T22:53:29.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 35.0 s, 229.7 tps, lat 549.819 ms stddev 1423.198 2023-07-21T22:53:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.366+0000 7f0ee67ff700 1 -- 172.21.15.151:0/1907553254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ee006d3a0 msgr2=0x7f0ee011b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:29.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.366+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/1907553254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ee006d3a0 0x7f0ee011b470 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f0ed0009990 tx=0x7f0ed0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.367+0000 7f0ee67ff700 1 -- 172.21.15.151:0/1907553254 shutdown_connections 2023-07-21T22:53:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.367+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/1907553254 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ee006d3a0 0x7f0ee011b470 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.367+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/1907553254 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee010e2a0 0x7f0ee010e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.367+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/1907553254 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ee006c910 0x7f0ee006cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.367+0000 7f0ee67ff700 1 -- 172.21.15.151:0/1907553254 >> 172.21.15.151:0/1907553254 conn(0x7f0ee006bd70 msgr2=0x7f0ee0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:29.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.385+0000 7f0ee67ff700 1 -- 172.21.15.151:0/1907553254 shutdown_connections 2023-07-21T22:53:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.389+0000 7f0ee67ff700 1 -- 172.21.15.151:0/1907553254 wait complete. 2023-07-21T22:53:29.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.391+0000 7f0ee67ff700 1 Processor -- start 2023-07-21T22:53:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.391+0000 7f0ee67ff700 1 -- start start 2023-07-21T22:53:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.392+0000 7f0ee67ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ee006c910 0x7f0ee01aaa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.392+0000 7f0ee67ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee006d3a0 0x7f0ee01aafd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.392+0000 7f0ee67ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ee010e2a0 0x7f0ee01a48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.392+0000 7f0ee67ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01a4f60 con 0x7f0ee006c910 2023-07-21T22:53:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.392+0000 7f0ee67ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01a50d0 con 0x7f0ee010e2a0 2023-07-21T22:53:29.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.392+0000 7f0ee67ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ee01a5290 con 0x7f0ee006d3a0 2023-07-21T22:53:29.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.393+0000 7f0edf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee006d3a0 0x7f0ee01aafd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.393+0000 7f0edf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee006d3a0 0x7f0ee01aafd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43786/0 (socket says 172.21.15.151:43786) 2023-07-21T22:53:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.393+0000 7f0edf7fe700 1 -- 172.21.15.151:0/3396553376 learned_addr learned my addr 172.21.15.151:0/3396553376 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.393+0000 7f0ee4d9c700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ee010e2a0 0x7f0ee01a48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.394+0000 7f0edf7fe700 1 -- 172.21.15.151:0/3396553376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ee010e2a0 msgr2=0x7f0ee01a48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:29.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.394+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ee010e2a0 0x7f0ee01a48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.394+0000 7f0edf7fe700 1 -- 172.21.15.151:0/3396553376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ee006c910 msgr2=0x7f0ee01aaa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.394+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ee006c910 0x7f0ee01aaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.394+0000 7f0edf7fe700 1 -- 172.21.15.151:0/3396553376 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ed00095f0 con 0x7f0ee006d3a0 2023-07-21T22:53:29.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.404+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee006d3a0 0x7f0ee01aafd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800ba50 tx=0x7f0ed800be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:29.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.411+0000 7f0edd7fa700 1 -- 172.21.15.151:0/3396553376 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed800cab0 con 0x7f0ee006d3a0 2023-07-21T22:53:29.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.411+0000 7f0edd7fa700 1 -- 172.21.15.151:0/3396553376 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ed800cc10 con 0x7f0ee006d3a0 2023-07-21T22:53:29.450 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.411+0000 7f0edd7fa700 1 -- 172.21.15.151:0/3396553376 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80075b0 con 0x7f0ee006d3a0 2023-07-21T22:53:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.420+0000 7f0ee67ff700 1 -- 172.21.15.151:0/3396553376 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ee01a5570 con 0x7f0ee006d3a0 2023-07-21T22:53:29.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.420+0000 7f0ee67ff700 1 -- 172.21.15.151:0/3396553376 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee010ee20 con 0x7f0ee006d3a0 2023-07-21T22:53:29.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.428+0000 7f0efa213b80 1 Processor -- start 2023-07-21T22:53:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.429+0000 7f0efa213b80 1 -- start start 2023-07-21T22:53:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.429+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d262104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.429+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2620fef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.429+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d2620ff4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.429+0000 7f0efa213b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d262004c50 con 0x55d261f5b6b0 2023-07-21T22:53:29.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.429+0000 7f0efa213b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2620579e0 con 0x55d262105210 2023-07-21T22:53:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.429+0000 7f0efa213b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d262050e70 con 0x55d262105660 2023-07-21T22:53:29.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.430+0000 7f0edffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2620fef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.430+0000 7f0edffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2620fef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:59690/0 (socket says 172.21.15.151:59690) 2023-07-21T22:53:29.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.430+0000 7f0edffff700 1 -- 172.21.15.151:0/4069024997 learned_addr learned my addr 172.21.15.151:0/4069024997 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:29.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.434+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/4069024997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d2620ff4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.436+0000 7f0edffff700 1 -- 172.21.15.151:0/4069024997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 msgr2=0x55d2620ff4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.436+0000 7f0edffff700 1 --2- 172.21.15.151:0/4069024997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d2620ff4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.436+0000 7f0edffff700 1 -- 172.21.15.151:0/4069024997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 msgr2=0x55d262104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.436+0000 7f0edffff700 1 --2- 172.21.15.151:0/4069024997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d262104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.436+0000 7f0edffff700 1 -- 172.21.15.151:0/4069024997 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d261e7ed80 con 0x55d262105210 2023-07-21T22:53:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.437+0000 7f0edffff700 1 --2- 172.21.15.151:0/4069024997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2620fef40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009870 tx=0x7f0ed4009b80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72ea3f2e960ccd0f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:29.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.437+0000 7f0edd7fa700 1 -- 172.21.15.151:0/3396553376 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0ed8014440 con 0x7f0ee006d3a0 2023-07-21T22:53:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.440+0000 7f0edd7fa700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0ec80a1400 0x7f0ec80a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.440+0000 7f0edd7fa700 1 -- 172.21.15.151:0/3396553376 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0ed80cc6e0 con 0x7f0ee006d3a0 2023-07-21T22:53:29.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.441+0000 7f0ec67fc700 1 -- 172.21.15.151:0/4069024997 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed4011830 con 0x55d262105210 2023-07-21T22:53:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.441+0000 7f0ec67fc700 1 -- 172.21.15.151:0/4069024997 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ed4011e20 con 0x55d262105210 2023-07-21T22:53:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.441+0000 7f0ec67fc700 1 -- 172.21.15.151:0/4069024997 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed400be30 con 0x55d262105210 2023-07-21T22:53:29.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.442+0000 7f0ee4d9c700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0ec80a1400 0x7f0ec80a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.442+0000 7f0efa213b80 1 -- 172.21.15.151:0/4069024997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 msgr2=0x55d2620fef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:29.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.442+0000 7f0efa213b80 1 --2- 172.21.15.151:0/4069024997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2620fef40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4009870 tx=0x7f0ed4009b80 comp rx=0 tx=0).stop 2023-07-21T22:53:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.444+0000 7f0efa213b80 1 -- 172.21.15.151:0/4069024997 shutdown_connections 2023-07-21T22:53:29.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.444+0000 7f0efa213b80 1 --2- 172.21.15.151:0/4069024997 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d2620ff4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.444+0000 7f0efa213b80 1 --2- 172.21.15.151:0/4069024997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d262104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.444+0000 7f0efa213b80 1 --2- 172.21.15.151:0/4069024997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2620fef40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.444+0000 7f0efa213b80 1 -- 172.21.15.151:0/4069024997 >> 172.21.15.151:0/4069024997 conn(0x55d2620f4ae0 msgr2=0x55d2620fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:29.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.445+0000 7f0efa213b80 1 -- 172.21.15.151:0/4069024997 shutdown_connections 2023-07-21T22:53:29.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.446+0000 7f0efa213b80 1 -- 172.21.15.151:0/4069024997 wait complete. 2023-07-21T22:53:29.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.446+0000 7f0efa213b80 1 -- start start 2023-07-21T22:53:29.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.447+0000 7f0efa213b80 1 Processor -- start 2023-07-21T22:53:29.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.449+0000 7f0ee4d9c700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0ec80a1400 0x7f0ec80a38b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0ee01ab790 tx=0x7f0ed000b540 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d26210b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d262108900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d262109040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0efa213b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d261ff0a60 con 0x55d261f5b6b0 2023-07-21T22:53:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0efa213b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d261ff0760 con 0x55d262105210 2023-07-21T22:53:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0efa213b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d261ed48c0 con 0x55d262105660 2023-07-21T22:53:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0efa213b80 10 client.0 _ll_register_callbacks cb 0x55d261fee700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:29.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0ee4d9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d262109040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0ee4d9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d262109040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43798/0 (socket says 172.21.15.151:43798) 2023-07-21T22:53:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.450+0000 7f0ee4d9c700 1 -- 172.21.15.151:0/2618949299 learned_addr learned my addr 172.21.15.151:0/2618949299 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.451+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d262108900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.451+0000 7f0edffff700 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d26210b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.451+0000 7f0ee4d9c700 1 -- 172.21.15.151:0/2618949299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 msgr2=0x55d262108900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.451+0000 7f0ee4d9c700 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d262108900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.451+0000 7f0ee4d9c700 1 -- 172.21.15.151:0/2618949299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 msgr2=0x55d26210b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.451+0000 7f0ee4d9c700 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d26210b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.451+0000 7f0ee4d9c700 1 -- 172.21.15.151:0/2618949299 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ed40094a0 con 0x55d262105660 2023-07-21T22:53:29.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.452+0000 7f0ee4d9c700 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d262109040 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000ba50 tx=0x7f0ed0009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73999ac20499c0e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.452+0000 7f0ebf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:53:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.452+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/2618949299 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed002b070 con 0x55d262105660 2023-07-21T22:53:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.453+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/2618949299 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0ed0003ad0 con 0x55d262105660 2023-07-21T22:53:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.453+0000 7f0efa213b80 1 -- 172.21.15.151:0/2618949299 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d261faa490 con 0x55d262105660 2023-07-21T22:53:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.453+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/2618949299 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ed0009ee0 con 0x55d262105660 2023-07-21T22:53:29.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.453+0000 7f0efa213b80 10 client.28747 fetch_fsmap learned FSMap version 105 2023-07-21T22:53:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.453+0000 7f0efa213b80 1 -- 172.21.15.151:0/2618949299 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55d261e67c00 con 0x55d262105660 2023-07-21T22:53:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.454+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/2618949299 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d261faa490 con 0x55d262105660 2023-07-21T22:53:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.454+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/2618949299 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0ed0037070 con 0x55d262105660 2023-07-21T22:53:29.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.454+0000 7f0efa213b80 10 client.28747 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:53:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.454+0000 7f0efa213b80 10 client.28747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.454+0000 7f0efa213b80 20 client.28747 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.454+0000 7f0efa213b80 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d262118aa0 0x55d26211aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.454+0000 7f0efa213b80 4 client.28747 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:53:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.454+0000 7f0efa213b80 1 -- 172.21.15.151:0/2618949299 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d262049e50 con 0x55d262118aa0 2023-07-21T22:53:29.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.455+0000 7f0edffff700 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d262118aa0 0x55d26211aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.456+0000 7f0ebf7fe700 10 client.28747 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.456+0000 7f0edffff700 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d262118aa0 0x55d26211aeb0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f1207d78d39cf973 server_cookie=43f55de5b3fae125 in_seq=0 out_seq=0 2023-07-21T22:53:29.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.457+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/2618949299 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d262049e50 con 0x55d262118aa0 2023-07-21T22:53:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.457+0000 7f0ebf7fe700 10 client.28747 handle_command_reply: tid=0 2023-07-21T22:53:29.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.457+0000 7f0efa213b80 1 client.28747 shutdown 2023-07-21T22:53:29.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.459+0000 7f0efa213b80 1 -- 172.21.15.151:0/2618949299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 msgr2=0x55d262109040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:29.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.459+0000 7f0efa213b80 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d262109040 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f0ed000ba50 tx=0x7f0ed0009ca0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.460+0000 7f0efa213b80 1 -- 172.21.15.151:0/2618949299 shutdown_connections 2023-07-21T22:53:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.460+0000 7f0efa213b80 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d262118aa0 0x55d26211aeb0 crc :-1 s=READY pgs=405 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.460+0000 7f0efa213b80 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105660 0x55d262109040 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.460+0000 7f0efa213b80 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d26210b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.460+0000 7f0efa213b80 1 --2- 172.21.15.151:0/2618949299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d262108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.460+0000 7f0efa213b80 1 -- 172.21.15.151:0/2618949299 >> 172.21.15.151:0/2618949299 conn(0x55d2620f4ae0 msgr2=0x55d2620f93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:29.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.460+0000 7f0ebf7fe700 0 client.28747 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:29.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.460+0000 7f0efa213b80 1 -- 172.21.15.151:0/2618949299 shutdown_connections 2023-07-21T22:53:29.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.460+0000 7f0efa213b80 1 -- 172.21.15.151:0/2618949299 wait complete. 2023-07-21T22:53:29.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.461+0000 7f0efa213b80 20 client.28747 trim_cache size 0 max 16384 2023-07-21T22:53:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.487+0000 7f0efa213b80 1 Processor -- start 2023-07-21T22:53:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.487+0000 7f0efa213b80 1 -- start start 2023-07-21T22:53:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d2620fef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105210 0x55d26210fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105660 0x55d2620f9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0efa213b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2620ff8a0 con 0x55d261f5b6b0 2023-07-21T22:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0efa213b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d262049e50 con 0x55d262105660 2023-07-21T22:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0efa213b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d261faa490 con 0x55d262105210 2023-07-21T22:53:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0edf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105210 0x55d26210fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0edffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d2620fef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0edf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105210 0x55d26210fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43800/0 (socket says 172.21.15.151:43800) 2023-07-21T22:53:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.488+0000 7f0edf7fe700 1 -- 172.21.15.151:0/799166227 learned_addr learned my addr 172.21.15.151:0/799166227 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.489+0000 7f0ee4d9c700 1 --2- 172.21.15.151:0/799166227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105660 0x55d2620f9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.489+0000 7f0edf7fe700 1 -- 172.21.15.151:0/799166227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105660 msgr2=0x55d2620f9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.489+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/799166227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105660 0x55d2620f9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.489+0000 7f0edf7fe700 1 -- 172.21.15.151:0/799166227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 msgr2=0x55d2620fef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:29.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.489+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/799166227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d2620fef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.489+0000 7f0edf7fe700 1 -- 172.21.15.151:0/799166227 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d261ea51f0 con 0x55d262105210 2023-07-21T22:53:29.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.489+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/799166227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105210 0x55d26210fba0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8095d80 tx=0x7f0ed8095c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c2cf011040f55 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.490+0000 7f0ec6ffd700 1 -- 172.21.15.151:0/799166227 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80991e0 con 0x55d262105210 2023-07-21T22:53:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.490+0000 7f0ec6ffd700 1 -- 172.21.15.151:0/799166227 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ed8099880 con 0x55d262105210 2023-07-21T22:53:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.490+0000 7f0ec6ffd700 1 -- 172.21.15.151:0/799166227 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed80ca070 con 0x55d262105210 2023-07-21T22:53:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.491+0000 7f0efa213b80 1 -- 172.21.15.151:0/799166227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105210 msgr2=0x55d26210fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.491+0000 7f0efa213b80 1 --2- 172.21.15.151:0/799166227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105210 0x55d26210fba0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0ed8095d80 tx=0x7f0ed8095c90 comp rx=0 tx=0).stop 2023-07-21T22:53:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.491+0000 7f0efa213b80 1 -- 172.21.15.151:0/799166227 shutdown_connections 2023-07-21T22:53:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.491+0000 7f0efa213b80 1 --2- 172.21.15.151:0/799166227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105660 0x55d2620f9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.491+0000 7f0efa213b80 1 --2- 172.21.15.151:0/799166227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d261f5b6b0 0x55d2620fef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.491+0000 7f0efa213b80 1 --2- 172.21.15.151:0/799166227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d262105210 0x55d26210fba0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.491+0000 7f0efa213b80 1 -- 172.21.15.151:0/799166227 >> 172.21.15.151:0/799166227 conn(0x55d2620f4ae0 msgr2=0x55d2621029d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.491+0000 7f0efa213b80 1 -- 172.21.15.151:0/799166227 shutdown_connections 2023-07-21T22:53:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.492+0000 7f0efa213b80 1 -- 172.21.15.151:0/799166227 wait complete. 2023-07-21T22:53:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.492+0000 7f0efa213b80 1 -- start start 2023-07-21T22:53:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.492+0000 7f0efa213b80 1 Processor -- start 2023-07-21T22:53:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.493+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d261f5b6b0 0x55d26210fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.493+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2621007f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.493+0000 7f0efa213b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d262105660 0x55d262100d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.493+0000 7f0efa213b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d262101270 con 0x55d262105660 2023-07-21T22:53:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.493+0000 7f0efa213b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2621013e0 con 0x55d262105210 2023-07-21T22:53:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.493+0000 7f0efa213b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d2621015a0 con 0x55d261f5b6b0 2023-07-21T22:53:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.493+0000 7f0efa213b80 10 client.0 _ll_register_callbacks cb 0x7f0ed0005630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.494+0000 7f0edffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d261f5b6b0 0x55d26210fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.494+0000 7f0edffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d261f5b6b0 0x55d26210fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43816/0 (socket says 172.21.15.151:43816) 2023-07-21T22:53:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.494+0000 7f0edffff700 1 -- 172.21.15.151:0/226869261 learned_addr learned my addr 172.21.15.151:0/226869261 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.494+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2621007f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.494+0000 7f0ee4d9c700 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d262105660 0x55d262100d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.494+0000 7f0edffff700 1 -- 172.21.15.151:0/226869261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 msgr2=0x55d2621007f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.494+0000 7f0edffff700 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2621007f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.495+0000 7f0edffff700 1 -- 172.21.15.151:0/226869261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d262105660 msgr2=0x55d262100d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.495+0000 7f0edffff700 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d262105660 0x55d262100d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.495+0000 7f0edffff700 1 -- 172.21.15.151:0/226869261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ee010ee20 con 0x55d261f5b6b0 2023-07-21T22:53:29.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.495+0000 7f0ee4d9c700 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d262105660 0x55d262100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:53:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.495+0000 7f0edffff700 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d261f5b6b0 0x55d26210fbb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4006b50 tx=0x7f0ed4011f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=146a82a367a3c45b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.495+0000 7f0ebf7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:53:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.495+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/226869261 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ed401f040 con 0x55d261f5b6b0 2023-07-21T22:53:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.495+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/226869261 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0ed4025230 con 0x55d261f5b6b0 2023-07-21T22:53:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.495+0000 7f0efa213b80 1 -- 172.21.15.151:0/226869261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ed4011e20 con 0x55d261f5b6b0 2023-07-21T22:53:29.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/226869261 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ed40253f0 con 0x55d261f5b6b0 2023-07-21T22:53:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0efa213b80 10 client.28753 fetch_fsmap learned FSMap version 105 2023-07-21T22:53:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0efa213b80 1 -- 172.21.15.151:0/226869261 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55d261e7d250 con 0x55d261f5b6b0 2023-07-21T22:53:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/226869261 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ed4011e20 con 0x55d261f5b6b0 2023-07-21T22:53:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/226869261 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0ed401a600 con 0x55d261f5b6b0 2023-07-21T22:53:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0efa213b80 10 client.28753 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:53:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0efa213b80 10 client.28753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:29.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0efa213b80 20 client.28753 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0efa213b80 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d26216dd70 0x55d262170180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0efa213b80 4 client.28753 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:53:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.496+0000 7f0efa213b80 1 -- 172.21.15.151:0/226869261 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d26200bff0 con 0x55d26216dd70 2023-07-21T22:53:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.497+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d26216dd70 0x55d262170180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:29.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.497+0000 7f0ebf7fe700 10 client.28753 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:29.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.497+0000 7f0edf7fe700 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d26216dd70 0x55d262170180 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bee8bcda47ed37ad server_cookie=59ea2e37d3596704 in_seq=0 out_seq=0 2023-07-21T22:53:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0ebf7fe700 1 -- 172.21.15.151:0/226869261 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d26200bff0 con 0x55d26216dd70 2023-07-21T22:53:29.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0ebf7fe700 10 client.28753 handle_command_reply: tid=0 2023-07-21T22:53:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0efa213b80 1 client.28753 shutdown 2023-07-21T22:53:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0efa213b80 1 -- 172.21.15.151:0/226869261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d261f5b6b0 msgr2=0x55d26210fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0efa213b80 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d261f5b6b0 0x55d26210fbb0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0ed4006b50 tx=0x7f0ed4011f90 comp rx=0 tx=0).stop 2023-07-21T22:53:29.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0efa213b80 1 -- 172.21.15.151:0/226869261 shutdown_connections 2023-07-21T22:53:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0efa213b80 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d26216dd70 0x55d262170180 crc :-1 s=READY pgs=406 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0efa213b80 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d262105660 0x55d262100d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0efa213b80 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d261f5b6b0 0x55d26210fbb0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0efa213b80 1 --2- 172.21.15.151:0/226869261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d262105210 0x55d2621007f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0efa213b80 1 -- 172.21.15.151:0/226869261 >> 172.21.15.151:0/226869261 conn(0x55d2620f4ae0 msgr2=0x55d26210a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.509+0000 7f0ebf7fe700 0 client.28753 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:29.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.510+0000 7f0efa213b80 1 -- 172.21.15.151:0/226869261 shutdown_connections 2023-07-21T22:53:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.510+0000 7f0efa213b80 1 -- 172.21.15.151:0/226869261 wait complete. 2023-07-21T22:53:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.510+0000 7f0efa213b80 20 client.28753 trim_cache size 0 max 16384 2023-07-21T22:53:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:53:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:53:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:53:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:53:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 -- 172.21.15.151:0/3396553376 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0ec80a1400 msgr2=0x7f0ec80a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0ec80a1400 0x7f0ec80a38b0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0ee01ab790 tx=0x7f0ed000b540 comp rx=0 tx=0).stop 2023-07-21T22:53:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 -- 172.21.15.151:0/3396553376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee006d3a0 msgr2=0x7f0ee01aafd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee006d3a0 0x7f0ee01aafd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f0ed800ba50 tx=0x7f0ed800be10 comp rx=0 tx=0).stop 2023-07-21T22:53:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 -- 172.21.15.151:0/3396553376 shutdown_connections 2023-07-21T22:53:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0ec80a1400 0x7f0ec80a38b0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ee010e2a0 0x7f0ee01a48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ee006c910 0x7f0ee01aaa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 --2- 172.21.15.151:0/3396553376 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ee006d3a0 0x7f0ee01aafd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 -- 172.21.15.151:0/3396553376 >> 172.21.15.151:0/3396553376 conn(0x7f0ee006bd70 msgr2=0x7f0ee006f260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 -- 172.21.15.151:0/3396553376 shutdown_connections 2023-07-21T22:53:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:29.511+0000 7f0ee67ff700 1 -- 172.21.15.151:0/3396553376 wait complete. 2023-07-21T22:53:30.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:30 smithi187 ceph-mon[96918]: pgmap v1090: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 6.0 MiB/s wr, 514 op/s 2023-07-21T22:53:30.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:30 smithi195 ceph-mon[97365]: pgmap v1090: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 6.0 MiB/s wr, 514 op/s 2023-07-21T22:53:30.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:30 smithi151 ceph-mon[95510]: pgmap v1090: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 6.0 MiB/s wr, 514 op/s 2023-07-21T22:53:32.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:32 smithi187 ceph-mon[96918]: pgmap v1091: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 6.0 MiB/s wr, 514 op/s 2023-07-21T22:53:32.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:32 smithi195 ceph-mon[97365]: pgmap v1091: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 6.0 MiB/s wr, 514 op/s 2023-07-21T22:53:32.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:32 smithi151 ceph-mon[95510]: pgmap v1091: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 296 KiB/s rd, 6.0 MiB/s wr, 514 op/s 2023-07-21T22:53:33.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:33 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:53:33.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:33 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:53:33.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:33 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:53:34.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 40.0 s, 453.2 tps, lat 226.018 ms stddev 100.748 2023-07-21T22:53:34.872 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:34 smithi187 ceph-mon[96918]: pgmap v1092: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 11 MiB/s wr, 876 op/s 2023-07-21T22:53:34.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:34 smithi195 ceph-mon[97365]: pgmap v1092: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 11 MiB/s wr, 876 op/s 2023-07-21T22:53:34.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:34 smithi151 ceph-mon[95510]: pgmap v1092: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 545 KiB/s rd, 11 MiB/s wr, 876 op/s 2023-07-21T22:53:35.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:35 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:53:35.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:35 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:53:35.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:35 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:53:35.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:35 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:53:35.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:35 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:53:35.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:35 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:53:35.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:35 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:53:35.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:35 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:53:35.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:35 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:53:36.871 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:36 smithi187 ceph-mon[96918]: pgmap v1093: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 8.2 MiB/s wr, 658 op/s 2023-07-21T22:53:37.331 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:36 smithi151 ceph-mon[95510]: pgmap v1093: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 8.2 MiB/s wr, 658 op/s 2023-07-21T22:53:37.332 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:36 smithi195 ceph-mon[97365]: pgmap v1093: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 8.2 MiB/s wr, 658 op/s 2023-07-21T22:53:38.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:37 smithi187 ceph-mon[96918]: pgmap v1094: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2023-07-21T22:53:38.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:37 smithi195 ceph-mon[97365]: pgmap v1094: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2023-07-21T22:53:38.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:37 smithi151 ceph-mon[95510]: pgmap v1094: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 701 KiB/s rd, 13 MiB/s wr, 1.03k op/s 2023-07-21T22:53:39.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 45.0 s, 385.6 tps, lat 259.542 ms stddev 92.437 2023-07-21T22:53:40.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:40 smithi151 ceph-mon[95510]: pgmap v1095: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 9.8 MiB/s wr, 730 op/s 2023-07-21T22:53:40.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:40 smithi187 ceph-mon[96918]: pgmap v1095: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 9.8 MiB/s wr, 730 op/s 2023-07-21T22:53:40.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:40 smithi195 ceph-mon[97365]: pgmap v1095: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 9.8 MiB/s wr, 730 op/s 2023-07-21T22:53:42.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:42 smithi151 ceph-mon[95510]: pgmap v1096: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 9.8 MiB/s wr, 731 op/s 2023-07-21T22:53:42.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:42 smithi187 ceph-mon[96918]: pgmap v1096: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 9.8 MiB/s wr, 731 op/s 2023-07-21T22:53:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.856+0000 7f0fa79ff700 1 -- 172.21.15.151:0/3830302939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fa0100db0 msgr2=0x7f0fa0101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:42.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.856+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/3830302939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fa0100db0 0x7f0fa0101180 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009990 tx=0x7f0f9c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.857+0000 7f0fa79ff700 1 -- 172.21.15.151:0/3830302939 shutdown_connections 2023-07-21T22:53:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.857+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/3830302939 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa010a180 0x7f0fa010c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.857+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/3830302939 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fa0100db0 0x7f0fa0101180 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.857+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/3830302939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa01016c0 0x7f0fa0109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.857+0000 7f0fa79ff700 1 -- 172.21.15.151:0/3830302939 >> 172.21.15.151:0/3830302939 conn(0x7f0fa0075bd0 msgr2=0x7f0fa0075fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:42.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.857+0000 7f0fa79ff700 1 -- 172.21.15.151:0/3830302939 shutdown_connections 2023-07-21T22:53:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.858+0000 7f0fa79ff700 1 -- 172.21.15.151:0/3830302939 wait complete. 2023-07-21T22:53:42.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.859+0000 7f0fa79ff700 1 Processor -- start 2023-07-21T22:53:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.859+0000 7f0fa79ff700 1 -- start start 2023-07-21T22:53:42.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.860+0000 7f0fa79ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0100db0 0x7f0fa019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.860+0000 7f0fa79ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fa01016c0 0x7f0fa019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.860+0000 7f0fa79ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa010a180 0x7f0fa01088a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.860+0000 7f0fa79ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa0109070 con 0x7f0fa010a180 2023-07-21T22:53:42.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.860+0000 7f0fa79ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa01091b0 con 0x7f0fa0100db0 2023-07-21T22:53:42.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.860+0000 7f0fa79ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa0109370 con 0x7f0fa01016c0 2023-07-21T22:53:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.860+0000 7f0fa579b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0100db0 0x7f0fa019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.860+0000 7f0fa579b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0100db0 0x7f0fa019cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49734/0 (socket says 172.21.15.151:49734) 2023-07-21T22:53:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.861+0000 7f0fa579b700 1 -- 172.21.15.151:0/82550239 learned_addr learned my addr 172.21.15.151:0/82550239 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.861+0000 7f0fa579b700 1 -- 172.21.15.151:0/82550239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fa01016c0 msgr2=0x7f0fa019d010 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:53:42.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.861+0000 7f0fa579b700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fa01016c0 0x7f0fa019d010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.861+0000 7f0fa579b700 1 -- 172.21.15.151:0/82550239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa010a180 msgr2=0x7f0fa01088a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.861+0000 7f0fa579b700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa010a180 0x7f0fa01088a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.861+0000 7f0fa579b700 1 -- 172.21.15.151:0/82550239 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c0095f0 con 0x7f0fa0100db0 2023-07-21T22:53:42.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:42 smithi195 ceph-mon[97365]: pgmap v1096: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 564 KiB/s rd, 9.8 MiB/s wr, 731 op/s 2023-07-21T22:53:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.862+0000 7f0fa579b700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0100db0 0x7f0fa019cad0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0036c0 tx=0x7f0f9c0057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.862+0000 7f0f967fc700 1 -- 172.21.15.151:0/82550239 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c01d070 con 0x7f0fa0100db0 2023-07-21T22:53:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.862+0000 7f0f967fc700 1 -- 172.21.15.151:0/82550239 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f9c003fc0 con 0x7f0fa0100db0 2023-07-21T22:53:42.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.862+0000 7f0f967fc700 1 -- 172.21.15.151:0/82550239 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c022ca0 con 0x7f0fa0100db0 2023-07-21T22:53:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.862+0000 7f0fa79ff700 1 -- 172.21.15.151:0/82550239 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fa01095f0 con 0x7f0fa0100db0 2023-07-21T22:53:42.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.863+0000 7f0fa79ff700 1 -- 172.21.15.151:0/82550239 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa01997e0 con 0x7f0fa0100db0 2023-07-21T22:53:42.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.869+0000 7f0fbb2f5b80 1 Processor -- start 2023-07-21T22:53:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.872+0000 7f0fbb2f5b80 1 -- start start 2023-07-21T22:53:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.872+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 0x55c7fac30cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.873+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31210 0x55c7fac2af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.873+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31660 0x55c7fac2b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.873+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fab30c50 con 0x55c7fac31660 2023-07-21T22:53:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.873+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fab839e0 con 0x55c7fac31210 2023-07-21T22:53:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.873+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fab7ce70 con 0x55c7faa876b0 2023-07-21T22:53:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.873+0000 7f0f967fc700 1 -- 172.21.15.151:0/82550239 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0f9c022470 con 0x7f0fa0100db0 2023-07-21T22:53:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.873+0000 7f0fa579b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31210 0x55c7fac2af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.873+0000 7f0fa579b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31210 0x55c7fac2af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49746/0 (socket says 172.21.15.151:49746) 2023-07-21T22:53:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.873+0000 7f0fa579b700 1 -- 172.21.15.151:0/616288857 learned_addr learned my addr 172.21.15.151:0/616288857 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.874+0000 7f0fa5f9c700 1 --2- 172.21.15.151:0/616288857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 0x55c7fac30cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.874+0000 7f0fa579b700 1 -- 172.21.15.151:0/616288857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 msgr2=0x55c7fac30cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.874+0000 7f0fa579b700 1 --2- 172.21.15.151:0/616288857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 0x55c7fac30cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.874+0000 7f0fa579b700 1 -- 172.21.15.151:0/616288857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31660 msgr2=0x55c7fac2b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.874+0000 7f0fa579b700 1 --2- 172.21.15.151:0/616288857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31660 0x55c7fac2b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.874+0000 7f0fa579b700 1 -- 172.21.15.151:0/616288857 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fa9aad80 con 0x55c7fac31210 2023-07-21T22:53:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.874+0000 7f0fa5f9c700 1 --2- 172.21.15.151:0/616288857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 0x55c7fac30cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:53:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.874+0000 7f0fa579b700 1 --2- 172.21.15.151:0/616288857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31210 0x55c7fac2af40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0cb600 tx=0x7f0f9c0d63c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=73631fe313fa1f38 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.875+0000 7f0f8b7fe700 1 -- 172.21.15.151:0/616288857 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0d1260 con 0x55c7fac31210 2023-07-21T22:53:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.875+0000 7f0f8b7fe700 1 -- 172.21.15.151:0/616288857 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f9c0d13c0 con 0x55c7fac31210 2023-07-21T22:53:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.875+0000 7f0f8b7fe700 1 -- 172.21.15.151:0/616288857 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9c0d0e20 con 0x55c7fac31210 2023-07-21T22:53:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.875+0000 7f0f967fc700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f8c0a13c0 0x7f0f8c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.876+0000 7f0f967fc700 1 -- 172.21.15.151:0/82550239 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0f9c0cdfb0 con 0x7f0fa0100db0 2023-07-21T22:53:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.876+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/616288857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31210 msgr2=0x55c7fac2af40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.876+0000 7f0fa5f9c700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f8c0a13c0 0x7f0f8c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.876+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/616288857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31210 0x55c7fac2af40 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0cb600 tx=0x7f0f9c0d63c0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.877+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/616288857 shutdown_connections 2023-07-21T22:53:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.877+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/616288857 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31660 0x55c7fac2b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.877+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/616288857 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 0x55c7fac30cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.877+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/616288857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31210 0x55c7fac2af40 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.877+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/616288857 >> 172.21.15.151:0/616288857 conn(0x55c7fac20ae0 msgr2=0x55c7fac260e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:42.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.877+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/616288857 shutdown_connections 2023-07-21T22:53:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.877+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/616288857 wait complete. 2023-07-21T22:53:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.878+0000 7f0fbb2f5b80 1 -- start start 2023-07-21T22:53:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.879+0000 7f0fbb2f5b80 1 Processor -- start 2023-07-21T22:53:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.879+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7faa876b0 0x55c7fac3a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.879+0000 7f0fa5f9c700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f8c0a13c0 0x7f0f8c0a3870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009550 tx=0x7f0f98009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.879+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac3a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.879+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31660 0x55c7fac345c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.879+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fab1ca60 con 0x55c7fac31660 2023-07-21T22:53:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.879+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fab1c760 con 0x55c7faa876b0 2023-07-21T22:53:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.879+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7faa008c0 con 0x55c7fac31210 2023-07-21T22:53:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.879+0000 7f0fbb2f5b80 10 client.0 _ll_register_callbacks cb 0x55c7fab1a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.880+0000 7f0fa579b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7faa876b0 0x55c7fac3a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.880+0000 7f0fa4f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac3a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.880+0000 7f0fa4f9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac3a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51550/0 (socket says 172.21.15.151:51550) 2023-07-21T22:53:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.880+0000 7f0fa4f9a700 1 -- 172.21.15.151:0/3707112838 learned_addr learned my addr 172.21.15.151:0/3707112838 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.880+0000 7f0fa5f9c700 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31660 0x55c7fac345c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.881+0000 7f0fa4f9a700 1 -- 172.21.15.151:0/3707112838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7faa876b0 msgr2=0x55c7fac3a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.881+0000 7f0fa4f9a700 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7faa876b0 0x55c7fac3a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.881+0000 7f0fa4f9a700 1 -- 172.21.15.151:0/3707112838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31660 msgr2=0x55c7fac345c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.881+0000 7f0fa4f9a700 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31660 0x55c7fac345c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.881+0000 7f0fa4f9a700 1 -- 172.21.15.151:0/3707112838 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa01997e0 con 0x55c7fac31210 2023-07-21T22:53:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.881+0000 7f0fa4f9a700 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac3a840 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005950 tx=0x7f0f9000bef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=356d93af043ff7b0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.881+0000 7f0f88ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:53:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.881+0000 7f0f88ff9700 1 -- 172.21.15.151:0/3707112838 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000dca0 con 0x55c7fac31210 2023-07-21T22:53:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.881+0000 7f0f88ff9700 1 -- 172.21.15.151:0/3707112838 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0f9000de00 con 0x55c7fac31210 2023-07-21T22:53:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.882+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/3707112838 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c7faad6490 con 0x55c7fac31210 2023-07-21T22:53:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.882+0000 7f0f88ff9700 1 -- 172.21.15.151:0/3707112838 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f9000b480 con 0x55c7fac31210 2023-07-21T22:53:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.882+0000 7f0fbb2f5b80 10 client.28759 fetch_fsmap learned FSMap version 105 2023-07-21T22:53:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.882+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/3707112838 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55c7fa993c00 con 0x55c7fac31210 2023-07-21T22:53:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.882+0000 7f0f88ff9700 1 -- 172.21.15.151:0/3707112838 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c7faad6490 con 0x55c7fac31210 2023-07-21T22:53:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.883+0000 7f0f88ff9700 1 -- 172.21.15.151:0/3707112838 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0f90004d20 con 0x55c7fac31210 2023-07-21T22:53:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.883+0000 7f0fbb2f5b80 10 client.28759 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:53:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.883+0000 7f0fbb2f5b80 10 client.28759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.883+0000 7f0fbb2f5b80 20 client.28759 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.883+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7fac44890 0x55c7fac46ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.883+0000 7f0fbb2f5b80 4 client.28759 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:53:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.883+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/3707112838 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7fab75e50 con 0x55c7fac44890 2023-07-21T22:53:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.884+0000 7f0fa579b700 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7fac44890 0x55c7fac46ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.885+0000 7f0fa579b700 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7fac44890 0x55c7fac46ca0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13f3724b57de0fb server_cookie=1df6d00e75cff014 in_seq=0 out_seq=0 2023-07-21T22:53:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.885+0000 7f0f88ff9700 10 client.28759 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.886+0000 7f0f88ff9700 1 -- 172.21.15.151:0/3707112838 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c7fab75e50 con 0x55c7fac44890 2023-07-21T22:53:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.886+0000 7f0f88ff9700 10 client.28759 handle_command_reply: tid=0 2023-07-21T22:53:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.886+0000 7f0fbb2f5b80 1 client.28759 shutdown 2023-07-21T22:53:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.890+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/3707112838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 msgr2=0x55c7fac3a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.890+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac3a840 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f0f90005950 tx=0x7f0f9000bef0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.893+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/3707112838 shutdown_connections 2023-07-21T22:53:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.893+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7fac44890 0x55c7fac46ca0 crc :-1 s=READY pgs=407 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.893+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7faa876b0 0x55c7fac3a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.893+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31660 0x55c7fac345c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.893+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/3707112838 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac3a840 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.893+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/3707112838 >> 172.21.15.151:0/3707112838 conn(0x55c7fac20ae0 msgr2=0x55c7fac253e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.893+0000 7f0f88ff9700 0 client.28759 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.894+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/3707112838 shutdown_connections 2023-07-21T22:53:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.894+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/3707112838 wait complete. 2023-07-21T22:53:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.895+0000 7f0fbb2f5b80 20 client.28759 trim_cache size 0 max 16384 2023-07-21T22:53:42.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.925+0000 7f0fbb2f5b80 1 Processor -- start 2023-07-21T22:53:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.925+0000 7f0fbb2f5b80 1 -- start start 2023-07-21T22:53:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.926+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 0x55c7fac33d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.926+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31210 0x55c7fac25b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.926+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac260a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.926+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fac2f000 con 0x55c7fac31210 2023-07-21T22:53:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.926+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fac27760 con 0x55c7fac31660 2023-07-21T22:53:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.926+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fac32b20 con 0x55c7faa876b0 2023-07-21T22:53:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.926+0000 7f0fa5f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.926+0000 7f0fa5f9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac260a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49758/0 (socket says 172.21.15.151:49758) 2023-07-21T22:53:42.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.926+0000 7f0fa5f9c700 1 -- 172.21.15.151:0/2273488275 learned_addr learned my addr 172.21.15.151:0/2273488275 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.927+0000 7f0fa5f9c700 1 -- 172.21.15.151:0/2273488275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 msgr2=0x55c7fac33d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:53:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.927+0000 7f0fa5f9c700 1 --2- 172.21.15.151:0/2273488275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 0x55c7fac33d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.927+0000 7f0fa5f9c700 1 -- 172.21.15.151:0/2273488275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31210 msgr2=0x55c7fac25b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.927+0000 7f0fa5f9c700 1 --2- 172.21.15.151:0/2273488275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31210 0x55c7fac25b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.927+0000 7f0fa5f9c700 1 -- 172.21.15.151:0/2273488275 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7fa9d11f0 con 0x55c7fac31660 2023-07-21T22:53:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.927+0000 7f0fa5f9c700 1 --2- 172.21.15.151:0/2273488275 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac260a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0f98018490 tx=0x7f0f98014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a02178596a45062b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.928+0000 7f0f8bfff700 1 -- 172.21.15.151:0/2273488275 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f9801d050 con 0x55c7fac31660 2023-07-21T22:53:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.928+0000 7f0f8bfff700 1 -- 172.21.15.151:0/2273488275 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f9801e040 con 0x55c7fac31660 2023-07-21T22:53:42.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.928+0000 7f0f8bfff700 1 -- 172.21.15.151:0/2273488275 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f980047a0 con 0x55c7fac31660 2023-07-21T22:53:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.929+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/2273488275 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 msgr2=0x55c7fac260a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.929+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/2273488275 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac260a0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0f98018490 tx=0x7f0f98014000 comp rx=0 tx=0).stop 2023-07-21T22:53:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.929+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/2273488275 shutdown_connections 2023-07-21T22:53:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.929+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/2273488275 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac260a0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.929+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/2273488275 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7faa876b0 0x55c7fac33d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.929+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/2273488275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7fac31210 0x55c7fac25b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.929+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/2273488275 >> 172.21.15.151:0/2273488275 conn(0x55c7fac20ae0 msgr2=0x55c7fac4b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.930+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/2273488275 shutdown_connections 2023-07-21T22:53:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.930+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/2273488275 wait complete. 2023-07-21T22:53:42.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.930+0000 7f0fbb2f5b80 1 -- start start 2023-07-21T22:53:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.931+0000 7f0fbb2f5b80 1 Processor -- start 2023-07-21T22:53:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.931+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7faa876b0 0x55c7fac90a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.931+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac90f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.931+0000 7f0fbb2f5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac3d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.931+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fac3d740 con 0x55c7faa876b0 2023-07-21T22:53:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.931+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fac3d8b0 con 0x55c7fac31660 2023-07-21T22:53:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.931+0000 7f0fbb2f5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7fac3da70 con 0x55c7fac31210 2023-07-21T22:53:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.931+0000 7f0fbb2f5b80 10 client.0 _ll_register_callbacks cb 0x7f0f9000b690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.932+0000 7f0fa579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7faa876b0 0x55c7fac90a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.932+0000 7f0fa579b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7faa876b0 0x55c7fac90a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37874/0 (socket says 172.21.15.151:37874) 2023-07-21T22:53:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.932+0000 7f0fa579b700 1 -- 172.21.15.151:0/486075978 learned_addr learned my addr 172.21.15.151:0/486075978 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:42.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.932+0000 7f0fa5f9c700 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac3d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.932+0000 7f0fa4f9a700 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac90f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.933+0000 7f0fa4f9a700 1 -- 172.21.15.151:0/486075978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 msgr2=0x55c7fac3d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.933+0000 7f0fa4f9a700 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac3d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.933+0000 7f0fa4f9a700 1 -- 172.21.15.151:0/486075978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7faa876b0 msgr2=0x55c7fac90a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.933+0000 7f0fa4f9a700 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7faa876b0 0x55c7fac90a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.933+0000 7f0fa4f9a700 1 -- 172.21.15.151:0/486075978 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f98007d00 con 0x55c7fac31210 2023-07-21T22:53:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.933+0000 7f0fa4f9a700 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac90f40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x55c7fac4bcf0 tx=0x7f0f9000d6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f32164105df099f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.933+0000 7f0f88ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:53:42.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.934+0000 7f0f88ff9700 1 -- 172.21.15.151:0/486075978 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f90010880 con 0x55c7fac31210 2023-07-21T22:53:42.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.934+0000 7f0f88ff9700 1 -- 172.21.15.151:0/486075978 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0f9000daa0 con 0x55c7fac31210 2023-07-21T22:53:42.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.934+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/486075978 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0f9c0d13c0 con 0x55c7fac31210 2023-07-21T22:53:42.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.935+0000 7f0f88ff9700 1 -- 172.21.15.151:0/486075978 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0f9000dca0 con 0x55c7fac31210 2023-07-21T22:53:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.935+0000 7f0fbb2f5b80 10 client.28762 fetch_fsmap learned FSMap version 105 2023-07-21T22:53:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.935+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/486075978 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55c7fa9a9250 con 0x55c7fac31210 2023-07-21T22:53:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.935+0000 7f0f88ff9700 1 -- 172.21.15.151:0/486075978 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0f9c0d13c0 con 0x55c7fac31210 2023-07-21T22:53:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.935+0000 7f0f88ff9700 1 -- 172.21.15.151:0/486075978 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0f90003900 con 0x55c7fac31210 2023-07-21T22:53:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.936+0000 7f0fbb2f5b80 10 client.28762 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:53:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.936+0000 7f0fbb2f5b80 10 client.28762 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:42.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.936+0000 7f0fbb2f5b80 20 client.28762 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:42.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.936+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7fac99910 0x55c7fac9bd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:42.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.936+0000 7f0fbb2f5b80 4 client.28762 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:53:42.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.936+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/486075978 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c7fab37ff0 con 0x55c7fac99910 2023-07-21T22:53:42.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.936+0000 7f0fa579b700 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7fac99910 0x55c7fac9bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:42.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.938+0000 7f0fa579b700 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7fac99910 0x55c7fac9bd20 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=789ab7f108db429e server_cookie=2b5d8c14e7b9ecda in_seq=0 out_seq=0 2023-07-21T22:53:42.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.938+0000 7f0f88ff9700 10 client.28762 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.994+0000 7f0f88ff9700 1 -- 172.21.15.151:0/486075978 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c7fab37ff0 con 0x55c7fac99910 2023-07-21T22:53:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0f88ff9700 10 client.28762 handle_command_reply: tid=0 2023-07-21T22:53:43.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0fbb2f5b80 1 client.28762 shutdown 2023-07-21T22:53:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/486075978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 msgr2=0x55c7fac90f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac90f40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x55c7fac4bcf0 tx=0x7f0f9000d6b0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/486075978 shutdown_connections 2023-07-21T22:53:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7fac99910 0x55c7fac9bd20 crc :-1 s=READY pgs=408 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7fac31660 0x55c7fac3d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7faa876b0 0x55c7fac90a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0fbb2f5b80 1 --2- 172.21.15.151:0/486075978 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7fac31210 0x55c7fac90f40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/486075978 >> 172.21.15.151:0/486075978 conn(0x55c7fac20ae0 msgr2=0x55c7fac31a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.995+0000 7f0f88ff9700 0 client.28762 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:43.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.996+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/486075978 shutdown_connections 2023-07-21T22:53:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.996+0000 7f0fbb2f5b80 1 -- 172.21.15.151:0/486075978 wait complete. 2023-07-21T22:53:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.996+0000 7f0fbb2f5b80 20 client.28762 trim_cache size 0 max 16384 2023-07-21T22:53:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:53:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:53:43.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:53:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:53:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 -- 172.21.15.151:0/82550239 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f8c0a13c0 msgr2=0x7f0f8c0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f8c0a13c0 0x7f0f8c0a3870 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009550 tx=0x7f0f98009040 comp rx=0 tx=0).stop 2023-07-21T22:53:43.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 -- 172.21.15.151:0/82550239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0100db0 msgr2=0x7f0fa019cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0100db0 0x7f0fa019cad0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c0036c0 tx=0x7f0f9c0057f0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 -- 172.21.15.151:0/82550239 shutdown_connections 2023-07-21T22:53:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0f8c0a13c0 0x7f0f8c0a3870 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0100db0 0x7f0fa019cad0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fa010a180 0x7f0fa01088a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 --2- 172.21.15.151:0/82550239 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fa01016c0 0x7f0fa019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 -- 172.21.15.151:0/82550239 >> 172.21.15.151:0/82550239 conn(0x7f0fa0075bd0 msgr2=0x7f0fa00fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:43.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 -- 172.21.15.151:0/82550239 shutdown_connections 2023-07-21T22:53:43.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:42.997+0000 7f0fa79ff700 1 -- 172.21.15.151:0/82550239 wait complete. 2023-07-21T22:53:44.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 50.0 s, 391.4 tps, lat 250.852 ms stddev 83.466 2023-07-21T22:53:44.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:44 smithi187 ceph-mon[96918]: pgmap v1097: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-07-21T22:53:44.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:44 smithi195 ceph-mon[97365]: pgmap v1097: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-07-21T22:53:44.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:44 smithi151 ceph-mon[95510]: pgmap v1097: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 891 KiB/s rd, 15 MiB/s wr, 1.09k op/s 2023-07-21T22:53:46.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:46 smithi187 ceph-mon[96918]: pgmap v1098: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 10 MiB/s wr, 724 op/s 2023-07-21T22:53:46.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:46 smithi195 ceph-mon[97365]: pgmap v1098: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 10 MiB/s wr, 724 op/s 2023-07-21T22:53:46.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:46 smithi151 ceph-mon[95510]: pgmap v1098: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 641 KiB/s rd, 10 MiB/s wr, 724 op/s 2023-07-21T22:53:48.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:47 smithi187 ceph-mon[96918]: pgmap v1099: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-07-21T22:53:48.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:47 smithi195 ceph-mon[97365]: pgmap v1099: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-07-21T22:53:48.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:47 smithi151 ceph-mon[95510]: pgmap v1099: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 15 MiB/s wr, 1.13k op/s 2023-07-21T22:53:49.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 55.0 s, 369.4 tps, lat 267.527 ms stddev 59.766 2023-07-21T22:53:50.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:50 smithi151 ceph-mon[95510]: pgmap v1100: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 10 MiB/s wr, 765 op/s 2023-07-21T22:53:50.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:50 smithi187 ceph-mon[96918]: pgmap v1100: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 10 MiB/s wr, 765 op/s 2023-07-21T22:53:50.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:50 smithi195 ceph-mon[97365]: pgmap v1100: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 10 MiB/s wr, 765 op/s 2023-07-21T22:53:52.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:52 smithi187 ceph-mon[96918]: pgmap v1101: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 10 MiB/s wr, 765 op/s 2023-07-21T22:53:52.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:52 smithi195 ceph-mon[97365]: pgmap v1101: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 10 MiB/s wr, 765 op/s 2023-07-21T22:53:52.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:52 smithi151 ceph-mon[95510]: pgmap v1101: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 10 MiB/s wr, 765 op/s 2023-07-21T22:53:54.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 60.0 s, 365.4 tps, lat 281.457 ms stddev 73.122 2023-07-21T22:53:54.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:54 smithi187 ceph-mon[96918]: pgmap v1102: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-07-21T22:53:54.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:54 smithi195 ceph-mon[97365]: pgmap v1102: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-07-21T22:53:54.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:54 smithi151 ceph-mon[95510]: pgmap v1102: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.14k op/s 2023-07-21T22:53:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.315+0000 7f94375ff700 1 -- 172.21.15.151:0/3406653075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f943006d3a0 msgr2=0x7f943011b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.315+0000 7f94375ff700 1 --2- 172.21.15.151:0/3406653075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f943006d3a0 0x7f943011b470 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f9428009f90 tx=0x7f942800b330 comp rx=0 tx=0).stop 2023-07-21T22:53:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.315+0000 7f94375ff700 1 -- 172.21.15.151:0/3406653075 shutdown_connections 2023-07-21T22:53:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.315+0000 7f94375ff700 1 --2- 172.21.15.151:0/3406653075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f943010e2a0 0x7f943010e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.315+0000 7f94375ff700 1 --2- 172.21.15.151:0/3406653075 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f943006d3a0 0x7f943011b470 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.315+0000 7f94375ff700 1 --2- 172.21.15.151:0/3406653075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f943006c910 0x7f943006cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.315+0000 7f94375ff700 1 -- 172.21.15.151:0/3406653075 >> 172.21.15.151:0/3406653075 conn(0x7f943006bd70 msgr2=0x7f9430070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.316+0000 7f94375ff700 1 -- 172.21.15.151:0/3406653075 shutdown_connections 2023-07-21T22:53:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.316+0000 7f94375ff700 1 -- 172.21.15.151:0/3406653075 wait complete. 2023-07-21T22:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.317+0000 7f94375ff700 1 Processor -- start 2023-07-21T22:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.318+0000 7f94375ff700 1 -- start start 2023-07-21T22:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.318+0000 7f94375ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f943006c910 0x7f943011ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.318+0000 7f94375ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f943006d3a0 0x7f943011b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.318+0000 7f94375ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f943010e2a0 0x7f9430113d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.318+0000 7f94375ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94301144e0 con 0x7f943006d3a0 2023-07-21T22:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.318+0000 7f94375ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9430114650 con 0x7f943010e2a0 2023-07-21T22:53:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.318+0000 7f94375ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9430114810 con 0x7f943006c910 2023-07-21T22:53:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.318+0000 7f9435b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f943010e2a0 0x7f9430113d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.318+0000 7f9435b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f943010e2a0 0x7f9430113d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36138/0 (socket says 172.21.15.151:36138) 2023-07-21T22:53:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.319+0000 7f9435b9c700 1 -- 172.21.15.151:0/113469688 learned_addr learned my addr 172.21.15.151:0/113469688 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.319+0000 7f943539b700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f943006c910 0x7f943011ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.319+0000 7f9434b9a700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f943006d3a0 0x7f943011b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.319+0000 7f9435b9c700 1 -- 172.21.15.151:0/113469688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f943006c910 msgr2=0x7f943011ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:56.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.319+0000 7f9435b9c700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f943006c910 0x7f943011ae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.319+0000 7f9435b9c700 1 -- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f943006d3a0 msgr2=0x7f943011b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.319+0000 7f9435b9c700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f943006d3a0 0x7f943011b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.319+0000 7f9435b9c700 1 -- 172.21.15.151:0/113469688 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9428009c40 con 0x7f943010e2a0 2023-07-21T22:53:56.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.319+0000 7f9435b9c700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f943010e2a0 0x7f9430113d10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9428009f60 tx=0x7f9428008d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.320+0000 7f94227fc700 1 -- 172.21.15.151:0/113469688 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942800e040 con 0x7f943010e2a0 2023-07-21T22:53:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.320+0000 7f94227fc700 1 -- 172.21.15.151:0/113469688 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9428004e30 con 0x7f943010e2a0 2023-07-21T22:53:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.320+0000 7f94227fc700 1 -- 172.21.15.151:0/113469688 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94280052a0 con 0x7f943010e2a0 2023-07-21T22:53:56.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.320+0000 7f94375ff700 1 -- 172.21.15.151:0/113469688 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9430114a90 con 0x7f943010e2a0 2023-07-21T22:53:56.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.320+0000 7f94375ff700 1 -- 172.21.15.151:0/113469688 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9430118c40 con 0x7f943010e2a0 2023-07-21T22:53:56.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.328+0000 7f944ae45b80 1 Processor -- start 2023-07-21T22:53:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.328+0000 7f944ae45b80 1 -- start start 2023-07-21T22:53:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.329+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 0x55f1424cbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.329+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc210 0x55f1424c5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.329+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.329+0000 7f944ae45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1423cbc50 con 0x55f1423226b0 2023-07-21T22:53:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.329+0000 7f944ae45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f14241e9e0 con 0x55f1424cc210 2023-07-21T22:53:56.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.329+0000 7f944ae45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f142417e70 con 0x55f1424cc660 2023-07-21T22:53:56.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f9434b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f9434b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50858/0 (socket says 172.21.15.151:50858) 2023-07-21T22:53:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f9434b9a700 1 -- 172.21.15.151:0/1439878533 learned_addr learned my addr 172.21.15.151:0/1439878533 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f9434b9a700 1 --2- 172.21.15.151:0/1439878533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 0x55f1424cbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f94227fc700 1 -- 172.21.15.151:0/113469688 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f942801d470 con 0x7f943010e2a0 2023-07-21T22:53:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f943539b700 1 --2- 172.21.15.151:0/1439878533 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc210 0x55f1424c5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f9434b9a700 1 -- 172.21.15.151:0/1439878533 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc210 msgr2=0x55f1424c5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f9434b9a700 1 --2- 172.21.15.151:0/1439878533 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc210 0x55f1424c5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f9434b9a700 1 -- 172.21.15.151:0/1439878533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 msgr2=0x55f1424cbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:56.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f9434b9a700 1 --2- 172.21.15.151:0/1439878533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 0x55f1424cbcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.330+0000 7f9434b9a700 1 -- 172.21.15.151:0/1439878533 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f142245d80 con 0x55f1424cc660 2023-07-21T22:53:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.331+0000 7f9434b9a700 1 --2- 172.21.15.151:0/1439878533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424c64a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f942400bf60 tx=0x7f942400b500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b51a1c39b6009db9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.332+0000 7f941b7fe700 1 -- 172.21.15.151:0/1439878533 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424013300 con 0x55f1424cc660 2023-07-21T22:53:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.332+0000 7f941b7fe700 1 -- 172.21.15.151:0/1439878533 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9424017030 con 0x55f1424cc660 2023-07-21T22:53:56.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.332+0000 7f941b7fe700 1 -- 172.21.15.151:0/1439878533 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942400e470 con 0x55f1424cc660 2023-07-21T22:53:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.332+0000 7f94227fc700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f941c0a1490 0x7f941c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.333+0000 7f944ae45b80 1 -- 172.21.15.151:0/1439878533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 msgr2=0x55f1424c64a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.333+0000 7f944ae45b80 1 --2- 172.21.15.151:0/1439878533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424c64a0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f942400bf60 tx=0x7f942400b500 comp rx=0 tx=0).stop 2023-07-21T22:53:56.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.333+0000 7f94227fc700 1 -- 172.21.15.151:0/113469688 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f94280ce110 con 0x7f943010e2a0 2023-07-21T22:53:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.333+0000 7f944ae45b80 1 -- 172.21.15.151:0/1439878533 shutdown_connections 2023-07-21T22:53:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.333+0000 7f944ae45b80 1 --2- 172.21.15.151:0/1439878533 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424c64a0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.333+0000 7f944ae45b80 1 --2- 172.21.15.151:0/1439878533 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 0x55f1424cbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.333+0000 7f944ae45b80 1 --2- 172.21.15.151:0/1439878533 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc210 0x55f1424c5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.333+0000 7f944ae45b80 1 -- 172.21.15.151:0/1439878533 >> 172.21.15.151:0/1439878533 conn(0x55f1424bbae0 msgr2=0x55f1424c10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:56.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.333+0000 7f944ae45b80 1 -- 172.21.15.151:0/1439878533 shutdown_connections 2023-07-21T22:53:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.334+0000 7f943539b700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f941c0a1490 0x7f941c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.334+0000 7f944ae45b80 1 -- 172.21.15.151:0/1439878533 wait complete. 2023-07-21T22:53:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.334+0000 7f944ae45b80 1 -- start start 2023-07-21T22:53:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.335+0000 7f944ae45b80 1 Processor -- start 2023-07-21T22:53:56.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.335+0000 7f943539b700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f941c0a1490 0x7f941c0a3940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f942c005fd0 tx=0x7f942c009310 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.335+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424d25f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.335+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 0x55f1424cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.335+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.335+0000 7f944ae45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1423b7a60 con 0x55f1424cc210 2023-07-21T22:53:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.335+0000 7f944ae45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1423b7760 con 0x55f1423226b0 2023-07-21T22:53:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.335+0000 7f944ae45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f14229b8c0 con 0x55f1424cc660 2023-07-21T22:53:56.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.336+0000 7f944ae45b80 10 client.0 _ll_register_callbacks cb 0x55f1423b5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.336+0000 7f943539b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424d25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.336+0000 7f943539b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424d25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36148/0 (socket says 172.21.15.151:36148) 2023-07-21T22:53:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.336+0000 7f943539b700 1 -- 172.21.15.151:0/677627415 learned_addr learned my addr 172.21.15.151:0/677627415 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.336+0000 7f9435b9c700 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.336+0000 7f943539b700 1 -- 172.21.15.151:0/677627415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 msgr2=0x55f1424cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.336+0000 7f943539b700 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.336+0000 7f943539b700 1 -- 172.21.15.151:0/677627415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 msgr2=0x55f1424cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.336+0000 7f943539b700 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 0x55f1424cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.337+0000 7f943539b700 1 -- 172.21.15.151:0/677627415 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9424013460 con 0x55f1423226b0 2023-07-21T22:53:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.337+0000 7f9435b9c700 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:53:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.337+0000 7f943539b700 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424d25f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f942c0041a0 tx=0x7f942c0047c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b91df49dd6d85abf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.337+0000 7f9418ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:53:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.337+0000 7f9418ff9700 1 -- 172.21.15.151:0/677627415 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f942c017070 con 0x55f1423226b0 2023-07-21T22:53:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.337+0000 7f944ae45b80 1 -- 172.21.15.151:0/677627415 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f142371490 con 0x55f1423226b0 2023-07-21T22:53:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.337+0000 7f9418ff9700 1 -- 172.21.15.151:0/677627415 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f942c003d20 con 0x55f1423226b0 2023-07-21T22:53:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f9418ff9700 1 -- 172.21.15.151:0/677627415 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f942c004560 con 0x55f1423226b0 2023-07-21T22:53:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f944ae45b80 10 client.28760 fetch_fsmap learned FSMap version 105 2023-07-21T22:53:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f944ae45b80 1 -- 172.21.15.151:0/677627415 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55f14222ec00 con 0x55f1423226b0 2023-07-21T22:53:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f9418ff9700 1 -- 172.21.15.151:0/677627415 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f142371490 con 0x55f1423226b0 2023-07-21T22:53:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f9418ff9700 1 -- 172.21.15.151:0/677627415 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f942c029550 con 0x55f1423226b0 2023-07-21T22:53:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f944ae45b80 10 client.28760 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:53:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f944ae45b80 10 client.28760 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f944ae45b80 20 client.28760 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f944ae45b80 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f1424dfcb0 0x55f1424e20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f944ae45b80 4 client.28760 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:53:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.338+0000 7f944ae45b80 1 -- 172.21.15.151:0/677627415 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f142410e50 con 0x55f1424dfcb0 2023-07-21T22:53:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.339+0000 7f9434b9a700 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f1424dfcb0 0x55f1424e20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.339+0000 7f9434b9a700 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f1424dfcb0 0x55f1424e20c0 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21cce01e9be90a49 server_cookie=20e8ea033313d2ec in_seq=0 out_seq=0 2023-07-21T22:53:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.339+0000 7f9418ff9700 10 client.28760 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.340+0000 7f9418ff9700 1 -- 172.21.15.151:0/677627415 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f142410e50 con 0x55f1424dfcb0 2023-07-21T22:53:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.340+0000 7f9418ff9700 10 client.28760 handle_command_reply: tid=0 2023-07-21T22:53:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.340+0000 7f944ae45b80 1 client.28760 shutdown 2023-07-21T22:53:56.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.341+0000 7f944ae45b80 1 -- 172.21.15.151:0/677627415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 msgr2=0x55f1424d25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.341+0000 7f944ae45b80 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424d25f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f942c0041a0 tx=0x7f942c0047c0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.341+0000 7f944ae45b80 1 -- 172.21.15.151:0/677627415 shutdown_connections 2023-07-21T22:53:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.341+0000 7f944ae45b80 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f1424dfcb0 0x55f1424e20c0 crc :-1 s=READY pgs=409 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.341+0000 7f944ae45b80 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424d25f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.341+0000 7f944ae45b80 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.341+0000 7f944ae45b80 1 --2- 172.21.15.151:0/677627415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 0x55f1424cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.341+0000 7f944ae45b80 1 -- 172.21.15.151:0/677627415 >> 172.21.15.151:0/677627415 conn(0x55f1424bbae0 msgr2=0x55f1424c4f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.341+0000 7f9418ff9700 0 client.28760 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.342+0000 7f944ae45b80 1 -- 172.21.15.151:0/677627415 shutdown_connections 2023-07-21T22:53:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.342+0000 7f944ae45b80 1 -- 172.21.15.151:0/677627415 wait complete. 2023-07-21T22:53:56.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.342+0000 7f944ae45b80 20 client.28760 trim_cache size 0 max 16384 2023-07-21T22:53:56.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.370+0000 7f944ae45b80 1 Processor -- start 2023-07-21T22:53:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f944ae45b80 1 -- start start 2023-07-21T22:53:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424c11d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 0x55f1424d2190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f944ae45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1424c69e0 con 0x55f1424cc210 2023-07-21T22:53:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f944ae45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1424c7160 con 0x55f1423226b0 2023-07-21T22:53:56.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f944ae45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1424cdea0 con 0x55f1424cc660 2023-07-21T22:53:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f9434b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 0x55f1424d2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.408 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f9434b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 0x55f1424d2190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:45710/0 (socket says 172.21.15.151:45710) 2023-07-21T22:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.371+0000 7f9434b9a700 1 -- 172.21.15.151:0/3614664388 learned_addr learned my addr 172.21.15.151:0/3614664388 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.372+0000 7f943539b700 1 --2- 172.21.15.151:0/3614664388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424c11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.372+0000 7f9435b9c700 1 --2- 172.21.15.151:0/3614664388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.372+0000 7f9434b9a700 1 -- 172.21.15.151:0/3614664388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 msgr2=0x55f1424cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.372+0000 7f9434b9a700 1 --2- 172.21.15.151:0/3614664388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.372+0000 7f9434b9a700 1 -- 172.21.15.151:0/3614664388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 msgr2=0x55f1424c11d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:56.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.372+0000 7f9434b9a700 1 --2- 172.21.15.151:0/3614664388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424c11d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.372+0000 7f9434b9a700 1 -- 172.21.15.151:0/3614664388 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f14226c1f0 con 0x55f1424cc210 2023-07-21T22:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.373+0000 7f9434b9a700 1 --2- 172.21.15.151:0/3614664388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 0x55f1424d2190 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f942400b4d0 tx=0x7f942400bc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25471c81aa252b78 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.373+0000 7f941bfff700 1 -- 172.21.15.151:0/3614664388 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424029070 con 0x55f1424cc210 2023-07-21T22:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.373+0000 7f941bfff700 1 -- 172.21.15.151:0/3614664388 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f942400b2c0 con 0x55f1424cc210 2023-07-21T22:53:56.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.373+0000 7f941bfff700 1 -- 172.21.15.151:0/3614664388 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9424024860 con 0x55f1424cc210 2023-07-21T22:53:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.374+0000 7f944ae45b80 1 -- 172.21.15.151:0/3614664388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 msgr2=0x55f1424d2190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.374+0000 7f944ae45b80 1 --2- 172.21.15.151:0/3614664388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 0x55f1424d2190 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f942400b4d0 tx=0x7f942400bc20 comp rx=0 tx=0).stop 2023-07-21T22:53:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.374+0000 7f944ae45b80 1 -- 172.21.15.151:0/3614664388 shutdown_connections 2023-07-21T22:53:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.374+0000 7f944ae45b80 1 --2- 172.21.15.151:0/3614664388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1423226b0 0x55f1424c11d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.411 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.374+0000 7f944ae45b80 1 --2- 172.21.15.151:0/3614664388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc660 0x55f1424cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.374+0000 7f944ae45b80 1 --2- 172.21.15.151:0/3614664388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1424cc210 0x55f1424d2190 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.374+0000 7f944ae45b80 1 -- 172.21.15.151:0/3614664388 >> 172.21.15.151:0/3614664388 conn(0x55f1424bbae0 msgr2=0x55f1424c0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:56.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.374+0000 7f944ae45b80 1 -- 172.21.15.151:0/3614664388 shutdown_connections 2023-07-21T22:53:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.375+0000 7f944ae45b80 1 -- 172.21.15.151:0/3614664388 wait complete. 2023-07-21T22:53:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.375+0000 7f944ae45b80 1 -- start start 2023-07-21T22:53:56.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.376+0000 7f944ae45b80 1 Processor -- start 2023-07-21T22:53:56.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.376+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 0x55f1424d3380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.376+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc210 0x55f1424d38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.376+0000 7f944ae45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc660 0x55f142532b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.376+0000 7f944ae45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1424d4040 con 0x55f1423226b0 2023-07-21T22:53:56.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.376+0000 7f944ae45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1425330f0 con 0x55f1424cc660 2023-07-21T22:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.376+0000 7f944ae45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f1425332b0 con 0x55f1424cc210 2023-07-21T22:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.376+0000 7f944ae45b80 10 client.0 _ll_register_callbacks cb 0x7f942c004030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f9435b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc660 0x55f142532b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f9435b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc660 0x55f142532b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36166/0 (socket says 172.21.15.151:36166) 2023-07-21T22:53:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f9435b9c700 1 -- 172.21.15.151:0/499108147 learned_addr learned my addr 172.21.15.151:0/499108147 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:53:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f943539b700 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 0x55f1424d3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f9434b9a700 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc210 0x55f1424d38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f9435b9c700 1 -- 172.21.15.151:0/499108147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc210 msgr2=0x55f1424d38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f9435b9c700 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc210 0x55f1424d38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f9435b9c700 1 -- 172.21.15.151:0/499108147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 msgr2=0x55f1424d3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f9435b9c700 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 0x55f1424d3380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f9435b9c700 1 -- 172.21.15.151:0/499108147 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f142245d80 con 0x55f1424cc660 2023-07-21T22:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.377+0000 7f943539b700 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 0x55f1424d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.378+0000 7f9435b9c700 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc660 0x55f142532b80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9428009790 tx=0x7f9428097620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f1562406d77d6de server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:53:56.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.378+0000 7f9418ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.378+0000 7f9418ff9700 1 -- 172.21.15.151:0/499108147 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94280aeea0 con 0x55f1424cc660 2023-07-21T22:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.378+0000 7f9418ff9700 1 -- 172.21.15.151:0/499108147 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(146..146 src has 1..146) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9428095e40 con 0x55f1424cc660 2023-07-21T22:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.378+0000 7f944ae45b80 1 -- 172.21.15.151:0/499108147 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9424017030 con 0x55f1424cc660 2023-07-21T22:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.378+0000 7f9418ff9700 1 -- 172.21.15.151:0/499108147 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f942809ab90 con 0x55f1424cc660 2023-07-21T22:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f944ae45b80 10 client.28766 fetch_fsmap learned FSMap version 105 2023-07-21T22:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f944ae45b80 1 -- 172.21.15.151:0/499108147 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55f142244250 con 0x55f1424cc660 2023-07-21T22:53:56.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f9418ff9700 1 -- 172.21.15.151:0/499108147 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9424017030 con 0x55f1424cc660 2023-07-21T22:53:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f9418ff9700 1 -- 172.21.15.151:0/499108147 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f942809a720 con 0x55f1424cc660 2023-07-21T22:53:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f944ae45b80 10 client.28766 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:53:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f944ae45b80 10 client.28766 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:53:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f944ae45b80 20 client.28766 populate_metadata read hostname 'smithi151' 2023-07-21T22:53:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f944ae45b80 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f142534780 0x55f142536b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:53:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f944ae45b80 4 client.28766 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:53:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.379+0000 7f944ae45b80 1 -- 172.21.15.151:0/499108147 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f1423d2ff0 con 0x55f142534780 2023-07-21T22:53:56.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.380+0000 7f943539b700 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f142534780 0x55f142536b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:53:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.380+0000 7f9418ff9700 10 client.28766 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:56.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:56.380+0000 7f943539b700 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f142534780 0x55f142536b90 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe0d89dbdd794453 server_cookie=8462f65268a97d0a in_seq=0 out_seq=0 2023-07-21T22:53:56.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:56 smithi187 ceph-mon[96918]: pgmap v1103: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 10 MiB/s wr, 787 op/s 2023-07-21T22:53:56.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:56 smithi195 ceph-mon[97365]: pgmap v1103: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 10 MiB/s wr, 787 op/s 2023-07-21T22:53:56.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:56 smithi151 ceph-mon[95510]: pgmap v1103: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 868 KiB/s rd, 10 MiB/s wr, 787 op/s 2023-07-21T22:53:57.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.859+0000 7f9418ff9700 1 -- 172.21.15.151:0/499108147 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f1423d2ff0 con 0x55f142534780 2023-07-21T22:53:57.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.859+0000 7f9418ff9700 10 client.28766 handle_command_reply: tid=0 2023-07-21T22:53:57.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.859+0000 7f944ae45b80 1 client.28766 shutdown 2023-07-21T22:53:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 -- 172.21.15.151:0/499108147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc660 msgr2=0x55f142532b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:57.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc660 0x55f142532b80 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f9428009790 tx=0x7f9428097620 comp rx=0 tx=0).stop 2023-07-21T22:53:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 -- 172.21.15.151:0/499108147 shutdown_connections 2023-07-21T22:53:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f142534780 0x55f142536b90 crc :-1 s=READY pgs=410 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f1424cc660 0x55f142532b80 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f1423226b0 0x55f1424d3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 --2- 172.21.15.151:0/499108147 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f1424cc210 0x55f1424d38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 -- 172.21.15.151:0/499108147 >> 172.21.15.151:0/499108147 conn(0x55f1424bbae0 msgr2=0x55f1424cd330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:57.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f9418ff9700 0 client.28766 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:53:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 -- 172.21.15.151:0/499108147 shutdown_connections 2023-07-21T22:53:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 1 -- 172.21.15.151:0/499108147 wait complete. 2023-07-21T22:53:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.860+0000 7f944ae45b80 20 client.28766 trim_cache size 0 max 16384 2023-07-21T22:53:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:53:57.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:53:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:53:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:53:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 -- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f941c0a1490 msgr2=0x7f941c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:57.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f941c0a1490 0x7f941c0a3940 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f942c005fd0 tx=0x7f942c009310 comp rx=0 tx=0).stop 2023-07-21T22:53:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 -- 172.21.15.151:0/113469688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f943010e2a0 msgr2=0x7f9430113d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:53:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f943010e2a0 0x7f9430113d10 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f9428009f60 tx=0x7f9428008d50 comp rx=0 tx=0).stop 2023-07-21T22:53:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 -- 172.21.15.151:0/113469688 shutdown_connections 2023-07-21T22:53:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f941c0a1490 0x7f941c0a3940 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f943010e2a0 0x7f9430113d10 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f943006c910 0x7f943011ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:57.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 --2- 172.21.15.151:0/113469688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f943006d3a0 0x7f943011b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:53:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.861+0000 7f94375ff700 1 -- 172.21.15.151:0/113469688 >> 172.21.15.151:0/113469688 conn(0x7f943006bd70 msgr2=0x7f943006f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:53:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.862+0000 7f94375ff700 1 -- 172.21.15.151:0/113469688 shutdown_connections 2023-07-21T22:53:57.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:53:57.862+0000 7f94375ff700 1 -- 172.21.15.151:0/113469688 wait complete. 2023-07-21T22:53:58.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:53:57 smithi187 ceph-mon[96918]: pgmap v1104: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 1.19k op/s 2023-07-21T22:53:58.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:53:57 smithi195 ceph-mon[97365]: pgmap v1104: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 1.19k op/s 2023-07-21T22:53:58.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:53:57 smithi151 ceph-mon[95510]: pgmap v1104: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 1.19k op/s 2023-07-21T22:53:59.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 65.0 s, 413.2 tps, lat 239.966 ms stddev 50.284 2023-07-21T22:54:00.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:00 smithi195 ceph-mon[97365]: pgmap v1105: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 10 MiB/s wr, 779 op/s 2023-07-21T22:54:00.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:00 smithi151 ceph-mon[95510]: pgmap v1105: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 10 MiB/s wr, 779 op/s 2023-07-21T22:54:01.289 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:00 smithi187 ceph-mon[96918]: pgmap v1105: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 10 MiB/s wr, 779 op/s 2023-07-21T22:54:02.875 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:02 smithi187 ceph-mon[96918]: pgmap v1106: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 10 MiB/s wr, 779 op/s 2023-07-21T22:54:02.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:02 smithi195 ceph-mon[97365]: pgmap v1106: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 10 MiB/s wr, 779 op/s 2023-07-21T22:54:02.948 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:02 smithi151 ceph-mon[95510]: pgmap v1106: 97 pgs: 97 active+clean; 13 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 865 KiB/s rd, 10 MiB/s wr, 779 op/s 2023-07-21T22:54:04.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 70.0 s, 306.2 tps, lat 321.842 ms stddev 147.825 2023-07-21T22:54:04.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:04 smithi187 ceph-mon[96918]: pgmap v1107: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.18k op/s 2023-07-21T22:54:04.899 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:04 smithi195 ceph-mon[97365]: pgmap v1107: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.18k op/s 2023-07-21T22:54:04.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:04 smithi151 ceph-mon[95510]: pgmap v1107: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.18k op/s 2023-07-21T22:54:05.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:05 smithi187 ceph-mon[96918]: osdmap e147: 12 total, 12 up, 12 in 2023-07-21T22:54:05.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:05 smithi195 ceph-mon[97365]: osdmap e147: 12 total, 12 up, 12 in 2023-07-21T22:54:05.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:05 smithi151 ceph-mon[95510]: osdmap e147: 12 total, 12 up, 12 in 2023-07-21T22:54:06.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:06 smithi187 ceph-mon[96918]: pgmap v1109: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 13 MiB/s wr, 969 op/s 2023-07-21T22:54:06.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:06 smithi195 ceph-mon[97365]: pgmap v1109: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 13 MiB/s wr, 969 op/s 2023-07-21T22:54:06.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:06 smithi151 ceph-mon[95510]: pgmap v1109: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 984 KiB/s rd, 13 MiB/s wr, 969 op/s 2023-07-21T22:54:08.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:07 smithi187 ceph-mon[96918]: pgmap v1110: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 9.8 MiB/s wr, 753 op/s 2023-07-21T22:54:08.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:07 smithi195 ceph-mon[97365]: pgmap v1110: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 9.8 MiB/s wr, 753 op/s 2023-07-21T22:54:08.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:07 smithi151 ceph-mon[95510]: pgmap v1110: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 741 KiB/s rd, 9.8 MiB/s wr, 753 op/s 2023-07-21T22:54:09.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 75.0 s, 208.2 tps, lat 484.961 ms stddev 210.906 2023-07-21T22:54:10.868 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:10 smithi187 ceph-mon[96918]: pgmap v1111: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 9.8 MiB/s wr, 753 op/s 2023-07-21T22:54:10.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:10 smithi195 ceph-mon[97365]: pgmap v1111: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 9.8 MiB/s wr, 753 op/s 2023-07-21T22:54:10.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:10 smithi151 ceph-mon[95510]: pgmap v1111: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 9.8 MiB/s wr, 753 op/s 2023-07-21T22:54:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.103+0000 7f2afebff700 1 -- 172.21.15.151:0/295863368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af810e2a0 msgr2=0x7f2af810e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.103+0000 7f2afebff700 1 --2- 172.21.15.151:0/295863368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af810e2a0 0x7f2af810e670 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0098f0 tx=0x7f2aec009c00 comp rx=0 tx=0).stop 2023-07-21T22:54:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.103+0000 7f2afebff700 1 -- 172.21.15.151:0/295863368 shutdown_connections 2023-07-21T22:54:11.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.103+0000 7f2afebff700 1 --2- 172.21.15.151:0/295863368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af810e2a0 0x7f2af810e670 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.103+0000 7f2afebff700 1 --2- 172.21.15.151:0/295863368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af806d3a0 0x7f2af811b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.103+0000 7f2afebff700 1 --2- 172.21.15.151:0/295863368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2af806c910 0x7f2af806cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.103+0000 7f2afebff700 1 -- 172.21.15.151:0/295863368 >> 172.21.15.151:0/295863368 conn(0x7f2af806bd70 msgr2=0x7f2af8070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.108+0000 7f2afebff700 1 -- 172.21.15.151:0/295863368 shutdown_connections 2023-07-21T22:54:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.108+0000 7f2afebff700 1 -- 172.21.15.151:0/295863368 wait complete. 2023-07-21T22:54:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.109+0000 7f2afebff700 1 Processor -- start 2023-07-21T22:54:11.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.110+0000 7f2afebff700 1 -- start start 2023-07-21T22:54:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.110+0000 7f2afebff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af806c910 0x7f2af80782b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.110+0000 7f2afebff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af806d3a0 0x7f2af8078810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.110+0000 7f2afebff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2af810e2a0 0x7f2af8073160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.110+0000 7f2afebff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8073930 con 0x7f2af806d3a0 2023-07-21T22:54:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.110+0000 7f2afebff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8073aa0 con 0x7f2af806c910 2023-07-21T22:54:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.110+0000 7f2afebff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2af8073c60 con 0x7f2af810e2a0 2023-07-21T22:54:11.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.111+0000 7f2afd19c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2af810e2a0 0x7f2af8073160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.111+0000 7f2afd19c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2af810e2a0 0x7f2af8073160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38110/0 (socket says 172.21.15.151:38110) 2023-07-21T22:54:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.111+0000 7f2afd19c700 1 -- 172.21.15.151:0/2130598074 learned_addr learned my addr 172.21.15.151:0/2130598074 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.111+0000 7f2afc99b700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af806c910 0x7f2af80782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.114+0000 7f2afc99b700 1 -- 172.21.15.151:0/2130598074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2af810e2a0 msgr2=0x7f2af8073160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.114+0000 7f2afc99b700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2af810e2a0 0x7f2af8073160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.114+0000 7f2afc99b700 1 -- 172.21.15.151:0/2130598074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af806d3a0 msgr2=0x7f2af8078810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.114+0000 7f2afc99b700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af806d3a0 0x7f2af8078810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.114+0000 7f2afc99b700 1 -- 172.21.15.151:0/2130598074 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae40095f0 con 0x7f2af806c910 2023-07-21T22:54:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.115+0000 7f2afc99b700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af806c910 0x7f2af80782b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009810 tx=0x7f2aec00fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:11.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.117+0000 7f2af5ffb700 1 -- 172.21.15.151:0/2130598074 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec01c070 con 0x7f2af806c910 2023-07-21T22:54:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.118+0000 7f2af5ffb700 1 -- 172.21.15.151:0/2130598074 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2aec005040 con 0x7f2af806c910 2023-07-21T22:54:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.118+0000 7f2af5ffb700 1 -- 172.21.15.151:0/2130598074 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec003970 con 0x7f2af806c910 2023-07-21T22:54:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.118+0000 7f2afebff700 1 -- 172.21.15.151:0/2130598074 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aec009520 con 0x7f2af806c910 2023-07-21T22:54:11.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.118+0000 7f2afebff700 1 -- 172.21.15.151:0/2130598074 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af8080040 con 0x7f2af806c910 2023-07-21T22:54:11.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.130+0000 7f2b125d6b80 1 Processor -- start 2023-07-21T22:54:11.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.133+0000 7f2af5ffb700 1 -- 172.21.15.151:0/2130598074 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2aec020030 con 0x7f2af806c910 2023-07-21T22:54:11.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.133+0000 7f2b125d6b80 1 -- start start 2023-07-21T22:54:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.134+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b85cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.134+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86210 0x55d696b7ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.134+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b804a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.134+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696a85c50 con 0x55d696b86210 2023-07-21T22:54:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.134+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696ad89e0 con 0x55d6969dc6b0 2023-07-21T22:54:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.134+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696ad1e70 con 0x55d696b86660 2023-07-21T22:54:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.135+0000 7f2afd19c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b85cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.135+0000 7f2afd19c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b85cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54810/0 (socket says 172.21.15.151:54810) 2023-07-21T22:54:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.135+0000 7f2afd19c700 1 -- 172.21.15.151:0/2054053227 learned_addr learned my addr 172.21.15.151:0/2054053227 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.136+0000 7f2afc99b700 1 --2- 172.21.15.151:0/2054053227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86210 0x55d696b7ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.136+0000 7f2afd19c700 1 -- 172.21.15.151:0/2054053227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 msgr2=0x55d696b804a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:54:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.136+0000 7f2afd19c700 1 --2- 172.21.15.151:0/2054053227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b804a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.136+0000 7f2afd19c700 1 -- 172.21.15.151:0/2054053227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86210 msgr2=0x55d696b7ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.136+0000 7f2afd19c700 1 --2- 172.21.15.151:0/2054053227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86210 0x55d696b7ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.136+0000 7f2afd19c700 1 -- 172.21.15.151:0/2054053227 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6968ffd80 con 0x55d6969dc6b0 2023-07-21T22:54:11.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.136+0000 7f2af5ffb700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ae80a1490 0x7f2ae80a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.137+0000 7f2af5ffb700 1 -- 172.21.15.151:0/2130598074 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f2aec0cdab0 con 0x7f2af806c910 2023-07-21T22:54:11.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.137+0000 7f2afc99b700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ae80a1490 0x7f2ae80a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.138+0000 7f2afd19c700 1 --2- 172.21.15.151:0/2054053227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b85cd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e190 tx=0x7f2af0009660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54a97d0933fb5eb0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.139+0000 7f2ae2ffd700 1 -- 172.21.15.151:0/2054053227 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0009bb0 con 0x55d6969dc6b0 2023-07-21T22:54:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.139+0000 7f2ae2ffd700 1 -- 172.21.15.151:0/2054053227 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2af000f040 con 0x55d6969dc6b0 2023-07-21T22:54:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.139+0000 7f2ae2ffd700 1 -- 172.21.15.151:0/2054053227 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0013810 con 0x55d6969dc6b0 2023-07-21T22:54:11.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.140+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2054053227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 msgr2=0x55d696b85cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.140+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/2054053227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b85cd0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2af000e190 tx=0x7f2af0009660 comp rx=0 tx=0).stop 2023-07-21T22:54:11.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.140+0000 7f2afc99b700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ae80a1490 0x7f2ae80a3940 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0d0fd0 tx=0x7f2aec009c00 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.141+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2054053227 shutdown_connections 2023-07-21T22:54:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.141+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/2054053227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b85cd0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.141+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/2054053227 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b804a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.141+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/2054053227 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86210 0x55d696b7ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.141+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2054053227 >> 172.21.15.151:0/2054053227 conn(0x55d696b75ae0 msgr2=0x55d696b7b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.141+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2054053227 shutdown_connections 2023-07-21T22:54:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.141+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2054053227 wait complete. 2023-07-21T22:54:11.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.142+0000 7f2b125d6b80 1 -- start start 2023-07-21T22:54:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.143+0000 7f2b125d6b80 1 Processor -- start 2023-07-21T22:54:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.143+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b8c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.143+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86210 0x55d696b897f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.143+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b89e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.144+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696a71a60 con 0x55d696b86210 2023-07-21T22:54:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.144+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696a71760 con 0x55d6969dc6b0 2023-07-21T22:54:11.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.144+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6969558c0 con 0x55d696b86660 2023-07-21T22:54:11.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.144+0000 7f2b125d6b80 10 client.0 _ll_register_callbacks cb 0x55d696a6f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:54:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.144+0000 7f2afd19c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b89e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.144+0000 7f2afd19c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b89e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38120/0 (socket says 172.21.15.151:38120) 2023-07-21T22:54:11.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.144+0000 7f2afd19c700 1 -- 172.21.15.151:0/1797507169 learned_addr learned my addr 172.21.15.151:0/1797507169 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.145+0000 7f2afd19c700 1 -- 172.21.15.151:0/1797507169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 msgr2=0x55d696b8c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.145+0000 7f2afd19c700 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b8c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.145+0000 7f2afd19c700 1 -- 172.21.15.151:0/1797507169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86210 msgr2=0x55d696b897f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.145+0000 7f2afd19c700 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86210 0x55d696b897f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.145+0000 7f2afd19c700 1 -- 172.21.15.151:0/1797507169 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2af0009d10 con 0x55d696b86660 2023-07-21T22:54:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.146+0000 7f2afd19c700 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b89e00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2af000ef80 tx=0x7f2af000efb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7bb417f9ea55a366 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:11.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.146+0000 7f2ad7fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:54:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.146+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1797507169 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af0024070 con 0x55d696b86660 2023-07-21T22:54:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.146+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1797507169 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f2af0006e40 con 0x55d696b86660 2023-07-21T22:54:11.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.148+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1797507169 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d696a2b490 con 0x55d696b86660 2023-07-21T22:54:11.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.148+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1797507169 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2af0013c00 con 0x55d696b86660 2023-07-21T22:54:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.148+0000 7f2b125d6b80 10 client.28789 fetch_fsmap learned FSMap version 105 2023-07-21T22:54:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.148+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1797507169 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55d6968e8c00 con 0x55d696b86660 2023-07-21T22:54:11.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.149+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1797507169 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d696a2b490 con 0x55d696b86660 2023-07-21T22:54:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.150+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1797507169 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2af0014480 con 0x55d696b86660 2023-07-21T22:54:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.150+0000 7f2b125d6b80 10 client.28789 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:54:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.150+0000 7f2b125d6b80 10 client.28789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:54:11.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.150+0000 7f2b125d6b80 20 client.28789 populate_metadata read hostname 'smithi151' 2023-07-21T22:54:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.150+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d696baaa70 0x55d696bace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.150+0000 7f2b125d6b80 4 client.28789 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:54:11.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.150+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1797507169 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d696acae50 con 0x55d696baaa70 2023-07-21T22:54:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.154+0000 7f2af7fff700 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d696baaa70 0x55d696bace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.156+0000 7f2af7fff700 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d696baaa70 0x55d696bace80 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a94c6ba18b2d7c08 server_cookie=808af177c1bc4270 in_seq=0 out_seq=0 2023-07-21T22:54:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.156+0000 7f2ad7fff700 10 client.28789 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:11.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.156+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1797507169 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d696acae50 con 0x55d696baaa70 2023-07-21T22:54:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.156+0000 7f2ad7fff700 10 client.28789 handle_command_reply: tid=0 2023-07-21T22:54:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.156+0000 7f2b125d6b80 1 client.28789 shutdown 2023-07-21T22:54:11.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.157+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1797507169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 msgr2=0x55d696b89e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:11.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.157+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b89e00 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2af000ef80 tx=0x7f2af000efb0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.157+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1797507169 shutdown_connections 2023-07-21T22:54:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.157+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d696baaa70 0x55d696bace80 crc :-1 s=READY pgs=411 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.157+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b8c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.157+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b89e00 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.157+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1797507169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86210 0x55d696b897f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.157+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1797507169 >> 172.21.15.151:0/1797507169 conn(0x55d696b75ae0 msgr2=0x55d696b7a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.157+0000 7f2ad7fff700 0 client.28789 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.159+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1797507169 shutdown_connections 2023-07-21T22:54:11.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.160+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1797507169 wait complete. 2023-07-21T22:54:11.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.165+0000 7f2b125d6b80 20 client.28789 trim_cache size 0 max 16384 2023-07-21T22:54:11.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.192+0000 7f2b125d6b80 1 Processor -- start 2023-07-21T22:54:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.192+0000 7f2b125d6b80 1 -- start start 2023-07-21T22:54:11.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.193+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6969dc6b0 0x55d696b90c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.193+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d696b86210 0x55d696b871b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.193+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b8c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.193+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696b85900 con 0x55d6969dc6b0 2023-07-21T22:54:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.193+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696b844b0 con 0x55d696b86210 2023-07-21T22:54:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.193+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696b91170 con 0x55d696b86660 2023-07-21T22:54:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.193+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d696b86210 0x55d696b871b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.193+0000 7f2af7fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d696b86210 0x55d696b871b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54820/0 (socket says 172.21.15.151:54820) 2023-07-21T22:54:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.193+0000 7f2af7fff700 1 -- 172.21.15.151:0/2295480499 learned_addr learned my addr 172.21.15.151:0/2295480499 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:11.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.194+0000 7f2afd19c700 1 --2- 172.21.15.151:0/2295480499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b8c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.194+0000 7f2af7fff700 1 -- 172.21.15.151:0/2295480499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 msgr2=0x55d696b8c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.194+0000 7f2af7fff700 1 --2- 172.21.15.151:0/2295480499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b8c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.194+0000 7f2af7fff700 1 -- 172.21.15.151:0/2295480499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6969dc6b0 msgr2=0x55d696b90c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.194+0000 7f2af7fff700 1 --2- 172.21.15.151:0/2295480499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6969dc6b0 0x55d696b90c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.194+0000 7f2af7fff700 1 -- 172.21.15.151:0/2295480499 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6969261f0 con 0x55d696b86210 2023-07-21T22:54:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.195+0000 7f2af7fff700 1 --2- 172.21.15.151:0/2295480499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d696b86210 0x55d696b871b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2af8074b40 tx=0x7f2ae4009510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c51d0cb8d7edc06 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.195+0000 7f2ae37fe700 1 -- 172.21.15.151:0/2295480499 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4015040 con 0x55d696b86210 2023-07-21T22:54:11.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.195+0000 7f2ae37fe700 1 -- 172.21.15.151:0/2295480499 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2ae40174c0 con 0x55d696b86210 2023-07-21T22:54:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.195+0000 7f2ae37fe700 1 -- 172.21.15.151:0/2295480499 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4017b50 con 0x55d696b86210 2023-07-21T22:54:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.196+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2295480499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d696b86210 msgr2=0x55d696b871b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.196+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/2295480499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d696b86210 0x55d696b871b0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2af8074b40 tx=0x7f2ae4009510 comp rx=0 tx=0).stop 2023-07-21T22:54:11.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.197+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2295480499 shutdown_connections 2023-07-21T22:54:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.197+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/2295480499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86660 0x55d696b8c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.197+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/2295480499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6969dc6b0 0x55d696b90c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.197+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/2295480499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d696b86210 0x55d696b871b0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.197+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2295480499 >> 172.21.15.151:0/2295480499 conn(0x55d696b75ae0 msgr2=0x55d696b86aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.197+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2295480499 shutdown_connections 2023-07-21T22:54:11.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.197+0000 7f2b125d6b80 1 -- 172.21.15.151:0/2295480499 wait complete. 2023-07-21T22:54:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.197+0000 7f2b125d6b80 1 -- start start 2023-07-21T22:54:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.198+0000 7f2b125d6b80 1 Processor -- start 2023-07-21T22:54:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.199+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b82da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.199+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86210 0x55d696b81730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.199+0000 7f2b125d6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86660 0x55d696b81c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.199+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696b821b0 con 0x55d696b86660 2023-07-21T22:54:11.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.199+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696b822f0 con 0x55d6969dc6b0 2023-07-21T22:54:11.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.199+0000 7f2b125d6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d696b824b0 con 0x55d696b86210 2023-07-21T22:54:11.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.199+0000 7f2b125d6b80 10 client.0 _ll_register_callbacks cb 0x7f2af0009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:54:11.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.199+0000 7f2afd19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86660 0x55d696b81c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.200+0000 7f2afd19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86660 0x55d696b81c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50128/0 (socket says 172.21.15.151:50128) 2023-07-21T22:54:11.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.200+0000 7f2afd19c700 1 -- 172.21.15.151:0/1514471648 learned_addr learned my addr 172.21.15.151:0/1514471648 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:11.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.200+0000 7f2af7fff700 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86210 0x55d696b81730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.200+0000 7f2af7fff700 1 -- 172.21.15.151:0/1514471648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 msgr2=0x55d696b82da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:11.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.200+0000 7f2af7fff700 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b82da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.200+0000 7f2af7fff700 1 -- 172.21.15.151:0/1514471648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86660 msgr2=0x55d696b81c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:11.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.200+0000 7f2af7fff700 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86660 0x55d696b81c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.200+0000 7f2af7fff700 1 -- 172.21.15.151:0/1514471648 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ae4009ce0 con 0x55d696b86210 2023-07-21T22:54:11.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.201+0000 7f2af7fff700 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86210 0x55d696b81730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4012010 tx=0x7f2ae4017350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46b44147ad83c44a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:11.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.201+0000 7f2ad7fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:54:11.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.201+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1514471648 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4015050 con 0x55d696b86210 2023-07-21T22:54:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.201+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1514471648 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(147..147 src has 1..147) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f2ae4004830 con 0x55d696b86210 2023-07-21T22:54:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.201+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1514471648 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2af000f040 con 0x55d696b86210 2023-07-21T22:54:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.202+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1514471648 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ae4024070 con 0x55d696b86210 2023-07-21T22:54:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.203+0000 7f2b125d6b80 10 client.28795 fetch_fsmap learned FSMap version 105 2023-07-21T22:54:11.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.203+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1514471648 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55d6968fe250 con 0x55d696b86210 2023-07-21T22:54:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.204+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1514471648 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2af000f040 con 0x55d696b86210 2023-07-21T22:54:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.204+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1514471648 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f2ae4032720 con 0x55d696b86210 2023-07-21T22:54:11.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.205+0000 7f2b125d6b80 10 client.28795 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:54:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.205+0000 7f2b125d6b80 10 client.28795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:54:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.205+0000 7f2b125d6b80 20 client.28795 populate_metadata read hostname 'smithi151' 2023-07-21T22:54:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.205+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d696bffc80 0x55d696c02090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.205+0000 7f2b125d6b80 4 client.28795 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:54:11.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.205+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1514471648 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d696a8cff0 con 0x55d696bffc80 2023-07-21T22:54:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.206+0000 7f2afd19c700 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d696bffc80 0x55d696c02090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.207+0000 7f2afd19c700 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d696bffc80 0x55d696c02090 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b97666b732cc62f9 server_cookie=b012fe949dc65639 in_seq=0 out_seq=0 2023-07-21T22:54:11.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.207+0000 7f2ad7fff700 10 client.28795 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.238+0000 7f2ad7fff700 1 -- 172.21.15.151:0/1514471648 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d696a8cff0 con 0x55d696bffc80 2023-07-21T22:54:11.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.238+0000 7f2ad7fff700 10 client.28795 handle_command_reply: tid=0 2023-07-21T22:54:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.238+0000 7f2b125d6b80 1 client.28795 shutdown 2023-07-21T22:54:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1514471648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86210 msgr2=0x55d696b81730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86210 0x55d696b81730 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4012010 tx=0x7f2ae4017350 comp rx=0 tx=0).stop 2023-07-21T22:54:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1514471648 shutdown_connections 2023-07-21T22:54:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d696bffc80 0x55d696c02090 crc :-1 s=READY pgs=412 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6969dc6b0 0x55d696b82da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d696b86660 0x55d696b81c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 --2- 172.21.15.151:0/1514471648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d696b86210 0x55d696b81730 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1514471648 >> 172.21.15.151:0/1514471648 conn(0x55d696b75ae0 msgr2=0x55d696b872c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2ad7fff700 0 client.28795 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1514471648 shutdown_connections 2023-07-21T22:54:11.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.239+0000 7f2b125d6b80 1 -- 172.21.15.151:0/1514471648 wait complete. 2023-07-21T22:54:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.240+0000 7f2b125d6b80 20 client.28795 trim_cache size 0 max 16384 2023-07-21T22:54:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:54:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:54:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:54:11.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:54:11.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.240+0000 7f2afebff700 1 -- 172.21.15.151:0/2130598074 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ae80a1490 msgr2=0x7f2ae80a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:11.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.240+0000 7f2afebff700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ae80a1490 0x7f2ae80a3940 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2aec0d0fd0 tx=0x7f2aec009c00 comp rx=0 tx=0).stop 2023-07-21T22:54:11.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 -- 172.21.15.151:0/2130598074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af806c910 msgr2=0x7f2af80782b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af806c910 0x7f2af80782b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f2aec009810 tx=0x7f2aec00fa00 comp rx=0 tx=0).stop 2023-07-21T22:54:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 -- 172.21.15.151:0/2130598074 shutdown_connections 2023-07-21T22:54:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2ae80a1490 0x7f2ae80a3940 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af806c910 0x7f2af80782b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2af810e2a0 0x7f2af8073160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 --2- 172.21.15.151:0/2130598074 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2af806d3a0 0x7f2af8078810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 -- 172.21.15.151:0/2130598074 >> 172.21.15.151:0/2130598074 conn(0x7f2af806bd70 msgr2=0x7f2af8108010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:11.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 -- 172.21.15.151:0/2130598074 shutdown_connections 2023-07-21T22:54:11.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:11.241+0000 7f2afebff700 1 -- 172.21.15.151:0/2130598074 wait complete. 2023-07-21T22:54:12.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:12 smithi187 ceph-mon[96918]: pgmap v1112: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 9.8 MiB/s wr, 753 op/s 2023-07-21T22:54:12.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:12 smithi187 ceph-mon[96918]: osdmap e148: 12 total, 12 up, 12 in 2023-07-21T22:54:12.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:12 smithi195 ceph-mon[97365]: pgmap v1112: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 9.8 MiB/s wr, 753 op/s 2023-07-21T22:54:12.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:12 smithi195 ceph-mon[97365]: osdmap e148: 12 total, 12 up, 12 in 2023-07-21T22:54:12.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:12 smithi151 ceph-mon[95510]: pgmap v1112: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 740 KiB/s rd, 9.8 MiB/s wr, 753 op/s 2023-07-21T22:54:12.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:12 smithi151 ceph-mon[95510]: osdmap e148: 12 total, 12 up, 12 in 2023-07-21T22:54:14.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 80.0 s, 321.0 tps, lat 315.970 ms stddev 103.456 2023-07-21T22:54:14.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:14 smithi187 ceph-mon[96918]: pgmap v1114: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 9.7 MiB/s wr, 742 op/s 2023-07-21T22:54:14.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:14 smithi195 ceph-mon[97365]: pgmap v1114: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 9.7 MiB/s wr, 742 op/s 2023-07-21T22:54:14.944 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:14 smithi151 ceph-mon[95510]: pgmap v1114: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 902 KiB/s rd, 9.7 MiB/s wr, 742 op/s 2023-07-21T22:54:16.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:16 smithi187 ceph-mon[96918]: pgmap v1115: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 8.6 MiB/s wr, 659 op/s 2023-07-21T22:54:16.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:16 smithi195 ceph-mon[97365]: pgmap v1115: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 8.6 MiB/s wr, 659 op/s 2023-07-21T22:54:16.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:16 smithi151 ceph-mon[95510]: pgmap v1115: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 800 KiB/s rd, 8.6 MiB/s wr, 659 op/s 2023-07-21T22:54:18.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:17 smithi187 ceph-mon[96918]: pgmap v1116: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 11 MiB/s wr, 880 op/s 2023-07-21T22:54:18.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:17 smithi195 ceph-mon[97365]: pgmap v1116: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 11 MiB/s wr, 880 op/s 2023-07-21T22:54:18.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:17 smithi151 ceph-mon[95510]: pgmap v1116: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 11 MiB/s wr, 880 op/s 2023-07-21T22:54:19.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 85.0 s, 352.2 tps, lat 276.179 ms stddev 280.609 2023-07-21T22:54:20.868 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:20 smithi187 ceph-mon[96918]: pgmap v1117: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 11 MiB/s wr, 880 op/s 2023-07-21T22:54:20.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:20 smithi195 ceph-mon[97365]: pgmap v1117: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 11 MiB/s wr, 880 op/s 2023-07-21T22:54:20.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:20 smithi151 ceph-mon[95510]: pgmap v1117: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 11 MiB/s wr, 880 op/s 2023-07-21T22:54:22.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:22 smithi187 ceph-mon[96918]: pgmap v1118: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 11 MiB/s wr, 880 op/s 2023-07-21T22:54:22.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:22 smithi195 ceph-mon[97365]: pgmap v1118: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 11 MiB/s wr, 880 op/s 2023-07-21T22:54:22.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:22 smithi151 ceph-mon[95510]: pgmap v1118: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 983 KiB/s rd, 11 MiB/s wr, 880 op/s 2023-07-21T22:54:24.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 90.0 s, 223.8 tps, lat 463.960 ms stddev 481.233 2023-07-21T22:54:24.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.438+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1101762511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb4104e00 msgr2=0x7fdfb410c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.438+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1101762511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb4104e00 0x7fdfb410c9d0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00b0d0 tx=0x7fdfac00b3e0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.438+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1101762511 shutdown_connections 2023-07-21T22:54:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.438+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1101762511 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb40ffdc0 0x7fdfb4100190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.438+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1101762511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb4104e00 0x7fdfb410c9d0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.438+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1101762511 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb4100760 0x7fdfb4104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.438+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1101762511 >> 172.21.15.151:0/1101762511 conn(0x7fdfb40fb650 msgr2=0x7fdfb40fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.438+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1101762511 shutdown_connections 2023-07-21T22:54:24.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.439+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1101762511 wait complete. 2023-07-21T22:54:24.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.440+0000 7fdfb97ff700 1 Processor -- start 2023-07-21T22:54:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.440+0000 7fdfb97ff700 1 -- start start 2023-07-21T22:54:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.440+0000 7fdfb97ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb40ffdc0 0x7fdfb41999c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.440+0000 7fdfb97ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb4100760 0x7fdfb4199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.440+0000 7fdfb97ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb4104e00 0x7fdfb41938c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.440+0000 7fdfb97ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4193f30 con 0x7fdfb4104e00 2023-07-21T22:54:24.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.440+0000 7fdfb97ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb41940a0 con 0x7fdfb40ffdc0 2023-07-21T22:54:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.440+0000 7fdfb97ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfb4194260 con 0x7fdfb4100760 2023-07-21T22:54:24.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb40ffdc0 0x7fdfb41999c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb4104e00 0x7fdfb41938c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb40ffdc0 0x7fdfb41999c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37720/0 (socket says 172.21.15.151:37720) 2023-07-21T22:54:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb2ffd700 1 -- 172.21.15.151:0/1230361904 learned_addr learned my addr 172.21.15.151:0/1230361904 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb4100760 0x7fdfb4199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb37fe700 1 -- 172.21.15.151:0/1230361904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb4100760 msgr2=0x7fdfb4199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:24.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb37fe700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb4100760 0x7fdfb4199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb37fe700 1 -- 172.21.15.151:0/1230361904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb40ffdc0 msgr2=0x7fdfb41999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb37fe700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb40ffdc0 0x7fdfb41999c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb37fe700 1 -- 172.21.15.151:0/1230361904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfac009d00 con 0x7fdfb4104e00 2023-07-21T22:54:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.441+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb4100760 0x7fdfb4199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:54:24.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.442+0000 7fdfb37fe700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb4104e00 0x7fdfb41938c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00b770 tx=0x7fdfac010ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.442+0000 7fdf9bfff700 1 -- 172.21.15.151:0/1230361904 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac00beb0 con 0x7fdfb4104e00 2023-07-21T22:54:24.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.442+0000 7fdf9bfff700 1 -- 172.21.15.151:0/1230361904 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfac008f00 con 0x7fdfb4104e00 2023-07-21T22:54:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.442+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1230361904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfb41944e0 con 0x7fdfb4104e00 2023-07-21T22:54:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.442+0000 7fdf9bfff700 1 -- 172.21.15.151:0/1230361904 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfac021a10 con 0x7fdfb4104e00 2023-07-21T22:54:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.442+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1230361904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfb41a09b0 con 0x7fdfb4104e00 2023-07-21T22:54:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.446+0000 7fdf9bfff700 1 -- 172.21.15.151:0/1230361904 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdfac021bb0 con 0x7fdfb4104e00 2023-07-21T22:54:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.447+0000 7fdfcd0a5b80 1 Processor -- start 2023-07-21T22:54:24.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.447+0000 7fdfcd0a5b80 1 -- start start 2023-07-21T22:54:24.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9210 0x55ca280c2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9660 0x55ca280c34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca27fc8c50 con 0x55ca27f1f6b0 2023-07-21T22:54:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca2801b9e0 con 0x55ca280c9210 2023-07-21T22:54:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca28014e70 con 0x55ca280c9660 2023-07-21T22:54:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfb2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9210 0x55ca280c2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfb2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9210 0x55ca280c2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37722/0 (socket says 172.21.15.151:37722) 2023-07-21T22:54:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfb2ffd700 1 -- 172.21.15.151:0/1387741544 learned_addr learned my addr 172.21.15.151:0/1387741544 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1387741544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.448+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1387741544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9660 0x55ca280c34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdf9bfff700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a1340 0x7fdf9c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdfb27fc700 1 -- 172.21.15.151:0/1387741544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9660 msgr2=0x55ca280c34a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1387741544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9660 0x55ca280c34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdfb27fc700 1 -- 172.21.15.151:0/1387741544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9210 msgr2=0x55ca280c2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:24.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1387741544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9210 0x55ca280c2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdfb27fc700 1 -- 172.21.15.151:0/1387741544 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca27e42d80 con 0x55ca27f1f6b0 2023-07-21T22:54:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdf9bfff700 1 -- 172.21.15.151:0/1230361904 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdfac0d29a0 con 0x7fdfb4104e00 2023-07-21T22:54:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdfb37fe700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a1340 0x7fdf9c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1387741544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280c8cd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4068570 tx=0x7fdfa800d5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f647c5c1eccf67 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:24.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdf997fa700 1 -- 172.21.15.151:0/1387741544 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8013e60 con 0x55ca27f1f6b0 2023-07-21T22:54:24.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdf997fa700 1 -- 172.21.15.151:0/1387741544 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfa80044c0 con 0x55ca27f1f6b0 2023-07-21T22:54:24.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.449+0000 7fdf997fa700 1 -- 172.21.15.151:0/1387741544 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8010460 con 0x55ca27f1f6b0 2023-07-21T22:54:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.450+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1387741544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 msgr2=0x55ca280c8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.450+0000 7fdfb37fe700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a1340 0x7fdf9c0a37f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0d0220 tx=0x7fdfac00b3e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.450+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1387741544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280c8cd0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fdfb4068570 tx=0x7fdfa800d5f0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.450+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1387741544 shutdown_connections 2023-07-21T22:54:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.450+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1387741544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9660 0x55ca280c34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.450+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1387741544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280c8cd0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.450+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1387741544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9210 0x55ca280c2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.450+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1387741544 >> 172.21.15.151:0/1387741544 conn(0x55ca280b8ae0 msgr2=0x55ca280be0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.450+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1387741544 shutdown_connections 2023-07-21T22:54:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.451+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1387741544 wait complete. 2023-07-21T22:54:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.451+0000 7fdfcd0a5b80 1 -- start start 2023-07-21T22:54:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.451+0000 7fdfcd0a5b80 1 Processor -- start 2023-07-21T22:54:24.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280cf5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 0x55ca280cc8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 0x55ca280ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca27fb4a60 con 0x55ca27f1f6b0 2023-07-21T22:54:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca27fb4760 con 0x55ca280c9660 2023-07-21T22:54:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca27e988c0 con 0x55ca280c9210 2023-07-21T22:54:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfcd0a5b80 10 client.0 _ll_register_callbacks cb 0x55ca27fb2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:54:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfb27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280cf5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfb27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280cf5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55262/0 (socket says 172.21.15.151:55262) 2023-07-21T22:54:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfb27fc700 1 -- 172.21.15.151:0/1978905448 learned_addr learned my addr 172.21.15.151:0/1978905448 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 0x55ca280cc8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.452+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 0x55ca280ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.453+0000 7fdfb2ffd700 1 -- 172.21.15.151:0/1978905448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 msgr2=0x55ca280ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.453+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 0x55ca280ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.453+0000 7fdfb2ffd700 1 -- 172.21.15.151:0/1978905448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 msgr2=0x55ca280cf5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:24.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.453+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280cf5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.453+0000 7fdfb2ffd700 1 -- 172.21.15.151:0/1978905448 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa800dd20 con 0x55ca280c9210 2023-07-21T22:54:24.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.453+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 0x55ca280cc8b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4012840 tx=0x7fdfa4012b50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8a11898ce2b3865 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:24.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.453+0000 7fdf96ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:54:24.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.453+0000 7fdf96ff5700 1 -- 172.21.15.151:0/1978905448 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4017070 con 0x55ca280c9210 2023-07-21T22:54:24.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.454+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1978905448 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ca27f6e490 con 0x55ca280c9210 2023-07-21T22:54:24.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.454+0000 7fdf96ff5700 1 -- 172.21.15.151:0/1978905448 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(148..148 src has 1..148) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdfa4004050 con 0x55ca280c9210 2023-07-21T22:54:24.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.454+0000 7fdf96ff5700 1 -- 172.21.15.151:0/1978905448 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfa4004210 con 0x55ca280c9210 2023-07-21T22:54:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.454+0000 7fdfcd0a5b80 10 client.28807 fetch_fsmap learned FSMap version 105 2023-07-21T22:54:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.454+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1978905448 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55ca27e2bc00 con 0x55ca280c9210 2023-07-21T22:54:24.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.454+0000 7fdf96ff5700 1 -- 172.21.15.151:0/1978905448 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ca27f6e490 con 0x55ca280c9210 2023-07-21T22:54:24.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.455+0000 7fdf96ff5700 1 -- 172.21.15.151:0/1978905448 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdfa4003680 con 0x55ca280c9210 2023-07-21T22:54:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.455+0000 7fdfcd0a5b80 10 client.28807 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:54:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.455+0000 7fdfcd0a5b80 10 client.28807 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:54:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.455+0000 7fdfcd0a5b80 20 client.28807 populate_metadata read hostname 'smithi151' 2023-07-21T22:54:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.455+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca280dcb40 0x55ca280def50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.455+0000 7fdfcd0a5b80 4 client.28807 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:54:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.455+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1978905448 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ca2800de50 con 0x55ca280dcb40 2023-07-21T22:54:24.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.456+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca280dcb40 0x55ca280def50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.456+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca280dcb40 0x55ca280def50 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a0bfb30a9021221 server_cookie=3736ad2270676f68 in_seq=0 out_seq=0 2023-07-21T22:54:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.456+0000 7fdf96ff5700 10 client.28807 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdf96ff5700 1 -- 172.21.15.151:0/1978905448 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ca2800de50 con 0x55ca280dcb40 2023-07-21T22:54:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdf96ff5700 10 client.28807 handle_command_reply: tid=0 2023-07-21T22:54:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdfcd0a5b80 1 client.28807 shutdown 2023-07-21T22:54:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1978905448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 msgr2=0x55ca280cc8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:24.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 0x55ca280cc8b0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fdfa4012840 tx=0x7fdfa4012b50 comp rx=0 tx=0).stop 2023-07-21T22:54:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1978905448 shutdown_connections 2023-07-21T22:54:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca280dcb40 0x55ca280def50 crc :-1 s=READY pgs=413 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 0x55ca280ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdf96ff5700 0 client.28807 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca27f1f6b0 0x55ca280cf5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/1978905448 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 0x55ca280cc8b0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.457+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1978905448 >> 172.21.15.151:0/1978905448 conn(0x55ca280b8ae0 msgr2=0x55ca280bd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:24.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.458+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1978905448 shutdown_connections 2023-07-21T22:54:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.458+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/1978905448 wait complete. 2023-07-21T22:54:24.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.458+0000 7fdfcd0a5b80 20 client.28807 trim_cache size 0 max 16384 2023-07-21T22:54:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.475+0000 7fdfcd0a5b80 1 Processor -- start 2023-07-21T22:54:24.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.475+0000 7fdfcd0a5b80 1 -- start start 2023-07-21T22:54:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.475+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca27f1f6b0 0x55ca280cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.475+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9210 0x55ca280cf160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.475+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 0x55ca280bdb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.475+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca27f6e490 con 0x55ca280c9210 2023-07-21T22:54:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca280b5b50 con 0x55ca280c9660 2023-07-21T22:54:24.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca280becb0 con 0x55ca27f1f6b0 2023-07-21T22:54:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9210 0x55ca280cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9210 0x55ca280cf160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55264/0 (socket says 172.21.15.151:55264) 2023-07-21T22:54:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb2ffd700 1 -- 172.21.15.151:0/2401608126 learned_addr learned my addr 172.21.15.151:0/2401608126 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca27f1f6b0 0x55ca280cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 0x55ca280bdb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb2ffd700 1 -- 172.21.15.151:0/2401608126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca27f1f6b0 msgr2=0x55ca280cc0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:24.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca27f1f6b0 0x55ca280cc0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb2ffd700 1 -- 172.21.15.151:0/2401608126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 msgr2=0x55ca280bdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 0x55ca280bdb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb2ffd700 1 -- 172.21.15.151:0/2401608126 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ca27e691f0 con 0x55ca280c9210 2023-07-21T22:54:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca27f1f6b0 0x55ca280cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:54:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.476+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9210 0x55ca280cf160 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fdfa40096b0 tx=0x7fdfa4012320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87459fe93af6caa6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.477+0000 7fdf99ffb700 1 -- 172.21.15.151:0/2401608126 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa4003e10 con 0x55ca280c9210 2023-07-21T22:54:24.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.477+0000 7fdf99ffb700 1 -- 172.21.15.151:0/2401608126 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfa4018040 con 0x55ca280c9210 2023-07-21T22:54:24.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.477+0000 7fdf99ffb700 1 -- 172.21.15.151:0/2401608126 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa400fb30 con 0x55ca280c9210 2023-07-21T22:54:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.477+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/2401608126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9210 msgr2=0x55ca280cf160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.477+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9210 0x55ca280cf160 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fdfa40096b0 tx=0x7fdfa4012320 comp rx=0 tx=0).stop 2023-07-21T22:54:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.477+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/2401608126 shutdown_connections 2023-07-21T22:54:24.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.477+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca280c9660 0x55ca280bdb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.477+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca27f1f6b0 0x55ca280cc0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.478+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/2401608126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9210 0x55ca280cf160 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.478+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/2401608126 >> 172.21.15.151:0/2401608126 conn(0x55ca280b8ae0 msgr2=0x55ca280c6a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.478+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/2401608126 shutdown_connections 2023-07-21T22:54:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.478+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/2401608126 wait complete. 2023-07-21T22:54:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.478+0000 7fdfcd0a5b80 1 -- start start 2023-07-21T22:54:24.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.478+0000 7fdfcd0a5b80 1 Processor -- start 2023-07-21T22:54:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca27f1f6b0 0x55ca280d35a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 0x55ca280d3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfcd0a5b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9660 0x55ca280d1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca280d2030 con 0x55ca280c9660 2023-07-21T22:54:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca280d2170 con 0x55ca27f1f6b0 2023-07-21T22:54:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfcd0a5b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ca280d2330 con 0x55ca280c9210 2023-07-21T22:54:24.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfcd0a5b80 10 client.0 _ll_register_callbacks cb 0x7fdfa4009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:54:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfb27fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca27f1f6b0 0x55ca280d35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfb27fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca27f1f6b0 0x55ca280d35a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37752/0 (socket says 172.21.15.151:37752) 2023-07-21T22:54:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfb27fc700 1 -- 172.21.15.151:0/593536000 learned_addr learned my addr 172.21.15.151:0/593536000 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9660 0x55ca280d1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.479+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 0x55ca280d3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdfb27fc700 1 -- 172.21.15.151:0/593536000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 msgr2=0x55ca280d3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:24.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 0x55ca280d3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdfb27fc700 1 -- 172.21.15.151:0/593536000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9660 msgr2=0x55ca280d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9660 0x55ca280d1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdfb27fc700 1 -- 172.21.15.151:0/593536000 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ca27e2bc00 con 0x55ca27f1f6b0 2023-07-21T22:54:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdfb27fc700 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca27f1f6b0 0x55ca280d35a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55ca280df830 tx=0x7fdfa8020040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=110c4630b5776ea8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdf96ff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:54:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdf96ff5700 1 -- 172.21.15.151:0/593536000 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8013020 con 0x55ca27f1f6b0 2023-07-21T22:54:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/593536000 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdfa80044c0 con 0x55ca27f1f6b0 2023-07-21T22:54:24.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.480+0000 7fdf96ff5700 1 -- 172.21.15.151:0/593536000 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(148..148 src has 1..148) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdfa8013180 con 0x55ca27f1f6b0 2023-07-21T22:54:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.481+0000 7fdf96ff5700 1 -- 172.21.15.151:0/593536000 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdfa802e340 con 0x55ca27f1f6b0 2023-07-21T22:54:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.481+0000 7fdfcd0a5b80 10 client.28796 fetch_fsmap learned FSMap version 105 2023-07-21T22:54:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.481+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/593536000 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55ca27e41250 con 0x55ca27f1f6b0 2023-07-21T22:54:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.482+0000 7fdf96ff5700 1 -- 172.21.15.151:0/593536000 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdfa803d080 con 0x55ca27f1f6b0 2023-07-21T22:54:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.482+0000 7fdf96ff5700 1 -- 172.21.15.151:0/593536000 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdfa8003bc0 con 0x55ca27f1f6b0 2023-07-21T22:54:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.482+0000 7fdfcd0a5b80 10 client.28796 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:54:24.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.482+0000 7fdfcd0a5b80 10 client.28796 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:54:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.482+0000 7fdfcd0a5b80 20 client.28796 populate_metadata read hostname 'smithi151' 2023-07-21T22:54:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.482+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca28131b30 0x55ca28133f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.482+0000 7fdfcd0a5b80 4 client.28796 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:54:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.482+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/593536000 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ca27fcfff0 con 0x55ca28131b30 2023-07-21T22:54:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.482+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca28131b30 0x55ca28133f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:24.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.483+0000 7fdf96ff5700 10 client.28796 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:24.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.483+0000 7fdfb2ffd700 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca28131b30 0x55ca28133f40 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3bdcf3215e8469b server_cookie=47c559aabbef7b00 in_seq=0 out_seq=0 2023-07-21T22:54:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.515+0000 7fdf96ff5700 1 -- 172.21.15.151:0/593536000 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ca27fcfff0 con 0x55ca28131b30 2023-07-21T22:54:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.515+0000 7fdf96ff5700 10 client.28796 handle_command_reply: tid=0 2023-07-21T22:54:24.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.519+0000 7fdfcd0a5b80 1 client.28796 shutdown 2023-07-21T22:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/593536000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca27f1f6b0 msgr2=0x55ca280d35a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca27f1f6b0 0x55ca280d35a0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x55ca280df830 tx=0x7fdfa8020040 comp rx=0 tx=0).stop 2023-07-21T22:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/593536000 shutdown_connections 2023-07-21T22:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ca28131b30 0x55ca28133f40 crc :-1 s=READY pgs=414 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ca27f1f6b0 0x55ca280d35a0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ca280c9660 0x55ca280d1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 --2- 172.21.15.151:0/593536000 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ca280c9210 0x55ca280d3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdf96ff5700 0 client.28796 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/593536000 >> 172.21.15.151:0/593536000 conn(0x55ca280b8ae0 msgr2=0x55ca280c79d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/593536000 shutdown_connections 2023-07-21T22:54:24.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.524+0000 7fdfcd0a5b80 1 -- 172.21.15.151:0/593536000 wait complete. 2023-07-21T22:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.525+0000 7fdfcd0a5b80 20 client.28796 trim_cache size 0 max 16384 2023-07-21T22:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:54:24.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.525+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a1340 msgr2=0x7fdf9c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:24.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.525+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a1340 0x7fdf9c0a37f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fdfac0d0220 tx=0x7fdfac00b3e0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.525+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb4104e00 msgr2=0x7fdfb41938c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.525+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb4104e00 0x7fdfb41938c0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fdfac00b770 tx=0x7fdfac010ca0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.526+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1230361904 shutdown_connections 2023-07-21T22:54:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.526+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdf9c0a1340 0x7fdf9c0a37f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.526+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdfb40ffdc0 0x7fdfb41999c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.526+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdfb4104e00 0x7fdfb41938c0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.526+0000 7fdfb97ff700 1 --2- 172.21.15.151:0/1230361904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdfb4100760 0x7fdfb4199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.526+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1230361904 >> 172.21.15.151:0/1230361904 conn(0x7fdfb40fb650 msgr2=0x7fdfb40fc070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.527+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1230361904 shutdown_connections 2023-07-21T22:54:24.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:24.527+0000 7fdfb97ff700 1 -- 172.21.15.151:0/1230361904 wait complete. 2023-07-21T22:54:24.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:24 smithi187 ceph-mon[96918]: pgmap v1119: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.06k op/s 2023-07-21T22:54:24.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:24 smithi151 ceph-mon[95510]: pgmap v1119: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.06k op/s 2023-07-21T22:54:26.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:26 smithi187 ceph-mon[96918]: pgmap v1120: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 12 MiB/s wr, 702 op/s 2023-07-21T22:54:26.899 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:24 smithi195 ceph-mon[97365]: pgmap v1119: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 16 MiB/s wr, 1.06k op/s 2023-07-21T22:54:26.900 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:26 smithi195 ceph-mon[97365]: pgmap v1120: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 12 MiB/s wr, 702 op/s 2023-07-21T22:54:26.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:26 smithi151 ceph-mon[95510]: pgmap v1120: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 791 KiB/s rd, 12 MiB/s wr, 702 op/s 2023-07-21T22:54:28.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:27 smithi187 ceph-mon[96918]: pgmap v1121: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 981 op/s 2023-07-21T22:54:28.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:27 smithi195 ceph-mon[97365]: pgmap v1121: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 981 op/s 2023-07-21T22:54:28.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:27 smithi151 ceph-mon[95510]: pgmap v1121: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 16 MiB/s wr, 981 op/s 2023-07-21T22:54:29.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 95.0 s, 271.2 tps, lat 368.236 ms stddev 476.373 2023-07-21T22:54:30.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:30 smithi187 ceph-mon[96918]: pgmap v1122: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 11 MiB/s wr, 574 op/s 2023-07-21T22:54:30.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:30 smithi195 ceph-mon[97365]: pgmap v1122: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 11 MiB/s wr, 574 op/s 2023-07-21T22:54:30.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:30 smithi151 ceph-mon[95510]: pgmap v1122: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 11 MiB/s wr, 574 op/s 2023-07-21T22:54:32.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:32 smithi187 ceph-mon[96918]: pgmap v1123: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 11 MiB/s wr, 574 op/s 2023-07-21T22:54:32.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:32 smithi195 ceph-mon[97365]: pgmap v1123: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 11 MiB/s wr, 574 op/s 2023-07-21T22:54:32.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:32 smithi151 ceph-mon[95510]: pgmap v1123: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 914 KiB/s rd, 11 MiB/s wr, 574 op/s 2023-07-21T22:54:34.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 100.0 s, 95.8 tps, lat 1010.411 ms stddev 1598.666 2023-07-21T22:54:34.868 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:34 smithi187 ceph-mon[96918]: pgmap v1124: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 12 MiB/s wr, 727 op/s 2023-07-21T22:54:34.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:34 smithi195 ceph-mon[97365]: pgmap v1124: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 12 MiB/s wr, 727 op/s 2023-07-21T22:54:34.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:34 smithi151 ceph-mon[95510]: pgmap v1124: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 12 MiB/s wr, 727 op/s 2023-07-21T22:54:35.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:35 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:54:35.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:35 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:54:35.939 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:35 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:54:36.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:36 smithi187 ceph-mon[96918]: pgmap v1125: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 5.5 MiB/s wr, 432 op/s 2023-07-21T22:54:36.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:36 smithi195 ceph-mon[97365]: pgmap v1125: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 5.5 MiB/s wr, 432 op/s 2023-07-21T22:54:36.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:36 smithi151 ceph-mon[95510]: pgmap v1125: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 702 KiB/s rd, 5.5 MiB/s wr, 432 op/s 2023-07-21T22:54:37.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.682+0000 7f31b61ff700 1 -- 172.21.15.151:0/637852063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b01004b0 msgr2=0x7f31b010c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.682+0000 7f31b61ff700 1 --2- 172.21.15.151:0/637852063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b01004b0 0x7f31b010c940 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7f31a800b0a0 tx=0x7f31a800b3b0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.682+0000 7f31b61ff700 1 -- 172.21.15.151:0/637852063 shutdown_connections 2023-07-21T22:54:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.682+0000 7f31b61ff700 1 --2- 172.21.15.151:0/637852063 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b01004b0 0x7f31b010c940 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.682+0000 7f31b61ff700 1 --2- 172.21.15.151:0/637852063 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31b0105b10 0x7f31b0105ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.682+0000 7f31b61ff700 1 --2- 172.21.15.151:0/637852063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31b00ffb00 0x7f31b00fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.682+0000 7f31b61ff700 1 -- 172.21.15.151:0/637852063 >> 172.21.15.151:0/637852063 conn(0x7f31b00fb600 msgr2=0x7f31b00fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.682+0000 7f31b61ff700 1 -- 172.21.15.151:0/637852063 shutdown_connections 2023-07-21T22:54:37.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.682+0000 7f31b61ff700 1 -- 172.21.15.151:0/637852063 wait complete. 2023-07-21T22:54:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.683+0000 7f31b61ff700 1 Processor -- start 2023-07-21T22:54:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.683+0000 7f31b61ff700 1 -- start start 2023-07-21T22:54:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31b61ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b00ffb00 0x7f31b00729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31b61ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31b01004b0 0x7f31b0072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31b61ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31b0105b10 0x7f31b01a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31b61ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b01a4430 con 0x7f31b00ffb00 2023-07-21T22:54:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31b61ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b01a4570 con 0x7f31b01004b0 2023-07-21T22:54:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31b61ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31b01a46e0 con 0x7f31b0105b10 2023-07-21T22:54:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31af7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b00ffb00 0x7f31b00729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31af7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b00ffb00 0x7f31b00729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54708/0 (socket says 172.21.15.151:54708) 2023-07-21T22:54:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31af7fe700 1 -- 172.21.15.151:0/3813050250 learned_addr learned my addr 172.21.15.151:0/3813050250 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31affff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31b0105b10 0x7f31b01a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31a7fff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31b01004b0 0x7f31b0072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31af7fe700 1 -- 172.21.15.151:0/3813050250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31b0105b10 msgr2=0x7f31b01a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31af7fe700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31b0105b10 0x7f31b01a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31af7fe700 1 -- 172.21.15.151:0/3813050250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31b01004b0 msgr2=0x7f31b0072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31af7fe700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31b01004b0 0x7f31b0072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31af7fe700 1 -- 172.21.15.151:0/3813050250 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31a8009d00 con 0x7f31b00ffb00 2023-07-21T22:54:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.684+0000 7f31a7fff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31b01004b0 0x7f31b0072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:54:37.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.685+0000 7f31af7fe700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b00ffb00 0x7f31b00729f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f31a000b530 tx=0x7f31a000b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.685+0000 7f31ad7fa700 1 -- 172.21.15.151:0/3813050250 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a0011830 con 0x7f31b00ffb00 2023-07-21T22:54:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.685+0000 7f31ad7fa700 1 -- 172.21.15.151:0/3813050250 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31a0011e20 con 0x7f31b00ffb00 2023-07-21T22:54:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.685+0000 7f31b61ff700 1 -- 172.21.15.151:0/3813050250 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31b01a49c0 con 0x7f31b00ffb00 2023-07-21T22:54:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.685+0000 7f31ad7fa700 1 -- 172.21.15.151:0/3813050250 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a000f2e0 con 0x7f31b00ffb00 2023-07-21T22:54:37.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.685+0000 7f31b61ff700 1 -- 172.21.15.151:0/3813050250 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b01a4f20 con 0x7f31b00ffb00 2023-07-21T22:54:37.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.688+0000 7f31ad7fa700 1 -- 172.21.15.151:0/3813050250 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f31a0011990 con 0x7f31b00ffb00 2023-07-21T22:54:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31c9a5eb80 1 Processor -- start 2023-07-21T22:54:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31c9a5eb80 1 -- start start 2023-07-21T22:54:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31ad7fa700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f319c0a1340 0x7f319c0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce13a66b0 0x55dce154fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1549f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce1550660 0x55dce154a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce144fc50 con 0x55dce1550210 2023-07-21T22:54:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce14a29e0 con 0x55dce1550660 2023-07-21T22:54:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce149be70 con 0x55dce13a66b0 2023-07-21T22:54:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31ad7fa700 1 -- 172.21.15.151:0/3813050250 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f31a00cc6e0 con 0x7f31b00ffb00 2023-07-21T22:54:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31affff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f319c0a1340 0x7f319c0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31a7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1549f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.729 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.690+0000 7f31a7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1549f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54712/0 (socket says 172.21.15.151:54712) 2023-07-21T22:54:37.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31a7fff700 1 -- 172.21.15.151:0/1441472579 learned_addr learned my addr 172.21.15.151:0/1441472579 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:37.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31af7fe700 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce13a66b0 0x55dce154fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31affff700 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce1550660 0x55dce154a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31a7fff700 1 -- 172.21.15.151:0/1441472579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce13a66b0 msgr2=0x55dce154fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:37.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31a7fff700 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce13a66b0 0x55dce154fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31a7fff700 1 -- 172.21.15.151:0/1441472579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce1550660 msgr2=0x55dce154a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:37.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31a7fff700 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce1550660 0x55dce154a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.730 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31a7fff700 1 -- 172.21.15.151:0/1441472579 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dce12c9d80 con 0x55dce1550210 2023-07-21T22:54:37.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31af7fe700 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce13a66b0 0x55dce154fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:54:37.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31affff700 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce1550660 0x55dce154a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:54:37.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31a7fff700 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1549f40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f319800bce0 tx=0x7f319800f360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859cc2b1d6f37067 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:37.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31affff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f319c0a1340 0x7f319c0a37f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f31a80060b0 tx=0x7f31a8006000 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:37.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.691+0000 7f31a5ffb700 1 -- 172.21.15.151:0/1441472579 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319800fbe0 con 0x55dce1550210 2023-07-21T22:54:37.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31a5ffb700 1 -- 172.21.15.151:0/1441472579 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f319800fd40 con 0x55dce1550210 2023-07-21T22:54:37.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31a5ffb700 1 -- 172.21.15.151:0/1441472579 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31980116a0 con 0x55dce1550210 2023-07-21T22:54:37.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/1441472579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 msgr2=0x55dce1549f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:37.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1549f40 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f319800bce0 tx=0x7f319800f360 comp rx=0 tx=0).stop 2023-07-21T22:54:37.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/1441472579 shutdown_connections 2023-07-21T22:54:37.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce1550660 0x55dce154a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce13a66b0 0x55dce154fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/1441472579 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1549f40 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/1441472579 >> 172.21.15.151:0/1441472579 conn(0x55dce153fae0 msgr2=0x55dce15450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:37.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/1441472579 shutdown_connections 2023-07-21T22:54:37.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.692+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/1441472579 wait complete. 2023-07-21T22:54:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.693+0000 7f31c9a5eb80 1 -- start start 2023-07-21T22:54:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.693+0000 7f31c9a5eb80 1 Processor -- start 2023-07-21T22:54:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce1559610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550210 0x55dce1559b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550660 0x55dce15538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce143ba60 con 0x55dce1550660 2023-07-21T22:54:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce143b760 con 0x55dce13a66b0 2023-07-21T22:54:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce131f8c0 con 0x55dce1550210 2023-07-21T22:54:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31c9a5eb80 10 client.0 _ll_register_callbacks cb 0x55dce1439700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:54:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31affff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550660 0x55dce15538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31affff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550660 0x55dce15538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54726/0 (socket says 172.21.15.151:54726) 2023-07-21T22:54:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.694+0000 7f31affff700 1 -- 172.21.15.151:0/2006924984 learned_addr learned my addr 172.21.15.151:0/2006924984 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31af7fe700 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce1559610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31a7fff700 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550210 0x55dce1559b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31affff700 1 -- 172.21.15.151:0/2006924984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550210 msgr2=0x55dce1559b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31affff700 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550210 0x55dce1559b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31affff700 1 -- 172.21.15.151:0/2006924984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 msgr2=0x55dce1559610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31affff700 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce1559610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31affff700 1 -- 172.21.15.151:0/2006924984 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31b01a4f20 con 0x55dce1550660 2023-07-21T22:54:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31af7fe700 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce1559610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:54:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31a7fff700 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550210 0x55dce1559b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:54:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31affff700 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550660 0x55dce15538a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f31a800b0a0 tx=0x7f31a80099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a16e5da023d2a307 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f318effd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:54:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f318effd700 1 -- 172.21.15.151:0/2006924984 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31a80094e0 con 0x55dce1550660 2023-07-21T22:54:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2006924984 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dce13f5490 con 0x55dce1550660 2023-07-21T22:54:37.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.695+0000 7f318effd700 1 -- 172.21.15.151:0/2006924984 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(148..148 src has 1..148) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f31a80056a0 con 0x55dce1550660 2023-07-21T22:54:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f318effd700 1 -- 172.21.15.151:0/2006924984 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f31a8005860 con 0x55dce1550660 2023-07-21T22:54:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f31c9a5eb80 10 client.19116 fetch_fsmap learned FSMap version 105 2023-07-21T22:54:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2006924984 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x7f319800b940 con 0x55dce1550660 2023-07-21T22:54:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f318effd700 1 -- 172.21.15.151:0/2006924984 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dce13f5490 con 0x55dce1550660 2023-07-21T22:54:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f318effd700 1 -- 172.21.15.151:0/2006924984 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f31a801d490 con 0x55dce1550660 2023-07-21T22:54:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f31c9a5eb80 10 client.19116 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:54:37.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f31c9a5eb80 10 client.19116 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:54:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f31c9a5eb80 20 client.19116 populate_metadata read hostname 'smithi151' 2023-07-21T22:54:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dce1563b80 0x55dce1565f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f31c9a5eb80 4 client.19116 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:54:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.696+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2006924984 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dce1494e50 con 0x55dce1563b80 2023-07-21T22:54:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.697+0000 7f31af7fe700 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dce1563b80 0x55dce1565f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.697+0000 7f31af7fe700 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dce1563b80 0x55dce1565f90 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95d68d2a9a43f306 server_cookie=6f1369880a9ed37e in_seq=0 out_seq=0 2023-07-21T22:54:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.697+0000 7f318effd700 10 client.19116 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.698+0000 7f318effd700 1 -- 172.21.15.151:0/2006924984 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dce1494e50 con 0x55dce1563b80 2023-07-21T22:54:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.698+0000 7f318effd700 10 client.19116 handle_command_reply: tid=0 2023-07-21T22:54:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.698+0000 7f31c9a5eb80 1 client.19116 shutdown 2023-07-21T22:54:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.698+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2006924984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550660 msgr2=0x55dce15538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.698+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550660 0x55dce15538a0 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f31a800b0a0 tx=0x7f31a80099e0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.698+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2006924984 shutdown_connections 2023-07-21T22:54:37.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.698+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dce1563b80 0x55dce1565f90 crc :-1 s=READY pgs=415 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.698+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce1559610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.699+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550660 0x55dce15538a0 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.699+0000 7f318effd700 0 client.19116 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.699+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2006924984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550210 0x55dce1559b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.699+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2006924984 >> 172.21.15.151:0/2006924984 conn(0x55dce153fae0 msgr2=0x55dce15443e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.699+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2006924984 shutdown_connections 2023-07-21T22:54:37.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.699+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2006924984 wait complete. 2023-07-21T22:54:37.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.699+0000 7f31c9a5eb80 20 client.19116 trim_cache size 0 max 16384 2023-07-21T22:54:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31c9a5eb80 1 Processor -- start 2023-07-21T22:54:37.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31c9a5eb80 1 -- start start 2023-07-21T22:54:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce1549f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce15512c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 0x55dce1551800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce1546700 con 0x55dce1550210 2023-07-21T22:54:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce1546510 con 0x55dce13a66b0 2023-07-21T22:54:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce153cb20 con 0x55dce1550660 2023-07-21T22:54:37.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31a7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce15512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31a7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce15512c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54734/0 (socket says 172.21.15.151:54734) 2023-07-21T22:54:37.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31a7fff700 1 -- 172.21.15.151:0/3913793406 learned_addr learned my addr 172.21.15.151:0/3913793406 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:37.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.715+0000 7f31af7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce1549f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.716+0000 7f31affff700 1 --2- 172.21.15.151:0/3913793406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 0x55dce1551800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.716+0000 7f31a7fff700 1 -- 172.21.15.151:0/3913793406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 msgr2=0x55dce1551800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:37.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.716+0000 7f31a7fff700 1 --2- 172.21.15.151:0/3913793406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 0x55dce1551800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.716+0000 7f31a7fff700 1 -- 172.21.15.151:0/3913793406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 msgr2=0x55dce1549f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.716+0000 7f31a7fff700 1 --2- 172.21.15.151:0/3913793406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce1549f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.716+0000 7f31a7fff700 1 -- 172.21.15.151:0/3913793406 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dce12b2c00 con 0x55dce1550210 2023-07-21T22:54:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.716+0000 7f31a7fff700 1 --2- 172.21.15.151:0/3913793406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce15512c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f319800b6f0 tx=0x7f319800bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c5b1b79d16e347 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.717+0000 7f31a67fc700 1 -- 172.21.15.151:0/3913793406 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319801f070 con 0x55dce1550210 2023-07-21T22:54:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.717+0000 7f31a67fc700 1 -- 172.21.15.151:0/3913793406 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f31980044c0 con 0x55dce1550210 2023-07-21T22:54:37.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.717+0000 7f31a67fc700 1 -- 172.21.15.151:0/3913793406 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3198004970 con 0x55dce1550210 2023-07-21T22:54:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.717+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/3913793406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 msgr2=0x55dce15512c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.717+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/3913793406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce15512c0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f319800b6f0 tx=0x7f319800bc10 comp rx=0 tx=0).stop 2023-07-21T22:54:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.718+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/3913793406 shutdown_connections 2023-07-21T22:54:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.718+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/3913793406 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce1549f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.718+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/3913793406 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 0x55dce1551800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.718+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/3913793406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce15512c0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.718+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/3913793406 >> 172.21.15.151:0/3913793406 conn(0x55dce153fae0 msgr2=0x55dce154ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:37.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.718+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/3913793406 shutdown_connections 2023-07-21T22:54:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.718+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/3913793406 wait complete. 2023-07-21T22:54:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.718+0000 7f31c9a5eb80 1 -- start start 2023-07-21T22:54:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.718+0000 7f31c9a5eb80 1 Processor -- start 2023-07-21T22:54:37.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce15595a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1559ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31c9a5eb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 0x55dce1557ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce15581e0 con 0x55dce1550210 2023-07-21T22:54:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce1558350 con 0x55dce13a66b0 2023-07-21T22:54:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31c9a5eb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dce1558510 con 0x55dce1550660 2023-07-21T22:54:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31c9a5eb80 10 client.0 _ll_register_callbacks cb 0x7f31a80077f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:54:37.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31af7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce15595a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31a7fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1559ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31af7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce15595a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50312/0 (socket says 172.21.15.151:50312) 2023-07-21T22:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.719+0000 7f31af7fe700 1 -- 172.21.15.151:0/2599670054 learned_addr learned my addr 172.21.15.151:0/2599670054 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31a7fff700 1 -- 172.21.15.151:0/2599670054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 msgr2=0x55dce1557ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31affff700 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 0x55dce1557ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31a7fff700 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 0x55dce1557ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31a7fff700 1 -- 172.21.15.151:0/2599670054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 msgr2=0x55dce15595a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:37.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31a7fff700 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce15595a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31a7fff700 1 -- 172.21.15.151:0/2599670054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55dce12c9d80 con 0x55dce1550210 2023-07-21T22:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31af7fe700 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce15595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31affff700 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 0x55dce1557ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31a7fff700 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1559ae0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x55dce1510030 tx=0x7f3198004630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0627e0ea2ff90d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f318effd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f318effd700 1 -- 172.21.15.151:0/2599670054 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319801f040 con 0x55dce1550210 2023-07-21T22:54:37.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2599670054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f319800fd40 con 0x55dce1550210 2023-07-21T22:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.720+0000 7f318effd700 1 -- 172.21.15.151:0/2599670054 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(148..148 src has 1..148) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f319801a870 con 0x55dce1550210 2023-07-21T22:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f318effd700 1 -- 172.21.15.151:0/2599670054 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f319801aa30 con 0x55dce1550210 2023-07-21T22:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f31c9a5eb80 10 client.19122 fetch_fsmap learned FSMap version 105 2023-07-21T22:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2599670054 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55dce12f01f0 con 0x55dce1550210 2023-07-21T22:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f318effd700 1 -- 172.21.15.151:0/2599670054 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f319800fd40 con 0x55dce1550210 2023-07-21T22:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f318effd700 1 -- 172.21.15.151:0/2599670054 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f3198004710 con 0x55dce1550210 2023-07-21T22:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f31c9a5eb80 10 client.19122 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:54:37.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f31c9a5eb80 10 client.19122 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:54:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f31c9a5eb80 20 client.19122 populate_metadata read hostname 'smithi151' 2023-07-21T22:54:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dce15b8800 0x55dce15babe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f31c9a5eb80 4 client.19122 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:54:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.721+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2599670054 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dce1456ff0 con 0x55dce15b8800 2023-07-21T22:54:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.722+0000 7f31af7fe700 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dce15b8800 0x55dce15babe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.722+0000 7f318effd700 10 client.19122 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:37.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.722+0000 7f31af7fe700 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dce15b8800 0x55dce15babe0 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7853883387069f3 server_cookie=e84cf74708cc8ff1 in_seq=0 out_seq=0 2023-07-21T22:54:37.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.751+0000 7f318effd700 1 -- 172.21.15.151:0/2599670054 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dce1456ff0 con 0x55dce15b8800 2023-07-21T22:54:37.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.751+0000 7f318effd700 10 client.19122 handle_command_reply: tid=0 2023-07-21T22:54:37.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.751+0000 7f31c9a5eb80 1 client.19122 shutdown 2023-07-21T22:54:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2599670054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 msgr2=0x55dce1559ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1559ae0 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x55dce1510030 tx=0x7f3198004630 comp rx=0 tx=0).stop 2023-07-21T22:54:37.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2599670054 shutdown_connections 2023-07-21T22:54:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dce15b8800 0x55dce15babe0 crc :-1 s=READY pgs=416 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dce13a66b0 0x55dce15595a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dce1550660 0x55dce1557ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 --2- 172.21.15.151:0/2599670054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dce1550210 0x55dce1559ae0 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2599670054 >> 172.21.15.151:0/2599670054 conn(0x55dce153fae0 msgr2=0x55dce15512c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f318effd700 0 client.19122 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2599670054 shutdown_connections 2023-07-21T22:54:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.752+0000 7f31c9a5eb80 1 -- 172.21.15.151:0/2599670054 wait complete. 2023-07-21T22:54:37.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.753+0000 7f31c9a5eb80 20 client.19122 trim_cache size 0 max 16384 2023-07-21T22:54:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:54:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:54:37.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:54:37.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:54:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.763+0000 7f31b61ff700 1 -- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f319c0a1340 msgr2=0x7f319c0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.763+0000 7f31b61ff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f319c0a1340 0x7f319c0a37f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f31a80060b0 tx=0x7f31a8006000 comp rx=0 tx=0).stop 2023-07-21T22:54:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.763+0000 7f31b61ff700 1 -- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b00ffb00 msgr2=0x7f31b00729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:37.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.763+0000 7f31b61ff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b00ffb00 0x7f31b00729f0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f31a000b530 tx=0x7f31a000b840 comp rx=0 tx=0).stop 2023-07-21T22:54:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.773+0000 7f31b61ff700 1 -- 172.21.15.151:0/3813050250 shutdown_connections 2023-07-21T22:54:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.774+0000 7f31b61ff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f319c0a1340 0x7f319c0a37f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.774+0000 7f31b61ff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f31b0105b10 0x7f31b01a3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.774+0000 7f31b61ff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b00ffb00 0x7f31b00729f0 secure :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f31a000b530 tx=0x7f31a000b840 comp rx=0 tx=0).stop 2023-07-21T22:54:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.774+0000 7f31b61ff700 1 --2- 172.21.15.151:0/3813050250 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31b01004b0 0x7f31b0072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:37.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.774+0000 7f31b61ff700 1 -- 172.21.15.151:0/3813050250 >> 172.21.15.151:0/3813050250 conn(0x7f31b00fb600 msgr2=0x7f31b00fbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:37.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.790+0000 7f31b61ff700 1 -- 172.21.15.151:0/3813050250 shutdown_connections 2023-07-21T22:54:37.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:37.790+0000 7f31b61ff700 1 -- 172.21.15.151:0/3813050250 wait complete. 2023-07-21T22:54:38.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:37 smithi187 ceph-mon[96918]: pgmap v1126: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 6.6 MiB/s wr, 530 op/s 2023-07-21T22:54:38.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:37 smithi195 ceph-mon[97365]: pgmap v1126: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 6.6 MiB/s wr, 530 op/s 2023-07-21T22:54:38.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:37 smithi151 ceph-mon[95510]: pgmap v1126: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 824 KiB/s rd, 6.6 MiB/s wr, 530 op/s 2023-07-21T22:54:39.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 105.0 s, 42.6 tps, lat 2418.385 ms stddev 1371.246 2023-07-21T22:54:40.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:40 smithi187 ceph-mon[96918]: pgmap v1127: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 2.8 MiB/s wr, 251 op/s 2023-07-21T22:54:40.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:40 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:54:40.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:40 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:54:40.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:40 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:54:40.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:40 smithi195 ceph-mon[97365]: pgmap v1127: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 2.8 MiB/s wr, 251 op/s 2023-07-21T22:54:40.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:40 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:54:40.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:40 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:54:40.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:40 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:54:40.939 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:40 smithi151 ceph-mon[95510]: pgmap v1127: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 2.8 MiB/s wr, 251 op/s 2023-07-21T22:54:40.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:40 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:54:40.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:40 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:54:40.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:40 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:54:41.868 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:41 smithi187 ceph-mon[96918]: pgmap v1128: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 3.1 MiB/s wr, 282 op/s 2023-07-21T22:54:41.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:41 smithi187 ceph-mon[96918]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2023-07-21T22:54:41.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:41 smithi195 ceph-mon[97365]: pgmap v1128: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 3.1 MiB/s wr, 282 op/s 2023-07-21T22:54:41.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:41 smithi195 ceph-mon[97365]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2023-07-21T22:54:41.940 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:41 smithi151 ceph-mon[95510]: pgmap v1128: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 3.1 MiB/s wr, 282 op/s 2023-07-21T22:54:41.941 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:41 smithi151 ceph-mon[95510]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2023-07-21T22:54:43.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:42 smithi187 ceph-mon[96918]: pgmap v1129: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 6.5 MiB/s wr, 499 op/s 2023-07-21T22:54:43.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:42 smithi195 ceph-mon[97365]: pgmap v1129: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 6.5 MiB/s wr, 499 op/s 2023-07-21T22:54:43.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:42 smithi151 ceph-mon[95510]: pgmap v1129: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 826 KiB/s rd, 6.5 MiB/s wr, 499 op/s 2023-07-21T22:54:44.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 110.0 s, 367.8 tps, lat 266.189 ms stddev 86.764 2023-07-21T22:54:45.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:45 smithi195 ceph-mon[97365]: pgmap v1130: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 4.5 MiB/s wr, 326 op/s 2023-07-21T22:54:45.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:45 smithi151 ceph-mon[95510]: pgmap v1130: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 4.5 MiB/s wr, 326 op/s 2023-07-21T22:54:45.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:45 smithi187 ceph-mon[96918]: pgmap v1130: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 4.5 MiB/s wr, 326 op/s 2023-07-21T22:54:47.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:47 smithi195 ceph-mon[97365]: pgmap v1131: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 4.5 MiB/s wr, 326 op/s 2023-07-21T22:54:47.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:47 smithi151 ceph-mon[95510]: pgmap v1131: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 4.5 MiB/s wr, 326 op/s 2023-07-21T22:54:47.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:47 smithi187 ceph-mon[96918]: pgmap v1131: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 619 KiB/s rd, 4.5 MiB/s wr, 326 op/s 2023-07-21T22:54:49.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 115.0 s, 386.6 tps, lat 260.959 ms stddev 62.385 2023-07-21T22:54:49.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:49 smithi195 ceph-mon[97365]: pgmap v1132: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.9 MiB/s wr, 689 op/s 2023-07-21T22:54:49.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:49 smithi151 ceph-mon[95510]: pgmap v1132: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.9 MiB/s wr, 689 op/s 2023-07-21T22:54:49.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:49 smithi187 ceph-mon[96918]: pgmap v1132: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.9 MiB/s wr, 689 op/s 2023-07-21T22:54:51.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.044+0000 7f8ac1bff700 1 -- 172.21.15.151:0/2134613744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc100db0 msgr2=0x7f8abc101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:51.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.044+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/2134613744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc100db0 0x7f8abc101180 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00b0a0 tx=0x7f8aac00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.045+0000 7f8ac1bff700 1 -- 172.21.15.151:0/2134613744 shutdown_connections 2023-07-21T22:54:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.045+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/2134613744 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8abc10a180 0x7f8abc10c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.045+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/2134613744 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc100db0 0x7f8abc101180 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.045+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/2134613744 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc1016c0 0x7f8abc109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.045+0000 7f8ac1bff700 1 -- 172.21.15.151:0/2134613744 >> 172.21.15.151:0/2134613744 conn(0x7f8abc075bd0 msgr2=0x7f8abc075fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.045+0000 7f8ac1bff700 1 -- 172.21.15.151:0/2134613744 shutdown_connections 2023-07-21T22:54:51.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.045+0000 7f8ac1bff700 1 -- 172.21.15.151:0/2134613744 wait complete. 2023-07-21T22:54:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.047+0000 7f8ac1bff700 1 Processor -- start 2023-07-21T22:54:51.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.047+0000 7f8ac1bff700 1 -- start start 2023-07-21T22:54:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.047+0000 7f8ac1bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc100db0 0x7f8abc0fec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.047+0000 7f8ac1bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1016c0 0x7f8abc0ff140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8ac1bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8abc10a180 0x7f8abc070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8ac1bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc070f50 con 0x7f8abc1016c0 2023-07-21T22:54:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8ac1bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc0710c0 con 0x7f8abc100db0 2023-07-21T22:54:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8ac1bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8abc071280 con 0x7f8abc10a180 2023-07-21T22:54:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8ab2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1016c0 0x7f8abc0ff140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc100db0 0x7f8abc0fec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc100db0 0x7f8abc0fec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50510/0 (socket says 172.21.15.151:50510) 2023-07-21T22:54:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8ab2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1016c0 0x7f8abc0ff140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46310/0 (socket says 172.21.15.151:46310) 2023-07-21T22:54:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abb7fe700 1 -- 172.21.15.151:0/3238037959 learned_addr learned my addr 172.21.15.151:0/3238037959 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:51.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abbfff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8abc10a180 0x7f8abc070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abbfff700 1 -- 172.21.15.151:0/3238037959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc100db0 msgr2=0x7f8abc0fec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abbfff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc100db0 0x7f8abc0fec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abbfff700 1 -- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1016c0 msgr2=0x7f8abc0ff140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:51.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abbfff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1016c0 0x7f8abc0ff140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abbfff700 1 -- 172.21.15.151:0/3238037959 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aac009d00 con 0x7f8abc10a180 2023-07-21T22:54:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1016c0 0x7f8abc0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:54:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.048+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc100db0 0x7f8abc0fec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:54:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.049+0000 7f8abbfff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8abc10a180 0x7f8abc070a10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400e970 tx=0x7f8ab400ec80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.049+0000 7f8ab97fa700 1 -- 172.21.15.151:0/3238037959 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab400cbd0 con 0x7f8abc10a180 2023-07-21T22:54:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.049+0000 7f8ac1bff700 1 -- 172.21.15.151:0/3238037959 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8abc071560 con 0x7f8abc10a180 2023-07-21T22:54:51.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.049+0000 7f8ab97fa700 1 -- 172.21.15.151:0/3238037959 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8ab400ee60 con 0x7f8abc10a180 2023-07-21T22:54:51.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.049+0000 7f8ab97fa700 1 -- 172.21.15.151:0/3238037959 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ab4004dd0 con 0x7f8abc10a180 2023-07-21T22:54:51.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.049+0000 7f8ac1bff700 1 -- 172.21.15.151:0/3238037959 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc071ac0 con 0x7f8abc10a180 2023-07-21T22:54:51.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.055+0000 7f8ab97fa700 1 -- 172.21.15.151:0/3238037959 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f8ab4005060 con 0x7f8abc10a180 2023-07-21T22:54:51.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.056+0000 7f8ad5566b80 1 Processor -- start 2023-07-21T22:54:51.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.056+0000 7f8ad5566b80 1 -- start start 2023-07-21T22:54:51.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.056+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ddc296b0 0x55b5dddd2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.056+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.056+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5dddcd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.056+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ddcd2c50 con 0x55b5ddc296b0 2023-07-21T22:54:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.056+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ddd259e0 con 0x55b5dddd3660 2023-07-21T22:54:51.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.056+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ddd1ee70 con 0x55b5dddd3210 2023-07-21T22:54:51.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.057+0000 7f8ab2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ddc296b0 0x55b5dddd2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.057+0000 7f8ab2ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ddc296b0 0x55b5dddd2cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46320/0 (socket says 172.21.15.151:46320) 2023-07-21T22:54:51.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.057+0000 7f8ab2ffd700 1 -- 172.21.15.151:0/2040288733 learned_addr learned my addr 172.21.15.151:0/2040288733 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.057+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/2040288733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.057+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/2040288733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5dddcd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.058+0000 7f8ab97fa700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8aa80a1380 0x7f8aa80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.058+0000 7f8ab97fa700 1 -- 172.21.15.151:0/3238037959 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8ab4014070 con 0x7f8abc10a180 2023-07-21T22:54:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.058+0000 7f8ab2ffd700 1 -- 172.21.15.151:0/2040288733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3210 msgr2=0x55b5dddccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.058+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/2040288733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.058+0000 7f8ab2ffd700 1 -- 172.21.15.151:0/2040288733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 msgr2=0x55b5dddcd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:51.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.058+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/2040288733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5dddcd4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.058+0000 7f8ab2ffd700 1 -- 172.21.15.151:0/2040288733 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ddb4cd80 con 0x55b5ddc296b0 2023-07-21T22:54:51.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.062+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/2040288733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ddc296b0 0x55b5dddd2cd0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4014640 tx=0x7f8aa400a3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e0c38fe70b522ba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.064+0000 7f8abbfff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8aa80a1380 0x7f8aa80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.064+0000 7f8ab1ffb700 1 -- 172.21.15.151:0/2040288733 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4014c60 con 0x55b5ddc296b0 2023-07-21T22:54:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.064+0000 7f8ab1ffb700 1 -- 172.21.15.151:0/2040288733 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8aa400c050 con 0x55b5ddc296b0 2023-07-21T22:54:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.064+0000 7f8ab1ffb700 1 -- 172.21.15.151:0/2040288733 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa40173e0 con 0x55b5ddc296b0 2023-07-21T22:54:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.065+0000 7f8ad5566b80 1 -- 172.21.15.151:0/2040288733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ddc296b0 msgr2=0x55b5dddd2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:51.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.065+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/2040288733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ddc296b0 0x55b5dddd2cd0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4014640 tx=0x7f8aa400a3e0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.067+0000 7f8ad5566b80 1 -- 172.21.15.151:0/2040288733 shutdown_connections 2023-07-21T22:54:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.067+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/2040288733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5dddcd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.067+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/2040288733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5ddc296b0 0x55b5dddd2cd0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.067+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/2040288733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.067+0000 7f8ad5566b80 1 -- 172.21.15.151:0/2040288733 >> 172.21.15.151:0/2040288733 conn(0x55b5dddc2ae0 msgr2=0x55b5dddc80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:51.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.069+0000 7f8ad5566b80 1 -- 172.21.15.151:0/2040288733 shutdown_connections 2023-07-21T22:54:51.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.069+0000 7f8ad5566b80 1 -- 172.21.15.151:0/2040288733 wait complete. 2023-07-21T22:54:51.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.070+0000 7f8ad5566b80 1 -- start start 2023-07-21T22:54:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.071+0000 7f8ad5566b80 1 Processor -- start 2023-07-21T22:54:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.071+0000 7f8abbfff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8aa80a1380 0x7f8aa80a3830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40ca2f0 tx=0x7f8ab401f000 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:51.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.072+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5ddddc520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.072+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 0x55b5ddddca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.072+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 0x55b5dddd6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.072+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ddcbea60 con 0x55b5dddd3210 2023-07-21T22:54:51.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.072+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ddcbe760 con 0x55b5ddc296b0 2023-07-21T22:54:51.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.072+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ddba28c0 con 0x55b5dddd3660 2023-07-21T22:54:51.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.072+0000 7f8ad5566b80 10 client.0 _ll_register_callbacks cb 0x55b5ddcbc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:54:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.072+0000 7f8ab2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5ddddc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.073+0000 7f8ab2ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5ddddc520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50528/0 (socket says 172.21.15.151:50528) 2023-07-21T22:54:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.073+0000 7f8ab2ffd700 1 -- 172.21.15.151:0/1514096049 learned_addr learned my addr 172.21.15.151:0/1514096049 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.073+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 0x55b5dddd6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.073+0000 7f8ab2ffd700 1 -- 172.21.15.151:0/1514096049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 msgr2=0x55b5dddd6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.073+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 0x55b5dddd6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.073+0000 7f8ab2ffd700 1 -- 172.21.15.151:0/1514096049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 msgr2=0x55b5ddddca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.073+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 0x55b5ddddca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.073+0000 7f8ab2ffd700 1 -- 172.21.15.151:0/1514096049 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa400e040 con 0x55b5ddc296b0 2023-07-21T22:54:51.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.074+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5ddddc520 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4008000 tx=0x7f8aa400ab40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fecc560c373099f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:51.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.074+0000 7f8a9affd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:54:51.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.074+0000 7f8a9affd700 1 -- 172.21.15.151:0/1514096049 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa4005c60 con 0x55b5ddc296b0 2023-07-21T22:54:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.074+0000 7f8a9affd700 1 -- 172.21.15.151:0/1514096049 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(148..148 src has 1..148) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8aa4005dc0 con 0x55b5ddc296b0 2023-07-21T22:54:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.074+0000 7f8ad5566b80 1 -- 172.21.15.151:0/1514096049 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b5ddc78490 con 0x55b5ddc296b0 2023-07-21T22:54:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.077+0000 7f8a9affd700 1 -- 172.21.15.151:0/1514096049 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aa4018430 con 0x55b5ddc296b0 2023-07-21T22:54:51.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.077+0000 7f8ad5566b80 10 client.28820 fetch_fsmap learned FSMap version 105 2023-07-21T22:54:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.077+0000 7f8ad5566b80 1 -- 172.21.15.151:0/1514096049 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55b5ddb35c00 con 0x55b5ddc296b0 2023-07-21T22:54:51.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.079+0000 7f8a9affd700 1 -- 172.21.15.151:0/1514096049 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b5ddc78490 con 0x55b5ddc296b0 2023-07-21T22:54:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.079+0000 7f8a9affd700 1 -- 172.21.15.151:0/1514096049 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8aa4012070 con 0x55b5ddc296b0 2023-07-21T22:54:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.080+0000 7f8ad5566b80 10 client.28820 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:54:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.080+0000 7f8ad5566b80 10 client.28820 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:54:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.080+0000 7f8ad5566b80 20 client.28820 populate_metadata read hostname 'smithi151' 2023-07-21T22:54:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.080+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ddde6920 0x55b5ddde8d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.080+0000 7f8ad5566b80 4 client.28820 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:54:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.080+0000 7f8ad5566b80 1 -- 172.21.15.151:0/1514096049 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b5ddd17e50 con 0x55b5ddde6920 2023-07-21T22:54:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.081+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ddde6920 0x55b5ddde8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.083+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ddde6920 0x55b5ddde8d30 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d3cab361f2666a10 server_cookie=69b970d8745dad5 in_seq=0 out_seq=0 2023-07-21T22:54:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.083+0000 7f8a9affd700 10 client.28820 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:51.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.084+0000 7f8a9affd700 1 -- 172.21.15.151:0/1514096049 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b5ddd17e50 con 0x55b5ddde6920 2023-07-21T22:54:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.084+0000 7f8a9affd700 10 client.28820 handle_command_reply: tid=0 2023-07-21T22:54:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.084+0000 7f8ad5566b80 1 client.28820 shutdown 2023-07-21T22:54:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.085+0000 7f8ad5566b80 1 -- 172.21.15.151:0/1514096049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 msgr2=0x55b5ddddc520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:51.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.085+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5ddddc520 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f8aa4008000 tx=0x7f8aa400ab40 comp rx=0 tx=0).stop 2023-07-21T22:54:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.085+0000 7f8ad5566b80 1 -- 172.21.15.151:0/1514096049 shutdown_connections 2023-07-21T22:54:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.085+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5ddde6920 0x55b5ddde8d30 crc :-1 s=READY pgs=417 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.085+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5ddddc520 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.085+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 0x55b5dddd6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.085+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/1514096049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 0x55b5ddddca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.085+0000 7f8ad5566b80 1 -- 172.21.15.151:0/1514096049 >> 172.21.15.151:0/1514096049 conn(0x55b5dddc2ae0 msgr2=0x55b5dddc73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:51.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.085+0000 7f8a9affd700 0 client.28820 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.086+0000 7f8ad5566b80 1 -- 172.21.15.151:0/1514096049 shutdown_connections 2023-07-21T22:54:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.086+0000 7f8ad5566b80 1 -- 172.21.15.151:0/1514096049 wait complete. 2023-07-21T22:54:51.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.087+0000 7f8ad5566b80 20 client.28820 trim_cache size 0 max 16384 2023-07-21T22:54:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.113+0000 7f8ad5566b80 1 Processor -- start 2023-07-21T22:54:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.113+0000 7f8ad5566b80 1 -- start start 2023-07-21T22:54:51.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.113+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5dddd68c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.113+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.113+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 0x55b5dddd4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.113+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5dddd4d30 con 0x55b5dddd3210 2023-07-21T22:54:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.113+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5dddd14a0 con 0x55b5ddc296b0 2023-07-21T22:54:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.113+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5dddc99b0 con 0x55b5dddd3660 2023-07-21T22:54:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8abb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8abb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46348/0 (socket says 172.21.15.151:46348) 2023-07-21T22:54:51.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8abb7fe700 1 -- 172.21.15.151:0/822096686 learned_addr learned my addr 172.21.15.151:0/822096686 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/822096686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 0x55b5dddd4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/822096686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5dddd68c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8abb7fe700 1 -- 172.21.15.151:0/822096686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 msgr2=0x55b5dddd4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:51.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/822096686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 0x55b5dddd4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8abb7fe700 1 -- 172.21.15.151:0/822096686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 msgr2=0x55b5dddd68c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/822096686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5dddd68c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.114+0000 7f8abb7fe700 1 -- 172.21.15.151:0/822096686 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b5ddded920 con 0x55b5dddd3210 2023-07-21T22:54:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.115+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/822096686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00d010 tx=0x7f8aac009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79eb8d33c75a3256 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.116+0000 7f8ab27fc700 1 -- 172.21.15.151:0/822096686 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00e040 con 0x55b5dddd3210 2023-07-21T22:54:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.116+0000 7f8ab27fc700 1 -- 172.21.15.151:0/822096686 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8aac00bbb0 con 0x55b5dddd3210 2023-07-21T22:54:51.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.116+0000 7f8ab27fc700 1 -- 172.21.15.151:0/822096686 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac005320 con 0x55b5dddd3210 2023-07-21T22:54:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.117+0000 7f8ad5566b80 1 -- 172.21.15.151:0/822096686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 msgr2=0x55b5dddccf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.117+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/822096686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00d010 tx=0x7f8aac009530 comp rx=0 tx=0).stop 2023-07-21T22:54:51.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.117+0000 7f8ad5566b80 1 -- 172.21.15.151:0/822096686 shutdown_connections 2023-07-21T22:54:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.117+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/822096686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5ddc296b0 0x55b5dddd68c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.117+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/822096686 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5dddd3660 0x55b5dddd4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.117+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/822096686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddd3210 0x55b5dddccf40 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.117+0000 7f8ad5566b80 1 -- 172.21.15.151:0/822096686 >> 172.21.15.151:0/822096686 conn(0x55b5dddc2ae0 msgr2=0x55b5dddd3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.118+0000 7f8ad5566b80 1 -- 172.21.15.151:0/822096686 shutdown_connections 2023-07-21T22:54:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.118+0000 7f8ad5566b80 1 -- 172.21.15.151:0/822096686 wait complete. 2023-07-21T22:54:51.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.118+0000 7f8ad5566b80 1 -- start start 2023-07-21T22:54:51.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.119+0000 7f8ad5566b80 1 Processor -- start 2023-07-21T22:54:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.119+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ddc296b0 0x55b5ddddc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.119+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5ddddc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.119+0000 7f8ad5566b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddda6d0 0x55b5ddddab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.119+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ddddb160 con 0x55b5dddda6d0 2023-07-21T22:54:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.119+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ddddb2a0 con 0x55b5dddd3660 2023-07-21T22:54:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.119+0000 7f8ad5566b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b5ddddb460 con 0x55b5ddc296b0 2023-07-21T22:54:51.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.120+0000 7f8ad5566b80 10 client.0 _ll_register_callbacks cb 0x7f8aa4014dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:54:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.120+0000 7f8abb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5ddddc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.120+0000 7f8abb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5ddddc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:50548/0 (socket says 172.21.15.151:50548) 2023-07-21T22:54:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.120+0000 7f8abb7fe700 1 -- 172.21.15.151:0/3923835326 learned_addr learned my addr 172.21.15.151:0/3923835326 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:54:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.121+0000 7f8abb7fe700 1 -- 172.21.15.151:0/3923835326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ddc296b0 msgr2=0x55b5ddddc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.121+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ddc296b0 0x55b5ddddc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.121+0000 7f8abb7fe700 1 -- 172.21.15.151:0/3923835326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddda6d0 msgr2=0x55b5ddddab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:54:51.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.121+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddda6d0 0x55b5ddddab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.121+0000 7f8abb7fe700 1 -- 172.21.15.151:0/3923835326 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8abc10d260 con 0x55b5dddd3660 2023-07-21T22:54:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.122+0000 7f8abb7fe700 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5ddddc790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009fd0 tx=0x7f8aac00bdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=763fc9e2d2c14628 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:54:51.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.122+0000 7f8a9affd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:54:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.123+0000 7f8a9affd700 1 -- 172.21.15.151:0/3923835326 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aac00e040 con 0x55b5dddd3660 2023-07-21T22:54:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.123+0000 7f8a9affd700 1 -- 172.21.15.151:0/3923835326 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(148..148 src has 1..148) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8aac0076a0 con 0x55b5dddd3660 2023-07-21T22:54:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.123+0000 7f8ad5566b80 1 -- 172.21.15.151:0/3923835326 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f8aa400c050 con 0x55b5dddd3660 2023-07-21T22:54:51.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.124+0000 7f8a9affd700 1 -- 172.21.15.151:0/3923835326 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8aac007860 con 0x55b5dddd3660 2023-07-21T22:54:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.124+0000 7f8ad5566b80 10 client.28823 fetch_fsmap learned FSMap version 105 2023-07-21T22:54:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.124+0000 7f8ad5566b80 1 -- 172.21.15.151:0/3923835326 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55b5ddb731f0 con 0x55b5dddd3660 2023-07-21T22:54:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.124+0000 7f8a9affd700 1 -- 172.21.15.151:0/3923835326 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8aa400c050 con 0x55b5dddd3660 2023-07-21T22:54:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.124+0000 7f8a9affd700 1 -- 172.21.15.151:0/3923835326 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8aac00b0d0 con 0x55b5dddd3660 2023-07-21T22:54:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.125+0000 7f8ad5566b80 10 client.28823 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:54:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.125+0000 7f8ad5566b80 10 client.28823 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:54:51.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.125+0000 7f8ad5566b80 20 client.28823 populate_metadata read hostname 'smithi151' 2023-07-21T22:54:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.125+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5dde3b930 0x55b5dde3dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:54:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.125+0000 7f8ad5566b80 4 client.28823 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:54:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.125+0000 7f8ad5566b80 1 -- 172.21.15.151:0/3923835326 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b5ddcd9ff0 con 0x55b5dde3b930 2023-07-21T22:54:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.125+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5dde3b930 0x55b5dde3dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:54:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.126+0000 7f8ab2ffd700 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5dde3b930 0x55b5dde3dd40 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56e29638905fb58d server_cookie=a3609f81ab9014b5 in_seq=0 out_seq=0 2023-07-21T22:54:51.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.126+0000 7f8a9affd700 10 client.28823 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.176+0000 7f8a9affd700 1 -- 172.21.15.151:0/3923835326 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b5ddcd9ff0 con 0x55b5dde3b930 2023-07-21T22:54:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.176+0000 7f8a9affd700 10 client.28823 handle_command_reply: tid=0 2023-07-21T22:54:51.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.176+0000 7f8ad5566b80 1 client.28823 shutdown 2023-07-21T22:54:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.176+0000 7f8ad5566b80 1 -- 172.21.15.151:0/3923835326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 msgr2=0x55b5ddddc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:51.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.176+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5ddddc790 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8aac009fd0 tx=0x7f8aac00bdd0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8ad5566b80 1 -- 172.21.15.151:0/3923835326 shutdown_connections 2023-07-21T22:54:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b5dde3b930 0x55b5dde3dd40 crc :-1 s=READY pgs=418 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b5dddda6d0 0x55b5ddddab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b5ddc296b0 0x55b5ddddc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8ad5566b80 1 --2- 172.21.15.151:0/3923835326 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b5dddd3660 0x55b5ddddc790 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8ad5566b80 1 -- 172.21.15.151:0/3923835326 >> 172.21.15.151:0/3923835326 conn(0x55b5dddc2ae0 msgr2=0x55b5dddd18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:51.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8a9affd700 0 client.28823 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:54:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8ad5566b80 1 -- 172.21.15.151:0/3923835326 shutdown_connections 2023-07-21T22:54:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8ad5566b80 1 -- 172.21.15.151:0/3923835326 wait complete. 2023-07-21T22:54:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.177+0000 7f8ad5566b80 20 client.28823 trim_cache size 0 max 16384 2023-07-21T22:54:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:54:51.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:54:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:54:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:54:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 -- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8aa80a1380 msgr2=0x7f8aa80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8aa80a1380 0x7f8aa80a3830 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8ab40ca2f0 tx=0x7f8ab401f000 comp rx=0 tx=0).stop 2023-07-21T22:54:51.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 -- 172.21.15.151:0/3238037959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8abc10a180 msgr2=0x7f8abc070a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:54:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8abc10a180 0x7f8abc070a10 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8ab400e970 tx=0x7f8ab400ec80 comp rx=0 tx=0).stop 2023-07-21T22:54:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 -- 172.21.15.151:0/3238037959 shutdown_connections 2023-07-21T22:54:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8aa80a1380 0x7f8aa80a3830 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8abc100db0 0x7f8abc0fec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8abc10a180 0x7f8abc070a10 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 --2- 172.21.15.151:0/3238037959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8abc1016c0 0x7f8abc0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:54:51.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.178+0000 7f8ac1bff700 1 -- 172.21.15.151:0/3238037959 >> 172.21.15.151:0/3238037959 conn(0x7f8abc075bd0 msgr2=0x7f8abc101b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:54:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.179+0000 7f8ac1bff700 1 -- 172.21.15.151:0/3238037959 shutdown_connections 2023-07-21T22:54:51.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:54:51.179+0000 7f8ac1bff700 1 -- 172.21.15.151:0/3238037959 wait complete. 2023-07-21T22:54:51.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:51 smithi151 ceph-mon[95510]: pgmap v1133: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.9 MiB/s wr, 689 op/s 2023-07-21T22:54:51.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:51 smithi187 ceph-mon[96918]: pgmap v1133: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.9 MiB/s wr, 689 op/s 2023-07-21T22:54:51.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:51 smithi195 ceph-mon[97365]: pgmap v1133: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 8.9 MiB/s wr, 689 op/s 2023-07-21T22:54:53.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:52 smithi187 ceph-mon[96918]: pgmap v1134: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2023-07-21T22:54:53.151 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:52 smithi195 ceph-mon[97365]: pgmap v1134: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2023-07-21T22:54:53.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:52 smithi151 ceph-mon[95510]: pgmap v1134: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 1.02k op/s 2023-07-21T22:54:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 120.0 s, 414.2 tps, lat 240.515 ms stddev 50.923 2023-07-21T22:54:55.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:55 smithi195 ceph-mon[97365]: pgmap v1135: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 822 op/s 2023-07-21T22:54:55.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:55 smithi151 ceph-mon[95510]: pgmap v1135: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 822 op/s 2023-07-21T22:54:57.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:57 smithi195 ceph-mon[97365]: pgmap v1136: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 822 op/s 2023-07-21T22:54:57.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:57 smithi151 ceph-mon[95510]: pgmap v1136: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 822 op/s 2023-07-21T22:54:57.468 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:55 smithi187 ceph-mon[96918]: pgmap v1135: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 822 op/s 2023-07-21T22:54:57.468 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:57 smithi187 ceph-mon[96918]: pgmap v1136: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 10 MiB/s wr, 822 op/s 2023-07-21T22:54:59.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 125.0 s, 368.0 tps, lat 270.410 ms stddev 67.296 2023-07-21T22:54:59.443 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:54:59 smithi151 ceph-mon[95510]: pgmap v1137: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 15 MiB/s wr, 1.22k op/s 2023-07-21T22:54:59.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:54:59 smithi187 ceph-mon[96918]: pgmap v1137: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 15 MiB/s wr, 1.22k op/s 2023-07-21T22:54:59.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:54:59 smithi195 ceph-mon[97365]: pgmap v1137: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 15 MiB/s wr, 1.22k op/s 2023-07-21T22:55:01.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:01 smithi151 ceph-mon[95510]: pgmap v1138: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 10 MiB/s wr, 797 op/s 2023-07-21T22:55:01.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:01 smithi187 ceph-mon[96918]: pgmap v1138: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 10 MiB/s wr, 797 op/s 2023-07-21T22:55:01.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:01 smithi195 ceph-mon[97365]: pgmap v1138: 97 pgs: 97 active+clean; 13 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 900 KiB/s rd, 10 MiB/s wr, 797 op/s 2023-07-21T22:55:03.124 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:02 smithi187 ceph-mon[96918]: pgmap v1139: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-07-21T22:55:03.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:02 smithi195 ceph-mon[97365]: pgmap v1139: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-07-21T22:55:03.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:02 smithi151 ceph-mon[95510]: pgmap v1139: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 15 MiB/s wr, 1.24k op/s 2023-07-21T22:55:04.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 130.0 s, 323.4 tps, lat 283.421 ms stddev 128.219 2023-07-21T22:55:04.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.444+0000 7f0a517ff700 1 -- 172.21.15.151:0/2012102827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a4c06d3a0 msgr2=0x7f0a4c11b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:04.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.444+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2012102827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a4c06d3a0 0x7f0a4c11b470 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c009990 tx=0x7f0a3c009ca0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.457+0000 7f0a517ff700 1 -- 172.21.15.151:0/2012102827 shutdown_connections 2023-07-21T22:55:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.457+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2012102827 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c10e2a0 0x7f0a4c10e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.457+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2012102827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a4c06d3a0 0x7f0a4c11b470 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.457+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2012102827 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a4c06c910 0x7f0a4c06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.457+0000 7f0a517ff700 1 -- 172.21.15.151:0/2012102827 >> 172.21.15.151:0/2012102827 conn(0x7f0a4c06bd70 msgr2=0x7f0a4c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:04.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.464+0000 7f0a517ff700 1 -- 172.21.15.151:0/2012102827 shutdown_connections 2023-07-21T22:55:04.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.469+0000 7f0a517ff700 1 -- 172.21.15.151:0/2012102827 wait complete. 2023-07-21T22:55:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.470+0000 7f0a517ff700 1 Processor -- start 2023-07-21T22:55:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.476+0000 7f0a517ff700 1 -- start start 2023-07-21T22:55:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.477+0000 7f0a517ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a4c06c910 0x7f0a4c1aab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.477+0000 7f0a517ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a4c06d3a0 0x7f0a4c1ab090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.477+0000 7f0a517ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c10e2a0 0x7f0a4c1a4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.477+0000 7f0a517ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c1a50f0 con 0x7f0a4c06d3a0 2023-07-21T22:55:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.477+0000 7f0a517ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c1a5230 con 0x7f0a4c10e2a0 2023-07-21T22:55:04.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.477+0000 7f0a517ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4c1a53f0 con 0x7f0a4c06c910 2023-07-21T22:55:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.480+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a4c06d3a0 0x7f0a4c1ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.480+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a4c06d3a0 0x7f0a4c1ab090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48442/0 (socket says 172.21.15.151:48442) 2023-07-21T22:55:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.480+0000 7f0a4a7fc700 1 -- 172.21.15.151:0/2853617036 learned_addr learned my addr 172.21.15.151:0/2853617036 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.480+0000 7f0a4affd700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a4c06c910 0x7f0a4c1aab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.483+0000 7f0a4affd700 1 -- 172.21.15.151:0/2853617036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c10e2a0 msgr2=0x7f0a4c1a4920 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:55:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.483+0000 7f0a4affd700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c10e2a0 0x7f0a4c1a4920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.483+0000 7f0a4affd700 1 -- 172.21.15.151:0/2853617036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a4c06d3a0 msgr2=0x7f0a4c1ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.483+0000 7f0a4affd700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a4c06d3a0 0x7f0a4c1ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.483+0000 7f0a4affd700 1 -- 172.21.15.151:0/2853617036 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a3c0095f0 con 0x7f0a4c06c910 2023-07-21T22:55:04.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.487+0000 7f0a4affd700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a4c06c910 0x7f0a4c1aab50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400bb80 tx=0x7f0a4400be90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.490+0000 7f0a33fff700 1 -- 172.21.15.151:0/2853617036 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4400cab0 con 0x7f0a4c06c910 2023-07-21T22:55:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.490+0000 7f0a33fff700 1 -- 172.21.15.151:0/2853617036 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a4400cc10 con 0x7f0a4c06c910 2023-07-21T22:55:04.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.490+0000 7f0a33fff700 1 -- 172.21.15.151:0/2853617036 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440125a0 con 0x7f0a4c06c910 2023-07-21T22:55:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.495+0000 7f0a517ff700 1 -- 172.21.15.151:0/2853617036 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a4c1a56d0 con 0x7f0a4c06c910 2023-07-21T22:55:04.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.495+0000 7f0a517ff700 1 -- 172.21.15.151:0/2853617036 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c10ee20 con 0x7f0a4c06c910 2023-07-21T22:55:04.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.508+0000 7f0a650dcb80 1 Processor -- start 2023-07-21T22:55:04.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.511+0000 7f0a33fff700 1 -- 172.21.15.151:0/2853617036 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0a44014440 con 0x7f0a4c06c910 2023-07-21T22:55:04.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.518+0000 7f0a650dcb80 1 -- start start 2023-07-21T22:55:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.518+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653c9236b0 0x55653cacccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.518+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd210 0x55653cac6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.518+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd660 0x55653cac74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.518+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653c9ccc50 con 0x55653c9236b0 2023-07-21T22:55:04.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.518+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653ca1f9e0 con 0x55653cacd660 2023-07-21T22:55:04.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.518+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653ca18e70 con 0x55653cacd210 2023-07-21T22:55:04.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.519+0000 7f0a4affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd210 0x55653cac6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.519+0000 7f0a4affd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd210 0x55653cac6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37508/0 (socket says 172.21.15.151:37508) 2023-07-21T22:55:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.519+0000 7f0a4affd700 1 -- 172.21.15.151:0/3829355200 learned_addr learned my addr 172.21.15.151:0/3829355200 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.520+0000 7f0a4affd700 1 -- 172.21.15.151:0/3829355200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd660 msgr2=0x55653cac74a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:55:04.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.520+0000 7f0a4affd700 1 --2- 172.21.15.151:0/3829355200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd660 0x55653cac74a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.520+0000 7f0a4affd700 1 -- 172.21.15.151:0/3829355200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653c9236b0 msgr2=0x55653cacccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.520+0000 7f0a4affd700 1 --2- 172.21.15.151:0/3829355200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653c9236b0 0x55653cacccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.520+0000 7f0a4affd700 1 -- 172.21.15.151:0/3829355200 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55653c846d80 con 0x55653cacd210 2023-07-21T22:55:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.522+0000 7f0a4affd700 1 --2- 172.21.15.151:0/3829355200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd210 0x55653cac6f40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0a440c9850 tx=0x7f0a440d4160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f9815a035092d05 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.523+0000 7f0a33fff700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0a340a1410 0x7f0a340a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.523+0000 7f0a33fff700 1 -- 172.21.15.151:0/2853617036 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f0a440cc120 con 0x7f0a4c06c910 2023-07-21T22:55:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.524+0000 7f0a317fa700 1 -- 172.21.15.151:0/3829355200 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a440955d0 con 0x55653cacd210 2023-07-21T22:55:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.525+0000 7f0a317fa700 1 -- 172.21.15.151:0/3829355200 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a44099060 con 0x55653cacd210 2023-07-21T22:55:04.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.525+0000 7f0a317fa700 1 -- 172.21.15.151:0/3829355200 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a44099290 con 0x55653cacd210 2023-07-21T22:55:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.526+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3829355200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd210 msgr2=0x55653cac6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.526+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/3829355200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd210 0x55653cac6f40 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f0a440c9850 tx=0x7f0a440d4160 comp rx=0 tx=0).stop 2023-07-21T22:55:04.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.526+0000 7f0a4b7fe700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0a340a1410 0x7f0a340a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.527+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3829355200 shutdown_connections 2023-07-21T22:55:04.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.527+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/3829355200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd660 0x55653cac74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.527+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/3829355200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653c9236b0 0x55653cacccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.527+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/3829355200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd210 0x55653cac6f40 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.527+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3829355200 >> 172.21.15.151:0/3829355200 conn(0x55653cabcae0 msgr2=0x55653cac20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:04.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.528+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3829355200 shutdown_connections 2023-07-21T22:55:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.528+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3829355200 wait complete. 2023-07-21T22:55:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.528+0000 7f0a4b7fe700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0a340a1410 0x7f0a340a38c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0098e0 tx=0x7f0a3c00b540 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:04.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.529+0000 7f0a650dcb80 1 -- start start 2023-07-21T22:55:04.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.529+0000 7f0a650dcb80 1 Processor -- start 2023-07-21T22:55:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.531+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653c9236b0 0x55653cad0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.531+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd210 0x55653cad0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.531+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 0x55653cad1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.531+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653c9b8a60 con 0x55653cacd210 2023-07-21T22:55:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.531+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653c9b8760 con 0x55653c9236b0 2023-07-21T22:55:04.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.531+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653c89c8c0 con 0x55653cacd660 2023-07-21T22:55:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.531+0000 7f0a650dcb80 10 client.0 _ll_register_callbacks cb 0x55653c9b6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:04.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.533+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd210 0x55653cad0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.533+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd210 0x55653cad0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48458/0 (socket says 172.21.15.151:48458) 2023-07-21T22:55:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.533+0000 7f0a4a7fc700 1 -- 172.21.15.151:0/775555285 learned_addr learned my addr 172.21.15.151:0/775555285 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.533+0000 7f0a4a7fc700 1 -- 172.21.15.151:0/775555285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 msgr2=0x55653cad1380 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:55:04.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.533+0000 7f0a4a7fc700 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 0x55653cad1380 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.533+0000 7f0a4a7fc700 1 -- 172.21.15.151:0/775555285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653c9236b0 msgr2=0x55653cad0900 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:55:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.533+0000 7f0a4a7fc700 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653c9236b0 0x55653cad0900 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.534+0000 7f0a4a7fc700 1 -- 172.21.15.151:0/775555285 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c10ee20 con 0x55653cacd210 2023-07-21T22:55:04.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.534+0000 7f0a4a7fc700 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd210 0x55653cad0e40 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000e450 tx=0x7f0a4000e810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc99d8b73e9c13b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:04.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.535+0000 7f0a2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:55:04.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.535+0000 7f0a2eff5700 1 -- 172.21.15.151:0/775555285 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40013470 con 0x55653cacd210 2023-07-21T22:55:04.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.535+0000 7f0a2eff5700 1 -- 172.21.15.151:0/775555285 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f0a400135d0 con 0x55653cacd210 2023-07-21T22:55:04.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.535+0000 7f0a650dcb80 1 -- 172.21.15.151:0/775555285 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55653c972490 con 0x55653cacd210 2023-07-21T22:55:04.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.539+0000 7f0a2eff5700 1 -- 172.21.15.151:0/775555285 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a40013790 con 0x55653cacd210 2023-07-21T22:55:04.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.539+0000 7f0a650dcb80 10 client.19143 fetch_fsmap learned FSMap version 105 2023-07-21T22:55:04.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.539+0000 7f0a650dcb80 1 -- 172.21.15.151:0/775555285 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55653c82fc00 con 0x55653cacd210 2023-07-21T22:55:04.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.540+0000 7f0a2eff5700 1 -- 172.21.15.151:0/775555285 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55653c972490 con 0x55653cacd210 2023-07-21T22:55:04.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.540+0000 7f0a2eff5700 1 -- 172.21.15.151:0/775555285 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0a40011070 con 0x55653cacd210 2023-07-21T22:55:04.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.541+0000 7f0a650dcb80 10 client.19143 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:55:04.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.541+0000 7f0a650dcb80 10 client.19143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:04.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.541+0000 7f0a650dcb80 20 client.19143 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:04.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.541+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55653cae0db0 0x55653cae31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.541+0000 7f0a650dcb80 4 client.19143 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:55:04.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.541+0000 7f0a650dcb80 1 -- 172.21.15.151:0/775555285 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55653ca11e50 con 0x55653cae0db0 2023-07-21T22:55:04.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.547+0000 7f0a4affd700 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55653cae0db0 0x55653cae31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.552+0000 7f0a4affd700 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55653cae0db0 0x55653cae31c0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce62031acfef1afe server_cookie=deb1ba3ad1af7af9 in_seq=0 out_seq=0 2023-07-21T22:55:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.554+0000 7f0a2eff5700 10 client.19143 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:04.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.561+0000 7f0a2eff5700 1 -- 172.21.15.151:0/775555285 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55653ca11e50 con 0x55653cae0db0 2023-07-21T22:55:04.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.561+0000 7f0a2eff5700 10 client.19143 handle_command_reply: tid=0 2023-07-21T22:55:04.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.561+0000 7f0a650dcb80 1 client.19143 shutdown 2023-07-21T22:55:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a650dcb80 1 -- 172.21.15.151:0/775555285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd210 msgr2=0x55653cad0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd210 0x55653cad0e40 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f0a4000e450 tx=0x7f0a4000e810 comp rx=0 tx=0).stop 2023-07-21T22:55:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a650dcb80 1 -- 172.21.15.151:0/775555285 shutdown_connections 2023-07-21T22:55:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55653cae0db0 0x55653cae31c0 crc :-1 s=READY pgs=419 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653c9236b0 0x55653cad0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 0x55653cad1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/775555285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd210 0x55653cad0e40 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a2eff5700 0 client.19143 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a650dcb80 1 -- 172.21.15.151:0/775555285 >> 172.21.15.151:0/775555285 conn(0x55653cabcae0 msgr2=0x55653cac13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.563+0000 7f0a650dcb80 1 -- 172.21.15.151:0/775555285 shutdown_connections 2023-07-21T22:55:04.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.564+0000 7f0a650dcb80 1 -- 172.21.15.151:0/775555285 wait complete. 2023-07-21T22:55:04.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.564+0000 7f0a650dcb80 20 client.19143 trim_cache size 0 max 16384 2023-07-21T22:55:04.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.595+0000 7f0a650dcb80 1 Processor -- start 2023-07-21T22:55:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.596+0000 7f0a650dcb80 1 -- start start 2023-07-21T22:55:04.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.596+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653c9236b0 0x55653cad7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.596+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cacc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.596+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 0x55653cad11b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.596+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653cacb610 con 0x55653c9236b0 2023-07-21T22:55:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.596+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653cad81a0 con 0x55653cacd210 2023-07-21T22:55:04.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.596+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653cacb260 con 0x55653cacd660 2023-07-21T22:55:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.597+0000 7f0a4b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 0x55653cad11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.597+0000 7f0a4b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 0x55653cad11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:37520/0 (socket says 172.21.15.151:37520) 2023-07-21T22:55:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.597+0000 7f0a4b7fe700 1 -- 172.21.15.151:0/3120839499 learned_addr learned my addr 172.21.15.151:0/3120839499 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.598+0000 7f0a4a7fc700 1 --2- 172.21.15.151:0/3120839499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cacc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.598+0000 7f0a4b7fe700 1 -- 172.21.15.151:0/3120839499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 msgr2=0x55653cacc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.598+0000 7f0a4b7fe700 1 --2- 172.21.15.151:0/3120839499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cacc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.598+0000 7f0a4b7fe700 1 -- 172.21.15.151:0/3120839499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653c9236b0 msgr2=0x55653cad7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.598+0000 7f0a4b7fe700 1 --2- 172.21.15.151:0/3120839499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653c9236b0 0x55653cad7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.598+0000 7f0a4b7fe700 1 -- 172.21.15.151:0/3120839499 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55653c86d1f0 con 0x55653cacd660 2023-07-21T22:55:04.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.599+0000 7f0a4b7fe700 1 --2- 172.21.15.151:0/3120839499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 0x55653cad11b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c015000 tx=0x7f0a3c01d000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d24a5b50d64db0c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.599+0000 7f0a31ffb700 1 -- 172.21.15.151:0/3120839499 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c029070 con 0x55653cacd660 2023-07-21T22:55:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.600+0000 7f0a31ffb700 1 -- 172.21.15.151:0/3120839499 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a3c0054e0 con 0x55653cacd660 2023-07-21T22:55:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.600+0000 7f0a31ffb700 1 -- 172.21.15.151:0/3120839499 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a3c01d070 con 0x55653cacd660 2023-07-21T22:55:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.601+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3120839499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 msgr2=0x55653cad11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:04.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.601+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/3120839499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 0x55653cad11b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c015000 tx=0x7f0a3c01d000 comp rx=0 tx=0).stop 2023-07-21T22:55:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.601+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3120839499 shutdown_connections 2023-07-21T22:55:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.601+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/3120839499 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653cacd660 0x55653cad11b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.601+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/3120839499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653c9236b0 0x55653cad7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.601+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/3120839499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cacc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.601+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3120839499 >> 172.21.15.151:0/3120839499 conn(0x55653cabcae0 msgr2=0x55653cacb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:04.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.617+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3120839499 shutdown_connections 2023-07-21T22:55:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.617+0000 7f0a650dcb80 1 -- 172.21.15.151:0/3120839499 wait complete. 2023-07-21T22:55:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.618+0000 7f0a650dcb80 1 -- start start 2023-07-21T22:55:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.618+0000 7f0a650dcb80 1 Processor -- start 2023-07-21T22:55:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.619+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653c9236b0 0x55653cac73b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.619+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cac5f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.619+0000 7f0a650dcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd660 0x55653cac6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.619+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653cac69b0 con 0x55653cacd660 2023-07-21T22:55:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.619+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653cac6b20 con 0x55653cacd210 2023-07-21T22:55:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.619+0000 7f0a650dcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55653cac6ce0 con 0x55653c9236b0 2023-07-21T22:55:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.619+0000 7f0a650dcb80 10 client.0 _ll_register_callbacks cb 0x7f0a40009a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.620+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cac5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.620+0000 7f0a4a7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cac5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:47296/0 (socket says 172.21.15.151:47296) 2023-07-21T22:55:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.620+0000 7f0a4a7fc700 1 -- 172.21.15.151:0/1919990206 learned_addr learned my addr 172.21.15.151:0/1919990206 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:04.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.623+0000 7f0a4affd700 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653c9236b0 0x55653cac73b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.623+0000 7f0a4a7fc700 1 -- 172.21.15.151:0/1919990206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653c9236b0 msgr2=0x55653cac73b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.623+0000 7f0a4a7fc700 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653c9236b0 0x55653cac73b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.623+0000 7f0a4a7fc700 1 -- 172.21.15.151:0/1919990206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd660 msgr2=0x55653cac6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:04.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.623+0000 7f0a4a7fc700 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd660 0x55653cac6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.623+0000 7f0a4a7fc700 1 -- 172.21.15.151:0/1919990206 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a4c11bfb0 con 0x55653cacd210 2023-07-21T22:55:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.628+0000 7f0a4a7fc700 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cac5f30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0a40000ea0 tx=0x7f0a4001c7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea382988f180defd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:04.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.628+0000 7f0a2eff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:55:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.633+0000 7f0a2eff5700 1 -- 172.21.15.151:0/1919990206 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a40005e90 con 0x55653cacd210 2023-07-21T22:55:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.633+0000 7f0a2eff5700 1 -- 172.21.15.151:0/1919990206 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(149..149 src has 1..149) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f0a40012740 con 0x55653cacd210 2023-07-21T22:55:04.672 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.635+0000 7f0a650dcb80 1 -- 172.21.15.151:0/1919990206 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0a44099060 con 0x55653cacd210 2023-07-21T22:55:04.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.643+0000 7f0a2eff5700 1 -- 172.21.15.151:0/1919990206 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0a40012920 con 0x55653cacd210 2023-07-21T22:55:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.647+0000 7f0a650dcb80 10 client.28826 fetch_fsmap learned FSMap version 105 2023-07-21T22:55:04.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.647+0000 7f0a650dcb80 1 -- 172.21.15.151:0/1919990206 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x55653c845250 con 0x55653cacd210 2023-07-21T22:55:04.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.651+0000 7f0a2eff5700 1 -- 172.21.15.151:0/1919990206 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0a44099060 con 0x55653cacd210 2023-07-21T22:55:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.651+0000 7f0a2eff5700 1 -- 172.21.15.151:0/1919990206 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f0a4002c020 con 0x55653cacd210 2023-07-21T22:55:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.652+0000 7f0a650dcb80 10 client.28826 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:55:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.652+0000 7f0a650dcb80 10 client.28826 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.652+0000 7f0a650dcb80 20 client.28826 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.652+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55653cb35eb0 0x55653cb382c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.652+0000 7f0a650dcb80 4 client.28826 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:55:04.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.652+0000 7f0a650dcb80 1 -- 172.21.15.151:0/1919990206 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55653c9d3ff0 con 0x55653cb35eb0 2023-07-21T22:55:04.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.655+0000 7f0a4affd700 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55653cb35eb0 0x55653cb382c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:04.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.659+0000 7f0a2eff5700 10 client.28826 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:04.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.659+0000 7f0a4affd700 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55653cb35eb0 0x55653cb382c0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2515b14fd20198d1 server_cookie=a8fea62c28a74741 in_seq=0 out_seq=0 2023-07-21T22:55:04.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.762+0000 7f0a2eff5700 1 -- 172.21.15.151:0/1919990206 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55653c9d3ff0 con 0x55653cb35eb0 2023-07-21T22:55:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.762+0000 7f0a2eff5700 10 client.28826 handle_command_reply: tid=0 2023-07-21T22:55:04.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.769+0000 7f0a650dcb80 1 client.28826 shutdown 2023-07-21T22:55:04.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.776+0000 7f0a650dcb80 1 -- 172.21.15.151:0/1919990206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 msgr2=0x55653cac5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:04.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.776+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cac5f30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f0a40000ea0 tx=0x7f0a4001c7a0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.786+0000 7f0a650dcb80 1 -- 172.21.15.151:0/1919990206 shutdown_connections 2023-07-21T22:55:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.786+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55653cb35eb0 0x55653cb382c0 crc :-1 s=READY pgs=420 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.786+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55653cacd660 0x55653cac6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.786+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55653c9236b0 0x55653cac73b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.786+0000 7f0a650dcb80 1 --2- 172.21.15.151:0/1919990206 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55653cacd210 0x55653cac5f30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.786+0000 7f0a650dcb80 1 -- 172.21.15.151:0/1919990206 >> 172.21.15.151:0/1919990206 conn(0x55653cabcae0 msgr2=0x55653cacf0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.786+0000 7f0a2eff5700 0 client.28826 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.786+0000 7f0a650dcb80 1 -- 172.21.15.151:0/1919990206 shutdown_connections 2023-07-21T22:55:04.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.786+0000 7f0a650dcb80 1 -- 172.21.15.151:0/1919990206 wait complete. 2023-07-21T22:55:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.787+0000 7f0a650dcb80 20 client.28826 trim_cache size 0 max 16384 2023-07-21T22:55:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:55:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:55:04.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:55:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:55:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.787+0000 7f0a517ff700 1 -- 172.21.15.151:0/2853617036 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0a340a1410 msgr2=0x7f0a340a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.787+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0a340a1410 0x7f0a340a38c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0a3c0098e0 tx=0x7f0a3c00b540 comp rx=0 tx=0).stop 2023-07-21T22:55:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.787+0000 7f0a517ff700 1 -- 172.21.15.151:0/2853617036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a4c06c910 msgr2=0x7f0a4c1aab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:04.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.787+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a4c06c910 0x7f0a4c1aab50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f0a4400bb80 tx=0x7f0a4400be90 comp rx=0 tx=0).stop 2023-07-21T22:55:04.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.799+0000 7f0a517ff700 1 -- 172.21.15.151:0/2853617036 shutdown_connections 2023-07-21T22:55:04.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.799+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0a340a1410 0x7f0a340a38c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.799+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a4c10e2a0 0x7f0a4c1a4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.799+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0a4c06c910 0x7f0a4c1aab50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.799+0000 7f0a517ff700 1 --2- 172.21.15.151:0/2853617036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0a4c06d3a0 0x7f0a4c1ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:04.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.799+0000 7f0a517ff700 1 -- 172.21.15.151:0/2853617036 >> 172.21.15.151:0/2853617036 conn(0x7f0a4c06bd70 msgr2=0x7f0a4c070890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.800+0000 7f0a517ff700 1 -- 172.21.15.151:0/2853617036 shutdown_connections 2023-07-21T22:55:04.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:04.801+0000 7f0a517ff700 1 -- 172.21.15.151:0/2853617036 wait complete. 2023-07-21T22:55:05.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:04 smithi187 ceph-mon[96918]: osdmap e149: 12 total, 12 up, 12 in 2023-07-21T22:55:05.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:04 smithi187 ceph-mon[96918]: pgmap v1141: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2023-07-21T22:55:05.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:04 smithi195 ceph-mon[97365]: osdmap e149: 12 total, 12 up, 12 in 2023-07-21T22:55:05.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:04 smithi195 ceph-mon[97365]: pgmap v1141: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2023-07-21T22:55:05.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:04 smithi151 ceph-mon[95510]: osdmap e149: 12 total, 12 up, 12 in 2023-07-21T22:55:05.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:04 smithi151 ceph-mon[95510]: pgmap v1141: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2023-07-21T22:55:07.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:07 smithi151 ceph-mon[95510]: pgmap v1142: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2023-07-21T22:55:07.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:07 smithi187 ceph-mon[96918]: pgmap v1142: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2023-07-21T22:55:07.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:07 smithi195 ceph-mon[97365]: pgmap v1142: 97 pgs: 97 active+clean; 14 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 953 KiB/s rd, 12 MiB/s wr, 1.01k op/s 2023-07-21T22:55:09.298 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 135.0 s, 215.8 tps, lat 504.280 ms stddev 310.017 2023-07-21T22:55:09.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:09 smithi151 ceph-mon[95510]: pgmap v1143: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 9.1 MiB/s wr, 756 op/s 2023-07-21T22:55:09.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:09 smithi187 ceph-mon[96918]: pgmap v1143: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 9.1 MiB/s wr, 756 op/s 2023-07-21T22:55:09.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:09 smithi195 ceph-mon[97365]: pgmap v1143: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 9.1 MiB/s wr, 756 op/s 2023-07-21T22:55:11.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:11 smithi151 ceph-mon[95510]: pgmap v1144: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 9.1 MiB/s wr, 756 op/s 2023-07-21T22:55:11.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:11 smithi187 ceph-mon[96918]: pgmap v1144: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 9.1 MiB/s wr, 756 op/s 2023-07-21T22:55:11.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:11 smithi195 ceph-mon[97365]: pgmap v1144: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 839 KiB/s rd, 9.1 MiB/s wr, 756 op/s 2023-07-21T22:55:13.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:12 smithi187 ceph-mon[96918]: osdmap e150: 12 total, 12 up, 12 in 2023-07-21T22:55:13.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:12 smithi187 ceph-mon[96918]: pgmap v1146: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 9.3 MiB/s wr, 735 op/s 2023-07-21T22:55:13.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:12 smithi195 ceph-mon[97365]: osdmap e150: 12 total, 12 up, 12 in 2023-07-21T22:55:13.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:12 smithi195 ceph-mon[97365]: pgmap v1146: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 9.3 MiB/s wr, 735 op/s 2023-07-21T22:55:13.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:12 smithi151 ceph-mon[95510]: osdmap e150: 12 total, 12 up, 12 in 2023-07-21T22:55:13.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:12 smithi151 ceph-mon[95510]: pgmap v1146: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 935 KiB/s rd, 9.3 MiB/s wr, 735 op/s 2023-07-21T22:55:14.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 140.0 s, 334.9 tps, lat 299.753 ms stddev 64.370 2023-07-21T22:55:15.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:15 smithi195 ceph-mon[97365]: pgmap v1147: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 7.7 MiB/s wr, 608 op/s 2023-07-21T22:55:15.443 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:15 smithi151 ceph-mon[95510]: pgmap v1147: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 7.7 MiB/s wr, 608 op/s 2023-07-21T22:55:15.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:15 smithi187 ceph-mon[96918]: pgmap v1147: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 7.7 MiB/s wr, 608 op/s 2023-07-21T22:55:17.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:17 smithi151 ceph-mon[95510]: pgmap v1148: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 7.7 MiB/s wr, 608 op/s 2023-07-21T22:55:17.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:17 smithi187 ceph-mon[96918]: pgmap v1148: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 7.7 MiB/s wr, 608 op/s 2023-07-21T22:55:17.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:17 smithi195 ceph-mon[97365]: pgmap v1148: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 774 KiB/s rd, 7.7 MiB/s wr, 608 op/s 2023-07-21T22:55:18.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.059+0000 7f9ca6dff700 1 -- 172.21.15.151:0/1243148829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca0104a30 msgr2=0x7f9ca0104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.059+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/1243148829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca0104a30 0x7f9ca0104e00 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f9c94009990 tx=0x7f9c94009ca0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.060+0000 7f9ca6dff700 1 -- 172.21.15.151:0/1243148829 shutdown_connections 2023-07-21T22:55:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.060+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/1243148829 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ca00ff3e0 0x7f9ca010b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.060+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/1243148829 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca0104a30 0x7f9ca0104e00 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.060+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/1243148829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca00fea30 0x7f9ca00feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.060+0000 7f9ca6dff700 1 -- 172.21.15.151:0/1243148829 >> 172.21.15.151:0/1243148829 conn(0x7f9ca0074760 msgr2=0x7f9ca0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.060+0000 7f9ca6dff700 1 -- 172.21.15.151:0/1243148829 shutdown_connections 2023-07-21T22:55:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.060+0000 7f9ca6dff700 1 -- 172.21.15.151:0/1243148829 wait complete. 2023-07-21T22:55:18.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.062+0000 7f9ca6dff700 1 Processor -- start 2023-07-21T22:55:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9ca6dff700 1 -- start start 2023-07-21T22:55:18.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9ca6dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca00fea30 0x7f9ca0109b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9ca6dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ca00ff3e0 0x7f9ca0118cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9ca6dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca0104a30 0x7f9ca010a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9ca6dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca010a720 con 0x7f9ca00fea30 2023-07-21T22:55:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9ca6dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca010a890 con 0x7f9ca0104a30 2023-07-21T22:55:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9ca6dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca0069f30 con 0x7f9ca00ff3e0 2023-07-21T22:55:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ca00ff3e0 0x7f9ca0118cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ca00ff3e0 0x7f9ca0118cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45502/0 (socket says 172.21.15.151:45502) 2023-07-21T22:55:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.064+0000 7f9c9ffff700 1 -- 172.21.15.151:0/2335059213 learned_addr learned my addr 172.21.15.151:0/2335059213 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.065+0000 7f9ca539c700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca0104a30 0x7f9ca010a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.066+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca00fea30 0x7f9ca0109b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.066+0000 7f9ca4b9b700 1 -- 172.21.15.151:0/2335059213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ca00ff3e0 msgr2=0x7f9ca0118cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.066+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ca00ff3e0 0x7f9ca0118cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.066+0000 7f9ca4b9b700 1 -- 172.21.15.151:0/2335059213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca0104a30 msgr2=0x7f9ca010a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.066+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca0104a30 0x7f9ca010a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.066+0000 7f9ca4b9b700 1 -- 172.21.15.151:0/2335059213 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940095f0 con 0x7f9ca00fea30 2023-07-21T22:55:18.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.067+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca00fea30 0x7f9ca0109b40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9c94000c00 tx=0x7f9c94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.068+0000 7f9c9dffb700 1 -- 172.21.15.151:0/2335059213 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9401d070 con 0x7f9ca00fea30 2023-07-21T22:55:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.068+0000 7f9c9dffb700 1 -- 172.21.15.151:0/2335059213 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c940173f0 con 0x7f9ca00fea30 2023-07-21T22:55:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.068+0000 7f9c9dffb700 1 -- 172.21.15.151:0/2335059213 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9400e640 con 0x7f9ca00fea30 2023-07-21T22:55:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.068+0000 7f9ca6dff700 1 -- 172.21.15.151:0/2335059213 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ca006a1b0 con 0x7f9ca00fea30 2023-07-21T22:55:18.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.068+0000 7f9ca6dff700 1 -- 172.21.15.151:0/2335059213 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca006a610 con 0x7f9ca00fea30 2023-07-21T22:55:18.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.074+0000 7f9c9dffb700 1 -- 172.21.15.151:0/2335059213 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f9c94017560 con 0x7f9ca00fea30 2023-07-21T22:55:18.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.075+0000 7f9cba738b80 1 Processor -- start 2023-07-21T22:55:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.076+0000 7f9cba738b80 1 -- start start 2023-07-21T22:55:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.076+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d199f76b0 0x562d19ba0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.076+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1210 0x562d19b9af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.076+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d19ba1660 0x562d19b9b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.076+0000 7f9cba738b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19aa0c50 con 0x562d19ba1210 2023-07-21T22:55:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.076+0000 7f9cba738b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19af39e0 con 0x562d199f76b0 2023-07-21T22:55:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.076+0000 7f9cba738b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19aece70 con 0x562d19ba1660 2023-07-21T22:55:18.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.077+0000 7f9ca539c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d199f76b0 0x562d19ba0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.077+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d19ba1660 0x562d19b9b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.077+0000 7f9ca539c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d199f76b0 0x562d19ba0cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53294/0 (socket says 172.21.15.151:53294) 2023-07-21T22:55:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.077+0000 7f9ca539c700 1 -- 172.21.15.151:0/759810413 learned_addr learned my addr 172.21.15.151:0/759810413 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.077+0000 7f9ca539c700 1 -- 172.21.15.151:0/759810413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d19ba1660 msgr2=0x562d19b9b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.077+0000 7f9ca539c700 1 --2- 172.21.15.151:0/759810413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d19ba1660 0x562d19b9b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.077+0000 7f9ca539c700 1 -- 172.21.15.151:0/759810413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1210 msgr2=0x562d19b9af40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:55:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.077+0000 7f9ca539c700 1 --2- 172.21.15.151:0/759810413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1210 0x562d19b9af40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.077+0000 7f9ca539c700 1 -- 172.21.15.151:0/759810413 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d1991ad80 con 0x562d199f76b0 2023-07-21T22:55:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.078+0000 7f9ca539c700 1 --2- 172.21.15.151:0/759810413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d199f76b0 0x562d19ba0cd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009440 tx=0x7f9c98009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7792757e02773351 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:18.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.078+0000 7f9c86ffd700 1 -- 172.21.15.151:0/759810413 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c9800e070 con 0x562d199f76b0 2023-07-21T22:55:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.078+0000 7f9c86ffd700 1 -- 172.21.15.151:0/759810413 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c9800f040 con 0x562d199f76b0 2023-07-21T22:55:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.078+0000 7f9c86ffd700 1 -- 172.21.15.151:0/759810413 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98015ae0 con 0x562d199f76b0 2023-07-21T22:55:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.079+0000 7f9cba738b80 1 -- 172.21.15.151:0/759810413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d199f76b0 msgr2=0x562d19ba0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.079+0000 7f9cba738b80 1 --2- 172.21.15.151:0/759810413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d199f76b0 0x562d19ba0cd0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009440 tx=0x7f9c98009920 comp rx=0 tx=0).stop 2023-07-21T22:55:18.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.080+0000 7f9cba738b80 1 -- 172.21.15.151:0/759810413 shutdown_connections 2023-07-21T22:55:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.080+0000 7f9cba738b80 1 --2- 172.21.15.151:0/759810413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d199f76b0 0x562d19ba0cd0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.080+0000 7f9cba738b80 1 --2- 172.21.15.151:0/759810413 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d19ba1660 0x562d19b9b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.080+0000 7f9cba738b80 1 --2- 172.21.15.151:0/759810413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1210 0x562d19b9af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.080+0000 7f9cba738b80 1 -- 172.21.15.151:0/759810413 >> 172.21.15.151:0/759810413 conn(0x562d19b90ae0 msgr2=0x562d19b960e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.081+0000 7f9cba738b80 1 -- 172.21.15.151:0/759810413 shutdown_connections 2023-07-21T22:55:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.081+0000 7f9cba738b80 1 -- 172.21.15.151:0/759810413 wait complete. 2023-07-21T22:55:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.081+0000 7f9c9dffb700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9c880a1300 0x7f9c880a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.082+0000 7f9cba738b80 1 -- start start 2023-07-21T22:55:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.082+0000 7f9cba738b80 1 Processor -- start 2023-07-21T22:55:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.082+0000 7f9c9dffb700 1 -- 172.21.15.151:0/2335059213 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9c940ce0b0 con 0x7f9ca00fea30 2023-07-21T22:55:18.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.082+0000 7f9ca539c700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9c880a1300 0x7f9c880a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d199f76b0 0x562d19ba48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 0x562d19ba4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d19ba1660 0x562d19ba5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9cba738b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19a8ca60 con 0x562d199f76b0 2023-07-21T22:55:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9cba738b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19a8c760 con 0x562d19ba1210 2023-07-21T22:55:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9cba738b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d199708c0 con 0x562d19ba1660 2023-07-21T22:55:18.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9cba738b80 10 client.0 _ll_register_callbacks cb 0x562d19a8a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 0x562d19ba4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9c9ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 0x562d19ba4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53298/0 (socket says 172.21.15.151:53298) 2023-07-21T22:55:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.083+0000 7f9c9ffff700 1 -- 172.21.15.151:0/357343310 learned_addr learned my addr 172.21.15.151:0/357343310 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.084+0000 7f9c9ffff700 1 -- 172.21.15.151:0/357343310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d19ba1660 msgr2=0x562d19ba5350 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:55:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.084+0000 7f9c9ffff700 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d19ba1660 0x562d19ba5350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.084+0000 7f9c9ffff700 1 -- 172.21.15.151:0/357343310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d199f76b0 msgr2=0x562d19ba48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:18.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.084+0000 7f9c9ffff700 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d199f76b0 0x562d19ba48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.084+0000 7f9c9ffff700 1 -- 172.21.15.151:0/357343310 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c980090f0 con 0x562d19ba1210 2023-07-21T22:55:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.084+0000 7f9c9ffff700 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 0x562d19ba4e10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9c90012840 tx=0x7f9c90012c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6062052004f6865c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:18.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.084+0000 7f9c7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:55:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.085+0000 7f9c7ffff700 1 -- 172.21.15.151:0/357343310 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c90017070 con 0x562d19ba1210 2023-07-21T22:55:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.085+0000 7f9c7ffff700 1 -- 172.21.15.151:0/357343310 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9c9000f640 con 0x562d19ba1210 2023-07-21T22:55:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.085+0000 7f9cba738b80 1 -- 172.21.15.151:0/357343310 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562d19a46490 con 0x562d19ba1210 2023-07-21T22:55:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.086+0000 7f9c7ffff700 1 -- 172.21.15.151:0/357343310 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c900122e0 con 0x562d19ba1210 2023-07-21T22:55:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.086+0000 7f9cba738b80 10 client.28838 fetch_fsmap learned FSMap version 105 2023-07-21T22:55:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.086+0000 7f9cba738b80 1 -- 172.21.15.151:0/357343310 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x562d19903c00 con 0x562d19ba1210 2023-07-21T22:55:18.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.086+0000 7f9c7ffff700 1 -- 172.21.15.151:0/357343310 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562d19a46490 con 0x562d19ba1210 2023-07-21T22:55:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.087+0000 7f9c7ffff700 1 -- 172.21.15.151:0/357343310 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f9c900268f0 con 0x562d19ba1210 2023-07-21T22:55:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.087+0000 7f9cba738b80 10 client.28838 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:55:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.087+0000 7f9cba738b80 10 client.28838 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:18.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.087+0000 7f9cba738b80 20 client.28838 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.087+0000 7f9cba738b80 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d19bb4b70 0x562d19bb6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.087+0000 7f9cba738b80 4 client.28838 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:55:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.087+0000 7f9cba738b80 1 -- 172.21.15.151:0/357343310 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562d19ae5e50 con 0x562d19bb4b70 2023-07-21T22:55:18.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.089+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d19bb4b70 0x562d19bb6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.089+0000 7f9ca539c700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9c880a1300 0x7f9c880a37b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009550 tx=0x7f9c98009da0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.089+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d19bb4b70 0x562d19bb6f80 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c202d1b9862bc99 server_cookie=23849b9a1ff5703f in_seq=0 out_seq=0 2023-07-21T22:55:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.090+0000 7f9c7ffff700 10 client.28838 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:18.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.090+0000 7f9c7ffff700 1 -- 172.21.15.151:0/357343310 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562d19ae5e50 con 0x562d19bb4b70 2023-07-21T22:55:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.090+0000 7f9c7ffff700 10 client.28838 handle_command_reply: tid=0 2023-07-21T22:55:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.091+0000 7f9cba738b80 1 client.28838 shutdown 2023-07-21T22:55:18.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.091+0000 7f9cba738b80 1 -- 172.21.15.151:0/357343310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 msgr2=0x562d19ba4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.091+0000 7f9cba738b80 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 0x562d19ba4e10 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f9c90012840 tx=0x7f9c90012c00 comp rx=0 tx=0).stop 2023-07-21T22:55:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.092+0000 7f9cba738b80 1 -- 172.21.15.151:0/357343310 shutdown_connections 2023-07-21T22:55:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.092+0000 7f9cba738b80 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d19bb4b70 0x562d19bb6f80 crc :-1 s=READY pgs=421 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.092+0000 7f9cba738b80 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d19ba1660 0x562d19ba5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.092+0000 7f9cba738b80 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d199f76b0 0x562d19ba48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.092+0000 7f9cba738b80 1 --2- 172.21.15.151:0/357343310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 0x562d19ba4e10 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.092+0000 7f9cba738b80 1 -- 172.21.15.151:0/357343310 >> 172.21.15.151:0/357343310 conn(0x562d19b90ae0 msgr2=0x562d19b953e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.092+0000 7f9c7ffff700 0 client.28838 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.092+0000 7f9cba738b80 1 -- 172.21.15.151:0/357343310 shutdown_connections 2023-07-21T22:55:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.092+0000 7f9cba738b80 1 -- 172.21.15.151:0/357343310 wait complete. 2023-07-21T22:55:18.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.093+0000 7f9cba738b80 20 client.28838 trim_cache size 0 max 16384 2023-07-21T22:55:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.122+0000 7f9cba738b80 1 Processor -- start 2023-07-21T22:55:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.122+0000 7f9cba738b80 1 -- start start 2023-07-21T22:55:18.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.123+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19babb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.123+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 0x562d19b9d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.123+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1660 0x562d19b95b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.123+0000 7f9cba738b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19b92c00 con 0x562d19ba1660 2023-07-21T22:55:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.123+0000 7f9cba738b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19b97900 con 0x562d19ba1210 2023-07-21T22:55:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.123+0000 7f9cba738b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19ba0920 con 0x562d199f76b0 2023-07-21T22:55:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.124+0000 7f9ca4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19babb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.124+0000 7f9ca4b9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19babb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45530/0 (socket says 172.21.15.151:45530) 2023-07-21T22:55:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.124+0000 7f9ca4b9b700 1 -- 172.21.15.151:0/2611298830 learned_addr learned my addr 172.21.15.151:0/2611298830 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.124+0000 7f9ca539c700 1 --2- 172.21.15.151:0/2611298830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1660 0x562d19b95b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.125+0000 7f9ca4b9b700 1 -- 172.21.15.151:0/2611298830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 msgr2=0x562d19b9d740 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:55:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.125+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/2611298830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 0x562d19b9d740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.125+0000 7f9ca4b9b700 1 -- 172.21.15.151:0/2611298830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1660 msgr2=0x562d19b95b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.125+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/2611298830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1660 0x562d19b95b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.125+0000 7f9ca4b9b700 1 -- 172.21.15.151:0/2611298830 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562d19ba4440 con 0x562d199f76b0 2023-07-21T22:55:18.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.125+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/2611298830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19babb80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400c010 tx=0x7f9c94005a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=12610eb67a95f8c2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.128+0000 7f9c877fe700 1 -- 172.21.15.151:0/2611298830 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c940b2070 con 0x562d199f76b0 2023-07-21T22:55:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.129+0000 7f9c877fe700 1 -- 172.21.15.151:0/2611298830 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c9409b1d0 con 0x562d199f76b0 2023-07-21T22:55:18.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.129+0000 7f9c877fe700 1 -- 172.21.15.151:0/2611298830 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94017860 con 0x562d199f76b0 2023-07-21T22:55:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.132+0000 7f9cba738b80 1 -- 172.21.15.151:0/2611298830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 msgr2=0x562d19babb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.133+0000 7f9cba738b80 1 --2- 172.21.15.151:0/2611298830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19babb80 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f9c9400c010 tx=0x7f9c94005a90 comp rx=0 tx=0).stop 2023-07-21T22:55:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.133+0000 7f9cba738b80 1 -- 172.21.15.151:0/2611298830 shutdown_connections 2023-07-21T22:55:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.133+0000 7f9cba738b80 1 --2- 172.21.15.151:0/2611298830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1660 0x562d19b95b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.133+0000 7f9cba738b80 1 --2- 172.21.15.151:0/2611298830 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19babb80 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.133+0000 7f9cba738b80 1 --2- 172.21.15.151:0/2611298830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1210 0x562d19b9d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.133+0000 7f9cba738b80 1 -- 172.21.15.151:0/2611298830 >> 172.21.15.151:0/2611298830 conn(0x562d19b90ae0 msgr2=0x562d19bb0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.134+0000 7f9cba738b80 1 -- 172.21.15.151:0/2611298830 shutdown_connections 2023-07-21T22:55:18.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.134+0000 7f9cba738b80 1 -- 172.21.15.151:0/2611298830 wait complete. 2023-07-21T22:55:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.135+0000 7f9cba738b80 1 -- start start 2023-07-21T22:55:18.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.135+0000 7f9cba738b80 1 Processor -- start 2023-07-21T22:55:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.136+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19b9b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.136+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1210 0x562d19b99f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.136+0000 7f9cba738b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1660 0x562d19b9a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.136+0000 7f9cba738b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19b9b710 con 0x562d19ba1210 2023-07-21T22:55:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.136+0000 7f9cba738b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19b9b880 con 0x562d19ba1660 2023-07-21T22:55:18.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.136+0000 7f9cba738b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562d19b9ba40 con 0x562d199f76b0 2023-07-21T22:55:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.136+0000 7f9cba738b80 10 client.0 _ll_register_callbacks cb 0x7f9c90009e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9ca539c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1660 0x562d19b9a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9ca539c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1660 0x562d19b9a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:53300/0 (socket says 172.21.15.151:53300) 2023-07-21T22:55:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9ca539c700 1 -- 172.21.15.151:0/1074656758 learned_addr learned my addr 172.21.15.151:0/1074656758 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19b9b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9c9ffff700 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1210 0x562d19b99f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9ca539c700 1 -- 172.21.15.151:0/1074656758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 msgr2=0x562d19b9b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9ca539c700 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19b9b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9ca539c700 1 -- 172.21.15.151:0/1074656758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1210 msgr2=0x562d19b99f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:18.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9ca539c700 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1210 0x562d19b99f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.137+0000 7f9ca539c700 1 -- 172.21.15.151:0/1074656758 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ca006a610 con 0x562d19ba1660 2023-07-21T22:55:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.139+0000 7f9ca539c700 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1660 0x562d19b9a470 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9c98007b70 tx=0x7f9c98009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b41a6b409487c813 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:18.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.139+0000 7f9c7ffff700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:55:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.139+0000 7f9c7ffff700 1 -- 172.21.15.151:0/1074656758 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c98026040 con 0x562d19ba1660 2023-07-21T22:55:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.139+0000 7f9c7ffff700 1 -- 172.21.15.151:0/1074656758 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9c98013ae0 con 0x562d19ba1660 2023-07-21T22:55:18.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.140+0000 7f9cba738b80 1 -- 172.21.15.151:0/1074656758 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9c9800f040 con 0x562d19ba1660 2023-07-21T22:55:18.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.141+0000 7f9c7ffff700 1 -- 172.21.15.151:0/1074656758 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=105) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9c9800e040 con 0x562d19ba1660 2023-07-21T22:55:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.143+0000 7f9cba738b80 10 client.28841 fetch_fsmap learned FSMap version 105 2023-07-21T22:55:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.143+0000 7f9cba738b80 1 -- 172.21.15.151:0/1074656758 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=105,monmap=4+}) v3 -- 0x562d199411f0 con 0x562d19ba1660 2023-07-21T22:55:18.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.144+0000 7f9c7ffff700 1 -- 172.21.15.151:0/1074656758 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9c9800f040 con 0x562d19ba1660 2023-07-21T22:55:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.144+0000 7f9c7ffff700 1 -- 172.21.15.151:0/1074656758 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 105) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f9c9801fc70 con 0x562d19ba1660 2023-07-21T22:55:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.144+0000 7f9cba738b80 10 client.28841 fetch_fsmap finished waiting for FSMap version 105 2023-07-21T22:55:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.144+0000 7f9cba738b80 10 client.28841 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.144+0000 7f9cba738b80 20 client.28841 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.144+0000 7f9cba738b80 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d19c097b0 0x562d19c0bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:18.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.144+0000 7f9cba738b80 4 client.28841 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:55:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.144+0000 7f9cba738b80 1 -- 172.21.15.151:0/1074656758 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562d19aa7ff0 con 0x562d19c097b0 2023-07-21T22:55:18.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.144+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d19c097b0 0x562d19c0bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.145+0000 7f9c7ffff700 10 client.28841 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:18.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.145+0000 7f9ca4b9b700 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d19c097b0 0x562d19c0bbc0 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2ab8c1fce4e5a3f server_cookie=2a9776a3517e631a in_seq=0 out_seq=0 2023-07-21T22:55:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.167+0000 7f9c7ffff700 1 -- 172.21.15.151:0/1074656758 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562d19aa7ff0 con 0x562d19c097b0 2023-07-21T22:55:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.167+0000 7f9c7ffff700 10 client.28841 handle_command_reply: tid=0 2023-07-21T22:55:18.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.167+0000 7f9cba738b80 1 client.28841 shutdown 2023-07-21T22:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.167+0000 7f9cba738b80 1 -- 172.21.15.151:0/1074656758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1660 msgr2=0x562d19b9a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.167+0000 7f9cba738b80 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1660 0x562d19b9a470 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f9c98007b70 tx=0x7f9c98009920 comp rx=0 tx=0).stop 2023-07-21T22:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.168+0000 7f9cba738b80 1 -- 172.21.15.151:0/1074656758 shutdown_connections 2023-07-21T22:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.168+0000 7f9cba738b80 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562d19c097b0 0x562d19c0bbc0 crc :-1 s=READY pgs=422 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.168+0000 7f9cba738b80 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562d19ba1660 0x562d19b9a470 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.168+0000 7f9cba738b80 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562d199f76b0 0x562d19b9b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.168+0000 7f9cba738b80 1 --2- 172.21.15.151:0/1074656758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562d19ba1210 0x562d19b99f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.168+0000 7f9cba738b80 1 -- 172.21.15.151:0/1074656758 >> 172.21.15.151:0/1074656758 conn(0x562d19b90ae0 msgr2=0x562d19b9f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.168+0000 7f9c7ffff700 0 client.28841 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.168+0000 7f9cba738b80 1 -- 172.21.15.151:0/1074656758 shutdown_connections 2023-07-21T22:55:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.169+0000 7f9cba738b80 1 -- 172.21.15.151:0/1074656758 wait complete. 2023-07-21T22:55:18.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.169+0000 7f9cba738b80 20 client.28841 trim_cache size 0 max 16384 2023-07-21T22:55:18.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:55:18.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:55:18.210 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:55:18.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.170+0000 7f9ca6dff700 1 -- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9c880a1300 msgr2=0x7f9c880a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.170+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9c880a1300 0x7f9c880a37b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f9c98009550 tx=0x7f9c98009da0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.170+0000 7f9ca6dff700 1 -- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca00fea30 msgr2=0x7f9ca0109b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.170+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca00fea30 0x7f9ca0109b40 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9c94000c00 tx=0x7f9c94004730 comp rx=0 tx=0).stop 2023-07-21T22:55:18.212 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.171+0000 7f9ca6dff700 1 -- 172.21.15.151:0/2335059213 shutdown_connections 2023-07-21T22:55:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.171+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9c880a1300 0x7f9c880a37b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.171+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ca0104a30 0x7f9ca010a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.171+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ca00fea30 0x7f9ca0109b40 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.171+0000 7f9ca6dff700 1 --2- 172.21.15.151:0/2335059213 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ca00ff3e0 0x7f9ca0118cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.171+0000 7f9ca6dff700 1 -- 172.21.15.151:0/2335059213 >> 172.21.15.151:0/2335059213 conn(0x7f9ca0074760 msgr2=0x7f9ca0103940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.171+0000 7f9ca6dff700 1 -- 172.21.15.151:0/2335059213 shutdown_connections 2023-07-21T22:55:18.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:18.172+0000 7f9ca6dff700 1 -- 172.21.15.151:0/2335059213 wait complete. 2023-07-21T22:55:19.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 145.0 s, 366.2 tps, lat 272.125 ms stddev 58.342 2023-07-21T22:55:19.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:19 smithi151 ceph-mon[95510]: pgmap v1149: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 11 MiB/s wr, 857 op/s 2023-07-21T22:55:19.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:19 smithi187 ceph-mon[96918]: pgmap v1149: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 11 MiB/s wr, 857 op/s 2023-07-21T22:55:19.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:19 smithi195 ceph-mon[97365]: pgmap v1149: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 11 MiB/s wr, 857 op/s 2023-07-21T22:55:21.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:21 smithi151 ceph-mon[95510]: pgmap v1150: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 11 MiB/s wr, 857 op/s 2023-07-21T22:55:21.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:21 smithi187 ceph-mon[96918]: pgmap v1150: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 11 MiB/s wr, 857 op/s 2023-07-21T22:55:21.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:21 smithi195 ceph-mon[97365]: pgmap v1150: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 11 MiB/s wr, 857 op/s 2023-07-21T22:55:24.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:23 smithi187 ceph-mon[96918]: pgmap v1151: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-07-21T22:55:24.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:23 smithi195 ceph-mon[97365]: pgmap v1151: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-07-21T22:55:24.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:23 smithi151 ceph-mon[95510]: pgmap v1151: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 1.27k op/s 2023-07-21T22:55:24.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 150.0 s, 361.0 tps, lat 276.178 ms stddev 75.314 2023-07-21T22:55:25.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:24 smithi187 ceph-mon[96918]: pgmap v1152: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.9 MiB/s wr, 770 op/s 2023-07-21T22:55:25.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:24 smithi195 ceph-mon[97365]: pgmap v1152: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.9 MiB/s wr, 770 op/s 2023-07-21T22:55:25.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:24 smithi151 ceph-mon[95510]: pgmap v1152: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.9 MiB/s wr, 770 op/s 2023-07-21T22:55:28.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:27 smithi187 ceph-mon[96918]: pgmap v1153: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.9 MiB/s wr, 770 op/s 2023-07-21T22:55:28.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:27 smithi195 ceph-mon[97365]: pgmap v1153: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.9 MiB/s wr, 770 op/s 2023-07-21T22:55:28.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:27 smithi151 ceph-mon[95510]: pgmap v1153: 97 pgs: 97 active+clean; 12 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.9 MiB/s wr, 770 op/s 2023-07-21T22:55:29.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:28 smithi187 ceph-mon[96918]: pgmap v1154: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 14 MiB/s wr, 1.13k op/s 2023-07-21T22:55:29.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:28 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:55:29.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:28 smithi195 ceph-mon[97365]: pgmap v1154: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 14 MiB/s wr, 1.13k op/s 2023-07-21T22:55:29.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:28 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:55:29.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:28 smithi151 ceph-mon[95510]: pgmap v1154: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 14 MiB/s wr, 1.13k op/s 2023-07-21T22:55:29.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:28 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:55:29.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 155.0 s, 354.8 tps, lat 282.668 ms stddev 72.704 2023-07-21T22:55:31.443 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:31 smithi151 ceph-mon[95510]: pgmap v1155: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.5 MiB/s wr, 741 op/s 2023-07-21T22:55:31.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.430+0000 7fd54fbff700 1 -- 172.21.15.151:0/1355197310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548075350 msgr2=0x7fd5481104c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.430+0000 7fd54fbff700 1 --2- 172.21.15.151:0/1355197310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548075350 0x7fd5481104c0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd538009990 tx=0x7fd538009ca0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.432+0000 7fd54fbff700 1 -- 172.21.15.151:0/1355197310 shutdown_connections 2023-07-21T22:55:31.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.432+0000 7fd54fbff700 1 --2- 172.21.15.151:0/1355197310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd548110a00 0x7fd548112de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.432+0000 7fd54fbff700 1 --2- 172.21.15.151:0/1355197310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd548074a40 0x7fd548074e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.432+0000 7fd54fbff700 1 --2- 172.21.15.151:0/1355197310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548075350 0x7fd5481104c0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.432+0000 7fd54fbff700 1 -- 172.21.15.151:0/1355197310 >> 172.21.15.151:0/1355197310 conn(0x7fd5480fd840 msgr2=0x7fd5480ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.433+0000 7fd54fbff700 1 -- 172.21.15.151:0/1355197310 shutdown_connections 2023-07-21T22:55:31.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.433+0000 7fd54fbff700 1 -- 172.21.15.151:0/1355197310 wait complete. 2023-07-21T22:55:31.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.434+0000 7fd54fbff700 1 Processor -- start 2023-07-21T22:55:31.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.434+0000 7fd54fbff700 1 -- start start 2023-07-21T22:55:31.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.435+0000 7fd54fbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd548074a40 0x7fd54819c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.435+0000 7fd54fbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd548075350 0x7fd54819c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.435+0000 7fd54fbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548110a00 0x7fd5481a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.435+0000 7fd54fbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5481a1410 con 0x7fd548075350 2023-07-21T22:55:31.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.435+0000 7fd54fbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5481a1580 con 0x7fd548110a00 2023-07-21T22:55:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.435+0000 7fd54fbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5481a1740 con 0x7fd548074a40 2023-07-21T22:55:31.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54e19c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548110a00 0x7fd5481a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54e19c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548110a00 0x7fd5481a0dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:56218/0 (socket says 172.21.15.151:56218) 2023-07-21T22:55:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54e19c700 1 -- 172.21.15.151:0/558226404 learned_addr learned my addr 172.21.15.151:0/558226404 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54d99b700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd548074a40 0x7fd54819c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54d19a700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd548075350 0x7fd54819c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54e19c700 1 -- 172.21.15.151:0/558226404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd548074a40 msgr2=0x7fd54819c220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54e19c700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd548074a40 0x7fd54819c220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54e19c700 1 -- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd548075350 msgr2=0x7fd54819c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54e19c700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd548075350 0x7fd54819c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54e19c700 1 -- 172.21.15.151:0/558226404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5380095f0 con 0x7fd548110a00 2023-07-21T22:55:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.436+0000 7fd54d99b700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd548074a40 0x7fd54819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:31.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.437+0000 7fd54e19c700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548110a00 0x7fd5481a0dd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd54000b9e0 tx=0x7fd54000bcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.437+0000 7fd53effd700 1 -- 172.21.15.151:0/558226404 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000c930 con 0x7fd548110a00 2023-07-21T22:55:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.437+0000 7fd54fbff700 1 -- 172.21.15.151:0/558226404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5481a1a20 con 0x7fd548110a00 2023-07-21T22:55:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.437+0000 7fd54fbff700 1 -- 172.21.15.151:0/558226404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5481a9260 con 0x7fd548110a00 2023-07-21T22:55:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.438+0000 7fd53effd700 1 -- 172.21.15.151:0/558226404 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd540014440 con 0x7fd548110a00 2023-07-21T22:55:31.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.438+0000 7fd53effd700 1 -- 172.21.15.151:0/558226404 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400125c0 con 0x7fd548110a00 2023-07-21T22:55:31.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.443+0000 7fd53effd700 1 -- 172.21.15.151:0/558226404 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fd54000ca90 con 0x7fd548110a00 2023-07-21T22:55:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.444+0000 7fd5634c2b80 1 Processor -- start 2023-07-21T22:55:31.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.445+0000 7fd5634c2b80 1 -- start start 2023-07-21T22:55:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.445+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 0x55db38ddbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.445+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.445+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc660 0x55db38dd64a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.445+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38cdbc50 con 0x55db38ddc210 2023-07-21T22:55:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.445+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38d2e9e0 con 0x55db38ddc660 2023-07-21T22:55:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.445+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38d27e70 con 0x55db38c326b0 2023-07-21T22:55:31.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.446+0000 7fd53effd700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5340a1400 0x7fd5340a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.447+0000 7fd54d99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.447+0000 7fd54d99b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50402/0 (socket says 172.21.15.151:50402) 2023-07-21T22:55:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.447+0000 7fd54d99b700 1 -- 172.21.15.151:0/1451630945 learned_addr learned my addr 172.21.15.151:0/1451630945 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.447+0000 7fd53effd700 1 -- 172.21.15.151:0/558226404 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd5400cc130 con 0x7fd548110a00 2023-07-21T22:55:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.447+0000 7fd54d99b700 1 -- 172.21.15.151:0/1451630945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 msgr2=0x55db38ddbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.447+0000 7fd54d99b700 1 --2- 172.21.15.151:0/1451630945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 0x55db38ddbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.447+0000 7fd54d99b700 1 -- 172.21.15.151:0/1451630945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc660 msgr2=0x55db38dd64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.447+0000 7fd54d99b700 1 --2- 172.21.15.151:0/1451630945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc660 0x55db38dd64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.447+0000 7fd54d99b700 1 -- 172.21.15.151:0/1451630945 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db38b55d80 con 0x55db38ddc210 2023-07-21T22:55:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.448+0000 7fd54d99b700 1 --2- 172.21.15.151:0/1451630945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd544009de0 tx=0x7fd5440116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718b224f04c8148c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.448+0000 7fd54e19c700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5340a1400 0x7fd5340a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.449+0000 7fd533fff700 1 -- 172.21.15.151:0/1451630945 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544011ed0 con 0x55db38ddc210 2023-07-21T22:55:31.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.449+0000 7fd533fff700 1 -- 172.21.15.151:0/1451630945 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5440128e0 con 0x55db38ddc210 2023-07-21T22:55:31.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.449+0000 7fd533fff700 1 -- 172.21.15.151:0/1451630945 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54400f800 con 0x55db38ddc210 2023-07-21T22:55:31.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.450+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1451630945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc210 msgr2=0x55db38dd5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.450+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/1451630945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fd544009de0 tx=0x7fd5440116c0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.450+0000 7fd54e19c700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5340a1400 0x7fd5340a38b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd5400957d0 tx=0x7fd540004b80 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.450+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1451630945 shutdown_connections 2023-07-21T22:55:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.450+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/1451630945 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc660 0x55db38dd64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.450+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/1451630945 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 0x55db38ddbcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.450+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/1451630945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.450+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1451630945 >> 172.21.15.151:0/1451630945 conn(0x55db38dcbae0 msgr2=0x55db38dd10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.451+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1451630945 shutdown_connections 2023-07-21T22:55:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.451+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1451630945 wait complete. 2023-07-21T22:55:31.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.451+0000 7fd5634c2b80 1 -- start start 2023-07-21T22:55:31.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.452+0000 7fd5634c2b80 1 Processor -- start 2023-07-21T22:55:31.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.453+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 0x55db38de2550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.453+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 0x55db38ddf7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.453+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 0x55db38ddfde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.453+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38cc7a60 con 0x55db38ddc660 2023-07-21T22:55:31.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.453+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38cc7760 con 0x55db38ddc210 2023-07-21T22:55:31.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.453+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38bab8c0 con 0x55db38c326b0 2023-07-21T22:55:31.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.453+0000 7fd5634c2b80 10 client.0 _ll_register_callbacks cb 0x55db38cc5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:31.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.454+0000 7fd54d19a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 0x55db38de2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.454+0000 7fd54d19a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 0x55db38ddfde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.454+0000 7fd54d19a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 0x55db38de2550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54760/0 (socket says 172.21.15.151:54760) 2023-07-21T22:55:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.454+0000 7fd54d19a700 1 -- 172.21.15.151:0/3533796458 learned_addr learned my addr 172.21.15.151:0/3533796458 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.454+0000 7fd54d19a700 1 -- 172.21.15.151:0/3533796458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 msgr2=0x55db38ddf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.454+0000 7fd54d19a700 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 0x55db38ddf7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.454+0000 7fd54d19a700 1 -- 172.21.15.151:0/3533796458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 msgr2=0x55db38ddfde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.454+0000 7fd54d19a700 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 0x55db38ddfde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.454+0000 7fd54d19a700 1 -- 172.21.15.151:0/3533796458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd544009a10 con 0x55db38c326b0 2023-07-21T22:55:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.455+0000 7fd54d19a700 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 0x55db38de2550 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd538000c00 tx=0x7fd53801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=187b7ffec632d77a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.455+0000 7fd5317fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:55:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.455+0000 7fd5317fa700 1 -- 172.21.15.151:0/3533796458 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53800f9d0 con 0x55db38c326b0 2023-07-21T22:55:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.455+0000 7fd5317fa700 1 -- 172.21.15.151:0/3533796458 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd53800fb30 con 0x55db38c326b0 2023-07-21T22:55:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.455+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3533796458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55db38c81490 con 0x55db38c326b0 2023-07-21T22:55:31.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.455+0000 7fd5317fa700 1 -- 172.21.15.151:0/3533796458 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd53800fcf0 con 0x55db38c326b0 2023-07-21T22:55:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.456+0000 7fd5634c2b80 10 client.28870 fetch_fsmap learned FSMap version 106 2023-07-21T22:55:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.456+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3533796458 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x55db38b3ec00 con 0x55db38c326b0 2023-07-21T22:55:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.456+0000 7fd5317fa700 1 -- 172.21.15.151:0/3533796458 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55db38c81490 con 0x55db38c326b0 2023-07-21T22:55:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.456+0000 7fd5317fa700 1 -- 172.21.15.151:0/3533796458 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 106) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd538028430 con 0x55db38c326b0 2023-07-21T22:55:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.457+0000 7fd5634c2b80 10 client.28870 fetch_fsmap finished waiting for FSMap version 106 2023-07-21T22:55:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.457+0000 7fd5634c2b80 10 client.28870 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:31.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.457+0000 7fd5634c2b80 20 client.28870 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.457+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db38e00b50 0x55db38e02f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.457+0000 7fd5634c2b80 4 client.28870 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:55:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.457+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3533796458 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55db38d20e50 con 0x55db38e00b50 2023-07-21T22:55:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.457+0000 7fd54d99b700 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db38e00b50 0x55db38e02f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.458+0000 7fd54d99b700 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db38e00b50 0x55db38e02f60 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=280ca1108a12aca6 server_cookie=8d84780a31ba2d98 in_seq=0 out_seq=0 2023-07-21T22:55:31.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.458+0000 7fd5317fa700 10 client.28870 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.459+0000 7fd5317fa700 1 -- 172.21.15.151:0/3533796458 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55db38d20e50 con 0x55db38e00b50 2023-07-21T22:55:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.459+0000 7fd5317fa700 10 client.28870 handle_command_reply: tid=0 2023-07-21T22:55:31.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.459+0000 7fd5634c2b80 1 client.28870 shutdown 2023-07-21T22:55:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3533796458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 msgr2=0x55db38de2550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 0x55db38de2550 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fd538000c00 tx=0x7fd53801a040 comp rx=0 tx=0).stop 2023-07-21T22:55:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3533796458 shutdown_connections 2023-07-21T22:55:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db38e00b50 0x55db38e02f60 crc :-1 s=READY pgs=423 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 0x55db38ddfde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38c326b0 0x55db38de2550 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3533796458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 0x55db38ddf7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3533796458 >> 172.21.15.151:0/3533796458 conn(0x55db38dcbae0 msgr2=0x55db38dd03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5317fa700 0 client.28870 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3533796458 shutdown_connections 2023-07-21T22:55:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.460+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3533796458 wait complete. 2023-07-21T22:55:31.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.461+0000 7fd5634c2b80 20 client.28870 trim_cache size 0 max 16384 2023-07-21T22:55:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.488+0000 7fd5634c2b80 1 Processor -- start 2023-07-21T22:55:31.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.488+0000 7fd5634c2b80 1 -- start start 2023-07-21T22:55:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38c326b0 0x55db38de6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc660 0x55db38de2080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38dd71b0 con 0x55db38c326b0 2023-07-21T22:55:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38dcdc30 con 0x55db38ddc210 2023-07-21T22:55:31.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38ddddb0 con 0x55db38ddc660 2023-07-21T22:55:31.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd54d99b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd54d19a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38c326b0 0x55db38de6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd54d19a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38c326b0 0x55db38de6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50420/0 (socket says 172.21.15.151:50420) 2023-07-21T22:55:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.489+0000 7fd54d19a700 1 -- 172.21.15.151:0/1899830200 learned_addr learned my addr 172.21.15.151:0/1899830200 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:31.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.490+0000 7fd54d19a700 1 --2- 172.21.15.151:0/1899830200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc660 0x55db38de2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.490+0000 7fd54d19a700 1 -- 172.21.15.151:0/1899830200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc660 msgr2=0x55db38de2080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.490+0000 7fd54d19a700 1 --2- 172.21.15.151:0/1899830200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc660 0x55db38de2080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.490+0000 7fd54d19a700 1 -- 172.21.15.151:0/1899830200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 msgr2=0x55db38dd5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.490+0000 7fd54d19a700 1 --2- 172.21.15.151:0/1899830200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.490+0000 7fd54d19a700 1 -- 172.21.15.151:0/1899830200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55db38b7c1f0 con 0x55db38c326b0 2023-07-21T22:55:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.490+0000 7fd54d99b700 1 --2- 172.21.15.151:0/1899830200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:31.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.491+0000 7fd54d19a700 1 --2- 172.21.15.151:0/1899830200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38c326b0 0x55db38de6c30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd538001eb0 tx=0x7fd538005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39fa65dbe481c45d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.491+0000 7fd53cbff700 1 -- 172.21.15.151:0/1899830200 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538028a60 con 0x55db38c326b0 2023-07-21T22:55:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.491+0000 7fd53cbff700 1 -- 172.21.15.151:0/1899830200 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd53803c070 con 0x55db38c326b0 2023-07-21T22:55:31.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.491+0000 7fd53cbff700 1 -- 172.21.15.151:0/1899830200 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd538016600 con 0x55db38c326b0 2023-07-21T22:55:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.492+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1899830200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38c326b0 msgr2=0x55db38de6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.492+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/1899830200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38c326b0 0x55db38de6c30 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fd538001eb0 tx=0x7fd538005fb0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.492+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1899830200 shutdown_connections 2023-07-21T22:55:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.492+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/1899830200 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc660 0x55db38de2080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.492+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/1899830200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38c326b0 0x55db38de6c30 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.492+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/1899830200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38ddc210 0x55db38dd5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.492+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1899830200 >> 172.21.15.151:0/1899830200 conn(0x55db38dcbae0 msgr2=0x55db38dd99d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.492+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1899830200 shutdown_connections 2023-07-21T22:55:31.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.492+0000 7fd5634c2b80 1 -- 172.21.15.151:0/1899830200 wait complete. 2023-07-21T22:55:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.493+0000 7fd5634c2b80 1 -- start start 2023-07-21T22:55:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.493+0000 7fd5634c2b80 1 Processor -- start 2023-07-21T22:55:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38c326b0 0x55db38de6c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc210 0x55db38dd7730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd5634c2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 0x55db38dd7c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38dd81f0 con 0x55db38ddc660 2023-07-21T22:55:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38dd8330 con 0x55db38c326b0 2023-07-21T22:55:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd5634c2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55db38dd84f0 con 0x55db38ddc210 2023-07-21T22:55:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd5634c2b80 10 client.0 _ll_register_callbacks cb 0x7fd53800bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd54d19a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38c326b0 0x55db38de6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd54d19a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38c326b0 0x55db38de6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:56270/0 (socket says 172.21.15.151:56270) 2023-07-21T22:55:31.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd54d19a700 1 -- 172.21.15.151:0/3883466279 learned_addr learned my addr 172.21.15.151:0/3883466279 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd54d19a700 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 0x55db38dd7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.494+0000 7fd54d99b700 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc210 0x55db38dd7730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.495+0000 7fd54d99b700 1 -- 172.21.15.151:0/3883466279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38c326b0 msgr2=0x55db38de6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.495+0000 7fd54d99b700 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38c326b0 0x55db38de6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.495+0000 7fd54d99b700 1 -- 172.21.15.151:0/3883466279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 msgr2=0x55db38dd7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.495+0000 7fd54d99b700 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 0x55db38dd7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.495+0000 7fd54d99b700 1 -- 172.21.15.151:0/3883466279 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55db38b3ec00 con 0x55db38ddc210 2023-07-21T22:55:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.495+0000 7fd54d19a700 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38c326b0 0x55db38de6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:55:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.495+0000 7fd54d99b700 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc210 0x55db38dd7730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd544011ac0 tx=0x7fd5440098c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c434a4ed27a04d41 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.495+0000 7fd5317fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:55:31.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.496+0000 7fd5317fa700 1 -- 172.21.15.151:0/3883466279 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd544012450 con 0x55db38ddc210 2023-07-21T22:55:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.496+0000 7fd5317fa700 1 -- 172.21.15.151:0/3883466279 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd5440125b0 con 0x55db38ddc210 2023-07-21T22:55:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.496+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3883466279 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd5440128e0 con 0x55db38ddc210 2023-07-21T22:55:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.496+0000 7fd5317fa700 1 -- 172.21.15.151:0/3883466279 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=106) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd544029ae0 con 0x55db38ddc210 2023-07-21T22:55:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.496+0000 7fd5634c2b80 10 client.28876 fetch_fsmap learned FSMap version 106 2023-07-21T22:55:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.496+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3883466279 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=106,monmap=4+}) v3 -- 0x55db38b54250 con 0x55db38ddc210 2023-07-21T22:55:31.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.497+0000 7fd5317fa700 1 -- 172.21.15.151:0/3883466279 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd5440128e0 con 0x55db38ddc210 2023-07-21T22:55:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.497+0000 7fd5317fa700 1 -- 172.21.15.151:0/3883466279 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 106) v1 ==== 7482+0+0 (secure 0 0 0) 0x7fd5440113e0 con 0x55db38ddc210 2023-07-21T22:55:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.497+0000 7fd5634c2b80 10 client.28876 fetch_fsmap finished waiting for FSMap version 106 2023-07-21T22:55:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.497+0000 7fd5634c2b80 10 client.28876 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.497+0000 7fd5634c2b80 20 client.28876 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.497+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db38e55030 0x55db38e57440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:31.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.497+0000 7fd5634c2b80 4 client.28876 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:55:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.497+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3883466279 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55db38ce2ff0 con 0x55db38e55030 2023-07-21T22:55:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.498+0000 7fd54d19a700 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db38e55030 0x55db38e57440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.498+0000 7fd54d19a700 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db38e55030 0x55db38e57440 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b659f09abc3ddb6 server_cookie=287c1f9b38102de in_seq=0 out_seq=0 2023-07-21T22:55:31.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.498+0000 7fd5317fa700 10 client.28876 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.531+0000 7fd5317fa700 1 -- 172.21.15.151:0/3883466279 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55db38ce2ff0 con 0x55db38e55030 2023-07-21T22:55:31.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.531+0000 7fd5317fa700 10 client.28876 handle_command_reply: tid=0 2023-07-21T22:55:31.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.531+0000 7fd5634c2b80 1 client.28876 shutdown 2023-07-21T22:55:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.533+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3883466279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc210 msgr2=0x55db38dd7730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.533+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc210 0x55db38dd7730 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fd544011ac0 tx=0x7fd5440098c0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.533+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3883466279 shutdown_connections 2023-07-21T22:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.533+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55db38e55030 0x55db38e57440 crc :-1 s=READY pgs=424 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.533+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55db38c326b0 0x55db38de6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.533+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55db38ddc660 0x55db38dd7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.533+0000 7fd5634c2b80 1 --2- 172.21.15.151:0/3883466279 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55db38ddc210 0x55db38dd7730 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.533+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3883466279 >> 172.21.15.151:0/3883466279 conn(0x55db38dcbae0 msgr2=0x55db38dd0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.533+0000 7fd5317fa700 0 client.28876 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.534+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3883466279 shutdown_connections 2023-07-21T22:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.534+0000 7fd5634c2b80 1 -- 172.21.15.151:0/3883466279 wait complete. 2023-07-21T22:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.534+0000 7fd5634c2b80 20 client.28876 trim_cache size 0 max 16384 2023-07-21T22:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:55:31.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:55:31.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 -- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5340a1400 msgr2=0x7fd5340a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5340a1400 0x7fd5340a38b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fd5400957d0 tx=0x7fd540004b80 comp rx=0 tx=0).stop 2023-07-21T22:55:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 -- 172.21.15.151:0/558226404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548110a00 msgr2=0x7fd5481a0dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548110a00 0x7fd5481a0dd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fd54000b9e0 tx=0x7fd54000bcf0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 -- 172.21.15.151:0/558226404 shutdown_connections 2023-07-21T22:55:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd5340a1400 0x7fd5340a38b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd548110a00 0x7fd5481a0dd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd548074a40 0x7fd54819c220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 --2- 172.21.15.151:0/558226404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd548075350 0x7fd54819c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.535+0000 7fd54fbff700 1 -- 172.21.15.151:0/558226404 >> 172.21.15.151:0/558226404 conn(0x7fd5480fd840 msgr2=0x7fd5480ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.536+0000 7fd54fbff700 1 -- 172.21.15.151:0/558226404 shutdown_connections 2023-07-21T22:55:31.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:31.536+0000 7fd54fbff700 1 -- 172.21.15.151:0/558226404 wait complete. 2023-07-21T22:55:31.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:31 smithi187 ceph-mon[96918]: pgmap v1155: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.5 MiB/s wr, 741 op/s 2023-07-21T22:55:31.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:31 smithi195 ceph-mon[97365]: pgmap v1155: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.5 MiB/s wr, 741 op/s 2023-07-21T22:55:33.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:32 smithi187 ceph-mon[96918]: pgmap v1156: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 14 MiB/s wr, 1.14k op/s 2023-07-21T22:55:33.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:32 smithi195 ceph-mon[97365]: pgmap v1156: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 14 MiB/s wr, 1.14k op/s 2023-07-21T22:55:33.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:32 smithi151 ceph-mon[95510]: pgmap v1156: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 14 MiB/s wr, 1.14k op/s 2023-07-21T22:55:34.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 160.0 s, 336.8 tps, lat 298.957 ms stddev 108.982 2023-07-21T22:55:35.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:35 smithi151 ceph-mon[95510]: pgmap v1157: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 9.2 MiB/s wr, 763 op/s 2023-07-21T22:55:35.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:35 smithi187 ceph-mon[96918]: pgmap v1157: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 9.2 MiB/s wr, 763 op/s 2023-07-21T22:55:35.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:35 smithi195 ceph-mon[97365]: pgmap v1157: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 9.2 MiB/s wr, 763 op/s 2023-07-21T22:55:38.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:37 smithi187 ceph-mon[96918]: pgmap v1158: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 9.2 MiB/s wr, 762 op/s 2023-07-21T22:55:38.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:37 smithi195 ceph-mon[97365]: pgmap v1158: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 9.2 MiB/s wr, 762 op/s 2023-07-21T22:55:38.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:37 smithi151 ceph-mon[95510]: pgmap v1158: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 9.2 MiB/s wr, 762 op/s 2023-07-21T22:55:39.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:38 smithi187 ceph-mon[96918]: pgmap v1159: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-21T22:55:39.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:38 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:55:39.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:38 smithi195 ceph-mon[97365]: pgmap v1159: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-21T22:55:39.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:38 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:55:39.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:38 smithi151 ceph-mon[95510]: pgmap v1159: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 14 MiB/s wr, 1.17k op/s 2023-07-21T22:55:39.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:38 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:55:39.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 165.0 s, 389.4 tps, lat 256.193 ms stddev 60.203 2023-07-21T22:55:41.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:41 smithi151 ceph-mon[95510]: pgmap v1160: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 9.8 MiB/s wr, 803 op/s 2023-07-21T22:55:41.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:41 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:55:41.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:41 smithi187 ceph-mon[96918]: pgmap v1160: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 9.8 MiB/s wr, 803 op/s 2023-07-21T22:55:41.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:41 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:55:41.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:41 smithi195 ceph-mon[97365]: pgmap v1160: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 992 KiB/s rd, 9.8 MiB/s wr, 803 op/s 2023-07-21T22:55:41.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:41 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:55:42.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:42 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:55:42.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:42 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:55:42.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:42 smithi151 ceph-mon[95510]: pgmap v1161: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 MiB/s wr, 832 op/s 2023-07-21T22:55:42.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:42 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:55:42.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:42 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:55:42.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:42 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:55:42.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:42 smithi187 ceph-mon[96918]: pgmap v1161: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 MiB/s wr, 832 op/s 2023-07-21T22:55:42.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:42 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:55:42.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:42 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:55:42.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:42 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:55:42.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:42 smithi195 ceph-mon[97365]: pgmap v1161: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 MiB/s wr, 832 op/s 2023-07-21T22:55:42.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:42 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:55:43.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:43 smithi151 ceph-mon[95510]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2023-07-21T22:55:43.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:43 smithi187 ceph-mon[96918]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2023-07-21T22:55:43.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:43 smithi195 ceph-mon[97365]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2023-07-21T22:55:44.302 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 170.0 s, 364.9 tps, lat 265.763 ms stddev 63.711 2023-07-21T22:55:44.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:44 smithi187 ceph-mon[96918]: pgmap v1162: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 MiB/s wr, 813 op/s 2023-07-21T22:55:44.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:44 smithi195 ceph-mon[97365]: pgmap v1162: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 MiB/s wr, 813 op/s 2023-07-21T22:55:44.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:44 smithi151 ceph-mon[95510]: pgmap v1162: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 MiB/s wr, 813 op/s 2023-07-21T22:55:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.773+0000 7f5fc27ff700 1 -- 172.21.15.151:0/3886684693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fbc1024f0 msgr2=0x7f5fbc102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.773+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/3886684693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fbc1024f0 0x7f5fbc102940 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0098f0 tx=0x7f5fac009c00 comp rx=0 tx=0).stop 2023-07-21T22:55:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.773+0000 7f5fc27ff700 1 -- 172.21.15.151:0/3886684693 shutdown_connections 2023-07-21T22:55:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.773+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/3886684693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fbc1024f0 0x7f5fbc102940 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.773+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/3886684693 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc104a60 0x7f5fbc0679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.773+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/3886684693 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc067ee0 0x7f5fbc068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.773+0000 7f5fc27ff700 1 -- 172.21.15.151:0/3886684693 >> 172.21.15.151:0/3886684693 conn(0x7f5fbc074760 msgr2=0x7f5fbc074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.773+0000 7f5fc27ff700 1 -- 172.21.15.151:0/3886684693 shutdown_connections 2023-07-21T22:55:44.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.774+0000 7f5fc27ff700 1 -- 172.21.15.151:0/3886684693 wait complete. 2023-07-21T22:55:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.776+0000 7f5fc27ff700 1 Processor -- start 2023-07-21T22:55:44.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.776+0000 7f5fc27ff700 1 -- start start 2023-07-21T22:55:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.777+0000 7f5fc27ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc067ee0 0x7f5fbc19c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.777+0000 7f5fc27ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc1024f0 0x7f5fbc19c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.777+0000 7f5fc27ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fbc104a60 0x7f5fbc1a0c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.777+0000 7f5fc27ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc1a12c0 con 0x7f5fbc104a60 2023-07-21T22:55:44.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.777+0000 7f5fc27ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc1a1430 con 0x7f5fbc1024f0 2023-07-21T22:55:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.777+0000 7f5fc27ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fbc1a15f0 con 0x7f5fbc067ee0 2023-07-21T22:55:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fbb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc1024f0 0x7f5fbc19c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fbb7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc1024f0 0x7f5fbc19c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:33162/0 (socket says 172.21.15.151:33162) 2023-07-21T22:55:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fbb7fe700 1 -- 172.21.15.151:0/935296891 learned_addr learned my addr 172.21.15.151:0/935296891 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc067ee0 0x7f5fbc19c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fc0d9c700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fbc104a60 0x7f5fbc1a0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fbb7fe700 1 -- 172.21.15.151:0/935296891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc067ee0 msgr2=0x7f5fbc19c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc067ee0 0x7f5fbc19c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fbb7fe700 1 -- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fbc104a60 msgr2=0x7f5fbc1a0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fbc104a60 0x7f5fbc1a0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.778+0000 7f5fbb7fe700 1 -- 172.21.15.151:0/935296891 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac009520 con 0x7f5fbc1024f0 2023-07-21T22:55:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.779+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc067ee0 0x7f5fbc19c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.779+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc1024f0 0x7f5fbc19c610 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4007fa0 tx=0x7f5fb400d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.780+0000 7f5fb97fa700 1 -- 172.21.15.151:0/935296891 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb400dda0 con 0x7f5fbc1024f0 2023-07-21T22:55:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.780+0000 7f5fb97fa700 1 -- 172.21.15.151:0/935296891 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fb400f040 con 0x7f5fbc1024f0 2023-07-21T22:55:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.780+0000 7f5fb97fa700 1 -- 172.21.15.151:0/935296891 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4014600 con 0x7f5fbc1024f0 2023-07-21T22:55:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.780+0000 7f5fc27ff700 1 -- 172.21.15.151:0/935296891 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fbc1a18d0 con 0x7f5fbc1024f0 2023-07-21T22:55:44.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.780+0000 7f5fc27ff700 1 -- 172.21.15.151:0/935296891 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fbc1a9110 con 0x7f5fbc1024f0 2023-07-21T22:55:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.786+0000 7f5fb97fa700 1 -- 172.21.15.151:0/935296891 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5fb4014760 con 0x7f5fbc1024f0 2023-07-21T22:55:44.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.787+0000 7f5fd6098b80 1 Processor -- start 2023-07-21T22:55:44.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.788+0000 7f5fd6098b80 1 -- start start 2023-07-21T22:55:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.789+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639ded3a6b0 0x5639deee3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.789+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeddf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.789+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deede4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.789+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dede3c50 con 0x5639ded3a6b0 2023-07-21T22:55:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.789+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dee369e0 con 0x5639deee4660 2023-07-21T22:55:44.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.789+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dee2fe70 con 0x5639deee4210 2023-07-21T22:55:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.790+0000 7f5fbbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeddf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.790+0000 7f5fbbfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeddf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47698/0 (socket says 172.21.15.151:47698) 2023-07-21T22:55:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.790+0000 7f5fbbfff700 1 -- 172.21.15.151:0/3289502973 learned_addr learned my addr 172.21.15.151:0/3289502973 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.790+0000 7f5fb97fa700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fa40a1410 0x7f5fa40a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.790+0000 7f5fb97fa700 1 -- 172.21.15.151:0/935296891 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5fb40cc1b0 con 0x7f5fbc1024f0 2023-07-21T22:55:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.791+0000 7f5fbbfff700 1 -- 172.21.15.151:0/3289502973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 msgr2=0x5639deede4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.791+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/3289502973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deede4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.791+0000 7f5fbbfff700 1 -- 172.21.15.151:0/3289502973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639ded3a6b0 msgr2=0x5639deee3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.791+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/3289502973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639ded3a6b0 0x5639deee3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.791+0000 7f5fbbfff700 1 -- 172.21.15.151:0/3289502973 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639dec5dd80 con 0x5639deee4210 2023-07-21T22:55:44.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.791+0000 7f5fc0d9c700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fa40a1410 0x7f5fa40a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.791+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/3289502973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeddf40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009de0 tx=0x7f5fb00116c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d704c9101a48bbab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.792+0000 7f5fa27fc700 1 -- 172.21.15.151:0/3289502973 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0011ed0 con 0x5639deee4210 2023-07-21T22:55:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.792+0000 7f5fa27fc700 1 -- 172.21.15.151:0/3289502973 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fb00128e0 con 0x5639deee4210 2023-07-21T22:55:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.792+0000 7f5fa27fc700 1 -- 172.21.15.151:0/3289502973 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb000f8a0 con 0x5639deee4210 2023-07-21T22:55:44.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3289502973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 msgr2=0x5639deeddf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fc0d9c700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fa40a1410 0x7f5fa40a38c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c010 tx=0x7f5fac019040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/3289502973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeddf40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009de0 tx=0x7f5fb00116c0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3289502973 shutdown_connections 2023-07-21T22:55:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/3289502973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deede4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/3289502973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639ded3a6b0 0x5639deee3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/3289502973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeddf40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3289502973 >> 172.21.15.151:0/3289502973 conn(0x5639deed3ae0 msgr2=0x5639deed90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3289502973 shutdown_connections 2023-07-21T22:55:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.793+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3289502973 wait complete. 2023-07-21T22:55:44.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.794+0000 7f5fd6098b80 1 -- start start 2023-07-21T22:55:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.794+0000 7f5fd6098b80 1 Processor -- start 2023-07-21T22:55:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.795+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639ded3a6b0 0x5639deee78e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.795+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deee7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.795+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deee8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.795+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dedcfa60 con 0x5639ded3a6b0 2023-07-21T22:55:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.795+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639dedcf760 con 0x5639deee4660 2023-07-21T22:55:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.795+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639decb38c0 con 0x5639deee4210 2023-07-21T22:55:44.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.795+0000 7f5fd6098b80 10 client.0 _ll_register_callbacks cb 0x5639dedcd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.796+0000 7f5fbb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deee7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.796+0000 7f5fc0d9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deee8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.796+0000 7f5fbb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deee7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47712/0 (socket says 172.21.15.151:47712) 2023-07-21T22:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.796+0000 7f5fbb7fe700 1 -- 172.21.15.151:0/2269149557 learned_addr learned my addr 172.21.15.151:0/2269149557 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.796+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639ded3a6b0 0x5639deee78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.797+0000 7f5fbb7fe700 1 -- 172.21.15.151:0/2269149557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 msgr2=0x5639deee8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.797+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deee8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.797+0000 7f5fbb7fe700 1 -- 172.21.15.151:0/2269149557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639ded3a6b0 msgr2=0x5639deee78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.797+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639ded3a6b0 0x5639deee78e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.797+0000 7f5fbb7fe700 1 -- 172.21.15.151:0/2269149557 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb0009a10 con 0x5639deee4210 2023-07-21T22:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.797+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deee7e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40c9980 tx=0x7f5fb4099320 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e768b843fa93cf29 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.797+0000 7f5f9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.798+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2269149557 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb4098790 con 0x5639deee4210 2023-07-21T22:55:44.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.798+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2269149557 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5fb40988f0 con 0x5639deee4210 2023-07-21T22:55:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.798+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2269149557 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5639ded89490 con 0x5639deee4210 2023-07-21T22:55:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.798+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2269149557 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fb40a1260 con 0x5639deee4210 2023-07-21T22:55:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.798+0000 7f5fd6098b80 10 client.28888 fetch_fsmap learned FSMap version 107 2023-07-21T22:55:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.798+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2269149557 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) v3 -- 0x5639dec46c00 con 0x5639deee4210 2023-07-21T22:55:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.798+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2269149557 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5639ded89490 con 0x5639deee4210 2023-07-21T22:55:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.799+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2269149557 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 107) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5fb4098200 con 0x5639deee4210 2023-07-21T22:55:44.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.799+0000 7f5fd6098b80 10 client.28888 fetch_fsmap finished waiting for FSMap version 107 2023-07-21T22:55:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.799+0000 7f5fd6098b80 10 client.28888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.799+0000 7f5fd6098b80 20 client.28888 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.799+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5639deef7bc0 0x5639deef9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.799+0000 7f5fd6098b80 4 client.28888 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:55:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.799+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2269149557 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5639dee28e50 con 0x5639deef7bc0 2023-07-21T22:55:44.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.799+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5639deef7bc0 0x5639deef9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.800+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5639deef7bc0 0x5639deef9fd0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3aa3b0ceb6cbc849 server_cookie=c706d7e10875e6ae in_seq=0 out_seq=0 2023-07-21T22:55:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.800+0000 7f5f9b7fe700 10 client.28888 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.802+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2269149557 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5639dee28e50 con 0x5639deef7bc0 2023-07-21T22:55:44.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.802+0000 7f5f9b7fe700 10 client.28888 handle_command_reply: tid=0 2023-07-21T22:55:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.802+0000 7f5fd6098b80 1 client.28888 shutdown 2023-07-21T22:55:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.802+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2269149557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 msgr2=0x5639deee7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.802+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deee7e20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f5fb40c9980 tx=0x7f5fb4099320 comp rx=0 tx=0).stop 2023-07-21T22:55:44.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.803+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2269149557 shutdown_connections 2023-07-21T22:55:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.803+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5639deef7bc0 0x5639deef9fd0 crc :-1 s=READY pgs=425 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.803+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deee8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.803+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639ded3a6b0 0x5639deee78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.803+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2269149557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deee7e20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.803+0000 7f5f9b7fe700 0 client.28888 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.803+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2269149557 >> 172.21.15.151:0/2269149557 conn(0x5639deed3ae0 msgr2=0x5639deed83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.803+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2269149557 shutdown_connections 2023-07-21T22:55:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.803+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2269149557 wait complete. 2023-07-21T22:55:44.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.804+0000 7f5fd6098b80 20 client.28888 trim_cache size 0 max 16384 2023-07-21T22:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.826+0000 7f5fd6098b80 1 Processor -- start 2023-07-21T22:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.826+0000 7f5fd6098b80 1 -- start start 2023-07-21T22:55:44.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.826+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639ded3a6b0 0x5639deee31c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.826+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4210 0x5639deeeec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.827+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deee6e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.827+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639deee3900 con 0x5639deee4210 2023-07-21T22:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.827+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639deed54f0 con 0x5639deee4660 2023-07-21T22:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.827+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639deedef80 con 0x5639ded3a6b0 2023-07-21T22:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.827+0000 7f5fbb7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4210 0x5639deeeec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.827+0000 7f5fc0d9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deee6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.827+0000 7f5fc0d9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deee6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:33194/0 (socket says 172.21.15.151:33194) 2023-07-21T22:55:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.827+0000 7f5fc0d9c700 1 -- 172.21.15.151:0/3467093609 learned_addr learned my addr 172.21.15.151:0/3467093609 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:44.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.827+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/3467093609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639ded3a6b0 0x5639deee31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.828+0000 7f5fbbfff700 1 -- 172.21.15.151:0/3467093609 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 msgr2=0x5639deee6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.828+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/3467093609 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deee6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.828+0000 7f5fbbfff700 1 -- 172.21.15.151:0/3467093609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4210 msgr2=0x5639deeeec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.828+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/3467093609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4210 0x5639deeeec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.828+0000 7f5fbbfff700 1 -- 172.21.15.151:0/3467093609 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5639dec841f0 con 0x5639ded3a6b0 2023-07-21T22:55:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.828+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/3467093609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4210 0x5639deeeec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:44.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.828+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/3467093609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639ded3a6b0 0x5639deee31c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009db0 tx=0x7f5fb0009960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=262a3513215cbaf0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.828+0000 7f5fa2ffd700 1 -- 172.21.15.151:0/3467093609 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0009260 con 0x5639ded3a6b0 2023-07-21T22:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.829+0000 7f5fa2ffd700 1 -- 172.21.15.151:0/3467093609 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fb0012690 con 0x5639ded3a6b0 2023-07-21T22:55:44.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.829+0000 7f5fa2ffd700 1 -- 172.21.15.151:0/3467093609 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0029440 con 0x5639ded3a6b0 2023-07-21T22:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.830+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3467093609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639ded3a6b0 msgr2=0x5639deee31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.830+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/3467093609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639ded3a6b0 0x5639deee31c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009db0 tx=0x7f5fb0009960 comp rx=0 tx=0).stop 2023-07-21T22:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.830+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3467093609 shutdown_connections 2023-07-21T22:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.830+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/3467093609 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639deee4660 0x5639deee6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.830+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/3467093609 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639ded3a6b0 0x5639deee31c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.830+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/3467093609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4210 0x5639deeeec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.830+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3467093609 >> 172.21.15.151:0/3467093609 conn(0x5639deed3ae0 msgr2=0x5639deedcf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.830+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3467093609 shutdown_connections 2023-07-21T22:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.830+0000 7f5fd6098b80 1 -- 172.21.15.151:0/3467093609 wait complete. 2023-07-21T22:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.831+0000 7f5fd6098b80 1 -- start start 2023-07-21T22:55:44.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.831+0000 7f5fd6098b80 1 Processor -- start 2023-07-21T22:55:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.832+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639ded3a6b0 0x5639deeee880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.832+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeeac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.832+0000 7f5fd6098b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4660 0x5639deeeb150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.832+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639deeeb700 con 0x5639deee4660 2023-07-21T22:55:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.832+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639deeeb870 con 0x5639ded3a6b0 2023-07-21T22:55:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.832+0000 7f5fd6098b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5639deeeba30 con 0x5639deee4210 2023-07-21T22:55:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.832+0000 7f5fd6098b80 10 client.0 _ll_register_callbacks cb 0x7f5fb4098eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.833+0000 7f5fbbfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639ded3a6b0 0x5639deeee880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.833+0000 7f5fbbfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639ded3a6b0 0x5639deeee880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:33198/0 (socket says 172.21.15.151:33198) 2023-07-21T22:55:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.833+0000 7f5fbbfff700 1 -- 172.21.15.151:0/2548949149 learned_addr learned my addr 172.21.15.151:0/2548949149 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.833+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeeac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.833+0000 7f5fbbfff700 1 -- 172.21.15.151:0/2548949149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 msgr2=0x5639deeeac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.833+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeeac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.833+0000 7f5fbbfff700 1 -- 172.21.15.151:0/2548949149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4660 msgr2=0x5639deeeb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.833+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4660 0x5639deeeb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.833+0000 7f5fbbfff700 1 -- 172.21.15.151:0/2548949149 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5639dec5dd80 con 0x5639ded3a6b0 2023-07-21T22:55:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.834+0000 7f5fbbfff700 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639ded3a6b0 0x5639deeee880 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009d00 tx=0x7f5fb0005880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8ffc66cdc7bed76 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.834+0000 7f5f9b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:55:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.835+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2548949149 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0012a50 con 0x5639ded3a6b0 2023-07-21T22:55:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.835+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2548949149 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5fb0012bb0 con 0x5639ded3a6b0 2023-07-21T22:55:44.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.835+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2548949149 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5fb00128e0 con 0x5639ded3a6b0 2023-07-21T22:55:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.835+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2548949149 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5fb0012d70 con 0x5639ded3a6b0 2023-07-21T22:55:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.835+0000 7f5fd6098b80 10 client.28868 fetch_fsmap learned FSMap version 107 2023-07-21T22:55:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.835+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2548949149 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) v3 -- 0x5639dec5c250 con 0x5639ded3a6b0 2023-07-21T22:55:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.836+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2548949149 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5fb0041020 con 0x5639ded3a6b0 2023-07-21T22:55:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.836+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2548949149 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 107) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5fb003b070 con 0x5639ded3a6b0 2023-07-21T22:55:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.836+0000 7f5fd6098b80 10 client.28868 fetch_fsmap finished waiting for FSMap version 107 2023-07-21T22:55:44.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.836+0000 7f5fd6098b80 10 client.28868 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.836+0000 7f5fd6098b80 20 client.28868 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.836+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5639def4cb50 0x5639def4ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.836+0000 7f5fd6098b80 4 client.28868 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:55:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.836+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2548949149 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5639dedeaff0 con 0x5639def4cb50 2023-07-21T22:55:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.836+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5639def4cb50 0x5639def4ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:44.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.837+0000 7f5fbb7fe700 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5639def4cb50 0x5639def4ef30 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7efab2b6fded1864 server_cookie=b9a8446945a88ea0 in_seq=0 out_seq=0 2023-07-21T22:55:44.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.837+0000 7f5f9b7fe700 10 client.28868 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5f9b7fe700 1 -- 172.21.15.151:0/2548949149 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5639dedeaff0 con 0x5639def4cb50 2023-07-21T22:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5f9b7fe700 10 client.28868 handle_command_reply: tid=0 2023-07-21T22:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 client.28868 shutdown 2023-07-21T22:55:44.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2548949149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639ded3a6b0 msgr2=0x5639deeee880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639ded3a6b0 0x5639deeee880 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0009d00 tx=0x7f5fb0005880 comp rx=0 tx=0).stop 2023-07-21T22:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2548949149 shutdown_connections 2023-07-21T22:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5639def4cb50 0x5639def4ef30 crc :-1 s=READY pgs=426 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5639ded3a6b0 0x5639deeee880 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5639deee4660 0x5639deeeb150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5f9b7fe700 0 client.28868 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:44.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 --2- 172.21.15.151:0/2548949149 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5639deee4210 0x5639deeeac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2548949149 >> 172.21.15.151:0/2548949149 conn(0x5639deed3ae0 msgr2=0x5639deedd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.873+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2548949149 shutdown_connections 2023-07-21T22:55:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.874+0000 7f5fd6098b80 1 -- 172.21.15.151:0/2548949149 wait complete. 2023-07-21T22:55:44.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.874+0000 7f5fd6098b80 20 client.28868 trim_cache size 0 max 16384 2023-07-21T22:55:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:55:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:55:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:55:44.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:55:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 -- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fa40a1410 msgr2=0x7f5fa40a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fa40a1410 0x7f5fa40a38c0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f5fac00c010 tx=0x7f5fac019040 comp rx=0 tx=0).stop 2023-07-21T22:55:44.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 -- 172.21.15.151:0/935296891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc1024f0 msgr2=0x7f5fbc19c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc1024f0 0x7f5fbc19c610 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4007fa0 tx=0x7f5fb400d3b0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 -- 172.21.15.151:0/935296891 shutdown_connections 2023-07-21T22:55:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5fa40a1410 0x7f5fa40a38c0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fbc104a60 0x7f5fbc1a0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5fbc067ee0 0x7f5fbc19c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 --2- 172.21.15.151:0/935296891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5fbc1024f0 0x7f5fbc19c610 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 -- 172.21.15.151:0/935296891 >> 172.21.15.151:0/935296891 conn(0x7f5fbc074760 msgr2=0x7f5fbc1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:44.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 -- 172.21.15.151:0/935296891 shutdown_connections 2023-07-21T22:55:44.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:44.875+0000 7f5fc27ff700 1 -- 172.21.15.151:0/935296891 wait complete. 2023-07-21T22:55:47.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:46 smithi187 ceph-mon[96918]: pgmap v1163: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 MiB/s wr, 813 op/s 2023-07-21T22:55:47.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:46 smithi195 ceph-mon[97365]: pgmap v1163: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 MiB/s wr, 813 op/s 2023-07-21T22:55:47.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:46 smithi151 ceph-mon[95510]: pgmap v1163: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 10 MiB/s wr, 813 op/s 2023-07-21T22:55:48.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:47 smithi195 ceph-mon[97365]: pgmap v1164: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 1.25k op/s 2023-07-21T22:55:48.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:47 smithi151 ceph-mon[95510]: pgmap v1164: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 1.25k op/s 2023-07-21T22:55:48.370 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:47 smithi187 ceph-mon[96918]: pgmap v1164: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 16 MiB/s wr, 1.25k op/s 2023-07-21T22:55:49.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 175.0 s, 401.6 tps, lat 256.427 ms stddev 115.665 2023-07-21T22:55:51.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:50 smithi187 ceph-mon[96918]: pgmap v1165: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 10 MiB/s wr, 832 op/s 2023-07-21T22:55:51.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:50 smithi195 ceph-mon[97365]: pgmap v1165: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 10 MiB/s wr, 832 op/s 2023-07-21T22:55:51.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:50 smithi151 ceph-mon[95510]: pgmap v1165: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 10 MiB/s wr, 832 op/s 2023-07-21T22:55:53.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:52 smithi187 ceph-mon[96918]: pgmap v1166: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 10 MiB/s wr, 833 op/s 2023-07-21T22:55:53.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:52 smithi195 ceph-mon[97365]: pgmap v1166: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 10 MiB/s wr, 833 op/s 2023-07-21T22:55:53.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:52 smithi151 ceph-mon[95510]: pgmap v1166: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 10 MiB/s wr, 833 op/s 2023-07-21T22:55:54.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:53 smithi195 ceph-mon[97365]: pgmap v1167: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-07-21T22:55:54.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:53 smithi151 ceph-mon[95510]: pgmap v1167: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-07-21T22:55:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 180.0 s, 183.8 tps, lat 546.869 ms stddev 731.417 2023-07-21T22:55:54.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:53 smithi187 ceph-mon[96918]: pgmap v1167: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-07-21T22:55:57.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:56 smithi187 ceph-mon[96918]: pgmap v1168: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.6 MiB/s wr, 816 op/s 2023-07-21T22:55:57.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:56 smithi151 ceph-mon[95510]: pgmap v1168: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.6 MiB/s wr, 816 op/s 2023-07-21T22:55:57.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:56 smithi195 ceph-mon[97365]: pgmap v1168: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.6 MiB/s wr, 816 op/s 2023-07-21T22:55:58.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.120+0000 7eff5c9ff700 1 -- 172.21.15.151:0/1088934707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff58104e50 msgr2=0x7eff5810ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.120+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/1088934707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff58104e50 0x7eff5810ca00 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7eff50009990 tx=0x7eff50009ca0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.121+0000 7eff5c9ff700 1 -- 172.21.15.151:0/1088934707 shutdown_connections 2023-07-21T22:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.121+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/1088934707 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff58067c10 0x7eff58067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.121+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/1088934707 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff58104e50 0x7eff5810ca00 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.121+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/1088934707 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff580685b0 0x7eff58104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.157 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.121+0000 7eff5c9ff700 1 -- 172.21.15.151:0/1088934707 >> 172.21.15.151:0/1088934707 conn(0x7eff58074760 msgr2=0x7eff58074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.126+0000 7eff5c9ff700 1 -- 172.21.15.151:0/1088934707 shutdown_connections 2023-07-21T22:55:58.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.129+0000 7eff5c9ff700 1 -- 172.21.15.151:0/1088934707 wait complete. 2023-07-21T22:55:58.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.131+0000 7eff5c9ff700 1 Processor -- start 2023-07-21T22:55:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.131+0000 7eff5c9ff700 1 -- start start 2023-07-21T22:55:58.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.131+0000 7eff5c9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff58067c10 0x7eff5810a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.131+0000 7eff5c9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580685b0 0x7eff58072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.132+0000 7eff4dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580685b0 0x7eff58072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.132+0000 7eff4dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580685b0 0x7eff58072140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51826/0 (socket says 172.21.15.151:51826) 2023-07-21T22:55:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.132+0000 7eff5c9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff58104e50 0x7eff5810a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.132+0000 7eff5c9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5806d120 con 0x7eff58067c10 2023-07-21T22:55:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.132+0000 7eff5c9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5806d290 con 0x7eff58104e50 2023-07-21T22:55:58.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.132+0000 7eff5c9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5806d400 con 0x7eff580685b0 2023-07-21T22:55:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.132+0000 7eff4dd9b700 1 -- 172.21.15.151:0/3480810002 learned_addr learned my addr 172.21.15.151:0/3480810002 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff56d9d700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff58104e50 0x7eff5810a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff4dd9b700 1 -- 172.21.15.151:0/3480810002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff58104e50 msgr2=0x7eff5810a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff58104e50 0x7eff5810a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff4dd9b700 1 -- 172.21.15.151:0/3480810002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff58067c10 msgr2=0x7eff5810a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff58067c10 0x7eff5810a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff4dd9b700 1 -- 172.21.15.151:0/3480810002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff500095f0 con 0x7eff580685b0 2023-07-21T22:55:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580685b0 0x7eff58072140 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7eff4000d950 tx=0x7eff4000dd10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff4ffff700 1 -- 172.21.15.151:0/3480810002 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4000bb60 con 0x7eff580685b0 2023-07-21T22:55:58.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff4ffff700 1 -- 172.21.15.151:0/3480810002 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff4000de30 con 0x7eff580685b0 2023-07-21T22:55:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff4ffff700 1 -- 172.21.15.151:0/3480810002 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40005460 con 0x7eff580685b0 2023-07-21T22:55:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.133+0000 7eff5c9ff700 1 -- 172.21.15.151:0/3480810002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5806d6e0 con 0x7eff580685b0 2023-07-21T22:55:58.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.134+0000 7eff5c9ff700 1 -- 172.21.15.151:0/3480810002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5806dbf0 con 0x7eff580685b0 2023-07-21T22:55:58.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.140+0000 7eff70299b80 1 Processor -- start 2023-07-21T22:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.140+0000 7eff70299b80 1 -- start start 2023-07-21T22:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff70299b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e89cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff70299b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a210 0x5597d8e83f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff70299b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a660 0x5597d8e844a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff70299b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8d89c50 con 0x5597d8e8a660 2023-07-21T22:55:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff70299b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8ddc9e0 con 0x5597d8ce06b0 2023-07-21T22:55:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff70299b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8dd5e70 con 0x5597d8e8a210 2023-07-21T22:55:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff56d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e89cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff56d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e89cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51092/0 (socket says 172.21.15.151:51092) 2023-07-21T22:55:58.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff56d9d700 1 -- 172.21.15.151:0/2121708403 learned_addr learned my addr 172.21.15.151:0/2121708403 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.141+0000 7eff5659c700 1 --2- 172.21.15.151:0/2121708403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a210 0x5597d8e83f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.142+0000 7eff56d9d700 1 -- 172.21.15.151:0/2121708403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a210 msgr2=0x5597d8e83f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.142+0000 7eff56d9d700 1 --2- 172.21.15.151:0/2121708403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a210 0x5597d8e83f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.142+0000 7eff56d9d700 1 -- 172.21.15.151:0/2121708403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a660 msgr2=0x5597d8e844a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:55:58.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.142+0000 7eff56d9d700 1 --2- 172.21.15.151:0/2121708403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a660 0x5597d8e844a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.142+0000 7eff56d9d700 1 -- 172.21.15.151:0/2121708403 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597d8c03d80 con 0x5597d8ce06b0 2023-07-21T22:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.142+0000 7eff56d9d700 1 --2- 172.21.15.151:0/2121708403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e89cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7eff50005a90 tx=0x7eff50005ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e45ebe627ed953f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.142+0000 7eff4ffff700 1 -- 172.21.15.151:0/3480810002 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7eff400055c0 con 0x7eff580685b0 2023-07-21T22:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.142+0000 7eff4cd99700 1 -- 172.21.15.151:0/2121708403 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50009ee0 con 0x5597d8ce06b0 2023-07-21T22:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.143+0000 7eff4cd99700 1 -- 172.21.15.151:0/2121708403 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff5001e040 con 0x5597d8ce06b0 2023-07-21T22:55:58.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.143+0000 7eff4cd99700 1 -- 172.21.15.151:0/2121708403 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50004760 con 0x5597d8ce06b0 2023-07-21T22:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.143+0000 7eff70299b80 1 -- 172.21.15.151:0/2121708403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 msgr2=0x5597d8e89cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.143+0000 7eff70299b80 1 --2- 172.21.15.151:0/2121708403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e89cd0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7eff50005a90 tx=0x7eff50005ac0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.144+0000 7eff70299b80 1 -- 172.21.15.151:0/2121708403 shutdown_connections 2023-07-21T22:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.144+0000 7eff70299b80 1 --2- 172.21.15.151:0/2121708403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e89cd0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.144+0000 7eff70299b80 1 --2- 172.21.15.151:0/2121708403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a660 0x5597d8e844a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.144+0000 7eff70299b80 1 --2- 172.21.15.151:0/2121708403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a210 0x5597d8e83f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.144+0000 7eff70299b80 1 -- 172.21.15.151:0/2121708403 >> 172.21.15.151:0/2121708403 conn(0x5597d8e79ae0 msgr2=0x5597d8e7f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.144+0000 7eff70299b80 1 -- 172.21.15.151:0/2121708403 shutdown_connections 2023-07-21T22:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.144+0000 7eff70299b80 1 -- 172.21.15.151:0/2121708403 wait complete. 2023-07-21T22:55:58.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.145+0000 7eff70299b80 1 -- start start 2023-07-21T22:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.146+0000 7eff70299b80 1 Processor -- start 2023-07-21T22:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff70299b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e905e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff70299b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e8d860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff70299b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a660 0x5597d8e8dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff70299b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8d75a60 con 0x5597d8e8a210 2023-07-21T22:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff70299b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8d75760 con 0x5597d8ce06b0 2023-07-21T22:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff70299b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8c598c0 con 0x5597d8e8a660 2023-07-21T22:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff4ffff700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7eff440a1310 0x7eff440a37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff70299b80 10 client.0 _ll_register_callbacks cb 0x5597d8d73700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff4ffff700 1 -- 172.21.15.151:0/3480810002 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7eff400cc570 con 0x7eff580685b0 2023-07-21T22:55:58.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.147+0000 7eff56d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e905e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.148+0000 7eff56d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e905e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51100/0 (socket says 172.21.15.151:51100) 2023-07-21T22:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.148+0000 7eff56d9d700 1 -- 172.21.15.151:0/1877437350 learned_addr learned my addr 172.21.15.151:0/1877437350 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.148+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a660 0x5597d8e8dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.148+0000 7eff5659c700 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e8d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.149+0000 7eff4dd9b700 1 -- 172.21.15.151:0/1877437350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 msgr2=0x5597d8e905e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.149+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e905e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.149+0000 7eff4dd9b700 1 -- 172.21.15.151:0/1877437350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 msgr2=0x5597d8e8d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.149+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e8d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.149+0000 7eff4dd9b700 1 -- 172.21.15.151:0/1877437350 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5810d210 con 0x5597d8e8a660 2023-07-21T22:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.149+0000 7eff56d9d700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7eff440a1310 0x7eff440a37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.149+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a660 0x5597d8e8dfa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7eff400c9c80 tx=0x7eff40098fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d370baa24e1a83d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.150+0000 7eff3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.150+0000 7eff3dffb700 1 -- 172.21.15.151:0/1877437350 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff400a1a50 con 0x5597d8e8a660 2023-07-21T22:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.150+0000 7eff3dffb700 1 -- 172.21.15.151:0/1877437350 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7eff400c9f00 con 0x5597d8e8a660 2023-07-21T22:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.150+0000 7eff70299b80 1 -- 172.21.15.151:0/1877437350 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5597d8d2f490 con 0x5597d8e8a660 2023-07-21T22:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.150+0000 7eff56d9d700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7eff440a1310 0x7eff440a37c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c010 tx=0x7eff5000b540 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.151+0000 7eff3dffb700 1 -- 172.21.15.151:0/1877437350 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff400ca0c0 con 0x5597d8e8a660 2023-07-21T22:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.151+0000 7eff70299b80 10 client.28903 fetch_fsmap learned FSMap version 107 2023-07-21T22:55:58.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.151+0000 7eff70299b80 1 -- 172.21.15.151:0/1877437350 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) v3 -- 0x5597d8becc00 con 0x5597d8e8a660 2023-07-21T22:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.151+0000 7eff3dffb700 1 -- 172.21.15.151:0/1877437350 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff400b5020 con 0x5597d8e8a660 2023-07-21T22:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.152+0000 7eff3dffb700 1 -- 172.21.15.151:0/1877437350 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 107) v1 ==== 7478+0+0 (secure 0 0 0) 0x7eff40098af0 con 0x5597d8e8a660 2023-07-21T22:55:58.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.152+0000 7eff70299b80 10 client.28903 fetch_fsmap finished waiting for FSMap version 107 2023-07-21T22:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.152+0000 7eff70299b80 10 client.28903 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.152+0000 7eff70299b80 20 client.28903 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.152+0000 7eff70299b80 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597d8e9d9b0 0x5597d8e9fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.152+0000 7eff70299b80 4 client.28903 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:55:58.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.152+0000 7eff70299b80 1 -- 172.21.15.151:0/1877437350 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5597d8dcee50 con 0x5597d8e9d9b0 2023-07-21T22:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.153+0000 7eff5659c700 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597d8e9d9b0 0x5597d8e9fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.153+0000 7eff5659c700 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597d8e9d9b0 0x5597d8e9fd90 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef49fda58832c9ed server_cookie=342aaf69ec1aab73 in_seq=0 out_seq=0 2023-07-21T22:55:58.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.153+0000 7eff3dffb700 10 client.28903 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.154+0000 7eff3dffb700 1 -- 172.21.15.151:0/1877437350 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5597d8dcee50 con 0x5597d8e9d9b0 2023-07-21T22:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.154+0000 7eff3dffb700 10 client.28903 handle_command_reply: tid=0 2023-07-21T22:55:58.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.154+0000 7eff70299b80 1 client.28903 shutdown 2023-07-21T22:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.156+0000 7eff70299b80 1 -- 172.21.15.151:0/1877437350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a660 msgr2=0x5597d8e8dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.156+0000 7eff70299b80 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a660 0x5597d8e8dfa0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7eff400c9c80 tx=0x7eff40098fe0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.157+0000 7eff70299b80 1 -- 172.21.15.151:0/1877437350 shutdown_connections 2023-07-21T22:55:58.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.157+0000 7eff70299b80 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597d8e9d9b0 0x5597d8e9fd90 crc :-1 s=READY pgs=427 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.157+0000 7eff70299b80 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e905e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.157+0000 7eff70299b80 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e8a660 0x5597d8e8dfa0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.157+0000 7eff70299b80 1 --2- 172.21.15.151:0/1877437350 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e8d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.157+0000 7eff70299b80 1 -- 172.21.15.151:0/1877437350 >> 172.21.15.151:0/1877437350 conn(0x5597d8e79ae0 msgr2=0x5597d8e7e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.157+0000 7eff3dffb700 0 client.28903 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.157+0000 7eff70299b80 1 -- 172.21.15.151:0/1877437350 shutdown_connections 2023-07-21T22:55:58.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.157+0000 7eff70299b80 1 -- 172.21.15.151:0/1877437350 wait complete. 2023-07-21T22:55:58.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.158+0000 7eff70299b80 20 client.28903 trim_cache size 0 max 16384 2023-07-21T22:55:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.185+0000 7eff70299b80 1 Processor -- start 2023-07-21T22:55:58.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.185+0000 7eff70299b80 1 -- start start 2023-07-21T22:55:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.185+0000 7eff70299b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8e79ae0 0x5597d8e83f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff70299b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8ce06b0 0x5597d8e89030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff70299b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e7eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff70299b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8e8ee40 con 0x5597d8e8a210 2023-07-21T22:55:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff70299b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8e84cd0 con 0x5597d8e79ae0 2023-07-21T22:55:58.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff70299b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8e9a500 con 0x5597d8ce06b0 2023-07-21T22:55:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff4dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8ce06b0 0x5597d8e89030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff56d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e7eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff4dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8ce06b0 0x5597d8e89030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51842/0 (socket says 172.21.15.151:51842) 2023-07-21T22:55:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff4dd9b700 1 -- 172.21.15.151:0/1032775135 learned_addr learned my addr 172.21.15.151:0/1032775135 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:58.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.186+0000 7eff5659c700 1 --2- 172.21.15.151:0/1032775135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8e79ae0 0x5597d8e83f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.187+0000 7eff4dd9b700 1 -- 172.21.15.151:0/1032775135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8e79ae0 msgr2=0x5597d8e83f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.187+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/1032775135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8e79ae0 0x5597d8e83f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.187+0000 7eff4dd9b700 1 -- 172.21.15.151:0/1032775135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 msgr2=0x5597d8e7eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.187+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/1032775135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e7eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.187+0000 7eff4dd9b700 1 -- 172.21.15.151:0/1032775135 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5597d8c2a1f0 con 0x5597d8ce06b0 2023-07-21T22:55:58.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.187+0000 7eff5659c700 1 --2- 172.21.15.151:0/1032775135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8e79ae0 0x5597d8e83f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.187+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/1032775135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8ce06b0 0x5597d8e89030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff40099300 tx=0x7eff40097bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc8ab4961a86e83 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.189+0000 7eff4d59a700 1 -- 172.21.15.151:0/1032775135 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff4009a140 con 0x5597d8ce06b0 2023-07-21T22:55:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.189+0000 7eff4d59a700 1 -- 172.21.15.151:0/1032775135 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff400b5050 con 0x5597d8ce06b0 2023-07-21T22:55:58.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.189+0000 7eff4d59a700 1 -- 172.21.15.151:0/1032775135 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff40098af0 con 0x5597d8ce06b0 2023-07-21T22:55:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.190+0000 7eff70299b80 1 -- 172.21.15.151:0/1032775135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8ce06b0 msgr2=0x5597d8e89030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.190+0000 7eff70299b80 1 --2- 172.21.15.151:0/1032775135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8ce06b0 0x5597d8e89030 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7eff40099300 tx=0x7eff40097bb0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.190+0000 7eff70299b80 1 -- 172.21.15.151:0/1032775135 shutdown_connections 2023-07-21T22:55:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.190+0000 7eff70299b80 1 --2- 172.21.15.151:0/1032775135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8e79ae0 0x5597d8e83f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.190+0000 7eff70299b80 1 --2- 172.21.15.151:0/1032775135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e7eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.190+0000 7eff70299b80 1 --2- 172.21.15.151:0/1032775135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8ce06b0 0x5597d8e89030 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.190+0000 7eff70299b80 1 -- 172.21.15.151:0/1032775135 >> 172.21.15.151:0/1032775135 conn(0x5597d8e8e110 msgr2=0x5597d8e88920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.191+0000 7eff70299b80 1 -- 172.21.15.151:0/1032775135 shutdown_connections 2023-07-21T22:55:58.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.191+0000 7eff70299b80 1 -- 172.21.15.151:0/1032775135 wait complete. 2023-07-21T22:55:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.192+0000 7eff70299b80 1 -- start start 2023-07-21T22:55:58.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.192+0000 7eff70299b80 1 Processor -- start 2023-07-21T22:55:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.193+0000 7eff70299b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e91180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.193+0000 7eff70299b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e79ae0 0x5597d8e916c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.193+0000 7eff70299b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e91c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.193+0000 7eff70299b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8ef09f0 con 0x5597d8e8a210 2023-07-21T22:55:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.193+0000 7eff70299b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8ef0b60 con 0x5597d8ce06b0 2023-07-21T22:55:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.193+0000 7eff70299b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5597d8ef0d20 con 0x5597d8e79ae0 2023-07-21T22:55:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.193+0000 7eff70299b80 10 client.0 _ll_register_callbacks cb 0x7eff400994c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:55:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.194+0000 7eff5659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e91180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.194+0000 7eff5659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e91180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51118/0 (socket says 172.21.15.151:51118) 2023-07-21T22:55:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.194+0000 7eff5659c700 1 -- 172.21.15.151:0/4039607044 learned_addr learned my addr 172.21.15.151:0/4039607044 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:55:58.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.194+0000 7eff56d9d700 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e91c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.195+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e79ae0 0x5597d8e916c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.196+0000 7eff56d9d700 1 -- 172.21.15.151:0/4039607044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e79ae0 msgr2=0x5597d8e916c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.196+0000 7eff56d9d700 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e79ae0 0x5597d8e916c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.196+0000 7eff56d9d700 1 -- 172.21.15.151:0/4039607044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 msgr2=0x5597d8e91180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:55:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.196+0000 7eff56d9d700 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e91180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.196+0000 7eff56d9d700 1 -- 172.21.15.151:0/4039607044 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5597d8becc00 con 0x5597d8e8a210 2023-07-21T22:55:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.196+0000 7eff56d9d700 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e91c00 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7eff50006010 tx=0x7eff5000baa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6e6ee146a9dedc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:55:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.196+0000 7eff3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:55:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.197+0000 7eff3dffb700 1 -- 172.21.15.151:0/4039607044 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff50036040 con 0x5597d8e8a210 2023-07-21T22:55:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.197+0000 7eff3dffb700 1 -- 172.21.15.151:0/4039607044 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(150..150 src has 1..150) v4 ==== 8492+0+0 (secure 0 0 0) 0x7eff50003c30 con 0x5597d8e8a210 2023-07-21T22:55:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.197+0000 7eff70299b80 1 -- 172.21.15.151:0/4039607044 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7eff5001e040 con 0x5597d8e8a210 2023-07-21T22:55:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.197+0000 7eff4dd9b700 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e79ae0 0x5597d8e916c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:55:58.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.198+0000 7eff3dffb700 1 -- 172.21.15.151:0/4039607044 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff50005710 con 0x5597d8e8a210 2023-07-21T22:55:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.198+0000 7eff70299b80 10 client.19197 fetch_fsmap learned FSMap version 107 2023-07-21T22:55:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.198+0000 7eff70299b80 1 -- 172.21.15.151:0/4039607044 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) v3 -- 0x5597d8c02250 con 0x5597d8e8a210 2023-07-21T22:55:58.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.199+0000 7eff5659c700 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e91180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:55:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.200+0000 7eff3dffb700 1 -- 172.21.15.151:0/4039607044 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7eff5001e040 con 0x5597d8e8a210 2023-07-21T22:55:58.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.200+0000 7eff3dffb700 1 -- 172.21.15.151:0/4039607044 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 107) v1 ==== 7478+0+0 (secure 0 0 0) 0x7eff5000f890 con 0x5597d8e8a210 2023-07-21T22:55:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.201+0000 7eff70299b80 10 client.19197 fetch_fsmap finished waiting for FSMap version 107 2023-07-21T22:55:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.201+0000 7eff70299b80 10 client.19197 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:55:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.201+0000 7eff70299b80 20 client.19197 populate_metadata read hostname 'smithi151' 2023-07-21T22:55:58.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.201+0000 7eff70299b80 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597d8e8a660 0x5597d8ef3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:55:58.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.201+0000 7eff70299b80 4 client.19197 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:55:58.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.201+0000 7eff70299b80 1 -- 172.21.15.151:0/4039607044 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5597d8d90ff0 con 0x5597d8e8a660 2023-07-21T22:55:58.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.202+0000 7eff5659c700 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597d8e8a660 0x5597d8ef3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:55:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.208+0000 7eff5659c700 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597d8e8a660 0x5597d8ef3ff0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b632c7192692204e server_cookie=92f274b78bd205d1 in_seq=0 out_seq=0 2023-07-21T22:55:58.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.208+0000 7eff3dffb700 10 client.19197 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.257+0000 7eff3dffb700 1 -- 172.21.15.151:0/4039607044 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5597d8d90ff0 con 0x5597d8e8a660 2023-07-21T22:55:58.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.257+0000 7eff3dffb700 10 client.19197 handle_command_reply: tid=0 2023-07-21T22:55:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.258+0000 7eff70299b80 1 client.19197 shutdown 2023-07-21T22:55:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.258+0000 7eff70299b80 1 -- 172.21.15.151:0/4039607044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 msgr2=0x5597d8e91c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.258+0000 7eff70299b80 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e91c00 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7eff50006010 tx=0x7eff5000baa0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff70299b80 1 -- 172.21.15.151:0/4039607044 shutdown_connections 2023-07-21T22:55:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff70299b80 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5597d8e8a660 0x5597d8ef3ff0 crc :-1 s=READY pgs=428 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff70299b80 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5597d8ce06b0 0x5597d8e91180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff70299b80 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5597d8e8a210 0x5597d8e91c00 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff70299b80 1 --2- 172.21.15.151:0/4039607044 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5597d8e79ae0 0x5597d8e916c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff70299b80 1 -- 172.21.15.151:0/4039607044 >> 172.21.15.151:0/4039607044 conn(0x5597d8e8e110 msgr2=0x5597d8e891b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff3dffb700 0 client.19197 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:55:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff70299b80 1 -- 172.21.15.151:0/4039607044 shutdown_connections 2023-07-21T22:55:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff70299b80 1 -- 172.21.15.151:0/4039607044 wait complete. 2023-07-21T22:55:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.259+0000 7eff70299b80 20 client.19197 trim_cache size 0 max 16384 2023-07-21T22:55:58.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:55:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:55:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:55:58.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:55:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.261+0000 7eff5c9ff700 1 -- 172.21.15.151:0/3480810002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7eff440a1310 msgr2=0x7eff440a37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.261+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7eff440a1310 0x7eff440a37c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7eff5000c010 tx=0x7eff5000b540 comp rx=0 tx=0).stop 2023-07-21T22:55:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.261+0000 7eff5c9ff700 1 -- 172.21.15.151:0/3480810002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580685b0 msgr2=0x7eff58072140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:55:58.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.261+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580685b0 0x7eff58072140 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7eff4000d950 tx=0x7eff4000dd10 comp rx=0 tx=0).stop 2023-07-21T22:55:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.262+0000 7eff5c9ff700 1 -- 172.21.15.151:0/3480810002 shutdown_connections 2023-07-21T22:55:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.262+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7eff440a1310 0x7eff440a37c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.262+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff58104e50 0x7eff5810a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.262+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff58067c10 0x7eff5810a2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.262+0000 7eff5c9ff700 1 --2- 172.21.15.151:0/3480810002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7eff580685b0 0x7eff58072140 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:55:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.262+0000 7eff5c9ff700 1 -- 172.21.15.151:0/3480810002 >> 172.21.15.151:0/3480810002 conn(0x7eff58074760 msgr2=0x7eff580fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:55:58.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.262+0000 7eff5c9ff700 1 -- 172.21.15.151:0/3480810002 shutdown_connections 2023-07-21T22:55:58.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:55:58.262+0000 7eff5c9ff700 1 -- 172.21.15.151:0/3480810002 wait complete. 2023-07-21T22:55:59.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:58 smithi187 ceph-mon[96918]: pgmap v1169: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-07-21T22:55:59.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:58 smithi195 ceph-mon[97365]: pgmap v1169: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-07-21T22:55:59.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:58 smithi151 ceph-mon[95510]: pgmap v1169: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 13 MiB/s wr, 1.06k op/s 2023-07-21T22:55:59.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 185.0 s, 387.2 tps, lat 256.435 ms stddev 63.969 2023-07-21T22:56:00.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:55:59 smithi187 ceph-mon[96918]: pgmap v1170: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 7.8 MiB/s wr, 639 op/s 2023-07-21T22:56:00.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:55:59 smithi195 ceph-mon[97365]: pgmap v1170: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 7.8 MiB/s wr, 639 op/s 2023-07-21T22:56:00.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:55:59 smithi151 ceph-mon[95510]: pgmap v1170: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 7.8 MiB/s wr, 639 op/s 2023-07-21T22:56:03.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:02 smithi187 ceph-mon[96918]: pgmap v1171: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 7.8 MiB/s wr, 639 op/s 2023-07-21T22:56:03.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:02 smithi195 ceph-mon[97365]: pgmap v1171: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 7.8 MiB/s wr, 639 op/s 2023-07-21T22:56:03.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:02 smithi151 ceph-mon[95510]: pgmap v1171: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 988 KiB/s rd, 7.8 MiB/s wr, 639 op/s 2023-07-21T22:56:04.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:03 smithi195 ceph-mon[97365]: pgmap v1172: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 885 op/s 2023-07-21T22:56:04.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:03 smithi151 ceph-mon[95510]: pgmap v1172: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 885 op/s 2023-07-21T22:56:04.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 190.0 s, 39.2 tps, lat 2500.188 ms stddev 2102.575 2023-07-21T22:56:04.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:03 smithi187 ceph-mon[96918]: pgmap v1172: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 885 op/s 2023-07-21T22:56:07.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:06 smithi187 ceph-mon[96918]: pgmap v1173: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 6.1 MiB/s wr, 489 op/s 2023-07-21T22:56:07.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:06 smithi195 ceph-mon[97365]: pgmap v1173: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 6.1 MiB/s wr, 489 op/s 2023-07-21T22:56:07.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:06 smithi151 ceph-mon[95510]: pgmap v1173: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 884 KiB/s rd, 6.1 MiB/s wr, 489 op/s 2023-07-21T22:56:08.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:07 smithi195 ceph-mon[97365]: pgmap v1174: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.5 MiB/s wr, 632 op/s 2023-07-21T22:56:08.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:07 smithi151 ceph-mon[95510]: pgmap v1174: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.5 MiB/s wr, 632 op/s 2023-07-21T22:56:08.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:07 smithi187 ceph-mon[96918]: pgmap v1174: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 7.5 MiB/s wr, 632 op/s 2023-07-21T22:56:09.292 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 195.0 s, 34.6 tps, lat 399.856 ms stddev 133.864 2023-07-21T22:56:10.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:09 smithi151 ceph-mon[95510]: osdmap e151: 12 total, 12 up, 12 in 2023-07-21T22:56:10.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:09 smithi151 ceph-mon[95510]: pgmap v1176: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 5.1 MiB/s wr, 467 op/s 2023-07-21T22:56:10.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:09 smithi187 ceph-mon[96918]: osdmap e151: 12 total, 12 up, 12 in 2023-07-21T22:56:10.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:09 smithi187 ceph-mon[96918]: pgmap v1176: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 5.1 MiB/s wr, 467 op/s 2023-07-21T22:56:10.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:09 smithi195 ceph-mon[97365]: osdmap e151: 12 total, 12 up, 12 in 2023-07-21T22:56:10.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:09 smithi195 ceph-mon[97365]: pgmap v1176: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 5.1 MiB/s wr, 467 op/s 2023-07-21T22:56:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.500+0000 7f4b3ddff700 1 -- 172.21.15.151:0/3896236307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b38105b60 msgr2=0x7f4b38105f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.500+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/3896236307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b38105b60 0x7f4b38105f30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4b28009990 tx=0x7f4b28009ca0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.500+0000 7f4b3ddff700 1 -- 172.21.15.151:0/3896236307 shutdown_connections 2023-07-21T22:56:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.500+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/3896236307 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b381004e0 0x7f4b3810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.500+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/3896236307 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b38105b60 0x7f4b38105f30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.500+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/3896236307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b380ffb30 0x7f4b380fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.500+0000 7f4b3ddff700 1 -- 172.21.15.151:0/3896236307 >> 172.21.15.151:0/3896236307 conn(0x7f4b380fb5f0 msgr2=0x7f4b380fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.501+0000 7f4b3ddff700 1 -- 172.21.15.151:0/3896236307 shutdown_connections 2023-07-21T22:56:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.501+0000 7f4b3ddff700 1 -- 172.21.15.151:0/3896236307 wait complete. 2023-07-21T22:56:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.502+0000 7f4b3ddff700 1 Processor -- start 2023-07-21T22:56:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.502+0000 7f4b3ddff700 1 -- start start 2023-07-21T22:56:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b3ddff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b380ffb30 0x7f4b38106930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b3ddff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b381004e0 0x7f4b38106e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b3ddff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b38105b60 0x7f4b381a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b3ddff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b381076d0 con 0x7f4b380ffb30 2023-07-21T22:56:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b3ddff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b381a87b0 con 0x7f4b38105b60 2023-07-21T22:56:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b3ddff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b381a88f0 con 0x7f4b381004e0 2023-07-21T22:56:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b37fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b38105b60 0x7f4b381a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b37fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b38105b60 0x7f4b381a8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:48758/0 (socket says 172.21.15.151:48758) 2023-07-21T22:56:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b37fff700 1 -- 172.21.15.151:0/115703885 learned_addr learned my addr 172.21.15.151:0/115703885 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.503+0000 7f4b377fe700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b380ffb30 0x7f4b38106930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.504+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b381004e0 0x7f4b38106e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.504+0000 7f4b37fff700 1 -- 172.21.15.151:0/115703885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b381004e0 msgr2=0x7f4b38106e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.504+0000 7f4b37fff700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b381004e0 0x7f4b38106e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.504+0000 7f4b37fff700 1 -- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b380ffb30 msgr2=0x7f4b38106930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.504+0000 7f4b37fff700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b380ffb30 0x7f4b38106930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.504+0000 7f4b37fff700 1 -- 172.21.15.151:0/115703885 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b280095f0 con 0x7f4b38105b60 2023-07-21T22:56:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.504+0000 7f4b37fff700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b38105b60 0x7f4b381a8270 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4b30007d70 tx=0x7f4b3000a340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.505+0000 7f4b34ff9700 1 -- 172.21.15.151:0/115703885 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b3000ad40 con 0x7f4b38105b60 2023-07-21T22:56:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.505+0000 7f4b34ff9700 1 -- 172.21.15.151:0/115703885 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b300128b0 con 0x7f4b38105b60 2023-07-21T22:56:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.505+0000 7f4b34ff9700 1 -- 172.21.15.151:0/115703885 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b300115a0 con 0x7f4b38105b60 2023-07-21T22:56:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.505+0000 7f4b3ddff700 1 -- 172.21.15.151:0/115703885 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b381a8b50 con 0x7f4b38105b60 2023-07-21T22:56:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.505+0000 7f4b3ddff700 1 -- 172.21.15.151:0/115703885 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b381a9090 con 0x7f4b38105b60 2023-07-21T22:56:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.511+0000 7f4b51811b80 1 Processor -- start 2023-07-21T22:56:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.512+0000 7f4b34ff9700 1 -- 172.21.15.151:0/115703885 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4b30012a20 con 0x7f4b38105b60 2023-07-21T22:56:11.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.512+0000 7f4b51811b80 1 -- start start 2023-07-21T22:56:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.512+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db8296b0 0x5637db9d2cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.512+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.512+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3660 0x5637db9cd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.512+0000 7f4b51811b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637db8d2c50 con 0x5637db8296b0 2023-07-21T22:56:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.512+0000 7f4b51811b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637db9259e0 con 0x5637db9d3210 2023-07-21T22:56:11.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.513+0000 7f4b51811b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637db91ee70 con 0x5637db9d3660 2023-07-21T22:56:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.513+0000 7f4b36ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db8296b0 0x5637db9d2cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.513+0000 7f4b36ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3660 0x5637db9cd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.513+0000 7f4b36ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3660 0x5637db9cd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56490/0 (socket says 172.21.15.151:56490) 2023-07-21T22:56:11.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.513+0000 7f4b36ffd700 1 -- 172.21.15.151:0/3170497047 learned_addr learned my addr 172.21.15.151:0/3170497047 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.513+0000 7f4b377fe700 1 --2- 172.21.15.151:0/3170497047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b36ffd700 1 -- 172.21.15.151:0/3170497047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 msgr2=0x5637db9ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/3170497047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b36ffd700 1 -- 172.21.15.151:0/3170497047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db8296b0 msgr2=0x5637db9d2cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:11.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/3170497047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db8296b0 0x5637db9d2cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b36ffd700 1 -- 172.21.15.151:0/3170497047 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637db74cd80 con 0x5637db9d3660 2023-07-21T22:56:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b34ff9700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b180a1410 0x7f4b180a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/3170497047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3660 0x5637db9cd4a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4b20016730 tx=0x7f4b20006a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3269f80d4c91536a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b34ff9700 1 -- 172.21.15.151:0/115703885 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4b300ccdc0 con 0x7f4b38105b60 2023-07-21T22:56:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b377fe700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b180a1410 0x7f4b180a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.514+0000 7f4b2dffb700 1 -- 172.21.15.151:0/3170497047 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20018680 con 0x5637db9d3660 2023-07-21T22:56:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.515+0000 7f4b2dffb700 1 -- 172.21.15.151:0/3170497047 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b2000c020 con 0x5637db9d3660 2023-07-21T22:56:11.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.515+0000 7f4b2dffb700 1 -- 172.21.15.151:0/3170497047 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20017640 con 0x5637db9d3660 2023-07-21T22:56:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.515+0000 7f4b377fe700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b180a1410 0x7f4b180a38c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4b280098e0 tx=0x7f4b2800b580 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.515+0000 7f4b51811b80 1 -- 172.21.15.151:0/3170497047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3660 msgr2=0x5637db9cd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.515+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3170497047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3660 0x5637db9cd4a0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f4b20016730 tx=0x7f4b20006a70 comp rx=0 tx=0).stop 2023-07-21T22:56:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.516+0000 7f4b51811b80 1 -- 172.21.15.151:0/3170497047 shutdown_connections 2023-07-21T22:56:11.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.516+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3170497047 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3660 0x5637db9cd4a0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.516+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3170497047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db8296b0 0x5637db9d2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.516+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3170497047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.516+0000 7f4b51811b80 1 -- 172.21.15.151:0/3170497047 >> 172.21.15.151:0/3170497047 conn(0x5637db9c2ae0 msgr2=0x5637db9c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.516+0000 7f4b51811b80 1 -- 172.21.15.151:0/3170497047 shutdown_connections 2023-07-21T22:56:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.516+0000 7f4b51811b80 1 -- 172.21.15.151:0/3170497047 wait complete. 2023-07-21T22:56:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.517+0000 7f4b51811b80 1 -- start start 2023-07-21T22:56:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.517+0000 7f4b51811b80 1 Processor -- start 2023-07-21T22:56:11.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3210 0x5637db9d6830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b51811b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637db8bea60 con 0x5637db9d3660 2023-07-21T22:56:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b51811b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637db8be760 con 0x5637db8296b0 2023-07-21T22:56:11.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b51811b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637db7a28c0 con 0x5637db9d3210 2023-07-21T22:56:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b51811b80 10 client.0 _ll_register_callbacks cb 0x5637db8bc700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:56:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b377fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b377fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d95b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:48768/0 (socket says 172.21.15.151:48768) 2023-07-21T22:56:11.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b377fe700 1 -- 172.21.15.151:0/2969447136 learned_addr learned my addr 172.21.15.151:0/2969447136 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:11.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3210 0x5637db9d6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.518+0000 7f4b37fff700 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.519+0000 7f4b377fe700 1 -- 172.21.15.151:0/2969447136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3210 msgr2=0x5637db9d6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.519+0000 7f4b377fe700 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3210 0x5637db9d6830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.519+0000 7f4b377fe700 1 -- 172.21.15.151:0/2969447136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 msgr2=0x5637db9d6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.519+0000 7f4b377fe700 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.519+0000 7f4b377fe700 1 -- 172.21.15.151:0/2969447136 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b20016410 con 0x5637db8296b0 2023-07-21T22:56:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.519+0000 7f4b377fe700 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d95b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800bf00 tx=0x7f4b28009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fbde5bdb975b9ab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.519+0000 7f4b26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:56:11.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.519+0000 7f4b26ffd700 1 -- 172.21.15.151:0/2969447136 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2801d040 con 0x5637db8296b0 2023-07-21T22:56:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.520+0000 7f4b26ffd700 1 -- 172.21.15.151:0/2969447136 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4b28004180 con 0x5637db8296b0 2023-07-21T22:56:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.520+0000 7f4b51811b80 1 -- 172.21.15.151:0/2969447136 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5637db878490 con 0x5637db8296b0 2023-07-21T22:56:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.520+0000 7f4b26ffd700 1 -- 172.21.15.151:0/2969447136 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b28004500 con 0x5637db8296b0 2023-07-21T22:56:11.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.520+0000 7f4b51811b80 10 client.28895 fetch_fsmap learned FSMap version 107 2023-07-21T22:56:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.520+0000 7f4b51811b80 1 -- 172.21.15.151:0/2969447136 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) v3 -- 0x5637db735c00 con 0x5637db8296b0 2023-07-21T22:56:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.521+0000 7f4b26ffd700 1 -- 172.21.15.151:0/2969447136 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5637db878490 con 0x5637db8296b0 2023-07-21T22:56:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.521+0000 7f4b26ffd700 1 -- 172.21.15.151:0/2969447136 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 107) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4b28024740 con 0x5637db8296b0 2023-07-21T22:56:11.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.521+0000 7f4b51811b80 10 client.28895 fetch_fsmap finished waiting for FSMap version 107 2023-07-21T22:56:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.521+0000 7f4b51811b80 10 client.28895 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:56:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.521+0000 7f4b51811b80 20 client.28895 populate_metadata read hostname 'smithi151' 2023-07-21T22:56:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.521+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5637db9e6af0 0x5637db9e8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.521+0000 7f4b51811b80 4 client.28895 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:56:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.521+0000 7f4b51811b80 1 -- 172.21.15.151:0/2969447136 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5637db917e50 con 0x5637db9e6af0 2023-07-21T22:56:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.522+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5637db9e6af0 0x5637db9e8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.522+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5637db9e6af0 0x5637db9e8f00 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=116705b93fb5e7a0 server_cookie=b6a84b1c6b18144a in_seq=0 out_seq=0 2023-07-21T22:56:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.522+0000 7f4b26ffd700 10 client.28895 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.523+0000 7f4b26ffd700 1 -- 172.21.15.151:0/2969447136 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5637db917e50 con 0x5637db9e6af0 2023-07-21T22:56:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.523+0000 7f4b26ffd700 10 client.28895 handle_command_reply: tid=0 2023-07-21T22:56:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.523+0000 7f4b51811b80 1 client.28895 shutdown 2023-07-21T22:56:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.523+0000 7f4b51811b80 1 -- 172.21.15.151:0/2969447136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 msgr2=0x5637db9d95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.523+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d95b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4b2800bf00 tx=0x7f4b28009ca0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.524+0000 7f4b51811b80 1 -- 172.21.15.151:0/2969447136 shutdown_connections 2023-07-21T22:56:11.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.524+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5637db9e6af0 0x5637db9e8f00 crc :-1 s=READY pgs=429 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.524+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d95b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.524+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.524+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2969447136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db9d3210 0x5637db9d6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.524+0000 7f4b51811b80 1 -- 172.21.15.151:0/2969447136 >> 172.21.15.151:0/2969447136 conn(0x5637db9c2ae0 msgr2=0x5637db9c73e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.524+0000 7f4b26ffd700 0 client.28895 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.524+0000 7f4b51811b80 1 -- 172.21.15.151:0/2969447136 shutdown_connections 2023-07-21T22:56:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.525+0000 7f4b51811b80 1 -- 172.21.15.151:0/2969447136 wait complete. 2023-07-21T22:56:11.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.525+0000 7f4b51811b80 20 client.28895 trim_cache size 0 max 16384 2023-07-21T22:56:11.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.550+0000 7f4b51811b80 1 Processor -- start 2023-07-21T22:56:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b51811b80 1 -- start start 2023-07-21T22:56:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db8296b0 0x5637db9ddc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9d41b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b51811b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637db878490 con 0x5637db9d3660 2023-07-21T22:56:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b51811b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637db9c4c00 con 0x5637db9d3210 2023-07-21T22:56:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b51811b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637db9d7570 con 0x5637db8296b0 2023-07-21T22:56:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b36ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9d41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b36ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9d41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:48784/0 (socket says 172.21.15.151:48784) 2023-07-21T22:56:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.551+0000 7f4b36ffd700 1 -- 172.21.15.151:0/2062712959 learned_addr learned my addr 172.21.15.151:0/2062712959 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.552+0000 7f4b377fe700 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db8296b0 0x5637db9ddc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.552+0000 7f4b36ffd700 1 -- 172.21.15.151:0/2062712959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db8296b0 msgr2=0x5637db9ddc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.552+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db8296b0 0x5637db9ddc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.552+0000 7f4b36ffd700 1 -- 172.21.15.151:0/2062712959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 msgr2=0x5637db9d90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.552+0000 7f4b37fff700 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.552+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.552+0000 7f4b36ffd700 1 -- 172.21.15.151:0/2062712959 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5637db7731f0 con 0x5637db9d3210 2023-07-21T22:56:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.552+0000 7f4b37fff700 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:56:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.552+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9d41b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4b20006ae0 tx=0x7f4b20008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11885522d4f9d8c1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.553+0000 7f4b2e7fc700 1 -- 172.21.15.151:0/2062712959 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b2002a450 con 0x5637db9d3210 2023-07-21T22:56:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.553+0000 7f4b2e7fc700 1 -- 172.21.15.151:0/2062712959 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b20029040 con 0x5637db9d3210 2023-07-21T22:56:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.553+0000 7f4b2e7fc700 1 -- 172.21.15.151:0/2062712959 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b20004330 con 0x5637db9d3210 2023-07-21T22:56:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.554+0000 7f4b51811b80 1 -- 172.21.15.151:0/2062712959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 msgr2=0x5637db9d41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.554+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9d41b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4b20006ae0 tx=0x7f4b20008040 comp rx=0 tx=0).stop 2023-07-21T22:56:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.554+0000 7f4b51811b80 1 -- 172.21.15.151:0/2062712959 shutdown_connections 2023-07-21T22:56:11.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.554+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.554+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637db8296b0 0x5637db9ddc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.554+0000 7f4b51811b80 1 --2- 172.21.15.151:0/2062712959 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db9d3210 0x5637db9d41b0 secure :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f4b20006ae0 tx=0x7f4b20008040 comp rx=0 tx=0).stop 2023-07-21T22:56:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.554+0000 7f4b51811b80 1 -- 172.21.15.151:0/2062712959 >> 172.21.15.151:0/2062712959 conn(0x5637db9c2ae0 msgr2=0x5637db9d3aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.554+0000 7f4b51811b80 1 -- 172.21.15.151:0/2062712959 shutdown_connections 2023-07-21T22:56:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.555+0000 7f4b51811b80 1 -- 172.21.15.151:0/2062712959 wait complete. 2023-07-21T22:56:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.555+0000 7f4b51811b80 1 -- start start 2023-07-21T22:56:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.555+0000 7f4b51811b80 1 Processor -- start 2023-07-21T22:56:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.557+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.557+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.557+0000 7f4b51811b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637dba35940 0x5637dba35db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.557+0000 7f4b51811b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637dba362f0 con 0x5637db9d3660 2023-07-21T22:56:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.557+0000 7f4b51811b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637dba36460 con 0x5637db8296b0 2023-07-21T22:56:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.557+0000 7f4b51811b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5637dba36620 con 0x5637dba35940 2023-07-21T22:56:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.557+0000 7f4b51811b80 10 client.0 _ll_register_callbacks cb 0x7f4b2800bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:56:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b37fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637dba35940 0x5637dba35db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b37fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637dba35940 0x5637dba35db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56522/0 (socket says 172.21.15.151:56522) 2023-07-21T22:56:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b37fff700 1 -- 172.21.15.151:0/3108339632 learned_addr learned my addr 172.21.15.151:0/3108339632 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b377fe700 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b36ffd700 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b37fff700 1 -- 172.21.15.151:0/3108339632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 msgr2=0x5637db9d6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b37fff700 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b37fff700 1 -- 172.21.15.151:0/3108339632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 msgr2=0x5637db9d6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b37fff700 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.558+0000 7f4b37fff700 1 -- 172.21.15.151:0/3108339632 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5637db74cd80 con 0x5637dba35940 2023-07-21T22:56:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.559+0000 7f4b37fff700 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637dba35940 0x5637dba35db0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4b30096a00 tx=0x7f4b3009a0d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=97bb01418db5489d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.559+0000 7f4b26ffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:56:11.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.559+0000 7f4b26ffd700 1 -- 172.21.15.151:0/3108339632 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b30099480 con 0x5637dba35940 2023-07-21T22:56:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.559+0000 7f4b26ffd700 1 -- 172.21.15.151:0/3108339632 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(151..151 src has 1..151) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4b300995e0 con 0x5637dba35940 2023-07-21T22:56:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.559+0000 7f4b51811b80 1 -- 172.21.15.151:0/3108339632 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b2000c020 con 0x5637dba35940 2023-07-21T22:56:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.559+0000 7f4b26ffd700 1 -- 172.21.15.151:0/3108339632 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=107) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b300b8310 con 0x5637dba35940 2023-07-21T22:56:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.559+0000 7f4b51811b80 10 client.28924 fetch_fsmap learned FSMap version 107 2023-07-21T22:56:11.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.559+0000 7f4b51811b80 1 -- 172.21.15.151:0/3108339632 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=107,monmap=4+}) v3 -- 0x5637db74b250 con 0x5637dba35940 2023-07-21T22:56:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.560+0000 7f4b26ffd700 1 -- 172.21.15.151:0/3108339632 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b2000c020 con 0x5637dba35940 2023-07-21T22:56:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.560+0000 7f4b26ffd700 1 -- 172.21.15.151:0/3108339632 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 107) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f4b30095d80 con 0x5637dba35940 2023-07-21T22:56:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.560+0000 7f4b51811b80 10 client.28924 fetch_fsmap finished waiting for FSMap version 107 2023-07-21T22:56:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.560+0000 7f4b51811b80 10 client.28924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:56:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.560+0000 7f4b51811b80 20 client.28924 populate_metadata read hostname 'smithi151' 2023-07-21T22:56:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.560+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5637db9d5100 0x5637db9d54d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:11.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.560+0000 7f4b51811b80 4 client.28924 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:56:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.560+0000 7f4b51811b80 1 -- 172.21.15.151:0/3108339632 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5637db8d9ff0 con 0x5637db9d5100 2023-07-21T22:56:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.560+0000 7f4b377fe700 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5637db9d5100 0x5637db9d54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.561+0000 7f4b377fe700 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5637db9d5100 0x5637db9d54d0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aed75cfcbefe896 server_cookie=156158287e408cca in_seq=0 out_seq=0 2023-07-21T22:56:11.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.561+0000 7f4b26ffd700 10 client.28924 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:11.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.594+0000 7f4b26ffd700 1 -- 172.21.15.151:0/3108339632 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5637db8d9ff0 con 0x5637db9d5100 2023-07-21T22:56:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.594+0000 7f4b26ffd700 10 client.28924 handle_command_reply: tid=0 2023-07-21T22:56:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.594+0000 7f4b51811b80 1 client.28924 shutdown 2023-07-21T22:56:11.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.594+0000 7f4b51811b80 1 -- 172.21.15.151:0/3108339632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637dba35940 msgr2=0x5637dba35db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.594+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637dba35940 0x5637dba35db0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f4b30096a00 tx=0x7f4b3009a0d0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.595+0000 7f4b51811b80 1 -- 172.21.15.151:0/3108339632 shutdown_connections 2023-07-21T22:56:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.595+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5637db9d5100 0x5637db9d54d0 crc :-1 s=READY pgs=430 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.595+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5637db8296b0 0x5637db9d6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.595+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5637dba35940 0x5637dba35db0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.595+0000 7f4b51811b80 1 --2- 172.21.15.151:0/3108339632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5637db9d3660 0x5637db9d6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.595+0000 7f4b51811b80 1 -- 172.21.15.151:0/3108339632 >> 172.21.15.151:0/3108339632 conn(0x5637db9c2ae0 msgr2=0x5637db9d2160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.595+0000 7f4b26ffd700 0 client.28924 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.595+0000 7f4b51811b80 1 -- 172.21.15.151:0/3108339632 shutdown_connections 2023-07-21T22:56:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.595+0000 7f4b51811b80 1 -- 172.21.15.151:0/3108339632 wait complete. 2023-07-21T22:56:11.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.596+0000 7f4b51811b80 20 client.28924 trim_cache size 0 max 16384 2023-07-21T22:56:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:56:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:56:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:56:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:56:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.596+0000 7f4b3ddff700 1 -- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b180a1410 msgr2=0x7f4b180a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.596+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b180a1410 0x7f4b180a38c0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f4b280098e0 tx=0x7f4b2800b580 comp rx=0 tx=0).stop 2023-07-21T22:56:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.597+0000 7f4b3ddff700 1 -- 172.21.15.151:0/115703885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b38105b60 msgr2=0x7f4b381a8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.597+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b38105b60 0x7f4b381a8270 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4b30007d70 tx=0x7f4b3000a340 comp rx=0 tx=0).stop 2023-07-21T22:56:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.597+0000 7f4b3ddff700 1 -- 172.21.15.151:0/115703885 shutdown_connections 2023-07-21T22:56:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.597+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b180a1410 0x7f4b180a38c0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.597+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b38105b60 0x7f4b381a8270 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.597+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b380ffb30 0x7f4b38106930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.597+0000 7f4b3ddff700 1 --2- 172.21.15.151:0/115703885 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b381004e0 0x7f4b38106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.597+0000 7f4b3ddff700 1 -- 172.21.15.151:0/115703885 >> 172.21.15.151:0/115703885 conn(0x7f4b380fb5f0 msgr2=0x7f4b38072740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.600+0000 7f4b3ddff700 1 -- 172.21.15.151:0/115703885 shutdown_connections 2023-07-21T22:56:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:11.600+0000 7f4b3ddff700 1 -- 172.21.15.151:0/115703885 wait complete. 2023-07-21T22:56:13.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:12 smithi187 ceph-mon[96918]: pgmap v1177: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 5.1 MiB/s wr, 467 op/s 2023-07-21T22:56:13.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:12 smithi195 ceph-mon[97365]: pgmap v1177: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 5.1 MiB/s wr, 467 op/s 2023-07-21T22:56:13.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:12 smithi151 ceph-mon[95510]: pgmap v1177: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 685 KiB/s rd, 5.1 MiB/s wr, 467 op/s 2023-07-21T22:56:14.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 200.0 s, 163.9 tps, lat 1146.601 ms stddev 1558.203 2023-07-21T22:56:15.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:14 smithi187 ceph-mon[96918]: pgmap v1178: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 3.2 MiB/s wr, 265 op/s 2023-07-21T22:56:15.121 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:14 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:56:15.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:14 smithi195 ceph-mon[97365]: pgmap v1178: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 3.2 MiB/s wr, 265 op/s 2023-07-21T22:56:15.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:14 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:56:15.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:14 smithi151 ceph-mon[95510]: pgmap v1178: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 3.2 MiB/s wr, 265 op/s 2023-07-21T22:56:15.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:14 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:56:16.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:15 smithi187 ceph-mon[96918]: pgmap v1179: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 3.2 MiB/s wr, 265 op/s 2023-07-21T22:56:16.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:15 smithi195 ceph-mon[97365]: pgmap v1179: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 3.2 MiB/s wr, 265 op/s 2023-07-21T22:56:16.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:15 smithi151 ceph-mon[95510]: pgmap v1179: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 656 KiB/s rd, 3.2 MiB/s wr, 265 op/s 2023-07-21T22:56:18.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:17 smithi187 ceph-mon[96918]: osdmap e152: 12 total, 12 up, 12 in 2023-07-21T22:56:18.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:17 smithi187 ceph-mon[96918]: pgmap v1181: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 3.9 MiB/s wr, 306 op/s 2023-07-21T22:56:18.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:17 smithi195 ceph-mon[97365]: osdmap e152: 12 total, 12 up, 12 in 2023-07-21T22:56:18.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:17 smithi195 ceph-mon[97365]: pgmap v1181: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 3.9 MiB/s wr, 306 op/s 2023-07-21T22:56:18.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:17 smithi151 ceph-mon[95510]: osdmap e152: 12 total, 12 up, 12 in 2023-07-21T22:56:18.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:17 smithi151 ceph-mon[95510]: pgmap v1181: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 794 KiB/s rd, 3.9 MiB/s wr, 306 op/s 2023-07-21T22:56:19.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 205.0 s, 101.6 tps, lat 914.986 ms stddev 1484.441 2023-07-21T22:56:20.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:19 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:56:20.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:19 smithi187 ceph-mon[96918]: pgmap v1182: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 3.5 MiB/s wr, 269 op/s 2023-07-21T22:56:20.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:19 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:56:20.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:19 smithi195 ceph-mon[97365]: pgmap v1182: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 3.5 MiB/s wr, 269 op/s 2023-07-21T22:56:20.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:19 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:56:20.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:19 smithi151 ceph-mon[95510]: pgmap v1182: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 3.5 MiB/s wr, 269 op/s 2023-07-21T22:56:23.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:22 smithi187 ceph-mon[96918]: pgmap v1183: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 3.5 MiB/s wr, 269 op/s 2023-07-21T22:56:23.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:22 smithi195 ceph-mon[97365]: pgmap v1183: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 3.5 MiB/s wr, 269 op/s 2023-07-21T22:56:23.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:22 smithi151 ceph-mon[95510]: pgmap v1183: 97 pgs: 97 active+clean; 12 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 700 KiB/s rd, 3.5 MiB/s wr, 269 op/s 2023-07-21T22:56:24.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:23 smithi195 ceph-mon[97365]: pgmap v1184: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 4.9 MiB/s wr, 378 op/s 2023-07-21T22:56:24.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:23 smithi151 ceph-mon[95510]: pgmap v1184: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 4.9 MiB/s wr, 378 op/s 2023-07-21T22:56:24.300 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 210.0 s, 318.6 tps, lat 340.127 ms stddev 201.766 2023-07-21T22:56:24.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:23 smithi187 ceph-mon[96918]: pgmap v1184: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 4.9 MiB/s wr, 378 op/s 2023-07-21T22:56:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.838+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/3036992558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88104a60 msgr2=0x7fdb880679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.838+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/3036992558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88104a60 0x7fdb880679a0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fdb78009990 tx=0x7fdb78009ca0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.838+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/3036992558 shutdown_connections 2023-07-21T22:56:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.838+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/3036992558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88104a60 0x7fdb880679a0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.838+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/3036992558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb881024f0 0x7fdb88102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.838+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/3036992558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb88067ee0 0x7fdb88068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.838+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/3036992558 >> 172.21.15.151:0/3036992558 conn(0x7fdb88074760 msgr2=0x7fdb88074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.839+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/3036992558 shutdown_connections 2023-07-21T22:56:24.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.839+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/3036992558 wait complete. 2023-07-21T22:56:24.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.840+0000 7fdb8d5ff700 1 Processor -- start 2023-07-21T22:56:24.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.840+0000 7fdb8d5ff700 1 -- start start 2023-07-21T22:56:24.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.840+0000 7fdb8d5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88067ee0 0x7fdb8819c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.840+0000 7fdb8d5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb881024f0 0x7fdb8819c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.840+0000 7fdb8d5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb88104a60 0x7fdb881a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.840+0000 7fdb8d5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb881a1460 con 0x7fdb88104a60 2023-07-21T22:56:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.840+0000 7fdb8d5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb881a15d0 con 0x7fdb88067ee0 2023-07-21T22:56:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.840+0000 7fdb8d5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb881a1790 con 0x7fdb881024f0 2023-07-21T22:56:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb86ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88067ee0 0x7fdb8819c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb867fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb881024f0 0x7fdb8819c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb86ffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88067ee0 0x7fdb8819c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36302/0 (socket says 172.21.15.151:36302) 2023-07-21T22:56:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb86ffd700 1 -- 172.21.15.151:0/4876688 learned_addr learned my addr 172.21.15.151:0/4876688 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb877fe700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb88104a60 0x7fdb881a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb86ffd700 1 -- 172.21.15.151:0/4876688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb881024f0 msgr2=0x7fdb8819c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb881024f0 0x7fdb8819c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb86ffd700 1 -- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb88104a60 msgr2=0x7fdb881a0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb88104a60 0x7fdb881a0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb86ffd700 1 -- 172.21.15.151:0/4876688 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780095f0 con 0x7fdb88067ee0 2023-07-21T22:56:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.841+0000 7fdb877fe700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb88104a60 0x7fdb881a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:56:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.842+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88067ee0 0x7fdb8819c270 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdb78005740 tx=0x7fdb78005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.842+0000 7fdb6ffff700 1 -- 172.21.15.151:0/4876688 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7801d070 con 0x7fdb88067ee0 2023-07-21T22:56:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.842+0000 7fdb6ffff700 1 -- 172.21.15.151:0/4876688 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb78022470 con 0x7fdb88067ee0 2023-07-21T22:56:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.842+0000 7fdb6ffff700 1 -- 172.21.15.151:0/4876688 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb78017650 con 0x7fdb88067ee0 2023-07-21T22:56:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.842+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/4876688 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb881a1a10 con 0x7fdb88067ee0 2023-07-21T22:56:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.842+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/4876688 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb881a1c90 con 0x7fdb88067ee0 2023-07-21T22:56:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.848+0000 7fdb6ffff700 1 -- 172.21.15.151:0/4876688 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdb7800fb00 con 0x7fdb88067ee0 2023-07-21T22:56:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.848+0000 7fdba0ef8b80 1 Processor -- start 2023-07-21T22:56:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.848+0000 7fdba0ef8b80 1 -- start start 2023-07-21T22:56:24.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.849+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 0x55c755598ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.849+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 0x55c755592f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.849+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599670 0x55c7555934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.849+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c755487c50 con 0x55c755599670 2023-07-21T22:56:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.849+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7554da9e0 con 0x55c7553de6b0 2023-07-21T22:56:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.849+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7554d3e70 con 0x55c755599220 2023-07-21T22:56:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.850+0000 7fdb867fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599670 0x55c7555934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.850+0000 7fdb877fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 0x55c755598ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.850+0000 7fdb877fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 0x55c755598ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36304/0 (socket says 172.21.15.151:36304) 2023-07-21T22:56:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.850+0000 7fdb877fe700 1 -- 172.21.15.151:0/3290913751 learned_addr learned my addr 172.21.15.151:0/3290913751 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.850+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/3290913751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 0x55c755592f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.850+0000 7fdb867fc700 1 -- 172.21.15.151:0/3290913751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 msgr2=0x55c755592f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.851+0000 7fdb867fc700 1 --2- 172.21.15.151:0/3290913751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 0x55c755592f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.851+0000 7fdb867fc700 1 -- 172.21.15.151:0/3290913751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 msgr2=0x55c755598ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.851+0000 7fdb867fc700 1 --2- 172.21.15.151:0/3290913751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 0x55c755598ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.851+0000 7fdb867fc700 1 -- 172.21.15.151:0/3290913751 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c755301d80 con 0x55c755599670 2023-07-21T22:56:24.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.851+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/3290913751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 0x55c755592f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:56:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.851+0000 7fdb867fc700 1 --2- 172.21.15.151:0/3290913751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599670 0x55c7555934b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005950 tx=0x7fdb7c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27134ced2bf22ee3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.851+0000 7fdb6d7fa700 1 -- 172.21.15.151:0/3290913751 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c010d20 con 0x55c755599670 2023-07-21T22:56:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.852+0000 7fdb6d7fa700 1 -- 172.21.15.151:0/3290913751 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb7c015070 con 0x55c755599670 2023-07-21T22:56:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.852+0000 7fdb6d7fa700 1 -- 172.21.15.151:0/3290913751 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c005020 con 0x55c755599670 2023-07-21T22:56:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.852+0000 7fdb6ffff700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb700a13c0 0x7fdb700a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.852+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3290913751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599670 msgr2=0x55c7555934b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.852+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3290913751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599670 0x55c7555934b0 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c005950 tx=0x7fdb7c00bf60 comp rx=0 tx=0).stop 2023-07-21T22:56:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.853+0000 7fdb6ffff700 1 -- 172.21.15.151:0/4876688 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdb780ce120 con 0x7fdb88067ee0 2023-07-21T22:56:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.853+0000 7fdb877fe700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb700a13c0 0x7fdb700a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.853+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3290913751 shutdown_connections 2023-07-21T22:56:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.853+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3290913751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 0x55c755598ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.853+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3290913751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599670 0x55c7555934b0 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.853+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3290913751 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 0x55c755592f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.853+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3290913751 >> 172.21.15.151:0/3290913751 conn(0x55c755577ae0 msgr2=0x55c75557d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:24.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.854+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3290913751 shutdown_connections 2023-07-21T22:56:24.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.854+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3290913751 wait complete. 2023-07-21T22:56:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.855+0000 7fdba0ef8b80 1 -- start start 2023-07-21T22:56:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.855+0000 7fdb877fe700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb700a13c0 0x7fdb700a3870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdb80007610 tx=0x7fdb80009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.855+0000 7fdba0ef8b80 1 Processor -- start 2023-07-21T22:56:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.856+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7553de6b0 0x55c75558a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.856+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 0x55c75558aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.856+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c755585850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.856+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c755473a60 con 0x55c755599220 2023-07-21T22:56:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.856+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c755473760 con 0x55c755599670 2023-07-21T22:56:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.856+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c7553578c0 con 0x55c7553de6b0 2023-07-21T22:56:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.856+0000 7fdba0ef8b80 10 client.0 _ll_register_callbacks cb 0x55c755471700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:56:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb877fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c755585850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb86ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7553de6b0 0x55c75558a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb877fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c755585850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36318/0 (socket says 172.21.15.151:36318) 2023-07-21T22:56:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb877fe700 1 -- 172.21.15.151:0/3927236083 learned_addr learned my addr 172.21.15.151:0/3927236083 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb867fc700 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 0x55c75558aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb877fe700 1 -- 172.21.15.151:0/3927236083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7553de6b0 msgr2=0x55c75558a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb877fe700 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7553de6b0 0x55c75558a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb877fe700 1 -- 172.21.15.151:0/3927236083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 msgr2=0x55c75558aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb877fe700 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 0x55c75558aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.857+0000 7fdb877fe700 1 -- 172.21.15.151:0/3927236083 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7c00b8e0 con 0x55c755599670 2023-07-21T22:56:24.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.858+0000 7fdb877fe700 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c755585850 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009100 tx=0x7fdb8000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f03591c4dc491 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.858+0000 7fdb6aff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:56:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.858+0000 7fdb6aff5700 1 -- 172.21.15.151:0/3927236083 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb80041070 con 0x55c755599670 2023-07-21T22:56:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.858+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3927236083 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c75542d490 con 0x55c755599670 2023-07-21T22:56:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.858+0000 7fdb6aff5700 1 -- 172.21.15.151:0/3927236083 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdb8003c2e0 con 0x55c755599670 2023-07-21T22:56:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.859+0000 7fdb6aff5700 1 -- 172.21.15.151:0/3927236083 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb80004bb0 con 0x55c755599670 2023-07-21T22:56:24.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.859+0000 7fdba0ef8b80 10 client.28913 fetch_fsmap learned FSMap version 109 2023-07-21T22:56:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.859+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3927236083 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55c7552eac00 con 0x55c755599670 2023-07-21T22:56:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.859+0000 7fdb6aff5700 1 -- 172.21.15.151:0/3927236083 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c75542d490 con 0x55c755599670 2023-07-21T22:56:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.859+0000 7fdb6aff5700 1 -- 172.21.15.151:0/3927236083 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdb8003a970 con 0x55c755599670 2023-07-21T22:56:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.859+0000 7fdba0ef8b80 10 client.28913 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:56:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.859+0000 7fdba0ef8b80 10 client.28913 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:56:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.859+0000 7fdba0ef8b80 20 client.28913 populate_metadata read hostname 'smithi151' 2023-07-21T22:56:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.860+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c75559be40 0x55c75559e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.860+0000 7fdba0ef8b80 4 client.28913 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:56:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.860+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3927236083 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c7554cce50 con 0x55c75559be40 2023-07-21T22:56:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.860+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c75559be40 0x55c75559e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.861+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c75559be40 0x55c75559e220 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9fb4e758bcafda17 server_cookie=f8d79e5bc460abfb in_seq=0 out_seq=0 2023-07-21T22:56:24.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.861+0000 7fdb6aff5700 10 client.28913 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.862+0000 7fdb6aff5700 1 -- 172.21.15.151:0/3927236083 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c7554cce50 con 0x55c75559be40 2023-07-21T22:56:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.862+0000 7fdb6aff5700 10 client.28913 handle_command_reply: tid=0 2023-07-21T22:56:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.862+0000 7fdba0ef8b80 1 client.28913 shutdown 2023-07-21T22:56:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.862+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3927236083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 msgr2=0x55c755585850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:24.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.862+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c755585850 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fdb80009100 tx=0x7fdb8000b040 comp rx=0 tx=0).stop 2023-07-21T22:56:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3927236083 shutdown_connections 2023-07-21T22:56:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c75559be40 0x55c75559e220 crc :-1 s=READY pgs=431 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c755585850 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c7553de6b0 0x55c75558a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/3927236083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 0x55c75558aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdb6aff5700 0 client.28913 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3927236083 >> 172.21.15.151:0/3927236083 conn(0x55c755577ae0 msgr2=0x55c75557c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:24.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3927236083 shutdown_connections 2023-07-21T22:56:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/3927236083 wait complete. 2023-07-21T22:56:24.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.863+0000 7fdba0ef8b80 20 client.28913 trim_cache size 0 max 16384 2023-07-21T22:56:24.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.893+0000 7fdba0ef8b80 1 Processor -- start 2023-07-21T22:56:24.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.894+0000 7fdba0ef8b80 1 -- start start 2023-07-21T22:56:24.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.895+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 0x55c7555920d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.895+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 0x55c755596920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.895+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599670 0x55c755582fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.895+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c755579c40 con 0x55c755599220 2023-07-21T22:56:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.895+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c755585e50 con 0x55c7553de6b0 2023-07-21T22:56:24.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.895+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c755598930 con 0x55c755599670 2023-07-21T22:56:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.895+0000 7fdb877fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599670 0x55c755582fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.895+0000 7fdb877fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599670 0x55c755582fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38504/0 (socket says 172.21.15.151:38504) 2023-07-21T22:56:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.895+0000 7fdb877fe700 1 -- 172.21.15.151:0/1688636568 learned_addr learned my addr 172.21.15.151:0/1688636568 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.896+0000 7fdb867fc700 1 --2- 172.21.15.151:0/1688636568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 0x55c755596920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.896+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/1688636568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 0x55c7555920d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.896+0000 7fdb867fc700 1 -- 172.21.15.151:0/1688636568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599670 msgr2=0x55c755582fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.896+0000 7fdb867fc700 1 --2- 172.21.15.151:0/1688636568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599670 0x55c755582fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.896+0000 7fdb867fc700 1 -- 172.21.15.151:0/1688636568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 msgr2=0x55c7555920d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.896+0000 7fdb867fc700 1 --2- 172.21.15.151:0/1688636568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 0x55c7555920d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.896+0000 7fdb867fc700 1 -- 172.21.15.151:0/1688636568 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c7553281f0 con 0x55c755599220 2023-07-21T22:56:24.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.898+0000 7fdb867fc700 1 --2- 172.21.15.151:0/1688636568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 0x55c755596920 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00b6c0 tx=0x7fdb7c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a20908d3779a24 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.898+0000 7fdb6dffb700 1 -- 172.21.15.151:0/1688636568 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c0050b0 con 0x55c755599220 2023-07-21T22:56:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.898+0000 7fdb6dffb700 1 -- 172.21.15.151:0/1688636568 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb7c021040 con 0x55c755599220 2023-07-21T22:56:24.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.898+0000 7fdb6dffb700 1 -- 172.21.15.151:0/1688636568 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb7c003cb0 con 0x55c755599220 2023-07-21T22:56:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.899+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/1688636568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 msgr2=0x55c755596920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.899+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/1688636568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 0x55c755596920 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fdb7c00b6c0 tx=0x7fdb7c00b630 comp rx=0 tx=0).stop 2023-07-21T22:56:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.900+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/1688636568 shutdown_connections 2023-07-21T22:56:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.900+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/1688636568 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c7553de6b0 0x55c7555920d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.900+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/1688636568 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599670 0x55c755582fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.900+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/1688636568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c755599220 0x55c755596920 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.900+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/1688636568 >> 172.21.15.151:0/1688636568 conn(0x55c755577ae0 msgr2=0x55c7555a2900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.900+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/1688636568 shutdown_connections 2023-07-21T22:56:24.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.900+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/1688636568 wait complete. 2023-07-21T22:56:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.901+0000 7fdba0ef8b80 1 -- start start 2023-07-21T22:56:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.901+0000 7fdba0ef8b80 1 Processor -- start 2023-07-21T22:56:24.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.902+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7553de6b0 0x55c75558eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.902+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 0x55c75558f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.902+0000 7fdba0ef8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c75558d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.902+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c75558d660 con 0x55c7553de6b0 2023-07-21T22:56:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.902+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c75558d7a0 con 0x55c755599670 2023-07-21T22:56:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.902+0000 7fdba0ef8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c75558d960 con 0x55c755599220 2023-07-21T22:56:24.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.902+0000 7fdba0ef8b80 10 client.0 _ll_register_callbacks cb 0x7fdb8003c840 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:56:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.903+0000 7fdb877fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c75558d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.903+0000 7fdb877fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c75558d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36334/0 (socket says 172.21.15.151:36334) 2023-07-21T22:56:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.903+0000 7fdb877fe700 1 -- 172.21.15.151:0/279007981 learned_addr learned my addr 172.21.15.151:0/279007981 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:24.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.903+0000 7fdb867fc700 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 0x55c75558f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.903+0000 7fdb877fe700 1 -- 172.21.15.151:0/279007981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 msgr2=0x55c75558f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.903+0000 7fdb877fe700 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 0x55c75558f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.903+0000 7fdb877fe700 1 -- 172.21.15.151:0/279007981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7553de6b0 msgr2=0x55c75558eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.903+0000 7fdb877fe700 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7553de6b0 0x55c75558eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.903+0000 7fdb877fe700 1 -- 172.21.15.151:0/279007981 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55c755301d80 con 0x55c755599670 2023-07-21T22:56:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.904+0000 7fdb877fe700 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c75558d090 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdb8003ad00 tx=0x7fdb8003c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5f2e2a7c233f254 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.904+0000 7fdb6aff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:56:24.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.904+0000 7fdb6aff5700 1 -- 172.21.15.151:0/279007981 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb80041040 con 0x55c755599670 2023-07-21T22:56:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.905+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/279007981 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb7c015070 con 0x55c755599670 2023-07-21T22:56:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.905+0000 7fdb6aff5700 1 -- 172.21.15.151:0/279007981 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdb80038d70 con 0x55c755599670 2023-07-21T22:56:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.905+0000 7fdb6aff5700 1 -- 172.21.15.151:0/279007981 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb8003aea0 con 0x55c755599670 2023-07-21T22:56:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.905+0000 7fdba0ef8b80 10 client.28919 fetch_fsmap learned FSMap version 109 2023-07-21T22:56:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.905+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/279007981 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55c755300250 con 0x55c755599670 2023-07-21T22:56:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.906+0000 7fdb6aff5700 1 -- 172.21.15.151:0/279007981 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb7c015070 con 0x55c755599670 2023-07-21T22:56:24.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.906+0000 7fdb6aff5700 1 -- 172.21.15.151:0/279007981 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdb80004020 con 0x55c755599670 2023-07-21T22:56:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.906+0000 7fdba0ef8b80 10 client.28919 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:56:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.906+0000 7fdba0ef8b80 10 client.28919 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:56:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.906+0000 7fdba0ef8b80 20 client.28919 populate_metadata read hostname 'smithi151' 2023-07-21T22:56:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.906+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7555f0cf0 0x55c7555f3100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:24.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.906+0000 7fdba0ef8b80 4 client.28919 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:56:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.906+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/279007981 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c75548eff0 con 0x55c7555f0cf0 2023-07-21T22:56:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.907+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7555f0cf0 0x55c7555f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.907+0000 7fdb86ffd700 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7555f0cf0 0x55c7555f3100 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7969d35a3fedd1e server_cookie=faf2d36bcc6534c4 in_seq=0 out_seq=0 2023-07-21T22:56:24.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.907+0000 7fdb6aff5700 10 client.28919 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:24.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdb6aff5700 1 -- 172.21.15.151:0/279007981 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c75548eff0 con 0x55c7555f0cf0 2023-07-21T22:56:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdb6aff5700 10 client.28919 handle_command_reply: tid=0 2023-07-21T22:56:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdba0ef8b80 1 client.28919 shutdown 2023-07-21T22:56:24.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/279007981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 msgr2=0x55c75558d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c75558d090 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fdb8003ad00 tx=0x7fdb8003c390 comp rx=0 tx=0).stop 2023-07-21T22:56:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/279007981 shutdown_connections 2023-07-21T22:56:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c7555f0cf0 0x55c7555f3100 crc :-1 s=READY pgs=432 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c755599670 0x55c75558d090 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c7553de6b0 0x55c75558eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.935+0000 7fdba0ef8b80 1 --2- 172.21.15.151:0/279007981 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c755599220 0x55c75558f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.936+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/279007981 >> 172.21.15.151:0/279007981 conn(0x55c755577ae0 msgr2=0x55c755596920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.936+0000 7fdb6aff5700 0 client.28919 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.936+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/279007981 shutdown_connections 2023-07-21T22:56:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.936+0000 7fdba0ef8b80 1 -- 172.21.15.151:0/279007981 wait complete. 2023-07-21T22:56:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.936+0000 7fdba0ef8b80 20 client.28919 trim_cache size 0 max 16384 2023-07-21T22:56:24.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:56:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:56:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:56:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:56:24.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb700a13c0 msgr2=0x7fdb700a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb700a13c0 0x7fdb700a3870 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fdb80007610 tx=0x7fdb80009040 comp rx=0 tx=0).stop 2023-07-21T22:56:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/4876688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88067ee0 msgr2=0x7fdb8819c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88067ee0 0x7fdb8819c270 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fdb78005740 tx=0x7fdb78005770 comp rx=0 tx=0).stop 2023-07-21T22:56:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/4876688 shutdown_connections 2023-07-21T22:56:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb700a13c0 0x7fdb700a3870 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb88067ee0 0x7fdb8819c270 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb88104a60 0x7fdb881a0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 --2- 172.21.15.151:0/4876688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb881024f0 0x7fdb8819c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/4876688 >> 172.21.15.151:0/4876688 conn(0x7fdb88074760 msgr2=0x7fdb881014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/4876688 shutdown_connections 2023-07-21T22:56:24.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:24.937+0000 7fdb8d5ff700 1 -- 172.21.15.151:0/4876688 wait complete. 2023-07-21T22:56:27.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:26 smithi187 ceph-mon[96918]: pgmap v1185: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 4.9 MiB/s wr, 378 op/s 2023-07-21T22:56:27.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:26 smithi195 ceph-mon[97365]: pgmap v1185: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 4.9 MiB/s wr, 378 op/s 2023-07-21T22:56:27.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:26 smithi151 ceph-mon[95510]: pgmap v1185: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 712 KiB/s rd, 4.9 MiB/s wr, 378 op/s 2023-07-21T22:56:29.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:28 smithi187 ceph-mon[96918]: pgmap v1186: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.1 MiB/s wr, 755 op/s 2023-07-21T22:56:29.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:28 smithi195 ceph-mon[97365]: pgmap v1186: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.1 MiB/s wr, 755 op/s 2023-07-21T22:56:29.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:28 smithi151 ceph-mon[95510]: pgmap v1186: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.1 MiB/s wr, 755 op/s 2023-07-21T22:56:29.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 215.0 s, 299.1 tps, lat 330.685 ms stddev 128.825 2023-07-21T22:56:31.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:30 smithi187 ceph-mon[96918]: pgmap v1187: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 6.6 MiB/s wr, 537 op/s 2023-07-21T22:56:31.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:30 smithi195 ceph-mon[97365]: pgmap v1187: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 6.6 MiB/s wr, 537 op/s 2023-07-21T22:56:31.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:30 smithi151 ceph-mon[95510]: pgmap v1187: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 6.6 MiB/s wr, 537 op/s 2023-07-21T22:56:33.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:32 smithi187 ceph-mon[96918]: pgmap v1188: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 6.6 MiB/s wr, 537 op/s 2023-07-21T22:56:33.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:32 smithi195 ceph-mon[97365]: pgmap v1188: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 6.6 MiB/s wr, 537 op/s 2023-07-21T22:56:33.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:32 smithi151 ceph-mon[95510]: pgmap v1188: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 813 KiB/s rd, 6.6 MiB/s wr, 537 op/s 2023-07-21T22:56:34.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 220.0 s, 372.9 tps, lat 261.480 ms stddev 64.742 2023-07-21T22:56:35.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:34 smithi187 ceph-mon[96918]: pgmap v1189: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 910 op/s 2023-07-21T22:56:35.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:34 smithi195 ceph-mon[97365]: pgmap v1189: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 910 op/s 2023-07-21T22:56:35.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:34 smithi151 ceph-mon[95510]: pgmap v1189: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 11 MiB/s wr, 910 op/s 2023-07-21T22:56:37.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:36 smithi187 ceph-mon[96918]: pgmap v1190: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 8.5 MiB/s wr, 743 op/s 2023-07-21T22:56:37.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:36 smithi195 ceph-mon[97365]: pgmap v1190: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 8.5 MiB/s wr, 743 op/s 2023-07-21T22:56:37.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:36 smithi151 ceph-mon[95510]: pgmap v1190: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 996 KiB/s rd, 8.5 MiB/s wr, 743 op/s 2023-07-21T22:56:38.244 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:37 smithi151 ceph-mon[95510]: pgmap v1191: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-21T22:56:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.213+0000 7f4b735ff700 1 -- 172.21.15.151:0/3691147374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b6c104a60 msgr2=0x7f4b6c0679a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.213+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3691147374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b6c104a60 0x7f4b6c0679a0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f4b680098f0 tx=0x7f4b68009c00 comp rx=0 tx=0).stop 2023-07-21T22:56:38.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.213+0000 7f4b735ff700 1 -- 172.21.15.151:0/3691147374 shutdown_connections 2023-07-21T22:56:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.213+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3691147374 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b6c1024f0 0x7f4b6c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.213+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3691147374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b6c104a60 0x7f4b6c0679a0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.213+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3691147374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c067ee0 0x7f4b6c068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.213+0000 7f4b735ff700 1 -- 172.21.15.151:0/3691147374 >> 172.21.15.151:0/3691147374 conn(0x7f4b6c074760 msgr2=0x7f4b6c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.213+0000 7f4b735ff700 1 -- 172.21.15.151:0/3691147374 shutdown_connections 2023-07-21T22:56:38.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.213+0000 7f4b735ff700 1 -- 172.21.15.151:0/3691147374 wait complete. 2023-07-21T22:56:38.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.215+0000 7f4b735ff700 1 Processor -- start 2023-07-21T22:56:38.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.218+0000 7f4b735ff700 1 -- start start 2023-07-21T22:56:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b735ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b6c067ee0 0x7f4b6c071a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b735ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b6c1024f0 0x7f4b6c071fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b735ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c104a60 0x7f4b6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b735ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c06b010 con 0x7f4b6c1024f0 2023-07-21T22:56:38.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b735ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c06b180 con 0x7f4b6c104a60 2023-07-21T22:56:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b735ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c06b340 con 0x7f4b6c067ee0 2023-07-21T22:56:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b7139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b6c067ee0 0x7f4b6c071a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b7139b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b6c067ee0 0x7f4b6c071a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45112/0 (socket says 172.21.15.151:45112) 2023-07-21T22:56:38.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b7139b700 1 -- 172.21.15.151:0/3818654405 learned_addr learned my addr 172.21.15.151:0/3818654405 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b71b9c700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c104a60 0x7f4b6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b7139b700 1 -- 172.21.15.151:0/3818654405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c104a60 msgr2=0x7f4b6c06a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:38.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b7139b700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c104a60 0x7f4b6c06a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b7139b700 1 -- 172.21.15.151:0/3818654405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b6c1024f0 msgr2=0x7f4b6c071fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:38.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b7139b700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b6c1024f0 0x7f4b6c071fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b7139b700 1 -- 172.21.15.151:0/3818654405 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b68009520 con 0x7f4b6c067ee0 2023-07-21T22:56:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.220+0000 7f4b7139b700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b6c067ee0 0x7f4b6c071a40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4b68009230 tx=0x7f4b6800bbb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.221+0000 7f4b627fc700 1 -- 172.21.15.151:0/3818654405 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68005520 con 0x7f4b6c067ee0 2023-07-21T22:56:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.221+0000 7f4b627fc700 1 -- 172.21.15.151:0/3818654405 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b68005680 con 0x7f4b6c067ee0 2023-07-21T22:56:38.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.221+0000 7f4b627fc700 1 -- 172.21.15.151:0/3818654405 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b680178c0 con 0x7f4b6c067ee0 2023-07-21T22:56:38.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.221+0000 7f4b735ff700 1 -- 172.21.15.151:0/3818654405 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c06b5c0 con 0x7f4b6c067ee0 2023-07-21T22:56:38.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.221+0000 7f4b735ff700 1 -- 172.21.15.151:0/3818654405 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c06f7b0 con 0x7f4b6c067ee0 2023-07-21T22:56:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.227+0000 7f4b627fc700 1 -- 172.21.15.151:0/3818654405 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4b68003680 con 0x7f4b6c067ee0 2023-07-21T22:56:38.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.227+0000 7f4b86e32b80 1 Processor -- start 2023-07-21T22:56:38.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.228+0000 7f4b86e32b80 1 -- start start 2023-07-21T22:56:38.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.228+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b4626b0 0x55713b60bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.228+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b60c210 0x55713b605f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.228+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c660 0x55713b6064a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.228+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b50bc50 con 0x55713b4626b0 2023-07-21T22:56:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.228+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b55e9e0 con 0x55713b60c210 2023-07-21T22:56:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.228+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b557e70 con 0x55713b60c660 2023-07-21T22:56:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b70b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c660 0x55713b6064a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b70b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c660 0x55713b6064a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45122/0 (socket says 172.21.15.151:45122) 2023-07-21T22:56:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b70b9a700 1 -- 172.21.15.151:0/2946871163 learned_addr learned my addr 172.21.15.151:0/2946871163 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b71b9c700 1 --2- 172.21.15.151:0/2946871163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b4626b0 0x55713b60bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b7139b700 1 --2- 172.21.15.151:0/2946871163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b60c210 0x55713b605f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b70b9a700 1 -- 172.21.15.151:0/2946871163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b60c210 msgr2=0x55713b605f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:38.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b70b9a700 1 --2- 172.21.15.151:0/2946871163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b60c210 0x55713b605f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b70b9a700 1 -- 172.21.15.151:0/2946871163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b4626b0 msgr2=0x55713b60bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b70b9a700 1 --2- 172.21.15.151:0/2946871163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b4626b0 0x55713b60bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.229+0000 7f4b70b9a700 1 -- 172.21.15.151:0/2946871163 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55713b385d80 con 0x55713b60c660 2023-07-21T22:56:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.230+0000 7f4b70b9a700 1 --2- 172.21.15.151:0/2946871163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c660 0x55713b6064a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0046e0 tx=0x7f4b5c009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=349d275ca0926f81 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:38.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.230+0000 7f4b577fe700 1 -- 172.21.15.151:0/2946871163 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00eb60 con 0x55713b60c660 2023-07-21T22:56:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.230+0000 7f4b577fe700 1 -- 172.21.15.151:0/2946871163 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b5c004cc0 con 0x55713b60c660 2023-07-21T22:56:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.230+0000 7f4b577fe700 1 -- 172.21.15.151:0/2946871163 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0055c0 con 0x55713b60c660 2023-07-21T22:56:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.231+0000 7f4b627fc700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b580a1380 0x7f4b580a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.231+0000 7f4b627fc700 1 -- 172.21.15.151:0/3818654405 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4b680cdf80 con 0x7f4b6c067ee0 2023-07-21T22:56:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.231+0000 7f4b86e32b80 1 -- 172.21.15.151:0/2946871163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c660 msgr2=0x55713b6064a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:38.270 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.231+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/2946871163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c660 0x55713b6064a0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c0046e0 tx=0x7f4b5c009ea0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.231+0000 7f4b71b9c700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b580a1380 0x7f4b580a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.232+0000 7f4b86e32b80 1 -- 172.21.15.151:0/2946871163 shutdown_connections 2023-07-21T22:56:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.232+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/2946871163 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c660 0x55713b6064a0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.232+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/2946871163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b4626b0 0x55713b60bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.232+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/2946871163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b60c210 0x55713b605f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.232+0000 7f4b86e32b80 1 -- 172.21.15.151:0/2946871163 >> 172.21.15.151:0/2946871163 conn(0x55713b5fbae0 msgr2=0x55713b6010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.232+0000 7f4b71b9c700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b580a1380 0x7f4b580a3830 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c072710 tx=0x7f4b64009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:38.271 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.233+0000 7f4b86e32b80 1 -- 172.21.15.151:0/2946871163 shutdown_connections 2023-07-21T22:56:38.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.233+0000 7f4b86e32b80 1 -- 172.21.15.151:0/2946871163 wait complete. 2023-07-21T22:56:38.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.233+0000 7f4b86e32b80 1 -- start start 2023-07-21T22:56:38.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.234+0000 7f4b86e32b80 1 Processor -- start 2023-07-21T22:56:38.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 0x55713b60f880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b60fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b60c660 0x55713b610300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b4f7a60 con 0x55713b60c660 2023-07-21T22:56:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b4f7760 con 0x55713b4626b0 2023-07-21T22:56:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b3db8c0 con 0x55713b60c210 2023-07-21T22:56:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b86e32b80 10 client.0 _ll_register_callbacks cb 0x55713b4f5700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:56:38.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b70b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b60fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b70b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b60fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45132/0 (socket says 172.21.15.151:45132) 2023-07-21T22:56:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.235+0000 7f4b70b9a700 1 -- 172.21.15.151:0/588858788 learned_addr learned my addr 172.21.15.151:0/588858788 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.236+0000 7f4b70b9a700 1 -- 172.21.15.151:0/588858788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 msgr2=0x55713b60f880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:56:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.236+0000 7f4b70b9a700 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 0x55713b60f880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.236+0000 7f4b70b9a700 1 -- 172.21.15.151:0/588858788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b60c660 msgr2=0x55713b610300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.236+0000 7f4b70b9a700 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b60c660 0x55713b610300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.236+0000 7f4b70b9a700 1 -- 172.21.15.151:0/588858788 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c0098a0 con 0x55713b60c210 2023-07-21T22:56:38.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.236+0000 7f4b70b9a700 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b60fdc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009570 tx=0x7f4b5c00ec40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=200291f3116e2d60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.236+0000 7f4b54ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:56:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.237+0000 7f4b54ff9700 1 -- 172.21.15.151:0/588858788 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c004ea0 con 0x55713b60c210 2023-07-21T22:56:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.237+0000 7f4b54ff9700 1 -- 172.21.15.151:0/588858788 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4b5c014070 con 0x55713b60c210 2023-07-21T22:56:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.237+0000 7f4b86e32b80 1 -- 172.21.15.151:0/588858788 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55713b4b1490 con 0x55713b60c210 2023-07-21T22:56:38.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.237+0000 7f4b54ff9700 1 -- 172.21.15.151:0/588858788 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b5c00ee60 con 0x55713b60c210 2023-07-21T22:56:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.237+0000 7f4b86e32b80 10 client.28945 fetch_fsmap learned FSMap version 109 2023-07-21T22:56:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.237+0000 7f4b86e32b80 1 -- 172.21.15.151:0/588858788 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55713b36ec00 con 0x55713b60c210 2023-07-21T22:56:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.238+0000 7f4b54ff9700 1 -- 172.21.15.151:0/588858788 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55713b4b1490 con 0x55713b60c210 2023-07-21T22:56:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.238+0000 7f4b54ff9700 1 -- 172.21.15.151:0/588858788 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4b5c018b00 con 0x55713b60c210 2023-07-21T22:56:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.238+0000 7f4b86e32b80 10 client.28945 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:56:38.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.238+0000 7f4b86e32b80 10 client.28945 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:56:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.238+0000 7f4b86e32b80 20 client.28945 populate_metadata read hostname 'smithi151' 2023-07-21T22:56:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.238+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55713b61fab0 0x55713b621ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.238+0000 7f4b86e32b80 4 client.28945 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:56:38.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.238+0000 7f4b86e32b80 1 -- 172.21.15.151:0/588858788 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55713b550e50 con 0x55713b61fab0 2023-07-21T22:56:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.240+0000 7f4b7139b700 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55713b61fab0 0x55713b621ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.241+0000 7f4b54ff9700 10 client.28945 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.241+0000 7f4b7139b700 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55713b61fab0 0x55713b621ee0 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa8445e71a057e86 server_cookie=c43124305bbc5f9b in_seq=0 out_seq=0 2023-07-21T22:56:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.242+0000 7f4b54ff9700 1 -- 172.21.15.151:0/588858788 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55713b550e50 con 0x55713b61fab0 2023-07-21T22:56:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.242+0000 7f4b54ff9700 10 client.28945 handle_command_reply: tid=0 2023-07-21T22:56:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.242+0000 7f4b86e32b80 1 client.28945 shutdown 2023-07-21T22:56:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 -- 172.21.15.151:0/588858788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 msgr2=0x55713b60fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:38.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b60fdc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c009570 tx=0x7f4b5c00ec40 comp rx=0 tx=0).stop 2023-07-21T22:56:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 -- 172.21.15.151:0/588858788 shutdown_connections 2023-07-21T22:56:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55713b61fab0 0x55713b621ee0 crc :-1 s=READY pgs=433 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 0x55713b60f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b60c660 0x55713b610300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/588858788 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b60fdc0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 -- 172.21.15.151:0/588858788 >> 172.21.15.151:0/588858788 conn(0x55713b5fbae0 msgr2=0x55713b6003e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b54ff9700 0 client.28945 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 -- 172.21.15.151:0/588858788 shutdown_connections 2023-07-21T22:56:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.243+0000 7f4b86e32b80 1 -- 172.21.15.151:0/588858788 wait complete. 2023-07-21T22:56:38.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.244+0000 7f4b86e32b80 20 client.28945 trim_cache size 0 max 16384 2023-07-21T22:56:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.270+0000 7f4b86e32b80 1 Processor -- start 2023-07-21T22:56:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.271+0000 7f4b86e32b80 1 -- start start 2023-07-21T22:56:38.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.271+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b5fbae0 0x55713b605f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.271+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 0x55713b616c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.271+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b610130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.271+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b601cb0 con 0x55713b5fbae0 2023-07-21T22:56:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.271+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b612930 con 0x55713b4626b0 2023-07-21T22:56:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.271+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b606480 con 0x55713b60c210 2023-07-21T22:56:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b70b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 0x55713b616c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b71b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b610130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b70b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 0x55713b616c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46654/0 (socket says 172.21.15.151:46654) 2023-07-21T22:56:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b71b9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b610130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:45148/0 (socket says 172.21.15.151:45148) 2023-07-21T22:56:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b70b9a700 1 -- 172.21.15.151:0/1407981032 learned_addr learned my addr 172.21.15.151:0/1407981032 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b7139b700 1 --2- 172.21.15.151:0/1407981032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b5fbae0 0x55713b605f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b71b9c700 1 -- 172.21.15.151:0/1407981032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 msgr2=0x55713b616c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b71b9c700 1 --2- 172.21.15.151:0/1407981032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 0x55713b616c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b71b9c700 1 -- 172.21.15.151:0/1407981032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b5fbae0 msgr2=0x55713b605f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:38.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b71b9c700 1 --2- 172.21.15.151:0/1407981032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b5fbae0 0x55713b605f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b71b9c700 1 -- 172.21.15.151:0/1407981032 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55713b3ac1f0 con 0x55713b60c210 2023-07-21T22:56:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.272+0000 7f4b7139b700 1 --2- 172.21.15.151:0/1407981032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b5fbae0 0x55713b605f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:56:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.273+0000 7f4b71b9c700 1 --2- 172.21.15.151:0/1407981032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b610130 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4b6401a7f0 tx=0x7f4b64004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=636af4c0f82b3103 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:38.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.274+0000 7f4b57fff700 1 -- 172.21.15.151:0/1407981032 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6401f070 con 0x55713b60c210 2023-07-21T22:56:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.274+0000 7f4b57fff700 1 -- 172.21.15.151:0/1407981032 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b6400f040 con 0x55713b60c210 2023-07-21T22:56:38.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.274+0000 7f4b57fff700 1 -- 172.21.15.151:0/1407981032 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b64004020 con 0x55713b60c210 2023-07-21T22:56:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.276+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1407981032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 msgr2=0x55713b610130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.276+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1407981032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b610130 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f4b6401a7f0 tx=0x7f4b64004b40 comp rx=0 tx=0).stop 2023-07-21T22:56:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.276+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1407981032 shutdown_connections 2023-07-21T22:56:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.276+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1407981032 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b60c210 0x55713b610130 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.276+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1407981032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b5fbae0 0x55713b605f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.276+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1407981032 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b4626b0 0x55713b616c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.276+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1407981032 >> 172.21.15.151:0/1407981032 conn(0x55713b61b740 msgr2=0x55713b60d300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.277+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1407981032 shutdown_connections 2023-07-21T22:56:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.278+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1407981032 wait complete. 2023-07-21T22:56:38.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.278+0000 7f4b86e32b80 1 -- start start 2023-07-21T22:56:38.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.278+0000 7f4b86e32b80 1 Processor -- start 2023-07-21T22:56:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b4626b0 0x55713b616c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b5fbae0 0x55713b607890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b86e32b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b60c210 0x55713b607dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b608360 con 0x55713b60c210 2023-07-21T22:56:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b6084d0 con 0x55713b5fbae0 2023-07-21T22:56:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b86e32b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b608690 con 0x55713b4626b0 2023-07-21T22:56:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b86e32b80 10 client.0 _ll_register_callbacks cb 0x7f4b5c009ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:56:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b70b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b5fbae0 0x55713b607890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b70b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b5fbae0 0x55713b607890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46658/0 (socket says 172.21.15.151:46658) 2023-07-21T22:56:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.281+0000 7f4b70b9a700 1 -- 172.21.15.151:0/1654046313 learned_addr learned my addr 172.21.15.151:0/1654046313 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.282+0000 7f4b70b9a700 1 -- 172.21.15.151:0/1654046313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b4626b0 msgr2=0x55713b616c40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:56:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.282+0000 7f4b70b9a700 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b4626b0 0x55713b616c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.282+0000 7f4b70b9a700 1 -- 172.21.15.151:0/1654046313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b60c210 msgr2=0x55713b607dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:56:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.282+0000 7f4b70b9a700 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b60c210 0x55713b607dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.282+0000 7f4b70b9a700 1 -- 172.21.15.151:0/1654046313 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6401a4d0 con 0x55713b5fbae0 2023-07-21T22:56:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.283+0000 7f4b70b9a700 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b5fbae0 0x55713b607890 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c018e60 tx=0x7f4b5c009290 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97e860cad2b6430b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.283+0000 7f4b54ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:56:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.284+0000 7f4b54ff9700 1 -- 172.21.15.151:0/1654046313 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c02ae00 con 0x55713b5fbae0 2023-07-21T22:56:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.284+0000 7f4b54ff9700 1 -- 172.21.15.151:0/1654046313 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4b5c000e40 con 0x55713b5fbae0 2023-07-21T22:56:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.284+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1654046313 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b5c004cc0 con 0x55713b5fbae0 2023-07-21T22:56:38.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.284+0000 7f4b54ff9700 1 -- 172.21.15.151:0/1654046313 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b5c005da0 con 0x55713b5fbae0 2023-07-21T22:56:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.284+0000 7f4b86e32b80 10 client.28934 fetch_fsmap learned FSMap version 109 2023-07-21T22:56:38.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.284+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1654046313 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55713b384250 con 0x55713b5fbae0 2023-07-21T22:56:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.285+0000 7f4b54ff9700 1 -- 172.21.15.151:0/1654046313 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b5c004cc0 con 0x55713b5fbae0 2023-07-21T22:56:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.285+0000 7f4b54ff9700 1 -- 172.21.15.151:0/1654046313 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4b5c004140 con 0x55713b5fbae0 2023-07-21T22:56:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.285+0000 7f4b86e32b80 10 client.28934 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:56:38.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.285+0000 7f4b86e32b80 10 client.28934 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:56:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.285+0000 7f4b86e32b80 20 client.28934 populate_metadata read hostname 'smithi151' 2023-07-21T22:56:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.285+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55713b60c660 0x55713b676b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.285+0000 7f4b86e32b80 4 client.28934 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:56:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.285+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1654046313 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55713b512ff0 con 0x55713b60c660 2023-07-21T22:56:38.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.286+0000 7f4b7139b700 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55713b60c660 0x55713b676b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.287+0000 7f4b7139b700 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55713b60c660 0x55713b676b90 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a0fc80463ea3988e server_cookie=281caf4545fba563 in_seq=0 out_seq=0 2023-07-21T22:56:38.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.287+0000 7f4b54ff9700 10 client.28934 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:38.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.308+0000 7f4b54ff9700 1 -- 172.21.15.151:0/1654046313 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55713b512ff0 con 0x55713b60c660 2023-07-21T22:56:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.308+0000 7f4b54ff9700 10 client.28934 handle_command_reply: tid=0 2023-07-21T22:56:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.308+0000 7f4b86e32b80 1 client.28934 shutdown 2023-07-21T22:56:38.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1654046313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b5fbae0 msgr2=0x55713b607890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b5fbae0 0x55713b607890 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c018e60 tx=0x7f4b5c009290 comp rx=0 tx=0).stop 2023-07-21T22:56:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1654046313 shutdown_connections 2023-07-21T22:56:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55713b60c660 0x55713b676b90 crc :-1 s=READY pgs=434 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55713b60c210 0x55713b607dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55713b4626b0 0x55713b616c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b86e32b80 1 --2- 172.21.15.151:0/1654046313 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55713b5fbae0 0x55713b607890 secure :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c018e60 tx=0x7f4b5c009290 comp rx=0 tx=0).stop 2023-07-21T22:56:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b54ff9700 0 client.28934 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:38.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1654046313 >> 172.21.15.151:0/1654046313 conn(0x55713b61b740 msgr2=0x55713b60ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.309+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1654046313 shutdown_connections 2023-07-21T22:56:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.310+0000 7f4b86e32b80 1 -- 172.21.15.151:0/1654046313 wait complete. 2023-07-21T22:56:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.310+0000 7f4b86e32b80 20 client.28934 trim_cache size 0 max 16384 2023-07-21T22:56:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:56:38.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:56:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:56:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:56:38.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 -- 172.21.15.151:0/3818654405 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b580a1380 msgr2=0x7f4b580a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b580a1380 0x7f4b580a3830 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c072710 tx=0x7f4b64009040 comp rx=0 tx=0).stop 2023-07-21T22:56:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 -- 172.21.15.151:0/3818654405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b6c067ee0 msgr2=0x7f4b6c071a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b6c067ee0 0x7f4b6c071a40 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f4b68009230 tx=0x7f4b6800bbb0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 -- 172.21.15.151:0/3818654405 shutdown_connections 2023-07-21T22:56:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b580a1380 0x7f4b580a3830 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c104a60 0x7f4b6c06a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b6c067ee0 0x7f4b6c071a40 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 --2- 172.21.15.151:0/3818654405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b6c1024f0 0x7f4b6c071fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 -- 172.21.15.151:0/3818654405 >> 172.21.15.151:0/3818654405 conn(0x7f4b6c074760 msgr2=0x7f4b6c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 -- 172.21.15.151:0/3818654405 shutdown_connections 2023-07-21T22:56:38.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:38.312+0000 7f4b735ff700 1 -- 172.21.15.151:0/3818654405 wait complete. 2023-07-21T22:56:38.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:37 smithi187 ceph-mon[96918]: pgmap v1191: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-21T22:56:38.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:37 smithi195 ceph-mon[97365]: pgmap v1191: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-21T22:56:39.293 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 225.0 s, 381.0 tps, lat 268.872 ms stddev 109.313 2023-07-21T22:56:41.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:40 smithi187 ceph-mon[96918]: pgmap v1192: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.2 MiB/s wr, 750 op/s 2023-07-21T22:56:41.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:40 smithi195 ceph-mon[97365]: pgmap v1192: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.2 MiB/s wr, 750 op/s 2023-07-21T22:56:41.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:40 smithi151 ceph-mon[95510]: pgmap v1192: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.2 MiB/s wr, 750 op/s 2023-07-21T22:56:43.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:42 smithi187 ceph-mon[96918]: pgmap v1193: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.2 MiB/s wr, 750 op/s 2023-07-21T22:56:43.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:42 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:56:43.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:42 smithi195 ceph-mon[97365]: pgmap v1193: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.2 MiB/s wr, 750 op/s 2023-07-21T22:56:43.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:42 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:56:43.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:42 smithi151 ceph-mon[95510]: pgmap v1193: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 9.2 MiB/s wr, 750 op/s 2023-07-21T22:56:43.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:42 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:56:44.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:43 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:56:44.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:43 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:56:44.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:43 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:56:44.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:43 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:56:44.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:43 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:56:44.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:43 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:56:44.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:43 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:56:44.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:43 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:56:44.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:43 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:56:44.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 230.0 s, 369.3 tps, lat 269.242 ms stddev 70.572 2023-07-21T22:56:45.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:44 smithi187 ceph-mon[96918]: pgmap v1194: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 14 MiB/s wr, 1.14k op/s 2023-07-21T22:56:45.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:44 smithi195 ceph-mon[97365]: pgmap v1194: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 14 MiB/s wr, 1.14k op/s 2023-07-21T22:56:45.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:44 smithi151 ceph-mon[95510]: pgmap v1194: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 14 MiB/s wr, 1.14k op/s 2023-07-21T22:56:46.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:45 smithi151 ceph-mon[95510]: pgmap v1195: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 9.4 MiB/s wr, 762 op/s 2023-07-21T22:56:46.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:45 smithi187 ceph-mon[96918]: pgmap v1195: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 9.4 MiB/s wr, 762 op/s 2023-07-21T22:56:46.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:45 smithi195 ceph-mon[97365]: pgmap v1195: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 9.4 MiB/s wr, 762 op/s 2023-07-21T22:56:49.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:48 smithi187 ceph-mon[96918]: pgmap v1196: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-07-21T22:56:49.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:48 smithi195 ceph-mon[97365]: pgmap v1196: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-07-21T22:56:49.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:48 smithi151 ceph-mon[95510]: pgmap v1196: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-07-21T22:56:49.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 235.0 s, 372.2 tps, lat 262.681 ms stddev 58.440 2023-07-21T22:56:51.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:50 smithi187 ceph-mon[96918]: pgmap v1197: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 9.3 MiB/s wr, 800 op/s 2023-07-21T22:56:51.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:50 smithi195 ceph-mon[97365]: pgmap v1197: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 9.3 MiB/s wr, 800 op/s 2023-07-21T22:56:51.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:50 smithi151 ceph-mon[95510]: pgmap v1197: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 9.3 MiB/s wr, 800 op/s 2023-07-21T22:56:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.548+0000 7f663f5ff700 1 -- 172.21.15.151:0/1258434558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66381024f0 msgr2=0x7f6638102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:51.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.548+0000 7f663f5ff700 1 --2- 172.21.15.151:0/1258434558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66381024f0 0x7f6638102940 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f6630009f90 tx=0x7f663000b330 comp rx=0 tx=0).stop 2023-07-21T22:56:51.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.548+0000 7f663f5ff700 1 -- 172.21.15.151:0/1258434558 shutdown_connections 2023-07-21T22:56:51.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.548+0000 7f663f5ff700 1 --2- 172.21.15.151:0/1258434558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66381024f0 0x7f6638102940 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.548+0000 7f663f5ff700 1 --2- 172.21.15.151:0/1258434558 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6638104a60 0x7f66380679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.548+0000 7f663f5ff700 1 --2- 172.21.15.151:0/1258434558 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6638067ee0 0x7f6638068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.548+0000 7f663f5ff700 1 -- 172.21.15.151:0/1258434558 >> 172.21.15.151:0/1258434558 conn(0x7f6638074760 msgr2=0x7f6638074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.548+0000 7f663f5ff700 1 -- 172.21.15.151:0/1258434558 shutdown_connections 2023-07-21T22:56:51.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.548+0000 7f663f5ff700 1 -- 172.21.15.151:0/1258434558 wait complete. 2023-07-21T22:56:51.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.550+0000 7f663f5ff700 1 Processor -- start 2023-07-21T22:56:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.550+0000 7f663f5ff700 1 -- start start 2023-07-21T22:56:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.550+0000 7f663f5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6638067ee0 0x7f663819c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.550+0000 7f663f5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66381024f0 0x7f663819c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663f5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6638104a60 0x7f66381a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663f5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381a14a0 con 0x7f6638067ee0 2023-07-21T22:56:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663f5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381a1610 con 0x7f6638104a60 2023-07-21T22:56:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663f5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66381a17d0 con 0x7f66381024f0 2023-07-21T22:56:51.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6638067ee0 0x7f663819c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663db9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6638104a60 0x7f66381a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663d39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6638067ee0 0x7f663819c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34928/0 (socket says 172.21.15.151:34928) 2023-07-21T22:56:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663d39b700 1 -- 172.21.15.151:0/745811807 learned_addr learned my addr 172.21.15.151:0/745811807 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663cb9a700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66381024f0 0x7f663819c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663d39b700 1 -- 172.21.15.151:0/745811807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66381024f0 msgr2=0x7f663819c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663d39b700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66381024f0 0x7f663819c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663d39b700 1 -- 172.21.15.151:0/745811807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6638104a60 msgr2=0x7f66381a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663d39b700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6638104a60 0x7f66381a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.551+0000 7f663d39b700 1 -- 172.21.15.151:0/745811807 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66340095f0 con 0x7f6638067ee0 2023-07-21T22:56:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.552+0000 7f663d39b700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6638067ee0 0x7f663819c2b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f663400ec10 tx=0x7f663400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.552+0000 7f662e7fc700 1 -- 172.21.15.151:0/745811807 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663400cc90 con 0x7f6638067ee0 2023-07-21T22:56:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.552+0000 7f662e7fc700 1 -- 172.21.15.151:0/745811807 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f663400cdf0 con 0x7f6638067ee0 2023-07-21T22:56:51.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.552+0000 7f662e7fc700 1 -- 172.21.15.151:0/745811807 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6634003e80 con 0x7f6638067ee0 2023-07-21T22:56:51.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.552+0000 7f663f5ff700 1 -- 172.21.15.151:0/745811807 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6630009c40 con 0x7f6638067ee0 2023-07-21T22:56:51.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.552+0000 7f663f5ff700 1 -- 172.21.15.151:0/745811807 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66381a9110 con 0x7f6638067ee0 2023-07-21T22:56:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.557+0000 7f662e7fc700 1 -- 172.21.15.151:0/745811807 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6634004000 con 0x7f6638067ee0 2023-07-21T22:56:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.558+0000 7f6652f01b80 1 Processor -- start 2023-07-21T22:56:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.558+0000 7f6652f01b80 1 -- start start 2023-07-21T22:56:51.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.559+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026bda6b0 0x55c026d83cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.559+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84210 0x55c026d7df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.559+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 0x55c026d7e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.559+0000 7f6652f01b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026c83c50 con 0x55c026bda6b0 2023-07-21T22:56:51.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.559+0000 7f6652f01b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026cd69e0 con 0x55c026d84210 2023-07-21T22:56:51.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.559+0000 7f6652f01b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026ccfe70 con 0x55c026d84660 2023-07-21T22:56:51.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.559+0000 7f663db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026bda6b0 0x55c026d83cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.559+0000 7f663db9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026bda6b0 0x55c026d83cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34938/0 (socket says 172.21.15.151:34938) 2023-07-21T22:56:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.559+0000 7f663db9c700 1 -- 172.21.15.151:0/2800831221 learned_addr learned my addr 172.21.15.151:0/2800831221 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.560+0000 7f663d39b700 1 --2- 172.21.15.151:0/2800831221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84210 0x55c026d7df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.560+0000 7f663cb9a700 1 --2- 172.21.15.151:0/2800831221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 0x55c026d7e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.560+0000 7f663db9c700 1 -- 172.21.15.151:0/2800831221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 msgr2=0x55c026d7e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:51.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.560+0000 7f663db9c700 1 --2- 172.21.15.151:0/2800831221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 0x55c026d7e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.560+0000 7f663db9c700 1 -- 172.21.15.151:0/2800831221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84210 msgr2=0x55c026d7df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.560+0000 7f663db9c700 1 --2- 172.21.15.151:0/2800831221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84210 0x55c026d7df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.560+0000 7f663db9c700 1 -- 172.21.15.151:0/2800831221 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c026afdd80 con 0x55c026bda6b0 2023-07-21T22:56:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.560+0000 7f662e7fc700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f66240a13c0 0x7f66240a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.561+0000 7f663db9c700 1 --2- 172.21.15.151:0/2800831221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026bda6b0 0x55c026d83cd0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f66300093e0 tx=0x7f6630009410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd9b2584330f7c13 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.561+0000 7f662e7fc700 1 -- 172.21.15.151:0/745811807 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6634014070 con 0x7f6638067ee0 2023-07-21T22:56:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.561+0000 7f663d39b700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f66240a13c0 0x7f66240a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.562+0000 7f66237fe700 1 -- 172.21.15.151:0/2800831221 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000e040 con 0x55c026bda6b0 2023-07-21T22:56:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.562+0000 7f66237fe700 1 -- 172.21.15.151:0/2800831221 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6630007720 con 0x55c026bda6b0 2023-07-21T22:56:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.562+0000 7f66237fe700 1 -- 172.21.15.151:0/2800831221 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000bc50 con 0x55c026bda6b0 2023-07-21T22:56:51.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.563+0000 7f6652f01b80 1 -- 172.21.15.151:0/2800831221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026bda6b0 msgr2=0x55c026d83cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:51.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.563+0000 7f6652f01b80 1 --2- 172.21.15.151:0/2800831221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026bda6b0 0x55c026d83cd0 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7f66300093e0 tx=0x7f6630009410 comp rx=0 tx=0).stop 2023-07-21T22:56:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.563+0000 7f663d39b700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f66240a13c0 0x7f66240a3870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f66340a2030 tx=0x7f6634000bc0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.563+0000 7f6652f01b80 1 -- 172.21.15.151:0/2800831221 shutdown_connections 2023-07-21T22:56:51.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.563+0000 7f6652f01b80 1 --2- 172.21.15.151:0/2800831221 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 0x55c026d7e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.564+0000 7f6652f01b80 1 --2- 172.21.15.151:0/2800831221 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026bda6b0 0x55c026d83cd0 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.564+0000 7f6652f01b80 1 --2- 172.21.15.151:0/2800831221 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84210 0x55c026d7df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.564+0000 7f6652f01b80 1 -- 172.21.15.151:0/2800831221 >> 172.21.15.151:0/2800831221 conn(0x55c026d73ae0 msgr2=0x55c026d790e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.564+0000 7f6652f01b80 1 -- 172.21.15.151:0/2800831221 shutdown_connections 2023-07-21T22:56:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.564+0000 7f6652f01b80 1 -- 172.21.15.151:0/2800831221 wait complete. 2023-07-21T22:56:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.565+0000 7f6652f01b80 1 -- start start 2023-07-21T22:56:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.565+0000 7f6652f01b80 1 Processor -- start 2023-07-21T22:56:51.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d8d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84210 0x55c026d8dae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84660 0x55c026d878a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f6652f01b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026c6fa60 con 0x55c026d84660 2023-07-21T22:56:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f6652f01b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026c6f760 con 0x55c026bda6b0 2023-07-21T22:56:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f6652f01b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026b538c0 con 0x55c026d84210 2023-07-21T22:56:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f6652f01b80 10 client.0 _ll_register_callbacks cb 0x55c026c6d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:56:51.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f663cb9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84210 0x55c026d8dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f663cb9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84210 0x55c026d8dae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58390/0 (socket says 172.21.15.151:58390) 2023-07-21T22:56:51.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f663cb9a700 1 -- 172.21.15.151:0/4012307035 learned_addr learned my addr 172.21.15.151:0/4012307035 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:51.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f663db9c700 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d8d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.566+0000 7f663db9c700 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84660 0x55c026d878a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.567+0000 7f663cb9a700 1 -- 172.21.15.151:0/4012307035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 msgr2=0x55c026d8d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.567+0000 7f663cb9a700 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d8d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.567+0000 7f663cb9a700 1 -- 172.21.15.151:0/4012307035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84660 msgr2=0x55c026d878a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.567+0000 7f663cb9a700 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84660 0x55c026d878a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.567+0000 7f663cb9a700 1 -- 172.21.15.151:0/4012307035 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6638113930 con 0x55c026d84210 2023-07-21T22:56:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.567+0000 7f663db9c700 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d8d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:56:51.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.567+0000 7f663cb9a700 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84210 0x55c026d8dae0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f662800b940 tx=0x7f662800bc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=33ecfbee476c9701 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:51.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.567+0000 7f6620ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:56:51.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.568+0000 7f6620ff9700 1 -- 172.21.15.151:0/4012307035 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628016070 con 0x55c026d84210 2023-07-21T22:56:51.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.568+0000 7f6620ff9700 1 -- 172.21.15.151:0/4012307035 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6628003b10 con 0x55c026d84210 2023-07-21T22:56:51.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.568+0000 7f6652f01b80 1 -- 172.21.15.151:0/4012307035 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55c026c29490 con 0x55c026d84210 2023-07-21T22:56:51.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.568+0000 7f6620ff9700 1 -- 172.21.15.151:0/4012307035 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6628003cd0 con 0x55c026d84210 2023-07-21T22:56:51.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.568+0000 7f6652f01b80 10 client.28960 fetch_fsmap learned FSMap version 109 2023-07-21T22:56:51.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.568+0000 7f6652f01b80 1 -- 172.21.15.151:0/4012307035 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55c026ae6c00 con 0x55c026d84210 2023-07-21T22:56:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.568+0000 7f6620ff9700 1 -- 172.21.15.151:0/4012307035 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55c026c29490 con 0x55c026d84210 2023-07-21T22:56:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.569+0000 7f6620ff9700 1 -- 172.21.15.151:0/4012307035 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6628005350 con 0x55c026d84210 2023-07-21T22:56:51.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.569+0000 7f6652f01b80 10 client.28960 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:56:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.569+0000 7f6652f01b80 10 client.28960 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:56:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.569+0000 7f6652f01b80 20 client.28960 populate_metadata read hostname 'smithi151' 2023-07-21T22:56:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.569+0000 7f6652f01b80 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c026d97b30 0x55c026d99f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.569+0000 7f6652f01b80 4 client.28960 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:56:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.569+0000 7f6652f01b80 1 -- 172.21.15.151:0/4012307035 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55c026cc8e50 con 0x55c026d97b30 2023-07-21T22:56:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.569+0000 7f663db9c700 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c026d97b30 0x55c026d99f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.570+0000 7f663db9c700 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c026d97b30 0x55c026d99f40 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5c3387e905a6b69 server_cookie=ef6cacf051ecd6bf in_seq=0 out_seq=0 2023-07-21T22:56:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.570+0000 7f6620ff9700 10 client.28960 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6620ff9700 1 -- 172.21.15.151:0/4012307035 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55c026cc8e50 con 0x55c026d97b30 2023-07-21T22:56:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6620ff9700 10 client.28960 handle_command_reply: tid=0 2023-07-21T22:56:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6652f01b80 1 client.28960 shutdown 2023-07-21T22:56:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6652f01b80 1 -- 172.21.15.151:0/4012307035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84210 msgr2=0x55c026d8dae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6652f01b80 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84210 0x55c026d8dae0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f662800b940 tx=0x7f662800bc50 comp rx=0 tx=0).stop 2023-07-21T22:56:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6652f01b80 1 -- 172.21.15.151:0/4012307035 shutdown_connections 2023-07-21T22:56:51.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6652f01b80 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c026d97b30 0x55c026d99f40 crc :-1 s=READY pgs=435 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6652f01b80 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d8d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6652f01b80 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84660 0x55c026d878a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6652f01b80 1 --2- 172.21.15.151:0/4012307035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84210 0x55c026d8dae0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.571+0000 7f6652f01b80 1 -- 172.21.15.151:0/4012307035 >> 172.21.15.151:0/4012307035 conn(0x55c026d73ae0 msgr2=0x55c026d783e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:51.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.572+0000 7f6620ff9700 0 client.28960 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.572+0000 7f6652f01b80 1 -- 172.21.15.151:0/4012307035 shutdown_connections 2023-07-21T22:56:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.572+0000 7f6652f01b80 1 -- 172.21.15.151:0/4012307035 wait complete. 2023-07-21T22:56:51.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.572+0000 7f6652f01b80 20 client.28960 trim_cache size 0 max 16384 2023-07-21T22:56:51.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.597+0000 7f6652f01b80 1 Processor -- start 2023-07-21T22:56:51.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.597+0000 7f6652f01b80 1 -- start start 2023-07-21T22:56:51.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.597+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d83000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.597+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d78b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.597+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 0x55c026d87060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.597+0000 7f6652f01b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026d7f160 con 0x55c026d84210 2023-07-21T22:56:51.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.597+0000 7f6652f01b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026d754f0 con 0x55c026bda6b0 2023-07-21T22:56:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.597+0000 7f6652f01b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026d886d0 con 0x55c026d84660 2023-07-21T22:56:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.598+0000 7f663cb9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d78b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.598+0000 7f663cb9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d78b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34958/0 (socket says 172.21.15.151:34958) 2023-07-21T22:56:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.598+0000 7f663cb9a700 1 -- 172.21.15.151:0/1416818429 learned_addr learned my addr 172.21.15.151:0/1416818429 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.598+0000 7f663db9c700 1 --2- 172.21.15.151:0/1416818429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d83000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.598+0000 7f663db9c700 1 --2- 172.21.15.151:0/1416818429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 0x55c026d87060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.599+0000 7f663db9c700 1 -- 172.21.15.151:0/1416818429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 msgr2=0x55c026d87060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.599+0000 7f663db9c700 1 --2- 172.21.15.151:0/1416818429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 0x55c026d87060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.599+0000 7f663db9c700 1 -- 172.21.15.151:0/1416818429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 msgr2=0x55c026d78b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.599+0000 7f663db9c700 1 --2- 172.21.15.151:0/1416818429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d78b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.599+0000 7f663db9c700 1 -- 172.21.15.151:0/1416818429 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55c026b241f0 con 0x55c026bda6b0 2023-07-21T22:56:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.599+0000 7f663db9c700 1 --2- 172.21.15.151:0/1416818429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d83000 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f663000bfd0 tx=0x7f66300096c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fd71e3308a4e0c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:51.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.599+0000 7f6623fff700 1 -- 172.21.15.151:0/1416818429 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f663000e040 con 0x55c026bda6b0 2023-07-21T22:56:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.599+0000 7f6623fff700 1 -- 172.21.15.151:0/1416818429 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6630003e90 con 0x55c026bda6b0 2023-07-21T22:56:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.599+0000 7f6623fff700 1 -- 172.21.15.151:0/1416818429 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6630005460 con 0x55c026bda6b0 2023-07-21T22:56:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.600+0000 7f6652f01b80 1 -- 172.21.15.151:0/1416818429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 msgr2=0x55c026d83000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.600+0000 7f6652f01b80 1 --2- 172.21.15.151:0/1416818429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d83000 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f663000bfd0 tx=0x7f66300096c0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.600+0000 7f6652f01b80 1 -- 172.21.15.151:0/1416818429 shutdown_connections 2023-07-21T22:56:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.600+0000 7f6652f01b80 1 --2- 172.21.15.151:0/1416818429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026bda6b0 0x55c026d83000 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.600+0000 7f6652f01b80 1 --2- 172.21.15.151:0/1416818429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026d84660 0x55c026d87060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.600+0000 7f6652f01b80 1 --2- 172.21.15.151:0/1416818429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d78b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.600+0000 7f6652f01b80 1 -- 172.21.15.151:0/1416818429 >> 172.21.15.151:0/1416818429 conn(0x55c026d73ae0 msgr2=0x55c026d852c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.601+0000 7f6652f01b80 1 -- 172.21.15.151:0/1416818429 shutdown_connections 2023-07-21T22:56:51.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.601+0000 7f6652f01b80 1 -- 172.21.15.151:0/1416818429 wait complete. 2023-07-21T22:56:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.601+0000 7f6652f01b80 1 -- start start 2023-07-21T22:56:51.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.602+0000 7f6652f01b80 1 Processor -- start 2023-07-21T22:56:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.602+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026bda6b0 0x55c026d8b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.602+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d8b690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.602+0000 7f6652f01b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84660 0x55c026d8bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.602+0000 7f6652f01b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026d8de10 con 0x55c026d84210 2023-07-21T22:56:51.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.602+0000 7f6652f01b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026dea9f0 con 0x55c026d84660 2023-07-21T22:56:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.602+0000 7f6652f01b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55c026deab30 con 0x55c026bda6b0 2023-07-21T22:56:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.602+0000 7f6652f01b80 10 client.0 _ll_register_callbacks cb 0x7f6628004260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:56:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.603+0000 7f663db9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026bda6b0 0x55c026d8b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.603+0000 7f663db9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026bda6b0 0x55c026d8b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:58410/0 (socket says 172.21.15.151:58410) 2023-07-21T22:56:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.603+0000 7f663db9c700 1 -- 172.21.15.151:0/54106214 learned_addr learned my addr 172.21.15.151:0/54106214 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:56:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.603+0000 7f663db9c700 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84660 0x55c026d8bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.603+0000 7f663cb9a700 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d8b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.604+0000 7f663cb9a700 1 -- 172.21.15.151:0/54106214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026bda6b0 msgr2=0x55c026d8b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.604+0000 7f663cb9a700 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026bda6b0 0x55c026d8b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.604+0000 7f663cb9a700 1 -- 172.21.15.151:0/54106214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84660 msgr2=0x55c026d8bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:56:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.604+0000 7f663cb9a700 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84660 0x55c026d8bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.604+0000 7f663cb9a700 1 -- 172.21.15.151:0/54106214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f663002d040 con 0x55c026d84210 2023-07-21T22:56:51.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.604+0000 7f663db9c700 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84660 0x55c026d8bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:56:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.605+0000 7f663cb9a700 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d8b690 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f662801b510 tx=0x7f6628004450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb78204a894338b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:56:51.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.605+0000 7f6620ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:56:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.605+0000 7f6620ff9700 1 -- 172.21.15.151:0/54106214 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6628016070 con 0x55c026d84210 2023-07-21T22:56:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.605+0000 7f6620ff9700 1 -- 172.21.15.151:0/54106214 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(152..152 src has 1..152) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6628000e40 con 0x55c026d84210 2023-07-21T22:56:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.605+0000 7f6652f01b80 1 -- 172.21.15.151:0/54106214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6630007720 con 0x55c026d84210 2023-07-21T22:56:51.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.606+0000 7f6620ff9700 1 -- 172.21.15.151:0/54106214 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f662801bc10 con 0x55c026d84210 2023-07-21T22:56:51.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.609+0000 7f6652f01b80 10 client.19248 fetch_fsmap learned FSMap version 109 2023-07-21T22:56:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.609+0000 7f6652f01b80 1 -- 172.21.15.151:0/54106214 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55c026afc250 con 0x55c026d84210 2023-07-21T22:56:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.610+0000 7f6620ff9700 1 -- 172.21.15.151:0/54106214 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6630007720 con 0x55c026d84210 2023-07-21T22:56:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.610+0000 7f6620ff9700 1 -- 172.21.15.151:0/54106214 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f6628024460 con 0x55c026d84210 2023-07-21T22:56:51.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.610+0000 7f6652f01b80 10 client.19248 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:56:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.610+0000 7f6652f01b80 10 client.19248 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:56:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.610+0000 7f6652f01b80 20 client.19248 populate_metadata read hostname 'smithi151' 2023-07-21T22:56:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.610+0000 7f6652f01b80 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c026dec210 0x55c026dee620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:56:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.610+0000 7f6652f01b80 4 client.19248 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:56:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.610+0000 7f6652f01b80 1 -- 172.21.15.151:0/54106214 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55c026c8aff0 con 0x55c026dec210 2023-07-21T22:56:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.610+0000 7f663db9c700 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c026dec210 0x55c026dee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:56:51.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.611+0000 7f663db9c700 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c026dec210 0x55c026dee620 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=490b7d60fe7c3290 server_cookie=9016f6ea66ffbea1 in_seq=0 out_seq=0 2023-07-21T22:56:51.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.611+0000 7f6620ff9700 10 client.19248 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6620ff9700 1 -- 172.21.15.151:0/54106214 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55c026c8aff0 con 0x55c026dec210 2023-07-21T22:56:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6620ff9700 10 client.19248 handle_command_reply: tid=0 2023-07-21T22:56:51.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6652f01b80 1 client.19248 shutdown 2023-07-21T22:56:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6652f01b80 1 -- 172.21.15.151:0/54106214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 msgr2=0x55c026d8b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6652f01b80 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d8b690 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f662801b510 tx=0x7f6628004450 comp rx=0 tx=0).stop 2023-07-21T22:56:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6652f01b80 1 -- 172.21.15.151:0/54106214 shutdown_connections 2023-07-21T22:56:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6652f01b80 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55c026dec210 0x55c026dee620 crc :-1 s=READY pgs=436 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6652f01b80 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55c026d84660 0x55c026d8bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6652f01b80 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55c026bda6b0 0x55c026d8b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6620ff9700 0 client.19248 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:56:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6652f01b80 1 --2- 172.21.15.151:0/54106214 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c026d84210 0x55c026d8b690 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.645+0000 7f6652f01b80 1 -- 172.21.15.151:0/54106214 >> 172.21.15.151:0/54106214 conn(0x55c026d73ae0 msgr2=0x55c026d852c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.646+0000 7f6652f01b80 1 -- 172.21.15.151:0/54106214 shutdown_connections 2023-07-21T22:56:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.646+0000 7f6652f01b80 1 -- 172.21.15.151:0/54106214 wait complete. 2023-07-21T22:56:51.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.646+0000 7f6652f01b80 20 client.19248 trim_cache size 0 max 16384 2023-07-21T22:56:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:56:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:56:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:56:51.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:56:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 -- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f66240a13c0 msgr2=0x7f66240a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f66240a13c0 0x7f66240a3870 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f66340a2030 tx=0x7f6634000bc0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 -- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6638067ee0 msgr2=0x7f663819c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:56:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6638067ee0 0x7f663819c2b0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f663400ec10 tx=0x7f663400ef20 comp rx=0 tx=0).stop 2023-07-21T22:56:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 -- 172.21.15.151:0/745811807 shutdown_connections 2023-07-21T22:56:51.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f66240a13c0 0x7f66240a3870 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6638104a60 0x7f66381a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6638067ee0 0x7f663819c2b0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 --2- 172.21.15.151:0/745811807 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f66381024f0 0x7f663819c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:56:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.647+0000 7f663f5ff700 1 -- 172.21.15.151:0/745811807 >> 172.21.15.151:0/745811807 conn(0x7f6638074760 msgr2=0x7f66381014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:56:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.648+0000 7f663f5ff700 1 -- 172.21.15.151:0/745811807 shutdown_connections 2023-07-21T22:56:51.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:56:51.648+0000 7f663f5ff700 1 -- 172.21.15.151:0/745811807 wait complete. 2023-07-21T22:56:53.122 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:52 smithi187 ceph-mon[96918]: pgmap v1198: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 9.3 MiB/s wr, 800 op/s 2023-07-21T22:56:53.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:52 smithi195 ceph-mon[97365]: pgmap v1198: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 9.3 MiB/s wr, 800 op/s 2023-07-21T22:56:53.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:52 smithi151 ceph-mon[95510]: pgmap v1198: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 9.3 MiB/s wr, 800 op/s 2023-07-21T22:56:54.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 240.0 s, 345.6 tps, lat 296.773 ms stddev 121.276 2023-07-21T22:56:55.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:54 smithi187 ceph-mon[96918]: pgmap v1199: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-07-21T22:56:55.150 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:54 smithi195 ceph-mon[97365]: pgmap v1199: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-07-21T22:56:55.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:54 smithi151 ceph-mon[95510]: pgmap v1199: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 14 MiB/s wr, 1.18k op/s 2023-07-21T22:56:56.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:55 smithi151 ceph-mon[95510]: pgmap v1200: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.3 MiB/s wr, 792 op/s 2023-07-21T22:56:56.370 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:55 smithi187 ceph-mon[96918]: pgmap v1200: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.3 MiB/s wr, 792 op/s 2023-07-21T22:56:56.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:55 smithi195 ceph-mon[97365]: pgmap v1200: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 9.3 MiB/s wr, 792 op/s 2023-07-21T22:56:59.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:56:58 smithi187 ceph-mon[96918]: pgmap v1201: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-07-21T22:56:59.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:56:58 smithi195 ceph-mon[97365]: pgmap v1201: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-07-21T22:56:59.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:56:58 smithi151 ceph-mon[95510]: pgmap v1201: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 14 MiB/s wr, 1.23k op/s 2023-07-21T22:56:59.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 245.0 s, 355.2 tps, lat 281.852 ms stddev 56.815 2023-07-21T22:57:01.120 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:00 smithi187 ceph-mon[96918]: pgmap v1202: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.6 MiB/s wr, 818 op/s 2023-07-21T22:57:01.166 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:00 smithi195 ceph-mon[97365]: pgmap v1202: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.6 MiB/s wr, 818 op/s 2023-07-21T22:57:01.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:00 smithi151 ceph-mon[95510]: pgmap v1202: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.6 MiB/s wr, 818 op/s 2023-07-21T22:57:03.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:02 smithi187 ceph-mon[96918]: pgmap v1203: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.6 MiB/s wr, 818 op/s 2023-07-21T22:57:03.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:02 smithi195 ceph-mon[97365]: pgmap v1203: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.6 MiB/s wr, 818 op/s 2023-07-21T22:57:03.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:02 smithi151 ceph-mon[95510]: pgmap v1203: 97 pgs: 97 active+clean; 12 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.6 MiB/s wr, 818 op/s 2023-07-21T22:57:04.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:03 smithi151 ceph-mon[95510]: pgmap v1204: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-21T22:57:04.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:03 smithi151 ceph-mon[95510]: osdmap e153: 12 total, 12 up, 12 in 2023-07-21T22:57:04.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 250.0 s, 309.4 tps, lat 296.048 ms stddev 157.507 2023-07-21T22:57:04.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:03 smithi187 ceph-mon[96918]: pgmap v1204: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-21T22:57:04.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:03 smithi187 ceph-mon[96918]: osdmap e153: 12 total, 12 up, 12 in 2023-07-21T22:57:04.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:03 smithi195 ceph-mon[97365]: pgmap v1204: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 14 MiB/s wr, 1.26k op/s 2023-07-21T22:57:04.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:03 smithi195 ceph-mon[97365]: osdmap e153: 12 total, 12 up, 12 in 2023-07-21T22:57:05.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.970+0000 7ff56a9ff700 1 -- 172.21.15.151:0/2017349277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff56406d3a0 msgr2=0x7ff56411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.970+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/2017349277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff56406d3a0 0x7ff56411b470 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00b0a0 tx=0x7ff55c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.972+0000 7ff56a9ff700 1 -- 172.21.15.151:0/2017349277 shutdown_connections 2023-07-21T22:57:05.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.972+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/2017349277 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff56406d3a0 0x7ff56411b470 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.972+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/2017349277 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff56410e2a0 0x7ff56410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.972+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/2017349277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff56406c910 0x7ff56406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.972+0000 7ff56a9ff700 1 -- 172.21.15.151:0/2017349277 >> 172.21.15.151:0/2017349277 conn(0x7ff56406bd70 msgr2=0x7ff564070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.977+0000 7ff56a9ff700 1 -- 172.21.15.151:0/2017349277 shutdown_connections 2023-07-21T22:57:05.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.981+0000 7ff56a9ff700 1 -- 172.21.15.151:0/2017349277 wait complete. 2023-07-21T22:57:05.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.983+0000 7ff56a9ff700 1 Processor -- start 2023-07-21T22:57:05.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.983+0000 7ff56a9ff700 1 -- start start 2023-07-21T22:57:05.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.984+0000 7ff56a9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff56406c910 0x7ff56411adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.984+0000 7ff56a9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff56406d3a0 0x7ff56411b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.984+0000 7ff56a9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff56410e2a0 0x7ff564114c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.984+0000 7ff56a9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564115430 con 0x7ff56406d3a0 2023-07-21T22:57:05.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.984+0000 7ff56a9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5641155a0 con 0x7ff56410e2a0 2023-07-21T22:57:05.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.984+0000 7ff56a9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff564115760 con 0x7ff56406c910 2023-07-21T22:57:05.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.984+0000 7ff563fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff56406c910 0x7ff56411adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.985+0000 7ff563fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff56406c910 0x7ff56411adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60226/0 (socket says 172.21.15.151:60226) 2023-07-21T22:57:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.985+0000 7ff563fff700 1 -- 172.21.15.151:0/4067055730 learned_addr learned my addr 172.21.15.151:0/4067055730 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.985+0000 7ff5637fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff56406d3a0 0x7ff56411b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.987+0000 7ff5637fe700 1 -- 172.21.15.151:0/4067055730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff56406c910 msgr2=0x7ff56411adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.987+0000 7ff5637fe700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff56406c910 0x7ff56411adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.987+0000 7ff5637fe700 1 -- 172.21.15.151:0/4067055730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff56410e2a0 msgr2=0x7ff564114c60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:57:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.987+0000 7ff5637fe700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff56410e2a0 0x7ff564114c60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.987+0000 7ff5637fe700 1 -- 172.21.15.151:0/4067055730 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff55c009d00 con 0x7ff56406d3a0 2023-07-21T22:57:05.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.987+0000 7ff5637fe700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff56406d3a0 0x7ff56411b330 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7ff55400b450 tx=0x7ff55400b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.996+0000 7ff5617fa700 1 -- 172.21.15.151:0/4067055730 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554011830 con 0x7ff56406d3a0 2023-07-21T22:57:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.996+0000 7ff5617fa700 1 -- 172.21.15.151:0/4067055730 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff554011e20 con 0x7ff56406d3a0 2023-07-21T22:57:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.996+0000 7ff5617fa700 1 -- 172.21.15.151:0/4067055730 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554010c90 con 0x7ff56406d3a0 2023-07-21T22:57:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.996+0000 7ff56a9ff700 1 -- 172.21.15.151:0/4067055730 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff564115a40 con 0x7ff56406d3a0 2023-07-21T22:57:05.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:04.996+0000 7ff56a9ff700 1 -- 172.21.15.151:0/4067055730 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff564124530 con 0x7ff56406d3a0 2023-07-21T22:57:05.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.003+0000 7ff5617fa700 1 -- 172.21.15.151:0/4067055730 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff554010380 con 0x7ff56406d3a0 2023-07-21T22:57:05.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.005+0000 7ff5617fa700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff54c0a14d0 0x7ff54c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.006+0000 7ff5617fa700 1 -- 172.21.15.151:0/4067055730 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 8536+0+0 (secure 0 0 0) 0x7ff5540cc4a0 con 0x7ff56406d3a0 2023-07-21T22:57:05.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.006+0000 7ff563fff700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff54c0a14d0 0x7ff54c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.008+0000 7ff563fff700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff54c0a14d0 0x7ff54c0a3980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff558009ad0 tx=0x7ff558009210 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.011+0000 7ff57e295b80 1 Processor -- start 2023-07-21T22:57:05.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.012+0000 7ff57e295b80 1 -- start start 2023-07-21T22:57:05.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.012+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b281ce6b0 0x556b28377cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.012+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b28371f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.012+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283724a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.012+0000 7ff57e295b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b28277c50 con 0x556b28378660 2023-07-21T22:57:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.012+0000 7ff57e295b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b282ca9e0 con 0x556b281ce6b0 2023-07-21T22:57:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.012+0000 7ff57e295b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b282c3e70 con 0x556b28378210 2023-07-21T22:57:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.013+0000 7ff568f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283724a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.013+0000 7ff568f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283724a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54802/0 (socket says 172.21.15.151:54802) 2023-07-21T22:57:05.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.013+0000 7ff568f9c700 1 -- 172.21.15.151:0/4133361460 learned_addr learned my addr 172.21.15.151:0/4133361460 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.013+0000 7ff5637fe700 1 --2- 172.21.15.151:0/4133361460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b28371f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.014+0000 7ff563fff700 1 --2- 172.21.15.151:0/4133361460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b281ce6b0 0x556b28377cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.014+0000 7ff5637fe700 1 -- 172.21.15.151:0/4133361460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b281ce6b0 msgr2=0x556b28377cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.014+0000 7ff5637fe700 1 --2- 172.21.15.151:0/4133361460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b281ce6b0 0x556b28377cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.014+0000 7ff5637fe700 1 -- 172.21.15.151:0/4133361460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 msgr2=0x556b283724a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.014+0000 7ff5637fe700 1 --2- 172.21.15.151:0/4133361460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283724a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.014+0000 7ff5637fe700 1 -- 172.21.15.151:0/4133361460 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b280f1d80 con 0x556b28378210 2023-07-21T22:57:05.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.015+0000 7ff5637fe700 1 --2- 172.21.15.151:0/4133361460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b28371f40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff5540c9c90 tx=0x7ff554099240 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b5a13e54039f79d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.015+0000 7ff54a7fc700 1 -- 172.21.15.151:0/4133361460 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55409d640 con 0x556b28378210 2023-07-21T22:57:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.015+0000 7ff54a7fc700 1 -- 172.21.15.151:0/4133361460 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5540a1a60 con 0x556b28378210 2023-07-21T22:57:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.015+0000 7ff54a7fc700 1 -- 172.21.15.151:0/4133361460 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff554098b00 con 0x556b28378210 2023-07-21T22:57:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.016+0000 7ff57e295b80 1 -- 172.21.15.151:0/4133361460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 msgr2=0x556b28371f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.016+0000 7ff57e295b80 1 --2- 172.21.15.151:0/4133361460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b28371f40 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ff5540c9c90 tx=0x7ff554099240 comp rx=0 tx=0).stop 2023-07-21T22:57:05.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.022+0000 7ff57e295b80 1 -- 172.21.15.151:0/4133361460 shutdown_connections 2023-07-21T22:57:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.022+0000 7ff57e295b80 1 --2- 172.21.15.151:0/4133361460 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b281ce6b0 0x556b28377cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.022+0000 7ff57e295b80 1 --2- 172.21.15.151:0/4133361460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283724a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.022+0000 7ff57e295b80 1 --2- 172.21.15.151:0/4133361460 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b28371f40 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.022+0000 7ff57e295b80 1 -- 172.21.15.151:0/4133361460 >> 172.21.15.151:0/4133361460 conn(0x556b28367ae0 msgr2=0x556b2836d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.023+0000 7ff57e295b80 1 -- 172.21.15.151:0/4133361460 shutdown_connections 2023-07-21T22:57:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.024+0000 7ff57e295b80 1 -- 172.21.15.151:0/4133361460 wait complete. 2023-07-21T22:57:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.024+0000 7ff57e295b80 1 -- start start 2023-07-21T22:57:05.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.025+0000 7ff57e295b80 1 Processor -- start 2023-07-21T22:57:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.026+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b281ce6b0 0x556b2837e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.026+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b2837b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.026+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b28378660 0x556b2837bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.026+0000 7ff57e295b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b28263a60 con 0x556b281ce6b0 2023-07-21T22:57:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.026+0000 7ff57e295b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b28263760 con 0x556b28378660 2023-07-21T22:57:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.026+0000 7ff57e295b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b281478c0 con 0x556b28378210 2023-07-21T22:57:05.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.026+0000 7ff57e295b80 10 client.0 _ll_register_callbacks cb 0x556b28261700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.027+0000 7ff563fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b281ce6b0 0x556b2837e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.027+0000 7ff563fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b281ce6b0 0x556b2837e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54810/0 (socket says 172.21.15.151:54810) 2023-07-21T22:57:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.027+0000 7ff563fff700 1 -- 172.21.15.151:0/473782785 learned_addr learned my addr 172.21.15.151:0/473782785 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.028+0000 7ff568f9c700 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b28378660 0x556b2837bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.028+0000 7ff5637fe700 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b2837b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.030+0000 7ff563fff700 1 -- 172.21.15.151:0/473782785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 msgr2=0x556b2837b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.030+0000 7ff563fff700 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b2837b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.030+0000 7ff563fff700 1 -- 172.21.15.151:0/473782785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b28378660 msgr2=0x556b2837bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.030+0000 7ff563fff700 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b28378660 0x556b2837bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.030+0000 7ff563fff700 1 -- 172.21.15.151:0/473782785 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff564124530 con 0x556b281ce6b0 2023-07-21T22:57:05.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.030+0000 7ff563fff700 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b281ce6b0 0x556b2837e5f0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff558015700 tx=0x7ff558004800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=297b29b683f3201a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.033+0000 7ff5437fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:57:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.034+0000 7ff5437fe700 1 -- 172.21.15.151:0/473782785 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff558015d20 con 0x556b281ce6b0 2023-07-21T22:57:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.034+0000 7ff5437fe700 1 -- 172.21.15.151:0/473782785 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8536+0+0 (secure 0 0 0) 0x7ff558021470 con 0x556b281ce6b0 2023-07-21T22:57:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.034+0000 7ff57e295b80 1 -- 172.21.15.151:0/473782785 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556b2821d490 con 0x556b281ce6b0 2023-07-21T22:57:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.034+0000 7ff5437fe700 1 -- 172.21.15.151:0/473782785 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff558015e80 con 0x556b281ce6b0 2023-07-21T22:57:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.034+0000 7ff57e295b80 10 client.19260 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:05.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.034+0000 7ff57e295b80 1 -- 172.21.15.151:0/473782785 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x556b280dac00 con 0x556b281ce6b0 2023-07-21T22:57:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.035+0000 7ff5437fe700 1 -- 172.21.15.151:0/473782785 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556b2821d490 con 0x556b281ce6b0 2023-07-21T22:57:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.035+0000 7ff5437fe700 1 -- 172.21.15.151:0/473782785 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff558013670 con 0x556b281ce6b0 2023-07-21T22:57:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.035+0000 7ff57e295b80 10 client.19260 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:05.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.035+0000 7ff57e295b80 10 client.19260 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.035+0000 7ff57e295b80 20 client.19260 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.035+0000 7ff57e295b80 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556b2838bc40 0x556b2838e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.035+0000 7ff57e295b80 4 client.19260 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:57:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.035+0000 7ff57e295b80 1 -- 172.21.15.151:0/473782785 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556b282bce50 con 0x556b2838bc40 2023-07-21T22:57:05.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.036+0000 7ff5637fe700 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556b2838bc40 0x556b2838e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.048+0000 7ff5637fe700 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556b2838bc40 0x556b2838e090 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7918b7b3a727fa7e server_cookie=7dc5b21205467875 in_seq=0 out_seq=0 2023-07-21T22:57:05.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.049+0000 7ff5437fe700 10 client.19260 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:05.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.056+0000 7ff5437fe700 1 -- 172.21.15.151:0/473782785 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556b282bce50 con 0x556b2838bc40 2023-07-21T22:57:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.056+0000 7ff5437fe700 10 client.19260 handle_command_reply: tid=0 2023-07-21T22:57:05.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.058+0000 7ff57e295b80 1 client.19260 shutdown 2023-07-21T22:57:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.059+0000 7ff57e295b80 1 -- 172.21.15.151:0/473782785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b281ce6b0 msgr2=0x556b2837e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.059+0000 7ff57e295b80 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b281ce6b0 0x556b2837e5f0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7ff558015700 tx=0x7ff558004800 comp rx=0 tx=0).stop 2023-07-21T22:57:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.059+0000 7ff57e295b80 1 -- 172.21.15.151:0/473782785 shutdown_connections 2023-07-21T22:57:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.059+0000 7ff57e295b80 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556b2838bc40 0x556b2838e090 crc :-1 s=READY pgs=437 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.059+0000 7ff57e295b80 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b28378660 0x556b2837bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.059+0000 7ff57e295b80 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b281ce6b0 0x556b2837e5f0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.059+0000 7ff57e295b80 1 --2- 172.21.15.151:0/473782785 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b2837b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.059+0000 7ff57e295b80 1 -- 172.21.15.151:0/473782785 >> 172.21.15.151:0/473782785 conn(0x556b28367ae0 msgr2=0x556b2836c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.060+0000 7ff5437fe700 0 client.19260 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.064+0000 7ff57e295b80 1 -- 172.21.15.151:0/473782785 shutdown_connections 2023-07-21T22:57:05.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.064+0000 7ff57e295b80 1 -- 172.21.15.151:0/473782785 wait complete. 2023-07-21T22:57:05.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.065+0000 7ff57e295b80 20 client.19260 trim_cache size 0 max 16384 2023-07-21T22:57:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.104+0000 7ff57e295b80 1 Processor -- start 2023-07-21T22:57:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.104+0000 7ff57e295b80 1 -- start start 2023-07-21T22:57:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.105+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b281ce6b0 0x556b28382c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.105+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b2837e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.105+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b2837ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.105+0000 7ff57e295b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b283764b0 con 0x556b28378660 2023-07-21T22:57:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.105+0000 7ff57e295b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b28383170 con 0x556b281ce6b0 2023-07-21T22:57:05.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.105+0000 7ff57e295b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b2838e360 con 0x556b28378210 2023-07-21T22:57:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.106+0000 7ff568f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b2837ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.106+0000 7ff568f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b2837ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54816/0 (socket says 172.21.15.151:54816) 2023-07-21T22:57:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.106+0000 7ff568f9c700 1 -- 172.21.15.151:0/1382054316 learned_addr learned my addr 172.21.15.151:0/1382054316 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.107+0000 7ff568f9c700 1 -- 172.21.15.151:0/1382054316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 msgr2=0x556b2837e120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:57:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.107+0000 7ff568f9c700 1 --2- 172.21.15.151:0/1382054316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b2837e120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.107+0000 7ff568f9c700 1 -- 172.21.15.151:0/1382054316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b281ce6b0 msgr2=0x556b28382c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:57:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.107+0000 7ff568f9c700 1 --2- 172.21.15.151:0/1382054316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b281ce6b0 0x556b28382c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.107+0000 7ff568f9c700 1 -- 172.21.15.151:0/1382054316 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556b281181f0 con 0x556b28378660 2023-07-21T22:57:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.107+0000 7ff568f9c700 1 --2- 172.21.15.151:0/1382054316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b2837ad70 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00b070 tx=0x7ff55c009150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9ac6564c3c5c05 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.108+0000 7ff54affd700 1 -- 172.21.15.151:0/1382054316 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00e040 con 0x556b28378660 2023-07-21T22:57:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.108+0000 7ff54affd700 1 -- 172.21.15.151:0/1382054316 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff55c003e90 con 0x556b28378660 2023-07-21T22:57:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.108+0000 7ff54affd700 1 -- 172.21.15.151:0/1382054316 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c005320 con 0x556b28378660 2023-07-21T22:57:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.109+0000 7ff57e295b80 1 -- 172.21.15.151:0/1382054316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 msgr2=0x556b2837ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.109+0000 7ff57e295b80 1 --2- 172.21.15.151:0/1382054316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b2837ad70 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00b070 tx=0x7ff55c009150 comp rx=0 tx=0).stop 2023-07-21T22:57:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.111+0000 7ff57e295b80 1 -- 172.21.15.151:0/1382054316 shutdown_connections 2023-07-21T22:57:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.111+0000 7ff57e295b80 1 --2- 172.21.15.151:0/1382054316 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b281ce6b0 0x556b28382c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.111+0000 7ff57e295b80 1 --2- 172.21.15.151:0/1382054316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b2837ad70 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.111+0000 7ff57e295b80 1 --2- 172.21.15.151:0/1382054316 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b28378210 0x556b2837e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.111+0000 7ff57e295b80 1 -- 172.21.15.151:0/1382054316 >> 172.21.15.151:0/1382054316 conn(0x556b28367ae0 msgr2=0x556b2838dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.112+0000 7ff57e295b80 1 -- 172.21.15.151:0/1382054316 shutdown_connections 2023-07-21T22:57:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.112+0000 7ff57e295b80 1 -- 172.21.15.151:0/1382054316 wait complete. 2023-07-21T22:57:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.113+0000 7ff57e295b80 1 -- start start 2023-07-21T22:57:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.113+0000 7ff57e295b80 1 Processor -- start 2023-07-21T22:57:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.114+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b281ce6b0 0x556b28372170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.115+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b28378210 0x556b283726b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.115+0000 7ff57e295b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.115+0000 7ff57e295b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b283717f0 con 0x556b28378660 2023-07-21T22:57:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.115+0000 7ff57e295b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b28371960 con 0x556b28378210 2023-07-21T22:57:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.115+0000 7ff57e295b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556b28371b20 con 0x556b281ce6b0 2023-07-21T22:57:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.115+0000 7ff57e295b80 10 client.0 _ll_register_callbacks cb 0x7ff55800eb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:05.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.116+0000 7ff568f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.116+0000 7ff568f9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54818/0 (socket says 172.21.15.151:54818) 2023-07-21T22:57:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.116+0000 7ff568f9c700 1 -- 172.21.15.151:0/3098773842 learned_addr learned my addr 172.21.15.151:0/3098773842 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.117+0000 7ff568f9c700 1 -- 172.21.15.151:0/3098773842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b281ce6b0 msgr2=0x556b28372170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.117+0000 7ff568f9c700 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b281ce6b0 0x556b28372170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.117+0000 7ff568f9c700 1 -- 172.21.15.151:0/3098773842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b28378210 msgr2=0x556b283726b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:05.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.117+0000 7ff568f9c700 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b28378210 0x556b283726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.117+0000 7ff568f9c700 1 -- 172.21.15.151:0/3098773842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff56411bfb0 con 0x556b28378660 2023-07-21T22:57:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.117+0000 7ff568f9c700 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283710e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00d010 tx=0x7ff55c007550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b93ad004a38040e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.119+0000 7ff5437fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:57:05.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.119+0000 7ff5437fe700 1 -- 172.21.15.151:0/3098773842 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff55c00e040 con 0x556b28378660 2023-07-21T22:57:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.120+0000 7ff5437fe700 1 -- 172.21.15.151:0/3098773842 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 8536+0+0 (secure 0 0 0) 0x7ff55c0050b0 con 0x556b28378660 2023-07-21T22:57:05.156 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.120+0000 7ff57e295b80 1 -- 172.21.15.151:0/3098773842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff5540a1a60 con 0x556b28378660 2023-07-21T22:57:05.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.124+0000 7ff5437fe700 1 -- 172.21.15.151:0/3098773842 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff55c005270 con 0x556b28378660 2023-07-21T22:57:05.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.125+0000 7ff57e295b80 10 client.19266 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:05.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.125+0000 7ff57e295b80 1 -- 172.21.15.151:0/3098773842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x556b280f0250 con 0x556b28378660 2023-07-21T22:57:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.126+0000 7ff5437fe700 1 -- 172.21.15.151:0/3098773842 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff5540a1a60 con 0x556b28378660 2023-07-21T22:57:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.126+0000 7ff5437fe700 1 -- 172.21.15.151:0/3098773842 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff55c019070 con 0x556b28378660 2023-07-21T22:57:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.126+0000 7ff57e295b80 10 client.19266 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:05.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.126+0000 7ff57e295b80 10 client.19266 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.126+0000 7ff57e295b80 20 client.19266 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.126+0000 7ff57e295b80 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556b283e0ac0 0x556b283e2ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:05.162 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.126+0000 7ff57e295b80 4 client.19266 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:57:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.126+0000 7ff57e295b80 1 -- 172.21.15.151:0/3098773842 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556b2827eff0 con 0x556b283e0ac0 2023-07-21T22:57:05.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.129+0000 7ff563fff700 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556b283e0ac0 0x556b283e2ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.137+0000 7ff563fff700 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556b283e0ac0 0x556b283e2ed0 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6af20bebc612aa84 server_cookie=cbe9f965ac44697e in_seq=0 out_seq=0 2023-07-21T22:57:05.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.137+0000 7ff5437fe700 10 client.19266 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:05.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.224+0000 7ff5437fe700 1 -- 172.21.15.151:0/3098773842 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556b2827eff0 con 0x556b283e0ac0 2023-07-21T22:57:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.224+0000 7ff5437fe700 10 client.19266 handle_command_reply: tid=0 2023-07-21T22:57:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.224+0000 7ff57e295b80 1 client.19266 shutdown 2023-07-21T22:57:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.225+0000 7ff57e295b80 1 -- 172.21.15.151:0/3098773842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 msgr2=0x556b283710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.225+0000 7ff57e295b80 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283710e0 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff55c00d010 tx=0x7ff55c007550 comp rx=0 tx=0).stop 2023-07-21T22:57:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.225+0000 7ff57e295b80 1 -- 172.21.15.151:0/3098773842 shutdown_connections 2023-07-21T22:57:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.225+0000 7ff57e295b80 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556b283e0ac0 0x556b283e2ed0 crc :-1 s=READY pgs=438 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.225+0000 7ff57e295b80 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556b28378660 0x556b283710e0 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.225+0000 7ff57e295b80 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556b281ce6b0 0x556b28372170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.225+0000 7ff57e295b80 1 --2- 172.21.15.151:0/3098773842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556b28378210 0x556b283726b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.225+0000 7ff57e295b80 1 -- 172.21.15.151:0/3098773842 >> 172.21.15.151:0/3098773842 conn(0x556b28367ae0 msgr2=0x556b28375910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.232+0000 7ff5437fe700 0 client.19266 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.232+0000 7ff57e295b80 1 -- 172.21.15.151:0/3098773842 shutdown_connections 2023-07-21T22:57:05.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.233+0000 7ff57e295b80 1 -- 172.21.15.151:0/3098773842 wait complete. 2023-07-21T22:57:05.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.243+0000 7ff57e295b80 20 client.19266 trim_cache size 0 max 16384 2023-07-21T22:57:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:57:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:57:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:57:05.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:57:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.252+0000 7ff56a9ff700 1 -- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff54c0a14d0 msgr2=0x7ff54c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.252+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff54c0a14d0 0x7ff54c0a3980 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7ff558009ad0 tx=0x7ff558009210 comp rx=0 tx=0).stop 2023-07-21T22:57:05.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.252+0000 7ff56a9ff700 1 -- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff56406d3a0 msgr2=0x7ff56411b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:05.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.252+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff56406d3a0 0x7ff56411b330 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7ff55400b450 tx=0x7ff55400b760 comp rx=0 tx=0).stop 2023-07-21T22:57:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.254+0000 7ff56a9ff700 1 -- 172.21.15.151:0/4067055730 shutdown_connections 2023-07-21T22:57:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.254+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff54c0a14d0 0x7ff54c0a3980 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.254+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff56410e2a0 0x7ff564114c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.254+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff56406c910 0x7ff56411adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.254+0000 7ff56a9ff700 1 --2- 172.21.15.151:0/4067055730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff56406d3a0 0x7ff56411b330 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.254+0000 7ff56a9ff700 1 -- 172.21.15.151:0/4067055730 >> 172.21.15.151:0/4067055730 conn(0x7ff56406bd70 msgr2=0x7ff56406f220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.254+0000 7ff56a9ff700 1 -- 172.21.15.151:0/4067055730 shutdown_connections 2023-07-21T22:57:05.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:05.254+0000 7ff56a9ff700 1 -- 172.21.15.151:0/4067055730 wait complete. 2023-07-21T22:57:07.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:06 smithi187 ceph-mon[96918]: pgmap v1206: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-07-21T22:57:07.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:06 smithi195 ceph-mon[97365]: pgmap v1206: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-07-21T22:57:07.197 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:06 smithi151 ceph-mon[95510]: pgmap v1206: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 12 MiB/s wr, 1.06k op/s 2023-07-21T22:57:09.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:08 smithi187 ceph-mon[96918]: pgmap v1207: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 766 op/s 2023-07-21T22:57:09.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:08 smithi195 ceph-mon[97365]: pgmap v1207: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 766 op/s 2023-07-21T22:57:09.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:08 smithi151 ceph-mon[95510]: pgmap v1207: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 766 op/s 2023-07-21T22:57:09.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 255.0 s, 187.2 tps, lat 571.090 ms stddev 377.988 2023-07-21T22:57:10.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:09 smithi151 ceph-mon[95510]: pgmap v1208: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 766 op/s 2023-07-21T22:57:10.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:09 smithi187 ceph-mon[96918]: pgmap v1208: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 766 op/s 2023-07-21T22:57:10.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:09 smithi195 ceph-mon[97365]: pgmap v1208: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 766 op/s 2023-07-21T22:57:13.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:12 smithi187 ceph-mon[96918]: pgmap v1209: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 766 op/s 2023-07-21T22:57:13.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:12 smithi187 ceph-mon[96918]: osdmap e154: 12 total, 12 up, 12 in 2023-07-21T22:57:13.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:12 smithi195 ceph-mon[97365]: pgmap v1209: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 766 op/s 2023-07-21T22:57:13.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:12 smithi195 ceph-mon[97365]: osdmap e154: 12 total, 12 up, 12 in 2023-07-21T22:57:13.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:12 smithi151 ceph-mon[95510]: pgmap v1209: 97 pgs: 97 active+clean; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 8.6 MiB/s wr, 766 op/s 2023-07-21T22:57:13.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:12 smithi151 ceph-mon[95510]: osdmap e154: 12 total, 12 up, 12 in 2023-07-21T22:57:14.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 260.0 s, 307.2 tps, lat 321.952 ms stddev 366.129 2023-07-21T22:57:15.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:14 smithi187 ceph-mon[96918]: pgmap v1211: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.9 MiB/s wr, 661 op/s 2023-07-21T22:57:15.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:14 smithi195 ceph-mon[97365]: pgmap v1211: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.9 MiB/s wr, 661 op/s 2023-07-21T22:57:15.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:14 smithi151 ceph-mon[95510]: pgmap v1211: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.9 MiB/s wr, 661 op/s 2023-07-21T22:57:16.867 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:16 smithi187 ceph-mon[96918]: pgmap v1212: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.7 MiB/s wr, 649 op/s 2023-07-21T22:57:17.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:16 smithi195 ceph-mon[97365]: pgmap v1212: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.7 MiB/s wr, 649 op/s 2023-07-21T22:57:17.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:16 smithi151 ceph-mon[95510]: pgmap v1212: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 7.7 MiB/s wr, 649 op/s 2023-07-21T22:57:18.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:17 smithi151 ceph-mon[95510]: pgmap v1213: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 862 op/s 2023-07-21T22:57:18.371 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:17 smithi187 ceph-mon[96918]: pgmap v1213: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 862 op/s 2023-07-21T22:57:18.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:17 smithi195 ceph-mon[97365]: pgmap v1213: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 862 op/s 2023-07-21T22:57:18.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.683+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2661323873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b68104a30 msgr2=0x7f4b68104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.683+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2661323873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b68104a30 0x7f4b68104e00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f4b580098f0 tx=0x7f4b58009c00 comp rx=0 tx=0).stop 2023-07-21T22:57:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.683+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2661323873 shutdown_connections 2023-07-21T22:57:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.683+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2661323873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b68104a30 0x7f4b68104e00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.683+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2661323873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b680ff3e0 0x7f4b6810b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.683+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2661323873 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b680fea30 0x7f4b680feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.683+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2661323873 >> 172.21.15.151:0/2661323873 conn(0x7f4b68074760 msgr2=0x7f4b68074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:18.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.683+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2661323873 shutdown_connections 2023-07-21T22:57:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.684+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2661323873 wait complete. 2023-07-21T22:57:18.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.685+0000 7f4b6d7ff700 1 Processor -- start 2023-07-21T22:57:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.686+0000 7f4b6d7ff700 1 -- start start 2023-07-21T22:57:18.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.686+0000 7f4b6d7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b680fea30 0x7f4b681084f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.686+0000 7f4b6d7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b680ff3e0 0x7f4b68108a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.686+0000 7f4b6d7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b68104a30 0x7f4b68199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.686+0000 7f4b6d7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68199d80 con 0x7f4b68104a30 2023-07-21T22:57:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.686+0000 7f4b6d7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b68199ef0 con 0x7f4b680fea30 2023-07-21T22:57:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.686+0000 7f4b6d7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6819a0b0 con 0x7f4b680ff3e0 2023-07-21T22:57:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.687+0000 7f4b667fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b680ff3e0 0x7f4b68108a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.687+0000 7f4b667fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b680ff3e0 0x7f4b68108a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39872/0 (socket says 172.21.15.151:39872) 2023-07-21T22:57:18.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.687+0000 7f4b667fc700 1 -- 172.21.15.151:0/2077573328 learned_addr learned my addr 172.21.15.151:0/2077573328 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.687+0000 7f4b66ffd700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b680fea30 0x7f4b681084f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.688+0000 7f4b66ffd700 1 -- 172.21.15.151:0/2077573328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b680ff3e0 msgr2=0x7f4b68108a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.688+0000 7f4b66ffd700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b680ff3e0 0x7f4b68108a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.688+0000 7f4b66ffd700 1 -- 172.21.15.151:0/2077573328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b68104a30 msgr2=0x7f4b68199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.688+0000 7f4b66ffd700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b68104a30 0x7f4b68199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.688+0000 7f4b66ffd700 1 -- 172.21.15.151:0/2077573328 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b58009520 con 0x7f4b680fea30 2023-07-21T22:57:18.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.689+0000 7f4b66ffd700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b680fea30 0x7f4b681084f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009230 tx=0x7f4b5800b560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:18.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.691+0000 7f4b4ffff700 1 -- 172.21.15.151:0/2077573328 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5801c070 con 0x7f4b680fea30 2023-07-21T22:57:18.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.691+0000 7f4b4ffff700 1 -- 172.21.15.151:0/2077573328 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b58005040 con 0x7f4b680fea30 2023-07-21T22:57:18.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.691+0000 7f4b4ffff700 1 -- 172.21.15.151:0/2077573328 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b58003970 con 0x7f4b680fea30 2023-07-21T22:57:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.696+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2077573328 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6819a330 con 0x7f4b680fea30 2023-07-21T22:57:18.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.697+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2077573328 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6819c9e0 con 0x7f4b680fea30 2023-07-21T22:57:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.703+0000 7f4b81213b80 1 Processor -- start 2023-07-21T22:57:18.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.704+0000 7f4b81213b80 1 -- start start 2023-07-21T22:57:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.705+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.705+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7210 0x55fa8f3e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.705+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3e7660 0x55fa8f3e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.705+0000 7f4b81213b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f2e6c50 con 0x55fa8f3e7210 2023-07-21T22:57:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.705+0000 7f4b81213b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f3399e0 con 0x55fa8f23d6b0 2023-07-21T22:57:18.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.705+0000 7f4b81213b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f332e70 con 0x55fa8f3e7660 2023-07-21T22:57:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.705+0000 7f4b667fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3e7660 0x55fa8f3e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.705+0000 7f4b667fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3e7660 0x55fa8f3e14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39880/0 (socket says 172.21.15.151:39880) 2023-07-21T22:57:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.706+0000 7f4b667fc700 1 -- 172.21.15.151:0/2313826987 learned_addr learned my addr 172.21.15.151:0/2313826987 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.706+0000 7f4b677fe700 1 --2- 172.21.15.151:0/2313826987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.706+0000 7f4b667fc700 1 -- 172.21.15.151:0/2313826987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 msgr2=0x55fa8f3e6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.706+0000 7f4b667fc700 1 --2- 172.21.15.151:0/2313826987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.706+0000 7f4b667fc700 1 -- 172.21.15.151:0/2313826987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7210 msgr2=0x55fa8f3e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.706+0000 7f4b667fc700 1 --2- 172.21.15.151:0/2313826987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7210 0x55fa8f3e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.706+0000 7f4b667fc700 1 -- 172.21.15.151:0/2313826987 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8f160d80 con 0x55fa8f3e7660 2023-07-21T22:57:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.707+0000 7f4b667fc700 1 --2- 172.21.15.151:0/2313826987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3e7660 0x55fa8f3e14a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00be20 tx=0x7f4b5c0106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e08a6417393c6c1b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:18.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.707+0000 7f4b4d7fa700 1 -- 172.21.15.151:0/2313826987 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c010ed0 con 0x55fa8f3e7660 2023-07-21T22:57:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.707+0000 7f4b4d7fa700 1 -- 172.21.15.151:0/2313826987 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b5c015070 con 0x55fa8f3e7660 2023-07-21T22:57:18.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.707+0000 7f4b4d7fa700 1 -- 172.21.15.151:0/2313826987 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c01a470 con 0x55fa8f3e7660 2023-07-21T22:57:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.709+0000 7f4b4ffff700 1 -- 172.21.15.151:0/2077573328 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4b58020070 con 0x7f4b680fea30 2023-07-21T22:57:18.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.710+0000 7f4b81213b80 1 -- 172.21.15.151:0/2313826987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3e7660 msgr2=0x55fa8f3e14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.710+0000 7f4b81213b80 1 --2- 172.21.15.151:0/2313826987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3e7660 0x55fa8f3e14a0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00be20 tx=0x7f4b5c0106b0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.711+0000 7f4b4ffff700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b500a1490 0x7f4b500a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.712+0000 7f4b4ffff700 1 -- 172.21.15.151:0/2077573328 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4b580cf150 con 0x7f4b680fea30 2023-07-21T22:57:18.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.713+0000 7f4b81213b80 1 -- 172.21.15.151:0/2313826987 shutdown_connections 2023-07-21T22:57:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.713+0000 7f4b81213b80 1 --2- 172.21.15.151:0/2313826987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.713+0000 7f4b81213b80 1 --2- 172.21.15.151:0/2313826987 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3e7660 0x55fa8f3e14a0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.713+0000 7f4b81213b80 1 --2- 172.21.15.151:0/2313826987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7210 0x55fa8f3e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.713+0000 7f4b81213b80 1 -- 172.21.15.151:0/2313826987 >> 172.21.15.151:0/2313826987 conn(0x55fa8f3d6ae0 msgr2=0x55fa8f3dc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:18.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.715+0000 7f4b677fe700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b500a1490 0x7f4b500a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.717+0000 7f4b81213b80 1 -- 172.21.15.151:0/2313826987 shutdown_connections 2023-07-21T22:57:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.719+0000 7f4b81213b80 1 -- 172.21.15.151:0/2313826987 wait complete. 2023-07-21T22:57:18.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.720+0000 7f4b81213b80 1 -- start start 2023-07-21T22:57:18.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.720+0000 7f4b81213b80 1 Processor -- start 2023-07-21T22:57:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.721+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3ed570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.721+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3e7210 0x55fa8f3ea860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.721+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7660 0x55fa8f3eaee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.721+0000 7f4b81213b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f2d2a60 con 0x55fa8f3e7660 2023-07-21T22:57:18.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.721+0000 7f4b81213b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f2d2760 con 0x55fa8f3e7210 2023-07-21T22:57:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.721+0000 7f4b81213b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f1b68c0 con 0x55fa8f23d6b0 2023-07-21T22:57:18.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.721+0000 7f4b81213b80 10 client.0 _ll_register_callbacks cb 0x55fa8f2d0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:18.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.722+0000 7f4b66ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.722+0000 7f4b66ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3ed570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39896/0 (socket says 172.21.15.151:39896) 2023-07-21T22:57:18.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.722+0000 7f4b66ffd700 1 -- 172.21.15.151:0/1608211834 learned_addr learned my addr 172.21.15.151:0/1608211834 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:18.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.722+0000 7f4b677fe700 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7660 0x55fa8f3eaee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.723+0000 7f4b667fc700 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3e7210 0x55fa8f3ea860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.723+0000 7f4b677fe700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b500a1490 0x7f4b500a3940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000f4a0 tx=0x7f4b6000d040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:18.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.723+0000 7f4b677fe700 1 -- 172.21.15.151:0/1608211834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 msgr2=0x55fa8f3ed570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:18.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.723+0000 7f4b677fe700 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3ed570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.723+0000 7f4b677fe700 1 -- 172.21.15.151:0/1608211834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3e7210 msgr2=0x55fa8f3ea860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:18.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.723+0000 7f4b677fe700 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3e7210 0x55fa8f3ea860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.723+0000 7f4b677fe700 1 -- 172.21.15.151:0/1608211834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b5c00ba50 con 0x55fa8f3e7660 2023-07-21T22:57:18.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.724+0000 7f4b677fe700 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7660 0x55fa8f3eaee0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009fd0 tx=0x7f4b600099e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8288d289bf4d13a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.724+0000 7f4b4aff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:57:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.725+0000 7f4b4aff5700 1 -- 172.21.15.151:0/1608211834 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60010040 con 0x55fa8f3e7660 2023-07-21T22:57:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.725+0000 7f4b4aff5700 1 -- 172.21.15.151:0/1608211834 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4b60016b70 con 0x55fa8f3e7660 2023-07-21T22:57:18.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.725+0000 7f4b81213b80 1 -- 172.21.15.151:0/1608211834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa8f28c490 con 0x55fa8f3e7660 2023-07-21T22:57:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.725+0000 7f4b4aff5700 1 -- 172.21.15.151:0/1608211834 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b60016d30 con 0x55fa8f3e7660 2023-07-21T22:57:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.725+0000 7f4b81213b80 10 client.19272 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.725+0000 7f4b81213b80 1 -- 172.21.15.151:0/1608211834 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55fa8f149c00 con 0x55fa8f3e7660 2023-07-21T22:57:18.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.726+0000 7f4b4aff5700 1 -- 172.21.15.151:0/1608211834 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55fa8f28c490 con 0x55fa8f3e7660 2023-07-21T22:57:18.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.726+0000 7f4b4aff5700 1 -- 172.21.15.151:0/1608211834 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4b60004020 con 0x55fa8f3e7660 2023-07-21T22:57:18.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.726+0000 7f4b81213b80 10 client.19272 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:18.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.726+0000 7f4b81213b80 10 client.19272 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.726+0000 7f4b81213b80 20 client.19272 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.726+0000 7f4b81213b80 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa8f3fabb0 0x55fa8f3fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.726+0000 7f4b81213b80 4 client.19272 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:57:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.726+0000 7f4b81213b80 1 -- 172.21.15.151:0/1608211834 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa8f32be50 con 0x55fa8f3fabb0 2023-07-21T22:57:18.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.727+0000 7f4b66ffd700 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa8f3fabb0 0x55fa8f3fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.734+0000 7f4b66ffd700 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa8f3fabb0 0x55fa8f3fcfc0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb70875ac3ce855b server_cookie=221c9ff6822248c in_seq=0 out_seq=0 2023-07-21T22:57:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.735+0000 7f4b4aff5700 10 client.19272 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.735+0000 7f4b4aff5700 1 -- 172.21.15.151:0/1608211834 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55fa8f32be50 con 0x55fa8f3fabb0 2023-07-21T22:57:18.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.735+0000 7f4b4aff5700 10 client.19272 handle_command_reply: tid=0 2023-07-21T22:57:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.736+0000 7f4b81213b80 1 client.19272 shutdown 2023-07-21T22:57:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 -- 172.21.15.151:0/1608211834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7660 msgr2=0x55fa8f3eaee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7660 0x55fa8f3eaee0 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009fd0 tx=0x7f4b600099e0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 -- 172.21.15.151:0/1608211834 shutdown_connections 2023-07-21T22:57:18.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa8f3fabb0 0x55fa8f3fcfc0 crc :-1 s=READY pgs=439 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3e7660 0x55fa8f3eaee0 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3ed570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 --2- 172.21.15.151:0/1608211834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3e7210 0x55fa8f3ea860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 -- 172.21.15.151:0/1608211834 >> 172.21.15.151:0/1608211834 conn(0x55fa8f3d6ae0 msgr2=0x55fa8f3db3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:18.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b4aff5700 0 client.19272 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 -- 172.21.15.151:0/1608211834 shutdown_connections 2023-07-21T22:57:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.737+0000 7f4b81213b80 1 -- 172.21.15.151:0/1608211834 wait complete. 2023-07-21T22:57:18.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.744+0000 7f4b81213b80 20 client.19272 trim_cache size 0 max 16384 2023-07-21T22:57:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.772+0000 7f4b81213b80 1 Processor -- start 2023-07-21T22:57:18.806 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.772+0000 7f4b81213b80 1 -- start start 2023-07-21T22:57:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.772+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 0x55fa8f3f1bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.772+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3d6ae0 0x55fa8f3e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.772+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e8330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.807 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.772+0000 7f4b81213b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f3d8c00 con 0x55fa8f3f66b0 2023-07-21T22:57:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.772+0000 7f4b81213b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f3eb7f0 con 0x55fa8f23d6b0 2023-07-21T22:57:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.772+0000 7f4b81213b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f3e1f20 con 0x55fa8f3d6ae0 2023-07-21T22:57:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b677fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b66ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 0x55fa8f3f1bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b677fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e8330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36542/0 (socket says 172.21.15.151:36542) 2023-07-21T22:57:18.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b677fe700 1 -- 172.21.15.151:0/3695001875 learned_addr learned my addr 172.21.15.151:0/3695001875 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b667fc700 1 --2- 172.21.15.151:0/3695001875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3d6ae0 0x55fa8f3e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b677fe700 1 -- 172.21.15.151:0/3695001875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3d6ae0 msgr2=0x55fa8f3e0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b677fe700 1 --2- 172.21.15.151:0/3695001875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3d6ae0 0x55fa8f3e0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b677fe700 1 -- 172.21.15.151:0/3695001875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 msgr2=0x55fa8f3f1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:18.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b677fe700 1 --2- 172.21.15.151:0/3695001875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 0x55fa8f3f1bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.773+0000 7f4b677fe700 1 -- 172.21.15.151:0/3695001875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8f1871f0 con 0x55fa8f23d6b0 2023-07-21T22:57:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.774+0000 7f4b677fe700 1 --2- 172.21.15.151:0/3695001875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e8330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b60004380 tx=0x7f4b60006160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74a280bddedc30ce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.775+0000 7f4b4dffb700 1 -- 172.21.15.151:0/3695001875 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000fd60 con 0x55fa8f23d6b0 2023-07-21T22:57:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.775+0000 7f4b4dffb700 1 -- 172.21.15.151:0/3695001875 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b6000fec0 con 0x55fa8f23d6b0 2023-07-21T22:57:18.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.775+0000 7f4b4dffb700 1 -- 172.21.15.151:0/3695001875 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60004050 con 0x55fa8f23d6b0 2023-07-21T22:57:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.776+0000 7f4b81213b80 1 -- 172.21.15.151:0/3695001875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 msgr2=0x55fa8f3e8330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.776+0000 7f4b81213b80 1 --2- 172.21.15.151:0/3695001875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e8330 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f4b60004380 tx=0x7f4b60006160 comp rx=0 tx=0).stop 2023-07-21T22:57:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.776+0000 7f4b81213b80 1 -- 172.21.15.151:0/3695001875 shutdown_connections 2023-07-21T22:57:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.776+0000 7f4b81213b80 1 --2- 172.21.15.151:0/3695001875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3e8330 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.776+0000 7f4b81213b80 1 --2- 172.21.15.151:0/3695001875 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 0x55fa8f3f1bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.776+0000 7f4b81213b80 1 --2- 172.21.15.151:0/3695001875 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f3d6ae0 0x55fa8f3e0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.776+0000 7f4b81213b80 1 -- 172.21.15.151:0/3695001875 >> 172.21.15.151:0/3695001875 conn(0x55fa8f3e4cf0 msgr2=0x55fa8f3e5f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.776+0000 7f4b81213b80 1 -- 172.21.15.151:0/3695001875 shutdown_connections 2023-07-21T22:57:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.776+0000 7f4b81213b80 1 -- 172.21.15.151:0/3695001875 wait complete. 2023-07-21T22:57:18.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.777+0000 7f4b81213b80 1 -- start start 2023-07-21T22:57:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.777+0000 7f4b81213b80 1 Processor -- start 2023-07-21T22:57:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3f1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3d6ae0 0x55fa8f3effe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b81213b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 0x55fa8f3f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b81213b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f3f0c70 con 0x55fa8f3f66b0 2023-07-21T22:57:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b81213b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f3f0de0 con 0x55fa8f3d6ae0 2023-07-21T22:57:18.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b81213b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8f44ea40 con 0x55fa8f23d6b0 2023-07-21T22:57:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b81213b80 10 client.0 _ll_register_callbacks cb 0x7f4b60018800 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b66ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3f1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b66ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3f1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39916/0 (socket says 172.21.15.151:39916) 2023-07-21T22:57:18.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b66ffd700 1 -- 172.21.15.151:0/678810577 learned_addr learned my addr 172.21.15.151:0/678810577 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.778+0000 7f4b667fc700 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3d6ae0 0x55fa8f3effe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b677fe700 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 0x55fa8f3f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b66ffd700 1 -- 172.21.15.151:0/678810577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3d6ae0 msgr2=0x55fa8f3effe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b66ffd700 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3d6ae0 0x55fa8f3effe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b66ffd700 1 -- 172.21.15.151:0/678810577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 msgr2=0x55fa8f3f05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b66ffd700 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 0x55fa8f3f05a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b66ffd700 1 -- 172.21.15.151:0/678810577 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa8f149c00 con 0x55fa8f23d6b0 2023-07-21T22:57:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b677fe700 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 0x55fa8f3f05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:57:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b66ffd700 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3f1cd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4b5809c000 tx=0x7f4b58098040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8db4f52b0fc63c54 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b4aff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:57:18.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.779+0000 7f4b4aff5700 1 -- 172.21.15.151:0/678810577 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b580a46c0 con 0x55fa8f23d6b0 2023-07-21T22:57:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b4aff5700 1 -- 172.21.15.151:0/678810577 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4b5809a6a0 con 0x55fa8f23d6b0 2023-07-21T22:57:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b81213b80 1 -- 172.21.15.151:0/678810577 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4b5c015070 con 0x55fa8f23d6b0 2023-07-21T22:57:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b4aff5700 1 -- 172.21.15.151:0/678810577 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4b580a20b0 con 0x55fa8f23d6b0 2023-07-21T22:57:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b81213b80 10 client.28993 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b81213b80 1 -- 172.21.15.151:0/678810577 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55fa8f15f250 con 0x55fa8f23d6b0 2023-07-21T22:57:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b4aff5700 1 -- 172.21.15.151:0/678810577 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4b5c015070 con 0x55fa8f23d6b0 2023-07-21T22:57:18.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b4aff5700 1 -- 172.21.15.151:0/678810577 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f4b580ccae0 con 0x55fa8f23d6b0 2023-07-21T22:57:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b81213b80 10 client.28993 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b81213b80 10 client.28993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b81213b80 20 client.28993 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b81213b80 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa8f3e7210 0x55fa8f451db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b81213b80 4 client.28993 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:57:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.780+0000 7f4b81213b80 1 -- 172.21.15.151:0/678810577 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55fa8f2edff0 con 0x55fa8f3e7210 2023-07-21T22:57:18.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.781+0000 7f4b667fc700 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa8f3e7210 0x55fa8f451db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.781+0000 7f4b4aff5700 10 client.28993 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:18.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.781+0000 7f4b667fc700 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa8f3e7210 0x55fa8f451db0 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f2e83d750ebd19e server_cookie=85987f882759c9e4 in_seq=0 out_seq=0 2023-07-21T22:57:18.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.802+0000 7f4b4aff5700 1 -- 172.21.15.151:0/678810577 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55fa8f2edff0 con 0x55fa8f3e7210 2023-07-21T22:57:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.802+0000 7f4b4aff5700 10 client.28993 handle_command_reply: tid=0 2023-07-21T22:57:18.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.802+0000 7f4b81213b80 1 client.28993 shutdown 2023-07-21T22:57:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.803+0000 7f4b81213b80 1 -- 172.21.15.151:0/678810577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 msgr2=0x55fa8f3f1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.803+0000 7f4b81213b80 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3f1cd0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f4b5809c000 tx=0x7f4b58098040 comp rx=0 tx=0).stop 2023-07-21T22:57:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.803+0000 7f4b81213b80 1 -- 172.21.15.151:0/678810577 shutdown_connections 2023-07-21T22:57:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.803+0000 7f4b81213b80 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55fa8f3e7210 0x55fa8f451db0 crc :-1 s=READY pgs=440 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.803+0000 7f4b81213b80 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fa8f3f66b0 0x55fa8f3f05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.803+0000 7f4b81213b80 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55fa8f23d6b0 0x55fa8f3f1cd0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.803+0000 7f4b81213b80 1 --2- 172.21.15.151:0/678810577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55fa8f3d6ae0 0x55fa8f3effe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.803+0000 7f4b81213b80 1 -- 172.21.15.151:0/678810577 >> 172.21.15.151:0/678810577 conn(0x55fa8f3e4cf0 msgr2=0x55fa8f3e8330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.803+0000 7f4b4aff5700 0 client.28993 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.804+0000 7f4b81213b80 1 -- 172.21.15.151:0/678810577 shutdown_connections 2023-07-21T22:57:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.804+0000 7f4b81213b80 1 -- 172.21.15.151:0/678810577 wait complete. 2023-07-21T22:57:18.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.804+0000 7f4b81213b80 20 client.28993 trim_cache size 0 max 16384 2023-07-21T22:57:18.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:57:18.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:57:18.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:57:18.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:57:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2077573328 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b500a1490 msgr2=0x7f4b500a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b500a1490 0x7f4b500a3940 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f4b6000f4a0 tx=0x7f4b6000d040 comp rx=0 tx=0).stop 2023-07-21T22:57:18.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2077573328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b680fea30 msgr2=0x7f4b681084f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b680fea30 0x7f4b681084f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f4b58009230 tx=0x7f4b5800b560 comp rx=0 tx=0).stop 2023-07-21T22:57:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2077573328 shutdown_connections 2023-07-21T22:57:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4b500a1490 0x7f4b500a3940 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b680fea30 0x7f4b681084f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4b68104a30 0x7f4b68199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 --2- 172.21.15.151:0/2077573328 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4b680ff3e0 0x7f4b68108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.805+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2077573328 >> 172.21.15.151:0/2077573328 conn(0x7f4b68074760 msgr2=0x7f4b6810c020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:18.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.806+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2077573328 shutdown_connections 2023-07-21T22:57:18.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:18.806+0000 7f4b6d7ff700 1 -- 172.21.15.151:0/2077573328 wait complete. 2023-07-21T22:57:19.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 265.0 s, 330.5 tps, lat 302.175 ms stddev 114.770 2023-07-21T22:57:21.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:20 smithi187 ceph-mon[96918]: pgmap v1214: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 862 op/s 2023-07-21T22:57:21.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:20 smithi195 ceph-mon[97365]: pgmap v1214: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 862 op/s 2023-07-21T22:57:21.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:20 smithi151 ceph-mon[95510]: pgmap v1214: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 862 op/s 2023-07-21T22:57:23.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:22 smithi187 ceph-mon[96918]: pgmap v1215: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 862 op/s 2023-07-21T22:57:23.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:22 smithi195 ceph-mon[97365]: pgmap v1215: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 862 op/s 2023-07-21T22:57:23.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:22 smithi151 ceph-mon[95510]: pgmap v1215: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 10 MiB/s wr, 862 op/s 2023-07-21T22:57:24.293 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 270.0 s, 364.8 tps, lat 275.491 ms stddev 78.780 2023-07-21T22:57:25.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:24 smithi187 ceph-mon[96918]: pgmap v1216: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 13 MiB/s wr, 1.13k op/s 2023-07-21T22:57:25.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:24 smithi195 ceph-mon[97365]: pgmap v1216: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 13 MiB/s wr, 1.13k op/s 2023-07-21T22:57:25.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:24 smithi151 ceph-mon[95510]: pgmap v1216: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 13 MiB/s wr, 1.13k op/s 2023-07-21T22:57:27.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:26 smithi195 ceph-mon[97365]: pgmap v1217: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.0 MiB/s wr, 773 op/s 2023-07-21T22:57:27.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:26 smithi151 ceph-mon[95510]: pgmap v1217: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.0 MiB/s wr, 773 op/s 2023-07-21T22:57:27.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:26 smithi187 ceph-mon[96918]: pgmap v1217: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 9.0 MiB/s wr, 773 op/s 2023-07-21T22:57:28.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:27 smithi195 ceph-mon[97365]: pgmap v1218: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-07-21T22:57:28.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:27 smithi151 ceph-mon[95510]: pgmap v1218: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-07-21T22:57:28.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:27 smithi187 ceph-mon[96918]: pgmap v1218: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 14 MiB/s wr, 1.20k op/s 2023-07-21T22:57:29.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 275.0 s, 409.4 tps, lat 251.387 ms stddev 83.340 2023-07-21T22:57:31.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:30 smithi187 ceph-mon[96918]: pgmap v1219: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.5 MiB/s wr, 825 op/s 2023-07-21T22:57:31.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:30 smithi195 ceph-mon[97365]: pgmap v1219: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.5 MiB/s wr, 825 op/s 2023-07-21T22:57:31.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:30 smithi151 ceph-mon[95510]: pgmap v1219: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.5 MiB/s wr, 825 op/s 2023-07-21T22:57:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.039+0000 7f8aad1ff700 1 -- 172.21.15.151:0/4159220924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8107c60 msgr2=0x7f8aa81103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.039+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/4159220924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8107c60 0x7f8aa81103c0 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0098f0 tx=0x7f8a9c009c00 comp rx=0 tx=0).stop 2023-07-21T22:57:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.039+0000 7f8aad1ff700 1 -- 172.21.15.151:0/4159220924 shutdown_connections 2023-07-21T22:57:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.039+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/4159220924 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8aa8110900 0x7f8aa8112ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.039+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/4159220924 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa8107350 0x7f8aa8107720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.039+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/4159220924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8107c60 0x7f8aa81103c0 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.039+0000 7f8aad1ff700 1 -- 172.21.15.151:0/4159220924 >> 172.21.15.151:0/4159220924 conn(0x7f8aa8075a00 msgr2=0x7f8aa8077e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.039+0000 7f8aad1ff700 1 -- 172.21.15.151:0/4159220924 shutdown_connections 2023-07-21T22:57:32.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.039+0000 7f8aad1ff700 1 -- 172.21.15.151:0/4159220924 wait complete. 2023-07-21T22:57:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.041+0000 7f8aad1ff700 1 Processor -- start 2023-07-21T22:57:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.041+0000 7f8aad1ff700 1 -- start start 2023-07-21T22:57:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.041+0000 7f8aad1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa8107350 0x7f8aa8071b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.041+0000 7f8aad1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8aa8107c60 0x7f8aa80720b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.041+0000 7f8aad1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8110900 0x7f8aa806aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.041+0000 7f8aad1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa806b1e0 con 0x7f8aa8110900 2023-07-21T22:57:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.041+0000 7f8aad1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa806b350 con 0x7f8aa8107c60 2023-07-21T22:57:32.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.041+0000 7f8aad1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aa806b510 con 0x7f8aa8107350 2023-07-21T22:57:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.042+0000 7f8aa759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8110900 0x7f8aa806aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.042+0000 7f8aa759e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8110900 0x7f8aa806aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33840/0 (socket says 172.21.15.151:33840) 2023-07-21T22:57:32.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.042+0000 7f8aa759e700 1 -- 172.21.15.151:0/627236904 learned_addr learned my addr 172.21.15.151:0/627236904 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:32.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.043+0000 7f8aa759e700 1 -- 172.21.15.151:0/627236904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa8107350 msgr2=0x7f8aa8071b30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T22:57:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.043+0000 7f8aa759e700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa8107350 0x7f8aa8071b30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.043+0000 7f8aa759e700 1 -- 172.21.15.151:0/627236904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8aa8107c60 msgr2=0x7f8aa80720b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T22:57:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.043+0000 7f8aa759e700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8aa8107c60 0x7f8aa80720b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.043+0000 7f8aa759e700 1 -- 172.21.15.151:0/627236904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0009d00 con 0x7f8aa8110900 2023-07-21T22:57:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.043+0000 7f8aa759e700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8110900 0x7f8aa806aa50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000c110 tx=0x7f8aa000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.043+0000 7f8a8ffff700 1 -- 172.21.15.151:0/627236904 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa000e050 con 0x7f8aa8110900 2023-07-21T22:57:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.044+0000 7f8a8ffff700 1 -- 172.21.15.151:0/627236904 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8aa000f040 con 0x7f8aa8110900 2023-07-21T22:57:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.044+0000 7f8a8ffff700 1 -- 172.21.15.151:0/627236904 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0007b80 con 0x7f8aa8110900 2023-07-21T22:57:32.082 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.044+0000 7f8aad1ff700 1 -- 172.21.15.151:0/627236904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a9c009520 con 0x7f8aa8110900 2023-07-21T22:57:32.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.044+0000 7f8aad1ff700 1 -- 172.21.15.151:0/627236904 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aa806f8a0 con 0x7f8aa8110900 2023-07-21T22:57:32.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.050+0000 7f8a8ffff700 1 -- 172.21.15.151:0/627236904 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f8aa0007ce0 con 0x7f8aa8110900 2023-07-21T22:57:32.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.051+0000 7f8ac0ae9b80 1 Processor -- start 2023-07-21T22:57:32.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.052+0000 7f8ac0ae9b80 1 -- start start 2023-07-21T22:57:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.052+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.052+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21145f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.052+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f211464a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.052+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f2104bc50 con 0x557f20fa26b0 2023-07-21T22:57:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.052+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f2109e9e0 con 0x557f2114c210 2023-07-21T22:57:32.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.052+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f21097e70 con 0x557f2114c660 2023-07-21T22:57:32.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.053+0000 7f8aa659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.053+0000 7f8aa659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33854/0 (socket says 172.21.15.151:33854) 2023-07-21T22:57:32.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.053+0000 7f8aa659c700 1 -- 172.21.15.151:0/4073710096 learned_addr learned my addr 172.21.15.151:0/4073710096 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:32.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.053+0000 7f8aa659c700 1 --2- 172.21.15.151:0/4073710096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f211464a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.054+0000 7f8a8ffff700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a900a13c0 0x7f8a900a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.054+0000 7f8aa659c700 1 -- 172.21.15.151:0/4073710096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 msgr2=0x557f21145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.054+0000 7f8aa659c700 1 --2- 172.21.15.151:0/4073710096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.054+0000 7f8aa659c700 1 -- 172.21.15.151:0/4073710096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 msgr2=0x557f2114bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.054+0000 7f8aa659c700 1 --2- 172.21.15.151:0/4073710096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.054+0000 7f8aa659c700 1 -- 172.21.15.151:0/4073710096 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f20ec5d80 con 0x557f2114c660 2023-07-21T22:57:32.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.054+0000 7f8a8ffff700 1 -- 172.21.15.151:0/627236904 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8aa00cc980 con 0x7f8aa8110900 2023-07-21T22:57:32.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.055+0000 7f8aa659c700 1 --2- 172.21.15.151:0/4073710096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f211464a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009810 tx=0x7f8a9c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b810d3efd177c43 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.055+0000 7f8a8d7fa700 1 -- 172.21.15.151:0/4073710096 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00fbc0 con 0x557f2114c660 2023-07-21T22:57:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.055+0000 7f8a8d7fa700 1 -- 172.21.15.151:0/4073710096 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a9c005560 con 0x557f2114c660 2023-07-21T22:57:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.055+0000 7f8a8d7fa700 1 -- 172.21.15.151:0/4073710096 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00b560 con 0x557f2114c660 2023-07-21T22:57:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.055+0000 7f8aa759e700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a900a13c0 0x7f8a900a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.056+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/4073710096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 msgr2=0x557f211464a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.056+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/4073710096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f211464a0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c009810 tx=0x7f8a9c000bc0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.056+0000 7f8aa759e700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a900a13c0 0x7f8a900a3870 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00090a0 tx=0x7f8aa00b9040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.056+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/4073710096 shutdown_connections 2023-07-21T22:57:32.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.056+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/4073710096 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f211464a0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.056+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/4073710096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.056+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/4073710096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.056+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/4073710096 >> 172.21.15.151:0/4073710096 conn(0x557f2113bae0 msgr2=0x557f211410e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:32.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.057+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/4073710096 shutdown_connections 2023-07-21T22:57:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.058+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/4073710096 wait complete. 2023-07-21T22:57:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.058+0000 7f8ac0ae9b80 1 -- start start 2023-07-21T22:57:32.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.059+0000 7f8ac0ae9b80 1 Processor -- start 2023-07-21T22:57:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f211555c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21155b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f2114f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f21037a60 con 0x557f20fa26b0 2023-07-21T22:57:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f21037760 con 0x557f2114c210 2023-07-21T22:57:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f20f1b8c0 con 0x557f2114c660 2023-07-21T22:57:32.098 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8ac0ae9b80 10 client.0 _ll_register_callbacks cb 0x557f21035700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8aa6d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8aa6d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49960/0 (socket says 172.21.15.151:49960) 2023-07-21T22:57:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8aa6d9d700 1 -- 172.21.15.151:0/2803714272 learned_addr learned my addr 172.21.15.151:0/2803714272 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:32.099 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.060+0000 7f8aa659c700 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f211555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.061+0000 7f8aa659c700 1 -- 172.21.15.151:0/2803714272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 msgr2=0x557f2114f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.061+0000 7f8aa659c700 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f2114f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.061+0000 7f8aa659c700 1 -- 172.21.15.151:0/2803714272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 msgr2=0x557f21155b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.061+0000 7f8aa659c700 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21155b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.100 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.061+0000 7f8aa659c700 1 -- 172.21.15.151:0/2803714272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a9c020040 con 0x557f20fa26b0 2023-07-21T22:57:32.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.061+0000 7f8aa6d9d700 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.061+0000 7f8aa659c700 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f211555c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c005850 tx=0x7f8a9c005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b08ff464b3aed4d9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.062+0000 7f8a8aff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:57:32.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.062+0000 7f8a8aff5700 1 -- 172.21.15.151:0/2803714272 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00f770 con 0x557f20fa26b0 2023-07-21T22:57:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.062+0000 7f8a8aff5700 1 -- 172.21.15.151:0/2803714272 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8a9c000e40 con 0x557f20fa26b0 2023-07-21T22:57:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.062+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/2803714272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f21090e50 con 0x557f20fa26b0 2023-07-21T22:57:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.063+0000 7f8a8aff5700 1 -- 172.21.15.151:0/2803714272 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a9c00f8d0 con 0x557f20fa26b0 2023-07-21T22:57:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.063+0000 7f8ac0ae9b80 10 client.19290 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.063+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/2803714272 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x557f20eaec00 con 0x557f20fa26b0 2023-07-21T22:57:32.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.064+0000 7f8a8aff5700 1 -- 172.21.15.151:0/2803714272 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557f21090e50 con 0x557f20fa26b0 2023-07-21T22:57:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.064+0000 7f8a8aff5700 1 -- 172.21.15.151:0/2803714272 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8a9c015020 con 0x557f20fa26b0 2023-07-21T22:57:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.064+0000 7f8ac0ae9b80 10 client.19290 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.064+0000 7f8ac0ae9b80 10 client.19290 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.064+0000 7f8ac0ae9b80 20 client.19290 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.064+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f2115f630 0x557f21161a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.064+0000 7f8ac0ae9b80 4 client.19290 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:57:32.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.064+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/2803714272 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f21052ff0 con 0x557f2115f630 2023-07-21T22:57:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.065+0000 7f8aa6d9d700 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f2115f630 0x557f21161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.065+0000 7f8aa6d9d700 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f2115f630 0x557f21161a40 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3d1103455bc0041 server_cookie=597de4ff4a9452c0 in_seq=0 out_seq=0 2023-07-21T22:57:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.065+0000 7f8a8aff5700 10 client.19290 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.066+0000 7f8a8aff5700 1 -- 172.21.15.151:0/2803714272 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557f21052ff0 con 0x557f2115f630 2023-07-21T22:57:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.066+0000 7f8a8aff5700 10 client.19290 handle_command_reply: tid=0 2023-07-21T22:57:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.067+0000 7f8ac0ae9b80 1 client.19290 shutdown 2023-07-21T22:57:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/2803714272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 msgr2=0x557f211555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f211555c0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c005850 tx=0x7f8a9c005e50 comp rx=0 tx=0).stop 2023-07-21T22:57:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/2803714272 shutdown_connections 2023-07-21T22:57:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f2115f630 0x557f21161a40 crc :-1 s=READY pgs=441 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f2114f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f211555c0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/2803714272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21155b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/2803714272 >> 172.21.15.151:0/2803714272 conn(0x557f2113bae0 msgr2=0x557f211403e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8a8aff5700 0 client.19290 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:32.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/2803714272 shutdown_connections 2023-07-21T22:57:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.068+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/2803714272 wait complete. 2023-07-21T22:57:32.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.069+0000 7f8ac0ae9b80 20 client.19290 trim_cache size 0 max 16384 2023-07-21T22:57:32.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.096+0000 7f8ac0ae9b80 1 Processor -- start 2023-07-21T22:57:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.097+0000 7f8ac0ae9b80 1 -- start start 2023-07-21T22:57:32.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.097+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.097+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21145f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.097+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f21146480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.097+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f21146cc0 con 0x557f20fa26b0 2023-07-21T22:57:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.097+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f21141cb0 con 0x557f2114c210 2023-07-21T22:57:32.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.097+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f21141e50 con 0x557f2114c660 2023-07-21T22:57:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.098+0000 7f8aa659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f21146480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.098+0000 7f8aa659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.098+0000 7f8aa659c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114b1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33870/0 (socket says 172.21.15.151:33870) 2023-07-21T22:57:32.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.098+0000 7f8aa659c700 1 -- 172.21.15.151:0/981701819 learned_addr learned my addr 172.21.15.151:0/981701819 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:32.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.100+0000 7f8aa6d9d700 1 --2- 172.21.15.151:0/981701819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.100+0000 7f8aa659c700 1 -- 172.21.15.151:0/981701819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 msgr2=0x557f21145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.100+0000 7f8aa659c700 1 --2- 172.21.15.151:0/981701819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21145f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.100+0000 7f8aa659c700 1 -- 172.21.15.151:0/981701819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 msgr2=0x557f2114b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.100+0000 7f8aa659c700 1 --2- 172.21.15.151:0/981701819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114b1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.100+0000 7f8aa659c700 1 -- 172.21.15.151:0/981701819 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f21166630 con 0x557f2114c660 2023-07-21T22:57:32.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.101+0000 7f8aa659c700 1 --2- 172.21.15.151:0/981701819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f21146480 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0094f0 tx=0x7f8a9c000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3c870d049aeb77f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.102+0000 7f8a8dffb700 1 -- 172.21.15.151:0/981701819 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c00f770 con 0x557f2114c660 2023-07-21T22:57:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.102+0000 7f8a8dffb700 1 -- 172.21.15.151:0/981701819 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8a9c00f8d0 con 0x557f2114c660 2023-07-21T22:57:32.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.102+0000 7f8a8dffb700 1 -- 172.21.15.151:0/981701819 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a9c017400 con 0x557f2114c660 2023-07-21T22:57:32.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.103+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/981701819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 msgr2=0x557f21146480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.103+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/981701819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f21146480 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8a9c0094f0 tx=0x7f8a9c000bc0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.140 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.106+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/981701819 shutdown_connections 2023-07-21T22:57:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.106+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/981701819 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c660 0x557f21146480 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.106+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/981701819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f20fa26b0 0x557f2114b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.141 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.106+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/981701819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f2114c210 0x557f21145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.142 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.106+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/981701819 >> 172.21.15.151:0/981701819 conn(0x557f2113bae0 msgr2=0x557f2114f830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.107+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/981701819 shutdown_connections 2023-07-21T22:57:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.107+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/981701819 wait complete. 2023-07-21T22:57:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.108+0000 7f8ac0ae9b80 1 -- start start 2023-07-21T22:57:32.143 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.108+0000 7f8ac0ae9b80 1 Processor -- start 2023-07-21T22:57:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f20fa26b0 0x557f211ac490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.146 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c210 0x557f211ac9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8ac0ae9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f2114c660 0x557f211acf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f211a7490 con 0x557f2114c660 2023-07-21T22:57:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f211a7600 con 0x557f20fa26b0 2023-07-21T22:57:32.147 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8ac0ae9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f211a77c0 con 0x557f2114c210 2023-07-21T22:57:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8ac0ae9b80 10 client.0 _ll_register_callbacks cb 0x7f8aa0009880 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8aa6d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c210 0x557f211ac9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.148 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8aa6d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c210 0x557f211ac9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34402/0 (socket says 172.21.15.151:34402) 2023-07-21T22:57:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8aa6d9d700 1 -- 172.21.15.151:0/1479384253 learned_addr learned my addr 172.21.15.151:0/1479384253 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8aa659c700 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f20fa26b0 0x557f211ac490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.109+0000 7f8aa659c700 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f2114c660 0x557f211acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.149 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.110+0000 7f8aa6d9d700 1 -- 172.21.15.151:0/1479384253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f20fa26b0 msgr2=0x557f211ac490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.110+0000 7f8aa6d9d700 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f20fa26b0 0x557f211ac490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.110+0000 7f8aa6d9d700 1 -- 172.21.15.151:0/1479384253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f2114c660 msgr2=0x557f211acf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.110+0000 7f8aa6d9d700 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f2114c660 0x557f211acf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.150 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.110+0000 7f8aa6d9d700 1 -- 172.21.15.151:0/1479384253 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f20eaec00 con 0x557f2114c210 2023-07-21T22:57:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.110+0000 7f8aa6d9d700 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c210 0x557f211ac9d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x557f21162310 tx=0x7f8a98019510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=644da7443b0bd4c9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.110+0000 7f8a8aff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:57:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.111+0000 7f8a8aff5700 1 -- 172.21.15.151:0/1479384253 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a98004260 con 0x557f2114c210 2023-07-21T22:57:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.111+0000 7f8a8aff5700 1 -- 172.21.15.151:0/1479384253 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8a980043c0 con 0x557f2114c210 2023-07-21T22:57:32.151 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.111+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/1479384253 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f20ff1490 con 0x557f2114c210 2023-07-21T22:57:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.111+0000 7f8a8aff5700 1 -- 172.21.15.151:0/1479384253 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8a98004580 con 0x557f2114c210 2023-07-21T22:57:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.111+0000 7f8ac0ae9b80 10 client.29005 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.111+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/1479384253 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x557f20eec1f0 con 0x557f2114c210 2023-07-21T22:57:32.152 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.112+0000 7f8a8aff5700 1 -- 172.21.15.151:0/1479384253 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557f20ff1490 con 0x557f2114c210 2023-07-21T22:57:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.112+0000 7f8a8aff5700 1 -- 172.21.15.151:0/1479384253 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f8a98003680 con 0x557f2114c210 2023-07-21T22:57:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.112+0000 7f8ac0ae9b80 10 client.29005 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:32.153 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.112+0000 7f8ac0ae9b80 10 client.29005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.112+0000 7f8ac0ae9b80 20 client.29005 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.112+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f211c50a0 0x557f211c74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.112+0000 7f8ac0ae9b80 4 client.29005 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:57:32.154 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.112+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/1479384253 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557f20ee6f10 con 0x557f211c50a0 2023-07-21T22:57:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.113+0000 7f8aa659c700 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f211c50a0 0x557f211c74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.113+0000 7f8aa659c700 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f211c50a0 0x557f211c74b0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9db242e4cdc4f27f server_cookie=794576da19e7ada7 in_seq=0 out_seq=0 2023-07-21T22:57:32.155 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.113+0000 7f8a8aff5700 10 client.29005 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:32.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.149+0000 7f8a8aff5700 1 -- 172.21.15.151:0/1479384253 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557f20ee6f10 con 0x557f211c50a0 2023-07-21T22:57:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.149+0000 7f8a8aff5700 10 client.29005 handle_command_reply: tid=0 2023-07-21T22:57:32.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.149+0000 7f8ac0ae9b80 1 client.29005 shutdown 2023-07-21T22:57:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.150+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/1479384253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c210 msgr2=0x557f211ac9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.150+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c210 0x557f211ac9d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x557f21162310 tx=0x7f8a98019510 comp rx=0 tx=0).stop 2023-07-21T22:57:32.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.151+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/1479384253 shutdown_connections 2023-07-21T22:57:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.151+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557f211c50a0 0x557f211c74b0 crc :-1 s=READY pgs=442 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.151+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557f20fa26b0 0x557f211ac490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.151+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557f2114c660 0x557f211acf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.151+0000 7f8a8aff5700 0 client.29005 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.151+0000 7f8ac0ae9b80 1 --2- 172.21.15.151:0/1479384253 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557f2114c210 0x557f211ac9d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.151+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/1479384253 >> 172.21.15.151:0/1479384253 conn(0x557f2113bae0 msgr2=0x557f2114ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.151+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/1479384253 shutdown_connections 2023-07-21T22:57:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.151+0000 7f8ac0ae9b80 1 -- 172.21.15.151:0/1479384253 wait complete. 2023-07-21T22:57:32.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.152+0000 7f8ac0ae9b80 20 client.29005 trim_cache size 0 max 16384 2023-07-21T22:57:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:57:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:57:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:57:32.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:57:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.153+0000 7f8aad1ff700 1 -- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a900a13c0 msgr2=0x7f8a900a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.153+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a900a13c0 0x7f8a900a3870 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00090a0 tx=0x7f8aa00b9040 comp rx=0 tx=0).stop 2023-07-21T22:57:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.153+0000 7f8aad1ff700 1 -- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8110900 msgr2=0x7f8aa806aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.153+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8110900 0x7f8aa806aa50 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f8aa000c110 tx=0x7f8aa000c4d0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.154+0000 7f8aad1ff700 1 -- 172.21.15.151:0/627236904 shutdown_connections 2023-07-21T22:57:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.154+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8a900a13c0 0x7f8a900a3870 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.154+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8aa8110900 0x7f8aa806aa50 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.154+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8aa8107350 0x7f8aa8071b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.154+0000 7f8aad1ff700 1 --2- 172.21.15.151:0/627236904 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8aa8107c60 0x7f8aa80720b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.154+0000 7f8aad1ff700 1 -- 172.21.15.151:0/627236904 >> 172.21.15.151:0/627236904 conn(0x7f8aa8075a00 msgr2=0x7f8aa8077640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.154+0000 7f8aad1ff700 1 -- 172.21.15.151:0/627236904 shutdown_connections 2023-07-21T22:57:32.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:32.154+0000 7f8aad1ff700 1 -- 172.21.15.151:0/627236904 wait complete. 2023-07-21T22:57:33.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:32 smithi187 ceph-mon[96918]: pgmap v1220: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.5 MiB/s wr, 825 op/s 2023-07-21T22:57:33.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:32 smithi195 ceph-mon[97365]: pgmap v1220: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.5 MiB/s wr, 825 op/s 2023-07-21T22:57:33.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:32 smithi151 ceph-mon[95510]: pgmap v1220: 97 pgs: 97 active+clean; 13 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 9.5 MiB/s wr, 825 op/s 2023-07-21T22:57:34.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 280.0 s, 370.4 tps, lat 268.866 ms stddev 122.678 2023-07-21T22:57:35.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:34 smithi187 ceph-mon[96918]: pgmap v1221: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-21T22:57:35.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:34 smithi195 ceph-mon[97365]: pgmap v1221: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-21T22:57:35.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:34 smithi151 ceph-mon[95510]: pgmap v1221: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 14 MiB/s wr, 1.25k op/s 2023-07-21T22:57:37.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:36 smithi187 ceph-mon[96918]: pgmap v1222: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.6 MiB/s wr, 848 op/s 2023-07-21T22:57:37.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:36 smithi195 ceph-mon[97365]: pgmap v1222: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.6 MiB/s wr, 848 op/s 2023-07-21T22:57:37.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:36 smithi151 ceph-mon[95510]: pgmap v1222: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 9.6 MiB/s wr, 848 op/s 2023-07-21T22:57:39.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:38 smithi195 ceph-mon[97365]: pgmap v1223: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-21T22:57:39.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:38 smithi151 ceph-mon[95510]: pgmap v1223: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-21T22:57:39.291 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 285.0 s, 18.8 tps, lat 265.559 ms stddev 66.691 2023-07-21T22:57:39.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:38 smithi187 ceph-mon[96918]: pgmap v1223: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 13 MiB/s wr, 1.12k op/s 2023-07-21T22:57:40.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:39 smithi195 ceph-mon[97365]: pgmap v1224: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.6 MiB/s wr, 701 op/s 2023-07-21T22:57:40.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:39 smithi151 ceph-mon[95510]: pgmap v1224: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.6 MiB/s wr, 701 op/s 2023-07-21T22:57:40.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:39 smithi187 ceph-mon[96918]: pgmap v1224: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.6 MiB/s wr, 701 op/s 2023-07-21T22:57:43.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:42 smithi187 ceph-mon[96918]: pgmap v1225: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.6 MiB/s wr, 701 op/s 2023-07-21T22:57:43.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:42 smithi195 ceph-mon[97365]: pgmap v1225: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.6 MiB/s wr, 701 op/s 2023-07-21T22:57:43.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:42 smithi151 ceph-mon[95510]: pgmap v1225: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 7.6 MiB/s wr, 701 op/s 2023-07-21T22:57:44.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:43 smithi151 ceph-mon[95510]: pgmap v1226: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.3 MiB/s wr, 769 op/s 2023-07-21T22:57:44.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:43 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:57:44.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 290.0 s, 97.6 tps, lat 2003.987 ms stddev 2582.372 2023-07-21T22:57:44.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:43 smithi187 ceph-mon[96918]: pgmap v1226: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.3 MiB/s wr, 769 op/s 2023-07-21T22:57:44.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:43 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:57:44.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:43 smithi195 ceph-mon[97365]: pgmap v1226: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 8.3 MiB/s wr, 769 op/s 2023-07-21T22:57:44.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:43 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:57:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.424+0000 7f90dbbff700 1 -- 172.21.15.151:0/2125813097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d4104a30 msgr2=0x7f90d4104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.424+0000 7f90dbbff700 1 --2- 172.21.15.151:0/2125813097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d4104a30 0x7f90d4104e00 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f90d000b0a0 tx=0x7f90d000b3b0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.424+0000 7f90dbbff700 1 -- 172.21.15.151:0/2125813097 shutdown_connections 2023-07-21T22:57:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.424+0000 7f90dbbff700 1 --2- 172.21.15.151:0/2125813097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d4104a30 0x7f90d4104e00 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.424+0000 7f90dbbff700 1 --2- 172.21.15.151:0/2125813097 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d40ff3e0 0x7f90d410b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.424+0000 7f90dbbff700 1 --2- 172.21.15.151:0/2125813097 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90d40fea30 0x7f90d40feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.424+0000 7f90dbbff700 1 -- 172.21.15.151:0/2125813097 >> 172.21.15.151:0/2125813097 conn(0x7f90d4074760 msgr2=0x7f90d4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.424+0000 7f90dbbff700 1 -- 172.21.15.151:0/2125813097 shutdown_connections 2023-07-21T22:57:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.424+0000 7f90dbbff700 1 -- 172.21.15.151:0/2125813097 wait complete. 2023-07-21T22:57:45.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.426+0000 7f90dbbff700 1 Processor -- start 2023-07-21T22:57:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.426+0000 7f90dbbff700 1 -- start start 2023-07-21T22:57:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.427+0000 7f90dbbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90d40fea30 0x7f90d419bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.427+0000 7f90dbbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d40ff3e0 0x7f90d419c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.427+0000 7f90dbbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d4104a30 0x7f90d4195ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.427+0000 7f90dbbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d4196140 con 0x7f90d40fea30 2023-07-21T22:57:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.427+0000 7f90dbbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d41962b0 con 0x7f90d4104a30 2023-07-21T22:57:45.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.427+0000 7f90dbbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d4196470 con 0x7f90d40ff3e0 2023-07-21T22:57:45.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90da19c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d4104a30 0x7f90d4195ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90d919a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d40ff3e0 0x7f90d419c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90d919a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d40ff3e0 0x7f90d419c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:42042/0 (socket says 172.21.15.151:42042) 2023-07-21T22:57:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90d919a700 1 -- 172.21.15.151:0/1232431805 learned_addr learned my addr 172.21.15.151:0/1232431805 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:45.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90d999b700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90d40fea30 0x7f90d419bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90d919a700 1 -- 172.21.15.151:0/1232431805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d4104a30 msgr2=0x7f90d4195ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90d919a700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d4104a30 0x7f90d4195ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90d919a700 1 -- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90d40fea30 msgr2=0x7f90d419bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90d919a700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90d40fea30 0x7f90d419bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.428+0000 7f90d919a700 1 -- 172.21.15.151:0/1232431805 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0009d00 con 0x7f90d40ff3e0 2023-07-21T22:57:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.429+0000 7f90d919a700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d40ff3e0 0x7f90d419c1b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f90c400d950 tx=0x7f90c400dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.429+0000 7f90caffd700 1 -- 172.21.15.151:0/1232431805 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c4009940 con 0x7f90d40ff3e0 2023-07-21T22:57:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.429+0000 7f90dbbff700 1 -- 172.21.15.151:0/1232431805 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d4196750 con 0x7f90d40ff3e0 2023-07-21T22:57:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.429+0000 7f90dbbff700 1 -- 172.21.15.151:0/1232431805 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d41a2c60 con 0x7f90d40ff3e0 2023-07-21T22:57:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.429+0000 7f90caffd700 1 -- 172.21.15.151:0/1232431805 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90c4010460 con 0x7f90d40ff3e0 2023-07-21T22:57:45.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.429+0000 7f90caffd700 1 -- 172.21.15.151:0/1232431805 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c400f620 con 0x7f90d40ff3e0 2023-07-21T22:57:45.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.434+0000 7f90caffd700 1 -- 172.21.15.151:0/1232431805 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f90c4009aa0 con 0x7f90d40ff3e0 2023-07-21T22:57:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.437+0000 7f90caffd700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f90c00a1340 0x7f90c00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.437+0000 7f90ef57db80 1 Processor -- start 2023-07-21T22:57:45.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.437+0000 7f90caffd700 1 -- 172.21.15.151:0/1232431805 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f90c40ccdc0 con 0x7f90d40ff3e0 2023-07-21T22:57:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.438+0000 7f90ef57db80 1 -- start start 2023-07-21T22:57:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.438+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0080cc6b0 0x55e008273d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.438+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e00826ff40 0x55e008270390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.438+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e008284bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.439+0000 7f90ef57db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e008175c50 con 0x55e00826ff40 2023-07-21T22:57:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.439+0000 7f90ef57db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0081c89e0 con 0x55e0082708d0 2023-07-21T22:57:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.439+0000 7f90ef57db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0081c1e70 con 0x55e0080cc6b0 2023-07-21T22:57:45.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.439+0000 7f90da19c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e008284bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.439+0000 7f90da19c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e008284bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49172/0 (socket says 172.21.15.151:49172) 2023-07-21T22:57:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.439+0000 7f90da19c700 1 -- 172.21.15.151:0/1968075812 learned_addr learned my addr 172.21.15.151:0/1968075812 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.439+0000 7f90d999b700 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0080cc6b0 0x55e008273d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.439+0000 7f90d999b700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f90c00a1340 0x7f90c00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.440+0000 7f90d919a700 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e00826ff40 0x55e008270390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.440+0000 7f90da19c700 1 -- 172.21.15.151:0/1968075812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0080cc6b0 msgr2=0x55e008273d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.440+0000 7f90da19c700 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0080cc6b0 0x55e008273d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.440+0000 7f90da19c700 1 -- 172.21.15.151:0/1968075812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e00826ff40 msgr2=0x55e008270390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.440+0000 7f90da19c700 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e00826ff40 0x55e008270390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.440+0000 7f90da19c700 1 -- 172.21.15.151:0/1968075812 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e007fefd80 con 0x55e0082708d0 2023-07-21T22:57:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.440+0000 7f90d919a700 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e00826ff40 0x55e008270390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:45.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.441+0000 7f90da19c700 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e008284bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009c30 tx=0x7f90cc009f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35c1f2c8494d81e6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.441+0000 7f90d999b700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f90c00a1340 0x7f90c00a37f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009fd0 tx=0x7f90d0009b80 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.441+0000 7f90bffff700 1 -- 172.21.15.151:0/1968075812 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc011d10 con 0x55e0082708d0 2023-07-21T22:57:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.441+0000 7f90bffff700 1 -- 172.21.15.151:0/1968075812 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90cc011e70 con 0x55e0082708d0 2023-07-21T22:57:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.441+0000 7f90bffff700 1 -- 172.21.15.151:0/1968075812 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc019430 con 0x55e0082708d0 2023-07-21T22:57:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.442+0000 7f90ef57db80 1 -- 172.21.15.151:0/1968075812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 msgr2=0x55e008284bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.442+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e008284bb0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f90cc009c30 tx=0x7f90cc009f40 comp rx=0 tx=0).stop 2023-07-21T22:57:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.443+0000 7f90ef57db80 1 -- 172.21.15.151:0/1968075812 shutdown_connections 2023-07-21T22:57:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.443+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e008284bb0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.443+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0080cc6b0 0x55e008273d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.443+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1968075812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e00826ff40 0x55e008270390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.443+0000 7f90ef57db80 1 -- 172.21.15.151:0/1968075812 >> 172.21.15.151:0/1968075812 conn(0x55e008265ae0 msgr2=0x55e00826b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.443+0000 7f90ef57db80 1 -- 172.21.15.151:0/1968075812 shutdown_connections 2023-07-21T22:57:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.443+0000 7f90ef57db80 1 -- 172.21.15.151:0/1968075812 wait complete. 2023-07-21T22:57:45.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.444+0000 7f90ef57db80 1 -- start start 2023-07-21T22:57:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.444+0000 7f90ef57db80 1 Processor -- start 2023-07-21T22:57:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.445+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 0x55e00827e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.445+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e00827eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.445+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e008284310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.445+0000 7f90ef57db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e008161a60 con 0x55e0082708d0 2023-07-21T22:57:45.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.445+0000 7f90ef57db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e008161760 con 0x55e0080cc6b0 2023-07-21T22:57:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.445+0000 7f90ef57db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0080458c0 con 0x55e00826ff40 2023-07-21T22:57:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.445+0000 7f90ef57db80 10 client.0 _ll_register_callbacks cb 0x55e00815f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.447+0000 7f90da19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e008284310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.447+0000 7f90da19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e008284310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60280/0 (socket says 172.21.15.151:60280) 2023-07-21T22:57:45.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.447+0000 7f90da19c700 1 -- 172.21.15.151:0/1115190399 learned_addr learned my addr 172.21.15.151:0/1115190399 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.448+0000 7f90d999b700 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 0x55e00827e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.448+0000 7f90da19c700 1 -- 172.21.15.151:0/1115190399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 msgr2=0x55e00827eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:45.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.448+0000 7f90da19c700 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e00827eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.448+0000 7f90da19c700 1 -- 172.21.15.151:0/1115190399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 msgr2=0x55e00827e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.448+0000 7f90da19c700 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 0x55e00827e5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.448+0000 7f90da19c700 1 -- 172.21.15.151:0/1115190399 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d41a2c60 con 0x55e0082708d0 2023-07-21T22:57:45.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.449+0000 7f90da19c700 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e008284310 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f90cc005d90 tx=0x7f90cc005590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ec392809880cde9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.451+0000 7f90bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:57:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.451+0000 7f90bd7fa700 1 -- 172.21.15.151:0/1115190399 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc004b60 con 0x55e0082708d0 2023-07-21T22:57:45.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.451+0000 7f90bd7fa700 1 -- 172.21.15.151:0/1115190399 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f90cc004cc0 con 0x55e0082708d0 2023-07-21T22:57:45.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.454+0000 7f90ef57db80 1 -- 172.21.15.151:0/1115190399 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e00811b490 con 0x55e0082708d0 2023-07-21T22:57:45.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.459+0000 7f90bd7fa700 1 -- 172.21.15.151:0/1115190399 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90cc005130 con 0x55e0082708d0 2023-07-21T22:57:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.460+0000 7f90ef57db80 10 client.19308 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.460+0000 7f90ef57db80 1 -- 172.21.15.151:0/1115190399 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x7f90cc0098e0 con 0x55e0082708d0 2023-07-21T22:57:45.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.461+0000 7f90bd7fa700 1 -- 172.21.15.151:0/1115190399 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e00811b490 con 0x55e0082708d0 2023-07-21T22:57:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.461+0000 7f90bd7fa700 1 -- 172.21.15.151:0/1115190399 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f90cc003b20 con 0x55e0082708d0 2023-07-21T22:57:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.461+0000 7f90ef57db80 10 client.19308 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:45.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.461+0000 7f90ef57db80 10 client.19308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.461+0000 7f90ef57db80 20 client.19308 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.461+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e00829aaa0 0x55e00829ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.461+0000 7f90ef57db80 4 client.19308 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:57:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.461+0000 7f90ef57db80 1 -- 172.21.15.151:0/1115190399 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0081bae50 con 0x55e00829aaa0 2023-07-21T22:57:45.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.462+0000 7f90d999b700 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e00829aaa0 0x55e00829ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.463+0000 7f90d999b700 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e00829aaa0 0x55e00829ceb0 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f2a897406a31d45 server_cookie=baff851bcefc9b19 in_seq=0 out_seq=0 2023-07-21T22:57:45.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.463+0000 7f90bd7fa700 10 client.19308 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.464+0000 7f90bd7fa700 1 -- 172.21.15.151:0/1115190399 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e0081bae50 con 0x55e00829aaa0 2023-07-21T22:57:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.464+0000 7f90bd7fa700 10 client.19308 handle_command_reply: tid=0 2023-07-21T22:57:45.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.464+0000 7f90ef57db80 1 client.19308 shutdown 2023-07-21T22:57:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.465+0000 7f90ef57db80 1 -- 172.21.15.151:0/1115190399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 msgr2=0x55e008284310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.465+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e008284310 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f90cc005d90 tx=0x7f90cc005590 comp rx=0 tx=0).stop 2023-07-21T22:57:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.466+0000 7f90ef57db80 1 -- 172.21.15.151:0/1115190399 shutdown_connections 2023-07-21T22:57:45.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.466+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e00829aaa0 0x55e00829ceb0 crc :-1 s=READY pgs=443 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.466+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 0x55e00827e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.466+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e008284310 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.466+0000 7f90ef57db80 1 --2- 172.21.15.151:0/1115190399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e00827eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.466+0000 7f90ef57db80 1 -- 172.21.15.151:0/1115190399 >> 172.21.15.151:0/1115190399 conn(0x55e008265ae0 msgr2=0x55e00826a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.466+0000 7f90bd7fa700 0 client.19308 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.466+0000 7f90ef57db80 1 -- 172.21.15.151:0/1115190399 shutdown_connections 2023-07-21T22:57:45.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.466+0000 7f90ef57db80 1 -- 172.21.15.151:0/1115190399 wait complete. 2023-07-21T22:57:45.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.467+0000 7f90ef57db80 20 client.19308 trim_cache size 0 max 16384 2023-07-21T22:57:45.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.493+0000 7f90ef57db80 1 Processor -- start 2023-07-21T22:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.493+0000 7f90ef57db80 1 -- start start 2023-07-21T22:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.494+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0080cc6b0 0x55e008284110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.494+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e00826ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.494+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e00826b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.494+0000 7f90ef57db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e008274410 con 0x55e0080cc6b0 2023-07-21T22:57:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.494+0000 7f90ef57db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00827ae50 con 0x55e0082708d0 2023-07-21T22:57:45.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.494+0000 7f90ef57db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e00827a980 con 0x55e00826ff40 2023-07-21T22:57:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.494+0000 7f90da19c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e00826b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.494+0000 7f90da19c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e00826b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:49190/0 (socket says 172.21.15.151:49190) 2023-07-21T22:57:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.494+0000 7f90da19c700 1 -- 172.21.15.151:0/4272627756 learned_addr learned my addr 172.21.15.151:0/4272627756 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90d919a700 1 --2- 172.21.15.151:0/4272627756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e00826ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90da19c700 1 -- 172.21.15.151:0/4272627756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 msgr2=0x55e00826ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90da19c700 1 --2- 172.21.15.151:0/4272627756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e00826ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90da19c700 1 -- 172.21.15.151:0/4272627756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0080cc6b0 msgr2=0x55e008284110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90da19c700 1 --2- 172.21.15.151:0/4272627756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0080cc6b0 0x55e008284110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90da19c700 1 -- 172.21.15.151:0/4272627756 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e007fd8c00 con 0x55e0082708d0 2023-07-21T22:57:45.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90da19c700 1 --2- 172.21.15.151:0/4272627756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e00826b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f90cc011720 tx=0x7f90cc024440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76d3054dd4b834ad server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90c8bff700 1 -- 172.21.15.151:0/4272627756 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc0058e0 con 0x55e0082708d0 2023-07-21T22:57:45.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90c8bff700 1 -- 172.21.15.151:0/4272627756 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90cc0056b0 con 0x55e0082708d0 2023-07-21T22:57:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.495+0000 7f90c8bff700 1 -- 172.21.15.151:0/4272627756 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc02ccc0 con 0x55e0082708d0 2023-07-21T22:57:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.496+0000 7f90ef57db80 1 -- 172.21.15.151:0/4272627756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 msgr2=0x55e00826b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.496+0000 7f90ef57db80 1 --2- 172.21.15.151:0/4272627756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e00826b0a0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f90cc011720 tx=0x7f90cc024440 comp rx=0 tx=0).stop 2023-07-21T22:57:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.497+0000 7f90ef57db80 1 -- 172.21.15.151:0/4272627756 shutdown_connections 2023-07-21T22:57:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.497+0000 7f90ef57db80 1 --2- 172.21.15.151:0/4272627756 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0082708d0 0x55e00826b0a0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.497+0000 7f90ef57db80 1 --2- 172.21.15.151:0/4272627756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0080cc6b0 0x55e008284110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.497+0000 7f90ef57db80 1 --2- 172.21.15.151:0/4272627756 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e00826ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.497+0000 7f90ef57db80 1 -- 172.21.15.151:0/4272627756 >> 172.21.15.151:0/4272627756 conn(0x55e008265ae0 msgr2=0x55e0082a17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.497+0000 7f90ef57db80 1 -- 172.21.15.151:0/4272627756 shutdown_connections 2023-07-21T22:57:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.497+0000 7f90ef57db80 1 -- 172.21.15.151:0/4272627756 wait complete. 2023-07-21T22:57:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.497+0000 7f90ef57db80 1 -- start start 2023-07-21T22:57:45.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.498+0000 7f90ef57db80 1 Processor -- start 2023-07-21T22:57:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.499+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 0x55e008281ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.499+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e008282420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.499+0000 7f90ef57db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e0082ed920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.499+0000 7f90ef57db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0082ede60 con 0x55e0082708d0 2023-07-21T22:57:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.499+0000 7f90ef57db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0082edfa0 con 0x55e0080cc6b0 2023-07-21T22:57:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.499+0000 7f90ef57db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0082ee130 con 0x55e00826ff40 2023-07-21T22:57:45.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.499+0000 7f90ef57db80 10 client.0 _ll_register_callbacks cb 0x7f90c4096190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.499+0000 7f90d919a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e008282420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.499+0000 7f90da19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e0082ed920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.500+0000 7f90da19c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e0082ed920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60300/0 (socket says 172.21.15.151:60300) 2023-07-21T22:57:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.500+0000 7f90da19c700 1 -- 172.21.15.151:0/3638220278 learned_addr learned my addr 172.21.15.151:0/3638220278 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.500+0000 7f90d999b700 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 0x55e008281ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.500+0000 7f90da19c700 1 -- 172.21.15.151:0/3638220278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 msgr2=0x55e008282420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.500+0000 7f90da19c700 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e008282420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.500+0000 7f90da19c700 1 -- 172.21.15.151:0/3638220278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 msgr2=0x55e008281ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.500+0000 7f90da19c700 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 0x55e008281ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.500+0000 7f90da19c700 1 -- 172.21.15.151:0/3638220278 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90cc0098e0 con 0x55e0082708d0 2023-07-21T22:57:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.500+0000 7f90d919a700 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e008282420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:45.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.501+0000 7f90da19c700 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e0082ed920 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f90cc011e40 tx=0x7f90cc005ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3c00bcc7ba6447 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.501+0000 7f90bd7fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:57:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.501+0000 7f90bd7fa700 1 -- 172.21.15.151:0/3638220278 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc02cb40 con 0x55e0082708d0 2023-07-21T22:57:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.501+0000 7f90bd7fa700 1 -- 172.21.15.151:0/3638220278 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f90cc0058e0 con 0x55e0082708d0 2023-07-21T22:57:45.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.501+0000 7f90ef57db80 1 -- 172.21.15.151:0/3638220278 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f90cc011e70 con 0x55e0082708d0 2023-07-21T22:57:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.501+0000 7f90bd7fa700 1 -- 172.21.15.151:0/3638220278 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f90cc02cca0 con 0x55e0082708d0 2023-07-21T22:57:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90ef57db80 10 client.19311 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90ef57db80 1 -- 172.21.15.151:0/3638220278 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55e0080161f0 con 0x55e0082708d0 2023-07-21T22:57:45.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90bd7fa700 1 -- 172.21.15.151:0/3638220278 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f90cc011e70 con 0x55e0082708d0 2023-07-21T22:57:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90bd7fa700 1 -- 172.21.15.151:0/3638220278 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f90cc003760 con 0x55e0082708d0 2023-07-21T22:57:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90ef57db80 10 client.19311 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90ef57db80 10 client.19311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90ef57db80 20 client.19311 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90ef57db80 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0082ef4b0 0x55e0082f18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:45.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90ef57db80 4 client.19311 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:57:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.502+0000 7f90ef57db80 1 -- 172.21.15.151:0/3638220278 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e00817cff0 con 0x55e0082ef4b0 2023-07-21T22:57:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.503+0000 7f90d999b700 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0082ef4b0 0x55e0082f18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.503+0000 7f90d999b700 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0082ef4b0 0x55e0082f18c0 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b2df22cde3523e37 server_cookie=673551ca9e45f625 in_seq=0 out_seq=0 2023-07-21T22:57:45.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.503+0000 7f90bd7fa700 10 client.19311 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:45.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.550+0000 7f90bd7fa700 1 -- 172.21.15.151:0/3638220278 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e00817cff0 con 0x55e0082ef4b0 2023-07-21T22:57:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.550+0000 7f90bd7fa700 10 client.19311 handle_command_reply: tid=0 2023-07-21T22:57:45.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.550+0000 7f90ef57db80 1 client.19311 shutdown 2023-07-21T22:57:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90ef57db80 1 -- 172.21.15.151:0/3638220278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 msgr2=0x55e0082ed920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90ef57db80 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e0082ed920 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7f90cc011e40 tx=0x7f90cc005ce0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90ef57db80 1 -- 172.21.15.151:0/3638220278 shutdown_connections 2023-07-21T22:57:45.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90ef57db80 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0082ef4b0 0x55e0082f18c0 crc :-1 s=READY pgs=444 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90ef57db80 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0080cc6b0 0x55e008281ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90ef57db80 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0082708d0 0x55e0082ed920 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90ef57db80 1 --2- 172.21.15.151:0/3638220278 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e00826ff40 0x55e008282420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90ef57db80 1 -- 172.21.15.151:0/3638220278 >> 172.21.15.151:0/3638220278 conn(0x55e008265ae0 msgr2=0x55e00826ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90bd7fa700 0 client.19311 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.551+0000 7f90ef57db80 1 -- 172.21.15.151:0/3638220278 shutdown_connections 2023-07-21T22:57:45.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.552+0000 7f90ef57db80 1 -- 172.21.15.151:0/3638220278 wait complete. 2023-07-21T22:57:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.552+0000 7f90ef57db80 20 client.19311 trim_cache size 0 max 16384 2023-07-21T22:57:45.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:57:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:57:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:57:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:57:45.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 -- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f90c00a1340 msgr2=0x7f90c00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f90c00a1340 0x7f90c00a37f0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009fd0 tx=0x7f90d0009b80 comp rx=0 tx=0).stop 2023-07-21T22:57:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 -- 172.21.15.151:0/1232431805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d40ff3e0 msgr2=0x7f90d419c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d40ff3e0 0x7f90d419c1b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f90c400d950 tx=0x7f90c400dc60 comp rx=0 tx=0).stop 2023-07-21T22:57:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 -- 172.21.15.151:0/1232431805 shutdown_connections 2023-07-21T22:57:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f90c00a1340 0x7f90c00a37f0 secure :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f90d0009fd0 tx=0x7f90d0009b80 comp rx=0 tx=0).stop 2023-07-21T22:57:45.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d4104a30 0x7f90d4195ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f90d40fea30 0x7f90d419bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 --2- 172.21.15.151:0/1232431805 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f90d40ff3e0 0x7f90d419c1b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:45.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.553+0000 7f90dbbff700 1 -- 172.21.15.151:0/1232431805 >> 172.21.15.151:0/1232431805 conn(0x7f90d4074760 msgr2=0x7f90d40fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.564+0000 7f90dbbff700 1 -- 172.21.15.151:0/1232431805 shutdown_connections 2023-07-21T22:57:45.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:45.564+0000 7f90dbbff700 1 -- 172.21.15.151:0/1232431805 wait complete. 2023-07-21T22:57:47.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:46 smithi187 ceph-mon[96918]: pgmap v1227: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 3.6 MiB/s wr, 342 op/s 2023-07-21T22:57:47.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:46 smithi195 ceph-mon[97365]: pgmap v1227: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 3.6 MiB/s wr, 342 op/s 2023-07-21T22:57:47.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:46 smithi151 ceph-mon[95510]: pgmap v1227: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 821 KiB/s rd, 3.6 MiB/s wr, 342 op/s 2023-07-21T22:57:49.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:48 smithi187 ceph-mon[96918]: pgmap v1228: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.6 MiB/s wr, 582 op/s 2023-07-21T22:57:49.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:57:49.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:57:49.119 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:57:49.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:48 smithi195 ceph-mon[97365]: pgmap v1228: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.6 MiB/s wr, 582 op/s 2023-07-21T22:57:49.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:57:49.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:57:49.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:57:49.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:48 smithi151 ceph-mon[95510]: pgmap v1228: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 6.6 MiB/s wr, 582 op/s 2023-07-21T22:57:49.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:57:49.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:57:49.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:57:49.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 295.0 s, 208.8 tps, lat 468.992 ms stddev 613.183 2023-07-21T22:57:51.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:50 smithi195 ceph-mon[97365]: pgmap v1229: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 306 op/s 2023-07-21T22:57:51.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:50 smithi151 ceph-mon[95510]: pgmap v1229: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 306 op/s 2023-07-21T22:57:51.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:50 smithi187 ceph-mon[96918]: pgmap v1229: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 306 op/s 2023-07-21T22:57:53.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:52 smithi195 ceph-mon[97365]: pgmap v1230: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 306 op/s 2023-07-21T22:57:53.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:52 smithi151 ceph-mon[95510]: pgmap v1230: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 306 op/s 2023-07-21T22:57:53.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:52 smithi187 ceph-mon[96918]: pgmap v1230: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.7 MiB/s wr, 306 op/s 2023-07-21T22:57:54.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:53 smithi151 ceph-mon[95510]: pgmap v1231: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.8 MiB/s wr, 608 op/s 2023-07-21T22:57:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 300.0 s, 375.0 tps, lat 270.867 ms stddev 149.812 2023-07-21T22:57:54.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:53 smithi187 ceph-mon[96918]: pgmap v1231: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.8 MiB/s wr, 608 op/s 2023-07-21T22:57:54.448 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:53 smithi195 ceph-mon[97365]: pgmap v1231: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 6.8 MiB/s wr, 608 op/s 2023-07-21T22:57:57.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:56 smithi187 ceph-mon[96918]: pgmap v1232: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.1 MiB/s wr, 541 op/s 2023-07-21T22:57:57.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:56 smithi195 ceph-mon[97365]: pgmap v1232: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.1 MiB/s wr, 541 op/s 2023-07-21T22:57:57.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:56 smithi151 ceph-mon[95510]: pgmap v1232: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.1 MiB/s wr, 541 op/s 2023-07-21T22:57:58.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.821+0000 7ff19cfff700 1 -- 172.21.15.151:0/2642091615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fdf10 msgr2=0x7ff1980fe2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.821+0000 7ff19cfff700 1 --2- 172.21.15.151:0/2642091615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fdf10 0x7ff1980fe2e0 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7ff1880098f0 tx=0x7ff188009c00 comp rx=0 tx=0).stop 2023-07-21T22:57:58.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.821+0000 7ff19cfff700 1 -- 172.21.15.151:0/2642091615 shutdown_connections 2023-07-21T22:57:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.821+0000 7ff19cfff700 1 --2- 172.21.15.151:0/2642091615 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff198110c30 0x7ff198113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.821+0000 7ff19cfff700 1 --2- 172.21.15.151:0/2642091615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fdf10 0x7ff1980fe2e0 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.821+0000 7ff19cfff700 1 --2- 172.21.15.151:0/2642091615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1980fe820 0x7ff1981106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.821+0000 7ff19cfff700 1 -- 172.21.15.151:0/2642091615 >> 172.21.15.151:0/2642091615 conn(0x7ff198073d50 msgr2=0x7ff198074150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.823+0000 7ff19cfff700 1 -- 172.21.15.151:0/2642091615 shutdown_connections 2023-07-21T22:57:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.823+0000 7ff19cfff700 1 -- 172.21.15.151:0/2642091615 wait complete. 2023-07-21T22:57:58.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.824+0000 7ff19cfff700 1 Processor -- start 2023-07-21T22:57:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.825+0000 7ff19cfff700 1 -- start start 2023-07-21T22:57:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.825+0000 7ff19cfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1980fdf10 0x7ff19819c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.825+0000 7ff19cfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fe820 0x7ff19819c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.825+0000 7ff19cfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff198110c30 0x7ff1981a0f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.825+0000 7ff19cfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1981a1560 con 0x7ff1980fe820 2023-07-21T22:57:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.825+0000 7ff19cfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1981a16d0 con 0x7ff1980fdf10 2023-07-21T22:57:58.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.825+0000 7ff19cfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1981a1890 con 0x7ff198110c30 2023-07-21T22:57:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff195d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fe820 0x7ff19819c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff19659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1980fdf10 0x7ff19819c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff195d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fe820 0x7ff19819c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44058/0 (socket says 172.21.15.151:44058) 2023-07-21T22:57:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff195d9b700 1 -- 172.21.15.151:0/1046337257 learned_addr learned my addr 172.21.15.151:0/1046337257 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:58.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff196d9d700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff198110c30 0x7ff1981a0f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff19659c700 1 -- 172.21.15.151:0/1046337257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff198110c30 msgr2=0x7ff1981a0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff19659c700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff198110c30 0x7ff1981a0f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff19659c700 1 -- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fe820 msgr2=0x7ff19819c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff19659c700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fe820 0x7ff19819c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff19659c700 1 -- 172.21.15.151:0/1046337257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff188009520 con 0x7ff1980fdf10 2023-07-21T22:57:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff195d9b700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fe820 0x7ff19819c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.826+0000 7ff196d9d700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff198110c30 0x7ff1981a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:58.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.827+0000 7ff19659c700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1980fdf10 0x7ff19819c370 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff188009810 tx=0x7ff18800fa00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.827+0000 7ff1877fe700 1 -- 172.21.15.151:0/1046337257 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18800ba70 con 0x7ff1980fdf10 2023-07-21T22:57:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.827+0000 7ff19cfff700 1 -- 172.21.15.151:0/1046337257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1981a1b10 con 0x7ff1980fdf10 2023-07-21T22:57:58.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.827+0000 7ff1877fe700 1 -- 172.21.15.151:0/1046337257 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff18800bbd0 con 0x7ff1980fdf10 2023-07-21T22:57:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.827+0000 7ff1877fe700 1 -- 172.21.15.151:0/1046337257 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff188003d70 con 0x7ff1980fdf10 2023-07-21T22:57:58.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.827+0000 7ff19cfff700 1 -- 172.21.15.151:0/1046337257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1981a93b0 con 0x7ff1980fdf10 2023-07-21T22:57:58.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.834+0000 7ff1877fe700 1 -- 172.21.15.151:0/1046337257 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff188005040 con 0x7ff1980fdf10 2023-07-21T22:57:58.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.835+0000 7ff1b0950b80 1 Processor -- start 2023-07-21T22:57:58.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.836+0000 7ff1b0950b80 1 -- start start 2023-07-21T22:57:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.837+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b00cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.837+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1afaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.837+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 0x5651b1afb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.837+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b1a00c50 con 0x5651b1b01660 2023-07-21T22:57:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.837+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b1a539e0 con 0x5651b19576b0 2023-07-21T22:57:58.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.837+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b1a4ce70 con 0x5651b1b01210 2023-07-21T22:57:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.837+0000 7ff1877fe700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1800a13c0 0x7ff1800a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.837+0000 7ff196d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b00cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff19659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1afaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff195d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 0x5651b1afb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff19659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1afaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46682/0 (socket says 172.21.15.151:46682) 2023-07-21T22:57:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff19659c700 1 -- 172.21.15.151:0/3430060517 learned_addr learned my addr 172.21.15.151:0/3430060517 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff196d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b00cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41888/0 (socket says 172.21.15.151:41888) 2023-07-21T22:57:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff1877fe700 1 -- 172.21.15.151:0/1046337257 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff1880cdd10 con 0x7ff1980fdf10 2023-07-21T22:57:58.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff19659c700 1 -- 172.21.15.151:0/3430060517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 msgr2=0x5651b1b00cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff19659c700 1 --2- 172.21.15.151:0/3430060517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b00cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff19659c700 1 -- 172.21.15.151:0/3430060517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 msgr2=0x5651b1afb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff19659c700 1 --2- 172.21.15.151:0/3430060517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 0x5651b1afb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff19659c700 1 -- 172.21.15.151:0/3430060517 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651b187ad80 con 0x5651b1b01210 2023-07-21T22:57:58.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.838+0000 7ff196d9d700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1800a13c0 0x7ff1800a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.839+0000 7ff19659c700 1 --2- 172.21.15.151:0/3430060517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1afaf40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff1880092a0 tx=0x7ff188029000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=321aa4039da1ea34 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.839+0000 7ff196d9d700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1800a13c0 0x7ff1800a3870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0046e0 tx=0x7ff18c004750 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.840+0000 7ff184ff9700 1 -- 172.21.15.151:0/3430060517 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18809a790 con 0x5651b1b01210 2023-07-21T22:57:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.840+0000 7ff184ff9700 1 -- 172.21.15.151:0/3430060517 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1880036f0 con 0x5651b1b01210 2023-07-21T22:57:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.840+0000 7ff184ff9700 1 -- 172.21.15.151:0/3430060517 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18809b090 con 0x5651b1b01210 2023-07-21T22:57:58.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.841+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3430060517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 msgr2=0x5651b1afaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.841+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3430060517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1afaf40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff1880092a0 tx=0x7ff188029000 comp rx=0 tx=0).stop 2023-07-21T22:57:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.841+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3430060517 shutdown_connections 2023-07-21T22:57:58.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.841+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3430060517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b00cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.841+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3430060517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 0x5651b1afb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.841+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3430060517 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1afaf40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.841+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3430060517 >> 172.21.15.151:0/3430060517 conn(0x5651b1af0ae0 msgr2=0x5651b1af60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.842+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3430060517 shutdown_connections 2023-07-21T22:57:58.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.842+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3430060517 wait complete. 2023-07-21T22:57:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.842+0000 7ff1b0950b80 1 -- start start 2023-07-21T22:57:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.843+0000 7ff1b0950b80 1 Processor -- start 2023-07-21T22:57:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b0a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01210 0x5651b1b0a800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01660 0x5651b1b04550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b19eca60 con 0x5651b1b01210 2023-07-21T22:57:58.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b19ec760 con 0x5651b19576b0 2023-07-21T22:57:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b18d08c0 con 0x5651b1b01660 2023-07-21T22:57:58.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff1b0950b80 10 client.0 _ll_register_callbacks cb 0x5651b19ea700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff195d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01210 0x5651b1b0a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff19659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b0a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff195d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01210 0x5651b1b0a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44076/0 (socket says 172.21.15.151:44076) 2023-07-21T22:57:58.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff195d9b700 1 -- 172.21.15.151:0/3832375065 learned_addr learned my addr 172.21.15.151:0/3832375065 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.844+0000 7ff19659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b0a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41904/0 (socket says 172.21.15.151:41904) 2023-07-21T22:57:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.845+0000 7ff19659c700 1 -- 172.21.15.151:0/3832375065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01660 msgr2=0x5651b1b04550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.845+0000 7ff19659c700 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01660 0x5651b1b04550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.845+0000 7ff19659c700 1 -- 172.21.15.151:0/3832375065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01210 msgr2=0x5651b1b0a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.845+0000 7ff19659c700 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01210 0x5651b1b0a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.845+0000 7ff19659c700 1 -- 172.21.15.151:0/3832375065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1981a93b0 con 0x5651b19576b0 2023-07-21T22:57:58.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.845+0000 7ff195d9b700 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01210 0x5651b1b0a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:57:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.845+0000 7ff19659c700 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b0a2c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff188003880 tx=0x7ff18809a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f58f7b40e78fb1cf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.845+0000 7ff17dffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:57:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.846+0000 7ff17dffb700 1 -- 172.21.15.151:0/3832375065 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18809a790 con 0x5651b19576b0 2023-07-21T22:57:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.846+0000 7ff17dffb700 1 -- 172.21.15.151:0/3832375065 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff18809ee60 con 0x5651b19576b0 2023-07-21T22:57:58.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.846+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3832375065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5651b19a6490 con 0x5651b19576b0 2023-07-21T22:57:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.847+0000 7ff17dffb700 1 -- 172.21.15.151:0/3832375065 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff18809ae30 con 0x5651b19576b0 2023-07-21T22:57:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.847+0000 7ff1b0950b80 10 client.29012 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:58.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.847+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3832375065 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x5651b1863c00 con 0x5651b19576b0 2023-07-21T22:57:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.851+0000 7ff17dffb700 1 -- 172.21.15.151:0/3832375065 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5651b19a6490 con 0x5651b19576b0 2023-07-21T22:57:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.851+0000 7ff17dffb700 1 -- 172.21.15.151:0/3832375065 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff1880b3220 con 0x5651b19576b0 2023-07-21T22:57:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.851+0000 7ff1b0950b80 10 client.29012 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.851+0000 7ff1b0950b80 10 client.29012 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.852+0000 7ff1b0950b80 20 client.29012 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:58.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.852+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5651b1b142d0 0x5651b1b166e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.852+0000 7ff1b0950b80 4 client.29012 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:57:58.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.852+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3832375065 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5651b1a45e50 con 0x5651b1b142d0 2023-07-21T22:57:58.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.852+0000 7ff195d9b700 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5651b1b142d0 0x5651b1b166e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.854+0000 7ff195d9b700 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5651b1b142d0 0x5651b1b166e0 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce3ee6ccce4d024e server_cookie=99c67eeb06555a35 in_seq=0 out_seq=0 2023-07-21T22:57:58.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.854+0000 7ff17dffb700 10 client.29012 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.855+0000 7ff17dffb700 1 -- 172.21.15.151:0/3832375065 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5651b1a45e50 con 0x5651b1b142d0 2023-07-21T22:57:58.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.855+0000 7ff17dffb700 10 client.29012 handle_command_reply: tid=0 2023-07-21T22:57:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff1b0950b80 1 client.29012 shutdown 2023-07-21T22:57:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3832375065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 msgr2=0x5651b1b0a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b0a2c0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7ff188003880 tx=0x7ff18809a5d0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3832375065 shutdown_connections 2023-07-21T22:57:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5651b1b142d0 0x5651b1b166e0 crc :-1 s=READY pgs=445 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b19576b0 0x5651b1b0a2c0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01660 0x5651b1b04550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3832375065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01210 0x5651b1b0a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3832375065 >> 172.21.15.151:0/3832375065 conn(0x5651b1af0ae0 msgr2=0x5651b1af53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:58.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.856+0000 7ff17dffb700 0 client.29012 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.857+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3832375065 shutdown_connections 2023-07-21T22:57:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.857+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3832375065 wait complete. 2023-07-21T22:57:58.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.858+0000 7ff1b0950b80 20 client.29012 trim_cache size 0 max 16384 2023-07-21T22:57:58.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.884+0000 7ff1b0950b80 1 Processor -- start 2023-07-21T22:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.884+0000 7ff1b0950b80 1 -- start start 2023-07-21T22:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.885+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b19576b0 0x5651b1b020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.885+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01210 0x5651b1affd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.885+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 0x5651b1b00250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.885+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b19a6490 con 0x5651b1b01660 2023-07-21T22:57:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.885+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b1af6f80 con 0x5651b1b01210 2023-07-21T22:57:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.885+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b1af2c00 con 0x5651b19576b0 2023-07-21T22:57:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.885+0000 7ff19659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b19576b0 0x5651b1b020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.886+0000 7ff19659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b19576b0 0x5651b1b020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:46702/0 (socket says 172.21.15.151:46702) 2023-07-21T22:57:58.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.886+0000 7ff19659c700 1 -- 172.21.15.151:0/3113589002 learned_addr learned my addr 172.21.15.151:0/3113589002 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.886+0000 7ff196d9d700 1 --2- 172.21.15.151:0/3113589002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 0x5651b1b00250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.887+0000 7ff195d9b700 1 --2- 172.21.15.151:0/3113589002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01210 0x5651b1affd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.887+0000 7ff19659c700 1 -- 172.21.15.151:0/3113589002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01210 msgr2=0x5651b1affd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.887+0000 7ff19659c700 1 --2- 172.21.15.151:0/3113589002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01210 0x5651b1affd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.887+0000 7ff19659c700 1 -- 172.21.15.151:0/3113589002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 msgr2=0x5651b1b00250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.887+0000 7ff19659c700 1 --2- 172.21.15.151:0/3113589002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 0x5651b1b00250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.887+0000 7ff19659c700 1 -- 172.21.15.151:0/3113589002 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5651b18a11f0 con 0x5651b19576b0 2023-07-21T22:57:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.887+0000 7ff19659c700 1 --2- 172.21.15.151:0/3113589002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b19576b0 0x5651b1b020b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff18809ab30 tx=0x7ff188029000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=567de17aeac67ddf server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.888+0000 7ff1857fa700 1 -- 172.21.15.151:0/3113589002 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880cb410 con 0x5651b19576b0 2023-07-21T22:57:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.888+0000 7ff1857fa700 1 -- 172.21.15.151:0/3113589002 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1880a3000 con 0x5651b19576b0 2023-07-21T22:57:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.888+0000 7ff1857fa700 1 -- 172.21.15.151:0/3113589002 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1880a31f0 con 0x5651b19576b0 2023-07-21T22:57:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.889+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3113589002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b19576b0 msgr2=0x5651b1b020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.889+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3113589002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b19576b0 0x5651b1b020b0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff18809ab30 tx=0x7ff188029000 comp rx=0 tx=0).stop 2023-07-21T22:57:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.889+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3113589002 shutdown_connections 2023-07-21T22:57:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.889+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3113589002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b1b01660 0x5651b1b00250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.889+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3113589002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b19576b0 0x5651b1b020b0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.889+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3113589002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01210 0x5651b1affd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.889+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3113589002 >> 172.21.15.151:0/3113589002 conn(0x5651b1af0ae0 msgr2=0x5651b1aff600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.889+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3113589002 shutdown_connections 2023-07-21T22:57:58.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.890+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3113589002 wait complete. 2023-07-21T22:57:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.890+0000 7ff1b0950b80 1 -- start start 2023-07-21T22:57:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.890+0000 7ff1b0950b80 1 Processor -- start 2023-07-21T22:57:58.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.891+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b19576b0 0x5651b1b084b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.891+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1b089f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.891+0000 7ff1b0950b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01660 0x5651b1b63170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.891+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b1b636b0 con 0x5651b19576b0 2023-07-21T22:57:58.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.891+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b1b63820 con 0x5651b1b01660 2023-07-21T22:57:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.891+0000 7ff1b0950b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5651b1b639e0 con 0x5651b1b01210 2023-07-21T22:57:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.891+0000 7ff1b0950b80 10 client.0 _ll_register_callbacks cb 0x7ff190009050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:57:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.892+0000 7ff196d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01660 0x5651b1b63170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.892+0000 7ff196d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01660 0x5651b1b63170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41932/0 (socket says 172.21.15.151:41932) 2023-07-21T22:57:58.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.892+0000 7ff196d9d700 1 -- 172.21.15.151:0/3281164562 learned_addr learned my addr 172.21.15.151:0/3281164562 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:57:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.892+0000 7ff195d9b700 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1b089f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.893+0000 7ff196d9d700 1 -- 172.21.15.151:0/3281164562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 msgr2=0x5651b1b089f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.893+0000 7ff196d9d700 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1b089f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.893+0000 7ff196d9d700 1 -- 172.21.15.151:0/3281164562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b19576b0 msgr2=0x5651b1b084b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:57:58.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.893+0000 7ff196d9d700 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b19576b0 0x5651b1b084b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.893+0000 7ff196d9d700 1 -- 172.21.15.151:0/3281164562 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5651b1863c00 con 0x5651b1b01660 2023-07-21T22:57:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.893+0000 7ff196d9d700 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01660 0x5651b1b63170 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff18c010df0 tx=0x7ff18c009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=519c1eeb7af4cce2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:57:58.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.894+0000 7ff17dffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:57:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.894+0000 7ff17dffb700 1 -- 172.21.15.151:0/3281164562 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff18c024070 con 0x5651b1b01660 2023-07-21T22:57:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.894+0000 7ff17dffb700 1 -- 172.21.15.151:0/3281164562 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(154..154 src has 1..154) v4 ==== 8492+0+0 (secure 0 0 0) 0x7ff18c01fd50 con 0x5651b1b01660 2023-07-21T22:57:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.894+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3281164562 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff1880036f0 con 0x5651b1b01660 2023-07-21T22:57:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.895+0000 7ff17dffb700 1 -- 172.21.15.151:0/3281164562 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff18c029420 con 0x5651b1b01660 2023-07-21T22:57:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.895+0000 7ff1b0950b80 10 client.29018 fetch_fsmap learned FSMap version 109 2023-07-21T22:57:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.895+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3281164562 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x5651b1879250 con 0x5651b1b01660 2023-07-21T22:57:58.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.895+0000 7ff17dffb700 1 -- 172.21.15.151:0/3281164562 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff1880036f0 con 0x5651b1b01660 2023-07-21T22:57:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.895+0000 7ff17dffb700 1 -- 172.21.15.151:0/3281164562 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7ff18c033540 con 0x5651b1b01660 2023-07-21T22:57:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.895+0000 7ff1b0950b80 10 client.29018 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:57:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.895+0000 7ff1b0950b80 10 client.29018 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:57:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.896+0000 7ff1b0950b80 20 client.29018 populate_metadata read hostname 'smithi151' 2023-07-21T22:57:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.896+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5651b1b7a0f0 0x5651b1b7c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:57:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.896+0000 7ff1b0950b80 4 client.29018 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:57:58.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.896+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3281164562 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5651b1a07ff0 con 0x5651b1b7a0f0 2023-07-21T22:57:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.896+0000 7ff19659c700 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5651b1b7a0f0 0x5651b1b7c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:57:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.897+0000 7ff19659c700 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5651b1b7a0f0 0x5651b1b7c500 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35e9a4d624e3e275 server_cookie=5738decc50746cae in_seq=0 out_seq=0 2023-07-21T22:57:58.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.897+0000 7ff17dffb700 10 client.29018 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:58.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.921+0000 7ff17dffb700 1 -- 172.21.15.151:0/3281164562 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5651b1a07ff0 con 0x5651b1b7a0f0 2023-07-21T22:57:58.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.921+0000 7ff17dffb700 10 client.29018 handle_command_reply: tid=0 2023-07-21T22:57:58.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.921+0000 7ff1b0950b80 1 client.29018 shutdown 2023-07-21T22:57:58.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.922+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3281164562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01660 msgr2=0x5651b1b63170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.922+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01660 0x5651b1b63170 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7ff18c010df0 tx=0x7ff18c009260 comp rx=0 tx=0).stop 2023-07-21T22:57:58.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.922+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3281164562 shutdown_connections 2023-07-21T22:57:58.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.922+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5651b1b7a0f0 0x5651b1b7c500 crc :-1 s=READY pgs=446 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.922+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5651b1b01660 0x5651b1b63170 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.922+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5651b19576b0 0x5651b1b084b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.922+0000 7ff1b0950b80 1 --2- 172.21.15.151:0/3281164562 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5651b1b01210 0x5651b1b089f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.922+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3281164562 >> 172.21.15.151:0/3281164562 conn(0x5651b1af0ae0 msgr2=0x5651b1b044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:58.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.922+0000 7ff17dffb700 0 client.29018 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:57:58.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.923+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3281164562 shutdown_connections 2023-07-21T22:57:58.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.923+0000 7ff1b0950b80 1 -- 172.21.15.151:0/3281164562 wait complete. 2023-07-21T22:57:58.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.926+0000 7ff1b0950b80 20 client.29018 trim_cache size 0 max 16384 2023-07-21T22:57:58.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:57:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:57:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:57:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:57:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 -- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1800a13c0 msgr2=0x7ff1800a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1800a13c0 0x7ff1800a3870 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff18c0046e0 tx=0x7ff18c004750 comp rx=0 tx=0).stop 2023-07-21T22:57:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 -- 172.21.15.151:0/1046337257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1980fdf10 msgr2=0x7ff19819c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:57:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1980fdf10 0x7ff19819c370 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7ff188009810 tx=0x7ff18800fa00 comp rx=0 tx=0).stop 2023-07-21T22:57:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 -- 172.21.15.151:0/1046337257 shutdown_connections 2023-07-21T22:57:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff1800a13c0 0x7ff1800a3870 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1980fdf10 0x7ff19819c370 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff198110c30 0x7ff1981a0f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 --2- 172.21.15.151:0/1046337257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff1980fe820 0x7ff19819c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:57:58.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.928+0000 7ff19cfff700 1 -- 172.21.15.151:0/1046337257 >> 172.21.15.151:0/1046337257 conn(0x7ff198073d50 msgr2=0x7ff1981039b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:57:58.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.929+0000 7ff19cfff700 1 -- 172.21.15.151:0/1046337257 shutdown_connections 2023-07-21T22:57:58.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:57:58.929+0000 7ff19cfff700 1 -- 172.21.15.151:0/1046337257 wait complete. 2023-07-21T22:57:59.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:57:58 smithi195 ceph-mon[97365]: pgmap v1233: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.00k op/s 2023-07-21T22:57:59.194 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:57:58 smithi151 ceph-mon[95510]: pgmap v1233: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.00k op/s 2023-07-21T22:57:59.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 305.0 s, 387.1 tps, lat 257.216 ms stddev 53.008 2023-07-21T22:57:59.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:57:58 smithi187 ceph-mon[96918]: pgmap v1233: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.00k op/s 2023-07-21T22:58:01.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:00 smithi195 ceph-mon[97365]: pgmap v1234: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 763 op/s 2023-07-21T22:58:01.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:00 smithi151 ceph-mon[95510]: pgmap v1234: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 763 op/s 2023-07-21T22:58:01.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:00 smithi187 ceph-mon[96918]: pgmap v1234: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 763 op/s 2023-07-21T22:58:03.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:02 smithi195 ceph-mon[97365]: pgmap v1235: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 763 op/s 2023-07-21T22:58:03.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:02 smithi151 ceph-mon[95510]: pgmap v1235: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 763 op/s 2023-07-21T22:58:03.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:02 smithi187 ceph-mon[96918]: pgmap v1235: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 763 op/s 2023-07-21T22:58:04.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 310.0 s, 304.8 tps, lat 305.640 ms stddev 163.762 2023-07-21T22:58:05.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:04 smithi195 ceph-mon[97365]: pgmap v1236: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-07-21T22:58:05.149 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:04 smithi195 ceph-mon[97365]: osdmap e155: 12 total, 12 up, 12 in 2023-07-21T22:58:05.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:04 smithi151 ceph-mon[95510]: pgmap v1236: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-07-21T22:58:05.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:04 smithi151 ceph-mon[95510]: osdmap e155: 12 total, 12 up, 12 in 2023-07-21T22:58:05.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:04 smithi187 ceph-mon[96918]: pgmap v1236: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 13 MiB/s wr, 1.21k op/s 2023-07-21T22:58:05.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:04 smithi187 ceph-mon[96918]: osdmap e155: 12 total, 12 up, 12 in 2023-07-21T22:58:06.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:05 smithi187 ceph-mon[96918]: pgmap v1238: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-21T22:58:06.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:05 smithi195 ceph-mon[97365]: pgmap v1238: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-21T22:58:06.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:05 smithi151 ceph-mon[95510]: pgmap v1238: 97 pgs: 97 active+clean; 13 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 12 MiB/s wr, 1.09k op/s 2023-07-21T22:58:09.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:08 smithi195 ceph-mon[97365]: pgmap v1239: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 771 op/s 2023-07-21T22:58:09.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:08 smithi151 ceph-mon[95510]: pgmap v1239: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 771 op/s 2023-07-21T22:58:09.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 315.0 s, 199.7 tps, lat 534.433 ms stddev 335.051 2023-07-21T22:58:09.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:08 smithi187 ceph-mon[96918]: pgmap v1239: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 771 op/s 2023-07-21T22:58:11.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:10 smithi195 ceph-mon[97365]: pgmap v1240: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 771 op/s 2023-07-21T22:58:11.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:10 smithi151 ceph-mon[95510]: pgmap v1240: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 771 op/s 2023-07-21T22:58:11.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:10 smithi187 ceph-mon[96918]: pgmap v1240: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 771 op/s 2023-07-21T22:58:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.182+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/365105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5c410e2a0 msgr2=0x7fe5c410e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:12.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.182+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/365105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5c410e2a0 0x7fe5c410e670 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00098f0 tx=0x7fe5c0009c00 comp rx=0 tx=0).stop 2023-07-21T22:58:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.182+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/365105 shutdown_connections 2023-07-21T22:58:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.182+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/365105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5c410e2a0 0x7fe5c410e670 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.182+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/365105 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5c406d3a0 0x7fe5c411b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.182+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/365105 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5c406c910 0x7fe5c406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.182+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/365105 >> 172.21.15.151:0/365105 conn(0x7fe5c406bd70 msgr2=0x7fe5c4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:12.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.183+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/365105 shutdown_connections 2023-07-21T22:58:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.183+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/365105 wait complete. 2023-07-21T22:58:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.184+0000 7fe5cc7ff700 1 Processor -- start 2023-07-21T22:58:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.185+0000 7fe5cc7ff700 1 -- start start 2023-07-21T22:58:12.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.185+0000 7fe5cc7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5c406c910 0x7fe5c41aa940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.185+0000 7fe5cc7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5c406d3a0 0x7fe5c41aae80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.185+0000 7fe5cc7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5c410e2a0 0x7fe5c41a4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.185+0000 7fe5cc7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41a4f50 con 0x7fe5c406c910 2023-07-21T22:58:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.185+0000 7fe5cc7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41a50c0 con 0x7fe5c410e2a0 2023-07-21T22:58:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.185+0000 7fe5cc7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5c41a5280 con 0x7fe5c406d3a0 2023-07-21T22:58:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5ca59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5c406c910 0x7fe5c41aa940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5ca59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5c406c910 0x7fe5c41aa940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47414/0 (socket says 172.21.15.151:47414) 2023-07-21T22:58:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5ca59b700 1 -- 172.21.15.151:0/3656489293 learned_addr learned my addr 172.21.15.151:0/3656489293 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5cad9c700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5c410e2a0 0x7fe5c41a4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5c406d3a0 0x7fe5c41aae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5c9d9a700 1 -- 172.21.15.151:0/3656489293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5c410e2a0 msgr2=0x7fe5c41a4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5c410e2a0 0x7fe5c41a4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5c9d9a700 1 -- 172.21.15.151:0/3656489293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5c406c910 msgr2=0x7fe5c41aa940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5c406c910 0x7fe5c41aa940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.186+0000 7fe5c9d9a700 1 -- 172.21.15.151:0/3656489293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b40095f0 con 0x7fe5c406d3a0 2023-07-21T22:58:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.187+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5c406d3a0 0x7fe5c41aae80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400eb90 tx=0x7fe5b400eea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.187+0000 7fe5bb7fe700 1 -- 172.21.15.151:0/3656489293 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4009970 con 0x7fe5c406d3a0 2023-07-21T22:58:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.187+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/3656489293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5c0009520 con 0x7fe5c406d3a0 2023-07-21T22:58:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.187+0000 7fe5bb7fe700 1 -- 172.21.15.151:0/3656489293 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5b40044b0 con 0x7fe5c406d3a0 2023-07-21T22:58:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.187+0000 7fe5bb7fe700 1 -- 172.21.15.151:0/3656489293 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b4003d70 con 0x7fe5c406d3a0 2023-07-21T22:58:12.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.187+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/3656489293 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c41b18c0 con 0x7fe5c406d3a0 2023-07-21T22:58:12.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.192+0000 7fe5bb7fe700 1 -- 172.21.15.151:0/3656489293 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fe5b4003f10 con 0x7fe5c406d3a0 2023-07-21T22:58:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.194+0000 7fe5e01bfb80 1 Processor -- start 2023-07-21T22:58:12.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.195+0000 7fe5e01bfb80 1 -- start start 2023-07-21T22:58:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.195+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a063416b0 0x557a064eacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.195+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb210 0x557a064e4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.195+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 0x557a064e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.195+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a063eac50 con 0x557a063416b0 2023-07-21T22:58:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.195+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a0643d9e0 con 0x557a064eb660 2023-07-21T22:58:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.195+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a06436e70 con 0x557a064eb210 2023-07-21T22:58:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.196+0000 7fe5ca59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb210 0x557a064e4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.196+0000 7fe5ca59b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb210 0x557a064e4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52806/0 (socket says 172.21.15.151:52806) 2023-07-21T22:58:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.196+0000 7fe5ca59b700 1 -- 172.21.15.151:0/498019471 learned_addr learned my addr 172.21.15.151:0/498019471 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.196+0000 7fe5ca59b700 1 -- 172.21.15.151:0/498019471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 msgr2=0x557a064e54a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:58:12.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.196+0000 7fe5ca59b700 1 --2- 172.21.15.151:0/498019471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 0x557a064e54a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.196+0000 7fe5ca59b700 1 -- 172.21.15.151:0/498019471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a063416b0 msgr2=0x557a064eacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.196+0000 7fe5ca59b700 1 --2- 172.21.15.151:0/498019471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a063416b0 0x557a064eacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.196+0000 7fe5ca59b700 1 -- 172.21.15.151:0/498019471 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a06264d80 con 0x557a064eb210 2023-07-21T22:58:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.197+0000 7fe5ca59b700 1 --2- 172.21.15.151:0/498019471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb210 0x557a064e4f40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0005ba0 tx=0x7fe5c0005e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61a913e7c010e3d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.197+0000 7fe5bb7fe700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe5b00a13c0 0x7fe5b00a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.198+0000 7fe5bb7fe700 1 -- 172.21.15.151:0/3656489293 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fe5b4014070 con 0x7fe5c406d3a0 2023-07-21T22:58:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.200+0000 7fe5cad9c700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe5b00a13c0 0x7fe5b00a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.201+0000 7fe5cad9c700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe5b00a13c0 0x7fe5b00a3870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe5c41ab5d0 tx=0x7fe5bc009920 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.203+0000 7fe5b8ff9700 1 -- 172.21.15.151:0/498019471 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c000f460 con 0x557a064eb210 2023-07-21T22:58:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.203+0000 7fe5b8ff9700 1 -- 172.21.15.151:0/498019471 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5c001d040 con 0x557a064eb210 2023-07-21T22:58:12.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.203+0000 7fe5b8ff9700 1 -- 172.21.15.151:0/498019471 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c00052a0 con 0x557a064eb210 2023-07-21T22:58:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.204+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/498019471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb210 msgr2=0x557a064e4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:12.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.204+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/498019471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb210 0x557a064e4f40 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe5c0005ba0 tx=0x7fe5c0005e00 comp rx=0 tx=0).stop 2023-07-21T22:58:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.205+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/498019471 shutdown_connections 2023-07-21T22:58:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.205+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/498019471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 0x557a064e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.205+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/498019471 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a063416b0 0x557a064eacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.205+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/498019471 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb210 0x557a064e4f40 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.205+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/498019471 >> 172.21.15.151:0/498019471 conn(0x557a064daae0 msgr2=0x557a064e00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:12.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.205+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/498019471 shutdown_connections 2023-07-21T22:58:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.206+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/498019471 wait complete. 2023-07-21T22:58:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.207+0000 7fe5e01bfb80 1 -- start start 2023-07-21T22:58:12.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.207+0000 7fe5e01bfb80 1 Processor -- start 2023-07-21T22:58:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.208+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a064f1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.208+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb210 0x557a064ee920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.208+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb660 0x557a064ef060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.208+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a063d6a60 con 0x557a064eb210 2023-07-21T22:58:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.208+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a063d6760 con 0x557a063416b0 2023-07-21T22:58:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.208+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a062ba8c0 con 0x557a064eb660 2023-07-21T22:58:12.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.208+0000 7fe5e01bfb80 10 client.0 _ll_register_callbacks cb 0x557a063d4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:58:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.209+0000 7fe5c9d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb210 0x557a064ee920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.209+0000 7fe5c9d9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb210 0x557a064ee920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47424/0 (socket says 172.21.15.151:47424) 2023-07-21T22:58:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.209+0000 7fe5c9d9a700 1 -- 172.21.15.151:0/190588510 learned_addr learned my addr 172.21.15.151:0/190588510 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:12.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.210+0000 7fe5ca59b700 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a064f1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.210+0000 7fe5cad9c700 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb660 0x557a064ef060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.211+0000 7fe5c9d9a700 1 -- 172.21.15.151:0/190588510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb660 msgr2=0x557a064ef060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:12.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.211+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb660 0x557a064ef060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.211+0000 7fe5c9d9a700 1 -- 172.21.15.151:0/190588510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 msgr2=0x557a064f1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.211+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a064f1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.211+0000 7fe5c9d9a700 1 -- 172.21.15.151:0/190588510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5c411bfb0 con 0x557a064eb210 2023-07-21T22:58:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.211+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb210 0x557a064ee920 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4096680 tx=0x7fe5b4099db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2bd3f61e24e2da server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:12.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.211+0000 7fe5adffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:58:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.212+0000 7fe5adffb700 1 -- 172.21.15.151:0/190588510 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5b409a5e0 con 0x557a064eb210 2023-07-21T22:58:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.212+0000 7fe5adffb700 1 -- 172.21.15.151:0/190588510 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fe5b409e1b0 con 0x557a064eb210 2023-07-21T22:58:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.212+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/190588510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a06390490 con 0x557a064eb210 2023-07-21T22:58:12.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.213+0000 7fe5adffb700 1 -- 172.21.15.151:0/190588510 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5b40a25d0 con 0x557a064eb210 2023-07-21T22:58:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.215+0000 7fe5e01bfb80 10 client.19335 fetch_fsmap learned FSMap version 109 2023-07-21T22:58:12.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.215+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/190588510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x557a0624dc00 con 0x557a064eb210 2023-07-21T22:58:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.216+0000 7fe5adffb700 1 -- 172.21.15.151:0/190588510 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a06390490 con 0x557a064eb210 2023-07-21T22:58:12.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.216+0000 7fe5adffb700 1 -- 172.21.15.151:0/190588510 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe5b40a2140 con 0x557a064eb210 2023-07-21T22:58:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.216+0000 7fe5e01bfb80 10 client.19335 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:58:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.216+0000 7fe5e01bfb80 10 client.19335 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:58:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.216+0000 7fe5e01bfb80 20 client.19335 populate_metadata read hostname 'smithi151' 2023-07-21T22:58:12.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.216+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a0650fb60 0x557a06511f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.216+0000 7fe5e01bfb80 4 client.19335 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:58:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.216+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/190588510 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a0642fe50 con 0x557a0650fb60 2023-07-21T22:58:12.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.218+0000 7fe5ca59b700 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a0650fb60 0x557a06511f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.219+0000 7fe5ca59b700 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a0650fb60 0x557a06511f70 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abeb09ff78115fe4 server_cookie=dc6ceb35f3dc1233 in_seq=0 out_seq=0 2023-07-21T22:58:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.220+0000 7fe5adffb700 10 client.19335 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.220+0000 7fe5adffb700 1 -- 172.21.15.151:0/190588510 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557a0642fe50 con 0x557a0650fb60 2023-07-21T22:58:12.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.220+0000 7fe5adffb700 10 client.19335 handle_command_reply: tid=0 2023-07-21T22:58:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.220+0000 7fe5e01bfb80 1 client.19335 shutdown 2023-07-21T22:58:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.221+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/190588510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb210 msgr2=0x557a064ee920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:12.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.221+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb210 0x557a064ee920 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4096680 tx=0x7fe5b4099db0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.221+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/190588510 shutdown_connections 2023-07-21T22:58:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.221+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a0650fb60 0x557a06511f70 crc :-1 s=READY pgs=447 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.221+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a064f1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.221+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064eb660 0x557a064ef060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.221+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/190588510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb210 0x557a064ee920 secure :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fe5b4096680 tx=0x7fe5b4099db0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.221+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/190588510 >> 172.21.15.151:0/190588510 conn(0x557a064daae0 msgr2=0x557a064df3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.221+0000 7fe5adffb700 0 client.19335 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:12.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.222+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/190588510 shutdown_connections 2023-07-21T22:58:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.222+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/190588510 wait complete. 2023-07-21T22:58:12.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.223+0000 7fe5e01bfb80 20 client.19335 trim_cache size 0 max 16384 2023-07-21T22:58:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.243+0000 7fe5e01bfb80 1 Processor -- start 2023-07-21T22:58:12.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.243+0000 7fe5e01bfb80 1 -- start start 2023-07-21T22:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.243+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a063416b0 0x557a064dfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.243+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 0x557a064e00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.243+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a064ee100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.243+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a064dcc50 con 0x557a063416b0 2023-07-21T22:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.243+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a064efec0 con 0x557a064eb660 2023-07-21T22:58:12.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.243+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a064e5fa0 con 0x557a064e9160 2023-07-21T22:58:12.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5cad9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a064ee100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5cad9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a064ee100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52826/0 (socket says 172.21.15.151:52826) 2023-07-21T22:58:12.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5cad9c700 1 -- 172.21.15.151:0/1990173604 learned_addr learned my addr 172.21.15.151:0/1990173604 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5ca59b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a063416b0 0x557a064dfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/1990173604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 0x557a064e00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5cad9c700 1 -- 172.21.15.151:0/1990173604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 msgr2=0x557a064e00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5cad9c700 1 --2- 172.21.15.151:0/1990173604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 0x557a064e00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5cad9c700 1 -- 172.21.15.151:0/1990173604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a063416b0 msgr2=0x557a064dfb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5cad9c700 1 --2- 172.21.15.151:0/1990173604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a063416b0 0x557a064dfb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5cad9c700 1 -- 172.21.15.151:0/1990173604 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a0628b1f0 con 0x557a064e9160 2023-07-21T22:58:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.244+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/1990173604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 0x557a064e00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:58:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.245+0000 7fe5cad9c700 1 --2- 172.21.15.151:0/1990173604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a064ee100 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009390 tx=0x7fe5bc014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8cbcd94051c52a0d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:12.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.245+0000 7fe5b97fa700 1 -- 172.21.15.151:0/1990173604 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc00e040 con 0x557a064e9160 2023-07-21T22:58:12.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.245+0000 7fe5b97fa700 1 -- 172.21.15.151:0/1990173604 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5bc00f040 con 0x557a064e9160 2023-07-21T22:58:12.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.245+0000 7fe5b97fa700 1 -- 172.21.15.151:0/1990173604 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5bc0176a0 con 0x557a064e9160 2023-07-21T22:58:12.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.246+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/1990173604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 msgr2=0x557a064ee100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.246+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/1990173604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a064ee100 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe5bc009390 tx=0x7fe5bc014000 comp rx=0 tx=0).stop 2023-07-21T22:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.246+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/1990173604 shutdown_connections 2023-07-21T22:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.246+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/1990173604 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a064ee100 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.246+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/1990173604 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a063416b0 0x557a064dfb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.246+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/1990173604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a064eb660 0x557a064e00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.246+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/1990173604 >> 172.21.15.151:0/1990173604 conn(0x557a064daae0 msgr2=0x557a064e8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.246+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/1990173604 shutdown_connections 2023-07-21T22:58:12.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.246+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/1990173604 wait complete. 2023-07-21T22:58:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.247+0000 7fe5e01bfb80 1 -- start start 2023-07-21T22:58:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.247+0000 7fe5e01bfb80 1 Processor -- start 2023-07-21T22:58:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a06506c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a06504fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5e01bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb660 0x557a06505530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a06505c40 con 0x557a064eb660 2023-07-21T22:58:12.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a06505db0 con 0x557a063416b0 2023-07-21T22:58:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5e01bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a065639f0 con 0x557a064e9160 2023-07-21T22:58:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5e01bfb80 10 client.0 _ll_register_callbacks cb 0x7fe5b4096590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:58:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5cad9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb660 0x557a06505530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5ca59b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a06506c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5ca59b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a06506c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:45570/0 (socket says 172.21.15.151:45570) 2023-07-21T22:58:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5ca59b700 1 -- 172.21.15.151:0/2953646311 learned_addr learned my addr 172.21.15.151:0/2953646311 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:12.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.248+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a06504fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.249+0000 7fe5ca59b700 1 -- 172.21.15.151:0/2953646311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 msgr2=0x557a06504fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.249+0000 7fe5ca59b700 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a06504fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.249+0000 7fe5ca59b700 1 -- 172.21.15.151:0/2953646311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb660 msgr2=0x557a06505530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.249+0000 7fe5ca59b700 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb660 0x557a06505530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.249+0000 7fe5ca59b700 1 -- 172.21.15.151:0/2953646311 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557a0624dc00 con 0x557a063416b0 2023-07-21T22:58:12.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.249+0000 7fe5ca59b700 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a06506c60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00094f0 tx=0x7fe5c0030450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8754dce78bc874d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.249+0000 7fe5adffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.249+0000 7fe5adffb700 1 -- 172.21.15.151:0/2953646311 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5c0030cf0 con 0x557a063416b0 2023-07-21T22:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.250+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/2953646311 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe5c001d040 con 0x557a063416b0 2023-07-21T22:58:12.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.250+0000 7fe5adffb700 1 -- 172.21.15.151:0/2953646311 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(155..155 src has 1..155) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fe5c000f460 con 0x557a063416b0 2023-07-21T22:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.250+0000 7fe5adffb700 1 -- 172.21.15.151:0/2953646311 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe5c0030e50 con 0x557a063416b0 2023-07-21T22:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.250+0000 7fe5e01bfb80 10 client.29033 fetch_fsmap learned FSMap version 109 2023-07-21T22:58:12.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.250+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/2953646311 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x7fe5bc009040 con 0x557a063416b0 2023-07-21T22:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.251+0000 7fe5adffb700 1 -- 172.21.15.151:0/2953646311 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe5c001d040 con 0x557a063416b0 2023-07-21T22:58:12.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.251+0000 7fe5adffb700 1 -- 172.21.15.151:0/2953646311 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fe5c0015020 con 0x557a063416b0 2023-07-21T22:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.251+0000 7fe5e01bfb80 10 client.29033 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.251+0000 7fe5e01bfb80 10 client.29033 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:58:12.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.251+0000 7fe5e01bfb80 20 client.29033 populate_metadata read hostname 'smithi151' 2023-07-21T22:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.251+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a06564cb0 0x557a065670c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.251+0000 7fe5e01bfb80 4 client.29033 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:58:12.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.251+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/2953646311 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a063f1ff0 con 0x557a06564cb0 2023-07-21T22:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.251+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a06564cb0 0x557a065670c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.253+0000 7fe5c9d9a700 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a06564cb0 0x557a065670c0 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb4a20dd12426ac7 server_cookie=b41a06cb6102df41 in_seq=0 out_seq=0 2023-07-21T22:58:12.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.253+0000 7fe5adffb700 10 client.29033 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:12.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.278+0000 7fe5adffb700 1 -- 172.21.15.151:0/2953646311 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a063f1ff0 con 0x557a06564cb0 2023-07-21T22:58:12.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.278+0000 7fe5adffb700 10 client.29033 handle_command_reply: tid=0 2023-07-21T22:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.280+0000 7fe5e01bfb80 1 client.29033 shutdown 2023-07-21T22:58:12.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.280+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/2953646311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 msgr2=0x557a06506c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:12.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.280+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a06506c60 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe5c00094f0 tx=0x7fe5c0030450 comp rx=0 tx=0).stop 2023-07-21T22:58:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.285+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/2953646311 shutdown_connections 2023-07-21T22:58:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.285+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a06564cb0 0x557a065670c0 crc :-1 s=READY pgs=448 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.285+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a063416b0 0x557a06506c60 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.285+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a064eb660 0x557a06505530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.285+0000 7fe5e01bfb80 1 --2- 172.21.15.151:0/2953646311 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a064e9160 0x557a06504fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.285+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/2953646311 >> 172.21.15.151:0/2953646311 conn(0x557a064daae0 msgr2=0x557a064e99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.287+0000 7fe5adffb700 0 client.29033 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:12.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.289+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/2953646311 shutdown_connections 2023-07-21T22:58:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.289+0000 7fe5e01bfb80 1 -- 172.21.15.151:0/2953646311 wait complete. 2023-07-21T22:58:12.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.290+0000 7fe5e01bfb80 20 client.29033 trim_cache size 0 max 16384 2023-07-21T22:58:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:58:12.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:58:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:58:12.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:58:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.291+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/3656489293 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe5b00a13c0 msgr2=0x7fe5b00a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:12.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.291+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe5b00a13c0 0x7fe5b00a3870 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fe5c41ab5d0 tx=0x7fe5bc009920 comp rx=0 tx=0).stop 2023-07-21T22:58:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.291+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/3656489293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5c406d3a0 msgr2=0x7fe5c41aae80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.291+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5c406d3a0 0x7fe5c41aae80 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe5b400eb90 tx=0x7fe5b400eea0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.292+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/3656489293 shutdown_connections 2023-07-21T22:58:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.292+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe5b00a13c0 0x7fe5b00a3870 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.292+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5c410e2a0 0x7fe5c41a4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.292+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5c406c910 0x7fe5c41aa940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.292+0000 7fe5cc7ff700 1 --2- 172.21.15.151:0/3656489293 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe5c406d3a0 0x7fe5c41aae80 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.292+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/3656489293 >> 172.21.15.151:0/3656489293 conn(0x7fe5c406bd70 msgr2=0x7fe5c406f250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.293+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/3656489293 shutdown_connections 2023-07-21T22:58:12.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:12.293+0000 7fe5cc7ff700 1 -- 172.21.15.151:0/3656489293 wait complete. 2023-07-21T22:58:13.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:12 smithi195 ceph-mon[97365]: pgmap v1241: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 771 op/s 2023-07-21T22:58:13.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:12 smithi151 ceph-mon[95510]: pgmap v1241: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 771 op/s 2023-07-21T22:58:13.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:12 smithi187 ceph-mon[96918]: pgmap v1241: 97 pgs: 2 active+clean+snaptrim, 89 active+clean, 6 active+clean+snaptrim_wait; 12 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 8.2 MiB/s wr, 771 op/s 2023-07-21T22:58:14.294 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 320.0 s, 322.3 tps, lat 308.261 ms stddev 84.751 2023-07-21T22:58:15.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:14 smithi151 ceph-mon[95510]: pgmap v1242: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.3 MiB/s wr, 686 op/s 2023-07-21T22:58:15.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:14 smithi187 ceph-mon[96918]: pgmap v1242: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.3 MiB/s wr, 686 op/s 2023-07-21T22:58:15.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:14 smithi195 ceph-mon[97365]: pgmap v1242: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 7.3 MiB/s wr, 686 op/s 2023-07-21T22:58:16.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:15 smithi187 ceph-mon[96918]: pgmap v1243: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.2 MiB/s wr, 580 op/s 2023-07-21T22:58:16.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:15 smithi195 ceph-mon[97365]: pgmap v1243: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.2 MiB/s wr, 580 op/s 2023-07-21T22:58:16.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:15 smithi151 ceph-mon[95510]: pgmap v1243: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 6.2 MiB/s wr, 580 op/s 2023-07-21T22:58:18.147 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:17 smithi195 ceph-mon[97365]: osdmap e156: 12 total, 12 up, 12 in 2023-07-21T22:58:18.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:17 smithi151 ceph-mon[95510]: osdmap e156: 12 total, 12 up, 12 in 2023-07-21T22:58:18.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:17 smithi187 ceph-mon[96918]: osdmap e156: 12 total, 12 up, 12 in 2023-07-21T22:58:19.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:18 smithi151 ceph-mon[95510]: pgmap v1245: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 957 op/s 2023-07-21T22:58:19.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 325.0 s, 352.4 tps, lat 288.393 ms stddev 75.920 2023-07-21T22:58:19.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:18 smithi187 ceph-mon[96918]: pgmap v1245: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 957 op/s 2023-07-21T22:58:19.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:18 smithi195 ceph-mon[97365]: pgmap v1245: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 957 op/s 2023-07-21T22:58:20.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:19 smithi187 ceph-mon[96918]: pgmap v1246: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 957 op/s 2023-07-21T22:58:20.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:19 smithi195 ceph-mon[97365]: pgmap v1246: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 957 op/s 2023-07-21T22:58:20.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:19 smithi151 ceph-mon[95510]: pgmap v1246: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 957 op/s 2023-07-21T22:58:23.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:22 smithi195 ceph-mon[97365]: pgmap v1247: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 957 op/s 2023-07-21T22:58:23.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:22 smithi151 ceph-mon[95510]: pgmap v1247: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 957 op/s 2023-07-21T22:58:23.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:22 smithi187 ceph-mon[96918]: pgmap v1247: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 10 MiB/s wr, 957 op/s 2023-07-21T22:58:24.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 330.0 s, 402.8 tps, lat 246.453 ms stddev 53.850 2023-07-21T22:58:25.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:24 smithi195 ceph-mon[97365]: pgmap v1248: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-07-21T22:58:25.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:24 smithi151 ceph-mon[95510]: pgmap v1248: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-07-21T22:58:25.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:24 smithi187 ceph-mon[96918]: pgmap v1248: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-07-21T22:58:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.545+0000 7f426f9ff700 1 -- 172.21.15.151:0/555292177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4268105b00 msgr2=0x7f4268105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:25.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.545+0000 7f426f9ff700 1 --2- 172.21.15.151:0/555292177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4268105b00 0x7f4268105ed0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f42640098f0 tx=0x7f4264009c00 comp rx=0 tx=0).stop 2023-07-21T22:58:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.545+0000 7f426f9ff700 1 -- 172.21.15.151:0/555292177 shutdown_connections 2023-07-21T22:58:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.545+0000 7f426f9ff700 1 --2- 172.21.15.151:0/555292177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4268105b00 0x7f4268105ed0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.545+0000 7f426f9ff700 1 --2- 172.21.15.151:0/555292177 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42681004a0 0x7f426810c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.545+0000 7f426f9ff700 1 --2- 172.21.15.151:0/555292177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f42680ffaf0 0x7f42680fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.545+0000 7f426f9ff700 1 -- 172.21.15.151:0/555292177 >> 172.21.15.151:0/555292177 conn(0x7f42680fb5f0 msgr2=0x7f42680fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.545+0000 7f426f9ff700 1 -- 172.21.15.151:0/555292177 shutdown_connections 2023-07-21T22:58:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.545+0000 7f426f9ff700 1 -- 172.21.15.151:0/555292177 wait complete. 2023-07-21T22:58:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.547+0000 7f426f9ff700 1 Processor -- start 2023-07-21T22:58:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.547+0000 7f426f9ff700 1 -- start start 2023-07-21T22:58:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426f9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42680ffaf0 0x7f4268197e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426f9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42681004a0 0x7f42681983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426f9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4268105b00 0x7f426819ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426f9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426819d050 con 0x7f4268105b00 2023-07-21T22:58:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426f9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426819d1c0 con 0x7f42681004a0 2023-07-21T22:58:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426f9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426819d380 con 0x7f42680ffaf0 2023-07-21T22:58:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426df9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4268105b00 0x7f426819ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426d79b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42680ffaf0 0x7f4268197e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42681004a0 0x7f42681983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426d79b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42680ffaf0 0x7f4268197e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52540/0 (socket says 172.21.15.151:52540) 2023-07-21T22:58:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.548+0000 7f426d79b700 1 -- 172.21.15.151:0/3776163597 learned_addr learned my addr 172.21.15.151:0/3776163597 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.549+0000 7f426df9c700 1 -- 172.21.15.151:0/3776163597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42680ffaf0 msgr2=0x7f4268197e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.549+0000 7f426df9c700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42680ffaf0 0x7f4268197e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.549+0000 7f426df9c700 1 -- 172.21.15.151:0/3776163597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42681004a0 msgr2=0x7f42681983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.549+0000 7f426df9c700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42681004a0 0x7f42681983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.549+0000 7f426df9c700 1 -- 172.21.15.151:0/3776163597 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4264009520 con 0x7f4268105b00 2023-07-21T22:58:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.549+0000 7f426d79b700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42680ffaf0 0x7f4268197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:58:25.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.549+0000 7f426cf9a700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42681004a0 0x7f42681983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:58:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.550+0000 7f426df9c700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4268105b00 0x7f426819ca10 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f426000efc0 tx=0x7f426000c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.550+0000 7f425e7fc700 1 -- 172.21.15.151:0/3776163597 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4260018070 con 0x7f4268105b00 2023-07-21T22:58:25.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.550+0000 7f425e7fc700 1 -- 172.21.15.151:0/3776163597 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f426000f040 con 0x7f4268105b00 2023-07-21T22:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.550+0000 7f425e7fc700 1 -- 172.21.15.151:0/3776163597 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f426000cba0 con 0x7f4268105b00 2023-07-21T22:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.550+0000 7f426f9ff700 1 -- 172.21.15.151:0/3776163597 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f426819d600 con 0x7f4268105b00 2023-07-21T22:58:25.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.550+0000 7f426f9ff700 1 -- 172.21.15.151:0/3776163597 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42681a4ea0 con 0x7f4268105b00 2023-07-21T22:58:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.556+0000 7f425e7fc700 1 -- 172.21.15.151:0/3776163597 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4260003a00 con 0x7f4268105b00 2023-07-21T22:58:25.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.558+0000 7f4283254b80 1 Processor -- start 2023-07-21T22:58:25.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.558+0000 7f4283254b80 1 -- start start 2023-07-21T22:58:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.559+0000 7f4283254b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.559+0000 7f4283254b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.559+0000 7f4283254b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fadcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.559+0000 7f4283254b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce57eaac50 con 0x55ce57fb3a20 2023-07-21T22:58:25.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.559+0000 7f4283254b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce57efd9e0 con 0x55ce57fb3e70 2023-07-21T22:58:25.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.559+0000 7f4283254b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce57ef6e70 con 0x55ce57e016b0 2023-07-21T22:58:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52550/0 (socket says 172.21.15.151:52550) 2023-07-21T22:58:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 -- 172.21.15.151:0/550917115 learned_addr learned my addr 172.21.15.151:0/550917115 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 --2- 172.21.15.151:0/550917115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fadcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426d79b700 1 --2- 172.21.15.151:0/550917115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 -- 172.21.15.151:0/550917115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 msgr2=0x55ce57fadcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 --2- 172.21.15.151:0/550917115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fadcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 -- 172.21.15.151:0/550917115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 msgr2=0x55ce57fad750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 --2- 172.21.15.151:0/550917115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fad750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 -- 172.21.15.151:0/550917115 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce57d24d80 con 0x55ce57e016b0 2023-07-21T22:58:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f425e7fc700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42540a1340 0x7f42540a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.560+0000 7f426cf9a700 1 --2- 172.21.15.151:0/550917115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb34e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4258011c70 tx=0x7f4258009c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7cdfcc989e8f879 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.561+0000 7f425e7fc700 1 -- 172.21.15.151:0/3776163597 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f42600cc680 con 0x7f4268105b00 2023-07-21T22:58:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.561+0000 7f42537fe700 1 -- 172.21.15.151:0/550917115 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800f6d0 con 0x55ce57e016b0 2023-07-21T22:58:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.561+0000 7f426d79b700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42540a1340 0x7f42540a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.561+0000 7f42537fe700 1 -- 172.21.15.151:0/550917115 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f425800fcc0 con 0x55ce57e016b0 2023-07-21T22:58:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.561+0000 7f42537fe700 1 -- 172.21.15.151:0/550917115 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425801fae0 con 0x55ce57e016b0 2023-07-21T22:58:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f4283254b80 1 -- 172.21.15.151:0/550917115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 msgr2=0x55ce57fb34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f426d79b700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42540a1340 0x7f42540a37f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4264009fd0 tx=0x7f4264019040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f4283254b80 1 --2- 172.21.15.151:0/550917115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb34e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f4258011c70 tx=0x7f4258009c30 comp rx=0 tx=0).stop 2023-07-21T22:58:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f4283254b80 1 -- 172.21.15.151:0/550917115 shutdown_connections 2023-07-21T22:58:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f4283254b80 1 --2- 172.21.15.151:0/550917115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fadcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f4283254b80 1 --2- 172.21.15.151:0/550917115 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb34e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f4283254b80 1 --2- 172.21.15.151:0/550917115 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fad750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f4283254b80 1 -- 172.21.15.151:0/550917115 >> 172.21.15.151:0/550917115 conn(0x55ce57f9aae0 msgr2=0x55ce57fa00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f4283254b80 1 -- 172.21.15.151:0/550917115 shutdown_connections 2023-07-21T22:58:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.562+0000 7f4283254b80 1 -- 172.21.15.151:0/550917115 wait complete. 2023-07-21T22:58:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.563+0000 7f4283254b80 1 -- start start 2023-07-21T22:58:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.563+0000 7f4283254b80 1 Processor -- start 2023-07-21T22:58:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.564+0000 7f4283254b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb9d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.564+0000 7f4283254b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fb7000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.564+0000 7f4283254b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fb7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.564+0000 7f4283254b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce57e96a60 con 0x55ce57fb3a20 2023-07-21T22:58:25.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.564+0000 7f4283254b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce57e96760 con 0x55ce57fb3e70 2023-07-21T22:58:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.564+0000 7f4283254b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce57d7a8c0 con 0x55ce57e016b0 2023-07-21T22:58:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.564+0000 7f4283254b80 10 client.0 _ll_register_callbacks cb 0x55ce57e94700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:58:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.565+0000 7f426df9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fb7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.565+0000 7f426df9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fb7680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41900/0 (socket says 172.21.15.151:41900) 2023-07-21T22:58:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.565+0000 7f426df9c700 1 -- 172.21.15.151:0/916391086 learned_addr learned my addr 172.21.15.151:0/916391086 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.565+0000 7f426d79b700 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.565+0000 7f426df9c700 1 -- 172.21.15.151:0/916391086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 msgr2=0x55ce57fb9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.565+0000 7f426df9c700 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.565+0000 7f426df9c700 1 -- 172.21.15.151:0/916391086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 msgr2=0x55ce57fb7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.565+0000 7f426df9c700 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fb7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.565+0000 7f426df9c700 1 -- 172.21.15.151:0/916391086 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4258019040 con 0x55ce57fb3e70 2023-07-21T22:58:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.566+0000 7f426df9c700 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fb7680 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4260099790 tx=0x7f4260099160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4b9a2e61c08853c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.566+0000 7f4250ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:58:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.566+0000 7f4250ff9700 1 -- 172.21.15.151:0/916391086 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42600a1bc0 con 0x55ce57fb3e70 2023-07-21T22:58:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.566+0000 7f4250ff9700 1 -- 172.21.15.151:0/916391086 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f42600b90d0 con 0x55ce57fb3e70 2023-07-21T22:58:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.566+0000 7f4283254b80 1 -- 172.21.15.151:0/916391086 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ce57e50490 con 0x55ce57fb3e70 2023-07-21T22:58:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.566+0000 7f4250ff9700 1 -- 172.21.15.151:0/916391086 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f42600b9290 con 0x55ce57fb3e70 2023-07-21T22:58:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.566+0000 7f4283254b80 10 client.29045 fetch_fsmap learned FSMap version 109 2023-07-21T22:58:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.566+0000 7f4283254b80 1 -- 172.21.15.151:0/916391086 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55ce57d0dc00 con 0x55ce57fb3e70 2023-07-21T22:58:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.567+0000 7f4250ff9700 1 -- 172.21.15.151:0/916391086 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ce57e50490 con 0x55ce57fb3e70 2023-07-21T22:58:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.567+0000 7f4250ff9700 1 -- 172.21.15.151:0/916391086 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f42600a1730 con 0x55ce57fb3e70 2023-07-21T22:58:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.568+0000 7f4283254b80 10 client.29045 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:58:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.568+0000 7f4283254b80 10 client.29045 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:58:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.568+0000 7f4283254b80 20 client.29045 populate_metadata read hostname 'smithi151' 2023-07-21T22:58:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.568+0000 7f4283254b80 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce57fc72c0 0x55ce57fc96d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.568+0000 7f4283254b80 4 client.29045 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:58:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.568+0000 7f4283254b80 1 -- 172.21.15.151:0/916391086 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ce57eefe50 con 0x55ce57fc72c0 2023-07-21T22:58:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.569+0000 7f426d79b700 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce57fc72c0 0x55ce57fc96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.572+0000 7f426d79b700 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce57fc72c0 0x55ce57fc96d0 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ad1abe90b9656b3 server_cookie=dd0da56361972c7f in_seq=0 out_seq=0 2023-07-21T22:58:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.572+0000 7f4250ff9700 10 client.29045 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.573+0000 7f4250ff9700 1 -- 172.21.15.151:0/916391086 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ce57eefe50 con 0x55ce57fc72c0 2023-07-21T22:58:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.573+0000 7f4250ff9700 10 client.29045 handle_command_reply: tid=0 2023-07-21T22:58:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.573+0000 7f4283254b80 1 client.29045 shutdown 2023-07-21T22:58:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4283254b80 1 -- 172.21.15.151:0/916391086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 msgr2=0x55ce57fb7680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4283254b80 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fb7680 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4260099790 tx=0x7f4260099160 comp rx=0 tx=0).stop 2023-07-21T22:58:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4283254b80 1 -- 172.21.15.151:0/916391086 shutdown_connections 2023-07-21T22:58:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4283254b80 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce57fc72c0 0x55ce57fc96d0 crc :-1 s=READY pgs=449 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4283254b80 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3e70 0x55ce57fb7680 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4283254b80 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57fb9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4283254b80 1 --2- 172.21.15.151:0/916391086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fb7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4250ff9700 0 client.29045 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4283254b80 1 -- 172.21.15.151:0/916391086 >> 172.21.15.151:0/916391086 conn(0x55ce57f9aae0 msgr2=0x55ce57f9f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.574+0000 7f4283254b80 1 -- 172.21.15.151:0/916391086 shutdown_connections 2023-07-21T22:58:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.575+0000 7f4283254b80 1 -- 172.21.15.151:0/916391086 wait complete. 2023-07-21T22:58:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.575+0000 7f4283254b80 20 client.29045 trim_cache size 0 max 16384 2023-07-21T22:58:25.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.601+0000 7f4283254b80 1 Processor -- start 2023-07-21T22:58:25.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.601+0000 7f4283254b80 1 -- start start 2023-07-21T22:58:25.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f4283254b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57f9aae0 0x55ce57fb2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f4283254b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57e016b0 0x55ce57fa4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f4283254b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3a20 0x55ce57fb9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f4283254b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce57fb7f90 con 0x55ce57e016b0 2023-07-21T22:58:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f4283254b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce57fb85e0 con 0x55ce57fb3a20 2023-07-21T22:58:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f4283254b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce57fa0d50 con 0x55ce57f9aae0 2023-07-21T22:58:25.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57e016b0 0x55ce57fa4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57e016b0 0x55ce57fa4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59694/0 (socket says 172.21.15.151:59694) 2023-07-21T22:58:25.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f426cf9a700 1 -- 172.21.15.151:0/3465010820 learned_addr learned my addr 172.21.15.151:0/3465010820 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:25.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.602+0000 7f426d79b700 1 --2- 172.21.15.151:0/3465010820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57f9aae0 0x55ce57fb2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.603+0000 7f426cf9a700 1 -- 172.21.15.151:0/3465010820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57f9aae0 msgr2=0x55ce57fb2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.603+0000 7f426cf9a700 1 --2- 172.21.15.151:0/3465010820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57f9aae0 0x55ce57fb2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.603+0000 7f426cf9a700 1 -- 172.21.15.151:0/3465010820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3a20 msgr2=0x55ce57fb9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.603+0000 7f426cf9a700 1 --2- 172.21.15.151:0/3465010820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3a20 0x55ce57fb9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.603+0000 7f426cf9a700 1 -- 172.21.15.151:0/3465010820 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ce57fce320 con 0x55ce57e016b0 2023-07-21T22:58:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.603+0000 7f426cf9a700 1 --2- 172.21.15.151:0/3465010820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57e016b0 0x55ce57fa4640 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f425801e000 tx=0x7f42580092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ded81b3b029daa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.604+0000 7f4253fff700 1 -- 172.21.15.151:0/3465010820 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800fe30 con 0x55ce57e016b0 2023-07-21T22:58:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.604+0000 7f4253fff700 1 -- 172.21.15.151:0/3465010820 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f425800fb30 con 0x55ce57e016b0 2023-07-21T22:58:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.604+0000 7f4253fff700 1 -- 172.21.15.151:0/3465010820 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42580038c0 con 0x55ce57e016b0 2023-07-21T22:58:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.605+0000 7f4283254b80 1 -- 172.21.15.151:0/3465010820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57e016b0 msgr2=0x55ce57fa4640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.605+0000 7f4283254b80 1 --2- 172.21.15.151:0/3465010820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57e016b0 0x55ce57fa4640 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f425801e000 tx=0x7f42580092d0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.605+0000 7f4283254b80 1 -- 172.21.15.151:0/3465010820 shutdown_connections 2023-07-21T22:58:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.605+0000 7f4283254b80 1 --2- 172.21.15.151:0/3465010820 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57fb3a20 0x55ce57fb9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.605+0000 7f4283254b80 1 --2- 172.21.15.151:0/3465010820 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57f9aae0 0x55ce57fb2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.605+0000 7f4283254b80 1 --2- 172.21.15.151:0/3465010820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57e016b0 0x55ce57fa4640 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.605+0000 7f4283254b80 1 -- 172.21.15.151:0/3465010820 >> 172.21.15.151:0/3465010820 conn(0x55ce57fadd90 msgr2=0x55ce57fa3f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.605+0000 7f4283254b80 1 -- 172.21.15.151:0/3465010820 shutdown_connections 2023-07-21T22:58:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.605+0000 7f4283254b80 1 -- 172.21.15.151:0/3465010820 wait complete. 2023-07-21T22:58:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.606+0000 7f4283254b80 1 -- start start 2023-07-21T22:58:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.606+0000 7f4283254b80 1 Processor -- start 2023-07-21T22:58:25.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.613+0000 7f4283254b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57faf580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.614+0000 7f4283254b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57f9aae0 0x55ce57fafac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.614+0000 7f4283254b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fb0000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.614+0000 7f4283254b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce5801b1a0 con 0x55ce57fb3a20 2023-07-21T22:58:25.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.614+0000 7f4283254b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce5801b2e0 con 0x55ce57f9aae0 2023-07-21T22:58:25.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.614+0000 7f4283254b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ce5801b420 con 0x55ce57e016b0 2023-07-21T22:58:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.614+0000 7f4283254b80 10 client.0 _ll_register_callbacks cb 0x7f4260095c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:58:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.614+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57f9aae0 0x55ce57fafac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.614+0000 7f426cf9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57f9aae0 0x55ce57fafac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41918/0 (socket says 172.21.15.151:41918) 2023-07-21T22:58:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.614+0000 7f426cf9a700 1 -- 172.21.15.151:0/3744605332 learned_addr learned my addr 172.21.15.151:0/3744605332 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.615+0000 7f426cf9a700 1 -- 172.21.15.151:0/3744605332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 msgr2=0x55ce57faf580 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:58:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.615+0000 7f426cf9a700 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57faf580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.615+0000 7f426cf9a700 1 -- 172.21.15.151:0/3744605332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 msgr2=0x55ce57fb0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.615+0000 7f426cf9a700 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fb0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.615+0000 7f426cf9a700 1 -- 172.21.15.151:0/3744605332 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ce57d24d80 con 0x55ce57f9aae0 2023-07-21T22:58:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.616+0000 7f426cf9a700 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57f9aae0 0x55ce57fafac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f42580119e0 tx=0x7f42580054c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1e29bb5c92f1207a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.620+0000 7f4250ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:58:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.620+0000 7f4250ff9700 1 -- 172.21.15.151:0/3744605332 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4258005700 con 0x55ce57f9aae0 2023-07-21T22:58:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.620+0000 7f4250ff9700 1 -- 172.21.15.151:0/3744605332 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f425800f8b0 con 0x55ce57f9aae0 2023-07-21T22:58:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.620+0000 7f4283254b80 1 -- 172.21.15.151:0/3744605332 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f425800fcc0 con 0x55ce57f9aae0 2023-07-21T22:58:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.620+0000 7f4250ff9700 1 -- 172.21.15.151:0/3744605332 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=109) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4258003680 con 0x55ce57f9aae0 2023-07-21T22:58:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.621+0000 7f4283254b80 10 client.29048 fetch_fsmap learned FSMap version 109 2023-07-21T22:58:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.621+0000 7f4283254b80 1 -- 172.21.15.151:0/3744605332 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=109,monmap=4+}) v3 -- 0x55ce57d4b1f0 con 0x55ce57f9aae0 2023-07-21T22:58:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.621+0000 7f4250ff9700 1 -- 172.21.15.151:0/3744605332 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f425800fcc0 con 0x55ce57f9aae0 2023-07-21T22:58:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.622+0000 7f4250ff9700 1 -- 172.21.15.151:0/3744605332 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 109) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f425803c890 con 0x55ce57f9aae0 2023-07-21T22:58:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.622+0000 7f4283254b80 10 client.29048 fetch_fsmap finished waiting for FSMap version 109 2023-07-21T22:58:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.622+0000 7f4283254b80 10 client.29048 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:58:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.622+0000 7f4283254b80 20 client.29048 populate_metadata read hostname 'smithi151' 2023-07-21T22:58:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.622+0000 7f4283254b80 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce57fb3e70 0x55ce5801e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.622+0000 7f4283254b80 4 client.29048 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:58:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.622+0000 7f4283254b80 1 -- 172.21.15.151:0/3744605332 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ce57eb1ff0 con 0x55ce57fb3e70 2023-07-21T22:58:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.623+0000 7f426d79b700 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce57fb3e70 0x55ce5801e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.623+0000 7f426d79b700 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce57fb3e70 0x55ce5801e710 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=66488b3bb03962dc server_cookie=a06e5ba2d8cd5639 in_seq=0 out_seq=0 2023-07-21T22:58:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.624+0000 7f4250ff9700 10 client.29048 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:25.679 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.645+0000 7f4250ff9700 1 -- 172.21.15.151:0/3744605332 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ce57eb1ff0 con 0x55ce57fb3e70 2023-07-21T22:58:25.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.645+0000 7f4250ff9700 10 client.29048 handle_command_reply: tid=0 2023-07-21T22:58:25.680 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.646+0000 7f4283254b80 1 client.29048 shutdown 2023-07-21T22:58:25.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.648+0000 7f4283254b80 1 -- 172.21.15.151:0/3744605332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57f9aae0 msgr2=0x55ce57fafac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:25.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.648+0000 7f4283254b80 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57f9aae0 0x55ce57fafac0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f42580119e0 tx=0x7f42580054c0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.652+0000 7f4283254b80 1 -- 172.21.15.151:0/3744605332 shutdown_connections 2023-07-21T22:58:25.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.652+0000 7f4283254b80 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ce57fb3e70 0x55ce5801e710 crc :-1 s=READY pgs=450 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.652+0000 7f4283254b80 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce57fb3a20 0x55ce57fb0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.652+0000 7f4283254b80 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ce57e016b0 0x55ce57faf580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.652+0000 7f4283254b80 1 --2- 172.21.15.151:0/3744605332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ce57f9aae0 0x55ce57fafac0 secure :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f42580119e0 tx=0x7f42580054c0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.652+0000 7f4283254b80 1 -- 172.21.15.151:0/3744605332 >> 172.21.15.151:0/3744605332 conn(0x55ce57fadd90 msgr2=0x55ce57fb2800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:25.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.653+0000 7f4250ff9700 0 client.29048 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.655+0000 7f4283254b80 1 -- 172.21.15.151:0/3744605332 shutdown_connections 2023-07-21T22:58:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.655+0000 7f4283254b80 1 -- 172.21.15.151:0/3744605332 wait complete. 2023-07-21T22:58:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.656+0000 7f4283254b80 20 client.29048 trim_cache size 0 max 16384 2023-07-21T22:58:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:58:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:58:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:58:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:58:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 -- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42540a1340 msgr2=0x7f42540a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42540a1340 0x7f42540a37f0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4264009fd0 tx=0x7f4264019040 comp rx=0 tx=0).stop 2023-07-21T22:58:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 -- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4268105b00 msgr2=0x7f426819ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4268105b00 0x7f426819ca10 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7f426000efc0 tx=0x7f426000c3a0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 -- 172.21.15.151:0/3776163597 shutdown_connections 2023-07-21T22:58:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f42540a1340 0x7f42540a37f0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4268105b00 0x7f426819ca10 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f42680ffaf0 0x7f4268197e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 --2- 172.21.15.151:0/3776163597 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42681004a0 0x7f42681983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 -- 172.21.15.151:0/3776163597 >> 172.21.15.151:0/3776163597 conn(0x7f42680fb5f0 msgr2=0x7f426810aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.657+0000 7f426f9ff700 1 -- 172.21.15.151:0/3776163597 shutdown_connections 2023-07-21T22:58:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:25.658+0000 7f426f9ff700 1 -- 172.21.15.151:0/3776163597 wait complete. 2023-07-21T22:58:26.646 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-mds[134580]: -- 172.21.15.195:0/833920311 <== mon.1 v2:172.21.15.195:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a48f9891e0 con 0x55a48f95e800 2023-07-21T22:58:26.647 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[134556]: ignoring --setuser ceph since I am not root 2023-07-21T22:58:26.647 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[134556]: ignoring --setgroup ceph since I am not root 2023-07-21T22:58:26.647 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[134556]: starting mds.f at 2023-07-21T22:58:27.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:26 smithi151 ceph-mon[95510]: pgmap v1249: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-07-21T22:58:27.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:26 smithi151 ceph-mon[95510]: daemon mds.f restarted 2023-07-21T22:58:27.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:26 smithi151 ceph-mon[95510]: osdmap e157: 12 total, 12 up, 12 in 2023-07-21T22:58:27.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:26 smithi151 ceph-mon[95510]: mds.? [v2:172.21.15.195:6834/4174831647,v1:172.21.15.195:6835/4174831647] up:boot 2023-07-21T22:58:27.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:26 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:58:27.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:26 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:58:27.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:26 smithi187 ceph-mon[96918]: pgmap v1249: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-07-21T22:58:27.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:26 smithi187 ceph-mon[96918]: daemon mds.f restarted 2023-07-21T22:58:27.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:26 smithi187 ceph-mon[96918]: osdmap e157: 12 total, 12 up, 12 in 2023-07-21T22:58:27.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:26 smithi187 ceph-mon[96918]: mds.? [v2:172.21.15.195:6834/4174831647,v1:172.21.15.195:6835/4174831647] up:boot 2023-07-21T22:58:27.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:26 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:58:27.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:26 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:58:27.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-mon[97365]: pgmap v1249: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 11 MiB/s wr, 1.02k op/s 2023-07-21T22:58:27.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-mon[97365]: daemon mds.f restarted 2023-07-21T22:58:27.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-mon[97365]: osdmap e157: 12 total, 12 up, 12 in 2023-07-21T22:58:27.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-mon[97365]: mds.? [v2:172.21.15.195:6834/4174831647,v1:172.21.15.195:6835/4174831647] up:boot 2023-07-21T22:58:27.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:58:27.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:26 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2023-07-21T22:58:29.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:28 smithi151 ceph-mon[95510]: pgmap v1251: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-07-21T22:58:29.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 335.0 s, 362.8 tps, lat 275.462 ms stddev 61.744 2023-07-21T22:58:29.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:28 smithi187 ceph-mon[96918]: pgmap v1251: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-07-21T22:58:29.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:28 smithi195 ceph-mon[97365]: pgmap v1251: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-07-21T22:58:30.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:29 smithi151 ceph-mon[95510]: pgmap v1252: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-07-21T22:58:30.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:29 smithi187 ceph-mon[96918]: pgmap v1252: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-07-21T22:58:30.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:29 smithi195 ceph-mon[97365]: pgmap v1252: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-07-21T22:58:33.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:32 smithi195 ceph-mon[97365]: pgmap v1253: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-07-21T22:58:33.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:32 smithi151 ceph-mon[95510]: pgmap v1253: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-07-21T22:58:33.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:32 smithi187 ceph-mon[96918]: pgmap v1253: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.05k op/s 2023-07-21T22:58:34.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 340.0 s, 353.4 tps, lat 285.487 ms stddev 77.013 2023-07-21T22:58:35.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:34 smithi151 ceph-mon[95510]: pgmap v1254: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-07-21T22:58:35.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:34 smithi187 ceph-mon[96918]: pgmap v1254: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-07-21T22:58:35.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:34 smithi195 ceph-mon[97365]: pgmap v1254: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-07-21T22:58:37.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:36 smithi151 ceph-mon[95510]: pgmap v1255: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-07-21T22:58:37.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:36 smithi187 ceph-mon[96918]: pgmap v1255: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-07-21T22:58:37.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:36 smithi195 ceph-mon[97365]: pgmap v1255: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 12 MiB/s wr, 1.08k op/s 2023-07-21T22:58:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.918+0000 7fdd50dff700 1 -- 172.21.15.151:0/2139718620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd4c067ee0 msgr2=0x7fdd4c068350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.918+0000 7fdd50dff700 1 --2- 172.21.15.151:0/2139718620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd4c067ee0 0x7fdd4c068350 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdd40009990 tx=0x7fdd40009ca0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.918+0000 7fdd50dff700 1 -- 172.21.15.151:0/2139718620 shutdown_connections 2023-07-21T22:58:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.918+0000 7fdd50dff700 1 --2- 172.21.15.151:0/2139718620 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd4c1024f0 0x7fdd4c102940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.918+0000 7fdd50dff700 1 --2- 172.21.15.151:0/2139718620 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c104a60 0x7fdd4c0679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.918+0000 7fdd50dff700 1 --2- 172.21.15.151:0/2139718620 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd4c067ee0 0x7fdd4c068350 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.918+0000 7fdd50dff700 1 -- 172.21.15.151:0/2139718620 >> 172.21.15.151:0/2139718620 conn(0x7fdd4c074760 msgr2=0x7fdd4c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.923+0000 7fdd50dff700 1 -- 172.21.15.151:0/2139718620 shutdown_connections 2023-07-21T22:58:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.924+0000 7fdd50dff700 1 -- 172.21.15.151:0/2139718620 wait complete. 2023-07-21T22:58:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.925+0000 7fdd50dff700 1 Processor -- start 2023-07-21T22:58:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.926+0000 7fdd50dff700 1 -- start start 2023-07-21T22:58:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.926+0000 7fdd50dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd4c067ee0 0x7fdd4c19c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.926+0000 7fdd50dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd4c1024f0 0x7fdd4c19c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.926+0000 7fdd50dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c104a60 0x7fdd4c1a0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.926+0000 7fdd50dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c1a12b0 con 0x7fdd4c1024f0 2023-07-21T22:58:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.927+0000 7fdd50dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c1a1420 con 0x7fdd4c067ee0 2023-07-21T22:58:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.927+0000 7fdd50dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c1a15e0 con 0x7fdd4c104a60 2023-07-21T22:58:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.927+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd4c1024f0 0x7fdd4c19c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.927+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd4c1024f0 0x7fdd4c19c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53250/0 (socket says 172.21.15.151:53250) 2023-07-21T22:58:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.927+0000 7fdd49d9b700 1 -- 172.21.15.151:0/10728617 learned_addr learned my addr 172.21.15.151:0/10728617 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.928+0000 7fdd49d9b700 1 -- 172.21.15.151:0/10728617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c104a60 msgr2=0x7fdd4c1a0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.928+0000 7fdd49d9b700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c104a60 0x7fdd4c1a0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.928+0000 7fdd49d9b700 1 -- 172.21.15.151:0/10728617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd4c067ee0 msgr2=0x7fdd4c19c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.928+0000 7fdd49d9b700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd4c067ee0 0x7fdd4c19c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.928+0000 7fdd49d9b700 1 -- 172.21.15.151:0/10728617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd400095f0 con 0x7fdd4c1024f0 2023-07-21T22:58:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.929+0000 7fdd49d9b700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd4c1024f0 0x7fdd4c19c600 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdd40000c00 tx=0x7fdd40009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.930+0000 7fdd3b7fe700 1 -- 172.21.15.151:0/10728617 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4001d070 con 0x7fdd4c1024f0 2023-07-21T22:58:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.930+0000 7fdd3b7fe700 1 -- 172.21.15.151:0/10728617 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd40022470 con 0x7fdd4c1024f0 2023-07-21T22:58:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.930+0000 7fdd3b7fe700 1 -- 172.21.15.151:0/10728617 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd40017650 con 0x7fdd4c1024f0 2023-07-21T22:58:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.930+0000 7fdd50dff700 1 -- 172.21.15.151:0/10728617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c1a1860 con 0x7fdd4c1024f0 2023-07-21T22:58:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.930+0000 7fdd50dff700 1 -- 172.21.15.151:0/10728617 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c06a110 con 0x7fdd4c1024f0 2023-07-21T22:58:38.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.937+0000 7fdd647a7b80 1 Processor -- start 2023-07-21T22:58:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.940+0000 7fdd647a7b80 1 -- start start 2023-07-21T22:58:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.940+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a60cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.940+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61210 0x561166a5af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.940+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 0x561166a5b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.940+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561166960c50 con 0x561166a61210 2023-07-21T22:58:38.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.940+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611669b39e0 con 0x5611668b76b0 2023-07-21T22:58:38.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.940+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611669ace70 con 0x561166a61660 2023-07-21T22:58:38.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.941+0000 7fdd4ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a60cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.941+0000 7fdd4ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a60cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43264/0 (socket says 172.21.15.151:43264) 2023-07-21T22:58:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.941+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/2413780269 learned_addr learned my addr 172.21.15.151:0/2413780269 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.942+0000 7fdd4a59c700 1 --2- 172.21.15.151:0/2413780269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61210 0x561166a5af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.942+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/2413780269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 msgr2=0x561166a5b4a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:58:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.942+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/2413780269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 0x561166a5b4a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.942+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/2413780269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61210 msgr2=0x561166a5af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.942+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/2413780269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61210 0x561166a5af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.942+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/2413780269 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611667dad80 con 0x5611668b76b0 2023-07-21T22:58:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.942+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/2413780269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a60cd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009cd0 tx=0x7fdd4400e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77888ec2ee88d039 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:38.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.942+0000 7fdd3b7fe700 1 -- 172.21.15.151:0/10728617 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdd4000fb00 con 0x7fdd4c1024f0 2023-07-21T22:58:38.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.943+0000 7fdd38ff9700 1 -- 172.21.15.151:0/2413780269 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44009820 con 0x5611668b76b0 2023-07-21T22:58:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.943+0000 7fdd38ff9700 1 -- 172.21.15.151:0/2413780269 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd44004cc0 con 0x5611668b76b0 2023-07-21T22:58:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.943+0000 7fdd38ff9700 1 -- 172.21.15.151:0/2413780269 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd440056c0 con 0x5611668b76b0 2023-07-21T22:58:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.944+0000 7fdd647a7b80 1 -- 172.21.15.151:0/2413780269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 msgr2=0x561166a60cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.944+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/2413780269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a60cd0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fdd44009cd0 tx=0x7fdd4400e350 comp rx=0 tx=0).stop 2023-07-21T22:58:38.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.945+0000 7fdd3b7fe700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd340a1490 0x7fdd340a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.945+0000 7fdd3b7fe700 1 -- 172.21.15.151:0/10728617 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdd400ce060 con 0x7fdd4c1024f0 2023-07-21T22:58:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.945+0000 7fdd647a7b80 1 -- 172.21.15.151:0/2413780269 shutdown_connections 2023-07-21T22:58:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.945+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/2413780269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a60cd0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.945+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/2413780269 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 0x561166a5b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.945+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/2413780269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61210 0x561166a5af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.945+0000 7fdd647a7b80 1 -- 172.21.15.151:0/2413780269 >> 172.21.15.151:0/2413780269 conn(0x561166a50ae0 msgr2=0x561166a560e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.946+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd340a1490 0x7fdd340a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.946+0000 7fdd647a7b80 1 -- 172.21.15.151:0/2413780269 shutdown_connections 2023-07-21T22:58:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.946+0000 7fdd647a7b80 1 -- 172.21.15.151:0/2413780269 wait complete. 2023-07-21T22:58:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.947+0000 7fdd647a7b80 1 -- start start 2023-07-21T22:58:38.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.948+0000 7fdd647a7b80 1 Processor -- start 2023-07-21T22:58:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 0x561166a67620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 0x561166a64830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61660 0x561166a64f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56116694ca60 con 0x5611668b76b0 2023-07-21T22:58:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56116694c760 con 0x561166a61660 2023-07-21T22:58:38.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5611668308c0 con 0x561166a61210 2023-07-21T22:58:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd647a7b80 10 client.0 _ll_register_callbacks cb 0x56116694a700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:58:38.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd340a1490 0x7fdd340a3940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdd440052d0 tx=0x7fdd44000bc0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd4ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61660 0x561166a64f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd4ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61660 0x561166a64f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43270/0 (socket says 172.21.15.151:43270) 2023-07-21T22:58:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/665088051 learned_addr learned my addr 172.21.15.151:0/665088051 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd4a59c700 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 0x561166a67620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.949+0000 7fdd49d9b700 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 0x561166a64830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:38.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.950+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/665088051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 msgr2=0x561166a64830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.950+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 0x561166a64830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.950+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/665088051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 msgr2=0x561166a67620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.950+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 0x561166a67620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.950+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/665088051 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd44009980 con 0x561166a61660 2023-07-21T22:58:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.951+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61660 0x561166a64f20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005610 tx=0x7fdd44004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=753bd05f7eefee7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.951+0000 7fdd31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:58:38.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.951+0000 7fdd31ffb700 1 -- 172.21.15.151:0/665088051 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44004460 con 0x561166a61660 2023-07-21T22:58:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.951+0000 7fdd647a7b80 1 -- 172.21.15.151:0/665088051 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561166906490 con 0x561166a61660 2023-07-21T22:58:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.951+0000 7fdd31ffb700 1 -- 172.21.15.151:0/665088051 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdd44014070 con 0x561166a61660 2023-07-21T22:58:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.951+0000 7fdd31ffb700 1 -- 172.21.15.151:0/665088051 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd44003680 con 0x561166a61660 2023-07-21T22:58:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.951+0000 7fdd647a7b80 10 client.29063 fetch_fsmap learned FSMap version 110 2023-07-21T22:58:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.952+0000 7fdd647a7b80 1 -- 172.21.15.151:0/665088051 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5611667c3c00 con 0x561166a61660 2023-07-21T22:58:38.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.953+0000 7fdd31ffb700 1 -- 172.21.15.151:0/665088051 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x561166906490 con 0x561166a61660 2023-07-21T22:58:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.953+0000 7fdd31ffb700 1 -- 172.21.15.151:0/665088051 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 110) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdd44022770 con 0x561166a61660 2023-07-21T22:58:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.954+0000 7fdd647a7b80 10 client.29063 fetch_fsmap finished waiting for FSMap version 110 2023-07-21T22:58:38.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.954+0000 7fdd647a7b80 10 client.29063 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:58:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.954+0000 7fdd647a7b80 20 client.29063 populate_metadata read hostname 'smithi151' 2023-07-21T22:58:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.954+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561166a74ab0 0x561166a76ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.954+0000 7fdd647a7b80 4 client.29063 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:58:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.954+0000 7fdd647a7b80 1 -- 172.21.15.151:0/665088051 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5611669a5e50 con 0x561166a74ab0 2023-07-21T22:58:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.955+0000 7fdd4a59c700 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561166a74ab0 0x561166a76ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:38.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.956+0000 7fdd4a59c700 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561166a74ab0 0x561166a76ec0 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=910452c3219c15a9 server_cookie=905e0946d9f06327 in_seq=0 out_seq=0 2023-07-21T22:58:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.956+0000 7fdd31ffb700 10 client.29063 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:38.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.957+0000 7fdd31ffb700 1 -- 172.21.15.151:0/665088051 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5611669a5e50 con 0x561166a74ab0 2023-07-21T22:58:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.957+0000 7fdd31ffb700 10 client.29063 handle_command_reply: tid=0 2023-07-21T22:58:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.957+0000 7fdd647a7b80 1 client.29063 shutdown 2023-07-21T22:58:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.958+0000 7fdd647a7b80 1 -- 172.21.15.151:0/665088051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61660 msgr2=0x561166a64f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.958+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61660 0x561166a64f20 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fdd44005610 tx=0x7fdd44004750 comp rx=0 tx=0).stop 2023-07-21T22:58:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.958+0000 7fdd647a7b80 1 -- 172.21.15.151:0/665088051 shutdown_connections 2023-07-21T22:58:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.958+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561166a74ab0 0x561166a76ec0 crc :-1 s=READY pgs=451 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.958+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61660 0x561166a64f20 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.958+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 0x561166a67620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.959+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/665088051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 0x561166a64830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.959+0000 7fdd647a7b80 1 -- 172.21.15.151:0/665088051 >> 172.21.15.151:0/665088051 conn(0x561166a50ae0 msgr2=0x561166a553e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:38.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.959+0000 7fdd31ffb700 0 client.29063 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.963+0000 7fdd647a7b80 1 -- 172.21.15.151:0/665088051 shutdown_connections 2023-07-21T22:58:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.966+0000 7fdd647a7b80 1 -- 172.21.15.151:0/665088051 wait complete. 2023-07-21T22:58:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.968+0000 7fdd647a7b80 20 client.29063 trim_cache size 0 max 16384 2023-07-21T22:58:39.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.997+0000 7fdd647a7b80 1 Processor -- start 2023-07-21T22:58:39.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.997+0000 7fdd647a7b80 1 -- start start 2023-07-21T22:58:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.998+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a5af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.998+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 0x561166a6bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:39.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.998+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61660 0x561166a67150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.998+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561166a5bf20 con 0x561166a61660 2023-07-21T22:58:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.998+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561166a65cc0 con 0x5611668b76b0 2023-07-21T22:58:39.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.998+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561166a608c0 con 0x561166a61210 2023-07-21T22:58:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a5af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd4ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61660 0x561166a67150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd4a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a5af40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43284/0 (socket says 172.21.15.151:43284) 2023-07-21T22:58:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd4a59c700 1 -- 172.21.15.151:0/1042489883 learned_addr learned my addr 172.21.15.151:0/1042489883 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd49d9b700 1 --2- 172.21.15.151:0/1042489883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 0x561166a6bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:39.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/1042489883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 msgr2=0x561166a6bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/1042489883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 0x561166a6bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/1042489883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 msgr2=0x561166a5af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/1042489883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a5af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:38.999+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/1042489883 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5611668011f0 con 0x561166a61660 2023-07-21T22:58:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.000+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/1042489883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61660 0x561166a67150 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fdd44022b80 tx=0x7fdd440056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e24ebdf3b5ffe17 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:39.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.000+0000 7fdd397fa700 1 -- 172.21.15.151:0/1042489883 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44004460 con 0x561166a61660 2023-07-21T22:58:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.000+0000 7fdd397fa700 1 -- 172.21.15.151:0/1042489883 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd44026070 con 0x561166a61660 2023-07-21T22:58:39.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.000+0000 7fdd397fa700 1 -- 172.21.15.151:0/1042489883 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44003900 con 0x561166a61660 2023-07-21T22:58:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.001+0000 7fdd647a7b80 1 -- 172.21.15.151:0/1042489883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61660 msgr2=0x561166a67150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.001+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/1042489883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61660 0x561166a67150 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fdd44022b80 tx=0x7fdd440056c0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.002+0000 7fdd647a7b80 1 -- 172.21.15.151:0/1042489883 shutdown_connections 2023-07-21T22:58:39.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.002+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/1042489883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5611668b76b0 0x561166a5af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.002+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/1042489883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561166a61660 0x561166a67150 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.002+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/1042489883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61210 0x561166a6bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.002+0000 7fdd647a7b80 1 -- 172.21.15.151:0/1042489883 >> 172.21.15.151:0/1042489883 conn(0x561166a50ae0 msgr2=0x561166a5e970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.002+0000 7fdd647a7b80 1 -- 172.21.15.151:0/1042489883 shutdown_connections 2023-07-21T22:58:39.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.002+0000 7fdd647a7b80 1 -- 172.21.15.151:0/1042489883 wait complete. 2023-07-21T22:58:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.003+0000 7fdd647a7b80 1 -- start start 2023-07-21T22:58:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.003+0000 7fdd647a7b80 1 Processor -- start 2023-07-21T22:58:39.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.004+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 0x561166a5c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.004+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61210 0x561166a5cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.004+0000 7fdd647a7b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 0x561166a5d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.004+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561166a5d6f0 con 0x5611668b76b0 2023-07-21T22:58:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.004+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561166a5d860 con 0x561166a61210 2023-07-21T22:58:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.004+0000 7fdd647a7b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561166a5d9d0 con 0x561166a61660 2023-07-21T22:58:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.004+0000 7fdd647a7b80 10 client.0 _ll_register_callbacks cb 0x7fdd44004f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:58:39.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.005+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61210 0x561166a5cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.005+0000 7fdd49d9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61210 0x561166a5cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:43292/0 (socket says 172.21.15.151:43292) 2023-07-21T22:58:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.005+0000 7fdd49d9b700 1 -- 172.21.15.151:0/897791725 learned_addr learned my addr 172.21.15.151:0/897791725 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:39.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.005+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 0x561166a5d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.006+0000 7fdd4a59c700 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 0x561166a5c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.006+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/897791725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61210 msgr2=0x561166a5cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.006+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61210 0x561166a5cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.006+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/897791725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 msgr2=0x561166a5c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:39.043 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.006+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 0x561166a5c730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.006+0000 7fdd4ad9d700 1 -- 172.21.15.151:0/897791725 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5611667c3c00 con 0x561166a61660 2023-07-21T22:58:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.007+0000 7fdd4ad9d700 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 0x561166a5d1b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdd44025040 tx=0x7fdd4400ef50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f0f933052d3b537 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.007+0000 7fdd31ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:58:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.007+0000 7fdd31ffb700 1 -- 172.21.15.151:0/897791725 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44022870 con 0x561166a61660 2023-07-21T22:58:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.007+0000 7fdd31ffb700 1 -- 172.21.15.151:0/897791725 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8448+0+0 (secure 0 0 0) 0x7fdd44014070 con 0x561166a61660 2023-07-21T22:58:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.007+0000 7fdd647a7b80 1 -- 172.21.15.151:0/897791725 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd44004cc0 con 0x561166a61660 2023-07-21T22:58:39.044 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.008+0000 7fdd31ffb700 1 -- 172.21.15.151:0/897791725 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd44022df0 con 0x561166a61660 2023-07-21T22:58:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.008+0000 7fdd647a7b80 10 client.29083 fetch_fsmap learned FSMap version 110 2023-07-21T22:58:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.008+0000 7fdd647a7b80 1 -- 172.21.15.151:0/897791725 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x5611667d9250 con 0x561166a61660 2023-07-21T22:58:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.008+0000 7fdd31ffb700 1 -- 172.21.15.151:0/897791725 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd44004cc0 con 0x561166a61660 2023-07-21T22:58:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.009+0000 7fdd31ffb700 1 -- 172.21.15.151:0/897791725 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 110) v1 ==== 7486+0+0 (secure 0 0 0) 0x7fdd44037460 con 0x561166a61660 2023-07-21T22:58:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.009+0000 7fdd647a7b80 10 client.29083 fetch_fsmap finished waiting for FSMap version 110 2023-07-21T22:58:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.009+0000 7fdd647a7b80 10 client.29083 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:58:39.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.009+0000 7fdd647a7b80 20 client.29083 populate_metadata read hostname 'smithi151' 2023-07-21T22:58:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.009+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561166ac8e50 0x561166acb260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.009+0000 7fdd647a7b80 4 client.29083 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:58:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.009+0000 7fdd647a7b80 1 -- 172.21.15.151:0/897791725 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561166967ff0 con 0x561166ac8e50 2023-07-21T22:58:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.010+0000 7fdd4a59c700 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561166ac8e50 0x561166acb260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.010+0000 7fdd4a59c700 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561166ac8e50 0x561166acb260 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80456a3d19703bc0 server_cookie=2691813c9b31fbd9 in_seq=0 out_seq=0 2023-07-21T22:58:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.010+0000 7fdd31ffb700 10 client.29083 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:39.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd31ffb700 1 -- 172.21.15.151:0/897791725 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561166967ff0 con 0x561166ac8e50 2023-07-21T22:58:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd31ffb700 10 client.29083 handle_command_reply: tid=0 2023-07-21T22:58:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd647a7b80 1 client.29083 shutdown 2023-07-21T22:58:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd647a7b80 1 -- 172.21.15.151:0/897791725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 msgr2=0x561166a5d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 0x561166a5d1b0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fdd44025040 tx=0x7fdd4400ef50 comp rx=0 tx=0).stop 2023-07-21T22:58:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd647a7b80 1 -- 172.21.15.151:0/897791725 shutdown_connections 2023-07-21T22:58:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561166ac8e50 0x561166acb260 crc :-1 s=READY pgs=452 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.074 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561166a61660 0x561166a5d1b0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd31ffb700 0 client.29083 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5611668b76b0 0x561166a5c730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd647a7b80 1 --2- 172.21.15.151:0/897791725 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561166a61210 0x561166a5cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.039+0000 7fdd647a7b80 1 -- 172.21.15.151:0/897791725 >> 172.21.15.151:0/897791725 conn(0x561166a50ae0 msgr2=0x561166a5f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.040+0000 7fdd647a7b80 1 -- 172.21.15.151:0/897791725 shutdown_connections 2023-07-21T22:58:39.075 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.040+0000 7fdd647a7b80 1 -- 172.21.15.151:0/897791725 wait complete. 2023-07-21T22:58:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.040+0000 7fdd647a7b80 20 client.29083 trim_cache size 0 max 16384 2023-07-21T22:58:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:58:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:58:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:58:39.076 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:58:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 -- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd340a1490 msgr2=0x7fdd340a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd340a1490 0x7fdd340a3940 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fdd440052d0 tx=0x7fdd44000bc0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 -- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd4c1024f0 msgr2=0x7fdd4c19c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:39.077 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd4c1024f0 0x7fdd4c19c600 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fdd40000c00 tx=0x7fdd40009570 comp rx=0 tx=0).stop 2023-07-21T22:58:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 -- 172.21.15.151:0/10728617 shutdown_connections 2023-07-21T22:58:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd340a1490 0x7fdd340a3940 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd4c067ee0 0x7fdd4c19c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd4c104a60 0x7fdd4c1a0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 --2- 172.21.15.151:0/10728617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd4c1024f0 0x7fdd4c19c600 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 -- 172.21.15.151:0/10728617 >> 172.21.15.151:0/10728617 conn(0x7fdd4c074760 msgr2=0x7fdd4c1014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:39.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 -- 172.21.15.151:0/10728617 shutdown_connections 2023-07-21T22:58:39.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:39.041+0000 7fdd50dff700 1 -- 172.21.15.151:0/10728617 wait complete. 2023-07-21T22:58:39.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:38 smithi151 ceph-mon[95510]: pgmap v1256: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 1.50k op/s 2023-07-21T22:58:39.291 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 345.0 s, 358.0 tps, lat 277.213 ms stddev 61.198 2023-07-21T22:58:39.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:38 smithi187 ceph-mon[96918]: pgmap v1256: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 1.50k op/s 2023-07-21T22:58:39.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:38 smithi195 ceph-mon[97365]: pgmap v1256: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 16 MiB/s wr, 1.50k op/s 2023-07-21T22:58:40.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:39 smithi151 ceph-mon[95510]: pgmap v1257: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.9 MiB/s wr, 915 op/s 2023-07-21T22:58:40.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:39 smithi187 ceph-mon[96918]: pgmap v1257: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.9 MiB/s wr, 915 op/s 2023-07-21T22:58:40.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:39 smithi195 ceph-mon[97365]: pgmap v1257: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.9 MiB/s wr, 915 op/s 2023-07-21T22:58:43.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:42 smithi195 ceph-mon[97365]: pgmap v1258: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.9 MiB/s wr, 915 op/s 2023-07-21T22:58:43.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:42 smithi151 ceph-mon[95510]: pgmap v1258: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.9 MiB/s wr, 915 op/s 2023-07-21T22:58:43.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:42 smithi187 ceph-mon[96918]: pgmap v1258: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 9.9 MiB/s wr, 915 op/s 2023-07-21T22:58:44.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 350.0 s, 374.8 tps, lat 265.978 ms stddev 71.209 2023-07-21T22:58:45.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:44 smithi151 ceph-mon[95510]: pgmap v1259: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-21T22:58:45.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:44 smithi187 ceph-mon[96918]: pgmap v1259: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-21T22:58:45.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:44 smithi195 ceph-mon[97365]: pgmap v1259: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-21T22:58:47.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:46 smithi151 ceph-mon[95510]: pgmap v1260: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 930 op/s 2023-07-21T22:58:47.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:46 smithi187 ceph-mon[96918]: pgmap v1260: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 930 op/s 2023-07-21T22:58:47.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:46 smithi195 ceph-mon[97365]: pgmap v1260: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 930 op/s 2023-07-21T22:58:48.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:47 smithi187 ceph-mon[96918]: pgmap v1261: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-21T22:58:48.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:47 smithi195 ceph-mon[97365]: pgmap v1261: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-21T22:58:48.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:47 smithi151 ceph-mon[95510]: pgmap v1261: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-21T22:58:49.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 355.0 s, 366.4 tps, lat 269.870 ms stddev 80.081 2023-07-21T22:58:49.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:58:49.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:58:49.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:58:50.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:49 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:58:50.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:49 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:58:50.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:49 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:58:50.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:49 smithi187 ceph-mon[96918]: pgmap v1262: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 924 op/s 2023-07-21T22:58:50.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:49 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:58:50.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:49 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:58:50.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:49 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:58:50.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:49 smithi195 ceph-mon[97365]: pgmap v1262: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 924 op/s 2023-07-21T22:58:50.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:49 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:58:50.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:49 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:58:50.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:49 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:58:50.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:49 smithi151 ceph-mon[95510]: pgmap v1262: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 924 op/s 2023-07-21T22:58:52.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.285+0000 7f44fc3ff700 1 -- 172.21.15.151:0/3150782925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4102970 msgr2=0x7f44f4106930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.285+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/3150782925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4102970 0x7f44f4106930 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009f90 tx=0x7f44f000b330 comp rx=0 tx=0).stop 2023-07-21T22:58:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.285+0000 7f44fc3ff700 1 -- 172.21.15.151:0/3150782925 shutdown_connections 2023-07-21T22:58:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.285+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/3150782925 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44f4107010 0x7f44f410ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.285+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/3150782925 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4101fd0 0x7f44f41023a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.285+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/3150782925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4102970 0x7f44f4106930 secure :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f44f0009f90 tx=0x7f44f000b330 comp rx=0 tx=0).stop 2023-07-21T22:58:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.286+0000 7f44fc3ff700 1 -- 172.21.15.151:0/3150782925 >> 172.21.15.151:0/3150782925 conn(0x7f44f40fd840 msgr2=0x7f44f40ffc50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.286+0000 7f44fc3ff700 1 -- 172.21.15.151:0/3150782925 shutdown_connections 2023-07-21T22:58:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.286+0000 7f44fc3ff700 1 -- 172.21.15.151:0/3150782925 wait complete. 2023-07-21T22:58:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.288+0000 7f44fc3ff700 1 Processor -- start 2023-07-21T22:58:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.288+0000 7f44fc3ff700 1 -- start start 2023-07-21T22:58:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.289+0000 7f44fc3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4101fd0 0x7f44f4071ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.289+0000 7f44fc3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4107010 0x7f44f406aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.289+0000 7f44fc3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44f406b1e0 0x7f44f406b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.289+0000 7f44fc3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f406fa30 con 0x7f44f4101fd0 2023-07-21T22:58:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.289+0000 7f44fc3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f406fba0 con 0x7f44f4107010 2023-07-21T22:58:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.289+0000 7f44fc3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f406fd60 con 0x7f44f406b1e0 2023-07-21T22:58:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.289+0000 7f44f999a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4107010 0x7f44f406aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.289+0000 7f44f999a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4107010 0x7f44f406aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40842/0 (socket says 172.21.15.151:40842) 2023-07-21T22:58:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.289+0000 7f44f999a700 1 -- 172.21.15.151:0/4175606392 learned_addr learned my addr 172.21.15.151:0/4175606392 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.290+0000 7f44fa99c700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44f406b1e0 0x7f44f406b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.290+0000 7f44fa19b700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4101fd0 0x7f44f4071ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.290+0000 7f44f999a700 1 -- 172.21.15.151:0/4175606392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44f406b1e0 msgr2=0x7f44f406b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.290+0000 7f44f999a700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44f406b1e0 0x7f44f406b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.290+0000 7f44f999a700 1 -- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4101fd0 msgr2=0x7f44f4071ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.290+0000 7f44f999a700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4101fd0 0x7f44f4071ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.290+0000 7f44f999a700 1 -- 172.21.15.151:0/4175606392 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f0009c40 con 0x7f44f4107010 2023-07-21T22:58:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.290+0000 7f44f999a700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4107010 0x7f44f406aca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f44f000d010 tx=0x7f44f0007860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.291+0000 7f44eb7fe700 1 -- 172.21.15.151:0/4175606392 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f000e040 con 0x7f44f4107010 2023-07-21T22:58:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.291+0000 7f44eb7fe700 1 -- 172.21.15.151:0/4175606392 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44f0004c60 con 0x7f44f4107010 2023-07-21T22:58:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.291+0000 7f44eb7fe700 1 -- 172.21.15.151:0/4175606392 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00052a0 con 0x7f44f4107010 2023-07-21T22:58:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.291+0000 7f44fc3ff700 1 -- 172.21.15.151:0/4175606392 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f406ffe0 con 0x7f44f4107010 2023-07-21T22:58:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.291+0000 7f44fc3ff700 1 -- 172.21.15.151:0/4175606392 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f40704a0 con 0x7f44f4107010 2023-07-21T22:58:52.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.297+0000 7f44eb7fe700 1 -- 172.21.15.151:0/4175606392 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f44f001d970 con 0x7f44f4107010 2023-07-21T22:58:52.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.300+0000 7f44eb7fe700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f44dc0a1490 0x7f44dc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.301+0000 7f450fcb3b80 1 Processor -- start 2023-07-21T22:58:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.301+0000 7f44eb7fe700 1 -- 172.21.15.151:0/4175606392 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f44f00ce190 con 0x7f44f4107010 2023-07-21T22:58:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.301+0000 7f44fa19b700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f44dc0a1490 0x7f44dc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.302+0000 7f450fcb3b80 1 -- start start 2023-07-21T22:58:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.302+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.302+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ac750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.302+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2e70 0x55d9185accb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.302+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9184a9c50 con 0x55d9185b2e70 2023-07-21T22:58:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.302+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9184fc9e0 con 0x55d9184006b0 2023-07-21T22:58:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.302+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9184f5e70 con 0x55d9185b2a20 2023-07-21T22:58:52.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.302+0000 7f44fa19b700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f44dc0a1490 0x7f44dc0a3940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f44e4005fd0 tx=0x7f44e4009310 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.303+0000 7f44f999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.303+0000 7f44f999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ac750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:44030/0 (socket says 172.21.15.151:44030) 2023-07-21T22:58:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.303+0000 7f44f999a700 1 -- 172.21.15.151:0/1711555165 learned_addr learned my addr 172.21.15.151:0/1711555165 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.303+0000 7f44fa19b700 1 --2- 172.21.15.151:0/1711555165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.303+0000 7f44fa99c700 1 --2- 172.21.15.151:0/1711555165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2e70 0x55d9185accb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.304+0000 7f44fa99c700 1 -- 172.21.15.151:0/1711555165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 msgr2=0x55d9185ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.304+0000 7f44fa99c700 1 --2- 172.21.15.151:0/1711555165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ac750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.304+0000 7f44fa99c700 1 -- 172.21.15.151:0/1711555165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 msgr2=0x55d9185b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.304+0000 7f44fa99c700 1 --2- 172.21.15.151:0/1711555165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.304+0000 7f44fa99c700 1 -- 172.21.15.151:0/1711555165 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d918323d80 con 0x55d9185b2e70 2023-07-21T22:58:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.305+0000 7f44fa99c700 1 --2- 172.21.15.151:0/1711555165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2e70 0x55d9185accb0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009b80 tx=0x7f44ec009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=964f812a221639dd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:52.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.305+0000 7f44e8bfe700 1 -- 172.21.15.151:0/1711555165 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec004220 con 0x55d9185b2e70 2023-07-21T22:58:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.305+0000 7f44e8bfe700 1 -- 172.21.15.151:0/1711555165 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44ec00fda0 con 0x55d9185b2e70 2023-07-21T22:58:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.305+0000 7f44e8bfe700 1 -- 172.21.15.151:0/1711555165 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44ec003d40 con 0x55d9185b2e70 2023-07-21T22:58:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.306+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1711555165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2e70 msgr2=0x55d9185accb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.306+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/1711555165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2e70 0x55d9185accb0 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f44ec009b80 tx=0x7f44ec009e90 comp rx=0 tx=0).stop 2023-07-21T22:58:52.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.307+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1711555165 shutdown_connections 2023-07-21T22:58:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.307+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/1711555165 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.307+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/1711555165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2e70 0x55d9185accb0 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.307+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/1711555165 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.307+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1711555165 >> 172.21.15.151:0/1711555165 conn(0x55d918599ae0 msgr2=0x55d91859f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:52.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.307+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1711555165 shutdown_connections 2023-07-21T22:58:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.307+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1711555165 wait complete. 2023-07-21T22:58:52.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.308+0000 7f450fcb3b80 1 -- start start 2023-07-21T22:58:52.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.309+0000 7f450fcb3b80 1 Processor -- start 2023-07-21T22:58:52.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185bbe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 0x55d9185bc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2e70 0x55d9185b60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d918495a60 con 0x55d9185b2a20 2023-07-21T22:58:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d918495760 con 0x55d9184006b0 2023-07-21T22:58:52.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9183798c0 con 0x55d9185b2e70 2023-07-21T22:58:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f450fcb3b80 10 client.0 _ll_register_callbacks cb 0x55d918493700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:58:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f44f999a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 0x55d9185bc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f44fa19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185bbe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f44f999a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 0x55d9185bc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52016/0 (socket says 172.21.15.151:52016) 2023-07-21T22:58:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f44fa19b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185bbe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40872/0 (socket says 172.21.15.151:40872) 2023-07-21T22:58:52.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.311+0000 7f44f999a700 1 -- 172.21.15.151:0/3516681198 learned_addr learned my addr 172.21.15.151:0/3516681198 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.312+0000 7f44fa19b700 1 -- 172.21.15.151:0/3516681198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2e70 msgr2=0x55d9185b60f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:58:52.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.312+0000 7f44fa19b700 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2e70 0x55d9185b60f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.312+0000 7f44fa19b700 1 -- 172.21.15.151:0/3516681198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 msgr2=0x55d9185bc3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.312+0000 7f44fa19b700 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 0x55d9185bc3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.312+0000 7f44fa19b700 1 -- 172.21.15.151:0/3516681198 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44ec009830 con 0x55d9184006b0 2023-07-21T22:58:52.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.312+0000 7f44fa19b700 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185bbe60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f44e4010ef0 tx=0x7f44e4004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e09c1a74ceb6371 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.313+0000 7f44d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:58:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.313+0000 7f44d9ffb700 1 -- 172.21.15.151:0/3516681198 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4029670 con 0x55d9184006b0 2023-07-21T22:58:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.314+0000 7f44d9ffb700 1 -- 172.21.15.151:0/3516681198 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f44e4020430 con 0x55d9184006b0 2023-07-21T22:58:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.314+0000 7f450fcb3b80 1 -- 172.21.15.151:0/3516681198 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d91844f490 con 0x55d9184006b0 2023-07-21T22:58:52.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.314+0000 7f44d9ffb700 1 -- 172.21.15.151:0/3516681198 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44e4012e80 con 0x55d9184006b0 2023-07-21T22:58:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.314+0000 7f450fcb3b80 10 client.29081 fetch_fsmap learned FSMap version 110 2023-07-21T22:58:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.314+0000 7f450fcb3b80 1 -- 172.21.15.151:0/3516681198 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55d91830cc00 con 0x55d9184006b0 2023-07-21T22:58:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.315+0000 7f44d9ffb700 1 -- 172.21.15.151:0/3516681198 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d91844f490 con 0x55d9184006b0 2023-07-21T22:58:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.315+0000 7f44d9ffb700 1 -- 172.21.15.151:0/3516681198 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 110) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f44e4020950 con 0x55d9184006b0 2023-07-21T22:58:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.315+0000 7f450fcb3b80 10 client.29081 fetch_fsmap finished waiting for FSMap version 110 2023-07-21T22:58:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.315+0000 7f450fcb3b80 10 client.29081 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:58:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.315+0000 7f450fcb3b80 20 client.29081 populate_metadata read hostname 'smithi151' 2023-07-21T22:58:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.315+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d9185c63e0 0x55d9185c87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.316+0000 7f450fcb3b80 4 client.29081 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:58:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.316+0000 7f450fcb3b80 1 -- 172.21.15.151:0/3516681198 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d9184eee50 con 0x55d9185c63e0 2023-07-21T22:58:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.316+0000 7f44f999a700 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d9185c63e0 0x55d9185c87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.317+0000 7f44f999a700 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d9185c63e0 0x55d9185c87f0 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf512e46f8291aab server_cookie=c446d824fd18c384 in_seq=0 out_seq=0 2023-07-21T22:58:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.317+0000 7f44d9ffb700 10 client.29081 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.318+0000 7f44d9ffb700 1 -- 172.21.15.151:0/3516681198 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d9184eee50 con 0x55d9185c63e0 2023-07-21T22:58:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.318+0000 7f44d9ffb700 10 client.29081 handle_command_reply: tid=0 2023-07-21T22:58:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.318+0000 7f450fcb3b80 1 client.29081 shutdown 2023-07-21T22:58:52.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 -- 172.21.15.151:0/3516681198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 msgr2=0x55d9185bbe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185bbe60 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f44e4010ef0 tx=0x7f44e4004750 comp rx=0 tx=0).stop 2023-07-21T22:58:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 -- 172.21.15.151:0/3516681198 shutdown_connections 2023-07-21T22:58:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d9185c63e0 0x55d9185c87f0 crc :-1 s=READY pgs=453 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9184006b0 0x55d9185bbe60 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2e70 0x55d9185b60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/3516681198 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 0x55d9185bc3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 -- 172.21.15.151:0/3516681198 >> 172.21.15.151:0/3516681198 conn(0x55d918599ae0 msgr2=0x55d91859e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f44d9ffb700 0 client.29081 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 -- 172.21.15.151:0/3516681198 shutdown_connections 2023-07-21T22:58:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.319+0000 7f450fcb3b80 1 -- 172.21.15.151:0/3516681198 wait complete. 2023-07-21T22:58:52.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.320+0000 7f450fcb3b80 20 client.29081 trim_cache size 0 max 16384 2023-07-21T22:58:52.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.346+0000 7f450fcb3b80 1 Processor -- start 2023-07-21T22:58:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.347+0000 7f450fcb3b80 1 -- start start 2023-07-21T22:58:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.347+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9184006b0 0x55d9185b18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.347+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 0x55d9185ac750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.347+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 0x55d91859eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.347+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d91859bc00 con 0x55d9185b2a20 2023-07-21T22:58:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.347+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9185b7100 con 0x55d9185b2e70 2023-07-21T22:58:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.347+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9185ad730 con 0x55d9184006b0 2023-07-21T22:58:52.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.347+0000 7f44fa19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9184006b0 0x55d9185b18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.348+0000 7f44fa19b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9184006b0 0x55d9185b18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:44036/0 (socket says 172.21.15.151:44036) 2023-07-21T22:58:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.348+0000 7f44fa19b700 1 -- 172.21.15.151:0/1346822003 learned_addr learned my addr 172.21.15.151:0/1346822003 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.348+0000 7f44f999a700 1 --2- 172.21.15.151:0/1346822003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 0x55d9185ac750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.348+0000 7f44fa99c700 1 --2- 172.21.15.151:0/1346822003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 0x55d91859eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.348+0000 7f44fa19b700 1 -- 172.21.15.151:0/1346822003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 msgr2=0x55d91859eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.348+0000 7f44fa19b700 1 --2- 172.21.15.151:0/1346822003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 0x55d91859eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.348+0000 7f44fa19b700 1 -- 172.21.15.151:0/1346822003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 msgr2=0x55d9185ac750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.348+0000 7f44fa19b700 1 --2- 172.21.15.151:0/1346822003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 0x55d9185ac750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.348+0000 7f44fa19b700 1 -- 172.21.15.151:0/1346822003 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d91834a1f0 con 0x55d9184006b0 2023-07-21T22:58:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.349+0000 7f44fa19b700 1 --2- 172.21.15.151:0/1346822003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9184006b0 0x55d9185b18f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44e4020ce0 tx=0x7f44e4012bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e6ff1c0f5140270 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.349+0000 7f44e93ff700 1 -- 172.21.15.151:0/1346822003 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4004a30 con 0x55d9184006b0 2023-07-21T22:58:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.349+0000 7f44e93ff700 1 -- 172.21.15.151:0/1346822003 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f44e4012e80 con 0x55d9184006b0 2023-07-21T22:58:52.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.349+0000 7f44e93ff700 1 -- 172.21.15.151:0/1346822003 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e4004e80 con 0x55d9184006b0 2023-07-21T22:58:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.350+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1346822003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9184006b0 msgr2=0x55d9185b18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.350+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/1346822003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9184006b0 0x55d9185b18f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f44e4020ce0 tx=0x7f44e4012bf0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.350+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1346822003 shutdown_connections 2023-07-21T22:58:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.350+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/1346822003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 0x55d91859eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.350+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/1346822003 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9184006b0 0x55d9185b18f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.350+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/1346822003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9185b2a20 0x55d9185ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.350+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1346822003 >> 172.21.15.151:0/1346822003 conn(0x55d918599ae0 msgr2=0x55d9185b11e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.350+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1346822003 shutdown_connections 2023-07-21T22:58:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.350+0000 7f450fcb3b80 1 -- 172.21.15.151:0/1346822003 wait complete. 2023-07-21T22:58:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.351+0000 7f450fcb3b80 1 -- start start 2023-07-21T22:58:52.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.351+0000 7f450fcb3b80 1 Processor -- start 2023-07-21T22:58:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9184006b0 0x55d9185ba240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ba780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f450fcb3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 0x55d918613270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d9186137f0 con 0x55d9184006b0 2023-07-21T22:58:52.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d918613960 con 0x55d9185b2e70 2023-07-21T22:58:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f450fcb3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d918613b20 con 0x55d9185b2a20 2023-07-21T22:58:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f450fcb3b80 10 client.0 _ll_register_callbacks cb 0x7f44e4010ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:58:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f44fa19b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9184006b0 0x55d9185ba240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f44f999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ba780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f44f999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ba780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:44038/0 (socket says 172.21.15.151:44038) 2023-07-21T22:58:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f44f999a700 1 -- 172.21.15.151:0/4161180141 learned_addr learned my addr 172.21.15.151:0/4161180141 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:58:52.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.352+0000 7f44fa99c700 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 0x55d918613270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.353+0000 7f44f999a700 1 -- 172.21.15.151:0/4161180141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 msgr2=0x55d918613270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.353+0000 7f44f999a700 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 0x55d918613270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.353+0000 7f44f999a700 1 -- 172.21.15.151:0/4161180141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9184006b0 msgr2=0x55d9185ba240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:58:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.353+0000 7f44f999a700 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9184006b0 0x55d9185ba240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.353+0000 7f44f999a700 1 -- 172.21.15.151:0/4161180141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d91830cc00 con 0x55d9185b2a20 2023-07-21T22:58:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.353+0000 7f44d9ffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:58:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.353+0000 7f44f999a700 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ba780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f44f0097d70 tx=0x7f44f0009920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30b77da8fa58831f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:58:52.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.354+0000 7f44d9ffb700 1 -- 172.21.15.151:0/4161180141 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f00a36c0 con 0x55d9185b2a20 2023-07-21T22:58:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.354+0000 7f44d9ffb700 1 -- 172.21.15.151:0/4161180141 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f44f00a10b0 con 0x55d9185b2a20 2023-07-21T22:58:52.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.354+0000 7f450fcb3b80 1 -- 172.21.15.151:0/4161180141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d9184b0ff0 con 0x55d9185b2a20 2023-07-21T22:58:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.356+0000 7f44d9ffb700 1 -- 172.21.15.151:0/4161180141 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=110) v2 ==== 24+0+0 (secure 0 0 0) 0x7f44f0097a10 con 0x55d9185b2a20 2023-07-21T22:58:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.356+0000 7f450fcb3b80 10 client.29095 fetch_fsmap learned FSMap version 110 2023-07-21T22:58:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.356+0000 7f450fcb3b80 1 -- 172.21.15.151:0/4161180141 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=110,monmap=4+}) v3 -- 0x55d918322250 con 0x55d9185b2a20 2023-07-21T22:58:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.356+0000 7f44d9ffb700 1 -- 172.21.15.151:0/4161180141 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d9184b0ff0 con 0x55d9185b2a20 2023-07-21T22:58:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.356+0000 7f44d9ffb700 1 -- 172.21.15.151:0/4161180141 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 110) v1 ==== 7486+0+0 (secure 0 0 0) 0x7f44f001d570 con 0x55d9185b2a20 2023-07-21T22:58:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.356+0000 7f450fcb3b80 10 client.29095 fetch_fsmap finished waiting for FSMap version 110 2023-07-21T22:58:52.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.357+0000 7f450fcb3b80 10 client.29095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:58:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.357+0000 7f450fcb3b80 20 client.29095 populate_metadata read hostname 'smithi151' 2023-07-21T22:58:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.357+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d91861b050 0x55d91861d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:58:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.357+0000 7f450fcb3b80 4 client.29095 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:58:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.357+0000 7f450fcb3b80 1 -- 172.21.15.151:0/4161180141 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d918344f10 con 0x55d91861b050 2023-07-21T22:58:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.357+0000 7f44fa19b700 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d91861b050 0x55d91861d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:58:52.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.358+0000 7f44fa19b700 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d91861b050 0x55d91861d460 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3215416b5ac8686 server_cookie=139e3c0f24795f1c in_seq=0 out_seq=0 2023-07-21T22:58:52.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.358+0000 7f44d9ffb700 10 client.29095 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.381+0000 7f44d9ffb700 1 -- 172.21.15.151:0/4161180141 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d918344f10 con 0x55d91861b050 2023-07-21T22:58:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.381+0000 7f44d9ffb700 10 client.29095 handle_command_reply: tid=0 2023-07-21T22:58:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.381+0000 7f450fcb3b80 1 client.29095 shutdown 2023-07-21T22:58:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 -- 172.21.15.151:0/4161180141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 msgr2=0x55d9185ba780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ba780 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f44f0097d70 tx=0x7f44f0009920 comp rx=0 tx=0).stop 2023-07-21T22:58:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 -- 172.21.15.151:0/4161180141 shutdown_connections 2023-07-21T22:58:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d91861b050 0x55d91861d460 crc :-1 s=READY pgs=454 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d9185b2e70 0x55d918613270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d9184006b0 0x55d9185ba240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 --2- 172.21.15.151:0/4161180141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d9185b2a20 0x55d9185ba780 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 -- 172.21.15.151:0/4161180141 >> 172.21.15.151:0/4161180141 conn(0x55d918599ae0 msgr2=0x55d9185b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f44d9ffb700 0 client.29095 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 -- 172.21.15.151:0/4161180141 shutdown_connections 2023-07-21T22:58:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.382+0000 7f450fcb3b80 1 -- 172.21.15.151:0/4161180141 wait complete. 2023-07-21T22:58:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.383+0000 7f450fcb3b80 20 client.29095 trim_cache size 0 max 16384 2023-07-21T22:58:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:58:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:58:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:58:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:58:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 -- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f44dc0a1490 msgr2=0x7f44dc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f44dc0a1490 0x7f44dc0a3940 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f44e4005fd0 tx=0x7f44e4009310 comp rx=0 tx=0).stop 2023-07-21T22:58:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 -- 172.21.15.151:0/4175606392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4107010 msgr2=0x7f44f406aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4107010 0x7f44f406aca0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f44f000d010 tx=0x7f44f0007860 comp rx=0 tx=0).stop 2023-07-21T22:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 -- 172.21.15.151:0/4175606392 shutdown_connections 2023-07-21T22:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f44dc0a1490 0x7f44dc0a3940 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f44f406b1e0 0x7f44f406b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44f4101fd0 0x7f44f4071ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 --2- 172.21.15.151:0/4175606392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f44f4107010 0x7f44f406aca0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:58:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 -- 172.21.15.151:0/4175606392 >> 172.21.15.151:0/4175606392 conn(0x7f44f40fd840 msgr2=0x7f44f41061a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.384+0000 7f44fc3ff700 1 -- 172.21.15.151:0/4175606392 shutdown_connections 2023-07-21T22:58:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:58:52.385+0000 7f44fc3ff700 1 -- 172.21.15.151:0/4175606392 wait complete. 2023-07-21T22:58:53.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:52 smithi151 ceph-mon[95510]: pgmap v1263: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 924 op/s 2023-07-21T22:58:53.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:52 smithi187 ceph-mon[96918]: pgmap v1263: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 924 op/s 2023-07-21T22:58:53.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:52 smithi195 ceph-mon[97365]: pgmap v1263: 97 pgs: 97 active+clean; 12 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 10 MiB/s wr, 924 op/s 2023-07-21T22:58:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 360.0 s, 364.6 tps, lat 280.093 ms stddev 119.368 2023-07-21T22:58:54.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:54 smithi187 ceph-mon[96918]: pgmap v1264: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-21T22:58:54.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:54 smithi195 ceph-mon[97365]: pgmap v1264: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-21T22:58:54.689 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:54 smithi151 ceph-mon[95510]: pgmap v1264: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 15 MiB/s wr, 1.39k op/s 2023-07-21T22:58:55.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:55 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:58:55.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:55 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:58:55.689 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:55 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:58:56.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:56 smithi187 ceph-mon[96918]: pgmap v1265: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.8 MiB/s wr, 913 op/s 2023-07-21T22:58:56.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:56 smithi195 ceph-mon[97365]: pgmap v1265: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.8 MiB/s wr, 913 op/s 2023-07-21T22:58:56.688 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:56 smithi151 ceph-mon[95510]: pgmap v1265: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 9.8 MiB/s wr, 913 op/s 2023-07-21T22:58:59.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:58:58 smithi151 ceph-mon[95510]: pgmap v1266: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-21T22:58:59.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 365.0 s, 396.6 tps, lat 250.091 ms stddev 57.308 2023-07-21T22:58:59.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:58:58 smithi187 ceph-mon[96918]: pgmap v1266: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-21T22:58:59.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:58:58 smithi195 ceph-mon[97365]: pgmap v1266: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 15 MiB/s wr, 1.38k op/s 2023-07-21T22:59:01.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:00 smithi151 ceph-mon[95510]: pgmap v1267: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.6 MiB/s wr, 925 op/s 2023-07-21T22:59:01.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:00 smithi187 ceph-mon[96918]: pgmap v1267: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.6 MiB/s wr, 925 op/s 2023-07-21T22:59:01.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:00 smithi195 ceph-mon[97365]: pgmap v1267: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.6 MiB/s wr, 925 op/s 2023-07-21T22:59:03.195 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:02 smithi151 ceph-mon[95510]: pgmap v1268: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.6 MiB/s wr, 925 op/s 2023-07-21T22:59:03.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:02 smithi187 ceph-mon[96918]: pgmap v1268: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.6 MiB/s wr, 925 op/s 2023-07-21T22:59:03.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:02 smithi195 ceph-mon[97365]: pgmap v1268: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.6 MiB/s wr, 925 op/s 2023-07-21T22:59:04.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 370.0 s, 275.4 tps, lat 354.114 ms stddev 242.918 2023-07-21T22:59:04.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:03 smithi187 ceph-mon[96918]: pgmap v1269: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.40k op/s 2023-07-21T22:59:04.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:03 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:59:04.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:03 smithi195 ceph-mon[97365]: pgmap v1269: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.40k op/s 2023-07-21T22:59:04.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:03 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:59:04.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:03 smithi151 ceph-mon[95510]: pgmap v1269: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 15 MiB/s wr, 1.40k op/s 2023-07-21T22:59:04.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:03 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:59:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.579+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/3346484305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 msgr2=0x7f5f1410c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.579+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/3346484305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 0x7f5f1410c920 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00b0a0 tx=0x7f5f0c00b3b0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.579+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/3346484305 shutdown_connections 2023-07-21T22:59:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.579+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/3346484305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f14105b60 0x7f5f14105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.579+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/3346484305 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 0x7f5f1410c920 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.579+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/3346484305 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f140ffb30 0x7f5f140fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.579+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/3346484305 >> 172.21.15.151:0/3346484305 conn(0x7f5f140fb5f0 msgr2=0x7f5f140fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.580+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/3346484305 shutdown_connections 2023-07-21T22:59:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.580+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/3346484305 wait complete. 2023-07-21T22:59:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f1a7ff700 1 Processor -- start 2023-07-21T22:59:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f1a7ff700 1 -- start start 2023-07-21T22:59:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f1a7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f140ffb30 0x7f5f14197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f1a7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 0x7f5f141982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f1a7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f14105b60 0x7f5f1419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f1a7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1419cf70 con 0x7f5f141004e0 2023-07-21T22:59:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f1a7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1419d0e0 con 0x7f5f140ffb30 2023-07-21T22:59:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f1a7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1419d2a0 con 0x7f5f14105b60 2023-07-21T22:59:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 0x7f5f141982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f137fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 0x7f5f141982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36532/0 (socket says 172.21.15.151:36532) 2023-07-21T22:59:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f137fe700 1 -- 172.21.15.151:0/2552259190 learned_addr learned my addr 172.21.15.151:0/2552259190 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.581+0000 7f5f13fff700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f140ffb30 0x7f5f14197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f18d9c700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f14105b60 0x7f5f1419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f137fe700 1 -- 172.21.15.151:0/2552259190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f14105b60 msgr2=0x7f5f1419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f137fe700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f14105b60 0x7f5f1419c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f137fe700 1 -- 172.21.15.151:0/2552259190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f140ffb30 msgr2=0x7f5f14197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f137fe700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f140ffb30 0x7f5f14197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f137fe700 1 -- 172.21.15.151:0/2552259190 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f0c009d00 con 0x7f5f141004e0 2023-07-21T22:59:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f137fe700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 0x7f5f141982c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800d950 tx=0x7f5f0800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f117fa700 1 -- 172.21.15.151:0/2552259190 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800f890 con 0x7f5f141004e0 2023-07-21T22:59:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f117fa700 1 -- 172.21.15.151:0/2552259190 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f0800fe80 con 0x7f5f141004e0 2023-07-21T22:59:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/2552259190 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f1419d580 con 0x7f5f141004e0 2023-07-21T22:59:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f117fa700 1 -- 172.21.15.151:0/2552259190 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0800e3b0 con 0x7f5f141004e0 2023-07-21T22:59:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.582+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/2552259190 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f141a4dc0 con 0x7f5f141004e0 2023-07-21T22:59:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.586+0000 7f5f117fa700 1 -- 172.21.15.151:0/2552259190 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5f08010460 con 0x7f5f141004e0 2023-07-21T22:59:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.587+0000 7f5f117fa700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5efc0a12c0 0x7f5efc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.587+0000 7f5f2e1fcb80 1 Processor -- start 2023-07-21T22:59:05.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.587+0000 7f5f117fa700 1 -- 172.21.15.151:0/2552259190 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5f080ccab0 con 0x7f5f141004e0 2023-07-21T22:59:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.587+0000 7f5f2e1fcb80 1 -- start start 2023-07-21T22:59:05.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.587+0000 7f5f13fff700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5efc0a12c0 0x7f5efc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b03acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b034f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b0354a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1af3ac50 con 0x557a1ae916b0 2023-07-21T22:59:05.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1af8d9e0 con 0x557a1b03b660 2023-07-21T22:59:05.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1af86e70 con 0x557a1b03b210 2023-07-21T22:59:05.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f13fff700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5efc0a12c0 0x7f5efc0a3770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5f04007be0 tx=0x7f5f040073d0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:05.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f13fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b03acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f18d9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b0354a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f137fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b034f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f137fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b034f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:36940/0 (socket says 172.21.15.151:36940) 2023-07-21T22:59:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f137fe700 1 -- 172.21.15.151:0/2053130772 learned_addr learned my addr 172.21.15.151:0/2053130772 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f18d9c700 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b0354a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39406/0 (socket says 172.21.15.151:39406) 2023-07-21T22:59:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.588+0000 7f5f13fff700 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b03acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36542/0 (socket says 172.21.15.151:36542) 2023-07-21T22:59:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5f137fe700 1 -- 172.21.15.151:0/2053130772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 msgr2=0x557a1b0354a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5f137fe700 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b0354a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5f137fe700 1 -- 172.21.15.151:0/2053130772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 msgr2=0x557a1b03acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5f137fe700 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b03acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5f137fe700 1 -- 172.21.15.151:0/2053130772 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a1adb4d80 con 0x557a1b03b210 2023-07-21T22:59:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5f18d9c700 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b0354a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:59:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5f137fe700 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b034f40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5f08096600 tx=0x7f5f08010760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f86119c1fc4388fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5efa7fc700 1 -- 172.21.15.151:0/2053130772 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0809dbc0 con 0x557a1b03b210 2023-07-21T22:59:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5efa7fc700 1 -- 172.21.15.151:0/2053130772 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f080a1fe0 con 0x557a1b03b210 2023-07-21T22:59:05.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.589+0000 7f5efa7fc700 1 -- 172.21.15.151:0/2053130772 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080a1b50 con 0x557a1b03b210 2023-07-21T22:59:05.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.590+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2053130772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 msgr2=0x557a1b034f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.590+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b034f40 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f5f08096600 tx=0x7f5f08010760 comp rx=0 tx=0).stop 2023-07-21T22:59:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.590+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2053130772 shutdown_connections 2023-07-21T22:59:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.590+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b0354a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.590+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b03acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.590+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2053130772 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b034f40 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.590+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2053130772 >> 172.21.15.151:0/2053130772 conn(0x557a1b02aae0 msgr2=0x557a1b0300e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:05.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.590+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2053130772 shutdown_connections 2023-07-21T22:59:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.590+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2053130772 wait complete. 2023-07-21T22:59:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.591+0000 7f5f2e1fcb80 1 -- start start 2023-07-21T22:59:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.591+0000 7f5f2e1fcb80 1 Processor -- start 2023-07-21T22:59:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b044660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b044ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b03e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1af26a60 con 0x557a1ae916b0 2023-07-21T22:59:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1af26760 con 0x557a1b03b660 2023-07-21T22:59:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1ae0a8c0 con 0x557a1b03b210 2023-07-21T22:59:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f2e1fcb80 10 client.0 _ll_register_callbacks cb 0x557a1af24700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f13fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b044660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f137fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b044ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f13fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b044660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36546/0 (socket says 172.21.15.151:36546) 2023-07-21T22:59:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f13fff700 1 -- 172.21.15.151:0/2116587703 learned_addr learned my addr 172.21.15.151:0/2116587703 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.592+0000 7f5f18d9c700 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b03e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5f137fe700 1 -- 172.21.15.151:0/2116587703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 msgr2=0x557a1b03e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5f137fe700 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b03e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5f137fe700 1 -- 172.21.15.151:0/2116587703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 msgr2=0x557a1b044660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5f137fe700 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b044660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5f137fe700 1 -- 172.21.15.151:0/2116587703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f1410d220 con 0x557a1b03b210 2023-07-21T22:59:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5f137fe700 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b044ba0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800e010 tx=0x7f5f0809a0a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d752c5d9992eeaba server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5ef37fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:59:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5ef37fe700 1 -- 172.21.15.151:0/2116587703 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0809dc40 con 0x557a1b03b210 2023-07-21T22:59:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2116587703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557a1aee0490 con 0x557a1b03b210 2023-07-21T22:59:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5ef37fe700 1 -- 172.21.15.151:0/2116587703 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5f08099080 con 0x557a1b03b210 2023-07-21T22:59:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5ef37fe700 1 -- 172.21.15.151:0/2116587703 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f080b2390 con 0x557a1b03b210 2023-07-21T22:59:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5f2e1fcb80 10 client.29107 fetch_fsmap learned FSMap version 112 2023-07-21T22:59:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.593+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2116587703 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f5f141a4dc0 con 0x557a1b03b210 2023-07-21T22:59:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.594+0000 7f5ef37fe700 1 -- 172.21.15.151:0/2116587703 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557a1aee0490 con 0x557a1b03b210 2023-07-21T22:59:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.594+0000 7f5ef37fe700 1 -- 172.21.15.151:0/2116587703 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 112) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5f08095980 con 0x557a1b03b210 2023-07-21T22:59:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.594+0000 7f5f2e1fcb80 10 client.29107 fetch_fsmap finished waiting for FSMap version 112 2023-07-21T22:59:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.594+0000 7f5f2e1fcb80 10 client.29107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.594+0000 7f5f2e1fcb80 20 client.29107 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.594+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a1b04e630 0x557a1b050a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.594+0000 7f5f2e1fcb80 4 client.29107 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:59:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.594+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2116587703 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557a1af7fe50 con 0x557a1b04e630 2023-07-21T22:59:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.595+0000 7f5f13fff700 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a1b04e630 0x557a1b050a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.595+0000 7f5f13fff700 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a1b04e630 0x557a1b050a40 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a53a898bb750db7f server_cookie=3f62a6e54dec7328 in_seq=0 out_seq=0 2023-07-21T22:59:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.595+0000 7f5ef37fe700 10 client.29107 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.596+0000 7f5ef37fe700 1 -- 172.21.15.151:0/2116587703 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557a1af7fe50 con 0x557a1b04e630 2023-07-21T22:59:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.596+0000 7f5ef37fe700 10 client.29107 handle_command_reply: tid=0 2023-07-21T22:59:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.596+0000 7f5f2e1fcb80 1 client.29107 shutdown 2023-07-21T22:59:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2116587703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 msgr2=0x557a1b044ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b044ba0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800e010 tx=0x7f5f0809a0a0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2116587703 shutdown_connections 2023-07-21T22:59:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a1b04e630 0x557a1b050a40 crc :-1 s=READY pgs=455 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1b03b660 0x557a1b03e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5ef37fe700 0 client.29107 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1ae916b0 0x557a1b044660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/2116587703 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b044ba0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2116587703 >> 172.21.15.151:0/2116587703 conn(0x557a1b02aae0 msgr2=0x557a1b02f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:05.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2116587703 shutdown_connections 2023-07-21T22:59:05.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/2116587703 wait complete. 2023-07-21T22:59:05.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.597+0000 7f5f2e1fcb80 20 client.29107 trim_cache size 0 max 16384 2023-07-21T22:59:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.613+0000 7f5f2e1fcb80 1 Processor -- start 2023-07-21T22:59:05.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.613+0000 7f5f2e1fcb80 1 -- start start 2023-07-21T22:59:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.613+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b02aae0 0x557a1b03a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.613+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1ae916b0 0x557a1b02fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.613+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b0300a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.613+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1aee0490 con 0x557a1b02aae0 2023-07-21T22:59:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.613+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1b031a80 con 0x557a1ae916b0 2023-07-21T22:59:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.613+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1b02cc00 con 0x557a1b03b210 2023-07-21T22:59:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f13fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b02aae0 0x557a1b03a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f13fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b02aae0 0x557a1b03a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36552/0 (socket says 172.21.15.151:36552) 2023-07-21T22:59:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f13fff700 1 -- 172.21.15.151:0/1553290125 learned_addr learned my addr 172.21.15.151:0/1553290125 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:05.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f18d9c700 1 --2- 172.21.15.151:0/1553290125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b0300a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f13fff700 1 -- 172.21.15.151:0/1553290125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 msgr2=0x557a1b0300a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f13fff700 1 --2- 172.21.15.151:0/1553290125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b0300a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f13fff700 1 -- 172.21.15.151:0/1553290125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1ae916b0 msgr2=0x557a1b02fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f13fff700 1 --2- 172.21.15.151:0/1553290125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1ae916b0 0x557a1b02fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f13fff700 1 -- 172.21.15.151:0/1553290125 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557a1ad9dc00 con 0x557a1b02aae0 2023-07-21T22:59:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5f13fff700 1 --2- 172.21.15.151:0/1553290125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b02aae0 0x557a1b03a190 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5f04005e90 tx=0x7f5f04013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6a525a72e0e0fb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5efaffd700 1 -- 172.21.15.151:0/1553290125 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04025040 con 0x557a1b02aae0 2023-07-21T22:59:05.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5efaffd700 1 -- 172.21.15.151:0/1553290125 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f040044c0 con 0x557a1b02aae0 2023-07-21T22:59:05.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.614+0000 7f5efaffd700 1 -- 172.21.15.151:0/1553290125 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f04003cb0 con 0x557a1b02aae0 2023-07-21T22:59:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.615+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/1553290125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b02aae0 msgr2=0x557a1b03a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.615+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/1553290125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b02aae0 0x557a1b03a190 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f5f04005e90 tx=0x7f5f04013000 comp rx=0 tx=0).stop 2023-07-21T22:59:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.615+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/1553290125 shutdown_connections 2023-07-21T22:59:05.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.615+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/1553290125 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b03b210 0x557a1b0300a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.615+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/1553290125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b02aae0 0x557a1b03a190 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.615+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/1553290125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1ae916b0 0x557a1b02fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.615+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/1553290125 >> 172.21.15.151:0/1553290125 conn(0x557a1b03f4e0 msgr2=0x557a1b03e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.615+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/1553290125 shutdown_connections 2023-07-21T22:59:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.615+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/1553290125 wait complete. 2023-07-21T22:59:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.616+0000 7f5f2e1fcb80 1 -- start start 2023-07-21T22:59:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.616+0000 7f5f2e1fcb80 1 Processor -- start 2023-07-21T22:59:05.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.616+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1ae916b0 0x557a1b044ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.616+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b02aae0 0x557a1b042d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.616+0000 7f5f2e1fcb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b03b210 0x557a1b043360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.616+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1b043a00 con 0x557a1b03b210 2023-07-21T22:59:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.616+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1b043b40 con 0x557a1ae916b0 2023-07-21T22:59:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.616+0000 7f5f2e1fcb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557a1b0a2500 con 0x557a1b02aae0 2023-07-21T22:59:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.616+0000 7f5f2e1fcb80 10 client.0 _ll_register_callbacks cb 0x7f5f04010970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f18d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b03b210 0x557a1b043360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f18d9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b03b210 0x557a1b043360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:36568/0 (socket says 172.21.15.151:36568) 2023-07-21T22:59:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f18d9c700 1 -- 172.21.15.151:0/110230116 learned_addr learned my addr 172.21.15.151:0/110230116 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f137fe700 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b02aae0 0x557a1b042d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f18d9c700 1 -- 172.21.15.151:0/110230116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b02aae0 msgr2=0x557a1b042d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f18d9c700 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b02aae0 0x557a1b042d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f18d9c700 1 -- 172.21.15.151:0/110230116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1ae916b0 msgr2=0x557a1b044ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f18d9c700 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1ae916b0 0x557a1b044ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f18d9c700 1 -- 172.21.15.151:0/110230116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f04010a60 con 0x557a1b03b210 2023-07-21T22:59:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5f18d9c700 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b03b210 0x557a1b043360 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c015000 tx=0x7f5f0c003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5aa31d49ab5f30d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.617+0000 7f5ef37fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:59:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5ef37fe700 1 -- 172.21.15.151:0/110230116 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c00e040 con 0x557a1b03b210 2023-07-21T22:59:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/110230116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5f080a1fe0 con 0x557a1b03b210 2023-07-21T22:59:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5ef37fe700 1 -- 172.21.15.151:0/110230116 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(157..157 src has 1..157) v4 ==== 8448+0+0 (secure 0 0 0) 0x7f5f0c005040 con 0x557a1b03b210 2023-07-21T22:59:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5ef37fe700 1 -- 172.21.15.151:0/110230116 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5f0c005200 con 0x557a1b03b210 2023-07-21T22:59:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5f2e1fcb80 10 client.19410 fetch_fsmap learned FSMap version 112 2023-07-21T22:59:05.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/110230116 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x557a1addb1f0 con 0x557a1b03b210 2023-07-21T22:59:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5ef37fe700 1 -- 172.21.15.151:0/110230116 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f080a1fe0 con 0x557a1b03b210 2023-07-21T22:59:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5ef37fe700 1 -- 172.21.15.151:0/110230116 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 112) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f5f0c02f050 con 0x557a1b03b210 2023-07-21T22:59:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5f2e1fcb80 10 client.19410 fetch_fsmap finished waiting for FSMap version 112 2023-07-21T22:59:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5f2e1fcb80 10 client.19410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5f2e1fcb80 20 client.19410 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a1b03b660 0x557a1b0a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:05.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5f2e1fcb80 4 client.19410 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:59:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.618+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/110230116 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557a1af41ff0 con 0x557a1b03b660 2023-07-21T22:59:05.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.619+0000 7f5f13fff700 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a1b03b660 0x557a1b0a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.636+0000 7f5ef37fe700 10 client.19410 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:05.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.636+0000 7f5f13fff700 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a1b03b660 0x557a1b0a5ca0 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f60717973f2326cb server_cookie=834b0dd6dbc915b8 in_seq=0 out_seq=0 2023-07-21T22:59:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5ef37fe700 1 -- 172.21.15.151:0/110230116 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557a1af41ff0 con 0x557a1b03b660 2023-07-21T22:59:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5ef37fe700 10 client.19410 handle_command_reply: tid=0 2023-07-21T22:59:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 client.19410 shutdown 2023-07-21T22:59:05.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/110230116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b03b210 msgr2=0x557a1b043360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b03b210 0x557a1b043360 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c015000 tx=0x7f5f0c003ab0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/110230116 shutdown_connections 2023-07-21T22:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557a1b03b660 0x557a1b0a5ca0 crc :-1 s=READY pgs=456 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557a1ae916b0 0x557a1b044ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557a1b03b210 0x557a1b043360 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5ef37fe700 0 client.19410 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 --2- 172.21.15.151:0/110230116 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557a1b02aae0 0x557a1b042d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/110230116 >> 172.21.15.151:0/110230116 conn(0x557a1b03f4e0 msgr2=0x557a1b03d080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/110230116 shutdown_connections 2023-07-21T22:59:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 1 -- 172.21.15.151:0/110230116 wait complete. 2023-07-21T22:59:05.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.942+0000 7f5f2e1fcb80 20 client.19410 trim_cache size 0 max 16384 2023-07-21T22:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:59:05.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5efc0a12c0 msgr2=0x7f5efc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5efc0a12c0 0x7f5efc0a3770 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f5f04007be0 tx=0x7f5f040073d0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 msgr2=0x7f5f141982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 0x7f5f141982c0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f5f0800d950 tx=0x7f5f0800dc60 comp rx=0 tx=0).stop 2023-07-21T22:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/2552259190 shutdown_connections 2023-07-21T22:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5efc0a12c0 0x7f5efc0a3770 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f140ffb30 0x7f5f14197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f14105b60 0x7f5f1419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 --2- 172.21.15.151:0/2552259190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f141004e0 0x7f5f141982c0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/2552259190 >> 172.21.15.151:0/2552259190 conn(0x7f5f140fb5f0 msgr2=0x7f5f1410ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/2552259190 shutdown_connections 2023-07-21T22:59:05.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:05.943+0000 7f5f1a7ff700 1 -- 172.21.15.151:0/2552259190 wait complete. 2023-07-21T22:59:07.117 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:06 smithi187 ceph-mon[96918]: pgmap v1270: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.9 MiB/s wr, 935 op/s 2023-07-21T22:59:07.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:06 smithi195 ceph-mon[97365]: pgmap v1270: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.9 MiB/s wr, 935 op/s 2023-07-21T22:59:07.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:06 smithi151 ceph-mon[95510]: pgmap v1270: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 9.9 MiB/s wr, 935 op/s 2023-07-21T22:59:09.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:08 smithi151 ceph-mon[95510]: pgmap v1271: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.11k op/s 2023-07-21T22:59:09.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 375.0 s, 49.2 tps, lat 1980.798 ms stddev 2084.695 2023-07-21T22:59:09.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:08 smithi187 ceph-mon[96918]: pgmap v1271: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.11k op/s 2023-07-21T22:59:09.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:08 smithi195 ceph-mon[97365]: pgmap v1271: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 13 MiB/s wr, 1.11k op/s 2023-07-21T22:59:10.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:09 smithi187 ceph-mon[96918]: osdmap e158: 12 total, 12 up, 12 in 2023-07-21T22:59:10.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:09 smithi195 ceph-mon[97365]: osdmap e158: 12 total, 12 up, 12 in 2023-07-21T22:59:10.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:09 smithi151 ceph-mon[95510]: osdmap e158: 12 total, 12 up, 12 in 2023-07-21T22:59:11.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:10 smithi187 ceph-mon[96918]: pgmap v1273: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.6 MiB/s wr, 775 op/s 2023-07-21T22:59:11.401 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:10 smithi195 ceph-mon[97365]: pgmap v1273: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.6 MiB/s wr, 775 op/s 2023-07-21T22:59:11.443 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:10 smithi151 ceph-mon[95510]: pgmap v1273: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.6 MiB/s wr, 775 op/s 2023-07-21T22:59:13.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:12 smithi187 ceph-mon[96918]: pgmap v1274: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.6 MiB/s wr, 775 op/s 2023-07-21T22:59:13.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:12 smithi195 ceph-mon[97365]: pgmap v1274: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.6 MiB/s wr, 775 op/s 2023-07-21T22:59:13.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:12 smithi151 ceph-mon[95510]: pgmap v1274: 97 pgs: 97 active+clean; 13 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 9.6 MiB/s wr, 775 op/s 2023-07-21T22:59:14.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 380.0 s, 176.0 tps, lat 599.296 ms stddev 370.031 2023-07-21T22:59:14.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:13 smithi187 ceph-mon[96918]: pgmap v1275: 97 pgs: 18 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 69 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 303 op/s 2023-07-21T22:59:14.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:13 smithi195 ceph-mon[97365]: pgmap v1275: 97 pgs: 18 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 69 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 303 op/s 2023-07-21T22:59:14.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:13 smithi151 ceph-mon[95510]: pgmap v1275: 97 pgs: 18 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 69 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 303 op/s 2023-07-21T22:59:17.117 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:16 smithi187 ceph-mon[96918]: pgmap v1276: 97 pgs: 18 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 69 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 303 op/s 2023-07-21T22:59:17.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:16 smithi195 ceph-mon[97365]: pgmap v1276: 97 pgs: 18 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 69 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 303 op/s 2023-07-21T22:59:17.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:16 smithi151 ceph-mon[95510]: pgmap v1276: 97 pgs: 18 active+clean+snaptrim_wait, 10 active+clean+snaptrim, 69 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 4.8 MiB/s wr, 303 op/s 2023-07-21T22:59:19.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:18 smithi151 ceph-mon[95510]: pgmap v1277: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 371 op/s 2023-07-21T22:59:19.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.168+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3745705158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c074a40 msgr2=0x7fdd8c074e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.168+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3745705158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c074a40 0x7fdd8c074e10 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0098f0 tx=0x7fdd7c009c00 comp rx=0 tx=0).stop 2023-07-21T22:59:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.169+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3745705158 shutdown_connections 2023-07-21T22:59:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.169+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3745705158 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c074a40 0x7fdd8c074e10 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.169+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3745705158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd8c110860 0x7fdd8c112c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.169+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3745705158 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd8c075350 0x7fdd8c110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.169+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3745705158 >> 172.21.15.151:0/3745705158 conn(0x7fdd8c0fd6c0 msgr2=0x7fdd8c0ffad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.169+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3745705158 shutdown_connections 2023-07-21T22:59:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.169+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3745705158 wait complete. 2023-07-21T22:59:19.204 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.171+0000 7fdd90b9d700 1 Processor -- start 2023-07-21T22:59:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.171+0000 7fdd90b9d700 1 -- start start 2023-07-21T22:59:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.171+0000 7fdd90b9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd8c074a40 0x7fdd8c19c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.171+0000 7fdd90b9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c075350 0x7fdd8c19c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.172+0000 7fdd90b9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd8c110860 0x7fdd8c1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.172+0000 7fdd90b9d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1a0fe0 con 0x7fdd8c074a40 2023-07-21T22:59:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.172+0000 7fdd90b9d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1a1150 con 0x7fdd8c075350 2023-07-21T22:59:19.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.172+0000 7fdd90b9d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8c1a1310 con 0x7fdd8c110860 2023-07-21T22:59:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.172+0000 7fdd8affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c075350 0x7fdd8c19c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.172+0000 7fdd8affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c075350 0x7fdd8c19c5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55510/0 (socket says 172.21.15.151:55510) 2023-07-21T22:59:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.172+0000 7fdd8affd700 1 -- 172.21.15.151:0/3106398017 learned_addr learned my addr 172.21.15.151:0/3106398017 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.172+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd8c074a40 0x7fdd8c19c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.172+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd8c110860 0x7fdd8c1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.173+0000 7fdd8b7fe700 1 -- 172.21.15.151:0/3106398017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd8c110860 msgr2=0x7fdd8c1a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:19.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.173+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd8c110860 0x7fdd8c1a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.173+0000 7fdd8b7fe700 1 -- 172.21.15.151:0/3106398017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c075350 msgr2=0x7fdd8c19c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:19.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.173+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c075350 0x7fdd8c19c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.173+0000 7fdd8b7fe700 1 -- 172.21.15.151:0/3106398017 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7c009520 con 0x7fdd8c074a40 2023-07-21T22:59:19.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.173+0000 7fdd8affd700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c075350 0x7fdd8c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:59:19.208 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.173+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd8c074a40 0x7fdd8c19c070 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009810 tx=0x7fdd7c00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:19.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.174+0000 7fdd88ff9700 1 -- 172.21.15.151:0/3106398017 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c01c070 con 0x7fdd8c074a40 2023-07-21T22:59:19.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.174+0000 7fdd88ff9700 1 -- 172.21.15.151:0/3106398017 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7c00ba70 con 0x7fdd8c074a40 2023-07-21T22:59:19.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.174+0000 7fdd88ff9700 1 -- 172.21.15.151:0/3106398017 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c0038e0 con 0x7fdd8c074a40 2023-07-21T22:59:19.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.174+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3106398017 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c1a1590 con 0x7fdd8c074a40 2023-07-21T22:59:19.209 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.174+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3106398017 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c1a17e0 con 0x7fdd8c074a40 2023-07-21T22:59:19.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.179+0000 7fdd88ff9700 1 -- 172.21.15.151:0/3106398017 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdd7c020030 con 0x7fdd8c074a40 2023-07-21T22:59:19.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.181+0000 7fdda57ffb80 1 Processor -- start 2023-07-21T22:59:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.181+0000 7fdd88ff9700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd740a1490 0x7fdd740a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.181+0000 7fdda57ffb80 1 -- start start 2023-07-21T22:59:19.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.181+0000 7fdd88ff9700 1 -- 172.21.15.151:0/3106398017 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fdd7c0cd950 con 0x7fdd8c074a40 2023-07-21T22:59:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.181+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a186bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.181+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a186c480 0x55b2a18660a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.181+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1866a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.182+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a176bc50 con 0x55b2a186c480 2023-07-21T22:59:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.182+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a17be9e0 con 0x55b2a16c26b0 2023-07-21T22:59:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.182+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a17b7e70 con 0x55b2a18665e0 2023-07-21T22:59:19.216 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.182+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd740a1490 0x7fdd740a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.182+0000 7fdd8b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a186bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.182+0000 7fdd8b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a186bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55514/0 (socket says 172.21.15.151:55514) 2023-07-21T22:59:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.182+0000 7fdd8b7fe700 1 -- 172.21.15.151:0/2155861941 learned_addr learned my addr 172.21.15.151:0/2155861941 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.182+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1866a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.182+0000 7fdd8affd700 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a186c480 0x55b2a18660a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd8b7fe700 1 -- 172.21.15.151:0/2155861941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 msgr2=0x55b2a1866a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1866a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd8b7fe700 1 -- 172.21.15.151:0/2155861941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a186c480 msgr2=0x55b2a18660a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:19.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a186c480 0x55b2a18660a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd8b7fe700 1 -- 172.21.15.151:0/2155861941 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2a15e5d80 con 0x55b2a16c26b0 2023-07-21T22:59:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1866a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T22:59:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd740a1490 0x7fdd740a3940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c069730 tx=0x7fdd8400fc00 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a186bf40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0974b0 tx=0x7fdd7c09a910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=928e39c0a4ac9504 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd71ffb700 1 -- 172.21.15.151:0/2155861941 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c09bea0 con 0x55b2a16c26b0 2023-07-21T22:59:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd71ffb700 1 -- 172.21.15.151:0/2155861941 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7c09ea70 con 0x55b2a16c26b0 2023-07-21T22:59:19.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.183+0000 7fdd71ffb700 1 -- 172.21.15.151:0/2155861941 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd7c005040 con 0x55b2a16c26b0 2023-07-21T22:59:19.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.184+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2155861941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 msgr2=0x55b2a186bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:19.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.184+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a186bf40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c0974b0 tx=0x7fdd7c09a910 comp rx=0 tx=0).stop 2023-07-21T22:59:19.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.184+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2155861941 shutdown_connections 2023-07-21T22:59:19.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.184+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a186bf40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.184+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1866a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.184+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/2155861941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a186c480 0x55b2a18660a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.184+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2155861941 >> 172.21.15.151:0/2155861941 conn(0x55b2a185bc40 msgr2=0x55b2a1861300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:19.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.185+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2155861941 shutdown_connections 2023-07-21T22:59:19.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.185+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2155861941 wait complete. 2023-07-21T22:59:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.185+0000 7fdda57ffb80 1 -- start start 2023-07-21T22:59:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.186+0000 7fdda57ffb80 1 Processor -- start 2023-07-21T22:59:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.186+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1875380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.186+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a18665e0 0x55b2a18758c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.186+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a186f610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.186+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a1757a60 con 0x55b2a16c26b0 2023-07-21T22:59:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.186+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a1757760 con 0x55b2a18665e0 2023-07-21T22:59:19.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.186+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a163b8c0 con 0x55b2a186c480 2023-07-21T22:59:19.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.186+0000 7fdda57ffb80 10 client.0 _ll_register_callbacks cb 0x55b2a1755700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1875380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a18665e0 0x55b2a18758c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8affd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a18665e0 0x55b2a18758c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55528/0 (socket says 172.21.15.151:55528) 2023-07-21T22:59:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1875380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59992/0 (socket says 172.21.15.151:59992) 2023-07-21T22:59:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8affd700 1 -- 172.21.15.151:0/580891637 learned_addr learned my addr 172.21.15.151:0/580891637 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a186f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8affd700 1 -- 172.21.15.151:0/580891637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 msgr2=0x55b2a186f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8affd700 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a186f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8affd700 1 -- 172.21.15.151:0/580891637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 msgr2=0x55b2a1875380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8affd700 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1875380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8affd700 1 -- 172.21.15.151:0/580891637 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd8c1a17e0 con 0x55b2a18665e0 2023-07-21T22:59:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.187+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1875380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:59:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.188+0000 7fdd8affd700 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a18665e0 0x55b2a18758c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdd80012c90 tx=0x7fdd80009d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=20a54fb1079140f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:19.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.188+0000 7fdd6affd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.188+0000 7fdd6affd700 1 -- 172.21.15.151:0/580891637 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80017070 con 0x55b2a18665e0 2023-07-21T22:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.188+0000 7fdda57ffb80 1 -- 172.21.15.151:0/580891637 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2a1711490 con 0x55b2a18665e0 2023-07-21T22:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.188+0000 7fdd6affd700 1 -- 172.21.15.151:0/580891637 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fdd8000f850 con 0x55b2a18665e0 2023-07-21T22:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.188+0000 7fdd6affd700 1 -- 172.21.15.151:0/580891637 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd800122e0 con 0x55b2a18665e0 2023-07-21T22:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.188+0000 7fdda57ffb80 10 client.29111 fetch_fsmap learned FSMap version 112 2023-07-21T22:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.188+0000 7fdda57ffb80 1 -- 172.21.15.151:0/580891637 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55b2a15cec00 con 0x55b2a18665e0 2023-07-21T22:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.189+0000 7fdd6affd700 1 -- 172.21.15.151:0/580891637 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b2a1711490 con 0x55b2a18665e0 2023-07-21T22:59:19.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.189+0000 7fdd6affd700 1 -- 172.21.15.151:0/580891637 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 112) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdd8001ca50 con 0x55b2a18665e0 2023-07-21T22:59:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.189+0000 7fdda57ffb80 10 client.29111 fetch_fsmap finished waiting for FSMap version 112 2023-07-21T22:59:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.189+0000 7fdda57ffb80 10 client.29111 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.189+0000 7fdda57ffb80 20 client.29111 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.189+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b2a187f900 0x55b2a1881d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.189+0000 7fdda57ffb80 4 client.29111 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:59:19.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.189+0000 7fdda57ffb80 1 -- 172.21.15.151:0/580891637 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2a17b0e50 con 0x55b2a187f900 2023-07-21T22:59:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.190+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b2a187f900 0x55b2a1881d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.191+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b2a187f900 0x55b2a1881d10 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fcfeec7b94feaf server_cookie=81f7e6c36cc0ce39 in_seq=0 out_seq=0 2023-07-21T22:59:19.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.191+0000 7fdd6affd700 10 client.29111 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.192+0000 7fdd6affd700 1 -- 172.21.15.151:0/580891637 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b2a17b0e50 con 0x55b2a187f900 2023-07-21T22:59:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.192+0000 7fdd6affd700 10 client.29111 handle_command_reply: tid=0 2023-07-21T22:59:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.192+0000 7fdda57ffb80 1 client.29111 shutdown 2023-07-21T22:59:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.193+0000 7fdda57ffb80 1 -- 172.21.15.151:0/580891637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a18665e0 msgr2=0x55b2a18758c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.193+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a18665e0 0x55b2a18758c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fdd80012c90 tx=0x7fdd80009d30 comp rx=0 tx=0).stop 2023-07-21T22:59:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.194+0000 7fdda57ffb80 1 -- 172.21.15.151:0/580891637 shutdown_connections 2023-07-21T22:59:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.194+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b2a187f900 0x55b2a1881d10 crc :-1 s=READY pgs=457 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.194+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a186f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.194+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1875380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.194+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/580891637 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a18665e0 0x55b2a18758c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.194+0000 7fdda57ffb80 1 -- 172.21.15.151:0/580891637 >> 172.21.15.151:0/580891637 conn(0x55b2a185bc40 msgr2=0x55b2a1860540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.194+0000 7fdd6affd700 0 client.29111 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.194+0000 7fdda57ffb80 1 -- 172.21.15.151:0/580891637 shutdown_connections 2023-07-21T22:59:19.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.194+0000 7fdda57ffb80 1 -- 172.21.15.151:0/580891637 wait complete. 2023-07-21T22:59:19.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.195+0000 7fdda57ffb80 20 client.29111 trim_cache size 0 max 16384 2023-07-21T22:59:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.220+0000 7fdda57ffb80 1 Processor -- start 2023-07-21T22:59:19.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdda57ffb80 1 -- start start 2023-07-21T22:59:19.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1868900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1868e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a186c480 0x55b2a1860cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a1867320 con 0x55b2a16c26b0 2023-07-21T22:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a185d650 con 0x55b2a186c480 2023-07-21T22:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a186bf40 con 0x55b2a18665e0 2023-07-21T22:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdd8b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1868900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdd8b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1868900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60004/0 (socket says 172.21.15.151:60004) 2023-07-21T22:59:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdd8b7fe700 1 -- 172.21.15.151:0/2464356426 learned_addr learned my addr 172.21.15.151:0/2464356426 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a186c480 0x55b2a1860cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.221+0000 7fdd8affd700 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1868e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.222+0000 7fdd8affd700 1 -- 172.21.15.151:0/2464356426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a186c480 msgr2=0x55b2a1860cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.222+0000 7fdd8affd700 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a186c480 0x55b2a1860cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.222+0000 7fdd8affd700 1 -- 172.21.15.151:0/2464356426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 msgr2=0x55b2a1868900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.222+0000 7fdd8affd700 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1868900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.222+0000 7fdd8affd700 1 -- 172.21.15.151:0/2464356426 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2a1866c80 con 0x55b2a18665e0 2023-07-21T22:59:19.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.222+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1868900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:59:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.222+0000 7fdd8affd700 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1868e40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdd80012c60 tx=0x7fdd80005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a455c006620f497d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.222+0000 7fdd727fc700 1 -- 172.21.15.151:0/2464356426 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd80017040 con 0x55b2a18665e0 2023-07-21T22:59:19.259 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.222+0000 7fdd727fc700 1 -- 172.21.15.151:0/2464356426 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd800055a0 con 0x55b2a18665e0 2023-07-21T22:59:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.223+0000 7fdd727fc700 1 -- 172.21.15.151:0/2464356426 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8000f6a0 con 0x55b2a18665e0 2023-07-21T22:59:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.223+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2464356426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 msgr2=0x55b2a1868e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.223+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1868e40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdd80012c60 tx=0x7fdd80005a00 comp rx=0 tx=0).stop 2023-07-21T22:59:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.223+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2464356426 shutdown_connections 2023-07-21T22:59:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.223+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a186c480 0x55b2a1860cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.223+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a16c26b0 0x55b2a1868900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.260 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.223+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/2464356426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a18665e0 0x55b2a1868e40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.223+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2464356426 >> 172.21.15.151:0/2464356426 conn(0x55b2a185bc40 msgr2=0x55b2a186cc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.223+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2464356426 shutdown_connections 2023-07-21T22:59:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.224+0000 7fdda57ffb80 1 -- 172.21.15.151:0/2464356426 wait complete. 2023-07-21T22:59:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.224+0000 7fdda57ffb80 1 -- start start 2023-07-21T22:59:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.224+0000 7fdda57ffb80 1 Processor -- start 2023-07-21T22:59:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a18757f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a18665e0 0x55b2a1872f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdda57ffb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a1873540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a1873c50 con 0x55b2a18665e0 2023-07-21T22:59:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a1873dc0 con 0x55b2a16c26b0 2023-07-21T22:59:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdda57ffb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a18d2810 con 0x55b2a186c480 2023-07-21T22:59:19.262 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdda57ffb80 10 client.0 _ll_register_callbacks cb 0x7fdd80012760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:19.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdd8bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a1873540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdd8bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a1873540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:40650/0 (socket says 172.21.15.151:40650) 2023-07-21T22:59:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdd8bfff700 1 -- 172.21.15.151:0/9265526 learned_addr learned my addr 172.21.15.151:0/9265526 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.225+0000 7fdd8affd700 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a18665e0 0x55b2a1872f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.226+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a18757f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.226+0000 7fdd8bfff700 1 -- 172.21.15.151:0/9265526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 msgr2=0x55b2a18757f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:19.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.226+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a18757f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.226+0000 7fdd8bfff700 1 -- 172.21.15.151:0/9265526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a18665e0 msgr2=0x55b2a1872f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.226+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a18665e0 0x55b2a1872f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.226+0000 7fdd8bfff700 1 -- 172.21.15.151:0/9265526 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2a15e5d80 con 0x55b2a186c480 2023-07-21T22:59:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.226+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a18757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:59:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.226+0000 7fdd8bfff700 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a1873540 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdd84018ab0 tx=0x7fdd84004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e1927e632b08eb22 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.226+0000 7fdd6affd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:59:19.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.227+0000 7fdd6affd700 1 -- 172.21.15.151:0/9265526 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8400e040 con 0x55b2a186c480 2023-07-21T22:59:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.227+0000 7fdda57ffb80 1 -- 172.21.15.151:0/9265526 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdd7c09ea70 con 0x55b2a186c480 2023-07-21T22:59:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.227+0000 7fdd6affd700 1 -- 172.21.15.151:0/9265526 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(158..158 src has 1..158) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fdd84003c00 con 0x55b2a186c480 2023-07-21T22:59:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.227+0000 7fdd6affd700 1 -- 172.21.15.151:0/9265526 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdd84003dc0 con 0x55b2a186c480 2023-07-21T22:59:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.227+0000 7fdda57ffb80 10 client.29131 fetch_fsmap learned FSMap version 112 2023-07-21T22:59:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.227+0000 7fdda57ffb80 1 -- 172.21.15.151:0/9265526 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x55b2a15cec00 con 0x55b2a186c480 2023-07-21T22:59:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.228+0000 7fdd6affd700 1 -- 172.21.15.151:0/9265526 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdd7c09ea70 con 0x55b2a186c480 2023-07-21T22:59:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.228+0000 7fdd6affd700 1 -- 172.21.15.151:0/9265526 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 112) v1 ==== 7478+0+0 (secure 0 0 0) 0x7fdd84004380 con 0x55b2a186c480 2023-07-21T22:59:19.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.228+0000 7fdda57ffb80 10 client.29131 fetch_fsmap finished waiting for FSMap version 112 2023-07-21T22:59:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.228+0000 7fdda57ffb80 10 client.29131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.228+0000 7fdda57ffb80 20 client.29131 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.228+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b2a18d3f20 0x55b2a18d6330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:19.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.228+0000 7fdda57ffb80 4 client.29131 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:59:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.228+0000 7fdda57ffb80 1 -- 172.21.15.151:0/9265526 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b2a1772ff0 con 0x55b2a18d3f20 2023-07-21T22:59:19.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.228+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b2a18d3f20 0x55b2a18d6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.229+0000 7fdd8b7fe700 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b2a18d3f20 0x55b2a18d6330 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cdd2b2b2d05ca45b server_cookie=c449e93f0fbc030b in_seq=0 out_seq=0 2023-07-21T22:59:19.269 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.229+0000 7fdd6affd700 10 client.29131 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:19.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 385.0 s, 87.0 tps, lat 1151.776 ms stddev 1779.778 2023-07-21T22:59:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdd6affd700 1 -- 172.21.15.151:0/9265526 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b2a1772ff0 con 0x55b2a18d3f20 2023-07-21T22:59:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdd6affd700 10 client.29131 handle_command_reply: tid=0 2023-07-21T22:59:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 client.29131 shutdown 2023-07-21T22:59:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 -- 172.21.15.151:0/9265526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 msgr2=0x55b2a1873540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a1873540 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fdd84018ab0 tx=0x7fdd84004b40 comp rx=0 tx=0).stop 2023-07-21T22:59:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 -- 172.21.15.151:0/9265526 shutdown_connections 2023-07-21T22:59:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b2a18d3f20 0x55b2a18d6330 crc :-1 s=READY pgs=458 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b2a16c26b0 0x55b2a18757f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b2a186c480 0x55b2a1873540 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 --2- 172.21.15.151:0/9265526 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b2a18665e0 0x55b2a1872f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 -- 172.21.15.151:0/9265526 >> 172.21.15.151:0/9265526 conn(0x55b2a185bc40 msgr2=0x55b2a186a860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdd6affd700 0 client.29131 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.258+0000 7fdda57ffb80 1 -- 172.21.15.151:0/9265526 shutdown_connections 2023-07-21T22:59:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.259+0000 7fdda57ffb80 1 -- 172.21.15.151:0/9265526 wait complete. 2023-07-21T22:59:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.259+0000 7fdda57ffb80 20 client.29131 trim_cache size 0 max 16384 2023-07-21T22:59:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:59:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:59:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:59:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:59:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd740a1490 msgr2=0x7fdd740a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd740a1490 0x7fdd740a3940 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c069730 tx=0x7fdd8400fc00 comp rx=0 tx=0).stop 2023-07-21T22:59:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd8c074a40 msgr2=0x7fdd8c19c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd8c074a40 0x7fdd8c19c070 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fdd7c009810 tx=0x7fdd7c00fa00 comp rx=0 tx=0).stop 2023-07-21T22:59:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3106398017 shutdown_connections 2023-07-21T22:59:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdd740a1490 0x7fdd740a3940 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdd8c110860 0x7fdd8c1a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd8c074a40 0x7fdd8c19c070 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 --2- 172.21.15.151:0/3106398017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd8c075350 0x7fdd8c19c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3106398017 >> 172.21.15.151:0/3106398017 conn(0x7fdd8c0fd6c0 msgr2=0x7fdd8c1114c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3106398017 shutdown_connections 2023-07-21T22:59:19.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:19.260+0000 7fdd90b9d700 1 -- 172.21.15.151:0/3106398017 wait complete. 2023-07-21T22:59:19.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:18 smithi187 ceph-mon[96918]: pgmap v1277: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 371 op/s 2023-07-21T22:59:19.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:18 smithi195 ceph-mon[97365]: pgmap v1277: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 3.8 MiB/s wr, 371 op/s 2023-07-21T22:59:21.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:20 smithi151 ceph-mon[95510]: pgmap v1278: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 341 op/s 2023-07-21T22:59:21.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:20 smithi187 ceph-mon[96918]: pgmap v1278: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 341 op/s 2023-07-21T22:59:21.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:20 smithi195 ceph-mon[97365]: pgmap v1278: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 3.5 MiB/s wr, 341 op/s 2023-07-21T22:59:23.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:22 smithi151 ceph-mon[95510]: pgmap v1279: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 3.2 MiB/s wr, 309 op/s 2023-07-21T22:59:23.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:22 smithi151 ceph-mon[95510]: osdmap e159: 12 total, 12 up, 12 in 2023-07-21T22:59:23.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:22 smithi187 ceph-mon[96918]: pgmap v1279: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 3.2 MiB/s wr, 309 op/s 2023-07-21T22:59:23.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:22 smithi187 ceph-mon[96918]: osdmap e159: 12 total, 12 up, 12 in 2023-07-21T22:59:23.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:22 smithi195 ceph-mon[97365]: pgmap v1279: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 1016 KiB/s rd, 3.2 MiB/s wr, 309 op/s 2023-07-21T22:59:23.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:22 smithi195 ceph-mon[97365]: osdmap e159: 12 total, 12 up, 12 in 2023-07-21T22:59:24.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 390.0 s, 204.8 tps, lat 475.029 ms stddev 592.024 2023-07-21T22:59:25.193 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:24 smithi151 ceph-mon[95510]: pgmap v1281: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 475 op/s 2023-07-21T22:59:25.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:24 smithi187 ceph-mon[96918]: pgmap v1281: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 475 op/s 2023-07-21T22:59:25.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:24 smithi195 ceph-mon[97365]: pgmap v1281: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 475 op/s 2023-07-21T22:59:27.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:26 smithi151 ceph-mon[95510]: pgmap v1282: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 475 op/s 2023-07-21T22:59:27.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:26 smithi187 ceph-mon[96918]: pgmap v1282: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 475 op/s 2023-07-21T22:59:27.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:26 smithi195 ceph-mon[97365]: pgmap v1282: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 5.0 MiB/s wr, 475 op/s 2023-07-21T22:59:29.292 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 395.0 s, 344.2 tps, lat 293.820 ms stddev 144.672 2023-07-21T22:59:29.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:28 smithi187 ceph-mon[96918]: pgmap v1283: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 631 op/s 2023-07-21T22:59:29.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:28 smithi195 ceph-mon[97365]: pgmap v1283: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 631 op/s 2023-07-21T22:59:29.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:28 smithi151 ceph-mon[95510]: pgmap v1283: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 631 op/s 2023-07-21T22:59:30.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:29 smithi187 ceph-mon[96918]: pgmap v1284: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 631 op/s 2023-07-21T22:59:30.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:29 smithi195 ceph-mon[97365]: pgmap v1284: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 631 op/s 2023-07-21T22:59:30.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:29 smithi151 ceph-mon[95510]: pgmap v1284: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 631 op/s 2023-07-21T22:59:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.499+0000 7f46c81ff700 1 -- 172.21.15.151:0/4136789399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0108210 msgr2=0x7f46c006c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.499+0000 7f46c81ff700 1 --2- 172.21.15.151:0/4136789399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0108210 0x7f46c006c7a0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009f90 tx=0x7f46bc00b330 comp rx=0 tx=0).stop 2023-07-21T22:59:32.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.499+0000 7f46c81ff700 1 -- 172.21.15.151:0/4136789399 shutdown_connections 2023-07-21T22:59:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.499+0000 7f46c81ff700 1 --2- 172.21.15.151:0/4136789399 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c0112930 0x7f46c0114d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.499+0000 7f46c81ff700 1 --2- 172.21.15.151:0/4136789399 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0108210 0x7f46c006c7a0 secure :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f46bc009f90 tx=0x7f46bc00b330 comp rx=0 tx=0).stop 2023-07-21T22:59:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.499+0000 7f46c81ff700 1 --2- 172.21.15.151:0/4136789399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46c006cd70 0x7f46c006d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.499+0000 7f46c81ff700 1 -- 172.21.15.151:0/4136789399 >> 172.21.15.151:0/4136789399 conn(0x7f46c006bd70 msgr2=0x7f46c0070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:32.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.500+0000 7f46c81ff700 1 -- 172.21.15.151:0/4136789399 shutdown_connections 2023-07-21T22:59:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.500+0000 7f46c81ff700 1 -- 172.21.15.151:0/4136789399 wait complete. 2023-07-21T22:59:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.501+0000 7f46c81ff700 1 Processor -- start 2023-07-21T22:59:32.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.502+0000 7f46c81ff700 1 -- start start 2023-07-21T22:59:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.502+0000 7f46c81ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46c006cd70 0x7f46c0117f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.502+0000 7f46c81ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0112930 0x7f46c0118470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.502+0000 7f46c81ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c011d6b0 0x7f46c011db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.502+0000 7f46c81ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c011e120 con 0x7f46c011d6b0 2023-07-21T22:59:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.502+0000 7f46c81ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c011e290 con 0x7f46c006cd70 2023-07-21T22:59:32.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.502+0000 7f46c81ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c011e450 con 0x7f46c0112930 2023-07-21T22:59:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.503+0000 7f46c579a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0112930 0x7f46c0118470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.503+0000 7f46c5f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46c006cd70 0x7f46c0117f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.503+0000 7f46c579a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0112930 0x7f46c0118470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52404/0 (socket says 172.21.15.151:52404) 2023-07-21T22:59:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.503+0000 7f46c579a700 1 -- 172.21.15.151:0/800440864 learned_addr learned my addr 172.21.15.151:0/800440864 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:32.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.503+0000 7f46c679c700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c011d6b0 0x7f46c011db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.503+0000 7f46c579a700 1 -- 172.21.15.151:0/800440864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46c006cd70 msgr2=0x7f46c0117f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.503+0000 7f46c579a700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46c006cd70 0x7f46c0117f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.503+0000 7f46c579a700 1 -- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c011d6b0 msgr2=0x7f46c011db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.503+0000 7f46c579a700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c011d6b0 0x7f46c011db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.504+0000 7f46c579a700 1 -- 172.21.15.151:0/800440864 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46bc009c40 con 0x7f46c0112930 2023-07-21T22:59:32.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.504+0000 7f46c579a700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0112930 0x7f46c0118470 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f46b000e9c0 tx=0x7f46b000ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.505+0000 7f46b6ffd700 1 -- 172.21.15.151:0/800440864 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0004a30 con 0x7f46c0112930 2023-07-21T22:59:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.505+0000 7f46b6ffd700 1 -- 172.21.15.151:0/800440864 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46b000cc50 con 0x7f46c0112930 2023-07-21T22:59:32.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.505+0000 7f46b6ffd700 1 -- 172.21.15.151:0/800440864 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0005410 con 0x7f46c0112930 2023-07-21T22:59:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.505+0000 7f46c81ff700 1 -- 172.21.15.151:0/800440864 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c0120780 con 0x7f46c0112930 2023-07-21T22:59:32.541 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.505+0000 7f46c81ff700 1 -- 172.21.15.151:0/800440864 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0120c40 con 0x7f46c0112930 2023-07-21T22:59:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.511+0000 7f46dbbd8b80 1 Processor -- start 2023-07-21T22:59:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.514+0000 7f46b6ffd700 1 -- 172.21.15.151:0/800440864 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f46b0005570 con 0x7f46c0112930 2023-07-21T22:59:32.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.514+0000 7f46dbbd8b80 1 -- start start 2023-07-21T22:59:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.515+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.515+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.515+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddc44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.515+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ddcc9c50 con 0x5610dddca660 2023-07-21T22:59:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.515+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ddd1c9e0 con 0x5610dddca210 2023-07-21T22:59:32.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.515+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ddd15e70 con 0x5610ddc206b0 2023-07-21T22:59:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.516+0000 7f46c5f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.516+0000 7f46c5f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55350/0 (socket says 172.21.15.151:55350) 2023-07-21T22:59:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.516+0000 7f46c5f9b700 1 -- 172.21.15.151:0/538565549 learned_addr learned my addr 172.21.15.151:0/538565549 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.516+0000 7f46c579a700 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddc44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.516+0000 7f46c679c700 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.517+0000 7f46c579a700 1 -- 172.21.15.151:0/538565549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 msgr2=0x5610dddc9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.517+0000 7f46c579a700 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.517+0000 7f46c579a700 1 -- 172.21.15.151:0/538565549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 msgr2=0x5610dddc3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.517+0000 7f46c579a700 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc3f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.517+0000 7f46c579a700 1 -- 172.21.15.151:0/538565549 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610ddb43d80 con 0x5610dddca660 2023-07-21T22:59:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.517+0000 7f46c5f9b700 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T22:59:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.517+0000 7f46c679c700 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:59:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.517+0000 7f46b6ffd700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f46ac0a1490 0x7f46ac0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.518+0000 7f46c579a700 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddc44a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f46b00ca470 tx=0x7f46b00d0ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbe7dee7b81a991f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.518+0000 7f46b6ffd700 1 -- 172.21.15.151:0/800440864 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f46b0014070 con 0x7f46c0112930 2023-07-21T22:59:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.518+0000 7f46abfff700 1 -- 172.21.15.151:0/538565549 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b00d2050 con 0x5610dddca660 2023-07-21T22:59:32.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.518+0000 7f46c679c700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f46ac0a1490 0x7f46ac0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.518+0000 7f46abfff700 1 -- 172.21.15.151:0/538565549 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46b0096130 con 0x5610dddca660 2023-07-21T22:59:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.518+0000 7f46abfff700 1 -- 172.21.15.151:0/538565549 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0099930 con 0x5610dddca660 2023-07-21T22:59:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.519+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/538565549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 msgr2=0x5610dddc44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.519+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddc44a0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7f46b00ca470 tx=0x7f46b00d0ac0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.519+0000 7f46c679c700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f46ac0a1490 0x7f46ac0a3940 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f46c0069880 tx=0x7f46b8009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.519+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/538565549 shutdown_connections 2023-07-21T22:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.519+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddc44a0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.519+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.519+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/538565549 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.519+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/538565549 >> 172.21.15.151:0/538565549 conn(0x5610dddb9ae0 msgr2=0x5610dddbf0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:32.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.520+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/538565549 shutdown_connections 2023-07-21T22:59:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.520+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/538565549 wait complete. 2023-07-21T22:59:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.521+0000 7f46dbbd8b80 1 -- start start 2023-07-21T22:59:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.521+0000 7f46dbbd8b80 1 Processor -- start 2023-07-21T22:59:32.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.522+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddd0590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.522+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddcd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.522+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddcdf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.522+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ddcb5a60 con 0x5610dddca660 2023-07-21T22:59:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.522+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ddcb5760 con 0x5610dddca210 2023-07-21T22:59:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.522+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610ddb998c0 con 0x5610ddc206b0 2023-07-21T22:59:32.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.522+0000 7f46dbbd8b80 10 client.0 _ll_register_callbacks cb 0x5610ddcb3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.523+0000 7f46c679c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddcdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.523+0000 7f46c679c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddcdf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39646/0 (socket says 172.21.15.151:39646) 2023-07-21T22:59:32.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.523+0000 7f46c679c700 1 -- 172.21.15.151:0/3523083898 learned_addr learned my addr 172.21.15.151:0/3523083898 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.524+0000 7f46c5f9b700 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddd0590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.524+0000 7f46c679c700 1 -- 172.21.15.151:0/3523083898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 msgr2=0x5610dddd0590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.524+0000 7f46c679c700 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddd0590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.524+0000 7f46c679c700 1 -- 172.21.15.151:0/3523083898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 msgr2=0x5610dddcd880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.524+0000 7f46c679c700 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddcd880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.524+0000 7f46c679c700 1 -- 172.21.15.151:0/3523083898 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c0108b10 con 0x5610dddca660 2023-07-21T22:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.525+0000 7f46c679c700 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddcdf20 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009870 tx=0x7f46b8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf1d1ea88551e5b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.525+0000 7f46a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.526+0000 7f46a97fa700 1 -- 172.21.15.151:0/3523083898 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b801e830 con 0x5610dddca660 2023-07-21T22:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.526+0000 7f46a97fa700 1 -- 172.21.15.151:0/3523083898 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f46b801e990 con 0x5610dddca660 2023-07-21T22:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.526+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/3523083898 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610ddc6f490 con 0x5610dddca660 2023-07-21T22:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.527+0000 7f46a97fa700 1 -- 172.21.15.151:0/3523083898 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46b801eb50 con 0x5610dddca660 2023-07-21T22:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.527+0000 7f46dbbd8b80 10 client.19440 fetch_fsmap learned FSMap version 112 2023-07-21T22:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.527+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/3523083898 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x7f46c0120c40 con 0x5610dddca660 2023-07-21T22:59:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.528+0000 7f46a97fa700 1 -- 172.21.15.151:0/3523083898 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5610ddc6f490 con 0x5610dddca660 2023-07-21T22:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.528+0000 7f46a97fa700 1 -- 172.21.15.151:0/3523083898 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 112) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f46b8027420 con 0x5610dddca660 2023-07-21T22:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.528+0000 7f46dbbd8b80 10 client.19440 fetch_fsmap finished waiting for FSMap version 112 2023-07-21T22:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.528+0000 7f46dbbd8b80 10 client.19440 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.528+0000 7f46dbbd8b80 20 client.19440 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.528+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5610dddddab0 0x5610ddddfec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.528+0000 7f46dbbd8b80 4 client.19440 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:59:32.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.528+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/3523083898 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5610ddd0ee50 con 0x5610dddddab0 2023-07-21T22:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.531+0000 7f46c5f9b700 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5610dddddab0 0x5610ddddfec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.532+0000 7f46c5f9b700 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5610dddddab0 0x5610ddddfec0 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=928dfff087066ee4 server_cookie=9f4d844eb71f1ac9 in_seq=0 out_seq=0 2023-07-21T22:59:32.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.532+0000 7f46a97fa700 10 client.19440 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.533+0000 7f46a97fa700 1 -- 172.21.15.151:0/3523083898 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5610ddd0ee50 con 0x5610dddddab0 2023-07-21T22:59:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.533+0000 7f46a97fa700 10 client.19440 handle_command_reply: tid=0 2023-07-21T22:59:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.533+0000 7f46dbbd8b80 1 client.19440 shutdown 2023-07-21T22:59:32.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.537+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/3523083898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 msgr2=0x5610dddcdf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:32.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.537+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddcdf20 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009870 tx=0x7f46b8004750 comp rx=0 tx=0).stop 2023-07-21T22:59:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.538+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/3523083898 shutdown_connections 2023-07-21T22:59:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.538+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5610dddddab0 0x5610ddddfec0 crc :-1 s=READY pgs=459 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.538+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddca660 0x5610dddcdf20 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.538+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddd0590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.538+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/3523083898 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddcd880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.538+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/3523083898 >> 172.21.15.151:0/3523083898 conn(0x5610dddb9ae0 msgr2=0x5610dddbe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.538+0000 7f46a97fa700 0 client.19440 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:32.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.538+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/3523083898 shutdown_connections 2023-07-21T22:59:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.539+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/3523083898 wait complete. 2023-07-21T22:59:32.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.539+0000 7f46dbbd8b80 20 client.19440 trim_cache size 0 max 16384 2023-07-21T22:59:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.567+0000 7f46dbbd8b80 1 Processor -- start 2023-07-21T22:59:32.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.567+0000 7f46dbbd8b80 1 -- start start 2023-07-21T22:59:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.567+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddb9ae0 0x5610dddd4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.567+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.567+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddcb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.567+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610dddce280 con 0x5610dddb9ae0 2023-07-21T22:59:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.567+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610dddce520 con 0x5610dddca210 2023-07-21T22:59:32.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.567+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610dddc0760 con 0x5610ddc206b0 2023-07-21T22:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c5f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddb9ae0 0x5610dddd4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c679c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddcb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c679c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddcb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55358/0 (socket says 172.21.15.151:55358) 2023-07-21T22:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c5f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddb9ae0 0x5610dddd4ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39650/0 (socket says 172.21.15.151:39650) 2023-07-21T22:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c679c700 1 -- 172.21.15.151:0/1243793170 learned_addr learned my addr 172.21.15.151:0/1243793170 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:32.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c579a700 1 --2- 172.21.15.151:0/1243793170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c579a700 1 -- 172.21.15.151:0/1243793170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 msgr2=0x5610dddcb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c579a700 1 --2- 172.21.15.151:0/1243793170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddcb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c579a700 1 -- 172.21.15.151:0/1243793170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddb9ae0 msgr2=0x5610dddd4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:32.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c579a700 1 --2- 172.21.15.151:0/1243793170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddb9ae0 0x5610dddd4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.568+0000 7f46c579a700 1 -- 172.21.15.151:0/1243793170 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5610ddb2cc00 con 0x5610ddc206b0 2023-07-21T22:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.569+0000 7f46c579a700 1 --2- 172.21.15.151:0/1243793170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc3f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f46b000f010 tx=0x7f46b000e940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16b07aa85dc80722 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.569+0000 7f46b4ff9700 1 -- 172.21.15.151:0/1243793170 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b0099750 con 0x5610ddc206b0 2023-07-21T22:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.569+0000 7f46b4ff9700 1 -- 172.21.15.151:0/1243793170 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f46b00d0730 con 0x5610ddc206b0 2023-07-21T22:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.569+0000 7f46b4ff9700 1 -- 172.21.15.151:0/1243793170 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46b000cdc0 con 0x5610ddc206b0 2023-07-21T22:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.570+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/1243793170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 msgr2=0x5610dddc3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:32.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.570+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/1243793170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc3f40 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f46b000f010 tx=0x7f46b000e940 comp rx=0 tx=0).stop 2023-07-21T22:59:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.572+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/1243793170 shutdown_connections 2023-07-21T22:59:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.572+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/1243793170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddcb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.572+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/1243793170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610dddb9ae0 0x5610dddd4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.572+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/1243793170 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610ddc206b0 0x5610dddc3f40 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.572+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/1243793170 >> 172.21.15.151:0/1243793170 conn(0x5610dddd0520 msgr2=0x5610dddcaa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.573+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/1243793170 shutdown_connections 2023-07-21T22:59:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.573+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/1243793170 wait complete. 2023-07-21T22:59:32.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.573+0000 7f46dbbd8b80 1 -- start start 2023-07-21T22:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.574+0000 7f46dbbd8b80 1 Processor -- start 2023-07-21T22:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.574+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610ddc206b0 0x5610dddd4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.574+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610dddb9ae0 0x5610dddc57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.574+0000 7f46dbbd8b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.574+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610dddc6270 con 0x5610ddc206b0 2023-07-21T22:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.574+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610dddc63e0 con 0x5610dddca210 2023-07-21T22:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.574+0000 7f46dbbd8b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5610dddc65a0 con 0x5610dddb9ae0 2023-07-21T22:59:32.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.575+0000 7f46dbbd8b80 10 client.0 _ll_register_callbacks cb 0x7f46b8009f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.575+0000 7f46c5f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610ddc206b0 0x5610dddd4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.575+0000 7f46c5f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610ddc206b0 0x5610dddd4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39654/0 (socket says 172.21.15.151:39654) 2023-07-21T22:59:32.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.575+0000 7f46c5f9b700 1 -- 172.21.15.151:0/298419811 learned_addr learned my addr 172.21.15.151:0/298419811 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.575+0000 7f46c679c700 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46c5f9b700 1 -- 172.21.15.151:0/298419811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610dddb9ae0 msgr2=0x5610dddc57f0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46c5f9b700 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610dddb9ae0 0x5610dddc57f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46c5f9b700 1 -- 172.21.15.151:0/298419811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 msgr2=0x5610dddc5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46c5f9b700 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46c5f9b700 1 -- 172.21.15.151:0/298419811 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5610ddb43d80 con 0x5610ddc206b0 2023-07-21T22:59:32.611 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46c5f9b700 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610ddc206b0 0x5610dddd4bb0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00b370 tx=0x7f46bc0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f1349ca5a5862c0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46a97fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T22:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46a97fa700 1 -- 172.21.15.151:0/298419811 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46bc022040 con 0x5610ddc206b0 2023-07-21T22:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46a97fa700 1 -- 172.21.15.151:0/298419811 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f46bc007a60 con 0x5610ddc206b0 2023-07-21T22:59:32.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.576+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/298419811 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5610ddcd0ff0 con 0x5610ddc206b0 2023-07-21T22:59:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.577+0000 7f46a97fa700 1 -- 172.21.15.151:0/298419811 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46bc00e040 con 0x5610ddc206b0 2023-07-21T22:59:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.577+0000 7f46dbbd8b80 10 client.19446 fetch_fsmap learned FSMap version 112 2023-07-21T22:59:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.577+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/298419811 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x5610ddb6a1f0 con 0x5610ddc206b0 2023-07-21T22:59:32.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.577+0000 7f46a97fa700 1 -- 172.21.15.151:0/298419811 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5610ddcd0ff0 con 0x5610ddc206b0 2023-07-21T22:59:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.578+0000 7f46a97fa700 1 -- 172.21.15.151:0/298419811 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 112) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f46bc00b050 con 0x5610ddc206b0 2023-07-21T22:59:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.578+0000 7f46dbbd8b80 10 client.19446 fetch_fsmap finished waiting for FSMap version 112 2023-07-21T22:59:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.578+0000 7f46dbbd8b80 10 client.19446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.578+0000 7f46dbbd8b80 20 client.19446 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.578+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5610dddca660 0x5610dde34e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.578+0000 7f46dbbd8b80 4 client.19446 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:59:32.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.578+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/298419811 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5610ddb64f10 con 0x5610dddca660 2023-07-21T22:59:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.578+0000 7f46c579a700 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5610dddca660 0x5610dde34e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.579+0000 7f46a97fa700 10 client.19446 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:32.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.579+0000 7f46c579a700 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5610dddca660 0x5610dde34e80 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17bcaa116790778f server_cookie=9cf4d319a6cdc00f in_seq=0 out_seq=0 2023-07-21T22:59:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.620+0000 7f46a97fa700 1 -- 172.21.15.151:0/298419811 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5610ddb64f10 con 0x5610dddca660 2023-07-21T22:59:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.620+0000 7f46a97fa700 10 client.19446 handle_command_reply: tid=0 2023-07-21T22:59:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.620+0000 7f46dbbd8b80 1 client.19446 shutdown 2023-07-21T22:59:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.621+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/298419811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610ddc206b0 msgr2=0x5610dddd4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.621+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610ddc206b0 0x5610dddd4bb0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f46bc00b370 tx=0x7f46bc0096c0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.623+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/298419811 shutdown_connections 2023-07-21T22:59:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.623+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5610dddca660 0x5610dde34e80 crc :-1 s=READY pgs=460 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.623+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5610dddca210 0x5610dddc5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.623+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5610ddc206b0 0x5610dddd4bb0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.623+0000 7f46dbbd8b80 1 --2- 172.21.15.151:0/298419811 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5610dddb9ae0 0x5610dddc57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.623+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/298419811 >> 172.21.15.151:0/298419811 conn(0x5610dddd0520 msgr2=0x5610dddcb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.623+0000 7f46a97fa700 0 client.19446 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.624+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/298419811 shutdown_connections 2023-07-21T22:59:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.624+0000 7f46dbbd8b80 1 -- 172.21.15.151:0/298419811 wait complete. 2023-07-21T22:59:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.625+0000 7f46dbbd8b80 20 client.19446 trim_cache size 0 max 16384 2023-07-21T22:59:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:59:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:59:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:59:32.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:59:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 -- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f46ac0a1490 msgr2=0x7f46ac0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f46ac0a1490 0x7f46ac0a3940 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f46c0069880 tx=0x7f46b8009260 comp rx=0 tx=0).stop 2023-07-21T22:59:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 -- 172.21.15.151:0/800440864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0112930 msgr2=0x7f46c0118470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0112930 0x7f46c0118470 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f46b000e9c0 tx=0x7f46b000ecd0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 -- 172.21.15.151:0/800440864 shutdown_connections 2023-07-21T22:59:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f46ac0a1490 0x7f46ac0a3940 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46c006cd70 0x7f46c0117f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f46c011d6b0 0x7f46c011db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 --2- 172.21.15.151:0/800440864 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f46c0112930 0x7f46c0118470 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.626+0000 7f46c81ff700 1 -- 172.21.15.151:0/800440864 >> 172.21.15.151:0/800440864 conn(0x7f46c006bd70 msgr2=0x7f46c0117120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:32.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.627+0000 7f46c81ff700 1 -- 172.21.15.151:0/800440864 shutdown_connections 2023-07-21T22:59:32.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:32.627+0000 7f46c81ff700 1 -- 172.21.15.151:0/800440864 wait complete. 2023-07-21T22:59:33.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:32 smithi151 ceph-mon[95510]: pgmap v1285: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 631 op/s 2023-07-21T22:59:33.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:32 smithi187 ceph-mon[96918]: pgmap v1285: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 631 op/s 2023-07-21T22:59:33.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:32 smithi195 ceph-mon[97365]: pgmap v1285: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 6.6 MiB/s wr, 631 op/s 2023-07-21T22:59:34.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 400.0 s, 372.2 tps, lat 270.902 ms stddev 66.016 2023-07-21T22:59:35.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:34 smithi151 ceph-mon[95510]: pgmap v1286: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-07-21T22:59:35.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:34 smithi187 ceph-mon[96918]: pgmap v1286: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-07-21T22:59:35.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:34 smithi195 ceph-mon[97365]: pgmap v1286: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-07-21T22:59:37.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:36 smithi187 ceph-mon[96918]: pgmap v1287: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.5 MiB/s wr, 848 op/s 2023-07-21T22:59:37.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:36 smithi195 ceph-mon[97365]: pgmap v1287: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.5 MiB/s wr, 848 op/s 2023-07-21T22:59:37.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:36 smithi151 ceph-mon[95510]: pgmap v1287: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.5 MiB/s wr, 848 op/s 2023-07-21T22:59:39.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 405.0 s, 362.8 tps, lat 276.202 ms stddev 82.784 2023-07-21T22:59:39.372 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:38 smithi187 ceph-mon[96918]: pgmap v1288: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 1.31k op/s 2023-07-21T22:59:39.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:38 smithi195 ceph-mon[97365]: pgmap v1288: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 1.31k op/s 2023-07-21T22:59:39.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:38 smithi151 ceph-mon[95510]: pgmap v1288: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 13 MiB/s wr, 1.31k op/s 2023-07-21T22:59:40.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:39 smithi187 ceph-mon[96918]: pgmap v1289: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.5 MiB/s wr, 953 op/s 2023-07-21T22:59:40.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:39 smithi195 ceph-mon[97365]: pgmap v1289: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.5 MiB/s wr, 953 op/s 2023-07-21T22:59:40.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:39 smithi151 ceph-mon[95510]: pgmap v1289: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.5 MiB/s wr, 953 op/s 2023-07-21T22:59:43.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:42 smithi151 ceph-mon[95510]: pgmap v1290: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.5 MiB/s wr, 953 op/s 2023-07-21T22:59:43.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:42 smithi187 ceph-mon[96918]: pgmap v1290: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.5 MiB/s wr, 953 op/s 2023-07-21T22:59:43.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:42 smithi195 ceph-mon[97365]: pgmap v1290: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 9.5 MiB/s wr, 953 op/s 2023-07-21T22:59:44.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 410.0 s, 298.2 tps, lat 330.407 ms stddev 120.744 2023-07-21T22:59:45.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:44 smithi151 ceph-mon[95510]: pgmap v1291: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T22:59:45.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:44 smithi187 ceph-mon[96918]: pgmap v1291: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T22:59:45.400 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:44 smithi195 ceph-mon[97365]: pgmap v1291: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T22:59:45.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.870+0000 7f2de93ff700 1 -- 172.21.15.151:0/3004596753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40731c0 msgr2=0x7f2de41105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.870+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3004596753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40731c0 0x7f2de41105d0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009990 tx=0x7f2dd8009ca0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.871+0000 7f2de93ff700 1 -- 172.21.15.151:0/3004596753 shutdown_connections 2023-07-21T22:59:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.871+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3004596753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de40728b0 0x7f2de4072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.871+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3004596753 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de4110b10 0x7f2de4112ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.871+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3004596753 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40731c0 0x7f2de41105d0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.871+0000 7f2de93ff700 1 -- 172.21.15.151:0/3004596753 >> 172.21.15.151:0/3004596753 conn(0x7f2de40fb600 msgr2=0x7f2de40fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.876+0000 7f2de93ff700 1 -- 172.21.15.151:0/3004596753 shutdown_connections 2023-07-21T22:59:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.876+0000 7f2de93ff700 1 -- 172.21.15.151:0/3004596753 wait complete. 2023-07-21T22:59:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.878+0000 7f2de93ff700 1 Processor -- start 2023-07-21T22:59:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.878+0000 7f2de93ff700 1 -- start start 2023-07-21T22:59:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de93ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40728b0 0x7f2de4071b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de93ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de40731c0 0x7f2de4072090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de93ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de4110b10 0x7f2de406a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de93ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de406b200 con 0x7f2de4110b10 2023-07-21T22:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de93ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de406b370 con 0x7f2de40731c0 2023-07-21T22:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de93ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2de406b530 con 0x7f2de40728b0 2023-07-21T22:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de40731c0 0x7f2de4072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de40731c0 0x7f2de4072090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60812/0 (socket says 172.21.15.151:60812) 2023-07-21T22:59:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de27fc700 1 -- 172.21.15.151:0/3085462292 learned_addr learned my addr 172.21.15.151:0/3085462292 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.879+0000 7f2de2ffd700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40728b0 0x7f2de4071b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.880+0000 7f2de37fe700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de4110b10 0x7f2de406a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.880+0000 7f2de2ffd700 1 -- 172.21.15.151:0/3085462292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de40731c0 msgr2=0x7f2de4072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.880+0000 7f2de2ffd700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de40731c0 0x7f2de4072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.880+0000 7f2de2ffd700 1 -- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de4110b10 msgr2=0x7f2de406a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.880+0000 7f2de2ffd700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de4110b10 0x7f2de406a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.880+0000 7f2de2ffd700 1 -- 172.21.15.151:0/3085462292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dd80095f0 con 0x7f2de40728b0 2023-07-21T22:59:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.881+0000 7f2de2ffd700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40728b0 0x7f2de4071b10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400e9f0 tx=0x7f2dd400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:45.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.883+0000 7f2dcbfff700 1 -- 172.21.15.151:0/3085462292 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd40096d0 con 0x7f2de40728b0 2023-07-21T22:59:45.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.883+0000 7f2dcbfff700 1 -- 172.21.15.151:0/3085462292 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2dd400cbd0 con 0x7f2de40728b0 2023-07-21T22:59:45.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.883+0000 7f2de93ff700 1 -- 172.21.15.151:0/3085462292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2de406f6a0 con 0x7f2de40728b0 2023-07-21T22:59:45.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.883+0000 7f2de93ff700 1 -- 172.21.15.151:0/3085462292 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de406fbb0 con 0x7f2de40728b0 2023-07-21T22:59:45.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.883+0000 7f2dcbfff700 1 -- 172.21.15.151:0/3085462292 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd4018680 con 0x7f2de40728b0 2023-07-21T22:59:45.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.890+0000 7f2dfcc4ab80 1 Processor -- start 2023-07-21T22:59:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.891+0000 7f2dfcc4ab80 1 -- start start 2023-07-21T22:59:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.891+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 0x5642dd21ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.891+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d210 0x5642dd216f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.891+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd21d660 0x5642dd2174a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.891+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd11cc50 con 0x5642dd21d210 2023-07-21T22:59:45.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.891+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd16f9e0 con 0x5642dd0736b0 2023-07-21T22:59:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.891+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd168e70 con 0x5642dd21d660 2023-07-21T22:59:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.892+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd21d660 0x5642dd2174a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.892+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd21d660 0x5642dd2174a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47584/0 (socket says 172.21.15.151:47584) 2023-07-21T22:59:45.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.892+0000 7f2de27fc700 1 -- 172.21.15.151:0/1066433645 learned_addr learned my addr 172.21.15.151:0/1066433645 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:45.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.892+0000 7f2de37fe700 1 --2- 172.21.15.151:0/1066433645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 0x5642dd21ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.892+0000 7f2de27fc700 1 -- 172.21.15.151:0/1066433645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 msgr2=0x5642dd21ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:45.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.892+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1066433645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 0x5642dd21ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.892+0000 7f2de27fc700 1 -- 172.21.15.151:0/1066433645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d210 msgr2=0x5642dd216f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:59:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.892+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1066433645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d210 0x5642dd216f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.892+0000 7f2de27fc700 1 -- 172.21.15.151:0/1066433645 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642dcf96d80 con 0x5642dd21d660 2023-07-21T22:59:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.893+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1066433645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd21d660 0x5642dd2174a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8005f40 tx=0x7f2dd8005c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ac382352024fe98c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:45.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.894+0000 7f2dcbfff700 1 -- 172.21.15.151:0/3085462292 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2dd400cd40 con 0x7f2de40728b0 2023-07-21T22:59:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.896+0000 7f2dcbfff700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2dcc0a1490 0x7f2dcc0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.897+0000 7f2dcbfff700 1 -- 172.21.15.151:0/3085462292 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2dd4014070 con 0x7f2de40728b0 2023-07-21T22:59:45.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.897+0000 7f2de37fe700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2dcc0a1490 0x7f2dcc0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.899+0000 7f2dc97fa700 1 -- 172.21.15.151:0/1066433645 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd801d070 con 0x5642dd21d660 2023-07-21T22:59:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.899+0000 7f2dc97fa700 1 -- 172.21.15.151:0/1066433645 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2dd801e040 con 0x5642dd21d660 2023-07-21T22:59:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.899+0000 7f2dc97fa700 1 -- 172.21.15.151:0/1066433645 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd8004ab0 con 0x5642dd21d660 2023-07-21T22:59:45.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.899+0000 7f2de37fe700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2dcc0a1490 0x7f2dcc0a3940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2de4069ab0 tx=0x7f2ddc009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.900+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1066433645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd21d660 msgr2=0x5642dd2174a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.900+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1066433645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd21d660 0x5642dd2174a0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8005f40 tx=0x7f2dd8005c60 comp rx=0 tx=0).stop 2023-07-21T22:59:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.900+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1066433645 shutdown_connections 2023-07-21T22:59:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.900+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1066433645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 0x5642dd21ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.900+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1066433645 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd21d660 0x5642dd2174a0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.900+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1066433645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d210 0x5642dd216f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.900+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1066433645 >> 172.21.15.151:0/1066433645 conn(0x5642dd20cae0 msgr2=0x5642dd2120e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.902+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1066433645 shutdown_connections 2023-07-21T22:59:45.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.902+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1066433645 wait complete. 2023-07-21T22:59:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.903+0000 7f2dfcc4ab80 1 -- start start 2023-07-21T22:59:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.903+0000 7f2dfcc4ab80 1 Processor -- start 2023-07-21T22:59:45.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.904+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd0736b0 0x5642dd223570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.904+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd2207f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.904+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d660 0x5642dd220e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.904+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd108a60 con 0x5642dd21d660 2023-07-21T22:59:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.904+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd108760 con 0x5642dd21d210 2023-07-21T22:59:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.904+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dcfec8c0 con 0x5642dd0736b0 2023-07-21T22:59:45.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.904+0000 7f2dfcc4ab80 10 client.0 _ll_register_callbacks cb 0x5642dd106700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.905+0000 7f2de37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d660 0x5642dd220e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.905+0000 7f2de37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d660 0x5642dd220e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56358/0 (socket says 172.21.15.151:56358) 2023-07-21T22:59:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.905+0000 7f2de37fe700 1 -- 172.21.15.151:0/1327553229 learned_addr learned my addr 172.21.15.151:0/1327553229 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.905+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd2207f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.905+0000 7f2de27fc700 1 -- 172.21.15.151:0/1327553229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd0736b0 msgr2=0x5642dd223570 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T22:59:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.905+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd0736b0 0x5642dd223570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.905+0000 7f2de27fc700 1 -- 172.21.15.151:0/1327553229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d660 msgr2=0x5642dd220e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.905+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d660 0x5642dd220e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.905+0000 7f2de27fc700 1 -- 172.21.15.151:0/1327553229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2de41137b0 con 0x5642dd21d210 2023-07-21T22:59:45.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.906+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd2207f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x5642dd21da70 tx=0x7f2dd800be70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bac57e5f0cde196 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.906+0000 7f2dc6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:59:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.908+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1327553229 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd801d040 con 0x5642dd21d210 2023-07-21T22:59:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.909+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1327553229 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2dd8004710 con 0x5642dd21d210 2023-07-21T22:59:45.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.909+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1327553229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5642dd0c2490 con 0x5642dd21d210 2023-07-21T22:59:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.909+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1327553229 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dd8004930 con 0x5642dd21d210 2023-07-21T22:59:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.910+0000 7f2dfcc4ab80 10 client.29141 fetch_fsmap learned FSMap version 112 2023-07-21T22:59:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.910+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1327553229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x5642dcf7fc00 con 0x5642dd21d210 2023-07-21T22:59:45.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.910+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1327553229 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5642dd0c2490 con 0x5642dd21d210 2023-07-21T22:59:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.911+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1327553229 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 112) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2dd800fb70 con 0x5642dd21d210 2023-07-21T22:59:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.911+0000 7f2dfcc4ab80 10 client.29141 fetch_fsmap finished waiting for FSMap version 112 2023-07-21T22:59:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.911+0000 7f2dfcc4ab80 10 client.29141 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:45.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.911+0000 7f2dfcc4ab80 20 client.29141 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.911+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642dd230620 0x5642dd232a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.911+0000 7f2dfcc4ab80 4 client.29141 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:59:45.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.911+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1327553229 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5642dd161e50 con 0x5642dd230620 2023-07-21T22:59:45.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.913+0000 7f2de2ffd700 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642dd230620 0x5642dd232a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.914+0000 7f2de2ffd700 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642dd230620 0x5642dd232a30 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d93b1e5e0bbe78a server_cookie=ba0e1e4c01987201 in_seq=0 out_seq=0 2023-07-21T22:59:45.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.914+0000 7f2dc6ff5700 10 client.29141 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.915+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1327553229 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5642dd161e50 con 0x5642dd230620 2023-07-21T22:59:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.915+0000 7f2dc6ff5700 10 client.29141 handle_command_reply: tid=0 2023-07-21T22:59:45.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.915+0000 7f2dfcc4ab80 1 client.29141 shutdown 2023-07-21T22:59:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.917+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1327553229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 msgr2=0x5642dd2207f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.917+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd2207f0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x5642dd21da70 tx=0x7f2dd800be70 comp rx=0 tx=0).stop 2023-07-21T22:59:45.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.918+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1327553229 shutdown_connections 2023-07-21T22:59:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.918+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642dd230620 0x5642dd232a30 crc :-1 s=READY pgs=461 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.918+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d660 0x5642dd220e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.918+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd0736b0 0x5642dd223570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.918+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1327553229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd2207f0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.918+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1327553229 >> 172.21.15.151:0/1327553229 conn(0x5642dd20cae0 msgr2=0x5642dd2113e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.918+0000 7f2dc6ff5700 0 client.29141 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:45.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.918+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1327553229 shutdown_connections 2023-07-21T22:59:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.918+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1327553229 wait complete. 2023-07-21T22:59:45.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.919+0000 7f2dfcc4ab80 20 client.29141 trim_cache size 0 max 16384 2023-07-21T22:59:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.949+0000 7f2dfcc4ab80 1 Processor -- start 2023-07-21T22:59:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.949+0000 7f2dfcc4ab80 1 -- start start 2023-07-21T22:59:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.949+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd216f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.949+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd0736b0 0x5642dd227ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.949+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd223110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.949+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd221900 con 0x5642dd0736b0 2023-07-21T22:59:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.949+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd213760 con 0x5642dd21d210 2023-07-21T22:59:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.949+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd217480 con 0x5642dd20cae0 2023-07-21T22:59:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.950+0000 7f2de2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd216f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.950+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd0736b0 0x5642dd227ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.950+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd0736b0 0x5642dd227ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56360/0 (socket says 172.21.15.151:56360) 2023-07-21T22:59:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.950+0000 7f2de27fc700 1 -- 172.21.15.151:0/1661182782 learned_addr learned my addr 172.21.15.151:0/1661182782 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.951+0000 7f2de37fe700 1 --2- 172.21.15.151:0/1661182782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd223110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.951+0000 7f2de27fc700 1 -- 172.21.15.151:0/1661182782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 msgr2=0x5642dd216f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.951+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1661182782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd216f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.951+0000 7f2de27fc700 1 -- 172.21.15.151:0/1661182782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 msgr2=0x5642dd223110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.951+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1661182782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd223110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.951+0000 7f2de27fc700 1 -- 172.21.15.151:0/1661182782 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5642dcfbd1f0 con 0x5642dd0736b0 2023-07-21T22:59:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.951+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1661182782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd0736b0 0x5642dd227ba0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c010 tx=0x7f2dd8005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a07fd525cf236c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.954+0000 7f2de37fe700 1 --2- 172.21.15.151:0/1661182782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd223110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T22:59:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.954+0000 7f2dc9ffb700 1 -- 172.21.15.151:0/1661182782 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd801d040 con 0x5642dd0736b0 2023-07-21T22:59:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.954+0000 7f2dc9ffb700 1 -- 172.21.15.151:0/1661182782 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2dd8005bc0 con 0x5642dd0736b0 2023-07-21T22:59:45.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.954+0000 7f2dc9ffb700 1 -- 172.21.15.151:0/1661182782 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd802da40 con 0x5642dd0736b0 2023-07-21T22:59:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.955+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1661182782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd0736b0 msgr2=0x5642dd227ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.955+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1661182782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd0736b0 0x5642dd227ba0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f2dd800c010 tx=0x7f2dd8005a90 comp rx=0 tx=0).stop 2023-07-21T22:59:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.955+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1661182782 shutdown_connections 2023-07-21T22:59:45.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.955+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1661182782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd21d210 0x5642dd223110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.955+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1661182782 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd216f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.955+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1661182782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd0736b0 0x5642dd227ba0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.955+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1661182782 >> 172.21.15.151:0/1661182782 conn(0x5642dd22d0a0 msgr2=0x5642dd21a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.956+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1661182782 shutdown_connections 2023-07-21T22:59:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.956+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1661182782 wait complete. 2023-07-21T22:59:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.956+0000 7f2dfcc4ab80 1 -- start start 2023-07-21T22:59:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.957+0000 7f2dfcc4ab80 1 Processor -- start 2023-07-21T22:59:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 0x5642dd21efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd21f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2dfcc4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d210 0x5642dd21fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd21fff0 con 0x5642dd21d210 2023-07-21T22:59:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd220160 con 0x5642dd0736b0 2023-07-21T22:59:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2dfcc4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5642dd220320 con 0x5642dd20cae0 2023-07-21T22:59:45.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2dfcc4ab80 10 client.0 _ll_register_callbacks cb 0x7f2dd8005e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd21f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2de27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd21f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:47596/0 (socket says 172.21.15.151:47596) 2023-07-21T22:59:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2de27fc700 1 -- 172.21.15.151:0/1373266698 learned_addr learned my addr 172.21.15.151:0/1373266698 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.958+0000 7f2de2ffd700 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 0x5642dd21efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.959+0000 7f2de27fc700 1 -- 172.21.15.151:0/1373266698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 msgr2=0x5642dd21efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.959+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 0x5642dd21efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.959+0000 7f2de27fc700 1 -- 172.21.15.151:0/1373266698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d210 msgr2=0x5642dd21fa20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T22:59:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.959+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d210 0x5642dd21fa20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.959+0000 7f2de27fc700 1 -- 172.21.15.151:0/1373266698 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5642dcf7fc00 con 0x5642dd20cae0 2023-07-21T22:59:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.959+0000 7f2de27fc700 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd21f4e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8005d70 tx=0x7f2dd8005a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3aae94c54c98d115 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.959+0000 7f2dc6ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:59:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.960+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1373266698 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dd801d040 con 0x5642dd20cae0 2023-07-21T22:59:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.960+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1373266698 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2dd8000e40 con 0x5642dd20cae0 2023-07-21T22:59:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.960+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1373266698 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2dd801e040 con 0x5642dd20cae0 2023-07-21T22:59:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.960+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1373266698 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2dd802d7e0 con 0x5642dd20cae0 2023-07-21T22:59:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.960+0000 7f2dfcc4ab80 10 client.29152 fetch_fsmap learned FSMap version 112 2023-07-21T22:59:45.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.960+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1373266698 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=4+}) v3 -- 0x5642dcf95250 con 0x5642dd20cae0 2023-07-21T22:59:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.961+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1373266698 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2dd801e040 con 0x5642dd20cae0 2023-07-21T22:59:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.961+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1373266698 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 112) v1 ==== 7478+0+0 (secure 0 0 0) 0x7f2dd8048070 con 0x5642dd20cae0 2023-07-21T22:59:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.961+0000 7f2dfcc4ab80 10 client.29152 fetch_fsmap finished waiting for FSMap version 112 2023-07-21T22:59:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.961+0000 7f2dfcc4ab80 10 client.29152 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:45.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.961+0000 7f2dfcc4ab80 20 client.29152 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.961+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642dd21d660 0x5642dd286b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.961+0000 7f2dfcc4ab80 4 client.29152 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:59:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.961+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1373266698 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5642dd123ff0 con 0x5642dd21d660 2023-07-21T22:59:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.962+0000 7f2de2ffd700 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642dd21d660 0x5642dd286b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.966+0000 7f2de2ffd700 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642dd21d660 0x5642dd286b50 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16065dc91fd54f58 server_cookie=2a1b03f97ed8811c in_seq=0 out_seq=0 2023-07-21T22:59:46.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:45.966+0000 7f2dc6ff5700 10 client.29152 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.011+0000 7f2dc6ff5700 1 -- 172.21.15.151:0/1373266698 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5642dd123ff0 con 0x5642dd21d660 2023-07-21T22:59:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.011+0000 7f2dc6ff5700 10 client.29152 handle_command_reply: tid=0 2023-07-21T22:59:46.045 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.011+0000 7f2dfcc4ab80 1 client.29152 shutdown 2023-07-21T22:59:46.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1373266698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 msgr2=0x5642dd21f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:46.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd21f4e0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8005d70 tx=0x7f2dd8005a00 comp rx=0 tx=0).stop 2023-07-21T22:59:46.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1373266698 shutdown_connections 2023-07-21T22:59:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5642dd21d660 0x5642dd286b50 crc :-1 s=READY pgs=462 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5642dd0736b0 0x5642dd21efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5642dd21d210 0x5642dd21fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dfcc4ab80 1 --2- 172.21.15.151:0/1373266698 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5642dd20cae0 0x5642dd21f4e0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1373266698 >> 172.21.15.151:0/1373266698 conn(0x5642dd22d0a0 msgr2=0x5642dd21da30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:46.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dc6ff5700 0 client.29152 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.018+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1373266698 shutdown_connections 2023-07-21T22:59:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.019+0000 7f2dfcc4ab80 1 -- 172.21.15.151:0/1373266698 wait complete. 2023-07-21T22:59:46.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.021+0000 7f2dfcc4ab80 20 client.29152 trim_cache size 0 max 16384 2023-07-21T22:59:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:59:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:59:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:59:46.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:59:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 -- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2dcc0a1490 msgr2=0x7f2dcc0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2dcc0a1490 0x7f2dcc0a3940 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f2de4069ab0 tx=0x7f2ddc009040 comp rx=0 tx=0).stop 2023-07-21T22:59:46.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 -- 172.21.15.151:0/3085462292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40728b0 msgr2=0x7f2de4071b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40728b0 0x7f2de4071b10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f2dd400e9f0 tx=0x7f2dd400ed00 comp rx=0 tx=0).stop 2023-07-21T22:59:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 -- 172.21.15.151:0/3085462292 shutdown_connections 2023-07-21T22:59:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2dcc0a1490 0x7f2dcc0a3940 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de4110b10 0x7f2de406a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2de40728b0 0x7f2de4071b10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 --2- 172.21.15.151:0/3085462292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2de40731c0 0x7f2de4072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:46.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 -- 172.21.15.151:0/3085462292 >> 172.21.15.151:0/3085462292 conn(0x7f2de40fb600 msgr2=0x7f2de40fc260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 -- 172.21.15.151:0/3085462292 shutdown_connections 2023-07-21T22:59:46.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:46.022+0000 7f2de93ff700 1 -- 172.21.15.151:0/3085462292 wait complete. 2023-07-21T22:59:47.371 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:46 smithi187 ceph-mon[96918]: pgmap v1292: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.1 MiB/s wr, 904 op/s 2023-07-21T22:59:47.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:46 smithi195 ceph-mon[97365]: pgmap v1292: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.1 MiB/s wr, 904 op/s 2023-07-21T22:59:47.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:46 smithi151 ceph-mon[95510]: pgmap v1292: 97 pgs: 97 active+clean; 12 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.1 MiB/s wr, 904 op/s 2023-07-21T22:59:49.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 415.0 s, 365.8 tps, lat 277.688 ms stddev 78.439 2023-07-21T22:59:49.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:48 smithi187 ceph-mon[96918]: pgmap v1293: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 13 MiB/s wr, 1.36k op/s 2023-07-21T22:59:49.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:48 smithi195 ceph-mon[97365]: pgmap v1293: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 13 MiB/s wr, 1.36k op/s 2023-07-21T22:59:49.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:48 smithi151 ceph-mon[95510]: pgmap v1293: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 13 MiB/s wr, 1.36k op/s 2023-07-21T22:59:50.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:49 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:59:50.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:49 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:59:50.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:49 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T22:59:51.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:50 smithi187 ceph-mon[96918]: pgmap v1294: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.8 MiB/s wr, 897 op/s 2023-07-21T22:59:51.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:50 smithi195 ceph-mon[97365]: pgmap v1294: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.8 MiB/s wr, 897 op/s 2023-07-21T22:59:51.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:50 smithi151 ceph-mon[95510]: pgmap v1294: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.8 MiB/s wr, 897 op/s 2023-07-21T22:59:52.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:51 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:59:52.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:51 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:59:52.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:51 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:59:52.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:51 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:59:52.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:51 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:59:52.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:51 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:59:52.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:51 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T22:59:52.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:51 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T22:59:52.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:51 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T22:59:53.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:52 smithi187 ceph-mon[96918]: pgmap v1295: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.8 MiB/s wr, 897 op/s 2023-07-21T22:59:53.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:52 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:59:53.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:52 smithi195 ceph-mon[97365]: pgmap v1295: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.8 MiB/s wr, 897 op/s 2023-07-21T22:59:53.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:52 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:59:53.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:52 smithi151 ceph-mon[95510]: pgmap v1295: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.8 MiB/s wr, 897 op/s 2023-07-21T22:59:53.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:52 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T22:59:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 420.0 s, 360.8 tps, lat 275.698 ms stddev 68.679 2023-07-21T22:59:54.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:53 smithi187 ceph-mon[96918]: pgmap v1296: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T22:59:54.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:53 smithi195 ceph-mon[97365]: pgmap v1296: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T22:59:54.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:53 smithi151 ceph-mon[95510]: pgmap v1296: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T22:59:57.117 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:56 smithi187 ceph-mon[96918]: pgmap v1297: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.8 MiB/s wr, 916 op/s 2023-07-21T22:59:57.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:56 smithi195 ceph-mon[97365]: pgmap v1297: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.8 MiB/s wr, 916 op/s 2023-07-21T22:59:57.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:56 smithi151 ceph-mon[95510]: pgmap v1297: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.8 MiB/s wr, 916 op/s 2023-07-21T22:59:59.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 22:59:58 smithi151 ceph-mon[95510]: pgmap v1298: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T22:59:59.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 425.0 s, 379.6 tps, lat 262.894 ms stddev 60.228 2023-07-21T22:59:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.276+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/1281213186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fb8067c10 msgr2=0x7f0fb8067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.276+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/1281213186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fb8067c10 0x7f0fb8067fe0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00099c0 tx=0x7f0fa0009cd0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.276+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/1281213186 shutdown_connections 2023-07-21T22:59:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.276+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/1281213186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fb8104e50 0x7f0fb810ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.276+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/1281213186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fb8067c10 0x7f0fb8067fe0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.276+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/1281213186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb80685b0 0x7f0fb8104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.276+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/1281213186 >> 172.21.15.151:0/1281213186 conn(0x7f0fb8074760 msgr2=0x7f0fb8074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.277+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/1281213186 shutdown_connections 2023-07-21T22:59:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.277+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/1281213186 wait complete. 2023-07-21T22:59:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.278+0000 7f0fbd1ff700 1 Processor -- start 2023-07-21T22:59:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.278+0000 7f0fbd1ff700 1 -- start start 2023-07-21T22:59:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fbd1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fb8067c10 0x7f0fb810b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fbd1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb80685b0 0x7f0fb810bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fbd1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fb8104e50 0x7f0fb81996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fbd1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8199d30 con 0x7f0fb8104e50 2023-07-21T22:59:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fbd1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb8199ea0 con 0x7f0fb80685b0 2023-07-21T22:59:59.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fbd1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb819a060 con 0x7f0fb8067c10 2023-07-21T22:59:59.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb80685b0 0x7f0fb810bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb80685b0 0x7f0fb810bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34386/0 (socket says 172.21.15.151:34386) 2023-07-21T22:59:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fae59c700 1 -- 172.21.15.151:0/3499497540 learned_addr learned my addr 172.21.15.151:0/3499497540 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fb8067c10 0x7f0fb810b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fb759e700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fb8104e50 0x7f0fb81996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fae59c700 1 -- 172.21.15.151:0/3499497540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fb8067c10 msgr2=0x7f0fb810b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fb8067c10 0x7f0fb810b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fae59c700 1 -- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fb8104e50 msgr2=0x7f0fb81996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fb8104e50 0x7f0fb81996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.279+0000 7f0fae59c700 1 -- 172.21.15.151:0/3499497540 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa00095f0 con 0x7f0fb80685b0 2023-07-21T22:59:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.280+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb80685b0 0x7f0fb810bde0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800e940 tx=0x7f0fa800ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.280+0000 7f0fb4d99700 1 -- 172.21.15.151:0/3499497540 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8009730 con 0x7f0fb80685b0 2023-07-21T22:59:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.280+0000 7f0fb4d99700 1 -- 172.21.15.151:0/3499497540 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fa800ee90 con 0x7f0fb80685b0 2023-07-21T22:59:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.280+0000 7f0fb4d99700 1 -- 172.21.15.151:0/3499497540 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8018420 con 0x7f0fb80685b0 2023-07-21T22:59:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.280+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/3499497540 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb819a340 con 0x7f0fb80685b0 2023-07-21T22:59:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.280+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/3499497540 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb819c990 con 0x7f0fb80685b0 2023-07-21T22:59:59.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.286+0000 7f0fb4d99700 1 -- 172.21.15.151:0/3499497540 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0fa800cbd0 con 0x7f0fb80685b0 2023-07-21T22:59:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.286+0000 7f0fd0b34b80 1 Processor -- start 2023-07-21T22:59:59.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.287+0000 7f0fd0b34b80 1 -- start start 2023-07-21T22:59:59.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.287+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f94fff7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.287+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f94fff1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.287+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94fff24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.287+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94fef7c50 con 0x55f94fe4e6b0 2023-07-21T22:59:59.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.287+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94ff4a9e0 con 0x55f94fff8210 2023-07-21T22:59:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.287+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94ff43e70 con 0x55f94fff8660 2023-07-21T22:59:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fb6d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f94fff1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fb6d9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f94fff1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34402/0 (socket says 172.21.15.151:34402) 2023-07-21T22:59:59.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fb6d9d700 1 -- 172.21.15.151:0/1368941882 learned_addr learned my addr 172.21.15.151:0/1368941882 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fae59c700 1 --2- 172.21.15.151:0/1368941882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94fff24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fb759e700 1 --2- 172.21.15.151:0/1368941882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f94fff7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fb6d9d700 1 -- 172.21.15.151:0/1368941882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 msgr2=0x55f94fff24a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/1368941882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94fff24a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fb6d9d700 1 -- 172.21.15.151:0/1368941882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 msgr2=0x55f94fff7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/1368941882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f94fff7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.288+0000 7f0fb6d9d700 1 -- 172.21.15.151:0/1368941882 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f94fd71d80 con 0x55f94fff8210 2023-07-21T22:59:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.289+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/1368941882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f94fff1f40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000b580 tx=0x7f0fa0005c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76f270247178da4e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.289+0000 7f0fb4d99700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0fa40a13c0 0x7f0fa40a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.289+0000 7f0fb4d99700 1 -- 172.21.15.151:0/3499497540 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0fa8014070 con 0x7f0fb80685b0 2023-07-21T22:59:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.289+0000 7f0fad59a700 1 -- 172.21.15.151:0/1368941882 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000bb40 con 0x55f94fff8210 2023-07-21T22:59:59.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.289+0000 7f0fad59a700 1 -- 172.21.15.151:0/1368941882 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fa001e040 con 0x55f94fff8210 2023-07-21T22:59:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.289+0000 7f0fad59a700 1 -- 172.21.15.151:0/1368941882 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa0003b80 con 0x55f94fff8210 2023-07-21T22:59:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.290+0000 7f0fb759e700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0fa40a13c0 0x7f0fa40a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.290+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/1368941882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 msgr2=0x55f94fff1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.290+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/1368941882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f94fff1f40 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f0fa000b580 tx=0x7f0fa0005c70 comp rx=0 tx=0).stop 2023-07-21T22:59:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.290+0000 7f0fb759e700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0fa40a13c0 0x7f0fa40a3870 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009cb0 tx=0x7f0fb0009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.291+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/1368941882 shutdown_connections 2023-07-21T22:59:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.291+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/1368941882 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94fff24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.291+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/1368941882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f94fff7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.291+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/1368941882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f94fff1f40 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.291+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/1368941882 >> 172.21.15.151:0/1368941882 conn(0x55f94ffe7ae0 msgr2=0x55f94ffed0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.291+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/1368941882 shutdown_connections 2023-07-21T22:59:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.291+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/1368941882 wait complete. 2023-07-21T22:59:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.291+0000 7f0fd0b34b80 1 -- start start 2023-07-21T22:59:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.292+0000 7f0fd0b34b80 1 Processor -- start 2023-07-21T22:59:59.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f9500015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f950001af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94fffb8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94fee3a60 con 0x55f94fe4e6b0 2023-07-21T22:59:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94fee3760 con 0x55f94fff8210 2023-07-21T22:59:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94fdc78c0 con 0x55f94fff8660 2023-07-21T22:59:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fd0b34b80 10 client.0 _ll_register_callbacks cb 0x55f94fee1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f950001af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.331 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fae59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f950001af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34404/0 (socket says 172.21.15.151:34404) 2023-07-21T22:59:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fae59c700 1 -- 172.21.15.151:0/2703321010 learned_addr learned my addr 172.21.15.151:0/2703321010 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.293+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f9500015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0fae59c700 1 -- 172.21.15.151:0/2703321010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 msgr2=0x55f94fffb8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0fae59c700 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94fffb8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0fae59c700 1 -- 172.21.15.151:0/2703321010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 msgr2=0x55f9500015b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0fae59c700 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f9500015b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.332 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0fae59c700 1 -- 172.21.15.151:0/2703321010 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb810d210 con 0x55f94fff8210 2023-07-21T22:59:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0fae59c700 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f950001af0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800e910 tx=0x7f0fa8099ae0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=555f03a44c559938 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0f9e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T22:59:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/2703321010 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8099fa0 con 0x55f94fff8210 2023-07-21T22:59:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/2703321010 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0fa809dfd0 con 0x55f94fff8210 2023-07-21T22:59:59.333 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.294+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/2703321010 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f94fe9d490 con 0x55f94fff8210 2023-07-21T22:59:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.295+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/2703321010 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fa80a23f0 con 0x55f94fff8210 2023-07-21T22:59:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.295+0000 7f0fd0b34b80 10 client.29156 fetch_fsmap learned FSMap version 113 2023-07-21T22:59:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.295+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/2703321010 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=4+}) v3 -- 0x55f94fd5ac00 con 0x55f94fff8210 2023-07-21T22:59:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.295+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/2703321010 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f94fe9d490 con 0x55f94fff8210 2023-07-21T22:59:59.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.295+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/2703321010 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 113) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f0fa8094bb0 con 0x55f94fff8210 2023-07-21T22:59:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.295+0000 7f0fd0b34b80 10 client.29156 fetch_fsmap finished waiting for FSMap version 113 2023-07-21T22:59:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.295+0000 7f0fd0b34b80 10 client.29156 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.295+0000 7f0fd0b34b80 20 client.29156 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.296+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f95000bb70 0x55f95000df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.296+0000 7f0fd0b34b80 4 client.29156 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T22:59:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.296+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/2703321010 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f94ff3ce50 con 0x55f95000bb70 2023-07-21T22:59:59.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.296+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f95000bb70 0x55f95000df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.297+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f95000bb70 0x55f95000df80 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc9cc861ffdf851c server_cookie=3f74dbcc2441f301 in_seq=0 out_seq=0 2023-07-21T22:59:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.297+0000 7f0f9e7fc700 10 client.29156 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.297+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/2703321010 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f94ff3ce50 con 0x55f95000bb70 2023-07-21T22:59:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.297+0000 7f0f9e7fc700 10 client.29156 handle_command_reply: tid=0 2023-07-21T22:59:59.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.297+0000 7f0fd0b34b80 1 client.29156 shutdown 2023-07-21T22:59:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/2703321010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 msgr2=0x55f950001af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f950001af0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800e910 tx=0x7f0fa8099ae0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/2703321010 shutdown_connections 2023-07-21T22:59:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f95000bb70 0x55f95000df80 crc :-1 s=READY pgs=463 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94fffb8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0f9e7fc700 0 client.29156 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f9500015b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/2703321010 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8210 0x55f950001af0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/2703321010 >> 172.21.15.151:0/2703321010 conn(0x55f94ffe7ae0 msgr2=0x55f94ffec3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/2703321010 shutdown_connections 2023-07-21T22:59:59.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/2703321010 wait complete. 2023-07-21T22:59:59.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.298+0000 7f0fd0b34b80 20 client.29156 trim_cache size 0 max 16384 2023-07-21T22:59:59.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.323+0000 7f0fd0b34b80 1 Processor -- start 2023-07-21T22:59:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.323+0000 7f0fd0b34b80 1 -- start start 2023-07-21T22:59:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.323+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fe4e6b0 0x55f94fffb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.323+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fff8210 0x55f94fff7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.323+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94ffecb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.323+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94ff3ce50 con 0x55f94fff8210 2023-07-21T22:59:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.323+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94fe9d490 con 0x55f94fe4e6b0 2023-07-21T22:59:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.323+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f94fff9e80 con 0x55f94fff8660 2023-07-21T22:59:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fae59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fff8210 0x55f94fff7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fae59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fff8210 0x55f94fff7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33102/0 (socket says 172.21.15.151:33102) 2023-07-21T22:59:59.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fae59c700 1 -- 172.21.15.151:0/3057099331 learned_addr learned my addr 172.21.15.151:0/3057099331 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/3057099331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fe4e6b0 0x55f94fffb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fb759e700 1 --2- 172.21.15.151:0/3057099331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94ffecb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fae59c700 1 -- 172.21.15.151:0/3057099331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 msgr2=0x55f94ffecb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3057099331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94ffecb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fae59c700 1 -- 172.21.15.151:0/3057099331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fe4e6b0 msgr2=0x55f94fffb9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3057099331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fe4e6b0 0x55f94fffb9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.324+0000 7f0fae59c700 1 -- 172.21.15.151:0/3057099331 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f94fff2590 con 0x55f94fff8210 2023-07-21T22:59:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.325+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3057099331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fff8210 0x55f94fff7010 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8096a10 tx=0x7f0fa80d0360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9eefe3a8b303852 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.325+0000 7f0fadd9b700 1 -- 172.21.15.151:0/3057099331 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa809dfd0 con 0x55f94fff8210 2023-07-21T22:59:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.325+0000 7f0fadd9b700 1 -- 172.21.15.151:0/3057099331 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fa8099fa0 con 0x55f94fff8210 2023-07-21T22:59:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.325+0000 7f0fadd9b700 1 -- 172.21.15.151:0/3057099331 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa8094ca0 con 0x55f94fff8210 2023-07-21T22:59:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.326+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3057099331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fff8210 msgr2=0x55f94fff7010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.326+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3057099331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fff8210 0x55f94fff7010 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8096a10 tx=0x7f0fa80d0360 comp rx=0 tx=0).stop 2023-07-21T22:59:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.326+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3057099331 shutdown_connections 2023-07-21T22:59:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.326+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3057099331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fe4e6b0 0x55f94fffb9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.326+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3057099331 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8660 0x55f94ffecb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.326+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3057099331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fff8210 0x55f94fff7010 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.326+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3057099331 >> 172.21.15.151:0/3057099331 conn(0x55f94ffe7ae0 msgr2=0x55f94fff6900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.326+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3057099331 shutdown_connections 2023-07-21T22:59:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.326+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3057099331 wait complete. 2023-07-21T22:59:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.327+0000 7f0fd0b34b80 1 -- start start 2023-07-21T22:59:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.327+0000 7f0fd0b34b80 1 Processor -- start 2023-07-21T22:59:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f9500539a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8210 0x55f950053ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fd0b34b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8660 0x55f95005ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f950054760 con 0x55f94fe4e6b0 2023-07-21T22:59:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f95005ef60 con 0x55f94fff8660 2023-07-21T22:59:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fd0b34b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f95005f0a0 con 0x55f94fff8210 2023-07-21T22:59:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fd0b34b80 10 client.0 _ll_register_callbacks cb 0x55f94fee1700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T22:59:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fb6d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f9500539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fb759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8660 0x55f95005ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fb6d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f9500539a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33110/0 (socket says 172.21.15.151:33110) 2023-07-21T22:59:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fb759e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8660 0x55f95005ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34422/0 (socket says 172.21.15.151:34422) 2023-07-21T22:59:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fb6d9d700 1 -- 172.21.15.151:0/3111367940 learned_addr learned my addr 172.21.15.151:0/3111367940 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T22:59:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.328+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8210 0x55f950053ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.329+0000 7f0fae59c700 1 -- 172.21.15.151:0/3111367940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8660 msgr2=0x55f95005ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.329+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8660 0x55f95005ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.329+0000 7f0fae59c700 1 -- 172.21.15.151:0/3111367940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 msgr2=0x55f9500539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T22:59:59.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.329+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f9500539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.329+0000 7f0fae59c700 1 -- 172.21.15.151:0/3111367940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f94fd5ac00 con 0x55f94fff8210 2023-07-21T22:59:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.329+0000 7f0fae59c700 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8210 0x55f950053ee0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8096a10 tx=0x7f0fa801f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a3cac2fe1a670c9f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T22:59:59.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.329+0000 7f0f9e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T22:59:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.330+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/3111367940 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80a23f0 con 0x55f94fff8210 2023-07-21T22:59:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.330+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3111367940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0fa001e040 con 0x55f94fff8210 2023-07-21T22:59:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.330+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/3111367940 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(159..159 src has 1..159) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0fa8095f80 con 0x55f94fff8210 2023-07-21T22:59:59.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.330+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/3111367940 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=113) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0fa8078e70 con 0x55f94fff8210 2023-07-21T22:59:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.330+0000 7f0fd0b34b80 10 client.29167 fetch_fsmap learned FSMap version 113 2023-07-21T22:59:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.330+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3111367940 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=113,monmap=4+}) v3 -- 0x55f94fd981f0 con 0x55f94fff8210 2023-07-21T22:59:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.330+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/3111367940 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0fa001e040 con 0x55f94fff8210 2023-07-21T22:59:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.331+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/3111367940 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 113) v1 ==== 7474+0+0 (secure 0 0 0) 0x7f0fa80ca2b0 con 0x55f94fff8210 2023-07-21T22:59:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.331+0000 7f0fd0b34b80 10 client.29167 fetch_fsmap finished waiting for FSMap version 113 2023-07-21T22:59:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.331+0000 7f0fd0b34b80 10 client.29167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T22:59:59.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.331+0000 7f0fd0b34b80 20 client.29167 populate_metadata read hostname 'smithi151' 2023-07-21T22:59:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.331+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9500602b0 0x55f950062690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T22:59:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.331+0000 7f0fd0b34b80 4 client.29167 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T22:59:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.331+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3111367940 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f94fefeff0 con 0x55f9500602b0 2023-07-21T22:59:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.331+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9500602b0 0x55f950062690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T22:59:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.332+0000 7f0fb6d9d700 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9500602b0 0x55f950062690 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af74d5af81215465 server_cookie=6d9596cbb96971f9 in_seq=0 out_seq=0 2023-07-21T22:59:59.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.332+0000 7f0f9e7fc700 10 client.29167 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:59.370 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 22:59:58 smithi187 ceph-mon[96918]: pgmap v1298: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T22:59:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.352+0000 7f0f9e7fc700 1 -- 172.21.15.151:0/3111367940 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f94fefeff0 con 0x55f9500602b0 2023-07-21T22:59:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.352+0000 7f0f9e7fc700 10 client.29167 handle_command_reply: tid=0 2023-07-21T22:59:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.352+0000 7f0fd0b34b80 1 client.29167 shutdown 2023-07-21T22:59:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3111367940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8210 msgr2=0x55f950053ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8210 0x55f950053ee0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8096a10 tx=0x7f0fa801f000 comp rx=0 tx=0).stop 2023-07-21T22:59:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3111367940 shutdown_connections 2023-07-21T22:59:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f9500602b0 0x55f950062690 crc :-1 s=READY pgs=464 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f94fff8660 0x55f95005ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f94fe4e6b0 0x55f9500539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 --2- 172.21.15.151:0/3111367940 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f94fff8210 0x55f950053ee0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3111367940 >> 172.21.15.151:0/3111367940 conn(0x55f94ffe7ae0 msgr2=0x55f94fffb850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0f9e7fc700 0 client.29167 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T22:59:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3111367940 shutdown_connections 2023-07-21T22:59:59.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.353+0000 7f0fd0b34b80 1 -- 172.21.15.151:0/3111367940 wait complete. 2023-07-21T22:59:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.354+0000 7f0fd0b34b80 20 client.29167 trim_cache size 0 max 16384 2023-07-21T22:59:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T22:59:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T22:59:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T22:59:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T22:59:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0fa40a13c0 msgr2=0x7f0fa40a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0fa40a13c0 0x7f0fa40a3870 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0fb0009cb0 tx=0x7f0fb0009040 comp rx=0 tx=0).stop 2023-07-21T22:59:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/3499497540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb80685b0 msgr2=0x7f0fb810bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T22:59:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb80685b0 0x7f0fb810bde0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800e940 tx=0x7f0fa800ec50 comp rx=0 tx=0).stop 2023-07-21T22:59:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/3499497540 shutdown_connections 2023-07-21T22:59:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0fa40a13c0 0x7f0fa40a3870 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fb8104e50 0x7f0fb81996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0fb8067c10 0x7f0fb810b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 --2- 172.21.15.151:0/3499497540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb80685b0 0x7f0fb810bde0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T22:59:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/3499497540 >> 172.21.15.151:0/3499497540 conn(0x7f0fb8074760 msgr2=0x7f0fb80fc620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T22:59:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/3499497540 shutdown_connections 2023-07-21T22:59:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T22:59:59.355+0000 7f0fbd1ff700 1 -- 172.21.15.151:0/3499497540 wait complete. 2023-07-21T22:59:59.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 22:59:58 smithi195 ceph-mon[97365]: pgmap v1298: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T23:00:00.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T22:59:59.999+0000 7f5662017700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T23:00:01.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:00 smithi187 ceph-mon[96918]: pgmap v1299: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.2 MiB/s wr, 929 op/s 2023-07-21T23:00:01.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:00 smithi187 ceph-mon[96918]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T23:00:01.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:00 smithi195 ceph-mon[97365]: pgmap v1299: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.2 MiB/s wr, 929 op/s 2023-07-21T23:00:01.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:00 smithi195 ceph-mon[97365]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T23:00:01.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:00 smithi151 ceph-mon[95510]: pgmap v1299: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.2 MiB/s wr, 929 op/s 2023-07-21T23:00:01.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:00 smithi151 ceph-mon[95510]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T23:00:03.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:02 smithi187 ceph-mon[96918]: pgmap v1300: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.2 MiB/s wr, 929 op/s 2023-07-21T23:00:03.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:02 smithi195 ceph-mon[97365]: pgmap v1300: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.2 MiB/s wr, 929 op/s 2023-07-21T23:00:03.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:02 smithi151 ceph-mon[95510]: pgmap v1300: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 9.2 MiB/s wr, 929 op/s 2023-07-21T23:00:04.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 430.0 s, 302.2 tps, lat 311.401 ms stddev 175.691 2023-07-21T23:00:05.345 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:04 smithi151 ceph-mon[95510]: pgmap v1301: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T23:00:05.345 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:04 smithi151 ceph-mon[95510]: osdmap e160: 12 total, 12 up, 12 in 2023-07-21T23:00:05.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:04 smithi187 ceph-mon[96918]: pgmap v1301: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T23:00:05.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:04 smithi187 ceph-mon[96918]: osdmap e160: 12 total, 12 up, 12 in 2023-07-21T23:00:05.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:04 smithi195 ceph-mon[97365]: pgmap v1301: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T23:00:05.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:04 smithi195 ceph-mon[97365]: osdmap e160: 12 total, 12 up, 12 in 2023-07-21T23:00:06.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:05 smithi187 ceph-mon[96918]: pgmap v1303: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-07-21T23:00:06.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:06 smithi195 ceph-mon[97365]: pgmap v1303: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-07-21T23:00:06.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:05 smithi151 ceph-mon[95510]: pgmap v1303: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-07-21T23:00:08.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:08 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:00:08.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:08 smithi187 ceph-mon[96918]: pgmap v1304: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 733 op/s 2023-07-21T23:00:08.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:08 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:00:08.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:08 smithi195 ceph-mon[97365]: pgmap v1304: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 733 op/s 2023-07-21T23:00:08.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:08 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:00:08.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:08 smithi151 ceph-mon[95510]: pgmap v1304: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 733 op/s 2023-07-21T23:00:09.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 435.0 s, 87.8 tps, lat 1159.008 ms stddev 426.555 2023-07-21T23:00:11.117 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:10 smithi187 ceph-mon[96918]: pgmap v1305: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 733 op/s 2023-07-21T23:00:11.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:10 smithi195 ceph-mon[97365]: pgmap v1305: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 733 op/s 2023-07-21T23:00:11.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:10 smithi151 ceph-mon[95510]: pgmap v1305: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 733 op/s 2023-07-21T23:00:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.674+0000 7fe2053ff700 1 -- 172.21.15.151:0/966421338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20006d3a0 msgr2=0x7fe20011b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:12.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.674+0000 7fe2053ff700 1 --2- 172.21.15.151:0/966421338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20006d3a0 0x7fe20011b470 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800b0a0 tx=0x7fe1f800b3b0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.676+0000 7fe2053ff700 1 -- 172.21.15.151:0/966421338 shutdown_connections 2023-07-21T23:00:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.676+0000 7fe2053ff700 1 --2- 172.21.15.151:0/966421338 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20006d3a0 0x7fe20011b470 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.676+0000 7fe2053ff700 1 --2- 172.21.15.151:0/966421338 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe20010e2a0 0x7fe20010e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.676+0000 7fe2053ff700 1 --2- 172.21.15.151:0/966421338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe20006c910 0x7fe20006cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.676+0000 7fe2053ff700 1 -- 172.21.15.151:0/966421338 >> 172.21.15.151:0/966421338 conn(0x7fe20006bd70 msgr2=0x7fe200070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.677+0000 7fe2053ff700 1 -- 172.21.15.151:0/966421338 shutdown_connections 2023-07-21T23:00:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.679+0000 7fe2053ff700 1 -- 172.21.15.151:0/966421338 wait complete. 2023-07-21T23:00:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.681+0000 7fe2053ff700 1 Processor -- start 2023-07-21T23:00:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.682+0000 7fe2053ff700 1 -- start start 2023-07-21T23:00:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.682+0000 7fe2053ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe20006c910 0x7fe2001aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.682+0000 7fe2053ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20006d3a0 0x7fe2001aaf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.682+0000 7fe2053ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe20010e2a0 0x7fe2001a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.682+0000 7fe2053ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001a4f10 con 0x7fe20006d3a0 2023-07-21T23:00:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.682+0000 7fe2053ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001a5080 con 0x7fe20006c910 2023-07-21T23:00:12.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.682+0000 7fe2053ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2001a5240 con 0x7fe20010e2a0 2023-07-21T23:00:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.683+0000 7fe1ff7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe20010e2a0 0x7fe2001a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.683+0000 7fe1ff7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe20010e2a0 0x7fe2001a48a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49128/0 (socket says 172.21.15.151:49128) 2023-07-21T23:00:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.683+0000 7fe1ff7fe700 1 -- 172.21.15.151:0/1974808544 learned_addr learned my addr 172.21.15.151:0/1974808544 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.684+0000 7fe1ff7fe700 1 -- 172.21.15.151:0/1974808544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe20006c910 msgr2=0x7fe2001aaa40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T23:00:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.684+0000 7fe1ff7fe700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe20006c910 0x7fe2001aaa40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.684+0000 7fe1ff7fe700 1 -- 172.21.15.151:0/1974808544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20006d3a0 msgr2=0x7fe2001aaf80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T23:00:12.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.684+0000 7fe1ff7fe700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20006d3a0 0x7fe2001aaf80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.684+0000 7fe1ff7fe700 1 -- 172.21.15.151:0/1974808544 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f8009d00 con 0x7fe20010e2a0 2023-07-21T23:00:12.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.684+0000 7fe1ff7fe700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe20010e2a0 0x7fe2001a48a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800b830 tx=0x7fe1f8004d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:12.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.685+0000 7fe1fcff9700 1 -- 172.21.15.151:0/1974808544 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f800e040 con 0x7fe20010e2a0 2023-07-21T23:00:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.685+0000 7fe1fcff9700 1 -- 172.21.15.151:0/1974808544 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1f801db10 con 0x7fe20010e2a0 2023-07-21T23:00:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.685+0000 7fe1fcff9700 1 -- 172.21.15.151:0/1974808544 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f80056f0 con 0x7fe20010e2a0 2023-07-21T23:00:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.685+0000 7fe2053ff700 1 -- 172.21.15.151:0/1974808544 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2001a54c0 con 0x7fe20010e2a0 2023-07-21T23:00:12.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.685+0000 7fe2053ff700 1 -- 172.21.15.151:0/1974808544 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20010ee20 con 0x7fe20010e2a0 2023-07-21T23:00:12.727 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.693+0000 7fe218cf0b80 1 Processor -- start 2023-07-21T23:00:12.728 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.695+0000 7fe1fcff9700 1 -- 172.21.15.151:0/1974808544 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fe1f8005850 con 0x7fe20010e2a0 2023-07-21T23:00:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.697+0000 7fe218cf0b80 1 -- start start 2023-07-21T23:00:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.697+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d93cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.731 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.698+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d8df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.698+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7d94660 0x5599c7d8e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.698+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7c93c50 con 0x5599c7d94660 2023-07-21T23:00:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.698+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7ce69e0 con 0x5599c7d94210 2023-07-21T23:00:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.698+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7cdfe70 con 0x5599c7bea6b0 2023-07-21T23:00:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.698+0000 7fe1f7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d93cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.698+0000 7fe1f7fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d93cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49138/0 (socket says 172.21.15.151:49138) 2023-07-21T23:00:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.698+0000 7fe1f7fff700 1 -- 172.21.15.151:0/3717760958 learned_addr learned my addr 172.21.15.151:0/3717760958 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.698+0000 7fe1feffd700 1 --2- 172.21.15.151:0/3717760958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d8df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.699+0000 7fe1feffd700 1 -- 172.21.15.151:0/3717760958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 msgr2=0x5599c7d93cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.699+0000 7fe1feffd700 1 --2- 172.21.15.151:0/3717760958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d93cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.699+0000 7fe1feffd700 1 -- 172.21.15.151:0/3717760958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7d94660 msgr2=0x5599c7d8e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.699+0000 7fe1feffd700 1 --2- 172.21.15.151:0/3717760958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7d94660 0x5599c7d8e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.699+0000 7fe1feffd700 1 -- 172.21.15.151:0/3717760958 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599c7b0dd80 con 0x5599c7d94210 2023-07-21T23:00:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.699+0000 7fe1fcff9700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1ec0a1450 0x7fe1ec0a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.699+0000 7fe1fcff9700 1 -- 172.21.15.151:0/1974808544 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fe1f80ce870 con 0x7fe20010e2a0 2023-07-21T23:00:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.699+0000 7fe1feffd700 1 --2- 172.21.15.151:0/3717760958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d8df40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000b9d0 tx=0x7fe1f000bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d262b508532f1640 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.699+0000 7fe1f7fff700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1ec0a1450 0x7fe1ec0a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.700+0000 7fe1f57fa700 1 -- 172.21.15.151:0/3717760958 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0004a30 con 0x5599c7d94210 2023-07-21T23:00:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.700+0000 7fe1f57fa700 1 -- 172.21.15.151:0/3717760958 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1f000b480 con 0x5599c7d94210 2023-07-21T23:00:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.700+0000 7fe1f57fa700 1 -- 172.21.15.151:0/3717760958 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0005310 con 0x5599c7d94210 2023-07-21T23:00:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.701+0000 7fe218cf0b80 1 -- 172.21.15.151:0/3717760958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 msgr2=0x5599c7d8df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.701+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/3717760958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d8df40 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000b9d0 tx=0x7fe1f000bce0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.701+0000 7fe1f7fff700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1ec0a1450 0x7fe1ec0a3900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5599c7d94a70 tx=0x7fe1e8009590 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.701+0000 7fe218cf0b80 1 -- 172.21.15.151:0/3717760958 shutdown_connections 2023-07-21T23:00:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.701+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/3717760958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7d94660 0x5599c7d8e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.701+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/3717760958 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d93cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.701+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/3717760958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d8df40 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.701+0000 7fe218cf0b80 1 -- 172.21.15.151:0/3717760958 >> 172.21.15.151:0/3717760958 conn(0x5599c7d83ae0 msgr2=0x5599c7d890e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.702+0000 7fe218cf0b80 1 -- 172.21.15.151:0/3717760958 shutdown_connections 2023-07-21T23:00:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.702+0000 7fe218cf0b80 1 -- 172.21.15.151:0/3717760958 wait complete. 2023-07-21T23:00:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.703+0000 7fe218cf0b80 1 -- start start 2023-07-21T23:00:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.703+0000 7fe218cf0b80 1 Processor -- start 2023-07-21T23:00:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.703+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.704+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d977a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.704+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7d94660 0x5599c7d97d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.704+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7c7fa60 con 0x5599c7bea6b0 2023-07-21T23:00:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.704+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7c7f760 con 0x5599c7d94210 2023-07-21T23:00:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.704+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7b638c0 con 0x5599c7d94660 2023-07-21T23:00:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.704+0000 7fe218cf0b80 10 client.0 _ll_register_callbacks cb 0x5599c7c7d700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:00:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.704+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.704+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37194/0 (socket says 172.21.15.151:37194) 2023-07-21T23:00:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.704+0000 7fe1feffd700 1 -- 172.21.15.151:0/910576542 learned_addr learned my addr 172.21.15.151:0/910576542 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:12.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.705+0000 7fe1feffd700 1 -- 172.21.15.151:0/910576542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7d94660 msgr2=0x5599c7d97d60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:00:12.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.705+0000 7fe1feffd700 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7d94660 0x5599c7d97d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.705+0000 7fe1feffd700 1 -- 172.21.15.151:0/910576542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 msgr2=0x5599c7d977a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:00:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.705+0000 7fe1feffd700 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d977a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.705+0000 7fe1feffd700 1 -- 172.21.15.151:0/910576542 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f000b600 con 0x5599c7bea6b0 2023-07-21T23:00:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.706+0000 7fe1feffd700 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9a520 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0005fb0 tx=0x7fe1f0004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c333638938cd3951 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.706+0000 7fe1e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:00:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.707+0000 7fe1e67fc700 1 -- 172.21.15.151:0/910576542 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f001f070 con 0x5599c7bea6b0 2023-07-21T23:00:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.707+0000 7fe1e67fc700 1 -- 172.21.15.151:0/910576542 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fe1f000d7d0 con 0x5599c7bea6b0 2023-07-21T23:00:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.707+0000 7fe218cf0b80 1 -- 172.21.15.151:0/910576542 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599c7cd8e50 con 0x5599c7bea6b0 2023-07-21T23:00:12.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.708+0000 7fe1e67fc700 1 -- 172.21.15.151:0/910576542 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1f000d990 con 0x5599c7bea6b0 2023-07-21T23:00:12.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.708+0000 7fe218cf0b80 10 client.19482 fetch_fsmap learned FSMap version 114 2023-07-21T23:00:12.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.708+0000 7fe218cf0b80 1 -- 172.21.15.151:0/910576542 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x5599c7af6c00 con 0x5599c7bea6b0 2023-07-21T23:00:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.709+0000 7fe1e67fc700 1 -- 172.21.15.151:0/910576542 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1f0030020 con 0x5599c7bea6b0 2023-07-21T23:00:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.709+0000 7fe1e67fc700 1 -- 172.21.15.151:0/910576542 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 114) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe1f00107b0 con 0x5599c7bea6b0 2023-07-21T23:00:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.709+0000 7fe218cf0b80 10 client.19482 fetch_fsmap finished waiting for FSMap version 114 2023-07-21T23:00:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.709+0000 7fe218cf0b80 10 client.19482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:00:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.709+0000 7fe218cf0b80 20 client.19482 populate_metadata read hostname 'smithi151' 2023-07-21T23:00:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.709+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5599c7da7a60 0x5599c7da9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.709+0000 7fe218cf0b80 4 client.19482 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:00:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.709+0000 7fe218cf0b80 1 -- 172.21.15.151:0/910576542 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5599c7c9aff0 con 0x5599c7da7a60 2023-07-21T23:00:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.710+0000 7fe1f7fff700 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5599c7da7a60 0x5599c7da9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.711+0000 7fe1f7fff700 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5599c7da7a60 0x5599c7da9e70 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=534d83e93ee9fa0b server_cookie=52ead91624fa5e1 in_seq=0 out_seq=0 2023-07-21T23:00:12.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.711+0000 7fe1e67fc700 10 client.19482 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:12.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.712+0000 7fe1e67fc700 1 -- 172.21.15.151:0/910576542 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5599c7c9aff0 con 0x5599c7da7a60 2023-07-21T23:00:12.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.712+0000 7fe1e67fc700 10 client.19482 handle_command_reply: tid=0 2023-07-21T23:00:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.713+0000 7fe218cf0b80 1 client.19482 shutdown 2023-07-21T23:00:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.713+0000 7fe218cf0b80 1 -- 172.21.15.151:0/910576542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 msgr2=0x5599c7d9a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.713+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9a520 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0005fb0 tx=0x7fe1f0004a80 comp rx=0 tx=0).stop 2023-07-21T23:00:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.714+0000 7fe218cf0b80 1 -- 172.21.15.151:0/910576542 shutdown_connections 2023-07-21T23:00:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.714+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5599c7da7a60 0x5599c7da9e70 crc :-1 s=READY pgs=465 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.714+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7d94660 0x5599c7d97d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.714+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9a520 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.714+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/910576542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d977a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.714+0000 7fe218cf0b80 1 -- 172.21.15.151:0/910576542 >> 172.21.15.151:0/910576542 conn(0x5599c7d83ae0 msgr2=0x5599c7d883e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:12.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.714+0000 7fe1e67fc700 0 client.19482 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:12.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.714+0000 7fe218cf0b80 1 -- 172.21.15.151:0/910576542 shutdown_connections 2023-07-21T23:00:12.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.714+0000 7fe218cf0b80 1 -- 172.21.15.151:0/910576542 wait complete. 2023-07-21T23:00:12.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.715+0000 7fe218cf0b80 20 client.19482 trim_cache size 0 max 16384 2023-07-21T23:00:12.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.736+0000 7fe218cf0b80 1 Processor -- start 2023-07-21T23:00:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.736+0000 7fe218cf0b80 1 -- start start 2023-07-21T23:00:12.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.736+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.736+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d96f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.736+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7d94660 0x5599c7d9a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.736+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7d98360 con 0x5599c7bea6b0 2023-07-21T23:00:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.736+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7d95d20 con 0x5599c7d94210 2023-07-21T23:00:12.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.736+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7d89d50 con 0x5599c7d94660 2023-07-21T23:00:12.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.738+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.738+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:37210/0 (socket says 172.21.15.151:37210) 2023-07-21T23:00:12.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.738+0000 7fe1feffd700 1 -- 172.21.15.151:0/590396415 learned_addr learned my addr 172.21.15.151:0/590396415 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:12.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.738+0000 7fe1ff7fe700 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7d94660 0x5599c7d9a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.738+0000 7fe1f7fff700 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d96f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.739+0000 7fe1feffd700 1 -- 172.21.15.151:0/590396415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7d94660 msgr2=0x5599c7d9a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:12.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.739+0000 7fe1feffd700 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7d94660 0x5599c7d9a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.739+0000 7fe1feffd700 1 -- 172.21.15.151:0/590396415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 msgr2=0x5599c7d96f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.739+0000 7fe1feffd700 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d96f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.739+0000 7fe1feffd700 1 -- 172.21.15.151:0/590396415 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5599c7b341f0 con 0x5599c7bea6b0 2023-07-21T23:00:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.739+0000 7fe1f7fff700 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d96f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:00:12.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.739+0000 7fe1feffd700 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9ec30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0010b40 tx=0x7fe1f000bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe64c3db19b996 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:12.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.740+0000 7fe1f5ffb700 1 -- 172.21.15.151:0/590396415 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f001f070 con 0x5599c7bea6b0 2023-07-21T23:00:12.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.740+0000 7fe1f5ffb700 1 -- 172.21.15.151:0/590396415 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe1f0030030 con 0x5599c7bea6b0 2023-07-21T23:00:12.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.740+0000 7fe1f5ffb700 1 -- 172.21.15.151:0/590396415 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0005210 con 0x5599c7bea6b0 2023-07-21T23:00:12.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.741+0000 7fe218cf0b80 1 -- 172.21.15.151:0/590396415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 msgr2=0x5599c7d9ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:12.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.741+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9ec30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0010b40 tx=0x7fe1f000bce0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.742+0000 7fe218cf0b80 1 -- 172.21.15.151:0/590396415 shutdown_connections 2023-07-21T23:00:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.742+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7d94660 0x5599c7d9a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.742+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7bea6b0 0x5599c7d9ec30 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.742+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/590396415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d96f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.742+0000 7fe218cf0b80 1 -- 172.21.15.151:0/590396415 >> 172.21.15.151:0/590396415 conn(0x5599c7d83ae0 msgr2=0x5599c7d88cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:12.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.742+0000 7fe218cf0b80 1 -- 172.21.15.151:0/590396415 shutdown_connections 2023-07-21T23:00:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.742+0000 7fe218cf0b80 1 -- 172.21.15.151:0/590396415 wait complete. 2023-07-21T23:00:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.743+0000 7fe218cf0b80 1 -- start start 2023-07-21T23:00:12.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.743+0000 7fe218cf0b80 1 Processor -- start 2023-07-21T23:00:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d90820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d90d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe218cf0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7d94660 0x5599c7d8f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7d91330 con 0x5599c7d94660 2023-07-21T23:00:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7d914a0 con 0x5599c7d94210 2023-07-21T23:00:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe218cf0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5599c7d8fc70 con 0x5599c7bea6b0 2023-07-21T23:00:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe218cf0b80 10 client.0 _ll_register_callbacks cb 0x7fe1f000b820 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:00:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d90820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe1feffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d90820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49160/0 (socket says 172.21.15.151:49160) 2023-07-21T23:00:12.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.745+0000 7fe1feffd700 1 -- 172.21.15.151:0/4010762662 learned_addr learned my addr 172.21.15.151:0/4010762662 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.746+0000 7fe1f7fff700 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d90d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.746+0000 7fe1ff7fe700 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7d94660 0x5599c7d8f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.747+0000 7fe1feffd700 1 -- 172.21.15.151:0/4010762662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 msgr2=0x5599c7d90d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.747+0000 7fe1feffd700 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d90d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.747+0000 7fe1feffd700 1 -- 172.21.15.151:0/4010762662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7d94660 msgr2=0x5599c7d8f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.747+0000 7fe1feffd700 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7d94660 0x5599c7d8f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.747+0000 7fe1feffd700 1 -- 172.21.15.151:0/4010762662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e800e7b0 con 0x5599c7bea6b0 2023-07-21T23:00:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.747+0000 7fe1feffd700 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d90820 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000b300 tx=0x7fe1f0004ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5914b3f9584aa69 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:12.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.747+0000 7fe1e67fc700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:00:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.748+0000 7fe1e67fc700 1 -- 172.21.15.151:0/4010762662 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f001f040 con 0x5599c7bea6b0 2023-07-21T23:00:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.748+0000 7fe1e67fc700 1 -- 172.21.15.151:0/4010762662 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(160..160 src has 1..160) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fe1f0000e40 con 0x5599c7bea6b0 2023-07-21T23:00:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.748+0000 7fe218cf0b80 1 -- 172.21.15.151:0/4010762662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5599c7c39490 con 0x5599c7bea6b0 2023-07-21T23:00:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.749+0000 7fe1e67fc700 1 -- 172.21.15.151:0/4010762662 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe1f000d9e0 con 0x5599c7bea6b0 2023-07-21T23:00:12.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.749+0000 7fe218cf0b80 10 client.29182 fetch_fsmap learned FSMap version 114 2023-07-21T23:00:12.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.749+0000 7fe218cf0b80 1 -- 172.21.15.151:0/4010762662 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x5599c7af6c00 con 0x5599c7bea6b0 2023-07-21T23:00:12.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.750+0000 7fe1e67fc700 1 -- 172.21.15.151:0/4010762662 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5599c7c39490 con 0x5599c7bea6b0 2023-07-21T23:00:12.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.750+0000 7fe1e67fc700 1 -- 172.21.15.151:0/4010762662 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 114) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fe1f0041070 con 0x5599c7bea6b0 2023-07-21T23:00:12.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.751+0000 7fe218cf0b80 10 client.29182 fetch_fsmap finished waiting for FSMap version 114 2023-07-21T23:00:12.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.751+0000 7fe218cf0b80 10 client.29182 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:00:12.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.751+0000 7fe218cf0b80 20 client.29182 populate_metadata read hostname 'smithi151' 2023-07-21T23:00:12.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.751+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5599c7dfc070 0x5599c7dfe450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:12.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.751+0000 7fe218cf0b80 4 client.29182 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:00:12.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.751+0000 7fe218cf0b80 1 -- 172.21.15.151:0/4010762662 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5599c7b2ef10 con 0x5599c7dfc070 2023-07-21T23:00:12.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.751+0000 7fe1f7fff700 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5599c7dfc070 0x5599c7dfe450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:12.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.755+0000 7fe1e67fc700 10 client.29182 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:12.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.755+0000 7fe1f7fff700 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5599c7dfc070 0x5599c7dfe450 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=460988f39fd77f53 server_cookie=a81bd43955a73d1a in_seq=0 out_seq=0 2023-07-21T23:00:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.805+0000 7fe1e67fc700 1 -- 172.21.15.151:0/4010762662 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5599c7b2ef10 con 0x5599c7dfc070 2023-07-21T23:00:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.805+0000 7fe1e67fc700 10 client.29182 handle_command_reply: tid=0 2023-07-21T23:00:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.805+0000 7fe218cf0b80 1 client.29182 shutdown 2023-07-21T23:00:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.806+0000 7fe218cf0b80 1 -- 172.21.15.151:0/4010762662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 msgr2=0x5599c7d90820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.806+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d90820 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000b300 tx=0x7fe1f0004ba0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.807+0000 7fe218cf0b80 1 -- 172.21.15.151:0/4010762662 shutdown_connections 2023-07-21T23:00:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.807+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5599c7dfc070 0x5599c7dfe450 crc :-1 s=READY pgs=466 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.807+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c7d94660 0x5599c7d8f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.807+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5599c7bea6b0 0x5599c7d90820 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.807+0000 7fe1e67fc700 0 client.29182 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.807+0000 7fe218cf0b80 1 --2- 172.21.15.151:0/4010762662 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5599c7d94210 0x5599c7d90d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.807+0000 7fe218cf0b80 1 -- 172.21.15.151:0/4010762662 >> 172.21.15.151:0/4010762662 conn(0x5599c7d83ae0 msgr2=0x5599c7d94aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.808+0000 7fe218cf0b80 1 -- 172.21.15.151:0/4010762662 shutdown_connections 2023-07-21T23:00:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.809+0000 7fe218cf0b80 1 -- 172.21.15.151:0/4010762662 wait complete. 2023-07-21T23:00:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.810+0000 7fe218cf0b80 20 client.29182 trim_cache size 0 max 16384 2023-07-21T23:00:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:00:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:00:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:00:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:00:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 -- 172.21.15.151:0/1974808544 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1ec0a1450 msgr2=0x7fe1ec0a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1ec0a1450 0x7fe1ec0a3900 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x5599c7d94a70 tx=0x7fe1e8009590 comp rx=0 tx=0).stop 2023-07-21T23:00:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 -- 172.21.15.151:0/1974808544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe20010e2a0 msgr2=0x7fe2001a48a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe20010e2a0 0x7fe2001a48a0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fe1f800b830 tx=0x7fe1f8004d30 comp rx=0 tx=0).stop 2023-07-21T23:00:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 -- 172.21.15.151:0/1974808544 shutdown_connections 2023-07-21T23:00:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe1ec0a1450 0x7fe1ec0a3900 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe20006c910 0x7fe2001aaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe20010e2a0 0x7fe2001a48a0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 --2- 172.21.15.151:0/1974808544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe20006d3a0 0x7fe2001aaf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.811+0000 7fe2053ff700 1 -- 172.21.15.151:0/1974808544 >> 172.21.15.151:0/1974808544 conn(0x7fe20006bd70 msgr2=0x7fe20006f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.813+0000 7fe2053ff700 1 -- 172.21.15.151:0/1974808544 shutdown_connections 2023-07-21T23:00:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:12.813+0000 7fe2053ff700 1 -- 172.21.15.151:0/1974808544 wait complete. 2023-07-21T23:00:13.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:12 smithi187 ceph-mon[96918]: pgmap v1306: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 733 op/s 2023-07-21T23:00:13.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:12 smithi195 ceph-mon[97365]: pgmap v1306: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 733 op/s 2023-07-21T23:00:13.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:12 smithi151 ceph-mon[95510]: pgmap v1306: 97 pgs: 15 active+clean+snaptrim, 30 active+clean+snaptrim_wait, 52 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 7.2 MiB/s wr, 733 op/s 2023-07-21T23:00:14.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 440.0 s, 261.0 tps, lat 396.977 ms stddev 124.148 2023-07-21T23:00:15.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:14 smithi187 ceph-mon[96918]: pgmap v1307: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 541 op/s 2023-07-21T23:00:15.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:14 smithi195 ceph-mon[97365]: pgmap v1307: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 541 op/s 2023-07-21T23:00:15.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:14 smithi151 ceph-mon[95510]: pgmap v1307: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 5.1 MiB/s wr, 541 op/s 2023-07-21T23:00:16.374 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:16 smithi187 ceph-mon[96918]: pgmap v1308: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 457 op/s 2023-07-21T23:00:16.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:16 smithi195 ceph-mon[97365]: pgmap v1308: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 457 op/s 2023-07-21T23:00:16.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:16 smithi151 ceph-mon[95510]: pgmap v1308: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 4.3 MiB/s wr, 457 op/s 2023-07-21T23:00:18.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:17 smithi187 ceph-mon[96918]: osdmap e161: 12 total, 12 up, 12 in 2023-07-21T23:00:18.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:17 smithi195 ceph-mon[97365]: osdmap e161: 12 total, 12 up, 12 in 2023-07-21T23:00:18.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:17 smithi151 ceph-mon[95510]: osdmap e161: 12 total, 12 up, 12 in 2023-07-21T23:00:19.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 445.0 s, 223.6 tps, lat 434.190 ms stddev 451.965 2023-07-21T23:00:19.372 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:18 smithi187 ceph-mon[96918]: pgmap v1310: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 843 op/s 2023-07-21T23:00:19.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:18 smithi195 ceph-mon[97365]: pgmap v1310: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 843 op/s 2023-07-21T23:00:19.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:18 smithi151 ceph-mon[95510]: pgmap v1310: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 843 op/s 2023-07-21T23:00:20.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:19 smithi187 ceph-mon[96918]: pgmap v1311: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 843 op/s 2023-07-21T23:00:20.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:19 smithi195 ceph-mon[97365]: pgmap v1311: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 843 op/s 2023-07-21T23:00:20.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:19 smithi151 ceph-mon[95510]: pgmap v1311: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.2 MiB/s wr, 843 op/s 2023-07-21T23:00:23.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:22 smithi187 ceph-mon[96918]: pgmap v1312: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 842 op/s 2023-07-21T23:00:23.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:22 smithi195 ceph-mon[97365]: pgmap v1312: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 842 op/s 2023-07-21T23:00:23.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:22 smithi151 ceph-mon[95510]: pgmap v1312: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 MiB/s rd, 8.1 MiB/s wr, 842 op/s 2023-07-21T23:00:24.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 450.0 s, 362.8 tps, lat 286.669 ms stddev 122.615 2023-07-21T23:00:25.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:24 smithi187 ceph-mon[96918]: pgmap v1313: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 982 op/s 2023-07-21T23:00:25.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:24 smithi195 ceph-mon[97365]: pgmap v1313: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 982 op/s 2023-07-21T23:00:25.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:24 smithi151 ceph-mon[95510]: pgmap v1313: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 982 op/s 2023-07-21T23:00:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.075+0000 7fef225ff700 1 -- 172.21.15.151:0/2493274403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef1c06c910 msgr2=0x7fef1c06cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.075+0000 7fef225ff700 1 --2- 172.21.15.151:0/2493274403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef1c06c910 0x7fef1c06cd80 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fef0c009990 tx=0x7fef0c009ca0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.075+0000 7fef225ff700 1 -- 172.21.15.151:0/2493274403 shutdown_connections 2023-07-21T23:00:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.075+0000 7fef225ff700 1 --2- 172.21.15.151:0/2493274403 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef1c10e2a0 0x7fef1c10e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.075+0000 7fef225ff700 1 --2- 172.21.15.151:0/2493274403 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef1c06d3a0 0x7fef1c11b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.075+0000 7fef225ff700 1 --2- 172.21.15.151:0/2493274403 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef1c06c910 0x7fef1c06cd80 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.075+0000 7fef225ff700 1 -- 172.21.15.151:0/2493274403 >> 172.21.15.151:0/2493274403 conn(0x7fef1c06bd70 msgr2=0x7fef1c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:26.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.076+0000 7fef225ff700 1 -- 172.21.15.151:0/2493274403 shutdown_connections 2023-07-21T23:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.076+0000 7fef225ff700 1 -- 172.21.15.151:0/2493274403 wait complete. 2023-07-21T23:00:26.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.078+0000 7fef225ff700 1 Processor -- start 2023-07-21T23:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.078+0000 7fef225ff700 1 -- start start 2023-07-21T23:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.078+0000 7fef225ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef1c06c910 0x7fef1c1aaa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.078+0000 7fef225ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef1c06d3a0 0x7fef1c1aafc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.078+0000 7fef225ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef1c10e2a0 0x7fef1c1a4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.078+0000 7fef225ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1a5020 con 0x7fef1c06c910 2023-07-21T23:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.079+0000 7fef225ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1a5160 con 0x7fef1c06d3a0 2023-07-21T23:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.079+0000 7fef225ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef1c1a5320 con 0x7fef1c10e2a0 2023-07-21T23:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.079+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef1c06d3a0 0x7fef1c1aafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.080+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef1c06d3a0 0x7fef1c1aafc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41040/0 (socket says 172.21.15.151:41040) 2023-07-21T23:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.080+0000 7fef1b7fe700 1 -- 172.21.15.151:0/2573724297 learned_addr learned my addr 172.21.15.151:0/2573724297 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.080+0000 7fef20b9c700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef1c10e2a0 0x7fef1c1a4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.081+0000 7fef1bfff700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef1c06c910 0x7fef1c1aaa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.081+0000 7fef20b9c700 1 -- 172.21.15.151:0/2573724297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef1c06d3a0 msgr2=0x7fef1c1aafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.081+0000 7fef20b9c700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef1c06d3a0 0x7fef1c1aafc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.081+0000 7fef20b9c700 1 -- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef1c06c910 msgr2=0x7fef1c1aaa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.081+0000 7fef20b9c700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef1c06c910 0x7fef1c1aaa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.081+0000 7fef20b9c700 1 -- 172.21.15.151:0/2573724297 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef0c0095f0 con 0x7fef1c10e2a0 2023-07-21T23:00:26.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.081+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef1c06d3a0 0x7fef1c1aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:00:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.082+0000 7fef20b9c700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef1c10e2a0 0x7fef1c1a4850 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fef14007f10 tx=0x7fef1400d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.082+0000 7fef197fa700 1 -- 172.21.15.151:0/2573724297 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef1400ddd0 con 0x7fef1c10e2a0 2023-07-21T23:00:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.082+0000 7fef197fa700 1 -- 172.21.15.151:0/2573724297 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef1400f040 con 0x7fef1c10e2a0 2023-07-21T23:00:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.082+0000 7fef197fa700 1 -- 172.21.15.151:0/2573724297 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef14005950 con 0x7fef1c10e2a0 2023-07-21T23:00:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.082+0000 7fef225ff700 1 -- 172.21.15.151:0/2573724297 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef1c1a5600 con 0x7fef1c10e2a0 2023-07-21T23:00:26.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.083+0000 7fef225ff700 1 -- 172.21.15.151:0/2573724297 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef1c10ee20 con 0x7fef1c10e2a0 2023-07-21T23:00:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.089+0000 7fef197fa700 1 -- 172.21.15.151:0/2573724297 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fef14005020 con 0x7fef1c10e2a0 2023-07-21T23:00:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.089+0000 7fef35f2bb80 1 Processor -- start 2023-07-21T23:00:26.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.090+0000 7fef35f2bb80 1 -- start start 2023-07-21T23:00:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.090+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2d3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.090+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.090+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4660 0x55640b2ce4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.090+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b1d3c50 con 0x55640b2d4660 2023-07-21T23:00:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.090+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b2269e0 con 0x55640b2d4210 2023-07-21T23:00:26.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.090+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b21fe70 con 0x55640b12a6b0 2023-07-21T23:00:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.091+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2d3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.091+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4660 0x55640b2ce4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.091+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4660 0x55640b2ce4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54718/0 (socket says 172.21.15.151:54718) 2023-07-21T23:00:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.091+0000 7fef1b7fe700 1 -- 172.21.15.151:0/3139324512 learned_addr learned my addr 172.21.15.151:0/3139324512 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.091+0000 7fef1bfff700 1 --2- 172.21.15.151:0/3139324512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.091+0000 7fef197fa700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef040a1450 0x7fef040a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef1b7fe700 1 -- 172.21.15.151:0/3139324512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 msgr2=0x55640b2cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef197fa700 1 -- 172.21.15.151:0/2573724297 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fef140cc490 con 0x7fef1c10e2a0 2023-07-21T23:00:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/3139324512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2cdf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef1b7fe700 1 -- 172.21.15.151:0/3139324512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4660 msgr2=0x55640b2ce4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/3139324512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4660 0x55640b2ce4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef1b7fe700 1 -- 172.21.15.151:0/3139324512 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55640b04dd80 con 0x55640b12a6b0 2023-07-21T23:00:26.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef20b9c700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef040a1450 0x7fef040a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/3139324512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2d3cd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0036c0 tx=0x7fef0c01a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=deb716671166e55c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef027fc700 1 -- 172.21.15.151:0/3139324512 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c00bd00 con 0x55640b12a6b0 2023-07-21T23:00:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef027fc700 1 -- 172.21.15.151:0/3139324512 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef0c01e070 con 0x55640b12a6b0 2023-07-21T23:00:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.092+0000 7fef027fc700 1 -- 172.21.15.151:0/3139324512 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c029460 con 0x55640b12a6b0 2023-07-21T23:00:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.093+0000 7fef35f2bb80 1 -- 172.21.15.151:0/3139324512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 msgr2=0x55640b2d3cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.093+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/3139324512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2d3cd0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fef0c0036c0 tx=0x7fef0c01a040 comp rx=0 tx=0).stop 2023-07-21T23:00:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.094+0000 7fef20b9c700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef040a1450 0x7fef040a3900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fef14009ed0 tx=0x7fef14009e20 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.094+0000 7fef35f2bb80 1 -- 172.21.15.151:0/3139324512 shutdown_connections 2023-07-21T23:00:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.094+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/3139324512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4660 0x55640b2ce4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.094+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/3139324512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2d3cd0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.094+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/3139324512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.094+0000 7fef35f2bb80 1 -- 172.21.15.151:0/3139324512 >> 172.21.15.151:0/3139324512 conn(0x55640b2c3ae0 msgr2=0x55640b2c90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.094+0000 7fef35f2bb80 1 -- 172.21.15.151:0/3139324512 shutdown_connections 2023-07-21T23:00:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.094+0000 7fef35f2bb80 1 -- 172.21.15.151:0/3139324512 wait complete. 2023-07-21T23:00:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.095+0000 7fef35f2bb80 1 -- start start 2023-07-21T23:00:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.095+0000 7fef35f2bb80 1 Processor -- start 2023-07-21T23:00:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2dd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2ddad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b2d4660 0x55640b2d7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b1bfa60 con 0x55640b12a6b0 2023-07-21T23:00:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b1bf760 con 0x55640b2d4210 2023-07-21T23:00:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b0a38c0 con 0x55640b2d4660 2023-07-21T23:00:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef35f2bb80 10 client.0 _ll_register_callbacks cb 0x55640b1bd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:00:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2dd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef1bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2ddad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef1bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2ddad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41054/0 (socket says 172.21.15.151:41054) 2023-07-21T23:00:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef1bfff700 1 -- 172.21.15.151:0/2261014475 learned_addr learned my addr 172.21.15.151:0/2261014475 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.096+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2dd590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54728/0 (socket says 172.21.15.151:54728) 2023-07-21T23:00:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.097+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b2d4660 0x55640b2d7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.097+0000 7fef1bfff700 1 -- 172.21.15.151:0/2261014475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b2d4660 msgr2=0x55640b2d7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.097+0000 7fef1bfff700 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b2d4660 0x55640b2d7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.097+0000 7fef1bfff700 1 -- 172.21.15.151:0/2261014475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 msgr2=0x55640b2dd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:26.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.097+0000 7fef1bfff700 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2dd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.097+0000 7fef1bfff700 1 -- 172.21.15.151:0/2261014475 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef0c020040 con 0x55640b2d4210 2023-07-21T23:00:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.097+0000 7fef1bfff700 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2ddad0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef1000f1e0 tx=0x7fef1000f4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d6af084f9fe57be server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.097+0000 7feefb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:00:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.098+0000 7feefb7fe700 1 -- 172.21.15.151:0/2261014475 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef10014460 con 0x55640b2d4210 2023-07-21T23:00:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.098+0000 7feefb7fe700 1 -- 172.21.15.151:0/2261014475 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fef100145c0 con 0x55640b2d4210 2023-07-21T23:00:26.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.098+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2261014475 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55640b179490 con 0x55640b2d4210 2023-07-21T23:00:26.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.098+0000 7feefb7fe700 1 -- 172.21.15.151:0/2261014475 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef10014780 con 0x55640b2d4210 2023-07-21T23:00:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.098+0000 7fef35f2bb80 10 client.29180 fetch_fsmap learned FSMap version 114 2023-07-21T23:00:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.098+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2261014475 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x55640b036c00 con 0x55640b2d4210 2023-07-21T23:00:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.098+0000 7feefb7fe700 1 -- 172.21.15.151:0/2261014475 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55640b179490 con 0x55640b2d4210 2023-07-21T23:00:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.098+0000 7feefb7fe700 1 -- 172.21.15.151:0/2261014475 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 114) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fef1001d930 con 0x55640b2d4210 2023-07-21T23:00:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.099+0000 7fef35f2bb80 10 client.29180 fetch_fsmap finished waiting for FSMap version 114 2023-07-21T23:00:26.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.099+0000 7fef35f2bb80 10 client.29180 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:00:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.099+0000 7fef35f2bb80 20 client.29180 populate_metadata read hostname 'smithi151' 2023-07-21T23:00:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.099+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55640b2e7b20 0x55640b2e9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.099+0000 7fef35f2bb80 4 client.29180 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:00:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.099+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2261014475 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55640b218e50 con 0x55640b2e7b20 2023-07-21T23:00:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.099+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55640b2e7b20 0x55640b2e9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.100+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55640b2e7b20 0x55640b2e9f30 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d70e3e9874426e9 server_cookie=88d0fdaafe3a2c50 in_seq=0 out_seq=0 2023-07-21T23:00:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.100+0000 7feefb7fe700 10 client.29180 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:26.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.100+0000 7feefb7fe700 1 -- 172.21.15.151:0/2261014475 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55640b218e50 con 0x55640b2e7b20 2023-07-21T23:00:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.100+0000 7feefb7fe700 10 client.29180 handle_command_reply: tid=0 2023-07-21T23:00:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.100+0000 7fef35f2bb80 1 client.29180 shutdown 2023-07-21T23:00:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2261014475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 msgr2=0x55640b2ddad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2ddad0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fef1000f1e0 tx=0x7fef1000f4f0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2261014475 shutdown_connections 2023-07-21T23:00:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55640b2e7b20 0x55640b2e9f30 crc :-1 s=READY pgs=467 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.138 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b2d4660 0x55640b2d7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2dd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2261014475 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4210 0x55640b2ddad0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2261014475 >> 172.21.15.151:0/2261014475 conn(0x55640b2c3ae0 msgr2=0x55640b2c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7feefb7fe700 0 client.29180 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2261014475 shutdown_connections 2023-07-21T23:00:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2261014475 wait complete. 2023-07-21T23:00:26.139 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.101+0000 7fef35f2bb80 20 client.29180 trim_cache size 0 max 16384 2023-07-21T23:00:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.128+0000 7fef35f2bb80 1 Processor -- start 2023-07-21T23:00:26.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.129+0000 7fef35f2bb80 1 -- start start 2023-07-21T23:00:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.129+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2d31e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.129+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b2d4210 0x55640b2cdf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.129+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4660 0x55640b2c8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.129+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b2d23c0 con 0x55640b12a6b0 2023-07-21T23:00:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.129+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b2d3970 con 0x55640b2d4660 2023-07-21T23:00:26.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.129+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b2c9f50 con 0x55640b2d4210 2023-07-21T23:00:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.131+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2d31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.131+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2d31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54732/0 (socket says 172.21.15.151:54732) 2023-07-21T23:00:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.131+0000 7fef1b7fe700 1 -- 172.21.15.151:0/2917997039 learned_addr learned my addr 172.21.15.151:0/2917997039 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.131+0000 7fef1b7fe700 1 -- 172.21.15.151:0/2917997039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b2d4210 msgr2=0x55640b2cdf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:26.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.131+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2917997039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b2d4210 0x55640b2cdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.131+0000 7fef1b7fe700 1 -- 172.21.15.151:0/2917997039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4660 msgr2=0x55640b2c8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.131+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2917997039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4660 0x55640b2c8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.131+0000 7fef1b7fe700 1 -- 172.21.15.151:0/2917997039 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55640b0741f0 con 0x55640b12a6b0 2023-07-21T23:00:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.132+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2917997039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2d31e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fef0c005970 tx=0x7fef0c005a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af3eebc3dade5b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.133+0000 7fef02ffd700 1 -- 172.21.15.151:0/2917997039 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c039a80 con 0x55640b12a6b0 2023-07-21T23:00:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.133+0000 7fef02ffd700 1 -- 172.21.15.151:0/2917997039 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef0c02e040 con 0x55640b12a6b0 2023-07-21T23:00:26.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.133+0000 7fef02ffd700 1 -- 172.21.15.151:0/2917997039 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef0c003a80 con 0x55640b12a6b0 2023-07-21T23:00:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.134+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2917997039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 msgr2=0x55640b2d31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.134+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2917997039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2d31e0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7fef0c005970 tx=0x7fef0c005a90 comp rx=0 tx=0).stop 2023-07-21T23:00:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.134+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2917997039 shutdown_connections 2023-07-21T23:00:26.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.134+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2917997039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4660 0x55640b2c8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.134+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2917997039 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b12a6b0 0x55640b2d31e0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.134+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2917997039 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b2d4210 0x55640b2cdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.134+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2917997039 >> 172.21.15.151:0/2917997039 conn(0x55640b2c3ae0 msgr2=0x55640b2d7770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.134+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2917997039 shutdown_connections 2023-07-21T23:00:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.134+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2917997039 wait complete. 2023-07-21T23:00:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.135+0000 7fef35f2bb80 1 -- start start 2023-07-21T23:00:26.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.135+0000 7fef35f2bb80 1 Processor -- start 2023-07-21T23:00:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.136+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2db140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.136+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4210 0x55640b2db680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.136+0000 7fef35f2bb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4660 0x55640b2dbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.136+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b33ab50 con 0x55640b2d4210 2023-07-21T23:00:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.136+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b33acc0 con 0x55640b2d4660 2023-07-21T23:00:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.136+0000 7fef35f2bb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55640b33ae80 con 0x55640b12a6b0 2023-07-21T23:00:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.136+0000 7fef35f2bb80 10 client.0 _ll_register_callbacks cb 0x7fef1000ba60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:00:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2db140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2db140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34258/0 (socket says 172.21.15.151:34258) 2023-07-21T23:00:26.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1b7fe700 1 -- 172.21.15.151:0/2757618135 learned_addr learned my addr 172.21.15.151:0/2757618135 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4660 0x55640b2dbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1bfff700 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4210 0x55640b2db680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1bfff700 1 -- 172.21.15.151:0/2757618135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 msgr2=0x55640b2db140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1bfff700 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2db140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1bfff700 1 -- 172.21.15.151:0/2757618135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4660 msgr2=0x55640b2dbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1bfff700 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4660 0x55640b2dbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.137+0000 7fef1bfff700 1 -- 172.21.15.151:0/2757618135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55640b04dd80 con 0x55640b2d4210 2023-07-21T23:00:26.173 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.138+0000 7fef1bfff700 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4210 0x55640b2db680 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fef10000c00 tx=0x7fef10006f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f4b345e67b18fb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:26.174 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.138+0000 7feefb7fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:00:26.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.138+0000 7feefb7fe700 1 -- 172.21.15.151:0/2757618135 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef100135c0 con 0x55640b2d4210 2023-07-21T23:00:26.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.138+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2757618135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fef0c01e070 con 0x55640b2d4210 2023-07-21T23:00:26.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.139+0000 7feefb7fe700 1 -- 172.21.15.151:0/2757618135 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fef1002c070 con 0x55640b2d4210 2023-07-21T23:00:26.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.139+0000 7feefb7fe700 1 -- 172.21.15.151:0/2757618135 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef1000b520 con 0x55640b2d4210 2023-07-21T23:00:26.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.139+0000 7fef35f2bb80 10 client.19506 fetch_fsmap learned FSMap version 114 2023-07-21T23:00:26.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.139+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2757618135 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x55640b04c250 con 0x55640b2d4210 2023-07-21T23:00:26.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.140+0000 7feefb7fe700 1 -- 172.21.15.151:0/2757618135 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fef0c01e070 con 0x55640b2d4210 2023-07-21T23:00:26.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.140+0000 7feefb7fe700 1 -- 172.21.15.151:0/2757618135 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 114) v1 ==== 7470+0+0 (secure 0 0 0) 0x7fef10031700 con 0x55640b2d4210 2023-07-21T23:00:26.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.140+0000 7fef35f2bb80 10 client.19506 fetch_fsmap finished waiting for FSMap version 114 2023-07-21T23:00:26.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.140+0000 7fef35f2bb80 10 client.19506 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:00:26.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.140+0000 7fef35f2bb80 20 client.19506 populate_metadata read hostname 'smithi151' 2023-07-21T23:00:26.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.140+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55640b33c530 0x55640b33e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:26.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.140+0000 7fef35f2bb80 4 client.19506 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:00:26.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.140+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2757618135 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55640b1daff0 con 0x55640b33c530 2023-07-21T23:00:26.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.141+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55640b33c530 0x55640b33e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:26.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.144+0000 7fef1b7fe700 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55640b33c530 0x55640b33e940 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6bbeffd7e24e068 server_cookie=d2b6d8b2f9c1a55f in_seq=0 out_seq=0 2023-07-21T23:00:26.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.144+0000 7feefb7fe700 10 client.19506 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:26.206 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.173+0000 7feefb7fe700 1 -- 172.21.15.151:0/2757618135 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55640b1daff0 con 0x55640b33c530 2023-07-21T23:00:26.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.173+0000 7feefb7fe700 10 client.19506 handle_command_reply: tid=0 2023-07-21T23:00:26.207 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.173+0000 7fef35f2bb80 1 client.19506 shutdown 2023-07-21T23:00:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.178+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2757618135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4210 msgr2=0x55640b2db680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:26.211 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.178+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4210 0x55640b2db680 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7fef10000c00 tx=0x7fef10006f50 comp rx=0 tx=0).stop 2023-07-21T23:00:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.184+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2757618135 shutdown_connections 2023-07-21T23:00:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.184+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55640b33c530 0x55640b33e940 crc :-1 s=READY pgs=468 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.184+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55640b2d4660 0x55640b2dbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.184+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55640b12a6b0 0x55640b2db140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.184+0000 7fef35f2bb80 1 --2- 172.21.15.151:0/2757618135 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55640b2d4210 0x55640b2db680 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.184+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2757618135 >> 172.21.15.151:0/2757618135 conn(0x55640b2c3ae0 msgr2=0x55640b2d6020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:26.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.184+0000 7feefb7fe700 0 client.19506 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.185+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2757618135 shutdown_connections 2023-07-21T23:00:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.185+0000 7fef35f2bb80 1 -- 172.21.15.151:0/2757618135 wait complete. 2023-07-21T23:00:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.185+0000 7fef35f2bb80 20 client.19506 trim_cache size 0 max 16384 2023-07-21T23:00:26.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:00:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:00:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:00:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:00:26.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.186+0000 7fef225ff700 1 -- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef040a1450 msgr2=0x7fef040a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.186+0000 7fef225ff700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef040a1450 0x7fef040a3900 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fef14009ed0 tx=0x7fef14009e20 comp rx=0 tx=0).stop 2023-07-21T23:00:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.186+0000 7fef225ff700 1 -- 172.21.15.151:0/2573724297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef1c10e2a0 msgr2=0x7fef1c1a4850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.186+0000 7fef225ff700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef1c10e2a0 0x7fef1c1a4850 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fef14007f10 tx=0x7fef1400d3b0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.187+0000 7fef225ff700 1 -- 172.21.15.151:0/2573724297 shutdown_connections 2023-07-21T23:00:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.187+0000 7fef225ff700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fef040a1450 0x7fef040a3900 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.187+0000 7fef225ff700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fef1c10e2a0 0x7fef1c1a4850 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.187+0000 7fef225ff700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef1c06c910 0x7fef1c1aaa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.187+0000 7fef225ff700 1 --2- 172.21.15.151:0/2573724297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fef1c06d3a0 0x7fef1c1aafc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:26.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.187+0000 7fef225ff700 1 -- 172.21.15.151:0/2573724297 >> 172.21.15.151:0/2573724297 conn(0x7fef1c06bd70 msgr2=0x7fef1c070820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:26.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.187+0000 7fef225ff700 1 -- 172.21.15.151:0/2573724297 shutdown_connections 2023-07-21T23:00:26.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:26.188+0000 7fef225ff700 1 -- 172.21.15.151:0/2573724297 wait complete. 2023-07-21T23:00:27.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:26 smithi187 ceph-mon[96918]: pgmap v1314: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 982 op/s 2023-07-21T23:00:27.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:26 smithi195 ceph-mon[97365]: pgmap v1314: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 982 op/s 2023-07-21T23:00:27.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:26 smithi151 ceph-mon[95510]: pgmap v1314: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 9.8 MiB/s wr, 982 op/s 2023-07-21T23:00:29.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 455.0 s, 367.5 tps, lat 272.007 ms stddev 73.760 2023-07-21T23:00:29.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:28 smithi187 ceph-mon[96918]: pgmap v1315: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 14 MiB/s wr, 1.41k op/s 2023-07-21T23:00:29.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:28 smithi195 ceph-mon[97365]: pgmap v1315: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 14 MiB/s wr, 1.41k op/s 2023-07-21T23:00:29.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:28 smithi151 ceph-mon[95510]: pgmap v1315: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 14 MiB/s wr, 1.41k op/s 2023-07-21T23:00:31.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:30 smithi187 ceph-mon[96918]: pgmap v1316: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 870 op/s 2023-07-21T23:00:31.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:30 smithi195 ceph-mon[97365]: pgmap v1316: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 870 op/s 2023-07-21T23:00:31.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:30 smithi151 ceph-mon[95510]: pgmap v1316: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 870 op/s 2023-07-21T23:00:33.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:32 smithi187 ceph-mon[96918]: pgmap v1317: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 870 op/s 2023-07-21T23:00:33.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:32 smithi195 ceph-mon[97365]: pgmap v1317: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 870 op/s 2023-07-21T23:00:33.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:32 smithi151 ceph-mon[95510]: pgmap v1317: 97 pgs: 97 active+clean; 12 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.8 MiB/s wr, 870 op/s 2023-07-21T23:00:34.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 460.0 s, 384.5 tps, lat 261.179 ms stddev 80.125 2023-07-21T23:00:34.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:33 smithi187 ceph-mon[96918]: pgmap v1318: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 14 MiB/s wr, 1.36k op/s 2023-07-21T23:00:34.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:33 smithi195 ceph-mon[97365]: pgmap v1318: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 14 MiB/s wr, 1.36k op/s 2023-07-21T23:00:34.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:33 smithi151 ceph-mon[95510]: pgmap v1318: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 14 MiB/s wr, 1.36k op/s 2023-07-21T23:00:37.117 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:36 smithi187 ceph-mon[96918]: pgmap v1319: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.8 MiB/s wr, 943 op/s 2023-07-21T23:00:37.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:36 smithi195 ceph-mon[97365]: pgmap v1319: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.8 MiB/s wr, 943 op/s 2023-07-21T23:00:37.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:36 smithi151 ceph-mon[95510]: pgmap v1319: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.8 MiB/s wr, 943 op/s 2023-07-21T23:00:39.294 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 465.0 s, 372.2 tps, lat 267.764 ms stddev 92.136 2023-07-21T23:00:39.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:38 smithi187 ceph-mon[96918]: pgmap v1320: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 14 MiB/s wr, 1.42k op/s 2023-07-21T23:00:39.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:38 smithi195 ceph-mon[97365]: pgmap v1320: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 14 MiB/s wr, 1.42k op/s 2023-07-21T23:00:39.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:38 smithi151 ceph-mon[95510]: pgmap v1320: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 14 MiB/s wr, 1.42k op/s 2023-07-21T23:00:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.458+0000 7f3cf59ff700 1 -- 172.21.15.151:0/422887391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0102040 msgr2=0x7f3cf0102410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.458+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/422887391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0102040 0x7f3cf0102410 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f3cd80099c0 tx=0x7f3cd8009cd0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.458+0000 7f3cf59ff700 1 -- 172.21.15.151:0/422887391 shutdown_connections 2023-07-21T23:00:39.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.458+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/422887391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cf0107080 0x7f3cf010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.458+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/422887391 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0102040 0x7f3cf0102410 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.458+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/422887391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf01029e0 0x7f3cf01069a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.458+0000 7f3cf59ff700 1 -- 172.21.15.151:0/422887391 >> 172.21.15.151:0/422887391 conn(0x7f3cf00fd8d0 msgr2=0x7f3cf00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.458+0000 7f3cf59ff700 1 -- 172.21.15.151:0/422887391 shutdown_connections 2023-07-21T23:00:39.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.458+0000 7f3cf59ff700 1 -- 172.21.15.151:0/422887391 wait complete. 2023-07-21T23:00:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.459+0000 7f3cf59ff700 1 Processor -- start 2023-07-21T23:00:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cf59ff700 1 -- start start 2023-07-21T23:00:39.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cf59ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf0102040 0x7f3cf0197de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cf59ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cf01029e0 0x7f3cf0198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cf59ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0107080 0x7f3cf019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cf59ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf019cfd0 con 0x7f3cf01029e0 2023-07-21T23:00:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cf59ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf019d140 con 0x7f3cf0102040 2023-07-21T23:00:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cf59ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf019d300 con 0x7f3cf0107080 2023-07-21T23:00:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cef7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0107080 0x7f3cf019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cef7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0107080 0x7f3cf019c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54892/0 (socket says 172.21.15.151:54892) 2023-07-21T23:00:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.460+0000 7f3cef7fe700 1 -- 172.21.15.151:0/666018801 learned_addr learned my addr 172.21.15.151:0/666018801 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.461+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cf01029e0 0x7f3cf0198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.461+0000 7f3ceeffd700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf0102040 0x7f3cf0197de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.461+0000 7f3cef7fe700 1 -- 172.21.15.151:0/666018801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf0102040 msgr2=0x7f3cf0197de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.461+0000 7f3cef7fe700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf0102040 0x7f3cf0197de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.461+0000 7f3cef7fe700 1 -- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cf01029e0 msgr2=0x7f3cf0198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.461+0000 7f3cef7fe700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cf01029e0 0x7f3cf0198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.461+0000 7f3cef7fe700 1 -- 172.21.15.151:0/666018801 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80095f0 con 0x7f3cf0107080 2023-07-21T23:00:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.462+0000 7f3cef7fe700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0107080 0x7f3cf019c990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8007ee0 tx=0x7f3ce800d3b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.462+0000 7f3cf49fd700 1 -- 172.21.15.151:0/666018801 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8017070 con 0x7f3cf0107080 2023-07-21T23:00:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.462+0000 7f3cf49fd700 1 -- 172.21.15.151:0/666018801 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ce800f040 con 0x7f3cf0107080 2023-07-21T23:00:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.462+0000 7f3cf59ff700 1 -- 172.21.15.151:0/666018801 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf019d5e0 con 0x7f3cf0107080 2023-07-21T23:00:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.462+0000 7f3cf49fd700 1 -- 172.21.15.151:0/666018801 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8005570 con 0x7f3cf0107080 2023-07-21T23:00:39.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.462+0000 7f3cf59ff700 1 -- 172.21.15.151:0/666018801 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf01a4e20 con 0x7f3cf0107080 2023-07-21T23:00:39.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.469+0000 7f3d093afb80 1 Processor -- start 2023-07-21T23:00:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.469+0000 7f3d093afb80 1 -- start start 2023-07-21T23:00:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.470+0000 7f3cf49fd700 1 -- 172.21.15.151:0/666018801 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f3ce800db20 con 0x7f3cf0107080 2023-07-21T23:00:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.470+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf3931df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.470+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3929f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.470+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf392a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.470+0000 7f3d093afb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf3832c50 con 0x55bdf3932330 2023-07-21T23:00:39.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.470+0000 7f3d093afb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf38859e0 con 0x55bdf37896b0 2023-07-21T23:00:39.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.470+0000 7f3d093afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf387ee70 con 0x55bdf392a460 2023-07-21T23:00:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ce67fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf3931df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ce67fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf3931df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55664/0 (socket says 172.21.15.151:55664) 2023-07-21T23:00:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ce67fc700 1 -- 172.21.15.151:0/3676779491 learned_addr learned my addr 172.21.15.151:0/3676779491 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:39.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/3676779491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf392a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ceeffd700 1 --2- 172.21.15.151:0/3676779491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3929f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ce67fc700 1 -- 172.21.15.151:0/3676779491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 msgr2=0x55bdf392a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/3676779491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf392a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ce67fc700 1 -- 172.21.15.151:0/3676779491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 msgr2=0x55bdf3929f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/3676779491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3929f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.471+0000 7f3ce67fc700 1 -- 172.21.15.151:0/3676779491 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdf36acd80 con 0x55bdf37896b0 2023-07-21T23:00:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.472+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/3676779491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf3931df0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009fd0 tx=0x7f3ce0009550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d11b990e114fcf07 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:39.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.472+0000 7f3cf49fd700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3cdc0a13c0 0x7f3cdc0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.472+0000 7f3cf49fd700 1 -- 172.21.15.151:0/666018801 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3ce80cc410 con 0x7f3cf0107080 2023-07-21T23:00:39.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.472+0000 7f3ce5ffb700 1 -- 172.21.15.151:0/3676779491 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0018450 con 0x55bdf37896b0 2023-07-21T23:00:39.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.473+0000 7f3ce5ffb700 1 -- 172.21.15.151:0/3676779491 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ce0018a40 con 0x55bdf37896b0 2023-07-21T23:00:39.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.473+0000 7f3ce5ffb700 1 -- 172.21.15.151:0/3676779491 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce00167f0 con 0x55bdf37896b0 2023-07-21T23:00:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.473+0000 7f3ceeffd700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3cdc0a13c0 0x7f3cdc0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.473+0000 7f3d093afb80 1 -- 172.21.15.151:0/3676779491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 msgr2=0x55bdf3931df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.473+0000 7f3d093afb80 1 --2- 172.21.15.151:0/3676779491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf3931df0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3ce0009fd0 tx=0x7f3ce0009550 comp rx=0 tx=0).stop 2023-07-21T23:00:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.474+0000 7f3d093afb80 1 -- 172.21.15.151:0/3676779491 shutdown_connections 2023-07-21T23:00:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.474+0000 7f3d093afb80 1 --2- 172.21.15.151:0/3676779491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf3931df0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.474+0000 7f3d093afb80 1 --2- 172.21.15.151:0/3676779491 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf392a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.474+0000 7f3d093afb80 1 --2- 172.21.15.151:0/3676779491 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3929f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.474+0000 7f3d093afb80 1 -- 172.21.15.151:0/3676779491 >> 172.21.15.151:0/3676779491 conn(0x55bdf3922ae0 msgr2=0x55bdf39280e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:39.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.475+0000 7f3ceeffd700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3cdc0a13c0 0x7f3cdc0a3870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009990 tx=0x7f3cd8005ab0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.475+0000 7f3d093afb80 1 -- 172.21.15.151:0/3676779491 shutdown_connections 2023-07-21T23:00:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.475+0000 7f3d093afb80 1 -- 172.21.15.151:0/3676779491 wait complete. 2023-07-21T23:00:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.476+0000 7f3d093afb80 1 -- start start 2023-07-21T23:00:39.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.476+0000 7f3d093afb80 1 Processor -- start 2023-07-21T23:00:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf39474e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3947bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3d093afb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf381ea60 con 0x55bdf3932330 2023-07-21T23:00:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3d093afb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf381e760 con 0x55bdf37896b0 2023-07-21T23:00:39.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3d093afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf37028c0 con 0x55bdf392a460 2023-07-21T23:00:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3d093afb80 10 client.0 _ll_register_callbacks cb 0x55bdf381c700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:00:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3ceeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3ceeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55666/0 (socket says 172.21.15.151:55666) 2023-07-21T23:00:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.477+0000 7f3ceeffd700 1 -- 172.21.15.151:0/1295073181 learned_addr learned my addr 172.21.15.151:0/1295073181 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.478+0000 7f3cef7fe700 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3947bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.478+0000 7f3ceeffd700 1 -- 172.21.15.151:0/1295073181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 msgr2=0x55bdf39474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:39.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.478+0000 7f3ceeffd700 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf39474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.478+0000 7f3ceeffd700 1 -- 172.21.15.151:0/1295073181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 msgr2=0x55bdf3947bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.478+0000 7f3ceeffd700 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3947bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.478+0000 7f3ceeffd700 1 -- 172.21.15.151:0/1295073181 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce0017460 con 0x55bdf37896b0 2023-07-21T23:00:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.479+0000 7f3ceeffd700 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394a260 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8015000 tx=0x7f3cd8009cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53b585e215fcb5ca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.479+0000 7f3cceffd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:00:39.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.480+0000 7f3cceffd700 1 -- 172.21.15.151:0/1295073181 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd801d040 con 0x55bdf37896b0 2023-07-21T23:00:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.480+0000 7f3cceffd700 1 -- 172.21.15.151:0/1295073181 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3cd8004500 con 0x55bdf37896b0 2023-07-21T23:00:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.480+0000 7f3d093afb80 1 -- 172.21.15.151:0/1295073181 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55bdf37d8490 con 0x55bdf37896b0 2023-07-21T23:00:39.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.480+0000 7f3cceffd700 1 -- 172.21.15.151:0/1295073181 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3cd800bec0 con 0x55bdf37896b0 2023-07-21T23:00:39.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.482+0000 7f3d093afb80 10 client.29192 fetch_fsmap learned FSMap version 114 2023-07-21T23:00:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.482+0000 7f3d093afb80 1 -- 172.21.15.151:0/1295073181 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x55bdf3695c00 con 0x55bdf37896b0 2023-07-21T23:00:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.482+0000 7f3cceffd700 1 -- 172.21.15.151:0/1295073181 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55bdf37d8490 con 0x55bdf37896b0 2023-07-21T23:00:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.483+0000 7f3cceffd700 1 -- 172.21.15.151:0/1295073181 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 114) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3cd8024570 con 0x55bdf37896b0 2023-07-21T23:00:39.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.483+0000 7f3d093afb80 10 client.29192 fetch_fsmap finished waiting for FSMap version 114 2023-07-21T23:00:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.483+0000 7f3d093afb80 10 client.29192 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:00:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.483+0000 7f3d093afb80 20 client.29192 populate_metadata read hostname 'smithi151' 2023-07-21T23:00:39.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.483+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bdf39579c0 0x55bdf3959dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.483+0000 7f3d093afb80 4 client.29192 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:00:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.483+0000 7f3d093afb80 1 -- 172.21.15.151:0/1295073181 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55bdf3877e50 con 0x55bdf39579c0 2023-07-21T23:00:39.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.484+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bdf39579c0 0x55bdf3959dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.485+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bdf39579c0 0x55bdf3959dd0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5d347b92cc96fd2 server_cookie=4158d475d866d417 in_seq=0 out_seq=0 2023-07-21T23:00:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.485+0000 7f3cceffd700 10 client.29192 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.486+0000 7f3cceffd700 1 -- 172.21.15.151:0/1295073181 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55bdf3877e50 con 0x55bdf39579c0 2023-07-21T23:00:39.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.486+0000 7f3cceffd700 10 client.29192 handle_command_reply: tid=0 2023-07-21T23:00:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.486+0000 7f3d093afb80 1 client.29192 shutdown 2023-07-21T23:00:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.486+0000 7f3d093afb80 1 -- 172.21.15.151:0/1295073181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 msgr2=0x55bdf394a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.486+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394a260 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8015000 tx=0x7f3cd8009cd0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3d093afb80 1 -- 172.21.15.151:0/1295073181 shutdown_connections 2023-07-21T23:00:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bdf39579c0 0x55bdf3959dd0 crc :-1 s=READY pgs=469 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394a260 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3947bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1295073181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf39474e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3d093afb80 1 -- 172.21.15.151:0/1295073181 >> 172.21.15.151:0/1295073181 conn(0x55bdf3922ae0 msgr2=0x55bdf39273e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3cceffd700 0 client.29192 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3d093afb80 1 -- 172.21.15.151:0/1295073181 shutdown_connections 2023-07-21T23:00:39.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3d093afb80 1 -- 172.21.15.151:0/1295073181 wait complete. 2023-07-21T23:00:39.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.487+0000 7f3d093afb80 20 client.29192 trim_cache size 0 max 16384 2023-07-21T23:00:39.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.520+0000 7f3d093afb80 1 Processor -- start 2023-07-21T23:00:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.520+0000 7f3d093afb80 1 -- start start 2023-07-21T23:00:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.520+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.520+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf392bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.520+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3949d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.520+0000 7f3d093afb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf392b760 con 0x55bdf3932330 2023-07-21T23:00:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.520+0000 7f3d093afb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf3948200 con 0x55bdf37896b0 2023-07-21T23:00:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.520+0000 7f3d093afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf392c5a0 con 0x55bdf392a460 2023-07-21T23:00:39.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3cef7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3949d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3ceeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3cef7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3949d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35310/0 (socket says 172.21.15.151:35310) 2023-07-21T23:00:39.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3cef7fe700 1 -- 172.21.15.151:0/800544104 learned_addr learned my addr 172.21.15.151:0/800544104 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/800544104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf392bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3cef7fe700 1 -- 172.21.15.151:0/800544104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 msgr2=0x55bdf392bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3cef7fe700 1 --2- 172.21.15.151:0/800544104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf392bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3cef7fe700 1 -- 172.21.15.151:0/800544104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 msgr2=0x55bdf394ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3cef7fe700 1 --2- 172.21.15.151:0/800544104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.521+0000 7f3cef7fe700 1 -- 172.21.15.151:0/800544104 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55bdf36d31f0 con 0x55bdf3932330 2023-07-21T23:00:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.522+0000 7f3cef7fe700 1 --2- 172.21.15.151:0/800544104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3949d90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009510 tx=0x7f3ce800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64c5d2565bd23ce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:39.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.522+0000 7f3ce6ffd700 1 -- 172.21.15.151:0/800544104 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce8004c40 con 0x55bdf3932330 2023-07-21T23:00:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.522+0000 7f3ce6ffd700 1 -- 172.21.15.151:0/800544104 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ce80994a0 con 0x55bdf3932330 2023-07-21T23:00:39.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.522+0000 7f3ce6ffd700 1 -- 172.21.15.151:0/800544104 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce809d150 con 0x55bdf3932330 2023-07-21T23:00:39.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.523+0000 7f3d093afb80 1 -- 172.21.15.151:0/800544104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 msgr2=0x55bdf3949d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.523+0000 7f3d093afb80 1 --2- 172.21.15.151:0/800544104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3949d90 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8009510 tx=0x7f3ce800b040 comp rx=0 tx=0).stop 2023-07-21T23:00:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.525+0000 7f3d093afb80 1 -- 172.21.15.151:0/800544104 shutdown_connections 2023-07-21T23:00:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.525+0000 7f3d093afb80 1 --2- 172.21.15.151:0/800544104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.525+0000 7f3d093afb80 1 --2- 172.21.15.151:0/800544104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf3949d90 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.525+0000 7f3d093afb80 1 --2- 172.21.15.151:0/800544104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf392bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.525+0000 7f3d093afb80 1 -- 172.21.15.151:0/800544104 >> 172.21.15.151:0/800544104 conn(0x55bdf3922ae0 msgr2=0x55bdf3953d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:39.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.529+0000 7f3d093afb80 1 -- 172.21.15.151:0/800544104 shutdown_connections 2023-07-21T23:00:39.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.529+0000 7f3d093afb80 1 -- 172.21.15.151:0/800544104 wait complete. 2023-07-21T23:00:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.530+0000 7f3d093afb80 1 -- start start 2023-07-21T23:00:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.530+0000 7f3d093afb80 1 Processor -- start 2023-07-21T23:00:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.531+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.531+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf394cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.531+0000 7f3d093afb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf394d180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.531+0000 7f3d093afb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf394d6c0 con 0x55bdf3932330 2023-07-21T23:00:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.531+0000 7f3d093afb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf394d830 con 0x55bdf37896b0 2023-07-21T23:00:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.531+0000 7f3d093afb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55bdf394d9f0 con 0x55bdf392a460 2023-07-21T23:00:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.531+0000 7f3d093afb80 10 client.0 _ll_register_callbacks cb 0x7f3cd800baa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:00:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.532+0000 7f3ce67fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf394cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.532+0000 7f3ceeffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.532+0000 7f3ce67fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf394cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54934/0 (socket says 172.21.15.151:54934) 2023-07-21T23:00:39.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.532+0000 7f3ce67fc700 1 -- 172.21.15.151:0/1112561600 learned_addr learned my addr 172.21.15.151:0/1112561600 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.532+0000 7f3cef7fe700 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf394d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.533+0000 7f3ce67fc700 1 -- 172.21.15.151:0/1112561600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 msgr2=0x55bdf394e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.533+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.533+0000 7f3ce67fc700 1 -- 172.21.15.151:0/1112561600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 msgr2=0x55bdf394d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.533+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf394d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.533+0000 7f3ce67fc700 1 -- 172.21.15.151:0/1112561600 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf01a4e20 con 0x55bdf392a460 2023-07-21T23:00:39.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.533+0000 7f3ce67fc700 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf394cc40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00093b0 tx=0x7f3ce0006df0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48685f6ad7006527 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:39.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.534+0000 7f3cceffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:00:39.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.534+0000 7f3cceffd700 1 -- 172.21.15.151:0/1112561600 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce0028d30 con 0x55bdf392a460 2023-07-21T23:00:39.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.534+0000 7f3d093afb80 1 -- 172.21.15.151:0/1112561600 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3ce0018a40 con 0x55bdf392a460 2023-07-21T23:00:39.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.534+0000 7f3cceffd700 1 -- 172.21.15.151:0/1112561600 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3ce00281c0 con 0x55bdf392a460 2023-07-21T23:00:39.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.534+0000 7f3cceffd700 1 -- 172.21.15.151:0/1112561600 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3ce0028e90 con 0x55bdf392a460 2023-07-21T23:00:39.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.534+0000 7f3d093afb80 10 client.29212 fetch_fsmap learned FSMap version 114 2023-07-21T23:00:39.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.534+0000 7f3d093afb80 1 -- 172.21.15.151:0/1112561600 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x55bdf36ab250 con 0x55bdf392a460 2023-07-21T23:00:39.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.534+0000 7f3cceffd700 1 -- 172.21.15.151:0/1112561600 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3ce0018a40 con 0x55bdf392a460 2023-07-21T23:00:39.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.535+0000 7f3cceffd700 1 -- 172.21.15.151:0/1112561600 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 114) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f3ce003a460 con 0x55bdf392a460 2023-07-21T23:00:39.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.535+0000 7f3d093afb80 10 client.29212 fetch_fsmap finished waiting for FSMap version 114 2023-07-21T23:00:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.535+0000 7f3d093afb80 10 client.29212 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:00:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.535+0000 7f3d093afb80 20 client.29212 populate_metadata read hostname 'smithi151' 2023-07-21T23:00:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.535+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bdf39a6ae0 0x55bdf39a6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.536+0000 7f3d093afb80 4 client.29212 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:00:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.536+0000 7f3d093afb80 1 -- 172.21.15.151:0/1112561600 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55bdf3839ff0 con 0x55bdf39a6ae0 2023-07-21T23:00:39.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.536+0000 7f3ceeffd700 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bdf39a6ae0 0x55bdf39a6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.537+0000 7f3ceeffd700 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bdf39a6ae0 0x55bdf39a6ee0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=245fe625167e1e4e server_cookie=35d947e1c09827dd in_seq=0 out_seq=0 2023-07-21T23:00:39.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.537+0000 7f3cceffd700 10 client.29212 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.583+0000 7f3cceffd700 1 -- 172.21.15.151:0/1112561600 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55bdf3839ff0 con 0x55bdf39a6ae0 2023-07-21T23:00:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.583+0000 7f3cceffd700 10 client.29212 handle_command_reply: tid=0 2023-07-21T23:00:39.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.583+0000 7f3d093afb80 1 client.29212 shutdown 2023-07-21T23:00:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 -- 172.21.15.151:0/1112561600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 msgr2=0x55bdf394cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:39.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf394cc40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3ce00093b0 tx=0x7f3ce0006df0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 -- 172.21.15.151:0/1112561600 shutdown_connections 2023-07-21T23:00:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55bdf39a6ae0 0x55bdf39a6ee0 crc :-1 s=READY pgs=470 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55bdf37896b0 0x55bdf394e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bdf3932330 0x55bdf394d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 --2- 172.21.15.151:0/1112561600 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55bdf392a460 0x55bdf394cc40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 -- 172.21.15.151:0/1112561600 >> 172.21.15.151:0/1112561600 conn(0x55bdf3922ae0 msgr2=0x55bdf392bbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3cceffd700 0 client.29212 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 -- 172.21.15.151:0/1112561600 shutdown_connections 2023-07-21T23:00:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.585+0000 7f3d093afb80 1 -- 172.21.15.151:0/1112561600 wait complete. 2023-07-21T23:00:39.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.587+0000 7f3d093afb80 20 client.29212 trim_cache size 0 max 16384 2023-07-21T23:00:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:00:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:00:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:00:39.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:00:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.587+0000 7f3cf59ff700 1 -- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3cdc0a13c0 msgr2=0x7f3cdc0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.587+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3cdc0a13c0 0x7f3cdc0a3870 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8009990 tx=0x7f3cd8005ab0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.587+0000 7f3cf59ff700 1 -- 172.21.15.151:0/666018801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0107080 msgr2=0x7f3cf019c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.587+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0107080 0x7f3cf019c990 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3ce8007ee0 tx=0x7f3ce800d3b0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.588+0000 7f3cf59ff700 1 -- 172.21.15.151:0/666018801 shutdown_connections 2023-07-21T23:00:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.588+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3cdc0a13c0 0x7f3cdc0a3870 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.588+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cf0102040 0x7f3cf0197de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.588+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3cf0107080 0x7f3cf019c990 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.588+0000 7f3cf59ff700 1 --2- 172.21.15.151:0/666018801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cf01029e0 0x7f3cf0198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:39.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.588+0000 7f3cf59ff700 1 -- 172.21.15.151:0/666018801 >> 172.21.15.151:0/666018801 conn(0x7f3cf00fd8d0 msgr2=0x7f3cf0105a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.591+0000 7f3cf59ff700 1 -- 172.21.15.151:0/666018801 shutdown_connections 2023-07-21T23:00:39.628 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:39.591+0000 7f3cf59ff700 1 -- 172.21.15.151:0/666018801 wait complete. 2023-07-21T23:00:41.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:40 smithi187 ceph-mon[96918]: pgmap v1321: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 970 op/s 2023-07-21T23:00:41.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:40 smithi195 ceph-mon[97365]: pgmap v1321: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 970 op/s 2023-07-21T23:00:41.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:40 smithi151 ceph-mon[95510]: pgmap v1321: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 970 op/s 2023-07-21T23:00:43.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:42 smithi187 ceph-mon[96918]: pgmap v1322: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 970 op/s 2023-07-21T23:00:43.436 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:42 smithi195 ceph-mon[97365]: pgmap v1322: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 970 op/s 2023-07-21T23:00:43.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:42 smithi151 ceph-mon[95510]: pgmap v1322: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 10 MiB/s wr, 970 op/s 2023-07-21T23:00:44.291 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 470.0 s, 351.2 tps, lat 269.359 ms stddev 72.902 2023-07-21T23:00:45.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:44 smithi187 ceph-mon[96918]: pgmap v1323: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 15 MiB/s wr, 1.47k op/s 2023-07-21T23:00:45.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:44 smithi195 ceph-mon[97365]: pgmap v1323: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 15 MiB/s wr, 1.47k op/s 2023-07-21T23:00:45.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:44 smithi151 ceph-mon[95510]: pgmap v1323: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 15 MiB/s wr, 1.47k op/s 2023-07-21T23:00:46.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:45 smithi187 ceph-mon[96918]: pgmap v1324: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.9 MiB/s wr, 975 op/s 2023-07-21T23:00:46.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:45 smithi195 ceph-mon[97365]: pgmap v1324: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.9 MiB/s wr, 975 op/s 2023-07-21T23:00:46.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:45 smithi151 ceph-mon[95510]: pgmap v1324: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.9 MiB/s wr, 975 op/s 2023-07-21T23:00:49.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 475.0 s, 221.2 tps, lat 458.284 ms stddev 502.253 2023-07-21T23:00:49.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:48 smithi187 ceph-mon[96918]: pgmap v1325: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T23:00:49.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:48 smithi195 ceph-mon[97365]: pgmap v1325: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T23:00:49.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:48 smithi151 ceph-mon[95510]: pgmap v1325: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.39k op/s 2023-07-21T23:00:51.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:50 smithi187 ceph-mon[96918]: pgmap v1326: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.2 MiB/s wr, 906 op/s 2023-07-21T23:00:51.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:50 smithi195 ceph-mon[97365]: pgmap v1326: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.2 MiB/s wr, 906 op/s 2023-07-21T23:00:51.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:50 smithi151 ceph-mon[95510]: pgmap v1326: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.2 MiB/s wr, 906 op/s 2023-07-21T23:00:52.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:51 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:00:52.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:51 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:00:52.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:51 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:00:52.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.882+0000 7f62211ff700 1 -- 172.21.15.151:0/1434816205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c10e2a0 msgr2=0x7f621c10e670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:52.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.882+0000 7f62211ff700 1 --2- 172.21.15.151:0/1434816205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c10e2a0 0x7f621c10e670 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f6204009990 tx=0x7f6204009ca0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.882+0000 7f62211ff700 1 -- 172.21.15.151:0/1434816205 shutdown_connections 2023-07-21T23:00:52.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.882+0000 7f62211ff700 1 --2- 172.21.15.151:0/1434816205 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f621c06d3a0 0x7f621c11b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.882+0000 7f62211ff700 1 --2- 172.21.15.151:0/1434816205 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c10e2a0 0x7f621c10e670 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.882+0000 7f62211ff700 1 --2- 172.21.15.151:0/1434816205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f621c06c910 0x7f621c06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.882+0000 7f62211ff700 1 -- 172.21.15.151:0/1434816205 >> 172.21.15.151:0/1434816205 conn(0x7f621c06bd70 msgr2=0x7f621c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.882+0000 7f62211ff700 1 -- 172.21.15.151:0/1434816205 shutdown_connections 2023-07-21T23:00:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.882+0000 7f62211ff700 1 -- 172.21.15.151:0/1434816205 wait complete. 2023-07-21T23:00:52.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.884+0000 7f62211ff700 1 Processor -- start 2023-07-21T23:00:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.884+0000 7f62211ff700 1 -- start start 2023-07-21T23:00:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f62211ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c06c910 0x7f621c1aa930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f62211ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f621c06d3a0 0x7f621c1aae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f62211ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f621c10e2a0 0x7f621c1a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f62211ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1a4e00 con 0x7f621c10e2a0 2023-07-21T23:00:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f62211ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1a4f70 con 0x7f621c06d3a0 2023-07-21T23:00:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f62211ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f621c1a5130 con 0x7f621c06c910 2023-07-21T23:00:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f621ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c06c910 0x7f621c1aa930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f621ad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c06c910 0x7f621c1aa930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43042/0 (socket says 172.21.15.151:43042) 2023-07-21T23:00:52.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f621ad9d700 1 -- 172.21.15.151:0/1246490983 learned_addr learned my addr 172.21.15.151:0/1246490983 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f621259c700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f621c06d3a0 0x7f621c1aae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.885+0000 7f621b59e700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f621c10e2a0 0x7f621c1a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.886+0000 7f621ad9d700 1 -- 172.21.15.151:0/1246490983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f621c06d3a0 msgr2=0x7f621c1aae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.886+0000 7f621ad9d700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f621c06d3a0 0x7f621c1aae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.886+0000 7f621ad9d700 1 -- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f621c10e2a0 msgr2=0x7f621c1a4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:52.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.886+0000 7f621ad9d700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f621c10e2a0 0x7f621c1a4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.886+0000 7f621ad9d700 1 -- 172.21.15.151:0/1246490983 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62040095f0 con 0x7f621c06c910 2023-07-21T23:00:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.886+0000 7f621b59e700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f621c10e2a0 0x7f621c1a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:00:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.886+0000 7f621ad9d700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c06c910 0x7f621c1aa930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6204000c00 tx=0x7f6204004730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.886+0000 7f6218d99700 1 -- 172.21.15.151:0/1246490983 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620401d070 con 0x7f621c06c910 2023-07-21T23:00:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.887+0000 7f62211ff700 1 -- 172.21.15.151:0/1246490983 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f621c1a53b0 con 0x7f621c06c910 2023-07-21T23:00:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.887+0000 7f6218d99700 1 -- 172.21.15.151:0/1246490983 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6204022470 con 0x7f621c06c910 2023-07-21T23:00:52.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.887+0000 7f6218d99700 1 -- 172.21.15.151:0/1246490983 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6204017650 con 0x7f621c06c910 2023-07-21T23:00:52.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.887+0000 7f62211ff700 1 -- 172.21.15.151:0/1246490983 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c1b1920 con 0x7f621c06c910 2023-07-21T23:00:52.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.891+0000 7f6218d99700 1 -- 172.21.15.151:0/1246490983 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f62040225e0 con 0x7f621c06c910 2023-07-21T23:00:52.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.893+0000 7f6234ad1b80 1 Processor -- start 2023-07-21T23:00:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.894+0000 7f6218d99700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62080a1340 0x7f62080a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.895+0000 7f6218d99700 1 -- 172.21.15.151:0/1246490983 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(161..161 src has 1..161) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f62040ce140 con 0x7f621c06c910 2023-07-21T23:00:52.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.896+0000 7f6234ad1b80 1 -- start start 2023-07-21T23:00:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.897+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4c216b0 0x563da4dcacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.897+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dc4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.897+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dc54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.897+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4ccac50 con 0x563da4dcb210 2023-07-21T23:00:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.897+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4d1d9e0 con 0x563da4c216b0 2023-07-21T23:00:52.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.897+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4d16e70 con 0x563da4dcb660 2023-07-21T23:00:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.897+0000 7f621ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4c216b0 0x563da4dcacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.897+0000 7f621ad9d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4c216b0 0x563da4dcacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37306/0 (socket says 172.21.15.151:37306) 2023-07-21T23:00:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.897+0000 7f621ad9d700 1 -- 172.21.15.151:0/4283513688 learned_addr learned my addr 172.21.15.151:0/4283513688 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:52.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.898+0000 7f621b59e700 1 --2- 172.21.15.151:0/4283513688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dc54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.901+0000 7f621b59e700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62080a1340 0x7f62080a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.902+0000 7f621ad9d700 1 -- 172.21.15.151:0/4283513688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 msgr2=0x563da4dc54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:52.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.902+0000 7f621ad9d700 1 --2- 172.21.15.151:0/4283513688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dc54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.902+0000 7f621ad9d700 1 -- 172.21.15.151:0/4283513688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 msgr2=0x563da4dc4f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:00:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.902+0000 7f621ad9d700 1 --2- 172.21.15.151:0/4283513688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dc4f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.902+0000 7f621ad9d700 1 -- 172.21.15.151:0/4283513688 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563da4b44d80 con 0x563da4c216b0 2023-07-21T23:00:52.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.903+0000 7f621b59e700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62080a1340 0x7f62080a37f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f621c1ab630 tx=0x7f6214012240 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:52.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.903+0000 7f621ad9d700 1 --2- 172.21.15.151:0/4283513688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4c216b0 0x563da4dcacd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6204009350 tx=0x7f620409b150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec4e8ac7ffbc3a57 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.903+0000 7f621159a700 1 -- 172.21.15.151:0/4283513688 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620409b260 con 0x563da4c216b0 2023-07-21T23:00:52.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.904+0000 7f621159a700 1 -- 172.21.15.151:0/4283513688 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f620409f290 con 0x563da4c216b0 2023-07-21T23:00:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.904+0000 7f621159a700 1 -- 172.21.15.151:0/4283513688 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620409b4c0 con 0x563da4c216b0 2023-07-21T23:00:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.905+0000 7f6234ad1b80 1 -- 172.21.15.151:0/4283513688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4c216b0 msgr2=0x563da4dcacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.905+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/4283513688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4c216b0 0x563da4dcacd0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f6204009350 tx=0x7f620409b150 comp rx=0 tx=0).stop 2023-07-21T23:00:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.905+0000 7f6234ad1b80 1 -- 172.21.15.151:0/4283513688 shutdown_connections 2023-07-21T23:00:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.905+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/4283513688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4c216b0 0x563da4dcacd0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.905+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/4283513688 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dc54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.905+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/4283513688 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dc4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.905+0000 7f6234ad1b80 1 -- 172.21.15.151:0/4283513688 >> 172.21.15.151:0/4283513688 conn(0x563da4dbaae0 msgr2=0x563da4dc00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:52.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.905+0000 7f6234ad1b80 1 -- 172.21.15.151:0/4283513688 shutdown_connections 2023-07-21T23:00:52.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.906+0000 7f6234ad1b80 1 -- 172.21.15.151:0/4283513688 wait complete. 2023-07-21T23:00:52.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.907+0000 7f6234ad1b80 1 -- start start 2023-07-21T23:00:52.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.907+0000 7f6234ad1b80 1 Processor -- start 2023-07-21T23:00:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.908+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4c216b0 0x563da4dd1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.908+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4dcb210 0x563da4dce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.908+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dceab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.908+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4cb6a60 con 0x563da4c216b0 2023-07-21T23:00:52.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.908+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4cb6760 con 0x563da4dcb210 2023-07-21T23:00:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.908+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4b9a8c0 con 0x563da4dcb660 2023-07-21T23:00:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.908+0000 7f6234ad1b80 10 client.0 _ll_register_callbacks cb 0x563da4cb4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:00:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.909+0000 7f621ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4c216b0 0x563da4dd1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.909+0000 7f621ad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4c216b0 0x563da4dd1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:53108/0 (socket says 172.21.15.151:53108) 2023-07-21T23:00:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.909+0000 7f621ad9d700 1 -- 172.21.15.151:0/2525355094 learned_addr learned my addr 172.21.15.151:0/2525355094 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.909+0000 7f621259c700 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4dcb210 0x563da4dce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.910+0000 7f621b59e700 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.910+0000 7f621ad9d700 1 -- 172.21.15.151:0/2525355094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 msgr2=0x563da4dceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.910+0000 7f621ad9d700 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.910+0000 7f621ad9d700 1 -- 172.21.15.151:0/2525355094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4dcb210 msgr2=0x563da4dce570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:52.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.910+0000 7f621ad9d700 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4dcb210 0x563da4dce570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.910+0000 7f621ad9d700 1 -- 172.21.15.151:0/2525355094 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f621c1b1920 con 0x563da4c216b0 2023-07-21T23:00:52.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.910+0000 7f621ad9d700 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4c216b0 0x563da4dd1250 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6204097760 tx=0x7f6204022c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e1e457d52500162 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:52.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.911+0000 7f62027fc700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:00:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.911+0000 7f62027fc700 1 -- 172.21.15.151:0/2525355094 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f620409b6c0 con 0x563da4c216b0 2023-07-21T23:00:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.911+0000 7f62027fc700 1 -- 172.21.15.151:0/2525355094 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f62040a3620 con 0x563da4c216b0 2023-07-21T23:00:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.911+0000 7f6234ad1b80 1 -- 172.21.15.151:0/2525355094 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563da4c70490 con 0x563da4c216b0 2023-07-21T23:00:52.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.911+0000 7f62027fc700 1 -- 172.21.15.151:0/2525355094 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f620409b260 con 0x563da4c216b0 2023-07-21T23:00:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.911+0000 7f6234ad1b80 10 client.19533 fetch_fsmap learned FSMap version 114 2023-07-21T23:00:52.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.911+0000 7f6234ad1b80 1 -- 172.21.15.151:0/2525355094 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x563da4b2dc00 con 0x563da4c216b0 2023-07-21T23:00:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.912+0000 7f62027fc700 1 -- 172.21.15.151:0/2525355094 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f62040cb030 con 0x563da4c216b0 2023-07-21T23:00:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.912+0000 7f62027fc700 1 -- 172.21.15.151:0/2525355094 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 114) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f62040b3c80 con 0x563da4c216b0 2023-07-21T23:00:52.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.912+0000 7f6234ad1b80 10 client.19533 fetch_fsmap finished waiting for FSMap version 114 2023-07-21T23:00:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.912+0000 7f6234ad1b80 10 client.19533 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:00:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.912+0000 7f6234ad1b80 20 client.19533 populate_metadata read hostname 'smithi151' 2023-07-21T23:00:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.912+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563da4def1a0 0x563da4df1580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.912+0000 7f6234ad1b80 4 client.19533 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:00:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.912+0000 7f6234ad1b80 1 -- 172.21.15.151:0/2525355094 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563da4d0fe50 con 0x563da4def1a0 2023-07-21T23:00:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.913+0000 7f621259c700 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563da4def1a0 0x563da4df1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.914+0000 7f621259c700 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563da4def1a0 0x563da4df1580 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=383754ac90537c53 server_cookie=95dd1ed2f8b34742 in_seq=0 out_seq=0 2023-07-21T23:00:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.914+0000 7f62027fc700 10 client.19533 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.914+0000 7f62027fc700 1 -- 172.21.15.151:0/2525355094 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x563da4d0fe50 con 0x563da4def1a0 2023-07-21T23:00:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.914+0000 7f62027fc700 10 client.19533 handle_command_reply: tid=0 2023-07-21T23:00:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.914+0000 7f6234ad1b80 1 client.19533 shutdown 2023-07-21T23:00:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.915+0000 7f6234ad1b80 1 -- 172.21.15.151:0/2525355094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4c216b0 msgr2=0x563da4dd1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.915+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4c216b0 0x563da4dd1250 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6204097760 tx=0x7f6204022c30 comp rx=0 tx=0).stop 2023-07-21T23:00:52.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.915+0000 7f6234ad1b80 1 -- 172.21.15.151:0/2525355094 shutdown_connections 2023-07-21T23:00:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.915+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563da4def1a0 0x563da4df1580 crc :-1 s=READY pgs=471 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.915+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dceab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.915+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4c216b0 0x563da4dd1250 secure :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f6204097760 tx=0x7f6204022c30 comp rx=0 tx=0).stop 2023-07-21T23:00:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.915+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/2525355094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4dcb210 0x563da4dce570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.915+0000 7f6234ad1b80 1 -- 172.21.15.151:0/2525355094 >> 172.21.15.151:0/2525355094 conn(0x563da4dbaae0 msgr2=0x563da4dbf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.915+0000 7f62027fc700 0 client.19533 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:52.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.916+0000 7f6234ad1b80 1 -- 172.21.15.151:0/2525355094 shutdown_connections 2023-07-21T23:00:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.916+0000 7f6234ad1b80 1 -- 172.21.15.151:0/2525355094 wait complete. 2023-07-21T23:00:52.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.916+0000 7f6234ad1b80 20 client.19533 trim_cache size 0 max 16384 2023-07-21T23:00:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.942+0000 7f6234ad1b80 1 Processor -- start 2023-07-21T23:00:52.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.943+0000 7f6234ad1b80 1 -- start start 2023-07-21T23:00:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.943+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dcc120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.943+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4dcb660 0x563da4debbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.943+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4de6bb0 0x563da4dcd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.943+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4dec170 con 0x563da4dcb210 2023-07-21T23:00:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.943+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4dcfa30 con 0x563da4dcb660 2023-07-21T23:00:52.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.943+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4dc0ed0 con 0x563da4de6bb0 2023-07-21T23:00:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.944+0000 7f621b59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4de6bb0 0x563da4dcd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.944+0000 7f621b59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4de6bb0 0x563da4dcd450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43058/0 (socket says 172.21.15.151:43058) 2023-07-21T23:00:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.944+0000 7f621b59e700 1 -- 172.21.15.151:0/792535865 learned_addr learned my addr 172.21.15.151:0/792535865 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:52.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.944+0000 7f621ad9d700 1 --2- 172.21.15.151:0/792535865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dcc120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.944+0000 7f621b59e700 1 -- 172.21.15.151:0/792535865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4dcb660 msgr2=0x563da4debbf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:00:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.944+0000 7f621b59e700 1 --2- 172.21.15.151:0/792535865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4dcb660 0x563da4debbf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.944+0000 7f621b59e700 1 -- 172.21.15.151:0/792535865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 msgr2=0x563da4dcc120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.944+0000 7f621b59e700 1 --2- 172.21.15.151:0/792535865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dcc120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:52.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.944+0000 7f621b59e700 1 -- 172.21.15.151:0/792535865 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563da4df6110 con 0x563da4de6bb0 2023-07-21T23:00:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.948+0000 7f621b59e700 1 --2- 172.21.15.151:0/792535865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4de6bb0 0x563da4dcd450 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6214009a00 tx=0x7f621401f000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d68980f160be46dc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.949+0000 7f6211d9b700 1 -- 172.21.15.151:0/792535865 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400e040 con 0x563da4de6bb0 2023-07-21T23:00:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.949+0000 7f6211d9b700 1 -- 172.21.15.151:0/792535865 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f621401e070 con 0x563da4de6bb0 2023-07-21T23:00:52.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.949+0000 7f6211d9b700 1 -- 172.21.15.151:0/792535865 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6214004870 con 0x563da4de6bb0 2023-07-21T23:00:52.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.952+0000 7f6234ad1b80 1 -- 172.21.15.151:0/792535865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4de6bb0 msgr2=0x563da4dcd450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:52.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.952+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/792535865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4de6bb0 0x563da4dcd450 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f6214009a00 tx=0x7f621401f000 comp rx=0 tx=0).stop 2023-07-21T23:00:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.967+0000 7f6234ad1b80 1 -- 172.21.15.151:0/792535865 shutdown_connections 2023-07-21T23:00:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.967+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/792535865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4de6bb0 0x563da4dcd450 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.967+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/792535865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dcc120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.967+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/792535865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4dcb660 0x563da4debbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.967+0000 7f6234ad1b80 1 -- 172.21.15.151:0/792535865 >> 172.21.15.151:0/792535865 conn(0x563da4dbaae0 msgr2=0x563da4dccd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:53.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.974+0000 7f6234ad1b80 1 -- 172.21.15.151:0/792535865 shutdown_connections 2023-07-21T23:00:53.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.974+0000 7f6234ad1b80 1 -- 172.21.15.151:0/792535865 wait complete. 2023-07-21T23:00:53.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.975+0000 7f6234ad1b80 1 -- start start 2023-07-21T23:00:53.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.975+0000 7f6234ad1b80 1 Processor -- start 2023-07-21T23:00:53.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.977+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dc7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.977+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dc8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.977+0000 7f6234ad1b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4de6bb0 0x563da4de5c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.977+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4de6350 con 0x563da4dcb210 2023-07-21T23:00:53.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.977+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4de64c0 con 0x563da4de6bb0 2023-07-21T23:00:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.977+0000 7f6234ad1b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x563da4de6680 con 0x563da4dcb660 2023-07-21T23:00:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.977+0000 7f6234ad1b80 10 client.0 _ll_register_callbacks cb 0x563da4cb4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:00:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.977+0000 7f621b59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4de6bb0 0x563da4de5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:53.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.977+0000 7f621b59e700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4de6bb0 0x563da4de5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37324/0 (socket says 172.21.15.151:37324) 2023-07-21T23:00:53.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.978+0000 7f621b59e700 1 -- 172.21.15.151:0/146868847 learned_addr learned my addr 172.21.15.151:0/146868847 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:00:53.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.978+0000 7f621b59e700 1 -- 172.21.15.151:0/146868847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 msgr2=0x563da4dc8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:53.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.978+0000 7f621b59e700 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dc8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.978+0000 7f621b59e700 1 -- 172.21.15.151:0/146868847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 msgr2=0x563da4dc7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:00:53.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.978+0000 7f621b59e700 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dc7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.978+0000 7f621b59e700 1 -- 172.21.15.151:0/146868847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6214012430 con 0x563da4de6bb0 2023-07-21T23:00:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.979+0000 7f621b59e700 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4de6bb0 0x563da4de5c80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f621401a010 tx=0x7f62140049b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dff3aeac6eeaff2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:00:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.979+0000 7f62027fc700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:00:53.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.979+0000 7f62027fc700 1 -- 172.21.15.151:0/146868847 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f621400e050 con 0x563da4de6bb0 2023-07-21T23:00:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.979+0000 7f62027fc700 1 -- 172.21.15.151:0/146868847 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(161..161 src has 1..161) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6214020070 con 0x563da4de6bb0 2023-07-21T23:00:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.980+0000 7f6234ad1b80 1 -- 172.21.15.151:0/146868847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f620409f290 con 0x563da4de6bb0 2023-07-21T23:00:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.981+0000 7f62027fc700 1 -- 172.21.15.151:0/146868847 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=114) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6214003e90 con 0x563da4de6bb0 2023-07-21T23:00:53.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.981+0000 7f6234ad1b80 10 client.29213 fetch_fsmap learned FSMap version 114 2023-07-21T23:00:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.981+0000 7f6234ad1b80 1 -- 172.21.15.151:0/146868847 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=114,monmap=4+}) v3 -- 0x563da4b6b1f0 con 0x563da4de6bb0 2023-07-21T23:00:53.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.983+0000 7f62027fc700 1 -- 172.21.15.151:0/146868847 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f620409f290 con 0x563da4de6bb0 2023-07-21T23:00:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.983+0000 7f62027fc700 1 -- 172.21.15.151:0/146868847 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 114) v1 ==== 7470+0+0 (secure 0 0 0) 0x7f6214007ca0 con 0x563da4de6bb0 2023-07-21T23:00:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.983+0000 7f6234ad1b80 10 client.29213 fetch_fsmap finished waiting for FSMap version 114 2023-07-21T23:00:53.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.983+0000 7f6234ad1b80 10 client.29213 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:00:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.983+0000 7f6234ad1b80 20 client.29213 populate_metadata read hostname 'smithi151' 2023-07-21T23:00:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.983+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563da4e44110 0x563da4e46520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:00:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.983+0000 7f6234ad1b80 4 client.29213 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:00:53.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.983+0000 7f6234ad1b80 1 -- 172.21.15.151:0/146868847 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x563da4cd1ff0 con 0x563da4e44110 2023-07-21T23:00:53.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.986+0000 7f621ad9d700 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563da4e44110 0x563da4e46520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:00:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.987+0000 7f621ad9d700 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563da4e44110 0x563da4e46520 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4fe41b43d1e50634 server_cookie=c5b9a56f2754fa64 in_seq=0 out_seq=0 2023-07-21T23:00:53.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:52.988+0000 7f62027fc700 10 client.29213 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.030+0000 7f62027fc700 1 -- 172.21.15.151:0/146868847 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x563da4cd1ff0 con 0x563da4e44110 2023-07-21T23:00:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.030+0000 7f62027fc700 10 client.29213 handle_command_reply: tid=0 2023-07-21T23:00:53.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.030+0000 7f6234ad1b80 1 client.29213 shutdown 2023-07-21T23:00:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.032+0000 7f6234ad1b80 1 -- 172.21.15.151:0/146868847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4de6bb0 msgr2=0x563da4de5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.032+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4de6bb0 0x563da4de5c80 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f621401a010 tx=0x7f62140049b0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.032+0000 7f6234ad1b80 1 -- 172.21.15.151:0/146868847 shutdown_connections 2023-07-21T23:00:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.032+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x563da4e44110 0x563da4e46520 crc :-1 s=READY pgs=472 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.032+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x563da4de6bb0 0x563da4de5c80 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.032+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563da4dcb210 0x563da4dc7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.032+0000 7f6234ad1b80 1 --2- 172.21.15.151:0/146868847 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x563da4dcb660 0x563da4dc8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.032+0000 7f6234ad1b80 1 -- 172.21.15.151:0/146868847 >> 172.21.15.151:0/146868847 conn(0x563da4dbaae0 msgr2=0x563da4deba60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:53.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.032+0000 7f62027fc700 0 client.29213 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:00:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.033+0000 7f6234ad1b80 1 -- 172.21.15.151:0/146868847 shutdown_connections 2023-07-21T23:00:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.033+0000 7f6234ad1b80 1 -- 172.21.15.151:0/146868847 wait complete. 2023-07-21T23:00:53.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.034+0000 7f6234ad1b80 20 client.29213 trim_cache size 0 max 16384 2023-07-21T23:00:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:00:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:00:53.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:00:53.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:00:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.035+0000 7f62211ff700 1 -- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62080a1340 msgr2=0x7f62080a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.035+0000 7f62211ff700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62080a1340 0x7f62080a37f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f621c1ab630 tx=0x7f6214012240 comp rx=0 tx=0).stop 2023-07-21T23:00:53.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.035+0000 7f62211ff700 1 -- 172.21.15.151:0/1246490983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c06c910 msgr2=0x7f621c1aa930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:00:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.035+0000 7f62211ff700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c06c910 0x7f621c1aa930 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f6204000c00 tx=0x7f6204004730 comp rx=0 tx=0).stop 2023-07-21T23:00:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.036+0000 7f62211ff700 1 -- 172.21.15.151:0/1246490983 shutdown_connections 2023-07-21T23:00:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.036+0000 7f62211ff700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f62080a1340 0x7f62080a37f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.036+0000 7f62211ff700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f621c10e2a0 0x7f621c1a4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.036+0000 7f62211ff700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f621c06c910 0x7f621c1aa930 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.036+0000 7f62211ff700 1 --2- 172.21.15.151:0/1246490983 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f621c06d3a0 0x7f621c1aae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:00:53.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.036+0000 7f62211ff700 1 -- 172.21.15.151:0/1246490983 >> 172.21.15.151:0/1246490983 conn(0x7f621c06bd70 msgr2=0x7f621c070860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:00:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.036+0000 7f62211ff700 1 -- 172.21.15.151:0/1246490983 shutdown_connections 2023-07-21T23:00:53.073 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:00:53.036+0000 7f62211ff700 1 -- 172.21.15.151:0/1246490983 wait complete. 2023-07-21T23:00:53.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:52 smithi187 ceph-mon[96918]: pgmap v1327: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.2 MiB/s wr, 906 op/s 2023-07-21T23:00:53.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:52 smithi195 ceph-mon[97365]: pgmap v1327: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.2 MiB/s wr, 906 op/s 2023-07-21T23:00:53.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:52 smithi151 ceph-mon[95510]: pgmap v1327: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.2 MiB/s wr, 906 op/s 2023-07-21T23:00:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 480.0 s, 338.4 tps, lat 309.070 ms stddev 386.023 2023-07-21T23:00:55.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:54 smithi187 ceph-mon[96918]: pgmap v1328: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 13 MiB/s wr, 1.28k op/s 2023-07-21T23:00:55.400 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:54 smithi195 ceph-mon[97365]: pgmap v1328: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 13 MiB/s wr, 1.28k op/s 2023-07-21T23:00:55.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:54 smithi151 ceph-mon[95510]: pgmap v1328: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 13 MiB/s wr, 1.28k op/s 2023-07-21T23:00:57.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:56 smithi187 ceph-mon[96918]: pgmap v1329: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.1 MiB/s wr, 788 op/s 2023-07-21T23:00:57.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:56 smithi195 ceph-mon[97365]: pgmap v1329: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.1 MiB/s wr, 788 op/s 2023-07-21T23:00:57.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:56 smithi151 ceph-mon[95510]: pgmap v1329: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 8.1 MiB/s wr, 788 op/s 2023-07-21T23:00:58.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:58 smithi187 ceph-mon[96918]: pgmap v1330: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 1.14k op/s 2023-07-21T23:00:58.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:58 smithi195 ceph-mon[97365]: pgmap v1330: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 1.14k op/s 2023-07-21T23:00:58.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:58 smithi151 ceph-mon[95510]: pgmap v1330: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 12 MiB/s wr, 1.14k op/s 2023-07-21T23:00:59.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 485.0 s, 278.6 tps, lat 353.995 ms stddev 396.691 2023-07-21T23:01:00.117 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:59 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:00.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:00:59 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:00.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:59 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:00.146 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:00:59 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:00.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:59 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:00.190 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:00:59 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:01.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:00 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:01:01.125 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:00 smithi187 ceph-mon[96918]: pgmap v1331: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.6 MiB/s wr, 728 op/s 2023-07-21T23:01:01.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.126 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:00 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:01:01.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:00 smithi195 ceph-mon[97365]: pgmap v1331: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.6 MiB/s wr, 728 op/s 2023-07-21T23:01:01.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.148 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:00 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:01:01.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:00 smithi151 ceph-mon[95510]: pgmap v1331: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.6 MiB/s wr, 728 op/s 2023-07-21T23:01:01.191 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:01.192 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:02.188 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:01 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T23:01:02.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:01 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T23:01:02.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:02.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:01 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:02.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:01 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T23:01:02.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:01 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T23:01:02.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:02.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:01 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:02.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:01 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T23:01:02.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:01 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T23:01:02.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:02.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:01 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:03.374 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:02 smithi187 ceph-mon[96918]: pgmap v1332: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.6 MiB/s wr, 728 op/s 2023-07-21T23:01:03.374 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:02 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:02 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:02 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:02 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:02 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:01:03.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:02 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:01:03.375 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:02 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:03.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:02 smithi195 ceph-mon[97365]: pgmap v1332: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.6 MiB/s wr, 728 op/s 2023-07-21T23:01:03.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:02 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:02 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:02 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:02 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:02 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:01:03.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:02 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:01:03.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:02 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:03.444 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:02 smithi151 ceph-mon[95510]: pgmap v1332: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.6 MiB/s wr, 728 op/s 2023-07-21T23:01:03.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:02 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:02 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:02 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.445 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:02 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:01:03.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:02 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:01:03.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:02 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:01:03.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:02 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:01:04.293 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 490.0 s, 299.5 tps, lat 309.204 ms stddev 184.787 2023-07-21T23:01:04.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:03 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T23:01:04.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:03 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:01:04.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:03 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T23:01:04.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:03 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:01:04.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:03 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T23:01:04.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:03 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:01:05.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:04 smithi187 ceph-mon[96918]: pgmap v1333: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.18k op/s 2023-07-21T23:01:05.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:04 smithi187 ceph-mon[96918]: osdmap e162: 12 total, 12 up, 12 in 2023-07-21T23:01:05.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:04 smithi195 ceph-mon[97365]: pgmap v1333: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.18k op/s 2023-07-21T23:01:05.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:04 smithi195 ceph-mon[97365]: osdmap e162: 12 total, 12 up, 12 in 2023-07-21T23:01:05.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:04 smithi151 ceph-mon[95510]: pgmap v1333: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.18k op/s 2023-07-21T23:01:05.446 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:04 smithi151 ceph-mon[95510]: osdmap e162: 12 total, 12 up, 12 in 2023-07-21T23:01:06.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:06 smithi187 ceph-mon[96918]: pgmap v1335: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.5 MiB/s wr, 964 op/s 2023-07-21T23:01:06.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:06 smithi195 ceph-mon[97365]: pgmap v1335: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.5 MiB/s wr, 964 op/s 2023-07-21T23:01:06.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:06 smithi151 ceph-mon[95510]: pgmap v1335: 97 pgs: 97 active+clean; 13 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.5 MiB/s wr, 964 op/s 2023-07-21T23:01:06.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.434+0000 7f81211ff700 1 -- 172.21.15.151:0/775851742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811c104a30 msgr2=0x7f811c104e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:06.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.434+0000 7f81211ff700 1 --2- 172.21.15.151:0/775851742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811c104a30 0x7f811c104e00 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f810c00ba80 tx=0x7f810c00bd90 comp rx=0 tx=0).stop 2023-07-21T23:01:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.441+0000 7f81211ff700 1 -- 172.21.15.151:0/775851742 shutdown_connections 2023-07-21T23:01:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.441+0000 7f81211ff700 1 --2- 172.21.15.151:0/775851742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c0ff3e0 0x7f811c10b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.441+0000 7f81211ff700 1 --2- 172.21.15.151:0/775851742 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811c104a30 0x7f811c104e00 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.441+0000 7f81211ff700 1 --2- 172.21.15.151:0/775851742 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f811c0fea30 0x7f811c0feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.441+0000 7f81211ff700 1 -- 172.21.15.151:0/775851742 >> 172.21.15.151:0/775851742 conn(0x7f811c074760 msgr2=0x7f811c074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.446+0000 7f81211ff700 1 -- 172.21.15.151:0/775851742 shutdown_connections 2023-07-21T23:01:06.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.446+0000 7f81211ff700 1 -- 172.21.15.151:0/775851742 wait complete. 2023-07-21T23:01:06.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.448+0000 7f81211ff700 1 Processor -- start 2023-07-21T23:01:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.449+0000 7f81211ff700 1 -- start start 2023-07-21T23:01:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.449+0000 7f81211ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f811c0fea30 0x7f811c113e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.449+0000 7f81211ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c0ff3e0 0x7f811c1143d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.449+0000 7f81211ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811c104a30 0x7f811c10dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.449+0000 7f81211ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c10e430 con 0x7f811c0fea30 2023-07-21T23:01:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.449+0000 7f81211ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c10e5a0 con 0x7f811c0ff3e0 2023-07-21T23:01:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.449+0000 7f81211ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c10e760 con 0x7f811c104a30 2023-07-21T23:01:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.450+0000 7f811b59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811c104a30 0x7f811c10dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.483 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.450+0000 7f811b59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811c104a30 0x7f811c10dc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:55194/0 (socket says 172.21.15.151:55194) 2023-07-21T23:01:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.450+0000 7f811b59e700 1 -- 172.21.15.151:0/3723484259 learned_addr learned my addr 172.21.15.151:0/3723484259 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.450+0000 7f811ad9d700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f811c0fea30 0x7f811c113e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.451+0000 7f811a59c700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c0ff3e0 0x7f811c1143d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.451+0000 7f811ad9d700 1 -- 172.21.15.151:0/3723484259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811c104a30 msgr2=0x7f811c10dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:06.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.451+0000 7f811ad9d700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811c104a30 0x7f811c10dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.451+0000 7f811ad9d700 1 -- 172.21.15.151:0/3723484259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c0ff3e0 msgr2=0x7f811c1143d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.451+0000 7f811ad9d700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c0ff3e0 0x7f811c1143d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.451+0000 7f811ad9d700 1 -- 172.21.15.151:0/3723484259 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c00b730 con 0x7f811c0fea30 2023-07-21T23:01:06.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.452+0000 7f811ad9d700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f811c0fea30 0x7f811c113e90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f810c00ba80 tx=0x7f810c00da00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.453+0000 7f8103fff700 1 -- 172.21.15.151:0/3723484259 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c010050 con 0x7f811c0fea30 2023-07-21T23:01:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.453+0000 7f8103fff700 1 -- 172.21.15.151:0/3723484259 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f810c015ed0 con 0x7f811c0fea30 2023-07-21T23:01:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.453+0000 7f8103fff700 1 -- 172.21.15.151:0/3723484259 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f810c01f6c0 con 0x7f811c0fea30 2023-07-21T23:01:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.454+0000 7f81211ff700 1 -- 172.21.15.151:0/3723484259 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c10e9e0 con 0x7f811c0fea30 2023-07-21T23:01:06.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.454+0000 7f81211ff700 1 -- 172.21.15.151:0/3723484259 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c070140 con 0x7f811c0fea30 2023-07-21T23:01:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.465+0000 7f8103fff700 1 -- 172.21.15.151:0/3723484259 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f810c005450 con 0x7f811c0fea30 2023-07-21T23:01:06.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.468+0000 7f8103fff700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f81040a14d0 0x7f81040a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.468+0000 7f8103fff700 1 -- 172.21.15.151:0/3723484259 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(162..162 src has 1..162) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f810c0ce180 con 0x7f811c0fea30 2023-07-21T23:01:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.468+0000 7f811a59c700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f81040a14d0 0x7f81040a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.469+0000 7f8134a4ab80 1 Processor -- start 2023-07-21T23:01:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.469+0000 7f8134a4ab80 1 -- start start 2023-07-21T23:01:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.469+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4824cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.469+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.470+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 0x55e0d481f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.470+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d4724c50 con 0x55e0d4825210 2023-07-21T23:01:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.470+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d47779e0 con 0x55e0d467b6b0 2023-07-21T23:01:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.470+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d4770e70 con 0x55e0d4825660 2023-07-21T23:01:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.470+0000 7f811a59c700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f81040a14d0 0x7f81040a3980 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f811c10f660 tx=0x7f811400d040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.470+0000 7f811b59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 0x55e0d481f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.470+0000 7f811b59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 0x55e0d481f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:55202/0 (socket says 172.21.15.151:55202) 2023-07-21T23:01:06.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.470+0000 7f811b59e700 1 -- 172.21.15.151:0/1832400970 learned_addr learned my addr 172.21.15.151:0/1832400970 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.471+0000 7f811ad9d700 1 --2- 172.21.15.151:0/1832400970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4824cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.473+0000 7f811a59c700 1 --2- 172.21.15.151:0/1832400970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.473+0000 7f811a59c700 1 -- 172.21.15.151:0/1832400970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 msgr2=0x55e0d481f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.473+0000 7f811a59c700 1 --2- 172.21.15.151:0/1832400970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 0x55e0d481f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.473+0000 7f811a59c700 1 -- 172.21.15.151:0/1832400970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 msgr2=0x55e0d4824cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.473+0000 7f811a59c700 1 --2- 172.21.15.151:0/1832400970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4824cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.473+0000 7f811a59c700 1 -- 172.21.15.151:0/1832400970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d459ed80 con 0x55e0d4825210 2023-07-21T23:01:06.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.474+0000 7f811a59c700 1 --2- 172.21.15.151:0/1832400970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481ef40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f8114016550 tx=0x7f8114011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bad38067bbdb22e4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.474+0000 7f81017fa700 1 -- 172.21.15.151:0/1832400970 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114010040 con 0x55e0d4825210 2023-07-21T23:01:06.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.474+0000 7f81017fa700 1 -- 172.21.15.151:0/1832400970 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f811401c040 con 0x55e0d4825210 2023-07-21T23:01:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.474+0000 7f81017fa700 1 -- 172.21.15.151:0/1832400970 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114015790 con 0x55e0d4825210 2023-07-21T23:01:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.477+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1832400970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 msgr2=0x55e0d481ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:06.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.477+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/1832400970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481ef40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f8114016550 tx=0x7f8114011000 comp rx=0 tx=0).stop 2023-07-21T23:01:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.481+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1832400970 shutdown_connections 2023-07-21T23:01:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.481+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/1832400970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4824cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.481+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/1832400970 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 0x55e0d481f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.481+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/1832400970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481ef40 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.481+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1832400970 >> 172.21.15.151:0/1832400970 conn(0x55e0d4814ae0 msgr2=0x55e0d481a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.485+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1832400970 shutdown_connections 2023-07-21T23:01:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.486+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1832400970 wait complete. 2023-07-21T23:01:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.487+0000 7f8134a4ab80 1 -- start start 2023-07-21T23:01:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.487+0000 7f8134a4ab80 1 Processor -- start 2023-07-21T23:01:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.488+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d467b6b0 0x55e0d482b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.488+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d4825210 0x55e0d48288a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.488+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d4828fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.488+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d4710a60 con 0x55e0d4825660 2023-07-21T23:01:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.488+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d4710760 con 0x55e0d4825210 2023-07-21T23:01:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.488+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d45f48c0 con 0x55e0d467b6b0 2023-07-21T23:01:06.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.488+0000 7f8134a4ab80 10 client.0 _ll_register_callbacks cb 0x55e0d470e700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:01:06.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.490+0000 7f811a59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d4825210 0x55e0d48288a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.490+0000 7f811b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d4828fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.490+0000 7f811b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d4828fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:57998/0 (socket says 172.21.15.151:57998) 2023-07-21T23:01:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.490+0000 7f811b59e700 1 -- 172.21.15.151:0/2277461064 learned_addr learned my addr 172.21.15.151:0/2277461064 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.491+0000 7f811b59e700 1 -- 172.21.15.151:0/2277461064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d467b6b0 msgr2=0x55e0d482b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.491+0000 7f811b59e700 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d467b6b0 0x55e0d482b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.491+0000 7f811b59e700 1 -- 172.21.15.151:0/2277461064 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d4825210 msgr2=0x55e0d48288a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:06.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.491+0000 7f811b59e700 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d4825210 0x55e0d48288a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.491+0000 7f811b59e700 1 -- 172.21.15.151:0/2277461064 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811400ae20 con 0x55e0d4825660 2023-07-21T23:01:06.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.491+0000 7f811b59e700 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d4828fe0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f81100128a0 tx=0x7f8110012c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=323d78b97a8c88f4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:06.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.496+0000 7f80feff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:01:06.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.496+0000 7f80feff5700 1 -- 172.21.15.151:0/2277461064 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110012ea0 con 0x55e0d4825660 2023-07-21T23:01:06.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.497+0000 7f80feff5700 1 -- 172.21.15.151:0/2277461064 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(162..162 src has 1..162) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f81100119e0 con 0x55e0d4825660 2023-07-21T23:01:06.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.501+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2277461064 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e0d46ca490 con 0x55e0d4825660 2023-07-21T23:01:06.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.502+0000 7f80feff5700 1 -- 172.21.15.151:0/2277461064 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8110017070 con 0x55e0d4825660 2023-07-21T23:01:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.510+0000 7f8134a4ab80 10 client.19545 fetch_fsmap learned FSMap version 115 2023-07-21T23:01:06.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.510+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2277461064 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=4+}) v3 -- 0x55e0d4587c00 con 0x55e0d4825660 2023-07-21T23:01:06.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.512+0000 7f80feff5700 1 -- 172.21.15.151:0/2277461064 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55e0d46ca490 con 0x55e0d4825660 2023-07-21T23:01:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.513+0000 7f80feff5700 1 -- 172.21.15.151:0/2277461064 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 115) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f811001c420 con 0x55e0d4825660 2023-07-21T23:01:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.513+0000 7f8134a4ab80 10 client.19545 fetch_fsmap finished waiting for FSMap version 115 2023-07-21T23:01:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.513+0000 7f8134a4ab80 10 client.19545 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:01:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.513+0000 7f8134a4ab80 20 client.19545 populate_metadata read hostname 'smithi151' 2023-07-21T23:01:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.513+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0d485acb0 0x55e0d485d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.513+0000 7f8134a4ab80 4 client.19545 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:01:06.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.513+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2277461064 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e0d4769e50 con 0x55e0d485acb0 2023-07-21T23:01:06.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.516+0000 7f811ad9d700 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0d485acb0 0x55e0d485d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.535+0000 7f811ad9d700 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0d485acb0 0x55e0d485d0c0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94b562cece00e0eb server_cookie=b0da25d1c06c274d in_seq=0 out_seq=0 2023-07-21T23:01:06.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.535+0000 7f80feff5700 10 client.19545 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:06.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.538+0000 7f80feff5700 1 -- 172.21.15.151:0/2277461064 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55e0d4769e50 con 0x55e0d485acb0 2023-07-21T23:01:06.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.538+0000 7f80feff5700 10 client.19545 handle_command_reply: tid=0 2023-07-21T23:01:06.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.543+0000 7f8134a4ab80 1 client.19545 shutdown 2023-07-21T23:01:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.553+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2277461064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 msgr2=0x55e0d4828fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.553+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d4828fe0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f81100128a0 tx=0x7f8110012c60 comp rx=0 tx=0).stop 2023-07-21T23:01:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.553+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2277461064 shutdown_connections 2023-07-21T23:01:06.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.553+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0d485acb0 0x55e0d485d0c0 crc :-1 s=READY pgs=473 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.553+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d4828fe0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.553+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d467b6b0 0x55e0d482b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.553+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2277461064 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d4825210 0x55e0d48288a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.553+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2277461064 >> 172.21.15.151:0/2277461064 conn(0x55e0d4814ae0 msgr2=0x55e0d48193e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.553+0000 7f80feff5700 0 client.19545 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:06.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.558+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2277461064 shutdown_connections 2023-07-21T23:01:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.558+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2277461064 wait complete. 2023-07-21T23:01:06.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.559+0000 7f8134a4ab80 20 client.19545 trim_cache size 0 max 16384 2023-07-21T23:01:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.594+0000 7f8134a4ab80 1 Processor -- start 2023-07-21T23:01:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.594+0000 7f8134a4ab80 1 -- start start 2023-07-21T23:01:06.629 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.595+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4821740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.595+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825210 0x55e0d4851c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.595+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d482b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.595+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d4822510 con 0x55e0d4825660 2023-07-21T23:01:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.595+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d4829880 con 0x55e0d467b6b0 2023-07-21T23:01:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.595+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d4829340 con 0x55e0d4825210 2023-07-21T23:01:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.597+0000 7f811b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d482b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.597+0000 7f811b59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d482b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58008/0 (socket says 172.21.15.151:58008) 2023-07-21T23:01:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.597+0000 7f811b59e700 1 -- 172.21.15.151:0/1634505497 learned_addr learned my addr 172.21.15.151:0/1634505497 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.597+0000 7f811a59c700 1 --2- 172.21.15.151:0/1634505497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825210 0x55e0d4851c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.597+0000 7f811b59e700 1 -- 172.21.15.151:0/1634505497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825210 msgr2=0x55e0d4851c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:06.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.597+0000 7f811b59e700 1 --2- 172.21.15.151:0/1634505497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825210 0x55e0d4851c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.597+0000 7f811b59e700 1 -- 172.21.15.151:0/1634505497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 msgr2=0x55e0d4821740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.597+0000 7f811b59e700 1 --2- 172.21.15.151:0/1634505497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4821740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.598+0000 7f811b59e700 1 -- 172.21.15.151:0/1634505497 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e0d45c51f0 con 0x55e0d4825660 2023-07-21T23:01:06.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.598+0000 7f811b59e700 1 --2- 172.21.15.151:0/1634505497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d482b150 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8110001eb0 tx=0x7f8110011720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4fc0c6cab49fb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.599+0000 7f8101ffb700 1 -- 172.21.15.151:0/1634505497 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110017040 con 0x55e0d4825660 2023-07-21T23:01:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.599+0000 7f8101ffb700 1 -- 172.21.15.151:0/1634505497 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8110011e70 con 0x55e0d4825660 2023-07-21T23:01:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.599+0000 7f8101ffb700 1 -- 172.21.15.151:0/1634505497 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8110012ea0 con 0x55e0d4825660 2023-07-21T23:01:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.600+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1634505497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 msgr2=0x55e0d482b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.600+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/1634505497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d482b150 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f8110001eb0 tx=0x7f8110011720 comp rx=0 tx=0).stop 2023-07-21T23:01:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.600+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1634505497 shutdown_connections 2023-07-21T23:01:06.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.600+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/1634505497 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4821740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.600+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/1634505497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825660 0x55e0d482b150 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.600+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/1634505497 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825210 0x55e0d4851c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.600+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1634505497 >> 172.21.15.151:0/1634505497 conn(0x55e0d4814ae0 msgr2=0x55e0d4856ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.603+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1634505497 shutdown_connections 2023-07-21T23:01:06.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.603+0000 7f8134a4ab80 1 -- 172.21.15.151:0/1634505497 wait complete. 2023-07-21T23:01:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.603+0000 7f8134a4ab80 1 -- start start 2023-07-21T23:01:06.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.604+0000 7f8134a4ab80 1 Processor -- start 2023-07-21T23:01:06.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.607+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4851c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.607+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.607+0000 7f8134a4ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 0x55e0d481e470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.607+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d481e9b0 con 0x55e0d4825210 2023-07-21T23:01:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.607+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d481eb20 con 0x55e0d467b6b0 2023-07-21T23:01:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.607+0000 7f8134a4ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e0d481ece0 con 0x55e0d4825660 2023-07-21T23:01:06.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.607+0000 7f8134a4ab80 10 client.0 _ll_register_callbacks cb 0x7f8110009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:01:06.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.608+0000 7f811a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.608+0000 7f811a59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58024/0 (socket says 172.21.15.151:58024) 2023-07-21T23:01:06.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.608+0000 7f811a59c700 1 -- 172.21.15.151:0/2007108217 learned_addr learned my addr 172.21.15.151:0/2007108217 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.608+0000 7f811b59e700 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 0x55e0d481e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.609+0000 7f811ad9d700 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4851c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.609+0000 7f811a59c700 1 -- 172.21.15.151:0/2007108217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 msgr2=0x55e0d481e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.609+0000 7f811a59c700 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 0x55e0d481e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.609+0000 7f811a59c700 1 -- 172.21.15.151:0/2007108217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 msgr2=0x55e0d4851c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.609+0000 7f811a59c700 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4851c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.610+0000 7f811a59c700 1 -- 172.21.15.151:0/2007108217 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e0d4587c00 con 0x55e0d4825210 2023-07-21T23:01:06.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.610+0000 7f811a59c700 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481df30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8114016550 tx=0x7f8114020b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34cd9e697b808075 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.611+0000 7f80feff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:01:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.611+0000 7f80feff5700 1 -- 172.21.15.151:0/2007108217 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8114010040 con 0x55e0d4825210 2023-07-21T23:01:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.611+0000 7f80feff5700 1 -- 172.21.15.151:0/2007108217 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(162..162 src has 1..162) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f811402d070 con 0x55e0d4825210 2023-07-21T23:01:06.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.611+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2007108217 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f811401c040 con 0x55e0d4825210 2023-07-21T23:01:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.612+0000 7f80feff5700 1 -- 172.21.15.151:0/2007108217 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=115) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8114032680 con 0x55e0d4825210 2023-07-21T23:01:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.612+0000 7f8134a4ab80 10 client.19551 fetch_fsmap learned FSMap version 115 2023-07-21T23:01:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.612+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2007108217 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=115,monmap=4+}) v3 -- 0x55e0d459d250 con 0x55e0d4825210 2023-07-21T23:01:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.613+0000 7f80feff5700 1 -- 172.21.15.151:0/2007108217 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f811401c040 con 0x55e0d4825210 2023-07-21T23:01:06.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.613+0000 7f80feff5700 1 -- 172.21.15.151:0/2007108217 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 115) v1 ==== 7466+0+0 (secure 0 0 0) 0x7f811401f070 con 0x55e0d4825210 2023-07-21T23:01:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.613+0000 7f8134a4ab80 10 client.19551 fetch_fsmap finished waiting for FSMap version 115 2023-07-21T23:01:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.613+0000 7f8134a4ab80 10 client.19551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:01:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.613+0000 7f8134a4ab80 20 client.19551 populate_metadata read hostname 'smithi151' 2023-07-21T23:01:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.613+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0d48afe70 0x55e0d48b2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:06.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.613+0000 7f8134a4ab80 4 client.19551 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:01:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.613+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2007108217 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55e0d472bff0 con 0x55e0d48afe70 2023-07-21T23:01:06.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.614+0000 7f811ad9d700 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0d48afe70 0x55e0d48b2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.639+0000 7f811ad9d700 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0d48afe70 0x55e0d48b2280 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0fd20a930e5b52e server_cookie=bf13d79e631812b in_seq=0 out_seq=0 2023-07-21T23:01:06.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:06.639+0000 7f80feff5700 10 client.19551 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.855+0000 7f80feff5700 1 -- 172.21.15.151:0/2007108217 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55e0d472bff0 con 0x55e0d48afe70 2023-07-21T23:01:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.855+0000 7f80feff5700 10 client.19551 handle_command_reply: tid=0 2023-07-21T23:01:08.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.855+0000 7f8134a4ab80 1 client.19551 shutdown 2023-07-21T23:01:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.866+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2007108217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 msgr2=0x55e0d481df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:08.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.866+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481df30 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f8114016550 tx=0x7f8114020b00 comp rx=0 tx=0).stop 2023-07-21T23:01:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.872+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2007108217 shutdown_connections 2023-07-21T23:01:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.872+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55e0d48afe70 0x55e0d48b2280 crc :-1 s=READY pgs=474 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.872+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55e0d467b6b0 0x55e0d4851c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.872+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55e0d4825660 0x55e0d481e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.872+0000 7f8134a4ab80 1 --2- 172.21.15.151:0/2007108217 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55e0d4825210 0x55e0d481df30 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:08.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.872+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2007108217 >> 172.21.15.151:0/2007108217 conn(0x55e0d4814ae0 msgr2=0x55e0d4819c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.872+0000 7f80feff5700 0 client.19551 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.873+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2007108217 shutdown_connections 2023-07-21T23:01:08.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.873+0000 7f8134a4ab80 1 -- 172.21.15.151:0/2007108217 wait complete. 2023-07-21T23:01:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.875+0000 7f8134a4ab80 20 client.19551 trim_cache size 0 max 16384 2023-07-21T23:01:08.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:01:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:01:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:01:08.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:01:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 -- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f81040a14d0 msgr2=0x7f81040a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:08.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f81040a14d0 0x7f81040a3980 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f811c10f660 tx=0x7f811400d040 comp rx=0 tx=0).stop 2023-07-21T23:01:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 -- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f811c0fea30 msgr2=0x7f811c113e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f811c0fea30 0x7f811c113e90 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f810c00ba80 tx=0x7f810c00da00 comp rx=0 tx=0).stop 2023-07-21T23:01:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 -- 172.21.15.151:0/3723484259 shutdown_connections 2023-07-21T23:01:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f81040a14d0 0x7f81040a3980 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f811c104a30 0x7f811c10dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f811c0fea30 0x7f811c113e90 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:08.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 --2- 172.21.15.151:0/3723484259 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f811c0ff3e0 0x7f811c1143d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.876+0000 7f81211ff700 1 -- 172.21.15.151:0/3723484259 >> 172.21.15.151:0/3723484259 conn(0x7f811c074760 msgr2=0x7f811c0fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.877+0000 7f81211ff700 1 -- 172.21.15.151:0/3723484259 shutdown_connections 2023-07-21T23:01:08.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:08.877+0000 7f81211ff700 1 -- 172.21.15.151:0/3723484259 wait complete. 2023-07-21T23:01:09.291 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 495.0 s, 90.2 tps, lat 1058.383 ms stddev 826.439 2023-07-21T23:01:09.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:08 smithi187 ceph-mon[96918]: pgmap v1336: 97 pgs: 11 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 59 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.7 MiB/s wr, 689 op/s 2023-07-21T23:01:09.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:08 smithi195 ceph-mon[97365]: pgmap v1336: 97 pgs: 11 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 59 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.7 MiB/s wr, 689 op/s 2023-07-21T23:01:09.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:08 smithi151 ceph-mon[95510]: pgmap v1336: 97 pgs: 11 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 59 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.7 MiB/s wr, 689 op/s 2023-07-21T23:01:10.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:10 smithi187 ceph-mon[96918]: pgmap v1337: 97 pgs: 15 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 49 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 723 op/s 2023-07-21T23:01:10.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:10 smithi195 ceph-mon[97365]: pgmap v1337: 97 pgs: 15 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 49 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 723 op/s 2023-07-21T23:01:10.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:10 smithi151 ceph-mon[95510]: pgmap v1337: 97 pgs: 15 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 49 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 723 op/s 2023-07-21T23:01:13.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:12 smithi187 ceph-mon[96918]: pgmap v1338: 97 pgs: 15 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 49 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 723 op/s 2023-07-21T23:01:13.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:12 smithi195 ceph-mon[97365]: pgmap v1338: 97 pgs: 15 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 49 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 723 op/s 2023-07-21T23:01:13.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:12 smithi151 ceph-mon[95510]: pgmap v1338: 97 pgs: 15 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 49 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.0 MiB/s wr, 723 op/s 2023-07-21T23:01:14.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 500.0 s, 256.4 tps, lat 411.854 ms stddev 398.228 2023-07-21T23:01:15.374 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:14 smithi187 ceph-mon[96918]: pgmap v1339: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 488 op/s 2023-07-21T23:01:15.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:14 smithi195 ceph-mon[97365]: pgmap v1339: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 488 op/s 2023-07-21T23:01:15.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:14 smithi151 ceph-mon[95510]: pgmap v1339: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.9 MiB/s rd, 5.0 MiB/s wr, 488 op/s 2023-07-21T23:01:17.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:16 smithi187 ceph-mon[96918]: pgmap v1340: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 413 op/s 2023-07-21T23:01:17.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:16 smithi187 ceph-mon[96918]: osdmap e163: 12 total, 12 up, 12 in 2023-07-21T23:01:17.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:16 smithi195 ceph-mon[97365]: pgmap v1340: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 413 op/s 2023-07-21T23:01:17.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:16 smithi195 ceph-mon[97365]: osdmap e163: 12 total, 12 up, 12 in 2023-07-21T23:01:17.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:16 smithi151 ceph-mon[95510]: pgmap v1340: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.2 MiB/s wr, 413 op/s 2023-07-21T23:01:17.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:16 smithi151 ceph-mon[95510]: osdmap e163: 12 total, 12 up, 12 in 2023-07-21T23:01:19.302 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 505.0 s, 324.6 tps, lat 331.785 ms stddev 113.848 2023-07-21T23:01:19.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:18 smithi187 ceph-mon[96918]: pgmap v1342: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 744 op/s 2023-07-21T23:01:19.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:18 smithi195 ceph-mon[97365]: pgmap v1342: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 744 op/s 2023-07-21T23:01:19.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:18 smithi151 ceph-mon[95510]: pgmap v1342: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.5 MiB/s wr, 744 op/s 2023-07-21T23:01:21.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:20 smithi187 ceph-mon[96918]: pgmap v1343: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 798 op/s 2023-07-21T23:01:21.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:20 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:01:21.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:20 smithi195 ceph-mon[97365]: pgmap v1343: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 798 op/s 2023-07-21T23:01:21.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:20 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:01:21.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:20 smithi151 ceph-mon[95510]: pgmap v1343: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 798 op/s 2023-07-21T23:01:21.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:20 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:01:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.419+0000 7fac21bff700 1 -- 172.21.15.151:0/2794102572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac1c10d640 msgr2=0x7fac1c1151c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:22.453 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.419+0000 7fac21bff700 1 --2- 172.21.15.151:0/2794102572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac1c10d640 0x7fac1c1151c0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b0a0 tx=0x7fac1400b3b0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.422+0000 7fac21bff700 1 -- 172.21.15.151:0/2794102572 shutdown_connections 2023-07-21T23:01:22.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.422+0000 7fac21bff700 1 --2- 172.21.15.151:0/2794102572 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac1c10d640 0x7fac1c1151c0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.422+0000 7fac21bff700 1 --2- 172.21.15.151:0/2794102572 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac1c108790 0x7fac1c108b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.422+0000 7fac21bff700 1 --2- 172.21.15.151:0/2794102572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac1c109130 0x7fac1c10cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.456 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.422+0000 7fac21bff700 1 -- 172.21.15.151:0/2794102572 >> 172.21.15.151:0/2794102572 conn(0x7fac1c06cef0 msgr2=0x7fac1c06f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.422+0000 7fac21bff700 1 -- 172.21.15.151:0/2794102572 shutdown_connections 2023-07-21T23:01:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.422+0000 7fac21bff700 1 -- 172.21.15.151:0/2794102572 wait complete. 2023-07-21T23:01:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.424+0000 7fac21bff700 1 Processor -- start 2023-07-21T23:01:22.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.424+0000 7fac21bff700 1 -- start start 2023-07-21T23:01:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.425+0000 7fac21bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac1c108790 0x7fac1c1a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.425+0000 7fac21bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac1c109130 0x7fac1c1a6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.425+0000 7fac21bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac1c10d640 0x7fac1c1a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.425+0000 7fac21bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c1a0b80 con 0x7fac1c10d640 2023-07-21T23:01:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.425+0000 7fac21bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c1a0cf0 con 0x7fac1c109130 2023-07-21T23:01:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.425+0000 7fac21bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1c1a0eb0 con 0x7fac1c108790 2023-07-21T23:01:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.426+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac1c108790 0x7fac1c1a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.426+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac1c108790 0x7fac1c1a66b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39500/0 (socket says 172.21.15.151:39500) 2023-07-21T23:01:22.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.426+0000 7fac1b7fe700 1 -- 172.21.15.151:0/3925495297 learned_addr learned my addr 172.21.15.151:0/3925495297 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.426+0000 7fac1bfff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac1c10d640 0x7fac1c1a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.426+0000 7fac1bfff700 1 -- 172.21.15.151:0/3925495297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac1c108790 msgr2=0x7fac1c1a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:22.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.426+0000 7fac1bfff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac1c108790 0x7fac1c1a66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.426+0000 7fac1bfff700 1 -- 172.21.15.151:0/3925495297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac1c109130 msgr2=0x7fac1c1a6bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T23:01:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.426+0000 7fac1bfff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac1c109130 0x7fac1c1a6bf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.426+0000 7fac1bfff700 1 -- 172.21.15.151:0/3925495297 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14009d00 con 0x7fac1c10d640 2023-07-21T23:01:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.427+0000 7fac1bfff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac1c10d640 0x7fac1c1a0510 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b070 tx=0x7fac14004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:22.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.427+0000 7fac197fa700 1 -- 172.21.15.151:0/3925495297 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1400e040 con 0x7fac1c10d640 2023-07-21T23:01:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.427+0000 7fac21bff700 1 -- 172.21.15.151:0/3925495297 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1c1a1130 con 0x7fac1c10d640 2023-07-21T23:01:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.427+0000 7fac197fa700 1 -- 172.21.15.151:0/3925495297 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac1400ce90 con 0x7fac1c10d640 2023-07-21T23:01:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.427+0000 7fac197fa700 1 -- 172.21.15.151:0/3925495297 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac140054d0 con 0x7fac1c10d640 2023-07-21T23:01:22.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.428+0000 7fac21bff700 1 -- 172.21.15.151:0/3925495297 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1c1ad6a0 con 0x7fac1c10d640 2023-07-21T23:01:22.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.434+0000 7fac197fa700 1 -- 172.21.15.151:0/3925495297 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fac1401bc80 con 0x7fac1c10d640 2023-07-21T23:01:22.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.435+0000 7fac354e3b80 1 Processor -- start 2023-07-21T23:01:22.469 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.436+0000 7fac354e3b80 1 -- start start 2023-07-21T23:01:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.436+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7287006b0 0x55f7288a9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.436+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.436+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7288aa660 0x55f7288a44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.436+0000 7fac354e3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7287a9c50 con 0x55f7287006b0 2023-07-21T23:01:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.436+0000 7fac354e3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7287fc9e0 con 0x55f7288aa660 2023-07-21T23:01:22.470 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.436+0000 7fac354e3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7287f5e70 con 0x55f7288aa210 2023-07-21T23:01:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.437+0000 7fac197fa700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac080a1380 0x7fac080a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.437+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288a3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.437+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288a3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39516/0 (socket says 172.21.15.151:39516) 2023-07-21T23:01:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.437+0000 7fac1b7fe700 1 -- 172.21.15.151:0/1579032494 learned_addr learned my addr 172.21.15.151:0/1579032494 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.437+0000 7fac13fff700 1 --2- 172.21.15.151:0/1579032494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7288aa660 0x55f7288a44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.437+0000 7fac197fa700 1 -- 172.21.15.151:0/3925495297 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fac140ce6b0 con 0x7fac1c10d640 2023-07-21T23:01:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.437+0000 7fac13fff700 1 --2- 172.21.15.151:0/1579032494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7287006b0 0x55f7288a9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac1b7fe700 1 -- 172.21.15.151:0/1579032494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7288aa660 msgr2=0x55f7288a44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/1579032494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7288aa660 0x55f7288a44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac1b7fe700 1 -- 172.21.15.151:0/1579032494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7287006b0 msgr2=0x55f7288a9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/1579032494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7287006b0 0x55f7288a9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac1b7fe700 1 -- 172.21.15.151:0/1579032494 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f728623d80 con 0x55f7288aa210 2023-07-21T23:01:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac1bfff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac080a1380 0x7fac080a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/1579032494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288a3f40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00bea0 tx=0x7fac0c0106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ceb5261072f3b6b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac11ffb700 1 -- 172.21.15.151:0/1579032494 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c011440 con 0x55f7288aa210 2023-07-21T23:01:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac11ffb700 1 -- 172.21.15.151:0/1579032494 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac0c015070 con 0x55f7288aa210 2023-07-21T23:01:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.438+0000 7fac11ffb700 1 -- 172.21.15.151:0/1579032494 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0197f0 con 0x55f7288aa210 2023-07-21T23:01:22.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.439+0000 7fac354e3b80 1 -- 172.21.15.151:0/1579032494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 msgr2=0x55f7288a3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.439+0000 7fac1bfff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac080a1380 0x7fac080a3830 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fac14009fd0 tx=0x7fac14009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.439+0000 7fac354e3b80 1 --2- 172.21.15.151:0/1579032494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288a3f40 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00bea0 tx=0x7fac0c0106b0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.439+0000 7fac354e3b80 1 -- 172.21.15.151:0/1579032494 shutdown_connections 2023-07-21T23:01:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.439+0000 7fac354e3b80 1 --2- 172.21.15.151:0/1579032494 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7288aa660 0x55f7288a44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.439+0000 7fac354e3b80 1 --2- 172.21.15.151:0/1579032494 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7287006b0 0x55f7288a9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.439+0000 7fac354e3b80 1 --2- 172.21.15.151:0/1579032494 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288a3f40 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.475 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.439+0000 7fac354e3b80 1 -- 172.21.15.151:0/1579032494 >> 172.21.15.151:0/1579032494 conn(0x55f728899ae0 msgr2=0x55f72889f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.440+0000 7fac354e3b80 1 -- 172.21.15.151:0/1579032494 shutdown_connections 2023-07-21T23:01:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.440+0000 7fac354e3b80 1 -- 172.21.15.151:0/1579032494 wait complete. 2023-07-21T23:01:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.440+0000 7fac354e3b80 1 -- start start 2023-07-21T23:01:22.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.441+0000 7fac354e3b80 1 Processor -- start 2023-07-21T23:01:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.441+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288b05e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.441+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288ad8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.441+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa660 0x55f7288ae010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.441+0000 7fac354e3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f728795a60 con 0x55f7288aa660 2023-07-21T23:01:22.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.441+0000 7fac354e3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f728795760 con 0x55f7287006b0 2023-07-21T23:01:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.442+0000 7fac354e3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7286798c0 con 0x55f7288aa210 2023-07-21T23:01:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.442+0000 7fac354e3b80 10 client.0 _ll_register_callbacks cb 0x55f728793700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:01:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.442+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288ad8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.442+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288ad8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39524/0 (socket says 172.21.15.151:39524) 2023-07-21T23:01:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.442+0000 7fac1b7fe700 1 -- 172.21.15.151:0/109987757 learned_addr learned my addr 172.21.15.151:0/109987757 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.442+0000 7fac13fff700 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288b05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.478 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.442+0000 7fac13fff700 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa660 0x55f7288ae010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.443+0000 7fac1b7fe700 1 -- 172.21.15.151:0/109987757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 msgr2=0x55f7288b05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.443+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288b05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.443+0000 7fac1b7fe700 1 -- 172.21.15.151:0/109987757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa660 msgr2=0x55f7288ae010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.443+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa660 0x55f7288ae010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.443+0000 7fac1b7fe700 1 -- 172.21.15.151:0/109987757 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0c00bad0 con 0x55f7288aa210 2023-07-21T23:01:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.443+0000 7fac13fff700 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa660 0x55f7288ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:01:22.479 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.443+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288ad8d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00b7f0 tx=0x7fac0c011f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7b04348ab6445a7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.443+0000 7fabfaffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:01:22.480 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.444+0000 7fabfaffd700 1 -- 172.21.15.151:0/109987757 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c005250 con 0x55f7288aa210 2023-07-21T23:01:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.444+0000 7fabfaffd700 1 -- 172.21.15.151:0/109987757 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fac0c0053b0 con 0x55f7288aa210 2023-07-21T23:01:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.444+0000 7fac354e3b80 1 -- 172.21.15.151:0/109987757 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55f72874f490 con 0x55f7288aa210 2023-07-21T23:01:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.445+0000 7fabfaffd700 1 -- 172.21.15.151:0/109987757 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac0c005570 con 0x55f7288aa210 2023-07-21T23:01:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.445+0000 7fac354e3b80 10 client.29254 fetch_fsmap learned FSMap version 116 2023-07-21T23:01:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.445+0000 7fac354e3b80 1 -- 172.21.15.151:0/109987757 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55f72860cc00 con 0x55f7288aa210 2023-07-21T23:01:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.445+0000 7fabfaffd700 1 -- 172.21.15.151:0/109987757 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55f72874f490 con 0x55f7288aa210 2023-07-21T23:01:22.481 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.446+0000 7fabfaffd700 1 -- 172.21.15.151:0/109987757 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fac0c021070 con 0x55f7288aa210 2023-07-21T23:01:22.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.446+0000 7fac354e3b80 10 client.29254 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:01:22.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.446+0000 7fac354e3b80 10 client.29254 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:01:22.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.446+0000 7fac354e3b80 20 client.29254 populate_metadata read hostname 'smithi151' 2023-07-21T23:01:22.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.446+0000 7fac354e3b80 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7288b49d0 0x55f7288b6de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.446+0000 7fac354e3b80 4 client.29254 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:01:22.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.446+0000 7fac354e3b80 1 -- 172.21.15.151:0/109987757 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55f7287eee50 con 0x55f7288b49d0 2023-07-21T23:01:22.482 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.446+0000 7fac13fff700 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7288b49d0 0x55f7288b6de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.448+0000 7fac13fff700 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7288b49d0 0x55f7288b6de0 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67b634003748baa0 server_cookie=184315d5d7912c66 in_seq=0 out_seq=0 2023-07-21T23:01:22.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.450+0000 7fabfaffd700 10 client.29254 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.453+0000 7fabfaffd700 1 -- 172.21.15.151:0/109987757 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55f7287eee50 con 0x55f7288b49d0 2023-07-21T23:01:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.453+0000 7fabfaffd700 10 client.29254 handle_command_reply: tid=0 2023-07-21T23:01:22.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.454+0000 7fac354e3b80 1 client.29254 shutdown 2023-07-21T23:01:22.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.458+0000 7fac354e3b80 1 -- 172.21.15.151:0/109987757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 msgr2=0x55f7288ad8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:22.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.458+0000 7fac354e3b80 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288ad8d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00b7f0 tx=0x7fac0c011f10 comp rx=0 tx=0).stop 2023-07-21T23:01:22.491 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.458+0000 7fac354e3b80 1 -- 172.21.15.151:0/109987757 shutdown_connections 2023-07-21T23:01:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.458+0000 7fac354e3b80 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7288b49d0 0x55f7288b6de0 crc :-1 s=READY pgs=475 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.458+0000 7fac354e3b80 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288b05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.458+0000 7fac354e3b80 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa660 0x55f7288ae010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.458+0000 7fac354e3b80 1 --2- 172.21.15.151:0/109987757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa210 0x55f7288ad8d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.458+0000 7fac354e3b80 1 -- 172.21.15.151:0/109987757 >> 172.21.15.151:0/109987757 conn(0x55f728899ae0 msgr2=0x55f72889e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:22.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.458+0000 7fabfaffd700 0 client.29254 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.459+0000 7fac354e3b80 1 -- 172.21.15.151:0/109987757 shutdown_connections 2023-07-21T23:01:22.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.459+0000 7fac354e3b80 1 -- 172.21.15.151:0/109987757 wait complete. 2023-07-21T23:01:22.494 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.459+0000 7fac354e3b80 20 client.29254 trim_cache size 0 max 16384 2023-07-21T23:01:22.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.488+0000 7fac354e3b80 1 Processor -- start 2023-07-21T23:01:22.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.488+0000 7fac354e3b80 1 -- start start 2023-07-21T23:01:22.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.489+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288a3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.489+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288a9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.489+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa660 0x55f72889eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.489+0000 7fac354e3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7288a4af0 con 0x55f7288aa210 2023-07-21T23:01:22.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.489+0000 7fac354e3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7288b0aa0 con 0x55f7287006b0 2023-07-21T23:01:22.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.489+0000 7fac354e3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7288a4f50 con 0x55f7288aa660 2023-07-21T23:01:22.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.489+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288a9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.489+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288a9050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:59822/0 (socket says 172.21.15.151:59822) 2023-07-21T23:01:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.489+0000 7fac1b7fe700 1 -- 172.21.15.151:0/3838557049 learned_addr learned my addr 172.21.15.151:0/3838557049 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.490+0000 7fac1b7fe700 1 -- 172.21.15.151:0/3838557049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa660 msgr2=0x55f72889eb60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:01:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.490+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/3838557049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa660 0x55f72889eb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.490+0000 7fac1b7fe700 1 -- 172.21.15.151:0/3838557049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 msgr2=0x55f7288a3f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:01:22.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.490+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/3838557049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288a3f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.490+0000 7fac1b7fe700 1 -- 172.21.15.151:0/3838557049 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55f7288d7730 con 0x55f7288aa210 2023-07-21T23:01:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.490+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/3838557049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288a9050 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fac0c010e30 tx=0x7fac0c010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8572095df09060 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:22.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.491+0000 7fac127fc700 1 -- 172.21.15.151:0/3838557049 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c039070 con 0x55f7288aa210 2023-07-21T23:01:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.491+0000 7fac127fc700 1 -- 172.21.15.151:0/3838557049 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac0c00b570 con 0x55f7288aa210 2023-07-21T23:01:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.491+0000 7fac127fc700 1 -- 172.21.15.151:0/3838557049 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c0115a0 con 0x55f7288aa210 2023-07-21T23:01:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 -- 172.21.15.151:0/3838557049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 msgr2=0x55f7288a9050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3838557049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288a9050 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fac0c010e30 tx=0x7fac0c010af0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 -- 172.21.15.151:0/3838557049 shutdown_connections 2023-07-21T23:01:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3838557049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288a3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3838557049 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa660 0x55f72889eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3838557049 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288a9050 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 -- 172.21.15.151:0/3838557049 >> 172.21.15.151:0/3838557049 conn(0x55f728899ae0 msgr2=0x55f7288a8940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 -- 172.21.15.151:0/3838557049 shutdown_connections 2023-07-21T23:01:22.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 -- 172.21.15.151:0/3838557049 wait complete. 2023-07-21T23:01:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.492+0000 7fac354e3b80 1 -- start start 2023-07-21T23:01:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.493+0000 7fac354e3b80 1 Processor -- start 2023-07-21T23:01:22.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.493+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288bb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.493+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288bb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.493+0000 7fac354e3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa660 0x55f7288b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.493+0000 7fac354e3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7288b9cd0 con 0x55f7288aa210 2023-07-21T23:01:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.493+0000 7fac354e3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7288b9e40 con 0x55f7287006b0 2023-07-21T23:01:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.493+0000 7fac354e3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55f7288ba000 con 0x55f7288aa660 2023-07-21T23:01:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.493+0000 7fac354e3b80 10 client.0 _ll_register_callbacks cb 0x7fac0c005910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:01:22.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac13fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288bb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac1b7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288bb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac13fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288bb120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60308/0 (socket says 172.21.15.151:60308) 2023-07-21T23:01:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac13fff700 1 -- 172.21.15.151:0/3616310479 learned_addr learned my addr 172.21.15.151:0/3616310479 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac13fff700 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa660 0x55f7288b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac1b7fe700 1 -- 172.21.15.151:0/3616310479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa660 msgr2=0x55f7288b96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa660 0x55f7288b96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac1b7fe700 1 -- 172.21.15.151:0/3616310479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 msgr2=0x55f7288bb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288bb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.494+0000 7fac1b7fe700 1 -- 172.21.15.151:0/3616310479 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55f72860cc00 con 0x55f7288aa210 2023-07-21T23:01:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.495+0000 7fac1b7fe700 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288bb660 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x55f7288aec90 tx=0x7fac0c005780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62edb5a5bcabe00f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.495+0000 7fabfaffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:01:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.495+0000 7fabfaffd700 1 -- 172.21.15.151:0/3616310479 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c039020 con 0x55f7288aa210 2023-07-21T23:01:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.495+0000 7fabfaffd700 1 -- 172.21.15.151:0/3616310479 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fac0c000e40 con 0x55f7288aa210 2023-07-21T23:01:22.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.495+0000 7fac354e3b80 1 -- 172.21.15.151:0/3616310479 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fac0c015070 con 0x55f7288aa210 2023-07-21T23:01:22.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.495+0000 7fabfaffd700 1 -- 172.21.15.151:0/3616310479 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac0c011e30 con 0x55f7288aa210 2023-07-21T23:01:22.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.495+0000 7fac354e3b80 10 client.19569 fetch_fsmap learned FSMap version 116 2023-07-21T23:01:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.495+0000 7fac354e3b80 1 -- 172.21.15.151:0/3616310479 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55f72864a1f0 con 0x55f7288aa210 2023-07-21T23:01:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.496+0000 7fabfaffd700 1 -- 172.21.15.151:0/3616310479 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fac0c015070 con 0x55f7288aa210 2023-07-21T23:01:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.496+0000 7fabfaffd700 1 -- 172.21.15.151:0/3616310479 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fac0c0107d0 con 0x55f7288aa210 2023-07-21T23:01:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.496+0000 7fac354e3b80 10 client.19569 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:01:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.496+0000 7fac354e3b80 10 client.19569 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:01:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.496+0000 7fac354e3b80 20 client.19569 populate_metadata read hostname 'smithi151' 2023-07-21T23:01:22.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.496+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7289232d0 0x55f7289256e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.496+0000 7fac354e3b80 4 client.19569 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:01:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.496+0000 7fac354e3b80 1 -- 172.21.15.151:0/3616310479 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55f7287b0ff0 con 0x55f7289232d0 2023-07-21T23:01:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.496+0000 7fac13fff700 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7289232d0 0x55f7289256e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.497+0000 7fabfaffd700 10 client.19569 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:22.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.497+0000 7fac13fff700 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7289232d0 0x55f7289256e0 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd8d6c52e9533cbd server_cookie=640c1ab11d29f908 in_seq=0 out_seq=0 2023-07-21T23:01:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fabfaffd700 1 -- 172.21.15.151:0/3616310479 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55f7287b0ff0 con 0x55f7289232d0 2023-07-21T23:01:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fabfaffd700 10 client.19569 handle_command_reply: tid=0 2023-07-21T23:01:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 client.19569 shutdown 2023-07-21T23:01:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 -- 172.21.15.151:0/3616310479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 msgr2=0x55f7288bb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288bb660 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x55f7288aec90 tx=0x7fac0c005780 comp rx=0 tx=0).stop 2023-07-21T23:01:22.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 -- 172.21.15.151:0/3616310479 shutdown_connections 2023-07-21T23:01:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55f7289232d0 0x55f7289256e0 crc :-1 s=READY pgs=476 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55f7287006b0 0x55f7288bb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55f7288aa660 0x55f7288b96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 --2- 172.21.15.151:0/3616310479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f7288aa210 0x55f7288bb660 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 -- 172.21.15.151:0/3616310479 >> 172.21.15.151:0/3616310479 conn(0x55f728899ae0 msgr2=0x55f7288afa00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fabfaffd700 0 client.19569 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:22.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.529+0000 7fac354e3b80 1 -- 172.21.15.151:0/3616310479 shutdown_connections 2023-07-21T23:01:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.530+0000 7fac354e3b80 1 -- 172.21.15.151:0/3616310479 wait complete. 2023-07-21T23:01:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.530+0000 7fac354e3b80 20 client.19569 trim_cache size 0 max 16384 2023-07-21T23:01:22.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:01:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:01:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:01:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:01:22.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.530+0000 7fac21bff700 1 -- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac080a1380 msgr2=0x7fac080a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.530+0000 7fac21bff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac080a1380 0x7fac080a3830 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fac14009fd0 tx=0x7fac14009040 comp rx=0 tx=0).stop 2023-07-21T23:01:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.530+0000 7fac21bff700 1 -- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac1c10d640 msgr2=0x7fac1c1a0510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.530+0000 7fac21bff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac1c10d640 0x7fac1c1a0510 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fac1400b070 tx=0x7fac14004c80 comp rx=0 tx=0).stop 2023-07-21T23:01:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.531+0000 7fac21bff700 1 -- 172.21.15.151:0/3925495297 shutdown_connections 2023-07-21T23:01:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.531+0000 7fac21bff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac080a1380 0x7fac080a3830 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.531+0000 7fac21bff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac1c10d640 0x7fac1c1a0510 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.531+0000 7fac21bff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fac1c108790 0x7fac1c1a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.567 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.531+0000 7fac21bff700 1 --2- 172.21.15.151:0/3925495297 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac1c109130 0x7fac1c1a6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.531+0000 7fac21bff700 1 -- 172.21.15.151:0/3925495297 >> 172.21.15.151:0/3925495297 conn(0x7fac1c06cef0 msgr2=0x7fac1c06dae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.531+0000 7fac21bff700 1 -- 172.21.15.151:0/3925495297 shutdown_connections 2023-07-21T23:01:22.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:22.531+0000 7fac21bff700 1 -- 172.21.15.151:0/3925495297 wait complete. 2023-07-21T23:01:23.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:22 smithi187 ceph-mon[96918]: pgmap v1344: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 798 op/s 2023-07-21T23:01:23.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:22 smithi195 ceph-mon[97365]: pgmap v1344: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 798 op/s 2023-07-21T23:01:23.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:22 smithi151 ceph-mon[95510]: pgmap v1344: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 8.0 MiB/s wr, 798 op/s 2023-07-21T23:01:24.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 510.0 s, 337.5 tps, lat 296.353 ms stddev 99.946 2023-07-21T23:01:25.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:24 smithi187 ceph-mon[96918]: pgmap v1345: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-07-21T23:01:25.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:24 smithi195 ceph-mon[97365]: pgmap v1345: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-07-21T23:01:25.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:24 smithi151 ceph-mon[95510]: pgmap v1345: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-07-21T23:01:27.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:26 smithi187 ceph-mon[96918]: pgmap v1346: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-07-21T23:01:27.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:26 smithi195 ceph-mon[97365]: pgmap v1346: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-07-21T23:01:27.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:26 smithi151 ceph-mon[95510]: pgmap v1346: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.02k op/s 2023-07-21T23:01:29.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 515.0 s, 354.4 tps, lat 280.170 ms stddev 74.985 2023-07-21T23:01:29.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:28 smithi187 ceph-mon[96918]: pgmap v1347: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.36k op/s 2023-07-21T23:01:29.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:28 smithi195 ceph-mon[97365]: pgmap v1347: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.36k op/s 2023-07-21T23:01:29.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:28 smithi151 ceph-mon[95510]: pgmap v1347: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.36k op/s 2023-07-21T23:01:31.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:30 smithi187 ceph-mon[96918]: pgmap v1348: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 987 op/s 2023-07-21T23:01:31.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:30 smithi195 ceph-mon[97365]: pgmap v1348: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 987 op/s 2023-07-21T23:01:31.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:30 smithi151 ceph-mon[95510]: pgmap v1348: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 987 op/s 2023-07-21T23:01:33.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:32 smithi187 ceph-mon[96918]: pgmap v1349: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.7 MiB/s wr, 913 op/s 2023-07-21T23:01:33.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:32 smithi195 ceph-mon[97365]: pgmap v1349: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.7 MiB/s wr, 913 op/s 2023-07-21T23:01:33.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:32 smithi151 ceph-mon[95510]: pgmap v1349: 97 pgs: 97 active+clean; 12 GiB data, 24 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.7 MiB/s wr, 913 op/s 2023-07-21T23:01:34.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 520.0 s, 390.4 tps, lat 258.238 ms stddev 57.606 2023-07-21T23:01:35.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:34 smithi187 ceph-mon[96918]: pgmap v1350: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-21T23:01:35.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:34 smithi195 ceph-mon[97365]: pgmap v1350: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-21T23:01:35.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:34 smithi151 ceph-mon[95510]: pgmap v1350: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-21T23:01:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.788+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/3380673130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5db806c910 msgr2=0x7f5db806cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:35.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.788+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/3380673130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5db806c910 0x7f5db806cd80 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5da800b0a0 tx=0x7f5da800b3b0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.789+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/3380673130 shutdown_connections 2023-07-21T23:01:35.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.789+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/3380673130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db810e2a0 0x7f5db810e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.789+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/3380673130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db806d3a0 0x7f5db811b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.789+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/3380673130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5db806c910 0x7f5db806cd80 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.789+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/3380673130 >> 172.21.15.151:0/3380673130 conn(0x7f5db806bd70 msgr2=0x7f5db8070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:35.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.789+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/3380673130 shutdown_connections 2023-07-21T23:01:35.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.790+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/3380673130 wait complete. 2023-07-21T23:01:35.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.792+0000 7f5dbf9ff700 1 Processor -- start 2023-07-21T23:01:35.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.792+0000 7f5dbf9ff700 1 -- start start 2023-07-21T23:01:35.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbf9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db806c910 0x7f5db81aa960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbf9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db806d3a0 0x7f5db81aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbf9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5db810e2a0 0x7f5db81a47c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbf9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db81a4e30 con 0x7f5db806c910 2023-07-21T23:01:35.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbf9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db81a4fa0 con 0x7f5db806d3a0 2023-07-21T23:01:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbf9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5db81a5160 con 0x7f5db810e2a0 2023-07-21T23:01:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbd79b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db806c910 0x7f5db81aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbd79b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db806c910 0x7f5db81aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34330/0 (socket says 172.21.15.151:34330) 2023-07-21T23:01:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbd79b700 1 -- 172.21.15.151:0/683077850 learned_addr learned my addr 172.21.15.151:0/683077850 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbcf9a700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db806d3a0 0x7f5db81aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.793+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5db810e2a0 0x7f5db81a47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.794+0000 7f5dbd79b700 1 -- 172.21.15.151:0/683077850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5db810e2a0 msgr2=0x7f5db81a47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.794+0000 7f5dbd79b700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5db810e2a0 0x7f5db81a47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.794+0000 7f5dbd79b700 1 -- 172.21.15.151:0/683077850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db806d3a0 msgr2=0x7f5db81aaea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:35.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.794+0000 7f5dbd79b700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db806d3a0 0x7f5db81aaea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.794+0000 7f5dbd79b700 1 -- 172.21.15.151:0/683077850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da8009d00 con 0x7f5db806c910 2023-07-21T23:01:35.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.795+0000 7f5dbd79b700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db806c910 0x7f5db81aa960 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d950 tx=0x7f5db000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.796+0000 7f5db67fc700 1 -- 172.21.15.151:0/683077850 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db0009b40 con 0x7f5db806c910 2023-07-21T23:01:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.796+0000 7f5db67fc700 1 -- 172.21.15.151:0/683077850 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5db0009ca0 con 0x7f5db806c910 2023-07-21T23:01:35.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.796+0000 7f5db67fc700 1 -- 172.21.15.151:0/683077850 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db000f620 con 0x7f5db806c910 2023-07-21T23:01:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.797+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/683077850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5db81a5440 con 0x7f5db806c910 2023-07-21T23:01:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.797+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/683077850 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db81b1950 con 0x7f5db806c910 2023-07-21T23:01:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.803+0000 7f5dd3418b80 1 Processor -- start 2023-07-21T23:01:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.804+0000 7f5dd3418b80 1 -- start start 2023-07-21T23:01:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.805+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b869646cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.805+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b869640f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.805+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696414a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.805+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b869546c50 con 0x55b86949d6b0 2023-07-21T23:01:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.805+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8695999e0 con 0x55b869647660 2023-07-21T23:01:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.805+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b869592e70 con 0x55b869647210 2023-07-21T23:01:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.806+0000 7f5dbdf9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b869646cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.806+0000 7f5dbdf9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b869646cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34344/0 (socket says 172.21.15.151:34344) 2023-07-21T23:01:35.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.806+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/841061368 learned_addr learned my addr 172.21.15.151:0/841061368 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.807+0000 7f5dbcf9a700 1 --2- 172.21.15.151:0/841061368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.808+0000 7f5db67fc700 1 -- 172.21.15.151:0/683077850 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5db0010460 con 0x7f5db806c910 2023-07-21T23:01:35.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.808+0000 7f5dbcf9a700 1 -- 172.21.15.151:0/841061368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 msgr2=0x55b869640f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:01:35.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.808+0000 7f5dbcf9a700 1 --2- 172.21.15.151:0/841061368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b869640f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.808+0000 7f5dbcf9a700 1 -- 172.21.15.151:0/841061368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 msgr2=0x55b869646cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:35.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.808+0000 7f5dbcf9a700 1 --2- 172.21.15.151:0/841061368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b869646cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.808+0000 7f5dbcf9a700 1 -- 172.21.15.151:0/841061368 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b8693c0d80 con 0x55b869647660 2023-07-21T23:01:35.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.809+0000 7f5dbcf9a700 1 --2- 172.21.15.151:0/841061368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696414a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5da8000f80 tx=0x7f5da8009230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d811ba63878a1f5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:35.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.810+0000 7f5db67fc700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5da00a1490 0x7f5da00a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.810+0000 7f5db67fc700 1 -- 172.21.15.151:0/683077850 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5db00ccbf0 con 0x7f5db806c910 2023-07-21T23:01:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.810+0000 7f5d9f7fe700 1 -- 172.21.15.151:0/841061368 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da800e050 con 0x55b869647660 2023-07-21T23:01:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.810+0000 7f5d9f7fe700 1 -- 172.21.15.151:0/841061368 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5da80074e0 con 0x55b869647660 2023-07-21T23:01:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.810+0000 7f5d9f7fe700 1 -- 172.21.15.151:0/841061368 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5da80054c0 con 0x55b869647660 2023-07-21T23:01:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.810+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5da00a1490 0x7f5da00a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.811+0000 7f5dd3418b80 1 -- 172.21.15.151:0/841061368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 msgr2=0x55b8696414a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:35.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.811+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/841061368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696414a0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f5da8000f80 tx=0x7f5da8009230 comp rx=0 tx=0).stop 2023-07-21T23:01:35.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.811+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5da00a1490 0x7f5da00a3940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5dac007a80 tx=0x7f5dac008040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.812+0000 7f5dd3418b80 1 -- 172.21.15.151:0/841061368 shutdown_connections 2023-07-21T23:01:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.812+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/841061368 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696414a0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.812+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/841061368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b869646cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.812+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/841061368 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b869640f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.812+0000 7f5dd3418b80 1 -- 172.21.15.151:0/841061368 >> 172.21.15.151:0/841061368 conn(0x55b869636ae0 msgr2=0x55b86963c0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:35.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.812+0000 7f5dd3418b80 1 -- 172.21.15.151:0/841061368 shutdown_connections 2023-07-21T23:01:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.812+0000 7f5dd3418b80 1 -- 172.21.15.151:0/841061368 wait complete. 2023-07-21T23:01:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.813+0000 7f5dd3418b80 1 -- start start 2023-07-21T23:01:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.813+0000 7f5dd3418b80 1 Processor -- start 2023-07-21T23:01:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.814+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b86964a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.814+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b86964ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.814+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b86964b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.814+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b869532a60 con 0x55b86949d6b0 2023-07-21T23:01:35.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.814+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b869532760 con 0x55b869647660 2023-07-21T23:01:35.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.814+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8694168c0 con 0x55b869647210 2023-07-21T23:01:35.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.814+0000 7f5dd3418b80 10 client.0 _ll_register_callbacks cb 0x55b869530700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:01:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.815+0000 7f5dbdf9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b86964b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.815+0000 7f5dbdf9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b86964b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:52408/0 (socket says 172.21.15.151:52408) 2023-07-21T23:01:35.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.815+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/1818895334 learned_addr learned my addr 172.21.15.151:0/1818895334 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.816+0000 7f5dbcf9a700 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b86964ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.816+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/1818895334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 msgr2=0x55b86964ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.816+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b86964ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.816+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/1818895334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 msgr2=0x55b86964a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.816+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b86964a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.816+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/1818895334 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5db811bfb0 con 0x55b869647660 2023-07-21T23:01:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.816+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b86964b3c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5dac016700 tx=0x7f5dac004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc8697b75e8d901d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:35.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.817+0000 7f5d9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:01:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.817+0000 7f5d9cff9700 1 -- 172.21.15.151:0/1818895334 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac010e90 con 0x55b869647660 2023-07-21T23:01:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.817+0000 7f5d9cff9700 1 -- 172.21.15.151:0/1818895334 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5dac014640 con 0x55b869647660 2023-07-21T23:01:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.817+0000 7f5dd3418b80 1 -- 172.21.15.151:0/1818895334 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b8694ec490 con 0x55b869647660 2023-07-21T23:01:35.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.818+0000 7f5d9cff9700 1 -- 172.21.15.151:0/1818895334 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dac005a50 con 0x55b869647660 2023-07-21T23:01:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.818+0000 7f5dd3418b80 10 client.29246 fetch_fsmap learned FSMap version 116 2023-07-21T23:01:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.818+0000 7f5dd3418b80 1 -- 172.21.15.151:0/1818895334 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55b8693a9c00 con 0x55b869647660 2023-07-21T23:01:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.819+0000 7f5d9cff9700 1 -- 172.21.15.151:0/1818895334 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b8694ec490 con 0x55b869647660 2023-07-21T23:01:35.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.819+0000 7f5d9cff9700 1 -- 172.21.15.151:0/1818895334 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5dac006110 con 0x55b869647660 2023-07-21T23:01:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.819+0000 7f5dd3418b80 10 client.29246 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:01:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.819+0000 7f5dd3418b80 10 client.29246 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:01:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.819+0000 7f5dd3418b80 20 client.29246 populate_metadata read hostname 'smithi151' 2023-07-21T23:01:35.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.819+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b86967cb80 0x55b86967ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.819+0000 7f5dd3418b80 4 client.29246 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:01:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.819+0000 7f5dd3418b80 1 -- 172.21.15.151:0/1818895334 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b86958be50 con 0x55b86967cb80 2023-07-21T23:01:35.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.819+0000 7f5dbd79b700 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b86967cb80 0x55b86967ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.820+0000 7f5dbd79b700 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b86967cb80 0x55b86967ef90 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28c03f10a7d8595e server_cookie=221c6095e1a11200 in_seq=0 out_seq=0 2023-07-21T23:01:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.820+0000 7f5d9cff9700 10 client.29246 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5d9cff9700 1 -- 172.21.15.151:0/1818895334 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b86958be50 con 0x55b86967cb80 2023-07-21T23:01:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5d9cff9700 10 client.29246 handle_command_reply: tid=0 2023-07-21T23:01:35.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5dd3418b80 1 client.29246 shutdown 2023-07-21T23:01:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5dd3418b80 1 -- 172.21.15.151:0/1818895334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 msgr2=0x55b86964b3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b86964b3c0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f5dac016700 tx=0x7f5dac004750 comp rx=0 tx=0).stop 2023-07-21T23:01:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5dd3418b80 1 -- 172.21.15.151:0/1818895334 shutdown_connections 2023-07-21T23:01:35.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b86967cb80 0x55b86967ef90 crc :-1 s=READY pgs=477 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b86964b3c0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b86964a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.863 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5d9cff9700 0 client.29246 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.821+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/1818895334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b86964ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.822+0000 7f5dd3418b80 1 -- 172.21.15.151:0/1818895334 >> 172.21.15.151:0/1818895334 conn(0x55b869636ae0 msgr2=0x55b86963b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.822+0000 7f5dd3418b80 1 -- 172.21.15.151:0/1818895334 shutdown_connections 2023-07-21T23:01:35.864 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.822+0000 7f5dd3418b80 1 -- 172.21.15.151:0/1818895334 wait complete. 2023-07-21T23:01:35.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.822+0000 7f5dd3418b80 20 client.29246 trim_cache size 0 max 16384 2023-07-21T23:01:35.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.851+0000 7f5dd3418b80 1 Processor -- start 2023-07-21T23:01:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.851+0000 7f5dd3418b80 1 -- start start 2023-07-21T23:01:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.851+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86949d6b0 0x55b869673bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.851+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b869647210 0x55b8696460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.851+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b869640f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.851+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86964bef0 con 0x55b869647210 2023-07-21T23:01:35.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.851+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86964bc90 con 0x55b869647660 2023-07-21T23:01:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.851+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b86963d6b0 con 0x55b86949d6b0 2023-07-21T23:01:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.852+0000 7f5dbd79b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86949d6b0 0x55b869673bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.852+0000 7f5dbd79b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86949d6b0 0x55b869673bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52812/0 (socket says 172.21.15.151:52812) 2023-07-21T23:01:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.852+0000 7f5dbd79b700 1 -- 172.21.15.151:0/2808131369 learned_addr learned my addr 172.21.15.151:0/2808131369 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.852+0000 7f5dbcf9a700 1 --2- 172.21.15.151:0/2808131369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b869647210 0x55b8696460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.853+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/2808131369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b869640f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.853+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/2808131369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86949d6b0 msgr2=0x55b869673bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.853+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/2808131369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86949d6b0 0x55b869673bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.853+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/2808131369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b869647210 msgr2=0x55b8696460a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.853+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/2808131369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b869647210 0x55b8696460a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.853+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/2808131369 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b869683bc0 con 0x55b869647660 2023-07-21T23:01:35.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.854+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/2808131369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b869640f40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5dac006440 tx=0x7f5dac010e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e008bf313c610f1a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:35.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.854+0000 7f5d9ffff700 1 -- 172.21.15.151:0/2808131369 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac010530 con 0x55b869647660 2023-07-21T23:01:35.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.855+0000 7f5d9ffff700 1 -- 172.21.15.151:0/2808131369 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5dac01a070 con 0x55b869647660 2023-07-21T23:01:35.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.855+0000 7f5d9ffff700 1 -- 172.21.15.151:0/2808131369 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac021e80 con 0x55b869647660 2023-07-21T23:01:35.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.856+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2808131369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 msgr2=0x55b869640f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.856+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2808131369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b869640f40 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f5dac006440 tx=0x7f5dac010e70 comp rx=0 tx=0).stop 2023-07-21T23:01:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.856+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2808131369 shutdown_connections 2023-07-21T23:01:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.856+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2808131369 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b869640f40 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.856+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2808131369 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b86949d6b0 0x55b869673bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.856+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2808131369 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b869647210 0x55b8696460a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.856+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2808131369 >> 172.21.15.151:0/2808131369 conn(0x55b869636ae0 msgr2=0x55b869645990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:35.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.858+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2808131369 shutdown_connections 2023-07-21T23:01:35.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.864+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2808131369 wait complete. 2023-07-21T23:01:35.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.865+0000 7f5dd3418b80 1 -- start start 2023-07-21T23:01:35.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.865+0000 7f5dd3418b80 1 Processor -- start 2023-07-21T23:01:35.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.866+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b8696c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.866+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b8696c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.866+0000 7f5dd3418b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696c49d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.866+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8696ca820 con 0x55b86949d6b0 2023-07-21T23:01:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.866+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8696c4f10 con 0x55b869647660 2023-07-21T23:01:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.866+0000 7f5dd3418b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b8696c50d0 con 0x55b869647210 2023-07-21T23:01:35.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.866+0000 7f5dd3418b80 10 client.0 _ll_register_callbacks cb 0x7f5dac010ae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:01:35.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.867+0000 7f5dbd79b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b8696c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.867+0000 7f5dbd79b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b8696c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34380/0 (socket says 172.21.15.151:34380) 2023-07-21T23:01:35.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.867+0000 7f5dbd79b700 1 -- 172.21.15.151:0/2755589865 learned_addr learned my addr 172.21.15.151:0/2755589865 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:35.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.867+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696c49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.867+0000 7f5dbcf9a700 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b8696c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.868+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/2755589865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 msgr2=0x55b8696c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:35.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.868+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b8696c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.868+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/2755589865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 msgr2=0x55b8696c9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.868+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b8696c9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.868+0000 7f5dbdf9c700 1 -- 172.21.15.151:0/2755589865 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b8693a9c00 con 0x55b869647660 2023-07-21T23:01:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.868+0000 7f5dbd79b700 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b8696c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:01:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.868+0000 7f5dbcf9a700 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b8696c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:01:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.868+0000 7f5dbdf9c700 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696c49d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55b86964c030 tx=0x7f5dac005d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5bfeb4bb6e1d95a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.868+0000 7f5d9cff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:01:35.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.869+0000 7f5d9cff9700 1 -- 172.21.15.151:0/2755589865 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dac007010 con 0x55b869647660 2023-07-21T23:01:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.869+0000 7f5d9cff9700 1 -- 172.21.15.151:0/2755589865 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5dac006230 con 0x55b869647660 2023-07-21T23:01:35.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.869+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2755589865 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5da80074e0 con 0x55b869647660 2023-07-21T23:01:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.870+0000 7f5d9cff9700 1 -- 172.21.15.151:0/2755589865 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5dac010530 con 0x55b869647660 2023-07-21T23:01:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.870+0000 7f5dd3418b80 10 client.29252 fetch_fsmap learned FSMap version 116 2023-07-21T23:01:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.870+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2755589865 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55b8693e71f0 con 0x55b869647660 2023-07-21T23:01:35.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.870+0000 7f5d9cff9700 1 -- 172.21.15.151:0/2755589865 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5da80074e0 con 0x55b869647660 2023-07-21T23:01:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.871+0000 7f5d9cff9700 1 -- 172.21.15.151:0/2755589865 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5dac039020 con 0x55b869647660 2023-07-21T23:01:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.871+0000 7f5dd3418b80 10 client.29252 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:01:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.871+0000 7f5dd3418b80 10 client.29252 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:01:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.871+0000 7f5dd3418b80 20 client.29252 populate_metadata read hostname 'smithi151' 2023-07-21T23:01:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.871+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b8696e2320 0x55b8696e4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:35.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.871+0000 7f5dd3418b80 4 client.29252 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:01:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.871+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2755589865 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b86954dff0 con 0x55b8696e2320 2023-07-21T23:01:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.872+0000 7f5dbd79b700 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b8696e2320 0x55b8696e4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.872+0000 7f5dbd79b700 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b8696e2320 0x55b8696e4700 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f93b691a71f8c2f2 server_cookie=a46f74fc11177ab4 in_seq=0 out_seq=0 2023-07-21T23:01:35.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.872+0000 7f5d9cff9700 10 client.29252 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:35.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.890+0000 7f5d9cff9700 1 -- 172.21.15.151:0/2755589865 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b86954dff0 con 0x55b8696e2320 2023-07-21T23:01:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.890+0000 7f5d9cff9700 10 client.29252 handle_command_reply: tid=0 2023-07-21T23:01:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.890+0000 7f5dd3418b80 1 client.29252 shutdown 2023-07-21T23:01:35.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.890+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2755589865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 msgr2=0x55b8696c49d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:35.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.890+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696c49d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x55b86964c030 tx=0x7f5dac005d00 comp rx=0 tx=0).stop 2023-07-21T23:01:35.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.891+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2755589865 shutdown_connections 2023-07-21T23:01:35.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.891+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b8696e2320 0x55b8696e4700 crc :-1 s=READY pgs=478 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.891+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b869647660 0x55b8696c49d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.891+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b86949d6b0 0x55b8696c9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.891+0000 7f5dd3418b80 1 --2- 172.21.15.151:0/2755589865 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b869647210 0x55b8696c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.891+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2755589865 >> 172.21.15.151:0/2755589865 conn(0x55b869636ae0 msgr2=0x55b869648330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.891+0000 7f5d9cff9700 0 client.29252 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.891+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2755589865 shutdown_connections 2023-07-21T23:01:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.891+0000 7f5dd3418b80 1 -- 172.21.15.151:0/2755589865 wait complete. 2023-07-21T23:01:35.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.892+0000 7f5dd3418b80 20 client.29252 trim_cache size 0 max 16384 2023-07-21T23:01:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:01:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:01:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:01:35.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:01:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.892+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5da00a1490 msgr2=0x7f5da00a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.892+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5da00a1490 0x7f5da00a3940 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5dac007a80 tx=0x7f5dac008040 comp rx=0 tx=0).stop 2023-07-21T23:01:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.892+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db806c910 msgr2=0x7f5db81aa960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.892+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db806c910 0x7f5db81aa960 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f5db000d950 tx=0x7f5db000dd10 comp rx=0 tx=0).stop 2023-07-21T23:01:35.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.893+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/683077850 shutdown_connections 2023-07-21T23:01:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.893+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5da00a1490 0x7f5da00a3940 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.893+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5db810e2a0 0x7f5db81a47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.893+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5db806c910 0x7f5db81aa960 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.893+0000 7f5dbf9ff700 1 --2- 172.21.15.151:0/683077850 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5db806d3a0 0x7f5db81aaea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:35.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.893+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/683077850 >> 172.21.15.151:0/683077850 conn(0x7f5db806bd70 msgr2=0x7f5db806f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.893+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/683077850 shutdown_connections 2023-07-21T23:01:35.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:35.893+0000 7f5dbf9ff700 1 -- 172.21.15.151:0/683077850 wait complete. 2023-07-21T23:01:36.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:36 smithi187 ceph-mon[96918]: pgmap v1351: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.7 MiB/s wr, 943 op/s 2023-07-21T23:01:36.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:36 smithi195 ceph-mon[97365]: pgmap v1351: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.7 MiB/s wr, 943 op/s 2023-07-21T23:01:36.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:36 smithi151 ceph-mon[95510]: pgmap v1351: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.7 MiB/s wr, 943 op/s 2023-07-21T23:01:39.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 525.0 s, 366.3 tps, lat 272.820 ms stddev 65.057 2023-07-21T23:01:39.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:38 smithi187 ceph-mon[96918]: pgmap v1352: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 12 MiB/s wr, 1.34k op/s 2023-07-21T23:01:39.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:38 smithi195 ceph-mon[97365]: pgmap v1352: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 12 MiB/s wr, 1.34k op/s 2023-07-21T23:01:39.443 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:38 smithi151 ceph-mon[95510]: pgmap v1352: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 12 MiB/s wr, 1.34k op/s 2023-07-21T23:01:41.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:40 smithi187 ceph-mon[96918]: pgmap v1353: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 10 MiB/s wr, 1.07k op/s 2023-07-21T23:01:41.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:40 smithi195 ceph-mon[97365]: pgmap v1353: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 10 MiB/s wr, 1.07k op/s 2023-07-21T23:01:41.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:40 smithi151 ceph-mon[95510]: pgmap v1353: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 10 MiB/s wr, 1.07k op/s 2023-07-21T23:01:43.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:42 smithi187 ceph-mon[96918]: pgmap v1354: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.2 MiB/s wr, 972 op/s 2023-07-21T23:01:43.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:42 smithi195 ceph-mon[97365]: pgmap v1354: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.2 MiB/s wr, 972 op/s 2023-07-21T23:01:43.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:42 smithi151 ceph-mon[95510]: pgmap v1354: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 9.2 MiB/s wr, 972 op/s 2023-07-21T23:01:44.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 530.0 s, 333.7 tps, lat 296.322 ms stddev 80.826 2023-07-21T23:01:45.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:44 smithi187 ceph-mon[96918]: pgmap v1355: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:01:45.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:44 smithi195 ceph-mon[97365]: pgmap v1355: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:01:45.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:44 smithi151 ceph-mon[95510]: pgmap v1355: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:01:47.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:46 smithi187 ceph-mon[96918]: pgmap v1356: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.6 MiB/s wr, 976 op/s 2023-07-21T23:01:47.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:46 smithi195 ceph-mon[97365]: pgmap v1356: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.6 MiB/s wr, 976 op/s 2023-07-21T23:01:47.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:46 smithi151 ceph-mon[95510]: pgmap v1356: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 9.6 MiB/s wr, 976 op/s 2023-07-21T23:01:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.132+0000 7f9ef15ff700 1 -- 172.21.15.151:0/2532543415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eec067c10 msgr2=0x7f9eec067fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.132+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/2532543415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eec067c10 0x7f9eec067fe0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f9edc00b0d0 tx=0x7f9edc00b3e0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.132+0000 7f9ef15ff700 1 -- 172.21.15.151:0/2532543415 shutdown_connections 2023-07-21T23:01:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.132+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/2532543415 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec104e50 0x7f9eec10ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.132+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/2532543415 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eec067c10 0x7f9eec067fe0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.132+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/2532543415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eec0685b0 0x7f9eec104770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.132+0000 7f9ef15ff700 1 -- 172.21.15.151:0/2532543415 >> 172.21.15.151:0/2532543415 conn(0x7f9eec074760 msgr2=0x7f9eec074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.132+0000 7f9ef15ff700 1 -- 172.21.15.151:0/2532543415 shutdown_connections 2023-07-21T23:01:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.133+0000 7f9ef15ff700 1 -- 172.21.15.151:0/2532543415 wait complete. 2023-07-21T23:01:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.134+0000 7f9ef15ff700 1 Processor -- start 2023-07-21T23:01:49.167 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.134+0000 7f9ef15ff700 1 -- start start 2023-07-21T23:01:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9ef15ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec067c10 0x7f9eec199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9ef15ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eec0685b0 0x7f9eec199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9ef15ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eec104e50 0x7f9eec1938c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9ef15ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec193f30 con 0x7f9eec0685b0 2023-07-21T23:01:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9ef15ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec1940a0 con 0x7f9eec104e50 2023-07-21T23:01:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9ef15ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eec194260 con 0x7f9eec067c10 2023-07-21T23:01:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9eeaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec067c10 0x7f9eec199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9ee3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eec0685b0 0x7f9eec199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9eeaffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec067c10 0x7f9eec199a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54580/0 (socket says 172.21.15.151:54580) 2023-07-21T23:01:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9eeaffd700 1 -- 172.21.15.151:0/3334557001 learned_addr learned my addr 172.21.15.151:0/3334557001 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.135+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eec104e50 0x7f9eec1938c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9eeaffd700 1 -- 172.21.15.151:0/3334557001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eec104e50 msgr2=0x7f9eec1938c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9eeaffd700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eec104e50 0x7f9eec1938c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9eeaffd700 1 -- 172.21.15.151:0/3334557001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eec0685b0 msgr2=0x7f9eec199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9eeaffd700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eec0685b0 0x7f9eec199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9eeaffd700 1 -- 172.21.15.151:0/3334557001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed4009520 con 0x7f9eec067c10 2023-07-21T23:01:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9eeaffd700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec067c10 0x7f9eec199a60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0079b0 tx=0x7f9edc0079e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:49.171 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9ee8ff9700 1 -- 172.21.15.151:0/3334557001 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc00e040 con 0x7f9eec067c10 2023-07-21T23:01:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9ef15ff700 1 -- 172.21.15.151:0/3334557001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9edc009d00 con 0x7f9eec067c10 2023-07-21T23:01:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9ee8ff9700 1 -- 172.21.15.151:0/3334557001 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9edc00ceb0 con 0x7f9eec067c10 2023-07-21T23:01:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9ee8ff9700 1 -- 172.21.15.151:0/3334557001 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9edc005040 con 0x7f9eec067c10 2023-07-21T23:01:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.136+0000 7f9ef15ff700 1 -- 172.21.15.151:0/3334557001 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eec1a0870 con 0x7f9eec067c10 2023-07-21T23:01:49.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.142+0000 7f9ee8ff9700 1 -- 172.21.15.151:0/3334557001 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f9edc01b450 con 0x7f9eec067c10 2023-07-21T23:01:49.175 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.142+0000 7f9f04f10b80 1 Processor -- start 2023-07-21T23:01:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.143+0000 7f9f04f10b80 1 -- start start 2023-07-21T23:01:49.177 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.143+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f2e56b0 0x55646f4974e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.143+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f491750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.144+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497e70 0x55646f491cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.144+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f38ec50 con 0x55646f497e70 2023-07-21T23:01:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.144+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f3e19e0 con 0x55646f497a20 2023-07-21T23:01:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.144+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f3dae70 con 0x55646f2e56b0 2023-07-21T23:01:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.144+0000 7f9eeaffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f491750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.144+0000 7f9eeaffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f491750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42094/0 (socket says 172.21.15.151:42094) 2023-07-21T23:01:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.144+0000 7f9eeaffd700 1 -- 172.21.15.151:0/375690219 learned_addr learned my addr 172.21.15.151:0/375690219 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.144+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f2e56b0 0x55646f4974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.144+0000 7f9ee3fff700 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497e70 0x55646f491cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.145+0000 7f9eeb7fe700 1 -- 172.21.15.151:0/375690219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 msgr2=0x55646f491750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.145+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f491750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.145+0000 7f9eeb7fe700 1 -- 172.21.15.151:0/375690219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497e70 msgr2=0x55646f491cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.145+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497e70 0x55646f491cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.145+0000 7f9eeb7fe700 1 -- 172.21.15.151:0/375690219 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646f208d80 con 0x55646f2e56b0 2023-07-21T23:01:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.145+0000 7f9ee8ff9700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ed80a1340 0x7f9ed80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.145+0000 7f9ee3fff700 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497e70 0x55646f491cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:01:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.145+0000 7f9ee8ff9700 1 -- 172.21.15.151:0/3334557001 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9edc0cdc30 con 0x7f9eec067c10 2023-07-21T23:01:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.145+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f2e56b0 0x55646f4974e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40043f0 tx=0x7f9ee4009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=71dadab3e72fd61 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.146+0000 7f9eeaffd700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ed80a1340 0x7f9ed80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.146+0000 7f9ee17fa700 1 -- 172.21.15.151:0/375690219 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4014040 con 0x55646f2e56b0 2023-07-21T23:01:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.146+0000 7f9ee17fa700 1 -- 172.21.15.151:0/375690219 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ee4003d10 con 0x55646f2e56b0 2023-07-21T23:01:49.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.146+0000 7f9ee17fa700 1 -- 172.21.15.151:0/375690219 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4019ac0 con 0x55646f2e56b0 2023-07-21T23:01:49.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.147+0000 7f9f04f10b80 1 -- 172.21.15.151:0/375690219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f2e56b0 msgr2=0x55646f4974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.147+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f2e56b0 0x55646f4974e0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f9ee40043f0 tx=0x7f9ee4009260 comp rx=0 tx=0).stop 2023-07-21T23:01:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.148+0000 7f9eeaffd700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ed80a1340 0x7f9ed80a37f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9edc097820 tx=0x7f9edc0d1740 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.148+0000 7f9f04f10b80 1 -- 172.21.15.151:0/375690219 shutdown_connections 2023-07-21T23:01:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.148+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497e70 0x55646f491cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.148+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f2e56b0 0x55646f4974e0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.148+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/375690219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f491750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.148+0000 7f9f04f10b80 1 -- 172.21.15.151:0/375690219 >> 172.21.15.151:0/375690219 conn(0x55646f47eae0 msgr2=0x55646f4840e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.148+0000 7f9f04f10b80 1 -- 172.21.15.151:0/375690219 shutdown_connections 2023-07-21T23:01:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.148+0000 7f9f04f10b80 1 -- 172.21.15.151:0/375690219 wait complete. 2023-07-21T23:01:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.149+0000 7f9f04f10b80 1 -- start start 2023-07-21T23:01:49.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.149+0000 7f9f04f10b80 1 Processor -- start 2023-07-21T23:01:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.150+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f2e56b0 0x55646f49dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.150+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f49af80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.150+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.150+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f37aa60 con 0x55646f2e56b0 2023-07-21T23:01:49.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.150+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f37a760 con 0x55646f497a20 2023-07-21T23:01:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.150+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f25e8c0 con 0x55646f497e70 2023-07-21T23:01:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.150+0000 7f9f04f10b80 10 client.0 _ll_register_callbacks cb 0x55646f378700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:01:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9ee3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f49af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9ee3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f49af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:42104/0 (socket says 172.21.15.151:42104) 2023-07-21T23:01:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9ee3fff700 1 -- 172.21.15.151:0/2614372960 learned_addr learned my addr 172.21.15.151:0/2614372960 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f2e56b0 0x55646f49dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.188 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9ee3fff700 1 -- 172.21.15.151:0/2614372960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 msgr2=0x55646f49b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9ee3fff700 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9ee3fff700 1 -- 172.21.15.151:0/2614372960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f2e56b0 msgr2=0x55646f49dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9ee3fff700 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f2e56b0 0x55646f49dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.151+0000 7f9ee3fff700 1 -- 172.21.15.151:0/2614372960 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed4009a70 con 0x55646f497a20 2023-07-21T23:01:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.152+0000 7f9ee3fff700 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f49af80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4011d10 tx=0x7f9ed4011df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abe23dc275031f39 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:49.189 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.152+0000 7f9ed27fc700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:01:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.152+0000 7f9ed27fc700 1 -- 172.21.15.151:0/2614372960 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4016070 con 0x55646f497a20 2023-07-21T23:01:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.152+0000 7f9ed27fc700 1 -- 172.21.15.151:0/2614372960 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9ed400fbc0 con 0x55646f497a20 2023-07-21T23:01:49.190 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.153+0000 7f9f04f10b80 1 -- 172.21.15.151:0/2614372960 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55646f334490 con 0x55646f497a20 2023-07-21T23:01:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.153+0000 7f9ed27fc700 1 -- 172.21.15.151:0/2614372960 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ed400fd80 con 0x55646f497a20 2023-07-21T23:01:49.191 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.153+0000 7f9f04f10b80 10 client.29264 fetch_fsmap learned FSMap version 116 2023-07-21T23:01:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.153+0000 7f9f04f10b80 1 -- 172.21.15.151:0/2614372960 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x7f9ee400f360 con 0x55646f497a20 2023-07-21T23:01:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.154+0000 7f9ed27fc700 1 -- 172.21.15.151:0/2614372960 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55646f334490 con 0x55646f497a20 2023-07-21T23:01:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.154+0000 7f9ed27fc700 1 -- 172.21.15.151:0/2614372960 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9ed4019420 con 0x55646f497a20 2023-07-21T23:01:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.154+0000 7f9f04f10b80 10 client.29264 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:01:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.154+0000 7f9f04f10b80 10 client.29264 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:01:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.154+0000 7f9f04f10b80 20 client.29264 populate_metadata read hostname 'smithi151' 2023-07-21T23:01:49.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.154+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55646f4ab340 0x55646f4ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.154+0000 7f9f04f10b80 4 client.29264 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:01:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.154+0000 7f9f04f10b80 1 -- 172.21.15.151:0/2614372960 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55646f3d3e50 con 0x55646f4ab340 2023-07-21T23:01:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.155+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55646f4ab340 0x55646f4ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.156+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55646f4ab340 0x55646f4ad750 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73d068a71fcd7450 server_cookie=e455ba1fdf09a7f4 in_seq=0 out_seq=0 2023-07-21T23:01:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.156+0000 7f9ed27fc700 10 client.29264 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.157+0000 7f9ed27fc700 1 -- 172.21.15.151:0/2614372960 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55646f3d3e50 con 0x55646f4ab340 2023-07-21T23:01:49.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.157+0000 7f9ed27fc700 10 client.29264 handle_command_reply: tid=0 2023-07-21T23:01:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.157+0000 7f9f04f10b80 1 client.29264 shutdown 2023-07-21T23:01:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.158+0000 7f9f04f10b80 1 -- 172.21.15.151:0/2614372960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 msgr2=0x55646f49af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.158+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f49af80 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4011d10 tx=0x7f9ed4011df0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.158+0000 7f9f04f10b80 1 -- 172.21.15.151:0/2614372960 shutdown_connections 2023-07-21T23:01:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.158+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55646f4ab340 0x55646f4ad750 crc :-1 s=READY pgs=479 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.158+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.158+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f2e56b0 0x55646f49dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.158+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/2614372960 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f49af80 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.158+0000 7f9f04f10b80 1 -- 172.21.15.151:0/2614372960 >> 172.21.15.151:0/2614372960 conn(0x55646f47eae0 msgr2=0x55646f4833e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.158+0000 7f9ed27fc700 0 client.29264 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:49.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.159+0000 7f9f04f10b80 1 -- 172.21.15.151:0/2614372960 shutdown_connections 2023-07-21T23:01:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.159+0000 7f9f04f10b80 1 -- 172.21.15.151:0/2614372960 wait complete. 2023-07-21T23:01:49.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.159+0000 7f9f04f10b80 20 client.29264 trim_cache size 0 max 16384 2023-07-21T23:01:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.187+0000 7f9f04f10b80 1 Processor -- start 2023-07-21T23:01:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.187+0000 7f9f04f10b80 1 -- start start 2023-07-21T23:01:49.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.188+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f2e56b0 0x55646f491e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.188+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f4a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.188+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.188+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f480c00 con 0x55646f2e56b0 2023-07-21T23:01:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.188+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f497870 con 0x55646f497a20 2023-07-21T23:01:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.188+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f49bb50 con 0x55646f497e70 2023-07-21T23:01:49.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.189+0000 7f9eeb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.189+0000 7f9eeb7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54608/0 (socket says 172.21.15.151:54608) 2023-07-21T23:01:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.189+0000 7f9eeb7fe700 1 -- 172.21.15.151:0/1015259459 learned_addr learned my addr 172.21.15.151:0/1015259459 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.190+0000 7f9eeb7fe700 1 -- 172.21.15.151:0/1015259459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 msgr2=0x55646f4a23b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:01:49.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.190+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/1015259459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f4a23b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.190+0000 7f9eeb7fe700 1 -- 172.21.15.151:0/1015259459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f2e56b0 msgr2=0x55646f491e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.190+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/1015259459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f2e56b0 0x55646f491e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.190+0000 7f9eeb7fe700 1 -- 172.21.15.151:0/1015259459 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55646f1f1c00 con 0x55646f497e70 2023-07-21T23:01:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.190+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/1015259459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49d790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4000c00 tx=0x7f9ee40037a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b46e6078a35a87b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.192+0000 7f9ee1ffb700 1 -- 172.21.15.151:0/1015259459 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee402d070 con 0x55646f497e70 2023-07-21T23:01:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.192+0000 7f9ee1ffb700 1 -- 172.21.15.151:0/1015259459 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ee40054c0 con 0x55646f497e70 2023-07-21T23:01:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.192+0000 7f9ee1ffb700 1 -- 172.21.15.151:0/1015259459 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ee4014040 con 0x55646f497e70 2023-07-21T23:01:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.193+0000 7f9f04f10b80 1 -- 172.21.15.151:0/1015259459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 msgr2=0x55646f49d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:49.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.193+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/1015259459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49d790 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f9ee4000c00 tx=0x7f9ee40037a0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.194+0000 7f9f04f10b80 1 -- 172.21.15.151:0/1015259459 shutdown_connections 2023-07-21T23:01:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.194+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/1015259459 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f49d790 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.194+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/1015259459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f2e56b0 0x55646f491e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.194+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/1015259459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f497a20 0x55646f4a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.194+0000 7f9f04f10b80 1 -- 172.21.15.151:0/1015259459 >> 172.21.15.151:0/1015259459 conn(0x55646f47eae0 msgr2=0x55646f491750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.194+0000 7f9f04f10b80 1 -- 172.21.15.151:0/1015259459 shutdown_connections 2023-07-21T23:01:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.194+0000 7f9f04f10b80 1 -- 172.21.15.151:0/1015259459 wait complete. 2023-07-21T23:01:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.195+0000 7f9f04f10b80 1 -- start start 2023-07-21T23:01:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.195+0000 7f9f04f10b80 1 Processor -- start 2023-07-21T23:01:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.196+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f2e56b0 0x55646f4fa1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.196+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497a20 0x55646f4fa710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.196+0000 7f9f04f10b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f4fac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.196+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f493010 con 0x55646f497a20 2023-07-21T23:01:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.196+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f493180 con 0x55646f2e56b0 2023-07-21T23:01:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.196+0000 7f9f04f10b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55646f4932c0 con 0x55646f497e70 2023-07-21T23:01:49.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.196+0000 7f9f04f10b80 10 client.0 _ll_register_callbacks cb 0x7f9ed40117e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:01:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.197+0000 7f9ee3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497a20 0x55646f4fa710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.197+0000 7f9ee3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497a20 0x55646f4fa710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48314/0 (socket says 172.21.15.151:48314) 2023-07-21T23:01:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.197+0000 7f9ee3fff700 1 -- 172.21.15.151:0/205338510 learned_addr learned my addr 172.21.15.151:0/205338510 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:01:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.198+0000 7f9ee3fff700 1 -- 172.21.15.151:0/205338510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 msgr2=0x55646f4fac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.198+0000 7f9ee3fff700 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f4fac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.198+0000 7f9ee3fff700 1 -- 172.21.15.151:0/205338510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f2e56b0 msgr2=0x55646f4fa1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:01:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.198+0000 7f9ee3fff700 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f2e56b0 0x55646f4fa1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.198+0000 7f9ee3fff700 1 -- 172.21.15.151:0/205338510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55646f208d80 con 0x55646f497a20 2023-07-21T23:01:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.199+0000 7f9ee3fff700 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497a20 0x55646f4fa710 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4019880 tx=0x7f9ed4019fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e5571b85e1fd60 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:01:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.199+0000 7f9ed27fc700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:01:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.199+0000 7f9ed27fc700 1 -- 172.21.15.151:0/205338510 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed4016070 con 0x55646f497a20 2023-07-21T23:01:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.200+0000 7f9ed27fc700 1 -- 172.21.15.151:0/205338510 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9ed4005040 con 0x55646f497a20 2023-07-21T23:01:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.200+0000 7f9f04f10b80 1 -- 172.21.15.151:0/205338510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9ee4003d10 con 0x55646f497a20 2023-07-21T23:01:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.200+0000 7f9ed27fc700 1 -- 172.21.15.151:0/205338510 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9ed4005200 con 0x55646f497a20 2023-07-21T23:01:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.201+0000 7f9f04f10b80 10 client.19596 fetch_fsmap learned FSMap version 116 2023-07-21T23:01:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.201+0000 7f9f04f10b80 1 -- 172.21.15.151:0/205338510 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55646f22f1f0 con 0x55646f497a20 2023-07-21T23:01:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.202+0000 7f9ed27fc700 1 -- 172.21.15.151:0/205338510 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9ee4003d10 con 0x55646f497a20 2023-07-21T23:01:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.202+0000 7f9ed27fc700 1 -- 172.21.15.151:0/205338510 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9ed4033050 con 0x55646f497a20 2023-07-21T23:01:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.202+0000 7f9f04f10b80 10 client.19596 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:01:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.202+0000 7f9f04f10b80 10 client.19596 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:01:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.202+0000 7f9f04f10b80 20 client.19596 populate_metadata read hostname 'smithi151' 2023-07-21T23:01:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.202+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55646f4a1ce0 0x55646f4a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:01:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.202+0000 7f9f04f10b80 4 client.19596 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:01:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.202+0000 7f9f04f10b80 1 -- 172.21.15.151:0/205338510 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55646f395ff0 con 0x55646f4a1ce0 2023-07-21T23:01:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.202+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55646f4a1ce0 0x55646f4a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:01:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.203+0000 7f9ed27fc700 10 client.19596 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:49.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.203+0000 7f9eeb7fe700 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55646f4a1ce0 0x55646f4a20e0 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab53119388044c10 server_cookie=c2b697da387fcb3b in_seq=0 out_seq=0 2023-07-21T23:01:49.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.229+0000 7f9ed27fc700 1 -- 172.21.15.151:0/205338510 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55646f395ff0 con 0x55646f4a1ce0 2023-07-21T23:01:49.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.229+0000 7f9ed27fc700 10 client.19596 handle_command_reply: tid=0 2023-07-21T23:01:49.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.229+0000 7f9f04f10b80 1 client.19596 shutdown 2023-07-21T23:01:49.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 -- 172.21.15.151:0/205338510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497a20 msgr2=0x55646f4fa710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:49.263 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497a20 0x55646f4fa710 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f9ed4019880 tx=0x7f9ed4019fc0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 -- 172.21.15.151:0/205338510 shutdown_connections 2023-07-21T23:01:49.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55646f4a1ce0 0x55646f4a20e0 crc :-1 s=READY pgs=480 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55646f2e56b0 0x55646f4fa1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.264 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55646f497e70 0x55646f4fac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 --2- 172.21.15.151:0/205338510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55646f497a20 0x55646f4fa710 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 -- 172.21.15.151:0/205338510 >> 172.21.15.151:0/205338510 conn(0x55646f47eae0 msgr2=0x55646f498240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9ed27fc700 0 client.19596 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:01:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 -- 172.21.15.151:0/205338510 shutdown_connections 2023-07-21T23:01:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 1 -- 172.21.15.151:0/205338510 wait complete. 2023-07-21T23:01:49.265 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.230+0000 7f9f04f10b80 20 client.19596 trim_cache size 0 max 16384 2023-07-21T23:01:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:01:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:01:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:01:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:01:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.231+0000 7f9ef15ff700 1 -- 172.21.15.151:0/3334557001 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ed80a1340 msgr2=0x7f9ed80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.231+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ed80a1340 0x7f9ed80a37f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9edc097820 tx=0x7f9edc0d1740 comp rx=0 tx=0).stop 2023-07-21T23:01:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.231+0000 7f9ef15ff700 1 -- 172.21.15.151:0/3334557001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec067c10 msgr2=0x7f9eec199a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:01:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.231+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec067c10 0x7f9eec199a60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f9edc0079b0 tx=0x7f9edc0079e0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.232+0000 7f9ef15ff700 1 -- 172.21.15.151:0/3334557001 shutdown_connections 2023-07-21T23:01:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.232+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9ed80a1340 0x7f9ed80a37f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.232+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9eec104e50 0x7f9eec1938c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.232+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9eec067c10 0x7f9eec199a60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.232+0000 7f9ef15ff700 1 --2- 172.21.15.151:0/3334557001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9eec0685b0 0x7f9eec199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:01:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.232+0000 7f9ef15ff700 1 -- 172.21.15.151:0/3334557001 >> 172.21.15.151:0/3334557001 conn(0x7f9eec074760 msgr2=0x7f9eec0fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:01:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.232+0000 7f9ef15ff700 1 -- 172.21.15.151:0/3334557001 shutdown_connections 2023-07-21T23:01:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:01:49.232+0000 7f9ef15ff700 1 -- 172.21.15.151:0/3334557001 wait complete. 2023-07-21T23:01:49.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 535.0 s, 354.8 tps, lat 281.393 ms stddev 63.533 2023-07-21T23:01:49.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:49 smithi187 ceph-mon[96918]: pgmap v1357: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:01:49.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:49 smithi195 ceph-mon[97365]: pgmap v1357: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:01:49.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:49 smithi151 ceph-mon[95510]: pgmap v1357: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:01:50.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:50 smithi187 ceph-mon[96918]: pgmap v1358: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:01:50.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:50 smithi195 ceph-mon[97365]: pgmap v1358: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:01:50.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:50 smithi151 ceph-mon[95510]: pgmap v1358: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:01:53.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:52 smithi187 ceph-mon[96918]: pgmap v1359: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.3 MiB/s wr, 941 op/s 2023-07-21T23:01:53.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:52 smithi195 ceph-mon[97365]: pgmap v1359: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.3 MiB/s wr, 941 op/s 2023-07-21T23:01:53.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:52 smithi151 ceph-mon[95510]: pgmap v1359: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.3 MiB/s wr, 941 op/s 2023-07-21T23:01:54.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 540.0 s, 363.4 tps, lat 276.217 ms stddev 136.474 2023-07-21T23:01:55.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:54 smithi187 ceph-mon[96918]: pgmap v1360: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 14 MiB/s wr, 1.42k op/s 2023-07-21T23:01:55.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:54 smithi195 ceph-mon[97365]: pgmap v1360: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 14 MiB/s wr, 1.42k op/s 2023-07-21T23:01:55.449 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:54 smithi151 ceph-mon[95510]: pgmap v1360: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 14 MiB/s wr, 1.42k op/s 2023-07-21T23:01:57.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:56 smithi187 ceph-mon[96918]: pgmap v1361: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.2 MiB/s wr, 937 op/s 2023-07-21T23:01:57.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:56 smithi195 ceph-mon[97365]: pgmap v1361: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.2 MiB/s wr, 937 op/s 2023-07-21T23:01:57.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:56 smithi151 ceph-mon[95510]: pgmap v1361: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.2 MiB/s wr, 937 op/s 2023-07-21T23:01:59.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 545.0 s, 342.6 tps, lat 288.178 ms stddev 84.639 2023-07-21T23:01:59.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:01:58 smithi187 ceph-mon[96918]: pgmap v1362: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 1.34k op/s 2023-07-21T23:01:59.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:01:58 smithi195 ceph-mon[97365]: pgmap v1362: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 1.34k op/s 2023-07-21T23:01:59.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:01:58 smithi151 ceph-mon[95510]: pgmap v1362: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 13 MiB/s wr, 1.34k op/s 2023-07-21T23:02:01.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:01 smithi187 ceph-mon[96918]: pgmap v1363: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-07-21T23:02:01.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:01 smithi195 ceph-mon[97365]: pgmap v1363: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-07-21T23:02:01.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:01 smithi151 ceph-mon[95510]: pgmap v1363: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 11 MiB/s wr, 1.07k op/s 2023-07-21T23:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.484+0000 7f92bf5ff700 1 -- 172.21.15.151:0/1410547104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92b806bb70 msgr2=0x7f92b806bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.484+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/1410547104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92b806bb70 0x7f92b806bf40 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f92b40098f0 tx=0x7f92b4009c00 comp rx=0 tx=0).stop 2023-07-21T23:02:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.485+0000 7f92bf5ff700 1 -- 172.21.15.151:0/1410547104 shutdown_connections 2023-07-21T23:02:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.485+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/1410547104 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92b81192c0 0x7f92b811b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.485+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/1410547104 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92b806bb70 0x7f92b806bf40 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.485+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/1410547104 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b806c480 0x7f92b8118d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.485+0000 7f92bf5ff700 1 -- 172.21.15.151:0/1410547104 >> 172.21.15.151:0/1410547104 conn(0x7f92b806a940 msgr2=0x7f92b806ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.485+0000 7f92bf5ff700 1 -- 172.21.15.151:0/1410547104 shutdown_connections 2023-07-21T23:02:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.485+0000 7f92bf5ff700 1 -- 172.21.15.151:0/1410547104 wait complete. 2023-07-21T23:02:02.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.486+0000 7f92bf5ff700 1 Processor -- start 2023-07-21T23:02:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.487+0000 7f92bf5ff700 1 -- start start 2023-07-21T23:02:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.487+0000 7f92bf5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92b806bb70 0x7f92b81aa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.487+0000 7f92bf5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b806c480 0x7f92b81aaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.487+0000 7f92bf5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92b81192c0 0x7f92b81a4840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.487+0000 7f92bf5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b81a4eb0 con 0x7f92b806bb70 2023-07-21T23:02:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.487+0000 7f92bf5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b81a5020 con 0x7f92b806c480 2023-07-21T23:02:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.487+0000 7f92bf5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b81a51e0 con 0x7f92b81192c0 2023-07-21T23:02:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bd39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92b806bb70 0x7f92b81aa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bdb9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92b81192c0 0x7f92b81a4840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bdb9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92b81192c0 0x7f92b81a4840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39314/0 (socket says 172.21.15.151:39314) 2023-07-21T23:02:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bdb9c700 1 -- 172.21.15.151:0/453472171 learned_addr learned my addr 172.21.15.151:0/453472171 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b806c480 0x7f92b81aaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bd39b700 1 -- 172.21.15.151:0/453472171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92b81192c0 msgr2=0x7f92b81a4840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bd39b700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92b81192c0 0x7f92b81a4840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bd39b700 1 -- 172.21.15.151:0/453472171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b806c480 msgr2=0x7f92b81aaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bd39b700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b806c480 0x7f92b81aaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bd39b700 1 -- 172.21.15.151:0/453472171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b4009520 con 0x7f92b806bb70 2023-07-21T23:02:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.488+0000 7f92bdb9c700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92b81192c0 0x7f92b81a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:02:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.489+0000 7f92bd39b700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92b806bb70 0x7f92b81aa9e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f92b4000c00 tx=0x7f92b400bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.489+0000 7f92ae7fc700 1 -- 172.21.15.151:0/453472171 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b401c070 con 0x7f92b806bb70 2023-07-21T23:02:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.489+0000 7f92ae7fc700 1 -- 172.21.15.151:0/453472171 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92b400bb40 con 0x7f92b806bb70 2023-07-21T23:02:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.489+0000 7f92ae7fc700 1 -- 172.21.15.151:0/453472171 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40038e0 con 0x7f92b806bb70 2023-07-21T23:02:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.489+0000 7f92bf5ff700 1 -- 172.21.15.151:0/453472171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b81a5460 con 0x7f92b806bb70 2023-07-21T23:02:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.490+0000 7f92bf5ff700 1 -- 172.21.15.151:0/453472171 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b81b19d0 con 0x7f92b806bb70 2023-07-21T23:02:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.493+0000 7f92ae7fc700 1 -- 172.21.15.151:0/453472171 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f92b4020030 con 0x7f92b806bb70 2023-07-21T23:02:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.495+0000 7f92ae7fc700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f92a40a1400 0x7f92a40a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.495+0000 7f92ae7fc700 1 -- 172.21.15.151:0/453472171 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f92b40cdc10 con 0x7f92b806bb70 2023-07-21T23:02:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.496+0000 7f92d2f45b80 1 Processor -- start 2023-07-21T23:02:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.496+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f92a40a1400 0x7f92a40a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.497+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f92a40a1400 0x7f92a40a38b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92a8005950 tx=0x7f92a80058e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:02.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.500+0000 7f92d2f45b80 1 -- start start 2023-07-21T23:02:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.501+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df29cf6b0 0x561df2b78cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.501+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df2b79210 0x561df2b72f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.501+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2b734a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.501+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2a78c50 con 0x561df29cf6b0 2023-07-21T23:02:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.501+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2acb9e0 con 0x561df2b79660 2023-07-21T23:02:02.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.501+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2ac4e70 con 0x561df2b79210 2023-07-21T23:02:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.502+0000 7f92bd39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df29cf6b0 0x561df2b78cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.502+0000 7f92bd39b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df29cf6b0 0x561df2b78cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50330/0 (socket says 172.21.15.151:50330) 2023-07-21T23:02:02.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.502+0000 7f92bd39b700 1 -- 172.21.15.151:0/1531101194 learned_addr learned my addr 172.21.15.151:0/1531101194 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.504+0000 7f92bd39b700 1 -- 172.21.15.151:0/1531101194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df2b79210 msgr2=0x561df2b72f40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:02:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.504+0000 7f92bd39b700 1 --2- 172.21.15.151:0/1531101194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df2b79210 0x561df2b72f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.504+0000 7f92bd39b700 1 -- 172.21.15.151:0/1531101194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 msgr2=0x561df2b734a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:02:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.504+0000 7f92bd39b700 1 --2- 172.21.15.151:0/1531101194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2b734a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.504+0000 7f92bd39b700 1 -- 172.21.15.151:0/1531101194 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561df28f2d80 con 0x561df29cf6b0 2023-07-21T23:02:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.504+0000 7f92bd39b700 1 --2- 172.21.15.151:0/1531101194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df29cf6b0 0x561df2b78cd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f92b4097230 tx=0x7f92b409a870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ece2ff4ea246bd50 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.505+0000 7f92a37fe700 1 -- 172.21.15.151:0/1531101194 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40a30f0 con 0x561df29cf6b0 2023-07-21T23:02:02.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.505+0000 7f92a37fe700 1 -- 172.21.15.151:0/1531101194 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92b4097440 con 0x561df29cf6b0 2023-07-21T23:02:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.505+0000 7f92a37fe700 1 -- 172.21.15.151:0/1531101194 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40b3210 con 0x561df29cf6b0 2023-07-21T23:02:02.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.506+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1531101194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df29cf6b0 msgr2=0x561df2b78cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:02.540 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.506+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1531101194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df29cf6b0 0x561df2b78cd0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f92b4097230 tx=0x7f92b409a870 comp rx=0 tx=0).stop 2023-07-21T23:02:02.542 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.509+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1531101194 shutdown_connections 2023-07-21T23:02:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.509+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1531101194 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2b734a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.509+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1531101194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df29cf6b0 0x561df2b78cd0 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.509+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1531101194 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df2b79210 0x561df2b72f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.543 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.509+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1531101194 >> 172.21.15.151:0/1531101194 conn(0x561df2b68ae0 msgr2=0x561df2b6e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.510+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1531101194 shutdown_connections 2023-07-21T23:02:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.510+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1531101194 wait complete. 2023-07-21T23:02:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.511+0000 7f92d2f45b80 1 -- start start 2023-07-21T23:02:02.544 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.511+0000 7f92d2f45b80 1 Processor -- start 2023-07-21T23:02:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.512+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b82250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.512+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79210 0x561df2b82790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.512+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79660 0x561df2b7c550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.512+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2a64a60 con 0x561df2b79660 2023-07-21T23:02:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.512+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2a64760 con 0x561df2b79210 2023-07-21T23:02:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.512+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df29488c0 con 0x561df29cf6b0 2023-07-21T23:02:02.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.512+0000 7f92d2f45b80 10 client.0 _ll_register_callbacks cb 0x561df2a62700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.514+0000 7f92bcb9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79210 0x561df2b82790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.514+0000 7f92bcb9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79210 0x561df2b82790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40460/0 (socket says 172.21.15.151:40460) 2023-07-21T23:02:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.514+0000 7f92bcb9a700 1 -- 172.21.15.151:0/392347179 learned_addr learned my addr 172.21.15.151:0/392347179 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.514+0000 7f92bd39b700 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b82250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.515+0000 7f92bd39b700 1 -- 172.21.15.151:0/392347179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79210 msgr2=0x561df2b82790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.515+0000 7f92bd39b700 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79210 0x561df2b82790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.515+0000 7f92bd39b700 1 -- 172.21.15.151:0/392347179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79660 msgr2=0x561df2b7c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.515+0000 7f92bd39b700 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79660 0x561df2b7c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.515+0000 7f92bd39b700 1 -- 172.21.15.151:0/392347179 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b81b19d0 con 0x561df29cf6b0 2023-07-21T23:02:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.521+0000 7f92bd39b700 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b82250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f92b40977a0 tx=0x7f92b40053e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6af16e17f521d0e1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.521+0000 7f92a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:02:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.521+0000 7f92a0ff9700 1 -- 172.21.15.151:0/392347179 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40cb7b0 con 0x561df29cf6b0 2023-07-21T23:02:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.521+0000 7f92a0ff9700 1 -- 172.21.15.151:0/392347179 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f92b409d030 con 0x561df29cf6b0 2023-07-21T23:02:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.522+0000 7f92d2f45b80 1 -- 172.21.15.151:0/392347179 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x561df2a1e490 con 0x561df29cf6b0 2023-07-21T23:02:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.527+0000 7f92a0ff9700 1 -- 172.21.15.151:0/392347179 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b40a30f0 con 0x561df29cf6b0 2023-07-21T23:02:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.528+0000 7f92d2f45b80 10 client.29296 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:02.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.528+0000 7f92d2f45b80 1 -- 172.21.15.151:0/392347179 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x561df28dbc00 con 0x561df29cf6b0 2023-07-21T23:02:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.534+0000 7f92a0ff9700 1 -- 172.21.15.151:0/392347179 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92b40c9070 con 0x561df29cf6b0 2023-07-21T23:02:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.534+0000 7f92a0ff9700 1 -- 172.21.15.151:0/392347179 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f92b409af90 con 0x561df29cf6b0 2023-07-21T23:02:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.535+0000 7f92d2f45b80 10 client.29296 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:02.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.535+0000 7f92d2f45b80 10 client.29296 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.535+0000 7f92d2f45b80 20 client.29296 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.535+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561df2b8c210 0x561df2b8e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.535+0000 7f92d2f45b80 4 client.29296 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:02:02.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.535+0000 7f92d2f45b80 1 -- 172.21.15.151:0/392347179 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x561df2abde50 con 0x561df2b8c210 2023-07-21T23:02:02.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.537+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561df2b8c210 0x561df2b8e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.559+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561df2b8c210 0x561df2b8e5f0 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7005c9df57fb7442 server_cookie=fe59e9e408b16097 in_seq=0 out_seq=0 2023-07-21T23:02:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.563+0000 7f92a0ff9700 10 client.29296 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.568+0000 7f92a0ff9700 1 -- 172.21.15.151:0/392347179 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x561df2abde50 con 0x561df2b8c210 2023-07-21T23:02:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.568+0000 7f92a0ff9700 10 client.29296 handle_command_reply: tid=0 2023-07-21T23:02:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.575+0000 7f92d2f45b80 1 client.29296 shutdown 2023-07-21T23:02:02.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.585+0000 7f92d2f45b80 1 -- 172.21.15.151:0/392347179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 msgr2=0x561df2b82250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:02.618 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.585+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b82250 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f92b40977a0 tx=0x7f92b40053e0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.589+0000 7f92d2f45b80 1 -- 172.21.15.151:0/392347179 shutdown_connections 2023-07-21T23:02:02.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.589+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561df2b8c210 0x561df2b8e5f0 crc :-1 s=READY pgs=481 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.589+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79660 0x561df2b7c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.589+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b82250 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.589+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/392347179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79210 0x561df2b82790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.589+0000 7f92d2f45b80 1 -- 172.21.15.151:0/392347179 >> 172.21.15.151:0/392347179 conn(0x561df2b68ae0 msgr2=0x561df2b6d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.589+0000 7f92a0ff9700 0 client.29296 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.589+0000 7f92d2f45b80 1 -- 172.21.15.151:0/392347179 shutdown_connections 2023-07-21T23:02:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.590+0000 7f92d2f45b80 1 -- 172.21.15.151:0/392347179 wait complete. 2023-07-21T23:02:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.594+0000 7f92d2f45b80 20 client.29296 trim_cache size 0 max 16384 2023-07-21T23:02:02.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.619+0000 7f92d2f45b80 1 Processor -- start 2023-07-21T23:02:02.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.619+0000 7f92d2f45b80 1 -- start start 2023-07-21T23:02:02.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.619+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b7a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.619+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 0x561df2b6db60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.619+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2b6e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.619+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2b76290 con 0x561df2b79210 2023-07-21T23:02:02.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.619+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2b76fe0 con 0x561df2b79660 2023-07-21T23:02:02.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.619+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2b7aab0 con 0x561df29cf6b0 2023-07-21T23:02:02.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bd39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b7a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bd39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b7a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39342/0 (socket says 172.21.15.151:39342) 2023-07-21T23:02:02.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bd39b700 1 -- 172.21.15.151:0/1670180051 learned_addr learned my addr 172.21.15.151:0/1670180051 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:02.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bdb9c700 1 --2- 172.21.15.151:0/1670180051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2b6e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/1670180051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 0x561df2b6db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bcb9a700 1 -- 172.21.15.151:0/1670180051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 msgr2=0x561df2b7a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:02.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/1670180051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b7a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bcb9a700 1 -- 172.21.15.151:0/1670180051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 msgr2=0x561df2b6e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:02.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/1670180051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2b6e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bcb9a700 1 -- 172.21.15.151:0/1670180051 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561df2b93220 con 0x561df2b79210 2023-07-21T23:02:02.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/1670180051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 0x561df2b6db60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x561df2b8eea0 tx=0x7f92a8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3f98e5419fad5ab server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:02.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92a3fff700 1 -- 172.21.15.151:0/1670180051 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8024040 con 0x561df2b79210 2023-07-21T23:02:02.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92a3fff700 1 -- 172.21.15.151:0/1670180051 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92a800fe70 con 0x561df2b79210 2023-07-21T23:02:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92a3fff700 1 -- 172.21.15.151:0/1670180051 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a801f430 con 0x561df2b79210 2023-07-21T23:02:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1670180051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 msgr2=0x561df2b6db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1670180051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 0x561df2b6db60 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x561df2b8eea0 tx=0x7f92a8015000 comp rx=0 tx=0).stop 2023-07-21T23:02:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1670180051 shutdown_connections 2023-07-21T23:02:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1670180051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2b6e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1670180051 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b7a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1670180051 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 0x561df2b6db60 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.620+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1670180051 >> 172.21.15.151:0/1670180051 conn(0x561df2b68ae0 msgr2=0x561df2b79aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:02.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.628+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1670180051 shutdown_connections 2023-07-21T23:02:02.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.629+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1670180051 wait complete. 2023-07-21T23:02:02.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.630+0000 7f92d2f45b80 1 -- start start 2023-07-21T23:02:02.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.630+0000 7f92d2f45b80 1 Processor -- start 2023-07-21T23:02:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.631+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b81a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.631+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 0x561df2b81fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.631+0000 7f92d2f45b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2bdf0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.631+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2b826f0 con 0x561df2b79210 2023-07-21T23:02:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.631+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2bdf5e0 con 0x561df2b79660 2023-07-21T23:02:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.631+0000 7f92d2f45b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x561df2bdf770 con 0x561df29cf6b0 2023-07-21T23:02:02.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.631+0000 7f92d2f45b80 10 client.0 _ll_register_callbacks cb 0x7f92b4097130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.632+0000 7f92bd39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b81a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.632+0000 7f92bd39b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b81a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:39350/0 (socket says 172.21.15.151:39350) 2023-07-21T23:02:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.632+0000 7f92bd39b700 1 -- 172.21.15.151:0/1633542145 learned_addr learned my addr 172.21.15.151:0/1633542145 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.632+0000 7f92bdb9c700 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2bdf0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.666 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.632+0000 7f92bd39b700 1 -- 172.21.15.151:0/1633542145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 msgr2=0x561df2bdf0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.632+0000 7f92bd39b700 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2bdf0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.632+0000 7f92bd39b700 1 -- 172.21.15.151:0/1633542145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 msgr2=0x561df2b81fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.632+0000 7f92bd39b700 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 0x561df2b81fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.632+0000 7f92bd39b700 1 -- 172.21.15.151:0/1633542145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92a800fa10 con 0x561df29cf6b0 2023-07-21T23:02:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.633+0000 7f92bd39b700 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b81a70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009810 tx=0x7f92b409c020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca8368d8c8a6784c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:02.667 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.633+0000 7f92a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:02:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.633+0000 7f92a0ff9700 1 -- 172.21.15.151:0/1633542145 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b40cb7b0 con 0x561df29cf6b0 2023-07-21T23:02:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.633+0000 7f92a0ff9700 1 -- 172.21.15.151:0/1633542145 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(163..163 src has 1..163) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f92b409d020 con 0x561df29cf6b0 2023-07-21T23:02:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.633+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1633542145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f92b4097440 con 0x561df29cf6b0 2023-07-21T23:02:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.634+0000 7f92a0ff9700 1 -- 172.21.15.151:0/1633542145 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f92b409a690 con 0x561df29cf6b0 2023-07-21T23:02:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.634+0000 7f92d2f45b80 10 client.29302 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.634+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1633542145 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x561df29191f0 con 0x561df29cf6b0 2023-07-21T23:02:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.634+0000 7f92a0ff9700 1 -- 172.21.15.151:0/1633542145 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f92b4097440 con 0x561df29cf6b0 2023-07-21T23:02:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.634+0000 7f92a0ff9700 1 -- 172.21.15.151:0/1633542145 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f92b40b3210 con 0x561df29cf6b0 2023-07-21T23:02:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.635+0000 7f92d2f45b80 10 client.29302 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.635+0000 7f92d2f45b80 10 client.29302 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.635+0000 7f92d2f45b80 20 client.29302 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.635+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561df2be09b0 0x561df2be2d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.635+0000 7f92d2f45b80 4 client.29302 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:02:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.635+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1633542145 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x561df2a7fff0 con 0x561df2be09b0 2023-07-21T23:02:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.635+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561df2be09b0 0x561df2be2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.638+0000 7f92bcb9a700 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561df2be09b0 0x561df2be2d90 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=185d9cfaf2642c33 server_cookie=b9d6eac9b2480835 in_seq=0 out_seq=0 2023-07-21T23:02:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.638+0000 7f92a0ff9700 10 client.29302 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:02.716 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.683+0000 7f92a0ff9700 1 -- 172.21.15.151:0/1633542145 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x561df2a7fff0 con 0x561df2be09b0 2023-07-21T23:02:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.683+0000 7f92a0ff9700 10 client.29302 handle_command_reply: tid=0 2023-07-21T23:02:02.717 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.683+0000 7f92d2f45b80 1 client.29302 shutdown 2023-07-21T23:02:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1633542145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 msgr2=0x561df2b81a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b81a70 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f92b4009810 tx=0x7f92b409c020 comp rx=0 tx=0).stop 2023-07-21T23:02:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1633542145 shutdown_connections 2023-07-21T23:02:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x561df2be09b0 0x561df2be2d90 crc :-1 s=READY pgs=482 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x561df2b79660 0x561df2bdf0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.718 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x561df29cf6b0 0x561df2b81a70 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 --2- 172.21.15.151:0/1633542145 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561df2b79210 0x561df2b81fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1633542145 >> 172.21.15.151:0/1633542145 conn(0x561df2b68ae0 msgr2=0x561df2b77610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92a0ff9700 0 client.29302 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1633542145 shutdown_connections 2023-07-21T23:02:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.684+0000 7f92d2f45b80 1 -- 172.21.15.151:0/1633542145 wait complete. 2023-07-21T23:02:02.719 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.685+0000 7f92d2f45b80 20 client.29302 trim_cache size 0 max 16384 2023-07-21T23:02:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:02:02.720 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:02:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:02:02.721 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:02:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 -- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f92a40a1400 msgr2=0x7f92a40a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f92a40a1400 0x7f92a40a38b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f92a8005950 tx=0x7f92a80058e0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 -- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92b806bb70 msgr2=0x7f92b81aa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:02.722 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92b806bb70 0x7f92b81aa9e0 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f92b4000c00 tx=0x7f92b400bfc0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 -- 172.21.15.151:0/453472171 shutdown_connections 2023-07-21T23:02:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f92a40a1400 0x7f92a40a38b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f92b81192c0 0x7f92b81a4840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f92b806bb70 0x7f92b81aa9e0 secure :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f92b4000c00 tx=0x7f92b400bfc0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 --2- 172.21.15.151:0/453472171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f92b806c480 0x7f92b81aaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 -- 172.21.15.151:0/453472171 >> 172.21.15.151:0/453472171 conn(0x7f92b806a940 msgr2=0x7f92b8109520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.686+0000 7f92bf5ff700 1 -- 172.21.15.151:0/453472171 shutdown_connections 2023-07-21T23:02:02.723 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:02.687+0000 7f92bf5ff700 1 -- 172.21.15.151:0/453472171 wait complete. 2023-07-21T23:02:03.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:02 smithi187 ceph-mon[96918]: pgmap v1364: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.8 MiB/s wr, 980 op/s 2023-07-21T23:02:03.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:02 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:02:03.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:02 smithi195 ceph-mon[97365]: pgmap v1364: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.8 MiB/s wr, 980 op/s 2023-07-21T23:02:03.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:02 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:02:03.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:02 smithi151 ceph-mon[95510]: pgmap v1364: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.8 MiB/s wr, 980 op/s 2023-07-21T23:02:03.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:02 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:02:04.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 550.0 s, 301.2 tps, lat 329.224 ms stddev 171.184 2023-07-21T23:02:04.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:04 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:04 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:04 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.869 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:04 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:04 smithi187 ceph-mon[96918]: pgmap v1365: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.44k op/s 2023-07-21T23:02:04.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:04 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.870 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:04 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.897 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:04 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:04 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:04 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.898 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:04 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.899 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:04 smithi195 ceph-mon[97365]: pgmap v1365: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.44k op/s 2023-07-21T23:02:04.899 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:04 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.899 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:04 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:04 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:04 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:04 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.942 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:04 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:04 smithi151 ceph-mon[95510]: pgmap v1365: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 MiB/s rd, 14 MiB/s wr, 1.44k op/s 2023-07-21T23:02:04.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:04 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:04.943 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:04 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:05.868 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:05 smithi187 ceph-mon[96918]: osdmap e164: 12 total, 12 up, 12 in 2023-07-21T23:02:05.896 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:05 smithi195 ceph-mon[97365]: osdmap e164: 12 total, 12 up, 12 in 2023-07-21T23:02:05.939 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:05 smithi151 ceph-mon[95510]: osdmap e164: 12 total, 12 up, 12 in 2023-07-21T23:02:06.938 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:06 smithi151 ceph-mon[95510]: pgmap v1367: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2023-07-21T23:02:07.118 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:06 smithi187 ceph-mon[96918]: pgmap v1367: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2023-07-21T23:02:07.145 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:06 smithi195 ceph-mon[97365]: pgmap v1367: 97 pgs: 97 active+clean; 13 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2023-07-21T23:02:09.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 555.0 s, 46.0 tps, lat 1813.936 ms stddev 961.178 2023-07-21T23:02:09.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:08 smithi187 ceph-mon[96918]: pgmap v1368: 97 pgs: 27 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 59 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.9 MiB/s wr, 803 op/s 2023-07-21T23:02:09.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:09 smithi195 ceph-mon[97365]: pgmap v1368: 97 pgs: 27 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 59 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.9 MiB/s wr, 803 op/s 2023-07-21T23:02:09.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:08 smithi151 ceph-mon[95510]: pgmap v1368: 97 pgs: 27 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 59 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 7.9 MiB/s wr, 803 op/s 2023-07-21T23:02:11.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:11 smithi187 ceph-mon[96918]: pgmap v1369: 97 pgs: 36 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 44 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 715 op/s 2023-07-21T23:02:11.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:11 smithi195 ceph-mon[97365]: pgmap v1369: 97 pgs: 36 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 44 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 715 op/s 2023-07-21T23:02:11.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:11 smithi151 ceph-mon[95510]: pgmap v1369: 97 pgs: 36 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 44 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 715 op/s 2023-07-21T23:02:13.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:13 smithi187 ceph-mon[96918]: pgmap v1370: 97 pgs: 36 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 44 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 715 op/s 2023-07-21T23:02:13.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:13 smithi195 ceph-mon[97365]: pgmap v1370: 97 pgs: 36 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 44 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 715 op/s 2023-07-21T23:02:13.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:13 smithi151 ceph-mon[95510]: pgmap v1370: 97 pgs: 36 active+clean+snaptrim_wait, 17 active+clean+snaptrim, 44 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.6 MiB/s wr, 715 op/s 2023-07-21T23:02:14.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 560.0 s, 266.4 tps, lat 439.708 ms stddev 385.187 2023-07-21T23:02:14.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:14 smithi187 ceph-mon[96918]: pgmap v1371: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 416 op/s 2023-07-21T23:02:14.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:14 smithi195 ceph-mon[97365]: pgmap v1371: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 416 op/s 2023-07-21T23:02:14.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:14 smithi151 ceph-mon[95510]: pgmap v1371: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.8 MiB/s wr, 416 op/s 2023-07-21T23:02:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.053+0000 7f82e19ff700 1 -- 172.21.15.151:0/2248896871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 msgr2=0x7f82dc11b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.053+0000 7f82e19ff700 1 --2- 172.21.15.151:0/2248896871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 0x7f82dc11b470 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f82d400b0a0 tx=0x7f82d400b3b0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.054+0000 7f82e19ff700 1 -- 172.21.15.151:0/2248896871 shutdown_connections 2023-07-21T23:02:16.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.054+0000 7f82e19ff700 1 --2- 172.21.15.151:0/2248896871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 0x7f82dc11b470 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.054+0000 7f82e19ff700 1 --2- 172.21.15.151:0/2248896871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82dc10e2a0 0x7f82dc10e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.054+0000 7f82e19ff700 1 --2- 172.21.15.151:0/2248896871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82dc06c910 0x7f82dc06cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.054+0000 7f82e19ff700 1 -- 172.21.15.151:0/2248896871 >> 172.21.15.151:0/2248896871 conn(0x7f82dc06bd70 msgr2=0x7f82dc070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:16.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.054+0000 7f82e19ff700 1 -- 172.21.15.151:0/2248896871 shutdown_connections 2023-07-21T23:02:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.054+0000 7f82e19ff700 1 -- 172.21.15.151:0/2248896871 wait complete. 2023-07-21T23:02:16.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.056+0000 7f82e19ff700 1 Processor -- start 2023-07-21T23:02:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.056+0000 7f82e19ff700 1 -- start start 2023-07-21T23:02:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.057+0000 7f82e19ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82dc06c910 0x7f82dc1aaba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.057+0000 7f82e19ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 0x7f82dc1ab0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.057+0000 7f82e19ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82dc10e2a0 0x7f82dc1a4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.057+0000 7f82e19ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc1a5140 con 0x7f82dc06c910 2023-07-21T23:02:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.057+0000 7f82e19ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc1a52b0 con 0x7f82dc06d3a0 2023-07-21T23:02:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.057+0000 7f82e19ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82dc1a5470 con 0x7f82dc10e2a0 2023-07-21T23:02:16.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.057+0000 7f82d3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 0x7f82dc1ab0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82d3fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 0x7f82dc1ab0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:51100/0 (socket says 172.21.15.151:51100) 2023-07-21T23:02:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82d3fff700 1 -- 172.21.15.151:0/513901117 learned_addr learned my addr 172.21.15.151:0/513901117 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82db7fe700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82dc10e2a0 0x7f82dc1a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82daffd700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82dc06c910 0x7f82dc1aaba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82d3fff700 1 -- 172.21.15.151:0/513901117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82dc10e2a0 msgr2=0x7f82dc1a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:16.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82d3fff700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82dc10e2a0 0x7f82dc1a4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82d3fff700 1 -- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82dc06c910 msgr2=0x7f82dc1aaba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82d3fff700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82dc06c910 0x7f82dc1aaba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82d3fff700 1 -- 172.21.15.151:0/513901117 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d4009d00 con 0x7f82dc06d3a0 2023-07-21T23:02:16.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.058+0000 7f82daffd700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82dc06c910 0x7f82dc1aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:02:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.059+0000 7f82d3fff700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 0x7f82dc1ab0e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f82c400b530 tx=0x7f82c400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.059+0000 7f82e09fd700 1 -- 172.21.15.151:0/513901117 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4011830 con 0x7f82dc06d3a0 2023-07-21T23:02:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.059+0000 7f82e19ff700 1 -- 172.21.15.151:0/513901117 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82dc1a5750 con 0x7f82dc06d3a0 2023-07-21T23:02:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.059+0000 7f82e09fd700 1 -- 172.21.15.151:0/513901117 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82c4011e20 con 0x7f82dc06d3a0 2023-07-21T23:02:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.059+0000 7f82e09fd700 1 -- 172.21.15.151:0/513901117 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c400f2e0 con 0x7f82dc06d3a0 2023-07-21T23:02:16.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.059+0000 7f82e19ff700 1 -- 172.21.15.151:0/513901117 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc1b1b70 con 0x7f82dc06d3a0 2023-07-21T23:02:16.097 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.065+0000 7f82e09fd700 1 -- 172.21.15.151:0/513901117 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f82c4011990 con 0x7f82dc06d3a0 2023-07-21T23:02:16.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.070+0000 7f82f5302b80 1 Processor -- start 2023-07-21T23:02:16.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.070+0000 7f82f5302b80 1 -- start start 2023-07-21T23:02:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.071+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dd1f6b0 0x55ef1dec8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.071+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9210 0x55ef1dec2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.071+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dec9660 0x55ef1dec34a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.071+0000 7f82f5302b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1ddc8c50 con 0x55ef1dec9210 2023-07-21T23:02:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.071+0000 7f82f5302b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1de1b9e0 con 0x55ef1dec9660 2023-07-21T23:02:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.071+0000 7f82f5302b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1de14e70 con 0x55ef1dd1f6b0 2023-07-21T23:02:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.072+0000 7f82e09fd700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82c80a1340 0x7f82c80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.072+0000 7f82daffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9210 0x55ef1dec2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.072+0000 7f82daffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9210 0x55ef1dec2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41466/0 (socket says 172.21.15.151:41466) 2023-07-21T23:02:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.072+0000 7f82daffd700 1 -- 172.21.15.151:0/129683306 learned_addr learned my addr 172.21.15.151:0/129683306 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.073+0000 7f82db7fe700 1 --2- 172.21.15.151:0/129683306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dd1f6b0 0x55ef1dec8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.073+0000 7f82e09fd700 1 -- 172.21.15.151:0/513901117 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f82c40cc710 con 0x7f82dc06d3a0 2023-07-21T23:02:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.073+0000 7f82db7fe700 1 -- 172.21.15.151:0/129683306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dec9660 msgr2=0x55ef1dec34a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:02:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.073+0000 7f82db7fe700 1 --2- 172.21.15.151:0/129683306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dec9660 0x55ef1dec34a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.073+0000 7f82db7fe700 1 -- 172.21.15.151:0/129683306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9210 msgr2=0x55ef1dec2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.073+0000 7f82db7fe700 1 --2- 172.21.15.151:0/129683306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9210 0x55ef1dec2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.073+0000 7f82db7fe700 1 -- 172.21.15.151:0/129683306 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef1dc42d80 con 0x55ef1dd1f6b0 2023-07-21T23:02:16.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.073+0000 7f82db7fe700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82c80a1340 0x7f82c80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.074+0000 7f82db7fe700 1 --2- 172.21.15.151:0/129683306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dd1f6b0 0x55ef1dec8cd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f82d40062a0 tx=0x7f82d400cf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f9a48262d84a2bd3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.074+0000 7f82d1ffb700 1 -- 172.21.15.151:0/129683306 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d400e040 con 0x55ef1dd1f6b0 2023-07-21T23:02:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.074+0000 7f82d1ffb700 1 -- 172.21.15.151:0/129683306 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d4003e90 con 0x55ef1dd1f6b0 2023-07-21T23:02:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.074+0000 7f82d1ffb700 1 -- 172.21.15.151:0/129683306 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d4029c20 con 0x55ef1dd1f6b0 2023-07-21T23:02:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.075+0000 7f82f5302b80 1 -- 172.21.15.151:0/129683306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dd1f6b0 msgr2=0x55ef1dec8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:16.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.075+0000 7f82f5302b80 1 --2- 172.21.15.151:0/129683306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dd1f6b0 0x55ef1dec8cd0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f82d40062a0 tx=0x7f82d400cf80 comp rx=0 tx=0).stop 2023-07-21T23:02:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.076+0000 7f82db7fe700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82c80a1340 0x7f82c80a37f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ef1dec3c40 tx=0x7f82d401e740 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.076+0000 7f82f5302b80 1 -- 172.21.15.151:0/129683306 shutdown_connections 2023-07-21T23:02:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.076+0000 7f82f5302b80 1 --2- 172.21.15.151:0/129683306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dec9660 0x55ef1dec34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.076+0000 7f82f5302b80 1 --2- 172.21.15.151:0/129683306 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dd1f6b0 0x55ef1dec8cd0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.076+0000 7f82f5302b80 1 --2- 172.21.15.151:0/129683306 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9210 0x55ef1dec2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.076+0000 7f82f5302b80 1 -- 172.21.15.151:0/129683306 >> 172.21.15.151:0/129683306 conn(0x55ef1deb8ae0 msgr2=0x55ef1debe0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:16.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.078+0000 7f82f5302b80 1 -- 172.21.15.151:0/129683306 shutdown_connections 2023-07-21T23:02:16.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.079+0000 7f82f5302b80 1 -- 172.21.15.151:0/129683306 wait complete. 2023-07-21T23:02:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.080+0000 7f82f5302b80 1 -- start start 2023-07-21T23:02:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.081+0000 7f82f5302b80 1 Processor -- start 2023-07-21T23:02:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.082+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dd1f6b0 0x55ef1decc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.082+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec9210 0x55ef1decce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.082+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9660 0x55ef1decd340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.082+0000 7f82f5302b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1ddb4a60 con 0x55ef1dec9660 2023-07-21T23:02:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.082+0000 7f82f5302b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1ddb4760 con 0x55ef1dd1f6b0 2023-07-21T23:02:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.082+0000 7f82f5302b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1dc988c0 con 0x55ef1dec9210 2023-07-21T23:02:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.082+0000 7f82f5302b80 10 client.0 _ll_register_callbacks cb 0x55ef1ddb2700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.083+0000 7f82db7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9660 0x55ef1decd340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.083+0000 7f82db7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9660 0x55ef1decd340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:41472/0 (socket says 172.21.15.151:41472) 2023-07-21T23:02:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.083+0000 7f82db7fe700 1 -- 172.21.15.151:0/3655524928 learned_addr learned my addr 172.21.15.151:0/3655524928 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.083+0000 7f82daffd700 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dd1f6b0 0x55ef1decc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.083+0000 7f82db7fe700 1 -- 172.21.15.151:0/3655524928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec9210 msgr2=0x55ef1decce00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:02:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.083+0000 7f82db7fe700 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec9210 0x55ef1decce00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.083+0000 7f82db7fe700 1 -- 172.21.15.151:0/3655524928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dd1f6b0 msgr2=0x55ef1decc8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:16.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.083+0000 7f82db7fe700 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dd1f6b0 0x55ef1decc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.083+0000 7f82db7fe700 1 -- 172.21.15.151:0/3655524928 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc11bfb0 con 0x55ef1dec9660 2023-07-21T23:02:16.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.084+0000 7f82db7fe700 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9660 0x55ef1decd340 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f82d400a010 tx=0x7f82d4021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704dafd4b7704c5d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:16.118 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.084+0000 7f82baffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:02:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.085+0000 7f82baffd700 1 -- 172.21.15.151:0/3655524928 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82d402d070 con 0x55ef1dec9660 2023-07-21T23:02:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.085+0000 7f82baffd700 1 -- 172.21.15.151:0/3655524928 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(164..164 src has 1..164) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f82d4029b80 con 0x55ef1dec9660 2023-07-21T23:02:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.085+0000 7f82f5302b80 1 -- 172.21.15.151:0/3655524928 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef1dd6e490 con 0x55ef1dec9660 2023-07-21T23:02:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.086+0000 7f82baffd700 1 -- 172.21.15.151:0/3655524928 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82d401ee80 con 0x55ef1dec9660 2023-07-21T23:02:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.086+0000 7f82f5302b80 10 client.19614 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.086+0000 7f82f5302b80 1 -- 172.21.15.151:0/3655524928 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55ef1dc2bc00 con 0x55ef1dec9660 2023-07-21T23:02:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.087+0000 7f82baffd700 1 -- 172.21.15.151:0/3655524928 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82d4044030 con 0x55ef1dec9660 2023-07-21T23:02:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.087+0000 7f82baffd700 1 -- 172.21.15.151:0/3655524928 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f82d4019030 con 0x55ef1dec9660 2023-07-21T23:02:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.087+0000 7f82f5302b80 10 client.19614 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.087+0000 7f82f5302b80 10 client.19614 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.087+0000 7f82f5302b80 20 client.19614 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.087+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef1dedc810 0x55ef1dedebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.087+0000 7f82f5302b80 4 client.19614 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:02:16.121 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.087+0000 7f82f5302b80 1 -- 172.21.15.151:0/3655524928 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ef1de0de50 con 0x55ef1dedc810 2023-07-21T23:02:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.088+0000 7f82daffd700 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef1dedc810 0x55ef1dedebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.089+0000 7f82daffd700 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef1dedc810 0x55ef1dedebf0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8147da6523892059 server_cookie=929d4cec5fd7a3cc in_seq=0 out_seq=0 2023-07-21T23:02:16.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.089+0000 7f82baffd700 10 client.19614 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.090+0000 7f82baffd700 1 -- 172.21.15.151:0/3655524928 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ef1de0de50 con 0x55ef1dedc810 2023-07-21T23:02:16.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.090+0000 7f82baffd700 10 client.19614 handle_command_reply: tid=0 2023-07-21T23:02:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.090+0000 7f82f5302b80 1 client.19614 shutdown 2023-07-21T23:02:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.091+0000 7f82f5302b80 1 -- 172.21.15.151:0/3655524928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9660 msgr2=0x55ef1decd340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:16.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.091+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9660 0x55ef1decd340 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f82d400a010 tx=0x7f82d4021000 comp rx=0 tx=0).stop 2023-07-21T23:02:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.096+0000 7f82f5302b80 1 -- 172.21.15.151:0/3655524928 shutdown_connections 2023-07-21T23:02:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.096+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef1dedc810 0x55ef1dedebf0 crc :-1 s=READY pgs=483 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.096+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dd1f6b0 0x55ef1decc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.096+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1dec9660 0x55ef1decd340 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.096+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3655524928 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec9210 0x55ef1decce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.096+0000 7f82f5302b80 1 -- 172.21.15.151:0/3655524928 >> 172.21.15.151:0/3655524928 conn(0x55ef1deb8ae0 msgr2=0x55ef1debd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.096+0000 7f82baffd700 0 client.19614 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.096+0000 7f82f5302b80 1 -- 172.21.15.151:0/3655524928 shutdown_connections 2023-07-21T23:02:16.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.096+0000 7f82f5302b80 1 -- 172.21.15.151:0/3655524928 wait complete. 2023-07-21T23:02:16.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.098+0000 7f82f5302b80 20 client.19614 trim_cache size 0 max 16384 2023-07-21T23:02:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.124+0000 7f82f5302b80 1 Processor -- start 2023-07-21T23:02:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.125+0000 7f82f5302b80 1 -- start start 2023-07-21T23:02:16.158 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.125+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dec71a0 0x55ef1decd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.125+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1ded91e0 0x55ef1dec8040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.125+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1deb8ae0 0x55ef1dec2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.125+0000 7f82f5302b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1debf6d0 con 0x55ef1deb8ae0 2023-07-21T23:02:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.125+0000 7f82f5302b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1deba4f0 con 0x55ef1dec71a0 2023-07-21T23:02:16.159 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.125+0000 7f82f5302b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1dec88d0 con 0x55ef1ded91e0 2023-07-21T23:02:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82daffd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dec71a0 0x55ef1decd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82d3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1ded91e0 0x55ef1dec8040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82d3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1ded91e0 0x55ef1dec8040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50936/0 (socket says 172.21.15.151:50936) 2023-07-21T23:02:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82d3fff700 1 -- 172.21.15.151:0/3702644901 learned_addr learned my addr 172.21.15.151:0/3702644901 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82db7fe700 1 --2- 172.21.15.151:0/3702644901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1deb8ae0 0x55ef1dec2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.160 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82d3fff700 1 -- 172.21.15.151:0/3702644901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dec71a0 msgr2=0x55ef1decd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82d3fff700 1 --2- 172.21.15.151:0/3702644901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dec71a0 0x55ef1decd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82d3fff700 1 -- 172.21.15.151:0/3702644901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1deb8ae0 msgr2=0x55ef1dec2f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82d3fff700 1 --2- 172.21.15.151:0/3702644901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1deb8ae0 0x55ef1dec2f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.126+0000 7f82d3fff700 1 -- 172.21.15.151:0/3702644901 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ef1dc691f0 con 0x55ef1ded91e0 2023-07-21T23:02:16.161 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.127+0000 7f82d3fff700 1 --2- 172.21.15.151:0/3702644901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1ded91e0 0x55ef1dec8040 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f82c4000c00 tx=0x7f82c4099260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7724f062d7b1e813 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:16.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.130+0000 7f82d27fc700 1 -- 172.21.15.151:0/3702644901 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4011c40 con 0x55ef1ded91e0 2023-07-21T23:02:16.163 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.130+0000 7f82d27fc700 1 -- 172.21.15.151:0/3702644901 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82c4099880 con 0x55ef1ded91e0 2023-07-21T23:02:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.130+0000 7f82d27fc700 1 -- 172.21.15.151:0/3702644901 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4098d70 con 0x55ef1ded91e0 2023-07-21T23:02:16.164 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.131+0000 7f82f5302b80 1 -- 172.21.15.151:0/3702644901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1ded91e0 msgr2=0x55ef1dec8040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.131+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3702644901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1ded91e0 0x55ef1dec8040 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f82c4000c00 tx=0x7f82c4099260 comp rx=0 tx=0).stop 2023-07-21T23:02:16.165 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.132+0000 7f82f5302b80 1 -- 172.21.15.151:0/3702644901 shutdown_connections 2023-07-21T23:02:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.132+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3702644901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1dec71a0 0x55ef1decd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.132+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3702644901 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1deb8ae0 0x55ef1dec2f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.132+0000 7f82f5302b80 1 --2- 172.21.15.151:0/3702644901 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1ded91e0 0x55ef1dec8040 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.166 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.132+0000 7f82f5302b80 1 -- 172.21.15.151:0/3702644901 >> 172.21.15.151:0/3702644901 conn(0x55ef1dec6dd0 msgr2=0x55ef1deca330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:16.179 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.146+0000 7f82f5302b80 1 -- 172.21.15.151:0/3702644901 shutdown_connections 2023-07-21T23:02:16.181 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.148+0000 7f82f5302b80 1 -- 172.21.15.151:0/3702644901 wait complete. 2023-07-21T23:02:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.148+0000 7f82f5302b80 1 -- start start 2023-07-21T23:02:16.182 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.149+0000 7f82f5302b80 1 Processor -- start 2023-07-21T23:02:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.150+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1deb8ae0 0x55ef1ded3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.150+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec71a0 0x55ef1ded20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.150+0000 7f82f5302b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1ded91e0 0x55ef1ded27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.150+0000 7f82f5302b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1ded2f00 con 0x55ef1deb8ae0 2023-07-21T23:02:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.150+0000 7f82f5302b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1df306b0 con 0x55ef1ded91e0 2023-07-21T23:02:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.150+0000 7f82f5302b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ef1df307f0 con 0x55ef1dec71a0 2023-07-21T23:02:16.184 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.150+0000 7f82f5302b80 10 client.0 _ll_register_callbacks cb 0x7f82d4009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.151+0000 7f82d3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec71a0 0x55ef1ded20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.185 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.151+0000 7f82d3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec71a0 0x55ef1ded20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:50948/0 (socket says 172.21.15.151:50948) 2023-07-21T23:02:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.151+0000 7f82d3fff700 1 -- 172.21.15.151:0/2800784148 learned_addr learned my addr 172.21.15.151:0/2800784148 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.151+0000 7f82db7fe700 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1ded91e0 0x55ef1ded27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.186 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.152+0000 7f82d3fff700 1 -- 172.21.15.151:0/2800784148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1ded91e0 msgr2=0x55ef1ded27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.152+0000 7f82d3fff700 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1ded91e0 0x55ef1ded27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.152+0000 7f82d3fff700 1 -- 172.21.15.151:0/2800784148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1deb8ae0 msgr2=0x55ef1ded3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.152+0000 7f82d3fff700 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1deb8ae0 0x55ef1ded3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.152+0000 7f82d3fff700 1 -- 172.21.15.151:0/2800784148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82dc1b1b70 con 0x55ef1dec71a0 2023-07-21T23:02:16.187 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.152+0000 7f82d3fff700 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec71a0 0x55ef1ded20b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f82c4099580 tx=0x7f82c4099750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a009b43dba0c43a0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.159+0000 7f82baffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:02:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.159+0000 7f82baffd700 1 -- 172.21.15.151:0/2800784148 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82c4011c40 con 0x55ef1dec71a0 2023-07-21T23:02:16.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.159+0000 7f82baffd700 1 -- 172.21.15.151:0/2800784148 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(164..164 src has 1..164) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f82c409d8b0 con 0x55ef1dec71a0 2023-07-21T23:02:16.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.161+0000 7f82f5302b80 1 -- 172.21.15.151:0/2800784148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ef1ded95b0 con 0x55ef1dec71a0 2023-07-21T23:02:16.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.162+0000 7f82baffd700 1 -- 172.21.15.151:0/2800784148 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f82c40b90f0 con 0x55ef1dec71a0 2023-07-21T23:02:16.200 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.167+0000 7f82f5302b80 10 client.29317 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.168+0000 7f82f5302b80 1 -- 172.21.15.151:0/2800784148 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55ef1dc41250 con 0x55ef1dec71a0 2023-07-21T23:02:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.168+0000 7f82baffd700 1 -- 172.21.15.151:0/2800784148 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f82c40c9020 con 0x55ef1dec71a0 2023-07-21T23:02:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.169+0000 7f82baffd700 1 -- 172.21.15.151:0/2800784148 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f82c4098e00 con 0x55ef1dec71a0 2023-07-21T23:02:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.169+0000 7f82f5302b80 10 client.29317 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.169+0000 7f82f5302b80 10 client.29317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.169+0000 7f82f5302b80 20 client.29317 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:16.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.169+0000 7f82f5302b80 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef1dd1f6b0 0x55ef1df33b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.169+0000 7f82f5302b80 4 client.29317 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:02:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.169+0000 7f82f5302b80 1 -- 172.21.15.151:0/2800784148 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x7f82d4003e90 con 0x55ef1dd1f6b0 2023-07-21T23:02:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.170+0000 7f82daffd700 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef1dd1f6b0 0x55ef1df33b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.172+0000 7f82baffd700 10 client.29317 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.172+0000 7f82daffd700 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef1dd1f6b0 0x55ef1df33b40 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58e142bef64669fa server_cookie=655fd401d731bd29 in_seq=0 out_seq=0 2023-07-21T23:02:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.199+0000 7f82baffd700 1 -- 172.21.15.151:0/2800784148 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x7f82d4003e90 con 0x55ef1dd1f6b0 2023-07-21T23:02:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.199+0000 7f82baffd700 10 client.29317 handle_command_reply: tid=0 2023-07-21T23:02:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.199+0000 7f82f5302b80 1 client.29317 shutdown 2023-07-21T23:02:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.199+0000 7f82f5302b80 1 -- 172.21.15.151:0/2800784148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec71a0 msgr2=0x55ef1ded20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.199+0000 7f82f5302b80 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec71a0 0x55ef1ded20b0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f82c4099580 tx=0x7f82c4099750 comp rx=0 tx=0).stop 2023-07-21T23:02:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82f5302b80 1 -- 172.21.15.151:0/2800784148 shutdown_connections 2023-07-21T23:02:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82f5302b80 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ef1dd1f6b0 0x55ef1df33b40 crc :-1 s=READY pgs=484 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82f5302b80 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ef1ded91e0 0x55ef1ded27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82f5302b80 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ef1deb8ae0 0x55ef1ded3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82baffd700 0 client.29317 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82f5302b80 1 --2- 172.21.15.151:0/2800784148 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ef1dec71a0 0x55ef1ded20b0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82f5302b80 1 -- 172.21.15.151:0/2800784148 >> 172.21.15.151:0/2800784148 conn(0x55ef1dec6dd0 msgr2=0x55ef1deca2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82f5302b80 1 -- 172.21.15.151:0/2800784148 shutdown_connections 2023-07-21T23:02:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82f5302b80 1 -- 172.21.15.151:0/2800784148 wait complete. 2023-07-21T23:02:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.200+0000 7f82f5302b80 20 client.29317 trim_cache size 0 max 16384 2023-07-21T23:02:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:02:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:02:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:02:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:02:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 -- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82c80a1340 msgr2=0x7f82c80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82c80a1340 0x7f82c80a37f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55ef1dec3c40 tx=0x7f82d401e740 comp rx=0 tx=0).stop 2023-07-21T23:02:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 -- 172.21.15.151:0/513901117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 msgr2=0x7f82dc1ab0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 0x7f82dc1ab0e0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f82c400b530 tx=0x7f82c400b840 comp rx=0 tx=0).stop 2023-07-21T23:02:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 -- 172.21.15.151:0/513901117 shutdown_connections 2023-07-21T23:02:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f82c80a1340 0x7f82c80a37f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f82dc10e2a0 0x7f82dc1a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82dc06c910 0x7f82dc1aaba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 --2- 172.21.15.151:0/513901117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f82dc06d3a0 0x7f82dc1ab0e0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 -- 172.21.15.151:0/513901117 >> 172.21.15.151:0/513901117 conn(0x7f82dc06bd70 msgr2=0x7f82dc0707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.201+0000 7f82e19ff700 1 -- 172.21.15.151:0/513901117 shutdown_connections 2023-07-21T23:02:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:16.202+0000 7f82e19ff700 1 -- 172.21.15.151:0/513901117 wait complete. 2023-07-21T23:02:17.189 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:16 smithi151 ceph-mon[95510]: pgmap v1372: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 369 op/s 2023-07-21T23:02:17.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:16 smithi187 ceph-mon[96918]: pgmap v1372: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 369 op/s 2023-07-21T23:02:17.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:16 smithi195 ceph-mon[97365]: pgmap v1372: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.4 MiB/s wr, 369 op/s 2023-07-21T23:02:18.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:17 smithi187 ceph-mon[96918]: osdmap e165: 12 total, 12 up, 12 in 2023-07-21T23:02:18.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:17 smithi195 ceph-mon[97365]: osdmap e165: 12 total, 12 up, 12 in 2023-07-21T23:02:18.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:17 smithi151 ceph-mon[95510]: osdmap e165: 12 total, 12 up, 12 in 2023-07-21T23:02:19.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 565.0 s, 325.6 tps, lat 313.783 ms stddev 76.327 2023-07-21T23:02:19.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:18 smithi187 ceph-mon[96918]: pgmap v1374: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 668 op/s 2023-07-21T23:02:19.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:18 smithi195 ceph-mon[97365]: pgmap v1374: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 668 op/s 2023-07-21T23:02:19.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:18 smithi151 ceph-mon[95510]: pgmap v1374: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 6.7 MiB/s wr, 668 op/s 2023-07-21T23:02:21.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:21 smithi187 ceph-mon[96918]: pgmap v1375: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.1 MiB/s wr, 747 op/s 2023-07-21T23:02:21.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:21 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:21.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:21 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:21.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:21 smithi195 ceph-mon[97365]: pgmap v1375: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.1 MiB/s wr, 747 op/s 2023-07-21T23:02:21.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:21 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:21.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:21 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:21.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:21 smithi151 ceph-mon[95510]: pgmap v1375: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.1 MiB/s wr, 747 op/s 2023-07-21T23:02:21.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:21 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:21.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:21 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:23.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:23 smithi187 ceph-mon[96918]: pgmap v1376: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.1 MiB/s wr, 747 op/s 2023-07-21T23:02:23.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:23 smithi195 ceph-mon[97365]: pgmap v1376: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.1 MiB/s wr, 747 op/s 2023-07-21T23:02:23.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:23 smithi151 ceph-mon[95510]: pgmap v1376: 97 pgs: 97 active+clean; 12 GiB data, 25 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.1 MiB/s wr, 747 op/s 2023-07-21T23:02:24.292 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 570.0 s, 283.3 tps, lat 322.156 ms stddev 124.848 2023-07-21T23:02:24.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:02:24.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:02:24.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:24 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:24.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:02:24.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:02:24.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:24 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:24.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:02:24.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:02:24.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:02:24.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:24 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:02:25.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:25 smithi187 ceph-mon[96918]: pgmap v1377: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:02:25.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:25 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T23:02:25.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:25 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:02:25.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:25 smithi195 ceph-mon[97365]: pgmap v1377: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:02:25.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:25 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T23:02:25.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:25 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:02:25.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:25 smithi151 ceph-mon[95510]: pgmap v1377: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:02:25.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:25 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T23:02:25.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:25 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:02:27.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:27 smithi187 ceph-mon[96918]: pgmap v1378: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:02:27.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:27 smithi195 ceph-mon[97365]: pgmap v1378: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:02:27.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:27 smithi151 ceph-mon[95510]: pgmap v1378: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:02:29.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 575.0 s, 194.7 tps, lat 562.188 ms stddev 757.198 2023-07-21T23:02:29.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:29 smithi187 ceph-mon[96918]: pgmap v1379: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-07-21T23:02:29.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:29 smithi195 ceph-mon[97365]: pgmap v1379: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-07-21T23:02:29.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:29 smithi151 ceph-mon[95510]: pgmap v1379: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.19k op/s 2023-07-21T23:02:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.461+0000 7f067e3ff700 1 -- 172.21.15.151:0/846453942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0678075350 msgr2=0x7f0678110470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.461+0000 7f067e3ff700 1 --2- 172.21.15.151:0/846453942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0678075350 0x7f0678110470 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f0668009990 tx=0x7f0668009ca0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.462+0000 7f067e3ff700 1 -- 172.21.15.151:0/846453942 shutdown_connections 2023-07-21T23:02:29.495 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.462+0000 7f067e3ff700 1 --2- 172.21.15.151:0/846453942 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06781109b0 0x7f0678112d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.462+0000 7f067e3ff700 1 --2- 172.21.15.151:0/846453942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0678074a40 0x7f0678074e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.462+0000 7f067e3ff700 1 --2- 172.21.15.151:0/846453942 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0678075350 0x7f0678110470 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.462+0000 7f067e3ff700 1 -- 172.21.15.151:0/846453942 >> 172.21.15.151:0/846453942 conn(0x7f06780fd7f0 msgr2=0x7f06780ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:29.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.462+0000 7f067e3ff700 1 -- 172.21.15.151:0/846453942 shutdown_connections 2023-07-21T23:02:29.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.462+0000 7f067e3ff700 1 -- 172.21.15.151:0/846453942 wait complete. 2023-07-21T23:02:29.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.463+0000 7f067e3ff700 1 Processor -- start 2023-07-21T23:02:29.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.464+0000 7f067e3ff700 1 -- start start 2023-07-21T23:02:29.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.464+0000 7f067e3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0678074a40 0x7f06781072f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.464+0000 7f067e3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0678075350 0x7f0678107830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.464+0000 7f067e3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06781109b0 0x7f0678101c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.464+0000 7f067e3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06781022d0 con 0x7f0678075350 2023-07-21T23:02:29.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.464+0000 7f067e3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0678102440 con 0x7f0678074a40 2023-07-21T23:02:29.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.464+0000 7f067e3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0678102600 con 0x7f06781109b0 2023-07-21T23:02:29.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.465+0000 7f0677fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0678074a40 0x7f06781072f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.465+0000 7f0677fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0678074a40 0x7f06781072f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:58938/0 (socket says 172.21.15.151:58938) 2023-07-21T23:02:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.465+0000 7f0677fff700 1 -- 172.21.15.151:0/74161284 learned_addr learned my addr 172.21.15.151:0/74161284 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.465+0000 7f06777fe700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0678075350 0x7f0678107830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.465+0000 7f06777fe700 1 -- 172.21.15.151:0/74161284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06781109b0 msgr2=0x7f0678101c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.465+0000 7f06777fe700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06781109b0 0x7f0678101c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.465+0000 7f06777fe700 1 -- 172.21.15.151:0/74161284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0678074a40 msgr2=0x7f06781072f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:29.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.465+0000 7f06777fe700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0678074a40 0x7f06781072f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.465+0000 7f06777fe700 1 -- 172.21.15.151:0/74161284 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06680095f0 con 0x7f0678075350 2023-07-21T23:02:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.466+0000 7f06777fe700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0678075350 0x7f0678107830 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f06680098e0 tx=0x7f0668003920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.469+0000 7f06757fa700 1 -- 172.21.15.151:0/74161284 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066801d070 con 0x7f0678075350 2023-07-21T23:02:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.469+0000 7f06757fa700 1 -- 172.21.15.151:0/74161284 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f066800bdb0 con 0x7f0678075350 2023-07-21T23:02:29.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.469+0000 7f06757fa700 1 -- 172.21.15.151:0/74161284 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066800fd20 con 0x7f0678075350 2023-07-21T23:02:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.469+0000 7f067e3ff700 1 -- 172.21.15.151:0/74161284 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0678102880 con 0x7f0678075350 2023-07-21T23:02:29.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.469+0000 7f067e3ff700 1 -- 172.21.15.151:0/74161284 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067810e320 con 0x7f0678075350 2023-07-21T23:02:29.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.478+0000 7f0691ce4b80 1 Processor -- start 2023-07-21T23:02:29.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.479+0000 7f0691ce4b80 1 -- start start 2023-07-21T23:02:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623583906b0 0x562358539cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a210 0x562358533f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a660 0x5623585344a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562358439c50 con 0x56235853a660 2023-07-21T23:02:29.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56235848c9e0 con 0x5623583906b0 2023-07-21T23:02:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562358485e70 con 0x56235853a210 2023-07-21T23:02:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f0677fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a210 0x562358533f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f0677fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a210 0x562358533f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:41792/0 (socket says 172.21.15.151:41792) 2023-07-21T23:02:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f0677fff700 1 -- 172.21.15.151:0/177394710 learned_addr learned my addr 172.21.15.151:0/177394710 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:29.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.480+0000 7f067c99c700 1 --2- 172.21.15.151:0/177394710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623583906b0 0x562358539cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.481+0000 7f06757fa700 1 -- 172.21.15.151:0/74161284 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f066800f460 con 0x7f0678075350 2023-07-21T23:02:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.481+0000 7f067c99c700 1 -- 172.21.15.151:0/177394710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a210 msgr2=0x562358533f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.481+0000 7f067c99c700 1 --2- 172.21.15.151:0/177394710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a210 0x562358533f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.481+0000 7f067c99c700 1 -- 172.21.15.151:0/177394710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a660 msgr2=0x5623585344a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.481+0000 7f067c99c700 1 --2- 172.21.15.151:0/177394710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a660 0x5623585344a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.481+0000 7f067c99c700 1 -- 172.21.15.151:0/177394710 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623582b3d80 con 0x5623583906b0 2023-07-21T23:02:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.482+0000 7f067c99c700 1 --2- 172.21.15.151:0/177394710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623583906b0 0x562358539cd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f067000e3e0 tx=0x7f067000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a3c7b85e8b2997b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:29.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.482+0000 7f066e7fc700 1 -- 172.21.15.151:0/177394710 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670010040 con 0x5623583906b0 2023-07-21T23:02:29.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.482+0000 7f066e7fc700 1 -- 172.21.15.151:0/177394710 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0670003e90 con 0x5623583906b0 2023-07-21T23:02:29.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.482+0000 7f066e7fc700 1 -- 172.21.15.151:0/177394710 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670004250 con 0x5623583906b0 2023-07-21T23:02:29.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.483+0000 7f0691ce4b80 1 -- 172.21.15.151:0/177394710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623583906b0 msgr2=0x562358539cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:29.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.483+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/177394710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623583906b0 0x562358539cd0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f067000e3e0 tx=0x7f067000b040 comp rx=0 tx=0).stop 2023-07-21T23:02:29.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.484+0000 7f06757fa700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06640a1490 0x7f06640a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.484+0000 7f06757fa700 1 -- 172.21.15.151:0/74161284 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f06680cdde0 con 0x7f0678075350 2023-07-21T23:02:29.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.484+0000 7f0691ce4b80 1 -- 172.21.15.151:0/177394710 shutdown_connections 2023-07-21T23:02:29.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.484+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/177394710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5623583906b0 0x562358539cd0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.484+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/177394710 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a660 0x5623585344a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.484+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/177394710 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a210 0x562358533f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.484+0000 7f0691ce4b80 1 -- 172.21.15.151:0/177394710 >> 172.21.15.151:0/177394710 conn(0x562358529ae0 msgr2=0x56235852f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:29.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.485+0000 7f0691ce4b80 1 -- 172.21.15.151:0/177394710 shutdown_connections 2023-07-21T23:02:29.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.485+0000 7f067c99c700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06640a1490 0x7f06640a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.485+0000 7f0691ce4b80 1 -- 172.21.15.151:0/177394710 wait complete. 2023-07-21T23:02:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.486+0000 7f0691ce4b80 1 -- start start 2023-07-21T23:02:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.486+0000 7f0691ce4b80 1 Processor -- start 2023-07-21T23:02:29.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.486+0000 7f067c99c700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06640a1490 0x7f06640a3940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0670009320 tx=0x7f0670004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.487+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623583906b0 0x562358540560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.487+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a210 0x56235853d850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.487+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a660 0x56235853deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.487+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562358425a60 con 0x5623583906b0 2023-07-21T23:02:29.521 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.487+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562358425760 con 0x56235853a210 2023-07-21T23:02:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.487+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623583098c0 con 0x56235853a660 2023-07-21T23:02:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.487+0000 7f0691ce4b80 10 client.0 _ll_register_callbacks cb 0x562358423700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.488+0000 7f067c99c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a660 0x56235853deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.488+0000 7f067c99c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a660 0x56235853deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:41804/0 (socket says 172.21.15.151:41804) 2023-07-21T23:02:29.522 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.488+0000 7f067c99c700 1 -- 172.21.15.151:0/3898127320 learned_addr learned my addr 172.21.15.151:0/3898127320 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.488+0000 7f0677fff700 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623583906b0 0x562358540560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.523 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.488+0000 7f06777fe700 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a210 0x56235853d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f067c99c700 1 -- 172.21.15.151:0/3898127320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a210 msgr2=0x56235853d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f067c99c700 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a210 0x56235853d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f067c99c700 1 -- 172.21.15.151:0/3898127320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623583906b0 msgr2=0x562358540560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f067c99c700 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623583906b0 0x562358540560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f067c99c700 1 -- 172.21.15.151:0/3898127320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f067000e0c0 con 0x56235853a660 2023-07-21T23:02:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f0677fff700 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623583906b0 0x562358540560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:02:29.524 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f067c99c700 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a660 0x56235853deb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0670003c10 tx=0x7f067000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95e386f9c1d9578f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f06577fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:02:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f06577fe700 1 -- 172.21.15.151:0/3898127320 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0670010040 con 0x56235853a660 2023-07-21T23:02:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.489+0000 7f06577fe700 1 -- 172.21.15.151:0/3898127320 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0670007500 con 0x56235853a660 2023-07-21T23:02:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.490+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3898127320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5623583df490 con 0x56235853a660 2023-07-21T23:02:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.490+0000 7f06577fe700 1 -- 172.21.15.151:0/3898127320 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0670003cf0 con 0x56235853a660 2023-07-21T23:02:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.490+0000 7f0691ce4b80 10 client.29326 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:29.525 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.490+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3898127320 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x56235829cc00 con 0x56235853a660 2023-07-21T23:02:29.526 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.490+0000 7f06577fe700 1 -- 172.21.15.151:0/3898127320 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5623583df490 con 0x56235853a660 2023-07-21T23:02:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.491+0000 7f06577fe700 1 -- 172.21.15.151:0/3898127320 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0670029720 con 0x56235853a660 2023-07-21T23:02:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.491+0000 7f0691ce4b80 10 client.29326 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.491+0000 7f0691ce4b80 10 client.29326 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.491+0000 7f0691ce4b80 20 client.29326 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.491+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56235854db30 0x56235854ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.491+0000 7f0691ce4b80 4 client.29326 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:02:29.527 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.491+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3898127320 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56235847ee50 con 0x56235854db30 2023-07-21T23:02:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.491+0000 7f0677fff700 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56235854db30 0x56235854ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.492+0000 7f06577fe700 10 client.29326 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.492+0000 7f0677fff700 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56235854db30 0x56235854ff40 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=255df2bc605f07f8 server_cookie=ec22be46096c9696 in_seq=0 out_seq=0 2023-07-21T23:02:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.493+0000 7f06577fe700 1 -- 172.21.15.151:0/3898127320 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56235847ee50 con 0x56235854db30 2023-07-21T23:02:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.493+0000 7f06577fe700 10 client.29326 handle_command_reply: tid=0 2023-07-21T23:02:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.493+0000 7f0691ce4b80 1 client.29326 shutdown 2023-07-21T23:02:29.528 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.493+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3898127320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a660 msgr2=0x56235853deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.493+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a660 0x56235853deb0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f0670003c10 tx=0x7f067000b040 comp rx=0 tx=0).stop 2023-07-21T23:02:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.493+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3898127320 shutdown_connections 2023-07-21T23:02:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.493+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56235854db30 0x56235854ff40 crc :-1 s=READY pgs=485 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.494+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56235853a660 0x56235853deb0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.494+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5623583906b0 0x562358540560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.494+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3898127320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a210 0x56235853d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.494+0000 7f06577fe700 0 client.29326 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:29.529 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.494+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3898127320 >> 172.21.15.151:0/3898127320 conn(0x562358529ae0 msgr2=0x56235852e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.494+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3898127320 shutdown_connections 2023-07-21T23:02:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.494+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3898127320 wait complete. 2023-07-21T23:02:29.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.495+0000 7f0691ce4b80 20 client.29326 trim_cache size 0 max 16384 2023-07-21T23:02:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.516+0000 7f0691ce4b80 1 Processor -- start 2023-07-21T23:02:29.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.516+0000 7f0691ce4b80 1 -- start start 2023-07-21T23:02:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.516+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.516+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 0x56235853d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.517+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 0x562358540100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.517+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562358533f80 con 0x56235853a210 2023-07-21T23:02:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.517+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623585505a0 con 0x56235853a660 2023-07-21T23:02:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.517+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56235853bdd0 con 0x5623583906b0 2023-07-21T23:02:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.517+0000 7f0677fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.517+0000 7f067c99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 0x562358540100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.517+0000 7f0677fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:41816/0 (socket says 172.21.15.151:41816) 2023-07-21T23:02:29.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.517+0000 7f0677fff700 1 -- 172.21.15.151:0/1161829057 learned_addr learned my addr 172.21.15.151:0/1161829057 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:29.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.517+0000 7f06777fe700 1 --2- 172.21.15.151:0/1161829057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 0x56235853d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.518+0000 7f0677fff700 1 -- 172.21.15.151:0/1161829057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 msgr2=0x562358540100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.518+0000 7f0677fff700 1 --2- 172.21.15.151:0/1161829057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 0x562358540100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.518+0000 7f0677fff700 1 -- 172.21.15.151:0/1161829057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 msgr2=0x56235853d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.518+0000 7f0677fff700 1 --2- 172.21.15.151:0/1161829057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 0x56235853d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.518+0000 7f0677fff700 1 -- 172.21.15.151:0/1161829057 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5623582da1f0 con 0x5623583906b0 2023-07-21T23:02:29.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.518+0000 7f0677fff700 1 --2- 172.21.15.151:0/1161829057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544c30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x5623585507e0 tx=0x7f0660009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b2e78992326cd00 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.518+0000 7f066effd700 1 -- 172.21.15.151:0/1161829057 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066001f250 con 0x5623583906b0 2023-07-21T23:02:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.518+0000 7f066effd700 1 -- 172.21.15.151:0/1161829057 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0660018040 con 0x5623583906b0 2023-07-21T23:02:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.518+0000 7f066effd700 1 -- 172.21.15.151:0/1161829057 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066001e810 con 0x5623583906b0 2023-07-21T23:02:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.519+0000 7f0691ce4b80 1 -- 172.21.15.151:0/1161829057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 msgr2=0x562358544c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.519+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/1161829057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544c30 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x5623585507e0 tx=0x7f0660009260 comp rx=0 tx=0).stop 2023-07-21T23:02:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.519+0000 7f0691ce4b80 1 -- 172.21.15.151:0/1161829057 shutdown_connections 2023-07-21T23:02:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.519+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/1161829057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 0x562358540100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.519+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/1161829057 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544c30 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.519+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/1161829057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 0x56235853d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.520+0000 7f0691ce4b80 1 -- 172.21.15.151:0/1161829057 >> 172.21.15.151:0/1161829057 conn(0x562358529ae0 msgr2=0x5623585379d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.520+0000 7f0691ce4b80 1 -- 172.21.15.151:0/1161829057 shutdown_connections 2023-07-21T23:02:29.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.520+0000 7f0691ce4b80 1 -- 172.21.15.151:0/1161829057 wait complete. 2023-07-21T23:02:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.521+0000 7f0691ce4b80 1 -- start start 2023-07-21T23:02:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.521+0000 7f0691ce4b80 1 Processor -- start 2023-07-21T23:02:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 0x562358535c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f0691ce4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 0x5623585363b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562358536af0 con 0x56235853a210 2023-07-21T23:02:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623585a19b0 con 0x56235853a660 2023-07-21T23:02:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f0691ce4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5623585a1af0 con 0x5623583906b0 2023-07-21T23:02:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f0691ce4b80 10 client.0 _ll_register_callbacks cb 0x7f0670004ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f06777fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 0x562358535c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f0677fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f06777fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 0x562358535c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56426/0 (socket says 172.21.15.151:56426) 2023-07-21T23:02:29.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.522+0000 7f06777fe700 1 -- 172.21.15.151:0/3089855273 learned_addr learned my addr 172.21.15.151:0/3089855273 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:29.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.523+0000 7f067c99c700 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 0x5623585363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.523+0000 7f0677fff700 1 -- 172.21.15.151:0/3089855273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 msgr2=0x5623585363b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.523+0000 7f0677fff700 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 0x5623585363b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.523+0000 7f0677fff700 1 -- 172.21.15.151:0/3089855273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 msgr2=0x562358535c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.523+0000 7f0677fff700 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 0x562358535c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.523+0000 7f0677fff700 1 -- 172.21.15.151:0/3089855273 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0660009c60 con 0x5623583906b0 2023-07-21T23:02:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.523+0000 7f0677fff700 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544e30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0660000c00 tx=0x7f066001f260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8834bf7d5d3ea863 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.523+0000 7f06577fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:02:29.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.524+0000 7f06577fe700 1 -- 172.21.15.151:0/3089855273 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f066002c030 con 0x5623583906b0 2023-07-21T23:02:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.524+0000 7f06577fe700 1 -- 172.21.15.151:0/3089855273 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f066002d070 con 0x5623583906b0 2023-07-21T23:02:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.524+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3089855273 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0670003e90 con 0x5623583906b0 2023-07-21T23:02:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.524+0000 7f06577fe700 1 -- 172.21.15.151:0/3089855273 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f066001f610 con 0x5623583906b0 2023-07-21T23:02:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.524+0000 7f0691ce4b80 10 client.29332 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.524+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3089855273 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x5623582b2250 con 0x5623583906b0 2023-07-21T23:02:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.524+0000 7f06577fe700 1 -- 172.21.15.151:0/3089855273 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0670003e90 con 0x5623583906b0 2023-07-21T23:02:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.525+0000 7f06577fe700 1 -- 172.21.15.151:0/3089855273 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0660005150 con 0x5623583906b0 2023-07-21T23:02:29.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.525+0000 7f0691ce4b80 10 client.29332 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.525+0000 7f0691ce4b80 10 client.29332 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.525+0000 7f0691ce4b80 20 client.29332 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.525+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5623585a30a0 0x5623585a54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.525+0000 7f0691ce4b80 4 client.29332 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:02:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.525+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3089855273 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562358440ff0 con 0x5623585a30a0 2023-07-21T23:02:29.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.525+0000 7f06777fe700 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5623585a30a0 0x5623585a54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.526+0000 7f06777fe700 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5623585a30a0 0x5623585a54b0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8a904425e0c0d54 server_cookie=4bb36f4233ce4353 in_seq=0 out_seq=0 2023-07-21T23:02:29.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.526+0000 7f06577fe700 10 client.29332 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:29.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.552+0000 7f06577fe700 1 -- 172.21.15.151:0/3089855273 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562358440ff0 con 0x5623585a30a0 2023-07-21T23:02:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.552+0000 7f06577fe700 10 client.29332 handle_command_reply: tid=0 2023-07-21T23:02:29.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 client.29332 shutdown 2023-07-21T23:02:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3089855273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 msgr2=0x562358544e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544e30 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f0660000c00 tx=0x7f066001f260 comp rx=0 tx=0).stop 2023-07-21T23:02:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3089855273 shutdown_connections 2023-07-21T23:02:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5623585a30a0 0x5623585a54b0 crc :-1 s=READY pgs=486 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56235853a660 0x5623585363b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5623583906b0 0x562358544e30 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f06577fe700 0 client.29332 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 --2- 172.21.15.151:0/3089855273 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56235853a210 0x562358535c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3089855273 >> 172.21.15.151:0/3089855273 conn(0x562358529ae0 msgr2=0x562358538950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.553+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3089855273 shutdown_connections 2023-07-21T23:02:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.554+0000 7f0691ce4b80 1 -- 172.21.15.151:0/3089855273 wait complete. 2023-07-21T23:02:29.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.554+0000 7f0691ce4b80 20 client.29332 trim_cache size 0 max 16384 2023-07-21T23:02:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:02:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:02:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:02:29.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:02:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 -- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06640a1490 msgr2=0x7f06640a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06640a1490 0x7f06640a3940 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f0670009320 tx=0x7f0670004ad0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 -- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0678075350 msgr2=0x7f0678107830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0678075350 0x7f0678107830 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f06680098e0 tx=0x7f0668003920 comp rx=0 tx=0).stop 2023-07-21T23:02:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 -- 172.21.15.151:0/74161284 shutdown_connections 2023-07-21T23:02:29.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f06640a1490 0x7f06640a3940 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0678074a40 0x7f06781072f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f06781109b0 0x7f0678101c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 --2- 172.21.15.151:0/74161284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0678075350 0x7f0678107830 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.555+0000 7f067e3ff700 1 -- 172.21.15.151:0/74161284 >> 172.21.15.151:0/74161284 conn(0x7f06780fd7f0 msgr2=0x7f06780ffbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.556+0000 7f067e3ff700 1 -- 172.21.15.151:0/74161284 shutdown_connections 2023-07-21T23:02:29.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:29.556+0000 7f067e3ff700 1 -- 172.21.15.151:0/74161284 wait complete. 2023-07-21T23:02:30.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:30 smithi195 ceph-mon[97365]: pgmap v1380: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.9 MiB/s wr, 820 op/s 2023-07-21T23:02:30.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:30 smithi151 ceph-mon[95510]: pgmap v1380: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.9 MiB/s wr, 820 op/s 2023-07-21T23:02:30.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:30 smithi187 ceph-mon[96918]: pgmap v1380: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.9 MiB/s wr, 820 op/s 2023-07-21T23:02:33.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:32 smithi187 ceph-mon[96918]: pgmap v1381: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.1 MiB/s wr, 723 op/s 2023-07-21T23:02:33.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:32 smithi195 ceph-mon[97365]: pgmap v1381: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.1 MiB/s wr, 723 op/s 2023-07-21T23:02:33.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:32 smithi151 ceph-mon[95510]: pgmap v1381: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 7.1 MiB/s wr, 723 op/s 2023-07-21T23:02:34.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 580.0 s, 161.5 tps, lat 250.776 ms stddev 60.672 2023-07-21T23:02:35.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:34 smithi187 ceph-mon[96918]: pgmap v1382: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.7 MiB/s wr, 997 op/s 2023-07-21T23:02:35.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:34 smithi195 ceph-mon[97365]: pgmap v1382: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.7 MiB/s wr, 997 op/s 2023-07-21T23:02:35.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:34 smithi151 ceph-mon[95510]: pgmap v1382: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.7 MiB/s wr, 997 op/s 2023-07-21T23:02:37.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:36 smithi187 ceph-mon[96918]: pgmap v1383: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 541 op/s 2023-07-21T23:02:37.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:36 smithi195 ceph-mon[97365]: pgmap v1383: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 541 op/s 2023-07-21T23:02:37.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:36 smithi151 ceph-mon[95510]: pgmap v1383: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 5.4 MiB/s wr, 541 op/s 2023-07-21T23:02:39.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 585.0 s, 277.9 tps, lat 570.268 ms stddev 1353.188 2023-07-21T23:02:39.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:38 smithi187 ceph-mon[96918]: pgmap v1384: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 683 op/s 2023-07-21T23:02:39.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:38 smithi195 ceph-mon[97365]: pgmap v1384: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 683 op/s 2023-07-21T23:02:39.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:38 smithi151 ceph-mon[95510]: pgmap v1384: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 683 op/s 2023-07-21T23:02:41.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:40 smithi187 ceph-mon[96918]: pgmap v1385: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 523 op/s 2023-07-21T23:02:41.401 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:40 smithi195 ceph-mon[97365]: pgmap v1385: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 523 op/s 2023-07-21T23:02:41.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:40 smithi151 ceph-mon[95510]: pgmap v1385: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 5.0 MiB/s wr, 523 op/s 2023-07-21T23:02:42.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.802+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/3584652230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db406d3a0 msgr2=0x7f6db411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.802+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/3584652230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db406d3a0 0x7f6db411b470 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6dac01a9a0 tx=0x7f6dac01acb0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.802+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/3584652230 shutdown_connections 2023-07-21T23:02:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.802+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/3584652230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db406d3a0 0x7f6db411b470 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.802+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/3584652230 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6db410e2a0 0x7f6db410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.802+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/3584652230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db406c910 0x7f6db406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.802+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/3584652230 >> 172.21.15.151:0/3584652230 conn(0x7f6db406bd70 msgr2=0x7f6db4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.807+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/3584652230 shutdown_connections 2023-07-21T23:02:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.807+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/3584652230 wait complete. 2023-07-21T23:02:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.808+0000 7f6dbc3ff700 1 Processor -- start 2023-07-21T23:02:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.809+0000 7f6dbc3ff700 1 -- start start 2023-07-21T23:02:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.809+0000 7f6dbc3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db406c910 0x7f6db4116cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.809+0000 7f6dbc3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6db406d3a0 0x7f6db4117200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.809+0000 7f6dbc3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db410e2a0 0x7f6db411a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.809+0000 7f6dbc3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db411aea0 con 0x7f6db406c910 2023-07-21T23:02:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.809+0000 7f6dbc3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db411b010 con 0x7f6db410e2a0 2023-07-21T23:02:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.809+0000 7f6dbc3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db411b1d0 con 0x7f6db406d3a0 2023-07-21T23:02:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6dba99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db410e2a0 0x7f6db411a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6db999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6db406d3a0 0x7f6db4117200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6dba99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db410e2a0 0x7f6db411a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46684/0 (socket says 172.21.15.151:46684) 2023-07-21T23:02:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6dba99c700 1 -- 172.21.15.151:0/4164998129 learned_addr learned my addr 172.21.15.151:0/4164998129 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6dba19b700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db406c910 0x7f6db4116cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6dba99c700 1 -- 172.21.15.151:0/4164998129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6db406d3a0 msgr2=0x7f6db4117200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6dba99c700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6db406d3a0 0x7f6db4117200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6dba99c700 1 -- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db406c910 msgr2=0x7f6db4116cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6dba99c700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db406c910 0x7f6db4116cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.810+0000 7f6dba99c700 1 -- 172.21.15.151:0/4164998129 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dac01a600 con 0x7f6db410e2a0 2023-07-21T23:02:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.811+0000 7f6dba99c700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db410e2a0 0x7f6db411a860 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0036c0 tx=0x7f6dac005750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.812+0000 7f6dab7fe700 1 -- 172.21.15.151:0/4164998129 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac003a00 con 0x7f6db410e2a0 2023-07-21T23:02:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.812+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/4164998129 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db411b450 con 0x7f6db410e2a0 2023-07-21T23:02:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.812+0000 7f6dab7fe700 1 -- 172.21.15.151:0/4164998129 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6dac030420 con 0x7f6db410e2a0 2023-07-21T23:02:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.812+0000 7f6dab7fe700 1 -- 172.21.15.151:0/4164998129 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac028650 con 0x7f6db410e2a0 2023-07-21T23:02:42.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.813+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/4164998129 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db41a9210 con 0x7f6db410e2a0 2023-07-21T23:02:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.820+0000 7f6dab7fe700 1 -- 172.21.15.151:0/4164998129 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6dac030850 con 0x7f6db410e2a0 2023-07-21T23:02:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.820+0000 7f6dcfd92b80 1 Processor -- start 2023-07-21T23:02:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.821+0000 7f6dcfd92b80 1 -- start start 2023-07-21T23:02:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.821+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe95cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.821+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fe96210 0x56423fe8ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.821+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96660 0x56423fe904a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.821+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fd95c50 con 0x56423fcec6b0 2023-07-21T23:02:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.821+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fde89e0 con 0x56423fe96660 2023-07-21T23:02:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.821+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fde1e70 con 0x56423fe96210 2023-07-21T23:02:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.822+0000 7f6db999a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96660 0x56423fe904a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6db999a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96660 0x56423fe904a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46686/0 (socket says 172.21.15.151:46686) 2023-07-21T23:02:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6db999a700 1 -- 172.21.15.151:0/3468421538 learned_addr learned my addr 172.21.15.151:0/3468421538 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6db999a700 1 --2- 172.21.15.151:0/3468421538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe95cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6dab7fe700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6da00a1400 0x7f6da00a38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6db999a700 1 -- 172.21.15.151:0/3468421538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fe96210 msgr2=0x56423fe8ff40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:02:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6db999a700 1 --2- 172.21.15.151:0/3468421538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fe96210 0x56423fe8ff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6db999a700 1 -- 172.21.15.151:0/3468421538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 msgr2=0x56423fe95cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6db999a700 1 --2- 172.21.15.151:0/3468421538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe95cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6db999a700 1 -- 172.21.15.151:0/3468421538 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56423fc0fd80 con 0x56423fe96660 2023-07-21T23:02:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.823+0000 7f6dab7fe700 1 -- 172.21.15.151:0/4164998129 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6dac0de860 con 0x7f6db410e2a0 2023-07-21T23:02:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.824+0000 7f6db999a700 1 --2- 172.21.15.151:0/3468421538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96660 0x56423fe904a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6da4017790 tx=0x7f6da40095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=abced4a9009eb146 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.824+0000 7f6da8bfe700 1 -- 172.21.15.151:0/3468421538 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4018450 con 0x56423fe96660 2023-07-21T23:02:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.824+0000 7f6da8bfe700 1 -- 172.21.15.151:0/3468421538 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6da4018a40 con 0x56423fe96660 2023-07-21T23:02:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.824+0000 7f6da8bfe700 1 -- 172.21.15.151:0/3468421538 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4013740 con 0x56423fe96660 2023-07-21T23:02:42.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.825+0000 7f6dba99c700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6da00a1400 0x7f6da00a38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.825+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/3468421538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96660 msgr2=0x56423fe904a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:42.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.825+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/3468421538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96660 0x56423fe904a0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f6da4017790 tx=0x7f6da40095a0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.860 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.826+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/3468421538 shutdown_connections 2023-07-21T23:02:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.826+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/3468421538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96660 0x56423fe904a0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.826+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/3468421538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe95cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.861 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.826+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/3468421538 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fe96210 0x56423fe8ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.826+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/3468421538 >> 172.21.15.151:0/3468421538 conn(0x56423fe85ae0 msgr2=0x56423fe8b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.832+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/3468421538 shutdown_connections 2023-07-21T23:02:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.833+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/3468421538 wait complete. 2023-07-21T23:02:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.834+0000 7f6dcfd92b80 1 -- start start 2023-07-21T23:02:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.834+0000 7f6dba99c700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6da00a1400 0x7f6da00a38b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6dac03f030 tx=0x7f6dac03efa0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.834+0000 7f6dcfd92b80 1 Processor -- start 2023-07-21T23:02:42.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.835+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe9f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.835+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fe9fba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.835+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fe96660 0x56423fe99920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.835+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fd81a60 con 0x56423fcec6b0 2023-07-21T23:02:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.835+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fd81760 con 0x56423fe96210 2023-07-21T23:02:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.835+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fc658c0 con 0x56423fe96660 2023-07-21T23:02:42.869 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.835+0000 7f6dcfd92b80 10 client.0 _ll_register_callbacks cb 0x56423fd7f700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.836+0000 7f6db999a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe9f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.836+0000 7f6db999a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe9f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60746/0 (socket says 172.21.15.151:60746) 2023-07-21T23:02:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.836+0000 7f6db999a700 1 -- 172.21.15.151:0/895552530 learned_addr learned my addr 172.21.15.151:0/895552530 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.836+0000 7f6db999a700 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fe96660 0x56423fe99920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.836+0000 7f6db999a700 1 -- 172.21.15.151:0/895552530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fe96660 msgr2=0x56423fe99920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.836+0000 7f6db999a700 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fe96660 0x56423fe99920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.836+0000 7f6db999a700 1 -- 172.21.15.151:0/895552530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 msgr2=0x56423fe9fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:42.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.836+0000 7f6db999a700 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fe9fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.836+0000 7f6db999a700 1 -- 172.21.15.151:0/895552530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6da4017440 con 0x56423fcec6b0 2023-07-21T23:02:42.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.838+0000 7f6db999a700 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe9f660 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6da4001eb0 tx=0x7f6da4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6319cd40d97f040a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:42.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.838+0000 7f6d9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:02:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.838+0000 7f6d9dffb700 1 -- 172.21.15.151:0/895552530 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4023610 con 0x56423fcec6b0 2023-07-21T23:02:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.838+0000 7f6d9dffb700 1 -- 172.21.15.151:0/895552530 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6da4000e40 con 0x56423fcec6b0 2023-07-21T23:02:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.839+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/895552530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56423fd3b490 con 0x56423fcec6b0 2023-07-21T23:02:42.874 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.839+0000 7f6d9dffb700 1 -- 172.21.15.151:0/895552530 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6da4023770 con 0x56423fcec6b0 2023-07-21T23:02:42.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.840+0000 7f6dcfd92b80 10 client.19641 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:42.875 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.840+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/895552530 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x56423fbf8c00 con 0x56423fcec6b0 2023-07-21T23:02:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.840+0000 7f6d9dffb700 1 -- 172.21.15.151:0/895552530 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6da4034030 con 0x56423fcec6b0 2023-07-21T23:02:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.840+0000 7f6d9dffb700 1 -- 172.21.15.151:0/895552530 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6da402d020 con 0x56423fcec6b0 2023-07-21T23:02:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.841+0000 7f6dcfd92b80 10 client.19641 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:42.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.841+0000 7f6dcfd92b80 10 client.19641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:42.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.841+0000 7f6dcfd92b80 20 client.19641 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:42.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.841+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56423fea9b10 0x56423feabf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.877 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.841+0000 7f6dcfd92b80 4 client.19641 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:02:42.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.841+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/895552530 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56423fddae50 con 0x56423fea9b10 2023-07-21T23:02:42.878 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.841+0000 7f6dba19b700 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56423fea9b10 0x56423feabf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.843+0000 7f6dba19b700 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56423fea9b10 0x56423feabf20 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c15bdfb2e80a57ec server_cookie=3a00d6dab230eb1a in_seq=0 out_seq=0 2023-07-21T23:02:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.843+0000 7f6d9dffb700 10 client.19641 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.845+0000 7f6d9dffb700 1 -- 172.21.15.151:0/895552530 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56423fddae50 con 0x56423fea9b10 2023-07-21T23:02:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.845+0000 7f6d9dffb700 10 client.19641 handle_command_reply: tid=0 2023-07-21T23:02:42.880 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.845+0000 7f6dcfd92b80 1 client.19641 shutdown 2023-07-21T23:02:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.848+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/895552530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 msgr2=0x56423fe9f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.848+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe9f660 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f6da4001eb0 tx=0x7f6da4009bb0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.848+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/895552530 shutdown_connections 2023-07-21T23:02:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.848+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56423fea9b10 0x56423feabf20 crc :-1 s=READY pgs=487 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.848+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fe96660 0x56423fe99920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.848+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fcec6b0 0x56423fe9f660 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.848+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/895552530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fe9fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.848+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/895552530 >> 172.21.15.151:0/895552530 conn(0x56423fe85ae0 msgr2=0x56423fe8a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:42.882 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.848+0000 7f6d9dffb700 0 client.19641 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.849+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/895552530 shutdown_connections 2023-07-21T23:02:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.849+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/895552530 wait complete. 2023-07-21T23:02:42.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.849+0000 7f6dcfd92b80 20 client.19641 trim_cache size 0 max 16384 2023-07-21T23:02:42.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.874+0000 7f6dcfd92b80 1 Processor -- start 2023-07-21T23:02:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.876+0000 7f6dcfd92b80 1 -- start start 2023-07-21T23:02:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.876+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fe95200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.876+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fe8ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.876+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 0x56423fe90480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.876+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fe82b00 con 0x56423fe96660 2023-07-21T23:02:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.876+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fe874f0 con 0x56423fe96210 2023-07-21T23:02:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.876+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fe94560 con 0x56423fcec6b0 2023-07-21T23:02:42.911 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.877+0000 7f6db999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fe95200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.877+0000 7f6db999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fe95200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54660/0 (socket says 172.21.15.151:54660) 2023-07-21T23:02:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.877+0000 7f6db999a700 1 -- 172.21.15.151:0/891500878 learned_addr learned my addr 172.21.15.151:0/891500878 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:42.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.877+0000 7f6db999a700 1 --2- 172.21.15.151:0/891500878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 0x56423fe90480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.878+0000 7f6dba19b700 1 --2- 172.21.15.151:0/891500878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fe8ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.913 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.878+0000 7f6db999a700 1 -- 172.21.15.151:0/891500878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 msgr2=0x56423fe8ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.878+0000 7f6db999a700 1 --2- 172.21.15.151:0/891500878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fe8ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.878+0000 7f6db999a700 1 -- 172.21.15.151:0/891500878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 msgr2=0x56423fe90480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.878+0000 7f6db999a700 1 --2- 172.21.15.151:0/891500878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 0x56423fe90480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.878+0000 7f6db999a700 1 -- 172.21.15.151:0/891500878 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56423fc361f0 con 0x56423fcec6b0 2023-07-21T23:02:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.878+0000 7f6db999a700 1 --2- 172.21.15.151:0/891500878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fe95200 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x56423fe95830 tx=0x7f6da4000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3684c25db1d70465 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:42.914 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.880+0000 7f6da93ff700 1 -- 172.21.15.151:0/891500878 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4009510 con 0x56423fcec6b0 2023-07-21T23:02:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.880+0000 7f6da93ff700 1 -- 172.21.15.151:0/891500878 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6da4034070 con 0x56423fcec6b0 2023-07-21T23:02:42.915 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.880+0000 7f6da93ff700 1 -- 172.21.15.151:0/891500878 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4018e10 con 0x56423fcec6b0 2023-07-21T23:02:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.881+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/891500878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 msgr2=0x56423fe95200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.881+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/891500878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fe95200 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x56423fe95830 tx=0x7f6da4000bc0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.883+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/891500878 shutdown_connections 2023-07-21T23:02:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.883+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/891500878 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 0x56423fe90480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.883+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/891500878 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fe95200 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.883+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/891500878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fe8ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.883+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/891500878 >> 172.21.15.151:0/891500878 conn(0x56423fe85ae0 msgr2=0x56423fe99840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.888+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/891500878 shutdown_connections 2023-07-21T23:02:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.889+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/891500878 wait complete. 2023-07-21T23:02:42.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.889+0000 7f6dcfd92b80 1 -- start start 2023-07-21T23:02:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.890+0000 7f6dcfd92b80 1 Processor -- start 2023-07-21T23:02:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fef1920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fef1e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6dcfd92b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 0x56423fef23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fefcae0 con 0x56423fe96660 2023-07-21T23:02:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fefcc50 con 0x56423fe96210 2023-07-21T23:02:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6dcfd92b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56423fefce10 con 0x56423fcec6b0 2023-07-21T23:02:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6dcfd92b80 10 client.0 _ll_register_callbacks cb 0x7f6da4019ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6db999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fef1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6db999a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fef1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:54668/0 (socket says 172.21.15.151:54668) 2023-07-21T23:02:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.891+0000 7f6db999a700 1 -- 172.21.15.151:0/1389710476 learned_addr learned my addr 172.21.15.151:0/1389710476 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.892+0000 7f6db999a700 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 0x56423fef23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.892+0000 7f6db999a700 1 -- 172.21.15.151:0/1389710476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 msgr2=0x56423fef1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.892+0000 7f6db999a700 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fef1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.892+0000 7f6db999a700 1 -- 172.21.15.151:0/1389710476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 msgr2=0x56423fef23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.892+0000 7f6db999a700 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 0x56423fef23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.892+0000 7f6db999a700 1 -- 172.21.15.151:0/1389710476 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x56423fbf8c00 con 0x56423fcec6b0 2023-07-21T23:02:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.893+0000 7f6db999a700 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fef1920 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009c30 tx=0x7f6da4006f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a366b6204ae5ba0c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.893+0000 7f6d9dffb700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:02:42.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.893+0000 7f6d9dffb700 1 -- 172.21.15.151:0/1389710476 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da4047660 con 0x56423fcec6b0 2023-07-21T23:02:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.894+0000 7f6d9dffb700 1 -- 172.21.15.151:0/1389710476 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6da4000e40 con 0x56423fcec6b0 2023-07-21T23:02:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.894+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/1389710476 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f6da4018a40 con 0x56423fcec6b0 2023-07-21T23:02:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.894+0000 7f6d9dffb700 1 -- 172.21.15.151:0/1389710476 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6da40095d0 con 0x56423fcec6b0 2023-07-21T23:02:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.899+0000 7f6dcfd92b80 10 client.29347 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:42.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.899+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/1389710476 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x56423fc0e250 con 0x56423fcec6b0 2023-07-21T23:02:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.905+0000 7f6d9dffb700 1 -- 172.21.15.151:0/1389710476 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6da4054020 con 0x56423fcec6b0 2023-07-21T23:02:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.905+0000 7f6d9dffb700 1 -- 172.21.15.151:0/1389710476 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6da4042070 con 0x56423fcec6b0 2023-07-21T23:02:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.906+0000 7f6dcfd92b80 10 client.29347 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.906+0000 7f6dcfd92b80 10 client.29347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.906+0000 7f6dcfd92b80 20 client.29347 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.906+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56423fefdfc0 0x56423ff003a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.906+0000 7f6dcfd92b80 4 client.29347 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:02:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.906+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/1389710476 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56423fd9cff0 con 0x56423fefdfc0 2023-07-21T23:02:42.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.906+0000 7f6dba19b700 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56423fefdfc0 0x56423ff003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.911+0000 7f6dba19b700 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56423fefdfc0 0x56423ff003a0 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef76cac4021cb06c server_cookie=fe29cd205c10c3bd in_seq=0 out_seq=0 2023-07-21T23:02:42.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.912+0000 7f6d9dffb700 10 client.29347 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.978+0000 7f6d9dffb700 1 -- 172.21.15.151:0/1389710476 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56423fd9cff0 con 0x56423fefdfc0 2023-07-21T23:02:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.978+0000 7f6d9dffb700 10 client.29347 handle_command_reply: tid=0 2023-07-21T23:02:43.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.978+0000 7f6dcfd92b80 1 client.29347 shutdown 2023-07-21T23:02:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.979+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/1389710476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 msgr2=0x56423fef1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:43.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.979+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fef1920 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6da4009c30 tx=0x7f6da4006f60 comp rx=0 tx=0).stop 2023-07-21T23:02:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.985+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/1389710476 shutdown_connections 2023-07-21T23:02:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.985+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56423fefdfc0 0x56423ff003a0 crc :-1 s=READY pgs=488 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.985+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56423fe96660 0x56423fef23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:43.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.985+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56423fcec6b0 0x56423fef1920 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.985+0000 7f6dcfd92b80 1 --2- 172.21.15.151:0/1389710476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56423fe96210 0x56423fef1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.985+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/1389710476 >> 172.21.15.151:0/1389710476 conn(0x56423fe85ae0 msgr2=0x56423fe96a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.985+0000 7f6d9dffb700 0 client.29347 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.985+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/1389710476 shutdown_connections 2023-07-21T23:02:43.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.985+0000 7f6dcfd92b80 1 -- 172.21.15.151:0/1389710476 wait complete. 2023-07-21T23:02:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.986+0000 7f6dcfd92b80 20 client.29347 trim_cache size 0 max 16384 2023-07-21T23:02:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:02:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:02:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:02:43.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:02:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.987+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6da00a1400 msgr2=0x7f6da00a38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.987+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6da00a1400 0x7f6da00a38b0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f6dac03f030 tx=0x7f6dac03efa0 comp rx=0 tx=0).stop 2023-07-21T23:02:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.987+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/4164998129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db410e2a0 msgr2=0x7f6db411a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.987+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db410e2a0 0x7f6db411a860 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0036c0 tx=0x7f6dac005750 comp rx=0 tx=0).stop 2023-07-21T23:02:43.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.988+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/4164998129 shutdown_connections 2023-07-21T23:02:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.988+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f6da00a1400 0x7f6da00a38b0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.988+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6db410e2a0 0x7f6db411a860 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.988+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db406c910 0x7f6db4116cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.988+0000 7f6dbc3ff700 1 --2- 172.21.15.151:0/4164998129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6db406d3a0 0x7f6db4117200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:43.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.988+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/4164998129 >> 172.21.15.151:0/4164998129 conn(0x7f6db406bd70 msgr2=0x7f6db40707d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.988+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/4164998129 shutdown_connections 2023-07-21T23:02:43.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:42.989+0000 7f6dbc3ff700 1 -- 172.21.15.151:0/4164998129 wait complete. 2023-07-21T23:02:43.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:43 smithi187 ceph-mon[96918]: pgmap v1386: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 468 op/s 2023-07-21T23:02:43.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:43 smithi195 ceph-mon[97365]: pgmap v1386: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 468 op/s 2023-07-21T23:02:43.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:43 smithi151 ceph-mon[95510]: pgmap v1386: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.5 MiB/s wr, 468 op/s 2023-07-21T23:02:44.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 590.0 s, 307.4 tps, lat 324.074 ms stddev 80.463 2023-07-21T23:02:45.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:45 smithi187 ceph-mon[96918]: pgmap v1387: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 935 op/s 2023-07-21T23:02:45.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:45 smithi195 ceph-mon[97365]: pgmap v1387: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 935 op/s 2023-07-21T23:02:45.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:45 smithi151 ceph-mon[95510]: pgmap v1387: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 935 op/s 2023-07-21T23:02:47.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:47 smithi187 ceph-mon[96918]: pgmap v1388: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 660 op/s 2023-07-21T23:02:47.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:47 smithi195 ceph-mon[97365]: pgmap v1388: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 660 op/s 2023-07-21T23:02:47.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:47 smithi151 ceph-mon[95510]: pgmap v1388: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 6.5 MiB/s wr, 660 op/s 2023-07-21T23:02:49.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 595.0 s, 369.8 tps, lat 272.201 ms stddev 76.392 2023-07-21T23:02:49.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:49 smithi187 ceph-mon[96918]: pgmap v1389: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-07-21T23:02:49.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:49 smithi195 ceph-mon[97365]: pgmap v1389: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-07-21T23:02:49.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:49 smithi151 ceph-mon[95510]: pgmap v1389: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-07-21T23:02:51.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:51 smithi187 ceph-mon[96918]: pgmap v1390: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-07-21T23:02:51.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:51 smithi195 ceph-mon[97365]: pgmap v1390: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-07-21T23:02:51.444 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:51 smithi151 ceph-mon[95510]: pgmap v1390: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.01k op/s 2023-07-21T23:02:53.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:53 smithi187 ceph-mon[96918]: pgmap v1391: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 956 op/s 2023-07-21T23:02:53.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:53 smithi195 ceph-mon[97365]: pgmap v1391: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 956 op/s 2023-07-21T23:02:53.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:53 smithi151 ceph-mon[95510]: pgmap v1391: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 956 op/s 2023-07-21T23:02:54.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 600.0 s, 413.4 tps, lat 243.741 ms stddev 56.818 2023-07-21T23:02:55.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:55 smithi187 ceph-mon[96918]: pgmap v1392: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:02:55.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:55 smithi195 ceph-mon[97365]: pgmap v1392: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:02:55.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:55 smithi151 ceph-mon[95510]: pgmap v1392: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:02:56.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.239+0000 7f762f3ff700 1 -- 172.21.15.151:0/1241853654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280ffb30 msgr2=0x7f76280fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:56.272 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.239+0000 7f762f3ff700 1 --2- 172.21.15.151:0/1241853654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280ffb30 0x7f76280fffa0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f7618009990 tx=0x7f7618009ca0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.239+0000 7f762f3ff700 1 -- 172.21.15.151:0/1241853654 shutdown_connections 2023-07-21T23:02:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.239+0000 7f762f3ff700 1 --2- 172.21.15.151:0/1241853654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7628105b60 0x7f7628105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.239+0000 7f762f3ff700 1 --2- 172.21.15.151:0/1241853654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76281004e0 0x7f762810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.239+0000 7f762f3ff700 1 --2- 172.21.15.151:0/1241853654 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280ffb30 0x7f76280fffa0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.273 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.239+0000 7f762f3ff700 1 -- 172.21.15.151:0/1241853654 >> 172.21.15.151:0/1241853654 conn(0x7f76280fb5f0 msgr2=0x7f76280fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.240+0000 7f762f3ff700 1 -- 172.21.15.151:0/1241853654 shutdown_connections 2023-07-21T23:02:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.240+0000 7f762f3ff700 1 -- 172.21.15.151:0/1241853654 wait complete. 2023-07-21T23:02:56.274 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.241+0000 7f762f3ff700 1 Processor -- start 2023-07-21T23:02:56.275 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.241+0000 7f762f3ff700 1 -- start start 2023-07-21T23:02:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.242+0000 7f762f3ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280ffb30 0x7f762819bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.242+0000 7f762f3ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76281004e0 0x7f762819c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.242+0000 7f762f3ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7628105b60 0x7f7628195910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.242+0000 7f762f3ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76281960e0 con 0x7f7628105b60 2023-07-21T23:02:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.242+0000 7f762f3ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7628196220 con 0x7f76281004e0 2023-07-21T23:02:56.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.242+0000 7f762f3ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76281963e0 con 0x7f76280ffb30 2023-07-21T23:02:56.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.243+0000 7f762d99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7628105b60 0x7f7628195910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.243+0000 7f762d99c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7628105b60 0x7f7628195910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58394/0 (socket says 172.21.15.151:58394) 2023-07-21T23:02:56.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.243+0000 7f762d99c700 1 -- 172.21.15.151:0/2277432310 learned_addr learned my addr 172.21.15.151:0/2277432310 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:56.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.244+0000 7f762d19b700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280ffb30 0x7f762819bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.244+0000 7f762d99c700 1 -- 172.21.15.151:0/2277432310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280ffb30 msgr2=0x7f762819bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.244+0000 7f762d99c700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280ffb30 0x7f762819bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.244+0000 7f762d99c700 1 -- 172.21.15.151:0/2277432310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76281004e0 msgr2=0x7f762819c080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T23:02:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.244+0000 7f762d99c700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76281004e0 0x7f762819c080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.244+0000 7f762d99c700 1 -- 172.21.15.151:0/2277432310 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76180095f0 con 0x7f7628105b60 2023-07-21T23:02:56.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.245+0000 7f762d99c700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7628105b60 0x7f7628195910 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f762000d980 tx=0x7f762000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.245+0000 7f761e7fc700 1 -- 172.21.15.151:0/2277432310 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620004a30 con 0x7f7628105b60 2023-07-21T23:02:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.245+0000 7f761e7fc700 1 -- 172.21.15.151:0/2277432310 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f762000b5c0 con 0x7f7628105b60 2023-07-21T23:02:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.245+0000 7f761e7fc700 1 -- 172.21.15.151:0/2277432310 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7620009a40 con 0x7f7628105b60 2023-07-21T23:02:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.246+0000 7f762f3ff700 1 -- 172.21.15.151:0/2277432310 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76281966c0 con 0x7f7628105b60 2023-07-21T23:02:56.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.246+0000 7f762f3ff700 1 -- 172.21.15.151:0/2277432310 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762806a190 con 0x7f7628105b60 2023-07-21T23:02:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.255+0000 7f761e7fc700 1 -- 172.21.15.151:0/2277432310 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f7620009ba0 con 0x7f7628105b60 2023-07-21T23:02:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.256+0000 7f7642dd0b80 1 Processor -- start 2023-07-21T23:02:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.257+0000 7f7642dd0b80 1 -- start start 2023-07-21T23:02:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.257+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c23a6b0 0x55678c3e1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.257+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 0x55678c3de390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.257+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 0x55678c3f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.257+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c2e3c50 con 0x55678c3de8d0 2023-07-21T23:02:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.257+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c3369e0 con 0x55678c23a6b0 2023-07-21T23:02:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.257+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c32fe70 con 0x55678c3ddf40 2023-07-21T23:02:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762c99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c23a6b0 0x55678c3e1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762c99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c23a6b0 0x55678c3e1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44248/0 (socket says 172.21.15.151:44248) 2023-07-21T23:02:56.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762c99a700 1 -- 172.21.15.151:0/3771928986 learned_addr learned my addr 172.21.15.151:0/3771928986 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762c99a700 1 --2- 172.21.15.151:0/3771928986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 0x55678c3f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762d19b700 1 --2- 172.21.15.151:0/3771928986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 0x55678c3de390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762c99a700 1 -- 172.21.15.151:0/3771928986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 msgr2=0x55678c3de390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762c99a700 1 --2- 172.21.15.151:0/3771928986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 0x55678c3de390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762c99a700 1 -- 172.21.15.151:0/3771928986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 msgr2=0x55678c3f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762c99a700 1 --2- 172.21.15.151:0/3771928986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 0x55678c3f2bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.258+0000 7f762c99a700 1 -- 172.21.15.151:0/3771928986 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55678c15dd80 con 0x55678c23a6b0 2023-07-21T23:02:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.259+0000 7f762c99a700 1 --2- 172.21.15.151:0/3771928986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c23a6b0 0x55678c3e1d60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7618005f50 tx=0x7f7618005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8c6252b4e4ecbcc server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.259+0000 7f761e7fc700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f76140a1490 0x7f76140a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.259+0000 7f76137fe700 1 -- 172.21.15.151:0/3771928986 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761800bc80 con 0x55678c23a6b0 2023-07-21T23:02:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.259+0000 7f761e7fc700 1 -- 172.21.15.151:0/2277432310 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f76200cc950 con 0x7f7628105b60 2023-07-21T23:02:56.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.259+0000 7f76137fe700 1 -- 172.21.15.151:0/3771928986 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7618005d40 con 0x55678c23a6b0 2023-07-21T23:02:56.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.259+0000 7f76137fe700 1 -- 172.21.15.151:0/3771928986 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7618005320 con 0x55678c23a6b0 2023-07-21T23:02:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.259+0000 7f762d19b700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f76140a1490 0x7f76140a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.260+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3771928986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c23a6b0 msgr2=0x55678c3e1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:56.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.260+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3771928986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c23a6b0 0x55678c3e1d60 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f7618005f50 tx=0x7f7618005c00 comp rx=0 tx=0).stop 2023-07-21T23:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.260+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3771928986 shutdown_connections 2023-07-21T23:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.260+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3771928986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c23a6b0 0x55678c3e1d60 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.260+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3771928986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 0x55678c3f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.260+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3771928986 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 0x55678c3de390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.260+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3771928986 >> 172.21.15.151:0/3771928986 conn(0x55678c3d3ae0 msgr2=0x55678c3d90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.260+0000 7f762d19b700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f76140a1490 0x7f76140a3940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f762400a510 tx=0x7f762400d040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:56.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.260+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3771928986 shutdown_connections 2023-07-21T23:02:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.261+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3771928986 wait complete. 2023-07-21T23:02:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.261+0000 7f7642dd0b80 1 -- start start 2023-07-21T23:02:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.262+0000 7f7642dd0b80 1 Processor -- start 2023-07-21T23:02:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.262+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c23a6b0 0x55678c3f2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.262+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3ddf40 0x55678c3efd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.262+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 0x55678c3f0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.262+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c2cfa60 con 0x55678c3de8d0 2023-07-21T23:02:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.262+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c2cf760 con 0x55678c3ddf40 2023-07-21T23:02:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.262+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c1b38c0 con 0x55678c23a6b0 2023-07-21T23:02:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.262+0000 7f7642dd0b80 10 client.0 _ll_register_callbacks cb 0x55678c2cd700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:56.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762c99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3ddf40 0x55678c3efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762c99a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3ddf40 0x55678c3efd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44254/0 (socket says 172.21.15.151:44254) 2023-07-21T23:02:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762c99a700 1 -- 172.21.15.151:0/3314751441 learned_addr learned my addr 172.21.15.151:0/3314751441 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762d99c700 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 0x55678c3f0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762d19b700 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c23a6b0 0x55678c3f2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762c99a700 1 -- 172.21.15.151:0/3314751441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c23a6b0 msgr2=0x55678c3f2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:56.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762c99a700 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c23a6b0 0x55678c3f2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762c99a700 1 -- 172.21.15.151:0/3314751441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 msgr2=0x55678c3f0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762c99a700 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 0x55678c3f0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762c99a700 1 -- 172.21.15.151:0/3314751441 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762810d220 con 0x55678c3ddf40 2023-07-21T23:02:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.263+0000 7f762d99c700 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 0x55678c3f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:02:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.264+0000 7f762c99a700 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3ddf40 0x55678c3efd00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7618009350 tx=0x7f761800bb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec7cfcf6d197491d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:56.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.264+0000 7f7610ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:02:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.264+0000 7f7610ff9700 1 -- 172.21.15.151:0/3314751441 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f761802f070 con 0x55678c3ddf40 2023-07-21T23:02:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.264+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3314751441 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55678c289490 con 0x55678c3ddf40 2023-07-21T23:02:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.264+0000 7f7610ff9700 1 -- 172.21.15.151:0/3314751441 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f761800be10 con 0x55678c3ddf40 2023-07-21T23:02:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.264+0000 7f7610ff9700 1 -- 172.21.15.151:0/3314751441 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7618028470 con 0x55678c3ddf40 2023-07-21T23:02:56.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.264+0000 7f7642dd0b80 10 client.29327 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.264+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3314751441 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55678c146c00 con 0x55678c3ddf40 2023-07-21T23:02:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.265+0000 7f7610ff9700 1 -- 172.21.15.151:0/3314751441 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55678c289490 con 0x55678c3ddf40 2023-07-21T23:02:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.265+0000 7f7610ff9700 1 -- 172.21.15.151:0/3314751441 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f761800f7c0 con 0x55678c3ddf40 2023-07-21T23:02:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.265+0000 7f7642dd0b80 10 client.29327 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.265+0000 7f7642dd0b80 10 client.29327 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.265+0000 7f7642dd0b80 20 client.29327 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:56.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.265+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55678c3fff20 0x55678c402330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.265+0000 7f7642dd0b80 4 client.29327 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:02:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.265+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3314751441 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55678c328e50 con 0x55678c3fff20 2023-07-21T23:02:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.265+0000 7f762d19b700 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55678c3fff20 0x55678c402330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.266+0000 7f7610ff9700 10 client.29327 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.266+0000 7f762d19b700 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55678c3fff20 0x55678c402330 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e0e73332d20b5ced server_cookie=168f44aad58db339 in_seq=0 out_seq=0 2023-07-21T23:02:56.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.266+0000 7f7610ff9700 1 -- 172.21.15.151:0/3314751441 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55678c328e50 con 0x55678c3fff20 2023-07-21T23:02:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.266+0000 7f7610ff9700 10 client.29327 handle_command_reply: tid=0 2023-07-21T23:02:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7642dd0b80 1 client.29327 shutdown 2023-07-21T23:02:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3314751441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3ddf40 msgr2=0x55678c3efd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3ddf40 0x55678c3efd00 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f7618009350 tx=0x7f761800bb70 comp rx=0 tx=0).stop 2023-07-21T23:02:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3314751441 shutdown_connections 2023-07-21T23:02:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55678c3fff20 0x55678c402330 crc :-1 s=READY pgs=489 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3de8d0 0x55678c3f0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c23a6b0 0x55678c3f2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/3314751441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3ddf40 0x55678c3efd00 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3314751441 >> 172.21.15.151:0/3314751441 conn(0x55678c3d3ae0 msgr2=0x55678c3d83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.267+0000 7f7610ff9700 0 client.29327 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.268+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3314751441 shutdown_connections 2023-07-21T23:02:56.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.268+0000 7f7642dd0b80 1 -- 172.21.15.151:0/3314751441 wait complete. 2023-07-21T23:02:56.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.268+0000 7f7642dd0b80 20 client.29327 trim_cache size 0 max 16384 2023-07-21T23:02:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.299+0000 7f7642dd0b80 1 Processor -- start 2023-07-21T23:02:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.299+0000 7f7642dd0b80 1 -- start start 2023-07-21T23:02:56.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.300+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c23a6b0 0x55678c3efcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.300+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 0x55678c3f2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.300+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3d8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.300+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c3f3150 con 0x55678c23a6b0 2023-07-21T23:02:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.300+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c3e1990 con 0x55678c3de8d0 2023-07-21T23:02:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.300+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c3f10c0 con 0x55678c3ddf40 2023-07-21T23:02:56.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.300+0000 7f762d99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3d8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.301+0000 7f762d99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3d8b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44266/0 (socket says 172.21.15.151:44266) 2023-07-21T23:02:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.301+0000 7f762d99c700 1 -- 172.21.15.151:0/1134758486 learned_addr learned my addr 172.21.15.151:0/1134758486 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:56.336 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.301+0000 7f762c99a700 1 --2- 172.21.15.151:0/1134758486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 0x55678c3f2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.301+0000 7f762d99c700 1 -- 172.21.15.151:0/1134758486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 msgr2=0x55678c3f2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:56.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.301+0000 7f762d99c700 1 --2- 172.21.15.151:0/1134758486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 0x55678c3f2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.301+0000 7f762d99c700 1 -- 172.21.15.151:0/1134758486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c23a6b0 msgr2=0x55678c3efcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.301+0000 7f762d99c700 1 --2- 172.21.15.151:0/1134758486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c23a6b0 0x55678c3efcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.301+0000 7f762d99c700 1 -- 172.21.15.151:0/1134758486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55678c1841f0 con 0x55678c3de8d0 2023-07-21T23:02:56.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.302+0000 7f762d99c700 1 --2- 172.21.15.151:0/1134758486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3d8b60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7620095f60 tx=0x7f7620095ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2c4a17623762990e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.302+0000 7f7613fff700 1 -- 172.21.15.151:0/1134758486 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76200a1eb0 con 0x55678c3de8d0 2023-07-21T23:02:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.302+0000 7f7613fff700 1 -- 172.21.15.151:0/1134758486 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f76200b2120 con 0x55678c3de8d0 2023-07-21T23:02:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.302+0000 7f7613fff700 1 -- 172.21.15.151:0/1134758486 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76200991b0 con 0x55678c3de8d0 2023-07-21T23:02:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.303+0000 7f7642dd0b80 1 -- 172.21.15.151:0/1134758486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 msgr2=0x55678c3d8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:56.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.303+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/1134758486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3d8b60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7620095f60 tx=0x7f7620095ed0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.303+0000 7f7642dd0b80 1 -- 172.21.15.151:0/1134758486 shutdown_connections 2023-07-21T23:02:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.303+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/1134758486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3d8b60 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.303+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/1134758486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c23a6b0 0x55678c3efcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.303+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/1134758486 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c3ddf40 0x55678c3f2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.304+0000 7f7642dd0b80 1 -- 172.21.15.151:0/1134758486 >> 172.21.15.151:0/1134758486 conn(0x55678c3d3ae0 msgr2=0x55678c3eafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:56.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.304+0000 7f7642dd0b80 1 -- 172.21.15.151:0/1134758486 shutdown_connections 2023-07-21T23:02:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.304+0000 7f7642dd0b80 1 -- 172.21.15.151:0/1134758486 wait complete. 2023-07-21T23:02:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.304+0000 7f7642dd0b80 1 -- start start 2023-07-21T23:02:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.305+0000 7f7642dd0b80 1 Processor -- start 2023-07-21T23:02:56.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.305+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c23a6b0 0x55678c3f7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.305+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3ddf40 0x55678c3f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.305+0000 7f7642dd0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3f5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.305+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c3f6700 con 0x55678c3ddf40 2023-07-21T23:02:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.305+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c44dd80 con 0x55678c3de8d0 2023-07-21T23:02:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.305+0000 7f7642dd0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55678c44def0 con 0x55678c23a6b0 2023-07-21T23:02:56.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.306+0000 7f7642dd0b80 10 client.0 _ll_register_callbacks cb 0x7f7618009810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:02:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.306+0000 7f762d99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3f5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.306+0000 7f762d99c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3f5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:44272/0 (socket says 172.21.15.151:44272) 2023-07-21T23:02:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.306+0000 7f762d99c700 1 -- 172.21.15.151:0/2260010757 learned_addr learned my addr 172.21.15.151:0/2260010757 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:02:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.307+0000 7f762d99c700 1 -- 172.21.15.151:0/2260010757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c23a6b0 msgr2=0x55678c3f7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.307+0000 7f762d99c700 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c23a6b0 0x55678c3f7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.307+0000 7f762d99c700 1 -- 172.21.15.151:0/2260010757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3ddf40 msgr2=0x55678c3f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:02:56.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.307+0000 7f762d99c700 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3ddf40 0x55678c3f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.307+0000 7f762d99c700 1 -- 172.21.15.151:0/2260010757 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762806a190 con 0x55678c3de8d0 2023-07-21T23:02:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.307+0000 7f762d99c700 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3f5ff0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f76200999f0 tx=0x7f7620099230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17f5b6f2a9a59579 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:02:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.308+0000 7f7610ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:02:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.308+0000 7f7610ff9700 1 -- 172.21.15.151:0/2260010757 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76200a1eb0 con 0x55678c3de8d0 2023-07-21T23:02:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.308+0000 7f7610ff9700 1 -- 172.21.15.151:0/2260010757 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(165..165 src has 1..165) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f7620099ed0 con 0x55678c3de8d0 2023-07-21T23:02:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.308+0000 7f7642dd0b80 1 -- 172.21.15.151:0/2260010757 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7618005d40 con 0x55678c3de8d0 2023-07-21T23:02:56.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.308+0000 7f7610ff9700 1 -- 172.21.15.151:0/2260010757 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f76200a1a20 con 0x55678c3de8d0 2023-07-21T23:02:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.309+0000 7f7642dd0b80 10 client.29333 fetch_fsmap learned FSMap version 116 2023-07-21T23:02:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.309+0000 7f7642dd0b80 1 -- 172.21.15.151:0/2260010757 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55678c15c250 con 0x55678c3de8d0 2023-07-21T23:02:56.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.309+0000 7f7610ff9700 1 -- 172.21.15.151:0/2260010757 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f7618005d40 con 0x55678c3de8d0 2023-07-21T23:02:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.310+0000 7f7610ff9700 1 -- 172.21.15.151:0/2260010757 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f7620095a10 con 0x55678c3de8d0 2023-07-21T23:02:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.310+0000 7f7642dd0b80 10 client.29333 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:02:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.310+0000 7f7642dd0b80 10 client.29333 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:02:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.310+0000 7f7642dd0b80 20 client.29333 populate_metadata read hostname 'smithi151' 2023-07-21T23:02:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.310+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55678c44f150 0x55678c44f550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:02:56.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.310+0000 7f7642dd0b80 4 client.29333 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:02:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.310+0000 7f7642dd0b80 1 -- 172.21.15.151:0/2260010757 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55678c2eaff0 con 0x55678c44f150 2023-07-21T23:02:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.310+0000 7f762d19b700 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55678c44f150 0x55678c44f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:02:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.311+0000 7f762d19b700 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55678c44f150 0x55678c44f550 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15c2b220eb720e0 server_cookie=5938c22855c43b53 in_seq=0 out_seq=0 2023-07-21T23:02:56.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.311+0000 7f7610ff9700 10 client.29333 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:56.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:56 smithi187 ceph-mon[96918]: pgmap v1393: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.7 MiB/s wr, 982 op/s 2023-07-21T23:02:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7610ff9700 1 -- 172.21.15.151:0/2260010757 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55678c2eaff0 con 0x55678c44f150 2023-07-21T23:02:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7610ff9700 10 client.29333 handle_command_reply: tid=0 2023-07-21T23:02:56.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 client.29333 shutdown 2023-07-21T23:02:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 -- 172.21.15.151:0/2260010757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 msgr2=0x55678c3f5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3f5ff0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f76200999f0 tx=0x7f7620099230 comp rx=0 tx=0).stop 2023-07-21T23:02:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 -- 172.21.15.151:0/2260010757 shutdown_connections 2023-07-21T23:02:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55678c44f150 0x55678c44f550 crc :-1 s=READY pgs=490 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55678c3de8d0 0x55678c3f5ff0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55678c23a6b0 0x55678c3f7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 --2- 172.21.15.151:0/2260010757 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55678c3ddf40 0x55678c3f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7610ff9700 0 client.29333 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:02:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 -- 172.21.15.151:0/2260010757 >> 172.21.15.151:0/2260010757 conn(0x55678c3d3ae0 msgr2=0x55678c3ee4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:56.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 -- 172.21.15.151:0/2260010757 shutdown_connections 2023-07-21T23:02:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.345+0000 7f7642dd0b80 1 -- 172.21.15.151:0/2260010757 wait complete. 2023-07-21T23:02:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.346+0000 7f7642dd0b80 20 client.29333 trim_cache size 0 max 16384 2023-07-21T23:02:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:02:56.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:02:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:02:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:02:56.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.346+0000 7f762f3ff700 1 -- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f76140a1490 msgr2=0x7f76140a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.347+0000 7f762f3ff700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f76140a1490 0x7f76140a3940 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f762400a510 tx=0x7f762400d040 comp rx=0 tx=0).stop 2023-07-21T23:02:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.347+0000 7f762f3ff700 1 -- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7628105b60 msgr2=0x7f7628195910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:02:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.347+0000 7f762f3ff700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7628105b60 0x7f7628195910 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f762000d980 tx=0x7f762000dc90 comp rx=0 tx=0).stop 2023-07-21T23:02:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.347+0000 7f762f3ff700 1 -- 172.21.15.151:0/2277432310 shutdown_connections 2023-07-21T23:02:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.347+0000 7f762f3ff700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f76140a1490 0x7f76140a3940 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.347+0000 7f762f3ff700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7628105b60 0x7f7628195910 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.347+0000 7f762f3ff700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f76280ffb30 0x7f762819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.347+0000 7f762f3ff700 1 --2- 172.21.15.151:0/2277432310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76281004e0 0x7f762819c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:02:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.347+0000 7f762f3ff700 1 -- 172.21.15.151:0/2277432310 >> 172.21.15.151:0/2277432310 conn(0x7f76280fb5f0 msgr2=0x7f76280fcb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:02:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.348+0000 7f762f3ff700 1 -- 172.21.15.151:0/2277432310 shutdown_connections 2023-07-21T23:02:56.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:02:56.348+0000 7f762f3ff700 1 -- 172.21.15.151:0/2277432310 wait complete. 2023-07-21T23:02:56.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:56 smithi195 ceph-mon[97365]: pgmap v1393: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.7 MiB/s wr, 982 op/s 2023-07-21T23:02:56.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:56 smithi151 ceph-mon[95510]: pgmap v1393: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.7 MiB/s wr, 982 op/s 2023-07-21T23:02:59.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 605.0 s, 350.6 tps, lat 281.969 ms stddev 81.887 2023-07-21T23:02:59.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:02:58 smithi187 ceph-mon[96918]: pgmap v1394: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.36k op/s 2023-07-21T23:02:59.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:02:58 smithi195 ceph-mon[97365]: pgmap v1394: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.36k op/s 2023-07-21T23:02:59.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:02:58 smithi151 ceph-mon[95510]: pgmap v1394: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.36k op/s 2023-07-21T23:03:01.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:01 smithi187 ceph-mon[96918]: pgmap v1395: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2023-07-21T23:03:01.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:01 smithi195 ceph-mon[97365]: pgmap v1395: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2023-07-21T23:03:01.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:01 smithi151 ceph-mon[95510]: pgmap v1395: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2023-07-21T23:03:03.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:03 smithi187 ceph-mon[96918]: pgmap v1396: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 976 op/s 2023-07-21T23:03:03.398 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:03 smithi195 ceph-mon[97365]: pgmap v1396: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 976 op/s 2023-07-21T23:03:03.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:03 smithi151 ceph-mon[95510]: pgmap v1396: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.4 MiB/s wr, 976 op/s 2023-07-21T23:03:04.292 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 610.0 s, 289.2 tps, lat 330.978 ms stddev 229.515 2023-07-21T23:03:05.372 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:05 smithi187 ceph-mon[96918]: pgmap v1397: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 14 MiB/s wr, 1.43k op/s 2023-07-21T23:03:05.373 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:05 smithi187 ceph-mon[96918]: osdmap e166: 12 total, 12 up, 12 in 2023-07-21T23:03:05.400 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:05 smithi195 ceph-mon[97365]: pgmap v1397: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 14 MiB/s wr, 1.43k op/s 2023-07-21T23:03:05.401 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:05 smithi195 ceph-mon[97365]: osdmap e166: 12 total, 12 up, 12 in 2023-07-21T23:03:05.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:05 smithi151 ceph-mon[95510]: pgmap v1397: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 14 MiB/s wr, 1.43k op/s 2023-07-21T23:03:05.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:05 smithi151 ceph-mon[95510]: osdmap e166: 12 total, 12 up, 12 in 2023-07-21T23:03:06.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:06 smithi151 ceph-mon[95510]: pgmap v1399: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 1.13k op/s 2023-07-21T23:03:06.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:06 smithi187 ceph-mon[96918]: pgmap v1399: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 1.13k op/s 2023-07-21T23:03:06.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:06 smithi195 ceph-mon[97365]: pgmap v1399: 97 pgs: 97 active+clean; 13 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 11 MiB/s wr, 1.13k op/s 2023-07-21T23:03:09.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 615.0 s, 88.6 tps, lat 1117.712 ms stddev 419.623 2023-07-21T23:03:09.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:09 smithi187 ceph-mon[96918]: pgmap v1400: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.3 MiB/s wr, 771 op/s 2023-07-21T23:03:09.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:09 smithi195 ceph-mon[97365]: pgmap v1400: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.3 MiB/s wr, 771 op/s 2023-07-21T23:03:09.444 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:09 smithi151 ceph-mon[95510]: pgmap v1400: 97 pgs: 8 active+clean+snaptrim, 16 active+clean+snaptrim_wait, 73 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 7.3 MiB/s wr, 771 op/s 2023-07-21T23:03:09.681 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.648+0000 7f48ac1ff700 1 -- 172.21.15.151:0/1794242429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a406d3a0 msgr2=0x7f48a411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.648+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/1794242429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a406d3a0 0x7f48a411b470 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f489c009f90 tx=0x7f489c00b330 comp rx=0 tx=0).stop 2023-07-21T23:03:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.648+0000 7f48ac1ff700 1 -- 172.21.15.151:0/1794242429 shutdown_connections 2023-07-21T23:03:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.648+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/1794242429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a406d3a0 0x7f48a411b470 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.648+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/1794242429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a410e2a0 0x7f48a410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.648+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/1794242429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48a406c910 0x7f48a406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.682 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.648+0000 7f48ac1ff700 1 -- 172.21.15.151:0/1794242429 >> 172.21.15.151:0/1794242429 conn(0x7f48a406bd70 msgr2=0x7f48a4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.650+0000 7f48ac1ff700 1 -- 172.21.15.151:0/1794242429 shutdown_connections 2023-07-21T23:03:09.683 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.650+0000 7f48ac1ff700 1 -- 172.21.15.151:0/1794242429 wait complete. 2023-07-21T23:03:09.684 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.651+0000 7f48ac1ff700 1 Processor -- start 2023-07-21T23:03:09.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.652+0000 7f48ac1ff700 1 -- start start 2023-07-21T23:03:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.652+0000 7f48ac1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a406c910 0x7f48a41aa9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.652+0000 7f48ac1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48a406d3a0 0x7f48a41aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.652+0000 7f48ac1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a410e2a0 0x7f48a41a4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.652+0000 7f48ac1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a41a4f60 con 0x7f48a406d3a0 2023-07-21T23:03:09.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.652+0000 7f48ac1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a41a50a0 con 0x7f48a410e2a0 2023-07-21T23:03:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.652+0000 7f48ac1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a41a5260 con 0x7f48a406c910 2023-07-21T23:03:09.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.653+0000 7f48aa79c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a410e2a0 0x7f48a41a4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.653+0000 7f48aa79c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a410e2a0 0x7f48a41a4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60190/0 (socket says 172.21.15.151:60190) 2023-07-21T23:03:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.653+0000 7f48aa79c700 1 -- 172.21.15.151:0/797375235 learned_addr learned my addr 172.21.15.151:0/797375235 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:09.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.654+0000 7f48aa79c700 1 -- 172.21.15.151:0/797375235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a406c910 msgr2=0x7f48a41aa9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T23:03:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.654+0000 7f48aa79c700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a406c910 0x7f48a41aa9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.654+0000 7f48aa79c700 1 -- 172.21.15.151:0/797375235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48a406d3a0 msgr2=0x7f48a41aaf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:09.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.654+0000 7f48aa79c700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48a406d3a0 0x7f48a41aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.654+0000 7f48aa79c700 1 -- 172.21.15.151:0/797375235 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c009c40 con 0x7f48a410e2a0 2023-07-21T23:03:09.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.655+0000 7f48aa79c700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a410e2a0 0x7f48a41a4790 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f489c0060b0 tx=0x7f489c004d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.661+0000 7f4896ffd700 1 -- 172.21.15.151:0/797375235 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c00e040 con 0x7f48a410e2a0 2023-07-21T23:03:09.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.661+0000 7f4896ffd700 1 -- 172.21.15.151:0/797375235 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f489c007910 con 0x7f48a410e2a0 2023-07-21T23:03:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.661+0000 7f4896ffd700 1 -- 172.21.15.151:0/797375235 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489c01b6c0 con 0x7f48a410e2a0 2023-07-21T23:03:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.661+0000 7f48ac1ff700 1 -- 172.21.15.151:0/797375235 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a41a54e0 con 0x7f48a410e2a0 2023-07-21T23:03:09.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.661+0000 7f48ac1ff700 1 -- 172.21.15.151:0/797375235 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a410ee20 con 0x7f48a410e2a0 2023-07-21T23:03:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.668+0000 7f48bfac6b80 1 Processor -- start 2023-07-21T23:03:09.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.671+0000 7f48bfac6b80 1 -- start start 2023-07-21T23:03:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.672+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 0x556acbce5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.672+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 0x556acbcdff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.672+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.672+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbbe5c50 con 0x556acbce6210 2023-07-21T23:03:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.672+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbc389e0 con 0x556acbb3c6b0 2023-07-21T23:03:09.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.672+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbc31e70 con 0x556acbce6660 2023-07-21T23:03:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.674+0000 7f48a9f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 0x556acbcdff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.674+0000 7f48a9f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 0x556acbcdff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33036/0 (socket says 172.21.15.151:33036) 2023-07-21T23:03:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.674+0000 7f48a9f9b700 1 -- 172.21.15.151:0/594599035 learned_addr learned my addr 172.21.15.151:0/594599035 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:09.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.674+0000 7f4896ffd700 1 -- 172.21.15.151:0/797375235 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f489c01b820 con 0x7f48a410e2a0 2023-07-21T23:03:09.708 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.675+0000 7f48a979a700 1 --2- 172.21.15.151:0/594599035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.676+0000 7f48a9f9b700 1 -- 172.21.15.151:0/594599035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 msgr2=0x556acbce04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.676+0000 7f48a9f9b700 1 --2- 172.21.15.151:0/594599035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.676+0000 7f48a9f9b700 1 -- 172.21.15.151:0/594599035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 msgr2=0x556acbce5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.676+0000 7f48a9f9b700 1 --2- 172.21.15.151:0/594599035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 0x556acbce5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.709 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.676+0000 7f48a9f9b700 1 -- 172.21.15.151:0/594599035 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556acba5fd80 con 0x556acbce6210 2023-07-21T23:03:09.710 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.678+0000 7f48a9f9b700 1 --2- 172.21.15.151:0/594599035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 0x556acbcdff40 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f489800baa0 tx=0x7f489800bdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba458c656f103f3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.678+0000 7f4896ffd700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f48900a14d0 0x7f48900a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.711 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.678+0000 7f4896ffd700 1 -- 172.21.15.151:0/797375235 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f489c0cedf0 con 0x7f48a410e2a0 2023-07-21T23:03:09.714 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.682+0000 7f48a979a700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f48900a14d0 0x7f48900a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.686+0000 7f488ffff700 1 -- 172.21.15.151:0/594599035 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898004a30 con 0x556acbce6210 2023-07-21T23:03:09.724 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.686+0000 7f488ffff700 1 -- 172.21.15.151:0/594599035 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f489800dc60 con 0x556acbce6210 2023-07-21T23:03:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.686+0000 7f488ffff700 1 -- 172.21.15.151:0/594599035 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4898005570 con 0x556acbce6210 2023-07-21T23:03:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.687+0000 7f48bfac6b80 1 -- 172.21.15.151:0/594599035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 msgr2=0x556acbcdff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.687+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/594599035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 0x556acbcdff40 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f489800baa0 tx=0x7f489800bdb0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.688+0000 7f48bfac6b80 1 -- 172.21.15.151:0/594599035 shutdown_connections 2023-07-21T23:03:09.725 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.688+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/594599035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 0x556acbce5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.688+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/594599035 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.688+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/594599035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 0x556acbcdff40 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.688+0000 7f48bfac6b80 1 -- 172.21.15.151:0/594599035 >> 172.21.15.151:0/594599035 conn(0x556acbcd5ae0 msgr2=0x556acbcdb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:09.726 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.693+0000 7f48bfac6b80 1 -- 172.21.15.151:0/594599035 shutdown_connections 2023-07-21T23:03:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.706+0000 7f48bfac6b80 1 -- 172.21.15.151:0/594599035 wait complete. 2023-07-21T23:03:09.740 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.706+0000 7f48bfac6b80 1 -- start start 2023-07-21T23:03:09.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.708+0000 7f48a979a700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f48900a14d0 0x7f48900a3980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x556acbce6a70 tx=0x7f48a000d380 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.708+0000 7f48bfac6b80 1 Processor -- start 2023-07-21T23:03:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.709+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 0x556acbcec5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.709+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 0x556acbce97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.709+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce9f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.709+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbbd1a60 con 0x556acbce6210 2023-07-21T23:03:09.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.709+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbbd1760 con 0x556acbb3c6b0 2023-07-21T23:03:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.709+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbab58c0 con 0x556acbce6660 2023-07-21T23:03:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.709+0000 7f48bfac6b80 10 client.0 _ll_register_callbacks cb 0x556acbbcf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:03:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.710+0000 7f48a9f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 0x556acbcec5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.710+0000 7f48a9f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 0x556acbcec5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60216/0 (socket says 172.21.15.151:60216) 2023-07-21T23:03:09.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.710+0000 7f48a9f9b700 1 -- 172.21.15.151:0/3473732916 learned_addr learned my addr 172.21.15.151:0/3473732916 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.711+0000 7f48aa79c700 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.712+0000 7f48a9f9b700 1 -- 172.21.15.151:0/3473732916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 msgr2=0x556acbce9f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.712+0000 7f48a9f9b700 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce9f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.712+0000 7f48a9f9b700 1 -- 172.21.15.151:0/3473732916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 msgr2=0x556acbce97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:09.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.712+0000 7f48a9f9b700 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 0x556acbce97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.712+0000 7f48a9f9b700 1 -- 172.21.15.151:0/3473732916 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489800b6d0 con 0x556acbb3c6b0 2023-07-21T23:03:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.712+0000 7f48a9f9b700 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 0x556acbcec5d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4898006000 tx=0x7f489800d880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c52711b37b5d531b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:09.748 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.712+0000 7f488d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:03:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.713+0000 7f488d7fa700 1 -- 172.21.15.151:0/3473732916 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489801f070 con 0x556acbb3c6b0 2023-07-21T23:03:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.714+0000 7f488d7fa700 1 -- 172.21.15.151:0/3473732916 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f4898005150 con 0x556acbb3c6b0 2023-07-21T23:03:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.714+0000 7f48bfac6b80 1 -- 172.21.15.151:0/3473732916 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556acbb8b490 con 0x556acbb3c6b0 2023-07-21T23:03:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.715+0000 7f488d7fa700 1 -- 172.21.15.151:0/3473732916 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4898005310 con 0x556acbb3c6b0 2023-07-21T23:03:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.715+0000 7f48bfac6b80 10 client.29342 fetch_fsmap learned FSMap version 116 2023-07-21T23:03:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.715+0000 7f48bfac6b80 1 -- 172.21.15.151:0/3473732916 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x556acba48c00 con 0x556acbb3c6b0 2023-07-21T23:03:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.716+0000 7f488d7fa700 1 -- 172.21.15.151:0/3473732916 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x556acbb8b490 con 0x556acbb3c6b0 2023-07-21T23:03:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.716+0000 7f488d7fa700 1 -- 172.21.15.151:0/3473732916 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f489802e470 con 0x556acbb3c6b0 2023-07-21T23:03:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.716+0000 7f48bfac6b80 10 client.29342 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:03:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.716+0000 7f48bfac6b80 10 client.29342 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:03:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.716+0000 7f48bfac6b80 20 client.29342 populate_metadata read hostname 'smithi151' 2023-07-21T23:03:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.716+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556acbcf9a90 0x556acbcfbea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.716+0000 7f48bfac6b80 4 client.29342 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:03:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.716+0000 7f48bfac6b80 1 -- 172.21.15.151:0/3473732916 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556acbc2ae50 con 0x556acbcf9a90 2023-07-21T23:03:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.717+0000 7f48a979a700 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556acbcf9a90 0x556acbcfbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.720+0000 7f48a979a700 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556acbcf9a90 0x556acbcfbea0 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a645a00eb10a676f server_cookie=835d3d43af4f924d in_seq=0 out_seq=0 2023-07-21T23:03:09.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.721+0000 7f488d7fa700 10 client.29342 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:09.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.723+0000 7f488d7fa700 1 -- 172.21.15.151:0/3473732916 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x556acbc2ae50 con 0x556acbcf9a90 2023-07-21T23:03:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.723+0000 7f488d7fa700 10 client.29342 handle_command_reply: tid=0 2023-07-21T23:03:09.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.723+0000 7f48bfac6b80 1 client.29342 shutdown 2023-07-21T23:03:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.724+0000 7f48bfac6b80 1 -- 172.21.15.151:0/3473732916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 msgr2=0x556acbcec5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.724+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 0x556acbcec5d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4898006000 tx=0x7f489800d880 comp rx=0 tx=0).stop 2023-07-21T23:03:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.724+0000 7f48bfac6b80 1 -- 172.21.15.151:0/3473732916 shutdown_connections 2023-07-21T23:03:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.724+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556acbcf9a90 0x556acbcfbea0 crc :-1 s=READY pgs=491 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.724+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbb3c6b0 0x556acbcec5d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.724+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce9f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.724+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/3473732916 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbce6210 0x556acbce97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.724+0000 7f48bfac6b80 1 -- 172.21.15.151:0/3473732916 >> 172.21.15.151:0/3473732916 conn(0x556acbcd5ae0 msgr2=0x556acbcda3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.724+0000 7f488d7fa700 0 client.29342 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.725+0000 7f48bfac6b80 1 -- 172.21.15.151:0/3473732916 shutdown_connections 2023-07-21T23:03:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.725+0000 7f48bfac6b80 1 -- 172.21.15.151:0/3473732916 wait complete. 2023-07-21T23:03:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.727+0000 7f48bfac6b80 20 client.29342 trim_cache size 0 max 16384 2023-07-21T23:03:09.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.753+0000 7f48bfac6b80 1 Processor -- start 2023-07-21T23:03:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.754+0000 7f48bfac6b80 1 -- start start 2023-07-21T23:03:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.754+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbb3c6b0 0x556acbcf0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.754+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.754+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbcdab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.754+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbce4200 con 0x556acbb3c6b0 2023-07-21T23:03:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.754+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbce4420 con 0x556acbce6210 2023-07-21T23:03:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.754+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbceab30 con 0x556acbce6660 2023-07-21T23:03:09.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48a979a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48a979a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60222/0 (socket says 172.21.15.151:60222) 2023-07-21T23:03:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48a979a700 1 -- 172.21.15.151:0/1985209141 learned_addr learned my addr 172.21.15.151:0/1985209141 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48a9f9b700 1 --2- 172.21.15.151:0/1985209141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbb3c6b0 0x556acbcf0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48aa79c700 1 --2- 172.21.15.151:0/1985209141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbcdab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48a979a700 1 -- 172.21.15.151:0/1985209141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 msgr2=0x556acbcdab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48a979a700 1 --2- 172.21.15.151:0/1985209141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbcdab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48a979a700 1 -- 172.21.15.151:0/1985209141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbb3c6b0 msgr2=0x556acbcf0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48a979a700 1 --2- 172.21.15.151:0/1985209141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbb3c6b0 0x556acbcf0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.755+0000 7f48a979a700 1 -- 172.21.15.151:0/1985209141 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556acbd00ad0 con 0x556acbce6210 2023-07-21T23:03:09.793 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.756+0000 7f48a979a700 1 --2- 172.21.15.151:0/1985209141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce71b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f48a41a61d0 tx=0x7f48a0012000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8bf1e91340d518 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:09.795 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.761+0000 7f4894ff9700 1 -- 172.21.15.151:0/1985209141 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0024070 con 0x556acbce6210 2023-07-21T23:03:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.761+0000 7f4894ff9700 1 -- 172.21.15.151:0/1985209141 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f48a0024bd0 con 0x556acbce6210 2023-07-21T23:03:09.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.761+0000 7f4894ff9700 1 -- 172.21.15.151:0/1985209141 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a00119a0 con 0x556acbce6210 2023-07-21T23:03:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.764+0000 7f48bfac6b80 1 -- 172.21.15.151:0/1985209141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 msgr2=0x556acbce71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.764+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/1985209141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce71b0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f48a41a61d0 tx=0x7f48a0012000 comp rx=0 tx=0).stop 2023-07-21T23:03:09.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.764+0000 7f48bfac6b80 1 -- 172.21.15.151:0/1985209141 shutdown_connections 2023-07-21T23:03:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.764+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/1985209141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbcdab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.764+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/1985209141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbb3c6b0 0x556acbcf0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.764+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/1985209141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce71b0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.764+0000 7f48bfac6b80 1 -- 172.21.15.151:0/1985209141 >> 172.21.15.151:0/1985209141 conn(0x556acbcd5ae0 msgr2=0x556acbce6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:09.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.764+0000 7f48bfac6b80 1 -- 172.21.15.151:0/1985209141 shutdown_connections 2023-07-21T23:03:09.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.764+0000 7f48bfac6b80 1 -- 172.21.15.151:0/1985209141 wait complete. 2023-07-21T23:03:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.765+0000 7f48bfac6b80 1 -- start start 2023-07-21T23:03:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.765+0000 7f48bfac6b80 1 Processor -- start 2023-07-21T23:03:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.766+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbb3c6b0 0x556acbce8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.766+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.766+0000 7f48bfac6b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.766+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbce9a00 con 0x556acbb3c6b0 2023-07-21T23:03:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.766+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbce9b70 con 0x556acbce6210 2023-07-21T23:03:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.766+0000 7f48bfac6b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x556acbce82d0 con 0x556acbce6660 2023-07-21T23:03:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.766+0000 7f48bfac6b80 10 client.0 _ll_register_callbacks cb 0x7f489800b8f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:03:09.801 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.767+0000 7f48a979a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.767+0000 7f48a979a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60228/0 (socket says 172.21.15.151:60228) 2023-07-21T23:03:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.767+0000 7f48a979a700 1 -- 172.21.15.151:0/2739652941 learned_addr learned my addr 172.21.15.151:0/2739652941 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.768+0000 7f48a979a700 1 -- 172.21.15.151:0/2739652941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 msgr2=0x556acbce7d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.768+0000 7f48a979a700 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.768+0000 7f48a979a700 1 -- 172.21.15.151:0/2739652941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbb3c6b0 msgr2=0x556acbce8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:09.802 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.768+0000 7f48a979a700 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbb3c6b0 0x556acbce8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.768+0000 7f48a979a700 1 -- 172.21.15.151:0/2739652941 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a000f870 con 0x556acbce6210 2023-07-21T23:03:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.768+0000 7f48a979a700 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce9400 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f48a0005e50 tx=0x7f48a0024250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaf5c47bae98bac0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:09.803 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.768+0000 7f488d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:03:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.773+0000 7f488d7fa700 1 -- 172.21.15.151:0/2739652941 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a0022070 con 0x556acbce6210 2023-07-21T23:03:09.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.774+0000 7f488d7fa700 1 -- 172.21.15.151:0/2739652941 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(166..166 src has 1..166) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f48a00115c0 con 0x556acbce6210 2023-07-21T23:03:09.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.774+0000 7f48bfac6b80 1 -- 172.21.15.151:0/2739652941 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f489800dc60 con 0x556acbce6210 2023-07-21T23:03:09.810 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.776+0000 7f488d7fa700 1 -- 172.21.15.151:0/2739652941 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48a0024040 con 0x556acbce6210 2023-07-21T23:03:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.778+0000 7f48bfac6b80 10 client.29348 fetch_fsmap learned FSMap version 116 2023-07-21T23:03:09.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.778+0000 7f48bfac6b80 1 -- 172.21.15.151:0/2739652941 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x556acba861f0 con 0x556acbce6210 2023-07-21T23:03:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.779+0000 7f488d7fa700 1 -- 172.21.15.151:0/2739652941 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f489800dc60 con 0x556acbce6210 2023-07-21T23:03:09.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.779+0000 7f488d7fa700 1 -- 172.21.15.151:0/2739652941 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f48a001e8f0 con 0x556acbce6210 2023-07-21T23:03:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.779+0000 7f48bfac6b80 10 client.29348 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:03:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.779+0000 7f48bfac6b80 10 client.29348 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:03:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.779+0000 7f48bfac6b80 20 client.29348 populate_metadata read hostname 'smithi151' 2023-07-21T23:03:09.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.780+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556acbd4e4f0 0x556acbd50900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.780+0000 7f48bfac6b80 4 client.29348 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:03:09.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.780+0000 7f48bfac6b80 1 -- 172.21.15.151:0/2739652941 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x556acbbecff0 con 0x556acbd4e4f0 2023-07-21T23:03:09.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.782+0000 7f48a9f9b700 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556acbd4e4f0 0x556acbd50900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.783+0000 7f48a9f9b700 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556acbd4e4f0 0x556acbd50900 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8de1b0c180b27983 server_cookie=103813d5e25c9026 in_seq=0 out_seq=0 2023-07-21T23:03:09.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.784+0000 7f488d7fa700 10 client.29348 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.814+0000 7f488d7fa700 1 -- 172.21.15.151:0/2739652941 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x556acbbecff0 con 0x556acbd4e4f0 2023-07-21T23:03:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.814+0000 7f488d7fa700 10 client.29348 handle_command_reply: tid=0 2023-07-21T23:03:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.814+0000 7f48bfac6b80 1 client.29348 shutdown 2023-07-21T23:03:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.815+0000 7f48bfac6b80 1 -- 172.21.15.151:0/2739652941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 msgr2=0x556acbce9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.815+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce9400 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f48a0005e50 tx=0x7f48a0024250 comp rx=0 tx=0).stop 2023-07-21T23:03:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.816+0000 7f48bfac6b80 1 -- 172.21.15.151:0/2739652941 shutdown_connections 2023-07-21T23:03:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.816+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x556acbd4e4f0 0x556acbd50900 crc :-1 s=READY pgs=492 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.816+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x556acbce6660 0x556acbce7d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.816+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556acbb3c6b0 0x556acbce8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.816+0000 7f48bfac6b80 1 --2- 172.21.15.151:0/2739652941 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x556acbce6210 0x556acbce9400 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.816+0000 7f48bfac6b80 1 -- 172.21.15.151:0/2739652941 >> 172.21.15.151:0/2739652941 conn(0x556acbcd5ae0 msgr2=0x556acbce7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.816+0000 7f488d7fa700 0 client.29348 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.816+0000 7f48bfac6b80 1 -- 172.21.15.151:0/2739652941 shutdown_connections 2023-07-21T23:03:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.816+0000 7f48bfac6b80 1 -- 172.21.15.151:0/2739652941 wait complete. 2023-07-21T23:03:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.820+0000 7f48bfac6b80 20 client.29348 trim_cache size 0 max 16384 2023-07-21T23:03:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:03:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:03:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:03:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:03:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 -- 172.21.15.151:0/797375235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f48900a14d0 msgr2=0x7f48900a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f48900a14d0 0x7f48900a3980 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x556acbce6a70 tx=0x7f48a000d380 comp rx=0 tx=0).stop 2023-07-21T23:03:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 -- 172.21.15.151:0/797375235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a410e2a0 msgr2=0x7f48a41a4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a410e2a0 0x7f48a41a4790 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f489c0060b0 tx=0x7f489c004d50 comp rx=0 tx=0).stop 2023-07-21T23:03:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 -- 172.21.15.151:0/797375235 shutdown_connections 2023-07-21T23:03:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f48900a14d0 0x7f48900a3980 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48a410e2a0 0x7f48a41a4790 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f48a406c910 0x7f48a41aa9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 --2- 172.21.15.151:0/797375235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48a406d3a0 0x7f48a41aaf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.822+0000 7f48ac1ff700 1 -- 172.21.15.151:0/797375235 >> 172.21.15.151:0/797375235 conn(0x7f48a406bd70 msgr2=0x7f48a40707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.823+0000 7f48ac1ff700 1 -- 172.21.15.151:0/797375235 shutdown_connections 2023-07-21T23:03:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:09.823+0000 7f48ac1ff700 1 -- 172.21.15.151:0/797375235 wait complete. 2023-07-21T23:03:11.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:11 smithi187 ceph-mon[96918]: pgmap v1401: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 714 op/s 2023-07-21T23:03:11.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:11 smithi195 ceph-mon[97365]: pgmap v1401: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 714 op/s 2023-07-21T23:03:11.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:11 smithi151 ceph-mon[95510]: pgmap v1401: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 714 op/s 2023-07-21T23:03:13.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:13 smithi187 ceph-mon[96918]: pgmap v1402: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 714 op/s 2023-07-21T23:03:13.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:13 smithi195 ceph-mon[97365]: pgmap v1402: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 714 op/s 2023-07-21T23:03:13.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:13 smithi151 ceph-mon[95510]: pgmap v1402: 97 pgs: 17 active+clean+snaptrim, 34 active+clean+snaptrim_wait, 46 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.6 MiB/s wr, 714 op/s 2023-07-21T23:03:14.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 620.0 s, 262.4 tps, lat 395.931 ms stddev 200.991 2023-07-21T23:03:14.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:14 smithi151 ceph-mon[95510]: pgmap v1403: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 481 op/s 2023-07-21T23:03:14.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:14 smithi187 ceph-mon[96918]: pgmap v1403: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 481 op/s 2023-07-21T23:03:14.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:14 smithi195 ceph-mon[97365]: pgmap v1403: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 4.8 MiB/s wr, 481 op/s 2023-07-21T23:03:17.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:16 smithi187 ceph-mon[96918]: pgmap v1404: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 408 op/s 2023-07-21T23:03:17.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:16 smithi195 ceph-mon[97365]: pgmap v1404: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 408 op/s 2023-07-21T23:03:17.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:16 smithi151 ceph-mon[95510]: pgmap v1404: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 4.1 MiB/s wr, 408 op/s 2023-07-21T23:03:18.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:17 smithi187 ceph-mon[96918]: osdmap e167: 12 total, 12 up, 12 in 2023-07-21T23:03:18.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:17 smithi195 ceph-mon[97365]: osdmap e167: 12 total, 12 up, 12 in 2023-07-21T23:03:18.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:17 smithi151 ceph-mon[95510]: osdmap e167: 12 total, 12 up, 12 in 2023-07-21T23:03:19.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 625.0 s, 289.8 tps, lat 345.559 ms stddev 127.631 2023-07-21T23:03:19.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:19 smithi187 ceph-mon[96918]: pgmap v1406: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.9 MiB/s wr, 690 op/s 2023-07-21T23:03:19.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:19 smithi195 ceph-mon[97365]: pgmap v1406: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.9 MiB/s wr, 690 op/s 2023-07-21T23:03:19.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:19 smithi151 ceph-mon[95510]: pgmap v1406: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.9 MiB/s wr, 690 op/s 2023-07-21T23:03:21.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:21 smithi187 ceph-mon[96918]: pgmap v1407: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.5 MiB/s wr, 792 op/s 2023-07-21T23:03:21.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:21 smithi195 ceph-mon[97365]: pgmap v1407: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.5 MiB/s wr, 792 op/s 2023-07-21T23:03:21.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:21 smithi151 ceph-mon[95510]: pgmap v1407: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.5 MiB/s wr, 792 op/s 2023-07-21T23:03:23.083 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.050+0000 7f230339d700 1 -- 172.21.15.151:0/4005726985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc0ff930 msgr2=0x7f22fc0ffda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.050+0000 7f230339d700 1 --2- 172.21.15.151:0/4005726985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc0ff930 0x7f22fc0ffda0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f22ec009990 tx=0x7f22ec009ca0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.050+0000 7f230339d700 1 -- 172.21.15.151:0/4005726985 shutdown_connections 2023-07-21T23:03:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.050+0000 7f230339d700 1 --2- 172.21.15.151:0/4005726985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22fc1002e0 0x7f22fc10c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.050+0000 7f230339d700 1 --2- 172.21.15.151:0/4005726985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22fc105940 0x7f22fc105d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.050+0000 7f230339d700 1 --2- 172.21.15.151:0/4005726985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc0ff930 0x7f22fc0ffda0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.084 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.050+0000 7f230339d700 1 -- 172.21.15.151:0/4005726985 >> 172.21.15.151:0/4005726985 conn(0x7f22fc0fb450 msgr2=0x7f22fc0fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.050+0000 7f230339d700 1 -- 172.21.15.151:0/4005726985 shutdown_connections 2023-07-21T23:03:23.085 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.051+0000 7f230339d700 1 -- 172.21.15.151:0/4005726985 wait complete. 2023-07-21T23:03:23.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.051+0000 7f230339d700 1 Processor -- start 2023-07-21T23:03:23.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.052+0000 7f230339d700 1 -- start start 2023-07-21T23:03:23.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.052+0000 7f230339d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22fc0ff930 0x7f22fc072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.052+0000 7f230339d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22fc1002e0 0x7f22fc072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.086 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.052+0000 7f230339d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc105940 0x7f22fc073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.052+0000 7f230339d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1a82d0 con 0x7f22fc1002e0 2023-07-21T23:03:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.052+0000 7f230339d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1a8410 con 0x7f22fc0ff930 2023-07-21T23:03:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.052+0000 7f230339d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22fc1a8550 con 0x7f22fc105940 2023-07-21T23:03:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f230239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22fc0ff930 0x7f22fc072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f230239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22fc0ff930 0x7f22fc072810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:33468/0 (socket says 172.21.15.151:33468) 2023-07-21T23:03:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f230239b700 1 -- 172.21.15.151:0/1362190237 learned_addr learned my addr 172.21.15.151:0/1362190237 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:23.087 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f2301b9a700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22fc1002e0 0x7f22fc072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f2302b9c700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc105940 0x7f22fc073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f230239b700 1 -- 172.21.15.151:0/1362190237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc105940 msgr2=0x7f22fc073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f230239b700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc105940 0x7f22fc073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f230239b700 1 -- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22fc1002e0 msgr2=0x7f22fc072d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f230239b700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22fc1002e0 0x7f22fc072d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.088 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f230239b700 1 -- 172.21.15.151:0/1362190237 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22ec0095f0 con 0x7f22fc0ff930 2023-07-21T23:03:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.053+0000 7f230239b700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22fc0ff930 0x7f22fc072810 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f22f800e970 tx=0x7f22f800ec80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.054+0000 7f22f37fe700 1 -- 172.21.15.151:0/1362190237 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8009790 con 0x7f22fc0ff930 2023-07-21T23:03:23.089 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.054+0000 7f22f37fe700 1 -- 172.21.15.151:0/1362190237 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22f800c7e0 con 0x7f22fc0ff930 2023-07-21T23:03:23.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.054+0000 7f22f37fe700 1 -- 172.21.15.151:0/1362190237 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8003bd0 con 0x7f22fc0ff930 2023-07-21T23:03:23.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.054+0000 7f230339d700 1 -- 172.21.15.151:0/1362190237 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22fc1a87e0 con 0x7f22fc0ff930 2023-07-21T23:03:23.090 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.054+0000 7f230339d700 1 -- 172.21.15.151:0/1362190237 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc1a8c70 con 0x7f22fc0ff930 2023-07-21T23:03:23.091 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.058+0000 7f22f37fe700 1 -- 172.21.15.151:0/1362190237 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f22f800c950 con 0x7f22fc0ff930 2023-07-21T23:03:23.092 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.060+0000 7f2317e85b80 1 Processor -- start 2023-07-21T23:03:23.093 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.060+0000 7f2317e85b80 1 -- start start 2023-07-21T23:03:23.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31d9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31d40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.094 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31d45e0 0x555cc31d4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2317e85b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc30d9c50 con 0x555cc30306b0 2023-07-21T23:03:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2317e85b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc312c9e0 con 0x555cc31d45e0 2023-07-21T23:03:23.095 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2317e85b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc3125e70 con 0x555cc31da480 2023-07-21T23:03:23.096 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f22f37fe700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f22e80a12c0 0x7f22e80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f22f37fe700 1 -- 172.21.15.151:0/1362190237 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f22f8014070 con 0x7f22fc0ff930 2023-07-21T23:03:23.101 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2302b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31d9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2301b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31d45e0 0x555cc31d4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f230239b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31d40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f230239b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31d40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33606/0 (socket says 172.21.15.151:33606) 2023-07-21T23:03:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2301b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31d45e0 0x555cc31d4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:33476/0 (socket says 172.21.15.151:33476) 2023-07-21T23:03:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f230239b700 1 -- 172.21.15.151:0/1216131783 learned_addr learned my addr 172.21.15.151:0/1216131783 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.061+0000 7f2302b9c700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f22e80a12c0 0x7f22e80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f2301b9a700 1 -- 172.21.15.151:0/1216131783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 msgr2=0x555cc31d40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f2301b9a700 1 --2- 172.21.15.151:0/1216131783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31d40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f2301b9a700 1 -- 172.21.15.151:0/1216131783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 msgr2=0x555cc31d9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:23.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f2301b9a700 1 --2- 172.21.15.151:0/1216131783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31d9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f2301b9a700 1 -- 172.21.15.151:0/1216131783 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cc2f53d80 con 0x555cc31d45e0 2023-07-21T23:03:23.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f230239b700 1 --2- 172.21.15.151:0/1216131783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31d40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:03:23.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f2301b9a700 1 --2- 172.21.15.151:0/1216131783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31d45e0 0x555cc31d4a30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0098e0 tx=0x7f22ec005f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b6a4f82d36b62a4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:23.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f2302b9c700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f22e80a12c0 0x7f22e80a3770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f22f4008c10 tx=0x7f22f4009f90 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:23.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f22f0bfe700 1 -- 172.21.15.151:0/1216131783 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec01d070 con 0x555cc31d45e0 2023-07-21T23:03:23.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.062+0000 7f22f0bfe700 1 -- 172.21.15.151:0/1216131783 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22ec01e040 con 0x555cc31d45e0 2023-07-21T23:03:23.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.063+0000 7f22f0bfe700 1 -- 172.21.15.151:0/1216131783 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22ec004760 con 0x555cc31d45e0 2023-07-21T23:03:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.063+0000 7f2317e85b80 1 -- 172.21.15.151:0/1216131783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31d45e0 msgr2=0x555cc31d4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.063+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1216131783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31d45e0 0x555cc31d4a30 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f22ec0098e0 tx=0x7f22ec005f00 comp rx=0 tx=0).stop 2023-07-21T23:03:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.063+0000 7f2317e85b80 1 -- 172.21.15.151:0/1216131783 shutdown_connections 2023-07-21T23:03:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.063+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1216131783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31d45e0 0x555cc31d4a30 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.063+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1216131783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31d9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.063+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1216131783 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31d40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.063+0000 7f2317e85b80 1 -- 172.21.15.151:0/1216131783 >> 172.21.15.151:0/1216131783 conn(0x555cc31c9c40 msgr2=0x555cc31cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:23.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.064+0000 7f2317e85b80 1 -- 172.21.15.151:0/1216131783 shutdown_connections 2023-07-21T23:03:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.064+0000 7f2317e85b80 1 -- 172.21.15.151:0/1216131783 wait complete. 2023-07-21T23:03:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.064+0000 7f2317e85b80 1 -- start start 2023-07-21T23:03:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.064+0000 7f2317e85b80 1 Processor -- start 2023-07-21T23:03:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.065+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.065+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 0x555cc31dd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.065+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 0x555cc31de080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.065+0000 7f2317e85b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc30c5a60 con 0x555cc30306b0 2023-07-21T23:03:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.065+0000 7f2317e85b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc30c5760 con 0x555cc31da480 2023-07-21T23:03:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.065+0000 7f2317e85b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc2fa98c0 con 0x555cc31d45e0 2023-07-21T23:03:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.065+0000 7f2317e85b80 10 client.0 _ll_register_callbacks cb 0x555cc30c3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:03:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f230239b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f2301b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 0x555cc31dd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f230239b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47828/0 (socket says 172.21.15.151:47828) 2023-07-21T23:03:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f230239b700 1 -- 172.21.15.151:0/1986180425 learned_addr learned my addr 172.21.15.151:0/1986180425 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f2302b9c700 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 0x555cc31de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f230239b700 1 -- 172.21.15.151:0/1986180425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 msgr2=0x555cc31dd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f230239b700 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 0x555cc31dd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f230239b700 1 -- 172.21.15.151:0/1986180425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 msgr2=0x555cc31de080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f230239b700 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 0x555cc31de080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f230239b700 1 -- 172.21.15.151:0/1986180425 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc1a8c70 con 0x555cc30306b0 2023-07-21T23:03:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f230239b700 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e0730 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f22f8099c40 tx=0x7f22f800cd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365f80ef96968ecd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.066+0000 7f22e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:03:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.067+0000 7f22e5ffb700 1 -- 172.21.15.151:0/1986180425 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f80caa50 con 0x555cc30306b0 2023-07-21T23:03:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.067+0000 7f2317e85b80 1 -- 172.21.15.151:0/1986180425 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555cc307f490 con 0x555cc30306b0 2023-07-21T23:03:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.067+0000 7f22e5ffb700 1 -- 172.21.15.151:0/1986180425 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f22f8099f40 con 0x555cc30306b0 2023-07-21T23:03:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.067+0000 7f22e5ffb700 1 -- 172.21.15.151:0/1986180425 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22f809df70 con 0x555cc30306b0 2023-07-21T23:03:23.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.067+0000 7f2317e85b80 10 client.19680 fetch_fsmap learned FSMap version 116 2023-07-21T23:03:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.067+0000 7f2317e85b80 1 -- 172.21.15.151:0/1986180425 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x7f22fc10d070 con 0x555cc30306b0 2023-07-21T23:03:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.067+0000 7f22e5ffb700 1 -- 172.21.15.151:0/1986180425 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22f80b6080 con 0x555cc30306b0 2023-07-21T23:03:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.067+0000 7f22e5ffb700 1 -- 172.21.15.151:0/1986180425 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f22f80994c0 con 0x555cc30306b0 2023-07-21T23:03:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.068+0000 7f2317e85b80 10 client.19680 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:03:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.068+0000 7f2317e85b80 10 client.19680 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:03:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.068+0000 7f2317e85b80 20 client.19680 populate_metadata read hostname 'smithi151' 2023-07-21T23:03:23.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.068+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555cc31edc80 0x555cc31f0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.068+0000 7f2317e85b80 4 client.19680 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:03:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.068+0000 7f2317e85b80 1 -- 172.21.15.151:0/1986180425 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555cc311ee50 con 0x555cc31edc80 2023-07-21T23:03:23.111 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.068+0000 7f2301b9a700 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555cc31edc80 0x555cc31f0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.112 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.069+0000 7f2301b9a700 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555cc31edc80 0x555cc31f0090 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7d9d2f31bec1d04 server_cookie=e15affa8352497db in_seq=0 out_seq=0 2023-07-21T23:03:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.069+0000 7f22e5ffb700 10 client.19680 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.069+0000 7f22e5ffb700 1 -- 172.21.15.151:0/1986180425 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x555cc311ee50 con 0x555cc31edc80 2023-07-21T23:03:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.069+0000 7f22e5ffb700 10 client.19680 handle_command_reply: tid=0 2023-07-21T23:03:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.069+0000 7f2317e85b80 1 client.19680 shutdown 2023-07-21T23:03:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 -- 172.21.15.151:0/1986180425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 msgr2=0x555cc31e0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e0730 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f22f8099c40 tx=0x7f22f800cd40 comp rx=0 tx=0).stop 2023-07-21T23:03:23.113 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 -- 172.21.15.151:0/1986180425 shutdown_connections 2023-07-21T23:03:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555cc31edc80 0x555cc31f0090 crc :-1 s=READY pgs=493 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 0x555cc31de080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e0730 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 --2- 172.21.15.151:0/1986180425 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 0x555cc31dd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f22e5ffb700 0 client.19680 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 -- 172.21.15.151:0/1986180425 >> 172.21.15.151:0/1986180425 conn(0x555cc31c9c40 msgr2=0x555cc31ce540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 -- 172.21.15.151:0/1986180425 shutdown_connections 2023-07-21T23:03:23.114 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 1 -- 172.21.15.151:0/1986180425 wait complete. 2023-07-21T23:03:23.115 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.070+0000 7f2317e85b80 20 client.19680 trim_cache size 0 max 16384 2023-07-21T23:03:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.089+0000 7f2317e85b80 1 Processor -- start 2023-07-21T23:03:23.122 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.089+0000 7f2317e85b80 1 -- start start 2023-07-21T23:03:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.089+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc30306b0 0x555cc31d40a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.089+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc31d45e0 0x555cc31e4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.123 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.089+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31db160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.089+0000 7f2317e85b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc31da850 con 0x555cc31d45e0 2023-07-21T23:03:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.089+0000 7f2317e85b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc31d5320 con 0x555cc30306b0 2023-07-21T23:03:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.089+0000 7f2317e85b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc31d06d0 con 0x555cc31da480 2023-07-21T23:03:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f230239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc30306b0 0x555cc31d40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f230239b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc30306b0 0x555cc31d40a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:33492/0 (socket says 172.21.15.151:33492) 2023-07-21T23:03:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f230239b700 1 -- 172.21.15.151:0/925729643 learned_addr learned my addr 172.21.15.151:0/925729643 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:23.124 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f2301b9a700 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc31d45e0 0x555cc31e4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f2302b9c700 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31db160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f230239b700 1 -- 172.21.15.151:0/925729643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 msgr2=0x555cc31db160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f230239b700 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31db160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f230239b700 1 -- 172.21.15.151:0/925729643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc31d45e0 msgr2=0x555cc31e4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f230239b700 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc31d45e0 0x555cc31e4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f230239b700 1 -- 172.21.15.151:0/925729643 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555cc31d4c80 con 0x555cc30306b0 2023-07-21T23:03:23.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f2302b9c700 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31db160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:03:23.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f230239b700 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc30306b0 0x555cc31d40a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f22f806df80 tx=0x7f22f8003680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6df4567ed0e5b6be server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.090+0000 7f22f13ff700 1 -- 172.21.15.151:0/925729643 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f809a3a0 con 0x555cc30306b0 2023-07-21T23:03:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f22f13ff700 1 -- 172.21.15.151:0/925729643 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x555cc307f490 con 0x555cc30306b0 2023-07-21T23:03:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f22f13ff700 1 -- 172.21.15.151:0/925729643 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f8065170 con 0x555cc30306b0 2023-07-21T23:03:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f2317e85b80 1 -- 172.21.15.151:0/925729643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc30306b0 msgr2=0x555cc31d40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f2317e85b80 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc30306b0 0x555cc31d40a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f22f806df80 tx=0x7f22f8003680 comp rx=0 tx=0).stop 2023-07-21T23:03:23.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f2317e85b80 1 -- 172.21.15.151:0/925729643 shutdown_connections 2023-07-21T23:03:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f2317e85b80 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc30306b0 0x555cc31d40a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f2317e85b80 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31da480 0x555cc31db160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f2317e85b80 1 --2- 172.21.15.151:0/925729643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc31d45e0 0x555cc31e4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f2317e85b80 1 -- 172.21.15.151:0/925729643 >> 172.21.15.151:0/925729643 conn(0x555cc31c9c40 msgr2=0x555cc31daa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.091+0000 7f2317e85b80 1 -- 172.21.15.151:0/925729643 shutdown_connections 2023-07-21T23:03:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.092+0000 7f2317e85b80 1 -- 172.21.15.151:0/925729643 wait complete. 2023-07-21T23:03:23.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.092+0000 7f2317e85b80 1 -- start start 2023-07-21T23:03:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.092+0000 7f2317e85b80 1 Processor -- start 2023-07-21T23:03:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 0x555cc31dc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2317e85b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 0x555cc31dc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2317e85b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc31dceb0 con 0x555cc30306b0 2023-07-21T23:03:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2317e85b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc31dd020 con 0x555cc31da480 2023-07-21T23:03:23.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2317e85b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x555cc3241b60 con 0x555cc31d45e0 2023-07-21T23:03:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2317e85b80 10 client.0 _ll_register_callbacks cb 0x7f22f8099b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:03:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2301b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 0x555cc31dc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2302b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 0x555cc31dc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2301b9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 0x555cc31dc2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:33636/0 (socket says 172.21.15.151:33636) 2023-07-21T23:03:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f2301b9a700 1 -- 172.21.15.151:0/3930814755 learned_addr learned my addr 172.21.15.151:0/3930814755 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:23.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.093+0000 7f230239b700 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.094+0000 7f2302b9c700 1 -- 172.21.15.151:0/3930814755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 msgr2=0x555cc31dc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.094+0000 7f2302b9c700 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 0x555cc31dc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.094+0000 7f2302b9c700 1 -- 172.21.15.151:0/3930814755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 msgr2=0x555cc31e4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.094+0000 7f2302b9c700 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.132 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.094+0000 7f2302b9c700 1 -- 172.21.15.151:0/3930814755 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22fc10d070 con 0x555cc31da480 2023-07-21T23:03:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.094+0000 7f2302b9c700 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 0x555cc31dc810 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x555cc31de940 tx=0x7f22f4009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fa2fa7c2b4b9699 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.094+0000 7f22e5ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:03:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.095+0000 7f22e5ffb700 1 -- 172.21.15.151:0/3930814755 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400e070 con 0x555cc31da480 2023-07-21T23:03:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.095+0000 7f22e5ffb700 1 -- 172.21.15.151:0/3930814755 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f22f4004030 con 0x555cc31da480 2023-07-21T23:03:23.133 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.095+0000 7f2317e85b80 1 -- 172.21.15.151:0/3930814755 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f22ec01e040 con 0x555cc31da480 2023-07-21T23:03:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.095+0000 7f22e5ffb700 1 -- 172.21.15.151:0/3930814755 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22f40091c0 con 0x555cc31da480 2023-07-21T23:03:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.095+0000 7f2317e85b80 10 client.29366 fetch_fsmap learned FSMap version 116 2023-07-21T23:03:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.095+0000 7f2317e85b80 1 -- 172.21.15.151:0/3930814755 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x555cc2f3cc00 con 0x555cc31da480 2023-07-21T23:03:23.134 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.096+0000 7f22e5ffb700 1 -- 172.21.15.151:0/3930814755 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f22ec01e040 con 0x555cc31da480 2023-07-21T23:03:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.096+0000 7f22e5ffb700 1 -- 172.21.15.151:0/3930814755 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f22f401b740 con 0x555cc31da480 2023-07-21T23:03:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.096+0000 7f2317e85b80 10 client.29366 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:03:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.096+0000 7f2317e85b80 10 client.29366 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:03:23.135 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.096+0000 7f2317e85b80 20 client.29366 populate_metadata read hostname 'smithi151' 2023-07-21T23:03:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.096+0000 7f2317e85b80 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555cc32430f0 0x555cc3245500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.096+0000 7f2317e85b80 4 client.29366 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:03:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.096+0000 7f2317e85b80 1 -- 172.21.15.151:0/3930814755 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x555cc30e0ff0 con 0x555cc32430f0 2023-07-21T23:03:23.136 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.096+0000 7f230239b700 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555cc32430f0 0x555cc3245500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.097+0000 7f230239b700 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555cc32430f0 0x555cc3245500 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1aa327613084f40 server_cookie=83878ea4e32fbb82 in_seq=0 out_seq=0 2023-07-21T23:03:23.137 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.097+0000 7f22e5ffb700 10 client.29366 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:23.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f22e5ffb700 1 -- 172.21.15.151:0/3930814755 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x555cc30e0ff0 con 0x555cc32430f0 2023-07-21T23:03:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f22e5ffb700 10 client.29366 handle_command_reply: tid=0 2023-07-21T23:03:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f2317e85b80 1 client.29366 shutdown 2023-07-21T23:03:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f2317e85b80 1 -- 172.21.15.151:0/3930814755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 msgr2=0x555cc31dc810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f2317e85b80 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 0x555cc31dc810 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x555cc31de940 tx=0x7f22f4009920 comp rx=0 tx=0).stop 2023-07-21T23:03:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f2317e85b80 1 -- 172.21.15.151:0/3930814755 shutdown_connections 2023-07-21T23:03:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f2317e85b80 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x555cc32430f0 0x555cc3245500 crc :-1 s=READY pgs=494 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f2317e85b80 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555cc31da480 0x555cc31dc810 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f2317e85b80 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555cc30306b0 0x555cc31e4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f22e5ffb700 0 client.29366 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f2317e85b80 1 --2- 172.21.15.151:0/3930814755 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x555cc31d45e0 0x555cc31dc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.265+0000 7f2317e85b80 1 -- 172.21.15.151:0/3930814755 >> 172.21.15.151:0/3930814755 conn(0x555cc31c9c40 msgr2=0x555cc31da9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.266+0000 7f2317e85b80 1 -- 172.21.15.151:0/3930814755 shutdown_connections 2023-07-21T23:03:23.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.266+0000 7f2317e85b80 1 -- 172.21.15.151:0/3930814755 wait complete. 2023-07-21T23:03:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.266+0000 7f2317e85b80 20 client.29366 trim_cache size 0 max 16384 2023-07-21T23:03:23.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:03:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:03:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:03:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:03:23.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 -- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f22e80a12c0 msgr2=0x7f22e80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f22e80a12c0 0x7f22e80a3770 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f22f4008c10 tx=0x7f22f4009f90 comp rx=0 tx=0).stop 2023-07-21T23:03:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 -- 172.21.15.151:0/1362190237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22fc0ff930 msgr2=0x7f22fc072810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22fc0ff930 0x7f22fc072810 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f22f800e970 tx=0x7f22f800ec80 comp rx=0 tx=0).stop 2023-07-21T23:03:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 -- 172.21.15.151:0/1362190237 shutdown_connections 2023-07-21T23:03:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f22e80a12c0 0x7f22e80a3770 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22fc0ff930 0x7f22fc072810 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f22fc105940 0x7f22fc073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 --2- 172.21.15.151:0/1362190237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22fc1002e0 0x7f22fc072d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 -- 172.21.15.151:0/1362190237 >> 172.21.15.151:0/1362190237 conn(0x7f22fc0fb450 msgr2=0x7f22fc0fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 -- 172.21.15.151:0/1362190237 shutdown_connections 2023-07-21T23:03:23.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:23.267+0000 7f230339d700 1 -- 172.21.15.151:0/1362190237 wait complete. 2023-07-21T23:03:23.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:23 smithi187 ceph-mon[96918]: pgmap v1408: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.5 MiB/s wr, 792 op/s 2023-07-21T23:03:23.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:23 smithi195 ceph-mon[97365]: pgmap v1408: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.5 MiB/s wr, 792 op/s 2023-07-21T23:03:23.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:23 smithi151 ceph-mon[95510]: pgmap v1408: 97 pgs: 97 active+clean; 12 GiB data, 26 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.5 MiB/s wr, 792 op/s 2023-07-21T23:03:24.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 630.0 s, 328.6 tps, lat 308.531 ms stddev 103.183 2023-07-21T23:03:25.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:25 smithi187 ceph-mon[96918]: pgmap v1409: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.2 MiB/s wr, 996 op/s 2023-07-21T23:03:25.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:25 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:03:25.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:25 smithi195 ceph-mon[97365]: pgmap v1409: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.2 MiB/s wr, 996 op/s 2023-07-21T23:03:25.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:25 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:03:25.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:25 smithi151 ceph-mon[95510]: pgmap v1409: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.2 MiB/s wr, 996 op/s 2023-07-21T23:03:25.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:25 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:03:27.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:27 smithi187 ceph-mon[96918]: pgmap v1410: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.2 MiB/s wr, 996 op/s 2023-07-21T23:03:27.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:27 smithi195 ceph-mon[97365]: pgmap v1410: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.2 MiB/s wr, 996 op/s 2023-07-21T23:03:27.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:27 smithi151 ceph-mon[95510]: pgmap v1410: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.2 MiB/s wr, 996 op/s 2023-07-21T23:03:29.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 635.0 s, 316.2 tps, lat 314.848 ms stddev 82.909 2023-07-21T23:03:29.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:29 smithi187 ceph-mon[96918]: pgmap v1411: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.23k op/s 2023-07-21T23:03:29.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:29 smithi195 ceph-mon[97365]: pgmap v1411: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.23k op/s 2023-07-21T23:03:29.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:29 smithi151 ceph-mon[95510]: pgmap v1411: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 12 MiB/s wr, 1.23k op/s 2023-07-21T23:03:31.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:31 smithi187 ceph-mon[96918]: pgmap v1412: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.6 MiB/s wr, 1.01k op/s 2023-07-21T23:03:31.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:31 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:03:31.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:31 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:03:31.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:31 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:03:31.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:31 smithi195 ceph-mon[97365]: pgmap v1412: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.6 MiB/s wr, 1.01k op/s 2023-07-21T23:03:31.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:31 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:03:31.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:31 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:03:31.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:31 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:03:31.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:31 smithi151 ceph-mon[95510]: pgmap v1412: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.6 MiB/s wr, 1.01k op/s 2023-07-21T23:03:31.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:31 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:03:31.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:31 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:03:31.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:31 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:03:33.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:33 smithi187 ceph-mon[96918]: pgmap v1413: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.5 MiB/s wr, 861 op/s 2023-07-21T23:03:33.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:33 smithi195 ceph-mon[97365]: pgmap v1413: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.5 MiB/s wr, 861 op/s 2023-07-21T23:03:33.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:33 smithi151 ceph-mon[95510]: pgmap v1413: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.5 MiB/s wr, 861 op/s 2023-07-21T23:03:34.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 640.0 s, 364.6 tps, lat 276.547 ms stddev 58.623 2023-07-21T23:03:35.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:35 smithi187 ceph-mon[96918]: pgmap v1414: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 1.32k op/s 2023-07-21T23:03:35.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:35 smithi195 ceph-mon[97365]: pgmap v1414: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 1.32k op/s 2023-07-21T23:03:35.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:35 smithi151 ceph-mon[95510]: pgmap v1414: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 1.32k op/s 2023-07-21T23:03:36.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.521+0000 7f4da51ff700 1 -- 172.21.15.151:0/1122232912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4da00fe220 msgr2=0x7f4da00fe5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.521+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1122232912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4da00fe220 0x7f4da00fe5f0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000d990 tx=0x7f4d9000dca0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.522+0000 7f4da51ff700 1 -- 172.21.15.151:0/1122232912 shutdown_connections 2023-07-21T23:03:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.522+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1122232912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da0103260 0x7f4da010ae30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.522+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1122232912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4da00fe220 0x7f4da00fe5f0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.522+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1122232912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da00febc0 0x7f4da0102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.522+0000 7f4da51ff700 1 -- 172.21.15.151:0/1122232912 >> 172.21.15.151:0/1122232912 conn(0x7f4da0073d50 msgr2=0x7f4da0074150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.522+0000 7f4da51ff700 1 -- 172.21.15.151:0/1122232912 shutdown_connections 2023-07-21T23:03:36.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.522+0000 7f4da51ff700 1 -- 172.21.15.151:0/1122232912 wait complete. 2023-07-21T23:03:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.524+0000 7f4da51ff700 1 Processor -- start 2023-07-21T23:03:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.524+0000 7f4da51ff700 1 -- start start 2023-07-21T23:03:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.524+0000 7f4da51ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da00fe220 0x7f4da006bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.524+0000 7f4da51ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4da00febc0 0x7f4da006c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.525+0000 7f4da51ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da0103260 0x7f4da00716f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.525+0000 7f4da51ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0071e80 con 0x7f4da00febc0 2023-07-21T23:03:36.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.525+0000 7f4da51ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da0071ff0 con 0x7f4da00fe220 2023-07-21T23:03:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.525+0000 7f4da51ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da00721b0 con 0x7f4da0103260 2023-07-21T23:03:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.525+0000 7f4d9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4da00febc0 0x7f4da006c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.525+0000 7f4d9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4da00febc0 0x7f4da006c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44980/0 (socket says 172.21.15.151:44980) 2023-07-21T23:03:36.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.525+0000 7f4d9e59c700 1 -- 172.21.15.151:0/1108098212 learned_addr learned my addr 172.21.15.151:0/1108098212 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.525+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da00fe220 0x7f4da006bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.526+0000 7f4d9f59e700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da0103260 0x7f4da00716f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.526+0000 7f4d9ed9d700 1 -- 172.21.15.151:0/1108098212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da0103260 msgr2=0x7f4da00716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.526+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da0103260 0x7f4da00716f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.526+0000 7f4d9ed9d700 1 -- 172.21.15.151:0/1108098212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4da00febc0 msgr2=0x7f4da006c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.526+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4da00febc0 0x7f4da006c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.526+0000 7f4d9ed9d700 1 -- 172.21.15.151:0/1108098212 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d9000d590 con 0x7f4da00fe220 2023-07-21T23:03:36.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.527+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da00fe220 0x7f4da006bba0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000d880 tx=0x7f4d90012ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:36.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.528+0000 7f4d87fff700 1 -- 172.21.15.151:0/1108098212 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90020070 con 0x7f4da00fe220 2023-07-21T23:03:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.528+0000 7f4d87fff700 1 -- 172.21.15.151:0/1108098212 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d90012e50 con 0x7f4da00fe220 2023-07-21T23:03:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.528+0000 7f4d87fff700 1 -- 172.21.15.151:0/1108098212 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d90003e10 con 0x7f4da00fe220 2023-07-21T23:03:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.529+0000 7f4da51ff700 1 -- 172.21.15.151:0/1108098212 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da0072430 con 0x7f4da00fe220 2023-07-21T23:03:36.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.529+0000 7f4da51ff700 1 -- 172.21.15.151:0/1108098212 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da01a9350 con 0x7f4da00fe220 2023-07-21T23:03:36.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.536+0000 7f4d87fff700 1 -- 172.21.15.151:0/1108098212 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4d90003680 con 0x7f4da00fe220 2023-07-21T23:03:36.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.537+0000 7f4db8b36b80 1 Processor -- start 2023-07-21T23:03:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.537+0000 7f4db8b36b80 1 -- start start 2023-07-21T23:03:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.538+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f4ae6b0 0x562c0f6604e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.538+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660a20 0x562c0f65a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.538+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660e70 0x562c0f65acb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.538+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f557c50 con 0x562c0f660e70 2023-07-21T23:03:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.538+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f5aa9e0 con 0x562c0f4ae6b0 2023-07-21T23:03:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.538+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f5a3e70 con 0x562c0f660a20 2023-07-21T23:03:36.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.539+0000 7f4d9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660e70 0x562c0f65acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.539+0000 7f4d9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660e70 0x562c0f65acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44982/0 (socket says 172.21.15.151:44982) 2023-07-21T23:03:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.539+0000 7f4d9e59c700 1 -- 172.21.15.151:0/4139233912 learned_addr learned my addr 172.21.15.151:0/4139233912 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.539+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/4139233912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660a20 0x562c0f65a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.540+0000 7f4d9e59c700 1 -- 172.21.15.151:0/4139233912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660a20 msgr2=0x562c0f65a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.540+0000 7f4d9e59c700 1 --2- 172.21.15.151:0/4139233912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660a20 0x562c0f65a750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.540+0000 7f4d9e59c700 1 -- 172.21.15.151:0/4139233912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f4ae6b0 msgr2=0x562c0f6604e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:03:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.540+0000 7f4d9e59c700 1 --2- 172.21.15.151:0/4139233912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f4ae6b0 0x562c0f6604e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.540+0000 7f4d9e59c700 1 -- 172.21.15.151:0/4139233912 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c0f3d1d80 con 0x562c0f660e70 2023-07-21T23:03:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.541+0000 7f4d87fff700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d880a14d0 0x7f4d880a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.541+0000 7f4d87fff700 1 -- 172.21.15.151:0/1108098212 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4d900d13f0 con 0x7f4da00fe220 2023-07-21T23:03:36.579 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.546+0000 7f4d9e59c700 1 --2- 172.21.15.151:0/4139233912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660e70 0x562c0f65acb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009b20 tx=0x7f4d94009e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ecac12f27ae26a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.547+0000 7f4d857fa700 1 -- 172.21.15.151:0/4139233912 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940095f0 con 0x562c0f660e70 2023-07-21T23:03:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.547+0000 7f4d857fa700 1 -- 172.21.15.151:0/4139233912 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d9400ee20 con 0x562c0f660e70 2023-07-21T23:03:36.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.547+0000 7f4d857fa700 1 -- 172.21.15.151:0/4139233912 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940123d0 con 0x562c0f660e70 2023-07-21T23:03:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.548+0000 7f4db8b36b80 1 -- 172.21.15.151:0/4139233912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660e70 msgr2=0x562c0f65acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:36.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.548+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/4139233912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660e70 0x562c0f65acb0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009b20 tx=0x7f4d94009e30 comp rx=0 tx=0).stop 2023-07-21T23:03:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.551+0000 7f4d9f59e700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d880a14d0 0x7f4d880a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.551+0000 7f4db8b36b80 1 -- 172.21.15.151:0/4139233912 shutdown_connections 2023-07-21T23:03:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.551+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/4139233912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f4ae6b0 0x562c0f6604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.551+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/4139233912 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660e70 0x562c0f65acb0 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.551+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/4139233912 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660a20 0x562c0f65a750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.551+0000 7f4db8b36b80 1 -- 172.21.15.151:0/4139233912 >> 172.21.15.151:0/4139233912 conn(0x562c0f647ae0 msgr2=0x562c0f64d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.552+0000 7f4db8b36b80 1 -- 172.21.15.151:0/4139233912 shutdown_connections 2023-07-21T23:03:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.552+0000 7f4db8b36b80 1 -- 172.21.15.151:0/4139233912 wait complete. 2023-07-21T23:03:36.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.552+0000 7f4d9f59e700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d880a14d0 0x7f4d880a3980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4d980095a0 tx=0x7f4d9800c040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.553+0000 7f4db8b36b80 1 -- start start 2023-07-21T23:03:36.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.553+0000 7f4db8b36b80 1 Processor -- start 2023-07-21T23:03:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.554+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f4ae6b0 0x562c0f666900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.554+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660a20 0x562c0f666e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.554+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f664d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.554+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f543a60 con 0x562c0f660a20 2023-07-21T23:03:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.554+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f543760 con 0x562c0f4ae6b0 2023-07-21T23:03:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.554+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f4278c0 con 0x562c0f660e70 2023-07-21T23:03:36.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.554+0000 7f4db8b36b80 10 client.0 _ll_register_callbacks cb 0x562c0f541700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:03:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.555+0000 7f4d9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660a20 0x562c0f666e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.555+0000 7f4d9e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660a20 0x562c0f666e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44990/0 (socket says 172.21.15.151:44990) 2023-07-21T23:03:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.555+0000 7f4d9e59c700 1 -- 172.21.15.151:0/1396087598 learned_addr learned my addr 172.21.15.151:0/1396087598 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:36.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.555+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f4ae6b0 0x562c0f666900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.556+0000 7f4d9e59c700 1 -- 172.21.15.151:0/1396087598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 msgr2=0x562c0f664d50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.556+0000 7f4d9e59c700 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f664d50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.556+0000 7f4d9e59c700 1 -- 172.21.15.151:0/1396087598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f4ae6b0 msgr2=0x562c0f666900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.556+0000 7f4d9e59c700 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f4ae6b0 0x562c0f666900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.556+0000 7f4d9e59c700 1 -- 172.21.15.151:0/1396087598 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d94009750 con 0x562c0f660a20 2023-07-21T23:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.556+0000 7f4d9e59c700 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660a20 0x562c0f666e40 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f4d94004790 tx=0x7f4d9400ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa34499d14cc712a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:36.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.556+0000 7f4d82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:03:36.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.557+0000 7f4d82ff5700 1 -- 172.21.15.151:0/1396087598 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94006e50 con 0x562c0f660a20 2023-07-21T23:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.557+0000 7f4d82ff5700 1 -- 172.21.15.151:0/1396087598 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4d94013d20 con 0x562c0f660a20 2023-07-21T23:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.557+0000 7f4db8b36b80 1 -- 172.21.15.151:0/1396087598 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562c0f4fd490 con 0x562c0f660a20 2023-07-21T23:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.557+0000 7f4d82ff5700 1 -- 172.21.15.151:0/1396087598 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d94013970 con 0x562c0f660a20 2023-07-21T23:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.557+0000 7f4db8b36b80 10 client.19698 fetch_fsmap learned FSMap version 116 2023-07-21T23:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.557+0000 7f4db8b36b80 1 -- 172.21.15.151:0/1396087598 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x562c0f3bac00 con 0x562c0f660a20 2023-07-21T23:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.558+0000 7f4d82ff5700 1 -- 172.21.15.151:0/1396087598 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562c0f4fd490 con 0x562c0f660a20 2023-07-21T23:03:36.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.558+0000 7f4d82ff5700 1 -- 172.21.15.151:0/1396087598 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d9402c070 con 0x562c0f660a20 2023-07-21T23:03:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.558+0000 7f4db8b36b80 10 client.19698 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:03:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.558+0000 7f4db8b36b80 10 client.19698 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:03:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.558+0000 7f4db8b36b80 20 client.19698 populate_metadata read hostname 'smithi151' 2023-07-21T23:03:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.558+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562c0f67c9e0 0x562c0f67edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.558+0000 7f4db8b36b80 4 client.19698 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:03:36.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.558+0000 7f4db8b36b80 1 -- 172.21.15.151:0/1396087598 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562c0f59ce50 con 0x562c0f67c9e0 2023-07-21T23:03:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.561+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562c0f67c9e0 0x562c0f67edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.562+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562c0f67c9e0 0x562c0f67edf0 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c054488d39807587 server_cookie=af3b34cc7324a98c in_seq=0 out_seq=0 2023-07-21T23:03:36.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.562+0000 7f4d82ff5700 10 client.19698 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.563+0000 7f4d82ff5700 1 -- 172.21.15.151:0/1396087598 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562c0f59ce50 con 0x562c0f67c9e0 2023-07-21T23:03:36.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.563+0000 7f4d82ff5700 10 client.19698 handle_command_reply: tid=0 2023-07-21T23:03:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.563+0000 7f4db8b36b80 1 client.19698 shutdown 2023-07-21T23:03:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.563+0000 7f4db8b36b80 1 -- 172.21.15.151:0/1396087598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660a20 msgr2=0x562c0f666e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:36.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.563+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660a20 0x562c0f666e40 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f4d94004790 tx=0x7f4d9400ec70 comp rx=0 tx=0).stop 2023-07-21T23:03:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.564+0000 7f4db8b36b80 1 -- 172.21.15.151:0/1396087598 shutdown_connections 2023-07-21T23:03:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.564+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562c0f67c9e0 0x562c0f67edf0 crc :-1 s=READY pgs=495 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.564+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f4ae6b0 0x562c0f666900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.564+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f664d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.564+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/1396087598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f660a20 0x562c0f666e40 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.564+0000 7f4db8b36b80 1 -- 172.21.15.151:0/1396087598 >> 172.21.15.151:0/1396087598 conn(0x562c0f647ae0 msgr2=0x562c0f64c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.564+0000 7f4d82ff5700 0 client.19698 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.564+0000 7f4db8b36b80 1 -- 172.21.15.151:0/1396087598 shutdown_connections 2023-07-21T23:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.564+0000 7f4db8b36b80 1 -- 172.21.15.151:0/1396087598 wait complete. 2023-07-21T23:03:36.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.565+0000 7f4db8b36b80 20 client.19698 trim_cache size 0 max 16384 2023-07-21T23:03:36.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.594+0000 7f4db8b36b80 1 Processor -- start 2023-07-21T23:03:36.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.597+0000 7f4db8b36b80 1 -- start start 2023-07-21T23:03:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.597+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f4ae6b0 0x562c0f652f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.597+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 0x562c0f64cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.597+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f64d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.598+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f6630b0 con 0x562c0f4ae6b0 2023-07-21T23:03:36.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.598+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f64d5e0 con 0x562c0f660a20 2023-07-21T23:03:36.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.598+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f65f790 con 0x562c0f660e70 2023-07-21T23:03:36.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.599+0000 7f4d9f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f64d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.599+0000 7f4d9e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 0x562c0f64cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.600+0000 7f4d9e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 0x562c0f64cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55944/0 (socket says 172.21.15.151:55944) 2023-07-21T23:03:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.600+0000 7f4d9e59c700 1 -- 172.21.15.151:0/3791700420 learned_addr learned my addr 172.21.15.151:0/3791700420 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:36.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.600+0000 7f4d9e59c700 1 -- 172.21.15.151:0/3791700420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 msgr2=0x562c0f64d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.600+0000 7f4d9e59c700 1 --2- 172.21.15.151:0/3791700420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f64d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.600+0000 7f4d9e59c700 1 -- 172.21.15.151:0/3791700420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f4ae6b0 msgr2=0x562c0f652f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.600+0000 7f4d9e59c700 1 --2- 172.21.15.151:0/3791700420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f4ae6b0 0x562c0f652f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.600+0000 7f4d9e59c700 1 -- 172.21.15.151:0/3791700420 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562c0f3f81f0 con 0x562c0f660a20 2023-07-21T23:03:36.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.601+0000 7f4d9e59c700 1 --2- 172.21.15.151:0/3791700420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 0x562c0f64cb60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009e70 tx=0x7f4d9400ef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5af1c422017bf39 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.601+0000 7f4d85ffb700 1 -- 172.21.15.151:0/3791700420 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d940237f0 con 0x562c0f660a20 2023-07-21T23:03:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.601+0000 7f4d85ffb700 1 -- 172.21.15.151:0/3791700420 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d940137f0 con 0x562c0f660a20 2023-07-21T23:03:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.601+0000 7f4d85ffb700 1 -- 172.21.15.151:0/3791700420 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d94006de0 con 0x562c0f660a20 2023-07-21T23:03:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.602+0000 7f4db8b36b80 1 -- 172.21.15.151:0/3791700420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 msgr2=0x562c0f64cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:36.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.602+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/3791700420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 0x562c0f64cb60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f4d94009e70 tx=0x7f4d9400ef90 comp rx=0 tx=0).stop 2023-07-21T23:03:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.602+0000 7f4db8b36b80 1 -- 172.21.15.151:0/3791700420 shutdown_connections 2023-07-21T23:03:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.602+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/3791700420 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f64d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.602+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/3791700420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f4ae6b0 0x562c0f652f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.602+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/3791700420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 0x562c0f64cb60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.602+0000 7f4db8b36b80 1 -- 172.21.15.151:0/3791700420 >> 172.21.15.151:0/3791700420 conn(0x562c0f647ae0 msgr2=0x562c0f65df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.603+0000 7f4db8b36b80 1 -- 172.21.15.151:0/3791700420 shutdown_connections 2023-07-21T23:03:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.603+0000 7f4db8b36b80 1 -- 172.21.15.151:0/3791700420 wait complete. 2023-07-21T23:03:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.603+0000 7f4db8b36b80 1 -- start start 2023-07-21T23:03:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.604+0000 7f4db8b36b80 1 Processor -- start 2023-07-21T23:03:36.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.604+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f4ae6b0 0x562c0f6c49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.604+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 0x562c0f6c4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.604+0000 7f4db8b36b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f6cf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.604+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f6cfdb0 con 0x562c0f4ae6b0 2023-07-21T23:03:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.604+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f6cfef0 con 0x562c0f660a20 2023-07-21T23:03:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.604+0000 7f4db8b36b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562c0f6d00b0 con 0x562c0f660e70 2023-07-21T23:03:36.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.604+0000 7f4db8b36b80 10 client.0 _ll_register_callbacks cb 0x7f4d94009970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:03:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.605+0000 7f4d9f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f6cf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.605+0000 7f4d9f59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f6cf870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34754/0 (socket says 172.21.15.151:34754) 2023-07-21T23:03:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.605+0000 7f4d9f59e700 1 -- 172.21.15.151:0/2549198346 learned_addr learned my addr 172.21.15.151:0/2549198346 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.605+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f4ae6b0 0x562c0f6c49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.605+0000 7f4d9f59e700 1 -- 172.21.15.151:0/2549198346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 msgr2=0x562c0f6c4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.605+0000 7f4d9f59e700 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 0x562c0f6c4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.605+0000 7f4d9f59e700 1 -- 172.21.15.151:0/2549198346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f4ae6b0 msgr2=0x562c0f6c49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.605+0000 7f4d9f59e700 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f4ae6b0 0x562c0f6c49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.605+0000 7f4d9f59e700 1 -- 172.21.15.151:0/2549198346 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562c0f3bac00 con 0x562c0f660e70 2023-07-21T23:03:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.606+0000 7f4d9f59e700 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f6cf870 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4d98006240 tx=0x7f4d98004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d0501ed53717359 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.606+0000 7f4d82ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:03:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.606+0000 7f4d82ff5700 1 -- 172.21.15.151:0/2549198346 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9800aea0 con 0x562c0f660e70 2023-07-21T23:03:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.606+0000 7f4d82ff5700 1 -- 172.21.15.151:0/2549198346 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4d98015d70 con 0x562c0f660e70 2023-07-21T23:03:36.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.607+0000 7f4db8b36b80 1 -- 172.21.15.151:0/2549198346 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4d9400ee20 con 0x562c0f660e70 2023-07-21T23:03:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.607+0000 7f4d82ff5700 1 -- 172.21.15.151:0/2549198346 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4d9802c450 con 0x562c0f660e70 2023-07-21T23:03:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.607+0000 7f4db8b36b80 10 client.29398 fetch_fsmap learned FSMap version 116 2023-07-21T23:03:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.607+0000 7f4db8b36b80 1 -- 172.21.15.151:0/2549198346 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x562c0f3d0250 con 0x562c0f660e70 2023-07-21T23:03:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.607+0000 7f4d82ff5700 1 -- 172.21.15.151:0/2549198346 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4d9400ee20 con 0x562c0f660e70 2023-07-21T23:03:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.608+0000 7f4d82ff5700 1 -- 172.21.15.151:0/2549198346 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4d98022670 con 0x562c0f660e70 2023-07-21T23:03:36.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.608+0000 7f4db8b36b80 10 client.29398 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:03:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.608+0000 7f4db8b36b80 10 client.29398 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:03:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.608+0000 7f4db8b36b80 20 client.29398 populate_metadata read hostname 'smithi151' 2023-07-21T23:03:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.608+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562c0f6d1890 0x562c0f6d3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.609+0000 7f4db8b36b80 4 client.29398 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:03:36.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.609+0000 7f4db8b36b80 1 -- 172.21.15.151:0/2549198346 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562c0f55eff0 con 0x562c0f6d1890 2023-07-21T23:03:36.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.613+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562c0f6d1890 0x562c0f6d3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:36.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.614+0000 7f4d9ed9d700 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562c0f6d1890 0x562c0f6d3ca0 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e4ce6711c2bafc server_cookie=861f359bbd766691 in_seq=0 out_seq=0 2023-07-21T23:03:36.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.614+0000 7f4d82ff5700 10 client.29398 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.648+0000 7f4d82ff5700 1 -- 172.21.15.151:0/2549198346 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562c0f55eff0 con 0x562c0f6d1890 2023-07-21T23:03:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.648+0000 7f4d82ff5700 10 client.29398 handle_command_reply: tid=0 2023-07-21T23:03:36.685 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.648+0000 7f4db8b36b80 1 client.29398 shutdown 2023-07-21T23:03:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.649+0000 7f4db8b36b80 1 -- 172.21.15.151:0/2549198346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 msgr2=0x562c0f6cf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.649+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f6cf870 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4d98006240 tx=0x7f4d98004b40 comp rx=0 tx=0).stop 2023-07-21T23:03:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.649+0000 7f4db8b36b80 1 -- 172.21.15.151:0/2549198346 shutdown_connections 2023-07-21T23:03:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.649+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562c0f6d1890 0x562c0f6d3ca0 crc :-1 s=READY pgs=496 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.649+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562c0f660e70 0x562c0f6cf870 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.649+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562c0f4ae6b0 0x562c0f6c49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.649+0000 7f4db8b36b80 1 --2- 172.21.15.151:0/2549198346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562c0f660a20 0x562c0f6c4f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.686 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.649+0000 7f4db8b36b80 1 -- 172.21.15.151:0/2549198346 >> 172.21.15.151:0/2549198346 conn(0x562c0f647ae0 msgr2=0x562c0f6666d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:36.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.649+0000 7f4d82ff5700 0 client.29398 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:36.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.658+0000 7f4db8b36b80 1 -- 172.21.15.151:0/2549198346 shutdown_connections 2023-07-21T23:03:36.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.664+0000 7f4db8b36b80 1 -- 172.21.15.151:0/2549198346 wait complete. 2023-07-21T23:03:36.700 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.667+0000 7f4db8b36b80 20 client.29398 trim_cache size 0 max 16384 2023-07-21T23:03:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:03:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:03:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:03:36.701 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:03:36.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 -- 172.21.15.151:0/1108098212 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d880a14d0 msgr2=0x7f4d880a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:36.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d880a14d0 0x7f4d880a3980 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4d980095a0 tx=0x7f4d9800c040 comp rx=0 tx=0).stop 2023-07-21T23:03:36.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 -- 172.21.15.151:0/1108098212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da00fe220 msgr2=0x7f4da006bba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:36.704 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da00fe220 0x7f4da006bba0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000d880 tx=0x7f4d90012ad0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.705 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 -- 172.21.15.151:0/1108098212 shutdown_connections 2023-07-21T23:03:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4d880a14d0 0x7f4d880a3980 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da00fe220 0x7f4da006bba0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4da0103260 0x7f4da00716f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 --2- 172.21.15.151:0/1108098212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4da00febc0 0x7f4da006c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:36.706 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.671+0000 7f4da51ff700 1 -- 172.21.15.151:0/1108098212 >> 172.21.15.151:0/1108098212 conn(0x7f4da0073d50 msgr2=0x7f4da00fb970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:36.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.672+0000 7f4da51ff700 1 -- 172.21.15.151:0/1108098212 shutdown_connections 2023-07-21T23:03:36.707 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:36.673+0000 7f4da51ff700 1 -- 172.21.15.151:0/1108098212 wait complete. 2023-07-21T23:03:37.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:37 smithi187 ceph-mon[96918]: pgmap v1415: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.5 MiB/s wr, 891 op/s 2023-07-21T23:03:37.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:37 smithi195 ceph-mon[97365]: pgmap v1415: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.5 MiB/s wr, 891 op/s 2023-07-21T23:03:37.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:37 smithi151 ceph-mon[95510]: pgmap v1415: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 8.5 MiB/s wr, 891 op/s 2023-07-21T23:03:39.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 645.0 s, 327.4 tps, lat 304.767 ms stddev 117.542 2023-07-21T23:03:39.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:39 smithi187 ceph-mon[96918]: pgmap v1416: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-07-21T23:03:39.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:39 smithi195 ceph-mon[97365]: pgmap v1416: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-07-21T23:03:39.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:39 smithi151 ceph-mon[95510]: pgmap v1416: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 12 MiB/s wr, 1.20k op/s 2023-07-21T23:03:41.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:41 smithi187 ceph-mon[96918]: pgmap v1417: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2023-07-21T23:03:41.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:41 smithi195 ceph-mon[97365]: pgmap v1417: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2023-07-21T23:03:41.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:41 smithi151 ceph-mon[95510]: pgmap v1417: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2023-07-21T23:03:43.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:43 smithi187 ceph-mon[96918]: pgmap v1418: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.6 MiB/s wr, 932 op/s 2023-07-21T23:03:43.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:43 smithi195 ceph-mon[97365]: pgmap v1418: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.6 MiB/s wr, 932 op/s 2023-07-21T23:03:43.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:43 smithi151 ceph-mon[95510]: pgmap v1418: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.6 MiB/s wr, 932 op/s 2023-07-21T23:03:44.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 650.0 s, 373.2 tps, lat 265.846 ms stddev 63.267 2023-07-21T23:03:45.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:45 smithi187 ceph-mon[96918]: pgmap v1419: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.42k op/s 2023-07-21T23:03:45.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:45 smithi195 ceph-mon[97365]: pgmap v1419: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.42k op/s 2023-07-21T23:03:45.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:45 smithi151 ceph-mon[95510]: pgmap v1419: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.42k op/s 2023-07-21T23:03:47.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:47 smithi187 ceph-mon[96918]: pgmap v1420: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.1 MiB/s wr, 957 op/s 2023-07-21T23:03:47.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:47 smithi195 ceph-mon[97365]: pgmap v1420: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.1 MiB/s wr, 957 op/s 2023-07-21T23:03:47.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:47 smithi151 ceph-mon[95510]: pgmap v1420: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 9.1 MiB/s wr, 957 op/s 2023-07-21T23:03:49.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 655.0 s, 327.4 tps, lat 308.411 ms stddev 88.448 2023-07-21T23:03:49.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:49 smithi187 ceph-mon[96918]: pgmap v1421: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 1.26k op/s 2023-07-21T23:03:49.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:49 smithi195 ceph-mon[97365]: pgmap v1421: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 1.26k op/s 2023-07-21T23:03:49.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:49 smithi151 ceph-mon[95510]: pgmap v1421: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 13 MiB/s wr, 1.26k op/s 2023-07-21T23:03:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.942+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3053848131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad04108e20 msgr2=0x7fad0410b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.942+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3053848131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad04108e20 0x7fad0410b200 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7facfc00faf0 tx=0x7facfc00fe00 comp rx=0 tx=0).stop 2023-07-21T23:03:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.942+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3053848131 shutdown_connections 2023-07-21T23:03:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.942+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3053848131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad04108e20 0x7fad0410b200 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.977 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.942+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3053848131 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad040fe840 0x7fad04102b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.942+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3053848131 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad041030c0 0x7fad04103530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.942+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3053848131 >> 172.21.15.151:0/3053848131 conn(0x7fad04073d50 msgr2=0x7fad04074150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.943+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3053848131 shutdown_connections 2023-07-21T23:03:49.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.943+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3053848131 wait complete. 2023-07-21T23:03:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.945+0000 7fad0b1ff700 1 Processor -- start 2023-07-21T23:03:49.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.945+0000 7fad0b1ff700 1 -- start start 2023-07-21T23:03:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.947+0000 7fad0b1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad040fe840 0x7fad041aaae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:49.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.947+0000 7fad0b1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad041030c0 0x7fad041ab020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.947+0000 7fad0b1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad04108e20 0x7fad041a4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.947+0000 7fad0b1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041a4fb0 con 0x7fad040fe840 2023-07-21T23:03:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.947+0000 7fad0b1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041a5120 con 0x7fad04108e20 2023-07-21T23:03:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.947+0000 7fad0b1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad041a52e0 con 0x7fad041030c0 2023-07-21T23:03:49.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.947+0000 7fad08f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad040fe840 0x7fad041aaae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.948+0000 7fad08f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad040fe840 0x7fad041aaae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35740/0 (socket says 172.21.15.151:35740) 2023-07-21T23:03:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.948+0000 7fad08f9b700 1 -- 172.21.15.151:0/3502297891 learned_addr learned my addr 172.21.15.151:0/3502297891 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.948+0000 7fad0979c700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad04108e20 0x7fad041a4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:49.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.948+0000 7fad03fff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad041030c0 0x7fad041ab020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.948+0000 7fad03fff700 1 -- 172.21.15.151:0/3502297891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad04108e20 msgr2=0x7fad041a4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.948+0000 7fad03fff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad04108e20 0x7fad041a4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.949+0000 7fad03fff700 1 -- 172.21.15.151:0/3502297891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad040fe840 msgr2=0x7fad041aaae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.949+0000 7fad03fff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad040fe840 0x7fad041aaae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.949+0000 7fad03fff700 1 -- 172.21.15.151:0/3502297891 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc00f750 con 0x7fad041030c0 2023-07-21T23:03:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.949+0000 7fad0979c700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad04108e20 0x7fad041a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:03:49.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.949+0000 7fad03fff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad041030c0 0x7fad041ab020 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7facf000e9f0 tx=0x7facf000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.950+0000 7fad01ffb700 1 -- 172.21.15.151:0/3502297891 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf000c9c0 con 0x7fad041030c0 2023-07-21T23:03:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.950+0000 7fad01ffb700 1 -- 172.21.15.151:0/3502297891 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facf0010430 con 0x7fad041030c0 2023-07-21T23:03:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.950+0000 7fad01ffb700 1 -- 172.21.15.151:0/3502297891 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0018680 con 0x7fad041030c0 2023-07-21T23:03:49.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.950+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3502297891 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad041a55c0 con 0x7fad041030c0 2023-07-21T23:03:49.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.950+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3502297891 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad041b1ad0 con 0x7fad041030c0 2023-07-21T23:03:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.958+0000 7fad1eacbb80 1 Processor -- start 2023-07-21T23:03:49.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.959+0000 7fad01ffb700 1 -- 172.21.15.151:0/3502297891 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7facf00105a0 con 0x7fad041030c0 2023-07-21T23:03:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.960+0000 7fad1eacbb80 1 -- start start 2023-07-21T23:03:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.960+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5859cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.960+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb5853f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:49.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.960+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 0x55ddb58544a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.960+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb5759c50 con 0x55ddb585a210 2023-07-21T23:03:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.960+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb57ac9e0 con 0x55ddb56b06b0 2023-07-21T23:03:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.960+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb57a5e70 con 0x55ddb585a660 2023-07-21T23:03:49.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.961+0000 7fad08f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb5853f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.961+0000 7fad08f9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb5853f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35752/0 (socket says 172.21.15.151:35752) 2023-07-21T23:03:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.961+0000 7fad08f9b700 1 -- 172.21.15.151:0/723853429 learned_addr learned my addr 172.21.15.151:0/723853429 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.961+0000 7fad03fff700 1 --2- 172.21.15.151:0/723853429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 0x55ddb58544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.961+0000 7fad03fff700 1 -- 172.21.15.151:0/723853429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 msgr2=0x55ddb5859cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:03:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.961+0000 7fad03fff700 1 --2- 172.21.15.151:0/723853429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5859cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.961+0000 7fad03fff700 1 -- 172.21.15.151:0/723853429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 msgr2=0x55ddb5853f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.961+0000 7fad03fff700 1 --2- 172.21.15.151:0/723853429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb5853f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.962+0000 7fad03fff700 1 -- 172.21.15.151:0/723853429 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddb55d3d80 con 0x55ddb585a660 2023-07-21T23:03:49.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.962+0000 7fad01ffb700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7facf40a1490 0x7facf40a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.962+0000 7fad03fff700 1 --2- 172.21.15.151:0/723853429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 0x55ddb58544a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7facf00ca3e0 tx=0x7facf00d0cb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f07d69cb31673e7f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.963+0000 7fad01ffb700 1 -- 172.21.15.151:0/3502297891 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7facf0014070 con 0x7fad041030c0 2023-07-21T23:03:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.963+0000 7faceeffd700 1 -- 172.21.15.151:0/723853429 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00d0640 con 0x55ddb585a660 2023-07-21T23:03:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.963+0000 7faceeffd700 1 -- 172.21.15.151:0/723853429 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facf00d6040 con 0x55ddb585a660 2023-07-21T23:03:49.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.963+0000 7faceeffd700 1 -- 172.21.15.151:0/723853429 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00998a0 con 0x55ddb585a660 2023-07-21T23:03:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.964+0000 7fad1eacbb80 1 -- 172.21.15.151:0/723853429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 msgr2=0x55ddb58544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.964+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/723853429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 0x55ddb58544a0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7facf00ca3e0 tx=0x7facf00d0cb0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.964+0000 7fad1eacbb80 1 -- 172.21.15.151:0/723853429 shutdown_connections 2023-07-21T23:03:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.964+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/723853429 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5859cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.964+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/723853429 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 0x55ddb58544a0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.964+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/723853429 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb5853f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.964+0000 7fad1eacbb80 1 -- 172.21.15.151:0/723853429 >> 172.21.15.151:0/723853429 conn(0x55ddb5849ae0 msgr2=0x55ddb584f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.965+0000 7fad0979c700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7facf40a1490 0x7facf40a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:49.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.967+0000 7fad1eacbb80 1 -- 172.21.15.151:0/723853429 shutdown_connections 2023-07-21T23:03:50.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.967+0000 7fad1eacbb80 1 -- 172.21.15.151:0/723853429 wait complete. 2023-07-21T23:03:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.968+0000 7fad1eacbb80 1 -- start start 2023-07-21T23:03:50.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.968+0000 7fad1eacbb80 1 Processor -- start 2023-07-21T23:03:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.969+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5860580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.969+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb585d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.969+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 0x55ddb585dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.969+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb5745a60 con 0x55ddb585a210 2023-07-21T23:03:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.969+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb5745760 con 0x55ddb56b06b0 2023-07-21T23:03:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.969+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb56298c0 con 0x55ddb585a660 2023-07-21T23:03:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.969+0000 7fad0979c700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7facf40a1490 0x7facf40a3940 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fad041ab7e0 tx=0x7facfc01b040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:50.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.969+0000 7fad1eacbb80 10 client.0 _ll_register_callbacks cb 0x55ddb5743700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:03:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.970+0000 7fad08f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5860580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:50.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.970+0000 7fad03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb585d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.970+0000 7fad08f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5860580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55608/0 (socket says 172.21.15.151:55608) 2023-07-21T23:03:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.970+0000 7fad03fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb585d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35762/0 (socket says 172.21.15.151:35762) 2023-07-21T23:03:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.970+0000 7fad08f9b700 1 -- 172.21.15.151:0/4097168336 learned_addr learned my addr 172.21.15.151:0/4097168336 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.970+0000 7fad03fff700 1 -- 172.21.15.151:0/4097168336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 msgr2=0x55ddb585dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.970+0000 7fad03fff700 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 0x55ddb585dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.970+0000 7fad03fff700 1 -- 172.21.15.151:0/4097168336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 msgr2=0x55ddb5860580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.970+0000 7fad03fff700 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5860580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.971+0000 7fad03fff700 1 -- 172.21.15.151:0/4097168336 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad041b1ad0 con 0x55ddb585a210 2023-07-21T23:03:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.971+0000 7fad08f9b700 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5860580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:03:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.971+0000 7fad03fff700 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb585d790 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7facf0096260 tx=0x7facf0009ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba187f14545627f server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.971+0000 7face3fff700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:03:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.971+0000 7face3fff700 1 -- 172.21.15.151:0/4097168336 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00d5040 con 0x55ddb585a210 2023-07-21T23:03:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.971+0000 7face3fff700 1 -- 172.21.15.151:0/4097168336 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7facf0010880 con 0x55ddb585a210 2023-07-21T23:03:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.972+0000 7fad1eacbb80 1 -- 172.21.15.151:0/4097168336 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ddb56ff490 con 0x55ddb585a210 2023-07-21T23:03:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.972+0000 7face3fff700 1 -- 172.21.15.151:0/4097168336 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7facf00d0640 con 0x55ddb585a210 2023-07-21T23:03:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.972+0000 7fad1eacbb80 10 client.19710 fetch_fsmap learned FSMap version 116 2023-07-21T23:03:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.972+0000 7fad1eacbb80 1 -- 172.21.15.151:0/4097168336 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55ddb55bcc00 con 0x55ddb585a210 2023-07-21T23:03:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.972+0000 7face3fff700 1 -- 172.21.15.151:0/4097168336 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ddb56ff490 con 0x55ddb585a210 2023-07-21T23:03:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.973+0000 7face3fff700 1 -- 172.21.15.151:0/4097168336 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7facf00c9f60 con 0x55ddb585a210 2023-07-21T23:03:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.973+0000 7fad1eacbb80 10 client.19710 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:03:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.973+0000 7fad1eacbb80 10 client.19710 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:03:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.973+0000 7fad1eacbb80 20 client.19710 populate_metadata read hostname 'smithi151' 2023-07-21T23:03:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.973+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ddb587e730 0x55ddb5880b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.973+0000 7fad1eacbb80 4 client.19710 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:03:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.973+0000 7fad1eacbb80 1 -- 172.21.15.151:0/4097168336 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ddb579ee50 con 0x55ddb587e730 2023-07-21T23:03:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.973+0000 7fad08f9b700 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ddb587e730 0x55ddb5880b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:50.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.974+0000 7fad08f9b700 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ddb587e730 0x55ddb5880b40 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=79bf5e1b9e7b4d39 server_cookie=c27c25b4bf319ba8 in_seq=0 out_seq=0 2023-07-21T23:03:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.974+0000 7face3fff700 10 client.19710 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7face3fff700 1 -- 172.21.15.151:0/4097168336 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ddb579ee50 con 0x55ddb587e730 2023-07-21T23:03:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7face3fff700 10 client.19710 handle_command_reply: tid=0 2023-07-21T23:03:50.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7fad1eacbb80 1 client.19710 shutdown 2023-07-21T23:03:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7fad1eacbb80 1 -- 172.21.15.151:0/4097168336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 msgr2=0x55ddb585d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:50.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb585d790 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7facf0096260 tx=0x7facf0009ef0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7fad1eacbb80 1 -- 172.21.15.151:0/4097168336 shutdown_connections 2023-07-21T23:03:50.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ddb587e730 0x55ddb5880b40 crc :-1 s=READY pgs=497 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5860580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a660 0x55ddb585dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.013 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/4097168336 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a210 0x55ddb585d790 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7fad1eacbb80 1 -- 172.21.15.151:0/4097168336 >> 172.21.15.151:0/4097168336 conn(0x55ddb5849ae0 msgr2=0x55ddb584e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.975+0000 7face3fff700 0 client.19710 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.976+0000 7fad1eacbb80 1 -- 172.21.15.151:0/4097168336 shutdown_connections 2023-07-21T23:03:50.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.976+0000 7fad1eacbb80 1 -- 172.21.15.151:0/4097168336 wait complete. 2023-07-21T23:03:50.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:49.976+0000 7fad1eacbb80 20 client.19710 trim_cache size 0 max 16384 2023-07-21T23:03:50.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.002+0000 7fad1eacbb80 1 Processor -- start 2023-07-21T23:03:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.004+0000 7fad1eacbb80 1 -- start start 2023-07-21T23:03:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.004+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb56b06b0 0x55ddb5853f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.004+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb585a210 0x55ddb5875c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.037 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.004+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 0x55ddb585cf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.004+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb5850900 con 0x55ddb585a660 2023-07-21T23:03:50.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.004+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb579ee50 con 0x55ddb585a210 2023-07-21T23:03:50.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.004+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb585e3a0 con 0x55ddb56b06b0 2023-07-21T23:03:50.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.005+0000 7fad03fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb585a210 0x55ddb5875c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:50.038 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.005+0000 7fad03fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb585a210 0x55ddb5875c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55618/0 (socket says 172.21.15.151:55618) 2023-07-21T23:03:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.005+0000 7fad03fff700 1 -- 172.21.15.151:0/1118587726 learned_addr learned my addr 172.21.15.151:0/1118587726 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:50.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.005+0000 7fad0979c700 1 --2- 172.21.15.151:0/1118587726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 0x55ddb585cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.006+0000 7fad03fff700 1 -- 172.21.15.151:0/1118587726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb56b06b0 msgr2=0x55ddb5853f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:03:50.040 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.006+0000 7fad03fff700 1 --2- 172.21.15.151:0/1118587726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb56b06b0 0x55ddb5853f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.006+0000 7fad03fff700 1 -- 172.21.15.151:0/1118587726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 msgr2=0x55ddb585cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:50.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.006+0000 7fad03fff700 1 --2- 172.21.15.151:0/1118587726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 0x55ddb585cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.007+0000 7fad03fff700 1 -- 172.21.15.151:0/1118587726 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ddb55fa1f0 con 0x55ddb585a210 2023-07-21T23:03:50.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.007+0000 7fad0979c700 1 --2- 172.21.15.151:0/1118587726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 0x55ddb585cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:03:50.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.007+0000 7fad03fff700 1 --2- 172.21.15.151:0/1118587726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb585a210 0x55ddb5875c40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7facf00980b0 tx=0x7facf0098310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd59159e51d32abb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:50.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.007+0000 7facef7fe700 1 -- 172.21.15.151:0/1118587726 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00d5040 con 0x55ddb585a210 2023-07-21T23:03:50.041 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.007+0000 7facef7fe700 1 -- 172.21.15.151:0/1118587726 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facf009de10 con 0x55ddb585a210 2023-07-21T23:03:50.042 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.007+0000 7facef7fe700 1 -- 172.21.15.151:0/1118587726 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf00960a0 con 0x55ddb585a210 2023-07-21T23:03:50.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.008+0000 7fad1eacbb80 1 -- 172.21.15.151:0/1118587726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb585a210 msgr2=0x55ddb5875c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:50.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.008+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/1118587726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb585a210 0x55ddb5875c40 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7facf00980b0 tx=0x7facf0098310 comp rx=0 tx=0).stop 2023-07-21T23:03:50.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.009+0000 7fad1eacbb80 1 -- 172.21.15.151:0/1118587726 shutdown_connections 2023-07-21T23:03:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.009+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/1118587726 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 0x55ddb585cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.009+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/1118587726 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb56b06b0 0x55ddb5853f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.009+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/1118587726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb585a210 0x55ddb5875c40 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.009+0000 7fad1eacbb80 1 -- 172.21.15.151:0/1118587726 >> 172.21.15.151:0/1118587726 conn(0x55ddb5849ae0 msgr2=0x55ddb584ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.009+0000 7fad1eacbb80 1 -- 172.21.15.151:0/1118587726 shutdown_connections 2023-07-21T23:03:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.009+0000 7fad1eacbb80 1 -- 172.21.15.151:0/1118587726 wait complete. 2023-07-21T23:03:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.010+0000 7fad1eacbb80 1 -- start start 2023-07-21T23:03:50.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.010+0000 7fad1eacbb80 1 Processor -- start 2023-07-21T23:03:50.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.011+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5855730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.011+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a210 0x55ddb5855c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.011+0000 7fad1eacbb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 0x55ddb58561b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.011+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb58566f0 con 0x55ddb585a660 2023-07-21T23:03:50.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.011+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb5856860 con 0x55ddb56b06b0 2023-07-21T23:03:50.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.011+0000 7fad1eacbb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ddb5856a20 con 0x55ddb585a210 2023-07-21T23:03:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.011+0000 7fad1eacbb80 10 client.0 _ll_register_callbacks cb 0x7facf8014b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:03:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.012+0000 7fad08f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5855730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.012+0000 7fad08f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5855730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55630/0 (socket says 172.21.15.151:55630) 2023-07-21T23:03:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.012+0000 7fad08f9b700 1 -- 172.21.15.151:0/3428304967 learned_addr learned my addr 172.21.15.151:0/3428304967 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:03:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.012+0000 7fad03fff700 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a210 0x55ddb5855c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:50.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.013+0000 7fad0979c700 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 0x55ddb58561b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.013+0000 7fad03fff700 1 -- 172.21.15.151:0/3428304967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 msgr2=0x55ddb5855730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.013+0000 7fad03fff700 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5855730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.013+0000 7fad03fff700 1 -- 172.21.15.151:0/3428304967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 msgr2=0x55ddb58561b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:03:50.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.013+0000 7fad03fff700 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 0x55ddb58561b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.013+0000 7fad03fff700 1 -- 172.21.15.151:0/3428304967 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad040fe4a0 con 0x55ddb585a210 2023-07-21T23:03:50.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.014+0000 7fad03fff700 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a210 0x55ddb5855c70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7facf00980b0 tx=0x7facf00d52c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b49e87ef556f1d3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:03:50.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.014+0000 7face3fff700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:03:50.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.014+0000 7face3fff700 1 -- 172.21.15.151:0/3428304967 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facf0099b30 con 0x55ddb585a210 2023-07-21T23:03:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.014+0000 7face3fff700 1 -- 172.21.15.151:0/3428304967 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7facf0010880 con 0x55ddb585a210 2023-07-21T23:03:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.014+0000 7fad1eacbb80 1 -- 172.21.15.151:0/3428304967 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7facf00d6040 con 0x55ddb585a210 2023-07-21T23:03:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.015+0000 7face3fff700 1 -- 172.21.15.151:0/3428304967 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7facf00d5040 con 0x55ddb585a210 2023-07-21T23:03:50.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.015+0000 7fad1eacbb80 10 client.29410 fetch_fsmap learned FSMap version 116 2023-07-21T23:03:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.015+0000 7fad1eacbb80 1 -- 172.21.15.151:0/3428304967 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55ddb55bcc00 con 0x55ddb585a210 2023-07-21T23:03:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.016+0000 7face3fff700 1 -- 172.21.15.151:0/3428304967 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7facf00bf080 con 0x55ddb585a210 2023-07-21T23:03:50.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.016+0000 7face3fff700 1 -- 172.21.15.151:0/3428304967 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7facf00a1d20 con 0x55ddb585a210 2023-07-21T23:03:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.016+0000 7fad1eacbb80 10 client.29410 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:03:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.016+0000 7fad1eacbb80 10 client.29410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:03:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.016+0000 7fad1eacbb80 20 client.29410 populate_metadata read hostname 'smithi151' 2023-07-21T23:03:50.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.016+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ddb58f4ab0 0x55ddb58f6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:03:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.016+0000 7fad1eacbb80 4 client.29410 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:03:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.016+0000 7fad1eacbb80 1 -- 172.21.15.151:0/3428304967 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ddb5760ff0 con 0x55ddb58f4ab0 2023-07-21T23:03:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.017+0000 7fad08f9b700 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ddb58f4ab0 0x55ddb58f6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:03:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.018+0000 7fad08f9b700 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ddb58f4ab0 0x55ddb58f6e90 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c91d61d92b93b282 server_cookie=df234ca1106e408f in_seq=0 out_seq=0 2023-07-21T23:03:50.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.018+0000 7face3fff700 10 client.29410 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7face3fff700 1 -- 172.21.15.151:0/3428304967 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ddb5760ff0 con 0x55ddb58f4ab0 2023-07-21T23:03:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7face3fff700 10 client.29410 handle_command_reply: tid=0 2023-07-21T23:03:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 client.29410 shutdown 2023-07-21T23:03:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 -- 172.21.15.151:0/3428304967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a210 msgr2=0x55ddb5855c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:50.102 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a210 0x55ddb5855c70 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7facf00980b0 tx=0x7facf00d52c0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 -- 172.21.15.151:0/3428304967 shutdown_connections 2023-07-21T23:03:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ddb58f4ab0 0x55ddb58f6e90 crc :-1 s=READY pgs=498 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ddb56b06b0 0x55ddb5855730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7face3fff700 0 client.29410 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:03:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ddb585a660 0x55ddb58561b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 --2- 172.21.15.151:0/3428304967 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ddb585a210 0x55ddb5855c70 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.103 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 -- 172.21.15.151:0/3428304967 >> 172.21.15.151:0/3428304967 conn(0x55ddb5849ae0 msgr2=0x55ddb584ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 -- 172.21.15.151:0/3428304967 shutdown_connections 2023-07-21T23:03:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.069+0000 7fad1eacbb80 1 -- 172.21.15.151:0/3428304967 wait complete. 2023-07-21T23:03:50.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.070+0000 7fad1eacbb80 20 client.29410 trim_cache size 0 max 16384 2023-07-21T23:03:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:03:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:03:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:03:50.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:03:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.070+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3502297891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7facf40a1490 msgr2=0x7facf40a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.070+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7facf40a1490 0x7facf40a3940 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fad041ab7e0 tx=0x7facfc01b040 comp rx=0 tx=0).stop 2023-07-21T23:03:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.070+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3502297891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad041030c0 msgr2=0x7fad041ab020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:03:50.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.070+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad041030c0 0x7fad041ab020 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7facf000e9f0 tx=0x7facf000ed00 comp rx=0 tx=0).stop 2023-07-21T23:03:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.071+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3502297891 shutdown_connections 2023-07-21T23:03:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.071+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7facf40a1490 0x7facf40a3940 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.071+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad04108e20 0x7fad041a4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.071+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad040fe840 0x7fad041aaae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.071+0000 7fad0b1ff700 1 --2- 172.21.15.151:0/3502297891 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fad041030c0 0x7fad041ab020 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:03:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.071+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3502297891 >> 172.21.15.151:0/3502297891 conn(0x7fad04073d50 msgr2=0x7fad040fb930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:03:50.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.071+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3502297891 shutdown_connections 2023-07-21T23:03:50.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:03:50.071+0000 7fad0b1ff700 1 -- 172.21.15.151:0/3502297891 wait complete. 2023-07-21T23:03:51.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:51 smithi151 ceph-mon[95510]: pgmap v1422: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.12k op/s 2023-07-21T23:03:51.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:51 smithi187 ceph-mon[96918]: pgmap v1422: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.12k op/s 2023-07-21T23:03:51.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:51 smithi195 ceph-mon[97365]: pgmap v1422: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.12k op/s 2023-07-21T23:03:53.369 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:53 smithi187 ceph-mon[96918]: pgmap v1423: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.4 MiB/s wr, 958 op/s 2023-07-21T23:03:53.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:53 smithi195 ceph-mon[97365]: pgmap v1423: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.4 MiB/s wr, 958 op/s 2023-07-21T23:03:53.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:53 smithi151 ceph-mon[95510]: pgmap v1423: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 9.4 MiB/s wr, 958 op/s 2023-07-21T23:03:54.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 660.0 s, 378.8 tps, lat 262.244 ms stddev 123.507 2023-07-21T23:03:55.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:55 smithi187 ceph-mon[96918]: pgmap v1424: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:03:55.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:55 smithi195 ceph-mon[97365]: pgmap v1424: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:03:55.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:55 smithi151 ceph-mon[95510]: pgmap v1424: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:03:57.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:57 smithi187 ceph-mon[96918]: pgmap v1425: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.5 MiB/s wr, 958 op/s 2023-07-21T23:03:57.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:57 smithi195 ceph-mon[97365]: pgmap v1425: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.5 MiB/s wr, 958 op/s 2023-07-21T23:03:57.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:57 smithi151 ceph-mon[95510]: pgmap v1425: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.5 MiB/s wr, 958 op/s 2023-07-21T23:03:59.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 665.0 s, 390.7 tps, lat 256.058 ms stddev 66.333 2023-07-21T23:03:59.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:03:59 smithi187 ceph-mon[96918]: pgmap v1426: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.27k op/s 2023-07-21T23:03:59.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:03:59 smithi195 ceph-mon[97365]: pgmap v1426: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.27k op/s 2023-07-21T23:03:59.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:03:59 smithi151 ceph-mon[95510]: pgmap v1426: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 13 MiB/s wr, 1.27k op/s 2023-07-21T23:04:01.370 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:01 smithi187 ceph-mon[96918]: pgmap v1427: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-07-21T23:04:01.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:01 smithi195 ceph-mon[97365]: pgmap v1427: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-07-21T23:04:01.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:01 smithi151 ceph-mon[95510]: pgmap v1427: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-07-21T23:04:03.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.332+0000 7fd255fff700 1 -- 172.21.15.151:0/2056678643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd25010c540 msgr2=0x7fd25010e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:03.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.332+0000 7fd255fff700 1 --2- 172.21.15.151:0/2056678643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd25010c540 0x7fd25010e920 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fd248009f90 tx=0x7fd24800b330 comp rx=0 tx=0).stop 2023-07-21T23:04:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.332+0000 7fd255fff700 1 -- 172.21.15.151:0/2056678643 shutdown_connections 2023-07-21T23:04:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.332+0000 7fd255fff700 1 --2- 172.21.15.151:0/2056678643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd25010c540 0x7fd25010e920 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.332+0000 7fd255fff700 1 --2- 172.21.15.151:0/2056678643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2500679a0 0x7fd250067d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.332+0000 7fd255fff700 1 --2- 172.21.15.151:0/2056678643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2500682b0 0x7fd25010c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.332+0000 7fd255fff700 1 -- 172.21.15.151:0/2056678643 >> 172.21.15.151:0/2056678643 conn(0x7fd250074760 msgr2=0x7fd250074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.333+0000 7fd255fff700 1 -- 172.21.15.151:0/2056678643 shutdown_connections 2023-07-21T23:04:03.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.333+0000 7fd255fff700 1 -- 172.21.15.151:0/2056678643 wait complete. 2023-07-21T23:04:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.334+0000 7fd255fff700 1 Processor -- start 2023-07-21T23:04:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.334+0000 7fd255fff700 1 -- start start 2023-07-21T23:04:03.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.335+0000 7fd255fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2500679a0 0x7fd250197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.335+0000 7fd255fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2500682b0 0x7fd2501983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.335+0000 7fd255fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd25010c540 0x7fd25019ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.335+0000 7fd255fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25019d080 con 0x7fd25010c540 2023-07-21T23:04:03.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.335+0000 7fd255fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25019d1f0 con 0x7fd2500679a0 2023-07-21T23:04:03.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.335+0000 7fd255fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd25019d3b0 con 0x7fd2500682b0 2023-07-21T23:04:03.370 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:03 smithi187 ceph-mon[96918]: pgmap v1428: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.4 MiB/s wr, 981 op/s 2023-07-21T23:04:03.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.335+0000 7fd24f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2500679a0 0x7fd250197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.336+0000 7fd24f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2500679a0 0x7fd250197e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:48004/0 (socket says 172.21.15.151:48004) 2023-07-21T23:04:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.336+0000 7fd24f7fe700 1 -- 172.21.15.151:0/2495433522 learned_addr learned my addr 172.21.15.151:0/2495433522 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:03.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.336+0000 7fd24ffff700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd25010c540 0x7fd25019ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.336+0000 7fd247fff700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2500682b0 0x7fd2501983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.336+0000 7fd24f7fe700 1 -- 172.21.15.151:0/2495433522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2500682b0 msgr2=0x7fd2501983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.336+0000 7fd24f7fe700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2500682b0 0x7fd2501983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.336+0000 7fd24f7fe700 1 -- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd25010c540 msgr2=0x7fd25019ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.336+0000 7fd24f7fe700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd25010c540 0x7fd25019ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.336+0000 7fd24f7fe700 1 -- 172.21.15.151:0/2495433522 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd248009c40 con 0x7fd2500679a0 2023-07-21T23:04:03.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.337+0000 7fd24f7fe700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2500679a0 0x7fd250197e90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd24000e9c0 tx=0x7fd24000ecd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.337+0000 7fd24d7fa700 1 -- 172.21.15.151:0/2495433522 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240004a30 con 0x7fd2500679a0 2023-07-21T23:04:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.337+0000 7fd24d7fa700 1 -- 172.21.15.151:0/2495433522 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd24000cc50 con 0x7fd2500679a0 2023-07-21T23:04:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.337+0000 7fd255fff700 1 -- 172.21.15.151:0/2495433522 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd25019d690 con 0x7fd2500679a0 2023-07-21T23:04:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.337+0000 7fd24d7fa700 1 -- 172.21.15.151:0/2495433522 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd240005410 con 0x7fd2500679a0 2023-07-21T23:04:03.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.337+0000 7fd255fff700 1 -- 172.21.15.151:0/2495433522 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2501a4ed0 con 0x7fd2500679a0 2023-07-21T23:04:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.343+0000 7fd24d7fa700 1 -- 172.21.15.151:0/2495433522 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fd240005570 con 0x7fd2500679a0 2023-07-21T23:04:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.343+0000 7fd269876b80 1 Processor -- start 2023-07-21T23:04:03.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.344+0000 7fd269876b80 1 -- start start 2023-07-21T23:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.344+0000 7fd269876b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad04df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.344+0000 7fd269876b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ad05330 0x55577acfcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.344+0000 7fd269876b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 0x55577acfd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.344+0000 7fd269876b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577ac05c50 con 0x55577ad05330 2023-07-21T23:04:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.344+0000 7fd269876b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577ac589e0 con 0x55577acfd460 2023-07-21T23:04:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.344+0000 7fd269876b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577ac51e70 con 0x55577ab5c6b0 2023-07-21T23:04:03.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.345+0000 7fd24ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad04df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.345+0000 7fd24ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad04df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52376/0 (socket says 172.21.15.151:52376) 2023-07-21T23:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.345+0000 7fd24ffff700 1 -- 172.21.15.151:0/104585706 learned_addr learned my addr 172.21.15.151:0/104585706 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.345+0000 7fd247fff700 1 --2- 172.21.15.151:0/104585706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 0x55577acfd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.345+0000 7fd24ffff700 1 -- 172.21.15.151:0/104585706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 msgr2=0x55577acfd8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.345+0000 7fd24ffff700 1 --2- 172.21.15.151:0/104585706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 0x55577acfd8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.346+0000 7fd24ffff700 1 -- 172.21.15.151:0/104585706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ad05330 msgr2=0x55577acfcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.346+0000 7fd24ffff700 1 --2- 172.21.15.151:0/104585706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ad05330 0x55577acfcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.346+0000 7fd24ffff700 1 -- 172.21.15.151:0/104585706 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55577aa7fd80 con 0x55577ab5c6b0 2023-07-21T23:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.346+0000 7fd24ffff700 1 --2- 172.21.15.151:0/104585706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad04df0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd248009b60 tx=0x7fd248009b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67447b1464c8c399 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:03.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.346+0000 7fd24d7fa700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd23c0a13c0 0x7fd23c0a3870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.347+0000 7fd24d7fa700 1 -- 172.21.15.151:0/2495433522 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd240014070 con 0x7fd2500679a0 2023-07-21T23:04:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.348+0000 7fd24f7fe700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd23c0a13c0 0x7fd23c0a3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.349+0000 7fd24f7fe700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd23c0a13c0 0x7fd23c0a3870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55577ad05700 tx=0x7fd240096170 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.352+0000 7fd245ffb700 1 -- 172.21.15.151:0/104585706 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800e040 con 0x55577ab5c6b0 2023-07-21T23:04:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.352+0000 7fd245ffb700 1 -- 172.21.15.151:0/104585706 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd248007720 con 0x55577ab5c6b0 2023-07-21T23:04:03.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.352+0000 7fd245ffb700 1 -- 172.21.15.151:0/104585706 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800bc70 con 0x55577ab5c6b0 2023-07-21T23:04:03.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.353+0000 7fd269876b80 1 -- 172.21.15.151:0/104585706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 msgr2=0x55577ad04df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:03.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.353+0000 7fd269876b80 1 --2- 172.21.15.151:0/104585706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad04df0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd248009b60 tx=0x7fd248009b90 comp rx=0 tx=0).stop 2023-07-21T23:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.355+0000 7fd269876b80 1 -- 172.21.15.151:0/104585706 shutdown_connections 2023-07-21T23:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.355+0000 7fd269876b80 1 --2- 172.21.15.151:0/104585706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 0x55577acfd8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.355+0000 7fd269876b80 1 --2- 172.21.15.151:0/104585706 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad04df0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.355+0000 7fd269876b80 1 --2- 172.21.15.151:0/104585706 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ad05330 0x55577acfcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.355+0000 7fd269876b80 1 -- 172.21.15.151:0/104585706 >> 172.21.15.151:0/104585706 conn(0x55577acf5ae0 msgr2=0x55577acfb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:03.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.356+0000 7fd269876b80 1 -- 172.21.15.151:0/104585706 shutdown_connections 2023-07-21T23:04:03.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.357+0000 7fd269876b80 1 -- 172.21.15.151:0/104585706 wait complete. 2023-07-21T23:04:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.357+0000 7fd269876b80 1 -- start start 2023-07-21T23:04:03.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.358+0000 7fd269876b80 1 Processor -- start 2023-07-21T23:04:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.359+0000 7fd269876b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad1d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.359+0000 7fd269876b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577acfd460 0x55577ad1a420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.359+0000 7fd269876b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 0x55577ad1aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.359+0000 7fd269876b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577abf1a60 con 0x55577acfd460 2023-07-21T23:04:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.359+0000 7fd269876b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577abf1760 con 0x55577ad05330 2023-07-21T23:04:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.359+0000 7fd269876b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577aad58c0 con 0x55577ab5c6b0 2023-07-21T23:04:03.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.359+0000 7fd269876b80 10 client.0 _ll_register_callbacks cb 0x55577abef700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.360+0000 7fd24ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad1d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.360+0000 7fd24ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad1d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52382/0 (socket says 172.21.15.151:52382) 2023-07-21T23:04:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.360+0000 7fd24ffff700 1 -- 172.21.15.151:0/3318921142 learned_addr learned my addr 172.21.15.151:0/3318921142 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.360+0000 7fd24ffff700 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 0x55577ad1aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.360+0000 7fd247fff700 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577acfd460 0x55577ad1a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.361+0000 7fd24ffff700 1 -- 172.21.15.151:0/3318921142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 msgr2=0x55577ad1aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:03.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.361+0000 7fd24ffff700 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 0x55577ad1aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.361+0000 7fd24ffff700 1 -- 172.21.15.151:0/3318921142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577acfd460 msgr2=0x55577ad1a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.361+0000 7fd24ffff700 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577acfd460 0x55577ad1a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.361+0000 7fd24ffff700 1 -- 172.21.15.151:0/3318921142 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd25010f420 con 0x55577ab5c6b0 2023-07-21T23:04:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.361+0000 7fd24ffff700 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad1d1a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd248007f70 tx=0x7fd248009ac0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5c532fa5416edba4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.361+0000 7fd22effd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:04:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.362+0000 7fd22effd700 1 -- 172.21.15.151:0/3318921142 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd24800e040 con 0x55577ab5c6b0 2023-07-21T23:04:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.362+0000 7fd22effd700 1 -- 172.21.15.151:0/3318921142 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd24802a060 con 0x55577ab5c6b0 2023-07-21T23:04:03.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.362+0000 7fd269876b80 1 -- 172.21.15.151:0/3318921142 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55577abab490 con 0x55577ab5c6b0 2023-07-21T23:04:03.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.362+0000 7fd22effd700 1 -- 172.21.15.151:0/3318921142 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd248005040 con 0x55577ab5c6b0 2023-07-21T23:04:03.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.362+0000 7fd269876b80 10 client.29422 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:03.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.362+0000 7fd269876b80 1 -- 172.21.15.151:0/3318921142 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55577aa68c00 con 0x55577ab5c6b0 2023-07-21T23:04:03.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.363+0000 7fd22effd700 1 -- 172.21.15.151:0/3318921142 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd248035020 con 0x55577ab5c6b0 2023-07-21T23:04:03.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:03 smithi195 ceph-mon[97365]: pgmap v1428: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.4 MiB/s wr, 981 op/s 2023-07-21T23:04:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.364+0000 7fd22effd700 1 -- 172.21.15.151:0/3318921142 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd248022020 con 0x55577ab5c6b0 2023-07-21T23:04:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.364+0000 7fd269876b80 10 client.29422 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:03.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.364+0000 7fd269876b80 10 client.29422 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.364+0000 7fd269876b80 20 client.29422 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.364+0000 7fd269876b80 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55577ad3b5c0 0x55577ad3d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.364+0000 7fd269876b80 4 client.29422 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:04:03.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.364+0000 7fd269876b80 1 -- 172.21.15.151:0/3318921142 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55577ac4ae50 con 0x55577ad3b5c0 2023-07-21T23:04:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.366+0000 7fd247fff700 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55577ad3b5c0 0x55577ad3d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.384+0000 7fd247fff700 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55577ad3b5c0 0x55577ad3d9d0 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8396bf87ad980630 server_cookie=c00c0263a8b4f0be in_seq=0 out_seq=0 2023-07-21T23:04:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.390+0000 7fd22effd700 10 client.29422 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:03.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.390+0000 7fd22effd700 1 -- 172.21.15.151:0/3318921142 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55577ac4ae50 con 0x55577ad3b5c0 2023-07-21T23:04:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.390+0000 7fd22effd700 10 client.29422 handle_command_reply: tid=0 2023-07-21T23:04:03.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.391+0000 7fd269876b80 1 client.29422 shutdown 2023-07-21T23:04:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.401+0000 7fd269876b80 1 -- 172.21.15.151:0/3318921142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 msgr2=0x55577ad1d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.401+0000 7fd269876b80 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad1d1a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fd248007f70 tx=0x7fd248009ac0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.401+0000 7fd269876b80 1 -- 172.21.15.151:0/3318921142 shutdown_connections 2023-07-21T23:04:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.401+0000 7fd269876b80 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55577ad3b5c0 0x55577ad3d9d0 crc :-1 s=READY pgs=499 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.401+0000 7fd269876b80 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 0x55577ad1aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.401+0000 7fd269876b80 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ab5c6b0 0x55577ad1d1a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.401+0000 7fd269876b80 1 --2- 172.21.15.151:0/3318921142 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577acfd460 0x55577ad1a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.401+0000 7fd269876b80 1 -- 172.21.15.151:0/3318921142 >> 172.21.15.151:0/3318921142 conn(0x55577acf5ae0 msgr2=0x55577acf9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.402+0000 7fd22effd700 0 client.29422 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:03.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:03 smithi151 ceph-mon[95510]: pgmap v1428: 97 pgs: 97 active+clean; 13 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.4 MiB/s wr, 981 op/s 2023-07-21T23:04:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.406+0000 7fd269876b80 1 -- 172.21.15.151:0/3318921142 shutdown_connections 2023-07-21T23:04:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.407+0000 7fd269876b80 1 -- 172.21.15.151:0/3318921142 wait complete. 2023-07-21T23:04:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.407+0000 7fd269876b80 20 client.29422 trim_cache size 0 max 16384 2023-07-21T23:04:03.484 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.440+0000 7fd269876b80 1 Processor -- start 2023-07-21T23:04:03.485 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.453+0000 7fd269876b80 1 -- start start 2023-07-21T23:04:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.453+0000 7fd269876b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 0x55577ad1cd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.453+0000 7fd269876b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 0x55577acfab80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.453+0000 7fd269876b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ad05330 0x55577acfb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.453+0000 7fd269876b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577acfc510 con 0x55577ab5c6b0 2023-07-21T23:04:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.453+0000 7fd269876b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577ad1d940 con 0x55577acfd460 2023-07-21T23:04:03.486 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.453+0000 7fd269876b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577acf7c00 con 0x55577ad05330 2023-07-21T23:04:03.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.456+0000 7fd24ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ad05330 0x55577acfb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.456+0000 7fd24ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ad05330 0x55577acfb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52390/0 (socket says 172.21.15.151:52390) 2023-07-21T23:04:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.456+0000 7fd24ffff700 1 -- 172.21.15.151:0/3808677705 learned_addr learned my addr 172.21.15.151:0/3808677705 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.456+0000 7fd24ffff700 1 --2- 172.21.15.151:0/3808677705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 0x55577ad1cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.490 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.457+0000 7fd247fff700 1 --2- 172.21.15.151:0/3808677705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 0x55577acfab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.496 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.460+0000 7fd247fff700 1 -- 172.21.15.151:0/3808677705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ad05330 msgr2=0x55577acfb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.460+0000 7fd247fff700 1 --2- 172.21.15.151:0/3808677705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ad05330 0x55577acfb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.497 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.460+0000 7fd247fff700 1 -- 172.21.15.151:0/3808677705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 msgr2=0x55577ad1cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:03.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.460+0000 7fd247fff700 1 --2- 172.21.15.151:0/3808677705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 0x55577ad1cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.498 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.460+0000 7fd247fff700 1 -- 172.21.15.151:0/3808677705 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55577ad42600 con 0x55577acfd460 2023-07-21T23:04:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.465+0000 7fd247fff700 1 --2- 172.21.15.151:0/3808677705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 0x55577acfab80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55577ad3e2b0 tx=0x7fd238009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=faf408726ae0dc26 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.467+0000 7fd2467fc700 1 -- 172.21.15.151:0/3808677705 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238009cf0 con 0x55577acfd460 2023-07-21T23:04:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.467+0000 7fd2467fc700 1 -- 172.21.15.151:0/3808677705 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd238017040 con 0x55577acfd460 2023-07-21T23:04:03.499 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.467+0000 7fd2467fc700 1 -- 172.21.15.151:0/3808677705 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd238004e40 con 0x55577acfd460 2023-07-21T23:04:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.468+0000 7fd269876b80 1 -- 172.21.15.151:0/3808677705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 msgr2=0x55577acfab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.468+0000 7fd269876b80 1 --2- 172.21.15.151:0/3808677705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 0x55577acfab80 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x55577ad3e2b0 tx=0x7fd238009260 comp rx=0 tx=0).stop 2023-07-21T23:04:03.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.468+0000 7fd269876b80 1 -- 172.21.15.151:0/3808677705 shutdown_connections 2023-07-21T23:04:03.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.468+0000 7fd269876b80 1 --2- 172.21.15.151:0/3808677705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577ad05330 0x55577acfb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.468+0000 7fd269876b80 1 --2- 172.21.15.151:0/3808677705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 0x55577ad1cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.468+0000 7fd269876b80 1 --2- 172.21.15.151:0/3808677705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577acfd460 0x55577acfab80 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.468+0000 7fd269876b80 1 -- 172.21.15.151:0/3808677705 >> 172.21.15.151:0/3808677705 conn(0x55577acf5ae0 msgr2=0x55577ad3d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.469+0000 7fd269876b80 1 -- 172.21.15.151:0/3808677705 shutdown_connections 2023-07-21T23:04:03.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.469+0000 7fd269876b80 1 -- 172.21.15.151:0/3808677705 wait complete. 2023-07-21T23:04:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.470+0000 7fd269876b80 1 -- start start 2023-07-21T23:04:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.470+0000 7fd269876b80 1 Processor -- start 2023-07-21T23:04:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.471+0000 7fd269876b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 0x55577ad1f690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.471+0000 7fd269876b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577acfd460 0x55577ad1fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.471+0000 7fd269876b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 0x55577ad8e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.471+0000 7fd269876b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577ad20510 con 0x55577ab5c6b0 2023-07-21T23:04:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.471+0000 7fd269876b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577ad8e9c0 con 0x55577ad05330 2023-07-21T23:04:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.471+0000 7fd269876b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55577ad8eb80 con 0x55577acfd460 2023-07-21T23:04:03.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.471+0000 7fd269876b80 10 client.0 _ll_register_callbacks cb 0x7fd248007db0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.474+0000 7fd247fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577acfd460 0x55577ad1fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.474+0000 7fd247fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577acfd460 0x55577ad1fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52402/0 (socket says 172.21.15.151:52402) 2023-07-21T23:04:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.474+0000 7fd247fff700 1 -- 172.21.15.151:0/2387800323 learned_addr learned my addr 172.21.15.151:0/2387800323 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.474+0000 7fd24ffff700 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 0x55577ad8e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.474+0000 7fd24ffff700 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 0x55577ad1f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.508 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.476+0000 7fd247fff700 1 -- 172.21.15.151:0/2387800323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 msgr2=0x55577ad8e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.476+0000 7fd247fff700 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 0x55577ad8e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.476+0000 7fd247fff700 1 -- 172.21.15.151:0/2387800323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 msgr2=0x55577ad1f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.476+0000 7fd247fff700 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 0x55577ad1f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.509 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.476+0000 7fd247fff700 1 -- 172.21.15.151:0/2387800323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55577aaa61f0 con 0x55577acfd460 2023-07-21T23:04:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.477+0000 7fd247fff700 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577acfd460 0x55577ad1fbd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd238000c00 tx=0x7fd238009af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c8634ebabe0d19a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.477+0000 7fd22effd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:04:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.477+0000 7fd22effd700 1 -- 172.21.15.151:0/2387800323 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2380049c0 con 0x55577acfd460 2023-07-21T23:04:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.478+0000 7fd22effd700 1 -- 172.21.15.151:0/2387800323 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(167..167 src has 1..167) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fd238004b20 con 0x55577acfd460 2023-07-21T23:04:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.478+0000 7fd269876b80 1 -- 172.21.15.151:0/2387800323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd248007720 con 0x55577acfd460 2023-07-21T23:04:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.479+0000 7fd22effd700 1 -- 172.21.15.151:0/2387800323 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd238004ce0 con 0x55577acfd460 2023-07-21T23:04:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.479+0000 7fd269876b80 10 client.29428 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.479+0000 7fd269876b80 1 -- 172.21.15.151:0/2387800323 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55577aa7e250 con 0x55577acfd460 2023-07-21T23:04:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.480+0000 7fd22effd700 1 -- 172.21.15.151:0/2387800323 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fd248007720 con 0x55577acfd460 2023-07-21T23:04:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.480+0000 7fd22effd700 1 -- 172.21.15.151:0/2387800323 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fd238003a00 con 0x55577acfd460 2023-07-21T23:04:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.480+0000 7fd269876b80 10 client.29428 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.480+0000 7fd269876b80 10 client.29428 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.480+0000 7fd269876b80 20 client.29428 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.481+0000 7fd269876b80 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55577ad90220 0x55577ad92630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.481+0000 7fd269876b80 4 client.29428 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:04:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.481+0000 7fd269876b80 1 -- 172.21.15.151:0/2387800323 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55577ac0cff0 con 0x55577ad90220 2023-07-21T23:04:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.481+0000 7fd24ffff700 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55577ad90220 0x55577ad92630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.483+0000 7fd24ffff700 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55577ad90220 0x55577ad92630 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef3b05575acf1952 server_cookie=d59c56de3fa8636b in_seq=0 out_seq=0 2023-07-21T23:04:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.483+0000 7fd22effd700 10 client.29428 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.601+0000 7fd22effd700 1 -- 172.21.15.151:0/2387800323 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55577ac0cff0 con 0x55577ad90220 2023-07-21T23:04:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.601+0000 7fd22effd700 10 client.29428 handle_command_reply: tid=0 2023-07-21T23:04:03.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.601+0000 7fd269876b80 1 client.29428 shutdown 2023-07-21T23:04:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.607+0000 7fd269876b80 1 -- 172.21.15.151:0/2387800323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577acfd460 msgr2=0x55577ad1fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.607+0000 7fd269876b80 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577acfd460 0x55577ad1fbd0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd238000c00 tx=0x7fd238009af0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.608+0000 7fd269876b80 1 -- 172.21.15.151:0/2387800323 shutdown_connections 2023-07-21T23:04:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.608+0000 7fd269876b80 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55577ad90220 0x55577ad92630 crc :-1 s=READY pgs=500 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.608+0000 7fd269876b80 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55577ad05330 0x55577ad8e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.608+0000 7fd269876b80 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55577ab5c6b0 0x55577ad1f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.608+0000 7fd269876b80 1 --2- 172.21.15.151:0/2387800323 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55577acfd460 0x55577ad1fbd0 secure :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd238000c00 tx=0x7fd238009af0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.608+0000 7fd269876b80 1 -- 172.21.15.151:0/2387800323 >> 172.21.15.151:0/2387800323 conn(0x55577acf5ae0 msgr2=0x55577ad03dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.608+0000 7fd22effd700 0 client.29428 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.608+0000 7fd269876b80 1 -- 172.21.15.151:0/2387800323 shutdown_connections 2023-07-21T23:04:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.609+0000 7fd269876b80 1 -- 172.21.15.151:0/2387800323 wait complete. 2023-07-21T23:04:03.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.609+0000 7fd269876b80 20 client.29428 trim_cache size 0 max 16384 2023-07-21T23:04:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:04:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:04:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:04:03.643 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:04:03.644 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 -- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd23c0a13c0 msgr2=0x7fd23c0a3870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd23c0a13c0 0x7fd23c0a3870 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55577ad05700 tx=0x7fd240096170 comp rx=0 tx=0).stop 2023-07-21T23:04:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 -- 172.21.15.151:0/2495433522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2500679a0 msgr2=0x7fd250197e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:03.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2500679a0 0x7fd250197e90 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd24000e9c0 tx=0x7fd24000ecd0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 -- 172.21.15.151:0/2495433522 shutdown_connections 2023-07-21T23:04:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fd23c0a13c0 0x7fd23c0a3870 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x55577ad05700 tx=0x7fd240096170 comp rx=0 tx=0).stop 2023-07-21T23:04:03.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2500679a0 0x7fd250197e90 secure :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fd24000e9c0 tx=0x7fd24000ecd0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd25010c540 0x7fd25019ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 --2- 172.21.15.151:0/2495433522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fd2500682b0 0x7fd2501983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:03.647 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.610+0000 7fd255fff700 1 -- 172.21.15.151:0/2495433522 >> 172.21.15.151:0/2495433522 conn(0x7fd250074760 msgr2=0x7fd2500fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.612+0000 7fd255fff700 1 -- 172.21.15.151:0/2495433522 shutdown_connections 2023-07-21T23:04:03.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:03.613+0000 7fd255fff700 1 -- 172.21.15.151:0/2495433522 wait complete. 2023-07-21T23:04:04.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 670.0 s, 327.9 tps, lat 298.831 ms stddev 155.593 2023-07-21T23:04:05.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:05 smithi195 ceph-mon[97365]: pgmap v1429: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.46k op/s 2023-07-21T23:04:05.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:05 smithi195 ceph-mon[97365]: osdmap e168: 12 total, 12 up, 12 in 2023-07-21T23:04:05.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:05 smithi151 ceph-mon[95510]: pgmap v1429: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.46k op/s 2023-07-21T23:04:05.451 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:05 smithi151 ceph-mon[95510]: osdmap e168: 12 total, 12 up, 12 in 2023-07-21T23:04:05.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:05 smithi187 ceph-mon[96918]: pgmap v1429: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.46k op/s 2023-07-21T23:04:05.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:05 smithi187 ceph-mon[96918]: osdmap e168: 12 total, 12 up, 12 in 2023-07-21T23:04:06.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:06 smithi187 ceph-mon[96918]: pgmap v1431: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 1.17k op/s 2023-07-21T23:04:06.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:06 smithi195 ceph-mon[97365]: pgmap v1431: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 1.17k op/s 2023-07-21T23:04:06.694 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:06 smithi151 ceph-mon[95510]: pgmap v1431: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 11 MiB/s wr, 1.17k op/s 2023-07-21T23:04:09.292 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 675.0 s, 85.7 tps, lat 1104.746 ms stddev 560.279 2023-07-21T23:04:09.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:09 smithi187 ceph-mon[96918]: pgmap v1432: 97 pgs: 12 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 65 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.4 MiB/s wr, 878 op/s 2023-07-21T23:04:09.401 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:09 smithi195 ceph-mon[97365]: pgmap v1432: 97 pgs: 12 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 65 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.4 MiB/s wr, 878 op/s 2023-07-21T23:04:09.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:09 smithi151 ceph-mon[95510]: pgmap v1432: 97 pgs: 12 active+clean+snaptrim, 20 active+clean+snaptrim_wait, 65 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 7.4 MiB/s wr, 878 op/s 2023-07-21T23:04:11.371 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:11 smithi187 ceph-mon[96918]: pgmap v1433: 97 pgs: 20 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 38 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.2 MiB/s wr, 761 op/s 2023-07-21T23:04:11.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:11 smithi195 ceph-mon[97365]: pgmap v1433: 97 pgs: 20 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 38 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.2 MiB/s wr, 761 op/s 2023-07-21T23:04:11.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:11 smithi151 ceph-mon[95510]: pgmap v1433: 97 pgs: 20 active+clean+snaptrim, 39 active+clean+snaptrim_wait, 38 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 7.2 MiB/s wr, 761 op/s 2023-07-21T23:04:13.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:13 smithi187 ceph-mon[96918]: pgmap v1434: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.2 MiB/s wr, 776 op/s 2023-07-21T23:04:13.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:13 smithi195 ceph-mon[97365]: pgmap v1434: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.2 MiB/s wr, 776 op/s 2023-07-21T23:04:13.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:13 smithi151 ceph-mon[95510]: pgmap v1434: 97 pgs: 18 active+clean+snaptrim, 35 active+clean+snaptrim_wait, 44 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 7.2 MiB/s wr, 776 op/s 2023-07-21T23:04:14.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 680.0 s, 209.2 tps, lat 508.898 ms stddev 526.318 2023-07-21T23:04:15.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:15 smithi195 ceph-mon[97365]: pgmap v1435: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 419 op/s 2023-07-21T23:04:15.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:15 smithi151 ceph-mon[95510]: pgmap v1435: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 419 op/s 2023-07-21T23:04:15.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:15 smithi187 ceph-mon[96918]: pgmap v1435: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.7 MiB/s wr, 419 op/s 2023-07-21T23:04:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.883+0000 7facb11ff700 1 -- 172.21.15.151:0/2060393476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 msgr2=0x7facac117060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.883+0000 7facb11ff700 1 --2- 172.21.15.151:0/2060393476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 0x7facac117060 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faca400b0a0 tx=0x7faca400b3b0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.883+0000 7facb11ff700 1 -- 172.21.15.151:0/2060393476 shutdown_connections 2023-07-21T23:04:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.883+0000 7facb11ff700 1 --2- 172.21.15.151:0/2060393476 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 0x7facac117060 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.883+0000 7facb11ff700 1 --2- 172.21.15.151:0/2060393476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facac10a1b0 0x7facac06c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.883+0000 7facb11ff700 1 --2- 172.21.15.151:0/2060393476 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facac06ce50 0x7facac06d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.883+0000 7facb11ff700 1 -- 172.21.15.151:0/2060393476 >> 172.21.15.151:0/2060393476 conn(0x7facac06bd70 msgr2=0x7facac070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.883+0000 7facb11ff700 1 -- 172.21.15.151:0/2060393476 shutdown_connections 2023-07-21T23:04:16.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.883+0000 7facb11ff700 1 -- 172.21.15.151:0/2060393476 wait complete. 2023-07-21T23:04:16.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.885+0000 7facb11ff700 1 Processor -- start 2023-07-21T23:04:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.885+0000 7facb11ff700 1 -- start start 2023-07-21T23:04:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.886+0000 7facb11ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facac06ce50 0x7facac113910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.886+0000 7facb11ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facac10a1b0 0x7facac113e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.886+0000 7facb11ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 0x7facac1a9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.886+0000 7facb11ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac1a9d20 con 0x7facac10a1b0 2023-07-21T23:04:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.886+0000 7facb11ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac1a9e90 con 0x7facac06ce50 2023-07-21T23:04:16.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.886+0000 7facb11ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facac1aa050 con 0x7facac114c80 2023-07-21T23:04:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.886+0000 7facab59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 0x7facac1a9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.887+0000 7facab59e700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 0x7facac1a9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56696/0 (socket says 172.21.15.151:56696) 2023-07-21T23:04:16.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.887+0000 7facab59e700 1 -- 172.21.15.151:0/3801719982 learned_addr learned my addr 172.21.15.151:0/3801719982 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.887+0000 7facaad9d700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facac06ce50 0x7facac113910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.887+0000 7facaa59c700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facac10a1b0 0x7facac113e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.887+0000 7facab59e700 1 -- 172.21.15.151:0/3801719982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facac06ce50 msgr2=0x7facac113910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.887+0000 7facab59e700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facac06ce50 0x7facac113910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.887+0000 7facab59e700 1 -- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facac10a1b0 msgr2=0x7facac113e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.887+0000 7facab59e700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facac10a1b0 0x7facac113e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.887+0000 7facab59e700 1 -- 172.21.15.151:0/3801719982 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca4009d00 con 0x7facac114c80 2023-07-21T23:04:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.888+0000 7facaad9d700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facac06ce50 0x7facac113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:04:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.888+0000 7facab59e700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 0x7facac1a9750 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faca400d010 tx=0x7faca400bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:16.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.889+0000 7fac93fff700 1 -- 172.21.15.151:0/3801719982 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca400e040 con 0x7facac114c80 2023-07-21T23:04:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.889+0000 7fac93fff700 1 -- 172.21.15.151:0/3801719982 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faca4009480 con 0x7facac114c80 2023-07-21T23:04:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.889+0000 7fac93fff700 1 -- 172.21.15.151:0/3801719982 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca40052a0 con 0x7facac114c80 2023-07-21T23:04:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.889+0000 7facb11ff700 1 -- 172.21.15.151:0/3801719982 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facac1aa2d0 con 0x7facac114c80 2023-07-21T23:04:16.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.889+0000 7facb11ff700 1 -- 172.21.15.151:0/3801719982 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac1b1a00 con 0x7facac114c80 2023-07-21T23:04:16.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.896+0000 7facc4a8db80 1 Processor -- start 2023-07-21T23:04:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.898+0000 7facc4a8db80 1 -- start start 2023-07-21T23:04:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.898+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254df26b0 0x55b254f9bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.898+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254f9c210 0x55b254f95f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.898+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f964a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.898+0000 7facc4a8db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254e9bc50 con 0x55b254f9c660 2023-07-21T23:04:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.898+0000 7facc4a8db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254eee9e0 con 0x55b254df26b0 2023-07-21T23:04:16.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.898+0000 7facc4a8db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254ee7e70 con 0x55b254f9c210 2023-07-21T23:04:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.899+0000 7fac93fff700 1 -- 172.21.15.151:0/3801719982 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7faca4005400 con 0x7facac114c80 2023-07-21T23:04:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.899+0000 7facaa59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f964a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.899+0000 7facaa59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f964a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43856/0 (socket says 172.21.15.151:43856) 2023-07-21T23:04:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.899+0000 7facaa59c700 1 -- 172.21.15.151:0/1084208161 learned_addr learned my addr 172.21.15.151:0/1084208161 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:16.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.899+0000 7facaa59c700 1 --2- 172.21.15.151:0/1084208161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254df26b0 0x55b254f9bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.900+0000 7facaa59c700 1 -- 172.21.15.151:0/1084208161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254f9c210 msgr2=0x55b254f95f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:04:16.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.900+0000 7facaa59c700 1 --2- 172.21.15.151:0/1084208161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254f9c210 0x55b254f95f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.900+0000 7facaa59c700 1 -- 172.21.15.151:0/1084208161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254df26b0 msgr2=0x55b254f9bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.900+0000 7facaa59c700 1 --2- 172.21.15.151:0/1084208161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254df26b0 0x55b254f9bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.900+0000 7facaa59c700 1 -- 172.21.15.151:0/1084208161 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b254d15d80 con 0x55b254f9c660 2023-07-21T23:04:16.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.900+0000 7facaa59c700 1 --2- 172.21.15.151:0/1084208161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f964a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7faca0009eb0 tx=0x7faca0009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd7d17ba69822ce server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.901+0000 7fac917fa700 1 -- 172.21.15.151:0/1084208161 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0004230 con 0x55b254f9c660 2023-07-21T23:04:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.901+0000 7fac917fa700 1 -- 172.21.15.151:0/1084208161 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faca0004390 con 0x55b254f9c660 2023-07-21T23:04:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.901+0000 7fac917fa700 1 -- 172.21.15.151:0/1084208161 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca000f6b0 con 0x55b254f9c660 2023-07-21T23:04:16.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.902+0000 7fac93fff700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac940a1490 0x7fac940a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.902+0000 7fac93fff700 1 -- 172.21.15.151:0/3801719982 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 8536+0+0 (secure 0 0 0) 0x7faca40cd6d0 con 0x7facac114c80 2023-07-21T23:04:16.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.904+0000 7facc4a8db80 1 -- 172.21.15.151:0/1084208161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 msgr2=0x55b254f964a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.904+0000 7facc4a8db80 1 --2- 172.21.15.151:0/1084208161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f964a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7faca0009eb0 tx=0x7faca0009770 comp rx=0 tx=0).stop 2023-07-21T23:04:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.904+0000 7facaad9d700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac940a1490 0x7fac940a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.904+0000 7facc4a8db80 1 -- 172.21.15.151:0/1084208161 shutdown_connections 2023-07-21T23:04:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.904+0000 7facc4a8db80 1 --2- 172.21.15.151:0/1084208161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254df26b0 0x55b254f9bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.938 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.904+0000 7facc4a8db80 1 --2- 172.21.15.151:0/1084208161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f964a0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.904+0000 7facc4a8db80 1 --2- 172.21.15.151:0/1084208161 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254f9c210 0x55b254f95f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.904+0000 7facc4a8db80 1 -- 172.21.15.151:0/1084208161 >> 172.21.15.151:0/1084208161 conn(0x55b254f8bae0 msgr2=0x55b254f910e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:16.939 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.906+0000 7facc4a8db80 1 -- 172.21.15.151:0/1084208161 shutdown_connections 2023-07-21T23:04:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.907+0000 7facc4a8db80 1 -- 172.21.15.151:0/1084208161 wait complete. 2023-07-21T23:04:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.907+0000 7facaad9d700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac940a1490 0x7fac940a3940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fac9c005fd0 tx=0x7fac9c005f60 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:16.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.908+0000 7facc4a8db80 1 -- start start 2023-07-21T23:04:16.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.909+0000 7facc4a8db80 1 Processor -- start 2023-07-21T23:04:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.909+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254df26b0 0x55b254f9f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.909+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254f9c210 0x55b254f9fe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.909+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c660 0x55b254fa03a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.910+0000 7facc4a8db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254e87a60 con 0x55b254df26b0 2023-07-21T23:04:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.910+0000 7facc4a8db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254e87760 con 0x55b254f9c660 2023-07-21T23:04:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.910+0000 7facc4a8db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254d6b8c0 con 0x55b254f9c210 2023-07-21T23:04:16.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.910+0000 7facc4a8db80 10 client.0 _ll_register_callbacks cb 0x55b254e85700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.911+0000 7facaad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254df26b0 0x55b254f9f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.911+0000 7facaad9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254df26b0 0x55b254f9f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43864/0 (socket says 172.21.15.151:43864) 2023-07-21T23:04:16.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.911+0000 7facaad9d700 1 -- 172.21.15.151:0/2808218871 learned_addr learned my addr 172.21.15.151:0/2808218871 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.913+0000 7facaad9d700 1 -- 172.21.15.151:0/2808218871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254f9c210 msgr2=0x55b254f9fe60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:04:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.913+0000 7facaad9d700 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254f9c210 0x55b254f9fe60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.913+0000 7facaad9d700 1 -- 172.21.15.151:0/2808218871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c660 msgr2=0x55b254fa03a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:04:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.913+0000 7facaad9d700 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c660 0x55b254fa03a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.913+0000 7facaad9d700 1 -- 172.21.15.151:0/2808218871 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca0012450 con 0x55b254df26b0 2023-07-21T23:04:16.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.914+0000 7facaad9d700 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254df26b0 0x55b254f9f920 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fac9c011720 tx=0x7fac9c004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ecd7ac64d39d499 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.914+0000 7fac8eff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:04:16.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.915+0000 7fac8eff5700 1 -- 172.21.15.151:0/2808218871 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9c01e640 con 0x55b254df26b0 2023-07-21T23:04:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.915+0000 7fac8eff5700 1 -- 172.21.15.151:0/2808218871 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 8536+0+0 (secure 0 0 0) 0x7fac9c01e7a0 con 0x55b254df26b0 2023-07-21T23:04:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.916+0000 7facc4a8db80 1 -- 172.21.15.151:0/2808218871 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b254e41490 con 0x55b254df26b0 2023-07-21T23:04:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.917+0000 7fac8eff5700 1 -- 172.21.15.151:0/2808218871 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fac9c01e960 con 0x55b254df26b0 2023-07-21T23:04:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.917+0000 7facc4a8db80 10 client.19743 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:16.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.917+0000 7facc4a8db80 1 -- 172.21.15.151:0/2808218871 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55b254cfec00 con 0x55b254df26b0 2023-07-21T23:04:16.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.917+0000 7fac8eff5700 1 -- 172.21.15.151:0/2808218871 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b254e41490 con 0x55b254df26b0 2023-07-21T23:04:16.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.918+0000 7fac8eff5700 1 -- 172.21.15.151:0/2808218871 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fac9c0104d0 con 0x55b254df26b0 2023-07-21T23:04:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.920+0000 7facc4a8db80 10 client.19743 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.920+0000 7facc4a8db80 10 client.19743 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.920+0000 7facc4a8db80 20 client.19743 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:16.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.920+0000 7facc4a8db80 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b254fc0bd0 0x55b254fc3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.920+0000 7facc4a8db80 4 client.19743 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:04:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.920+0000 7facc4a8db80 1 -- 172.21.15.151:0/2808218871 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b254ee0e50 con 0x55b254fc0bd0 2023-07-21T23:04:16.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.921+0000 7facaa59c700 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b254fc0bd0 0x55b254fc3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.922+0000 7facaa59c700 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b254fc0bd0 0x55b254fc3000 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=31563a3762b7f073 server_cookie=85999b7fb8fb85f0 in_seq=0 out_seq=0 2023-07-21T23:04:16.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.922+0000 7fac8eff5700 10 client.19743 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.923+0000 7fac8eff5700 1 -- 172.21.15.151:0/2808218871 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b254ee0e50 con 0x55b254fc0bd0 2023-07-21T23:04:16.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.923+0000 7fac8eff5700 10 client.19743 handle_command_reply: tid=0 2023-07-21T23:04:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.924+0000 7facc4a8db80 1 client.19743 shutdown 2023-07-21T23:04:16.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.924+0000 7facc4a8db80 1 -- 172.21.15.151:0/2808218871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254df26b0 msgr2=0x55b254f9f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:16.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.924+0000 7facc4a8db80 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254df26b0 0x55b254f9f920 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7fac9c011720 tx=0x7fac9c004750 comp rx=0 tx=0).stop 2023-07-21T23:04:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.925+0000 7facc4a8db80 1 -- 172.21.15.151:0/2808218871 shutdown_connections 2023-07-21T23:04:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.925+0000 7facc4a8db80 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b254fc0bd0 0x55b254fc3000 crc :-1 s=READY pgs=501 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.925+0000 7facc4a8db80 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c660 0x55b254fa03a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.925+0000 7facc4a8db80 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254df26b0 0x55b254f9f920 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.925+0000 7facc4a8db80 1 --2- 172.21.15.151:0/2808218871 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254f9c210 0x55b254f9fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.925+0000 7facc4a8db80 1 -- 172.21.15.151:0/2808218871 >> 172.21.15.151:0/2808218871 conn(0x55b254f8bae0 msgr2=0x55b254f903e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:16.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.925+0000 7fac8eff5700 0 client.19743 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.925+0000 7facc4a8db80 1 -- 172.21.15.151:0/2808218871 shutdown_connections 2023-07-21T23:04:16.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.925+0000 7facc4a8db80 1 -- 172.21.15.151:0/2808218871 wait complete. 2023-07-21T23:04:16.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.927+0000 7facc4a8db80 20 client.19743 trim_cache size 0 max 16384 2023-07-21T23:04:16.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.957+0000 7facc4a8db80 1 Processor -- start 2023-07-21T23:04:16.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.957+0000 7facc4a8db80 1 -- start start 2023-07-21T23:04:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.958+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254df26b0 0x55b254fa6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.958+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c210 0x55b254f9b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.958+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f95f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.958+0000 7facc4a8db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254f96a10 con 0x55b254f9c660 2023-07-21T23:04:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.958+0000 7facc4a8db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254f8d4f0 con 0x55b254f9c210 2023-07-21T23:04:16.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.958+0000 7facc4a8db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254f9a560 con 0x55b254df26b0 2023-07-21T23:04:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.962+0000 7facaa59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c210 0x55b254f9b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.963+0000 7facaad9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254df26b0 0x55b254fa6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:16.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.963+0000 7facaa59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c210 0x55b254f9b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:40466/0 (socket says 172.21.15.151:40466) 2023-07-21T23:04:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.963+0000 7facaa59c700 1 -- 172.21.15.151:0/4049845648 learned_addr learned my addr 172.21.15.151:0/4049845648 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:16.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.963+0000 7facab59e700 1 --2- 172.21.15.151:0/4049845648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f95f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.964+0000 7facab59e700 1 -- 172.21.15.151:0/4049845648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254df26b0 msgr2=0x55b254fa6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.964+0000 7facab59e700 1 --2- 172.21.15.151:0/4049845648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254df26b0 0x55b254fa6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.964+0000 7facab59e700 1 -- 172.21.15.151:0/4049845648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c210 msgr2=0x55b254f9b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.964+0000 7facab59e700 1 --2- 172.21.15.151:0/4049845648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c210 0x55b254f9b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.964+0000 7facab59e700 1 -- 172.21.15.151:0/4049845648 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b254d3c1f0 con 0x55b254f9c660 2023-07-21T23:04:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.964+0000 7facab59e700 1 --2- 172.21.15.151:0/4049845648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f95f40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7faca40cadb0 tx=0x7faca400b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3df0f3c2348e109 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.965+0000 7fac91ffb700 1 -- 172.21.15.151:0/4049845648 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca409a720 con 0x55b254f9c660 2023-07-21T23:04:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.965+0000 7fac91ffb700 1 -- 172.21.15.151:0/4049845648 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faca409e750 con 0x55b254f9c660 2023-07-21T23:04:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.965+0000 7fac91ffb700 1 -- 172.21.15.151:0/4049845648 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca409abe0 con 0x55b254f9c660 2023-07-21T23:04:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.966+0000 7facc4a8db80 1 -- 172.21.15.151:0/4049845648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 msgr2=0x55b254f95f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.966+0000 7facc4a8db80 1 --2- 172.21.15.151:0/4049845648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f95f40 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7faca40cadb0 tx=0x7faca400b3b0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.967+0000 7facc4a8db80 1 -- 172.21.15.151:0/4049845648 shutdown_connections 2023-07-21T23:04:17.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.967+0000 7facc4a8db80 1 --2- 172.21.15.151:0/4049845648 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f95f40 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.967+0000 7facc4a8db80 1 --2- 172.21.15.151:0/4049845648 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254df26b0 0x55b254fa6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.967+0000 7facc4a8db80 1 --2- 172.21.15.151:0/4049845648 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f9c210 0x55b254f9b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.967+0000 7facc4a8db80 1 -- 172.21.15.151:0/4049845648 >> 172.21.15.151:0/4049845648 conn(0x55b254f8bae0 msgr2=0x55b254f9a970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.968+0000 7facc4a8db80 1 -- 172.21.15.151:0/4049845648 shutdown_connections 2023-07-21T23:04:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.968+0000 7facc4a8db80 1 -- 172.21.15.151:0/4049845648 wait complete. 2023-07-21T23:04:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.969+0000 7facc4a8db80 1 -- start start 2023-07-21T23:04:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.969+0000 7facc4a8db80 1 Processor -- start 2023-07-21T23:04:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.970+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254df26b0 0x55b254f98c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:17.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.970+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f99180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.970+0000 7facc4a8db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f97730 0x55b254f97ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.970+0000 7facc4a8db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254f980e0 con 0x55b254f9c660 2023-07-21T23:04:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.970+0000 7facc4a8db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254f98250 con 0x55b254f97730 2023-07-21T23:04:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.970+0000 7facc4a8db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b254f98410 con 0x55b254df26b0 2023-07-21T23:04:17.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.970+0000 7facc4a8db80 10 client.0 _ll_register_callbacks cb 0x55b254e85700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.970+0000 7facaa59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f99180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.971+0000 7facaa59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f99180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43870/0 (socket says 172.21.15.151:43870) 2023-07-21T23:04:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.971+0000 7facaa59c700 1 -- 172.21.15.151:0/876078567 learned_addr learned my addr 172.21.15.151:0/876078567 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.971+0000 7facaa59c700 1 -- 172.21.15.151:0/876078567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254df26b0 msgr2=0x55b254f98c40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:04:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.971+0000 7facaa59c700 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254df26b0 0x55b254f98c40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.971+0000 7facaa59c700 1 -- 172.21.15.151:0/876078567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f97730 msgr2=0x55b254f97ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.971+0000 7facaa59c700 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f97730 0x55b254f97ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.971+0000 7facaa59c700 1 -- 172.21.15.151:0/876078567 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facac1b1a00 con 0x55b254f9c660 2023-07-21T23:04:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.972+0000 7facaa59c700 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f99180 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x55b254f9ca70 tx=0x7faca0009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e20ad571e25e814e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:17.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.972+0000 7fac8eff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:04:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.973+0000 7fac8eff5700 1 -- 172.21.15.151:0/876078567 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faca0023040 con 0x55b254f9c660 2023-07-21T23:04:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.973+0000 7fac8eff5700 1 -- 172.21.15.151:0/876078567 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 8536+0+0 (secure 0 0 0) 0x7faca0000e40 con 0x55b254f9c660 2023-07-21T23:04:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.973+0000 7facc4a8db80 1 -- 172.21.15.151:0/876078567 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faca0004390 con 0x55b254f9c660 2023-07-21T23:04:17.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.974+0000 7fac8eff5700 1 -- 172.21.15.151:0/876078567 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7faca0027780 con 0x55b254f9c660 2023-07-21T23:04:17.014 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.978+0000 7facc4a8db80 10 client.19749 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:17.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.978+0000 7facc4a8db80 1 -- 172.21.15.151:0/876078567 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55b254d14250 con 0x55b254f9c660 2023-07-21T23:04:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.983+0000 7fac8eff5700 1 -- 172.21.15.151:0/876078567 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7faca0004390 con 0x55b254f9c660 2023-07-21T23:04:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.983+0000 7fac8eff5700 1 -- 172.21.15.151:0/876078567 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7faca0004500 con 0x55b254f9c660 2023-07-21T23:04:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.983+0000 7facc4a8db80 10 client.19749 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.983+0000 7facc4a8db80 10 client.19749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.983+0000 7facc4a8db80 20 client.19749 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:17.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.983+0000 7facc4a8db80 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b255015d00 0x55b255018110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.983+0000 7facc4a8db80 4 client.19749 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:04:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.983+0000 7facc4a8db80 1 -- 172.21.15.151:0/876078567 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b254ea2ff0 con 0x55b255015d00 2023-07-21T23:04:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.984+0000 7facaad9d700 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b255015d00 0x55b255018110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:17.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.984+0000 7facaad9d700 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b255015d00 0x55b255018110 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ebbd7c2e1b67eba server_cookie=6348c0b06da370f5 in_seq=0 out_seq=0 2023-07-21T23:04:17.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:16.984+0000 7fac8eff5700 10 client.19749 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.070+0000 7fac8eff5700 1 -- 172.21.15.151:0/876078567 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b254ea2ff0 con 0x55b255015d00 2023-07-21T23:04:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.070+0000 7fac8eff5700 10 client.19749 handle_command_reply: tid=0 2023-07-21T23:04:17.104 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.071+0000 7facc4a8db80 1 client.19749 shutdown 2023-07-21T23:04:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.072+0000 7facc4a8db80 1 -- 172.21.15.151:0/876078567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 msgr2=0x55b254f99180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.072+0000 7facc4a8db80 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f99180 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x55b254f9ca70 tx=0x7faca0009720 comp rx=0 tx=0).stop 2023-07-21T23:04:17.105 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.072+0000 7facc4a8db80 1 -- 172.21.15.151:0/876078567 shutdown_connections 2023-07-21T23:04:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.072+0000 7facc4a8db80 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b255015d00 0x55b255018110 crc :-1 s=READY pgs=502 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.072+0000 7facc4a8db80 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b254f97730 0x55b254f97ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.072+0000 7facc4a8db80 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b254df26b0 0x55b254f98c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.072+0000 7facc4a8db80 1 --2- 172.21.15.151:0/876078567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b254f9c660 0x55b254f99180 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.072+0000 7facc4a8db80 1 -- 172.21.15.151:0/876078567 >> 172.21.15.151:0/876078567 conn(0x55b254f8bae0 msgr2=0x55b254f9e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:17.106 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.072+0000 7fac8eff5700 0 client.19749 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.073+0000 7facc4a8db80 1 -- 172.21.15.151:0/876078567 shutdown_connections 2023-07-21T23:04:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.073+0000 7facc4a8db80 1 -- 172.21.15.151:0/876078567 wait complete. 2023-07-21T23:04:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.074+0000 7facc4a8db80 20 client.19749 trim_cache size 0 max 16384 2023-07-21T23:04:17.107 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:04:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:04:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:04:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:04:17.108 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.074+0000 7facb11ff700 1 -- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac940a1490 msgr2=0x7fac940a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.074+0000 7facb11ff700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac940a1490 0x7fac940a3940 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fac9c005fd0 tx=0x7fac9c005f60 comp rx=0 tx=0).stop 2023-07-21T23:04:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 -- 172.21.15.151:0/3801719982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 msgr2=0x7facac1a9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 0x7facac1a9750 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faca400d010 tx=0x7faca400bd90 comp rx=0 tx=0).stop 2023-07-21T23:04:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 -- 172.21.15.151:0/3801719982 shutdown_connections 2023-07-21T23:04:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fac940a1490 0x7fac940a3940 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facac06ce50 0x7facac113910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.109 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7facac114c80 0x7facac1a9750 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 --2- 172.21.15.151:0/3801719982 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facac10a1b0 0x7facac113e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 -- 172.21.15.151:0/3801719982 >> 172.21.15.151:0/3801719982 conn(0x7facac06bd70 msgr2=0x7facac115360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 -- 172.21.15.151:0/3801719982 shutdown_connections 2023-07-21T23:04:17.110 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:17.075+0000 7facb11ff700 1 -- 172.21.15.151:0/3801719982 wait complete. 2023-07-21T23:04:17.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:17 smithi151 ceph-mon[95510]: pgmap v1436: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 356 op/s 2023-07-21T23:04:17.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:17 smithi187 ceph-mon[96918]: pgmap v1436: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 356 op/s 2023-07-21T23:04:17.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:17 smithi195 ceph-mon[97365]: pgmap v1436: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 356 op/s 2023-07-21T23:04:18.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:18 smithi187 ceph-mon[96918]: pgmap v1437: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.4 MiB/s wr, 601 op/s 2023-07-21T23:04:18.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:18 smithi195 ceph-mon[97365]: pgmap v1437: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.4 MiB/s wr, 601 op/s 2023-07-21T23:04:18.688 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:18 smithi151 ceph-mon[95510]: pgmap v1437: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.4 MiB/s wr, 601 op/s 2023-07-21T23:04:19.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 685.0 s, 315.4 tps, lat 322.641 ms stddev 99.203 2023-07-21T23:04:21.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:20 smithi187 ceph-mon[96918]: pgmap v1438: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.0 MiB/s wr, 694 op/s 2023-07-21T23:04:21.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:20 smithi195 ceph-mon[97365]: pgmap v1438: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.0 MiB/s wr, 694 op/s 2023-07-21T23:04:21.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:20 smithi151 ceph-mon[95510]: pgmap v1438: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 MiB/s rd, 7.0 MiB/s wr, 694 op/s 2023-07-21T23:04:23.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:23 smithi187 ceph-mon[96918]: pgmap v1439: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.9 MiB/s wr, 616 op/s 2023-07-21T23:04:23.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:23 smithi187 ceph-mon[96918]: osdmap e169: 12 total, 12 up, 12 in 2023-07-21T23:04:23.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:23 smithi195 ceph-mon[97365]: pgmap v1439: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.9 MiB/s wr, 616 op/s 2023-07-21T23:04:23.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:23 smithi195 ceph-mon[97365]: osdmap e169: 12 total, 12 up, 12 in 2023-07-21T23:04:23.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:23 smithi151 ceph-mon[95510]: pgmap v1439: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 5.9 MiB/s wr, 616 op/s 2023-07-21T23:04:23.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:23 smithi151 ceph-mon[95510]: osdmap e169: 12 total, 12 up, 12 in 2023-07-21T23:04:24.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 690.0 s, 312.4 tps, lat 318.071 ms stddev 127.768 2023-07-21T23:04:25.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:25 smithi187 ceph-mon[96918]: pgmap v1441: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.9 MiB/s wr, 1.04k op/s 2023-07-21T23:04:25.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:25 smithi195 ceph-mon[97365]: pgmap v1441: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.9 MiB/s wr, 1.04k op/s 2023-07-21T23:04:25.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:25 smithi151 ceph-mon[95510]: pgmap v1441: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.9 MiB/s wr, 1.04k op/s 2023-07-21T23:04:27.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:27 smithi187 ceph-mon[96918]: pgmap v1442: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.9 MiB/s wr, 1.04k op/s 2023-07-21T23:04:27.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:27 smithi195 ceph-mon[97365]: pgmap v1442: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.9 MiB/s wr, 1.04k op/s 2023-07-21T23:04:27.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:27 smithi151 ceph-mon[95510]: pgmap v1442: 97 pgs: 97 active+clean; 12 GiB data, 27 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.9 MiB/s wr, 1.04k op/s 2023-07-21T23:04:29.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 695.0 s, 200.7 tps, lat 501.781 ms stddev 773.997 2023-07-21T23:04:29.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:29 smithi187 ceph-mon[96918]: pgmap v1443: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.7 MiB/s wr, 1.01k op/s 2023-07-21T23:04:29.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:29 smithi195 ceph-mon[97365]: pgmap v1443: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.7 MiB/s wr, 1.01k op/s 2023-07-21T23:04:29.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:29 smithi151 ceph-mon[95510]: pgmap v1443: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.7 MiB/s wr, 1.01k op/s 2023-07-21T23:04:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.326+0000 7f9ba8bff700 1 -- 172.21.15.151:0/2215743856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406d3a0 msgr2=0x7f9ba411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:30.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.326+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/2215743856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406d3a0 0x7f9ba411b470 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c00b0a0 tx=0x7f9b9c00b3b0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.328+0000 7f9ba8bff700 1 -- 172.21.15.151:0/2215743856 shutdown_connections 2023-07-21T23:04:30.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.328+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/2215743856 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba410e2a0 0x7f9ba410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.328+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/2215743856 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406d3a0 0x7f9ba411b470 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.328+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/2215743856 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ba406c910 0x7f9ba406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.328+0000 7f9ba8bff700 1 -- 172.21.15.151:0/2215743856 >> 172.21.15.151:0/2215743856 conn(0x7f9ba406bd70 msgr2=0x7f9ba4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:30.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.331+0000 7f9ba8bff700 1 -- 172.21.15.151:0/2215743856 shutdown_connections 2023-07-21T23:04:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.331+0000 7f9ba8bff700 1 -- 172.21.15.151:0/2215743856 wait complete. 2023-07-21T23:04:30.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.332+0000 7f9ba8bff700 1 Processor -- start 2023-07-21T23:04:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.333+0000 7f9ba8bff700 1 -- start start 2023-07-21T23:04:30.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.333+0000 7f9ba8bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406c910 0x7f9ba411ae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.333+0000 7f9ba8bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba406d3a0 0x7f9ba411b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.333+0000 7f9ba8bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ba410e2a0 0x7f9ba4113c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.333+0000 7f9ba8bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba4114460 con 0x7f9ba410e2a0 2023-07-21T23:04:30.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.333+0000 7f9ba8bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba41145d0 con 0x7f9ba406d3a0 2023-07-21T23:04:30.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.333+0000 7f9ba8bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ba4114790 con 0x7f9ba406c910 2023-07-21T23:04:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.334+0000 7f9ba259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406c910 0x7f9ba411ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.334+0000 7f9ba259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406c910 0x7f9ba411ae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49676/0 (socket says 172.21.15.151:49676) 2023-07-21T23:04:30.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.334+0000 7f9ba259c700 1 -- 172.21.15.151:0/3561584635 learned_addr learned my addr 172.21.15.151:0/3561584635 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.335+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ba410e2a0 0x7f9ba4113c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.336+0000 7f9ba259c700 1 -- 172.21.15.151:0/3561584635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba406d3a0 msgr2=0x7f9ba411b350 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T23:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.336+0000 7f9ba259c700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba406d3a0 0x7f9ba411b350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.336+0000 7f9ba259c700 1 -- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ba410e2a0 msgr2=0x7f9ba4113c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.336+0000 7f9ba259c700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ba410e2a0 0x7f9ba4113c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.336+0000 7f9ba259c700 1 -- 172.21.15.151:0/3561584635 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b9c009d00 con 0x7f9ba406c910 2023-07-21T23:04:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.336+0000 7f9ba259c700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406c910 0x7f9ba411ae10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c920 tx=0x7f9b9400cce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:30.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.337+0000 7f9b9bfff700 1 -- 172.21.15.151:0/3561584635 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94007b00 con 0x7f9ba406c910 2023-07-21T23:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.337+0000 7f9b9bfff700 1 -- 172.21.15.151:0/3561584635 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b94004cc0 con 0x7f9ba406c910 2023-07-21T23:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.337+0000 7f9b9bfff700 1 -- 172.21.15.151:0/3561584635 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94005590 con 0x7f9ba406c910 2023-07-21T23:04:30.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.337+0000 7f9ba8bff700 1 -- 172.21.15.151:0/3561584635 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ba4114a10 con 0x7f9ba406c910 2023-07-21T23:04:30.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.337+0000 7f9ba8bff700 1 -- 172.21.15.151:0/3561584635 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba4118c60 con 0x7f9ba406c910 2023-07-21T23:04:30.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.344+0000 7f9b9bfff700 1 -- 172.21.15.151:0/3561584635 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f9b94004750 con 0x7f9ba406c910 2023-07-21T23:04:30.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.345+0000 7f9bbc474b80 1 Processor -- start 2023-07-21T23:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.346+0000 7f9bbc474b80 1 -- start start 2023-07-21T23:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d490d56b0 0x560d4927ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49278f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d4927f660 0x560d492794a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4917ec50 con 0x560d490d56b0 2023-07-21T23:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d491d19e0 con 0x560d4927f660 2023-07-21T23:04:30.380 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d491cae70 con 0x560d4927f210 2023-07-21T23:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9ba259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49278f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9ba259c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49278f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:49684/0 (socket says 172.21.15.151:49684) 2023-07-21T23:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9ba259c700 1 -- 172.21.15.151:0/2689610101 learned_addr learned my addr 172.21.15.151:0/2689610101 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:30.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.347+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/2689610101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d490d56b0 0x560d4927ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.348+0000 7f9ba259c700 1 -- 172.21.15.151:0/2689610101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d4927f660 msgr2=0x560d492794a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:04:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.348+0000 7f9ba259c700 1 --2- 172.21.15.151:0/2689610101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d4927f660 0x560d492794a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.348+0000 7f9ba259c700 1 -- 172.21.15.151:0/2689610101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d490d56b0 msgr2=0x560d4927ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.348+0000 7f9ba259c700 1 --2- 172.21.15.151:0/2689610101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d490d56b0 0x560d4927ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.348+0000 7f9ba259c700 1 -- 172.21.15.151:0/2689610101 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d48ff8d80 con 0x560d4927f210 2023-07-21T23:04:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.348+0000 7f9ba259c700 1 --2- 172.21.15.151:0/2689610101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49278f40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9b940ca0a0 tx=0x7f9b940d2a60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dca0281e3ad6a71d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.348+0000 7f9b9bfff700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b840a1450 0x7f9b840a3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.349+0000 7f9b98d99700 1 -- 172.21.15.151:0/2689610101 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94095df0 con 0x560d4927f210 2023-07-21T23:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.349+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b840a1450 0x7f9b840a3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.349+0000 7f9b98d99700 1 -- 172.21.15.151:0/2689610101 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b940956c0 con 0x560d4927f210 2023-07-21T23:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.349+0000 7f9b98d99700 1 -- 172.21.15.151:0/2689610101 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b94099ab0 con 0x560d4927f210 2023-07-21T23:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.349+0000 7f9b9bfff700 1 -- 172.21.15.151:0/3561584635 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9b940cc9c0 con 0x7f9ba406c910 2023-07-21T23:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.350+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2689610101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 msgr2=0x560d49278f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.350+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2689610101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49278f40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9b940ca0a0 tx=0x7f9b940d2a60 comp rx=0 tx=0).stop 2023-07-21T23:04:30.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.350+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b840a1450 0x7f9b840a3900 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0060b0 tx=0x7f9b9c006020 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.350+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2689610101 shutdown_connections 2023-07-21T23:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.350+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2689610101 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d4927f660 0x560d492794a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.350+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2689610101 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d490d56b0 0x560d4927ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.350+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2689610101 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49278f40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.350+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2689610101 >> 172.21.15.151:0/2689610101 conn(0x560d4926eae0 msgr2=0x560d492740e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:30.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.351+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2689610101 shutdown_connections 2023-07-21T23:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.351+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2689610101 wait complete. 2023-07-21T23:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.351+0000 7f9bbc474b80 1 -- start start 2023-07-21T23:04:30.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.352+0000 7f9bbc474b80 1 Processor -- start 2023-07-21T23:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.352+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 0x560d49282940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.352+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49282e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.352+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492833c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.352+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4916aa60 con 0x560d4927f660 2023-07-21T23:04:30.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.352+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4916a760 con 0x560d490d56b0 2023-07-21T23:04:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.352+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4904e8c0 con 0x560d4927f210 2023-07-21T23:04:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.353+0000 7f9bbc474b80 10 client.0 _ll_register_callbacks cb 0x560d49168700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.353+0000 7f9b99d9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49282e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.353+0000 7f9ba2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492833c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.353+0000 7f9ba2d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492833c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55786/0 (socket says 172.21.15.151:55786) 2023-07-21T23:04:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.353+0000 7f9ba2d9d700 1 -- 172.21.15.151:0/1456648680 learned_addr learned my addr 172.21.15.151:0/1456648680 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:30.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.353+0000 7f9ba259c700 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 0x560d49282940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.354+0000 7f9ba2d9d700 1 -- 172.21.15.151:0/1456648680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 msgr2=0x560d49282e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.354+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49282e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.354+0000 7f9ba2d9d700 1 -- 172.21.15.151:0/1456648680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 msgr2=0x560d49282940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.354+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 0x560d49282940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.354+0000 7f9ba2d9d700 1 -- 172.21.15.151:0/1456648680 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ba4118c60 con 0x560d4927f660 2023-07-21T23:04:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.355+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492833c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c015000 tx=0x7f9b9c00b3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed712eb68da2a9f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.355+0000 7f9b91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:04:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.355+0000 7f9b91ffb700 1 -- 172.21.15.151:0/1456648680 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00e040 con 0x560d4927f660 2023-07-21T23:04:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.355+0000 7f9bbc474b80 1 -- 172.21.15.151:0/1456648680 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d49124490 con 0x560d4927f660 2023-07-21T23:04:30.390 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.355+0000 7f9b91ffb700 1 -- 172.21.15.151:0/1456648680 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9b9c028720 con 0x560d4927f660 2023-07-21T23:04:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.356+0000 7f9b91ffb700 1 -- 172.21.15.151:0/1456648680 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b9c0288e0 con 0x560d4927f660 2023-07-21T23:04:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.356+0000 7f9bbc474b80 10 client.19761 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:30.391 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.356+0000 7f9bbc474b80 1 -- 172.21.15.151:0/1456648680 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x560d48fe1c00 con 0x560d4927f660 2023-07-21T23:04:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.356+0000 7f9b91ffb700 1 -- 172.21.15.151:0/1456648680 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x560d49124490 con 0x560d4927f660 2023-07-21T23:04:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.356+0000 7f9b91ffb700 1 -- 172.21.15.151:0/1456648680 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9b9c03ab70 con 0x560d4927f660 2023-07-21T23:04:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.358+0000 7f9bbc474b80 10 client.19761 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.358+0000 7f9bbc474b80 10 client.19761 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.358+0000 7f9bbc474b80 20 client.19761 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:30.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.358+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560d49292c20 0x560d49295030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.358+0000 7f9bbc474b80 4 client.19761 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:04:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.358+0000 7f9bbc474b80 1 -- 172.21.15.151:0/1456648680 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d491c3e50 con 0x560d49292c20 2023-07-21T23:04:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.358+0000 7f9ba259c700 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560d49292c20 0x560d49295030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.359+0000 7f9ba259c700 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560d49292c20 0x560d49295030 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4271701d412a8a22 server_cookie=6dc12ab192b0e4a2 in_seq=0 out_seq=0 2023-07-21T23:04:30.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.359+0000 7f9b91ffb700 10 client.19761 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.361+0000 7f9b91ffb700 1 -- 172.21.15.151:0/1456648680 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x560d491c3e50 con 0x560d49292c20 2023-07-21T23:04:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.361+0000 7f9b91ffb700 10 client.19761 handle_command_reply: tid=0 2023-07-21T23:04:30.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9bbc474b80 1 client.19761 shutdown 2023-07-21T23:04:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9bbc474b80 1 -- 172.21.15.151:0/1456648680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 msgr2=0x560d492833c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492833c0 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c015000 tx=0x7f9b9c00b3b0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9bbc474b80 1 -- 172.21.15.151:0/1456648680 shutdown_connections 2023-07-21T23:04:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560d49292c20 0x560d49295030 crc :-1 s=READY pgs=503 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 0x560d49282940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492833c0 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/1456648680 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49282e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9bbc474b80 1 -- 172.21.15.151:0/1456648680 >> 172.21.15.151:0/1456648680 conn(0x560d4926eae0 msgr2=0x560d492733e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.362+0000 7f9b91ffb700 0 client.19761 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.363+0000 7f9bbc474b80 1 -- 172.21.15.151:0/1456648680 shutdown_connections 2023-07-21T23:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.363+0000 7f9bbc474b80 1 -- 172.21.15.151:0/1456648680 wait complete. 2023-07-21T23:04:30.397 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.363+0000 7f9bbc474b80 20 client.19761 trim_cache size 0 max 16384 2023-07-21T23:04:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.393+0000 7f9bbc474b80 1 Processor -- start 2023-07-21T23:04:30.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.393+0000 7f9bbc474b80 1 -- start start 2023-07-21T23:04:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.393+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 0x560d49289b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.393+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d4927e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.393+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.393+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d49270c00 con 0x560d4927f660 2023-07-21T23:04:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.394+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d4927e920 con 0x560d490d56b0 2023-07-21T23:04:30.427 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.394+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d492756b0 con 0x560d4927f210 2023-07-21T23:04:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.394+0000 7f9ba259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 0x560d49289b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.394+0000 7f9ba259c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 0x560d49289b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:34160/0 (socket says 172.21.15.151:34160) 2023-07-21T23:04:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.394+0000 7f9ba259c700 1 -- 172.21.15.151:0/3431454132 learned_addr learned my addr 172.21.15.151:0/3431454132 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:30.428 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.394+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/3431454132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.394+0000 7f9b99d9b700 1 --2- 172.21.15.151:0/3431454132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d4927e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.395+0000 7f9ba2d9d700 1 -- 172.21.15.151:0/3431454132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 msgr2=0x560d4927e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.395+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/3431454132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d4927e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.395+0000 7f9ba2d9d700 1 -- 172.21.15.151:0/3431454132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 msgr2=0x560d49289b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.395+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/3431454132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 0x560d49289b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.395+0000 7f9ba2d9d700 1 -- 172.21.15.151:0/3431454132 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d49299c60 con 0x560d4927f660 2023-07-21T23:04:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.396+0000 7f9ba2d9d700 1 --2- 172.21.15.151:0/3431454132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492831f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c015000 tx=0x7f9b9c005110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be9e1439fe0e577b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.396+0000 7f9b9959a700 1 -- 172.21.15.151:0/3431454132 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c00e040 con 0x560d4927f660 2023-07-21T23:04:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.396+0000 7f9b9959a700 1 -- 172.21.15.151:0/3431454132 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b9c0051e0 con 0x560d4927f660 2023-07-21T23:04:30.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.396+0000 7f9b9959a700 1 -- 172.21.15.151:0/3431454132 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c0288c0 con 0x560d4927f660 2023-07-21T23:04:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.397+0000 7f9bbc474b80 1 -- 172.21.15.151:0/3431454132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 msgr2=0x560d492831f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.397+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/3431454132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492831f0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c015000 tx=0x7f9b9c005110 comp rx=0 tx=0).stop 2023-07-21T23:04:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.398+0000 7f9bbc474b80 1 -- 172.21.15.151:0/3431454132 shutdown_connections 2023-07-21T23:04:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.398+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/3431454132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d490d56b0 0x560d49289b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.398+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/3431454132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d492831f0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.431 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.398+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/3431454132 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d4927e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.432 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.398+0000 7f9bbc474b80 1 -- 172.21.15.151:0/3431454132 >> 172.21.15.151:0/3431454132 conn(0x560d4926eae0 msgr2=0x560d4927d980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:30.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.400+0000 7f9bbc474b80 1 -- 172.21.15.151:0/3431454132 shutdown_connections 2023-07-21T23:04:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.400+0000 7f9bbc474b80 1 -- 172.21.15.151:0/3431454132 wait complete. 2023-07-21T23:04:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.401+0000 7f9bbc474b80 1 -- start start 2023-07-21T23:04:30.434 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.401+0000 7f9bbc474b80 1 Processor -- start 2023-07-21T23:04:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.402+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49278fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.402+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d49279520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.402+0000 7f9bbc474b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d49289ed0 0x560d49277f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.402+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d49278580 con 0x560d4927f660 2023-07-21T23:04:30.436 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.402+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d492786f0 con 0x560d49289ed0 2023-07-21T23:04:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.402+0000 7f9bbc474b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d492788b0 con 0x560d4927f210 2023-07-21T23:04:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.402+0000 7f9bbc474b80 10 client.0 _ll_register_callbacks cb 0x7f9b9c004d60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.404+0000 7f9b99d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d49279520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.404+0000 7f9b99d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d49279520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55806/0 (socket says 172.21.15.151:55806) 2023-07-21T23:04:30.437 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.404+0000 7f9b99d9b700 1 -- 172.21.15.151:0/2621442953 learned_addr learned my addr 172.21.15.151:0/2621442953 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.405+0000 7f9b99d9b700 1 -- 172.21.15.151:0/2621442953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 msgr2=0x560d49278fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:04:30.438 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.406+0000 7f9b99d9b700 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49278fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.406+0000 7f9b99d9b700 1 -- 172.21.15.151:0/2621442953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d49289ed0 msgr2=0x560d49277f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:04:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.406+0000 7f9b99d9b700 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d49289ed0 0x560d49277f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.406+0000 7f9b99d9b700 1 -- 172.21.15.151:0/2621442953 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x560d48fe1c00 con 0x560d4927f660 2023-07-21T23:04:30.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.406+0000 7f9b99d9b700 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d49279520 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4115650 tx=0x7f9b8c009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7263a8c8102edf64 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.408+0000 7f9b91ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:04:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.408+0000 7f9b91ffb700 1 -- 172.21.15.151:0/2621442953 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b8c011d50 con 0x560d4927f660 2023-07-21T23:04:30.441 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.408+0000 7f9b91ffb700 1 -- 172.21.15.151:0/2621442953 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f9b8c012450 con 0x560d4927f660 2023-07-21T23:04:30.443 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.410+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2621442953 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f9b940956c0 con 0x560d4927f660 2023-07-21T23:04:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.411+0000 7f9b91ffb700 1 -- 172.21.15.151:0/2621442953 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b8c011eb0 con 0x560d4927f660 2023-07-21T23:04:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.412+0000 7f9bbc474b80 10 client.19767 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:30.444 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.412+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2621442953 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x560d4901f1f0 con 0x560d4927f660 2023-07-21T23:04:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.413+0000 7f9b91ffb700 1 -- 172.21.15.151:0/2621442953 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f9b940956c0 con 0x560d4927f660 2023-07-21T23:04:30.445 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.413+0000 7f9b91ffb700 1 -- 172.21.15.151:0/2621442953 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f9b8c00c070 con 0x560d4927f660 2023-07-21T23:04:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.414+0000 7f9bbc474b80 10 client.19767 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.414+0000 7f9bbc474b80 10 client.19767 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.414+0000 7f9bbc474b80 20 client.19767 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.414+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560d492e7c10 0x560d492ea020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.414+0000 7f9bbc474b80 4 client.19767 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:04:30.447 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.414+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2621442953 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x560d49185ff0 con 0x560d492e7c10 2023-07-21T23:04:30.448 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.415+0000 7f9ba259c700 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560d492e7c10 0x560d492ea020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.417+0000 7f9ba259c700 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560d492e7c10 0x560d492ea020 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1da4a3fbd1b4c30 server_cookie=6b0880f94a766902 in_seq=0 out_seq=0 2023-07-21T23:04:30.449 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.417+0000 7f9b91ffb700 10 client.19767 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:30.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.467+0000 7f9b91ffb700 1 -- 172.21.15.151:0/2621442953 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x560d49185ff0 con 0x560d492e7c10 2023-07-21T23:04:30.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.467+0000 7f9b91ffb700 10 client.19767 handle_command_reply: tid=0 2023-07-21T23:04:30.500 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.467+0000 7f9bbc474b80 1 client.19767 shutdown 2023-07-21T23:04:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.468+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2621442953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 msgr2=0x560d49279520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.468+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d49279520 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4115650 tx=0x7f9b8c009ed0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.501 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.469+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2621442953 shutdown_connections 2023-07-21T23:04:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.469+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x560d492e7c10 0x560d492ea020 crc :-1 s=READY pgs=504 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.469+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x560d49289ed0 0x560d49277f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.469+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x560d4927f210 0x560d49278fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.469+0000 7f9bbc474b80 1 --2- 172.21.15.151:0/2621442953 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560d4927f660 0x560d49279520 secure :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4115650 tx=0x7f9b8c009ed0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.469+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2621442953 >> 172.21.15.151:0/2621442953 conn(0x560d4926eae0 msgr2=0x560d4927e210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:30.502 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.469+0000 7f9b91ffb700 0 client.19767 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.469+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2621442953 shutdown_connections 2023-07-21T23:04:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.470+0000 7f9bbc474b80 1 -- 172.21.15.151:0/2621442953 wait complete. 2023-07-21T23:04:30.503 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.471+0000 7f9bbc474b80 20 client.19767 trim_cache size 0 max 16384 2023-07-21T23:04:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:04:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:04:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:04:30.504 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:04:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.471+0000 7f9ba8bff700 1 -- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b840a1450 msgr2=0x7f9b840a3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b840a1450 0x7f9b840a3900 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c0060b0 tx=0x7f9b9c006020 comp rx=0 tx=0).stop 2023-07-21T23:04:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 -- 172.21.15.151:0/3561584635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406c910 msgr2=0x7f9ba411ae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:30.505 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406c910 0x7f9ba411ae10 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9b9400c920 tx=0x7f9b9400cce0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 -- 172.21.15.151:0/3561584635 shutdown_connections 2023-07-21T23:04:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f9b840a1450 0x7f9b840a3900 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ba410e2a0 0x7f9ba4113c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f9ba406c910 0x7f9ba411ae10 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 --2- 172.21.15.151:0/3561584635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ba406d3a0 0x7f9ba411b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 -- 172.21.15.151:0/3561584635 >> 172.21.15.151:0/3561584635 conn(0x7f9ba406bd70 msgr2=0x7f9ba40707c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:30.506 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 -- 172.21.15.151:0/3561584635 shutdown_connections 2023-07-21T23:04:30.507 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:30.472+0000 7f9ba8bff700 1 -- 172.21.15.151:0/3561584635 wait complete. 2023-07-21T23:04:31.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:31 smithi187 ceph-mon[96918]: pgmap v1444: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.0 MiB/s wr, 963 op/s 2023-07-21T23:04:31.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:31 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:04:31.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:31 smithi195 ceph-mon[97365]: pgmap v1444: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.0 MiB/s wr, 963 op/s 2023-07-21T23:04:31.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:31 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:04:31.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:31 smithi151 ceph-mon[95510]: pgmap v1444: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.6 MiB/s rd, 9.0 MiB/s wr, 963 op/s 2023-07-21T23:04:31.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:31 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:04:33.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:33 smithi187 ceph-mon[96918]: pgmap v1445: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.7 MiB/s wr, 999 op/s 2023-07-21T23:04:33.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:33 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:04:33.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:33 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:04:33.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:33 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:04:33.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:33 smithi195 ceph-mon[97365]: pgmap v1445: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.7 MiB/s wr, 999 op/s 2023-07-21T23:04:33.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:33 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:04:33.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:33 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:04:33.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:33 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:04:33.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:33 smithi151 ceph-mon[95510]: pgmap v1445: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 9.7 MiB/s wr, 999 op/s 2023-07-21T23:04:33.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:33 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:04:33.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:33 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:04:33.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:33 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:04:34.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 700.0 s, 387.3 tps, lat 257.549 ms stddev 70.801 2023-07-21T23:04:35.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:35 smithi195 ceph-mon[97365]: pgmap v1446: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 1.10k op/s 2023-07-21T23:04:35.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:35 smithi151 ceph-mon[95510]: pgmap v1446: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 1.10k op/s 2023-07-21T23:04:35.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:35 smithi187 ceph-mon[96918]: pgmap v1446: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 10 MiB/s wr, 1.10k op/s 2023-07-21T23:04:37.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:37 smithi195 ceph-mon[97365]: pgmap v1447: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.8 MiB/s wr, 742 op/s 2023-07-21T23:04:37.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:37 smithi151 ceph-mon[95510]: pgmap v1447: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.8 MiB/s wr, 742 op/s 2023-07-21T23:04:37.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:37 smithi187 ceph-mon[96918]: pgmap v1447: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 6.8 MiB/s wr, 742 op/s 2023-07-21T23:04:39.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 705.0 s, 344.8 tps, lat 285.065 ms stddev 69.761 2023-07-21T23:04:39.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:39 smithi195 ceph-mon[97365]: pgmap v1448: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.06k op/s 2023-07-21T23:04:39.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:39 smithi151 ceph-mon[95510]: pgmap v1448: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.06k op/s 2023-07-21T23:04:39.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:39 smithi187 ceph-mon[96918]: pgmap v1448: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.06k op/s 2023-07-21T23:04:41.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:41 smithi195 ceph-mon[97365]: pgmap v1449: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.6 MiB/s wr, 1.02k op/s 2023-07-21T23:04:41.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:41 smithi151 ceph-mon[95510]: pgmap v1449: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.6 MiB/s wr, 1.02k op/s 2023-07-21T23:04:41.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:41 smithi187 ceph-mon[96918]: pgmap v1449: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.6 MiB/s wr, 1.02k op/s 2023-07-21T23:04:43.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:43 smithi151 ceph-mon[95510]: pgmap v1450: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.4 MiB/s wr, 896 op/s 2023-07-21T23:04:43.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:43 smithi187 ceph-mon[96918]: pgmap v1450: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.4 MiB/s wr, 896 op/s 2023-07-21T23:04:43.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:43 smithi195 ceph-mon[97365]: pgmap v1450: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 MiB/s rd, 8.4 MiB/s wr, 896 op/s 2023-07-21T23:04:44.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 710.0 s, 354.4 tps, lat 286.028 ms stddev 67.657 2023-07-21T23:04:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.497+0000 7f1697bff700 1 -- 172.21.15.151:0/1693450634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1690107e20 msgr2=0x7f169010c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.497+0000 7f1697bff700 1 --2- 172.21.15.151:0/1693450634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1690107e20 0x7f169010c560 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f16800098f0 tx=0x7f1680009c00 comp rx=0 tx=0).stop 2023-07-21T23:04:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.498+0000 7f1697bff700 1 -- 172.21.15.151:0/1693450634 shutdown_connections 2023-07-21T23:04:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.498+0000 7f1697bff700 1 --2- 172.21.15.151:0/1693450634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1690107510 0x7f16901078e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.498+0000 7f1697bff700 1 --2- 172.21.15.151:0/1693450634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f169010caa0 0x7f169010cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.498+0000 7f1697bff700 1 --2- 172.21.15.151:0/1693450634 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1690107e20 0x7f169010c560 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.498+0000 7f1697bff700 1 -- 172.21.15.151:0/1693450634 >> 172.21.15.151:0/1693450634 conn(0x7f169006c270 msgr2=0x7f169006c670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.498+0000 7f1697bff700 1 -- 172.21.15.151:0/1693450634 shutdown_connections 2023-07-21T23:04:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.498+0000 7f1697bff700 1 -- 172.21.15.151:0/1693450634 wait complete. 2023-07-21T23:04:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.499+0000 7f1697bff700 1 Processor -- start 2023-07-21T23:04:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.499+0000 7f1697bff700 1 -- start start 2023-07-21T23:04:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.500+0000 7f1697bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1690107510 0x7f16901aa970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.500+0000 7f1697bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1690107e20 0x7f16901aaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.500+0000 7f1697bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169010caa0 0x7f16901a47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.500+0000 7f1697bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16901a4e40 con 0x7f1690107510 2023-07-21T23:04:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.500+0000 7f1697bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16901a4fb0 con 0x7f169010caa0 2023-07-21T23:04:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.500+0000 7f1697bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16901a5170 con 0x7f1690107e20 2023-07-21T23:04:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169599b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1690107510 0x7f16901aa970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169599b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1690107510 0x7f16901aa970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56384/0 (socket says 172.21.15.151:56384) 2023-07-21T23:04:44.534 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169599b700 1 -- 172.21.15.151:0/888505575 learned_addr learned my addr 172.21.15.151:0/888505575 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169519a700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1690107e20 0x7f16901aaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169619c700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169010caa0 0x7f16901a47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169519a700 1 -- 172.21.15.151:0/888505575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169010caa0 msgr2=0x7f16901a47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169519a700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169010caa0 0x7f16901a47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169519a700 1 -- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1690107510 msgr2=0x7f16901aa970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169519a700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1690107510 0x7f16901aa970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.501+0000 7f169519a700 1 -- 172.21.15.151:0/888505575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1680009520 con 0x7f1690107e20 2023-07-21T23:04:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.502+0000 7f169619c700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169010caa0 0x7f16901a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:04:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.502+0000 7f169599b700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1690107510 0x7f16901aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:04:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.502+0000 7f169519a700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1690107e20 0x7f16901aaeb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1680000c00 tx=0x7f168000b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.503+0000 7f1686ffd700 1 -- 172.21.15.151:0/888505575 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1680005250 con 0x7f1690107e20 2023-07-21T23:04:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.504+0000 7f1686ffd700 1 -- 172.21.15.151:0/888505575 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1680003680 con 0x7f1690107e20 2023-07-21T23:04:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.504+0000 7f1686ffd700 1 -- 172.21.15.151:0/888505575 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16800216a0 con 0x7f1690107e20 2023-07-21T23:04:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.505+0000 7f1697bff700 1 -- 172.21.15.151:0/888505575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16901a53f0 con 0x7f1690107e20 2023-07-21T23:04:44.539 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.505+0000 7f1697bff700 1 -- 172.21.15.151:0/888505575 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16901b1960 con 0x7f1690107e20 2023-07-21T23:04:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.512+0000 7f1686ffd700 1 -- 172.21.15.151:0/888505575 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f16800037f0 con 0x7f1690107e20 2023-07-21T23:04:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.512+0000 7f16ab458b80 1 Processor -- start 2023-07-21T23:04:44.545 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.513+0000 7f16ab458b80 1 -- start start 2023-07-21T23:04:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.513+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469eb606b0 0x56469ed09cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.513+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a210 0x56469ed03f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.513+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a660 0x56469ed044a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.546 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.513+0000 7f16ab458b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ec09c50 con 0x56469ed0a210 2023-07-21T23:04:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.513+0000 7f16ab458b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ec5c9e0 con 0x56469eb606b0 2023-07-21T23:04:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.513+0000 7f16ab458b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ec55e70 con 0x56469ed0a660 2023-07-21T23:04:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.514+0000 7f169599b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a210 0x56469ed03f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.514+0000 7f169599b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a210 0x56469ed03f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:56392/0 (socket says 172.21.15.151:56392) 2023-07-21T23:04:44.547 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.514+0000 7f169599b700 1 -- 172.21.15.151:0/2414315341 learned_addr learned my addr 172.21.15.151:0/2414315341 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.515+0000 7f169599b700 1 -- 172.21.15.151:0/2414315341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a660 msgr2=0x56469ed044a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:04:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.515+0000 7f169599b700 1 --2- 172.21.15.151:0/2414315341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a660 0x56469ed044a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.515+0000 7f169599b700 1 -- 172.21.15.151:0/2414315341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469eb606b0 msgr2=0x56469ed09cd0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:04:44.548 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.515+0000 7f169599b700 1 --2- 172.21.15.151:0/2414315341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469eb606b0 0x56469ed09cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.515+0000 7f169599b700 1 -- 172.21.15.151:0/2414315341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56469ea83d80 con 0x56469ed0a210 2023-07-21T23:04:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.515+0000 7f1686ffd700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f167c0a1470 0x7f167c0a3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.515+0000 7f1686ffd700 1 -- 172.21.15.151:0/888505575 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f16800cd3f0 con 0x7f1690107e20 2023-07-21T23:04:44.549 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.515+0000 7f169599b700 1 --2- 172.21.15.151:0/2414315341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a210 0x56469ed03f40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f168c007960 tx=0x7f168c0092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b97890b64f0da8e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.516+0000 7f167bfff700 1 -- 172.21.15.151:0/2414315341 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c015850 con 0x56469ed0a210 2023-07-21T23:04:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.516+0000 7f167bfff700 1 -- 172.21.15.151:0/2414315341 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f168c00f040 con 0x56469ed0a210 2023-07-21T23:04:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.516+0000 7f167bfff700 1 -- 172.21.15.151:0/2414315341 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c010dc0 con 0x56469ed0a210 2023-07-21T23:04:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.516+0000 7f169619c700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f167c0a1470 0x7f167c0a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.517+0000 7f16ab458b80 1 -- 172.21.15.151:0/2414315341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a210 msgr2=0x56469ed03f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:44.550 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.517+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2414315341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a210 0x56469ed03f40 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f168c007960 tx=0x7f168c0092d0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.517+0000 7f16ab458b80 1 -- 172.21.15.151:0/2414315341 shutdown_connections 2023-07-21T23:04:44.551 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.517+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2414315341 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469eb606b0 0x56469ed09cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.517+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2414315341 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a660 0x56469ed044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.517+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2414315341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a210 0x56469ed03f40 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.517+0000 7f16ab458b80 1 -- 172.21.15.151:0/2414315341 >> 172.21.15.151:0/2414315341 conn(0x56469ecf9ae0 msgr2=0x56469ecff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.518+0000 7f169619c700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f167c0a1470 0x7f167c0a3920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1688005e90 tx=0x7f1688005d00 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.518+0000 7f16ab458b80 1 -- 172.21.15.151:0/2414315341 shutdown_connections 2023-07-21T23:04:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.518+0000 7f16ab458b80 1 -- 172.21.15.151:0/2414315341 wait complete. 2023-07-21T23:04:44.552 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.519+0000 7f16ab458b80 1 -- start start 2023-07-21T23:04:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.519+0000 7f16ab458b80 1 Processor -- start 2023-07-21T23:04:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.520+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed105c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.520+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 0x56469ed0d840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.520+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed0df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.520+0000 7f16ab458b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ebf5a60 con 0x56469ed0a660 2023-07-21T23:04:44.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.520+0000 7f16ab458b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ebf5760 con 0x56469ed0a210 2023-07-21T23:04:44.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.520+0000 7f16ab458b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ead98c0 con 0x56469eb606b0 2023-07-21T23:04:44.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.520+0000 7f16ab458b80 10 client.0 _ll_register_callbacks cb 0x56469ebf3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:44.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.522+0000 7f169599b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed105c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.522+0000 7f169599b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed105c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34868/0 (socket says 172.21.15.151:34868) 2023-07-21T23:04:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.522+0000 7f169599b700 1 -- 172.21.15.151:0/3876332477 learned_addr learned my addr 172.21.15.151:0/3876332477 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.522+0000 7f169619c700 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed0df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.523+0000 7f169519a700 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 0x56469ed0d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.523+0000 7f169599b700 1 -- 172.21.15.151:0/3876332477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 msgr2=0x56469ed0d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.523+0000 7f169599b700 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 0x56469ed0d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.523+0000 7f169599b700 1 -- 172.21.15.151:0/3876332477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 msgr2=0x56469ed0df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.523+0000 7f169599b700 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed0df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.523+0000 7f169599b700 1 -- 172.21.15.151:0/3876332477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f168c0075c0 con 0x56469eb606b0 2023-07-21T23:04:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.524+0000 7f169599b700 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed105c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f168c009610 tx=0x7f168c010a10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=975a1bf4dc5cda9d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.524+0000 7f16797fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:04:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.525+0000 7f16797fa700 1 -- 172.21.15.151:0/3876332477 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c015650 con 0x56469eb606b0 2023-07-21T23:04:44.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.525+0000 7f16797fa700 1 -- 172.21.15.151:0/3876332477 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f168c0157b0 con 0x56469eb606b0 2023-07-21T23:04:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.525+0000 7f16ab458b80 1 -- 172.21.15.151:0/3876332477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56469ebaf490 con 0x56469eb606b0 2023-07-21T23:04:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.525+0000 7f16797fa700 1 -- 172.21.15.151:0/3876332477 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f168c015970 con 0x56469eb606b0 2023-07-21T23:04:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.525+0000 7f16ab458b80 10 client.29458 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.526+0000 7f16ab458b80 1 -- 172.21.15.151:0/3876332477 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x56469ea6cc00 con 0x56469eb606b0 2023-07-21T23:04:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.526+0000 7f16797fa700 1 -- 172.21.15.151:0/3876332477 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56469ebaf490 con 0x56469eb606b0 2023-07-21T23:04:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.526+0000 7f16797fa700 1 -- 172.21.15.151:0/3876332477 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f168c027ba0 con 0x56469eb606b0 2023-07-21T23:04:44.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.527+0000 7f16ab458b80 10 client.29458 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.527+0000 7f16ab458b80 10 client.29458 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.527+0000 7f16ab458b80 20 client.29458 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.527+0000 7f16ab458b80 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56469ed1d9f0 0x56469ed1fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.527+0000 7f16ab458b80 4 client.29458 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:04:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.527+0000 7f16ab458b80 1 -- 172.21.15.151:0/3876332477 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56469ec4ee50 con 0x56469ed1d9f0 2023-07-21T23:04:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.527+0000 7f169519a700 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56469ed1d9f0 0x56469ed1fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.529+0000 7f169519a700 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56469ed1d9f0 0x56469ed1fe00 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a5e1432c38b1ea server_cookie=586c69d90984959 in_seq=0 out_seq=0 2023-07-21T23:04:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.529+0000 7f16797fa700 10 client.29458 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.530+0000 7f16797fa700 1 -- 172.21.15.151:0/3876332477 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56469ec4ee50 con 0x56469ed1d9f0 2023-07-21T23:04:44.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.530+0000 7f16797fa700 10 client.29458 handle_command_reply: tid=0 2023-07-21T23:04:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.530+0000 7f16ab458b80 1 client.29458 shutdown 2023-07-21T23:04:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.531+0000 7f16ab458b80 1 -- 172.21.15.151:0/3876332477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 msgr2=0x56469ed105c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.531+0000 7f16ab458b80 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed105c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f168c009610 tx=0x7f168c010a10 comp rx=0 tx=0).stop 2023-07-21T23:04:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.531+0000 7f16ab458b80 1 -- 172.21.15.151:0/3876332477 shutdown_connections 2023-07-21T23:04:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.531+0000 7f16ab458b80 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56469ed1d9f0 0x56469ed1fe00 crc :-1 s=READY pgs=505 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.531+0000 7f16ab458b80 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed0df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.531+0000 7f16ab458b80 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed105c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.531+0000 7f16ab458b80 1 --2- 172.21.15.151:0/3876332477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 0x56469ed0d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.531+0000 7f16ab458b80 1 -- 172.21.15.151:0/3876332477 >> 172.21.15.151:0/3876332477 conn(0x56469ecf9ae0 msgr2=0x56469ecfe3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.531+0000 7f16797fa700 0 client.29458 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.532+0000 7f16ab458b80 1 -- 172.21.15.151:0/3876332477 shutdown_connections 2023-07-21T23:04:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.532+0000 7f16ab458b80 1 -- 172.21.15.151:0/3876332477 wait complete. 2023-07-21T23:04:44.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.533+0000 7f16ab458b80 20 client.29458 trim_cache size 0 max 16384 2023-07-21T23:04:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.559+0000 7f16ab458b80 1 Processor -- start 2023-07-21T23:04:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.559+0000 7f16ab458b80 1 -- start start 2023-07-21T23:04:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469eb606b0 0x56469ed14c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a210 0x56469ed0b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed10160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f16ab458b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ecf6b40 con 0x56469ed0a660 2023-07-21T23:04:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f16ab458b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ed082a0 con 0x56469eb606b0 2023-07-21T23:04:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f16ab458b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ed05160 con 0x56469ed0a210 2023-07-21T23:04:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f169599b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469eb606b0 0x56469ed14c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f169519a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a210 0x56469ed0b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f169519a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a210 0x56469ed0b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34876/0 (socket says 172.21.15.151:34876) 2023-07-21T23:04:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.560+0000 7f169519a700 1 -- 172.21.15.151:0/421411325 learned_addr learned my addr 172.21.15.151:0/421411325 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:44.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.561+0000 7f169619c700 1 --2- 172.21.15.151:0/421411325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed10160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.561+0000 7f169519a700 1 -- 172.21.15.151:0/421411325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469eb606b0 msgr2=0x56469ed14c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.561+0000 7f169519a700 1 --2- 172.21.15.151:0/421411325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469eb606b0 0x56469ed14c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.561+0000 7f169519a700 1 -- 172.21.15.151:0/421411325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 msgr2=0x56469ed10160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.561+0000 7f169519a700 1 --2- 172.21.15.151:0/421411325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed10160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.561+0000 7f169519a700 1 -- 172.21.15.151:0/421411325 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56469eaaa1f0 con 0x56469ed0a210 2023-07-21T23:04:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.561+0000 7f169519a700 1 --2- 172.21.15.151:0/421411325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a210 0x56469ed0b140 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f168009a530 tx=0x7f1680009c00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=371d454568e9526c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.562+0000 7f1684bff700 1 -- 172.21.15.151:0/421411325 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1680099f00 con 0x56469ed0a210 2023-07-21T23:04:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.562+0000 7f1684bff700 1 -- 172.21.15.151:0/421411325 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f1680016360 con 0x56469ed0a210 2023-07-21T23:04:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.562+0000 7f1684bff700 1 -- 172.21.15.151:0/421411325 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1680003b10 con 0x56469ed0a210 2023-07-21T23:04:44.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.563+0000 7f16ab458b80 1 -- 172.21.15.151:0/421411325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a210 msgr2=0x56469ed0b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.563+0000 7f16ab458b80 1 --2- 172.21.15.151:0/421411325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a210 0x56469ed0b140 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f168009a530 tx=0x7f1680009c00 comp rx=0 tx=0).stop 2023-07-21T23:04:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.563+0000 7f16ab458b80 1 -- 172.21.15.151:0/421411325 shutdown_connections 2023-07-21T23:04:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.563+0000 7f16ab458b80 1 --2- 172.21.15.151:0/421411325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469eb606b0 0x56469ed14c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.563+0000 7f16ab458b80 1 --2- 172.21.15.151:0/421411325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed10160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.563+0000 7f16ab458b80 1 --2- 172.21.15.151:0/421411325 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469ed0a210 0x56469ed0b140 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.563+0000 7f16ab458b80 1 -- 172.21.15.151:0/421411325 >> 172.21.15.151:0/421411325 conn(0x56469ecf9ae0 msgr2=0x56469ed0aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.563+0000 7f16ab458b80 1 -- 172.21.15.151:0/421411325 shutdown_connections 2023-07-21T23:04:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.563+0000 7f16ab458b80 1 -- 172.21.15.151:0/421411325 wait complete. 2023-07-21T23:04:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.564+0000 7f16ab458b80 1 -- start start 2023-07-21T23:04:44.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.564+0000 7f16ab458b80 1 Processor -- start 2023-07-21T23:04:44.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.565+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed067b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.565+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 0x56469ed06cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.565+0000 7f16ab458b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed05730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.565+0000 7f16ab458b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ed072d0 con 0x56469ed0a660 2023-07-21T23:04:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.565+0000 7f16ab458b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ed07440 con 0x56469ed0a210 2023-07-21T23:04:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.565+0000 7f16ab458b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56469ed05ca0 con 0x56469eb606b0 2023-07-21T23:04:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.565+0000 7f16ab458b80 10 client.0 _ll_register_callbacks cb 0x7f168c0077e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.565+0000 7f169599b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed067b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169599b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed067b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34890/0 (socket says 172.21.15.151:34890) 2023-07-21T23:04:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169599b700 1 -- 172.21.15.151:0/2631170522 learned_addr learned my addr 172.21.15.151:0/2631170522 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169519a700 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 0x56469ed06cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169619c700 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed05730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169599b700 1 -- 172.21.15.151:0/2631170522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 msgr2=0x56469ed06cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169599b700 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 0x56469ed06cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169599b700 1 -- 172.21.15.151:0/2631170522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 msgr2=0x56469ed05730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:44.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169599b700 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed05730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169599b700 1 -- 172.21.15.151:0/2631170522 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16901b1960 con 0x56469eb606b0 2023-07-21T23:04:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.566+0000 7f169519a700 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 0x56469ed06cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:04:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.567+0000 7f169599b700 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed067b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f168c027f60 tx=0x7f168c009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0025e2656e0507c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.567+0000 7f16797fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:04:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.567+0000 7f16797fa700 1 -- 172.21.15.151:0/2631170522 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168c01dc30 con 0x56469eb606b0 2023-07-21T23:04:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.567+0000 7f16797fa700 1 -- 172.21.15.151:0/2631170522 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f168c005230 con 0x56469eb606b0 2023-07-21T23:04:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.567+0000 7f16ab458b80 1 -- 172.21.15.151:0/2631170522 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f168c00f040 con 0x56469eb606b0 2023-07-21T23:04:44.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.567+0000 7f16797fa700 1 -- 172.21.15.151:0/2631170522 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f168c01dd90 con 0x56469eb606b0 2023-07-21T23:04:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.567+0000 7f16ab458b80 10 client.29464 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.567+0000 7f16ab458b80 1 -- 172.21.15.151:0/2631170522 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x56469ea82250 con 0x56469eb606b0 2023-07-21T23:04:44.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.568+0000 7f16797fa700 1 -- 172.21.15.151:0/2631170522 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f168c00f040 con 0x56469eb606b0 2023-07-21T23:04:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.568+0000 7f16797fa700 1 -- 172.21.15.151:0/2631170522 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f168c015810 con 0x56469eb606b0 2023-07-21T23:04:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.568+0000 7f16ab458b80 10 client.29464 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.568+0000 7f16ab458b80 10 client.29464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.568+0000 7f16ab458b80 20 client.29464 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.568+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56469ed72080 0x56469ed74460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.568+0000 7f16ab458b80 4 client.29464 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:04:44.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.568+0000 7f16ab458b80 1 -- 172.21.15.151:0/2631170522 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56469ec10ff0 con 0x56469ed72080 2023-07-21T23:04:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.568+0000 7f169519a700 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56469ed72080 0x56469ed74460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.569+0000 7f16797fa700 10 client.29464 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:44.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.569+0000 7f169519a700 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56469ed72080 0x56469ed74460 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8165a0f968c2433f server_cookie=bbcf87057c17a5ed in_seq=0 out_seq=0 2023-07-21T23:04:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.601+0000 7f16797fa700 1 -- 172.21.15.151:0/2631170522 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56469ec10ff0 con 0x56469ed72080 2023-07-21T23:04:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.601+0000 7f16797fa700 10 client.29464 handle_command_reply: tid=0 2023-07-21T23:04:44.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.601+0000 7f16ab458b80 1 client.29464 shutdown 2023-07-21T23:04:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.603+0000 7f16ab458b80 1 -- 172.21.15.151:0/2631170522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 msgr2=0x56469ed067b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.603+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed067b0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f168c027f60 tx=0x7f168c009400 comp rx=0 tx=0).stop 2023-07-21T23:04:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.603+0000 7f16ab458b80 1 -- 172.21.15.151:0/2631170522 shutdown_connections 2023-07-21T23:04:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.603+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56469ed72080 0x56469ed74460 crc :-1 s=READY pgs=506 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.603+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56469ed0a660 0x56469ed05730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.603+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56469eb606b0 0x56469ed067b0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.604+0000 7f16ab458b80 1 --2- 172.21.15.151:0/2631170522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56469ed0a210 0x56469ed06cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.604+0000 7f16ab458b80 1 -- 172.21.15.151:0/2631170522 >> 172.21.15.151:0/2631170522 conn(0x56469ecf9ae0 msgr2=0x56469ed0b2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.604+0000 7f16797fa700 0 client.29464 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.604+0000 7f16ab458b80 1 -- 172.21.15.151:0/2631170522 shutdown_connections 2023-07-21T23:04:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.604+0000 7f16ab458b80 1 -- 172.21.15.151:0/2631170522 wait complete. 2023-07-21T23:04:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.604+0000 7f16ab458b80 20 client.29464 trim_cache size 0 max 16384 2023-07-21T23:04:44.638 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:04:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:04:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:04:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:04:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.605+0000 7f1697bff700 1 -- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f167c0a1470 msgr2=0x7f167c0a3920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.605+0000 7f1697bff700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f167c0a1470 0x7f167c0a3920 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1688005e90 tx=0x7f1688005d00 comp rx=0 tx=0).stop 2023-07-21T23:04:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.605+0000 7f1697bff700 1 -- 172.21.15.151:0/888505575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1690107e20 msgr2=0x7f16901aaeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.605+0000 7f1697bff700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1690107e20 0x7f16901aaeb0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1680000c00 tx=0x7f168000b860 comp rx=0 tx=0).stop 2023-07-21T23:04:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.606+0000 7f1697bff700 1 -- 172.21.15.151:0/888505575 shutdown_connections 2023-07-21T23:04:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.606+0000 7f1697bff700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f167c0a1470 0x7f167c0a3920 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.606+0000 7f1697bff700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f169010caa0 0x7f16901a47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.606+0000 7f1697bff700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1690107510 0x7f16901aa970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.606+0000 7f1697bff700 1 --2- 172.21.15.151:0/888505575 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f1690107e20 0x7f16901aaeb0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.606+0000 7f1697bff700 1 -- 172.21.15.151:0/888505575 >> 172.21.15.151:0/888505575 conn(0x7f169006c270 msgr2=0x7f169010a650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.606+0000 7f1697bff700 1 -- 172.21.15.151:0/888505575 shutdown_connections 2023-07-21T23:04:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:44.606+0000 7f1697bff700 1 -- 172.21.15.151:0/888505575 wait complete. 2023-07-21T23:04:45.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:45 smithi151 ceph-mon[95510]: pgmap v1451: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.37k op/s 2023-07-21T23:04:45.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:45 smithi187 ceph-mon[96918]: pgmap v1451: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.37k op/s 2023-07-21T23:04:45.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:45 smithi195 ceph-mon[97365]: pgmap v1451: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.37k op/s 2023-07-21T23:04:46.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:46 smithi187 ceph-mon[96918]: pgmap v1452: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 1.02k op/s 2023-07-21T23:04:46.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:46 smithi195 ceph-mon[97365]: pgmap v1452: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 1.02k op/s 2023-07-21T23:04:46.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:46 smithi151 ceph-mon[95510]: pgmap v1452: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 1.02k op/s 2023-07-21T23:04:49.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 715.0 s, 369.4 tps, lat 271.482 ms stddev 94.766 2023-07-21T23:04:49.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:49 smithi187 ceph-mon[96918]: pgmap v1453: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.32k op/s 2023-07-21T23:04:49.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:49 smithi195 ceph-mon[97365]: pgmap v1453: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.32k op/s 2023-07-21T23:04:49.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:49 smithi151 ceph-mon[95510]: pgmap v1453: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 12 MiB/s wr, 1.32k op/s 2023-07-21T23:04:51.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:51 smithi187 ceph-mon[96918]: pgmap v1454: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-07-21T23:04:51.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:51 smithi195 ceph-mon[97365]: pgmap v1454: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-07-21T23:04:51.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:51 smithi151 ceph-mon[95510]: pgmap v1454: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-07-21T23:04:53.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:53 smithi187 ceph-mon[96918]: pgmap v1455: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.7 MiB/s wr, 1.03k op/s 2023-07-21T23:04:53.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:53 smithi195 ceph-mon[97365]: pgmap v1455: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.7 MiB/s wr, 1.03k op/s 2023-07-21T23:04:53.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:53 smithi151 ceph-mon[95510]: pgmap v1455: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.7 MiB/s wr, 1.03k op/s 2023-07-21T23:04:54.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 720.0 s, 389.2 tps, lat 256.003 ms stddev 58.247 2023-07-21T23:04:55.366 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:55 smithi187 ceph-mon[96918]: pgmap v1456: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 14 MiB/s wr, 1.49k op/s 2023-07-21T23:04:55.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:55 smithi195 ceph-mon[97365]: pgmap v1456: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 14 MiB/s wr, 1.49k op/s 2023-07-21T23:04:55.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:55 smithi151 ceph-mon[95510]: pgmap v1456: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 14 MiB/s wr, 1.49k op/s 2023-07-21T23:04:57.366 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:57 smithi187 ceph-mon[96918]: pgmap v1457: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.4 MiB/s wr, 980 op/s 2023-07-21T23:04:57.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:57 smithi195 ceph-mon[97365]: pgmap v1457: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.4 MiB/s wr, 980 op/s 2023-07-21T23:04:57.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:57 smithi151 ceph-mon[95510]: pgmap v1457: 97 pgs: 97 active+clean; 12 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.4 MiB/s wr, 980 op/s 2023-07-21T23:04:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.934+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/3949145144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb48103430 msgr2=0x7fdb4810b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:57.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.934+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/3949145144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb48103430 0x7fdb4810b000 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00aad0 tx=0x7fdb3c00ade0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.935+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/3949145144 shutdown_connections 2023-07-21T23:04:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.935+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/3949145144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb48103430 0x7fdb4810b000 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.935+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/3949145144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb480fe3f0 0x7fdb480fe7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.935+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/3949145144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb480fed90 0x7fdb48102d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.935+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/3949145144 >> 172.21.15.151:0/3949145144 conn(0x7fdb48075f90 msgr2=0x7fdb48076390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.935+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/3949145144 shutdown_connections 2023-07-21T23:04:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.935+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/3949145144 wait complete. 2023-07-21T23:04:57.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.937+0000 7fdb4d1ff700 1 Processor -- start 2023-07-21T23:04:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.937+0000 7fdb4d1ff700 1 -- start start 2023-07-21T23:04:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4d1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb480fe3f0 0x7fdb4819c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4d1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb480fed90 0x7fdb4819c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4d1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb48103430 0x7fdb481a0d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4d1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb481a1350 con 0x7fdb48103430 2023-07-21T23:04:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4d1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb481a14c0 con 0x7fdb480fed90 2023-07-21T23:04:57.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4d1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb481a1680 con 0x7fdb480fe3f0 2023-07-21T23:04:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb480fed90 0x7fdb4819c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb480fed90 0x7fdb4819c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60944/0 (socket says 172.21.15.151:60944) 2023-07-21T23:04:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4659c700 1 -- 172.21.15.151:0/1798272186 learned_addr learned my addr 172.21.15.151:0/1798272186 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb480fe3f0 0x7fdb4819c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.938+0000 7fdb4759e700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb48103430 0x7fdb481a0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.939+0000 7fdb4659c700 1 -- 172.21.15.151:0/1798272186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb480fe3f0 msgr2=0x7fdb4819c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.939+0000 7fdb4659c700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb480fe3f0 0x7fdb4819c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.939+0000 7fdb4659c700 1 -- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb48103430 msgr2=0x7fdb481a0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.939+0000 7fdb4659c700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb48103430 0x7fdb481a0d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.939+0000 7fdb4659c700 1 -- 172.21.15.151:0/1798272186 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb3c00a700 con 0x7fdb480fed90 2023-07-21T23:04:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.939+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb480fe3f0 0x7fdb4819c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:04:57.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.939+0000 7fdb4659c700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb480fed90 0x7fdb4819c6a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdb40007ee0 tx=0x7fdb4000d3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.939+0000 7fdb2ffff700 1 -- 172.21.15.151:0/1798272186 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb4000dd20 con 0x7fdb480fed90 2023-07-21T23:04:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.940+0000 7fdb2ffff700 1 -- 172.21.15.151:0/1798272186 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb4000f040 con 0x7fdb480fed90 2023-07-21T23:04:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.940+0000 7fdb2ffff700 1 -- 172.21.15.151:0/1798272186 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400125f0 con 0x7fdb480fed90 2023-07-21T23:04:57.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.940+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/1798272186 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb481a1960 con 0x7fdb480fed90 2023-07-21T23:04:57.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.940+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/1798272186 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb481a91a0 con 0x7fdb480fed90 2023-07-21T23:04:57.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.947+0000 7fdb60ab0b80 1 Processor -- start 2023-07-21T23:04:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.947+0000 7fdb2ffff700 1 -- 172.21.15.151:0/1798272186 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fdb40015400 con 0x7fdb480fed90 2023-07-21T23:04:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.948+0000 7fdb60ab0b80 1 -- start start 2023-07-21T23:04:57.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.948+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5feacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.948+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 0x55dcf5fe4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.948+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb660 0x55dcf5fe54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.948+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf5eeac50 con 0x55dcf5e416b0 2023-07-21T23:04:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.948+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf5f3d9e0 con 0x55dcf5feb210 2023-07-21T23:04:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.948+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf5f36e70 con 0x55dcf5feb660 2023-07-21T23:04:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.949+0000 7fdb4659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb660 0x55dcf5fe54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.949+0000 7fdb4659c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb660 0x55dcf5fe54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38448/0 (socket says 172.21.15.151:38448) 2023-07-21T23:04:57.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.949+0000 7fdb4659c700 1 -- 172.21.15.151:0/2303578437 learned_addr learned my addr 172.21.15.151:0/2303578437 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:57.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.950+0000 7fdb4759e700 1 --2- 172.21.15.151:0/2303578437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5feacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.951+0000 7fdb4759e700 1 -- 172.21.15.151:0/2303578437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb660 msgr2=0x55dcf5fe54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.951+0000 7fdb4759e700 1 --2- 172.21.15.151:0/2303578437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb660 0x55dcf5fe54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.951+0000 7fdb4759e700 1 -- 172.21.15.151:0/2303578437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 msgr2=0x55dcf5fe4f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:04:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.951+0000 7fdb4759e700 1 --2- 172.21.15.151:0/2303578437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 0x55dcf5fe4f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.951+0000 7fdb4759e700 1 -- 172.21.15.151:0/2303578437 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcf5d64d80 con 0x55dcf5e416b0 2023-07-21T23:04:57.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.951+0000 7fdb4759e700 1 --2- 172.21.15.151:0/2303578437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5feacd0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00a9f0 tx=0x7fdb3c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efa4c0049400423 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:57.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.951+0000 7fdb2ffff700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb300a1380 0x7fdb300a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.952+0000 7fdb2ffff700 1 -- 172.21.15.151:0/1798272186 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdb400cc780 con 0x7fdb480fed90 2023-07-21T23:04:57.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.952+0000 7fdb2d7fa700 1 -- 172.21.15.151:0/2303578437 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c00cb70 con 0x55dcf5e416b0 2023-07-21T23:04:57.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.952+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb300a1380 0x7fdb300a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.985 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.952+0000 7fdb2d7fa700 1 -- 172.21.15.151:0/2303578437 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb3c00ccd0 con 0x55dcf5e416b0 2023-07-21T23:04:57.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.952+0000 7fdb2d7fa700 1 -- 172.21.15.151:0/2303578437 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c004310 con 0x55dcf5e416b0 2023-07-21T23:04:57.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.953+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/2303578437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 msgr2=0x55dcf5feacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:57.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.953+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/2303578437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5feacd0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00a9f0 tx=0x7fdb3c005c00 comp rx=0 tx=0).stop 2023-07-21T23:04:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.953+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb300a1380 0x7fdb300a3830 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdb38005950 tx=0x7fdb3800b410 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.953+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/2303578437 shutdown_connections 2023-07-21T23:04:57.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.953+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/2303578437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb660 0x55dcf5fe54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.953+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/2303578437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5feacd0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.953+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/2303578437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 0x55dcf5fe4f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.953+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/2303578437 >> 172.21.15.151:0/2303578437 conn(0x55dcf5fdaae0 msgr2=0x55dcf5fe00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.954+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/2303578437 shutdown_connections 2023-07-21T23:04:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.954+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/2303578437 wait complete. 2023-07-21T23:04:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.954+0000 7fdb60ab0b80 1 -- start start 2023-07-21T23:04:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.955+0000 7fdb60ab0b80 1 Processor -- start 2023-07-21T23:04:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.955+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5ff4640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.955+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb210 0x55dcf5ff4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.955+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf5fee8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.955+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf5ed6a60 con 0x55dcf5e416b0 2023-07-21T23:04:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.955+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf5ed6760 con 0x55dcf5feb660 2023-07-21T23:04:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.955+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf5dba8c0 con 0x55dcf5feb210 2023-07-21T23:04:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.955+0000 7fdb60ab0b80 10 client.0 _ll_register_callbacks cb 0x55dcf5ed4700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb46d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5ff4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb46d9d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5ff4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:55642/0 (socket says 172.21.15.151:55642) 2023-07-21T23:04:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb46d9d700 1 -- 172.21.15.151:0/3917225113 learned_addr learned my addr 172.21.15.151:0/3917225113 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb4759e700 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf5fee8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb4659c700 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb210 0x55dcf5ff4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb4759e700 1 -- 172.21.15.151:0/3917225113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb210 msgr2=0x55dcf5ff4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb4759e700 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb210 0x55dcf5ff4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb4759e700 1 -- 172.21.15.151:0/3917225113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 msgr2=0x55dcf5ff4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb4759e700 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5ff4640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb4759e700 1 -- 172.21.15.151:0/3917225113 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb3c01a040 con 0x55dcf5feb660 2023-07-21T23:04:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.956+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5ff4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:04:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.957+0000 7fdb4759e700 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf5fee8d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00aaa0 tx=0x7fdb3c005a60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10257dbc5a2e2034 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.957+0000 7fdb2aff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:04:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.957+0000 7fdb2aff5700 1 -- 172.21.15.151:0/3917225113 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c003ef0 con 0x55dcf5feb660 2023-07-21T23:04:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.958+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/3917225113 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55dcf5e90490 con 0x55dcf5feb660 2023-07-21T23:04:57.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.958+0000 7fdb2aff5700 1 -- 172.21.15.151:0/3917225113 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdb3c012070 con 0x55dcf5feb660 2023-07-21T23:04:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.958+0000 7fdb2aff5700 1 -- 172.21.15.151:0/3917225113 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb3c004050 con 0x55dcf5feb660 2023-07-21T23:04:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.958+0000 7fdb60ab0b80 10 client.29441 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.958+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/3917225113 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55dcf5d4dc00 con 0x55dcf5feb660 2023-07-21T23:04:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.958+0000 7fdb2aff5700 1 -- 172.21.15.151:0/3917225113 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55dcf5e90490 con 0x55dcf5feb660 2023-07-21T23:04:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.959+0000 7fdb2aff5700 1 -- 172.21.15.151:0/3917225113 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdb3c03dd00 con 0x55dcf5feb660 2023-07-21T23:04:57.995 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.959+0000 7fdb60ab0b80 10 client.29441 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.959+0000 7fdb60ab0b80 10 client.29441 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.959+0000 7fdb60ab0b80 20 client.29441 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.959+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dcf5ffe600 0x55dcf60009e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.959+0000 7fdb60ab0b80 4 client.29441 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:04:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.959+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/3917225113 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55dcf5f2fe50 con 0x55dcf5ffe600 2023-07-21T23:04:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.959+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dcf5ffe600 0x55dcf60009e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.960+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dcf5ffe600 0x55dcf60009e0 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=987a5023aa5ffe5b server_cookie=87577ea16519958e in_seq=0 out_seq=0 2023-07-21T23:04:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.960+0000 7fdb2aff5700 10 client.29441 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.960+0000 7fdb2aff5700 1 -- 172.21.15.151:0/3917225113 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55dcf5f2fe50 con 0x55dcf5ffe600 2023-07-21T23:04:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb2aff5700 10 client.29441 handle_command_reply: tid=0 2023-07-21T23:04:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb60ab0b80 1 client.29441 shutdown 2023-07-21T23:04:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/3917225113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 msgr2=0x55dcf5fee8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf5fee8d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c00aaa0 tx=0x7fdb3c005a60 comp rx=0 tx=0).stop 2023-07-21T23:04:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/3917225113 shutdown_connections 2023-07-21T23:04:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dcf5ffe600 0x55dcf60009e0 crc :-1 s=READY pgs=507 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf5fee8d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5e416b0 0x55dcf5ff4640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/3917225113 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5feb210 0x55dcf5ff4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb2aff5700 0 client.29441 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.961+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/3917225113 >> 172.21.15.151:0/3917225113 conn(0x55dcf5fdaae0 msgr2=0x55dcf5fdf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.962+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/3917225113 shutdown_connections 2023-07-21T23:04:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.962+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/3917225113 wait complete. 2023-07-21T23:04:57.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.962+0000 7fdb60ab0b80 20 client.29441 trim_cache size 0 max 16384 2023-07-21T23:04:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.984+0000 7fdb60ab0b80 1 Processor -- start 2023-07-21T23:04:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.984+0000 7fdb60ab0b80 1 -- start start 2023-07-21T23:04:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.984+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 0x55dcf5fea260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:58.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.984+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 0x55dcf5fdfb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.984+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb660 0x55dcf5fe00a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.984+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf5fe9440 con 0x55dcf5feb660 2023-07-21T23:04:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.984+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf5f2fe80 con 0x55dcf5feb210 2023-07-21T23:04:58.018 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.984+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf5fea920 con 0x55dcf5e416b0 2023-07-21T23:04:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb4659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 0x55dcf5fdfb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb4659c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 0x55dcf5fdfb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60974/0 (socket says 172.21.15.151:60974) 2023-07-21T23:04:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb4659c700 1 -- 172.21.15.151:0/4213921529 learned_addr learned my addr 172.21.15.151:0/4213921529 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:58.019 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/4213921529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 0x55dcf5fea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb4759e700 1 --2- 172.21.15.151:0/4213921529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb660 0x55dcf5fe00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb4659c700 1 -- 172.21.15.151:0/4213921529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 msgr2=0x55dcf5fea260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb4659c700 1 --2- 172.21.15.151:0/4213921529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 0x55dcf5fea260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb4659c700 1 -- 172.21.15.151:0/4213921529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb660 msgr2=0x55dcf5fe00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb4659c700 1 --2- 172.21.15.151:0/4213921529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb660 0x55dcf5fe00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.985+0000 7fdb4659c700 1 -- 172.21.15.151:0/4213921529 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55dcf6005550 con 0x55dcf5feb210 2023-07-21T23:04:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.986+0000 7fdb4659c700 1 --2- 172.21.15.151:0/4213921529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 0x55dcf5fdfb60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55dcf5feba70 tx=0x7fdb400d2530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff7e24e96794e10 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.986+0000 7fdb2dffb700 1 -- 172.21.15.151:0/4213921529 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb40015e90 con 0x55dcf5feb210 2023-07-21T23:04:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.986+0000 7fdb2dffb700 1 -- 172.21.15.151:0/4213921529 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb40095b50 con 0x55dcf5feb210 2023-07-21T23:04:58.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.986+0000 7fdb2dffb700 1 -- 172.21.15.151:0/4213921529 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb400b9310 con 0x55dcf5feb210 2023-07-21T23:04:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.987+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/4213921529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 msgr2=0x55dcf5fdfb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.987+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/4213921529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 0x55dcf5fdfb60 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x55dcf5feba70 tx=0x7fdb400d2530 comp rx=0 tx=0).stop 2023-07-21T23:04:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.987+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/4213921529 shutdown_connections 2023-07-21T23:04:58.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.987+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/4213921529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb660 0x55dcf5fe00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.987+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/4213921529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 0x55dcf5fea260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.987+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/4213921529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb210 0x55dcf5fdfb60 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.987+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/4213921529 >> 172.21.15.151:0/4213921529 conn(0x55dcf5fdaae0 msgr2=0x55dcf5fee7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.987+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/4213921529 shutdown_connections 2023-07-21T23:04:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.987+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/4213921529 wait complete. 2023-07-21T23:04:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.988+0000 7fdb60ab0b80 1 -- start start 2023-07-21T23:04:58.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.988+0000 7fdb60ab0b80 1 Processor -- start 2023-07-21T23:04:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 0x55dcf6046360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb210 0x55dcf60468a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb60ab0b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf60513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf60471b0 con 0x55dcf5feb210 2023-07-21T23:04:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf6051920 con 0x55dcf5feb660 2023-07-21T23:04:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb60ab0b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55dcf6051a60 con 0x55dcf5e416b0 2023-07-21T23:04:58.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb60ab0b80 10 client.0 _ll_register_callbacks cb 0x7fdb400d2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:04:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb46d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 0x55dcf6046360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb46d9d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 0x55dcf6046360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38492/0 (socket says 172.21.15.151:38492) 2023-07-21T23:04:58.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb46d9d700 1 -- 172.21.15.151:0/1148789717 learned_addr learned my addr 172.21.15.151:0/1148789717 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:04:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.989+0000 7fdb4759e700 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf60513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.990+0000 7fdb4659c700 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb210 0x55dcf60468a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.990+0000 7fdb4759e700 1 -- 172.21.15.151:0/1148789717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 msgr2=0x55dcf6046360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.990+0000 7fdb4759e700 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 0x55dcf6046360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.990+0000 7fdb4759e700 1 -- 172.21.15.151:0/1148789717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb210 msgr2=0x55dcf60468a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:04:58.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.990+0000 7fdb4759e700 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb210 0x55dcf60468a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.990+0000 7fdb4759e700 1 -- 172.21.15.151:0/1148789717 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb481a91a0 con 0x55dcf5feb660 2023-07-21T23:04:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.990+0000 7fdb4759e700 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf60513e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55dcf5fdcd20 tx=0x7fdb3c0346f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c543e80ec57cba7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:04:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.990+0000 7fdb2aff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:04:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.991+0000 7fdb2aff5700 1 -- 172.21.15.151:0/1148789717 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb3c0058e0 con 0x55dcf5feb660 2023-07-21T23:04:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.991+0000 7fdb2aff5700 1 -- 172.21.15.151:0/1148789717 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fdb3c000e40 con 0x55dcf5feb660 2023-07-21T23:04:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.991+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/1148789717 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdb3c00ccd0 con 0x55dcf5feb660 2023-07-21T23:04:58.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.991+0000 7fdb2aff5700 1 -- 172.21.15.151:0/1148789717 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdb3c005c00 con 0x55dcf5feb660 2023-07-21T23:04:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.991+0000 7fdb60ab0b80 10 client.29447 fetch_fsmap learned FSMap version 116 2023-07-21T23:04:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.992+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/1148789717 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55dcf5d8b1f0 con 0x55dcf5feb660 2023-07-21T23:04:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.992+0000 7fdb2aff5700 1 -- 172.21.15.151:0/1148789717 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fdb3c00ccd0 con 0x55dcf5feb660 2023-07-21T23:04:58.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.992+0000 7fdb2aff5700 1 -- 172.21.15.151:0/1148789717 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fdb3c0040b0 con 0x55dcf5feb660 2023-07-21T23:04:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.992+0000 7fdb60ab0b80 10 client.29447 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:04:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.992+0000 7fdb60ab0b80 10 client.29447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:04:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.992+0000 7fdb60ab0b80 20 client.29447 populate_metadata read hostname 'smithi151' 2023-07-21T23:04:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.992+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dcf6052be0 0x55dcf6054fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:04:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.992+0000 7fdb60ab0b80 4 client.29447 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:04:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.992+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/1148789717 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55dcf5ef1ff0 con 0x55dcf6052be0 2023-07-21T23:04:58.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.993+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dcf6052be0 0x55dcf6054fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:04:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.994+0000 7fdb46d9d700 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dcf6052be0 0x55dcf6054fc0 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1595c8eee31eb9e1 server_cookie=97a95b9780d56767 in_seq=0 out_seq=0 2023-07-21T23:04:58.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:57.994+0000 7fdb2aff5700 10 client.29447 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:58.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb2aff5700 1 -- 172.21.15.151:0/1148789717 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55dcf5ef1ff0 con 0x55dcf6052be0 2023-07-21T23:04:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb2aff5700 10 client.29447 handle_command_reply: tid=0 2023-07-21T23:04:58.064 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb60ab0b80 1 client.29447 shutdown 2023-07-21T23:04:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/1148789717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 msgr2=0x55dcf60513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf60513e0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x55dcf5fdcd20 tx=0x7fdb3c0346f0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/1148789717 shutdown_connections 2023-07-21T23:04:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55dcf6052be0 0x55dcf6054fc0 crc :-1 s=READY pgs=508 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55dcf5feb660 0x55dcf60513e0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55dcf5e416b0 0x55dcf6046360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb60ab0b80 1 --2- 172.21.15.151:0/1148789717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55dcf5feb210 0x55dcf60468a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.031+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/1148789717 >> 172.21.15.151:0/1148789717 conn(0x55dcf5fdaae0 msgr2=0x55dcf5fed0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.032+0000 7fdb2aff5700 0 client.29447 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.032+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/1148789717 shutdown_connections 2023-07-21T23:04:58.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.032+0000 7fdb60ab0b80 1 -- 172.21.15.151:0/1148789717 wait complete. 2023-07-21T23:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.032+0000 7fdb60ab0b80 20 client.29447 trim_cache size 0 max 16384 2023-07-21T23:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:04:58.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.033+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb300a1380 msgr2=0x7fdb300a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:58.068 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.033+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb300a1380 0x7fdb300a3830 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fdb38005950 tx=0x7fdb3800b410 comp rx=0 tx=0).stop 2023-07-21T23:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.033+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/1798272186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb480fed90 msgr2=0x7fdb4819c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.033+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb480fed90 0x7fdb4819c6a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fdb40007ee0 tx=0x7fdb4000d3b0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.034+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/1798272186 shutdown_connections 2023-07-21T23:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.034+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fdb300a1380 0x7fdb300a3830 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.034+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb48103430 0x7fdb481a0d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.034+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fdb480fe3f0 0x7fdb4819c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.069 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.034+0000 7fdb4d1ff700 1 --2- 172.21.15.151:0/1798272186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb480fed90 0x7fdb4819c6a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.034+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/1798272186 >> 172.21.15.151:0/1798272186 conn(0x7fdb48075f90 msgr2=0x7fdb480fbc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.034+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/1798272186 shutdown_connections 2023-07-21T23:04:58.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:04:58.034+0000 7fdb4d1ff700 1 -- 172.21.15.151:0/1798272186 wait complete. 2023-07-21T23:04:59.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 725.0 s, 366.8 tps, lat 272.815 ms stddev 63.081 2023-07-21T23:04:59.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:04:59 smithi187 ceph-mon[96918]: pgmap v1458: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-21T23:04:59.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:04:59 smithi195 ceph-mon[97365]: pgmap v1458: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-21T23:04:59.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:04:59 smithi151 ceph-mon[95510]: pgmap v1458: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-21T23:05:01.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:01 smithi195 ceph-mon[97365]: pgmap v1459: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.15k op/s 2023-07-21T23:05:01.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:01 smithi151 ceph-mon[95510]: pgmap v1459: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.15k op/s 2023-07-21T23:05:01.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:01 smithi187 ceph-mon[96918]: pgmap v1459: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.15k op/s 2023-07-21T23:05:03.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:03 smithi195 ceph-mon[97365]: pgmap v1460: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.4 MiB/s wr, 1.02k op/s 2023-07-21T23:05:03.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:03 smithi151 ceph-mon[95510]: pgmap v1460: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.4 MiB/s wr, 1.02k op/s 2023-07-21T23:05:03.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:03 smithi187 ceph-mon[96918]: pgmap v1460: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.4 MiB/s wr, 1.02k op/s 2023-07-21T23:05:04.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 730.0 s, 290.8 tps, lat 329.419 ms stddev 214.596 2023-07-21T23:05:05.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:05 smithi195 ceph-mon[97365]: pgmap v1461: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 13 MiB/s wr, 1.40k op/s 2023-07-21T23:05:05.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:05 smithi151 ceph-mon[95510]: pgmap v1461: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 13 MiB/s wr, 1.40k op/s 2023-07-21T23:05:05.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:05 smithi187 ceph-mon[96918]: pgmap v1461: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 13 MiB/s wr, 1.40k op/s 2023-07-21T23:05:07.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:07 smithi151 ceph-mon[95510]: pgmap v1462: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.5 MiB/s wr, 940 op/s 2023-07-21T23:05:07.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:07 smithi187 ceph-mon[96918]: pgmap v1462: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.5 MiB/s wr, 940 op/s 2023-07-21T23:05:07.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:07 smithi195 ceph-mon[97365]: pgmap v1462: 97 pgs: 97 active+clean; 13 GiB data, 28 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 8.5 MiB/s wr, 940 op/s 2023-07-21T23:05:09.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 735.0 s, 247.8 tps, lat 408.040 ms stddev 167.325 2023-07-21T23:05:09.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:09 smithi187 ceph-mon[96918]: pgmap v1463: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2023-07-21T23:05:09.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:09 smithi195 ceph-mon[97365]: pgmap v1463: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2023-07-21T23:05:09.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:09 smithi151 ceph-mon[95510]: pgmap v1463: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 1.13k op/s 2023-07-21T23:05:10.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:10 smithi187 ceph-mon[96918]: pgmap v1464: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.5 MiB/s wr, 928 op/s 2023-07-21T23:05:10.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:10 smithi195 ceph-mon[97365]: pgmap v1464: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.5 MiB/s wr, 928 op/s 2023-07-21T23:05:10.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:10 smithi151 ceph-mon[95510]: pgmap v1464: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 8.5 MiB/s wr, 928 op/s 2023-07-21T23:05:11.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.284+0000 7f47aa9ff700 1 -- 172.21.15.151:0/1249810521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 msgr2=0x7f47a4067d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.284+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/1249810521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 0x7f47a4067d70 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f4794009990 tx=0x7f4794009ca0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.285+0000 7f47aa9ff700 1 -- 172.21.15.151:0/1249810521 shutdown_connections 2023-07-21T23:05:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.285+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/1249810521 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47a410c540 0x7f47a410e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.285+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/1249810521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 0x7f47a4067d70 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.285+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/1249810521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a40682b0 0x7f47a410c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.285+0000 7f47aa9ff700 1 -- 172.21.15.151:0/1249810521 >> 172.21.15.151:0/1249810521 conn(0x7f47a4074760 msgr2=0x7f47a4074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:11.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.285+0000 7f47aa9ff700 1 -- 172.21.15.151:0/1249810521 shutdown_connections 2023-07-21T23:05:11.319 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.286+0000 7f47aa9ff700 1 -- 172.21.15.151:0/1249810521 wait complete. 2023-07-21T23:05:11.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.287+0000 7f47aa9ff700 1 Processor -- start 2023-07-21T23:05:11.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.290+0000 7f47aa9ff700 1 -- start start 2023-07-21T23:05:11.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.290+0000 7f47aa9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 0x7f47a4071a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.290+0000 7f47aa9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a40682b0 0x7f47a4071fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.290+0000 7f47aa9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47a410c540 0x7f47a406a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.290+0000 7f47aa9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a406b030 con 0x7f47a40679a0 2023-07-21T23:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.290+0000 7f47aa9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a406b1a0 con 0x7f47a40682b0 2023-07-21T23:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.290+0000 7f47aa9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a406b360 con 0x7f47a410c540 2023-07-21T23:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.291+0000 7f47a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 0x7f47a4071a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.291+0000 7f47a3fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 0x7f47a4071a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48686/0 (socket says 172.21.15.151:48686) 2023-07-21T23:05:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.291+0000 7f47a3fff700 1 -- 172.21.15.151:0/2439823555 learned_addr learned my addr 172.21.15.151:0/2439823555 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.292+0000 7f47a3fff700 1 -- 172.21.15.151:0/2439823555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47a410c540 msgr2=0x7f47a406a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.292+0000 7f47a3fff700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47a410c540 0x7f47a406a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.292+0000 7f47a3fff700 1 -- 172.21.15.151:0/2439823555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a40682b0 msgr2=0x7f47a4071fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T23:05:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.292+0000 7f47a3fff700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a40682b0 0x7f47a4071fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.292+0000 7f47a3fff700 1 -- 172.21.15.151:0/2439823555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c009c40 con 0x7f47a40679a0 2023-07-21T23:05:11.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.293+0000 7f47a3fff700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 0x7f47a4071a30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f4794005740 tx=0x7f4794005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.293+0000 7f47a17fa700 1 -- 172.21.15.151:0/2439823555 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479401d070 con 0x7f47a40679a0 2023-07-21T23:05:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.293+0000 7f47a17fa700 1 -- 172.21.15.151:0/2439823555 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f479400fbb0 con 0x7f47a40679a0 2023-07-21T23:05:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.293+0000 7f47a17fa700 1 -- 172.21.15.151:0/2439823555 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4794017650 con 0x7f47a40679a0 2023-07-21T23:05:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.294+0000 7f47aa9ff700 1 -- 172.21.15.151:0/2439823555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47940095f0 con 0x7f47a40679a0 2023-07-21T23:05:11.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.294+0000 7f47aa9ff700 1 -- 172.21.15.151:0/2439823555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a406f5c0 con 0x7f47a40679a0 2023-07-21T23:05:11.337 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.305+0000 7f47be2d3b80 1 Processor -- start 2023-07-21T23:05:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.305+0000 7f47be2d3b80 1 -- start start 2023-07-21T23:05:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.306+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a1524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.306+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152a20 0x558d1a14c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.306+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152e70 0x558d1a14ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.339 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.306+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a049c50 con 0x558d1a152e70 2023-07-21T23:05:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.306+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a09c9e0 con 0x558d19fa06b0 2023-07-21T23:05:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.306+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a095e70 con 0x558d1a152a20 2023-07-21T23:05:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.307+0000 7f47a3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152a20 0x558d1a14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.307+0000 7f47a3fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152a20 0x558d1a14c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52034/0 (socket says 172.21.15.151:52034) 2023-07-21T23:05:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.307+0000 7f47a3fff700 1 -- 172.21.15.151:0/2642834144 learned_addr learned my addr 172.21.15.151:0/2642834144 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.307+0000 7f47a8f9c700 1 --2- 172.21.15.151:0/2642834144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a1524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.308+0000 7f47a8f9c700 1 -- 172.21.15.151:0/2642834144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152a20 msgr2=0x558d1a14c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.308+0000 7f47a8f9c700 1 --2- 172.21.15.151:0/2642834144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152a20 0x558d1a14c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.308+0000 7f47a8f9c700 1 -- 172.21.15.151:0/2642834144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152e70 msgr2=0x558d1a14ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.308+0000 7f47a8f9c700 1 --2- 172.21.15.151:0/2642834144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152e70 0x558d1a14ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.308+0000 7f47a8f9c700 1 -- 172.21.15.151:0/2642834144 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d19ec3d80 con 0x558d19fa06b0 2023-07-21T23:05:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.308+0000 7f47a8f9c700 1 --2- 172.21.15.151:0/2642834144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a1524e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f47a40733d0 tx=0x7f479c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66d439a0531171 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.309+0000 7f478a7fc700 1 -- 172.21.15.151:0/2642834144 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c010040 con 0x558d19fa06b0 2023-07-21T23:05:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.309+0000 7f478a7fc700 1 -- 172.21.15.151:0/2642834144 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f479c003e90 con 0x558d19fa06b0 2023-07-21T23:05:11.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.309+0000 7f478a7fc700 1 -- 172.21.15.151:0/2642834144 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c004780 con 0x558d19fa06b0 2023-07-21T23:05:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.310+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2642834144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 msgr2=0x558d1a1524e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.310+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/2642834144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a1524e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f47a40733d0 tx=0x7f479c00b040 comp rx=0 tx=0).stop 2023-07-21T23:05:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.310+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2642834144 shutdown_connections 2023-07-21T23:05:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.310+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/2642834144 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a1524e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.310+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/2642834144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152e70 0x558d1a14ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.310+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/2642834144 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152a20 0x558d1a14c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.310+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2642834144 >> 172.21.15.151:0/2642834144 conn(0x558d1a139ae0 msgr2=0x558d1a13f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:11.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.312+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2642834144 shutdown_connections 2023-07-21T23:05:11.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.312+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2642834144 wait complete. 2023-07-21T23:05:11.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.313+0000 7f47be2d3b80 1 -- start start 2023-07-21T23:05:11.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.313+0000 7f47be2d3b80 1 Processor -- start 2023-07-21T23:05:11.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.313+0000 7f47a17fa700 1 -- 172.21.15.151:0/2439823555 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f479400fd20 con 0x7f47a40679a0 2023-07-21T23:05:11.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.315+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d19fa06b0 0x558d1a156080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.315+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d1a152a20 0x558d1a1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.315+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a156b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.315+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a035a60 con 0x558d19fa06b0 2023-07-21T23:05:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.315+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a035760 con 0x558d1a152a20 2023-07-21T23:05:11.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.315+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d19f198c0 con 0x558d1a152e70 2023-07-21T23:05:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.315+0000 7f47be2d3b80 10 client.0 _ll_register_callbacks cb 0x558d1a033700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:05:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.316+0000 7f47a37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a156b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.316+0000 7f47a37fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a156b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52050/0 (socket says 172.21.15.151:52050) 2023-07-21T23:05:11.349 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.316+0000 7f47a37fe700 1 -- 172.21.15.151:0/3379057567 learned_addr learned my addr 172.21.15.151:0/3379057567 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:11.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.317+0000 7f47a3fff700 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d1a152a20 0x558d1a1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.318+0000 7f47a17fa700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f478c0c33b0 0x7f478c0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.318+0000 7f47a17fa700 1 -- 172.21.15.151:0/2439823555 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47940ce250 con 0x7f47a40679a0 2023-07-21T23:05:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.319+0000 7f47a37fe700 1 -- 172.21.15.151:0/3379057567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d1a152a20 msgr2=0x558d1a1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.319+0000 7f47a37fe700 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d1a152a20 0x558d1a1565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.319+0000 7f47a37fe700 1 -- 172.21.15.151:0/3379057567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d19fa06b0 msgr2=0x558d1a156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.319+0000 7f47a37fe700 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d19fa06b0 0x558d1a156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.319+0000 7f47a37fe700 1 -- 172.21.15.151:0/3379057567 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f479c00e0c0 con 0x558d1a152e70 2023-07-21T23:05:11.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.319+0000 7f47a37fe700 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a156b00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f479800bc10 tx=0x7f479800d2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0116ef930d6305b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:11.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.324+0000 7f47837fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:05:11.356 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.324+0000 7f47837fe700 1 -- 172.21.15.151:0/3379057567 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800ddf0 con 0x558d1a152e70 2023-07-21T23:05:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.324+0000 7f47837fe700 1 -- 172.21.15.151:0/3379057567 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4798005030 con 0x558d1a152e70 2023-07-21T23:05:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.324+0000 7f47a8f9c700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f478c0c33b0 0x7f478c0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.324+0000 7f47be2d3b80 1 -- 172.21.15.151:0/3379057567 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x558d19fef490 con 0x558d1a152e70 2023-07-21T23:05:11.357 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.325+0000 7f47837fe700 1 -- 172.21.15.151:0/3379057567 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f479800b480 con 0x558d1a152e70 2023-07-21T23:05:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.325+0000 7f47be2d3b80 10 client.29491 fetch_fsmap learned FSMap version 116 2023-07-21T23:05:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.325+0000 7f47be2d3b80 1 -- 172.21.15.151:0/3379057567 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x558d19eacc00 con 0x558d1a152e70 2023-07-21T23:05:11.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.325+0000 7f47a8f9c700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f478c0c33b0 0x7f478c0c5860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f479c0040e0 tx=0x7f479c009f30 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.326+0000 7f47837fe700 1 -- 172.21.15.151:0/3379057567 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x558d19fef490 con 0x558d1a152e70 2023-07-21T23:05:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.326+0000 7f47837fe700 1 -- 172.21.15.151:0/3379057567 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4798010460 con 0x558d1a152e70 2023-07-21T23:05:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.326+0000 7f47be2d3b80 10 client.29491 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:05:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.326+0000 7f47be2d3b80 10 client.29491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:05:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.326+0000 7f47be2d3b80 20 client.29491 populate_metadata read hostname 'smithi151' 2023-07-21T23:05:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.326+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d1a166460 0x558d1a168870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.326+0000 7f47be2d3b80 4 client.29491 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:05:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.326+0000 7f47be2d3b80 1 -- 172.21.15.151:0/3379057567 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x558d1a08ee50 con 0x558d1a166460 2023-07-21T23:05:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.327+0000 7f47a3fff700 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d1a166460 0x558d1a168870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.328+0000 7f47a3fff700 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d1a166460 0x558d1a168870 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3a891621122e7fc server_cookie=dadecae9c63fd6a3 in_seq=0 out_seq=0 2023-07-21T23:05:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.328+0000 7f47837fe700 10 client.29491 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.329+0000 7f47837fe700 1 -- 172.21.15.151:0/3379057567 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x558d1a08ee50 con 0x558d1a166460 2023-07-21T23:05:11.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.329+0000 7f47837fe700 10 client.29491 handle_command_reply: tid=0 2023-07-21T23:05:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.329+0000 7f47be2d3b80 1 client.29491 shutdown 2023-07-21T23:05:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.330+0000 7f47be2d3b80 1 -- 172.21.15.151:0/3379057567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 msgr2=0x558d1a156b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:11.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.330+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a156b00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f479800bc10 tx=0x7f479800d2e0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.333+0000 7f47be2d3b80 1 -- 172.21.15.151:0/3379057567 shutdown_connections 2023-07-21T23:05:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.333+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d1a166460 0x558d1a168870 crc :-1 s=READY pgs=509 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.333+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a156b00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.333+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d19fa06b0 0x558d1a156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.333+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/3379057567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d1a152a20 0x558d1a1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.333+0000 7f47be2d3b80 1 -- 172.21.15.151:0/3379057567 >> 172.21.15.151:0/3379057567 conn(0x558d1a139ae0 msgr2=0x558d1a13e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:11.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.333+0000 7f47837fe700 0 client.29491 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.333+0000 7f47be2d3b80 1 -- 172.21.15.151:0/3379057567 shutdown_connections 2023-07-21T23:05:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.334+0000 7f47be2d3b80 1 -- 172.21.15.151:0/3379057567 wait complete. 2023-07-21T23:05:11.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.335+0000 7f47be2d3b80 20 client.29491 trim_cache size 0 max 16384 2023-07-21T23:05:11.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.363+0000 7f47be2d3b80 1 Processor -- start 2023-07-21T23:05:11.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.373+0000 7f47be2d3b80 1 -- start start 2023-07-21T23:05:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.373+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a15d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.373+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 0x558d1a1518b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.373+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a14c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.373+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a14d540 con 0x558d1a152a20 2023-07-21T23:05:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.373+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a1408d0 con 0x558d19fa06b0 2023-07-21T23:05:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.373+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a13b4f0 con 0x558d1a152e70 2023-07-21T23:05:11.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.375+0000 7f47a8f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a14c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.376+0000 7f47a8f9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a14c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:52066/0 (socket says 172.21.15.151:52066) 2023-07-21T23:05:11.409 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.376+0000 7f47a8f9c700 1 -- 172.21.15.151:0/2924409108 learned_addr learned my addr 172.21.15.151:0/2924409108 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.377+0000 7f47a8f9c700 1 -- 172.21.15.151:0/2924409108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 msgr2=0x558d1a15d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.377+0000 7f47a8f9c700 1 --2- 172.21.15.151:0/2924409108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a15d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.377+0000 7f47a8f9c700 1 -- 172.21.15.151:0/2924409108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 msgr2=0x558d1a1518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.377+0000 7f47a8f9c700 1 --2- 172.21.15.151:0/2924409108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 0x558d1a1518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.410 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.377+0000 7f47a8f9c700 1 -- 172.21.15.151:0/2924409108 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x558d19eea1f0 con 0x558d1a152e70 2023-07-21T23:05:11.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.382+0000 7f47a8f9c700 1 --2- 172.21.15.151:0/2924409108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a14c750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f479c00e3b0 tx=0x7f479c020000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=44b23e53916c0bb3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.397+0000 7f478affd700 1 -- 172.21.15.151:0/2924409108 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c0042b0 con 0x558d1a152e70 2023-07-21T23:05:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.397+0000 7f478affd700 1 -- 172.21.15.151:0/2924409108 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f479c0048a0 con 0x558d1a152e70 2023-07-21T23:05:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.397+0000 7f478affd700 1 -- 172.21.15.151:0/2924409108 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479c007e20 con 0x558d1a152e70 2023-07-21T23:05:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.400+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2924409108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 msgr2=0x558d1a14c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.400+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/2924409108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a14c750 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f479c00e3b0 tx=0x7f479c020000 comp rx=0 tx=0).stop 2023-07-21T23:05:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.407+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2924409108 shutdown_connections 2023-07-21T23:05:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.407+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/2924409108 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a15d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.407+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/2924409108 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a14c750 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.407+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/2924409108 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 0x558d1a1518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.407+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2924409108 >> 172.21.15.151:0/2924409108 conn(0x558d1a139ae0 msgr2=0x558d1a1511a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.408+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2924409108 shutdown_connections 2023-07-21T23:05:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.408+0000 7f47be2d3b80 1 -- 172.21.15.151:0/2924409108 wait complete. 2023-07-21T23:05:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.409+0000 7f47be2d3b80 1 -- start start 2023-07-21T23:05:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.409+0000 7f47be2d3b80 1 Processor -- start 2023-07-21T23:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.420+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a15b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.420+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 0x558d1a15b840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.420+0000 7f47be2d3b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.420+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a1b9440 con 0x558d1a152a20 2023-07-21T23:05:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.420+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a1b95b0 con 0x558d19fa06b0 2023-07-21T23:05:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.420+0000 7f47be2d3b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x558d1a140fa0 con 0x558d1a152e70 2023-07-21T23:05:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.420+0000 7f47be2d3b80 10 client.0 _ll_register_callbacks cb 0x558d1a033700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:05:11.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.421+0000 7f47a37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 0x558d1a15b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.422+0000 7f47a37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 0x558d1a15b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:48708/0 (socket says 172.21.15.151:48708) 2023-07-21T23:05:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.422+0000 7f47a37fe700 1 -- 172.21.15.151:0/1651885397 learned_addr learned my addr 172.21.15.151:0/1651885397 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.422+0000 7f47a37fe700 1 -- 172.21.15.151:0/1651885397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 msgr2=0x558d1a15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.422+0000 7f47a37fe700 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.422+0000 7f47a37fe700 1 -- 172.21.15.151:0/1651885397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 msgr2=0x558d1a15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:11.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.422+0000 7f47a37fe700 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a15b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.422+0000 7f47a37fe700 1 -- 172.21.15.151:0/1651885397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x558d19ec3d80 con 0x558d1a152a20 2023-07-21T23:05:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.423+0000 7f47a37fe700 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 0x558d1a15b840 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4798010c10 tx=0x7f479800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1c8a57f90b5697 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.426+0000 7f47837fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:05:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.426+0000 7f47837fe700 1 -- 172.21.15.151:0/1651885397 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798005040 con 0x558d1a152a20 2023-07-21T23:05:11.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.426+0000 7f47837fe700 1 -- 172.21.15.151:0/1651885397 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47980051a0 con 0x558d1a152a20 2023-07-21T23:05:11.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.426+0000 7f47be2d3b80 1 -- 172.21.15.151:0/1651885397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f479c003e90 con 0x558d1a152a20 2023-07-21T23:05:11.468 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.436+0000 7f47837fe700 1 -- 172.21.15.151:0/1651885397 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4798005360 con 0x558d1a152a20 2023-07-21T23:05:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.443+0000 7f47be2d3b80 10 client.19812 fetch_fsmap learned FSMap version 116 2023-07-21T23:05:11.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.443+0000 7f47be2d3b80 1 -- 172.21.15.151:0/1651885397 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x558d19ec2250 con 0x558d1a152a20 2023-07-21T23:05:11.487 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.455+0000 7f47837fe700 1 -- 172.21.15.151:0/1651885397 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f479c003e90 con 0x558d1a152a20 2023-07-21T23:05:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.455+0000 7f47837fe700 1 -- 172.21.15.151:0/1651885397 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4798003680 con 0x558d1a152a20 2023-07-21T23:05:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.455+0000 7f47be2d3b80 10 client.19812 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:05:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.455+0000 7f47be2d3b80 10 client.19812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:05:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.455+0000 7f47be2d3b80 20 client.19812 populate_metadata read hostname 'smithi151' 2023-07-21T23:05:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.455+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d1a142690 0x558d1a144aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:11.488 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.455+0000 7f47be2d3b80 4 client.19812 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:05:11.489 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.455+0000 7f47be2d3b80 1 -- 172.21.15.151:0/1651885397 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x558d1a050ff0 con 0x558d1a142690 2023-07-21T23:05:11.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.456+0000 7f47a3fff700 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d1a142690 0x558d1a144aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.478+0000 7f47a3fff700 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d1a142690 0x558d1a144aa0 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8966631b1c798ed server_cookie=b08e453ad68ff659 in_seq=0 out_seq=0 2023-07-21T23:05:11.511 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.479+0000 7f47837fe700 10 client.19812 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:11.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.577+0000 7f47837fe700 1 -- 172.21.15.151:0/1651885397 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x558d1a050ff0 con 0x558d1a142690 2023-07-21T23:05:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.577+0000 7f47837fe700 10 client.19812 handle_command_reply: tid=0 2023-07-21T23:05:11.610 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.577+0000 7f47be2d3b80 1 client.19812 shutdown 2023-07-21T23:05:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.580+0000 7f47be2d3b80 1 -- 172.21.15.151:0/1651885397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 msgr2=0x558d1a15b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.580+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 0x558d1a15b840 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7f4798010c10 tx=0x7f479800b4f0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.588+0000 7f47be2d3b80 1 -- 172.21.15.151:0/1651885397 shutdown_connections 2023-07-21T23:05:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.588+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x558d1a142690 0x558d1a144aa0 crc :-1 s=READY pgs=510 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.588+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x558d19fa06b0 0x558d1a15b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.588+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x558d1a152e70 0x558d1a15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.588+0000 7f47be2d3b80 1 --2- 172.21.15.151:0/1651885397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558d1a152a20 0x558d1a15b840 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.588+0000 7f47be2d3b80 1 -- 172.21.15.151:0/1651885397 >> 172.21.15.151:0/1651885397 conn(0x558d1a139ae0 msgr2=0x558d1a153ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:11.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.589+0000 7f47837fe700 0 client.19812 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:11.630 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.598+0000 7f47be2d3b80 1 -- 172.21.15.151:0/1651885397 shutdown_connections 2023-07-21T23:05:11.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.599+0000 7f47be2d3b80 1 -- 172.21.15.151:0/1651885397 wait complete. 2023-07-21T23:05:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.600+0000 7f47be2d3b80 20 client.19812 trim_cache size 0 max 16384 2023-07-21T23:05:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:05:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:05:11.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:05:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:05:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.602+0000 7f47aa9ff700 1 -- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f478c0c33b0 msgr2=0x7f478c0c5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.602+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f478c0c33b0 0x7f478c0c5860 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f479c0040e0 tx=0x7f479c009f30 comp rx=0 tx=0).stop 2023-07-21T23:05:11.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.602+0000 7f47aa9ff700 1 -- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 msgr2=0x7f47a4071a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.602+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 0x7f47a4071a30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f4794005740 tx=0x7f4794005e80 comp rx=0 tx=0).stop 2023-07-21T23:05:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.603+0000 7f47aa9ff700 1 -- 172.21.15.151:0/2439823555 shutdown_connections 2023-07-21T23:05:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.603+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f478c0c33b0 0x7f478c0c5860 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.603+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47a410c540 0x7f47a406a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.603+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47a40679a0 0x7f47a4071a30 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.603+0000 7f47aa9ff700 1 --2- 172.21.15.151:0/2439823555 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a40682b0 0x7f47a4071fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.603+0000 7f47aa9ff700 1 -- 172.21.15.151:0/2439823555 >> 172.21.15.151:0/2439823555 conn(0x7f47a4074760 msgr2=0x7f47a40fc5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.603+0000 7f47aa9ff700 1 -- 172.21.15.151:0/2439823555 shutdown_connections 2023-07-21T23:05:11.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:11.604+0000 7f47aa9ff700 1 -- 172.21.15.151:0/2439823555 wait complete. 2023-07-21T23:05:13.366 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:13 smithi187 ceph-mon[96918]: pgmap v1465: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 796 op/s 2023-07-21T23:05:13.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:13 smithi195 ceph-mon[97365]: pgmap v1465: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 796 op/s 2023-07-21T23:05:13.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:13 smithi151 ceph-mon[95510]: pgmap v1465: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 MiB/s rd, 7.1 MiB/s wr, 796 op/s 2023-07-21T23:05:14.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 740.0 s, 281.2 tps, lat 363.813 ms stddev 182.637 2023-07-21T23:05:15.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:15 smithi195 ceph-mon[97365]: pgmap v1466: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 1.11k op/s 2023-07-21T23:05:15.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:15 smithi151 ceph-mon[95510]: pgmap v1466: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 1.11k op/s 2023-07-21T23:05:15.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:15 smithi187 ceph-mon[96918]: pgmap v1466: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 10 MiB/s wr, 1.11k op/s 2023-07-21T23:05:17.397 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:17 smithi195 ceph-mon[97365]: pgmap v1467: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 699 op/s 2023-07-21T23:05:17.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:17 smithi151 ceph-mon[95510]: pgmap v1467: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 699 op/s 2023-07-21T23:05:17.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:17 smithi187 ceph-mon[96918]: pgmap v1467: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 MiB/s rd, 6.5 MiB/s wr, 699 op/s 2023-07-21T23:05:19.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 745.0 s, 382.6 tps, lat 263.546 ms stddev 66.230 2023-07-21T23:05:19.399 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:19 smithi195 ceph-mon[97365]: pgmap v1468: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 1.00k op/s 2023-07-21T23:05:19.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:19 smithi151 ceph-mon[95510]: pgmap v1468: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 1.00k op/s 2023-07-21T23:05:19.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:19 smithi187 ceph-mon[96918]: pgmap v1468: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.6 MiB/s wr, 1.00k op/s 2023-07-21T23:05:21.396 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:21 smithi195 ceph-mon[97365]: pgmap v1469: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 983 op/s 2023-07-21T23:05:21.441 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:21 smithi151 ceph-mon[95510]: pgmap v1469: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 983 op/s 2023-07-21T23:05:21.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:21 smithi187 ceph-mon[96918]: pgmap v1469: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 983 op/s 2023-07-21T23:05:23.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:23 smithi151 ceph-mon[95510]: pgmap v1470: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.5 MiB/s wr, 919 op/s 2023-07-21T23:05:23.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:23 smithi187 ceph-mon[96918]: pgmap v1470: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.5 MiB/s wr, 919 op/s 2023-07-21T23:05:23.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:23 smithi195 ceph-mon[97365]: pgmap v1470: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.5 MiB/s wr, 919 op/s 2023-07-21T23:05:24.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 750.0 s, 359.2 tps, lat 277.994 ms stddev 74.880 2023-07-21T23:05:25.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:25 smithi151 ceph-mon[95510]: pgmap v1471: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:05:25.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.547+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/2632523247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8106ff0 msgr2=0x7f0ea810ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.547+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/2632523247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8106ff0 0x7f0ea810ebc0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0009fc0 tx=0x7f0ea000b330 comp rx=0 tx=0).stop 2023-07-21T23:05:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.548+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/2632523247 shutdown_connections 2023-07-21T23:05:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.548+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/2632523247 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8106ff0 0x7f0ea810ebc0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.548+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/2632523247 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea8101fb0 0x7f0ea8102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.548+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/2632523247 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ea8102950 0x7f0ea8106910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.548+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/2632523247 >> 172.21.15.151:0/2632523247 conn(0x7f0ea80fd800 msgr2=0x7f0ea80ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:25.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.548+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/2632523247 shutdown_connections 2023-07-21T23:05:25.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.548+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/2632523247 wait complete. 2023-07-21T23:05:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.550+0000 7f0eaf9ff700 1 Processor -- start 2023-07-21T23:05:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.550+0000 7f0eaf9ff700 1 -- start start 2023-07-21T23:05:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.550+0000 7f0eaf9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ea8101fb0 0x7f0ea810e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.550+0000 7f0eaf9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8102950 0x7f0ea810b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.551+0000 7f0eaf9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea8106ff0 0x7f0ea810bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.551+0000 7f0eaf9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea810c440 con 0x7f0ea8102950 2023-07-21T23:05:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.551+0000 7f0eaf9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea810c580 con 0x7f0ea8101fb0 2023-07-21T23:05:25.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.551+0000 7f0eaf9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ea819e290 con 0x7f0ea8106ff0 2023-07-21T23:05:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.551+0000 7f0eadf9c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea8106ff0 0x7f0ea810bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.551+0000 7f0eacf9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8102950 0x7f0ea810b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.551+0000 7f0eacf9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8102950 0x7f0ea810b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44874/0 (socket says 172.21.15.151:44874) 2023-07-21T23:05:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.551+0000 7f0eacf9a700 1 -- 172.21.15.151:0/1983612385 learned_addr learned my addr 172.21.15.151:0/1983612385 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.552+0000 7f0ead79b700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ea8101fb0 0x7f0ea810e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.552+0000 7f0eacf9a700 1 -- 172.21.15.151:0/1983612385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea8106ff0 msgr2=0x7f0ea810bc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:25.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.552+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea8106ff0 0x7f0ea810bc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.552+0000 7f0eacf9a700 1 -- 172.21.15.151:0/1983612385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ea8101fb0 msgr2=0x7f0ea810e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.552+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ea8101fb0 0x7f0ea810e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.552+0000 7f0eacf9a700 1 -- 172.21.15.151:0/1983612385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ea0009c40 con 0x7f0ea8102950 2023-07-21T23:05:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.552+0000 7f0ead79b700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ea8101fb0 0x7f0ea810e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:05:25.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.553+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8102950 0x7f0ea810b730 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800e9c0 tx=0x7f0e9800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.553+0000 7f0e9e7fc700 1 -- 172.21.15.151:0/1983612385 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98009690 con 0x7f0ea8102950 2023-07-21T23:05:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.554+0000 7f0e9e7fc700 1 -- 172.21.15.151:0/1983612385 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e9800ce50 con 0x7f0ea8102950 2023-07-21T23:05:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.554+0000 7f0e9e7fc700 1 -- 172.21.15.151:0/1983612385 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e98010dd0 con 0x7f0ea8102950 2023-07-21T23:05:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.554+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/1983612385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ea819e540 con 0x7f0ea8102950 2023-07-21T23:05:25.588 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.554+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/1983612385 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea819ea00 con 0x7f0ea8102950 2023-07-21T23:05:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.561+0000 7f0e9e7fc700 1 -- 172.21.15.151:0/1983612385 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f0e98018420 con 0x7f0ea8102950 2023-07-21T23:05:25.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.562+0000 7f0ec32bab80 1 Processor -- start 2023-07-21T23:05:25.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.562+0000 7f0ec32bab80 1 -- start start 2023-07-21T23:05:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.563+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f397cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.563+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398210 0x56026f391f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.563+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398660 0x56026f3924a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.563+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f297c50 con 0x56026f1ee6b0 2023-07-21T23:05:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.563+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f2ea9e0 con 0x56026f398210 2023-07-21T23:05:25.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.563+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f2e3e70 con 0x56026f398660 2023-07-21T23:05:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.564+0000 7f0e9e7fc700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0e940a14d0 0x7f0e940a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.564+0000 7f0eadf9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f397cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.564+0000 7f0ead79b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398210 0x56026f391f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.564+0000 7f0eadf9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f397cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44884/0 (socket says 172.21.15.151:44884) 2023-07-21T23:05:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.564+0000 7f0eadf9c700 1 -- 172.21.15.151:0/2804989862 learned_addr learned my addr 172.21.15.151:0/2804989862 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.564+0000 7f0e9e7fc700 1 -- 172.21.15.151:0/1983612385 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0e98014070 con 0x7f0ea8102950 2023-07-21T23:05:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.564+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/2804989862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398660 0x56026f3924a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.564+0000 7f0eadf9c700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0e940a14d0 0x7f0e940a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.565+0000 7f0ead79b700 1 -- 172.21.15.151:0/2804989862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398660 msgr2=0x56026f3924a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.565+0000 7f0ead79b700 1 --2- 172.21.15.151:0/2804989862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398660 0x56026f3924a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.565+0000 7f0ead79b700 1 -- 172.21.15.151:0/2804989862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 msgr2=0x56026f397cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:25.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.565+0000 7f0ead79b700 1 --2- 172.21.15.151:0/2804989862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f397cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.565+0000 7f0ead79b700 1 -- 172.21.15.151:0/2804989862 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56026f111d80 con 0x56026f398210 2023-07-21T23:05:25.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.565+0000 7f0ead79b700 1 --2- 172.21.15.151:0/2804989862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398210 0x56026f391f40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40114f0 tx=0x7f0ea4011800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e17c1f7231fc2661 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.565+0000 7f0e937fe700 1 -- 172.21.15.151:0/2804989862 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4004230 con 0x56026f398210 2023-07-21T23:05:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.565+0000 7f0eadf9c700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0e940a14d0 0x7f0e940a3980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0006070 tx=0x7f0ea0005040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.566+0000 7f0e937fe700 1 -- 172.21.15.151:0/2804989862 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ea4004cc0 con 0x56026f398210 2023-07-21T23:05:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.566+0000 7f0e937fe700 1 -- 172.21.15.151:0/2804989862 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea40055f0 con 0x56026f398210 2023-07-21T23:05:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.567+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2804989862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398210 msgr2=0x56026f391f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.567+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/2804989862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398210 0x56026f391f40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f0ea40114f0 tx=0x7f0ea4011800 comp rx=0 tx=0).stop 2023-07-21T23:05:25.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.567+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2804989862 shutdown_connections 2023-07-21T23:05:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.567+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/2804989862 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398660 0x56026f3924a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.567+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/2804989862 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f397cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.567+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/2804989862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398210 0x56026f391f40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.567+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2804989862 >> 172.21.15.151:0/2804989862 conn(0x56026f387ae0 msgr2=0x56026f38d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:25.601 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.567+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2804989862 shutdown_connections 2023-07-21T23:05:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.567+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2804989862 wait complete. 2023-07-21T23:05:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.568+0000 7f0ec32bab80 1 -- start start 2023-07-21T23:05:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.568+0000 7f0ec32bab80 1 Processor -- start 2023-07-21T23:05:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.569+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f39e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.569+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f39b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.602 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.569+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f39be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.569+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f283a60 con 0x56026f1ee6b0 2023-07-21T23:05:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.569+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f283760 con 0x56026f398660 2023-07-21T23:05:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.569+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f1678c0 con 0x56026f398210 2023-07-21T23:05:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.569+0000 7f0ec32bab80 10 client.0 _ll_register_callbacks cb 0x56026f281700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:05:25.603 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.570+0000 7f0eadf9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f39be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.570+0000 7f0eadf9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f39be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:39308/0 (socket says 172.21.15.151:39308) 2023-07-21T23:05:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.570+0000 7f0eadf9c700 1 -- 172.21.15.151:0/779639479 learned_addr learned my addr 172.21.15.151:0/779639479 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.570+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f39b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.570+0000 7f0eadf9c700 1 -- 172.21.15.151:0/779639479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 msgr2=0x56026f39b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.570+0000 7f0eadf9c700 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f39b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.570+0000 7f0eadf9c700 1 -- 172.21.15.151:0/779639479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 msgr2=0x56026f39e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.570+0000 7f0eadf9c700 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f39e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.570+0000 7f0eadf9c700 1 -- 172.21.15.151:0/779639479 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea4009c90 con 0x56026f398660 2023-07-21T23:05:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.571+0000 7f0eadf9c700 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f39be20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b6c0 tx=0x7f0ea0009920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c6a8ccc3cd9b76a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.571+0000 7f0e90ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:05:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.572+0000 7f0e90ff9700 1 -- 172.21.15.151:0/779639479 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea002e070 con 0x56026f398660 2023-07-21T23:05:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.572+0000 7f0e90ff9700 1 -- 172.21.15.151:0/779639479 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0ea000bab0 con 0x56026f398660 2023-07-21T23:05:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.572+0000 7f0ec32bab80 1 -- 172.21.15.151:0/779639479 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56026f23d490 con 0x56026f398660 2023-07-21T23:05:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.572+0000 7f0e90ff9700 1 -- 172.21.15.151:0/779639479 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea000e040 con 0x56026f398660 2023-07-21T23:05:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.573+0000 7f0ec32bab80 10 client.29465 fetch_fsmap learned FSMap version 116 2023-07-21T23:05:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.573+0000 7f0ec32bab80 1 -- 172.21.15.151:0/779639479 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x56026f0fac00 con 0x56026f398660 2023-07-21T23:05:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.573+0000 7f0e90ff9700 1 -- 172.21.15.151:0/779639479 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56026f23d490 con 0x56026f398660 2023-07-21T23:05:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.574+0000 7f0e90ff9700 1 -- 172.21.15.151:0/779639479 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0ea0031020 con 0x56026f398660 2023-07-21T23:05:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.574+0000 7f0ec32bab80 10 client.29465 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:05:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.574+0000 7f0ec32bab80 10 client.29465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:05:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.574+0000 7f0ec32bab80 20 client.29465 populate_metadata read hostname 'smithi151' 2023-07-21T23:05:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.574+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56026f3abad0 0x56026f3adf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.574+0000 7f0ec32bab80 4 client.29465 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:05:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.574+0000 7f0ec32bab80 1 -- 172.21.15.151:0/779639479 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56026f2dce50 con 0x56026f3abad0 2023-07-21T23:05:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.574+0000 7f0ead79b700 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56026f3abad0 0x56026f3adf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.576+0000 7f0ead79b700 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56026f3abad0 0x56026f3adf00 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=281dd812de6a40 server_cookie=a4901423cbf6b2c0 in_seq=0 out_seq=0 2023-07-21T23:05:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.576+0000 7f0e90ff9700 10 client.29465 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.577+0000 7f0e90ff9700 1 -- 172.21.15.151:0/779639479 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56026f2dce50 con 0x56026f3abad0 2023-07-21T23:05:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.577+0000 7f0e90ff9700 10 client.29465 handle_command_reply: tid=0 2023-07-21T23:05:25.609 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.577+0000 7f0ec32bab80 1 client.29465 shutdown 2023-07-21T23:05:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.578+0000 7f0ec32bab80 1 -- 172.21.15.151:0/779639479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 msgr2=0x56026f39be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.578+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f39be20 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f0ea000b6c0 tx=0x7f0ea0009920 comp rx=0 tx=0).stop 2023-07-21T23:05:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.581+0000 7f0ec32bab80 1 -- 172.21.15.151:0/779639479 shutdown_connections 2023-07-21T23:05:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.581+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56026f3abad0 0x56026f3adf00 crc :-1 s=READY pgs=511 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.581+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f39be20 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.581+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f39e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.581+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/779639479 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f39b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.614 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.581+0000 7f0ec32bab80 1 -- 172.21.15.151:0/779639479 >> 172.21.15.151:0/779639479 conn(0x56026f387ae0 msgr2=0x56026f38c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.582+0000 7f0e90ff9700 0 client.29465 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:25.615 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.582+0000 7f0ec32bab80 1 -- 172.21.15.151:0/779639479 shutdown_connections 2023-07-21T23:05:25.616 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.583+0000 7f0ec32bab80 1 -- 172.21.15.151:0/779639479 wait complete. 2023-07-21T23:05:25.617 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.584+0000 7f0ec32bab80 20 client.29465 trim_cache size 0 max 16384 2023-07-21T23:05:25.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:25 smithi187 ceph-mon[96918]: pgmap v1471: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:05:25.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:25 smithi195 ceph-mon[97365]: pgmap v1471: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:05:25.645 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.613+0000 7f0ec32bab80 1 Processor -- start 2023-07-21T23:05:25.646 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.613+0000 7f0ec32bab80 1 -- start start 2023-07-21T23:05:25.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.614+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f1ee6b0 0x56026f38cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.648 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.614+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f38d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.614+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f398660 0x56026f394740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.614+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f3a7b00 con 0x56026f398660 2023-07-21T23:05:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.614+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f39c420 con 0x56026f1ee6b0 2023-07-21T23:05:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.614+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f39c800 con 0x56026f398210 2023-07-21T23:05:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0eacf9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f38d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0eacf9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f38d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:51940/0 (socket says 172.21.15.151:51940) 2023-07-21T23:05:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0eacf9a700 1 -- 172.21.15.151:0/2608230985 learned_addr learned my addr 172.21.15.151:0/2608230985 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:25.649 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0ead79b700 1 --2- 172.21.15.151:0/2608230985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f1ee6b0 0x56026f38cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0eadf9c700 1 --2- 172.21.15.151:0/2608230985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f398660 0x56026f394740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0eacf9a700 1 -- 172.21.15.151:0/2608230985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f1ee6b0 msgr2=0x56026f38cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/2608230985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f1ee6b0 0x56026f38cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0eacf9a700 1 -- 172.21.15.151:0/2608230985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f398660 msgr2=0x56026f394740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/2608230985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f398660 0x56026f394740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.615+0000 7f0eacf9a700 1 -- 172.21.15.151:0/2608230985 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56026f1381f0 con 0x56026f398210 2023-07-21T23:05:25.650 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.616+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/2608230985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f38d0a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0e980960a0 tx=0x7f0e9801a040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9b6326442740883c server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.616+0000 7f0e93fff700 1 -- 172.21.15.151:0/2608230985 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9809dc20 con 0x56026f398210 2023-07-21T23:05:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.616+0000 7f0e93fff700 1 -- 172.21.15.151:0/2608230985 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0e980a2040 con 0x56026f398210 2023-07-21T23:05:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.616+0000 7f0e93fff700 1 -- 172.21.15.151:0/2608230985 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e980990e0 con 0x56026f398210 2023-07-21T23:05:25.651 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.618+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2608230985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 msgr2=0x56026f38d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.618+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/2608230985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f38d0a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0e980960a0 tx=0x7f0e9801a040 comp rx=0 tx=0).stop 2023-07-21T23:05:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.618+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2608230985 shutdown_connections 2023-07-21T23:05:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.618+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/2608230985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f1ee6b0 0x56026f38cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.618+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/2608230985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f398660 0x56026f394740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.618+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/2608230985 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f38d0a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.652 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.618+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2608230985 >> 172.21.15.151:0/2608230985 conn(0x56026f387ae0 msgr2=0x56026f395990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.620+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2608230985 shutdown_connections 2023-07-21T23:05:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.620+0000 7f0ec32bab80 1 -- 172.21.15.151:0/2608230985 wait complete. 2023-07-21T23:05:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.620+0000 7f0ec32bab80 1 -- start start 2023-07-21T23:05:25.653 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.621+0000 7f0ec32bab80 1 Processor -- start 2023-07-21T23:05:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.622+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f3a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.622+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f3a1350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.654 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.622+0000 7f0ec32bab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f3fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.622+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f3fef60 con 0x56026f1ee6b0 2023-07-21T23:05:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.622+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f3ff0d0 con 0x56026f398660 2023-07-21T23:05:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.622+0000 7f0ec32bab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56026f3ff290 con 0x56026f398210 2023-07-21T23:05:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.622+0000 7f0ec32bab80 10 client.0 _ll_register_callbacks cb 0x7f0ea0007b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:05:25.655 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.623+0000 7f0eacf9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f3a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.623+0000 7f0eadf9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f3fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.623+0000 7f0ead79b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f3a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.623+0000 7f0ead79b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f3a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44904/0 (socket says 172.21.15.151:44904) 2023-07-21T23:05:25.656 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.623+0000 7f0ead79b700 1 -- 172.21.15.151:0/1102041174 learned_addr learned my addr 172.21.15.151:0/1102041174 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:25.657 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.625+0000 7f0ead79b700 1 -- 172.21.15.151:0/1102041174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 msgr2=0x56026f3a1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.625+0000 7f0ead79b700 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f3a1350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.625+0000 7f0ead79b700 1 -- 172.21.15.151:0/1102041174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 msgr2=0x56026f3fe9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.625+0000 7f0ead79b700 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f3fe9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.658 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.625+0000 7f0ead79b700 1 -- 172.21.15.151:0/1102041174 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ea819ea00 con 0x56026f1ee6b0 2023-07-21T23:05:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.626+0000 7f0ead79b700 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f3a0e10 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4005950 tx=0x7f0ea4004960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab4a706c9b45e43 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.626+0000 7f0e90ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:05:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.627+0000 7f0e90ff9700 1 -- 172.21.15.151:0/1102041174 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ea4028af0 con 0x56026f1ee6b0 2023-07-21T23:05:25.659 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.627+0000 7f0e90ff9700 1 -- 172.21.15.151:0/1102041174 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f0ea4028c50 con 0x56026f1ee6b0 2023-07-21T23:05:25.660 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.628+0000 7f0ec32bab80 1 -- 172.21.15.151:0/1102041174 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f0ea4004cc0 con 0x56026f1ee6b0 2023-07-21T23:05:25.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.628+0000 7f0e90ff9700 1 -- 172.21.15.151:0/1102041174 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0ea4028e10 con 0x56026f1ee6b0 2023-07-21T23:05:25.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.629+0000 7f0ec32bab80 10 client.19827 fetch_fsmap learned FSMap version 116 2023-07-21T23:05:25.661 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.629+0000 7f0ec32bab80 1 -- 172.21.15.151:0/1102041174 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x56026f110250 con 0x56026f1ee6b0 2023-07-21T23:05:25.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.630+0000 7f0e90ff9700 1 -- 172.21.15.151:0/1102041174 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f0ea4004cc0 con 0x56026f1ee6b0 2023-07-21T23:05:25.662 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.630+0000 7f0e90ff9700 1 -- 172.21.15.151:0/1102041174 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f0ea400e470 con 0x56026f1ee6b0 2023-07-21T23:05:25.663 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.631+0000 7f0ec32bab80 10 client.19827 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:05:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.631+0000 7f0ec32bab80 10 client.19827 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:05:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.631+0000 7f0ec32bab80 20 client.19827 populate_metadata read hostname 'smithi151' 2023-07-21T23:05:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.631+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56026f400840 0x56026f402c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.631+0000 7f0ec32bab80 4 client.19827 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:05:25.664 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.631+0000 7f0ec32bab80 1 -- 172.21.15.151:0/1102041174 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56026f29eff0 con 0x56026f400840 2023-07-21T23:05:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.632+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56026f400840 0x56026f402c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.632+0000 7f0eacf9a700 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56026f400840 0x56026f402c20 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67a52950f9e416f9 server_cookie=de4250852e630b90 in_seq=0 out_seq=0 2023-07-21T23:05:25.665 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.633+0000 7f0e90ff9700 10 client.19827 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:25.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.655+0000 7f0e90ff9700 1 -- 172.21.15.151:0/1102041174 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56026f29eff0 con 0x56026f400840 2023-07-21T23:05:25.687 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.655+0000 7f0e90ff9700 10 client.19827 handle_command_reply: tid=0 2023-07-21T23:05:25.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.655+0000 7f0ec32bab80 1 client.19827 shutdown 2023-07-21T23:05:25.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0ec32bab80 1 -- 172.21.15.151:0/1102041174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 msgr2=0x56026f3a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:25.688 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f3a0e10 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7f0ea4005950 tx=0x7f0ea4004960 comp rx=0 tx=0).stop 2023-07-21T23:05:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0ec32bab80 1 -- 172.21.15.151:0/1102041174 shutdown_connections 2023-07-21T23:05:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56026f400840 0x56026f402c20 crc :-1 s=READY pgs=512 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56026f398660 0x56026f3fe9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56026f1ee6b0 0x56026f3a0e10 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0ec32bab80 1 --2- 172.21.15.151:0/1102041174 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56026f398210 0x56026f3a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0ec32bab80 1 -- 172.21.15.151:0/1102041174 >> 172.21.15.151:0/1102041174 conn(0x56026f387ae0 msgr2=0x56026f39d090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0e90ff9700 0 client.19827 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.656+0000 7f0ec32bab80 1 -- 172.21.15.151:0/1102041174 shutdown_connections 2023-07-21T23:05:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.657+0000 7f0ec32bab80 1 -- 172.21.15.151:0/1102041174 wait complete. 2023-07-21T23:05:25.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.657+0000 7f0ec32bab80 20 client.19827 trim_cache size 0 max 16384 2023-07-21T23:05:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:05:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:05:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:05:25.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:05:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0e940a14d0 msgr2=0x7f0e940a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0e940a14d0 0x7f0e940a3980 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f0ea0006070 tx=0x7f0ea0005040 comp rx=0 tx=0).stop 2023-07-21T23:05:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8102950 msgr2=0x7f0ea810b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8102950 0x7f0ea810b730 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7f0e9800e9c0 tx=0x7f0e9800ecd0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/1983612385 shutdown_connections 2023-07-21T23:05:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f0e940a14d0 0x7f0e940a3980 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ea8101fb0 0x7f0ea810e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f0ea8106ff0 0x7f0ea810bc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 --2- 172.21.15.151:0/1983612385 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0ea8102950 0x7f0ea810b730 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/1983612385 >> 172.21.15.151:0/1983612385 conn(0x7f0ea80fd800 msgr2=0x7f0ea80ff020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/1983612385 shutdown_connections 2023-07-21T23:05:25.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:25.658+0000 7f0eaf9ff700 1 -- 172.21.15.151:0/1983612385 wait complete. 2023-07-21T23:05:27.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:27 smithi151 ceph-mon[95510]: pgmap v1472: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 983 op/s 2023-07-21T23:05:27.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:27 smithi187 ceph-mon[96918]: pgmap v1472: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 983 op/s 2023-07-21T23:05:27.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:27 smithi195 ceph-mon[97365]: pgmap v1472: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.5 MiB/s wr, 983 op/s 2023-07-21T23:05:29.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 755.0 s, 352.2 tps, lat 286.087 ms stddev 92.100 2023-07-21T23:05:29.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:29 smithi151 ceph-mon[95510]: pgmap v1473: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.30k op/s 2023-07-21T23:05:29.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:29 smithi187 ceph-mon[96918]: pgmap v1473: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.30k op/s 2023-07-21T23:05:29.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:29 smithi195 ceph-mon[97365]: pgmap v1473: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.30k op/s 2023-07-21T23:05:31.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:31 smithi187 ceph-mon[96918]: pgmap v1474: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-07-21T23:05:31.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:31 smithi195 ceph-mon[97365]: pgmap v1474: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-07-21T23:05:31.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:31 smithi151 ceph-mon[95510]: pgmap v1474: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-07-21T23:05:33.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:33 smithi187 ceph-mon[96918]: pgmap v1475: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-07-21T23:05:33.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:33 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:05:33.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:33 smithi195 ceph-mon[97365]: pgmap v1475: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-07-21T23:05:33.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:33 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:05:33.699 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:33 smithi151 ceph-mon[95510]: pgmap v1475: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-07-21T23:05:33.700 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:33 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:05:34.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 760.0 s, 347.8 tps, lat 286.154 ms stddev 101.361 2023-07-21T23:05:35.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:35 smithi187 ceph-mon[96918]: pgmap v1476: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.44k op/s 2023-07-21T23:05:35.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:35 smithi195 ceph-mon[97365]: pgmap v1476: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.44k op/s 2023-07-21T23:05:35.688 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:35 smithi151 ceph-mon[95510]: pgmap v1476: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 14 MiB/s wr, 1.44k op/s 2023-07-21T23:05:37.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:37 smithi187 ceph-mon[96918]: pgmap v1477: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 975 op/s 2023-07-21T23:05:37.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:05:37.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:05:37.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:37 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:05:37.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:37 smithi195 ceph-mon[97365]: pgmap v1477: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 975 op/s 2023-07-21T23:05:37.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:05:37.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:05:37.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:37 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:05:37.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:37 smithi151 ceph-mon[95510]: pgmap v1477: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.1 MiB/s wr, 975 op/s 2023-07-21T23:05:37.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:05:37.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:05:37.688 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:37 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:05:38.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:38 smithi187 ceph-mon[96918]: pgmap v1478: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 1.27k op/s 2023-07-21T23:05:38.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:38 smithi195 ceph-mon[97365]: pgmap v1478: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 1.27k op/s 2023-07-21T23:05:38.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:38 smithi151 ceph-mon[95510]: pgmap v1478: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 11 MiB/s wr, 1.27k op/s 2023-07-21T23:05:38.940 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.907+0000 7f47c5fff700 1 -- 172.21.15.151:0/1333659956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c00ff3e0 msgr2=0x7f47c0067900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.907+0000 7f47c5fff700 1 --2- 172.21.15.151:0/1333659956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c00ff3e0 0x7f47c0067900 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f47b8009990 tx=0x7f47b8009ca0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.908+0000 7f47c5fff700 1 -- 172.21.15.151:0/1333659956 shutdown_connections 2023-07-21T23:05:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.908+0000 7f47c5fff700 1 --2- 172.21.15.151:0/1333659956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c00ff3e0 0x7f47c0067900 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.908+0000 7f47c5fff700 1 --2- 172.21.15.151:0/1333659956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c0104a30 0x7f47c0104e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.908+0000 7f47c5fff700 1 --2- 172.21.15.151:0/1333659956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c00fea30 0x7f47c00feea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.908+0000 7f47c5fff700 1 -- 172.21.15.151:0/1333659956 >> 172.21.15.151:0/1333659956 conn(0x7f47c0074760 msgr2=0x7f47c0074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:38.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.908+0000 7f47c5fff700 1 -- 172.21.15.151:0/1333659956 shutdown_connections 2023-07-21T23:05:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.908+0000 7f47c5fff700 1 -- 172.21.15.151:0/1333659956 wait complete. 2023-07-21T23:05:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.909+0000 7f47c5fff700 1 Processor -- start 2023-07-21T23:05:38.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.909+0000 7f47c5fff700 1 -- start start 2023-07-21T23:05:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47c5fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c00fea30 0x7f47c0101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47c5fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c00ff3e0 0x7f47c01015c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47c5fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c0104a30 0x7f47c0101b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47c5fff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c01a8500 con 0x7f47c00fea30 2023-07-21T23:05:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47c5fff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c01a8670 con 0x7f47c0104a30 2023-07-21T23:05:38.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47c5fff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47c01a8830 con 0x7f47c00ff3e0 2023-07-21T23:05:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47beffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c00ff3e0 0x7f47c01015c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47beffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c00ff3e0 0x7f47c01015c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48706/0 (socket says 172.21.15.151:48706) 2023-07-21T23:05:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47beffd700 1 -- 172.21.15.151:0/2091578705 learned_addr learned my addr 172.21.15.151:0/2091578705 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.910+0000 7f47bffff700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c0104a30 0x7f47c0101b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.911+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c00fea30 0x7f47c0101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.911+0000 7f47beffd700 1 -- 172.21.15.151:0/2091578705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c0104a30 msgr2=0x7f47c0101b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.911+0000 7f47beffd700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c0104a30 0x7f47c0101b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.911+0000 7f47beffd700 1 -- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c00fea30 msgr2=0x7f47c0101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:38.945 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.911+0000 7f47beffd700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c00fea30 0x7f47c0101080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.911+0000 7f47beffd700 1 -- 172.21.15.151:0/2091578705 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47b80095f0 con 0x7f47c00ff3e0 2023-07-21T23:05:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.912+0000 7f47beffd700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c00ff3e0 0x7f47c01015c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e9a0 tx=0x7f47b400ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.912+0000 7f47bcff9700 1 -- 172.21.15.151:0/2091578705 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b400ca10 con 0x7f47c00ff3e0 2023-07-21T23:05:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.912+0000 7f47c5fff700 1 -- 172.21.15.151:0/2091578705 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47c01a8b10 con 0x7f47c00ff3e0 2023-07-21T23:05:38.946 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.912+0000 7f47bcff9700 1 -- 172.21.15.151:0/2091578705 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47b4010430 con 0x7f47c00ff3e0 2023-07-21T23:05:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.912+0000 7f47bcff9700 1 -- 172.21.15.151:0/2091578705 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b4018680 con 0x7f47c00ff3e0 2023-07-21T23:05:38.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.912+0000 7f47c5fff700 1 -- 172.21.15.151:0/2091578705 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c01a9070 con 0x7f47c00ff3e0 2023-07-21T23:05:38.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.917+0000 7f47bcff9700 1 -- 172.21.15.151:0/2091578705 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f47b40105a0 con 0x7f47c00ff3e0 2023-07-21T23:05:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.919+0000 7f47d99cfb80 1 Processor -- start 2023-07-21T23:05:38.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.919+0000 7f47d99cfb80 1 -- start start 2023-07-21T23:05:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea5048dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e210 0x55ea50487f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e660 0x55ea504884a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5038dc50 con 0x55ea5048e660 2023-07-21T23:05:38.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea503e09e0 con 0x55ea5048e210 2023-07-21T23:05:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea503d9e70 con 0x55ea502e46b0 2023-07-21T23:05:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e210 0x55ea50487f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.953 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e210 0x55ea50487f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54594/0 (socket says 172.21.15.151:54594) 2023-07-21T23:05:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47bf7fe700 1 -- 172.21.15.151:0/1503758244 learned_addr learned my addr 172.21.15.151:0/1503758244 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.920+0000 7f47bffff700 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea5048dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.921+0000 7f47beffd700 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e660 0x55ea504884a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.921+0000 7f47bf7fe700 1 -- 172.21.15.151:0/1503758244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 msgr2=0x55ea5048dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:38.954 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.921+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea5048dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.921+0000 7f47bf7fe700 1 -- 172.21.15.151:0/1503758244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e660 msgr2=0x55ea504884a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.921+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e660 0x55ea504884a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.921+0000 7f47bf7fe700 1 -- 172.21.15.151:0/1503758244 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea50207d80 con 0x55ea5048e210 2023-07-21T23:05:38.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.921+0000 7f47bffff700 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea5048dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:05:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.921+0000 7f47bcff9700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47a80a1340 0x7f47a80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.921+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e210 0x55ea50487f40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009e80 tx=0x7f47b00077e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb6e0f997fcedc51 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.922+0000 7f47bcff9700 1 -- 172.21.15.151:0/2091578705 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47b4014070 con 0x7f47c00ff3e0 2023-07-21T23:05:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.922+0000 7f47a5ffb700 1 -- 172.21.15.151:0/1503758244 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0003a00 con 0x55ea5048e210 2023-07-21T23:05:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.922+0000 7f47a5ffb700 1 -- 172.21.15.151:0/1503758244 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47b000f040 con 0x55ea5048e210 2023-07-21T23:05:38.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.922+0000 7f47a5ffb700 1 -- 172.21.15.151:0/1503758244 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0004290 con 0x55ea5048e210 2023-07-21T23:05:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.922+0000 7f47bffff700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47a80a1340 0x7f47a80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.923+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1503758244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e210 msgr2=0x55ea50487f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.923+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e210 0x55ea50487f40 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009e80 tx=0x7f47b00077e0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.923+0000 7f47bffff700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47a80a1340 0x7f47a80a37f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f47b8006010 tx=0x7f47b800b260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.924+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1503758244 shutdown_connections 2023-07-21T23:05:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.924+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e660 0x55ea504884a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.924+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea5048dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.924+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1503758244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e210 0x55ea50487f40 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.924+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1503758244 >> 172.21.15.151:0/1503758244 conn(0x55ea5047dae0 msgr2=0x55ea504830e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:38.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.924+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1503758244 shutdown_connections 2023-07-21T23:05:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.924+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1503758244 wait complete. 2023-07-21T23:05:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.925+0000 7f47d99cfb80 1 -- start start 2023-07-21T23:05:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.925+0000 7f47d99cfb80 1 Processor -- start 2023-07-21T23:05:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.926+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea502e46b0 0x55ea50494560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.926+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e210 0x55ea504917e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.926+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e660 0x55ea50491dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.926+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea50379a60 con 0x55ea5048e210 2023-07-21T23:05:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.926+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea50379760 con 0x55ea502e46b0 2023-07-21T23:05:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.927+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5025d8c0 con 0x55ea5048e660 2023-07-21T23:05:38.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.927+0000 7f47d99cfb80 10 client.0 _ll_register_callbacks cb 0x55ea50377700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:05:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.927+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea502e46b0 0x55ea50494560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.927+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea502e46b0 0x55ea50494560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54604/0 (socket says 172.21.15.151:54604) 2023-07-21T23:05:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.927+0000 7f47bf7fe700 1 -- 172.21.15.151:0/1943481656 learned_addr learned my addr 172.21.15.151:0/1943481656 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.927+0000 7f47bffff700 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e660 0x55ea50491dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.928+0000 7f47bf7fe700 1 -- 172.21.15.151:0/1943481656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e660 msgr2=0x55ea50491dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:38.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.928+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e660 0x55ea50491dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.928+0000 7f47bf7fe700 1 -- 172.21.15.151:0/1943481656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e210 msgr2=0x55ea504917e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.928+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e210 0x55ea504917e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.928+0000 7f47bf7fe700 1 -- 172.21.15.151:0/1943481656 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47c00681c0 con 0x55ea502e46b0 2023-07-21T23:05:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.928+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea502e46b0 0x55ea50494560 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f47b0004d00 tx=0x7f47b0004d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=68036ef8d2c8f044 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:38.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.928+0000 7f479effd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:05:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.929+0000 7f479effd700 1 -- 172.21.15.151:0/1943481656 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0015e40 con 0x55ea502e46b0 2023-07-21T23:05:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.929+0000 7f479effd700 1 -- 172.21.15.151:0/1943481656 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47b0003a00 con 0x55ea502e46b0 2023-07-21T23:05:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.929+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1943481656 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ea50333490 con 0x55ea502e46b0 2023-07-21T23:05:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.929+0000 7f479effd700 1 -- 172.21.15.151:0/1943481656 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47b0003bc0 con 0x55ea502e46b0 2023-07-21T23:05:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.930+0000 7f47d99cfb80 10 client.29480 fetch_fsmap learned FSMap version 116 2023-07-21T23:05:38.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.930+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1943481656 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x7f47b0009ab0 con 0x55ea502e46b0 2023-07-21T23:05:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.930+0000 7f479effd700 1 -- 172.21.15.151:0/1943481656 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ea50333490 con 0x55ea502e46b0 2023-07-21T23:05:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.931+0000 7f479effd700 1 -- 172.21.15.151:0/1943481656 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f47b001c070 con 0x55ea502e46b0 2023-07-21T23:05:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.931+0000 7f47d99cfb80 10 client.29480 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:05:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.931+0000 7f47d99cfb80 10 client.29480 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:05:38.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.931+0000 7f47d99cfb80 20 client.29480 populate_metadata read hostname 'smithi151' 2023-07-21T23:05:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.931+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea504b29c0 0x55ea504b4dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.931+0000 7f47d99cfb80 4 client.29480 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:05:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.931+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1943481656 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ea503d2e50 con 0x55ea504b29c0 2023-07-21T23:05:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.931+0000 7f47beffd700 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea504b29c0 0x55ea504b4dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.933+0000 7f47beffd700 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea504b29c0 0x55ea504b4dd0 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47bcb6284def84b server_cookie=9f457ebb99f34543 in_seq=0 out_seq=0 2023-07-21T23:05:38.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.933+0000 7f479effd700 10 client.29480 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.935+0000 7f479effd700 1 -- 172.21.15.151:0/1943481656 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ea503d2e50 con 0x55ea504b29c0 2023-07-21T23:05:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.935+0000 7f479effd700 10 client.29480 handle_command_reply: tid=0 2023-07-21T23:05:38.967 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.935+0000 7f47d99cfb80 1 client.29480 shutdown 2023-07-21T23:05:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.935+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1943481656 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea502e46b0 msgr2=0x55ea50494560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.935+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea502e46b0 0x55ea50494560 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f47b0004d00 tx=0x7f47b0004d30 comp rx=0 tx=0).stop 2023-07-21T23:05:38.968 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1943481656 shutdown_connections 2023-07-21T23:05:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea504b29c0 0x55ea504b4dd0 crc :-1 s=READY pgs=513 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea502e46b0 0x55ea50494560 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e660 0x55ea50491dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1943481656 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e210 0x55ea504917e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1943481656 >> 172.21.15.151:0/1943481656 conn(0x55ea5047dae0 msgr2=0x55ea504823e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:38.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f479effd700 0 client.29480 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1943481656 shutdown_connections 2023-07-21T23:05:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1943481656 wait complete. 2023-07-21T23:05:38.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.936+0000 7f47d99cfb80 20 client.29480 trim_cache size 0 max 16384 2023-07-21T23:05:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.964+0000 7f47d99cfb80 1 Processor -- start 2023-07-21T23:05:38.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.965+0000 7f47d99cfb80 1 -- start start 2023-07-21T23:05:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.965+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea50487f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.965+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e210 0x55ea50498c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.965+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 0x55ea5048f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.965+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea50488520 con 0x55ea5048e210 2023-07-21T23:05:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.965+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5048fd90 con 0x55ea5048e660 2023-07-21T23:05:38.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.965+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea5048c440 con 0x55ea502e46b0 2023-07-21T23:05:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.966+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea50487f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.966+0000 7f47beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e210 0x55ea50498c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.966+0000 7f47bffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 0x55ea5048f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.966+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea50487f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:48734/0 (socket says 172.21.15.151:48734) 2023-07-21T23:05:38.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.966+0000 7f47bf7fe700 1 -- 172.21.15.151:0/753350337 learned_addr learned my addr 172.21.15.151:0/753350337 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.967+0000 7f47bf7fe700 1 -- 172.21.15.151:0/753350337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 msgr2=0x55ea5048f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.967+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/753350337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 0x55ea5048f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.967+0000 7f47bf7fe700 1 -- 172.21.15.151:0/753350337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e210 msgr2=0x55ea50498c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.967+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/753350337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e210 0x55ea50498c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.967+0000 7f47bf7fe700 1 -- 172.21.15.151:0/753350337 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ea501f0c00 con 0x55ea502e46b0 2023-07-21T23:05:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.967+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/753350337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea50487f40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f47b0007820 tx=0x7f47b0007b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dc8c69019a619f2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.967+0000 7f47a67fc700 1 -- 172.21.15.151:0/753350337 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0015e40 con 0x55ea502e46b0 2023-07-21T23:05:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.968+0000 7f47a67fc700 1 -- 172.21.15.151:0/753350337 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47b00097e0 con 0x55ea502e46b0 2023-07-21T23:05:39.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.968+0000 7f47a67fc700 1 -- 172.21.15.151:0/753350337 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b0005540 con 0x55ea502e46b0 2023-07-21T23:05:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.969+0000 7f47d99cfb80 1 -- 172.21.15.151:0/753350337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 msgr2=0x55ea50487f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.969+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/753350337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea50487f40 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f47b0007820 tx=0x7f47b0007b70 comp rx=0 tx=0).stop 2023-07-21T23:05:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.969+0000 7f47d99cfb80 1 -- 172.21.15.151:0/753350337 shutdown_connections 2023-07-21T23:05:39.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.969+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/753350337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 0x55ea5048f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.969+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/753350337 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea502e46b0 0x55ea50487f40 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.969+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/753350337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea5048e210 0x55ea50498c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.969+0000 7f47d99cfb80 1 -- 172.21.15.151:0/753350337 >> 172.21.15.151:0/753350337 conn(0x55ea5047dae0 msgr2=0x55ea5048ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.969+0000 7f47d99cfb80 1 -- 172.21.15.151:0/753350337 shutdown_connections 2023-07-21T23:05:39.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.969+0000 7f47d99cfb80 1 -- 172.21.15.151:0/753350337 wait complete. 2023-07-21T23:05:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.970+0000 7f47d99cfb80 1 -- start start 2023-07-21T23:05:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.970+0000 7f47d99cfb80 1 Processor -- start 2023-07-21T23:05:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.971+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea502e46b0 0x55ea50494c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.971+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e210 0x55ea50495150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.971+0000 7f47d99cfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 0x55ea50495690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:39.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.971+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea50499280 con 0x55ea502e46b0 2023-07-21T23:05:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.971+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea50505870 con 0x55ea5048e660 2023-07-21T23:05:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.971+0000 7f47d99cfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ea505059e0 con 0x55ea5048e210 2023-07-21T23:05:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.971+0000 7f47d99cfb80 10 client.0 _ll_register_callbacks cb 0x7f47b4005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:05:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.972+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea502e46b0 0x55ea50494c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:39.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.972+0000 7f47bf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea502e46b0 0x55ea50494c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49472/0 (socket says 172.21.15.151:49472) 2023-07-21T23:05:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.972+0000 7f47bf7fe700 1 -- 172.21.15.151:0/1295815731 learned_addr learned my addr 172.21.15.151:0/1295815731 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.972+0000 7f47bffff700 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 0x55ea50495690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.973+0000 7f47beffd700 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e210 0x55ea50495150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.973+0000 7f47bffff700 1 -- 172.21.15.151:0/1295815731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e210 msgr2=0x55ea50495150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.973+0000 7f47bffff700 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e210 0x55ea50495150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.973+0000 7f47bffff700 1 -- 172.21.15.151:0/1295815731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea502e46b0 msgr2=0x55ea50494c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:39.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.973+0000 7f47bffff700 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea502e46b0 0x55ea50494c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.973+0000 7f47bffff700 1 -- 172.21.15.151:0/1295815731 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47b0009ab0 con 0x55ea5048e660 2023-07-21T23:05:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.973+0000 7f47bffff700 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 0x55ea50495690 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f47b800b650 tx=0x7f47b8009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50cfc9bdb04da2c4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:39.007 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.974+0000 7f479effd700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:05:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.974+0000 7f479effd700 1 -- 172.21.15.151:0/1295815731 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47b801d040 con 0x55ea5048e660 2023-07-21T23:05:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.974+0000 7f479effd700 1 -- 172.21.15.151:0/1295815731 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f47b8024460 con 0x55ea5048e660 2023-07-21T23:05:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.974+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1295815731 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f47b000f040 con 0x55ea5048e660 2023-07-21T23:05:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.975+0000 7f479effd700 1 -- 172.21.15.151:0/1295815731 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f47b8004ee0 con 0x55ea5048e660 2023-07-21T23:05:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.975+0000 7f47d99cfb80 10 client.29486 fetch_fsmap learned FSMap version 116 2023-07-21T23:05:39.008 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.975+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1295815731 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55ea5022e1f0 con 0x55ea5048e660 2023-07-21T23:05:39.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.975+0000 7f479effd700 1 -- 172.21.15.151:0/1295815731 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f47b000f040 con 0x55ea5048e660 2023-07-21T23:05:39.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.975+0000 7f479effd700 1 -- 172.21.15.151:0/1295815731 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f47b8038020 con 0x55ea5048e660 2023-07-21T23:05:39.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.976+0000 7f47d99cfb80 10 client.29486 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:05:39.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.976+0000 7f47d99cfb80 10 client.29486 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:05:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.976+0000 7f47d99cfb80 20 client.29486 populate_metadata read hostname 'smithi151' 2023-07-21T23:05:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.976+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea50506fd0 0x55ea505093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.976+0000 7f47d99cfb80 4 client.29486 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:05:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.976+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1295815731 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ea50394ff0 con 0x55ea50506fd0 2023-07-21T23:05:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.976+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea50506fd0 0x55ea505093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:39.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.977+0000 7f47bf7fe700 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea50506fd0 0x55ea505093e0 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dce34318a50aa34b server_cookie=d64e45cc005afd48 in_seq=0 out_seq=0 2023-07-21T23:05:39.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:38.977+0000 7f479effd700 10 client.29486 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:39.046 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.014+0000 7f479effd700 1 -- 172.21.15.151:0/1295815731 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ea50394ff0 con 0x55ea50506fd0 2023-07-21T23:05:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.014+0000 7f479effd700 10 client.29486 handle_command_reply: tid=0 2023-07-21T23:05:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.014+0000 7f47d99cfb80 1 client.29486 shutdown 2023-07-21T23:05:39.047 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1295815731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 msgr2=0x55ea50495690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 0x55ea50495690 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f47b800b650 tx=0x7f47b8009ca0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1295815731 shutdown_connections 2023-07-21T23:05:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ea50506fd0 0x55ea505093e0 crc :-1 s=READY pgs=514 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ea5048e660 0x55ea50495690 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ea502e46b0 0x55ea50494c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 --2- 172.21.15.151:0/1295815731 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ea5048e210 0x55ea50495150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.048 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f479effd700 0 client.29486 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:39.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1295815731 >> 172.21.15.151:0/1295815731 conn(0x55ea5047dae0 msgr2=0x55ea5048f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:39.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1295815731 shutdown_connections 2023-07-21T23:05:39.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 1 -- 172.21.15.151:0/1295815731 wait complete. 2023-07-21T23:05:39.049 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.015+0000 7f47d99cfb80 20 client.29486 trim_cache size 0 max 16384 2023-07-21T23:05:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:05:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:05:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:05:39.050 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:05:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.016+0000 7f47c5fff700 1 -- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47a80a1340 msgr2=0x7f47a80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.016+0000 7f47c5fff700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47a80a1340 0x7f47a80a37f0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f47b8006010 tx=0x7f47b800b260 comp rx=0 tx=0).stop 2023-07-21T23:05:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.016+0000 7f47c5fff700 1 -- 172.21.15.151:0/2091578705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c00ff3e0 msgr2=0x7f47c01015c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.016+0000 7f47c5fff700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c00ff3e0 0x7f47c01015c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f47b400e9a0 tx=0x7f47b400ecb0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.017+0000 7f47c5fff700 1 -- 172.21.15.151:0/2091578705 shutdown_connections 2023-07-21T23:05:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.017+0000 7f47c5fff700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f47a80a1340 0x7f47a80a37f0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.017+0000 7f47c5fff700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47c0104a30 0x7f47c0101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.017+0000 7f47c5fff700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47c00fea30 0x7f47c0101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.017+0000 7f47c5fff700 1 --2- 172.21.15.151:0/2091578705 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f47c00ff3e0 0x7f47c01015c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.017+0000 7f47c5fff700 1 -- 172.21.15.151:0/2091578705 >> 172.21.15.151:0/2091578705 conn(0x7f47c0074760 msgr2=0x7f47c010e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.017+0000 7f47c5fff700 1 -- 172.21.15.151:0/2091578705 shutdown_connections 2023-07-21T23:05:39.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:39.017+0000 7f47c5fff700 1 -- 172.21.15.151:0/2091578705 wait complete. 2023-07-21T23:05:39.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 765.0 s, 341.6 tps, lat 292.426 ms stddev 109.923 2023-07-21T23:05:41.366 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:40 smithi187 ceph-mon[96918]: pgmap v1479: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-07-21T23:05:41.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:40 smithi195 ceph-mon[97365]: pgmap v1479: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-07-21T23:05:41.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:40 smithi151 ceph-mon[95510]: pgmap v1479: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.14k op/s 2023-07-21T23:05:43.366 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:43 smithi187 ceph-mon[96918]: pgmap v1480: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.5 MiB/s wr, 1.01k op/s 2023-07-21T23:05:43.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:43 smithi195 ceph-mon[97365]: pgmap v1480: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.5 MiB/s wr, 1.01k op/s 2023-07-21T23:05:43.440 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:43 smithi151 ceph-mon[95510]: pgmap v1480: 97 pgs: 97 active+clean; 13 GiB data, 29 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.5 MiB/s wr, 1.01k op/s 2023-07-21T23:05:44.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 770.0 s, 342.4 tps, lat 291.708 ms stddev 86.614 2023-07-21T23:05:45.367 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:45 smithi187 ceph-mon[96918]: pgmap v1481: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:05:45.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:45 smithi195 ceph-mon[97365]: pgmap v1481: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:05:45.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:45 smithi151 ceph-mon[95510]: pgmap v1481: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:05:47.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:47 smithi195 ceph-mon[97365]: pgmap v1482: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.9 MiB/s wr, 914 op/s 2023-07-21T23:05:47.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:47 smithi151 ceph-mon[95510]: pgmap v1482: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.9 MiB/s wr, 914 op/s 2023-07-21T23:05:47.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:47 smithi187 ceph-mon[96918]: pgmap v1482: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 8.9 MiB/s wr, 914 op/s 2023-07-21T23:05:49.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 775.0 s, 376.4 tps, lat 267.313 ms stddev 64.984 2023-07-21T23:05:49.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:49 smithi195 ceph-mon[97365]: pgmap v1483: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-21T23:05:49.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:49 smithi151 ceph-mon[95510]: pgmap v1483: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-21T23:05:49.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:49 smithi187 ceph-mon[96918]: pgmap v1483: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 MiB/s rd, 12 MiB/s wr, 1.24k op/s 2023-07-21T23:05:51.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:51 smithi195 ceph-mon[97365]: pgmap v1484: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-07-21T23:05:51.439 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:51 smithi151 ceph-mon[95510]: pgmap v1484: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-07-21T23:05:51.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:51 smithi187 ceph-mon[96918]: pgmap v1484: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.12k op/s 2023-07-21T23:05:52.294 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.261+0000 7f676ffff700 1 -- 172.21.15.151:0/1086948219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67680ffaf0 msgr2=0x7f67680fff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.261+0000 7f676ffff700 1 --2- 172.21.15.151:0/1086948219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67680ffaf0 0x7f67680fff60 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f6758009990 tx=0x7f6758009ca0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.295 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.262+0000 7f676ffff700 1 -- 172.21.15.151:0/1086948219 shutdown_connections 2023-07-21T23:05:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.262+0000 7f676ffff700 1 --2- 172.21.15.151:0/1086948219 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67681004a0 0x7f676810c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.262+0000 7f676ffff700 1 --2- 172.21.15.151:0/1086948219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6768105b00 0x7f6768105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.262+0000 7f676ffff700 1 --2- 172.21.15.151:0/1086948219 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f67680ffaf0 0x7f67680fff60 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.262+0000 7f676ffff700 1 -- 172.21.15.151:0/1086948219 >> 172.21.15.151:0/1086948219 conn(0x7f67680fb5f0 msgr2=0x7f67680fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.262+0000 7f676ffff700 1 -- 172.21.15.151:0/1086948219 shutdown_connections 2023-07-21T23:05:52.296 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.262+0000 7f676ffff700 1 -- 172.21.15.151:0/1086948219 wait complete. 2023-07-21T23:05:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.263+0000 7f676ffff700 1 Processor -- start 2023-07-21T23:05:52.297 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.263+0000 7f676ffff700 1 -- start start 2023-07-21T23:05:52.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.264+0000 7f676ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67680ffaf0 0x7f67680729f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.264+0000 7f676ffff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67681004a0 0x7f6768072f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.264+0000 7f676ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6768105b00 0x7f67681a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.264+0000 7f676ffff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67681a4230 con 0x7f67681004a0 2023-07-21T23:05:52.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.264+0000 7f676ffff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67681a4370 con 0x7f67680ffaf0 2023-07-21T23:05:52.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.264+0000 7f676ffff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67681a44e0 con 0x7f6768105b00 2023-07-21T23:05:52.298 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.265+0000 7f676dd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67680ffaf0 0x7f67680729f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.265+0000 7f676dd9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67680ffaf0 0x7f67680729f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55366/0 (socket says 172.21.15.151:55366) 2023-07-21T23:05:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.265+0000 7f676dd9b700 1 -- 172.21.15.151:0/3684227012 learned_addr learned my addr 172.21.15.151:0/3684227012 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:52.299 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.265+0000 7f676d59a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67681004a0 0x7f6768072f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.265+0000 7f676e59c700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6768105b00 0x7f67681a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.265+0000 7f676dd9b700 1 -- 172.21.15.151:0/3684227012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6768105b00 msgr2=0x7f67681a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.266+0000 7f676dd9b700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6768105b00 0x7f67681a3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.266+0000 7f676dd9b700 1 -- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67681004a0 msgr2=0x7f6768072f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:52.300 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.266+0000 7f676dd9b700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67681004a0 0x7f6768072f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.266+0000 7f676dd9b700 1 -- 172.21.15.151:0/3684227012 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67580095f0 con 0x7f67680ffaf0 2023-07-21T23:05:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.266+0000 7f676d59a700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67681004a0 0x7f6768072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:05:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.266+0000 7f676dd9b700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67680ffaf0 0x7f67680729f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f676400d950 tx=0x7f676400dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.267+0000 7f675effd700 1 -- 172.21.15.151:0/3684227012 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676400f890 con 0x7f67680ffaf0 2023-07-21T23:05:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.267+0000 7f675effd700 1 -- 172.21.15.151:0/3684227012 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f676400fe80 con 0x7f67680ffaf0 2023-07-21T23:05:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.267+0000 7f675effd700 1 -- 172.21.15.151:0/3684227012 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f676400e3b0 con 0x7f67680ffaf0 2023-07-21T23:05:52.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.267+0000 7f676ffff700 1 -- 172.21.15.151:0/3684227012 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67681a47c0 con 0x7f67680ffaf0 2023-07-21T23:05:52.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.267+0000 7f676ffff700 1 -- 172.21.15.151:0/3684227012 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67681a4c80 con 0x7f67680ffaf0 2023-07-21T23:05:52.303 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.271+0000 7f675effd700 1 -- 172.21.15.151:0/3684227012 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f676400f9f0 con 0x7f67680ffaf0 2023-07-21T23:05:52.304 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.272+0000 7f6783960b80 1 Processor -- start 2023-07-21T23:05:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.273+0000 7f6783960b80 1 -- start start 2023-07-21T23:05:52.305 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.273+0000 7f6783960b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb67a46b0 0x55cdb694dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.273+0000 7f6783960b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb6947f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.273+0000 7f6783960b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb69484a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.273+0000 7f6783960b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb684dc50 con 0x55cdb67a46b0 2023-07-21T23:05:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.273+0000 7f6783960b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb68a09e0 con 0x55cdb694e660 2023-07-21T23:05:52.306 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.273+0000 7f6783960b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb6899e70 con 0x55cdb694e210 2023-07-21T23:05:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.273+0000 7f676dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb6947f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.274+0000 7f676dd9b700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb6947f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60518/0 (socket says 172.21.15.151:60518) 2023-07-21T23:05:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.274+0000 7f676dd9b700 1 -- 172.21.15.151:0/3057515512 learned_addr learned my addr 172.21.15.151:0/3057515512 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.274+0000 7f676e59c700 1 --2- 172.21.15.151:0/3057515512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb67a46b0 0x55cdb694dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.307 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.274+0000 7f676dd9b700 1 -- 172.21.15.151:0/3057515512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 msgr2=0x55cdb69484a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:05:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.274+0000 7f676dd9b700 1 --2- 172.21.15.151:0/3057515512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb69484a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.274+0000 7f676dd9b700 1 -- 172.21.15.151:0/3057515512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb67a46b0 msgr2=0x55cdb694dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.274+0000 7f676dd9b700 1 --2- 172.21.15.151:0/3057515512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb67a46b0 0x55cdb694dcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.308 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.274+0000 7f676dd9b700 1 -- 172.21.15.151:0/3057515512 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdb66c7d80 con 0x55cdb694e210 2023-07-21T23:05:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.275+0000 7f676dd9b700 1 --2- 172.21.15.151:0/3057515512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb6947f40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f67640ca070 tx=0x7f67640d2d40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf2141c9644a85b3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:52.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.275+0000 7f675effd700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67540a1380 0x7f67540a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.275+0000 7f6753fff700 1 -- 172.21.15.151:0/3057515512 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764095df0 con 0x55cdb694e210 2023-07-21T23:05:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.275+0000 7f6753fff700 1 -- 172.21.15.151:0/3057515512 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f67640d26d0 con 0x55cdb694e210 2023-07-21T23:05:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.275+0000 7f6753fff700 1 -- 172.21.15.151:0/3057515512 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6764099410 con 0x55cdb694e210 2023-07-21T23:05:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.275+0000 7f675effd700 1 -- 172.21.15.151:0/3684227012 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f67640cca20 con 0x7f67680ffaf0 2023-07-21T23:05:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.275+0000 7f676e59c700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67540a1380 0x7f67540a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.276+0000 7f6783960b80 1 -- 172.21.15.151:0/3057515512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 msgr2=0x55cdb6947f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:52.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.276+0000 7f6783960b80 1 --2- 172.21.15.151:0/3057515512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb6947f40 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f67640ca070 tx=0x7f67640d2d40 comp rx=0 tx=0).stop 2023-07-21T23:05:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.276+0000 7f676e59c700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67540a1380 0x7f67540a3830 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f67600099d0 tx=0x7f6760009100 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.277+0000 7f6783960b80 1 -- 172.21.15.151:0/3057515512 shutdown_connections 2023-07-21T23:05:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.277+0000 7f6783960b80 1 --2- 172.21.15.151:0/3057515512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb69484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.277+0000 7f6783960b80 1 --2- 172.21.15.151:0/3057515512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb67a46b0 0x55cdb694dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.277+0000 7f6783960b80 1 --2- 172.21.15.151:0/3057515512 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb6947f40 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.277+0000 7f6783960b80 1 -- 172.21.15.151:0/3057515512 >> 172.21.15.151:0/3057515512 conn(0x55cdb693dae0 msgr2=0x55cdb69430e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:52.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.277+0000 7f6783960b80 1 -- 172.21.15.151:0/3057515512 shutdown_connections 2023-07-21T23:05:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.277+0000 7f6783960b80 1 -- 172.21.15.151:0/3057515512 wait complete. 2023-07-21T23:05:52.312 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.277+0000 7f6783960b80 1 -- start start 2023-07-21T23:05:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.278+0000 7f6783960b80 1 Processor -- start 2023-07-21T23:05:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.279+0000 7f6783960b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb67a46b0 0x55cdb695fca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.279+0000 7f6783960b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb69601e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.279+0000 7f6783960b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e660 0x55cdb6959ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.313 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.279+0000 7f6783960b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb6839a60 con 0x55cdb694e660 2023-07-21T23:05:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.279+0000 7f6783960b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb6839760 con 0x55cdb67a46b0 2023-07-21T23:05:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.279+0000 7f6783960b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb671d8c0 con 0x55cdb694e210 2023-07-21T23:05:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.279+0000 7f6783960b80 10 client.0 _ll_register_callbacks cb 0x55cdb6837700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:05:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.279+0000 7f676e59c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e660 0x55cdb6959ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.279+0000 7f676d59a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb69601e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.314 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676d59a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb69601e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:60526/0 (socket says 172.21.15.151:60526) 2023-07-21T23:05:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676d59a700 1 -- 172.21.15.151:0/2634945585 learned_addr learned my addr 172.21.15.151:0/2634945585 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:52.315 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676dd9b700 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb67a46b0 0x55cdb695fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676e59c700 1 -- 172.21.15.151:0/2634945585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 msgr2=0x55cdb69601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676e59c700 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb69601e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676e59c700 1 -- 172.21.15.151:0/2634945585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb67a46b0 msgr2=0x55cdb695fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:52.316 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676e59c700 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb67a46b0 0x55cdb695fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676e59c700 1 -- 172.21.15.151:0/2634945585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67681a4c80 con 0x55cdb694e660 2023-07-21T23:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676d59a700 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb69601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.280+0000 7f676dd9b700 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb67a46b0 0x55cdb695fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.281+0000 7f676e59c700 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e660 0x55cdb6959ef0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6760009e40 tx=0x7f6760004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa0d7ba42e2ebdae server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.281+0000 7f67517fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.282+0000 7f67517fa700 1 -- 172.21.15.151:0/2634945585 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760007d30 con 0x55cdb694e660 2023-07-21T23:05:52.317 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.282+0000 7f67517fa700 1 -- 172.21.15.151:0/2634945585 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6760004bb0 con 0x55cdb694e660 2023-07-21T23:05:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.282+0000 7f6783960b80 1 -- 172.21.15.151:0/2634945585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cdb6892e50 con 0x55cdb694e660 2023-07-21T23:05:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.283+0000 7f67517fa700 1 -- 172.21.15.151:0/2634945585 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6760007e90 con 0x55cdb694e660 2023-07-21T23:05:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.283+0000 7f6783960b80 10 client.19854 fetch_fsmap learned FSMap version 116 2023-07-21T23:05:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.283+0000 7f6783960b80 1 -- 172.21.15.151:0/2634945585 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55cdb66b0c00 con 0x55cdb694e660 2023-07-21T23:05:52.318 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.283+0000 7f67517fa700 1 -- 172.21.15.151:0/2634945585 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6760030030 con 0x55cdb694e660 2023-07-21T23:05:52.320 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.284+0000 7f67517fa700 1 -- 172.21.15.151:0/2634945585 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f6760016430 con 0x55cdb694e660 2023-07-21T23:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.284+0000 7f6783960b80 10 client.19854 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.284+0000 7f6783960b80 10 client.19854 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.284+0000 7f6783960b80 20 client.19854 populate_metadata read hostname 'smithi151' 2023-07-21T23:05:52.321 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.284+0000 7f6783960b80 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cdb696a1e0 0x55cdb696c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.284+0000 7f6783960b80 4 client.19854 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:05:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.284+0000 7f6783960b80 1 -- 172.21.15.151:0/2634945585 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55cdb6854ff0 con 0x55cdb696a1e0 2023-07-21T23:05:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.284+0000 7f676dd9b700 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cdb696a1e0 0x55cdb696c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.285+0000 7f676dd9b700 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cdb696a1e0 0x55cdb696c5f0 crc :-1 s=READY pgs=515 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7236a04d77d3bc4d server_cookie=2996d3d233fe5ea9 in_seq=0 out_seq=0 2023-07-21T23:05:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.285+0000 7f67517fa700 10 client.19854 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.286+0000 7f67517fa700 1 -- 172.21.15.151:0/2634945585 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55cdb6854ff0 con 0x55cdb696a1e0 2023-07-21T23:05:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.286+0000 7f67517fa700 10 client.19854 handle_command_reply: tid=0 2023-07-21T23:05:52.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.286+0000 7f6783960b80 1 client.19854 shutdown 2023-07-21T23:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 -- 172.21.15.151:0/2634945585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e660 msgr2=0x55cdb6959ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e660 0x55cdb6959ef0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f6760009e40 tx=0x7f6760004ad0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 -- 172.21.15.151:0/2634945585 shutdown_connections 2023-07-21T23:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cdb696a1e0 0x55cdb696c5f0 crc :-1 s=READY pgs=515 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb67a46b0 0x55cdb695fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e660 0x55cdb6959ef0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 --2- 172.21.15.151:0/2634945585 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb69601e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 -- 172.21.15.151:0/2634945585 >> 172.21.15.151:0/2634945585 conn(0x55cdb693dae0 msgr2=0x55cdb69423e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f67517fa700 0 client.19854 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 -- 172.21.15.151:0/2634945585 shutdown_connections 2023-07-21T23:05:52.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.287+0000 7f6783960b80 1 -- 172.21.15.151:0/2634945585 wait complete. 2023-07-21T23:05:52.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.288+0000 7f6783960b80 20 client.19854 trim_cache size 0 max 16384 2023-07-21T23:05:52.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.320+0000 7f6783960b80 1 Processor -- start 2023-07-21T23:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.320+0000 7f6783960b80 1 -- start start 2023-07-21T23:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.320+0000 7f6783960b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb67a46b0 0x55cdb6950ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.320+0000 7f6783960b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb694cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.320+0000 7f6783960b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb6942b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.320+0000 7f6783960b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb6949160 con 0x55cdb67a46b0 2023-07-21T23:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.320+0000 7f6783960b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb694e060 con 0x55cdb694e660 2023-07-21T23:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.320+0000 7f6783960b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb6967860 con 0x55cdb694e210 2023-07-21T23:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.322+0000 7f676e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb6942b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.323+0000 7f676e59c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb6942b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55400/0 (socket says 172.21.15.151:55400) 2023-07-21T23:05:52.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.323+0000 7f676e59c700 1 -- 172.21.15.151:0/2558517396 learned_addr learned my addr 172.21.15.151:0/2558517396 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.328+0000 7f676e59c700 1 -- 172.21.15.151:0/2558517396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 msgr2=0x55cdb694cfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:05:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.328+0000 7f676e59c700 1 --2- 172.21.15.151:0/2558517396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb694cfe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.328+0000 7f676e59c700 1 -- 172.21.15.151:0/2558517396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb67a46b0 msgr2=0x55cdb6950ea0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:05:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.328+0000 7f676e59c700 1 --2- 172.21.15.151:0/2558517396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb67a46b0 0x55cdb6950ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.328+0000 7f676e59c700 1 -- 172.21.15.151:0/2558517396 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55cdb66ee1f0 con 0x55cdb694e660 2023-07-21T23:05:52.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.330+0000 7f676e59c700 1 --2- 172.21.15.151:0/2558517396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb6942b60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6760018040 tx=0x7f6760007b70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f78c2b6048babb74 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.330+0000 7f675cff9700 1 -- 172.21.15.151:0/2558517396 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760016b30 con 0x55cdb694e660 2023-07-21T23:05:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.330+0000 7f675cff9700 1 -- 172.21.15.151:0/2558517396 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6760030040 con 0x55cdb694e660 2023-07-21T23:05:52.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.330+0000 7f675cff9700 1 -- 172.21.15.151:0/2558517396 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6760035440 con 0x55cdb694e660 2023-07-21T23:05:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.331+0000 7f6783960b80 1 -- 172.21.15.151:0/2558517396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 msgr2=0x55cdb6942b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.331+0000 7f6783960b80 1 --2- 172.21.15.151:0/2558517396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb6942b60 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f6760018040 tx=0x7f6760007b70 comp rx=0 tx=0).stop 2023-07-21T23:05:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.331+0000 7f6783960b80 1 -- 172.21.15.151:0/2558517396 shutdown_connections 2023-07-21T23:05:52.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.331+0000 7f6783960b80 1 --2- 172.21.15.151:0/2558517396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb6942b60 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.331+0000 7f6783960b80 1 --2- 172.21.15.151:0/2558517396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb67a46b0 0x55cdb6950ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.331+0000 7f6783960b80 1 --2- 172.21.15.151:0/2558517396 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb694e210 0x55cdb694cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.331+0000 7f6783960b80 1 -- 172.21.15.151:0/2558517396 >> 172.21.15.151:0/2558517396 conn(0x55cdb693dae0 msgr2=0x55cdb694f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.332+0000 7f6783960b80 1 -- 172.21.15.151:0/2558517396 shutdown_connections 2023-07-21T23:05:52.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.332+0000 7f6783960b80 1 -- 172.21.15.151:0/2558517396 wait complete. 2023-07-21T23:05:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.333+0000 7f6783960b80 1 -- start start 2023-07-21T23:05:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.333+0000 7f6783960b80 1 Processor -- start 2023-07-21T23:05:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.334+0000 7f6783960b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb67a46b0 0x55cdb69b9940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.334+0000 7f6783960b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e210 0x55cdb695f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.334+0000 7f6783960b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb695f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.334+0000 7f6783960b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb695fe00 con 0x55cdb694e210 2023-07-21T23:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.334+0000 7f6783960b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb695ff70 con 0x55cdb694e660 2023-07-21T23:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.334+0000 7f6783960b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55cdb6960130 con 0x55cdb67a46b0 2023-07-21T23:05:52.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.334+0000 7f6783960b80 10 client.0 _ll_register_callbacks cb 0x7f67600043b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676d59a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e210 0x55cdb695f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676d59a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e210 0x55cdb695f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:33184/0 (socket says 172.21.15.151:33184) 2023-07-21T23:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676d59a700 1 -- 172.21.15.151:0/2269761722 learned_addr learned my addr 172.21.15.151:0/2269761722 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676e59c700 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb695f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676dd9b700 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb67a46b0 0x55cdb69b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676d59a700 1 -- 172.21.15.151:0/2269761722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb67a46b0 msgr2=0x55cdb69b9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676d59a700 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb67a46b0 0x55cdb69b9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676d59a700 1 -- 172.21.15.151:0/2269761722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 msgr2=0x55cdb695f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676d59a700 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb695f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.335+0000 7f676d59a700 1 -- 172.21.15.151:0/2269761722 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55cdb66b0c00 con 0x55cdb694e210 2023-07-21T23:05:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.336+0000 7f676e59c700 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb695f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:05:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.336+0000 7f676d59a700 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e210 0x55cdb695f270 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f67580036c0 tx=0x7f6758003b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bbfbd13032eb4ca server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:05:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.336+0000 7f67517fa700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:05:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.336+0000 7f67517fa700 1 -- 172.21.15.151:0/2269761722 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675801d040 con 0x55cdb694e210 2023-07-21T23:05:52.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.336+0000 7f67517fa700 1 -- 172.21.15.151:0/2269761722 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f6758004810 con 0x55cdb694e210 2023-07-21T23:05:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.336+0000 7f6783960b80 1 -- 172.21.15.151:0/2269761722 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55cdb67f3490 con 0x55cdb694e210 2023-07-21T23:05:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.337+0000 7f67517fa700 1 -- 172.21.15.151:0/2269761722 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f67580041f0 con 0x55cdb694e210 2023-07-21T23:05:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.337+0000 7f6783960b80 10 client.19857 fetch_fsmap learned FSMap version 116 2023-07-21T23:05:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.337+0000 7f6783960b80 1 -- 172.21.15.151:0/2269761722 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55cdb66c6250 con 0x55cdb694e210 2023-07-21T23:05:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.338+0000 7f67517fa700 1 -- 172.21.15.151:0/2269761722 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55cdb67f3490 con 0x55cdb694e210 2023-07-21T23:05:52.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.338+0000 7f67517fa700 1 -- 172.21.15.151:0/2269761722 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f675800f460 con 0x55cdb694e210 2023-07-21T23:05:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.338+0000 7f6783960b80 10 client.19857 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:05:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.338+0000 7f6783960b80 10 client.19857 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:05:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.338+0000 7f6783960b80 20 client.19857 populate_metadata read hostname 'smithi151' 2023-07-21T23:05:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.338+0000 7f6783960b80 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cdb69565b0 0x55cdb69589c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:05:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.338+0000 7f6783960b80 4 client.19857 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:05:52.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.338+0000 7f6783960b80 1 -- 172.21.15.151:0/2269761722 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55cdb66e8f10 con 0x55cdb69565b0 2023-07-21T23:05:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.338+0000 7f676dd9b700 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cdb69565b0 0x55cdb69589c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:05:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.340+0000 7f676dd9b700 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cdb69565b0 0x55cdb69589c0 crc :-1 s=READY pgs=516 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1f32895de114115 server_cookie=826d1e810a29259e in_seq=0 out_seq=0 2023-07-21T23:05:52.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.340+0000 7f67517fa700 10 client.19857 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.385+0000 7f67517fa700 1 -- 172.21.15.151:0/2269761722 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55cdb66e8f10 con 0x55cdb69565b0 2023-07-21T23:05:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.385+0000 7f67517fa700 10 client.19857 handle_command_reply: tid=0 2023-07-21T23:05:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.386+0000 7f6783960b80 1 client.19857 shutdown 2023-07-21T23:05:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.387+0000 7f6783960b80 1 -- 172.21.15.151:0/2269761722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e210 msgr2=0x55cdb695f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.387+0000 7f6783960b80 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e210 0x55cdb695f270 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f67580036c0 tx=0x7f6758003b00 comp rx=0 tx=0).stop 2023-07-21T23:05:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.388+0000 7f6783960b80 1 -- 172.21.15.151:0/2269761722 shutdown_connections 2023-07-21T23:05:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.388+0000 7f6783960b80 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55cdb69565b0 0x55cdb69589c0 crc :-1 s=READY pgs=516 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.388+0000 7f6783960b80 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55cdb694e660 0x55cdb695f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.388+0000 7f6783960b80 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55cdb67a46b0 0x55cdb69b9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.388+0000 7f6783960b80 1 --2- 172.21.15.151:0/2269761722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55cdb694e210 0x55cdb695f270 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.388+0000 7f6783960b80 1 -- 172.21.15.151:0/2269761722 >> 172.21.15.151:0/2269761722 conn(0x55cdb693dae0 msgr2=0x55cdb694cfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.388+0000 7f67517fa700 0 client.19857 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:05:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.389+0000 7f6783960b80 1 -- 172.21.15.151:0/2269761722 shutdown_connections 2023-07-21T23:05:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.389+0000 7f6783960b80 1 -- 172.21.15.151:0/2269761722 wait complete. 2023-07-21T23:05:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.389+0000 7f6783960b80 20 client.19857 trim_cache size 0 max 16384 2023-07-21T23:05:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:05:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:05:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:05:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:05:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.390+0000 7f676ffff700 1 -- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67540a1380 msgr2=0x7f67540a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.390+0000 7f676ffff700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67540a1380 0x7f67540a3830 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f67600099d0 tx=0x7f6760009100 comp rx=0 tx=0).stop 2023-07-21T23:05:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.390+0000 7f676ffff700 1 -- 172.21.15.151:0/3684227012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67680ffaf0 msgr2=0x7f67680729f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:05:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.391+0000 7f676ffff700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67680ffaf0 0x7f67680729f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f676400d950 tx=0x7f676400dc60 comp rx=0 tx=0).stop 2023-07-21T23:05:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.391+0000 7f676ffff700 1 -- 172.21.15.151:0/3684227012 shutdown_connections 2023-07-21T23:05:52.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.391+0000 7f676ffff700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f67540a1380 0x7f67540a3830 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.391+0000 7f676ffff700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67680ffaf0 0x7f67680729f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.391+0000 7f676ffff700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6768105b00 0x7f67681a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.391+0000 7f676ffff700 1 --2- 172.21.15.151:0/3684227012 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67681004a0 0x7f6768072f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:05:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.391+0000 7f676ffff700 1 -- 172.21.15.151:0/3684227012 >> 172.21.15.151:0/3684227012 conn(0x7f67680fb5f0 msgr2=0x7f6768103600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:05:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.391+0000 7f676ffff700 1 -- 172.21.15.151:0/3684227012 shutdown_connections 2023-07-21T23:05:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:05:52.391+0000 7f676ffff700 1 -- 172.21.15.151:0/3684227012 wait complete. 2023-07-21T23:05:53.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:53 smithi151 ceph-mon[95510]: pgmap v1485: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 997 op/s 2023-07-21T23:05:53.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:53 smithi187 ceph-mon[96918]: pgmap v1485: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 997 op/s 2023-07-21T23:05:53.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:53 smithi195 ceph-mon[97365]: pgmap v1485: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.3 MiB/s wr, 997 op/s 2023-07-21T23:05:54.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 780.0 s, 366.0 tps, lat 272.015 ms stddev 78.144 2023-07-21T23:05:55.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:55 smithi151 ceph-mon[95510]: pgmap v1486: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-21T23:05:55.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:55 smithi187 ceph-mon[96918]: pgmap v1486: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-21T23:05:55.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:55 smithi195 ceph-mon[97365]: pgmap v1486: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-21T23:05:57.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:57 smithi151 ceph-mon[95510]: pgmap v1487: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.0 MiB/s wr, 1k op/s 2023-07-21T23:05:57.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:57 smithi187 ceph-mon[96918]: pgmap v1487: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.0 MiB/s wr, 1k op/s 2023-07-21T23:05:57.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:57 smithi195 ceph-mon[97365]: pgmap v1487: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.0 MiB/s wr, 1k op/s 2023-07-21T23:05:59.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 785.0 s, 386.8 tps, lat 257.631 ms stddev 54.893 2023-07-21T23:05:59.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:05:59 smithi151 ceph-mon[95510]: pgmap v1488: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 1.32k op/s 2023-07-21T23:05:59.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:05:59 smithi187 ceph-mon[96918]: pgmap v1488: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 1.32k op/s 2023-07-21T23:05:59.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:05:59 smithi195 ceph-mon[97365]: pgmap v1488: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 MiB/s rd, 12 MiB/s wr, 1.32k op/s 2023-07-21T23:06:01.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:01 smithi151 ceph-mon[95510]: pgmap v1489: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-07-21T23:06:01.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:01 smithi187 ceph-mon[96918]: pgmap v1489: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-07-21T23:06:01.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:01 smithi195 ceph-mon[97365]: pgmap v1489: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 11 MiB/s wr, 1.18k op/s 2023-07-21T23:06:03.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:03 smithi187 ceph-mon[96918]: pgmap v1490: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.5 MiB/s wr, 1.04k op/s 2023-07-21T23:06:03.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:03 smithi195 ceph-mon[97365]: pgmap v1490: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.5 MiB/s wr, 1.04k op/s 2023-07-21T23:06:03.693 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:03 smithi151 ceph-mon[95510]: pgmap v1490: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.5 MiB/s wr, 1.04k op/s 2023-07-21T23:06:04.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 790.0 s, 296.4 tps, lat 323.152 ms stddev 314.748 2023-07-21T23:06:05.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:05 smithi187 ceph-mon[96918]: pgmap v1491: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 13 MiB/s wr, 1.40k op/s 2023-07-21T23:06:05.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:05 smithi187 ceph-mon[96918]: osdmap e170: 12 total, 12 up, 12 in 2023-07-21T23:06:05.649 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:05 smithi195 ceph-mon[97365]: pgmap v1491: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 13 MiB/s wr, 1.40k op/s 2023-07-21T23:06:05.650 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:05 smithi195 ceph-mon[97365]: osdmap e170: 12 total, 12 up, 12 in 2023-07-21T23:06:05.692 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:05 smithi151 ceph-mon[95510]: pgmap v1491: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 13 MiB/s wr, 1.40k op/s 2023-07-21T23:06:05.693 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:05 smithi151 ceph-mon[95510]: osdmap e170: 12 total, 12 up, 12 in 2023-07-21T23:06:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.707+0000 7f5aa97ff700 1 -- 172.21.15.151:0/2217161527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5aa406d3a0 msgr2=0x7f5aa411b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:05.739 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.707+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/2217161527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5aa406d3a0 0x7f5aa411b470 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00b0a0 tx=0x7f5a9c00b3b0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.707+0000 7f5aa97ff700 1 -- 172.21.15.151:0/2217161527 shutdown_connections 2023-07-21T23:06:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.707+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/2217161527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5aa406d3a0 0x7f5aa411b470 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.707+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/2217161527 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aa410e2a0 0x7f5aa410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.707+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/2217161527 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5aa406c910 0x7f5aa406cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.707+0000 7f5aa97ff700 1 -- 172.21.15.151:0/2217161527 >> 172.21.15.151:0/2217161527 conn(0x7f5aa406bd70 msgr2=0x7f5aa4070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:05.741 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.708+0000 7f5aa97ff700 1 -- 172.21.15.151:0/2217161527 shutdown_connections 2023-07-21T23:06:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.709+0000 7f5aa97ff700 1 -- 172.21.15.151:0/2217161527 wait complete. 2023-07-21T23:06:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.710+0000 7f5aa97ff700 1 Processor -- start 2023-07-21T23:06:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.711+0000 7f5aa97ff700 1 -- start start 2023-07-21T23:06:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.712+0000 7f5aa97ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5aa406c910 0x7f5aa41aab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.712+0000 7f5aa97ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5aa406d3a0 0x7f5aa41ab070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.712+0000 7f5aa97ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aa410e2a0 0x7f5aa41a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.712+0000 7f5aa97ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41a50d0 con 0x7f5aa410e2a0 2023-07-21T23:06:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.712+0000 7f5aa97ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41a5240 con 0x7f5aa406d3a0 2023-07-21T23:06:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.712+0000 7f5aa97ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5aa41a5400 con 0x7f5aa406c910 2023-07-21T23:06:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.713+0000 7f5aa2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5aa406c910 0x7f5aa41aab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.713+0000 7f5aa37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aa410e2a0 0x7f5aa41a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.713+0000 7f5aa37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aa410e2a0 0x7f5aa41a4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35366/0 (socket says 172.21.15.151:35366) 2023-07-21T23:06:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.713+0000 7f5aa2ffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5aa406c910 0x7f5aa41aab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56932/0 (socket says 172.21.15.151:56932) 2023-07-21T23:06:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.713+0000 7f5aa37fe700 1 -- 172.21.15.151:0/834925231 learned_addr learned my addr 172.21.15.151:0/834925231 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.713+0000 7f5aa27fc700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5aa406d3a0 0x7f5aa41ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.713+0000 7f5aa2ffd700 1 -- 172.21.15.151:0/834925231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5aa406d3a0 msgr2=0x7f5aa41ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.713+0000 7f5aa2ffd700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5aa406d3a0 0x7f5aa41ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.714+0000 7f5aa2ffd700 1 -- 172.21.15.151:0/834925231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aa410e2a0 msgr2=0x7f5aa41a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.714+0000 7f5aa2ffd700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aa410e2a0 0x7f5aa41a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.714+0000 7f5aa2ffd700 1 -- 172.21.15.151:0/834925231 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a9c009d00 con 0x7f5aa406c910 2023-07-21T23:06:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.714+0000 7f5aa2ffd700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5aa406c910 0x7f5aa41aab30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e9f0 tx=0x7f5a9400ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.715+0000 7f5a8bfff700 1 -- 172.21.15.151:0/834925231 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a940096d0 con 0x7f5aa406c910 2023-07-21T23:06:05.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.715+0000 7f5a8bfff700 1 -- 172.21.15.151:0/834925231 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a9400cbd0 con 0x7f5aa406c910 2023-07-21T23:06:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.715+0000 7f5a8bfff700 1 -- 172.21.15.151:0/834925231 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a94018420 con 0x7f5aa406c910 2023-07-21T23:06:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.719+0000 7f5aa97ff700 1 -- 172.21.15.151:0/834925231 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5aa41a56e0 con 0x7f5aa406c910 2023-07-21T23:06:05.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.719+0000 7f5aa97ff700 1 -- 172.21.15.151:0/834925231 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa41b1ab0 con 0x7f5aa406c910 2023-07-21T23:06:05.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.726+0000 7f5abd1a9b80 1 Processor -- start 2023-07-21T23:06:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.727+0000 7f5abd1a9b80 1 -- start start 2023-07-21T23:06:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.727+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee2136b0 0x5640ee3bccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.727+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd210 0x5640ee3b6f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.727+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.727+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee2bcc50 con 0x5640ee3bd210 2023-07-21T23:06:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.727+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee30f9e0 con 0x5640ee2136b0 2023-07-21T23:06:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.728+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee308e70 con 0x5640ee3bd660 2023-07-21T23:06:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.728+0000 7f5aa27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.728+0000 7f5aa27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56940/0 (socket says 172.21.15.151:56940) 2023-07-21T23:06:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.728+0000 7f5aa27fc700 1 -- 172.21.15.151:0/3566819996 learned_addr learned my addr 172.21.15.151:0/3566819996 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:05.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.728+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/3566819996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee2136b0 0x5640ee3bccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.731+0000 7f5a8bfff700 1 -- 172.21.15.151:0/834925231 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5a9400cd40 con 0x7f5aa406c910 2023-07-21T23:06:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.731+0000 7f5aa27fc700 1 -- 172.21.15.151:0/3566819996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee2136b0 msgr2=0x5640ee3bccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.731+0000 7f5aa27fc700 1 --2- 172.21.15.151:0/3566819996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee2136b0 0x5640ee3bccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.731+0000 7f5aa27fc700 1 -- 172.21.15.151:0/3566819996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd210 msgr2=0x5640ee3b6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.731+0000 7f5aa27fc700 1 --2- 172.21.15.151:0/3566819996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd210 0x5640ee3b6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.731+0000 7f5aa27fc700 1 -- 172.21.15.151:0/3566819996 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640ee136d80 con 0x5640ee3bd660 2023-07-21T23:06:05.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.734+0000 7f5a8bfff700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a8c0a1490 0x7f5a8c0a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.734+0000 7f5a8bfff700 1 -- 172.21.15.151:0/834925231 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f5a94014070 con 0x7f5aa406c910 2023-07-21T23:06:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.740+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a8c0a1490 0x7f5a8c0a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.741+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a8c0a1490 0x7f5a8c0a3940 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5aa41ab7c0 tx=0x7f5a9c0094a0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:05.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.747+0000 7f5aa27fc700 1 --2- 172.21.15.151:0/3566819996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b74a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5a980077c0 tx=0x7f5a98007ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22706754795ec28d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:05.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.747+0000 7f5a897fa700 1 -- 172.21.15.151:0/3566819996 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980125f0 con 0x5640ee3bd660 2023-07-21T23:06:05.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.748+0000 7f5a897fa700 1 -- 172.21.15.151:0/3566819996 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a98012be0 con 0x5640ee3bd660 2023-07-21T23:06:05.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.748+0000 7f5a897fa700 1 -- 172.21.15.151:0/3566819996 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a98013de0 con 0x5640ee3bd660 2023-07-21T23:06:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.749+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3566819996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 msgr2=0x5640ee3b74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:05.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.749+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3566819996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b74a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f5a980077c0 tx=0x7f5a98007ad0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.749+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3566819996 shutdown_connections 2023-07-21T23:06:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.749+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3566819996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee2136b0 0x5640ee3bccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.749+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3566819996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b74a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.749+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3566819996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd210 0x5640ee3b6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.749+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3566819996 >> 172.21.15.151:0/3566819996 conn(0x5640ee3acae0 msgr2=0x5640ee3b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:05.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.750+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3566819996 shutdown_connections 2023-07-21T23:06:05.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.750+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3566819996 wait complete. 2023-07-21T23:06:05.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.750+0000 7f5abd1a9b80 1 -- start start 2023-07-21T23:06:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.751+0000 7f5abd1a9b80 1 Processor -- start 2023-07-21T23:06:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.752+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee2136b0 0x5640ee3c08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.752+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd210 0x5640ee3c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.752+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee3c1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.752+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee2a8a60 con 0x5640ee3bd660 2023-07-21T23:06:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.752+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee2a8760 con 0x5640ee2136b0 2023-07-21T23:06:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.752+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee18c8c0 con 0x5640ee3bd210 2023-07-21T23:06:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.752+0000 7f5abd1a9b80 10 client.0 _ll_register_callbacks cb 0x5640ee2a6700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.764+0000 7f5aa27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd210 0x5640ee3c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.764+0000 7f5aa27fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd210 0x5640ee3c0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:56944/0 (socket says 172.21.15.151:56944) 2023-07-21T23:06:05.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.764+0000 7f5aa27fc700 1 -- 172.21.15.151:0/3673899169 learned_addr learned my addr 172.21.15.151:0/3673899169 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:05.798 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.765+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee3c1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.768+0000 7f5aa27fc700 1 -- 172.21.15.151:0/3673899169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee2136b0 msgr2=0x5640ee3c08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:05.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.768+0000 7f5aa27fc700 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee2136b0 0x5640ee3c08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.768+0000 7f5aa27fc700 1 -- 172.21.15.151:0/3673899169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 msgr2=0x5640ee3c1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.768+0000 7f5aa27fc700 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee3c1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.809 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.768+0000 7f5aa27fc700 1 -- 172.21.15.151:0/3673899169 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a9800e040 con 0x5640ee3bd210 2023-07-21T23:06:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.776+0000 7f5aa27fc700 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd210 0x5640ee3c0e00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5a980048a0 tx=0x7f5a98007000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed5af881a979df89 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:05.811 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.779+0000 7f5a86ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:06:05.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.785+0000 7f5a86ff5700 1 -- 172.21.15.151:0/3673899169 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a980125f0 con 0x5640ee3bd210 2023-07-21T23:06:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.785+0000 7f5a86ff5700 1 -- 172.21.15.151:0/3673899169 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(170..170 src has 1..170) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f5a98012750 con 0x5640ee3bd210 2023-07-21T23:06:05.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.785+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3673899169 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5640ee262490 con 0x5640ee3bd210 2023-07-21T23:06:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.793+0000 7f5a86ff5700 1 -- 172.21.15.151:0/3673899169 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a98012930 con 0x5640ee3bd210 2023-07-21T23:06:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.793+0000 7f5abd1a9b80 10 client.29551 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.793+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3673899169 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x5640ee11fc00 con 0x5640ee3bd210 2023-07-21T23:06:05.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.803+0000 7f5a86ff5700 1 -- 172.21.15.151:0/3673899169 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x5640ee262490 con 0x5640ee3bd210 2023-07-21T23:06:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.803+0000 7f5a86ff5700 1 -- 172.21.15.151:0/3673899169 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5a98031960 con 0x5640ee3bd210 2023-07-21T23:06:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.803+0000 7f5abd1a9b80 10 client.29551 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.803+0000 7f5abd1a9b80 10 client.29551 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.803+0000 7f5abd1a9b80 20 client.29551 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.803+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5640ee3e1ac0 0x5640ee3e3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.803+0000 7f5abd1a9b80 4 client.29551 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:06:05.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.803+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3673899169 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5640ee301e50 con 0x5640ee3e1ac0 2023-07-21T23:06:05.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.807+0000 7f5aa2ffd700 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5640ee3e1ac0 0x5640ee3e3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.817+0000 7f5aa2ffd700 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5640ee3e1ac0 0x5640ee3e3ed0 crc :-1 s=READY pgs=517 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bdb26923a162a02e server_cookie=82446351a699bb39 in_seq=0 out_seq=0 2023-07-21T23:06:05.851 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.817+0000 7f5a86ff5700 10 client.29551 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.819+0000 7f5a86ff5700 1 -- 172.21.15.151:0/3673899169 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x5640ee301e50 con 0x5640ee3e1ac0 2023-07-21T23:06:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.819+0000 7f5a86ff5700 10 client.29551 handle_command_reply: tid=0 2023-07-21T23:06:05.852 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.819+0000 7f5abd1a9b80 1 client.29551 shutdown 2023-07-21T23:06:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.820+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3673899169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd210 msgr2=0x5640ee3c0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.820+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd210 0x5640ee3c0e00 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f5a980048a0 tx=0x7f5a98007000 comp rx=0 tx=0).stop 2023-07-21T23:06:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.820+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3673899169 shutdown_connections 2023-07-21T23:06:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.820+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5640ee3e1ac0 0x5640ee3e3ed0 crc :-1 s=READY pgs=517 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.820+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee2136b0 0x5640ee3c08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.820+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee3c1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.820+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/3673899169 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd210 0x5640ee3c0e00 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.820+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3673899169 >> 172.21.15.151:0/3673899169 conn(0x5640ee3acae0 msgr2=0x5640ee3b13e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.821+0000 7f5a86ff5700 0 client.29551 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:05.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.821+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3673899169 shutdown_connections 2023-07-21T23:06:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.821+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/3673899169 wait complete. 2023-07-21T23:06:05.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.822+0000 7f5abd1a9b80 20 client.29551 trim_cache size 0 max 16384 2023-07-21T23:06:05.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.850+0000 7f5abd1a9b80 1 Processor -- start 2023-07-21T23:06:05.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.851+0000 7f5abd1a9b80 1 -- start start 2023-07-21T23:06:05.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.851+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee2136b0 0x5640ee3bc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.851+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 0x5640ee3c1140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.851+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b1b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.851+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee3aec30 con 0x5640ee2136b0 2023-07-21T23:06:05.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.851+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee3bc920 con 0x5640ee3bd210 2023-07-21T23:06:05.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.851+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee3b36b0 con 0x5640ee3bd660 2023-07-21T23:06:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.852+0000 7f5aa27fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 0x5640ee3c1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.852+0000 7f5aa27fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 0x5640ee3c1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41622/0 (socket says 172.21.15.151:41622) 2023-07-21T23:06:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.852+0000 7f5aa27fc700 1 -- 172.21.15.151:0/80517463 learned_addr learned my addr 172.21.15.151:0/80517463 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.852+0000 7f5aa2ffd700 1 --2- 172.21.15.151:0/80517463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee2136b0 0x5640ee3bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.852+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/80517463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b1b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.853+0000 7f5aa37fe700 1 -- 172.21.15.151:0/80517463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 msgr2=0x5640ee3c1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:05.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.853+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/80517463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 0x5640ee3c1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.853+0000 7f5aa37fe700 1 -- 172.21.15.151:0/80517463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee2136b0 msgr2=0x5640ee3bc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.853+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/80517463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee2136b0 0x5640ee3bc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.853+0000 7f5aa37fe700 1 -- 172.21.15.151:0/80517463 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5640ee15d1f0 con 0x5640ee3bd660 2023-07-21T23:06:05.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.854+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/80517463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b1b60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00b070 tx=0x7f5a9c01c000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5efafaebe2f4b43e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.855+0000 7f5a89ffb700 1 -- 172.21.15.151:0/80517463 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00e040 con 0x5640ee3bd660 2023-07-21T23:06:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.855+0000 7f5a89ffb700 1 -- 172.21.15.151:0/80517463 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a9c003e90 con 0x5640ee3bd660 2023-07-21T23:06:05.888 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.855+0000 7f5a89ffb700 1 -- 172.21.15.151:0/80517463 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c005a80 con 0x5640ee3bd660 2023-07-21T23:06:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.856+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/80517463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 msgr2=0x5640ee3b1b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.856+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/80517463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b1b60 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00b070 tx=0x7f5a9c01c000 comp rx=0 tx=0).stop 2023-07-21T23:06:05.889 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.857+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/80517463 shutdown_connections 2023-07-21T23:06:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.857+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/80517463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee3bd660 0x5640ee3b1b60 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.857+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/80517463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee2136b0 0x5640ee3bc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.857+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/80517463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 0x5640ee3c1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.857+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/80517463 >> 172.21.15.151:0/80517463 conn(0x5640ee3acae0 msgr2=0x5640ee3bb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:05.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.857+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/80517463 shutdown_connections 2023-07-21T23:06:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.857+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/80517463 wait complete. 2023-07-21T23:06:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.858+0000 7f5abd1a9b80 1 -- start start 2023-07-21T23:06:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.858+0000 7f5abd1a9b80 1 Processor -- start 2023-07-21T23:06:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.859+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee2136b0 0x5640ee3d7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.859+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 0x5640ee3d83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.859+0000 7f5abd1a9b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee434980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.859+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee3d8cc0 con 0x5640ee3bd660 2023-07-21T23:06:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.859+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee434ec0 con 0x5640ee3bd210 2023-07-21T23:06:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.859+0000 7f5abd1a9b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x5640ee435000 con 0x5640ee2136b0 2023-07-21T23:06:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.859+0000 7f5abd1a9b80 10 client.0 _ll_register_callbacks cb 0x7f5a98007610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.861+0000 7f5aa37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee434980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.861+0000 7f5aa37fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee434980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32974/0 (socket says 172.21.15.151:32974) 2023-07-21T23:06:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.861+0000 7f5aa37fe700 1 -- 172.21.15.151:0/2463601776 learned_addr learned my addr 172.21.15.151:0/2463601776 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.861+0000 7f5aa37fe700 1 -- 172.21.15.151:0/2463601776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee2136b0 msgr2=0x5640ee3d7e70 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:06:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.862+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee2136b0 0x5640ee3d7e70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.862+0000 7f5aa37fe700 1 -- 172.21.15.151:0/2463601776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 msgr2=0x5640ee3d83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.862+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 0x5640ee3d83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.862+0000 7f5aa37fe700 1 -- 172.21.15.151:0/2463601776 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5aa411bfb0 con 0x5640ee3bd660 2023-07-21T23:06:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.862+0000 7f5aa37fe700 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee434980 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00b780 tx=0x7f5a9c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb37eb25bb813837 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.863+0000 7f5a86ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:06:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.863+0000 7f5a86ff5700 1 -- 172.21.15.151:0/2463601776 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a9c00e040 con 0x5640ee3bd660 2023-07-21T23:06:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.863+0000 7f5a86ff5700 1 -- 172.21.15.151:0/2463601776 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(170..170 src has 1..170) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f5a9c024040 con 0x5640ee3bd660 2023-07-21T23:06:05.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.863+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/2463601776 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5a98012be0 con 0x5640ee3bd660 2023-07-21T23:06:05.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.864+0000 7f5a86ff5700 1 -- 172.21.15.151:0/2463601776 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a9c005820 con 0x5640ee3bd660 2023-07-21T23:06:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.865+0000 7f5abd1a9b80 10 client.19872 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:05.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.865+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/2463601776 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x5640ee135250 con 0x5640ee3bd660 2023-07-21T23:06:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.868+0000 7f5a86ff5700 1 -- 172.21.15.151:0/2463601776 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a98012be0 con 0x5640ee3bd660 2023-07-21T23:06:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.868+0000 7f5a86ff5700 1 -- 172.21.15.151:0/2463601776 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f5a9c01c440 con 0x5640ee3bd660 2023-07-21T23:06:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.869+0000 7f5abd1a9b80 10 client.19872 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:05.901 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.869+0000 7f5abd1a9b80 10 client.19872 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.869+0000 7f5abd1a9b80 20 client.19872 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.869+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5640ee436190 0x5640ee438570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.869+0000 7f5abd1a9b80 4 client.19872 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:06:05.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.869+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/2463601776 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x5640ee2c3ff0 con 0x5640ee436190 2023-07-21T23:06:05.912 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.879+0000 7f5aa2ffd700 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5640ee436190 0x5640ee438570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.900+0000 7f5aa2ffd700 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5640ee436190 0x5640ee438570 crc :-1 s=READY pgs=518 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=216766d911856b4a server_cookie=22e6873b0dd6ef27 in_seq=0 out_seq=0 2023-07-21T23:06:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:05.900+0000 7f5a86ff5700 10 client.19872 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.481+0000 7f5a86ff5700 1 -- 172.21.15.151:0/2463601776 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x5640ee2c3ff0 con 0x5640ee436190 2023-07-21T23:06:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.481+0000 7f5a86ff5700 10 client.19872 handle_command_reply: tid=0 2023-07-21T23:06:06.514 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.481+0000 7f5abd1a9b80 1 client.19872 shutdown 2023-07-21T23:06:06.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/2463601776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 msgr2=0x5640ee434980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:06.515 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee434980 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f5a9c00b780 tx=0x7f5a9c009c30 comp rx=0 tx=0).stop 2023-07-21T23:06:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/2463601776 shutdown_connections 2023-07-21T23:06:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x5640ee436190 0x5640ee438570 crc :-1 s=READY pgs=518 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5640ee3bd660 0x5640ee434980 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x5640ee2136b0 0x5640ee3d7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 --2- 172.21.15.151:0/2463601776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5640ee3bd210 0x5640ee3d83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/2463601776 >> 172.21.15.151:0/2463601776 conn(0x5640ee3acae0 msgr2=0x5640ee3bc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:06.516 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5a86ff5700 0 client.19872 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/2463601776 shutdown_connections 2023-07-21T23:06:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.482+0000 7f5abd1a9b80 1 -- 172.21.15.151:0/2463601776 wait complete. 2023-07-21T23:06:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.483+0000 7f5abd1a9b80 20 client.19872 trim_cache size 0 max 16384 2023-07-21T23:06:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:06:06.517 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:06:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:06:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:06:06.518 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.483+0000 7f5aa97ff700 1 -- 172.21.15.151:0/834925231 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a8c0a1490 msgr2=0x7f5a8c0a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.483+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a8c0a1490 0x7f5a8c0a3940 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5aa41ab7c0 tx=0x7f5a9c0094a0 comp rx=0 tx=0).stop 2023-07-21T23:06:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.483+0000 7f5aa97ff700 1 -- 172.21.15.151:0/834925231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5aa406c910 msgr2=0x7f5aa41aab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.483+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5aa406c910 0x7f5aa41aab30 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f5a9400e9f0 tx=0x7f5a9400ed00 comp rx=0 tx=0).stop 2023-07-21T23:06:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.484+0000 7f5aa97ff700 1 -- 172.21.15.151:0/834925231 shutdown_connections 2023-07-21T23:06:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.484+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a8c0a1490 0x7f5a8c0a3940 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.484+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5aa410e2a0 0x7f5aa41a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:06.519 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.484+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5aa406c910 0x7f5aa41aab30 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.484+0000 7f5aa97ff700 1 --2- 172.21.15.151:0/834925231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5aa406d3a0 0x7f5aa41ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.484+0000 7f5aa97ff700 1 -- 172.21.15.151:0/834925231 >> 172.21.15.151:0/834925231 conn(0x7f5aa406bd70 msgr2=0x7f5aa40707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.484+0000 7f5aa97ff700 1 -- 172.21.15.151:0/834925231 shutdown_connections 2023-07-21T23:06:06.520 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:06.484+0000 7f5aa97ff700 1 -- 172.21.15.151:0/834925231 wait complete. 2023-07-21T23:06:06.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:06 smithi187 ceph-mon[96918]: pgmap v1493: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2023-07-21T23:06:06.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:06 smithi195 ceph-mon[97365]: pgmap v1493: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2023-07-21T23:06:06.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:06 smithi151 ceph-mon[95510]: pgmap v1493: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 11 MiB/s wr, 1.16k op/s 2023-07-21T23:06:09.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 795.0 s, 68.0 tps, lat 1152.949 ms stddev 665.534 2023-07-21T23:06:09.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:09 smithi151 ceph-mon[95510]: pgmap v1494: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.7 MiB/s wr, 820 op/s 2023-07-21T23:06:09.622 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:09 smithi187 ceph-mon[96918]: pgmap v1494: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.7 MiB/s wr, 820 op/s 2023-07-21T23:06:09.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:09 smithi195 ceph-mon[97365]: pgmap v1494: 97 pgs: 4 active+clean+snaptrim, 10 active+clean+snaptrim_wait, 83 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 MiB/s rd, 7.7 MiB/s wr, 820 op/s 2023-07-21T23:06:11.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:11 smithi151 ceph-mon[95510]: pgmap v1495: 97 pgs: 20 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 40 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 742 op/s 2023-07-21T23:06:11.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:11 smithi187 ceph-mon[96918]: pgmap v1495: 97 pgs: 20 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 40 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 742 op/s 2023-07-21T23:06:11.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:11 smithi195 ceph-mon[97365]: pgmap v1495: 97 pgs: 20 active+clean+snaptrim, 37 active+clean+snaptrim_wait, 40 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 MiB/s rd, 6.7 MiB/s wr, 742 op/s 2023-07-21T23:06:13.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:13 smithi151 ceph-mon[95510]: pgmap v1496: 97 pgs: 18 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 46 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 715 op/s 2023-07-21T23:06:13.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:13 smithi187 ceph-mon[96918]: pgmap v1496: 97 pgs: 18 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 46 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 715 op/s 2023-07-21T23:06:13.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:13 smithi195 ceph-mon[97365]: pgmap v1496: 97 pgs: 18 active+clean+snaptrim, 33 active+clean+snaptrim_wait, 46 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.8 MiB/s wr, 715 op/s 2023-07-21T23:06:14.297 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 800.0 s, 222.0 tps, lat 563.567 ms stddev 841.338 2023-07-21T23:06:15.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:15 smithi187 ceph-mon[96918]: pgmap v1497: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 416 op/s 2023-07-21T23:06:15.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:15 smithi195 ceph-mon[97365]: pgmap v1497: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 416 op/s 2023-07-21T23:06:15.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:15 smithi151 ceph-mon[95510]: pgmap v1497: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.8 MiB/s wr, 416 op/s 2023-07-21T23:06:17.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:17 smithi187 ceph-mon[96918]: pgmap v1498: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 363 op/s 2023-07-21T23:06:17.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:17 smithi187 ceph-mon[96918]: osdmap e171: 12 total, 12 up, 12 in 2023-07-21T23:06:17.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:17 smithi195 ceph-mon[97365]: pgmap v1498: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 363 op/s 2023-07-21T23:06:17.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:17 smithi195 ceph-mon[97365]: osdmap e171: 12 total, 12 up, 12 in 2023-07-21T23:06:17.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:17 smithi151 ceph-mon[95510]: pgmap v1498: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.3 MiB/s wr, 363 op/s 2023-07-21T23:06:17.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:17 smithi151 ceph-mon[95510]: osdmap e171: 12 total, 12 up, 12 in 2023-07-21T23:06:19.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 805.0 s, 291.7 tps, lat 343.150 ms stddev 94.340 2023-07-21T23:06:19.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:19 smithi187 ceph-mon[96918]: pgmap v1500: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 477 op/s 2023-07-21T23:06:19.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:19 smithi195 ceph-mon[97365]: pgmap v1500: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 477 op/s 2023-07-21T23:06:19.688 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:19 smithi151 ceph-mon[95510]: pgmap v1500: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.1 MiB/s rd, 4.4 MiB/s wr, 477 op/s 2023-07-21T23:06:19.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.767+0000 7f3f897ff700 1 -- 172.21.15.151:0/986372404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84106ff0 msgr2=0x7f3f8410ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:19.800 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.767+0000 7f3f897ff700 1 --2- 172.21.15.151:0/986372404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84106ff0 0x7f3f8410ebc0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7f3f78009920 tx=0x7f3f78009c30 comp rx=0 tx=0).stop 2023-07-21T23:06:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.775+0000 7f3f897ff700 1 -- 172.21.15.151:0/986372404 shutdown_connections 2023-07-21T23:06:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.775+0000 7f3f897ff700 1 --2- 172.21.15.151:0/986372404 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84106ff0 0x7f3f8410ebc0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.775+0000 7f3f897ff700 1 --2- 172.21.15.151:0/986372404 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f84101fb0 0x7f3f84102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.775+0000 7f3f897ff700 1 --2- 172.21.15.151:0/986372404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f84102950 0x7f3f84106910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.808 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.775+0000 7f3f897ff700 1 -- 172.21.15.151:0/986372404 >> 172.21.15.151:0/986372404 conn(0x7f3f840fd800 msgr2=0x7f3f840ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:19.812 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.776+0000 7f3f897ff700 1 -- 172.21.15.151:0/986372404 shutdown_connections 2023-07-21T23:06:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.776+0000 7f3f897ff700 1 -- 172.21.15.151:0/986372404 wait complete. 2023-07-21T23:06:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.778+0000 7f3f897ff700 1 Processor -- start 2023-07-21T23:06:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.778+0000 7f3f897ff700 1 -- start start 2023-07-21T23:06:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.778+0000 7f3f897ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84101fb0 0x7f3f8410cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.778+0000 7f3f897ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f84102950 0x7f3f84071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.813 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.778+0000 7f3f897ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f84106ff0 0x7f3f8410d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.778+0000 7f3f897ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8410dbe0 con 0x7f3f84101fb0 2023-07-21T23:06:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.778+0000 7f3f897ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f8410dd20 con 0x7f3f84106ff0 2023-07-21T23:06:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.778+0000 7f3f897ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f84110cb0 con 0x7f3f84102950 2023-07-21T23:06:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.780+0000 7f3f82ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84101fb0 0x7f3f8410cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.780+0000 7f3f82ffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84101fb0 0x7f3f8410cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47450/0 (socket says 172.21.15.151:47450) 2023-07-21T23:06:19.814 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.780+0000 7f3f82ffd700 1 -- 172.21.15.151:0/2852420040 learned_addr learned my addr 172.21.15.151:0/2852420040 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.781+0000 7f3f82ffd700 1 -- 172.21.15.151:0/2852420040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f84102950 msgr2=0x7f3f84071f90 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T23:06:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.781+0000 7f3f82ffd700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f84102950 0x7f3f84071f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.781+0000 7f3f82ffd700 1 -- 172.21.15.151:0/2852420040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f84106ff0 msgr2=0x7f3f8410d450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-07-21T23:06:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.781+0000 7f3f82ffd700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f84106ff0 0x7f3f8410d450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.781+0000 7f3f82ffd700 1 -- 172.21.15.151:0/2852420040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f78009520 con 0x7f3f84101fb0 2023-07-21T23:06:19.815 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.782+0000 7f3f82ffd700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84101fb0 0x7f3f8410cf10 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c007fa0 tx=0x7f3f7c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.784+0000 7f3f6bfff700 1 -- 172.21.15.151:0/2852420040 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c00de60 con 0x7f3f84101fb0 2023-07-21T23:06:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.784+0000 7f3f6bfff700 1 -- 172.21.15.151:0/2852420040 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f7c00f040 con 0x7f3f84101fb0 2023-07-21T23:06:19.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.784+0000 7f3f6bfff700 1 -- 172.21.15.151:0/2852420040 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7c014690 con 0x7f3f84101fb0 2023-07-21T23:06:19.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.785+0000 7f3f897ff700 1 -- 172.21.15.151:0/2852420040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f84110f90 con 0x7f3f84101fb0 2023-07-21T23:06:19.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.785+0000 7f3f897ff700 1 -- 172.21.15.151:0/2852420040 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f84111450 con 0x7f3f84101fb0 2023-07-21T23:06:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.793+0000 7f3f9d0d2b80 1 Processor -- start 2023-07-21T23:06:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.793+0000 7f3f9d0d2b80 1 -- start start 2023-07-21T23:06:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.793+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e9692c6b0 0x557e96ad5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.793+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e96ad6210 0x557e96acff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.794+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96ad04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.794+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e969d5c50 con 0x557e9692c6b0 2023-07-21T23:06:19.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.794+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e96a289e0 con 0x557e96ad6660 2023-07-21T23:06:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.794+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e96a21e70 con 0x557e96ad6210 2023-07-21T23:06:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.794+0000 7f3f837fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e9692c6b0 0x557e96ad5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.794+0000 7f3f837fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e9692c6b0 0x557e96ad5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47456/0 (socket says 172.21.15.151:47456) 2023-07-21T23:06:19.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.794+0000 7f3f837fe700 1 -- 172.21.15.151:0/2238283763 learned_addr learned my addr 172.21.15.151:0/2238283763 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.796+0000 7f3f6bfff700 1 -- 172.21.15.151:0/2852420040 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f3f7c015400 con 0x7f3f84101fb0 2023-07-21T23:06:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.796+0000 7f3f837fe700 1 -- 172.21.15.151:0/2238283763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e96ad6210 msgr2=0x557e96acff40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:06:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.796+0000 7f3f837fe700 1 --2- 172.21.15.151:0/2238283763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e96ad6210 0x557e96acff40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.796+0000 7f3f837fe700 1 -- 172.21.15.151:0/2238283763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 msgr2=0x557e96ad04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.796+0000 7f3f827fc700 1 --2- 172.21.15.151:0/2238283763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96ad04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.796+0000 7f3f837fe700 1 --2- 172.21.15.151:0/2238283763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96ad04a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.796+0000 7f3f837fe700 1 -- 172.21.15.151:0/2238283763 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e9684fd80 con 0x557e9692c6b0 2023-07-21T23:06:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.797+0000 7f3f837fe700 1 --2- 172.21.15.151:0/2238283763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e9692c6b0 0x557e96ad5cd0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f3f780098f0 tx=0x7f3f78010c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=207c37ecf486d47b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.798+0000 7f3f697fa700 1 -- 172.21.15.151:0/2238283763 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7801c070 con 0x557e9692c6b0 2023-07-21T23:06:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.798+0000 7f3f697fa700 1 -- 172.21.15.151:0/2238283763 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f78010e20 con 0x557e9692c6b0 2023-07-21T23:06:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.798+0000 7f3f697fa700 1 -- 172.21.15.151:0/2238283763 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7800b790 con 0x557e9692c6b0 2023-07-21T23:06:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.798+0000 7f3f6bfff700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f6c0a14d0 0x7f3f6c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.799+0000 7f3f6bfff700 1 -- 172.21.15.151:0/2852420040 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f7c0cc5a0 con 0x7f3f84101fb0 2023-07-21T23:06:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.799+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/2238283763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e9692c6b0 msgr2=0x557e96ad5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.799+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/2238283763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e9692c6b0 0x557e96ad5cd0 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f3f780098f0 tx=0x7f3f78010c80 comp rx=0 tx=0).stop 2023-07-21T23:06:19.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.799+0000 7f3f82ffd700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f6c0a14d0 0x7f3f6c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.800+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/2238283763 shutdown_connections 2023-07-21T23:06:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.800+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/2238283763 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96ad04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.800+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/2238283763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e9692c6b0 0x557e96ad5cd0 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.800+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/2238283763 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e96ad6210 0x557e96acff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.800+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/2238283763 >> 172.21.15.151:0/2238283763 conn(0x557e96ac5ae0 msgr2=0x557e96acb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.800+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/2238283763 shutdown_connections 2023-07-21T23:06:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.800+0000 7f3f82ffd700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f6c0a14d0 0x7f3f6c0a3980 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c095b30 tx=0x7f3f7c095250 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.801+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/2238283763 wait complete. 2023-07-21T23:06:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.801+0000 7f3f9d0d2b80 1 -- start start 2023-07-21T23:06:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.802+0000 7f3f9d0d2b80 1 Processor -- start 2023-07-21T23:06:19.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.803+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96adc500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.803+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 0x557e96ad9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.803+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96ad9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.803+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e969c1a60 con 0x557e96ad6210 2023-07-21T23:06:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.803+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e969c1760 con 0x557e96ad6660 2023-07-21T23:06:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.803+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e968a58c0 con 0x557e9692c6b0 2023-07-21T23:06:19.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.803+0000 7f3f9d0d2b80 10 client.0 _ll_register_callbacks cb 0x557e969bf700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.803+0000 7f3f837fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96adc500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.804+0000 7f3f837fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96adc500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43190/0 (socket says 172.21.15.151:43190) 2023-07-21T23:06:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.804+0000 7f3f837fe700 1 -- 172.21.15.151:0/3374655803 learned_addr learned my addr 172.21.15.151:0/3374655803 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.804+0000 7f3f837fe700 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96ad9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.804+0000 7f3f837fe700 1 -- 172.21.15.151:0/3374655803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 msgr2=0x557e96ad9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.804+0000 7f3f837fe700 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96ad9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.804+0000 7f3f837fe700 1 -- 172.21.15.151:0/3374655803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 msgr2=0x557e96ad9780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:06:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.804+0000 7f3f837fe700 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 0x557e96ad9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.838 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.804+0000 7f3f837fe700 1 -- 172.21.15.151:0/3374655803 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f8410f400 con 0x557e9692c6b0 2023-07-21T23:06:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.805+0000 7f3f837fe700 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96adc500 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800ba40 tx=0x7f3f78019040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b54827da53596b4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.805+0000 7f3f66ff5700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:06:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.805+0000 7f3f66ff5700 1 -- 172.21.15.151:0/3374655803 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7801c020 con 0x557e9692c6b0 2023-07-21T23:06:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.806+0000 7f3f66ff5700 1 -- 172.21.15.151:0/3374655803 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f7800bd60 con 0x557e9692c6b0 2023-07-21T23:06:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.806+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3374655803 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557e9697b490 con 0x557e9692c6b0 2023-07-21T23:06:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.806+0000 7f3f66ff5700 1 -- 172.21.15.151:0/3374655803 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f7800f460 con 0x557e9692c6b0 2023-07-21T23:06:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.806+0000 7f3f9d0d2b80 10 client.29560 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.806+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3374655803 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x557e96838c00 con 0x557e9692c6b0 2023-07-21T23:06:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.807+0000 7f3f66ff5700 1 -- 172.21.15.151:0/3374655803 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557e9697b490 con 0x557e9692c6b0 2023-07-21T23:06:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.807+0000 7f3f66ff5700 1 -- 172.21.15.151:0/3374655803 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3f78015020 con 0x557e9692c6b0 2023-07-21T23:06:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.807+0000 7f3f9d0d2b80 10 client.29560 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.807+0000 7f3f9d0d2b80 10 client.29560 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.807+0000 7f3f9d0d2b80 20 client.29560 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.807+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e96ae9540 0x557e96aeb920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.807+0000 7f3f9d0d2b80 4 client.29560 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:06:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.807+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3374655803 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557e96a1ae50 con 0x557e96ae9540 2023-07-21T23:06:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.810+0000 7f3f827fc700 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e96ae9540 0x557e96aeb920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.817+0000 7f3f827fc700 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e96ae9540 0x557e96aeb920 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c28949867c526c6a server_cookie=fe87ebf7a10df4e9 in_seq=0 out_seq=0 2023-07-21T23:06:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.817+0000 7f3f66ff5700 10 client.29560 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:19.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.821+0000 7f3f66ff5700 1 -- 172.21.15.151:0/3374655803 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557e96a1ae50 con 0x557e96ae9540 2023-07-21T23:06:19.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.821+0000 7f3f66ff5700 10 client.29560 handle_command_reply: tid=0 2023-07-21T23:06:19.853 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.821+0000 7f3f9d0d2b80 1 client.29560 shutdown 2023-07-21T23:06:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.821+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3374655803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 msgr2=0x557e96adc500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.821+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96adc500 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f3f7800ba40 tx=0x7f3f78019040 comp rx=0 tx=0).stop 2023-07-21T23:06:19.854 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.822+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3374655803 shutdown_connections 2023-07-21T23:06:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.822+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e96ae9540 0x557e96aeb920 crc :-1 s=READY pgs=519 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.822+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96ad9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.822+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96adc500 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.822+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3374655803 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 0x557e96ad9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.822+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3374655803 >> 172.21.15.151:0/3374655803 conn(0x557e96ac5ae0 msgr2=0x557e96aca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:19.855 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.822+0000 7f3f66ff5700 0 client.29560 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.822+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3374655803 shutdown_connections 2023-07-21T23:06:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.822+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3374655803 wait complete. 2023-07-21T23:06:19.856 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.823+0000 7f3f9d0d2b80 20 client.29560 trim_cache size 0 max 16384 2023-07-21T23:06:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.852+0000 7f3f9d0d2b80 1 Processor -- start 2023-07-21T23:06:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.852+0000 7f3f9d0d2b80 1 -- start start 2023-07-21T23:06:19.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.852+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ae0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.852+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 0x557e96ad8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.852+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96adc0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.852+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e96adad60 con 0x557e96ad6210 2023-07-21T23:06:19.886 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.852+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e96ad0f20 con 0x557e96ad6660 2023-07-21T23:06:19.887 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.852+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e96ad0cd0 con 0x557e9692c6b0 2023-07-21T23:06:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f827fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 0x557e96ad8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f827fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 0x557e96ad8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47470/0 (socket says 172.21.15.151:47470) 2023-07-21T23:06:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f827fc700 1 -- 172.21.15.151:0/3987833679 learned_addr learned my addr 172.21.15.151:0/3987833679 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f837fe700 1 --2- 172.21.15.151:0/3987833679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ae0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.890 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f837fe700 1 --2- 172.21.15.151:0/3987833679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96adc0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f827fc700 1 -- 172.21.15.151:0/3987833679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 msgr2=0x557e96ae0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f827fc700 1 --2- 172.21.15.151:0/3987833679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ae0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f827fc700 1 -- 172.21.15.151:0/3987833679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 msgr2=0x557e96adc0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f827fc700 1 --2- 172.21.15.151:0/3987833679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96adc0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f827fc700 1 -- 172.21.15.151:0/3987833679 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557e968761f0 con 0x557e96ad6210 2023-07-21T23:06:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.853+0000 7f3f827fc700 1 --2- 172.21.15.151:0/3987833679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 0x557e96ad8f80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3f8410f0d0 tx=0x7f3f74016c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6b62093638b44 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f69ffb700 1 -- 172.21.15.151:0/3987833679 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f74016330 con 0x557e96ad6210 2023-07-21T23:06:19.891 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f69ffb700 1 -- 172.21.15.151:0/3987833679 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f7400c040 con 0x557e96ad6210 2023-07-21T23:06:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f69ffb700 1 -- 172.21.15.151:0/3987833679 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7401f6d0 con 0x557e96ad6210 2023-07-21T23:06:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3987833679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 msgr2=0x557e96ad8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3987833679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 0x557e96ad8f80 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f3f8410f0d0 tx=0x7f3f74016c80 comp rx=0 tx=0).stop 2023-07-21T23:06:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3987833679 shutdown_connections 2023-07-21T23:06:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3987833679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6660 0x557e96adc0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.892 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3987833679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ae0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/3987833679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6210 0x557e96ad8f80 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.854+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3987833679 >> 172.21.15.151:0/3987833679 conn(0x557e96ac5ae0 msgr2=0x557e96ad3930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.855+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3987833679 shutdown_connections 2023-07-21T23:06:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.855+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/3987833679 wait complete. 2023-07-21T23:06:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.855+0000 7f3f9d0d2b80 1 -- start start 2023-07-21T23:06:19.893 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.855+0000 7f3f9d0d2b80 1 Processor -- start 2023-07-21T23:06:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ad2c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6210 0x557e96ad1730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f9d0d2b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6660 0x557e96ad1c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e96ad32e0 con 0x557e96ad6660 2023-07-21T23:06:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e96ad3450 con 0x557e96ad6210 2023-07-21T23:06:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f9d0d2b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557e96ad21b0 con 0x557e9692c6b0 2023-07-21T23:06:19.894 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f9d0d2b80 10 client.0 _ll_register_callbacks cb 0x7f3f78005790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f827fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6210 0x557e96ad1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f837fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ad2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f827fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6210 0x557e96ad1730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:54942/0 (socket says 172.21.15.151:54942) 2023-07-21T23:06:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f827fc700 1 -- 172.21.15.151:0/794115973 learned_addr learned my addr 172.21.15.151:0/794115973 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f837fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ad2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43220/0 (socket says 172.21.15.151:43220) 2023-07-21T23:06:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.856+0000 7f3f837fe700 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6660 0x557e96ad1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.895 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.857+0000 7f3f827fc700 1 -- 172.21.15.151:0/794115973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 msgr2=0x557e96ad2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.857+0000 7f3f827fc700 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ad2c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.857+0000 7f3f827fc700 1 -- 172.21.15.151:0/794115973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6660 msgr2=0x557e96ad1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.857+0000 7f3f827fc700 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6660 0x557e96ad1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.857+0000 7f3f827fc700 1 -- 172.21.15.151:0/794115973 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f74016a60 con 0x557e96ad6210 2023-07-21T23:06:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.857+0000 7f3f837fe700 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ad2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:06:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.857+0000 7f3f66ff5700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:06:19.896 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.857+0000 7f3f827fc700 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6210 0x557e96ad1730 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3f74000c00 tx=0x7f3f74016360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eab0fff06a25cfe4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.857+0000 7f3f66ff5700 1 -- 172.21.15.151:0/794115973 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f7400a9a0 con 0x557e96ad6210 2023-07-21T23:06:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/794115973 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3f78010e20 con 0x557e96ad6210 2023-07-21T23:06:19.897 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f66ff5700 1 -- 172.21.15.151:0/794115973 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f3f7400ab00 con 0x557e96ad6210 2023-07-21T23:06:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f66ff5700 1 -- 172.21.15.151:0/794115973 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3f7400aeb0 con 0x557e96ad6210 2023-07-21T23:06:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f9d0d2b80 10 client.29519 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/794115973 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x557e9684e250 con 0x557e96ad6210 2023-07-21T23:06:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f66ff5700 1 -- 172.21.15.151:0/794115973 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f3f74037020 con 0x557e96ad6210 2023-07-21T23:06:19.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f66ff5700 1 -- 172.21.15.151:0/794115973 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f3f7401f470 con 0x557e96ad6210 2023-07-21T23:06:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f9d0d2b80 10 client.29519 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f9d0d2b80 10 client.29519 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.858+0000 7f3f9d0d2b80 20 client.29519 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.859+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e96b3e370 0x557e96b40780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.859+0000 7f3f9d0d2b80 4 client.29519 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:06:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.859+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/794115973 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557e969dcff0 con 0x557e96b3e370 2023-07-21T23:06:19.899 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.859+0000 7f3f837fe700 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e96b3e370 0x557e96b40780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.859+0000 7f3f837fe700 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e96b3e370 0x557e96b40780 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f9c8379fa8633d0 server_cookie=d64f0ae3e56f3e39 in_seq=0 out_seq=0 2023-07-21T23:06:19.900 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.859+0000 7f3f66ff5700 10 client.29519 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.890+0000 7f3f66ff5700 1 -- 172.21.15.151:0/794115973 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557e969dcff0 con 0x557e96b3e370 2023-07-21T23:06:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.890+0000 7f3f66ff5700 10 client.29519 handle_command_reply: tid=0 2023-07-21T23:06:19.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.890+0000 7f3f9d0d2b80 1 client.29519 shutdown 2023-07-21T23:06:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.890+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/794115973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6210 msgr2=0x557e96ad1730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:19.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.890+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6210 0x557e96ad1730 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f3f74000c00 tx=0x7f3f74016360 comp rx=0 tx=0).stop 2023-07-21T23:06:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.891+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/794115973 shutdown_connections 2023-07-21T23:06:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.891+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557e96b3e370 0x557e96b40780 crc :-1 s=READY pgs=520 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.891+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557e96ad6660 0x557e96ad1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.891+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557e9692c6b0 0x557e96ad2c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.891+0000 7f3f66ff5700 0 client.29519 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.891+0000 7f3f9d0d2b80 1 --2- 172.21.15.151:0/794115973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557e96ad6210 0x557e96ad1730 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.891+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/794115973 >> 172.21.15.151:0/794115973 conn(0x557e96ac5ae0 msgr2=0x557e96ad6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:19.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.891+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/794115973 shutdown_connections 2023-07-21T23:06:19.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.891+0000 7f3f9d0d2b80 1 -- 172.21.15.151:0/794115973 wait complete. 2023-07-21T23:06:19.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.896+0000 7f3f9d0d2b80 20 client.29519 trim_cache size 0 max 16384 2023-07-21T23:06:19.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:06:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:06:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:06:19.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:06:19.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.899+0000 7f3f897ff700 1 -- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f6c0a14d0 msgr2=0x7f3f6c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.899+0000 7f3f897ff700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f6c0a14d0 0x7f3f6c0a3980 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c095b30 tx=0x7f3f7c095250 comp rx=0 tx=0).stop 2023-07-21T23:06:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.899+0000 7f3f897ff700 1 -- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84101fb0 msgr2=0x7f3f8410cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:19.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.899+0000 7f3f897ff700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84101fb0 0x7f3f8410cf10 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f3f7c007fa0 tx=0x7f3f7c00d3b0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.911+0000 7f3f897ff700 1 -- 172.21.15.151:0/2852420040 shutdown_connections 2023-07-21T23:06:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.911+0000 7f3f897ff700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f3f6c0a14d0 0x7f3f6c0a3980 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.911+0000 7f3f897ff700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f84106ff0 0x7f3f8410d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.911+0000 7f3f897ff700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f84101fb0 0x7f3f8410cf10 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.911+0000 7f3f897ff700 1 --2- 172.21.15.151:0/2852420040 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3f84102950 0x7f3f84071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:19.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.911+0000 7f3f897ff700 1 -- 172.21.15.151:0/2852420040 >> 172.21.15.151:0/2852420040 conn(0x7f3f840fd800 msgr2=0x7f3f84078240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.919+0000 7f3f897ff700 1 -- 172.21.15.151:0/2852420040 shutdown_connections 2023-07-21T23:06:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:19.920+0000 7f3f897ff700 1 -- 172.21.15.151:0/2852420040 wait complete. 2023-07-21T23:06:21.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:21 smithi187 ceph-mon[96918]: pgmap v1501: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.8 MiB/s wr, 728 op/s 2023-07-21T23:06:21.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:21 smithi195 ceph-mon[97365]: pgmap v1501: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.8 MiB/s wr, 728 op/s 2023-07-21T23:06:21.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:21 smithi151 ceph-mon[95510]: pgmap v1501: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.8 MiB/s wr, 728 op/s 2023-07-21T23:06:23.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:23 smithi187 ceph-mon[96918]: pgmap v1502: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.6 MiB/s wr, 759 op/s 2023-07-21T23:06:23.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:23 smithi195 ceph-mon[97365]: pgmap v1502: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.6 MiB/s wr, 759 op/s 2023-07-21T23:06:23.689 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:23 smithi151 ceph-mon[95510]: pgmap v1502: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 MiB/s rd, 6.6 MiB/s wr, 759 op/s 2023-07-21T23:06:24.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 810.0 s, 357.2 tps, lat 281.418 ms stddev 70.054 2023-07-21T23:06:25.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:25 smithi187 ceph-mon[96918]: pgmap v1503: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 1.04k op/s 2023-07-21T23:06:25.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:25 smithi195 ceph-mon[97365]: pgmap v1503: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 1.04k op/s 2023-07-21T23:06:25.689 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:25 smithi151 ceph-mon[95510]: pgmap v1503: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 1.04k op/s 2023-07-21T23:06:27.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:27 smithi187 ceph-mon[96918]: pgmap v1504: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 1.06k op/s 2023-07-21T23:06:27.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:27 smithi195 ceph-mon[97365]: pgmap v1504: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 1.06k op/s 2023-07-21T23:06:27.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:27 smithi151 ceph-mon[95510]: pgmap v1504: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.4 MiB/s wr, 1.06k op/s 2023-07-21T23:06:29.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 815.0 s, 365.6 tps, lat 274.073 ms stddev 71.039 2023-07-21T23:06:29.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:29 smithi187 ceph-mon[96918]: pgmap v1505: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.2 MiB/s wr, 1.05k op/s 2023-07-21T23:06:29.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:29 smithi195 ceph-mon[97365]: pgmap v1505: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.2 MiB/s wr, 1.05k op/s 2023-07-21T23:06:29.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:29 smithi151 ceph-mon[95510]: pgmap v1505: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.2 MiB/s wr, 1.05k op/s 2023-07-21T23:06:30.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:30 smithi187 ceph-mon[96918]: pgmap v1506: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-21T23:06:30.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:30 smithi195 ceph-mon[97365]: pgmap v1506: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-21T23:06:30.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:30 smithi151 ceph-mon[95510]: pgmap v1506: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 MiB/s rd, 12 MiB/s wr, 1.29k op/s 2023-07-21T23:06:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.180+0000 7f4c901ff700 1 -- 172.21.15.151:0/1180459241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c880ffb30 msgr2=0x7f4c880fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.180+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1180459241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c880ffb30 0x7f4c880fffa0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009990 tx=0x7f4c78009ca0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.180+0000 7f4c901ff700 1 -- 172.21.15.151:0/1180459241 shutdown_connections 2023-07-21T23:06:33.213 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.180+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1180459241 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c881004e0 0x7f4c8810c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.180+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1180459241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c88105b60 0x7f4c88105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.181+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1180459241 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c880ffb30 0x7f4c880fffa0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.181+0000 7f4c901ff700 1 -- 172.21.15.151:0/1180459241 >> 172.21.15.151:0/1180459241 conn(0x7f4c880fb5f0 msgr2=0x7f4c880fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.181+0000 7f4c901ff700 1 -- 172.21.15.151:0/1180459241 shutdown_connections 2023-07-21T23:06:33.214 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.181+0000 7f4c901ff700 1 -- 172.21.15.151:0/1180459241 wait complete. 2023-07-21T23:06:33.215 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.183+0000 7f4c901ff700 1 Processor -- start 2023-07-21T23:06:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.184+0000 7f4c901ff700 1 -- start start 2023-07-21T23:06:33.217 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.184+0000 7f4c901ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c880ffb30 0x7f4c88106910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.184+0000 7f4c901ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c881004e0 0x7f4c88106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.184+0000 7f4c901ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c88105b60 0x7f4c881a8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.218 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.184+0000 7f4c901ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c881076b0 con 0x7f4c881004e0 2023-07-21T23:06:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.184+0000 7f4c901ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c88197aa0 con 0x7f4c880ffb30 2023-07-21T23:06:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.184+0000 7f4c901ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c88197c60 con 0x7f4c88105b60 2023-07-21T23:06:33.219 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.185+0000 7f4c8df9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c880ffb30 0x7f4c88106910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.185+0000 7f4c8df9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c880ffb30 0x7f4c88106910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37954/0 (socket says 172.21.15.151:37954) 2023-07-21T23:06:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.185+0000 7f4c8df9b700 1 -- 172.21.15.151:0/1717620874 learned_addr learned my addr 172.21.15.151:0/1717620874 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:33.220 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.185+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c88105b60 0x7f4c881a8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.186+0000 7f4c8d79a700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c881004e0 0x7f4c88106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.186+0000 7f4c8df9b700 1 -- 172.21.15.151:0/1717620874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c88105b60 msgr2=0x7f4c881a8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.186+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c88105b60 0x7f4c881a8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.186+0000 7f4c8df9b700 1 -- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c881004e0 msgr2=0x7f4c88106e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.186+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c881004e0 0x7f4c88106e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.186+0000 7f4c8df9b700 1 -- 172.21.15.151:0/1717620874 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c780095f0 con 0x7f4c880ffb30 2023-07-21T23:06:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.186+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c880ffb30 0x7f4c88106910 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400e9a0 tx=0x7f4c8400ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.187+0000 7f4c7effd700 1 -- 172.21.15.151:0/1717620874 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c84009790 con 0x7f4c880ffb30 2023-07-21T23:06:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.187+0000 7f4c7effd700 1 -- 172.21.15.151:0/1717620874 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c84010430 con 0x7f4c880ffb30 2023-07-21T23:06:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.187+0000 7f4c7effd700 1 -- 172.21.15.151:0/1717620874 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400cea0 con 0x7f4c880ffb30 2023-07-21T23:06:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.187+0000 7f4c901ff700 1 -- 172.21.15.151:0/1717620874 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c88197f40 con 0x7f4c880ffb30 2023-07-21T23:06:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.187+0000 7f4c901ff700 1 -- 172.21.15.151:0/1717620874 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c88198420 con 0x7f4c880ffb30 2023-07-21T23:06:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.192+0000 7f4c7effd700 1 -- 172.21.15.151:0/1717620874 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f4c8400ca10 con 0x7f4c880ffb30 2023-07-21T23:06:33.226 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.194+0000 7f4ca3a46b80 1 Processor -- start 2023-07-21T23:06:33.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.194+0000 7f4ca3a46b80 1 -- start start 2023-07-21T23:06:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.195+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc65c6b0 0x55d6cc805cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.195+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc806210 0x55d6cc7fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.195+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806660 0x55d6cc8004a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.195+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc705c50 con 0x55d6cc65c6b0 2023-07-21T23:06:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.195+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc7589e0 con 0x55d6cc806210 2023-07-21T23:06:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.195+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc751e70 con 0x55d6cc806660 2023-07-21T23:06:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.196+0000 7f4c8e79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc65c6b0 0x55d6cc805cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.196+0000 7f4c8e79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc65c6b0 0x55d6cc805cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46112/0 (socket says 172.21.15.151:46112) 2023-07-21T23:06:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.196+0000 7f4c8e79c700 1 -- 172.21.15.151:0/2714004608 learned_addr learned my addr 172.21.15.151:0/2714004608 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.196+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/2714004608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc806210 0x55d6cc7fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.196+0000 7f4c7effd700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4c740a1410 0x7f4c740a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.196+0000 7f4c7effd700 1 -- 172.21.15.151:0/1717620874 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4c84014070 con 0x7f4c880ffb30 2023-07-21T23:06:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.197+0000 7f4c8e79c700 1 -- 172.21.15.151:0/2714004608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806660 msgr2=0x55d6cc8004a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.197+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/2714004608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806660 0x55d6cc8004a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.197+0000 7f4c8e79c700 1 -- 172.21.15.151:0/2714004608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc806210 msgr2=0x55d6cc7fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.197+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/2714004608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc806210 0x55d6cc7fff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.197+0000 7f4c8e79c700 1 -- 172.21.15.151:0/2714004608 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6cc57fd80 con 0x55d6cc65c6b0 2023-07-21T23:06:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.197+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4c740a1410 0x7f4c740a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.198+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/2714004608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc65c6b0 0x55d6cc805cd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4c800099f0 tx=0x7f4c80009d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d724ffec1fb5f0a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.199+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4c740a1410 0x7f4c740a38c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4c80021000 tx=0x7f4c8001e000 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.200+0000 7f4c73fff700 1 -- 172.21.15.151:0/2714004608 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80007c70 con 0x55d6cc65c6b0 2023-07-21T23:06:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.200+0000 7f4c73fff700 1 -- 172.21.15.151:0/2714004608 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c8000f040 con 0x55d6cc65c6b0 2023-07-21T23:06:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.200+0000 7f4c73fff700 1 -- 172.21.15.151:0/2714004608 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c800223f0 con 0x55d6cc65c6b0 2023-07-21T23:06:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.201+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2714004608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc65c6b0 msgr2=0x55d6cc805cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.201+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/2714004608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc65c6b0 0x55d6cc805cd0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f4c800099f0 tx=0x7f4c80009d00 comp rx=0 tx=0).stop 2023-07-21T23:06:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.201+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2714004608 shutdown_connections 2023-07-21T23:06:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.201+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/2714004608 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806660 0x55d6cc8004a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.201+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/2714004608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc65c6b0 0x55d6cc805cd0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.234 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.201+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/2714004608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc806210 0x55d6cc7fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.201+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2714004608 >> 172.21.15.151:0/2714004608 conn(0x55d6cc7f5ae0 msgr2=0x55d6cc7fb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:33.235 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.203+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2714004608 shutdown_connections 2023-07-21T23:06:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.203+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2714004608 wait complete. 2023-07-21T23:06:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.204+0000 7f4ca3a46b80 1 -- start start 2023-07-21T23:06:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.204+0000 7f4ca3a46b80 1 Processor -- start 2023-07-21T23:06:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.205+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 0x55d6cc80c640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.205+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806210 0x55d6cc8098c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.205+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc806660 0x55d6cc80a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.205+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc6f1a60 con 0x55d6cc806660 2023-07-21T23:06:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.205+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc6f1760 con 0x55d6cc65c6b0 2023-07-21T23:06:33.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.205+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc5d58c0 con 0x55d6cc806210 2023-07-21T23:06:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.205+0000 7f4ca3a46b80 10 client.0 _ll_register_callbacks cb 0x55d6cc6ef700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:33.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.206+0000 7f4c8d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806210 0x55d6cc8098c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.206+0000 7f4c8d79a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806210 0x55d6cc8098c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:34350/0 (socket says 172.21.15.151:34350) 2023-07-21T23:06:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.206+0000 7f4c8d79a700 1 -- 172.21.15.151:0/3721616921 learned_addr learned my addr 172.21.15.151:0/3721616921 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.206+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc806660 0x55d6cc80a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.207+0000 7f4c8d79a700 1 -- 172.21.15.151:0/3721616921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 msgr2=0x55d6cc80c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.207+0000 7f4c8d79a700 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 0x55d6cc80c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.207+0000 7f4c8d79a700 1 -- 172.21.15.151:0/3721616921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc806660 msgr2=0x55d6cc80a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.207+0000 7f4c8d79a700 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc806660 0x55d6cc80a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.207+0000 7f4c8d79a700 1 -- 172.21.15.151:0/3721616921 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c80003ce0 con 0x55d6cc806210 2023-07-21T23:06:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.207+0000 7f4c8d79a700 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806210 0x55d6cc8098c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009990 tx=0x7f4c78005f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f6a5c2f29eb040bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.207+0000 7f4c717fa700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:06:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.208+0000 7f4c717fa700 1 -- 172.21.15.151:0/3721616921 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7801d070 con 0x55d6cc806210 2023-07-21T23:06:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.208+0000 7f4c717fa700 1 -- 172.21.15.151:0/3721616921 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4c78004500 con 0x55d6cc806210 2023-07-21T23:06:33.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.208+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/3721616921 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d6cc6ab490 con 0x55d6cc806210 2023-07-21T23:06:33.243 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.210+0000 7f4c717fa700 1 -- 172.21.15.151:0/3721616921 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c780046c0 con 0x55d6cc806210 2023-07-21T23:06:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.210+0000 7f4ca3a46b80 10 client.29575 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.210+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/3721616921 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55d6cc568c00 con 0x55d6cc806210 2023-07-21T23:06:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.210+0000 7f4c717fa700 1 -- 172.21.15.151:0/3721616921 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d6cc6ab490 con 0x55d6cc806210 2023-07-21T23:06:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.210+0000 7f4c717fa700 1 -- 172.21.15.151:0/3721616921 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c7800f8b0 con 0x55d6cc806210 2023-07-21T23:06:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.210+0000 7f4ca3a46b80 10 client.29575 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.210+0000 7f4ca3a46b80 10 client.29575 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:33.244 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.211+0000 7f4ca3a46b80 20 client.29575 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.211+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d6cc83bc20 0x55d6cc83e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.211+0000 7f4ca3a46b80 4 client.29575 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:06:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.211+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/3721616921 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d6cc74ae50 con 0x55d6cc83bc20 2023-07-21T23:06:33.245 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.211+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d6cc83bc20 0x55d6cc83e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.212+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d6cc83bc20 0x55d6cc83e030 crc :-1 s=READY pgs=521 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da7dcfea09c6483f server_cookie=1b6549f4c02165e in_seq=0 out_seq=0 2023-07-21T23:06:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.212+0000 7f4c717fa700 10 client.29575 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.213+0000 7f4c717fa700 1 -- 172.21.15.151:0/3721616921 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d6cc74ae50 con 0x55d6cc83bc20 2023-07-21T23:06:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.213+0000 7f4c717fa700 10 client.29575 handle_command_reply: tid=0 2023-07-21T23:06:33.246 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.213+0000 7f4ca3a46b80 1 client.29575 shutdown 2023-07-21T23:06:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.215+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/3721616921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806210 msgr2=0x55d6cc8098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:33.247 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.215+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806210 0x55d6cc8098c0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4c78009990 tx=0x7f4c78005f00 comp rx=0 tx=0).stop 2023-07-21T23:06:33.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.215+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/3721616921 shutdown_connections 2023-07-21T23:06:33.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.215+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d6cc83bc20 0x55d6cc83e030 crc :-1 s=READY pgs=521 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.215+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 0x55d6cc80c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.215+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc806660 0x55d6cc80a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.248 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.215+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/3721616921 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806210 0x55d6cc8098c0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.215+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/3721616921 >> 172.21.15.151:0/3721616921 conn(0x55d6cc7f5ae0 msgr2=0x55d6cc7fa3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:33.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.215+0000 7f4c717fa700 0 client.29575 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:33.249 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.216+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/3721616921 shutdown_connections 2023-07-21T23:06:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.216+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/3721616921 wait complete. 2023-07-21T23:06:33.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.217+0000 7f4ca3a46b80 20 client.29575 trim_cache size 0 max 16384 2023-07-21T23:06:33.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.244+0000 7f4ca3a46b80 1 Processor -- start 2023-07-21T23:06:33.276 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.244+0000 7f4ca3a46b80 1 -- start start 2023-07-21T23:06:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.244+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc65c6b0 0x55d6cc80c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.244+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc806660 0x55d6cc7fff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.244+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc80c6b0 0x55d6cc800480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.244+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc805900 con 0x55d6cc806660 2023-07-21T23:06:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.244+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc8045e0 con 0x55d6cc80c6b0 2023-07-21T23:06:33.277 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.244+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc80a600 con 0x55d6cc65c6b0 2023-07-21T23:06:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.245+0000 7f4c8e79c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc80c6b0 0x55d6cc800480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.245+0000 7f4c8e79c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc80c6b0 0x55d6cc800480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:37968/0 (socket says 172.21.15.151:37968) 2023-07-21T23:06:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.245+0000 7f4c8e79c700 1 -- 172.21.15.151:0/2887533773 learned_addr learned my addr 172.21.15.151:0/2887533773 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:33.278 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.245+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/2887533773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc65c6b0 0x55d6cc80c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.246+0000 7f4c8e79c700 1 -- 172.21.15.151:0/2887533773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc65c6b0 msgr2=0x55d6cc80c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.246+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/2887533773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc65c6b0 0x55d6cc80c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.246+0000 7f4c8e79c700 1 -- 172.21.15.151:0/2887533773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc806660 msgr2=0x55d6cc7fff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.246+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/2887533773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc806660 0x55d6cc7fff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.279 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.246+0000 7f4c8e79c700 1 -- 172.21.15.151:0/2887533773 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d6cc5a61f0 con 0x55d6cc80c6b0 2023-07-21T23:06:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.246+0000 7f4c8e79c700 1 --2- 172.21.15.151:0/2887533773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc80c6b0 0x55d6cc800480 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4c80007450 tx=0x7f4c80007480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=86e2cbde0be3de13 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.247+0000 7f4c7cff9700 1 -- 172.21.15.151:0/2887533773 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000aea0 con 0x55d6cc80c6b0 2023-07-21T23:06:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.247+0000 7f4c7cff9700 1 -- 172.21.15.151:0/2887533773 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c80018b90 con 0x55d6cc80c6b0 2023-07-21T23:06:33.280 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.247+0000 7f4c7cff9700 1 -- 172.21.15.151:0/2887533773 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8002b990 con 0x55d6cc80c6b0 2023-07-21T23:06:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.248+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2887533773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc80c6b0 msgr2=0x55d6cc800480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.248+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/2887533773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc80c6b0 0x55d6cc800480 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4c80007450 tx=0x7f4c80007480 comp rx=0 tx=0).stop 2023-07-21T23:06:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.248+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2887533773 shutdown_connections 2023-07-21T23:06:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.248+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/2887533773 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc80c6b0 0x55d6cc800480 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.281 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.248+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/2887533773 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc65c6b0 0x55d6cc80c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.248+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/2887533773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc806660 0x55d6cc7fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.248+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2887533773 >> 172.21.15.151:0/2887533773 conn(0x55d6cc7f5ae0 msgr2=0x55d6cc842990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.248+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2887533773 shutdown_connections 2023-07-21T23:06:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.248+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/2887533773 wait complete. 2023-07-21T23:06:33.282 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.249+0000 7f4ca3a46b80 1 -- start start 2023-07-21T23:06:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.249+0000 7f4ca3a46b80 1 Processor -- start 2023-07-21T23:06:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.250+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 0x55d6cc8109f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.250+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806660 0x55d6cc80ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.250+0000 7f4ca3a46b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc80c6b0 0x55d6cc80f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.250+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc80f7a0 con 0x55d6cc80c6b0 2023-07-21T23:06:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.250+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc80f910 con 0x55d6cc65c6b0 2023-07-21T23:06:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.250+0000 7f4ca3a46b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d6cc80fad0 con 0x55d6cc806660 2023-07-21T23:06:33.284 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.250+0000 7f4ca3a46b80 10 client.0 _ll_register_callbacks cb 0x7f4c780053c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8e79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc80c6b0 0x55d6cc80f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8df9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 0x55d6cc8109f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.285 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8e79c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc80c6b0 0x55d6cc80f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:46148/0 (socket says 172.21.15.151:46148) 2023-07-21T23:06:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8e79c700 1 -- 172.21.15.151:0/395221153 learned_addr learned my addr 172.21.15.151:0/395221153 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8d79a700 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806660 0x55d6cc80ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8df9b700 1 -- 172.21.15.151:0/395221153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806660 msgr2=0x55d6cc80ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806660 0x55d6cc80ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8df9b700 1 -- 172.21.15.151:0/395221153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc80c6b0 msgr2=0x55d6cc80f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc80c6b0 0x55d6cc80f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.251+0000 7f4c8df9b700 1 -- 172.21.15.151:0/395221153 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c80026070 con 0x55d6cc65c6b0 2023-07-21T23:06:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.252+0000 7f4c8df9b700 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 0x55d6cc8109f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4c840ca3f0 tx=0x7f4c840cef90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4662efc5794cae63 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.252+0000 7f4c717fa700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:06:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.252+0000 7f4c717fa700 1 -- 172.21.15.151:0/395221153 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8400ccc0 con 0x55d6cc65c6b0 2023-07-21T23:06:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.252+0000 7f4c717fa700 1 -- 172.21.15.151:0/395221153 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f4c84099d70 con 0x55d6cc65c6b0 2023-07-21T23:06:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.252+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/395221153 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4c8000f040 con 0x55d6cc65c6b0 2023-07-21T23:06:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.252+0000 7f4c717fa700 1 -- 172.21.15.151:0/395221153 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4c8409dda0 con 0x55d6cc65c6b0 2023-07-21T23:06:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.252+0000 7f4ca3a46b80 10 client.29534 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:33.287 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.252+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/395221153 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55d6cc57e250 con 0x55d6cc65c6b0 2023-07-21T23:06:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.253+0000 7f4c717fa700 1 -- 172.21.15.151:0/395221153 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f4c840b8020 con 0x55d6cc65c6b0 2023-07-21T23:06:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.253+0000 7f4c717fa700 1 -- 172.21.15.151:0/395221153 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f4c84099260 con 0x55d6cc65c6b0 2023-07-21T23:06:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.253+0000 7f4ca3a46b80 10 client.29534 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.253+0000 7f4ca3a46b80 10 client.29534 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.253+0000 7f4ca3a46b80 20 client.29534 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.253+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d6cc890f00 0x55d6cc893310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:33.288 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.253+0000 7f4ca3a46b80 4 client.29534 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:06:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.253+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/395221153 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d6cc70cff0 con 0x55d6cc890f00 2023-07-21T23:06:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.254+0000 7f4c8d79a700 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d6cc890f00 0x55d6cc893310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.254+0000 7f4c8d79a700 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d6cc890f00 0x55d6cc893310 crc :-1 s=READY pgs=522 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c51ac86fae552b9 server_cookie=83b899a389fd666b in_seq=0 out_seq=0 2023-07-21T23:06:33.289 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.254+0000 7f4c717fa700 10 client.29534 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:33.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.289+0000 7f4c717fa700 1 -- 172.21.15.151:0/395221153 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d6cc70cff0 con 0x55d6cc890f00 2023-07-21T23:06:33.322 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.289+0000 7f4c717fa700 10 client.29534 handle_command_reply: tid=0 2023-07-21T23:06:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.289+0000 7f4ca3a46b80 1 client.29534 shutdown 2023-07-21T23:06:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/395221153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 msgr2=0x55d6cc8109f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 0x55d6cc8109f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f4c840ca3f0 tx=0x7f4c840cef90 comp rx=0 tx=0).stop 2023-07-21T23:06:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/395221153 shutdown_connections 2023-07-21T23:06:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d6cc890f00 0x55d6cc893310 crc :-1 s=READY pgs=522 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d6cc65c6b0 0x55d6cc8109f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.323 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d6cc80c6b0 0x55d6cc80f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 --2- 172.21.15.151:0/395221153 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d6cc806660 0x55d6cc80ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/395221153 >> 172.21.15.151:0/395221153 conn(0x55d6cc7f5ae0 msgr2=0x55d6cc803a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4c717fa700 0 client.29534 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/395221153 shutdown_connections 2023-07-21T23:06:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.290+0000 7f4ca3a46b80 1 -- 172.21.15.151:0/395221153 wait complete. 2023-07-21T23:06:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.291+0000 7f4ca3a46b80 20 client.29534 trim_cache size 0 max 16384 2023-07-21T23:06:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:06:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:06:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:06:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:06:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.291+0000 7f4c901ff700 1 -- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4c740a1410 msgr2=0x7f4c740a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.291+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4c740a1410 0x7f4c740a38c0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f4c80021000 tx=0x7f4c8001e000 comp rx=0 tx=0).stop 2023-07-21T23:06:33.326 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.291+0000 7f4c901ff700 1 -- 172.21.15.151:0/1717620874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c880ffb30 msgr2=0x7f4c88106910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.291+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c880ffb30 0x7f4c88106910 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f4c8400e9a0 tx=0x7f4c8400ecb0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.292+0000 7f4c901ff700 1 -- 172.21.15.151:0/1717620874 shutdown_connections 2023-07-21T23:06:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.292+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f4c740a1410 0x7f4c740a38c0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.292+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c880ffb30 0x7f4c88106910 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.292+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f4c88105b60 0x7f4c881a8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.292+0000 7f4c901ff700 1 --2- 172.21.15.151:0/1717620874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4c881004e0 0x7f4c88106e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.292+0000 7f4c901ff700 1 -- 172.21.15.151:0/1717620874 >> 172.21.15.151:0/1717620874 conn(0x7f4c880fb5f0 msgr2=0x7f4c8810ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.292+0000 7f4c901ff700 1 -- 172.21.15.151:0/1717620874 shutdown_connections 2023-07-21T23:06:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:33.292+0000 7f4c901ff700 1 -- 172.21.15.151:0/1717620874 wait complete. 2023-07-21T23:06:33.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:33 smithi195 ceph-mon[97365]: pgmap v1507: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.5 MiB/s wr, 997 op/s 2023-07-21T23:06:33.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:33 smithi151 ceph-mon[95510]: pgmap v1507: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.5 MiB/s wr, 997 op/s 2023-07-21T23:06:33.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:33 smithi187 ceph-mon[96918]: pgmap v1507: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 8.5 MiB/s wr, 997 op/s 2023-07-21T23:06:34.290 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 820.0 s, 352.8 tps, lat 283.182 ms stddev 59.017 2023-07-21T23:06:35.395 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:35 smithi195 ceph-mon[97365]: pgmap v1508: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-21T23:06:35.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:35 smithi151 ceph-mon[95510]: pgmap v1508: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-21T23:06:35.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:35 smithi187 ceph-mon[96918]: pgmap v1508: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-21T23:06:37.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:37 smithi151 ceph-mon[95510]: pgmap v1509: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.2 MiB/s wr, 1.00k op/s 2023-07-21T23:06:37.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:37 smithi187 ceph-mon[96918]: pgmap v1509: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.2 MiB/s wr, 1.00k op/s 2023-07-21T23:06:37.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:37 smithi195 ceph-mon[97365]: pgmap v1509: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.2 MiB/s wr, 1.00k op/s 2023-07-21T23:06:38.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:38 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:06:38.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:38 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:06:38.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:38 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:06:39.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 825.0 s, 358.7 tps, lat 279.603 ms stddev 72.667 2023-07-21T23:06:39.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:39 smithi151 ceph-mon[95510]: pgmap v1510: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.9 MiB/s wr, 1.08k op/s 2023-07-21T23:06:39.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:39 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:06:39.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:39 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:06:39.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:39 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:06:39.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:39 smithi187 ceph-mon[96918]: pgmap v1510: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.9 MiB/s wr, 1.08k op/s 2023-07-21T23:06:39.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:39 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:06:39.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:39 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:06:39.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:39 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:06:39.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:39 smithi195 ceph-mon[97365]: pgmap v1510: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.9 MiB/s wr, 1.08k op/s 2023-07-21T23:06:39.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:39 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:06:39.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:39 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:06:39.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:39 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:06:41.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:41 smithi151 ceph-mon[95510]: pgmap v1511: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.37k op/s 2023-07-21T23:06:41.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:41 smithi187 ceph-mon[96918]: pgmap v1511: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.37k op/s 2023-07-21T23:06:41.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:41 smithi195 ceph-mon[97365]: pgmap v1511: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 MiB/s rd, 13 MiB/s wr, 1.37k op/s 2023-07-21T23:06:43.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:43 smithi187 ceph-mon[96918]: pgmap v1512: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 1.03k op/s 2023-07-21T23:06:43.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:43 smithi195 ceph-mon[97365]: pgmap v1512: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 1.03k op/s 2023-07-21T23:06:43.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:43 smithi151 ceph-mon[95510]: pgmap v1512: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.3 MiB/s wr, 1.03k op/s 2023-07-21T23:06:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 830.0 s, 309.9 tps, lat 322.806 ms stddev 128.162 2023-07-21T23:06:45.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:45 smithi187 ceph-mon[96918]: pgmap v1513: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.42k op/s 2023-07-21T23:06:45.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:45 smithi195 ceph-mon[97365]: pgmap v1513: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.42k op/s 2023-07-21T23:06:45.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:45 smithi151 ceph-mon[95510]: pgmap v1513: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 MiB/s rd, 13 MiB/s wr, 1.42k op/s 2023-07-21T23:06:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.528+0000 7fa0e37ff700 1 -- 172.21.15.151:0/1229483573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0dc101f80 msgr2=0x7fa0dc102350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:46.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.528+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/1229483573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0dc101f80 0x7fa0dc102350 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80099c0 tx=0x7fa0d8009cd0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.529+0000 7fa0e37ff700 1 -- 172.21.15.151:0/1229483573 shutdown_connections 2023-07-21T23:06:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.529+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/1229483573 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc106fc0 0x7fa0dc10eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.529+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/1229483573 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0dc101f80 0x7fa0dc102350 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.529+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/1229483573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0dc102920 0x7fa0dc1068e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.529+0000 7fa0e37ff700 1 -- 172.21.15.151:0/1229483573 >> 172.21.15.151:0/1229483573 conn(0x7fa0dc0fd7d0 msgr2=0x7fa0dc0ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:46.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.529+0000 7fa0e37ff700 1 -- 172.21.15.151:0/1229483573 shutdown_connections 2023-07-21T23:06:46.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.529+0000 7fa0e37ff700 1 -- 172.21.15.151:0/1229483573 wait complete. 2023-07-21T23:06:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.531+0000 7fa0e37ff700 1 Processor -- start 2023-07-21T23:06:46.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.531+0000 7fa0e37ff700 1 -- start start 2023-07-21T23:06:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.531+0000 7fa0e37ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc101f80 0x7fa0dc197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e37ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0dc102920 0x7fa0dc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e37ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0dc106fc0 0x7fa0dc19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e37ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc19cff0 con 0x7fa0dc101f80 2023-07-21T23:06:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e37ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc19d160 con 0x7fa0dc102920 2023-07-21T23:06:46.566 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e37ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0dc19d320 con 0x7fa0dc106fc0 2023-07-21T23:06:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e0d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0dc102920 0x7fa0dc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.568 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e0d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0dc102920 0x7fa0dc198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36092/0 (socket says 172.21.15.151:36092) 2023-07-21T23:06:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e0d9a700 1 -- 172.21.15.151:0/3815077124 learned_addr learned my addr 172.21.15.151:0/3815077124 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e159b700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc101f80 0x7fa0dc197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.569 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0dc106fc0 0x7fa0dc19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e0d9a700 1 -- 172.21.15.151:0/3815077124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0dc106fc0 msgr2=0x7fa0dc19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.532+0000 7fa0e0d9a700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0dc106fc0 0x7fa0dc19c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.533+0000 7fa0e0d9a700 1 -- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc101f80 msgr2=0x7fa0dc197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.533+0000 7fa0e0d9a700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc101f80 0x7fa0dc197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.570 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.533+0000 7fa0e0d9a700 1 -- 172.21.15.151:0/3815077124 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d80095f0 con 0x7fa0dc102920 2023-07-21T23:06:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.533+0000 7fa0e0d9a700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0dc102920 0x7fa0dc198340 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00d950 tx=0x7fa0cc00dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.533+0000 7fa0d27fc700 1 -- 172.21.15.151:0/3815077124 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc009930 con 0x7fa0dc102920 2023-07-21T23:06:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.533+0000 7fa0d27fc700 1 -- 172.21.15.151:0/3815077124 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0cc010460 con 0x7fa0dc102920 2023-07-21T23:06:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.533+0000 7fa0e37ff700 1 -- 172.21.15.151:0/3815077124 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0dc19d600 con 0x7fa0dc102920 2023-07-21T23:06:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.533+0000 7fa0d27fc700 1 -- 172.21.15.151:0/3815077124 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc00f620 con 0x7fa0dc102920 2023-07-21T23:06:46.571 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.533+0000 7fa0e37ff700 1 -- 172.21.15.151:0/3815077124 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc1a4e40 con 0x7fa0dc102920 2023-07-21T23:06:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.538+0000 7fa0d27fc700 1 -- 172.21.15.151:0/3815077124 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fa0cc009a90 con 0x7fa0dc102920 2023-07-21T23:06:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.539+0000 7fa0d27fc700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0c80a1340 0x7fa0c80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.572 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.540+0000 7fa0d27fc700 1 -- 172.21.15.151:0/3815077124 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa0cc0cc870 con 0x7fa0dc102920 2023-07-21T23:06:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.540+0000 7fa0e159b700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0c80a1340 0x7fa0c80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.540+0000 7fa0f70aab80 1 Processor -- start 2023-07-21T23:06:46.573 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.541+0000 7fa0f70aab80 1 -- start start 2023-07-21T23:06:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.541+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac620284e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.541+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 0x55ac62022750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.541+0000 7fa0e159b700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0c80a1340 0x7fa0c80a37f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8000c00 tx=0x7fa0d8009f10 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.541+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac62022cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.541+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac61f1fc50 con 0x55ac61e766b0 2023-07-21T23:06:46.574 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.541+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac61f729e0 con 0x55ac62028e70 2023-07-21T23:06:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.541+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac61f6be70 con 0x55ac62028a20 2023-07-21T23:06:46.575 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac620284e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac620284e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:42318/0 (socket says 172.21.15.151:42318) 2023-07-21T23:06:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e159b700 1 -- 172.21.15.151:0/1254488008 learned_addr learned my addr 172.21.15.151:0/1254488008 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e0d9a700 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 0x55ac62022750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac62022cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/1254488008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 msgr2=0x55ac62022750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:46.576 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 0x55ac62022750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/1254488008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 msgr2=0x55ac620284e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac620284e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.542+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/1254488008 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac61d99d80 con 0x55ac62028e70 2023-07-21T23:06:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.543+0000 7fa0e0d9a700 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 0x55ac62022750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:06:46.577 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.543+0000 7fa0e159b700 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac620284e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:06:46.578 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.543+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac62022cb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009e60 tx=0x7fa0d4009e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=917c9de952d682c6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.543+0000 7fa0c77fe700 1 -- 172.21.15.151:0/1254488008 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4011070 con 0x55ac62028e70 2023-07-21T23:06:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.543+0000 7fa0c77fe700 1 -- 172.21.15.151:0/1254488008 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0d4009990 con 0x55ac62028e70 2023-07-21T23:06:46.580 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.543+0000 7fa0c77fe700 1 -- 172.21.15.151:0/1254488008 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4015c30 con 0x55ac62028e70 2023-07-21T23:06:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.544+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1254488008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 msgr2=0x55ac62022cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.544+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac62022cb0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009e60 tx=0x7fa0d4009e90 comp rx=0 tx=0).stop 2023-07-21T23:06:46.581 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.545+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1254488008 shutdown_connections 2023-07-21T23:06:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.545+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac62022cb0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.545+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac620284e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.582 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.545+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1254488008 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 0x55ac62022750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.545+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1254488008 >> 172.21.15.151:0/1254488008 conn(0x55ac6200fae0 msgr2=0x55ac620150e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.545+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1254488008 shutdown_connections 2023-07-21T23:06:46.583 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.545+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1254488008 wait complete. 2023-07-21T23:06:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.546+0000 7fa0f70aab80 1 -- start start 2023-07-21T23:06:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.546+0000 7fa0f70aab80 1 Processor -- start 2023-07-21T23:06:46.584 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac6202c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 0x55ac6202c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac6202cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.585 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac61f0ba60 con 0x55ac61e766b0 2023-07-21T23:06:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac61f0b760 con 0x55ac62028e70 2023-07-21T23:06:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac61def8c0 con 0x55ac62028a20 2023-07-21T23:06:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0f70aab80 10 client.0 _ll_register_callbacks cb 0x55ac61f09700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:46.586 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0e1d9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac6202cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0e0d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 0x55ac6202c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0e1d9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac6202cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36118/0 (socket says 172.21.15.151:36118) 2023-07-21T23:06:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/2068960437 learned_addr learned my addr 172.21.15.151:0/2068960437 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:46.587 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.547+0000 7fa0e159b700 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac6202c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.589 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.548+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/2068960437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 msgr2=0x55ac6202c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.548+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 0x55ac6202c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.548+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/2068960437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 msgr2=0x55ac6202c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.548+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac6202c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.590 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.548+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/2068960437 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc10f3d0 con 0x55ac62028e70 2023-07-21T23:06:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.548+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac6202cbf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009fa0 tx=0x7fa0d400c390 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7404030796ebc64 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.548+0000 7fa0c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:06:46.591 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.549+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/2068960437 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4011040 con 0x55ac62028e70 2023-07-21T23:06:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.549+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/2068960437 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa0d4006e40 con 0x55ac62028e70 2023-07-21T23:06:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.549+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2068960437 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac61f64e50 con 0x55ac62028e70 2023-07-21T23:06:46.592 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.549+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/2068960437 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0d4009990 con 0x55ac62028e70 2023-07-21T23:06:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.549+0000 7fa0f70aab80 10 client.29546 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.549+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2068960437 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x7fa0dc1a4e40 con 0x55ac62028e70 2023-07-21T23:06:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.549+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/2068960437 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ac61f64e50 con 0x55ac62028e70 2023-07-21T23:06:46.593 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.549+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/2068960437 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa0d401c030 con 0x55ac62028e70 2023-07-21T23:06:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.550+0000 7fa0f70aab80 10 client.29546 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.550+0000 7fa0f70aab80 10 client.29546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:46.594 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.550+0000 7fa0f70aab80 20 client.29546 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.550+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac6203c210 0x55ac6203e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.550+0000 7fa0f70aab80 4 client.29546 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:06:46.595 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.550+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2068960437 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ac61f26ff0 con 0x55ac6203c210 2023-07-21T23:06:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.550+0000 7fa0e159b700 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac6203c210 0x55ac6203e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.551+0000 7fa0e159b700 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac6203c210 0x55ac6203e620 crc :-1 s=READY pgs=523 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e2dc39b04553930 server_cookie=89ee997cf7856c9 in_seq=0 out_seq=0 2023-07-21T23:06:46.596 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.551+0000 7fa0c4ff9700 10 client.29546 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.552+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/2068960437 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55ac61f26ff0 con 0x55ac6203c210 2023-07-21T23:06:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.552+0000 7fa0c4ff9700 10 client.29546 handle_command_reply: tid=0 2023-07-21T23:06:46.597 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.552+0000 7fa0f70aab80 1 client.29546 shutdown 2023-07-21T23:06:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.552+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2068960437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 msgr2=0x55ac6202cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.552+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac6202cbf0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4009fa0 tx=0x7fa0d400c390 comp rx=0 tx=0).stop 2023-07-21T23:06:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.552+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2068960437 shutdown_connections 2023-07-21T23:06:46.598 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.552+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac6203c210 0x55ac6203e620 crc :-1 s=READY pgs=523 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.553+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028e70 0x55ac6202cbf0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.553+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac6202c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.553+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2068960437 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028a20 0x55ac6202c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.599 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.553+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2068960437 >> 172.21.15.151:0/2068960437 conn(0x55ac6200fae0 msgr2=0x55ac620143e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.553+0000 7fa0c4ff9700 0 client.29546 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.553+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2068960437 shutdown_connections 2023-07-21T23:06:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.553+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2068960437 wait complete. 2023-07-21T23:06:46.600 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.553+0000 7fa0f70aab80 20 client.29546 trim_cache size 0 max 16384 2023-07-21T23:06:46.619 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.585+0000 7fa0f70aab80 1 Processor -- start 2023-07-21T23:06:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.586+0000 7fa0f70aab80 1 -- start start 2023-07-21T23:06:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.586+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac61e766b0 0x55ac62033450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.586+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62028a20 0x55ac620278d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.586+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 0x55ac62022750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.620 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.586+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62028180 con 0x55ac62028a20 2023-07-21T23:06:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.586+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62023730 con 0x55ac61e766b0 2023-07-21T23:06:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.586+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac62026b70 con 0x55ac62028e70 2023-07-21T23:06:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.587+0000 7fa0e159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac61e766b0 0x55ac62033450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.621 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.587+0000 7fa0e159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac61e766b0 0x55ac62033450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36124/0 (socket says 172.21.15.151:36124) 2023-07-21T23:06:46.622 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.587+0000 7fa0e159b700 1 -- 172.21.15.151:0/2259385858 learned_addr learned my addr 172.21.15.151:0/2259385858 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.588+0000 7fa0e0d9a700 1 --2- 172.21.15.151:0/2259385858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62028a20 0x55ac620278d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.588+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/2259385858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 0x55ac62022750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.588+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/2259385858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac61e766b0 msgr2=0x55ac62033450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.588+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/2259385858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac61e766b0 0x55ac62033450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.588+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/2259385858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62028a20 msgr2=0x55ac620278d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.588+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/2259385858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62028a20 0x55ac620278d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.623 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.588+0000 7fa0e1d9c700 1 -- 172.21.15.151:0/2259385858 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ac62043270 con 0x55ac62028e70 2023-07-21T23:06:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.589+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/2259385858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 0x55ac62022750 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400a4c0 tx=0x7fa0d4009410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27c1726a7b783e5d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.590+0000 7fa0c7fff700 1 -- 172.21.15.151:0/2259385858 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4011040 con 0x55ac62028e70 2023-07-21T23:06:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.590+0000 7fa0c7fff700 1 -- 172.21.15.151:0/2259385858 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fa0d400ac70 con 0x55ac62028e70 2023-07-21T23:06:46.624 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.590+0000 7fa0c7fff700 1 -- 172.21.15.151:0/2259385858 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d4020480 con 0x55ac62028e70 2023-07-21T23:06:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.591+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2259385858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 msgr2=0x55ac62022750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.591+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2259385858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 0x55ac62022750 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa0d400a4c0 tx=0x7fa0d4009410 comp rx=0 tx=0).stop 2023-07-21T23:06:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.591+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2259385858 shutdown_connections 2023-07-21T23:06:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.591+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2259385858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac61e766b0 0x55ac62033450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.591+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2259385858 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 0x55ac62022750 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.591+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/2259385858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac62028a20 0x55ac620278d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.626 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.591+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2259385858 >> 172.21.15.151:0/2259385858 conn(0x55ac6200fae0 msgr2=0x55ac620271c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.591+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2259385858 shutdown_connections 2023-07-21T23:06:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.591+0000 7fa0f70aab80 1 -- 172.21.15.151:0/2259385858 wait complete. 2023-07-21T23:06:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.592+0000 7fa0f70aab80 1 -- start start 2023-07-21T23:06:46.627 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.592+0000 7fa0f70aab80 1 Processor -- start 2023-07-21T23:06:46.631 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.593+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac62084080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.593+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028a20 0x55ac620845c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.593+0000 7fa0f70aab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 0x55ac62084b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.593+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6208f230 con 0x55ac61e766b0 2023-07-21T23:06:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.593+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6208f370 con 0x55ac62028a20 2023-07-21T23:06:46.632 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.593+0000 7fa0f70aab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ac6208f530 con 0x55ac62028e70 2023-07-21T23:06:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.593+0000 7fa0f70aab80 10 client.0 _ll_register_callbacks cb 0x7fa0cc010ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.594+0000 7fa0e0d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028a20 0x55ac620845c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.594+0000 7fa0e0d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028a20 0x55ac620845c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:36126/0 (socket says 172.21.15.151:36126) 2023-07-21T23:06:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.594+0000 7fa0e0d9a700 1 -- 172.21.15.151:0/1376404678 learned_addr learned my addr 172.21.15.151:0/1376404678 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.594+0000 7fa0e1d9c700 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 0x55ac62084b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.594+0000 7fa0e159b700 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac62084080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.633 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.595+0000 7fa0e159b700 1 -- 172.21.15.151:0/1376404678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 msgr2=0x55ac62084b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.595+0000 7fa0e159b700 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 0x55ac62084b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.595+0000 7fa0e159b700 1 -- 172.21.15.151:0/1376404678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028a20 msgr2=0x55ac620845c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.595+0000 7fa0e159b700 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028a20 0x55ac620845c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.595+0000 7fa0e159b700 1 -- 172.21.15.151:0/1376404678 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0dc1a4e40 con 0x55ac61e766b0 2023-07-21T23:06:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.595+0000 7fa0e159b700 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac62084080 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x55ac61f27130 tx=0x7fa0d8009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c996522531800cf6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.596+0000 7fa0c4ff9700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:06:46.634 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.597+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/1376404678 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d800be00 con 0x55ac61e766b0 2023-07-21T23:06:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.597+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/1376404678 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fa0d80350e0 con 0x55ac61e766b0 2023-07-21T23:06:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.597+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1376404678 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ac61ec5490 con 0x55ac61e766b0 2023-07-21T23:06:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.597+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/1376404678 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa0d80352a0 con 0x55ac61e766b0 2023-07-21T23:06:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.598+0000 7fa0f70aab80 10 client.19917 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.598+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1376404678 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x7fa0d4009b10 con 0x55ac61e766b0 2023-07-21T23:06:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.598+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/1376404678 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55ac61ec5490 con 0x55ac61e766b0 2023-07-21T23:06:46.635 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.598+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/1376404678 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fa0d800f460 con 0x55ac61e766b0 2023-07-21T23:06:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.598+0000 7fa0f70aab80 10 client.19917 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.598+0000 7fa0f70aab80 10 client.19917 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.598+0000 7fa0f70aab80 20 client.19917 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.598+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62090bf0 0x55ac62093000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.599+0000 7fa0f70aab80 4 client.19917 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:06:46.636 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.599+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1376404678 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55ac61dbaf10 con 0x55ac62090bf0 2023-07-21T23:06:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.600+0000 7fa0e0d9a700 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62090bf0 0x55ac62093000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.601+0000 7fa0c4ff9700 10 client.19917 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:46.637 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.601+0000 7fa0e0d9a700 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62090bf0 0x55ac62093000 crc :-1 s=READY pgs=524 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfa9e9dff9cea040 server_cookie=95d1afdb9b9c8d2b in_seq=0 out_seq=0 2023-07-21T23:06:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.657+0000 7fa0c4ff9700 1 -- 172.21.15.151:0/1376404678 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55ac61dbaf10 con 0x55ac62090bf0 2023-07-21T23:06:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.657+0000 7fa0c4ff9700 10 client.19917 handle_command_reply: tid=0 2023-07-21T23:06:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.657+0000 7fa0f70aab80 1 client.19917 shutdown 2023-07-21T23:06:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1376404678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 msgr2=0x55ac62084080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac62084080 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x55ac61f27130 tx=0x7fa0d8009cd0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1376404678 shutdown_connections 2023-07-21T23:06:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55ac62090bf0 0x55ac62093000 crc :-1 s=READY pgs=524 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.691 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55ac62028e70 0x55ac62084b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ac61e766b0 0x55ac62084080 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0f70aab80 1 --2- 172.21.15.151:0/1376404678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ac62028a20 0x55ac620845c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1376404678 >> 172.21.15.151:0/1376404678 conn(0x55ac6200fae0 msgr2=0x55ac62027a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0c4ff9700 0 client.19917 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.658+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1376404678 shutdown_connections 2023-07-21T23:06:46.692 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.659+0000 7fa0f70aab80 1 -- 172.21.15.151:0/1376404678 wait complete. 2023-07-21T23:06:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.659+0000 7fa0f70aab80 20 client.19917 trim_cache size 0 max 16384 2023-07-21T23:06:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:06:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:06:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:06:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:06:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 -- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0c80a1340 msgr2=0x7fa0c80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0c80a1340 0x7fa0c80a37f0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa0d8000c00 tx=0x7fa0d8009f10 comp rx=0 tx=0).stop 2023-07-21T23:06:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 -- 172.21.15.151:0/3815077124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0dc102920 msgr2=0x7fa0dc198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0dc102920 0x7fa0dc198340 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00d950 tx=0x7fa0cc00dc60 comp rx=0 tx=0).stop 2023-07-21T23:06:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 -- 172.21.15.151:0/3815077124 shutdown_connections 2023-07-21T23:06:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fa0c80a1340 0x7fa0c80a37f0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fa0dc106fc0 0x7fa0dc19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa0dc101f80 0x7fa0dc197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 --2- 172.21.15.151:0/3815077124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa0dc102920 0x7fa0dc198340 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.660+0000 7fa0e37ff700 1 -- 172.21.15.151:0/3815077124 >> 172.21.15.151:0/3815077124 conn(0x7fa0dc0fd7d0 msgr2=0x7fa0dc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:46.698 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.661+0000 7fa0e37ff700 1 -- 172.21.15.151:0/3815077124 shutdown_connections 2023-07-21T23:06:46.699 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:46.661+0000 7fa0e37ff700 1 -- 172.21.15.151:0/3815077124 wait complete. 2023-07-21T23:06:47.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:47 smithi187 ceph-mon[96918]: pgmap v1514: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.3 MiB/s wr, 1.01k op/s 2023-07-21T23:06:47.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:47 smithi195 ceph-mon[97365]: pgmap v1514: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.3 MiB/s wr, 1.01k op/s 2023-07-21T23:06:47.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:47 smithi151 ceph-mon[95510]: pgmap v1514: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 9.3 MiB/s wr, 1.01k op/s 2023-07-21T23:06:49.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 835.0 s, 429.2 tps, lat 232.135 ms stddev 57.496 2023-07-21T23:06:49.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:49 smithi187 ceph-mon[96918]: pgmap v1515: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 1.09k op/s 2023-07-21T23:06:49.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:49 smithi195 ceph-mon[97365]: pgmap v1515: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 1.09k op/s 2023-07-21T23:06:49.691 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:49 smithi151 ceph-mon[95510]: pgmap v1515: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 10 MiB/s wr, 1.09k op/s 2023-07-21T23:06:51.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:51 smithi187 ceph-mon[96918]: pgmap v1516: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-21T23:06:51.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:51 smithi195 ceph-mon[97365]: pgmap v1516: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-21T23:06:51.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:51 smithi151 ceph-mon[95510]: pgmap v1516: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-21T23:06:53.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:53 smithi187 ceph-mon[96918]: pgmap v1517: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:06:53.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:53 smithi195 ceph-mon[97365]: pgmap v1517: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:06:53.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:53 smithi151 ceph-mon[95510]: pgmap v1517: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.04k op/s 2023-07-21T23:06:54.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 840.0 s, 386.8 tps, lat 261.183 ms stddev 122.713 2023-07-21T23:06:55.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:55 smithi187 ceph-mon[96918]: pgmap v1518: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:06:55.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:55 smithi195 ceph-mon[97365]: pgmap v1518: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:06:55.689 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:55 smithi151 ceph-mon[95510]: pgmap v1518: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 MiB/s rd, 14 MiB/s wr, 1.45k op/s 2023-07-21T23:06:57.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:57 smithi187 ceph-mon[96918]: pgmap v1519: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-07-21T23:06:57.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:57 smithi195 ceph-mon[97365]: pgmap v1519: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-07-21T23:06:57.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:57 smithi151 ceph-mon[95510]: pgmap v1519: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 10 MiB/s wr, 1.05k op/s 2023-07-21T23:06:58.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:06:58 smithi187 ceph-mon[96918]: pgmap v1520: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.13k op/s 2023-07-21T23:06:58.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:06:58 smithi195 ceph-mon[97365]: pgmap v1520: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.13k op/s 2023-07-21T23:06:58.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:06:58 smithi151 ceph-mon[95510]: pgmap v1520: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 1.13k op/s 2023-07-21T23:06:59.286 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 845.0 s, 371.4 tps, lat 264.667 ms stddev 56.982 2023-07-21T23:06:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.865+0000 7fcf163ff700 1 -- 172.21.15.151:0/2369970463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf101024f0 msgr2=0x7fcf10102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:59.898 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.865+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2369970463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf101024f0 0x7fcf10102940 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009990 tx=0x7fcf08009ca0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.869+0000 7fcf163ff700 1 -- 172.21.15.151:0/2369970463 shutdown_connections 2023-07-21T23:06:59.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.869+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2369970463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf101024f0 0x7fcf10102940 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.902 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.869+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2369970463 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf10104a60 0x7fcf100679a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.869+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2369970463 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf10067ee0 0x7fcf10068350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.869+0000 7fcf163ff700 1 -- 172.21.15.151:0/2369970463 >> 172.21.15.151:0/2369970463 conn(0x7fcf10074760 msgr2=0x7fcf10074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:59.903 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.870+0000 7fcf163ff700 1 -- 172.21.15.151:0/2369970463 shutdown_connections 2023-07-21T23:06:59.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.870+0000 7fcf163ff700 1 -- 172.21.15.151:0/2369970463 wait complete. 2023-07-21T23:06:59.904 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.871+0000 7fcf163ff700 1 Processor -- start 2023-07-21T23:06:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.872+0000 7fcf163ff700 1 -- start start 2023-07-21T23:06:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.872+0000 7fcf163ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf10067ee0 0x7fcf10105190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.905 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.872+0000 7fcf163ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf101024f0 0x7fcf101056d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.872+0000 7fcf163ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf10104a60 0x7fcf1010a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.872+0000 7fcf163ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1010a680 con 0x7fcf101024f0 2023-07-21T23:06:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.872+0000 7fcf163ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1010a7f0 con 0x7fcf10104a60 2023-07-21T23:06:59.906 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.872+0000 7fcf163ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf1010a9b0 con 0x7fcf10067ee0 2023-07-21T23:06:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.874+0000 7fcf07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf101024f0 0x7fcf101056d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.874+0000 7fcf07fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf101024f0 0x7fcf101056d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43632/0 (socket says 172.21.15.151:43632) 2023-07-21T23:06:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.875+0000 7fcf07fff700 1 -- 172.21.15.151:0/2133046627 learned_addr learned my addr 172.21.15.151:0/2133046627 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.875+0000 7fcf1499c700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf10104a60 0x7fcf1010a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.907 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.875+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf10067ee0 0x7fcf10105190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.908 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.875+0000 7fcf07fff700 1 -- 172.21.15.151:0/2133046627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf10067ee0 msgr2=0x7fcf10105190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.875+0000 7fcf07fff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf10067ee0 0x7fcf10105190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.875+0000 7fcf07fff700 1 -- 172.21.15.151:0/2133046627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf10104a60 msgr2=0x7fcf1010a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.875+0000 7fcf07fff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf10104a60 0x7fcf1010a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.875+0000 7fcf07fff700 1 -- 172.21.15.151:0/2133046627 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf080095f0 con 0x7fcf101024f0 2023-07-21T23:06:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.875+0000 7fcf07fff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf101024f0 0x7fcf101056d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00e9a0 tx=0x7fcefc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.876+0000 7fcf1499c700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf10104a60 0x7fcf1010a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:06:59.909 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.876+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf10067ee0 0x7fcf10105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:06:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.876+0000 7fcf0dffb700 1 -- 172.21.15.151:0/2133046627 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc00cbd0 con 0x7fcf101024f0 2023-07-21T23:06:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.876+0000 7fcf0dffb700 1 -- 172.21.15.151:0/2133046627 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcefc00cd30 con 0x7fcf101024f0 2023-07-21T23:06:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.877+0000 7fcf0dffb700 1 -- 172.21.15.151:0/2133046627 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcefc018680 con 0x7fcf101024f0 2023-07-21T23:06:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.877+0000 7fcf163ff700 1 -- 172.21.15.151:0/2133046627 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf1010ac90 con 0x7fcf101024f0 2023-07-21T23:06:59.910 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.877+0000 7fcf163ff700 1 -- 172.21.15.151:0/2133046627 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf10111340 con 0x7fcf101024f0 2023-07-21T23:06:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.883+0000 7fcf0dffb700 1 -- 172.21.15.151:0/2133046627 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fcefc0187e0 con 0x7fcf101024f0 2023-07-21T23:06:59.916 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.884+0000 7fcf29d14b80 1 Processor -- start 2023-07-21T23:06:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.884+0000 7fcf29d14b80 1 -- start start 2023-07-21T23:06:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.885+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad52b6b0 0x562aad6d4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.917 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.885+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5210 0x562aad6cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.885+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad6d5660 0x562aad6cf4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.885+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad5d4c50 con 0x562aad6d5210 2023-07-21T23:06:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.885+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad6279e0 con 0x562aad6d5660 2023-07-21T23:06:59.918 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.885+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad620e70 con 0x562aad52b6b0 2023-07-21T23:06:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.886+0000 7fcf1499c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad52b6b0 0x562aad6d4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.886+0000 7fcf1499c700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad52b6b0 0x562aad6d4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:38190/0 (socket says 172.21.15.151:38190) 2023-07-21T23:06:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.886+0000 7fcf1499c700 1 -- 172.21.15.151:0/1773227665 learned_addr learned my addr 172.21.15.151:0/1773227665 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.886+0000 7fcf07fff700 1 --2- 172.21.15.151:0/1773227665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad6d5660 0x562aad6cf4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.919 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.887+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/1773227665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5210 0x562aad6cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.887+0000 7fcf1499c700 1 -- 172.21.15.151:0/1773227665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad6d5660 msgr2=0x562aad6cf4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.887+0000 7fcf1499c700 1 --2- 172.21.15.151:0/1773227665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad6d5660 0x562aad6cf4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.887+0000 7fcf1499c700 1 -- 172.21.15.151:0/1773227665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5210 msgr2=0x562aad6cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.887+0000 7fcf1499c700 1 --2- 172.21.15.151:0/1773227665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5210 0x562aad6cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.920 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.887+0000 7fcf1499c700 1 -- 172.21.15.151:0/1773227665 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aad44ed80 con 0x562aad52b6b0 2023-07-21T23:06:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.888+0000 7fcf0dffb700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcef40a14d0 0x7fcef40a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.888+0000 7fcf1499c700 1 --2- 172.21.15.151:0/1773227665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad52b6b0 0x562aad6d4cd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800b2e0 tx=0x7fcf08005c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9bee8ec0260430a3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:59.921 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.888+0000 7fcf0dffb700 1 -- 172.21.15.151:0/2133046627 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcefc014070 con 0x7fcf101024f0 2023-07-21T23:06:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.889+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcef40a14d0 0x7fcef40a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.889+0000 7fcf067fc700 1 -- 172.21.15.151:0/1773227665 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08005650 con 0x562aad52b6b0 2023-07-21T23:06:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.889+0000 7fcf067fc700 1 -- 172.21.15.151:0/1773227665 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf0801e040 con 0x562aad52b6b0 2023-07-21T23:06:59.922 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.889+0000 7fcf067fc700 1 -- 172.21.15.151:0/1773227665 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08004b40 con 0x562aad52b6b0 2023-07-21T23:06:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.890+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1773227665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad52b6b0 msgr2=0x562aad6d4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.890+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1773227665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad52b6b0 0x562aad6d4cd0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fcf0800b2e0 tx=0x7fcf08005c40 comp rx=0 tx=0).stop 2023-07-21T23:06:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.891+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcef40a14d0 0x7fcef40a3980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcf000094d0 tx=0x7fcf00009040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:59.923 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.891+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1773227665 shutdown_connections 2023-07-21T23:06:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.891+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1773227665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad6d5660 0x562aad6cf4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.891+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1773227665 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad52b6b0 0x562aad6d4cd0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.891+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1773227665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5210 0x562aad6cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.891+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1773227665 >> 172.21.15.151:0/1773227665 conn(0x562aad6c4ae0 msgr2=0x562aad6ca0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:59.924 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.891+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1773227665 shutdown_connections 2023-07-21T23:06:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.891+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1773227665 wait complete. 2023-07-21T23:06:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.892+0000 7fcf29d14b80 1 -- start start 2023-07-21T23:06:59.925 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.893+0000 7fcf29d14b80 1 Processor -- start 2023-07-21T23:06:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.893+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6de610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.893+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6deb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.894+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6d88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.926 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.894+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad5c0a60 con 0x562aad6d5660 2023-07-21T23:06:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.894+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad5c0760 con 0x562aad52b6b0 2023-07-21T23:06:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.894+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad4a48c0 con 0x562aad6d5210 2023-07-21T23:06:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.894+0000 7fcf29d14b80 10 client.0 _ll_register_callbacks cb 0x562aad5be700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.894+0000 7fcf1499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6d88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.894+0000 7fcf1499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6d88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43664/0 (socket says 172.21.15.151:43664) 2023-07-21T23:06:59.927 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.894+0000 7fcf1499c700 1 -- 172.21.15.151:0/1407698750 learned_addr learned my addr 172.21.15.151:0/1407698750 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.895+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6de610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.928 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.895+0000 7fcf07fff700 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6deb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.895+0000 7fcf1499c700 1 -- 172.21.15.151:0/1407698750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 msgr2=0x562aad6deb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.895+0000 7fcf1499c700 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6deb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.895+0000 7fcf1499c700 1 -- 172.21.15.151:0/1407698750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 msgr2=0x562aad6de610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.895+0000 7fcf1499c700 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6de610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.895+0000 7fcf1499c700 1 -- 172.21.15.151:0/1407698750 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf10113930 con 0x562aad6d5660 2023-07-21T23:06:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.896+0000 7fcf1499c700 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6d88a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fcf080098e0 tx=0x7fcf08004950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2aefa08908a5a9d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:59.929 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.896+0000 7fcef37fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:06:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.897+0000 7fcef37fe700 1 -- 172.21.15.151:0/1407698750 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800b710 con 0x562aad6d5660 2023-07-21T23:06:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.897+0000 7fcef37fe700 1 -- 172.21.15.151:0/1407698750 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcf0800b870 con 0x562aad6d5660 2023-07-21T23:06:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.897+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1407698750 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562aad57a490 con 0x562aad6d5660 2023-07-21T23:06:59.930 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.897+0000 7fcef37fe700 1 -- 172.21.15.151:0/1407698750 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf0800ba30 con 0x562aad6d5660 2023-07-21T23:06:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.897+0000 7fcf29d14b80 10 client.19929 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.897+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1407698750 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x562aad437c00 con 0x562aad6d5660 2023-07-21T23:06:59.931 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.898+0000 7fcef37fe700 1 -- 172.21.15.151:0/1407698750 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x562aad57a490 con 0x562aad6d5660 2023-07-21T23:06:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.898+0000 7fcef37fe700 1 -- 172.21.15.151:0/1407698750 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcf0800fd00 con 0x562aad6d5660 2023-07-21T23:06:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.899+0000 7fcf29d14b80 10 client.19929 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.899+0000 7fcf29d14b80 10 client.19929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.899+0000 7fcf29d14b80 20 client.19929 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.899+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aad6e85d0 0x562aad6ea9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.899+0000 7fcf29d14b80 4 client.19929 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:06:59.932 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.899+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1407698750 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562aad619e50 con 0x562aad6e85d0 2023-07-21T23:06:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.899+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aad6e85d0 0x562aad6ea9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.900+0000 7fcef37fe700 10 client.19929 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:59.933 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.900+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aad6e85d0 0x562aad6ea9b0 crc :-1 s=READY pgs=525 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=915df14797a1b5d2 server_cookie=6a852804edf9d5f4 in_seq=0 out_seq=0 2023-07-21T23:06:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.901+0000 7fcef37fe700 1 -- 172.21.15.151:0/1407698750 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x562aad619e50 con 0x562aad6e85d0 2023-07-21T23:06:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.901+0000 7fcef37fe700 10 client.19929 handle_command_reply: tid=0 2023-07-21T23:06:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.901+0000 7fcf29d14b80 1 client.19929 shutdown 2023-07-21T23:06:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.902+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1407698750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 msgr2=0x562aad6d88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:59.934 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.902+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6d88a0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7fcf080098e0 tx=0x7fcf08004950 comp rx=0 tx=0).stop 2023-07-21T23:06:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.902+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1407698750 shutdown_connections 2023-07-21T23:06:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.902+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aad6e85d0 0x562aad6ea9b0 crc :-1 s=READY pgs=525 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.902+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6de610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.902+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6d88a0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.902+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/1407698750 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6deb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.935 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.902+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1407698750 >> 172.21.15.151:0/1407698750 conn(0x562aad6c4ae0 msgr2=0x562aad6c93e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.903+0000 7fcef37fe700 0 client.19929 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:06:59.936 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.903+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1407698750 shutdown_connections 2023-07-21T23:06:59.937 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.905+0000 7fcf29d14b80 1 -- 172.21.15.151:0/1407698750 wait complete. 2023-07-21T23:06:59.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.908+0000 7fcf29d14b80 20 client.19929 trim_cache size 0 max 16384 2023-07-21T23:06:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.936+0000 7fcf29d14b80 1 Processor -- start 2023-07-21T23:06:59.969 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.937+0000 7fcf29d14b80 1 -- start start 2023-07-21T23:06:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.937+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6d4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.937+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6cef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.937+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.937+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad6c6c00 con 0x562aad6d5660 2023-07-21T23:06:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.937+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad6d4920 con 0x562aad52b6b0 2023-07-21T23:06:59.970 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.937+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad6c64f0 con 0x562aad6d5210 2023-07-21T23:06:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.938+0000 7fcf1499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.938+0000 7fcf1499c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:43680/0 (socket says 172.21.15.151:43680) 2023-07-21T23:06:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.938+0000 7fcf1499c700 1 -- 172.21.15.151:0/2128676661 learned_addr learned my addr 172.21.15.151:0/2128676661 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.938+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6d4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.971 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.938+0000 7fcf07fff700 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6cef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.939+0000 7fcf1499c700 1 -- 172.21.15.151:0/2128676661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 msgr2=0x562aad6cef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.939+0000 7fcf1499c700 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6cef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.939+0000 7fcf1499c700 1 -- 172.21.15.151:0/2128676661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 msgr2=0x562aad6d4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.939+0000 7fcf1499c700 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6d4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.972 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.939+0000 7fcf1499c700 1 -- 172.21.15.151:0/2128676661 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562aad6ef5b0 con 0x562aad6d5660 2023-07-21T23:06:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.939+0000 7fcf07fff700 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:06:59.973 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.940+0000 7fcf1499c700 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6c9b60 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009ce0 tx=0x7fcf08004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ccfc6a186b56492 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.941+0000 7fcf06ffd700 1 -- 172.21.15.151:0/2128676661 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf08005a00 con 0x562aad6d5660 2023-07-21T23:06:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.941+0000 7fcf06ffd700 1 -- 172.21.15.151:0/2128676661 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf0801b040 con 0x562aad6d5660 2023-07-21T23:06:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.941+0000 7fcf06ffd700 1 -- 172.21.15.151:0/2128676661 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0800e850 con 0x562aad6d5660 2023-07-21T23:06:59.974 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.942+0000 7fcf29d14b80 1 -- 172.21.15.151:0/2128676661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 msgr2=0x562aad6c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:06:59.975 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.942+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6c9b60 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fcf08009ce0 tx=0x7fcf08004500 comp rx=0 tx=0).stop 2023-07-21T23:06:59.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.944+0000 7fcf29d14b80 1 -- 172.21.15.151:0/2128676661 shutdown_connections 2023-07-21T23:06:59.978 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.944+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6d4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.944+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6c9b60 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.944+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/2128676661 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6cef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.979 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.944+0000 7fcf29d14b80 1 -- 172.21.15.151:0/2128676661 >> 172.21.15.151:0/2128676661 conn(0x562aad6c4ae0 msgr2=0x562aad6d8810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:06:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.945+0000 7fcf29d14b80 1 -- 172.21.15.151:0/2128676661 shutdown_connections 2023-07-21T23:06:59.980 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.946+0000 7fcf29d14b80 1 -- 172.21.15.151:0/2128676661 wait complete. 2023-07-21T23:06:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.946+0000 7fcf29d14b80 1 -- start start 2023-07-21T23:06:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.946+0000 7fcf29d14b80 1 Processor -- start 2023-07-21T23:06:59.981 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.947+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6dc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.947+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6dc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.947+0000 7fcf29d14b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6dccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.982 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.947+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad73b650 con 0x562aad6d5660 2023-07-21T23:06:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.947+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad73b7c0 con 0x562aad52b6b0 2023-07-21T23:06:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.947+0000 7fcf29d14b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x562aad73b980 con 0x562aad6d5210 2023-07-21T23:06:59.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.947+0000 7fcf29d14b80 10 client.0 _ll_register_callbacks cb 0x7fcf000097c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:06:59.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.948+0000 7fcf0ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6dc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.948+0000 7fcf0ffff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6dc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:41406/0 (socket says 172.21.15.151:41406) 2023-07-21T23:06:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.948+0000 7fcf0ffff700 1 -- 172.21.15.151:0/3662486141 learned_addr learned my addr 172.21.15.151:0/3662486141 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:06:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.948+0000 7fcf07fff700 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6dc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.949+0000 7fcf0ffff700 1 -- 172.21.15.151:0/3662486141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 msgr2=0x562aad6dc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.949+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6dc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.949+0000 7fcf0ffff700 1 -- 172.21.15.151:0/3662486141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 msgr2=0x562aad6dccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:06:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.949+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6dccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:06:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.949+0000 7fcf0ffff700 1 -- 172.21.15.151:0/3662486141 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x562aad437c00 con 0x562aad52b6b0 2023-07-21T23:06:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.949+0000 7fcf0ffff700 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6dc200 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x562aad6eb290 tx=0x7fcf0000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e63d6c517c32c25d server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:06:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.949+0000 7fcef37fe700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:06:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.949+0000 7fcef37fe700 1 -- 172.21.15.151:0/3662486141 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0001f040 con 0x562aad52b6b0 2023-07-21T23:06:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.950+0000 7fcf29d14b80 1 -- 172.21.15.151:0/3662486141 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fcf0801e040 con 0x562aad52b6b0 2023-07-21T23:06:59.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.950+0000 7fcef37fe700 1 -- 172.21.15.151:0/3662486141 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(171..171 src has 1..171) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fcf000290e0 con 0x562aad52b6b0 2023-07-21T23:06:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.950+0000 7fcef37fe700 1 -- 172.21.15.151:0/3662486141 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf000292e0 con 0x562aad52b6b0 2023-07-21T23:06:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.950+0000 7fcf29d14b80 10 client.29570 fetch_fsmap learned FSMap version 116 2023-07-21T23:06:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.950+0000 7fcf29d14b80 1 -- 172.21.15.151:0/3662486141 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x562aad4751f0 con 0x562aad52b6b0 2023-07-21T23:06:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.951+0000 7fcef37fe700 1 -- 172.21.15.151:0/3662486141 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fcf0801e040 con 0x562aad52b6b0 2023-07-21T23:06:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.951+0000 7fcef37fe700 1 -- 172.21.15.151:0/3662486141 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fcf00018c20 con 0x562aad52b6b0 2023-07-21T23:06:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.951+0000 7fcf29d14b80 10 client.29570 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:06:59.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.951+0000 7fcf29d14b80 10 client.29570 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:06:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.951+0000 7fcf29d14b80 20 client.29570 populate_metadata read hostname 'smithi151' 2023-07-21T23:06:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.951+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aad73d130 0x562aad73f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:06:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.951+0000 7fcf29d14b80 4 client.29570 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:06:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.951+0000 7fcf29d14b80 1 -- 172.21.15.151:0/3662486141 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x562aad5dbff0 con 0x562aad73d130 2023-07-21T23:06:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.952+0000 7fcf07fff700 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aad73d130 0x562aad73f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:06:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.954+0000 7fcf07fff700 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aad73d130 0x562aad73f540 crc :-1 s=READY pgs=526 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2351ec13217c9e05 server_cookie=ff9d3090d34e153f in_seq=0 out_seq=0 2023-07-21T23:06:59.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.954+0000 7fcef37fe700 10 client.29570 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:00.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.995+0000 7fcef37fe700 1 -- 172.21.15.151:0/3662486141 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x562aad5dbff0 con 0x562aad73d130 2023-07-21T23:07:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.995+0000 7fcef37fe700 10 client.29570 handle_command_reply: tid=0 2023-07-21T23:07:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.995+0000 7fcf29d14b80 1 client.29570 shutdown 2023-07-21T23:07:00.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.996+0000 7fcf29d14b80 1 -- 172.21.15.151:0/3662486141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 msgr2=0x562aad6dc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.996+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6dc200 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x562aad6eb290 tx=0x7fcf0000b040 comp rx=0 tx=0).stop 2023-07-21T23:07:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.996+0000 7fcf29d14b80 1 -- 172.21.15.151:0/3662486141 shutdown_connections 2023-07-21T23:07:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.996+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x562aad73d130 0x562aad73f540 crc :-1 s=READY pgs=526 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.996+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x562aad52b6b0 0x562aad6dc200 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:00.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.996+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562aad6d5660 0x562aad6dccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:00.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.996+0000 7fcf29d14b80 1 --2- 172.21.15.151:0/3662486141 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x562aad6d5210 0x562aad6dc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.996+0000 7fcf29d14b80 1 -- 172.21.15.151:0/3662486141 >> 172.21.15.151:0/3662486141 conn(0x562aad6c4ae0 msgr2=0x562aad6d70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:00.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.996+0000 7fcef37fe700 0 client.29570 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.997+0000 7fcf29d14b80 1 -- 172.21.15.151:0/3662486141 shutdown_connections 2023-07-21T23:07:00.032 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:06:59.997+0000 7fcf29d14b80 1 -- 172.21.15.151:0/3662486141 wait complete. 2023-07-21T23:07:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.000+0000 7fcf29d14b80 20 client.29570 trim_cache size 0 max 16384 2023-07-21T23:07:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:07:00.033 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:07:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:07:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:07:00.034 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 -- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcef40a14d0 msgr2=0x7fcef40a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcef40a14d0 0x7fcef40a3980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fcf000094d0 tx=0x7fcf00009040 comp rx=0 tx=0).stop 2023-07-21T23:07:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 -- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf101024f0 msgr2=0x7fcf101056d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf101024f0 0x7fcf101056d0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7fcefc00e9a0 tx=0x7fcefc00ed60 comp rx=0 tx=0).stop 2023-07-21T23:07:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 -- 172.21.15.151:0/2133046627 shutdown_connections 2023-07-21T23:07:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fcef40a14d0 0x7fcef40a3980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf10104a60 0x7fcf1010a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:00.035 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fcf10067ee0 0x7fcf10105190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 --2- 172.21.15.151:0/2133046627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf101024f0 0x7fcf101056d0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:00.036 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.002+0000 7fcf163ff700 1 -- 172.21.15.151:0/2133046627 >> 172.21.15.151:0/2133046627 conn(0x7fcf10074760 msgr2=0x7fcf101014d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.006+0000 7fcf163ff700 1 -- 172.21.15.151:0/2133046627 shutdown_connections 2023-07-21T23:07:00.039 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:00.007+0000 7fcf163ff700 1 -- 172.21.15.151:0/2133046627 wait complete. 2023-07-21T23:07:01.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:01 smithi151 ceph-mon[95510]: pgmap v1521: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 14 MiB/s wr, 1.43k op/s 2023-07-21T23:07:01.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:01 smithi187 ceph-mon[96918]: pgmap v1521: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 14 MiB/s wr, 1.43k op/s 2023-07-21T23:07:01.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:01 smithi195 ceph-mon[97365]: pgmap v1521: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 MiB/s rd, 14 MiB/s wr, 1.43k op/s 2023-07-21T23:07:03.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:03 smithi151 ceph-mon[95510]: pgmap v1522: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.7 MiB/s wr, 1.07k op/s 2023-07-21T23:07:03.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:03 smithi187 ceph-mon[96918]: pgmap v1522: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.7 MiB/s wr, 1.07k op/s 2023-07-21T23:07:03.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:03 smithi195 ceph-mon[97365]: pgmap v1522: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.7 MiB/s wr, 1.07k op/s 2023-07-21T23:07:04.288 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 850.0 s, 307.0 tps, lat 304.758 ms stddev 157.629 2023-07-21T23:07:05.443 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:05 smithi151 ceph-mon[95510]: pgmap v1523: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 13 MiB/s wr, 1.42k op/s 2023-07-21T23:07:05.444 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:05 smithi151 ceph-mon[95510]: osdmap e172: 12 total, 12 up, 12 in 2023-07-21T23:07:05.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:05 smithi187 ceph-mon[96918]: pgmap v1523: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 13 MiB/s wr, 1.42k op/s 2023-07-21T23:07:05.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:05 smithi187 ceph-mon[96918]: osdmap e172: 12 total, 12 up, 12 in 2023-07-21T23:07:05.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:05 smithi195 ceph-mon[97365]: pgmap v1523: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 MiB/s rd, 13 MiB/s wr, 1.42k op/s 2023-07-21T23:07:05.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:05 smithi195 ceph-mon[97365]: osdmap e172: 12 total, 12 up, 12 in 2023-07-21T23:07:07.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:07 smithi187 ceph-mon[96918]: pgmap v1525: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.16k op/s 2023-07-21T23:07:07.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:07 smithi195 ceph-mon[97365]: pgmap v1525: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.16k op/s 2023-07-21T23:07:07.688 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:07 smithi151 ceph-mon[95510]: pgmap v1525: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 MiB/s rd, 10 MiB/s wr, 1.16k op/s 2023-07-21T23:07:09.294 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 855.0 s, 88.5 tps, lat 1140.334 ms stddev 559.001 2023-07-21T23:07:09.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:09 smithi187 ceph-mon[96918]: pgmap v1526: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2023-07-21T23:07:09.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:09 smithi195 ceph-mon[97365]: pgmap v1526: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2023-07-21T23:07:09.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:09 smithi151 ceph-mon[95510]: pgmap v1526: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 4.5 MiB/s rd, 10 MiB/s wr, 1.08k op/s 2023-07-21T23:07:11.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:11 smithi187 ceph-mon[96918]: pgmap v1527: 97 pgs: 15 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 51 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 709 op/s 2023-07-21T23:07:11.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:11 smithi195 ceph-mon[97365]: pgmap v1527: 97 pgs: 15 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 51 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 709 op/s 2023-07-21T23:07:11.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:11 smithi151 ceph-mon[95510]: pgmap v1527: 97 pgs: 15 active+clean+snaptrim, 31 active+clean+snaptrim_wait, 51 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.4 MiB/s wr, 709 op/s 2023-07-21T23:07:13.301 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.269+0000 7ff3883ff700 1 -- 172.21.15.151:0/239740138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff38010c240 msgr2=0x7ff38010c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:13.302 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.269+0000 7ff3883ff700 1 --2- 172.21.15.151:0/239740138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff38010c240 0x7ff38010c610 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009990 tx=0x7ff37c009ca0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.276+0000 7ff3883ff700 1 -- 172.21.15.151:0/239740138 shutdown_connections 2023-07-21T23:07:13.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.276+0000 7ff3883ff700 1 --2- 172.21.15.151:0/239740138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff380106cf0 0x7ff380112f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.276+0000 7ff3883ff700 1 --2- 172.21.15.151:0/239740138 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff38010c240 0x7ff38010c610 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.276+0000 7ff3883ff700 1 --2- 172.21.15.151:0/239740138 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff380106340 0x7ff3801067b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.309 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.276+0000 7ff3883ff700 1 -- 172.21.15.151:0/239740138 >> 172.21.15.151:0/239740138 conn(0x7ff380075a20 msgr2=0x7ff380077e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:13.310 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.277+0000 7ff3883ff700 1 -- 172.21.15.151:0/239740138 shutdown_connections 2023-07-21T23:07:13.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.278+0000 7ff3883ff700 1 -- 172.21.15.151:0/239740138 wait complete. 2023-07-21T23:07:13.311 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.279+0000 7ff3883ff700 1 Processor -- start 2023-07-21T23:07:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.279+0000 7ff3883ff700 1 -- start start 2023-07-21T23:07:13.340 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.280+0000 7ff3883ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff380106340 0x7ff380071a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.280+0000 7ff3883ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff380106cf0 0x7ff380071f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.288+0000 7ff3883ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff38010c240 0x7ff38006a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.288+0000 7ff3883ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38006afa0 con 0x7ff38010c240 2023-07-21T23:07:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.288+0000 7ff3883ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38006b110 con 0x7ff380106340 2023-07-21T23:07:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.288+0000 7ff3883ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38006b2d0 con 0x7ff380106cf0 2023-07-21T23:07:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.289+0000 7ff38699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff38010c240 0x7ff38006a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.341 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.289+0000 7ff38699c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff38010c240 0x7ff38006a810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35516/0 (socket says 172.21.15.151:35516) 2023-07-21T23:07:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.289+0000 7ff38699c700 1 -- 172.21.15.151:0/2992953421 learned_addr learned my addr 172.21.15.151:0/2992953421 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.290+0000 7ff38699c700 1 -- 172.21.15.151:0/2992953421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff380106cf0 msgr2=0x7ff380071f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T23:07:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.290+0000 7ff38699c700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff380106cf0 0x7ff380071f90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.290+0000 7ff38699c700 1 -- 172.21.15.151:0/2992953421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff380106340 msgr2=0x7ff380071a10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-07-21T23:07:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.290+0000 7ff38699c700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff380106340 0x7ff380071a10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.342 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.290+0000 7ff38699c700 1 -- 172.21.15.151:0/2992953421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff378009c40 con 0x7ff38010c240 2023-07-21T23:07:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.290+0000 7ff38699c700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff38010c240 0x7ff38006a810 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c140 tx=0x7ff37800c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.291+0000 7ff3777fe700 1 -- 172.21.15.151:0/2992953421 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378017070 con 0x7ff38010c240 2023-07-21T23:07:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.291+0000 7ff3777fe700 1 -- 172.21.15.151:0/2992953421 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff37800e050 con 0x7ff38010c240 2023-07-21T23:07:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.291+0000 7ff3777fe700 1 -- 172.21.15.151:0/2992953421 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff378004330 con 0x7ff38010c240 2023-07-21T23:07:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.291+0000 7ff3883ff700 1 -- 172.21.15.151:0/2992953421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff37c0095f0 con 0x7ff38010c240 2023-07-21T23:07:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.291+0000 7ff3883ff700 1 -- 172.21.15.151:0/2992953421 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38006f780 con 0x7ff38010c240 2023-07-21T23:07:13.343 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.304+0000 7ff3777fe700 1 -- 172.21.15.151:0/2992953421 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7ff3780044b0 con 0x7ff38010c240 2023-07-21T23:07:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.307+0000 7ff3777fe700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff36c0c34e0 0x7ff36c0c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.344 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.307+0000 7ff3777fe700 1 -- 172.21.15.151:0/2992953421 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(172..172 src has 1..172) v4 ==== 8536+0+0 (secure 0 0 0) 0x7ff3780cce00 con 0x7ff38010c240 2023-07-21T23:07:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.309+0000 7ff39bca4b80 1 Processor -- start 2023-07-21T23:07:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.310+0000 7ff39bca4b80 1 -- start start 2023-07-21T23:07:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.310+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809adf6b0 0x55b809c88cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.310+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89210 0x55b809c82f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.345 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.311+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.311+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809b88c50 con 0x55b809c89210 2023-07-21T23:07:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.311+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809bdb9e0 con 0x55b809c89660 2023-07-21T23:07:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.311+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809bd4e70 con 0x55b809adf6b0 2023-07-21T23:07:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.311+0000 7ff38699c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.346 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.311+0000 7ff38699c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c834a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60586/0 (socket says 172.21.15.151:60586) 2023-07-21T23:07:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.311+0000 7ff38699c700 1 -- 172.21.15.151:0/2314098966 learned_addr learned my addr 172.21.15.151:0/2314098966 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.312+0000 7ff38699c700 1 -- 172.21.15.151:0/2314098966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809adf6b0 msgr2=0x55b809c88cd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:07:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.312+0000 7ff38699c700 1 --2- 172.21.15.151:0/2314098966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809adf6b0 0x55b809c88cd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.312+0000 7ff38699c700 1 -- 172.21.15.151:0/2314098966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89210 msgr2=0x55b809c82f40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-07-21T23:07:13.347 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.312+0000 7ff38699c700 1 --2- 172.21.15.151:0/2314098966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89210 0x55b809c82f40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.348 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.312+0000 7ff38699c700 1 -- 172.21.15.151:0/2314098966 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b809a02d80 con 0x55b809c89660 2023-07-21T23:07:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.313+0000 7ff38699c700 1 --2- 172.21.15.151:0/2314098966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c834a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff3780a1d80 tx=0x7ff378099c30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=291b7f67742577e2 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:13.350 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.314+0000 7ff374bfe700 1 -- 172.21.15.151:0/2314098966 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780b1070 con 0x55b809c89660 2023-07-21T23:07:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.314+0000 7ff374bfe700 1 -- 172.21.15.151:0/2314098966 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff37800f040 con 0x55b809c89660 2023-07-21T23:07:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.314+0000 7ff374bfe700 1 -- 172.21.15.151:0/2314098966 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37809a0c0 con 0x55b809c89660 2023-07-21T23:07:13.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.315+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2314098966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 msgr2=0x55b809c834a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.315+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2314098966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c834a0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7ff3780a1d80 tx=0x7ff378099c30 comp rx=0 tx=0).stop 2023-07-21T23:07:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.315+0000 7ff38619b700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff36c0c34e0 0x7ff36c0c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.316+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2314098966 shutdown_connections 2023-07-21T23:07:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.316+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2314098966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c834a0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.316+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2314098966 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809adf6b0 0x55b809c88cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.316+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2314098966 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89210 0x55b809c82f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.316+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2314098966 >> 172.21.15.151:0/2314098966 conn(0x55b809c78ae0 msgr2=0x55b809c7e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.317+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2314098966 shutdown_connections 2023-07-21T23:07:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.317+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2314098966 wait complete. 2023-07-21T23:07:13.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.317+0000 7ff38619b700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff36c0c34e0 0x7ff36c0c5990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff37c005910 tx=0x7ff37c009510 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:13.355 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.318+0000 7ff39bca4b80 1 -- start start 2023-07-21T23:07:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.318+0000 7ff39bca4b80 1 Processor -- start 2023-07-21T23:07:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.319+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809adf6b0 0x55b809c8f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.319+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 0x55b809c8c820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.319+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.358 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.319+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809b74a60 con 0x55b809adf6b0 2023-07-21T23:07:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.319+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809b74760 con 0x55b809c89660 2023-07-21T23:07:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.319+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809a588c0 con 0x55b809c89210 2023-07-21T23:07:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.319+0000 7ff39bca4b80 10 client.0 _ll_register_callbacks cb 0x55b809b72700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:07:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38619b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809adf6b0 0x55b809c8f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38599a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 0x55b809c8c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38619b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809adf6b0 0x55b809c8f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35526/0 (socket says 172.21.15.151:35526) 2023-07-21T23:07:13.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38619b700 1 -- 172.21.15.151:0/2710105701 learned_addr learned my addr 172.21.15.151:0/2710105701 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38699c700 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38619b700 1 -- 172.21.15.151:0/2710105701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 msgr2=0x55b809c8c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38619b700 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 0x55b809c8c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38619b700 1 -- 172.21.15.151:0/2710105701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 msgr2=0x55b809c8cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38619b700 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.320+0000 7ff38619b700 1 -- 172.21.15.151:0/2710105701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38006f780 con 0x55b809adf6b0 2023-07-21T23:07:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.321+0000 7ff38619b700 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809adf6b0 0x55b809c8f5a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff37c015000 tx=0x7ff37c009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cd0c5f5a9ce7b8 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.321+0000 7ff369ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:07:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.322+0000 7ff369ffb700 1 -- 172.21.15.151:0/2710105701 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c01d070 con 0x55b809adf6b0 2023-07-21T23:07:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.322+0000 7ff369ffb700 1 -- 172.21.15.151:0/2710105701 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 8536+0+0 (secure 0 0 0) 0x7ff37c00fde0 con 0x55b809adf6b0 2023-07-21T23:07:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.322+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2710105701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b809b2e490 con 0x55b809adf6b0 2023-07-21T23:07:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.322+0000 7ff369ffb700 1 -- 172.21.15.151:0/2710105701 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff37c02f420 con 0x55b809adf6b0 2023-07-21T23:07:13.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.322+0000 7ff39bca4b80 10 client.19938 fetch_fsmap learned FSMap version 116 2023-07-21T23:07:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.322+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2710105701 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55b8099ebc00 con 0x55b809adf6b0 2023-07-21T23:07:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.323+0000 7ff369ffb700 1 -- 172.21.15.151:0/2710105701 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55b809b2e490 con 0x55b809adf6b0 2023-07-21T23:07:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.323+0000 7ff369ffb700 1 -- 172.21.15.151:0/2710105701 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff37c026400 con 0x55b809adf6b0 2023-07-21T23:07:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.323+0000 7ff39bca4b80 10 client.19938 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:07:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.323+0000 7ff39bca4b80 10 client.19938 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:07:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.323+0000 7ff39bca4b80 20 client.19938 populate_metadata read hostname 'smithi151' 2023-07-21T23:07:13.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.323+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b809c9cbe0 0x55b809c9eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.323+0000 7ff39bca4b80 4 client.19938 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:07:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.323+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2710105701 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b809bcde50 con 0x55b809c9cbe0 2023-07-21T23:07:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.324+0000 7ff38599a700 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b809c9cbe0 0x55b809c9eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.325+0000 7ff38599a700 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b809c9cbe0 0x55b809c9eff0 crc :-1 s=READY pgs=527 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22c1cf7739308459 server_cookie=f59d7de596f6a2ea in_seq=0 out_seq=0 2023-07-21T23:07:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.325+0000 7ff369ffb700 10 client.19938 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:13.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.325+0000 7ff369ffb700 1 -- 172.21.15.151:0/2710105701 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55b809bcde50 con 0x55b809c9cbe0 2023-07-21T23:07:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.325+0000 7ff369ffb700 10 client.19938 handle_command_reply: tid=0 2023-07-21T23:07:13.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.325+0000 7ff39bca4b80 1 client.19938 shutdown 2023-07-21T23:07:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.326+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2710105701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809adf6b0 msgr2=0x55b809c8f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.326+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809adf6b0 0x55b809c8f5a0 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7ff37c015000 tx=0x7ff37c009ca0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.330+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2710105701 shutdown_connections 2023-07-21T23:07:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.330+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b809c9cbe0 0x55b809c9eff0 crc :-1 s=READY pgs=527 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.330+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.330+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809adf6b0 0x55b809c8f5a0 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.330+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2710105701 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 0x55b809c8c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.330+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2710105701 >> 172.21.15.151:0/2710105701 conn(0x55b809c78ae0 msgr2=0x55b809c7d3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.330+0000 7ff369ffb700 0 client.19938 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.330+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2710105701 shutdown_connections 2023-07-21T23:07:13.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.331+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2710105701 wait complete. 2023-07-21T23:07:13.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.334+0000 7ff39bca4b80 20 client.19938 trim_cache size 0 max 16384 2023-07-21T23:07:13.392 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.360+0000 7ff39bca4b80 1 Processor -- start 2023-07-21T23:07:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.360+0000 7ff39bca4b80 1 -- start start 2023-07-21T23:07:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.361+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809adf6b0 0x55b809c93c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.361+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89210 0x55b809c880a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.361+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.361+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809c8ae30 con 0x55b809c89210 2023-07-21T23:07:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.361+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809c87580 con 0x55b809c89660 2023-07-21T23:07:13.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.361+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809c75ab0 con 0x55b809adf6b0 2023-07-21T23:07:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.361+0000 7ff38699c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.361+0000 7ff38699c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60600/0 (socket says 172.21.15.151:60600) 2023-07-21T23:07:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.361+0000 7ff38699c700 1 -- 172.21.15.151:0/2929769207 learned_addr learned my addr 172.21.15.151:0/2929769207 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.362+0000 7ff38599a700 1 --2- 172.21.15.151:0/2929769207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89210 0x55b809c880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.395 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.363+0000 7ff38699c700 1 -- 172.21.15.151:0/2929769207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809adf6b0 msgr2=0x55b809c93c30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-07-21T23:07:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.363+0000 7ff38699c700 1 --2- 172.21.15.151:0/2929769207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809adf6b0 0x55b809c93c30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.363+0000 7ff38699c700 1 -- 172.21.15.151:0/2929769207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89210 msgr2=0x55b809c880a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.363+0000 7ff38699c700 1 --2- 172.21.15.151:0/2929769207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89210 0x55b809c880a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.396 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.363+0000 7ff38699c700 1 -- 172.21.15.151:0/2929769207 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b809a291f0 con 0x55b809c89660 2023-07-21T23:07:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.364+0000 7ff38699c700 1 --2- 172.21.15.151:0/2929769207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8f140 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff3780968d0 tx=0x7ff37800ca50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf387a87ad09d4a6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.364+0000 7ff3753ff700 1 -- 172.21.15.151:0/2929769207 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3780b1040 con 0x55b809c89660 2023-07-21T23:07:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.364+0000 7ff3753ff700 1 -- 172.21.15.151:0/2929769207 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff3780a22b0 con 0x55b809c89660 2023-07-21T23:07:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.364+0000 7ff3753ff700 1 -- 172.21.15.151:0/2929769207 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37809a320 con 0x55b809c89660 2023-07-21T23:07:13.398 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.365+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2929769207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 msgr2=0x55b809c8f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.365+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2929769207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8f140 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7ff3780968d0 tx=0x7ff37800ca50 comp rx=0 tx=0).stop 2023-07-21T23:07:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.365+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2929769207 shutdown_connections 2023-07-21T23:07:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.365+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2929769207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809c89660 0x55b809c8f140 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.365+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2929769207 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809adf6b0 0x55b809c93c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.399 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.365+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/2929769207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89210 0x55b809c880a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.365+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2929769207 >> 172.21.15.151:0/2929769207 conn(0x55b809c78ae0 msgr2=0x55b809c87990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.366+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2929769207 shutdown_connections 2023-07-21T23:07:13.400 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.366+0000 7ff39bca4b80 1 -- 172.21.15.151:0/2929769207 wait complete. 2023-07-21T23:07:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.366+0000 7ff39bca4b80 1 -- start start 2023-07-21T23:07:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.367+0000 7ff39bca4b80 1 Processor -- start 2023-07-21T23:07:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.367+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809adf6b0 0x55b809c85d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.401 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.367+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 0x55b809c84730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.367+0000 7ff39bca4b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89660 0x55b809c84c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.367+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809c86490 con 0x55b809c89660 2023-07-21T23:07:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.367+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809c851b0 con 0x55b809adf6b0 2023-07-21T23:07:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.367+0000 7ff39bca4b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b809c85370 con 0x55b809c89210 2023-07-21T23:07:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.367+0000 7ff39bca4b80 10 client.0 _ll_register_callbacks cb 0x7ff37c00bd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:07:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.368+0000 7ff38599a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 0x55b809c84730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.402 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.368+0000 7ff38619b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809adf6b0 0x55b809c85d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.368+0000 7ff38619b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809adf6b0 0x55b809c85d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:60604/0 (socket says 172.21.15.151:60604) 2023-07-21T23:07:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.368+0000 7ff38619b700 1 -- 172.21.15.151:0/597520505 learned_addr learned my addr 172.21.15.151:0/597520505 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.368+0000 7ff38619b700 1 -- 172.21.15.151:0/597520505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 msgr2=0x55b809c84730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.368+0000 7ff38619b700 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 0x55b809c84730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.368+0000 7ff38619b700 1 -- 172.21.15.151:0/597520505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89660 msgr2=0x55b809c84c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.368+0000 7ff38619b700 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89660 0x55b809c84c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.368+0000 7ff38619b700 1 -- 172.21.15.151:0/597520505 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b809a02d80 con 0x55b809adf6b0 2023-07-21T23:07:13.403 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.369+0000 7ff38619b700 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809adf6b0 0x55b809c85d60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0095c0 tx=0x7ff37c0059f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=275db70dd5c37e14 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:13.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.369+0000 7ff369ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:07:13.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.369+0000 7ff369ffb700 1 -- 172.21.15.151:0/597520505 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c026a80 con 0x55b809adf6b0 2023-07-21T23:07:13.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.369+0000 7ff369ffb700 1 -- 172.21.15.151:0/597520505 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(172..172 src has 1..172) v4 ==== 8536+0+0 (secure 0 0 0) 0x7ff37c005bc0 con 0x55b809adf6b0 2023-07-21T23:07:13.404 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.369+0000 7ff39bca4b80 1 -- 172.21.15.151:0/597520505 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff37800f040 con 0x55b809adf6b0 2023-07-21T23:07:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.369+0000 7ff369ffb700 1 -- 172.21.15.151:0/597520505 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff37c023760 con 0x55b809adf6b0 2023-07-21T23:07:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.369+0000 7ff39bca4b80 10 client.29585 fetch_fsmap learned FSMap version 116 2023-07-21T23:07:13.405 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.369+0000 7ff39bca4b80 1 -- 172.21.15.151:0/597520505 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55b809a01250 con 0x55b809adf6b0 2023-07-21T23:07:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.370+0000 7ff369ffb700 1 -- 172.21.15.151:0/597520505 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7ff37800f040 con 0x55b809adf6b0 2023-07-21T23:07:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.370+0000 7ff369ffb700 1 -- 172.21.15.151:0/597520505 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7ff37c03a5d0 con 0x55b809adf6b0 2023-07-21T23:07:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.370+0000 7ff39bca4b80 10 client.29585 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:07:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.370+0000 7ff39bca4b80 10 client.29585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:07:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.370+0000 7ff39bca4b80 20 client.29585 populate_metadata read hostname 'smithi151' 2023-07-21T23:07:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.371+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b809cf19a0 0x55b809cf3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.371+0000 7ff39bca4b80 4 client.29585 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:07:13.406 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.371+0000 7ff39bca4b80 1 -- 172.21.15.151:0/597520505 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55b809b8fff0 con 0x55b809cf19a0 2023-07-21T23:07:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.371+0000 7ff38599a700 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b809cf19a0 0x55b809cf3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.371+0000 7ff38599a700 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b809cf19a0 0x55b809cf3db0 crc :-1 s=READY pgs=528 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45494918879aca7 server_cookie=97d2ffa1dbd0321b in_seq=0 out_seq=0 2023-07-21T23:07:13.407 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.371+0000 7ff369ffb700 10 client.29585 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.424+0000 7ff369ffb700 1 -- 172.21.15.151:0/597520505 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55b809b8fff0 con 0x55b809cf19a0 2023-07-21T23:07:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.424+0000 7ff369ffb700 10 client.29585 handle_command_reply: tid=0 2023-07-21T23:07:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.424+0000 7ff39bca4b80 1 client.29585 shutdown 2023-07-21T23:07:13.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.425+0000 7ff39bca4b80 1 -- 172.21.15.151:0/597520505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809adf6b0 msgr2=0x55b809c85d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:13.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.425+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809adf6b0 0x55b809c85d60 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7ff37c0095c0 tx=0x7ff37c0059f0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff39bca4b80 1 -- 172.21.15.151:0/597520505 shutdown_connections 2023-07-21T23:07:13.458 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55b809cf19a0 0x55b809cf3db0 crc :-1 s=READY pgs=528 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b809adf6b0 0x55b809c85d60 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809c89660 0x55b809c84c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff39bca4b80 1 --2- 172.21.15.151:0/597520505 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55b809c89210 0x55b809c84730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff39bca4b80 1 -- 172.21.15.151:0/597520505 >> 172.21.15.151:0/597520505 conn(0x55b809c78ae0 msgr2=0x55b809c8a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff369ffb700 0 client.29585 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff39bca4b80 1 -- 172.21.15.151:0/597520505 shutdown_connections 2023-07-21T23:07:13.459 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff39bca4b80 1 -- 172.21.15.151:0/597520505 wait complete. 2023-07-21T23:07:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.426+0000 7ff39bca4b80 20 client.29585 trim_cache size 0 max 16384 2023-07-21T23:07:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:07:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:07:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:07:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:07:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.430+0000 7ff3883ff700 1 -- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff36c0c34e0 msgr2=0x7ff36c0c5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.430+0000 7ff3883ff700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff36c0c34e0 0x7ff36c0c5990 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7ff37c005910 tx=0x7ff37c009510 comp rx=0 tx=0).stop 2023-07-21T23:07:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.430+0000 7ff3883ff700 1 -- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff38010c240 msgr2=0x7ff38006a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.430+0000 7ff3883ff700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff38010c240 0x7ff38006a810 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7ff37800c140 tx=0x7ff37800c500 comp rx=0 tx=0).stop 2023-07-21T23:07:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.430+0000 7ff3883ff700 1 -- 172.21.15.151:0/2992953421 shutdown_connections 2023-07-21T23:07:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.430+0000 7ff3883ff700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7ff36c0c34e0 0x7ff36c0c5990 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.430+0000 7ff3883ff700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff380106340 0x7ff380071a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.430+0000 7ff3883ff700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff38010c240 0x7ff38006a810 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.431+0000 7ff3883ff700 1 --2- 172.21.15.151:0/2992953421 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7ff380106cf0 0x7ff380071f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.431+0000 7ff3883ff700 1 -- 172.21.15.151:0/2992953421 >> 172.21.15.151:0/2992953421 conn(0x7ff380075a20 msgr2=0x7ff380077080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.434+0000 7ff3883ff700 1 -- 172.21.15.151:0/2992953421 shutdown_connections 2023-07-21T23:07:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:13.435+0000 7ff3883ff700 1 -- 172.21.15.151:0/2992953421 wait complete. 2023-07-21T23:07:13.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:13 smithi187 ceph-mon[96918]: pgmap v1528: 97 pgs: 13 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 57 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 679 op/s 2023-07-21T23:07:13.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:13 smithi195 ceph-mon[97365]: pgmap v1528: 97 pgs: 13 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 57 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 679 op/s 2023-07-21T23:07:13.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:13 smithi151 ceph-mon[95510]: pgmap v1528: 97 pgs: 13 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 57 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 6.2 MiB/s wr, 679 op/s 2023-07-21T23:07:14.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 860.0 s, 221.8 tps, lat 472.056 ms stddev 372.414 2023-07-21T23:07:15.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:15 smithi187 ceph-mon[96918]: pgmap v1529: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 453 op/s 2023-07-21T23:07:15.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:15 smithi195 ceph-mon[97365]: pgmap v1529: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 453 op/s 2023-07-21T23:07:15.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:15 smithi151 ceph-mon[95510]: pgmap v1529: 97 pgs: 1 active+clean+snaptrim, 96 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.3 MiB/s rd, 4.2 MiB/s wr, 453 op/s 2023-07-21T23:07:16.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:16 smithi187 ceph-mon[96918]: pgmap v1530: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 397 op/s 2023-07-21T23:07:16.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:16 smithi195 ceph-mon[97365]: pgmap v1530: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 397 op/s 2023-07-21T23:07:16.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:16 smithi151 ceph-mon[95510]: pgmap v1530: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.6 MiB/s wr, 397 op/s 2023-07-21T23:07:18.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:18 smithi151 ceph-mon[95510]: osdmap e173: 12 total, 12 up, 12 in 2023-07-21T23:07:18.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:18 smithi187 ceph-mon[96918]: osdmap e173: 12 total, 12 up, 12 in 2023-07-21T23:07:18.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:18 smithi195 ceph-mon[97365]: osdmap e173: 12 total, 12 up, 12 in 2023-07-21T23:07:19.286 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 865.0 s, 286.2 tps, lat 352.270 ms stddev 178.271 2023-07-21T23:07:19.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:19 smithi187 ceph-mon[96918]: pgmap v1532: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.4 MiB/s wr, 509 op/s 2023-07-21T23:07:19.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:19 smithi195 ceph-mon[97365]: pgmap v1532: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.4 MiB/s wr, 509 op/s 2023-07-21T23:07:19.688 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:19 smithi151 ceph-mon[95510]: pgmap v1532: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 5.4 MiB/s wr, 509 op/s 2023-07-21T23:07:21.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:21 smithi187 ceph-mon[96918]: pgmap v1533: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.9 MiB/s wr, 763 op/s 2023-07-21T23:07:21.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:21 smithi195 ceph-mon[97365]: pgmap v1533: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.9 MiB/s wr, 763 op/s 2023-07-21T23:07:21.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:21 smithi151 ceph-mon[95510]: pgmap v1533: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 MiB/s rd, 6.9 MiB/s wr, 763 op/s 2023-07-21T23:07:23.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:23 smithi187 ceph-mon[96918]: pgmap v1534: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.3 MiB/s wr, 812 op/s 2023-07-21T23:07:23.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:23 smithi195 ceph-mon[97365]: pgmap v1534: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.3 MiB/s wr, 812 op/s 2023-07-21T23:07:23.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:23 smithi151 ceph-mon[95510]: pgmap v1534: 97 pgs: 97 active+clean; 14 GiB data, 32 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.3 MiB/s wr, 812 op/s 2023-07-21T23:07:24.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 870.0 s, 328.4 tps, lat 308.634 ms stddev 94.305 2023-07-21T23:07:25.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:25 smithi187 ceph-mon[96918]: pgmap v1535: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.0 MiB/s wr, 981 op/s 2023-07-21T23:07:25.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:25 smithi195 ceph-mon[97365]: pgmap v1535: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.0 MiB/s wr, 981 op/s 2023-07-21T23:07:25.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:25 smithi151 ceph-mon[95510]: pgmap v1535: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.0 MiB/s wr, 981 op/s 2023-07-21T23:07:26.941 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.908+0000 7f2c25dff700 1 -- 172.21.15.151:0/2709475426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c20105b10 msgr2=0x7f2c20105ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.908+0000 7f2c25dff700 1 --2- 172.21.15.151:0/2709475426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c20105b10 0x7f2c20105ee0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009990 tx=0x7f2c10009ca0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.908+0000 7f2c25dff700 1 -- 172.21.15.151:0/2709475426 shutdown_connections 2023-07-21T23:07:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.908+0000 7f2c25dff700 1 --2- 172.21.15.151:0/2709475426 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c201004b0 0x7f2c2010c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.942 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.908+0000 7f2c25dff700 1 --2- 172.21.15.151:0/2709475426 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c20105b10 0x7f2c20105ee0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.908+0000 7f2c25dff700 1 --2- 172.21.15.151:0/2709475426 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c200ffb00 0x7f2c200fff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.908+0000 7f2c25dff700 1 -- 172.21.15.151:0/2709475426 >> 172.21.15.151:0/2709475426 conn(0x7f2c200fb600 msgr2=0x7f2c200fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:26.943 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.908+0000 7f2c25dff700 1 -- 172.21.15.151:0/2709475426 shutdown_connections 2023-07-21T23:07:26.944 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.908+0000 7f2c25dff700 1 -- 172.21.15.151:0/2709475426 wait complete. 2023-07-21T23:07:26.947 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.909+0000 7f2c25dff700 1 Processor -- start 2023-07-21T23:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.909+0000 7f2c25dff700 1 -- start start 2023-07-21T23:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c25dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c200ffb00 0x7f2c2019bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c25dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c201004b0 0x7f2c2019c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c25dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c20105b10 0x7f2c20195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.948 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c25dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201960a0 con 0x7f2c201004b0 2023-07-21T23:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c25dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c20196210 con 0x7f2c200ffb00 2023-07-21T23:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c25dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c201963d0 con 0x7f2c20105b10 2023-07-21T23:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c1effd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c201004b0 0x7f2c2019c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c1f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c200ffb00 0x7f2c2019bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c1effd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c201004b0 0x7f2c2019c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60274/0 (socket says 172.21.15.151:60274) 2023-07-21T23:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c1f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c200ffb00 0x7f2c2019bbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46976/0 (socket says 172.21.15.151:46976) 2023-07-21T23:07:26.949 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c1effd700 1 -- 172.21.15.151:0/1998440489 learned_addr learned my addr 172.21.15.151:0/1998440489 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.910+0000 7f2c1ffff700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c20105b10 0x7f2c20195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1effd700 1 -- 172.21.15.151:0/1998440489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c20105b10 msgr2=0x7f2c20195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1effd700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c20105b10 0x7f2c20195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1effd700 1 -- 172.21.15.151:0/1998440489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c200ffb00 msgr2=0x7f2c2019bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1effd700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c200ffb00 0x7f2c2019bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1effd700 1 -- 172.21.15.151:0/1998440489 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c100095f0 con 0x7f2c201004b0 2023-07-21T23:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c200ffb00 0x7f2c2019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:07:26.950 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1effd700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c201004b0 0x7f2c2019c110 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400d950 tx=0x7f2c1400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1cff9700 1 -- 172.21.15.151:0/1998440489 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14009940 con 0x7f2c201004b0 2023-07-21T23:07:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c25dff700 1 -- 172.21.15.151:0/1998440489 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c201966b0 con 0x7f2c201004b0 2023-07-21T23:07:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1cff9700 1 -- 172.21.15.151:0/1998440489 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c14010460 con 0x7f2c201004b0 2023-07-21T23:07:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c1cff9700 1 -- 172.21.15.151:0/1998440489 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400f620 con 0x7f2c201004b0 2023-07-21T23:07:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.911+0000 7f2c25dff700 1 -- 172.21.15.151:0/1998440489 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c201a2bc0 con 0x7f2c201004b0 2023-07-21T23:07:26.951 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.914+0000 7f2c1cff9700 1 -- 172.21.15.151:0/1998440489 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f2c140105d0 con 0x7f2c201004b0 2023-07-21T23:07:26.955 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c397bfb80 1 Processor -- start 2023-07-21T23:07:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c397bfb80 1 -- start start 2023-07-21T23:07:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c1cff9700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c080a12c0 0x7f2c080a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c1cff9700 1 -- 172.21.15.151:0/1998440489 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2c140ccbb0 con 0x7f2c201004b0 2023-07-21T23:07:26.956 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f39f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f399350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39fa70 0x56424f3998b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f29ac50 con 0x56424f39fa70 2023-07-21T23:07:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f2ed9e0 con 0x56424f39f620 2023-07-21T23:07:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f2e6e70 con 0x56424f1f16b0 2023-07-21T23:07:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c1ffff700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c080a12c0 0x7f2c080a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.957 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.916+0000 7f2c1effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f399350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f399350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:46982/0 (socket says 172.21.15.151:46982) 2023-07-21T23:07:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1effd700 1 -- 172.21.15.151:0/2828315765 learned_addr learned my addr 172.21.15.151:0/2828315765 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1ffff700 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39fa70 0x56424f3998b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f39f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1effd700 1 -- 172.21.15.151:0/2828315765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 msgr2=0x56424f39f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1effd700 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f39f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1effd700 1 -- 172.21.15.151:0/2828315765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39fa70 msgr2=0x56424f3998b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:26.958 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1effd700 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39fa70 0x56424f3998b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1effd700 1 -- 172.21.15.151:0/2828315765 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56424f114d80 con 0x56424f39f620 2023-07-21T23:07:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f39f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:07:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1effd700 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f399350 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2c140966b0 tx=0x7f2c14099620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b3a22e21ea96126 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c1ffff700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c080a12c0 0x7f2c080a3770 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2c2019c8d0 tx=0x7f2c18007a80 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c05ffb700 1 -- 172.21.15.151:0/2828315765 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140a2090 con 0x56424f39f620 2023-07-21T23:07:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c05ffb700 1 -- 172.21.15.151:0/2828315765 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c1409d030 con 0x56424f39f620 2023-07-21T23:07:26.959 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.917+0000 7f2c05ffb700 1 -- 172.21.15.151:0/2828315765 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c14099390 con 0x56424f39f620 2023-07-21T23:07:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.918+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2828315765 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 msgr2=0x56424f399350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.918+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f399350 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2c140966b0 tx=0x7f2c14099620 comp rx=0 tx=0).stop 2023-07-21T23:07:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.918+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2828315765 shutdown_connections 2023-07-21T23:07:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.918+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39fa70 0x56424f3998b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.918+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f39f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.918+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2828315765 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f399350 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.918+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2828315765 >> 172.21.15.151:0/2828315765 conn(0x56424f38aae0 msgr2=0x56424f3900e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:26.960 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.918+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2828315765 shutdown_connections 2023-07-21T23:07:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.918+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2828315765 wait complete. 2023-07-21T23:07:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.919+0000 7f2c397bfb80 1 -- start start 2023-07-21T23:07:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.919+0000 7f2c397bfb80 1 Processor -- start 2023-07-21T23:07:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.919+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f3a8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.919+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 0x56424f3a8f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.919+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39fa70 0x56424f3a2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.961 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f286a60 con 0x56424f39f620 2023-07-21T23:07:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f286760 con 0x56424f39fa70 2023-07-21T23:07:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f16a8c0 con 0x56424f1f16b0 2023-07-21T23:07:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c397bfb80 10 client.0 _ll_register_callbacks cb 0x56424f284700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:07:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1effd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 0x56424f3a8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1effd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 0x56424f3a8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:60290/0 (socket says 172.21.15.151:60290) 2023-07-21T23:07:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1effd700 1 -- 172.21.15.151:0/748365733 learned_addr learned my addr 172.21.15.151:0/748365733 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f3a8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.962 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1ffff700 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39fa70 0x56424f3a2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1effd700 1 -- 172.21.15.151:0/748365733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 msgr2=0x56424f3a8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1effd700 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f3a8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1effd700 1 -- 172.21.15.151:0/748365733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39fa70 msgr2=0x56424f3a2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:26.963 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1effd700 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39fa70 0x56424f3a2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1effd700 1 -- 172.21.15.151:0/748365733 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c201a2bc0 con 0x56424f39f620 2023-07-21T23:07:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2c1effd700 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 0x56424f3a8f90 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f2c140ca840 tx=0x7f2c140993e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea7671c5e278f7df server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.920+0000 7f2bfeffd700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:07:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2bfeffd700 1 -- 172.21.15.151:0/748365733 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140a2090 con 0x56424f39f620 2023-07-21T23:07:26.964 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2bfeffd700 1 -- 172.21.15.151:0/748365733 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2c1409a0b0 con 0x56424f39f620 2023-07-21T23:07:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2c397bfb80 1 -- 172.21.15.151:0/748365733 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56424f240490 con 0x56424f39f620 2023-07-21T23:07:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2bfeffd700 1 -- 172.21.15.151:0/748365733 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c140a1c00 con 0x56424f39f620 2023-07-21T23:07:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2c397bfb80 10 client.19953 fetch_fsmap learned FSMap version 116 2023-07-21T23:07:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2c397bfb80 1 -- 172.21.15.151:0/748365733 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x56424f0fdc00 con 0x56424f39f620 2023-07-21T23:07:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2bfeffd700 1 -- 172.21.15.151:0/748365733 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x56424f240490 con 0x56424f39f620 2023-07-21T23:07:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2bfeffd700 1 -- 172.21.15.151:0/748365733 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2c140b2280 con 0x56424f39f620 2023-07-21T23:07:26.965 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2c397bfb80 10 client.19953 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:07:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2c397bfb80 10 client.19953 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:07:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2c397bfb80 20 client.19953 populate_metadata read hostname 'smithi151' 2023-07-21T23:07:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56424f3b2a80 0x56424f3b4e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2c397bfb80 4 client.19953 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:07:26.966 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.921+0000 7f2c397bfb80 1 -- 172.21.15.151:0/748365733 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56424f2dfe50 con 0x56424f3b2a80 2023-07-21T23:07:27.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.989+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56424f3b2a80 0x56424f3b4e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:27.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.991+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56424f3b2a80 0x56424f3b4e90 crc :-1 s=READY pgs=529 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3044fb43c0852278 server_cookie=b7a481af43ed14cb in_seq=0 out_seq=0 2023-07-21T23:07:27.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.991+0000 7f2bfeffd700 10 client.19953 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:27.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.994+0000 7f2bfeffd700 1 -- 172.21.15.151:0/748365733 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x56424f2dfe50 con 0x56424f3b2a80 2023-07-21T23:07:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.994+0000 7f2bfeffd700 10 client.19953 handle_command_reply: tid=0 2023-07-21T23:07:27.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.994+0000 7f2c397bfb80 1 client.19953 shutdown 2023-07-21T23:07:27.028 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.994+0000 7f2c397bfb80 1 -- 172.21.15.151:0/748365733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 msgr2=0x56424f3a8f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.994+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 0x56424f3a8f90 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f2c140ca840 tx=0x7f2c140993e0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2c397bfb80 1 -- 172.21.15.151:0/748365733 shutdown_connections 2023-07-21T23:07:27.029 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56424f3b2a80 0x56424f3b4e90 crc :-1 s=READY pgs=529 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39fa70 0x56424f3a2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f3a8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/748365733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 0x56424f3a8f90 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.030 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2c397bfb80 1 -- 172.21.15.151:0/748365733 >> 172.21.15.151:0/748365733 conn(0x56424f38aae0 msgr2=0x56424f38f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2bfeffd700 0 client.19953 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2c397bfb80 1 -- 172.21.15.151:0/748365733 shutdown_connections 2023-07-21T23:07:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2c397bfb80 1 -- 172.21.15.151:0/748365733 wait complete. 2023-07-21T23:07:27.031 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:26.995+0000 7f2c397bfb80 20 client.19953 trim_cache size 0 max 16384 2023-07-21T23:07:27.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.020+0000 7f2c397bfb80 1 Processor -- start 2023-07-21T23:07:27.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.022+0000 7f2c397bfb80 1 -- start start 2023-07-21T23:07:27.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.022+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f1f16b0 0x56424f3a2e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.022+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 0x56424f39e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.023+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f39fa70 0x56424f38fb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.023+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f39ed30 con 0x56424f39f620 2023-07-21T23:07:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.023+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f38c4f0 con 0x56424f1f16b0 2023-07-21T23:07:27.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.023+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f39d980 con 0x56424f39fa70 2023-07-21T23:07:27.058 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.026+0000 7f2c1f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f1f16b0 0x56424f3a2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.026+0000 7f2c1ffff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f39fa70 0x56424f38fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.026+0000 7f2c1f7fe700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f1f16b0 0x56424f3a2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:47000/0 (socket says 172.21.15.151:47000) 2023-07-21T23:07:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.026+0000 7f2c1f7fe700 1 -- 172.21.15.151:0/2035255340 learned_addr learned my addr 172.21.15.151:0/2035255340 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:27.059 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.027+0000 7f2c1f7fe700 1 -- 172.21.15.151:0/2035255340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f39fa70 msgr2=0x56424f38fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.027+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/2035255340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f39fa70 0x56424f38fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.027+0000 7f2c1f7fe700 1 -- 172.21.15.151:0/2035255340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 msgr2=0x56424f39e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.027+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/2035255340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 0x56424f39e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.027+0000 7f2c1f7fe700 1 -- 172.21.15.151:0/2035255340 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56424f13b1f0 con 0x56424f1f16b0 2023-07-21T23:07:27.060 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.027+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/2035255340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f1f16b0 0x56424f3a2e80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009990 tx=0x7f2c1000b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24c47375a7df297a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.028+0000 7f2c067fc700 1 -- 172.21.15.151:0/2035255340 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000bda0 con 0x56424f1f16b0 2023-07-21T23:07:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.028+0000 7f2c067fc700 1 -- 172.21.15.151:0/2035255340 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c1001e040 con 0x56424f1f16b0 2023-07-21T23:07:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.028+0000 7f2c067fc700 1 -- 172.21.15.151:0/2035255340 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c100052d0 con 0x56424f1f16b0 2023-07-21T23:07:27.061 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.029+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2035255340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f1f16b0 msgr2=0x56424f3a2e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.029+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2035255340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f1f16b0 0x56424f3a2e80 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2c10009990 tx=0x7f2c1000b260 comp rx=0 tx=0).stop 2023-07-21T23:07:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.029+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2035255340 shutdown_connections 2023-07-21T23:07:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.029+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2035255340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f1f16b0 0x56424f3a2e80 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.029+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2035255340 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f39fa70 0x56424f38fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.029+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2035255340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39f620 0x56424f39e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.062 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.029+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2035255340 >> 172.21.15.151:0/2035255340 conn(0x56424f38aae0 msgr2=0x56424f39dd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:27.063 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.030+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2035255340 shutdown_connections 2023-07-21T23:07:27.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.031+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2035255340 wait complete. 2023-07-21T23:07:27.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.031+0000 7f2c397bfb80 1 -- start start 2023-07-21T23:07:27.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.031+0000 7f2c397bfb80 1 Processor -- start 2023-07-21T23:07:27.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.032+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f3a7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:27.065 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.032+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f3a8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.032+0000 7f2c397bfb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39fa70 0x56424f397fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.032+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f3a8840 con 0x56424f39fa70 2023-07-21T23:07:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.032+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f3a89b0 con 0x56424f39f620 2023-07-21T23:07:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.032+0000 7f2c397bfb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x56424f3985a0 con 0x56424f1f16b0 2023-07-21T23:07:27.066 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.032+0000 7f2c397bfb80 10 client.0 _ll_register_callbacks cb 0x7f2c14099830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:07:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.033+0000 7f2c1effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f3a8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.034+0000 7f2c1effd700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f3a8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:47016/0 (socket says 172.21.15.151:47016) 2023-07-21T23:07:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.034+0000 7f2c1effd700 1 -- 172.21.15.151:0/2950231679 learned_addr learned my addr 172.21.15.151:0/2950231679 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:27.067 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.035+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f3a7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.037+0000 7f2c1f7fe700 1 -- 172.21.15.151:0/2950231679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 msgr2=0x56424f3a8060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.037+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f3a8060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.037+0000 7f2c1f7fe700 1 -- 172.21.15.151:0/2950231679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39fa70 msgr2=0x56424f397fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.037+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39fa70 0x56424f397fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.070 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.037+0000 7f2c1f7fe700 1 -- 172.21.15.151:0/2950231679 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c2010d240 con 0x56424f1f16b0 2023-07-21T23:07:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.038+0000 7f2c1f7fe700 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f3a7b20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2c100098e0 tx=0x7f2c100276d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36a10ee1b52caeaa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.038+0000 7f2bfeffd700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:07:27.071 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.038+0000 7f2bfeffd700 1 -- 172.21.15.151:0/2950231679 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c10027c60 con 0x56424f1f16b0 2023-07-21T23:07:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.039+0000 7f2bfeffd700 1 -- 172.21.15.151:0/2950231679 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f2c10027dc0 con 0x56424f1f16b0 2023-07-21T23:07:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.039+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2950231679 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2c1409d030 con 0x56424f1f16b0 2023-07-21T23:07:27.072 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.040+0000 7f2bfeffd700 1 -- 172.21.15.151:0/2950231679 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c10005040 con 0x56424f1f16b0 2023-07-21T23:07:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.045+0000 7f2c397bfb80 10 client.29638 fetch_fsmap learned FSMap version 116 2023-07-21T23:07:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.045+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2950231679 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x56424f113250 con 0x56424f1f16b0 2023-07-21T23:07:27.078 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.046+0000 7f2bfeffd700 1 -- 172.21.15.151:0/2950231679 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f2c1409d030 con 0x56424f1f16b0 2023-07-21T23:07:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.046+0000 7f2bfeffd700 1 -- 172.21.15.151:0/2950231679 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f2c10023030 con 0x56424f1f16b0 2023-07-21T23:07:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.046+0000 7f2c397bfb80 10 client.29638 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:07:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.046+0000 7f2c397bfb80 10 client.29638 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:07:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.046+0000 7f2c397bfb80 20 client.29638 populate_metadata read hostname 'smithi151' 2023-07-21T23:07:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.046+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56424f4031b0 0x56424f4035b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:27.079 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.046+0000 7f2c397bfb80 4 client.29638 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:07:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.046+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2950231679 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x56424f2a1ff0 con 0x56424f4031b0 2023-07-21T23:07:27.080 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.048+0000 7f2c1effd700 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56424f4031b0 0x56424f4035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.049+0000 7f2c1effd700 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56424f4031b0 0x56424f4035b0 crc :-1 s=READY pgs=530 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=698ba92af9f19bf0 server_cookie=83a9f19885c3322e in_seq=0 out_seq=0 2023-07-21T23:07:27.081 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.049+0000 7f2bfeffd700 10 client.29638 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:27.125 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.092+0000 7f2bfeffd700 1 -- 172.21.15.151:0/2950231679 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x56424f2a1ff0 con 0x56424f4031b0 2023-07-21T23:07:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.092+0000 7f2bfeffd700 10 client.29638 handle_command_reply: tid=0 2023-07-21T23:07:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.092+0000 7f2c397bfb80 1 client.29638 shutdown 2023-07-21T23:07:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.092+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2950231679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 msgr2=0x56424f3a7b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.092+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f3a7b20 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2c100098e0 tx=0x7f2c100276d0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.092+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2950231679 shutdown_connections 2023-07-21T23:07:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.093+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x56424f4031b0 0x56424f4035b0 crc :-1 s=READY pgs=530 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.126 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.093+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56424f39fa70 0x56424f397fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.093+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x56424f1f16b0 0x56424f3a7b20 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.093+0000 7f2bfeffd700 0 client.29638 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.093+0000 7f2c397bfb80 1 --2- 172.21.15.151:0/2950231679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x56424f39f620 0x56424f3a8060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.093+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2950231679 >> 172.21.15.151:0/2950231679 conn(0x56424f38aae0 msgr2=0x56424f39e620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.093+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2950231679 shutdown_connections 2023-07-21T23:07:27.127 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.093+0000 7f2c397bfb80 1 -- 172.21.15.151:0/2950231679 wait complete. 2023-07-21T23:07:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.093+0000 7f2c397bfb80 20 client.29638 trim_cache size 0 max 16384 2023-07-21T23:07:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:07:27.128 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:07:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:07:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:07:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 -- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c080a12c0 msgr2=0x7f2c080a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:27.129 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c080a12c0 0x7f2c080a3770 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2c2019c8d0 tx=0x7f2c18007a80 comp rx=0 tx=0).stop 2023-07-21T23:07:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 -- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c201004b0 msgr2=0x7f2c2019c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c201004b0 0x7f2c2019c110 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400d950 tx=0x7f2c1400dc60 comp rx=0 tx=0).stop 2023-07-21T23:07:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 -- 172.21.15.151:0/1998440489 shutdown_connections 2023-07-21T23:07:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f2c080a12c0 0x7f2c080a3770 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c200ffb00 0x7f2c2019bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f2c20105b10 0x7f2c20195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.130 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 --2- 172.21.15.151:0/1998440489 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2c201004b0 0x7f2c2019c110 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 -- 172.21.15.151:0/1998440489 >> 172.21.15.151:0/1998440489 conn(0x7f2c200fb600 msgr2=0x7f2c200fbce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 -- 172.21.15.151:0/1998440489 shutdown_connections 2023-07-21T23:07:27.131 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:27.094+0000 7f2c25dff700 1 -- 172.21.15.151:0/1998440489 wait complete. 2023-07-21T23:07:27.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:27 smithi187 ceph-mon[96918]: pgmap v1536: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.5 MiB/s wr, 996 op/s 2023-07-21T23:07:27.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:27 smithi195 ceph-mon[97365]: pgmap v1536: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.5 MiB/s wr, 996 op/s 2023-07-21T23:07:27.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:27 smithi151 ceph-mon[95510]: pgmap v1536: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 MiB/s rd, 9.5 MiB/s wr, 996 op/s 2023-07-21T23:07:29.287 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 875.0 s, 336.0 tps, lat 297.779 ms stddev 92.825 2023-07-21T23:07:29.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:29 smithi187 ceph-mon[96918]: pgmap v1537: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.1 MiB/s wr, 987 op/s 2023-07-21T23:07:29.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:29 smithi195 ceph-mon[97365]: pgmap v1537: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.1 MiB/s wr, 987 op/s 2023-07-21T23:07:29.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:29 smithi151 ceph-mon[95510]: pgmap v1537: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.1 MiB/s wr, 987 op/s 2023-07-21T23:07:31.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:31 smithi187 ceph-mon[96918]: pgmap v1538: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 11 MiB/s wr, 1.21k op/s 2023-07-21T23:07:31.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:31 smithi195 ceph-mon[97365]: pgmap v1538: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 11 MiB/s wr, 1.21k op/s 2023-07-21T23:07:31.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:31 smithi151 ceph-mon[95510]: pgmap v1538: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 11 MiB/s wr, 1.21k op/s 2023-07-21T23:07:33.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:33 smithi187 ceph-mon[96918]: pgmap v1539: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.1 MiB/s wr, 945 op/s 2023-07-21T23:07:33.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:33 smithi195 ceph-mon[97365]: pgmap v1539: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.1 MiB/s wr, 945 op/s 2023-07-21T23:07:33.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:33 smithi151 ceph-mon[95510]: pgmap v1539: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.1 MiB/s wr, 945 op/s 2023-07-21T23:07:34.286 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 880.0 s, 356.0 tps, lat 278.469 ms stddev 140.429 2023-07-21T23:07:35.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:35 smithi187 ceph-mon[96918]: pgmap v1540: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 12 MiB/s wr, 1.31k op/s 2023-07-21T23:07:35.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:35 smithi195 ceph-mon[97365]: pgmap v1540: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 12 MiB/s wr, 1.31k op/s 2023-07-21T23:07:35.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:35 smithi151 ceph-mon[95510]: pgmap v1540: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 12 MiB/s wr, 1.31k op/s 2023-07-21T23:07:37.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:37 smithi187 ceph-mon[96918]: pgmap v1541: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 9.4 MiB/s wr, 986 op/s 2023-07-21T23:07:37.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:37 smithi195 ceph-mon[97365]: pgmap v1541: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 9.4 MiB/s wr, 986 op/s 2023-07-21T23:07:37.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:37 smithi151 ceph-mon[95510]: pgmap v1541: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 MiB/s rd, 9.4 MiB/s wr, 986 op/s 2023-07-21T23:07:39.286 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 885.0 s, 363.6 tps, lat 272.375 ms stddev 105.476 2023-07-21T23:07:39.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:39 smithi187 ceph-mon[96918]: pgmap v1542: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.5 MiB/s wr, 1.05k op/s 2023-07-21T23:07:39.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:39 smithi195 ceph-mon[97365]: pgmap v1542: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.5 MiB/s wr, 1.05k op/s 2023-07-21T23:07:39.692 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:39 smithi151 ceph-mon[95510]: pgmap v1542: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 MiB/s rd, 9.5 MiB/s wr, 1.05k op/s 2023-07-21T23:07:40.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.326+0000 7f56937ff700 1 -- 172.21.15.151:0/1858072822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f568c100db0 msgr2=0x7f568c101180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.326+0000 7f56937ff700 1 --2- 172.21.15.151:0/1858072822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f568c100db0 0x7f568c101180 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f5688009990 tx=0x7f5688009ca0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.327+0000 7f56937ff700 1 -- 172.21.15.151:0/1858072822 shutdown_connections 2023-07-21T23:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.327+0000 7f56937ff700 1 --2- 172.21.15.151:0/1858072822 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f568c10a180 0x7f568c10c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.327+0000 7f56937ff700 1 --2- 172.21.15.151:0/1858072822 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f568c100db0 0x7f568c101180 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.327+0000 7f56937ff700 1 --2- 172.21.15.151:0/1858072822 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f568c1016c0 0x7f568c109bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.327+0000 7f56937ff700 1 -- 172.21.15.151:0/1858072822 >> 172.21.15.151:0/1858072822 conn(0x7f568c075bd0 msgr2=0x7f568c075fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:40.360 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.327+0000 7f56937ff700 1 -- 172.21.15.151:0/1858072822 shutdown_connections 2023-07-21T23:07:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.327+0000 7f56937ff700 1 -- 172.21.15.151:0/1858072822 wait complete. 2023-07-21T23:07:40.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.328+0000 7f56937ff700 1 Processor -- start 2023-07-21T23:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.328+0000 7f56937ff700 1 -- start start 2023-07-21T23:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f56937ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f568c100db0 0x7f568c0febe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f56937ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f568c1016c0 0x7f568c0ff120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f56937ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f568c10a180 0x7f568c1a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f56937ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c1a4300 con 0x7f568c1016c0 2023-07-21T23:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f56937ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c1a4440 con 0x7f568c100db0 2023-07-21T23:07:40.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f56937ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568c1a45b0 con 0x7f568c10a180 2023-07-21T23:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f569159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f568c100db0 0x7f568c0febe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f569159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f568c100db0 0x7f568c0febe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55128/0 (socket says 172.21.15.151:55128) 2023-07-21T23:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f569159b700 1 -- 172.21.15.151:0/3234701877 learned_addr learned my addr 172.21.15.151:0/3234701877 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:40.363 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.329+0000 7f5691d9c700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f568c10a180 0x7f568c1a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.330+0000 7f5690d9a700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f568c1016c0 0x7f568c0ff120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.330+0000 7f569159b700 1 -- 172.21.15.151:0/3234701877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f568c10a180 msgr2=0x7f568c1a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.330+0000 7f569159b700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f568c10a180 0x7f568c1a3dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.330+0000 7f569159b700 1 -- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f568c1016c0 msgr2=0x7f568c0ff120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.330+0000 7f569159b700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f568c1016c0 0x7f568c0ff120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.330+0000 7f569159b700 1 -- 172.21.15.151:0/3234701877 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5684009c40 con 0x7f568c100db0 2023-07-21T23:07:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.330+0000 7f569159b700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f568c100db0 0x7f568c0febe0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5688000c00 tx=0x7f5688009570 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.331+0000 7f56827fc700 1 -- 172.21.15.151:0/3234701877 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568801d070 con 0x7f568c100db0 2023-07-21T23:07:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.331+0000 7f56827fc700 1 -- 172.21.15.151:0/3234701877 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5688022470 con 0x7f568c100db0 2023-07-21T23:07:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.331+0000 7f56827fc700 1 -- 172.21.15.151:0/3234701877 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5688017650 con 0x7f568c100db0 2023-07-21T23:07:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.331+0000 7f56937ff700 1 -- 172.21.15.151:0/3234701877 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56880095f0 con 0x7f568c100db0 2023-07-21T23:07:40.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.331+0000 7f56937ff700 1 -- 172.21.15.151:0/3234701877 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c1a4b00 con 0x7f568c100db0 2023-07-21T23:07:40.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.337+0000 7f56827fc700 1 -- 172.21.15.151:0/3234701877 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f568800fb00 con 0x7f568c100db0 2023-07-21T23:07:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.338+0000 7f56a7048b80 1 Processor -- start 2023-07-21T23:07:40.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.338+0000 7f56a7048b80 1 -- start start 2023-07-21T23:07:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794e14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f56a7048b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1793e6c50 con 0x55d17933d6b0 2023-07-21T23:07:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f56a7048b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1794399e0 con 0x55d1794e7210 2023-07-21T23:07:40.372 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f56a7048b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d179432e70 con 0x55d1794e7660 2023-07-21T23:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f569159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f569159b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55138/0 (socket says 172.21.15.151:55138) 2023-07-21T23:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f5690d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794e14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f569159b700 1 -- 172.21.15.151:0/490841516 learned_addr learned my addr 172.21.15.151:0/490841516 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f5691d9c700 1 --2- 172.21.15.151:0/490841516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.339+0000 7f56827fc700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f56780a1410 0x7f56780a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.340+0000 7f56827fc700 1 -- 172.21.15.151:0/3234701877 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f56880ce020 con 0x7f568c100db0 2023-07-21T23:07:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.340+0000 7f569159b700 1 -- 172.21.15.151:0/490841516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 msgr2=0x55d1794e14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.340+0000 7f569159b700 1 --2- 172.21.15.151:0/490841516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794e14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.340+0000 7f569159b700 1 -- 172.21.15.151:0/490841516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 msgr2=0x55d1794e6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.340+0000 7f569159b700 1 --2- 172.21.15.151:0/490841516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.340+0000 7f569159b700 1 -- 172.21.15.151:0/490841516 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d179260d80 con 0x55d1794e7210 2023-07-21T23:07:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.340+0000 7f5691d9c700 1 --2- 172.21.15.151:0/490841516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:07:40.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.340+0000 7f569159b700 1 --2- 172.21.15.151:0/490841516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e0f40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f56880cb7b0 tx=0x7f5688009ca0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1bbb2340c722d1e3 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.340+0000 7f5691d9c700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f56780a1410 0x7f56780a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.341+0000 7f56777fe700 1 -- 172.21.15.151:0/490841516 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56880d1b80 con 0x55d1794e7210 2023-07-21T23:07:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.341+0000 7f56777fe700 1 -- 172.21.15.151:0/490841516 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5688097590 con 0x55d1794e7210 2023-07-21T23:07:40.375 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.341+0000 7f56777fe700 1 -- 172.21.15.151:0/490841516 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f568809b250 con 0x55d1794e7210 2023-07-21T23:07:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.341+0000 7f56a7048b80 1 -- 172.21.15.151:0/490841516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 msgr2=0x55d1794e0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.341+0000 7f5691d9c700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f56780a1410 0x7f56780a38c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5684004a60 tx=0x7f5684004ad0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.341+0000 7f56a7048b80 1 --2- 172.21.15.151:0/490841516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e0f40 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f56880cb7b0 tx=0x7f5688009ca0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.376 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.342+0000 7f56a7048b80 1 -- 172.21.15.151:0/490841516 shutdown_connections 2023-07-21T23:07:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.342+0000 7f56a7048b80 1 --2- 172.21.15.151:0/490841516 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794e14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.342+0000 7f56a7048b80 1 --2- 172.21.15.151:0/490841516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.342+0000 7f56a7048b80 1 --2- 172.21.15.151:0/490841516 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e0f40 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.342+0000 7f56a7048b80 1 -- 172.21.15.151:0/490841516 >> 172.21.15.151:0/490841516 conn(0x55d1794d6ae0 msgr2=0x55d1794dc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.342+0000 7f56a7048b80 1 -- 172.21.15.151:0/490841516 shutdown_connections 2023-07-21T23:07:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.342+0000 7f56a7048b80 1 -- 172.21.15.151:0/490841516 wait complete. 2023-07-21T23:07:40.377 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.343+0000 7f56a7048b80 1 -- start start 2023-07-21T23:07:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.343+0000 7f56a7048b80 1 Processor -- start 2023-07-21T23:07:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.344+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d17933d6b0 0x55d1794f0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.344+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7210 0x55d1794f07d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.344+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1794e7660 0x55d1794ea590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.344+0000 7f56a7048b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1793d2a60 con 0x55d1794e7660 2023-07-21T23:07:40.378 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.344+0000 7f56a7048b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1793d2760 con 0x55d17933d6b0 2023-07-21T23:07:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.344+0000 7f56a7048b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1792b68c0 con 0x55d1794e7210 2023-07-21T23:07:40.379 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.344+0000 7f56a7048b80 10 client.0 _ll_register_callbacks cb 0x55d1793d0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:07:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f5690d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7210 0x55d1794f07d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f5690d9a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7210 0x55d1794f07d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:53154/0 (socket says 172.21.15.151:53154) 2023-07-21T23:07:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f5690d9a700 1 -- 172.21.15.151:0/3539627124 learned_addr learned my addr 172.21.15.151:0/3539627124 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:40.381 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f5691d9c700 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1794e7660 0x55d1794ea590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f569159b700 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d17933d6b0 0x55d1794f0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f5690d9a700 1 -- 172.21.15.151:0/3539627124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d17933d6b0 msgr2=0x55d1794f0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f5690d9a700 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d17933d6b0 0x55d1794f0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f5690d9a700 1 -- 172.21.15.151:0/3539627124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1794e7660 msgr2=0x55d1794ea590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f5690d9a700 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1794e7660 0x55d1794ea590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.345+0000 7f5690d9a700 1 -- 172.21.15.151:0/3539627124 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568400e3f0 con 0x55d1794e7210 2023-07-21T23:07:40.382 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.346+0000 7f5690d9a700 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7210 0x55d1794f07d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f567c013710 tx=0x7f567c013a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=49cce60aaef330d5 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.346+0000 7f5674ff9700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:07:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.346+0000 7f5674ff9700 1 -- 172.21.15.151:0/3539627124 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c004020 con 0x55d1794e7210 2023-07-21T23:07:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.346+0000 7f5674ff9700 1 -- 172.21.15.151:0/3539627124 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f567c004180 con 0x55d1794e7210 2023-07-21T23:07:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.346+0000 7f56a7048b80 1 -- 172.21.15.151:0/3539627124 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d17938c490 con 0x55d1794e7210 2023-07-21T23:07:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.347+0000 7f5674ff9700 1 -- 172.21.15.151:0/3539627124 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f567c004340 con 0x55d1794e7210 2023-07-21T23:07:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.347+0000 7f56a7048b80 10 client.29650 fetch_fsmap learned FSMap version 116 2023-07-21T23:07:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.347+0000 7f56a7048b80 1 -- 172.21.15.151:0/3539627124 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x7f568c1a4b00 con 0x55d1794e7210 2023-07-21T23:07:40.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.347+0000 7f5674ff9700 1 -- 172.21.15.151:0/3539627124 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55d17938c490 con 0x55d1794e7210 2023-07-21T23:07:40.384 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.349+0000 7f5674ff9700 1 -- 172.21.15.151:0/3539627124 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f567c022020 con 0x55d1794e7210 2023-07-21T23:07:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.349+0000 7f56a7048b80 10 client.29650 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:07:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.349+0000 7f56a7048b80 10 client.29650 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:07:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.349+0000 7f56a7048b80 20 client.29650 populate_metadata read hostname 'smithi151' 2023-07-21T23:07:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.349+0000 7f56a7048b80 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d179502ff0 0x55d179505400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.349+0000 7f56a7048b80 4 client.29650 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:07:40.385 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.349+0000 7f56a7048b80 1 -- 172.21.15.151:0/3539627124 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d17942be50 con 0x55d179502ff0 2023-07-21T23:07:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.349+0000 7f569159b700 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d179502ff0 0x55d179505400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.350+0000 7f569159b700 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d179502ff0 0x55d179505400 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49d4be0bb4c02427 server_cookie=c1a6127f757bacd5 in_seq=0 out_seq=0 2023-07-21T23:07:40.386 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.350+0000 7f5674ff9700 10 client.29650 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.351+0000 7f5674ff9700 1 -- 172.21.15.151:0/3539627124 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55d17942be50 con 0x55d179502ff0 2023-07-21T23:07:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.351+0000 7f5674ff9700 10 client.29650 handle_command_reply: tid=0 2023-07-21T23:07:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.351+0000 7f56a7048b80 1 client.29650 shutdown 2023-07-21T23:07:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.351+0000 7f56a7048b80 1 -- 172.21.15.151:0/3539627124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7210 msgr2=0x55d1794f07d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.351+0000 7f56a7048b80 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7210 0x55d1794f07d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f567c013710 tx=0x7f567c013a20 comp rx=0 tx=0).stop 2023-07-21T23:07:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f56a7048b80 1 -- 172.21.15.151:0/3539627124 shutdown_connections 2023-07-21T23:07:40.387 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f56a7048b80 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d179502ff0 0x55d179505400 crc :-1 s=READY pgs=531 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f56a7048b80 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d17933d6b0 0x55d1794f0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f56a7048b80 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d1794e7660 0x55d1794ea590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f56a7048b80 1 --2- 172.21.15.151:0/3539627124 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7210 0x55d1794f07d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.388 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f5674ff9700 0 client.29650 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f56a7048b80 1 -- 172.21.15.151:0/3539627124 >> 172.21.15.151:0/3539627124 conn(0x55d1794d6ae0 msgr2=0x55d1794db3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f56a7048b80 1 -- 172.21.15.151:0/3539627124 shutdown_connections 2023-07-21T23:07:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f56a7048b80 1 -- 172.21.15.151:0/3539627124 wait complete. 2023-07-21T23:07:40.389 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.352+0000 7f56a7048b80 20 client.29650 trim_cache size 0 max 16384 2023-07-21T23:07:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.380+0000 7f56a7048b80 1 Processor -- start 2023-07-21T23:07:40.412 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.380+0000 7f56a7048b80 1 -- start start 2023-07-21T23:07:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.380+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.381+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e9740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.381+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794e3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.381+0000 7f56a7048b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1795006d0 con 0x55d17933d6b0 2023-07-21T23:07:40.413 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.381+0000 7f56a7048b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1794e9cb0 con 0x55d1794e7210 2023-07-21T23:07:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.381+0000 7f56a7048b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1794e6920 con 0x55d1794e7660 2023-07-21T23:07:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.382+0000 7f569159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.382+0000 7f569159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e9200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:49768/0 (socket says 172.21.15.151:49768) 2023-07-21T23:07:40.414 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.382+0000 7f569159b700 1 -- 172.21.15.151:0/362152256 learned_addr learned my addr 172.21.15.151:0/362152256 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.382+0000 7f5690d9a700 1 --2- 172.21.15.151:0/362152256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e9740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.382+0000 7f5691d9c700 1 --2- 172.21.15.151:0/362152256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794e3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.383+0000 7f5690d9a700 1 -- 172.21.15.151:0/362152256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 msgr2=0x55d1794e3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.383+0000 7f5690d9a700 1 --2- 172.21.15.151:0/362152256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794e3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.415 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.383+0000 7f5690d9a700 1 -- 172.21.15.151:0/362152256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 msgr2=0x55d1794e9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.383+0000 7f5690d9a700 1 --2- 172.21.15.151:0/362152256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e9200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.383+0000 7f5690d9a700 1 -- 172.21.15.151:0/362152256 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d179249c00 con 0x55d1794e7210 2023-07-21T23:07:40.416 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.383+0000 7f5690d9a700 1 --2- 172.21.15.151:0/362152256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e9740 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f567c000c00 tx=0x7f567c003ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dab6729d15672add server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.384+0000 7f5677fff700 1 -- 172.21.15.151:0/362152256 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c005d60 con 0x55d1794e7210 2023-07-21T23:07:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.384+0000 7f5677fff700 1 -- 172.21.15.151:0/362152256 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f567c0039f0 con 0x55d1794e7210 2023-07-21T23:07:40.417 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.384+0000 7f5677fff700 1 -- 172.21.15.151:0/362152256 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c005930 con 0x55d1794e7210 2023-07-21T23:07:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.385+0000 7f56a7048b80 1 -- 172.21.15.151:0/362152256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 msgr2=0x55d1794e9740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.385+0000 7f56a7048b80 1 --2- 172.21.15.151:0/362152256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e9740 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f567c000c00 tx=0x7f567c003ce0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.385+0000 7f56a7048b80 1 -- 172.21.15.151:0/362152256 shutdown_connections 2023-07-21T23:07:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.385+0000 7f56a7048b80 1 --2- 172.21.15.151:0/362152256 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794e3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.385+0000 7f56a7048b80 1 --2- 172.21.15.151:0/362152256 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794e9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.385+0000 7f56a7048b80 1 --2- 172.21.15.151:0/362152256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794e9740 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.418 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.385+0000 7f56a7048b80 1 -- 172.21.15.151:0/362152256 >> 172.21.15.151:0/362152256 conn(0x55d1794d6ae0 msgr2=0x55d1794e8af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.385+0000 7f56a7048b80 1 -- 172.21.15.151:0/362152256 shutdown_connections 2023-07-21T23:07:40.419 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.385+0000 7f56a7048b80 1 -- 172.21.15.151:0/362152256 wait complete. 2023-07-21T23:07:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.386+0000 7f56a7048b80 1 -- start start 2023-07-21T23:07:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.386+0000 7f56a7048b80 1 Processor -- start 2023-07-21T23:07:40.420 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.387+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794f0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.387+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794f0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.387+0000 7f56a7048b80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794ee730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.387+0000 7f56a7048b80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1794eee40 con 0x55d17933d6b0 2023-07-21T23:07:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.387+0000 7f56a7048b80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1794eefb0 con 0x55d1794e7210 2023-07-21T23:07:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.387+0000 7f56a7048b80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d1794ef170 con 0x55d1794e7660 2023-07-21T23:07:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.387+0000 7f56a7048b80 10 client.0 _ll_register_callbacks cb 0x7f567c009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:07:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f5690d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794f0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.421 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f569159b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794f0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f5690d9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794f0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:55164/0 (socket says 172.21.15.151:55164) 2023-07-21T23:07:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f5690d9a700 1 -- 172.21.15.151:0/1218326554 learned_addr learned my addr 172.21.15.151:0/1218326554 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f5691d9c700 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794ee730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f5690d9a700 1 -- 172.21.15.151:0/1218326554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 msgr2=0x55d1794ee730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f5690d9a700 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794ee730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f5690d9a700 1 -- 172.21.15.151:0/1218326554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 msgr2=0x55d1794f0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f5690d9a700 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794f0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.422 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.388+0000 7f5690d9a700 1 -- 172.21.15.151:0/1218326554 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568c1a4b00 con 0x55d1794e7210 2023-07-21T23:07:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.389+0000 7f5690d9a700 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794f0740 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55d179432e90 tx=0x7f567c003fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21da8f68a09093bb server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.389+0000 7f5674ff9700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:07:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.389+0000 7f5674ff9700 1 -- 172.21.15.151:0/1218326554 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567c005930 con 0x55d1794e7210 2023-07-21T23:07:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.389+0000 7f56a7048b80 1 -- 172.21.15.151:0/1218326554 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5688097590 con 0x55d1794e7210 2023-07-21T23:07:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.389+0000 7f5674ff9700 1 -- 172.21.15.151:0/1218326554 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f567c000e40 con 0x55d1794e7210 2023-07-21T23:07:40.424 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.389+0000 7f5674ff9700 1 -- 172.21.15.151:0/1218326554 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f567c005d60 con 0x55d1794e7210 2023-07-21T23:07:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.389+0000 7f56a7048b80 10 client.29621 fetch_fsmap learned FSMap version 116 2023-07-21T23:07:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.389+0000 7f56a7048b80 1 -- 172.21.15.151:0/1218326554 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55d1792871f0 con 0x55d1794e7210 2023-07-21T23:07:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.390+0000 7f5674ff9700 1 -- 172.21.15.151:0/1218326554 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5688097590 con 0x55d1794e7210 2023-07-21T23:07:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.390+0000 7f5674ff9700 1 -- 172.21.15.151:0/1218326554 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f567c013740 con 0x55d1794e7210 2023-07-21T23:07:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.390+0000 7f56a7048b80 10 client.29621 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:07:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.390+0000 7f56a7048b80 10 client.29621 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:07:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.390+0000 7f56a7048b80 20 client.29621 populate_metadata read hostname 'smithi151' 2023-07-21T23:07:40.425 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.390+0000 7f56a7048b80 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d179558090 0x55d17955a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.390+0000 7f56a7048b80 4 client.29621 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:07:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.390+0000 7f56a7048b80 1 -- 172.21.15.151:0/1218326554 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55d1793edff0 con 0x55d179558090 2023-07-21T23:07:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.390+0000 7f569159b700 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d179558090 0x55d17955a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.391+0000 7f5674ff9700 10 client.29621 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:40.426 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.391+0000 7f569159b700 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d179558090 0x55d17955a4a0 crc :-1 s=READY pgs=532 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e225556e799e95d server_cookie=8e4d0b5a8f17fbd in_seq=0 out_seq=0 2023-07-21T23:07:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.433+0000 7f5674ff9700 1 -- 172.21.15.151:0/1218326554 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55d1793edff0 con 0x55d179558090 2023-07-21T23:07:40.465 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.433+0000 7f5674ff9700 10 client.29621 handle_command_reply: tid=0 2023-07-21T23:07:40.471 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.438+0000 7f56a7048b80 1 client.29621 shutdown 2023-07-21T23:07:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.439+0000 7f56a7048b80 1 -- 172.21.15.151:0/1218326554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 msgr2=0x55d1794f0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:40.472 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.439+0000 7f56a7048b80 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794f0740 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55d179432e90 tx=0x7f567c003fd0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.440+0000 7f56a7048b80 1 -- 172.21.15.151:0/1218326554 shutdown_connections 2023-07-21T23:07:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.440+0000 7f56a7048b80 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55d179558090 0x55d17955a4a0 crc :-1 s=READY pgs=532 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.440+0000 7f56a7048b80 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55d1794e7660 0x55d1794ee730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.440+0000 7f56a7048b80 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55d17933d6b0 0x55d1794f0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.440+0000 7f56a7048b80 1 --2- 172.21.15.151:0/1218326554 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d1794e7210 0x55d1794f0740 secure :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0x55d179432e90 tx=0x7f567c003fd0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.473 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.440+0000 7f56a7048b80 1 -- 172.21.15.151:0/1218326554 >> 172.21.15.151:0/1218326554 conn(0x55d1794d6ae0 msgr2=0x55d1794ea500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.441+0000 7f5674ff9700 0 client.29621 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.441+0000 7f56a7048b80 1 -- 172.21.15.151:0/1218326554 shutdown_connections 2023-07-21T23:07:40.474 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.441+0000 7f56a7048b80 1 -- 172.21.15.151:0/1218326554 wait complete. 2023-07-21T23:07:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.444+0000 7f56a7048b80 20 client.29621 trim_cache size 0 max 16384 2023-07-21T23:07:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:07:40.476 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:07:40.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:07:40.477 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:07:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 -- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f56780a1410 msgr2=0x7f56780a38c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f56780a1410 0x7f56780a38c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5684004a60 tx=0x7f5684004ad0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 -- 172.21.15.151:0/3234701877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f568c100db0 msgr2=0x7f568c0febe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f568c100db0 0x7f568c0febe0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f5688000c00 tx=0x7f5688009570 comp rx=0 tx=0).stop 2023-07-21T23:07:40.492 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 -- 172.21.15.151:0/3234701877 shutdown_connections 2023-07-21T23:07:40.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f56780a1410 0x7f56780a38c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f568c100db0 0x7f568c0febe0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f568c10a180 0x7f568c1a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 --2- 172.21.15.151:0/3234701877 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f568c1016c0 0x7f568c0ff120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:40.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.459+0000 7f56937ff700 1 -- 172.21.15.151:0/3234701877 >> 172.21.15.151:0/3234701877 conn(0x7f568c075bd0 msgr2=0x7f568c10a630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:40.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.460+0000 7f56937ff700 1 -- 172.21.15.151:0/3234701877 shutdown_connections 2023-07-21T23:07:40.493 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:40.460+0000 7f56937ff700 1 -- 172.21.15.151:0/3234701877 wait complete. 2023-07-21T23:07:40.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:40 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:07:40.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:40 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:07:40.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:40 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:07:41.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:41 smithi187 ceph-mon[96918]: pgmap v1543: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:07:41.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:41 smithi195 ceph-mon[97365]: pgmap v1543: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:07:41.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:41 smithi151 ceph-mon[95510]: pgmap v1543: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 MiB/s rd, 13 MiB/s wr, 1.35k op/s 2023-07-21T23:07:43.442 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:43 smithi151 ceph-mon[95510]: pgmap v1544: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.9 MiB/s wr, 1.03k op/s 2023-07-21T23:07:43.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:43 smithi187 ceph-mon[96918]: pgmap v1544: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.9 MiB/s wr, 1.03k op/s 2023-07-21T23:07:43.651 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:43 smithi195 ceph-mon[97365]: pgmap v1544: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.3 MiB/s rd, 9.9 MiB/s wr, 1.03k op/s 2023-07-21T23:07:44.286 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 890.0 s, 329.6 tps, lat 305.154 ms stddev 104.658 2023-07-21T23:07:44.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:44 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:07:44.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:44 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:07:44.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:44 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:07:44.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:44 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:07:44.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:44 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:07:44.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:44 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:07:44.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:44 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:07:44.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:44 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:07:44.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:44 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:07:45.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:45 smithi187 ceph-mon[96918]: pgmap v1545: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-21T23:07:45.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:45 smithi195 ceph-mon[97365]: pgmap v1545: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-21T23:07:45.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:45 smithi151 ceph-mon[95510]: pgmap v1545: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 MiB/s rd, 13 MiB/s wr, 1.39k op/s 2023-07-21T23:07:47.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:47 smithi187 ceph-mon[96918]: pgmap v1546: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.8 MiB/s wr, 994 op/s 2023-07-21T23:07:47.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:47 smithi195 ceph-mon[97365]: pgmap v1546: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.8 MiB/s wr, 994 op/s 2023-07-21T23:07:47.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:47 smithi151 ceph-mon[95510]: pgmap v1546: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.8 MiB/s wr, 994 op/s 2023-07-21T23:07:49.289 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 895.0 s, 380.6 tps, lat 264.504 ms stddev 61.815 2023-07-21T23:07:49.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:49 smithi187 ceph-mon[96918]: pgmap v1547: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 1.08k op/s 2023-07-21T23:07:49.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:49 smithi195 ceph-mon[97365]: pgmap v1547: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 1.08k op/s 2023-07-21T23:07:49.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:49 smithi151 ceph-mon[95510]: pgmap v1547: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 MiB/s rd, 9.8 MiB/s wr, 1.08k op/s 2023-07-21T23:07:51.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:51 smithi187 ceph-mon[96918]: pgmap v1548: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-21T23:07:51.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:51 smithi195 ceph-mon[97365]: pgmap v1548: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-21T23:07:51.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:51 smithi151 ceph-mon[95510]: pgmap v1548: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 13 MiB/s wr, 1.38k op/s 2023-07-21T23:07:53.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:53 smithi187 ceph-mon[96918]: pgmap v1549: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.0 MiB/s wr, 1.02k op/s 2023-07-21T23:07:53.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:53 smithi195 ceph-mon[97365]: pgmap v1549: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.0 MiB/s wr, 1.02k op/s 2023-07-21T23:07:53.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:53 smithi151 ceph-mon[95510]: pgmap v1549: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 MiB/s rd, 9.0 MiB/s wr, 1.02k op/s 2023-07-21T23:07:53.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.724+0000 7fde5e7ff700 1 -- 172.21.15.151:0/1010987360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde58106ff0 msgr2=0x7fde5810ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.724+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/1010987360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde58106ff0 0x7fde5810ebc0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fde500098f0 tx=0x7fde50009c00 comp rx=0 tx=0).stop 2023-07-21T23:07:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.724+0000 7fde5e7ff700 1 -- 172.21.15.151:0/1010987360 shutdown_connections 2023-07-21T23:07:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.724+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/1010987360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde58106ff0 0x7fde5810ebc0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.724+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/1010987360 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde58101fb0 0x7fde58102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.724+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/1010987360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde58102950 0x7fde58106910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.724+0000 7fde5e7ff700 1 -- 172.21.15.151:0/1010987360 >> 172.21.15.151:0/1010987360 conn(0x7fde580fd800 msgr2=0x7fde580ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.724+0000 7fde5e7ff700 1 -- 172.21.15.151:0/1010987360 shutdown_connections 2023-07-21T23:07:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.725+0000 7fde5e7ff700 1 -- 172.21.15.151:0/1010987360 wait complete. 2023-07-21T23:07:53.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.726+0000 7fde5e7ff700 1 Processor -- start 2023-07-21T23:07:53.759 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.726+0000 7fde5e7ff700 1 -- start start 2023-07-21T23:07:53.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.727+0000 7fde5e7ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde58101fb0 0x7fde5810e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.727+0000 7fde5e7ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde58102950 0x7fde5810b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.727+0000 7fde5e7ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde58106ff0 0x7fde5810bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.727+0000 7fde5e7ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5810c210 con 0x7fde58101fb0 2023-07-21T23:07:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.727+0000 7fde5e7ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5810c380 con 0x7fde58106ff0 2023-07-21T23:07:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.727+0000 7fde5e7ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5810c540 con 0x7fde58102950 2023-07-21T23:07:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde4f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde58102950 0x7fde5810b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde4f7fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde58102950 0x7fde5810b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43564/0 (socket says 172.21.15.151:43564) 2023-07-21T23:07:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde4f7fe700 1 -- 172.21.15.151:0/712648529 learned_addr learned my addr 172.21.15.151:0/712648529 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde57fff700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde58101fb0 0x7fde5810e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde5cd9c700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde58106ff0 0x7fde5810bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde4f7fe700 1 -- 172.21.15.151:0/712648529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde58106ff0 msgr2=0x7fde5810bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde58106ff0 0x7fde5810bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde4f7fe700 1 -- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde58101fb0 msgr2=0x7fde5810e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde58101fb0 0x7fde5810e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.728+0000 7fde4f7fe700 1 -- 172.21.15.151:0/712648529 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40009520 con 0x7fde58102950 2023-07-21T23:07:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.729+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde58102950 0x7fde5810b670 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fde40009fd0 tx=0x7fde4000ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:53.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.730+0000 7fde55ffb700 1 -- 172.21.15.151:0/712648529 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4000cbd0 con 0x7fde58102950 2023-07-21T23:07:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.730+0000 7fde55ffb700 1 -- 172.21.15.151:0/712648529 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde4000eea0 con 0x7fde58102950 2023-07-21T23:07:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.730+0000 7fde55ffb700 1 -- 172.21.15.151:0/712648529 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde40003c40 con 0x7fde58102950 2023-07-21T23:07:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.730+0000 7fde5e7ff700 1 -- 172.21.15.151:0/712648529 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde50009520 con 0x7fde58102950 2023-07-21T23:07:53.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.730+0000 7fde5e7ff700 1 -- 172.21.15.151:0/712648529 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde581a8f30 con 0x7fde58102950 2023-07-21T23:07:53.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.736+0000 7fde55ffb700 1 -- 172.21.15.151:0/712648529 <== mon.1 v2:172.21.15.195:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fde40018430 con 0x7fde58102950 2023-07-21T23:07:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.738+0000 7fde7206ab80 1 Processor -- start 2023-07-21T23:07:53.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.739+0000 7fde7206ab80 1 -- start start 2023-07-21T23:07:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1e9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea210 0x557dcc1e3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1e44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.772 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde7206ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc0e9c50 con 0x557dcc0406b0 2023-07-21T23:07:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde7206ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc13c9e0 con 0x557dcc1ea660 2023-07-21T23:07:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde7206ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc135e70 con 0x557dcc1ea210 2023-07-21T23:07:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde55ffb700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde440a1490 0x7fde440a3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.773 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde5cd9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1e9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde5cd9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1e9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35396/0 (socket says 172.21.15.151:35396) 2023-07-21T23:07:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde5cd9c700 1 -- 172.21.15.151:0/2560355917 learned_addr learned my addr 172.21.15.151:0/2560355917 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/2560355917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1e44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.740+0000 7fde57fff700 1 --2- 172.21.15.151:0/2560355917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea210 0x557dcc1e3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.741+0000 7fde5cd9c700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde440a1490 0x7fde440a3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.774 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.741+0000 7fde4f7fe700 1 -- 172.21.15.151:0/2560355917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea210 msgr2=0x557dcc1e3f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.741+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/2560355917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea210 0x557dcc1e3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.741+0000 7fde4f7fe700 1 -- 172.21.15.151:0/2560355917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 msgr2=0x557dcc1e9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.741+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/2560355917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1e9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.741+0000 7fde4f7fe700 1 -- 172.21.15.151:0/2560355917 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dcbf63d80 con 0x557dcc1ea660 2023-07-21T23:07:53.775 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.741+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/2560355917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1e44a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fde400cb410 tx=0x7fde40014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db4a1f7e5190966 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.742+0000 7fde4e7fc700 1 -- 172.21.15.151:0/2560355917 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde400d5070 con 0x557dcc1ea660 2023-07-21T23:07:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.742+0000 7fde4e7fc700 1 -- 172.21.15.151:0/2560355917 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde4009edc0 con 0x557dcc1ea660 2023-07-21T23:07:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.742+0000 7fde4e7fc700 1 -- 172.21.15.151:0/2560355917 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4009f280 con 0x557dcc1ea660 2023-07-21T23:07:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.743+0000 7fde7206ab80 1 -- 172.21.15.151:0/2560355917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 msgr2=0x557dcc1e44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:53.776 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.743+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2560355917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1e44a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fde400cb410 tx=0x7fde40014000 comp rx=0 tx=0).stop 2023-07-21T23:07:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.743+0000 7fde55ffb700 1 -- 172.21.15.151:0/712648529 <== mon.1 v2:172.21.15.195:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fde40014070 con 0x7fde58102950 2023-07-21T23:07:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.743+0000 7fde5cd9c700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde440a1490 0x7fde440a3940 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c010 tx=0x7fde50005dc0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.744+0000 7fde7206ab80 1 -- 172.21.15.151:0/2560355917 shutdown_connections 2023-07-21T23:07:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.744+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2560355917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1e44a0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.744+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2560355917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1e9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.744+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2560355917 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea210 0x557dcc1e3f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.777 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.744+0000 7fde7206ab80 1 -- 172.21.15.151:0/2560355917 >> 172.21.15.151:0/2560355917 conn(0x557dcc1d9ae0 msgr2=0x557dcc1df0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.744+0000 7fde7206ab80 1 -- 172.21.15.151:0/2560355917 shutdown_connections 2023-07-21T23:07:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.744+0000 7fde7206ab80 1 -- 172.21.15.151:0/2560355917 wait complete. 2023-07-21T23:07:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.745+0000 7fde7206ab80 1 -- start start 2023-07-21T23:07:53.778 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.745+0000 7fde7206ab80 1 Processor -- start 2023-07-21T23:07:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 0x557dcc1ed800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1ede80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde7206ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc0d5a60 con 0x557dcc1ea210 2023-07-21T23:07:53.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde7206ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc0d5760 con 0x557dcc1ea660 2023-07-21T23:07:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde7206ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcbfb98c0 con 0x557dcc0406b0 2023-07-21T23:07:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde7206ab80 10 client.0 _ll_register_callbacks cb 0x557dcc0d3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:07:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde57fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde5cd9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1ede80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde57fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43594/0 (socket says 172.21.15.151:43594) 2023-07-21T23:07:53.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.746+0000 7fde57fff700 1 -- 172.21.15.151:0/2860295290 learned_addr learned my addr 172.21.15.151:0/2860295290 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.747+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 0x557dcc1ed800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.747+0000 7fde57fff700 1 -- 172.21.15.151:0/2860295290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 msgr2=0x557dcc1ede80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:53.781 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.747+0000 7fde57fff700 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1ede80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.747+0000 7fde57fff700 1 -- 172.21.15.151:0/2860295290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 msgr2=0x557dcc1ed800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.747+0000 7fde57fff700 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 0x557dcc1ed800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.747+0000 7fde57fff700 1 -- 172.21.15.151:0/2860295290 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde581a8f30 con 0x557dcc0406b0 2023-07-21T23:07:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.748+0000 7fde57fff700 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f0580 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fde48007bb0 tx=0x7fde48007ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4acc82e3c6199395 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.748+0000 7fde377fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:07:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.749+0000 7fde377fe700 1 -- 172.21.15.151:0/2860295290 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800e040 con 0x557dcc0406b0 2023-07-21T23:07:53.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.749+0000 7fde377fe700 1 -- 172.21.15.151:0/2860295290 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fde48012ac0 con 0x557dcc0406b0 2023-07-21T23:07:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.749+0000 7fde7206ab80 1 -- 172.21.15.151:0/2860295290 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557dcc08f490 con 0x557dcc0406b0 2023-07-21T23:07:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.750+0000 7fde377fe700 1 -- 172.21.15.151:0/2860295290 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde48012c80 con 0x557dcc0406b0 2023-07-21T23:07:53.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.750+0000 7fde7206ab80 10 client.29665 fetch_fsmap learned FSMap version 116 2023-07-21T23:07:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.750+0000 7fde7206ab80 1 -- 172.21.15.151:0/2860295290 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x557dcbf4cc00 con 0x557dcc0406b0 2023-07-21T23:07:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.751+0000 7fde377fe700 1 -- 172.21.15.151:0/2860295290 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x557dcc08f490 con 0x557dcc0406b0 2023-07-21T23:07:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.751+0000 7fde377fe700 1 -- 172.21.15.151:0/2860295290 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fde48014040 con 0x557dcc0406b0 2023-07-21T23:07:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.751+0000 7fde7206ab80 10 client.29665 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:07:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.751+0000 7fde7206ab80 10 client.29665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:07:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.751+0000 7fde7206ab80 20 client.29665 populate_metadata read hostname 'smithi151' 2023-07-21T23:07:53.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.751+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557dcc1fdb50 0x557dcc1fff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.751+0000 7fde7206ab80 4 client.29665 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:07:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.751+0000 7fde7206ab80 1 -- 172.21.15.151:0/2860295290 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557dcc12ee50 con 0x557dcc1fdb50 2023-07-21T23:07:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.752+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557dcc1fdb50 0x557dcc1fff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.753+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557dcc1fdb50 0x557dcc1fff60 crc :-1 s=READY pgs=533 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83df6672f0028768 server_cookie=7f0191ef8423c9e6 in_seq=0 out_seq=0 2023-07-21T23:07:53.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.753+0000 7fde377fe700 10 client.29665 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.754+0000 7fde377fe700 1 -- 172.21.15.151:0/2860295290 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x557dcc12ee50 con 0x557dcc1fdb50 2023-07-21T23:07:53.786 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.754+0000 7fde377fe700 10 client.29665 handle_command_reply: tid=0 2023-07-21T23:07:53.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.755+0000 7fde7206ab80 1 client.29665 shutdown 2023-07-21T23:07:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.756+0000 7fde7206ab80 1 -- 172.21.15.151:0/2860295290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 msgr2=0x557dcc1f0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:53.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.756+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f0580 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fde48007bb0 tx=0x7fde48007ec0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.758+0000 7fde7206ab80 1 -- 172.21.15.151:0/2860295290 shutdown_connections 2023-07-21T23:07:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.758+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557dcc1fdb50 0x557dcc1fff60 crc :-1 s=READY pgs=533 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.758+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1ede80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.758+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f0580 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.758+0000 7fde7206ab80 1 --2- 172.21.15.151:0/2860295290 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 0x557dcc1ed800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.758+0000 7fde7206ab80 1 -- 172.21.15.151:0/2860295290 >> 172.21.15.151:0/2860295290 conn(0x557dcc1d9ae0 msgr2=0x557dcc1de3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:53.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.758+0000 7fde377fe700 0 client.29665 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.764+0000 7fde7206ab80 1 -- 172.21.15.151:0/2860295290 shutdown_connections 2023-07-21T23:07:53.796 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.764+0000 7fde7206ab80 1 -- 172.21.15.151:0/2860295290 wait complete. 2023-07-21T23:07:53.799 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.766+0000 7fde7206ab80 20 client.29665 trim_cache size 0 max 16384 2023-07-21T23:07:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.791+0000 7fde7206ab80 1 Processor -- start 2023-07-21T23:07:53.823 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.791+0000 7fde7206ab80 1 -- start start 2023-07-21T23:07:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.791+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.824 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.791+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 0x557dcc1eb140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.791+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1f0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.791+0000 7fde7206ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc1e5160 con 0x557dcc1ea210 2023-07-21T23:07:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.791+0000 7fde7206ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc1e0900 con 0x557dcc1ea660 2023-07-21T23:07:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.791+0000 7fde7206ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc1e8440 con 0x557dcc0406b0 2023-07-21T23:07:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.792+0000 7fde57fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.792+0000 7fde57fff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:43606/0 (socket says 172.21.15.151:43606) 2023-07-21T23:07:53.825 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.792+0000 7fde57fff700 1 -- 172.21.15.151:0/1373861409 learned_addr learned my addr 172.21.15.151:0/1373861409 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:53.826 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.792+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/1373861409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 0x557dcc1eb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.792+0000 7fde5cd9c700 1 --2- 172.21.15.151:0/1373861409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1f0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.793+0000 7fde57fff700 1 -- 172.21.15.151:0/1373861409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 msgr2=0x557dcc1f0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.793+0000 7fde57fff700 1 --2- 172.21.15.151:0/1373861409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1f0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.793+0000 7fde57fff700 1 -- 172.21.15.151:0/1373861409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 msgr2=0x557dcc1eb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.793+0000 7fde57fff700 1 --2- 172.21.15.151:0/1373861409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 0x557dcc1eb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.827 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.793+0000 7fde57fff700 1 -- 172.21.15.151:0/1373861409 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557dcbf8a1f0 con 0x557dcc0406b0 2023-07-21T23:07:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.793+0000 7fde57fff700 1 --2- 172.21.15.151:0/1373861409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f4b80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fde4800afe0 tx=0x7fde48016610 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52ff705ab456670a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.793+0000 7fde4effd700 1 -- 172.21.15.151:0/1373861409 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4800e040 con 0x557dcc0406b0 2023-07-21T23:07:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.793+0000 7fde4effd700 1 -- 172.21.15.151:0/1373861409 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde4800f040 con 0x557dcc0406b0 2023-07-21T23:07:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.793+0000 7fde4effd700 1 -- 172.21.15.151:0/1373861409 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48016e40 con 0x557dcc0406b0 2023-07-21T23:07:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.794+0000 7fde7206ab80 1 -- 172.21.15.151:0/1373861409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 msgr2=0x557dcc1f4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.794+0000 7fde7206ab80 1 --2- 172.21.15.151:0/1373861409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f4b80 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fde4800afe0 tx=0x7fde48016610 comp rx=0 tx=0).stop 2023-07-21T23:07:53.828 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.794+0000 7fde7206ab80 1 -- 172.21.15.151:0/1373861409 shutdown_connections 2023-07-21T23:07:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.794+0000 7fde7206ab80 1 --2- 172.21.15.151:0/1373861409 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea660 0x557dcc1f0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.794+0000 7fde7206ab80 1 --2- 172.21.15.151:0/1373861409 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc0406b0 0x557dcc1f4b80 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.794+0000 7fde7206ab80 1 --2- 172.21.15.151:0/1373861409 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc1ea210 0x557dcc1eb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.794+0000 7fde7206ab80 1 -- 172.21.15.151:0/1373861409 >> 172.21.15.151:0/1373861409 conn(0x557dcc1d9ae0 msgr2=0x557dcc1eaa30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.795+0000 7fde7206ab80 1 -- 172.21.15.151:0/1373861409 shutdown_connections 2023-07-21T23:07:53.829 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.795+0000 7fde7206ab80 1 -- 172.21.15.151:0/1373861409 wait complete. 2023-07-21T23:07:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.795+0000 7fde7206ab80 1 -- start start 2023-07-21T23:07:53.830 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.795+0000 7fde7206ab80 1 Processor -- start 2023-07-21T23:07:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.796+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1ed430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.796+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea210 0x557dcc1ebfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.796+0000 7fde7206ab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea660 0x557dcc1ec4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.796+0000 7fde7206ab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc1edd40 con 0x557dcc0406b0 2023-07-21T23:07:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.796+0000 7fde7206ab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc1eca30 con 0x557dcc1ea210 2023-07-21T23:07:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.796+0000 7fde7206ab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x557dcc1ecbf0 con 0x557dcc1ea660 2023-07-21T23:07:53.831 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.796+0000 7fde7206ab80 10 client.0 _ll_register_callbacks cb 0x557dcc0d3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:07:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.797+0000 7fde57fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1ed430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.797+0000 7fde57fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1ed430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:35420/0 (socket says 172.21.15.151:35420) 2023-07-21T23:07:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.797+0000 7fde57fff700 1 -- 172.21.15.151:0/91727841 learned_addr learned my addr 172.21.15.151:0/91727841 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:07:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.797+0000 7fde5cd9c700 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea660 0x557dcc1ec4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.798+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea210 0x557dcc1ebfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.798+0000 7fde57fff700 1 -- 172.21.15.151:0/91727841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea660 msgr2=0x557dcc1ec4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:53.832 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.798+0000 7fde57fff700 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea660 0x557dcc1ec4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.798+0000 7fde57fff700 1 -- 172.21.15.151:0/91727841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea210 msgr2=0x557dcc1ebfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:07:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.798+0000 7fde57fff700 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea210 0x557dcc1ebfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.833 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.798+0000 7fde57fff700 1 -- 172.21.15.151:0/91727841 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557dcbf4cc00 con 0x557dcc0406b0 2023-07-21T23:07:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.799+0000 7fde57fff700 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1ed430 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fde48007bb0 tx=0x7fde48007520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd994d0cc0c0bc6e server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:07:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.799+0000 7fde377fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:07:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.799+0000 7fde377fe700 1 -- 172.21.15.151:0/91727841 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde48016db0 con 0x557dcc0406b0 2023-07-21T23:07:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.799+0000 7fde377fe700 1 -- 172.21.15.151:0/91727841 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(173..173 src has 1..173) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fde48009a50 con 0x557dcc0406b0 2023-07-21T23:07:53.834 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.799+0000 7fde7206ab80 1 -- 172.21.15.151:0/91727841 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fde4009edc0 con 0x557dcc0406b0 2023-07-21T23:07:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.800+0000 7fde377fe700 1 -- 172.21.15.151:0/91727841 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde480128c0 con 0x557dcc0406b0 2023-07-21T23:07:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.800+0000 7fde7206ab80 10 client.19986 fetch_fsmap learned FSMap version 116 2023-07-21T23:07:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.800+0000 7fde7206ab80 1 -- 172.21.15.151:0/91727841 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x557dcbf62250 con 0x557dcc0406b0 2023-07-21T23:07:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.801+0000 7fde377fe700 1 -- 172.21.15.151:0/91727841 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fde4009edc0 con 0x557dcc0406b0 2023-07-21T23:07:53.835 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.802+0000 7fde377fe700 1 -- 172.21.15.151:0/91727841 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fde48014070 con 0x557dcc0406b0 2023-07-21T23:07:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.802+0000 7fde7206ab80 10 client.19986 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:07:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.802+0000 7fde7206ab80 10 client.19986 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:07:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.802+0000 7fde7206ab80 20 client.19986 populate_metadata read hostname 'smithi151' 2023-07-21T23:07:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.802+0000 7fde7206ab80 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557dcc252800 0x557dcc254be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:07:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.802+0000 7fde7206ab80 4 client.19986 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:07:53.836 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.802+0000 7fde7206ab80 1 -- 172.21.15.151:0/91727841 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x557dcc0f0ff0 con 0x557dcc252800 2023-07-21T23:07:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.803+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557dcc252800 0x557dcc254be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:07:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.804+0000 7fde4f7fe700 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557dcc252800 0x557dcc254be0 crc :-1 s=READY pgs=534 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46de1e8525d430bc server_cookie=9ab491c01eca0d61 in_seq=0 out_seq=0 2023-07-21T23:07:53.837 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.804+0000 7fde377fe700 10 client.19986 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.833+0000 7fde377fe700 1 -- 172.21.15.151:0/91727841 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x557dcc0f0ff0 con 0x557dcc252800 2023-07-21T23:07:53.865 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.833+0000 7fde377fe700 10 client.19986 handle_command_reply: tid=0 2023-07-21T23:07:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.833+0000 7fde7206ab80 1 client.19986 shutdown 2023-07-21T23:07:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.833+0000 7fde7206ab80 1 -- 172.21.15.151:0/91727841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 msgr2=0x557dcc1ed430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:53.866 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.833+0000 7fde7206ab80 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1ed430 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fde48007bb0 tx=0x7fde48007520 comp rx=0 tx=0).stop 2023-07-21T23:07:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.834+0000 7fde7206ab80 1 -- 172.21.15.151:0/91727841 shutdown_connections 2023-07-21T23:07:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.834+0000 7fde7206ab80 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x557dcc252800 0x557dcc254be0 crc :-1 s=READY pgs=534 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.834+0000 7fde7206ab80 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x557dcc1ea660 0x557dcc1ec4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.834+0000 7fde7206ab80 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557dcc0406b0 0x557dcc1ed430 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.834+0000 7fde7206ab80 1 --2- 172.21.15.151:0/91727841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x557dcc1ea210 0x557dcc1ebfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.867 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.834+0000 7fde7206ab80 1 -- 172.21.15.151:0/91727841 >> 172.21.15.151:0/91727841 conn(0x557dcc1d9ae0 msgr2=0x557dcc1eb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.834+0000 7fde377fe700 0 client.19986 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:07:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.834+0000 7fde7206ab80 1 -- 172.21.15.151:0/91727841 shutdown_connections 2023-07-21T23:07:53.868 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.834+0000 7fde7206ab80 1 -- 172.21.15.151:0/91727841 wait complete. 2023-07-21T23:07:53.870 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.838+0000 7fde7206ab80 20 client.19986 trim_cache size 0 max 16384 2023-07-21T23:07:53.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:07:53.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:07:53.871 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:07:53.872 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:07:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.849+0000 7fde5e7ff700 1 -- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde440a1490 msgr2=0x7fde440a3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.849+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde440a1490 0x7fde440a3940 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fde5000c010 tx=0x7fde50005dc0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.849+0000 7fde5e7ff700 1 -- 172.21.15.151:0/712648529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde58102950 msgr2=0x7fde5810b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:07:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.849+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde58102950 0x7fde5810b670 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fde40009fd0 tx=0x7fde4000ed10 comp rx=0 tx=0).stop 2023-07-21T23:07:53.883 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.850+0000 7fde5e7ff700 1 -- 172.21.15.151:0/712648529 shutdown_connections 2023-07-21T23:07:53.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.850+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fde440a1490 0x7fde440a3940 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.850+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde58106ff0 0x7fde5810bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.850+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fde58101fb0 0x7fde5810e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:07:53.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.850+0000 7fde5e7ff700 1 --2- 172.21.15.151:0/712648529 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fde58102950 0x7fde5810b670 secure :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fde40009fd0 tx=0x7fde4000ed10 comp rx=0 tx=0).stop 2023-07-21T23:07:53.884 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.850+0000 7fde5e7ff700 1 -- 172.21.15.151:0/712648529 >> 172.21.15.151:0/712648529 conn(0x7fde580fd800 msgr2=0x7fde580fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:07:53.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.850+0000 7fde5e7ff700 1 -- 172.21.15.151:0/712648529 shutdown_connections 2023-07-21T23:07:53.885 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:07:53.851+0000 7fde5e7ff700 1 -- 172.21.15.151:0/712648529 wait complete. 2023-07-21T23:07:54.286 INFO:teuthology.orchestra.run.smithi151.stderr:progress: 900.0 s, 371.8 tps, lat 268.664 ms stddev 75.491 2023-07-21T23:07:54.749 INFO:teuthology.orchestra.run.smithi151.stdout:transaction type: 2023-07-21T23:07:54.750 INFO:teuthology.orchestra.run.smithi151.stdout:scaling factor: 500 2023-07-21T23:07:54.750 INFO:teuthology.orchestra.run.smithi151.stdout:query mode: simple 2023-07-21T23:07:54.750 INFO:teuthology.orchestra.run.smithi151.stdout:number of clients: 100 2023-07-21T23:07:54.750 INFO:teuthology.orchestra.run.smithi151.stdout:number of threads: 4 2023-07-21T23:07:54.750 INFO:teuthology.orchestra.run.smithi151.stdout:duration: 900 s 2023-07-21T23:07:54.750 INFO:teuthology.orchestra.run.smithi151.stdout:number of transactions actually processed: 275807 2023-07-21T23:07:54.750 INFO:teuthology.orchestra.run.smithi151.stdout:latency average = 326.237 ms 2023-07-21T23:07:54.751 INFO:teuthology.orchestra.run.smithi151.stdout:latency stddev = 373.465 ms 2023-07-21T23:07:54.751 INFO:teuthology.orchestra.run.smithi151.stdout:tps = 306.298870 (including connections establishing) 2023-07-21T23:07:54.751 INFO:teuthology.orchestra.run.smithi151.stdout:tps = 306.304962 (excluding connections establishing) 2023-07-21T23:07:54.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2023-07-21T23:07:55.438 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:55 smithi151 ceph-mon[95510]: pgmap v1550: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2023-07-21T23:07:55.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:55 smithi187 ceph-mon[96918]: pgmap v1550: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2023-07-21T23:07:55.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:55 smithi195 ceph-mon[97365]: pgmap v1550: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 MiB/s rd, 12 MiB/s wr, 1.40k op/s 2023-07-21T23:07:57.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:57 smithi187 ceph-mon[96918]: pgmap v1551: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.9 MiB/s wr, 1.01k op/s 2023-07-21T23:07:57.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:57 smithi195 ceph-mon[97365]: pgmap v1551: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.9 MiB/s wr, 1.01k op/s 2023-07-21T23:07:57.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:57 smithi151 ceph-mon[95510]: pgmap v1551: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 8.9 MiB/s wr, 1.01k op/s 2023-07-21T23:07:59.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:07:59 smithi187 ceph-mon[96918]: pgmap v1552: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.8 MiB/s wr, 1.12k op/s 2023-07-21T23:07:59.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:07:59 smithi195 ceph-mon[97365]: pgmap v1552: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.8 MiB/s wr, 1.12k op/s 2023-07-21T23:07:59.688 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:07:59 smithi151 ceph-mon[95510]: pgmap v1552: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.8 MiB/s wr, 1.12k op/s 2023-07-21T23:08:01.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:01 smithi187 ceph-mon[96918]: pgmap v1553: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 11 MiB/s wr, 1.34k op/s 2023-07-21T23:08:01.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:01 smithi195 ceph-mon[97365]: pgmap v1553: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 11 MiB/s wr, 1.34k op/s 2023-07-21T23:08:01.688 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:01 smithi151 ceph-mon[95510]: pgmap v1553: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 MiB/s rd, 11 MiB/s wr, 1.34k op/s 2023-07-21T23:08:03.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:03 smithi187 ceph-mon[96918]: pgmap v1554: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.6 MiB/s wr, 1.01k op/s 2023-07-21T23:08:03.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:03 smithi195 ceph-mon[97365]: pgmap v1554: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.6 MiB/s wr, 1.01k op/s 2023-07-21T23:08:03.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:03 smithi151 ceph-mon[95510]: pgmap v1554: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 8.6 MiB/s wr, 1.01k op/s 2023-07-21T23:08:05.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:05 smithi187 ceph-mon[96918]: pgmap v1555: 97 pgs: 97 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.58k op/s 2023-07-21T23:08:05.619 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:05 smithi187 ceph-mon[96918]: osdmap e174: 12 total, 12 up, 12 in 2023-07-21T23:08:05.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:05 smithi195 ceph-mon[97365]: pgmap v1555: 97 pgs: 97 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.58k op/s 2023-07-21T23:08:05.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:05 smithi195 ceph-mon[97365]: osdmap e174: 12 total, 12 up, 12 in 2023-07-21T23:08:05.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:05 smithi151 ceph-mon[95510]: pgmap v1555: 97 pgs: 97 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 13 MiB/s wr, 1.58k op/s 2023-07-21T23:08:05.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:05 smithi151 ceph-mon[95510]: osdmap e174: 12 total, 12 up, 12 in 2023-07-21T23:08:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.144+0000 7f695a5ff700 1 -- 172.21.15.151:0/806325984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f695406c910 msgr2=0x7f695406cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:07.176 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.144+0000 7f695a5ff700 1 --2- 172.21.15.151:0/806325984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f695406c910 0x7f695406cd80 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f69480098f0 tx=0x7f6948009c00 comp rx=0 tx=0).stop 2023-07-21T23:08:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.157+0000 7f695a5ff700 1 -- 172.21.15.151:0/806325984 shutdown_connections 2023-07-21T23:08:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.157+0000 7f695a5ff700 1 --2- 172.21.15.151:0/806325984 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f695406d3a0 0x7f695411b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.192 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.157+0000 7f695a5ff700 1 --2- 172.21.15.151:0/806325984 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f695410e2a0 0x7f695410e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.157+0000 7f695a5ff700 1 --2- 172.21.15.151:0/806325984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f695406c910 0x7f695406cd80 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.157+0000 7f695a5ff700 1 -- 172.21.15.151:0/806325984 >> 172.21.15.151:0/806325984 conn(0x7f695406bd70 msgr2=0x7f6954070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.158+0000 7f695a5ff700 1 -- 172.21.15.151:0/806325984 shutdown_connections 2023-07-21T23:08:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.158+0000 7f695a5ff700 1 -- 172.21.15.151:0/806325984 wait complete. 2023-07-21T23:08:07.193 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.160+0000 7f695a5ff700 1 Processor -- start 2023-07-21T23:08:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.160+0000 7f695a5ff700 1 -- start start 2023-07-21T23:08:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.161+0000 7f695a5ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f695406c910 0x7f6954116d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.161+0000 7f695a5ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f695406d3a0 0x7f6954117280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.194 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.161+0000 7f695a5ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f695410e2a0 0x7f695411a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.161+0000 7f695a5ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695411af90 con 0x7f695406d3a0 2023-07-21T23:08:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.161+0000 7f695a5ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695411b100 con 0x7f695406c910 2023-07-21T23:08:07.195 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.161+0000 7f695a5ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f695411b2c0 con 0x7f695410e2a0 2023-07-21T23:08:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.162+0000 7f6953fff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f695406c910 0x7f6954116d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.163+0000 7f69537fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f695406d3a0 0x7f6954117280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.163+0000 7f69537fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f695406d3a0 0x7f6954117280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50422/0 (socket says 172.21.15.151:50422) 2023-07-21T23:08:07.196 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.163+0000 7f69537fe700 1 -- 172.21.15.151:0/239826728 learned_addr learned my addr 172.21.15.151:0/239826728 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.164+0000 7f69537fe700 1 -- 172.21.15.151:0/239826728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f695410e2a0 msgr2=0x7f695411a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:07.197 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.164+0000 7f69537fe700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f695410e2a0 0x7f695411a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.164+0000 7f69537fe700 1 -- 172.21.15.151:0/239826728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f695406c910 msgr2=0x7f6954116d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.164+0000 7f69537fe700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f695406c910 0x7f6954116d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.164+0000 7f69537fe700 1 -- 172.21.15.151:0/239826728 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6948009520 con 0x7f695406d3a0 2023-07-21T23:08:07.198 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.165+0000 7f69537fe700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f695406d3a0 0x7f6954117280 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6948009810 tx=0x7f694800b560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:07.201 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.167+0000 7f69517fa700 1 -- 172.21.15.151:0/239826728 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694801c070 con 0x7f695406d3a0 2023-07-21T23:08:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.168+0000 7f69517fa700 1 -- 172.21.15.151:0/239826728 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6948005040 con 0x7f695406d3a0 2023-07-21T23:08:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.168+0000 7f69517fa700 1 -- 172.21.15.151:0/239826728 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948004970 con 0x7f695406d3a0 2023-07-21T23:08:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.169+0000 7f695a5ff700 1 -- 172.21.15.151:0/239826728 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695411b540 con 0x7f695406d3a0 2023-07-21T23:08:07.202 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.169+0000 7f695a5ff700 1 -- 172.21.15.151:0/239826728 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6954078950 con 0x7f695406d3a0 2023-07-21T23:08:07.221 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.186+0000 7f696de5db80 1 Processor -- start 2023-07-21T23:08:07.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.189+0000 7f696de5db80 1 -- start start 2023-07-21T23:08:07.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.190+0000 7f696de5db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.190+0000 7f696de5db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf3f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.190+0000 7f696de5db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa660 0x55a2b0cf44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.190+0000 7f696de5db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0bf9c50 con 0x55a2b0cfa210 2023-07-21T23:08:07.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.190+0000 7f696de5db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0c4c9e0 con 0x55a2b0b506b0 2023-07-21T23:08:07.223 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.190+0000 7f696de5db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0c45e70 con 0x55a2b0cfa660 2023-07-21T23:08:07.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.191+0000 7f69517fa700 1 -- 172.21.15.151:0/239826728 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f6948020070 con 0x7f695406d3a0 2023-07-21T23:08:07.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.194+0000 7f69517fa700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f693c0a14d0 0x7f693c0a3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.194+0000 7f69517fa700 1 -- 172.21.15.151:0/239826728 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f69480cd840 con 0x7f695406d3a0 2023-07-21T23:08:07.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.194+0000 7f6958b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.227 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.194+0000 7f6958b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57306/0 (socket says 172.21.15.151:57306) 2023-07-21T23:08:07.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.194+0000 7f6958b9c700 1 -- 172.21.15.151:0/145499388 learned_addr learned my addr 172.21.15.151:0/145499388 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:07.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.194+0000 7f6953fff700 1 --2- 172.21.15.151:0/145499388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.195+0000 7f69537fe700 1 --2- 172.21.15.151:0/145499388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa660 0x55a2b0cf44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.228 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.195+0000 7f6953fff700 1 -- 172.21.15.151:0/145499388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa660 msgr2=0x55a2b0cf44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.195+0000 7f6953fff700 1 --2- 172.21.15.151:0/145499388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa660 0x55a2b0cf44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.195+0000 7f6953fff700 1 -- 172.21.15.151:0/145499388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 msgr2=0x55a2b0cf9cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.195+0000 7f6953fff700 1 --2- 172.21.15.151:0/145499388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf9cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.195+0000 7f6953fff700 1 -- 172.21.15.151:0/145499388 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2b0a73d80 con 0x55a2b0cfa210 2023-07-21T23:08:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.195+0000 7f6958b9c700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f693c0a14d0 0x7f693c0a3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.229 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.196+0000 7f6953fff700 1 --2- 172.21.15.151:0/145499388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf3f40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f694c009370 tx=0x7f694c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94d55acf3326d2b1 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:07.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.196+0000 7f693a7fc700 1 -- 172.21.15.151:0/145499388 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c019070 con 0x55a2b0cfa210 2023-07-21T23:08:07.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.197+0000 7f693a7fc700 1 -- 172.21.15.151:0/145499388 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f694c011040 con 0x55a2b0cfa210 2023-07-21T23:08:07.230 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.197+0000 7f693a7fc700 1 -- 172.21.15.151:0/145499388 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c004820 con 0x55a2b0cfa210 2023-07-21T23:08:07.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.198+0000 7f696de5db80 1 -- 172.21.15.151:0/145499388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa210 msgr2=0x55a2b0cf3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:07.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.198+0000 7f696de5db80 1 --2- 172.21.15.151:0/145499388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf3f40 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f694c009370 tx=0x7f694c009920 comp rx=0 tx=0).stop 2023-07-21T23:08:07.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.198+0000 7f696de5db80 1 -- 172.21.15.151:0/145499388 shutdown_connections 2023-07-21T23:08:07.231 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.198+0000 7f696de5db80 1 --2- 172.21.15.151:0/145499388 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf9cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.198+0000 7f696de5db80 1 --2- 172.21.15.151:0/145499388 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa660 0x55a2b0cf44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.198+0000 7f696de5db80 1 --2- 172.21.15.151:0/145499388 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf3f40 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.232 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.198+0000 7f696de5db80 1 -- 172.21.15.151:0/145499388 >> 172.21.15.151:0/145499388 conn(0x55a2b0ce9ae0 msgr2=0x55a2b0cef0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:07.233 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.199+0000 7f6958b9c700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f693c0a14d0 0x7f693c0a3980 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f69440244d0 tx=0x7f694401a320 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:07.237 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.205+0000 7f696de5db80 1 -- 172.21.15.151:0/145499388 shutdown_connections 2023-07-21T23:08:07.238 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.205+0000 7f696de5db80 1 -- 172.21.15.151:0/145499388 wait complete. 2023-07-21T23:08:07.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.206+0000 7f696de5db80 1 -- start start 2023-07-21T23:08:07.239 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.206+0000 7f696de5db80 1 Processor -- start 2023-07-21T23:08:07.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.207+0000 7f696de5db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0d00510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.240 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.207+0000 7f696de5db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa210 0x55a2b0cfd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.207+0000 7f696de5db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa660 0x55a2b0cfde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.207+0000 7f696de5db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0be5a60 con 0x55a2b0b506b0 2023-07-21T23:08:07.241 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.207+0000 7f696de5db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0be5760 con 0x55a2b0cfa210 2023-07-21T23:08:07.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.207+0000 7f696de5db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0ac98c0 con 0x55a2b0cfa660 2023-07-21T23:08:07.242 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.207+0000 7f696de5db80 10 client.0 _ll_register_callbacks cb 0x55a2b0be3700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:08:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.212+0000 7f6953fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0d00510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.250 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.212+0000 7f6953fff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0d00510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50440/0 (socket says 172.21.15.151:50440) 2023-07-21T23:08:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.212+0000 7f6953fff700 1 -- 172.21.15.151:0/270692395 learned_addr learned my addr 172.21.15.151:0/270692395 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.212+0000 7f69537fe700 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa210 0x55a2b0cfd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.214+0000 7f6953fff700 1 -- 172.21.15.151:0/270692395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa660 msgr2=0x55a2b0cfde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.214+0000 7f6953fff700 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa660 0x55a2b0cfde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.251 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.214+0000 7f6953fff700 1 -- 172.21.15.151:0/270692395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa210 msgr2=0x55a2b0cfd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.214+0000 7f6953fff700 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa210 0x55a2b0cfd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.214+0000 7f6953fff700 1 -- 172.21.15.151:0/270692395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f694c009050 con 0x55a2b0b506b0 2023-07-21T23:08:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.215+0000 7f6953fff700 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0d00510 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f694c004400 tx=0x7f694c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8f471828cd290a server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:07.252 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.215+0000 7f69337fe700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:08:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.219+0000 7f69337fe700 1 -- 172.21.15.151:0/270692395 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f694c019040 con 0x55a2b0b506b0 2023-07-21T23:08:07.253 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.219+0000 7f69337fe700 1 -- 172.21.15.151:0/270692395 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f694c003e10 con 0x55a2b0b506b0 2023-07-21T23:08:07.254 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.220+0000 7f696de5db80 1 -- 172.21.15.151:0/270692395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55a2b0b9f490 con 0x55a2b0b506b0 2023-07-21T23:08:07.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.222+0000 7f69337fe700 1 -- 172.21.15.151:0/270692395 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f694c01e440 con 0x55a2b0b506b0 2023-07-21T23:08:07.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.223+0000 7f696de5db80 10 client.19998 fetch_fsmap learned FSMap version 116 2023-07-21T23:08:07.255 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.223+0000 7f696de5db80 1 -- 172.21.15.151:0/270692395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55a2b0a5cc00 con 0x55a2b0b506b0 2023-07-21T23:08:07.256 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.223+0000 7f69337fe700 1 -- 172.21.15.151:0/270692395 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55a2b0b9f490 con 0x55a2b0b506b0 2023-07-21T23:08:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.223+0000 7f69337fe700 1 -- 172.21.15.151:0/270692395 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f694c014070 con 0x55a2b0b506b0 2023-07-21T23:08:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.224+0000 7f696de5db80 10 client.19998 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:08:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.224+0000 7f696de5db80 10 client.19998 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:08:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.224+0000 7f696de5db80 20 client.19998 populate_metadata read hostname 'smithi151' 2023-07-21T23:08:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.224+0000 7f696de5db80 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a2b0d0d960 0x55a2b0d0fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.257 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.224+0000 7f696de5db80 4 client.19998 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:08:07.258 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.224+0000 7f696de5db80 1 -- 172.21.15.151:0/270692395 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55a2b0c3ee50 con 0x55a2b0d0d960 2023-07-21T23:08:07.261 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.229+0000 7f69537fe700 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a2b0d0d960 0x55a2b0d0fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.243+0000 7f69537fe700 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a2b0d0d960 0x55a2b0d0fd70 crc :-1 s=READY pgs=535 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c24d5f1fc2319a9 server_cookie=6cd525e088008c46 in_seq=0 out_seq=0 2023-07-21T23:08:07.283 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.243+0000 7f69337fe700 10 client.19998 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.254+0000 7f69337fe700 1 -- 172.21.15.151:0/270692395 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55a2b0c3ee50 con 0x55a2b0d0d960 2023-07-21T23:08:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.254+0000 7f69337fe700 10 client.19998 handle_command_reply: tid=0 2023-07-21T23:08:07.286 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.254+0000 7f696de5db80 1 client.19998 shutdown 2023-07-21T23:08:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.255+0000 7f696de5db80 1 -- 172.21.15.151:0/270692395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 msgr2=0x55a2b0d00510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.255+0000 7f696de5db80 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0d00510 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f694c004400 tx=0x7f694c004740 comp rx=0 tx=0).stop 2023-07-21T23:08:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.256+0000 7f696de5db80 1 -- 172.21.15.151:0/270692395 shutdown_connections 2023-07-21T23:08:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.256+0000 7f696de5db80 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a2b0d0d960 0x55a2b0d0fd70 crc :-1 s=READY pgs=535 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.291 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.256+0000 7f696de5db80 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa660 0x55a2b0cfde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.256+0000 7f696de5db80 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0d00510 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.256+0000 7f696de5db80 1 --2- 172.21.15.151:0/270692395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa210 0x55a2b0cfd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.256+0000 7f696de5db80 1 -- 172.21.15.151:0/270692395 >> 172.21.15.151:0/270692395 conn(0x55a2b0ce9ae0 msgr2=0x55a2b0cee3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:07.292 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.259+0000 7f69337fe700 0 client.19998 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.259+0000 7f696de5db80 1 -- 172.21.15.151:0/270692395 shutdown_connections 2023-07-21T23:08:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.260+0000 7f696de5db80 1 -- 172.21.15.151:0/270692395 wait complete. 2023-07-21T23:08:07.293 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.260+0000 7f696de5db80 20 client.19998 trim_cache size 0 max 16384 2023-07-21T23:08:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.289+0000 7f696de5db80 1 Processor -- start 2023-07-21T23:08:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.289+0000 7f696de5db80 1 -- start start 2023-07-21T23:08:07.328 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.289+0000 7f696de5db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.289+0000 7f696de5db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 0x55a2b0d04ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.289+0000 7f696de5db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa660 0x55a2b0d000b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.289+0000 7f696de5db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0cebc40 con 0x55a2b0cfa660 2023-07-21T23:08:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.289+0000 7f696de5db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0cf06d0 con 0x55a2b0b506b0 2023-07-21T23:08:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.289+0000 7f696de5db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0cfed70 con 0x55a2b0cfa210 2023-07-21T23:08:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.290+0000 7f6958b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa660 0x55a2b0d000b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.329 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.291+0000 7f6958b9c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa660 0x55a2b0d000b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50450/0 (socket says 172.21.15.151:50450) 2023-07-21T23:08:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.291+0000 7f6958b9c700 1 -- 172.21.15.151:0/3782246334 learned_addr learned my addr 172.21.15.151:0/3782246334 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.291+0000 7f69537fe700 1 --2- 172.21.15.151:0/3782246334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 0x55a2b0d04ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.330 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.297+0000 7f6953fff700 1 --2- 172.21.15.151:0/3782246334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.302+0000 7f6958b9c700 1 -- 172.21.15.151:0/3782246334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 msgr2=0x55a2b0d04ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.302+0000 7f6958b9c700 1 --2- 172.21.15.151:0/3782246334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 0x55a2b0d04ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.302+0000 7f6958b9c700 1 -- 172.21.15.151:0/3782246334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 msgr2=0x55a2b0cf46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:07.334 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.302+0000 7f6958b9c700 1 --2- 172.21.15.151:0/3782246334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.335 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.302+0000 7f6958b9c700 1 -- 172.21.15.151:0/3782246334 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55a2b0d14960 con 0x55a2b0cfa660 2023-07-21T23:08:07.338 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.306+0000 7f6958b9c700 1 --2- 172.21.15.151:0/3782246334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa660 0x55a2b0d000b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f6944020610 tx=0x7f694401a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78bc8b54e1ce89a9 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:07.351 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.313+0000 7f693affd700 1 -- 172.21.15.151:0/3782246334 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6944004050 con 0x55a2b0cfa660 2023-07-21T23:08:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.313+0000 7f693affd700 1 -- 172.21.15.151:0/3782246334 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6944003680 con 0x55a2b0cfa660 2023-07-21T23:08:07.352 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.313+0000 7f693affd700 1 -- 172.21.15.151:0/3782246334 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69440306e0 con 0x55a2b0cfa660 2023-07-21T23:08:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.314+0000 7f696de5db80 1 -- 172.21.15.151:0/3782246334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa660 msgr2=0x55a2b0d000b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.314+0000 7f696de5db80 1 --2- 172.21.15.151:0/3782246334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa660 0x55a2b0d000b0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f6944020610 tx=0x7f694401a6f0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.320+0000 7f696de5db80 1 -- 172.21.15.151:0/3782246334 shutdown_connections 2023-07-21T23:08:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.320+0000 7f696de5db80 1 --2- 172.21.15.151:0/3782246334 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.320+0000 7f696de5db80 1 --2- 172.21.15.151:0/3782246334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0cfa660 0x55a2b0d000b0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.353 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.320+0000 7f696de5db80 1 --2- 172.21.15.151:0/3782246334 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 0x55a2b0d04ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.354 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.320+0000 7f696de5db80 1 -- 172.21.15.151:0/3782246334 >> 172.21.15.151:0/3782246334 conn(0x55a2b0ce9ae0 msgr2=0x55a2b0cf3fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:07.359 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.327+0000 7f696de5db80 1 -- 172.21.15.151:0/3782246334 shutdown_connections 2023-07-21T23:08:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.329+0000 7f696de5db80 1 -- 172.21.15.151:0/3782246334 wait complete. 2023-07-21T23:08:07.361 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.329+0000 7f696de5db80 1 -- start start 2023-07-21T23:08:07.362 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.330+0000 7f696de5db80 1 Processor -- start 2023-07-21T23:08:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.331+0000 7f696de5db80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.331+0000 7f696de5db80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.331+0000 7f696de5db80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa660 0x55a2b0cf61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.331+0000 7f696de5db80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0cf6760 con 0x55a2b0b506b0 2023-07-21T23:08:07.364 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.331+0000 7f696de5db80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0cf68d0 con 0x55a2b0cfa660 2023-07-21T23:08:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.331+0000 7f696de5db80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55a2b0cf6a90 con 0x55a2b0cfa210 2023-07-21T23:08:07.365 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.331+0000 7f696de5db80 10 client.0 _ll_register_callbacks cb 0x7f694c009270 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:08:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.334+0000 7f6958b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa660 0x55a2b0cf61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.334+0000 7f69537fe700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.366 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.334+0000 7f6958b9c700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa660 0x55a2b0cf61b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:57340/0 (socket says 172.21.15.151:57340) 2023-07-21T23:08:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.334+0000 7f6958b9c700 1 -- 172.21.15.151:0/1050062433 learned_addr learned my addr 172.21.15.151:0/1050062433 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.335+0000 7f6953fff700 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.367 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.335+0000 7f69537fe700 1 -- 172.21.15.151:0/1050062433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa660 msgr2=0x55a2b0cf61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.335+0000 7f69537fe700 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa660 0x55a2b0cf61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.335+0000 7f69537fe700 1 -- 172.21.15.151:0/1050062433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 msgr2=0x55a2b0cf5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.335+0000 7f69537fe700 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.335+0000 7f69537fe700 1 -- 172.21.15.151:0/1050062433 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55a2b0a9a1f0 con 0x55a2b0cfa210 2023-07-21T23:08:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.335+0000 7f6953fff700 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:08:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.335+0000 7f69537fe700 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf5c70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f69480caf20 tx=0x7f6948025000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=316378252d3c5fa7 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:07.368 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.335+0000 7f69337fe700 10 client.0 ms_handle_connect on v2:172.21.15.195:3300/0 2023-07-21T23:08:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.337+0000 7f69337fe700 1 -- 172.21.15.151:0/1050062433 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6948097040 con 0x55a2b0cfa210 2023-07-21T23:08:07.369 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.337+0000 7f69337fe700 1 -- 172.21.15.151:0/1050062433 <== mon.1 v2:172.21.15.195:3300/0 2 ==== osd_map(174..174 src has 1..174) v4 ==== 8536+0+0 (secure 0 0 0) 0x7f69480971a0 con 0x55a2b0cfa210 2023-07-21T23:08:07.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.337+0000 7f696de5db80 1 -- 172.21.15.151:0/1050062433 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f694c011040 con 0x55a2b0cfa210 2023-07-21T23:08:07.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.338+0000 7f69337fe700 1 -- 172.21.15.151:0/1050062433 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f69480cb1a0 con 0x55a2b0cfa210 2023-07-21T23:08:07.370 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.339+0000 7f696de5db80 10 client.29677 fetch_fsmap learned FSMap version 116 2023-07-21T23:08:07.371 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.339+0000 7f696de5db80 1 -- 172.21.15.151:0/1050062433 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55a2b0a72250 con 0x55a2b0cfa210 2023-07-21T23:08:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.340+0000 7f69337fe700 1 -- 172.21.15.151:0/1050062433 <== mon.1 v2:172.21.15.195:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f694c011040 con 0x55a2b0cfa210 2023-07-21T23:08:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.340+0000 7f69337fe700 1 -- 172.21.15.151:0/1050062433 <== mon.1 v2:172.21.15.195:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f694809acb0 con 0x55a2b0cfa210 2023-07-21T23:08:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.341+0000 7f696de5db80 10 client.29677 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:08:07.373 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.341+0000 7f696de5db80 10 client.29677 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:08:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.341+0000 7f696de5db80 20 client.29677 populate_metadata read hostname 'smithi151' 2023-07-21T23:08:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.341+0000 7f696de5db80 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a2b0d61fc0 0x55a2b0d643d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.341+0000 7f696de5db80 4 client.29677 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:08:07.374 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.341+0000 7f696de5db80 1 -- 172.21.15.151:0/1050062433 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55a2b0c00ff0 con 0x55a2b0d61fc0 2023-07-21T23:08:07.383 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.347+0000 7f6953fff700 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a2b0d61fc0 0x55a2b0d643d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:07.393 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.361+0000 7f6953fff700 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a2b0d61fc0 0x55a2b0d643d0 crc :-1 s=READY pgs=536 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dce69f375e26df9f server_cookie=fda2a9810dc61a3d in_seq=0 out_seq=0 2023-07-21T23:08:07.394 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.361+0000 7f69337fe700 10 client.29677 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.522+0000 7f69337fe700 1 -- 172.21.15.151:0/1050062433 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55a2b0c00ff0 con 0x55a2b0d61fc0 2023-07-21T23:08:07.554 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.522+0000 7f69337fe700 10 client.29677 handle_command_reply: tid=0 2023-07-21T23:08:07.555 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.522+0000 7f696de5db80 1 client.29677 shutdown 2023-07-21T23:08:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.522+0000 7f696de5db80 1 -- 172.21.15.151:0/1050062433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 msgr2=0x55a2b0cf5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:07.556 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.522+0000 7f696de5db80 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf5c70 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f69480caf20 tx=0x7f6948025000 comp rx=0 tx=0).stop 2023-07-21T23:08:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.523+0000 7f696de5db80 1 -- 172.21.15.151:0/1050062433 shutdown_connections 2023-07-21T23:08:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.523+0000 7f696de5db80 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55a2b0d61fc0 0x55a2b0d643d0 crc :-1 s=READY pgs=536 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.523+0000 7f696de5db80 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55a2b0cfa660 0x55a2b0cf61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.557 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.523+0000 7f696de5db80 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a2b0b506b0 0x55a2b0cf5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.523+0000 7f696de5db80 1 --2- 172.21.15.151:0/1050062433 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55a2b0cfa210 0x55a2b0cf5c70 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.523+0000 7f696de5db80 1 -- 172.21.15.151:0/1050062433 >> 172.21.15.151:0/1050062433 conn(0x55a2b0ce9ae0 msgr2=0x55a2b0cfb2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:07.558 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.523+0000 7f69337fe700 0 client.29677 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.523+0000 7f696de5db80 1 -- 172.21.15.151:0/1050062433 shutdown_connections 2023-07-21T23:08:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.523+0000 7f696de5db80 1 -- 172.21.15.151:0/1050062433 wait complete. 2023-07-21T23:08:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.526+0000 7f696de5db80 20 client.29677 trim_cache size 0 max 16384 2023-07-21T23:08:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:08:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:08:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:08:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:08:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.528+0000 7f695a5ff700 1 -- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f693c0a14d0 msgr2=0x7f693c0a3980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.528+0000 7f695a5ff700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f693c0a14d0 0x7f693c0a3980 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f69440244d0 tx=0x7f694401a320 comp rx=0 tx=0).stop 2023-07-21T23:08:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.528+0000 7f695a5ff700 1 -- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f695406d3a0 msgr2=0x7f6954117280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.528+0000 7f695a5ff700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f695406d3a0 0x7f6954117280 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f6948009810 tx=0x7f694800b560 comp rx=0 tx=0).stop 2023-07-21T23:08:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.529+0000 7f695a5ff700 1 -- 172.21.15.151:0/239826728 shutdown_connections 2023-07-21T23:08:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.529+0000 7f695a5ff700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f693c0a14d0 0x7f693c0a3980 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.529+0000 7f695a5ff700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f695406c910 0x7f6954116d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.529+0000 7f695a5ff700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f695410e2a0 0x7f695411a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.529+0000 7f695a5ff700 1 --2- 172.21.15.151:0/239826728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f695406d3a0 0x7f6954117280 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.529+0000 7f695a5ff700 1 -- 172.21.15.151:0/239826728 >> 172.21.15.151:0/239826728 conn(0x7f695406bd70 msgr2=0x7f69540708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.533+0000 7f695a5ff700 1 -- 172.21.15.151:0/239826728 shutdown_connections 2023-07-21T23:08:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:07.533+0000 7f695a5ff700 1 -- 172.21.15.151:0/239826728 wait complete. 2023-07-21T23:08:07.618 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:07 smithi187 ceph-mon[96918]: pgmap v1557: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 12 MiB/s wr, 1.41k op/s 2023-07-21T23:08:07.648 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:07 smithi195 ceph-mon[97365]: pgmap v1557: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 12 MiB/s wr, 1.41k op/s 2023-07-21T23:08:07.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:07 smithi151 ceph-mon[95510]: pgmap v1557: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 987 KiB/s rd, 12 MiB/s wr, 1.41k op/s 2023-07-21T23:08:09.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:09 smithi187 ceph-mon[96918]: pgmap v1558: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2023-07-21T23:08:09.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:09 smithi195 ceph-mon[97365]: pgmap v1558: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2023-07-21T23:08:09.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:09 smithi151 ceph-mon[95510]: pgmap v1558: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 14 GiB data, 34 GiB used, 1.0 TiB / 1.0 TiB avail; 756 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2023-07-21T23:08:11.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:11 smithi187 ceph-mon[96918]: pgmap v1559: 97 pgs: 13 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 59 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 8.4 MiB/s wr, 976 op/s 2023-07-21T23:08:11.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:11 smithi195 ceph-mon[97365]: pgmap v1559: 97 pgs: 13 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 59 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 8.4 MiB/s wr, 976 op/s 2023-07-21T23:08:11.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:11 smithi151 ceph-mon[95510]: pgmap v1559: 97 pgs: 13 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 59 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 8.4 MiB/s wr, 976 op/s 2023-07-21T23:08:13.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:13 smithi187 ceph-mon[96918]: pgmap v1560: 97 pgs: 13 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 59 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 7.8 MiB/s wr, 901 op/s 2023-07-21T23:08:13.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:13 smithi195 ceph-mon[97365]: pgmap v1560: 97 pgs: 13 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 59 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 7.8 MiB/s wr, 901 op/s 2023-07-21T23:08:13.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:13 smithi151 ceph-mon[95510]: pgmap v1560: 97 pgs: 13 active+clean+snaptrim, 25 active+clean+snaptrim_wait, 59 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 538 KiB/s rd, 7.8 MiB/s wr, 901 op/s 2023-07-21T23:08:15.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:15 smithi187 ceph-mon[96918]: pgmap v1561: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.5 MiB/s wr, 169 op/s 2023-07-21T23:08:15.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:15 smithi195 ceph-mon[97365]: pgmap v1561: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.5 MiB/s wr, 169 op/s 2023-07-21T23:08:15.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:15 smithi151 ceph-mon[95510]: pgmap v1561: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 377 KiB/s rd, 1.5 MiB/s wr, 169 op/s 2023-07-21T23:08:17.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:17 smithi187 ceph-mon[96918]: pgmap v1562: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.3 MiB/s wr, 143 op/s 2023-07-21T23:08:17.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:17 smithi187 ceph-mon[96918]: osdmap e175: 12 total, 12 up, 12 in 2023-07-21T23:08:17.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:17 smithi195 ceph-mon[97365]: pgmap v1562: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.3 MiB/s wr, 143 op/s 2023-07-21T23:08:17.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:17 smithi195 ceph-mon[97365]: osdmap e175: 12 total, 12 up, 12 in 2023-07-21T23:08:17.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:17 smithi151 ceph-mon[95510]: pgmap v1562: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 1.3 MiB/s wr, 143 op/s 2023-07-21T23:08:17.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:17 smithi151 ceph-mon[95510]: osdmap e175: 12 total, 12 up, 12 in 2023-07-21T23:08:19.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:19 smithi187 ceph-mon[96918]: pgmap v1564: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 795 KiB/s wr, 81 op/s 2023-07-21T23:08:19.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:19 smithi195 ceph-mon[97365]: pgmap v1564: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 795 KiB/s wr, 81 op/s 2023-07-21T23:08:19.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:19 smithi151 ceph-mon[95510]: pgmap v1564: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 289 KiB/s rd, 795 KiB/s wr, 81 op/s 2023-07-21T23:08:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.714+0000 7f71c53ff700 1 -- 172.21.15.151:0/1321080503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c00ffb30 msgr2=0x7f71c00fffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.714+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1321080503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c00ffb30 0x7f71c00fffa0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f71b4009990 tx=0x7f71b4009ca0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.714+0000 7f71c53ff700 1 -- 172.21.15.151:0/1321080503 shutdown_connections 2023-07-21T23:08:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.714+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1321080503 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c01004e0 0x7f71c010c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.746 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.714+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1321080503 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c0105b60 0x7f71c0105f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.714+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1321080503 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c00ffb30 0x7f71c00fffa0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.714+0000 7f71c53ff700 1 -- 172.21.15.151:0/1321080503 >> 172.21.15.151:0/1321080503 conn(0x7f71c00fb5f0 msgr2=0x7f71c00fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.714+0000 7f71c53ff700 1 -- 172.21.15.151:0/1321080503 shutdown_connections 2023-07-21T23:08:20.747 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.714+0000 7f71c53ff700 1 -- 172.21.15.151:0/1321080503 wait complete. 2023-07-21T23:08:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.715+0000 7f71c53ff700 1 Processor -- start 2023-07-21T23:08:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71c53ff700 1 -- start start 2023-07-21T23:08:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71c53ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c00ffb30 0x7f71c0197ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71c53ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c01004e0 0x7f71c0198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71c53ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c0105b60 0x7f71c019b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.749 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71c53ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c019bde0 con 0x7f71c0105b60 2023-07-21T23:08:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71c53ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c019bf50 con 0x7f71c01004e0 2023-07-21T23:08:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71c53ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c019c110 con 0x7f71c00ffb30 2023-07-21T23:08:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71bf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c0105b60 0x7f71c019b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71be7fc700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c01004e0 0x7f71c0198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71beffd700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c00ffb30 0x7f71c0197ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71bf7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c0105b60 0x7f71c019b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47450/0 (socket says 172.21.15.151:47450) 2023-07-21T23:08:20.750 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.716+0000 7f71bf7fe700 1 -- 172.21.15.151:0/1687461530 learned_addr learned my addr 172.21.15.151:0/1687461530 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.717+0000 7f71be7fc700 1 -- 172.21.15.151:0/1687461530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c00ffb30 msgr2=0x7f71c0197ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.717+0000 7f71be7fc700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c00ffb30 0x7f71c0197ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.717+0000 7f71be7fc700 1 -- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c0105b60 msgr2=0x7f71c019b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.717+0000 7f71be7fc700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c0105b60 0x7f71c019b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.717+0000 7f71be7fc700 1 -- 172.21.15.151:0/1687461530 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b40095f0 con 0x7f71c01004e0 2023-07-21T23:08:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.717+0000 7f71beffd700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c00ffb30 0x7f71c0197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:08:20.751 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.717+0000 7f71bf7fe700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c0105b60 0x7f71c019b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:08:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.717+0000 7f71be7fc700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c01004e0 0x7f71c0198220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f71b40098e0 tx=0x7f71b4009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.718+0000 7f71a7fff700 1 -- 172.21.15.151:0/1687461530 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b401d070 con 0x7f71c01004e0 2023-07-21T23:08:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.718+0000 7f71c53ff700 1 -- 172.21.15.151:0/1687461530 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c019c390 con 0x7f71c01004e0 2023-07-21T23:08:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.718+0000 7f71a7fff700 1 -- 172.21.15.151:0/1687461530 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71b4003ec0 con 0x7f71c01004e0 2023-07-21T23:08:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.718+0000 7f71a7fff700 1 -- 172.21.15.151:0/1687461530 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4022a80 con 0x7f71c01004e0 2023-07-21T23:08:20.752 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.718+0000 7f71c53ff700 1 -- 172.21.15.151:0/1687461530 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c019c660 con 0x7f71c01004e0 2023-07-21T23:08:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.721+0000 7f71a7fff700 1 -- 172.21.15.151:0/1687461530 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f71b4004030 con 0x7f71c01004e0 2023-07-21T23:08:20.753 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.722+0000 7f71d8dfdb80 1 Processor -- start 2023-07-21T23:08:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.722+0000 7f71d8dfdb80 1 -- start start 2023-07-21T23:08:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71a7fff700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71a80a12c0 0x7f71a80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861bc786b0 0x55861be21cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 0x55861be1bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.755 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861be22660 0x55861be1c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bd21c50 con 0x55861be22660 2023-07-21T23:08:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bd749e0 con 0x55861bc786b0 2023-07-21T23:08:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bd6de70 con 0x55861be22210 2023-07-21T23:08:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71a7fff700 1 -- 172.21.15.151:0/1687461530 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f71b40ce4b0 con 0x7f71c01004e0 2023-07-21T23:08:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71bf7fe700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71a80a12c0 0x7f71a80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71be7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 0x55861be1bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.756 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71be7fc700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 0x55861be1bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.195:3300/0 says I am v2:172.21.15.151:57168/0 (socket says 172.21.15.151:57168) 2023-07-21T23:08:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71be7fc700 1 -- 172.21.15.151:0/2318952889 learned_addr learned my addr 172.21.15.151:0/2318952889 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71beffd700 1 --2- 172.21.15.151:0/2318952889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861bc786b0 0x55861be21cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.723+0000 7f71bf7fe700 1 --2- 172.21.15.151:0/2318952889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861be22660 0x55861be1c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71be7fc700 1 -- 172.21.15.151:0/2318952889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861bc786b0 msgr2=0x55861be21cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71be7fc700 1 --2- 172.21.15.151:0/2318952889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861bc786b0 0x55861be21cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71be7fc700 1 -- 172.21.15.151:0/2318952889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861be22660 msgr2=0x55861be1c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:20.757 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71be7fc700 1 --2- 172.21.15.151:0/2318952889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861be22660 0x55861be1c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.758 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71be7fc700 1 -- 172.21.15.151:0/2318952889 --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55861bb9bd80 con 0x55861be22210 2023-07-21T23:08:20.760 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71be7fc700 1 --2- 172.21.15.151:0/2318952889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 0x55861be1bf40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f71b4097ad0 tx=0x7f71b4009310 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bc06376b88365fd server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71bf7fe700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71a80a12c0 0x7f71a80a3770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009fd0 tx=0x7f71b8007610 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71a57fa700 1 -- 172.21.15.151:0/2318952889 <== mon.1 v2:172.21.15.195:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4086550 con 0x55861be22210 2023-07-21T23:08:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71a57fa700 1 -- 172.21.15.151:0/2318952889 <== mon.1 v2:172.21.15.195:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71b409b5d0 con 0x55861be22210 2023-07-21T23:08:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.724+0000 7f71a57fa700 1 -- 172.21.15.151:0/2318952889 <== mon.1 v2:172.21.15.195:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40868d0 con 0x55861be22210 2023-07-21T23:08:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.725+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2318952889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 msgr2=0x55861be1bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:20.761 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.725+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2318952889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 0x55861be1bf40 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f71b4097ad0 tx=0x7f71b4009310 comp rx=0 tx=0).stop 2023-07-21T23:08:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.725+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2318952889 shutdown_connections 2023-07-21T23:08:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.725+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2318952889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861bc786b0 0x55861be21cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.725+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2318952889 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861be22660 0x55861be1c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.725+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2318952889 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 0x55861be1bf40 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.725+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2318952889 >> 172.21.15.151:0/2318952889 conn(0x55861be11ae0 msgr2=0x55861be170e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.725+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2318952889 shutdown_connections 2023-07-21T23:08:20.762 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.725+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2318952889 wait complete. 2023-07-21T23:08:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.726+0000 7f71d8dfdb80 1 -- start start 2023-07-21T23:08:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.726+0000 7f71d8dfdb80 1 Processor -- start 2023-07-21T23:08:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.726+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.726+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 0x55861be2b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.726+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 0x55861be254a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.726+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bd0da60 con 0x55861bc786b0 2023-07-21T23:08:20.763 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.726+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bd0d760 con 0x55861be22210 2023-07-21T23:08:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.726+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861bbf18c0 con 0x55861be22660 2023-07-21T23:08:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71d8dfdb80 10 client.0 _ll_register_callbacks cb 0x55861bd0b700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:08:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47472/0 (socket says 172.21.15.151:47472) 2023-07-21T23:08:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71beffd700 1 -- 172.21.15.151:0/2774323181 learned_addr learned my addr 172.21.15.151:0/2774323181 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71be7fc700 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 0x55861be2b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.764 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71bf7fe700 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 0x55861be254a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71beffd700 1 -- 172.21.15.151:0/2774323181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 msgr2=0x55861be254a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:20.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71beffd700 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 0x55861be254a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71beffd700 1 -- 172.21.15.151:0/2774323181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 msgr2=0x55861be2b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:20.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71beffd700 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 0x55861be2b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.727+0000 7f71beffd700 1 -- 172.21.15.151:0/2774323181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c019c660 con 0x55861bc786b0 2023-07-21T23:08:20.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71beffd700 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b210 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f71b00118c0 tx=0x7f71b0011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c244570aa04ee04b server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:20.765 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71a2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:08:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71a2ff5700 1 -- 172.21.15.151:0/2774323181 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0016070 con 0x55861bc786b0 2023-07-21T23:08:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71a2ff5700 1 -- 172.21.15.151:0/2774323181 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f71b0004830 con 0x55861bc786b0 2023-07-21T23:08:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2774323181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55861bcc7490 con 0x55861bc786b0 2023-07-21T23:08:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71a2ff5700 1 -- 172.21.15.151:0/2774323181 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71b00049f0 con 0x55861bc786b0 2023-07-21T23:08:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71d8dfdb80 10 client.20013 fetch_fsmap learned FSMap version 116 2023-07-21T23:08:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2774323181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55861bb84c00 con 0x55861bc786b0 2023-07-21T23:08:20.766 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71a2ff5700 1 -- 172.21.15.151:0/2774323181 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55861bcc7490 con 0x55861bc786b0 2023-07-21T23:08:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71a2ff5700 1 -- 172.21.15.151:0/2774323181 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f71b001a970 con 0x55861bc786b0 2023-07-21T23:08:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71d8dfdb80 10 client.20013 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:08:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.728+0000 7f71d8dfdb80 10 client.20013 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:08:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.729+0000 7f71d8dfdb80 20 client.20013 populate_metadata read hostname 'smithi151' 2023-07-21T23:08:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.729+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55861be35720 0x55861be37b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.729+0000 7f71d8dfdb80 4 client.20013 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:08:20.767 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.729+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2774323181 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55861bd66e50 con 0x55861be35720 2023-07-21T23:08:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.729+0000 7f71be7fc700 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55861be35720 0x55861be37b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.729+0000 7f71be7fc700 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55861be35720 0x55861be37b30 crc :-1 s=READY pgs=537 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4e72ea1b7b379a5 server_cookie=d7ef5b9de715c3a8 in_seq=0 out_seq=0 2023-07-21T23:08:20.768 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.729+0000 7f71a2ff5700 10 client.20013 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.730+0000 7f71a2ff5700 1 -- 172.21.15.151:0/2774323181 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55861bd66e50 con 0x55861be35720 2023-07-21T23:08:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.730+0000 7f71a2ff5700 10 client.20013 handle_command_reply: tid=0 2023-07-21T23:08:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.730+0000 7f71d8dfdb80 1 client.20013 shutdown 2023-07-21T23:08:20.769 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2774323181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 msgr2=0x55861be2b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b210 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f71b00118c0 tx=0x7f71b0011bd0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2774323181 shutdown_connections 2023-07-21T23:08:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55861be35720 0x55861be37b30 crc :-1 s=READY pgs=537 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 0x55861be254a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b210 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71a2ff5700 0 client.20013 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:20.770 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/2774323181 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 0x55861be2b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2774323181 >> 172.21.15.151:0/2774323181 conn(0x55861be11ae0 msgr2=0x55861be163e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2774323181 shutdown_connections 2023-07-21T23:08:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/2774323181 wait complete. 2023-07-21T23:08:20.771 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.731+0000 7f71d8dfdb80 20 client.20013 trim_cache size 0 max 16384 2023-07-21T23:08:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.748+0000 7f71d8dfdb80 1 Processor -- start 2023-07-21T23:08:20.779 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.748+0000 7f71d8dfdb80 1 -- start start 2023-07-21T23:08:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.748+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be25450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.748+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 0x55861be1e740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.748+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 0x55861be1ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.748+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861be259e0 con 0x55861bc786b0 2023-07-21T23:08:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.748+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861be13c30 con 0x55861be22210 2023-07-21T23:08:20.780 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.748+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861be1cdb0 con 0x55861be22660 2023-07-21T23:08:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be25450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be25450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47482/0 (socket says 172.21.15.151:47482) 2023-07-21T23:08:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71beffd700 1 -- 172.21.15.151:0/1114592454 learned_addr learned my addr 172.21.15.151:0/1114592454 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:20.782 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71bf7fe700 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 0x55861be1ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71beffd700 1 -- 172.21.15.151:0/1114592454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 msgr2=0x55861be1ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71beffd700 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 0x55861be1ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71beffd700 1 -- 172.21.15.151:0/1114592454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 msgr2=0x55861be1e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71be7fc700 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 0x55861be1e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71beffd700 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 0x55861be1e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71beffd700 1 -- 172.21.15.151:0/1114592454 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55861bbc21f0 con 0x55861bc786b0 2023-07-21T23:08:20.783 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71bf7fe700 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 0x55861be1ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:08:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71beffd700 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be25450 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f71b000b4f0 tx=0x7f71b000bb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fece4b0938120fa server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.749+0000 7f71a5ffb700 1 -- 172.21.15.151:0/1114592454 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0016070 con 0x55861bc786b0 2023-07-21T23:08:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.750+0000 7f71a5ffb700 1 -- 172.21.15.151:0/1114592454 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71b00044b0 con 0x55861bc786b0 2023-07-21T23:08:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.750+0000 7f71a5ffb700 1 -- 172.21.15.151:0/1114592454 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0005290 con 0x55861bc786b0 2023-07-21T23:08:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.750+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/1114592454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 msgr2=0x55861be25450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.750+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be25450 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f71b000b4f0 tx=0x7f71b000bb90 comp rx=0 tx=0).stop 2023-07-21T23:08:20.784 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.750+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/1114592454 shutdown_connections 2023-07-21T23:08:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.750+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22660 0x55861be1ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.750+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be25450 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.750+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/1114592454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22210 0x55861be1e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.750+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/1114592454 >> 172.21.15.151:0/1114592454 conn(0x55861be11ae0 msgr2=0x55861be24d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.751+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/1114592454 shutdown_connections 2023-07-21T23:08:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.751+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/1114592454 wait complete. 2023-07-21T23:08:20.785 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.751+0000 7f71d8dfdb80 1 -- start start 2023-07-21T23:08:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.751+0000 7f71d8dfdb80 1 Processor -- start 2023-07-21T23:08:20.787 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 0x55861be2b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71d8dfdb80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22660 0x55861be296a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861be29d80 con 0x55861bc786b0 2023-07-21T23:08:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861be29ef0 con 0x55861be22660 2023-07-21T23:08:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71d8dfdb80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55861be2a0b0 con 0x55861be22210 2023-07-21T23:08:20.788 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71d8dfdb80 10 client.0 _ll_register_callbacks cb 0x7f71b000bf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:08:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71beffd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:47492/0 (socket says 172.21.15.151:47492) 2023-07-21T23:08:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.752+0000 7f71beffd700 1 -- 172.21.15.151:0/19679998 learned_addr learned my addr 172.21.15.151:0/19679998 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71bf7fe700 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22660 0x55861be296a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71beffd700 1 -- 172.21.15.151:0/19679998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 msgr2=0x55861be2b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71beffd700 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 0x55861be2b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.789 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71beffd700 1 -- 172.21.15.151:0/19679998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22660 msgr2=0x55861be296a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71beffd700 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22660 0x55861be296a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71beffd700 1 -- 172.21.15.151:0/19679998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b001ae70 con 0x55861bc786b0 2023-07-21T23:08:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71beffd700 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b1e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f71b0011fd0 tx=0x7f71b0010b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed5351d63d1d115 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71a2ff5700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:08:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71a2ff5700 1 -- 172.21.15.151:0/19679998 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b0016040 con 0x55861bc786b0 2023-07-21T23:08:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/19679998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f71b409b5d0 con 0x55861bc786b0 2023-07-21T23:08:20.790 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71a2ff5700 1 -- 172.21.15.151:0/19679998 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f71b0005440 con 0x55861bc786b0 2023-07-21T23:08:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71a2ff5700 1 -- 172.21.15.151:0/19679998 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7f71b0005600 con 0x55861bc786b0 2023-07-21T23:08:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71d8dfdb80 10 client.20019 fetch_fsmap learned FSMap version 116 2023-07-21T23:08:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.753+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/19679998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55861bb9a250 con 0x55861bc786b0 2023-07-21T23:08:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.754+0000 7f71a2ff5700 1 -- 172.21.15.151:0/19679998 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f71b409b5d0 con 0x55861bc786b0 2023-07-21T23:08:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.754+0000 7f71a2ff5700 1 -- 172.21.15.151:0/19679998 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7f71b00049d0 con 0x55861bc786b0 2023-07-21T23:08:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.754+0000 7f71d8dfdb80 10 client.20019 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:08:20.791 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.754+0000 7f71d8dfdb80 10 client.20019 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:08:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.754+0000 7f71d8dfdb80 20 client.20019 populate_metadata read hostname 'smithi151' 2023-07-21T23:08:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.754+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55861be8a630 0x55861be8ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.754+0000 7f71d8dfdb80 4 client.20019 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:08:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.754+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/19679998 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55861bd28ff0 con 0x55861be8a630 2023-07-21T23:08:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.754+0000 7f71be7fc700 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55861be8a630 0x55861be8ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.755+0000 7f71be7fc700 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55861be8a630 0x55861be8ca40 crc :-1 s=READY pgs=538 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d084819a14a2aae4 server_cookie=e02491ac0120d7c5 in_seq=0 out_seq=0 2023-07-21T23:08:20.792 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.755+0000 7f71a2ff5700 10 client.20019 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71a2ff5700 1 -- 172.21.15.151:0/19679998 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55861bd28ff0 con 0x55861be8a630 2023-07-21T23:08:20.816 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71a2ff5700 10 client.20019 handle_command_reply: tid=0 2023-07-21T23:08:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 client.20019 shutdown 2023-07-21T23:08:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/19679998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 msgr2=0x55861be2b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b1e0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f71b0011fd0 tx=0x7f71b0010b60 comp rx=0 tx=0).stop 2023-07-21T23:08:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/19679998 shutdown_connections 2023-07-21T23:08:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55861be8a630 0x55861be8ca40 crc :-1 s=READY pgs=538 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55861be22660 0x55861be296a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.817 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55861bc786b0 0x55861be2b1e0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71a2ff5700 0 client.20019 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 --2- 172.21.15.151:0/19679998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55861be22210 0x55861be2b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/19679998 >> 172.21.15.151:0/19679998 conn(0x55861be11ae0 msgr2=0x55861be23c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/19679998 shutdown_connections 2023-07-21T23:08:20.818 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.785+0000 7f71d8dfdb80 1 -- 172.21.15.151:0/19679998 wait complete. 2023-07-21T23:08:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71d8dfdb80 20 client.20019 trim_cache size 0 max 16384 2023-07-21T23:08:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:08:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:08:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:08:20.819 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:08:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 -- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71a80a12c0 msgr2=0x7f71a80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71a80a12c0 0x7f71a80a3770 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f71b8009fd0 tx=0x7f71b8007610 comp rx=0 tx=0).stop 2023-07-21T23:08:20.820 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 -- 172.21.15.151:0/1687461530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c01004e0 msgr2=0x7f71c0198220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c01004e0 0x7f71c0198220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f71b40098e0 tx=0x7f71b4009580 comp rx=0 tx=0).stop 2023-07-21T23:08:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 -- 172.21.15.151:0/1687461530 shutdown_connections 2023-07-21T23:08:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f71a80a12c0 0x7f71a80a3770 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71c0105b60 0x7f71c019b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f71c00ffb30 0x7f71c0197ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 --2- 172.21.15.151:0/1687461530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c01004e0 0x7f71c0198220 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:20.821 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.786+0000 7f71c53ff700 1 -- 172.21.15.151:0/1687461530 >> 172.21.15.151:0/1687461530 conn(0x7f71c00fb5f0 msgr2=0x7f71c010ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.787+0000 7f71c53ff700 1 -- 172.21.15.151:0/1687461530 shutdown_connections 2023-07-21T23:08:20.822 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:20.787+0000 7f71c53ff700 1 -- 172.21.15.151:0/1687461530 wait complete. 2023-07-21T23:08:21.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:21 smithi187 ceph-mon[96918]: pgmap v1565: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 180 KiB/s wr, 15 op/s 2023-07-21T23:08:21.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:21 smithi195 ceph-mon[97365]: pgmap v1565: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 180 KiB/s wr, 15 op/s 2023-07-21T23:08:21.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:21 smithi151 ceph-mon[95510]: pgmap v1565: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 180 KiB/s wr, 15 op/s 2023-07-21T23:08:23.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:23 smithi187 ceph-mon[96918]: pgmap v1566: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 180 KiB/s wr, 15 op/s 2023-07-21T23:08:23.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:23 smithi195 ceph-mon[97365]: pgmap v1566: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 180 KiB/s wr, 15 op/s 2023-07-21T23:08:23.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:23 smithi151 ceph-mon[95510]: pgmap v1566: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 180 KiB/s wr, 15 op/s 2023-07-21T23:08:25.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:25 smithi187 ceph-mon[96918]: pgmap v1567: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 310 KiB/s wr, 27 op/s 2023-07-21T23:08:25.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:25 smithi195 ceph-mon[97365]: pgmap v1567: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 310 KiB/s wr, 27 op/s 2023-07-21T23:08:25.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:25 smithi151 ceph-mon[95510]: pgmap v1567: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 310 KiB/s wr, 27 op/s 2023-07-21T23:08:27.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:27 smithi187 ceph-mon[96918]: pgmap v1568: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 310 KiB/s wr, 27 op/s 2023-07-21T23:08:27.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:27 smithi195 ceph-mon[97365]: pgmap v1568: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 310 KiB/s wr, 27 op/s 2023-07-21T23:08:27.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:27 smithi151 ceph-mon[95510]: pgmap v1568: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 290 KiB/s rd, 310 KiB/s wr, 27 op/s 2023-07-21T23:08:29.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:29 smithi187 ceph-mon[96918]: pgmap v1569: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 285 KiB/s wr, 25 op/s 2023-07-21T23:08:29.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:29 smithi195 ceph-mon[97365]: pgmap v1569: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 285 KiB/s wr, 25 op/s 2023-07-21T23:08:29.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:29 smithi151 ceph-mon[95510]: pgmap v1569: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 285 KiB/s wr, 25 op/s 2023-07-21T23:08:31.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:31 smithi187 ceph-mon[96918]: pgmap v1570: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 404 KiB/s wr, 31 op/s 2023-07-21T23:08:31.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:31 smithi195 ceph-mon[97365]: pgmap v1570: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 404 KiB/s wr, 31 op/s 2023-07-21T23:08:31.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:31 smithi151 ceph-mon[95510]: pgmap v1570: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 405 KiB/s rd, 404 KiB/s wr, 31 op/s 2023-07-21T23:08:33.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:33 smithi187 ceph-mon[96918]: pgmap v1571: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 295 KiB/s wr, 24 op/s 2023-07-21T23:08:33.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:33 smithi195 ceph-mon[97365]: pgmap v1571: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 295 KiB/s wr, 24 op/s 2023-07-21T23:08:33.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:33 smithi151 ceph-mon[95510]: pgmap v1571: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 356 KiB/s rd, 295 KiB/s wr, 24 op/s 2023-07-21T23:08:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.950+0000 7fae3739d700 1 -- 172.21.15.151:0/2517257244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae30101e50 msgr2=0x7fae3010c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.950+0000 7fae3739d700 1 --2- 172.21.15.151:0/2517257244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae30101e50 0x7fae3010c8a0 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7fae2800b0a0 tx=0x7fae2800b3b0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.950+0000 7fae3739d700 1 -- 172.21.15.151:0/2517257244 shutdown_connections 2023-07-21T23:08:33.983 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.950+0000 7fae3739d700 1 --2- 172.21.15.151:0/2517257244 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae30101e50 0x7fae3010c8a0 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.950+0000 7fae3739d700 1 --2- 172.21.15.151:0/2517257244 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae300ffd20 0x7fae301000f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.950+0000 7fae3739d700 1 --2- 172.21.15.151:0/2517257244 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae301014a0 0x7fae30101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.950+0000 7fae3739d700 1 -- 172.21.15.151:0/2517257244 >> 172.21.15.151:0/2517257244 conn(0x7fae300fb440 msgr2=0x7fae300fd850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.951+0000 7fae3739d700 1 -- 172.21.15.151:0/2517257244 shutdown_connections 2023-07-21T23:08:33.984 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.951+0000 7fae3739d700 1 -- 172.21.15.151:0/2517257244 wait complete. 2023-07-21T23:08:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae3739d700 1 Processor -- start 2023-07-21T23:08:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae3739d700 1 -- start start 2023-07-21T23:08:33.986 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae3739d700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae300ffd20 0x7fae3019b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae3739d700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae301014a0 0x7fae3019be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae3739d700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae30101e50 0x7fae30195940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae3739d700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae30195fb0 con 0x7fae301014a0 2023-07-21T23:08:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae3739d700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae30196120 con 0x7fae300ffd20 2023-07-21T23:08:33.987 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae3739d700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae301962e0 con 0x7fae30101e50 2023-07-21T23:08:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae35b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae301014a0 0x7fae3019be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae35b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae301014a0 0x7fae3019be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52826/0 (socket says 172.21.15.151:52826) 2023-07-21T23:08:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae35b9a700 1 -- 172.21.15.151:0/1312464948 learned_addr learned my addr 172.21.15.151:0/1312464948 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.952+0000 7fae3639b700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae300ffd20 0x7fae3019b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae36b9c700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae30101e50 0x7fae30195940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae35b9a700 1 -- 172.21.15.151:0/1312464948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae30101e50 msgr2=0x7fae30195940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:33.988 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae35b9a700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae30101e50 0x7fae30195940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae35b9a700 1 -- 172.21.15.151:0/1312464948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae300ffd20 msgr2=0x7fae3019b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae35b9a700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae300ffd20 0x7fae3019b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae35b9a700 1 -- 172.21.15.151:0/1312464948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae28009d00 con 0x7fae301014a0 2023-07-21T23:08:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae35b9a700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae301014a0 0x7fae3019be10 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fae2000d950 tx=0x7fae2000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae277fe700 1 -- 172.21.15.151:0/1312464948 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20009940 con 0x7fae301014a0 2023-07-21T23:08:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae3739d700 1 -- 172.21.15.151:0/1312464948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae301965c0 con 0x7fae301014a0 2023-07-21T23:08:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae277fe700 1 -- 172.21.15.151:0/1312464948 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae20010460 con 0x7fae301014a0 2023-07-21T23:08:33.989 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae277fe700 1 -- 172.21.15.151:0/1312464948 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2000f620 con 0x7fae301014a0 2023-07-21T23:08:33.990 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.953+0000 7fae3739d700 1 -- 172.21.15.151:0/1312464948 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae301a28c0 con 0x7fae301014a0 2023-07-21T23:08:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.957+0000 7fae277fe700 1 -- 172.21.15.151:0/1312464948 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fae200105d0 con 0x7fae301014a0 2023-07-21T23:08:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae4bfeab80 1 Processor -- start 2023-07-21T23:08:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae277fe700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fae1c0a12c0 0x7fae1c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:33.991 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae4bfeab80 1 -- start start 2023-07-21T23:08:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae277fe700 1 -- 172.21.15.151:0/1312464948 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fae200ccbb0 con 0x7fae301014a0 2023-07-21T23:08:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d8890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:33.992 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d889a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae36b9c700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fae1c0a12c0 0x7fae1c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d78ec50 con 0x55898d6e56b0 2023-07-21T23:08:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d7e19e0 con 0x55898d8895e0 2023-07-21T23:08:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.958+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d7dae70 con 0x55898d88f480 2023-07-21T23:08:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae3639b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae3639b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52828/0 (socket says 172.21.15.151:52828) 2023-07-21T23:08:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae3639b700 1 -- 172.21.15.151:0/703443302 learned_addr learned my addr 172.21.15.151:0/703443302 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:33.993 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae36b9c700 1 --2- 172.21.15.151:0/703443302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d889a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae35b9a700 1 --2- 172.21.15.151:0/703443302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d8890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae3639b700 1 -- 172.21.15.151:0/703443302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 msgr2=0x55898d8890a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae3639b700 1 --2- 172.21.15.151:0/703443302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d8890a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae3639b700 1 -- 172.21.15.151:0/703443302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 msgr2=0x55898d889a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae3639b700 1 --2- 172.21.15.151:0/703443302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d889a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.994 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae3639b700 1 -- 172.21.15.151:0/703443302 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55898d608d80 con 0x55898d6e56b0 2023-07-21T23:08:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae3639b700 1 --2- 172.21.15.151:0/703443302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88ef40 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00bd70 tx=0x7fae2c0106b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c45e2bc6f3a5ea4 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.959+0000 7fae36b9c700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fae1c0a12c0 0x7fae1c0a3770 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fae280062a0 tx=0x7fae28004a50 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:33.997 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.960+0000 7fae24bfe700 1 -- 172.21.15.151:0/703443302 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c010e10 con 0x55898d6e56b0 2023-07-21T23:08:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.960+0000 7fae24bfe700 1 -- 172.21.15.151:0/703443302 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae2c015070 con 0x55898d6e56b0 2023-07-21T23:08:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.960+0000 7fae24bfe700 1 -- 172.21.15.151:0/703443302 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c0116a0 con 0x55898d6e56b0 2023-07-21T23:08:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.960+0000 7fae4bfeab80 1 -- 172.21.15.151:0/703443302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 msgr2=0x55898d88ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.960+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/703443302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88ef40 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7fae2c00bd70 tx=0x7fae2c0106b0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.998 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.961+0000 7fae4bfeab80 1 -- 172.21.15.151:0/703443302 shutdown_connections 2023-07-21T23:08:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.961+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/703443302 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d889a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.961+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/703443302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88ef40 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.961+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/703443302 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d8890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.961+0000 7fae4bfeab80 1 -- 172.21.15.151:0/703443302 >> 172.21.15.151:0/703443302 conn(0x55898d87ec40 msgr2=0x55898d884300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.961+0000 7fae4bfeab80 1 -- 172.21.15.151:0/703443302 shutdown_connections 2023-07-21T23:08:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.961+0000 7fae4bfeab80 1 -- 172.21.15.151:0/703443302 wait complete. 2023-07-21T23:08:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.961+0000 7fae4bfeab80 1 -- start start 2023-07-21T23:08:33.999 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.961+0000 7fae4bfeab80 1 Processor -- start 2023-07-21T23:08:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d895670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d8928f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d892f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d77aa60 con 0x55898d6e56b0 2023-07-21T23:08:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d77a760 con 0x55898d8895e0 2023-07-21T23:08:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d65e8c0 con 0x55898d88f480 2023-07-21T23:08:34.000 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae4bfeab80 10 client.0 _ll_register_callbacks cb 0x55898d778700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:08:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae3639b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d895670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae3639b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d895670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52840/0 (socket says 172.21.15.151:52840) 2023-07-21T23:08:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae3639b700 1 -- 172.21.15.151:0/2328586398 learned_addr learned my addr 172.21.15.151:0/2328586398 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae35b9a700 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d8928f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae36b9c700 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d892f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae3639b700 1 -- 172.21.15.151:0/2328586398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 msgr2=0x55898d892f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae3639b700 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d892f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.001 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae3639b700 1 -- 172.21.15.151:0/2328586398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 msgr2=0x55898d8928f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae3639b700 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d8928f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.962+0000 7fae3639b700 1 -- 172.21.15.151:0/2328586398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae2c00b9a0 con 0x55898d6e56b0 2023-07-21T23:08:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.963+0000 7fae3639b700 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d895670 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fae2c010ec0 tx=0x7fae2c010ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f115a223c23c4ef server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.963+0000 7fae19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2023-07-21T23:08:34.002 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.963+0000 7fae19ffb700 1 -- 172.21.15.151:0/2328586398 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c01c890 con 0x55898d6e56b0 2023-07-21T23:08:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.963+0000 7fae4bfeab80 1 -- 172.21.15.151:0/2328586398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55898d734490 con 0x55898d6e56b0 2023-07-21T23:08:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.963+0000 7fae19ffb700 1 -- 172.21.15.151:0/2328586398 <== mon.0 v2:172.21.15.151:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fae2c017070 con 0x55898d6e56b0 2023-07-21T23:08:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.963+0000 7fae19ffb700 1 -- 172.21.15.151:0/2328586398 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae2c01c9f0 con 0x55898d6e56b0 2023-07-21T23:08:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.963+0000 7fae4bfeab80 10 client.20031 fetch_fsmap learned FSMap version 116 2023-07-21T23:08:34.003 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.963+0000 7fae4bfeab80 1 -- 172.21.15.151:0/2328586398 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55898d5f1c00 con 0x55898d6e56b0 2023-07-21T23:08:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.964+0000 7fae19ffb700 1 -- 172.21.15.151:0/2328586398 <== mon.0 v2:172.21.15.151:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x55898d734490 con 0x55898d6e56b0 2023-07-21T23:08:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.964+0000 7fae19ffb700 1 -- 172.21.15.151:0/2328586398 <== mon.0 v2:172.21.15.151:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fae2c003a90 con 0x55898d6e56b0 2023-07-21T23:08:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.964+0000 7fae4bfeab80 10 client.20031 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:08:34.004 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.964+0000 7fae4bfeab80 10 client.20031 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:08:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.964+0000 7fae4bfeab80 20 client.20031 populate_metadata read hostname 'smithi151' 2023-07-21T23:08:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.964+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55898d8a2be0 0x55898d8a4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.005 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.964+0000 7fae4bfeab80 4 client.20031 mds_command: new command op to 24599 tid=0[{"prefix": "get_command_descriptions"}] 2023-07-21T23:08:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.964+0000 7fae4bfeab80 1 -- 172.21.15.151:0/2328586398 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55898d7d3e50 con 0x55898d8a2be0 2023-07-21T23:08:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.964+0000 7fae35b9a700 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55898d8a2be0 0x55898d8a4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.965+0000 7fae35b9a700 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55898d8a2be0 0x55898d8a4ff0 crc :-1 s=READY pgs=539 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e716b7376c6e36b server_cookie=302251aff9b9618c in_seq=0 out_seq=0 2023-07-21T23:08:34.006 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.965+0000 7fae19ffb700 10 client.20031 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae19ffb700 1 -- 172.21.15.151:0/2328586398 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+18291 (crc 0 0 0) 0x55898d7d3e50 con 0x55898d8a2be0 2023-07-21T23:08:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae19ffb700 10 client.20031 handle_command_reply: tid=0 2023-07-21T23:08:34.009 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 client.20031 shutdown 2023-07-21T23:08:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 -- 172.21.15.151:0/2328586398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 msgr2=0x55898d895670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d895670 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fae2c010ec0 tx=0x7fae2c010ef0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 -- 172.21.15.151:0/2328586398 shutdown_connections 2023-07-21T23:08:34.010 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55898d8a2be0 0x55898d8a4ff0 crc :-1 s=READY pgs=539 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d892f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d895670 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.011 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae19ffb700 0 client.20031 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/2328586398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d8928f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 -- 172.21.15.151:0/2328586398 >> 172.21.15.151:0/2328586398 conn(0x55898d87ec40 msgr2=0x55898d882cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 -- 172.21.15.151:0/2328586398 shutdown_connections 2023-07-21T23:08:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 1 -- 172.21.15.151:0/2328586398 wait complete. 2023-07-21T23:08:34.012 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.966+0000 7fae4bfeab80 20 client.20031 trim_cache size 0 max 16384 2023-07-21T23:08:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.981+0000 7fae4bfeab80 1 Processor -- start 2023-07-21T23:08:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.981+0000 7fae4bfeab80 1 -- start start 2023-07-21T23:08:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.981+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d6e56b0 0x55898d8890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d8895e0 0x55898d8843f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d899dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.015 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d893ed0 con 0x55898d8895e0 2023-07-21T23:08:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d88f2a0 con 0x55898d6e56b0 2023-07-21T23:08:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d88d620 con 0x55898d88f480 2023-07-21T23:08:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae35b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d8895e0 0x55898d8843f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae35b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d8895e0 0x55898d8843f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52844/0 (socket says 172.21.15.151:52844) 2023-07-21T23:08:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae35b9a700 1 -- 172.21.15.151:0/18363643 learned_addr learned my addr 172.21.15.151:0/18363643 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae35b9a700 1 -- 172.21.15.151:0/18363643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 msgr2=0x55898d899dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:34.016 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae35b9a700 1 --2- 172.21.15.151:0/18363643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d899dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae35b9a700 1 -- 172.21.15.151:0/18363643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d6e56b0 msgr2=0x55898d8890a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae35b9a700 1 --2- 172.21.15.151:0/18363643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d6e56b0 0x55898d8890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae35b9a700 1 -- 172.21.15.151:0/18363643 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55898d62f1f0 con 0x55898d8895e0 2023-07-21T23:08:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.982+0000 7fae35b9a700 1 --2- 172.21.15.151:0/18363643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d8895e0 0x55898d8843f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fae20009520 tx=0x7fae200cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631129c5eb57d173 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae253ff700 1 -- 172.21.15.151:0/18363643 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae200a2090 con 0x55898d8895e0 2023-07-21T23:08:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae253ff700 1 -- 172.21.15.151:0/18363643 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae20097fe0 con 0x55898d8895e0 2023-07-21T23:08:34.017 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae253ff700 1 -- 172.21.15.151:0/18363643 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20099390 con 0x55898d8895e0 2023-07-21T23:08:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae4bfeab80 1 -- 172.21.15.151:0/18363643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d8895e0 msgr2=0x55898d8843f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/18363643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d8895e0 0x55898d8843f0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fae20009520 tx=0x7fae200cc040 comp rx=0 tx=0).stop 2023-07-21T23:08:34.020 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae4bfeab80 1 -- 172.21.15.151:0/18363643 shutdown_connections 2023-07-21T23:08:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/18363643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d6e56b0 0x55898d8890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/18363643 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d899dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/18363643 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d8895e0 0x55898d8843f0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae4bfeab80 1 -- 172.21.15.151:0/18363643 >> 172.21.15.151:0/18363643 conn(0x55898d87ec40 msgr2=0x55898d883ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae4bfeab80 1 -- 172.21.15.151:0/18363643 shutdown_connections 2023-07-21T23:08:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.983+0000 7fae4bfeab80 1 -- 172.21.15.151:0/18363643 wait complete. 2023-07-21T23:08:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.984+0000 7fae4bfeab80 1 -- start start 2023-07-21T23:08:34.021 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.984+0000 7fae4bfeab80 1 Processor -- start 2023-07-21T23:08:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.984+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.984+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d88c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.984+0000 7fae4bfeab80 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d88a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.984+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d88b020 con 0x55898d6e56b0 2023-07-21T23:08:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.984+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d88b190 con 0x55898d8895e0 2023-07-21T23:08:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.984+0000 7fae4bfeab80 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x55898d88b350 con 0x55898d88f480 2023-07-21T23:08:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae4bfeab80 10 client.0 _ll_register_callbacks cb 0x7fae2000bf20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-07-21T23:08:34.022 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae3639b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae35b9a700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d88c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae3639b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:52854/0 (socket says 172.21.15.151:52854) 2023-07-21T23:08:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae3639b700 1 -- 172.21.15.151:0/3356131208 learned_addr learned my addr 172.21.15.151:0/3356131208 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae36b9c700 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d88a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae35b9a700 1 -- 172.21.15.151:0/3356131208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 msgr2=0x55898d88a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae35b9a700 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d88a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.023 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae35b9a700 1 -- 172.21.15.151:0/3356131208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 msgr2=0x55898d88bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-07-21T23:08:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae35b9a700 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae35b9a700 1 -- 172.21.15.151:0/3356131208 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae301a28c0 con 0x55898d8895e0 2023-07-21T23:08:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae36b9c700 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d88a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:08:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae3639b700 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:08:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae35b9a700 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d88c180 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55898d893630 tx=0x7fae20096020 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f35e037e74fa89d6 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.985+0000 7fae19ffb700 10 client.0 ms_handle_connect on v2:172.21.15.187:3300/0 2023-07-21T23:08:34.024 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae19ffb700 1 -- 172.21.15.151:0/3356131208 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae20099340 con 0x55898d8895e0 2023-07-21T23:08:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae19ffb700 1 -- 172.21.15.151:0/3356131208 <== mon.2 v2:172.21.15.187:3300/0 2 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fae200a1c00 con 0x55898d8895e0 2023-07-21T23:08:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae4bfeab80 1 -- 172.21.15.151:0/3356131208 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fae2c015070 con 0x55898d8895e0 2023-07-21T23:08:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae19ffb700 1 -- 172.21.15.151:0/3356131208 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_get_version_reply(handle=1 version=116) v2 ==== 24+0+0 (secure 0 0 0) 0x7fae200a1e00 con 0x55898d8895e0 2023-07-21T23:08:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae4bfeab80 10 client.29684 fetch_fsmap learned FSMap version 116 2023-07-21T23:08:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae4bfeab80 1 -- 172.21.15.151:0/3356131208 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,fsmap=116,monmap=4+}) v3 -- 0x55898d607250 con 0x55898d8895e0 2023-07-21T23:08:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae19ffb700 1 -- 172.21.15.151:0/3356131208 <== mon.2 v2:172.21.15.187:3300/0 4 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fae2c015070 con 0x55898d8895e0 2023-07-21T23:08:34.025 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae19ffb700 1 -- 172.21.15.151:0/3356131208 <== mon.2 v2:172.21.15.187:3300/0 5 ==== fsmap(e 116) v1 ==== 7462+0+0 (secure 0 0 0) 0x7fae20098da0 con 0x55898d8895e0 2023-07-21T23:08:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae4bfeab80 10 client.29684 fetch_fsmap finished waiting for FSMap version 116 2023-07-21T23:08:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae4bfeab80 10 client.29684 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2023-07-21T23:08:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae4bfeab80 20 client.29684 populate_metadata read hostname 'smithi151' 2023-07-21T23:08:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55898d8f7910 0x55898d8f9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae4bfeab80 4 client.29684 mds_command: new command op to 24599 tid=0[{"prefix": "flush journal"}] 2023-07-21T23:08:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.986+0000 7fae4bfeab80 1 -- 172.21.15.151:0/3356131208 --> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] -- command(tid 0: {"prefix": "flush journal"}) v1 -- 0x55898d795ff0 con 0x55898d8f7910 2023-07-21T23:08:34.026 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.987+0000 7fae3639b700 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55898d8f7910 0x55898d8f9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.987+0000 7fae19ffb700 10 client.29684 ms_handle_connect on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:34.027 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:33.987+0000 7fae3639b700 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55898d8f7910 0x55898d8f9d20 crc :-1 s=READY pgs=540 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=326b663b885cb6b7 server_cookie=a6fdce35a5e5b472 in_seq=0 out_seq=0 2023-07-21T23:08:34.051 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae19ffb700 1 -- 172.21.15.151:0/3356131208 <== mds.0 v2:172.21.15.187:6838/1236119832 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+44 (crc 0 0 0) 0x55898d795ff0 con 0x55898d8f7910 2023-07-21T23:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae19ffb700 10 client.29684 handle_command_reply: tid=0 2023-07-21T23:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae4bfeab80 1 client.29684 shutdown 2023-07-21T23:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae4bfeab80 1 -- 172.21.15.151:0/3356131208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 msgr2=0x55898d88c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d88c180 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x55898d893630 tx=0x7fae20096020 comp rx=0 tx=0).stop 2023-07-21T23:08:34.052 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae4bfeab80 1 -- 172.21.15.151:0/3356131208 shutdown_connections 2023-07-21T23:08:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.187:6838/1236119832,v1:172.21.15.187:6839/1236119832] conn(0x55898d8f7910 0x55898d8f9d20 crc :-1 s=READY pgs=540 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x55898d88f480 0x55898d88a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55898d6e56b0 0x55898d88bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae4bfeab80 1 --2- 172.21.15.151:0/3356131208 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55898d8895e0 0x55898d88c180 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae19ffb700 0 client.29684 ms_handle_reset on v2:172.21.15.187:6838/1236119832 2023-07-21T23:08:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.019+0000 7fae4bfeab80 1 -- 172.21.15.151:0/3356131208 >> 172.21.15.151:0/3356131208 conn(0x55898d87ec40 msgr2=0x55898d882cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.020+0000 7fae4bfeab80 1 -- 172.21.15.151:0/3356131208 shutdown_connections 2023-07-21T23:08:34.053 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.020+0000 7fae4bfeab80 1 -- 172.21.15.151:0/3356131208 wait complete. 2023-07-21T23:08:34.054 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.020+0000 7fae4bfeab80 20 client.29684 trim_cache size 0 max 16384 2023-07-21T23:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:{ 2023-07-21T23:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "message": "", 2023-07-21T23:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout: "return_code": 0 2023-07-21T23:08:34.055 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stdout:} 2023-07-21T23:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.020+0000 7fae3739d700 1 -- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fae1c0a12c0 msgr2=0x7fae1c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.020+0000 7fae3739d700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fae1c0a12c0 0x7fae1c0a3770 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fae280062a0 tx=0x7fae28004a50 comp rx=0 tx=0).stop 2023-07-21T23:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.020+0000 7fae3739d700 1 -- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae301014a0 msgr2=0x7fae3019be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.020+0000 7fae3739d700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae301014a0 0x7fae3019be10 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7fae2000d950 tx=0x7fae2000dc60 comp rx=0 tx=0).stop 2023-07-21T23:08:34.056 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.021+0000 7fae3739d700 1 -- 172.21.15.151:0/1312464948 shutdown_connections 2023-07-21T23:08:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.021+0000 7fae3739d700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fae1c0a12c0 0x7fae1c0a3770 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.021+0000 7fae3739d700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae300ffd20 0x7fae3019b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.021+0000 7fae3739d700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fae30101e50 0x7fae30195940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.021+0000 7fae3739d700 1 --2- 172.21.15.151:0/1312464948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae301014a0 0x7fae3019be10 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.021+0000 7fae3739d700 1 -- 172.21.15.151:0/1312464948 >> 172.21.15.151:0/1312464948 conn(0x7fae300fb440 msgr2=0x7fae301045c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.021+0000 7fae3739d700 1 -- 172.21.15.151:0/1312464948 shutdown_connections 2023-07-21T23:08:34.057 INFO:teuthology.task.background_exec.ubuntu@smithi151.front.sepia.ceph.com.smithi151.stderr:2023-07-21T23:08:34.021+0000 7fae3739d700 1 -- 172.21.15.151:0/1312464948 wait complete. 2023-07-21T23:08:35.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:35 smithi187 ceph-mon[96918]: pgmap v1572: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 328 KiB/s wr, 29 op/s 2023-07-21T23:08:35.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:35 smithi195 ceph-mon[97365]: pgmap v1572: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 328 KiB/s wr, 29 op/s 2023-07-21T23:08:35.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:35 smithi151 ceph-mon[95510]: pgmap v1572: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 328 KiB/s wr, 29 op/s 2023-07-21T23:08:37.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:37 smithi187 ceph-mon[96918]: pgmap v1573: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 179 KiB/s wr, 15 op/s 2023-07-21T23:08:37.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:37 smithi195 ceph-mon[97365]: pgmap v1573: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 179 KiB/s wr, 15 op/s 2023-07-21T23:08:37.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:37 smithi151 ceph-mon[95510]: pgmap v1573: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 179 KiB/s wr, 15 op/s 2023-07-21T23:08:39.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:39 smithi187 ceph-mon[96918]: pgmap v1574: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 179 KiB/s wr, 15 op/s 2023-07-21T23:08:39.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:39 smithi195 ceph-mon[97365]: pgmap v1574: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 179 KiB/s wr, 15 op/s 2023-07-21T23:08:39.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:39 smithi151 ceph-mon[95510]: pgmap v1574: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 179 KiB/s wr, 15 op/s 2023-07-21T23:08:41.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2023-07-21T23:08:41.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:41 smithi187 ceph-mon[96918]: pgmap v1575: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 314 KiB/s wr, 28 op/s 2023-07-21T23:08:41.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:41 smithi195 ceph-mon[97365]: pgmap v1575: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 314 KiB/s wr, 28 op/s 2023-07-21T23:08:41.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:41 smithi151 ceph-mon[95510]: pgmap v1575: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 307 KiB/s rd, 314 KiB/s wr, 28 op/s 2023-07-21T23:08:42.172 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/: 2023-07-21T23:08:42.172 INFO:teuthology.orchestra.run.smithi151.stdout:total 2 2023-07-21T23:08:42.173 INFO:teuthology.orchestra.run.smithi151.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 9005939077 Jul 21 22:19 . 2023-07-21T23:08:42.173 INFO:teuthology.orchestra.run.smithi151.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 9005939077 Jul 21 22:19 .. 2023-07-21T23:08:42.173 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 data 2023-07-21T23:08:42.173 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:42.173 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data: 2023-07-21T23:08:42.173 INFO:teuthology.orchestra.run.smithi151.stdout:total 41 2023-07-21T23:08:42.173 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 . 2023-07-21T23:08:42.174 INFO:teuthology.orchestra.run.smithi151.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 9005939077 Jul 21 22:19 .. 2023-07-21T23:08:42.174 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7914635405 Jul 21 22:50 base 2023-07-21T23:08:42.174 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Jul 21 22:19 current_logfiles 2023-07-21T23:08:42.174 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Jul 21 22:19 global 2023-07-21T23:08:42.174 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 627 Jul 21 22:19 log 2023-07-21T23:08:42.174 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_commit_ts 2023-07-21T23:08:42.174 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_dynshmem 2023-07-21T23:08:42.175 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4269 Jul 21 22:19 pg_hba.conf 2023-07-21T23:08:42.175 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Jul 21 22:19 pg_ident.conf 2023-07-21T23:08:42.175 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 23:08 pg_logical 2023-07-21T23:08:42.175 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 pg_multixact 2023-07-21T23:08:42.175 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 pg_notify 2023-07-21T23:08:42.175 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_replslot 2023-07-21T23:08:42.175 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_serial 2023-07-21T23:08:42.176 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_snapshots 2023-07-21T23:08:42.176 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jul 21 23:08 pg_stat 2023-07-21T23:08:42.177 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jul 21 23:08 pg_stat_tmp 2023-07-21T23:08:42.177 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 21 23:07 pg_subtrans 2023-07-21T23:08:42.177 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_tblspc 2023-07-21T23:08:42.177 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 pg_twophase 2023-07-21T23:08:42.177 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 21 22:19 PG_VERSION 2023-07-21T23:08:42.177 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1090519040 Jul 21 23:08 pg_wal 2023-07-21T23:08:42.177 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 21 22:19 pg_xact 2023-07-21T23:08:42.177 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Jul 21 22:19 postgresql.auto.conf 2023-07-21T23:08:42.178 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 22989 Jul 21 22:19 postgresql.conf 2023-07-21T23:08:42.178 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Jul 21 22:19 postmaster.opts 2023-07-21T23:08:42.178 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:42.178 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/base: 2023-07-21T23:08:42.178 INFO:teuthology.orchestra.run.smithi151.stdout:total 3 2023-07-21T23:08:42.178 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7914635405 Jul 21 22:50 . 2023-07-21T23:08:42.178 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:42.179 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 1 2023-07-21T23:08:42.179 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 12346 2023-07-21T23:08:42.179 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7899872391 Jul 21 22:54 12347 2023-07-21T23:08:42.180 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:52 pgsql_tmp 2023-07-21T23:08:42.180 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:42.180 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/base/1: 2023-07-21T23:08:42.181 INFO:teuthology.orchestra.run.smithi151.stdout:total 7210 2023-07-21T23:08:42.181 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 . 2023-07-21T23:08:42.181 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7914635405 Jul 21 22:50 .. 2023-07-21T23:08:42.181 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 112 2023-07-21T23:08:42.182 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 113 2023-07-21T23:08:42.182 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 21 22:19 12182 2023-07-21T23:08:42.182 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12182_fsm 2023-07-21T23:08:42.182 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12182_vm 2023-07-21T23:08:42.183 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12184 2023-07-21T23:08:42.183 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12186 2023-07-21T23:08:42.183 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187 2023-07-21T23:08:42.184 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12187_fsm 2023-07-21T23:08:42.184 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187_vm 2023-07-21T23:08:42.184 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12189 2023-07-21T23:08:42.185 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12191 2023-07-21T23:08:42.185 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192 2023-07-21T23:08:42.185 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12192_fsm 2023-07-21T23:08:42.186 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192_vm 2023-07-21T23:08:42.186 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12194 2023-07-21T23:08:42.187 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12196 2023-07-21T23:08:42.187 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197 2023-07-21T23:08:42.187 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12197_fsm 2023-07-21T23:08:42.187 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197_vm 2023-07-21T23:08:42.188 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12199 2023-07-21T23:08:42.188 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12201 2023-07-21T23:08:42.188 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202 2023-07-21T23:08:42.188 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12202_fsm 2023-07-21T23:08:42.189 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202_vm 2023-07-21T23:08:42.189 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12204 2023-07-21T23:08:42.189 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12206 2023-07-21T23:08:42.190 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207 2023-07-21T23:08:42.190 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12207_fsm 2023-07-21T23:08:42.190 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207_vm 2023-07-21T23:08:42.190 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12209 2023-07-21T23:08:42.190 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12211 2023-07-21T23:08:42.191 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12212 2023-07-21T23:08:42.191 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12214 2023-07-21T23:08:42.191 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12216 2023-07-21T23:08:42.191 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 21 22:19 1247 2023-07-21T23:08:42.191 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1247_fsm 2023-07-21T23:08:42.191 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1247_vm 2023-07-21T23:08:42.191 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 21 22:19 1249 2023-07-21T23:08:42.192 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1249_fsm 2023-07-21T23:08:42.192 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1249_vm 2023-07-21T23:08:42.192 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 21 22:19 1255 2023-07-21T23:08:42.192 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1255_fsm 2023-07-21T23:08:42.192 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1255_vm 2023-07-21T23:08:42.193 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 21 22:19 1259 2023-07-21T23:08:42.193 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1259_fsm 2023-07-21T23:08:42.193 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1259_vm 2023-07-21T23:08:42.193 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417 2023-07-21T23:08:42.193 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417_vm 2023-07-21T23:08:42.193 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418 2023-07-21T23:08:42.193 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418_vm 2023-07-21T23:08:42.193 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 174 2023-07-21T23:08:42.194 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 175 2023-07-21T23:08:42.194 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2187 2023-07-21T23:08:42.194 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224 2023-07-21T23:08:42.194 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224_vm 2023-07-21T23:08:42.194 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328 2023-07-21T23:08:42.194 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328_vm 2023-07-21T23:08:42.194 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336 2023-07-21T23:08:42.195 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336_vm 2023-07-21T23:08:42.195 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2337 2023-07-21T23:08:42.195 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2600 2023-07-21T23:08:42.195 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2600_fsm 2023-07-21T23:08:42.195 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2600_vm 2023-07-21T23:08:42.196 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601 2023-07-21T23:08:42.196 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2601_fsm 2023-07-21T23:08:42.196 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601_vm 2023-07-21T23:08:42.196 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2602 2023-07-21T23:08:42.197 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2602_fsm 2023-07-21T23:08:42.197 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2602_vm 2023-07-21T23:08:42.198 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2603 2023-07-21T23:08:42.198 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2603_fsm 2023-07-21T23:08:42.198 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2603_vm 2023-07-21T23:08:42.198 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604 2023-07-21T23:08:42.199 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604_vm 2023-07-21T23:08:42.199 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2605 2023-07-21T23:08:42.199 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2605_fsm 2023-07-21T23:08:42.200 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2605_vm 2023-07-21T23:08:42.200 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606 2023-07-21T23:08:42.200 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2606_fsm 2023-07-21T23:08:42.200 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606_vm 2023-07-21T23:08:42.201 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607 2023-07-21T23:08:42.201 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607_fsm 2023-07-21T23:08:42.201 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2607_vm 2023-07-21T23:08:42.201 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 21 22:19 2608 2023-07-21T23:08:42.201 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2608_fsm 2023-07-21T23:08:42.202 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2608_vm 2023-07-21T23:08:42.202 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 21 22:19 2609 2023-07-21T23:08:42.202 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2609_fsm 2023-07-21T23:08:42.202 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2609_vm 2023-07-21T23:08:42.203 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610 2023-07-21T23:08:42.203 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610_fsm 2023-07-21T23:08:42.203 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2610_vm 2023-07-21T23:08:42.203 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611 2023-07-21T23:08:42.203 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611_vm 2023-07-21T23:08:42.204 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612 2023-07-21T23:08:42.204 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2612_fsm 2023-07-21T23:08:42.204 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612_vm 2023-07-21T23:08:42.204 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613 2023-07-21T23:08:42.205 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613_vm 2023-07-21T23:08:42.205 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615 2023-07-21T23:08:42.205 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2615_fsm 2023-07-21T23:08:42.205 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615_vm 2023-07-21T23:08:42.206 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616 2023-07-21T23:08:42.206 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616_fsm 2023-07-21T23:08:42.206 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2616_vm 2023-07-21T23:08:42.206 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 21 22:19 2617 2023-07-21T23:08:42.206 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2617_fsm 2023-07-21T23:08:42.207 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2617_vm 2023-07-21T23:08:42.207 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 21 22:19 2618 2023-07-21T23:08:42.208 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2618_fsm 2023-07-21T23:08:42.208 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2618_vm 2023-07-21T23:08:42.208 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 21 22:19 2619 2023-07-21T23:08:42.208 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2619_fsm 2023-07-21T23:08:42.209 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2619_vm 2023-07-21T23:08:42.209 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620 2023-07-21T23:08:42.209 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620_vm 2023-07-21T23:08:42.210 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2650 2023-07-21T23:08:42.210 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2651 2023-07-21T23:08:42.210 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2652 2023-07-21T23:08:42.210 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2653 2023-07-21T23:08:42.211 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2654 2023-07-21T23:08:42.211 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2655 2023-07-21T23:08:42.211 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2656 2023-07-21T23:08:42.211 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2657 2023-07-21T23:08:42.211 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 21 22:19 2658 2023-07-21T23:08:42.212 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2659 2023-07-21T23:08:42.212 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2660 2023-07-21T23:08:42.212 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2661 2023-07-21T23:08:42.212 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2662 2023-07-21T23:08:42.212 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2663 2023-07-21T23:08:42.212 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2664 2023-07-21T23:08:42.212 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2665 2023-07-21T23:08:42.213 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2666 2023-07-21T23:08:42.213 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2667 2023-07-21T23:08:42.213 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2668 2023-07-21T23:08:42.213 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2669 2023-07-21T23:08:42.213 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2670 2023-07-21T23:08:42.213 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Jul 21 22:19 2673 2023-07-21T23:08:42.213 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 21 22:19 2674 2023-07-21T23:08:42.213 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 21 22:19 2675 2023-07-21T23:08:42.214 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2678 2023-07-21T23:08:42.214 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2679 2023-07-21T23:08:42.214 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2680 2023-07-21T23:08:42.214 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2681 2023-07-21T23:08:42.214 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2682 2023-07-21T23:08:42.214 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2683 2023-07-21T23:08:42.214 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2684 2023-07-21T23:08:42.214 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2685 2023-07-21T23:08:42.215 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2686 2023-07-21T23:08:42.215 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2687 2023-07-21T23:08:42.215 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2688 2023-07-21T23:08:42.215 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2689 2023-07-21T23:08:42.215 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2690 2023-07-21T23:08:42.215 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 21 22:19 2691 2023-07-21T23:08:42.215 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2692 2023-07-21T23:08:42.215 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2693 2023-07-21T23:08:42.216 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2696 2023-07-21T23:08:42.216 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2699 2023-07-21T23:08:42.216 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2701 2023-07-21T23:08:42.216 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2702 2023-07-21T23:08:42.216 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2703 2023-07-21T23:08:42.216 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2704 2023-07-21T23:08:42.216 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2753 2023-07-21T23:08:42.217 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2753_fsm 2023-07-21T23:08:42.217 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2753_vm 2023-07-21T23:08:42.217 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2754 2023-07-21T23:08:42.217 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2755 2023-07-21T23:08:42.217 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2756 2023-07-21T23:08:42.217 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2757 2023-07-21T23:08:42.217 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830 2023-07-21T23:08:42.217 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830_vm 2023-07-21T23:08:42.218 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2831 2023-07-21T23:08:42.218 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832 2023-07-21T23:08:42.218 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832_vm 2023-07-21T23:08:42.218 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2833 2023-07-21T23:08:42.219 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834 2023-07-21T23:08:42.219 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834_vm 2023-07-21T23:08:42.219 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2835 2023-07-21T23:08:42.219 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836 2023-07-21T23:08:42.219 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836_vm 2023-07-21T23:08:42.219 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2837 2023-07-21T23:08:42.219 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 21 22:19 2838 2023-07-21T23:08:42.220 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2838_fsm 2023-07-21T23:08:42.220 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2838_vm 2023-07-21T23:08:42.220 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2839 2023-07-21T23:08:42.220 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840 2023-07-21T23:08:42.220 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840_fsm 2023-07-21T23:08:42.220 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2840_vm 2023-07-21T23:08:42.220 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2841 2023-07-21T23:08:42.221 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995 2023-07-21T23:08:42.221 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995_vm 2023-07-21T23:08:42.221 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2996 2023-07-21T23:08:42.221 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079 2023-07-21T23:08:42.221 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3079_fsm 2023-07-21T23:08:42.221 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079_vm 2023-07-21T23:08:42.221 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3080 2023-07-21T23:08:42.221 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3081 2023-07-21T23:08:42.222 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3085 2023-07-21T23:08:42.222 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118 2023-07-21T23:08:42.222 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118_vm 2023-07-21T23:08:42.222 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3119 2023-07-21T23:08:42.222 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3164 2023-07-21T23:08:42.222 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256 2023-07-21T23:08:42.222 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256_vm 2023-07-21T23:08:42.222 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3257 2023-07-21T23:08:42.223 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3258 2023-07-21T23:08:42.223 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350 2023-07-21T23:08:42.223 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350_vm 2023-07-21T23:08:42.223 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3351 2023-07-21T23:08:42.223 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3379 2023-07-21T23:08:42.224 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3380 2023-07-21T23:08:42.224 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381 2023-07-21T23:08:42.224 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381_vm 2023-07-21T23:08:42.224 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3394 2023-07-21T23:08:42.225 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3394_fsm 2023-07-21T23:08:42.225 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3394_vm 2023-07-21T23:08:42.225 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3395 2023-07-21T23:08:42.226 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439 2023-07-21T23:08:42.226 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439_vm 2023-07-21T23:08:42.226 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3440 2023-07-21T23:08:42.226 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 3455 2023-07-21T23:08:42.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3456 2023-07-21T23:08:42.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3456_fsm 2023-07-21T23:08:42.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3456_vm 2023-07-21T23:08:42.227 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466 2023-07-21T23:08:42.228 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466_vm 2023-07-21T23:08:42.229 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3467 2023-07-21T23:08:42.229 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3468 2023-07-21T23:08:42.229 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501 2023-07-21T23:08:42.229 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501_vm 2023-07-21T23:08:42.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3502 2023-07-21T23:08:42.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3503 2023-07-21T23:08:42.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3534 2023-07-21T23:08:42.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541 2023-07-21T23:08:42.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3541_fsm 2023-07-21T23:08:42.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541_vm 2023-07-21T23:08:42.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3542 2023-07-21T23:08:42.230 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3574 2023-07-21T23:08:42.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3575 2023-07-21T23:08:42.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576 2023-07-21T23:08:42.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576_vm 2023-07-21T23:08:42.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596 2023-07-21T23:08:42.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596_vm 2023-07-21T23:08:42.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3597 2023-07-21T23:08:42.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598 2023-07-21T23:08:42.231 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598_vm 2023-07-21T23:08:42.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3599 2023-07-21T23:08:42.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600 2023-07-21T23:08:42.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3600_fsm 2023-07-21T23:08:42.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600_vm 2023-07-21T23:08:42.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601 2023-07-21T23:08:42.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3601_fsm 2023-07-21T23:08:42.232 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601_vm 2023-07-21T23:08:42.233 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602 2023-07-21T23:08:42.233 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3602_fsm 2023-07-21T23:08:42.233 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602_vm 2023-07-21T23:08:42.233 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3603 2023-07-21T23:08:42.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3603_fsm 2023-07-21T23:08:42.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3603_vm 2023-07-21T23:08:42.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3604 2023-07-21T23:08:42.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3605 2023-07-21T23:08:42.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3606 2023-07-21T23:08:42.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3607 2023-07-21T23:08:42.234 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3608 2023-07-21T23:08:42.235 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 3609 2023-07-21T23:08:42.235 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3712 2023-07-21T23:08:42.235 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764 2023-07-21T23:08:42.235 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3764_fsm 2023-07-21T23:08:42.235 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764_vm 2023-07-21T23:08:42.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3766 2023-07-21T23:08:42.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3767 2023-07-21T23:08:42.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3997 2023-07-21T23:08:42.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 5002 2023-07-21T23:08:42.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 548 2023-07-21T23:08:42.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 549 2023-07-21T23:08:42.236 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102 2023-07-21T23:08:42.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102_vm 2023-07-21T23:08:42.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104 2023-07-21T23:08:42.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104_vm 2023-07-21T23:08:42.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106 2023-07-21T23:08:42.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106_vm 2023-07-21T23:08:42.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6110 2023-07-21T23:08:42.237 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6111 2023-07-21T23:08:42.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6112 2023-07-21T23:08:42.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6113 2023-07-21T23:08:42.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6117 2023-07-21T23:08:42.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826 2023-07-21T23:08:42.238 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826_vm 2023-07-21T23:08:42.745 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 827 2023-07-21T23:08:42.745 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 828 2023-07-21T23:08:42.745 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 21 22:19 pg_filenode.map 2023-07-21T23:08:42.745 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 21 22:19 PG_VERSION 2023-07-21T23:08:42.746 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:42.746 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/base/12346: 2023-07-21T23:08:42.746 INFO:teuthology.orchestra.run.smithi151.stdout:total 7210 2023-07-21T23:08:42.746 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7381507 Jul 21 22:19 . 2023-07-21T23:08:42.746 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7914635405 Jul 21 22:50 .. 2023-07-21T23:08:42.746 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 112 2023-07-21T23:08:42.746 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 113 2023-07-21T23:08:42.746 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 21 22:19 12182 2023-07-21T23:08:42.747 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12182_fsm 2023-07-21T23:08:42.747 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12182_vm 2023-07-21T23:08:42.747 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12184 2023-07-21T23:08:42.747 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12186 2023-07-21T23:08:42.747 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187 2023-07-21T23:08:42.747 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12187_fsm 2023-07-21T23:08:42.747 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187_vm 2023-07-21T23:08:42.748 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12189 2023-07-21T23:08:42.748 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12191 2023-07-21T23:08:42.748 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192 2023-07-21T23:08:42.748 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12192_fsm 2023-07-21T23:08:42.748 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192_vm 2023-07-21T23:08:42.748 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12194 2023-07-21T23:08:42.748 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12196 2023-07-21T23:08:42.749 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197 2023-07-21T23:08:42.749 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12197_fsm 2023-07-21T23:08:42.749 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197_vm 2023-07-21T23:08:42.749 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12199 2023-07-21T23:08:42.749 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12201 2023-07-21T23:08:42.749 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202 2023-07-21T23:08:42.749 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12202_fsm 2023-07-21T23:08:42.749 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202_vm 2023-07-21T23:08:42.750 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12204 2023-07-21T23:08:42.750 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12206 2023-07-21T23:08:42.750 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207 2023-07-21T23:08:42.750 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12207_fsm 2023-07-21T23:08:42.750 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207_vm 2023-07-21T23:08:42.750 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12209 2023-07-21T23:08:42.750 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12211 2023-07-21T23:08:42.751 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12212 2023-07-21T23:08:42.751 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12214 2023-07-21T23:08:42.751 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12216 2023-07-21T23:08:42.751 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 21 22:19 1247 2023-07-21T23:08:42.751 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1247_fsm 2023-07-21T23:08:42.751 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1247_vm 2023-07-21T23:08:42.751 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 21 22:19 1249 2023-07-21T23:08:42.751 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1249_fsm 2023-07-21T23:08:42.752 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1249_vm 2023-07-21T23:08:42.752 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 21 22:19 1255 2023-07-21T23:08:42.752 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1255_fsm 2023-07-21T23:08:42.752 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1255_vm 2023-07-21T23:08:42.752 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 21 22:19 1259 2023-07-21T23:08:42.752 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1259_fsm 2023-07-21T23:08:42.752 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1259_vm 2023-07-21T23:08:42.753 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417 2023-07-21T23:08:42.753 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417_vm 2023-07-21T23:08:42.753 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418 2023-07-21T23:08:42.753 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418_vm 2023-07-21T23:08:42.753 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 174 2023-07-21T23:08:42.753 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 175 2023-07-21T23:08:42.753 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2187 2023-07-21T23:08:42.753 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224 2023-07-21T23:08:42.754 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224_vm 2023-07-21T23:08:42.754 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328 2023-07-21T23:08:42.754 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328_vm 2023-07-21T23:08:42.754 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336 2023-07-21T23:08:42.754 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336_vm 2023-07-21T23:08:42.755 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2337 2023-07-21T23:08:42.755 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2600 2023-07-21T23:08:42.755 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2600_fsm 2023-07-21T23:08:42.755 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2600_vm 2023-07-21T23:08:42.755 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601 2023-07-21T23:08:42.755 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2601_fsm 2023-07-21T23:08:42.755 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601_vm 2023-07-21T23:08:42.755 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2602 2023-07-21T23:08:42.756 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2602_fsm 2023-07-21T23:08:42.756 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2602_vm 2023-07-21T23:08:42.756 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2603 2023-07-21T23:08:42.756 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2603_fsm 2023-07-21T23:08:42.756 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2603_vm 2023-07-21T23:08:42.756 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604 2023-07-21T23:08:42.756 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604_vm 2023-07-21T23:08:42.757 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2605 2023-07-21T23:08:42.757 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2605_fsm 2023-07-21T23:08:42.757 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2605_vm 2023-07-21T23:08:42.757 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606 2023-07-21T23:08:42.757 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2606_fsm 2023-07-21T23:08:42.757 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2606_vm 2023-07-21T23:08:42.757 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607 2023-07-21T23:08:42.758 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607_fsm 2023-07-21T23:08:42.758 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2607_vm 2023-07-21T23:08:42.758 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 442368 Jul 21 22:19 2608 2023-07-21T23:08:42.758 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2608_fsm 2023-07-21T23:08:42.758 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2608_vm 2023-07-21T23:08:42.758 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 21 22:19 2609 2023-07-21T23:08:42.758 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2609_fsm 2023-07-21T23:08:42.758 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2609_vm 2023-07-21T23:08:42.759 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610 2023-07-21T23:08:42.759 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2610_fsm 2023-07-21T23:08:42.759 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2610_vm 2023-07-21T23:08:42.759 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611 2023-07-21T23:08:42.759 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611_vm 2023-07-21T23:08:42.759 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612 2023-07-21T23:08:42.759 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2612_fsm 2023-07-21T23:08:42.759 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612_vm 2023-07-21T23:08:42.760 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613 2023-07-21T23:08:42.760 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613_vm 2023-07-21T23:08:42.760 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615 2023-07-21T23:08:42.760 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2615_fsm 2023-07-21T23:08:42.760 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615_vm 2023-07-21T23:08:42.760 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616 2023-07-21T23:08:42.760 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616_fsm 2023-07-21T23:08:42.761 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2616_vm 2023-07-21T23:08:42.761 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 21 22:19 2617 2023-07-21T23:08:42.761 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2617_fsm 2023-07-21T23:08:42.761 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2617_vm 2023-07-21T23:08:42.761 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 21 22:19 2618 2023-07-21T23:08:42.761 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2618_fsm 2023-07-21T23:08:42.762 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2618_vm 2023-07-21T23:08:42.762 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Jul 21 22:19 2619 2023-07-21T23:08:42.762 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2619_fsm 2023-07-21T23:08:42.762 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2619_vm 2023-07-21T23:08:42.762 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620 2023-07-21T23:08:42.762 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620_vm 2023-07-21T23:08:42.762 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2650 2023-07-21T23:08:42.762 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2651 2023-07-21T23:08:42.763 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2652 2023-07-21T23:08:42.763 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2653 2023-07-21T23:08:42.763 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2654 2023-07-21T23:08:42.763 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2655 2023-07-21T23:08:42.763 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2656 2023-07-21T23:08:42.763 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2657 2023-07-21T23:08:42.763 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Jul 21 22:19 2658 2023-07-21T23:08:42.763 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2659 2023-07-21T23:08:42.764 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2660 2023-07-21T23:08:42.764 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2661 2023-07-21T23:08:42.764 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2662 2023-07-21T23:08:42.764 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2663 2023-07-21T23:08:42.764 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2664 2023-07-21T23:08:42.764 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2665 2023-07-21T23:08:42.765 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2666 2023-07-21T23:08:42.765 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2667 2023-07-21T23:08:42.765 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2668 2023-07-21T23:08:42.765 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2669 2023-07-21T23:08:42.765 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2670 2023-07-21T23:08:42.765 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Jul 21 22:19 2673 2023-07-21T23:08:42.766 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 21 22:19 2674 2023-07-21T23:08:42.766 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 21 22:19 2675 2023-07-21T23:08:42.766 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2678 2023-07-21T23:08:42.766 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2679 2023-07-21T23:08:42.766 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2680 2023-07-21T23:08:42.766 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2681 2023-07-21T23:08:42.766 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2682 2023-07-21T23:08:42.766 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2683 2023-07-21T23:08:42.767 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2684 2023-07-21T23:08:42.767 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2685 2023-07-21T23:08:42.767 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2686 2023-07-21T23:08:42.767 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2687 2023-07-21T23:08:42.767 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2688 2023-07-21T23:08:42.767 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2689 2023-07-21T23:08:42.767 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2690 2023-07-21T23:08:42.767 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 21 22:19 2691 2023-07-21T23:08:42.768 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2692 2023-07-21T23:08:42.768 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2693 2023-07-21T23:08:42.768 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2696 2023-07-21T23:08:42.768 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2699 2023-07-21T23:08:42.768 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2701 2023-07-21T23:08:42.768 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2702 2023-07-21T23:08:42.768 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2703 2023-07-21T23:08:42.769 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2704 2023-07-21T23:08:42.769 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2753 2023-07-21T23:08:42.769 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2753_fsm 2023-07-21T23:08:42.769 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2753_vm 2023-07-21T23:08:42.769 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2754 2023-07-21T23:08:42.769 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2755 2023-07-21T23:08:42.769 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2756 2023-07-21T23:08:42.769 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2757 2023-07-21T23:08:42.770 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830 2023-07-21T23:08:42.770 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830_vm 2023-07-21T23:08:42.770 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2831 2023-07-21T23:08:42.770 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832 2023-07-21T23:08:42.770 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832_vm 2023-07-21T23:08:42.770 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2833 2023-07-21T23:08:42.770 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834 2023-07-21T23:08:42.771 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834_vm 2023-07-21T23:08:42.771 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2835 2023-07-21T23:08:42.771 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836 2023-07-21T23:08:42.771 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836_vm 2023-07-21T23:08:42.771 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2837 2023-07-21T23:08:42.771 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 21 22:19 2838 2023-07-21T23:08:42.771 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2838_fsm 2023-07-21T23:08:42.771 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2838_vm 2023-07-21T23:08:42.772 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2839 2023-07-21T23:08:42.772 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840 2023-07-21T23:08:42.772 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840_fsm 2023-07-21T23:08:42.772 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2840_vm 2023-07-21T23:08:42.772 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2841 2023-07-21T23:08:42.772 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995 2023-07-21T23:08:42.772 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995_vm 2023-07-21T23:08:42.773 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2996 2023-07-21T23:08:42.773 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079 2023-07-21T23:08:42.773 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3079_fsm 2023-07-21T23:08:42.773 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079_vm 2023-07-21T23:08:42.773 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3080 2023-07-21T23:08:42.773 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3081 2023-07-21T23:08:42.774 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3085 2023-07-21T23:08:42.774 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118 2023-07-21T23:08:42.774 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118_vm 2023-07-21T23:08:42.774 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3119 2023-07-21T23:08:42.774 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3164 2023-07-21T23:08:42.774 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256 2023-07-21T23:08:42.774 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256_vm 2023-07-21T23:08:42.774 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3257 2023-07-21T23:08:42.775 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3258 2023-07-21T23:08:42.775 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350 2023-07-21T23:08:42.775 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350_vm 2023-07-21T23:08:42.775 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3351 2023-07-21T23:08:42.775 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3379 2023-07-21T23:08:42.775 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3380 2023-07-21T23:08:42.776 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381 2023-07-21T23:08:42.776 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381_vm 2023-07-21T23:08:42.776 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3394 2023-07-21T23:08:42.777 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3394_fsm 2023-07-21T23:08:42.777 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3394_vm 2023-07-21T23:08:42.777 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3395 2023-07-21T23:08:42.777 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439 2023-07-21T23:08:42.778 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439_vm 2023-07-21T23:08:42.778 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3440 2023-07-21T23:08:42.778 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 3455 2023-07-21T23:08:42.779 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3456 2023-07-21T23:08:42.779 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3456_fsm 2023-07-21T23:08:42.779 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3456_vm 2023-07-21T23:08:42.779 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466 2023-07-21T23:08:42.780 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466_vm 2023-07-21T23:08:42.780 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3467 2023-07-21T23:08:42.780 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3468 2023-07-21T23:08:42.781 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501 2023-07-21T23:08:42.781 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501_vm 2023-07-21T23:08:42.781 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3502 2023-07-21T23:08:42.782 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3503 2023-07-21T23:08:42.782 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3534 2023-07-21T23:08:42.782 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541 2023-07-21T23:08:42.782 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3541_fsm 2023-07-21T23:08:42.783 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541_vm 2023-07-21T23:08:42.783 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3542 2023-07-21T23:08:42.783 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3574 2023-07-21T23:08:42.784 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3575 2023-07-21T23:08:42.784 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576 2023-07-21T23:08:42.784 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576_vm 2023-07-21T23:08:42.784 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596 2023-07-21T23:08:42.785 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596_vm 2023-07-21T23:08:42.785 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3597 2023-07-21T23:08:42.785 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598 2023-07-21T23:08:42.785 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598_vm 2023-07-21T23:08:42.785 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3599 2023-07-21T23:08:42.786 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600 2023-07-21T23:08:42.786 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3600_fsm 2023-07-21T23:08:42.786 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600_vm 2023-07-21T23:08:42.787 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601 2023-07-21T23:08:42.787 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3601_fsm 2023-07-21T23:08:42.787 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601_vm 2023-07-21T23:08:42.787 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602 2023-07-21T23:08:42.787 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3602_fsm 2023-07-21T23:08:42.788 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602_vm 2023-07-21T23:08:42.788 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3603 2023-07-21T23:08:42.788 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3603_fsm 2023-07-21T23:08:42.788 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3603_vm 2023-07-21T23:08:42.788 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3604 2023-07-21T23:08:42.788 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3605 2023-07-21T23:08:42.788 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3606 2023-07-21T23:08:42.789 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3607 2023-07-21T23:08:42.789 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3608 2023-07-21T23:08:42.789 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 3609 2023-07-21T23:08:42.789 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3712 2023-07-21T23:08:42.789 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764 2023-07-21T23:08:42.789 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3764_fsm 2023-07-21T23:08:42.789 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764_vm 2023-07-21T23:08:42.789 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3766 2023-07-21T23:08:42.790 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3767 2023-07-21T23:08:42.790 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3997 2023-07-21T23:08:42.790 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 5002 2023-07-21T23:08:42.790 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 548 2023-07-21T23:08:42.790 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 549 2023-07-21T23:08:42.790 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102 2023-07-21T23:08:42.790 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102_vm 2023-07-21T23:08:42.790 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104 2023-07-21T23:08:42.791 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104_vm 2023-07-21T23:08:42.791 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106 2023-07-21T23:08:42.791 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106_vm 2023-07-21T23:08:43.445 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6110 2023-07-21T23:08:43.445 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6111 2023-07-21T23:08:43.445 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6112 2023-07-21T23:08:43.445 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6113 2023-07-21T23:08:43.445 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6117 2023-07-21T23:08:43.446 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826 2023-07-21T23:08:43.446 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826_vm 2023-07-21T23:08:43.446 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 827 2023-07-21T23:08:43.446 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 828 2023-07-21T23:08:43.446 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 21 22:19 pg_filenode.map 2023-07-21T23:08:43.446 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 21 22:19 PG_VERSION 2023-07-21T23:08:43.446 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.446 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/base/12347: 2023-07-21T23:08:43.447 INFO:teuthology.orchestra.run.smithi151.stdout:total 7714721 2023-07-21T23:08:43.447 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7899872391 Jul 21 22:54 . 2023-07-21T23:08:43.447 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7914635405 Jul 21 22:50 .. 2023-07-21T23:08:43.447 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 112 2023-07-21T23:08:43.447 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 113 2023-07-21T23:08:43.447 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 21 22:19 12182 2023-07-21T23:08:43.447 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12182_fsm 2023-07-21T23:08:43.447 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12182_vm 2023-07-21T23:08:43.448 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12184 2023-07-21T23:08:43.448 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12186 2023-07-21T23:08:43.448 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187 2023-07-21T23:08:43.448 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12187_fsm 2023-07-21T23:08:43.448 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12187_vm 2023-07-21T23:08:43.448 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12189 2023-07-21T23:08:43.448 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12191 2023-07-21T23:08:43.449 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192 2023-07-21T23:08:43.449 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12192_fsm 2023-07-21T23:08:43.449 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12192_vm 2023-07-21T23:08:43.449 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12194 2023-07-21T23:08:43.449 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12196 2023-07-21T23:08:43.449 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197 2023-07-21T23:08:43.449 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12197_fsm 2023-07-21T23:08:43.449 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12197_vm 2023-07-21T23:08:43.450 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12199 2023-07-21T23:08:43.450 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12201 2023-07-21T23:08:43.450 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202 2023-07-21T23:08:43.450 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12202_fsm 2023-07-21T23:08:43.450 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12202_vm 2023-07-21T23:08:43.450 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12204 2023-07-21T23:08:43.450 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12206 2023-07-21T23:08:43.451 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207 2023-07-21T23:08:43.451 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 12207_fsm 2023-07-21T23:08:43.451 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12207_vm 2023-07-21T23:08:43.451 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12209 2023-07-21T23:08:43.451 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12211 2023-07-21T23:08:43.451 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12212 2023-07-21T23:08:43.451 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 12214 2023-07-21T23:08:43.451 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 12216 2023-07-21T23:08:43.452 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 21 22:20 1247 2023-07-21T23:08:43.452 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:20 1247_fsm 2023-07-21T23:08:43.452 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:20 1247_vm 2023-07-21T23:08:43.452 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 393216 Jul 21 22:53 1249 2023-07-21T23:08:43.452 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:20 1249_fsm 2023-07-21T23:08:43.452 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:20 1249_vm 2023-07-21T23:08:43.452 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 606208 Jul 21 22:19 1255 2023-07-21T23:08:43.452 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1255_fsm 2023-07-21T23:08:43.453 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1255_vm 2023-07-21T23:08:43.453 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Jul 21 23:07 1259 2023-07-21T23:08:43.453 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1259_fsm 2023-07-21T23:08:43.453 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:20 1259_vm 2023-07-21T23:08:43.453 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417 2023-07-21T23:08:43.453 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1417_vm 2023-07-21T23:08:43.453 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418 2023-07-21T23:08:43.453 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 1418_vm 2023-07-21T23:08:43.454 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 21 23:07 16387 2023-07-21T23:08:43.454 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 23:07 16387_fsm 2023-07-21T23:08:43.454 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 23:07 16387_vm 2023-07-21T23:08:43.454 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4243456 Jul 21 23:07 16393 2023-07-21T23:08:43.454 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 23:07 16393_fsm 2023-07-21T23:08:43.454 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 23:07 16393_vm 2023-07-21T23:08:43.454 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 21 23:07 16396 2023-07-21T23:08:43.455 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 21 23:07 16396.1 2023-07-21T23:08:43.455 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 21 23:07 16396.2 2023-07-21T23:08:43.455 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 21 23:07 16396.3 2023-07-21T23:08:43.455 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 21 23:07 16396.4 2023-07-21T23:08:43.455 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 21 23:07 16396.5 2023-07-21T23:08:43.455 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 305225728 Jul 21 23:07 16396.6 2023-07-21T23:08:43.455 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1679360 Jul 21 23:07 16396_fsm 2023-07-21T23:08:43.455 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 212992 Jul 21 23:07 16396_vm 2023-07-21T23:08:43.456 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 23:07 16397 2023-07-21T23:08:43.456 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 237568 Jul 21 23:07 16399 2023-07-21T23:08:43.456 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 21 23:08 16401 2023-07-21T23:08:43.456 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49373184 Jul 21 23:08 16401.1 2023-07-21T23:08:43.456 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 14565376 Jul 21 23:08 16403 2023-07-21T23:08:43.456 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 23:08 16403_fsm 2023-07-21T23:08:43.456 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 174 2023-07-21T23:08:43.457 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 175 2023-07-21T23:08:43.457 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2187 2023-07-21T23:08:43.457 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224 2023-07-21T23:08:43.457 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2224_vm 2023-07-21T23:08:43.457 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328 2023-07-21T23:08:43.457 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2328_vm 2023-07-21T23:08:43.457 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336 2023-07-21T23:08:43.457 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2336_vm 2023-07-21T23:08:43.458 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2337 2023-07-21T23:08:43.458 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2600 2023-07-21T23:08:43.458 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2600_fsm 2023-07-21T23:08:43.458 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2600_vm 2023-07-21T23:08:43.458 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601 2023-07-21T23:08:43.458 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2601_fsm 2023-07-21T23:08:43.458 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2601_vm 2023-07-21T23:08:43.458 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2602 2023-07-21T23:08:43.459 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2602_fsm 2023-07-21T23:08:43.459 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2602_vm 2023-07-21T23:08:43.459 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2603 2023-07-21T23:08:43.459 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2603_fsm 2023-07-21T23:08:43.459 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2603_vm 2023-07-21T23:08:43.459 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604 2023-07-21T23:08:43.459 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2604_vm 2023-07-21T23:08:43.459 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2605 2023-07-21T23:08:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2605_fsm 2023-07-21T23:08:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2605_vm 2023-07-21T23:08:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:51 2606 2023-07-21T23:08:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2606_fsm 2023-07-21T23:08:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:50 2606_vm 2023-07-21T23:08:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607 2023-07-21T23:08:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2607_fsm 2023-07-21T23:08:43.460 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2607_vm 2023-07-21T23:08:43.461 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 450560 Jul 21 22:51 2608 2023-07-21T23:08:43.461 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:51 2608_fsm 2023-07-21T23:08:43.461 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:52 2608_vm 2023-07-21T23:08:43.461 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 286720 Jul 21 22:19 2609 2023-07-21T23:08:43.461 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2609_fsm 2023-07-21T23:08:43.461 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2609_vm 2023-07-21T23:08:43.461 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:53 2610 2023-07-21T23:08:43.461 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:52 2610_fsm 2023-07-21T23:08:43.462 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:50 2610_vm 2023-07-21T23:08:43.462 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611 2023-07-21T23:08:43.462 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2611_vm 2023-07-21T23:08:43.462 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612 2023-07-21T23:08:43.462 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2612_fsm 2023-07-21T23:08:43.462 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2612_vm 2023-07-21T23:08:43.462 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613 2023-07-21T23:08:43.463 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2613_vm 2023-07-21T23:08:43.463 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615 2023-07-21T23:08:43.463 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2615_fsm 2023-07-21T23:08:43.463 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2615_vm 2023-07-21T23:08:43.463 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616 2023-07-21T23:08:43.463 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2616_fsm 2023-07-21T23:08:43.463 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2616_vm 2023-07-21T23:08:43.463 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Jul 21 22:19 2617 2023-07-21T23:08:43.464 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2617_fsm 2023-07-21T23:08:43.464 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2617_vm 2023-07-21T23:08:43.464 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Jul 21 22:19 2618 2023-07-21T23:08:43.464 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2618_fsm 2023-07-21T23:08:43.464 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2618_vm 2023-07-21T23:08:43.464 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 163840 Jul 21 23:07 2619 2023-07-21T23:08:43.464 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 23:01 2619_fsm 2023-07-21T23:08:43.464 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:35 2619_vm 2023-07-21T23:08:43.465 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620 2023-07-21T23:08:43.465 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2620_vm 2023-07-21T23:08:43.465 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2650 2023-07-21T23:08:43.465 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2651 2023-07-21T23:08:43.465 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2652 2023-07-21T23:08:43.465 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2653 2023-07-21T23:08:43.465 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2654 2023-07-21T23:08:43.465 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2655 2023-07-21T23:08:43.466 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2656 2023-07-21T23:08:43.466 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2657 2023-07-21T23:08:43.466 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Jul 21 22:52 2658 2023-07-21T23:08:43.466 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:52 2659 2023-07-21T23:08:43.466 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2660 2023-07-21T23:08:43.466 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2661 2023-07-21T23:08:43.466 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:53 2662 2023-07-21T23:08:43.466 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:53 2663 2023-07-21T23:08:43.467 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:52 2664 2023-07-21T23:08:43.467 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:52 2665 2023-07-21T23:08:43.467 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:52 2666 2023-07-21T23:08:43.467 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:52 2667 2023-07-21T23:08:43.467 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2668 2023-07-21T23:08:43.467 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2669 2023-07-21T23:08:43.467 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2670 2023-07-21T23:08:43.468 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 335872 Jul 21 22:52 2673 2023-07-21T23:08:43.468 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 376832 Jul 21 22:52 2674 2023-07-21T23:08:43.468 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 180224 Jul 21 22:19 2675 2023-07-21T23:08:43.468 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:52 2678 2023-07-21T23:08:43.468 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:52 2679 2023-07-21T23:08:43.468 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2680 2023-07-21T23:08:43.468 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2681 2023-07-21T23:08:43.468 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2682 2023-07-21T23:08:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2683 2023-07-21T23:08:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2684 2023-07-21T23:08:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2685 2023-07-21T23:08:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2686 2023-07-21T23:08:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2687 2023-07-21T23:08:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:19 2688 2023-07-21T23:08:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Jul 21 22:19 2689 2023-07-21T23:08:43.469 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Jul 21 22:19 2690 2023-07-21T23:08:43.470 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 270336 Jul 21 22:19 2691 2023-07-21T23:08:43.470 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2692 2023-07-21T23:08:43.470 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2693 2023-07-21T23:08:43.470 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 23:06 2696 2023-07-21T23:08:43.470 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2699 2023-07-21T23:08:43.470 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2701 2023-07-21T23:08:43.470 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2702 2023-07-21T23:08:43.470 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:20 2703 2023-07-21T23:08:43.471 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:20 2704 2023-07-21T23:08:43.471 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2753 2023-07-21T23:08:43.471 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2753_fsm 2023-07-21T23:08:43.471 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2753_vm 2023-07-21T23:08:43.471 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2754 2023-07-21T23:08:43.471 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2755 2023-07-21T23:08:43.472 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2756 2023-07-21T23:08:43.472 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 2757 2023-07-21T23:08:43.472 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830 2023-07-21T23:08:43.472 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2830_vm 2023-07-21T23:08:43.472 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2831 2023-07-21T23:08:43.473 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832 2023-07-21T23:08:43.473 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2832_vm 2023-07-21T23:08:43.473 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2833 2023-07-21T23:08:43.473 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834 2023-07-21T23:08:43.473 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2834_vm 2023-07-21T23:08:43.473 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2835 2023-07-21T23:08:43.473 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836 2023-07-21T23:08:43.473 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2836_vm 2023-07-21T23:08:43.474 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2837 2023-07-21T23:08:43.474 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 417792 Jul 21 22:19 2838 2023-07-21T23:08:43.474 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2838_fsm 2023-07-21T23:08:43.474 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2838_vm 2023-07-21T23:08:43.474 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2839 2023-07-21T23:08:43.474 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840 2023-07-21T23:08:43.474 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2840_fsm 2023-07-21T23:08:43.474 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2840_vm 2023-07-21T23:08:43.475 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2841 2023-07-21T23:08:43.475 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995 2023-07-21T23:08:43.475 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2995_vm 2023-07-21T23:08:43.475 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2996 2023-07-21T23:08:43.475 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079 2023-07-21T23:08:43.475 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3079_fsm 2023-07-21T23:08:43.475 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3079_vm 2023-07-21T23:08:43.475 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3080 2023-07-21T23:08:43.476 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3081 2023-07-21T23:08:43.476 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3085 2023-07-21T23:08:43.476 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118 2023-07-21T23:08:43.476 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3118_vm 2023-07-21T23:08:43.476 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3119 2023-07-21T23:08:43.476 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3164 2023-07-21T23:08:43.476 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256 2023-07-21T23:08:43.476 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3256_vm 2023-07-21T23:08:43.477 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3257 2023-07-21T23:08:43.477 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3258 2023-07-21T23:08:43.477 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350 2023-07-21T23:08:43.477 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3350_vm 2023-07-21T23:08:43.477 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3351 2023-07-21T23:08:43.477 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3379 2023-07-21T23:08:43.477 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3380 2023-07-21T23:08:43.478 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381 2023-07-21T23:08:43.478 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3381_vm 2023-07-21T23:08:43.478 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3394 2023-07-21T23:08:43.478 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3394_fsm 2023-07-21T23:08:43.478 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3394_vm 2023-07-21T23:08:43.478 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3395 2023-07-21T23:08:43.478 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439 2023-07-21T23:08:43.478 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3439_vm 2023-07-21T23:08:43.479 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3440 2023-07-21T23:08:43.479 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Jul 21 22:53 3455 2023-07-21T23:08:43.479 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3456 2023-07-21T23:08:43.479 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3456_fsm 2023-07-21T23:08:43.479 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3456_vm 2023-07-21T23:08:43.479 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466 2023-07-21T23:08:43.479 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3466_vm 2023-07-21T23:08:43.479 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3467 2023-07-21T23:08:43.480 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3468 2023-07-21T23:08:43.480 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501 2023-07-21T23:08:43.480 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3501_vm 2023-07-21T23:08:43.480 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3502 2023-07-21T23:08:43.480 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3503 2023-07-21T23:08:43.480 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3534 2023-07-21T23:08:43.480 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541 2023-07-21T23:08:43.480 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3541_fsm 2023-07-21T23:08:43.481 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3541_vm 2023-07-21T23:08:43.481 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3542 2023-07-21T23:08:43.481 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3574 2023-07-21T23:08:43.481 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3575 2023-07-21T23:08:43.481 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576 2023-07-21T23:08:43.481 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3576_vm 2023-07-21T23:08:43.481 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596 2023-07-21T23:08:43.481 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3596_vm 2023-07-21T23:08:43.482 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3597 2023-07-21T23:08:43.482 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598 2023-07-21T23:08:43.482 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3598_vm 2023-07-21T23:08:43.482 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3599 2023-07-21T23:08:43.482 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600 2023-07-21T23:08:43.482 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3600_fsm 2023-07-21T23:08:43.482 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3600_vm 2023-07-21T23:08:43.482 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601 2023-07-21T23:08:43.483 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3601_fsm 2023-07-21T23:08:43.483 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3601_vm 2023-07-21T23:08:43.483 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602 2023-07-21T23:08:43.484 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3602_fsm 2023-07-21T23:08:43.484 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3602_vm 2023-07-21T23:08:43.484 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3603 2023-07-21T23:08:43.484 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3603_fsm 2023-07-21T23:08:43.484 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3603_vm 2023-07-21T23:08:43.484 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3604 2023-07-21T23:08:43.484 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3605 2023-07-21T23:08:43.484 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3606 2023-07-21T23:08:43.485 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3607 2023-07-21T23:08:43.485 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3608 2023-07-21T23:08:43.485 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Jul 21 22:19 3609 2023-07-21T23:08:43.485 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3712 2023-07-21T23:08:43.485 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764 2023-07-21T23:08:43.485 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 3764_fsm 2023-07-21T23:08:43.485 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3764_vm 2023-07-21T23:08:43.485 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3766 2023-07-21T23:08:43.486 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 3767 2023-07-21T23:08:43.486 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3997 2023-07-21T23:08:43.486 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 5002 2023-07-21T23:08:43.486 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 548 2023-07-21T23:08:43.486 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 549 2023-07-21T23:08:43.486 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102 2023-07-21T23:08:43.486 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6102_vm 2023-07-21T23:08:43.487 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104 2023-07-21T23:08:43.487 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6104_vm 2023-07-21T23:08:43.487 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106 2023-07-21T23:08:43.487 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6106_vm 2023-07-21T23:08:43.487 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6110 2023-07-21T23:08:43.487 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6111 2023-07-21T23:08:43.487 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6112 2023-07-21T23:08:43.487 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6113 2023-07-21T23:08:43.488 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6117 2023-07-21T23:08:43.488 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826 2023-07-21T23:08:43.488 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 826_vm 2023-07-21T23:08:43.488 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 827 2023-07-21T23:08:43.488 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 828 2023-07-21T23:08:43.488 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 21 22:19 pg_filenode.map 2023-07-21T23:08:43.488 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 137860 Jul 21 22:19 pg_internal.init 2023-07-21T23:08:43.488 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Jul 21 22:19 PG_VERSION 2023-07-21T23:08:43.489 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.489 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2023-07-21T23:08:43.489 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.562 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:52 . 2023-07-21T23:08:43.563 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 7914635405 Jul 21 22:50 .. 2023-07-21T23:08:43.563 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.563 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/global: 2023-07-21T23:08:43.563 INFO:teuthology.orchestra.run.smithi151.stdout:total 575 2023-07-21T23:08:43.563 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 587404 Jul 21 22:19 . 2023-07-21T23:08:43.563 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.564 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1136 2023-07-21T23:08:43.564 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1136_fsm 2023-07-21T23:08:43.564 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1136_vm 2023-07-21T23:08:43.565 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 1137 2023-07-21T23:08:43.565 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1213 2023-07-21T23:08:43.565 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1213_fsm 2023-07-21T23:08:43.565 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1213_vm 2023-07-21T23:08:43.566 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1214 2023-07-21T23:08:43.566 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1214_fsm 2023-07-21T23:08:43.566 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1214_vm 2023-07-21T23:08:43.566 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 1232 2023-07-21T23:08:43.567 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 1233 2023-07-21T23:08:43.567 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1260 2023-07-21T23:08:43.567 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1260_fsm 2023-07-21T23:08:43.567 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1260_vm 2023-07-21T23:08:43.568 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1261 2023-07-21T23:08:43.568 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1261_fsm 2023-07-21T23:08:43.568 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1261_vm 2023-07-21T23:08:43.568 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1262 2023-07-21T23:08:43.569 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 1262_fsm 2023-07-21T23:08:43.569 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 1262_vm 2023-07-21T23:08:43.569 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2396 2023-07-21T23:08:43.570 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Jul 21 22:19 2396_fsm 2023-07-21T23:08:43.570 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2396_vm 2023-07-21T23:08:43.571 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2397 2023-07-21T23:08:43.571 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2671 2023-07-21T23:08:43.571 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2672 2023-07-21T23:08:43.571 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2676 2023-07-21T23:08:43.572 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2677 2023-07-21T23:08:43.572 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2694 2023-07-21T23:08:43.572 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2695 2023-07-21T23:08:43.572 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2697 2023-07-21T23:08:43.572 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 2698 2023-07-21T23:08:43.573 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2846 2023-07-21T23:08:43.573 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2846_vm 2023-07-21T23:08:43.573 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2847 2023-07-21T23:08:43.573 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2964 2023-07-21T23:08:43.613 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2964_vm 2023-07-21T23:08:43.613 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2965 2023-07-21T23:08:43.613 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2966 2023-07-21T23:08:43.613 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 2966_vm 2023-07-21T23:08:43.613 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 2967 2023-07-21T23:08:43.614 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3592 2023-07-21T23:08:43.614 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 3592_vm 2023-07-21T23:08:43.614 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 3593 2023-07-21T23:08:43.614 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 4060 2023-07-21T23:08:43.615 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 4060_vm 2023-07-21T23:08:43.615 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 4061 2023-07-21T23:08:43.615 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6000 2023-07-21T23:08:43.615 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6000_vm 2023-07-21T23:08:43.615 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6001 2023-07-21T23:08:43.615 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6002 2023-07-21T23:08:43.615 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6100 2023-07-21T23:08:43.616 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 6100_vm 2023-07-21T23:08:43.616 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6114 2023-07-21T23:08:43.616 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 6115 2023-07-21T23:08:43.616 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 23:08 pg_control 2023-07-21T23:08:43.616 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Jul 21 22:19 pg_filenode.map 2023-07-21T23:08:43.617 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 21644 Jul 21 22:19 pg_internal.init 2023-07-21T23:08:43.617 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.617 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/log: 2023-07-21T23:08:43.617 INFO:teuthology.orchestra.run.smithi151.stdout:total 2 2023-07-21T23:08:43.618 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 627 Jul 21 22:19 . 2023-07-21T23:08:43.618 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.618 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 699 Jul 21 23:08 postgresql-Fri.log 2023-07-21T23:08:43.618 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.619 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2023-07-21T23:08:43.619 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.619 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.620 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.620 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.620 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2023-07-21T23:08:43.620 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.621 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.621 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.621 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.622 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_logical: 2023-07-21T23:08:43.622 INFO:teuthology.orchestra.run.smithi151.stdout:total 3 2023-07-21T23:08:43.622 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 23:08 . 2023-07-21T23:08:43.622 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.623 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 mappings 2023-07-21T23:08:43.623 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 23:08 replorigin_checkpoint 2023-07-21T23:08:43.623 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 snapshots 2023-07-21T23:08:43.623 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.624 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2023-07-21T23:08:43.624 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.624 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.624 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 23:08 .. 2023-07-21T23:08:43.625 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.625 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2023-07-21T23:08:43.625 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.625 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.626 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Jul 21 23:08 .. 2023-07-21T23:08:43.626 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.626 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2023-07-21T23:08:43.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:43 smithi187 ceph-mon[96918]: pgmap v1576: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 168 KiB/s wr, 19 op/s 2023-07-21T23:08:43.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:43 smithi195 ceph-mon[97365]: pgmap v1576: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 168 KiB/s wr, 19 op/s 2023-07-21T23:08:43.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:43 smithi151 ceph-mon[95510]: pgmap v1576: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 143 KiB/s rd, 168 KiB/s wr, 19 op/s 2023-07-21T23:08:43.830 INFO:teuthology.orchestra.run.smithi151.stdout:total 2 2023-07-21T23:08:43.831 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 . 2023-07-21T23:08:43.831 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.831 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 members 2023-07-21T23:08:43.832 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 offsets 2023-07-21T23:08:43.832 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.832 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2023-07-21T23:08:43.832 INFO:teuthology.orchestra.run.smithi151.stdout:total 9 2023-07-21T23:08:43.832 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 . 2023-07-21T23:08:43.832 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 .. 2023-07-21T23:08:43.832 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 0000 2023-07-21T23:08:43.833 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.833 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2023-07-21T23:08:43.833 INFO:teuthology.orchestra.run.smithi151.stdout:total 9 2023-07-21T23:08:43.833 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 . 2023-07-21T23:08:43.833 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Jul 21 22:19 .. 2023-07-21T23:08:43.833 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:20 0000 2023-07-21T23:08:43.833 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.833 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_notify: 2023-07-21T23:08:43.834 INFO:teuthology.orchestra.run.smithi151.stdout:total 9 2023-07-21T23:08:43.834 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 . 2023-07-21T23:08:43.834 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.834 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Jul 21 22:19 0000 2023-07-21T23:08:43.834 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.834 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2023-07-21T23:08:43.834 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.835 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.835 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.835 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.835 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_serial: 2023-07-21T23:08:43.835 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.835 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.835 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.835 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.836 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2023-07-21T23:08:43.836 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.836 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.836 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.836 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.836 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_stat: 2023-07-21T23:08:43.836 INFO:teuthology.orchestra.run.smithi151.stdout:total 14 2023-07-21T23:08:43.837 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jul 21 23:08 . 2023-07-21T23:08:43.837 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.837 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1864 Jul 21 23:08 db_0.stat 2023-07-21T23:08:43.837 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 9300 Jul 21 23:08 db_12347.stat 2023-07-21T23:08:43.837 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 607 Jul 21 23:08 global.stat 2023-07-21T23:08:43.837 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.837 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2023-07-21T23:08:43.837 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.838 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 11771 Jul 21 23:08 . 2023-07-21T23:08:43.838 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.838 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.838 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2023-07-21T23:08:43.839 INFO:teuthology.orchestra.run.smithi151.stdout:total 57 2023-07-21T23:08:43.839 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 21 23:07 . 2023-07-21T23:08:43.839 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.839 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Jul 21 23:07 0004 2023-07-21T23:08:43.840 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.840 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2023-07-21T23:08:43.840 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.840 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.841 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.841 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.841 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2023-07-21T23:08:43.841 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.841 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.842 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.842 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.842 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_wal: 2023-07-21T23:08:43.843 INFO:teuthology.orchestra.run.smithi151.stdout:total 1048578 2023-07-21T23:08:43.843 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1090519040 Jul 21 23:08 . 2023-07-21T23:08:43.843 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 9005950740 Jul 21 23:08 .. 2023-07-21T23:08:43.843 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 000000010000000200000057 2023-07-21T23:08:43.843 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 000000010000000200000058 2023-07-21T23:08:43.844 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 000000010000000200000059 2023-07-21T23:08:43.844 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000005A 2023-07-21T23:08:43.844 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000005B 2023-07-21T23:08:43.844 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000005C 2023-07-21T23:08:43.844 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000005D 2023-07-21T23:08:43.845 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000005E 2023-07-21T23:08:43.845 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000005F 2023-07-21T23:08:43.845 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000060 2023-07-21T23:08:43.845 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000061 2023-07-21T23:08:43.845 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000062 2023-07-21T23:08:43.846 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000063 2023-07-21T23:08:43.846 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000064 2023-07-21T23:08:43.846 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000065 2023-07-21T23:08:43.846 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000066 2023-07-21T23:08:43.846 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000067 2023-07-21T23:08:43.847 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000068 2023-07-21T23:08:43.847 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 000000010000000200000069 2023-07-21T23:08:43.847 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 00000001000000020000006A 2023-07-21T23:08:43.847 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 00000001000000020000006B 2023-07-21T23:08:43.847 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:07 00000001000000020000006C 2023-07-21T23:08:43.847 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:08 00000001000000020000006D 2023-07-21T23:08:43.848 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:03 00000001000000020000006E 2023-07-21T23:08:43.848 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:04 00000001000000020000006F 2023-07-21T23:08:43.848 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:03 000000010000000200000070 2023-07-21T23:08:43.848 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:03 000000010000000200000071 2023-07-21T23:08:43.848 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:04 000000010000000200000072 2023-07-21T23:08:43.849 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:03 000000010000000200000073 2023-07-21T23:08:43.849 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:04 000000010000000200000074 2023-07-21T23:08:43.849 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:03 000000010000000200000075 2023-07-21T23:08:43.849 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:03 000000010000000200000076 2023-07-21T23:08:43.849 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:04 000000010000000200000077 2023-07-21T23:08:43.850 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:03 000000010000000200000078 2023-07-21T23:08:43.850 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:04 000000010000000200000079 2023-07-21T23:08:43.851 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:03 00000001000000020000007A 2023-07-21T23:08:43.851 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:03 00000001000000020000007B 2023-07-21T23:08:43.852 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:04 00000001000000020000007C 2023-07-21T23:08:43.852 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:04 00000001000000020000007D 2023-07-21T23:08:43.852 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 00000001000000020000007E 2023-07-21T23:08:43.852 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000007F 2023-07-21T23:08:43.853 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000080 2023-07-21T23:08:43.853 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000081 2023-07-21T23:08:43.853 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000082 2023-07-21T23:08:43.853 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000083 2023-07-21T23:08:43.853 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000084 2023-07-21T23:08:43.854 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000085 2023-07-21T23:08:43.854 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000086 2023-07-21T23:08:43.854 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000087 2023-07-21T23:08:43.854 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:04 000000010000000200000088 2023-07-21T23:08:43.854 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000089 2023-07-21T23:08:43.855 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000008A 2023-07-21T23:08:43.855 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 00000001000000020000008B 2023-07-21T23:08:43.855 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000008C 2023-07-21T23:08:43.855 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000008D 2023-07-21T23:08:43.855 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 00000001000000020000008E 2023-07-21T23:08:43.855 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 00000001000000020000008F 2023-07-21T23:08:43.856 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000090 2023-07-21T23:08:43.856 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:06 000000010000000200000091 2023-07-21T23:08:43.856 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:04 000000010000000200000092 2023-07-21T23:08:43.856 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000093 2023-07-21T23:08:43.856 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000094 2023-07-21T23:08:43.857 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000095 2023-07-21T23:08:43.857 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Jul 21 23:05 000000010000000200000096 2023-07-21T23:08:43.857 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 archive_status 2023-07-21T23:08:43.857 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.857 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2023-07-21T23:08:43.858 INFO:teuthology.orchestra.run.smithi151.stdout:total 1 2023-07-21T23:08:43.858 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Jul 21 22:19 . 2023-07-21T23:08:43.858 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1073741824 Jul 21 23:08 .. 2023-07-21T23:08:43.858 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:43.858 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/cephfs/postgres/data/pg_xact: 2023-07-21T23:08:43.858 INFO:teuthology.orchestra.run.smithi151.stdout:total 73 2023-07-21T23:08:43.858 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 21 22:19 . 2023-07-21T23:08:43.859 INFO:teuthology.orchestra.run.smithi151.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 8989173524 Jul 21 23:08 .. 2023-07-21T23:08:43.859 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 73728 Jul 21 23:07 0000 2023-07-21T23:08:43.859 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2023-07-21T23:08:43.870 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T23:08:43.882 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2023-07-21T23:08:43.891 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2023-07-21T23:08:43.891 INFO:teuthology.task.exec:Executing custom commands... 2023-07-21T23:08:43.892 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T23:08:43.892 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2023-07-21T23:08:44.028 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2023-07-21T23:08:44.125 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2023-07-21T23:08:44.321 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.289+0000 7f38251ff700 1 -- 172.21.15.151:0/404361647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38200685b0 msgr2=0x7f3820104770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:44.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.289+0000 7f38251ff700 1 --2- 172.21.15.151:0/404361647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38200685b0 0x7f3820104770 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f38140099c0 tx=0x7f3814009cd0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.289+0000 7f38251ff700 1 -- 172.21.15.151:0/404361647 shutdown_connections 2023-07-21T23:08:44.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.289+0000 7f38251ff700 1 --2- 172.21.15.151:0/404361647 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3820067c10 0x7f3820067fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.289+0000 7f38251ff700 1 --2- 172.21.15.151:0/404361647 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3820104e50 0x7f382010ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.289+0000 7f38251ff700 1 --2- 172.21.15.151:0/404361647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38200685b0 0x7f3820104770 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.289+0000 7f38251ff700 1 -- 172.21.15.151:0/404361647 >> 172.21.15.151:0/404361647 conn(0x7f3820074760 msgr2=0x7f3820074b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:44.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.289+0000 7f38251ff700 1 -- 172.21.15.151:0/404361647 shutdown_connections 2023-07-21T23:08:44.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.289+0000 7f38251ff700 1 -- 172.21.15.151:0/404361647 wait complete. 2023-07-21T23:08:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.291+0000 7f38251ff700 1 Processor -- start 2023-07-21T23:08:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.291+0000 7f38251ff700 1 -- start start 2023-07-21T23:08:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.291+0000 7f38251ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3820067c10 0x7f382019baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:44.325 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.291+0000 7f38251ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38200685b0 0x7f382019c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.291+0000 7f38251ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820104e50 0x7f3820195950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.291+0000 7f38251ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820195fc0 con 0x7f3820104e50 2023-07-21T23:08:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.291+0000 7f38251ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3820196130 con 0x7f38200685b0 2023-07-21T23:08:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.291+0000 7f38251ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38201962f0 con 0x7f3820067c10 2023-07-21T23:08:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820104e50 0x7f3820195950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381f59e700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820104e50 0x7f3820195950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40744/0 (socket says 172.21.15.151:40744) 2023-07-21T23:08:44.326 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381f59e700 1 -- 172.21.15.151:0/1593175402 learned_addr learned my addr 172.21.15.151:0/1593175402 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:44.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381e59c700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38200685b0 0x7f382019c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:44.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381ed9d700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3820067c10 0x7f382019baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:44.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381f59e700 1 -- 172.21.15.151:0/1593175402 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3820067c10 msgr2=0x7f382019baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:44.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381f59e700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3820067c10 0x7f382019baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381f59e700 1 -- 172.21.15.151:0/1593175402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38200685b0 msgr2=0x7f382019c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:44.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381f59e700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38200685b0 0x7f382019c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381f59e700 1 -- 172.21.15.151:0/1593175402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38140095f0 con 0x7f3820104e50 2023-07-21T23:08:44.327 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f381f59e700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820104e50 0x7f3820195950 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3818007ee0 tx=0x7f381800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:44.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.292+0000 7f3807fff700 1 -- 172.21.15.151:0/1593175402 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818017070 con 0x7f3820104e50 2023-07-21T23:08:44.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.293+0000 7f3807fff700 1 -- 172.21.15.151:0/1593175402 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f381800f040 con 0x7f3820104e50 2023-07-21T23:08:44.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.293+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38201965d0 con 0x7f3820104e50 2023-07-21T23:08:44.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.293+0000 7f3807fff700 1 -- 172.21.15.151:0/1593175402 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3818005570 con 0x7f3820104e50 2023-07-21T23:08:44.328 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.293+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38201a2ae0 con 0x7f3820104e50 2023-07-21T23:08:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.294+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3820076280 con 0x7f3820104e50 2023-07-21T23:08:44.329 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.296+0000 7f3807fff700 1 -- 172.21.15.151:0/1593175402 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f381800db20 con 0x7f3820104e50 2023-07-21T23:08:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.298+0000 7f3807fff700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38080a1340 0x7f38080a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:44.330 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.298+0000 7f3807fff700 1 -- 172.21.15.151:0/1593175402 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f38180cc3e0 con 0x7f3820104e50 2023-07-21T23:08:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.298+0000 7f381ed9d700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38080a1340 0x7f38080a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:44.331 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.299+0000 7f381ed9d700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38080a1340 0x7f38080a37f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3810007c60 tx=0x7f38100073d0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:44.334 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.303+0000 7f3807fff700 1 -- 172.21.15.151:0/1593175402 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f38180957b0 con 0x7f3820104e50 2023-07-21T23:08:44.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.571+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 --> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) v1 -- 0x7f3820103f70 con 0x7f38080a1340 2023-07-21T23:08:44.630 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.598+0000 7f3807fff700 1 -- 172.21.15.151:0/1593175402 <== mgr.15489 v2:172.21.15.151:6800/508405215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+336 (secure 0 0 0) 0x7f3820103f70 con 0x7f38080a1340 2023-07-21T23:08:44.630 INFO:teuthology.orchestra.run.smithi151.stdout:{"fs": "cephfs", "subvol": null, "path": "/", "rel_path": "/", "schedule": "1M", "retention": {"h": 3, "M": 6}, "start": "2023-07-21T00:00:00", "created": "2023-07-21T22:19:11", "first": "2023-07-21T22:20:00", "last": "2023-07-21T23:08:00", "last_pruned": "2023-07-21T23:08:00", "created_count": 49, "pruned_count": 42, "active": true} 2023-07-21T23:08:44.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.600+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38080a1340 msgr2=0x7f38080a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:44.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.600+0000 7f38251ff700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38080a1340 0x7f38080a37f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3810007c60 tx=0x7f38100073d0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820104e50 msgr2=0x7f3820195950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:44.633 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820104e50 0x7f3820195950 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f3818007ee0 tx=0x7f381800d3b0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 shutdown_connections 2023-07-21T23:08:44.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38080a1340 0x7f38080a37f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3820104e50 0x7f3820195950 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f3820067c10 0x7f382019baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 --2- 172.21.15.151:0/1593175402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38200685b0 0x7f382019c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 >> 172.21.15.151:0/1593175402 conn(0x7f3820074760 msgr2=0x7f38200fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:44.634 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 shutdown_connections 2023-07-21T23:08:44.635 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.601+0000 7f38251ff700 1 -- 172.21.15.151:0/1593175402 wait complete. 2023-07-21T23:08:44.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2023-07-21T23:08:44.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.821+0000 7f8cc41ff700 1 -- 172.21.15.151:0/3949873557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0731c0 msgr2=0x7f8cbc10be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:44.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.821+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/3949873557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0731c0 0x7f8cbc10be10 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8cac009990 tx=0x7f8cac009ca0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.821+0000 7f8cc41ff700 1 -- 172.21.15.151:0/3949873557 shutdown_connections 2023-07-21T23:08:44.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.821+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/3949873557 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cbc10c350 0x7f8cbc10e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.821+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/3949873557 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cbc0728b0 0x7f8cbc072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.821+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/3949873557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0731c0 0x7f8cbc10be10 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.821+0000 7f8cc41ff700 1 -- 172.21.15.151:0/3949873557 >> 172.21.15.151:0/3949873557 conn(0x7f8cbc0fb5f0 msgr2=0x7f8cbc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:44.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.821+0000 7f8cc41ff700 1 -- 172.21.15.151:0/3949873557 shutdown_connections 2023-07-21T23:08:44.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.821+0000 7f8cc41ff700 1 -- 172.21.15.151:0/3949873557 wait complete. 2023-07-21T23:08:44.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.822+0000 7f8cc41ff700 1 Processor -- start 2023-07-21T23:08:44.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc41ff700 1 -- start start 2023-07-21T23:08:44.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc41ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0728b0 0x7f8cbc197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:44.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc41ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cbc0731c0 0x7f8cbc1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:44.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc41ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cbc10c350 0x7f8cbc19c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:44.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc41ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc19cf60 con 0x7f8cbc0731c0 2023-07-21T23:08:44.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc41ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc19d0d0 con 0x7f8cbc0728b0 2023-07-21T23:08:44.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc41ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cbc19d290 con 0x7f8cbc10c350 2023-07-21T23:08:44.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc1f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0728b0 0x7f8cbc197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:44.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc179a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cbc0731c0 0x7f8cbc1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:44.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc1f9b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0728b0 0x7f8cbc197d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.151:35862/0 (socket says 172.21.15.151:35862) 2023-07-21T23:08:44.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc1f9b700 1 -- 172.21.15.151:0/762288837 learned_addr learned my addr 172.21.15.151:0/762288837 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:44.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.823+0000 7f8cc279c700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cbc10c350 0x7f8cbc19c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:44.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cc1f9b700 1 -- 172.21.15.151:0/762288837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cbc10c350 msgr2=0x7f8cbc19c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:44.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cc1f9b700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cbc10c350 0x7f8cbc19c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cc1f9b700 1 -- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cbc0731c0 msgr2=0x7f8cbc1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:44.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cc1f9b700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cbc0731c0 0x7f8cbc1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:44.859 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cc1f9b700 1 -- 172.21.15.151:0/762288837 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0095f0 con 0x7f8cbc0728b0 2023-07-21T23:08:44.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cc179a700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cbc0731c0 0x7f8cbc1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:08:44.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cc1f9b700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0728b0 0x7f8cbc197d70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800e9a0 tx=0x7f8cb800ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:44.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cb2ffd700 1 -- 172.21.15.151:0/762288837 <== mon.2 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb8009790 con 0x7f8cbc0728b0 2023-07-21T23:08:44.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cb2ffd700 1 -- 172.21.15.151:0/762288837 <== mon.2 v2:172.21.15.187:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8cb8010430 con 0x7f8cbc0728b0 2023-07-21T23:08:44.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cbc19d570 con 0x7f8cbc0728b0 2023-07-21T23:08:44.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.824+0000 7f8cb2ffd700 1 -- 172.21.15.151:0/762288837 <== mon.2 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cb800cea0 con 0x7f8cbc0728b0 2023-07-21T23:08:44.860 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.825+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cbc1a4db0 con 0x7f8cbc0728b0 2023-07-21T23:08:44.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.826+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cbc0ff250 con 0x7f8cbc0728b0 2023-07-21T23:08:44.861 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.829+0000 7f8cb2ffd700 1 -- 172.21.15.151:0/762288837 <== mon.2 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f8cb80105a0 con 0x7f8cbc0728b0 2023-07-21T23:08:44.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.830+0000 7f8cb2ffd700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8ca80a1340 0x7f8ca80a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:44.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.831+0000 7f8cb2ffd700 1 -- 172.21.15.151:0/762288837 <== mon.2 v2:172.21.15.187:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8cb8014070 con 0x7f8cbc0728b0 2023-07-21T23:08:44.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.831+0000 7f8cc179a700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8ca80a1340 0x7f8ca80a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:44.863 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.831+0000 7f8cc179a700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8ca80a1340 0x7f8ca80a37f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc199590 tx=0x7f8cac00b260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:44.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:44.833+0000 7f8cb2ffd700 1 -- 172.21.15.151:0/762288837 <== mon.2 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8cb8096220 con 0x7f8cbc0728b0 2023-07-21T23:08:45.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.071+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 --> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f8cbc0fd260 con 0x7f8ca80a1340 2023-07-21T23:08:45.126 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.094+0000 7f8cb2ffd700 1 -- 172.21.15.151:0/762288837 <== mgr.15489 v2:172.21.15.151:6800/508405215 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+10 (secure 0 0 0) 0x7f8cbc0fd260 con 0x7f8ca80a1340 2023-07-21T23:08:45.127 INFO:teuthology.orchestra.run.smithi151.stdout:/ 1M 6M3h 2023-07-21T23:08:45.129 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8ca80a1340 msgr2=0x7f8ca80a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8ca80a1340 0x7f8ca80a37f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc199590 tx=0x7f8cac00b260 comp rx=0 tx=0).stop 2023-07-21T23:08:45.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0728b0 msgr2=0x7f8cbc197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0728b0 0x7f8cbc197d70 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8cb800e9a0 tx=0x7f8cb800ecb0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 shutdown_connections 2023-07-21T23:08:45.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8ca80a1340 0x7f8ca80a37f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.130 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cbc0728b0 0x7f8cbc197d70 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8cbc10c350 0x7f8cbc19c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 --2- 172.21.15.151:0/762288837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cbc0731c0 0x7f8cbc1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.097+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 >> 172.21.15.151:0/762288837 conn(0x7f8cbc0fb5f0 msgr2=0x7f8cbc10e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:45.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.098+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 shutdown_connections 2023-07-21T23:08:45.131 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.098+0000 7f8cc41ff700 1 -- 172.21.15.151:0/762288837 wait complete. 2023-07-21T23:08:45.152 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2023-07-21T23:08:45.162 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2023-07-21T23:08:45.163 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-07-21T23:08:45.163 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-07-21T23:08:45.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T23:08:45.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.367+0000 7fb3f45ff700 1 -- 172.21.15.151:0/982668112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 msgr2=0x7fb3ec10c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.367+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/982668112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 0x7fb3ec10c930 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400b0a0 tx=0x7fb3e400b3b0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.367+0000 7fb3f45ff700 1 -- 172.21.15.151:0/982668112 shutdown_connections 2023-07-21T23:08:45.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.367+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/982668112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3ec105b00 0x7fb3ec105ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.367+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/982668112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 0x7fb3ec10c930 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.367+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/982668112 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ec0ffaf0 0x7fb3ec0fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.367+0000 7fb3f45ff700 1 -- 172.21.15.151:0/982668112 >> 172.21.15.151:0/982668112 conn(0x7fb3ec0fb630 msgr2=0x7fb3ec0fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:45.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.367+0000 7fb3f45ff700 1 -- 172.21.15.151:0/982668112 shutdown_connections 2023-07-21T23:08:45.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.367+0000 7fb3f45ff700 1 -- 172.21.15.151:0/982668112 wait complete. 2023-07-21T23:08:45.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.368+0000 7fb3f45ff700 1 Processor -- start 2023-07-21T23:08:45.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.368+0000 7fb3f45ff700 1 -- start start 2023-07-21T23:08:45.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f45ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ec0ffaf0 0x7fb3ec197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:45.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f45ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 0x7fb3ec198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:45.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f45ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3ec105b00 0x7fb3ec19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:45.403 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f45ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec19cdd0 con 0x7fb3ec1004a0 2023-07-21T23:08:45.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f45ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec19cf40 con 0x7fb3ec105b00 2023-07-21T23:08:45.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f45ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec19d100 con 0x7fb3ec0ffaf0 2023-07-21T23:08:45.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f1b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 0x7fb3ec198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:45.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f1b9a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 0x7fb3ec198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:40780/0 (socket says 172.21.15.151:40780) 2023-07-21T23:08:45.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f1b9a700 1 -- 172.21.15.151:0/4010069998 learned_addr learned my addr 172.21.15.151:0/4010069998 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:45.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f2b9c700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3ec105b00 0x7fb3ec19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:45.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f239b700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ec0ffaf0 0x7fb3ec197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:45.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f1b9a700 1 -- 172.21.15.151:0/4010069998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ec0ffaf0 msgr2=0x7fb3ec197df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f1b9a700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ec0ffaf0 0x7fb3ec197df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.405 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f1b9a700 1 -- 172.21.15.151:0/4010069998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3ec105b00 msgr2=0x7fb3ec19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f1b9a700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3ec105b00 0x7fb3ec19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.369+0000 7fb3f1b9a700 1 -- 172.21.15.151:0/4010069998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e4009d00 con 0x7fb3ec1004a0 2023-07-21T23:08:45.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.370+0000 7fb3f1b9a700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 0x7fb3ec198330 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00e9a0 tx=0x7fb3dc00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:45.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.370+0000 7fb3e37fe700 1 -- 172.21.15.151:0/4010069998 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc009790 con 0x7fb3ec1004a0 2023-07-21T23:08:45.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.370+0000 7fb3e37fe700 1 -- 172.21.15.151:0/4010069998 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb3dc00cbd0 con 0x7fb3ec1004a0 2023-07-21T23:08:45.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.370+0000 7fb3e37fe700 1 -- 172.21.15.151:0/4010069998 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc018680 con 0x7fb3ec1004a0 2023-07-21T23:08:45.406 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.370+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec19d3e0 con 0x7fb3ec1004a0 2023-07-21T23:08:45.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.370+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec1a4c20 con 0x7fb3ec1004a0 2023-07-21T23:08:45.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.371+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec067300 con 0x7fb3ec1004a0 2023-07-21T23:08:45.407 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.373+0000 7fb3e37fe700 1 -- 172.21.15.151:0/4010069998 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fb3dc00cd40 con 0x7fb3ec1004a0 2023-07-21T23:08:45.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.374+0000 7fb3e37fe700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb3d80a1380 0x7fb3d80a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:45.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.374+0000 7fb3e37fe700 1 -- 172.21.15.151:0/4010069998 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb3dc014070 con 0x7fb3ec1004a0 2023-07-21T23:08:45.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.374+0000 7fb3f239b700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb3d80a1380 0x7fb3d80a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:45.408 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.375+0000 7fb3f239b700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb3d80a1380 0x7fb3d80a3830 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009bd0 tx=0x7fb3e8009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:45.410 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.378+0000 7fb3e37fe700 1 -- 172.21.15.151:0/4010069998 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fb3dc051770 con 0x7fb3ec1004a0 2023-07-21T23:08:45.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:45 smithi151 ceph-mon[95510]: pgmap v1577: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 239 KiB/s wr, 27 op/s 2023-07-21T23:08:45.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:45 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:45.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:45 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:08:45.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:45 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:08:45.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:45 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:08:45.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:45 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:08:45.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:45 smithi187 ceph-mon[96918]: pgmap v1577: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 239 KiB/s wr, 27 op/s 2023-07-21T23:08:45.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:45 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:45.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:45 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:08:45.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:45 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:08:45.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:45 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:08:45.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:45 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:08:45.620 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.588+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb3ec1a4f80 con 0x7fb3ec1004a0 2023-07-21T23:08:45.622 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.590+0000 7fb3e37fe700 1 -- 172.21.15.151:0/4010069998 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v175) v1 ==== 74+0+23056 (secure 0 0 0) 0x7fb3dc096350 con 0x7fb3ec1004a0 2023-07-21T23:08:45.622 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:45.623 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":175,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T23:08:17.150671+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"174","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":92,"snap_epoch":174,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2857691582":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6800/3677157440":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6801/3677157440":"2023-07-22T22:19:10.841711+0000","172.21.15.151:0/117839627":"2023-07-22T22:19:10.841711+0000","172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1323163778":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/4119562225":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":80,"length":1},{"begin":92,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T23:08:45.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.592+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb3d80a1380 msgr2=0x7fb3d80a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb3d80a1380 0x7fb3d80a3830 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fb3e8009bd0 tx=0x7fb3e8009260 comp rx=0 tx=0).stop 2023-07-21T23:08:45.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 msgr2=0x7fb3ec198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 0x7fb3ec198330 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc00e9a0 tx=0x7fb3dc00ecb0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.625 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 shutdown_connections 2023-07-21T23:08:45.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb3d80a1380 0x7fb3d80a3830 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3ec105b00 0x7fb3ec19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb3ec0ffaf0 0x7fb3ec197df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 --2- 172.21.15.151:0/4010069998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3ec1004a0 0x7fb3ec198330 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 >> 172.21.15.151:0/4010069998 conn(0x7fb3ec0fb630 msgr2=0x7fb3ec0fbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:45.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 shutdown_connections 2023-07-21T23:08:45.626 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.593+0000 7fb3f45ff700 1 -- 172.21.15.151:0/4010069998 wait complete. 2023-07-21T23:08:45.643 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '174', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 92, 'snap_epoch': 174, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T23:08:45.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T23:08:45.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:45 smithi195 ceph-mon[97365]: pgmap v1577: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 240 KiB/s rd, 239 KiB/s wr, 27 op/s 2023-07-21T23:08:45.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:45 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:45.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:45 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:08:45.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:45 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:08:45.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:45 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:08:45.646 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:45 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:08:45.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.817+0000 7f614bfff700 1 -- 172.21.15.151:0/3642157335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61440ffae0 msgr2=0x7f61440fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.817+0000 7f614bfff700 1 --2- 172.21.15.151:0/3642157335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61440ffae0 0x7f61440fff50 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f6134009990 tx=0x7f6134009ca0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.817+0000 7f614bfff700 1 -- 172.21.15.151:0/3642157335 shutdown_connections 2023-07-21T23:08:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.817+0000 7f614bfff700 1 --2- 172.21.15.151:0/3642157335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144100490 0x7f614410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.817+0000 7f614bfff700 1 --2- 172.21.15.151:0/3642157335 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f6144105af0 0x7f6144105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.817+0000 7f614bfff700 1 --2- 172.21.15.151:0/3642157335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f61440ffae0 0x7f61440fff50 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.850 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.817+0000 7f614bfff700 1 -- 172.21.15.151:0/3642157335 >> 172.21.15.151:0/3642157335 conn(0x7f61440fb5e0 msgr2=0x7f61440fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:45.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.817+0000 7f614bfff700 1 -- 172.21.15.151:0/3642157335 shutdown_connections 2023-07-21T23:08:45.851 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.817+0000 7f614bfff700 1 -- 172.21.15.151:0/3642157335 wait complete. 2023-07-21T23:08:45.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.818+0000 7f614bfff700 1 Processor -- start 2023-07-21T23:08:45.852 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.818+0000 7f614bfff700 1 -- start start 2023-07-21T23:08:45.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.818+0000 7f614bfff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61440ffae0 0x7f614419b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:45.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.818+0000 7f614bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6144100490 0x7f614419bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:45.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.818+0000 7f614bfff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144105af0 0x7f61441958f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:45.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614bfff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144195f60 con 0x7f6144100490 2023-07-21T23:08:45.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614bfff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61441960d0 con 0x7f6144105af0 2023-07-21T23:08:45.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614bfff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6144196290 con 0x7f61440ffae0 2023-07-21T23:08:45.853 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614959a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6144100490 0x7f614419bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614959a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6144100490 0x7f614419bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39122/0 (socket says 172.21.15.151:39122) 2023-07-21T23:08:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614959a700 1 -- 172.21.15.151:0/2858005681 learned_addr learned my addr 172.21.15.151:0/2858005681 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f6149d9b700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61440ffae0 0x7f614419b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614a59c700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144105af0 0x7f61441958f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614959a700 1 -- 172.21.15.151:0/2858005681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61440ffae0 msgr2=0x7f614419b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614959a700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61440ffae0 0x7f614419b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.854 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614959a700 1 -- 172.21.15.151:0/2858005681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144105af0 msgr2=0x7f61441958f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614959a700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144105af0 0x7f61441958f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614959a700 1 -- 172.21.15.151:0/2858005681 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61340095f0 con 0x7f6144100490 2023-07-21T23:08:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.819+0000 7f614959a700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6144100490 0x7f614419bdc0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6134005910 tx=0x7f61340047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.820+0000 7f613affd700 1 -- 172.21.15.151:0/2858005681 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f613401d070 con 0x7f6144100490 2023-07-21T23:08:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.820+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6144196510 con 0x7f6144100490 2023-07-21T23:08:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.820+0000 7f613affd700 1 -- 172.21.15.151:0/2858005681 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f6134021410 con 0x7f6144100490 2023-07-21T23:08:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.820+0000 7f613affd700 1 -- 172.21.15.151:0/2858005681 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6134017650 con 0x7f6144100490 2023-07-21T23:08:45.855 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.820+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61441a2870 con 0x7f6144100490 2023-07-21T23:08:45.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.821+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6144067290 con 0x7f6144100490 2023-07-21T23:08:45.856 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.823+0000 7f613affd700 1 -- 172.21.15.151:0/2858005681 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f613400fb00 con 0x7f6144100490 2023-07-21T23:08:45.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.824+0000 7f613affd700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f61300a12c0 0x7f61300a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:45.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.824+0000 7f613affd700 1 -- 172.21.15.151:0/2858005681 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f61340ce970 con 0x7f6144100490 2023-07-21T23:08:45.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.824+0000 7f6149d9b700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f61300a12c0 0x7f61300a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:45.857 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.825+0000 7f6149d9b700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f61300a12c0 0x7f61300a3770 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6140009bd0 tx=0x7f6140009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:45.858 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:45.826+0000 7f613affd700 1 -- 172.21.15.151:0/2858005681 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f6134097dd0 con 0x7f6144100490 2023-07-21T23:08:46.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.026+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61441a2a90 con 0x7f6144100490 2023-07-21T23:08:46.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.027+0000 7f613affd700 1 -- 172.21.15.151:0/2858005681 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v175) v1 ==== 93+0+10 (secure 0 0 0) 0x7f613409b3f0 con 0x7f6144100490 2023-07-21T23:08:46.060 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T23:08:46.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f61300a12c0 msgr2=0x7f61300a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f61300a12c0 0x7f61300a3770 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f6140009bd0 tx=0x7f6140009260 comp rx=0 tx=0).stop 2023-07-21T23:08:46.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6144100490 msgr2=0x7f614419bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6144100490 0x7f614419bdc0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f6134005910 tx=0x7f61340047b0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 shutdown_connections 2023-07-21T23:08:46.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f61300a12c0 0x7f61300a3770 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.062 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6144105af0 0x7f61441958f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f61440ffae0 0x7f614419b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 --2- 172.21.15.151:0/2858005681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6144100490 0x7f614419bdc0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.029+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 >> 172.21.15.151:0/2858005681 conn(0x7f61440fb5e0 msgr2=0x7f61441035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:46.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.030+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 shutdown_connections 2023-07-21T23:08:46.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.030+0000 7f614bfff700 1 -- 172.21.15.151:0/2858005681 wait complete. 2023-07-21T23:08:46.081 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T23:08:46.289 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.257+0000 7f5f873ff700 1 -- 172.21.15.151:0/3267388363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 msgr2=0x7f5f8010c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.257+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3267388363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 0x7f5f8010c910 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f5f7800b0a0 tx=0x7f5f7800b3b0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.257+0000 7f5f873ff700 1 -- 172.21.15.151:0/3267388363 shutdown_connections 2023-07-21T23:08:46.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.257+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3267388363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f80105ae0 0x7f5f80105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.290 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.257+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3267388363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 0x7f5f8010c910 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.257+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3267388363 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f800ffad0 0x7f5f800fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.257+0000 7f5f873ff700 1 -- 172.21.15.151:0/3267388363 >> 172.21.15.151:0/3267388363 conn(0x7f5f800fb5f0 msgr2=0x7f5f800fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:46.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.257+0000 7f5f873ff700 1 -- 172.21.15.151:0/3267388363 shutdown_connections 2023-07-21T23:08:46.291 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.257+0000 7f5f873ff700 1 -- 172.21.15.151:0/3267388363 wait complete. 2023-07-21T23:08:46.292 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.258+0000 7f5f873ff700 1 Processor -- start 2023-07-21T23:08:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f873ff700 1 -- start start 2023-07-21T23:08:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f873ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f800ffad0 0x7f5f80072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f873ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 0x7f5f80072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f873ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f80105ae0 0x7f5f80073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f873ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f801a4010 con 0x7f5f80100480 2023-07-21T23:08:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f873ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f801a4180 con 0x7f5f800ffad0 2023-07-21T23:08:46.293 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f873ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f801a4340 con 0x7f5f80105ae0 2023-07-21T23:08:46.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f8499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 0x7f5f80072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:46.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f8519b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f800ffad0 0x7f5f80072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:46.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f8499a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 0x7f5f80072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39136/0 (socket says 172.21.15.151:39136) 2023-07-21T23:08:46.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f8499a700 1 -- 172.21.15.151:0/3064109884 learned_addr learned my addr 172.21.15.151:0/3064109884 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:46.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.259+0000 7f5f8599c700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f80105ae0 0x7f5f80073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:46.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f8499a700 1 -- 172.21.15.151:0/3064109884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f80105ae0 msgr2=0x7f5f80073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f8499a700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f80105ae0 0x7f5f80073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.294 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f8499a700 1 -- 172.21.15.151:0/3064109884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f800ffad0 msgr2=0x7f5f80072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f8499a700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f800ffad0 0x7f5f80072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f8499a700 1 -- 172.21.15.151:0/3064109884 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f78009d00 con 0x7f5f80100480 2023-07-21T23:08:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f8499a700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 0x7f5f80072d50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000e9a0 tx=0x7f5f7000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f767fc700 1 -- 172.21.15.151:0/3064109884 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f70009790 con 0x7f5f80100480 2023-07-21T23:08:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f801a4620 con 0x7f5f80100480 2023-07-21T23:08:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f767fc700 1 -- 172.21.15.151:0/3064109884 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5f70010430 con 0x7f5f80100480 2023-07-21T23:08:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f767fc700 1 -- 172.21.15.151:0/3064109884 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000cea0 con 0x7f5f80100480 2023-07-21T23:08:46.295 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.260+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f801a4b30 con 0x7f5f80100480 2023-07-21T23:08:46.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.261+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f80067290 con 0x7f5f80100480 2023-07-21T23:08:46.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.263+0000 7f5f767fc700 1 -- 172.21.15.151:0/3064109884 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5f700105a0 con 0x7f5f80100480 2023-07-21T23:08:46.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.265+0000 7f5f767fc700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5f6c0a12c0 0x7f5f6c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:46.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.265+0000 7f5f767fc700 1 -- 172.21.15.151:0/3064109884 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5f70014070 con 0x7f5f80100480 2023-07-21T23:08:46.297 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.265+0000 7f5f8519b700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5f6c0a12c0 0x7f5f6c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:46.298 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.266+0000 7f5f8519b700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5f6c0a12c0 0x7f5f6c0a3770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009be0 tx=0x7f5f7c009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:46.301 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.269+0000 7f5f767fc700 1 -- 172.21.15.151:0/3064109884 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f5f70096500 con 0x7f5f80100480 2023-07-21T23:08:46.515 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.483+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5f801a4e50 con 0x7f5f80100480 2023-07-21T23:08:46.516 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.484+0000 7f5f767fc700 1 -- 172.21.15.151:0/3064109884 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v175) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5f70099b20 con 0x7f5f80100480 2023-07-21T23:08:46.517 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T23:08:46.518 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5f6c0a12c0 msgr2=0x7f5f6c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5f6c0a12c0 0x7f5f6c0a3770 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5f7c009be0 tx=0x7f5f7c009260 comp rx=0 tx=0).stop 2023-07-21T23:08:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 msgr2=0x7f5f80072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 0x7f5f80072d50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000e9a0 tx=0x7f5f7000ecb0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 shutdown_connections 2023-07-21T23:08:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5f6c0a12c0 0x7f5f6c0a3770 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5f800ffad0 0x7f5f80072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.519 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5f80105ae0 0x7f5f80073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 --2- 172.21.15.151:0/3064109884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f80100480 0x7f5f80072d50 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.486+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 >> 172.21.15.151:0/3064109884 conn(0x7f5f800fb5f0 msgr2=0x7f5f801035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.487+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 shutdown_connections 2023-07-21T23:08:46.520 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.487+0000 7f5f873ff700 1 -- 172.21.15.151:0/3064109884 wait complete. 2023-07-21T23:08:46.537 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T23:08:46.600 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:46 smithi151 ceph-mon[95510]: from='client.20043 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T23:08:46.601 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:46 smithi151 ceph-mon[95510]: from='client.29696 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T23:08:46.601 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:46 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/4010069998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T23:08:46.601 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:46 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2858005681' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T23:08:46.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:46 smithi187 ceph-mon[96918]: from='client.20043 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T23:08:46.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:46 smithi187 ceph-mon[96918]: from='client.29696 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T23:08:46.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:46 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/4010069998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T23:08:46.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:46 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2858005681' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T23:08:46.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:46 smithi195 ceph-mon[97365]: from='client.20043 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T23:08:46.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:46 smithi195 ceph-mon[97365]: from='client.29696 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2023-07-21T23:08:46.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:46 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/4010069998' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T23:08:46.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:46 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2858005681' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T23:08:46.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.709+0000 7f12617ff700 1 -- 172.21.15.151:0/2565309700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c100480 msgr2=0x7f125c10c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.709+0000 7f12617ff700 1 --2- 172.21.15.151:0/2565309700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c100480 0x7f125c10c910 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f125400b0a0 tx=0x7f125400b3b0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.741 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.709+0000 7f12617ff700 1 -- 172.21.15.151:0/2565309700 shutdown_connections 2023-07-21T23:08:46.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.709+0000 7f12617ff700 1 --2- 172.21.15.151:0/2565309700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c105ae0 0x7f125c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.709+0000 7f12617ff700 1 --2- 172.21.15.151:0/2565309700 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c100480 0x7f125c10c910 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.709+0000 7f12617ff700 1 --2- 172.21.15.151:0/2565309700 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f125c0ffad0 0x7f125c0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.709+0000 7f12617ff700 1 -- 172.21.15.151:0/2565309700 >> 172.21.15.151:0/2565309700 conn(0x7f125c0fb5f0 msgr2=0x7f125c0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:46.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.709+0000 7f12617ff700 1 -- 172.21.15.151:0/2565309700 shutdown_connections 2023-07-21T23:08:46.742 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.709+0000 7f12617ff700 1 -- 172.21.15.151:0/2565309700 wait complete. 2023-07-21T23:08:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.710+0000 7f12617ff700 1 Processor -- start 2023-07-21T23:08:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.710+0000 7f12617ff700 1 -- start start 2023-07-21T23:08:46.744 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.710+0000 7f12617ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c0ffad0 0x7f125c197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.710+0000 7f12617ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f125c100480 0x7f125c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.710+0000 7f12617ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c105ae0 0x7f125c19c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.710+0000 7f12617ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c19cdd0 con 0x7f125c0ffad0 2023-07-21T23:08:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.710+0000 7f12617ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c19cf40 con 0x7f125c105ae0 2023-07-21T23:08:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.710+0000 7f12617ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f125c19d100 con 0x7f125c100480 2023-07-21T23:08:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c0ffad0 0x7f125c197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:46.745 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125affd700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c0ffad0 0x7f125c197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39164/0 (socket says 172.21.15.151:39164) 2023-07-21T23:08:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125affd700 1 -- 172.21.15.151:0/2430367523 learned_addr learned my addr 172.21.15.151:0/2430367523 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125b7fe700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c105ae0 0x7f125c19c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f1253fff700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f125c100480 0x7f125c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125affd700 1 -- 172.21.15.151:0/2430367523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f125c100480 msgr2=0x7f125c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125affd700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f125c100480 0x7f125c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125affd700 1 -- 172.21.15.151:0/2430367523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c105ae0 msgr2=0x7f125c19c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125affd700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c105ae0 0x7f125c19c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125affd700 1 -- 172.21.15.151:0/2430367523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1254009d00 con 0x7f125c0ffad0 2023-07-21T23:08:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f125affd700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c0ffad0 0x7f125c197df0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f124c00d950 tx=0x7f124c00dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f1258ff9700 1 -- 172.21.15.151:0/2430367523 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c009940 con 0x7f125c0ffad0 2023-07-21T23:08:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f1258ff9700 1 -- 172.21.15.151:0/2430367523 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f124c010460 con 0x7f125c0ffad0 2023-07-21T23:08:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f125c19d3e0 con 0x7f125c0ffad0 2023-07-21T23:08:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.711+0000 7f1258ff9700 1 -- 172.21.15.151:0/2430367523 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f124c00f620 con 0x7f125c0ffad0 2023-07-21T23:08:46.747 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.712+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f125c1a4c20 con 0x7f125c0ffad0 2023-07-21T23:08:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.713+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f125c067290 con 0x7f125c0ffad0 2023-07-21T23:08:46.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.715+0000 7f1258ff9700 1 -- 172.21.15.151:0/2430367523 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f124c0105d0 con 0x7f125c0ffad0 2023-07-21T23:08:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.716+0000 7f1258ff9700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f12480a12c0 0x7f12480a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.716+0000 7f1258ff9700 1 -- 172.21.15.151:0/2430367523 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f124c0cc5e0 con 0x7f125c0ffad0 2023-07-21T23:08:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.716+0000 7f1253fff700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f12480a12c0 0x7f12480a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:46.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.717+0000 7f1253fff700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f12480a12c0 0x7f12480a3770 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f125c199400 tx=0x7f1244009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:46.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.719+0000 7f1258ff9700 1 -- 172.21.15.151:0/2430367523 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f124c0959b0 con 0x7f125c0ffad0 2023-07-21T23:08:46.946 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.914+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f125c1a4e80 con 0x7f125c0ffad0 2023-07-21T23:08:46.947 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.915+0000 7f1258ff9700 1 -- 172.21.15.151:0/2430367523 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v175) v1 ==== 100+0+11 (secure 0 0 0) 0x7f124c098fd0 con 0x7f125c0ffad0 2023-07-21T23:08:46.947 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T23:08:46.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f12480a12c0 msgr2=0x7f12480a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.949 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f12480a12c0 0x7f12480a3770 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f125c199400 tx=0x7f1244009260 comp rx=0 tx=0).stop 2023-07-21T23:08:46.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c0ffad0 msgr2=0x7f125c197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:46.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c0ffad0 0x7f125c197df0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f124c00d950 tx=0x7f124c00dc60 comp rx=0 tx=0).stop 2023-07-21T23:08:46.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 shutdown_connections 2023-07-21T23:08:46.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f12480a12c0 0x7f12480a3770 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f125c105ae0 0x7f125c19c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f125c0ffad0 0x7f125c197df0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.950 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 --2- 172.21.15.151:0/2430367523 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f125c100480 0x7f125c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:46.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 >> 172.21.15.151:0/2430367523 conn(0x7f125c0fb5f0 msgr2=0x7f125c10aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:46.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 shutdown_connections 2023-07-21T23:08:46.951 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:46.917+0000 7f12617ff700 1 -- 172.21.15.151:0/2430367523 wait complete. 2023-07-21T23:08:46.969 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-07-21T23:08:47.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.137+0000 7f98bc9ff700 1 -- 172.21.15.151:0/2293548150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98b8105b00 msgr2=0x7f98b8105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:47.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.137+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/2293548150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98b8105b00 0x7f98b8105ed0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f98a80098f0 tx=0x7f98a8009c00 comp rx=0 tx=0).stop 2023-07-21T23:08:47.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.137+0000 7f98bc9ff700 1 -- 172.21.15.151:0/2293548150 shutdown_connections 2023-07-21T23:08:47.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.137+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/2293548150 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98b8105b00 0x7f98b8105ed0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:47.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.137+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/2293548150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98b81004a0 0x7f98b810c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:47.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.137+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/2293548150 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98b80ffaf0 0x7f98b80fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:47.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.137+0000 7f98bc9ff700 1 -- 172.21.15.151:0/2293548150 >> 172.21.15.151:0/2293548150 conn(0x7f98b80fb630 msgr2=0x7f98b80fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:47.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.137+0000 7f98bc9ff700 1 -- 172.21.15.151:0/2293548150 shutdown_connections 2023-07-21T23:08:47.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.137+0000 7f98bc9ff700 1 -- 172.21.15.151:0/2293548150 wait complete. 2023-07-21T23:08:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.138+0000 7f98bc9ff700 1 Processor -- start 2023-07-21T23:08:47.172 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.138+0000 7f98bc9ff700 1 -- start start 2023-07-21T23:08:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98bc9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98b80ffaf0 0x7f98b8072810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98bc9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98b81004a0 0x7f98b8072d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98bc9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98b8105b00 0x7f98b81a3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98bc9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b8073580 con 0x7f98b81004a0 2023-07-21T23:08:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98bc9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b81a42f0 con 0x7f98b8105b00 2023-07-21T23:08:47.173 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98bc9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b81a4430 con 0x7f98b80ffaf0 2023-07-21T23:08:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98b5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98b81004a0 0x7f98b8072d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98b5d9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98b81004a0 0x7f98b8072d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:39178/0 (socket says 172.21.15.151:39178) 2023-07-21T23:08:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98b5d9b700 1 -- 172.21.15.151:0/632475127 learned_addr learned my addr 172.21.15.151:0/632475127 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:08:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98b6d9d700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98b8105b00 0x7f98b81a3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.139+0000 7f98b659c700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98b80ffaf0 0x7f98b8072810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98b5d9b700 1 -- 172.21.15.151:0/632475127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98b80ffaf0 msgr2=0x7f98b8072810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:47.174 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98b5d9b700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98b80ffaf0 0x7f98b8072810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98b5d9b700 1 -- 172.21.15.151:0/632475127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98b8105b00 msgr2=0x7f98b81a3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98b5d9b700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98b8105b00 0x7f98b81a3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98b5d9b700 1 -- 172.21.15.151:0/632475127 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b0009d00 con 0x7f98b81004a0 2023-07-21T23:08:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98b659c700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98b80ffaf0 0x7f98b8072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:08:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98b5d9b700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98b81004a0 0x7f98b8072d50 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00e9a0 tx=0x7f98ac00ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98a77fe700 1 -- 172.21.15.151:0/632475127 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac009790 con 0x7f98b81004a0 2023-07-21T23:08:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98a77fe700 1 -- 172.21.15.151:0/632475127 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f98ac00cbd0 con 0x7f98b81004a0 2023-07-21T23:08:47.175 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98a8009520 con 0x7f98b81004a0 2023-07-21T23:08:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98a77fe700 1 -- 172.21.15.151:0/632475127 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac018680 con 0x7f98b81004a0 2023-07-21T23:08:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.140+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b81a4a30 con 0x7f98b81004a0 2023-07-21T23:08:47.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.141+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98b8067300 con 0x7f98b81004a0 2023-07-21T23:08:47.177 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.143+0000 7f98a77fe700 1 -- 172.21.15.151:0/632475127 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f98ac00cd40 con 0x7f98b81004a0 2023-07-21T23:08:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.146+0000 7f98a77fe700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98a00a1380 0x7f98a00a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:08:47.178 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.146+0000 7f98a77fe700 1 -- 172.21.15.151:0/632475127 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f98ac014070 con 0x7f98b81004a0 2023-07-21T23:08:47.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.146+0000 7f98b659c700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98a00a1380 0x7f98a00a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:08:47.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.147+0000 7f98b659c700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98a00a1380 0x7f98a00a3830 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f98a80098c0 tx=0x7f98a8019040 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:08:47.181 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.149+0000 7f98a77fe700 1 -- 172.21.15.151:0/632475127 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f98ac051770 con 0x7f98b81004a0 2023-07-21T23:08:47.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.406+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7f98b81a4d10 con 0x7f98b81004a0 2023-07-21T23:08:47.476 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.444+0000 7f98a77fe700 1 -- 172.21.15.151:0/632475127 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) v1 ==== 81+0+733782 (secure 0 0 0) 0x7f98ac096350 con 0x7f98b81004a0 2023-07-21T23:08:47.484 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:08:47.484 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T23:08:47.484 INFO:teuthology.orchestra.run.smithi151.stdout: "epoch": 25, 2023-07-21T23:08:47.485 INFO:teuthology.orchestra.run.smithi151.stdout: "active_gid": 15489, 2023-07-21T23:08:47.485 INFO:teuthology.orchestra.run.smithi151.stdout: "active_name": "x", 2023-07-21T23:08:47.485 INFO:teuthology.orchestra.run.smithi151.stdout: "active_addrs": { 2023-07-21T23:08:47.485 INFO:teuthology.orchestra.run.smithi151.stdout: "addrvec": [ 2023-07-21T23:08:47.485 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.485 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v2", 2023-07-21T23:08:47.485 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:6800", 2023-07-21T23:08:47.486 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 508405215 2023-07-21T23:08:47.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.486 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.486 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v1", 2023-07-21T23:08:47.486 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:6801", 2023-07-21T23:08:47.486 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 508405215 2023-07-21T23:08:47.486 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.486 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:47.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.487 INFO:teuthology.orchestra.run.smithi151.stdout: "active_addr": "172.21.15.151:6801/508405215", 2023-07-21T23:08:47.487 INFO:teuthology.orchestra.run.smithi151.stdout: "active_change": "2023-07-21T22:19:10.842029+0000", 2023-07-21T23:08:47.487 INFO:teuthology.orchestra.run.smithi151.stdout: "active_mgr_features": 4540138322906710015, 2023-07-21T23:08:47.487 INFO:teuthology.orchestra.run.smithi151.stdout: "available": true, 2023-07-21T23:08:47.487 INFO:teuthology.orchestra.run.smithi151.stdout: "standbys": [ 2023-07-21T23:08:47.487 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.488 INFO:teuthology.orchestra.run.smithi151.stdout: "gid": 25238, 2023-07-21T23:08:47.488 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "y", 2023-07-21T23:08:47.488 INFO:teuthology.orchestra.run.smithi151.stdout: "mgr_features": 4540138322906710015, 2023-07-21T23:08:47.488 INFO:teuthology.orchestra.run.smithi151.stdout: "available_modules": [ 2023-07-21T23:08:47.488 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.488 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "alerts", 2023-07-21T23:08:47.488 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.488 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.489 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.489 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:47.489 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:47.489 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.489 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.489 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.489 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:47.490 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.490 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.490 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.490 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How frequently to reexamine health status", 2023-07-21T23:08:47.490 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.490 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.490 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.491 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.491 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.491 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.491 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.491 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.491 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.491 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.491 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.492 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.492 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.492 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.492 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.492 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.492 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.492 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.492 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.493 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.493 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.493 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.493 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.493 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.493 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.494 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.494 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.494 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.494 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.494 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.494 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.494 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.494 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.495 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.495 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.495 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.495 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.495 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.495 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.495 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.496 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.496 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.496 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.496 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.496 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.496 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.496 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.497 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.497 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.497 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.497 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.497 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.497 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.497 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.497 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.498 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.498 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.498 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.498 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.498 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.498 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.498 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.499 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.499 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.499 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.499 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.499 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.499 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.499 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.499 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.500 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_destination": { 2023-07-21T23:08:47.500 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_destination", 2023-07-21T23:08:47.500 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.500 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.500 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.500 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.500 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.501 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.501 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.501 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Email address to send alerts to", 2023-07-21T23:08:47.501 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.501 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.501 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.501 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_from_name": { 2023-07-21T23:08:47.502 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_from_name", 2023-07-21T23:08:47.502 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.502 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.502 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.502 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "Ceph", 2023-07-21T23:08:47.502 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.502 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.502 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.503 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Email From: name", 2023-07-21T23:08:47.503 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.503 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.503 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.503 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_host": { 2023-07-21T23:08:47.503 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_host", 2023-07-21T23:08:47.503 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.504 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.504 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.504 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.504 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.504 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.504 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.504 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SMTP server", 2023-07-21T23:08:47.504 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.505 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.505 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.505 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_password": { 2023-07-21T23:08:47.505 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_password", 2023-07-21T23:08:47.505 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.505 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.506 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.506 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.506 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.506 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.506 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.506 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Password to authenticate with", 2023-07-21T23:08:47.506 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.506 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.507 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.507 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_port": { 2023-07-21T23:08:47.507 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_port", 2023-07-21T23:08:47.507 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.507 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.507 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.507 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "465", 2023-07-21T23:08:47.508 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.508 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.508 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.508 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SMTP port", 2023-07-21T23:08:47.508 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.508 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.508 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.509 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_sender": { 2023-07-21T23:08:47.509 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_sender", 2023-07-21T23:08:47.509 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.509 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.509 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.509 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.509 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.510 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.510 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.510 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SMTP envelope sender", 2023-07-21T23:08:47.510 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.510 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.510 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.511 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_ssl": { 2023-07-21T23:08:47.511 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_ssl", 2023-07-21T23:08:47.511 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.511 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.511 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.511 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.511 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.511 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.512 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.512 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-21T23:08:47.512 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.512 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.512 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.512 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_user": { 2023-07-21T23:08:47.513 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_user", 2023-07-21T23:08:47.513 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.513 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.513 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.513 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.513 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.513 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.513 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.514 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "User to authenticate as", 2023-07-21T23:08:47.514 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.514 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.514 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.514 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.514 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.515 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.515 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "balancer", 2023-07-21T23:08:47.515 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.515 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.515 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.515 INFO:teuthology.orchestra.run.smithi151.stdout: "active": { 2023-07-21T23:08:47.515 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "active", 2023-07-21T23:08:47.515 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.516 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.516 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.516 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.516 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.516 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.516 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.516 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "automatically balance PGs across cluster", 2023-07-21T23:08:47.516 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.517 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.517 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.517 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.517 INFO:teuthology.orchestra.run.smithi151.stdout: "begin_time": { 2023-07-21T23:08:47.517 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "begin_time", 2023-07-21T23:08:47.517 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.517 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.518 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.518 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0000", 2023-07-21T23:08:47.518 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.518 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.518 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.518 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "beginning time of day to automatically balance", 2023-07-21T23:08:47.518 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-21T23:08:47.518 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.519 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.519 INFO:teuthology.orchestra.run.smithi151.stdout: "begin_weekday": { 2023-07-21T23:08:47.519 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "begin_weekday", 2023-07-21T23:08:47.519 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:47.519 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.519 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.519 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:47.520 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "0", 2023-07-21T23:08:47.520 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "6", 2023-07-21T23:08:47.520 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.520 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-21T23:08:47.520 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-21T23:08:47.520 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.520 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.521 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.521 INFO:teuthology.orchestra.run.smithi151.stdout: "crush_compat_max_iterations": { 2023-07-21T23:08:47.521 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crush_compat_max_iterations", 2023-07-21T23:08:47.521 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:47.521 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.521 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.521 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "25", 2023-07-21T23:08:47.521 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:47.522 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "250", 2023-07-21T23:08:47.522 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.522 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-21T23:08:47.522 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.522 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.522 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.522 INFO:teuthology.orchestra.run.smithi151.stdout: "crush_compat_metrics": { 2023-07-21T23:08:47.523 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crush_compat_metrics", 2023-07-21T23:08:47.523 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.523 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.523 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.523 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "pgs,objects,bytes", 2023-07-21T23:08:47.523 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.523 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.523 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.524 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-21T23:08:47.524 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-21T23:08:47.524 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.524 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.524 INFO:teuthology.orchestra.run.smithi151.stdout: "crush_compat_step": { 2023-07-21T23:08:47.524 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crush_compat_step", 2023-07-21T23:08:47.525 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:47.525 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.525 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.525 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0.5", 2023-07-21T23:08:47.525 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "0.001", 2023-07-21T23:08:47.525 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "0.999", 2023-07-21T23:08:47.525 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.525 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "aggressiveness of optimization", 2023-07-21T23:08:47.526 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-21T23:08:47.526 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.526 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.526 INFO:teuthology.orchestra.run.smithi151.stdout: "end_time": { 2023-07-21T23:08:47.526 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "end_time", 2023-07-21T23:08:47.526 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.526 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.527 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.527 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "2359", 2023-07-21T23:08:47.527 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.527 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.527 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.527 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "ending time of day to automatically balance", 2023-07-21T23:08:47.527 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-21T23:08:47.527 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.528 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.528 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.528 INFO:teuthology.orchestra.run.smithi151.stdout: "end_weekday": { 2023-07-21T23:08:47.528 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "end_weekday", 2023-07-21T23:08:47.528 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:47.528 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.528 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.529 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:47.529 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "0", 2023-07-21T23:08:47.529 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "6", 2023-07-21T23:08:47.529 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.529 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-21T23:08:47.529 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-21T23:08:47.529 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.529 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.530 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.530 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.530 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.530 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.530 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.530 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.530 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.530 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.531 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.531 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.531 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.531 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.531 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.531 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.531 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.531 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.532 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.532 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.532 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.532 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.532 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.532 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.532 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.533 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.533 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.533 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.533 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.533 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.533 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.533 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.534 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.534 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.534 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.534 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.534 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.534 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.534 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.535 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.535 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.535 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.535 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.535 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.535 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.535 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.536 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.536 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.536 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.536 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.536 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.536 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.536 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.536 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.537 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.537 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.537 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.537 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.537 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.537 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.537 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.537 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.538 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.538 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.538 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.538 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.538 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.538 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.538 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.538 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.539 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.539 INFO:teuthology.orchestra.run.smithi151.stdout: "min_score": { 2023-07-21T23:08:47.539 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "min_score", 2023-07-21T23:08:47.539 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:47.539 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.539 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.539 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:47.539 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.540 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.540 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.540 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-21T23:08:47.540 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.540 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.540 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.541 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": { 2023-07-21T23:08:47.541 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mode", 2023-07-21T23:08:47.541 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.541 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.541 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.541 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "upmap", 2023-07-21T23:08:47.541 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.541 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.542 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.542 INFO:teuthology.orchestra.run.smithi151.stdout: "crush-compat", 2023-07-21T23:08:47.542 INFO:teuthology.orchestra.run.smithi151.stdout: "none", 2023-07-21T23:08:47.542 INFO:teuthology.orchestra.run.smithi151.stdout: "upmap" 2023-07-21T23:08:47.542 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.542 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Balancer mode", 2023-07-21T23:08:47.542 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.542 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.543 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.543 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.543 INFO:teuthology.orchestra.run.smithi151.stdout: "pool_ids": { 2023-07-21T23:08:47.543 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pool_ids", 2023-07-21T23:08:47.543 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.543 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.544 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.544 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.544 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.544 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.544 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.544 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-21T23:08:47.544 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.545 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.545 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.545 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.545 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:47.545 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:47.545 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.545 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.545 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.546 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:47.546 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.546 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.546 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.546 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-21T23:08:47.546 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.546 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.546 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.547 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.547 INFO:teuthology.orchestra.run.smithi151.stdout: "upmap_max_deviation": { 2023-07-21T23:08:47.547 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "upmap_max_deviation", 2023-07-21T23:08:47.547 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.547 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.547 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.547 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:47.547 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:47.548 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.548 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.548 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-21T23:08:47.548 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-21T23:08:47.548 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.548 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.548 INFO:teuthology.orchestra.run.smithi151.stdout: "upmap_max_optimizations": { 2023-07-21T23:08:47.549 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "upmap_max_optimizations", 2023-07-21T23:08:47.549 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:47.549 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.549 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.549 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:47.549 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.549 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.549 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.550 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-21T23:08:47.550 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.550 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.550 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.550 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cephadm", 2023-07-21T23:08:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "agent_down_multiplier": { 2023-07-21T23:08:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "agent_down_multiplier", 2023-07-21T23:08:47.551 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:47.552 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.552 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.552 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "3.0", 2023-07-21T23:08:47.552 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.552 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.552 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.552 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-21T23:08:47.552 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.553 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.553 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.553 INFO:teuthology.orchestra.run.smithi151.stdout: "agent_refresh_rate": { 2023-07-21T23:08:47.553 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "agent_refresh_rate", 2023-07-21T23:08:47.553 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.553 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.553 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.554 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "20", 2023-07-21T23:08:47.554 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.554 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.554 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.554 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-21T23:08:47.554 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.554 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.554 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.555 INFO:teuthology.orchestra.run.smithi151.stdout: "agent_starting_port": { 2023-07-21T23:08:47.555 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "agent_starting_port", 2023-07-21T23:08:47.555 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.555 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.555 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.555 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "4721", 2023-07-21T23:08:47.555 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.556 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.556 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.556 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-21T23:08:47.556 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.556 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.556 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.557 INFO:teuthology.orchestra.run.smithi151.stdout: "alertmanager_web_password": { 2023-07-21T23:08:47.557 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "alertmanager_web_password", 2023-07-21T23:08:47.557 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.557 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.557 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.557 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:47.557 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.558 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.558 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.558 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Alertmanager web password", 2023-07-21T23:08:47.558 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.558 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.558 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.558 INFO:teuthology.orchestra.run.smithi151.stdout: "alertmanager_web_user": { 2023-07-21T23:08:47.559 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "alertmanager_web_user", 2023-07-21T23:08:47.559 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.559 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.559 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.559 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:47.559 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.559 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.559 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.560 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Alertmanager web user", 2023-07-21T23:08:47.560 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.560 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.560 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.560 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.560 INFO:teuthology.orchestra.run.smithi151.stdout: "allow_ptrace": { 2023-07-21T23:08:47.560 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "allow_ptrace", 2023-07-21T23:08:47.561 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.561 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.561 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.561 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.561 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.561 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.561 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.561 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-21T23:08:47.562 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-21T23:08:47.562 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.562 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.562 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.562 INFO:teuthology.orchestra.run.smithi151.stdout: "autotune_interval": { 2023-07-21T23:08:47.562 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "autotune_interval", 2023-07-21T23:08:47.562 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.562 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.563 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.563 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:47.563 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.563 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.563 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.563 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-21T23:08:47.563 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.563 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.564 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.564 INFO:teuthology.orchestra.run.smithi151.stdout: "autotune_memory_target_ratio": { 2023-07-21T23:08:47.564 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "autotune_memory_target_ratio", 2023-07-21T23:08:47.564 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:47.564 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.564 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.564 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0.7", 2023-07-21T23:08:47.565 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.565 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.565 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.565 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-21T23:08:47.565 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.565 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.565 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.566 INFO:teuthology.orchestra.run.smithi151.stdout: "cgroups_split": { 2023-07-21T23:08:47.566 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cgroups_split", 2023-07-21T23:08:47.566 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.566 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.566 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.566 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.566 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.566 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.567 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.567 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-21T23:08:47.567 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.567 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.567 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.567 INFO:teuthology.orchestra.run.smithi151.stdout: "config_checks_enabled": { 2023-07-21T23:08:47.568 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "config_checks_enabled", 2023-07-21T23:08:47.568 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.568 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.568 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.568 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.568 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.569 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.569 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.569 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-21T23:08:47.569 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.569 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.569 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.570 INFO:teuthology.orchestra.run.smithi151.stdout: "config_dashboard": { 2023-07-21T23:08:47.570 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "config_dashboard", 2023-07-21T23:08:47.570 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.570 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.570 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.570 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.570 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.570 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-21T23:08:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_alertmanager": { 2023-07-21T23:08:47.571 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_alertmanager", 2023-07-21T23:08:47.572 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.572 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.572 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.572 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-21T23:08:47.572 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.572 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.572 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.572 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:47.573 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.573 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.573 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.573 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_base": { 2023-07-21T23:08:47.573 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_base", 2023-07-21T23:08:47.573 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.573 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.574 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.574 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-21T23:08:47.574 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.574 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.574 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.574 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Container image name, without the tag", 2023-07-21T23:08:47.574 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.574 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.575 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.575 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_elasticsearch": { 2023-07-21T23:08:47.575 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_elasticsearch", 2023-07-21T23:08:47.575 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.575 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.575 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.576 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-21T23:08:47.576 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.576 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.576 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.576 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "elasticsearch container image", 2023-07-21T23:08:47.576 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.576 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.576 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.577 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_grafana": { 2023-07-21T23:08:47.577 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_grafana", 2023-07-21T23:08:47.577 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.577 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.577 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.577 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-21T23:08:47.577 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.578 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.578 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.578 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:47.578 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.578 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.578 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.579 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_haproxy": { 2023-07-21T23:08:47.579 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_haproxy", 2023-07-21T23:08:47.579 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.579 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.579 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.579 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-21T23:08:47.579 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.579 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.580 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.580 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "HAproxy container image", 2023-07-21T23:08:47.580 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.580 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.580 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.580 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.580 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_jaeger_agent": { 2023-07-21T23:08:47.580 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_jaeger_agent", 2023-07-21T23:08:47.581 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.581 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.581 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.581 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-21T23:08:47.581 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.581 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.581 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.581 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Jaeger agent container image", 2023-07-21T23:08:47.582 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.582 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.582 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.582 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_jaeger_collector": { 2023-07-21T23:08:47.582 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_jaeger_collector", 2023-07-21T23:08:47.582 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.583 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.583 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.583 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-21T23:08:47.583 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.583 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.583 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.583 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Jaeger collector container image", 2023-07-21T23:08:47.583 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.584 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.584 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.584 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_jaeger_query": { 2023-07-21T23:08:47.584 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_jaeger_query", 2023-07-21T23:08:47.584 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.584 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.584 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.585 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-21T23:08:47.585 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.585 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.585 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.585 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Jaeger query container image", 2023-07-21T23:08:47.585 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.585 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.585 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.586 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_keepalived": { 2023-07-21T23:08:47.586 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_keepalived", 2023-07-21T23:08:47.586 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.586 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.586 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.586 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-21T23:08:47.586 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.587 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.587 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.587 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Keepalived container image", 2023-07-21T23:08:47.587 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.587 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.587 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.587 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_loki": { 2023-07-21T23:08:47.588 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_loki", 2023-07-21T23:08:47.588 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.588 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.588 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.588 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-21T23:08:47.588 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.588 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.588 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.589 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Loki container image", 2023-07-21T23:08:47.589 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.589 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.589 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.589 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_node_exporter": { 2023-07-21T23:08:47.589 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_node_exporter", 2023-07-21T23:08:47.590 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.590 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.590 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.590 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-21T23:08:47.590 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.590 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.590 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.590 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:47.591 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.591 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.591 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.591 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.591 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_prometheus": { 2023-07-21T23:08:47.591 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_prometheus", 2023-07-21T23:08:47.591 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.591 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.592 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.592 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-21T23:08:47.592 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.592 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.592 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.592 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:47.592 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.592 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.593 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.593 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_promtail": { 2023-07-21T23:08:47.593 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_promtail", 2023-07-21T23:08:47.593 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.593 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.593 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.593 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-21T23:08:47.594 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.594 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.594 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.594 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Promtail container image", 2023-07-21T23:08:47.594 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.594 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.594 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.595 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_snmp_gateway": { 2023-07-21T23:08:47.595 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_snmp_gateway", 2023-07-21T23:08:47.595 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.595 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.595 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.595 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-21T23:08:47.595 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.595 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.596 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.596 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SNMP Gateway container image", 2023-07-21T23:08:47.596 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.596 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.596 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.596 INFO:teuthology.orchestra.run.smithi151.stdout: "container_init": { 2023-07-21T23:08:47.597 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_init", 2023-07-21T23:08:47.597 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.597 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.597 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.597 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.597 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.597 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.597 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.598 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Run podman/docker with `--init`", 2023-07-21T23:08:47.598 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.598 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.598 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.598 INFO:teuthology.orchestra.run.smithi151.stdout: "daemon_cache_timeout": { 2023-07-21T23:08:47.598 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "daemon_cache_timeout", 2023-07-21T23:08:47.598 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.599 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.599 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.599 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:47.599 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.599 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.599 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.599 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-21T23:08:47.599 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.600 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.600 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.600 INFO:teuthology.orchestra.run.smithi151.stdout: "default_cephadm_command_timeout": { 2023-07-21T23:08:47.600 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "default_cephadm_command_timeout", 2023-07-21T23:08:47.600 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.600 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.601 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.601 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "900", 2023-07-21T23:08:47.601 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.601 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.601 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.601 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-21T23:08:47.601 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.601 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.602 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.602 INFO:teuthology.orchestra.run.smithi151.stdout: "default_registry": { 2023-07-21T23:08:47.602 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "default_registry", 2023-07-21T23:08:47.602 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.602 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.602 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.602 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io", 2023-07-21T23:08:47.603 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.603 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.603 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.603 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-21T23:08:47.603 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.603 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.603 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.604 INFO:teuthology.orchestra.run.smithi151.stdout: "device_cache_timeout": { 2023-07-21T23:08:47.604 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "device_cache_timeout", 2023-07-21T23:08:47.604 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.604 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.604 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.604 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "1800", 2023-07-21T23:08:47.604 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.605 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.605 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.605 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "seconds to cache device inventory", 2023-07-21T23:08:47.605 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.605 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.605 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.605 INFO:teuthology.orchestra.run.smithi151.stdout: "device_enhanced_scan": { 2023-07-21T23:08:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "device_enhanced_scan", 2023-07-21T23:08:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.606 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-21T23:08:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "facts_cache_timeout": { 2023-07-21T23:08:47.607 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "facts_cache_timeout", 2023-07-21T23:08:47.608 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.608 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.608 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.608 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:47.608 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.608 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.608 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.608 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "seconds to cache host facts data", 2023-07-21T23:08:47.609 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.609 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.609 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.609 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.609 INFO:teuthology.orchestra.run.smithi151.stdout: "host_check_interval": { 2023-07-21T23:08:47.609 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "host_check_interval", 2023-07-21T23:08:47.609 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.609 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.610 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.610 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:47.610 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.610 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.610 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.610 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to perform a host check", 2023-07-21T23:08:47.610 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.610 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.611 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.611 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.611 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.611 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.611 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.611 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.611 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.612 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.612 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.612 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.612 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.612 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.612 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.612 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.613 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.613 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.613 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.613 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.613 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.613 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.614 INFO:teuthology.orchestra.run.smithi151.stdout: "log_refresh_metadata": { 2023-07-21T23:08:47.614 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_refresh_metadata", 2023-07-21T23:08:47.614 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.614 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.614 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.614 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.614 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.614 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.615 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.615 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-21T23:08:47.615 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.615 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.615 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.615 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.615 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.615 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.616 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.616 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.616 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.616 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.616 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.616 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.616 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.616 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-21T23:08:47.617 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.617 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.617 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.617 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.617 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.617 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.617 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.617 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.618 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.618 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.618 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.618 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.618 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.618 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.618 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.618 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.619 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.619 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.619 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.619 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.619 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.619 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.619 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.619 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.620 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.620 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.620 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.620 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.620 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.620 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.621 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.621 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.621 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.621 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.621 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.621 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.621 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.622 INFO:teuthology.orchestra.run.smithi151.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-21T23:08:47.622 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-21T23:08:47.622 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.622 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.622 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.622 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.622 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.622 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.623 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.623 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-21T23:08:47.623 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.623 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.623 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.623 INFO:teuthology.orchestra.run.smithi151.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-21T23:08:47.624 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-21T23:08:47.624 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.624 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.624 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.624 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "*", 2023-07-21T23:08:47.624 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.624 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.624 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.625 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-21T23:08:47.625 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.625 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.625 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.625 INFO:teuthology.orchestra.run.smithi151.stdout: "max_count_per_host": { 2023-07-21T23:08:47.625 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_count_per_host", 2023-07-21T23:08:47.625 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.626 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.626 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.626 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:47.626 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.626 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.626 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.626 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "max number of daemons per service per host", 2023-07-21T23:08:47.626 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: "max_osd_draining_count": { 2023-07-21T23:08:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_osd_draining_count", 2023-07-21T23:08:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.627 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.628 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.628 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:47.628 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.628 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.628 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.628 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-21T23:08:47.628 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.628 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.629 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.629 INFO:teuthology.orchestra.run.smithi151.stdout: "migration_current": { 2023-07-21T23:08:47.629 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "migration_current", 2023-07-21T23:08:47.629 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.629 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.629 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.629 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.630 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.630 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.630 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.630 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "internal - do not modify", 2023-07-21T23:08:47.630 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.630 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.630 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.631 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": { 2023-07-21T23:08:47.631 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mode", 2023-07-21T23:08:47.631 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.631 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.631 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.631 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "root", 2023-07-21T23:08:47.631 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.632 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.632 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.632 INFO:teuthology.orchestra.run.smithi151.stdout: "cephadm-package", 2023-07-21T23:08:47.632 INFO:teuthology.orchestra.run.smithi151.stdout: "root" 2023-07-21T23:08:47.632 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.632 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "mode for remote execution of cephadm", 2023-07-21T23:08:47.632 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.632 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.633 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.633 INFO:teuthology.orchestra.run.smithi151.stdout: "prometheus_alerts_path": { 2023-07-21T23:08:47.633 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus_alerts_path", 2023-07-21T23:08:47.633 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.633 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.633 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.633 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-21T23:08:47.634 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.634 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.634 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.634 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-21T23:08:47.634 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.634 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.634 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.635 INFO:teuthology.orchestra.run.smithi151.stdout: "prometheus_web_password": { 2023-07-21T23:08:47.635 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus_web_password", 2023-07-21T23:08:47.635 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.635 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.635 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.635 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:47.635 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.635 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.636 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.636 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus web password", 2023-07-21T23:08:47.636 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.636 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.636 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.636 INFO:teuthology.orchestra.run.smithi151.stdout: "prometheus_web_user": { 2023-07-21T23:08:47.637 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus_web_user", 2023-07-21T23:08:47.637 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.637 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.637 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.637 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:47.637 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.637 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.637 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.638 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus web user", 2023-07-21T23:08:47.638 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.638 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.638 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.638 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_insecure": { 2023-07-21T23:08:47.638 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_insecure", 2023-07-21T23:08:47.638 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.639 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.639 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.639 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.639 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.639 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.639 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.639 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-21T23:08:47.639 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.640 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.640 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.640 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_password": { 2023-07-21T23:08:47.640 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_password", 2023-07-21T23:08:47.640 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.640 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.640 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.641 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.641 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.641 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.641 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.641 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-21T23:08:47.641 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.641 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.641 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.642 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.642 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_url": { 2023-07-21T23:08:47.642 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_url", 2023-07-21T23:08:47.642 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.642 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.642 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.642 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.643 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.643 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.643 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.643 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-21T23:08:47.643 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.643 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.643 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.644 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_username": { 2023-07-21T23:08:47.644 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_username", 2023-07-21T23:08:47.644 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.644 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.644 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.644 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.644 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.644 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.645 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.645 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-21T23:08:47.645 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.645 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.645 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.645 INFO:teuthology.orchestra.run.smithi151.stdout: "secure_monitoring_stack": { 2023-07-21T23:08:47.646 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "secure_monitoring_stack", 2023-07-21T23:08:47.646 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.646 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.646 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.646 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.646 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.646 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.646 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.647 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-21T23:08:47.647 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.647 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.647 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.647 INFO:teuthology.orchestra.run.smithi151.stdout: "service_discovery_port": { 2023-07-21T23:08:47.647 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "service_discovery_port", 2023-07-21T23:08:47.647 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.648 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.648 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.648 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8765", 2023-07-21T23:08:47.648 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.648 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.648 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.648 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "cephadm service discovery port", 2023-07-21T23:08:47.649 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.649 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.649 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.649 INFO:teuthology.orchestra.run.smithi151.stdout: "ssh_config_file": { 2023-07-21T23:08:47.649 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssh_config_file", 2023-07-21T23:08:47.649 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.649 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.650 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.650 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.650 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.650 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.650 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.650 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-21T23:08:47.650 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.650 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.651 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.651 INFO:teuthology.orchestra.run.smithi151.stdout: "use_agent": { 2023-07-21T23:08:47.651 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "use_agent", 2023-07-21T23:08:47.651 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.651 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.651 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.652 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.652 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.652 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.652 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-21T23:08:47.652 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.652 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.652 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.652 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.653 INFO:teuthology.orchestra.run.smithi151.stdout: "use_repo_digest": { 2023-07-21T23:08:47.653 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "use_repo_digest", 2023-07-21T23:08:47.653 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.653 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.653 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.653 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.653 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.653 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.654 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.654 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-21T23:08:47.654 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.654 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.654 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.654 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.654 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_on_failed_host_check": { 2023-07-21T23:08:47.654 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_on_failed_host_check", 2023-07-21T23:08:47.655 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.655 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.655 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.655 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.655 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.655 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.655 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.655 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise a health warning if the host check fails", 2023-07-21T23:08:47.656 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.656 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.656 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.656 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.656 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_on_stray_daemons": { 2023-07-21T23:08:47.656 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_on_stray_daemons", 2023-07-21T23:08:47.656 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.657 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.657 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.657 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.657 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.657 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.657 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.657 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-21T23:08:47.657 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.658 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.658 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.658 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_on_stray_hosts": { 2023-07-21T23:08:47.658 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_on_stray_hosts", 2023-07-21T23:08:47.658 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.658 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.658 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.659 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.659 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.659 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.659 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.659 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-21T23:08:47.659 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.659 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.659 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.660 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.660 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.660 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.660 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crash", 2023-07-21T23:08:47.660 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.660 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.660 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.661 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.661 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.661 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.661 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.661 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.661 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.661 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.661 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.662 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.662 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.662 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.662 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.662 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.662 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.662 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.662 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.663 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.663 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.663 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.663 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.663 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.663 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.663 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.664 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.664 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.664 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.664 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.664 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.664 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.664 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.665 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.665 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.665 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.665 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.665 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.665 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.665 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.666 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.666 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.666 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.666 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.666 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.666 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.666 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.667 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.667 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.667 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.667 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.667 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.667 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.667 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.667 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.668 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.668 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.668 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.668 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.669 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.669 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.669 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.669 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.669 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.669 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.669 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.670 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.670 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.670 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.670 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.670 INFO:teuthology.orchestra.run.smithi151.stdout: "retain_interval": { 2023-07-21T23:08:47.670 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "retain_interval", 2023-07-21T23:08:47.670 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.671 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.671 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.671 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "31536000", 2023-07-21T23:08:47.671 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.671 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.671 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.671 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-21T23:08:47.671 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.672 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.672 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.672 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_recent_interval": { 2023-07-21T23:08:47.672 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_recent_interval", 2023-07-21T23:08:47.672 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.672 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.673 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.673 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "1209600", 2023-07-21T23:08:47.673 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.673 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.673 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.673 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-21T23:08:47.673 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.673 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.674 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.674 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.674 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.674 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "dashboard", 2023-07-21T23:08:47.674 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.674 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.675 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.675 INFO:teuthology.orchestra.run.smithi151.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-21T23:08:47.675 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-21T23:08:47.675 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.675 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.675 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.675 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:47.675 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.676 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.676 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.676 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.676 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.676 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.676 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.676 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.677 INFO:teuthology.orchestra.run.smithi151.stdout: "ALERTMANAGER_API_HOST": { 2023-07-21T23:08:47.677 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-21T23:08:47.677 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.677 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.677 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.677 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.677 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.677 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.678 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.678 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.678 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.678 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.678 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.678 INFO:teuthology.orchestra.run.smithi151.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-21T23:08:47.678 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-21T23:08:47.679 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.679 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.679 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.679 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.679 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.679 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.679 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.679 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.680 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.680 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.680 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.680 INFO:teuthology.orchestra.run.smithi151.stdout: "AUDIT_API_ENABLED": { 2023-07-21T23:08:47.680 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "AUDIT_API_ENABLED", 2023-07-21T23:08:47.680 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.681 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.681 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.681 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.681 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.681 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.681 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.681 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.681 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.682 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.682 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.682 INFO:teuthology.orchestra.run.smithi151.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-21T23:08:47.682 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-21T23:08:47.682 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.682 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.682 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.683 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.683 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.683 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.683 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.683 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.683 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.683 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.683 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.684 INFO:teuthology.orchestra.run.smithi151.stdout: "ENABLE_BROWSABLE_API": { 2023-07-21T23:08:47.684 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-21T23:08:47.684 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.684 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.684 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.684 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.684 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.685 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.685 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.685 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.685 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.685 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.685 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.685 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.686 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-21T23:08:47.686 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-21T23:08:47.686 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.686 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.686 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.686 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.686 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.686 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.687 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.687 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.687 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.687 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.687 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.687 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-21T23:08:47.687 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-21T23:08:47.688 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.688 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.688 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.688 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.688 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.688 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.688 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.688 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.689 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.689 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.689 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.689 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-21T23:08:47.689 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-21T23:08:47.689 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.690 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.690 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.690 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.690 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.690 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.690 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.690 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.690 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.691 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.691 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.691 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-21T23:08:47.691 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-21T23:08:47.691 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.691 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.691 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.692 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.692 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.692 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.692 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.692 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.692 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.692 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.693 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.693 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-21T23:08:47.693 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-21T23:08:47.693 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.693 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.693 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.693 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.694 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.694 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.694 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.694 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.694 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.694 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.694 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.694 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.695 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-21T23:08:47.695 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-21T23:08:47.695 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.695 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.695 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.695 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.695 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.695 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.696 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.696 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.696 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.696 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.696 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.696 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-21T23:08:47.697 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-21T23:08:47.697 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.697 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.697 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.697 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.697 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.697 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.697 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.698 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.698 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.698 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.698 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.698 INFO:teuthology.orchestra.run.smithi151.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-21T23:08:47.698 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-21T23:08:47.698 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.699 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.699 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.699 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.699 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.699 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.699 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.699 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.699 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.700 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.700 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.700 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_PASSWORD": { 2023-07-21T23:08:47.700 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-21T23:08:47.700 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.700 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.700 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.701 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:47.701 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.701 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.701 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.701 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.701 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.701 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.701 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.702 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-21T23:08:47.702 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-21T23:08:47.702 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.702 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.702 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.702 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.703 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.703 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.703 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.703 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.703 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.703 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.703 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.704 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_URL": { 2023-07-21T23:08:47.704 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_URL", 2023-07-21T23:08:47.704 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.704 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.704 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.704 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.704 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.704 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.705 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.705 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.705 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.705 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.705 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.705 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_USERNAME": { 2023-07-21T23:08:47.705 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-21T23:08:47.706 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.706 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.706 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.706 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:47.706 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.706 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.706 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.706 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.707 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.707 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.707 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.707 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-21T23:08:47.707 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-21T23:08:47.707 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.707 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.708 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.708 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.708 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.708 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.708 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.708 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.708 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.709 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.709 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.709 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-21T23:08:47.709 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-21T23:08:47.709 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.709 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.709 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.710 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.710 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.710 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.710 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.710 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.710 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.710 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.710 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.711 INFO:teuthology.orchestra.run.smithi151.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-21T23:08:47.711 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-21T23:08:47.711 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.711 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.711 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.711 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.711 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.712 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.712 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.712 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.712 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.712 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.712 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.712 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.713 INFO:teuthology.orchestra.run.smithi151.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-21T23:08:47.713 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-21T23:08:47.713 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.713 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.713 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.713 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.713 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.713 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.714 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.714 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.714 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.714 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.714 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.714 INFO:teuthology.orchestra.run.smithi151.stdout: "PROMETHEUS_API_HOST": { 2023-07-21T23:08:47.714 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-21T23:08:47.715 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.715 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.715 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.715 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.715 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.715 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.715 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.715 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.716 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.716 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.716 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.716 INFO:teuthology.orchestra.run.smithi151.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-21T23:08:47.716 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-21T23:08:47.717 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.717 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.717 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.717 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.717 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.717 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.717 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.717 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.718 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.718 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.718 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.718 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-21T23:08:47.718 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-21T23:08:47.718 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.718 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.719 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.719 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.719 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.719 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.719 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.719 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.719 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.719 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.720 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.720 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-21T23:08:47.720 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-21T23:08:47.720 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.720 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.720 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.720 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.721 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.721 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.721 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.721 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.721 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.721 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.721 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.722 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-21T23:08:47.722 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-21T23:08:47.722 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.722 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.722 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.722 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.722 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.722 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.723 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.723 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.723 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.723 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.723 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.723 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-21T23:08:47.723 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-21T23:08:47.724 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.724 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.724 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.724 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.724 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.724 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.724 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.725 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.725 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.725 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.725 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.725 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-21T23:08:47.725 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-21T23:08:47.725 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.726 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.726 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.726 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.726 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.726 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.726 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.726 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.726 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.727 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.727 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.727 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-21T23:08:47.727 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-21T23:08:47.727 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.727 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.727 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.728 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.728 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.728 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.728 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.728 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.728 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.728 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.729 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.729 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-21T23:08:47.729 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-21T23:08:47.729 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.729 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.729 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.729 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.730 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.730 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.730 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.730 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.730 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.730 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.730 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.731 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_ENABLED": { 2023-07-21T23:08:47.731 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-21T23:08:47.731 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.731 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.731 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.731 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.731 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.731 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.732 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.732 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.732 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.732 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.732 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.732 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-21T23:08:47.732 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-21T23:08:47.733 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.733 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.733 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.733 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-21T23:08:47.733 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.733 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.733 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.734 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.734 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.734 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.734 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.734 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.734 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-21T23:08:47.734 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-21T23:08:47.734 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.735 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.735 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.735 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:47.735 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.735 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.735 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.735 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.735 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.736 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.736 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.736 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-21T23:08:47.736 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-21T23:08:47.736 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.736 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.736 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.737 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8", 2023-07-21T23:08:47.737 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.737 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.737 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.737 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.737 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.737 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.737 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.738 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.738 INFO:teuthology.orchestra.run.smithi151.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-21T23:08:47.738 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-21T23:08:47.738 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.738 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.738 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.738 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "45", 2023-07-21T23:08:47.738 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_ACCESS_KEY": { 2023-07-21T23:08:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-21T23:08:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-21T23:08:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-21T23:08:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_SECRET_KEY": { 2023-07-21T23:08:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-21T23:08:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_SSL_VERIFY": { 2023-07-21T23:08:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-21T23:08:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-21T23:08:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-21T23:08:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-21T23:08:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-21T23:08:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-21T23:08:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-21T23:08:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: "cross_origin_url": { 2023-07-21T23:08:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cross_origin_url", 2023-07-21T23:08:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.753 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.753 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.753 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.753 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.753 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.753 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.753 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.753 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.754 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.754 INFO:teuthology.orchestra.run.smithi151.stdout: "crt_file": { 2023-07-21T23:08:47.754 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crt_file", 2023-07-21T23:08:47.754 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.754 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.754 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.754 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.755 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.755 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.755 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.755 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.755 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.755 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.755 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.756 INFO:teuthology.orchestra.run.smithi151.stdout: "debug": { 2023-07-21T23:08:47.756 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "debug", 2023-07-21T23:08:47.756 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.756 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.756 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.756 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.756 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.756 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.757 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.757 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Enable/disable debug options", 2023-07-21T23:08:47.757 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.757 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.757 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.757 INFO:teuthology.orchestra.run.smithi151.stdout: "jwt_token_ttl": { 2023-07-21T23:08:47.757 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "jwt_token_ttl", 2023-07-21T23:08:47.758 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.758 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.758 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.758 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "28800", 2023-07-21T23:08:47.758 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.758 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.758 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.758 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.759 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.759 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.759 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.759 INFO:teuthology.orchestra.run.smithi151.stdout: "key_file": { 2023-07-21T23:08:47.759 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "key_file", 2023-07-21T23:08:47.759 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.759 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.760 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.760 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.760 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.760 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.760 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.760 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.760 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.760 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.761 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.761 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.761 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.761 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.761 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.761 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.761 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.761 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.762 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.762 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.762 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.762 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.762 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.762 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.762 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.762 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.763 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.763 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.763 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.763 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.763 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.763 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.763 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.764 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.764 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.764 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.764 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.764 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.764 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.764 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.765 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.765 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.765 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.765 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.765 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.765 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.765 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.765 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.766 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.767 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.768 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.769 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.770 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.770 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.770 INFO:teuthology.orchestra.run.smithi151.stdout: "motd": { 2023-07-21T23:08:47.770 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "motd", 2023-07-21T23:08:47.770 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.770 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.770 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.771 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.771 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.771 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.771 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.771 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "The message of the day", 2023-07-21T23:08:47.771 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.771 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.771 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.772 INFO:teuthology.orchestra.run.smithi151.stdout: "redirect_resolve_ip_addr": { 2023-07-21T23:08:47.772 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "redirect_resolve_ip_addr", 2023-07-21T23:08:47.772 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.772 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.772 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.772 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.772 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.773 INFO:teuthology.orchestra.run.smithi151.stdout: "server_addr": { 2023-07-21T23:08:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_addr", 2023-07-21T23:08:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "::", 2023-07-21T23:08:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.774 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "server_port": { 2023-07-21T23:08:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_port", 2023-07-21T23:08:47.775 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8080", 2023-07-21T23:08:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.776 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "ssl": { 2023-07-21T23:08:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssl", 2023-07-21T23:08:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.777 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.778 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "ssl_server_port": { 2023-07-21T23:08:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssl_server_port", 2023-07-21T23:08:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.779 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8443", 2023-07-21T23:08:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.780 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_behaviour": { 2023-07-21T23:08:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_behaviour", 2023-07-21T23:08:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "redirect", 2023-07-21T23:08:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.781 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "redirect" 2023-07-21T23:08:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.782 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_error_status_code": { 2023-07-21T23:08:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_error_status_code", 2023-07-21T23:08:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "500", 2023-07-21T23:08:47.783 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "400", 2023-07-21T23:08:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "599", 2023-07-21T23:08:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "url_prefix": { 2023-07-21T23:08:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "url_prefix", 2023-07-21T23:08:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.785 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "devicehealth", 2023-07-21T23:08:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "enable_monitoring": { 2023-07-21T23:08:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enable_monitoring", 2023-07-21T23:08:47.787 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.788 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "monitor device health metrics", 2023-07-21T23:08:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.789 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.790 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.791 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.792 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.793 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.794 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.795 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.796 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.797 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "mark_out_threshold": { 2023-07-21T23:08:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mark_out_threshold", 2023-07-21T23:08:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.798 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "2419200", 2023-07-21T23:08:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-21T23:08:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.799 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "pool_name": { 2023-07-21T23:08:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pool_name", 2023-07-21T23:08:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "device_health_metrics", 2023-07-21T23:08:47.800 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-21T23:08:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.801 INFO:teuthology.orchestra.run.smithi151.stdout: "retention_period": { 2023-07-21T23:08:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "retention_period", 2023-07-21T23:08:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "15552000", 2023-07-21T23:08:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.802 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how long to retain device health metrics", 2023-07-21T23:08:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "scrape_frequency": { 2023-07-21T23:08:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "scrape_frequency", 2023-07-21T23:08:47.803 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "86400", 2023-07-21T23:08:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-21T23:08:47.804 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "self_heal": { 2023-07-21T23:08:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "self_heal", 2023-07-21T23:08:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.805 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-21T23:08:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.806 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.807 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to wake up and check device health", 2023-07-21T23:08:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_threshold": { 2023-07-21T23:08:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_threshold", 2023-07-21T23:08:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "7257600", 2023-07-21T23:08:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-21T23:08:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.810 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "diskprediction_local", 2023-07-21T23:08:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.811 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.812 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.813 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.814 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.815 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.816 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.817 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.818 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.819 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "predict_interval": { 2023-07-21T23:08:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "predict_interval", 2023-07-21T23:08:47.820 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "86400", 2023-07-21T23:08:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.821 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "predictor_model": { 2023-07-21T23:08:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "predictor_model", 2023-07-21T23:08:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.822 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "prophetstor", 2023-07-21T23:08:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.823 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.824 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.825 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "influx", 2023-07-21T23:08:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": false, 2023-07-21T23:08:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "influxdb python module not found", 2023-07-21T23:08:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.826 INFO:teuthology.orchestra.run.smithi151.stdout: "batch_size": { 2023-07-21T23:08:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "batch_size", 2023-07-21T23:08:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5000", 2023-07-21T23:08:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.827 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-21T23:08:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "database": { 2023-07-21T23:08:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "database", 2023-07-21T23:08:47.828 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "ceph", 2023-07-21T23:08:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-21T23:08:47.829 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": { 2023-07-21T23:08:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "hostname", 2023-07-21T23:08:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.830 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "InfluxDB server hostname", 2023-07-21T23:08:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.831 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.832 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "30", 2023-07-21T23:08:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "5", 2023-07-21T23:08:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-21T23:08:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.834 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.835 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.836 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.837 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.838 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.839 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.840 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.841 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.842 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "password": { 2023-07-21T23:08:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "password", 2023-07-21T23:08:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.843 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "password of InfluxDB server user", 2023-07-21T23:08:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.844 INFO:teuthology.orchestra.run.smithi151.stdout: "port": { 2023-07-21T23:08:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "port", 2023-07-21T23:08:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8086", 2023-07-21T23:08:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.845 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "InfluxDB server port", 2023-07-21T23:08:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "ssl": { 2023-07-21T23:08:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssl", 2023-07-21T23:08:47.846 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "false", 2023-07-21T23:08:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-21T23:08:47.847 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "threads": { 2023-07-21T23:08:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "threads", 2023-07-21T23:08:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.848 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "32", 2023-07-21T23:08:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-21T23:08:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.849 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "username": { 2023-07-21T23:08:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "username", 2023-07-21T23:08:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.850 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "username of InfluxDB server user", 2023-07-21T23:08:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.851 INFO:teuthology.orchestra.run.smithi151.stdout: "verify_ssl": { 2023-07-21T23:08:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "verify_ssl", 2023-07-21T23:08:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "true", 2023-07-21T23:08:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.852 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-21T23:08:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "insights", 2023-07-21T23:08:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.854 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.855 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.856 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.857 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.858 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.858 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.858 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.858 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.858 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.858 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.858 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.859 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.860 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.861 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.862 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.863 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "iostat", 2023-07-21T23:08:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.864 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.865 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.866 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.867 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.868 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.869 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.870 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.871 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.872 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "k8sevents", 2023-07-21T23:08:47.873 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_event_retention_days": { 2023-07-21T23:08:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ceph_event_retention_days", 2023-07-21T23:08:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.874 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "7", 2023-07-21T23:08:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Days to hold ceph event information within local cache", 2023-07-21T23:08:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "config_check_secs": { 2023-07-21T23:08:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "config_check_secs", 2023-07-21T23:08:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "10", 2023-07-21T23:08:47.876 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-07-21T23:08:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.877 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.878 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.879 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.880 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.881 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.882 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.883 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.885 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "localpool", 2023-07-21T23:08:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "failure_domain": { 2023-07-21T23:08:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "failure_domain", 2023-07-21T23:08:47.887 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "host", 2023-07-21T23:08:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "failure domain for any created local pool", 2023-07-21T23:08:47.888 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-21T23:08:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.889 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.890 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.891 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.892 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.893 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.894 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.895 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.896 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.897 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "min_size": { 2023-07-21T23:08:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "min_size", 2023-07-21T23:08:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.898 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "default min_size for any created local pool", 2023-07-21T23:08:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-21T23:08:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.899 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "num_rep": { 2023-07-21T23:08:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "num_rep", 2023-07-21T23:08:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "3", 2023-07-21T23:08:47.900 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "default replica count for any created local pool", 2023-07-21T23:08:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.901 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "pg_num": { 2023-07-21T23:08:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pg_num", 2023-07-21T23:08:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "128", 2023-07-21T23:08:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.902 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "default pg_num for any created local pool", 2023-07-21T23:08:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "prefix": { 2023-07-21T23:08:47.903 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prefix", 2023-07-21T23:08:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.904 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "name prefix for any created local pool", 2023-07-21T23:08:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "subtree": { 2023-07-21T23:08:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "subtree", 2023-07-21T23:08:47.905 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "rack", 2023-07-21T23:08:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-21T23:08:47.906 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-21T23:08:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mds_autoscaler", 2023-07-21T23:08:47.907 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.908 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.909 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.910 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.911 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.912 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.913 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.913 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.913 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.913 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.913 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.913 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.913 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.913 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.914 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.914 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.914 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.914 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.914 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.914 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.914 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.914 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.915 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.916 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mirroring", 2023-07-21T23:08:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.917 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.918 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.919 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.920 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.921 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.922 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.923 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.924 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.925 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.926 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "nfs", 2023-07-21T23:08:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.927 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.928 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.929 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.930 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.931 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.932 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.932 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.932 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.932 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.932 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.932 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.933 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.934 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.935 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.937 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.937 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.937 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "orchestrator", 2023-07-21T23:08:47.937 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.937 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.937 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.937 INFO:teuthology.orchestra.run.smithi151.stdout: "fail_fs": { 2023-07-21T23:08:47.937 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "fail_fs", 2023-07-21T23:08:47.938 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.938 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.938 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.938 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.938 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.938 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.938 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.938 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-21T23:08:47.939 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.939 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.939 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.939 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.939 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.939 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.939 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.939 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.940 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.940 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.940 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.940 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.940 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.940 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.940 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.941 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.942 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.944 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.945 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.946 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.947 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: "orchestrator": { 2023-07-21T23:08:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "orchestrator", 2023-07-21T23:08:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.948 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "cephadm", 2023-07-21T23:08:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "rook", 2023-07-21T23:08:47.949 INFO:teuthology.orchestra.run.smithi151.stdout: "test_orchestrator" 2023-07-21T23:08:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Orchestrator backend", 2023-07-21T23:08:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "osd_perf_query", 2023-07-21T23:08:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.951 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.952 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.953 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.954 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.954 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.954 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.954 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.954 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.954 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.955 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.956 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.957 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.958 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.959 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.960 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "osd_support", 2023-07-21T23:08:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.961 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.962 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.963 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.964 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.966 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.967 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.968 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.969 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pg_autoscaler", 2023-07-21T23:08:47.970 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.971 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.972 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.973 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.974 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.975 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.976 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.977 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.978 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.979 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: "noautoscale": { 2023-07-21T23:08:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "noautoscale", 2023-07-21T23:08:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.980 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "global autoscale flag", 2023-07-21T23:08:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-21T23:08:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.981 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.982 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.983 INFO:teuthology.orchestra.run.smithi151.stdout: "threshold": { 2023-07-21T23:08:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "threshold", 2023-07-21T23:08:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "3.0", 2023-07-21T23:08:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1.0", 2023-07-21T23:08:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.984 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "scaling threshold", 2023-07-21T23:08:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-21T23:08:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.985 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "progress", 2023-07-21T23:08:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "allow_pg_recovery_event": { 2023-07-21T23:08:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "allow_pg_recovery_event", 2023-07-21T23:08:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.986 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-21T23:08:47.987 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "enabled": { 2023-07-21T23:08:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enabled", 2023-07-21T23:08:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.988 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.989 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:47.990 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.991 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.992 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.993 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:47.995 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.996 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.997 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:47.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "max_completed_events": { 2023-07-21T23:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_completed_events", 2023-07-21T23:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "50", 2023-07-21T23:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:47.999 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "number of past completed events to remember", 2023-07-21T23:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:48.000 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.001 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how long the module is going to sleep", 2023-07-21T23:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.002 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus", 2023-07-21T23:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "cache": { 2023-07-21T23:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cache", 2023-07-21T23:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.003 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.004 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "exclude_perf_counters": { 2023-07-21T23:08:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "exclude_perf_counters", 2023-07-21T23:08:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.005 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-21T23:08:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-21T23:08:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.006 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.007 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.008 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.009 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.010 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.011 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.012 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.013 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.014 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.015 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_stats_pools": { 2023-07-21T23:08:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_stats_pools", 2023-07-21T23:08:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.016 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-21T23:08:48.017 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-21T23:08:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "300", 2023-07-21T23:08:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.018 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "scrape_interval": { 2023-07-21T23:08:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "scrape_interval", 2023-07-21T23:08:48.019 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "15.0", 2023-07-21T23:08:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.020 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: "server_addr": { 2023-07-21T23:08:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_addr", 2023-07-21T23:08:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.021 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.022 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "::", 2023-07-21T23:08:48.022 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.022 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.022 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.022 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-21T23:08:48.022 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.022 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.022 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.023 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.023 INFO:teuthology.orchestra.run.smithi151.stdout: "server_port": { 2023-07-21T23:08:48.023 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_port", 2023-07-21T23:08:48.023 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.023 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.023 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.023 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "9283", 2023-07-21T23:08:48.024 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.024 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.024 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.024 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-21T23:08:48.024 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.024 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.024 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.025 INFO:teuthology.orchestra.run.smithi151.stdout: "stale_cache_strategy": { 2023-07-21T23:08:48.025 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "stale_cache_strategy", 2023-07-21T23:08:48.025 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.025 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.025 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.025 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "log", 2023-07-21T23:08:48.025 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.025 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.026 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.026 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.026 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.026 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.026 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.026 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_behaviour": { 2023-07-21T23:08:48.026 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_behaviour", 2023-07-21T23:08:48.027 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.027 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.027 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.027 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "default", 2023-07-21T23:08:48.027 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.027 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.027 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.028 INFO:teuthology.orchestra.run.smithi151.stdout: "default", 2023-07-21T23:08:48.028 INFO:teuthology.orchestra.run.smithi151.stdout: "error" 2023-07-21T23:08:48.028 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.028 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.028 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.028 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.028 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.029 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_error_status_code": { 2023-07-21T23:08:48.029 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_error_status_code", 2023-07-21T23:08:48.029 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.029 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.029 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.029 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "500", 2023-07-21T23:08:48.029 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "400", 2023-07-21T23:08:48.030 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "599", 2023-07-21T23:08:48.030 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.030 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.030 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.030 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.030 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.030 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.031 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.031 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.031 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.031 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_support", 2023-07-21T23:08:48.031 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.031 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.031 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.031 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.032 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.032 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.032 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.032 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.032 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.032 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.032 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.032 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.033 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.033 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.033 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.033 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.033 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.033 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.033 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.033 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.034 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.034 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.034 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.034 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.034 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.034 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.034 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.034 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.035 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.035 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.035 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.035 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.035 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.035 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.035 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.035 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.036 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.036 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.036 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.036 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.036 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.036 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.036 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.036 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.037 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.037 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.037 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.037 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.037 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.037 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.037 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.037 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.038 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.038 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.038 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.038 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.038 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.038 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.039 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.039 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.039 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.039 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.039 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.039 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.039 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.039 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.040 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.040 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.040 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.040 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.040 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.040 INFO:teuthology.orchestra.run.smithi151.stdout: "max_concurrent_snap_create": { 2023-07-21T23:08:48.040 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_concurrent_snap_create", 2023-07-21T23:08:48.041 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.041 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.041 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.041 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:48.041 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.041 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.041 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.041 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.042 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.042 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.042 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.042 INFO:teuthology.orchestra.run.smithi151.stdout: "mirror_snapshot_schedule": { 2023-07-21T23:08:48.042 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mirror_snapshot_schedule", 2023-07-21T23:08:48.042 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.042 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.043 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.043 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.043 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.043 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.043 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.043 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.043 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.043 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.044 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.044 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.044 INFO:teuthology.orchestra.run.smithi151.stdout: "trash_purge_schedule": { 2023-07-21T23:08:48.044 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "trash_purge_schedule", 2023-07-21T23:08:48.044 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.044 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.044 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.044 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.045 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.045 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.045 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.045 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.045 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.045 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.045 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.045 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.046 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.046 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.046 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.046 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "restful", 2023-07-21T23:08:48.046 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.046 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.046 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.046 INFO:teuthology.orchestra.run.smithi151.stdout: "enable_auth": { 2023-07-21T23:08:48.047 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enable_auth", 2023-07-21T23:08:48.047 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.047 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.047 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.047 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.047 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.047 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.048 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.048 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.048 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.048 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.048 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.048 INFO:teuthology.orchestra.run.smithi151.stdout: "key_file": { 2023-07-21T23:08:48.048 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "key_file", 2023-07-21T23:08:48.049 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.049 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.049 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.049 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.049 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.049 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.049 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.049 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.050 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.050 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.050 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.050 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.050 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.050 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.050 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.051 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.051 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.051 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.051 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.051 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.051 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.051 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.051 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.052 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.052 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.052 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.052 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.052 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.052 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.052 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.052 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.053 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.053 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.053 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.053 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.053 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.053 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.053 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.053 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.054 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.054 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.054 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.054 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.054 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.054 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.054 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.055 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.055 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.055 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.055 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.055 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.056 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.056 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.056 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.056 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.056 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.056 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.056 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.056 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.057 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.057 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.057 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.057 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.057 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.057 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.057 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.058 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.058 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.058 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.058 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.058 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.058 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.058 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.058 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.059 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.059 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.059 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.059 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.059 INFO:teuthology.orchestra.run.smithi151.stdout: "server_addr": { 2023-07-21T23:08:48.059 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_addr", 2023-07-21T23:08:48.059 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.060 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.060 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.060 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.060 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.060 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.060 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.060 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.060 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.061 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.061 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.061 INFO:teuthology.orchestra.run.smithi151.stdout: "server_port": { 2023-07-21T23:08:48.061 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_port", 2023-07-21T23:08:48.061 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.061 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.061 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.062 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.062 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.062 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.062 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.062 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.062 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.062 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.062 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.063 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.063 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.063 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.063 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.063 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rgw", 2023-07-21T23:08:48.063 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.063 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.063 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.064 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.064 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.064 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.064 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.064 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.064 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.064 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.065 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.065 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.065 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.065 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.065 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.065 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.065 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.065 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.066 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.066 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.066 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.066 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.066 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.066 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.066 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.066 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.067 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.067 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.067 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.067 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.067 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.067 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.067 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.067 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.068 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.068 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.068 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.068 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.068 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.068 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.068 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.068 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.069 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.069 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.069 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.069 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.069 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.069 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.069 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.070 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.070 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.070 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.070 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.070 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.070 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.070 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.070 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.071 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.071 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.071 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.071 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.071 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.071 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.071 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.072 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.072 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.072 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.072 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.072 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.072 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.072 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.072 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.073 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.073 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.073 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.073 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rook", 2023-07-21T23:08:48.073 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.073 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.073 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.073 INFO:teuthology.orchestra.run.smithi151.stdout: "drive_group_interval": { 2023-07-21T23:08:48.074 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "drive_group_interval", 2023-07-21T23:08:48.074 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.074 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.074 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.074 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "300.0", 2023-07-21T23:08:48.074 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.074 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.075 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.075 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-21T23:08:48.075 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.075 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.075 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.075 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.075 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.075 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.076 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.076 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.076 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.076 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.076 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.076 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.076 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.076 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.077 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.077 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.077 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.077 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.077 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.077 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.077 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.077 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.078 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.078 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.078 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.078 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.078 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.078 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.078 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.078 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.079 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.079 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.079 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.079 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.079 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.079 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.079 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.079 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.080 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.080 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.080 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.080 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.080 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.080 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.081 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.081 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.081 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.081 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.081 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.081 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.081 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.081 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.082 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.082 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.082 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.082 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.082 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.082 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.083 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.083 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.083 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.083 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.083 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.083 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.083 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.083 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.084 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.084 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.084 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.084 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.084 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.084 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.084 INFO:teuthology.orchestra.run.smithi151.stdout: "storage_class": { 2023-07-21T23:08:48.085 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "storage_class", 2023-07-21T23:08:48.085 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.085 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.085 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.085 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "local", 2023-07-21T23:08:48.085 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.085 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.085 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.086 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-21T23:08:48.086 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.086 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.086 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.086 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.086 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.087 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "selftest", 2023-07-21T23:08:48.087 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.087 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.087 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.087 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.087 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.087 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.087 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.088 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.088 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.088 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.088 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.088 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.088 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.088 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.088 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.089 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.089 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.089 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.089 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.089 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.089 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.089 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.090 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.090 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.090 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.090 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.090 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.090 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.090 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.092 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.093 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.094 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.094 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.094 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.094 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.094 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.094 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.094 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.095 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.095 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.095 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.095 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.095 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.095 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.095 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.095 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.096 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.096 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.096 INFO:teuthology.orchestra.run.smithi151.stdout: "roption1": { 2023-07-21T23:08:48.096 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "roption1", 2023-07-21T23:08:48.096 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.096 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.096 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.097 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.097 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.097 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.097 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.097 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.097 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.097 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.098 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.098 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.098 INFO:teuthology.orchestra.run.smithi151.stdout: "roption2": { 2023-07-21T23:08:48.098 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "roption2", 2023-07-21T23:08:48.098 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.098 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.098 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.098 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "xyz", 2023-07-21T23:08:48.099 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.099 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.099 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.099 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.099 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.099 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.099 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.100 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption1": { 2023-07-21T23:08:48.100 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption1", 2023-07-21T23:08:48.100 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.100 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.100 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.100 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.100 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.100 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.101 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.101 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.101 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.101 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.101 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.101 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption2": { 2023-07-21T23:08:48.101 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption2", 2023-07-21T23:08:48.102 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.102 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.102 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.102 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.102 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.102 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.102 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.102 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.103 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.103 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.103 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.103 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption3": { 2023-07-21T23:08:48.103 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption3", 2023-07-21T23:08:48.103 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.103 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.104 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.104 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.104 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.104 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.104 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.104 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.104 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.104 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.105 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.105 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.105 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption4": { 2023-07-21T23:08:48.105 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption4", 2023-07-21T23:08:48.105 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.105 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.105 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.106 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.106 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.106 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.106 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.106 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.106 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.106 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.106 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.107 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.107 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption5": { 2023-07-21T23:08:48.107 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption5", 2023-07-21T23:08:48.107 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.107 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.107 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.107 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.107 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.108 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.108 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.108 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.108 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.108 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.108 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.109 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption6": { 2023-07-21T23:08:48.109 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption6", 2023-07-21T23:08:48.109 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.109 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.109 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.109 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.109 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.109 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.110 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.110 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.110 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.110 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.110 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.110 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.110 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption7": { 2023-07-21T23:08:48.110 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption7", 2023-07-21T23:08:48.111 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.111 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.111 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.111 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.111 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:48.111 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "42", 2023-07-21T23:08:48.111 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.111 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.112 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.112 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.112 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.112 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.112 INFO:teuthology.orchestra.run.smithi151.stdout: "testkey": { 2023-07-21T23:08:48.112 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "testkey", 2023-07-21T23:08:48.112 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.112 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.113 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.113 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.113 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.113 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.113 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.113 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.113 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.113 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.114 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.114 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.114 INFO:teuthology.orchestra.run.smithi151.stdout: "testlkey": { 2023-07-21T23:08:48.114 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "testlkey", 2023-07-21T23:08:48.114 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.114 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.114 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.114 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.115 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.115 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.115 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.115 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.115 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.115 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.115 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.116 INFO:teuthology.orchestra.run.smithi151.stdout: "testnewline": { 2023-07-21T23:08:48.116 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "testnewline", 2023-07-21T23:08:48.116 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.116 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.116 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.116 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.116 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.116 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.117 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.117 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.117 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.117 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.117 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.117 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.117 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.118 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.118 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "snap_schedule", 2023-07-21T23:08:48.118 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.118 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.118 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.118 INFO:teuthology.orchestra.run.smithi151.stdout: "allow_m_granularity": { 2023-07-21T23:08:48.118 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "allow_m_granularity", 2023-07-21T23:08:48.118 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.119 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.119 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.119 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.119 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.119 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.119 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.119 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "allow minute scheduled snapshots", 2023-07-21T23:08:48.119 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.120 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.120 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.120 INFO:teuthology.orchestra.run.smithi151.stdout: "dump_on_update": { 2023-07-21T23:08:48.120 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "dump_on_update", 2023-07-21T23:08:48.120 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.120 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.121 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.121 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.121 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.121 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.121 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.121 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "dump database to debug log on update", 2023-07-21T23:08:48.121 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.121 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.122 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.122 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.122 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.122 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.122 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.122 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.122 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.123 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.123 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.123 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.123 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.123 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.123 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.123 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.123 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.124 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.124 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.124 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.124 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.124 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.124 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.124 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.125 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.125 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.125 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.125 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.125 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.125 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.125 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.125 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.126 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.126 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.126 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.126 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.126 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.126 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.126 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.126 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.127 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.127 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.127 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.127 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.127 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.127 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.127 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.127 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.128 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.128 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.128 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.128 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.128 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.128 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.128 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.128 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.129 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.129 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.129 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.129 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.129 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.129 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.129 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.130 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.130 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.130 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.130 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.130 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.130 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.130 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.131 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.131 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.131 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "stats", 2023-07-21T23:08:48.131 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.131 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.132 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.132 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.132 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.132 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.132 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.132 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.132 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.132 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.133 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.133 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.133 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.133 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.133 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.133 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.133 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.133 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.134 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.134 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.134 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.134 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.134 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.134 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.134 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.135 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.135 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.135 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.135 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.135 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.135 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.135 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.135 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.136 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.136 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.136 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.136 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.136 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.136 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.136 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.137 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.137 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.137 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.137 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.137 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.137 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.137 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.137 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.138 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.138 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.138 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.138 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.138 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.138 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.138 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.138 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.139 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.139 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.139 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.139 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.139 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.139 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.139 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.139 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.140 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.140 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.140 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.140 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.140 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.140 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.140 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "status", 2023-07-21T23:08:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.142 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.142 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.142 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.142 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.142 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.142 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.142 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.142 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.143 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.143 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.143 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.143 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.143 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.143 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.143 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.143 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.144 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.144 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.144 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.144 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.144 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.144 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.144 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.144 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.145 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.145 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.145 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.145 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.145 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.145 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.145 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.145 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.146 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.146 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.146 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.146 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.146 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.146 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.146 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.146 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.147 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.147 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.147 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.147 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.147 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.147 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.147 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.147 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.148 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.148 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.148 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.148 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.148 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.148 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.148 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.148 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.149 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.149 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.149 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.149 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.149 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.149 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.149 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.149 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.150 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.150 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.150 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.150 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.150 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.150 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.150 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.151 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "telegraf", 2023-07-21T23:08:48.151 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.151 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.151 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.151 INFO:teuthology.orchestra.run.smithi151.stdout: "address": { 2023-07-21T23:08:48.151 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "address", 2023-07-21T23:08:48.151 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.151 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.152 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.152 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-21T23:08:48.152 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.152 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.152 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.152 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.152 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.153 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.153 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.153 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.153 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:48.153 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:48.153 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.153 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.153 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.154 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "15", 2023-07-21T23:08:48.154 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.154 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.154 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.154 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.154 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.154 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.154 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.155 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.155 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.155 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.155 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.155 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.155 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.155 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.156 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.156 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.156 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.156 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.156 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.156 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.156 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.156 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.157 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.157 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.157 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.157 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.157 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.157 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.157 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.157 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.158 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.158 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.158 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.158 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.158 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.158 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.158 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.158 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.159 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.159 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.159 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.159 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.159 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.159 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.159 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.159 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.160 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.160 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.160 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.160 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.160 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.160 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.160 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.161 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.161 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.161 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.161 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.161 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.161 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.161 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.161 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.162 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.162 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.162 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.162 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.162 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.162 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.162 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.163 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.163 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.163 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.163 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.163 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.163 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.163 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.163 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.164 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.164 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.164 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.164 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.164 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "telemetry", 2023-07-21T23:08:48.164 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.164 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.164 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.165 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_basic": { 2023-07-21T23:08:48.165 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_basic", 2023-07-21T23:08:48.165 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.165 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.165 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.165 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.165 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.165 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.166 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.166 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-21T23:08:48.166 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.166 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.166 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.166 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.166 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_crash": { 2023-07-21T23:08:48.166 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_crash", 2023-07-21T23:08:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.167 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-21T23:08:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_device": { 2023-07-21T23:08:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_device", 2023-07-21T23:08:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.168 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.169 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.169 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.169 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.169 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.169 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.169 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-21T23:08:48.169 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.170 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.170 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.170 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_ident": { 2023-07-21T23:08:48.170 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_ident", 2023-07-21T23:08:48.170 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.170 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.170 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.170 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.171 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.171 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.171 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.171 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-21T23:08:48.171 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.171 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.171 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.172 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_perf": { 2023-07-21T23:08:48.172 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_perf", 2023-07-21T23:08:48.172 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.172 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.172 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.172 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.172 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.173 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.173 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.173 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-21T23:08:48.173 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.173 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.173 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.173 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.173 INFO:teuthology.orchestra.run.smithi151.stdout: "contact": { 2023-07-21T23:08:48.174 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "contact", 2023-07-21T23:08:48.174 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.174 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.174 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.174 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.174 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.174 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.174 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.175 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.175 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.175 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.175 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.175 INFO:teuthology.orchestra.run.smithi151.stdout: "description": { 2023-07-21T23:08:48.175 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "description", 2023-07-21T23:08:48.175 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.176 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.176 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.176 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.176 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.176 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.176 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.176 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.176 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.177 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.177 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.177 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.177 INFO:teuthology.orchestra.run.smithi151.stdout: "device_url": { 2023-07-21T23:08:48.177 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "device_url", 2023-07-21T23:08:48.177 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.177 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.177 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.178 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-21T23:08:48.178 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.178 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.178 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.178 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.178 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.178 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.178 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.179 INFO:teuthology.orchestra.run.smithi151.stdout: "enabled": { 2023-07-21T23:08:48.179 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enabled", 2023-07-21T23:08:48.179 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.179 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.179 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.179 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.180 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.180 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.180 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.180 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.180 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.180 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.180 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.180 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.181 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:48.181 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:48.181 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.181 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.181 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.181 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "24", 2023-07-21T23:08:48.181 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "8", 2023-07-21T23:08:48.181 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.182 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.182 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.182 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.182 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.182 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.182 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.182 INFO:teuthology.orchestra.run.smithi151.stdout: "last_opt_revision": { 2023-07-21T23:08:48.182 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "last_opt_revision", 2023-07-21T23:08:48.183 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.183 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.183 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.183 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "1", 2023-07-21T23:08:48.183 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.183 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.183 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.183 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.184 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.184 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.184 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.184 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.184 INFO:teuthology.orchestra.run.smithi151.stdout: "leaderboard": { 2023-07-21T23:08:48.184 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "leaderboard", 2023-07-21T23:08:48.184 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.185 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.185 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.185 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.185 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.185 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.185 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.185 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.185 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.186 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.186 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.186 INFO:teuthology.orchestra.run.smithi151.stdout: "leaderboard_description": { 2023-07-21T23:08:48.186 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "leaderboard_description", 2023-07-21T23:08:48.186 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.186 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.186 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.187 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.187 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.187 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.187 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.187 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.187 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.187 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.187 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.188 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.188 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.188 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.188 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.188 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.188 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.188 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.189 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.189 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.189 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.189 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.189 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.189 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.189 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.189 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.190 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.190 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.190 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.190 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.190 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.190 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.190 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.191 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.191 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.191 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.191 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.191 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.191 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.191 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.191 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.192 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.192 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.192 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.192 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.192 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.192 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.192 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.193 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.193 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.193 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.193 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.193 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.193 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.193 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.193 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.194 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.194 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.194 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.194 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.194 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.194 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.194 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.194 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.195 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.195 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.195 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.195 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.195 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.195 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.195 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.196 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.196 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.196 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.196 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.196 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.196 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.196 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.196 INFO:teuthology.orchestra.run.smithi151.stdout: "organization": { 2023-07-21T23:08:48.197 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "organization", 2023-07-21T23:08:48.197 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.197 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.197 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.197 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.197 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.197 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.197 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.198 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.198 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.198 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.198 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.198 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.198 INFO:teuthology.orchestra.run.smithi151.stdout: "proxy": { 2023-07-21T23:08:48.198 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "proxy", 2023-07-21T23:08:48.199 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.199 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.199 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.199 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.199 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.199 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.199 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.199 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.200 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.200 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.200 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.200 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.200 INFO:teuthology.orchestra.run.smithi151.stdout: "url": { 2023-07-21T23:08:48.200 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "url", 2023-07-21T23:08:48.200 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.200 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.201 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.201 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-21T23:08:48.201 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.201 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.201 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.201 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.201 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.201 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.202 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.202 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.202 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.202 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.202 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "test_orchestrator", 2023-07-21T23:08:48.202 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.202 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.203 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.203 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.203 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.203 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.203 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.203 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.203 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.204 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.204 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.204 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.204 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.204 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.204 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.204 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.205 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.205 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.205 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.205 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.205 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.205 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.205 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.205 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.206 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.206 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.206 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.206 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.206 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.206 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.206 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.206 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.207 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.207 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.207 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.207 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.207 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.207 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.207 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.207 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.208 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.208 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.208 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.208 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.208 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.208 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.208 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.209 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.209 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.209 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.209 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.209 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.209 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.209 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.209 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.210 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.210 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.210 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.210 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.210 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.210 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.210 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.210 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.211 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.211 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.211 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.211 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.211 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.211 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.211 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.211 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.212 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.212 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.212 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.212 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.212 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "volumes", 2023-07-21T23:08:48.212 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.212 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.213 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.214 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.215 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.216 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.217 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.217 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.217 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.217 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.217 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.217 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.217 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.218 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.218 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.218 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.218 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.218 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.218 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.218 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.218 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.219 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.219 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.219 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.219 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.219 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.219 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.219 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.219 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.220 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.220 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.220 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.220 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.220 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.220 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.220 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.221 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.221 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.221 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.221 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.221 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.221 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.221 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.221 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.222 INFO:teuthology.orchestra.run.smithi151.stdout: "max_concurrent_clones": { 2023-07-21T23:08:48.222 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_concurrent_clones", 2023-07-21T23:08:48.222 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.222 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.222 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.222 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "4", 2023-07-21T23:08:48.222 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.222 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-21T23:08:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: "snapshot_clone_delay": { 2023-07-21T23:08:48.223 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "snapshot_clone_delay", 2023-07-21T23:08:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.224 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-21T23:08:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.225 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix", 2023-07-21T23:08:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: "discovery_interval": { 2023-07-21T23:08:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "discovery_interval", 2023-07-21T23:08:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.226 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "100", 2023-07-21T23:08:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.227 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: "identifier": { 2023-07-21T23:08:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "identifier", 2023-07-21T23:08:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.228 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:48.230 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.231 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.232 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.233 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.233 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.233 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.233 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.233 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.233 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.233 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.233 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.234 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.235 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.236 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.237 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.238 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.239 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.240 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.240 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.240 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.240 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.240 INFO:teuthology.orchestra.run.smithi151.stdout: "zabbix_host": { 2023-07-21T23:08:48.240 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix_host", 2023-07-21T23:08:48.240 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.241 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.241 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.241 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.241 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.241 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.241 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.241 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.241 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.242 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.242 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.242 INFO:teuthology.orchestra.run.smithi151.stdout: "zabbix_port": { 2023-07-21T23:08:48.242 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix_port", 2023-07-21T23:08:48.242 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.242 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.242 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.243 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10051", 2023-07-21T23:08:48.243 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.243 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.243 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.243 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.243 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.243 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.243 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.244 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.244 INFO:teuthology.orchestra.run.smithi151.stdout: "zabbix_sender": { 2023-07-21T23:08:48.244 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix_sender", 2023-07-21T23:08:48.244 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.244 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.244 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.244 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-21T23:08:48.245 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.245 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.245 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.245 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.245 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.245 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.245 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.245 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.246 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.246 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.246 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:48.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.246 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.246 INFO:teuthology.orchestra.run.smithi151.stdout: "gid": 25288, 2023-07-21T23:08:48.246 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "z", 2023-07-21T23:08:48.246 INFO:teuthology.orchestra.run.smithi151.stdout: "mgr_features": 4540138322906710015, 2023-07-21T23:08:48.247 INFO:teuthology.orchestra.run.smithi151.stdout: "available_modules": [ 2023-07-21T23:08:48.247 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.247 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "alerts", 2023-07-21T23:08:48.247 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.247 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.247 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.247 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:48.247 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:48.248 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.248 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.248 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.248 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:48.248 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.248 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.248 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.248 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How frequently to reexamine health status", 2023-07-21T23:08:48.249 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.249 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.249 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.249 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.249 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.249 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.249 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.250 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.250 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.250 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.250 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.250 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.250 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.250 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.250 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.251 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.251 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.251 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.251 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.251 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.251 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.251 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.251 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.252 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.252 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.252 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.252 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.252 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.252 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.253 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.254 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.254 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.254 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.254 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.254 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.254 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.254 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.254 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.255 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.255 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.255 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.255 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.255 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.255 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.255 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.255 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.256 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.256 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.256 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.256 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.256 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.256 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.257 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.257 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.257 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.257 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.257 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.257 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.257 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.257 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.258 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.258 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.258 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.258 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_destination": { 2023-07-21T23:08:48.258 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_destination", 2023-07-21T23:08:48.258 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.258 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.259 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.259 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.259 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.259 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.259 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.259 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Email address to send alerts to", 2023-07-21T23:08:48.259 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.259 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.260 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.260 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_from_name": { 2023-07-21T23:08:48.260 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_from_name", 2023-07-21T23:08:48.260 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.260 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.260 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.260 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "Ceph", 2023-07-21T23:08:48.261 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.261 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.261 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.261 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Email From: name", 2023-07-21T23:08:48.261 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.261 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.261 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.262 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_host": { 2023-07-21T23:08:48.262 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_host", 2023-07-21T23:08:48.262 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.262 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.262 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.262 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.262 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.262 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.263 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.263 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SMTP server", 2023-07-21T23:08:48.263 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.263 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.263 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.263 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_password": { 2023-07-21T23:08:48.263 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_password", 2023-07-21T23:08:48.264 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.264 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.264 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.264 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.264 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.264 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.264 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.265 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Password to authenticate with", 2023-07-21T23:08:48.265 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.265 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.265 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.265 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_port": { 2023-07-21T23:08:48.265 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_port", 2023-07-21T23:08:48.265 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.266 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.266 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.266 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "465", 2023-07-21T23:08:48.266 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.266 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.266 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.266 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SMTP port", 2023-07-21T23:08:48.266 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.267 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.267 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.267 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_sender": { 2023-07-21T23:08:48.267 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_sender", 2023-07-21T23:08:48.267 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.267 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.267 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.268 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.268 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.268 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.268 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.268 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SMTP envelope sender", 2023-07-21T23:08:48.268 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.268 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.268 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.269 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_ssl": { 2023-07-21T23:08:48.269 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_ssl", 2023-07-21T23:08:48.269 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.269 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.269 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.269 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.269 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.270 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.270 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.270 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-21T23:08:48.270 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.270 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.270 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.270 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_user": { 2023-07-21T23:08:48.271 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_user", 2023-07-21T23:08:48.271 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.271 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.271 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.271 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.271 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.271 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.271 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.272 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "User to authenticate as", 2023-07-21T23:08:48.272 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.272 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.272 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.272 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.272 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.273 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.273 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "balancer", 2023-07-21T23:08:48.273 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.273 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.273 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.273 INFO:teuthology.orchestra.run.smithi151.stdout: "active": { 2023-07-21T23:08:48.273 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "active", 2023-07-21T23:08:48.273 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.274 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.274 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.274 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.274 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.274 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.274 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.274 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "automatically balance PGs across cluster", 2023-07-21T23:08:48.274 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.275 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.275 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.275 INFO:teuthology.orchestra.run.smithi151.stdout: "begin_time": { 2023-07-21T23:08:48.275 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "begin_time", 2023-07-21T23:08:48.275 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.275 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.275 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.276 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0000", 2023-07-21T23:08:48.276 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.276 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.276 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.276 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "beginning time of day to automatically balance", 2023-07-21T23:08:48.276 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-21T23:08:48.276 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.276 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.277 INFO:teuthology.orchestra.run.smithi151.stdout: "begin_weekday": { 2023-07-21T23:08:48.277 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "begin_weekday", 2023-07-21T23:08:48.277 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:48.277 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.277 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.277 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:48.278 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "0", 2023-07-21T23:08:48.278 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "6", 2023-07-21T23:08:48.278 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.278 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-21T23:08:48.278 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-21T23:08:48.278 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.278 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.278 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.279 INFO:teuthology.orchestra.run.smithi151.stdout: "crush_compat_max_iterations": { 2023-07-21T23:08:48.279 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crush_compat_max_iterations", 2023-07-21T23:08:48.279 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:48.279 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.279 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.279 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "25", 2023-07-21T23:08:48.279 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:48.280 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "250", 2023-07-21T23:08:48.280 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.280 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-21T23:08:48.280 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.280 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.280 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.280 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.280 INFO:teuthology.orchestra.run.smithi151.stdout: "crush_compat_metrics": { 2023-07-21T23:08:48.281 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crush_compat_metrics", 2023-07-21T23:08:48.281 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.281 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.281 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.281 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "pgs,objects,bytes", 2023-07-21T23:08:48.281 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.281 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.281 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.282 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-21T23:08:48.282 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-21T23:08:48.282 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.282 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.282 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.282 INFO:teuthology.orchestra.run.smithi151.stdout: "crush_compat_step": { 2023-07-21T23:08:48.282 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crush_compat_step", 2023-07-21T23:08:48.282 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.283 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.283 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.283 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0.5", 2023-07-21T23:08:48.283 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "0.001", 2023-07-21T23:08:48.283 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "0.999", 2023-07-21T23:08:48.283 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.283 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "aggressiveness of optimization", 2023-07-21T23:08:48.284 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-21T23:08:48.284 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.284 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.284 INFO:teuthology.orchestra.run.smithi151.stdout: "end_time": { 2023-07-21T23:08:48.284 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "end_time", 2023-07-21T23:08:48.284 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.284 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.285 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.285 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "2359", 2023-07-21T23:08:48.285 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.285 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.285 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.285 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "ending time of day to automatically balance", 2023-07-21T23:08:48.285 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-21T23:08:48.285 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.286 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.286 INFO:teuthology.orchestra.run.smithi151.stdout: "end_weekday": { 2023-07-21T23:08:48.286 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "end_weekday", 2023-07-21T23:08:48.286 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:48.286 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.286 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.286 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:48.287 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "0", 2023-07-21T23:08:48.287 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "6", 2023-07-21T23:08:48.287 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.287 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-21T23:08:48.287 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-21T23:08:48.287 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.287 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.288 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.288 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.288 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.288 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.288 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.288 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.288 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.288 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.289 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.289 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.289 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.289 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.289 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.289 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.289 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.290 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.290 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.290 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.290 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.290 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.290 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.290 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.291 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.291 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.291 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.291 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.291 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.291 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.291 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.291 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.292 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.292 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.292 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.292 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.292 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.292 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.292 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.292 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.293 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.293 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.293 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.293 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.293 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.293 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.293 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.293 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.294 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.294 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.294 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.294 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.294 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.294 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.294 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.295 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.296 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.296 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.296 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.296 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.296 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.296 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.296 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.296 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.297 INFO:teuthology.orchestra.run.smithi151.stdout: "min_score": { 2023-07-21T23:08:48.297 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "min_score", 2023-07-21T23:08:48.297 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.297 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.297 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.297 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:48.297 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.297 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.298 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.298 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-21T23:08:48.298 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.298 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.298 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.298 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.298 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": { 2023-07-21T23:08:48.298 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mode", 2023-07-21T23:08:48.299 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.299 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.299 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.299 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "upmap", 2023-07-21T23:08:48.299 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.299 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.299 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.299 INFO:teuthology.orchestra.run.smithi151.stdout: "crush-compat", 2023-07-21T23:08:48.300 INFO:teuthology.orchestra.run.smithi151.stdout: "none", 2023-07-21T23:08:48.300 INFO:teuthology.orchestra.run.smithi151.stdout: "upmap" 2023-07-21T23:08:48.300 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.300 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Balancer mode", 2023-07-21T23:08:48.300 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.300 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.300 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.301 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.301 INFO:teuthology.orchestra.run.smithi151.stdout: "pool_ids": { 2023-07-21T23:08:48.301 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pool_ids", 2023-07-21T23:08:48.301 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.301 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.301 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.301 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.302 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.302 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.302 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.302 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-21T23:08:48.302 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.302 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.302 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.303 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:48.303 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:48.303 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.303 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.303 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.303 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:48.303 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.303 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.304 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.304 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-21T23:08:48.304 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.304 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.304 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.304 INFO:teuthology.orchestra.run.smithi151.stdout: "upmap_max_deviation": { 2023-07-21T23:08:48.304 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "upmap_max_deviation", 2023-07-21T23:08:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.305 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-21T23:08:48.306 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-21T23:08:48.306 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.306 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.306 INFO:teuthology.orchestra.run.smithi151.stdout: "upmap_max_optimizations": { 2023-07-21T23:08:48.306 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "upmap_max_optimizations", 2023-07-21T23:08:48.306 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:48.306 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.307 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.307 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:48.307 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.307 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.307 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.307 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-21T23:08:48.307 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.308 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.308 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.308 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.308 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.308 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.308 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cephadm", 2023-07-21T23:08:48.308 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.309 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.309 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.309 INFO:teuthology.orchestra.run.smithi151.stdout: "agent_down_multiplier": { 2023-07-21T23:08:48.309 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "agent_down_multiplier", 2023-07-21T23:08:48.309 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.309 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.309 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.309 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "3.0", 2023-07-21T23:08:48.310 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.310 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.310 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.310 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-21T23:08:48.310 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.310 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.310 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.311 INFO:teuthology.orchestra.run.smithi151.stdout: "agent_refresh_rate": { 2023-07-21T23:08:48.311 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "agent_refresh_rate", 2023-07-21T23:08:48.311 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.311 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.311 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.311 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "20", 2023-07-21T23:08:48.311 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.311 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.312 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.312 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-21T23:08:48.312 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.312 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.312 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.312 INFO:teuthology.orchestra.run.smithi151.stdout: "agent_starting_port": { 2023-07-21T23:08:48.313 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "agent_starting_port", 2023-07-21T23:08:48.313 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.313 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.313 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.313 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "4721", 2023-07-21T23:08:48.313 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.313 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.313 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.314 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-21T23:08:48.314 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.314 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.314 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.314 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.314 INFO:teuthology.orchestra.run.smithi151.stdout: "alertmanager_web_password": { 2023-07-21T23:08:48.314 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "alertmanager_web_password", 2023-07-21T23:08:48.314 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.315 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.315 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.315 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:48.315 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.315 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.315 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.315 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Alertmanager web password", 2023-07-21T23:08:48.315 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.316 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.316 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.316 INFO:teuthology.orchestra.run.smithi151.stdout: "alertmanager_web_user": { 2023-07-21T23:08:48.316 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "alertmanager_web_user", 2023-07-21T23:08:48.316 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.316 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.317 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.317 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:48.317 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.317 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.317 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.317 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Alertmanager web user", 2023-07-21T23:08:48.317 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.317 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.318 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.318 INFO:teuthology.orchestra.run.smithi151.stdout: "allow_ptrace": { 2023-07-21T23:08:48.318 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "allow_ptrace", 2023-07-21T23:08:48.318 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.318 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.318 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.318 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.319 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.319 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.319 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.319 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-21T23:08:48.319 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-21T23:08:48.319 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.319 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.319 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.320 INFO:teuthology.orchestra.run.smithi151.stdout: "autotune_interval": { 2023-07-21T23:08:48.320 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "autotune_interval", 2023-07-21T23:08:48.320 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.320 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.320 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.320 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:48.320 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.321 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.321 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.321 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-21T23:08:48.321 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.321 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.321 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.321 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.321 INFO:teuthology.orchestra.run.smithi151.stdout: "autotune_memory_target_ratio": { 2023-07-21T23:08:48.322 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "autotune_memory_target_ratio", 2023-07-21T23:08:48.322 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.322 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.322 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.322 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0.7", 2023-07-21T23:08:48.322 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.322 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.323 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.323 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-21T23:08:48.323 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.323 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.323 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.323 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.323 INFO:teuthology.orchestra.run.smithi151.stdout: "cgroups_split": { 2023-07-21T23:08:48.323 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cgroups_split", 2023-07-21T23:08:48.324 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.324 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.324 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.324 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.324 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.324 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.324 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.324 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-21T23:08:48.325 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.325 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.325 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.325 INFO:teuthology.orchestra.run.smithi151.stdout: "config_checks_enabled": { 2023-07-21T23:08:48.325 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "config_checks_enabled", 2023-07-21T23:08:48.325 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.325 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.326 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.326 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.326 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.326 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.326 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.326 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-21T23:08:48.326 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.326 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.327 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.327 INFO:teuthology.orchestra.run.smithi151.stdout: "config_dashboard": { 2023-07-21T23:08:48.327 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "config_dashboard", 2023-07-21T23:08:48.327 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.327 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.327 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.328 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.328 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.328 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.328 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.328 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-21T23:08:48.328 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.328 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.328 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.329 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_alertmanager": { 2023-07-21T23:08:48.329 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_alertmanager", 2023-07-21T23:08:48.329 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.329 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.329 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.329 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-21T23:08:48.329 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.330 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.330 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.330 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:48.330 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.330 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.330 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.330 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.330 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_base": { 2023-07-21T23:08:48.331 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_base", 2023-07-21T23:08:48.331 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.331 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.331 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.331 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-21T23:08:48.331 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.331 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.331 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.332 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Container image name, without the tag", 2023-07-21T23:08:48.332 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.332 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.332 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.332 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.332 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_elasticsearch": { 2023-07-21T23:08:48.332 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_elasticsearch", 2023-07-21T23:08:48.333 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.333 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.333 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.333 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-21T23:08:48.333 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.333 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.333 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.333 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "elasticsearch container image", 2023-07-21T23:08:48.334 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.334 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.334 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.334 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_grafana": { 2023-07-21T23:08:48.334 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_grafana", 2023-07-21T23:08:48.334 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.334 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.335 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.335 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-21T23:08:48.335 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.335 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.335 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.335 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:48.335 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.335 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.336 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.336 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_haproxy": { 2023-07-21T23:08:48.336 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_haproxy", 2023-07-21T23:08:48.336 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.336 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.336 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.336 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-21T23:08:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "HAproxy container image", 2023-07-21T23:08:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.337 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_jaeger_agent": { 2023-07-21T23:08:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_jaeger_agent", 2023-07-21T23:08:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-21T23:08:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.338 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.339 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.339 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Jaeger agent container image", 2023-07-21T23:08:48.339 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.339 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.339 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.339 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.339 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_jaeger_collector": { 2023-07-21T23:08:48.339 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_jaeger_collector", 2023-07-21T23:08:48.340 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.340 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.340 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.340 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-21T23:08:48.340 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.340 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.340 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.341 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Jaeger collector container image", 2023-07-21T23:08:48.341 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.341 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.341 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.341 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_jaeger_query": { 2023-07-21T23:08:48.341 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_jaeger_query", 2023-07-21T23:08:48.341 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.342 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.342 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.342 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-21T23:08:48.342 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.342 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.342 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.342 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Jaeger query container image", 2023-07-21T23:08:48.342 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.343 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.343 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.343 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_keepalived": { 2023-07-21T23:08:48.343 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_keepalived", 2023-07-21T23:08:48.343 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.343 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.344 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.344 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-21T23:08:48.344 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.344 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.344 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.344 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Keepalived container image", 2023-07-21T23:08:48.344 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.344 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.345 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.345 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.345 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_loki": { 2023-07-21T23:08:48.345 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_loki", 2023-07-21T23:08:48.345 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.345 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.345 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.345 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-21T23:08:48.346 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.346 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.346 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.346 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Loki container image", 2023-07-21T23:08:48.346 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.346 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.346 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.347 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_node_exporter": { 2023-07-21T23:08:48.347 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_node_exporter", 2023-07-21T23:08:48.347 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.347 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.347 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.347 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-21T23:08:48.347 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.348 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.348 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.348 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:48.348 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.348 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.348 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.348 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_prometheus": { 2023-07-21T23:08:48.349 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_prometheus", 2023-07-21T23:08:48.349 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.349 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.349 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.349 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-21T23:08:48.349 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.349 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.349 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.350 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:48.350 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.350 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.350 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.350 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_promtail": { 2023-07-21T23:08:48.350 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_promtail", 2023-07-21T23:08:48.350 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.351 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.351 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.351 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-21T23:08:48.351 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.351 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.351 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.351 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Promtail container image", 2023-07-21T23:08:48.351 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.352 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.352 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.352 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_snmp_gateway": { 2023-07-21T23:08:48.352 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_snmp_gateway", 2023-07-21T23:08:48.352 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.352 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.353 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.353 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-21T23:08:48.353 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.353 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.353 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.353 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SNMP Gateway container image", 2023-07-21T23:08:48.353 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.353 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.354 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.354 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.354 INFO:teuthology.orchestra.run.smithi151.stdout: "container_init": { 2023-07-21T23:08:48.354 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_init", 2023-07-21T23:08:48.354 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.354 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.354 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.354 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.355 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.355 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.355 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.355 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Run podman/docker with `--init`", 2023-07-21T23:08:48.355 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.355 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.355 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.356 INFO:teuthology.orchestra.run.smithi151.stdout: "daemon_cache_timeout": { 2023-07-21T23:08:48.356 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "daemon_cache_timeout", 2023-07-21T23:08:48.356 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.356 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.356 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.356 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:48.356 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.356 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.357 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.357 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-21T23:08:48.357 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.357 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.357 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.357 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.357 INFO:teuthology.orchestra.run.smithi151.stdout: "default_cephadm_command_timeout": { 2023-07-21T23:08:48.357 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "default_cephadm_command_timeout", 2023-07-21T23:08:48.358 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.358 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.358 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.358 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "900", 2023-07-21T23:08:48.358 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.358 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.358 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.358 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-21T23:08:48.359 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.359 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.359 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.359 INFO:teuthology.orchestra.run.smithi151.stdout: "default_registry": { 2023-07-21T23:08:48.359 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "default_registry", 2023-07-21T23:08:48.359 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.359 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.360 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.360 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io", 2023-07-21T23:08:48.360 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.360 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.360 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.360 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-21T23:08:48.360 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.361 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.361 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.361 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.361 INFO:teuthology.orchestra.run.smithi151.stdout: "device_cache_timeout": { 2023-07-21T23:08:48.361 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "device_cache_timeout", 2023-07-21T23:08:48.361 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.361 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.361 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.362 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "1800", 2023-07-21T23:08:48.362 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.362 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.362 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.362 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "seconds to cache device inventory", 2023-07-21T23:08:48.362 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.362 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.362 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.363 INFO:teuthology.orchestra.run.smithi151.stdout: "device_enhanced_scan": { 2023-07-21T23:08:48.363 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "device_enhanced_scan", 2023-07-21T23:08:48.363 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.363 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.363 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.363 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.363 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.364 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.364 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.364 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-21T23:08:48.364 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.364 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.364 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.364 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.365 INFO:teuthology.orchestra.run.smithi151.stdout: "facts_cache_timeout": { 2023-07-21T23:08:48.365 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "facts_cache_timeout", 2023-07-21T23:08:48.365 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.365 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.365 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.365 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:48.365 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.366 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.366 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.366 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "seconds to cache host facts data", 2023-07-21T23:08:48.366 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.366 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.366 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.366 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.366 INFO:teuthology.orchestra.run.smithi151.stdout: "host_check_interval": { 2023-07-21T23:08:48.367 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "host_check_interval", 2023-07-21T23:08:48.367 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.367 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.367 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.367 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:48.367 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.367 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.367 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.368 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to perform a host check", 2023-07-21T23:08:48.368 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.368 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.368 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.368 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.368 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.368 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.369 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.369 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.369 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.369 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.369 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.369 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.369 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.369 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.370 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.370 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.370 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.370 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.370 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.370 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.370 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.370 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.371 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.371 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.371 INFO:teuthology.orchestra.run.smithi151.stdout: "log_refresh_metadata": { 2023-07-21T23:08:48.371 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_refresh_metadata", 2023-07-21T23:08:48.371 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.371 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.371 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.372 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.372 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.372 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.372 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.372 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-21T23:08:48.372 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.372 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.372 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.373 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.373 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.373 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.373 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.373 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.373 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.373 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.374 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.374 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.374 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-21T23:08:48.374 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.374 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.374 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.374 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.374 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.375 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.375 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.375 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.375 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.375 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.376 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.376 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.376 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.376 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.376 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.376 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.376 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.376 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.377 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.377 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.377 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.377 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.377 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.377 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.377 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.377 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.378 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.378 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.378 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.378 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.378 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.378 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.378 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.378 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.379 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.379 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.379 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.379 INFO:teuthology.orchestra.run.smithi151.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-21T23:08:48.379 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-21T23:08:48.379 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.379 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.379 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.380 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.380 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.380 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.380 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.380 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-21T23:08:48.380 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.380 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.381 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.381 INFO:teuthology.orchestra.run.smithi151.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-21T23:08:48.381 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-21T23:08:48.381 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.381 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.381 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.381 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "*", 2023-07-21T23:08:48.382 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.382 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.382 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.382 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-21T23:08:48.382 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.382 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.382 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.382 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.383 INFO:teuthology.orchestra.run.smithi151.stdout: "max_count_per_host": { 2023-07-21T23:08:48.383 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_count_per_host", 2023-07-21T23:08:48.383 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.383 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.383 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.383 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:48.383 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.383 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.384 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.384 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "max number of daemons per service per host", 2023-07-21T23:08:48.384 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.384 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.384 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.384 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.384 INFO:teuthology.orchestra.run.smithi151.stdout: "max_osd_draining_count": { 2023-07-21T23:08:48.384 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_osd_draining_count", 2023-07-21T23:08:48.385 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.385 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.385 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.385 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:48.385 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.385 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.385 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.385 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-21T23:08:48.386 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.386 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.386 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.386 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.386 INFO:teuthology.orchestra.run.smithi151.stdout: "migration_current": { 2023-07-21T23:08:48.386 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "migration_current", 2023-07-21T23:08:48.386 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.386 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.387 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.387 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.387 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.387 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.387 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.387 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "internal - do not modify", 2023-07-21T23:08:48.387 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.387 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.388 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.388 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.388 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": { 2023-07-21T23:08:48.388 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mode", 2023-07-21T23:08:48.388 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.388 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.389 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.389 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "root", 2023-07-21T23:08:48.389 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.389 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.389 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.389 INFO:teuthology.orchestra.run.smithi151.stdout: "cephadm-package", 2023-07-21T23:08:48.389 INFO:teuthology.orchestra.run.smithi151.stdout: "root" 2023-07-21T23:08:48.389 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.390 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "mode for remote execution of cephadm", 2023-07-21T23:08:48.390 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.390 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.390 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.390 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.390 INFO:teuthology.orchestra.run.smithi151.stdout: "prometheus_alerts_path": { 2023-07-21T23:08:48.390 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus_alerts_path", 2023-07-21T23:08:48.390 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.391 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.391 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.391 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-21T23:08:48.391 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.391 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.391 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.391 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-21T23:08:48.391 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.392 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.392 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.392 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.392 INFO:teuthology.orchestra.run.smithi151.stdout: "prometheus_web_password": { 2023-07-21T23:08:48.392 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus_web_password", 2023-07-21T23:08:48.392 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.392 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.393 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.393 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:48.393 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.393 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.393 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.393 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus web password", 2023-07-21T23:08:48.393 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.393 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.394 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.394 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.394 INFO:teuthology.orchestra.run.smithi151.stdout: "prometheus_web_user": { 2023-07-21T23:08:48.394 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus_web_user", 2023-07-21T23:08:48.394 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.394 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.394 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.394 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:48.395 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.395 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.395 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.395 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus web user", 2023-07-21T23:08:48.395 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.395 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.395 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.396 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_insecure": { 2023-07-21T23:08:48.396 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_insecure", 2023-07-21T23:08:48.396 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.396 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.396 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.396 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.396 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.396 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.397 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.397 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-21T23:08:48.397 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.397 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.397 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.397 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.397 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_password": { 2023-07-21T23:08:48.398 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_password", 2023-07-21T23:08:48.398 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.398 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.398 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.398 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.398 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.398 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.398 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.399 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-21T23:08:48.399 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.399 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.399 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.399 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.399 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_url": { 2023-07-21T23:08:48.399 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_url", 2023-07-21T23:08:48.399 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.400 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.400 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.400 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.400 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.400 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.400 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.400 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-21T23:08:48.400 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.401 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.401 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.401 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.401 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_username": { 2023-07-21T23:08:48.401 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_username", 2023-07-21T23:08:48.401 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.401 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.401 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.402 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.402 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.402 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.402 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.402 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-21T23:08:48.402 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.402 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.402 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.403 INFO:teuthology.orchestra.run.smithi151.stdout: "secure_monitoring_stack": { 2023-07-21T23:08:48.403 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "secure_monitoring_stack", 2023-07-21T23:08:48.403 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.403 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.403 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.403 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.404 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.404 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.404 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.404 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-21T23:08:48.404 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.404 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.404 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.404 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.405 INFO:teuthology.orchestra.run.smithi151.stdout: "service_discovery_port": { 2023-07-21T23:08:48.405 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "service_discovery_port", 2023-07-21T23:08:48.405 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.405 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.405 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.405 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8765", 2023-07-21T23:08:48.405 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.405 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.406 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.406 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "cephadm service discovery port", 2023-07-21T23:08:48.406 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.406 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.406 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.406 INFO:teuthology.orchestra.run.smithi151.stdout: "ssh_config_file": { 2023-07-21T23:08:48.406 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssh_config_file", 2023-07-21T23:08:48.407 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.407 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.407 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.407 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.407 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.407 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.407 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.407 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-21T23:08:48.408 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.408 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.408 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.408 INFO:teuthology.orchestra.run.smithi151.stdout: "use_agent": { 2023-07-21T23:08:48.408 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "use_agent", 2023-07-21T23:08:48.408 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.409 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.409 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.409 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.409 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.409 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.409 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.409 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-21T23:08:48.409 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.410 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.410 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.410 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.410 INFO:teuthology.orchestra.run.smithi151.stdout: "use_repo_digest": { 2023-07-21T23:08:48.410 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "use_repo_digest", 2023-07-21T23:08:48.410 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.410 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.411 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.411 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.411 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.411 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.411 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.411 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-21T23:08:48.411 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.411 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.412 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.412 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.412 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_on_failed_host_check": { 2023-07-21T23:08:48.412 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_on_failed_host_check", 2023-07-21T23:08:48.412 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.412 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.412 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.412 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.413 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.413 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.413 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.413 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise a health warning if the host check fails", 2023-07-21T23:08:48.413 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.413 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.413 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.414 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_on_stray_daemons": { 2023-07-21T23:08:48.414 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_on_stray_daemons", 2023-07-21T23:08:48.414 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.414 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.414 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.414 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.414 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.414 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.415 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.415 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-21T23:08:48.415 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.415 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.415 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.415 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.415 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_on_stray_hosts": { 2023-07-21T23:08:48.416 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_on_stray_hosts", 2023-07-21T23:08:48.416 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.416 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.416 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.416 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.416 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.416 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.416 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.417 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-21T23:08:48.417 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.417 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.417 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.417 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.417 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.417 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.418 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crash", 2023-07-21T23:08:48.418 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.418 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.418 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.418 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.418 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.418 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.418 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.419 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.419 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.419 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.419 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.419 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.419 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.419 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.419 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.420 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.420 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.420 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.420 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.420 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.420 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.420 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.420 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.421 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.421 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.421 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.421 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.421 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.421 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.421 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.421 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.422 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.422 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.422 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.422 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.422 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.422 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.422 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.423 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.423 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.423 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.423 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.423 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.423 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.423 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.423 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.424 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.424 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.424 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.424 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.424 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.424 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.424 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.425 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.425 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.425 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.425 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.425 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.425 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.425 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.426 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.426 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.426 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.426 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.426 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.426 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.426 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.426 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.427 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.427 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.427 INFO:teuthology.orchestra.run.smithi151.stdout: "retain_interval": { 2023-07-21T23:08:48.427 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "retain_interval", 2023-07-21T23:08:48.427 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.427 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.427 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.428 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "31536000", 2023-07-21T23:08:48.428 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.428 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.428 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.428 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-21T23:08:48.428 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.428 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.428 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.429 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_recent_interval": { 2023-07-21T23:08:48.429 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_recent_interval", 2023-07-21T23:08:48.429 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.429 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.429 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.429 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "1209600", 2023-07-21T23:08:48.430 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.430 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.430 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.430 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-21T23:08:48.430 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.430 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.430 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.430 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.431 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "dashboard", 2023-07-21T23:08:48.431 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.431 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.431 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.431 INFO:teuthology.orchestra.run.smithi151.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-21T23:08:48.432 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-21T23:08:48.432 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.432 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.432 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.432 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:48.432 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.432 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.432 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.433 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.433 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.433 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.433 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.433 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.433 INFO:teuthology.orchestra.run.smithi151.stdout: "ALERTMANAGER_API_HOST": { 2023-07-21T23:08:48.433 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-21T23:08:48.433 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.434 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.434 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.434 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.434 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.434 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.434 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.434 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.435 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.435 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.435 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.435 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.435 INFO:teuthology.orchestra.run.smithi151.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-21T23:08:48.435 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-21T23:08:48.435 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.435 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.436 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.436 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.436 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.436 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.436 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.436 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.436 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.437 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.437 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.437 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.437 INFO:teuthology.orchestra.run.smithi151.stdout: "AUDIT_API_ENABLED": { 2023-07-21T23:08:48.437 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "AUDIT_API_ENABLED", 2023-07-21T23:08:48.437 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.437 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.437 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.438 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.438 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.438 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.438 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.438 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.438 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.438 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.438 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.439 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.439 INFO:teuthology.orchestra.run.smithi151.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-21T23:08:48.439 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-21T23:08:48.439 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.439 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.439 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.439 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.440 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.440 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.440 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.440 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.440 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.440 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.440 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.440 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.441 INFO:teuthology.orchestra.run.smithi151.stdout: "ENABLE_BROWSABLE_API": { 2023-07-21T23:08:48.441 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-21T23:08:48.441 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.441 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.441 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.441 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.441 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.441 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.442 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.442 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.442 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.442 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.442 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.442 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.442 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-21T23:08:48.443 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-21T23:08:48.443 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.443 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.443 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.443 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.443 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.443 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.443 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.444 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.444 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.444 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.444 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.444 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-21T23:08:48.444 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-21T23:08:48.444 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.445 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.445 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.445 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.445 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.445 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.445 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.445 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.446 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.446 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.446 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.446 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-21T23:08:48.446 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-21T23:08:48.446 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.446 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.447 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.447 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.447 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.447 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.447 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.447 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.447 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.447 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.448 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.448 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-21T23:08:48.448 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-21T23:08:48.448 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.448 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.448 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.448 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.449 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.449 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.449 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.449 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.449 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.449 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.449 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.450 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-21T23:08:48.450 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-21T23:08:48.450 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.450 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.450 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.450 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.450 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.451 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.451 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.451 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.451 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.451 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.451 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.451 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.451 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-21T23:08:48.452 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-21T23:08:48.452 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.452 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.452 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.452 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.452 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.452 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.452 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.453 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.453 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.453 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.453 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.453 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.453 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-21T23:08:48.453 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-21T23:08:48.453 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.454 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.454 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.454 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.454 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.454 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.454 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.454 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.454 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.455 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.455 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.455 INFO:teuthology.orchestra.run.smithi151.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-21T23:08:48.455 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-21T23:08:48.455 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.455 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.456 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.456 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.456 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.456 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.456 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.456 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.456 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.456 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.457 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.457 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_PASSWORD": { 2023-07-21T23:08:48.457 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-21T23:08:48.457 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.457 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.457 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.457 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:48.458 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.458 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.458 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.458 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.458 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.458 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.458 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.459 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-21T23:08:48.459 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-21T23:08:48.459 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.459 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.459 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.459 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.459 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.460 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.460 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.460 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.460 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.460 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.460 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.460 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.460 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_URL": { 2023-07-21T23:08:48.461 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_URL", 2023-07-21T23:08:48.461 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.461 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.461 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.461 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.461 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.461 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.462 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.462 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.462 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.462 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.462 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.462 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.462 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_USERNAME": { 2023-07-21T23:08:48.462 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-21T23:08:48.463 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.463 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.463 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.463 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:48.463 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.463 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.463 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.463 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.464 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.464 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.464 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.464 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.464 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-21T23:08:48.464 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-21T23:08:48.464 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.464 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.465 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.465 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.465 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.465 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.465 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.465 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.465 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.465 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-21T23:08:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-21T23:08:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-21T23:08:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-21T23:08:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.468 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.469 INFO:teuthology.orchestra.run.smithi151.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-21T23:08:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-21T23:08:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.470 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: "PROMETHEUS_API_HOST": { 2023-07-21T23:08:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-21T23:08:48.471 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.472 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-21T23:08:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-21T23:08:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.473 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.474 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-21T23:08:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-21T23:08:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.475 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-21T23:08:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-21T23:08:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.477 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-21T23:08:48.478 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-21T23:08:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.479 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-21T23:08:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-21T23:08:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.481 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-21T23:08:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-21T23:08:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.482 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.483 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-21T23:08:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-21T23:08:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.484 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.485 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-21T23:08:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-21T23:08:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.486 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_ENABLED": { 2023-07-21T23:08:48.487 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-21T23:08:48.488 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.488 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.488 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.488 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.488 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.488 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.488 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.489 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.489 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.489 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.489 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.489 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.489 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-21T23:08:48.489 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-21T23:08:48.489 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.490 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.490 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.490 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-21T23:08:48.490 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.490 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.490 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.490 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.490 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.491 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.491 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.491 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.491 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-21T23:08:48.491 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-21T23:08:48.491 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.491 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.491 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.492 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:48.492 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.492 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.492 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.492 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.492 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.492 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.492 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.493 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.493 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-21T23:08:48.493 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-21T23:08:48.493 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.493 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.493 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.493 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8", 2023-07-21T23:08:48.493 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.494 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.494 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.494 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.494 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.494 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.494 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.494 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.494 INFO:teuthology.orchestra.run.smithi151.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-21T23:08:48.495 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-21T23:08:48.495 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.495 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.495 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.495 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "45", 2023-07-21T23:08:48.495 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.495 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.495 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.496 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.496 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.496 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.496 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.496 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.496 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_ACCESS_KEY": { 2023-07-21T23:08:48.496 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-21T23:08:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.497 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-21T23:08:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-21T23:08:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.498 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.499 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_SECRET_KEY": { 2023-07-21T23:08:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-21T23:08:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.500 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.501 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_SSL_VERIFY": { 2023-07-21T23:08:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-21T23:08:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.502 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-21T23:08:48.503 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-21T23:08:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.504 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-21T23:08:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-21T23:08:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.506 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-21T23:08:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-21T23:08:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.507 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.508 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "cross_origin_url": { 2023-07-21T23:08:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cross_origin_url", 2023-07-21T23:08:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.509 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "crt_file": { 2023-07-21T23:08:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crt_file", 2023-07-21T23:08:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.511 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "debug": { 2023-07-21T23:08:48.512 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "debug", 2023-07-21T23:08:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.513 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Enable/disable debug options", 2023-07-21T23:08:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "jwt_token_ttl": { 2023-07-21T23:08:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "jwt_token_ttl", 2023-07-21T23:08:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.514 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "28800", 2023-07-21T23:08:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.515 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "key_file": { 2023-07-21T23:08:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "key_file", 2023-07-21T23:08:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.516 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.517 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.518 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.519 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.520 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.521 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.522 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.523 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.524 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.525 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.526 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "motd": { 2023-07-21T23:08:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "motd", 2023-07-21T23:08:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.527 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.528 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "The message of the day", 2023-07-21T23:08:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: "redirect_resolve_ip_addr": { 2023-07-21T23:08:48.529 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "redirect_resolve_ip_addr", 2023-07-21T23:08:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.531 INFO:teuthology.orchestra.run.smithi151.stdout: "server_addr": { 2023-07-21T23:08:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_addr", 2023-07-21T23:08:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "::", 2023-07-21T23:08:48.532 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.533 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "server_port": { 2023-07-21T23:08:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_port", 2023-07-21T23:08:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.534 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8080", 2023-07-21T23:08:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.535 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "ssl": { 2023-07-21T23:08:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssl", 2023-07-21T23:08:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.536 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.537 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "ssl_server_port": { 2023-07-21T23:08:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssl_server_port", 2023-07-21T23:08:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.538 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8443", 2023-07-21T23:08:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_behaviour": { 2023-07-21T23:08:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_behaviour", 2023-07-21T23:08:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.540 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "redirect", 2023-07-21T23:08:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.541 INFO:teuthology.orchestra.run.smithi151.stdout: "redirect" 2023-07-21T23:08:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_error_status_code": { 2023-07-21T23:08:48.542 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_error_status_code", 2023-07-21T23:08:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "500", 2023-07-21T23:08:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "400", 2023-07-21T23:08:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "599", 2023-07-21T23:08:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.543 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "url_prefix": { 2023-07-21T23:08:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "url_prefix", 2023-07-21T23:08:48.544 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.545 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.546 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.547 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.548 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.548 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.548 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "devicehealth", 2023-07-21T23:08:48.549 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.549 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.549 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.550 INFO:teuthology.orchestra.run.smithi151.stdout: "enable_monitoring": { 2023-07-21T23:08:48.550 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enable_monitoring", 2023-07-21T23:08:48.550 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.550 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.551 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.552 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.552 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "monitor device health metrics", 2023-07-21T23:08:48.552 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.552 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.553 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.553 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.554 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.554 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.554 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.554 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.554 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.555 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.556 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.558 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.559 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.560 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.561 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.562 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.563 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.563 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.563 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.564 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.564 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.564 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.565 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.566 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "mark_out_threshold": { 2023-07-21T23:08:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mark_out_threshold", 2023-07-21T23:08:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.568 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "2419200", 2023-07-21T23:08:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-21T23:08:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.569 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "pool_name": { 2023-07-21T23:08:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pool_name", 2023-07-21T23:08:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.570 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "device_health_metrics", 2023-07-21T23:08:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.571 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-21T23:08:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: "retention_period": { 2023-07-21T23:08:48.572 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "retention_period", 2023-07-21T23:08:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "15552000", 2023-07-21T23:08:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.573 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how long to retain device health metrics", 2023-07-21T23:08:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.574 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: "scrape_frequency": { 2023-07-21T23:08:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "scrape_frequency", 2023-07-21T23:08:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.575 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "86400", 2023-07-21T23:08:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-21T23:08:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.576 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "self_heal": { 2023-07-21T23:08:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "self_heal", 2023-07-21T23:08:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.577 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-21T23:08:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.578 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:48.579 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.580 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to wake up and check device health", 2023-07-21T23:08:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.581 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_threshold": { 2023-07-21T23:08:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_threshold", 2023-07-21T23:08:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "7257600", 2023-07-21T23:08:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.582 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-21T23:08:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "diskprediction_local", 2023-07-21T23:08:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.584 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.585 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.586 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.587 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.588 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.589 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.590 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.591 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.592 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.593 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.594 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.596 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: "predict_interval": { 2023-07-21T23:08:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "predict_interval", 2023-07-21T23:08:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.598 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "86400", 2023-07-21T23:08:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.599 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.600 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: "predictor_model": { 2023-07-21T23:08:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "predictor_model", 2023-07-21T23:08:48.601 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "prophetstor", 2023-07-21T23:08:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.602 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:48.603 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.604 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.605 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "influx", 2023-07-21T23:08:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": false, 2023-07-21T23:08:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "influxdb python module not found", 2023-07-21T23:08:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "batch_size": { 2023-07-21T23:08:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "batch_size", 2023-07-21T23:08:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.606 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5000", 2023-07-21T23:08:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-21T23:08:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.607 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: "database": { 2023-07-21T23:08:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "database", 2023-07-21T23:08:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.608 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "ceph", 2023-07-21T23:08:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-21T23:08:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.609 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": { 2023-07-21T23:08:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "hostname", 2023-07-21T23:08:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.610 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "InfluxDB server hostname", 2023-07-21T23:08:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.611 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.612 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "30", 2023-07-21T23:08:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "5", 2023-07-21T23:08:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-21T23:08:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.613 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.614 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.615 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.617 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.618 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.619 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.620 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.621 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.622 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.623 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.624 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.625 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: "password": { 2023-07-21T23:08:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "password", 2023-07-21T23:08:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.627 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.628 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.629 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.629 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "password of InfluxDB server user", 2023-07-21T23:08:48.629 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.630 INFO:teuthology.orchestra.run.smithi151.stdout: "port": { 2023-07-21T23:08:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "port", 2023-07-21T23:08:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8086", 2023-07-21T23:08:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.631 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "InfluxDB server port", 2023-07-21T23:08:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "ssl": { 2023-07-21T23:08:48.632 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssl", 2023-07-21T23:08:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "false", 2023-07-21T23:08:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.633 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-21T23:08:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "threads": { 2023-07-21T23:08:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "threads", 2023-07-21T23:08:48.634 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "32", 2023-07-21T23:08:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-21T23:08:48.635 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "username": { 2023-07-21T23:08:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "username", 2023-07-21T23:08:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.636 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "username of InfluxDB server user", 2023-07-21T23:08:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.637 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "verify_ssl": { 2023-07-21T23:08:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "verify_ssl", 2023-07-21T23:08:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.638 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "true", 2023-07-21T23:08:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-21T23:08:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.639 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "insights", 2023-07-21T23:08:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.640 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.641 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.643 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.644 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.645 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.646 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.647 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.648 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.649 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "iostat", 2023-07-21T23:08:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.650 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.651 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.652 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.653 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.654 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.655 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.656 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.657 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.658 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.659 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "k8sevents", 2023-07-21T23:08:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_event_retention_days": { 2023-07-21T23:08:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ceph_event_retention_days", 2023-07-21T23:08:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.660 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "7", 2023-07-21T23:08:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Days to hold ceph event information within local cache", 2023-07-21T23:08:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.661 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "config_check_secs": { 2023-07-21T23:08:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "config_check_secs", 2023-07-21T23:08:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.662 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "10", 2023-07-21T23:08:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-07-21T23:08:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.664 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.665 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.666 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.667 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.668 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.669 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.670 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.671 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.672 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "localpool", 2023-07-21T23:08:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.673 INFO:teuthology.orchestra.run.smithi151.stdout: "failure_domain": { 2023-07-21T23:08:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "failure_domain", 2023-07-21T23:08:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "host", 2023-07-21T23:08:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.674 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "failure domain for any created local pool", 2023-07-21T23:08:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-21T23:08:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.675 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.677 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.678 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.679 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.680 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.681 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.682 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.683 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "min_size": { 2023-07-21T23:08:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "min_size", 2023-07-21T23:08:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.684 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "default min_size for any created local pool", 2023-07-21T23:08:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-21T23:08:48.685 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "num_rep": { 2023-07-21T23:08:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "num_rep", 2023-07-21T23:08:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.686 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "3", 2023-07-21T23:08:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "default replica count for any created local pool", 2023-07-21T23:08:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.687 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "pg_num": { 2023-07-21T23:08:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pg_num", 2023-07-21T23:08:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "128", 2023-07-21T23:08:48.688 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "default pg_num for any created local pool", 2023-07-21T23:08:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.689 INFO:teuthology.orchestra.run.smithi151.stdout: "prefix": { 2023-07-21T23:08:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prefix", 2023-07-21T23:08:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.690 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "name prefix for any created local pool", 2023-07-21T23:08:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "subtree": { 2023-07-21T23:08:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "subtree", 2023-07-21T23:08:48.691 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "rack", 2023-07-21T23:08:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.692 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-21T23:08:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-21T23:08:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.693 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mds_autoscaler", 2023-07-21T23:08:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.694 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.695 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.697 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.698 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.699 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.700 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.701 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.702 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.703 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mirroring", 2023-07-21T23:08:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.704 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.705 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.706 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.707 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.708 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.709 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.710 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.711 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.712 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "nfs", 2023-07-21T23:08:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.713 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.714 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.715 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.716 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.717 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.718 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.719 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.720 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.721 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.723 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.724 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "orchestrator", 2023-07-21T23:08:48.725 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "fail_fs": { 2023-07-21T23:08:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "fail_fs", 2023-07-21T23:08:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.726 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-21T23:08:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.728 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.729 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.730 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.731 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.732 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.733 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.734 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.735 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.736 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "orchestrator": { 2023-07-21T23:08:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "orchestrator", 2023-07-21T23:08:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.737 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "cephadm", 2023-07-21T23:08:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "rook", 2023-07-21T23:08:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "test_orchestrator" 2023-07-21T23:08:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Orchestrator backend", 2023-07-21T23:08:48.738 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "osd_perf_query", 2023-07-21T23:08:48.739 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.740 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.741 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.742 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.743 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.743 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.743 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.743 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.743 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.743 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.743 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.743 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.744 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.744 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.744 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.744 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.744 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.744 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.744 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.745 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.745 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.745 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.745 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.745 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.745 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.745 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.745 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.746 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.746 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.746 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.746 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.746 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.746 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.746 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.746 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.747 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.747 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.747 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.747 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.747 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.747 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.747 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.747 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.748 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.748 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.748 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.748 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.748 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.748 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.748 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.748 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.749 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.749 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.749 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.749 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.749 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "osd_support", 2023-07-21T23:08:48.749 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.749 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.749 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.750 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.750 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.750 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.750 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.750 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.750 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.750 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.750 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.751 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.751 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.751 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.751 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.751 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.751 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.751 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.751 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.752 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.752 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.752 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.752 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.752 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.752 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.752 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.753 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.753 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.753 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.753 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.753 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.753 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.753 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.753 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.754 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.754 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.754 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.754 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.754 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.754 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.754 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.754 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.755 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.755 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.755 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.755 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.755 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.755 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.755 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.756 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.756 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.756 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.756 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.756 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.756 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.756 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.756 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.757 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.757 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.757 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.757 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.757 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.757 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.757 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.757 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.758 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.758 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.758 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.758 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.758 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.758 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.758 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.758 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.759 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.759 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.759 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.759 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pg_autoscaler", 2023-07-21T23:08:48.759 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.759 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.759 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.759 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.760 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.760 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.760 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.760 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.760 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.760 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.760 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.761 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.761 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.761 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.761 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.761 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.761 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.761 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.761 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.762 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.762 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.762 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.762 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.762 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.762 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.762 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.763 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.763 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.763 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.763 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.763 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.763 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.763 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.763 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.764 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.764 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.764 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.764 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.764 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.764 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.764 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.765 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.765 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.765 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.765 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.765 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.765 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.765 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.765 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.766 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.766 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.766 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.766 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.766 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.766 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.766 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.767 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.767 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.767 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.767 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.767 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.767 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.767 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.768 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.768 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.768 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.768 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.768 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.768 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.768 INFO:teuthology.orchestra.run.smithi151.stdout: "noautoscale": { 2023-07-21T23:08:48.769 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "noautoscale", 2023-07-21T23:08:48.769 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.769 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.769 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.769 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.769 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.769 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.769 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.770 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "global autoscale flag", 2023-07-21T23:08:48.770 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-21T23:08:48.770 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.770 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.770 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:48.770 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:48.770 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.771 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.771 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.771 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:48.771 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.771 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.771 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.771 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.771 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.772 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.772 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.772 INFO:teuthology.orchestra.run.smithi151.stdout: "threshold": { 2023-07-21T23:08:48.772 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "threshold", 2023-07-21T23:08:48.772 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.772 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.772 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.773 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "3.0", 2023-07-21T23:08:48.773 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1.0", 2023-07-21T23:08:48.773 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.773 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.773 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "scaling threshold", 2023-07-21T23:08:48.773 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-21T23:08:48.773 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.773 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.774 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.774 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.774 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.774 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "progress", 2023-07-21T23:08:48.774 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.774 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.774 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.775 INFO:teuthology.orchestra.run.smithi151.stdout: "allow_pg_recovery_event": { 2023-07-21T23:08:48.775 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "allow_pg_recovery_event", 2023-07-21T23:08:48.775 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.775 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.775 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.775 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.775 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.776 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.776 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.776 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-21T23:08:48.776 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.776 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.776 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.776 INFO:teuthology.orchestra.run.smithi151.stdout: "enabled": { 2023-07-21T23:08:48.777 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enabled", 2023-07-21T23:08:48.777 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.777 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.777 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.777 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.777 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.777 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.777 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.778 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.778 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.778 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.778 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.778 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.778 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.778 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.779 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.779 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.779 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.779 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.779 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.779 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.779 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.779 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.780 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.780 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.780 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.780 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.780 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.780 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.780 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.781 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.782 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.782 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.782 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.782 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.782 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.782 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.782 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.782 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.783 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.783 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.783 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.783 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.783 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.783 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.783 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.784 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.784 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.784 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.784 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.784 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.784 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.784 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.785 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.785 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.785 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.785 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.785 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.785 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.785 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.787 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.787 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.787 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.787 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.787 INFO:teuthology.orchestra.run.smithi151.stdout: "max_completed_events": { 2023-07-21T23:08:48.787 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_completed_events", 2023-07-21T23:08:48.787 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.788 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.788 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.788 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "50", 2023-07-21T23:08:48.788 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.788 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.788 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.788 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "number of past completed events to remember", 2023-07-21T23:08:48.788 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.789 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.789 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.789 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:48.789 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:48.789 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.789 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.789 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.790 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:48.790 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.790 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.790 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.790 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how long the module is going to sleep", 2023-07-21T23:08:48.790 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.790 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.790 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.791 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.791 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.791 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.791 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus", 2023-07-21T23:08:48.791 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.791 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.791 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.792 INFO:teuthology.orchestra.run.smithi151.stdout: "cache": { 2023-07-21T23:08:48.792 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cache", 2023-07-21T23:08:48.792 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.792 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.792 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.792 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.792 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.792 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.793 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.793 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.793 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.793 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.793 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.793 INFO:teuthology.orchestra.run.smithi151.stdout: "exclude_perf_counters": { 2023-07-21T23:08:48.794 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "exclude_perf_counters", 2023-07-21T23:08:48.794 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.794 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.794 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.794 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.794 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.794 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.794 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.795 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-21T23:08:48.795 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-21T23:08:48.795 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.795 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.795 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.795 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.795 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.796 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.796 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.796 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.796 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.796 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.796 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.796 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.796 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.797 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.797 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.797 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.797 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.797 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.797 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.797 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.797 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.798 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.798 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.798 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.798 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.798 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.798 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.798 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.799 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.799 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.799 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.799 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.799 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.799 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.799 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.800 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.800 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.800 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.800 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.800 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.800 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.800 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.801 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.801 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.801 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.801 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.801 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.801 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.801 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.801 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.802 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.802 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.802 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.802 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.802 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.802 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.802 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.803 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.803 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.803 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.803 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.803 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.803 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.803 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_stats_pools": { 2023-07-21T23:08:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_stats_pools", 2023-07-21T23:08:48.804 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.805 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-21T23:08:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-21T23:08:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.806 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.807 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "300", 2023-07-21T23:08:48.807 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.807 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.807 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.807 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.807 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.807 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.807 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.808 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.808 INFO:teuthology.orchestra.run.smithi151.stdout: "scrape_interval": { 2023-07-21T23:08:48.808 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "scrape_interval", 2023-07-21T23:08:48.808 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.808 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.808 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.808 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "15.0", 2023-07-21T23:08:48.809 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.809 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.809 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.809 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.809 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.809 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.809 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.809 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.810 INFO:teuthology.orchestra.run.smithi151.stdout: "server_addr": { 2023-07-21T23:08:48.810 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_addr", 2023-07-21T23:08:48.810 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.810 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.810 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.810 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "::", 2023-07-21T23:08:48.810 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.810 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.811 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.811 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-21T23:08:48.811 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.811 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.811 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.811 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.811 INFO:teuthology.orchestra.run.smithi151.stdout: "server_port": { 2023-07-21T23:08:48.811 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_port", 2023-07-21T23:08:48.812 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.812 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.812 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.812 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "9283", 2023-07-21T23:08:48.812 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.812 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.812 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.812 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-21T23:08:48.813 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.813 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.813 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.813 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.813 INFO:teuthology.orchestra.run.smithi151.stdout: "stale_cache_strategy": { 2023-07-21T23:08:48.813 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "stale_cache_strategy", 2023-07-21T23:08:48.813 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.813 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.814 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.814 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "log", 2023-07-21T23:08:48.814 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.814 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.814 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.814 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.814 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.814 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.815 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.815 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.815 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_behaviour": { 2023-07-21T23:08:48.815 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_behaviour", 2023-07-21T23:08:48.815 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.815 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.815 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.816 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "default", 2023-07-21T23:08:48.816 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.816 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.816 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.816 INFO:teuthology.orchestra.run.smithi151.stdout: "default", 2023-07-21T23:08:48.816 INFO:teuthology.orchestra.run.smithi151.stdout: "error" 2023-07-21T23:08:48.816 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.816 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.817 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.817 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.817 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.817 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.817 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_error_status_code": { 2023-07-21T23:08:48.817 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_error_status_code", 2023-07-21T23:08:48.817 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.817 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.818 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.818 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "500", 2023-07-21T23:08:48.818 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "400", 2023-07-21T23:08:48.818 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "599", 2023-07-21T23:08:48.818 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.818 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.818 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.818 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.819 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.819 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.819 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.819 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.819 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.819 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_support", 2023-07-21T23:08:48.819 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.819 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.820 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.820 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.820 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.820 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.820 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.820 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.820 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.820 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.821 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.821 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.821 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.821 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.821 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.821 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.821 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.822 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.822 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.822 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.822 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.822 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.822 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.822 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.823 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.823 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.823 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.823 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.823 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.823 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.823 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.823 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.824 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.824 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.824 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.824 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.824 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.824 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.824 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.824 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.825 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.825 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.825 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.825 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.825 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.825 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.825 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.825 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.826 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.826 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.826 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.826 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.826 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.826 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.826 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.826 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.827 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.827 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.827 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.827 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.827 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.827 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.827 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.828 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.828 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.828 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.828 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.828 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.828 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.828 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.829 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.829 INFO:teuthology.orchestra.run.smithi151.stdout: "max_concurrent_snap_create": { 2023-07-21T23:08:48.829 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_concurrent_snap_create", 2023-07-21T23:08:48.829 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.829 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.829 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.829 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:48.829 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.830 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.830 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.830 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.830 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.830 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.830 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.831 INFO:teuthology.orchestra.run.smithi151.stdout: "mirror_snapshot_schedule": { 2023-07-21T23:08:48.831 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mirror_snapshot_schedule", 2023-07-21T23:08:48.831 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.831 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.831 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.831 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.831 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.831 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.832 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.832 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.832 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.832 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.832 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.832 INFO:teuthology.orchestra.run.smithi151.stdout: "trash_purge_schedule": { 2023-07-21T23:08:48.832 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "trash_purge_schedule", 2023-07-21T23:08:48.833 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.833 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.833 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.833 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.833 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.833 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.833 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.833 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.834 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.834 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.834 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.834 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.834 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.834 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.834 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.834 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "restful", 2023-07-21T23:08:48.835 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.835 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.835 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.835 INFO:teuthology.orchestra.run.smithi151.stdout: "enable_auth": { 2023-07-21T23:08:48.835 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enable_auth", 2023-07-21T23:08:48.835 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.835 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.835 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.836 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.836 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.836 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.836 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.836 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.836 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.836 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.836 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.837 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.837 INFO:teuthology.orchestra.run.smithi151.stdout: "key_file": { 2023-07-21T23:08:48.837 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "key_file", 2023-07-21T23:08:48.837 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.837 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.837 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.837 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.837 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.838 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.838 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.838 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.838 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.838 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.838 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.838 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.838 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.839 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.839 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.839 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.839 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.839 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.839 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.839 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.840 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.840 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.840 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.840 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.840 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.840 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.840 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.840 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.841 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.841 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.841 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.841 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.841 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.841 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.841 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.841 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.842 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.842 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.842 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.842 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.842 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.842 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.842 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.842 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.843 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.843 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.843 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.843 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.843 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.843 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.843 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.844 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.844 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.844 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.844 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.844 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.844 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.844 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.844 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.845 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.845 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.845 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.845 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.845 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.845 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.845 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.845 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.846 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.846 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.846 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.846 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.846 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.846 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.846 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.846 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.847 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.847 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.847 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.847 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.847 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.847 INFO:teuthology.orchestra.run.smithi151.stdout: "server_addr": { 2023-07-21T23:08:48.847 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_addr", 2023-07-21T23:08:48.848 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.848 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.848 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.848 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.848 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.848 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.848 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.848 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.849 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.849 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.849 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.849 INFO:teuthology.orchestra.run.smithi151.stdout: "server_port": { 2023-07-21T23:08:48.849 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_port", 2023-07-21T23:08:48.849 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.849 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.850 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.850 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.850 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.850 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.850 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.850 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.850 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.850 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.851 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.851 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.851 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.851 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.851 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rgw", 2023-07-21T23:08:48.851 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.851 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.852 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.852 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.852 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.852 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.852 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.852 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.852 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.853 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.853 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.853 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.853 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.853 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.853 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.853 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.853 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.854 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.854 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.854 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.854 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.854 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.854 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.854 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.855 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.855 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.855 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.855 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.855 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.855 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.855 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.855 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.856 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.856 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.856 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.856 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.856 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.856 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.856 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.857 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.857 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.857 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.857 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.857 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.857 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.857 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.857 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.858 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.858 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.858 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.858 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.858 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.858 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.858 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.858 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.859 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.859 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.859 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.859 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.859 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.859 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.859 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.859 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.860 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.860 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.860 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.860 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.860 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.860 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.860 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.860 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.861 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.861 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.861 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.861 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.861 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rook", 2023-07-21T23:08:48.861 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.861 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.861 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.862 INFO:teuthology.orchestra.run.smithi151.stdout: "drive_group_interval": { 2023-07-21T23:08:48.862 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "drive_group_interval", 2023-07-21T23:08:48.862 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.862 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.862 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.862 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "300.0", 2023-07-21T23:08:48.862 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.862 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.863 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.863 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-21T23:08:48.863 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.863 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.863 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.863 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.863 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.864 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.864 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.864 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.864 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.864 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.864 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.864 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.865 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.865 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.865 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.865 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.865 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.865 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.865 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.865 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.865 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.866 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.866 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.866 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.866 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.866 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.866 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.866 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.867 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.867 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.867 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.867 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.867 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.867 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.867 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.867 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.868 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.868 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.868 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.868 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.868 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.868 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.869 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.869 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.869 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.869 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.869 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.869 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.869 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.869 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.870 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.870 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.870 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.870 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.870 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.870 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.870 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.871 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.871 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.871 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.871 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.871 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.871 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.871 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.871 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.872 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.872 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.872 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.872 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.872 INFO:teuthology.orchestra.run.smithi151.stdout: "storage_class": { 2023-07-21T23:08:48.872 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "storage_class", 2023-07-21T23:08:48.872 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.873 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.873 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.873 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "local", 2023-07-21T23:08:48.873 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.873 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.873 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.873 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-21T23:08:48.873 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.874 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.874 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.874 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.874 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.874 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.874 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "selftest", 2023-07-21T23:08:48.874 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.875 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.875 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.875 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.875 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.875 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.875 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.875 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.875 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.876 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.876 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.876 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.876 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.876 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.876 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.876 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.877 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.877 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.877 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.877 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.877 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.877 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.877 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.878 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.878 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.878 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.878 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.878 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.878 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.878 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.879 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.879 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.879 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.879 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.879 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.879 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.879 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.879 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.880 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.880 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.880 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.880 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.880 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.880 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.880 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.880 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.881 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.881 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.881 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.881 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.881 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.881 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.881 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.881 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.882 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.882 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.882 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.882 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.882 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.882 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.883 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.883 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.883 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.883 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.883 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.883 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.883 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.883 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.884 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.884 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.884 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.884 INFO:teuthology.orchestra.run.smithi151.stdout: "roption1": { 2023-07-21T23:08:48.884 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "roption1", 2023-07-21T23:08:48.884 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.884 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.884 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.885 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.885 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.885 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.885 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.885 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.885 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.885 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.885 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.886 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.886 INFO:teuthology.orchestra.run.smithi151.stdout: "roption2": { 2023-07-21T23:08:48.886 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "roption2", 2023-07-21T23:08:48.886 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.886 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.886 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.886 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "xyz", 2023-07-21T23:08:48.886 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.887 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.887 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.887 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.887 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.887 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.887 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.887 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption1": { 2023-07-21T23:08:48.888 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption1", 2023-07-21T23:08:48.888 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.888 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.888 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.888 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.888 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.888 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.888 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.889 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.889 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.889 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.889 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.889 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.889 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption2": { 2023-07-21T23:08:48.889 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption2", 2023-07-21T23:08:48.889 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.890 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.890 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.890 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.890 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.890 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.890 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.890 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.890 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.891 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.891 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.891 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption3": { 2023-07-21T23:08:48.891 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption3", 2023-07-21T23:08:48.891 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:48.891 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.891 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.892 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.892 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.892 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.892 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.892 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.892 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.892 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.893 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.893 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.893 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption4": { 2023-07-21T23:08:48.893 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption4", 2023-07-21T23:08:48.893 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.893 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.893 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.893 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.894 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.894 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.894 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.894 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.894 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.894 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.894 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.895 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption5": { 2023-07-21T23:08:48.895 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption5", 2023-07-21T23:08:48.895 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.895 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.895 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.895 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.896 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.896 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.896 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.896 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.896 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.896 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.896 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.896 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.897 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption6": { 2023-07-21T23:08:48.897 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption6", 2023-07-21T23:08:48.897 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.897 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.897 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.897 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.897 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.897 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.898 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.898 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.898 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.898 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.898 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.898 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.898 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption7": { 2023-07-21T23:08:48.898 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption7", 2023-07-21T23:08:48.899 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.899 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.899 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.899 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.899 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:48.899 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "42", 2023-07-21T23:08:48.899 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.899 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.900 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.900 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.900 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.900 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.900 INFO:teuthology.orchestra.run.smithi151.stdout: "testkey": { 2023-07-21T23:08:48.900 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "testkey", 2023-07-21T23:08:48.900 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.900 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.901 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.901 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.901 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.901 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.901 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.901 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.901 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.901 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.902 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.902 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.902 INFO:teuthology.orchestra.run.smithi151.stdout: "testlkey": { 2023-07-21T23:08:48.902 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "testlkey", 2023-07-21T23:08:48.902 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.902 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.902 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.903 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.903 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.903 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.903 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.903 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.903 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.903 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.903 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.904 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.904 INFO:teuthology.orchestra.run.smithi151.stdout: "testnewline": { 2023-07-21T23:08:48.904 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "testnewline", 2023-07-21T23:08:48.904 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.904 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.904 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.904 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.904 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.905 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.905 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.905 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.905 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.905 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.905 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.905 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.905 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.906 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.906 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.906 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "snap_schedule", 2023-07-21T23:08:48.906 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.906 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.906 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.906 INFO:teuthology.orchestra.run.smithi151.stdout: "allow_m_granularity": { 2023-07-21T23:08:48.906 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "allow_m_granularity", 2023-07-21T23:08:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.907 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.908 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "allow minute scheduled snapshots", 2023-07-21T23:08:48.908 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.908 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.908 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.908 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.908 INFO:teuthology.orchestra.run.smithi151.stdout: "dump_on_update": { 2023-07-21T23:08:48.908 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "dump_on_update", 2023-07-21T23:08:48.908 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.909 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.909 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.909 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.909 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.909 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.909 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.909 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "dump database to debug log on update", 2023-07-21T23:08:48.909 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.910 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.910 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.910 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.910 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.910 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.910 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.910 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.910 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.911 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.911 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.911 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.911 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.911 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.911 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.911 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.911 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.912 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.912 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.912 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.912 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.912 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.912 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.912 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.912 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.913 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.913 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.913 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.913 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.913 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.913 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.913 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.913 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.914 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.914 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.914 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.914 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.914 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.914 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.914 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.915 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.915 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.915 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.915 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.915 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.915 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.915 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.915 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.916 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.916 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.916 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.916 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.916 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.916 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.916 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.916 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.917 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.917 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.917 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.917 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.917 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.917 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.917 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.917 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.918 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.918 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.918 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.918 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.918 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.918 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.918 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.918 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.919 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.919 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.919 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.919 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.919 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "stats", 2023-07-21T23:08:48.919 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.919 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.920 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.920 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.920 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.920 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.920 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.920 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.920 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.920 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.921 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.921 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.921 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.921 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.921 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.921 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.921 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.921 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.922 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.922 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.922 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.922 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.922 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.922 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.922 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.922 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.923 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.923 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.923 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.923 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.923 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.923 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.923 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.923 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.924 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.924 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.924 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.924 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.924 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.924 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.924 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.924 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.925 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.925 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.925 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.925 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.925 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.925 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.925 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.925 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.926 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.926 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.926 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.926 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.926 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.926 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.926 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.926 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.927 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.927 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.927 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.927 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.927 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.927 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.927 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.928 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.928 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.928 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.928 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.928 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.928 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.928 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.928 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.929 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.929 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.929 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.929 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "status", 2023-07-21T23:08:48.929 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.929 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.929 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.929 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.930 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.930 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.930 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.930 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.930 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.930 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.930 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.930 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.931 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.931 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.931 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.931 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.931 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.931 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.931 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.931 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.932 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.932 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.932 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.932 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.932 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.932 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.932 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.933 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.933 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.933 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.933 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.933 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.933 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.933 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.933 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.934 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.934 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.934 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.934 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.934 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.934 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.934 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.934 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.935 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.935 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.935 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.935 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.935 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.935 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.935 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.935 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.936 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.936 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.936 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.936 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.936 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.936 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.936 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.936 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.937 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.937 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.937 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.937 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.937 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.937 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.937 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.937 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.938 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.938 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.938 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.938 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.938 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.938 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.938 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.938 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.939 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.939 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "telegraf", 2023-07-21T23:08:48.939 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.939 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.939 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.939 INFO:teuthology.orchestra.run.smithi151.stdout: "address": { 2023-07-21T23:08:48.939 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "address", 2023-07-21T23:08:48.939 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.940 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.940 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.940 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-21T23:08:48.940 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.940 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.940 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.940 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.940 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.941 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.941 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.941 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.941 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:48.941 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:48.941 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:48.941 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.942 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.942 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "15", 2023-07-21T23:08:48.942 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.942 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.942 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.942 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.942 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.942 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.943 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.943 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.943 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.943 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.943 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.943 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.943 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.943 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.944 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.944 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.944 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.944 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.944 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.944 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.944 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.944 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.945 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.945 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.945 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.945 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.945 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.945 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.945 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.945 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.946 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.946 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.946 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.946 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.946 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.946 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.946 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.946 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.947 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.947 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.947 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.947 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.947 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.947 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.947 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.948 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.948 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.948 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.948 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.948 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.948 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.948 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.948 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.949 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.949 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.949 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.949 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.949 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.949 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.949 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.949 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.950 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.950 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.950 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.950 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.950 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.950 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.950 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.950 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.951 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.951 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.951 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.951 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.951 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.951 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.951 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.951 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.952 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.952 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.952 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.952 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "telemetry", 2023-07-21T23:08:48.952 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.952 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.953 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.953 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_basic": { 2023-07-21T23:08:48.953 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_basic", 2023-07-21T23:08:48.953 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.953 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.953 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.953 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.953 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.954 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.954 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.954 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-21T23:08:48.954 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.954 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.954 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.954 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.954 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_crash": { 2023-07-21T23:08:48.955 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_crash", 2023-07-21T23:08:48.955 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.955 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.955 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.955 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.955 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.955 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.955 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.956 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-21T23:08:48.956 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.956 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.956 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.956 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.956 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_device": { 2023-07-21T23:08:48.956 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_device", 2023-07-21T23:08:48.956 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.957 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.957 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.957 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:48.957 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.957 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.957 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.957 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-21T23:08:48.957 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.958 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.958 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.958 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.958 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_ident": { 2023-07-21T23:08:48.958 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_ident", 2023-07-21T23:08:48.958 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.958 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.959 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.959 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.959 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.959 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.959 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.959 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-21T23:08:48.959 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.959 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.960 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.960 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.960 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_perf": { 2023-07-21T23:08:48.960 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_perf", 2023-07-21T23:08:48.960 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.960 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.960 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.960 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.961 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.961 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.961 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.961 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-21T23:08:48.961 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.961 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.961 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.961 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.962 INFO:teuthology.orchestra.run.smithi151.stdout: "contact": { 2023-07-21T23:08:48.962 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "contact", 2023-07-21T23:08:48.962 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.962 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.962 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.962 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.962 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.962 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.963 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.963 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.963 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.963 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.963 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.963 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.963 INFO:teuthology.orchestra.run.smithi151.stdout: "description": { 2023-07-21T23:08:48.963 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "description", 2023-07-21T23:08:48.964 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.964 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.964 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.964 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.964 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.964 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.964 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.964 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.965 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.965 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.965 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.965 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.965 INFO:teuthology.orchestra.run.smithi151.stdout: "device_url": { 2023-07-21T23:08:48.965 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "device_url", 2023-07-21T23:08:48.965 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.965 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.966 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.966 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-21T23:08:48.966 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.966 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.966 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.966 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.966 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.966 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.967 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.967 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.967 INFO:teuthology.orchestra.run.smithi151.stdout: "enabled": { 2023-07-21T23:08:48.967 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enabled", 2023-07-21T23:08:48.967 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.967 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.967 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.967 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.968 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.968 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.968 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.968 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.968 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.968 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.968 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.968 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.969 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:48.969 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:48.969 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.969 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.969 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.969 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "24", 2023-07-21T23:08:48.969 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "8", 2023-07-21T23:08:48.969 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.970 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.970 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.970 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.970 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.970 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.970 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.970 INFO:teuthology.orchestra.run.smithi151.stdout: "last_opt_revision": { 2023-07-21T23:08:48.970 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "last_opt_revision", 2023-07-21T23:08:48.971 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:48.971 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.971 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.971 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "1", 2023-07-21T23:08:48.971 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.971 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.971 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.971 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.972 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.972 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.972 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.972 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.972 INFO:teuthology.orchestra.run.smithi151.stdout: "leaderboard": { 2023-07-21T23:08:48.972 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "leaderboard", 2023-07-21T23:08:48.972 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.973 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.973 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.973 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.973 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.973 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.973 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.973 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.973 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.974 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.974 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.974 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.974 INFO:teuthology.orchestra.run.smithi151.stdout: "leaderboard_description": { 2023-07-21T23:08:48.974 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "leaderboard_description", 2023-07-21T23:08:48.974 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.974 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.974 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.975 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.975 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.975 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.975 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.975 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.975 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.975 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.975 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.976 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.976 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.976 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.976 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.976 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.976 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.976 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.977 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.977 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.977 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.977 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.977 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.977 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.977 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.977 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.978 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.978 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.978 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.978 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.978 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.978 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.978 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.978 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.979 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.979 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.979 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.979 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.979 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.979 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.979 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.979 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.980 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.980 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.980 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.980 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.980 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.980 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.980 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.980 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.981 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.981 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.981 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.981 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.981 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.981 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.981 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.981 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.982 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.982 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.982 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.982 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.982 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.982 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.982 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.982 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.983 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.983 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.983 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.983 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.983 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.983 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.983 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.983 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.984 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.984 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.984 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.984 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.984 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.984 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.984 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.984 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.985 INFO:teuthology.orchestra.run.smithi151.stdout: "organization": { 2023-07-21T23:08:48.985 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "organization", 2023-07-21T23:08:48.985 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.985 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.985 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.985 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.985 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.985 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.986 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.986 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.986 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.986 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.986 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.986 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.986 INFO:teuthology.orchestra.run.smithi151.stdout: "proxy": { 2023-07-21T23:08:48.986 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "proxy", 2023-07-21T23:08:48.987 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.987 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.987 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.987 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.987 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.987 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.987 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.987 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.988 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.988 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.988 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.988 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.988 INFO:teuthology.orchestra.run.smithi151.stdout: "url": { 2023-07-21T23:08:48.988 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "url", 2023-07-21T23:08:48.988 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.988 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.989 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:48.989 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-21T23:08:48.989 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.989 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.989 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.989 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.989 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.989 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.990 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.990 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.990 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:48.990 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.990 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:48.990 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "test_orchestrator", 2023-07-21T23:08:48.990 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:48.990 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:48.991 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:48.991 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:48.991 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:48.991 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.991 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.991 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.991 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:48.992 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.992 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.992 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.992 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.992 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.992 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.992 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.992 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.993 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.993 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.993 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.993 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.993 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.993 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.993 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.993 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:48.994 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:48.994 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.994 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.994 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.994 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.994 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.994 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.994 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.995 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.995 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.995 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.995 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.995 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.995 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:48.995 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:48.995 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:48.996 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.996 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.996 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:48.996 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.996 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.996 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:48.996 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:48.997 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:48.997 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:48.997 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:48.997 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:48.997 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:48.997 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:48.997 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.997 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.998 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.998 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:48.998 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:48.998 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:48.998 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:48.998 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:48.998 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:48.998 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:48.999 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:48.999 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:48.999 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:48.999 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:48.999 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:48.999 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:48.999 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:48.999 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.000 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.000 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.000 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.000 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.000 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "volumes", 2023-07-21T23:08:49.000 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.000 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.000 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.001 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.001 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.001 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.001 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.001 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.001 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.001 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.002 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.002 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.002 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.002 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.002 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.002 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.002 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.002 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.003 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.003 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.003 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.003 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.003 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.003 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.003 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.003 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.004 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.004 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.004 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.004 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.004 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.004 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.004 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.004 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.005 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.005 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.005 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.005 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.005 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.005 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.005 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.005 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.006 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.006 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.006 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.006 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.006 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.006 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.006 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.006 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.007 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.007 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.007 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.007 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.007 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.007 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.007 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.007 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.008 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.008 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.008 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.008 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.008 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.008 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.008 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.009 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.009 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.009 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.009 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.009 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.009 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.009 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.009 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.010 INFO:teuthology.orchestra.run.smithi151.stdout: "max_concurrent_clones": { 2023-07-21T23:08:49.010 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_concurrent_clones", 2023-07-21T23:08:49.010 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.010 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.010 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.010 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "4", 2023-07-21T23:08:49.010 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.010 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.011 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.011 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-21T23:08:49.011 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.011 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.011 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.011 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.011 INFO:teuthology.orchestra.run.smithi151.stdout: "snapshot_clone_delay": { 2023-07-21T23:08:49.011 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "snapshot_clone_delay", 2023-07-21T23:08:49.012 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.012 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.012 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.012 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:49.012 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.012 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.012 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.013 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-21T23:08:49.013 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.013 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.013 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.013 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.013 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.013 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.013 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.014 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix", 2023-07-21T23:08:49.014 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.014 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.014 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.014 INFO:teuthology.orchestra.run.smithi151.stdout: "discovery_interval": { 2023-07-21T23:08:49.014 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "discovery_interval", 2023-07-21T23:08:49.014 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:49.014 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.015 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.015 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "100", 2023-07-21T23:08:49.015 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.015 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.015 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.015 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.015 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.015 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.016 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.016 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.016 INFO:teuthology.orchestra.run.smithi151.stdout: "identifier": { 2023-07-21T23:08:49.016 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "identifier", 2023-07-21T23:08:49.016 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.016 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.016 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.016 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.017 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.017 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.017 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.017 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.017 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.017 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.017 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.017 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.018 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:49.018 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:49.018 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.018 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.018 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.018 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:49.018 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.018 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.019 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.019 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.019 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.019 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.019 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.019 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.019 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.020 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.021 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.022 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.022 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.022 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.022 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.022 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.022 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.022 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.022 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.023 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.023 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.023 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.023 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.023 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.023 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.023 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.023 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.024 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.024 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.024 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.024 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.024 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.024 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.024 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.024 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.025 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.025 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.025 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.025 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.025 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.025 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.025 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.026 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.026 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.026 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.026 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.026 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.026 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.026 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.026 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.027 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.027 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.027 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.027 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.027 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.027 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.027 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.027 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.028 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.028 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.028 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.028 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.028 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.028 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.028 INFO:teuthology.orchestra.run.smithi151.stdout: "zabbix_host": { 2023-07-21T23:08:49.028 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix_host", 2023-07-21T23:08:49.029 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.029 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.029 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.029 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.029 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.029 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.029 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.029 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.030 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.030 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.030 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.030 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.030 INFO:teuthology.orchestra.run.smithi151.stdout: "zabbix_port": { 2023-07-21T23:08:49.030 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix_port", 2023-07-21T23:08:49.030 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.031 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.031 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.031 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10051", 2023-07-21T23:08:49.031 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.031 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.031 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.031 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.031 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.032 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.032 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.032 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.032 INFO:teuthology.orchestra.run.smithi151.stdout: "zabbix_sender": { 2023-07-21T23:08:49.032 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix_sender", 2023-07-21T23:08:49.032 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.032 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.032 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.033 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-21T23:08:49.033 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.033 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.033 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.033 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.033 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.033 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.033 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.034 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:49.034 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.034 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.034 INFO:teuthology.orchestra.run.smithi151.stdout: "modules": [ 2023-07-21T23:08:49.034 INFO:teuthology.orchestra.run.smithi151.stdout: "cephadm", 2023-07-21T23:08:49.035 INFO:teuthology.orchestra.run.smithi151.stdout: "dashboard", 2023-07-21T23:08:49.035 INFO:teuthology.orchestra.run.smithi151.stdout: "iostat", 2023-07-21T23:08:49.035 INFO:teuthology.orchestra.run.smithi151.stdout: "nfs", 2023-07-21T23:08:49.035 INFO:teuthology.orchestra.run.smithi151.stdout: "restful", 2023-07-21T23:08:49.035 INFO:teuthology.orchestra.run.smithi151.stdout: "snap_schedule" 2023-07-21T23:08:49.035 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.035 INFO:teuthology.orchestra.run.smithi151.stdout: "available_modules": [ 2023-07-21T23:08:49.035 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.036 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "alerts", 2023-07-21T23:08:49.036 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.036 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.036 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.036 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:49.036 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:49.036 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.036 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How frequently to reexamine health status", 2023-07-21T23:08:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.037 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.038 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.039 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.040 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.041 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.041 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.041 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.041 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.041 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.041 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.041 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.041 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.042 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.043 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.044 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.045 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.046 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_destination": { 2023-07-21T23:08:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_destination", 2023-07-21T23:08:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.047 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Email address to send alerts to", 2023-07-21T23:08:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_from_name": { 2023-07-21T23:08:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_from_name", 2023-07-21T23:08:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "Ceph", 2023-07-21T23:08:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.049 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Email From: name", 2023-07-21T23:08:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_host": { 2023-07-21T23:08:49.050 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_host", 2023-07-21T23:08:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.051 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SMTP server", 2023-07-21T23:08:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_password": { 2023-07-21T23:08:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_password", 2023-07-21T23:08:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.052 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Password to authenticate with", 2023-07-21T23:08:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.053 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_port": { 2023-07-21T23:08:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_port", 2023-07-21T23:08:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.054 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "465", 2023-07-21T23:08:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SMTP port", 2023-07-21T23:08:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.055 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_sender": { 2023-07-21T23:08:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_sender", 2023-07-21T23:08:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.056 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SMTP envelope sender", 2023-07-21T23:08:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.057 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_ssl": { 2023-07-21T23:08:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_ssl", 2023-07-21T23:08:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.058 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use SSL to connect to SMTP server", 2023-07-21T23:08:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "smtp_user": { 2023-07-21T23:08:49.059 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "smtp_user", 2023-07-21T23:08:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.060 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "User to authenticate as", 2023-07-21T23:08:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.061 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "balancer", 2023-07-21T23:08:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "active": { 2023-07-21T23:08:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "active", 2023-07-21T23:08:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.062 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "automatically balance PGs across cluster", 2023-07-21T23:08:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.063 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "begin_time": { 2023-07-21T23:08:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "begin_time", 2023-07-21T23:08:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0000", 2023-07-21T23:08:49.064 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "beginning time of day to automatically balance", 2023-07-21T23:08:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-21T23:08:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.065 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "begin_weekday": { 2023-07-21T23:08:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "begin_weekday", 2023-07-21T23:08:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "0", 2023-07-21T23:08:49.066 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "6", 2023-07-21T23:08:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-07-21T23:08:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-21T23:08:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "crush_compat_max_iterations": { 2023-07-21T23:08:49.067 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crush_compat_max_iterations", 2023-07-21T23:08:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "25", 2023-07-21T23:08:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "250", 2023-07-21T23:08:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.068 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-07-21T23:08:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "crush_compat_metrics": { 2023-07-21T23:08:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crush_compat_metrics", 2023-07-21T23:08:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.069 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "pgs,objects,bytes", 2023-07-21T23:08:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-07-21T23:08:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-07-21T23:08:49.070 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "crush_compat_step": { 2023-07-21T23:08:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crush_compat_step", 2023-07-21T23:08:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.071 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0.5", 2023-07-21T23:08:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "0.001", 2023-07-21T23:08:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "0.999", 2023-07-21T23:08:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "aggressiveness of optimization", 2023-07-21T23:08:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-07-21T23:08:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.072 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "end_time": { 2023-07-21T23:08:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "end_time", 2023-07-21T23:08:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "2359", 2023-07-21T23:08:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.073 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "ending time of day to automatically balance", 2023-07-21T23:08:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-07-21T23:08:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "end_weekday": { 2023-07-21T23:08:49.074 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "end_weekday", 2023-07-21T23:08:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "0", 2023-07-21T23:08:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "6", 2023-07-21T23:08:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.075 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-07-21T23:08:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2023-07-21T23:08:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.076 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.077 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.078 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.079 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.080 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.082 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.083 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.084 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "min_score": { 2023-07-21T23:08:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "min_score", 2023-07-21T23:08:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:49.085 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-07-21T23:08:49.086 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": { 2023-07-21T23:08:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mode", 2023-07-21T23:08:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.087 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "upmap", 2023-07-21T23:08:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "crush-compat", 2023-07-21T23:08:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "none", 2023-07-21T23:08:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: "upmap" 2023-07-21T23:08:49.088 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Balancer mode", 2023-07-21T23:08:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "pool_ids": { 2023-07-21T23:08:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pool_ids", 2023-07-21T23:08:49.089 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-07-21T23:08:49.090 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.091 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-07-21T23:08:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.092 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "upmap_max_deviation": { 2023-07-21T23:08:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "upmap_max_deviation", 2023-07-21T23:08:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:49.093 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "deviation below which no optimization is attempted", 2023-07-21T23:08:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-07-21T23:08:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.094 INFO:teuthology.orchestra.run.smithi151.stdout: "upmap_max_optimizations": { 2023-07-21T23:08:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "upmap_max_optimizations", 2023-07-21T23:08:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.095 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-07-21T23:08:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.096 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cephadm", 2023-07-21T23:08:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "agent_down_multiplier": { 2023-07-21T23:08:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "agent_down_multiplier", 2023-07-21T23:08:49.097 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "3.0", 2023-07-21T23:08:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-07-21T23:08:49.098 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "agent_refresh_rate": { 2023-07-21T23:08:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "agent_refresh_rate", 2023-07-21T23:08:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.099 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "20", 2023-07-21T23:08:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-07-21T23:08:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.100 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "agent_starting_port": { 2023-07-21T23:08:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "agent_starting_port", 2023-07-21T23:08:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "4721", 2023-07-21T23:08:49.101 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-07-21T23:08:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.102 INFO:teuthology.orchestra.run.smithi151.stdout: "alertmanager_web_password": { 2023-07-21T23:08:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "alertmanager_web_password", 2023-07-21T23:08:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.103 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Alertmanager web password", 2023-07-21T23:08:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "alertmanager_web_user": { 2023-07-21T23:08:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "alertmanager_web_user", 2023-07-21T23:08:49.104 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Alertmanager web user", 2023-07-21T23:08:49.105 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "allow_ptrace": { 2023-07-21T23:08:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "allow_ptrace", 2023-07-21T23:08:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.106 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-07-21T23:08:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-07-21T23:08:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "autotune_interval": { 2023-07-21T23:08:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "autotune_interval", 2023-07-21T23:08:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.108 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to autotune daemon memory", 2023-07-21T23:08:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.109 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "autotune_memory_target_ratio": { 2023-07-21T23:08:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "autotune_memory_target_ratio", 2023-07-21T23:08:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0.7", 2023-07-21T23:08:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.110 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-07-21T23:08:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "cgroups_split": { 2023-07-21T23:08:49.111 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cgroups_split", 2023-07-21T23:08:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.112 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-07-21T23:08:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "config_checks_enabled": { 2023-07-21T23:08:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "config_checks_enabled", 2023-07-21T23:08:49.113 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-07-21T23:08:49.114 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "config_dashboard": { 2023-07-21T23:08:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "config_dashboard", 2023-07-21T23:08:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.115 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-07-21T23:08:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.116 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_alertmanager": { 2023-07-21T23:08:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_alertmanager", 2023-07-21T23:08:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-07-21T23:08:49.117 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.118 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_base": { 2023-07-21T23:08:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_base", 2023-07-21T23:08:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/ceph", 2023-07-21T23:08:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.119 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Container image name, without the tag", 2023-07-21T23:08:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_elasticsearch": { 2023-07-21T23:08:49.120 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_elasticsearch", 2023-07-21T23:08:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2023-07-21T23:08:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.121 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "elasticsearch container image", 2023-07-21T23:08:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_grafana": { 2023-07-21T23:08:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_grafana", 2023-07-21T23:08:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.122 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-07-21T23:08:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.123 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_haproxy": { 2023-07-21T23:08:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_haproxy", 2023-07-21T23:08:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.124 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-07-21T23:08:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "HAproxy container image", 2023-07-21T23:08:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.125 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_jaeger_agent": { 2023-07-21T23:08:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_jaeger_agent", 2023-07-21T23:08:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2023-07-21T23:08:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.126 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Jaeger agent container image", 2023-07-21T23:08:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_jaeger_collector": { 2023-07-21T23:08:49.127 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_jaeger_collector", 2023-07-21T23:08:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2023-07-21T23:08:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.128 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Jaeger collector container image", 2023-07-21T23:08:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_jaeger_query": { 2023-07-21T23:08:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_jaeger_query", 2023-07-21T23:08:49.129 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2023-07-21T23:08:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Jaeger query container image", 2023-07-21T23:08:49.130 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_keepalived": { 2023-07-21T23:08:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_keepalived", 2023-07-21T23:08:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.131 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2023-07-21T23:08:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Keepalived container image", 2023-07-21T23:08:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.132 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_loki": { 2023-07-21T23:08:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_loki", 2023-07-21T23:08:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.133 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-07-21T23:08:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Loki container image", 2023-07-21T23:08:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.134 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_node_exporter": { 2023-07-21T23:08:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_node_exporter", 2023-07-21T23:08:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-07-21T23:08:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.135 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_prometheus": { 2023-07-21T23:08:49.136 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_prometheus", 2023-07-21T23:08:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-07-21T23:08:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.137 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus container image", 2023-07-21T23:08:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_promtail": { 2023-07-21T23:08:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_promtail", 2023-07-21T23:08:49.138 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-07-21T23:08:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Promtail container image", 2023-07-21T23:08:49.139 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "container_image_snmp_gateway": { 2023-07-21T23:08:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_image_snmp_gateway", 2023-07-21T23:08:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.140 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-07-21T23:08:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "SNMP Gateway container image", 2023-07-21T23:08:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.141 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "container_init": { 2023-07-21T23:08:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "container_init", 2023-07-21T23:08:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.142 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Run podman/docker with `--init`", 2023-07-21T23:08:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.143 INFO:teuthology.orchestra.run.smithi151.stdout: "daemon_cache_timeout": { 2023-07-21T23:08:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "daemon_cache_timeout", 2023-07-21T23:08:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.144 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-07-21T23:08:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "default_cephadm_command_timeout": { 2023-07-21T23:08:49.145 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "default_cephadm_command_timeout", 2023-07-21T23:08:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "900", 2023-07-21T23:08:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.146 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-07-21T23:08:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "default_registry": { 2023-07-21T23:08:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "default_registry", 2023-07-21T23:08:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.147 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "docker.io", 2023-07-21T23:08:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-07-21T23:08:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.148 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "device_cache_timeout": { 2023-07-21T23:08:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "device_cache_timeout", 2023-07-21T23:08:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.149 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "1800", 2023-07-21T23:08:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "seconds to cache device inventory", 2023-07-21T23:08:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.150 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "device_enhanced_scan": { 2023-07-21T23:08:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "device_enhanced_scan", 2023-07-21T23:08:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.151 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use libstoragemgmt during device scans", 2023-07-21T23:08:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "facts_cache_timeout": { 2023-07-21T23:08:49.152 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "facts_cache_timeout", 2023-07-21T23:08:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.153 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "seconds to cache host facts data", 2023-07-21T23:08:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "host_check_interval": { 2023-07-21T23:08:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "host_check_interval", 2023-07-21T23:08:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.154 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.155 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.155 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:49.155 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.155 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.155 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.155 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to perform a host check", 2023-07-21T23:08:49.155 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.155 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.156 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.156 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.156 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.156 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.156 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.156 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.156 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.157 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.157 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.157 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.157 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.157 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.157 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.157 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.157 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.158 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.158 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.158 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.158 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.158 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.158 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.158 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.158 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.159 INFO:teuthology.orchestra.run.smithi151.stdout: "log_refresh_metadata": { 2023-07-21T23:08:49.159 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_refresh_metadata", 2023-07-21T23:08:49.159 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.159 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.159 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.159 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.159 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.159 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.160 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.160 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-07-21T23:08:49.160 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.160 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.160 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.160 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.160 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.161 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.161 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.161 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.161 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.161 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.161 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.161 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.161 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.162 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-07-21T23:08:49.162 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.162 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.162 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.162 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.162 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.162 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.162 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.163 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.163 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.163 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.163 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.163 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.163 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.163 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.163 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.164 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.164 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.164 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.164 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.164 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.164 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.164 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.165 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.165 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.165 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.165 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.165 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.165 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.165 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.165 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.166 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.166 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.166 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.166 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.166 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.166 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.166 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.166 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.167 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.167 INFO:teuthology.orchestra.run.smithi151.stdout: "manage_etc_ceph_ceph_conf": { 2023-07-21T23:08:49.167 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-07-21T23:08:49.167 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.167 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.167 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.167 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.167 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.168 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.168 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.168 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-07-21T23:08:49.168 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.168 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.168 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.168 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.168 INFO:teuthology.orchestra.run.smithi151.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-07-21T23:08:49.169 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-07-21T23:08:49.169 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.169 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.169 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.169 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "*", 2023-07-21T23:08:49.169 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.169 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.169 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.170 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-07-21T23:08:49.170 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.170 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.170 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.170 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.170 INFO:teuthology.orchestra.run.smithi151.stdout: "max_count_per_host": { 2023-07-21T23:08:49.170 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_count_per_host", 2023-07-21T23:08:49.170 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.171 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.171 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.171 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:49.171 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.171 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.171 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.171 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "max number of daemons per service per host", 2023-07-21T23:08:49.172 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.172 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.172 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.172 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.172 INFO:teuthology.orchestra.run.smithi151.stdout: "max_osd_draining_count": { 2023-07-21T23:08:49.172 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_osd_draining_count", 2023-07-21T23:08:49.172 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.172 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.173 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.173 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:49.173 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.173 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.173 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.173 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-07-21T23:08:49.173 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.173 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.174 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.174 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.174 INFO:teuthology.orchestra.run.smithi151.stdout: "migration_current": { 2023-07-21T23:08:49.174 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "migration_current", 2023-07-21T23:08:49.174 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.174 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.174 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.174 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.175 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.175 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.175 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.175 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "internal - do not modify", 2023-07-21T23:08:49.175 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.175 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.175 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.175 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.176 INFO:teuthology.orchestra.run.smithi151.stdout: "mode": { 2023-07-21T23:08:49.176 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mode", 2023-07-21T23:08:49.176 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.176 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.176 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.176 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "root", 2023-07-21T23:08:49.176 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.176 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.177 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.177 INFO:teuthology.orchestra.run.smithi151.stdout: "cephadm-package", 2023-07-21T23:08:49.177 INFO:teuthology.orchestra.run.smithi151.stdout: "root" 2023-07-21T23:08:49.177 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.177 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "mode for remote execution of cephadm", 2023-07-21T23:08:49.177 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.177 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.177 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.178 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.178 INFO:teuthology.orchestra.run.smithi151.stdout: "prometheus_alerts_path": { 2023-07-21T23:08:49.178 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus_alerts_path", 2023-07-21T23:08:49.178 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.178 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.178 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.178 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-07-21T23:08:49.178 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.179 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.179 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.179 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-07-21T23:08:49.179 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.179 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.179 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.179 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.179 INFO:teuthology.orchestra.run.smithi151.stdout: "prometheus_web_password": { 2023-07-21T23:08:49.180 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus_web_password", 2023-07-21T23:08:49.180 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.180 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.180 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.180 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:49.180 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.180 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.180 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.181 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus web password", 2023-07-21T23:08:49.181 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.181 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.181 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.181 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.181 INFO:teuthology.orchestra.run.smithi151.stdout: "prometheus_web_user": { 2023-07-21T23:08:49.181 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus_web_user", 2023-07-21T23:08:49.182 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.182 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.182 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.182 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:49.182 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.182 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.182 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.182 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Prometheus web user", 2023-07-21T23:08:49.183 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.183 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.183 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.183 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.183 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_insecure": { 2023-07-21T23:08:49.183 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_insecure", 2023-07-21T23:08:49.183 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.183 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.184 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.184 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.184 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.184 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.184 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.184 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-07-21T23:08:49.184 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.184 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.185 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.185 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.185 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_password": { 2023-07-21T23:08:49.185 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_password", 2023-07-21T23:08:49.185 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.185 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.185 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.185 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.186 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.186 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.186 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.186 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-07-21T23:08:49.186 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.186 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.186 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.186 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.187 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_url": { 2023-07-21T23:08:49.187 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_url", 2023-07-21T23:08:49.187 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.187 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.187 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.187 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.187 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.188 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.188 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.188 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-07-21T23:08:49.188 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.188 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.188 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.188 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.188 INFO:teuthology.orchestra.run.smithi151.stdout: "registry_username": { 2023-07-21T23:08:49.189 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "registry_username", 2023-07-21T23:08:49.189 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.189 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.189 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.189 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.189 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.189 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.189 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.190 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-07-21T23:08:49.190 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.190 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.190 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.190 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.190 INFO:teuthology.orchestra.run.smithi151.stdout: "secure_monitoring_stack": { 2023-07-21T23:08:49.190 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "secure_monitoring_stack", 2023-07-21T23:08:49.190 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.191 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.191 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.191 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.191 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.191 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.191 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.191 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2023-07-21T23:08:49.191 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.192 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.192 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.192 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.192 INFO:teuthology.orchestra.run.smithi151.stdout: "service_discovery_port": { 2023-07-21T23:08:49.192 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "service_discovery_port", 2023-07-21T23:08:49.192 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.192 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.192 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.193 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8765", 2023-07-21T23:08:49.193 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.193 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.193 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.193 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "cephadm service discovery port", 2023-07-21T23:08:49.193 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.193 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.194 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.194 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.194 INFO:teuthology.orchestra.run.smithi151.stdout: "ssh_config_file": { 2023-07-21T23:08:49.194 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssh_config_file", 2023-07-21T23:08:49.194 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.194 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.194 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.194 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.195 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.195 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.195 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.195 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-07-21T23:08:49.195 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.195 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.195 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.195 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.196 INFO:teuthology.orchestra.run.smithi151.stdout: "use_agent": { 2023-07-21T23:08:49.196 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "use_agent", 2023-07-21T23:08:49.196 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.196 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.196 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.196 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.196 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.196 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.197 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.197 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-07-21T23:08:49.197 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.197 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.197 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.197 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.197 INFO:teuthology.orchestra.run.smithi151.stdout: "use_repo_digest": { 2023-07-21T23:08:49.197 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "use_repo_digest", 2023-07-21T23:08:49.198 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.198 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.198 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.198 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.198 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.198 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.198 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.198 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-07-21T23:08:49.199 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.199 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.199 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.199 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.199 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_on_failed_host_check": { 2023-07-21T23:08:49.199 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_on_failed_host_check", 2023-07-21T23:08:49.199 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.199 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.200 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.200 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.200 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.200 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.200 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.200 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise a health warning if the host check fails", 2023-07-21T23:08:49.200 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.200 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.201 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.201 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.201 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_on_stray_daemons": { 2023-07-21T23:08:49.201 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_on_stray_daemons", 2023-07-21T23:08:49.201 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.201 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.201 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.201 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.202 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.202 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.202 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.202 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-07-21T23:08:49.202 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.202 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.202 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.202 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.203 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_on_stray_hosts": { 2023-07-21T23:08:49.203 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_on_stray_hosts", 2023-07-21T23:08:49.203 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.203 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.203 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.203 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.203 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.203 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.204 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.204 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-07-21T23:08:49.204 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.204 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.204 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.204 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.204 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.204 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.205 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.205 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crash", 2023-07-21T23:08:49.205 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.205 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.205 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.205 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.205 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.205 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.206 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.206 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.206 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.206 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.206 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.206 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.206 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.206 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.207 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.207 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.207 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.207 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.207 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.207 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.207 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.207 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.208 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.208 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.208 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.208 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.208 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.208 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.208 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.208 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.209 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.209 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.209 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.209 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.209 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.209 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.209 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.209 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.210 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.210 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.210 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.210 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.210 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.210 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.210 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.210 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.211 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.211 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.211 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.211 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.211 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.211 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.211 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.211 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.212 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.212 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.212 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.212 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.212 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.212 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.212 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.212 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.213 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.213 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.213 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.213 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.213 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.213 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.213 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.213 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.214 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.214 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.214 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.214 INFO:teuthology.orchestra.run.smithi151.stdout: "retain_interval": { 2023-07-21T23:08:49.214 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "retain_interval", 2023-07-21T23:08:49.214 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.214 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.215 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.215 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "31536000", 2023-07-21T23:08:49.215 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.215 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.215 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.215 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how long to retain crashes before pruning them", 2023-07-21T23:08:49.215 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.215 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.216 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.216 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.216 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_recent_interval": { 2023-07-21T23:08:49.216 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_recent_interval", 2023-07-21T23:08:49.216 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.216 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.216 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.216 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "1209600", 2023-07-21T23:08:49.217 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.217 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.217 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.217 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "time interval in which to warn about recent crashes", 2023-07-21T23:08:49.217 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.217 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.217 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.217 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.218 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.218 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.218 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.218 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "dashboard", 2023-07-21T23:08:49.218 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.218 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.218 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.218 INFO:teuthology.orchestra.run.smithi151.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-07-21T23:08:49.219 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-07-21T23:08:49.219 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.219 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.219 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.219 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:49.219 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.219 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.220 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.220 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.220 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.220 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.220 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.220 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.220 INFO:teuthology.orchestra.run.smithi151.stdout: "ALERTMANAGER_API_HOST": { 2023-07-21T23:08:49.220 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ALERTMANAGER_API_HOST", 2023-07-21T23:08:49.221 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.221 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.221 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.221 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.221 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.221 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.221 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.221 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.222 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.222 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.222 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.222 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.222 INFO:teuthology.orchestra.run.smithi151.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-07-21T23:08:49.222 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-07-21T23:08:49.222 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.222 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.223 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.223 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.223 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.223 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.223 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.223 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.223 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.223 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.224 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.224 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.224 INFO:teuthology.orchestra.run.smithi151.stdout: "AUDIT_API_ENABLED": { 2023-07-21T23:08:49.224 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "AUDIT_API_ENABLED", 2023-07-21T23:08:49.224 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.224 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.224 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.224 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.225 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.225 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.225 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.225 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.225 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.225 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.225 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.225 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.226 INFO:teuthology.orchestra.run.smithi151.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-07-21T23:08:49.226 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-07-21T23:08:49.226 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.226 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.226 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.226 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.226 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.226 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.227 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.227 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.227 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.227 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.227 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.227 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.227 INFO:teuthology.orchestra.run.smithi151.stdout: "ENABLE_BROWSABLE_API": { 2023-07-21T23:08:49.227 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ENABLE_BROWSABLE_API", 2023-07-21T23:08:49.228 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.228 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.228 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.228 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.228 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.228 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.228 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-07-21T23:08:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-07-21T23:08:49.229 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.230 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.230 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.230 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.230 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.230 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.230 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.230 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.230 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.231 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.231 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.231 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.231 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-07-21T23:08:49.231 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-07-21T23:08:49.231 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.231 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.231 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.232 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.232 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.232 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.232 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.232 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.232 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.232 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.232 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.233 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.233 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-07-21T23:08:49.233 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-07-21T23:08:49.233 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.233 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.233 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.233 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.234 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.234 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.234 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.234 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.234 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.234 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.234 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.234 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.235 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-07-21T23:08:49.235 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-07-21T23:08:49.235 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.235 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.235 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.235 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.236 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.236 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.236 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.236 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.237 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.237 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.237 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.237 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.237 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_NFS": { 2023-07-21T23:08:49.238 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-07-21T23:08:49.238 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.238 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.238 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.238 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.238 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.239 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.239 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.239 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.239 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.239 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.240 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.240 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.240 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_RBD": { 2023-07-21T23:08:49.240 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-07-21T23:08:49.240 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.240 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.241 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.241 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.241 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.241 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.241 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.241 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.241 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.241 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.242 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.242 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.242 INFO:teuthology.orchestra.run.smithi151.stdout: "FEATURE_TOGGLE_RGW": { 2023-07-21T23:08:49.242 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-07-21T23:08:49.242 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.242 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.242 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.242 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.243 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.243 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.243 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.243 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.243 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.243 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.243 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.244 INFO:teuthology.orchestra.run.smithi151.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-07-21T23:08:49.244 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-07-21T23:08:49.244 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.244 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.244 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.244 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.244 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.244 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.245 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.245 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.245 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.245 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.245 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.245 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_PASSWORD": { 2023-07-21T23:08:49.245 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_PASSWORD", 2023-07-21T23:08:49.246 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.246 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.246 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.246 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:49.246 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.246 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.246 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.246 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.247 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.247 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.247 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.247 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-07-21T23:08:49.247 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-07-21T23:08:49.247 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.247 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.248 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.248 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.248 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.248 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.248 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.248 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.248 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.248 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.249 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.249 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.249 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_URL": { 2023-07-21T23:08:49.249 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_URL", 2023-07-21T23:08:49.249 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.249 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.249 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.250 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.250 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.250 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.250 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.250 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.250 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.250 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.250 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.251 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.251 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_API_USERNAME": { 2023-07-21T23:08:49.251 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_API_USERNAME", 2023-07-21T23:08:49.251 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.251 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.251 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.251 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:49.251 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.252 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.252 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.252 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.252 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.252 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.252 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.252 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-07-21T23:08:49.253 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-07-21T23:08:49.253 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.253 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.253 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.253 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.253 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.253 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.253 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.254 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.254 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.254 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.254 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.254 INFO:teuthology.orchestra.run.smithi151.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-07-21T23:08:49.254 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-07-21T23:08:49.254 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.255 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.255 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.255 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.255 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.255 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.255 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.255 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.255 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.256 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.256 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.256 INFO:teuthology.orchestra.run.smithi151.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-07-21T23:08:49.256 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-07-21T23:08:49.256 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.256 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.256 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.257 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.257 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.257 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.257 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.257 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.257 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.257 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.257 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.258 INFO:teuthology.orchestra.run.smithi151.stdout: "ISSUE_TRACKER_API_KEY": { 2023-07-21T23:08:49.258 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-07-21T23:08:49.258 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.258 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.258 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.258 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.259 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.259 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.259 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.259 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.259 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.259 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.259 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.260 INFO:teuthology.orchestra.run.smithi151.stdout: "PROMETHEUS_API_HOST": { 2023-07-21T23:08:49.260 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PROMETHEUS_API_HOST", 2023-07-21T23:08:49.260 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.260 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.260 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.260 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.260 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.260 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.261 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.261 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.261 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.261 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.261 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.261 INFO:teuthology.orchestra.run.smithi151.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-07-21T23:08:49.261 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-07-21T23:08:49.262 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.262 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.262 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.262 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.262 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.262 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.262 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.262 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.263 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.263 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.263 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.263 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-07-21T23:08:49.263 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-07-21T23:08:49.263 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.263 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.264 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.264 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.264 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.264 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.264 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.264 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.264 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.265 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.265 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.265 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-07-21T23:08:49.265 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-07-21T23:08:49.265 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.265 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.265 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.266 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.266 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.266 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.266 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.266 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.266 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.266 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.266 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.267 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-07-21T23:08:49.267 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-07-21T23:08:49.267 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.267 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.267 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.267 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.267 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.268 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.268 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.268 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.268 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.268 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.268 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.268 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-07-21T23:08:49.269 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-07-21T23:08:49.269 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.269 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.269 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.269 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.269 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.269 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.269 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.270 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.270 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.270 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.270 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.270 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-07-21T23:08:49.270 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-07-21T23:08:49.270 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.271 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.271 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.271 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.271 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.271 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.271 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.271 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.271 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.272 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.272 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.272 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-07-21T23:08:49.272 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-07-21T23:08:49.272 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.272 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.273 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.273 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.273 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.273 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.273 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.273 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.273 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.273 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.274 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.274 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.274 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-07-21T23:08:49.274 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-07-21T23:08:49.274 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.274 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.274 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.274 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.275 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.275 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.275 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.275 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.275 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.275 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.275 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.275 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.276 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_ENABLED": { 2023-07-21T23:08:49.276 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_ENABLED", 2023-07-21T23:08:49.276 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.276 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.276 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.276 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.276 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.277 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.277 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.277 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.277 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.277 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.277 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.277 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-07-21T23:08:49.278 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-07-21T23:08:49.278 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.278 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.278 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.278 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-07-21T23:08:49.278 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.278 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.278 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.279 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.279 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.279 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.279 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.279 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.279 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-07-21T23:08:49.279 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-07-21T23:08:49.279 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.280 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.280 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.280 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:49.280 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.280 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.280 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.280 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.280 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.281 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.281 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.281 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.281 INFO:teuthology.orchestra.run.smithi151.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-07-21T23:08:49.281 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-07-21T23:08:49.281 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.281 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.281 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.282 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8", 2023-07-21T23:08:49.282 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.282 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.282 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.282 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.282 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.282 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.282 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.283 INFO:teuthology.orchestra.run.smithi151.stdout: "REST_REQUESTS_TIMEOUT": { 2023-07-21T23:08:49.283 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-07-21T23:08:49.283 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.283 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.283 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.283 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "45", 2023-07-21T23:08:49.283 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.284 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.284 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.284 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.284 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.284 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.284 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.285 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_ACCESS_KEY": { 2023-07-21T23:08:49.285 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_ACCESS_KEY", 2023-07-21T23:08:49.285 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.285 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.285 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.285 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.285 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.285 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.286 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.286 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.286 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.286 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.286 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.286 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-07-21T23:08:49.286 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-07-21T23:08:49.287 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.287 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.287 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.287 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "admin", 2023-07-21T23:08:49.287 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.287 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.287 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.287 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.288 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.288 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.288 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.288 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.288 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_SECRET_KEY": { 2023-07-21T23:08:49.288 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_SECRET_KEY", 2023-07-21T23:08:49.288 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.288 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.289 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.289 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.289 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.289 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.289 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.289 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.289 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.289 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.290 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.290 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.290 INFO:teuthology.orchestra.run.smithi151.stdout: "RGW_API_SSL_VERIFY": { 2023-07-21T23:08:49.290 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "RGW_API_SSL_VERIFY", 2023-07-21T23:08:49.290 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.290 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.290 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.290 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.291 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.291 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.291 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.291 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.291 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.291 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.291 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.292 INFO:teuthology.orchestra.run.smithi151.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-07-21T23:08:49.292 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-07-21T23:08:49.292 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.292 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.292 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.292 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:49.292 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.292 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.293 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.293 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.293 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.293 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.293 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.293 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.293 INFO:teuthology.orchestra.run.smithi151.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-07-21T23:08:49.293 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-07-21T23:08:49.294 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.294 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.294 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.294 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:49.294 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.294 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.294 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.294 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.295 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.295 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.295 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.295 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.295 INFO:teuthology.orchestra.run.smithi151.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-07-21T23:08:49.295 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-07-21T23:08:49.295 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.296 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.296 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.296 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:49.296 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.296 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.296 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.296 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.296 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.297 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.297 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.297 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.297 INFO:teuthology.orchestra.run.smithi151.stdout: "cross_origin_url": { 2023-07-21T23:08:49.297 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cross_origin_url", 2023-07-21T23:08:49.297 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.297 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.297 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.298 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.298 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.298 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.298 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.298 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.298 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.298 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.298 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.299 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.299 INFO:teuthology.orchestra.run.smithi151.stdout: "crt_file": { 2023-07-21T23:08:49.299 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "crt_file", 2023-07-21T23:08:49.299 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.299 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.299 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.299 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.299 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.300 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.300 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.300 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.300 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.300 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.300 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.300 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.300 INFO:teuthology.orchestra.run.smithi151.stdout: "debug": { 2023-07-21T23:08:49.301 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "debug", 2023-07-21T23:08:49.301 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.301 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.301 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.301 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.301 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.301 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.301 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.302 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Enable/disable debug options", 2023-07-21T23:08:49.302 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.302 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.302 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.302 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.302 INFO:teuthology.orchestra.run.smithi151.stdout: "jwt_token_ttl": { 2023-07-21T23:08:49.302 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "jwt_token_ttl", 2023-07-21T23:08:49.303 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.303 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.303 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.303 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "28800", 2023-07-21T23:08:49.303 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.303 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.303 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.303 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.304 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.304 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.304 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.304 INFO:teuthology.orchestra.run.smithi151.stdout: "key_file": { 2023-07-21T23:08:49.304 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "key_file", 2023-07-21T23:08:49.304 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.304 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.305 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.305 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.305 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.305 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.305 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.305 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.305 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.305 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.306 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.306 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.306 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.306 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.306 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.306 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.306 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.307 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.307 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.307 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.307 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.307 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.307 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.307 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.307 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.308 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.308 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.308 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.308 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.308 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.308 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.308 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.309 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.309 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.309 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.309 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.309 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.309 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.309 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.309 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.310 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.310 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.310 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.310 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.310 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.310 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.310 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.311 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.311 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.311 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.311 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.311 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.311 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.311 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.311 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.312 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.312 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.312 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.312 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.312 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.312 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.312 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.312 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.313 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.313 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.313 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.313 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.313 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.313 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.313 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.314 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.314 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.314 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.314 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.314 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.314 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.314 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.314 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.315 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.315 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.315 INFO:teuthology.orchestra.run.smithi151.stdout: "motd": { 2023-07-21T23:08:49.315 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "motd", 2023-07-21T23:08:49.315 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.315 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.315 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.315 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.316 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.316 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.316 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.316 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "The message of the day", 2023-07-21T23:08:49.316 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.316 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.316 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.316 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.317 INFO:teuthology.orchestra.run.smithi151.stdout: "redirect_resolve_ip_addr": { 2023-07-21T23:08:49.317 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "redirect_resolve_ip_addr", 2023-07-21T23:08:49.317 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.317 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.317 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.317 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.317 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.318 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.318 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.318 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.318 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.318 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.318 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.318 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.318 INFO:teuthology.orchestra.run.smithi151.stdout: "server_addr": { 2023-07-21T23:08:49.319 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_addr", 2023-07-21T23:08:49.319 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.319 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.319 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.319 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "::", 2023-07-21T23:08:49.319 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.319 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.319 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.320 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.320 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.320 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.320 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.320 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.320 INFO:teuthology.orchestra.run.smithi151.stdout: "server_port": { 2023-07-21T23:08:49.320 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_port", 2023-07-21T23:08:49.320 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.321 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.321 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.321 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8080", 2023-07-21T23:08:49.321 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.321 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.321 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.321 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.321 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.322 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.322 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.322 INFO:teuthology.orchestra.run.smithi151.stdout: "ssl": { 2023-07-21T23:08:49.322 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssl", 2023-07-21T23:08:49.322 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.322 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.322 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.323 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.323 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.323 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.323 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.323 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.323 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.323 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.323 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.324 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.324 INFO:teuthology.orchestra.run.smithi151.stdout: "ssl_server_port": { 2023-07-21T23:08:49.324 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssl_server_port", 2023-07-21T23:08:49.324 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.324 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.324 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.324 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8443", 2023-07-21T23:08:49.324 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.325 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.325 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.325 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.325 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.325 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.325 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.325 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.325 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_behaviour": { 2023-07-21T23:08:49.326 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_behaviour", 2023-07-21T23:08:49.326 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.326 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.326 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.326 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "redirect", 2023-07-21T23:08:49.326 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.326 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.326 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.327 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.327 INFO:teuthology.orchestra.run.smithi151.stdout: "redirect" 2023-07-21T23:08:49.327 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.327 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.327 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.327 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.327 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.327 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.328 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_error_status_code": { 2023-07-21T23:08:49.328 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_error_status_code", 2023-07-21T23:08:49.328 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.328 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.328 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.328 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "500", 2023-07-21T23:08:49.328 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "400", 2023-07-21T23:08:49.328 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "599", 2023-07-21T23:08:49.329 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.329 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.329 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.329 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.329 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.329 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.329 INFO:teuthology.orchestra.run.smithi151.stdout: "url_prefix": { 2023-07-21T23:08:49.329 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "url_prefix", 2023-07-21T23:08:49.330 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.330 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.330 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.330 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.330 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.330 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.330 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.330 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.331 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "devicehealth", 2023-07-21T23:08:49.332 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.332 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.332 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.332 INFO:teuthology.orchestra.run.smithi151.stdout: "enable_monitoring": { 2023-07-21T23:08:49.332 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enable_monitoring", 2023-07-21T23:08:49.332 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.332 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.333 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.333 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.333 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.333 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.333 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.333 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "monitor device health metrics", 2023-07-21T23:08:49.333 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.333 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.334 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.334 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.334 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.334 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.334 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.334 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.334 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.334 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.335 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.335 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.335 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.335 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.335 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.335 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.335 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.336 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.336 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.336 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.336 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.336 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.336 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.336 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.336 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.337 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.337 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.337 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.337 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.337 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.337 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.337 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.337 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.338 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.338 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.338 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.338 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.338 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.338 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.338 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.338 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.339 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.339 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.339 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.339 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.339 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.339 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.339 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.339 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.340 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.340 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.340 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.340 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.340 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.340 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.340 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.341 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.341 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.341 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.341 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.341 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.341 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.341 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.341 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.342 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.343 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.343 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.343 INFO:teuthology.orchestra.run.smithi151.stdout: "mark_out_threshold": { 2023-07-21T23:08:49.343 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mark_out_threshold", 2023-07-21T23:08:49.343 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.343 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.343 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.343 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "2419200", 2023-07-21T23:08:49.344 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.344 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.344 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.344 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-07-21T23:08:49.344 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.344 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.344 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.344 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.345 INFO:teuthology.orchestra.run.smithi151.stdout: "pool_name": { 2023-07-21T23:08:49.345 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pool_name", 2023-07-21T23:08:49.345 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.345 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.345 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.345 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "device_health_metrics", 2023-07-21T23:08:49.345 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.346 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.346 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.346 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "name of pool in which to store device health metrics", 2023-07-21T23:08:49.346 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.346 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.346 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.346 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.346 INFO:teuthology.orchestra.run.smithi151.stdout: "retention_period": { 2023-07-21T23:08:49.347 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "retention_period", 2023-07-21T23:08:49.347 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.347 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.347 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.347 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "15552000", 2023-07-21T23:08:49.347 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.347 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.347 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.348 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how long to retain device health metrics", 2023-07-21T23:08:49.348 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.348 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.348 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.348 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.348 INFO:teuthology.orchestra.run.smithi151.stdout: "scrape_frequency": { 2023-07-21T23:08:49.348 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "scrape_frequency", 2023-07-21T23:08:49.348 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.349 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.349 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.349 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "86400", 2023-07-21T23:08:49.349 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.349 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.349 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.349 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to scrape device health metrics", 2023-07-21T23:08:49.349 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.350 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.350 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.350 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.350 INFO:teuthology.orchestra.run.smithi151.stdout: "self_heal": { 2023-07-21T23:08:49.350 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "self_heal", 2023-07-21T23:08:49.350 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.350 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.350 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.351 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.351 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.351 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.351 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.351 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-07-21T23:08:49.351 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.351 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.351 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.352 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.352 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:49.352 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:49.352 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.352 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.352 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.352 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:49.352 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.353 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.353 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.353 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how frequently to wake up and check device health", 2023-07-21T23:08:49.353 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.353 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.353 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.353 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.353 INFO:teuthology.orchestra.run.smithi151.stdout: "warn_threshold": { 2023-07-21T23:08:49.354 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "warn_threshold", 2023-07-21T23:08:49.354 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.354 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.354 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.354 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "7257600", 2023-07-21T23:08:49.354 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.354 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.354 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.355 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-07-21T23:08:49.355 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.355 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.355 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.355 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.355 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.355 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.356 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "diskprediction_local", 2023-07-21T23:08:49.356 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.356 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.356 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.356 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.356 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.356 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.357 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.357 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.357 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.357 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.357 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.357 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.357 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.357 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.358 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.358 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.358 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.358 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.358 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.358 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.358 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.358 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.359 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.359 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.359 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.359 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.359 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.359 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.359 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.359 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.360 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.361 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.361 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.361 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.361 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.361 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.361 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.361 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.361 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.362 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.362 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.362 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.362 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.362 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.362 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.362 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.363 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.363 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.363 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.363 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.363 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.363 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.363 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.363 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.364 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.364 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.364 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.364 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.364 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.364 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.364 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.364 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.365 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.365 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.365 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.365 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.365 INFO:teuthology.orchestra.run.smithi151.stdout: "predict_interval": { 2023-07-21T23:08:49.365 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "predict_interval", 2023-07-21T23:08:49.365 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.365 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.366 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.366 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "86400", 2023-07-21T23:08:49.366 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.366 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.366 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.366 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.366 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.366 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.367 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.367 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.367 INFO:teuthology.orchestra.run.smithi151.stdout: "predictor_model": { 2023-07-21T23:08:49.367 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "predictor_model", 2023-07-21T23:08:49.367 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.367 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.367 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.367 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "prophetstor", 2023-07-21T23:08:49.368 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.368 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.368 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.368 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.368 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.368 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.368 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.368 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "600", 2023-07-21T23:08:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.369 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.370 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.371 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.371 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "influx", 2023-07-21T23:08:49.371 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": false, 2023-07-21T23:08:49.371 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "influxdb python module not found", 2023-07-21T23:08:49.371 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.371 INFO:teuthology.orchestra.run.smithi151.stdout: "batch_size": { 2023-07-21T23:08:49.371 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "batch_size", 2023-07-21T23:08:49.371 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.372 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.372 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.372 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5000", 2023-07-21T23:08:49.372 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.372 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.372 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.372 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-07-21T23:08:49.373 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.373 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.373 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.373 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.373 INFO:teuthology.orchestra.run.smithi151.stdout: "database": { 2023-07-21T23:08:49.373 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "database", 2023-07-21T23:08:49.373 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.373 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.374 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.374 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "ceph", 2023-07-21T23:08:49.374 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.374 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.374 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.374 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-07-21T23:08:49.374 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.374 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.375 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.375 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.375 INFO:teuthology.orchestra.run.smithi151.stdout: "hostname": { 2023-07-21T23:08:49.375 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "hostname", 2023-07-21T23:08:49.375 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.375 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.375 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.375 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.376 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.376 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.376 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.376 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "InfluxDB server hostname", 2023-07-21T23:08:49.376 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.376 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.376 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.376 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.377 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:49.377 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:49.377 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.377 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.377 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.377 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "30", 2023-07-21T23:08:49.377 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "5", 2023-07-21T23:08:49.377 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.378 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.378 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-07-21T23:08:49.378 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.378 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.378 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.378 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.378 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.378 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.379 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.379 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.379 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.379 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.379 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.379 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.379 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.379 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.380 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.380 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.380 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.380 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.380 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.380 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.380 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.380 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.381 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.381 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.381 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.381 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.381 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.381 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.381 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.381 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.382 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.382 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.382 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.382 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.382 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.382 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.382 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.383 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.383 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.383 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.383 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.383 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.383 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.383 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.383 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.384 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.384 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.384 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.384 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.384 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.384 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.384 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.384 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.385 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.385 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.385 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.385 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.385 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.385 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.385 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.385 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.386 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.386 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.386 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.386 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.386 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.386 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.386 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.387 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.387 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.387 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.387 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.387 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.387 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.387 INFO:teuthology.orchestra.run.smithi151.stdout: "password": { 2023-07-21T23:08:49.387 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "password", 2023-07-21T23:08:49.388 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.388 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.388 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.388 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.388 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.388 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.388 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.388 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "password of InfluxDB server user", 2023-07-21T23:08:49.389 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.389 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.389 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.389 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.389 INFO:teuthology.orchestra.run.smithi151.stdout: "port": { 2023-07-21T23:08:49.389 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "port", 2023-07-21T23:08:49.389 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.389 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.390 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.390 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "8086", 2023-07-21T23:08:49.390 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.390 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.390 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.390 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "InfluxDB server port", 2023-07-21T23:08:49.391 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.391 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.391 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.391 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.391 INFO:teuthology.orchestra.run.smithi151.stdout: "ssl": { 2023-07-21T23:08:49.391 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ssl", 2023-07-21T23:08:49.391 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.391 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.392 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.392 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "false", 2023-07-21T23:08:49.392 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.392 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.392 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.392 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-07-21T23:08:49.392 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.393 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.393 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.393 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.393 INFO:teuthology.orchestra.run.smithi151.stdout: "threads": { 2023-07-21T23:08:49.393 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "threads", 2023-07-21T23:08:49.393 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.393 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.393 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.394 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:49.394 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:49.394 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "32", 2023-07-21T23:08:49.394 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.394 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-07-21T23:08:49.394 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.394 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.394 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.395 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.395 INFO:teuthology.orchestra.run.smithi151.stdout: "username": { 2023-07-21T23:08:49.395 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "username", 2023-07-21T23:08:49.395 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.395 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.395 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.395 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.395 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.396 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.396 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.396 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "username of InfluxDB server user", 2023-07-21T23:08:49.396 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.396 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.396 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.396 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.396 INFO:teuthology.orchestra.run.smithi151.stdout: "verify_ssl": { 2023-07-21T23:08:49.397 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "verify_ssl", 2023-07-21T23:08:49.397 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.397 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.397 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.397 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "true", 2023-07-21T23:08:49.397 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.397 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.398 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.398 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-07-21T23:08:49.398 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.398 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.398 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.398 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.398 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.398 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.399 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.399 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "insights", 2023-07-21T23:08:49.399 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.399 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.399 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.399 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.399 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.399 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.400 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.400 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.400 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.400 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.400 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.400 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.400 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.400 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.401 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.401 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.401 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.401 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.401 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.401 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.401 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.401 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.402 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.402 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.402 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.402 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.402 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.402 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.402 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.402 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.403 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.403 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.403 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.403 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.403 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.403 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.403 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.403 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.404 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.404 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.404 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.404 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.404 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.404 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.404 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.404 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.405 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.405 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.405 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.405 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.405 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.405 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.405 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.405 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.406 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.406 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.406 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.406 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.406 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.406 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.406 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.406 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.407 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.407 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.407 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.407 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.407 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.407 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.407 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.407 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.408 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.408 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.408 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.408 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.408 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.408 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.408 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "iostat", 2023-07-21T23:08:49.409 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.409 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.409 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.409 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.409 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.409 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.409 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.409 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.410 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.410 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.410 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.410 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.410 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.410 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.410 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.410 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.411 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.411 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.411 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.411 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.411 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.411 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.411 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.411 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.412 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.412 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.412 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.412 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.412 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.412 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.412 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.412 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.413 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.413 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.413 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.413 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.413 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.413 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.413 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.413 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.414 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.414 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.414 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.414 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.414 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.414 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.414 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.414 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.415 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.415 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.415 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.415 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.415 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.415 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.415 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.415 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.416 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.416 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.416 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.416 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.416 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.416 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.416 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.416 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.417 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.417 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.417 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.417 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.417 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.417 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.417 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.417 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.418 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.418 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.418 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.418 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.418 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "k8sevents", 2023-07-21T23:08:49.418 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.418 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.419 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.419 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_event_retention_days": { 2023-07-21T23:08:49.419 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "ceph_event_retention_days", 2023-07-21T23:08:49.419 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.419 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.419 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.419 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "7", 2023-07-21T23:08:49.419 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.420 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.420 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.420 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Days to hold ceph event information within local cache", 2023-07-21T23:08:49.420 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.420 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.420 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.420 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.420 INFO:teuthology.orchestra.run.smithi151.stdout: "config_check_secs": { 2023-07-21T23:08:49.421 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "config_check_secs", 2023-07-21T23:08:49.421 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.421 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.421 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.421 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:49.421 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "10", 2023-07-21T23:08:49.421 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2023-07-21T23:08:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.422 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.423 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.424 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.425 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.425 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.425 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.425 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.425 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.425 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.425 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.425 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.426 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.426 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.426 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.426 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.426 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.426 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.426 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.426 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.427 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.427 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.427 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.427 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.427 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.427 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.427 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.427 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.428 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.428 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.428 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.428 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.428 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.428 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.428 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.429 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.429 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.429 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.429 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.429 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.429 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.429 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.429 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.430 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.430 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.430 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.430 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.430 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.430 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.430 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.430 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.431 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.431 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.431 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.431 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.431 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.431 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.431 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.432 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "localpool", 2023-07-21T23:08:49.432 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.432 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.432 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.432 INFO:teuthology.orchestra.run.smithi151.stdout: "failure_domain": { 2023-07-21T23:08:49.432 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "failure_domain", 2023-07-21T23:08:49.432 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.432 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.433 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.433 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "host", 2023-07-21T23:08:49.433 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.433 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.433 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.433 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "failure domain for any created local pool", 2023-07-21T23:08:49.433 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-07-21T23:08:49.433 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.434 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.434 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.434 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.434 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.434 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.434 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.434 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.434 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.435 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.435 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.435 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.435 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.435 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.435 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.435 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.435 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.436 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.436 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.436 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.436 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.436 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.436 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.436 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.436 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.437 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.437 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.437 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.437 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.437 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.437 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.437 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.437 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.438 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.438 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.438 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.438 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.438 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.438 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.438 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.438 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.439 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.439 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.439 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.439 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.439 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.439 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.439 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.440 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.440 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.440 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.440 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.440 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.440 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.440 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.440 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.441 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.441 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.441 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.441 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.441 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.441 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.441 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.441 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.442 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.442 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.442 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.442 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.442 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.442 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.442 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.442 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.443 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.443 INFO:teuthology.orchestra.run.smithi151.stdout: "min_size": { 2023-07-21T23:08:49.443 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "min_size", 2023-07-21T23:08:49.443 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.443 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.443 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.443 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.443 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.444 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.444 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.444 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "default min_size for any created local pool", 2023-07-21T23:08:49.444 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-07-21T23:08:49.444 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.444 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.444 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.444 INFO:teuthology.orchestra.run.smithi151.stdout: "num_rep": { 2023-07-21T23:08:49.445 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "num_rep", 2023-07-21T23:08:49.445 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.445 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.445 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.445 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "3", 2023-07-21T23:08:49.445 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.445 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.446 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.446 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "default replica count for any created local pool", 2023-07-21T23:08:49.446 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.446 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.446 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.446 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.446 INFO:teuthology.orchestra.run.smithi151.stdout: "pg_num": { 2023-07-21T23:08:49.446 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pg_num", 2023-07-21T23:08:49.447 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.447 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.447 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.447 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "128", 2023-07-21T23:08:49.447 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.447 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.447 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.447 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "default pg_num for any created local pool", 2023-07-21T23:08:49.448 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.448 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.448 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.448 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.448 INFO:teuthology.orchestra.run.smithi151.stdout: "prefix": { 2023-07-21T23:08:49.448 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prefix", 2023-07-21T23:08:49.448 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.448 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.449 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.449 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.449 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.449 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.449 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.449 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "name prefix for any created local pool", 2023-07-21T23:08:49.449 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.449 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: "subtree": { 2023-07-21T23:08:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "subtree", 2023-07-21T23:08:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.450 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "rack", 2023-07-21T23:08:49.451 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.451 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.451 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.451 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "CRUSH level for which to create a local pool", 2023-07-21T23:08:49.451 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-07-21T23:08:49.451 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.451 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.451 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.452 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.452 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.452 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.452 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mds_autoscaler", 2023-07-21T23:08:49.452 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.452 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.452 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.453 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.453 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.453 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.453 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.453 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.453 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.453 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.453 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.454 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.454 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.454 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.454 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.454 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.454 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.454 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.454 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.455 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.455 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.455 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.455 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.455 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.455 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.455 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.455 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.456 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.456 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.456 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.456 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.456 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.456 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.456 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.456 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.457 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.457 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.457 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.457 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.457 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.457 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.457 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.457 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.458 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.458 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.458 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.458 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.458 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.458 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.458 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.458 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.459 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.459 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.459 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.459 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.459 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.459 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.459 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.459 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.460 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.460 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.460 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.460 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.460 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.460 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.460 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.460 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.461 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mirroring", 2023-07-21T23:08:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.462 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.463 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.464 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.464 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.464 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.464 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.464 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.464 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.464 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.465 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.465 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.465 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.465 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.465 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.465 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.465 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.465 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.466 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.466 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.466 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.466 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.466 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.466 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.466 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.466 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.467 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.467 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.467 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.467 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.467 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.467 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.467 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.467 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.468 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.468 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.468 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.468 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.468 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.468 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.468 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.468 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.469 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.469 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.469 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.469 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.469 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.469 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.469 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.469 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.470 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.470 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.470 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.470 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.470 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.470 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.470 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.470 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.471 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.471 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.471 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.471 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.471 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.471 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.471 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.472 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "nfs", 2023-07-21T23:08:49.472 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.472 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.472 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.472 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.472 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.472 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.472 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.473 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.473 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.473 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.473 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.473 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.473 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.473 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.473 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.474 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.474 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.474 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.474 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.474 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.474 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.474 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.474 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.475 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.475 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.475 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.475 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.475 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.475 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.475 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.475 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.476 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.476 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.476 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.476 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.476 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.476 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.476 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.476 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.477 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.477 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.477 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.477 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.477 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.477 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.477 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.477 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.478 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.478 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.478 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.478 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.478 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.478 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.478 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.478 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.479 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.479 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.479 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.479 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.479 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.479 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.479 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.479 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.480 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.480 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.480 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.480 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.480 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.480 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.480 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.481 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.481 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.481 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.481 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.481 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.481 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.481 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "orchestrator", 2023-07-21T23:08:49.481 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.482 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.482 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.482 INFO:teuthology.orchestra.run.smithi151.stdout: "fail_fs": { 2023-07-21T23:08:49.482 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "fail_fs", 2023-07-21T23:08:49.482 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.482 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.482 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.482 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.483 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.483 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.483 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.483 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2023-07-21T23:08:49.483 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.483 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.483 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.483 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.484 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.484 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.484 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.484 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.484 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.484 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.484 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.484 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.485 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.485 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.485 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.485 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.485 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.485 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.485 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.485 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.486 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.486 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.486 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.486 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.486 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.486 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.486 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.486 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.487 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.487 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.487 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.487 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.487 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.487 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.487 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.487 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.488 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.488 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.488 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.488 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.488 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.488 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.488 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.488 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.489 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.489 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.489 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.489 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.489 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.489 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.489 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.489 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.490 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.490 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.490 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.490 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.490 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.490 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.490 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.490 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.491 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.491 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.491 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.491 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.491 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.491 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.491 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.491 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.492 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.492 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.492 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.492 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.492 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.492 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.492 INFO:teuthology.orchestra.run.smithi151.stdout: "orchestrator": { 2023-07-21T23:08:49.493 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "orchestrator", 2023-07-21T23:08:49.493 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.493 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.493 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.493 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.493 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.493 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.493 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.494 INFO:teuthology.orchestra.run.smithi151.stdout: "cephadm", 2023-07-21T23:08:49.494 INFO:teuthology.orchestra.run.smithi151.stdout: "rook", 2023-07-21T23:08:49.494 INFO:teuthology.orchestra.run.smithi151.stdout: "test_orchestrator" 2023-07-21T23:08:49.494 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.494 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Orchestrator backend", 2023-07-21T23:08:49.494 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.494 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.494 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.495 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.495 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.495 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.495 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.495 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "osd_perf_query", 2023-07-21T23:08:49.495 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.495 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.495 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.496 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.496 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.496 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.496 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.496 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.496 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.496 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.496 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.497 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.497 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.497 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.497 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.497 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.497 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.497 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.497 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.498 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.498 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.498 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.498 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.498 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.498 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.498 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.498 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.499 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.499 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.499 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.499 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.499 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.499 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.499 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.499 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.500 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.500 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.500 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.500 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.500 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.500 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.500 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.501 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.501 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.501 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.501 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.501 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.501 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.501 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.501 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.502 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.502 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.502 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.502 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.502 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.502 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.502 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.502 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.503 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.503 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.503 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.503 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.503 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.503 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.503 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.503 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.504 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.504 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.504 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.504 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.504 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.504 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.504 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.504 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.505 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.505 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.505 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "osd_support", 2023-07-21T23:08:49.505 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.505 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.505 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.505 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.505 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.506 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.506 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.506 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.506 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.506 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.506 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.506 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.506 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.507 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.507 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.507 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.507 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.507 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.507 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.507 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.507 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.508 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.508 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.508 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.508 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.508 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.508 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.508 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.508 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.509 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.509 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.509 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.509 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.509 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.509 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.509 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.509 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.510 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.510 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.510 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.510 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.510 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.510 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.510 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.510 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.511 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.511 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.511 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.511 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.511 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.511 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.511 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.511 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.512 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.512 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.512 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.512 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.512 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.512 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.512 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.513 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.513 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.513 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.513 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.513 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.513 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.513 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.513 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.514 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.514 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.514 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.514 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.514 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.514 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.514 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.514 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.515 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "pg_autoscaler", 2023-07-21T23:08:49.515 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.515 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.515 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.515 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.515 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.515 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.515 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.516 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.516 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.516 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.516 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.516 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.516 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.516 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.516 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.517 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.517 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.517 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.517 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.517 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.517 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.517 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.517 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.518 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.518 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.518 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.518 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.518 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.518 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.518 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.518 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.519 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.519 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.519 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.519 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.519 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.519 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.519 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.519 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.520 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.520 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.520 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.520 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.520 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.520 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.520 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.521 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.521 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.521 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.521 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.521 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.521 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.521 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.521 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.522 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.522 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.522 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.522 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.522 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.522 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.522 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.522 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.523 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.523 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.523 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.523 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.523 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.523 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.523 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.523 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.524 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.524 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.524 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.524 INFO:teuthology.orchestra.run.smithi151.stdout: "noautoscale": { 2023-07-21T23:08:49.524 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "noautoscale", 2023-07-21T23:08:49.524 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.524 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.524 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.525 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.525 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.525 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.525 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.525 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "global autoscale flag", 2023-07-21T23:08:49.525 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "Option to turn on/off the autoscaler for all pools", 2023-07-21T23:08:49.525 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.525 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.526 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.526 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:49.526 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:49.526 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.526 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.526 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.526 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:49.526 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.527 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.527 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.527 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.527 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.527 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.527 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.527 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.527 INFO:teuthology.orchestra.run.smithi151.stdout: "threshold": { 2023-07-21T23:08:49.528 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "threshold", 2023-07-21T23:08:49.528 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:49.528 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.528 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.528 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "3.0", 2023-07-21T23:08:49.528 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1.0", 2023-07-21T23:08:49.528 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.529 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.529 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "scaling threshold", 2023-07-21T23:08:49.529 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-07-21T23:08:49.529 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.529 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.529 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.529 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.530 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.530 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "progress", 2023-07-21T23:08:49.530 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.530 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.530 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.530 INFO:teuthology.orchestra.run.smithi151.stdout: "allow_pg_recovery_event": { 2023-07-21T23:08:49.530 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "allow_pg_recovery_event", 2023-07-21T23:08:49.530 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.531 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.531 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.531 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.531 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.531 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.531 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.531 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "allow the module to show pg recovery progress", 2023-07-21T23:08:49.531 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.532 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.532 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.532 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.532 INFO:teuthology.orchestra.run.smithi151.stdout: "enabled": { 2023-07-21T23:08:49.532 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enabled", 2023-07-21T23:08:49.532 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.532 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.532 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.533 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.533 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.533 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.533 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.533 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.533 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.533 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.533 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.534 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.534 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.534 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.534 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.534 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.534 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.534 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.534 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.535 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.535 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.535 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.535 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.535 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.535 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.535 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.535 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.536 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.536 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.536 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.536 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.536 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.536 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.536 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.536 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.537 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.537 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.537 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.537 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.537 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.537 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.537 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.537 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.538 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.538 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.538 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.538 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.538 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.538 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.538 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.538 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.539 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.539 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.539 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.539 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.539 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.539 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.539 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.539 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.540 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.540 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.540 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.540 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.540 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.540 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.540 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.541 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.541 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.541 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.541 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.541 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.541 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.541 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.541 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.542 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.542 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.542 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.542 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.542 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.542 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.542 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.542 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.543 INFO:teuthology.orchestra.run.smithi151.stdout: "max_completed_events": { 2023-07-21T23:08:49.543 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_completed_events", 2023-07-21T23:08:49.543 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.543 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.543 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.543 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "50", 2023-07-21T23:08:49.543 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.543 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.544 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.544 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "number of past completed events to remember", 2023-07-21T23:08:49.544 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.544 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.544 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.544 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.544 INFO:teuthology.orchestra.run.smithi151.stdout: "sleep_interval": { 2023-07-21T23:08:49.544 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "sleep_interval", 2023-07-21T23:08:49.545 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.545 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.545 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.545 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "5", 2023-07-21T23:08:49.545 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.545 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.545 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.545 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "how long the module is going to sleep", 2023-07-21T23:08:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.546 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "prometheus", 2023-07-21T23:08:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "cache": { 2023-07-21T23:08:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "cache", 2023-07-21T23:08:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.547 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.548 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "exclude_perf_counters": { 2023-07-21T23:08:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "exclude_perf_counters", 2023-07-21T23:08:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.549 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Do not include perf-counters in the metrics output", 2023-07-21T23:08:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2023-07-21T23:08:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.550 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.551 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.552 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.553 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.554 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.555 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.556 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.557 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.558 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.559 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_stats_pools": { 2023-07-21T23:08:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_stats_pools", 2023-07-21T23:08:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.560 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_stats_pools_refresh_interval": { 2023-07-21T23:08:49.561 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-07-21T23:08:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "300", 2023-07-21T23:08:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.562 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "scrape_interval": { 2023-07-21T23:08:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "scrape_interval", 2023-07-21T23:08:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:49.563 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "15.0", 2023-07-21T23:08:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.564 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "server_addr": { 2023-07-21T23:08:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_addr", 2023-07-21T23:08:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.565 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "::", 2023-07-21T23:08:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-07-21T23:08:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.566 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "server_port": { 2023-07-21T23:08:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_port", 2023-07-21T23:08:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "9283", 2023-07-21T23:08:49.567 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-07-21T23:08:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.568 INFO:teuthology.orchestra.run.smithi151.stdout: "stale_cache_strategy": { 2023-07-21T23:08:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "stale_cache_strategy", 2023-07-21T23:08:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "log", 2023-07-21T23:08:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.569 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_behaviour": { 2023-07-21T23:08:49.570 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_behaviour", 2023-07-21T23:08:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "default", 2023-07-21T23:08:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.571 INFO:teuthology.orchestra.run.smithi151.stdout: "default", 2023-07-21T23:08:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "error" 2023-07-21T23:08:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.572 INFO:teuthology.orchestra.run.smithi151.stdout: "standby_error_status_code": { 2023-07-21T23:08:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "standby_error_status_code", 2023-07-21T23:08:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "500", 2023-07-21T23:08:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "400", 2023-07-21T23:08:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "599", 2023-07-21T23:08:49.573 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.574 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_support", 2023-07-21T23:08:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.575 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.576 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.577 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.578 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.579 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.581 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.582 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.583 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "max_concurrent_snap_create": { 2023-07-21T23:08:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_concurrent_snap_create", 2023-07-21T23:08:49.584 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10", 2023-07-21T23:08:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.585 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "mirror_snapshot_schedule": { 2023-07-21T23:08:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "mirror_snapshot_schedule", 2023-07-21T23:08:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.586 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.587 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "trash_purge_schedule": { 2023-07-21T23:08:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "trash_purge_schedule", 2023-07-21T23:08:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.588 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.589 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "restful", 2023-07-21T23:08:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "enable_auth": { 2023-07-21T23:08:49.590 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enable_auth", 2023-07-21T23:08:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.591 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "key_file": { 2023-07-21T23:08:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "key_file", 2023-07-21T23:08:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.592 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.593 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.594 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.595 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.597 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.598 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.599 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.600 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.601 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.602 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "server_addr": { 2023-07-21T23:08:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_addr", 2023-07-21T23:08:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.603 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.604 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "server_port": { 2023-07-21T23:08:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "server_port", 2023-07-21T23:08:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.605 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.606 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rgw", 2023-07-21T23:08:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.607 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.608 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.609 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.610 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.611 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.612 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.613 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.615 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.616 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rook", 2023-07-21T23:08:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "drive_group_interval": { 2023-07-21T23:08:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "drive_group_interval", 2023-07-21T23:08:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.617 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "300.0", 2023-07-21T23:08:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-07-21T23:08:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.618 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.619 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.620 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.621 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.622 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.623 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.624 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.625 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.626 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "storage_class": { 2023-07-21T23:08:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "storage_class", 2023-07-21T23:08:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "local", 2023-07-21T23:08:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.628 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-07-21T23:08:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.629 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "selftest", 2023-07-21T23:08:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.630 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.631 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.632 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.633 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.634 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.635 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.636 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.637 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.638 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "roption1": { 2023-07-21T23:08:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "roption1", 2023-07-21T23:08:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.639 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.640 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "roption2": { 2023-07-21T23:08:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "roption2", 2023-07-21T23:08:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.641 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "xyz", 2023-07-21T23:08:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.642 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption1": { 2023-07-21T23:08:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption1", 2023-07-21T23:08:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.643 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.644 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption2": { 2023-07-21T23:08:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption2", 2023-07-21T23:08:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.645 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption3": { 2023-07-21T23:08:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption3", 2023-07-21T23:08:49.646 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "float", 2023-07-21T23:08:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.647 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption4": { 2023-07-21T23:08:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption4", 2023-07-21T23:08:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.649 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption5": { 2023-07-21T23:08:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption5", 2023-07-21T23:08:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.650 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.651 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption6": { 2023-07-21T23:08:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption6", 2023-07-21T23:08:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.652 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "rwoption7": { 2023-07-21T23:08:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rwoption7", 2023-07-21T23:08:49.653 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "1", 2023-07-21T23:08:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "42", 2023-07-21T23:08:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.654 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "testkey": { 2023-07-21T23:08:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "testkey", 2023-07-21T23:08:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.655 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.656 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "testlkey": { 2023-07-21T23:08:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "testlkey", 2023-07-21T23:08:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.657 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.658 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "testnewline": { 2023-07-21T23:08:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "testnewline", 2023-07-21T23:08:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.659 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.660 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "snap_schedule", 2023-07-21T23:08:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "allow_m_granularity": { 2023-07-21T23:08:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "allow_m_granularity", 2023-07-21T23:08:49.661 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.662 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "allow minute scheduled snapshots", 2023-07-21T23:08:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "dump_on_update": { 2023-07-21T23:08:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "dump_on_update", 2023-07-21T23:08:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.663 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "dump database to debug log on update", 2023-07-21T23:08:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.664 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.665 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.666 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.667 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.668 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.668 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.668 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.668 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.668 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.668 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.668 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.668 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.669 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.669 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.669 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.669 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.669 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.669 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.669 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.669 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.670 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.670 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.670 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.670 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.670 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.670 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.670 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.670 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.671 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.671 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.671 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.671 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.671 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.671 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.671 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.671 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.672 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.672 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.672 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.672 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.672 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.672 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.672 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.672 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.673 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.673 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.673 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.673 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.673 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.673 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.673 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.673 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.674 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.674 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.674 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.674 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "stats", 2023-07-21T23:08:49.674 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.674 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.674 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.674 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.675 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.675 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.675 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.675 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.675 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.675 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.675 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.675 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.676 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.676 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.676 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.676 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.676 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.676 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.676 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.676 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.677 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.677 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.677 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.677 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.677 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.677 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.677 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.678 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.678 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.678 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.678 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.678 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.678 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.678 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.678 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.679 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.679 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.679 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.679 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.679 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.679 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.679 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.679 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.680 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.680 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.680 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.680 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.680 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.680 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.680 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.680 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.681 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.681 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.681 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.681 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.681 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.681 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.681 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.681 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.682 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.682 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.682 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.682 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.682 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.682 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.682 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.682 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.683 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.683 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.683 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.683 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.683 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.683 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.683 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.684 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.684 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "status", 2023-07-21T23:08:49.684 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.684 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.684 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.684 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.684 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.684 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.685 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.685 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.685 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.685 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.685 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.685 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.685 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.686 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.686 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.686 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.686 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.686 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.686 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.686 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.686 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.687 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.687 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.687 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.687 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.687 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.687 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.687 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.687 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.688 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.688 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.688 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.688 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.688 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.688 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.688 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.688 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.689 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.689 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.689 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.689 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.689 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.689 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.689 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.689 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.690 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.690 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.690 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.690 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.690 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.690 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.690 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.690 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.691 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.691 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.691 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.691 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.691 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.691 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.691 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.691 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.692 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.692 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.692 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.692 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.692 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.692 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.692 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.693 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.693 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.693 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.693 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.693 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.693 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.693 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.693 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.694 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "telegraf", 2023-07-21T23:08:49.694 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.694 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.694 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.694 INFO:teuthology.orchestra.run.smithi151.stdout: "address": { 2023-07-21T23:08:49.694 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "address", 2023-07-21T23:08:49.694 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.694 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.695 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.695 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-07-21T23:08:49.695 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.695 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.695 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.695 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.695 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.695 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.696 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.696 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.696 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:49.696 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:49.696 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.696 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.696 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.696 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "15", 2023-07-21T23:08:49.697 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.697 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.697 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.697 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.697 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.697 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.697 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.697 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.698 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.698 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.698 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.698 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.698 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.698 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.698 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.698 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.699 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.699 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.699 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.699 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.699 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.699 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.699 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.699 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.700 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.700 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.700 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.700 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.700 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.700 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.700 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.701 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.702 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.703 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.704 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.705 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.706 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "telemetry", 2023-07-21T23:08:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_basic": { 2023-07-21T23:08:49.707 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_basic", 2023-07-21T23:08:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.708 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share basic cluster information (size, version)", 2023-07-21T23:08:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_crash": { 2023-07-21T23:08:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_crash", 2023-07-21T23:08:49.709 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-07-21T23:08:49.710 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_device": { 2023-07-21T23:08:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_device", 2023-07-21T23:08:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.711 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "True", 2023-07-21T23:08:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-07-21T23:08:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.712 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_ident": { 2023-07-21T23:08:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_ident", 2023-07-21T23:08:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.713 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-07-21T23:08:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.714 INFO:teuthology.orchestra.run.smithi151.stdout: "channel_perf": { 2023-07-21T23:08:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "channel_perf", 2023-07-21T23:08:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.715 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Share various performance metrics of a cluster", 2023-07-21T23:08:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "contact": { 2023-07-21T23:08:49.716 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "contact", 2023-07-21T23:08:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.717 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "description": { 2023-07-21T23:08:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "description", 2023-07-21T23:08:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.718 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.719 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "device_url": { 2023-07-21T23:08:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "device_url", 2023-07-21T23:08:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.720 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-07-21T23:08:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.721 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "enabled": { 2023-07-21T23:08:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "enabled", 2023-07-21T23:08:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.722 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:49.723 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "24", 2023-07-21T23:08:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "8", 2023-07-21T23:08:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.724 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "last_opt_revision": { 2023-07-21T23:08:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "last_opt_revision", 2023-07-21T23:08:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.725 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "1", 2023-07-21T23:08:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.726 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "leaderboard": { 2023-07-21T23:08:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "leaderboard", 2023-07-21T23:08:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.727 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.728 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "leaderboard_description": { 2023-07-21T23:08:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "leaderboard_description", 2023-07-21T23:08:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.729 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.730 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.731 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.732 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.733 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.734 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.735 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.736 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.737 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.738 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "organization": { 2023-07-21T23:08:49.739 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "organization", 2023-07-21T23:08:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.740 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "proxy": { 2023-07-21T23:08:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "proxy", 2023-07-21T23:08:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.741 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.742 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "url": { 2023-07-21T23:08:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "url", 2023-07-21T23:08:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.743 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-07-21T23:08:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.744 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "test_orchestrator", 2023-07-21T23:08:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.745 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.746 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.747 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.748 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.749 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.750 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.751 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.752 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.753 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.754 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.754 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.754 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.754 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.754 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.754 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.754 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.754 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.755 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.755 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.755 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "volumes", 2023-07-21T23:08:49.755 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.755 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.755 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.755 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.755 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.756 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.756 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.756 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.756 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.756 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.756 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.756 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.756 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.757 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.757 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.757 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.757 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.757 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.757 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.757 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.757 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.758 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.758 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.758 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.758 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.758 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.758 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.758 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.758 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.759 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.759 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.759 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.759 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.759 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.759 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.759 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.759 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.760 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.760 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.760 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.760 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.760 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.760 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.760 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.760 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.761 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.761 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.761 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.761 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.761 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.761 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.761 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.761 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.762 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.762 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.762 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.762 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.762 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.762 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.762 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.762 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.763 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.763 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.763 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.763 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.763 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.763 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.763 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.763 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.764 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.764 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.764 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.764 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.764 INFO:teuthology.orchestra.run.smithi151.stdout: "max_concurrent_clones": { 2023-07-21T23:08:49.764 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "max_concurrent_clones", 2023-07-21T23:08:49.764 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.765 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.765 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.765 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "4", 2023-07-21T23:08:49.765 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.765 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.765 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.765 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Number of asynchronous cloner threads", 2023-07-21T23:08:49.765 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.766 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.766 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.766 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.766 INFO:teuthology.orchestra.run.smithi151.stdout: "snapshot_clone_delay": { 2023-07-21T23:08:49.766 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "snapshot_clone_delay", 2023-07-21T23:08:49.766 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.766 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.766 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.767 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "0", 2023-07-21T23:08:49.767 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.767 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.767 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.767 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-07-21T23:08:49.767 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.767 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.767 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.768 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.768 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.768 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.768 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.768 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix", 2023-07-21T23:08:49.768 INFO:teuthology.orchestra.run.smithi151.stdout: "can_run": true, 2023-07-21T23:08:49.768 INFO:teuthology.orchestra.run.smithi151.stdout: "error_string": "", 2023-07-21T23:08:49.768 INFO:teuthology.orchestra.run.smithi151.stdout: "module_options": { 2023-07-21T23:08:49.769 INFO:teuthology.orchestra.run.smithi151.stdout: "discovery_interval": { 2023-07-21T23:08:49.769 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "discovery_interval", 2023-07-21T23:08:49.769 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "uint", 2023-07-21T23:08:49.769 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.769 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.769 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "100", 2023-07-21T23:08:49.769 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.770 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.770 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.770 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.770 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.770 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.770 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.770 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.770 INFO:teuthology.orchestra.run.smithi151.stdout: "identifier": { 2023-07-21T23:08:49.771 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "identifier", 2023-07-21T23:08:49.771 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.771 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.771 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.771 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.771 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.771 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.771 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.772 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.772 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.772 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.772 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.772 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.772 INFO:teuthology.orchestra.run.smithi151.stdout: "interval": { 2023-07-21T23:08:49.772 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "interval", 2023-07-21T23:08:49.772 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "secs", 2023-07-21T23:08:49.773 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.773 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.773 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "60", 2023-07-21T23:08:49.773 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.773 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.773 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.773 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.773 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.774 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.774 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.774 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.774 INFO:teuthology.orchestra.run.smithi151.stdout: "log_level": { 2023-07-21T23:08:49.774 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_level", 2023-07-21T23:08:49.774 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.774 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.774 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.775 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.775 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.775 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.775 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.775 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.775 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.775 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.775 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.776 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.776 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.776 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.776 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.776 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.776 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.776 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.776 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.777 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster": { 2023-07-21T23:08:49.777 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster", 2023-07-21T23:08:49.777 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.777 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.777 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.777 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.777 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.777 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.778 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.778 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.778 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.778 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.778 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.778 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.778 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_cluster_level": { 2023-07-21T23:08:49.778 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_cluster_level", 2023-07-21T23:08:49.779 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.779 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.779 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.779 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "info", 2023-07-21T23:08:49.779 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.779 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.779 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [ 2023-07-21T23:08:49.780 INFO:teuthology.orchestra.run.smithi151.stdout: "", 2023-07-21T23:08:49.780 INFO:teuthology.orchestra.run.smithi151.stdout: "critical", 2023-07-21T23:08:49.780 INFO:teuthology.orchestra.run.smithi151.stdout: "debug", 2023-07-21T23:08:49.780 INFO:teuthology.orchestra.run.smithi151.stdout: "error", 2023-07-21T23:08:49.780 INFO:teuthology.orchestra.run.smithi151.stdout: "info", 2023-07-21T23:08:49.780 INFO:teuthology.orchestra.run.smithi151.stdout: "warning" 2023-07-21T23:08:49.780 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.780 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.781 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.781 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.781 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.781 INFO:teuthology.orchestra.run.smithi151.stdout: "log_to_file": { 2023-07-21T23:08:49.781 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "log_to_file", 2023-07-21T23:08:49.781 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "bool", 2023-07-21T23:08:49.781 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 1, 2023-07-21T23:08:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "False", 2023-07-21T23:08:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.782 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.783 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.783 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.783 INFO:teuthology.orchestra.run.smithi151.stdout: "zabbix_host": { 2023-07-21T23:08:49.783 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix_host", 2023-07-21T23:08:49.783 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.783 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.783 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.783 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "", 2023-07-21T23:08:49.784 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.784 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.784 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.784 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.784 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.784 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.784 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.784 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.785 INFO:teuthology.orchestra.run.smithi151.stdout: "zabbix_port": { 2023-07-21T23:08:49.785 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix_port", 2023-07-21T23:08:49.785 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "int", 2023-07-21T23:08:49.785 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.785 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.785 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "10051", 2023-07-21T23:08:49.785 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.785 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.786 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.786 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.786 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.786 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.786 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.786 INFO:teuthology.orchestra.run.smithi151.stdout: "zabbix_sender": { 2023-07-21T23:08:49.786 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "zabbix_sender", 2023-07-21T23:08:49.787 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "str", 2023-07-21T23:08:49.787 INFO:teuthology.orchestra.run.smithi151.stdout: "level": "advanced", 2023-07-21T23:08:49.787 INFO:teuthology.orchestra.run.smithi151.stdout: "flags": 0, 2023-07-21T23:08:49.787 INFO:teuthology.orchestra.run.smithi151.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-07-21T23:08:49.787 INFO:teuthology.orchestra.run.smithi151.stdout: "min": "", 2023-07-21T23:08:49.787 INFO:teuthology.orchestra.run.smithi151.stdout: "max": "", 2023-07-21T23:08:49.787 INFO:teuthology.orchestra.run.smithi151.stdout: "enum_allowed": [], 2023-07-21T23:08:49.787 INFO:teuthology.orchestra.run.smithi151.stdout: "desc": "", 2023-07-21T23:08:49.788 INFO:teuthology.orchestra.run.smithi151.stdout: "long_desc": "", 2023-07-21T23:08:49.788 INFO:teuthology.orchestra.run.smithi151.stdout: "tags": [], 2023-07-21T23:08:49.788 INFO:teuthology.orchestra.run.smithi151.stdout: "see_also": [] 2023-07-21T23:08:49.788 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.788 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.788 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.788 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.788 INFO:teuthology.orchestra.run.smithi151.stdout: "services": { 2023-07-21T23:08:49.789 INFO:teuthology.orchestra.run.smithi151.stdout: "dashboard": "https://172.21.15.151:8443/" 2023-07-21T23:08:49.789 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.789 INFO:teuthology.orchestra.run.smithi151.stdout: "always_on_modules": { 2023-07-21T23:08:49.789 INFO:teuthology.orchestra.run.smithi151.stdout: "octopus": [ 2023-07-21T23:08:49.789 INFO:teuthology.orchestra.run.smithi151.stdout: "balancer", 2023-07-21T23:08:49.789 INFO:teuthology.orchestra.run.smithi151.stdout: "crash", 2023-07-21T23:08:49.789 INFO:teuthology.orchestra.run.smithi151.stdout: "devicehealth", 2023-07-21T23:08:49.790 INFO:teuthology.orchestra.run.smithi151.stdout: "orchestrator", 2023-07-21T23:08:49.790 INFO:teuthology.orchestra.run.smithi151.stdout: "pg_autoscaler", 2023-07-21T23:08:49.790 INFO:teuthology.orchestra.run.smithi151.stdout: "progress", 2023-07-21T23:08:49.790 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_support", 2023-07-21T23:08:49.790 INFO:teuthology.orchestra.run.smithi151.stdout: "status", 2023-07-21T23:08:49.790 INFO:teuthology.orchestra.run.smithi151.stdout: "telemetry", 2023-07-21T23:08:49.790 INFO:teuthology.orchestra.run.smithi151.stdout: "volumes" 2023-07-21T23:08:49.790 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.791 INFO:teuthology.orchestra.run.smithi151.stdout: "pacific": [ 2023-07-21T23:08:49.791 INFO:teuthology.orchestra.run.smithi151.stdout: "balancer", 2023-07-21T23:08:49.791 INFO:teuthology.orchestra.run.smithi151.stdout: "crash", 2023-07-21T23:08:49.791 INFO:teuthology.orchestra.run.smithi151.stdout: "devicehealth", 2023-07-21T23:08:49.791 INFO:teuthology.orchestra.run.smithi151.stdout: "orchestrator", 2023-07-21T23:08:49.791 INFO:teuthology.orchestra.run.smithi151.stdout: "pg_autoscaler", 2023-07-21T23:08:49.791 INFO:teuthology.orchestra.run.smithi151.stdout: "progress", 2023-07-21T23:08:49.791 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_support", 2023-07-21T23:08:49.792 INFO:teuthology.orchestra.run.smithi151.stdout: "status", 2023-07-21T23:08:49.792 INFO:teuthology.orchestra.run.smithi151.stdout: "telemetry", 2023-07-21T23:08:49.792 INFO:teuthology.orchestra.run.smithi151.stdout: "volumes" 2023-07-21T23:08:49.792 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.792 INFO:teuthology.orchestra.run.smithi151.stdout: "quincy": [ 2023-07-21T23:08:49.792 INFO:teuthology.orchestra.run.smithi151.stdout: "balancer", 2023-07-21T23:08:49.792 INFO:teuthology.orchestra.run.smithi151.stdout: "crash", 2023-07-21T23:08:49.792 INFO:teuthology.orchestra.run.smithi151.stdout: "devicehealth", 2023-07-21T23:08:49.793 INFO:teuthology.orchestra.run.smithi151.stdout: "orchestrator", 2023-07-21T23:08:49.793 INFO:teuthology.orchestra.run.smithi151.stdout: "pg_autoscaler", 2023-07-21T23:08:49.793 INFO:teuthology.orchestra.run.smithi151.stdout: "progress", 2023-07-21T23:08:49.793 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_support", 2023-07-21T23:08:49.793 INFO:teuthology.orchestra.run.smithi151.stdout: "status", 2023-07-21T23:08:49.793 INFO:teuthology.orchestra.run.smithi151.stdout: "telemetry", 2023-07-21T23:08:49.793 INFO:teuthology.orchestra.run.smithi151.stdout: "volumes" 2023-07-21T23:08:49.793 INFO:teuthology.orchestra.run.smithi151.stdout: ], 2023-07-21T23:08:49.794 INFO:teuthology.orchestra.run.smithi151.stdout: "reef": [ 2023-07-21T23:08:49.794 INFO:teuthology.orchestra.run.smithi151.stdout: "balancer", 2023-07-21T23:08:49.794 INFO:teuthology.orchestra.run.smithi151.stdout: "crash", 2023-07-21T23:08:49.794 INFO:teuthology.orchestra.run.smithi151.stdout: "devicehealth", 2023-07-21T23:08:49.794 INFO:teuthology.orchestra.run.smithi151.stdout: "orchestrator", 2023-07-21T23:08:49.794 INFO:teuthology.orchestra.run.smithi151.stdout: "pg_autoscaler", 2023-07-21T23:08:49.794 INFO:teuthology.orchestra.run.smithi151.stdout: "progress", 2023-07-21T23:08:49.794 INFO:teuthology.orchestra.run.smithi151.stdout: "rbd_support", 2023-07-21T23:08:49.795 INFO:teuthology.orchestra.run.smithi151.stdout: "status", 2023-07-21T23:08:49.795 INFO:teuthology.orchestra.run.smithi151.stdout: "telemetry", 2023-07-21T23:08:49.795 INFO:teuthology.orchestra.run.smithi151.stdout: "volumes" 2023-07-21T23:08:49.795 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:49.795 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.795 INFO:teuthology.orchestra.run.smithi151.stdout: "last_failure_osd_epoch": 88, 2023-07-21T23:08:49.795 INFO:teuthology.orchestra.run.smithi151.stdout: "active_clients": [ 2023-07-21T23:08:49.795 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.796 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "devicehealth", 2023-07-21T23:08:49.796 INFO:teuthology.orchestra.run.smithi151.stdout: "addrvec": [ 2023-07-21T23:08:49.796 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.796 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v2", 2023-07-21T23:08:49.796 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-07-21T23:08:49.796 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 4224162866 2023-07-21T23:08:49.796 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.796 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "libcephsqlite", 2023-07-21T23:08:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: "addrvec": [ 2023-07-21T23:08:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v2", 2023-07-21T23:08:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-07-21T23:08:49.797 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 291905791 2023-07-21T23:08:49.798 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.798 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:49.798 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.798 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "rbd_support", 2023-07-21T23:08:49.798 INFO:teuthology.orchestra.run.smithi151.stdout: "addrvec": [ 2023-07-21T23:08:49.798 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.798 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v2", 2023-07-21T23:08:49.799 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-07-21T23:08:49.799 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 2241756531 2023-07-21T23:08:49.799 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.799 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:49.799 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.799 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.799 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "snap_schedule", 2023-07-21T23:08:49.799 INFO:teuthology.orchestra.run.smithi151.stdout: "addrvec": [ 2023-07-21T23:08:49.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.800 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v2", 2023-07-21T23:08:49.800 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-07-21T23:08:49.800 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 1949944885 2023-07-21T23:08:49.800 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.800 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:49.800 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.800 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.801 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "snap_schedule", 2023-07-21T23:08:49.801 INFO:teuthology.orchestra.run.smithi151.stdout: "addrvec": [ 2023-07-21T23:08:49.801 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.801 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v2", 2023-07-21T23:08:49.801 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-07-21T23:08:49.801 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 2118860598 2023-07-21T23:08:49.801 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.802 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:49.802 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:49.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.802 INFO:teuthology.orchestra.run.smithi151.stdout: "name": "volumes", 2023-07-21T23:08:49.802 INFO:teuthology.orchestra.run.smithi151.stdout: "addrvec": [ 2023-07-21T23:08:49.802 INFO:teuthology.orchestra.run.smithi151.stdout: { 2023-07-21T23:08:49.802 INFO:teuthology.orchestra.run.smithi151.stdout: "type": "v2", 2023-07-21T23:08:49.802 INFO:teuthology.orchestra.run.smithi151.stdout: "addr": "172.21.15.151:0", 2023-07-21T23:08:49.803 INFO:teuthology.orchestra.run.smithi151.stdout: "nonce": 2404825016 2023-07-21T23:08:49.803 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.803 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:49.803 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:49.803 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2023-07-21T23:08:49.803 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T23:08:49.804 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:47 smithi195 ceph-mon[97365]: pgmap v1578: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 206 KiB/s wr, 22 op/s 2023-07-21T23:08:49.805 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:47 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:49.805 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:47 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3064109884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T23:08:49.805 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:47 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2430367523' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T23:08:49.805 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:48 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/632475127' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-07-21T23:08:49.805 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:48 smithi195 ceph-mon[97365]: pgmap v1579: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 207 KiB/s wr, 23 op/s 2023-07-21T23:08:49.805 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:47 smithi187 ceph-mon[96918]: pgmap v1578: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 206 KiB/s wr, 22 op/s 2023-07-21T23:08:49.806 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:47 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:49.806 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:47 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3064109884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T23:08:49.806 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:47 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2430367523' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T23:08:49.806 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:48 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/632475127' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-07-21T23:08:49.806 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:48 smithi187 ceph-mon[96918]: pgmap v1579: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 207 KiB/s wr, 23 op/s 2023-07-21T23:08:49.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98a00a1380 msgr2=0x7f98a00a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:49.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98a00a1380 0x7f98a00a3830 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f98a80098c0 tx=0x7f98a8019040 comp rx=0 tx=0).stop 2023-07-21T23:08:49.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98b81004a0 msgr2=0x7f98b8072d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:08:49.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98b81004a0 0x7f98b8072d50 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00e9a0 tx=0x7f98ac00ecb0 comp rx=0 tx=0).stop 2023-07-21T23:08:49.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 shutdown_connections 2023-07-21T23:08:49.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f98a00a1380 0x7f98a00a3830 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:49.807 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98b8105b00 0x7f98b81a3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:49.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f98b80ffaf0 0x7f98b8072810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:49.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 --2- 172.21.15.151:0/632475127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98b81004a0 0x7f98b8072d50 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:08:49.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 >> 172.21.15.151:0/632475127 conn(0x7f98b80fb630 msgr2=0x7f98b80fbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:08:49.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 shutdown_connections 2023-07-21T23:08:49.808 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:08:47.451+0000 7f98bc9ff700 1 -- 172.21.15.151:0/632475127 wait complete. 2023-07-21T23:08:49.815 DEBUG:tasks.check_counter:Getting stats from a 2023-07-21T23:08:49.815 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.a perf dump 2023-07-21T23:08:49.816 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:47 smithi151 ceph-mon[95510]: pgmap v1578: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 206 KiB/s wr, 22 op/s 2023-07-21T23:08:49.816 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:47 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:49.816 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:47 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3064109884' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T23:08:49.817 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:47 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2430367523' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T23:08:49.817 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:48 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/632475127' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2023-07-21T23:08:49.817 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:48 smithi151 ceph-mon[95510]: pgmap v1579: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 235 KiB/s rd, 207 KiB/s wr, 23 op/s 2023-07-21T23:08:50.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:50 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:50.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:50 smithi187 ceph-mon[96918]: pgmap v1580: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 389 KiB/s wr, 32 op/s 2023-07-21T23:08:50.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:50 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:50.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:50 smithi195 ceph-mon[97365]: pgmap v1580: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 389 KiB/s wr, 32 op/s 2023-07-21T23:08:50.653 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T23:08:50.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:50 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:50.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:50 smithi151 ceph-mon[95510]: pgmap v1580: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 427 KiB/s rd, 389 KiB/s wr, 32 op/s 2023-07-21T23:08:52.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:52 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:52.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:52 smithi195 ceph-mon[97365]: pgmap v1581: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 253 KiB/s wr, 19 op/s 2023-07-21T23:08:52.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:52 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:52.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:52 smithi151 ceph-mon[95510]: pgmap v1581: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 253 KiB/s wr, 19 op/s 2023-07-21T23:08:52.866 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:52 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:08:52.867 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:52 smithi187 ceph-mon[96918]: pgmap v1581: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 294 KiB/s rd, 253 KiB/s wr, 19 op/s 2023-07-21T23:08:53.302 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T23:08:53.302 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:08:53.302 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 4, 2023-07-21T23:08:53.303 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 4, 2023-07-21T23:08:53.303 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 2960, 2023-07-21T23:08:53.303 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 448, 2023-07-21T23:08:53.303 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 4, 2023-07-21T23:08:53.303 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 0, 2023-07-21T23:08:53.303 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.004169033, 2023-07-21T23:08:53.303 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.000075699, 2023-07-21T23:08:53.303 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.001236360, 2023-07-21T23:08:53.304 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:08:53.304 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:08:53.304 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3, 2023-07-21T23:08:53.304 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001204030, 2023-07-21T23:08:53.304 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000401343 2023-07-21T23:08:53.304 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.304 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:08:53.305 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:53.305 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:53.305 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:53.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.305 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-21T23:08:53.305 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 448 2023-07-21T23:08:53.305 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.306 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:08:53.306 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 5, 2023-07-21T23:08:53.306 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 630, 2023-07-21T23:08:53.306 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 800, 2023-07-21T23:08:53.306 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 489952, 2023-07-21T23:08:53.306 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 8, 2023-07-21T23:08:53.306 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2023-07-21T23:08:53.306 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.053381354, 2023-07-21T23:08:53.307 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.040235819, 2023-07-21T23:08:53.307 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.004416113, 2023-07-21T23:08:53.307 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:08:53.307 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:08:53.307 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 627, 2023-07-21T23:08:53.307 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.057492136, 2023-07-21T23:08:53.307 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000091693 2023-07-21T23:08:53.307 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.308 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:08:53.308 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:53.308 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:53.308 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:53.308 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.308 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 800, 2023-07-21T23:08:53.308 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 489952 2023-07-21T23:08:53.309 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.309 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:08:53.309 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 830, 2023-07-21T23:08:53.309 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 820, 2023-07-21T23:08:53.309 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1596960, 2023-07-21T23:08:53.310 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 472224, 2023-07-21T23:08:53.310 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 2, 2023-07-21T23:08:53.310 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 1, 2023-07-21T23:08:53.310 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.134011829, 2023-07-21T23:08:53.310 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.060555055, 2023-07-21T23:08:53.310 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.052022944, 2023-07-21T23:08:53.310 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.018975806, 2023-07-21T23:08:53.311 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:08:53.311 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 819, 2023-07-21T23:08:53.311 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.118048597, 2023-07-21T23:08:53.311 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000144137 2023-07-21T23:08:53.311 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.311 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:08:53.311 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:53.311 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:53.312 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:53.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.312 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1596960, 2023-07-21T23:08:53.312 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 472224 2023-07-21T23:08:53.312 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.312 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2023-07-21T23:08:53.312 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 0, 2023-07-21T23:08:53.312 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2023-07-21T23:08:53.313 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.313 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2023-07-21T23:08:53.313 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:08:53.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2023-07-21T23:08:53.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:08:53.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:08:53.314 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:08:53.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:08:53.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:08:53.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:08:53.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:08:53.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:08:53.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:08:53.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:08:53.315 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:08:53.316 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:08:53.316 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:08:53.316 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2023-07-21T23:08:53.316 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:08:53.316 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2023-07-21T23:08:53.316 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:08:53.316 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:08:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:08:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:08:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:08:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:08:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:08:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2023-07-21T23:08:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:08:53.317 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:08:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:08:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2023-07-21T23:08:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2023-07-21T23:08:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2023-07-21T23:08:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:08:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:08:53.318 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:08:53.319 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:08:53.319 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 148731, 2023-07-21T23:08:53.319 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 31, 2023-07-21T23:08:53.319 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:08:53.319 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2023-07-21T23:08:53.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2023-07-21T23:08:53.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2023-07-21T23:08:53.319 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:08:53.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2023-07-21T23:08:53.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:08:53.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2023-07-21T23:08:53.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 0, 2023-07-21T23:08:53.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 0, 2023-07-21T23:08:53.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:08:53.320 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:08:53.321 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2023-07-21T23:08:53.321 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2023-07-21T23:08:53.321 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 928, 2023-07-21T23:08:53.321 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 2, 2023-07-21T23:08:53.321 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2023-07-21T23:08:53.321 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2023-07-21T23:08:53.321 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2023-07-21T23:08:53.321 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2023-07-21T23:08:53.322 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:53.322 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:08:53.322 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2023-07-21T23:08:53.322 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2023-07-21T23:08:53.322 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2023-07-21T23:08:53.322 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 835, 2023-07-21T23:08:53.322 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1479577, 2023-07-21T23:08:53.322 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2023-07-21T23:08:53.323 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 835, 2023-07-21T23:08:53.323 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2023-07-21T23:08:53.323 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2023-07-21T23:08:53.323 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 835, 2023-07-21T23:08:53.324 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1479577, 2023-07-21T23:08:53.324 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2023-07-21T23:08:53.324 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:53.324 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:53.325 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:53.325 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:53.325 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:53.325 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T23:08:53.747 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2023-07-21T23:08:53.747 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2023-07-21T23:08:53.748 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2023-07-21T23:08:53.748 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2023-07-21T23:08:53.748 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2023-07-21T23:08:53.748 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2023-07-21T23:08:53.748 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2023-07-21T23:08:53.748 DEBUG:tasks.check_counter:Getting stats from d 2023-07-21T23:08:53.749 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.d perf dump 2023-07-21T23:08:54.488 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T23:08:55.393 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:55 smithi151 ceph-mon[95510]: pgmap v1582: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 395 KiB/s wr, 26 op/s 2023-07-21T23:08:55.394 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:55 smithi195 ceph-mon[97365]: pgmap v1582: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 395 KiB/s wr, 26 op/s 2023-07-21T23:08:55.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:55 smithi187 ceph-mon[96918]: pgmap v1582: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 395 KiB/s wr, 26 op/s 2023-07-21T23:08:56.079 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T23:08:56.080 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:08:56.080 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 0, 2023-07-21T23:08:56.080 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 2, 2023-07-21T23:08:56.080 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 0, 2023-07-21T23:08:56.080 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 0, 2023-07-21T23:08:56.080 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 4, 2023-07-21T23:08:56.081 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 0, 2023-07-21T23:08:56.081 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.003382713, 2023-07-21T23:08:56.081 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.000000000, 2023-07-21T23:08:56.081 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.000608857, 2023-07-21T23:08:56.081 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:08:56.081 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:08:56.081 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:56.081 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:56.082 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:56.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.082 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:08:56.082 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:56.082 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:56.082 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:56.082 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.083 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-21T23:08:56.083 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 0 2023-07-21T23:08:56.083 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.083 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:08:56.083 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 837, 2023-07-21T23:08:56.083 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 827, 2023-07-21T23:08:56.083 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1598192, 2023-07-21T23:08:56.083 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 475936, 2023-07-21T23:08:56.084 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 2, 2023-07-21T23:08:56.084 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 1, 2023-07-21T23:08:56.084 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.135814600, 2023-07-21T23:08:56.084 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.060761354, 2023-07-21T23:08:56.084 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.054122746, 2023-07-21T23:08:56.084 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.019203322, 2023-07-21T23:08:56.084 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:08:56.085 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 826, 2023-07-21T23:08:56.085 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.084229228, 2023-07-21T23:08:56.085 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000101972 2023-07-21T23:08:56.085 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.085 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:08:56.085 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:56.085 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:56.086 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:56.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.086 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1598192, 2023-07-21T23:08:56.086 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 475936 2023-07-21T23:08:56.086 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.086 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:08:56.086 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 9, 2023-07-21T23:08:56.086 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 636, 2023-07-21T23:08:56.087 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 3760, 2023-07-21T23:08:56.087 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 491104, 2023-07-21T23:08:56.087 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 8, 2023-07-21T23:08:56.087 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2023-07-21T23:08:56.087 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.052386884, 2023-07-21T23:08:56.087 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.040094145, 2023-07-21T23:08:56.087 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.004885394, 2023-07-21T23:08:56.087 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:08:56.088 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:08:56.088 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 634, 2023-07-21T23:08:56.088 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.055710691, 2023-07-21T23:08:56.088 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000087871 2023-07-21T23:08:56.088 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.088 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:08:56.088 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:56.089 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:56.089 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:56.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.089 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 3760, 2023-07-21T23:08:56.089 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 491104 2023-07-21T23:08:56.089 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.089 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2023-07-21T23:08:56.090 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 0, 2023-07-21T23:08:56.090 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2023-07-21T23:08:56.090 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.090 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2023-07-21T23:08:56.091 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:08:56.091 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2023-07-21T23:08:56.091 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:08:56.092 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:08:56.092 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:08:56.092 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:08:56.092 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:08:56.093 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:08:56.093 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:08:56.093 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:08:56.094 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:08:56.094 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:08:56.094 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:08:56.095 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:08:56.095 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:08:56.095 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2023-07-21T23:08:56.095 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:08:56.096 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2023-07-21T23:08:56.096 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:08:56.096 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:08:56.097 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:08:56.097 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:08:56.097 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:08:56.097 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:08:56.098 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:08:56.098 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2023-07-21T23:08:56.098 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:08:56.098 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:08:56.098 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:08:56.098 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2023-07-21T23:08:56.099 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2023-07-21T23:08:56.099 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2023-07-21T23:08:56.099 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:08:56.100 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:08:56.100 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:08:56.100 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:08:56.100 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 150776, 2023-07-21T23:08:56.101 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 32, 2023-07-21T23:08:56.101 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:08:56.101 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2023-07-21T23:08:56.101 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2023-07-21T23:08:56.101 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2023-07-21T23:08:56.101 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:08:56.101 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2023-07-21T23:08:56.102 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:08:56.102 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2023-07-21T23:08:56.102 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 0, 2023-07-21T23:08:56.102 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 0, 2023-07-21T23:08:56.102 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:08:56.102 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:08:56.102 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2023-07-21T23:08:56.102 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2023-07-21T23:08:56.103 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 928, 2023-07-21T23:08:56.103 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 2, 2023-07-21T23:08:56.103 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2023-07-21T23:08:56.103 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2023-07-21T23:08:56.103 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2023-07-21T23:08:56.103 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2023-07-21T23:08:56.103 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:56.103 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:08:56.104 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2023-07-21T23:08:56.104 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2023-07-21T23:08:56.104 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2023-07-21T23:08:56.105 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 842, 2023-07-21T23:08:56.105 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1479814, 2023-07-21T23:08:56.105 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2023-07-21T23:08:56.105 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 842, 2023-07-21T23:08:56.105 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2023-07-21T23:08:56.105 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2023-07-21T23:08:56.105 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 842, 2023-07-21T23:08:56.106 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1479814, 2023-07-21T23:08:56.106 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2023-07-21T23:08:56.106 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:56.106 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:56.106 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:56.106 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:56.106 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:56.107 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T23:08:56.483 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2023-07-21T23:08:56.483 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2023-07-21T23:08:56.484 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2023-07-21T23:08:56.484 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2023-07-21T23:08:56.484 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2023-07-21T23:08:56.484 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2023-07-21T23:08:56.484 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2023-07-21T23:08:56.485 DEBUG:tasks.check_counter:Getting stats from g 2023-07-21T23:08:56.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.g perf dump 2023-07-21T23:08:57.210 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T23:08:57.394 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:57 smithi195 ceph-mon[97365]: pgmap v1583: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 324 KiB/s wr, 18 op/s 2023-07-21T23:08:57.436 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:57 smithi151 ceph-mon[95510]: pgmap v1583: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 324 KiB/s wr, 18 op/s 2023-07-21T23:08:57.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:57 smithi187 ceph-mon[96918]: pgmap v1583: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 324 KiB/s wr, 18 op/s 2023-07-21T23:08:58.779 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T23:08:58.779 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:08:58.779 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 4, 2023-07-21T23:08:58.779 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 4, 2023-07-21T23:08:58.780 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 2960, 2023-07-21T23:08:58.780 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 448, 2023-07-21T23:08:58.780 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 4, 2023-07-21T23:08:58.780 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 0, 2023-07-21T23:08:58.780 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.003953410, 2023-07-21T23:08:58.780 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.000066956, 2023-07-21T23:08:58.781 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.001020245, 2023-07-21T23:08:58.781 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:08:58.781 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:08:58.781 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3, 2023-07-21T23:08:58.781 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001336878, 2023-07-21T23:08:58.781 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000445626 2023-07-21T23:08:58.781 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.782 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:08:58.782 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:58.782 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:58.782 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:58.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.782 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-21T23:08:58.782 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 448 2023-07-21T23:08:58.782 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.783 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:08:58.783 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 832, 2023-07-21T23:08:58.783 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 822, 2023-07-21T23:08:58.783 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1597504, 2023-07-21T23:08:58.783 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 473408, 2023-07-21T23:08:58.783 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 2, 2023-07-21T23:08:58.783 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 1, 2023-07-21T23:08:58.784 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.133425290, 2023-07-21T23:08:58.784 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.059572468, 2023-07-21T23:08:58.784 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.052655481, 2023-07-21T23:08:58.784 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.018697299, 2023-07-21T23:08:58.784 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:08:58.785 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 821, 2023-07-21T23:08:58.785 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.063877333, 2023-07-21T23:08:58.785 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000077804 2023-07-21T23:08:58.785 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.785 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:08:58.786 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:58.786 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:58.786 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:58.786 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.787 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1597504, 2023-07-21T23:08:58.787 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 473408 2023-07-21T23:08:58.787 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.787 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:08:58.787 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 5, 2023-07-21T23:08:58.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 632, 2023-07-21T23:08:58.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 800, 2023-07-21T23:08:58.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 490304, 2023-07-21T23:08:58.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 8, 2023-07-21T23:08:58.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2023-07-21T23:08:58.788 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.051424534, 2023-07-21T23:08:58.789 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.039429443, 2023-07-21T23:08:58.789 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.004116643, 2023-07-21T23:08:58.789 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:08:58.789 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:08:58.790 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 629, 2023-07-21T23:08:58.790 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.069363400, 2023-07-21T23:08:58.790 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000110275 2023-07-21T23:08:58.790 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.790 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:08:58.791 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:58.791 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:58.791 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:58.791 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.791 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 800, 2023-07-21T23:08:58.792 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 490304 2023-07-21T23:08:58.792 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.792 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2023-07-21T23:08:58.792 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 0, 2023-07-21T23:08:58.793 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2023-07-21T23:08:58.793 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.793 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2023-07-21T23:08:58.793 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:08:58.793 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2023-07-21T23:08:58.794 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:08:58.794 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:08:58.794 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:08:58.794 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:08:58.795 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:08:58.795 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:08:58.795 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:08:58.795 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:08:58.795 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:08:58.796 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:08:58.796 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:08:58.796 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:08:58.796 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:08:58.797 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2023-07-21T23:08:58.797 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:08:58.797 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2023-07-21T23:08:58.797 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:08:58.797 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:08:58.797 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:08:58.798 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:08:58.798 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:08:58.798 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:08:58.798 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:08:58.798 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2023-07-21T23:08:58.799 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:08:58.799 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:08:58.799 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:08:58.799 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2023-07-21T23:08:58.799 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2023-07-21T23:08:58.799 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2023-07-21T23:08:58.799 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:08:58.800 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:08:58.800 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:08:58.800 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:08:58.800 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 148714, 2023-07-21T23:08:58.800 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 30, 2023-07-21T23:08:58.801 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:08:58.801 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2023-07-21T23:08:58.801 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2023-07-21T23:08:58.801 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2023-07-21T23:08:58.802 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:08:58.802 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2023-07-21T23:08:58.802 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:08:58.802 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2023-07-21T23:08:58.802 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 0, 2023-07-21T23:08:58.802 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 0, 2023-07-21T23:08:58.803 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:08:58.803 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:08:58.803 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2023-07-21T23:08:58.803 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2023-07-21T23:08:58.804 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 928, 2023-07-21T23:08:58.804 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 2, 2023-07-21T23:08:58.804 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2023-07-21T23:08:58.804 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2023-07-21T23:08:58.804 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2023-07-21T23:08:58.804 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2023-07-21T23:08:58.804 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:08:58.805 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:08:58.805 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2023-07-21T23:08:58.805 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2023-07-21T23:08:58.805 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2023-07-21T23:08:58.805 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 837, 2023-07-21T23:08:58.805 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1479837, 2023-07-21T23:08:58.805 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2023-07-21T23:08:58.805 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 837, 2023-07-21T23:08:58.806 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2023-07-21T23:08:58.806 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2023-07-21T23:08:58.806 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 837, 2023-07-21T23:08:58.806 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1479837, 2023-07-21T23:08:58.806 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2023-07-21T23:08:58.806 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:08:58.806 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:08:58.806 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:08:58.807 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:58.807 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:08:58.807 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T23:08:59.297 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2023-07-21T23:08:59.297 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2023-07-21T23:08:59.298 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2023-07-21T23:08:59.298 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2023-07-21T23:08:59.298 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2023-07-21T23:08:59.298 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2023-07-21T23:08:59.298 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2023-07-21T23:08:59.298 DEBUG:tasks.check_counter:Getting stats from j 2023-07-21T23:08:59.299 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.j perf dump 2023-07-21T23:08:59.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:08:59 smithi187 ceph-mon[96918]: pgmap v1584: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 324 KiB/s wr, 18 op/s 2023-07-21T23:08:59.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:08:59 smithi195 ceph-mon[97365]: pgmap v1584: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 324 KiB/s wr, 18 op/s 2023-07-21T23:08:59.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:08:59 smithi151 ceph-mon[95510]: pgmap v1584: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 338 KiB/s rd, 324 KiB/s wr, 18 op/s 2023-07-21T23:09:00.030 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.a/config 2023-07-21T23:09:01.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:01 smithi151 ceph-mon[95510]: pgmap v1585: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 388 KiB/s wr, 21 op/s 2023-07-21T23:09:01.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:01 smithi187 ceph-mon[96918]: pgmap v1585: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 388 KiB/s wr, 21 op/s 2023-07-21T23:09:01.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:01 smithi195 ceph-mon[97365]: pgmap v1585: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 388 KiB/s wr, 21 op/s 2023-07-21T23:09:01.819 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2023-07-21T23:09:01.820 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:09:01.820 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 4, 2023-07-21T23:09:01.820 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 4, 2023-07-21T23:09:01.820 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 2960, 2023-07-21T23:09:01.820 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 448, 2023-07-21T23:09:01.820 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 4, 2023-07-21T23:09:01.821 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 0, 2023-07-21T23:09:01.821 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.003897632, 2023-07-21T23:09:01.821 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.000069835, 2023-07-21T23:09:01.821 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.001107716, 2023-07-21T23:09:01.821 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:09:01.821 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:01.821 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3, 2023-07-21T23:09:01.822 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001343689, 2023-07-21T23:09:01.822 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000447896 2023-07-21T23:09:01.822 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.822 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:01.822 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:09:01.822 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:09:01.823 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:09:01.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.823 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-21T23:09:01.823 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 448 2023-07-21T23:09:01.823 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.823 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:09:01.824 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 5, 2023-07-21T23:09:01.824 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 636, 2023-07-21T23:09:01.824 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 800, 2023-07-21T23:09:01.824 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 491008, 2023-07-21T23:09:01.824 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 8, 2023-07-21T23:09:01.824 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2023-07-21T23:09:01.825 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.058279538, 2023-07-21T23:09:01.825 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.045853926, 2023-07-21T23:09:01.825 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.004508063, 2023-07-21T23:09:01.825 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:09:01.825 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:01.825 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 633, 2023-07-21T23:09:01.826 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.055338018, 2023-07-21T23:09:01.826 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000087421 2023-07-21T23:09:01.826 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.826 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:01.826 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:09:01.826 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:09:01.826 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:09:01.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.827 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 800, 2023-07-21T23:09:01.827 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 491008 2023-07-21T23:09:01.827 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.827 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:09:01.827 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 839, 2023-07-21T23:09:01.828 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 829, 2023-07-21T23:09:01.828 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1599472, 2023-07-21T23:09:01.828 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 477120, 2023-07-21T23:09:01.828 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 2, 2023-07-21T23:09:01.828 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 1, 2023-07-21T23:09:01.828 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.138826181, 2023-07-21T23:09:01.828 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.061916649, 2023-07-21T23:09:01.829 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.055369052, 2023-07-21T23:09:01.829 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.019412384, 2023-07-21T23:09:01.829 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:01.829 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 828, 2023-07-21T23:09:01.829 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.076028228, 2023-07-21T23:09:01.830 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000091821 2023-07-21T23:09:01.830 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.830 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:01.830 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:09:01.831 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:09:01.831 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:09:01.831 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.831 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1599472, 2023-07-21T23:09:01.832 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 477120 2023-07-21T23:09:01.832 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.832 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2023-07-21T23:09:01.832 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 0, 2023-07-21T23:09:01.832 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2023-07-21T23:09:01.833 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.833 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2023-07-21T23:09:01.833 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:09:01.833 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2023-07-21T23:09:01.833 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:09:01.833 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:09:01.833 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:09:01.834 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:09:01.834 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:09:01.834 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:09:01.834 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:09:01.834 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:09:01.835 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:09:01.835 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:09:01.835 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:09:01.835 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:09:01.835 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:09:01.836 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2023-07-21T23:09:01.836 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:09:01.836 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2023-07-21T23:09:01.836 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:09:01.836 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:09:01.837 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:09:01.837 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:09:01.837 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:09:01.837 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:09:01.837 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:09:01.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2023-07-21T23:09:01.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:09:01.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:09:01.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:09:01.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2023-07-21T23:09:01.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2023-07-21T23:09:01.838 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2023-07-21T23:09:01.839 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:09:01.839 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:09:01.839 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:09:01.839 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:09:01.839 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 148748, 2023-07-21T23:09:01.839 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 32, 2023-07-21T23:09:01.839 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:09:01.839 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2023-07-21T23:09:01.840 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2023-07-21T23:09:01.840 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2023-07-21T23:09:01.840 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:09:01.840 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2023-07-21T23:09:01.840 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:09:01.840 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2023-07-21T23:09:01.841 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 0, 2023-07-21T23:09:01.841 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 0, 2023-07-21T23:09:01.841 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:09:01.841 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:09:01.841 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2023-07-21T23:09:01.841 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2023-07-21T23:09:01.842 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 928, 2023-07-21T23:09:01.842 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 2, 2023-07-21T23:09:01.842 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2023-07-21T23:09:01.842 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2023-07-21T23:09:01.842 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2023-07-21T23:09:01.843 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2023-07-21T23:09:01.843 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2023-07-21T23:09:01.843 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:09:01.843 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2023-07-21T23:09:01.844 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2023-07-21T23:09:01.844 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2023-07-21T23:09:01.844 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 844, 2023-07-21T23:09:01.845 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1480811, 2023-07-21T23:09:01.845 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:01.845 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 844, 2023-07-21T23:09:01.845 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2023-07-21T23:09:01.846 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2023-07-21T23:09:01.846 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 844, 2023-07-21T23:09:01.846 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1480811, 2023-07-21T23:09:01.847 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2023-07-21T23:09:01.847 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2023-07-21T23:09:01.847 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2023-07-21T23:09:01.847 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2023-07-21T23:09:01.848 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:09:01.848 INFO:teuthology.orchestra.run.smithi151.stdout: } 2023-07-21T23:09:01.848 INFO:teuthology.orchestra.run.smithi151.stdout:} 2023-07-21T23:09:02.233 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2023-07-21T23:09:02.233 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2023-07-21T23:09:02.233 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2023-07-21T23:09:02.234 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2023-07-21T23:09:02.234 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2023-07-21T23:09:02.234 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2023-07-21T23:09:02.234 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2023-07-21T23:09:02.234 DEBUG:tasks.check_counter:Getting stats from b 2023-07-21T23:09:02.235 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.b perf dump 2023-07-21T23:09:03.069 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T23:09:03.460 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:03 smithi187 ceph-mon[96918]: pgmap v1586: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 206 KiB/s wr, 12 op/s 2023-07-21T23:09:03.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:03 smithi195 ceph-mon[97365]: pgmap v1586: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 206 KiB/s wr, 12 op/s 2023-07-21T23:09:03.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:03 smithi151 ceph-mon[95510]: pgmap v1586: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 206 KiB/s rd, 206 KiB/s wr, 12 op/s 2023-07-21T23:09:04.968 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-07-21T23:09:04.969 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:09:04.969 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 599139, 2023-07-21T23:09:04.969 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 340788, 2023-07-21T23:09:04.970 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 165310767, 2023-07-21T23:09:04.970 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 124817371, 2023-07-21T23:09:04.970 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 499, 2023-07-21T23:09:04.970 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 5, 2023-07-21T23:09:04.970 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 33.604633327, 2023-07-21T23:09:04.971 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 13.527011558, 2023-07-21T23:09:04.971 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 26.366662469, 2023-07-21T23:09:04.971 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.651555134, 2023-07-21T23:09:04.971 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:04.972 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 340787, 2023-07-21T23:09:04.972 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 21.595631522, 2023-07-21T23:09:04.972 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000063369 2023-07-21T23:09:04.973 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.973 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:04.973 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 910243, 2023-07-21T23:09:04.973 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.136197787, 2023-07-21T23:09:04.974 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000149 2023-07-21T23:09:04.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.974 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 2136656, 2023-07-21T23:09:04.974 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 524992 2023-07-21T23:09:04.974 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.975 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:09:04.975 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 278530, 2023-07-21T23:09:04.975 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 499990, 2023-07-21T23:09:04.975 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 95129135, 2023-07-21T23:09:04.975 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 217739948, 2023-07-21T23:09:04.975 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 16, 2023-07-21T23:09:04.975 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 5, 2023-07-21T23:09:04.976 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 27.176455289, 2023-07-21T23:09:04.976 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 12.372433328, 2023-07-21T23:09:04.976 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 15.686912562, 2023-07-21T23:09:04.976 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.470622725, 2023-07-21T23:09:04.976 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:04.976 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 499988, 2023-07-21T23:09:04.976 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 37.896695245, 2023-07-21T23:09:04.977 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000075795 2023-07-21T23:09:04.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.977 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:04.977 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 606427, 2023-07-21T23:09:04.977 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.141445496, 2023-07-21T23:09:04.977 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000233 2023-07-21T23:09:04.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.978 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 102864, 2023-07-21T23:09:04.978 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 1322592 2023-07-21T23:09:04.978 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.978 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:09:04.978 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 363789, 2023-07-21T23:09:04.978 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 222305, 2023-07-21T23:09:04.979 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 107059202, 2023-07-21T23:09:04.979 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 79539821, 2023-07-21T23:09:04.979 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 26, 2023-07-21T23:09:04.979 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 6, 2023-07-21T23:09:04.980 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 27.785769577, 2023-07-21T23:09:04.980 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 13.736927452, 2023-07-21T23:09:04.980 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 18.876103478, 2023-07-21T23:09:04.980 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.576279709, 2023-07-21T23:09:04.980 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:04.980 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 222303, 2023-07-21T23:09:04.980 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 12.162717664, 2023-07-21T23:09:04.981 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000054712 2023-07-21T23:09:04.981 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.981 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:04.981 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 566616, 2023-07-21T23:09:04.981 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.091781795, 2023-07-21T23:09:04.982 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000161 2023-07-21T23:09:04.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.982 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 1575872, 2023-07-21T23:09:04.982 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 552944 2023-07-21T23:09:04.982 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.982 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2023-07-21T23:09:04.982 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2023-07-21T23:09:04.983 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2023-07-21T23:09:04.983 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.983 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2023-07-21T23:09:04.983 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-07-21T23:09:04.983 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-07-21T23:09:04.983 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 32989, 2023-07-21T23:09:04.983 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 11.997352567, 2023-07-21T23:09:04.984 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000363677 2023-07-21T23:09:04.984 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:04.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.984 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2023-07-21T23:09:04.984 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-07-21T23:09:04.984 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-07-21T23:09:04.984 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1734, 2023-07-21T23:09:04.985 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.075590988, 2023-07-21T23:09:04.985 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000043593 2023-07-21T23:09:04.985 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:04.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.986 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2023-07-21T23:09:04.986 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 29950, 2023-07-21T23:09:04.986 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 26358, 2023-07-21T23:09:04.987 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2023-07-21T23:09:04.987 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 26358, 2023-07-21T23:09:04.987 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 454.102837111, 2023-07-21T23:09:04.987 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.017228273 2023-07-21T23:09:04.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:04.988 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2023-07-21T23:09:04.989 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 3592, 2023-07-21T23:09:04.989 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 14, 2023-07-21T23:09:04.989 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 1, 2023-07-21T23:09:04.989 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 1983, 2023-07-21T23:09:04.990 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 3, 2023-07-21T23:09:04.990 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 0, 2023-07-21T23:09:04.990 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 1359, 2023-07-21T23:09:04.990 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 276, 2023-07-21T23:09:04.991 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 1071, 2023-07-21T23:09:04.991 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 12, 2023-07-21T23:09:04.991 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 960, 2023-07-21T23:09:04.991 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 3665, 2023-07-21T23:09:04.992 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 294, 2023-07-21T23:09:04.992 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 295, 2023-07-21T23:09:04.992 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 34, 2023-07-21T23:09:04.993 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 79564, 2023-07-21T23:09:04.993 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 67643, 2023-07-21T23:09:04.993 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 3432, 2023-07-21T23:09:04.993 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 341, 2023-07-21T23:09:04.994 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 2, 2023-07-21T23:09:04.994 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2023-07-21T23:09:04.994 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 4383, 2023-07-21T23:09:04.994 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 8414, 2023-07-21T23:09:04.995 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2023-07-21T23:09:04.995 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 51, 2023-07-21T23:09:04.995 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 3202, 2023-07-21T23:09:04.996 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 62, 2023-07-21T23:09:04.996 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 3803, 2023-07-21T23:09:04.996 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2023-07-21T23:09:04.996 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 2375, 2023-07-21T23:09:04.997 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2023-07-21T23:09:04.997 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 1045, 2023-07-21T23:09:04.997 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 8989162071, 2023-07-21T23:09:04.998 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 7, 2023-07-21T23:09:04.998 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 2375, 2023-07-21T23:09:04.998 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2023-07-21T23:09:04.998 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2023-07-21T23:09:04.999 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2023-07-21T23:09:04.999 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 163, 2023-07-21T23:09:04.999 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 6, 2023-07-21T23:09:05.000 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 157, 2023-07-21T23:09:05.000 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 2212, 2023-07-21T23:09:05.000 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 674, 2023-07-21T23:09:05.000 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 226638, 2023-07-21T23:09:05.001 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 220558, 2023-07-21T23:09:05.001 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 0, 2023-07-21T23:09:05.001 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-21T23:09:05.001 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-21T23:09:05.002 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 239883, 2023-07-21T23:09:05.002 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 10477, 2023-07-21T23:09:05.002 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 359, 2023-07-21T23:09:05.002 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 2422 2023-07-21T23:09:05.003 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.003 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2023-07-21T23:09:05.003 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 32, 2023-07-21T23:09:05.003 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 118, 2023-07-21T23:09:05.004 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 67, 2023-07-21T23:09:05.004 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 401, 2023-07-21T23:09:05.004 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 334, 2023-07-21T23:09:05.005 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 0, 2023-07-21T23:09:05.005 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2023-07-21T23:09:05.005 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2023-07-21T23:09:05.005 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 583, 2023-07-21T23:09:05.006 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 359, 2023-07-21T23:09:05.006 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 1116, 2023-07-21T23:09:05.006 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 79, 2023-07-21T23:09:05.007 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2023-07-21T23:09:05.007 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2023-07-21T23:09:05.007 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2023-07-21T23:09:05.007 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2023-07-21T23:09:05.007 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2023-07-21T23:09:05.008 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 6, 2023-07-21T23:09:05.008 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 52, 2023-07-21T23:09:05.008 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2023-07-21T23:09:05.009 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 3, 2023-07-21T23:09:05.009 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2023-07-21T23:09:05.009 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0 2023-07-21T23:09:05.009 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.010 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2023-07-21T23:09:05.010 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 22301, 2023-07-21T23:09:05.010 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 22166, 2023-07-21T23:09:05.010 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 22166, 2023-07-21T23:09:05.011 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 135, 2023-07-21T23:09:05.011 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2023-07-21T23:09:05.011 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 176, 2023-07-21T23:09:05.011 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 244, 2023-07-21T23:09:05.012 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 243, 2023-07-21T23:09:05.012 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 243, 2023-07-21T23:09:05.012 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 3, 2023-07-21T23:09:05.012 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2023-07-21T23:09:05.012 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 2, 2023-07-21T23:09:05.012 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 92549595, 2023-07-21T23:09:05.012 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 93610577, 2023-07-21T23:09:05.013 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 0, 2023-07-21T23:09:05.013 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2023-07-21T23:09:05.013 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 14029, 2023-07-21T23:09:05.013 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 69.331951718, 2023-07-21T23:09:05.013 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.004942045 2023-07-21T23:09:05.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.013 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 0 2023-07-21T23:09:05.013 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2023-07-21T23:09:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 603, 2023-07-21T23:09:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 4018, 2023-07-21T23:09:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 3415, 2023-07-21T23:09:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 120, 2023-07-21T23:09:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 249, 2023-07-21T23:09:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 129, 2023-07-21T23:09:05.014 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 1362, 2023-07-21T23:09:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 5959, 2023-07-21T23:09:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 4597, 2023-07-21T23:09:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 295, 2023-07-21T23:09:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 3361, 2023-07-21T23:09:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 3066, 2023-07-21T23:09:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 75288, 2023-07-21T23:09:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 207156 2023-07-21T23:09:05.015 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2023-07-21T23:09:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 66197, 2023-07-21T23:09:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 9770, 2023-07-21T23:09:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 29950, 2023-07-21T23:09:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 354, 2023-07-21T23:09:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 22431, 2023-07-21T23:09:05.016 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2023-07-21T23:09:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 593, 2023-07-21T23:09:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.722846024, 2023-07-21T23:09:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001218964 2023-07-21T23:09:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2023-07-21T23:09:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1266, 2023-07-21T23:09:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.063886327, 2023-07-21T23:09:05.017 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000840352 2023-07-21T23:09:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2023-07-21T23:09:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2023-07-21T23:09:05.018 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 219, 2023-07-21T23:09:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 2.591666022, 2023-07-21T23:09:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.011834091 2023-07-21T23:09:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2023-07-21T23:09:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 13573, 2023-07-21T23:09:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 182.031052005, 2023-07-21T23:09:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.013411261 2023-07-21T23:09:05.019 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2023-07-21T23:09:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2023-07-21T23:09:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.020 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2023-07-21T23:09:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.021 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2023-07-21T23:09:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2023-07-21T23:09:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.022 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2023-07-21T23:09:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 50, 2023-07-21T23:09:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.010315034, 2023-07-21T23:09:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000206300 2023-07-21T23:09:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.023 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2023-07-21T23:09:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 32, 2023-07-21T23:09:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.037459367, 2023-07-21T23:09:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001170605 2023-07-21T23:09:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2023-07-21T23:09:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.024 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2023-07-21T23:09:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 50, 2023-07-21T23:09:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 10.720932894, 2023-07-21T23:09:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.214418657 2023-07-21T23:09:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2023-07-21T23:09:05.025 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 8655, 2023-07-21T23:09:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 4.220912886, 2023-07-21T23:09:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000487684 2023-07-21T23:09:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2023-07-21T23:09:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 88, 2023-07-21T23:09:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.094057437, 2023-07-21T23:09:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001068834 2023-07-21T23:09:05.026 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2023-07-21T23:09:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1538, 2023-07-21T23:09:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 246.736327274, 2023-07-21T23:09:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.160426740 2023-07-21T23:09:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2023-07-21T23:09:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.027 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2023-07-21T23:09:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.028 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2023-07-21T23:09:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2023-07-21T23:09:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 43, 2023-07-21T23:09:05.029 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 4.508038412, 2023-07-21T23:09:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.104838102 2023-07-21T23:09:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2023-07-21T23:09:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.030 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2023-07-21T23:09:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1, 2023-07-21T23:09:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.001534172, 2023-07-21T23:09:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001534172 2023-07-21T23:09:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2023-07-21T23:09:05.031 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2023-07-21T23:09:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.032 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2023-07-21T23:09:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2023-07-21T23:09:05.033 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 6, 2023-07-21T23:09:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.019051276, 2023-07-21T23:09:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.003175212 2023-07-21T23:09:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2023-07-21T23:09:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.034 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2023-07-21T23:09:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 244, 2023-07-21T23:09:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.344757981, 2023-07-21T23:09:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.005511303 2023-07-21T23:09:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2023-07-21T23:09:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2023-07-21T23:09:05.035 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2023-07-21T23:09:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2023-07-21T23:09:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 2, 2023-07-21T23:09:05.036 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 5, 2023-07-21T23:09:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 3, 2023-07-21T23:09:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 2, 2023-07-21T23:09:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2023-07-21T23:09:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 1240, 2023-07-21T23:09:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 620, 2023-07-21T23:09:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 2978 2023-07-21T23:09:05.037 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2023-07-21T23:09:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:09:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2023-07-21T23:09:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:09:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:09:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:09:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:09:05.038 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:09:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:09:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:09:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:09:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:09:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:09:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:09:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:09:05.039 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:09:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2023-07-21T23:09:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:09:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2023-07-21T23:09:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:09:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:09:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:09:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:09:05.040 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:09:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:09:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:09:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2023-07-21T23:09:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:09:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:09:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:09:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2023-07-21T23:09:05.041 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2023-07-21T23:09:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2023-07-21T23:09:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:09:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:09:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:09:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:09:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 882647, 2023-07-21T23:09:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 257, 2023-07-21T23:09:05.042 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:09:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 0, 2023-07-21T23:09:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2023-07-21T23:09:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2023-07-21T23:09:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:09:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2023-07-21T23:09:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:09:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2023-07-21T23:09:05.043 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 7944, 2023-07-21T23:09:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 166, 2023-07-21T23:09:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:09:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:09:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2023-07-21T23:09:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2023-07-21T23:09:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 2983094, 2023-07-21T23:09:05.044 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 78747, 2023-07-21T23:09:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2023-07-21T23:09:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2023-07-21T23:09:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2023-07-21T23:09:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2023-07-21T23:09:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2023-07-21T23:09:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2023-07-21T23:09:05.045 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2023-07-21T23:09:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 23118, 2023-07-21T23:09:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 97731318, 2023-07-21T23:09:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 37, 2023-07-21T23:09:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 23118, 2023-07-21T23:09:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2023-07-21T23:09:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 23118, 2023-07-21T23:09:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 189.532053918, 2023-07-21T23:09:05.046 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.008198462 2023-07-21T23:09:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2023-07-21T23:09:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2023-07-21T23:09:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 23118, 2023-07-21T23:09:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 30628 2023-07-21T23:09:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 23118, 2023-07-21T23:09:05.047 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 2673, 2023-07-21T23:09:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 20445, 2023-07-21T23:09:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2023-07-21T23:09:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2023-07-21T23:09:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 1915, 2023-07-21T23:09:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 1513, 2023-07-21T23:09:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 254, 2023-07-21T23:09:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 14277, 2023-07-21T23:09:05.048 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 1030, 2023-07-21T23:09:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2023-07-21T23:09:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2023-07-21T23:09:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 0, 2023-07-21T23:09:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 3, 2023-07-21T23:09:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 913, 2023-07-21T23:09:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2023-07-21T23:09:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2023-07-21T23:09:05.049 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2023-07-21T23:09:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 2395, 2023-07-21T23:09:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 3026, 2023-07-21T23:09:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2023-07-21T23:09:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2023-07-21T23:09:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2023-07-21T23:09:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2023-07-21T23:09:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2023-07-21T23:09:05.050 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2023-07-21T23:09:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2023-07-21T23:09:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2023-07-21T23:09:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2023-07-21T23:09:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 0, 2023-07-21T23:09:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2023-07-21T23:09:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2023-07-21T23:09:05.051 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2023-07-21T23:09:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2023-07-21T23:09:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2023-07-21T23:09:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2023-07-21T23:09:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2023-07-21T23:09:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2023-07-21T23:09:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2023-07-21T23:09:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2023-07-21T23:09:05.052 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2023-07-21T23:09:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2023-07-21T23:09:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2023-07-21T23:09:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2023-07-21T23:09:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2023-07-21T23:09:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2023-07-21T23:09:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 175, 2023-07-21T23:09:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2023-07-21T23:09:05.053 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 91, 2023-07-21T23:09:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 12, 2023-07-21T23:09:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 12, 2023-07-21T23:09:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 0, 2023-07-21T23:09:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2023-07-21T23:09:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 4757, 2023-07-21T23:09:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 53, 2023-07-21T23:09:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 492 2023-07-21T23:09:05.054 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2023-07-21T23:09:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 1, 2023-07-21T23:09:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2023-07-21T23:09:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2023-07-21T23:09:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2023-07-21T23:09:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "osd-slow-ops": { 2023-07-21T23:09:05.055 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 35824 2023-07-21T23:09:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2023-07-21T23:09:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2023-07-21T23:09:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 8, 2023-07-21T23:09:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2023-07-21T23:09:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 8, 2023-07-21T23:09:05.056 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 359, 2023-07-21T23:09:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2023-07-21T23:09:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:09:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-07-21T23:09:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 1241454, 2023-07-21T23:09:05.057 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 255530139, 2023-07-21T23:09:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 1241454, 2023-07-21T23:09:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 1241454, 2023-07-21T23:09:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 255530139, 2023-07-21T23:09:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:05.058 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2023-07-21T23:09:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-07-21T23:09:05.059 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 23118, 2023-07-21T23:09:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 97767734, 2023-07-21T23:09:05.060 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 23118, 2023-07-21T23:09:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 97767734, 2023-07-21T23:09:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.061 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2023-07-21T23:09:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2023-07-21T23:09:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:05.062 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 23118, 2023-07-21T23:09:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 23118, 2023-07-21T23:09:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 23118, 2023-07-21T23:09:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 23118, 2023-07-21T23:09:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.063 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2023-07-21T23:09:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-07-21T23:09:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 359, 2023-07-21T23:09:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 37379, 2023-07-21T23:09:05.064 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 359, 2023-07-21T23:09:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 248, 2023-07-21T23:09:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 37379, 2023-07-21T23:09:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.065 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x55f0b1a140a0": { 2023-07-21T23:09:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 60, 2023-07-21T23:09:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-07-21T23:09:05.066 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 22301, 2023-07-21T23:09:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 89416273, 2023-07-21T23:09:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 22301, 2023-07-21T23:09:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 14029, 2023-07-21T23:09:05.067 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 89416213, 2023-07-21T23:09:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:05.068 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:05.068 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-07-21T23:09:05.366 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:05 smithi187 ceph-mon[96918]: pgmap v1587: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 258 KiB/s wr, 30 op/s 2023-07-21T23:09:05.473 INFO:tasks.check_counter:Daemon mds.b mds.exported=51 2023-07-21T23:09:05.474 INFO:tasks.check_counter:Daemon mds.b mds.imported=62 2023-07-21T23:09:05.474 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=32 2023-07-21T23:09:05.474 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=118 2023-07-21T23:09:05.474 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=7 2023-07-21T23:09:05.474 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=50 2023-07-21T23:09:05.475 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=43 2023-07-21T23:09:05.475 DEBUG:tasks.check_counter:Getting stats from e 2023-07-21T23:09:05.475 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.e perf dump 2023-07-21T23:09:05.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:05 smithi195 ceph-mon[97365]: pgmap v1587: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 258 KiB/s wr, 30 op/s 2023-07-21T23:09:05.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:05 smithi151 ceph-mon[95510]: pgmap v1587: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 224 KiB/s rd, 258 KiB/s wr, 30 op/s 2023-07-21T23:09:06.235 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T23:09:07.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:07 smithi187 ceph-mon[96918]: pgmap v1588: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 117 KiB/s wr, 23 op/s 2023-07-21T23:09:07.624 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-07-21T23:09:07.624 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:09:07.624 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 6239, 2023-07-21T23:09:07.624 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 6241, 2023-07-21T23:09:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 27038316, 2023-07-21T23:09:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 1940336, 2023-07-21T23:09:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 7, 2023-07-21T23:09:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 2, 2023-07-21T23:09:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.649971823, 2023-07-21T23:09:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.225315231, 2023-07-21T23:09:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.190304969, 2023-07-21T23:09:07.625 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.173823889, 2023-07-21T23:09:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 6239, 2023-07-21T23:09:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.345896254, 2023-07-21T23:09:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000055440 2023-07-21T23:09:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:07.626 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-21T23:09:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 0 2023-07-21T23:09:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.627 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:09:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 3252, 2023-07-21T23:09:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 3145, 2023-07-21T23:09:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 21630580, 2023-07-21T23:09:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 1184736, 2023-07-21T23:09:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 7, 2023-07-21T23:09:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 4, 2023-07-21T23:09:07.628 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.389812224, 2023-07-21T23:09:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.137211672, 2023-07-21T23:09:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.151222023, 2023-07-21T23:09:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.082179127, 2023-07-21T23:09:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 3144, 2023-07-21T23:09:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.248367770, 2023-07-21T23:09:07.629 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000078997 2023-07-21T23:09:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 2067088, 2023-07-21T23:09:07.630 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 493632 2023-07-21T23:09:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:09:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 1682, 2023-07-21T23:09:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 2312, 2023-07-21T23:09:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 8805688, 2023-07-21T23:09:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 1792589, 2023-07-21T23:09:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 12, 2023-07-21T23:09:07.631 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 4, 2023-07-21T23:09:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.206299777, 2023-07-21T23:09:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.080022884, 2023-07-21T23:09:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.048771815, 2023-07-21T23:09:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.054915869, 2023-07-21T23:09:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2310, 2023-07-21T23:09:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.175255253, 2023-07-21T23:09:07.632 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000075868 2023-07-21T23:09:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 3440, 2023-07-21T23:09:07.633 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 1271664 2023-07-21T23:09:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.636 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2023-07-21T23:09:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2023-07-21T23:09:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2023-07-21T23:09:07.637 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2023-07-21T23:09:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-07-21T23:09:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-07-21T23:09:07.638 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 16927, 2023-07-21T23:09:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.448595683, 2023-07-21T23:09:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000026501 2023-07-21T23:09:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2023-07-21T23:09:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-07-21T23:09:07.639 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-07-21T23:09:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2023-07-21T23:09:07.640 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 0, 2023-07-21T23:09:07.641 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 0, 2023-07-21T23:09:07.641 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2023-07-21T23:09:07.641 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.641 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.641 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.641 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2023-07-21T23:09:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 0, 2023-07-21T23:09:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 0, 2023-07-21T23:09:07.642 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 0, 2023-07-21T23:09:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 0, 2023-07-21T23:09:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 0, 2023-07-21T23:09:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 0, 2023-07-21T23:09:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 794, 2023-07-21T23:09:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 266, 2023-07-21T23:09:07.643 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 219, 2023-07-21T23:09:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 309, 2023-07-21T23:09:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 413, 2023-07-21T23:09:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 0, 2023-07-21T23:09:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 0, 2023-07-21T23:09:07.644 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 0, 2023-07-21T23:09:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 12, 2023-07-21T23:09:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 0, 2023-07-21T23:09:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 0, 2023-07-21T23:09:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 0, 2023-07-21T23:09:07.645 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 0, 2023-07-21T23:09:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 0, 2023-07-21T23:09:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2023-07-21T23:09:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 0, 2023-07-21T23:09:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 0, 2023-07-21T23:09:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2023-07-21T23:09:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 0, 2023-07-21T23:09:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 0, 2023-07-21T23:09:07.646 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 0, 2023-07-21T23:09:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 0, 2023-07-21T23:09:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2023-07-21T23:09:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 0, 2023-07-21T23:09:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2023-07-21T23:09:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 0, 2023-07-21T23:09:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 0, 2023-07-21T23:09:07.647 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 0, 2023-07-21T23:09:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 0, 2023-07-21T23:09:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2023-07-21T23:09:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2023-07-21T23:09:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2023-07-21T23:09:07.648 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 0, 2023-07-21T23:09:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 0, 2023-07-21T23:09:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 0, 2023-07-21T23:09:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 0, 2023-07-21T23:09:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 0, 2023-07-21T23:09:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 0, 2023-07-21T23:09:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 0, 2023-07-21T23:09:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 0, 2023-07-21T23:09:07.649 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-21T23:09:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-21T23:09:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 0, 2023-07-21T23:09:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 0, 2023-07-21T23:09:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 0, 2023-07-21T23:09:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 0 2023-07-21T23:09:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.650 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2023-07-21T23:09:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 0, 2023-07-21T23:09:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 0, 2023-07-21T23:09:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 0, 2023-07-21T23:09:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 0, 2023-07-21T23:09:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 0, 2023-07-21T23:09:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 0, 2023-07-21T23:09:07.651 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2023-07-21T23:09:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2023-07-21T23:09:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 0, 2023-07-21T23:09:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 0, 2023-07-21T23:09:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 0, 2023-07-21T23:09:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 0, 2023-07-21T23:09:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2023-07-21T23:09:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2023-07-21T23:09:07.652 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2023-07-21T23:09:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2023-07-21T23:09:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2023-07-21T23:09:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 0, 2023-07-21T23:09:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 0, 2023-07-21T23:09:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2023-07-21T23:09:07.653 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 0, 2023-07-21T23:09:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2023-07-21T23:09:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0 2023-07-21T23:09:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.654 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2023-07-21T23:09:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 0, 2023-07-21T23:09:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 0, 2023-07-21T23:09:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 0, 2023-07-21T23:09:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 0, 2023-07-21T23:09:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2023-07-21T23:09:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 0, 2023-07-21T23:09:07.655 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 0, 2023-07-21T23:09:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 0, 2023-07-21T23:09:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 0, 2023-07-21T23:09:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 22, 2023-07-21T23:09:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2023-07-21T23:09:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 0, 2023-07-21T23:09:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 4194304, 2023-07-21T23:09:07.656 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 0, 2023-07-21T23:09:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 56742556, 2023-07-21T23:09:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2023-07-21T23:09:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 17323 2023-07-21T23:09:07.657 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2023-07-21T23:09:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 498, 2023-07-21T23:09:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 2921, 2023-07-21T23:09:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 2423, 2023-07-21T23:09:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 28, 2023-07-21T23:09:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 132, 2023-07-21T23:09:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 104, 2023-07-21T23:09:07.658 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 794, 2023-07-21T23:09:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 3461, 2023-07-21T23:09:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 2667, 2023-07-21T23:09:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 0, 2023-07-21T23:09:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 0, 2023-07-21T23:09:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 0, 2023-07-21T23:09:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 56268, 2023-07-21T23:09:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 207156 2023-07-21T23:09:07.659 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2023-07-21T23:09:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 0, 2023-07-21T23:09:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 0, 2023-07-21T23:09:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 0, 2023-07-21T23:09:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 0, 2023-07-21T23:09:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 0, 2023-07-21T23:09:07.660 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2023-07-21T23:09:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2023-07-21T23:09:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.661 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2023-07-21T23:09:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.662 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2023-07-21T23:09:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2023-07-21T23:09:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.663 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2023-07-21T23:09:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.664 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2023-07-21T23:09:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2023-07-21T23:09:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.665 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2023-07-21T23:09:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2023-07-21T23:09:07.666 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2023-07-21T23:09:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.667 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2023-07-21T23:09:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2023-07-21T23:09:07.668 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2023-07-21T23:09:07.669 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.670 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2023-07-21T23:09:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.671 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2023-07-21T23:09:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.672 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2023-07-21T23:09:07.673 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.674 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2023-07-21T23:09:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.675 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2023-07-21T23:09:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.676 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2023-07-21T23:09:07.677 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.678 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2023-07-21T23:09:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.679 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2023-07-21T23:09:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2023-07-21T23:09:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.680 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2023-07-21T23:09:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.681 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2023-07-21T23:09:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.682 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2023-07-21T23:09:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.683 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2023-07-21T23:09:07.684 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2023-07-21T23:09:07.685 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.686 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2023-07-21T23:09:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.687 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2023-07-21T23:09:07.688 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2023-07-21T23:09:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2023-07-21T23:09:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.689 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.690 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2023-07-21T23:09:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 2, 2023-07-21T23:09:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 4, 2023-07-21T23:09:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 2, 2023-07-21T23:09:07.691 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 4, 2023-07-21T23:09:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2023-07-21T23:09:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 0, 2023-07-21T23:09:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 0, 2023-07-21T23:09:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 6528 2023-07-21T23:09:07.692 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2023-07-21T23:09:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:09:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2023-07-21T23:09:07.693 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:09:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:09:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:09:07.694 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:09:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:09:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:09:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:09:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:09:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:09:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:09:07.695 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:09:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:09:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:09:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2023-07-21T23:09:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:09:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2023-07-21T23:09:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:09:07.696 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:09:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:09:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:09:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:09:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:09:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:09:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2023-07-21T23:09:07.697 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:09:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:09:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:09:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2023-07-21T23:09:07.698 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2023-07-21T23:09:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2023-07-21T23:09:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:09:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:09:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:09:07.699 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:09:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 225559, 2023-07-21T23:09:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 74, 2023-07-21T23:09:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:09:07.700 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 0, 2023-07-21T23:09:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2023-07-21T23:09:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2023-07-21T23:09:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:09:07.701 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2023-07-21T23:09:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:09:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2023-07-21T23:09:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 7944, 2023-07-21T23:09:07.702 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 166, 2023-07-21T23:09:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:09:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:09:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2023-07-21T23:09:07.703 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2023-07-21T23:09:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 1723209, 2023-07-21T23:09:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 4195, 2023-07-21T23:09:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2023-07-21T23:09:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2023-07-21T23:09:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2023-07-21T23:09:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2023-07-21T23:09:07.704 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2023-07-21T23:09:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2023-07-21T23:09:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2023-07-21T23:09:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 10136, 2023-07-21T23:09:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 21, 2023-07-21T23:09:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 3, 2023-07-21T23:09:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 10136, 2023-07-21T23:09:07.705 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2023-07-21T23:09:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 10136, 2023-07-21T23:09:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 10.846834548, 2023-07-21T23:09:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001070129 2023-07-21T23:09:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2023-07-21T23:09:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2023-07-21T23:09:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 10136, 2023-07-21T23:09:07.706 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 10137 2023-07-21T23:09:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 10136, 2023-07-21T23:09:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 10136, 2023-07-21T23:09:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 0, 2023-07-21T23:09:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2023-07-21T23:09:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2023-07-21T23:09:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 6106, 2023-07-21T23:09:07.707 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 0, 2023-07-21T23:09:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 4028, 2023-07-21T23:09:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 0, 2023-07-21T23:09:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 0, 2023-07-21T23:09:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2023-07-21T23:09:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2023-07-21T23:09:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 0, 2023-07-21T23:09:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 0, 2023-07-21T23:09:07.708 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 0, 2023-07-21T23:09:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2023-07-21T23:09:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2023-07-21T23:09:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2023-07-21T23:09:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 1, 2023-07-21T23:09:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 0, 2023-07-21T23:09:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2023-07-21T23:09:07.709 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2023-07-21T23:09:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2023-07-21T23:09:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2023-07-21T23:09:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2023-07-21T23:09:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2023-07-21T23:09:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2023-07-21T23:09:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2023-07-21T23:09:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2023-07-21T23:09:07.710 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 0, 2023-07-21T23:09:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2023-07-21T23:09:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2023-07-21T23:09:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2023-07-21T23:09:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2023-07-21T23:09:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2023-07-21T23:09:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2023-07-21T23:09:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2023-07-21T23:09:07.711 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2023-07-21T23:09:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2023-07-21T23:09:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2023-07-21T23:09:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2023-07-21T23:09:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2023-07-21T23:09:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2023-07-21T23:09:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2023-07-21T23:09:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2023-07-21T23:09:07.712 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2023-07-21T23:09:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 175, 2023-07-21T23:09:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2023-07-21T23:09:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 90, 2023-07-21T23:09:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 9, 2023-07-21T23:09:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 14, 2023-07-21T23:09:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 5, 2023-07-21T23:09:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2023-07-21T23:09:07.713 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 0, 2023-07-21T23:09:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 2, 2023-07-21T23:09:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 0 2023-07-21T23:09:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2023-07-21T23:09:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 0, 2023-07-21T23:09:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2023-07-21T23:09:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2023-07-21T23:09:07.714 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2023-07-21T23:09:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "osd-slow-ops": { 2023-07-21T23:09:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 0 2023-07-21T23:09:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2023-07-21T23:09:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2023-07-21T23:09:07.715 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 0, 2023-07-21T23:09:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2023-07-21T23:09:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 0, 2023-07-21T23:09:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 0, 2023-07-21T23:09:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2023-07-21T23:09:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:09:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:07.716 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-07-21T23:09:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 11169, 2023-07-21T23:09:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 56414313, 2023-07-21T23:09:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 11169, 2023-07-21T23:09:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:07.717 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 11169, 2023-07-21T23:09:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 56414313, 2023-07-21T23:09:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.718 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2023-07-21T23:09:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-07-21T23:09:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:07.719 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 10136, 2023-07-21T23:09:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 52579222, 2023-07-21T23:09:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 10136, 2023-07-21T23:09:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 52579222, 2023-07-21T23:09:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.720 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2023-07-21T23:09:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2023-07-21T23:09:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:07.721 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 10136, 2023-07-21T23:09:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 10136, 2023-07-21T23:09:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 10136, 2023-07-21T23:09:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 10136, 2023-07-21T23:09:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:07.722 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2023-07-21T23:09:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-07-21T23:09:07.723 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:07.724 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 0, 2023-07-21T23:09:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 0, 2023-07-21T23:09:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:07.725 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x561717f72500": { 2023-07-21T23:09:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-07-21T23:09:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:07.726 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 0, 2023-07-21T23:09:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 0, 2023-07-21T23:09:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:07.727 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:07.728 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:07.728 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-07-21T23:09:07.728 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:07 smithi151 ceph-mon[95510]: pgmap v1588: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 117 KiB/s wr, 23 op/s 2023-07-21T23:09:07.729 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:07 smithi195 ceph-mon[97365]: pgmap v1588: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 117 KiB/s wr, 23 op/s 2023-07-21T23:09:08.011 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2023-07-21T23:09:08.011 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2023-07-21T23:09:08.012 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2023-07-21T23:09:08.012 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2023-07-21T23:09:08.012 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2023-07-21T23:09:08.012 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2023-07-21T23:09:08.012 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2023-07-21T23:09:08.013 DEBUG:tasks.check_counter:Getting stats from h 2023-07-21T23:09:08.013 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.h perf dump 2023-07-21T23:09:08.741 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T23:09:09.368 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:09 smithi187 ceph-mon[96918]: pgmap v1589: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 117 KiB/s wr, 23 op/s 2023-07-21T23:09:09.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:09 smithi195 ceph-mon[97365]: pgmap v1589: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 117 KiB/s wr, 23 op/s 2023-07-21T23:09:09.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:09 smithi151 ceph-mon[95510]: pgmap v1589: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 117 KiB/s wr, 23 op/s 2023-07-21T23:09:10.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:10 smithi187 ceph-mon[96918]: osdmap e176: 12 total, 12 up, 12 in 2023-07-21T23:09:10.647 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:10 smithi195 ceph-mon[97365]: osdmap e176: 12 total, 12 up, 12 in 2023-07-21T23:09:10.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:10 smithi151 ceph-mon[95510]: osdmap e176: 12 total, 12 up, 12 in 2023-07-21T23:09:11.626 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:11 smithi187 ceph-mon[96918]: pgmap v1591: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 66 KiB/s wr, 24 op/s 2023-07-21T23:09:11.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:11 smithi195 ceph-mon[97365]: pgmap v1591: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 66 KiB/s wr, 24 op/s 2023-07-21T23:09:11.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:11 smithi151 ceph-mon[95510]: pgmap v1591: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 66 KiB/s wr, 24 op/s 2023-07-21T23:09:13.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:13 smithi187 ceph-mon[96918]: pgmap v1592: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 66 KiB/s wr, 24 op/s 2023-07-21T23:09:13.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:13 smithi195 ceph-mon[97365]: pgmap v1592: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 66 KiB/s wr, 24 op/s 2023-07-21T23:09:13.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:13 smithi151 ceph-mon[95510]: pgmap v1592: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 66 KiB/s wr, 24 op/s 2023-07-21T23:09:15.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:15 smithi187 ceph-mon[96918]: pgmap v1593: 97 pgs: 14 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 54 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2023-07-21T23:09:15.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:15 smithi195 ceph-mon[97365]: pgmap v1593: 97 pgs: 14 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 54 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2023-07-21T23:09:15.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:15 smithi151 ceph-mon[95510]: pgmap v1593: 97 pgs: 14 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 54 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2023-07-21T23:09:17.133 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-07-21T23:09:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:09:17.133 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 221035, 2023-07-21T23:09:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 359953, 2023-07-21T23:09:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 54405291, 2023-07-21T23:09:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 277834985, 2023-07-21T23:09:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 13, 2023-07-21T23:09:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 4, 2023-07-21T23:09:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 27.424081062, 2023-07-21T23:09:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 14.252506232, 2023-07-21T23:09:17.134 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 14.964791560, 2023-07-21T23:09:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.439752870, 2023-07-21T23:09:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 359953, 2023-07-21T23:09:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 20.245016879, 2023-07-21T23:09:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000056243 2023-07-21T23:09:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.135 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 538047, 2023-07-21T23:09:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.117819518, 2023-07-21T23:09:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000218 2023-07-21T23:09:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 6880, 2023-07-21T23:09:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 59088 2023-07-21T23:09:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.136 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:09:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 213730, 2023-07-21T23:09:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 304994, 2023-07-21T23:09:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 65958918, 2023-07-21T23:09:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 303757329, 2023-07-21T23:09:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 17, 2023-07-21T23:09:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 7, 2023-07-21T23:09:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 19.954420654, 2023-07-21T23:09:17.137 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 8.703892784, 2023-07-21T23:09:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 12.665706280, 2023-07-21T23:09:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.238254787, 2023-07-21T23:09:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 304992, 2023-07-21T23:09:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 22.857394549, 2023-07-21T23:09:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000074944 2023-07-21T23:09:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.138 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 479145, 2023-07-21T23:09:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.113501623, 2023-07-21T23:09:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000236 2023-07-21T23:09:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 2081216, 2023-07-21T23:09:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 529728 2023-07-21T23:09:17.139 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:09:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 1166077, 2023-07-21T23:09:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 1175068, 2023-07-21T23:09:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 196704682, 2023-07-21T23:09:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 308990625, 2023-07-21T23:09:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 24, 2023-07-21T23:09:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 6, 2023-07-21T23:09:17.140 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 53.062562310, 2023-07-21T23:09:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 21.729269789, 2023-07-21T23:09:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 36.644042777, 2023-07-21T23:09:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.099403277, 2023-07-21T23:09:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1175065, 2023-07-21T23:09:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 19.612824241, 2023-07-21T23:09:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000016690 2023-07-21T23:09:17.141 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2330776, 2023-07-21T23:09:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.230437319, 2023-07-21T23:09:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000098 2023-07-21T23:09:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 3984, 2023-07-21T23:09:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 1365488 2023-07-21T23:09:17.142 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2023-07-21T23:09:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2023-07-21T23:09:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2023-07-21T23:09:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2023-07-21T23:09:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-07-21T23:09:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-07-21T23:09:17.143 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 24894, 2023-07-21T23:09:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 11.348390125, 2023-07-21T23:09:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000455868 2023-07-21T23:09:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2023-07-21T23:09:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-07-21T23:09:17.144 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-07-21T23:09:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 274, 2023-07-21T23:09:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.013014494, 2023-07-21T23:09:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000047498 2023-07-21T23:09:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2023-07-21T23:09:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 109382, 2023-07-21T23:09:17.145 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 105587, 2023-07-21T23:09:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2023-07-21T23:09:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 105587, 2023-07-21T23:09:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 755.075951074, 2023-07-21T23:09:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.007151220 2023-07-21T23:09:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2023-07-21T23:09:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 3792, 2023-07-21T23:09:17.146 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 30, 2023-07-21T23:09:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 0, 2023-07-21T23:09:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 54, 2023-07-21T23:09:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 5, 2023-07-21T23:09:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 3, 2023-07-21T23:09:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 1128, 2023-07-21T23:09:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 46, 2023-07-21T23:09:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 75, 2023-07-21T23:09:17.147 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 1007, 2023-07-21T23:09:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 1020, 2023-07-21T23:09:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 5157, 2023-07-21T23:09:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 444, 2023-07-21T23:09:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 444, 2023-07-21T23:09:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 40, 2023-07-21T23:09:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 248168, 2023-07-21T23:09:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 233784, 2023-07-21T23:09:17.148 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 3588, 2023-07-21T23:09:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 327, 2023-07-21T23:09:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 9, 2023-07-21T23:09:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2023-07-21T23:09:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 6351, 2023-07-21T23:09:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 1620, 2023-07-21T23:09:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2023-07-21T23:09:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 104, 2023-07-21T23:09:17.149 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 3933, 2023-07-21T23:09:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 90, 2023-07-21T23:09:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 3996, 2023-07-21T23:09:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2023-07-21T23:09:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 375, 2023-07-21T23:09:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2023-07-21T23:09:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 1041, 2023-07-21T23:09:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 7795082488, 2023-07-21T23:09:17.150 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 6, 2023-07-21T23:09:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 375, 2023-07-21T23:09:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2023-07-21T23:09:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2023-07-21T23:09:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2023-07-21T23:09:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 4, 2023-07-21T23:09:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 0, 2023-07-21T23:09:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 4, 2023-07-21T23:09:17.151 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 371, 2023-07-21T23:09:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 844, 2023-07-21T23:09:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 92166, 2023-07-21T23:09:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 81423, 2023-07-21T23:09:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 0, 2023-07-21T23:09:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-21T23:09:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-21T23:09:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 98178, 2023-07-21T23:09:17.152 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 9771, 2023-07-21T23:09:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 358, 2023-07-21T23:09:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 1014 2023-07-21T23:09:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2023-07-21T23:09:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 50, 2023-07-21T23:09:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 149, 2023-07-21T23:09:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 85, 2023-07-21T23:09:17.153 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 419, 2023-07-21T23:09:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 541, 2023-07-21T23:09:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 1, 2023-07-21T23:09:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2023-07-21T23:09:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2023-07-21T23:09:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 267, 2023-07-21T23:09:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 7, 2023-07-21T23:09:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 1375, 2023-07-21T23:09:17.154 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 109, 2023-07-21T23:09:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2023-07-21T23:09:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2023-07-21T23:09:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2023-07-21T23:09:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2023-07-21T23:09:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2023-07-21T23:09:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 0, 2023-07-21T23:09:17.155 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 112, 2023-07-21T23:09:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2023-07-21T23:09:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 8, 2023-07-21T23:09:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2023-07-21T23:09:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0 2023-07-21T23:09:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2023-07-21T23:09:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 20368, 2023-07-21T23:09:17.156 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 0, 2023-07-21T23:09:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 0, 2023-07-21T23:09:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 20368, 2023-07-21T23:09:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2023-07-21T23:09:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 0, 2023-07-21T23:09:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 114, 2023-07-21T23:09:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 0, 2023-07-21T23:09:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 0, 2023-07-21T23:09:17.157 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 114, 2023-07-21T23:09:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2023-07-21T23:09:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 0, 2023-07-21T23:09:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 4194304, 2023-07-21T23:09:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 468250773, 2023-07-21T23:09:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 0, 2023-07-21T23:09:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2023-07-21T23:09:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 12342, 2023-07-21T23:09:17.158 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 74.579113028, 2023-07-21T23:09:17.159 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.006042708 2023-07-21T23:09:17.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.159 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 0 2023-07-21T23:09:17.159 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.159 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2023-07-21T23:09:17.159 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 889, 2023-07-21T23:09:17.159 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 4529, 2023-07-21T23:09:17.159 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 3640, 2023-07-21T23:09:17.160 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 114, 2023-07-21T23:09:17.160 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 253, 2023-07-21T23:09:17.160 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 139, 2023-07-21T23:09:17.160 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 1129, 2023-07-21T23:09:17.160 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 6364, 2023-07-21T23:09:17.160 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 5235, 2023-07-21T23:09:17.160 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 444, 2023-07-21T23:09:17.160 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 3271, 2023-07-21T23:09:17.161 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 2827, 2023-07-21T23:09:17.161 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 75288, 2023-07-21T23:09:17.161 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 198964 2023-07-21T23:09:17.161 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.161 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2023-07-21T23:09:17.161 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 213649, 2023-07-21T23:09:17.161 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 13477, 2023-07-21T23:09:17.162 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 109382, 2023-07-21T23:09:17.162 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 454, 2023-07-21T23:09:17.162 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 22642, 2023-07-21T23:09:17.162 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2023-07-21T23:09:17.162 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 222, 2023-07-21T23:09:17.162 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.581838729, 2023-07-21T23:09:17.162 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002620895 2023-07-21T23:09:17.162 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.163 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2023-07-21T23:09:17.163 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 81940, 2023-07-21T23:09:17.163 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 113.062170895, 2023-07-21T23:09:17.163 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001379816 2023-07-21T23:09:17.163 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.163 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2023-07-21T23:09:17.163 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.163 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.164 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.164 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2023-07-21T23:09:17.164 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 267, 2023-07-21T23:09:17.164 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 3.059537552, 2023-07-21T23:09:17.164 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.011458942 2023-07-21T23:09:17.164 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.164 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2023-07-21T23:09:17.165 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 14225, 2023-07-21T23:09:17.165 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 419.970098466, 2023-07-21T23:09:17.165 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.029523381 2023-07-21T23:09:17.165 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.165 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2023-07-21T23:09:17.165 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.165 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.165 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.166 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2023-07-21T23:09:17.166 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.166 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.166 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.166 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.166 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2023-07-21T23:09:17.166 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.167 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.167 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.167 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2023-07-21T23:09:17.167 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.167 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.167 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.167 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.168 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2023-07-21T23:09:17.168 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.168 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.168 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.168 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.168 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2023-07-21T23:09:17.168 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.169 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.169 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.169 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2023-07-21T23:09:17.169 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1, 2023-07-21T23:09:17.169 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.001655319, 2023-07-21T23:09:17.169 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001655319 2023-07-21T23:09:17.169 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.170 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2023-07-21T23:09:17.170 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.170 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.170 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.170 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.170 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2023-07-21T23:09:17.170 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.170 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.171 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.171 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2023-07-21T23:09:17.171 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 6988, 2023-07-21T23:09:17.171 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 8.818814051, 2023-07-21T23:09:17.171 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001261993 2023-07-21T23:09:17.171 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.171 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2023-07-21T23:09:17.172 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 186, 2023-07-21T23:09:17.172 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.223494578, 2023-07-21T23:09:17.172 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.001201583 2023-07-21T23:09:17.172 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.172 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2023-07-21T23:09:17.172 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1491, 2023-07-21T23:09:17.172 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 207.961859386, 2023-07-21T23:09:17.173 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.139478108 2023-07-21T23:09:17.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.173 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2023-07-21T23:09:17.173 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.173 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.173 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.173 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.173 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2023-07-21T23:09:17.174 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.174 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.174 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.174 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.174 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2023-07-21T23:09:17.174 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.174 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.174 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.175 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2023-07-21T23:09:17.175 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.175 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.175 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.175 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.175 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2023-07-21T23:09:17.175 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.176 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.176 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.176 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2023-07-21T23:09:17.176 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.176 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.176 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.176 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.177 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2023-07-21T23:09:17.177 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.177 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.177 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.177 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.177 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2023-07-21T23:09:17.177 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.177 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.178 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.178 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2023-07-21T23:09:17.178 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.178 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.178 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.178 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.178 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2023-07-21T23:09:17.179 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.179 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.179 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.179 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.179 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2023-07-21T23:09:17.179 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.179 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.179 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.180 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2023-07-21T23:09:17.180 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 267, 2023-07-21T23:09:17.180 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 1.396482098, 2023-07-21T23:09:17.180 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.005230270 2023-07-21T23:09:17.180 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.180 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2023-07-21T23:09:17.180 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2023-07-21T23:09:17.181 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2023-07-21T23:09:17.181 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.181 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.181 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.181 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:17.181 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.181 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2023-07-21T23:09:17.181 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 2, 2023-07-21T23:09:17.182 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 4, 2023-07-21T23:09:17.182 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 2, 2023-07-21T23:09:17.182 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 2, 2023-07-21T23:09:17.182 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2023-07-21T23:09:17.182 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 1717, 2023-07-21T23:09:17.182 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 858, 2023-07-21T23:09:17.182 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 2990 2023-07-21T23:09:17.183 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.183 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2023-07-21T23:09:17.183 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:09:17.183 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2023-07-21T23:09:17.183 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:09:17.183 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:09:17.183 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:09:17.183 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:09:17.184 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:09:17.184 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:09:17.184 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:09:17.184 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:09:17.184 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:09:17.184 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:09:17.184 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:09:17.184 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:09:17.185 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:09:17.185 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2023-07-21T23:09:17.185 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:09:17.185 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2023-07-21T23:09:17.185 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:09:17.185 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:09:17.185 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:09:17.185 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:09:17.186 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:09:17.186 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:09:17.186 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:09:17.186 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2023-07-21T23:09:17.186 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:09:17.186 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:09:17.186 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:09:17.186 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2023-07-21T23:09:17.187 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2023-07-21T23:09:17.187 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2023-07-21T23:09:17.187 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:09:17.187 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:09:17.187 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:09:17.187 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:09:17.187 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 572442, 2023-07-21T23:09:17.187 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 184, 2023-07-21T23:09:17.188 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:09:17.188 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 0, 2023-07-21T23:09:17.188 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2023-07-21T23:09:17.188 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2023-07-21T23:09:17.188 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:09:17.188 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2023-07-21T23:09:17.188 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:09:17.188 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2023-07-21T23:09:17.189 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 8064, 2023-07-21T23:09:17.189 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 169, 2023-07-21T23:09:17.189 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:09:17.189 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:09:17.189 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2023-07-21T23:09:17.189 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2023-07-21T23:09:17.189 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 3474091, 2023-07-21T23:09:17.189 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 35072, 2023-07-21T23:09:17.190 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2023-07-21T23:09:17.190 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2023-07-21T23:09:17.190 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2023-07-21T23:09:17.190 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2023-07-21T23:09:17.190 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.190 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2023-07-21T23:09:17.190 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2023-07-21T23:09:17.190 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2023-07-21T23:09:17.191 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 13798, 2023-07-21T23:09:17.191 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 464507134, 2023-07-21T23:09:17.191 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 27, 2023-07-21T23:09:17.191 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 13798, 2023-07-21T23:09:17.191 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2023-07-21T23:09:17.191 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 13798, 2023-07-21T23:09:17.191 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 82.788743939, 2023-07-21T23:09:17.191 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.006000053 2023-07-21T23:09:17.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.192 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2023-07-21T23:09:17.192 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2023-07-21T23:09:17.192 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 13798, 2023-07-21T23:09:17.192 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 14444 2023-07-21T23:09:17.192 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.192 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 13798, 2023-07-21T23:09:17.192 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 467, 2023-07-21T23:09:17.193 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 13331, 2023-07-21T23:09:17.193 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2023-07-21T23:09:17.193 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2023-07-21T23:09:17.193 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 0, 2023-07-21T23:09:17.193 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 10, 2023-07-21T23:09:17.193 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 7, 2023-07-21T23:09:17.193 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 12349, 2023-07-21T23:09:17.193 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 197, 2023-07-21T23:09:17.194 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2023-07-21T23:09:17.194 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2023-07-21T23:09:17.194 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 1, 2023-07-21T23:09:17.194 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 1, 2023-07-21T23:09:17.194 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 384, 2023-07-21T23:09:17.194 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2023-07-21T23:09:17.194 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2023-07-21T23:09:17.194 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2023-07-21T23:09:17.195 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 377, 2023-07-21T23:09:17.195 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 20, 2023-07-21T23:09:17.195 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2023-07-21T23:09:17.195 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2023-07-21T23:09:17.195 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2023-07-21T23:09:17.195 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2023-07-21T23:09:17.195 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2023-07-21T23:09:17.195 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2023-07-21T23:09:17.196 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2023-07-21T23:09:17.196 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2023-07-21T23:09:17.196 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2023-07-21T23:09:17.196 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 0, 2023-07-21T23:09:17.196 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2023-07-21T23:09:17.196 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2023-07-21T23:09:17.196 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2023-07-21T23:09:17.197 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2023-07-21T23:09:17.197 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2023-07-21T23:09:17.197 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2023-07-21T23:09:17.197 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2023-07-21T23:09:17.197 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2023-07-21T23:09:17.197 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2023-07-21T23:09:17.197 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2023-07-21T23:09:17.197 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2023-07-21T23:09:17.197 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2023-07-21T23:09:17.198 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2023-07-21T23:09:17.198 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2023-07-21T23:09:17.198 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2023-07-21T23:09:17.198 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2023-07-21T23:09:17.199 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 176, 2023-07-21T23:09:17.199 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2023-07-21T23:09:17.199 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 91, 2023-07-21T23:09:17.199 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 12, 2023-07-21T23:09:17.199 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 17, 2023-07-21T23:09:17.199 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 5, 2023-07-21T23:09:17.199 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2023-07-21T23:09:17.199 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 724, 2023-07-21T23:09:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 115, 2023-07-21T23:09:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 259 2023-07-21T23:09:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2023-07-21T23:09:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 1, 2023-07-21T23:09:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2023-07-21T23:09:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2023-07-21T23:09:17.200 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2023-07-21T23:09:17.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.201 INFO:teuthology.orchestra.run.smithi187.stdout: "osd-slow-ops": { 2023-07-21T23:09:17.201 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 114918 2023-07-21T23:09:17.201 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.201 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2023-07-21T23:09:17.201 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2023-07-21T23:09:17.201 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 239, 2023-07-21T23:09:17.201 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2023-07-21T23:09:17.202 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 1, 2023-07-21T23:09:17.202 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 7, 2023-07-21T23:09:17.202 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2023-07-21T23:09:17.202 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.202 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:09:17.202 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:17.202 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-07-21T23:09:17.202 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:17.203 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 1600838, 2023-07-21T23:09:17.203 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 172934627, 2023-07-21T23:09:17.203 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:17.203 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 1600838, 2023-07-21T23:09:17.203 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:17.203 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:17.203 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 1600838, 2023-07-21T23:09:17.203 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 172934627, 2023-07-21T23:09:17.204 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:17.204 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.204 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.204 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.204 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:17.204 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.204 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2023-07-21T23:09:17.205 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:17.205 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-07-21T23:09:17.205 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:17.205 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:17.205 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:17.205 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:17.205 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:17.205 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 13798, 2023-07-21T23:09:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 464505904, 2023-07-21T23:09:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 13798, 2023-07-21T23:09:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 464505904, 2023-07-21T23:09:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.206 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:17.207 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.207 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2023-07-21T23:09:17.207 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:17.207 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2023-07-21T23:09:17.207 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:17.207 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:17.207 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:17.207 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:17.208 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:17.208 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 13798, 2023-07-21T23:09:17.208 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 13798, 2023-07-21T23:09:17.208 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 13798, 2023-07-21T23:09:17.208 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 13798, 2023-07-21T23:09:17.208 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:17.208 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.208 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.209 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.209 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:17.209 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.209 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2023-07-21T23:09:17.209 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:17.209 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-07-21T23:09:17.209 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:17.209 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 7, 2023-07-21T23:09:17.210 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 923, 2023-07-21T23:09:17.210 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:17.210 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 7, 2023-07-21T23:09:17.210 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:17.210 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:17.210 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 7, 2023-07-21T23:09:17.210 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 923, 2023-07-21T23:09:17.211 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:17.211 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.211 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.211 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.211 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:17.211 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:17.211 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x555f629ca0a0": { 2023-07-21T23:09:17.211 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:17.212 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-07-21T23:09:17.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:17.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 20368, 2023-07-21T23:09:17.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 464056469, 2023-07-21T23:09:17.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:17.212 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 20368, 2023-07-21T23:09:17.212 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:17.212 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:17.213 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 12342, 2023-07-21T23:09:17.213 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 464056469, 2023-07-21T23:09:17.213 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:17.213 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:17.213 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:17.213 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:17.213 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:17.213 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:17.214 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-07-21T23:09:17.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:17 smithi187 ceph-mon[96918]: pgmap v1594: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2023-07-21T23:09:17.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:17 smithi195 ceph-mon[97365]: pgmap v1594: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2023-07-21T23:09:17.655 INFO:tasks.check_counter:Daemon mds.h mds.exported=104 2023-07-21T23:09:17.655 INFO:tasks.check_counter:Daemon mds.h mds.imported=90 2023-07-21T23:09:17.655 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=50 2023-07-21T23:09:17.655 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=149 2023-07-21T23:09:17.656 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2023-07-21T23:09:17.656 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2023-07-21T23:09:17.656 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2023-07-21T23:09:17.656 DEBUG:tasks.check_counter:Getting stats from k 2023-07-21T23:09:17.656 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.k perf dump 2023-07-21T23:09:17.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:17 smithi151 ceph-mon[95510]: pgmap v1594: 97 pgs: 12 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 58 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2023-07-21T23:09:18.395 INFO:teuthology.orchestra.run.smithi187.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.b/config 2023-07-21T23:09:19.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:19 smithi187 ceph-mon[96918]: pgmap v1595: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2023-07-21T23:09:19.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:19 smithi195 ceph-mon[97365]: pgmap v1595: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2023-07-21T23:09:19.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:19 smithi151 ceph-mon[95510]: pgmap v1595: 97 pgs: 8 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 72 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 3.1 KiB/s wr, 6 op/s 2023-07-21T23:09:19.916 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-07-21T23:09:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:09:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 523, 2023-07-21T23:09:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 525, 2023-07-21T23:09:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 12592754, 2023-07-21T23:09:19.917 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 162669, 2023-07-21T23:09:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 7, 2023-07-21T23:09:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 3, 2023-07-21T23:09:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.074398081, 2023-07-21T23:09:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.013196066, 2023-07-21T23:09:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.037954243, 2023-07-21T23:09:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.015935759, 2023-07-21T23:09:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:19.918 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 523, 2023-07-21T23:09:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.071891438, 2023-07-21T23:09:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000137459 2023-07-21T23:09:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.919 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-21T23:09:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 0 2023-07-21T23:09:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:09:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 1779, 2023-07-21T23:09:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 1759, 2023-07-21T23:09:19.920 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 6150101, 2023-07-21T23:09:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 764226, 2023-07-21T23:09:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 5, 2023-07-21T23:09:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 4, 2023-07-21T23:09:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.246119722, 2023-07-21T23:09:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.098718551, 2023-07-21T23:09:19.921 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.086726210, 2023-07-21T23:09:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.048992447, 2023-07-21T23:09:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1758, 2023-07-21T23:09:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.181050252, 2023-07-21T23:09:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000102986 2023-07-21T23:09:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:19.922 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 1670064, 2023-07-21T23:09:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 484576 2023-07-21T23:09:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:09:19.923 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_messages": 960, 2023-07-21T23:09:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages": 1593, 2023-07-21T23:09:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_bytes": 18387418, 2023-07-21T23:09:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_bytes": 873528, 2023-07-21T23:09:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_created_connections": 10, 2023-07-21T23:09:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_active_connections": 6, 2023-07-21T23:09:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_total_time": 0.153365519, 2023-07-21T23:09:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_send_time": 0.051584415, 2023-07-21T23:09:19.924 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_recv_time": 0.058819305, 2023-07-21T23:09:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_running_fast_dispatch_time": 0.028106420, 2023-07-21T23:09:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 1591, 2023-07-21T23:09:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.170896604, 2023-07-21T23:09:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000107414 2023-07-21T23:09:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:19.925 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_recv_encrypted_bytes": 3600, 2023-07-21T23:09:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "msgr_send_encrypted_bytes": 577456 2023-07-21T23:09:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.926 INFO:teuthology.orchestra.run.smithi187.stdout: "cct": { 2023-07-21T23:09:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "total_workers": 1, 2023-07-21T23:09:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "unhealthy_workers": 0 2023-07-21T23:09:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-MDSRank": { 2023-07-21T23:09:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-07-21T23:09:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-07-21T23:09:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 3978, 2023-07-21T23:09:19.927 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.128609645, 2023-07-21T23:09:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000032330 2023-07-21T23:09:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "finisher-PurgeQueue": { 2023-07-21T23:09:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "queue_len": 0, 2023-07-21T23:09:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "complete_latency": { 2023-07-21T23:09:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.928 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "mds": { 2023-07-21T23:09:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "request": 0, 2023-07-21T23:09:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "reply": 0, 2023-07-21T23:09:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "reply_latency": { 2023-07-21T23:09:19.929 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_reply": 0, 2023-07-21T23:09:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "forward": 0, 2023-07-21T23:09:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_complete": 0, 2023-07-21T23:09:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_fetch_keys": 0, 2023-07-21T23:09:19.930 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_commit": 0, 2023-07-21T23:09:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_split": 0, 2023-07-21T23:09:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_merge": 0, 2023-07-21T23:09:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes": 1371, 2023-07-21T23:09:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_top": 444, 2023-07-21T23:09:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_bottom": 917, 2023-07-21T23:09:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pin_tail": 10, 2023-07-21T23:09:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_pinned": 736, 2023-07-21T23:09:19.931 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_expired": 10, 2023-07-21T23:09:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "inodes_with_caps": 0, 2023-07-21T23:09:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "caps": 0, 2023-07-21T23:09:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "subtrees": 30, 2023-07-21T23:09:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse": 0, 2023-07-21T23:09:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_hit": 0, 2023-07-21T23:09:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_forward": 0, 2023-07-21T23:09:19.932 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_discover": 0, 2023-07-21T23:09:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_dir_fetch": 0, 2023-07-21T23:09:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_remote_ino": 0, 2023-07-21T23:09:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "traverse_lock": 0, 2023-07-21T23:09:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "load_cent": 0, 2023-07-21T23:09:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "q": 0, 2023-07-21T23:09:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "exported": 0, 2023-07-21T23:09:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "exported_inodes": 0, 2023-07-21T23:09:19.933 INFO:teuthology.orchestra.run.smithi187.stdout: "imported": 0, 2023-07-21T23:09:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "imported_inodes": 0, 2023-07-21T23:09:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_dir_fetch": 0, 2023-07-21T23:09:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_backtrace_fetch": 0, 2023-07-21T23:09:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "openino_peer_discover": 0, 2023-07-21T23:09:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rfiles": 1045, 2023-07-21T23:09:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rbytes": 8989162071, 2023-07-21T23:09:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "root_rsnaps": 7, 2023-07-21T23:09:19.934 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_fetch": 0, 2023-07-21T23:09:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_set_tag": 0, 2023-07-21T23:09:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_backtrace_repaired": 0, 2023-07-21T23:09:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_inotable_repaired": 0, 2023-07-21T23:09:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_inodes": 0, 2023-07-21T23:09:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dir_base_inodes": 0, 2023-07-21T23:09:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_dirfrag_rstats": 0, 2023-07-21T23:09:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "scrub_file_inodes": 0, 2023-07-21T23:09:19.935 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_inode_file_caps": 0, 2023-07-21T23:09:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_revoke": 0, 2023-07-21T23:09:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_grant": 0, 2023-07-21T23:09:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_trunc": 0, 2023-07-21T23:09:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-21T23:09:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-21T23:09:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps": 0, 2023-07-21T23:09:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_caps_dirty": 0, 2023-07-21T23:09:19.936 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_cap_release": 0, 2023-07-21T23:09:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "process_request_cap_release": 0 2023-07-21T23:09:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_cache": { 2023-07-21T23:09:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update": 0, 2023-07-21T23:09:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_update_receipt": 0, 2023-07-21T23:09:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_try_discover": 0, 2023-07-21T23:09:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_send_discover": 0, 2023-07-21T23:09:19.937 INFO:teuthology.orchestra.run.smithi187.stdout: "dir_handle_discover": 0, 2023-07-21T23:09:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays": 0, 2023-07-21T23:09:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_delayed": 0, 2023-07-21T23:09:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "num_strays_enqueuing": 0, 2023-07-21T23:09:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_created": 0, 2023-07-21T23:09:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_enqueued": 0, 2023-07-21T23:09:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_reintegrated": 0, 2023-07-21T23:09:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "strays_migrated": 0, 2023-07-21T23:09:19.938 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_processing": 0, 2023-07-21T23:09:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_enqueued": 0, 2023-07-21T23:09:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "num_recovering_prioritized": 0, 2023-07-21T23:09:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_started": 0, 2023-07-21T23:09:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "recovery_completed": 0, 2023-07-21T23:09:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_enqueue_scrub": 0, 2023-07-21T23:09:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_exportdir": 0, 2023-07-21T23:09:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_flush": 0, 2023-07-21T23:09:19.939 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragmentdir": 0, 2023-07-21T23:09:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_fragstats": 0, 2023-07-21T23:09:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "ireq_inodestats": 0 2023-07-21T23:09:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_log": { 2023-07-21T23:09:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "evadd": 0, 2023-07-21T23:09:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "evex": 0, 2023-07-21T23:09:19.940 INFO:teuthology.orchestra.run.smithi187.stdout: "evtrm": 0, 2023-07-21T23:09:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "ev": 0, 2023-07-21T23:09:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "evexg": 0, 2023-07-21T23:09:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "evexd": 0, 2023-07-21T23:09:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "segadd": 0, 2023-07-21T23:09:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "segex": 0, 2023-07-21T23:09:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "segtrm": 0, 2023-07-21T23:09:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "seg": 2, 2023-07-21T23:09:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "segexg": 0, 2023-07-21T23:09:19.941 INFO:teuthology.orchestra.run.smithi187.stdout: "segexd": 0, 2023-07-21T23:09:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "expos": 92549595, 2023-07-21T23:09:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "wrpos": 0, 2023-07-21T23:09:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "rdpos": 93638571, 2023-07-21T23:09:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "jlat": { 2023-07-21T23:09:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.942 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "replayed": 9701 2023-07-21T23:09:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_mem": { 2023-07-21T23:09:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "ino": 463, 2023-07-21T23:09:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "ino+": 806, 2023-07-21T23:09:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "ino-": 343, 2023-07-21T23:09:19.943 INFO:teuthology.orchestra.run.smithi187.stdout: "dir": 47, 2023-07-21T23:09:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "dir+": 52, 2023-07-21T23:09:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "dir-": 5, 2023-07-21T23:09:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "dn": 1371, 2023-07-21T23:09:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "dn+": 1540, 2023-07-21T23:09:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "dn-": 169, 2023-07-21T23:09:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "cap": 0, 2023-07-21T23:09:19.944 INFO:teuthology.orchestra.run.smithi187.stdout: "cap+": 0, 2023-07-21T23:09:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "cap-": 0, 2023-07-21T23:09:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "rss": 53200, 2023-07-21T23:09:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "heap": 207156 2023-07-21T23:09:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_server": { 2023-07-21T23:09:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_client_request": 0, 2023-07-21T23:09:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "dispatch_server_request": 0, 2023-07-21T23:09:19.945 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_request": 0, 2023-07-21T23:09:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_client_session": 0, 2023-07-21T23:09:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "handle_peer_request": 0, 2023-07-21T23:09:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "req_create_latency": { 2023-07-21T23:09:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.946 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getattr_latency": { 2023-07-21T23:09:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getfilelock_latency": { 2023-07-21T23:09:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.947 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "req_link_latency": { 2023-07-21T23:09:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookup_latency": { 2023-07-21T23:09:19.948 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookuphash_latency": { 2023-07-21T23:09:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.949 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupino_latency": { 2023-07-21T23:09:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupname_latency": { 2023-07-21T23:09:19.950 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupparent_latency": { 2023-07-21T23:09:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.951 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lookupsnap_latency": { 2023-07-21T23:09:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "req_lssnap_latency": { 2023-07-21T23:09:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.952 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mkdir_latency": { 2023-07-21T23:09:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.953 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mknod_latency": { 2023-07-21T23:09:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.954 INFO:teuthology.orchestra.run.smithi187.stdout: "req_mksnap_latency": { 2023-07-21T23:09:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "req_open_latency": { 2023-07-21T23:09:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.955 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "req_readdir_latency": { 2023-07-21T23:09:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.956 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rename_latency": { 2023-07-21T23:09:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "req_renamesnap_latency": { 2023-07-21T23:09:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.957 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "req_snapdiff_latency": { 2023-07-21T23:09:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.958 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmdir_latency": { 2023-07-21T23:09:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmsnap_latency": { 2023-07-21T23:09:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.959 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "req_rmxattr_latency": { 2023-07-21T23:09:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setattr_latency": { 2023-07-21T23:09:19.960 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setdirlayout_latency": { 2023-07-21T23:09:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.961 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setfilelock_latency": { 2023-07-21T23:09:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setlayout_latency": { 2023-07-21T23:09:19.962 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "req_setxattr_latency": { 2023-07-21T23:09:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.963 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "req_symlink_latency": { 2023-07-21T23:09:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "req_unlink_latency": { 2023-07-21T23:09:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.964 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_revoke_eviction": 0, 2023-07-21T23:09:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "cap_acquisition_throttle": 0, 2023-07-21T23:09:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "req_getvxattr_latency": { 2023-07-21T23:09:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.965 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_sessions": { 2023-07-21T23:09:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "session_count": 2, 2023-07-21T23:09:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "session_add": 2, 2023-07-21T23:09:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "session_remove": 0, 2023-07-21T23:09:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_open": 0, 2023-07-21T23:09:19.966 INFO:teuthology.orchestra.run.smithi187.stdout: "sessions_stale": 0, 2023-07-21T23:09:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "total_load": 0, 2023-07-21T23:09:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "average_load": 0, 2023-07-21T23:09:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "avg_session_uptime": 4772 2023-07-21T23:09:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "mempool": { 2023-07-21T23:09:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:09:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "bloom_filter_items": 0, 2023-07-21T23:09:19.967 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:09:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:09:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:09:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:09:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:09:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:09:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:09:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:09:19.968 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:09:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:09:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:09:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:09:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:09:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_extent_items": 0, 2023-07-21T23:09:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:09:19.969 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_blob_items": 0, 2023-07-21T23:09:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:09:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:09:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:09:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:09:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:09:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:09:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:09:19.970 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_txc_items": 0, 2023-07-21T23:09:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:09:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:09:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:09:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "bluestore_writing_items": 0, 2023-07-21T23:09:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_bytes": 0, 2023-07-21T23:09:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_items": 0, 2023-07-21T23:09:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:09:19.971 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:09:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:09:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:09:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_bytes": 223018, 2023-07-21T23:09:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_anon_items": 71, 2023-07-21T23:09:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:09:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "buffer_meta_items": 0, 2023-07-21T23:09:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_bytes": 0, 2023-07-21T23:09:19.972 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_items": 0, 2023-07-21T23:09:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:09:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_mapbl_items": 0, 2023-07-21T23:09:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:09:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_pglog_items": 0, 2023-07-21T23:09:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_bytes": 8064, 2023-07-21T23:09:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_items": 169, 2023-07-21T23:09:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:09:19.973 INFO:teuthology.orchestra.run.smithi187.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:09:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_bytes": 0, 2023-07-21T23:09:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "pgmap_items": 0, 2023-07-21T23:09:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_bytes": 2387454, 2023-07-21T23:09:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_co_items": 73647, 2023-07-21T23:09:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_bytes": 0, 2023-07-21T23:09:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_1_items": 0, 2023-07-21T23:09:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_bytes": 0, 2023-07-21T23:09:19.974 INFO:teuthology.orchestra.run.smithi187.stdout: "unittest_2_items": 0 2023-07-21T23:09:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "objecter": { 2023-07-21T23:09:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "op_active": 0, 2023-07-21T23:09:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "op_laggy": 0, 2023-07-21T23:09:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send": 2374, 2023-07-21T23:09:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "op_send_bytes": 26, 2023-07-21T23:09:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "op_resend": 4, 2023-07-21T23:09:19.975 INFO:teuthology.orchestra.run.smithi187.stdout: "op_reply": 2374, 2023-07-21T23:09:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "op_latency": { 2023-07-21T23:09:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2374, 2023-07-21T23:09:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 7.026893515, 2023-07-21T23:09:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.002959938 2023-07-21T23:09:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "op_inflight": 0, 2023-07-21T23:09:19.976 INFO:teuthology.orchestra.run.smithi187.stdout: "oplen_avg": { 2023-07-21T23:09:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 2374, 2023-07-21T23:09:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 2375 2023-07-21T23:09:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "op": 2374, 2023-07-21T23:09:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "op_r": 2374, 2023-07-21T23:09:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "op_w": 0, 2023-07-21T23:09:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "op_rmw": 0, 2023-07-21T23:09:19.977 INFO:teuthology.orchestra.run.smithi187.stdout: "op_pg": 0, 2023-07-21T23:09:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_stat": 1292, 2023-07-21T23:09:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_create": 0, 2023-07-21T23:09:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_read": 1079, 2023-07-21T23:09:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_write": 0, 2023-07-21T23:09:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writefull": 0, 2023-07-21T23:09:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_writesame": 0, 2023-07-21T23:09:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_append": 0, 2023-07-21T23:09:19.978 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_zero": 0, 2023-07-21T23:09:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_truncate": 0, 2023-07-21T23:09:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_delete": 0, 2023-07-21T23:09:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_mapext": 0, 2023-07-21T23:09:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_sparse_read": 0, 2023-07-21T23:09:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_clonerange": 0, 2023-07-21T23:09:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_getxattr": 2, 2023-07-21T23:09:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_setxattr": 0, 2023-07-21T23:09:19.979 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_cmpxattr": 0, 2023-07-21T23:09:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_rmxattr": 0, 2023-07-21T23:09:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_resetxattrs": 0, 2023-07-21T23:09:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_call": 0, 2023-07-21T23:09:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_watch": 0, 2023-07-21T23:09:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_notify": 0, 2023-07-21T23:09:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_src_cmpxattr": 0, 2023-07-21T23:09:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls": 0, 2023-07-21T23:09:19.980 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_pgls_filter": 0, 2023-07-21T23:09:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "osdop_other": 0, 2023-07-21T23:09:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_active": 0, 2023-07-21T23:09:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_send": 0, 2023-07-21T23:09:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_resend": 0, 2023-07-21T23:09:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "linger_ping": 0, 2023-07-21T23:09:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_active": 0, 2023-07-21T23:09:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_send": 0, 2023-07-21T23:09:19.981 INFO:teuthology.orchestra.run.smithi187.stdout: "poolop_resend": 0, 2023-07-21T23:09:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_active": 0, 2023-07-21T23:09:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_send": 0, 2023-07-21T23:09:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "poolstat_resend": 0, 2023-07-21T23:09:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_active": 0, 2023-07-21T23:09:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_send": 0, 2023-07-21T23:09:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "statfs_resend": 0, 2023-07-21T23:09:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "command_active": 0, 2023-07-21T23:09:19.982 INFO:teuthology.orchestra.run.smithi187.stdout: "command_send": 0, 2023-07-21T23:09:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "command_resend": 0, 2023-07-21T23:09:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "map_epoch": 176, 2023-07-21T23:09:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "map_full": 0, 2023-07-21T23:09:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "map_inc": 19, 2023-07-21T23:09:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_sessions": 9, 2023-07-21T23:09:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_open": 9, 2023-07-21T23:09:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_session_close": 0, 2023-07-21T23:09:19.983 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_laggy": 0, 2023-07-21T23:09:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_wr": 0, 2023-07-21T23:09:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_rd": 2, 2023-07-21T23:09:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_del": 0 2023-07-21T23:09:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "oft": { 2023-07-21T23:09:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_objs": 0, 2023-07-21T23:09:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_kv_pairs": 0, 2023-07-21T23:09:19.984 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_updates": 0, 2023-07-21T23:09:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "omap_total_removes": 0 2023-07-21T23:09:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "osd-slow-ops": { 2023-07-21T23:09:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "slow_ops_count": 0 2023-07-21T23:09:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "purge_queue": { 2023-07-21T23:09:19.985 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops": 0, 2023-07-21T23:09:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_ops_high_water": 0, 2023-07-21T23:09:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing": 0, 2023-07-21T23:09:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executing_high_water": 0, 2023-07-21T23:09:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_executed": 0, 2023-07-21T23:09:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "pq_item_in_journal": 0 2023-07-21T23:09:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:09:19.986 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-07-21T23:09:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 3258, 2023-07-21T23:09:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 36788755, 2023-07-21T23:09:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 3258, 2023-07-21T23:09:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:19.987 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 3258, 2023-07-21T23:09:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 36788755, 2023-07-21T23:09:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:19.988 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_bytes": { 2023-07-21T23:09:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 104857600, 2023-07-21T23:09:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:19.989 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 2374, 2023-07-21T23:09:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 34797480, 2023-07-21T23:09:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 2374, 2023-07-21T23:09:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 34797480, 2023-07-21T23:09:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.990 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-objecter_ops": { 2023-07-21T23:09:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 1024, 2023-07-21T23:09:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:19.991 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 2374, 2023-07-21T23:09:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 2374, 2023-07-21T23:09:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 2374, 2023-07-21T23:09:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 2374, 2023-07-21T23:09:19.992 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle": { 2023-07-21T23:09:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:19.993 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-07-21T23:09:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:19.994 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 0, 2023-07-21T23:09:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 0, 2023-07-21T23:09:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:19.995 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-07-21T23:09:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "throttle-write_buf_throttle-0x560f5f178500": { 2023-07-21T23:09:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "val": 0, 2023-07-21T23:09:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "max": 3758096384, 2023-07-21T23:09:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "get_started": 0, 2023-07-21T23:09:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "get": 0, 2023-07-21T23:09:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "get_sum": 0, 2023-07-21T23:09:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:19.996 INFO:teuthology.orchestra.run.smithi187.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "take": 0, 2023-07-21T23:09:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "take_sum": 0, 2023-07-21T23:09:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "put": 0, 2023-07-21T23:09:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "put_sum": 0, 2023-07-21T23:09:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "wait": { 2023-07-21T23:09:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "avgcount": 0, 2023-07-21T23:09:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "sum": 0.000000000, 2023-07-21T23:09:19.997 INFO:teuthology.orchestra.run.smithi187.stdout: "avgtime": 0.000000000 2023-07-21T23:09:19.998 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:19.998 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-07-21T23:09:19.998 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-07-21T23:09:20.368 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2023-07-21T23:09:20.369 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2023-07-21T23:09:20.369 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2023-07-21T23:09:20.369 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2023-07-21T23:09:20.369 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=7 2023-07-21T23:09:20.370 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2023-07-21T23:09:20.370 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2023-07-21T23:09:20.370 DEBUG:tasks.check_counter:Getting stats from c 2023-07-21T23:09:20.370 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.c perf dump 2023-07-21T23:09:21.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:21 smithi187 ceph-mon[96918]: pgmap v1596: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 282 B/s wr, 5 op/s 2023-07-21T23:09:21.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:21 smithi195 ceph-mon[97365]: pgmap v1596: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 282 B/s wr, 5 op/s 2023-07-21T23:09:21.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:21 smithi151 ceph-mon[95510]: pgmap v1596: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 282 B/s wr, 5 op/s 2023-07-21T23:09:23.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:23 smithi187 ceph-mon[96918]: pgmap v1597: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-07-21T23:09:23.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:23 smithi187 ceph-mon[96918]: osdmap e177: 12 total, 12 up, 12 in 2023-07-21T23:09:23.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:23 smithi195 ceph-mon[97365]: pgmap v1597: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-07-21T23:09:23.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:23 smithi195 ceph-mon[97365]: osdmap e177: 12 total, 12 up, 12 in 2023-07-21T23:09:23.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:23 smithi151 ceph-mon[95510]: pgmap v1597: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2023-07-21T23:09:23.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:23 smithi151 ceph-mon[95510]: osdmap e177: 12 total, 12 up, 12 in 2023-07-21T23:09:25.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:25 smithi187 ceph-mon[96918]: pgmap v1599: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:09:25.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:25 smithi195 ceph-mon[97365]: pgmap v1599: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:09:25.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:25 smithi151 ceph-mon[95510]: pgmap v1599: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:09:26.348 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T23:09:27.497 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:27 smithi195 ceph-mon[97365]: pgmap v1600: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:09:27.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:27 smithi187 ceph-mon[96918]: pgmap v1600: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:09:27.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:27 smithi151 ceph-mon[95510]: pgmap v1600: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-07-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:09:28.346 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 0, 2023-07-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 2, 2023-07-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 0, 2023-07-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 0, 2023-07-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 4, 2023-07-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 0, 2023-07-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.003389155, 2023-07-21T23:09:28.347 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.000000000, 2023-07-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.000693810, 2023-07-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.348 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2023-07-21T23:09:28.349 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 4, 2023-07-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 638, 2023-07-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 640, 2023-07-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 355920, 2023-07-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 7, 2023-07-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 3, 2023-07-21T23:09:28.350 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.040332888, 2023-07-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.028074765, 2023-07-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.003871764, 2023-07-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 635, 2023-07-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.044452372, 2023-07-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000070003 2023-07-21T23:09:28.351 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 640, 2023-07-21T23:09:28.352 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 355920 2023-07-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 847, 2023-07-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 835, 2023-07-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 1603520, 2023-07-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 479936, 2023-07-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 2, 2023-07-21T23:09:28.353 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 1, 2023-07-21T23:09:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.131079813, 2023-07-21T23:09:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.044027067, 2023-07-21T23:09:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.061605929, 2023-07-21T23:09:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.021261487, 2023-07-21T23:09:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 835, 2023-07-21T23:09:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.071998522, 2023-07-21T23:09:28.354 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000086225 2023-07-21T23:09:28.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.355 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:28.355 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:28.355 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:28.355 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:28.355 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.355 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 1603520, 2023-07-21T23:09:28.355 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 479936 2023-07-21T23:09:28.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.356 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-07-21T23:09:28.356 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 0, 2023-07-21T23:09:28.356 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-07-21T23:09:28.356 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.356 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-07-21T23:09:28.356 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:09:28.357 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-07-21T23:09:28.358 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:09:28.358 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:09:28.358 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:09:28.358 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:09:28.359 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:09:28.359 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:09:28.359 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:09:28.359 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:09:28.359 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:09:28.360 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:09:28.360 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:09:28.360 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:09:28.361 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:09:28.361 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-07-21T23:09:28.361 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:09:28.361 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-07-21T23:09:28.362 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:09:28.362 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:09:28.362 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:09:28.363 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:09:28.363 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:09:28.363 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:09:28.363 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:09:28.364 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-07-21T23:09:28.364 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:09:28.364 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:09:28.364 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:09:28.365 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-07-21T23:09:28.365 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-07-21T23:09:28.365 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-07-21T23:09:28.365 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:09:28.365 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:09:28.366 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:09:28.366 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:09:28.366 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 148714, 2023-07-21T23:09:28.366 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 30, 2023-07-21T23:09:28.366 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:09:28.366 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-07-21T23:09:28.366 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-07-21T23:09:28.366 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-07-21T23:09:28.367 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:09:28.367 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-07-21T23:09:28.367 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:09:28.367 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-07-21T23:09:28.367 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 0, 2023-07-21T23:09:28.367 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 0, 2023-07-21T23:09:28.367 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:09:28.368 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:09:28.368 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-07-21T23:09:28.368 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-07-21T23:09:28.368 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 928, 2023-07-21T23:09:28.368 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 2, 2023-07-21T23:09:28.368 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-07-21T23:09:28.369 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-07-21T23:09:28.369 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-07-21T23:09:28.369 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-07-21T23:09:28.369 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:28.370 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:09:28.370 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:28.370 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-07-21T23:09:28.370 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:28.370 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 847, 2023-07-21T23:09:28.370 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 1481304, 2023-07-21T23:09:28.370 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:28.371 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 847, 2023-07-21T23:09:28.371 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-07-21T23:09:28.371 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-07-21T23:09:28.371 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 847, 2023-07-21T23:09:28.371 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 1481304, 2023-07-21T23:09:28.371 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:28.372 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:28.372 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:28.372 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:28.372 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:28.373 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:28.373 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-07-21T23:09:28.735 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.c 2023-07-21T23:09:28.736 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.c 2023-07-21T23:09:28.736 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.c 2023-07-21T23:09:28.736 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.c 2023-07-21T23:09:28.736 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.c 2023-07-21T23:09:28.736 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.c 2023-07-21T23:09:28.737 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.c 2023-07-21T23:09:28.737 DEBUG:tasks.check_counter:Getting stats from f 2023-07-21T23:09:28.737 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.f perf dump 2023-07-21T23:09:29.458 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T23:09:29.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:29 smithi187 ceph-mon[96918]: pgmap v1601: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:09:29.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:29 smithi195 ceph-mon[97365]: pgmap v1601: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:09:29.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:29 smithi151 ceph-mon[95510]: pgmap v1601: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:09:30.887 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-07-21T23:09:30.888 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:09:30.888 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 0, 2023-07-21T23:09:30.888 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 2, 2023-07-21T23:09:30.888 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 0, 2023-07-21T23:09:30.888 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 0, 2023-07-21T23:09:30.889 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 4, 2023-07-21T23:09:30.889 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 0, 2023-07-21T23:09:30.889 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.004042310, 2023-07-21T23:09:30.889 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.000000000, 2023-07-21T23:09:30.889 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.000815198, 2023-07-21T23:09:30.889 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:09:30.889 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:30.890 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:30.890 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:30.890 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:30.890 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.890 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:30.890 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:30.890 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:30.890 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:30.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.891 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 0, 2023-07-21T23:09:30.891 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 0 2023-07-21T23:09:30.891 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.891 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:09:30.891 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 185, 2023-07-21T23:09:30.892 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 182, 2023-07-21T23:09:30.892 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 192640, 2023-07-21T23:09:30.892 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 102704, 2023-07-21T23:09:30.892 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 2, 2023-07-21T23:09:30.892 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 1, 2023-07-21T23:09:30.892 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.026544026, 2023-07-21T23:09:30.892 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.008220741, 2023-07-21T23:09:30.893 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.012549642, 2023-07-21T23:09:30.893 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.004777474, 2023-07-21T23:09:30.893 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:30.893 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 182, 2023-07-21T23:09:30.893 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.024766527, 2023-07-21T23:09:30.893 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000136079 2023-07-21T23:09:30.893 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.893 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:30.894 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:30.894 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:30.894 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:30.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.894 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 192640, 2023-07-21T23:09:30.894 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 102704 2023-07-21T23:09:30.894 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.894 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:09:30.895 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1, 2023-07-21T23:09:30.895 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 136, 2023-07-21T23:09:30.895 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 160, 2023-07-21T23:09:30.895 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 99504, 2023-07-21T23:09:30.895 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 3, 2023-07-21T23:09:30.895 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 2, 2023-07-21T23:09:30.895 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.008606721, 2023-07-21T23:09:30.895 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.005657711, 2023-07-21T23:09:30.896 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.001278102, 2023-07-21T23:09:30.896 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2023-07-21T23:09:30.896 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:30.896 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 134, 2023-07-21T23:09:30.896 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.035412327, 2023-07-21T23:09:30.896 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000264271 2023-07-21T23:09:30.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.897 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:30.897 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:30.897 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:30.897 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:30.897 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.897 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 160, 2023-07-21T23:09:30.897 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 99504 2023-07-21T23:09:30.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.898 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-07-21T23:09:30.898 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 0, 2023-07-21T23:09:30.898 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-07-21T23:09:30.898 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.898 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-07-21T23:09:30.899 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:09:30.899 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-07-21T23:09:30.899 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:09:30.899 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:09:30.899 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:09:30.899 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:09:30.900 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:09:30.900 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:09:30.900 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:09:30.900 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:09:30.900 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:09:30.900 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:09:30.900 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:09:30.901 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:09:30.901 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:09:30.901 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-07-21T23:09:30.901 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:09:30.901 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-07-21T23:09:30.901 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:09:30.901 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:09:30.902 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:09:30.902 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:09:30.902 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:09:30.902 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:09:30.902 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:09:30.902 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-07-21T23:09:30.902 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:09:30.902 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:09:30.903 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:09:30.903 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-07-21T23:09:30.903 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-07-21T23:09:30.903 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-07-21T23:09:30.903 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:09:30.903 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:09:30.903 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:09:30.903 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:09:30.904 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 148967, 2023-07-21T23:09:30.904 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 29, 2023-07-21T23:09:30.904 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:09:30.904 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-07-21T23:09:30.904 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-07-21T23:09:30.904 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-07-21T23:09:30.904 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:09:30.905 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-07-21T23:09:30.905 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:09:30.905 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-07-21T23:09:30.905 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 0, 2023-07-21T23:09:30.905 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 0, 2023-07-21T23:09:30.905 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:09:30.905 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:09:30.905 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-07-21T23:09:30.906 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-07-21T23:09:30.906 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 928, 2023-07-21T23:09:30.906 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 2, 2023-07-21T23:09:30.906 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-07-21T23:09:30.906 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-07-21T23:09:30.906 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-07-21T23:09:30.906 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-07-21T23:09:30.906 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:30.907 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:09:30.907 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:30.907 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-07-21T23:09:30.907 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:30.907 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 182, 2023-07-21T23:09:30.907 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 164090, 2023-07-21T23:09:30.907 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:30.907 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 182, 2023-07-21T23:09:30.908 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-07-21T23:09:30.908 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-07-21T23:09:30.908 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 182, 2023-07-21T23:09:30.908 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 164090, 2023-07-21T23:09:30.908 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:30.908 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:30.908 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:30.909 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:30.909 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:30.909 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:30.909 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-07-21T23:09:31.336 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2023-07-21T23:09:31.337 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2023-07-21T23:09:31.337 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.f 2023-07-21T23:09:31.337 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.f 2023-07-21T23:09:31.337 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.f 2023-07-21T23:09:31.338 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.f 2023-07-21T23:09:31.338 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.f 2023-07-21T23:09:31.338 DEBUG:tasks.check_counter:Getting stats from i 2023-07-21T23:09:31.338 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.i perf dump 2023-07-21T23:09:31.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:31 smithi187 ceph-mon[96918]: pgmap v1602: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:09:31.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:31 smithi195 ceph-mon[97365]: pgmap v1602: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:09:31.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:31 smithi151 ceph-mon[95510]: pgmap v1602: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:09:32.058 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T23:09:33.475 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-07-21T23:09:33.475 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:09:33.475 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 1176866, 2023-07-21T23:09:33.475 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 1168422, 2023-07-21T23:09:33.475 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 200949344, 2023-07-21T23:09:33.476 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 218821576, 2023-07-21T23:09:33.476 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 12, 2023-07-21T23:09:33.476 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2023-07-21T23:09:33.476 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 52.214533227, 2023-07-21T23:09:33.476 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 21.495597268, 2023-07-21T23:09:33.476 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 35.868184060, 2023-07-21T23:09:33.476 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.124383694, 2023-07-21T23:09:33.477 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:33.477 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1168420, 2023-07-21T23:09:33.477 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 18.254550858, 2023-07-21T23:09:33.477 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000015623 2023-07-21T23:09:33.477 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.477 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:33.477 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2330919, 2023-07-21T23:09:33.477 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.221458104, 2023-07-21T23:09:33.478 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000095 2023-07-21T23:09:33.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.478 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2087168, 2023-07-21T23:09:33.478 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 510080 2023-07-21T23:09:33.478 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.478 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:09:33.478 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 331482, 2023-07-21T23:09:33.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 589988, 2023-07-21T23:09:33.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 72985188, 2023-07-21T23:09:33.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 172994325, 2023-07-21T23:09:33.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 20, 2023-07-21T23:09:33.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 8, 2023-07-21T23:09:33.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 32.036048624, 2023-07-21T23:09:33.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 14.082741039, 2023-07-21T23:09:33.479 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 19.183372625, 2023-07-21T23:09:33.480 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.286043001, 2023-07-21T23:09:33.480 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:33.480 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 589987, 2023-07-21T23:09:33.480 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 45.589077203, 2023-07-21T23:09:33.480 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000077271 2023-07-21T23:09:33.480 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.481 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:33.481 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 865185, 2023-07-21T23:09:33.481 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.161364452, 2023-07-21T23:09:33.481 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000186 2023-07-21T23:09:33.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.481 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2144, 2023-07-21T23:09:33.481 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 603968 2023-07-21T23:09:33.481 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.482 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:09:33.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 376953, 2023-07-21T23:09:33.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 529524, 2023-07-21T23:09:33.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 113181115, 2023-07-21T23:09:33.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 265153339, 2023-07-21T23:09:33.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 16, 2023-07-21T23:09:33.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2023-07-21T23:09:33.482 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 33.022624405, 2023-07-21T23:09:33.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 14.347106285, 2023-07-21T23:09:33.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 21.560104297, 2023-07-21T23:09:33.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.106678450, 2023-07-21T23:09:33.483 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:33.483 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 529522, 2023-07-21T23:09:33.483 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 41.479251293, 2023-07-21T23:09:33.483 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000078333 2023-07-21T23:09:33.483 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.484 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:33.484 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 851250, 2023-07-21T23:09:33.484 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.184382946, 2023-07-21T23:09:33.484 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000216 2023-07-21T23:09:33.484 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.484 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 5552, 2023-07-21T23:09:33.484 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 710560 2023-07-21T23:09:33.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.485 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-07-21T23:09:33.485 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-07-21T23:09:33.485 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-07-21T23:09:33.485 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.485 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-07-21T23:09:33.485 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-07-21T23:09:33.485 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-07-21T23:09:33.486 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 15553, 2023-07-21T23:09:33.486 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 5.510813966, 2023-07-21T23:09:33.486 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000354324 2023-07-21T23:09:33.486 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:33.486 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.486 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-07-21T23:09:33.486 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-07-21T23:09:33.486 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-07-21T23:09:33.487 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 659, 2023-07-21T23:09:33.487 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.023311540, 2023-07-21T23:09:33.487 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000035374 2023-07-21T23:09:33.487 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:33.487 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.487 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-07-21T23:09:33.487 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 195433, 2023-07-21T23:09:33.488 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 191847, 2023-07-21T23:09:33.488 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-07-21T23:09:33.488 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 191847, 2023-07-21T23:09:33.488 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 531.267469335, 2023-07-21T23:09:33.488 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.002769224 2023-07-21T23:09:33.488 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.488 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-07-21T23:09:33.488 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 3586, 2023-07-21T23:09:33.489 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 9, 2023-07-21T23:09:33.489 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-07-21T23:09:33.489 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 37, 2023-07-21T23:09:33.489 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 3, 2023-07-21T23:09:33.489 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2023-07-21T23:09:33.489 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 709, 2023-07-21T23:09:33.489 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 16, 2023-07-21T23:09:33.489 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 502, 2023-07-21T23:09:33.490 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 191, 2023-07-21T23:09:33.490 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 687, 2023-07-21T23:09:33.490 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 3244, 2023-07-21T23:09:33.490 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 414, 2023-07-21T23:09:33.490 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 414, 2023-07-21T23:09:33.490 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 38, 2023-07-21T23:09:33.490 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 411667, 2023-07-21T23:09:33.490 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 400628, 2023-07-21T23:09:33.491 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 3513, 2023-07-21T23:09:33.491 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 317, 2023-07-21T23:09:33.491 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 2, 2023-07-21T23:09:33.491 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-07-21T23:09:33.491 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 3943, 2023-07-21T23:09:33.491 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 1126, 2023-07-21T23:09:33.491 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 1, 2023-07-21T23:09:33.491 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 78, 2023-07-21T23:09:33.492 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 2567, 2023-07-21T23:09:33.492 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 81, 2023-07-21T23:09:33.492 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 1903, 2023-07-21T23:09:33.492 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-07-21T23:09:33.492 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 2468, 2023-07-21T23:09:33.492 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-07-21T23:09:33.492 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 1041, 2023-07-21T23:09:33.493 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 7795082488, 2023-07-21T23:09:33.493 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 6, 2023-07-21T23:09:33.493 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 2468, 2023-07-21T23:09:33.493 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-07-21T23:09:33.493 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-07-21T23:09:33.493 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-07-21T23:09:33.493 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 15, 2023-07-21T23:09:33.494 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-07-21T23:09:33.494 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 15, 2023-07-21T23:09:33.494 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 2453, 2023-07-21T23:09:33.494 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 579, 2023-07-21T23:09:33.494 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 170070, 2023-07-21T23:09:33.494 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 149872, 2023-07-21T23:09:33.495 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-07-21T23:09:33.495 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-21T23:09:33.495 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-21T23:09:33.495 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 178157, 2023-07-21T23:09:33.495 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 5850, 2023-07-21T23:09:33.495 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 434, 2023-07-21T23:09:33.495 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 1748 2023-07-21T23:09:33.495 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.496 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-07-21T23:09:33.496 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 68, 2023-07-21T23:09:33.496 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 86, 2023-07-21T23:09:33.496 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 51, 2023-07-21T23:09:33.496 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 353, 2023-07-21T23:09:33.496 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 298, 2023-07-21T23:09:33.496 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 1, 2023-07-21T23:09:33.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-07-21T23:09:33.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-07-21T23:09:33.497 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 306, 2023-07-21T23:09:33.497 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 128, 2023-07-21T23:09:33.497 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 904, 2023-07-21T23:09:33.497 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 86, 2023-07-21T23:09:33.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-07-21T23:09:33.497 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-07-21T23:09:33.498 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-07-21T23:09:33.498 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-07-21T23:09:33.498 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-07-21T23:09:33.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-07-21T23:09:33.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 84, 2023-07-21T23:09:33.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-07-21T23:09:33.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 3, 2023-07-21T23:09:33.498 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-07-21T23:09:33.499 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-07-21T23:09:33.499 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.499 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-07-21T23:09:33.499 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 17323, 2023-07-21T23:09:33.499 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-07-21T23:09:33.499 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-07-21T23:09:33.500 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 17323, 2023-07-21T23:09:33.500 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-07-21T23:09:33.500 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-07-21T23:09:33.500 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 22, 2023-07-21T23:09:33.500 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-07-21T23:09:33.500 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-07-21T23:09:33.500 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 22, 2023-07-21T23:09:33.501 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-07-21T23:09:33.501 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-07-21T23:09:33.501 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-07-21T23:09:33.501 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 56742617, 2023-07-21T23:09:33.501 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 0, 2023-07-21T23:09:33.501 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-07-21T23:09:33.501 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 6812, 2023-07-21T23:09:33.502 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 26.164052321, 2023-07-21T23:09:33.502 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003840876 2023-07-21T23:09:33.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.502 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 0 2023-07-21T23:09:33.502 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.502 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-07-21T23:09:33.502 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 542, 2023-07-21T23:09:33.502 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 2921, 2023-07-21T23:09:33.503 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 2379, 2023-07-21T23:09:33.503 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 124, 2023-07-21T23:09:33.503 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 205, 2023-07-21T23:09:33.503 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 81, 2023-07-21T23:09:33.503 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 709, 2023-07-21T23:09:33.503 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 4097, 2023-07-21T23:09:33.503 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 3388, 2023-07-21T23:09:33.504 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 414, 2023-07-21T23:09:33.504 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 2535, 2023-07-21T23:09:33.504 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 2121, 2023-07-21T23:09:33.504 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 71428, 2023-07-21T23:09:33.504 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 198964 2023-07-21T23:09:33.504 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.504 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-07-21T23:09:33.505 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 361161, 2023-07-21T23:09:33.505 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 6392, 2023-07-21T23:09:33.505 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 195433, 2023-07-21T23:09:33.505 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 217, 2023-07-21T23:09:33.505 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 14460, 2023-07-21T23:09:33.505 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-07-21T23:09:33.505 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 724, 2023-07-21T23:09:33.505 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.748195930, 2023-07-21T23:09:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001033419 2023-07-21T23:09:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-07-21T23:09:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 173260, 2023-07-21T23:09:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 237.431068041, 2023-07-21T23:09:33.506 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001370374 2023-07-21T23:09:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-07-21T23:09:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-07-21T23:09:33.507 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 176, 2023-07-21T23:09:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 1.367222826, 2023-07-21T23:09:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.007768311 2023-07-21T23:09:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-07-21T23:09:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 10210, 2023-07-21T23:09:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 141.118451269, 2023-07-21T23:09:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.013821591 2023-07-21T23:09:33.508 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-07-21T23:09:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-07-21T23:09:33.509 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.510 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.510 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.510 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-07-21T23:09:33.510 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.510 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.510 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.510 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.511 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-07-21T23:09:33.511 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.511 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.511 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.511 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.511 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-07-21T23:09:33.511 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.511 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.512 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.512 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-07-21T23:09:33.512 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.512 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.512 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.512 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.513 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-07-21T23:09:33.513 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2, 2023-07-21T23:09:33.513 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.003937435, 2023-07-21T23:09:33.513 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001968717 2023-07-21T23:09:33.513 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.513 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-07-21T23:09:33.513 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.514 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.514 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.514 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-07-21T23:09:33.514 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.514 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.514 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.514 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.515 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-07-21T23:09:33.515 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 6042, 2023-07-21T23:09:33.515 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 6.287513873, 2023-07-21T23:09:33.515 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001040634 2023-07-21T23:09:33.515 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.515 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-07-21T23:09:33.515 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 137, 2023-07-21T23:09:33.515 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.126876395, 2023-07-21T23:09:33.516 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000926105 2023-07-21T23:09:33.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.516 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-07-21T23:09:33.516 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 1115, 2023-07-21T23:09:33.516 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 143.232265164, 2023-07-21T23:09:33.516 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.128459430 2023-07-21T23:09:33.516 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.516 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-07-21T23:09:33.517 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.517 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.517 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.517 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.517 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-07-21T23:09:33.517 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.517 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.518 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.518 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-07-21T23:09:33.518 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.518 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.518 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.518 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.518 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-07-21T23:09:33.519 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.519 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.519 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.519 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.519 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-07-21T23:09:33.519 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.519 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.519 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.520 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-07-21T23:09:33.520 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.520 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.520 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.520 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.520 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-07-21T23:09:33.520 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.521 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.521 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.521 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-07-21T23:09:33.521 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.521 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.521 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.521 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.522 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-07-21T23:09:33.522 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.522 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.522 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.522 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.522 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-07-21T23:09:33.522 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.523 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.523 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.523 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-07-21T23:09:33.523 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.523 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.523 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.523 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.524 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-07-21T23:09:33.524 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 181, 2023-07-21T23:09:33.524 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.951938402, 2023-07-21T23:09:33.524 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.005259328 2023-07-21T23:09:33.524 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.524 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-07-21T23:09:33.524 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-07-21T23:09:33.525 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-07-21T23:09:33.525 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.525 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.525 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.525 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:33.525 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.525 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-07-21T23:09:33.525 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 2, 2023-07-21T23:09:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 4, 2023-07-21T23:09:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 2, 2023-07-21T23:09:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 2, 2023-07-21T23:09:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-07-21T23:09:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 15092, 2023-07-21T23:09:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 7546, 2023-07-21T23:09:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 3003 2023-07-21T23:09:33.526 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.527 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-07-21T23:09:33.527 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:09:33.527 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-07-21T23:09:33.527 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:09:33.527 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:09:33.527 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:09:33.527 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:09:33.528 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:09:33.528 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:09:33.528 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:09:33.528 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:09:33.528 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:09:33.528 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:09:33.528 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:09:33.529 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:09:33.529 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:09:33.529 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-07-21T23:09:33.529 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:09:33.529 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-07-21T23:09:33.529 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:09:33.529 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:09:33.530 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:09:33.530 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:09:33.530 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:09:33.530 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:09:33.530 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:09:33.530 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-07-21T23:09:33.530 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:09:33.530 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:09:33.531 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:09:33.531 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-07-21T23:09:33.531 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-07-21T23:09:33.531 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-07-21T23:09:33.531 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:09:33.531 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:09:33.531 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:09:33.531 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:09:33.532 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 603847, 2023-07-21T23:09:33.532 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 201, 2023-07-21T23:09:33.532 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:09:33.532 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-07-21T23:09:33.532 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-07-21T23:09:33.532 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-07-21T23:09:33.532 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:09:33.533 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-07-21T23:09:33.533 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:09:33.533 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-07-21T23:09:33.533 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 7944, 2023-07-21T23:09:33.533 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 166, 2023-07-21T23:09:33.533 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:09:33.533 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:09:33.533 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-07-21T23:09:33.534 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-07-21T23:09:33.534 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 2288130, 2023-07-21T23:09:33.534 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 31591, 2023-07-21T23:09:33.534 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-07-21T23:09:33.534 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-07-21T23:09:33.534 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-07-21T23:09:33.534 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-07-21T23:09:33.534 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.535 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-07-21T23:09:33.535 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-07-21T23:09:33.535 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-07-21T23:09:33.535 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 10229, 2023-07-21T23:09:33.535 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 53017844, 2023-07-21T23:09:33.535 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 27, 2023-07-21T23:09:33.535 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 10229, 2023-07-21T23:09:33.536 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-07-21T23:09:33.536 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 10229, 2023-07-21T23:09:33.536 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 31.345400558, 2023-07-21T23:09:33.536 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.003064366 2023-07-21T23:09:33.536 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.536 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-07-21T23:09:33.536 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-07-21T23:09:33.537 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 10229, 2023-07-21T23:09:33.537 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 10763 2023-07-21T23:09:33.537 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.537 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 10229, 2023-07-21T23:09:33.537 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 2580, 2023-07-21T23:09:33.537 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 7649, 2023-07-21T23:09:33.537 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-07-21T23:09:33.538 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-07-21T23:09:33.538 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 0, 2023-07-21T23:09:33.538 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 10, 2023-07-21T23:09:33.538 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 91, 2023-07-21T23:09:33.538 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 6903, 2023-07-21T23:09:33.538 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 236, 2023-07-21T23:09:33.538 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-07-21T23:09:33.538 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-07-21T23:09:33.539 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 1, 2023-07-21T23:09:33.539 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 2, 2023-07-21T23:09:33.539 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 155, 2023-07-21T23:09:33.539 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-07-21T23:09:33.539 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-07-21T23:09:33.539 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-07-21T23:09:33.539 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 2469, 2023-07-21T23:09:33.539 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 20, 2023-07-21T23:09:33.540 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-07-21T23:09:33.540 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-07-21T23:09:33.540 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-07-21T23:09:33.540 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-07-21T23:09:33.540 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-07-21T23:09:33.540 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-07-21T23:09:33.540 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-07-21T23:09:33.541 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-07-21T23:09:33.541 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-07-21T23:09:33.541 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-07-21T23:09:33.541 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-07-21T23:09:33.541 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-07-21T23:09:33.541 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-07-21T23:09:33.541 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-07-21T23:09:33.541 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-07-21T23:09:33.542 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-07-21T23:09:33.542 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-07-21T23:09:33.542 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-07-21T23:09:33.542 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-07-21T23:09:33.542 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-07-21T23:09:33.542 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-07-21T23:09:33.542 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-07-21T23:09:33.542 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-07-21T23:09:33.543 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-07-21T23:09:33.543 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-07-21T23:09:33.543 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-07-21T23:09:33.543 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 177, 2023-07-21T23:09:33.543 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-07-21T23:09:33.543 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 92, 2023-07-21T23:09:33.543 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 12, 2023-07-21T23:09:33.543 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 12, 2023-07-21T23:09:33.544 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 0, 2023-07-21T23:09:33.544 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-07-21T23:09:33.544 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 610, 2023-07-21T23:09:33.544 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 30, 2023-07-21T23:09:33.544 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 236 2023-07-21T23:09:33.544 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.544 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-07-21T23:09:33.544 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 1, 2023-07-21T23:09:33.545 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-07-21T23:09:33.545 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-07-21T23:09:33.545 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-07-21T23:09:33.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.545 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-07-21T23:09:33.545 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 197729 2023-07-21T23:09:33.545 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.546 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-07-21T23:09:33.546 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-07-21T23:09:33.546 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 6, 2023-07-21T23:09:33.546 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-07-21T23:09:33.546 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 6, 2023-07-21T23:09:33.546 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 128, 2023-07-21T23:09:33.546 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-07-21T23:09:33.546 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.547 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:09:33.547 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:33.547 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-07-21T23:09:33.547 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:33.547 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 1885297, 2023-07-21T23:09:33.547 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 217380056, 2023-07-21T23:09:33.547 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:33.547 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 1885297, 2023-07-21T23:09:33.548 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-07-21T23:09:33.548 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-07-21T23:09:33.548 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 1885297, 2023-07-21T23:09:33.548 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 217380056, 2023-07-21T23:09:33.548 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:33.548 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.548 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.549 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.549 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:33.549 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.549 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-07-21T23:09:33.549 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:33.549 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-07-21T23:09:33.549 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:33.549 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-07-21T23:09:33.550 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-07-21T23:09:33.550 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:33.550 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:33.550 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 10229, 2023-07-21T23:09:33.550 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 53030796, 2023-07-21T23:09:33.550 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 10229, 2023-07-21T23:09:33.550 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 53030796, 2023-07-21T23:09:33.550 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:33.551 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.551 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.551 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.551 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:33.551 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.551 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-07-21T23:09:33.552 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:33.552 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-07-21T23:09:33.552 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:33.552 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-07-21T23:09:33.552 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-07-21T23:09:33.552 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:33.552 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:33.552 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 10229, 2023-07-21T23:09:33.553 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 10229, 2023-07-21T23:09:33.553 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 10229, 2023-07-21T23:09:33.553 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 10229, 2023-07-21T23:09:33.553 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:33.553 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.553 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.553 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.553 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:33.554 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.554 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-07-21T23:09:33.554 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:33.554 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-07-21T23:09:33.554 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:33.554 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 128, 2023-07-21T23:09:33.554 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 13496, 2023-07-21T23:09:33.554 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:33.555 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 128, 2023-07-21T23:09:33.555 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-07-21T23:09:33.555 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-07-21T23:09:33.555 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 91, 2023-07-21T23:09:33.555 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 13496, 2023-07-21T23:09:33.555 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:33.555 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.555 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.556 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.556 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:33.556 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:33.556 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x564ded32c0a0": { 2023-07-21T23:09:33.556 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:33.556 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-07-21T23:09:33.556 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:33.557 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 17323, 2023-07-21T23:09:33.557 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 52548313, 2023-07-21T23:09:33.557 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:33.557 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 17323, 2023-07-21T23:09:33.557 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-07-21T23:09:33.557 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-07-21T23:09:33.557 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 6812, 2023-07-21T23:09:33.557 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 52548313, 2023-07-21T23:09:33.558 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:33.558 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:33.558 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:33.558 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:33.558 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:33.558 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:33.558 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-07-21T23:09:33.559 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:33 smithi195 ceph-mon[97365]: pgmap v1603: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:09:33.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:33 smithi187 ceph-mon[96918]: pgmap v1603: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:09:33.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:33 smithi151 ceph-mon[95510]: pgmap v1603: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:09:33.931 INFO:tasks.check_counter:Daemon mds.i mds.exported=78 2023-07-21T23:09:33.932 INFO:tasks.check_counter:Daemon mds.i mds.imported=81 2023-07-21T23:09:33.932 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=68 2023-07-21T23:09:33.932 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=86 2023-07-21T23:09:33.932 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2023-07-21T23:09:33.933 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2023-07-21T23:09:33.933 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2023-07-21T23:09:33.933 DEBUG:tasks.check_counter:Getting stats from l 2023-07-21T23:09:33.933 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea shell --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c -- ceph daemon mds.l perf dump 2023-07-21T23:09:34.655 INFO:teuthology.orchestra.run.smithi195.stderr:Inferring config /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/mon.c/config 2023-07-21T23:09:35.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:35 smithi187 ceph-mon[96918]: pgmap v1604: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:09:35.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:35 smithi195 ceph-mon[97365]: pgmap v1604: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:09:35.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:35 smithi151 ceph-mon[95510]: pgmap v1604: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:09:36.063 INFO:teuthology.orchestra.run.smithi195.stdout:{ 2023-07-21T23:09:36.063 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-0": { 2023-07-21T23:09:36.064 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 2884, 2023-07-21T23:09:36.064 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 2884, 2023-07-21T23:09:36.064 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 188021005, 2023-07-21T23:09:36.064 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 896192, 2023-07-21T23:09:36.064 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 10, 2023-07-21T23:09:36.064 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 4, 2023-07-21T23:09:36.065 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.540289507, 2023-07-21T23:09:36.065 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.078583620, 2023-07-21T23:09:36.065 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.352320482, 2023-07-21T23:09:36.065 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.079317244, 2023-07-21T23:09:36.065 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:36.065 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 2883, 2023-07-21T23:09:36.065 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.167918317, 2023-07-21T23:09:36.065 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000058244 2023-07-21T23:09:36.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:36.066 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.066 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.066 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.066 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2960, 2023-07-21T23:09:36.066 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 448 2023-07-21T23:09:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-1": { 2023-07-21T23:09:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 4467, 2023-07-21T23:09:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 4360, 2023-07-21T23:09:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 179161962, 2023-07-21T23:09:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 1564782, 2023-07-21T23:09:36.067 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 7, 2023-07-21T23:09:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 5, 2023-07-21T23:09:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.692583085, 2023-07-21T23:09:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.184035795, 2023-07-21T23:09:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.365683119, 2023-07-21T23:09:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.114138260, 2023-07-21T23:09:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:36.068 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 4359, 2023-07-21T23:09:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.329485132, 2023-07-21T23:09:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000075587 2023-07-21T23:09:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.069 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 2072224, 2023-07-21T23:09:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 500224 2023-07-21T23:09:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: "AsyncMessenger::Worker-2": { 2023-07-21T23:09:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_messages": 4638, 2023-07-21T23:09:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages": 5277, 2023-07-21T23:09:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_bytes": 102143324, 2023-07-21T23:09:36.070 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_bytes": 2720141, 2023-07-21T23:09:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_created_connections": 9, 2023-07-21T23:09:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_active_connections": 6, 2023-07-21T23:09:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_total_time": 0.638361631, 2023-07-21T23:09:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_send_time": 0.176145115, 2023-07-21T23:09:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_recv_time": 0.256643583, 2023-07-21T23:09:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_running_fast_dispatch_time": 0.146271092, 2023-07-21T23:09:36.071 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_messages_queue_lat": { 2023-07-21T23:09:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 5274, 2023-07-21T23:09:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.361478088, 2023-07-21T23:09:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000068539 2023-07-21T23:09:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_handle_ack_lat": { 2023-07-21T23:09:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.072 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_recv_encrypted_bytes": 480, 2023-07-21T23:09:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: "msgr_send_encrypted_bytes": 1278656 2023-07-21T23:09:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: "cct": { 2023-07-21T23:09:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: "total_workers": 1, 2023-07-21T23:09:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: "unhealthy_workers": 0 2023-07-21T23:09:36.073 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-MDSRank": { 2023-07-21T23:09:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-07-21T23:09:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-07-21T23:09:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 18164, 2023-07-21T23:09:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.509451114, 2023-07-21T23:09:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000028047 2023-07-21T23:09:36.074 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: "finisher-PurgeQueue": { 2023-07-21T23:09:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: "queue_len": 0, 2023-07-21T23:09:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: "complete_latency": { 2023-07-21T23:09:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.075 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: "mds": { 2023-07-21T23:09:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: "request": 0, 2023-07-21T23:09:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: "reply": 0, 2023-07-21T23:09:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: "reply_latency": { 2023-07-21T23:09:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.076 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_reply": 0, 2023-07-21T23:09:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: "forward": 0, 2023-07-21T23:09:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_complete": 0, 2023-07-21T23:09:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_fetch_keys": 0, 2023-07-21T23:09:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_commit": 0, 2023-07-21T23:09:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_split": 0, 2023-07-21T23:09:36.077 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_merge": 0, 2023-07-21T23:09:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes": 1335, 2023-07-21T23:09:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_top": 368, 2023-07-21T23:09:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_bottom": 830, 2023-07-21T23:09:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pin_tail": 137, 2023-07-21T23:09:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_pinned": 809, 2023-07-21T23:09:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_expired": 0, 2023-07-21T23:09:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: "inodes_with_caps": 0, 2023-07-21T23:09:36.078 INFO:teuthology.orchestra.run.smithi195.stdout: "caps": 0, 2023-07-21T23:09:36.079 INFO:teuthology.orchestra.run.smithi195.stdout: "subtrees": 40, 2023-07-21T23:09:36.079 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse": 0, 2023-07-21T23:09:36.079 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_hit": 0, 2023-07-21T23:09:36.079 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_forward": 0, 2023-07-21T23:09:36.079 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_discover": 0, 2023-07-21T23:09:36.079 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_dir_fetch": 0, 2023-07-21T23:09:36.079 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_remote_ino": 0, 2023-07-21T23:09:36.079 INFO:teuthology.orchestra.run.smithi195.stdout: "traverse_lock": 0, 2023-07-21T23:09:36.080 INFO:teuthology.orchestra.run.smithi195.stdout: "load_cent": 0, 2023-07-21T23:09:36.080 INFO:teuthology.orchestra.run.smithi195.stdout: "q": 0, 2023-07-21T23:09:36.080 INFO:teuthology.orchestra.run.smithi195.stdout: "exported": 0, 2023-07-21T23:09:36.080 INFO:teuthology.orchestra.run.smithi195.stdout: "exported_inodes": 0, 2023-07-21T23:09:36.080 INFO:teuthology.orchestra.run.smithi195.stdout: "imported": 0, 2023-07-21T23:09:36.080 INFO:teuthology.orchestra.run.smithi195.stdout: "imported_inodes": 0, 2023-07-21T23:09:36.080 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_dir_fetch": 0, 2023-07-21T23:09:36.080 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_backtrace_fetch": 0, 2023-07-21T23:09:36.081 INFO:teuthology.orchestra.run.smithi195.stdout: "openino_peer_discover": 0, 2023-07-21T23:09:36.081 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rfiles": 0, 2023-07-21T23:09:36.081 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rbytes": 0, 2023-07-21T23:09:36.081 INFO:teuthology.orchestra.run.smithi195.stdout: "root_rsnaps": 0, 2023-07-21T23:09:36.081 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_fetch": 0, 2023-07-21T23:09:36.081 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_set_tag": 0, 2023-07-21T23:09:36.081 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_backtrace_repaired": 0, 2023-07-21T23:09:36.082 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_inotable_repaired": 0, 2023-07-21T23:09:36.082 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_inodes": 0, 2023-07-21T23:09:36.082 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dir_base_inodes": 0, 2023-07-21T23:09:36.082 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_dirfrag_rstats": 0, 2023-07-21T23:09:36.082 INFO:teuthology.orchestra.run.smithi195.stdout: "scrub_file_inodes": 0, 2023-07-21T23:09:36.082 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_inode_file_caps": 0, 2023-07-21T23:09:36.082 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_revoke": 0, 2023-07-21T23:09:36.082 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_grant": 0, 2023-07-21T23:09:36.083 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_trunc": 0, 2023-07-21T23:09:36.083 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flushsnap_ack": 0, 2023-07-21T23:09:36.083 INFO:teuthology.orchestra.run.smithi195.stdout: "ceph_cap_op_flush_ack": 0, 2023-07-21T23:09:36.083 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps": 0, 2023-07-21T23:09:36.083 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_caps_dirty": 0, 2023-07-21T23:09:36.083 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_cap_release": 0, 2023-07-21T23:09:36.083 INFO:teuthology.orchestra.run.smithi195.stdout: "process_request_cap_release": 0 2023-07-21T23:09:36.083 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.084 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_cache": { 2023-07-21T23:09:36.084 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update": 0, 2023-07-21T23:09:36.084 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_update_receipt": 0, 2023-07-21T23:09:36.084 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_try_discover": 0, 2023-07-21T23:09:36.084 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_send_discover": 0, 2023-07-21T23:09:36.084 INFO:teuthology.orchestra.run.smithi195.stdout: "dir_handle_discover": 0, 2023-07-21T23:09:36.084 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays": 0, 2023-07-21T23:09:36.085 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_delayed": 0, 2023-07-21T23:09:36.085 INFO:teuthology.orchestra.run.smithi195.stdout: "num_strays_enqueuing": 0, 2023-07-21T23:09:36.085 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_created": 0, 2023-07-21T23:09:36.085 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_enqueued": 0, 2023-07-21T23:09:36.085 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_reintegrated": 0, 2023-07-21T23:09:36.085 INFO:teuthology.orchestra.run.smithi195.stdout: "strays_migrated": 0, 2023-07-21T23:09:36.085 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_processing": 0, 2023-07-21T23:09:36.085 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_enqueued": 0, 2023-07-21T23:09:36.086 INFO:teuthology.orchestra.run.smithi195.stdout: "num_recovering_prioritized": 0, 2023-07-21T23:09:36.086 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_started": 0, 2023-07-21T23:09:36.086 INFO:teuthology.orchestra.run.smithi195.stdout: "recovery_completed": 0, 2023-07-21T23:09:36.086 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_enqueue_scrub": 0, 2023-07-21T23:09:36.086 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_exportdir": 0, 2023-07-21T23:09:36.086 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_flush": 0, 2023-07-21T23:09:36.086 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragmentdir": 0, 2023-07-21T23:09:36.086 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_fragstats": 0, 2023-07-21T23:09:36.087 INFO:teuthology.orchestra.run.smithi195.stdout: "ireq_inodestats": 0 2023-07-21T23:09:36.087 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.087 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_log": { 2023-07-21T23:09:36.087 INFO:teuthology.orchestra.run.smithi195.stdout: "evadd": 0, 2023-07-21T23:09:36.087 INFO:teuthology.orchestra.run.smithi195.stdout: "evex": 0, 2023-07-21T23:09:36.087 INFO:teuthology.orchestra.run.smithi195.stdout: "evtrm": 0, 2023-07-21T23:09:36.087 INFO:teuthology.orchestra.run.smithi195.stdout: "ev": 0, 2023-07-21T23:09:36.087 INFO:teuthology.orchestra.run.smithi195.stdout: "evexg": 0, 2023-07-21T23:09:36.088 INFO:teuthology.orchestra.run.smithi195.stdout: "evexd": 0, 2023-07-21T23:09:36.088 INFO:teuthology.orchestra.run.smithi195.stdout: "segadd": 0, 2023-07-21T23:09:36.088 INFO:teuthology.orchestra.run.smithi195.stdout: "segex": 0, 2023-07-21T23:09:36.088 INFO:teuthology.orchestra.run.smithi195.stdout: "segtrm": 0, 2023-07-21T23:09:36.088 INFO:teuthology.orchestra.run.smithi195.stdout: "seg": 114, 2023-07-21T23:09:36.088 INFO:teuthology.orchestra.run.smithi195.stdout: "segexg": 0, 2023-07-21T23:09:36.088 INFO:teuthology.orchestra.run.smithi195.stdout: "segexd": 0, 2023-07-21T23:09:36.088 INFO:teuthology.orchestra.run.smithi195.stdout: "expos": 4194304, 2023-07-21T23:09:36.089 INFO:teuthology.orchestra.run.smithi195.stdout: "wrpos": 0, 2023-07-21T23:09:36.089 INFO:teuthology.orchestra.run.smithi195.stdout: "rdpos": 468250199, 2023-07-21T23:09:36.089 INFO:teuthology.orchestra.run.smithi195.stdout: "jlat": { 2023-07-21T23:09:36.089 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.089 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.089 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.089 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.090 INFO:teuthology.orchestra.run.smithi195.stdout: "replayed": 20368 2023-07-21T23:09:36.090 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.090 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_mem": { 2023-07-21T23:09:36.090 INFO:teuthology.orchestra.run.smithi195.stdout: "ino": 1085, 2023-07-21T23:09:36.090 INFO:teuthology.orchestra.run.smithi195.stdout: "ino+": 4445, 2023-07-21T23:09:36.090 INFO:teuthology.orchestra.run.smithi195.stdout: "ino-": 3360, 2023-07-21T23:09:36.090 INFO:teuthology.orchestra.run.smithi195.stdout: "dir": 114, 2023-07-21T23:09:36.090 INFO:teuthology.orchestra.run.smithi195.stdout: "dir+": 180, 2023-07-21T23:09:36.091 INFO:teuthology.orchestra.run.smithi195.stdout: "dir-": 66, 2023-07-21T23:09:36.091 INFO:teuthology.orchestra.run.smithi195.stdout: "dn": 1335, 2023-07-21T23:09:36.091 INFO:teuthology.orchestra.run.smithi195.stdout: "dn+": 5439, 2023-07-21T23:09:36.091 INFO:teuthology.orchestra.run.smithi195.stdout: "dn-": 4104, 2023-07-21T23:09:36.091 INFO:teuthology.orchestra.run.smithi195.stdout: "cap": 0, 2023-07-21T23:09:36.091 INFO:teuthology.orchestra.run.smithi195.stdout: "cap+": 0, 2023-07-21T23:09:36.091 INFO:teuthology.orchestra.run.smithi195.stdout: "cap-": 0, 2023-07-21T23:09:36.091 INFO:teuthology.orchestra.run.smithi195.stdout: "rss": 59516, 2023-07-21T23:09:36.092 INFO:teuthology.orchestra.run.smithi195.stdout: "heap": 207156 2023-07-21T23:09:36.092 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.092 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_server": { 2023-07-21T23:09:36.092 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_client_request": 0, 2023-07-21T23:09:36.092 INFO:teuthology.orchestra.run.smithi195.stdout: "dispatch_server_request": 0, 2023-07-21T23:09:36.092 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_request": 0, 2023-07-21T23:09:36.092 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_client_session": 0, 2023-07-21T23:09:36.092 INFO:teuthology.orchestra.run.smithi195.stdout: "handle_peer_request": 0, 2023-07-21T23:09:36.093 INFO:teuthology.orchestra.run.smithi195.stdout: "req_create_latency": { 2023-07-21T23:09:36.093 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.093 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.093 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.093 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.093 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getattr_latency": { 2023-07-21T23:09:36.093 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.093 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.094 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.094 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getfilelock_latency": { 2023-07-21T23:09:36.094 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.094 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.094 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.094 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.095 INFO:teuthology.orchestra.run.smithi195.stdout: "req_link_latency": { 2023-07-21T23:09:36.095 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.095 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.095 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.095 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.095 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookup_latency": { 2023-07-21T23:09:36.095 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.095 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.096 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.096 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookuphash_latency": { 2023-07-21T23:09:36.096 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.096 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.096 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.096 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.096 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupino_latency": { 2023-07-21T23:09:36.097 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.097 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.097 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.097 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.097 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupname_latency": { 2023-07-21T23:09:36.097 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.097 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.097 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.098 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupparent_latency": { 2023-07-21T23:09:36.098 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.098 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.098 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.098 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.098 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lookupsnap_latency": { 2023-07-21T23:09:36.098 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.099 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.099 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.099 INFO:teuthology.orchestra.run.smithi195.stdout: "req_lssnap_latency": { 2023-07-21T23:09:36.099 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.099 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.099 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.099 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.100 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mkdir_latency": { 2023-07-21T23:09:36.100 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.100 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.100 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.100 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.100 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mknod_latency": { 2023-07-21T23:09:36.100 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.101 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.101 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.101 INFO:teuthology.orchestra.run.smithi195.stdout: "req_mksnap_latency": { 2023-07-21T23:09:36.101 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.101 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.101 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.101 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.102 INFO:teuthology.orchestra.run.smithi195.stdout: "req_open_latency": { 2023-07-21T23:09:36.102 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.102 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.102 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.102 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.102 INFO:teuthology.orchestra.run.smithi195.stdout: "req_readdir_latency": { 2023-07-21T23:09:36.102 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.103 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.103 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.103 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rename_latency": { 2023-07-21T23:09:36.103 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.103 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.103 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.103 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.104 INFO:teuthology.orchestra.run.smithi195.stdout: "req_renamesnap_latency": { 2023-07-21T23:09:36.104 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.104 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.104 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.104 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.104 INFO:teuthology.orchestra.run.smithi195.stdout: "req_snapdiff_latency": { 2023-07-21T23:09:36.104 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.104 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.105 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.105 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmdir_latency": { 2023-07-21T23:09:36.105 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.105 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.105 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.105 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.106 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmsnap_latency": { 2023-07-21T23:09:36.106 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.106 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.106 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.106 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.106 INFO:teuthology.orchestra.run.smithi195.stdout: "req_rmxattr_latency": { 2023-07-21T23:09:36.106 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.106 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.107 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.107 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setattr_latency": { 2023-07-21T23:09:36.107 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.107 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.107 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.107 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.107 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setdirlayout_latency": { 2023-07-21T23:09:36.108 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.108 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.108 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.108 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.108 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setfilelock_latency": { 2023-07-21T23:09:36.108 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.108 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.108 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.109 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setlayout_latency": { 2023-07-21T23:09:36.109 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.109 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.109 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.109 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.109 INFO:teuthology.orchestra.run.smithi195.stdout: "req_setxattr_latency": { 2023-07-21T23:09:36.109 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.110 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.110 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.110 INFO:teuthology.orchestra.run.smithi195.stdout: "req_symlink_latency": { 2023-07-21T23:09:36.110 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.110 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.110 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.110 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.111 INFO:teuthology.orchestra.run.smithi195.stdout: "req_unlink_latency": { 2023-07-21T23:09:36.111 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.111 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.111 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.111 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.111 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_revoke_eviction": 0, 2023-07-21T23:09:36.111 INFO:teuthology.orchestra.run.smithi195.stdout: "cap_acquisition_throttle": 0, 2023-07-21T23:09:36.112 INFO:teuthology.orchestra.run.smithi195.stdout: "req_getvxattr_latency": { 2023-07-21T23:09:36.112 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.112 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.112 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.112 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:36.112 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.112 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_sessions": { 2023-07-21T23:09:36.112 INFO:teuthology.orchestra.run.smithi195.stdout: "session_count": 2, 2023-07-21T23:09:36.113 INFO:teuthology.orchestra.run.smithi195.stdout: "session_add": 4, 2023-07-21T23:09:36.113 INFO:teuthology.orchestra.run.smithi195.stdout: "session_remove": 2, 2023-07-21T23:09:36.113 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_open": 3, 2023-07-21T23:09:36.113 INFO:teuthology.orchestra.run.smithi195.stdout: "sessions_stale": 0, 2023-07-21T23:09:36.113 INFO:teuthology.orchestra.run.smithi195.stdout: "total_load": 0, 2023-07-21T23:09:36.113 INFO:teuthology.orchestra.run.smithi195.stdout: "average_load": 0, 2023-07-21T23:09:36.113 INFO:teuthology.orchestra.run.smithi195.stdout: "avg_session_uptime": 5683 2023-07-21T23:09:36.113 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.114 INFO:teuthology.orchestra.run.smithi195.stdout: "mempool": { 2023-07-21T23:09:36.114 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_bytes": 0, 2023-07-21T23:09:36.114 INFO:teuthology.orchestra.run.smithi195.stdout: "bloom_filter_items": 0, 2023-07-21T23:09:36.114 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_bytes": 0, 2023-07-21T23:09:36.114 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_alloc_items": 0, 2023-07-21T23:09:36.114 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_bytes": 0, 2023-07-21T23:09:36.114 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_data_items": 0, 2023-07-21T23:09:36.114 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_bytes": 0, 2023-07-21T23:09:36.115 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_onode_items": 0, 2023-07-21T23:09:36.115 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_bytes": 0, 2023-07-21T23:09:36.115 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_meta_items": 0, 2023-07-21T23:09:36.115 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_bytes": 0, 2023-07-21T23:09:36.115 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_other_items": 0, 2023-07-21T23:09:36.115 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_bytes": 0, 2023-07-21T23:09:36.115 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_cache_buffer_items": 0, 2023-07-21T23:09:36.115 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_bytes": 0, 2023-07-21T23:09:36.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_extent_items": 0, 2023-07-21T23:09:36.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_bytes": 0, 2023-07-21T23:09:36.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_blob_items": 0, 2023-07-21T23:09:36.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_bytes": 0, 2023-07-21T23:09:36.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_shared_blob_items": 0, 2023-07-21T23:09:36.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_bytes": 0, 2023-07-21T23:09:36.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_inline_bl_items": 0, 2023-07-21T23:09:36.116 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_bytes": 0, 2023-07-21T23:09:36.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_fsck_items": 0, 2023-07-21T23:09:36.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_bytes": 0, 2023-07-21T23:09:36.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_txc_items": 0, 2023-07-21T23:09:36.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_bytes": 0, 2023-07-21T23:09:36.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_deferred_items": 0, 2023-07-21T23:09:36.117 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_bytes": 0, 2023-07-21T23:09:36.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluestore_writing_items": 0, 2023-07-21T23:09:36.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_bytes": 0, 2023-07-21T23:09:36.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_items": 0, 2023-07-21T23:09:36.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_bytes": 0, 2023-07-21T23:09:36.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_reader_items": 0, 2023-07-21T23:09:36.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_bytes": 0, 2023-07-21T23:09:36.118 INFO:teuthology.orchestra.run.smithi195.stdout: "bluefs_file_writer_items": 0, 2023-07-21T23:09:36.119 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_bytes": 243378, 2023-07-21T23:09:36.119 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_anon_items": 90, 2023-07-21T23:09:36.119 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_bytes": 0, 2023-07-21T23:09:36.119 INFO:teuthology.orchestra.run.smithi195.stdout: "buffer_meta_items": 0, 2023-07-21T23:09:36.119 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_bytes": 0, 2023-07-21T23:09:36.119 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_items": 0, 2023-07-21T23:09:36.119 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_bytes": 0, 2023-07-21T23:09:36.119 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_mapbl_items": 0, 2023-07-21T23:09:36.120 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_bytes": 0, 2023-07-21T23:09:36.120 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_pglog_items": 0, 2023-07-21T23:09:36.120 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_bytes": 7944, 2023-07-21T23:09:36.120 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_items": 166, 2023-07-21T23:09:36.120 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_bytes": 0, 2023-07-21T23:09:36.120 INFO:teuthology.orchestra.run.smithi195.stdout: "osdmap_mapping_items": 0, 2023-07-21T23:09:36.120 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_bytes": 0, 2023-07-21T23:09:36.120 INFO:teuthology.orchestra.run.smithi195.stdout: "pgmap_items": 0, 2023-07-21T23:09:36.121 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_bytes": 3627182, 2023-07-21T23:09:36.121 INFO:teuthology.orchestra.run.smithi195.stdout: "mds_co_items": 8734, 2023-07-21T23:09:36.121 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_bytes": 0, 2023-07-21T23:09:36.121 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_1_items": 0, 2023-07-21T23:09:36.121 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_bytes": 0, 2023-07-21T23:09:36.121 INFO:teuthology.orchestra.run.smithi195.stdout: "unittest_2_items": 0 2023-07-21T23:09:36.121 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.121 INFO:teuthology.orchestra.run.smithi195.stdout: "objecter": { 2023-07-21T23:09:36.122 INFO:teuthology.orchestra.run.smithi195.stdout: "op_active": 0, 2023-07-21T23:09:36.122 INFO:teuthology.orchestra.run.smithi195.stdout: "op_laggy": 0, 2023-07-21T23:09:36.122 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send": 10938, 2023-07-21T23:09:36.122 INFO:teuthology.orchestra.run.smithi195.stdout: "op_send_bytes": 21, 2023-07-21T23:09:36.122 INFO:teuthology.orchestra.run.smithi195.stdout: "op_resend": 3, 2023-07-21T23:09:36.122 INFO:teuthology.orchestra.run.smithi195.stdout: "op_reply": 10938, 2023-07-21T23:09:36.122 INFO:teuthology.orchestra.run.smithi195.stdout: "op_latency": { 2023-07-21T23:09:36.122 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 10938, 2023-07-21T23:09:36.123 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 13.299746679, 2023-07-21T23:09:36.123 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.001215921 2023-07-21T23:09:36.123 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.123 INFO:teuthology.orchestra.run.smithi195.stdout: "op_inflight": 0, 2023-07-21T23:09:36.123 INFO:teuthology.orchestra.run.smithi195.stdout: "oplen_avg": { 2023-07-21T23:09:36.123 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 10938, 2023-07-21T23:09:36.123 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 10939 2023-07-21T23:09:36.124 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.124 INFO:teuthology.orchestra.run.smithi195.stdout: "op": 10938, 2023-07-21T23:09:36.124 INFO:teuthology.orchestra.run.smithi195.stdout: "op_r": 10938, 2023-07-21T23:09:36.124 INFO:teuthology.orchestra.run.smithi195.stdout: "op_w": 0, 2023-07-21T23:09:36.124 INFO:teuthology.orchestra.run.smithi195.stdout: "op_rmw": 0, 2023-07-21T23:09:36.124 INFO:teuthology.orchestra.run.smithi195.stdout: "op_pg": 0, 2023-07-21T23:09:36.124 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_stat": 6402, 2023-07-21T23:09:36.124 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_create": 0, 2023-07-21T23:09:36.125 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_read": 4534, 2023-07-21T23:09:36.125 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_write": 0, 2023-07-21T23:09:36.125 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writefull": 0, 2023-07-21T23:09:36.125 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_writesame": 0, 2023-07-21T23:09:36.125 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_append": 0, 2023-07-21T23:09:36.125 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_zero": 0, 2023-07-21T23:09:36.125 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_truncate": 0, 2023-07-21T23:09:36.125 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_delete": 0, 2023-07-21T23:09:36.126 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_mapext": 0, 2023-07-21T23:09:36.126 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_sparse_read": 0, 2023-07-21T23:09:36.126 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_clonerange": 0, 2023-07-21T23:09:36.126 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_getxattr": 1, 2023-07-21T23:09:36.126 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_setxattr": 0, 2023-07-21T23:09:36.126 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_cmpxattr": 0, 2023-07-21T23:09:36.126 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_rmxattr": 0, 2023-07-21T23:09:36.126 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_resetxattrs": 0, 2023-07-21T23:09:36.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_call": 0, 2023-07-21T23:09:36.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_watch": 0, 2023-07-21T23:09:36.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_notify": 0, 2023-07-21T23:09:36.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_src_cmpxattr": 0, 2023-07-21T23:09:36.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls": 0, 2023-07-21T23:09:36.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_pgls_filter": 0, 2023-07-21T23:09:36.127 INFO:teuthology.orchestra.run.smithi195.stdout: "osdop_other": 0, 2023-07-21T23:09:36.128 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_active": 0, 2023-07-21T23:09:36.128 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_send": 0, 2023-07-21T23:09:36.128 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_resend": 0, 2023-07-21T23:09:36.128 INFO:teuthology.orchestra.run.smithi195.stdout: "linger_ping": 0, 2023-07-21T23:09:36.128 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_active": 0, 2023-07-21T23:09:36.128 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_send": 0, 2023-07-21T23:09:36.128 INFO:teuthology.orchestra.run.smithi195.stdout: "poolop_resend": 0, 2023-07-21T23:09:36.128 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_active": 0, 2023-07-21T23:09:36.129 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_send": 0, 2023-07-21T23:09:36.129 INFO:teuthology.orchestra.run.smithi195.stdout: "poolstat_resend": 0, 2023-07-21T23:09:36.129 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_active": 0, 2023-07-21T23:09:36.129 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_send": 0, 2023-07-21T23:09:36.129 INFO:teuthology.orchestra.run.smithi195.stdout: "statfs_resend": 0, 2023-07-21T23:09:36.129 INFO:teuthology.orchestra.run.smithi195.stdout: "command_active": 0, 2023-07-21T23:09:36.129 INFO:teuthology.orchestra.run.smithi195.stdout: "command_send": 0, 2023-07-21T23:09:36.129 INFO:teuthology.orchestra.run.smithi195.stdout: "command_resend": 0, 2023-07-21T23:09:36.130 INFO:teuthology.orchestra.run.smithi195.stdout: "map_epoch": 177, 2023-07-21T23:09:36.130 INFO:teuthology.orchestra.run.smithi195.stdout: "map_full": 0, 2023-07-21T23:09:36.130 INFO:teuthology.orchestra.run.smithi195.stdout: "map_inc": 92, 2023-07-21T23:09:36.130 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_sessions": 11, 2023-07-21T23:09:36.130 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_open": 14, 2023-07-21T23:09:36.130 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_session_close": 3, 2023-07-21T23:09:36.130 INFO:teuthology.orchestra.run.smithi195.stdout: "osd_laggy": 0, 2023-07-21T23:09:36.130 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_wr": 0, 2023-07-21T23:09:36.131 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_rd": 2, 2023-07-21T23:09:36.131 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_del": 0 2023-07-21T23:09:36.131 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.131 INFO:teuthology.orchestra.run.smithi195.stdout: "oft": { 2023-07-21T23:09:36.131 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_objs": 0, 2023-07-21T23:09:36.131 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_kv_pairs": 0, 2023-07-21T23:09:36.131 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_updates": 0, 2023-07-21T23:09:36.132 INFO:teuthology.orchestra.run.smithi195.stdout: "omap_total_removes": 0 2023-07-21T23:09:36.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.132 INFO:teuthology.orchestra.run.smithi195.stdout: "osd-slow-ops": { 2023-07-21T23:09:36.132 INFO:teuthology.orchestra.run.smithi195.stdout: "slow_ops_count": 0 2023-07-21T23:09:36.132 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.132 INFO:teuthology.orchestra.run.smithi195.stdout: "purge_queue": { 2023-07-21T23:09:36.132 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops": 0, 2023-07-21T23:09:36.132 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_ops_high_water": 0, 2023-07-21T23:09:36.133 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing": 0, 2023-07-21T23:09:36.133 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executing_high_water": 0, 2023-07-21T23:09:36.133 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_executed": 0, 2023-07-21T23:09:36.133 INFO:teuthology.orchestra.run.smithi195.stdout: "pq_item_in_journal": 0 2023-07-21T23:09:36.133 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.133 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-msgr_dispatch_throttler-mds": { 2023-07-21T23:09:36.133 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:36.134 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-07-21T23:09:36.134 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:36.134 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 11985, 2023-07-21T23:09:36.134 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 468191869, 2023-07-21T23:09:36.134 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:36.134 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 11985, 2023-07-21T23:09:36.134 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-07-21T23:09:36.134 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-07-21T23:09:36.135 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 11985, 2023-07-21T23:09:36.135 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 468191869, 2023-07-21T23:09:36.135 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:36.135 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.135 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.135 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.135 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:36.135 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.136 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_bytes": { 2023-07-21T23:09:36.136 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:36.136 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 104857600, 2023-07-21T23:09:36.136 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:36.136 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-07-21T23:09:36.136 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-07-21T23:09:36.136 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:36.137 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:36.137 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 10938, 2023-07-21T23:09:36.137 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 464213029, 2023-07-21T23:09:36.137 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 10938, 2023-07-21T23:09:36.137 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 464213029, 2023-07-21T23:09:36.137 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:36.137 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.137 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.138 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.138 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:36.138 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.138 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-objecter_ops": { 2023-07-21T23:09:36.138 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:36.138 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 1024, 2023-07-21T23:09:36.138 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:36.138 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-07-21T23:09:36.139 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-07-21T23:09:36.139 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:36.139 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:36.139 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 10938, 2023-07-21T23:09:36.139 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 10938, 2023-07-21T23:09:36.139 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 10938, 2023-07-21T23:09:36.139 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 10938, 2023-07-21T23:09:36.140 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:36.140 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.140 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.140 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.140 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:36.140 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.140 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle": { 2023-07-21T23:09:36.140 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:36.141 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-07-21T23:09:36.141 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:36.141 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-07-21T23:09:36.141 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-07-21T23:09:36.141 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:36.141 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:36.141 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-07-21T23:09:36.142 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-07-21T23:09:36.142 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2023-07-21T23:09:36.142 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2023-07-21T23:09:36.142 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:36.142 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.142 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.142 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.142 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:36.143 INFO:teuthology.orchestra.run.smithi195.stdout: }, 2023-07-21T23:09:36.143 INFO:teuthology.orchestra.run.smithi195.stdout: "throttle-write_buf_throttle-0x5639029e2500": { 2023-07-21T23:09:36.143 INFO:teuthology.orchestra.run.smithi195.stdout: "val": 0, 2023-07-21T23:09:36.143 INFO:teuthology.orchestra.run.smithi195.stdout: "max": 3758096384, 2023-07-21T23:09:36.143 INFO:teuthology.orchestra.run.smithi195.stdout: "get_started": 0, 2023-07-21T23:09:36.143 INFO:teuthology.orchestra.run.smithi195.stdout: "get": 0, 2023-07-21T23:09:36.143 INFO:teuthology.orchestra.run.smithi195.stdout: "get_sum": 0, 2023-07-21T23:09:36.143 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_fail": 0, 2023-07-21T23:09:36.144 INFO:teuthology.orchestra.run.smithi195.stdout: "get_or_fail_success": 0, 2023-07-21T23:09:36.144 INFO:teuthology.orchestra.run.smithi195.stdout: "take": 0, 2023-07-21T23:09:36.144 INFO:teuthology.orchestra.run.smithi195.stdout: "take_sum": 0, 2023-07-21T23:09:36.144 INFO:teuthology.orchestra.run.smithi195.stdout: "put": 0, 2023-07-21T23:09:36.144 INFO:teuthology.orchestra.run.smithi195.stdout: "put_sum": 0, 2023-07-21T23:09:36.144 INFO:teuthology.orchestra.run.smithi195.stdout: "wait": { 2023-07-21T23:09:36.144 INFO:teuthology.orchestra.run.smithi195.stdout: "avgcount": 0, 2023-07-21T23:09:36.144 INFO:teuthology.orchestra.run.smithi195.stdout: "sum": 0.000000000, 2023-07-21T23:09:36.145 INFO:teuthology.orchestra.run.smithi195.stdout: "avgtime": 0.000000000 2023-07-21T23:09:36.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:36.145 INFO:teuthology.orchestra.run.smithi195.stdout: } 2023-07-21T23:09:36.145 INFO:teuthology.orchestra.run.smithi195.stdout:} 2023-07-21T23:09:36.528 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2023-07-21T23:09:36.528 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2023-07-21T23:09:36.528 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2023-07-21T23:09:36.528 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2023-07-21T23:09:36.528 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2023-07-21T23:09:36.529 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2023-07-21T23:09:36.529 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2023-07-21T23:09:36.529 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-07-21T23:09:36.540 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-07-21T23:09:36.540 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T23:09:36.540 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T23:09:36.656 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T23:09:36.657 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T23:09:36.706 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T23:09:36.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.920+0000 7fc373dff700 1 -- 172.21.15.151:0/174637136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c105b00 msgr2=0x7fc36c105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:36.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.920+0000 7fc373dff700 1 --2- 172.21.15.151:0/174637136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c105b00 0x7fc36c105ed0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fc368009990 tx=0x7fc368009ca0 comp rx=0 tx=0).stop 2023-07-21T23:09:36.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.920+0000 7fc373dff700 1 -- 172.21.15.151:0/174637136 shutdown_connections 2023-07-21T23:09:36.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.920+0000 7fc373dff700 1 --2- 172.21.15.151:0/174637136 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc36c1004a0 0x7fc36c10c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:36.952 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.920+0000 7fc373dff700 1 --2- 172.21.15.151:0/174637136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c105b00 0x7fc36c105ed0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.920+0000 7fc373dff700 1 --2- 172.21.15.151:0/174637136 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc36c0ffaf0 0x7fc36c0fff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.920+0000 7fc373dff700 1 -- 172.21.15.151:0/174637136 >> 172.21.15.151:0/174637136 conn(0x7fc36c0fb630 msgr2=0x7fc36c0fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.920+0000 7fc373dff700 1 -- 172.21.15.151:0/174637136 shutdown_connections 2023-07-21T23:09:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.920+0000 7fc373dff700 1 -- 172.21.15.151:0/174637136 wait complete. 2023-07-21T23:09:36.953 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.921+0000 7fc373dff700 1 Processor -- start 2023-07-21T23:09:36.954 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc373dff700 1 -- start start 2023-07-21T23:09:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc373dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c0ffaf0 0x7fc36c19b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc373dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc36c1004a0 0x7fc36c19bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc373dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc36c105b00 0x7fc36c195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc373dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c195fd0 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc373dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c196140 con 0x7fc36c105b00 2023-07-21T23:09:36.955 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc373dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc36c196300 con 0x7fc36c1004a0 2023-07-21T23:09:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc371b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c0ffaf0 0x7fc36c19b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc371b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c0ffaf0 0x7fc36c19b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44158/0 (socket says 172.21.15.151:44158) 2023-07-21T23:09:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.922+0000 7fc371b9b700 1 -- 172.21.15.151:0/2873631996 learned_addr learned my addr 172.21.15.151:0/2873631996 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc37139a700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc36c1004a0 0x7fc36c19bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc37239c700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc36c105b00 0x7fc36c195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc371b9b700 1 -- 172.21.15.151:0/2873631996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc36c1004a0 msgr2=0x7fc36c19bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:36.956 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc371b9b700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc36c1004a0 0x7fc36c19bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc371b9b700 1 -- 172.21.15.151:0/2873631996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc36c105b00 msgr2=0x7fc36c195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc371b9b700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc36c105b00 0x7fc36c195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc371b9b700 1 -- 172.21.15.151:0/2873631996 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3680095f0 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc37239c700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc36c105b00 0x7fc36c195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:09:36.957 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc371b9b700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c0ffaf0 0x7fc36c19b8a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc368005910 tx=0x7fc3680047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc362ffd700 1 -- 172.21.15.151:0/2873631996 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc36801d070 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc36c196580 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc362ffd700 1 -- 172.21.15.151:0/2873631996 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fc368021410 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.923+0000 7fc362ffd700 1 -- 172.21.15.151:0/2873631996 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc368017650 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.924+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc36c1a2890 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.958 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.925+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc36c067300 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.926+0000 7fc362ffd700 1 -- 172.21.15.151:0/2873631996 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fc36800fb00 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.959 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.928+0000 7fc362ffd700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc3580a1380 0x7fc3580a3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:36.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.928+0000 7fc362ffd700 1 -- 172.21.15.151:0/2873631996 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fc3680ce150 con 0x7fc36c0ffaf0 2023-07-21T23:09:36.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.928+0000 7fc37139a700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc3580a1380 0x7fc3580a3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:36.960 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.929+0000 7fc37139a700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc3580a1380 0x7fc3580a3830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0fdfd0 tx=0x7fc35c00b410 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:36.964 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:36.932+0000 7fc362ffd700 1 -- 172.21.15.151:0/2873631996 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fc368097610 con 0x7fc36c0ffaf0 2023-07-21T23:09:37.166 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.133+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc36c196e20 con 0x7fc36c0ffaf0 2023-07-21T23:09:37.167 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.134+0000 7fc362ffd700 1 -- 172.21.15.151:0/2873631996 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+23056 (secure 0 0 0) 0x7fc36809ac30 con 0x7fc36c0ffaf0 2023-07-21T23:09:37.167 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:09:37.167 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":177,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T23:09:22.172187+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":94,"snap_epoch":176,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2857691582":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6800/3677157440":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6801/3677157440":"2023-07-22T22:19:10.841711+0000","172.21.15.151:0/117839627":"2023-07-22T22:19:10.841711+0000","172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1323163778":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/4119562225":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":82,"length":1},{"begin":94,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T23:09:37.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc3580a1380 msgr2=0x7fc3580a3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc3580a1380 0x7fc3580a3830 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fc36c0fdfd0 tx=0x7fc35c00b410 comp rx=0 tx=0).stop 2023-07-21T23:09:37.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c0ffaf0 msgr2=0x7fc36c19b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c0ffaf0 0x7fc36c19b8a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7fc368005910 tx=0x7fc3680047b0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 shutdown_connections 2023-07-21T23:09:37.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fc3580a1380 0x7fc3580a3830 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc36c105b00 0x7fc36c195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc36c0ffaf0 0x7fc36c19b8a0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 --2- 172.21.15.151:0/2873631996 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fc36c1004a0 0x7fc36c19bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 >> 172.21.15.151:0/2873631996 conn(0x7fc36c0fb630 msgr2=0x7fc36c0fbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:37.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 shutdown_connections 2023-07-21T23:09:37.170 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.137+0000 7fc373dff700 1 -- 172.21.15.151:0/2873631996 wait complete. 2023-07-21T23:09:37.188 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 94, 'snap_epoch': 176, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T23:09:37.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T23:09:37.393 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.361+0000 7f5a57bff700 1 -- 172.21.15.151:0/4088211094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500728b0 msgr2=0x7f5a50072c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.361+0000 7f5a57bff700 1 --2- 172.21.15.151:0/4088211094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500728b0 0x7f5a50072c80 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c009990 tx=0x7f5a4c009ca0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.362+0000 7f5a57bff700 1 -- 172.21.15.151:0/4088211094 shutdown_connections 2023-07-21T23:09:37.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.362+0000 7f5a57bff700 1 --2- 172.21.15.151:0/4088211094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a5010c320 0x7f5a5010e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.362+0000 7f5a57bff700 1 --2- 172.21.15.151:0/4088211094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500728b0 0x7f5a50072c80 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.394 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.362+0000 7f5a57bff700 1 --2- 172.21.15.151:0/4088211094 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a500731c0 0x7f5a5010bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.362+0000 7f5a57bff700 1 -- 172.21.15.151:0/4088211094 >> 172.21.15.151:0/4088211094 conn(0x7f5a500fb5e0 msgr2=0x7f5a500fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:37.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.362+0000 7f5a57bff700 1 -- 172.21.15.151:0/4088211094 shutdown_connections 2023-07-21T23:09:37.395 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.362+0000 7f5a57bff700 1 -- 172.21.15.151:0/4088211094 wait complete. 2023-07-21T23:09:37.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a57bff700 1 Processor -- start 2023-07-21T23:09:37.396 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a57bff700 1 -- start start 2023-07-21T23:09:37.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a57bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a500728b0 0x7f5a50197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:37.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a57bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500731c0 0x7f5a50198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:37.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a57bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a5010c320 0x7f5a5019c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:37.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a57bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5019cd20 con 0x7f5a500731c0 2023-07-21T23:09:37.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a57bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5019ce90 con 0x7f5a500728b0 2023-07-21T23:09:37.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a57bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a5019d050 con 0x7f5a5010c320 2023-07-21T23:09:37.397 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a5519a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500731c0 0x7f5a50198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:37.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a5519a700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500731c0 0x7f5a50198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44172/0 (socket says 172.21.15.151:44172) 2023-07-21T23:09:37.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a5519a700 1 -- 172.21.15.151:0/3947798002 learned_addr learned my addr 172.21.15.151:0/3947798002 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:37.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.363+0000 7f5a5599b700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a500728b0 0x7f5a50197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:37.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a5619c700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a5010c320 0x7f5a5019c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:37.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a5519a700 1 -- 172.21.15.151:0/3947798002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a5010c320 msgr2=0x7f5a5019c6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a5519a700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a5010c320 0x7f5a5019c6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.398 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a5519a700 1 -- 172.21.15.151:0/3947798002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a500728b0 msgr2=0x7f5a50197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a5519a700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a500728b0 0x7f5a50197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a5519a700 1 -- 172.21.15.151:0/3947798002 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4c0095f0 con 0x7f5a500731c0 2023-07-21T23:09:37.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a5619c700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a5010c320 0x7f5a5019c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:09:37.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a5519a700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500731c0 0x7f5a50198280 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000e9a0 tx=0x7f5a4000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:37.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a46ffd700 1 -- 172.21.15.151:0/3947798002 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40009790 con 0x7f5a500731c0 2023-07-21T23:09:37.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a5019d330 con 0x7f5a500731c0 2023-07-21T23:09:37.399 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a46ffd700 1 -- 172.21.15.151:0/3947798002 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f5a4000cbd0 con 0x7f5a500731c0 2023-07-21T23:09:37.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a46ffd700 1 -- 172.21.15.151:0/3947798002 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40018680 con 0x7f5a500731c0 2023-07-21T23:09:37.400 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.364+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a501a4b70 con 0x7f5a500731c0 2023-07-21T23:09:37.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.365+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a50107530 con 0x7f5a500731c0 2023-07-21T23:09:37.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.367+0000 7f5a46ffd700 1 -- 172.21.15.151:0/3947798002 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f5a4000cd40 con 0x7f5a500731c0 2023-07-21T23:09:37.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.369+0000 7f5a46ffd700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a3c0a12c0 0x7f5a3c0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:37.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.369+0000 7f5a46ffd700 1 -- 172.21.15.151:0/3947798002 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f5a40014070 con 0x7f5a500731c0 2023-07-21T23:09:37.401 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.369+0000 7f5a5599b700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a3c0a12c0 0x7f5a3c0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:37.402 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.370+0000 7f5a5599b700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a3c0a12c0 0x7f5a3c0a3770 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c006010 tx=0x7f5a4c00b260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:37.404 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.373+0000 7f5a46ffd700 1 -- 172.21.15.151:0/3947798002 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f5a40051770 con 0x7f5a500731c0 2023-07-21T23:09:37.436 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:37 smithi151 ceph-mon[95510]: pgmap v1605: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:09:37.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:37 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2873631996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T23:09:37.604 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.572+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5a5002c910 con 0x7f5a500731c0 2023-07-21T23:09:37.605 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.573+0000 7f5a46ffd700 1 -- 172.21.15.151:0/3947798002 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5a400963d0 con 0x7f5a500731c0 2023-07-21T23:09:37.605 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T23:09:37.607 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a3c0a12c0 msgr2=0x7f5a3c0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a3c0a12c0 0x7f5a3c0a3770 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5a4c006010 tx=0x7f5a4c00b260 comp rx=0 tx=0).stop 2023-07-21T23:09:37.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500731c0 msgr2=0x7f5a50198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.608 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500731c0 0x7f5a50198280 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f5a4000e9a0 tx=0x7f5a4000ecb0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 shutdown_connections 2023-07-21T23:09:37.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f5a3c0a12c0 0x7f5a3c0a3770 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.609 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a500728b0 0x7f5a50197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f5a5010c320 0x7f5a5019c6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 --2- 172.21.15.151:0/3947798002 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5a500731c0 0x7f5a50198280 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 >> 172.21.15.151:0/3947798002 conn(0x7f5a500fb5e0 msgr2=0x7f5a5010d5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:37.610 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 shutdown_connections 2023-07-21T23:09:37.611 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.575+0000 7f5a57bff700 1 -- 172.21.15.151:0/3947798002 wait complete. 2023-07-21T23:09:37.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:37 smithi187 ceph-mon[96918]: pgmap v1605: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:09:37.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:37 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2873631996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T23:09:37.626 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T23:09:37.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:37 smithi195 ceph-mon[97365]: pgmap v1605: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:09:37.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:37 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2873631996' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T23:09:37.829 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.796+0000 7f38c3bff700 1 -- 172.21.15.151:0/2299807561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc073160 msgr2=0x7f38bc10be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.796+0000 7f38c3bff700 1 --2- 172.21.15.151:0/2299807561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc073160 0x7f38bc10be60 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f38ac009990 tx=0x7f38ac009ca0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.796+0000 7f38c3bff700 1 -- 172.21.15.151:0/2299807561 shutdown_connections 2023-07-21T23:09:37.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.796+0000 7f38c3bff700 1 --2- 172.21.15.151:0/2299807561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38bc072850 0x7f38bc072c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.796+0000 7f38c3bff700 1 --2- 172.21.15.151:0/2299807561 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38bc10c3a0 0x7f38bc10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.796+0000 7f38c3bff700 1 --2- 172.21.15.151:0/2299807561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc073160 0x7f38bc10be60 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.830 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.796+0000 7f38c3bff700 1 -- 172.21.15.151:0/2299807561 >> 172.21.15.151:0/2299807561 conn(0x7f38bc0fb600 msgr2=0x7f38bc0fda10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:37.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.796+0000 7f38c3bff700 1 -- 172.21.15.151:0/2299807561 shutdown_connections 2023-07-21T23:09:37.831 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.797+0000 7f38c3bff700 1 -- 172.21.15.151:0/2299807561 wait complete. 2023-07-21T23:09:37.832 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.798+0000 7f38c3bff700 1 Processor -- start 2023-07-21T23:09:37.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.798+0000 7f38c3bff700 1 -- start start 2023-07-21T23:09:37.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.798+0000 7f38c3bff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38bc072850 0x7f38bc197d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:37.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.798+0000 7f38c3bff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38bc073160 0x7f38bc1982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:37.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.798+0000 7f38c3bff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc10c3a0 0x7f38bc19c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:37.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.798+0000 7f38c3bff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc19cd60 con 0x7f38bc10c3a0 2023-07-21T23:09:37.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.798+0000 7f38c3bff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc19ced0 con 0x7f38bc072850 2023-07-21T23:09:37.833 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.798+0000 7f38c3bff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38bc19d090 con 0x7f38bc073160 2023-07-21T23:09:37.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c219c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc10c3a0 0x7f38bc19c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:37.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c219c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc10c3a0 0x7f38bc19c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44188/0 (socket says 172.21.15.151:44188) 2023-07-21T23:09:37.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c199b700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38bc072850 0x7f38bc197d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:37.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c219c700 1 -- 172.21.15.151:0/1679114677 learned_addr learned my addr 172.21.15.151:0/1679114677 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:37.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c119a700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38bc073160 0x7f38bc1982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:37.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c219c700 1 -- 172.21.15.151:0/1679114677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38bc073160 msgr2=0x7f38bc1982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c219c700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38bc073160 0x7f38bc1982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.834 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c219c700 1 -- 172.21.15.151:0/1679114677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38bc072850 msgr2=0x7f38bc197d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:37.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c219c700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38bc072850 0x7f38bc197d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:37.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c219c700 1 -- 172.21.15.151:0/1679114677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38b8009520 con 0x7f38bc10c3a0 2023-07-21T23:09:37.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38c219c700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc10c3a0 0x7f38bc19c720 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009fd0 tx=0x7f38b400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:37.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.799+0000 7f38b2ffd700 1 -- 172.21.15.151:0/1679114677 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b4018070 con 0x7f38bc10c3a0 2023-07-21T23:09:37.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.800+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38ac0095f0 con 0x7f38bc10c3a0 2023-07-21T23:09:37.835 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.800+0000 7f38b2ffd700 1 -- 172.21.15.151:0/1679114677 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f38b400f040 con 0x7f38bc10c3a0 2023-07-21T23:09:37.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.800+0000 7f38b2ffd700 1 -- 172.21.15.151:0/1679114677 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38b400cc80 con 0x7f38bc10c3a0 2023-07-21T23:09:37.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.800+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38bc1a49d0 con 0x7f38bc10c3a0 2023-07-21T23:09:37.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.801+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38bc067290 con 0x7f38bc10c3a0 2023-07-21T23:09:37.836 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.804+0000 7f38b2ffd700 1 -- 172.21.15.151:0/1679114677 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f38b4003a00 con 0x7f38bc10c3a0 2023-07-21T23:09:37.837 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.806+0000 7f38b2ffd700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38a80a12c0 0x7f38a80a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:37.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.806+0000 7f38b2ffd700 1 -- 172.21.15.151:0/1679114677 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f38b40ccc80 con 0x7f38bc10c3a0 2023-07-21T23:09:37.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.806+0000 7f38c199b700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38a80a12c0 0x7f38a80a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:37.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.806+0000 7f38b2ffd700 1 -- 172.21.15.151:0/1679114677 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f38b40960e0 con 0x7f38bc10c3a0 2023-07-21T23:09:37.839 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:37.807+0000 7f38c199b700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38a80a12c0 0x7f38a80a3770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009df0 tx=0x7f38b8009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:38.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.008+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f38bc1a4bc0 con 0x7f38bc10c3a0 2023-07-21T23:09:38.041 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.009+0000 7f38b2ffd700 1 -- 172.21.15.151:0/1679114677 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v177) v1 ==== 104+0+11 (secure 0 0 0) 0x7f38b4099700 con 0x7f38bc10c3a0 2023-07-21T23:09:38.042 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T23:09:38.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38a80a12c0 msgr2=0x7f38a80a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38a80a12c0 0x7f38a80a3770 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f38b8009df0 tx=0x7f38b8009260 comp rx=0 tx=0).stop 2023-07-21T23:09:38.044 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc10c3a0 msgr2=0x7f38bc19c720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc10c3a0 0x7f38bc19c720 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f38b4009fd0 tx=0x7f38b400ef90 comp rx=0 tx=0).stop 2023-07-21T23:09:38.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 shutdown_connections 2023-07-21T23:09:38.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f38a80a12c0 0x7f38a80a3770 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.045 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38bc072850 0x7f38bc197d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38bc10c3a0 0x7f38bc19c720 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 --2- 172.21.15.151:0/1679114677 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f38bc073160 0x7f38bc1982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.046 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.011+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 >> 172.21.15.151:0/1679114677 conn(0x7f38bc0fb600 msgr2=0x7f38bc10e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:38.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.012+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 shutdown_connections 2023-07-21T23:09:38.047 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.012+0000 7f38c3bff700 1 -- 172.21.15.151:0/1679114677 wait complete. 2023-07-21T23:09:38.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T23:09:38.265 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.233+0000 7f837b1ff700 1 -- 172.21.15.151:0/2046666447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83740ffae0 msgr2=0x7f83740fff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.233+0000 7f837b1ff700 1 --2- 172.21.15.151:0/2046666447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83740ffae0 0x7f83740fff50 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f8360009990 tx=0x7f8360009ca0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.233+0000 7f837b1ff700 1 -- 172.21.15.151:0/2046666447 shutdown_connections 2023-07-21T23:09:38.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.233+0000 7f837b1ff700 1 --2- 172.21.15.151:0/2046666447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8374105af0 0x7f8374105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.233+0000 7f837b1ff700 1 --2- 172.21.15.151:0/2046666447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8374100490 0x7f837410c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.233+0000 7f837b1ff700 1 --2- 172.21.15.151:0/2046666447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83740ffae0 0x7f83740fff50 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.233+0000 7f837b1ff700 1 -- 172.21.15.151:0/2046666447 >> 172.21.15.151:0/2046666447 conn(0x7f83740fb5e0 msgr2=0x7f83740fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:38.266 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.233+0000 7f837b1ff700 1 -- 172.21.15.151:0/2046666447 shutdown_connections 2023-07-21T23:09:38.267 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.233+0000 7f837b1ff700 1 -- 172.21.15.151:0/2046666447 wait complete. 2023-07-21T23:09:38.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.234+0000 7f837b1ff700 1 Processor -- start 2023-07-21T23:09:38.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.234+0000 7f837b1ff700 1 -- start start 2023-07-21T23:09:38.268 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837b1ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83740ffae0 0x7f8374197cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:38.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837b1ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8374100490 0x7f8374198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:38.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837b1ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8374105af0 0x7f837419b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:38.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837b1ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837419bbb0 con 0x7f8374105af0 2023-07-21T23:09:38.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837b1ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837419bd20 con 0x7f8374100490 2023-07-21T23:09:38.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837b1ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837419bee0 con 0x7f83740ffae0 2023-07-21T23:09:38.269 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837979c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8374105af0 0x7f837419b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:38.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837979c700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8374105af0 0x7f837419b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44208/0 (socket says 172.21.15.151:44208) 2023-07-21T23:09:38.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837979c700 1 -- 172.21.15.151:0/3816334139 learned_addr learned my addr 172.21.15.151:0/3816334139 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:38.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f8378f9b700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83740ffae0 0x7f8374197cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:38.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837979c700 1 -- 172.21.15.151:0/3816334139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83740ffae0 msgr2=0x7f8374197cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837979c700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83740ffae0 0x7f8374197cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f8373fff700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8374100490 0x7f8374198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:38.270 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.235+0000 7f837979c700 1 -- 172.21.15.151:0/3816334139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8374100490 msgr2=0x7f8374198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.236+0000 7f837979c700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8374100490 0x7f8374198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.236+0000 7f837979c700 1 -- 172.21.15.151:0/3816334139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83600095f0 con 0x7f8374105af0 2023-07-21T23:09:38.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.236+0000 7f8373fff700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8374100490 0x7f8374198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:09:38.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.236+0000 7f837979c700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8374105af0 0x7f837419b5b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f836c007d70 tx=0x7f836c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:38.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.236+0000 7f8371ffb700 1 -- 172.21.15.151:0/3816334139 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c00ad40 con 0x7f8374105af0 2023-07-21T23:09:38.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.236+0000 7f8371ffb700 1 -- 172.21.15.151:0/3816334139 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f836c0128b0 con 0x7f8374105af0 2023-07-21T23:09:38.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.236+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837419c1c0 con 0x7f8374105af0 2023-07-21T23:09:38.271 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.236+0000 7f8371ffb700 1 -- 172.21.15.151:0/3816334139 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f836c0116b0 con 0x7f8374105af0 2023-07-21T23:09:38.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.236+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83741a4b20 con 0x7f8374105af0 2023-07-21T23:09:38.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.237+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8374067290 con 0x7f8374105af0 2023-07-21T23:09:38.272 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.239+0000 7f8371ffb700 1 -- 172.21.15.151:0/3816334139 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f836c012a20 con 0x7f8374105af0 2023-07-21T23:09:38.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.241+0000 7f8371ffb700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f83640a1340 0x7f83640a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:38.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.241+0000 7f8371ffb700 1 -- 172.21.15.151:0/3816334139 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f836c0cce90 con 0x7f8374105af0 2023-07-21T23:09:38.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.241+0000 7f8378f9b700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f83640a1340 0x7f83640a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:38.273 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.242+0000 7f8378f9b700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f83640a1340 0x7f83640a37f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8368005950 tx=0x7f83680058e0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:38.276 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.245+0000 7f8371ffb700 1 -- 172.21.15.151:0/3816334139 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f836c096370 con 0x7f8374105af0 2023-07-21T23:09:38.436 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:38 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3947798002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T23:09:38.437 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:38 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1679114677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T23:09:38.481 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.449+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83741a4e10 con 0x7f8374105af0 2023-07-21T23:09:38.482 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.450+0000 7f8371ffb700 1 -- 172.21.15.151:0/3816334139 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v177) v1 ==== 100+0+11 (secure 0 0 0) 0x7f836c0160a0 con 0x7f8374105af0 2023-07-21T23:09:38.482 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T23:09:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f83640a1340 msgr2=0x7f83640a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f83640a1340 0x7f83640a37f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f8368005950 tx=0x7f83680058e0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8374105af0 msgr2=0x7f837419b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8374105af0 0x7f837419b5b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f836c007d70 tx=0x7f836c00a340 comp rx=0 tx=0).stop 2023-07-21T23:09:38.484 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 shutdown_connections 2023-07-21T23:09:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f83640a1340 0x7f83640a37f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8374105af0 0x7f837419b5b0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f83740ffae0 0x7f8374197cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 --2- 172.21.15.151:0/3816334139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8374100490 0x7f8374198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 >> 172.21.15.151:0/3816334139 conn(0x7f83740fb5e0 msgr2=0x7f837410ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 shutdown_connections 2023-07-21T23:09:38.485 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.452+0000 7f837b1ff700 1 -- 172.21.15.151:0/3816334139 wait complete. 2023-07-21T23:09:38.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T23:09:38.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:38 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3947798002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T23:09:38.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:38 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1679114677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T23:09:38.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:38 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3947798002' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T23:09:38.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:38 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1679114677' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T23:09:38.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.672+0000 7fe312dff700 1 -- 172.21.15.151:0/3798144716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 msgr2=0x7fe30c10c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.672+0000 7fe312dff700 1 --2- 172.21.15.151:0/3798144716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 0x7fe30c10c920 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fe30400b0a0 tx=0x7fe30400b3b0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.672+0000 7fe312dff700 1 -- 172.21.15.151:0/3798144716 shutdown_connections 2023-07-21T23:09:38.704 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.672+0000 7fe312dff700 1 --2- 172.21.15.151:0/3798144716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe30c105af0 0x7fe30c105ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.672+0000 7fe312dff700 1 --2- 172.21.15.151:0/3798144716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 0x7fe30c10c920 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.672+0000 7fe312dff700 1 --2- 172.21.15.151:0/3798144716 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe30c0ffae0 0x7fe30c0fff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.672+0000 7fe312dff700 1 -- 172.21.15.151:0/3798144716 >> 172.21.15.151:0/3798144716 conn(0x7fe30c0fb5e0 msgr2=0x7fe30c0fd9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.672+0000 7fe312dff700 1 -- 172.21.15.151:0/3798144716 shutdown_connections 2023-07-21T23:09:38.705 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.672+0000 7fe312dff700 1 -- 172.21.15.151:0/3798144716 wait complete. 2023-07-21T23:09:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.673+0000 7fe312dff700 1 Processor -- start 2023-07-21T23:09:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.673+0000 7fe312dff700 1 -- start start 2023-07-21T23:09:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.673+0000 7fe312dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe30c0ffae0 0x7fe30c19b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:38.707 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.673+0000 7fe312dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 0x7fe30c19be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.673+0000 7fe312dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe30c105af0 0x7fe30c1959b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.673+0000 7fe312dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c196020 con 0x7fe30c100490 2023-07-21T23:09:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.673+0000 7fe312dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c196190 con 0x7fe30c105af0 2023-07-21T23:09:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.673+0000 7fe312dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe30c196350 con 0x7fe30c0ffae0 2023-07-21T23:09:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe30bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 0x7fe30c19be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe30bfff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 0x7fe30c19be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44228/0 (socket says 172.21.15.151:44228) 2023-07-21T23:09:38.708 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe30bfff700 1 -- 172.21.15.151:0/1689764298 learned_addr learned my addr 172.21.15.151:0/1689764298 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe310b9b700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe30c0ffae0 0x7fe30c19b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe31139c700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe30c105af0 0x7fe30c1959b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe30bfff700 1 -- 172.21.15.151:0/1689764298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe30c0ffae0 msgr2=0x7fe30c19b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe30bfff700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe30c0ffae0 0x7fe30c19b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe30bfff700 1 -- 172.21.15.151:0/1689764298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe30c105af0 msgr2=0x7fe30c1959b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe30bfff700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe30c105af0 0x7fe30c1959b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.709 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe30bfff700 1 -- 172.21.15.151:0/1689764298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe304009d00 con 0x7fe30c100490 2023-07-21T23:09:38.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.674+0000 7fe30bfff700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 0x7fe30c19be80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800e9a0 tx=0x7fe2f800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:38.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.675+0000 7fe309ffb700 1 -- 172.21.15.151:0/1689764298 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8009790 con 0x7fe30c100490 2023-07-21T23:09:38.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.675+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe30c196630 con 0x7fe30c100490 2023-07-21T23:09:38.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.675+0000 7fe309ffb700 1 -- 172.21.15.151:0/1689764298 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fe2f800cbd0 con 0x7fe30c100490 2023-07-21T23:09:38.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.675+0000 7fe309ffb700 1 -- 172.21.15.151:0/1689764298 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2f8018680 con 0x7fe30c100490 2023-07-21T23:09:38.710 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.675+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe30c1a2930 con 0x7fe30c100490 2023-07-21T23:09:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.676+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe30c067290 con 0x7fe30c100490 2023-07-21T23:09:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.678+0000 7fe309ffb700 1 -- 172.21.15.151:0/1689764298 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fe2f800cd40 con 0x7fe30c100490 2023-07-21T23:09:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.679+0000 7fe309ffb700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe2fc0a1340 0x7fe2fc0a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.679+0000 7fe309ffb700 1 -- 172.21.15.151:0/1689764298 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fe2f8014070 con 0x7fe30c100490 2023-07-21T23:09:38.711 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.679+0000 7fe310b9b700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe2fc0a1340 0x7fe2fc0a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:38.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.680+0000 7fe310b9b700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe2fc0a1340 0x7fe2fc0a37f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe300005fd0 tx=0x7fe30000af20 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:38.712 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.681+0000 7fe309ffb700 1 -- 172.21.15.151:0/1689764298 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fe2f8096610 con 0x7fe30c100490 2023-07-21T23:09:38.926 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.894+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe30c196ec0 con 0x7fe30c100490 2023-07-21T23:09:38.927 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.895+0000 7fe309ffb700 1 -- 172.21.15.151:0/1689764298 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v177) v1 ==== 81+0+957 (secure 0 0 0) 0x7fe2f8026080 con 0x7fe30c100490 2023-07-21T23:09:38.927 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/2857691582 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:38.928 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6800/3677157440 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:38.928 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6801/3677157440 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:38.928 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/117839627 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:38.928 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/2580982703 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:38.929 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6801/191414094 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:38.929 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/1323163778 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:38.929 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6800/191414094 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:38.929 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/1795404200 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:38.929 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/3453762997 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:38.929 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6800/4032529407 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:38.929 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/3481435706 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:38.930 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/311680782 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:38.930 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/372172769 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:38.930 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/4119562225 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:38.930 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6801/4032529407 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe2fc0a1340 msgr2=0x7fe2fc0a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe2fc0a1340 0x7fe2fc0a37f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fe300005fd0 tx=0x7fe30000af20 comp rx=0 tx=0).stop 2023-07-21T23:09:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 msgr2=0x7fe30c19be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:38.931 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 0x7fe30c19be80 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe2f800e9a0 tx=0x7fe2f800ed60 comp rx=0 tx=0).stop 2023-07-21T23:09:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 shutdown_connections 2023-07-21T23:09:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fe2fc0a1340 0x7fe2fc0a37f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe30c105af0 0x7fe30c1959b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fe30c0ffae0 0x7fe30c19b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 --2- 172.21.15.151:0/1689764298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe30c100490 0x7fe30c19be80 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:38.932 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 >> 172.21.15.151:0/1689764298 conn(0x7fe30c0fb5e0 msgr2=0x7fe30c0fbb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:38.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 shutdown_connections 2023-07-21T23:09:38.933 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:38.897+0000 7fe312dff700 1 -- 172.21.15.151:0/1689764298 wait complete. 2023-07-21T23:09:38.933 INFO:teuthology.orchestra.run.smithi151.stderr:listed 16 entries 2023-07-21T23:09:38.948 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-07-21T23:09:38.949 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-07-21T23:09:38.994 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-07-21T23:09:39.232 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.200+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/2344246883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 msgr2=0x7f8e9810bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.200+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/2344246883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 0x7f8e9810bdf0 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c009990 tx=0x7f8e8c009ca0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.200+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/2344246883 shutdown_connections 2023-07-21T23:09:39.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.200+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/2344246883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9810c330 0x7f8e9810e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.200+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/2344246883 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e980728b0 0x7f8e98072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.233 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.200+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/2344246883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 0x7f8e9810bdf0 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.201+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/2344246883 >> 172.21.15.151:0/2344246883 conn(0x7f8e980fb630 msgr2=0x7f8e980fda40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.201+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/2344246883 shutdown_connections 2023-07-21T23:09:39.234 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.201+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/2344246883 wait complete. 2023-07-21T23:09:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.202+0000 7f8e9d9ff700 1 Processor -- start 2023-07-21T23:09:39.235 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.202+0000 7f8e9d9ff700 1 -- start start 2023-07-21T23:09:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e9d9ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e980728b0 0x7f8e9819da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e9d9ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 0x7f8e9819df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e9d9ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9810c330 0x7f8e98197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e9d9ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98198130 con 0x7f8e980731c0 2023-07-21T23:09:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e9d9ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e981982a0 con 0x7f8e9810c330 2023-07-21T23:09:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e9d9ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98198460 con 0x7f8e980728b0 2023-07-21T23:09:39.236 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e967fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 0x7f8e9819df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e967fc700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 0x7f8e9819df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44250/0 (socket says 172.21.15.151:44250) 2023-07-21T23:09:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e967fc700 1 -- 172.21.15.151:0/47800447 learned_addr learned my addr 172.21.15.151:0/47800447 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e977fe700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9810c330 0x7f8e98197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.203+0000 7f8e96ffd700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e980728b0 0x7f8e9819da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e967fc700 1 -- 172.21.15.151:0/47800447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e980728b0 msgr2=0x7f8e9819da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e967fc700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e980728b0 0x7f8e9819da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.237 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e967fc700 1 -- 172.21.15.151:0/47800447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9810c330 msgr2=0x7f8e98197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e967fc700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9810c330 0x7f8e98197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.238 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e967fc700 1 -- 172.21.15.151:0/47800447 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8c0095f0 con 0x7f8e980731c0 2023-07-21T23:09:39.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e967fc700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 0x7f8e9819df90 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c006010 tx=0x7f8e8c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:39.239 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e9c9fd700 1 -- 172.21.15.151:0/47800447 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c01d070 con 0x7f8e980731c0 2023-07-21T23:09:39.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e981986e0 con 0x7f8e980731c0 2023-07-21T23:09:39.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e9c9fd700 1 -- 172.21.15.151:0/47800447 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f8e8c003f80 con 0x7f8e980731c0 2023-07-21T23:09:39.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e9c9fd700 1 -- 172.21.15.151:0/47800447 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c022b90 con 0x7f8e980731c0 2023-07-21T23:09:39.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.204+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e981a4a40 con 0x7f8e980731c0 2023-07-21T23:09:39.240 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.206+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e98067300 con 0x7f8e980731c0 2023-07-21T23:09:39.241 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.209+0000 7f8e9c9fd700 1 -- 172.21.15.151:0/47800447 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f8e8c003af0 con 0x7f8e980731c0 2023-07-21T23:09:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.210+0000 7f8e9c9fd700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8e800a1300 0x7f8e800a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:39.242 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.211+0000 7f8e9c9fd700 1 -- 172.21.15.151:0/47800447 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f8e8c0cea00 con 0x7f8e980731c0 2023-07-21T23:09:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.211+0000 7f8e96ffd700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8e800a1300 0x7f8e800a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:39.243 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.211+0000 7f8e96ffd700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8e800a1300 0x7f8e800a37b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8e88007be0 tx=0x7f8e880073d0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:39.244 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.213+0000 7f8e9c9fd700 1 -- 172.21.15.151:0/47800447 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f8e8c097e60 con 0x7f8e980731c0 2023-07-21T23:09:39.444 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.412+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e981a4ca0 con 0x7f8e980731c0 2023-07-21T23:09:39.445 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.414+0000 7f8e9c9fd700 1 -- 172.21.15.151:0/47800447 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v177) v1 ==== 74+0+23056 (secure 0 0 0) 0x7f8e8c09b480 con 0x7f8e980731c0 2023-07-21T23:09:39.446 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-07-21T23:09:39.446 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":177,"fsid":"f5fce3a4-2812-11ee-9b34-001a4aab830c","created":"2023-07-21T22:08:36.779776+0000","modified":"2023-07-21T23:09:22.172187+0000","last_up_change":"2023-07-21T22:16:12.903639+0000","last_in_change":"2023-07-21T22:15:52.932874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-07-21T22:12:15.343215+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-07-21T22:17:07.780301+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"84","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-07-21T22:17:08.816952+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"176","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":94,"snap_epoch":176,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e903ed24-3bea-4007-9763-2fa25fdf3098","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6803","nonce":1215940854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6805","nonce":1215940854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6809","nonce":1215940854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":1215940854},{"type":"v1","addr":"172.21.15.151:6807","nonce":1215940854}]},"public_addr":"172.21.15.151:6803/1215940854","cluster_addr":"172.21.15.151:6805/1215940854","heartbeat_back_addr":"172.21.15.151:6809/1215940854","heartbeat_front_addr":"172.21.15.151:6807/1215940854","state":["exists","up"]},{"osd":1,"uuid":"96879cff-72f6-4852-91cb-51fedc6c24ee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6801","nonce":2089567930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6803","nonce":2089567930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6807","nonce":2089567930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6804","nonce":2089567930},{"type":"v1","addr":"172.21.15.187:6805","nonce":2089567930}]},"public_addr":"172.21.15.187:6801/2089567930","cluster_addr":"172.21.15.187:6803/2089567930","heartbeat_back_addr":"172.21.15.187:6807/2089567930","heartbeat_front_addr":"172.21.15.187:6805/2089567930","state":["exists","up"]},{"osd":2,"uuid":"2a953e7b-0858-4387-9d3d-ad2693e940f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6800","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6801","nonce":3736985408}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6802","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6803","nonce":3736985408}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6806","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6807","nonce":3736985408}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6804","nonce":3736985408},{"type":"v1","addr":"172.21.15.195:6805","nonce":3736985408}]},"public_addr":"172.21.15.195:6801/3736985408","cluster_addr":"172.21.15.195:6803/3736985408","heartbeat_back_addr":"172.21.15.195:6807/3736985408","heartbeat_front_addr":"172.21.15.195:6805/3736985408","state":["exists","up"]},{"osd":3,"uuid":"69ea6be1-ee4c-4392-a1ea-f33959280632","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6811","nonce":446322037}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6813","nonce":446322037}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6817","nonce":446322037}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":446322037},{"type":"v1","addr":"172.21.15.151:6815","nonce":446322037}]},"public_addr":"172.21.15.151:6811/446322037","cluster_addr":"172.21.15.151:6813/446322037","heartbeat_back_addr":"172.21.15.151:6817/446322037","heartbeat_front_addr":"172.21.15.151:6815/446322037","state":["exists","up"]},{"osd":4,"uuid":"9fb10c73-994e-456d-8b9d-6f73960469df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":33,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6809","nonce":357741250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6810","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6811","nonce":357741250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6815","nonce":357741250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":357741250},{"type":"v1","addr":"172.21.15.187:6813","nonce":357741250}]},"public_addr":"172.21.15.187:6809/357741250","cluster_addr":"172.21.15.187:6811/357741250","heartbeat_back_addr":"172.21.15.187:6815/357741250","heartbeat_front_addr":"172.21.15.187:6813/357741250","state":["exists","up"]},{"osd":5,"uuid":"8bc15555-8fb3-4caa-bea9-15460b5d34a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":38,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6808","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6809","nonce":2892220444}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6810","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6811","nonce":2892220444}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6814","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6815","nonce":2892220444}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6812","nonce":2892220444},{"type":"v1","addr":"172.21.15.195:6813","nonce":2892220444}]},"public_addr":"172.21.15.195:6809/2892220444","cluster_addr":"172.21.15.195:6811/2892220444","heartbeat_back_addr":"172.21.15.195:6815/2892220444","heartbeat_front_addr":"172.21.15.195:6813/2892220444","state":["exists","up"]},{"osd":6,"uuid":"eb0278c9-dae9-453f-83a9-6102b326604e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":46,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6819","nonce":3406076685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6821","nonce":3406076685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6825","nonce":3406076685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":3406076685},{"type":"v1","addr":"172.21.15.151:6823","nonce":3406076685}]},"public_addr":"172.21.15.151:6819/3406076685","cluster_addr":"172.21.15.151:6821/3406076685","heartbeat_back_addr":"172.21.15.151:6825/3406076685","heartbeat_front_addr":"172.21.15.151:6823/3406076685","state":["exists","up"]},{"osd":7,"uuid":"16610547-d8ff-4d2a-b8f6-514f0374c058","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6816","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6817","nonce":963467354}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6818","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6819","nonce":963467354}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6823","nonce":963467354}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6820","nonce":963467354},{"type":"v1","addr":"172.21.15.187:6821","nonce":963467354}]},"public_addr":"172.21.15.187:6817/963467354","cluster_addr":"172.21.15.187:6819/963467354","heartbeat_back_addr":"172.21.15.187:6823/963467354","heartbeat_front_addr":"172.21.15.187:6821/963467354","state":["exists","up"]},{"osd":8,"uuid":"16e29935-729c-4d6d-b86b-82a69248c80c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":59,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6816","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6817","nonce":1226094225}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6818","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6819","nonce":1226094225}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6822","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6823","nonce":1226094225}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6820","nonce":1226094225},{"type":"v1","addr":"172.21.15.195:6821","nonce":1226094225}]},"public_addr":"172.21.15.195:6817/1226094225","cluster_addr":"172.21.15.195:6819/1226094225","heartbeat_back_addr":"172.21.15.195:6823/1226094225","heartbeat_front_addr":"172.21.15.195:6821/1226094225","state":["exists","up"]},{"osd":9,"uuid":"0a2ffc33-aff4-4451-9c2b-b3e28f5e7f57","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6827","nonce":2119659233}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6829","nonce":2119659233}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6833","nonce":2119659233}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2119659233},{"type":"v1","addr":"172.21.15.151:6831","nonce":2119659233}]},"public_addr":"172.21.15.151:6827/2119659233","cluster_addr":"172.21.15.151:6829/2119659233","heartbeat_back_addr":"172.21.15.151:6833/2119659233","heartbeat_front_addr":"172.21.15.151:6831/2119659233","state":["exists","up"]},{"osd":10,"uuid":"2408af95-5fda-41f2-8251-f56ed4efde80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6825","nonce":1369649564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6827","nonce":1369649564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6831","nonce":1369649564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":1369649564},{"type":"v1","addr":"172.21.15.187:6829","nonce":1369649564}]},"public_addr":"172.21.15.187:6825/1369649564","cluster_addr":"172.21.15.187:6827/1369649564","heartbeat_back_addr":"172.21.15.187:6831/1369649564","heartbeat_front_addr":"172.21.15.187:6829/1369649564","state":["exists","up"]},{"osd":11,"uuid":"4071400e-d6ce-4ed6-8dc3-7c5e94774861","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":80,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6824","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6825","nonce":2228826039}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6826","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6827","nonce":2228826039}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6830","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6831","nonce":2228826039}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.195:6828","nonce":2228826039},{"type":"v1","addr":"172.21.15.195:6829","nonce":2228826039}]},"public_addr":"172.21.15.195:6825/2228826039","cluster_addr":"172.21.15.195:6827/2228826039","heartbeat_back_addr":"172.21.15.195:6831/2228826039","heartbeat_front_addr":"172.21.15.195:6829/2228826039","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:20.833247+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:11:47.266845+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:12.768506+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:12:40.055594+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:06.745093+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:32.793889+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:13:59.326214+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:26.153805+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:14:52.114045+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:18.887210+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:15:45.329117+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-07-21T22:16:11.503210+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":1},{"from":8,"to":11}]},{"pgid":"2.1a","mappings":[{"from":8,"to":4}]},{"pgid":"3.e","mappings":[{"from":5,"to":9}]},{"pgid":"3.21","mappings":[{"from":4,"to":8}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.151:0/2857691582":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6800/3677157440":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6801/3677157440":"2023-07-22T22:19:10.841711+0000","172.21.15.151:0/117839627":"2023-07-22T22:19:10.841711+0000","172.21.15.151:0/2580982703":"2023-07-22T22:09:42.752515+0000","172.21.15.151:6801/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1323163778":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6800/191414094":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/1795404200":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/3453762997":"2023-07-22T22:09:15.556837+0000","172.21.15.151:6800/4032529407":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/3481435706":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/311680782":"2023-07-22T22:09:42.752515+0000","172.21.15.151:0/372172769":"2023-07-22T22:09:15.556837+0000","172.21.15.151:0/4119562225":"2023-07-22T22:19:10.841711+0000","172.21.15.151:6801/4032529407":"2023-07-22T22:09:15.556837+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":82,"length":1},{"begin":94,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-07-21T23:09:39.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8e800a1300 msgr2=0x7f8e800a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8e800a1300 0x7f8e800a37b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f8e88007be0 tx=0x7f8e880073d0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 msgr2=0x7f8e9819df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 0x7f8e9819df90 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c006010 tx=0x7f8e8c005740 comp rx=0 tx=0).stop 2023-07-21T23:09:39.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 shutdown_connections 2023-07-21T23:09:39.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f8e800a1300 0x7f8e800a37b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9810c330 0x7f8e98197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f8e980728b0 0x7f8e9819da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 --2- 172.21.15.151:0/47800447 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8e980731c0 0x7f8e9819df90 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 >> 172.21.15.151:0/47800447 conn(0x7f8e980fb630 msgr2=0x7f8e9810e400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.416+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 shutdown_connections 2023-07-21T23:09:39.450 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.417+0000 7f8e9d9ff700 1 -- 172.21.15.151:0/47800447 wait complete. 2023-07-21T23:09:39.467 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-07-21T22:12:15.343215+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-07-21T22:17:07.780301+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '84', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-07-21T22:17:08.816952+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '176', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 94, 'snap_epoch': 176, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-07-21T23:09:39.469 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-07-21T23:09:39.530 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:39 smithi151 ceph-mon[95510]: pgmap v1606: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:09:39.531 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:39 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/3816334139' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T23:09:39.531 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:39 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/1689764298' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-21T23:09:39.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:39 smithi187 ceph-mon[96918]: pgmap v1606: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:09:39.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:39 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/3816334139' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T23:09:39.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:39 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/1689764298' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-21T23:09:39.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:39 smithi195 ceph-mon[97365]: pgmap v1606: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:09:39.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:39 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/3816334139' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T23:09:39.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:39 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/1689764298' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-21T23:09:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.640+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2235201129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4106fa0 msgr2=0x7fb7d410eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.640+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2235201129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4106fa0 0x7fb7d410eb70 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fb7cc00b0d0 tx=0x7fb7cc00b3e0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.640+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2235201129 shutdown_connections 2023-07-21T23:09:39.672 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.640+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2235201129 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4106fa0 0x7fb7d410eb70 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.640+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2235201129 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7d4101f60 0x7fb7d4102330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.640+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2235201129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4102900 0x7fb7d41068c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.640+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2235201129 >> 172.21.15.151:0/2235201129 conn(0x7fb7d40fd7d0 msgr2=0x7fb7d40ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.640+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2235201129 shutdown_connections 2023-07-21T23:09:39.673 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.640+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2235201129 wait complete. 2023-07-21T23:09:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.642+0000 7fb7dbdff700 1 Processor -- start 2023-07-21T23:09:39.674 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.642+0000 7fb7dbdff700 1 -- start start 2023-07-21T23:09:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.642+0000 7fb7dbdff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4101f60 0x7fb7d4197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.642+0000 7fb7dbdff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7d4102900 0x7fb7d4198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.642+0000 7fb7dbdff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4106fa0 0x7fb7d419c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.642+0000 7fb7dbdff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d419ce00 con 0x7fb7d4101f60 2023-07-21T23:09:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.642+0000 7fb7dbdff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d419cf70 con 0x7fb7d4106fa0 2023-07-21T23:09:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.642+0000 7fb7dbdff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d419d130 con 0x7fb7d4102900 2023-07-21T23:09:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d9b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4101f60 0x7fb7d4197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:39.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d9b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4101f60 0x7fb7d4197ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44266/0 (socket says 172.21.15.151:44266) 2023-07-21T23:09:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d9b9b700 1 -- 172.21.15.151:0/2585365130 learned_addr learned my addr 172.21.15.151:0/2585365130 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d939a700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7d4102900 0x7fb7d4198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:39.676 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7da39c700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4106fa0 0x7fb7d419c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:39.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d9b9b700 1 -- 172.21.15.151:0/2585365130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7d4102900 msgr2=0x7fb7d4198400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d9b9b700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7d4102900 0x7fb7d4198400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d9b9b700 1 -- 172.21.15.151:0/2585365130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4106fa0 msgr2=0x7fb7d419c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d9b9b700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4106fa0 0x7fb7d419c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d9b9b700 1 -- 172.21.15.151:0/2585365130 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7cc009d00 con 0x7fb7d4101f60 2023-07-21T23:09:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d939a700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7d4102900 0x7fb7d4198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-07-21T23:09:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.643+0000 7fb7d9b9b700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4101f60 0x7fb7d4197ec0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000e9a0 tx=0x7fb7d000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.644+0000 7fb7caffd700 1 -- 172.21.15.151:0/2585365130 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d0009790 con 0x7fb7d4101f60 2023-07-21T23:09:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.644+0000 7fb7caffd700 1 -- 172.21.15.151:0/2585365130 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb7d0010430 con 0x7fb7d4101f60 2023-07-21T23:09:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.644+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d419d410 con 0x7fb7d4101f60 2023-07-21T23:09:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.644+0000 7fb7caffd700 1 -- 172.21.15.151:0/2585365130 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d000cea0 con 0x7fb7d4101f60 2023-07-21T23:09:39.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.644+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d41a4c50 con 0x7fb7d4101f60 2023-07-21T23:09:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.645+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d40676e0 con 0x7fb7d4101f60 2023-07-21T23:09:39.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.647+0000 7fb7caffd700 1 -- 172.21.15.151:0/2585365130 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fb7d00105a0 con 0x7fb7d4101f60 2023-07-21T23:09:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.649+0000 7fb7caffd700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb7c00a12c0 0x7fb7c00a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:39.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.649+0000 7fb7caffd700 1 -- 172.21.15.151:0/2585365130 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb7d0014070 con 0x7fb7d4101f60 2023-07-21T23:09:39.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.649+0000 7fb7d939a700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb7c00a12c0 0x7fb7c00a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:39.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.649+0000 7fb7d939a700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb7c00a12c0 0x7fb7c00a3770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb7d41994d0 tx=0x7fb7c4009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:39.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.651+0000 7fb7caffd700 1 -- 172.21.15.151:0/2585365130 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fb7d0096500 con 0x7fb7d4101f60 2023-07-21T23:09:39.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.848+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb7d41a4ee0 con 0x7fb7d4101f60 2023-07-21T23:09:39.880 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.849+0000 7fb7caffd700 1 -- 172.21.15.151:0/2585365130 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v177) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb7d00260a0 con 0x7fb7d4101f60 2023-07-21T23:09:39.881 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 1 2023-07-21T23:09:39.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb7c00a12c0 msgr2=0x7fb7c00a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.883 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb7c00a12c0 0x7fb7c00a3770 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fb7d41994d0 tx=0x7fb7c4009260 comp rx=0 tx=0).stop 2023-07-21T23:09:39.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4101f60 msgr2=0x7fb7d4197ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:39.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4101f60 0x7fb7d4197ec0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fb7d000e9a0 tx=0x7fb7d000ecb0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 shutdown_connections 2023-07-21T23:09:39.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb7c00a12c0 0x7fb7c00a3770 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7d4106fa0 0x7fb7d419c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.884 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7d4101f60 0x7fb7d4197ec0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 --2- 172.21.15.151:0/2585365130 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb7d4102900 0x7fb7d4198400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:39.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 >> 172.21.15.151:0/2585365130 conn(0x7fb7d40fd7d0 msgr2=0x7fb7d40fe270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:39.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 shutdown_connections 2023-07-21T23:09:39.885 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:39.851+0000 7fb7dbdff700 1 -- 172.21.15.151:0/2585365130 wait complete. 2023-07-21T23:09:39.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-07-21T23:09:40.103 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.071+0000 7fbee2dff700 1 -- 172.21.15.151:0/2720594896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc10c310 msgr2=0x7fbedc10e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.071+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2720594896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc10c310 0x7fbedc10e6f0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fbed400b0a0 tx=0x7fbed400b3b0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.071+0000 7fbee2dff700 1 -- 172.21.15.151:0/2720594896 shutdown_connections 2023-07-21T23:09:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.071+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2720594896 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc0728b0 0x7fbedc072c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.071+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2720594896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc10c310 0x7fbedc10e6f0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.071+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2720594896 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbedc0731c0 0x7fbedc10bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.104 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.071+0000 7fbee2dff700 1 -- 172.21.15.151:0/2720594896 >> 172.21.15.151:0/2720594896 conn(0x7fbedc0fb5f0 msgr2=0x7fbedc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.071+0000 7fbee2dff700 1 -- 172.21.15.151:0/2720594896 shutdown_connections 2023-07-21T23:09:40.105 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.072+0000 7fbee2dff700 1 -- 172.21.15.151:0/2720594896 wait complete. 2023-07-21T23:09:40.106 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.073+0000 7fbee2dff700 1 Processor -- start 2023-07-21T23:09:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.073+0000 7fbee2dff700 1 -- start start 2023-07-21T23:09:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee2dff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc0728b0 0x7fbedc197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee2dff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc0731c0 0x7fbedc198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee2dff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbedc10c310 0x7fbedc19c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee2dff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc19cdb0 con 0x7fbedc0728b0 2023-07-21T23:09:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee2dff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc19cf20 con 0x7fbedc0731c0 2023-07-21T23:09:40.107 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee2dff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbedc19d0e0 con 0x7fbedc10c310 2023-07-21T23:09:40.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee0b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc0728b0 0x7fbedc197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee0b9b700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc0728b0 0x7fbedc197dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44280/0 (socket says 172.21.15.151:44280) 2023-07-21T23:09:40.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee0b9b700 1 -- 172.21.15.151:0/2954440159 learned_addr learned my addr 172.21.15.151:0/2954440159 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:40.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbedbfff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc0731c0 0x7fbedc198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee139c700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbedc10c310 0x7fbedc19c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee0b9b700 1 -- 172.21.15.151:0/2954440159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbedc10c310 msgr2=0x7fbedc19c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.108 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee0b9b700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbedc10c310 0x7fbedc19c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee0b9b700 1 -- 172.21.15.151:0/2954440159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc0731c0 msgr2=0x7fbedc198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee0b9b700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc0731c0 0x7fbedc198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee0b9b700 1 -- 172.21.15.151:0/2954440159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4009d00 con 0x7fbedc0728b0 2023-07-21T23:09:40.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbee139c700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbedc10c310 0x7fbedc19c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-07-21T23:09:40.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.074+0000 7fbedbfff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc0731c0 0x7fbedc198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:09:40.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.075+0000 7fbee0b9b700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc0728b0 0x7fbedc197dd0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbed000e9a0 tx=0x7fbed000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:40.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.075+0000 7fbed9ffb700 1 -- 172.21.15.151:0/2954440159 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0009790 con 0x7fbedc0728b0 2023-07-21T23:09:40.109 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.075+0000 7fbed9ffb700 1 -- 172.21.15.151:0/2954440159 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fbed000cbd0 con 0x7fbedc0728b0 2023-07-21T23:09:40.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.075+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbedc19d3c0 con 0x7fbedc0728b0 2023-07-21T23:09:40.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.075+0000 7fbed9ffb700 1 -- 172.21.15.151:0/2954440159 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed0018680 con 0x7fbedc0728b0 2023-07-21T23:09:40.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.075+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbedc1a4c00 con 0x7fbedc0728b0 2023-07-21T23:09:40.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.076+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbedc067290 con 0x7fbedc0728b0 2023-07-21T23:09:40.110 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.078+0000 7fbed9ffb700 1 -- 172.21.15.151:0/2954440159 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fbed000cd40 con 0x7fbedc0728b0 2023-07-21T23:09:40.111 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.080+0000 7fbed9ffb700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbecc0a12c0 0x7fbecc0a3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.080+0000 7fbed9ffb700 1 -- 172.21.15.151:0/2954440159 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fbed0014070 con 0x7fbedc0728b0 2023-07-21T23:09:40.112 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.080+0000 7fbedbfff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbecc0a12c0 0x7fbecc0a3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.113 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.081+0000 7fbedbfff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbecc0a12c0 0x7fbecc0a3770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbedc1993e0 tx=0x7fbec8005d80 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:40.115 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.084+0000 7fbed9ffb700 1 -- 172.21.15.151:0/2954440159 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fbed0051770 con 0x7fbedc0728b0 2023-07-21T23:09:40.319 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.287+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fbedc1a4e90 con 0x7fbedc0728b0 2023-07-21T23:09:40.320 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.288+0000 7fbed9ffb700 1 -- 172.21.15.151:0/2954440159 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v177) v1 ==== 104+0+11 (secure 0 0 0) 0x7fbed0099f00 con 0x7fbedc0728b0 2023-07-21T23:09:40.320 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 32 2023-07-21T23:09:40.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbecc0a12c0 msgr2=0x7fbecc0a3770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbecc0a12c0 0x7fbecc0a3770 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fbedc1993e0 tx=0x7fbec8005d80 comp rx=0 tx=0).stop 2023-07-21T23:09:40.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc0728b0 msgr2=0x7fbedc197dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc0728b0 0x7fbedc197dd0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fbed000e9a0 tx=0x7fbed000ed60 comp rx=0 tx=0).stop 2023-07-21T23:09:40.322 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 shutdown_connections 2023-07-21T23:09:40.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fbecc0a12c0 0x7fbecc0a3770 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fbedc10c310 0x7fbedc19c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbedc0728b0 0x7fbedc197dd0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 --2- 172.21.15.151:0/2954440159 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbedc0731c0 0x7fbedc198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 >> 172.21.15.151:0/2954440159 conn(0x7fbedc0fb5f0 msgr2=0x7fbedc10e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:40.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 shutdown_connections 2023-07-21T23:09:40.323 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.290+0000 7fbee2dff700 1 -- 172.21.15.151:0/2954440159 wait complete. 2023-07-21T23:09:40.341 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-07-21T23:09:40.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.512+0000 7fb4edbff700 1 -- 172.21.15.151:0/3582036016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 msgr2=0x7fb4e80fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.512+0000 7fb4edbff700 1 --2- 172.21.15.151:0/3582036016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 0x7fb4e80fff40 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fb4dc009990 tx=0x7fb4dc009ca0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.512+0000 7fb4edbff700 1 -- 172.21.15.151:0/3582036016 shutdown_connections 2023-07-21T23:09:40.545 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.512+0000 7fb4edbff700 1 --2- 172.21.15.151:0/3582036016 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4e8100480 0x7fb4e810c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.512+0000 7fb4edbff700 1 --2- 172.21.15.151:0/3582036016 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e8105ae0 0x7fb4e8105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.512+0000 7fb4edbff700 1 --2- 172.21.15.151:0/3582036016 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 0x7fb4e80fff40 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.546 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.512+0000 7fb4edbff700 1 -- 172.21.15.151:0/3582036016 >> 172.21.15.151:0/3582036016 conn(0x7fb4e80fb5f0 msgr2=0x7fb4e80fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:40.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.513+0000 7fb4edbff700 1 -- 172.21.15.151:0/3582036016 shutdown_connections 2023-07-21T23:09:40.547 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.513+0000 7fb4edbff700 1 -- 172.21.15.151:0/3582036016 wait complete. 2023-07-21T23:09:40.549 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.514+0000 7fb4edbff700 1 Processor -- start 2023-07-21T23:09:40.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.514+0000 7fb4edbff700 1 -- start start 2023-07-21T23:09:40.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4edbff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 0x7fb4e819b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4edbff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e8100480 0x7fb4e819be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4edbff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4e8105ae0 0x7fb4e8195960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4edbff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8195fd0 con 0x7fb4e80ffad0 2023-07-21T23:09:40.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4edbff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8196140 con 0x7fb4e8105ae0 2023-07-21T23:09:40.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4edbff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4e8196300 con 0x7fb4e8100480 2023-07-21T23:09:40.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 0x7fb4e819b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e77fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 0x7fb4e819b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44306/0 (socket says 172.21.15.151:44306) 2023-07-21T23:09:40.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e77fe700 1 -- 172.21.15.151:0/2917591395 learned_addr learned my addr 172.21.15.151:0/2917591395 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:40.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e6ffd700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e8100480 0x7fb4e819be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.551 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e7fff700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4e8105ae0 0x7fb4e8195960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e77fe700 1 -- 172.21.15.151:0/2917591395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e8100480 msgr2=0x7fb4e819be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e77fe700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e8100480 0x7fb4e819be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e77fe700 1 -- 172.21.15.151:0/2917591395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4e8105ae0 msgr2=0x7fb4e8195960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.552 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e77fe700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4e8105ae0 0x7fb4e8195960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e77fe700 1 -- 172.21.15.151:0/2917591395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4dc0095f0 con 0x7fb4e80ffad0 2023-07-21T23:09:40.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.515+0000 7fb4e7fff700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4e8105ae0 0x7fb4e8195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-07-21T23:09:40.553 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.516+0000 7fb4e77fe700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 0x7fb4e819b8f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800d950 tx=0x7fb4d800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:40.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.516+0000 7fb4e4ff9700 1 -- 172.21.15.151:0/2917591395 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8009940 con 0x7fb4e80ffad0 2023-07-21T23:09:40.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.516+0000 7fb4e4ff9700 1 -- 172.21.15.151:0/2917591395 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7fb4d8010460 con 0x7fb4e80ffad0 2023-07-21T23:09:40.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.516+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4e81965e0 con 0x7fb4e80ffad0 2023-07-21T23:09:40.554 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.516+0000 7fb4e4ff9700 1 -- 172.21.15.151:0/2917591395 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4d800f620 con 0x7fb4e80ffad0 2023-07-21T23:09:40.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.516+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4e81a28e0 con 0x7fb4e80ffad0 2023-07-21T23:09:40.555 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.517+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4e8067290 con 0x7fb4e80ffad0 2023-07-21T23:09:40.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.519+0000 7fb4e4ff9700 1 -- 172.21.15.151:0/2917591395 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7fb4d80105d0 con 0x7fb4e80ffad0 2023-07-21T23:09:40.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.521+0000 7fb4e4ff9700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4d00a1340 0x7fb4d00a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.557 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.522+0000 7fb4e4ff9700 1 -- 172.21.15.151:0/2917591395 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7fb4d80cca90 con 0x7fb4e80ffad0 2023-07-21T23:09:40.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.522+0000 7fb4e6ffd700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4d00a1340 0x7fb4d00a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.522+0000 7fb4e6ffd700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4d00a1340 0x7fb4d00a37f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80fdef0 tx=0x7fb4dc005fb0 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:40.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.524+0000 7fb4e4ff9700 1 -- 172.21.15.151:0/2917591395 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7fb4d8095e60 con 0x7fb4e80ffad0 2023-07-21T23:09:40.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:40 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/47800447' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T23:09:40.617 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:40 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2585365130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T23:09:40.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:40 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/47800447' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T23:09:40.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:40 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2585365130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T23:09:40.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:40 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/47800447' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2023-07-21T23:09:40.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:40 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2585365130' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2023-07-21T23:09:40.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.723+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4e81a2c40 con 0x7fb4e80ffad0 2023-07-21T23:09:40.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.724+0000 7fb4e4ff9700 1 -- 172.21.15.151:0/2917591395 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v177) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb4d80160a0 con 0x7fb4e80ffad0 2023-07-21T23:09:40.756 INFO:teuthology.orchestra.run.smithi151.stdout:pg_num: 64 2023-07-21T23:09:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4d00a1340 msgr2=0x7fb4d00a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4d00a1340 0x7fb4d00a37f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb4e80fdef0 tx=0x7fb4dc005fb0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 msgr2=0x7fb4e819b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 0x7fb4e819b8f0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800d950 tx=0x7fb4d800dc60 comp rx=0 tx=0).stop 2023-07-21T23:09:40.758 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 shutdown_connections 2023-07-21T23:09:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7fb4d00a1340 0x7fb4d00a37f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4e8105ae0 0x7fb4e8195960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4e80ffad0 0x7fb4e819b8f0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 --2- 172.21.15.151:0/2917591395 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7fb4e8100480 0x7fb4e819be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 >> 172.21.15.151:0/2917591395 conn(0x7fb4e80fb5f0 msgr2=0x7fb4e80fbc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 shutdown_connections 2023-07-21T23:09:40.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.726+0000 7fb4edbff700 1 -- 172.21.15.151:0/2917591395 wait complete. 2023-07-21T23:09:40.777 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-07-21T23:09:40.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.945+0000 7f04e27ff700 1 -- 172.21.15.151:0/2312747956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 msgr2=0x7f04dc10c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.945+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2312747956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 0x7f04dc10c910 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f04d400b0a0 tx=0x7f04d400b3b0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.977 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.945+0000 7f04e27ff700 1 -- 172.21.15.151:0/2312747956 shutdown_connections 2023-07-21T23:09:40.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.945+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2312747956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc105ae0 0x7f04dc105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.945+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2312747956 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 0x7f04dc10c910 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.945+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2312747956 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04dc0ffad0 0x7f04dc0fff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.945+0000 7f04e27ff700 1 -- 172.21.15.151:0/2312747956 >> 172.21.15.151:0/2312747956 conn(0x7f04dc0fb5f0 msgr2=0x7f04dc0fda00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:40.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.945+0000 7f04e27ff700 1 -- 172.21.15.151:0/2312747956 shutdown_connections 2023-07-21T23:09:40.978 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.945+0000 7f04e27ff700 1 -- 172.21.15.151:0/2312747956 wait complete. 2023-07-21T23:09:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.946+0000 7f04e27ff700 1 Processor -- start 2023-07-21T23:09:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.946+0000 7f04e27ff700 1 -- start start 2023-07-21T23:09:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04e27ff700 1 --2- >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04dc0ffad0 0x7f04dc197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04e27ff700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 0x7f04dc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04e27ff700 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc105ae0 0x7f04dc19c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.980 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04e27ff700 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc19cde0 con 0x7f04dc100480 2023-07-21T23:09:40.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04e27ff700 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc19cf50 con 0x7f04dc105ae0 2023-07-21T23:09:40.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04e27ff700 1 -- --> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04dc19d110 con 0x7f04dc0ffad0 2023-07-21T23:09:40.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04db7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 0x7f04dc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04db7fe700 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 0x7f04dc198340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:44336/0 (socket says 172.21.15.151:44336) 2023-07-21T23:09:40.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04db7fe700 1 -- 172.21.15.151:0/2539331908 learned_addr learned my addr 172.21.15.151:0/2539331908 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-07-21T23:09:40.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04dbfff700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04dc0ffad0 0x7f04dc197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.981 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04e0d9c700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc105ae0 0x7f04dc19c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04db7fe700 1 -- 172.21.15.151:0/2539331908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04dc0ffad0 msgr2=0x7f04dc197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04db7fe700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04dc0ffad0 0x7f04dc197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04db7fe700 1 -- 172.21.15.151:0/2539331908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc105ae0 msgr2=0x7f04dc19c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04db7fe700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc105ae0 0x7f04dc19c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.947+0000 7f04db7fe700 1 -- 172.21.15.151:0/2539331908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d0009520 con 0x7f04dc100480 2023-07-21T23:09:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.948+0000 7f04db7fe700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 0x7f04dc198340 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f04d000eb30 tx=0x7f04d000ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.948+0000 7f04d97fa700 1 -- 172.21.15.151:0/2539331908 <== mon.0 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0009880 con 0x7f04dc100480 2023-07-21T23:09:40.982 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.948+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04d4009d00 con 0x7f04dc100480 2023-07-21T23:09:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.948+0000 7f04d97fa700 1 -- 172.21.15.151:0/2539331908 <== mon.0 v2:172.21.15.151:3300/0 2 ==== config(25 keys) v1 ==== 1067+0+0 (secure 0 0 0) 0x7f04d00044b0 con 0x7f04dc100480 2023-07-21T23:09:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.948+0000 7f04d97fa700 1 -- 172.21.15.151:0/2539331908 <== mon.0 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d0003df0 con 0x7f04dc100480 2023-07-21T23:09:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.948+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04dc19d5e0 con 0x7f04dc100480 2023-07-21T23:09:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.949+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04dc067290 con 0x7f04dc100480 2023-07-21T23:09:40.983 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.951+0000 7f04d97fa700 1 -- 172.21.15.151:0/2539331908 <== mon.0 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) v1 ==== 135847+0+0 (secure 0 0 0) 0x7f04d0003f50 con 0x7f04dc100480 2023-07-21T23:09:40.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.952+0000 7f04d97fa700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04c40a1340 0x7f04c40a37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-07-21T23:09:40.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.953+0000 7f04d97fa700 1 -- 172.21.15.151:0/2539331908 <== mon.0 v2:172.21.15.151:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 8492+0+0 (secure 0 0 0) 0x7f04d0014070 con 0x7f04dc100480 2023-07-21T23:09:40.984 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.953+0000 7f04dbfff700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04c40a1340 0x7f04c40a37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-07-21T23:09:40.985 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.954+0000 7f04dbfff700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04c40a1340 0x7f04c40a37f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009be0 tx=0x7f04cc009260 comp rx=0 tx=0).ready entity=mgr.15489 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-07-21T23:09:40.988 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:40.956+0000 7f04d97fa700 1 -- 172.21.15.151:0/2539331908 <== mon.0 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+178008 (secure 0 0 0) 0x7f04d0096450 con 0x7f04dc100480 2023-07-21T23:09:41.208 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.177+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f04dc199150 con 0x7f04dc100480 2023-07-21T23:09:41.209 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.177+0000 7f04d97fa700 1 -- 172.21.15.151:0/2539331908 <== mon.0 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v177) v1 ==== 81+0+957 (secure 0 0 0) 0x7f04d0099a70 con 0x7f04dc100480 2023-07-21T23:09:41.209 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/2857691582 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:41.209 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6800/3677157440 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:41.210 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6801/3677157440 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:41.210 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/117839627 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:41.210 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/2580982703 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:41.210 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6801/191414094 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:41.210 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/1323163778 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:41.210 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6800/191414094 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:41.210 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/1795404200 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:41.210 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/3453762997 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:41.211 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6800/4032529407 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:41.211 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/3481435706 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:41.211 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/311680782 2023-07-22T22:09:42.752515+0000 2023-07-21T23:09:41.211 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/372172769 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:41.211 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:0/4119562225 2023-07-22T22:19:10.841711+0000 2023-07-21T23:09:41.211 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.15.151:6801/4032529407 2023-07-22T22:09:15.556837+0000 2023-07-21T23:09:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.179+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04c40a1340 msgr2=0x7f04c40a37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.179+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04c40a1340 0x7f04c40a37f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f04cc009be0 tx=0x7f04cc009260 comp rx=0 tx=0).stop 2023-07-21T23:09:41.212 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 msgr2=0x7f04dc198340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-07-21T23:09:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 0x7f04dc198340 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f04d000eb30 tx=0x7f04d000ee40 comp rx=0 tx=0).stop 2023-07-21T23:09:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 shutdown_connections 2023-07-21T23:09:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:6800/508405215,v1:172.21.15.151:6801/508405215] conn(0x7f04c40a1340 0x7f04c40a37f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04dc105ae0 0x7f04dc19c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.195:3300/0,v1:172.21.15.195:6789/0] conn(0x7f04dc0ffad0 0x7f04dc197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 --2- 172.21.15.151:0/2539331908 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04dc100480 0x7f04dc198340 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-07-21T23:09:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 >> 172.21.15.151:0/2539331908 conn(0x7f04dc0fb5f0 msgr2=0x7f04dc0fbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-07-21T23:09:41.213 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 shutdown_connections 2023-07-21T23:09:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:2023-07-21T23:09:41.180+0000 7f04e27ff700 1 -- 172.21.15.151:0/2539331908 wait complete. 2023-07-21T23:09:41.214 INFO:teuthology.orchestra.run.smithi151.stderr:listed 16 entries 2023-07-21T23:09:41.230 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi151.front.sepia.ceph.com... 2023-07-21T23:09:41.230 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-07-21T23:09:41.231 DEBUG:teuthology.orchestra.run.smithi151:> sudo fusermount -u /tmp/cephfs 2023-07-21T23:09:41.351 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi151.stderr:ceph-fuse[143827]: fuse finished with error 0 and tester_r 0 2023-07-21T23:09:41.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:41 smithi187 ceph-mon[96918]: pgmap v1607: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:09:41.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:41 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2954440159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T23:09:41.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:41 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2917591395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T23:09:41.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:41 smithi187 ceph-mon[96918]: from='client.? 172.21.15.151:0/2539331908' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-21T23:09:41.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:41 smithi195 ceph-mon[97365]: pgmap v1607: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:09:41.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:41 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2954440159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T23:09:41.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:41 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2917591395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T23:09:41.645 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:41 smithi195 ceph-mon[97365]: from='client.? 172.21.15.151:0/2539331908' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-21T23:09:41.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:41 smithi151 ceph-mon[95510]: pgmap v1607: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:09:41.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:41 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2954440159' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2023-07-21T23:09:41.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:41 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2917591395' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2023-07-21T23:09:41.687 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:41 smithi151 ceph-mon[95510]: from='client.? 172.21.15.151:0/2539331908' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2023-07-21T23:09:42.237 INFO:teuthology.orchestra.run:waiting for 300 2023-07-21T23:09:43.615 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:43 smithi187 ceph-mon[96918]: pgmap v1608: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:09:43.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:43 smithi195 ceph-mon[97365]: pgmap v1608: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:09:43.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:43 smithi151 ceph-mon[95510]: pgmap v1608: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:09:45.615 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:45 smithi187 ceph-mon[96918]: pgmap v1609: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:09:45.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:45 smithi195 ceph-mon[97365]: pgmap v1609: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:09:45.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:45 smithi151 ceph-mon[95510]: pgmap v1609: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:09:46.615 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:46 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:09:46.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:46 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:09:46.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:46 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:09:47.615 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:47 smithi187 ceph-mon[96918]: pgmap v1610: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:09:47.615 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:47 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:09:47.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:47 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:09:47.616 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:47 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:09:47.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:47 smithi195 ceph-mon[97365]: pgmap v1610: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:09:47.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:47 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:09:47.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:47 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:09:47.644 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:47 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:09:47.689 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:47 smithi151 ceph-mon[95510]: pgmap v1610: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:09:47.689 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:47 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:09:47.689 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:47 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:09:47.690 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:47 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:09:49.615 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:49 smithi187 ceph-mon[96918]: pgmap v1611: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-07-21T23:09:49.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:49 smithi195 ceph-mon[97365]: pgmap v1611: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-07-21T23:09:49.686 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:49 smithi151 ceph-mon[95510]: pgmap v1611: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 5 op/s 2023-07-21T23:09:51.615 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:51 smithi187 ceph-mon[96918]: pgmap v1612: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2023-07-21T23:09:51.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:51 smithi195 ceph-mon[97365]: pgmap v1612: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2023-07-21T23:09:51.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:51 smithi151 ceph-mon[95510]: pgmap v1612: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 KiB/s wr, 7 op/s 2023-07-21T23:09:53.615 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:53 smithi187 ceph-mon[96918]: pgmap v1613: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2023-07-21T23:09:53.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:53 smithi195 ceph-mon[97365]: pgmap v1613: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2023-07-21T23:09:53.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:53 smithi151 ceph-mon[95510]: pgmap v1613: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.0 KiB/s wr, 5 op/s 2023-07-21T23:09:55.614 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:55 smithi187 ceph-mon[96918]: pgmap v1614: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2023-07-21T23:09:55.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:55 smithi195 ceph-mon[97365]: pgmap v1614: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2023-07-21T23:09:55.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:55 smithi151 ceph-mon[95510]: pgmap v1614: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 6.7 KiB/s wr, 8 op/s 2023-07-21T23:09:57.615 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:57 smithi187 ceph-mon[96918]: pgmap v1615: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2023-07-21T23:09:57.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:57 smithi195 ceph-mon[97365]: pgmap v1615: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2023-07-21T23:09:57.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:57 smithi151 ceph-mon[95510]: pgmap v1615: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2023-07-21T23:09:59.614 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:09:59 smithi187 ceph-mon[96918]: pgmap v1616: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2023-07-21T23:09:59.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:09:59 smithi195 ceph-mon[97365]: pgmap v1616: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2023-07-21T23:09:59.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:09:59 smithi151 ceph-mon[95510]: pgmap v1616: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.7 KiB/s wr, 6 op/s 2023-07-21T23:10:00.297 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T23:09:59.999+0000 7f5662017700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T23:10:00.614 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:00 smithi187 ceph-mon[96918]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T23:10:00.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:00 smithi195 ceph-mon[97365]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T23:10:00.684 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:00 smithi151 ceph-mon[95510]: overall HEALTH_ERR 1 MDSs report damaged metadata 2023-07-21T23:10:01.614 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:01 smithi187 ceph-mon[96918]: pgmap v1617: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-07-21T23:10:01.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:01 smithi195 ceph-mon[97365]: pgmap v1617: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-07-21T23:10:01.684 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:01 smithi151 ceph-mon[95510]: pgmap v1617: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 14 KiB/s wr, 8 op/s 2023-07-21T23:10:03.614 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:03 smithi187 ceph-mon[96918]: pgmap v1618: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-07-21T23:10:03.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:03 smithi195 ceph-mon[97365]: pgmap v1618: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-07-21T23:10:03.684 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:03 smithi151 ceph-mon[95510]: pgmap v1618: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 KiB/s wr, 6 op/s 2023-07-21T23:10:05.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:05 smithi187 ceph-mon[96918]: pgmap v1619: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 59 KiB/s wr, 23 op/s 2023-07-21T23:10:05.620 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:05 smithi187 ceph-mon[96918]: osdmap e178: 12 total, 12 up, 12 in 2023-07-21T23:10:05.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:05 smithi195 ceph-mon[97365]: pgmap v1619: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 59 KiB/s wr, 23 op/s 2023-07-21T23:10:05.643 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:05 smithi195 ceph-mon[97365]: osdmap e178: 12 total, 12 up, 12 in 2023-07-21T23:10:05.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:05 smithi151 ceph-mon[95510]: pgmap v1619: 97 pgs: 97 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 59 KiB/s wr, 23 op/s 2023-07-21T23:10:05.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:05 smithi151 ceph-mon[95510]: osdmap e178: 12 total, 12 up, 12 in 2023-07-21T23:10:07.684 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:07 smithi151 ceph-mon[95510]: pgmap v1621: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 67 KiB/s wr, 24 op/s 2023-07-21T23:10:07.865 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:07 smithi187 ceph-mon[96918]: pgmap v1621: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 67 KiB/s wr, 24 op/s 2023-07-21T23:10:07.893 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:07 smithi195 ceph-mon[97365]: pgmap v1621: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 67 KiB/s wr, 24 op/s 2023-07-21T23:10:08.684 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:08 smithi151 ceph-mon[95510]: pgmap v1622: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 67 KiB/s wr, 24 op/s 2023-07-21T23:10:08.864 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:08 smithi187 ceph-mon[96918]: pgmap v1622: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 67 KiB/s wr, 24 op/s 2023-07-21T23:10:08.892 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:08 smithi195 ceph-mon[97365]: pgmap v1622: 97 pgs: 6 active+clean+snaptrim, 12 active+clean+snaptrim_wait, 79 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 67 KiB/s wr, 24 op/s 2023-07-21T23:10:11.434 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:11 smithi151 ceph-mon[95510]: pgmap v1623: 97 pgs: 11 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 64 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 24 op/s 2023-07-21T23:10:11.613 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:11 smithi187 ceph-mon[96918]: pgmap v1623: 97 pgs: 11 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 64 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 24 op/s 2023-07-21T23:10:11.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:11 smithi195 ceph-mon[97365]: pgmap v1623: 97 pgs: 11 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 64 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 24 op/s 2023-07-21T23:10:13.613 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:13 smithi187 ceph-mon[96918]: pgmap v1624: 97 pgs: 11 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 64 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 24 op/s 2023-07-21T23:10:13.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:13 smithi195 ceph-mon[97365]: pgmap v1624: 97 pgs: 11 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 64 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 24 op/s 2023-07-21T23:10:13.684 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:13 smithi151 ceph-mon[95510]: pgmap v1624: 97 pgs: 11 active+clean+snaptrim, 22 active+clean+snaptrim_wait, 64 active+clean; 14 GiB data, 33 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 58 KiB/s wr, 24 op/s 2023-07-21T23:10:15.613 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:15 smithi187 ceph-mon[96918]: pgmap v1625: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2023-07-21T23:10:15.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:15 smithi195 ceph-mon[97365]: pgmap v1625: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2023-07-21T23:10:15.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:15 smithi151 ceph-mon[95510]: pgmap v1625: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 511 B/s wr, 6 op/s 2023-07-21T23:10:17.613 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:17 smithi187 ceph-mon[96918]: pgmap v1626: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 434 B/s wr, 5 op/s 2023-07-21T23:10:17.613 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:17 smithi187 ceph-mon[96918]: osdmap e179: 12 total, 12 up, 12 in 2023-07-21T23:10:17.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:17 smithi195 ceph-mon[97365]: pgmap v1626: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 434 B/s wr, 5 op/s 2023-07-21T23:10:17.642 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:17 smithi195 ceph-mon[97365]: osdmap e179: 12 total, 12 up, 12 in 2023-07-21T23:10:17.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:17 smithi151 ceph-mon[95510]: pgmap v1626: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 434 B/s wr, 5 op/s 2023-07-21T23:10:17.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:17 smithi151 ceph-mon[95510]: osdmap e179: 12 total, 12 up, 12 in 2023-07-21T23:10:19.613 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:19 smithi187 ceph-mon[96918]: pgmap v1628: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 409 B/s wr, 6 op/s 2023-07-21T23:10:19.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:19 smithi195 ceph-mon[97365]: pgmap v1628: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 409 B/s wr, 6 op/s 2023-07-21T23:10:19.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:19 smithi151 ceph-mon[95510]: pgmap v1628: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 409 B/s wr, 6 op/s 2023-07-21T23:10:21.612 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:21 smithi187 ceph-mon[96918]: pgmap v1629: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:10:21.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:21 smithi195 ceph-mon[97365]: pgmap v1629: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:10:21.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:21 smithi151 ceph-mon[95510]: pgmap v1629: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:10:23.612 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:23 smithi187 ceph-mon[96918]: pgmap v1630: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:10:23.641 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:23 smithi195 ceph-mon[97365]: pgmap v1630: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:10:23.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:23 smithi151 ceph-mon[95510]: pgmap v1630: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:10:25.612 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:25 smithi187 ceph-mon[96918]: pgmap v1631: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:10:25.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:25 smithi195 ceph-mon[97365]: pgmap v1631: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:10:25.683 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:25 smithi151 ceph-mon[95510]: pgmap v1631: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:10:27.612 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:27 smithi187 ceph-mon[96918]: pgmap v1632: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:10:27.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:27 smithi195 ceph-mon[97365]: pgmap v1632: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:10:27.682 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:27 smithi151 ceph-mon[95510]: pgmap v1632: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:10:29.612 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:29 smithi187 ceph-mon[96918]: pgmap v1633: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T23:10:29.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:29 smithi195 ceph-mon[97365]: pgmap v1633: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T23:10:29.682 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:29 smithi151 ceph-mon[95510]: pgmap v1633: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T23:10:31.612 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:31 smithi187 ceph-mon[96918]: pgmap v1634: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:10:31.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:31 smithi195 ceph-mon[97365]: pgmap v1634: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:10:31.682 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:31 smithi151 ceph-mon[95510]: pgmap v1634: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:10:33.611 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:33 smithi187 ceph-mon[96918]: pgmap v1635: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:33.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:33 smithi195 ceph-mon[97365]: pgmap v1635: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:33.682 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:33 smithi151 ceph-mon[95510]: pgmap v1635: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:35.611 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:35 smithi187 ceph-mon[96918]: pgmap v1636: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:10:35.640 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:35 smithi195 ceph-mon[97365]: pgmap v1636: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:10:35.682 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:35 smithi151 ceph-mon[95510]: pgmap v1636: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:10:37.611 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:37 smithi187 ceph-mon[96918]: pgmap v1637: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:37.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:37 smithi195 ceph-mon[97365]: pgmap v1637: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:37.682 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:37 smithi151 ceph-mon[95510]: pgmap v1637: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:39.611 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:39 smithi187 ceph-mon[96918]: pgmap v1638: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:10:39.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:39 smithi195 ceph-mon[97365]: pgmap v1638: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:10:39.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:39 smithi151 ceph-mon[95510]: pgmap v1638: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:10:41.611 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:41 smithi187 ceph-mon[96918]: pgmap v1639: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:10:41.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:41 smithi195 ceph-mon[97365]: pgmap v1639: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:10:41.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:41 smithi151 ceph-mon[95510]: pgmap v1639: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:10:43.611 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:43 smithi187 ceph-mon[96918]: pgmap v1640: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:43.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:43 smithi195 ceph-mon[97365]: pgmap v1640: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:43.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:43 smithi151 ceph-mon[95510]: pgmap v1640: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:45.610 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:45 smithi187 ceph-mon[96918]: pgmap v1641: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:10:45.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:45 smithi195 ceph-mon[97365]: pgmap v1641: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:10:45.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:45 smithi151 ceph-mon[95510]: pgmap v1641: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:10:47.610 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:47 smithi187 ceph-mon[96918]: pgmap v1642: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:47.611 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:47 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:10:47.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:47 smithi195 ceph-mon[97365]: pgmap v1642: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:47.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:47 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:10:47.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:47 smithi151 ceph-mon[95510]: pgmap v1642: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:47.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:47 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:10:48.610 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:10:48.611 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:10:48.611 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:10:48.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:10:48.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:10:48.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:10:48.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:10:48.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:10:48.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:10:49.610 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:49 smithi187 ceph-mon[96918]: pgmap v1643: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:10:49.638 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:49 smithi195 ceph-mon[97365]: pgmap v1643: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:10:49.681 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:49 smithi151 ceph-mon[95510]: pgmap v1643: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:10:51.610 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:51 smithi187 ceph-mon[96918]: pgmap v1644: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:10:51.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:51 smithi195 ceph-mon[97365]: pgmap v1644: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:10:51.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:51 smithi151 ceph-mon[95510]: pgmap v1644: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:10:53.610 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:53 smithi187 ceph-mon[96918]: pgmap v1645: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:53.638 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:53 smithi195 ceph-mon[97365]: pgmap v1645: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:53.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:53 smithi151 ceph-mon[95510]: pgmap v1645: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:55.610 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:55 smithi187 ceph-mon[96918]: pgmap v1646: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:10:55.638 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:55 smithi195 ceph-mon[97365]: pgmap v1646: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:10:55.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:55 smithi151 ceph-mon[95510]: pgmap v1646: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:10:57.610 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:57 smithi187 ceph-mon[96918]: pgmap v1647: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:57.639 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:57 smithi195 ceph-mon[97365]: pgmap v1647: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:57.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:57 smithi151 ceph-mon[95510]: pgmap v1647: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:10:59.610 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:10:59 smithi187 ceph-mon[96918]: pgmap v1648: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:10:59.638 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:10:59 smithi195 ceph-mon[97365]: pgmap v1648: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:10:59.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:10:59 smithi151 ceph-mon[95510]: pgmap v1648: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:11:01.609 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:01 smithi187 ceph-mon[96918]: pgmap v1649: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:11:01.638 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:01 smithi195 ceph-mon[97365]: pgmap v1649: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:11:01.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:01 smithi151 ceph-mon[95510]: pgmap v1649: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:11:03.609 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:03 smithi187 ceph-mon[96918]: pgmap v1650: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:03.637 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:03 smithi195 ceph-mon[97365]: pgmap v1650: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:03.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:03 smithi151 ceph-mon[95510]: pgmap v1650: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:05.609 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:05 smithi187 ceph-mon[96918]: pgmap v1651: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:11:05.609 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:05 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:05.637 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:05 smithi195 ceph-mon[97365]: pgmap v1651: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:11:05.638 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:05 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:05.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:05 smithi151 ceph-mon[95510]: pgmap v1651: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:11:05.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:05 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:07.609 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:07 smithi187 ceph-mon[96918]: pgmap v1652: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:11:07.637 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:07 smithi195 ceph-mon[97365]: pgmap v1652: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:11:07.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:07 smithi151 ceph-mon[95510]: pgmap v1652: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:11:09.638 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:09 smithi195 ceph-mon[97365]: pgmap v1653: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:11:09.685 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:09 smithi151 ceph-mon[95510]: pgmap v1653: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:11:09.859 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:09 smithi187 ceph-mon[96918]: pgmap v1653: 97 pgs: 97 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:11:10.680 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:10 smithi151 ceph-mon[95510]: osdmap e180: 12 total, 12 up, 12 in 2023-07-21T23:11:10.864 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:10 smithi187 ceph-mon[96918]: osdmap e180: 12 total, 12 up, 12 in 2023-07-21T23:11:10.888 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:10 smithi195 ceph-mon[97365]: osdmap e180: 12 total, 12 up, 12 in 2023-07-21T23:11:11.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:11 smithi151 ceph-mon[95510]: pgmap v1655: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:11:11.859 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:11 smithi187 ceph-mon[96918]: pgmap v1655: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:11:11.888 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:11 smithi195 ceph-mon[97365]: pgmap v1655: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:11:13.609 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:13 smithi187 ceph-mon[96918]: pgmap v1656: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:11:13.637 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:13 smithi195 ceph-mon[97365]: pgmap v1656: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:11:13.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:13 smithi151 ceph-mon[95510]: pgmap v1656: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 14 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:11:15.608 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:15 smithi187 ceph-mon[96918]: pgmap v1657: 97 pgs: 29 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 55 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:11:15.637 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:15 smithi195 ceph-mon[97365]: pgmap v1657: 97 pgs: 29 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 55 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:11:15.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:15 smithi151 ceph-mon[95510]: pgmap v1657: 97 pgs: 29 active+clean+snaptrim_wait, 13 active+clean+snaptrim, 55 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:11:17.608 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:17 smithi187 ceph-mon[96918]: pgmap v1658: 97 pgs: 27 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 59 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:11:17.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:17 smithi195 ceph-mon[97365]: pgmap v1658: 97 pgs: 27 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 59 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:11:17.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:17 smithi151 ceph-mon[95510]: pgmap v1658: 97 pgs: 27 active+clean+snaptrim_wait, 11 active+clean+snaptrim, 59 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:11:19.608 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:19 smithi187 ceph-mon[96918]: pgmap v1659: 97 pgs: 17 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 73 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:11:19.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:19 smithi195 ceph-mon[97365]: pgmap v1659: 97 pgs: 17 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 73 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:11:19.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:19 smithi151 ceph-mon[95510]: pgmap v1659: 97 pgs: 17 active+clean+snaptrim_wait, 7 active+clean+snaptrim, 73 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:11:21.608 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:21 smithi187 ceph-mon[96918]: pgmap v1660: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 190 B/s wr, 5 op/s 2023-07-21T23:11:21.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:21 smithi195 ceph-mon[97365]: pgmap v1660: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 190 B/s wr, 5 op/s 2023-07-21T23:11:21.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:21 smithi151 ceph-mon[95510]: pgmap v1660: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 190 B/s wr, 5 op/s 2023-07-21T23:11:23.608 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:23 smithi187 ceph-mon[96918]: pgmap v1661: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-07-21T23:11:23.608 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:23 smithi187 ceph-mon[96918]: osdmap e181: 12 total, 12 up, 12 in 2023-07-21T23:11:23.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:23 smithi195 ceph-mon[97365]: pgmap v1661: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-07-21T23:11:23.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:23 smithi195 ceph-mon[97365]: osdmap e181: 12 total, 12 up, 12 in 2023-07-21T23:11:23.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:23 smithi151 ceph-mon[95510]: pgmap v1661: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-07-21T23:11:23.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:23 smithi151 ceph-mon[95510]: osdmap e181: 12 total, 12 up, 12 in 2023-07-21T23:11:25.608 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:25 smithi187 ceph-mon[96918]: pgmap v1663: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:11:25.608 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:25 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:25.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:25 smithi195 ceph-mon[97365]: pgmap v1663: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:11:25.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:25 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:25.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:25 smithi151 ceph-mon[95510]: pgmap v1663: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:11:25.679 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:25 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:27.607 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:27 smithi187 ceph-mon[96918]: pgmap v1664: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:11:27.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:27 smithi195 ceph-mon[97365]: pgmap v1664: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:11:27.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:27 smithi151 ceph-mon[95510]: pgmap v1664: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:11:29.607 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:29 smithi187 ceph-mon[96918]: pgmap v1665: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:11:29.636 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:29 smithi195 ceph-mon[97365]: pgmap v1665: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:11:29.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:29 smithi151 ceph-mon[95510]: pgmap v1665: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:11:31.607 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:31 smithi187 ceph-mon[96918]: pgmap v1666: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:11:31.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:31 smithi195 ceph-mon[97365]: pgmap v1666: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:11:31.678 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:31 smithi151 ceph-mon[95510]: pgmap v1666: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:11:33.607 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:33 smithi187 ceph-mon[96918]: pgmap v1667: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:11:33.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:33 smithi195 ceph-mon[97365]: pgmap v1667: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:11:33.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:33 smithi151 ceph-mon[95510]: pgmap v1667: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:11:35.607 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:35 smithi187 ceph-mon[96918]: pgmap v1668: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:11:35.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:35 smithi195 ceph-mon[97365]: pgmap v1668: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:11:35.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:35 smithi151 ceph-mon[95510]: pgmap v1668: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:11:37.607 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:37 smithi187 ceph-mon[96918]: pgmap v1669: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:37.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:37 smithi195 ceph-mon[97365]: pgmap v1669: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:37.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:37 smithi151 ceph-mon[95510]: pgmap v1669: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:39.607 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:39 smithi187 ceph-mon[96918]: pgmap v1670: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:11:39.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:39 smithi195 ceph-mon[97365]: pgmap v1670: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:11:39.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:39 smithi151 ceph-mon[95510]: pgmap v1670: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:11:41.606 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:41 smithi187 ceph-mon[96918]: pgmap v1671: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:11:41.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:41 smithi195 ceph-mon[97365]: pgmap v1671: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:11:41.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:41 smithi151 ceph-mon[95510]: pgmap v1671: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:11:42.606 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:42 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:42.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:42 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:42.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:42 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:43.606 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:43 smithi187 ceph-mon[96918]: pgmap v1672: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:43.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:43 smithi195 ceph-mon[97365]: pgmap v1672: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:43.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:43 smithi151 ceph-mon[95510]: pgmap v1672: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:45.606 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:45 smithi187 ceph-mon[96918]: pgmap v1673: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:11:45.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:45 smithi195 ceph-mon[97365]: pgmap v1673: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:11:45.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:45 smithi151 ceph-mon[95510]: pgmap v1673: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:11:47.606 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:47 smithi187 ceph-mon[96918]: pgmap v1674: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:47.607 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:47 smithi187 ceph-mon[96918]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:47.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:47 smithi195 ceph-mon[97365]: pgmap v1674: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:47.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:47 smithi195 ceph-mon[97365]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:47.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:47 smithi151 ceph-mon[95510]: pgmap v1674: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:47.677 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:47 smithi151 ceph-mon[95510]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 3 up:standby-replay 6 up:standby 2023-07-21T23:11:48.606 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:48 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:11:48.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:48 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:11:48.676 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:48 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:11:49.606 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:49 smithi187 ceph-mon[96918]: pgmap v1675: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:11:49.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:49 smithi195 ceph-mon[97365]: pgmap v1675: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:11:49.676 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:49 smithi151 ceph-mon[95510]: pgmap v1675: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:11:51.606 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:51 smithi187 ceph-mon[96918]: pgmap v1676: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:11:51.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:51 smithi195 ceph-mon[97365]: pgmap v1676: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:11:51.676 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:51 smithi151 ceph-mon[95510]: pgmap v1676: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:11:53.176 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:52 smithi151 ceph-mon[95510]: pgmap v1677: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:53.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.178 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.178 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.178 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:52 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:52 smithi187 ceph-mon[96918]: pgmap v1677: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:53.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.358 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.358 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:52 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:52 smithi195 ceph-mon[97365]: pgmap v1677: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:53.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:53.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:53.386 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:52 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.176 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T23:11:54.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:11:54.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.177 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.178 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T23:11:54.178 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T23:11:54.178 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:11:54.178 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:11:54.178 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:53 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:54.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T23:11:54.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:11:54.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T23:11:54.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T23:11:54.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:11:54.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:11:54.357 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:53 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:54.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi195 to 220.9M 2023-07-21T23:11:54.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi195 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:11:54.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:11:54.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi151 to 220.9M 2023-07-21T23:11:54.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi151 to 231678361: error parsing value: Value '231678361' is below minimum 939524096 2023-07-21T23:11:54.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:11:54.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:11:54.385 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:53 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:11:55.356 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:54 smithi187 ceph-mon[96918]: pgmap v1678: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:11:55.384 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:54 smithi195 ceph-mon[97365]: pgmap v1678: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:11:55.426 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:54 smithi151 ceph-mon[95510]: pgmap v1678: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:11:57.426 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:57 smithi151 ceph-mon[95510]: pgmap v1679: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:57.605 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:57 smithi187 ceph-mon[96918]: pgmap v1679: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:57.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:57 smithi195 ceph-mon[97365]: pgmap v1679: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:11:59.605 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:11:59 smithi187 ceph-mon[96918]: pgmap v1680: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:11:59.634 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:11:59 smithi195 ceph-mon[97365]: pgmap v1680: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:11:59.676 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:11:59 smithi151 ceph-mon[95510]: pgmap v1680: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:01.605 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:01 smithi187 ceph-mon[96918]: pgmap v1681: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-21T23:12:01.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:01 smithi195 ceph-mon[97365]: pgmap v1681: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-21T23:12:01.675 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:01 smithi151 ceph-mon[95510]: pgmap v1681: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2023-07-21T23:12:03.605 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:03 smithi187 ceph-mon[96918]: pgmap v1682: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:03.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:03 smithi195 ceph-mon[97365]: pgmap v1682: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:03.675 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:03 smithi151 ceph-mon[95510]: pgmap v1682: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:05.605 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:05 smithi187 ceph-mon[96918]: pgmap v1683: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:12:05.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:05 smithi195 ceph-mon[97365]: pgmap v1683: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:12:05.675 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:05 smithi151 ceph-mon[95510]: pgmap v1683: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:12:07.605 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:07 smithi187 ceph-mon[96918]: pgmap v1684: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:12:07.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:07 smithi195 ceph-mon[97365]: pgmap v1684: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:12:07.675 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:07 smithi151 ceph-mon[95510]: pgmap v1684: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:12:09.606 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:09 smithi187 ceph-mon[96918]: pgmap v1685: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:12:09.637 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:09 smithi195 ceph-mon[97365]: pgmap v1685: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:12:09.676 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:09 smithi151 ceph-mon[95510]: pgmap v1685: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:12:10.605 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:10 smithi187 ceph-mon[96918]: osdmap e182: 12 total, 12 up, 12 in 2023-07-21T23:12:10.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:10 smithi195 ceph-mon[97365]: osdmap e182: 12 total, 12 up, 12 in 2023-07-21T23:12:10.675 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:10 smithi151 ceph-mon[95510]: osdmap e182: 12 total, 12 up, 12 in 2023-07-21T23:12:11.605 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:11 smithi187 ceph-mon[96918]: pgmap v1687: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:12:11.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:11 smithi195 ceph-mon[97365]: pgmap v1687: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:12:11.675 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:11 smithi151 ceph-mon[95510]: pgmap v1687: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:12:13.609 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:13 smithi187 ceph-mon[96918]: pgmap v1688: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:12:13.635 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:13 smithi195 ceph-mon[97365]: pgmap v1688: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:12:13.676 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:13 smithi151 ceph-mon[95510]: pgmap v1688: 97 pgs: 2 active+clean+snaptrim, 2 active+clean+snaptrim_wait, 93 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:12:15.604 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:15 smithi187 ceph-mon[96918]: pgmap v1689: 97 pgs: 13 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 55 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:12:15.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:15 smithi195 ceph-mon[97365]: pgmap v1689: 97 pgs: 13 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 55 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:12:15.675 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:15 smithi151 ceph-mon[95510]: pgmap v1689: 97 pgs: 13 active+clean+snaptrim, 29 active+clean+snaptrim_wait, 55 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:12:17.633 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:17 smithi195 ceph-mon[97365]: pgmap v1690: 97 pgs: 11 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 59 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:12:17.675 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:17 smithi151 ceph-mon[95510]: pgmap v1690: 97 pgs: 11 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 59 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:12:17.854 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:17 smithi187 ceph-mon[96918]: pgmap v1690: 97 pgs: 11 active+clean+snaptrim, 27 active+clean+snaptrim_wait, 59 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:12:19.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:19 smithi195 ceph-mon[97365]: pgmap v1691: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:12:19.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:19 smithi151 ceph-mon[95510]: pgmap v1691: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:12:19.854 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:19 smithi187 ceph-mon[96918]: pgmap v1691: 97 pgs: 7 active+clean+snaptrim, 17 active+clean+snaptrim_wait, 73 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:12:21.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:21 smithi195 ceph-mon[97365]: pgmap v1692: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 188 B/s wr, 5 op/s 2023-07-21T23:12:21.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:21 smithi151 ceph-mon[95510]: pgmap v1692: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 188 B/s wr, 5 op/s 2023-07-21T23:12:21.854 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:21 smithi187 ceph-mon[96918]: pgmap v1692: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 188 B/s wr, 5 op/s 2023-07-21T23:12:23.604 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:23 smithi187 ceph-mon[96918]: pgmap v1693: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-07-21T23:12:23.604 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:23 smithi187 ceph-mon[96918]: osdmap e183: 12 total, 12 up, 12 in 2023-07-21T23:12:23.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:23 smithi195 ceph-mon[97365]: pgmap v1693: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-07-21T23:12:23.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:23 smithi195 ceph-mon[97365]: osdmap e183: 12 total, 12 up, 12 in 2023-07-21T23:12:23.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:23 smithi151 ceph-mon[95510]: pgmap v1693: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-07-21T23:12:23.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:23 smithi151 ceph-mon[95510]: osdmap e183: 12 total, 12 up, 12 in 2023-07-21T23:12:25.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:25 smithi187 ceph-mon[96918]: pgmap v1695: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:12:25.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:25 smithi195 ceph-mon[97365]: pgmap v1695: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:12:25.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:25 smithi151 ceph-mon[95510]: pgmap v1695: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:12:27.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:27 smithi187 ceph-mon[96918]: pgmap v1696: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:12:27.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:27 smithi195 ceph-mon[97365]: pgmap v1696: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:12:27.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:27 smithi151 ceph-mon[95510]: pgmap v1696: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:12:29.604 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:29 smithi187 ceph-mon[96918]: pgmap v1697: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:12:29.632 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:29 smithi195 ceph-mon[97365]: pgmap v1697: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:12:29.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:29 smithi151 ceph-mon[95510]: pgmap v1697: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:12:31.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:31 smithi187 ceph-mon[96918]: pgmap v1698: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:12:31.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:31 smithi195 ceph-mon[97365]: pgmap v1698: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:12:31.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:31 smithi151 ceph-mon[95510]: pgmap v1698: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:12:33.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:33 smithi187 ceph-mon[96918]: pgmap v1699: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:12:33.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:33 smithi195 ceph-mon[97365]: pgmap v1699: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:12:33.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:33 smithi151 ceph-mon[95510]: pgmap v1699: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:12:35.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:35 smithi187 ceph-mon[96918]: pgmap v1700: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:12:35.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:35 smithi195 ceph-mon[97365]: pgmap v1700: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:12:35.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:35 smithi151 ceph-mon[95510]: pgmap v1700: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:12:37.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:37 smithi187 ceph-mon[96918]: pgmap v1701: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:37.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:37 smithi195 ceph-mon[97365]: pgmap v1701: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:37.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:37 smithi151 ceph-mon[95510]: pgmap v1701: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:39.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:39 smithi187 ceph-mon[96918]: pgmap v1702: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:39.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:39 smithi195 ceph-mon[97365]: pgmap v1702: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:39.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:39 smithi151 ceph-mon[95510]: pgmap v1702: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:41.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:41 smithi187 ceph-mon[96918]: pgmap v1703: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:12:41.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:41 smithi195 ceph-mon[97365]: pgmap v1703: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:12:41.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:41 smithi151 ceph-mon[95510]: pgmap v1703: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:12:43.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:43 smithi187 ceph-mon[96918]: pgmap v1704: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:43.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:43 smithi195 ceph-mon[97365]: pgmap v1704: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:43.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:43 smithi151 ceph-mon[95510]: pgmap v1704: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:45.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:45 smithi187 ceph-mon[96918]: pgmap v1705: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:12:45.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:45 smithi195 ceph-mon[97365]: pgmap v1705: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:12:45.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:45 smithi151 ceph-mon[95510]: pgmap v1705: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:12:47.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:47 smithi187 ceph-mon[96918]: pgmap v1706: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:47.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:47 smithi195 ceph-mon[97365]: pgmap v1706: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:47.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:47 smithi151 ceph-mon[95510]: pgmap v1706: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:49.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:49 smithi187 ceph-mon[96918]: pgmap v1707: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:49.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:49 smithi195 ceph-mon[97365]: pgmap v1707: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:49.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:49 smithi151 ceph-mon[95510]: pgmap v1707: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:51.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:51 smithi187 ceph-mon[96918]: pgmap v1708: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:12:51.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:51 smithi195 ceph-mon[97365]: pgmap v1708: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:12:51.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:51 smithi151 ceph-mon[95510]: pgmap v1708: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:12:53.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:53 smithi187 ceph-mon[96918]: pgmap v1709: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:53.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:53 smithi195 ceph-mon[97365]: pgmap v1709: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:53.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:53 smithi151 ceph-mon[95510]: pgmap v1709: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:54.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:54 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:12:54.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:54 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:54 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:54 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:54 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:54 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.603 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:54 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:54 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:12:54.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:54 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:54 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:54 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:54 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:54 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:54 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:54 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:12:54.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:54 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:54 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:54 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:54 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:54 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:54.673 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:54 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:55.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:55 smithi187 ceph-mon[96918]: pgmap v1710: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:12:55.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:55 smithi195 ceph-mon[97365]: pgmap v1710: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:12:55.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:55 smithi151 ceph-mon[95510]: pgmap v1710: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:12:57.601 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:57 smithi187 ceph-mon[96918]: pgmap v1711: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:57.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:57 smithi195 ceph-mon[97365]: pgmap v1711: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:57.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:57 smithi151 ceph-mon[95510]: pgmap v1711: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:12:59.351 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:59.352 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:59.352 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: pgmap v1712: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:59.352 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.352 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.352 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.353 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.353 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:12:59.353 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:12:59.353 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:58 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:59.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:59.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:59.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: pgmap v1712: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:59.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:12:59.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:12:59.381 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:58 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:59.422 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:59.422 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:12:59.423 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: pgmap v1712: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:12:59.423 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.423 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.424 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.424 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2023-07-21T23:12:59.424 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:12:59.424 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:12:59.425 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:58 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:13:00.351 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:59 smithi187 ceph-mon[96918]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T23:13:00.352 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:12:59 smithi187 ceph-mon[96918]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:13:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:59 smithi195 ceph-mon[97365]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T23:13:00.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:12:59 smithi195 ceph-mon[97365]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:13:00.422 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:59 smithi151 ceph-mon[95510]: Adjusting osd_memory_target on smithi187 to 220.9M 2023-07-21T23:13:00.422 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:12:59 smithi151 ceph-mon[95510]: Unable to set osd_memory_target on smithi187 to 231661158: error parsing value: Value '231661158' is below minimum 939524096 2023-07-21T23:13:01.351 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:00 smithi187 ceph-mon[96918]: pgmap v1713: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:13:01.380 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:00 smithi195 ceph-mon[97365]: pgmap v1713: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:13:01.422 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:00 smithi151 ceph-mon[95510]: pgmap v1713: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:13:03.601 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:03 smithi187 ceph-mon[96918]: pgmap v1714: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:03.629 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:03 smithi195 ceph-mon[97365]: pgmap v1714: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:03.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:03 smithi151 ceph-mon[95510]: pgmap v1714: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:05.601 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:05 smithi187 ceph-mon[96918]: pgmap v1715: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:13:05.629 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:05 smithi195 ceph-mon[97365]: pgmap v1715: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:13:05.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:05 smithi151 ceph-mon[95510]: pgmap v1715: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:13:07.601 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:07 smithi187 ceph-mon[96918]: pgmap v1716: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:13:07.629 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:07 smithi195 ceph-mon[97365]: pgmap v1716: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:13:07.671 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:07 smithi151 ceph-mon[95510]: pgmap v1716: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:13:09.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:09 smithi187 ceph-mon[96918]: pgmap v1717: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:13:09.631 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:09 smithi195 ceph-mon[97365]: pgmap v1717: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:13:09.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:09 smithi151 ceph-mon[95510]: pgmap v1717: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:13:10.608 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:10 smithi187 ceph-mon[96918]: osdmap e184: 12 total, 12 up, 12 in 2023-07-21T23:13:10.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:10 smithi195 ceph-mon[97365]: osdmap e184: 12 total, 12 up, 12 in 2023-07-21T23:13:10.672 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:10 smithi151 ceph-mon[95510]: osdmap e184: 12 total, 12 up, 12 in 2023-07-21T23:13:11.602 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:11 smithi187 ceph-mon[96918]: pgmap v1719: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:13:11.630 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:11 smithi195 ceph-mon[97365]: pgmap v1719: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:13:11.671 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:11 smithi151 ceph-mon[95510]: pgmap v1719: 97 pgs: 97 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:13:13.638 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:13 smithi195 ceph-mon[97365]: pgmap v1720: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:13:13.674 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:13 smithi151 ceph-mon[95510]: pgmap v1720: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:13:13.851 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:13 smithi187 ceph-mon[96918]: pgmap v1720: 97 pgs: 2 active+clean+snaptrim_wait, 2 active+clean+snaptrim, 93 active+clean; 13 GiB data, 31 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:13:15.629 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:15 smithi195 ceph-mon[97365]: pgmap v1721: 97 pgs: 29 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 54 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:13:15.671 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:15 smithi151 ceph-mon[95510]: pgmap v1721: 97 pgs: 29 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 54 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:13:15.850 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:15 smithi187 ceph-mon[96918]: pgmap v1721: 97 pgs: 29 active+clean+snaptrim_wait, 14 active+clean+snaptrim, 54 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:13:17.629 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:17 smithi195 ceph-mon[97365]: pgmap v1722: 97 pgs: 27 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 58 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:13:17.671 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:17 smithi151 ceph-mon[95510]: pgmap v1722: 97 pgs: 27 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 58 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:13:17.850 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:17 smithi187 ceph-mon[96918]: pgmap v1722: 97 pgs: 27 active+clean+snaptrim_wait, 12 active+clean+snaptrim, 58 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:13:19.628 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:19 smithi195 ceph-mon[97365]: pgmap v1723: 97 pgs: 17 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 72 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:13:19.671 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:19 smithi151 ceph-mon[95510]: pgmap v1723: 97 pgs: 17 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 72 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:13:19.850 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:19 smithi187 ceph-mon[96918]: pgmap v1723: 97 pgs: 17 active+clean+snaptrim_wait, 8 active+clean+snaptrim, 72 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:13:21.671 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:21 smithi151 ceph-mon[95510]: pgmap v1724: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 188 B/s wr, 5 op/s 2023-07-21T23:13:21.850 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:21 smithi187 ceph-mon[96918]: pgmap v1724: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 188 B/s wr, 5 op/s 2023-07-21T23:13:21.878 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:21 smithi195 ceph-mon[97365]: pgmap v1724: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 188 B/s wr, 5 op/s 2023-07-21T23:13:23.600 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:23 smithi187 ceph-mon[96918]: pgmap v1725: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-07-21T23:13:23.600 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:23 smithi187 ceph-mon[96918]: osdmap e185: 12 total, 12 up, 12 in 2023-07-21T23:13:23.628 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:23 smithi195 ceph-mon[97365]: pgmap v1725: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-07-21T23:13:23.629 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:23 smithi195 ceph-mon[97365]: osdmap e185: 12 total, 12 up, 12 in 2023-07-21T23:13:23.670 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:23 smithi151 ceph-mon[95510]: pgmap v1725: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2023-07-21T23:13:23.671 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:23 smithi151 ceph-mon[95510]: osdmap e185: 12 total, 12 up, 12 in 2023-07-21T23:13:25.600 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:25 smithi187 ceph-mon[96918]: pgmap v1727: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:13:25.628 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:25 smithi195 ceph-mon[97365]: pgmap v1727: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:13:25.670 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:25 smithi151 ceph-mon[95510]: pgmap v1727: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:13:27.600 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:27 smithi187 ceph-mon[96918]: pgmap v1728: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:13:27.628 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:27 smithi195 ceph-mon[97365]: pgmap v1728: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:13:27.670 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:27 smithi151 ceph-mon[95510]: pgmap v1728: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:13:29.600 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:29 smithi187 ceph-mon[96918]: pgmap v1729: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:13:29.628 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:29 smithi195 ceph-mon[97365]: pgmap v1729: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:13:29.670 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:29 smithi151 ceph-mon[95510]: pgmap v1729: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:13:31.600 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:31 smithi187 ceph-mon[96918]: pgmap v1730: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:13:31.628 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:31 smithi195 ceph-mon[97365]: pgmap v1730: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:13:31.670 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:31 smithi151 ceph-mon[95510]: pgmap v1730: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:13:33.599 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:33 smithi187 ceph-mon[96918]: pgmap v1731: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:13:33.628 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:33 smithi195 ceph-mon[97365]: pgmap v1731: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:13:33.670 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:33 smithi151 ceph-mon[95510]: pgmap v1731: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2023-07-21T23:13:35.599 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:35 smithi187 ceph-mon[96918]: pgmap v1732: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:13:35.628 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:35 smithi195 ceph-mon[97365]: pgmap v1732: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:13:35.670 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:35 smithi151 ceph-mon[95510]: pgmap v1732: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 7 op/s 2023-07-21T23:13:37.599 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:37 smithi187 ceph-mon[96918]: pgmap v1733: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:37.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:37 smithi195 ceph-mon[97365]: pgmap v1733: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:37.670 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:37 smithi151 ceph-mon[95510]: pgmap v1733: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:39.599 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:39 smithi187 ceph-mon[96918]: pgmap v1734: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:13:39.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:39 smithi195 ceph-mon[97365]: pgmap v1734: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:13:39.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:39 smithi151 ceph-mon[95510]: pgmap v1734: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:13:41.599 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:41 smithi187 ceph-mon[96918]: pgmap v1735: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:13:41.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:41 smithi195 ceph-mon[97365]: pgmap v1735: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:13:41.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:41 smithi151 ceph-mon[95510]: pgmap v1735: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:13:43.599 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:43 smithi187 ceph-mon[96918]: pgmap v1736: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:43.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:43 smithi195 ceph-mon[97365]: pgmap v1736: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:43.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:43 smithi151 ceph-mon[95510]: pgmap v1736: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:45.599 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:45 smithi187 ceph-mon[96918]: pgmap v1737: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:13:45.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:45 smithi195 ceph-mon[97365]: pgmap v1737: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:13:45.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:45 smithi151 ceph-mon[95510]: pgmap v1737: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:13:47.599 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:47 smithi187 ceph-mon[96918]: pgmap v1738: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:47.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:47 smithi195 ceph-mon[97365]: pgmap v1738: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:47.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:47 smithi151 ceph-mon[95510]: pgmap v1738: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:49.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:49 smithi187 ceph-mon[96918]: pgmap v1739: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:13:49.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:49 smithi195 ceph-mon[97365]: pgmap v1739: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:13:49.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:49 smithi151 ceph-mon[95510]: pgmap v1739: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:13:51.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:51 smithi187 ceph-mon[96918]: pgmap v1740: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:13:51.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:51 smithi195 ceph-mon[97365]: pgmap v1740: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:13:51.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:51 smithi151 ceph-mon[95510]: pgmap v1740: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:13:53.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:53 smithi187 ceph-mon[96918]: pgmap v1741: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:53.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:53 smithi195 ceph-mon[97365]: pgmap v1741: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:53.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:53 smithi151 ceph-mon[95510]: pgmap v1741: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:55.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:55 smithi187 ceph-mon[96918]: pgmap v1742: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:13:55.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:55 smithi195 ceph-mon[97365]: pgmap v1742: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:13:55.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:55 smithi151 ceph-mon[95510]: pgmap v1742: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:13:57.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:57 smithi187 ceph-mon[96918]: pgmap v1743: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:57.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:57 smithi195 ceph-mon[97365]: pgmap v1743: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:57.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:57 smithi151 ceph-mon[95510]: pgmap v1743: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:13:59.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:59 smithi187 ceph-mon[96918]: pgmap v1744: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:13:59.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:13:59 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:13:59.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:59 smithi195 ceph-mon[97365]: pgmap v1744: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:13:59.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:13:59 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:13:59.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:59 smithi151 ceph-mon[95510]: pgmap v1744: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2023-07-21T23:13:59.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:13:59 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2023-07-21T23:14:00.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:14:00.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:14:00.598 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:00 smithi187 ceph-mon[96918]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:14:00.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:14:00.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:14:00.627 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:00 smithi195 ceph-mon[97365]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:14:00.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2023-07-21T23:14:00.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2023-07-21T23:14:00.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:00 smithi151 ceph-mon[95510]: from='mgr.15489 172.21.15.151:0/3017380108' entity='mgr.x' 2023-07-21T23:14:01.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:01 smithi195 ceph-mon[97365]: pgmap v1745: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:14:01.669 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:01 smithi151 ceph-mon[95510]: pgmap v1745: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:14:01.848 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:01 smithi187 ceph-mon[96918]: pgmap v1745: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2023-07-21T23:14:03.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:03 smithi195 ceph-mon[97365]: pgmap v1746: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:14:03.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:03 smithi151 ceph-mon[95510]: pgmap v1746: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:14:03.848 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:03 smithi187 ceph-mon[96918]: pgmap v1746: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:14:05.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:05 smithi195 ceph-mon[97365]: pgmap v1747: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:14:05.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:05 smithi151 ceph-mon[95510]: pgmap v1747: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:14:05.848 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:05 smithi187 ceph-mon[96918]: pgmap v1747: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2023-07-21T23:14:07.626 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:07 smithi195 ceph-mon[97365]: pgmap v1748: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:14:07.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:07 smithi151 ceph-mon[95510]: pgmap v1748: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:14:07.848 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:07 smithi187 ceph-mon[96918]: pgmap v1748: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 45 KiB/s wr, 19 op/s 2023-07-21T23:14:09.670 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:09 smithi151 ceph-mon[95510]: pgmap v1749: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:14:09.847 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:09 smithi187 ceph-mon[96918]: pgmap v1749: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:14:09.876 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:09 smithi195 ceph-mon[97365]: pgmap v1749: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 45 KiB/s wr, 20 op/s 2023-07-21T23:14:10.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:10 smithi151 ceph-mon[95510]: osdmap e186: 12 total, 12 up, 12 in 2023-07-21T23:14:10.847 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:10 smithi187 ceph-mon[96918]: osdmap e186: 12 total, 12 up, 12 in 2023-07-21T23:14:10.876 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:10 smithi195 ceph-mon[97365]: osdmap e186: 12 total, 12 up, 12 in 2023-07-21T23:14:11.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:11 smithi151 ceph-mon[95510]: pgmap v1751: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:14:11.847 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:11 smithi187 ceph-mon[96918]: pgmap v1751: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:14:11.875 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:11 smithi195 ceph-mon[97365]: pgmap v1751: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:14:13.668 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:13 smithi151 ceph-mon[95510]: pgmap v1752: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:14:13.847 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:13 smithi187 ceph-mon[96918]: pgmap v1752: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:14:13.875 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:13 smithi195 ceph-mon[97365]: pgmap v1752: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 54 KiB/s wr, 23 op/s 2023-07-21T23:14:14.847 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:14 smithi187 ceph-mon[96918]: pgmap v1753: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:14.875 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:14 smithi195 ceph-mon[97365]: pgmap v1753: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:14.918 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:14 smithi151 ceph-mon[95510]: pgmap v1753: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:17.597 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:17 smithi187 ceph-mon[96918]: pgmap v1754: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:17.625 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:17 smithi195 ceph-mon[97365]: pgmap v1754: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:17.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:17 smithi151 ceph-mon[95510]: pgmap v1754: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:18.597 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:18 smithi187 ceph-mon[96918]: osdmap e187: 12 total, 12 up, 12 in 2023-07-21T23:14:18.625 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:18 smithi195 ceph-mon[97365]: osdmap e187: 12 total, 12 up, 12 in 2023-07-21T23:14:18.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:18 smithi151 ceph-mon[95510]: osdmap e187: 12 total, 12 up, 12 in 2023-07-21T23:14:19.597 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:19 smithi187 ceph-mon[96918]: pgmap v1756: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 116 B/s wr, 4 op/s 2023-07-21T23:14:19.625 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:19 smithi195 ceph-mon[97365]: pgmap v1756: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 116 B/s wr, 4 op/s 2023-07-21T23:14:19.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:19 smithi151 ceph-mon[95510]: pgmap v1756: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 116 B/s wr, 4 op/s 2023-07-21T23:14:21.597 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:21 smithi187 ceph-mon[96918]: pgmap v1757: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:21.625 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:21 smithi195 ceph-mon[97365]: pgmap v1757: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:21.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:21 smithi151 ceph-mon[95510]: pgmap v1757: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:23.596 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:23 smithi187 ceph-mon[96918]: pgmap v1758: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:23.625 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:23 smithi195 ceph-mon[97365]: pgmap v1758: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:23.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:23 smithi151 ceph-mon[95510]: pgmap v1758: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2023-07-21T23:14:25.596 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:25 smithi187 ceph-mon[96918]: pgmap v1759: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:14:25.625 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:25 smithi195 ceph-mon[97365]: pgmap v1759: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:14:25.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:25 smithi151 ceph-mon[95510]: pgmap v1759: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:14:27.596 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:27 smithi187 ceph-mon[96918]: pgmap v1760: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:14:27.625 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:27 smithi195 ceph-mon[97365]: pgmap v1760: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:14:27.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:27 smithi151 ceph-mon[95510]: pgmap v1760: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2023-07-21T23:14:29.596 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:29 smithi187 ceph-mon[96918]: pgmap v1761: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2023-07-21T23:14:29.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:29 smithi195 ceph-mon[97365]: pgmap v1761: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2023-07-21T23:14:29.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:29 smithi151 ceph-mon[95510]: pgmap v1761: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 94 B/s wr, 5 op/s 2023-07-21T23:14:31.596 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:31 smithi187 ceph-mon[96918]: pgmap v1762: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 7 op/s 2023-07-21T23:14:31.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:31 smithi195 ceph-mon[97365]: pgmap v1762: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 7 op/s 2023-07-21T23:14:31.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:31 smithi151 ceph-mon[95510]: pgmap v1762: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 7 op/s 2023-07-21T23:14:33.596 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:33 smithi187 ceph-mon[96918]: pgmap v1763: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:14:33.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:33 smithi195 ceph-mon[97365]: pgmap v1763: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:14:33.667 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:33 smithi151 ceph-mon[95510]: pgmap v1763: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2023-07-21T23:14:35.596 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:35 smithi187 ceph-mon[96918]: pgmap v1764: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:14:35.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:35 smithi195 ceph-mon[97365]: pgmap v1764: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:14:35.666 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:35 smithi151 ceph-mon[95510]: pgmap v1764: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2023-07-21T23:14:37.596 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:37 smithi187 ceph-mon[96918]: pgmap v1765: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-07-21T23:14:37.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:37 smithi195 ceph-mon[97365]: pgmap v1765: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-07-21T23:14:37.666 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:37 smithi151 ceph-mon[95510]: pgmap v1765: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2023-07-21T23:14:39.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:39 smithi195 ceph-mon[97365]: pgmap v1766: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T23:14:39.666 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:39 smithi151 ceph-mon[95510]: pgmap v1766: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T23:14:39.846 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:39 smithi187 ceph-mon[96918]: pgmap v1766: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2023-07-21T23:14:41.306 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2023-07-21T23:14:41.307 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/ceph_fuse.py", line 175, in task yield all_mounts File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2023-07-21T23:14:41.308 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2023-07-21T23:14:41.318 INFO:tasks.cephadm:Teardown begin 2023-07-21T23:14:41.319 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/cephadm.py", line 1677, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-07-21T23:14:41.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-21T23:14:41.456 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-21T23:14:41.597 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-21T23:14:41.624 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:41 smithi195 ceph-mon[97365]: pgmap v1767: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T23:14:41.666 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:41 smithi151 ceph-mon[95510]: pgmap v1767: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T23:14:41.789 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2023-07-21T23:14:41.790 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-21T23:14:41.846 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:41 smithi187 ceph-mon[96918]: pgmap v1767: 97 pgs: 97 active+clean; 13 GiB data, 30 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2023-07-21T23:14:41.855 DEBUG:teuthology.orchestra.run.smithi187:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-21T23:14:41.901 DEBUG:teuthology.orchestra.run.smithi195:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2023-07-21T23:14:41.948 INFO:tasks.cephadm:Stopping all daemons... 2023-07-21T23:14:41.949 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2023-07-21T23:14:41.949 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.a 2023-07-21T23:14:42.416 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:42 smithi151 systemd[1]: Stopping Ceph mon.a for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:14:42.916 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:42 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T23:14:42.563+0000 7f566501d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:14:42.917 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:42 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a[95486]: 2023-07-21T23:14:42.563+0000 7f566501d700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2023-07-21T23:14:43.577 INFO:journalctl@ceph.mon.a.smithi151.stdout:Jul 21 23:14:43 smithi151 bash[194804]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-a 2023-07-21T23:14:43.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.a.service' 2023-07-21T23:14:43.728 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:14:43.729 INFO:tasks.cephadm.mon.a:Stopped mon.a 2023-07-21T23:14:43.729 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2023-07-21T23:14:43.730 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.b 2023-07-21T23:14:44.096 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:43 smithi187 systemd[1]: Stopping Ceph mon.b for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:14:44.728 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:44 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-b[96894]: 2023-07-21T23:14:44.399+0000 7fd5f8f16700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:14:44.728 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:44 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-b[96894]: 2023-07-21T23:14:44.399+0000 7fd5f8f16700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2023-07-21T23:14:45.095 INFO:journalctl@ceph.mon.b.smithi187.stdout:Jul 21 23:14:44 smithi187 bash[136905]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-b 2023-07-21T23:14:45.274 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.b.service' 2023-07-21T23:14:45.366 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:14:45.366 INFO:tasks.cephadm.mon.c:Stopped mon.b 2023-07-21T23:14:45.367 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2023-07-21T23:14:45.367 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.c 2023-07-21T23:14:46.124 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:45 smithi195 systemd[1]: Stopping Ceph mon.c for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:14:46.470 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:46 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-c[97340]: 2023-07-21T23:14:46.171+0000 7fa1a8c1b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:14:46.470 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:46 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-c[97340]: 2023-07-21T23:14:46.171+0000 7fa1a8c1b700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2023-07-21T23:14:46.794 INFO:journalctl@ceph.mon.c.smithi195.stdout:Jul 21 23:14:46 smithi195 bash[140492]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mon-c 2023-07-21T23:14:47.092 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mon.c.service' 2023-07-21T23:14:47.191 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:14:47.191 INFO:tasks.cephadm.mon.c:Stopped mon.c 2023-07-21T23:14:47.192 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2023-07-21T23:14:47.193 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.x 2023-07-21T23:14:47.666 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 23:14:47 smithi151 systemd[1]: Stopping Ceph mgr.x for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:14:47.973 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 23:14:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x[95756]: 2023-07-21T23:14:47.708+0000 7fee8c3a1700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:14:48.416 INFO:journalctl@ceph.mgr.x.smithi151.stdout:Jul 21 23:14:48 smithi151 bash[194945]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-x 2023-07-21T23:14:48.444 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.x.service' 2023-07-21T23:14:48.534 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:14:48.534 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2023-07-21T23:14:48.535 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2023-07-21T23:14:48.535 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.y 2023-07-21T23:14:49.095 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 23:14:48 smithi187 systemd[1]: Stopping Ceph mgr.y for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:14:49.591 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 23:14:49 smithi187 bash[137057]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-y 2023-07-21T23:14:49.774 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.y.service' 2023-07-21T23:14:49.845 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 23:14:49 smithi187 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.y.service: Main process exited, code=exited, status=143/n/a 2023-07-21T23:14:49.845 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 23:14:49 smithi187 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.y.service: Failed with result 'exit-code'. 2023-07-21T23:14:49.845 INFO:journalctl@ceph.mgr.y.smithi187.stdout:Jul 21 23:14:49 smithi187 systemd[1]: Stopped Ceph mgr.y for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T23:14:49.859 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:14:49.859 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2023-07-21T23:14:49.860 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2023-07-21T23:14:49.860 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.z 2023-07-21T23:14:50.373 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 23:14:49 smithi195 systemd[1]: Stopping Ceph mgr.z for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:14:50.873 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 23:14:50 smithi195 bash[140637]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mgr-z 2023-07-21T23:14:51.106 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.z.service' 2023-07-21T23:14:51.166 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 23:14:50 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.z.service: Main process exited, code=exited, status=143/n/a 2023-07-21T23:14:51.167 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 23:14:51 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mgr.z.service: Failed with result 'exit-code'. 2023-07-21T23:14:51.167 INFO:journalctl@ceph.mgr.z.smithi195.stdout:Jul 21 23:14:51 smithi195 systemd[1]: Stopped Ceph mgr.z for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T23:14:51.190 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:14:51.191 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2023-07-21T23:14:51.191 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2023-07-21T23:14:51.192 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.0 2023-07-21T23:14:51.666 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 23:14:51 smithi151 systemd[1]: Stopping Ceph osd.0 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:14:52.166 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 23:14:51 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-0[108545]: 2023-07-21T23:14:51.765+0000 7f7ea8797700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:14:52.166 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 23:14:51 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-0[108545]: 2023-07-21T23:14:51.765+0000 7f7ea8797700 -1 osd.0 187 *** Got signal Terminated *** 2023-07-21T23:14:52.166 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 23:14:51 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-0[108545]: 2023-07-21T23:14:51.765+0000 7f7ea8797700 -1 osd.0 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:14:58.166 INFO:journalctl@ceph.osd.0.smithi151.stdout:Jul 21 23:14:57 smithi151 bash[195093]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-0 2023-07-21T23:15:01.143 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.0.service' 2023-07-21T23:15:01.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:15:01.234 INFO:tasks.cephadm.osd.0:Stopped osd.0 2023-07-21T23:15:01.234 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2023-07-21T23:15:01.235 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.1 2023-07-21T23:15:01.594 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 23:15:01 smithi187 systemd[1]: Stopping Ceph osd.1 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:15:02.094 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 23:15:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-1[102031]: 2023-07-21T23:15:01.797+0000 7f540e836700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:15:02.095 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 23:15:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-1[102031]: 2023-07-21T23:15:01.797+0000 7f540e836700 -1 osd.1 187 *** Got signal Terminated *** 2023-07-21T23:15:02.095 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 23:15:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-1[102031]: 2023-07-21T23:15:01.797+0000 7f540e836700 -1 osd.1 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:15:08.096 INFO:journalctl@ceph.osd.1.smithi187.stdout:Jul 21 23:15:07 smithi187 bash[137217]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-1 2023-07-21T23:15:09.983 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.1.service' 2023-07-21T23:15:10.071 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:15:10.071 INFO:tasks.cephadm.osd.1:Stopped osd.1 2023-07-21T23:15:10.072 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2023-07-21T23:15:10.072 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.2 2023-07-21T23:15:10.582 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 23:15:10 smithi195 systemd[1]: Stopping Ceph osd.2 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:15:10.872 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 23:15:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-2[103401]: 2023-07-21T23:15:10.571+0000 7f306e1d4700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:15:10.873 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 23:15:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-2[103401]: 2023-07-21T23:15:10.571+0000 7f306e1d4700 -1 osd.2 187 *** Got signal Terminated *** 2023-07-21T23:15:10.873 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 23:15:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-2[103401]: 2023-07-21T23:15:10.571+0000 7f306e1d4700 -1 osd.2 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:15:16.981 INFO:journalctl@ceph.osd.2.smithi195.stdout:Jul 21 23:15:16 smithi195 bash[140799]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-2 2023-07-21T23:15:18.928 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.2.service' 2023-07-21T23:15:19.017 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:15:19.017 INFO:tasks.cephadm.osd.2:Stopped osd.2 2023-07-21T23:15:19.018 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2023-07-21T23:15:19.018 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.3 2023-07-21T23:15:19.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:18 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:18.770+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:19.414 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 23:15:19 smithi151 systemd[1]: Stopping Ceph osd.3 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:15:19.415 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:19 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:19.170+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:19.594 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:19.237+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:19.776 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:19 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:19.513+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:19.914 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 23:15:19 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-3[114027]: 2023-07-21T23:15:19.537+0000 7ff604af7700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:15:19.914 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 23:15:19 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-3[114027]: 2023-07-21T23:15:19.537+0000 7ff604af7700 -1 osd.3 187 *** Got signal Terminated *** 2023-07-21T23:15:19.915 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 23:15:19 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-3[114027]: 2023-07-21T23:15:19.537+0000 7ff604af7700 -1 osd.3 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:15:20.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:19 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:19.766+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:20.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:20.143+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:20.415 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:20 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:20.051+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:20.594 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:20 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:20.261+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:20.622 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:20 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:20.485+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:20.622 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:20 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:20.249+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:21.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:20 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:20.723+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:21.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:21 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:21.136+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:21.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:21 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:21.101+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:21.481 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:21.219+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:21.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:21 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:21.295+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:21.872 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:21.471+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:21.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:21.694+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:21.914 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 23:15:21 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-3[114027]: 2023-07-21T23:15:21.520+0000 7ff6010ed700 -1 osd.3 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.008977+0000 front 2023-07-21T23:14:56.009178+0000 (oldest deadline 2023-07-21T23:15:20.709137+0000) 2023-07-21T23:15:22.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:22 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:22.179+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:22.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:22 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:22.118+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:22.594 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:22 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:22.301+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:22.622 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:22.493+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:22.622 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:22.262+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:22.914 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 23:15:22 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-3[114027]: 2023-07-21T23:15:22.524+0000 7ff6010ed700 -1 osd.3 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.008977+0000 front 2023-07-21T23:14:56.009178+0000 (oldest deadline 2023-07-21T23:15:20.709137+0000) 2023-07-21T23:15:23.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:22.656+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:23.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:23 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:23.224+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:23.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:23 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:23.077+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:23.594 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:23 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:23.262+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:23.622 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:23.528+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:23.622 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:23.290+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:23.914 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 23:15:23 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-3[114027]: 2023-07-21T23:15:23.502+0000 7ff6010ed700 -1 osd.3 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.008977+0000 front 2023-07-21T23:14:56.009178+0000 (oldest deadline 2023-07-21T23:15:20.709137+0000) 2023-07-21T23:15:24.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:23.622+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:24.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:24 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:24.223+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:24.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:24 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:24.069+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:24.558 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:24.280+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:24.594 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:24 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:24.306+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:24.872 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:24.549+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:24.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:24.664+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:25.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:25 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:25.201+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:25.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:25 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:25.035+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:25.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:25 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:25.282+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:25.622 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:25.305+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:25.622 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:25.525+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:25.914 INFO:journalctl@ceph.osd.3.smithi151.stdout:Jul 21 23:15:25 smithi151 bash[195382]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-3 2023-07-21T23:15:26.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:25.696+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:26.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:26 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:26.237+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:26.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:26 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:26.052+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:26.546 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:26.282+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:26.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:26 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:26.241+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:26.871 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:26.536+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:26.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:26.711+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:27.334 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:27 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:27.210+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:27.335 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:27 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:27.032+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:27.586 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:27.252+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:27.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:27 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:27.276+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:27.605 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.3.service' 2023-07-21T23:15:27.696 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:15:27.696 INFO:tasks.cephadm.osd.3:Stopped osd.3 2023-07-21T23:15:27.697 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2023-07-21T23:15:27.697 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.4 2023-07-21T23:15:27.871 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:27.577+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:27.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:27.746+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:27.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:27.746+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:28.093 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:27 smithi187 systemd[1]: Stopping Ceph osd.4 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:15:28.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:28 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:28.192+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:28.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:27 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:27.998+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:28.570 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:28.231+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:28.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:28 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:28.249+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:28.594 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:28 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T23:15:28.233+0000 7fb179b74700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:15:28.594 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:28 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T23:15:28.233+0000 7fb179b74700 -1 osd.4 187 *** Got signal Terminated *** 2023-07-21T23:15:28.594 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:28 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T23:15:28.233+0000 7fb179b74700 -1 osd.4 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:15:28.872 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:28.560+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:28.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:28.757+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:28.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:28.757+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:29.301 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:28 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T23:15:28.945+0000 7fb172162700 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.346932+0000 front 2023-07-21T23:15:05.347049+0000 (oldest deadline 2023-07-21T23:15:28.247101+0000) 2023-07-21T23:15:29.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:29 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:29.035+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:29.415 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:29 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:29.157+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:29.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:29 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:29.292+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:29.605 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:29.203+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:29.872 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:29.595+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:29.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:29.795+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:29.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:29.795+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:30.287 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:29 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T23:15:29.992+0000 7fb172162700 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.346932+0000 front 2023-07-21T23:15:05.347049+0000 (oldest deadline 2023-07-21T23:15:28.247101+0000) 2023-07-21T23:15:30.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:30 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:30.049+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:30.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:30 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:30.049+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:30.415 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:30 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:30.192+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:30.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:30 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:30.277+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:30.602 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:30.244+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:30.602 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:30.244+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:30.871 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:30.592+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:30.872 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:30.592+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:30.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:30.802+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:30.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:30.802+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:31.295 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:31 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T23:15:31.028+0000 7fb172162700 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.346932+0000 front 2023-07-21T23:15:05.347049+0000 (oldest deadline 2023-07-21T23:15:28.247101+0000) 2023-07-21T23:15:31.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:31 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:31.087+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:31.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:31 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:31.087+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:31.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:31 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:31.162+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:31.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:31 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:31.286+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:31.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:31 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:31.286+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:31.599 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:31.285+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:31.600 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:31.285+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:31.872 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:31.590+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:31.872 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:31.590+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:31.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:31.819+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:31.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:31.819+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:32.343 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:32 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T23:15:32.062+0000 7fb172162700 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.346932+0000 front 2023-07-21T23:15:05.347049+0000 (oldest deadline 2023-07-21T23:15:28.247101+0000) 2023-07-21T23:15:32.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:32 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:32.053+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:32.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:32 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:32.053+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:32.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:32 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:32.181+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:32.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:32 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:32.181+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:32.597 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:32.269+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:32.598 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:32.269+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:32.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:32 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:32.334+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:32.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:32 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:32.334+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:32.844 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:32 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:32.496+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:32.871 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:32.588+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:32.872 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:32.588+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:32.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:32.791+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:32.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:32.791+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:33.343 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:33 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4[107524]: 2023-07-21T23:15:33.033+0000 7fb172162700 -1 osd.4 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.346932+0000 front 2023-07-21T23:15:05.347049+0000 (oldest deadline 2023-07-21T23:15:28.247101+0000) 2023-07-21T23:15:33.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:33 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:33.015+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:33.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:33 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:33.015+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:33.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:33 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:33.158+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:33.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:33 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:33.158+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:33.571 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:33 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:33.306+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:33.571 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:33 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:33.306+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:33.830 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:33 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:33.562+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:33.830 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:33 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:33.562+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:33.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:33 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:33.500+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:33.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:33 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:33.367+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:33.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:33 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:33.367+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:34.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:33 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:33.820+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:34.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:33 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:33.820+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:34.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:34.028+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:34.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:34.028+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:34.415 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:34.189+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:34.415 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:34 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:34.189+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:34.608 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:34 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:34.283+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:34.609 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:34 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:34.283+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:34.843 INFO:journalctl@ceph.osd.4.smithi187.stdout:Jul 21 23:15:34 smithi187 bash[137484]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-4 2023-07-21T23:15:34.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:34 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:34.458+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:34.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:34 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:34.338+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:34.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:34 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:34.338+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:34.871 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:34 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:34.599+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:34.871 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:34 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:34.599+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:34.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:34 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:34.803+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:34.872 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:34 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:34.803+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:35.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:35.043+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:35.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:35.043+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:35.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:35.200+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:35.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:35 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:35.200+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:35.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:35 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:35.268+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:35.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:35 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:35.268+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:35.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:35 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:35.445+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:35.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:35 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:35.376+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:35.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:35 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:35.376+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:36.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:35 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:35.649+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:36.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:35 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:35.649+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:36.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:35 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:35.765+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:36.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:35 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:35.765+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:36.235 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.4.service' 2023-07-21T23:15:36.323 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:15:36.323 INFO:tasks.cephadm.osd.4:Stopped osd.4 2023-07-21T23:15:36.324 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2023-07-21T23:15:36.324 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.5 2023-07-21T23:15:36.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:36 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:36.074+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:36.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:36 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:36.074+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:36.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:36 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:36.202+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:36.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:36 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:36.202+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:36.593 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:36 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:36.455+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:36.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:36 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:36.422+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:36.593 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:36 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:36.422+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:36.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:36 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:36.313+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:36.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:36 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:36.313+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:36.622 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:36 smithi195 systemd[1]: Stopping Ceph osd.5 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:15:37.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:36 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:36.687+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:37.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:36 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:36.687+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:37.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:36 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:36.748+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:37.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:36 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:36.748+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:37.122 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:36 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:36.825+0000 7fa54b664700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:15:37.122 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:36 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:36.825+0000 7fa54b664700 -1 osd.5 187 *** Got signal Terminated *** 2023-07-21T23:15:37.122 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:36 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:36.825+0000 7fa54b664700 -1 osd.5 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:15:37.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:37 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:37.082+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:37.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:37 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:37.082+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:37.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:37 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:37.224+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:37.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:37 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:37.224+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:37.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:37 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:37.224+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:37.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:37 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:37.313+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:37.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:37 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:37.313+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:37.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:37 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:37.497+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:37.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:37 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:37.390+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:37.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:37 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:37.390+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:37.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:37 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:37.390+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:38.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:37 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:37.710+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:38.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:37 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:37.710+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:38.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:37 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:37.748+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:38.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:37 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:37.748+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:38.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:38 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:38.123+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:38.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:38 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:38.123+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:38.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:38 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:38.176+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:38.415 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:38 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:38.176+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:38.415 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:38 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:38.176+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:38.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:38 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:38.291+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:38.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:38 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:38.291+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:38.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:38 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:38.531+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:38.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:38 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:38.531+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:38.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:38 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:38.437+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:38.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:38 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:38.437+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:38.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:38 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:38.437+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:39.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:38 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:38.729+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:39.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:38 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:38.729+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:39.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:38 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:38.790+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:39.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:38 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:38.790+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:39.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:39 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:39.268+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:39.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:39 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:39.268+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:39.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:39 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:39.268+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:14.303055+0000 front 2023-07-21T23:15:14.303141+0000 (oldest deadline 2023-07-21T23:15:38.403154+0000) 2023-07-21T23:15:39.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:39 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:39.168+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:39.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:39 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:39.168+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:39.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:39 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:39.216+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:39.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:39 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:39.216+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:39.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:39 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:39.216+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:39.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:39 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:39.478+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:39.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:39 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:39.478+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:39.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:39 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:39.478+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:39.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:39 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:39.530+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:39.844 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:39 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:39.530+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:40.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:39 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:39.755+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:40.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:39 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:39.755+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:40.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:39 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:39.829+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:40.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:39 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:39.829+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:40.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:39 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:39.829+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:40.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:40 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:40.242+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:40.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:40 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:40.242+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:40.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:40 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:40.242+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:14.303055+0000 front 2023-07-21T23:15:14.303141+0000 (oldest deadline 2023-07-21T23:15:38.403154+0000) 2023-07-21T23:15:40.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:40 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:40.171+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:40.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:40 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:40.171+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:40.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:40 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:40.171+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:40.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:40 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:40.261+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:40.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:40 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:40.261+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:40.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:40 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:40.261+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:40.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:40 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:40.446+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:40.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:40 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:40.446+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:40.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:40 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:40.446+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:40.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:40 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:40.492+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:40.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:40 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:40.492+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:41.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:40 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:40.731+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:41.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:40 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:40.731+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:41.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:40 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:40.731+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:41.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:40 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:40.829+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:41.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:40 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:40.829+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:41.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:40 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:40.829+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:41.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:41 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:41.220+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.100568+0000 front 2023-07-21T23:14:56.100376+0000 (oldest deadline 2023-07-21T23:15:19.600444+0000) 2023-07-21T23:15:41.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:41 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:41.220+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.901900+0000 front 2023-07-21T23:15:04.901824+0000 (oldest deadline 2023-07-21T23:15:30.201911+0000) 2023-07-21T23:15:41.621 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:41 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5[108935]: 2023-07-21T23:15:41.220+0000 7fa545c56700 -1 osd.5 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:14.303055+0000 front 2023-07-21T23:15:14.303141+0000 (oldest deadline 2023-07-21T23:15:38.403154+0000) 2023-07-21T23:15:41.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:41.189+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:41.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:41.189+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:41.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:41.189+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:41.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:41.258+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:41.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:41.258+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:41.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:41.258+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:41.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:41 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:41.453+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:41.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:41 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:41.453+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:41.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:41 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:41.478+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:41.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:41 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:41.478+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:41.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:41 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:41.478+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:42.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:41 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:41.715+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:42.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:41 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:41.715+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:42.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:41 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:41.715+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:42.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:41 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:41.846+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:42.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:41 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:41.846+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:42.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:41 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:41.846+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:42.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:42 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:42.179+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:42.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:42 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:42.179+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:42.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:42 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:42.179+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:42.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:42 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:42.246+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:42.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:42 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:42.246+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:42.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:42 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:42.246+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:42.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:42 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:42.479+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:42.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:42 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:42.479+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:42.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:42 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:42.444+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:42.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:42 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:42.444+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:42.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:42 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:42.444+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:43.121 INFO:journalctl@ceph.osd.5.smithi195.stdout:Jul 21 23:15:42 smithi195 bash[141066]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-5 2023-07-21T23:15:43.122 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:42 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:42.745+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:43.122 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:42 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:42.745+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:43.122 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:42 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:42.745+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:43.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:42 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:42.885+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:43.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:42 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:42.885+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:43.123 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:42 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:42.885+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:43.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:43 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:43.246+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:43.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:43 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:43.246+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:43.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:43 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:43.246+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:43.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:43 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:43.153+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:43.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:43 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:43.153+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:43.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:43 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:43.153+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:43.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:43 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:43.523+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:43.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:43 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:43.523+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:43.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:43 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:43.475+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:43.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:43 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:43.475+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:43.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:43 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:43.475+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:44.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:43 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:43.695+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:44.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:43 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:43.695+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:44.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:43 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:43.695+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:44.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:43 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:43.932+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:44.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:43 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:43.932+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:44.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:43 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:43.932+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:44.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:44 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:44.237+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:44.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:44 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:44.237+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:44.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:44 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:44.237+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:44.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:44 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:44.150+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:44.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:44 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:44.150+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:44.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:44 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:44.150+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:44.707 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.5.service' 2023-07-21T23:15:44.797 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:15:44.797 INFO:tasks.cephadm.osd.5:Stopped osd.5 2023-07-21T23:15:44.798 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2023-07-21T23:15:44.798 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.6 2023-07-21T23:15:44.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:44 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:44.523+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:44.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:44 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:44.523+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:44.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:44 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:44.493+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:44.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:44 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:44.493+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:44.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:44 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:44.493+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:44.975 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:44 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:44.742+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:44.975 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:44 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:44.742+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:44.975 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:44 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:44.742+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:45.163 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:44 smithi151 systemd[1]: Stopping Ceph osd.6 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:15:45.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:44 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:44.966+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:45.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:44 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:44.966+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:45.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:44 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:44.966+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:45.663 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:45 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:45.194+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:45.663 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:45 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:45.194+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:45.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:45 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:45.194+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:45.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:45 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:45.306+0000 7fc1438f0700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:15:45.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:45 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:45.306+0000 7fc1438f0700 -1 osd.6 187 *** Got signal Terminated *** 2023-07-21T23:15:45.664 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:45 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:45.306+0000 7fc1438f0700 -1 osd.6 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:15:45.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:45 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:45.167+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:45.665 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:45 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:45.167+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:45.665 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:45 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:45.167+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:45.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:45 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:45.548+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:45.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:45 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:45.548+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:45.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:45 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:45.520+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:45.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:45 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:45.520+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:45.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:45 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:45.520+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:46.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:45 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:45.993+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:46.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:45 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:45.993+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:46.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:45 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:45.993+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:46.122 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:45 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:45.784+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:46.122 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:45 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:45.784+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:46.122 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:45 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:45.784+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:46.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:46 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:46.224+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:46.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:46 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:46.224+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:46.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:46 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:46.224+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:46.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:46 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:46.122+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:46.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:46 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:46.122+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:46.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:46 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:46.122+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:46.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:46 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:46.122+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:46.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:46 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:46.555+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:46.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:46 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:46.555+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:46.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:46 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:46.498+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:46.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:46 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:46.498+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:46.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:46 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:46.498+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:47.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:46 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:46.781+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:47.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:46 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:46.781+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:47.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:46 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:46.781+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:47.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:46 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:46.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:47.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:46 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:46.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:47.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:46 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:46.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:47.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:46 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:46.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:47.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:47.138+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:47.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:47.138+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:47.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:47.138+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:47.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:47.138+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:47.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:47.218+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:47.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:47.218+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:47.414 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:47.218+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:47.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:47 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:47.529+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:47.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:47 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:47.529+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:47.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:47 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:47.529+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:47.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:47 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:47.469+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:47.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:47 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:47.469+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:47.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:47 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:47.469+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:47.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:47 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:47.469+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:48.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:47 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:47.743+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:48.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:47 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:47.743+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:48.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:47 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:47.743+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:48.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:47 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:47.905+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:48.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:47 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:47.905+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:48.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:47 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:47.905+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:48.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:47 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:47.905+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:48.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:48 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:48.244+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:48.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:48 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:48.244+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:48.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:48 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:48.244+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:48.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:48 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:48.132+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:48.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:48 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:48.132+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:48.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:48 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:48.132+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:48.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:48 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:48.132+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:48.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:48 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:48.573+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:48.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:48 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:48.573+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:48.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:48 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:48.573+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:48.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:48 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:48.511+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:48.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:48 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:48.511+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:48.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:48 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:48.511+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:48.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:48 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:48.511+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:49.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:48 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:48.738+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:49.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:48 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:48.738+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:49.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:48 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:48.738+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:49.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:48 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:48.738+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:49.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:48 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:48.875+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:49.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:48 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:48.875+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:49.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:48 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:48.875+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:49.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:48 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:48.875+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:49.663 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:49 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:49.253+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:49.663 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:49 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:49.253+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:49.663 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:49 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:49.253+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:49.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:49 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:49.172+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:49.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:49 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:49.172+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:49.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:49 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:49.172+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:49.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:49 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:49.172+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:49.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:49 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:49.540+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:49.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:49 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:49.540+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:49.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:49 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:49.540+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:49.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:49 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:49.540+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:49.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:49 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:49.530+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:49.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:49 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:49.530+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:49.844 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:49 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:49.530+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:50.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:49 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:49.779+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:50.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:49 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:49.779+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:50.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:49 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:49.779+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:50.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:49 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:49.779+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:50.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:49 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:49.907+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:50.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:49 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:49.907+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:50.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:49 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:49.907+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:50.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:49 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:49.907+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:50.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:50 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:50.220+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.720655+0000 front 2023-07-21T23:14:55.720301+0000 (oldest deadline 2023-07-21T23:15:18.620430+0000) 2023-07-21T23:15:50.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:50 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:50.220+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:06.222289+0000 front 2023-07-21T23:15:06.222339+0000 (oldest deadline 2023-07-21T23:15:31.522326+0000) 2023-07-21T23:15:50.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:50 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6[119548]: 2023-07-21T23:15:50.220+0000 7fc13d6e1700 -1 osd.6 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.823796+0000 front 2023-07-21T23:15:13.823885+0000 (oldest deadline 2023-07-21T23:15:36.723963+0000) 2023-07-21T23:15:50.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:50 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:50.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:50.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:50 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:50.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:50.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:50 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:50.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:50.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:50 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:50.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:50.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:50 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:50.562+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:50.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:50 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:50.562+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:50.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:50 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:50.562+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:50.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:50 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:50.562+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:50.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:50 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:50.546+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:50.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:50 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:50.546+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:50.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:50 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:50.546+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:51.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:50 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:50.814+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:51.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:50 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:50.814+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:51.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:50 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:50.814+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:51.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:50 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:50.814+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:51.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:50 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:50.884+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:51.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:50 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:50.884+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:51.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:50 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:50.884+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:51.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:50 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:50.884+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:51.413 INFO:journalctl@ceph.osd.6.smithi151.stdout:Jul 21 23:15:51 smithi151 bash[195647]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-6 2023-07-21T23:15:51.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:51 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:51.153+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:51.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:51 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:51.153+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:51.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:51 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:51.153+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:51.414 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:51 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:51.153+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:51.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:51 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:51.611+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:51.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:51 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:51.611+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:51.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:51 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:51.611+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:51.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:51 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:51.611+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:51.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:51 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:51.541+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:51.844 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:51 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:51.541+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:51.844 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:51 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:51.541+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:52.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:51 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:51.815+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:52.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:51 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:51.815+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:52.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:51 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:51.815+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:52.122 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:51 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:51.815+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:52.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:51 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:51.931+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:52.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:51 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:51.931+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:52.123 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:51 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:51.931+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:52.123 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:51 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:51.931+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:52.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:52 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:52.143+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:52.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:52 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:52.143+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:52.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:52 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:52.143+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:52.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:52 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:52.143+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:52.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:52 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:52.535+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:52.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:52 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:52.535+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:52.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:52 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:52.535+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:52.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:52 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:52.570+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:52.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:52 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:52.570+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:52.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:52 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:52.570+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:52.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:52 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:52.570+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:53.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:52 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:52.848+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:53.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:52 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:52.848+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:53.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:52 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:52.848+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:53.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:52 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:52.848+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:53.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:52 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:52.975+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:53.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:52 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:52.975+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:53.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:52 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:52.975+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:53.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:52 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:52.975+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:53.307 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.6.service' 2023-07-21T23:15:53.397 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:15:53.398 INFO:tasks.cephadm.osd.6:Stopped osd.6 2023-07-21T23:15:53.398 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2023-07-21T23:15:53.399 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.7 2023-07-21T23:15:53.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:53 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:53.144+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:53.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:53 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:53.144+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:53.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:53 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:53.144+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:53.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:53 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:53.144+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:53.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:53.617+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:53.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:53.617+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:53.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:53.617+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:53.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:53.617+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:53.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:53 smithi187 systemd[1]: Stopping Ceph osd.7 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:15:53.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:53.570+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:53.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:53.570+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:53.844 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:53.570+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:54.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:53.826+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:54.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:53.826+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:54.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:53.826+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:54.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:53.826+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:54.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:53.982+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:54.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:53.982+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:54.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:53.982+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:54.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:53 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:53.982+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:54.342 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:53.911+0000 7f01c0a62700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:15:54.342 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:53.911+0000 7f01c0a62700 -1 osd.7 187 *** Got signal Terminated *** 2023-07-21T23:15:54.343 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:53 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:53.911+0000 7f01c0a62700 -1 osd.7 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:15:54.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:54 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:54.191+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:54.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:54 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:54.191+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:54.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:54 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:54.191+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:54.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:54 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:54.191+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:54.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:54 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:54.543+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:54.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:54 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:54.543+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:54.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:54 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:54.543+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:54.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:54 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:54.602+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:54.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:54 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:54.602+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:54.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:54 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:54.602+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:54.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:54 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:54.602+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:55.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:54.800+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:55.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:54.800+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:55.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:54.800+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:55.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:54.800+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:55.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:54.966+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:55.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:54.966+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:55.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:54.966+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:55.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:54 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:54.966+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:55.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:55 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:55.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:55.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:55 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:55.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:55.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:55 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:55.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:55.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:55 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:55.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:55.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:55 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:55.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:15:55.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:55 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:55.594+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:55.842 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:55 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:55.594+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:55.843 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:55 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:55.594+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:55.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:55 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:55.571+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:55.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:55 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:55.571+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:55.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:55 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:55.571+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:55.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:55 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:55.571+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:55.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:55 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:55.571+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:15:56.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:55.830+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:56.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:55.830+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:56.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:55.830+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:56.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:55.830+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:56.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:55.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:56.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:55.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:56.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:55.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:56.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:55.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:56.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:55 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:55.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:15:56.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:56 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:56.171+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:56.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:56 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:56.171+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:56.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:56 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:56.171+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:56.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:56 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:56.171+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:56.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:56 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:56.171+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:15:57.092 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:56.594+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:57.093 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:56.594+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:57.093 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:56.594+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:57.093 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:56.592+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:57.094 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:56.592+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:57.094 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:56.592+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:57.094 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:56.592+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:57.095 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:56.592+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:15:57.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:56.847+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:57.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:56.847+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:57.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:56.847+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:57.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:56.847+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:57.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:56.983+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:57.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:56.983+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:57.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:56.983+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:57.123 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:56.983+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:57.123 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:56 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:56.983+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:15:57.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:57 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:57.208+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:57.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:57 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:57.208+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:57.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:57 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:57.208+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:57.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:57 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:57.208+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:57.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:57 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:57.208+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:15:58.092 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:57.624+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:58.093 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:57.624+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:58.093 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:57.624+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:58.093 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:57.624+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.677242+0000 front 2023-07-21T23:15:32.677212+0000 (oldest deadline 2023-07-21T23:15:56.777412+0000) 2023-07-21T23:15:58.093 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:57.591+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:58.093 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:57.591+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:58.094 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:57.591+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:58.094 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:57.591+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:58.094 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:57 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:57.591+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:15:58.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:57 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:57.843+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:58.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:57 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:57.843+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:58.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:57 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:57.843+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:58.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:57 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:57.843+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:58.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.009+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:58.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.009+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:58.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.009+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:58.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.009+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:58.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.009+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:15:58.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:58 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:58.170+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:58.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:58 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:58.170+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:58.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:58 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:58.170+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:58.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:58 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:58.170+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:58.664 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:58 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:58.170+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:15:59.092 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:58.646+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.871856+0000 front 2023-07-21T23:15:05.871795+0000 (oldest deadline 2023-07-21T23:15:31.771945+0000) 2023-07-21T23:15:59.092 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:58.646+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:11.772683+0000 front 2023-07-21T23:15:11.772457+0000 (oldest deadline 2023-07-21T23:15:37.672509+0000) 2023-07-21T23:15:59.092 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:58.646+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.374053+0000 front 2023-07-21T23:15:22.374115+0000 (oldest deadline 2023-07-21T23:15:47.073778+0000) 2023-07-21T23:15:59.093 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:15:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7[113044]: 2023-07-21T23:15:58.646+0000 7f01b9050700 -1 osd.7 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.677242+0000 front 2023-07-21T23:15:32.677212+0000 (oldest deadline 2023-07-21T23:15:56.777412+0000) 2023-07-21T23:15:59.093 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:58.607+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:59.093 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:58.607+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:59.093 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:58.607+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:59.093 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:58.607+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:59.093 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:58 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:58.607+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:15:59.370 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:58.878+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:15:59.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:58.878+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:15:59.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:58.878+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:15:59.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:58.878+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:15:59.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.967+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:15:59.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.967+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:15:59.372 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.967+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:15:59.372 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.967+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:15:59.372 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:58 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:58.967+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:15:59.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:59 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:59.192+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:15:59.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:59 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:59.192+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:15:59.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:59 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:59.192+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:15:59.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:59 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:59.192+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:15:59.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:15:59 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:15:59.192+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:15:59.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:59 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:59.580+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:15:59.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:59 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:59.580+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:15:59.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:59 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:59.580+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:15:59.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:59 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:59.580+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:15:59.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:15:59 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:15:59.580+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:00.104 INFO:journalctl@ceph.osd.7.smithi187.stdout:Jul 21 23:16:00 smithi187 bash[137759]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-7 2023-07-21T23:16:00.370 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:59.914+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:16:00.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:59.914+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:16:00.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:59.914+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:16:00.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:59.914+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:16:00.372 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:15:59.914+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:28.621596+0000 front 2023-07-21T23:15:28.621758+0000 (oldest deadline 2023-07-21T23:15:59.221978+0000) 2023-07-21T23:16:00.372 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:59.980+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:00.373 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:59.980+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:00.373 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:59.980+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:00.373 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:59.980+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:00.374 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:15:59 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:15:59.980+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:00.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:00.165+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:00.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:00.165+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:00.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:00.165+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:00.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:00.165+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:00.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:00 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:00.165+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:00.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:00 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:00.542+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:00.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:00 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:00.542+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:00.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:00 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:00.542+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:00.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:00 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:00.542+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:00.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:00 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:00.542+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:01.370 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:00.907+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:16:01.370 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:00.907+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:16:01.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:00.907+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:16:01.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:00.908+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:16:01.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:00.908+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:28.621596+0000 front 2023-07-21T23:15:28.621758+0000 (oldest deadline 2023-07-21T23:15:59.221978+0000) 2023-07-21T23:16:01.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:00.935+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:01.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:00.935+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:01.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:00.935+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:01.372 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:00.935+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:01.372 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:00 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:00.935+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:01.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:01 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:01.144+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:01.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:01 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:01.144+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:01.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:01 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:01.144+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:01.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:01 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:01.144+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:01.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:01 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:01.144+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:01.817 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:01.493+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:01.817 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:01.493+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:01.817 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:01.493+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:01.818 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:01.493+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:01.818 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:01 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:01.493+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:01.847 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.7.service' 2023-07-21T23:16:01.934 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:16:01.935 INFO:tasks.cephadm.osd.7:Stopped osd.7 2023-07-21T23:16:01.935 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2023-07-21T23:16:01.935 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.8 2023-07-21T23:16:02.370 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:01.879+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:16:02.370 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:01.879+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:16:02.370 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:01.879+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:16:02.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:01.879+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:16:02.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:01.879+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:28.621596+0000 front 2023-07-21T23:15:28.621758+0000 (oldest deadline 2023-07-21T23:15:59.221978+0000) 2023-07-21T23:16:02.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:02 smithi195 systemd[1]: Stopping Ceph osd.8 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:16:02.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:01.927+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:02.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:01.927+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:02.372 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:01.927+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:02.372 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:01.927+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:02.372 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:01 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:01.927+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:02.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:02.135+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:02.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:02.135+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:02.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:02.135+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:02.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:02.135+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:02.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:02 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:02.135+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:02.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:02.536+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:02.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:02.536+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:02.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:02.536+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:02.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:02.536+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:02.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:02.536+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:02.870 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:02.439+0000 7fc61475b700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:16:02.870 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:02.439+0000 7fc61475b700 -1 osd.8 187 *** Got signal Terminated *** 2023-07-21T23:16:02.870 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:02.439+0000 7fc61475b700 -1 osd.8 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:16:03.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:02.926+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:03.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:02.927+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:03.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:02.927+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:03.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:02.927+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:03.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:02.927+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:03.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:02.876+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:16:03.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:02.876+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:16:03.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:02.876+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:16:03.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:02.876+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:16:03.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:02 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:02.876+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:28.621596+0000 front 2023-07-21T23:15:28.621758+0000 (oldest deadline 2023-07-21T23:15:59.221978+0000) 2023-07-21T23:16:03.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:03 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:03.177+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:03.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:03 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:03.177+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:03.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:03 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:03.177+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:03.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:03 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:03.177+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:03.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:03 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:03.177+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:03.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:03.497+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:03.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:03.497+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:03.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:03.497+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:03.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:03.497+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:03.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:03 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:03.497+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:04.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:03.971+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:04.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:03.971+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:04.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:03.971+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:04.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:03.971+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:04.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:03.971+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:04.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:03.890+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:16:04.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:03.890+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:16:04.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:03.890+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:16:04.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:03.890+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:16:04.371 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:03 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:03.890+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:28.621596+0000 front 2023-07-21T23:15:28.621758+0000 (oldest deadline 2023-07-21T23:15:59.221978+0000) 2023-07-21T23:16:04.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:04 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:04.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:04.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:04 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:04.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:04.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:04 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:04.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:04.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:04 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:04.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:04.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:04 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:04.161+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:04.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:04 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:04.518+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:04.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:04 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:04.518+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:04.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:04 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:04.518+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:04.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:04 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:04.518+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:04.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:04 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:04.518+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:05.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.001+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:05.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.001+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:05.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.001+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:05.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.001+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:05.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.001+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:05.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:04.845+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:16:05.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:04.845+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:16:05.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:04.845+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:16:05.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:04.845+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:16:05.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:04 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:04.845+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:28.621596+0000 front 2023-07-21T23:15:28.621758+0000 (oldest deadline 2023-07-21T23:15:59.221978+0000) 2023-07-21T23:16:05.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:05 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:05.203+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:05.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:05 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:05.203+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:05.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:05 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:05.203+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:05.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:05 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:05.203+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:05.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:05 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:05.203+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:05.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:05 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:05.475+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:05.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:05 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:05.475+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:05.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:05 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:05.475+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:05.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:05 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:05.475+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:05.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:05 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:05.475+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:06.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.986+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:06.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.986+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:06.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.986+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:06.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.986+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:06.120 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.986+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:06.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:05.986+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:06.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:05.807+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:16:06.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:05.807+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:16:06.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:05.807+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:16:06.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:05.807+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:16:06.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:05 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:05.807+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:28.621596+0000 front 2023-07-21T23:15:28.621758+0000 (oldest deadline 2023-07-21T23:15:59.221978+0000) 2023-07-21T23:16:06.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:06 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:06.162+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:06.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:06 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:06.162+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:06.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:06 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:06.162+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:06.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:06 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:06.162+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:06.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:06 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:06.162+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:06.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:06 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:06.500+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:06.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:06 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:06.500+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:06.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:06 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:06.500+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:06.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:06 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:06.500+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:06.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:06 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:06.500+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:07.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:06.837+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:56.415232+0000 front 2023-07-21T23:14:56.415360+0000 (oldest deadline 2023-07-21T23:15:18.715216+0000) 2023-07-21T23:16:07.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:06.837+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.016751+0000 front 2023-07-21T23:15:04.016955+0000 (oldest deadline 2023-07-21T23:15:29.916743+0000) 2023-07-21T23:16:07.120 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:06.837+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:15.119132+0000 front 2023-07-21T23:15:15.119094+0000 (oldest deadline 2023-07-21T23:15:40.419367+0000) 2023-07-21T23:16:07.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:06.837+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.720818+0000 front 2023-07-21T23:15:22.720714+0000 (oldest deadline 2023-07-21T23:15:48.620847+0000) 2023-07-21T23:16:07.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:06.837+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:28.621596+0000 front 2023-07-21T23:15:28.621758+0000 (oldest deadline 2023-07-21T23:15:59.221978+0000) 2023-07-21T23:16:07.121 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8[114345]: 2023-07-21T23:16:06.837+0000 7fc60f54e700 -1 osd.8 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:39.222455+0000 front 2023-07-21T23:15:39.222529+0000 (oldest deadline 2023-07-21T23:16:06.823011+0000) 2023-07-21T23:16:07.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:06.959+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:07.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:06.959+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:07.121 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:06.959+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:07.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:06.959+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:07.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:06.959+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:07.122 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:06 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:06.959+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:07.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:07.146+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:07.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:07.146+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:07.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:07.146+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:07.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:07.146+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:07.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:07.146+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:07.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:07 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:07.146+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:41.699253+0000 front 2023-07-21T23:15:41.699267+0000 (oldest deadline 2023-07-21T23:16:06.999031+0000) 2023-07-21T23:16:07.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:07.461+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:07.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:07.461+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:07.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:07.461+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:07.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:07.461+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:07.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:07.461+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:07.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:07.461+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:08.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:07.961+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:08.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:07.961+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:08.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:07.961+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:08.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:07.961+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:08.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:07.961+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:08.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:07 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:07.961+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:08.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:08.130+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:08.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:08.130+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:08.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:08.130+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:08.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:08.130+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:08.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:08.130+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:08.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:08 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:08.130+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:41.699253+0000 front 2023-07-21T23:15:41.699267+0000 (oldest deadline 2023-07-21T23:16:06.999031+0000) 2023-07-21T23:16:08.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:08 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:08.443+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:08.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:08 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:08.443+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:08.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:08 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:08.443+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:08.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:08 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:08.443+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:08.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:08 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:08.443+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:08.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:08 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:08.443+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:08.870 INFO:journalctl@ceph.osd.8.smithi195.stdout:Jul 21 23:16:08 smithi195 bash[141347]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-8 2023-07-21T23:16:09.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:08 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:08.934+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:09.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:08 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:08.934+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:09.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:08 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:08.934+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:09.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:08 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:08.934+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:09.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:08 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:08.934+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:09.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:08 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:08.934+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:09.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:09.169+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:09.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:09.169+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:09.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:09.169+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:09.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:09.169+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:09.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:09.169+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:09.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:09 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:09.169+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:41.699253+0000 front 2023-07-21T23:15:41.699267+0000 (oldest deadline 2023-07-21T23:16:06.999031+0000) 2023-07-21T23:16:09.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:09 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:09.481+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:09.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:09 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:09.481+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:09.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:09 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:09.481+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:09.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:09 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:09.481+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:09.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:09 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:09.481+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:09.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:09 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:09.481+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:10.238 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:09 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:09.912+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:10.238 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:09 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:09.912+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:10.238 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:09 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:09.912+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:10.239 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:09 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:09.912+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:10.239 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:09 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:09.912+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:10.239 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:09 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:09.912+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:10.267 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.8.service' 2023-07-21T23:16:10.354 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:16:10.355 INFO:tasks.cephadm.osd.8:Stopped osd.8 2023-07-21T23:16:10.355 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2023-07-21T23:16:10.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.9 2023-07-21T23:16:10.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:10.134+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:10.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:10.134+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:10.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:10.134+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:10.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:10.134+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:10.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:10.134+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:10.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:10.134+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:41.699253+0000 front 2023-07-21T23:15:41.699267+0000 (oldest deadline 2023-07-21T23:16:06.999031+0000) 2023-07-21T23:16:10.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:10 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:10.464+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:10.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:10 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:10.464+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:10.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:10 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:10.464+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:10.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:10 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:10.464+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:10.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:10 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:10.464+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:10.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:10 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:10.464+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:10.912 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 systemd[1]: Stopping Ceph osd.9 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:16:11.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:10.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:11.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:10.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:11.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:10.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:11.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:10.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:11.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:10.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:11.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:10 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:10.939+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:11.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:10.961+0000 7f5e83f3e700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:16:11.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:10.961+0000 7f5e83f3e700 -1 osd.9 187 *** Got signal Terminated *** 2023-07-21T23:16:11.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:10 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:10.961+0000 7f5e83f3e700 -1 osd.9 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:16:11.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:11.091+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:11.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:11.091+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:11.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:11.091+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:11.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:11.091+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:11.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:11.091+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:11.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:11 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:11.091+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:41.699253+0000 front 2023-07-21T23:15:41.699267+0000 (oldest deadline 2023-07-21T23:16:06.999031+0000) 2023-07-21T23:16:11.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:11 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:11.448+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:11.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:11 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:11.448+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:11.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:11 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:11.448+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:11.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:11 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:11.448+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:11.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:11 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:11.448+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:11.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:11 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:11.448+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:12.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:11 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:11.945+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:12.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:11 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:11.945+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:12.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:11 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:11.945+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:12.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:11 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:11.945+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:12.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:11 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:11.945+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:12.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:11 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:11.945+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:12.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:12 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:12.139+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:12.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:12 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:12.139+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:12.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:12 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:12.139+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:12.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:12 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:12.139+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:12.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:12 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:12.139+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:12.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:12 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:12.139+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:41.699253+0000 front 2023-07-21T23:15:41.699267+0000 (oldest deadline 2023-07-21T23:16:06.999031+0000) 2023-07-21T23:16:12.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:12 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:12.465+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:12.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:12 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:12.465+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:12.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:12 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:12.465+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:12.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:12 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:12.465+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:12.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:12 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:12.465+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:12.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:12 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:12.465+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:12.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:12 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:12.465+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:13.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:12 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:12.991+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:13.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:12 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:12.991+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:13.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:12 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:12.991+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:13.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:12 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:12.991+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:13.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:12 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:12.991+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:13.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:12 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:12.991+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:13.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:13 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:13.168+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:13.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:13 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:13.168+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:13.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:13 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:13.168+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:13.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:13 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:13.168+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:13.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:13 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:13.168+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:13.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:13 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:13.168+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:41.699253+0000 front 2023-07-21T23:15:41.699267+0000 (oldest deadline 2023-07-21T23:16:06.999031+0000) 2023-07-21T23:16:13.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:13 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:13.472+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:13.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:13 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:13.472+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:13.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:13 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:13.472+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:13.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:13 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:13.472+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:13.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:13 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:13.472+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:13.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:13 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:13.472+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:13.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:13 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:13.472+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:14.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:13 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:13.962+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:14.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:13 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:13.962+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:14.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:13 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:13.962+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:14.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:13 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:13.962+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:14.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:13 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:13.962+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:14.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:13 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:13.962+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:14.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:14.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:14.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:14.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:14.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:14.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:14.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:14.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:14.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:14.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:14.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:14.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:41.699253+0000 front 2023-07-21T23:15:41.699267+0000 (oldest deadline 2023-07-21T23:16:06.999031+0000) 2023-07-21T23:16:14.413 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:14 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:14.154+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:49.300270+0000 front 2023-07-21T23:15:49.300258+0000 (oldest deadline 2023-07-21T23:16:14.000341+0000) 2023-07-21T23:16:14.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:14 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:14.429+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:14.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:14 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:14.429+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:14.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:14 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:14.429+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:14.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:14 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:14.429+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:14.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:14 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:14.429+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:14.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:14 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:14.429+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:14.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:14 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:14.429+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:15.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:14 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:14.963+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:15.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:14 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:14.963+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:15.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:14 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:14.963+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:15.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:14 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:14.963+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:15.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:14 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:14.963+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:15.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:14 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:14.963+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:15.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:15.155+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:55.888218+0000 front 2023-07-21T23:14:55.888251+0000 (oldest deadline 2023-07-21T23:15:19.388578+0000) 2023-07-21T23:16:15.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:15.155+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:05.790804+0000 front 2023-07-21T23:15:05.790871+0000 (oldest deadline 2023-07-21T23:15:29.290828+0000) 2023-07-21T23:16:15.662 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:15.155+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.292841+0000 front 2023-07-21T23:15:13.292860+0000 (oldest deadline 2023-07-21T23:15:39.192853+0000) 2023-07-21T23:16:15.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:15.155+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:22.694140+0000 front 2023-07-21T23:15:22.693975+0000 (oldest deadline 2023-07-21T23:15:45.594198+0000) 2023-07-21T23:16:15.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:15.155+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:32.496844+0000 front 2023-07-21T23:15:32.496869+0000 (oldest deadline 2023-07-21T23:15:54.796807+0000) 2023-07-21T23:16:15.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:15.155+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:41.699253+0000 front 2023-07-21T23:15:41.699267+0000 (oldest deadline 2023-07-21T23:16:06.999031+0000) 2023-07-21T23:16:15.663 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:15 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9[125123]: 2023-07-21T23:16:15.155+0000 7f5e7fd33700 -1 osd.9 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:49.300270+0000 front 2023-07-21T23:15:49.300258+0000 (oldest deadline 2023-07-21T23:16:14.000341+0000) 2023-07-21T23:16:15.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:15 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:15.471+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:15.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:15 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:15.471+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:15.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:15 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:15.471+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:15.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:15 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:15.471+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:15.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:15 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:15.471+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:15.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:15 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:15.471+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:15.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:15 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:15.471+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:16.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:15 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:15.972+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:16.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:15 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:15.972+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:16.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:15 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:15.972+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:16.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:15 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:15.972+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:16.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:15 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:15.972+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:16.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:15 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:15.972+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:16.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:16 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:16.457+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:16.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:16 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:16.457+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:16.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:16 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:16.457+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:16.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:16 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:16.457+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:16.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:16 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:16.457+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:16.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:16 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:16.457+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:16.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:16 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:16.457+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:17.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:16 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:16.965+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:17.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:16 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:16.965+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:17.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:16 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:16.965+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:17.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:16 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:16.965+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:17.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:16 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:16.965+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:17.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:16 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:16.965+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:17.412 INFO:journalctl@ceph.osd.9.smithi151.stdout:Jul 21 23:16:17 smithi151 bash[195922]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-9 2023-07-21T23:16:17.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:17 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:17.421+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:17.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:17 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:17.421+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:17.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:17 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:17.421+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:17.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:17 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:17.421+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:17.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:17 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:17.421+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:17.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:17 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:17.421+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:17.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:17 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:17.421+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:18.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:17 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:17.976+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:18.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:17 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:17.976+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:18.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:17 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:17.976+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:18.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:17 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:17.976+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:18.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:17 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:17.976+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:18.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:17 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:17.976+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:18.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:18 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:18.455+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:18.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:18 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:18.455+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:18.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:18 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:18.455+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:18.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:18 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:18.455+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:18.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:18 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:18.455+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:18.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:18 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:18.455+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:18.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:18 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:18.455+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:18.900 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.9.service' 2023-07-21T23:16:18.988 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:16:18.989 INFO:tasks.cephadm.osd.9:Stopped osd.9 2023-07-21T23:16:18.989 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2023-07-21T23:16:18.989 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.10 2023-07-21T23:16:19.341 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 systemd[1]: Stopping Ceph osd.10 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:16:19.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:18 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:18.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:19.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:18 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:18.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:19.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:18 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:18.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:19.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:18 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:18.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:19.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:18 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:18.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:19.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:18 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:18.944+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:19.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.419+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:19.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.419+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:19.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.419+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:19.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.419+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:19.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.419+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:19.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.419+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:19.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.419+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:19.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.490+0000 7f29d4c27700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:16:19.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.490+0000 7f29d4c27700 -1 osd.10 187 *** Got signal Terminated *** 2023-07-21T23:16:19.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:19 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:19.490+0000 7f29d4c27700 -1 osd.10 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:16:20.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:19 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:19.988+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:20.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:19 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:19.988+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:20.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:19 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:19.988+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:20.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:19 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:19.988+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:20.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:19 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:19.988+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:20.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:19 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:19.988+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:20.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:20 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:20.398+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:20.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:20 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:20.398+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:20.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:20 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:20.398+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:20.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:20 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:20.398+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:20.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:20 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:20.398+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:20.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:20 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:20.398+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:20.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:20 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:20.398+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:21.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:21.007+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:21.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:21.007+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:21.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:21.007+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:21.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:21.007+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:21.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:21.007+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:21.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:21.007+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:21.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:21.007+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:21.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:21 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:21.447+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:21.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:21 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:21.447+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:21.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:21 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:21.447+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:21.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:21 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:21.447+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:21.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:21 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:21.447+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:21.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:21 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:21.447+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:21.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:21 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:21.447+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:22.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:22.024+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:22.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:22.024+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:22.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:22.024+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:22.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:22.024+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:22.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:22.024+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:22.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:22.024+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:22.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:22 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:22.024+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:22.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:22 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:22.458+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:22.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:22 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:22.458+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:22.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:22 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:22.458+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:22.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:22 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:22.458+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:22.843 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:22 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:22.458+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:22.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:22 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:22.458+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:22.844 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:22 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:22.458+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:23.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:23.048+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:23.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:23.048+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:23.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:23.048+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:23.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:23.048+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:23.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:23.048+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:23.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:23.048+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:23.371 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:23.048+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:23.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:23 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:23.456+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:23.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:23 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:23.456+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:23.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:23 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:23.456+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:23.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:23 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:23.456+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:23.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:23 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:23.456+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:23.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:23 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:23.456+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:23.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:23 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:23.456+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:24.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:24.082+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:24.369 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:24.082+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:24.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:24.082+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:24.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:24.082+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:24.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:24.082+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:24.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:24.082+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:24.370 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:24 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:24.082+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:24.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:24 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:24.409+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:53.878343+0000 front 2023-07-21T23:14:53.878457+0000 (oldest deadline 2023-07-21T23:15:19.178593+0000) 2023-07-21T23:16:24.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:24 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:24.409+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:04.980422+0000 front 2023-07-21T23:15:04.980454+0000 (oldest deadline 2023-07-21T23:15:30.781272+0000) 2023-07-21T23:16:24.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:24 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:24.409+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:10.781794+0000 front 2023-07-21T23:15:10.781883+0000 (oldest deadline 2023-07-21T23:15:36.681932+0000) 2023-07-21T23:16:24.841 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:24 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:24.409+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:24.084921+0000 front 2023-07-21T23:15:24.084948+0000 (oldest deadline 2023-07-21T23:15:46.984613+0000) 2023-07-21T23:16:24.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:24 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:24.409+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.085645+0000 front 2023-07-21T23:15:31.085657+0000 (oldest deadline 2023-07-21T23:15:55.086185+0000) 2023-07-21T23:16:24.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:24 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:24.409+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.888200+0000 front 2023-07-21T23:15:40.888117+0000 (oldest deadline 2023-07-21T23:16:06.688281+0000) 2023-07-21T23:16:24.842 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:24 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10[118622]: 2023-07-21T23:16:24.409+0000 7f29cd215700 -1 osd.10 187 heartbeat_check: no reply from 172.21.15.151:6822 osd.6 since back 2023-07-21T23:15:50.090147+0000 front 2023-07-21T23:15:50.090103+0000 (oldest deadline 2023-07-21T23:16:11.789947+0000) 2023-07-21T23:16:25.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:25.113+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:25.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:25.113+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:25.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:25.113+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:25.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:25.113+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:25.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:25.113+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:25.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:25.113+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:25.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:25 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:25.113+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:25.788 INFO:journalctl@ceph.osd.10.smithi187.stdout:Jul 21 23:16:25 smithi187 bash[138030]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-10 2023-07-21T23:16:26.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:26.139+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:26.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:26.139+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:26.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:26.139+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:26.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:26.139+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:26.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:26.139+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:26.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:26.139+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:26.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:26 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:26.139+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:27.526 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.10.service' 2023-07-21T23:16:27.614 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:16:27.614 INFO:tasks.cephadm.osd.10:Stopped osd.10 2023-07-21T23:16:27.615 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2023-07-21T23:16:27.615 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.11 2023-07-21T23:16:27.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:27.177+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:27.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:27.177+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:27.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:27.177+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:27.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:27.177+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:27.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:27.177+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:27.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:27.177+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:27.622 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:27 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:27.177+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:28.119 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:27 smithi195 systemd[1]: Stopping Ceph osd.11 for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:16:28.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.117+0000 7f5d092d3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:16:28.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.117+0000 7f5d092d3700 -1 osd.11 187 *** Got signal Terminated *** 2023-07-21T23:16:28.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.117+0000 7f5d092d3700 -1 osd.11 187 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-07-21T23:16:28.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.179+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:28.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.179+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:28.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.179+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:28.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.179+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:28.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.179+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:28.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.179+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:28.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:28.179+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:29.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:29.137+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:29.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:29.137+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:29.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:29.137+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:29.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:29.137+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:29.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:29.137+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:29.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:29.137+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:29.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:29 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:29.137+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:30.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:30.162+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:30.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:30.162+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:30.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:30.162+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:30.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:30.162+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:30.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:30.162+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:30.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:30.162+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:30.621 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:30 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:30.162+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:31.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:31.196+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:31.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:31.196+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:31.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:31.196+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:31.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:31.196+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:31.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:31.196+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:31.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:31.196+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:31.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:31 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:31.196+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:32.618 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:32.219+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6806 osd.0 since back 2023-07-21T23:14:52.984725+0000 front 2023-07-21T23:14:52.984836+0000 (oldest deadline 2023-07-21T23:15:18.285040+0000) 2023-07-21T23:16:32.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:32.219+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6804 osd.1 since back 2023-07-21T23:15:01.786167+0000 front 2023-07-21T23:15:01.786136+0000 (oldest deadline 2023-07-21T23:15:27.686351+0000) 2023-07-21T23:16:32.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:32.219+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6804 osd.2 since back 2023-07-21T23:15:13.488232+0000 front 2023-07-21T23:15:13.488519+0000 (oldest deadline 2023-07-21T23:15:39.388449+0000) 2023-07-21T23:16:32.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:32.219+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.151:6814 osd.3 since back 2023-07-21T23:15:20.990263+0000 front 2023-07-21T23:15:20.990305+0000 (oldest deadline 2023-07-21T23:15:46.890034+0000) 2023-07-21T23:16:32.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:32.219+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6812 osd.4 since back 2023-07-21T23:15:31.992508+0000 front 2023-07-21T23:15:31.992432+0000 (oldest deadline 2023-07-21T23:15:55.492352+0000) 2023-07-21T23:16:32.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:32.219+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.195:6812 osd.5 since back 2023-07-21T23:15:40.693935+0000 front 2023-07-21T23:15:40.693978+0000 (oldest deadline 2023-07-21T23:16:05.393908+0000) 2023-07-21T23:16:32.620 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:32 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11[119945]: 2023-07-21T23:16:32.219+0000 7f5d028c3700 -1 osd.11 187 heartbeat_check: no reply from 172.21.15.187:6820 osd.7 since back 2023-07-21T23:15:58.896356+0000 front 2023-07-21T23:15:58.896497+0000 (oldest deadline 2023-07-21T23:16:20.496762+0000) 2023-07-21T23:16:34.619 INFO:journalctl@ceph.osd.11.smithi195.stdout:Jul 21 23:16:34 smithi195 bash[141620]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-osd-11 2023-07-21T23:16:35.915 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@osd.11.service' 2023-07-21T23:16:36.004 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:16:36.005 INFO:tasks.cephadm.osd.11:Stopped osd.11 2023-07-21T23:16:36.005 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2023-07-21T23:16:36.005 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.a 2023-07-21T23:16:36.411 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 23:16:36 smithi151 systemd[1]: Stopping Ceph mds.a for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:16:36.910 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 23:16:36 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-a[130677]: 2023-07-21T23:16:36.517+0000 7f75b7525700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:16:36.911 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 23:16:36 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-a[130677]: 2023-07-21T23:16:36.517+0000 7f75b7525700 -1 mds.a *** got signal Terminated *** 2023-07-21T23:16:41.160 INFO:journalctl@ceph.mds.a.smithi151.stdout:Jul 21 23:16:40 smithi151 bash[196203]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-a 2023-07-21T23:16:41.297 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.a.service' 2023-07-21T23:16:41.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:16:41.383 INFO:tasks.cephadm.mds.a:Stopped mds.a 2023-07-21T23:16:41.383 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2023-07-21T23:16:41.383 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.d 2023-07-21T23:16:41.661 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 23:16:41 smithi151 systemd[1]: Stopping Ceph mds.d for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:16:42.410 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 23:16:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-d[129587]: 2023-07-21T23:16:41.905+0000 7f86798da700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:16:42.411 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 23:16:41 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-d[129587]: 2023-07-21T23:16:41.905+0000 7f86798da700 -1 mds.d *** got signal Terminated *** 2023-07-21T23:16:46.410 INFO:journalctl@ceph.mds.d.smithi151.stdout:Jul 21 23:16:46 smithi151 bash[196350]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-d 2023-07-21T23:16:46.561 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.d.service' 2023-07-21T23:16:46.645 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:16:46.646 INFO:tasks.cephadm.mds.d:Stopped mds.d 2023-07-21T23:16:46.646 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2023-07-21T23:16:46.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.g 2023-07-21T23:16:46.910 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 23:16:46 smithi151 systemd[1]: Stopping Ceph mds.g for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:16:47.410 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 23:16:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-g[130246]: 2023-07-21T23:16:47.130+0000 7f0bf6301700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:16:47.410 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 23:16:47 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-g[130246]: 2023-07-21T23:16:47.130+0000 7f0bf6301700 -1 mds.g *** got signal Terminated *** 2023-07-21T23:16:50.149 INFO:journalctl@ceph.mds.g.smithi151.stdout:Jul 21 23:16:49 smithi151 bash[196497]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-g 2023-07-21T23:16:50.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.g.service' 2023-07-21T23:16:50.258 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:16:50.258 INFO:tasks.cephadm.mds.g:Stopped mds.g 2023-07-21T23:16:50.258 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2023-07-21T23:16:50.259 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.j 2023-07-21T23:16:50.660 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 23:16:50 smithi151 systemd[1]: Stopping Ceph mds.j for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:16:51.160 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 23:16:50 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-j[129194]: 2023-07-21T23:16:50.746+0000 7f173e5e3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:16:51.160 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 23:16:50 smithi151 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-j[129194]: 2023-07-21T23:16:50.746+0000 7f173e5e3700 -1 mds.j *** got signal Terminated *** 2023-07-21T23:16:55.299 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 23:16:55 smithi151 bash[196642]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-j 2023-07-21T23:16:55.529 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.j.service' 2023-07-21T23:16:55.589 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 23:16:55 smithi151 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.j.service: Succeeded. 2023-07-21T23:16:55.589 INFO:journalctl@ceph.mds.j.smithi151.stdout:Jul 21 23:16:55 smithi151 systemd[1]: Stopped Ceph mds.j for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T23:16:55.611 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:16:55.611 INFO:tasks.cephadm.mds.j:Stopped mds.j 2023-07-21T23:16:55.612 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2023-07-21T23:16:55.612 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.b 2023-07-21T23:16:56.090 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 23:16:55 smithi187 systemd[1]: Stopping Ceph mds.b for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:16:56.589 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 23:16:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-b[122412]: 2023-07-21T23:16:56.101+0000 7f7b28b2a700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:16:56.589 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 23:16:56 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-b[122412]: 2023-07-21T23:16:56.101+0000 7f7b28b2a700 -1 mds.b *** got signal Terminated *** 2023-07-21T23:17:02.080 INFO:journalctl@ceph.mds.b.smithi187.stdout:Jul 21 23:17:01 smithi187 bash[138298]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-b 2023-07-21T23:17:02.109 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.b.service' 2023-07-21T23:17:02.193 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:17:02.194 INFO:tasks.cephadm.mds.b:Stopped mds.b 2023-07-21T23:17:02.194 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2023-07-21T23:17:02.194 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.e 2023-07-21T23:17:02.589 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 23:17:02 smithi187 systemd[1]: Stopping Ceph mds.e for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:17:03.089 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 23:17:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-e[121723]: 2023-07-21T23:17:02.674+0000 7f6a4db04700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:17:03.089 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 23:17:02 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-e[121723]: 2023-07-21T23:17:02.674+0000 7f6a4db04700 -1 mds.e *** got signal Terminated *** 2023-07-21T23:17:06.589 INFO:journalctl@ceph.mds.e.smithi187.stdout:Jul 21 23:17:06 smithi187 bash[138443]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-e 2023-07-21T23:17:06.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.e.service' 2023-07-21T23:17:06.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:17:06.913 INFO:tasks.cephadm.mds.e:Stopped mds.e 2023-07-21T23:17:06.914 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2023-07-21T23:17:06.914 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.h 2023-07-21T23:17:07.090 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 23:17:07 smithi187 systemd[1]: Stopping Ceph mds.h for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:17:07.839 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 23:17:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-h[122065]: 2023-07-21T23:17:07.431+0000 7f7f128d9700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:17:07.839 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 23:17:07 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-h[122065]: 2023-07-21T23:17:07.431+0000 7f7f128d9700 -1 mds.h *** got signal Terminated *** 2023-07-21T23:17:12.338 INFO:journalctl@ceph.mds.h.smithi187.stdout:Jul 21 23:17:12 smithi187 bash[138589]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-h 2023-07-21T23:17:12.470 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.h.service' 2023-07-21T23:17:12.551 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:17:12.551 INFO:tasks.cephadm.mds.h:Stopped mds.h 2023-07-21T23:17:12.552 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2023-07-21T23:17:12.552 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.k 2023-07-21T23:17:12.839 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 23:17:12 smithi187 systemd[1]: Stopping Ceph mds.k for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:17:13.339 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 23:17:13 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-k[121380]: 2023-07-21T23:17:13.038+0000 7fc9bb8ff700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:17:13.339 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 23:17:13 smithi187 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-k[121380]: 2023-07-21T23:17:13.038+0000 7fc9bb8ff700 -1 mds.k *** got signal Terminated *** 2023-07-21T23:17:17.220 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 23:17:17 smithi187 bash[138730]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-k 2023-07-21T23:17:17.460 DEBUG:teuthology.orchestra.run.smithi187:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.k.service' 2023-07-21T23:17:17.519 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 23:17:17 smithi187 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.k.service: Succeeded. 2023-07-21T23:17:17.520 INFO:journalctl@ceph.mds.k.smithi187.stdout:Jul 21 23:17:17 smithi187 systemd[1]: Stopped Ceph mds.k for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T23:17:17.541 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:17:17.542 INFO:tasks.cephadm.mds.k:Stopped mds.k 2023-07-21T23:17:17.543 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2023-07-21T23:17:17.543 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.c 2023-07-21T23:17:17.867 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 23:17:17 smithi195 systemd[1]: Stopping Ceph mds.c for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:17:18.366 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 23:17:18 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-c[123539]: 2023-07-21T23:17:18.060+0000 7f0196a93700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:17:18.367 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 23:17:18 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-c[123539]: 2023-07-21T23:17:18.060+0000 7f0196a93700 -1 mds.c *** got signal Terminated *** 2023-07-21T23:17:20.617 INFO:journalctl@ceph.mds.c.smithi195.stdout:Jul 21 23:17:20 smithi195 bash[141902]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-c 2023-07-21T23:17:20.688 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.c.service' 2023-07-21T23:17:20.772 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:17:20.773 INFO:tasks.cephadm.mds.c:Stopped mds.c 2023-07-21T23:17:20.773 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2023-07-21T23:17:20.774 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f 2023-07-21T23:17:21.116 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 23:17:20 smithi195 systemd[1]: Stopping Ceph mds.f for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:17:21.616 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 23:17:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[134556]: 2023-07-21T23:17:21.258+0000 7f468886d700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:17:21.617 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 23:17:21 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f[134556]: 2023-07-21T23:17:21.258+0000 7f468886d700 -1 mds.f *** got signal Terminated *** 2023-07-21T23:17:23.116 INFO:journalctl@ceph.mds.f.smithi195.stdout:Jul 21 23:17:22 smithi195 bash[142050]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-f 2023-07-21T23:17:23.213 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.f.service' 2023-07-21T23:17:23.295 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:17:23.295 INFO:tasks.cephadm.mds.f:Stopped mds.f 2023-07-21T23:17:23.295 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2023-07-21T23:17:23.296 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.i 2023-07-21T23:17:23.617 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 23:17:23 smithi195 systemd[1]: Stopping Ceph mds.i for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:17:24.116 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 23:17:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-i[123889]: 2023-07-21T23:17:23.783+0000 7fdabecaf700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:17:24.117 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 23:17:23 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-i[123889]: 2023-07-21T23:17:23.783+0000 7fdabecaf700 -1 mds.i *** got signal Terminated *** 2023-07-21T23:17:27.616 INFO:journalctl@ceph.mds.i.smithi195.stdout:Jul 21 23:17:27 smithi195 bash[142199]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-i 2023-07-21T23:17:27.726 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.i.service' 2023-07-21T23:17:27.805 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:17:27.806 INFO:tasks.cephadm.mds.i:Stopped mds.i 2023-07-21T23:17:27.806 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2023-07-21T23:17:27.807 DEBUG:teuthology.orchestra.run.smithi195:> sudo systemctl stop ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.l 2023-07-21T23:17:28.116 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 23:17:27 smithi195 systemd[1]: Stopping Ceph mds.l for f5fce3a4-2812-11ee-9b34-001a4aab830c... 2023-07-21T23:17:28.616 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 23:17:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-l[122851]: 2023-07-21T23:17:28.324+0000 7f731e2e3700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2023-07-21T23:17:28.617 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 23:17:28 smithi195 ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-l[122851]: 2023-07-21T23:17:28.324+0000 7f731e2e3700 -1 mds.l *** got signal Terminated *** 2023-07-21T23:17:30.071 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 23:17:29 smithi195 bash[142342]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c-mds-l 2023-07-21T23:17:30.278 DEBUG:teuthology.orchestra.run.smithi195:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.l.service' 2023-07-21T23:17:30.338 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 23:17:30 smithi195 systemd[1]: ceph-f5fce3a4-2812-11ee-9b34-001a4aab830c@mds.l.service: Succeeded. 2023-07-21T23:17:30.338 INFO:journalctl@ceph.mds.l.smithi195.stdout:Jul 21 23:17:30 smithi195 systemd[1]: Stopped Ceph mds.l for f5fce3a4-2812-11ee-9b34-001a4aab830c. 2023-07-21T23:17:30.359 DEBUG:teuthology.orchestra.run:got remote process result: None 2023-07-21T23:17:30.359 INFO:tasks.cephadm.mds.l:Stopped mds.l 2023-07-21T23:17:30.360 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c --force --keep-logs 2023-07-21T23:17:34.255 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c --force --keep-logs 2023-07-21T23:17:38.005 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c --force --keep-logs 2023-07-21T23:17:41.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-21T23:17:41.758 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-21T23:17:41.836 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2023-07-21T23:17:41.907 INFO:tasks.cephadm:Archiving crash dumps... 2023-07-21T23:17:41.910 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/remote/smithi151/crash 2023-07-21T23:17:41.911 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/crash -- . 2023-07-21T23:17:42.071 INFO:teuthology.orchestra.run.smithi151.stderr:tar: /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-21T23:17:42.071 INFO:teuthology.orchestra.run.smithi151.stderr:tar: Error is not recoverable: exiting now 2023-07-21T23:17:42.074 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/remote/smithi187/crash 2023-07-21T23:17:42.075 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/crash -- . 2023-07-21T23:17:42.226 INFO:teuthology.orchestra.run.smithi187.stderr:tar: /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-21T23:17:42.226 INFO:teuthology.orchestra.run.smithi187.stderr:tar: Error is not recoverable: exiting now 2023-07-21T23:17:42.229 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/crash to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/remote/smithi195/crash 2023-07-21T23:17:42.230 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/crash -- . 2023-07-21T23:17:42.333 INFO:teuthology.orchestra.run.smithi195.stderr:tar: /var/lib/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/crash: Cannot open: No such file or directory 2023-07-21T23:17:42.333 INFO:teuthology.orchestra.run.smithi195.stderr:tar: Error is not recoverable: exiting now 2023-07-21T23:17:42.336 INFO:tasks.cephadm:Checking cluster log for badness... 2023-07-21T23:17:42.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2023-07-21T23:17:42.418 INFO:teuthology.orchestra.run.smithi151.stderr:grep: /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph.log: No such file or directory 2023-07-21T23:17:42.423 INFO:tasks.cephadm:Compressing logs... 2023-07-21T23:17:42.424 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-21T23:17:42.428 DEBUG:teuthology.orchestra.run.smithi187:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-21T23:17:42.433 DEBUG:teuthology.orchestra.run.smithi195:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-07-21T23:17:42.504 INFO:teuthology.orchestra.run.smithi195.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-21T23:17:42.504 INFO:teuthology.orchestra.run.smithi195.stderr:: No such file or directory 2023-07-21T23:17:42.513 INFO:teuthology.orchestra.run.smithi195.stderr:gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.5.log 2023-07-21T23:17:42.514 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.2.log 2023-07-21T23:17:42.515 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.11.log 2023-07-21T23:17:42.516 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mgr.z.log 2023-07-21T23:17:42.517 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.8.log 2023-07-21T23:17:42.518 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.f.log 2023-07-21T23:17:42.519 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.c.log 2023-07-21T23:17:42.520 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.i.log 2023-07-21T23:17:42.521 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mon.c.log 2023-07-21T23:17:42.522 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-volume.log 2023-07-21T23:17:42.523 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.l.log 2023-07-21T23:17:42.527 INFO:teuthology.orchestra.run.smithi187.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-21T23:17:42.528 INFO:teuthology.orchestra.run.smithi187.stderr:: No such file or directory 2023-07-21T23:17:42.530 INFO:teuthology.orchestra.run.smithi195.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-volume.log: /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.l.log: 93.4% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mgr.z.log.gz 2023-07-21T23:17:42.530 INFO:teuthology.orchestra.run.smithi195.stderr: 94.6% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.c.log.gz 2023-07-21T23:17:42.539 INFO:teuthology.orchestra.run.smithi151.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/cephadm.log 2023-07-21T23:17:42.539 INFO:teuthology.orchestra.run.smithi151.stderr:: No such file or directory 2023-07-21T23:17:42.548 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2023-07-21T23:17:42.549 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.0.log 2023-07-21T23:17:42.550 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.g.log 2023-07-21T23:17:42.551 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.a.log 2023-07-21T23:17:42.552 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.6.log 2023-07-21T23:17:42.553 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.3.log 2023-07-21T23:17:42.554 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.d.log 2023-07-21T23:17:42.555 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mgr.x.log 2023-07-21T23:17:42.557 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.9.log 2023-07-21T23:17:42.558 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-volume.log 2023-07-21T23:17:42.559 INFO:teuthology.orchestra.run.smithi187.stderr:gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.10.log 2023-07-21T23:17:42.560 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.j.log 2023-07-21T23:17:42.560 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.h.log 2023-07-21T23:17:42.561 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mon.a.log 2023-07-21T23:17:42.561 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.e.log 2023-07-21T23:17:42.562 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.4.log 2023-07-21T23:17:42.563 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.1.log 2023-07-21T23:17:42.564 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.k.log 2023-07-21T23:17:42.565 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-volume.log 2023-07-21T23:17:42.566 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.7.log 2023-07-21T23:17:42.567 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mon.b.log 2023-07-21T23:17:42.568 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.b.log 2023-07-21T23:17:42.569 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mgr.y.log 2023-07-21T23:17:42.583 INFO:teuthology.orchestra.run.smithi187.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.b.log: /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mgr.y.log: 93.4% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mgr.y.log.gz 2023-07-21T23:17:42.727 INFO:teuthology.orchestra.run.smithi195.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-21T23:17:42.821 INFO:teuthology.orchestra.run.smithi195.stderr: 91.6% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-volume.log.gz 2023-07-21T23:17:43.206 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.j.log: /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mon.a.log: 94.6% 94.6% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.g.log.gz -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.a.log.gz 94.5% 91.6% 2023-07-21T23:17:43.206 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-07-21T23:17:43.206 INFO:teuthology.orchestra.run.smithi151.stderr: -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-volume.log.gz -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.d.log.gz 2023-07-21T23:17:43.207 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-07-21T23:17:43.207 INFO:teuthology.orchestra.run.smithi151.stderr: 94.6% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.j.log.gz 2023-07-21T23:17:43.242 INFO:teuthology.orchestra.run.smithi187.stderr: 91.5% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-21T23:17:43.252 INFO:teuthology.orchestra.run.smithi151.stderr: 93.3% -- replaced with /var/log/ceph/cephadm.log.gz 2023-07-21T23:17:43.490 INFO:teuthology.orchestra.run.smithi187.stderr: 91.6% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-volume.log.gz 2023-07-21T23:17:46.169 INFO:teuthology.orchestra.run.smithi187.stderr: 95.0% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.k.log.gz 2023-07-21T23:17:46.194 INFO:teuthology.orchestra.run.smithi151.stderr: 89.9% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mgr.x.log.gz 2023-07-21T23:17:47.082 INFO:teuthology.orchestra.run.smithi187.stderr: 91.9% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mon.b.log.gz 2023-07-21T23:17:47.674 INFO:teuthology.orchestra.run.smithi195.stderr: 94.1% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.f.log.gz 2023-07-21T23:17:47.928 INFO:teuthology.orchestra.run.smithi187.stderr: 95.1% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.e.log.gz 2023-07-21T23:17:48.709 INFO:teuthology.orchestra.run.smithi195.stderr: 91.9% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mon.c.log.gz 2023-07-21T23:17:48.920 INFO:teuthology.orchestra.run.smithi195.stderr: 94.9% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.l.log.gz 2023-07-21T23:17:57.712 INFO:teuthology.orchestra.run.smithi151.stderr: 90.2% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mon.a.log.gz 2023-07-21T23:22:28.912 INFO:teuthology.orchestra.run.smithi187.stderr: 95.2% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.b.log.gz 2023-07-21T23:24:04.696 INFO:teuthology.orchestra.run.smithi187.stderr: 94.6% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.h.log.gz 2023-07-21T23:24:48.192 INFO:teuthology.orchestra.run.smithi195.stderr: 92.3% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.8.log.gz 2023-07-21T23:25:37.653 INFO:teuthology.orchestra.run.smithi195.stderr: 95.0% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-mds.i.log.gz 2023-07-21T23:25:41.457 INFO:teuthology.orchestra.run.smithi187.stderr: 91.8% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.7.log.gz 2023-07-21T23:25:41.474 INFO:teuthology.orchestra.run.smithi195.stderr: 92.3% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.2.log.gz 2023-07-21T23:25:49.373 INFO:teuthology.orchestra.run.smithi187.stderr: 92.2% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.10.log.gz 2023-07-21T23:25:51.046 INFO:teuthology.orchestra.run.smithi195.stderr: 92.1% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.11.log.gz 2023-07-21T23:25:59.039 INFO:teuthology.orchestra.run.smithi151.stderr: 92.2% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.9.log.gz 2023-07-21T23:25:59.253 INFO:teuthology.orchestra.run.smithi187.stderr: 92.6% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.4.log.gz 2023-07-21T23:26:13.317 INFO:teuthology.orchestra.run.smithi187.stderr: 92.1% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.1.log.gz 2023-07-21T23:26:13.328 INFO:teuthology.orchestra.run.smithi187.stderr: 2023-07-21T23:26:13.329 INFO:teuthology.orchestra.run.smithi187.stderr:real 8m30.872s 2023-07-21T23:26:13.329 INFO:teuthology.orchestra.run.smithi187.stderr:user 10m46.130s 2023-07-21T23:26:13.329 INFO:teuthology.orchestra.run.smithi187.stderr:sys 1m32.885s 2023-07-21T23:26:14.819 INFO:teuthology.orchestra.run.smithi195.stderr: 92.2% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.5.log.gz 2023-07-21T23:26:14.824 INFO:teuthology.orchestra.run.smithi195.stderr: 2023-07-21T23:26:14.824 INFO:teuthology.orchestra.run.smithi195.stderr:real 8m32.366s 2023-07-21T23:26:14.824 INFO:teuthology.orchestra.run.smithi195.stderr:user 10m36.641s 2023-07-21T23:26:14.824 INFO:teuthology.orchestra.run.smithi195.stderr:sys 1m31.982s 2023-07-21T23:26:39.588 INFO:teuthology.orchestra.run.smithi151.stderr: 92.1% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.6.log.gz 2023-07-21T23:27:41.158 INFO:teuthology.orchestra.run.smithi151.stderr: 91.9% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.0.log.gz 2023-07-21T23:27:47.962 INFO:teuthology.orchestra.run.smithi151.stderr: 92.1% -- replaced with /var/log/ceph/f5fce3a4-2812-11ee-9b34-001a4aab830c/ceph-osd.3.log.gz 2023-07-21T23:28:19.906 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: /var/log/ceph/ceph-client.0.log: file size changed while zipping 2023-07-21T23:28:19.907 INFO:teuthology.orchestra.run.smithi151.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2023-07-21T23:28:19.911 INFO:teuthology.orchestra.run.smithi151.stderr: 2023-07-21T23:28:19.911 INFO:teuthology.orchestra.run.smithi151.stderr:real 10m37.463s 2023-07-21T23:28:19.911 INFO:teuthology.orchestra.run.smithi151.stderr:user 11m46.243s 2023-07-21T23:28:19.911 INFO:teuthology.orchestra.run.smithi151.stderr:sys 1m39.250s 2023-07-21T23:28:19.912 INFO:tasks.cephadm:Archiving logs... 2023-07-21T23:28:19.913 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/remote/smithi151/log 2023-07-21T23:28:19.914 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-21T23:29:51.787 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/remote/smithi187/log 2023-07-21T23:29:51.789 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-21T23:31:14.995 DEBUG:teuthology.misc:Transferring archived files from smithi195:/var/log/ceph to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/remote/smithi195/log 2023-07-21T23:31:14.996 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /var/log/ceph -- . 2023-07-21T23:32:36.455 INFO:tasks.cephadm:Removing cluster... 2023-07-21T23:32:36.455 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c --force 2023-07-21T23:32:39.264 DEBUG:teuthology.orchestra.run.smithi187:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c --force 2023-07-21T23:32:42.658 DEBUG:teuthology.orchestra.run.smithi195:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f5fce3a4-2812-11ee-9b34-001a4aab830c --force 2023-07-21T23:32:45.965 INFO:tasks.cephadm:Removing cephadm ... 2023-07-21T23:32:45.966 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-21T23:32:46.016 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-21T23:32:46.066 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf /home/ubuntu/cephtest/cephadm 2023-07-21T23:32:46.109 INFO:tasks.cephadm:Teardown complete 2023-07-21T23:32:46.110 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-07-21T23:32:46.125 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_79491cb69dd37a1eafb93b3471998174bdfa2fd9/teuthology/run_tasks.py", line 192, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_bffe049d41f6256b5f1cd35b2ea5c7f5a9a2e7ea/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-07-21T23:32:46.126 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-07-21T23:32:46.127 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-21T23:32:46.132 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-21T23:32:46.137 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-07-21T23:32:46.386 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-07-21T23:32:46.397 INFO:teuthology.task.clock:Checking final clock skew... 2023-07-21T23:32:46.397 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T23:32:46.402 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T23:32:46.407 DEBUG:teuthology.orchestra.run.smithi195:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-07-21T23:32:46.440 INFO:teuthology.orchestra.run.smithi151.stderr:bash: ntpq: command not found 2023-07-21T23:32:46.445 INFO:teuthology.orchestra.run.smithi187.stderr:bash: ntpq: command not found 2023-07-21T23:32:46.448 INFO:teuthology.orchestra.run.smithi195.stderr:bash: ntpq: command not found 2023-07-21T23:32:46.470 INFO:teuthology.orchestra.run.smithi195.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T23:32:46.470 INFO:teuthology.orchestra.run.smithi195.stdout:=============================================================================== 2023-07-21T23:32:46.470 INFO:teuthology.orchestra.run.smithi195.stdout:^* hv01.front.sepia.ceph.com 3 6 377 39 +998us[+1014us] +/- 67ms 2023-07-21T23:32:46.471 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -2654us[-2468us] +/- 78ms 2023-07-21T23:32:46.471 INFO:teuthology.orchestra.run.smithi195.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 +1391us[+1391us] +/- 64ms 2023-07-21T23:32:46.471 INFO:teuthology.orchestra.run.smithi195.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T23:32:46.475 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T23:32:46.476 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-07-21T23:32:46.476 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv01.front.sepia.ceph.com 3 6 377 31 +968us[ +984us] +/- 67ms 2023-07-21T23:32:46.476 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 39 -2701us[-2684us] +/- 78ms 2023-07-21T23:32:46.477 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +1355us[+1371us] +/- 64ms 2023-07-21T23:32:46.477 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T23:32:46.479 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-07-21T23:32:46.479 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-07-21T23:32:46.480 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv01.front.sepia.ceph.com 3 6 377 33 +975us[+1004us] +/- 67ms 2023-07-21T23:32:46.480 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 -2696us[-2667us] +/- 79ms 2023-07-21T23:32:46.480 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 38 +1389us[+1418us] +/- 64ms 2023-07-21T23:32:46.481 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2023-07-21T23:32:46.481 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-07-21T23:32:46.500 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-07-21T23:32:46.501 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-07-21T23:32:46.512 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-21T23:32:46.840 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-21T23:32:47.102 DEBUG:teuthology.orchestra.run.smithi195:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-07-21T23:32:47.364 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-21T23:32:47.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T23:32:47.445 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-21T23:32:47.521 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T23:32:47.522 DEBUG:teuthology.orchestra.run.smithi195:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-07-21T23:32:47.596 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T23:32:47.597 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-07-21T23:32:47.611 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-07-21T23:32:47.623 INFO:teuthology.task.internal:Duration was 6123.705137 seconds 2023-07-21T23:32:47.627 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-07-21T23:32:47.647 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-07-21T23:32:47.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-21T23:32:47.654 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-21T23:32:47.663 DEBUG:teuthology.orchestra.run.smithi195:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-07-21T23:32:47.787 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T23:32:47.797 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T23:32:47.807 INFO:teuthology.orchestra.run.smithi195.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-07-21T23:32:48.206 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-07-21T23:32:48.207 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2023-07-21T23:32:48.207 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-21T23:32:48.286 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2023-07-21T23:32:48.287 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-21T23:32:48.368 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi195.front.sepia.ceph.com 2023-07-21T23:32:48.369 DEBUG:teuthology.orchestra.run.smithi195:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-07-21T23:32:48.444 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-07-21T23:32:48.445 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-21T23:32:48.451 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-21T23:32:48.457 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-07-21T23:32:48.598 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-07-21T23:32:48.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-21T23:32:48.603 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-21T23:32:48.608 DEBUG:teuthology.orchestra.run.smithi195:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-07-21T23:32:48.786 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-07-21T23:32:48.798 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-07-21T23:32:48.798 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-21T23:32:48.880 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-21T23:32:48.951 DEBUG:teuthology.orchestra.run.smithi195:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-07-21T23:32:49.022 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-07-21T23:32:49.035 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-21T23:32:49.040 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-21T23:32:49.045 DEBUG:teuthology.orchestra.run.smithi195:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-07-21T23:32:49.124 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2023-07-21T23:32:49.127 INFO:teuthology.orchestra.run.smithi195.stdout:kernel.core_pattern = core 2023-07-21T23:32:49.128 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2023-07-21T23:32:49.166 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-21T23:32:49.207 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T23:32:49.208 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-21T23:32:49.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T23:32:49.249 DEBUG:teuthology.orchestra.run.smithi195:> test -e /home/ubuntu/cephtest/archive/coredump 2023-07-21T23:32:49.290 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-07-21T23:32:49.290 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-07-21T23:32:49.303 INFO:teuthology.task.internal:Transferring archived files... 2023-07-21T23:32:49.303 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/remote/smithi151 2023-07-21T23:32:49.304 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-21T23:32:49.385 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/remote/smithi187 2023-07-21T23:32:49.385 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-21T23:32:49.464 DEBUG:teuthology.misc:Transferring archived files from smithi195:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721/remote/smithi195 2023-07-21T23:32:49.464 DEBUG:teuthology.orchestra.run.smithi195:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-07-21T23:32:49.542 INFO:teuthology.task.internal:Removing archive directory... 2023-07-21T23:32:49.543 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-21T23:32:49.547 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-21T23:32:49.552 DEBUG:teuthology.orchestra.run.smithi195:> rm -rf -- /home/ubuntu/cephtest/archive 2023-07-21T23:32:49.595 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-07-21T23:32:49.609 INFO:teuthology.task.internal:Not uploading archives. 2023-07-21T23:32:49.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-07-21T23:32:49.620 INFO:teuthology.task.internal:Tidying up after the test... 2023-07-21T23:32:49.620 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-21T23:32:49.630 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-21T23:32:49.635 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-07-21T23:32:49.669 INFO:teuthology.orchestra.run.smithi151.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 21 23:32 /home/ubuntu/cephtest 2023-07-21T23:32:49.673 INFO:teuthology.orchestra.run.smithi187.stdout: 524293 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 21 23:32 /home/ubuntu/cephtest 2023-07-21T23:32:49.677 INFO:teuthology.orchestra.run.smithi195.stdout: 524301 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Jul 21 23:32 /home/ubuntu/cephtest 2023-07-21T23:32:49.681 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-07-21T23:32:49.694 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-07-21T23:32:49.706 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2023-07-21T23:32:49.707 INFO:teuthology.nuke:Checking targets against current locks 2023-07-21T23:32:49.736 DEBUG:teuthology.nuke:shortname: smithi151 2023-07-21T23:32:49.737 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T23:32:49.762 DEBUG:teuthology.nuke:shortname: smithi187 2023-07-21T23:32:49.762 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T23:32:49.766 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:39:47.065139', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T23:32:49.789 DEBUG:teuthology.nuke:shortname: smithi195 2023-07-21T23:32:49.789 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-07-21T23:32:49.794 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:39:47.066295', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-07-21T23:32:49.817 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi195.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-07-21_21:30:53-fs-wip-rishabh-2023Jul13-base-2-testing-default-smithi/7347721', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-07-21 21:39:47.067740', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCpUxo5ay/ucdkX9rleNMm8Ofp24XRXUtJPOK3Ji3XBpTiUgmmwneaY6316+3CG+k4K0p3IebanuyTvZApjm02/dNCvu8yD3rjEpWVgIuqYH8O3lEdN9DXcCX+7xHJE0m18+ZPsJQVsNrNJxY+5zqyNnBc8jpZq2LStsWwPOKPWhauANRkOBFSGDoLppWZbLx/yJs+R0qoNLLK9LpKQTUnqsapXvbD27OpPahzj/qbNxFPPyY6XrrldZ6qEO+EjJOujFLH3gzv0kJu10DCuzxrpz6ston4RPi1O3GgcHnF4Mqr/W9VwZ94UTMh+k4dIFRVqJEKrcwRHa5kFsvH/WhVx0Ygr/MiV/Q86mmV7JT+/MpzIRTtWyei5L9IBeZIE9cwzj+mOk6SD/t1roIVEGVV/uF2AyFDVBPr6F8oZ822OGpUyyaDsWTitPNdTX4TC3zdSrLc9tyDa1P74eH/ZLeTSf+C6pM/cepOhQaa6XzpDiPSuJUm9HOQxUlEAvcqa7Ac='} 2023-07-21T23:32:49.826 INFO:teuthology.orchestra.console:Power off smithi151 2023-07-21T23:32:49.827 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T23:32:49.856 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:32:49.877 INFO:teuthology.orchestra.console:Power off smithi187 2023-07-21T23:32:49.877 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T23:32:49.902 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:32:49.920 INFO:teuthology.orchestra.console:Power off smithi195 2023-07-21T23:32:49.921 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-07-21T23:32:49.942 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:32:53.892 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:32:53.931 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:32:53.967 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:32:58.008 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:32:58.044 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:32:58.081 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi195.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:32:58.293 INFO:teuthology.orchestra.console:Power off for smithi195 completed 2023-07-21T23:33:02.124 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi151.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:33:02.158 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-07-21T23:33:02.336 INFO:teuthology.orchestra.console:Power off for smithi151 completed 2023-07-21T23:33:02.370 INFO:teuthology.orchestra.console:Power off for smithi187 completed 2023-07-21T23:33:02.475 INFO:teuthology.run:Summary data: description: fs/workload/{0-rhel_8 begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mon osd} mount/fuse objectstore-ec/bluestore-comp omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts session_timeout} ranks/multi/{export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-workunit/postgres}} duration: 6123.705137252808 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default mon.a-kernel-sha1: c685da6f56cc77f2cfb9c4221be3960522616caf mon.b-kernel-sha1: c685da6f56cc77f2cfb9c4221be3960522616caf mon.c-kernel-sha1: c685da6f56cc77f2cfb9c4221be3960522616caf owner: scheduled_rishabh@teuthology status: fail success: false 2023-07-21T23:33:02.475 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-07-21T23:33:02.551 INFO:teuthology.run:FAIL